2024-05-30T16:33:25.418 INFO:root:teuthology version: 0.0.1.dev296+ge1979f0 2024-05-30T16:33:25.418 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145 --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} --owner scheduled_rishabh@teuthology --verbose --name rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi -- /home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145/orig.config.yaml 2024-05-30T16:33:25.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-30T16:33:25.560 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145 branch: rishabh-clone-stats description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} email: null first_in_suite: false job_id: '7734145' kernel: flavor: default kdb: 1 sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-clone-stats ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-clone-stats sha1: 019a0d1fdedb1237f85e8a3711761fae4e094286 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3537 sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-clone-stats suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 019a0d1fdedb1237f85e8a3711761fae4e094286 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBApOi4fetpPdO198zdHnJ4fAOWsVtQrijUbE6v+WXLau1v2Gq/+87uE8ckA0UVTklK8hmdRHrrQcAJIbZ0we7WI= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyOjsk0R9+cVEpkEzG36pbb4mXPnHoql4zG5mYHDwd/lzYEhCYv/rmU7yepgHjsoR+nkrlu02cR2GPP+JK6HC8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestCloneProgressReporter teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e1979f064b0becde2020282c7e87cf3c5e98026c timestamp: 2024-05-30_16:11:34 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-30T16:33:25.561 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa; will attempt to use it 2024-05-30T16:33:25.561 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks 2024-05-30T16:33:25.561 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-30T16:33:25.563 INFO:teuthology.task.internal:Checking packages... 2024-05-30T16:33:25.584 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9ed025fbf4406fb54980a0647506b15895b6d863' 2024-05-30T16:33:25.584 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-30T16:33:25.585 INFO:teuthology.packaging:ref: None 2024-05-30T16:33:25.585 INFO:teuthology.packaging:tag: None 2024-05-30T16:33:25.585 INFO:teuthology.packaging:branch: rishabh-clone-stats 2024-05-30T16:33:25.585 INFO:teuthology.packaging:sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T16:33:25.585 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-clone-stats 2024-05-30T16:33:25.804 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3154-g9ed025fb-1jammy 2024-05-30T16:33:25.805 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-30T16:33:25.812 INFO:teuthology.task.internal:no buildpackages task found 2024-05-30T16:33:25.813 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-30T16:33:25.893 INFO:teuthology.task.internal:Saving configuration 2024-05-30T16:33:25.909 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-30T16:33:25.916 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-30T16:33:25.938 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-30 16:27:49.631288', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOOz2LM8vXfMxJYq0DVRh35Pqt5CRHuFAKnRGrsvFRKn'} 2024-05-30T16:33:25.962 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-30 16:27:49.632611', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBtES7q7UcFtDt+KNK9NCOm6umTJqm0J6Bd41RFSX5ZP'} 2024-05-30T16:33:25.962 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-30T16:33:25.968 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-30T16:33:25.968 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-30T16:33:25.969 INFO:teuthology.run_tasks:Running task console_log... 2024-05-30T16:33:26.063 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7e5d0b7be0>, signals=[15]) 2024-05-30T16:33:26.063 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-30T16:33:26.069 INFO:teuthology.task.internal:Opening connections... 2024-05-30T16:33:26.069 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T16:33:26.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:33:26.149 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T16:33:26.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:33:26.228 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-30T16:33:26.234 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-05-30T16:33:26.239 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-05-30T16:33:26.240 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-05-30T16:33:26.288 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-30T16:33:26.288 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Ubuntu" 2024-05-30T16:33:26.288 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="22.04" 2024-05-30T16:33:26.288 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-30T16:33:26.288 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_CODENAME=jammy 2024-05-30T16:33:26.288 INFO:teuthology.orchestra.run.smithi059.stdout:ID=ubuntu 2024-05-30T16:33:26.288 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE=debian 2024-05-30T16:33:26.288 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-30T16:33:26.288 INFO:teuthology.orchestra.run.smithi059.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-30T16:33:26.289 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-30T16:33:26.289 INFO:teuthology.orchestra.run.smithi059.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-30T16:33:26.289 INFO:teuthology.orchestra.run.smithi059.stdout:UBUNTU_CODENAME=jammy 2024-05-30T16:33:26.289 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-05-30T16:33:26.306 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-05-30T16:33:26.311 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-05-30T16:33:26.311 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-05-30T16:33:26.355 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-30T16:33:26.355 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2024-05-30T16:33:26.355 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="22.04" 2024-05-30T16:33:26.355 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-30T16:33:26.355 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=jammy 2024-05-30T16:33:26.355 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2024-05-30T16:33:26.355 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2024-05-30T16:33:26.356 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-30T16:33:26.356 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-30T16:33:26.356 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-30T16:33:26.356 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-30T16:33:26.356 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=jammy 2024-05-30T16:33:26.356 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-05-30T16:33:26.372 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-30T16:33:26.381 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-30T16:33:26.416 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-30T16:33:26.416 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-05-30T16:33:26.419 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-05-30T16:33:26.423 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-30T16:33:26.470 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-30T16:33:26.470 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-05-30T16:33:26.472 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-05-30T16:33:26.485 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-30T16:33:26.570 INFO:teuthology.run_tasks:Running task kernel... 2024-05-30T16:33:26.604 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'} 2024-05-30T16:33:26.604 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}}, timeout 300 2024-05-30T16:33:26.605 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-30T16:33:26.605 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-30T16:33:26.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:33:26.610 DEBUG:teuthology.task.kernel:sha1 for mon.b is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:33:26.610 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-30T16:33:26.610 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-05-30T16:33:26.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:33:26.611 DEBUG:teuthology.task.kernel:sha1 for mon.a is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:33:26.611 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-30T16:33:26.612 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-05-30T16:33:26.656 INFO:teuthology.orchestra.run.smithi107.stdout:5.15.0-56-generic 2024-05-30T16:33:26.656 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:33:26.656 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-30T16:33:26.657 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:33:26.663 INFO:teuthology.orchestra.run.smithi059.stdout:5.15.0-56-generic 2024-05-30T16:33:26.664 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:33:26.664 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-30T16:33:26.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:33:26.797 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-05-30T16:33:26.797 DEBUG:teuthology.orchestra.run.smithi107:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-05-30T16:33:26.804 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-05-30T16:33:26.804 DEBUG:teuthology.orchestra.run.smithi059:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-05-30T16:33:26.810 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-05-30T16:33:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-05-30T16:33:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-05-30T16:33:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-05-30T16:33:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-05-30T16:33:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:hint: 2024-05-30T16:33:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:hint: git config --global init.defaultBranch 2024-05-30T16:33:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:hint: 2024-05-30T16:33:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-05-30T16:33:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-05-30T16:33:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:hint: 2024-05-30T16:33:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:hint: git branch -m 2024-05-30T16:33:26.958 INFO:teuthology.orchestra.run.smithi059.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-05-30T16:33:26.960 DEBUG:teuthology.orchestra.run.smithi059:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-05-30T16:33:26.967 INFO:teuthology.orchestra.run.smithi107.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-05-30T16:33:26.967 INFO:teuthology.orchestra.run.smithi107.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-05-30T16:33:26.967 INFO:teuthology.orchestra.run.smithi107.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-05-30T16:33:26.967 INFO:teuthology.orchestra.run.smithi107.stderr:hint: 2024-05-30T16:33:26.967 INFO:teuthology.orchestra.run.smithi107.stderr:hint: git config --global init.defaultBranch 2024-05-30T16:33:26.967 INFO:teuthology.orchestra.run.smithi107.stderr:hint: 2024-05-30T16:33:26.967 INFO:teuthology.orchestra.run.smithi107.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-05-30T16:33:26.967 INFO:teuthology.orchestra.run.smithi107.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-05-30T16:33:26.967 INFO:teuthology.orchestra.run.smithi107.stderr:hint: 2024-05-30T16:33:26.967 INFO:teuthology.orchestra.run.smithi107.stderr:hint: git branch -m 2024-05-30T16:33:26.968 INFO:teuthology.orchestra.run.smithi107.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-05-30T16:33:26.970 DEBUG:teuthology.orchestra.run.smithi107:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-05-30T16:33:27.030 DEBUG:teuthology.orchestra.run.smithi059:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-05-30T16:33:27.042 DEBUG:teuthology.orchestra.run.smithi107:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-05-30T16:33:27.086 DEBUG:teuthology.orchestra.run.smithi059:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-05-30T16:33:27.100 DEBUG:teuthology.orchestra.run.smithi107:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-05-30T16:34:08.691 INFO:teuthology.orchestra.run.smithi107.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-05-30T16:34:08.691 INFO:teuthology.orchestra.run.smithi107.stderr: * [new branch] main -> origin/main 2024-05-30T16:34:08.717 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20190312 -> 20190312 2024-05-30T16:34:08.717 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20190416 -> 20190416 2024-05-30T16:34:08.718 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20190514 -> 20190514 2024-05-30T16:34:08.718 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20190618 -> 20190618 2024-05-30T16:34:08.718 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20190717 -> 20190717 2024-05-30T16:34:08.718 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20190815 -> 20190815 2024-05-30T16:34:08.718 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20190923 -> 20190923 2024-05-30T16:34:08.718 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20191022 -> 20191022 2024-05-30T16:34:08.718 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20191215 -> 20191215 2024-05-30T16:34:08.720 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20200122 -> 20200122 2024-05-30T16:34:08.721 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20200316 -> 20200316 2024-05-30T16:34:08.721 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20200421 -> 20200421 2024-05-30T16:34:08.721 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20200519 -> 20200519 2024-05-30T16:34:08.721 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20200619 -> 20200619 2024-05-30T16:34:08.721 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20200721 -> 20200721 2024-05-30T16:34:08.721 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20200817 -> 20200817 2024-05-30T16:34:08.721 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20200918 -> 20200918 2024-05-30T16:34:08.721 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20201022 -> 20201022 2024-05-30T16:34:08.721 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20201118 -> 20201118 2024-05-30T16:34:08.721 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20201218 -> 20201218 2024-05-30T16:34:08.721 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20210208 -> 20210208 2024-05-30T16:34:08.721 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20210315 -> 20210315 2024-05-30T16:34:08.722 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20210511 -> 20210511 2024-05-30T16:34:08.722 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20210716 -> 20210716 2024-05-30T16:34:08.722 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20210818 -> 20210818 2024-05-30T16:34:08.722 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20210919 -> 20210919 2024-05-30T16:34:08.722 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20211027 -> 20211027 2024-05-30T16:34:08.722 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20211216 -> 20211216 2024-05-30T16:34:08.722 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20220209 -> 20220209 2024-05-30T16:34:08.722 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20220310 -> 20220310 2024-05-30T16:34:08.722 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20220411 -> 20220411 2024-05-30T16:34:08.722 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20220509 -> 20220509 2024-05-30T16:34:08.723 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20220610 -> 20220610 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20220708 -> 20220708 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20220815 -> 20220815 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20220913 -> 20220913 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20221012 -> 20221012 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20221109 -> 20221109 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20221214 -> 20221214 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20230117 -> 20230117 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20230210 -> 20230210 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20230310 -> 20230310 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20230404 -> 20230404 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20230515 -> 20230515 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20230625 -> 20230625 2024-05-30T16:34:08.725 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20230804 -> 20230804 2024-05-30T16:34:08.726 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20230919 -> 20230919 2024-05-30T16:34:08.726 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20231030 -> 20231030 2024-05-30T16:34:08.726 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20231111 -> 20231111 2024-05-30T16:34:08.726 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20231211 -> 20231211 2024-05-30T16:34:08.726 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20240115 -> 20240115 2024-05-30T16:34:08.726 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20240220 -> 20240220 2024-05-30T16:34:08.726 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20240312 -> 20240312 2024-05-30T16:34:08.726 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20240410 -> 20240410 2024-05-30T16:34:08.726 INFO:teuthology.orchestra.run.smithi107.stderr: * [new tag] 20240513 -> 20240513 2024-05-30T16:34:13.008 INFO:teuthology.orchestra.run.smithi107.stderr:Updating files: 45% (1560/3422) Updating files: 46% (1575/3422) Updating files: 47% (1609/3422) Updating files: 48% (1643/3422) Updating files: 49% (1677/3422) Updating files: 50% (1711/3422) Updating files: 51% (1746/3422) Updating files: 52% (1780/3422) Updating files: 53% (1814/3422) Updating files: 54% (1848/3422) Updating files: 55% (1883/3422) Updating files: 56% (1917/3422) Updating files: 57% (1951/3422) Updating files: 58% (1985/3422) Updating files: 59% (2019/3422) Updating files: 59% (2046/3422) Updating files: 60% (2054/3422) Updating files: 61% (2088/3422) Updating files: 62% (2122/3422) Updating files: 63% (2156/3422) Updating files: 64% (2191/3422) Updating files: 65% (2225/3422) Updating files: 66% (2259/3422) Updating files: 67% (2293/3422) Updating files: 68% (2327/3422) Updating files: 69% (2362/3422) Updating files: 70% (2396/3422) Updating files: 70% (2402/3422) Updating files: 71% (2430/3422) Updating files: 72% (2464/3422) Updating files: 73% (2499/3422) Updating files: 74% (2533/3422) Updating files: 75% (2567/3422) Updating files: 76% (2601/3422) Updating files: 77% (2635/3422) Updating files: 78% (2670/3422) Updating files: 79% (2704/3422) Updating files: 80% (2738/3422) Updating files: 81% (2772/3422) Updating files: 82% (2807/3422) Updating files: 83% (2841/3422) Updating files: 83% (2850/3422) Updating files: 84% (2875/3422) Updating files: 85% (2909/3422) Updating files: 86% (2943/3422) Updating files: 87% (2978/3422) Updating files: 88% (3012/3422) Updating files: 89% (3046/3422) Updating files: 90% (3080/3422) Updating files: 91% (3115/3422) Updating files: 92% (3149/3422) Updating files: 93% (3183/3422) Updating files: 94% (3217/3422) Updating files: 95% (3251/3422) Updating files: 96% (3286/3422) Updating files: 97% (3320/3422) Updating files: 98% (3354/3422) Updating files: 99% (3388/3422) Updating files: 100% (3422/3422) Updating files: 100% (3422/3422), done. 2024-05-30T16:34:13.013 INFO:teuthology.orchestra.run.smithi107.stdout:HEAD is now at 92d264e8 Merge branch 'robot/patch-0-1716949439' into 'main' 2024-05-30T16:34:13.034 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on mon.b... 2024-05-30T16:34:13.035 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:34:13.254 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ 2024-05-30T16:34:13.254 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ --input-file=- 2024-05-30T16:34:13.257 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi107.front.sepia.ceph.com to complete... 2024-05-30T16:34:13.455 INFO:teuthology.orchestra.run.smithi059.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-05-30T16:34:13.455 INFO:teuthology.orchestra.run.smithi059.stderr: * [new branch] main -> origin/main 2024-05-30T16:34:13.490 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190312 -> 20190312 2024-05-30T16:34:13.490 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190416 -> 20190416 2024-05-30T16:34:13.490 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190514 -> 20190514 2024-05-30T16:34:13.490 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190618 -> 20190618 2024-05-30T16:34:13.490 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190717 -> 20190717 2024-05-30T16:34:13.490 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190815 -> 20190815 2024-05-30T16:34:13.491 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190923 -> 20190923 2024-05-30T16:34:13.491 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20191022 -> 20191022 2024-05-30T16:34:13.492 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20191215 -> 20191215 2024-05-30T16:34:13.492 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200122 -> 20200122 2024-05-30T16:34:13.492 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200316 -> 20200316 2024-05-30T16:34:13.492 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200421 -> 20200421 2024-05-30T16:34:13.492 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200519 -> 20200519 2024-05-30T16:34:13.492 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200619 -> 20200619 2024-05-30T16:34:13.492 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200721 -> 20200721 2024-05-30T16:34:13.492 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200817 -> 20200817 2024-05-30T16:34:13.493 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200918 -> 20200918 2024-05-30T16:34:13.493 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20201022 -> 20201022 2024-05-30T16:34:13.493 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20201118 -> 20201118 2024-05-30T16:34:13.494 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20201218 -> 20201218 2024-05-30T16:34:13.494 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20210208 -> 20210208 2024-05-30T16:34:13.494 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20210315 -> 20210315 2024-05-30T16:34:13.494 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20210511 -> 20210511 2024-05-30T16:34:13.494 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20210716 -> 20210716 2024-05-30T16:34:13.494 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20210818 -> 20210818 2024-05-30T16:34:13.494 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20210919 -> 20210919 2024-05-30T16:34:13.494 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20211027 -> 20211027 2024-05-30T16:34:13.494 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20211216 -> 20211216 2024-05-30T16:34:13.499 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220209 -> 20220209 2024-05-30T16:34:13.499 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220310 -> 20220310 2024-05-30T16:34:13.499 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220411 -> 20220411 2024-05-30T16:34:13.499 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220509 -> 20220509 2024-05-30T16:34:13.499 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220610 -> 20220610 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220708 -> 20220708 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220815 -> 20220815 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220913 -> 20220913 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20221012 -> 20221012 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20221109 -> 20221109 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20221214 -> 20221214 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230117 -> 20230117 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230210 -> 20230210 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230310 -> 20230310 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230404 -> 20230404 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230515 -> 20230515 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230625 -> 20230625 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230804 -> 20230804 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230919 -> 20230919 2024-05-30T16:34:13.500 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20231030 -> 20231030 2024-05-30T16:34:13.501 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20231111 -> 20231111 2024-05-30T16:34:13.501 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20231211 -> 20231211 2024-05-30T16:34:13.501 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20240115 -> 20240115 2024-05-30T16:34:13.501 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20240220 -> 20240220 2024-05-30T16:34:13.501 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20240312 -> 20240312 2024-05-30T16:34:13.501 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20240410 -> 20240410 2024-05-30T16:34:13.501 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20240513 -> 20240513 2024-05-30T16:34:15.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30 16:34:15 URL:https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb [44988888/44988888] -> "/tmp/linux-image.deb" [1] 2024-05-30T16:34:15.359 INFO:teuthology.orchestra.run.smithi107.stderr:FINISHED --2024-05-30 16:34:15-- 2024-05-30T16:34:15.359 INFO:teuthology.orchestra.run.smithi107.stderr:Total wall clock time: 2.1s 2024-05-30T16:34:15.359 INFO:teuthology.orchestra.run.smithi107.stderr:Downloaded: 1 files, 43M in 1.9s (22.9 MB/s) 2024-05-30T16:34:15.363 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on mon.b... 2024-05-30T16:34:15.363 DEBUG:teuthology.orchestra.run.smithi107:> sudo dpkg -i /tmp/linux-image.deb 2024-05-30T16:34:15.629 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-image-6.9.0-gb9459a26b088. 2024-05-30T16:34:17.659 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-05-30T16:34:17.663 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-05-30T16:34:17.814 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-30T16:34:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:Updating files: 44% (1532/3422) Updating files: 45% (1540/3422) Updating files: 46% (1575/3422) Updating files: 47% (1609/3422) Updating files: 48% (1643/3422) Updating files: 49% (1677/3422) Updating files: 50% (1711/3422) Updating files: 51% (1746/3422) Updating files: 52% (1780/3422) Updating files: 53% (1814/3422) Updating files: 54% (1848/3422) Updating files: 55% (1883/3422) Updating files: 56% (1917/3422) Updating files: 57% (1951/3422) Updating files: 58% (1985/3422) Updating files: 58% (2013/3422) Updating files: 59% (2019/3422) Updating files: 60% (2054/3422) Updating files: 61% (2088/3422) Updating files: 62% (2122/3422) Updating files: 63% (2156/3422) Updating files: 64% (2191/3422) Updating files: 65% (2225/3422) Updating files: 66% (2259/3422) Updating files: 67% (2293/3422) Updating files: 68% (2327/3422) Updating files: 69% (2362/3422) Updating files: 69% (2367/3422) Updating files: 70% (2396/3422) Updating files: 71% (2430/3422) Updating files: 72% (2464/3422) Updating files: 73% (2499/3422) Updating files: 74% (2533/3422) Updating files: 75% (2567/3422) Updating files: 76% (2601/3422) Updating files: 77% (2635/3422) Updating files: 78% (2670/3422) Updating files: 79% (2704/3422) Updating files: 80% (2738/3422) Updating files: 81% (2772/3422) Updating files: 82% (2807/3422) Updating files: 82% (2820/3422) Updating files: 83% (2841/3422) Updating files: 84% (2875/3422) Updating files: 85% (2909/3422) Updating files: 86% (2943/3422) Updating files: 87% (2978/3422) Updating files: 88% (3012/3422) Updating files: 89% (3046/3422) Updating files: 90% (3080/3422) Updating files: 91% (3115/3422) Updating files: 92% (3149/3422) Updating files: 93% (3183/3422) Updating files: 94% (3217/3422) Updating files: 95% (3251/3422) Updating files: 96% (3286/3422) Updating files: 97% (3320/3422) Updating files: 98% (3354/3422) Updating files: 99% (3388/3422) Updating files: 100% (3422/3422) Updating files: 100% (3422/3422), done. 2024-05-30T16:34:18.041 INFO:teuthology.orchestra.run.smithi059.stdout:HEAD is now at 92d264e8 Merge branch 'robot/patch-0-1716949439' into 'main' 2024-05-30T16:34:18.063 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on mon.a... 2024-05-30T16:34:18.064 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:34:18.282 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ 2024-05-30T16:34:18.282 DEBUG:teuthology.orchestra.run.smithi059:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ --input-file=- 2024-05-30T16:34:18.284 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi059.front.sepia.ceph.com to complete... 2024-05-30T16:34:20.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30 16:34:20 URL:https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb [44988888/44988888] -> "/tmp/linux-image.deb" [1] 2024-05-30T16:34:20.201 INFO:teuthology.orchestra.run.smithi059.stderr:FINISHED --2024-05-30 16:34:20-- 2024-05-30T16:34:20.201 INFO:teuthology.orchestra.run.smithi059.stderr:Total wall clock time: 1.9s 2024-05-30T16:34:20.201 INFO:teuthology.orchestra.run.smithi059.stderr:Downloaded: 1 files, 43M in 1.7s (25.8 MB/s) 2024-05-30T16:34:20.205 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on mon.a... 2024-05-30T16:34:20.205 DEBUG:teuthology.orchestra.run.smithi059:> sudo dpkg -i /tmp/linux-image.deb 2024-05-30T16:34:20.489 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-image-6.9.0-gb9459a26b088. 2024-05-30T16:34:22.012 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-30T16:34:22.114 INFO:teuthology.orchestra.run.smithi107.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-30T16:34:22.489 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-05-30T16:34:22.493 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-05-30T16:34:22.709 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-30T16:34:26.931 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-30T16:34:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-30T16:34:44.438 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub' 2024-05-30T16:34:44.449 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-30T16:34:44.481 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-05-30T16:34:44.817 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T16:34:44.835 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-30T16:34:45.115 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-30T16:34:45.121 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-30T16:34:45.184 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-30T16:34:45.190 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-30T16:34:45.339 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-30T16:34:45.339 INFO:teuthology.orchestra.run.smithi107.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-30T16:34:45.339 INFO:teuthology.orchestra.run.smithi107.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-30T16:34:45.380 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-05-30T16:34:45.576 DEBUG:teuthology.orchestra.run.smithi107:> dpkg-deb -c /tmp/linux-image.deb 2024-05-30T16:34:45.626 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./ 2024-05-30T16:34:45.626 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./boot/ 2024-05-30T16:34:45.626 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7004139 2024-05-23 11:07 ./boot/System.map-6.9.0-gb9459a26b088 2024-05-30T16:34:45.641 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 172251 2024-05-23 11:07 ./boot/config-6.9.0-gb9459a26b088 2024-05-30T16:34:45.641 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13136896 2024-05-23 11:07 ./boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T16:34:45.661 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/ 2024-05-30T16:34:45.661 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/ 2024-05-30T16:34:45.661 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postinst.d/ 2024-05-30T16:34:45.661 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postrm.d/ 2024-05-30T16:34:45.661 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/preinst.d/ 2024-05-30T16:34:45.661 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/prerm.d/ 2024-05-30T16:34:45.662 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/ 2024-05-30T16:34:45.662 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/ 2024-05-30T16:34:45.662 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/ 2024-05-30T16:34:45.662 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/ 2024-05-30T16:34:45.662 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/ 2024-05-30T16:34:45.662 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/ 2024-05-30T16:34:45.662 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ 2024-05-30T16:34:45.662 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 507497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/aesni-intel.ko 2024-05-30T16:34:45.665 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-30T16:34:45.665 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-30T16:34:45.665 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-30T16:34:45.665 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 97945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-30T16:34:45.665 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 109897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-30T16:34:45.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 155241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-30T16:34:45.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-30T16:34:45.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-30T16:34:45.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 87001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-30T16:34:45.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-30T16:34:45.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 50297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-30T16:34:45.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 50369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-30T16:34:45.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 54505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-30T16:34:45.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-30T16:34:45.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 48041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 62865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 53561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/ 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/ 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/ 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 49073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpuid.ko 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/msr.ko 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/ 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 443289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-30T16:34:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1037081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-30T16:34:45.668 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 2850153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-30T16:34:45.746 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ 2024-05-30T16:34:45.746 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/af_alg.ko 2024-05-30T16:34:45.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_hash.ko 2024-05-30T16:34:45.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_skcipher.ko 2024-05-30T16:34:45.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-30T16:34:45.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-30T16:34:45.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-30T16:34:45.747 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/ 2024-05-30T16:34:45.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-05-30T16:34:45.747 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/ 2024-05-30T16:34:45.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-30T16:34:45.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-30T16:34:45.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-30T16:34:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-30T16:34:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-30T16:34:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-30T16:34:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-30T16:34:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-30T16:34:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-30T16:34:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-30T16:34:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-30T16:34:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-30T16:34:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-30T16:34:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-30T16:34:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-30T16:34:45.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-30T16:34:45.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-30T16:34:45.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-30T16:34:45.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cryptd.ko 2024-05-30T16:34:45.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 48105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-30T16:34:45.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_simd.ko 2024-05-30T16:34:45.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-30T16:34:45.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-30T16:34:45.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-30T16:34:45.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-30T16:34:45.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-30T16:34:45.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-30T16:34:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-30T16:34:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-30T16:34:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lrw.ko 2024-05-30T16:34:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-30T16:34:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-30T16:34:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-30T16:34:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-30T16:34:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-30T16:34:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-30T16:34:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-30T16:34:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-30T16:34:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 169057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xts.ko 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ 2024-05-30T16:34:45.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_extlog.ko 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/ 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/einj.ko 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 119017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 99177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci.ko 2024-05-30T16:34:45.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 107729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-30T16:34:45.753 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-30T16:34:45.754 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-30T16:34:45.754 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-30T16:34:45.754 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-30T16:34:45.754 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-30T16:34:45.754 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-30T16:34:45.754 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-30T16:34:45.754 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 60249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_legacy.ko 2024-05-30T16:34:45.754 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-30T16:34:45.754 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-30T16:34:45.754 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-30T16:34:45.754 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-30T16:34:45.754 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-30T16:34:45.755 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-30T16:34:45.755 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-30T16:34:45.755 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-30T16:34:45.755 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-30T16:34:45.755 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-30T16:34:45.755 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-30T16:34:45.755 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-30T16:34:45.755 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-30T16:34:45.755 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_radisys.ko 2024-05-30T16:34:45.755 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-30T16:34:45.755 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rz1000.ko 2024-05-30T16:34:45.755 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 102113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 85401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-30T16:34:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 45897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 53345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/ 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 163833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/ 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/ 2024-05-30T16:34:45.757 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 140833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-30T16:34:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/ 2024-05-30T16:34:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1241585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-30T16:34:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 203281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-30T16:34:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/ 2024-05-30T16:34:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 115257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-30T16:34:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 143425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-30T16:34:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/ 2024-05-30T16:34:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 126609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-30T16:34:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 119865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-30T16:34:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 313209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-30T16:34:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/ 2024-05-30T16:34:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 117217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-30T16:34:45.759 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/ 2024-05-30T16:34:45.759 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 70369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-30T16:34:45.759 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ 2024-05-30T16:34:45.759 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/applicom.ko 2024-05-30T16:34:45.759 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-30T16:34:45.759 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/ 2024-05-30T16:34:45.759 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-30T16:34:45.759 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-30T16:34:45.759 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-30T16:34:45.759 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-30T16:34:45.759 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-30T16:34:45.759 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 186913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 179441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 85433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/ 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 103385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/nvram.ko 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 59233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-30T16:34:45.760 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/ 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 39185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/ 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_class.ko 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 62537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_core.ko 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/ 2024-05-30T16:34:45.761 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-palmas.ko 2024-05-30T16:34:45.762 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 57281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-si5351.ko 2024-05-30T16:34:45.762 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-twl6040.ko 2024-05-30T16:34:45.762 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-wm831x.ko 2024-05-30T16:34:45.762 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/ 2024-05-30T16:34:45.762 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-30T16:34:45.762 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-30T16:34:45.762 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-30T16:34:45.762 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ 2024-05-30T16:34:45.762 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ 2024-05-30T16:34:45.762 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 89209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-30T16:34:45.762 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 333593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-30T16:34:45.762 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/ 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/ 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/ 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 751433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/ 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 90465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/ 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ 2024-05-30T16:34:45.763 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/ 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 146745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 96137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 51097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-30T16:34:45.764 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 64153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-30T16:34:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-30T16:34:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-30T16:34:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 68689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-30T16:34:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-30T16:34:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/ 2024-05-30T16:34:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-gpio.ko 2024-05-30T16:34:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max14577.ko 2024-05-30T16:34:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max77693.ko 2024-05-30T16:34:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max8997.ko 2024-05-30T16:34:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-palmas.ko 2024-05-30T16:34:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-rt8973a.ko 2024-05-30T16:34:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-sm5502.ko 2024-05-30T16:34:45.766 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/ 2024-05-30T16:34:45.766 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/dmi-sysfs.ko 2024-05-30T16:34:45.766 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/ 2024-05-30T16:34:45.766 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/efi-pstore.ko 2024-05-30T16:34:45.766 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-30T16:34:45.766 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/ 2024-05-30T16:34:45.766 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-adp5520.ko 2024-05-30T16:34:45.766 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-amd8111.ko 2024-05-30T16:34:45.766 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-arizona.ko 2024-05-30T16:34:45.766 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9052.ko 2024-05-30T16:34:45.766 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9055.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-dln2.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 81065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-f7188x.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-generic.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-kempld.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-lp3943.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max7300.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max730x.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max732x.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pca953x.ko 2024-05-30T16:34:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pcf857x.ko 2024-05-30T16:34:45.768 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-rdc321x.ko 2024-05-30T16:34:45.768 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch.ko 2024-05-30T16:34:45.768 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch311x.ko 2024-05-30T16:34:45.768 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-tps65912.ko 2024-05-30T16:34:45.768 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl4030.ko 2024-05-30T16:34:45.768 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl6040.ko 2024-05-30T16:34:45.768 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-30T16:34:45.768 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-vx855.ko 2024-05-30T16:34:45.768 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm831x.ko 2024-05-30T16:34:45.768 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8350.ko 2024-05-30T16:34:45.768 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8994.ko 2024-05-30T16:34:45.768 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/ 2024-05-30T16:34:45.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-a4tech.ko 2024-05-30T16:34:45.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-apple.ko 2024-05-30T16:34:45.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-30T16:34:45.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-30T16:34:45.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-30T16:34:45.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-belkin.ko 2024-05-30T16:34:45.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cherry.ko 2024-05-30T16:34:45.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-chicony.ko 2024-05-30T16:34:45.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 74385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cp2112.ko 2024-05-30T16:34:45.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cypress.ko 2024-05-30T16:34:45.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-30T16:34:45.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-30T16:34:45.770 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-30T16:34:45.770 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-30T16:34:45.770 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ezkey.ko 2024-05-30T16:34:45.770 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-30T16:34:45.770 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-generic.ko 2024-05-30T16:34:45.770 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-30T16:34:45.770 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-30T16:34:45.770 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-30T16:34:45.770 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-30T16:34:45.770 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-30T16:34:45.770 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-30T16:34:45.770 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kensington.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 54209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lg-g15.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 121361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 97929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-magicmouse.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-microsoft.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-monterey.ko 2024-05-30T16:34:45.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 58993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-30T16:34:45.772 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 39689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ntrig.ko 2024-05-30T16:34:45.772 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-30T16:34:45.772 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-30T16:34:45.772 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-30T16:34:45.772 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 91217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-30T16:34:45.772 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-30T16:34:45.772 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-30T16:34:45.772 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-30T16:34:45.772 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-30T16:34:45.772 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-30T16:34:45.772 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-30T16:34:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-30T16:34:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-30T16:34:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-30T16:34:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-30T16:34:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-30T16:34:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-30T16:34:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-30T16:34:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-30T16:34:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-30T16:34:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-30T16:34:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-30T16:34:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-30T16:34:45.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-30T16:34:45.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-30T16:34:45.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 62121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-30T16:34:45.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-30T16:34:45.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-30T16:34:45.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-30T16:34:45.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-30T16:34:45.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-30T16:34:45.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-30T16:34:45.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-30T16:34:45.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 81097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 184729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 319897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid.ko 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 39521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/ 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 153617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbhid.ko 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbkbd.ko 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbmouse.ko 2024-05-30T16:34:45.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 261929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-30T16:34:45.776 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/ 2024-05-30T16:34:45.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 75057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-30T16:34:45.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 110657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-30T16:34:45.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 381625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-30T16:34:45.776 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ 2024-05-30T16:34:45.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 77145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-30T16:34:45.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 67001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-30T16:34:45.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-30T16:34:45.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-30T16:34:45.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-30T16:34:45.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-30T16:34:45.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-30T16:34:45.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 115049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-30T16:34:45.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-30T16:34:45.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-30T16:34:45.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-30T16:34:45.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-30T16:34:45.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-30T16:34:45.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-30T16:34:45.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 89017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-30T16:34:45.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 49145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-30T16:34:45.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 81465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-30T16:34:45.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-30T16:34:45.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 48169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 68857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 60185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 69001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 47969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9052-hwmon.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9055-hwmon.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 113129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-30T16:34:45.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc2103.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 78913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 108953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 50689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 59753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 56305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hih6130.ko 2024-05-30T16:34:45.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 156457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/jc42.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 57761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-30T16:34:45.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-30T16:34:45.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-30T16:34:45.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-30T16:34:45.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-30T16:34:45.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-30T16:34:45.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-30T16:34:45.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 86489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-30T16:34:45.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-30T16:34:45.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 76481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-30T16:34:45.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-30T16:34:45.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 131497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-30T16:34:45.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-30T16:34:45.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-30T16:34:45.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 39721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mc13783-adc.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 56497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 141345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 72729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 67769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 97769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 61913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-30T16:34:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ 2024-05-30T16:34:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-30T16:34:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-30T16:34:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-30T16:34:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-30T16:34:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-30T16:34:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-30T16:34:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-30T16:34:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 101225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-30T16:34:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-30T16:34:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-30T16:34:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-30T16:34:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-30T16:34:45.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-30T16:34:45.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-30T16:34:45.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-30T16:34:45.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-30T16:34:45.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-30T16:34:45.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-30T16:34:45.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-30T16:34:45.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 48705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-30T16:34:45.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-30T16:34:45.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 46465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-30T16:34:45.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-30T16:34:45.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 50209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 59657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 62729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 71161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 96569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 85905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 75121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-30T16:34:45.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 83417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 116769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 134433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/ 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/ 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/ 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-05-30T16:34:45.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-05-30T16:34:45.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-05-30T16:34:45.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-30T16:34:45.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-30T16:34:45.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-30T16:34:45.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-05-30T16:34:45.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-30T16:34:45.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-05-30T16:34:45.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 64217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-30T16:34:45.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-30T16:34:45.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-30T16:34:45.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-30T16:34:45.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-05-30T16:34:45.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-05-30T16:34:45.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 76961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-30T16:34:45.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-30T16:34:45.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 52929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-30T16:34:45.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-05-30T16:34:45.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-30T16:34:45.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-30T16:34:45.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-05-30T16:34:45.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-30T16:34:45.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-30T16:34:45.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 57209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-30T16:34:45.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-05-30T16:34:45.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-30T16:34:45.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-30T16:34:45.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-05-30T16:34:45.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-05-30T16:34:45.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-30T16:34:45.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-05-30T16:34:45.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-30T16:34:45.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-30T16:34:45.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-30T16:34:45.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-30T16:34:45.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-05-30T16:34:45.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-30T16:34:45.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-30T16:34:45.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-30T16:34:45.791 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/ 2024-05-30T16:34:45.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-05-30T16:34:45.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-05-30T16:34:45.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-05-30T16:34:45.791 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ 2024-05-30T16:34:45.791 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ 2024-05-30T16:34:45.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 329681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-30T16:34:45.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1119785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 83897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 408329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 120905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 347201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 84937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/ 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 590873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/ 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 514577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/ 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 911649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-30T16:34:45.792 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ 2024-05-30T16:34:45.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 375449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-30T16:34:45.793 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ 2024-05-30T16:34:45.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 197097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-05-30T16:34:45.793 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/ 2024-05-30T16:34:45.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 212497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-05-30T16:34:45.793 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ 2024-05-30T16:34:45.793 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ 2024-05-30T16:34:45.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 334353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-30T16:34:45.793 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ 2024-05-30T16:34:45.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 120649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-30T16:34:45.793 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ 2024-05-30T16:34:45.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 132577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-30T16:34:45.794 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ 2024-05-30T16:34:45.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 157929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-30T16:34:45.794 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ 2024-05-30T16:34:45.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 156665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-30T16:34:45.794 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ 2024-05-30T16:34:45.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/evbug.ko 2024-05-30T16:34:45.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ff-memless.ko 2024-05-30T16:34:45.794 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/ 2024-05-30T16:34:45.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-30T16:34:45.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-30T16:34:45.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 50705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 49433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/ 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 45465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lkkbd.ko 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8323.ko 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8333.ko 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-05-30T16:34:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-05-30T16:34:45.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-05-30T16:34:45.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-05-30T16:34:45.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/newtonkbd.ko 2024-05-30T16:34:45.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-05-30T16:34:45.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt1070.ko 2024-05-30T16:34:45.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt2160.ko 2024-05-30T16:34:45.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-05-30T16:34:45.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/stowaway.ko 2024-05-30T16:34:45.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/sunkbd.ko 2024-05-30T16:34:45.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-05-30T16:34:45.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-05-30T16:34:45.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-05-30T16:34:45.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/xtkbd.ko 2024-05-30T16:34:45.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/matrix-keymap.ko 2024-05-30T16:34:45.797 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/ 2024-05-30T16:34:45.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-30T16:34:45.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 39545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-30T16:34:45.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 159993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-30T16:34:45.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 114193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-30T16:34:45.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/gpio_mouse.ko 2024-05-30T16:34:45.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 428121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/psmouse.ko 2024-05-30T16:34:45.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-30T16:34:45.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-30T16:34:45.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-30T16:34:45.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-30T16:34:45.798 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/ 2024-05-30T16:34:45.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 140921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-30T16:34:45.798 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ 2024-05-30T16:34:45.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-30T16:34:45.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-30T16:34:45.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ct82c710.ko 2024-05-30T16:34:45.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-30T16:34:45.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/parkbd.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/pcips2.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ps2mult.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serport.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/ 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-88pm860x.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-adp5520.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 77193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-bd2802.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da903x.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da9052.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-gpio.ko 2024-05-30T16:34:45.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3533.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm355x.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3642.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp8788.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-max8997.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-mc13783.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-menf21bmc.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca9532.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca955x.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca963x.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-tca6507.ko 2024-05-30T16:34:45.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm831x-status.ko 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm8350.ko 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/ 2024-05-30T16:34:45.801 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/ 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 790665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 49065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 116817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bufio.ko 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 58273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 199017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 134937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 67489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-era.ko 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 50441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log.ko 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 60969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-mirror.ko 2024-05-30T16:34:45.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 97193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 85681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-region-hash.ko 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 139793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-snapshot.ko 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 234441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 66417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-zero.ko 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/ 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 264273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-30T16:34:45.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 124705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 157673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 444649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/ 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/ 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 214833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 77977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 54777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 150753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 97209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 63865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-30T16:34:45.804 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/ 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm800.ko 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm805.ko 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm80x.ko 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona-i2c.ko 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 148545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona.ko 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/bcm590xx.ko 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/cros_ec_dev.ko 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/dln2.ko 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/janz-cmodio.ko 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 59081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/kempld-core.ko 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-core.ko 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-05-30T16:34:45.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lp3943.ko 2024-05-30T16:34:45.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 60489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-30T16:34:45.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-30T16:34:45.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/max8907.ko 2024-05-30T16:34:45.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-core.ko 2024-05-30T16:34:45.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-05-30T16:34:45.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/menf21bmc.ko 2024-05-30T16:34:45.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-adc.ko 2024-05-30T16:34:45.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-gpio.ko 2024-05-30T16:34:45.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633.ko 2024-05-30T16:34:45.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-05-30T16:34:45.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/retu-mfd.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 99409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/si476x-core.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 58049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 60673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps65010.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps6507x.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 52345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wm8994.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 64257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/ 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 57497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-30T16:34:45.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 47681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 58625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/ 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 47441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/core.ko 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/ 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ds1682.ko 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/dummy-irq.ko 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/ 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/echo.ko 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/ 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-30T16:34:45.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/ 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 191617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hmc6352.ko 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 92289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ics932s401.ko 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/ 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 54857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-30T16:34:45.809 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/ 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 154257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 69793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 388977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/phantom.ko 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/ 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 91129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/st_drv.ko 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/ 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 234849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ 2024-05-30T16:34:45.810 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/ 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 620849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/ 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/ 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 139745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 49529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/ 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 589537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/ 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 53745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-30T16:34:45.811 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 49193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 158641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 85945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 109513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/ 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 64697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/ 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 84321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/ 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 70729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-30T16:34:45.812 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/ 2024-05-30T16:34:45.813 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 52681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-30T16:34:45.813 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/ 2024-05-30T16:34:45.813 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-30T16:34:45.813 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 56049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-30T16:34:45.813 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 115873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-30T16:34:45.813 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/ 2024-05-30T16:34:45.813 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/ 2024-05-30T16:34:45.813 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 124481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-30T16:34:45.813 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-05-30T16:34:45.813 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 128393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-30T16:34:45.813 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-05-30T16:34:45.813 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 110321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-30T16:34:45.814 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/ 2024-05-30T16:34:45.814 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 101849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-30T16:34:45.814 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 88945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-30T16:34:45.814 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/ 2024-05-30T16:34:45.814 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 105625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-30T16:34:45.814 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 228977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-30T16:34:45.814 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-05-30T16:34:45.814 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1733297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-30T16:34:45.814 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 167177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-30T16:34:45.814 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/ 2024-05-30T16:34:45.814 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 164249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-30T16:34:45.814 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 440553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-30T16:34:45.815 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/ 2024-05-30T16:34:45.815 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/ 2024-05-30T16:34:45.815 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 432145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-30T16:34:45.815 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/ 2024-05-30T16:34:45.815 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-05-30T16:34:45.815 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 257145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-30T16:34:45.815 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-05-30T16:34:45.815 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 446057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-30T16:34:45.890 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-05-30T16:34:45.890 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1311193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-30T16:34:45.890 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-05-30T16:34:45.890 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 206673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-30T16:34:45.890 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-05-30T16:34:45.890 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-30T16:34:45.891 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/ 2024-05-30T16:34:45.891 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/ 2024-05-30T16:34:45.891 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 269249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-30T16:34:45.891 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/ 2024-05-30T16:34:45.891 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/ 2024-05-30T16:34:45.891 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 85377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-30T16:34:45.891 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 77449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-30T16:34:45.891 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 169041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-30T16:34:45.891 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-30T16:34:45.891 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 76201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-30T16:34:45.891 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-30T16:34:45.891 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/ 2024-05-30T16:34:45.892 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 75937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-30T16:34:45.892 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 78697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-30T16:34:45.892 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 52305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-30T16:34:45.892 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ec_bhf.ko 2024-05-30T16:34:45.892 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/ 2024-05-30T16:34:45.892 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/ 2024-05-30T16:34:45.892 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 356353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-30T16:34:45.892 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 61729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-30T16:34:45.892 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 63177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-30T16:34:45.892 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/ 2024-05-30T16:34:45.892 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 51505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-05-30T16:34:45.892 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 115561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/ 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 366193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/ 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 755673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/ 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 324513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/ 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1196201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/ 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 362609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/ 2024-05-30T16:34:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 672313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-30T16:34:45.894 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/ 2024-05-30T16:34:45.894 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 121513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-30T16:34:45.894 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-05-30T16:34:45.894 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 966601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-30T16:34:45.894 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-05-30T16:34:45.894 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 193465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-30T16:34:45.894 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 108625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-30T16:34:45.894 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/ 2024-05-30T16:34:45.894 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-30T16:34:45.894 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 126873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-30T16:34:45.894 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 150769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-30T16:34:45.894 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/ 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 904929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 344089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1413529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 54217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 117345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/ 2024-05-30T16:34:45.895 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-05-30T16:34:45.896 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 131353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-30T16:34:45.896 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ 2024-05-30T16:34:45.896 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 91457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-30T16:34:45.896 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 56681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-30T16:34:45.896 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/ 2024-05-30T16:34:45.896 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 181201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-30T16:34:45.896 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/ 2024-05-30T16:34:45.896 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 171409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-30T16:34:45.896 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/ 2024-05-30T16:34:45.896 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 58241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-30T16:34:45.896 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 50113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/ 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 300793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 105681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 885057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/ 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 52297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/ 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 81633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 100681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-30T16:34:45.897 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 264145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-30T16:34:45.898 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/ 2024-05-30T16:34:45.898 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-05-30T16:34:45.898 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 142401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-05-30T16:34:45.898 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/ 2024-05-30T16:34:45.898 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1350201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-30T16:34:45.898 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/ 2024-05-30T16:34:45.898 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 57945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-30T16:34:45.898 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/ 2024-05-30T16:34:45.898 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 66497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-30T16:34:45.898 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 80057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-30T16:34:45.898 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/ 2024-05-30T16:34:45.898 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 74281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 79449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 100777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 83433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/ 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 46977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 644329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/ 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 128489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 207985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-30T16:34:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 82625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 91345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/ 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 59793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/ 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 110721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/ 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 98681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 102505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/ 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 61489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/ 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 69905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/ 2024-05-30T16:34:45.900 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 49441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/defxx.ko 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/ 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 275713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/skfp.ko 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 91665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/ 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 290441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/ 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 78057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/ 2024-05-30T16:34:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-30T16:34:45.902 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-30T16:34:45.902 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-gpio.ko 2024-05-30T16:34:45.902 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-30T16:34:45.902 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-30T16:34:45.902 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-30T16:34:45.902 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 62673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-30T16:34:45.902 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-30T16:34:45.902 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/ 2024-05-30T16:34:45.902 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-30T16:34:45.902 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 48233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-30T16:34:45.902 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ 2024-05-30T16:34:45.902 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 61977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 52857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 53401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 103369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 96017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-30T16:34:45.903 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 121097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-30T16:34:45.904 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-30T16:34:45.904 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 62105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-30T16:34:45.904 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-30T16:34:45.904 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-30T16:34:45.904 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-30T16:34:45.904 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/ 2024-05-30T16:34:45.904 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/plip.ko 2024-05-30T16:34:45.904 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ 2024-05-30T16:34:45.904 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-30T16:34:45.904 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-30T16:34:45.904 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-30T16:34:45.904 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 53225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sb1000.ko 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/ 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 52065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 80153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/ 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 137313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-30T16:34:45.905 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 108081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/ 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 176481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/ 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 384329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/ 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 175513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-30T16:34:45.906 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/ 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/ 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 335489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 127497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/ 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 168113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 103881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/ 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/ 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-05-30T16:34:45.907 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-05-30T16:34:45.908 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pci-stub.ko 2024-05-30T16:34:45.908 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-30T16:34:45.908 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/ 2024-05-30T16:34:45.908 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-30T16:34:45.908 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 179937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia.ko 2024-05-30T16:34:45.908 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 78145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_core.ko 2024-05-30T16:34:45.908 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-05-30T16:34:45.908 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-30T16:34:45.908 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 133745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-30T16:34:45.908 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/ 2024-05-30T16:34:45.908 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/ 2024-05-30T16:34:45.908 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/ 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/ 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/ 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 78185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/ 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/ 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 61025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec.ko 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-05-30T16:34:45.909 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-05-30T16:34:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ 2024-05-30T16:34:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 87929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-30T16:34:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-30T16:34:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 48249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-30T16:34:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-30T16:34:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-30T16:34:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 164761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-30T16:34:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 46177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-30T16:34:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 62065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-30T16:34:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-30T16:34:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 51873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-30T16:34:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-30T16:34:45.911 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-30T16:34:45.911 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ibm_rtl.ko 2024-05-30T16:34:45.911 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/ 2024-05-30T16:34:45.911 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-30T16:34:45.911 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-05-30T16:34:45.911 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 53993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-30T16:34:45.911 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-30T16:34:45.911 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-30T16:34:45.911 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-30T16:34:45.911 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-30T16:34:45.911 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-30T16:34:45.912 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-30T16:34:45.912 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-30T16:34:45.912 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-30T16:34:45.912 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-30T16:34:45.912 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 61409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-30T16:34:45.912 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/ 2024-05-30T16:34:45.912 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ 2024-05-30T16:34:45.912 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_battery.ko 2024-05-30T16:34:45.912 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_charger.ko 2024-05-30T16:34:45.912 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 68825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq2415x_charger.ko 2024-05-30T16:34:45.912 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 73065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24190_charger.ko 2024-05-30T16:34:45.912 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24735-charger.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9030_battery.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9052-battery.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2760_battery.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2780_battery.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2781_battery.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2782_battery.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/gpio-charger.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/isp1704_charger.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/lp8727_charger.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max14577_charger.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max17042_battery.ko 2024-05-30T16:34:45.913 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8903_charger.ko 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8925_power.ko 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/pcf50633-charger.ko 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/sbs-battery.ko 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/test_power.ko 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/tps65090-charger.ko 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_backup.ko 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_power.ko 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm8350_power.ko 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/ 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 73289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/ 2024-05-30T16:34:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/ 2024-05-30T16:34:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-30T16:34:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-30T16:34:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-30T16:34:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 49801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-30T16:34:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ 2024-05-30T16:34:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 91369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-30T16:34:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-30T16:34:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/ 2024-05-30T16:34:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/ 2024-05-30T16:34:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/ 2024-05-30T16:34:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 67473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-30T16:34:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 47129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/ 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm80x.ko 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm860x.ko 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9052.ko 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9055.ko 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9063.ko 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 82217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-30T16:34:45.916 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-lp8788.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 46905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t86.ko 2024-05-30T16:34:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8907.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8925.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8997.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8998.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-palmas.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 56769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf50633.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-30T16:34:45.918 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rc5t583.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-s35390a.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps6586x.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps65910.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm831x.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm8350.ko 2024-05-30T16:34:45.919 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 90369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 69585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 164473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/ 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 340689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 120393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/ 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 468049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 380633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/ 2024-05-30T16:34:45.920 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 243649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/ 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 135601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/ 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 304969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/ 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1527017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/ 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 297769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/ 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 144377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 47449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-30T16:34:45.921 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/ 2024-05-30T16:34:45.922 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 390657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-30T16:34:45.922 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/ 2024-05-30T16:34:45.922 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-05-30T16:34:45.922 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 88873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-30T16:34:45.922 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-05-30T16:34:45.922 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 117473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-30T16:34:45.922 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 173009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-30T16:34:45.922 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 91497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-30T16:34:45.922 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 45393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-30T16:34:45.922 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/ 2024-05-30T16:34:45.922 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 267521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-30T16:34:45.922 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/ 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 95321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 194001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fdomain.ko 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/ 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 366457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 251497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 57089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/imm.ko 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 327833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 129777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-30T16:34:45.923 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/ 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 397657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 63113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/ 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 386801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 178169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 64801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/ 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 273953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/ 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 2735913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/ 2024-05-30T16:34:45.924 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 88521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 389089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 104761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/ 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 836897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/ 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 158705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 96529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/ 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 101609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-05-30T16:34:45.925 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/ 2024-05-30T16:34:45.926 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 443713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-30T16:34:45.926 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 152025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-30T16:34:45.926 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ppa.ko 2024-05-30T16:34:45.926 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 66969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-30T16:34:45.926 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/ 2024-05-30T16:34:45.926 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 2324713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-30T16:34:45.926 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 103593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-30T16:34:45.926 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/ 2024-05-30T16:34:45.926 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 697281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-30T16:34:45.926 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qlogicfas408.ko 2024-05-30T16:34:45.926 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-30T16:34:45.926 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 322857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 219849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 357145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 121177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 93473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 138113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 57393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/ 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 205001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 59113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-30T16:34:45.927 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 48769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-30T16:34:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 59409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/xen-scsifront.ko 2024-05-30T16:34:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ 2024-05-30T16:34:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 174865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-30T16:34:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/ 2024-05-30T16:34:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/ 2024-05-30T16:34:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 920073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-30T16:34:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/ 2024-05-30T16:34:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 60313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-30T16:34:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 48121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-30T16:34:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 54225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-30T16:34:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1170873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-30T16:34:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 149777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/ 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 90033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/ 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/ 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/ 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-30T16:34:45.929 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-30T16:34:45.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-30T16:34:45.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-30T16:34:45.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-30T16:34:45.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-30T16:34:45.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-30T16:34:45.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 45993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-30T16:34:45.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-30T16:34:45.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-30T16:34:45.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-05-30T16:34:45.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-30T16:34:45.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-30T16:34:45.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 99289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 69721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/moxa.ko 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 61641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/mxser.ko 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 134329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/ 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/ 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-30T16:34:45.931 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_uart.ko 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 91593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/ 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 120553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/rp2.ko 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/sc16is7xx.ko 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/ 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 693057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-05-30T16:34:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/ 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_dmem_genirq.ko 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_mf624.ko 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_netx.ko 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/ 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/ 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 90297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/c67x00.ko 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ 2024-05-30T16:34:45.933 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 189169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-05-30T16:34:45.934 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-05-30T16:34:45.934 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-05-30T16:34:45.934 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-05-30T16:34:45.934 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-05-30T16:34:45.934 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/ 2024-05-30T16:34:45.934 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 101537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-30T16:34:45.934 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 63017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-30T16:34:45.934 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 56713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-30T16:34:45.934 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 107409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-30T16:34:45.934 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ 2024-05-30T16:34:45.934 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ulpi.ko 2024-05-30T16:34:45.934 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/ 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/ 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 575217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3.ko 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/ 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/ 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 72241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_ether.ko 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 61945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_serial.ko 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 49729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-05-30T16:34:45.935 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-05-30T16:34:45.936 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 131513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-05-30T16:34:45.936 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 62313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-05-30T16:34:45.936 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 146601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-05-30T16:34:45.936 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 70569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-05-30T16:34:45.936 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-05-30T16:34:45.936 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-05-30T16:34:45.936 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 70009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-05-30T16:34:45.936 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 101233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-05-30T16:34:45.936 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-05-30T16:34:45.936 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 71241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-05-30T16:34:45.936 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 84929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-05-30T16:34:45.936 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/ 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-05-30T16:34:45.937 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 78065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 204009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/libcomposite.ko 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/ 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/ 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 182537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 45537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 66505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 85209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 69305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 90305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2272.ko 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 90353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2280.ko 2024-05-30T16:34:45.938 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 94833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-05-30T16:34:45.939 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 80513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-05-30T16:34:45.939 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 87457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-05-30T16:34:45.939 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 95433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-05-30T16:34:45.939 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 195953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-05-30T16:34:45.939 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ 2024-05-30T16:34:45.939 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/bcma-hcd.ko 2024-05-30T16:34:45.939 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/isp116x-hcd.ko 2024-05-30T16:34:45.939 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 104433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-05-30T16:34:45.939 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 102265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-05-30T16:34:45.939 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 60097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-30T16:34:45.939 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811_cs.ko 2024-05-30T16:34:45.940 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ssb-hcd.ko 2024-05-30T16:34:45.940 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-05-30T16:34:45.940 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/ 2024-05-30T16:34:45.940 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-30T16:34:45.940 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-30T16:34:45.940 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ 2024-05-30T16:34:45.940 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 47345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-30T16:34:45.940 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-30T16:34:45.940 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-05-30T16:34:45.940 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cytherm.ko 2024-05-30T16:34:45.940 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ehset.ko 2024-05-30T16:34:45.940 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/lvstest.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/ 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 85305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-30T16:34:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 84257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbtest.ko 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 52057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/ 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 91505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/usbmon.ko 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/ 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 396169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/musb_hdrc.ko 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/ 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-isp1301.ko 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-tahvo.ko 2024-05-30T16:34:45.942 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 66865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 58321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 53001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/f81232.ko 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 188601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 61481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-30T16:34:45.943 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 152297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 142825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 69209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 66353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 122321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/metro-usb.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 89961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mxuport.ko 2024-05-30T16:34:45.944 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 197201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 45329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 61753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 39977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 59337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-30T16:34:45.945 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 70489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 39313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 151121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usbserial.ko 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/wishbone-serial.ko 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 64041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-30T16:34:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 201145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/ 2024-05-30T16:34:45.947 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 76025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 85233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 122233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/ 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/ 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 206897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 134241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 93665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/ 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 138641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 71273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 107897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-30T16:34:45.948 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/ 2024-05-30T16:34:45.949 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/ 2024-05-30T16:34:45.949 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-05-30T16:34:45.949 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/aat2870_bl.ko 2024-05-30T16:34:45.949 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp5520_bl.ko 2024-05-30T16:34:45.949 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8860_bl.ko 2024-05-30T16:34:45.949 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 51737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8870_bl.ko 2024-05-30T16:34:45.949 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-30T16:34:45.949 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/as3711_bl.ko 2024-05-30T16:34:45.949 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/bd6107.ko 2024-05-30T16:34:45.949 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da903x_bl.ko 2024-05-30T16:34:45.949 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da9052_bl.ko 2024-05-30T16:34:45.950 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/gpio_backlight.ko 2024-05-30T16:34:45.950 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/kb3886_bl.ko 2024-05-30T16:34:45.950 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-30T16:34:45.950 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3533_bl.ko 2024-05-30T16:34:45.950 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3639_bl.ko 2024-05-30T16:34:45.950 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lv5207lp.ko 2024-05-30T16:34:45.950 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/max8925_bl.ko 2024-05-30T16:34:45.950 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pandora_bl.ko 2024-05-30T16:34:45.950 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-05-30T16:34:45.950 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-30T16:34:45.950 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/wm831x_bl.ko 2024-05-30T16:34:45.950 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/ 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 46793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/matrox_w1.ko 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/w1-gpio.ko 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/ 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-30T16:34:45.951 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-30T16:34:45.952 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-30T16:34:45.952 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-30T16:34:45.952 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-30T16:34:45.952 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 70361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-30T16:34:45.952 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 129409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-30T16:34:45.952 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ 2024-05-30T16:34:45.952 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/acquirewdt.ko 2024-05-30T16:34:45.952 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/advantechwdt.ko 2024-05-30T16:34:45.952 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-30T16:34:45.952 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-30T16:34:45.952 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/cpu5wdt.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9052_wdt.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9055_wdt.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9063_wdt.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/dw_wdt.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/eurotechwdt.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-30T16:34:45.953 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-30T16:34:45.954 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-30T16:34:45.954 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-30T16:34:45.954 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/kempld_wdt.ko 2024-05-30T16:34:45.954 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-30T16:34:45.954 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/mena21_wdt.ko 2024-05-30T16:34:45.954 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-05-30T16:34:45.954 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-30T16:34:45.954 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-05-30T16:34:45.954 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pc87413_wdt.ko 2024-05-30T16:34:45.954 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 46945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-30T16:34:45.955 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-30T16:34:45.955 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/retu_wdt.ko 2024-05-30T16:34:45.955 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-05-30T16:34:45.955 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-05-30T16:34:45.955 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-30T16:34:45.955 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sc1200wdt.ko 2024-05-30T16:34:45.955 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-30T16:34:45.955 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-05-30T16:34:45.955 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-30T16:34:45.955 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-30T16:34:45.955 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/twl4030_wdt.ko 2024-05-30T16:34:45.955 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wafer5823wdt.ko 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm831x_wdt.ko 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm8350_wdt.ko 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/ 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-30T16:34:45.956 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/ 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 213865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 47673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 85705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-scsiback.ko 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/ 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/ 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 194449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/ 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 78049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/adfs.ko 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/ 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 197801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-30T16:34:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/ 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1260937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/kafs.ko 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/ 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 127337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/autofs4.ko 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/ 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 80481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/ 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 50457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/bfs.ko 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 45553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/ 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 4491713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/ 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 376801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-30T16:34:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1586617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/ 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 130017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/ 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 139049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/configfs.ko 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/ 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/ 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 813137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/ 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 46377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/efs.ko 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/ 2024-05-30T16:34:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1906713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-30T16:34:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/ 2024-05-30T16:34:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-30T16:34:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/ 2024-05-30T16:34:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 52265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/freevxfs.ko 2024-05-30T16:34:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/ 2024-05-30T16:34:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-30T16:34:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/ 2024-05-30T16:34:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1486393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-30T16:34:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/ 2024-05-30T16:34:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 183217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-30T16:34:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/ 2024-05-30T16:34:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 281993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-30T16:34:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/ 2024-05-30T16:34:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 248945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/hpfs.ko 2024-05-30T16:34:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/ 2024-05-30T16:34:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 92985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-30T16:34:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/ 2024-05-30T16:34:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 532953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-30T16:34:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/ 2024-05-30T16:34:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 361281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-30T16:34:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/ 2024-05-30T16:34:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 112569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-30T16:34:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/ 2024-05-30T16:34:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 591625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/ 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/ 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 102537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/ 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 74337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/ 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 147673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1320377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 82089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv2.ko 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 151617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 2518385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/ 2024-05-30T16:34:45.962 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-30T16:34:45.963 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-30T16:34:45.963 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/ 2024-05-30T16:34:45.963 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 2021969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-30T16:34:45.963 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/ 2024-05-30T16:34:45.963 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 733969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-30T16:34:45.963 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/ 2024-05-30T16:34:45.963 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-30T16:34:45.963 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-30T16:34:45.963 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-30T16:34:45.963 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-30T16:34:45.963 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-30T16:34:45.963 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ascii.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-30T16:34:45.964 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 95617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 144201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-30T16:34:45.965 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 167129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-30T16:34:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 119505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-30T16:34:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-30T16:34:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-30T16:34:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-30T16:34:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-30T16:34:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-30T16:34:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-30T16:34:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-30T16:34:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-30T16:34:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-30T16:34:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-30T16:34:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 634457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ntfs3.ko 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 302033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 548057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ 2024-05-30T16:34:45.967 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 66345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-30T16:34:45.968 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 3245449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-30T16:34:46.009 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 22105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-30T16:34:46.009 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 39305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-30T16:34:46.009 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-30T16:34:46.009 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/ 2024-05-30T16:34:46.009 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 67465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/omfs.ko 2024-05-30T16:34:46.009 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/ 2024-05-30T16:34:46.009 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 462817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-30T16:34:46.009 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ 2024-05-30T16:34:46.009 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-30T16:34:46.010 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/ 2024-05-30T16:34:46.010 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/qnx4.ko 2024-05-30T16:34:46.010 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/ 2024-05-30T16:34:46.010 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 56073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/qnx6.ko 2024-05-30T16:34:46.010 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/ 2024-05-30T16:34:46.010 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_tree.ko 2024-05-30T16:34:46.010 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v1.ko 2024-05-30T16:34:46.010 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v2.ko 2024-05-30T16:34:46.010 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/ 2024-05-30T16:34:46.010 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 684713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-30T16:34:46.010 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/ 2024-05-30T16:34:46.010 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/ 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/ 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 3350841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/ 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/ 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 164145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/ 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 115865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/ 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 309937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ 2024-05-30T16:34:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 198185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/ 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 5192193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/ 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/ 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 97617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/locktorture.ko 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/ 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/test_udelay.ko 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 72657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc7.ko 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/ 2024-05-30T16:34:46.012 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/interval_tree_test.ko 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/ 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/ 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/memory-notifier-error-inject.ko 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/notifier-error-inject.ko 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/percpu_test.ko 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/pm-notifier-error-inject.ko 2024-05-30T16:34:46.013 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/ 2024-05-30T16:34:46.014 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 151945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-30T16:34:46.014 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/rbtree_test.ko 2024-05-30T16:34:46.014 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/ 2024-05-30T16:34:46.014 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-30T16:34:46.014 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test-kstrtox.ko 2024-05-30T16:34:46.014 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 4912433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_bpf.ko 2024-05-30T16:34:46.014 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 61161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_firmware.ko 2024-05-30T16:34:46.014 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_module.ko 2024-05-30T16:34:46.014 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_user_copy.ko 2024-05-30T16:34:46.014 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-30T16:34:46.014 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-30T16:34:46.014 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/ 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/xz_dec_test.ko 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/ 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/ 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 66945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-30T16:34:46.015 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/ 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/ 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 106697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/ 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 236769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 39553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-30T16:34:46.016 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/ 2024-05-30T16:34:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 879593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-30T16:34:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/ 2024-05-30T16:34:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 85225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-30T16:34:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1031177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-30T16:34:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ 2024-05-30T16:34:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-30T16:34:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-30T16:34:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-30T16:34:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-30T16:34:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-30T16:34:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-30T16:34:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-30T16:34:46.018 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-30T16:34:46.018 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-30T16:34:46.018 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-30T16:34:46.018 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-30T16:34:46.018 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-30T16:34:46.018 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-30T16:34:46.018 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-30T16:34:46.018 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-30T16:34:46.018 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-30T16:34:46.018 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-30T16:34:46.018 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-30T16:34:46.018 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 70521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/ 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1243369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/ 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 153793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/ 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 244825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 71025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 74985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-30T16:34:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/ 2024-05-30T16:34:46.020 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 507649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-30T16:34:46.020 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-30T16:34:46.020 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-30T16:34:46.020 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-30T16:34:46.020 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-30T16:34:46.020 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/ 2024-05-30T16:34:46.020 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 128577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/hsr.ko 2024-05-30T16:34:46.020 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ 2024-05-30T16:34:46.020 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ 2024-05-30T16:34:46.020 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-30T16:34:46.020 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 357369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-30T16:34:46.020 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 59385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 46409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 60217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 75481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 77713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 45513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-30T16:34:46.021 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 50161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ip_tables.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-30T16:34:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-30T16:34:46.023 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 54425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-30T16:34:46.024 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 47425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 103169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_gre.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 118873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 71081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/mip6.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 50729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-30T16:34:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-30T16:34:46.026 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-30T16:34:46.026 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-30T16:34:46.026 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-30T16:34:46.026 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-30T16:34:46.026 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-30T16:34:46.026 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-30T16:34:46.026 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-30T16:34:46.026 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-30T16:34:46.026 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-30T16:34:46.026 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-30T16:34:46.026 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 46297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-30T16:34:46.026 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 29809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 94081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 30289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/ 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 106361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/ 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 153209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-30T16:34:46.027 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 66233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/ 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 63321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/lapb.ko 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/ 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 332817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc2.ko 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/ 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 388817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/ 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ 2024-05-30T16:34:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 147729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 124033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 124337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 126673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 126465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 137825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 72345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 133673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 139065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 138257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-30T16:34:46.029 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 136169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 139889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 534033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-30T16:34:46.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 55209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 496713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 134361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 140793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-30T16:34:46.031 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 79865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 117385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 46097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 118337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 53385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-30T16:34:46.032 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 811705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 53041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 49289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 65137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 50649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-30T16:34:46.033 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_osf.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 24985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_synproxy.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tproxy.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 108385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/x_tables.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-30T16:34:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 21857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 45209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-30T16:34:46.035 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-30T16:34:46.036 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 52809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-30T16:34:46.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 16153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-30T16:34:46.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 11873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpudp.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/ 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 17225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-30T16:34:46.039 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/ 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/ 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 488457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/ 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/ 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 141993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/phonet.ko 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 68801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/pn_pep.ko 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/ 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 318537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-30T16:34:46.040 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 202249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 85073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/ 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1028129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/rxrpc.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/ 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 28713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 45401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 53457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 45665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-30T16:34:46.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 41449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_cgroup.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 37297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 39593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 49313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 79137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 48777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 25089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-30T16:34:46.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 43145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 39169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq_codel.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 62809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 81825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 36617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 44785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 32825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 13497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-30T16:34:46.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 60241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 33425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 35769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 34153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/ 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1187153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/ 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/ 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 432225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 70081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1940753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-30T16:34:46.044 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/ 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 889729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/ 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 1122273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/ 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 18793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/ 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 105601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 90249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 123745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-30T16:34:46.045 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/ 2024-05-30T16:34:46.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 165777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/x25.ko 2024-05-30T16:34:46.046 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/ 2024-05-30T16:34:46.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_algo.ko 2024-05-30T16:34:46.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-30T16:34:46.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 131857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_user.ko 2024-05-30T16:34:46.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 646387 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-30T16:34:46.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 630543 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-30T16:34:46.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 7706 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-30T16:34:46.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 23609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-30T16:34:46.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 9941 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-30T16:34:46.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 70990 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-30T16:34:46.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 146985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-30T16:34:46.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 232892 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-30T16:34:46.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 210 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-30T16:34:46.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 72627 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-30T16:34:46.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 879 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-30T16:34:46.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 258450 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-30T16:34:46.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 313019 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-30T16:34:46.047 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/ 2024-05-30T16:34:46.047 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/ 2024-05-30T16:34:46.047 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/ 2024-05-30T16:34:46.047 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/ 2024-05-30T16:34:46.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 171 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/changelog.Debian.gz 2024-05-30T16:34:46.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r-- root/root 691 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/copyright 2024-05-30T16:34:46.052 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-30T16:34:46.052 INFO:teuthology.task.kernel:searching for kernel 6.9.0-gb9459a26b088 2024-05-30T16:34:46.052 DEBUG:teuthology.orchestra.run.smithi107:> egrep '(submenu|menuentry.*6.9.0-gb9459a26b088).*{' /boot/grub/grub.cfg 2024-05-30T16:34:46.059 INFO:teuthology.orchestra.run.smithi107.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-30T16:34:46.059 INFO:teuthology.orchestra.run.smithi107.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-30T16:34:46.059 INFO:teuthology.orchestra.run.smithi107.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-30T16:34:46.060 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-05-30T16:34:46.060 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-gb9459a26b088 2024-05-30T16:34:46.060 DEBUG:teuthology.orchestra.run.smithi107:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-05-30T16:34:46.105 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi107.front.sepia.ceph.com to complete... 2024-05-30T16:34:46.586 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub' 2024-05-30T16:34:46.587 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-30T16:34:46.603 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-05-30T16:34:46.776 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T16:34:46.782 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-30T16:34:47.013 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-30T16:34:47.018 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-30T16:34:47.057 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-30T16:34:47.062 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-30T16:34:47.210 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-30T16:34:47.210 INFO:teuthology.orchestra.run.smithi107.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-30T16:34:47.210 INFO:teuthology.orchestra.run.smithi107.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-30T16:34:47.244 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-05-30T16:34:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub' 2024-05-30T16:34:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-30T16:34:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2024-05-30T16:34:50.453 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T16:34:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-30T16:34:50.864 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-30T16:34:50.871 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-30T16:34:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-30T16:34:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-30T16:34:51.116 INFO:teuthology.orchestra.run.smithi059.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-30T16:34:51.116 INFO:teuthology.orchestra.run.smithi059.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-30T16:34:51.116 INFO:teuthology.orchestra.run.smithi059.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-30T16:34:51.160 INFO:teuthology.orchestra.run.smithi059.stderr:done 2024-05-30T16:34:51.347 DEBUG:teuthology.orchestra.run.smithi059:> dpkg-deb -c /tmp/linux-image.deb 2024-05-30T16:34:51.354 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./ 2024-05-30T16:34:51.355 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./boot/ 2024-05-30T16:34:51.355 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7004139 2024-05-23 11:07 ./boot/System.map-6.9.0-gb9459a26b088 2024-05-30T16:34:51.374 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 172251 2024-05-23 11:07 ./boot/config-6.9.0-gb9459a26b088 2024-05-30T16:34:51.374 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13136896 2024-05-23 11:07 ./boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T16:34:51.398 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/ 2024-05-30T16:34:51.398 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/ 2024-05-30T16:34:51.398 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postinst.d/ 2024-05-30T16:34:51.398 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postrm.d/ 2024-05-30T16:34:51.398 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/preinst.d/ 2024-05-30T16:34:51.398 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/prerm.d/ 2024-05-30T16:34:51.399 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/ 2024-05-30T16:34:51.399 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/ 2024-05-30T16:34:51.399 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/ 2024-05-30T16:34:51.399 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/ 2024-05-30T16:34:51.399 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/ 2024-05-30T16:34:51.399 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/ 2024-05-30T16:34:51.399 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ 2024-05-30T16:34:51.399 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 507497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/aesni-intel.ko 2024-05-30T16:34:51.402 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-30T16:34:51.403 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-30T16:34:51.403 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-30T16:34:51.403 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 97945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-30T16:34:51.403 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 109897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-30T16:34:51.403 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 155241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-30T16:34:51.403 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-30T16:34:51.403 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-30T16:34:51.403 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 87001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-30T16:34:51.403 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-30T16:34:51.403 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-30T16:34:51.403 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-30T16:34:51.404 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-30T16:34:51.404 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-30T16:34:51.404 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-30T16:34:51.404 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-30T16:34:51.404 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-30T16:34:51.404 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-30T16:34:51.404 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-30T16:34:51.404 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/ 2024-05-30T16:34:51.404 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/ 2024-05-30T16:34:51.404 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/ 2024-05-30T16:34:51.404 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-30T16:34:51.404 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpuid.ko 2024-05-30T16:34:51.405 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/msr.ko 2024-05-30T16:34:51.405 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/ 2024-05-30T16:34:51.405 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 443289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-30T16:34:51.405 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1037081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-30T16:34:51.406 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 2850153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-30T16:34:51.421 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ 2024-05-30T16:34:51.421 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/af_alg.ko 2024-05-30T16:34:51.421 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_hash.ko 2024-05-30T16:34:51.421 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_skcipher.ko 2024-05-30T16:34:51.421 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-30T16:34:51.422 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-30T16:34:51.422 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-30T16:34:51.422 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/ 2024-05-30T16:34:51.422 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-05-30T16:34:51.422 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/ 2024-05-30T16:34:51.423 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-30T16:34:51.423 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-30T16:34:51.423 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-30T16:34:51.423 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-30T16:34:51.423 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-30T16:34:51.423 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-30T16:34:51.423 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-30T16:34:51.423 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-30T16:34:51.423 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-30T16:34:51.423 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-30T16:34:51.423 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-30T16:34:51.424 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-30T16:34:51.424 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-30T16:34:51.424 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-30T16:34:51.424 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-30T16:34:51.424 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-30T16:34:51.424 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-30T16:34:51.424 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-30T16:34:51.424 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cryptd.ko 2024-05-30T16:34:51.424 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-30T16:34:51.424 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_simd.ko 2024-05-30T16:34:51.424 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lrw.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-30T16:34:51.425 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-30T16:34:51.426 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-30T16:34:51.426 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-30T16:34:51.426 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-30T16:34:51.426 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-30T16:34:51.426 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 169057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-30T16:34:51.426 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-30T16:34:51.426 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-30T16:34:51.426 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-30T16:34:51.426 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-30T16:34:51.426 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-30T16:34:51.426 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xts.ko 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_extlog.ko 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/ 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/einj.ko 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-30T16:34:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 119017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 99177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 107729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-30T16:34:51.428 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_legacy.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-30T16:34:51.429 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-30T16:34:51.430 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-30T16:34:51.430 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-30T16:34:51.430 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-30T16:34:51.430 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-30T16:34:51.430 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-30T16:34:51.430 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-30T16:34:51.430 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-30T16:34:51.430 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-30T16:34:51.430 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-30T16:34:51.430 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_radisys.ko 2024-05-30T16:34:51.430 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-30T16:34:51.430 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rz1000.ko 2024-05-30T16:34:51.431 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-30T16:34:51.431 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-30T16:34:51.431 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-30T16:34:51.431 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-30T16:34:51.431 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-30T16:34:51.431 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-30T16:34:51.431 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-30T16:34:51.431 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-30T16:34:51.431 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 102113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-30T16:34:51.431 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-30T16:34:51.431 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-30T16:34:51.431 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/ 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 163833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-30T16:34:51.432 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/ 2024-05-30T16:34:51.433 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/ 2024-05-30T16:34:51.433 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 140833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-30T16:34:51.433 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/ 2024-05-30T16:34:51.433 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1241585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-30T16:34:51.484 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 203281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-30T16:34:51.484 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/ 2024-05-30T16:34:51.484 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 115257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-30T16:34:51.484 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 143425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-30T16:34:51.484 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/ 2024-05-30T16:34:51.484 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 126609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-30T16:34:51.484 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 119865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-30T16:34:51.484 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 313209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-30T16:34:51.485 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/ 2024-05-30T16:34:51.485 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 117217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-30T16:34:51.485 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/ 2024-05-30T16:34:51.485 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-30T16:34:51.485 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ 2024-05-30T16:34:51.485 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/applicom.ko 2024-05-30T16:34:51.485 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-30T16:34:51.485 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/ 2024-05-30T16:34:51.485 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-30T16:34:51.485 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-30T16:34:51.486 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-30T16:34:51.486 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-30T16:34:51.486 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-30T16:34:51.486 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ 2024-05-30T16:34:51.486 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-30T16:34:51.486 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 186913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-30T16:34:51.486 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-30T16:34:51.486 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 179441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-30T16:34:51.487 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-30T16:34:51.487 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-30T16:34:51.487 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-30T16:34:51.487 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/ 2024-05-30T16:34:51.487 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 103385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-30T16:34:51.487 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/nvram.ko 2024-05-30T16:34:51.487 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-30T16:34:51.487 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-30T16:34:51.487 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/ 2024-05-30T16:34:51.487 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-30T16:34:51.487 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-05-30T16:34:51.488 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-05-30T16:34:51.488 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-05-30T16:34:51.488 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-30T16:34:51.488 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-30T16:34:51.488 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-05-30T16:34:51.488 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/ 2024-05-30T16:34:51.488 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_class.ko 2024-05-30T16:34:51.488 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_core.ko 2024-05-30T16:34:51.488 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-05-30T16:34:51.488 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/ 2024-05-30T16:34:51.489 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-palmas.ko 2024-05-30T16:34:51.489 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-si5351.ko 2024-05-30T16:34:51.489 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-twl6040.ko 2024-05-30T16:34:51.489 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-wm831x.ko 2024-05-30T16:34:51.489 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/ 2024-05-30T16:34:51.489 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-30T16:34:51.489 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-30T16:34:51.489 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-30T16:34:51.489 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ 2024-05-30T16:34:51.489 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ 2024-05-30T16:34:51.489 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 89209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-30T16:34:51.489 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 333593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-30T16:34:51.490 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/ 2024-05-30T16:34:51.490 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/ 2024-05-30T16:34:51.490 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/ 2024-05-30T16:34:51.490 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 751433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-30T16:34:51.490 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-05-30T16:34:51.490 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-30T16:34:51.490 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-30T16:34:51.490 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-30T16:34:51.490 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/ 2024-05-30T16:34:51.490 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/ 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/ 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 146745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 96137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 51097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-30T16:34:51.491 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-30T16:34:51.492 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-30T16:34:51.492 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-30T16:34:51.492 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-30T16:34:51.492 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 64153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-30T16:34:51.492 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-30T16:34:51.492 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-30T16:34:51.492 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 68689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-30T16:34:51.492 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-30T16:34:51.492 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/ 2024-05-30T16:34:51.492 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-gpio.ko 2024-05-30T16:34:51.492 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max14577.ko 2024-05-30T16:34:51.493 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max77693.ko 2024-05-30T16:34:51.493 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max8997.ko 2024-05-30T16:34:51.493 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-palmas.ko 2024-05-30T16:34:51.493 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-rt8973a.ko 2024-05-30T16:34:51.493 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-sm5502.ko 2024-05-30T16:34:51.493 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/ 2024-05-30T16:34:51.493 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/dmi-sysfs.ko 2024-05-30T16:34:51.493 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/ 2024-05-30T16:34:51.493 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/efi-pstore.ko 2024-05-30T16:34:51.493 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-30T16:34:51.493 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/ 2024-05-30T16:34:51.493 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-adp5520.ko 2024-05-30T16:34:51.494 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-amd8111.ko 2024-05-30T16:34:51.494 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-arizona.ko 2024-05-30T16:34:51.494 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9052.ko 2024-05-30T16:34:51.494 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9055.ko 2024-05-30T16:34:51.494 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-dln2.ko 2024-05-30T16:34:51.494 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 81065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-f7188x.ko 2024-05-30T16:34:51.494 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-generic.ko 2024-05-30T16:34:51.494 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-30T16:34:51.494 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-05-30T16:34:51.495 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-kempld.ko 2024-05-30T16:34:51.495 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-lp3943.ko 2024-05-30T16:34:51.495 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max7300.ko 2024-05-30T16:34:51.495 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max730x.ko 2024-05-30T16:34:51.495 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max732x.ko 2024-05-30T16:34:51.495 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-05-30T16:34:51.495 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pca953x.ko 2024-05-30T16:34:51.495 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pcf857x.ko 2024-05-30T16:34:51.495 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-rdc321x.ko 2024-05-30T16:34:51.496 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch.ko 2024-05-30T16:34:51.496 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch311x.ko 2024-05-30T16:34:51.496 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-tps65912.ko 2024-05-30T16:34:51.496 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl4030.ko 2024-05-30T16:34:51.496 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl6040.ko 2024-05-30T16:34:51.496 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-30T16:34:51.496 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-vx855.ko 2024-05-30T16:34:51.496 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm831x.ko 2024-05-30T16:34:51.496 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8350.ko 2024-05-30T16:34:51.496 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8994.ko 2024-05-30T16:34:51.496 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/ 2024-05-30T16:34:51.497 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-a4tech.ko 2024-05-30T16:34:51.497 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-apple.ko 2024-05-30T16:34:51.497 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-30T16:34:51.497 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-30T16:34:51.497 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-30T16:34:51.497 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-belkin.ko 2024-05-30T16:34:51.497 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cherry.ko 2024-05-30T16:34:51.497 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-chicony.ko 2024-05-30T16:34:51.497 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 74385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cp2112.ko 2024-05-30T16:34:51.497 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cypress.ko 2024-05-30T16:34:51.497 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-30T16:34:51.498 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-30T16:34:51.498 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-30T16:34:51.498 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-30T16:34:51.498 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ezkey.ko 2024-05-30T16:34:51.498 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-30T16:34:51.498 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-generic.ko 2024-05-30T16:34:51.498 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-30T16:34:51.498 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-30T16:34:51.498 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-30T16:34:51.498 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-30T16:34:51.498 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-30T16:34:51.498 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-30T16:34:51.499 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-30T16:34:51.499 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kensington.ko 2024-05-30T16:34:51.499 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-30T16:34:51.499 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-30T16:34:51.499 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-30T16:34:51.499 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-30T16:34:51.499 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-30T16:34:51.499 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lg-g15.ko 2024-05-30T16:34:51.499 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-30T16:34:51.499 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 121361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-30T16:34:51.499 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 97929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech.ko 2024-05-30T16:34:51.499 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-magicmouse.ko 2024-05-30T16:34:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-microsoft.ko 2024-05-30T16:34:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-monterey.ko 2024-05-30T16:34:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 58993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-30T16:34:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ntrig.ko 2024-05-30T16:34:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-30T16:34:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-30T16:34:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-30T16:34:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-30T16:34:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-30T16:34:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-30T16:34:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-30T16:34:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-30T16:34:51.501 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-30T16:34:51.501 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-30T16:34:51.501 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-30T16:34:51.501 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-30T16:34:51.501 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-30T16:34:51.501 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-30T16:34:51.501 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-30T16:34:51.501 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-30T16:34:51.501 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-30T16:34:51.501 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-30T16:34:51.502 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-30T16:34:51.502 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-30T16:34:51.502 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-30T16:34:51.502 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-30T16:34:51.502 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-30T16:34:51.502 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-30T16:34:51.502 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-30T16:34:51.502 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-30T16:34:51.502 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-30T16:34:51.502 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-30T16:34:51.502 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-30T16:34:51.503 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-30T16:34:51.503 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-30T16:34:51.503 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-30T16:34:51.503 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-30T16:34:51.503 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 81097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-30T16:34:51.503 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-30T16:34:51.503 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 184729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-30T16:34:51.503 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-30T16:34:51.503 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-30T16:34:51.503 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-30T16:34:51.504 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 319897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid.ko 2024-05-30T16:34:51.504 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-30T16:34:51.504 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/ 2024-05-30T16:34:51.504 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 153617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbhid.ko 2024-05-30T16:34:51.504 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbkbd.ko 2024-05-30T16:34:51.504 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbmouse.ko 2024-05-30T16:34:51.504 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 261929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-30T16:34:51.504 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/ 2024-05-30T16:34:51.504 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 75057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-30T16:34:51.505 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 110657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-30T16:34:51.505 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 381625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-30T16:34:51.505 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ 2024-05-30T16:34:51.505 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 77145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-30T16:34:51.505 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-30T16:34:51.505 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-30T16:34:51.505 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-30T16:34:51.505 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-30T16:34:51.505 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-30T16:34:51.505 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-30T16:34:51.505 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 115049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-30T16:34:51.505 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-30T16:34:51.506 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-30T16:34:51.506 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-30T16:34:51.506 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-30T16:34:51.506 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-30T16:34:51.506 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-30T16:34:51.506 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 89017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-30T16:34:51.506 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-30T16:34:51.506 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 81465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-30T16:34:51.506 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-30T16:34:51.506 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-30T16:34:51.507 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 68857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-30T16:34:51.507 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-30T16:34:51.507 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-30T16:34:51.507 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-30T16:34:51.507 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-30T16:34:51.507 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-30T16:34:51.507 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9052-hwmon.ko 2024-05-30T16:34:51.507 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9055-hwmon.ko 2024-05-30T16:34:51.507 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-30T16:34:51.507 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 113129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-30T16:34:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-30T16:34:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-30T16:34:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-30T16:34:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc2103.ko 2024-05-30T16:34:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-30T16:34:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-30T16:34:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 108953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-30T16:34:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-30T16:34:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-30T16:34:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-30T16:34:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-30T16:34:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-30T16:34:51.509 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-30T16:34:51.509 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-30T16:34:51.509 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hih6130.ko 2024-05-30T16:34:51.509 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-30T16:34:51.509 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-30T16:34:51.509 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-30T16:34:51.509 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-30T16:34:51.509 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-30T16:34:51.509 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-30T16:34:51.509 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-30T16:34:51.509 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 156457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-30T16:34:51.509 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/jc42.ko 2024-05-30T16:34:51.510 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-30T16:34:51.510 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-30T16:34:51.510 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-30T16:34:51.510 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-30T16:34:51.510 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-30T16:34:51.510 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-30T16:34:51.510 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-30T16:34:51.510 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-30T16:34:51.511 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-30T16:34:51.511 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-30T16:34:51.511 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 86489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-30T16:34:51.511 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-30T16:34:51.511 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 76481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-30T16:34:51.511 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-30T16:34:51.511 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 131497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-30T16:34:51.511 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-30T16:34:51.511 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-30T16:34:51.511 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-30T16:34:51.511 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-30T16:34:51.511 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-30T16:34:51.512 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-30T16:34:51.512 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-30T16:34:51.512 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-30T16:34:51.512 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-30T16:34:51.512 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-30T16:34:51.512 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-30T16:34:51.512 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-30T16:34:51.512 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-30T16:34:51.512 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-30T16:34:51.512 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-30T16:34:51.513 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-30T16:34:51.513 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-30T16:34:51.513 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mc13783-adc.ko 2024-05-30T16:34:51.513 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-30T16:34:51.513 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-05-30T16:34:51.513 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-30T16:34:51.513 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 141345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-30T16:34:51.513 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 72729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-30T16:34:51.513 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-30T16:34:51.513 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 97769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-30T16:34:51.513 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-30T16:34:51.513 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-30T16:34:51.514 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ 2024-05-30T16:34:51.514 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-30T16:34:51.514 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-30T16:34:51.514 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-30T16:34:51.514 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-30T16:34:51.514 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-30T16:34:51.514 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-30T16:34:51.514 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-30T16:34:51.514 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 101225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-30T16:34:51.514 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-30T16:34:51.514 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-30T16:34:51.515 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 71161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 96569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 75121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-30T16:34:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 83417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 116769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 134433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/ 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/ 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/ 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-05-30T16:34:51.517 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-05-30T16:34:51.518 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-30T16:34:51.518 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-30T16:34:51.518 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-30T16:34:51.518 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-05-30T16:34:51.518 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-30T16:34:51.518 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-05-30T16:34:51.518 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 64217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-30T16:34:51.518 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-30T16:34:51.518 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-30T16:34:51.519 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-30T16:34:51.519 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-05-30T16:34:51.519 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-05-30T16:34:51.519 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 76961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-30T16:34:51.519 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-30T16:34:51.519 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-30T16:34:51.519 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-05-30T16:34:51.519 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-30T16:34:51.519 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-30T16:34:51.520 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-05-30T16:34:51.520 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-30T16:34:51.520 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-30T16:34:51.520 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-30T16:34:51.520 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-05-30T16:34:51.520 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-30T16:34:51.522 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-30T16:34:51.522 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-05-30T16:34:51.522 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-05-30T16:34:51.522 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-30T16:34:51.523 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-05-30T16:34:51.523 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-30T16:34:51.523 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-30T16:34:51.523 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-30T16:34:51.523 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-30T16:34:51.524 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-05-30T16:34:51.524 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-30T16:34:51.524 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-30T16:34:51.524 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-30T16:34:51.524 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/ 2024-05-30T16:34:51.524 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-05-30T16:34:51.524 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-05-30T16:34:51.524 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 329681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1119785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 83897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 408329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 120905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 347201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 84937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/ 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 590873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-30T16:34:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/ 2024-05-30T16:34:51.526 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 514577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-30T16:34:51.526 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/ 2024-05-30T16:34:51.526 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 911649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-30T16:34:51.526 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ 2024-05-30T16:34:51.526 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 375449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-30T16:34:51.526 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ 2024-05-30T16:34:51.526 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 197097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-05-30T16:34:51.526 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/ 2024-05-30T16:34:51.526 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 212497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-05-30T16:34:51.526 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ 2024-05-30T16:34:51.526 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ 2024-05-30T16:34:51.526 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 334353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 120649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 132577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 157929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 156665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/evbug.ko 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ff-memless.ko 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/ 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-30T16:34:51.527 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/ 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lkkbd.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8323.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8333.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-05-30T16:34:51.528 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-05-30T16:34:51.529 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-05-30T16:34:51.529 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/newtonkbd.ko 2024-05-30T16:34:51.529 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-05-30T16:34:51.529 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt1070.ko 2024-05-30T16:34:51.529 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt2160.ko 2024-05-30T16:34:51.529 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-05-30T16:34:51.529 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/stowaway.ko 2024-05-30T16:34:51.529 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/sunkbd.ko 2024-05-30T16:34:51.529 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-05-30T16:34:51.529 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-05-30T16:34:51.529 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-05-30T16:34:51.529 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/xtkbd.ko 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/matrix-keymap.ko 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/ 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 159993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 114193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/gpio_mouse.ko 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 428121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/psmouse.ko 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-30T16:34:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/ 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 140921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ct82c710.ko 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/parkbd.ko 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/pcips2.ko 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ps2mult.ko 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serport.ko 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/ 2024-05-30T16:34:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-88pm860x.ko 2024-05-30T16:34:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-adp5520.ko 2024-05-30T16:34:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 77193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-bd2802.ko 2024-05-30T16:34:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-30T16:34:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da903x.ko 2024-05-30T16:34:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da9052.ko 2024-05-30T16:34:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-gpio.ko 2024-05-30T16:34:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-30T16:34:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3533.ko 2024-05-30T16:34:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm355x.ko 2024-05-30T16:34:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3642.ko 2024-05-30T16:34:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-30T16:34:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp8788.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-max8997.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-mc13783.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-menf21bmc.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca9532.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca955x.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca963x.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-tca6507.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm831x-status.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm8350.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-30T16:34:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/ 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/ 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 790665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 116817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bufio.ko 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 58273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-30T16:34:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 199017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 134937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-era.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-mirror.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 97193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-region-hash.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-30T16:34:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 139793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-snapshot.ko 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 234441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-zero.ko 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/ 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 264273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 124705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 157673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 444649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/ 2024-05-30T16:34:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/ 2024-05-30T16:34:51.537 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 214833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-30T16:34:51.537 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 77977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-30T16:34:51.537 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-30T16:34:51.537 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-30T16:34:51.537 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 150753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-30T16:34:51.537 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 97209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-30T16:34:51.587 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 63865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-30T16:34:51.587 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/ 2024-05-30T16:34:51.587 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm800.ko 2024-05-30T16:34:51.587 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm805.ko 2024-05-30T16:34:51.588 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm80x.ko 2024-05-30T16:34:51.588 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona-i2c.ko 2024-05-30T16:34:51.588 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 148545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona.ko 2024-05-30T16:34:51.588 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/bcm590xx.ko 2024-05-30T16:34:51.588 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/cros_ec_dev.ko 2024-05-30T16:34:51.588 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/dln2.ko 2024-05-30T16:34:51.588 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/janz-cmodio.ko 2024-05-30T16:34:51.588 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/kempld-core.ko 2024-05-30T16:34:51.588 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-core.ko 2024-05-30T16:34:51.588 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-05-30T16:34:51.588 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lp3943.ko 2024-05-30T16:34:51.588 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-30T16:34:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-30T16:34:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/max8907.ko 2024-05-30T16:34:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-core.ko 2024-05-30T16:34:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-05-30T16:34:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/menf21bmc.ko 2024-05-30T16:34:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-adc.ko 2024-05-30T16:34:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-gpio.ko 2024-05-30T16:34:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633.ko 2024-05-30T16:34:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-05-30T16:34:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/retu-mfd.ko 2024-05-30T16:34:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 99409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/si476x-core.ko 2024-05-30T16:34:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 58049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-30T16:34:51.590 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps65010.ko 2024-05-30T16:34:51.590 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps6507x.ko 2024-05-30T16:34:51.590 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-30T16:34:51.590 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-30T16:34:51.590 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-30T16:34:51.590 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wm8994.ko 2024-05-30T16:34:51.590 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ 2024-05-30T16:34:51.590 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-05-30T16:34:51.590 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 64257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot.ko 2024-05-30T16:34:51.590 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/ 2024-05-30T16:34:51.590 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-30T16:34:51.590 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-30T16:34:51.591 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-30T16:34:51.591 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 58625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-30T16:34:51.591 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/ 2024-05-30T16:34:51.591 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-05-30T16:34:51.591 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/core.ko 2024-05-30T16:34:51.591 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/ 2024-05-30T16:34:51.591 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-30T16:34:51.591 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ds1682.ko 2024-05-30T16:34:51.591 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/dummy-irq.ko 2024-05-30T16:34:51.591 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/ 2024-05-30T16:34:51.591 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/echo.ko 2024-05-30T16:34:51.592 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/ 2024-05-30T16:34:51.592 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-30T16:34:51.592 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-30T16:34:51.592 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-30T16:34:51.592 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-30T16:34:51.592 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/ 2024-05-30T16:34:51.592 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 191617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-05-30T16:34:51.592 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hmc6352.ko 2024-05-30T16:34:51.592 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-30T16:34:51.592 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ 2024-05-30T16:34:51.592 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 92289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-05-30T16:34:51.593 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ics932s401.ko 2024-05-30T16:34:51.593 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-30T16:34:51.593 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-30T16:34:51.593 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/ 2024-05-30T16:34:51.593 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-30T16:34:51.593 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-30T16:34:51.593 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/ 2024-05-30T16:34:51.593 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 154257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-30T16:34:51.593 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-30T16:34:51.594 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 388977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-30T16:34:51.594 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/phantom.ko 2024-05-30T16:34:51.594 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/ 2024-05-30T16:34:51.594 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/st_drv.ko 2024-05-30T16:34:51.594 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-30T16:34:51.594 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-30T16:34:51.594 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-30T16:34:51.594 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-30T16:34:51.594 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/ 2024-05-30T16:34:51.595 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 234849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-30T16:34:51.595 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ 2024-05-30T16:34:51.595 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/ 2024-05-30T16:34:51.595 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 620849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-30T16:34:51.595 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/ 2024-05-30T16:34:51.595 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/ 2024-05-30T16:34:51.595 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 139745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-30T16:34:51.595 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-30T16:34:51.595 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-30T16:34:51.595 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/ 2024-05-30T16:34:51.595 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 589537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-30T16:34:51.596 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-30T16:34:51.596 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-30T16:34:51.596 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ 2024-05-30T16:34:51.596 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/ 2024-05-30T16:34:51.596 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-30T16:34:51.596 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-30T16:34:51.596 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 158641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-30T16:34:51.596 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-30T16:34:51.596 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ 2024-05-30T16:34:51.596 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-30T16:34:51.597 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-30T16:34:51.597 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-30T16:34:51.597 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 109513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-30T16:34:51.597 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/ 2024-05-30T16:34:51.597 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 64697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-30T16:34:51.597 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/ 2024-05-30T16:34:51.597 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 84321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-30T16:34:51.597 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/ 2024-05-30T16:34:51.597 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-30T16:34:51.597 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/ 2024-05-30T16:34:51.597 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-30T16:34:51.598 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/ 2024-05-30T16:34:51.598 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-30T16:34:51.598 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-30T16:34:51.598 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 115873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-30T16:34:51.598 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/ 2024-05-30T16:34:51.598 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/ 2024-05-30T16:34:51.598 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 124481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-30T16:34:51.598 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-05-30T16:34:51.598 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 128393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-30T16:34:51.598 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-05-30T16:34:51.598 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 110321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-30T16:34:51.599 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/ 2024-05-30T16:34:51.599 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 101849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-30T16:34:51.599 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 88945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-30T16:34:51.599 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/ 2024-05-30T16:34:51.599 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 105625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-30T16:34:51.599 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 228977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-30T16:34:51.600 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-05-30T16:34:51.600 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1733297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-30T16:34:51.600 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 167177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-30T16:34:51.600 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/ 2024-05-30T16:34:51.600 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 164249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-30T16:34:51.600 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 440553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-30T16:34:51.600 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/ 2024-05-30T16:34:51.600 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/ 2024-05-30T16:34:51.600 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 432145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-30T16:34:51.601 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/ 2024-05-30T16:34:51.601 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-05-30T16:34:51.601 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 257145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-30T16:34:51.601 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-05-30T16:34:51.601 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 446057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-30T16:34:51.601 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-05-30T16:34:51.601 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1311193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-30T16:34:51.601 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-05-30T16:34:51.601 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 206673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-30T16:34:51.601 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-05-30T16:34:51.602 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-30T16:34:51.602 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/ 2024-05-30T16:34:51.602 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/ 2024-05-30T16:34:51.602 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 269249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-30T16:34:51.602 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/ 2024-05-30T16:34:51.602 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/ 2024-05-30T16:34:51.602 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-30T16:34:51.602 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 77449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-30T16:34:51.602 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 169041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-30T16:34:51.602 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-30T16:34:51.602 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 76201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-30T16:34:51.602 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-30T16:34:51.603 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/ 2024-05-30T16:34:51.603 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 75937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-30T16:34:51.603 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-30T16:34:51.603 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-30T16:34:51.603 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ec_bhf.ko 2024-05-30T16:34:51.603 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/ 2024-05-30T16:34:51.603 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/ 2024-05-30T16:34:51.603 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 356353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-30T16:34:51.603 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-30T16:34:51.604 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 63177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-30T16:34:51.604 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/ 2024-05-30T16:34:51.604 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 51505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-05-30T16:34:51.604 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ 2024-05-30T16:34:51.604 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 115561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-30T16:34:51.604 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/ 2024-05-30T16:34:51.604 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 366193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-30T16:34:51.605 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/ 2024-05-30T16:34:51.605 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 755673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-30T16:34:51.605 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/ 2024-05-30T16:34:51.605 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 324513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-30T16:34:51.605 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/ 2024-05-30T16:34:51.605 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1196201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-30T16:34:51.605 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/ 2024-05-30T16:34:51.605 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 362609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-30T16:34:51.605 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/ 2024-05-30T16:34:51.605 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 672313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-30T16:34:51.605 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/ 2024-05-30T16:34:51.606 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 121513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-30T16:34:51.606 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-05-30T16:34:51.606 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 966601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-30T16:34:51.606 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-05-30T16:34:51.606 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 193465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-30T16:34:51.606 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 108625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-30T16:34:51.606 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/ 2024-05-30T16:34:51.606 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-30T16:34:51.607 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 126873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-30T16:34:51.607 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 150769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-30T16:34:51.607 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/ 2024-05-30T16:34:51.607 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-05-30T16:34:51.607 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 904929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-30T16:34:51.607 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 344089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-30T16:34:51.607 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-05-30T16:34:51.608 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-05-30T16:34:51.608 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1413529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-30T16:34:51.608 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ 2024-05-30T16:34:51.608 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-05-30T16:34:51.608 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-05-30T16:34:51.608 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-05-30T16:34:51.608 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 117345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-30T16:34:51.608 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/ 2024-05-30T16:34:51.608 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-05-30T16:34:51.609 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 131353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-30T16:34:51.609 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ 2024-05-30T16:34:51.609 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-30T16:34:51.609 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-30T16:34:51.609 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/ 2024-05-30T16:34:51.609 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 181201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-30T16:34:51.609 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/ 2024-05-30T16:34:51.609 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 171409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-30T16:34:51.609 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/ 2024-05-30T16:34:51.610 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 58241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-30T16:34:51.610 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-30T16:34:51.610 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/ 2024-05-30T16:34:51.610 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-05-30T16:34:51.610 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 300793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-30T16:34:51.610 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 105681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-30T16:34:51.610 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-05-30T16:34:51.610 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 885057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-30T16:34:51.611 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/ 2024-05-30T16:34:51.611 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-30T16:34:51.611 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/ 2024-05-30T16:34:51.611 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 81633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-30T16:34:51.611 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 100681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-30T16:34:51.611 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-30T16:34:51.611 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 264145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-30T16:34:51.611 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/ 2024-05-30T16:34:51.611 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-05-30T16:34:51.611 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 142401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-05-30T16:34:51.611 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/ 2024-05-30T16:34:51.612 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1350201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-30T16:34:51.612 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/ 2024-05-30T16:34:51.612 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-30T16:34:51.612 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/ 2024-05-30T16:34:51.612 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-30T16:34:51.612 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 80057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-30T16:34:51.612 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/ 2024-05-30T16:34:51.613 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 74281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-30T16:34:51.613 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 79449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-30T16:34:51.613 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 100777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-30T16:34:51.613 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 83433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-30T16:34:51.613 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/ 2024-05-30T16:34:51.613 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-05-30T16:34:51.613 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-05-30T16:34:51.613 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-30T16:34:51.613 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-05-30T16:34:51.613 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 644329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-30T16:34:51.613 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/ 2024-05-30T16:34:51.614 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 128489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-30T16:34:51.614 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 207985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-30T16:34:51.614 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 82625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-30T16:34:51.614 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-30T16:34:51.614 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/ 2024-05-30T16:34:51.614 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-30T16:34:51.614 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/ 2024-05-30T16:34:51.614 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 110721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-30T16:34:51.615 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/ 2024-05-30T16:34:51.615 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 98681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-30T16:34:51.615 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 102505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-30T16:34:51.615 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/ 2024-05-30T16:34:51.615 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-30T16:34:51.615 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-30T16:34:51.615 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/ 2024-05-30T16:34:51.615 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-30T16:34:51.615 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/ 2024-05-30T16:34:51.615 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/defxx.ko 2024-05-30T16:34:51.616 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/ 2024-05-30T16:34:51.616 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 275713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/skfp.ko 2024-05-30T16:34:51.616 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-30T16:34:51.616 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/ 2024-05-30T16:34:51.616 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 290441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-30T16:34:51.616 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/ 2024-05-30T16:34:51.616 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-30T16:34:51.616 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-30T16:34:51.617 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ 2024-05-30T16:34:51.617 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-30T16:34:51.617 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-30T16:34:51.617 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-30T16:34:51.617 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/ 2024-05-30T16:34:51.617 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-30T16:34:51.617 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-30T16:34:51.617 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-gpio.ko 2024-05-30T16:34:51.617 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-30T16:34:51.618 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-30T16:34:51.618 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-30T16:34:51.618 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-30T16:34:51.618 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-30T16:34:51.618 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/ 2024-05-30T16:34:51.618 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-30T16:34:51.619 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-30T16:34:51.619 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ 2024-05-30T16:34:51.619 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-30T16:34:51.619 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-30T16:34:51.619 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-30T16:34:51.619 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-30T16:34:51.619 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-30T16:34:51.619 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-30T16:34:51.619 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-30T16:34:51.619 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-30T16:34:51.620 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-30T16:34:51.620 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-30T16:34:51.620 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 103369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-30T16:34:51.620 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 96017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-30T16:34:51.620 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-30T16:34:51.620 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 121097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-30T16:34:51.620 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-30T16:34:51.620 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-30T16:34:51.620 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-30T16:34:51.620 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-30T16:34:51.620 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/ 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/plip.ko 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sb1000.ko 2024-05-30T16:34:51.621 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/ 2024-05-30T16:34:51.622 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-30T16:34:51.622 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-30T16:34:51.622 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 80153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-30T16:34:51.622 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/ 2024-05-30T16:34:51.622 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 137313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-30T16:34:51.622 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-30T16:34:51.622 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-30T16:34:51.622 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-30T16:34:51.622 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-30T16:34:51.622 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-30T16:34:51.622 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 108081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-30T16:34:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/ 2024-05-30T16:34:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 176481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-30T16:34:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/ 2024-05-30T16:34:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 384329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-30T16:34:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/ 2024-05-30T16:34:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 175513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-30T16:34:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ 2024-05-30T16:34:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-30T16:34:51.624 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/ 2024-05-30T16:34:51.624 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/ 2024-05-30T16:34:51.624 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 335489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-30T16:34:51.624 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 127497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-30T16:34:51.624 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/ 2024-05-30T16:34:51.624 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 168113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-30T16:34:51.624 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-30T16:34:51.624 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 103881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-30T16:34:51.624 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-30T16:34:51.624 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/ 2024-05-30T16:34:51.625 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/ 2024-05-30T16:34:51.625 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-30T16:34:51.625 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-05-30T16:34:51.625 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-05-30T16:34:51.625 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pci-stub.ko 2024-05-30T16:34:51.625 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-30T16:34:51.626 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/ 2024-05-30T16:34:51.626 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-30T16:34:51.626 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 179937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia.ko 2024-05-30T16:34:51.626 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_core.ko 2024-05-30T16:34:51.626 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-05-30T16:34:51.626 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-30T16:34:51.626 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 133745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-30T16:34:51.626 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/ 2024-05-30T16:34:51.626 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/ 2024-05-30T16:34:51.626 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-05-30T16:34:51.626 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/ 2024-05-30T16:34:51.626 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-05-30T16:34:51.627 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/ 2024-05-30T16:34:51.627 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/ 2024-05-30T16:34:51.627 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-30T16:34:51.627 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/ 2024-05-30T16:34:51.627 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/ 2024-05-30T16:34:51.627 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-05-30T16:34:51.627 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec.ko 2024-05-30T16:34:51.627 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-05-30T16:34:51.627 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-05-30T16:34:51.627 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-05-30T16:34:51.627 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-05-30T16:34:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-05-30T16:34:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ 2024-05-30T16:34:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 87929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-30T16:34:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-30T16:34:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-30T16:34:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-30T16:34:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-30T16:34:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 164761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-30T16:34:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-30T16:34:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-30T16:34:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-30T16:34:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 51873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ibm_rtl.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/ 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-30T16:34:51.629 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-30T16:34:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-30T16:34:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-30T16:34:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-30T16:34:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/ 2024-05-30T16:34:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ 2024-05-30T16:34:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_battery.ko 2024-05-30T16:34:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_charger.ko 2024-05-30T16:34:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 68825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq2415x_charger.ko 2024-05-30T16:34:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 73065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24190_charger.ko 2024-05-30T16:34:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24735-charger.ko 2024-05-30T16:34:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-05-30T16:34:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9030_battery.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9052-battery.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2760_battery.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2780_battery.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2781_battery.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2782_battery.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/gpio-charger.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/isp1704_charger.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/lp8727_charger.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max14577_charger.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max17042_battery.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8903_charger.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8925_power.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/pcf50633-charger.ko 2024-05-30T16:34:51.631 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/sbs-battery.ko 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/test_power.ko 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/tps65090-charger.ko 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_backup.ko 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_power.ko 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm8350_power.ko 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/ 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 73289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/ 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/ 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-30T16:34:51.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-30T16:34:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ 2024-05-30T16:34:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-30T16:34:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-30T16:34:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/ 2024-05-30T16:34:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/ 2024-05-30T16:34:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/ 2024-05-30T16:34:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-30T16:34:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-30T16:34:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/ 2024-05-30T16:34:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm80x.ko 2024-05-30T16:34:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm860x.ko 2024-05-30T16:34:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-30T16:34:51.634 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9052.ko 2024-05-30T16:34:51.634 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9055.ko 2024-05-30T16:34:51.634 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9063.ko 2024-05-30T16:34:51.634 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-30T16:34:51.634 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 82217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-30T16:34:51.634 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-30T16:34:51.634 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-30T16:34:51.634 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-30T16:34:51.634 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-30T16:34:51.634 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-lp8788.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t86.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-30T16:34:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8907.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8925.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8997.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8998.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-palmas.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf50633.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-30T16:34:51.636 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rc5t583.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-s35390a.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps6586x.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps65910.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm831x.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm8350.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-30T16:34:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 164473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/ 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 340689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 120393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/ 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 468049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 380633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/ 2024-05-30T16:34:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 243649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-05-30T16:34:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-30T16:34:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/ 2024-05-30T16:34:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 135601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-30T16:34:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-30T16:34:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/ 2024-05-30T16:34:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 304969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-30T16:34:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/ 2024-05-30T16:34:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1527017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-30T16:34:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/ 2024-05-30T16:34:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 297769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-30T16:34:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/ 2024-05-30T16:34:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 144377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-30T16:34:51.640 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-30T16:34:51.640 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/ 2024-05-30T16:34:51.640 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 390657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-30T16:34:51.640 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/ 2024-05-30T16:34:51.640 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-05-30T16:34:51.640 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 88873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-30T16:34:51.640 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-05-30T16:34:51.640 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 117473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-30T16:34:51.640 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 173009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-30T16:34:51.640 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-30T16:34:51.641 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-30T16:34:51.641 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/ 2024-05-30T16:34:51.641 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 267521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-30T16:34:51.641 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-30T16:34:51.641 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/ 2024-05-30T16:34:51.641 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 95321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-30T16:34:51.641 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 194001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-30T16:34:51.641 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fdomain.ko 2024-05-30T16:34:51.641 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/ 2024-05-30T16:34:51.641 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 366457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-30T16:34:51.641 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 251497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/imm.ko 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 327833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 129777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/ 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 397657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 63113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/ 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 386801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-30T16:34:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 178169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 64801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/ 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 273953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/ 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 2735913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/ 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 88521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 389089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 104761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/ 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 836897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/ 2024-05-30T16:34:51.643 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 158705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 96529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/ 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 101609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/ 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 443713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 152025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ppa.ko 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/ 2024-05-30T16:34:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 2324713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-30T16:34:51.703 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 103593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-30T16:34:51.703 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/ 2024-05-30T16:34:51.703 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 697281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-30T16:34:51.704 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qlogicfas408.ko 2024-05-30T16:34:51.704 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-30T16:34:51.704 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 322857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-30T16:34:51.704 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 219849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-30T16:34:51.704 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 357145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-30T16:34:51.704 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 121177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-30T16:34:51.704 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 93473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-30T16:34:51.705 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-30T16:34:51.705 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-30T16:34:51.705 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 138113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-30T16:34:51.705 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-30T16:34:51.705 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/ 2024-05-30T16:34:51.705 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 205001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-30T16:34:51.705 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-30T16:34:51.705 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-30T16:34:51.706 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-30T16:34:51.706 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/xen-scsifront.ko 2024-05-30T16:34:51.706 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ 2024-05-30T16:34:51.706 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 174865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-30T16:34:51.706 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/ 2024-05-30T16:34:51.706 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/ 2024-05-30T16:34:51.706 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 920073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-30T16:34:51.706 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/ 2024-05-30T16:34:51.707 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-30T16:34:51.707 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-30T16:34:51.707 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-30T16:34:51.707 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1170873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-30T16:34:51.707 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-30T16:34:51.708 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 149777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-30T16:34:51.708 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/ 2024-05-30T16:34:51.708 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-30T16:34:51.708 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/ 2024-05-30T16:34:51.708 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/ 2024-05-30T16:34:51.708 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/ 2024-05-30T16:34:51.708 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-30T16:34:51.708 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-30T16:34:51.708 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-30T16:34:51.709 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-30T16:34:51.709 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-30T16:34:51.709 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-30T16:34:51.709 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-30T16:34:51.709 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-30T16:34:51.709 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-30T16:34:51.709 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-30T16:34:51.709 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-30T16:34:51.709 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-30T16:34:51.710 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-30T16:34:51.710 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-30T16:34:51.710 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-30T16:34:51.710 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-05-30T16:34:51.710 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-30T16:34:51.710 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-30T16:34:51.710 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-30T16:34:51.710 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ 2024-05-30T16:34:51.710 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ 2024-05-30T16:34:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 99289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-30T16:34:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/moxa.ko 2024-05-30T16:34:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/mxser.ko 2024-05-30T16:34:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 134329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-30T16:34:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-30T16:34:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-30T16:34:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/ 2024-05-30T16:34:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/ 2024-05-30T16:34:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-05-30T16:34:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-30T16:34:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-05-30T16:34:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_uart.ko 2024-05-30T16:34:51.712 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-30T16:34:51.712 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-05-30T16:34:51.712 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/ 2024-05-30T16:34:51.712 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 120553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-30T16:34:51.712 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/rp2.ko 2024-05-30T16:34:51.712 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/sc16is7xx.ko 2024-05-30T16:34:51.712 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/ 2024-05-30T16:34:51.712 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ 2024-05-30T16:34:51.712 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 693057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-30T16:34:51.712 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ 2024-05-30T16:34:51.713 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-30T16:34:51.713 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-05-30T16:34:51.713 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/ 2024-05-30T16:34:51.713 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-30T16:34:51.713 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-30T16:34:51.713 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-30T16:34:51.713 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_dmem_genirq.ko 2024-05-30T16:34:51.713 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_mf624.ko 2024-05-30T16:34:51.713 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_netx.ko 2024-05-30T16:34:51.713 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-30T16:34:51.713 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-05-30T16:34:51.713 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-30T16:34:51.714 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/ 2024-05-30T16:34:51.714 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/ 2024-05-30T16:34:51.714 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/c67x00.ko 2024-05-30T16:34:51.714 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ 2024-05-30T16:34:51.714 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 189169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-05-30T16:34:51.714 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-05-30T16:34:51.714 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-05-30T16:34:51.714 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-05-30T16:34:51.714 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-05-30T16:34:51.714 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/ 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 101537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 63017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 107409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ulpi.ko 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/ 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/ 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 575217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3.ko 2024-05-30T16:34:51.715 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/ 2024-05-30T16:34:51.716 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/ 2024-05-30T16:34:51.716 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 72241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_ether.ko 2024-05-30T16:34:51.716 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_serial.ko 2024-05-30T16:34:51.716 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-05-30T16:34:51.716 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-05-30T16:34:51.716 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-05-30T16:34:51.716 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-05-30T16:34:51.716 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 131513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-05-30T16:34:51.716 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-05-30T16:34:51.716 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 146601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-05-30T16:34:51.716 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-05-30T16:34:51.716 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-05-30T16:34:51.717 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-05-30T16:34:51.717 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-05-30T16:34:51.717 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 101233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-05-30T16:34:51.717 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-05-30T16:34:51.717 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 71241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-05-30T16:34:51.717 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 84929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-05-30T16:34:51.717 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/ 2024-05-30T16:34:51.717 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-05-30T16:34:51.717 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-05-30T16:34:51.717 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-05-30T16:34:51.718 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-05-30T16:34:51.718 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-05-30T16:34:51.718 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-05-30T16:34:51.718 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-05-30T16:34:51.718 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-05-30T16:34:51.718 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-05-30T16:34:51.718 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-05-30T16:34:51.718 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-05-30T16:34:51.719 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-05-30T16:34:51.719 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-05-30T16:34:51.719 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-05-30T16:34:51.719 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 204009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/libcomposite.ko 2024-05-30T16:34:51.719 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/ 2024-05-30T16:34:51.719 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-05-30T16:34:51.719 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/ 2024-05-30T16:34:51.719 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 182537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-05-30T16:34:51.719 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-05-30T16:34:51.719 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-05-30T16:34:51.719 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-05-30T16:34:51.720 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-05-30T16:34:51.720 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2272.ko 2024-05-30T16:34:51.720 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2280.ko 2024-05-30T16:34:51.720 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 94833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-05-30T16:34:51.720 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 80513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-05-30T16:34:51.720 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 87457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-05-30T16:34:51.720 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 95433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-05-30T16:34:51.720 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 195953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-05-30T16:34:51.721 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ 2024-05-30T16:34:51.721 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/bcma-hcd.ko 2024-05-30T16:34:51.721 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/isp116x-hcd.ko 2024-05-30T16:34:51.721 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 104433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-05-30T16:34:51.721 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 102265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-05-30T16:34:51.722 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-30T16:34:51.722 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811_cs.ko 2024-05-30T16:34:51.722 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ssb-hcd.ko 2024-05-30T16:34:51.722 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-05-30T16:34:51.722 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/ 2024-05-30T16:34:51.722 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-30T16:34:51.723 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-30T16:34:51.723 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ 2024-05-30T16:34:51.723 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-30T16:34:51.723 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-30T16:34:51.723 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-05-30T16:34:51.723 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cytherm.ko 2024-05-30T16:34:51.723 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ehset.ko 2024-05-30T16:34:51.724 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-30T16:34:51.724 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-30T16:34:51.724 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-30T16:34:51.724 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-30T16:34:51.724 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-30T16:34:51.724 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-30T16:34:51.724 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-30T16:34:51.724 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-30T16:34:51.724 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/lvstest.ko 2024-05-30T16:34:51.725 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/ 2024-05-30T16:34:51.725 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-30T16:34:51.725 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-30T16:34:51.725 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-30T16:34:51.725 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-30T16:34:51.725 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-30T16:34:51.725 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 84257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbtest.ko 2024-05-30T16:34:51.725 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-30T16:34:51.726 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-30T16:34:51.726 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/ 2024-05-30T16:34:51.726 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/usbmon.ko 2024-05-30T16:34:51.726 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/ 2024-05-30T16:34:51.726 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 396169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/musb_hdrc.ko 2024-05-30T16:34:51.726 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/ 2024-05-30T16:34:51.726 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-30T16:34:51.727 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-05-30T16:34:51.727 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-isp1301.ko 2024-05-30T16:34:51.727 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-tahvo.ko 2024-05-30T16:34:51.727 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ 2024-05-30T16:34:51.727 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-30T16:34:51.727 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-30T16:34:51.727 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-30T16:34:51.727 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-30T16:34:51.727 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-30T16:34:51.727 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-30T16:34:51.727 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-30T16:34:51.727 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 58321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-30T16:34:51.728 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-30T16:34:51.728 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/f81232.ko 2024-05-30T16:34:51.728 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 188601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-30T16:34:51.728 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-30T16:34:51.728 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 152297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-30T16:34:51.728 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 142825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-30T16:34:51.728 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-30T16:34:51.729 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-30T16:34:51.729 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-30T16:34:51.729 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-30T16:34:51.729 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 122321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-30T16:34:51.729 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-30T16:34:51.729 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-30T16:34:51.729 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-30T16:34:51.729 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-30T16:34:51.730 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/metro-usb.ko 2024-05-30T16:34:51.730 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-30T16:34:51.730 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 89961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-30T16:34:51.730 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mxuport.ko 2024-05-30T16:34:51.730 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-30T16:34:51.730 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-30T16:34:51.730 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-30T16:34:51.730 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 197201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-30T16:34:51.731 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-30T16:34:51.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-30T16:34:51.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 151121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usbserial.ko 2024-05-30T16:34:51.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-30T16:34:51.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-30T16:34:51.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/wishbone-serial.ko 2024-05-30T16:34:51.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-30T16:34:51.732 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ 2024-05-30T16:34:51.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 64041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-30T16:34:51.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-30T16:34:51.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-30T16:34:51.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-30T16:34:51.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-30T16:34:51.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-30T16:34:51.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-30T16:34:51.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-30T16:34:51.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-30T16:34:51.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-30T16:34:51.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-30T16:34:51.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-30T16:34:51.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-30T16:34:51.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-30T16:34:51.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 201145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-30T16:34:51.733 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/ 2024-05-30T16:34:51.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 76025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-30T16:34:51.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-30T16:34:51.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 122233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-30T16:34:51.734 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/ 2024-05-30T16:34:51.734 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/ 2024-05-30T16:34:51.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 206897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-30T16:34:51.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-30T16:34:51.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 134241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-30T16:34:51.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 93665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-30T16:34:51.734 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/ 2024-05-30T16:34:51.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 138641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 71273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 107897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/ 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/ 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/aat2870_bl.ko 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp5520_bl.ko 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8860_bl.ko 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 51737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8870_bl.ko 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/as3711_bl.ko 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/bd6107.ko 2024-05-30T16:34:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da903x_bl.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da9052_bl.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/gpio_backlight.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/kb3886_bl.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3533_bl.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3639_bl.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lv5207lp.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/max8925_bl.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pandora_bl.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/wm831x_bl.ko 2024-05-30T16:34:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/ 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/matrox_w1.ko 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/w1-gpio.ko 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/ 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-30T16:34:51.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 129409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/acquirewdt.ko 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/advantechwdt.ko 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/cpu5wdt.ko 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9052_wdt.ko 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9055_wdt.ko 2024-05-30T16:34:51.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9063_wdt.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/dw_wdt.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/eurotechwdt.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/kempld_wdt.ko 2024-05-30T16:34:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-30T16:34:51.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/mena21_wdt.ko 2024-05-30T16:34:51.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-05-30T16:34:51.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-30T16:34:51.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-05-30T16:34:51.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pc87413_wdt.ko 2024-05-30T16:34:51.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-30T16:34:51.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-30T16:34:51.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/retu_wdt.ko 2024-05-30T16:34:51.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sc1200wdt.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/twl4030_wdt.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-30T16:34:51.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wafer5823wdt.ko 2024-05-30T16:34:51.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-30T16:34:51.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm831x_wdt.ko 2024-05-30T16:34:51.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm8350_wdt.ko 2024-05-30T16:34:51.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-30T16:34:51.742 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/ 2024-05-30T16:34:51.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-30T16:34:51.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-30T16:34:51.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-30T16:34:51.742 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/ 2024-05-30T16:34:51.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 213865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-30T16:34:51.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-30T16:34:51.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-scsiback.ko 2024-05-30T16:34:51.743 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/ 2024-05-30T16:34:51.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-30T16:34:51.743 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ 2024-05-30T16:34:51.743 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/ 2024-05-30T16:34:51.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 194449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-30T16:34:51.743 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/ 2024-05-30T16:34:51.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/adfs.ko 2024-05-30T16:34:51.743 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/ 2024-05-30T16:34:51.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 197801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-30T16:34:51.744 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/ 2024-05-30T16:34:51.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1260937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/kafs.ko 2024-05-30T16:34:51.744 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/ 2024-05-30T16:34:51.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 127337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/autofs4.ko 2024-05-30T16:34:51.744 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/ 2024-05-30T16:34:51.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 80481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-30T16:34:51.744 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/ 2024-05-30T16:34:51.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/bfs.ko 2024-05-30T16:34:51.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-30T16:34:51.744 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/ 2024-05-30T16:34:51.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 4491713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-30T16:34:51.744 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/ 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 376801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1586617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/ 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 130017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/ 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 139049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/configfs.ko 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/ 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/ 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 813137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/ 2024-05-30T16:34:51.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/efs.ko 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/ 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1906713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/ 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/ 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/freevxfs.ko 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/ 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/ 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1486393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/ 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 183217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/ 2024-05-30T16:34:51.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 281993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/ 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 248945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/hpfs.ko 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/ 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 92985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/ 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 532953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/ 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 361281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/ 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 112569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/ 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 591625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/ 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/ 2024-05-30T16:34:51.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 102537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-30T16:34:51.748 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/ 2024-05-30T16:34:51.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 74337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-30T16:34:51.748 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/ 2024-05-30T16:34:51.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 147673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-30T16:34:51.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1320377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-30T16:34:51.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 82089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv2.ko 2024-05-30T16:34:51.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 151617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-30T16:34:51.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 2518385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-30T16:34:51.748 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/ 2024-05-30T16:34:51.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-30T16:34:51.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/ 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 2021969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/ 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 733969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/ 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-30T16:34:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ascii.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-30T16:34:51.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 95617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 144201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 167129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 119505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-30T16:34:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-30T16:34:51.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 634457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ntfs3.ko 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 302033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 548057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 3245449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/ 2024-05-30T16:34:51.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/omfs.ko 2024-05-30T16:34:51.754 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/ 2024-05-30T16:34:51.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 462817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-30T16:34:51.754 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ 2024-05-30T16:34:51.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-30T16:34:51.754 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/ 2024-05-30T16:34:51.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/qnx4.ko 2024-05-30T16:34:51.754 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/ 2024-05-30T16:34:51.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/qnx6.ko 2024-05-30T16:34:51.754 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/ 2024-05-30T16:34:51.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_tree.ko 2024-05-30T16:34:51.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v1.ko 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v2.ko 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/ 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 684713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/ 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/ 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/ 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 3350841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/ 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/ 2024-05-30T16:34:51.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 164145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-30T16:34:51.756 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/ 2024-05-30T16:34:51.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 115865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-30T16:34:51.756 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/ 2024-05-30T16:34:51.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 309937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-30T16:34:51.756 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ 2024-05-30T16:34:51.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 198185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-30T16:34:51.756 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/ 2024-05-30T16:34:51.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 5192193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-30T16:34:51.756 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/ 2024-05-30T16:34:51.756 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/ 2024-05-30T16:34:51.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 97617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/locktorture.ko 2024-05-30T16:34:51.756 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/ 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/test_udelay.ko 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 72657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc7.ko 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/ 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/interval_tree_test.ko 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-30T16:34:51.757 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/ 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/ 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/memory-notifier-error-inject.ko 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/notifier-error-inject.ko 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/percpu_test.ko 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/pm-notifier-error-inject.ko 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/ 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 151945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/rbtree_test.ko 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/ 2024-05-30T16:34:51.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test-kstrtox.ko 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 4912433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_bpf.ko 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_firmware.ko 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_module.ko 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_user_copy.ko 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/ 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/xz_dec_test.ko 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/ 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-30T16:34:51.759 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/ 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/ 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-30T16:34:51.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/ 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 106697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/ 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 236769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/ 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 879593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/ 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1031177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-30T16:34:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ 2024-05-30T16:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-30T16:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-30T16:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-30T16:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-30T16:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-30T16:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-30T16:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-30T16:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-30T16:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-30T16:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-30T16:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-30T16:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/ 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1243369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-30T16:34:51.763 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/ 2024-05-30T16:34:51.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 153793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-30T16:34:51.764 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/ 2024-05-30T16:34:51.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 244825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-30T16:34:51.789 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 71025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 74985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/ 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 507649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/ 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 128577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/hsr.ko 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ 2024-05-30T16:34:51.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-30T16:34:51.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 357369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-30T16:34:51.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-30T16:34:51.791 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ 2024-05-30T16:34:51.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-30T16:34:51.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-30T16:34:51.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-30T16:34:51.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-30T16:34:51.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-30T16:34:51.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 75481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-30T16:34:51.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 77713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-30T16:34:51.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-30T16:34:51.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ip_tables.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-30T16:34:51.792 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-30T16:34:51.793 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-30T16:34:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-30T16:34:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-30T16:34:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-30T16:34:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-30T16:34:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-30T16:34:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-30T16:34:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-30T16:34:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-30T16:34:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-30T16:34:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-30T16:34:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-30T16:34:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 103169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_gre.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 118873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 71081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/mip6.ko 2024-05-30T16:34:51.795 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-30T16:34:51.796 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 94081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-30T16:34:51.797 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-30T16:34:51.798 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/ 2024-05-30T16:34:51.798 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 106361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-30T16:34:51.798 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/ 2024-05-30T16:34:51.798 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 153209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-30T16:34:51.798 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-30T16:34:51.798 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-30T16:34:51.798 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-30T16:34:51.798 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-30T16:34:51.798 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-30T16:34:51.798 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-30T16:34:51.798 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/ 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 63321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/lapb.ko 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/ 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 332817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc2.ko 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/ 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 388817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/ 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 147729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-30T16:34:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 124033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 124337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 126673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 126465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 137825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 72345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 133673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 139065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 138257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 136169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 139889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-30T16:34:51.800 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 534033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-30T16:34:51.801 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 496713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 134361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 140793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 79865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-30T16:34:51.802 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 117385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 118337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 811705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-30T16:34:51.803 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-30T16:34:51.804 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_osf.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_synproxy.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tproxy.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 108385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/x_tables.ko 2024-05-30T16:34:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-30T16:34:51.806 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-30T16:34:51.806 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-30T16:34:51.806 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-30T16:34:51.806 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-30T16:34:51.806 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-30T16:34:51.806 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-30T16:34:51.806 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-30T16:34:51.806 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-30T16:34:51.806 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-30T16:34:51.806 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-30T16:34:51.807 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-30T16:34:51.807 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-30T16:34:51.807 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-30T16:34:51.807 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-30T16:34:51.807 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-30T16:34:51.807 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-30T16:34:51.807 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-30T16:34:51.807 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-30T16:34:51.807 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-30T16:34:51.807 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-30T16:34:51.807 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-30T16:34:51.807 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-30T16:34:51.808 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-30T16:34:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-30T16:34:51.810 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpudp.ko 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/ 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/ 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/ 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 488457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-30T16:34:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/ 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/ 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 141993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/phonet.ko 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 68801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/pn_pep.ko 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/ 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 318537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 202249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/ 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1028129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/rxrpc.ko 2024-05-30T16:34:51.812 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/ 2024-05-30T16:34:51.813 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-30T16:34:51.813 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-30T16:34:51.813 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-30T16:34:51.813 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-30T16:34:51.813 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-30T16:34:51.813 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-30T16:34:51.813 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-30T16:34:51.813 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-30T16:34:51.813 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-30T16:34:51.813 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-30T16:34:51.813 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_cgroup.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 79137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-30T16:34:51.814 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq_codel.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 81825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-30T16:34:51.815 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/ 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1187153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/ 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/ 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 432225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-30T16:34:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1940753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/ 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 889729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/ 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1122273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/ 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/ 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 105601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 123745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-30T16:34:51.817 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-30T16:34:51.818 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/ 2024-05-30T16:34:51.818 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 165777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/x25.ko 2024-05-30T16:34:51.818 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/ 2024-05-30T16:34:51.818 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_algo.ko 2024-05-30T16:34:51.818 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-30T16:34:51.818 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 131857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_user.ko 2024-05-30T16:34:51.818 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 646387 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-30T16:34:51.818 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 630543 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-30T16:34:51.818 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7706 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-30T16:34:51.818 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-30T16:34:51.818 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9941 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-30T16:34:51.818 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70990 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-30T16:34:51.819 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 146985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-30T16:34:51.819 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 232892 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-30T16:34:51.819 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 210 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-30T16:34:51.819 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 72627 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-30T16:34:51.819 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 879 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-30T16:34:51.819 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 258450 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-30T16:34:51.819 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 313019 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-30T16:34:51.819 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/ 2024-05-30T16:34:51.819 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/ 2024-05-30T16:34:51.819 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/ 2024-05-30T16:34:51.819 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/ 2024-05-30T16:34:51.820 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 171 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/changelog.Debian.gz 2024-05-30T16:34:51.820 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 691 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/copyright 2024-05-30T16:34:51.829 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-30T16:34:51.830 INFO:teuthology.task.kernel:searching for kernel 6.9.0-gb9459a26b088 2024-05-30T16:34:51.831 DEBUG:teuthology.orchestra.run.smithi059:> egrep '(submenu|menuentry.*6.9.0-gb9459a26b088).*{' /boot/grub/grub.cfg 2024-05-30T16:34:51.838 INFO:teuthology.orchestra.run.smithi059.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-30T16:34:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-30T16:34:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-30T16:34:51.838 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-05-30T16:34:51.838 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-gb9459a26b088 2024-05-30T16:34:51.839 DEBUG:teuthology.orchestra.run.smithi059:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-05-30T16:34:51.883 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi059.front.sepia.ceph.com to complete... 2024-05-30T16:34:52.316 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub' 2024-05-30T16:34:52.317 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-30T16:34:52.327 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2024-05-30T16:34:52.574 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T16:34:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-30T16:34:52.852 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-30T16:34:52.858 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-30T16:34:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-30T16:34:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-30T16:34:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-30T16:34:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-30T16:34:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-30T16:34:53.036 INFO:teuthology.orchestra.run.smithi059.stderr:done 2024-05-30T16:35:18.372 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-30T16:35:18.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-30T16:35:18.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:35:24.206 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-30T16:35:24.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-05-30T16:35:24.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:35:36.862 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-05-30T16:35:42.750 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-05-30T16:35:45.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-30T16:35:45.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:35:48.926 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-05-30T16:35:51.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-05-30T16:35:51.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:36:00.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-30T16:36:00.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:36:51.774 DEBUG:teuthology.orchestra.remote:timed out 2024-05-30T16:37:00.942 DEBUG:teuthology.orchestra.remote:timed out 2024-05-30T16:37:03.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-05-30T16:37:03.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:37:03.980 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-05-30T16:37:04.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-05-30T16:37:04.780 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-gb9459a26b088"... 2024-05-30T16:37:04.781 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-05-30T16:37:04.828 INFO:teuthology.orchestra.run.smithi059.stdout:6.9.0-gb9459a26b088 2024-05-30T16:37:04.829 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-30T16:37:04.829 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-30T16:37:04.829 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-30T16:37:05.830 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-30T16:37:05.830 DEBUG:teuthology.orchestra.run.smithi059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-30T16:37:05.914 INFO:teuthology.orchestra.run.smithi059.stdout:ttyS1 2024-05-30T16:37:05.988 DEBUG:teuthology.parallel:result is None 2024-05-30T16:37:15.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-30T16:37:15.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:37:16.430 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-05-30T16:37:17.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-30T16:37:17.116 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-gb9459a26b088"... 2024-05-30T16:37:17.116 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-05-30T16:37:17.163 INFO:teuthology.orchestra.run.smithi107.stdout:6.9.0-gb9459a26b088 2024-05-30T16:37:17.166 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-30T16:37:17.166 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-30T16:37:17.167 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-30T16:37:18.167 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-30T16:37:18.167 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-30T16:37:18.231 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-05-30T16:37:18.305 DEBUG:teuthology.parallel:result is None 2024-05-30T16:37:18.305 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-30T16:37:18.313 INFO:teuthology.task.internal:Creating test directory... 2024-05-30T16:37:18.314 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-30T16:37:18.317 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-30T16:37:18.326 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-30T16:37:18.332 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-30T16:37:18.343 INFO:teuthology.task.internal:Creating archive directory... 2024-05-30T16:37:18.343 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-30T16:37:18.367 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-30T16:37:18.392 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-30T16:37:18.399 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-30T16:37:18.399 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-30T16:37:18.423 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-30T16:37:18.449 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-30T16:37:18.455 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-30T16:37:18.463 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-30T16:37:18.469 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-30T16:37:18.472 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-30T16:37:18.478 INFO:teuthology.task.internal:Configuring sudo... 2024-05-30T16:37:18.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-30T16:37:18.511 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-30T16:37:18.536 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-30T16:37:18.545 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-30T16:37:18.546 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-30T16:37:18.575 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-30T16:37:18.588 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-30T16:37:18.633 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-30T16:37:18.685 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:37:18.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-30T16:37:18.762 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-30T16:37:18.770 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-30T16:37:18.821 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:37:18.821 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-30T16:37:18.893 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-05-30T16:37:18.896 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-05-30T16:37:19.018 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-30T16:37:19.026 INFO:teuthology.task.internal:Starting timer... 2024-05-30T16:37:19.026 INFO:teuthology.run_tasks:Running task pcp... 2024-05-30T16:37:19.036 INFO:teuthology.run_tasks:Running task selinux... 2024-05-30T16:37:19.048 DEBUG:teuthology.task.selinux:Excluding smithi059: OS 'ubuntu' does not support SELinux 2024-05-30T16:37:19.048 DEBUG:teuthology.task.selinux:Excluding smithi107: OS 'ubuntu' does not support SELinux 2024-05-30T16:37:19.049 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-30T16:37:19.049 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-30T16:37:19.049 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-30T16:37:19.049 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-30T16:37:19.058 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-30T16:37:19.061 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-30T16:37:19.190 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-30T16:37:19.203 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-30T16:37:19.204 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-30T16:45:09.192 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com')] 2024-05-30T16:45:09.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-05-30T16:45:09.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:45:09.281 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-05-30T16:45:09.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-05-30T16:45:09.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-30T16:45:09.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:45:09.489 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-05-30T16:45:09.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-30T16:45:09.622 INFO:teuthology.run_tasks:Running task clock... 2024-05-30T16:45:09.634 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-30T16:45:09.634 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-30T16:45:09.635 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-30T16:45:09.638 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-30T16:45:09.638 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-30T16:45:09.677 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-30T16:45:09.678 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: Command line: ntpd -gq 2024-05-30T16:45:09.678 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: ---------------------------------------------------- 2024-05-30T16:45:09.678 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: ntp-4 is maintained by Network Time Foundation, 2024-05-30T16:45:09.678 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-30T16:45:09.678 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: corporation. Support and training for ntp-4 are 2024-05-30T16:45:09.678 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: available at https://www.nwtime.org/support 2024-05-30T16:45:09.678 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: ---------------------------------------------------- 2024-05-30T16:45:09.679 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: proto: precision = 0.044 usec (-24) 2024-05-30T16:45:09.679 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: basedate set to 2022-02-04 2024-05-30T16:45:09.679 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: gps base set to 2022-02-06 (week 2196) 2024-05-30T16:45:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-30T16:45:09.679 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-30T16:45:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-30T16:45:09.680 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: restrict ::: KOD does nothing without LIMITED. 2024-05-30T16:45:09.681 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: Listen and drop on 0 v6wildcard [::]:123 2024-05-30T16:45:09.681 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-30T16:45:09.682 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: Listen normally on 2 lo 127.0.0.1:123 2024-05-30T16:45:09.682 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: Listen normally on 3 ens1f0 172.21.15.59:123 2024-05-30T16:45:09.682 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: Listen normally on 4 lo [::1]:123 2024-05-30T16:45:09.682 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:192a%4]:123 2024-05-30T16:45:09.682 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:09 ntpd[17468]: Listening on routing socket on fd #22 for interface updates 2024-05-30T16:45:09.702 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-30T16:45:09.702 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: Command line: ntpd -gq 2024-05-30T16:45:09.702 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: ---------------------------------------------------- 2024-05-30T16:45:09.702 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: ntp-4 is maintained by Network Time Foundation, 2024-05-30T16:45:09.702 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-30T16:45:09.703 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: corporation. Support and training for ntp-4 are 2024-05-30T16:45:09.703 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: available at https://www.nwtime.org/support 2024-05-30T16:45:09.703 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: ---------------------------------------------------- 2024-05-30T16:45:09.703 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: proto: precision = 0.051 usec (-24) 2024-05-30T16:45:09.703 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: basedate set to 2022-02-04 2024-05-30T16:45:09.703 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: gps base set to 2022-02-06 (week 2196) 2024-05-30T16:45:09.704 INFO:teuthology.orchestra.run.smithi107.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-30T16:45:09.704 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-30T16:45:09.704 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: restrict ::: KOD does nothing without LIMITED. 2024-05-30T16:45:09.704 INFO:teuthology.orchestra.run.smithi107.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-30T16:45:09.705 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: Listen and drop on 0 v6wildcard [::]:123 2024-05-30T16:45:09.705 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-30T16:45:09.705 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: Listen normally on 2 lo 127.0.0.1:123 2024-05-30T16:45:09.705 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: Listen normally on 3 enp3s0f1 172.21.15.107:123 2024-05-30T16:45:09.705 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: Listen normally on 4 lo [::1]:123 2024-05-30T16:45:09.706 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:47eb%5]:123 2024-05-30T16:45:09.706 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:09 ntpd[17584]: Listening on routing socket on fd #22 for interface updates 2024-05-30T16:45:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:10 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:10 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:10 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:10 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:10 ntpd[17468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:10 ntpd[17468]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:10.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:10 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:10.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:10 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:10.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:10 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:10.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:10 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:10.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:10 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:10.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:10 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:10.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:10 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:10.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:10 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:11.678 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:11 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:11.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:11 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:11.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:11 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:11.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:11 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:11.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:11 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:11.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:11 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:11.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:11 ntpd[17468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:11.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:11 ntpd[17468]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:11.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:11 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:11.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:11 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:11.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:11 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:11.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:11 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:11.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:11 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:11.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:11 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:11.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:11 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:11.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:11 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:11.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:11 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:11.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:11 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:11.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:11 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:11.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:11 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:12.678 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:12 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:12.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:12 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:12.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:12 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:12.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:12 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:12.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:12 ntpd[17468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:12.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:12 ntpd[17468]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:12.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:12 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:12.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:12 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:12.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:12 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:12.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:12 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:12.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:12 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:12.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:12 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:13 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:13 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:13 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:13 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:13 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:13 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:13 ntpd[17468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:13 ntpd[17468]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:13 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:13 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:13 ntpd[17468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:13 ntpd[17468]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:13.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:13 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:13.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:13 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:13.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:13 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:13.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:13 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:13.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:13 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:13.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:13 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:13.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:13 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:13.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:13 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:13.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:13 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:13.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:13 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:13.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:13 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:13.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:13 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:14 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:14 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:14.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:14 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:14.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:14 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:14.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:14 ntpd[17468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:14.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:14 ntpd[17468]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:14.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:14 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:14.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:14 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:14.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:14 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:14.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:14 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:14.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:14 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:14.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:14 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:15 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:15 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:15.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:15 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:15.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:15 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:15.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:15 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:15.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:15 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:15.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:15 ntpd[17468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:15.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:15 ntpd[17468]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:15.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:15 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:15.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:15 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:15.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:15 ntpd[17468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:15.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:15 ntpd[17468]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:15.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:15 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:15.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:15 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:15.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:15 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:15.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:15 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:15.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:15 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:15.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:15 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:15.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:15 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:15.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:15 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:15.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:15 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:15.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:15 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:15.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:15 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:15.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:15 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:16.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:16 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:16.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:16 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:16.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:16 ntpd[17468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:16.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:16 ntpd[17468]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:16.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:16 ntpd[17468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:16.679 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:16 ntpd[17468]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:16.679 INFO:teuthology.orchestra.run.smithi059.stdout:30 May 16:45:16 ntpd[17468]: ntpd: time slew -0.001641 s 2024-05-30T16:45:16.679 INFO:teuthology.orchestra.run.smithi059.stdout:ntpd: time slew -0.001641s 2024-05-30T16:45:16.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:16 ntpd[17468]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-30T16:45:16.680 INFO:teuthology.orchestra.run.smithi059.stderr:30 May 16:45:16 ntpd[17468]: can't open /var/log/ntpstats/loopstats.20240530: Permission denied 2024-05-30T16:45:16.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:16 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:16.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:16 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:16.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:16 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T16:45:16.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:16 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T16:45:16.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:16 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T16:45:16.703 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:16 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T16:45:16.704 INFO:teuthology.orchestra.run.smithi107.stdout:30 May 16:45:16 ntpd[17584]: ntpd: time slew +0.000855 s 2024-05-30T16:45:16.704 INFO:teuthology.orchestra.run.smithi107.stdout:ntpd: time slew +0.000855s 2024-05-30T16:45:16.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:16 ntpd[17584]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-30T16:45:16.704 INFO:teuthology.orchestra.run.smithi107.stderr:30 May 16:45:16 ntpd[17584]: can't open /var/log/ntpstats/loopstats.20240530: Permission denied 2024-05-30T16:45:16.768 INFO:teuthology.orchestra.run.smithi059.stdout: remote refid st t when poll reach delay offset jitter 2024-05-30T16:45:16.768 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================== 2024-05-30T16:45:16.768 INFO:teuthology.orchestra.run.smithi059.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T16:45:16.768 INFO:teuthology.orchestra.run.smithi059.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T16:45:16.768 INFO:teuthology.orchestra.run.smithi059.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T16:45:16.768 INFO:teuthology.orchestra.run.smithi059.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T16:45:16.810 INFO:teuthology.orchestra.run.smithi107.stdout: remote refid st t when poll reach delay offset jitter 2024-05-30T16:45:16.810 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================== 2024-05-30T16:45:16.811 INFO:teuthology.orchestra.run.smithi107.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T16:45:16.811 INFO:teuthology.orchestra.run.smithi107.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T16:45:16.811 INFO:teuthology.orchestra.run.smithi107.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T16:45:16.811 INFO:teuthology.orchestra.run.smithi107.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T16:45:16.812 INFO:teuthology.run_tasks:Running task install... 2024-05-30T16:45:16.820 DEBUG:teuthology.task.install:project ceph 2024-05-30T16:45:16.820 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}} 2024-05-30T16:45:16.821 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'} 2024-05-30T16:45:16.821 INFO:teuthology.task.install:Using flavor: default 2024-05-30T16:45:16.826 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-30T16:45:16.826 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-30T16:45:16.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-key list | grep Ceph 2024-05-30T16:45:16.827 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-key list | grep Ceph 2024-05-30T16:45:16.932 INFO:teuthology.orchestra.run.smithi059.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-30T16:45:16.958 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-30T16:45:16.986 INFO:teuthology.orchestra.run.smithi059.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-30T16:45:16.986 INFO:teuthology.orchestra.run.smithi059.stdout:uid [ unknown] Ceph.com (release key) 2024-05-30T16:45:16.987 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-30T16:45:16.987 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-30T16:45:16.988 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T16:45:17.009 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-30T16:45:17.009 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph.com (release key) 2024-05-30T16:45:17.010 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-30T16:45:17.010 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-30T16:45:17.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T16:45:17.147 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default/ 2024-05-30T16:45:17.147 INFO:teuthology.task.install.deb:Package version is 19.0.0-3154-g9ed025fb-1jammy 2024-05-30T16:45:17.200 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default/ 2024-05-30T16:45:17.200 INFO:teuthology.task.install.deb:Package version is 19.0.0-3154-g9ed025fb-1jammy 2024-05-30T16:45:17.312 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:45:17.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-30T16:45:17.322 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:45:17.322 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-30T16:45:17.332 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get update 2024-05-30T16:45:17.342 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-05-30T16:45:17.525 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-30T16:45:17.535 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-30T16:45:17.556 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-30T16:45:17.603 INFO:teuthology.orchestra.run.smithi059.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy InRelease 2024-05-30T16:45:17.604 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy InRelease 2024-05-30T16:45:17.626 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-30T16:45:17.627 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-30T16:45:17.648 INFO:teuthology.orchestra.run.smithi059.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-30T16:45:17.648 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:7 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-30T16:45:17.649 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-30T16:45:17.668 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-30T16:45:17.669 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-30T16:45:17.672 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-30T16:45:17.674 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-05-30T16:45:17.706 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-30T16:45:17.724 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-05-30T16:45:17.744 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-30T16:45:17.830 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-30T16:45:18.140 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 29.2 kB in 1s (50.5 kB/s) 2024-05-30T16:45:18.259 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 29.2 kB in 1s (42.3 kB/s) 2024-05-30T16:45:19.179 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-05-30T16:45:19.194 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3154-g9ed025fb-1jammy cephadm=19.0.0-3154-g9ed025fb-1jammy ceph-mds=19.0.0-3154-g9ed025fb-1jammy ceph-mgr=19.0.0-3154-g9ed025fb-1jammy ceph-common=19.0.0-3154-g9ed025fb-1jammy ceph-fuse=19.0.0-3154-g9ed025fb-1jammy ceph-test=19.0.0-3154-g9ed025fb-1jammy ceph-volume=19.0.0-3154-g9ed025fb-1jammy radosgw=19.0.0-3154-g9ed025fb-1jammy python3-rados=19.0.0-3154-g9ed025fb-1jammy python3-rgw=19.0.0-3154-g9ed025fb-1jammy python3-cephfs=19.0.0-3154-g9ed025fb-1jammy python3-rbd=19.0.0-3154-g9ed025fb-1jammy libcephfs2=19.0.0-3154-g9ed025fb-1jammy libcephfs-dev=19.0.0-3154-g9ed025fb-1jammy librados2=19.0.0-3154-g9ed025fb-1jammy librbd1=19.0.0-3154-g9ed025fb-1jammy rbd-fuse=19.0.0-3154-g9ed025fb-1jammy python3-cephfs=19.0.0-3154-g9ed025fb-1jammy cephfs-shell=19.0.0-3154-g9ed025fb-1jammy cephfs-top=19.0.0-3154-g9ed025fb-1jammy cephfs-mirror=19.0.0-3154-g9ed025fb-1jammy 2024-05-30T16:45:19.249 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-30T16:45:19.263 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3154-g9ed025fb-1jammy cephadm=19.0.0-3154-g9ed025fb-1jammy ceph-mds=19.0.0-3154-g9ed025fb-1jammy ceph-mgr=19.0.0-3154-g9ed025fb-1jammy ceph-common=19.0.0-3154-g9ed025fb-1jammy ceph-fuse=19.0.0-3154-g9ed025fb-1jammy ceph-test=19.0.0-3154-g9ed025fb-1jammy ceph-volume=19.0.0-3154-g9ed025fb-1jammy radosgw=19.0.0-3154-g9ed025fb-1jammy python3-rados=19.0.0-3154-g9ed025fb-1jammy python3-rgw=19.0.0-3154-g9ed025fb-1jammy python3-cephfs=19.0.0-3154-g9ed025fb-1jammy python3-rbd=19.0.0-3154-g9ed025fb-1jammy libcephfs2=19.0.0-3154-g9ed025fb-1jammy libcephfs-dev=19.0.0-3154-g9ed025fb-1jammy librados2=19.0.0-3154-g9ed025fb-1jammy librbd1=19.0.0-3154-g9ed025fb-1jammy rbd-fuse=19.0.0-3154-g9ed025fb-1jammy python3-cephfs=19.0.0-3154-g9ed025fb-1jammy cephfs-shell=19.0.0-3154-g9ed025fb-1jammy cephfs-top=19.0.0-3154-g9ed025fb-1jammy cephfs-mirror=19.0.0-3154-g9ed025fb-1jammy 2024-05-30T16:45:19.273 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-05-30T16:45:19.339 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-30T16:45:19.453 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2024-05-30T16:45:19.453 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2024-05-30T16:45:19.514 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-05-30T16:45:19.515 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-05-30T16:45:19.637 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2024-05-30T16:45:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-30T16:45:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-30T16:45:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-30T16:45:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-30T16:45:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-30T16:45:19.638 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-30T16:45:19.639 INFO:teuthology.orchestra.run.smithi059.stdout:The following additional packages will be installed: 2024-05-30T16:45:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-30T16:45:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-30T16:45:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-30T16:45:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-30T16:45:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-30T16:45:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-30T16:45:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-30T16:45:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-30T16:45:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-30T16:45:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-30T16:45:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-30T16:45:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-30T16:45:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-30T16:45:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-30T16:45:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-30T16:45:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-30T16:45:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-30T16:45:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-30T16:45:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-30T16:45:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-30T16:45:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-30T16:45:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-30T16:45:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-30T16:45:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-30T16:45:19.643 INFO:teuthology.orchestra.run.smithi059.stdout:Suggested packages: 2024-05-30T16:45:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-30T16:45:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-30T16:45:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-30T16:45:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-30T16:45:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-30T16:45:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-30T16:45:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-30T16:45:19.643 INFO:teuthology.orchestra.run.smithi059.stdout:Recommended packages: 2024-05-30T16:45:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: btrfs-tools 2024-05-30T16:45:19.692 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-05-30T16:45:19.692 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-30T16:45:19.692 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-30T16:45:19.692 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-30T16:45:19.693 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-30T16:45:19.693 INFO:teuthology.orchestra.run.smithi107.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-30T16:45:19.693 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-30T16:45:19.693 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2024-05-30T16:45:19.694 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-30T16:45:19.694 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-30T16:45:19.694 INFO:teuthology.orchestra.run.smithi107.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-30T16:45:19.694 INFO:teuthology.orchestra.run.smithi107.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-30T16:45:19.695 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-30T16:45:19.695 INFO:teuthology.orchestra.run.smithi107.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-30T16:45:19.695 INFO:teuthology.orchestra.run.smithi107.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-30T16:45:19.695 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-30T16:45:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-30T16:45:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-30T16:45:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-30T16:45:19.697 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2024-05-30T16:45:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-30T16:45:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-30T16:45:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-30T16:45:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-30T16:45:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-30T16:45:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-30T16:45:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-30T16:45:19.698 INFO:teuthology.orchestra.run.smithi107.stdout:Recommended packages: 2024-05-30T16:45:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: btrfs-tools 2024-05-30T16:45:19.804 INFO:teuthology.orchestra.run.smithi059.stdout:The following NEW packages will be installed: 2024-05-30T16:45:19.804 INFO:teuthology.orchestra.run.smithi059.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-30T16:45:19.804 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-30T16:45:19.804 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-30T16:45:19.804 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-30T16:45:19.806 INFO:teuthology.orchestra.run.smithi059.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-30T16:45:19.806 INFO:teuthology.orchestra.run.smithi059.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-30T16:45:19.806 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-30T16:45:19.806 INFO:teuthology.orchestra.run.smithi059.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-30T16:45:19.806 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-30T16:45:19.806 INFO:teuthology.orchestra.run.smithi059.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-30T16:45:19.806 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-30T16:45:19.806 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-30T16:45:19.806 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-30T16:45:19.807 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-30T16:45:19.808 INFO:teuthology.orchestra.run.smithi059.stdout: socat unzip xmlstarlet zip 2024-05-30T16:45:19.850 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2024-05-30T16:45:19.850 INFO:teuthology.orchestra.run.smithi107.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-30T16:45:19.850 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-30T16:45:19.850 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-30T16:45:19.850 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-30T16:45:19.852 INFO:teuthology.orchestra.run.smithi107.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-30T16:45:19.852 INFO:teuthology.orchestra.run.smithi107.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-30T16:45:19.852 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-30T16:45:19.852 INFO:teuthology.orchestra.run.smithi107.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-30T16:45:19.852 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-30T16:45:19.852 INFO:teuthology.orchestra.run.smithi107.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-30T16:45:19.853 INFO:teuthology.orchestra.run.smithi107.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-30T16:45:19.854 INFO:teuthology.orchestra.run.smithi107.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-30T16:45:19.854 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-30T16:45:19.854 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-30T16:45:19.854 INFO:teuthology.orchestra.run.smithi107.stdout: socat unzip xmlstarlet zip 2024-05-30T16:45:19.926 INFO:teuthology.orchestra.run.smithi107.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-30T16:45:19.927 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 182 MB of archives. 2024-05-30T16:45:19.927 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 831 MB of additional disk space will be used. 2024-05-30T16:45:19.927 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-30T16:45:19.948 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-30T16:45:19.961 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-30T16:45:20.016 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-30T16:45:20.016 INFO:teuthology.orchestra.run.smithi059.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-30T16:45:20.017 INFO:teuthology.orchestra.run.smithi059.stdout:Need to get 182 MB of archives. 2024-05-30T16:45:20.017 INFO:teuthology.orchestra.run.smithi059.stdout:After this operation, 831 MB of additional disk space will be used. 2024-05-30T16:45:20.017 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-30T16:45:20.043 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-30T16:45:20.050 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-30T16:45:20.067 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-30T16:45:20.102 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-30T16:45:20.110 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3154-g9ed025fb-1jammy [3,555 kB] 2024-05-30T16:45:20.120 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-30T16:45:20.122 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-30T16:45:20.142 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-30T16:45:20.145 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-30T16:45:20.145 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-30T16:45:20.150 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-30T16:45:20.151 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-30T16:45:20.153 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-30T16:45:20.155 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-30T16:45:20.156 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-30T16:45:20.157 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-30T16:45:20.164 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3154-g9ed025fb-1jammy [3,555 kB] 2024-05-30T16:45:20.187 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-30T16:45:20.188 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-30T16:45:20.190 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-30T16:45:20.191 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-30T16:45:20.191 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-30T16:45:20.217 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-30T16:45:20.218 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-30T16:45:20.218 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-30T16:45:20.219 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-30T16:45:20.220 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-30T16:45:20.237 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-30T16:45:20.238 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-30T16:45:20.240 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-30T16:45:20.240 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-30T16:45:20.241 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-30T16:45:20.258 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-30T16:45:20.259 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-30T16:45:20.259 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-30T16:45:20.260 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-30T16:45:20.261 INFO:teuthology.orchestra.run.smithi107.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-30T16:45:20.278 INFO:teuthology.orchestra.run.smithi107.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-30T16:45:20.279 INFO:teuthology.orchestra.run.smithi107.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-30T16:45:20.283 INFO:teuthology.orchestra.run.smithi107.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-30T16:45:20.284 INFO:teuthology.orchestra.run.smithi107.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-30T16:45:20.284 INFO:teuthology.orchestra.run.smithi107.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-30T16:45:20.299 INFO:teuthology.orchestra.run.smithi107.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-30T16:45:20.300 INFO:teuthology.orchestra.run.smithi107.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-30T16:45:20.302 INFO:teuthology.orchestra.run.smithi107.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-05-30T16:45:20.303 INFO:teuthology.orchestra.run.smithi107.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-30T16:45:20.304 INFO:teuthology.orchestra.run.smithi107.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-30T16:45:20.329 INFO:teuthology.orchestra.run.smithi107.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-05-30T16:45:20.331 INFO:teuthology.orchestra.run.smithi107.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-30T16:45:20.332 INFO:teuthology.orchestra.run.smithi107.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-30T16:45:20.332 INFO:teuthology.orchestra.run.smithi107.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-30T16:45:20.334 INFO:teuthology.orchestra.run.smithi107.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-30T16:45:20.363 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-30T16:45:20.402 INFO:teuthology.orchestra.run.smithi107.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-30T16:45:20.403 INFO:teuthology.orchestra.run.smithi107.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-05-30T16:45:20.404 INFO:teuthology.orchestra.run.smithi107.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-30T16:45:20.404 INFO:teuthology.orchestra.run.smithi107.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-30T16:45:20.405 INFO:teuthology.orchestra.run.smithi107.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-30T16:45:20.425 INFO:teuthology.orchestra.run.smithi107.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-30T16:45:20.428 INFO:teuthology.orchestra.run.smithi107.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-30T16:45:20.428 INFO:teuthology.orchestra.run.smithi107.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-30T16:45:20.467 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-30T16:45:20.468 INFO:teuthology.orchestra.run.smithi107.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-30T16:45:20.468 INFO:teuthology.orchestra.run.smithi107.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-30T16:45:20.469 INFO:teuthology.orchestra.run.smithi107.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-30T16:45:20.470 INFO:teuthology.orchestra.run.smithi107.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-30T16:45:20.470 INFO:teuthology.orchestra.run.smithi107.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-30T16:45:20.471 INFO:teuthology.orchestra.run.smithi107.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-30T16:45:20.477 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3154-g9ed025fb-1jammy [3,224 kB] 2024-05-30T16:45:20.481 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-30T16:45:20.491 INFO:teuthology.orchestra.run.smithi107.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-30T16:45:20.492 INFO:teuthology.orchestra.run.smithi107.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-30T16:45:20.495 INFO:teuthology.orchestra.run.smithi107.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-30T16:45:20.512 INFO:teuthology.orchestra.run.smithi107.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-30T16:45:20.513 INFO:teuthology.orchestra.run.smithi107.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-30T16:45:20.514 INFO:teuthology.orchestra.run.smithi107.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-30T16:45:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-30T16:45:20.520 INFO:teuthology.orchestra.run.smithi107.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-30T16:45:20.521 INFO:teuthology.orchestra.run.smithi107.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-30T16:45:20.522 INFO:teuthology.orchestra.run.smithi107.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-30T16:45:20.536 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-30T16:45:20.545 INFO:teuthology.orchestra.run.smithi107.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-30T16:45:20.550 INFO:teuthology.orchestra.run.smithi107.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-30T16:45:20.551 INFO:teuthology.orchestra.run.smithi107.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-30T16:45:20.577 INFO:teuthology.orchestra.run.smithi059.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3154-g9ed025fb-1jammy [712 kB] 2024-05-30T16:45:20.578 INFO:teuthology.orchestra.run.smithi107.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-30T16:45:20.579 INFO:teuthology.orchestra.run.smithi107.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-30T16:45:20.579 INFO:teuthology.orchestra.run.smithi107.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-30T16:45:20.580 INFO:teuthology.orchestra.run.smithi107.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-30T16:45:20.582 INFO:teuthology.orchestra.run.smithi107.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-30T16:45:20.583 INFO:teuthology.orchestra.run.smithi107.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-30T16:45:20.590 INFO:teuthology.orchestra.run.smithi107.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-30T16:45:20.599 INFO:teuthology.orchestra.run.smithi107.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-30T16:45:20.600 INFO:teuthology.orchestra.run.smithi107.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-30T16:45:20.602 INFO:teuthology.orchestra.run.smithi107.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-30T16:45:20.606 INFO:teuthology.orchestra.run.smithi059.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3154-g9ed025fb-1jammy [356 kB] 2024-05-30T16:45:20.611 INFO:teuthology.orchestra.run.smithi059.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3154-g9ed025fb-1jammy [32.8 kB] 2024-05-30T16:45:20.621 INFO:teuthology.orchestra.run.smithi107.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-30T16:45:20.641 INFO:teuthology.orchestra.run.smithi059.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3154-g9ed025fb-1jammy [180 kB] 2024-05-30T16:45:20.659 INFO:teuthology.orchestra.run.smithi059.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3154-g9ed025fb-1jammy [66.9 kB] 2024-05-30T16:45:20.677 INFO:teuthology.orchestra.run.smithi059.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3154-g9ed025fb-1jammy [330 kB] 2024-05-30T16:45:20.713 INFO:teuthology.orchestra.run.smithi059.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3154-g9ed025fb-1jammy [6,895 kB] 2024-05-30T16:45:20.722 INFO:teuthology.orchestra.run.smithi059.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-30T16:45:20.731 INFO:teuthology.orchestra.run.smithi059.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-30T16:45:20.761 INFO:teuthology.orchestra.run.smithi059.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-30T16:45:20.769 INFO:teuthology.orchestra.run.smithi059.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-30T16:45:20.885 INFO:teuthology.orchestra.run.smithi059.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3154-g9ed025fb-1jammy [112 kB] 2024-05-30T16:45:20.886 INFO:teuthology.orchestra.run.smithi059.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3154-g9ed025fb-1jammy [466 kB] 2024-05-30T16:45:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3154-g9ed025fb-1jammy [25.8 MB] 2024-05-30T16:45:20.944 INFO:teuthology.orchestra.run.smithi059.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-30T16:45:21.567 INFO:teuthology.orchestra.run.smithi059.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-30T16:45:21.583 INFO:teuthology.orchestra.run.smithi059.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-30T16:45:21.601 INFO:teuthology.orchestra.run.smithi059.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-30T16:45:21.610 INFO:teuthology.orchestra.run.smithi059.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-30T16:45:21.611 INFO:teuthology.orchestra.run.smithi059.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-30T16:45:21.630 INFO:teuthology.orchestra.run.smithi059.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-30T16:45:21.668 INFO:teuthology.orchestra.run.smithi059.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-30T16:45:21.681 INFO:teuthology.orchestra.run.smithi059.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-30T16:45:21.687 INFO:teuthology.orchestra.run.smithi059.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-30T16:45:21.688 INFO:teuthology.orchestra.run.smithi059.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-30T16:45:21.851 INFO:teuthology.orchestra.run.smithi059.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3154-g9ed025fb-1jammy [5,092 kB] 2024-05-30T16:45:21.869 INFO:teuthology.orchestra.run.smithi059.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-30T16:45:21.943 INFO:teuthology.orchestra.run.smithi059.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3154-g9ed025fb-1jammy [247 kB] 2024-05-30T16:45:21.947 INFO:teuthology.orchestra.run.smithi059.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3154-g9ed025fb-1jammy [124 kB] 2024-05-30T16:45:21.957 INFO:teuthology.orchestra.run.smithi059.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-30T16:45:21.962 INFO:teuthology.orchestra.run.smithi059.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3154-g9ed025fb-1jammy [1,527 kB] 2024-05-30T16:45:21.978 INFO:teuthology.orchestra.run.smithi059.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-30T16:45:22.045 INFO:teuthology.orchestra.run.smithi059.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-30T16:45:22.093 INFO:teuthology.orchestra.run.smithi059.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-30T16:45:22.113 INFO:teuthology.orchestra.run.smithi059.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-30T16:45:22.137 INFO:teuthology.orchestra.run.smithi059.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-30T16:45:22.194 INFO:teuthology.orchestra.run.smithi059.stdout:Get:46 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3154-g9ed025fb-1jammy [6,257 kB] 2024-05-30T16:45:22.323 INFO:teuthology.orchestra.run.smithi059.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-30T16:45:22.340 INFO:teuthology.orchestra.run.smithi059.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-30T16:45:22.346 INFO:teuthology.orchestra.run.smithi059.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-30T16:45:22.352 INFO:teuthology.orchestra.run.smithi059.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-30T16:45:22.415 INFO:teuthology.orchestra.run.smithi059.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3154-g9ed025fb-1jammy [22.8 MB] 2024-05-30T16:45:22.496 INFO:teuthology.orchestra.run.smithi107.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3154-g9ed025fb-1jammy [3,224 kB] 2024-05-30T16:45:22.553 INFO:teuthology.orchestra.run.smithi059.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-30T16:45:22.642 INFO:teuthology.orchestra.run.smithi059.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-30T16:45:22.658 INFO:teuthology.orchestra.run.smithi059.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-30T16:45:22.826 INFO:teuthology.orchestra.run.smithi107.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3154-g9ed025fb-1jammy [712 kB] 2024-05-30T16:45:22.854 INFO:teuthology.orchestra.run.smithi059.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-30T16:45:22.871 INFO:teuthology.orchestra.run.smithi107.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3154-g9ed025fb-1jammy [356 kB] 2024-05-30T16:45:22.907 INFO:teuthology.orchestra.run.smithi059.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-30T16:45:22.920 INFO:teuthology.orchestra.run.smithi059.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-30T16:45:23.071 INFO:teuthology.orchestra.run.smithi107.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3154-g9ed025fb-1jammy [32.8 kB] 2024-05-30T16:45:23.072 INFO:teuthology.orchestra.run.smithi107.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3154-g9ed025fb-1jammy [180 kB] 2024-05-30T16:45:23.078 INFO:teuthology.orchestra.run.smithi107.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3154-g9ed025fb-1jammy [66.9 kB] 2024-05-30T16:45:23.079 INFO:teuthology.orchestra.run.smithi107.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3154-g9ed025fb-1jammy [330 kB] 2024-05-30T16:45:23.088 INFO:teuthology.orchestra.run.smithi059.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-30T16:45:23.089 INFO:teuthology.orchestra.run.smithi059.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-30T16:45:23.094 INFO:teuthology.orchestra.run.smithi059.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-30T16:45:23.099 INFO:teuthology.orchestra.run.smithi059.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-30T16:45:23.114 INFO:teuthology.orchestra.run.smithi059.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-30T16:45:23.114 INFO:teuthology.orchestra.run.smithi107.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3154-g9ed025fb-1jammy [6,895 kB] 2024-05-30T16:45:23.229 INFO:teuthology.orchestra.run.smithi059.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3154-g9ed025fb-1jammy [14.1 kB] 2024-05-30T16:45:23.234 INFO:teuthology.orchestra.run.smithi059.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3154-g9ed025fb-1jammy [870 kB] 2024-05-30T16:45:23.260 INFO:teuthology.orchestra.run.smithi059.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3154-g9ed025fb-1jammy [2,436 kB] 2024-05-30T16:45:23.308 INFO:teuthology.orchestra.run.smithi059.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-05-30T16:45:23.332 INFO:teuthology.orchestra.run.smithi059.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3154-g9ed025fb-1jammy [791 kB] 2024-05-30T16:45:23.376 INFO:teuthology.orchestra.run.smithi059.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3154-g9ed025fb-1jammy [148 kB] 2024-05-30T16:45:23.410 INFO:teuthology.orchestra.run.smithi059.stdout:Get:69 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3154-g9ed025fb-1jammy [2,297 kB] 2024-05-30T16:45:23.443 INFO:teuthology.orchestra.run.smithi059.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3154-g9ed025fb-1jammy [8,625 kB] 2024-05-30T16:45:23.582 INFO:teuthology.orchestra.run.smithi059.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-30T16:45:23.654 INFO:teuthology.orchestra.run.smithi059.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3154-g9ed025fb-1jammy [14.2 kB] 2024-05-30T16:45:23.654 INFO:teuthology.orchestra.run.smithi059.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3154-g9ed025fb-1jammy [51.6 MB] 2024-05-30T16:45:23.722 INFO:teuthology.orchestra.run.smithi059.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-30T16:45:23.768 INFO:teuthology.orchestra.run.smithi059.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-05-30T16:45:23.864 INFO:teuthology.orchestra.run.smithi059.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-30T16:45:23.874 INFO:teuthology.orchestra.run.smithi059.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-30T16:45:23.888 INFO:teuthology.orchestra.run.smithi059.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-30T16:45:23.933 INFO:teuthology.orchestra.run.smithi059.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-30T16:45:24.211 INFO:teuthology.orchestra.run.smithi059.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-30T16:45:24.212 INFO:teuthology.orchestra.run.smithi059.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-05-30T16:45:24.214 INFO:teuthology.orchestra.run.smithi059.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-30T16:45:24.388 INFO:teuthology.orchestra.run.smithi059.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-30T16:45:24.757 INFO:teuthology.orchestra.run.smithi059.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-30T16:45:25.183 INFO:teuthology.orchestra.run.smithi059.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-30T16:45:25.192 INFO:teuthology.orchestra.run.smithi059.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-30T16:45:25.193 INFO:teuthology.orchestra.run.smithi059.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-30T16:45:25.269 INFO:teuthology.orchestra.run.smithi059.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-30T16:45:25.269 INFO:teuthology.orchestra.run.smithi059.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-30T16:45:25.271 INFO:teuthology.orchestra.run.smithi059.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-30T16:45:25.271 INFO:teuthology.orchestra.run.smithi059.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-30T16:45:25.272 INFO:teuthology.orchestra.run.smithi059.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-30T16:45:25.273 INFO:teuthology.orchestra.run.smithi059.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-30T16:45:25.395 INFO:teuthology.orchestra.run.smithi059.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3154-g9ed025fb-1jammy [124 kB] 2024-05-30T16:45:25.404 INFO:teuthology.orchestra.run.smithi059.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3154-g9ed025fb-1jammy [232 kB] 2024-05-30T16:45:25.411 INFO:teuthology.orchestra.run.smithi059.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3154-g9ed025fb-1jammy [33.9 kB] 2024-05-30T16:45:25.411 INFO:teuthology.orchestra.run.smithi059.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3154-g9ed025fb-1jammy [23.4 kB] 2024-05-30T16:45:25.412 INFO:teuthology.orchestra.run.smithi059.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3154-g9ed025fb-1jammy [38.9 kB] 2024-05-30T16:45:25.412 INFO:teuthology.orchestra.run.smithi059.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3154-g9ed025fb-1jammy [13.6 MB] 2024-05-30T16:45:25.447 INFO:teuthology.orchestra.run.smithi059.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-30T16:45:25.673 INFO:teuthology.orchestra.run.smithi059.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-30T16:45:25.838 INFO:teuthology.orchestra.run.smithi059.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3154-g9ed025fb-1jammy [91.2 kB] 2024-05-30T16:45:25.877 INFO:teuthology.orchestra.run.smithi107.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3154-g9ed025fb-1jammy [112 kB] 2024-05-30T16:45:25.909 INFO:teuthology.orchestra.run.smithi107.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3154-g9ed025fb-1jammy [466 kB] 2024-05-30T16:45:25.913 INFO:teuthology.orchestra.run.smithi107.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3154-g9ed025fb-1jammy [25.8 MB] 2024-05-30T16:45:26.024 INFO:teuthology.orchestra.run.smithi059.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-30T16:45:26.078 INFO:teuthology.orchestra.run.smithi059.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-30T16:45:26.107 INFO:teuthology.orchestra.run.smithi059.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-30T16:45:26.117 INFO:teuthology.orchestra.run.smithi059.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-30T16:45:26.166 INFO:teuthology.orchestra.run.smithi059.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-30T16:45:26.195 INFO:teuthology.orchestra.run.smithi059.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-30T16:45:26.196 INFO:teuthology.orchestra.run.smithi059.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-30T16:45:26.204 INFO:teuthology.orchestra.run.smithi059.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-30T16:45:26.208 INFO:teuthology.orchestra.run.smithi059.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-30T16:45:26.418 INFO:teuthology.orchestra.run.smithi059.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-30T16:45:26.697 INFO:teuthology.orchestra.run.smithi059.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-30T16:45:26.732 INFO:teuthology.orchestra.run.smithi107.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3154-g9ed025fb-1jammy [5,092 kB] 2024-05-30T16:45:26.824 INFO:teuthology.orchestra.run.smithi107.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3154-g9ed025fb-1jammy [247 kB] 2024-05-30T16:45:26.827 INFO:teuthology.orchestra.run.smithi107.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3154-g9ed025fb-1jammy [124 kB] 2024-05-30T16:45:26.828 INFO:teuthology.orchestra.run.smithi107.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3154-g9ed025fb-1jammy [1,527 kB] 2024-05-30T16:45:26.856 INFO:teuthology.orchestra.run.smithi107.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3154-g9ed025fb-1jammy [6,257 kB] 2024-05-30T16:45:26.953 INFO:teuthology.orchestra.run.smithi107.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3154-g9ed025fb-1jammy [22.8 MB] 2024-05-30T16:45:26.989 INFO:teuthology.orchestra.run.smithi059.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-30T16:45:26.992 INFO:teuthology.orchestra.run.smithi059.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-30T16:45:27.009 INFO:teuthology.orchestra.run.smithi059.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-30T16:45:27.015 INFO:teuthology.orchestra.run.smithi059.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-30T16:45:27.059 INFO:teuthology.orchestra.run.smithi059.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-30T16:45:27.075 INFO:teuthology.orchestra.run.smithi059.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-30T16:45:27.170 INFO:teuthology.orchestra.run.smithi059.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-30T16:45:27.173 INFO:teuthology.orchestra.run.smithi059.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-30T16:45:27.174 INFO:teuthology.orchestra.run.smithi059.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-30T16:45:27.331 INFO:teuthology.orchestra.run.smithi107.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3154-g9ed025fb-1jammy [14.1 kB] 2024-05-30T16:45:27.331 INFO:teuthology.orchestra.run.smithi107.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3154-g9ed025fb-1jammy [870 kB] 2024-05-30T16:45:27.338 INFO:teuthology.orchestra.run.smithi107.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3154-g9ed025fb-1jammy [2,436 kB] 2024-05-30T16:45:27.378 INFO:teuthology.orchestra.run.smithi107.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3154-g9ed025fb-1jammy [791 kB] 2024-05-30T16:45:27.391 INFO:teuthology.orchestra.run.smithi107.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3154-g9ed025fb-1jammy [148 kB] 2024-05-30T16:45:27.396 INFO:teuthology.orchestra.run.smithi107.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3154-g9ed025fb-1jammy [2,297 kB] 2024-05-30T16:45:27.439 INFO:teuthology.orchestra.run.smithi107.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3154-g9ed025fb-1jammy [8,625 kB] 2024-05-30T16:45:27.592 INFO:teuthology.orchestra.run.smithi107.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3154-g9ed025fb-1jammy [14.2 kB] 2024-05-30T16:45:27.592 INFO:teuthology.orchestra.run.smithi107.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3154-g9ed025fb-1jammy [51.6 MB] 2024-05-30T16:45:28.368 INFO:teuthology.orchestra.run.smithi059.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-30T16:45:28.449 INFO:teuthology.orchestra.run.smithi107.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3154-g9ed025fb-1jammy [124 kB] 2024-05-30T16:45:28.450 INFO:teuthology.orchestra.run.smithi107.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3154-g9ed025fb-1jammy [232 kB] 2024-05-30T16:45:28.452 INFO:teuthology.orchestra.run.smithi107.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3154-g9ed025fb-1jammy [33.9 kB] 2024-05-30T16:45:28.452 INFO:teuthology.orchestra.run.smithi107.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3154-g9ed025fb-1jammy [23.4 kB] 2024-05-30T16:45:28.453 INFO:teuthology.orchestra.run.smithi107.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3154-g9ed025fb-1jammy [38.9 kB] 2024-05-30T16:45:28.453 INFO:teuthology.orchestra.run.smithi107.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3154-g9ed025fb-1jammy [13.6 MB] 2024-05-30T16:45:28.658 INFO:teuthology.orchestra.run.smithi059.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-30T16:45:28.664 INFO:teuthology.orchestra.run.smithi107.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3154-g9ed025fb-1jammy [91.2 kB] 2024-05-30T16:45:29.312 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 182 MB in 9s (20.6 MB/s) 2024-05-30T16:45:29.456 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-30T16:45:29.522 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132924 files and directories currently installed.) 2024-05-30T16:45:29.525 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-30T16:45:29.571 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-30T16:45:29.829 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 182 MB in 9s (19.5 MB/s) 2024-05-30T16:45:29.841 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-30T16:45:29.854 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-30T16:45:29.883 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-30T16:45:29.935 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-30T16:45:30.006 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132924 files and directories currently installed.) 2024-05-30T16:45:30.010 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-30T16:45:30.043 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-30T16:45:30.194 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cmd2. 2024-05-30T16:45:30.207 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-30T16:45:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-30T16:45:30.345 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-30T16:45:30.359 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-30T16:45:30.403 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-30T16:45:30.605 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-30T16:45:30.618 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-30T16:45:30.697 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-30T16:45:30.706 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cmd2. 2024-05-30T16:45:30.720 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-30T16:45:30.764 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-30T16:45:31.093 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-30T16:45:31.106 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-30T16:45:31.159 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-30T16:45:31.376 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-30T16:45:31.391 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-30T16:45:31.476 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-30T16:45:31.537 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-30T16:45:31.550 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-30T16:45:31.596 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-30T16:45:31.779 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-30T16:45:31.795 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-30T16:45:31.829 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-30T16:45:32.140 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-30T16:45:32.141 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-30T16:45:32.155 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-30T16:45:32.156 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-30T16:45:32.199 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-30T16:45:32.216 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T16:45:32.611 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-30T16:45:32.626 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-30T16:45:32.669 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-30T16:45:32.669 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T16:45:32.684 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-30T16:45:32.735 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T16:45:33.014 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-30T16:45:33.029 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-30T16:45:33.072 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T16:45:33.088 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-30T16:45:33.104 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-30T16:45:33.138 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T16:45:33.401 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-30T16:45:33.415 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-30T16:45:33.450 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-30T16:45:33.459 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-30T16:45:33.465 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-30T16:45:33.510 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T16:45:33.762 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librados2. 2024-05-30T16:45:33.777 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../010-librados2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:33.820 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librados2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:33.846 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-30T16:45:33.862 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-30T16:45:33.904 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-30T16:45:34.240 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librbd1. 2024-05-30T16:45:34.241 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librados2. 2024-05-30T16:45:34.254 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../011-librbd1_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:34.256 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../010-librados2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:34.298 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librbd1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:34.299 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librados2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:34.710 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librbd1. 2024-05-30T16:45:34.718 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libcephfs2. 2024-05-30T16:45:34.724 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../011-librbd1_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:34.732 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:34.768 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libcephfs2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:34.768 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librbd1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:35.020 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rados. 2024-05-30T16:45:35.034 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:35.078 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rados (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:35.130 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libcephfs2. 2024-05-30T16:45:35.144 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:35.179 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libcephfs2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:35.398 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-30T16:45:35.412 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:45:35.448 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rados. 2024-05-30T16:45:35.456 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-ceph-argparse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:35.464 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:35.507 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rados (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:35.709 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cephfs. 2024-05-30T16:45:35.723 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:35.759 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cephfs (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:35.801 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-30T16:45:35.817 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:45:35.859 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-ceph-argparse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:36.020 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-30T16:45:36.035 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:45:36.096 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:36.146 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cephfs. 2024-05-30T16:45:36.161 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:36.203 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cephfs (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:36.390 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-prettytable. 2024-05-30T16:45:36.405 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-30T16:45:36.448 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-30T16:45:36.631 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-30T16:45:36.647 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:45:36.681 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:36.701 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rbd. 2024-05-30T16:45:36.716 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:36.759 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rbd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:37.018 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-prettytable. 2024-05-30T16:45:37.033 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-30T16:45:37.071 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-30T16:45:37.076 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-30T16:45:37.086 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-30T16:45:37.120 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-30T16:45:37.345 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rbd. 2024-05-30T16:45:37.361 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:37.404 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rbd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:37.765 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-30T16:45:37.780 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-30T16:45:37.823 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-30T16:45:37.833 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-30T16:45:37.847 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-30T16:45:37.890 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-30T16:45:38.059 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-30T16:45:38.074 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-30T16:45:38.109 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-30T16:45:38.144 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-30T16:45:38.159 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-30T16:45:38.202 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-30T16:45:38.420 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-30T16:45:38.435 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-30T16:45:38.478 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-30T16:45:38.522 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package lua5.1. 2024-05-30T16:45:38.537 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-30T16:45:38.580 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-30T16:45:38.807 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua5.1. 2024-05-30T16:45:38.822 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-30T16:45:38.865 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-30T16:45:38.875 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package lua-any. 2024-05-30T16:45:38.890 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-30T16:45:38.925 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-30T16:45:39.169 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package zip. 2024-05-30T16:45:39.176 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua-any. 2024-05-30T16:45:39.184 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-30T16:45:39.192 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-30T16:45:39.226 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-30T16:45:39.228 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking zip (3.0-12build2) ... 2024-05-30T16:45:39.462 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package zip. 2024-05-30T16:45:39.478 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-30T16:45:39.521 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking zip (3.0-12build2) ... 2024-05-30T16:45:39.539 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package unzip. 2024-05-30T16:45:39.554 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-30T16:45:39.597 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-30T16:45:39.849 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package unzip. 2024-05-30T16:45:39.864 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-30T16:45:39.907 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-30T16:45:39.944 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package luarocks. 2024-05-30T16:45:39.958 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-30T16:45:39.993 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-30T16:45:40.302 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package luarocks. 2024-05-30T16:45:40.318 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-30T16:45:40.361 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-30T16:45:40.376 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librgw2. 2024-05-30T16:45:40.390 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../027-librgw2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:40.435 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librgw2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:40.727 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librgw2. 2024-05-30T16:45:40.741 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../027-librgw2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:40.776 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librgw2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:40.904 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rgw. 2024-05-30T16:45:40.918 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:40.962 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:41.262 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rgw. 2024-05-30T16:45:41.277 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:41.299 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-30T16:45:41.314 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-30T16:45:41.320 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:41.348 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-30T16:45:41.627 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libradosstriper1. 2024-05-30T16:45:41.642 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:41.657 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-30T16:45:41.672 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-30T16:45:41.685 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libradosstriper1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:41.715 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-30T16:45:42.001 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libradosstriper1. 2024-05-30T16:45:42.017 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:42.059 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libradosstriper1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:42.139 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-common. 2024-05-30T16:45:42.153 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:42.197 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:42.454 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-common. 2024-05-30T16:45:42.470 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:42.537 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:43.269 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-base. 2024-05-30T16:45:43.284 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:43.345 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-base (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:43.684 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-base. 2024-05-30T16:45:43.700 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:43.752 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-base (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:43.848 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-30T16:45:43.862 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-30T16:45:43.907 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-30T16:45:44.210 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cheroot. 2024-05-30T16:45:44.224 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-30T16:45:44.268 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-30T16:45:44.372 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-30T16:45:44.387 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-30T16:45:44.439 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-30T16:45:44.597 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-30T16:45:44.611 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-30T16:45:44.655 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-30T16:45:44.808 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cheroot. 2024-05-30T16:45:44.824 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-30T16:45:44.875 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-30T16:45:44.941 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-30T16:45:44.955 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-30T16:45:44.999 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-30T16:45:45.211 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-30T16:45:45.227 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-30T16:45:45.270 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-30T16:45:45.285 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-30T16:45:45.300 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-30T16:45:45.344 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-30T16:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-30T16:45:45.612 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-30T16:45:45.630 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-tempora. 2024-05-30T16:45:45.645 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-30T16:45:45.647 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-30T16:45:45.688 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-30T16:45:45.925 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-30T16:45:45.939 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-30T16:45:45.975 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-portend. 2024-05-30T16:45:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-30T16:45:45.990 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-30T16:45:46.025 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-30T16:45:46.278 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-tempora. 2024-05-30T16:45:46.293 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-30T16:45:46.303 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-30T16:45:46.317 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-30T16:45:46.336 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-30T16:45:46.361 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-30T16:45:46.664 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-30T16:45:46.679 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-30T16:45:46.723 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-30T16:45:46.848 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-portend. 2024-05-30T16:45:46.863 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-30T16:45:46.906 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-30T16:45:47.035 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-natsort. 2024-05-30T16:45:47.049 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-30T16:45:47.093 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-30T16:45:47.209 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-30T16:45:47.224 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-30T16:45:47.267 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-30T16:45:47.405 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-logutils. 2024-05-30T16:45:47.419 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-30T16:45:47.462 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-30T16:45:47.545 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-30T16:45:47.560 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-30T16:45:47.604 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-30T16:45:47.807 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-30T16:45:47.822 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-30T16:45:47.948 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-natsort. 2024-05-30T16:45:47.964 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-30T16:45:48.006 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-30T16:45:48.065 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-30T16:45:48.318 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-logutils. 2024-05-30T16:45:48.319 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-mako. 2024-05-30T16:45:48.333 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-30T16:45:48.334 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-30T16:45:48.368 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-30T16:45:48.376 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-30T16:45:48.630 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-30T16:45:48.645 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-30T16:45:48.687 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-30T16:45:48.697 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-30T16:45:48.712 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-30T16:45:48.755 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-30T16:45:48.990 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-mako. 2024-05-30T16:45:49.006 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-30T16:45:49.048 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-30T16:45:49.092 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-30T16:45:49.106 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-30T16:45:49.150 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-30T16:45:49.377 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-30T16:45:49.392 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-30T16:45:49.428 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webob. 2024-05-30T16:45:49.435 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-30T16:45:49.443 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-30T16:45:49.477 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-30T16:45:49.738 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-30T16:45:49.753 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-30T16:45:49.781 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-waitress. 2024-05-30T16:45:49.788 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-30T16:45:49.795 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-30T16:45:49.833 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-30T16:45:50.065 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-webob. 2024-05-30T16:45:50.081 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-30T16:45:50.117 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-tempita. 2024-05-30T16:45:50.124 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-30T16:45:50.132 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-30T16:45:50.175 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-30T16:45:50.485 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-waitress. 2024-05-30T16:45:50.502 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-30T16:45:50.503 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-paste. 2024-05-30T16:45:50.518 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-30T16:45:50.554 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-30T16:45:50.561 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-30T16:45:50.905 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-tempita. 2024-05-30T16:45:50.915 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-30T16:45:50.921 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-30T16:45:50.930 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-30T16:45:50.963 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-30T16:45:50.973 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-30T16:45:51.335 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-30T16:45:51.341 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-paste. 2024-05-30T16:45:51.350 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-30T16:45:51.357 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-30T16:45:51.393 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-30T16:45:51.407 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-30T16:45:51.696 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webtest. 2024-05-30T16:45:51.711 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-30T16:45:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-30T16:45:51.746 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-30T16:45:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-30T16:45:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-30T16:45:52.016 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pecan. 2024-05-30T16:45:52.031 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-30T16:45:52.072 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-30T16:45:52.083 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-30T16:45:52.088 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-30T16:45:52.122 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-30T16:45:52.383 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-webtest. 2024-05-30T16:45:52.399 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-30T16:45:52.437 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-certifi. 2024-05-30T16:45:52.452 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-30T16:45:52.475 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-30T16:45:52.496 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-30T16:45:53.445 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pecan. 2024-05-30T16:45:53.460 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-30T16:45:53.499 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-idna. 2024-05-30T16:45:53.502 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-30T16:45:53.514 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-05-30T16:45:53.566 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-05-30T16:45:53.836 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-urllib3. 2024-05-30T16:45:53.851 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-30T16:45:53.883 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-certifi. 2024-05-30T16:45:53.885 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-30T16:45:53.899 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-30T16:45:53.941 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-30T16:45:54.155 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-requests. 2024-05-30T16:45:54.169 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-30T16:45:54.205 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-30T16:45:54.269 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-idna. 2024-05-30T16:45:54.285 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-05-30T16:45:54.327 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-05-30T16:45:54.517 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-30T16:45:54.531 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-05-30T16:45:54.575 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-05-30T16:45:54.605 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-urllib3. 2024-05-30T16:45:54.621 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-30T16:45:54.655 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-30T16:45:54.828 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-30T16:45:54.841 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:45:54.878 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:54.925 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-requests. 2024-05-30T16:45:54.940 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-30T16:45:54.975 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-30T16:45:55.250 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-30T16:45:55.252 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-30T16:45:55.262 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:55.268 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-05-30T16:45:55.300 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:55.335 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-05-30T16:45:55.578 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-30T16:45:55.590 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-30T16:45:55.597 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-30T16:45:55.613 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:45:55.627 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-30T16:45:55.647 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:55.956 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-openssl. 2024-05-30T16:45:55.968 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-30T16:45:56.005 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-30T16:45:56.035 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-30T16:45:56.051 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:56.093 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:56.342 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr. 2024-05-30T16:45:56.354 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:56.363 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-30T16:45:56.379 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-30T16:45:56.392 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:56.413 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-30T16:45:56.757 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-openssl. 2024-05-30T16:45:56.771 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mon. 2024-05-30T16:45:56.773 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-30T16:45:56.783 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:56.815 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-30T16:45:56.820 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mon (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:57.152 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr. 2024-05-30T16:45:57.168 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:57.382 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-osd. 2024-05-30T16:45:57.397 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:57.441 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-osd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:57.563 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mon. 2024-05-30T16:45:57.579 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:57.613 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mon (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:58.144 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph. 2024-05-30T16:45:58.161 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../068-ceph_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:58.175 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-osd. 2024-05-30T16:45:58.191 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:58.202 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:58.233 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-osd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:58.772 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-fuse. 2024-05-30T16:45:58.787 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:58.830 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:58.953 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph. 2024-05-30T16:45:58.968 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../068-ceph_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:59.011 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:59.210 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mds. 2024-05-30T16:45:59.226 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:59.260 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mds (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:59.339 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-fuse. 2024-05-30T16:45:59.355 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:59.397 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:59.613 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package cephadm. 2024-05-30T16:45:59.628 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../071-cephadm_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:59.671 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:59.717 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mds. 2024-05-30T16:45:59.728 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:45:59.767 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mds (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:45:59.982 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-30T16:45:59.997 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-30T16:46:00.040 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-30T16:46:00.153 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package cephadm. 2024-05-30T16:46:00.162 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../071-cephadm_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:46:00.203 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:00.376 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-30T16:46:00.389 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-30T16:46:00.434 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-30T16:46:00.481 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-30T16:46:00.490 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-30T16:46:00.530 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-30T16:46:00.842 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-30T16:46:00.850 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-30T16:46:00.891 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-30T16:46:01.339 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-babel. 2024-05-30T16:46:01.352 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-30T16:46:01.397 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-30T16:46:01.733 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jinja2. 2024-05-30T16:46:01.747 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-05-30T16:46:01.791 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-05-30T16:46:01.855 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-babel. 2024-05-30T16:46:01.866 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-30T16:46:01.896 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-30T16:46:02.144 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-30T16:46:02.158 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:02.202 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:02.391 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jinja2. 2024-05-30T16:46:02.404 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-05-30T16:46:02.441 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-05-30T16:46:02.530 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-30T16:46:02.544 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-30T16:46:02.589 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-30T16:46:02.761 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-30T16:46:02.772 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:02.810 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:02.874 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-routes. 2024-05-30T16:46:02.888 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-30T16:46:02.941 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-30T16:46:03.131 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-30T16:46:03.145 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-30T16:46:03.189 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-30T16:46:03.253 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-30T16:46:03.266 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:03.311 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:03.500 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-routes. 2024-05-30T16:46:03.512 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-30T16:46:03.550 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-30T16:46:03.895 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-30T16:46:03.907 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:03.944 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:04.540 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-30T16:46:04.554 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-30T16:46:04.599 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-30T16:46:05.108 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-30T16:46:05.110 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-joblib. 2024-05-30T16:46:05.117 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-30T16:46:05.118 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-30T16:46:05.158 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-30T16:46:05.160 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-30T16:46:05.488 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-30T16:46:05.497 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-30T16:46:05.607 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-30T16:46:05.678 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-joblib. 2024-05-30T16:46:05.689 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-30T16:46:05.728 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-30T16:46:05.951 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-sklearn. 2024-05-30T16:46:05.959 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-30T16:46:06.001 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-30T16:46:06.098 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-30T16:46:06.109 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-30T16:46:06.225 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-30T16:46:06.495 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-sklearn. 2024-05-30T16:46:06.506 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-30T16:46:06.536 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-30T16:46:06.652 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-30T16:46:06.659 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:06.701 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:07.220 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-30T16:46:07.232 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:07.270 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:07.621 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cachetools. 2024-05-30T16:46:07.630 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-30T16:46:07.662 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-30T16:46:07.940 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-30T16:46:07.951 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-30T16:46:07.990 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-30T16:46:08.156 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cachetools. 2024-05-30T16:46:08.169 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-30T16:46:08.198 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-30T16:46:08.327 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-30T16:46:08.337 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-30T16:46:08.377 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-30T16:46:08.484 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-30T16:46:08.496 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-30T16:46:08.534 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-30T16:46:08.837 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-30T16:46:08.850 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-30T16:46:08.887 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-30T16:46:08.946 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rsa. 2024-05-30T16:46:08.956 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-30T16:46:08.997 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-30T16:46:09.201 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rsa. 2024-05-30T16:46:09.213 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-30T16:46:09.250 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-30T16:46:09.316 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-google-auth. 2024-05-30T16:46:09.326 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-30T16:46:09.366 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-30T16:46:09.562 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-google-auth. 2024-05-30T16:46:09.575 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-30T16:46:09.604 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-30T16:46:09.694 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-30T16:46:09.704 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-30T16:46:09.745 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-30T16:46:09.907 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-30T16:46:09.917 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-30T16:46:09.957 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-30T16:46:10.047 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-websocket. 2024-05-30T16:46:10.057 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-30T16:46:10.088 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-30T16:46:10.269 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-websocket. 2024-05-30T16:46:10.278 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-30T16:46:10.318 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-30T16:46:10.366 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-30T16:46:10.379 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-30T16:46:10.416 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-30T16:46:10.622 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-30T16:46:10.631 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-30T16:46:10.671 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-30T16:46:11.046 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-30T16:46:11.056 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:11.096 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:11.335 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-30T16:46:11.344 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:11.377 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:11.440 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-30T16:46:11.450 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-30T16:46:11.490 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-30T16:46:11.663 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-30T16:46:11.671 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-30T16:46:11.713 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-30T16:46:11.835 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-30T16:46:11.845 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-30T16:46:11.885 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-30T16:46:12.066 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-30T16:46:12.074 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-30T16:46:12.116 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-30T16:46:12.121 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package jq. 2024-05-30T16:46:12.131 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-30T16:46:12.162 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-30T16:46:12.365 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package socat. 2024-05-30T16:46:12.375 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-30T16:46:12.414 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-30T16:46:12.594 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package jq. 2024-05-30T16:46:12.603 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-30T16:46:12.643 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-30T16:46:12.693 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package xmlstarlet. 2024-05-30T16:46:12.703 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-30T16:46:12.742 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-30T16:46:12.863 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package socat. 2024-05-30T16:46:12.876 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-30T16:46:12.913 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-30T16:46:13.097 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-test. 2024-05-30T16:46:13.106 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:46:13.138 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-test (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:13.183 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package xmlstarlet. 2024-05-30T16:46:13.193 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-30T16:46:13.232 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-30T16:46:13.570 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-test. 2024-05-30T16:46:13.580 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:46:13.620 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-test (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:15.225 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-volume. 2024-05-30T16:46:15.234 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:15.275 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-volume (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:15.658 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-volume. 2024-05-30T16:46:15.662 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-30T16:46:15.668 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:15.671 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:46:15.707 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-volume (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:15.712 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking cephfs-mirror (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:16.015 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-colorama. 2024-05-30T16:46:16.024 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-30T16:46:16.065 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-30T16:46:16.087 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-30T16:46:16.097 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:46:16.136 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking cephfs-mirror (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:16.275 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package cephfs-shell. 2024-05-30T16:46:16.284 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:16.317 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking cephfs-shell (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:16.414 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-colorama. 2024-05-30T16:46:16.425 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-30T16:46:16.464 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-30T16:46:16.586 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package cephfs-top. 2024-05-30T16:46:16.595 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:16.636 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking cephfs-top (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:16.725 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package cephfs-shell. 2024-05-30T16:46:16.736 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:16.775 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking cephfs-shell (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:16.880 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-30T16:46:16.889 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:46:16.930 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libcephfs-dev (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:17.053 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package cephfs-top. 2024-05-30T16:46:17.063 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T16:46:17.102 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking cephfs-top (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:17.266 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-30T16:46:17.275 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-30T16:46:17.315 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-30T16:46:17.355 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-30T16:46:17.365 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:46:17.405 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libcephfs-dev (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:17.662 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-30T16:46:17.673 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-30T16:46:17.708 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-30T16:46:17.711 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-30T16:46:17.718 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-30T16:46:17.749 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-30T16:46:18.045 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-30T16:46:18.048 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package nvme-cli. 2024-05-30T16:46:18.055 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-30T16:46:18.058 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-30T16:46:18.095 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-30T16:46:18.098 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-30T16:46:18.495 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package pkg-config. 2024-05-30T16:46:18.499 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package nvme-cli. 2024-05-30T16:46:18.504 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-30T16:46:18.512 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-30T16:46:18.557 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-30T16:46:18.570 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-30T16:46:18.971 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package pkg-config. 2024-05-30T16:46:18.982 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-30T16:46:19.020 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-30T16:46:19.031 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-30T16:46:19.041 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-30T16:46:19.081 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-30T16:46:19.257 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-30T16:46:19.268 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-30T16:46:19.298 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-30T16:46:19.516 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-30T16:46:19.526 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-30T16:46:19.566 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-30T16:46:19.735 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-30T16:46:19.745 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-30T16:46:19.785 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-30T16:46:19.836 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pastescript. 2024-05-30T16:46:19.846 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-30T16:46:19.877 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-30T16:46:20.054 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pastescript. 2024-05-30T16:46:20.065 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-30T16:46:20.104 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-30T16:46:20.164 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pluggy. 2024-05-30T16:46:20.174 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-30T16:46:20.214 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-30T16:46:20.424 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pluggy. 2024-05-30T16:46:20.435 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-30T16:46:20.473 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-30T16:46:20.525 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-psutil. 2024-05-30T16:46:20.535 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-30T16:46:20.575 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-30T16:46:20.785 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-psutil. 2024-05-30T16:46:20.796 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-30T16:46:20.835 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-30T16:46:20.936 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-py. 2024-05-30T16:46:20.946 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-30T16:46:20.986 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-30T16:46:21.188 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-py. 2024-05-30T16:46:21.199 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-30T16:46:21.237 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-30T16:46:21.314 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pygments. 2024-05-30T16:46:21.325 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-30T16:46:21.380 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-30T16:46:21.549 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pygments. 2024-05-30T16:46:21.560 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-30T16:46:21.599 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-30T16:46:21.842 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-30T16:46:21.852 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-30T16:46:21.901 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-30T16:46:22.053 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-30T16:46:22.063 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-30T16:46:22.103 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-30T16:46:22.195 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-toml. 2024-05-30T16:46:22.204 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-30T16:46:22.245 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-30T16:46:22.381 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-toml. 2024-05-30T16:46:22.392 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-30T16:46:22.430 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-30T16:46:22.489 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pytest. 2024-05-30T16:46:22.498 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-30T16:46:22.530 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-30T16:46:22.759 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pytest. 2024-05-30T16:46:22.770 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-30T16:46:22.808 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-30T16:46:22.892 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-simplejson. 2024-05-30T16:46:22.901 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-30T16:46:22.942 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-30T16:46:23.120 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-simplejson. 2024-05-30T16:46:23.131 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-30T16:46:23.170 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-30T16:46:23.211 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-30T16:46:23.220 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-30T16:46:23.261 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-30T16:46:23.423 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-30T16:46:23.434 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-30T16:46:23.473 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-30T16:46:23.965 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package radosgw. 2024-05-30T16:46:23.974 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../122-radosgw_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:46:24.014 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking radosgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:24.168 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package radosgw. 2024-05-30T16:46:24.179 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../122-radosgw_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:46:24.210 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking radosgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:24.659 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package rbd-fuse. 2024-05-30T16:46:24.669 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:46:24.717 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking rbd-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:24.780 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package rbd-fuse. 2024-05-30T16:46:24.790 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T16:46:24.829 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking rbd-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:24.998 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-30T16:46:25.122 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-30T16:46:25.255 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-30T16:46:25.365 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-30T16:46:25.393 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-30T16:46:25.519 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-30T16:46:25.620 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-30T16:46:25.788 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-30T16:46:25.996 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-30T16:46:26.189 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-30T16:46:26.582 INFO:teuthology.orchestra.run.smithi107.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-30T16:46:26.609 INFO:teuthology.orchestra.run.smithi107.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-05-30T16:46:26.650 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:26.813 INFO:teuthology.orchestra.run.smithi059.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-30T16:46:26.827 INFO:teuthology.orchestra.run.smithi059.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-05-30T16:46:26.879 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:27.443 INFO:teuthology.orchestra.run.smithi107.stdout:Adding system user cephadm....done 2024-05-30T16:46:27.515 INFO:teuthology.orchestra.run.smithi059.stdout:Adding system user cephadm....done 2024-05-30T16:46:27.622 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-30T16:46:27.873 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-30T16:46:27.919 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-30T16:46:28.116 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-30T16:46:28.212 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-30T16:46:28.242 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-30T16:46:28.480 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-30T16:46:28.518 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-30T16:46:28.606 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-30T16:46:28.786 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-30T16:46:28.882 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-30T16:46:28.912 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-30T16:46:29.158 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-30T16:46:29.222 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-30T16:46:29.259 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-30T16:46:29.566 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-30T16:46:29.586 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-30T16:46:29.816 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-30T16:46:29.963 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-30T16:46:30.085 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-30T16:46:30.214 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-30T16:46:30.369 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-30T16:46:30.482 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-30T16:46:30.612 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-30T16:46:30.775 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-30T16:46:30.855 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-30T16:46:31.026 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-30T16:46:31.155 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-30T16:46:31.286 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-30T16:46:31.398 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-ceph-argparse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:31.554 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-30T16:46:31.649 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-30T16:46:31.775 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-30T16:46:31.813 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-ceph-argparse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:31.901 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-30T16:46:32.073 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-30T16:46:32.169 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-30T16:46:32.256 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-30T16:46:32.294 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-30T16:46:32.408 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-30T16:46:32.579 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-30T16:46:32.842 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-30T16:46:32.968 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-30T16:46:32.991 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-30T16:46:33.026 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-30T16:46:33.090 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-30T16:46:33.199 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-30T16:46:33.244 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-30T16:46:33.584 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-30T16:46:33.620 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-30T16:46:33.641 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-30T16:46:33.706 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-30T16:46:33.710 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-30T16:46:33.865 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-30T16:46:33.995 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-30T16:46:34.249 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-30T16:46:34.359 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-30T16:46:34.554 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-30T16:46:34.610 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-30T16:46:34.871 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up zip (3.0-12build2) ... 2024-05-30T16:46:34.886 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-30T16:46:34.973 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-30T16:46:35.188 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up zip (3.0-12build2) ... 2024-05-30T16:46:35.338 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-30T16:46:35.649 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-30T16:46:35.926 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-30T16:46:36.057 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-30T16:46:36.118 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-30T16:46:36.244 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-30T16:46:36.334 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-30T16:46:36.459 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-30T16:46:36.553 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-30T16:46:36.585 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-30T16:46:36.936 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-30T16:46:36.946 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-30T16:46:37.205 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-30T16:46:37.346 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-30T16:46:37.582 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-30T16:46:37.588 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-30T16:46:37.866 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-30T16:46:37.982 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-30T16:46:38.192 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-05-30T16:46:38.316 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-30T16:46:38.569 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-30T16:46:38.642 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-05-30T16:46:38.820 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-30T16:46:38.945 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:38.994 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-30T16:46:39.247 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-05-30T16:46:39.253 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-30T16:46:39.354 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:39.589 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-30T16:46:39.655 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-05-30T16:46:40.006 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-30T16:46:40.795 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-30T16:46:41.055 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T16:46:41.189 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-30T16:46:41.279 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-30T16:46:41.465 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-30T16:46:41.497 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T16:46:41.574 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-30T16:46:41.632 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-30T16:46:41.683 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-30T16:46:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-30T16:46:41.968 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-30T16:46:42.034 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-30T16:46:42.160 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-30T16:46:42.236 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-30T16:46:42.469 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-30T16:46:42.520 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T16:46:42.638 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-30T16:46:42.737 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-30T16:46:42.931 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-30T16:46:42.988 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T16:46:43.114 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-30T16:46:43.182 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-30T16:46:43.441 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-30T16:46:43.449 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-30T16:46:43.734 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-30T16:46:43.742 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-30T16:46:44.002 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-30T16:46:44.010 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-30T16:46:44.277 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-30T16:46:44.278 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-30T16:46:44.403 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-30T16:46:44.520 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-30T16:46:44.688 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-30T16:46:44.779 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-30T16:46:44.813 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-30T16:46:44.905 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-30T16:46:45.123 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-30T16:46:45.199 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-30T16:46:45.324 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-30T16:46:45.424 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-30T16:46:45.634 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-30T16:46:45.667 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-30T16:46:45.784 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-30T16:46:45.910 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-30T16:46:45.952 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-30T16:46:45.999 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-30T16:46:46.211 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-30T16:46:46.245 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-30T16:46:46.312 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-30T16:46:46.346 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-30T16:46:46.421 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-30T16:46:46.535 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-30T16:46:46.731 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-30T16:46:46.781 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-30T16:46:46.907 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-30T16:46:46.990 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-30T16:46:47.118 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-30T16:46:47.317 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-30T16:46:47.378 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T16:46:47.504 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-05-30T16:46:47.593 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-30T16:46:47.703 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-30T16:46:47.830 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-30T16:46:47.954 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T16:46:48.072 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-05-30T16:46:48.164 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-30T16:46:48.398 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-30T16:46:48.448 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-30T16:46:48.660 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-30T16:46:48.724 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-30T16:46:48.920 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-30T16:46:49.025 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-30T16:46:49.179 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-30T16:46:49.236 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-30T16:46:49.447 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-30T16:46:49.521 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-30T16:46:49.789 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-30T16:46:49.849 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-30T16:46:50.065 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-30T16:46:50.151 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-30T16:46:50.467 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-30T16:46:50.503 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-30T16:46:50.604 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librados2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:50.730 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:50.785 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-30T16:46:50.848 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-30T16:46:51.146 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-30T16:46:51.193 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libcephfs2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:51.263 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librados2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:51.319 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libradosstriper1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:51.389 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:51.445 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-30T16:46:51.516 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-30T16:46:51.738 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librbd1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:51.852 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libcephfs2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:51.864 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-modules-core (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:51.961 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libradosstriper1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:51.989 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:52.062 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-30T16:46:52.232 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-30T16:46:52.232 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-30T16:46:52.347 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librbd1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:52.473 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-modules-core (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:52.599 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:52.819 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-30T16:46:52.819 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-30T16:46:52.924 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libcephfs-dev (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:53.092 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rados (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:53.227 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librgw2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:53.336 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up cephfs-top (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:53.477 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-30T16:46:53.492 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libcephfs-dev (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:53.643 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rados (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:53.761 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librgw2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:53.862 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up cephfs-top (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:53.963 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-30T16:46:55.201 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rbd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:55.305 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up rbd-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:55.308 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rbd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:55.414 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:55.428 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up rbd-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:55.537 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:55.540 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cephfs (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:55.638 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cephfs (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:55.666 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up cephfs-shell (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:55.764 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up cephfs-shell (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:55.792 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:55.890 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:56.295 INFO:teuthology.orchestra.run.smithi107.stdout:Adding group ceph....done 2024-05-30T16:46:56.451 INFO:teuthology.orchestra.run.smithi059.stdout:Adding group ceph....done 2024-05-30T16:46:56.662 INFO:teuthology.orchestra.run.smithi107.stdout:Adding system user ceph....done 2024-05-30T16:46:56.827 INFO:teuthology.orchestra.run.smithi059.stdout:Adding system user ceph....done 2024-05-30T16:46:56.840 INFO:teuthology.orchestra.run.smithi107.stdout:Setting system user ceph properties....done 2024-05-30T16:46:56.861 INFO:teuthology.orchestra.run.smithi107.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-30T16:46:56.988 INFO:teuthology.orchestra.run.smithi059.stdout:Setting system user ceph properties....done 2024-05-30T16:46:57.001 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-30T16:46:57.004 INFO:teuthology.orchestra.run.smithi059.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-30T16:46:57.155 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-30T16:46:57.412 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-30T16:46:57.589 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-30T16:46:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up cephfs-mirror (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:58.362 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-30T16:46:58.362 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-30T16:46:58.611 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up cephfs-mirror (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:58.852 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-30T16:46:58.852 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-30T16:46:59.050 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-test (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:59.248 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up radosgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:59.576 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-test (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:59.711 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up radosgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:46:59.926 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-30T16:46:59.926 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-30T16:47:00.291 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-30T16:47:00.291 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-30T16:47:00.557 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-base (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:00.911 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-30T16:47:00.969 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-base (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:01.454 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-30T16:47:01.634 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mds (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:01.881 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-30T16:47:01.881 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-30T16:47:02.173 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mds (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:02.410 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-30T16:47:02.411 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-30T16:47:02.502 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:02.723 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-30T16:47:02.723 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-30T16:47:03.075 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:03.295 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-30T16:47:03.295 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-30T16:47:03.370 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-osd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:03.699 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-30T16:47:03.699 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-30T16:47:04.130 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-osd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:04.338 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:04.459 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-30T16:47:04.459 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-30T16:47:04.489 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:04.657 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mon (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:04.882 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-30T16:47:04.882 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-30T16:47:05.140 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:05.283 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:05.425 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mon (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:05.558 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:05.643 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-30T16:47:05.643 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-30T16:47:05.726 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:05.877 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-dashboard (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:06.020 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-volume (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:06.326 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:06.406 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-30T16:47:06.453 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:06.506 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-30T16:47:06.553 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-dashboard (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:06.667 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-30T16:47:06.688 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-volume (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T16:47:07.057 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-30T16:47:07.166 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-30T16:47:07.318 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-30T16:47:07.417 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-30T16:47:08.093 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-30T16:47:08.148 INFO:teuthology.orchestra.run.smithi107.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-30T16:47:08.152 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-30T16:47:08.228 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-30T16:47:08.404 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-05-30T16:47:08.405 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-05-30T16:47:08.578 INFO:teuthology.orchestra.run.smithi107.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-30T16:47:08.578 INFO:teuthology.orchestra.run.smithi107.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-30T16:47:08.578 INFO:teuthology.orchestra.run.smithi107.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-30T16:47:08.578 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-05-30T16:47:08.578 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-30T16:47:08.578 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-30T16:47:08.578 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-30T16:47:08.578 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-30T16:47:08.579 INFO:teuthology.orchestra.run.smithi107.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-30T16:47:08.579 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-30T16:47:08.579 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2024-05-30T16:47:08.580 INFO:teuthology.orchestra.run.smithi107.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-30T16:47:08.580 INFO:teuthology.orchestra.run.smithi107.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-30T16:47:08.580 INFO:teuthology.orchestra.run.smithi107.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-30T16:47:08.580 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-30T16:47:08.580 INFO:teuthology.orchestra.run.smithi107.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-30T16:47:08.581 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2024-05-30T16:47:08.581 INFO:teuthology.orchestra.run.smithi107.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-30T16:47:08.581 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-30T16:47:08.581 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-30T16:47:08.634 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2024-05-30T16:47:08.635 INFO:teuthology.orchestra.run.smithi107.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-30T16:47:08.635 INFO:teuthology.orchestra.run.smithi107.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-30T16:47:08.636 INFO:teuthology.orchestra.run.smithi107.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-30T16:47:08.636 INFO:teuthology.orchestra.run.smithi107.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-30T16:47:08.636 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-30T16:47:08.636 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-30T16:47:08.636 INFO:teuthology.orchestra.run.smithi107.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-30T16:47:08.637 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages will be upgraded: 2024-05-30T16:47:08.637 INFO:teuthology.orchestra.run.smithi107.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-30T16:47:08.721 INFO:teuthology.orchestra.run.smithi107.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-30T16:47:08.721 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 55.7 MB of archives. 2024-05-30T16:47:08.721 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 203 MB of additional disk space will be used. 2024-05-30T16:47:08.721 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-30T16:47:08.800 INFO:teuthology.orchestra.run.smithi059.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-30T16:47:08.805 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-30T16:47:08.883 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-05-30T16:47:08.886 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-30T16:47:08.891 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-30T16:47:08.925 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-30T16:47:08.926 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-30T16:47:08.927 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-30T16:47:08.935 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-30T16:47:08.936 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-30T16:47:08.937 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-30T16:47:08.939 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-30T16:47:08.939 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-30T16:47:08.940 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-30T16:47:08.951 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-30T16:47:08.951 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-30T16:47:08.952 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-30T16:47:08.972 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-30T16:47:09.070 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2024-05-30T16:47:09.071 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2024-05-30T16:47:09.257 INFO:teuthology.orchestra.run.smithi059.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-30T16:47:09.257 INFO:teuthology.orchestra.run.smithi059.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-30T16:47:09.257 INFO:teuthology.orchestra.run.smithi059.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-30T16:47:09.257 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2024-05-30T16:47:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-30T16:47:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-30T16:47:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-30T16:47:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-30T16:47:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-30T16:47:09.259 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-30T16:47:09.259 INFO:teuthology.orchestra.run.smithi059.stdout:The following additional packages will be installed: 2024-05-30T16:47:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-30T16:47:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-30T16:47:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-30T16:47:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-30T16:47:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-30T16:47:09.261 INFO:teuthology.orchestra.run.smithi059.stdout:Suggested packages: 2024-05-30T16:47:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-30T16:47:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-30T16:47:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-30T16:47:09.273 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-30T16:47:09.276 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-30T16:47:09.276 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-30T16:47:09.280 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-30T16:47:09.280 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-30T16:47:09.285 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.12-0ubuntu0.22.04.1 [149 kB] 2024-05-30T16:47:09.287 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-30T16:47:09.295 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-30T16:47:09.295 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-30T16:47:09.318 INFO:teuthology.orchestra.run.smithi059.stdout:The following NEW packages will be installed: 2024-05-30T16:47:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-30T16:47:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-30T16:47:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-30T16:47:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-30T16:47:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-30T16:47:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-30T16:47:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-30T16:47:09.320 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-30T16:47:09.320 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-30T16:47:09.321 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages will be upgraded: 2024-05-30T16:47:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-30T16:47:09.331 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-30T16:47:09.356 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-30T16:47:09.360 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-30T16:47:09.361 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-30T16:47:09.361 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-30T16:47:09.362 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.12-0ubuntu0.22.04.1 [1,223 kB] 2024-05-30T16:47:09.374 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-30T16:47:09.379 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.12-0ubuntu0.22.04.1 [16.2 MB] 2024-05-30T16:47:09.518 INFO:teuthology.orchestra.run.smithi059.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-30T16:47:09.518 INFO:teuthology.orchestra.run.smithi059.stdout:Need to get 55.7 MB of archives. 2024-05-30T16:47:09.519 INFO:teuthology.orchestra.run.smithi059.stdout:After this operation, 203 MB of additional disk space will be used. 2024-05-30T16:47:09.519 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-30T16:47:09.571 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-30T16:47:09.571 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-30T16:47:09.571 INFO:teuthology.orchestra.run.smithi107.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-30T16:47:09.572 INFO:teuthology.orchestra.run.smithi107.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-30T16:47:09.572 INFO:teuthology.orchestra.run.smithi107.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-30T16:47:09.572 INFO:teuthology.orchestra.run.smithi107.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-30T16:47:09.587 INFO:teuthology.orchestra.run.smithi107.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-30T16:47:09.587 INFO:teuthology.orchestra.run.smithi107.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-30T16:47:09.969 INFO:teuthology.orchestra.run.smithi107.stdout:Preconfiguring packages ... 2024-05-30T16:47:10.132 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 55.7 MB in 1s (59.1 MB/s) 2024-05-30T16:47:10.220 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-30T16:47:10.247 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-30T16:47:10.392 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-30T16:47:10.393 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-30T16:47:10.394 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-30T16:47:10.420 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-05-30T16:47:10.422 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-30T16:47:10.423 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-30T16:47:10.423 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-30T16:47:10.427 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-30T16:47:10.430 INFO:teuthology.orchestra.run.smithi059.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-30T16:47:10.431 INFO:teuthology.orchestra.run.smithi059.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-30T16:47:10.565 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-30T16:47:10.607 INFO:teuthology.orchestra.run.smithi059.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-30T16:47:10.917 INFO:teuthology.orchestra.run.smithi059.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-30T16:47:10.927 INFO:teuthology.orchestra.run.smithi059.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-30T16:47:10.933 INFO:teuthology.orchestra.run.smithi059.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-30T16:47:11.022 INFO:teuthology.orchestra.run.smithi059.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-30T16:47:11.173 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-30T16:47:12.053 INFO:teuthology.orchestra.run.smithi059.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-30T16:47:12.055 INFO:teuthology.orchestra.run.smithi059.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-30T16:47:12.055 INFO:teuthology.orchestra.run.smithi059.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-30T16:47:12.058 INFO:teuthology.orchestra.run.smithi059.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-30T16:47:12.059 INFO:teuthology.orchestra.run.smithi059.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-30T16:47:12.095 INFO:teuthology.orchestra.run.smithi059.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.12-0ubuntu0.22.04.1 [149 kB] 2024-05-30T16:47:12.258 INFO:teuthology.orchestra.run.smithi107.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-30T16:47:12.270 INFO:teuthology.orchestra.run.smithi059.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-30T16:47:12.511 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package flex. 2024-05-30T16:47:12.581 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-05-30T16:47:12.585 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-30T16:47:12.626 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-30T16:47:12.918 INFO:teuthology.orchestra.run.smithi059.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-30T16:47:12.918 INFO:teuthology.orchestra.run.smithi059.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-30T16:47:13.062 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-30T16:47:13.110 INFO:teuthology.orchestra.run.smithi059.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-30T16:47:13.111 INFO:teuthology.orchestra.run.smithi059.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-30T16:47:13.152 INFO:teuthology.orchestra.run.smithi059.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-30T16:47:13.207 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-30T16:47:13.213 INFO:teuthology.orchestra.run.smithi059.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-30T16:47:13.219 INFO:teuthology.orchestra.run.smithi059.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-30T16:47:13.220 INFO:teuthology.orchestra.run.smithi059.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-30T16:47:13.221 INFO:teuthology.orchestra.run.smithi059.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-30T16:47:13.221 INFO:teuthology.orchestra.run.smithi059.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.12-0ubuntu0.22.04.1 [1,223 kB] 2024-05-30T16:47:13.439 INFO:teuthology.orchestra.run.smithi059.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-30T16:47:13.630 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-30T16:47:13.892 INFO:teuthology.orchestra.run.smithi059.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.12-0ubuntu0.22.04.1 [16.2 MB] 2024-05-30T16:47:14.163 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-05-30T16:47:14.166 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-30T16:47:14.289 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-30T16:47:14.652 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-30T16:47:14.709 INFO:teuthology.orchestra.run.smithi059.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-30T16:47:14.709 INFO:teuthology.orchestra.run.smithi059.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-30T16:47:14.709 INFO:teuthology.orchestra.run.smithi059.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-30T16:47:14.710 INFO:teuthology.orchestra.run.smithi059.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-30T16:47:14.710 INFO:teuthology.orchestra.run.smithi059.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-30T16:47:14.710 INFO:teuthology.orchestra.run.smithi059.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-30T16:47:14.724 INFO:teuthology.orchestra.run.smithi059.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-30T16:47:14.724 INFO:teuthology.orchestra.run.smithi059.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-30T16:47:14.805 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-30T16:47:15.119 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-30T16:47:15.126 INFO:teuthology.orchestra.run.smithi059.stdout:Preconfiguring packages ... 2024-05-30T16:47:15.284 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 55.7 MB in 5s (10.3 MB/s) 2024-05-30T16:47:15.513 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package bison. 2024-05-30T16:47:15.572 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-05-30T16:47:15.575 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-30T16:47:15.585 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-05-30T16:47:15.589 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-30T16:47:15.632 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-30T16:47:15.716 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-30T16:47:16.010 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-30T16:47:16.023 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-30T16:47:16.058 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-30T16:47:16.351 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-30T16:47:16.421 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package dump. 2024-05-30T16:47:16.434 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-30T16:47:16.478 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking dump (0.4b47-3) ... 2024-05-30T16:47:16.757 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package indent. 2024-05-30T16:47:16.771 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-30T16:47:16.815 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-30T16:47:17.068 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-30T16:47:17.082 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-30T16:47:17.118 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-30T16:47:17.430 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-30T16:47:17.445 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-30T16:47:17.473 INFO:teuthology.orchestra.run.smithi059.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-30T16:47:17.488 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-30T16:47:17.711 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package flex. 2024-05-30T16:47:17.766 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-30T16:47:17.781 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-30T16:47:17.785 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-05-30T16:47:17.789 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-30T16:47:17.824 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-30T16:47:17.835 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-30T16:47:18.153 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-30T16:47:18.168 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-30T16:47:18.202 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-30T16:47:18.338 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-30T16:47:18.430 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-30T16:47:18.446 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-30T16:47:18.489 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-30T16:47:18.516 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-30T16:47:18.766 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libjson-perl. 2024-05-30T16:47:18.782 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-30T16:47:18.816 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-30T16:47:18.898 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-30T16:47:19.103 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-30T16:47:19.119 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-30T16:47:19.153 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-30T16:47:19.557 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-05-30T16:47:19.560 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-30T16:47:19.698 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-30T16:47:20.036 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-30T16:47:20.196 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-30T16:47:20.514 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-30T16:47:20.530 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-30T16:47:20.572 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T16:47:20.597 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-30T16:47:20.842 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-30T16:47:20.857 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-30T16:47:20.900 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T16:47:21.134 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package bison. 2024-05-30T16:47:21.134 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-05-30T16:47:21.135 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-30T16:47:21.135 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-30T16:47:21.161 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-30T16:47:21.176 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-30T16:47:21.211 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T16:47:21.433 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-30T16:47:21.448 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-30T16:47:21.492 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-30T16:47:21.522 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-30T16:47:21.538 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-30T16:47:21.581 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-30T16:47:21.819 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package dump. 2024-05-30T16:47:21.835 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-30T16:47:21.902 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking dump (0.4b47-3) ... 2024-05-30T16:47:21.933 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-30T16:47:21.948 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-30T16:47:21.991 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-30T16:47:22.239 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package indent. 2024-05-30T16:47:22.256 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-30T16:47:22.289 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-30T16:47:22.303 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-30T16:47:22.319 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../16-libpq5_14.12-0ubuntu0.22.04.1_amd64.deb ... 2024-05-30T16:47:22.353 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libpq5:amd64 (14.12-0ubuntu0.22.04.1) ... 2024-05-30T16:47:22.542 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-30T16:47:22.558 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-30T16:47:22.600 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-30T16:47:22.672 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-30T16:47:22.687 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-30T16:47:22.730 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T16:47:22.921 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-30T16:47:22.937 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-30T16:47:22.979 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-30T16:47:23.009 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-30T16:47:23.023 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-30T16:47:23.232 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-30T16:47:23.243 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T16:47:23.248 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-30T16:47:23.315 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-30T16:47:23.486 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-30T16:47:23.501 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-30T16:47:23.535 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-30T16:47:23.660 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-30T16:47:23.676 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-30T16:47:23.718 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-30T16:47:23.980 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-30T16:47:23.996 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-30T16:47:24.006 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-30T16:47:24.020 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-30T16:47:24.037 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-30T16:47:24.064 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-30T16:47:24.290 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libjson-perl. 2024-05-30T16:47:24.307 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-30T16:47:24.348 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-30T16:47:24.392 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package modemmanager. 2024-05-30T16:47:24.409 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-30T16:47:24.451 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T16:47:24.668 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-30T16:47:24.684 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-30T16:47:24.751 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-30T16:47:25.032 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package network-manager. 2024-05-30T16:47:25.048 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-30T16:47:25.090 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-30T16:47:26.079 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-30T16:47:26.096 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-30T16:47:26.123 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ppp. 2024-05-30T16:47:26.139 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-30T16:47:26.163 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T16:47:26.424 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-30T16:47:26.440 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-30T16:47:26.482 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T16:47:26.545 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-30T16:47:26.768 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-30T16:47:26.784 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-30T16:47:26.826 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T16:47:26.878 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package pptp-linux. 2024-05-30T16:47:26.892 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-30T16:47:26.936 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-30T16:47:27.129 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-30T16:47:27.146 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-30T16:47:27.180 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-30T16:47:27.187 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-30T16:47:27.195 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-30T16:47:27.239 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-30T16:47:27.515 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-30T16:47:27.531 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-30T16:47:27.533 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-30T16:47:27.548 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-30T16:47:27.583 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql-client-common (238) ... 2024-05-30T16:47:27.590 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-30T16:47:27.912 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-30T16:47:27.927 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../27-postgresql-client-14_14.12-0ubuntu0.22.04.1_amd64.deb ... 2024-05-30T16:47:27.934 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-30T16:47:27.951 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../16-libpq5_14.12-0ubuntu0.22.04.1_amd64.deb ... 2024-05-30T16:47:27.970 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql-client-14 (14.12-0ubuntu0.22.04.1) ... 2024-05-30T16:47:27.993 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libpq5:amd64 (14.12-0ubuntu0.22.04.1) ... 2024-05-30T16:47:28.287 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-30T16:47:28.304 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-30T16:47:28.345 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T16:47:28.525 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql-common. 2024-05-30T16:47:28.540 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-30T16:47:28.592 INFO:teuthology.orchestra.run.smithi107.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-30T16:47:28.623 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-30T16:47:28.632 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql-common (238) ... 2024-05-30T16:47:28.639 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-30T16:47:28.673 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T16:47:28.917 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-30T16:47:28.934 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-30T16:47:28.992 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-30T16:47:29.116 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql-14. 2024-05-30T16:47:29.130 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../29-postgresql-14_14.12-0ubuntu0.22.04.1_amd64.deb ... 2024-05-30T16:47:29.176 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql-14 (14.12-0ubuntu0.22.04.1) ... 2024-05-30T16:47:29.496 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-30T16:47:29.511 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-30T16:47:29.546 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-30T16:47:29.866 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package modemmanager. 2024-05-30T16:47:29.882 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-30T16:47:29.924 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T16:47:30.304 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql. 2024-05-30T16:47:30.319 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-30T16:47:30.354 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql (14+238) ... 2024-05-30T16:47:30.539 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package network-manager. 2024-05-30T16:47:30.556 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-30T16:47:30.589 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql-client. 2024-05-30T16:47:30.597 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-30T16:47:30.604 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-30T16:47:30.648 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql-client (14+238) ... 2024-05-30T16:47:30.900 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-30T16:47:30.915 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-30T16:47:30.958 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-30T16:47:31.213 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ppp. 2024-05-30T16:47:31.229 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-30T16:47:31.286 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package tcl8.6. 2024-05-30T16:47:31.301 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-30T16:47:31.336 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-30T16:47:31.574 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package tcl. 2024-05-30T16:47:31.574 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-30T16:47:31.587 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-30T16:47:31.625 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-30T16:47:31.909 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package pptp-linux. 2024-05-30T16:47:31.924 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-30T16:47:31.967 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-30T16:47:31.991 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package wpasupplicant. 2024-05-30T16:47:32.007 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-30T16:47:32.049 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-30T16:47:32.220 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-30T16:47:32.235 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-30T16:47:32.278 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-30T16:47:32.387 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-30T16:47:32.403 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-30T16:47:32.445 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-30T16:47:32.564 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-30T16:47:32.580 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-30T16:47:32.614 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql-client-common (238) ... 2024-05-30T16:47:32.823 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-30T16:47:32.839 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-30T16:47:32.889 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-30T16:47:32.918 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-30T16:47:32.934 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../27-postgresql-client-14_14.12-0ubuntu0.22.04.1_amd64.deb ... 2024-05-30T16:47:32.976 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql-client-14 (14.12-0ubuntu0.22.04.1) ... 2024-05-30T16:47:33.192 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql-client-common (238) ... 2024-05-30T16:47:33.404 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-30T16:47:33.530 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-30T16:47:33.589 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql-common. 2024-05-30T16:47:33.605 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-30T16:47:33.648 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libpq5:amd64 (14.12-0ubuntu0.22.04.1) ... 2024-05-30T16:47:33.667 INFO:teuthology.orchestra.run.smithi059.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-30T16:47:33.688 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql-common (238) ... 2024-05-30T16:47:33.757 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-30T16:47:33.866 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-30T16:47:33.993 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql-client-14 (14.12-0ubuntu0.22.04.1) ... 2024-05-30T16:47:34.104 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql-14. 2024-05-30T16:47:34.120 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../29-postgresql-14_14.12-0ubuntu0.22.04.1_amd64.deb ... 2024-05-30T16:47:34.157 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql-14 (14.12-0ubuntu0.22.04.1) ... 2024-05-30T16:47:34.950 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-30T16:47:35.040 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-30T16:47:35.383 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-30T16:47:35.383 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-30T16:47:35.674 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql. 2024-05-30T16:47:35.689 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-30T16:47:35.732 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql (14+238) ... 2024-05-30T16:47:36.001 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql-client. 2024-05-30T16:47:36.016 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-30T16:47:36.059 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql-client (14+238) ... 2024-05-30T16:47:36.067 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-30T16:47:36.210 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-30T16:47:36.278 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-30T16:47:36.293 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-30T16:47:36.327 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-30T16:47:36.361 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-30T16:47:36.513 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-30T16:47:36.639 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package tcl8.6. 2024-05-30T16:47:36.654 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-30T16:47:36.664 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-30T16:47:36.697 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-30T16:47:36.815 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-30T16:47:36.966 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-30T16:47:36.983 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package tcl. 2024-05-30T16:47:36.999 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-30T16:47:37.117 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-30T16:47:37.419 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package wpasupplicant. 2024-05-30T16:47:37.435 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-30T16:47:37.477 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-30T16:47:37.789 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-30T16:47:37.806 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-30T16:47:37.848 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-30T16:47:37.906 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-30T16:47:38.057 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up dump (0.4b47-3) ... 2024-05-30T16:47:38.152 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-30T16:47:38.226 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-30T16:47:38.233 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T16:47:38.242 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-30T16:47:38.292 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-30T16:47:38.359 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-30T16:47:38.544 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-30T16:47:38.587 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql-client-common (238) ... 2024-05-30T16:47:38.695 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-30T16:47:38.821 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-30T16:47:38.865 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-30T16:47:38.910 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-30T16:47:38.981 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-30T16:47:39.007 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-30T16:47:39.090 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-30T16:47:39.134 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libpq5:amd64 (14.12-0ubuntu0.22.04.1) ... 2024-05-30T16:47:39.241 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-30T16:47:39.268 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-30T16:47:39.367 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T16:47:39.427 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-30T16:47:39.493 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-30T16:47:39.578 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql-client-14 (14.12-0ubuntu0.22.04.1) ... 2024-05-30T16:47:39.661 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql-client (14+238) ... 2024-05-30T16:47:39.795 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-30T16:47:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:47:40.419 INFO:teuthology.orchestra.run.smithi107.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-30T16:47:40.419 INFO:teuthology.orchestra.run.smithi107.stdout:which means they are currently configured by ifupdown: 2024-05-30T16:47:40.419 INFO:teuthology.orchestra.run.smithi107.stdout:- enp3s0f1 2024-05-30T16:47:40.419 INFO:teuthology.orchestra.run.smithi107.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-30T16:47:40.419 INFO:teuthology.orchestra.run.smithi107.stdout:remove their configuration from /etc/network/interfaces. 2024-05-30T16:47:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:47:40.550 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-30T16:47:40.575 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-30T16:47:40.692 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-30T16:47:40.966 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-30T16:47:41.128 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-30T16:47:41.128 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-30T16:47:41.411 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-30T16:47:41.887 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-30T16:47:42.040 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-30T16:47:42.106 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T16:47:42.199 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-30T16:47:42.224 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-30T16:47:42.333 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-30T16:47:42.350 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-30T16:47:42.459 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-30T16:47:42.485 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql-common (238) ... 2024-05-30T16:47:42.702 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-30T16:47:42.853 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-30T16:47:43.004 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-30T16:47:43.363 INFO:teuthology.orchestra.run.smithi107.stdout:Adding user postgres to group ssl-cert 2024-05-30T16:47:43.610 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:47:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-30T16:47:43.826 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-30T16:47:43.859 INFO:teuthology.orchestra.run.smithi107.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-30T16:47:43.859 INFO:teuthology.orchestra.run.smithi107.stdout:Removing obsolete dictionary files: 2024-05-30T16:47:43.960 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up dump (0.4b47-3) ... 2024-05-30T16:47:44.073 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-30T16:47:44.145 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T16:47:44.296 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-30T16:47:44.447 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-30T16:47:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-30T16:47:44.640 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-30T16:47:44.791 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-30T16:47:44.897 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-30T16:47:44.967 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-30T16:47:45.069 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql-14 (14.12-0ubuntu0.22.04.1) ... 2024-05-30T16:47:45.102 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-30T16:47:45.311 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-30T16:47:45.429 INFO:teuthology.orchestra.run.smithi107.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-30T16:47:45.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-30T16:47:45.462 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T16:47:45.495 INFO:teuthology.orchestra.run.smithi107.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-30T16:47:45.495 INFO:teuthology.orchestra.run.smithi107.stdout:This user must also own the server process. 2024-05-30T16:47:45.495 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:47:45.495 INFO:teuthology.orchestra.run.smithi107.stdout:The database cluster will be initialized with locale "en_US". 2024-05-30T16:47:45.495 INFO:teuthology.orchestra.run.smithi107.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-30T16:47:45.495 INFO:teuthology.orchestra.run.smithi107.stdout:The default text search configuration will be set to "english". 2024-05-30T16:47:45.495 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:47:45.495 INFO:teuthology.orchestra.run.smithi107.stdout:Data page checksums are disabled. 2024-05-30T16:47:45.495 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:47:45.496 INFO:teuthology.orchestra.run.smithi107.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-30T16:47:45.496 INFO:teuthology.orchestra.run.smithi107.stdout:creating subdirectories ... ok 2024-05-30T16:47:45.496 INFO:teuthology.orchestra.run.smithi107.stdout:selecting dynamic shared memory implementation ... posix 2024-05-30T16:47:45.520 INFO:teuthology.orchestra.run.smithi107.stdout:selecting default max_connections ... 100 2024-05-30T16:47:45.554 INFO:teuthology.orchestra.run.smithi107.stdout:selecting default shared_buffers ... 128MB 2024-05-30T16:47:45.569 INFO:teuthology.orchestra.run.smithi107.stdout:selecting default time zone ... Etc/UTC 2024-05-30T16:47:45.570 INFO:teuthology.orchestra.run.smithi107.stdout:creating configuration files ... ok 2024-05-30T16:47:45.613 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-30T16:47:45.735 INFO:teuthology.orchestra.run.smithi107.stdout:running bootstrap script ... ok 2024-05-30T16:47:45.806 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql-client (14+238) ... 2024-05-30T16:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-30T16:47:46.356 INFO:teuthology.orchestra.run.smithi107.stdout:performing post-bootstrap initialization ... ok 2024-05-30T16:47:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:47:46.637 INFO:teuthology.orchestra.run.smithi059.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-30T16:47:46.637 INFO:teuthology.orchestra.run.smithi059.stdout:which means they are currently configured by ifupdown: 2024-05-30T16:47:46.637 INFO:teuthology.orchestra.run.smithi059.stdout:- ens1f0 2024-05-30T16:47:46.638 INFO:teuthology.orchestra.run.smithi059.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-30T16:47:46.638 INFO:teuthology.orchestra.run.smithi059.stdout:remove their configuration from /etc/network/interfaces. 2024-05-30T16:47:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:47:46.777 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-30T16:47:46.958 INFO:teuthology.orchestra.run.smithi107.stdout:syncing data to disk ... ok 2024-05-30T16:47:47.201 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-30T16:47:47.462 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-30T16:47:47.634 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-30T16:47:48.360 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T16:47:48.537 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-30T16:47:48.687 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-30T16:47:48.855 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql-common (238) ... 2024-05-30T16:47:49.831 INFO:teuthology.orchestra.run.smithi059.stdout:Adding user postgres to group ssl-cert 2024-05-30T16:47:50.054 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:47:50.054 INFO:teuthology.orchestra.run.smithi059.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-30T16:47:50.317 INFO:teuthology.orchestra.run.smithi059.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-30T16:47:50.317 INFO:teuthology.orchestra.run.smithi059.stdout:Removing obsolete dictionary files: 2024-05-30T16:47:50.517 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T16:47:50.643 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-30T16:47:50.769 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql (14+238) ... 2024-05-30T16:47:50.895 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T16:47:51.021 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T16:47:51.056 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-30T16:47:51.289 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-30T16:47:51.290 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-30T16:47:51.723 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql-14 (14.12-0ubuntu0.22.04.1) ... 2024-05-30T16:47:52.040 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-30T16:47:52.123 INFO:teuthology.orchestra.run.smithi059.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-30T16:47:52.124 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-30T16:47:52.141 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-30T16:47:52.188 INFO:teuthology.orchestra.run.smithi059.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-30T16:47:52.188 INFO:teuthology.orchestra.run.smithi059.stdout:This user must also own the server process. 2024-05-30T16:47:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:47:52.188 INFO:teuthology.orchestra.run.smithi059.stdout:The database cluster will be initialized with locale "en_US". 2024-05-30T16:47:52.188 INFO:teuthology.orchestra.run.smithi059.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-30T16:47:52.188 INFO:teuthology.orchestra.run.smithi059.stdout:The default text search configuration will be set to "english". 2024-05-30T16:47:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:47:52.188 INFO:teuthology.orchestra.run.smithi059.stdout:Data page checksums are disabled. 2024-05-30T16:47:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:47:52.188 INFO:teuthology.orchestra.run.smithi059.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-30T16:47:52.189 INFO:teuthology.orchestra.run.smithi059.stdout:creating subdirectories ... ok 2024-05-30T16:47:52.189 INFO:teuthology.orchestra.run.smithi059.stdout:selecting dynamic shared memory implementation ... posix 2024-05-30T16:47:52.213 INFO:teuthology.orchestra.run.smithi059.stdout:selecting default max_connections ... 100 2024-05-30T16:47:52.248 INFO:teuthology.orchestra.run.smithi059.stdout:selecting default shared_buffers ... 128MB 2024-05-30T16:47:52.263 INFO:teuthology.orchestra.run.smithi059.stdout:selecting default time zone ... Etc/UTC 2024-05-30T16:47:52.263 INFO:teuthology.orchestra.run.smithi059.stdout:creating configuration files ... ok 2024-05-30T16:47:52.426 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-30T16:47:52.438 INFO:teuthology.orchestra.run.smithi059.stdout:running bootstrap script ... ok 2024-05-30T16:47:52.611 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-30T16:47:53.060 INFO:teuthology.orchestra.run.smithi059.stdout:performing post-bootstrap initialization ... ok 2024-05-30T16:47:53.625 INFO:teuthology.orchestra.run.smithi059.stdout:syncing data to disk ... ok 2024-05-30T16:47:53.997 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-30T16:47:54.089 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-30T16:47:54.173 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-30T16:47:54.605 INFO:teuthology.orchestra.run.smithi107.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-30T16:47:54.613 DEBUG:teuthology.parallel:result is None 2024-05-30T16:47:57.280 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T16:47:57.473 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-30T16:47:57.624 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql (14+238) ... 2024-05-30T16:47:57.749 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T16:47:57.884 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T16:47:58.169 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-30T16:47:58.169 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-30T16:47:58.928 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-30T16:47:59.045 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-30T16:47:59.389 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-30T16:47:59.541 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-30T16:48:00.926 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-30T16:48:01.043 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-30T16:48:01.622 INFO:teuthology.orchestra.run.smithi059.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-30T16:48:01.629 DEBUG:teuthology.parallel:result is None 2024-05-30T16:48:01.630 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T16:48:01.775 DEBUG:teuthology.orchestra.run.smithi059:> dpkg-query -W -f '${Version}' ceph 2024-05-30T16:48:01.797 INFO:teuthology.orchestra.run.smithi059.stdout:19.0.0-3154-g9ed025fb-1jammy 2024-05-30T16:48:01.798 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154-g9ed025fb-1jammy 2024-05-30T16:48:01.798 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154-g9ed025fb-1jammy is installed. 2024-05-30T16:48:01.800 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T16:48:02.017 DEBUG:teuthology.orchestra.run.smithi107:> dpkg-query -W -f '${Version}' ceph 2024-05-30T16:48:02.041 INFO:teuthology.orchestra.run.smithi107.stdout:19.0.0-3154-g9ed025fb-1jammy 2024-05-30T16:48:02.041 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154-g9ed025fb-1jammy 2024-05-30T16:48:02.041 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154-g9ed025fb-1jammy is installed. 2024-05-30T16:48:02.043 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-30T16:48:02.043 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:02.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-30T16:48:02.063 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:02.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-30T16:48:02.108 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-30T16:48:02.135 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:02.135 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-05-30T16:48:02.155 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-30T16:48:02.221 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:02.221 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-05-30T16:48:02.241 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-30T16:48:02.302 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-30T16:48:02.302 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:02.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-30T16:48:02.322 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-30T16:48:02.385 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:02.385 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-30T16:48:02.405 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-30T16:48:02.466 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-30T16:48:02.466 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:02.466 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-05-30T16:48:02.486 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-30T16:48:02.553 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:02.554 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-05-30T16:48:02.574 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-30T16:48:02.642 INFO:teuthology.run_tasks:Running task ceph... 2024-05-30T16:48:02.721 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-30T16:48:02.721 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2024-05-30T16:48:02.724 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-05-30T16:48:02.744 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-30T16:48:02.744 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-30T16:48:02.789 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-30T16:48:02.810 INFO:tasks.ceph:Creating extra log directories... 2024-05-30T16:48:02.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-30T16:48:02.849 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-30T16:48:02.880 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-30T16:48:02.881 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-30T16:48:02.881 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-30T16:48:02.881 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:02.881 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-30T16:48:02.922 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-30T16:48:03.020 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:03.020 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-30T16:48:03.029 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-30T16:48:03.128 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-30T16:48:03.129 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-30T16:48:03.129 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145', 'branch': 'rishabh-clone-stats', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}}', 'email': None, 'first_in_suite': False, 'job_id': '7734145', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-clone-stats'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-clone-stats', 'sha1': '019a0d1fdedb1237f85e8a3711761fae4e094286'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3537, 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-clone-stats', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '019a0d1fdedb1237f85e8a3711761fae4e094286', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBApOi4fetpPdO198zdHnJ4fAOWsVtQrijUbE6v+WXLau1v2Gq/+87uE8ckA0UVTklK8hmdRHrrQcAJIbZ0we7WI=', 'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyOjsk0R9+cVEpkEzG36pbb4mXPnHoql4zG5mYHDwd/lzYEhCYv/rmU7yepgHjsoR+nkrlu02cR2GPP+JK6HC8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestCloneProgressReporter']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e1979f064b0becde2020282c7e87cf3c5e98026c', 'timestamp': '2024-05-30_16:11:34', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-05-30T16:48:03.129 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-30T16:48:03.133 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-30T16:48:03.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2024-05-30T16:48:03.189 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-05-30T16:48:03.209 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:03.209 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-05-30T16:48:03.259 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-30T16:48:03.259 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-05-30T16:48:03.312 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-30T16:48:03.312 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:48:03.312 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 901 Links: 1 2024-05-30T16:48:03.312 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:48:03.312 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-05-30 16:41:33.570101599 +0000 2024-05-30T16:48:03.313 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-05-30 16:41:33.278104208 +0000 2024-05-30T16:48:03.313 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-05-30 16:41:33.278104208 +0000 2024-05-30T16:48:03.313 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-05-30 16:41:33.278104208 +0000 2024-05-30T16:48:03.313 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-30T16:48:03.373 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-05-30T16:48:03.373 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-05-30T16:48:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000388475 s, 1.3 MB/s 2024-05-30T16:48:03.376 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-30T16:48:03.429 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-05-30T16:48:03.479 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-30T16:48:03.479 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:48:03.479 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 917 Links: 1 2024-05-30T16:48:03.479 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:48:03.479 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-05-30 16:41:34.142096490 +0000 2024-05-30T16:48:03.479 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-05-30 16:41:33.890098741 +0000 2024-05-30T16:48:03.479 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-05-30 16:41:33.890098741 +0000 2024-05-30T16:48:03.479 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-05-30 16:41:33.890098741 +0000 2024-05-30T16:48:03.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-30T16:48:03.541 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-05-30T16:48:03.541 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-05-30T16:48:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000373828 s, 1.4 MB/s 2024-05-30T16:48:03.543 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-30T16:48:03.601 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-05-30T16:48:03.651 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-30T16:48:03.651 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:48:03.651 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 935 Links: 1 2024-05-30T16:48:03.651 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:48:03.651 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-05-30 16:41:34.730091238 +0000 2024-05-30T16:48:03.651 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-05-30 16:41:34.454093703 +0000 2024-05-30T16:48:03.651 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-05-30 16:41:34.454093703 +0000 2024-05-30T16:48:03.652 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-05-30 16:41:34.454093703 +0000 2024-05-30T16:48:03.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-30T16:48:03.714 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-05-30T16:48:03.714 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-05-30T16:48:03.714 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000373123 s, 1.4 MB/s 2024-05-30T16:48:03.716 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-30T16:48:03.773 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-05-30T16:48:03.823 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-30T16:48:03.823 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:48:03.823 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 951 Links: 1 2024-05-30T16:48:03.823 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:48:03.823 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-05-30 16:41:35.334085843 +0000 2024-05-30T16:48:03.823 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-05-30 16:41:35.058088308 +0000 2024-05-30T16:48:03.823 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-05-30 16:41:35.058088308 +0000 2024-05-30T16:48:03.824 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-05-30 16:41:35.058088308 +0000 2024-05-30T16:48:03.824 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-30T16:48:03.885 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-05-30T16:48:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-05-30T16:48:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000393871 s, 1.3 MB/s 2024-05-30T16:48:03.888 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-30T16:48:03.941 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T16:48:03.941 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:03.941 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-05-30T16:48:03.950 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-30T16:48:03.950 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-05-30T16:48:04.003 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-30T16:48:04.003 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:48:04.003 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 891 Links: 1 2024-05-30T16:48:04.003 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:48:04.003 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-30 16:41:30.258833417 +0000 2024-05-30T16:48:04.004 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-30 16:41:29.990835810 +0000 2024-05-30T16:48:04.004 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-30 16:41:29.990835810 +0000 2024-05-30T16:48:04.004 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-30 16:41:29.990835810 +0000 2024-05-30T16:48:04.004 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-30T16:48:04.065 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-30T16:48:04.065 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-30T16:48:04.065 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000397532 s, 1.3 MB/s 2024-05-30T16:48:04.067 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-30T16:48:04.125 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-05-30T16:48:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-30T16:48:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:48:04.179 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 910 Links: 1 2024-05-30T16:48:04.179 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:48:04.179 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-30 16:41:30.850828129 +0000 2024-05-30T16:48:04.179 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-30 16:41:30.582830521 +0000 2024-05-30T16:48:04.180 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-30 16:41:30.582830521 +0000 2024-05-30T16:48:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-30 16:41:30.582830521 +0000 2024-05-30T16:48:04.180 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-30T16:48:04.244 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-30T16:48:04.245 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-30T16:48:04.245 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.00039522 s, 1.3 MB/s 2024-05-30T16:48:04.247 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-30T16:48:04.304 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-05-30T16:48:04.359 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-30T16:48:04.359 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:48:04.359 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 925 Links: 1 2024-05-30T16:48:04.359 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:48:04.359 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-30 16:41:31.426822984 +0000 2024-05-30T16:48:04.360 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-30 16:41:31.158825377 +0000 2024-05-30T16:48:04.360 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-30 16:41:31.158825377 +0000 2024-05-30T16:48:04.360 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-30 16:41:31.158825377 +0000 2024-05-30T16:48:04.360 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-30T16:48:04.420 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-30T16:48:04.421 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-30T16:48:04.421 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000384438 s, 1.3 MB/s 2024-05-30T16:48:04.423 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-30T16:48:04.477 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-05-30T16:48:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-30T16:48:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:48:04.527 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 944 Links: 1 2024-05-30T16:48:04.527 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:48:04.527 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-30 16:41:31.994817910 +0000 2024-05-30T16:48:04.527 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-30 16:41:31.718820376 +0000 2024-05-30T16:48:04.527 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-30 16:41:31.718820376 +0000 2024-05-30T16:48:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-30 16:41:31.718820376 +0000 2024-05-30T16:48:04.527 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-30T16:48:04.589 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-30T16:48:04.589 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-30T16:48:04.590 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000668916 s, 765 kB/s 2024-05-30T16:48:04.591 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-30T16:48:04.645 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T16:48:04.645 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-30T16:48:04.645 INFO:tasks.ceph:Generating config... 2024-05-30T16:48:04.646 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-30T16:48:04.647 INFO:tasks.ceph:[client] debug client = 20 2024-05-30T16:48:04.647 INFO:tasks.ceph:[client] debug ms = 1 2024-05-30T16:48:04.647 INFO:tasks.ceph:[client] pid file = 2024-05-30T16:48:04.647 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-30T16:48:04.647 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-30T16:48:04.647 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-30T16:48:04.647 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-30T16:48:04.647 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-30T16:48:04.647 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-30T16:48:04.647 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-30T16:48:04.647 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-30T16:48:04.647 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-30T16:48:04.648 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-30T16:48:04.648 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-30T16:48:04.648 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-30T16:48:04.648 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-30T16:48:04.648 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-05-30T16:48:04.648 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-30T16:48:04.648 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-30T16:48:04.648 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-30T16:48:04.648 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-30T16:48:04.648 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-30T16:48:04.648 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-30T16:48:04.648 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-30T16:48:04.648 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-30T16:48:04.648 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-30T16:48:04.649 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-30T16:48:04.650 INFO:tasks.ceph:Setting up mon.a... 2024-05-30T16:48:04.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-30T16:48:04.697 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.keyring 2024-05-30T16:48:04.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-30T16:48:04.803 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-30T16:48:04.823 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.59'), ('mon.b', '172.21.15.107'), ('mon.c', '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]')] 2024-05-30T16:48:04.824 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.59,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-30T16:48:04.825 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:04.825 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-30T16:48:04.874 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.59 --add b 172.21.15.107 --addv c '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:04.962 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:04.962 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: generated fsid 97857630-028c-48a2-897f-bf5f996be133 2024-05-30T16:48:04.962 INFO:teuthology.orchestra.run.smithi059.stdout:setting min_mon_release = quincy 2024-05-30T16:48:04.963 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 0 2024-05-30T16:48:04.963 INFO:teuthology.orchestra.run.smithi059.stdout:fsid 97857630-028c-48a2-897f-bf5f996be133 2024-05-30T16:48:04.963 INFO:teuthology.orchestra.run.smithi059.stdout:last_changed 2024-05-30T16:48:04.962007+0000 2024-05-30T16:48:04.963 INFO:teuthology.orchestra.run.smithi059.stdout:created 2024-05-30T16:48:04.962007+0000 2024-05-30T16:48:04.963 INFO:teuthology.orchestra.run.smithi059.stdout:min_mon_release 17 (quincy) 2024-05-30T16:48:04.963 INFO:teuthology.orchestra.run.smithi059.stdout:election_strategy: 1 2024-05-30T16:48:04.963 INFO:teuthology.orchestra.run.smithi059.stdout:0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-05-30T16:48:04.963 INFO:teuthology.orchestra.run.smithi059.stdout:1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.b 2024-05-30T16:48:04.963 INFO:teuthology.orchestra.run.smithi059.stdout:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-05-30T16:48:04.963 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-30T16:48:04.966 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-30T16:48:04.974 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 97857630-028c-48a2-897f-bf5f996be133... 2024-05-30T16:48:04.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-30T16:48:05.021 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-30T16:48:05.061 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-05-30T16:48:05.062 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2024-05-30T16:48:05.062 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-30T16:48:05.062 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2024-05-30T16:48:05.062 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.062 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2024-05-30T16:48:05.062 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.062 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2024-05-30T16:48:05.062 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.062 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2024-05-30T16:48:05.062 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2024-05-30T16:48:05.062 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.062 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2024-05-30T16:48:05.063 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2024-05-30T16:48:05.063 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.063 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-30T16:48:05.063 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2024-05-30T16:48:05.063 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.063 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2024-05-30T16:48:05.063 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-30T16:48:05.063 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.063 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2024-05-30T16:48:05.063 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.063 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2024-05-30T16:48:05.063 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2024-05-30T16:48:05.064 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.065 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2024-05-30T16:48:05.065 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.065 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2024-05-30T16:48:05.065 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2024-05-30T16:48:05.065 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2024-05-30T16:48:05.065 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]" 2024-05-30T16:48:05.065 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 97857630-028c-48a2-897f-bf5f996be133 2024-05-30T16:48:05.065 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.065 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2024-05-30T16:48:05.065 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2024-05-30T16:48:05.065 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.065 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2024-05-30T16:48:05.066 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2024-05-30T16:48:05.066 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2024-05-30T16:48:05.066 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.066 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2024-05-30T16:48:05.066 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2024-05-30T16:48:05.066 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.066 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2024-05-30T16:48:05.066 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2024-05-30T16:48:05.066 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2024-05-30T16:48:05.066 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug trim objects = true 2024-05-30T16:48:05.066 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.066 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2024-05-30T16:48:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: bdev async discard = True 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: bdev enable discard = True 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore allocator = bitmap 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 1/20 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 1/20 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 4/10 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2024-05-30T16:48:05.068 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2024-05-30T16:48:05.069 INFO:teuthology.orchestra.run.smithi059.stdout: debug finisher = 20 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: mon down mkfs grace = 300 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2024-05-30T16:48:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = "" 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2024-05-30T16:48:05.072 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds balancer = 20 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2024-05-30T16:48:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-05-30T16:48:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-05-30T16:48:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-05-30T16:48:05.074 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-05-30T16:48:05.074 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-05-30T16:48:05.074 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-30T16:48:05.074 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-05-30T16:48:05.074 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.075 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-05-30T16:48:05.076 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.59,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]" 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 97857630-028c-48a2-897f-bf5f996be133 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-05-30T16:48:05.077 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug trim objects = true 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-05-30T16:48:05.078 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2024-05-30T16:48:05.079 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = bitmap 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-05-30T16:48:05.080 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: debug finisher = 20 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-05-30T16:48:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-05-30T16:48:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-05-30T16:48:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-05-30T16:48:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-05-30T16:48:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-05-30T16:48:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-05-30T16:48:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-05-30T16:48:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-05-30T16:48:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-30T16:48:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-05-30T16:48:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-05-30T16:48:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: mon down mkfs grace = 300 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: mon op complaint time = 120 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-05-30T16:48:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: client mount timeout = 600 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = "" 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout:[mds] 2024-05-30T16:48:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds = 20 2024-05-30T16:48:05.085 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds balancer = 20 2024-05-30T16:48:05.085 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-30T16:48:05.085 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug frag = True 2024-05-30T16:48:05.085 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug scatterstat = True 2024-05-30T16:48:05.085 INFO:teuthology.orchestra.run.smithi107.stdout: mds op complaint time = 180 2024-05-30T16:48:05.085 INFO:teuthology.orchestra.run.smithi107.stdout: mds verify scatter = True 2024-05-30T16:48:05.085 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-05-30T16:48:05.085 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-05-30T16:48:05.085 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-05-30T16:48:05.086 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-30T16:48:05.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-30T16:48:05.192 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-30T16:48:05.192 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:05.192 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-30T16:48:05.201 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:05.201 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-30T16:48:05.254 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T16:48:05.254 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:05.254 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-30T16:48:05.254 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-30T16:48:05.325 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:05.326 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:05.374 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T16:48:05.374 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:05.374 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-30T16:48:05.374 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-30T16:48:05.409 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:05.409 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:05.458 INFO:tasks.ceph:Setting up mon nodes... 2024-05-30T16:48:05.459 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-30T16:48:05.459 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-30T16:48:05.515 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-30T16:48:05.520 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-30T16:48:05.580 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-30T16:48:05.595 INFO:tasks.ceph:Setting up mds nodes... 2024-05-30T16:48:05.595 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-30T16:48:05.651 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-30T16:48:05.656 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-30T16:48:05.676 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-30T16:48:05.777 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-30T16:48:05.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-30T16:48:05.801 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-30T16:48:05.859 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-30T16:48:05.864 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-30T16:48:05.885 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-30T16:48:05.984 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-30T16:48:05.988 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-30T16:48:06.008 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-30T16:48:06.008 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-30T16:48:06.051 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-30T16:48:06.068 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-30T16:48:06.156 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-30T16:48:06.172 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-30T16:48:06.213 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-30T16:48:06.230 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-30T16:48:06.314 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-30T16:48:06.331 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-30T16:48:06.331 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-30T16:48:06.331 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-30T16:48:06.351 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T16:48:06.351 INFO:tasks.ceph:role: osd.0 2024-05-30T16:48:06.351 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T16:48:06.351 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-30T16:48:06.425 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:48:06.426 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:48:06.426 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:48:06.426 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T16:48:06.426 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:48:06.426 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:48:06.426 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:48:06.426 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T16:48:06.426 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:48:06.426 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:48:06.837 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-05-30T16:48:06.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-05-30T16:48:06.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-30T16:48:06.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-30T16:48:06.995 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T16:48:06.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:48:06.996 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-30T16:48:07.058 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T16:48:07.058 INFO:tasks.ceph:role: osd.1 2024-05-30T16:48:07.058 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T16:48:07.058 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-30T16:48:07.133 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:48:07.133 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:48:07.133 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:48:07.133 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T16:48:07.134 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:48:07.134 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:48:07.134 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:48:07.134 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T16:48:07.134 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:48:07.134 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:48:07.491 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-05-30T16:48:07.494 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-05-30T16:48:07.494 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-30T16:48:07.567 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-30T16:48:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T16:48:07.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:48:07.629 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-30T16:48:07.691 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T16:48:07.691 INFO:tasks.ceph:role: osd.2 2024-05-30T16:48:07.691 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T16:48:07.691 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-30T16:48:07.766 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:48:07.766 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:48:07.767 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:48:07.767 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T16:48:07.767 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:48:07.767 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:48:07.767 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:48:07.767 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T16:48:07.767 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:48:07.767 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:48:08.160 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-05-30T16:48:08.162 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-05-30T16:48:08.163 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-30T16:48:08.266 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-30T16:48:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T16:48:08.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:48:08.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-30T16:48:08.352 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T16:48:08.352 INFO:tasks.ceph:role: osd.3 2024-05-30T16:48:08.352 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T16:48:08.352 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-30T16:48:08.423 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:48:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:48:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:48:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T16:48:08.423 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:48:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:48:08.424 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:48:08.424 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T16:48:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:48:08.424 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:48:08.844 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-05-30T16:48:08.847 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-05-30T16:48:08.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-30T16:48:08.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-30T16:48:08.982 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T16:48:08.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:48:08.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:09.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:09.110+0000 7f2ff242b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-30T16:48:09.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:09.114+0000 7f2ff242b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-30T16:48:09.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:09.114+0000 7f2ff242b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-30T16:48:09.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:09.114+0000 7f2ff242b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-30T16:48:09.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:09.114+0000 7f2ff242b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-30T16:48:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:09.122+0000 7f2ff242b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-30T16:48:12.175 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-30T16:48:12.197 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:12.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:12.286+0000 7f2497ae87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-30T16:48:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:12.290+0000 7f2497ae87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-30T16:48:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:12.290+0000 7f2497ae87c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-30T16:48:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:12.290+0000 7f2497ae87c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-30T16:48:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:12.290+0000 7f2497ae87c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-30T16:48:12.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:12.290+0000 7f2497ae87c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-30T16:48:15.330 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-30T16:48:15.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:15.442+0000 7f333782c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-30T16:48:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:15.442+0000 7f333782c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-30T16:48:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:15.442+0000 7f333782c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-30T16:48:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:15.442+0000 7f333782c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-30T16:48:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:15.442+0000 7f333782c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-30T16:48:15.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:15.446+0000 7f333782c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-30T16:48:18.539 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-30T16:48:18.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:18.650+0000 7f2707b6e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-30T16:48:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:18.650+0000 7f2707b6e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-30T16:48:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:18.650+0000 7f2707b6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-30T16:48:18.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:18.650+0000 7f2707b6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-30T16:48:18.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:18.650+0000 7f2707b6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-30T16:48:18.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:18.650+0000 7f2707b6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-30T16:48:21.677 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-30T16:48:21.698 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-30T16:48:21.720 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T16:48:21.720 INFO:tasks.ceph:role: osd.4 2024-05-30T16:48:21.720 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T16:48:21.720 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-30T16:48:21.790 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:48:21.790 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:48:21.790 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:48:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T16:48:21.791 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:48:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:48:21.791 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:48:21.791 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T16:48:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:48:21.791 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:48:22.197 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-30T16:48:22.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-30T16:48:22.200 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-30T16:48:22.354 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-30T16:48:22.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:48:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T16:48:22.373 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-30T16:48:22.438 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T16:48:22.439 INFO:tasks.ceph:role: osd.5 2024-05-30T16:48:22.439 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T16:48:22.439 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-30T16:48:22.510 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:48:22.510 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:48:22.510 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:48:22.510 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T16:48:22.510 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:48:22.510 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:48:22.510 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:48:22.511 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T16:48:22.511 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:48:22.511 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:48:22.869 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-30T16:48:22.871 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-30T16:48:22.872 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-30T16:48:22.946 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-30T16:48:23.011 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T16:48:23.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:48:23.012 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-30T16:48:23.078 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T16:48:23.079 INFO:tasks.ceph:role: osd.6 2024-05-30T16:48:23.079 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T16:48:23.079 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-30T16:48:23.150 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:48:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:48:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:48:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T16:48:23.151 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:48:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:48:23.151 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:48:23.151 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T16:48:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:48:23.151 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:48:23.537 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-30T16:48:23.540 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-30T16:48:23.540 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-30T16:48:23.637 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-30T16:48:23.654 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T16:48:23.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:48:23.655 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-30T16:48:23.722 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T16:48:23.722 INFO:tasks.ceph:role: osd.7 2024-05-30T16:48:23.723 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T16:48:23.723 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-30T16:48:23.798 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:48:23.798 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:48:23.799 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:48:23.799 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T16:48:23.799 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:48:23.799 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:48:23.799 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:48:23.799 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T16:48:23.799 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:48:23.799 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:48:24.224 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-30T16:48:24.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-30T16:48:24.227 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-30T16:48:24.357 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-30T16:48:24.374 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T16:48:24.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:48:24.375 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:24.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:24.508+0000 7fed78c2f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-30T16:48:24.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:24.512+0000 7fed78c2f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-30T16:48:24.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:24.512+0000 7fed78c2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-30T16:48:24.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:24.512+0000 7fed78c2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-30T16:48:24.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:24.512+0000 7fed78c2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-30T16:48:24.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:24.520+0000 7fed78c2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-30T16:48:27.573 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-30T16:48:27.593 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:27.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:27.684+0000 7f199aacd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-30T16:48:27.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:27.684+0000 7f199aacd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-30T16:48:27.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:27.684+0000 7f199aacd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-30T16:48:27.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:27.684+0000 7f199aacd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-30T16:48:27.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:27.684+0000 7f199aacd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-30T16:48:27.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:27.688+0000 7f199aacd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-30T16:48:30.705 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-30T16:48:30.725 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:30.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:30.816+0000 7facd3eb27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-30T16:48:30.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:30.820+0000 7facd3eb27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-30T16:48:30.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:30.820+0000 7facd3eb27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-30T16:48:30.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:30.820+0000 7facd3eb27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-30T16:48:30.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:30.820+0000 7facd3eb27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-30T16:48:30.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:30.820+0000 7facd3eb27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-30T16:48:33.131 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:48:33.135 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:48:33.872 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-30T16:48:33.892 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:33.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:33.988+0000 7f40e0ad47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-30T16:48:33.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:33.988+0000 7f40e0ad47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-30T16:48:33.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:33.988+0000 7f40e0ad47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-30T16:48:33.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:33.988+0000 7f40e0ad47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-30T16:48:33.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:33.988+0000 7f40e0ad47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-30T16:48:33.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:33.988+0000 7f40e0ad47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-30T16:48:37.044 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-30T16:48:37.065 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-30T16:48:37.065 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:37.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-30T16:48:37.088 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:37.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-30T16:48:37.155 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:37.155 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-30T16:48:37.223 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:37.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-30T16:48:37.291 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:37.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-30T16:48:37.359 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:37.360 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-30T16:48:37.427 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:37.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-30T16:48:37.495 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:37.495 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-30T16:48:37.516 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:37.516 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-30T16:48:37.578 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:37.578 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-30T16:48:37.642 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:37.642 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-30T16:48:37.710 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:37.710 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-30T16:48:37.778 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:37.778 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-30T16:48:37.838 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:37.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-30T16:48:37.898 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:37.898 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-30T16:48:37.908 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:37.908 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-30T16:48:37.962 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:37.963 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-30T16:48:37.971 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:37.971 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-30T16:48:38.026 INFO:tasks.ceph:Adding keys to all mons... 2024-05-30T16:48:38.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-30T16:48:38.029 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-30T16:48:38.074 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.y] 2024-05-30T16:48:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDFrVhm0UKsHhAAimqtE18XjW/1vA7uMsJmEw== 2024-05-30T16:48:38.074 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2024-05-30T16:48:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDFrVhmAAjIJhAA5/FZHJtfSZuYcD6bEfCGDA== 2024-05-30T16:48:38.074 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2024-05-30T16:48:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDFrVhmD2pGLhAAWmDw/02mc8T7upvRXnj1yw== 2024-05-30T16:48:38.074 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2024-05-30T16:48:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDJrVhmU0fpBhAA2tKWGJF24DlEjG+iuO4djg== 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDMrVhmxE2HERAA4N9Bsb0fxl5GERpgyKCl6Q== 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDPrVhm6v7AGhAAqOQCN90pL0AmnXYIPIb48A== 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDSrVhm3BEDJxAA4SOWC/qF90R9ivrCvN92ZA== 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDFrVhmWZq9IhAAFuEZeFiLGCitIiNARjoDTA== 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDFrVhmELVkMxAA/vOsM3Z0z4YEmUqoPtrPBQ== 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDFrVhmYLbYOhAAxggGfPZU/ryu+8vciSXjUw== 2024-05-30T16:48:38.075 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.4] 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDYrVhmFzmDHhAAQtbXd6haolYB98wfEbpvTQ== 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.5] 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDbrVhmHqkEKRAAKfFPdTqaVhBNnc5lKeEFpg== 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.6] 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDerVhm72bzMBAA+FfnxIOnkESuTervY23ruw== 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.7] 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDhrVhmXGv/OhAAr2k7IXDA9VDi9ZJwrQ+u6A== 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA== 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout:[client.2] 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDGrVhmvlFFCRAAZCq7ijfrVqy8Ukh7jKZESQ== 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout:[client.1] 2024-05-30T16:48:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDGrVhmncPjDBAAWEJOkxm9xfRjonO6U1hO6A== 2024-05-30T16:48:38.077 INFO:teuthology.orchestra.run.smithi059.stdout:[client.3] 2024-05-30T16:48:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDGrVhmcpjuEhAA0q+PfNy0IWhqQSiIZuyBlg== 2024-05-30T16:48:38.088 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2024-05-30T16:48:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDFrVhm0UKsHhAAimqtE18XjW/1vA7uMsJmEw== 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDFrVhmAAjIJhAA5/FZHJtfSZuYcD6bEfCGDA== 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDFrVhmD2pGLhAAWmDw/02mc8T7upvRXnj1yw== 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDJrVhmU0fpBhAA2tKWGJF24DlEjG+iuO4djg== 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDMrVhmxE2HERAA4N9Bsb0fxl5GERpgyKCl6Q== 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDPrVhm6v7AGhAAqOQCN90pL0AmnXYIPIb48A== 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDSrVhm3BEDJxAA4SOWC/qF90R9ivrCvN92ZA== 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-05-30T16:48:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDFrVhmWZq9IhAAFuEZeFiLGCitIiNARjoDTA== 2024-05-30T16:48:38.090 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-05-30T16:48:38.090 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDFrVhmELVkMxAA/vOsM3Z0z4YEmUqoPtrPBQ== 2024-05-30T16:48:38.090 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-05-30T16:48:38.090 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDFrVhmYLbYOhAAxggGfPZU/ryu+8vciSXjUw== 2024-05-30T16:48:38.090 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2024-05-30T16:48:38.090 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDYrVhmFzmDHhAAQtbXd6haolYB98wfEbpvTQ== 2024-05-30T16:48:38.090 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDbrVhmHqkEKRAAKfFPdTqaVhBNnc5lKeEFpg== 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDerVhm72bzMBAA+FfnxIOnkESuTervY23ruw== 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDhrVhmXGv/OhAAr2k7IXDA9VDi9ZJwrQ+u6A== 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA== 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout:[client.2] 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDGrVhmvlFFCRAAZCq7ijfrVqy8Ukh7jKZESQ== 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout:[client.1] 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDGrVhmncPjDBAAWEJOkxm9xfRjonO6U1hO6A== 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout:[client.3] 2024-05-30T16:48:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDGrVhmcpjuEhAA0q+PfNy0IWhqQSiIZuyBlg== 2024-05-30T16:48:38.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-30T16:48:38.121 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-30T16:48:38.192 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:48:38.195 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:48:38.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:48:38.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:48:38.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.315 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.368 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.371 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.428 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.481 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.484 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-30T16:48:38.539 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-30T16:48:38.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:48:38.595 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:48:38.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:48:38.653 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:48:38.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.712 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.764 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.767 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.822 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.874 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.878 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:48:38.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:48:38.934 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:48:38.989 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:48:38.992 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:48:39.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:48:39.051 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:48:39.106 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:48:39.109 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:48:39.166 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-30T16:48:39.166 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-30T16:48:39.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-30T16:48:39.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-30T16:48:39.322 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-30T16:48:39.341 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-30T16:48:39.447 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-30T16:48:39.467 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-30T16:48:39.528 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-30T16:48:39.640 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-30T16:48:39.659 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:39.662 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:48:39.710 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-30T16:48:39.710 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-30T16:48:39.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-30T16:48:39.713 INFO:tasks.ceph.mon.a:Started 2024-05-30T16:48:39.713 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-30T16:48:39.713 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-30T16:48:39.756 INFO:tasks.ceph.mon.b:Started 2024-05-30T16:48:39.757 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-30T16:48:39.757 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-30T16:48:39.759 INFO:tasks.ceph.mon.c:Started 2024-05-30T16:48:39.760 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-30T16:48:39.760 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-30T16:48:39.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-30T16:48:39.763 INFO:tasks.ceph.mgr.y:Started 2024-05-30T16:48:39.763 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-30T16:48:39.763 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-30T16:48:39.766 INFO:tasks.ceph.mgr.x:Started 2024-05-30T16:48:39.766 INFO:tasks.ceph:Setting crush tunables to default 2024-05-30T16:48:39.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd crush tunables default 2024-05-30T16:48:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f43000640 1 Processor -- start 2024-05-30T16:48:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f43000640 1 -- start start 2024-05-30T16:48:39.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f43000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c0d14c0 0x7f8f3c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:39.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f43000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3c06ea20 con 0x7f8f3c09b150 2024-05-30T16:48:39.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f43000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3c070950 con 0x7f8f3c0d05b0 2024-05-30T16:48:39.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f43000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3c070c30 con 0x7f8f3c0d14c0 2024-05-30T16:48:39.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f41000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8f3c09b150 0x7f8f3c06d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56282/0 (socket says 172.21.15.59:56282) 2024-05-30T16:48:39.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f41000640 1 -- 172.21.15.59:0/3230107896 learned_addr learned my addr 172.21.15.59:0/3230107896 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:48:39.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f3be00640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c0d14c0 0x7f8f3c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:39.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f3be00640 1 -- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c0d14c0 msgr2=0x7f8f3c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-30T16:48:39.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f3be00640 1 -- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c0d14c0 msgr2=0x7f8f3c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T16:48:39.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f3be00640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c0d14c0 0x7f8f3c06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T16:48:39.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:39.918+0000 7f8f3be00640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c0d14c0 0x7f8f3c06e4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-30T16:48:40.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1650132275 0 0) 0x7f8f34001120 con 0x7f8f3c09b150 2024-05-30T16:48:40.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f20003530 con 0x7f8f3c09b150 2024-05-30T16:48:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3921739259 0 0) 0x7f8f3c070950 con 0x7f8f3c0d05b0 2024-05-30T16:48:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f34001120 con 0x7f8f3c0d05b0 2024-05-30T16:48:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1344434370 0 0) 0x7f8f20003530 con 0x7f8f3c09b150 2024-05-30T16:48:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c0d14c0 msgr2=0x7f8f3c06e4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:48:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c0d14c0 0x7f8f3c06e4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 >> v1:172.21.15.107:6789/0 conn(0x7f8f3c0d05b0 legacy=0x7f8f3c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c070f10 con 0x7f8f3c09b150 2024-05-30T16:48:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f8f34001850 con 0x7f8f3c09b150 2024-05-30T16:48:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 >> v1:172.21.15.59:6789/0 conn(0x7f8f3c09b150 legacy=0x7f8f3c06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f20003b80 0x7f8f20003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f20004810 0x7f8f20004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c0d14c0 0x7f8f200051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c070c30 con 0x7f8f20004810 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2000bae0 con 0x7f8f20003b80 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2000bce0 con 0x7f8f3c0d14c0 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f3be00640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f20003b80 0x7f8f20003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f33400640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f20004810 0x7f8f20004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.054+0000 7f8f41000640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c0d14c0 0x7f8f200051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.058+0000 7f8f33400640 1 -- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c0d14c0 msgr2=0x7f8f200051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.058+0000 7f8f33400640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c0d14c0 0x7f8f200051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.058+0000 7f8f33400640 1 -- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f20003b80 msgr2=0x7f8f20003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.058+0000 7f8f33400640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f20003b80 0x7f8f20003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.058+0000 7f8f33400640 1 -- 172.21.15.59:0/3230107896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f20003530 con 0x7f8f20004810 2024-05-30T16:48:40.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.058+0000 7f8f33400640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f20004810 0x7f8f20004c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f24001fd0 tx=0x7f8f2401f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da229e1ac503862 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:40.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.058+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24001c20 con 0x7f8f20004810 2024-05-30T16:48:40.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.058+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f240a8cb0 con 0x7f8f20004810 2024-05-30T16:48:40.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.058+0000 7f8f3b400640 1 -- 172.21.15.59:0/3230107896 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f240a8e60 con 0x7f8f20004810 2024-05-30T16:48:40.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 -- 172.21.15.59:0/3230107896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f20004810 msgr2=0x7f8f20004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 --2- 172.21.15.59:0/3230107896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f20004810 0x7f8f20004c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f24001fd0 tx=0x7f8f2401f070 comp rx=0 tx=0).stop 2024-05-30T16:48:40.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f41000640 1 -- 172.21.15.59:0/3230107896 reap_dead start 2024-05-30T16:48:40.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 -- 172.21.15.59:0/3230107896 shutdown_connections 2024-05-30T16:48:40.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 -- 172.21.15.59:0/3230107896 >> 172.21.15.59:0/3230107896 conn(0x7f8f3c0b3f80 msgr2=0x7f8f3c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:40.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 -- 172.21.15.59:0/3230107896 shutdown_connections 2024-05-30T16:48:40.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 -- 172.21.15.59:0/3230107896 wait complete. 2024-05-30T16:48:40.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 Processor -- start 2024-05-30T16:48:40.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 -- start start 2024-05-30T16:48:40.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f20004810 0x7f8f3c157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f3c1e8690 0x7f8f3c1e8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c15fb90 0x7f8f3c160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c0d18a0 con 0x7f8f20004810 2024-05-30T16:48:40.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c0711f0 con 0x7f8f3c1e8690 2024-05-30T16:48:40.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f43000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3c0d0a30 con 0x7f8f3c15fb90 2024-05-30T16:48:40.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f3be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f20004810 0x7f8f3c157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f3be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f20004810 0x7f8f3c157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46872/0 (socket says 172.21.15.59:46872) 2024-05-30T16:48:40.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f33400640 1 --2- 172.21.15.59:0/317228532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f3c1e8690 0x7f8f3c1e8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f3be00640 1 -- 172.21.15.59:0/317228532 learned_addr learned my addr 172.21.15.59:0/317228532 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:48:40.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.062+0000 7f8f41000640 1 --2- 172.21.15.59:0/317228532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c15fb90 0x7f8f3c160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f3be00640 1 -- 172.21.15.59:0/317228532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c15fb90 msgr2=0x7f8f3c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f3be00640 1 --2- 172.21.15.59:0/317228532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c15fb90 0x7f8f3c160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f3be00640 1 -- 172.21.15.59:0/317228532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f3c1e8690 msgr2=0x7f8f3c1e8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f3be00640 1 --2- 172.21.15.59:0/317228532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f3c1e8690 0x7f8f3c1e8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f3be00640 1 -- 172.21.15.59:0/317228532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c1582d0 con 0x7f8f20004810 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f3be00640 1 --2- 172.21.15.59:0/317228532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f20004810 0x7f8f3c157d90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c011660 tx=0x7f8f2c011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f38c00640 1 -- 172.21.15.59:0/317228532 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00f040 con 0x7f8f20004810 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f38c00640 1 -- 172.21.15.59:0/317228532 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f2c004230 con 0x7f8f20004810 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f43000640 1 -- 172.21.15.59:0/317228532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3c160950 con 0x7f8f20004810 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f38c00640 1 -- 172.21.15.59:0/317228532 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00f7c0 con 0x7f8f20004810 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f43000640 1 -- 172.21.15.59:0/317228532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3c0c6eb0 con 0x7f8f20004810 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f38c00640 1 -- 172.21.15.59:0/317228532 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f2c00fcf0 con 0x7f8f20004810 2024-05-30T16:48:40.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f38c00640 1 -- 172.21.15.59:0/317228532 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8f2c0159e0 con 0x7f8f20004810 2024-05-30T16:48:40.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.066+0000 7f8f43000640 1 -- 172.21.15.59:0/317228532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3c068a90 con 0x7f8f20004810 2024-05-30T16:48:40.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.078+0000 7f8f38c00640 1 -- 172.21.15.59:0/317228532 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8f2c019020 con 0x7f8f20004810 2024-05-30T16:48:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.146+0000 7f8f43000640 1 -- 172.21.15.59:0/317228532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8f3c069450 con 0x7f8f20004810 2024-05-30T16:48:40.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.150+0000 7f8f38c00640 1 -- 172.21.15.59:0/317228532 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8f2c015c30 con 0x7f8f20004810 2024-05-30T16:48:40.151 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2024-05-30T16:48:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.150+0000 7f8f43000640 1 -- 172.21.15.59:0/317228532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f20004810 msgr2=0x7f8f3c157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.150+0000 7f8f43000640 1 --2- 172.21.15.59:0/317228532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f20004810 0x7f8f3c157d90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c011660 tx=0x7f8f2c011b20 comp rx=0 tx=0).stop 2024-05-30T16:48:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.150+0000 7f8f43000640 1 -- 172.21.15.59:0/317228532 shutdown_connections 2024-05-30T16:48:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.150+0000 7f8f43000640 1 --2- 172.21.15.59:0/317228532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f3c15fb90 0x7f8f3c160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.150+0000 7f8f43000640 1 --2- 172.21.15.59:0/317228532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f3c1e8690 0x7f8f3c1e8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.150+0000 7f8f43000640 1 --2- 172.21.15.59:0/317228532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f20004810 0x7f8f3c157d90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.150+0000 7f8f43000640 1 -- 172.21.15.59:0/317228532 >> 172.21.15.59:0/317228532 conn(0x7f8f3c0b3f80 msgr2=0x7f8f3c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:40.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.150+0000 7f8f43000640 1 -- 172.21.15.59:0/317228532 shutdown_connections 2024-05-30T16:48:40.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:40.150+0000 7f8f43000640 1 -- 172.21.15.59:0/317228532 wait complete. 2024-05-30T16:48:40.172 INFO:tasks.ceph:check_enable_crimson: False 2024-05-30T16:48:40.172 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-30T16:48:40.173 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:40.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-30T16:48:40.192 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:40.192 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-30T16:48:40.253 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:40.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-30T16:48:40.257 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:40.256+0000 7efdf2c48180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-30T16:48:40.313 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:48:40.314 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-30T16:48:40.327 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:40.326+0000 7f02220ee180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-30T16:48:40.346 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:40.346 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-30T16:48:40.367 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:40.367 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-30T16:48:40.429 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:40.429 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-30T16:48:40.493 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:48:40.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-30T16:48:40.557 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new d0944a0f-0119-4302-b5df-86a303bb4f34 0 2024-05-30T16:48:40.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff23a00640 1 Processor -- start 2024-05-30T16:48:40.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff23a00640 1 -- start start 2024-05-30T16:48:40.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff23a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7eff1c09b150 0x7eff1c1699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff23a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1c070950 con 0x7eff1c0d14c0 2024-05-30T16:48:40.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff23a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1c070c30 con 0x7eff1c0d05b0 2024-05-30T16:48:40.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff23a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7eff1c070f10 con 0x7eff1c09b150 2024-05-30T16:48:40.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff21a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7eff1c09b150 0x7eff1c1699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff21a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7eff1c09b150 0x7eff1c1699b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39472/0 (socket says 172.21.15.107:39472) 2024-05-30T16:48:40.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff21a00640 1 -- 172.21.15.107:0/2836603641 learned_addr learned my addr 172.21.15.107:0/2836603641 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-30T16:48:40.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff13e00640 1 --1- 172.21.15.107:0/2836603641 >> v1:172.21.15.107:6789/0 conn(0x7eff1c0d05b0 0x7eff1c09aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35708/0 (socket says 172.21.15.107:35708) 2024-05-30T16:48:40.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff21a00640 1 -- 172.21.15.107:0/2836603641 >> v1:172.21.15.107:6789/0 conn(0x7eff1c0d05b0 legacy=0x7eff1c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff21a00640 1 -- 172.21.15.107:0/2836603641 >> v1:172.21.15.59:6789/0 conn(0x7eff1c0d14c0 legacy=0x7eff1c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.736+0000 7eff21a00640 1 -- 172.21.15.107:0/2836603641 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c06cbd0 con 0x7eff1c09b150 2024-05-30T16:48:40.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.740+0000 7eff21a00640 1 --2- 172.21.15.107:0/2836603641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c09b150 0x7eff1c1699b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7eff14009e50 tx=0x7eff1401c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=209c77d47e8d05ad server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:40.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.740+0000 7eff1be00640 1 -- 172.21.15.107:0/2836603641 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140a58b0 con 0x7eff1c09b150 2024-05-30T16:48:40.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.740+0000 7eff1be00640 1 -- 172.21.15.107:0/2836603641 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff140a5a50 con 0x7eff1c09b150 2024-05-30T16:48:40.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.740+0000 7eff1be00640 1 -- 172.21.15.107:0/2836603641 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140a5e20 con 0x7eff1c09b150 2024-05-30T16:48:40.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.740+0000 7eff23a00640 1 -- 172.21.15.107:0/2836603641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c09b150 msgr2=0x7eff1c1699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.740+0000 7eff23a00640 1 --2- 172.21.15.107:0/2836603641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c09b150 0x7eff1c1699b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7eff14009e50 tx=0x7eff1401c9d0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.740+0000 7eff23a00640 1 -- 172.21.15.107:0/2836603641 shutdown_connections 2024-05-30T16:48:40.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.740+0000 7eff23a00640 1 --2- 172.21.15.107:0/2836603641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c09b150 0x7eff1c1699b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.740+0000 7eff23a00640 1 -- 172.21.15.107:0/2836603641 >> 172.21.15.107:0/2836603641 conn(0x7eff1c0b3f80 msgr2=0x7eff1c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:40.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.740+0000 7eff23a00640 1 -- 172.21.15.107:0/2836603641 shutdown_connections 2024-05-30T16:48:40.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.740+0000 7eff23a00640 1 -- 172.21.15.107:0/2836603641 wait complete. 2024-05-30T16:48:40.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff23a00640 1 Processor -- start 2024-05-30T16:48:40.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff23a00640 1 -- start start 2024-05-30T16:48:40.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff23a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff1c09b150 0x7eff1c153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff23a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c0d05b0 0x7eff1c15e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff23a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c0d14c0 0x7eff1c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff23a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c06e280 con 0x7eff1c09b150 2024-05-30T16:48:40.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff23a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c06e100 con 0x7eff1c0d05b0 2024-05-30T16:48:40.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff23a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c16c710 con 0x7eff1c0d14c0 2024-05-30T16:48:40.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff13e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c0d05b0 0x7eff1c15e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff21a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c0d14c0 0x7eff1c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff21a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c0d14c0 0x7eff1c15d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:46148/0 (socket says 172.21.15.107:46148) 2024-05-30T16:48:40.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff13e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c0d05b0 0x7eff1c15e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39478/0 (socket says 172.21.15.107:39478) 2024-05-30T16:48:40.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff21a00640 1 -- 172.21.15.107:0/1210702825 learned_addr learned my addr 172.21.15.107:0/1210702825 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-30T16:48:40.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff21000640 1 --2- 172.21.15.107:0/1210702825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff1c09b150 0x7eff1c153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff21a00640 1 -- 172.21.15.107:0/1210702825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c0d05b0 msgr2=0x7eff1c15e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff21a00640 1 --2- 172.21.15.107:0/1210702825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c0d05b0 0x7eff1c15e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff21a00640 1 -- 172.21.15.107:0/1210702825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff1c09b150 msgr2=0x7eff1c153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff21a00640 1 --2- 172.21.15.107:0/1210702825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff1c09b150 0x7eff1c153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff21a00640 1 -- 172.21.15.107:0/1210702825 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c160100 con 0x7eff1c0d14c0 2024-05-30T16:48:40.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff13e00640 1 --2- 172.21.15.107:0/1210702825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c0d05b0 0x7eff1c15e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:48:40.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff21a00640 1 --2- 172.21.15.107:0/1210702825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c0d14c0 0x7eff1c15d1e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7eff14009e50 tx=0x7eff140197d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff19600640 1 -- 172.21.15.107:0/1210702825 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140a58b0 con 0x7eff1c0d14c0 2024-05-30T16:48:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff19600640 1 -- 172.21.15.107:0/1210702825 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff140be070 con 0x7eff1c0d14c0 2024-05-30T16:48:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff23a00640 1 -- 172.21.15.107:0/1210702825 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c15f060 con 0x7eff1c0d14c0 2024-05-30T16:48:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff19600640 1 -- 172.21.15.107:0/1210702825 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14009510 con 0x7eff1c0d14c0 2024-05-30T16:48:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff23a00640 1 -- 172.21.15.107:0/1210702825 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c15f620 con 0x7eff1c0d14c0 2024-05-30T16:48:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff19600640 1 -- 172.21.15.107:0/1210702825 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7eff140b86b0 con 0x7eff1c0d14c0 2024-05-30T16:48:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.744+0000 7eff19600640 1 -- 172.21.15.107:0/1210702825 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7eff140c35f0 con 0x7eff1c0d14c0 2024-05-30T16:48:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.748+0000 7eff23a00640 1 -- 172.21.15.107:0/1210702825 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1c068a90 con 0x7eff1c0d14c0 2024-05-30T16:48:40.750 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:40.748+0000 7efdf2c48180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-30T16:48:40.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.752+0000 7eff19600640 1 -- 172.21.15.107:0/1210702825 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7eff14016620 con 0x7eff1c0d14c0 2024-05-30T16:48:40.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.820+0000 7eff23a00640 1 -- 172.21.15.107:0/1210702825 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d0944a0f-0119-4302-b5df-86a303bb4f34", "id": 0} v 0) -- 0x7eff1c0b4be0 con 0x7eff1c0d14c0 2024-05-30T16:48:40.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.828+0000 7eff19600640 1 -- 172.21.15.107:0/1210702825 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0944a0f-0119-4302-b5df-86a303bb4f34", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7eff140b8ae0 con 0x7eff1c0d14c0 2024-05-30T16:48:40.827 INFO:teuthology.orchestra.run.smithi107.stdout:0 2024-05-30T16:48:40.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.828+0000 7eff23a00640 1 -- 172.21.15.107:0/1210702825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c0d14c0 msgr2=0x7eff1c15d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.828+0000 7eff23a00640 1 --2- 172.21.15.107:0/1210702825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c0d14c0 0x7eff1c15d1e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7eff14009e50 tx=0x7eff140197d0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.828+0000 7eff23a00640 1 -- 172.21.15.107:0/1210702825 shutdown_connections 2024-05-30T16:48:40.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.828+0000 7eff23a00640 1 --2- 172.21.15.107:0/1210702825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c0d14c0 0x7eff1c15d1e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.828+0000 7eff23a00640 1 --2- 172.21.15.107:0/1210702825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c0d05b0 0x7eff1c15e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.828+0000 7eff23a00640 1 --2- 172.21.15.107:0/1210702825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff1c09b150 0x7eff1c153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.828+0000 7eff23a00640 1 -- 172.21.15.107:0/1210702825 >> 172.21.15.107:0/1210702825 conn(0x7eff1c0b3f80 msgr2=0x7eff1c0ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:40.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.828+0000 7eff23a00640 1 -- 172.21.15.107:0/1210702825 shutdown_connections 2024-05-30T16:48:40.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.828+0000 7eff23a00640 1 -- 172.21.15.107:0/1210702825 wait complete. 2024-05-30T16:48:40.839 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:40.838+0000 7f02220ee180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-30T16:48:40.846 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new c3562d37-416b-4433-8f1f-d9767f4c5b17 1 2024-05-30T16:48:40.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.980+0000 7f6c2e400640 1 Processor -- start 2024-05-30T16:48:40.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.980+0000 7f6c2e400640 1 -- start start 2024-05-30T16:48:40.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.980+0000 7f6c2e400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6c280d14c0 0x7f6c2806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.980+0000 7f6c2e400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c280d05b0 0x7f6c2809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.980+0000 7f6c2e400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2806ea20 con 0x7f6c2809af80 2024-05-30T16:48:40.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.980+0000 7f6c2e400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6c2809b3f0 con 0x7f6c280d05b0 2024-05-30T16:48:40.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.980+0000 7f6c2e400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6c28070950 con 0x7f6c280d14c0 2024-05-30T16:48:40.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.984+0000 7f6c27400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6c280d14c0 0x7f6c2806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.984+0000 7f6c27400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6c280d14c0 0x7f6c2806e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39488/0 (socket says 172.21.15.107:39488) 2024-05-30T16:48:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.984+0000 7f6c27400640 1 -- 172.21.15.107:0/3249306347 learned_addr learned my addr 172.21.15.107:0/3249306347 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-30T16:48:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.984+0000 7f6c26a00640 1 --2- 172.21.15.107:0/3249306347 >> v2:172.21.15.59:3300/0 conn(0x7f6c280d05b0 0x7f6c2809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.984+0000 7f6c27400640 1 -- 172.21.15.107:0/3249306347 >> v2:172.21.15.59:3300/0 conn(0x7f6c280d05b0 msgr2=0x7f6c2809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.984+0000 7f6c27400640 1 --2- 172.21.15.107:0/3249306347 >> v2:172.21.15.59:3300/0 conn(0x7f6c280d05b0 0x7f6c2809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.984+0000 7f6c27400640 1 -- 172.21.15.107:0/3249306347 >> v1:172.21.15.59:6789/0 conn(0x7f6c2809af80 legacy=0x7f6c28162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.984+0000 7f6c27400640 1 -- 172.21.15.107:0/3249306347 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c28070c30 con 0x7f6c280d14c0 2024-05-30T16:48:40.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.984+0000 7f6c27400640 1 --2- 172.21.15.107:0/3249306347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c280d14c0 0x7f6c2806e4e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6c280735d0 tx=0x7f6c1801c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54de55da4e34fe50 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:40.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.984+0000 7f6c26000640 1 -- 172.21.15.107:0/3249306347 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c180b0070 con 0x7f6c280d14c0 2024-05-30T16:48:40.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.984+0000 7f6c26000640 1 -- 172.21.15.107:0/3249306347 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c180ab600 con 0x7f6c280d14c0 2024-05-30T16:48:40.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.984+0000 7f6c26000640 1 -- 172.21.15.107:0/3249306347 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c180ab9d0 con 0x7f6c280d14c0 2024-05-30T16:48:40.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 -- 172.21.15.107:0/3249306347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c280d14c0 msgr2=0x7f6c2806e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 --2- 172.21.15.107:0/3249306347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c280d14c0 0x7f6c2806e4e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6c280735d0 tx=0x7f6c1801c2d0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 -- 172.21.15.107:0/3249306347 shutdown_connections 2024-05-30T16:48:40.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 --2- 172.21.15.107:0/3249306347 >> v2:172.21.15.59:3300/0 conn(0x7f6c280d05b0 0x7f6c2809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 --2- 172.21.15.107:0/3249306347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c280d14c0 0x7f6c2806e4e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 -- 172.21.15.107:0/3249306347 >> 172.21.15.107:0/3249306347 conn(0x7f6c280b3f80 msgr2=0x7f6c280b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:40.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 -- 172.21.15.107:0/3249306347 shutdown_connections 2024-05-30T16:48:40.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 -- 172.21.15.107:0/3249306347 wait complete. 2024-05-30T16:48:40.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 Processor -- start 2024-05-30T16:48:40.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 -- start start 2024-05-30T16:48:40.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2809af80 0x7f6c281538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c280d05b0 0x7f6c2815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c280d14c0 0x7f6c2815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6c280d09c0 con 0x7f6c280d14c0 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6c280d18a0 con 0x7f6c2809af80 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c2e400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6c280d0b40 con 0x7f6c280d05b0 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c27400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2809af80 0x7f6c281538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c27400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2809af80 0x7f6c281538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39504/0 (socket says 172.21.15.107:39504) 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c27400640 1 -- 172.21.15.107:0/4082842319 learned_addr learned my addr 172.21.15.107:0/4082842319 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c26a00640 1 --2- 172.21.15.107:0/4082842319 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c280d05b0 0x7f6c2815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c27e00640 1 --2- 172.21.15.107:0/4082842319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c280d14c0 0x7f6c2815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c27400640 1 -- 172.21.15.107:0/4082842319 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c280d05b0 msgr2=0x7f6c2815c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c27400640 1 --2- 172.21.15.107:0/4082842319 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c280d05b0 0x7f6c2815c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c27400640 1 -- 172.21.15.107:0/4082842319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c280d14c0 msgr2=0x7f6c2815c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c27400640 1 --2- 172.21.15.107:0/4082842319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c280d14c0 0x7f6c2815c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.988+0000 7f6c27400640 1 -- 172.21.15.107:0/4082842319 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2815ac80 con 0x7f6c2809af80 2024-05-30T16:48:40.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.992+0000 7f6c27400640 1 --2- 172.21.15.107:0/4082842319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2809af80 0x7f6c281538c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c180ae040 tx=0x7f6c1801ab10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:40.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.992+0000 7f6c1f400640 1 -- 172.21.15.107:0/4082842319 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c180ba020 con 0x7f6c2809af80 2024-05-30T16:48:40.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.992+0000 7f6c1f400640 1 -- 172.21.15.107:0/4082842319 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c180b6640 con 0x7f6c2809af80 2024-05-30T16:48:40.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.992+0000 7f6c2e400640 1 -- 172.21.15.107:0/4082842319 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2815af20 con 0x7f6c2809af80 2024-05-30T16:48:40.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.992+0000 7f6c1f400640 1 -- 172.21.15.107:0/4082842319 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c180b0040 con 0x7f6c2809af80 2024-05-30T16:48:40.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.992+0000 7f6c2e400640 1 -- 172.21.15.107:0/4082842319 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2815b4e0 con 0x7f6c2809af80 2024-05-30T16:48:40.993 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:40.992+0000 7efdf2c48180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-30T16:48:40.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.992+0000 7f6c1f400640 1 -- 172.21.15.107:0/4082842319 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c180bd020 con 0x7f6c2809af80 2024-05-30T16:48:40.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.992+0000 7f6c1f400640 1 -- 172.21.15.107:0/4082842319 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f6c180bfae0 con 0x7f6c2809af80 2024-05-30T16:48:40.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.992+0000 7f6c2e400640 1 -- 172.21.15.107:0/4082842319 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c28068a90 con 0x7f6c2809af80 2024-05-30T16:48:40.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:40.996+0000 7f6c1f400640 1 -- 172.21.15.107:0/4082842319 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6c180c4030 con 0x7f6c2809af80 2024-05-30T16:48:41.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.064+0000 7f6c2e400640 1 -- 172.21.15.107:0/4082842319 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c3562d37-416b-4433-8f1f-d9767f4c5b17", "id": 1} v 0) -- 0x7f6c280b4be0 con 0x7f6c2809af80 2024-05-30T16:48:41.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.068+0000 7f6c1f400640 1 -- 172.21.15.107:0/4082842319 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3562d37-416b-4433-8f1f-d9767f4c5b17", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f6c2806ea20 con 0x7f6c2809af80 2024-05-30T16:48:41.069 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-05-30T16:48:41.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.068+0000 7f6c2e400640 1 -- 172.21.15.107:0/4082842319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2809af80 msgr2=0x7f6c281538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.068+0000 7f6c2e400640 1 --2- 172.21.15.107:0/4082842319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2809af80 0x7f6c281538c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c180ae040 tx=0x7f6c1801ab10 comp rx=0 tx=0).stop 2024-05-30T16:48:41.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.068+0000 7f6c2e400640 1 -- 172.21.15.107:0/4082842319 shutdown_connections 2024-05-30T16:48:41.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.068+0000 7f6c2e400640 1 --2- 172.21.15.107:0/4082842319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c280d14c0 0x7f6c2815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.068+0000 7f6c2e400640 1 --2- 172.21.15.107:0/4082842319 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c280d05b0 0x7f6c2815c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.068+0000 7f6c2e400640 1 --2- 172.21.15.107:0/4082842319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2809af80 0x7f6c281538c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.068+0000 7f6c2e400640 1 -- 172.21.15.107:0/4082842319 >> 172.21.15.107:0/4082842319 conn(0x7f6c280b3f80 msgr2=0x7f6c280b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:41.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.068+0000 7f6c2e400640 1 -- 172.21.15.107:0/4082842319 shutdown_connections 2024-05-30T16:48:41.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.068+0000 7f6c2e400640 1 -- 172.21.15.107:0/4082842319 wait complete. 2024-05-30T16:48:41.073 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:41.070+0000 7f02220ee180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-30T16:48:41.089 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new c4c61001-0148-4453-bc11-9056a3b70ea3 2 2024-05-30T16:48:41.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.220+0000 7f18c5400640 1 Processor -- start 2024-05-30T16:48:41.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.220+0000 7f18c5400640 1 -- start start 2024-05-30T16:48:41.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18c5400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c00d05b0 0x7f18c009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18c5400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18c009af80 0x7f18c006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18c5400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c0070950 con 0x7f18c00d14c0 2024-05-30T16:48:41.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18c5400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f18c0070c30 con 0x7f18c009af80 2024-05-30T16:48:41.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18c5400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f18c0070f10 con 0x7f18c00d05b0 2024-05-30T16:48:41.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18bf200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18c009af80 0x7f18c006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18bde00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c00d05b0 0x7f18c009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18be800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f18c00d14c0 0x7f18c006e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35712/0 (socket says 172.21.15.107:35712) 2024-05-30T16:48:41.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18be800640 1 -- 172.21.15.107:0/4007143008 learned_addr learned my addr 172.21.15.107:0/4007143008 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-30T16:48:41.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18bde00640 1 -- 172.21.15.107:0/4007143008 >> v2:172.21.15.107:3300/0 conn(0x7f18c009af80 msgr2=0x7f18c006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:41.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18bde00640 1 --2- 172.21.15.107:0/4007143008 >> v2:172.21.15.107:3300/0 conn(0x7f18c009af80 0x7f18c006d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18bde00640 1 -- 172.21.15.107:0/4007143008 >> v1:172.21.15.107:6789/0 conn(0x7f18c00d14c0 legacy=0x7f18c006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18bde00640 1 -- 172.21.15.107:0/4007143008 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c006cbd0 con 0x7f18c00d05b0 2024-05-30T16:48:41.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18bf200640 1 --2- 172.21.15.107:0/4007143008 >> v2:172.21.15.107:3300/0 conn(0x7f18c009af80 0x7f18c006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:48:41.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.224+0000 7f18bd400640 1 -- 172.21.15.107:0/4007143008 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1366332414 0 0) 0x7f18c0070950 con 0x7f18c00d14c0 2024-05-30T16:48:41.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18bde00640 1 --2- 172.21.15.107:0/4007143008 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c00d05b0 0x7f18c009aa40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0097c0 tx=0x7f18ac01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15f6f077b66f42df server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:41.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18bd400640 1 -- 172.21.15.107:0/4007143008 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0b1070 con 0x7f18c00d05b0 2024-05-30T16:48:41.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18bd400640 1 -- 172.21.15.107:0/4007143008 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac0ac410 con 0x7f18c00d05b0 2024-05-30T16:48:41.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18bd400640 1 -- 172.21.15.107:0/4007143008 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0ac7e0 con 0x7f18c00d05b0 2024-05-30T16:48:41.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18c5400640 1 -- 172.21.15.107:0/4007143008 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c00d05b0 msgr2=0x7f18c009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18c5400640 1 --2- 172.21.15.107:0/4007143008 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c00d05b0 0x7f18c009aa40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0097c0 tx=0x7f18ac01c4a0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18c5400640 1 -- 172.21.15.107:0/4007143008 shutdown_connections 2024-05-30T16:48:41.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18c5400640 1 --2- 172.21.15.107:0/4007143008 >> v2:172.21.15.107:3300/0 conn(0x7f18c009af80 0x7f18c006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18c5400640 1 --2- 172.21.15.107:0/4007143008 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c00d05b0 0x7f18c009aa40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18c5400640 1 -- 172.21.15.107:0/4007143008 >> 172.21.15.107:0/4007143008 conn(0x7f18c00b3f80 msgr2=0x7f18c00b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:41.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18c5400640 1 -- 172.21.15.107:0/4007143008 shutdown_connections 2024-05-30T16:48:41.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18c5400640 1 -- 172.21.15.107:0/4007143008 wait complete. 2024-05-30T16:48:41.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18c5400640 1 Processor -- start 2024-05-30T16:48:41.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.228+0000 7f18c5400640 1 -- start start 2024-05-30T16:48:41.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18c5400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c009af80 0x7f18c00b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18c5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18c00d05b0 0x7f18c0152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18c5400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c00d14c0 0x7f18c0153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18c5400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f18c006dfc0 con 0x7f18c00d05b0 2024-05-30T16:48:41.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18c5400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f18c006de40 con 0x7f18c009af80 2024-05-30T16:48:41.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18c5400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f18c006e140 con 0x7f18c00d14c0 2024-05-30T16:48:41.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18be800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c009af80 0x7f18c00b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18bf200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c00d14c0 0x7f18c0153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18be800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c009af80 0x7f18c00b6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39528/0 (socket says 172.21.15.107:39528) 2024-05-30T16:48:41.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18be800640 1 -- 172.21.15.107:0/3380462988 learned_addr learned my addr 172.21.15.107:0/3380462988 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-30T16:48:41.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18bde00640 1 --2- 172.21.15.107:0/3380462988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18c00d05b0 0x7f18c0152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18be800640 1 -- 172.21.15.107:0/3380462988 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c00d14c0 msgr2=0x7f18c0153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18be800640 1 --2- 172.21.15.107:0/3380462988 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c00d14c0 0x7f18c0153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18be800640 1 -- 172.21.15.107:0/3380462988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18c00d05b0 msgr2=0x7f18c0152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18be800640 1 --2- 172.21.15.107:0/3380462988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18c00d05b0 0x7f18c0152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18be800640 1 -- 172.21.15.107:0/3380462988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c00b7610 con 0x7f18c009af80 2024-05-30T16:48:41.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18bf200640 1 --2- 172.21.15.107:0/3380462988 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c00d14c0 0x7f18c0153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:48:41.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18be800640 1 --2- 172.21.15.107:0/3380462988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c009af80 0x7f18c00b6ba0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c890 tx=0x7f18b000cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:41.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18b6a00640 1 -- 172.21.15.107:0/3380462988 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0018070 con 0x7f18c009af80 2024-05-30T16:48:41.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18b6a00640 1 -- 172.21.15.107:0/3380462988 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b000a640 con 0x7f18c009af80 2024-05-30T16:48:41.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18b6a00640 1 -- 172.21.15.107:0/3380462988 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b000aa30 con 0x7f18c009af80 2024-05-30T16:48:41.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18c5400640 1 -- 172.21.15.107:0/3380462988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c00b78f0 con 0x7f18c009af80 2024-05-30T16:48:41.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18c5400640 1 -- 172.21.15.107:0/3380462988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c00b7eb0 con 0x7f18c009af80 2024-05-30T16:48:41.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18b6a00640 1 -- 172.21.15.107:0/3380462988 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f18b000abd0 con 0x7f18c009af80 2024-05-30T16:48:41.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18b6a00640 1 -- 172.21.15.107:0/3380462988 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f18b00074f0 con 0x7f18c009af80 2024-05-30T16:48:41.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.232+0000 7f18c5400640 1 -- 172.21.15.107:0/3380462988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c0068a90 con 0x7f18c009af80 2024-05-30T16:48:41.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.236+0000 7f18b6a00640 1 -- 172.21.15.107:0/3380462988 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f18b0021070 con 0x7f18c009af80 2024-05-30T16:48:41.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.300+0000 7f18c5400640 1 -- 172.21.15.107:0/3380462988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c4c61001-0148-4453-bc11-9056a3b70ea3", "id": 2} v 0) -- 0x7f18c00d2270 con 0x7f18c009af80 2024-05-30T16:48:41.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.308+0000 7f18b6a00640 1 -- 172.21.15.107:0/3380462988 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4c61001-0148-4453-bc11-9056a3b70ea3", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f18b00076f0 con 0x7f18c009af80 2024-05-30T16:48:41.308 INFO:teuthology.orchestra.run.smithi107.stdout:2 2024-05-30T16:48:41.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.308+0000 7f18c5400640 1 -- 172.21.15.107:0/3380462988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c009af80 msgr2=0x7f18c00b6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.308+0000 7f18c5400640 1 --2- 172.21.15.107:0/3380462988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c009af80 0x7f18c00b6ba0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c890 tx=0x7f18b000cc90 comp rx=0 tx=0).stop 2024-05-30T16:48:41.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.308+0000 7f18c5400640 1 -- 172.21.15.107:0/3380462988 shutdown_connections 2024-05-30T16:48:41.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.308+0000 7f18c5400640 1 --2- 172.21.15.107:0/3380462988 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c00d14c0 0x7f18c0153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.308+0000 7f18c5400640 1 --2- 172.21.15.107:0/3380462988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18c00d05b0 0x7f18c0152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.308+0000 7f18c5400640 1 --2- 172.21.15.107:0/3380462988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c009af80 0x7f18c00b6ba0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.308+0000 7f18c5400640 1 -- 172.21.15.107:0/3380462988 >> 172.21.15.107:0/3380462988 conn(0x7f18c00b3f80 msgr2=0x7f18c015cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:41.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.308+0000 7f18c5400640 1 -- 172.21.15.107:0/3380462988 shutdown_connections 2024-05-30T16:48:41.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.308+0000 7f18c5400640 1 -- 172.21.15.107:0/3380462988 wait complete. 2024-05-30T16:48:41.328 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 6f4274e3-f29a-424b-9eff-dc82e384c867 3 2024-05-30T16:48:41.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbade400640 1 Processor -- start 2024-05-30T16:48:41.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbade400640 1 -- start start 2024-05-30T16:48:41.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbade400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbad809b150 0x7fbad80cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbade400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbad809b780 0x7fbad80ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbade400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad80d1310 con 0x7fbad8160d90 2024-05-30T16:48:41.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbade400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbad809bcf0 con 0x7fbad809b780 2024-05-30T16:48:41.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbade400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbad80d0a70 con 0x7fbad809b150 2024-05-30T16:48:41.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbacfe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbad809b150 0x7fbad80cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbad7400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fbad8160d90 0x7fbad809aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35722/0 (socket says 172.21.15.107:35722) 2024-05-30T16:48:41.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbad7400640 1 -- 172.21.15.107:0/2512075379 learned_addr learned my addr 172.21.15.107:0/2512075379 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-30T16:48:41.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbad7e00640 1 --2- 172.21.15.107:0/2512075379 >> v2:172.21.15.59:3300/0 conn(0x7fbad809b780 0x7fbad80ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbacfe00640 1 -- 172.21.15.107:0/2512075379 >> v2:172.21.15.59:3300/0 conn(0x7fbad809b780 msgr2=0x7fbad80ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:41.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbacfe00640 1 --2- 172.21.15.107:0/2512075379 >> v2:172.21.15.59:3300/0 conn(0x7fbad809b780 0x7fbad80ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbacfe00640 1 -- 172.21.15.107:0/2512075379 >> v1:172.21.15.107:6789/0 conn(0x7fbad8160d90 legacy=0x7fbad809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbacfe00640 1 -- 172.21.15.107:0/2512075379 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad80d0d50 con 0x7fbad809b150 2024-05-30T16:48:41.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.464+0000 7fbad6a00640 1 -- 172.21.15.107:0/2512075379 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489338938 0 0) 0x7fbad80d1310 con 0x7fbad8160d90 2024-05-30T16:48:41.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.468+0000 7fbacfe00640 1 --2- 172.21.15.107:0/2512075379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbad809b150 0x7fbad80cdd20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbac00097c0 tx=0x7fbac001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69148783e14a313 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:41.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.468+0000 7fbad6a00640 1 -- 172.21.15.107:0/2512075379 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac00b0070 con 0x7fbad809b150 2024-05-30T16:48:41.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.468+0000 7fbad6a00640 1 -- 172.21.15.107:0/2512075379 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac00ab600 con 0x7fbad809b150 2024-05-30T16:48:41.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.468+0000 7fbad6a00640 1 -- 172.21.15.107:0/2512075379 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac00ab9d0 con 0x7fbad809b150 2024-05-30T16:48:41.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.468+0000 7fbade400640 1 -- 172.21.15.107:0/2512075379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbad809b150 msgr2=0x7fbad80cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.468+0000 7fbade400640 1 --2- 172.21.15.107:0/2512075379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbad809b150 0x7fbad80cdd20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbac00097c0 tx=0x7fbac001c410 comp rx=0 tx=0).stop 2024-05-30T16:48:41.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.468+0000 7fbade400640 1 -- 172.21.15.107:0/2512075379 shutdown_connections 2024-05-30T16:48:41.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.468+0000 7fbade400640 1 --2- 172.21.15.107:0/2512075379 >> v2:172.21.15.59:3300/0 conn(0x7fbad809b780 0x7fbad80ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.468+0000 7fbade400640 1 --2- 172.21.15.107:0/2512075379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbad809b150 0x7fbad80cdd20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.468+0000 7fbade400640 1 -- 172.21.15.107:0/2512075379 >> 172.21.15.107:0/2512075379 conn(0x7fbad80b3f80 msgr2=0x7fbad80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:41.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.468+0000 7fbade400640 1 -- 172.21.15.107:0/2512075379 shutdown_connections 2024-05-30T16:48:41.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.468+0000 7fbade400640 1 -- 172.21.15.107:0/2512075379 wait complete. 2024-05-30T16:48:41.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbade400640 1 Processor -- start 2024-05-30T16:48:41.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbade400640 1 -- start start 2024-05-30T16:48:41.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbade400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad809b150 0x7fbad8158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbade400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbad809b780 0x7fbad80b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbade400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbad8160d90 0x7fbad815f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbade400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbad8071fe0 con 0x7fbad809b150 2024-05-30T16:48:41.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbade400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbad8071e60 con 0x7fbad8160d90 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbade400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbad8161170 con 0x7fbad809b780 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbad7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbad8160d90 0x7fbad815f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbacfe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbad809b780 0x7fbad80b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbad7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbad8160d90 0x7fbad815f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39544/0 (socket says 172.21.15.107:39544) 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbad7e00640 1 -- 172.21.15.107:0/756733046 learned_addr learned my addr 172.21.15.107:0/756733046 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbad7400640 1 --2- 172.21.15.107:0/756733046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad809b150 0x7fbad8158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbacfe00640 1 -- 172.21.15.107:0/756733046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbad8160d90 msgr2=0x7fbad815f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbacfe00640 1 --2- 172.21.15.107:0/756733046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbad8160d90 0x7fbad815f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbacfe00640 1 -- 172.21.15.107:0/756733046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad809b150 msgr2=0x7fbad8158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbacfe00640 1 --2- 172.21.15.107:0/756733046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad809b150 0x7fbad8158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.472+0000 7fbacfe00640 1 -- 172.21.15.107:0/756733046 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad80b6e10 con 0x7fbad809b780 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.476+0000 7fbacfe00640 1 --2- 172.21.15.107:0/756733046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbad809b780 0x7fbad80b3210 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbad80735a0 tx=0x7fbac001ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:41.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.476+0000 7fbacf400640 1 -- 172.21.15.107:0/756733046 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac00b0050 con 0x7fbad809b780 2024-05-30T16:48:41.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.476+0000 7fbacf400640 1 -- 172.21.15.107:0/756733046 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac00bc070 con 0x7fbad809b780 2024-05-30T16:48:41.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.476+0000 7fbacf400640 1 -- 172.21.15.107:0/756733046 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac00b5830 con 0x7fbad809b780 2024-05-30T16:48:41.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.476+0000 7fbade400640 1 -- 172.21.15.107:0/756733046 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad81faf30 con 0x7fbad809b780 2024-05-30T16:48:41.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.476+0000 7fbade400640 1 -- 172.21.15.107:0/756733046 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad81fb4f0 con 0x7fbad809b780 2024-05-30T16:48:41.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.476+0000 7fbacf400640 1 -- 172.21.15.107:0/756733046 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbac00b59d0 con 0x7fbad809b780 2024-05-30T16:48:41.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.476+0000 7fbacf400640 1 -- 172.21.15.107:0/756733046 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fbac00c1460 con 0x7fbad809b780 2024-05-30T16:48:41.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.476+0000 7fbade400640 1 -- 172.21.15.107:0/756733046 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad8068a90 con 0x7fbad809b780 2024-05-30T16:48:41.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.476+0000 7fbacf400640 1 -- 172.21.15.107:0/756733046 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbac0016090 con 0x7fbad809b780 2024-05-30T16:48:41.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.544+0000 7fbade400640 1 -- 172.21.15.107:0/756733046 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6f4274e3-f29a-424b-9eff-dc82e384c867", "id": 3} v 0) -- 0x7fbad80b4be0 con 0x7fbad809b780 2024-05-30T16:48:41.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.548+0000 7fbacf400640 1 -- 172.21.15.107:0/756733046 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6f4274e3-f29a-424b-9eff-dc82e384c867", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fbac00b5cc0 con 0x7fbad809b780 2024-05-30T16:48:41.551 INFO:teuthology.orchestra.run.smithi107.stdout:3 2024-05-30T16:48:41.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.552+0000 7fbade400640 1 -- 172.21.15.107:0/756733046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbad809b780 msgr2=0x7fbad80b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.552+0000 7fbade400640 1 --2- 172.21.15.107:0/756733046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbad809b780 0x7fbad80b3210 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbad80735a0 tx=0x7fbac001ac50 comp rx=0 tx=0).stop 2024-05-30T16:48:41.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.552+0000 7fbade400640 1 -- 172.21.15.107:0/756733046 shutdown_connections 2024-05-30T16:48:41.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.552+0000 7fbade400640 1 --2- 172.21.15.107:0/756733046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbad8160d90 0x7fbad815f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.552+0000 7fbade400640 1 --2- 172.21.15.107:0/756733046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbad809b780 0x7fbad80b3210 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.552+0000 7fbade400640 1 --2- 172.21.15.107:0/756733046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad809b150 0x7fbad8158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.552+0000 7fbade400640 1 -- 172.21.15.107:0/756733046 >> 172.21.15.107:0/756733046 conn(0x7fbad80b3f80 msgr2=0x7fbad81665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:41.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.552+0000 7fbade400640 1 -- 172.21.15.107:0/756733046 shutdown_connections 2024-05-30T16:48:41.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.552+0000 7fbade400640 1 -- 172.21.15.107:0/756733046 wait complete. 2024-05-30T16:48:41.571 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 55f90922-47ad-445a-93b1-2478afbc03ce 4 2024-05-30T16:48:41.634 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:41.632+0000 7efdf2c48180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-30T16:48:41.699 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:41.696+0000 7efdf2c48180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-30T16:48:41.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d49200640 1 Processor -- start 2024-05-30T16:48:41.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d49200640 1 -- start start 2024-05-30T16:48:41.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d49200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d440b0500 0x7f7d440cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d49200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d440ccd40 0x7f7d4406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d49200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d440cbab0 con 0x7f7d4415ea20 2024-05-30T16:48:41.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d49200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f7d4415ee00 con 0x7f7d440ccd40 2024-05-30T16:48:41.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d49200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7d440cc370 con 0x7f7d440b0500 2024-05-30T16:48:41.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d41e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7d4415ea20 0x7f7d440ae230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35732/0 (socket says 172.21.15.107:35732) 2024-05-30T16:48:41.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d41e00640 1 -- 172.21.15.107:0/1670888474 learned_addr learned my addr 172.21.15.107:0/1670888474 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-30T16:48:41.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d41400640 1 --2- 172.21.15.107:0/1670888474 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d440b0500 0x7f7d440cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d42800640 1 --2- 172.21.15.107:0/1670888474 >> v2:172.21.15.59:3300/0 conn(0x7f7d440ccd40 0x7f7d4406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d41400640 1 -- 172.21.15.107:0/1670888474 >> v2:172.21.15.59:3300/0 conn(0x7f7d440ccd40 msgr2=0x7f7d4406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:41.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d41400640 1 --2- 172.21.15.107:0/1670888474 >> v2:172.21.15.59:3300/0 conn(0x7f7d440ccd40 0x7f7d4406b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d41400640 1 -- 172.21.15.107:0/1670888474 >> v1:172.21.15.107:6789/0 conn(0x7f7d4415ea20 legacy=0x7f7d440ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d40a00640 1 -- 172.21.15.107:0/1670888474 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2634378140 0 0) 0x7f7d440cbab0 con 0x7f7d4415ea20 2024-05-30T16:48:41.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.708+0000 7f7d41400640 1 -- 172.21.15.107:0/1670888474 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d440cbd20 con 0x7f7d440b0500 2024-05-30T16:48:41.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d41400640 1 --2- 172.21.15.107:0/1670888474 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d440b0500 0x7f7d440cc800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7d300097c0 tx=0x7f7d3001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78b2c561deaff861 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:41.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d40a00640 1 -- 172.21.15.107:0/1670888474 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d300b0070 con 0x7f7d440b0500 2024-05-30T16:48:41.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d40a00640 1 -- 172.21.15.107:0/1670888474 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d300ab600 con 0x7f7d440b0500 2024-05-30T16:48:41.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d40a00640 1 -- 172.21.15.107:0/1670888474 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d300ab9d0 con 0x7f7d440b0500 2024-05-30T16:48:41.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d49200640 1 -- 172.21.15.107:0/1670888474 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d440b0500 msgr2=0x7f7d440cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d49200640 1 --2- 172.21.15.107:0/1670888474 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d440b0500 0x7f7d440cc800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7d300097c0 tx=0x7f7d3001c3e0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d49200640 1 -- 172.21.15.107:0/1670888474 shutdown_connections 2024-05-30T16:48:41.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d49200640 1 --2- 172.21.15.107:0/1670888474 >> v2:172.21.15.59:3300/0 conn(0x7f7d440ccd40 0x7f7d4406b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d49200640 1 --2- 172.21.15.107:0/1670888474 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d440b0500 0x7f7d440cc800 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d49200640 1 -- 172.21.15.107:0/1670888474 >> 172.21.15.107:0/1670888474 conn(0x7f7d440b2f50 msgr2=0x7f7d440b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:41.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d49200640 1 -- 172.21.15.107:0/1670888474 shutdown_connections 2024-05-30T16:48:41.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d49200640 1 -- 172.21.15.107:0/1670888474 wait complete. 2024-05-30T16:48:41.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d49200640 1 Processor -- start 2024-05-30T16:48:41.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.712+0000 7f7d49200640 1 -- start start 2024-05-30T16:48:41.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d49200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d440b0500 0x7f7d44156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d49200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d440ccd40 0x7f7d44144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d49200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d4415ea20 0x7f7d440c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d49200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d440ae940 con 0x7f7d440b0500 2024-05-30T16:48:41.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d49200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4406c300 con 0x7f7d4415ea20 2024-05-30T16:48:41.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d49200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7d440c7760 con 0x7f7d440ccd40 2024-05-30T16:48:41.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d42800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d4415ea20 0x7f7d440c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d41400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d440ccd40 0x7f7d44144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d41e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d440b0500 0x7f7d44156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d42800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d4415ea20 0x7f7d440c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39556/0 (socket says 172.21.15.107:39556) 2024-05-30T16:48:41.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d42800640 1 -- 172.21.15.107:0/258152695 learned_addr learned my addr 172.21.15.107:0/258152695 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-30T16:48:41.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d42800640 1 -- 172.21.15.107:0/258152695 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d440ccd40 msgr2=0x7f7d44144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d42800640 1 --2- 172.21.15.107:0/258152695 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d440ccd40 0x7f7d44144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d42800640 1 -- 172.21.15.107:0/258152695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d440b0500 msgr2=0x7f7d44156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d42800640 1 --2- 172.21.15.107:0/258152695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d440b0500 0x7f7d44156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d42800640 1 -- 172.21.15.107:0/258152695 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d44144e60 con 0x7f7d4415ea20 2024-05-30T16:48:41.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d41400640 1 --2- 172.21.15.107:0/258152695 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d440ccd40 0x7f7d44144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:48:41.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d42800640 1 --2- 172.21.15.107:0/258152695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d4415ea20 0x7f7d440c7bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009dd0 tx=0x7f7d3c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:41.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d3a000640 1 -- 172.21.15.107:0/258152695 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c018020 con 0x7f7d4415ea20 2024-05-30T16:48:41.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d3a000640 1 -- 172.21.15.107:0/258152695 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3c014480 con 0x7f7d4415ea20 2024-05-30T16:48:41.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d3a000640 1 -- 172.21.15.107:0/258152695 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c014870 con 0x7f7d4415ea20 2024-05-30T16:48:41.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d49200640 1 -- 172.21.15.107:0/258152695 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d440c8130 con 0x7f7d4415ea20 2024-05-30T16:48:41.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d49200640 1 -- 172.21.15.107:0/258152695 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d440c6e30 con 0x7f7d4415ea20 2024-05-30T16:48:41.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d3a000640 1 -- 172.21.15.107:0/258152695 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d3c01b020 con 0x7f7d4415ea20 2024-05-30T16:48:41.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d3a000640 1 -- 172.21.15.107:0/258152695 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f7d3c014da0 con 0x7f7d4415ea20 2024-05-30T16:48:41.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.716+0000 7f7d49200640 1 -- 172.21.15.107:0/258152695 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d44075680 con 0x7f7d4415ea20 2024-05-30T16:48:41.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.720+0000 7f7d3a000640 1 -- 172.21.15.107:0/258152695 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7d3c022070 con 0x7f7d4415ea20 2024-05-30T16:48:41.720 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:41.718+0000 7f02220ee180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-30T16:48:41.763 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:41.764+0000 7efdf2c48180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-30T16:48:41.785 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:41.782+0000 7f02220ee180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-30T16:48:41.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.784+0000 7f7d49200640 1 -- 172.21.15.107:0/258152695 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "55f90922-47ad-445a-93b1-2478afbc03ce", "id": 4} v 0) -- 0x7f7d44068a90 con 0x7f7d4415ea20 2024-05-30T16:48:41.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.792+0000 7f7d3a000640 1 -- 172.21.15.107:0/258152695 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "55f90922-47ad-445a-93b1-2478afbc03ce", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f7d44144e60 con 0x7f7d4415ea20 2024-05-30T16:48:41.792 INFO:teuthology.orchestra.run.smithi107.stdout:4 2024-05-30T16:48:41.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.792+0000 7f7d49200640 1 -- 172.21.15.107:0/258152695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d4415ea20 msgr2=0x7f7d440c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.792+0000 7f7d49200640 1 --2- 172.21.15.107:0/258152695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d4415ea20 0x7f7d440c7bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009dd0 tx=0x7f7d3c00c490 comp rx=0 tx=0).stop 2024-05-30T16:48:41.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.792+0000 7f7d49200640 1 -- 172.21.15.107:0/258152695 shutdown_connections 2024-05-30T16:48:41.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.792+0000 7f7d49200640 1 --2- 172.21.15.107:0/258152695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d4415ea20 0x7f7d440c7bf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.792+0000 7f7d49200640 1 --2- 172.21.15.107:0/258152695 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d440ccd40 0x7f7d44144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.792+0000 7f7d49200640 1 --2- 172.21.15.107:0/258152695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d440b0500 0x7f7d44156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.792+0000 7f7d49200640 1 -- 172.21.15.107:0/258152695 >> 172.21.15.107:0/258152695 conn(0x7f7d440b2f50 msgr2=0x7f7d4406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:41.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.792+0000 7f7d49200640 1 -- 172.21.15.107:0/258152695 shutdown_connections 2024-05-30T16:48:41.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.792+0000 7f7d49200640 1 -- 172.21.15.107:0/258152695 wait complete. 2024-05-30T16:48:41.811 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 1c557515-2bf0-4537-869c-2fa7818cf9f2 5 2024-05-30T16:48:41.849 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:41.846+0000 7f02220ee180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-30T16:48:41.856 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:41.855+0000 7efdf2c48180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-30T16:48:41.918 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:41.915+0000 7efdf2c48180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-30T16:48:41.941 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:41.938+0000 7f02220ee180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-30T16:48:41.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.943+0000 7f1fb7200640 1 Processor -- start 2024-05-30T16:48:41.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.943+0000 7f1fb7200640 1 -- start start 2024-05-30T16:48:41.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.947+0000 7f1fb7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb00d05b0 0x7f1fb009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.947+0000 7f1fb7200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb0070950 con 0x7f1fb009af80 2024-05-30T16:48:41.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.947+0000 7f1fb7200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb0070c30 con 0x7f1fb00d14c0 2024-05-30T16:48:41.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.947+0000 7f1fb7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb0070f10 con 0x7f1fb00d05b0 2024-05-30T16:48:41.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.947+0000 7f1faf400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb00d05b0 0x7f1fb009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.947+0000 7f1fafe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1fb00d14c0 0x7f1fb006e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35746/0 (socket says 172.21.15.107:35746) 2024-05-30T16:48:41.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.947+0000 7f1fafe00640 1 -- 172.21.15.107:0/329585450 learned_addr learned my addr 172.21.15.107:0/329585450 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-30T16:48:41.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.947+0000 7f1faf400640 1 -- 172.21.15.107:0/329585450 >> v1:172.21.15.107:6789/0 conn(0x7f1fb00d14c0 legacy=0x7f1fb006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.947+0000 7f1faf400640 1 -- 172.21.15.107:0/329585450 >> v1:172.21.15.59:6789/0 conn(0x7f1fb009af80 legacy=0x7f1fb006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.947+0000 7f1faf400640 1 -- 172.21.15.107:0/329585450 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb006cbd0 con 0x7f1fb00d05b0 2024-05-30T16:48:41.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.947+0000 7f1faea00640 1 -- 172.21.15.107:0/329585450 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3877719837 0 0) 0x7f1fb0070c30 con 0x7f1fb00d14c0 2024-05-30T16:48:41.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1faf400640 1 --2- 172.21.15.107:0/329585450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb00d05b0 0x7f1fb009aa40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0097f0 tx=0x7f1f9c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92b740f5af38c980 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:41.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1faea00640 1 -- 172.21.15.107:0/329585450 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0ab5f0 con 0x7f1fb00d05b0 2024-05-30T16:48:41.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1faea00640 1 -- 172.21.15.107:0/329585450 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f9c0b0070 con 0x7f1fb00d05b0 2024-05-30T16:48:41.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1faea00640 1 -- 172.21.15.107:0/329585450 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0ab9b0 con 0x7f1fb00d05b0 2024-05-30T16:48:41.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 -- 172.21.15.107:0/329585450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb00d05b0 msgr2=0x7f1fb009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 --2- 172.21.15.107:0/329585450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb00d05b0 0x7f1fb009aa40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0097f0 tx=0x7f1f9c01c4e0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 -- 172.21.15.107:0/329585450 shutdown_connections 2024-05-30T16:48:41.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 --2- 172.21.15.107:0/329585450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb00d05b0 0x7f1fb009aa40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 -- 172.21.15.107:0/329585450 >> 172.21.15.107:0/329585450 conn(0x7f1fb00b3f80 msgr2=0x7f1fb00b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:41.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 -- 172.21.15.107:0/329585450 shutdown_connections 2024-05-30T16:48:41.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 -- 172.21.15.107:0/329585450 wait complete. 2024-05-30T16:48:41.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 Processor -- start 2024-05-30T16:48:41.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 -- start start 2024-05-30T16:48:41.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb009af80 0x7f1fb01586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb00d05b0 0x7f1fb0158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb00d14c0 0x7f1fb015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb006e190 con 0x7f1fb00d14c0 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb006e010 con 0x7f1fb00d05b0 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.951+0000 7f1fb7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb006e310 con 0x7f1fb009af80 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fafe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb009af80 0x7f1fb01586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fafe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb009af80 0x7f1fb01586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:46224/0 (socket says 172.21.15.107:46224) 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fafe00640 1 -- 172.21.15.107:0/773133643 learned_addr learned my addr 172.21.15.107:0/773133643 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1faf400640 1 --2- 172.21.15.107:0/773133643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb00d05b0 0x7f1fb0158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fb5200640 1 --2- 172.21.15.107:0/773133643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb00d14c0 0x7f1fb015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1faf400640 1 -- 172.21.15.107:0/773133643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb009af80 msgr2=0x7f1fb01586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1faf400640 1 --2- 172.21.15.107:0/773133643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb009af80 0x7f1fb01586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1faf400640 1 -- 172.21.15.107:0/773133643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb00d14c0 msgr2=0x7f1fb015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1faf400640 1 --2- 172.21.15.107:0/773133643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb00d14c0 0x7f1fb015e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1faf400640 1 -- 172.21.15.107:0/773133643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb015d710 con 0x7f1fb00d05b0 2024-05-30T16:48:41.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fafe00640 1 --2- 172.21.15.107:0/773133643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb009af80 0x7f1fb01586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:48:41.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1faf400640 1 --2- 172.21.15.107:0/773133643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb00d05b0 0x7f1fb0158c20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0ac000 tx=0x7f1f9c01ad20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:41.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fa7e00640 1 -- 172.21.15.107:0/773133643 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0bf610 con 0x7f1fb00d05b0 2024-05-30T16:48:41.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fa7e00640 1 -- 172.21.15.107:0/773133643 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f9c0bf7f0 con 0x7f1fb00d05b0 2024-05-30T16:48:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fb7200640 1 -- 172.21.15.107:0/773133643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb015d9f0 con 0x7f1fb00d05b0 2024-05-30T16:48:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fa7e00640 1 -- 172.21.15.107:0/773133643 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0bfbe0 con 0x7f1fb00d05b0 2024-05-30T16:48:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fb7200640 1 -- 172.21.15.107:0/773133643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb015d2f0 con 0x7f1fb00d05b0 2024-05-30T16:48:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fa7e00640 1 -- 172.21.15.107:0/773133643 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f9c0bd020 con 0x7f1fb00d05b0 2024-05-30T16:48:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fa7e00640 1 -- 172.21.15.107:0/773133643 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f1f9c0bfd80 con 0x7f1fb00d05b0 2024-05-30T16:48:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.955+0000 7f1fb7200640 1 -- 172.21.15.107:0/773133643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb0068a90 con 0x7f1fb00d05b0 2024-05-30T16:48:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:41.959+0000 7f1fa7e00640 1 -- 172.21.15.107:0/773133643 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1f9c0160d0 con 0x7f1fb00d05b0 2024-05-30T16:48:42.005 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:42.002+0000 7f02220ee180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-30T16:48:42.010 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:42.007+0000 7efdf2c48180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-30T16:48:42.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.023+0000 7f1fb7200640 1 -- 172.21.15.107:0/773133643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1c557515-2bf0-4537-869c-2fa7818cf9f2", "id": 5} v 0) -- 0x7f1fb006d270 con 0x7f1fb00d05b0 2024-05-30T16:48:42.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.031+0000 7f1fa7e00640 1 -- 172.21.15.107:0/773133643 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1c557515-2bf0-4537-869c-2fa7818cf9f2", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f1f9c0b5790 con 0x7f1fb00d05b0 2024-05-30T16:48:42.032 INFO:teuthology.orchestra.run.smithi107.stdout:5 2024-05-30T16:48:42.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.031+0000 7f1fb7200640 1 -- 172.21.15.107:0/773133643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb00d05b0 msgr2=0x7f1fb0158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.031+0000 7f1fb7200640 1 --2- 172.21.15.107:0/773133643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb00d05b0 0x7f1fb0158c20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0ac000 tx=0x7f1f9c01ad20 comp rx=0 tx=0).stop 2024-05-30T16:48:42.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.031+0000 7f1fb7200640 1 -- 172.21.15.107:0/773133643 shutdown_connections 2024-05-30T16:48:42.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.031+0000 7f1fb7200640 1 --2- 172.21.15.107:0/773133643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb00d14c0 0x7f1fb015e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.031+0000 7f1fb7200640 1 --2- 172.21.15.107:0/773133643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb00d05b0 0x7f1fb0158c20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.031+0000 7f1fb7200640 1 --2- 172.21.15.107:0/773133643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1fb009af80 0x7f1fb01586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.031+0000 7f1fb7200640 1 -- 172.21.15.107:0/773133643 >> 172.21.15.107:0/773133643 conn(0x7f1fb00b3f80 msgr2=0x7f1fb006e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:42.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.031+0000 7f1fb7200640 1 -- 172.21.15.107:0/773133643 shutdown_connections 2024-05-30T16:48:42.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.031+0000 7f1fb7200640 1 -- 172.21.15.107:0/773133643 wait complete. 2024-05-30T16:48:42.051 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc 6 2024-05-30T16:48:42.079 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:42.079+0000 7efdf2c48180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-30T16:48:42.098 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:42.094+0000 7f02220ee180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-30T16:48:42.163 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:42.162+0000 7f02220ee180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-30T16:48:42.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.183+0000 7feaf8000640 1 Processor -- start 2024-05-30T16:48:42.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.183+0000 7feaf8000640 1 -- start start 2024-05-30T16:48:42.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf8000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf0160d90 0x7feaf009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf8000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feaf009b780 0x7feaf009af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf8000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf00d1310 con 0x7feaf00711e0 2024-05-30T16:48:42.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf8000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7feaf00ced30 con 0x7feaf009b780 2024-05-30T16:48:42.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf8000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7feaf009bcf0 con 0x7feaf0160d90 2024-05-30T16:48:42.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf5600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf0160d90 0x7feaf009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf4c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feaf009b780 0x7feaf009af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf5600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf0160d90 0x7feaf009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:46230/0 (socket says 172.21.15.107:46230) 2024-05-30T16:48:42.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf5600640 1 -- 172.21.15.107:0/1844838278 learned_addr learned my addr 172.21.15.107:0/1844838278 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-30T16:48:42.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf5600640 1 -- 172.21.15.107:0/1844838278 >> v2:172.21.15.107:3300/0 conn(0x7feaf009b780 msgr2=0x7feaf009af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:42.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf5600640 1 --2- 172.21.15.107:0/1844838278 >> v2:172.21.15.107:3300/0 conn(0x7feaf009b780 0x7feaf009af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf5600640 1 -- 172.21.15.107:0/1844838278 >> v1:172.21.15.107:6789/0 conn(0x7feaf00711e0 legacy=0x7feaf006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf5600640 1 -- 172.21.15.107:0/1844838278 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf00d0a70 con 0x7feaf0160d90 2024-05-30T16:48:42.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.187+0000 7feaf5600640 1 --2- 172.21.15.107:0/1844838278 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf0160d90 0x7feaf009aa40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feae4009870 tx=0x7feae401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b023847d971346a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:42.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaefe00640 1 -- 172.21.15.107:0/1844838278 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae40b0070 con 0x7feaf0160d90 2024-05-30T16:48:42.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaefe00640 1 -- 172.21.15.107:0/1844838278 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae40ab600 con 0x7feaf0160d90 2024-05-30T16:48:42.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaefe00640 1 -- 172.21.15.107:0/1844838278 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae40ab9d0 con 0x7feaf0160d90 2024-05-30T16:48:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 -- 172.21.15.107:0/1844838278 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf0160d90 msgr2=0x7feaf009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 --2- 172.21.15.107:0/1844838278 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf0160d90 0x7feaf009aa40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feae4009870 tx=0x7feae401c4d0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 -- 172.21.15.107:0/1844838278 shutdown_connections 2024-05-30T16:48:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 --2- 172.21.15.107:0/1844838278 >> v2:172.21.15.107:3300/0 conn(0x7feaf009b780 0x7feaf009af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 --2- 172.21.15.107:0/1844838278 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf0160d90 0x7feaf009aa40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 -- 172.21.15.107:0/1844838278 >> 172.21.15.107:0/1844838278 conn(0x7feaf00b3f80 msgr2=0x7feaf00b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 -- 172.21.15.107:0/1844838278 shutdown_connections 2024-05-30T16:48:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 -- 172.21.15.107:0/1844838278 wait complete. 2024-05-30T16:48:42.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 Processor -- start 2024-05-30T16:48:42.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 -- start start 2024-05-30T16:48:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaf00711e0 0x7feaf01575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf009b780 0x7feaf015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf0160d90 0x7feaf0156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feaf0071fe0 con 0x7feaf00711e0 2024-05-30T16:48:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7feaf0071e60 con 0x7feaf0160d90 2024-05-30T16:48:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf8000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7feaf0161170 con 0x7feaf009b780 2024-05-30T16:48:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf4c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf009b780 0x7feaf015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf4c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf009b780 0x7feaf015f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:46238/0 (socket says 172.21.15.107:46238) 2024-05-30T16:48:42.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf4c00640 1 -- 172.21.15.107:0/2483957892 learned_addr learned my addr 172.21.15.107:0/2483957892 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-30T16:48:42.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.191+0000 7feaf6000640 1 --2- 172.21.15.107:0/2483957892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf0160d90 0x7feaf0156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaf5600640 1 --2- 172.21.15.107:0/2483957892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaf00711e0 0x7feaf01575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaf4c00640 1 -- 172.21.15.107:0/2483957892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf0160d90 msgr2=0x7feaf0156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaf4c00640 1 --2- 172.21.15.107:0/2483957892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf0160d90 0x7feaf0156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaf4c00640 1 -- 172.21.15.107:0/2483957892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaf00711e0 msgr2=0x7feaf01575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaf4c00640 1 --2- 172.21.15.107:0/2483957892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaf00711e0 0x7feaf01575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaf4c00640 1 -- 172.21.15.107:0/2483957892 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf0157e20 con 0x7feaf009b780 2024-05-30T16:48:42.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaf4c00640 1 --2- 172.21.15.107:0/2483957892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf009b780 0x7feaf015f4a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feadc00e8a0 tx=0x7feadc00eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaed600640 1 -- 172.21.15.107:0/2483957892 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc017070 con 0x7feaf009b780 2024-05-30T16:48:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaed600640 1 -- 172.21.15.107:0/2483957892 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feadc00c940 con 0x7feaf009b780 2024-05-30T16:48:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaed600640 1 -- 172.21.15.107:0/2483957892 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc00ccf0 con 0x7feaf009b780 2024-05-30T16:48:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaf8000640 1 -- 172.21.15.107:0/2483957892 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf0157360 con 0x7feaf009b780 2024-05-30T16:48:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaf8000640 1 -- 172.21.15.107:0/2483957892 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf00cad70 con 0x7feaf009b780 2024-05-30T16:48:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaed600640 1 -- 172.21.15.107:0/2483957892 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feadc01a070 con 0x7feaf009b780 2024-05-30T16:48:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaed600640 1 -- 172.21.15.107:0/2483957892 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7feadc006020 con 0x7feaf009b780 2024-05-30T16:48:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.195+0000 7feaf8000640 1 -- 172.21.15.107:0/2483957892 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf0068a90 con 0x7feaf009b780 2024-05-30T16:48:42.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.199+0000 7feaed600640 1 -- 172.21.15.107:0/2483957892 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7feaf0157e20 con 0x7feaf009b780 2024-05-30T16:48:42.252 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:42.251+0000 7efdf2c48180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-30T16:48:42.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.263+0000 7feaf8000640 1 -- 172.21.15.107:0/2483957892 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc", "id": 6} v 0) -- 0x7feaf0074fc0 con 0x7feaf009b780 2024-05-30T16:48:42.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.271+0000 7feaed600640 1 -- 172.21.15.107:0/2483957892 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7feadc006480 con 0x7feaf009b780 2024-05-30T16:48:42.273 INFO:teuthology.orchestra.run.smithi107.stdout:6 2024-05-30T16:48:42.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.271+0000 7feaf8000640 1 -- 172.21.15.107:0/2483957892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf009b780 msgr2=0x7feaf015f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.271+0000 7feaf8000640 1 --2- 172.21.15.107:0/2483957892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf009b780 0x7feaf015f4a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feadc00e8a0 tx=0x7feadc00eca0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.271+0000 7feaf8000640 1 -- 172.21.15.107:0/2483957892 shutdown_connections 2024-05-30T16:48:42.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.271+0000 7feaf8000640 1 --2- 172.21.15.107:0/2483957892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf0160d90 0x7feaf0156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.271+0000 7feaf8000640 1 --2- 172.21.15.107:0/2483957892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feaf009b780 0x7feaf015f4a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.271+0000 7feaf8000640 1 --2- 172.21.15.107:0/2483957892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaf00711e0 0x7feaf01575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.271+0000 7feaf8000640 1 -- 172.21.15.107:0/2483957892 >> 172.21.15.107:0/2483957892 conn(0x7feaf00b3f80 msgr2=0x7feaf00b5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:42.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.271+0000 7feaf8000640 1 -- 172.21.15.107:0/2483957892 shutdown_connections 2024-05-30T16:48:42.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.271+0000 7feaf8000640 1 -- 172.21.15.107:0/2483957892 wait complete. 2024-05-30T16:48:42.293 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 7286638d-077a-494a-b4bf-0dc3ca5326c1 7 2024-05-30T16:48:42.326 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:42.323+0000 7efdf2c48180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-30T16:48:42.337 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:42.334+0000 7f02220ee180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-30T16:48:42.411 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:42.410+0000 7f02220ee180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-30T16:48:42.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.459+0000 7fa69e400640 1 Processor -- start 2024-05-30T16:48:42.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.459+0000 7fa69e400640 1 -- start start 2024-05-30T16:48:42.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.459+0000 7fa69e400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa69809b780 0x7fa6980ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.459+0000 7fa69e400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6980d1310 con 0x7fa69809b150 2024-05-30T16:48:42.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.459+0000 7fa69e400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69809bcf0 con 0x7fa698160d90 2024-05-30T16:48:42.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.459+0000 7fa69e400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa6980d0a70 con 0x7fa69809b780 2024-05-30T16:48:42.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa697400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa698160d90 0x7fa69809aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35776/0 (socket says 172.21.15.107:35776) 2024-05-30T16:48:42.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa697400640 1 -- 172.21.15.107:0/2659064605 learned_addr learned my addr 172.21.15.107:0/2659064605 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-30T16:48:42.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa697e00640 1 --2- 172.21.15.107:0/2659064605 >> v2:172.21.15.107:3300/0 conn(0x7fa69809b780 0x7fa6980ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa696a00640 1 -- 172.21.15.107:0/2659064605 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729215286 0 0) 0x7fa69809bcf0 con 0x7fa698160d90 2024-05-30T16:48:42.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa696a00640 1 -- 172.21.15.107:0/2659064605 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa67c003530 con 0x7fa698160d90 2024-05-30T16:48:42.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa696a00640 1 -- 172.21.15.107:0/2659064605 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283196843 0 0) 0x7fa6980d1310 con 0x7fa69809b150 2024-05-30T16:48:42.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa697e00640 1 -- 172.21.15.107:0/2659064605 >> v1:172.21.15.107:6789/0 conn(0x7fa698160d90 legacy=0x7fa69809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa697e00640 1 -- 172.21.15.107:0/2659064605 >> v1:172.21.15.59:6789/0 conn(0x7fa69809b150 legacy=0x7fa6980cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa697e00640 1 -- 172.21.15.107:0/2659064605 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6980d0d50 con 0x7fa69809b780 2024-05-30T16:48:42.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa697e00640 1 --2- 172.21.15.107:0/2659064605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69809b780 0x7fa6980ce430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa690009d90 tx=0x7fa69001c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8feca3b6322fd3c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:42.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa696a00640 1 -- 172.21.15.107:0/2659064605 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6900b2070 con 0x7fa69809b780 2024-05-30T16:48:42.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa696a00640 1 -- 172.21.15.107:0/2659064605 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6900a5820 con 0x7fa69809b780 2024-05-30T16:48:42.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.463+0000 7fa696a00640 1 -- 172.21.15.107:0/2659064605 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6900a5bf0 con 0x7fa69809b780 2024-05-30T16:48:42.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 -- 172.21.15.107:0/2659064605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69809b780 msgr2=0x7fa6980ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 --2- 172.21.15.107:0/2659064605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69809b780 0x7fa6980ce430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa690009d90 tx=0x7fa69001c850 comp rx=0 tx=0).stop 2024-05-30T16:48:42.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 -- 172.21.15.107:0/2659064605 shutdown_connections 2024-05-30T16:48:42.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 --2- 172.21.15.107:0/2659064605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69809b780 0x7fa6980ce430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 -- 172.21.15.107:0/2659064605 >> 172.21.15.107:0/2659064605 conn(0x7fa6980b3f80 msgr2=0x7fa6980b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:42.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 -- 172.21.15.107:0/2659064605 shutdown_connections 2024-05-30T16:48:42.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 -- 172.21.15.107:0/2659064605 wait complete. 2024-05-30T16:48:42.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 Processor -- start 2024-05-30T16:48:42.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 -- start start 2024-05-30T16:48:42.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa69809b150 0x7fa6980cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69809b780 0x7fa6980b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa698160d90 0x7fa69815e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa6981612f0 con 0x7fa69809b150 2024-05-30T16:48:42.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa698161170 con 0x7fa69809b780 2024-05-30T16:48:42.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa69e400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa69816af90 con 0x7fa698160d90 2024-05-30T16:48:42.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa68fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69809b780 0x7fa6980b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa697e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa698160d90 0x7fa69815e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa697400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa69809b150 0x7fa6980cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa68fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69809b780 0x7fa6980b2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39604/0 (socket says 172.21.15.107:39604) 2024-05-30T16:48:42.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.467+0000 7fa68fe00640 1 -- 172.21.15.107:0/3240012962 learned_addr learned my addr 172.21.15.107:0/3240012962 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-30T16:48:42.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa68fe00640 1 -- 172.21.15.107:0/3240012962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa698160d90 msgr2=0x7fa69815e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa68fe00640 1 --2- 172.21.15.107:0/3240012962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa698160d90 0x7fa69815e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa68fe00640 1 -- 172.21.15.107:0/3240012962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa69809b150 msgr2=0x7fa6980cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa68fe00640 1 --2- 172.21.15.107:0/3240012962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa69809b150 0x7fa6980cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa68fe00640 1 -- 172.21.15.107:0/3240012962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6980b2d70 con 0x7fa69809b780 2024-05-30T16:48:42.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa697e00640 1 --2- 172.21.15.107:0/3240012962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa698160d90 0x7fa69815e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:48:42.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa68fe00640 1 --2- 172.21.15.107:0/3240012962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69809b780 0x7fa6980b2380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa68000c520 tx=0x7fa68000c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:42.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa68f400640 1 -- 172.21.15.107:0/3240012962 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa680017070 con 0x7fa69809b780 2024-05-30T16:48:42.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa68f400640 1 -- 172.21.15.107:0/3240012962 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa680003600 con 0x7fa69809b780 2024-05-30T16:48:42.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa68f400640 1 -- 172.21.15.107:0/3240012962 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6800039f0 con 0x7fa69809b780 2024-05-30T16:48:42.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa69e400640 1 -- 172.21.15.107:0/3240012962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6980b3050 con 0x7fa69809b780 2024-05-30T16:48:42.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa69e400640 1 -- 172.21.15.107:0/3240012962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa698165b40 con 0x7fa69809b780 2024-05-30T16:48:42.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa68f400640 1 -- 172.21.15.107:0/3240012962 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa68001a070 con 0x7fa69809b780 2024-05-30T16:48:42.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa68f400640 1 -- 172.21.15.107:0/3240012962 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa680003b90 con 0x7fa69809b780 2024-05-30T16:48:42.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa69e400640 1 -- 172.21.15.107:0/3240012962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa698068a90 con 0x7fa69809b780 2024-05-30T16:48:42.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.471+0000 7fa68f400640 1 -- 172.21.15.107:0/3240012962 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa680021020 con 0x7fa69809b780 2024-05-30T16:48:42.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.539+0000 7fa69e400640 1 -- 172.21.15.107:0/3240012962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7286638d-077a-494a-b4bf-0dc3ca5326c1", "id": 7} v 0) -- 0x7fa6980b4be0 con 0x7fa69809b780 2024-05-30T16:48:42.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.547+0000 7fa68f400640 1 -- 172.21.15.107:0/3240012962 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7286638d-077a-494a-b4bf-0dc3ca5326c1", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa68001c440 con 0x7fa69809b780 2024-05-30T16:48:42.549 INFO:teuthology.orchestra.run.smithi107.stdout:7 2024-05-30T16:48:42.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.547+0000 7fa69e400640 1 -- 172.21.15.107:0/3240012962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69809b780 msgr2=0x7fa6980b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.547+0000 7fa69e400640 1 --2- 172.21.15.107:0/3240012962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69809b780 0x7fa6980b2380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa68000c520 tx=0x7fa68000c9e0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.547+0000 7fa69e400640 1 -- 172.21.15.107:0/3240012962 shutdown_connections 2024-05-30T16:48:42.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.547+0000 7fa69e400640 1 --2- 172.21.15.107:0/3240012962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa698160d90 0x7fa69815e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.547+0000 7fa69e400640 1 --2- 172.21.15.107:0/3240012962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69809b780 0x7fa6980b2380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.547+0000 7fa69e400640 1 --2- 172.21.15.107:0/3240012962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa69809b150 0x7fa6980cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.547+0000 7fa69e400640 1 -- 172.21.15.107:0/3240012962 >> 172.21.15.107:0/3240012962 conn(0x7fa6980b3f80 msgr2=0x7fa6980ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:42.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.547+0000 7fa69e400640 1 -- 172.21.15.107:0/3240012962 shutdown_connections 2024-05-30T16:48:42.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:48:42.547+0000 7fa69e400640 1 -- 172.21.15.107:0/3240012962 wait complete. 2024-05-30T16:48:42.567 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-30T16:48:42.567 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-30T16:48:42.570 INFO:tasks.ceph.osd.0:Started 2024-05-30T16:48:42.571 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-30T16:48:42.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-30T16:48:42.574 INFO:tasks.ceph.osd.1:Started 2024-05-30T16:48:42.574 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-30T16:48:42.574 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-30T16:48:42.577 INFO:tasks.ceph.osd.2:Started 2024-05-30T16:48:42.577 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-30T16:48:42.577 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-30T16:48:42.580 INFO:tasks.ceph.osd.3:Started 2024-05-30T16:48:42.580 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-30T16:48:42.580 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-30T16:48:42.583 INFO:tasks.ceph.osd.4:Started 2024-05-30T16:48:42.583 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-30T16:48:42.583 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-30T16:48:42.587 INFO:tasks.ceph.osd.5:Started 2024-05-30T16:48:42.588 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-30T16:48:42.588 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-30T16:48:42.591 INFO:tasks.ceph.osd.6:Started 2024-05-30T16:48:42.591 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-30T16:48:42.591 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-30T16:48:42.595 INFO:tasks.ceph.osd.7:Started 2024-05-30T16:48:42.595 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:48:42.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.786+0000 7f39c4a00640 1 Processor -- start 2024-05-30T16:48:42.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.786+0000 7f39c4a00640 1 -- start start 2024-05-30T16:48:42.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39c4a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39c015e680 0x7f39c00d4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39c4a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f39c0162ce0 0x7f39c00b1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39c4a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c015ea60 con 0x7f39c0162170 2024-05-30T16:48:42.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39c4a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f39c00cf570 con 0x7f39c015e680 2024-05-30T16:48:42.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39c4a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f39c00cf7c0 con 0x7f39c0162ce0 2024-05-30T16:48:42.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39bea00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f39c0162170 0x7f39c01625d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:54390/0 (socket says 172.21.15.59:54390) 2024-05-30T16:48:42.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39bea00640 1 -- 172.21.15.59:0/1029411975 learned_addr learned my addr 172.21.15.59:0/1029411975 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:48:42.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39bfe00640 1 --2- 172.21.15.59:0/1029411975 >> v2:172.21.15.107:3300/0 conn(0x7f39c0162ce0 0x7f39c00b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39bf400640 1 --2- 172.21.15.59:0/1029411975 >> v2:172.21.15.59:3300/0 conn(0x7f39c015e680 0x7f39c00d4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39bfe00640 1 -- 172.21.15.59:0/1029411975 >> v2:172.21.15.59:3300/0 conn(0x7f39c015e680 msgr2=0x7f39c00d4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:42.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39bfe00640 1 --2- 172.21.15.59:0/1029411975 >> v2:172.21.15.59:3300/0 conn(0x7f39c015e680 0x7f39c00d4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39bfe00640 1 -- 172.21.15.59:0/1029411975 >> v1:172.21.15.107:6789/0 conn(0x7f39c0162170 legacy=0x7f39c01625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39be000640 1 -- 172.21.15.59:0/1029411975 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387320541 0 0) 0x7f39c015ea60 con 0x7f39c0162170 2024-05-30T16:48:42.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.790+0000 7f39bfe00640 1 -- 172.21.15.59:0/1029411975 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c00cfaa0 con 0x7f39c0162ce0 2024-05-30T16:48:42.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.802+0000 7f39bfe00640 1 --2- 172.21.15.59:0/1029411975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c0162ce0 0x7f39c00b1730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f39c00b70c0 tx=0x7f39b801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56d0020c892e5cc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:42.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.802+0000 7f39be000640 1 -- 172.21.15.59:0/1029411975 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b80b2070 con 0x7f39c0162ce0 2024-05-30T16:48:42.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.802+0000 7f39be000640 1 -- 172.21.15.59:0/1029411975 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b80a5850 con 0x7f39c0162ce0 2024-05-30T16:48:42.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.802+0000 7f39be000640 1 -- 172.21.15.59:0/1029411975 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b80a5c20 con 0x7f39c0162ce0 2024-05-30T16:48:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.802+0000 7f39c4a00640 1 -- 172.21.15.59:0/1029411975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c0162ce0 msgr2=0x7f39c00b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.802+0000 7f39c4a00640 1 --2- 172.21.15.59:0/1029411975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c0162ce0 0x7f39c00b1730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f39c00b70c0 tx=0x7f39b801c8c0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.802+0000 7f39c4a00640 1 -- 172.21.15.59:0/1029411975 shutdown_connections 2024-05-30T16:48:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.802+0000 7f39c4a00640 1 --2- 172.21.15.59:0/1029411975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c0162ce0 0x7f39c00b1730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.802+0000 7f39c4a00640 1 --2- 172.21.15.59:0/1029411975 >> v2:172.21.15.59:3300/0 conn(0x7f39c015e680 0x7f39c00d4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.802+0000 7f39c4a00640 1 -- 172.21.15.59:0/1029411975 >> 172.21.15.59:0/1029411975 conn(0x7f39c008bfd0 msgr2=0x7f39c00d4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.802+0000 7f39c4a00640 1 -- 172.21.15.59:0/1029411975 shutdown_connections 2024-05-30T16:48:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.802+0000 7f39c4a00640 1 -- 172.21.15.59:0/1029411975 wait complete. 2024-05-30T16:48:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.806+0000 7f39c4a00640 1 Processor -- start 2024-05-30T16:48:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.806+0000 7f39c4a00640 1 -- start start 2024-05-30T16:48:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39c4a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c015e680 0x7f39c0158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39c4a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39c0162170 0x7f39c00b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39c4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0162ce0 0x7f39c015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bf400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c015e680 0x7f39c0158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bf400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c015e680 0x7f39c0158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:39224/0 (socket says 172.21.15.59:39224) 2024-05-30T16:48:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39c0162170 0x7f39c00b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39c0162170 0x7f39c00b62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:40938/0 (socket says 172.21.15.59:40938) 2024-05-30T16:48:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39c4a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39c00b2600 con 0x7f39c0162ce0 2024-05-30T16:48:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bf400640 1 -- 172.21.15.59:0/893178869 learned_addr learned my addr 172.21.15.59:0/893178869 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:48:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39c4a00640 1 -- 172.21.15.59:0/893178869 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f39c00b2480 con 0x7f39c015e680 2024-05-30T16:48:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39c4a00640 1 -- 172.21.15.59:0/893178869 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f39c00b2780 con 0x7f39c0162170 2024-05-30T16:48:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bfe00640 1 --2- 172.21.15.59:0/893178869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0162ce0 0x7f39c015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bea00640 1 -- 172.21.15.59:0/893178869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c015e680 msgr2=0x7f39c0158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bea00640 1 --2- 172.21.15.59:0/893178869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c015e680 0x7f39c0158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bea00640 1 -- 172.21.15.59:0/893178869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0162ce0 msgr2=0x7f39c015d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bea00640 1 --2- 172.21.15.59:0/893178869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0162ce0 0x7f39c015d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bea00640 1 -- 172.21.15.59:0/893178869 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c00c81e0 con 0x7f39c0162170 2024-05-30T16:48:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bf400640 1 --2- 172.21.15.59:0/893178869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c015e680 0x7f39c0158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:48:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39bea00640 1 --2- 172.21.15.59:0/893178869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39c0162170 0x7f39c00b62e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f39ac000c10 tx=0x7f39ac00c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.810+0000 7f39b7400640 1 -- 172.21.15.59:0/893178869 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac0074e0 con 0x7f39c0162170 2024-05-30T16:48:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.814+0000 7f39b7400640 1 -- 172.21.15.59:0/893178869 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac0047f0 con 0x7f39c0162170 2024-05-30T16:48:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.814+0000 7f39c4a00640 1 -- 172.21.15.59:0/893178869 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c00c84c0 con 0x7f39c0162170 2024-05-30T16:48:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.814+0000 7f39b7400640 1 -- 172.21.15.59:0/893178869 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac007680 con 0x7f39c0162170 2024-05-30T16:48:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.814+0000 7f39b7400640 1 -- 172.21.15.59:0/893178869 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39ac011070 con 0x7f39c0162170 2024-05-30T16:48:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.814+0000 7f39c4a00640 1 -- 172.21.15.59:0/893178869 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c00c8a80 con 0x7f39c0162170 2024-05-30T16:48:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.814+0000 7f39b7400640 1 -- 172.21.15.59:0/893178869 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f39ac004da0 con 0x7f39c0162170 2024-05-30T16:48:42.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.814+0000 7f39c4a00640 1 -- 172.21.15.59:0/893178869 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c00691a0 con 0x7f39c0162170 2024-05-30T16:48:42.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.818+0000 7f39b7400640 1 -- 172.21.15.59:0/893178869 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f39ac0133c0 con 0x7f39c0162170 2024-05-30T16:48:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.882+0000 7f39c4a00640 1 -- 172.21.15.59:0/893178869 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39c008e630 con 0x7f39c0162170 2024-05-30T16:48:42.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.882+0000 7f39b7400640 1 -- 172.21.15.59:0/893178869 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f39ac0135a0 con 0x7f39c0162170 2024-05-30T16:48:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:42.885 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":10,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:48:42.540914+0000","last_up_change":"0.000000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:48:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.882+0000 7f39c4a00640 1 -- 172.21.15.59:0/893178869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39c0162170 msgr2=0x7f39c00b62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.882+0000 7f39c4a00640 1 --2- 172.21.15.59:0/893178869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39c0162170 0x7f39c00b62e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f39ac000c10 tx=0x7f39ac00c870 comp rx=0 tx=0).stop 2024-05-30T16:48:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.882+0000 7f39c4a00640 1 -- 172.21.15.59:0/893178869 shutdown_connections 2024-05-30T16:48:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.882+0000 7f39c4a00640 1 --2- 172.21.15.59:0/893178869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0162ce0 0x7f39c015d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.882+0000 7f39c4a00640 1 --2- 172.21.15.59:0/893178869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39c0162170 0x7f39c00b62e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.882+0000 7f39c4a00640 1 --2- 172.21.15.59:0/893178869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c015e680 0x7f39c0158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.882+0000 7f39c4a00640 1 -- 172.21.15.59:0/893178869 >> 172.21.15.59:0/893178869 conn(0x7f39c008bfd0 msgr2=0x7f39c00d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.882+0000 7f39c4a00640 1 -- 172.21.15.59:0/893178869 shutdown_connections 2024-05-30T16:48:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:42.882+0000 7f39c4a00640 1 -- 172.21.15.59:0/893178869 wait complete. 2024-05-30T16:48:42.904 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-30T16:48:42.905 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-30T16:48:42.971 INFO:tasks.ceph.mgr.x.smithi107.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-30T16:48:42.971 INFO:tasks.ceph.mgr.x.smithi107.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-30T16:48:42.971 INFO:tasks.ceph.mgr.x.smithi107.stderr: from numpy import show_config as show_numpy_config 2024-05-30T16:48:43.040 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:43.039+0000 7efdf2c48180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-30T16:48:43.090 INFO:tasks.ceph.mgr.y.smithi059.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-30T16:48:43.090 INFO:tasks.ceph.mgr.y.smithi059.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-30T16:48:43.090 INFO:tasks.ceph.mgr.y.smithi059.stderr: from numpy import show_config as show_numpy_config 2024-05-30T16:48:43.133 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:43.130+0000 7f02220ee180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-30T16:48:43.188 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:43.187+0000 7efdf2c48180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-30T16:48:43.231 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-05-30T16:48:43.230+0000 7f91df4937c0 -1 Falling back to public interface 2024-05-30T16:48:43.240 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-05-30T16:48:43.238+0000 7f96e07437c0 -1 Falling back to public interface 2024-05-30T16:48:43.253 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-05-30T16:48:43.250+0000 7f3a010a77c0 -1 Falling back to public interface 2024-05-30T16:48:43.259 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-05-30T16:48:43.258+0000 7f9d53b297c0 -1 Falling back to public interface 2024-05-30T16:48:43.268 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-30T16:48:43.267+0000 7fd5d30f07c0 -1 Falling back to public interface 2024-05-30T16:48:43.292 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-30T16:48:43.291+0000 7f7056d617c0 -1 Falling back to public interface 2024-05-30T16:48:43.296 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:43.294+0000 7f02220ee180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-30T16:48:43.304 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-30T16:48:43.303+0000 7ff2e96ec7c0 -1 Falling back to public interface 2024-05-30T16:48:43.332 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-30T16:48:43.331+0000 7f37590a47c0 -1 Falling back to public interface 2024-05-30T16:48:43.365 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:43.363+0000 7efdf2c48180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-30T16:48:43.438 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:43.435+0000 7efdf2c48180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-30T16:48:43.509 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:43.506+0000 7f02220ee180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-30T16:48:43.586 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:43.586+0000 7f02220ee180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-30T16:48:43.587 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:43.587+0000 7efdf2c48180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-30T16:48:43.710 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-30T16:48:43.744 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:43.742+0000 7f02220ee180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-30T16:48:43.841 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.838+0000 7f20ce800640 1 Processor -- start 2024-05-30T16:48:43.842 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.838+0000 7f20ce800640 1 -- start start 2024-05-30T16:48:43.843 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20ce800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20c806d8a0 0x7f20c815f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:43.843 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20ce800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f20c809a9e0 0x7f20c815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:43.843 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20ce800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20c809af80 con 0x7f20c8161f50 2024-05-30T16:48:43.843 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20ce800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f20c815fe80 con 0x7f20c809a9e0 2024-05-30T16:48:43.843 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20ce800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f20c80d1b60 con 0x7f20c806d8a0 2024-05-30T16:48:43.843 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20c7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f20c8161f50 0x7f20c806d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47430/0 (socket says 172.21.15.59:47430) 2024-05-30T16:48:43.843 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20c7400640 1 -- 172.21.15.59:0/1385498182 learned_addr learned my addr 172.21.15.59:0/1385498182 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:48:43.843 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20c7e00640 1 --2- 172.21.15.59:0/1385498182 >> v2:172.21.15.59:3300/0 conn(0x7f20c809a9e0 0x7f20c815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:43.844 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20bfe00640 1 --2- 172.21.15.59:0/1385498182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20c806d8a0 0x7f20c815f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:43.844 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20c6a00640 1 -- 172.21.15.59:0/1385498182 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2125588583 0 0) 0x7f20c809af80 con 0x7f20c8161f50 2024-05-30T16:48:43.844 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20c7e00640 1 -- 172.21.15.59:0/1385498182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20c806d8a0 msgr2=0x7f20c815f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:43.844 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20c7e00640 1 --2- 172.21.15.59:0/1385498182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20c806d8a0 0x7f20c815f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:43.844 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20c7e00640 1 -- 172.21.15.59:0/1385498182 >> v1:172.21.15.59:6789/0 conn(0x7f20c8161f50 legacy=0x7f20c806d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:43.844 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.842+0000 7f20c7e00640 1 -- 172.21.15.59:0/1385498182 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c809b260 con 0x7f20c809a9e0 2024-05-30T16:48:43.846 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20c7e00640 1 --2- 172.21.15.59:0/1385498182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c809a9e0 0x7f20c815e1a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009d90 tx=0x7f20c001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfe15601063a459 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:43.847 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20c6a00640 1 -- 172.21.15.59:0/1385498182 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c00b2070 con 0x7f20c809a9e0 2024-05-30T16:48:43.847 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20c6a00640 1 -- 172.21.15.59:0/1385498182 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c00a5930 con 0x7f20c809a9e0 2024-05-30T16:48:43.847 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20c6a00640 1 -- 172.21.15.59:0/1385498182 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c00a5d00 con 0x7f20c809a9e0 2024-05-30T16:48:43.848 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 -- 172.21.15.59:0/1385498182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c809a9e0 msgr2=0x7f20c815e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:43.848 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 --2- 172.21.15.59:0/1385498182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c809a9e0 0x7f20c815e1a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009d90 tx=0x7f20c001c870 comp rx=0 tx=0).stop 2024-05-30T16:48:43.848 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 -- 172.21.15.59:0/1385498182 shutdown_connections 2024-05-30T16:48:43.848 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 --2- 172.21.15.59:0/1385498182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c809a9e0 0x7f20c815e1a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:43.848 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 --2- 172.21.15.59:0/1385498182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20c806d8a0 0x7f20c815f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:43.848 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 -- 172.21.15.59:0/1385498182 >> 172.21.15.59:0/1385498182 conn(0x7f20c80b4020 msgr2=0x7f20c80b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:43.848 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 -- 172.21.15.59:0/1385498182 shutdown_connections 2024-05-30T16:48:43.848 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 -- 172.21.15.59:0/1385498182 wait complete. 2024-05-30T16:48:43.849 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 Processor -- start 2024-05-30T16:48:43.849 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 -- start start 2024-05-30T16:48:43.852 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20c806d8a0 0x7f20c8160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:43.852 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c809a9e0 0x7f20c80b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:43.852 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20c8161f50 0x7f20c81fade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:43.852 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81603b0 con 0x7f20c809a9e0 2024-05-30T16:48:43.852 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f20c8160230 con 0x7f20c806d8a0 2024-05-30T16:48:43.852 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20ce800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f20c80d0b50 con 0x7f20c8161f50 2024-05-30T16:48:43.852 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.846+0000 7f20bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c809a9e0 0x7f20c80b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:43.852 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c809a9e0 0x7f20c80b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42874/0 (socket says 172.21.15.59:42874) 2024-05-30T16:48:43.852 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bfe00640 1 -- 172.21.15.59:0/3505269435 learned_addr learned my addr 172.21.15.59:0/3505269435 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:48:43.852 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20c7e00640 1 --2- 172.21.15.59:0/3505269435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20c8161f50 0x7f20c81fade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:43.852 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20c7400640 1 --2- 172.21.15.59:0/3505269435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20c806d8a0 0x7f20c8160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bfe00640 1 -- 172.21.15.59:0/3505269435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20c8161f50 msgr2=0x7f20c81fade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bfe00640 1 --2- 172.21.15.59:0/3505269435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20c8161f50 0x7f20c81fade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bfe00640 1 -- 172.21.15.59:0/3505269435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20c806d8a0 msgr2=0x7f20c8160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bfe00640 1 --2- 172.21.15.59:0/3505269435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20c806d8a0 0x7f20c8160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bfe00640 1 -- 172.21.15.59:0/3505269435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c8155be0 con 0x7f20c809a9e0 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20c7400640 1 --2- 172.21.15.59:0/3505269435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20c806d8a0 0x7f20c8160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bfe00640 1 --2- 172.21.15.59:0/3505269435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c809a9e0 0x7f20c80b34b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20b000e960 tx=0x7f20b000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bf400640 1 -- 172.21.15.59:0/3505269435 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0017070 con 0x7f20c809a9e0 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bf400640 1 -- 172.21.15.59:0/3505269435 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b000ca00 con 0x7f20c809a9e0 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20ce800640 1 -- 172.21.15.59:0/3505269435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c8155ec0 con 0x7f20c809a9e0 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bf400640 1 -- 172.21.15.59:0/3505269435 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b000cdb0 con 0x7f20c809a9e0 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20ce800640 1 -- 172.21.15.59:0/3505269435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c80b5150 con 0x7f20c809a9e0 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bf400640 1 -- 172.21.15.59:0/3505269435 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f20b001a070 con 0x7f20c809a9e0 2024-05-30T16:48:43.853 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20bf400640 1 -- 172.21.15.59:0/3505269435 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f20b0013b40 con 0x7f20c809a9e0 2024-05-30T16:48:43.854 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.850+0000 7f20ce800640 1 -- 172.21.15.59:0/3505269435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c804fcf0 con 0x7f20c809a9e0 2024-05-30T16:48:43.855 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.854+0000 7f20bf400640 1 -- 172.21.15.59:0/3505269435 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f20b0013470 con 0x7f20c809a9e0 2024-05-30T16:48:43.913 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.910+0000 7f20ce800640 1 -- 172.21.15.59:0/3505269435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20c80b4c10 con 0x7f20c809a9e0 2024-05-30T16:48:43.914 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.910+0000 7f20bf400640 1 -- 172.21.15.59:0/3505269435 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f20b0013650 con 0x7f20c809a9e0 2024-05-30T16:48:43.914 INFO:teuthology.misc.health.smithi059.stdout: 2024-05-30T16:48:43.915 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":10,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:48:42.540914+0000","last_up_change":"0.000000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:48:43.915 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.914+0000 7f20ce800640 1 -- 172.21.15.59:0/3505269435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c809a9e0 msgr2=0x7f20c80b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:43.916 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.914+0000 7f20ce800640 1 --2- 172.21.15.59:0/3505269435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c809a9e0 0x7f20c80b34b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20b000e960 tx=0x7f20b000ee20 comp rx=0 tx=0).stop 2024-05-30T16:48:43.916 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.914+0000 7f20ce800640 1 -- 172.21.15.59:0/3505269435 shutdown_connections 2024-05-30T16:48:43.916 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.914+0000 7f20ce800640 1 --2- 172.21.15.59:0/3505269435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20c8161f50 0x7f20c81fade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:43.916 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.914+0000 7f20ce800640 1 --2- 172.21.15.59:0/3505269435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c809a9e0 0x7f20c80b34b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:43.916 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.914+0000 7f20ce800640 1 --2- 172.21.15.59:0/3505269435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20c806d8a0 0x7f20c8160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:43.916 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.914+0000 7f20ce800640 1 -- 172.21.15.59:0/3505269435 >> 172.21.15.59:0/3505269435 conn(0x7f20c80b4020 msgr2=0x7f20c8070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:43.916 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.914+0000 7f20ce800640 1 -- 172.21.15.59:0/3505269435 shutdown_connections 2024-05-30T16:48:43.916 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:43.914+0000 7f20ce800640 1 -- 172.21.15.59:0/3505269435 wait complete. 2024-05-30T16:48:43.932 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-30T16:48:44.282 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:44.279+0000 7efdf2c48180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-30T16:48:44.368 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:44.367+0000 7efdf2c48180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-30T16:48:44.455 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:44.454+0000 7f02220ee180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-30T16:48:44.547 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:44.546+0000 7f02220ee180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-30T16:48:44.572 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:44.571+0000 7efdf2c48180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-30T16:48:44.655 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:44.655+0000 7efdf2c48180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-30T16:48:44.761 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:44.758+0000 7f02220ee180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-30T16:48:44.849 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:44.846+0000 7f02220ee180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-30T16:48:44.984 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:44.983+0000 7efdf2c48180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-30T16:48:45.055 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:45.051+0000 7efdf2c48180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-30T16:48:45.204 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:45.202+0000 7f02220ee180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-30T16:48:45.278 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-05-30T16:48:45.274+0000 7f02220ee180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-30T16:48:46.082 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:46.079+0000 7efd98200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-30T16:48:46.084 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:48:46.083+0000 7efd98200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-30T16:48:47.094 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-05-30T16:48:47.090+0000 7f91df4937c0 -1 osd.3 0 log_to_monitors true 2024-05-30T16:48:47.133 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-30T16:48:47.131+0000 7fd5d30f07c0 -1 osd.6 0 log_to_monitors true 2024-05-30T16:48:47.139 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-05-30T16:48:47.134+0000 7f9d53b297c0 -1 osd.1 0 log_to_monitors true 2024-05-30T16:48:47.230 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-05-30T16:48:47.226+0000 7f96e07437c0 -1 osd.2 0 log_to_monitors true 2024-05-30T16:48:47.241 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-30T16:48:47.239+0000 7f7056d617c0 -1 osd.4 0 log_to_monitors true 2024-05-30T16:48:47.256 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-05-30T16:48:47.250+0000 7f3a010a77c0 -1 osd.0 0 log_to_monitors true 2024-05-30T16:48:47.257 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-30T16:48:47.255+0000 7f37590a47c0 -1 osd.7 0 log_to_monitors true 2024-05-30T16:48:47.268 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-30T16:48:47.267+0000 7ff2e96ec7c0 -1 osd.5 0 log_to_monitors true 2024-05-30T16:48:49.118 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-05-30T16:48:49.110+0000 7f91dae00640 -1 osd.3 0 waiting for initial osdmap 2024-05-30T16:48:49.192 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-05-30T16:48:49.186+0000 7f91d0400640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:48:50.738 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-30T16:48:50.924 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.918+0000 7f2eb7200640 1 Processor -- start 2024-05-30T16:48:50.924 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.918+0000 7f2eb7200640 1 -- start start 2024-05-30T16:48:50.925 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.918+0000 7f2eb7200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2eb006dae0 0x7f2eb00d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:50.925 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.918+0000 7f2eb7200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb00cd4d0 con 0x7f2eb009b0f0 2024-05-30T16:48:50.926 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.918+0000 7f2eb7200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb00d06b0 con 0x7f2eb00b15b0 2024-05-30T16:48:50.926 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.918+0000 7f2eb7200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb00d0990 con 0x7f2eb006dae0 2024-05-30T16:48:50.927 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.918+0000 7f2eb5400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2eb009b0f0 0x7f2eb015df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47438/0 (socket says 172.21.15.59:47438) 2024-05-30T16:48:50.927 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.918+0000 7f2eb5400640 1 -- 172.21.15.59:0/264855507 learned_addr learned my addr 172.21.15.59:0/264855507 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:48:50.927 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.918+0000 7f2eb6800640 1 --2- 172.21.15.59:0/264855507 >> v2:172.21.15.107:3300/0 conn(0x7f2eb006dae0 0x7f2eb00d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:50.927 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.922+0000 7f2eb4a00640 1 -- 172.21.15.59:0/264855507 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3082918886 0 0) 0x7f2eb00d06b0 con 0x7f2eb00b15b0 2024-05-30T16:48:50.927 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.922+0000 7f2eb4a00640 1 -- 172.21.15.59:0/264855507 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e98003530 con 0x7f2eb00b15b0 2024-05-30T16:48:50.927 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.922+0000 7f2eb4a00640 1 -- 172.21.15.59:0/264855507 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975407394 0 0) 0x7f2eb00cd4d0 con 0x7f2eb009b0f0 2024-05-30T16:48:50.927 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.922+0000 7f2eb4a00640 1 -- 172.21.15.59:0/264855507 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2eb00d06b0 con 0x7f2eb009b0f0 2024-05-30T16:48:50.930 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.922+0000 7f2eb6800640 1 -- 172.21.15.59:0/264855507 >> v1:172.21.15.107:6789/0 conn(0x7f2eb00b15b0 legacy=0x7f2eb009a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:50.930 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.922+0000 7f2eb6800640 1 -- 172.21.15.59:0/264855507 >> v1:172.21.15.59:6789/0 conn(0x7f2eb009b0f0 legacy=0x7f2eb015df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:50.930 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.922+0000 7f2eb6800640 1 -- 172.21.15.59:0/264855507 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb00d0c70 con 0x7f2eb006dae0 2024-05-30T16:48:50.932 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.926+0000 7f2eb6800640 1 --2- 172.21.15.59:0/264855507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb006dae0 0x7f2eb00d00d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23b95c4a2dcf3355 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:50.933 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.926+0000 7f2eb4a00640 1 -- 172.21.15.59:0/264855507 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0b2070 con 0x7f2eb006dae0 2024-05-30T16:48:50.934 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.926+0000 7f2eb4a00640 1 -- 172.21.15.59:0/264855507 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac0a5910 con 0x7f2eb006dae0 2024-05-30T16:48:50.934 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.926+0000 7f2eb4a00640 1 -- 172.21.15.59:0/264855507 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0a5ce0 con 0x7f2eb006dae0 2024-05-30T16:48:50.934 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.926+0000 7f2eb7200640 1 -- 172.21.15.59:0/264855507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb006dae0 msgr2=0x7f2eb00d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:50.934 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.926+0000 7f2eb7200640 1 --2- 172.21.15.59:0/264855507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb006dae0 0x7f2eb00d00d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac01c940 comp rx=0 tx=0).stop 2024-05-30T16:48:50.934 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.926+0000 7f2eb7200640 1 -- 172.21.15.59:0/264855507 shutdown_connections 2024-05-30T16:48:50.934 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.926+0000 7f2eb7200640 1 --2- 172.21.15.59:0/264855507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb006dae0 0x7f2eb00d00d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:50.934 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.926+0000 7f2eb7200640 1 -- 172.21.15.59:0/264855507 >> 172.21.15.59:0/264855507 conn(0x7f2eb00b3de0 msgr2=0x7f2eb00b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:50.935 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.926+0000 7f2eb7200640 1 -- 172.21.15.59:0/264855507 shutdown_connections 2024-05-30T16:48:50.935 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.930+0000 7f2eb7200640 1 -- 172.21.15.59:0/264855507 wait complete. 2024-05-30T16:48:50.937 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.930+0000 7f2eb7200640 1 Processor -- start 2024-05-30T16:48:50.938 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.930+0000 7f2eb7200640 1 -- start start 2024-05-30T16:48:50.938 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb006dae0 0x7f2eb0151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:50.939 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2eb009b0f0 0x7f2eb00c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:50.939 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb00b15b0 0x7f2eb006fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:50.939 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb00b1b10 con 0x7f2eb006dae0 2024-05-30T16:48:50.939 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb00b1990 con 0x7f2eb00b15b0 2024-05-30T16:48:50.939 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb016ceb0 con 0x7f2eb009b0f0 2024-05-30T16:48:50.939 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb006dae0 0x7f2eb0151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:50.940 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb006dae0 0x7f2eb0151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42912/0 (socket says 172.21.15.59:42912) 2024-05-30T16:48:50.940 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb5e00640 1 -- 172.21.15.59:0/3114102707 learned_addr learned my addr 172.21.15.59:0/3114102707 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:48:50.940 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb5400640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2eb009b0f0 0x7f2eb00c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:50.941 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb5e00640 1 -- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2eb009b0f0 msgr2=0x7f2eb00c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:50.941 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb5e00640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2eb009b0f0 0x7f2eb00c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:50.941 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb5e00640 1 -- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb00b15b0 msgr2=0x7f2eb006fac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T16:48:50.941 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb5e00640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb00b15b0 0x7f2eb006fac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:50.941 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb5e00640 1 -- 172.21.15.59:0/3114102707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb00c7bd0 con 0x7f2eb006dae0 2024-05-30T16:48:50.941 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb5e00640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb006dae0 0x7f2eb0151b00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400c450 tx=0x7f2ea400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:50.942 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eaa000640 1 -- 172.21.15.59:0/3114102707 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40052d0 con 0x7f2eb006dae0 2024-05-30T16:48:50.942 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eaa000640 1 -- 172.21.15.59:0/3114102707 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea4005470 con 0x7f2eb006dae0 2024-05-30T16:48:50.942 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eaa000640 1 -- 172.21.15.59:0/3114102707 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4012870 con 0x7f2eb006dae0 2024-05-30T16:48:50.942 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb7200640 1 -- 172.21.15.59:0/3114102707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb00c7eb0 con 0x7f2eb006dae0 2024-05-30T16:48:50.942 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.934+0000 7f2eb7200640 1 -- 172.21.15.59:0/3114102707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb0155aa0 con 0x7f2eb006dae0 2024-05-30T16:48:50.943 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.938+0000 7f2eaa000640 1 -- 172.21.15.59:0/3114102707 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f2ea4012a10 con 0x7f2eb006dae0 2024-05-30T16:48:50.944 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.938+0000 7f2eb7200640 1 -- 172.21.15.59:0/3114102707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb00c83d0 con 0x7f2eb006dae0 2024-05-30T16:48:50.946 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.938+0000 7f2eaa000640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2e940683c0 0x7f2e9406a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:50.946 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.938+0000 7f2eaa000640 1 -- 172.21.15.59:0/3114102707 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f2ea40857d0 con 0x7f2eb006dae0 2024-05-30T16:48:50.950 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.946+0000 7f2eb5400640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2e940683c0 0x7f2e9406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:50.951 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.946+0000 7f2eaa000640 1 -- 172.21.15.59:0/3114102707 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2eb00c83d0 con 0x7f2eb006dae0 2024-05-30T16:48:50.951 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:50.946+0000 7f2eb5400640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2e940683c0 0x7f2e9406a880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0007fd0 tx=0x7f2ea0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:51.015 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-05-30T16:48:51.010+0000 7f39fc000640 -1 osd.0 0 waiting for initial osdmap 2024-05-30T16:48:51.016 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-05-30T16:48:51.010+0000 7f9d4f400640 -1 osd.1 0 waiting for initial osdmap 2024-05-30T16:48:51.030 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-05-30T16:48:51.022+0000 7f96db600640 -1 osd.2 0 waiting for initial osdmap 2024-05-30T16:48:51.039 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-05-30T16:48:51.034+0000 7f39f2000640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:48:51.040 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-05-30T16:48:51.034+0000 7f9d44a00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:48:51.055 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-05-30T16:48:51.050+0000 7f96d1600640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:48:51.160 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.154+0000 7f2eb7200640 1 -- 172.21.15.59:0/3114102707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2eb0155ca0 con 0x7f2eb006dae0 2024-05-30T16:48:51.160 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.154+0000 7f2eaa000640 1 -- 172.21.15.59:0/3114102707 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7555 (secure 0 0 0) 0x7f2ea4056b60 con 0x7f2eb006dae0 2024-05-30T16:48:51.161 INFO:teuthology.misc.health.smithi059.stdout: 2024-05-30T16:48:51.161 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":14,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:48:50.133483+0000","last_up_change":"2024-05-30T16:48:50.133483+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:48:51.163 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.158+0000 7f2eb7200640 1 -- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2e940683c0 msgr2=0x7f2e9406a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:51.163 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.158+0000 7f2eb7200640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2e940683c0 0x7f2e9406a880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0007fd0 tx=0x7f2ea0009040 comp rx=0 tx=0).stop 2024-05-30T16:48:51.163 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.158+0000 7f2eb7200640 1 -- 172.21.15.59:0/3114102707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb006dae0 msgr2=0x7f2eb0151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:51.163 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.158+0000 7f2eb7200640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb006dae0 0x7f2eb0151b00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400c450 tx=0x7f2ea400c910 comp rx=0 tx=0).stop 2024-05-30T16:48:51.163 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.158+0000 7f2eb7200640 1 -- 172.21.15.59:0/3114102707 shutdown_connections 2024-05-30T16:48:51.163 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.158+0000 7f2eb7200640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2e940683c0 0x7f2e9406a880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.163 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.158+0000 7f2eb7200640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb00b15b0 0x7f2eb006fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.163 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.158+0000 7f2eb7200640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2eb009b0f0 0x7f2eb00c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.163 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.158+0000 7f2eb7200640 1 --2- 172.21.15.59:0/3114102707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb006dae0 0x7f2eb0151b00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.164 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.158+0000 7f2eb7200640 1 -- 172.21.15.59:0/3114102707 >> 172.21.15.59:0/3114102707 conn(0x7f2eb00b3de0 msgr2=0x7f2eb009a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:51.164 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.158+0000 7f2eb7200640 1 -- 172.21.15.59:0/3114102707 shutdown_connections 2024-05-30T16:48:51.164 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:51.158+0000 7f2eb7200640 1 -- 172.21.15.59:0/3114102707 wait complete. 2024-05-30T16:48:51.179 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-05-30T16:48:51.464 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-30T16:48:51.463+0000 7f7052600640 -1 osd.4 0 waiting for initial osdmap 2024-05-30T16:48:51.466 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-30T16:48:51.463+0000 7fd5ce000640 -1 osd.6 0 waiting for initial osdmap 2024-05-30T16:48:51.472 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-30T16:48:51.471+0000 7ff2e4600640 -1 osd.5 0 waiting for initial osdmap 2024-05-30T16:48:51.473 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-30T16:48:51.471+0000 7f3754a00640 -1 osd.7 0 waiting for initial osdmap 2024-05-30T16:48:51.501 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-30T16:48:51.499+0000 7f7047c00640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:48:51.501 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-30T16:48:51.499+0000 7fd5c4000640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:48:51.501 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-30T16:48:51.499+0000 7ff2da600640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:48:51.502 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-30T16:48:51.499+0000 7f374a000640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:48:57.986 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-30T16:48:58.160 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.122+0000 7fda53600640 1 Processor -- start 2024-05-30T16:48:58.160 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.122+0000 7fda53600640 1 -- start start 2024-05-30T16:48:58.160 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.122+0000 7fda53600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda4c16b400 0x7fda4c0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.160 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.122+0000 7fda53600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fda4c0b3910 0x7fda4c093aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.122+0000 7fda53600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda4c092a00 con 0x7fda4c16b7e0 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.122+0000 7fda53600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fda4c092ce0 con 0x7fda4c0b3910 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.122+0000 7fda53600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fda4c092fc0 con 0x7fda4c16b400 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.122+0000 7fda4be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fda4c16b7e0 0x7fda4c0b3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50328/0 (socket says 172.21.15.59:50328) 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.122+0000 7fda4be00640 1 -- 172.21.15.59:0/3195756407 learned_addr learned my addr 172.21.15.59:0/3195756407 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.126+0000 7fda51600640 1 --2- 172.21.15.59:0/3195756407 >> v2:172.21.15.107:3300/0 conn(0x7fda4c0b3910 0x7fda4c093aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.126+0000 7fda4b400640 1 -- 172.21.15.59:0/3195756407 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062314716 0 0) 0x7fda4c092a00 con 0x7fda4c16b7e0 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.126+0000 7fda50c00640 1 --2- 172.21.15.59:0/3195756407 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda4c16b400 0x7fda4c0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.154+0000 7fda4b400640 1 -- 172.21.15.59:0/3195756407 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda34003510 con 0x7fda4c16b7e0 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.154+0000 7fda51600640 1 -- 172.21.15.59:0/3195756407 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda4c16b400 msgr2=0x7fda4c0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.154+0000 7fda51600640 1 --2- 172.21.15.59:0/3195756407 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda4c16b400 0x7fda4c0d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.154+0000 7fda51600640 1 -- 172.21.15.59:0/3195756407 >> v1:172.21.15.59:6789/0 conn(0x7fda4c16b7e0 legacy=0x7fda4c0b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.161 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.154+0000 7fda51600640 1 -- 172.21.15.59:0/3195756407 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4c0932a0 con 0x7fda4c0b3910 2024-05-30T16:48:58.163 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda51600640 1 --2- 172.21.15.59:0/3195756407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda4c0b3910 0x7fda4c093aa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fda4400be30 tx=0x7fda4401c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7668f70570c0f9cb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:58.163 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda4b400640 1 -- 172.21.15.59:0/3195756407 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4400b2d0 con 0x7fda4c0b3910 2024-05-30T16:48:58.164 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda4b400640 1 -- 172.21.15.59:0/3195756407 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda440a5890 con 0x7fda4c0b3910 2024-05-30T16:48:58.164 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda4b400640 1 -- 172.21.15.59:0/3195756407 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda440a5c80 con 0x7fda4c0b3910 2024-05-30T16:48:58.165 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda53600640 1 -- 172.21.15.59:0/3195756407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda4c0b3910 msgr2=0x7fda4c093aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.165 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda53600640 1 --2- 172.21.15.59:0/3195756407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda4c0b3910 0x7fda4c093aa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fda4400be30 tx=0x7fda4401c9b0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.165 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda53600640 1 -- 172.21.15.59:0/3195756407 shutdown_connections 2024-05-30T16:48:58.165 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda53600640 1 --2- 172.21.15.59:0/3195756407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda4c0b3910 0x7fda4c093aa0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.165 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda53600640 1 --2- 172.21.15.59:0/3195756407 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda4c16b400 0x7fda4c0d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.165 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda53600640 1 -- 172.21.15.59:0/3195756407 >> 172.21.15.59:0/3195756407 conn(0x7fda4c0b5720 msgr2=0x7fda4c0b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:58.165 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda53600640 1 -- 172.21.15.59:0/3195756407 shutdown_connections 2024-05-30T16:48:58.165 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda53600640 1 -- 172.21.15.59:0/3195756407 wait complete. 2024-05-30T16:48:58.166 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.158+0000 7fda53600640 1 Processor -- start 2024-05-30T16:48:58.166 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda53600640 1 -- start start 2024-05-30T16:48:58.168 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda53600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda4c0b3910 0x7fda4c091650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.168 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda53600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda4c16b400 0x7fda4c09b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.168 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda53600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda4c16b7e0 0x7fda4c08a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.168 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda53600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c094b80 con 0x7fda4c16b7e0 2024-05-30T16:48:58.168 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda53600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c094a00 con 0x7fda4c0b3910 2024-05-30T16:48:58.168 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda53600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fda4c094d00 con 0x7fda4c16b400 2024-05-30T16:48:58.168 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda51600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda4c16b7e0 0x7fda4c08a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.168 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda51600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda4c16b7e0 0x7fda4c08a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58434/0 (socket says 172.21.15.59:58434) 2024-05-30T16:48:58.169 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda51600640 1 -- 172.21.15.59:0/2746286894 learned_addr learned my addr 172.21.15.59:0/2746286894 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:48:58.169 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda4be00640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda4c16b400 0x7fda4c09b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.169 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda50c00640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda4c0b3910 0x7fda4c091650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.169 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda51600640 1 -- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda4c16b400 msgr2=0x7fda4c09b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.169 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda51600640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda4c16b400 0x7fda4c09b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.169 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda51600640 1 -- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda4c0b3910 msgr2=0x7fda4c091650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.169 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda51600640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda4c0b3910 0x7fda4c091650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.169 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda51600640 1 -- 172.21.15.59:0/2746286894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4c09bc60 con 0x7fda4c16b7e0 2024-05-30T16:48:58.170 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda51600640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda4c16b7e0 0x7fda4c08a8f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda440af040 tx=0x7fda440092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:58.171 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda48c00640 1 -- 172.21.15.59:0/2746286894 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44003ba0 con 0x7fda4c16b7e0 2024-05-30T16:48:58.171 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda48c00640 1 -- 172.21.15.59:0/2746286894 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda440be070 con 0x7fda4c16b7e0 2024-05-30T16:48:58.171 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda48c00640 1 -- 172.21.15.59:0/2746286894 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda440a6ec0 con 0x7fda4c16b7e0 2024-05-30T16:48:58.171 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda53600640 1 -- 172.21.15.59:0/2746286894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda4c09bf40 con 0x7fda4c16b7e0 2024-05-30T16:48:58.171 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda53600640 1 -- 172.21.15.59:0/2746286894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda4c09c500 con 0x7fda4c16b7e0 2024-05-30T16:48:58.171 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.162+0000 7fda53600640 1 -- 172.21.15.59:0/2746286894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4c088df0 con 0x7fda4c16b7e0 2024-05-30T16:48:58.171 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.166+0000 7fda48c00640 1 -- 172.21.15.59:0/2746286894 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fda44004040 con 0x7fda4c16b7e0 2024-05-30T16:48:58.172 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.166+0000 7fda48c00640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fda2c068520 0x7fda2c06a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.172 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.166+0000 7fda48c00640 1 -- 172.21.15.59:0/2746286894 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fda44121740 con 0x7fda4c16b7e0 2024-05-30T16:48:58.172 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.166+0000 7fda50c00640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fda2c068520 0x7fda2c06a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.172 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.166+0000 7fda50c00640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fda2c068520 0x7fda2c06a9e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fda40009b60 tx=0x7fda40009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:58.177 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.170+0000 7fda48c00640 1 -- 172.21.15.59:0/2746286894 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fda440165d0 con 0x7fda4c16b7e0 2024-05-30T16:48:58.347 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda53600640 1 -- 172.21.15.59:0/2746286894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda4c095460 con 0x7fda4c16b7e0 2024-05-30T16:48:58.348 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda48c00640 1 -- 172.21.15.59:0/2746286894 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12872 (secure 0 0 0) 0x7fda440f1960 con 0x7fda4c16b7e0 2024-05-30T16:48:58.348 INFO:teuthology.misc.health.smithi059.stdout: 2024-05-30T16:48:58.348 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":19,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:48:56.084364+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:48:58.350 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda53600640 1 -- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fda2c068520 msgr2=0x7fda2c06a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.350 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda53600640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fda2c068520 0x7fda2c06a9e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fda40009b60 tx=0x7fda40009190 comp rx=0 tx=0).stop 2024-05-30T16:48:58.350 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda53600640 1 -- 172.21.15.59:0/2746286894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda4c16b7e0 msgr2=0x7fda4c08a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.350 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda53600640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda4c16b7e0 0x7fda4c08a8f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda440af040 tx=0x7fda440092f0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.350 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda53600640 1 -- 172.21.15.59:0/2746286894 shutdown_connections 2024-05-30T16:48:58.350 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda53600640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fda2c068520 0x7fda2c06a9e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.351 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda53600640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda4c16b7e0 0x7fda4c08a8f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.351 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda53600640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda4c16b400 0x7fda4c09b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.351 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda53600640 1 --2- 172.21.15.59:0/2746286894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda4c0b3910 0x7fda4c091650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.351 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda53600640 1 -- 172.21.15.59:0/2746286894 >> 172.21.15.59:0/2746286894 conn(0x7fda4c0b5720 msgr2=0x7fda4c0d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:58.351 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.342+0000 7fda53600640 1 -- 172.21.15.59:0/2746286894 shutdown_connections 2024-05-30T16:48:58.351 INFO:teuthology.misc.health.smithi059.stderr:2024-05-30T16:48:58.346+0000 7fda53600640 1 -- 172.21.15.59:0/2746286894 wait complete. 2024-05-30T16:48:58.368 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-30T16:48:58.368 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-30T16:48:58.369 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T16:48:58.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T16:48:58.372 INFO:tasks.ceph.mds.a:Started 2024-05-30T16:48:58.372 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T16:48:58.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T16:48:58.375 INFO:tasks.ceph.mds.c:Started 2024-05-30T16:48:58.375 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T16:48:58.375 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T16:48:58.379 INFO:tasks.ceph.mds.b:Started 2024-05-30T16:48:58.379 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T16:48:58.379 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T16:48:58.382 INFO:tasks.ceph.mds.d:Started 2024-05-30T16:48:58.383 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-30T16:48:58.383 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:48:58.476 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T16:48:58.477 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-05-30T16:48:58.481 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-30T16:48:58.482 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-30T16:48:58.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ad2a00640 1 Processor -- start 2024-05-30T16:48:58.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ad2a00640 1 -- start start 2024-05-30T16:48:58.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ad2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1acc15e7e0 0x7f1acc0b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ad2a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1acc0b73a0 0x7f1acc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ad2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1acc09af80 0x7f1acc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ad2a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1acc0b61f0 con 0x7f1acc15e7e0 2024-05-30T16:48:58.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ad2a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1acc09b390 con 0x7f1acc0b73a0 2024-05-30T16:48:58.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ad2a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1acc15ebc0 con 0x7f1acc09af80 2024-05-30T16:48:58.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1acbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1acc15e7e0 0x7f1acc0b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1acbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1acc15e7e0 0x7f1acc0b6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58474/0 (socket says 172.21.15.59:58474) 2024-05-30T16:48:58.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ac3e00640 1 --2- 172.21.15.59:0/3532756797 >> v2:172.21.15.107:3300/0 conn(0x7f1acc0b73a0 0x7f1acc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1acbe00640 1 -- 172.21.15.59:0/3532756797 learned_addr learned my addr 172.21.15.59:0/3532756797 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:48:58.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ad0a00640 1 --2- 172.21.15.59:0/3532756797 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1acc09af80 0x7f1acc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ac3e00640 1 -- 172.21.15.59:0/3532756797 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1acc09af80 msgr2=0x7f1acc06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ac3e00640 1 --2- 172.21.15.59:0/3532756797 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1acc09af80 0x7f1acc06d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ac3e00640 1 -- 172.21.15.59:0/3532756797 >> v2:172.21.15.59:3300/0 conn(0x7f1acc15e7e0 msgr2=0x7f1acc0b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ac3e00640 1 --2- 172.21.15.59:0/3532756797 >> v2:172.21.15.59:3300/0 conn(0x7f1acc15e7e0 0x7f1acc0b6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1ac3e00640 1 -- 172.21.15.59:0/3532756797 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc15ee60 con 0x7f1acc0b73a0 2024-05-30T16:48:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.526+0000 7f1acbe00640 1 --2- 172.21.15.59:0/3532756797 >> v2:172.21.15.59:3300/0 conn(0x7f1acc15e7e0 0x7f1acc0b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:48:58.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.530+0000 7f1ac3e00640 1 --2- 172.21.15.59:0/3532756797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1acc0b73a0 0x7f1acc09aa40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1acc06fed0 tx=0x7f1ab401c1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7bdd734220390e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:58.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.530+0000 7f1acb400640 1 -- 172.21.15.59:0/3532756797 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab40b0070 con 0x7f1acc0b73a0 2024-05-30T16:48:58.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.530+0000 7f1acb400640 1 -- 172.21.15.59:0/3532756797 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab40ab600 con 0x7f1acc0b73a0 2024-05-30T16:48:58.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.530+0000 7f1acb400640 1 -- 172.21.15.59:0/3532756797 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab40ab9d0 con 0x7f1acc0b73a0 2024-05-30T16:48:58.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.530+0000 7f1ad2a00640 1 -- 172.21.15.59:0/3532756797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1acc0b73a0 msgr2=0x7f1acc09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.530+0000 7f1ad2a00640 1 --2- 172.21.15.59:0/3532756797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1acc0b73a0 0x7f1acc09aa40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1acc06fed0 tx=0x7f1ab401c1c0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.530+0000 7f1ad2a00640 1 -- 172.21.15.59:0/3532756797 shutdown_connections 2024-05-30T16:48:58.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.530+0000 7f1ad2a00640 1 --2- 172.21.15.59:0/3532756797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1acc0b73a0 0x7f1acc09aa40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.530+0000 7f1ad2a00640 1 --2- 172.21.15.59:0/3532756797 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1acc09af80 0x7f1acc06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.530+0000 7f1ad2a00640 1 --2- 172.21.15.59:0/3532756797 >> v2:172.21.15.59:3300/0 conn(0x7f1acc15e7e0 0x7f1acc0b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.530+0000 7f1ad2a00640 1 -- 172.21.15.59:0/3532756797 >> 172.21.15.59:0/3532756797 conn(0x7f1acc0b41a0 msgr2=0x7f1acc0b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:58.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad2a00640 1 -- 172.21.15.59:0/3532756797 shutdown_connections 2024-05-30T16:48:58.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad2a00640 1 -- 172.21.15.59:0/3532756797 wait complete. 2024-05-30T16:48:58.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad2a00640 1 Processor -- start 2024-05-30T16:48:58.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad2a00640 1 -- start start 2024-05-30T16:48:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1acc09af80 0x7f1acc13fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad2a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1acc0b73a0 0x7f1acc154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1acc15e7e0 0x7f1acc1f74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad2a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc15ff00 con 0x7f1acc15e7e0 2024-05-30T16:48:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad2a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc15f9e0 con 0x7f1acc0b73a0 2024-05-30T16:48:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad2a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1acc160080 con 0x7f1acc09af80 2024-05-30T16:48:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1acc15e7e0 0x7f1acc1f74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1acc15e7e0 0x7f1acc1f74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58476/0 (socket says 172.21.15.59:58476) 2024-05-30T16:48:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad0a00640 1 -- 172.21.15.59:0/596625442 learned_addr learned my addr 172.21.15.59:0/596625442 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:48:58.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ac3e00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1acc0b73a0 0x7f1acc154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1acbe00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1acc09af80 0x7f1acc13fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad0a00640 1 -- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1acc09af80 msgr2=0x7f1acc13fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad0a00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1acc09af80 0x7f1acc13fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad0a00640 1 -- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1acc0b73a0 msgr2=0x7f1acc154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad0a00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1acc0b73a0 0x7f1acc154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad0a00640 1 -- 172.21.15.59:0/596625442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc152ff0 con 0x7f1acc15e7e0 2024-05-30T16:48:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad0a00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1acc15e7e0 0x7f1acc1f74e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400efc0 tx=0x7f1ac400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ac8c00640 1 -- 172.21.15.59:0/596625442 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4018020 con 0x7f1acc15e7e0 2024-05-30T16:48:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ac8c00640 1 -- 172.21.15.59:0/596625442 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac4014480 con 0x7f1acc15e7e0 2024-05-30T16:48:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ad2a00640 1 -- 172.21.15.59:0/596625442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1acc1532d0 con 0x7f1acc15e7e0 2024-05-30T16:48:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.534+0000 7f1ac8c00640 1 -- 172.21.15.59:0/596625442 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4014870 con 0x7f1acc15e7e0 2024-05-30T16:48:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.538+0000 7f1ad2a00640 1 -- 172.21.15.59:0/596625442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1acc153890 con 0x7f1acc15e7e0 2024-05-30T16:48:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.538+0000 7f1ad2a00640 1 -- 172.21.15.59:0/596625442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1acc068a90 con 0x7f1acc15e7e0 2024-05-30T16:48:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.538+0000 7f1ac8c00640 1 -- 172.21.15.59:0/596625442 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ac401b020 con 0x7f1acc15e7e0 2024-05-30T16:48:58.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.538+0000 7f1ac8c00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aa8068380 0x7f1aa806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.538+0000 7f1ac8c00640 1 -- 172.21.15.59:0/596625442 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f1ac4087440 con 0x7f1acc15e7e0 2024-05-30T16:48:58.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.538+0000 7f1acbe00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aa8068380 0x7f1aa806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.542+0000 7f1acbe00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aa8068380 0x7f1aa806a840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0096d0 tx=0x7f1abc009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:58.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.542+0000 7f1ac8c00640 1 -- 172.21.15.59:0/596625442 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ac4022030 con 0x7f1acc15e7e0 2024-05-30T16:48:58.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.750+0000 7f1ad2a00640 1 -- 172.21.15.59:0/596625442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1acc0712a0 con 0x7f1acc15e7e0 2024-05-30T16:48:58.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.750+0000 7f1ac8c00640 1 -- 172.21.15.59:0/596625442 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f1ac4010040 con 0x7f1acc15e7e0 2024-05-30T16:48:58.757 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:48:58.757 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/2922739893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2922739893},{"type":"v1","addr":"172.21.15.59:6833","nonce":2922739893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-30T16:48:58.757 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 2 2024-05-30T16:48:58.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.754+0000 7f1ad2a00640 1 -- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aa8068380 msgr2=0x7f1aa806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.754+0000 7f1ad2a00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aa8068380 0x7f1aa806a840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0096d0 tx=0x7f1abc009240 comp rx=0 tx=0).stop 2024-05-30T16:48:58.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.754+0000 7f1ad2a00640 1 -- 172.21.15.59:0/596625442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1acc15e7e0 msgr2=0x7f1acc1f74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.754+0000 7f1ad2a00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1acc15e7e0 0x7f1acc1f74e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400efc0 tx=0x7f1ac400c490 comp rx=0 tx=0).stop 2024-05-30T16:48:58.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.754+0000 7f1ad2a00640 1 -- 172.21.15.59:0/596625442 shutdown_connections 2024-05-30T16:48:58.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.754+0000 7f1ad2a00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aa8068380 0x7f1aa806a840 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.754+0000 7f1ad2a00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1acc15e7e0 0x7f1acc1f74e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.754+0000 7f1ad2a00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1acc0b73a0 0x7f1acc154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.754+0000 7f1ad2a00640 1 --2- 172.21.15.59:0/596625442 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1acc09af80 0x7f1acc13fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.754+0000 7f1ad2a00640 1 -- 172.21.15.59:0/596625442 >> 172.21.15.59:0/596625442 conn(0x7f1acc0b41a0 msgr2=0x7f1acc071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:58.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.754+0000 7f1ad2a00640 1 -- 172.21.15.59:0/596625442 shutdown_connections 2024-05-30T16:48:58.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:48:58.754+0000 7f1ad2a00640 1 -- 172.21.15.59:0/596625442 wait complete. 2024-05-30T16:49:00.779 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.914+0000 7f4f78400640 1 Processor -- start 2024-05-30T16:49:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.914+0000 7f4f78400640 1 -- start start 2024-05-30T16:49:00.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f78400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4f700cfe20 0x7f4f7015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f78400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7015f3b0 con 0x7f4f700cfa40 2024-05-30T16:49:00.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f78400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7015f690 con 0x7f4f70073bb0 2024-05-30T16:49:00.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f78400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4f7015f970 con 0x7f4f700cfe20 2024-05-30T16:49:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f75a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4f700cfa40 0x7f4f700b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50344/0 (socket says 172.21.15.59:50344) 2024-05-30T16:49:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f75a00640 1 -- 172.21.15.59:0/3891192868 learned_addr learned my addr 172.21.15.59:0/3891192868 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f75000640 1 --2- 172.21.15.59:0/3891192868 >> v2:172.21.15.107:3300/0 conn(0x7f4f700cfe20 0x7f4f7015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396557627 0 0) 0x7f4f7015f3b0 con 0x7f4f700cfa40 2024-05-30T16:49:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f58003530 con 0x7f4f700cfa40 2024-05-30T16:49:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2820140682 0 0) 0x7f4f7015f690 con 0x7f4f70073bb0 2024-05-30T16:49:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f7015f3b0 con 0x7f4f70073bb0 2024-05-30T16:49:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3529160182 0 0) 0x7f4f58003530 con 0x7f4f700cfa40 2024-05-30T16:49:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 >> v2:172.21.15.107:3300/0 conn(0x7f4f700cfe20 msgr2=0x7f4f7015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 --2- 172.21.15.59:0/3891192868 >> v2:172.21.15.107:3300/0 conn(0x7f4f700cfe20 0x7f4f7015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 >> v1:172.21.15.107:6789/0 conn(0x7f4f70073bb0 legacy=0x7f4f70072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f700b3370 con 0x7f4f700cfa40 2024-05-30T16:49:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f4f64001680 con 0x7f4f700cfa40 2024-05-30T16:49:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f75000640 1 --2- 172.21.15.59:0/3891192868 >> v2:172.21.15.107:3300/0 conn(0x7f4f700cfe20 0x7f4f7015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 >> v1:172.21.15.59:6789/0 conn(0x7f4f700cfa40 legacy=0x7f4f700b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 --2- 172.21.15.59:0/3891192868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f58003b50 0x7f4f58003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 --2- 172.21.15.59:0/3891192868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f58004810 0x7f4f58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 --2- 172.21.15.59:0/3891192868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f580051d0 0x7f4f5800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7015f970 con 0x7f4f580051d0 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5800c050 con 0x7f4f58004810 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4f5800c250 con 0x7f4f58003b50 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f76400640 1 --2- 172.21.15.59:0/3891192868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f580051d0 0x7f4f5800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f75000640 1 --2- 172.21.15.59:0/3891192868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f58004810 0x7f4f58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f75a00640 1 --2- 172.21.15.59:0/3891192868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f58003b50 0x7f4f58003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f76400640 1 -- 172.21.15.59:0/3891192868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f58003b50 msgr2=0x7f4f58003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f76400640 1 --2- 172.21.15.59:0/3891192868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f58003b50 0x7f4f58003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f76400640 1 -- 172.21.15.59:0/3891192868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f58004810 msgr2=0x7f4f58004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:00.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f76400640 1 --2- 172.21.15.59:0/3891192868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f58004810 0x7f4f58004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.918+0000 7f4f76400640 1 -- 172.21.15.59:0/3891192868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f58003530 con 0x7f4f580051d0 2024-05-30T16:49:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f76400640 1 -- 172.21.15.59:0/3891192868 reap_dead start 2024-05-30T16:49:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f76400640 1 --2- 172.21.15.59:0/3891192868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f580051d0 0x7f4f5800b9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4f68001fd0 tx=0x7f4f6801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39936cee155c0527 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68001c20 con 0x7f4f580051d0 2024-05-30T16:49:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f68003b80 con 0x7f4f580051d0 2024-05-30T16:49:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f6fe00640 1 -- 172.21.15.59:0/3891192868 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f680050d0 con 0x7f4f580051d0 2024-05-30T16:49:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f78400640 1 -- 172.21.15.59:0/3891192868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f580051d0 msgr2=0x7f4f5800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f78400640 1 --2- 172.21.15.59:0/3891192868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f580051d0 0x7f4f5800b9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4f68001fd0 tx=0x7f4f6801c900 comp rx=0 tx=0).stop 2024-05-30T16:49:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f78400640 1 -- 172.21.15.59:0/3891192868 shutdown_connections 2024-05-30T16:49:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f78400640 1 --2- 172.21.15.59:0/3891192868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f580051d0 0x7f4f5800b9d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f78400640 1 -- 172.21.15.59:0/3891192868 >> 172.21.15.59:0/3891192868 conn(0x7f4f700b22d0 msgr2=0x7f4f700b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f78400640 1 -- 172.21.15.59:0/3891192868 shutdown_connections 2024-05-30T16:49:00.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f78400640 1 -- 172.21.15.59:0/3891192868 wait complete. 2024-05-30T16:49:00.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f78400640 1 Processor -- start 2024-05-30T16:49:00.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.922+0000 7f4f78400640 1 -- start start 2024-05-30T16:49:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f78400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f580051d0 0x7f4f7009cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f78400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f70149e60 0x7f4f70145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f78400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f70072b00 0x7f4f70072f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f78400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7015ee30 con 0x7f4f70072b00 2024-05-30T16:49:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f78400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7015ecb0 con 0x7f4f580051d0 2024-05-30T16:49:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f78400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7015efb0 con 0x7f4f70149e60 2024-05-30T16:49:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f76400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f70072b00 0x7f4f70072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f76400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f70072b00 0x7f4f70072f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58500/0 (socket says 172.21.15.59:58500) 2024-05-30T16:49:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f76400640 1 -- 172.21.15.59:0/985519215 learned_addr learned my addr 172.21.15.59:0/985519215 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f75a00640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f580051d0 0x7f4f7009cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f75000640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f70149e60 0x7f4f70145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f76400640 1 -- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f70149e60 msgr2=0x7f4f70145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f76400640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f70149e60 0x7f4f70145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f76400640 1 -- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f580051d0 msgr2=0x7f4f7009cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f76400640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f580051d0 0x7f4f7009cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f76400640 1 -- 172.21.15.59:0/985519215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f70146cd0 con 0x7f4f70072b00 2024-05-30T16:49:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f76400640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f70072b00 0x7f4f70072f80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f6801d1a0 tx=0x7f4f58005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f6d600640 1 -- 172.21.15.59:0/985519215 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68003980 con 0x7f4f70072b00 2024-05-30T16:49:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f6d600640 1 -- 172.21.15.59:0/985519215 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f680052e0 con 0x7f4f70072b00 2024-05-30T16:49:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f6d600640 1 -- 172.21.15.59:0/985519215 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68005690 con 0x7f4f70072b00 2024-05-30T16:49:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f78400640 1 -- 172.21.15.59:0/985519215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f70146710 con 0x7f4f70072b00 2024-05-30T16:49:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f78400640 1 -- 172.21.15.59:0/985519215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7009a360 con 0x7f4f70072b00 2024-05-30T16:49:00.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f78400640 1 -- 172.21.15.59:0/985519215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f700734c0 con 0x7f4f70072b00 2024-05-30T16:49:00.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.926+0000 7f4f6d600640 1 -- 172.21.15.59:0/985519215 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f680a55f0 con 0x7f4f70072b00 2024-05-30T16:49:00.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.930+0000 7f4f6d600640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4f50068380 0x7f4f5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.930+0000 7f4f6d600640 1 -- 172.21.15.59:0/985519215 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f4f6811fd50 con 0x7f4f70072b00 2024-05-30T16:49:00.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.930+0000 7f4f75a00640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4f50068380 0x7f4f5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.930+0000 7f4f75a00640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4f50068380 0x7f4f5006a840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4f64001060 tx=0x7f4f64001e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:00.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:00.934+0000 7f4f6d600640 1 -- 172.21.15.59:0/985519215 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4f680be030 con 0x7f4f70072b00 2024-05-30T16:49:01.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.134+0000 7f4f78400640 1 -- 172.21.15.59:0/985519215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f700b5190 con 0x7f4f70072b00 2024-05-30T16:49:01.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.134+0000 7f4f6d600640 1 -- 172.21.15.59:0/985519215 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f4f68016610 con 0x7f4f70072b00 2024-05-30T16:49:01.141 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:01.141 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/2922739893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2922739893},{"type":"v1","addr":"172.21.15.59:6833","nonce":2922739893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1233400446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1233400446},{"type":"v1","addr":"172.21.15.59:6835","nonce":1233400446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1465510297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1465510297},{"type":"v1","addr":"172.21.15.107:6836","nonce":1465510297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3864508560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3864508560},{"type":"v1","addr":"172.21.15.107:6837","nonce":3864508560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-30T16:49:01.141 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 3 2024-05-30T16:49:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.138+0000 7f4f78400640 1 -- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4f50068380 msgr2=0x7f4f5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.138+0000 7f4f78400640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4f50068380 0x7f4f5006a840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4f64001060 tx=0x7f4f64001e30 comp rx=0 tx=0).stop 2024-05-30T16:49:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.138+0000 7f4f78400640 1 -- 172.21.15.59:0/985519215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f70072b00 msgr2=0x7f4f70072f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.138+0000 7f4f78400640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f70072b00 0x7f4f70072f80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f6801d1a0 tx=0x7f4f58005840 comp rx=0 tx=0).stop 2024-05-30T16:49:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.138+0000 7f4f78400640 1 -- 172.21.15.59:0/985519215 shutdown_connections 2024-05-30T16:49:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.138+0000 7f4f78400640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4f50068380 0x7f4f5006a840 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.138+0000 7f4f78400640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f70072b00 0x7f4f70072f80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.138+0000 7f4f78400640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f70149e60 0x7f4f70145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.138+0000 7f4f78400640 1 --2- 172.21.15.59:0/985519215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f580051d0 0x7f4f7009cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.138+0000 7f4f78400640 1 -- 172.21.15.59:0/985519215 >> 172.21.15.59:0/985519215 conn(0x7f4f700b22d0 msgr2=0x7f4f700d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.138+0000 7f4f78400640 1 -- 172.21.15.59:0/985519215 shutdown_connections 2024-05-30T16:49:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.138+0000 7f4f78400640 1 -- 172.21.15.59:0/985519215 wait complete. 2024-05-30T16:49:01.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T16:49:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.294+0000 7f194fe00640 1 Processor -- start 2024-05-30T16:49:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.294+0000 7f194fe00640 1 -- start start 2024-05-30T16:49:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19480af720 0x7f194815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f194806e900 0x7f194815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194fe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f194815f060 con 0x7f19480d0560 2024-05-30T16:49:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194fe00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f19480afb00 con 0x7f19480af720 2024-05-30T16:49:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194fe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f194815c270 con 0x7f194806e900 2024-05-30T16:49:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19480af720 0x7f194815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194de00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f19480d0560 0x7f1948072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50352/0 (socket says 172.21.15.59:50352) 2024-05-30T16:49:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194de00640 1 -- 172.21.15.59:0/3498558877 learned_addr learned my addr 172.21.15.59:0/3498558877 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194ca00640 1 --2- 172.21.15.59:0/3498558877 >> v2:172.21.15.107:3300/0 conn(0x7f194806e900 0x7f194815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194d400640 1 -- 172.21.15.59:0/3498558877 >> v2:172.21.15.107:3300/0 conn(0x7f194806e900 msgr2=0x7f194815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194d400640 1 --2- 172.21.15.59:0/3498558877 >> v2:172.21.15.107:3300/0 conn(0x7f194806e900 0x7f194815f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194d400640 1 -- 172.21.15.59:0/3498558877 >> v1:172.21.15.59:6789/0 conn(0x7f19480d0560 legacy=0x7f1948072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194d400640 1 -- 172.21.15.59:0/3498558877 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194815c550 con 0x7f19480af720 2024-05-30T16:49:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.298+0000 7f194ca00640 1 --2- 172.21.15.59:0/3498558877 >> v2:172.21.15.107:3300/0 conn(0x7f194806e900 0x7f194815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:01.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f194d400640 1 --2- 172.21.15.59:0/3498558877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19480af720 0x7f194815b9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19480b5410 tx=0x7f193c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f88930660ee891 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f1947e00640 1 -- 172.21.15.59:0/3498558877 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c0a7070 con 0x7f19480af720 2024-05-30T16:49:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f1947e00640 1 -- 172.21.15.59:0/3498558877 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193c0b0070 con 0x7f19480af720 2024-05-30T16:49:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f1947e00640 1 -- 172.21.15.59:0/3498558877 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c0ab890 con 0x7f19480af720 2024-05-30T16:49:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f194fe00640 1 -- 172.21.15.59:0/3498558877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19480af720 msgr2=0x7f194815b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f194fe00640 1 --2- 172.21.15.59:0/3498558877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19480af720 0x7f194815b9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19480b5410 tx=0x7f193c01c450 comp rx=0 tx=0).stop 2024-05-30T16:49:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f194fe00640 1 -- 172.21.15.59:0/3498558877 shutdown_connections 2024-05-30T16:49:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f194fe00640 1 --2- 172.21.15.59:0/3498558877 >> v2:172.21.15.107:3300/0 conn(0x7f194806e900 0x7f194815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f194fe00640 1 --2- 172.21.15.59:0/3498558877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19480af720 0x7f194815b9d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f194fe00640 1 -- 172.21.15.59:0/3498558877 >> 172.21.15.59:0/3498558877 conn(0x7f19480b22d0 msgr2=0x7f19480b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f194fe00640 1 -- 172.21.15.59:0/3498558877 shutdown_connections 2024-05-30T16:49:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f194fe00640 1 -- 172.21.15.59:0/3498558877 wait complete. 2024-05-30T16:49:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f194fe00640 1 Processor -- start 2024-05-30T16:49:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.302+0000 7f194fe00640 1 -- start start 2024-05-30T16:49:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194806e900 0x7f1948149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19480af720 0x7f1948152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19480d0560 0x7f194814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f194815fd30 con 0x7f194806e900 2024-05-30T16:49:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f19480d0da0 con 0x7f19480af720 2024-05-30T16:49:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f194815feb0 con 0x7f19480d0560 2024-05-30T16:49:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194806e900 0x7f1948149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194806e900 0x7f1948149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58514/0 (socket says 172.21.15.59:58514) 2024-05-30T16:49:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194d400640 1 -- 172.21.15.59:0/300215623 learned_addr learned my addr 172.21.15.59:0/300215623 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194ca00640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19480af720 0x7f1948152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194de00640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19480d0560 0x7f194814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194d400640 1 -- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19480d0560 msgr2=0x7f194814e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194d400640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19480d0560 0x7f194814e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194d400640 1 -- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19480af720 msgr2=0x7f1948152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194d400640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19480af720 0x7f1948152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194d400640 1 -- 172.21.15.59:0/300215623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19480b1d00 con 0x7f194806e900 2024-05-30T16:49:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194de00640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19480d0560 0x7f194814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194d400640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194806e900 0x7f1948149dd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f193c0ad040 tx=0x7f193c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f1945600640 1 -- 172.21.15.59:0/300215623 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c0bf610 con 0x7f194806e900 2024-05-30T16:49:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f1945600640 1 -- 172.21.15.59:0/300215623 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193c0bf7d0 con 0x7f194806e900 2024-05-30T16:49:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f1945600640 1 -- 172.21.15.59:0/300215623 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c0bfbc0 con 0x7f194806e900 2024-05-30T16:49:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194fe00640 1 -- 172.21.15.59:0/300215623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194815a630 con 0x7f194806e900 2024-05-30T16:49:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194fe00640 1 -- 172.21.15.59:0/300215623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1948151c40 con 0x7f194806e900 2024-05-30T16:49:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f194fe00640 1 -- 172.21.15.59:0/300215623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1948068a90 con 0x7f194806e900 2024-05-30T16:49:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.306+0000 7f1945600640 1 -- 172.21.15.59:0/300215623 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f193c0bd020 con 0x7f194806e900 2024-05-30T16:49:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.310+0000 7f1945600640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1928068380 0x7f192806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.310+0000 7f1945600640 1 -- 172.21.15.59:0/300215623 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f193c120fe0 con 0x7f194806e900 2024-05-30T16:49:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.310+0000 7f194ca00640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1928068380 0x7f192806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.310+0000 7f194ca00640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1928068380 0x7f192806a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f19480b1730 tx=0x7f1934008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.314+0000 7f1945600640 1 -- 172.21.15.59:0/300215623 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f193c016070 con 0x7f194806e900 2024-05-30T16:49:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 -- 172.21.15.59:0/300215623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1948072e30 con 0x7f194806e900 2024-05-30T16:49:01.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f1945600640 1 -- 172.21.15.59:0/300215623 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f193c0f1240 con 0x7f194806e900 2024-05-30T16:49:01.487 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:01.487 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:49:01.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:01.487 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-05-30T16:49:01.487 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-05-30T16:49:01.487 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:01.488 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:49:01.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 -- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1928068380 msgr2=0x7f192806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1928068380 0x7f192806a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f19480b1730 tx=0x7f1934008040 comp rx=0 tx=0).stop 2024-05-30T16:49:01.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 -- 172.21.15.59:0/300215623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194806e900 msgr2=0x7f1948149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194806e900 0x7f1948149dd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f193c0ad040 tx=0x7f193c01ac90 comp rx=0 tx=0).stop 2024-05-30T16:49:01.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 -- 172.21.15.59:0/300215623 shutdown_connections 2024-05-30T16:49:01.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1928068380 0x7f192806a840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19480d0560 0x7f194814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19480af720 0x7f1948152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 --2- 172.21.15.59:0/300215623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194806e900 0x7f1948149dd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 -- 172.21.15.59:0/300215623 >> 172.21.15.59:0/300215623 conn(0x7f19480b22d0 msgr2=0x7f19480afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:01.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 -- 172.21.15.59:0/300215623 shutdown_connections 2024-05-30T16:49:01.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.482+0000 7f194fe00640 1 -- 172.21.15.59:0/300215623 wait complete. 2024-05-30T16:49:01.509 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T16:49:01.509 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T16:49:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.646+0000 7f9266a00640 1 Processor -- start 2024-05-30T16:49:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.646+0000 7f9266a00640 1 -- start start 2024-05-30T16:49:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f9266a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9260156e40 0x7f926006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f9266a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92600af130 0x7f92600af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f9266a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926006e120 con 0x7f926006dc60 2024-05-30T16:49:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f9266a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f926006e400 con 0x7f9260156e40 2024-05-30T16:49:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f9266a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f926006e6e0 con 0x7f92600af130 2024-05-30T16:49:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f925fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9260156e40 0x7f926006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f925fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9260156e40 0x7f926006f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58516/0 (socket says 172.21.15.59:58516) 2024-05-30T16:49:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f925fe00640 1 -- 172.21.15.59:0/2841845286 learned_addr learned my addr 172.21.15.59:0/2841845286 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f925fe00640 1 -- 172.21.15.59:0/2841845286 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92600af130 msgr2=0x7f92600af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f925fe00640 1 --2- 172.21.15.59:0/2841845286 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92600af130 0x7f92600af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f925fe00640 1 -- 172.21.15.59:0/2841845286 >> v1:172.21.15.107:6789/0 conn(0x7f926006dc60 legacy=0x7f926015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f925fe00640 1 -- 172.21.15.59:0/2841845286 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926006e9c0 con 0x7f9260156e40 2024-05-30T16:49:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.650+0000 7f925fe00640 1 --2- 172.21.15.59:0/2841845286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9260156e40 0x7f926006f1c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9260073f70 tx=0x7f925001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c65f85a43ba34c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f925f400640 1 -- 172.21.15.59:0/2841845286 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92500b1070 con 0x7f9260156e40 2024-05-30T16:49:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f925f400640 1 -- 172.21.15.59:0/2841845286 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92500ac640 con 0x7f9260156e40 2024-05-30T16:49:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f925f400640 1 -- 172.21.15.59:0/2841845286 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92500aca10 con 0x7f9260156e40 2024-05-30T16:49:01.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 -- 172.21.15.59:0/2841845286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9260156e40 msgr2=0x7f926006f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 --2- 172.21.15.59:0/2841845286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9260156e40 0x7f926006f1c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9260073f70 tx=0x7f925001c500 comp rx=0 tx=0).stop 2024-05-30T16:49:01.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 -- 172.21.15.59:0/2841845286 shutdown_connections 2024-05-30T16:49:01.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 --2- 172.21.15.59:0/2841845286 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92600af130 0x7f92600af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 --2- 172.21.15.59:0/2841845286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9260156e40 0x7f926006f1c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 -- 172.21.15.59:0/2841845286 >> 172.21.15.59:0/2841845286 conn(0x7f92600b1e60 msgr2=0x7f92600b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:01.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 -- 172.21.15.59:0/2841845286 shutdown_connections 2024-05-30T16:49:01.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 -- 172.21.15.59:0/2841845286 wait complete. 2024-05-30T16:49:01.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 Processor -- start 2024-05-30T16:49:01.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 -- start start 2024-05-30T16:49:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f926006dc60 0x7f9260149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92600af130 0x7f926009a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9260156e40 0x7f926009a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f926015eb70 con 0x7f9260156e40 2024-05-30T16:49:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f926015e9f0 con 0x7f92600af130 2024-05-30T16:49:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9266a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9260169550 con 0x7f926006dc60 2024-05-30T16:49:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9264a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9260156e40 0x7f926009a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9264a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9260156e40 0x7f926009a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58522/0 (socket says 172.21.15.59:58522) 2024-05-30T16:49:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.654+0000 7f9264a00640 1 -- 172.21.15.59:0/675547523 learned_addr learned my addr 172.21.15.59:0/675547523 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f9264a00640 1 -- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f926006dc60 msgr2=0x7f9260149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f925fe00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f926006dc60 0x7f9260149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f9264a00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f926006dc60 0x7f9260149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f9264a00640 1 -- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92600af130 msgr2=0x7f926009a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f9264a00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92600af130 0x7f926009a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f9264a00640 1 -- 172.21.15.59:0/675547523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92601576c0 con 0x7f9260156e40 2024-05-30T16:49:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f925fe00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f926006dc60 0x7f9260149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f9264a00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9260156e40 0x7f926009a800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f925800b9a0 tx=0x7f925800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f925cc00640 1 -- 172.21.15.59:0/675547523 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258019070 con 0x7f9260156e40 2024-05-30T16:49:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f9266a00640 1 -- 172.21.15.59:0/675547523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926009b520 con 0x7f9260156e40 2024-05-30T16:49:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f925cc00640 1 -- 172.21.15.59:0/675547523 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925800cba0 con 0x7f9260156e40 2024-05-30T16:49:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f9266a00640 1 -- 172.21.15.59:0/675547523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f926009bae0 con 0x7f9260156e40 2024-05-30T16:49:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f925cc00640 1 -- 172.21.15.59:0/675547523 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258014440 con 0x7f9260156e40 2024-05-30T16:49:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f9266a00640 1 -- 172.21.15.59:0/675547523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92380052a0 con 0x7f9260156e40 2024-05-30T16:49:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f925cc00640 1 -- 172.21.15.59:0/675547523 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f925801c070 con 0x7f9260156e40 2024-05-30T16:49:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f925cc00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f923c068380 0x7f923c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f925cc00640 1 -- 172.21.15.59:0/675547523 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f9258086350 con 0x7f9260156e40 2024-05-30T16:49:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.658+0000 7f925fe00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f923c068380 0x7f923c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.662+0000 7f925fe00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f923c068380 0x7f923c06a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f92500ae000 tx=0x7f9250008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.662+0000 7f925cc00640 1 -- 172.21.15.59:0/675547523 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9258056570 con 0x7f9260156e40 2024-05-30T16:49:01.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:01.834+0000 7f9266a00640 1 -- 172.21.15.59:0/675547523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9238005590 con 0x7f9260156e40 2024-05-30T16:49:02.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.498+0000 7f925cc00640 1 -- 172.21.15.59:0/675547523 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f925805a870 con 0x7f9260156e40 2024-05-30T16:49:02.506 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-05-30T16:49:02.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.502+0000 7f9266a00640 1 -- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f923c068380 msgr2=0x7f923c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.502+0000 7f9266a00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f923c068380 0x7f923c06a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f92500ae000 tx=0x7f9250008040 comp rx=0 tx=0).stop 2024-05-30T16:49:02.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.502+0000 7f9266a00640 1 -- 172.21.15.59:0/675547523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9260156e40 msgr2=0x7f926009a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.502+0000 7f9266a00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9260156e40 0x7f926009a800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f925800b9a0 tx=0x7f925800be60 comp rx=0 tx=0).stop 2024-05-30T16:49:02.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.502+0000 7f9266a00640 1 -- 172.21.15.59:0/675547523 shutdown_connections 2024-05-30T16:49:02.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.502+0000 7f9266a00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f923c068380 0x7f923c06a840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.502+0000 7f9266a00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9260156e40 0x7f926009a800 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.502+0000 7f9266a00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92600af130 0x7f926009a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.502+0000 7f9266a00640 1 --2- 172.21.15.59:0/675547523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f926006dc60 0x7f9260149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.502+0000 7f9266a00640 1 -- 172.21.15.59:0/675547523 >> 172.21.15.59:0/675547523 conn(0x7f92600b1e60 msgr2=0x7f92600b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:02.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.502+0000 7f9266a00640 1 -- 172.21.15.59:0/675547523 shutdown_connections 2024-05-30T16:49:02.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.502+0000 7f9266a00640 1 -- 172.21.15.59:0/675547523 wait complete. 2024-05-30T16:49:02.539 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T16:49:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c9c00640 1 Processor -- start 2024-05-30T16:49:02.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c9c00640 1 -- start start 2024-05-30T16:49:02.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c9c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c415fdb0 0x7f76c40b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c9c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f76c40b3a10 0x7f76c40cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c9c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c4160190 con 0x7f76c409aa40 2024-05-30T16:49:02.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c9c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f76c40b2ea0 con 0x7f76c40b3a10 2024-05-30T16:49:02.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c9c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f76c40b2600 con 0x7f76c415fdb0 2024-05-30T16:49:02.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c415fdb0 0x7f76c40b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76bbe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f76c409aa40 0x7f76c40b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:44020/0 (socket says 172.21.15.59:44020) 2024-05-30T16:49:02.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76bbe00640 1 -- 172.21.15.59:0/1595366384 learned_addr learned my addr 172.21.15.59:0/1595366384 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:02.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c3400640 1 --2- 172.21.15.59:0/1595366384 >> v2:172.21.15.107:3300/0 conn(0x7f76c40b3a10 0x7f76c40cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c2000640 1 -- 172.21.15.59:0/1595366384 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1878308988 0 0) 0x7f76c4160190 con 0x7f76c409aa40 2024-05-30T16:49:02.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c2000640 1 -- 172.21.15.59:0/1595366384 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a8003530 con 0x7f76c409aa40 2024-05-30T16:49:02.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c2a00640 1 -- 172.21.15.59:0/1595366384 >> v2:172.21.15.107:3300/0 conn(0x7f76c40b3a10 msgr2=0x7f76c40cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:02.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c2a00640 1 --2- 172.21.15.59:0/1595366384 >> v2:172.21.15.107:3300/0 conn(0x7f76c40b3a10 0x7f76c40cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c2a00640 1 -- 172.21.15.59:0/1595366384 >> v1:172.21.15.107:6789/0 conn(0x7f76c409aa40 legacy=0x7f76c40b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c2a00640 1 -- 172.21.15.59:0/1595366384 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c40b28e0 con 0x7f76c415fdb0 2024-05-30T16:49:02.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.686+0000 7f76c3400640 1 --2- 172.21.15.59:0/1595366384 >> v2:172.21.15.107:3300/0 conn(0x7f76c40b3a10 0x7f76c40cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.690+0000 7f76c2a00640 1 --2- 172.21.15.59:0/1595366384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c415fdb0 0x7f76c40b1dc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f76b40097c0 tx=0x7f76b401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebc2ba6acbb22640 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.690+0000 7f76c2000640 1 -- 172.21.15.59:0/1595366384 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b40b1070 con 0x7f76c415fdb0 2024-05-30T16:49:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.690+0000 7f76c2000640 1 -- 172.21.15.59:0/1595366384 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b40a8050 con 0x7f76c415fdb0 2024-05-30T16:49:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.690+0000 7f76c2000640 1 -- 172.21.15.59:0/1595366384 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b40ac840 con 0x7f76c415fdb0 2024-05-30T16:49:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.690+0000 7f76c9c00640 1 -- 172.21.15.59:0/1595366384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c415fdb0 msgr2=0x7f76c40b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.690+0000 7f76c9c00640 1 --2- 172.21.15.59:0/1595366384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c415fdb0 0x7f76c40b1dc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f76b40097c0 tx=0x7f76b401c3e0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.690+0000 7f76c9c00640 1 -- 172.21.15.59:0/1595366384 shutdown_connections 2024-05-30T16:49:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.690+0000 7f76c9c00640 1 --2- 172.21.15.59:0/1595366384 >> v2:172.21.15.107:3300/0 conn(0x7f76c40b3a10 0x7f76c40cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.690+0000 7f76c9c00640 1 --2- 172.21.15.59:0/1595366384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c415fdb0 0x7f76c40b1dc0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.690+0000 7f76c9c00640 1 -- 172.21.15.59:0/1595366384 >> 172.21.15.59:0/1595366384 conn(0x7f76c40d24c0 msgr2=0x7f76c40d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.690+0000 7f76c9c00640 1 -- 172.21.15.59:0/1595366384 shutdown_connections 2024-05-30T16:49:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.690+0000 7f76c9c00640 1 -- 172.21.15.59:0/1595366384 wait complete. 2024-05-30T16:49:02.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c9c00640 1 Processor -- start 2024-05-30T16:49:02.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c9c00640 1 -- start start 2024-05-30T16:49:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c9c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c409aa40 0x7f76c40cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c9c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76c40b3a10 0x7f76c414bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c9c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c415fdb0 0x7f76c406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c9c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76c40af4b0 con 0x7f76c409aa40 2024-05-30T16:49:02.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c9c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f76c40af330 con 0x7f76c40b3a10 2024-05-30T16:49:02.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c9c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f76c4169420 con 0x7f76c415fdb0 2024-05-30T16:49:02.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c409aa40 0x7f76c40cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c409aa40 0x7f76c40cbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43680/0 (socket says 172.21.15.59:43680) 2024-05-30T16:49:02.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c2a00640 1 -- 172.21.15.59:0/574162546 learned_addr learned my addr 172.21.15.59:0/574162546 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:02.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76bbe00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76c40b3a10 0x7f76c414bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c3400640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c415fdb0 0x7f76c406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c2a00640 1 -- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c415fdb0 msgr2=0x7f76c406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c2a00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c415fdb0 0x7f76c406d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c2a00640 1 -- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76c40b3a10 msgr2=0x7f76c414bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c2a00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76c40b3a10 0x7f76c414bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c2a00640 1 -- 172.21.15.59:0/574162546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c415ccb0 con 0x7f76c409aa40 2024-05-30T16:49:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c2a00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c409aa40 0x7f76c40cbf90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f76b40097c0 tx=0x7f76b401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76baa00640 1 -- 172.21.15.59:0/574162546 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b40b1040 con 0x7f76c409aa40 2024-05-30T16:49:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76baa00640 1 -- 172.21.15.59:0/574162546 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b40bc070 con 0x7f76c409aa40 2024-05-30T16:49:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76baa00640 1 -- 172.21.15.59:0/574162546 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b40b7450 con 0x7f76c409aa40 2024-05-30T16:49:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c9c00640 1 -- 172.21.15.59:0/574162546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c4149310 con 0x7f76c409aa40 2024-05-30T16:49:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c9c00640 1 -- 172.21.15.59:0/574162546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c415e730 con 0x7f76c409aa40 2024-05-30T16:49:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.694+0000 7f76c9c00640 1 -- 172.21.15.59:0/574162546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c4068a90 con 0x7f76c409aa40 2024-05-30T16:49:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.698+0000 7f76baa00640 1 -- 172.21.15.59:0/574162546 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f76b40b75f0 con 0x7f76c409aa40 2024-05-30T16:49:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.698+0000 7f76baa00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76a00683b0 0x7f76a006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.698+0000 7f76baa00640 1 -- 172.21.15.59:0/574162546 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f76b4120af0 con 0x7f76c409aa40 2024-05-30T16:49:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.698+0000 7f76bbe00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76a00683b0 0x7f76a006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.698+0000 7f76bbe00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76a00683b0 0x7f76a006a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f76c40afd30 tx=0x7f76ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.702+0000 7f76baa00640 1 -- 172.21.15.59:0/574162546 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f76c4149310 con 0x7f76c409aa40 2024-05-30T16:49:02.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:02.870+0000 7f76c9c00640 1 -- 172.21.15.59:0/574162546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f76c40d1f50 con 0x7f76c409aa40 2024-05-30T16:49:03.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:49:03.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:49:03.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.506+0000 7f76baa00640 1 -- 172.21.15.59:0/574162546 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7f76c415ccb0 con 0x7f76c409aa40 2024-05-30T16:49:03.514 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-05-30T16:49:03.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.510+0000 7f76c9c00640 1 -- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76a00683b0 msgr2=0x7f76a006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.510+0000 7f76c9c00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76a00683b0 0x7f76a006a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f76c40afd30 tx=0x7f76ac009040 comp rx=0 tx=0).stop 2024-05-30T16:49:03.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.510+0000 7f76c9c00640 1 -- 172.21.15.59:0/574162546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c409aa40 msgr2=0x7f76c40cbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.510+0000 7f76c9c00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c409aa40 0x7f76c40cbf90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f76b40097c0 tx=0x7f76b401ac20 comp rx=0 tx=0).stop 2024-05-30T16:49:03.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.510+0000 7f76c9c00640 1 -- 172.21.15.59:0/574162546 shutdown_connections 2024-05-30T16:49:03.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.510+0000 7f76c9c00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76a00683b0 0x7f76a006a870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.510+0000 7f76c9c00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c415fdb0 0x7f76c406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.510+0000 7f76c9c00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76c40b3a10 0x7f76c414bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.510+0000 7f76c9c00640 1 --2- 172.21.15.59:0/574162546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c409aa40 0x7f76c40cbf90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.510+0000 7f76c9c00640 1 -- 172.21.15.59:0/574162546 >> 172.21.15.59:0/574162546 conn(0x7f76c40d24c0 msgr2=0x7f76c40b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:03.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.510+0000 7f76c9c00640 1 -- 172.21.15.59:0/574162546 shutdown_connections 2024-05-30T16:49:03.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.510+0000 7f76c9c00640 1 -- 172.21.15.59:0/574162546 wait complete. 2024-05-30T16:49:03.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T16:49:03.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.698+0000 7f3312c00640 1 Processor -- start 2024-05-30T16:49:03.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.698+0000 7f3312c00640 1 -- start start 2024-05-30T16:49:03.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3312c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f330c161fd0 0x7f330c0d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3312c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f330c0cb9b0 0x7f330c0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3312c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f330c0d1150 con 0x7f330c06b9b0 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3312c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f330c0d0b90 con 0x7f330c0cb9b0 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3312c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f330c0d0e70 con 0x7f330c161fd0 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3303e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f330c0cb9b0 0x7f330c0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3310c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f330c06b9b0 0x7f330c0cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58074/0 (socket says 172.21.15.59:58074) 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3303e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f330c0cb9b0 0x7f330c0b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43682/0 (socket says 172.21.15.59:43682) 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3310c00640 1 -- 172.21.15.59:0/2984173888 learned_addr learned my addr 172.21.15.59:0/2984173888 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f330be00640 1 --2- 172.21.15.59:0/2984173888 >> v2:172.21.15.107:3300/0 conn(0x7f330c161fd0 0x7f330c0d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3303e00640 1 -- 172.21.15.59:0/2984173888 >> v2:172.21.15.107:3300/0 conn(0x7f330c161fd0 msgr2=0x7f330c0d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3303e00640 1 --2- 172.21.15.59:0/2984173888 >> v2:172.21.15.107:3300/0 conn(0x7f330c161fd0 0x7f330c0d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3303e00640 1 -- 172.21.15.59:0/2984173888 >> v1:172.21.15.59:6789/0 conn(0x7f330c06b9b0 legacy=0x7f330c0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.702+0000 7f3303e00640 1 -- 172.21.15.59:0/2984173888 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c0cd620 con 0x7f330c0cb9b0 2024-05-30T16:49:03.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f3303e00640 1 --2- 172.21.15.59:0/2984173888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c0cb9b0 0x7f330c0b3a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f330c075970 tx=0x7f32f401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211e7eae2da44d91 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:03.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f330b400640 1 -- 172.21.15.59:0/2984173888 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f40b0070 con 0x7f330c0cb9b0 2024-05-30T16:49:03.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f330b400640 1 -- 172.21.15.59:0/2984173888 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f40ab600 con 0x7f330c0cb9b0 2024-05-30T16:49:03.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f330b400640 1 -- 172.21.15.59:0/2984173888 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f40ab9d0 con 0x7f330c0cb9b0 2024-05-30T16:49:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f3312c00640 1 -- 172.21.15.59:0/2984173888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c0cb9b0 msgr2=0x7f330c0b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f3312c00640 1 --2- 172.21.15.59:0/2984173888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c0cb9b0 0x7f330c0b3a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f330c075970 tx=0x7f32f401c3f0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f3312c00640 1 -- 172.21.15.59:0/2984173888 shutdown_connections 2024-05-30T16:49:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f3312c00640 1 --2- 172.21.15.59:0/2984173888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c0cb9b0 0x7f330c0b3a40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f3312c00640 1 --2- 172.21.15.59:0/2984173888 >> v2:172.21.15.107:3300/0 conn(0x7f330c161fd0 0x7f330c0d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f3312c00640 1 -- 172.21.15.59:0/2984173888 >> 172.21.15.59:0/2984173888 conn(0x7f330c0b2f50 msgr2=0x7f330c0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f3312c00640 1 -- 172.21.15.59:0/2984173888 shutdown_connections 2024-05-30T16:49:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f3312c00640 1 -- 172.21.15.59:0/2984173888 wait complete. 2024-05-30T16:49:03.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f3312c00640 1 Processor -- start 2024-05-30T16:49:03.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.706+0000 7f3312c00640 1 -- start start 2024-05-30T16:49:03.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3312c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c06b9b0 0x7f330c155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:03.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3312c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f330c0cb9b0 0x7f330c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:03.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3312c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f330c161fd0 0x7f330c15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:03.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3312c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f330c16b700 con 0x7f330c06b9b0 2024-05-30T16:49:03.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3312c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f330c16b580 con 0x7f330c161fd0 2024-05-30T16:49:03.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3312c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f330c16b880 con 0x7f330c0cb9b0 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f330be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c06b9b0 0x7f330c155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f330be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c06b9b0 0x7f330c155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43688/0 (socket says 172.21.15.59:43688) 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f330be00640 1 -- 172.21.15.59:0/3997388425 learned_addr learned my addr 172.21.15.59:0/3997388425 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f330be00640 1 -- 172.21.15.59:0/3997388425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f330c0cb9b0 msgr2=0x7f330c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f330be00640 1 --2- 172.21.15.59:0/3997388425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f330c0cb9b0 0x7f330c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f330be00640 1 -- 172.21.15.59:0/3997388425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f330c161fd0 msgr2=0x7f330c15b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f330be00640 1 --2- 172.21.15.59:0/3997388425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f330c161fd0 0x7f330c15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f330be00640 1 -- 172.21.15.59:0/3997388425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c155d50 con 0x7f330c06b9b0 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f330be00640 1 --2- 172.21.15.59:0/3997388425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c06b9b0 0x7f330c155810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00d800 tx=0x7f32fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3308c00640 1 -- 172.21.15.59:0/3997388425 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc00b6c0 con 0x7f330c06b9b0 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3308c00640 1 -- 172.21.15.59:0/3997388425 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc019070 con 0x7f330c06b9b0 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3308c00640 1 -- 172.21.15.59:0/3997388425 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc00ba60 con 0x7f330c06b9b0 2024-05-30T16:49:03.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3312c00640 1 -- 172.21.15.59:0/3997388425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330c159700 con 0x7f330c06b9b0 2024-05-30T16:49:03.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3312c00640 1 -- 172.21.15.59:0/3997388425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330c158940 con 0x7f330c06b9b0 2024-05-30T16:49:03.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3312c00640 1 -- 172.21.15.59:0/3997388425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f330c068a90 con 0x7f330c06b9b0 2024-05-30T16:49:03.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.710+0000 7f3308c00640 1 -- 172.21.15.59:0/3997388425 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f32fc00bc00 con 0x7f330c06b9b0 2024-05-30T16:49:03.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.714+0000 7f3308c00640 1 --2- 172.21.15.59:0/3997388425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f32e8068380 0x7f32e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:03.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.714+0000 7f3308c00640 1 -- 172.21.15.59:0/3997388425 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f32fc086e10 con 0x7f330c06b9b0 2024-05-30T16:49:03.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.714+0000 7f3303e00640 1 --2- 172.21.15.59:0/3997388425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f32e8068380 0x7f32e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:03.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.714+0000 7f3303e00640 1 --2- 172.21.15.59:0/3997388425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f32e8068380 0x7f32e806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f32f40ad000 tx=0x7f32f4004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:03.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.718+0000 7f3308c00640 1 -- 172.21.15.59:0/3997388425 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f32fc08a030 con 0x7f330c06b9b0 2024-05-30T16:49:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:03.918+0000 7f3312c00640 1 -- 172.21.15.59:0/3997388425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f330c0cf220 con 0x7f330c06b9b0 2024-05-30T16:49:04.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.510+0000 7f3308c00640 1 -- 172.21.15.59:0/3997388425 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f32fc057420 con 0x7f330c06b9b0 2024-05-30T16:49:04.516 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 2 and data pool 3 2024-05-30T16:49:04.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.514+0000 7f3312c00640 1 -- 172.21.15.59:0/3997388425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f32e8068380 msgr2=0x7f32e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:04.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.514+0000 7f3312c00640 1 --2- 172.21.15.59:0/3997388425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f32e8068380 0x7f32e806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f32f40ad000 tx=0x7f32f4004740 comp rx=0 tx=0).stop 2024-05-30T16:49:04.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.514+0000 7f3312c00640 1 -- 172.21.15.59:0/3997388425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c06b9b0 msgr2=0x7f330c155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:04.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.514+0000 7f3312c00640 1 --2- 172.21.15.59:0/3997388425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c06b9b0 0x7f330c155810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00d800 tx=0x7f32fc00dcc0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.514+0000 7f3312c00640 1 -- 172.21.15.59:0/3997388425 shutdown_connections 2024-05-30T16:49:04.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.514+0000 7f3312c00640 1 --2- 172.21.15.59:0/3997388425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f32e8068380 0x7f32e806a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.514+0000 7f3312c00640 1 --2- 172.21.15.59:0/3997388425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f330c161fd0 0x7f330c15b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.514+0000 7f3312c00640 1 --2- 172.21.15.59:0/3997388425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f330c0cb9b0 0x7f330c15c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.514+0000 7f3312c00640 1 --2- 172.21.15.59:0/3997388425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c06b9b0 0x7f330c155810 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.514+0000 7f3312c00640 1 -- 172.21.15.59:0/3997388425 >> 172.21.15.59:0/3997388425 conn(0x7f330c0b2f50 msgr2=0x7f330c0cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:04.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.514+0000 7f3312c00640 1 -- 172.21.15.59:0/3997388425 shutdown_connections 2024-05-30T16:49:04.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.514+0000 7f3312c00640 1 -- 172.21.15.59:0/3997388425 wait complete. 2024-05-30T16:49:04.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:04.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.702+0000 7f9cd4a00640 1 Processor -- start 2024-05-30T16:49:04.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.702+0000 7f9cd4a00640 1 -- start start 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.702+0000 7f9cd4a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9cd0159df0 0x7f9cd00ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.702+0000 7f9cd4a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9cd015a1d0 0x7f9cd00ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.702+0000 7f9cd4a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd00b3e50 0x7f9cd015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.702+0000 7f9cd4a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd015d730 con 0x7f9cd015a1d0 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.702+0000 7f9cd4a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd00b3370 con 0x7f9cd0159df0 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.702+0000 7f9cd4a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd00b3650 con 0x7f9cd00b3e50 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9cc5400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9cd015a1d0 0x7f9cd00ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9cc5400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9cd015a1d0 0x7f9cd00ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43694/0 (socket says 172.21.15.59:43694) 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9cc5400640 1 -- 172.21.15.59:0/3468565376 learned_addr learned my addr 172.21.15.59:0/3468565376 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9ccde00640 1 --2- 172.21.15.59:0/3468565376 >> v2:172.21.15.107:3300/0 conn(0x7f9cd0159df0 0x7f9cd00ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9cce800640 1 --2- 172.21.15.59:0/3468565376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd00b3e50 0x7f9cd015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9cc5400640 1 -- 172.21.15.59:0/3468565376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd00b3e50 msgr2=0x7f9cd015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9cc5400640 1 --2- 172.21.15.59:0/3468565376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd00b3e50 0x7f9cd015ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9cc5400640 1 -- 172.21.15.59:0/3468565376 >> v2:172.21.15.107:3300/0 conn(0x7f9cd0159df0 msgr2=0x7f9cd00ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:04.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9cc5400640 1 --2- 172.21.15.59:0/3468565376 >> v2:172.21.15.107:3300/0 conn(0x7f9cd0159df0 0x7f9cd00ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9cc5400640 1 -- 172.21.15.59:0/3468565376 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd00b3930 con 0x7f9cd015a1d0 2024-05-30T16:49:04.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9cce800640 1 --2- 172.21.15.59:0/3468565376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd00b3e50 0x7f9cd015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:04.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9cc5400640 1 --2- 172.21.15.59:0/3468565376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd015a1d0 0x7f9cd00ad6f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00b4c20 tx=0x7f9cb801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551ca49f42869282 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:04.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9ccd400640 1 -- 172.21.15.59:0/3468565376 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80ab5f0 con 0x7f9cd015a1d0 2024-05-30T16:49:04.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9ccd400640 1 -- 172.21.15.59:0/3468565376 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb80b0070 con 0x7f9cd015a1d0 2024-05-30T16:49:04.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.706+0000 7f9ccd400640 1 -- 172.21.15.59:0/3468565376 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80ab9b0 con 0x7f9cd015a1d0 2024-05-30T16:49:04.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 -- 172.21.15.59:0/3468565376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd015a1d0 msgr2=0x7f9cd00ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:04.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 --2- 172.21.15.59:0/3468565376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd015a1d0 0x7f9cd00ad6f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00b4c20 tx=0x7f9cb801c520 comp rx=0 tx=0).stop 2024-05-30T16:49:04.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 -- 172.21.15.59:0/3468565376 shutdown_connections 2024-05-30T16:49:04.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 --2- 172.21.15.59:0/3468565376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd00b3e50 0x7f9cd015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 --2- 172.21.15.59:0/3468565376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd015a1d0 0x7f9cd00ad6f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 --2- 172.21.15.59:0/3468565376 >> v2:172.21.15.107:3300/0 conn(0x7f9cd0159df0 0x7f9cd00ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 -- 172.21.15.59:0/3468565376 >> 172.21.15.59:0/3468565376 conn(0x7f9cd00b22d0 msgr2=0x7f9cd00b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:04.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 -- 172.21.15.59:0/3468565376 shutdown_connections 2024-05-30T16:49:04.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 -- 172.21.15.59:0/3468565376 wait complete. 2024-05-30T16:49:04.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 Processor -- start 2024-05-30T16:49:04.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 -- start start 2024-05-30T16:49:04.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd00b3e50 0x7f9cd015ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:04.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cd0159df0 0x7f9cd01551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:04.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd015a1d0 0x7f9cd0160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:04.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd015e720 con 0x7f9cd015a1d0 2024-05-30T16:49:04.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd015e5a0 con 0x7f9cd0159df0 2024-05-30T16:49:04.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cd4a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd015e8a0 con 0x7f9cd00b3e50 2024-05-30T16:49:04.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cce800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd015a1d0 0x7f9cd0160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:04.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cce800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd015a1d0 0x7f9cd0160500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43698/0 (socket says 172.21.15.59:43698) 2024-05-30T16:49:04.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cce800640 1 -- 172.21.15.59:0/653657630 learned_addr learned my addr 172.21.15.59:0/653657630 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:04.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cc5400640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cd0159df0 0x7f9cd01551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:04.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9ccde00640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd00b3e50 0x7f9cd015ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:04.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cce800640 1 -- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd00b3e50 msgr2=0x7f9cd015ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:04.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cce800640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd00b3e50 0x7f9cd015ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cce800640 1 -- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cd0159df0 msgr2=0x7f9cd01551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:04.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cce800640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cd0159df0 0x7f9cd01551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.710+0000 7f9cce800640 1 -- 172.21.15.59:0/653657630 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd01556e0 con 0x7f9cd015a1d0 2024-05-30T16:49:04.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.714+0000 7f9cce800640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd015a1d0 0x7f9cd0160500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8007df0 tx=0x7f9cc800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:04.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.714+0000 7f9cc6a00640 1 -- 172.21.15.59:0/653657630 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc801a070 con 0x7f9cd015a1d0 2024-05-30T16:49:04.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.714+0000 7f9cc6a00640 1 -- 172.21.15.59:0/653657630 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc80039a0 con 0x7f9cd015a1d0 2024-05-30T16:49:04.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.714+0000 7f9cc6a00640 1 -- 172.21.15.59:0/653657630 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8003d90 con 0x7f9cd015a1d0 2024-05-30T16:49:04.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.714+0000 7f9cd4a00640 1 -- 172.21.15.59:0/653657630 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd015f4c0 con 0x7f9cd015a1d0 2024-05-30T16:49:04.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.714+0000 7f9cd4a00640 1 -- 172.21.15.59:0/653657630 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd015fd00 con 0x7f9cd015a1d0 2024-05-30T16:49:04.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.714+0000 7f9cd4a00640 1 -- 172.21.15.59:0/653657630 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd0068a90 con 0x7f9cd015a1d0 2024-05-30T16:49:04.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.714+0000 7f9cc6a00640 1 -- 172.21.15.59:0/653657630 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9cc801d070 con 0x7f9cd015a1d0 2024-05-30T16:49:04.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.714+0000 7f9cc6a00640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9cac0683b0 0x7f9cac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:04.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.714+0000 7f9cc6a00640 1 -- 172.21.15.59:0/653657630 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9cc8086cd0 con 0x7f9cd015a1d0 2024-05-30T16:49:04.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.714+0000 7f9ccde00640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9cac0683b0 0x7f9cac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:04.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.718+0000 7f9ccde00640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9cac0683b0 0x7f9cac06a870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009a40 tx=0x7f9cc0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:04.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.718+0000 7f9cc6a00640 1 -- 172.21.15.59:0/653657630 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9cd015f4c0 con 0x7f9cd015a1d0 2024-05-30T16:49:04.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 -- 172.21.15.59:0/653657630 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9cd006fb50 con 0x7f9cd015a1d0 2024-05-30T16:49:04.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cc6a00640 1 -- 172.21.15.59:0/653657630 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16606 (secure 0 0 0) 0x7f9cd01556e0 con 0x7f9cd015a1d0 2024-05-30T16:49:04.896 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:04.896 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":22,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:49:03.924978+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:01.850911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:02.883949+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:04.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 -- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9cac0683b0 msgr2=0x7f9cac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9cac0683b0 0x7f9cac06a870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009a40 tx=0x7f9cc0009190 comp rx=0 tx=0).stop 2024-05-30T16:49:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 -- 172.21.15.59:0/653657630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd015a1d0 msgr2=0x7f9cd0160500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd015a1d0 0x7f9cd0160500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8007df0 tx=0x7f9cc800d4a0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 -- 172.21.15.59:0/653657630 shutdown_connections 2024-05-30T16:49:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9cac0683b0 0x7f9cac06a870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd015a1d0 0x7f9cd0160500 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cd0159df0 0x7f9cd01551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 --2- 172.21.15.59:0/653657630 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd00b3e50 0x7f9cd015ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 -- 172.21.15.59:0/653657630 >> 172.21.15.59:0/653657630 conn(0x7f9cd00b22d0 msgr2=0x7f9cd00af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 -- 172.21.15.59:0/653657630 shutdown_connections 2024-05-30T16:49:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:04.890+0000 7f9cd4a00640 1 -- 172.21.15.59:0/653657630 wait complete. 2024-05-30T16:49:04.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:05.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.050+0000 7f0f3d600640 1 Processor -- start 2024-05-30T16:49:05.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.050+0000 7f0f3d600640 1 -- start start 2024-05-30T16:49:05.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.050+0000 7f0f3d600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f3806c5c0 0x7f0f3806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:05.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.050+0000 7f0f3d600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f380d0b80 0x7f0f3806bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:05.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.050+0000 7f0f3d600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f38163150 con 0x7f0f38162d70 2024-05-30T16:49:05.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.050+0000 7f0f3d600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0f380c7b20 con 0x7f0f3806c5c0 2024-05-30T16:49:05.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.050+0000 7f0f3d600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0f380c7e00 con 0x7f0f380d0b80 2024-05-30T16:49:05.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f2fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f3806c5c0 0x7f0f3806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:05.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f36a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0f38162d70 0x7f0f380cef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58076/0 (socket says 172.21.15.59:58076) 2024-05-30T16:49:05.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f36a00640 1 -- 172.21.15.59:0/351173300 learned_addr learned my addr 172.21.15.59:0/351173300 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:05.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f37400640 1 --2- 172.21.15.59:0/351173300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f380d0b80 0x7f0f3806bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:05.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f2fe00640 1 -- 172.21.15.59:0/351173300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f380d0b80 msgr2=0x7f0f3806bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:05.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f2fe00640 1 --2- 172.21.15.59:0/351173300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f380d0b80 0x7f0f3806bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f2fe00640 1 -- 172.21.15.59:0/351173300 >> v1:172.21.15.59:6789/0 conn(0x7f0f38162d70 legacy=0x7f0f380cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:05.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f2fe00640 1 -- 172.21.15.59:0/351173300 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f380c80e0 con 0x7f0f3806c5c0 2024-05-30T16:49:05.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f37400640 1 --2- 172.21.15.59:0/351173300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f380d0b80 0x7f0f3806bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:05.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f36000640 1 -- 172.21.15.59:0/351173300 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298728864 0 0) 0x7f0f38163150 con 0x7f0f38162d70 2024-05-30T16:49:05.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f2fe00640 1 --2- 172.21.15.59:0/351173300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3806c5c0 0x7f0f3806b9b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f200097c0 tx=0x7f0f2001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de055538e82a41b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:05.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f36000640 1 -- 172.21.15.59:0/351173300 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f200b5070 con 0x7f0f3806c5c0 2024-05-30T16:49:05.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f36000640 1 -- 172.21.15.59:0/351173300 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f200a8990 con 0x7f0f3806c5c0 2024-05-30T16:49:05.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.054+0000 7f0f36000640 1 -- 172.21.15.59:0/351173300 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f200a8d60 con 0x7f0f3806c5c0 2024-05-30T16:49:05.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 -- 172.21.15.59:0/351173300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3806c5c0 msgr2=0x7f0f3806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:05.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 --2- 172.21.15.59:0/351173300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3806c5c0 0x7f0f3806b9b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f200097c0 tx=0x7f0f2001ec90 comp rx=0 tx=0).stop 2024-05-30T16:49:05.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 -- 172.21.15.59:0/351173300 shutdown_connections 2024-05-30T16:49:05.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 --2- 172.21.15.59:0/351173300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f380d0b80 0x7f0f3806bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 --2- 172.21.15.59:0/351173300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3806c5c0 0x7f0f3806b9b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 -- 172.21.15.59:0/351173300 >> 172.21.15.59:0/351173300 conn(0x7f0f380b2fc0 msgr2=0x7f0f380b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:05.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 -- 172.21.15.59:0/351173300 shutdown_connections 2024-05-30T16:49:05.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 -- 172.21.15.59:0/351173300 wait complete. 2024-05-30T16:49:05.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 Processor -- start 2024-05-30T16:49:05.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 -- start start 2024-05-30T16:49:05.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3806c5c0 0x7f0f381f9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f380d0b80 0x7f0f380b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f38162d70 0x7f0f38160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0f380b3c60 con 0x7f0f3806c5c0 2024-05-30T16:49:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0f380b3ae0 con 0x7f0f380d0b80 2024-05-30T16:49:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f3d600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0f380b3de0 con 0x7f0f38162d70 2024-05-30T16:49:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f36a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3806c5c0 0x7f0f381f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f36a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3806c5c0 0x7f0f381f9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43710/0 (socket says 172.21.15.59:43710) 2024-05-30T16:49:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f36a00640 1 -- 172.21.15.59:0/3586134214 learned_addr learned my addr 172.21.15.59:0/3586134214 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f37400640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f38162d70 0x7f0f38160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f2fe00640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f380d0b80 0x7f0f380b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f36a00640 1 -- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f38162d70 msgr2=0x7f0f38160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f36a00640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f38162d70 0x7f0f38160440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f36a00640 1 -- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f380d0b80 msgr2=0x7f0f380b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:05.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f36a00640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f380d0b80 0x7f0f380b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f36a00640 1 -- 172.21.15.59:0/3586134214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f380b17d0 con 0x7f0f3806c5c0 2024-05-30T16:49:05.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.058+0000 7f0f36a00640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3806c5c0 0x7f0f381f9130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800c480 tx=0x7f0f2800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:05.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.062+0000 7f0f2ea00640 1 -- 172.21.15.59:0/3586134214 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28018070 con 0x7f0f3806c5c0 2024-05-30T16:49:05.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.062+0000 7f0f2ea00640 1 -- 172.21.15.59:0/3586134214 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f28007500 con 0x7f0f3806c5c0 2024-05-30T16:49:05.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.062+0000 7f0f2ea00640 1 -- 172.21.15.59:0/3586134214 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28004a30 con 0x7f0f3806c5c0 2024-05-30T16:49:05.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.062+0000 7f0f3d600640 1 -- 172.21.15.59:0/3586134214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f380b1ab0 con 0x7f0f3806c5c0 2024-05-30T16:49:05.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.062+0000 7f0f3d600640 1 -- 172.21.15.59:0/3586134214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f380b2070 con 0x7f0f3806c5c0 2024-05-30T16:49:05.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.062+0000 7f0f3d600640 1 -- 172.21.15.59:0/3586134214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f38068a90 con 0x7f0f3806c5c0 2024-05-30T16:49:05.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.062+0000 7f0f2ea00640 1 -- 172.21.15.59:0/3586134214 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0f28004bd0 con 0x7f0f3806c5c0 2024-05-30T16:49:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.062+0000 7f0f2ea00640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0f14068380 0x7f0f1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.062+0000 7f0f2ea00640 1 -- 172.21.15.59:0/3586134214 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0f28085bf0 con 0x7f0f3806c5c0 2024-05-30T16:49:05.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.066+0000 7f0f2fe00640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0f14068380 0x7f0f1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:05.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.066+0000 7f0f2fe00640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0f14068380 0x7f0f1406a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0f200b2000 tx=0x7f0f200aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:05.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.070+0000 7f0f2ea00640 1 -- 172.21.15.59:0/3586134214 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0f28056240 con 0x7f0f3806c5c0 2024-05-30T16:49:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.234+0000 7f0f3d600640 1 -- 172.21.15.59:0/3586134214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f380c75c0 con 0x7f0f3806c5c0 2024-05-30T16:49:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.234+0000 7f0f2ea00640 1 -- 172.21.15.59:0/3586134214 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16606 (secure 0 0 0) 0x7f0f28055b40 con 0x7f0f3806c5c0 2024-05-30T16:49:05.240 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:05.241 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":22,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:49:03.924978+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:01.850911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:02.883949+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.238+0000 7f0f3d600640 1 -- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0f14068380 msgr2=0x7f0f1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.238+0000 7f0f3d600640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0f14068380 0x7f0f1406a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0f200b2000 tx=0x7f0f200aa070 comp rx=0 tx=0).stop 2024-05-30T16:49:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.238+0000 7f0f3d600640 1 -- 172.21.15.59:0/3586134214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3806c5c0 msgr2=0x7f0f381f9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.238+0000 7f0f3d600640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3806c5c0 0x7f0f381f9130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800c480 tx=0x7f0f2800c940 comp rx=0 tx=0).stop 2024-05-30T16:49:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.238+0000 7f0f3d600640 1 -- 172.21.15.59:0/3586134214 shutdown_connections 2024-05-30T16:49:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.238+0000 7f0f3d600640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0f14068380 0x7f0f1406a840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.238+0000 7f0f3d600640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f38162d70 0x7f0f38160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.238+0000 7f0f3d600640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f380d0b80 0x7f0f380b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.238+0000 7f0f3d600640 1 --2- 172.21.15.59:0/3586134214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3806c5c0 0x7f0f381f9130 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.238+0000 7f0f3d600640 1 -- 172.21.15.59:0/3586134214 >> 172.21.15.59:0/3586134214 conn(0x7f0f380b2fc0 msgr2=0x7f0f3815fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.238+0000 7f0f3d600640 1 -- 172.21.15.59:0/3586134214 shutdown_connections 2024-05-30T16:49:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.238+0000 7f0f3d600640 1 -- 172.21.15.59:0/3586134214 wait complete. 2024-05-30T16:49:05.262 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T16:49:05.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.398+0000 7f9e94200640 1 Processor -- start 2024-05-30T16:49:05.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.398+0000 7f9e94200640 1 -- start start 2024-05-30T16:49:05.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.398+0000 7f9e94200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9e8c0ad2b0 0x7f9e8c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:05.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.398+0000 7f9e94200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0d0660 0x7f9e8c0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:05.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.398+0000 7f9e94200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e8c0ad770 con 0x7f9e8c1569e0 2024-05-30T16:49:05.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.398+0000 7f9e94200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9e8c0d1010 con 0x7f9e8c0ad2b0 2024-05-30T16:49:05.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.398+0000 7f9e94200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8c15cb40 con 0x7f9e8c0d0660 2024-05-30T16:49:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.402+0000 7f9e90e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9e8c0ad2b0 0x7f9e8c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.402+0000 7f9e91800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9e8c1569e0 0x7f9e8c0cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:44032/0 (socket says 172.21.15.59:44032) 2024-05-30T16:49:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.402+0000 7f9e91800640 1 -- 172.21.15.59:0/1887999066 learned_addr learned my addr 172.21.15.59:0/1887999066 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.402+0000 7f9e92200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0d0660 0x7f9e8c0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.402+0000 7f9e8be00640 1 -- 172.21.15.59:0/1887999066 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4170252931 0 0) 0x7f9e8c0ad770 con 0x7f9e8c1569e0 2024-05-30T16:49:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.402+0000 7f9e8be00640 1 -- 172.21.15.59:0/1887999066 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e74003530 con 0x7f9e8c1569e0 2024-05-30T16:49:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.402+0000 7f9e92200640 1 -- 172.21.15.59:0/1887999066 >> v2:172.21.15.107:3300/0 conn(0x7f9e8c0ad2b0 msgr2=0x7f9e8c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.402+0000 7f9e92200640 1 --2- 172.21.15.59:0/1887999066 >> v2:172.21.15.107:3300/0 conn(0x7f9e8c0ad2b0 0x7f9e8c15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.402+0000 7f9e92200640 1 -- 172.21.15.59:0/1887999066 >> v1:172.21.15.107:6789/0 conn(0x7f9e8c1569e0 legacy=0x7f9e8c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:05.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.402+0000 7f9e92200640 1 -- 172.21.15.59:0/1887999066 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c15ce20 con 0x7f9e8c0d0660 2024-05-30T16:49:05.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.402+0000 7f9e90e00640 1 --2- 172.21.15.59:0/1887999066 >> v2:172.21.15.107:3300/0 conn(0x7f9e8c0ad2b0 0x7f9e8c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:05.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.402+0000 7f9e92200640 1 --2- 172.21.15.59:0/1887999066 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0d0660 0x7f9e8c0d0ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009d90 tx=0x7f9e8401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4016375664be4931 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:05.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e8be00640 1 -- 172.21.15.59:0/1887999066 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840b2070 con 0x7f9e8c0d0660 2024-05-30T16:49:05.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e8be00640 1 -- 172.21.15.59:0/1887999066 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e840a5820 con 0x7f9e8c0d0660 2024-05-30T16:49:05.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e8be00640 1 -- 172.21.15.59:0/1887999066 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840a5bf0 con 0x7f9e8c0d0660 2024-05-30T16:49:05.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 -- 172.21.15.59:0/1887999066 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0d0660 msgr2=0x7f9e8c0d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:05.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 --2- 172.21.15.59:0/1887999066 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0d0660 0x7f9e8c0d0ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009d90 tx=0x7f9e8401c8e0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 -- 172.21.15.59:0/1887999066 shutdown_connections 2024-05-30T16:49:05.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 --2- 172.21.15.59:0/1887999066 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0d0660 0x7f9e8c0d0ad0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 --2- 172.21.15.59:0/1887999066 >> v2:172.21.15.107:3300/0 conn(0x7f9e8c0ad2b0 0x7f9e8c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 -- 172.21.15.59:0/1887999066 >> 172.21.15.59:0/1887999066 conn(0x7f9e8c06bdb0 msgr2=0x7f9e8c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:05.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 -- 172.21.15.59:0/1887999066 shutdown_connections 2024-05-30T16:49:05.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 -- 172.21.15.59:0/1887999066 wait complete. 2024-05-30T16:49:05.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 Processor -- start 2024-05-30T16:49:05.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 -- start start 2024-05-30T16:49:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0ad2b0 0x7f9e8c15f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c0d0660 0x7f9e8c14a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e8c1569e0 0x7f9e8c151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c0b3c60 con 0x7f9e8c0d0660 2024-05-30T16:49:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c0b3ae0 con 0x7f9e8c1569e0 2024-05-30T16:49:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e94200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8c0b3de0 con 0x7f9e8c0ad2b0 2024-05-30T16:49:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e90e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c0d0660 0x7f9e8c14a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e90e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c0d0660 0x7f9e8c14a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43716/0 (socket says 172.21.15.59:43716) 2024-05-30T16:49:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e90e00640 1 -- 172.21.15.59:0/2223117756 learned_addr learned my addr 172.21.15.59:0/2223117756 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e91800640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0ad2b0 0x7f9e8c15f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e92200640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e8c1569e0 0x7f9e8c151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.406+0000 7f9e90e00640 1 -- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0ad2b0 msgr2=0x7f9e8c15f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e90e00640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0ad2b0 0x7f9e8c15f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e90e00640 1 -- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e8c1569e0 msgr2=0x7f9e8c151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e90e00640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e8c1569e0 0x7f9e8c151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e90e00640 1 -- 172.21.15.59:0/2223117756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c0b25c0 con 0x7f9e8c0d0660 2024-05-30T16:49:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e90e00640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c0d0660 0x7f9e8c14a4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800e980 tx=0x7f9e7800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e89600640 1 -- 172.21.15.59:0/2223117756 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78017070 con 0x7f9e8c0d0660 2024-05-30T16:49:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e89600640 1 -- 172.21.15.59:0/2223117756 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7800ca00 con 0x7f9e8c0d0660 2024-05-30T16:49:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e94200640 1 -- 172.21.15.59:0/2223117756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8c0b28a0 con 0x7f9e8c0d0660 2024-05-30T16:49:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e89600640 1 -- 172.21.15.59:0/2223117756 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800cdd0 con 0x7f9e8c0d0660 2024-05-30T16:49:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e94200640 1 -- 172.21.15.59:0/2223117756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8c151160 con 0x7f9e8c0d0660 2024-05-30T16:49:05.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e94200640 1 -- 172.21.15.59:0/2223117756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8c068a90 con 0x7f9e8c0d0660 2024-05-30T16:49:05.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e89600640 1 -- 172.21.15.59:0/2223117756 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e7801a070 con 0x7f9e8c0d0660 2024-05-30T16:49:05.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e89600640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9e6c068380 0x7f9e6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:05.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e89600640 1 -- 172.21.15.59:0/2223117756 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9e78086c20 con 0x7f9e8c0d0660 2024-05-30T16:49:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.410+0000 7f9e91800640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9e6c068380 0x7f9e6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.414+0000 7f9e91800640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9e6c068380 0x7f9e6c06a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9e80007fd0 tx=0x7f9e80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:05.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.414+0000 7f9e89600640 1 -- 172.21.15.59:0/2223117756 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9e78056af0 con 0x7f9e8c0d0660 2024-05-30T16:49:05.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:05.618+0000 7f9e94200640 1 -- 172.21.15.59:0/2223117756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9e8c1522f0 con 0x7f9e8c0d0660 2024-05-30T16:49:06.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.534+0000 7f9e89600640 1 -- 172.21.15.59:0/2223117756 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f9e7805adf0 con 0x7f9e8c0d0660 2024-05-30T16:49:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.538+0000 7f9e94200640 1 -- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9e6c068380 msgr2=0x7f9e6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.538+0000 7f9e94200640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9e6c068380 0x7f9e6c06a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9e80007fd0 tx=0x7f9e80009040 comp rx=0 tx=0).stop 2024-05-30T16:49:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.538+0000 7f9e94200640 1 -- 172.21.15.59:0/2223117756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c0d0660 msgr2=0x7f9e8c14a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.538+0000 7f9e94200640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c0d0660 0x7f9e8c14a4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800e980 tx=0x7f9e7800ee40 comp rx=0 tx=0).stop 2024-05-30T16:49:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.538+0000 7f9e94200640 1 -- 172.21.15.59:0/2223117756 shutdown_connections 2024-05-30T16:49:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.538+0000 7f9e94200640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9e6c068380 0x7f9e6c06a840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.538+0000 7f9e94200640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e8c1569e0 0x7f9e8c151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.538+0000 7f9e94200640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c0d0660 0x7f9e8c14a4e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.538+0000 7f9e94200640 1 --2- 172.21.15.59:0/2223117756 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0ad2b0 0x7f9e8c15f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.538+0000 7f9e94200640 1 -- 172.21.15.59:0/2223117756 >> 172.21.15.59:0/2223117756 conn(0x7f9e8c06bdb0 msgr2=0x7f9e8c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.538+0000 7f9e94200640 1 -- 172.21.15.59:0/2223117756 shutdown_connections 2024-05-30T16:49:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.538+0000 7f9e94200640 1 -- 172.21.15.59:0/2223117756 wait complete. 2024-05-30T16:49:06.568 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T16:49:06.568 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T16:49:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.710+0000 7f7e3c600640 1 Processor -- start 2024-05-30T16:49:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.710+0000 7f7e3c600640 1 -- start start 2024-05-30T16:49:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.710+0000 7f7e3c600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7e34159100 0x7f7e3406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.710+0000 7f7e3c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b44e0 0x7f7e3415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.710+0000 7f7e3c600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e340b52d0 con 0x7f7e3415f510 2024-05-30T16:49:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.710+0000 7f7e3c600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7e340b4a30 con 0x7f7e34159100 2024-05-30T16:49:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.710+0000 7f7e3c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7e340b4d10 con 0x7f7e340b44e0 2024-05-30T16:49:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e3a600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7e3415f510 0x7f7e3415c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58078/0 (socket says 172.21.15.59:58078) 2024-05-30T16:49:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e3a600640 1 -- 172.21.15.59:0/3794440652 learned_addr learned my addr 172.21.15.59:0/3794440652 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e39c00640 1 --2- 172.21.15.59:0/3794440652 >> v2:172.21.15.107:3300/0 conn(0x7f7e34159100 0x7f7e3406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e39200640 1 --2- 172.21.15.59:0/3794440652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b44e0 0x7f7e3415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656074182 0 0) 0x7f7e340b52d0 con 0x7f7e3415f510 2024-05-30T16:49:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e1c003530 con 0x7f7e3415f510 2024-05-30T16:49:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3409269949 0 0) 0x7f7e1c003530 con 0x7f7e3415f510 2024-05-30T16:49:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b44e0 msgr2=0x7f7e3415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 --2- 172.21.15.59:0/3794440652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b44e0 0x7f7e3415efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 >> v2:172.21.15.107:3300/0 conn(0x7f7e34159100 msgr2=0x7f7e3406e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 --2- 172.21.15.59:0/3794440652 >> v2:172.21.15.107:3300/0 conn(0x7f7e34159100 0x7f7e3406e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e340b4ff0 con 0x7f7e3415f510 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f7e2c001a00 con 0x7f7e3415f510 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 >> v1:172.21.15.59:6789/0 conn(0x7f7e3415f510 legacy=0x7f7e3415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 --2- 172.21.15.59:0/3794440652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0039c0 0x7f7e1c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 --2- 172.21.15.59:0/3794440652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e1c004810 0x7f7e1c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 --2- 172.21.15.59:0/3794440652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b44e0 0x7f7e1c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340b4a30 con 0x7f7e1c0039c0 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340b4d10 con 0x7f7e1c004810 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1c00dc60 con 0x7f7e340b44e0 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e39c00640 1 --2- 172.21.15.59:0/3794440652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0039c0 0x7f7e1c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e39200640 1 --2- 172.21.15.59:0/3794440652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e1c004810 0x7f7e1c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e3a600640 1 --2- 172.21.15.59:0/3794440652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b44e0 0x7f7e1c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e39c00640 1 -- 172.21.15.59:0/3794440652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b44e0 msgr2=0x7f7e1c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e39c00640 1 --2- 172.21.15.59:0/3794440652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b44e0 0x7f7e1c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e39c00640 1 -- 172.21.15.59:0/3794440652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e1c004810 msgr2=0x7f7e1c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e39c00640 1 --2- 172.21.15.59:0/3794440652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e1c004810 0x7f7e1c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.714+0000 7f7e39c00640 1 -- 172.21.15.59:0/3794440652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1c003530 con 0x7f7e1c0039c0 2024-05-30T16:49:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e39c00640 1 --2- 172.21.15.59:0/3794440652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0039c0 0x7f7e1c003de0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009ae0 tx=0x7f7e2801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2162db1e3cb45637 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e280b2070 con 0x7f7e1c0039c0 2024-05-30T16:49:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e280a5560 con 0x7f7e1c0039c0 2024-05-30T16:49:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e33e00640 1 -- 172.21.15.59:0/3794440652 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e280096b0 con 0x7f7e1c0039c0 2024-05-30T16:49:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e3c600640 1 -- 172.21.15.59:0/3794440652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0039c0 msgr2=0x7f7e1c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e3c600640 1 --2- 172.21.15.59:0/3794440652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0039c0 0x7f7e1c003de0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009ae0 tx=0x7f7e2801ca80 comp rx=0 tx=0).stop 2024-05-30T16:49:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e3a600640 1 -- 172.21.15.59:0/3794440652 reap_dead start 2024-05-30T16:49:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e3c600640 1 -- 172.21.15.59:0/3794440652 shutdown_connections 2024-05-30T16:49:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e3c600640 1 -- 172.21.15.59:0/3794440652 >> 172.21.15.59:0/3794440652 conn(0x7f7e3406bdb0 msgr2=0x7f7e3406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e3c600640 1 -- 172.21.15.59:0/3794440652 shutdown_connections 2024-05-30T16:49:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e3c600640 1 -- 172.21.15.59:0/3794440652 wait complete. 2024-05-30T16:49:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e3c600640 1 Processor -- start 2024-05-30T16:49:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e3c600640 1 -- start start 2024-05-30T16:49:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.718+0000 7f7e3c600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0039c0 0x7f7e3414f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e3c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b2ae0 0x7f7e341507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e3c600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e34150d20 0x7f7e3415dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e3c600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340b33b0 con 0x7f7e1c0039c0 2024-05-30T16:49:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e3c600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340b3530 con 0x7f7e34150d20 2024-05-30T16:49:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e3c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7e340b36b0 con 0x7f7e340b2ae0 2024-05-30T16:49:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e39c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0039c0 0x7f7e3414f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e39c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0039c0 0x7f7e3414f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43732/0 (socket says 172.21.15.59:43732) 2024-05-30T16:49:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e39c00640 1 -- 172.21.15.59:0/3559344869 learned_addr learned my addr 172.21.15.59:0/3559344869 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e39200640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b2ae0 0x7f7e341507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e3a600640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e34150d20 0x7f7e3415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e39c00640 1 -- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b2ae0 msgr2=0x7f7e341507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e39c00640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b2ae0 0x7f7e341507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e39c00640 1 -- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e34150d20 msgr2=0x7f7e3415dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e39c00640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e34150d20 0x7f7e3415dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e39c00640 1 -- 172.21.15.59:0/3559344869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e340b1a40 con 0x7f7e1c0039c0 2024-05-30T16:49:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e39200640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b2ae0 0x7f7e341507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e3a600640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e34150d20 0x7f7e3415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e39c00640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0039c0 0x7f7e3414f6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009ae0 tx=0x7f7e1c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e31600640 1 -- 172.21.15.59:0/3559344869 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e280b2040 con 0x7f7e1c0039c0 2024-05-30T16:49:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e31600640 1 -- 172.21.15.59:0/3559344869 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2800f000 con 0x7f7e1c0039c0 2024-05-30T16:49:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e31600640 1 -- 172.21.15.59:0/3559344869 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28004020 con 0x7f7e1c0039c0 2024-05-30T16:49:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e3c600640 1 -- 172.21.15.59:0/3559344869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e340b1d20 con 0x7f7e1c0039c0 2024-05-30T16:49:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e3c600640 1 -- 172.21.15.59:0/3559344869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e340b22e0 con 0x7f7e1c0039c0 2024-05-30T16:49:06.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e3c600640 1 -- 172.21.15.59:0/3559344869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e34068a90 con 0x7f7e1c0039c0 2024-05-30T16:49:06.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.722+0000 7f7e31600640 1 -- 172.21.15.59:0/3559344869 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7e280c0030 con 0x7f7e1c0039c0 2024-05-30T16:49:06.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.726+0000 7f7e31600640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7e14068380 0x7f7e1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:06.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.726+0000 7f7e31600640 1 -- 172.21.15.59:0/3559344869 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7e28120580 con 0x7f7e1c0039c0 2024-05-30T16:49:06.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.726+0000 7f7e39200640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7e14068380 0x7f7e1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:06.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.726+0000 7f7e39200640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7e14068380 0x7f7e1406a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7e341f7280 tx=0x7f7e20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:06.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.730+0000 7f7e31600640 1 -- 172.21.15.59:0/3559344869 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7e280c7060 con 0x7f7e1c0039c0 2024-05-30T16:49:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:06.930+0000 7f7e3c600640 1 -- 172.21.15.59:0/3559344869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7e340720e0 con 0x7f7e1c0039c0 2024-05-30T16:49:07.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.538+0000 7f7e31600640 1 -- 172.21.15.59:0/3559344869 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f7e280167c0 con 0x7f7e1c0039c0 2024-05-30T16:49:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.542+0000 7f7e3c600640 1 -- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7e14068380 msgr2=0x7f7e1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.542+0000 7f7e3c600640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7e14068380 0x7f7e1406a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7e341f7280 tx=0x7f7e20008040 comp rx=0 tx=0).stop 2024-05-30T16:49:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.542+0000 7f7e3c600640 1 -- 172.21.15.59:0/3559344869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0039c0 msgr2=0x7f7e3414f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.542+0000 7f7e3c600640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0039c0 0x7f7e3414f6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009ae0 tx=0x7f7e1c005840 comp rx=0 tx=0).stop 2024-05-30T16:49:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.542+0000 7f7e3c600640 1 -- 172.21.15.59:0/3559344869 shutdown_connections 2024-05-30T16:49:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.542+0000 7f7e3c600640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7e14068380 0x7f7e1406a840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.542+0000 7f7e3c600640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e34150d20 0x7f7e3415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.542+0000 7f7e3c600640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e340b2ae0 0x7f7e341507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.542+0000 7f7e3c600640 1 --2- 172.21.15.59:0/3559344869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0039c0 0x7f7e3414f6e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.542+0000 7f7e3c600640 1 -- 172.21.15.59:0/3559344869 >> 172.21.15.59:0/3559344869 conn(0x7f7e3406bdb0 msgr2=0x7f7e34152840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.542+0000 7f7e3c600640 1 -- 172.21.15.59:0/3559344869 shutdown_connections 2024-05-30T16:49:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.542+0000 7f7e3c600640 1 -- 172.21.15.59:0/3559344869 wait complete. 2024-05-30T16:49:07.572 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T16:49:07.572 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:07.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.710+0000 7f4c1e000640 1 Processor -- start 2024-05-30T16:49:07.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.710+0000 7f4c1e000640 1 -- start start 2024-05-30T16:49:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.710+0000 7f4c1e000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c1809aa40 0x7f4c1809ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c1e000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c180b61f0 con 0x7f4c1815e7e0 2024-05-30T16:49:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c1e000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c1815ebc0 con 0x7f4c1815ff00 2024-05-30T16:49:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c1e000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1809b3d0 con 0x7f4c1809aa40 2024-05-30T16:49:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c17400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4c1815e7e0 0x7f4c180b6e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58086/0 (socket says 172.21.15.59:58086) 2024-05-30T16:49:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c17400640 1 -- 172.21.15.59:0/3256556784 learned_addr learned my addr 172.21.15.59:0/3256556784 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c0ea00640 1 --2- 172.21.15.59:0/3256556784 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c1809aa40 0x7f4c1809ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c16a00640 1 -- 172.21.15.59:0/3256556784 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190687387 0 0) 0x7f4c08001120 con 0x7f4c1815e7e0 2024-05-30T16:49:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c16a00640 1 -- 172.21.15.59:0/3256556784 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bfc003530 con 0x7f4c1815e7e0 2024-05-30T16:49:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c16a00640 1 -- 172.21.15.59:0/3256556784 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195557798 0 0) 0x7f4c1815ebc0 con 0x7f4c1815ff00 2024-05-30T16:49:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c16a00640 1 -- 172.21.15.59:0/3256556784 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c08001120 con 0x7f4c1815ff00 2024-05-30T16:49:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c16a00640 1 -- 172.21.15.59:0/3256556784 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 169310650 0 0) 0x7f4bfc003530 con 0x7f4c1815e7e0 2024-05-30T16:49:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c0ea00640 1 -- 172.21.15.59:0/3256556784 >> v1:172.21.15.107:6789/0 conn(0x7f4c1815ff00 legacy=0x7f4c18160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c0ea00640 1 -- 172.21.15.59:0/3256556784 >> v1:172.21.15.59:6789/0 conn(0x7f4c1815e7e0 legacy=0x7f4c180b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.714+0000 7f4c0ea00640 1 -- 172.21.15.59:0/3256556784 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1815ee60 con 0x7f4c1809aa40 2024-05-30T16:49:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c0ea00640 1 --2- 172.21.15.59:0/3256556784 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c1809aa40 0x7f4c1809ae90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c000097f0 tx=0x7f4c0001c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc931b8989a0c4fd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c16a00640 1 -- 172.21.15.59:0/3256556784 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c000b0070 con 0x7f4c1809aa40 2024-05-30T16:49:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c16a00640 1 -- 172.21.15.59:0/3256556784 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c00004030 con 0x7f4c1809aa40 2024-05-30T16:49:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c16a00640 1 -- 172.21.15.59:0/3256556784 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08001850 con 0x7f4c1809aa40 2024-05-30T16:49:07.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 -- 172.21.15.59:0/3256556784 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c1809aa40 msgr2=0x7f4c1809ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:07.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 --2- 172.21.15.59:0/3256556784 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c1809aa40 0x7f4c1809ae90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c000097f0 tx=0x7f4c0001c3d0 comp rx=0 tx=0).stop 2024-05-30T16:49:07.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 -- 172.21.15.59:0/3256556784 shutdown_connections 2024-05-30T16:49:07.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 --2- 172.21.15.59:0/3256556784 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c1809aa40 0x7f4c1809ae90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:07.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 -- 172.21.15.59:0/3256556784 >> 172.21.15.59:0/3256556784 conn(0x7f4c180b41a0 msgr2=0x7f4c180b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:07.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 -- 172.21.15.59:0/3256556784 shutdown_connections 2024-05-30T16:49:07.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 -- 172.21.15.59:0/3256556784 wait complete. 2024-05-30T16:49:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 Processor -- start 2024-05-30T16:49:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 -- start start 2024-05-30T16:49:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1809aa40 0x7f4c1814db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c1815e7e0 0x7f4c18156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c1815ff00 0x7f4c18156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4c180b7570 con 0x7f4c1809aa40 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1815f9e0 con 0x7f4c1815ff00 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c1e000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4c180b76f0 con 0x7f4c1815e7e0 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c17400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1809aa40 0x7f4c1814db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c17400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1809aa40 0x7f4c1814db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43744/0 (socket says 172.21.15.59:43744) 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.718+0000 7f4c17400640 1 -- 172.21.15.59:0/1999427704 learned_addr learned my addr 172.21.15.59:0/1999427704 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c0ea00640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c1815e7e0 0x7f4c18156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c17e00640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c1815ff00 0x7f4c18156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c17400640 1 -- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c1815e7e0 msgr2=0x7f4c18156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c17400640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c1815e7e0 0x7f4c18156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c17400640 1 -- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c1815ff00 msgr2=0x7f4c18156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c17400640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c1815ff00 0x7f4c18156980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c17400640 1 -- 172.21.15.59:0/1999427704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c181509a0 con 0x7f4c1809aa40 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c17e00640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c1815ff00 0x7f4c18156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c17400640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1809aa40 0x7f4c1814db20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800cad0 tx=0x7f4c0800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:07.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c0fe00640 1 -- 172.21.15.59:0/1999427704 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08005cf0 con 0x7f4c1809aa40 2024-05-30T16:49:07.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c0fe00640 1 -- 172.21.15.59:0/1999427704 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c08007070 con 0x7f4c1809aa40 2024-05-30T16:49:07.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c0fe00640 1 -- 172.21.15.59:0/1999427704 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c080074a0 con 0x7f4c1809aa40 2024-05-30T16:49:07.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c1e000640 1 -- 172.21.15.59:0/1999427704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c18150c80 con 0x7f4c1809aa40 2024-05-30T16:49:07.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c1e000640 1 -- 172.21.15.59:0/1999427704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1815ac90 con 0x7f4c1809aa40 2024-05-30T16:49:07.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c1e000640 1 -- 172.21.15.59:0/1999427704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c18068a90 con 0x7f4c1809aa40 2024-05-30T16:49:07.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c0fe00640 1 -- 172.21.15.59:0/1999427704 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4c0800a640 con 0x7f4c1809aa40 2024-05-30T16:49:07.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c0fe00640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4bf4068380 0x7f4bf406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:07.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.722+0000 7f4c0fe00640 1 -- 172.21.15.59:0/1999427704 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4c08086900 con 0x7f4c1809aa40 2024-05-30T16:49:07.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.726+0000 7f4c0ea00640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4bf4068380 0x7f4bf406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:07.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.726+0000 7f4c0ea00640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4bf4068380 0x7f4bf406a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c000ad000 tx=0x7f4c00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:07.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.726+0000 7f4c0fe00640 1 -- 172.21.15.59:0/1999427704 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4c180b61f0 con 0x7f4c1809aa40 2024-05-30T16:49:07.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.926+0000 7f4c1e000640 1 -- 172.21.15.59:0/1999427704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c180d2290 con 0x7f4c1809aa40 2024-05-30T16:49:07.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.926+0000 7f4c0fe00640 1 -- 172.21.15.59:0/1999427704 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7f4c08086020 con 0x7f4c1809aa40 2024-05-30T16:49:07.932 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:07.933 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/2922739893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2922739893},{"type":"v1","addr":"172.21.15.59:6833","nonce":2922739893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1233400446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1233400446},{"type":"v1","addr":"172.21.15.59:6835","nonce":1233400446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1465510297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1465510297},{"type":"v1","addr":"172.21.15.107:6836","nonce":1465510297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:03.924942+0000","modified":"2024-05-30T16:49:06.937279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3864508560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3864508560},{"type":"v1","addr":"172.21.15.107:6837","nonce":3864508560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-05-30T16:49:07.933 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2024-05-30T16:49:07.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.930+0000 7f4c1e000640 1 -- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4bf4068380 msgr2=0x7f4bf406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:07.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.930+0000 7f4c1e000640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4bf4068380 0x7f4bf406a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c000ad000 tx=0x7f4c00008040 comp rx=0 tx=0).stop 2024-05-30T16:49:07.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.930+0000 7f4c1e000640 1 -- 172.21.15.59:0/1999427704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1809aa40 msgr2=0x7f4c1814db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:07.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.930+0000 7f4c1e000640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1809aa40 0x7f4c1814db20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800cad0 tx=0x7f4c0800cf90 comp rx=0 tx=0).stop 2024-05-30T16:49:07.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.930+0000 7f4c1e000640 1 -- 172.21.15.59:0/1999427704 shutdown_connections 2024-05-30T16:49:07.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.930+0000 7f4c1e000640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4bf4068380 0x7f4bf406a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:07.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.930+0000 7f4c1e000640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c1815ff00 0x7f4c18156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:07.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.930+0000 7f4c1e000640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c1815e7e0 0x7f4c18156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:07.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.930+0000 7f4c1e000640 1 --2- 172.21.15.59:0/1999427704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1809aa40 0x7f4c1814db20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:07.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.930+0000 7f4c1e000640 1 -- 172.21.15.59:0/1999427704 >> 172.21.15.59:0/1999427704 conn(0x7f4c180b41a0 msgr2=0x7f4c180b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:07.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.930+0000 7f4c1e000640 1 -- 172.21.15.59:0/1999427704 shutdown_connections 2024-05-30T16:49:07.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:07.930+0000 7f4c1e000640 1 -- 172.21.15.59:0/1999427704 wait complete. 2024-05-30T16:49:07.954 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:08.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d68600640 1 Processor -- start 2024-05-30T16:49:08.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d68600640 1 -- start start 2024-05-30T16:49:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d68600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d6009b150 0x7f2d601699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d68600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d60070950 con 0x7f2d600d05b0 2024-05-30T16:49:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d68600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d60070c30 con 0x7f2d600d14c0 2024-05-30T16:49:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d68600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f2d60070f10 con 0x7f2d6009b150 2024-05-30T16:49:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d66600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d6009b150 0x7f2d601699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d65200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2d600d05b0 0x7f2d6009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58096/0 (socket says 172.21.15.59:58096) 2024-05-30T16:49:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d65200640 1 -- 172.21.15.59:0/2250251814 learned_addr learned my addr 172.21.15.59:0/2250251814 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d5fe00640 1 -- 172.21.15.59:0/2250251814 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567296044 0 0) 0x7f2d60070950 con 0x7f2d600d05b0 2024-05-30T16:49:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d5fe00640 1 -- 172.21.15.59:0/2250251814 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d48003530 con 0x7f2d600d05b0 2024-05-30T16:49:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d66600640 1 -- 172.21.15.59:0/2250251814 >> v1:172.21.15.107:6789/0 conn(0x7f2d600d14c0 legacy=0x7f2d6006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d66600640 1 -- 172.21.15.59:0/2250251814 >> v1:172.21.15.59:6789/0 conn(0x7f2d600d05b0 legacy=0x7f2d6009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.090+0000 7f2d66600640 1 -- 172.21.15.59:0/2250251814 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6006cbd0 con 0x7f2d6009b150 2024-05-30T16:49:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.094+0000 7f2d66600640 1 --2- 172.21.15.59:0/2250251814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d6009b150 0x7f2d601699b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009d90 tx=0x7f2d5801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89249a6c5f9c8115 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.094+0000 7f2d5fe00640 1 -- 172.21.15.59:0/2250251814 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d580b2070 con 0x7f2d6009b150 2024-05-30T16:49:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.094+0000 7f2d5fe00640 1 -- 172.21.15.59:0/2250251814 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d580a59f0 con 0x7f2d6009b150 2024-05-30T16:49:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.094+0000 7f2d5fe00640 1 -- 172.21.15.59:0/2250251814 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d580a5dc0 con 0x7f2d6009b150 2024-05-30T16:49:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.094+0000 7f2d68600640 1 -- 172.21.15.59:0/2250251814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d6009b150 msgr2=0x7f2d601699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.094+0000 7f2d68600640 1 --2- 172.21.15.59:0/2250251814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d6009b150 0x7f2d601699b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009d90 tx=0x7f2d5801c910 comp rx=0 tx=0).stop 2024-05-30T16:49:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.094+0000 7f2d68600640 1 -- 172.21.15.59:0/2250251814 shutdown_connections 2024-05-30T16:49:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.094+0000 7f2d68600640 1 --2- 172.21.15.59:0/2250251814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d6009b150 0x7f2d601699b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.094+0000 7f2d68600640 1 -- 172.21.15.59:0/2250251814 >> 172.21.15.59:0/2250251814 conn(0x7f2d600b3f80 msgr2=0x7f2d600b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.094+0000 7f2d68600640 1 -- 172.21.15.59:0/2250251814 shutdown_connections 2024-05-30T16:49:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.094+0000 7f2d68600640 1 -- 172.21.15.59:0/2250251814 wait complete. 2024-05-30T16:49:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d68600640 1 Processor -- start 2024-05-30T16:49:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d68600640 1 -- start start 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d68600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d6009b150 0x7f2d6015e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d68600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d600d05b0 0x7f2d600c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d68600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d600d14c0 0x7f2d6015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d68600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6006e280 con 0x7f2d600d14c0 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d68600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6006e100 con 0x7f2d6009b150 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d68600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6016c710 con 0x7f2d600d05b0 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d66600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d600d14c0 0x7f2d6015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d66600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d600d14c0 0x7f2d6015b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43760/0 (socket says 172.21.15.59:43760) 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d66600640 1 -- 172.21.15.59:0/2918330370 learned_addr learned my addr 172.21.15.59:0/2918330370 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d65200640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d600d05b0 0x7f2d600c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d65c00640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d6009b150 0x7f2d6015e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d66600640 1 -- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d600d05b0 msgr2=0x7f2d600c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d66600640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d600d05b0 0x7f2d600c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d66600640 1 -- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d6009b150 msgr2=0x7f2d6015e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d66600640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d6009b150 0x7f2d6015e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d66600640 1 -- 172.21.15.59:0/2918330370 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d600c6460 con 0x7f2d600d14c0 2024-05-30T16:49:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d65200640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d600d05b0 0x7f2d600c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d65c00640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d6009b150 0x7f2d6015e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d66600640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d600d14c0 0x7f2d6015b620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d5801a5a0 tx=0x7f2d58019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d5d600640 1 -- 172.21.15.59:0/2918330370 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d580b2050 con 0x7f2d600d14c0 2024-05-30T16:49:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d5d600640 1 -- 172.21.15.59:0/2918330370 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d580be070 con 0x7f2d600d14c0 2024-05-30T16:49:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d5d600640 1 -- 172.21.15.59:0/2918330370 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d580ada50 con 0x7f2d600d14c0 2024-05-30T16:49:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d68600640 1 -- 172.21.15.59:0/2918330370 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d600c6740 con 0x7f2d600d14c0 2024-05-30T16:49:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d68600640 1 -- 172.21.15.59:0/2918330370 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d600c6d00 con 0x7f2d600d14c0 2024-05-30T16:49:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.098+0000 7f2d68600640 1 -- 172.21.15.59:0/2918330370 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d60068a90 con 0x7f2d600d14c0 2024-05-30T16:49:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.102+0000 7f2d5d600640 1 -- 172.21.15.59:0/2918330370 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2d580adbf0 con 0x7f2d600d14c0 2024-05-30T16:49:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.102+0000 7f2d5d600640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2d40068380 0x7f2d4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.102+0000 7f2d5d600640 1 -- 172.21.15.59:0/2918330370 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2d58121d60 con 0x7f2d600d14c0 2024-05-30T16:49:08.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.102+0000 7f2d65c00640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2d40068380 0x7f2d4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.102+0000 7f2d65c00640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2d40068380 0x7f2d4006a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d54001650 tx=0x7f2d54009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:08.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.106+0000 7f2d5d600640 1 -- 172.21.15.59:0/2918330370 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d58016560 con 0x7f2d600d14c0 2024-05-30T16:49:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 -- 172.21.15.59:0/2918330370 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d600d2270 con 0x7f2d600d14c0 2024-05-30T16:49:08.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d5d600640 1 -- 172.21.15.59:0/2918330370 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f2d580f2430 con 0x7f2d600d14c0 2024-05-30T16:49:08.280 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:08.280 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":23,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:49:05.525706+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:01.850911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:02.883949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 -- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2d40068380 msgr2=0x7f2d4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2d40068380 0x7f2d4006a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d54001650 tx=0x7f2d54009040 comp rx=0 tx=0).stop 2024-05-30T16:49:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 -- 172.21.15.59:0/2918330370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d600d14c0 msgr2=0x7f2d6015b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d600d14c0 0x7f2d6015b620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d5801a5a0 tx=0x7f2d58019710 comp rx=0 tx=0).stop 2024-05-30T16:49:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 -- 172.21.15.59:0/2918330370 shutdown_connections 2024-05-30T16:49:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2d40068380 0x7f2d4006a840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d600d14c0 0x7f2d6015b620 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d600d05b0 0x7f2d600c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 --2- 172.21.15.59:0/2918330370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d6009b150 0x7f2d6015e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 -- 172.21.15.59:0/2918330370 >> 172.21.15.59:0/2918330370 conn(0x7f2d600b3f80 msgr2=0x7f2d600b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 -- 172.21.15.59:0/2918330370 shutdown_connections 2024-05-30T16:49:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.274+0000 7f2d68600640 1 -- 172.21.15.59:0/2918330370 wait complete. 2024-05-30T16:49:08.301 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:49:08.301 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:49:08.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.434+0000 7f062d400640 1 Processor -- start 2024-05-30T16:49:08.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.434+0000 7f062d400640 1 -- start start 2024-05-30T16:49:08.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.438+0000 7f062d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06280b4510 0x7f06281630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.438+0000 7f062d400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062815fbe0 con 0x7f0628072d00 2024-05-30T16:49:08.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.438+0000 7f062d400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062815fec0 con 0x7f06280b48f0 2024-05-30T16:49:08.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.438+0000 7f062d400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f06281635f0 con 0x7f06280b4510 2024-05-30T16:49:08.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.438+0000 7f0626800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06280b4510 0x7f06281630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.438+0000 7f0627200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0628072d00 0x7f062806e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58098/0 (socket says 172.21.15.59:58098) 2024-05-30T16:49:08.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.438+0000 7f0627200640 1 -- 172.21.15.59:0/3366258596 learned_addr learned my addr 172.21.15.59:0/3366258596 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:08.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.438+0000 7f0626800640 1 -- 172.21.15.59:0/3366258596 >> v1:172.21.15.107:6789/0 conn(0x7f06280b48f0 legacy=0x7f062815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:08.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.438+0000 7f0626800640 1 -- 172.21.15.59:0/3366258596 >> v1:172.21.15.59:6789/0 conn(0x7f0628072d00 legacy=0x7f062806e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.438+0000 7f0626800640 1 -- 172.21.15.59:0/3366258596 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06281628b0 con 0x7f06280b4510 2024-05-30T16:49:08.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f0626800640 1 --2- 172.21.15.59:0/3366258596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06280b4510 0x7f06281630b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f06180097c0 tx=0x7f061801cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb605c85195a156 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:08.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f0625e00640 1 -- 172.21.15.59:0/3366258596 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06180b0070 con 0x7f06280b4510 2024-05-30T16:49:08.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f0625e00640 1 -- 172.21.15.59:0/3366258596 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06180ab600 con 0x7f06280b4510 2024-05-30T16:49:08.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f0625e00640 1 -- 172.21.15.59:0/3366258596 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06180ab9d0 con 0x7f06280b4510 2024-05-30T16:49:08.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f062d400640 1 -- 172.21.15.59:0/3366258596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06280b4510 msgr2=0x7f06281630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f062d400640 1 --2- 172.21.15.59:0/3366258596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06280b4510 0x7f06281630b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f06180097c0 tx=0x7f061801cec0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f062d400640 1 -- 172.21.15.59:0/3366258596 shutdown_connections 2024-05-30T16:49:08.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f062d400640 1 --2- 172.21.15.59:0/3366258596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06280b4510 0x7f06281630b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f062d400640 1 -- 172.21.15.59:0/3366258596 >> 172.21.15.59:0/3366258596 conn(0x7f06280b3240 msgr2=0x7f06280725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:08.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f062d400640 1 -- 172.21.15.59:0/3366258596 shutdown_connections 2024-05-30T16:49:08.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f062d400640 1 -- 172.21.15.59:0/3366258596 wait complete. 2024-05-30T16:49:08.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f062d400640 1 Processor -- start 2024-05-30T16:49:08.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.442+0000 7f062d400640 1 -- start start 2024-05-30T16:49:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f062d400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0628072d00 0x7f0628156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f062d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06280b4510 0x7f06281502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f062d400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06280b48f0 0x7f0628152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f062d400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0628073520 con 0x7f06280b4510 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f062d400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f062815f7c0 con 0x7f06280b48f0 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f062d400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0628158dd0 con 0x7f0628072d00 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06280b4510 0x7f06281502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06280b4510 0x7f06281502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43778/0 (socket says 172.21.15.59:43778) 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061de00640 1 -- 172.21.15.59:0/3770045464 learned_addr learned my addr 172.21.15.59:0/3770045464 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f0627200640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06280b48f0 0x7f0628152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f0626800640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0628072d00 0x7f0628156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061de00640 1 -- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0628072d00 msgr2=0x7f0628156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061de00640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0628072d00 0x7f0628156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061de00640 1 -- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06280b48f0 msgr2=0x7f0628152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061de00640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06280b48f0 0x7f0628152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061de00640 1 -- 172.21.15.59:0/3770045464 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0628153540 con 0x7f06280b4510 2024-05-30T16:49:08.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061de00640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06280b4510 0x7f06281502e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f061000c400 tx=0x7f061000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:08.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061f400640 1 -- 172.21.15.59:0/3770045464 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0610007020 con 0x7f06280b4510 2024-05-30T16:49:08.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061f400640 1 -- 172.21.15.59:0/3770045464 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06100071c0 con 0x7f06280b4510 2024-05-30T16:49:08.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061f400640 1 -- 172.21.15.59:0/3770045464 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06100075f0 con 0x7f06280b4510 2024-05-30T16:49:08.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f062d400640 1 -- 172.21.15.59:0/3770045464 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0628155930 con 0x7f06280b4510 2024-05-30T16:49:08.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f062d400640 1 -- 172.21.15.59:0/3770045464 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0628150820 con 0x7f06280b4510 2024-05-30T16:49:08.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f062d400640 1 -- 172.21.15.59:0/3770045464 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0628068a90 con 0x7f06280b4510 2024-05-30T16:49:08.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.446+0000 7f061f400640 1 -- 172.21.15.59:0/3770045464 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0610019020 con 0x7f06280b4510 2024-05-30T16:49:08.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.450+0000 7f061f400640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0604068380 0x7f060406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.450+0000 7f061f400640 1 -- 172.21.15.59:0/3770045464 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f06100861d0 con 0x7f06280b4510 2024-05-30T16:49:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.450+0000 7f0626800640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0604068380 0x7f060406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.450+0000 7f0626800640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0604068380 0x7f060406a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f06180ad000 tx=0x7f0618004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:08.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.454+0000 7f061f400640 1 -- 172.21.15.59:0/3770045464 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0610056780 con 0x7f06280b4510 2024-05-30T16:49:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.614+0000 7f062d400640 1 -- 172.21.15.59:0/3770045464 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f062806d2c0 con 0x7f0604068380 2024-05-30T16:49:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.622+0000 7f061f400640 1 -- 172.21.15.59:0/3770045464 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239185 (secure 0 0 0) 0x7f062806d2c0 con 0x7f0604068380 2024-05-30T16:49:08.628 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:49:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.626+0000 7f062d400640 1 -- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0604068380 msgr2=0x7f060406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.626+0000 7f062d400640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0604068380 0x7f060406a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f06180ad000 tx=0x7f0618004740 comp rx=0 tx=0).stop 2024-05-30T16:49:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.626+0000 7f062d400640 1 -- 172.21.15.59:0/3770045464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06280b4510 msgr2=0x7f06281502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.626+0000 7f062d400640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06280b4510 0x7f06281502e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f061000c400 tx=0x7f061000c8c0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.626+0000 7f062d400640 1 -- 172.21.15.59:0/3770045464 shutdown_connections 2024-05-30T16:49:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.626+0000 7f062d400640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0604068380 0x7f060406a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.626+0000 7f062d400640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06280b48f0 0x7f0628152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.626+0000 7f062d400640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06280b4510 0x7f06281502e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.626+0000 7f062d400640 1 --2- 172.21.15.59:0/3770045464 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0628072d00 0x7f0628156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.626+0000 7f062d400640 1 -- 172.21.15.59:0/3770045464 >> 172.21.15.59:0/3770045464 conn(0x7f06280b3240 msgr2=0x7f0628154b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.626+0000 7f062d400640 1 -- 172.21.15.59:0/3770045464 shutdown_connections 2024-05-30T16:49:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.626+0000 7f062d400640 1 -- 172.21.15.59:0/3770045464 wait complete. 2024-05-30T16:49:08.650 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-05-30T16:49:07.074658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":220012,"kb_used_data":2648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754708,"statfs":{"total":773094113280,"available":772868820992,"internally_reserved":0,"allocated":2711552,"data_stored":1647519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.566523"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.050859+0000","last_change":"2024-05-30T16:49:04.546221+0000","last_active":"2024-05-30T16:49:06.050859+0000","last_peered":"2024-05-30T16:49:06.050859+0000","last_clean":"2024-05-30T16:49:06.050859+0000","last_became_active":"2024-05-30T16:49:04.545933+0000","last_became_peered":"2024-05-30T16:49:04.545933+0000","last_unstale":"2024-05-30T16:49:06.050859+0000","last_undegraded":"2024-05-30T16:49:06.050859+0000","last_fullsized":"2024-05-30T16:49:06.050859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:21.914079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051507+0000","last_change":"2024-05-30T16:49:04.541147+0000","last_active":"2024-05-30T16:49:06.051507+0000","last_peered":"2024-05-30T16:49:06.051507+0000","last_clean":"2024-05-30T16:49:06.051507+0000","last_became_active":"2024-05-30T16:49:04.540873+0000","last_became_peered":"2024-05-30T16:49:04.540873+0000","last_unstale":"2024-05-30T16:49:06.051507+0000","last_undegraded":"2024-05-30T16:49:06.051507+0000","last_fullsized":"2024-05-30T16:49:06.051507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:31:53.336085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051209+0000","last_change":"2024-05-30T16:49:04.554673+0000","last_active":"2024-05-30T16:49:06.051209+0000","last_peered":"2024-05-30T16:49:06.051209+0000","last_clean":"2024-05-30T16:49:06.051209+0000","last_became_active":"2024-05-30T16:49:04.552406+0000","last_became_peered":"2024-05-30T16:49:04.552406+0000","last_unstale":"2024-05-30T16:49:06.051209+0000","last_undegraded":"2024-05-30T16:49:06.051209+0000","last_fullsized":"2024-05-30T16:49:06.051209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:32:11.592244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052036+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.052036+0000","last_peered":"2024-05-30T16:49:06.052036+0000","last_clean":"2024-05-30T16:49:06.052036+0000","last_became_active":"2024-05-30T16:49:04.556321+0000","last_became_peered":"2024-05-30T16:49:04.556321+0000","last_unstale":"2024-05-30T16:49:06.052036+0000","last_undegraded":"2024-05-30T16:49:06.052036+0000","last_fullsized":"2024-05-30T16:49:06.052036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:44:48.125700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051647+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.051647+0000","last_peered":"2024-05-30T16:49:06.051647+0000","last_clean":"2024-05-30T16:49:06.051647+0000","last_became_active":"2024-05-30T16:49:04.556297+0000","last_became_peered":"2024-05-30T16:49:04.556297+0000","last_unstale":"2024-05-30T16:49:06.051647+0000","last_undegraded":"2024-05-30T16:49:06.051647+0000","last_fullsized":"2024-05-30T16:49:06.051647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:14:09.241699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051650+0000","last_change":"2024-05-30T16:49:03.546643+0000","last_active":"2024-05-30T16:49:06.051650+0000","last_peered":"2024-05-30T16:49:06.051650+0000","last_clean":"2024-05-30T16:49:06.051650+0000","last_became_active":"2024-05-30T16:49:03.546381+0000","last_became_peered":"2024-05-30T16:49:03.546381+0000","last_unstale":"2024-05-30T16:49:06.051650+0000","last_undegraded":"2024-05-30T16:49:06.051650+0000","last_fullsized":"2024-05-30T16:49:06.051650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:44.078644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051315+0000","last_change":"2024-05-30T16:49:03.538756+0000","last_active":"2024-05-30T16:49:06.051315+0000","last_peered":"2024-05-30T16:49:06.051315+0000","last_clean":"2024-05-30T16:49:06.051315+0000","last_became_active":"2024-05-30T16:49:03.538053+0000","last_became_peered":"2024-05-30T16:49:03.538053+0000","last_unstale":"2024-05-30T16:49:06.051315+0000","last_undegraded":"2024-05-30T16:49:06.051315+0000","last_fullsized":"2024-05-30T16:49:06.051315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:07.264297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051433+0000","last_change":"2024-05-30T16:49:04.546048+0000","last_active":"2024-05-30T16:49:06.051433+0000","last_peered":"2024-05-30T16:49:06.051433+0000","last_clean":"2024-05-30T16:49:06.051433+0000","last_became_active":"2024-05-30T16:49:04.545151+0000","last_became_peered":"2024-05-30T16:49:04.545151+0000","last_unstale":"2024-05-30T16:49:06.051433+0000","last_undegraded":"2024-05-30T16:49:06.051433+0000","last_fullsized":"2024-05-30T16:49:06.051433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:07.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-30T16:48:56.668210+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:48:56.668210+0000","last_peered":"2024-05-30T16:48:56.668210+0000","last_clean":"2024-05-30T16:48:56.668210+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:48:56.668210+0000","last_undegraded":"2024-05-30T16:48:56.668210+0000","last_fullsized":"2024-05-30T16:48:56.668210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051447+0000","last_change":"2024-05-30T16:49:04.546603+0000","last_active":"2024-05-30T16:49:06.051447+0000","last_peered":"2024-05-30T16:49:06.051447+0000","last_clean":"2024-05-30T16:49:06.051447+0000","last_became_active":"2024-05-30T16:49:04.545130+0000","last_became_peered":"2024-05-30T16:49:04.545130+0000","last_unstale":"2024-05-30T16:49:06.051447+0000","last_undegraded":"2024-05-30T16:49:06.051447+0000","last_fullsized":"2024-05-30T16:49:06.051447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:47.404454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052135+0000","last_change":"2024-05-30T16:49:04.544633+0000","last_active":"2024-05-30T16:49:06.052135+0000","last_peered":"2024-05-30T16:49:06.052135+0000","last_clean":"2024-05-30T16:49:06.052135+0000","last_became_active":"2024-05-30T16:49:04.544348+0000","last_became_peered":"2024-05-30T16:49:04.544348+0000","last_unstale":"2024-05-30T16:49:06.052135+0000","last_undegraded":"2024-05-30T16:49:06.052135+0000","last_fullsized":"2024-05-30T16:49:06.052135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:09.918803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051851+0000","last_change":"2024-05-30T16:49:04.535297+0000","last_active":"2024-05-30T16:49:06.051851+0000","last_peered":"2024-05-30T16:49:06.051851+0000","last_clean":"2024-05-30T16:49:06.051851+0000","last_became_active":"2024-05-30T16:49:04.534907+0000","last_became_peered":"2024-05-30T16:49:04.534907+0000","last_unstale":"2024-05-30T16:49:06.051851+0000","last_undegraded":"2024-05-30T16:49:06.051851+0000","last_fullsized":"2024-05-30T16:49:06.051851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:56.163039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051567+0000","last_change":"2024-05-30T16:49:04.556339+0000","last_active":"2024-05-30T16:49:06.051567+0000","last_peered":"2024-05-30T16:49:06.051567+0000","last_clean":"2024-05-30T16:49:06.051567+0000","last_became_active":"2024-05-30T16:49:04.556012+0000","last_became_peered":"2024-05-30T16:49:04.556012+0000","last_unstale":"2024-05-30T16:49:06.051567+0000","last_undegraded":"2024-05-30T16:49:06.051567+0000","last_fullsized":"2024-05-30T16:49:06.051567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:23.369792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052111+0000","last_change":"2024-05-30T16:49:03.546038+0000","last_active":"2024-05-30T16:49:06.052111+0000","last_peered":"2024-05-30T16:49:06.052111+0000","last_clean":"2024-05-30T16:49:06.052111+0000","last_became_active":"2024-05-30T16:49:03.545623+0000","last_became_peered":"2024-05-30T16:49:03.545623+0000","last_unstale":"2024-05-30T16:49:06.052111+0000","last_undegraded":"2024-05-30T16:49:06.052111+0000","last_fullsized":"2024-05-30T16:49:06.052111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:40.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052052+0000","last_change":"2024-05-30T16:49:04.546841+0000","last_active":"2024-05-30T16:49:06.052052+0000","last_peered":"2024-05-30T16:49:06.052052+0000","last_clean":"2024-05-30T16:49:06.052052+0000","last_became_active":"2024-05-30T16:49:04.546596+0000","last_became_peered":"2024-05-30T16:49:04.546596+0000","last_unstale":"2024-05-30T16:49:06.052052+0000","last_undegraded":"2024-05-30T16:49:06.052052+0000","last_fullsized":"2024-05-30T16:49:06.052052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:06.186315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":6,"acting":6,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28404,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343436,"statfs":{"total":96636764160,"available":96607678464,"internally_reserved":0,"allocated":778240,"data_stored":646156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":55788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":55788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":55788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":55788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":55788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":778240,"data_stored":646156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:49:08.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:49:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.826+0000 7f554e200640 1 Processor -- start 2024-05-30T16:49:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.826+0000 7f554e200640 1 -- start start 2024-05-30T16:49:08.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.826+0000 7f554e200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5548159df0 0x7f55480ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.826+0000 7f554e200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f554815a1d0 0x7f55480ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f554e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55480b3e50 0x7f554815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f554e200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f554815d730 con 0x7f554815a1d0 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f554e200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f55480b3370 con 0x7f5548159df0 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f554e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f55480b3650 con 0x7f55480b3e50 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f553fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f554815a1d0 0x7f55480ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f553fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f554815a1d0 0x7f55480ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43786/0 (socket says 172.21.15.59:43786) 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f553fe00640 1 -- 172.21.15.59:0/1787576867 learned_addr learned my addr 172.21.15.59:0/1787576867 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f5547e00640 1 --2- 172.21.15.59:0/1787576867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55480b3e50 0x7f554815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f5547400640 1 --2- 172.21.15.59:0/1787576867 >> v2:172.21.15.107:3300/0 conn(0x7f5548159df0 0x7f55480ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f553fe00640 1 -- 172.21.15.59:0/1787576867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55480b3e50 msgr2=0x7f554815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f553fe00640 1 --2- 172.21.15.59:0/1787576867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55480b3e50 0x7f554815ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f553fe00640 1 -- 172.21.15.59:0/1787576867 >> v2:172.21.15.107:3300/0 conn(0x7f5548159df0 msgr2=0x7f55480ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f553fe00640 1 --2- 172.21.15.59:0/1787576867 >> v2:172.21.15.107:3300/0 conn(0x7f5548159df0 0x7f55480ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f553fe00640 1 -- 172.21.15.59:0/1787576867 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55480b3930 con 0x7f554815a1d0 2024-05-30T16:49:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f553fe00640 1 --2- 172.21.15.59:0/1787576867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f554815a1d0 0x7f55480ad6f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f55480b4c20 tx=0x7f553001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5e5bf38854dda5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f5546a00640 1 -- 172.21.15.59:0/1787576867 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55300ab5f0 con 0x7f554815a1d0 2024-05-30T16:49:08.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f5546a00640 1 -- 172.21.15.59:0/1787576867 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55300b0070 con 0x7f554815a1d0 2024-05-30T16:49:08.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.830+0000 7f5546a00640 1 -- 172.21.15.59:0/1787576867 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55300ab9b0 con 0x7f554815a1d0 2024-05-30T16:49:08.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 -- 172.21.15.59:0/1787576867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f554815a1d0 msgr2=0x7f55480ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 --2- 172.21.15.59:0/1787576867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f554815a1d0 0x7f55480ad6f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f55480b4c20 tx=0x7f553001c520 comp rx=0 tx=0).stop 2024-05-30T16:49:08.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 -- 172.21.15.59:0/1787576867 shutdown_connections 2024-05-30T16:49:08.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 --2- 172.21.15.59:0/1787576867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55480b3e50 0x7f554815ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 --2- 172.21.15.59:0/1787576867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f554815a1d0 0x7f55480ad6f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 --2- 172.21.15.59:0/1787576867 >> v2:172.21.15.107:3300/0 conn(0x7f5548159df0 0x7f55480ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 -- 172.21.15.59:0/1787576867 >> 172.21.15.59:0/1787576867 conn(0x7f55480b22d0 msgr2=0x7f55480b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:08.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 -- 172.21.15.59:0/1787576867 shutdown_connections 2024-05-30T16:49:08.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 -- 172.21.15.59:0/1787576867 wait complete. 2024-05-30T16:49:08.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 Processor -- start 2024-05-30T16:49:08.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 -- start start 2024-05-30T16:49:08.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55480b3e50 0x7f5548149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5548159df0 0x7f5548156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f554815a1d0 0x7f554814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f554815e720 con 0x7f554815a1d0 2024-05-30T16:49:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f554815e5a0 con 0x7f55480b3e50 2024-05-30T16:49:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f554e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f554815e8a0 con 0x7f5548159df0 2024-05-30T16:49:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f5547e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f554815a1d0 0x7f554814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f5547e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f554815a1d0 0x7f554814c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43802/0 (socket says 172.21.15.59:43802) 2024-05-30T16:49:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f5547e00640 1 -- 172.21.15.59:0/2156698780 learned_addr learned my addr 172.21.15.59:0/2156698780 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f553fe00640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5548159df0 0x7f5548156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.834+0000 7f5547400640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55480b3e50 0x7f5548149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f5547e00640 1 -- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5548159df0 msgr2=0x7f5548156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f5547e00640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5548159df0 0x7f5548156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f5547e00640 1 -- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55480b3e50 msgr2=0x7f5548149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f5547e00640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55480b3e50 0x7f5548149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f5547e00640 1 -- 172.21.15.59:0/2156698780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5548154e60 con 0x7f554815a1d0 2024-05-30T16:49:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f5547e00640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f554815a1d0 0x7f554814c0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5540007e90 tx=0x7f554000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f553f400640 1 -- 172.21.15.59:0/2156698780 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540014420 con 0x7f554815a1d0 2024-05-30T16:49:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f553f400640 1 -- 172.21.15.59:0/2156698780 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5540019070 con 0x7f554815a1d0 2024-05-30T16:49:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f553f400640 1 -- 172.21.15.59:0/2156698780 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540014800 con 0x7f554815a1d0 2024-05-30T16:49:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f554e200640 1 -- 172.21.15.59:0/2156698780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5548155140 con 0x7f554815a1d0 2024-05-30T16:49:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f554e200640 1 -- 172.21.15.59:0/2156698780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5548155700 con 0x7f554815a1d0 2024-05-30T16:49:08.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f554e200640 1 -- 172.21.15.59:0/2156698780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5548068a90 con 0x7f554815a1d0 2024-05-30T16:49:08.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f553f400640 1 -- 172.21.15.59:0/2156698780 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f55400149a0 con 0x7f554815a1d0 2024-05-30T16:49:08.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f553f400640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5524068380 0x7f552406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f553f400640 1 -- 172.21.15.59:0/2156698780 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5540087020 con 0x7f554815a1d0 2024-05-30T16:49:08.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.838+0000 7f5547400640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5524068380 0x7f552406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.842+0000 7f5547400640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5524068380 0x7f552406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5548152450 tx=0x7f5538008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:08.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:08.842+0000 7f553f400640 1 -- 172.21.15.59:0/2156698780 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5540057020 con 0x7f554815a1d0 2024-05-30T16:49:09.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.002+0000 7f554e200640 1 -- 172.21.15.59:0/2156698780 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55481671d0 con 0x7f5524068380 2024-05-30T16:49:09.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f553f400640 1 -- 172.21.15.59:0/2156698780 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239185 (secure 0 0 0) 0x7f55481671d0 con 0x7f5524068380 2024-05-30T16:49:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:09.022 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:49:09.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f554e200640 1 -- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5524068380 msgr2=0x7f552406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f554e200640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5524068380 0x7f552406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5548152450 tx=0x7f5538008040 comp rx=0 tx=0).stop 2024-05-30T16:49:09.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f554e200640 1 -- 172.21.15.59:0/2156698780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f554815a1d0 msgr2=0x7f554814c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f554e200640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f554815a1d0 0x7f554814c0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5540007e90 tx=0x7f554000e4b0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f554e200640 1 -- 172.21.15.59:0/2156698780 shutdown_connections 2024-05-30T16:49:09.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f554e200640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5524068380 0x7f552406a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f554e200640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f554815a1d0 0x7f554814c0d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f554e200640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5548159df0 0x7f5548156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f554e200640 1 --2- 172.21.15.59:0/2156698780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55480b3e50 0x7f5548149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f554e200640 1 -- 172.21.15.59:0/2156698780 >> 172.21.15.59:0/2156698780 conn(0x7f55480b22d0 msgr2=0x7f554806edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:09.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f554e200640 1 -- 172.21.15.59:0/2156698780 shutdown_connections 2024-05-30T16:49:09.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.014+0000 7f554e200640 1 -- 172.21.15.59:0/2156698780 wait complete. 2024-05-30T16:49:09.038 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-05-30T16:49:07.074658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":220012,"kb_used_data":2648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754708,"statfs":{"total":773094113280,"available":772868820992,"internally_reserved":0,"allocated":2711552,"data_stored":1647519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.566523"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.050859+0000","last_change":"2024-05-30T16:49:04.546221+0000","last_active":"2024-05-30T16:49:06.050859+0000","last_peered":"2024-05-30T16:49:06.050859+0000","last_clean":"2024-05-30T16:49:06.050859+0000","last_became_active":"2024-05-30T16:49:04.545933+0000","last_became_peered":"2024-05-30T16:49:04.545933+0000","last_unstale":"2024-05-30T16:49:06.050859+0000","last_undegraded":"2024-05-30T16:49:06.050859+0000","last_fullsized":"2024-05-30T16:49:06.050859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:21.914079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051507+0000","last_change":"2024-05-30T16:49:04.541147+0000","last_active":"2024-05-30T16:49:06.051507+0000","last_peered":"2024-05-30T16:49:06.051507+0000","last_clean":"2024-05-30T16:49:06.051507+0000","last_became_active":"2024-05-30T16:49:04.540873+0000","last_became_peered":"2024-05-30T16:49:04.540873+0000","last_unstale":"2024-05-30T16:49:06.051507+0000","last_undegraded":"2024-05-30T16:49:06.051507+0000","last_fullsized":"2024-05-30T16:49:06.051507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:31:53.336085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051209+0000","last_change":"2024-05-30T16:49:04.554673+0000","last_active":"2024-05-30T16:49:06.051209+0000","last_peered":"2024-05-30T16:49:06.051209+0000","last_clean":"2024-05-30T16:49:06.051209+0000","last_became_active":"2024-05-30T16:49:04.552406+0000","last_became_peered":"2024-05-30T16:49:04.552406+0000","last_unstale":"2024-05-30T16:49:06.051209+0000","last_undegraded":"2024-05-30T16:49:06.051209+0000","last_fullsized":"2024-05-30T16:49:06.051209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:32:11.592244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052036+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.052036+0000","last_peered":"2024-05-30T16:49:06.052036+0000","last_clean":"2024-05-30T16:49:06.052036+0000","last_became_active":"2024-05-30T16:49:04.556321+0000","last_became_peered":"2024-05-30T16:49:04.556321+0000","last_unstale":"2024-05-30T16:49:06.052036+0000","last_undegraded":"2024-05-30T16:49:06.052036+0000","last_fullsized":"2024-05-30T16:49:06.052036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:44:48.125700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051647+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.051647+0000","last_peered":"2024-05-30T16:49:06.051647+0000","last_clean":"2024-05-30T16:49:06.051647+0000","last_became_active":"2024-05-30T16:49:04.556297+0000","last_became_peered":"2024-05-30T16:49:04.556297+0000","last_unstale":"2024-05-30T16:49:06.051647+0000","last_undegraded":"2024-05-30T16:49:06.051647+0000","last_fullsized":"2024-05-30T16:49:06.051647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:14:09.241699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051650+0000","last_change":"2024-05-30T16:49:03.546643+0000","last_active":"2024-05-30T16:49:06.051650+0000","last_peered":"2024-05-30T16:49:06.051650+0000","last_clean":"2024-05-30T16:49:06.051650+0000","last_became_active":"2024-05-30T16:49:03.546381+0000","last_became_peered":"2024-05-30T16:49:03.546381+0000","last_unstale":"2024-05-30T16:49:06.051650+0000","last_undegraded":"2024-05-30T16:49:06.051650+0000","last_fullsized":"2024-05-30T16:49:06.051650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:44.078644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051315+0000","last_change":"2024-05-30T16:49:03.538756+0000","last_active":"2024-05-30T16:49:06.051315+0000","last_peered":"2024-05-30T16:49:06.051315+0000","last_clean":"2024-05-30T16:49:06.051315+0000","last_became_active":"2024-05-30T16:49:03.538053+0000","last_became_peered":"2024-05-30T16:49:03.538053+0000","last_unstale":"2024-05-30T16:49:06.051315+0000","last_undegraded":"2024-05-30T16:49:06.051315+0000","last_fullsized":"2024-05-30T16:49:06.051315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:07.264297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051433+0000","last_change":"2024-05-30T16:49:04.546048+0000","last_active":"2024-05-30T16:49:06.051433+0000","last_peered":"2024-05-30T16:49:06.051433+0000","last_clean":"2024-05-30T16:49:06.051433+0000","last_became_active":"2024-05-30T16:49:04.545151+0000","last_became_peered":"2024-05-30T16:49:04.545151+0000","last_unstale":"2024-05-30T16:49:06.051433+0000","last_undegraded":"2024-05-30T16:49:06.051433+0000","last_fullsized":"2024-05-30T16:49:06.051433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:07.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-30T16:48:56.668210+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:48:56.668210+0000","last_peered":"2024-05-30T16:48:56.668210+0000","last_clean":"2024-05-30T16:48:56.668210+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:48:56.668210+0000","last_undegraded":"2024-05-30T16:48:56.668210+0000","last_fullsized":"2024-05-30T16:48:56.668210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051447+0000","last_change":"2024-05-30T16:49:04.546603+0000","last_active":"2024-05-30T16:49:06.051447+0000","last_peered":"2024-05-30T16:49:06.051447+0000","last_clean":"2024-05-30T16:49:06.051447+0000","last_became_active":"2024-05-30T16:49:04.545130+0000","last_became_peered":"2024-05-30T16:49:04.545130+0000","last_unstale":"2024-05-30T16:49:06.051447+0000","last_undegraded":"2024-05-30T16:49:06.051447+0000","last_fullsized":"2024-05-30T16:49:06.051447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:47.404454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052135+0000","last_change":"2024-05-30T16:49:04.544633+0000","last_active":"2024-05-30T16:49:06.052135+0000","last_peered":"2024-05-30T16:49:06.052135+0000","last_clean":"2024-05-30T16:49:06.052135+0000","last_became_active":"2024-05-30T16:49:04.544348+0000","last_became_peered":"2024-05-30T16:49:04.544348+0000","last_unstale":"2024-05-30T16:49:06.052135+0000","last_undegraded":"2024-05-30T16:49:06.052135+0000","last_fullsized":"2024-05-30T16:49:06.052135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:09.918803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051851+0000","last_change":"2024-05-30T16:49:04.535297+0000","last_active":"2024-05-30T16:49:06.051851+0000","last_peered":"2024-05-30T16:49:06.051851+0000","last_clean":"2024-05-30T16:49:06.051851+0000","last_became_active":"2024-05-30T16:49:04.534907+0000","last_became_peered":"2024-05-30T16:49:04.534907+0000","last_unstale":"2024-05-30T16:49:06.051851+0000","last_undegraded":"2024-05-30T16:49:06.051851+0000","last_fullsized":"2024-05-30T16:49:06.051851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:56.163039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051567+0000","last_change":"2024-05-30T16:49:04.556339+0000","last_active":"2024-05-30T16:49:06.051567+0000","last_peered":"2024-05-30T16:49:06.051567+0000","last_clean":"2024-05-30T16:49:06.051567+0000","last_became_active":"2024-05-30T16:49:04.556012+0000","last_became_peered":"2024-05-30T16:49:04.556012+0000","last_unstale":"2024-05-30T16:49:06.051567+0000","last_undegraded":"2024-05-30T16:49:06.051567+0000","last_fullsized":"2024-05-30T16:49:06.051567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:23.369792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:03.506009+0000","last_change":"2024-05-30T16:49:03.506009+0000","last_active":"2024-05-30T16:49:03.506009+0000","last_peered":"2024-05-30T16:49:03.506009+0000","last_clean":"2024-05-30T16:49:03.506009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:03.506009+0000","last_undegraded":"2024-05-30T16:49:03.506009+0000","last_fullsized":"2024-05-30T16:49:03.506009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052111+0000","last_change":"2024-05-30T16:49:03.546038+0000","last_active":"2024-05-30T16:49:06.052111+0000","last_peered":"2024-05-30T16:49:06.052111+0000","last_clean":"2024-05-30T16:49:06.052111+0000","last_became_active":"2024-05-30T16:49:03.545623+0000","last_became_peered":"2024-05-30T16:49:03.545623+0000","last_unstale":"2024-05-30T16:49:06.052111+0000","last_undegraded":"2024-05-30T16:49:06.052111+0000","last_fullsized":"2024-05-30T16:49:06.052111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:40.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052052+0000","last_change":"2024-05-30T16:49:04.546841+0000","last_active":"2024-05-30T16:49:06.052052+0000","last_peered":"2024-05-30T16:49:06.052052+0000","last_clean":"2024-05-30T16:49:06.052052+0000","last_became_active":"2024-05-30T16:49:04.546596+0000","last_became_peered":"2024-05-30T16:49:04.546596+0000","last_unstale":"2024-05-30T16:49:06.052052+0000","last_undegraded":"2024-05-30T16:49:06.052052+0000","last_fullsized":"2024-05-30T16:49:06.052052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:06.186315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:02.497990+0000","last_change":"2024-05-30T16:49:02.497990+0000","last_active":"2024-05-30T16:49:02.497990+0000","last_peered":"2024-05-30T16:49:02.497990+0000","last_clean":"2024-05-30T16:49:02.497990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:02.497990+0000","last_undegraded":"2024-05-30T16:49:02.497990+0000","last_fullsized":"2024-05-30T16:49:02.497990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":6,"acting":6,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28404,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343436,"statfs":{"total":96636764160,"available":96607678464,"internally_reserved":0,"allocated":778240,"data_stored":646156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":55788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":55788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":55788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":55788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":55788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":778240,"data_stored":646156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:49:09.042 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:49:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f460bc00640 1 Processor -- start 2024-05-30T16:49:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f460bc00640 1 -- start start 2024-05-30T16:49:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f460bc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46040b3a70 0x7f46040cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f460bc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46040c4cf0 con 0x7f460406c0c0 2024-05-30T16:49:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f460bc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46040ce160 con 0x7f460415c890 2024-05-30T16:49:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f460bc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f46040ce440 con 0x7f46040b3a70 2024-05-30T16:49:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f45fbe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f460406c0c0 0x7f46040b0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58114/0 (socket says 172.21.15.59:58114) 2024-05-30T16:49:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f45fbe00640 1 -- 172.21.15.59:0/1998447597 learned_addr learned my addr 172.21.15.59:0/1998447597 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f4609c00640 1 --2- 172.21.15.59:0/1998447597 >> v2:172.21.15.59:3300/0 conn(0x7f46040b3a70 0x7f46040cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f4603e00640 1 -- 172.21.15.59:0/1998447597 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946605060 0 0) 0x7f46040c4cf0 con 0x7f460406c0c0 2024-05-30T16:49:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f4603e00640 1 -- 172.21.15.59:0/1998447597 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45e8003530 con 0x7f460406c0c0 2024-05-30T16:49:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f4609c00640 1 -- 172.21.15.59:0/1998447597 >> v1:172.21.15.107:6789/0 conn(0x7f460415c890 legacy=0x7f460406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f4609c00640 1 -- 172.21.15.59:0/1998447597 >> v1:172.21.15.59:6789/0 conn(0x7f460406c0c0 legacy=0x7f46040b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.218+0000 7f4609c00640 1 -- 172.21.15.59:0/1998447597 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46040ce720 con 0x7f46040b3a70 2024-05-30T16:49:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.222+0000 7f4609c00640 1 --2- 172.21.15.59:0/1998447597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46040b3a70 0x7f46040cda60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009d90 tx=0x7f45fc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6825fbb80acb9e43 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.222+0000 7f4603e00640 1 -- 172.21.15.59:0/1998447597 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0b2070 con 0x7f46040b3a70 2024-05-30T16:49:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.222+0000 7f4603e00640 1 -- 172.21.15.59:0/1998447597 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45fc0a5940 con 0x7f46040b3a70 2024-05-30T16:49:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.222+0000 7f4603e00640 1 -- 172.21.15.59:0/1998447597 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0a5d10 con 0x7f46040b3a70 2024-05-30T16:49:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.222+0000 7f460bc00640 1 -- 172.21.15.59:0/1998447597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46040b3a70 msgr2=0x7f46040cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.222+0000 7f460bc00640 1 --2- 172.21.15.59:0/1998447597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46040b3a70 0x7f46040cda60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009d90 tx=0x7f45fc01c970 comp rx=0 tx=0).stop 2024-05-30T16:49:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.222+0000 7f460bc00640 1 -- 172.21.15.59:0/1998447597 shutdown_connections 2024-05-30T16:49:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.222+0000 7f460bc00640 1 --2- 172.21.15.59:0/1998447597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46040b3a70 0x7f46040cda60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.222+0000 7f460bc00640 1 -- 172.21.15.59:0/1998447597 >> 172.21.15.59:0/1998447597 conn(0x7f46040b2f50 msgr2=0x7f46040b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.222+0000 7f460bc00640 1 -- 172.21.15.59:0/1998447597 shutdown_connections 2024-05-30T16:49:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.222+0000 7f460bc00640 1 -- 172.21.15.59:0/1998447597 wait complete. 2024-05-30T16:49:09.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f460bc00640 1 Processor -- start 2024-05-30T16:49:09.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f460bc00640 1 -- start start 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f460bc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460406c0c0 0x7f460415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f460bc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46040b3a70 0x7f460415eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f460bc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f460415c890 0x7f460415f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f460bc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f46040b20f0 con 0x7f46040b3a70 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f460bc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f46040b1f70 con 0x7f460406c0c0 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f460bc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f460416a3e0 con 0x7f460415c890 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f45fbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46040b3a70 0x7f460415eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f45fbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46040b3a70 0x7f460415eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43814/0 (socket says 172.21.15.59:43814) 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f45fbe00640 1 -- 172.21.15.59:0/4101402312 learned_addr learned my addr 172.21.15.59:0/4101402312 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f4609200640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460406c0c0 0x7f460415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f4609c00640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f460415c890 0x7f460415f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f45fbe00640 1 -- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f460415c890 msgr2=0x7f460415f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f45fbe00640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f460415c890 0x7f460415f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f45fbe00640 1 -- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460406c0c0 msgr2=0x7f460415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f45fbe00640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460406c0c0 0x7f460415ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f45fbe00640 1 -- 172.21.15.59:0/4101402312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4604159c50 con 0x7f46040b3a70 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f45fbe00640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46040b3a70 0x7f460415eae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00c4d0 tx=0x7f45ec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f4601600640 1 -- 172.21.15.59:0/4101402312 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec017070 con 0x7f46040b3a70 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f4601600640 1 -- 172.21.15.59:0/4101402312 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec005cf0 con 0x7f46040b3a70 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f4601600640 1 -- 172.21.15.59:0/4101402312 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec007270 con 0x7f46040b3a70 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f460bc00640 1 -- 172.21.15.59:0/4101402312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460415f6c0 con 0x7f46040b3a70 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f460bc00640 1 -- 172.21.15.59:0/4101402312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f460415fc20 con 0x7f46040b3a70 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.226+0000 7f460bc00640 1 -- 172.21.15.59:0/4101402312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4604068a90 con 0x7f46040b3a70 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.230+0000 7f4601600640 1 -- 172.21.15.59:0/4101402312 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45ec01a070 con 0x7f46040b3a70 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.230+0000 7f4601600640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45e0068380 0x7f45e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.230+0000 7f4601600640 1 -- 172.21.15.59:0/4101402312 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f45ec085d40 con 0x7f46040b3a70 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.230+0000 7f4609200640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45e0068380 0x7f45e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.230+0000 7f4609200640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45e0068380 0x7f45e006a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f45f4007fd0 tx=0x7f45f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:09.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.234+0000 7f4601600640 1 -- 172.21.15.59:0/4101402312 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f460415f6c0 con 0x7f46040b3a70 2024-05-30T16:49:09.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.398+0000 7f460bc00640 1 -- 172.21.15.59:0/4101402312 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46040cba10 con 0x7f45e0068380 2024-05-30T16:49:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.406+0000 7f4601600640 1 -- 172.21.15.59:0/4101402312 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f46040cba10 con 0x7f45e0068380 2024-05-30T16:49:09.414 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:49:09.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.410+0000 7f460bc00640 1 -- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45e0068380 msgr2=0x7f45e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.410+0000 7f460bc00640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45e0068380 0x7f45e006a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f45f4007fd0 tx=0x7f45f4009040 comp rx=0 tx=0).stop 2024-05-30T16:49:09.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.410+0000 7f460bc00640 1 -- 172.21.15.59:0/4101402312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46040b3a70 msgr2=0x7f460415eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.410+0000 7f460bc00640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46040b3a70 0x7f460415eae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00c4d0 tx=0x7f45ec00c990 comp rx=0 tx=0).stop 2024-05-30T16:49:09.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.410+0000 7f460bc00640 1 -- 172.21.15.59:0/4101402312 shutdown_connections 2024-05-30T16:49:09.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.410+0000 7f460bc00640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45e0068380 0x7f45e006a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.410+0000 7f460bc00640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f460415c890 0x7f460415f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.410+0000 7f460bc00640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46040b3a70 0x7f460415eae0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.410+0000 7f460bc00640 1 --2- 172.21.15.59:0/4101402312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460406c0c0 0x7f460415ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.410+0000 7f460bc00640 1 -- 172.21.15.59:0/4101402312 >> 172.21.15.59:0/4101402312 conn(0x7f46040b2f50 msgr2=0x7f4604167bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:09.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.410+0000 7f460bc00640 1 -- 172.21.15.59:0/4101402312 shutdown_connections 2024-05-30T16:49:09.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.410+0000 7f460bc00640 1 -- 172.21.15.59:0/4101402312 wait complete. 2024-05-30T16:49:09.434 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-30T16:49:09.075252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219196,"kb_used_data":3036,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755524,"statfs":{"total":773094113280,"available":772869656576,"internally_reserved":0,"allocated":3108864,"data_stored":1826896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001335"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052545+0000","last_change":"2024-05-30T16:49:04.545096+0000","last_active":"2024-05-30T16:49:06.052545+0000","last_peered":"2024-05-30T16:49:06.052545+0000","last_clean":"2024-05-30T16:49:06.052545+0000","last_became_active":"2024-05-30T16:49:04.544532+0000","last_became_peered":"2024-05-30T16:49:04.544532+0000","last_unstale":"2024-05-30T16:49:06.052545+0000","last_undegraded":"2024-05-30T16:49:06.052545+0000","last_fullsized":"2024-05-30T16:49:06.052545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:00.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053033+0000","last_change":"2024-05-30T16:49:04.538139+0000","last_active":"2024-05-30T16:49:06.053033+0000","last_peered":"2024-05-30T16:49:06.053033+0000","last_clean":"2024-05-30T16:49:06.053033+0000","last_became_active":"2024-05-30T16:49:04.537797+0000","last_became_peered":"2024-05-30T16:49:04.537797+0000","last_unstale":"2024-05-30T16:49:06.053033+0000","last_undegraded":"2024-05-30T16:49:06.053033+0000","last_fullsized":"2024-05-30T16:49:06.053033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051246+0000","last_change":"2024-05-30T16:49:04.542945+0000","last_active":"2024-05-30T16:49:06.051246+0000","last_peered":"2024-05-30T16:49:06.051246+0000","last_clean":"2024-05-30T16:49:06.051246+0000","last_became_active":"2024-05-30T16:49:04.542637+0000","last_became_peered":"2024-05-30T16:49:04.542637+0000","last_unstale":"2024-05-30T16:49:06.051246+0000","last_undegraded":"2024-05-30T16:49:06.051246+0000","last_fullsized":"2024-05-30T16:49:06.051246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:55:32.611131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533898+0000","last_change":"2024-05-30T16:49:04.556673+0000","last_active":"2024-05-30T16:49:05.533898+0000","last_peered":"2024-05-30T16:49:05.533898+0000","last_clean":"2024-05-30T16:49:05.533898+0000","last_became_active":"2024-05-30T16:49:04.556386+0000","last_became_peered":"2024-05-30T16:49:04.556386+0000","last_unstale":"2024-05-30T16:49:05.533898+0000","last_undegraded":"2024-05-30T16:49:05.533898+0000","last_fullsized":"2024-05-30T16:49:05.533898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:45.716674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052183+0000","last_change":"2024-05-30T16:49:04.552810+0000","last_active":"2024-05-30T16:49:06.052183+0000","last_peered":"2024-05-30T16:49:06.052183+0000","last_clean":"2024-05-30T16:49:06.052183+0000","last_became_active":"2024-05-30T16:49:04.552478+0000","last_became_peered":"2024-05-30T16:49:04.552478+0000","last_unstale":"2024-05-30T16:49:06.052183+0000","last_undegraded":"2024-05-30T16:49:06.052183+0000","last_fullsized":"2024-05-30T16:49:06.052183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:17:37.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534174+0000","last_change":"2024-05-30T16:49:04.546420+0000","last_active":"2024-05-30T16:49:05.534174+0000","last_peered":"2024-05-30T16:49:05.534174+0000","last_clean":"2024-05-30T16:49:05.534174+0000","last_became_active":"2024-05-30T16:49:04.545288+0000","last_became_peered":"2024-05-30T16:49:04.545288+0000","last_unstale":"2024-05-30T16:49:05.534174+0000","last_undegraded":"2024-05-30T16:49:05.534174+0000","last_fullsized":"2024-05-30T16:49:05.534174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:17:37.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051955+0000","last_change":"2024-05-30T16:49:04.542431+0000","last_active":"2024-05-30T16:49:06.051955+0000","last_peered":"2024-05-30T16:49:06.051955+0000","last_clean":"2024-05-30T16:49:06.051955+0000","last_became_active":"2024-05-30T16:49:04.541958+0000","last_became_peered":"2024-05-30T16:49:04.541958+0000","last_unstale":"2024-05-30T16:49:06.051955+0000","last_undegraded":"2024-05-30T16:49:06.051955+0000","last_fullsized":"2024-05-30T16:49:06.051955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:41.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.050859+0000","last_change":"2024-05-30T16:49:04.546221+0000","last_active":"2024-05-30T16:49:06.050859+0000","last_peered":"2024-05-30T16:49:06.050859+0000","last_clean":"2024-05-30T16:49:06.050859+0000","last_became_active":"2024-05-30T16:49:04.545933+0000","last_became_peered":"2024-05-30T16:49:04.545933+0000","last_unstale":"2024-05-30T16:49:06.050859+0000","last_undegraded":"2024-05-30T16:49:06.050859+0000","last_fullsized":"2024-05-30T16:49:06.050859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:21.914079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052633+0000","last_change":"2024-05-30T16:49:04.554508+0000","last_active":"2024-05-30T16:49:06.052633+0000","last_peered":"2024-05-30T16:49:06.052633+0000","last_clean":"2024-05-30T16:49:06.052633+0000","last_became_active":"2024-05-30T16:49:04.553966+0000","last_became_peered":"2024-05-30T16:49:04.553966+0000","last_unstale":"2024-05-30T16:49:06.052633+0000","last_undegraded":"2024-05-30T16:49:06.052633+0000","last_fullsized":"2024-05-30T16:49:06.052633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:47:24.068734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053243+0000","last_change":"2024-05-30T16:49:04.553475+0000","last_active":"2024-05-30T16:49:06.053243+0000","last_peered":"2024-05-30T16:49:06.053243+0000","last_clean":"2024-05-30T16:49:06.053243+0000","last_became_active":"2024-05-30T16:49:04.552962+0000","last_became_peered":"2024-05-30T16:49:04.552962+0000","last_unstale":"2024-05-30T16:49:06.053243+0000","last_undegraded":"2024-05-30T16:49:06.053243+0000","last_fullsized":"2024-05-30T16:49:06.053243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053178+0000","last_change":"2024-05-30T16:49:04.554233+0000","last_active":"2024-05-30T16:49:06.053178+0000","last_peered":"2024-05-30T16:49:06.053178+0000","last_clean":"2024-05-30T16:49:06.053178+0000","last_became_active":"2024-05-30T16:49:04.553934+0000","last_became_peered":"2024-05-30T16:49:04.553934+0000","last_unstale":"2024-05-30T16:49:06.053178+0000","last_undegraded":"2024-05-30T16:49:06.053178+0000","last_fullsized":"2024-05-30T16:49:06.053178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534485+0000","last_change":"2024-05-30T16:49:04.548278+0000","last_active":"2024-05-30T16:49:05.534485+0000","last_peered":"2024-05-30T16:49:05.534485+0000","last_clean":"2024-05-30T16:49:05.534485+0000","last_became_active":"2024-05-30T16:49:04.547736+0000","last_became_peered":"2024-05-30T16:49:04.547736+0000","last_unstale":"2024-05-30T16:49:05.534485+0000","last_undegraded":"2024-05-30T16:49:05.534485+0000","last_fullsized":"2024-05-30T16:49:05.534485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:02.310302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051507+0000","last_change":"2024-05-30T16:49:04.541147+0000","last_active":"2024-05-30T16:49:06.051507+0000","last_peered":"2024-05-30T16:49:06.051507+0000","last_clean":"2024-05-30T16:49:06.051507+0000","last_became_active":"2024-05-30T16:49:04.540873+0000","last_became_peered":"2024-05-30T16:49:04.540873+0000","last_unstale":"2024-05-30T16:49:06.051507+0000","last_undegraded":"2024-05-30T16:49:06.051507+0000","last_fullsized":"2024-05-30T16:49:06.051507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:31:53.336085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051066+0000","last_change":"2024-05-30T16:49:04.540239+0000","last_active":"2024-05-30T16:49:06.051066+0000","last_peered":"2024-05-30T16:49:06.051066+0000","last_clean":"2024-05-30T16:49:06.051066+0000","last_became_active":"2024-05-30T16:49:04.539685+0000","last_became_peered":"2024-05-30T16:49:04.539685+0000","last_unstale":"2024-05-30T16:49:06.051066+0000","last_undegraded":"2024-05-30T16:49:06.051066+0000","last_fullsized":"2024-05-30T16:49:06.051066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:59.153304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052714+0000","last_change":"2024-05-30T16:49:04.548766+0000","last_active":"2024-05-30T16:49:06.052714+0000","last_peered":"2024-05-30T16:49:06.052714+0000","last_clean":"2024-05-30T16:49:06.052714+0000","last_became_active":"2024-05-30T16:49:04.548490+0000","last_became_peered":"2024-05-30T16:49:04.548490+0000","last_unstale":"2024-05-30T16:49:06.052714+0000","last_undegraded":"2024-05-30T16:49:06.052714+0000","last_fullsized":"2024-05-30T16:49:06.052714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.532984+0000","last_change":"2024-05-30T16:49:04.542268+0000","last_active":"2024-05-30T16:49:05.532984+0000","last_peered":"2024-05-30T16:49:05.532984+0000","last_clean":"2024-05-30T16:49:05.532984+0000","last_became_active":"2024-05-30T16:49:04.541992+0000","last_became_peered":"2024-05-30T16:49:04.541992+0000","last_unstale":"2024-05-30T16:49:05.532984+0000","last_undegraded":"2024-05-30T16:49:05.532984+0000","last_fullsized":"2024-05-30T16:49:05.532984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534099+0000","last_change":"2024-05-30T16:49:04.550221+0000","last_active":"2024-05-30T16:49:05.534099+0000","last_peered":"2024-05-30T16:49:05.534099+0000","last_clean":"2024-05-30T16:49:05.534099+0000","last_became_active":"2024-05-30T16:49:04.549914+0000","last_became_peered":"2024-05-30T16:49:04.549914+0000","last_unstale":"2024-05-30T16:49:05.534099+0000","last_undegraded":"2024-05-30T16:49:05.534099+0000","last_fullsized":"2024-05-30T16:49:05.534099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:41.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530293+0000","last_change":"2024-05-30T16:49:04.551149+0000","last_active":"2024-05-30T16:49:05.530293+0000","last_peered":"2024-05-30T16:49:05.530293+0000","last_clean":"2024-05-30T16:49:05.530293+0000","last_became_active":"2024-05-30T16:49:04.543927+0000","last_became_peered":"2024-05-30T16:49:04.543927+0000","last_unstale":"2024-05-30T16:49:05.530293+0000","last_undegraded":"2024-05-30T16:49:05.530293+0000","last_fullsized":"2024-05-30T16:49:05.530293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:19.326134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052813+0000","last_change":"2024-05-30T16:49:04.536971+0000","last_active":"2024-05-30T16:49:06.052813+0000","last_peered":"2024-05-30T16:49:06.052813+0000","last_clean":"2024-05-30T16:49:06.052813+0000","last_became_active":"2024-05-30T16:49:04.536697+0000","last_became_peered":"2024-05-30T16:49:04.536697+0000","last_unstale":"2024-05-30T16:49:06.052813+0000","last_undegraded":"2024-05-30T16:49:06.052813+0000","last_fullsized":"2024-05-30T16:49:06.052813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:07.305667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052893+0000","last_change":"2024-05-30T16:49:04.554920+0000","last_active":"2024-05-30T16:49:06.052893+0000","last_peered":"2024-05-30T16:49:06.052893+0000","last_clean":"2024-05-30T16:49:06.052893+0000","last_became_active":"2024-05-30T16:49:04.554629+0000","last_became_peered":"2024-05-30T16:49:04.554629+0000","last_unstale":"2024-05-30T16:49:06.052893+0000","last_undegraded":"2024-05-30T16:49:06.052893+0000","last_fullsized":"2024-05-30T16:49:06.052893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051215+0000","last_change":"2024-05-30T16:49:04.546642+0000","last_active":"2024-05-30T16:49:06.051215+0000","last_peered":"2024-05-30T16:49:06.051215+0000","last_clean":"2024-05-30T16:49:06.051215+0000","last_became_active":"2024-05-30T16:49:04.546003+0000","last_became_peered":"2024-05-30T16:49:04.546003+0000","last_unstale":"2024-05-30T16:49:06.051215+0000","last_undegraded":"2024-05-30T16:49:06.051215+0000","last_fullsized":"2024-05-30T16:49:06.051215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:34:33.807678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534275+0000","last_change":"2024-05-30T16:49:04.549251+0000","last_active":"2024-05-30T16:49:05.534275+0000","last_peered":"2024-05-30T16:49:05.534275+0000","last_clean":"2024-05-30T16:49:05.534275+0000","last_became_active":"2024-05-30T16:49:04.548946+0000","last_became_peered":"2024-05-30T16:49:04.548946+0000","last_unstale":"2024-05-30T16:49:05.534275+0000","last_undegraded":"2024-05-30T16:49:05.534275+0000","last_fullsized":"2024-05-30T16:49:05.534275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:53:12.385144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051209+0000","last_change":"2024-05-30T16:49:04.554673+0000","last_active":"2024-05-30T16:49:06.051209+0000","last_peered":"2024-05-30T16:49:06.051209+0000","last_clean":"2024-05-30T16:49:06.051209+0000","last_became_active":"2024-05-30T16:49:04.552406+0000","last_became_peered":"2024-05-30T16:49:04.552406+0000","last_unstale":"2024-05-30T16:49:06.051209+0000","last_undegraded":"2024-05-30T16:49:06.051209+0000","last_fullsized":"2024-05-30T16:49:06.051209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:32:11.592244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534589+0000","last_change":"2024-05-30T16:49:04.539930+0000","last_active":"2024-05-30T16:49:05.534589+0000","last_peered":"2024-05-30T16:49:05.534589+0000","last_clean":"2024-05-30T16:49:05.534589+0000","last_became_active":"2024-05-30T16:49:04.538018+0000","last_became_peered":"2024-05-30T16:49:04.538018+0000","last_unstale":"2024-05-30T16:49:05.534589+0000","last_undegraded":"2024-05-30T16:49:05.534589+0000","last_fullsized":"2024-05-30T16:49:05.534589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052036+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.052036+0000","last_peered":"2024-05-30T16:49:06.052036+0000","last_clean":"2024-05-30T16:49:06.052036+0000","last_became_active":"2024-05-30T16:49:04.556321+0000","last_became_peered":"2024-05-30T16:49:04.556321+0000","last_unstale":"2024-05-30T16:49:06.052036+0000","last_undegraded":"2024-05-30T16:49:06.052036+0000","last_fullsized":"2024-05-30T16:49:06.052036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:44:48.125700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053240+0000","last_change":"2024-05-30T16:49:04.544556+0000","last_active":"2024-05-30T16:49:06.053240+0000","last_peered":"2024-05-30T16:49:06.053240+0000","last_clean":"2024-05-30T16:49:06.053240+0000","last_became_active":"2024-05-30T16:49:04.543181+0000","last_became_peered":"2024-05-30T16:49:04.543181+0000","last_unstale":"2024-05-30T16:49:06.053240+0000","last_undegraded":"2024-05-30T16:49:06.053240+0000","last_fullsized":"2024-05-30T16:49:06.053240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052887+0000","last_change":"2024-05-30T16:49:04.540083+0000","last_active":"2024-05-30T16:49:06.052887+0000","last_peered":"2024-05-30T16:49:06.052887+0000","last_clean":"2024-05-30T16:49:06.052887+0000","last_became_active":"2024-05-30T16:49:04.539760+0000","last_became_peered":"2024-05-30T16:49:04.539760+0000","last_unstale":"2024-05-30T16:49:06.052887+0000","last_undegraded":"2024-05-30T16:49:06.052887+0000","last_fullsized":"2024-05-30T16:49:06.052887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051647+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.051647+0000","last_peered":"2024-05-30T16:49:06.051647+0000","last_clean":"2024-05-30T16:49:06.051647+0000","last_became_active":"2024-05-30T16:49:04.556297+0000","last_became_peered":"2024-05-30T16:49:04.556297+0000","last_unstale":"2024-05-30T16:49:06.051647+0000","last_undegraded":"2024-05-30T16:49:06.051647+0000","last_fullsized":"2024-05-30T16:49:06.051647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:14:09.241699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051361+0000","last_change":"2024-05-30T16:49:04.546093+0000","last_active":"2024-05-30T16:49:06.051361+0000","last_peered":"2024-05-30T16:49:06.051361+0000","last_clean":"2024-05-30T16:49:06.051361+0000","last_became_active":"2024-05-30T16:49:04.545623+0000","last_became_peered":"2024-05-30T16:49:04.545623+0000","last_unstale":"2024-05-30T16:49:06.051361+0000","last_undegraded":"2024-05-30T16:49:06.051361+0000","last_fullsized":"2024-05-30T16:49:06.051361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:38.640365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534360+0000","last_change":"2024-05-30T16:49:04.558192+0000","last_active":"2024-05-30T16:49:05.534360+0000","last_peered":"2024-05-30T16:49:05.534360+0000","last_clean":"2024-05-30T16:49:05.534360+0000","last_became_active":"2024-05-30T16:49:04.557826+0000","last_became_peered":"2024-05-30T16:49:04.557826+0000","last_unstale":"2024-05-30T16:49:05.534360+0000","last_undegraded":"2024-05-30T16:49:05.534360+0000","last_fullsized":"2024-05-30T16:49:05.534360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:59.487481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530068+0000","last_change":"2024-05-30T16:49:04.539369+0000","last_active":"2024-05-30T16:49:05.530068+0000","last_peered":"2024-05-30T16:49:05.530068+0000","last_clean":"2024-05-30T16:49:05.530068+0000","last_became_active":"2024-05-30T16:49:04.538899+0000","last_became_peered":"2024-05-30T16:49:04.538899+0000","last_unstale":"2024-05-30T16:49:05.530068+0000","last_undegraded":"2024-05-30T16:49:05.530068+0000","last_fullsized":"2024-05-30T16:49:05.530068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:39.816197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052013+0000","last_change":"2024-05-30T16:49:04.549536+0000","last_active":"2024-05-30T16:49:06.052013+0000","last_peered":"2024-05-30T16:49:06.052013+0000","last_clean":"2024-05-30T16:49:06.052013+0000","last_became_active":"2024-05-30T16:49:04.546653+0000","last_became_peered":"2024-05-30T16:49:04.546653+0000","last_unstale":"2024-05-30T16:49:06.052013+0000","last_undegraded":"2024-05-30T16:49:06.052013+0000","last_fullsized":"2024-05-30T16:49:06.052013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:38.640365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533225+0000","last_change":"2024-05-30T16:49:04.558267+0000","last_active":"2024-05-30T16:49:05.533225+0000","last_peered":"2024-05-30T16:49:05.533225+0000","last_clean":"2024-05-30T16:49:05.533225+0000","last_became_active":"2024-05-30T16:49:04.558000+0000","last_became_peered":"2024-05-30T16:49:04.558000+0000","last_unstale":"2024-05-30T16:49:05.533225+0000","last_undegraded":"2024-05-30T16:49:05.533225+0000","last_fullsized":"2024-05-30T16:49:05.533225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:11.469445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051650+0000","last_change":"2024-05-30T16:49:03.546643+0000","last_active":"2024-05-30T16:49:06.051650+0000","last_peered":"2024-05-30T16:49:06.051650+0000","last_clean":"2024-05-30T16:49:06.051650+0000","last_became_active":"2024-05-30T16:49:03.546381+0000","last_became_peered":"2024-05-30T16:49:03.546381+0000","last_unstale":"2024-05-30T16:49:06.051650+0000","last_undegraded":"2024-05-30T16:49:06.051650+0000","last_fullsized":"2024-05-30T16:49:06.051650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:44.078644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051517+0000","last_change":"2024-05-30T16:49:04.549134+0000","last_active":"2024-05-30T16:49:06.051517+0000","last_peered":"2024-05-30T16:49:06.051517+0000","last_clean":"2024-05-30T16:49:06.051517+0000","last_became_active":"2024-05-30T16:49:04.548780+0000","last_became_peered":"2024-05-30T16:49:04.548780+0000","last_unstale":"2024-05-30T16:49:06.051517+0000","last_undegraded":"2024-05-30T16:49:06.051517+0000","last_fullsized":"2024-05-30T16:49:06.051517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052899+0000","last_change":"2024-05-30T16:49:03.542612+0000","last_active":"2024-05-30T16:49:06.052899+0000","last_peered":"2024-05-30T16:49:06.052899+0000","last_clean":"2024-05-30T16:49:06.052899+0000","last_became_active":"2024-05-30T16:49:03.541360+0000","last_became_peered":"2024-05-30T16:49:03.541360+0000","last_unstale":"2024-05-30T16:49:06.052899+0000","last_undegraded":"2024-05-30T16:49:06.052899+0000","last_fullsized":"2024-05-30T16:49:06.052899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051315+0000","last_change":"2024-05-30T16:49:03.538756+0000","last_active":"2024-05-30T16:49:06.051315+0000","last_peered":"2024-05-30T16:49:06.051315+0000","last_clean":"2024-05-30T16:49:06.051315+0000","last_became_active":"2024-05-30T16:49:03.538053+0000","last_became_peered":"2024-05-30T16:49:03.538053+0000","last_unstale":"2024-05-30T16:49:06.051315+0000","last_undegraded":"2024-05-30T16:49:06.051315+0000","last_fullsized":"2024-05-30T16:49:06.051315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:07.264297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051433+0000","last_change":"2024-05-30T16:49:04.546048+0000","last_active":"2024-05-30T16:49:06.051433+0000","last_peered":"2024-05-30T16:49:06.051433+0000","last_clean":"2024-05-30T16:49:06.051433+0000","last_became_active":"2024-05-30T16:49:04.545151+0000","last_became_peered":"2024-05-30T16:49:04.545151+0000","last_unstale":"2024-05-30T16:49:06.051433+0000","last_undegraded":"2024-05-30T16:49:06.051433+0000","last_fullsized":"2024-05-30T16:49:06.051433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:07.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533718+0000","last_change":"2024-05-30T16:49:03.529039+0000","last_active":"2024-05-30T16:49:05.533718+0000","last_peered":"2024-05-30T16:49:05.533718+0000","last_clean":"2024-05-30T16:49:05.533718+0000","last_became_active":"2024-05-30T16:49:03.527042+0000","last_became_peered":"2024-05-30T16:49:03.527042+0000","last_unstale":"2024-05-30T16:49:05.533718+0000","last_undegraded":"2024-05-30T16:49:05.533718+0000","last_fullsized":"2024-05-30T16:49:05.533718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052719+0000","last_change":"2024-05-30T16:49:04.540411+0000","last_active":"2024-05-30T16:49:06.052719+0000","last_peered":"2024-05-30T16:49:06.052719+0000","last_clean":"2024-05-30T16:49:06.052719+0000","last_became_active":"2024-05-30T16:49:04.540089+0000","last_became_peered":"2024-05-30T16:49:04.540089+0000","last_unstale":"2024-05-30T16:49:06.052719+0000","last_undegraded":"2024-05-30T16:49:06.052719+0000","last_fullsized":"2024-05-30T16:49:06.052719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053224+0000","last_change":"2024-05-30T16:49:03.542933+0000","last_active":"2024-05-30T16:49:06.053224+0000","last_peered":"2024-05-30T16:49:06.053224+0000","last_clean":"2024-05-30T16:49:06.053224+0000","last_became_active":"2024-05-30T16:49:03.541460+0000","last_became_peered":"2024-05-30T16:49:03.541460+0000","last_unstale":"2024-05-30T16:49:06.053224+0000","last_undegraded":"2024-05-30T16:49:06.053224+0000","last_fullsized":"2024-05-30T16:49:06.053224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533477+0000","last_change":"2024-05-30T16:49:04.549367+0000","last_active":"2024-05-30T16:49:05.533477+0000","last_peered":"2024-05-30T16:49:05.533477+0000","last_clean":"2024-05-30T16:49:05.533477+0000","last_became_active":"2024-05-30T16:49:04.548994+0000","last_became_peered":"2024-05-30T16:49:04.548994+0000","last_unstale":"2024-05-30T16:49:05.533477+0000","last_undegraded":"2024-05-30T16:49:05.533477+0000","last_fullsized":"2024-05-30T16:49:05.533477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533840+0000","last_change":"2024-05-30T16:49:03.540903+0000","last_active":"2024-05-30T16:49:05.533840+0000","last_peered":"2024-05-30T16:49:05.533840+0000","last_clean":"2024-05-30T16:49:05.533840+0000","last_became_active":"2024-05-30T16:49:03.540598+0000","last_became_peered":"2024-05-30T16:49:03.540598+0000","last_unstale":"2024-05-30T16:49:05.533840+0000","last_undegraded":"2024-05-30T16:49:05.533840+0000","last_fullsized":"2024-05-30T16:49:05.533840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:45.462713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051841+0000","last_change":"2024-05-30T16:49:04.542032+0000","last_active":"2024-05-30T16:49:06.051841+0000","last_peered":"2024-05-30T16:49:06.051841+0000","last_clean":"2024-05-30T16:49:06.051841+0000","last_became_active":"2024-05-30T16:49:04.541750+0000","last_became_peered":"2024-05-30T16:49:04.541750+0000","last_unstale":"2024-05-30T16:49:06.051841+0000","last_undegraded":"2024-05-30T16:49:06.051841+0000","last_fullsized":"2024-05-30T16:49:06.051841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052980+0000","last_change":"2024-05-30T16:49:03.537811+0000","last_active":"2024-05-30T16:49:06.052980+0000","last_peered":"2024-05-30T16:49:06.052980+0000","last_clean":"2024-05-30T16:49:06.052980+0000","last_became_active":"2024-05-30T16:49:03.537468+0000","last_became_peered":"2024-05-30T16:49:03.537468+0000","last_unstale":"2024-05-30T16:49:06.052980+0000","last_undegraded":"2024-05-30T16:49:06.052980+0000","last_fullsized":"2024-05-30T16:49:06.052980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534607+0000","last_change":"2024-05-30T16:49:04.548049+0000","last_active":"2024-05-30T16:49:05.534607+0000","last_peered":"2024-05-30T16:49:05.534607+0000","last_clean":"2024-05-30T16:49:05.534607+0000","last_became_active":"2024-05-30T16:49:04.547483+0000","last_became_peered":"2024-05-30T16:49:04.547483+0000","last_unstale":"2024-05-30T16:49:05.534607+0000","last_undegraded":"2024-05-30T16:49:05.534607+0000","last_fullsized":"2024-05-30T16:49:05.534607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:39.816197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053012+0000","last_change":"2024-05-30T16:49:03.542201+0000","last_active":"2024-05-30T16:49:06.053012+0000","last_peered":"2024-05-30T16:49:06.053012+0000","last_clean":"2024-05-30T16:49:06.053012+0000","last_became_active":"2024-05-30T16:49:03.541172+0000","last_became_peered":"2024-05-30T16:49:03.541172+0000","last_unstale":"2024-05-30T16:49:06.053012+0000","last_undegraded":"2024-05-30T16:49:06.053012+0000","last_fullsized":"2024-05-30T16:49:06.053012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:21:15.090452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052243+0000","last_change":"2024-05-30T16:49:04.540546+0000","last_active":"2024-05-30T16:49:06.052243+0000","last_peered":"2024-05-30T16:49:06.052243+0000","last_clean":"2024-05-30T16:49:06.052243+0000","last_became_active":"2024-05-30T16:49:04.539786+0000","last_became_peered":"2024-05-30T16:49:04.539786+0000","last_unstale":"2024-05-30T16:49:06.052243+0000","last_undegraded":"2024-05-30T16:49:06.052243+0000","last_fullsized":"2024-05-30T16:49:06.052243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:53:12.385144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051634+0000","last_change":"2024-05-30T16:49:03.542403+0000","last_active":"2024-05-30T16:49:06.051634+0000","last_peered":"2024-05-30T16:49:06.051634+0000","last_clean":"2024-05-30T16:49:06.051634+0000","last_became_active":"2024-05-30T16:49:03.535558+0000","last_became_peered":"2024-05-30T16:49:03.535558+0000","last_unstale":"2024-05-30T16:49:06.051634+0000","last_undegraded":"2024-05-30T16:49:06.051634+0000","last_fullsized":"2024-05-30T16:49:06.051634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:50:44.488767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051231+0000","last_change":"2024-05-30T16:49:04.543912+0000","last_active":"2024-05-30T16:49:06.051231+0000","last_peered":"2024-05-30T16:49:06.051231+0000","last_clean":"2024-05-30T16:49:06.051231+0000","last_became_active":"2024-05-30T16:49:04.543548+0000","last_became_peered":"2024-05-30T16:49:04.543548+0000","last_unstale":"2024-05-30T16:49:06.051231+0000","last_undegraded":"2024-05-30T16:49:06.051231+0000","last_fullsized":"2024-05-30T16:49:06.051231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:46.470731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534423+0000","last_change":"2024-05-30T16:49:03.533929+0000","last_active":"2024-05-30T16:49:05.534423+0000","last_peered":"2024-05-30T16:49:05.534423+0000","last_clean":"2024-05-30T16:49:05.534423+0000","last_became_active":"2024-05-30T16:49:03.533583+0000","last_became_peered":"2024-05-30T16:49:03.533583+0000","last_unstale":"2024-05-30T16:49:05.534423+0000","last_undegraded":"2024-05-30T16:49:05.534423+0000","last_fullsized":"2024-05-30T16:49:05.534423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052365+0000","last_change":"2024-05-30T16:49:04.550074+0000","last_active":"2024-05-30T16:49:06.052365+0000","last_peered":"2024-05-30T16:49:06.052365+0000","last_clean":"2024-05-30T16:49:06.052365+0000","last_became_active":"2024-05-30T16:49:04.549701+0000","last_became_peered":"2024-05-30T16:49:04.549701+0000","last_unstale":"2024-05-30T16:49:06.052365+0000","last_undegraded":"2024-05-30T16:49:06.052365+0000","last_fullsized":"2024-05-30T16:49:06.052365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:45:42.077957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052757+0000","last_change":"2024-05-30T16:49:03.533071+0000","last_active":"2024-05-30T16:49:06.052757+0000","last_peered":"2024-05-30T16:49:06.052757+0000","last_clean":"2024-05-30T16:49:06.052757+0000","last_became_active":"2024-05-30T16:49:03.532744+0000","last_became_peered":"2024-05-30T16:49:03.532744+0000","last_unstale":"2024-05-30T16:49:06.052757+0000","last_undegraded":"2024-05-30T16:49:06.052757+0000","last_fullsized":"2024-05-30T16:49:06.052757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:51:21.137153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052564+0000","last_change":"2024-05-30T16:49:04.546980+0000","last_active":"2024-05-30T16:49:06.052564+0000","last_peered":"2024-05-30T16:49:06.052564+0000","last_clean":"2024-05-30T16:49:06.052564+0000","last_became_active":"2024-05-30T16:49:04.546205+0000","last_became_peered":"2024-05-30T16:49:04.546205+0000","last_unstale":"2024-05-30T16:49:06.052564+0000","last_undegraded":"2024-05-30T16:49:06.052564+0000","last_fullsized":"2024-05-30T16:49:06.052564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.529988+0000","last_change":"2024-05-30T16:49:03.543445+0000","last_active":"2024-05-30T16:49:05.529988+0000","last_peered":"2024-05-30T16:49:05.529988+0000","last_clean":"2024-05-30T16:49:05.529988+0000","last_became_active":"2024-05-30T16:49:03.543068+0000","last_became_peered":"2024-05-30T16:49:03.543068+0000","last_unstale":"2024-05-30T16:49:05.529988+0000","last_undegraded":"2024-05-30T16:49:05.529988+0000","last_fullsized":"2024-05-30T16:49:05.529988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:51:21.137153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052327+0000","last_change":"2024-05-30T16:49:04.553768+0000","last_active":"2024-05-30T16:49:06.052327+0000","last_peered":"2024-05-30T16:49:06.052327+0000","last_clean":"2024-05-30T16:49:06.052327+0000","last_became_active":"2024-05-30T16:49:04.550850+0000","last_became_peered":"2024-05-30T16:49:04.550850+0000","last_unstale":"2024-05-30T16:49:06.052327+0000","last_undegraded":"2024-05-30T16:49:06.052327+0000","last_fullsized":"2024-05-30T16:49:06.052327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:55.007207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534287+0000","last_change":"2024-05-30T16:49:03.549177+0000","last_active":"2024-05-30T16:49:05.534287+0000","last_peered":"2024-05-30T16:49:05.534287+0000","last_clean":"2024-05-30T16:49:05.534287+0000","last_became_active":"2024-05-30T16:49:03.548803+0000","last_became_peered":"2024-05-30T16:49:03.548803+0000","last_unstale":"2024-05-30T16:49:05.534287+0000","last_undegraded":"2024-05-30T16:49:05.534287+0000","last_fullsized":"2024-05-30T16:49:05.534287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:28:50.120091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052450+0000","last_change":"2024-05-30T16:49:04.552000+0000","last_active":"2024-05-30T16:49:06.052450+0000","last_peered":"2024-05-30T16:49:06.052450+0000","last_clean":"2024-05-30T16:49:06.052450+0000","last_became_active":"2024-05-30T16:49:04.551392+0000","last_became_peered":"2024-05-30T16:49:04.551392+0000","last_unstale":"2024-05-30T16:49:06.052450+0000","last_undegraded":"2024-05-30T16:49:06.052450+0000","last_fullsized":"2024-05-30T16:49:06.052450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:59.487481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530211+0000","last_change":"2024-05-30T16:49:03.548846+0000","last_active":"2024-05-30T16:49:05.530211+0000","last_peered":"2024-05-30T16:49:05.530211+0000","last_clean":"2024-05-30T16:49:05.530211+0000","last_became_active":"2024-05-30T16:49:03.547182+0000","last_became_peered":"2024-05-30T16:49:03.547182+0000","last_unstale":"2024-05-30T16:49:05.530211+0000","last_undegraded":"2024-05-30T16:49:05.530211+0000","last_fullsized":"2024-05-30T16:49:05.530211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052721+0000","last_change":"2024-05-30T16:49:04.558273+0000","last_active":"2024-05-30T16:49:06.052721+0000","last_peered":"2024-05-30T16:49:06.052721+0000","last_clean":"2024-05-30T16:49:06.052721+0000","last_became_active":"2024-05-30T16:49:04.557860+0000","last_became_peered":"2024-05-30T16:49:04.557860+0000","last_unstale":"2024-05-30T16:49:06.052721+0000","last_undegraded":"2024-05-30T16:49:06.052721+0000","last_fullsized":"2024-05-30T16:49:06.052721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:20.040027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053015+0000","last_change":"2024-05-30T16:49:03.532399+0000","last_active":"2024-05-30T16:49:06.053015+0000","last_peered":"2024-05-30T16:49:06.053015+0000","last_clean":"2024-05-30T16:49:06.053015+0000","last_became_active":"2024-05-30T16:49:03.529396+0000","last_became_peered":"2024-05-30T16:49:03.529396+0000","last_unstale":"2024-05-30T16:49:06.053015+0000","last_undegraded":"2024-05-30T16:49:06.053015+0000","last_fullsized":"2024-05-30T16:49:06.053015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:18.318116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534179+0000","last_change":"2024-05-30T16:49:04.549628+0000","last_active":"2024-05-30T16:49:05.534179+0000","last_peered":"2024-05-30T16:49:05.534179+0000","last_clean":"2024-05-30T16:49:05.534179+0000","last_became_active":"2024-05-30T16:49:04.548782+0000","last_became_peered":"2024-05-30T16:49:04.548782+0000","last_unstale":"2024-05-30T16:49:05.534179+0000","last_undegraded":"2024-05-30T16:49:05.534179+0000","last_fullsized":"2024-05-30T16:49:05.534179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:55.007207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530197+0000","last_change":"2024-05-30T16:49:03.540089+0000","last_active":"2024-05-30T16:49:05.530197+0000","last_peered":"2024-05-30T16:49:05.530197+0000","last_clean":"2024-05-30T16:49:05.530197+0000","last_became_active":"2024-05-30T16:49:03.539760+0000","last_became_peered":"2024-05-30T16:49:03.539760+0000","last_unstale":"2024-05-30T16:49:05.530197+0000","last_undegraded":"2024-05-30T16:49:05.530197+0000","last_fullsized":"2024-05-30T16:49:05.530197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:21:15.090452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052910+0000","last_change":"2024-05-30T16:49:04.555284+0000","last_active":"2024-05-30T16:49:06.052910+0000","last_peered":"2024-05-30T16:49:06.052910+0000","last_clean":"2024-05-30T16:49:06.052910+0000","last_became_active":"2024-05-30T16:49:04.555022+0000","last_became_peered":"2024-05-30T16:49:04.555022+0000","last_unstale":"2024-05-30T16:49:06.052910+0000","last_undegraded":"2024-05-30T16:49:06.052910+0000","last_fullsized":"2024-05-30T16:49:06.052910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:42.707877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052217+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:49:06.052217+0000","last_peered":"2024-05-30T16:49:06.052217+0000","last_clean":"2024-05-30T16:49:06.052217+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:49:06.052217+0000","last_undegraded":"2024-05-30T16:49:06.052217+0000","last_fullsized":"2024-05-30T16:49:06.052217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533284+0000","last_change":"2024-05-30T16:49:03.536755+0000","last_active":"2024-05-30T16:49:05.533284+0000","last_peered":"2024-05-30T16:49:05.533284+0000","last_clean":"2024-05-30T16:49:05.533284+0000","last_became_active":"2024-05-30T16:49:03.536335+0000","last_became_peered":"2024-05-30T16:49:03.536335+0000","last_unstale":"2024-05-30T16:49:05.533284+0000","last_undegraded":"2024-05-30T16:49:05.533284+0000","last_fullsized":"2024-05-30T16:49:05.533284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051447+0000","last_change":"2024-05-30T16:49:04.546603+0000","last_active":"2024-05-30T16:49:06.051447+0000","last_peered":"2024-05-30T16:49:06.051447+0000","last_clean":"2024-05-30T16:49:06.051447+0000","last_became_active":"2024-05-30T16:49:04.545130+0000","last_became_peered":"2024-05-30T16:49:04.545130+0000","last_unstale":"2024-05-30T16:49:06.051447+0000","last_undegraded":"2024-05-30T16:49:06.051447+0000","last_fullsized":"2024-05-30T16:49:06.051447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:47.404454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052089+0000","last_change":"2024-05-30T16:49:03.548756+0000","last_active":"2024-05-30T16:49:06.052089+0000","last_peered":"2024-05-30T16:49:06.052089+0000","last_clean":"2024-05-30T16:49:06.052089+0000","last_became_active":"2024-05-30T16:49:03.548431+0000","last_became_peered":"2024-05-30T16:49:03.548431+0000","last_unstale":"2024-05-30T16:49:06.052089+0000","last_undegraded":"2024-05-30T16:49:06.052089+0000","last_fullsized":"2024-05-30T16:49:06.052089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051661+0000","last_change":"2024-05-30T16:49:04.557247+0000","last_active":"2024-05-30T16:49:06.051661+0000","last_peered":"2024-05-30T16:49:06.051661+0000","last_clean":"2024-05-30T16:49:06.051661+0000","last_became_active":"2024-05-30T16:49:04.556957+0000","last_became_peered":"2024-05-30T16:49:04.556957+0000","last_unstale":"2024-05-30T16:49:06.051661+0000","last_undegraded":"2024-05-30T16:49:06.051661+0000","last_fullsized":"2024-05-30T16:49:06.051661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530057+0000","last_change":"2024-05-30T16:49:03.548449+0000","last_active":"2024-05-30T16:49:05.530057+0000","last_peered":"2024-05-30T16:49:05.530057+0000","last_clean":"2024-05-30T16:49:05.530057+0000","last_became_active":"2024-05-30T16:49:03.547447+0000","last_became_peered":"2024-05-30T16:49:03.547447+0000","last_unstale":"2024-05-30T16:49:05.530057+0000","last_undegraded":"2024-05-30T16:49:05.530057+0000","last_fullsized":"2024-05-30T16:49:05.530057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:39:09.796452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052694+0000","last_change":"2024-05-30T16:49:04.535009+0000","last_active":"2024-05-30T16:49:06.052694+0000","last_peered":"2024-05-30T16:49:06.052694+0000","last_clean":"2024-05-30T16:49:06.052694+0000","last_became_active":"2024-05-30T16:49:04.534615+0000","last_became_peered":"2024-05-30T16:49:04.534615+0000","last_unstale":"2024-05-30T16:49:06.052694+0000","last_undegraded":"2024-05-30T16:49:06.052694+0000","last_fullsized":"2024-05-30T16:49:06.052694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534481+0000","last_change":"2024-05-30T16:49:03.526029+0000","last_active":"2024-05-30T16:49:05.534481+0000","last_peered":"2024-05-30T16:49:05.534481+0000","last_clean":"2024-05-30T16:49:05.534481+0000","last_became_active":"2024-05-30T16:49:03.525606+0000","last_became_peered":"2024-05-30T16:49:03.525606+0000","last_unstale":"2024-05-30T16:49:05.534481+0000","last_undegraded":"2024-05-30T16:49:05.534481+0000","last_fullsized":"2024-05-30T16:49:05.534481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533778+0000","last_change":"2024-05-30T16:49:04.553469+0000","last_active":"2024-05-30T16:49:05.533778+0000","last_peered":"2024-05-30T16:49:05.533778+0000","last_clean":"2024-05-30T16:49:05.533778+0000","last_became_active":"2024-05-30T16:49:04.551873+0000","last_became_peered":"2024-05-30T16:49:04.551873+0000","last_unstale":"2024-05-30T16:49:05.533778+0000","last_undegraded":"2024-05-30T16:49:05.533778+0000","last_fullsized":"2024-05-30T16:49:05.533778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:15.394210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052860+0000","last_change":"2024-05-30T16:49:03.537420+0000","last_active":"2024-05-30T16:49:06.052860+0000","last_peered":"2024-05-30T16:49:06.052860+0000","last_clean":"2024-05-30T16:49:06.052860+0000","last_became_active":"2024-05-30T16:49:03.536674+0000","last_became_peered":"2024-05-30T16:49:03.536674+0000","last_unstale":"2024-05-30T16:49:06.052860+0000","last_undegraded":"2024-05-30T16:49:06.052860+0000","last_fullsized":"2024-05-30T16:49:06.052860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534511+0000","last_change":"2024-05-30T16:49:04.557070+0000","last_active":"2024-05-30T16:49:05.534511+0000","last_peered":"2024-05-30T16:49:05.534511+0000","last_clean":"2024-05-30T16:49:05.534511+0000","last_became_active":"2024-05-30T16:49:04.556515+0000","last_became_peered":"2024-05-30T16:49:04.556515+0000","last_unstale":"2024-05-30T16:49:05.534511+0000","last_undegraded":"2024-05-30T16:49:05.534511+0000","last_fullsized":"2024-05-30T16:49:05.534511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:00.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052919+0000","last_change":"2024-05-30T16:49:03.551865+0000","last_active":"2024-05-30T16:49:06.052919+0000","last_peered":"2024-05-30T16:49:06.052919+0000","last_clean":"2024-05-30T16:49:06.052919+0000","last_became_active":"2024-05-30T16:49:03.551582+0000","last_became_peered":"2024-05-30T16:49:03.551582+0000","last_unstale":"2024-05-30T16:49:06.052919+0000","last_undegraded":"2024-05-30T16:49:06.052919+0000","last_fullsized":"2024-05-30T16:49:06.052919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:53:44.885507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052808+0000","last_change":"2024-05-30T16:49:04.537297+0000","last_active":"2024-05-30T16:49:06.052808+0000","last_peered":"2024-05-30T16:49:06.052808+0000","last_clean":"2024-05-30T16:49:06.052808+0000","last_became_active":"2024-05-30T16:49:04.535219+0000","last_became_peered":"2024-05-30T16:49:04.535219+0000","last_unstale":"2024-05-30T16:49:06.052808+0000","last_undegraded":"2024-05-30T16:49:06.052808+0000","last_fullsized":"2024-05-30T16:49:06.052808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053097+0000","last_change":"2024-05-30T16:49:03.534738+0000","last_active":"2024-05-30T16:49:06.053097+0000","last_peered":"2024-05-30T16:49:06.053097+0000","last_clean":"2024-05-30T16:49:06.053097+0000","last_became_active":"2024-05-30T16:49:03.534350+0000","last_became_peered":"2024-05-30T16:49:03.534350+0000","last_unstale":"2024-05-30T16:49:06.053097+0000","last_undegraded":"2024-05-30T16:49:06.053097+0000","last_fullsized":"2024-05-30T16:49:06.053097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052135+0000","last_change":"2024-05-30T16:49:04.544633+0000","last_active":"2024-05-30T16:49:06.052135+0000","last_peered":"2024-05-30T16:49:06.052135+0000","last_clean":"2024-05-30T16:49:06.052135+0000","last_became_active":"2024-05-30T16:49:04.544348+0000","last_became_peered":"2024-05-30T16:49:04.544348+0000","last_unstale":"2024-05-30T16:49:06.052135+0000","last_undegraded":"2024-05-30T16:49:06.052135+0000","last_fullsized":"2024-05-30T16:49:06.052135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:09.918803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053285+0000","last_change":"2024-05-30T16:49:03.547123+0000","last_active":"2024-05-30T16:49:06.053285+0000","last_peered":"2024-05-30T16:49:06.053285+0000","last_clean":"2024-05-30T16:49:06.053285+0000","last_became_active":"2024-05-30T16:49:03.546748+0000","last_became_peered":"2024-05-30T16:49:03.546748+0000","last_unstale":"2024-05-30T16:49:06.053285+0000","last_undegraded":"2024-05-30T16:49:06.053285+0000","last_fullsized":"2024-05-30T16:49:06.053285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051720+0000","last_change":"2024-05-30T16:49:04.536325+0000","last_active":"2024-05-30T16:49:06.051720+0000","last_peered":"2024-05-30T16:49:06.051720+0000","last_clean":"2024-05-30T16:49:06.051720+0000","last_became_active":"2024-05-30T16:49:04.535456+0000","last_became_peered":"2024-05-30T16:49:04.535456+0000","last_unstale":"2024-05-30T16:49:06.051720+0000","last_undegraded":"2024-05-30T16:49:06.051720+0000","last_fullsized":"2024-05-30T16:49:06.051720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051841+0000","last_change":"2024-05-30T16:49:03.551302+0000","last_active":"2024-05-30T16:49:06.051841+0000","last_peered":"2024-05-30T16:49:06.051841+0000","last_clean":"2024-05-30T16:49:06.051841+0000","last_became_active":"2024-05-30T16:49:03.551084+0000","last_became_peered":"2024-05-30T16:49:03.551084+0000","last_unstale":"2024-05-30T16:49:06.051841+0000","last_undegraded":"2024-05-30T16:49:06.051841+0000","last_fullsized":"2024-05-30T16:49:06.051841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533890+0000","last_change":"2024-05-30T16:49:04.548525+0000","last_active":"2024-05-30T16:49:05.533890+0000","last_peered":"2024-05-30T16:49:05.533890+0000","last_clean":"2024-05-30T16:49:05.533890+0000","last_became_active":"2024-05-30T16:49:04.548054+0000","last_became_peered":"2024-05-30T16:49:04.548054+0000","last_unstale":"2024-05-30T16:49:05.533890+0000","last_undegraded":"2024-05-30T16:49:05.533890+0000","last_fullsized":"2024-05-30T16:49:05.533890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:49.724960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052859+0000","last_change":"2024-05-30T16:49:03.546920+0000","last_active":"2024-05-30T16:49:06.052859+0000","last_peered":"2024-05-30T16:49:06.052859+0000","last_clean":"2024-05-30T16:49:06.052859+0000","last_became_active":"2024-05-30T16:49:03.545621+0000","last_became_peered":"2024-05-30T16:49:03.545621+0000","last_unstale":"2024-05-30T16:49:06.052859+0000","last_undegraded":"2024-05-30T16:49:06.052859+0000","last_fullsized":"2024-05-30T16:49:06.052859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051851+0000","last_change":"2024-05-30T16:49:04.535297+0000","last_active":"2024-05-30T16:49:06.051851+0000","last_peered":"2024-05-30T16:49:06.051851+0000","last_clean":"2024-05-30T16:49:06.051851+0000","last_became_active":"2024-05-30T16:49:04.534907+0000","last_became_peered":"2024-05-30T16:49:04.534907+0000","last_unstale":"2024-05-30T16:49:06.051851+0000","last_undegraded":"2024-05-30T16:49:06.051851+0000","last_fullsized":"2024-05-30T16:49:06.051851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:56.163039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052768+0000","last_change":"2024-05-30T16:49:03.536690+0000","last_active":"2024-05-30T16:49:06.052768+0000","last_peered":"2024-05-30T16:49:06.052768+0000","last_clean":"2024-05-30T16:49:06.052768+0000","last_became_active":"2024-05-30T16:49:03.536351+0000","last_became_peered":"2024-05-30T16:49:03.536351+0000","last_unstale":"2024-05-30T16:49:06.052768+0000","last_undegraded":"2024-05-30T16:49:06.052768+0000","last_fullsized":"2024-05-30T16:49:06.052768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051567+0000","last_change":"2024-05-30T16:49:04.556339+0000","last_active":"2024-05-30T16:49:06.051567+0000","last_peered":"2024-05-30T16:49:06.051567+0000","last_clean":"2024-05-30T16:49:06.051567+0000","last_became_active":"2024-05-30T16:49:04.556012+0000","last_became_peered":"2024-05-30T16:49:04.556012+0000","last_unstale":"2024-05-30T16:49:06.051567+0000","last_undegraded":"2024-05-30T16:49:06.051567+0000","last_fullsized":"2024-05-30T16:49:06.051567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:23.369792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052569+0000","last_change":"2024-05-30T16:49:03.550153+0000","last_active":"2024-05-30T16:49:06.052569+0000","last_peered":"2024-05-30T16:49:06.052569+0000","last_clean":"2024-05-30T16:49:06.052569+0000","last_became_active":"2024-05-30T16:49:03.549872+0000","last_became_peered":"2024-05-30T16:49:03.549872+0000","last_unstale":"2024-05-30T16:49:06.052569+0000","last_undegraded":"2024-05-30T16:49:06.052569+0000","last_fullsized":"2024-05-30T16:49:06.052569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:58.145285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052911+0000","last_change":"2024-05-30T16:49:04.558227+0000","last_active":"2024-05-30T16:49:06.052911+0000","last_peered":"2024-05-30T16:49:06.052911+0000","last_clean":"2024-05-30T16:49:06.052911+0000","last_became_active":"2024-05-30T16:49:04.557978+0000","last_became_peered":"2024-05-30T16:49:04.557978+0000","last_unstale":"2024-05-30T16:49:06.052911+0000","last_undegraded":"2024-05-30T16:49:06.052911+0000","last_fullsized":"2024-05-30T16:49:06.052911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534339+0000","last_change":"2024-05-30T16:49:04.561331+0000","last_active":"2024-05-30T16:49:05.534339+0000","last_peered":"2024-05-30T16:49:05.534339+0000","last_clean":"2024-05-30T16:49:05.534339+0000","last_became_active":"2024-05-30T16:49:04.560894+0000","last_became_peered":"2024-05-30T16:49:04.560894+0000","last_unstale":"2024-05-30T16:49:05.534339+0000","last_undegraded":"2024-05-30T16:49:05.534339+0000","last_fullsized":"2024-05-30T16:49:05.534339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:45:42.077957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052112+0000","last_change":"2024-05-30T16:49:03.549087+0000","last_active":"2024-05-30T16:49:06.052112+0000","last_peered":"2024-05-30T16:49:06.052112+0000","last_clean":"2024-05-30T16:49:06.052112+0000","last_became_active":"2024-05-30T16:49:03.548736+0000","last_became_peered":"2024-05-30T16:49:03.548736+0000","last_unstale":"2024-05-30T16:49:06.052112+0000","last_undegraded":"2024-05-30T16:49:06.052112+0000","last_fullsized":"2024-05-30T16:49:06.052112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534726+0000","last_change":"2024-05-30T16:49:04.561436+0000","last_active":"2024-05-30T16:49:05.534726+0000","last_peered":"2024-05-30T16:49:05.534726+0000","last_clean":"2024-05-30T16:49:05.534726+0000","last_became_active":"2024-05-30T16:49:04.561159+0000","last_became_peered":"2024-05-30T16:49:04.561159+0000","last_unstale":"2024-05-30T16:49:05.534726+0000","last_undegraded":"2024-05-30T16:49:05.534726+0000","last_fullsized":"2024-05-30T16:49:05.534726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:47:24.068734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052643+0000","last_change":"2024-05-30T16:49:03.552644+0000","last_active":"2024-05-30T16:49:06.052643+0000","last_peered":"2024-05-30T16:49:06.052643+0000","last_clean":"2024-05-30T16:49:06.052643+0000","last_became_active":"2024-05-30T16:49:03.552304+0000","last_became_peered":"2024-05-30T16:49:03.552304+0000","last_unstale":"2024-05-30T16:49:06.052643+0000","last_undegraded":"2024-05-30T16:49:06.052643+0000","last_fullsized":"2024-05-30T16:49:06.052643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:18.318116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051834+0000","last_change":"2024-05-30T16:49:04.542732+0000","last_active":"2024-05-30T16:49:06.051834+0000","last_peered":"2024-05-30T16:49:06.051834+0000","last_clean":"2024-05-30T16:49:06.051834+0000","last_became_active":"2024-05-30T16:49:04.542400+0000","last_became_peered":"2024-05-30T16:49:04.542400+0000","last_unstale":"2024-05-30T16:49:06.051834+0000","last_undegraded":"2024-05-30T16:49:06.051834+0000","last_fullsized":"2024-05-30T16:49:06.051834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052111+0000","last_change":"2024-05-30T16:49:03.546038+0000","last_active":"2024-05-30T16:49:06.052111+0000","last_peered":"2024-05-30T16:49:06.052111+0000","last_clean":"2024-05-30T16:49:06.052111+0000","last_became_active":"2024-05-30T16:49:03.545623+0000","last_became_peered":"2024-05-30T16:49:03.545623+0000","last_unstale":"2024-05-30T16:49:06.052111+0000","last_undegraded":"2024-05-30T16:49:06.052111+0000","last_fullsized":"2024-05-30T16:49:06.052111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:40.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052052+0000","last_change":"2024-05-30T16:49:04.546841+0000","last_active":"2024-05-30T16:49:06.052052+0000","last_peered":"2024-05-30T16:49:06.052052+0000","last_clean":"2024-05-30T16:49:06.052052+0000","last_became_active":"2024-05-30T16:49:04.546596+0000","last_became_peered":"2024-05-30T16:49:04.546596+0000","last_unstale":"2024-05-30T16:49:06.052052+0000","last_undegraded":"2024-05-30T16:49:06.052052+0000","last_fullsized":"2024-05-30T16:49:06.052052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:06.186315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051977+0000","last_change":"2024-05-30T16:49:03.551604+0000","last_active":"2024-05-30T16:49:06.051977+0000","last_peered":"2024-05-30T16:49:06.051977+0000","last_clean":"2024-05-30T16:49:06.051977+0000","last_became_active":"2024-05-30T16:49:03.551333+0000","last_became_peered":"2024-05-30T16:49:03.551333+0000","last_unstale":"2024-05-30T16:49:06.051977+0000","last_undegraded":"2024-05-30T16:49:06.051977+0000","last_fullsized":"2024-05-30T16:49:06.051977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:23.050556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":81081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":671961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:49:09.438 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T16:49:09.499 INFO:tasks.ceph.mds.d.smithi107.stderr:2024-05-30T16:49:09.494+0000 7eff78200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:49:09.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.614+0000 7f7837c00640 1 Processor -- start 2024-05-30T16:49:09.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.614+0000 7f7837c00640 1 -- start start 2024-05-30T16:49:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f7837c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f783015a500 0x7f78300cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f7837c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78300b1480 con 0x7f78300b0ec0 2024-05-30T16:49:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f7837c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78300b1760 con 0x7f78300d1390 2024-05-30T16:49:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f7837c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f783015a8e0 con 0x7f783015a500 2024-05-30T16:49:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f78300b0ec0 0x7f783015d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58116/0 (socket says 172.21.15.59:58116) 2024-05-30T16:49:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782fe00640 1 -- 172.21.15.59:0/1063435528 learned_addr learned my addr 172.21.15.59:0/1063435528 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:09.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f7835200640 1 --2- 172.21.15.59:0/1063435528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f783015a500 0x7f78300cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2633817891 0 0) 0x7f78300b1480 con 0x7f78300b0ec0 2024-05-30T16:49:09.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7818003530 con 0x7f78300b0ec0 2024-05-30T16:49:09.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2398157449 0 0) 0x7f78300b1760 con 0x7f78300d1390 2024-05-30T16:49:09.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78300b1480 con 0x7f78300d1390 2024-05-30T16:49:09.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1134565687 0 0) 0x7f7818003530 con 0x7f78300b0ec0 2024-05-30T16:49:09.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f783015a500 msgr2=0x7f78300cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:09.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 --2- 172.21.15.59:0/1063435528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f783015a500 0x7f78300cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 >> v1:172.21.15.107:6789/0 conn(0x7f78300d1390 legacy=0x7f78300ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78300b1a40 con 0x7f78300b0ec0 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f781c001680 con 0x7f78300b0ec0 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 >> v1:172.21.15.59:6789/0 conn(0x7f78300b0ec0 legacy=0x7f783015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 --2- 172.21.15.59:0/1063435528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7818003b80 0x7f7818003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 --2- 172.21.15.59:0/1063435528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f783015a500 0x7f7818004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 --2- 172.21.15.59:0/1063435528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7818004d50 0x7f78180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f783015a8e0 con 0x7f7818004d50 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f781800ba80 con 0x7f7818003b80 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f781800bc30 con 0x7f783015a500 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f7835c00640 1 --2- 172.21.15.59:0/1063435528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7818004d50 0x7f78180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f7835200640 1 --2- 172.21.15.59:0/1063435528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7818003b80 0x7f7818003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f782fe00640 1 --2- 172.21.15.59:0/1063435528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f783015a500 0x7f7818004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f7835c00640 1 -- 172.21.15.59:0/1063435528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f783015a500 msgr2=0x7f7818004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f7835c00640 1 --2- 172.21.15.59:0/1063435528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f783015a500 0x7f7818004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f7835c00640 1 -- 172.21.15.59:0/1063435528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7818003b80 msgr2=0x7f7818003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f7835c00640 1 --2- 172.21.15.59:0/1063435528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7818003b80 0x7f7818003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.618+0000 7f7835c00640 1 -- 172.21.15.59:0/1063435528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7818003530 con 0x7f7818004d50 2024-05-30T16:49:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.622+0000 7f7835c00640 1 --2- 172.21.15.59:0/1063435528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7818004d50 0x7f78180051d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7828001fd0 tx=0x7f782801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33082f68f0a126ff server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.622+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828001c20 con 0x7f7818004d50 2024-05-30T16:49:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.622+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7828003ba0 con 0x7f7818004d50 2024-05-30T16:49:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.622+0000 7f782f400640 1 -- 172.21.15.59:0/1063435528 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78280050d0 con 0x7f7818004d50 2024-05-30T16:49:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.622+0000 7f7837c00640 1 -- 172.21.15.59:0/1063435528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7818004d50 msgr2=0x7f78180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.622+0000 7f7837c00640 1 --2- 172.21.15.59:0/1063435528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7818004d50 0x7f78180051d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7828001fd0 tx=0x7f782801c900 comp rx=0 tx=0).stop 2024-05-30T16:49:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.622+0000 7f7835c00640 1 -- 172.21.15.59:0/1063435528 reap_dead start 2024-05-30T16:49:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.622+0000 7f7837c00640 1 -- 172.21.15.59:0/1063435528 shutdown_connections 2024-05-30T16:49:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.622+0000 7f7837c00640 1 -- 172.21.15.59:0/1063435528 >> 172.21.15.59:0/1063435528 conn(0x7f78300b6870 msgr2=0x7f78300b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.622+0000 7f7837c00640 1 -- 172.21.15.59:0/1063435528 shutdown_connections 2024-05-30T16:49:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.622+0000 7f7837c00640 1 -- 172.21.15.59:0/1063435528 wait complete. 2024-05-30T16:49:09.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7837c00640 1 Processor -- start 2024-05-30T16:49:09.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7837c00640 1 -- start start 2024-05-30T16:49:09.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7837c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7818004d50 0x7f783014d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7837c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f78300b4450 0x7f78300b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7837c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f783006bbb0 0x7f783006c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7837c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78300cf960 con 0x7f7818004d50 2024-05-30T16:49:09.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7837c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f78300cf7e0 con 0x7f783006bbb0 2024-05-30T16:49:09.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7837c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f78300cfae0 con 0x7f78300b4450 2024-05-30T16:49:09.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7835200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7818004d50 0x7f783014d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7835200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7818004d50 0x7f783014d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43834/0 (socket says 172.21.15.59:43834) 2024-05-30T16:49:09.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7835200640 1 -- 172.21.15.59:0/932019604 learned_addr learned my addr 172.21.15.59:0/932019604 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:09.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f782fe00640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f78300b4450 0x7f78300b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7835c00640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f783006bbb0 0x7f783006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7835200640 1 -- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f78300b4450 msgr2=0x7f78300b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7835200640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f78300b4450 0x7f78300b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7835200640 1 -- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f783006bbb0 msgr2=0x7f783006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7835200640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f783006bbb0 0x7f783006c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7835200640 1 -- 172.21.15.59:0/932019604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78300b57b0 con 0x7f7818004d50 2024-05-30T16:49:09.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7835c00640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f783006bbb0 0x7f783006c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:09.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7835200640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7818004d50 0x7f783014d200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f78240119d0 tx=0x7f7824011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:09.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f782cc00640 1 -- 172.21.15.59:0/932019604 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782400fb50 con 0x7f7818004d50 2024-05-30T16:49:09.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f782cc00640 1 -- 172.21.15.59:0/932019604 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782400fcf0 con 0x7f7818004d50 2024-05-30T16:49:09.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f782cc00640 1 -- 172.21.15.59:0/932019604 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782400fea0 con 0x7f7818004d50 2024-05-30T16:49:09.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7837c00640 1 -- 172.21.15.59:0/932019604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78300b4f10 con 0x7f7818004d50 2024-05-30T16:49:09.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7837c00640 1 -- 172.21.15.59:0/932019604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78300b54d0 con 0x7f7818004d50 2024-05-30T16:49:09.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.626+0000 7f7837c00640 1 -- 172.21.15.59:0/932019604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7830068a90 con 0x7f7818004d50 2024-05-30T16:49:09.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.630+0000 7f782cc00640 1 -- 172.21.15.59:0/932019604 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7824012040 con 0x7f7818004d50 2024-05-30T16:49:09.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.630+0000 7f782cc00640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7810068380 0x7f781006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:09.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.630+0000 7f782cc00640 1 -- 172.21.15.59:0/932019604 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7824086f70 con 0x7f7818004d50 2024-05-30T16:49:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.630+0000 7f782fe00640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7810068380 0x7f781006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.630+0000 7f782fe00640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7810068380 0x7f781006a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f781c001c70 tx=0x7f781c001e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.634+0000 7f782cc00640 1 -- 172.21.15.59:0/932019604 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7824019030 con 0x7f7818004d50 2024-05-30T16:49:09.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.854+0000 7f7837c00640 1 -- 172.21.15.59:0/932019604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f78300d0690 con 0x7f7818004d50 2024-05-30T16:49:09.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.854+0000 7f782cc00640 1 -- 172.21.15.59:0/932019604 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1011 (secure 0 0 0) 0x7f78240575e0 con 0x7f7818004d50 2024-05-30T16:49:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:09.862 INFO:teuthology.orchestra.run.smithi059.stdout:{"fsid":"97857630-028c-48a2-897f-bf5f996be133","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1717087732,"num_in_osds":8,"osd_in_since":1717087722,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224456704,"bytes_avail":772869656576,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4294}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-30T16:48:40.035873+0000","services":{}},"progress_events":{}} 2024-05-30T16:49:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.858+0000 7f7837c00640 1 -- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7810068380 msgr2=0x7f781006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.858+0000 7f7837c00640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7810068380 0x7f781006a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f781c001c70 tx=0x7f781c001e50 comp rx=0 tx=0).stop 2024-05-30T16:49:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.858+0000 7f7837c00640 1 -- 172.21.15.59:0/932019604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7818004d50 msgr2=0x7f783014d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.858+0000 7f7837c00640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7818004d50 0x7f783014d200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f78240119d0 tx=0x7f7824011e90 comp rx=0 tx=0).stop 2024-05-30T16:49:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.858+0000 7f7837c00640 1 -- 172.21.15.59:0/932019604 shutdown_connections 2024-05-30T16:49:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.858+0000 7f7837c00640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7810068380 0x7f781006a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.858+0000 7f7837c00640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f783006bbb0 0x7f783006c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.858+0000 7f7837c00640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f78300b4450 0x7f78300b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.858+0000 7f7837c00640 1 --2- 172.21.15.59:0/932019604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7818004d50 0x7f783014d200 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.858+0000 7f7837c00640 1 -- 172.21.15.59:0/932019604 >> 172.21.15.59:0/932019604 conn(0x7f78300b6870 msgr2=0x7f783006eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.858+0000 7f7837c00640 1 -- 172.21.15.59:0/932019604 shutdown_connections 2024-05-30T16:49:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:09.858+0000 7f7837c00640 1 -- 172.21.15.59:0/932019604 wait complete. 2024-05-30T16:49:09.883 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-30T16:49:09.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:49:10.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f79a5c00640 1 Processor -- start 2024-05-30T16:49:10.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f79a5c00640 1 -- start start 2024-05-30T16:49:10.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f79a5c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79a00d14c0 0x7f79a006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:10.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f79a5c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79a00d05b0 0x7f79a009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:10.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f79a5c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a006ea20 con 0x7f79a009af80 2024-05-30T16:49:10.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f79a5c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f79a009b3f0 con 0x7f79a00d05b0 2024-05-30T16:49:10.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f79a5c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f79a0070950 con 0x7f79a00d14c0 2024-05-30T16:49:10.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f7996000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79a00d05b0 0x7f79a009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:10.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f799f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f79a009af80 0x7f79a0162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58122/0 (socket says 172.21.15.59:58122) 2024-05-30T16:49:10.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f799f400640 1 -- 172.21.15.59:0/3496798185 learned_addr learned my addr 172.21.15.59:0/3496798185 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:10.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f799ea00640 1 --2- 172.21.15.59:0/3496798185 >> v2:172.21.15.107:3300/0 conn(0x7f79a00d14c0 0x7f79a006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:10.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f7996000640 1 -- 172.21.15.59:0/3496798185 >> v2:172.21.15.107:3300/0 conn(0x7f79a00d14c0 msgr2=0x7f79a006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:10.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f7996000640 1 --2- 172.21.15.59:0/3496798185 >> v2:172.21.15.107:3300/0 conn(0x7f79a00d14c0 0x7f79a006e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:10.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f7996000640 1 -- 172.21.15.59:0/3496798185 >> v1:172.21.15.59:6789/0 conn(0x7f79a009af80 legacy=0x7f79a0162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:10.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.018+0000 7f7996000640 1 -- 172.21.15.59:0/3496798185 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a0070c30 con 0x7f79a00d05b0 2024-05-30T16:49:10.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.022+0000 7f7996000640 1 --2- 172.21.15.59:0/3496798185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a00d05b0 0x7f79a009aa40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f79a00735d0 tx=0x7f798801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3be60a66082bb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.022+0000 7f799e000640 1 -- 172.21.15.59:0/3496798185 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79880b0070 con 0x7f79a00d05b0 2024-05-30T16:49:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.022+0000 7f799e000640 1 -- 172.21.15.59:0/3496798185 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79880ab600 con 0x7f79a00d05b0 2024-05-30T16:49:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.022+0000 7f799e000640 1 -- 172.21.15.59:0/3496798185 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79880ab9d0 con 0x7f79a00d05b0 2024-05-30T16:49:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.022+0000 7f79a5c00640 1 -- 172.21.15.59:0/3496798185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a00d05b0 msgr2=0x7f79a009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.022+0000 7f79a5c00640 1 --2- 172.21.15.59:0/3496798185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a00d05b0 0x7f79a009aa40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f79a00735d0 tx=0x7f798801c450 comp rx=0 tx=0).stop 2024-05-30T16:49:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.022+0000 7f79a5c00640 1 -- 172.21.15.59:0/3496798185 shutdown_connections 2024-05-30T16:49:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.022+0000 7f79a5c00640 1 --2- 172.21.15.59:0/3496798185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a00d05b0 0x7f79a009aa40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.022+0000 7f79a5c00640 1 --2- 172.21.15.59:0/3496798185 >> v2:172.21.15.107:3300/0 conn(0x7f79a00d14c0 0x7f79a006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.022+0000 7f79a5c00640 1 -- 172.21.15.59:0/3496798185 >> 172.21.15.59:0/3496798185 conn(0x7f79a00b3f80 msgr2=0x7f79a00b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.022+0000 7f79a5c00640 1 -- 172.21.15.59:0/3496798185 shutdown_connections 2024-05-30T16:49:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.022+0000 7f79a5c00640 1 -- 172.21.15.59:0/3496798185 wait complete. 2024-05-30T16:49:10.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f79a5c00640 1 Processor -- start 2024-05-30T16:49:10.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f79a5c00640 1 -- start start 2024-05-30T16:49:10.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f79a5c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a009af80 0x7f79a0146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:10.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f79a5c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a00d05b0 0x7f79a00af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:10.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f79a5c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a00d14c0 0x7f79a0154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:10.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f79a5c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f79a00d18a0 con 0x7f79a00d14c0 2024-05-30T16:49:10.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f79a5c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f79a00d0a60 con 0x7f79a009af80 2024-05-30T16:49:10.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f79a5c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f79a006e100 con 0x7f79a00d05b0 2024-05-30T16:49:10.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f799f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a00d14c0 0x7f79a0154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:10.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f799f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a00d14c0 0x7f79a0154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43854/0 (socket says 172.21.15.59:43854) 2024-05-30T16:49:10.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f799f400640 1 -- 172.21.15.59:0/4211465488 learned_addr learned my addr 172.21.15.59:0/4211465488 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:10.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f7996000640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a00d05b0 0x7f79a00af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:10.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f799ea00640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a009af80 0x7f79a0146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:10.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f799f400640 1 -- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a00d05b0 msgr2=0x7f79a00af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:10.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f799f400640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a00d05b0 0x7f79a00af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:10.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f799f400640 1 -- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a009af80 msgr2=0x7f79a0146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:10.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f799f400640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a009af80 0x7f79a0146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:10.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f799f400640 1 -- 172.21.15.59:0/4211465488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a0146ca0 con 0x7f79a00d14c0 2024-05-30T16:49:10.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f799ea00640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a009af80 0x7f79a0146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:10.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f799f400640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a00d14c0 0x7f79a0154730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f799800cbc0 tx=0x7f799800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:10.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f7997400640 1 -- 172.21.15.59:0/4211465488 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7998017070 con 0x7f79a00d14c0 2024-05-30T16:49:10.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f7997400640 1 -- 172.21.15.59:0/4211465488 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799800ad40 con 0x7f79a00d14c0 2024-05-30T16:49:10.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f7997400640 1 -- 172.21.15.59:0/4211465488 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7998012600 con 0x7f79a00d14c0 2024-05-30T16:49:10.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f79a5c00640 1 -- 172.21.15.59:0/4211465488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a00afb50 con 0x7f79a00d14c0 2024-05-30T16:49:10.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.026+0000 7f79a5c00640 1 -- 172.21.15.59:0/4211465488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a00b0110 con 0x7f79a00d14c0 2024-05-30T16:49:10.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.030+0000 7f79a5c00640 1 -- 172.21.15.59:0/4211465488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a0068a90 con 0x7f79a00d14c0 2024-05-30T16:49:10.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.030+0000 7f7997400640 1 -- 172.21.15.59:0/4211465488 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f799801a070 con 0x7f79a00d14c0 2024-05-30T16:49:10.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.030+0000 7f7997400640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f797c0683b0 0x7f797c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:10.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.030+0000 7f7997400640 1 -- 172.21.15.59:0/4211465488 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7998086680 con 0x7f79a00d14c0 2024-05-30T16:49:10.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.030+0000 7f799ea00640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f797c0683b0 0x7f797c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:10.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.030+0000 7f799ea00640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f797c0683b0 0x7f797c06a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7990009b10 tx=0x7f7990008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:10.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.034+0000 7f7997400640 1 -- 172.21.15.59:0/4211465488 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f79a006ea20 con 0x7f79a00d14c0 2024-05-30T16:49:10.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.198+0000 7f79a5c00640 1 -- 172.21.15.59:0/4211465488 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79a0070730 con 0x7f797c0683b0 2024-05-30T16:49:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.202+0000 7f7997400640 1 -- 172.21.15.59:0/4211465488 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f79a0070730 con 0x7f797c0683b0 2024-05-30T16:49:10.211 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:10.213 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:49:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.206+0000 7f79a5c00640 1 -- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f797c0683b0 msgr2=0x7f797c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.206+0000 7f79a5c00640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f797c0683b0 0x7f797c06a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7990009b10 tx=0x7f7990008040 comp rx=0 tx=0).stop 2024-05-30T16:49:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.206+0000 7f79a5c00640 1 -- 172.21.15.59:0/4211465488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a00d14c0 msgr2=0x7f79a0154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.206+0000 7f79a5c00640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a00d14c0 0x7f79a0154730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f799800cbc0 tx=0x7f799800a430 comp rx=0 tx=0).stop 2024-05-30T16:49:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.206+0000 7f79a5c00640 1 -- 172.21.15.59:0/4211465488 shutdown_connections 2024-05-30T16:49:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.206+0000 7f79a5c00640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f797c0683b0 0x7f797c06a870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.206+0000 7f79a5c00640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a00d14c0 0x7f79a0154730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.206+0000 7f79a5c00640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a00d05b0 0x7f79a00af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.206+0000 7f79a5c00640 1 --2- 172.21.15.59:0/4211465488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a009af80 0x7f79a0146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.206+0000 7f79a5c00640 1 -- 172.21.15.59:0/4211465488 >> 172.21.15.59:0/4211465488 conn(0x7f79a00b3f80 msgr2=0x7f79a00cd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.206+0000 7f79a5c00640 1 -- 172.21.15.59:0/4211465488 shutdown_connections 2024-05-30T16:49:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:10.206+0000 7f79a5c00640 1 -- 172.21.15.59:0/4211465488 wait complete. 2024-05-30T16:49:10.232 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-30T16:49:09.075252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219196,"kb_used_data":3036,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755524,"statfs":{"total":773094113280,"available":772869656576,"internally_reserved":0,"allocated":3108864,"data_stored":1826896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001335"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052545+0000","last_change":"2024-05-30T16:49:04.545096+0000","last_active":"2024-05-30T16:49:06.052545+0000","last_peered":"2024-05-30T16:49:06.052545+0000","last_clean":"2024-05-30T16:49:06.052545+0000","last_became_active":"2024-05-30T16:49:04.544532+0000","last_became_peered":"2024-05-30T16:49:04.544532+0000","last_unstale":"2024-05-30T16:49:06.052545+0000","last_undegraded":"2024-05-30T16:49:06.052545+0000","last_fullsized":"2024-05-30T16:49:06.052545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:00.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053033+0000","last_change":"2024-05-30T16:49:04.538139+0000","last_active":"2024-05-30T16:49:06.053033+0000","last_peered":"2024-05-30T16:49:06.053033+0000","last_clean":"2024-05-30T16:49:06.053033+0000","last_became_active":"2024-05-30T16:49:04.537797+0000","last_became_peered":"2024-05-30T16:49:04.537797+0000","last_unstale":"2024-05-30T16:49:06.053033+0000","last_undegraded":"2024-05-30T16:49:06.053033+0000","last_fullsized":"2024-05-30T16:49:06.053033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051246+0000","last_change":"2024-05-30T16:49:04.542945+0000","last_active":"2024-05-30T16:49:06.051246+0000","last_peered":"2024-05-30T16:49:06.051246+0000","last_clean":"2024-05-30T16:49:06.051246+0000","last_became_active":"2024-05-30T16:49:04.542637+0000","last_became_peered":"2024-05-30T16:49:04.542637+0000","last_unstale":"2024-05-30T16:49:06.051246+0000","last_undegraded":"2024-05-30T16:49:06.051246+0000","last_fullsized":"2024-05-30T16:49:06.051246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:55:32.611131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533898+0000","last_change":"2024-05-30T16:49:04.556673+0000","last_active":"2024-05-30T16:49:05.533898+0000","last_peered":"2024-05-30T16:49:05.533898+0000","last_clean":"2024-05-30T16:49:05.533898+0000","last_became_active":"2024-05-30T16:49:04.556386+0000","last_became_peered":"2024-05-30T16:49:04.556386+0000","last_unstale":"2024-05-30T16:49:05.533898+0000","last_undegraded":"2024-05-30T16:49:05.533898+0000","last_fullsized":"2024-05-30T16:49:05.533898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:45.716674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052183+0000","last_change":"2024-05-30T16:49:04.552810+0000","last_active":"2024-05-30T16:49:06.052183+0000","last_peered":"2024-05-30T16:49:06.052183+0000","last_clean":"2024-05-30T16:49:06.052183+0000","last_became_active":"2024-05-30T16:49:04.552478+0000","last_became_peered":"2024-05-30T16:49:04.552478+0000","last_unstale":"2024-05-30T16:49:06.052183+0000","last_undegraded":"2024-05-30T16:49:06.052183+0000","last_fullsized":"2024-05-30T16:49:06.052183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:17:37.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534174+0000","last_change":"2024-05-30T16:49:04.546420+0000","last_active":"2024-05-30T16:49:05.534174+0000","last_peered":"2024-05-30T16:49:05.534174+0000","last_clean":"2024-05-30T16:49:05.534174+0000","last_became_active":"2024-05-30T16:49:04.545288+0000","last_became_peered":"2024-05-30T16:49:04.545288+0000","last_unstale":"2024-05-30T16:49:05.534174+0000","last_undegraded":"2024-05-30T16:49:05.534174+0000","last_fullsized":"2024-05-30T16:49:05.534174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:17:37.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051955+0000","last_change":"2024-05-30T16:49:04.542431+0000","last_active":"2024-05-30T16:49:06.051955+0000","last_peered":"2024-05-30T16:49:06.051955+0000","last_clean":"2024-05-30T16:49:06.051955+0000","last_became_active":"2024-05-30T16:49:04.541958+0000","last_became_peered":"2024-05-30T16:49:04.541958+0000","last_unstale":"2024-05-30T16:49:06.051955+0000","last_undegraded":"2024-05-30T16:49:06.051955+0000","last_fullsized":"2024-05-30T16:49:06.051955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:41.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.050859+0000","last_change":"2024-05-30T16:49:04.546221+0000","last_active":"2024-05-30T16:49:06.050859+0000","last_peered":"2024-05-30T16:49:06.050859+0000","last_clean":"2024-05-30T16:49:06.050859+0000","last_became_active":"2024-05-30T16:49:04.545933+0000","last_became_peered":"2024-05-30T16:49:04.545933+0000","last_unstale":"2024-05-30T16:49:06.050859+0000","last_undegraded":"2024-05-30T16:49:06.050859+0000","last_fullsized":"2024-05-30T16:49:06.050859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:21.914079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052633+0000","last_change":"2024-05-30T16:49:04.554508+0000","last_active":"2024-05-30T16:49:06.052633+0000","last_peered":"2024-05-30T16:49:06.052633+0000","last_clean":"2024-05-30T16:49:06.052633+0000","last_became_active":"2024-05-30T16:49:04.553966+0000","last_became_peered":"2024-05-30T16:49:04.553966+0000","last_unstale":"2024-05-30T16:49:06.052633+0000","last_undegraded":"2024-05-30T16:49:06.052633+0000","last_fullsized":"2024-05-30T16:49:06.052633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:47:24.068734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053243+0000","last_change":"2024-05-30T16:49:04.553475+0000","last_active":"2024-05-30T16:49:06.053243+0000","last_peered":"2024-05-30T16:49:06.053243+0000","last_clean":"2024-05-30T16:49:06.053243+0000","last_became_active":"2024-05-30T16:49:04.552962+0000","last_became_peered":"2024-05-30T16:49:04.552962+0000","last_unstale":"2024-05-30T16:49:06.053243+0000","last_undegraded":"2024-05-30T16:49:06.053243+0000","last_fullsized":"2024-05-30T16:49:06.053243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053178+0000","last_change":"2024-05-30T16:49:04.554233+0000","last_active":"2024-05-30T16:49:06.053178+0000","last_peered":"2024-05-30T16:49:06.053178+0000","last_clean":"2024-05-30T16:49:06.053178+0000","last_became_active":"2024-05-30T16:49:04.553934+0000","last_became_peered":"2024-05-30T16:49:04.553934+0000","last_unstale":"2024-05-30T16:49:06.053178+0000","last_undegraded":"2024-05-30T16:49:06.053178+0000","last_fullsized":"2024-05-30T16:49:06.053178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534485+0000","last_change":"2024-05-30T16:49:04.548278+0000","last_active":"2024-05-30T16:49:05.534485+0000","last_peered":"2024-05-30T16:49:05.534485+0000","last_clean":"2024-05-30T16:49:05.534485+0000","last_became_active":"2024-05-30T16:49:04.547736+0000","last_became_peered":"2024-05-30T16:49:04.547736+0000","last_unstale":"2024-05-30T16:49:05.534485+0000","last_undegraded":"2024-05-30T16:49:05.534485+0000","last_fullsized":"2024-05-30T16:49:05.534485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:02.310302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051507+0000","last_change":"2024-05-30T16:49:04.541147+0000","last_active":"2024-05-30T16:49:06.051507+0000","last_peered":"2024-05-30T16:49:06.051507+0000","last_clean":"2024-05-30T16:49:06.051507+0000","last_became_active":"2024-05-30T16:49:04.540873+0000","last_became_peered":"2024-05-30T16:49:04.540873+0000","last_unstale":"2024-05-30T16:49:06.051507+0000","last_undegraded":"2024-05-30T16:49:06.051507+0000","last_fullsized":"2024-05-30T16:49:06.051507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:31:53.336085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051066+0000","last_change":"2024-05-30T16:49:04.540239+0000","last_active":"2024-05-30T16:49:06.051066+0000","last_peered":"2024-05-30T16:49:06.051066+0000","last_clean":"2024-05-30T16:49:06.051066+0000","last_became_active":"2024-05-30T16:49:04.539685+0000","last_became_peered":"2024-05-30T16:49:04.539685+0000","last_unstale":"2024-05-30T16:49:06.051066+0000","last_undegraded":"2024-05-30T16:49:06.051066+0000","last_fullsized":"2024-05-30T16:49:06.051066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:59.153304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052714+0000","last_change":"2024-05-30T16:49:04.548766+0000","last_active":"2024-05-30T16:49:06.052714+0000","last_peered":"2024-05-30T16:49:06.052714+0000","last_clean":"2024-05-30T16:49:06.052714+0000","last_became_active":"2024-05-30T16:49:04.548490+0000","last_became_peered":"2024-05-30T16:49:04.548490+0000","last_unstale":"2024-05-30T16:49:06.052714+0000","last_undegraded":"2024-05-30T16:49:06.052714+0000","last_fullsized":"2024-05-30T16:49:06.052714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.532984+0000","last_change":"2024-05-30T16:49:04.542268+0000","last_active":"2024-05-30T16:49:05.532984+0000","last_peered":"2024-05-30T16:49:05.532984+0000","last_clean":"2024-05-30T16:49:05.532984+0000","last_became_active":"2024-05-30T16:49:04.541992+0000","last_became_peered":"2024-05-30T16:49:04.541992+0000","last_unstale":"2024-05-30T16:49:05.532984+0000","last_undegraded":"2024-05-30T16:49:05.532984+0000","last_fullsized":"2024-05-30T16:49:05.532984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534099+0000","last_change":"2024-05-30T16:49:04.550221+0000","last_active":"2024-05-30T16:49:05.534099+0000","last_peered":"2024-05-30T16:49:05.534099+0000","last_clean":"2024-05-30T16:49:05.534099+0000","last_became_active":"2024-05-30T16:49:04.549914+0000","last_became_peered":"2024-05-30T16:49:04.549914+0000","last_unstale":"2024-05-30T16:49:05.534099+0000","last_undegraded":"2024-05-30T16:49:05.534099+0000","last_fullsized":"2024-05-30T16:49:05.534099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:41.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530293+0000","last_change":"2024-05-30T16:49:04.551149+0000","last_active":"2024-05-30T16:49:05.530293+0000","last_peered":"2024-05-30T16:49:05.530293+0000","last_clean":"2024-05-30T16:49:05.530293+0000","last_became_active":"2024-05-30T16:49:04.543927+0000","last_became_peered":"2024-05-30T16:49:04.543927+0000","last_unstale":"2024-05-30T16:49:05.530293+0000","last_undegraded":"2024-05-30T16:49:05.530293+0000","last_fullsized":"2024-05-30T16:49:05.530293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:19.326134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052813+0000","last_change":"2024-05-30T16:49:04.536971+0000","last_active":"2024-05-30T16:49:06.052813+0000","last_peered":"2024-05-30T16:49:06.052813+0000","last_clean":"2024-05-30T16:49:06.052813+0000","last_became_active":"2024-05-30T16:49:04.536697+0000","last_became_peered":"2024-05-30T16:49:04.536697+0000","last_unstale":"2024-05-30T16:49:06.052813+0000","last_undegraded":"2024-05-30T16:49:06.052813+0000","last_fullsized":"2024-05-30T16:49:06.052813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:07.305667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052893+0000","last_change":"2024-05-30T16:49:04.554920+0000","last_active":"2024-05-30T16:49:06.052893+0000","last_peered":"2024-05-30T16:49:06.052893+0000","last_clean":"2024-05-30T16:49:06.052893+0000","last_became_active":"2024-05-30T16:49:04.554629+0000","last_became_peered":"2024-05-30T16:49:04.554629+0000","last_unstale":"2024-05-30T16:49:06.052893+0000","last_undegraded":"2024-05-30T16:49:06.052893+0000","last_fullsized":"2024-05-30T16:49:06.052893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051215+0000","last_change":"2024-05-30T16:49:04.546642+0000","last_active":"2024-05-30T16:49:06.051215+0000","last_peered":"2024-05-30T16:49:06.051215+0000","last_clean":"2024-05-30T16:49:06.051215+0000","last_became_active":"2024-05-30T16:49:04.546003+0000","last_became_peered":"2024-05-30T16:49:04.546003+0000","last_unstale":"2024-05-30T16:49:06.051215+0000","last_undegraded":"2024-05-30T16:49:06.051215+0000","last_fullsized":"2024-05-30T16:49:06.051215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:34:33.807678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534275+0000","last_change":"2024-05-30T16:49:04.549251+0000","last_active":"2024-05-30T16:49:05.534275+0000","last_peered":"2024-05-30T16:49:05.534275+0000","last_clean":"2024-05-30T16:49:05.534275+0000","last_became_active":"2024-05-30T16:49:04.548946+0000","last_became_peered":"2024-05-30T16:49:04.548946+0000","last_unstale":"2024-05-30T16:49:05.534275+0000","last_undegraded":"2024-05-30T16:49:05.534275+0000","last_fullsized":"2024-05-30T16:49:05.534275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:53:12.385144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051209+0000","last_change":"2024-05-30T16:49:04.554673+0000","last_active":"2024-05-30T16:49:06.051209+0000","last_peered":"2024-05-30T16:49:06.051209+0000","last_clean":"2024-05-30T16:49:06.051209+0000","last_became_active":"2024-05-30T16:49:04.552406+0000","last_became_peered":"2024-05-30T16:49:04.552406+0000","last_unstale":"2024-05-30T16:49:06.051209+0000","last_undegraded":"2024-05-30T16:49:06.051209+0000","last_fullsized":"2024-05-30T16:49:06.051209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:32:11.592244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534589+0000","last_change":"2024-05-30T16:49:04.539930+0000","last_active":"2024-05-30T16:49:05.534589+0000","last_peered":"2024-05-30T16:49:05.534589+0000","last_clean":"2024-05-30T16:49:05.534589+0000","last_became_active":"2024-05-30T16:49:04.538018+0000","last_became_peered":"2024-05-30T16:49:04.538018+0000","last_unstale":"2024-05-30T16:49:05.534589+0000","last_undegraded":"2024-05-30T16:49:05.534589+0000","last_fullsized":"2024-05-30T16:49:05.534589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052036+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.052036+0000","last_peered":"2024-05-30T16:49:06.052036+0000","last_clean":"2024-05-30T16:49:06.052036+0000","last_became_active":"2024-05-30T16:49:04.556321+0000","last_became_peered":"2024-05-30T16:49:04.556321+0000","last_unstale":"2024-05-30T16:49:06.052036+0000","last_undegraded":"2024-05-30T16:49:06.052036+0000","last_fullsized":"2024-05-30T16:49:06.052036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:44:48.125700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053240+0000","last_change":"2024-05-30T16:49:04.544556+0000","last_active":"2024-05-30T16:49:06.053240+0000","last_peered":"2024-05-30T16:49:06.053240+0000","last_clean":"2024-05-30T16:49:06.053240+0000","last_became_active":"2024-05-30T16:49:04.543181+0000","last_became_peered":"2024-05-30T16:49:04.543181+0000","last_unstale":"2024-05-30T16:49:06.053240+0000","last_undegraded":"2024-05-30T16:49:06.053240+0000","last_fullsized":"2024-05-30T16:49:06.053240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052887+0000","last_change":"2024-05-30T16:49:04.540083+0000","last_active":"2024-05-30T16:49:06.052887+0000","last_peered":"2024-05-30T16:49:06.052887+0000","last_clean":"2024-05-30T16:49:06.052887+0000","last_became_active":"2024-05-30T16:49:04.539760+0000","last_became_peered":"2024-05-30T16:49:04.539760+0000","last_unstale":"2024-05-30T16:49:06.052887+0000","last_undegraded":"2024-05-30T16:49:06.052887+0000","last_fullsized":"2024-05-30T16:49:06.052887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051647+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.051647+0000","last_peered":"2024-05-30T16:49:06.051647+0000","last_clean":"2024-05-30T16:49:06.051647+0000","last_became_active":"2024-05-30T16:49:04.556297+0000","last_became_peered":"2024-05-30T16:49:04.556297+0000","last_unstale":"2024-05-30T16:49:06.051647+0000","last_undegraded":"2024-05-30T16:49:06.051647+0000","last_fullsized":"2024-05-30T16:49:06.051647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:14:09.241699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051361+0000","last_change":"2024-05-30T16:49:04.546093+0000","last_active":"2024-05-30T16:49:06.051361+0000","last_peered":"2024-05-30T16:49:06.051361+0000","last_clean":"2024-05-30T16:49:06.051361+0000","last_became_active":"2024-05-30T16:49:04.545623+0000","last_became_peered":"2024-05-30T16:49:04.545623+0000","last_unstale":"2024-05-30T16:49:06.051361+0000","last_undegraded":"2024-05-30T16:49:06.051361+0000","last_fullsized":"2024-05-30T16:49:06.051361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:38.640365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534360+0000","last_change":"2024-05-30T16:49:04.558192+0000","last_active":"2024-05-30T16:49:05.534360+0000","last_peered":"2024-05-30T16:49:05.534360+0000","last_clean":"2024-05-30T16:49:05.534360+0000","last_became_active":"2024-05-30T16:49:04.557826+0000","last_became_peered":"2024-05-30T16:49:04.557826+0000","last_unstale":"2024-05-30T16:49:05.534360+0000","last_undegraded":"2024-05-30T16:49:05.534360+0000","last_fullsized":"2024-05-30T16:49:05.534360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:59.487481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530068+0000","last_change":"2024-05-30T16:49:04.539369+0000","last_active":"2024-05-30T16:49:05.530068+0000","last_peered":"2024-05-30T16:49:05.530068+0000","last_clean":"2024-05-30T16:49:05.530068+0000","last_became_active":"2024-05-30T16:49:04.538899+0000","last_became_peered":"2024-05-30T16:49:04.538899+0000","last_unstale":"2024-05-30T16:49:05.530068+0000","last_undegraded":"2024-05-30T16:49:05.530068+0000","last_fullsized":"2024-05-30T16:49:05.530068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:39.816197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052013+0000","last_change":"2024-05-30T16:49:04.549536+0000","last_active":"2024-05-30T16:49:06.052013+0000","last_peered":"2024-05-30T16:49:06.052013+0000","last_clean":"2024-05-30T16:49:06.052013+0000","last_became_active":"2024-05-30T16:49:04.546653+0000","last_became_peered":"2024-05-30T16:49:04.546653+0000","last_unstale":"2024-05-30T16:49:06.052013+0000","last_undegraded":"2024-05-30T16:49:06.052013+0000","last_fullsized":"2024-05-30T16:49:06.052013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:38.640365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533225+0000","last_change":"2024-05-30T16:49:04.558267+0000","last_active":"2024-05-30T16:49:05.533225+0000","last_peered":"2024-05-30T16:49:05.533225+0000","last_clean":"2024-05-30T16:49:05.533225+0000","last_became_active":"2024-05-30T16:49:04.558000+0000","last_became_peered":"2024-05-30T16:49:04.558000+0000","last_unstale":"2024-05-30T16:49:05.533225+0000","last_undegraded":"2024-05-30T16:49:05.533225+0000","last_fullsized":"2024-05-30T16:49:05.533225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:11.469445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051650+0000","last_change":"2024-05-30T16:49:03.546643+0000","last_active":"2024-05-30T16:49:06.051650+0000","last_peered":"2024-05-30T16:49:06.051650+0000","last_clean":"2024-05-30T16:49:06.051650+0000","last_became_active":"2024-05-30T16:49:03.546381+0000","last_became_peered":"2024-05-30T16:49:03.546381+0000","last_unstale":"2024-05-30T16:49:06.051650+0000","last_undegraded":"2024-05-30T16:49:06.051650+0000","last_fullsized":"2024-05-30T16:49:06.051650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:44.078644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051517+0000","last_change":"2024-05-30T16:49:04.549134+0000","last_active":"2024-05-30T16:49:06.051517+0000","last_peered":"2024-05-30T16:49:06.051517+0000","last_clean":"2024-05-30T16:49:06.051517+0000","last_became_active":"2024-05-30T16:49:04.548780+0000","last_became_peered":"2024-05-30T16:49:04.548780+0000","last_unstale":"2024-05-30T16:49:06.051517+0000","last_undegraded":"2024-05-30T16:49:06.051517+0000","last_fullsized":"2024-05-30T16:49:06.051517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052899+0000","last_change":"2024-05-30T16:49:03.542612+0000","last_active":"2024-05-30T16:49:06.052899+0000","last_peered":"2024-05-30T16:49:06.052899+0000","last_clean":"2024-05-30T16:49:06.052899+0000","last_became_active":"2024-05-30T16:49:03.541360+0000","last_became_peered":"2024-05-30T16:49:03.541360+0000","last_unstale":"2024-05-30T16:49:06.052899+0000","last_undegraded":"2024-05-30T16:49:06.052899+0000","last_fullsized":"2024-05-30T16:49:06.052899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051315+0000","last_change":"2024-05-30T16:49:03.538756+0000","last_active":"2024-05-30T16:49:06.051315+0000","last_peered":"2024-05-30T16:49:06.051315+0000","last_clean":"2024-05-30T16:49:06.051315+0000","last_became_active":"2024-05-30T16:49:03.538053+0000","last_became_peered":"2024-05-30T16:49:03.538053+0000","last_unstale":"2024-05-30T16:49:06.051315+0000","last_undegraded":"2024-05-30T16:49:06.051315+0000","last_fullsized":"2024-05-30T16:49:06.051315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:07.264297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051433+0000","last_change":"2024-05-30T16:49:04.546048+0000","last_active":"2024-05-30T16:49:06.051433+0000","last_peered":"2024-05-30T16:49:06.051433+0000","last_clean":"2024-05-30T16:49:06.051433+0000","last_became_active":"2024-05-30T16:49:04.545151+0000","last_became_peered":"2024-05-30T16:49:04.545151+0000","last_unstale":"2024-05-30T16:49:06.051433+0000","last_undegraded":"2024-05-30T16:49:06.051433+0000","last_fullsized":"2024-05-30T16:49:06.051433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:07.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533718+0000","last_change":"2024-05-30T16:49:03.529039+0000","last_active":"2024-05-30T16:49:05.533718+0000","last_peered":"2024-05-30T16:49:05.533718+0000","last_clean":"2024-05-30T16:49:05.533718+0000","last_became_active":"2024-05-30T16:49:03.527042+0000","last_became_peered":"2024-05-30T16:49:03.527042+0000","last_unstale":"2024-05-30T16:49:05.533718+0000","last_undegraded":"2024-05-30T16:49:05.533718+0000","last_fullsized":"2024-05-30T16:49:05.533718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052719+0000","last_change":"2024-05-30T16:49:04.540411+0000","last_active":"2024-05-30T16:49:06.052719+0000","last_peered":"2024-05-30T16:49:06.052719+0000","last_clean":"2024-05-30T16:49:06.052719+0000","last_became_active":"2024-05-30T16:49:04.540089+0000","last_became_peered":"2024-05-30T16:49:04.540089+0000","last_unstale":"2024-05-30T16:49:06.052719+0000","last_undegraded":"2024-05-30T16:49:06.052719+0000","last_fullsized":"2024-05-30T16:49:06.052719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053224+0000","last_change":"2024-05-30T16:49:03.542933+0000","last_active":"2024-05-30T16:49:06.053224+0000","last_peered":"2024-05-30T16:49:06.053224+0000","last_clean":"2024-05-30T16:49:06.053224+0000","last_became_active":"2024-05-30T16:49:03.541460+0000","last_became_peered":"2024-05-30T16:49:03.541460+0000","last_unstale":"2024-05-30T16:49:06.053224+0000","last_undegraded":"2024-05-30T16:49:06.053224+0000","last_fullsized":"2024-05-30T16:49:06.053224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533477+0000","last_change":"2024-05-30T16:49:04.549367+0000","last_active":"2024-05-30T16:49:05.533477+0000","last_peered":"2024-05-30T16:49:05.533477+0000","last_clean":"2024-05-30T16:49:05.533477+0000","last_became_active":"2024-05-30T16:49:04.548994+0000","last_became_peered":"2024-05-30T16:49:04.548994+0000","last_unstale":"2024-05-30T16:49:05.533477+0000","last_undegraded":"2024-05-30T16:49:05.533477+0000","last_fullsized":"2024-05-30T16:49:05.533477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533840+0000","last_change":"2024-05-30T16:49:03.540903+0000","last_active":"2024-05-30T16:49:05.533840+0000","last_peered":"2024-05-30T16:49:05.533840+0000","last_clean":"2024-05-30T16:49:05.533840+0000","last_became_active":"2024-05-30T16:49:03.540598+0000","last_became_peered":"2024-05-30T16:49:03.540598+0000","last_unstale":"2024-05-30T16:49:05.533840+0000","last_undegraded":"2024-05-30T16:49:05.533840+0000","last_fullsized":"2024-05-30T16:49:05.533840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:45.462713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051841+0000","last_change":"2024-05-30T16:49:04.542032+0000","last_active":"2024-05-30T16:49:06.051841+0000","last_peered":"2024-05-30T16:49:06.051841+0000","last_clean":"2024-05-30T16:49:06.051841+0000","last_became_active":"2024-05-30T16:49:04.541750+0000","last_became_peered":"2024-05-30T16:49:04.541750+0000","last_unstale":"2024-05-30T16:49:06.051841+0000","last_undegraded":"2024-05-30T16:49:06.051841+0000","last_fullsized":"2024-05-30T16:49:06.051841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052980+0000","last_change":"2024-05-30T16:49:03.537811+0000","last_active":"2024-05-30T16:49:06.052980+0000","last_peered":"2024-05-30T16:49:06.052980+0000","last_clean":"2024-05-30T16:49:06.052980+0000","last_became_active":"2024-05-30T16:49:03.537468+0000","last_became_peered":"2024-05-30T16:49:03.537468+0000","last_unstale":"2024-05-30T16:49:06.052980+0000","last_undegraded":"2024-05-30T16:49:06.052980+0000","last_fullsized":"2024-05-30T16:49:06.052980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534607+0000","last_change":"2024-05-30T16:49:04.548049+0000","last_active":"2024-05-30T16:49:05.534607+0000","last_peered":"2024-05-30T16:49:05.534607+0000","last_clean":"2024-05-30T16:49:05.534607+0000","last_became_active":"2024-05-30T16:49:04.547483+0000","last_became_peered":"2024-05-30T16:49:04.547483+0000","last_unstale":"2024-05-30T16:49:05.534607+0000","last_undegraded":"2024-05-30T16:49:05.534607+0000","last_fullsized":"2024-05-30T16:49:05.534607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:39.816197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053012+0000","last_change":"2024-05-30T16:49:03.542201+0000","last_active":"2024-05-30T16:49:06.053012+0000","last_peered":"2024-05-30T16:49:06.053012+0000","last_clean":"2024-05-30T16:49:06.053012+0000","last_became_active":"2024-05-30T16:49:03.541172+0000","last_became_peered":"2024-05-30T16:49:03.541172+0000","last_unstale":"2024-05-30T16:49:06.053012+0000","last_undegraded":"2024-05-30T16:49:06.053012+0000","last_fullsized":"2024-05-30T16:49:06.053012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:21:15.090452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052243+0000","last_change":"2024-05-30T16:49:04.540546+0000","last_active":"2024-05-30T16:49:06.052243+0000","last_peered":"2024-05-30T16:49:06.052243+0000","last_clean":"2024-05-30T16:49:06.052243+0000","last_became_active":"2024-05-30T16:49:04.539786+0000","last_became_peered":"2024-05-30T16:49:04.539786+0000","last_unstale":"2024-05-30T16:49:06.052243+0000","last_undegraded":"2024-05-30T16:49:06.052243+0000","last_fullsized":"2024-05-30T16:49:06.052243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:53:12.385144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051634+0000","last_change":"2024-05-30T16:49:03.542403+0000","last_active":"2024-05-30T16:49:06.051634+0000","last_peered":"2024-05-30T16:49:06.051634+0000","last_clean":"2024-05-30T16:49:06.051634+0000","last_became_active":"2024-05-30T16:49:03.535558+0000","last_became_peered":"2024-05-30T16:49:03.535558+0000","last_unstale":"2024-05-30T16:49:06.051634+0000","last_undegraded":"2024-05-30T16:49:06.051634+0000","last_fullsized":"2024-05-30T16:49:06.051634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:50:44.488767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051231+0000","last_change":"2024-05-30T16:49:04.543912+0000","last_active":"2024-05-30T16:49:06.051231+0000","last_peered":"2024-05-30T16:49:06.051231+0000","last_clean":"2024-05-30T16:49:06.051231+0000","last_became_active":"2024-05-30T16:49:04.543548+0000","last_became_peered":"2024-05-30T16:49:04.543548+0000","last_unstale":"2024-05-30T16:49:06.051231+0000","last_undegraded":"2024-05-30T16:49:06.051231+0000","last_fullsized":"2024-05-30T16:49:06.051231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:46.470731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534423+0000","last_change":"2024-05-30T16:49:03.533929+0000","last_active":"2024-05-30T16:49:05.534423+0000","last_peered":"2024-05-30T16:49:05.534423+0000","last_clean":"2024-05-30T16:49:05.534423+0000","last_became_active":"2024-05-30T16:49:03.533583+0000","last_became_peered":"2024-05-30T16:49:03.533583+0000","last_unstale":"2024-05-30T16:49:05.534423+0000","last_undegraded":"2024-05-30T16:49:05.534423+0000","last_fullsized":"2024-05-30T16:49:05.534423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052365+0000","last_change":"2024-05-30T16:49:04.550074+0000","last_active":"2024-05-30T16:49:06.052365+0000","last_peered":"2024-05-30T16:49:06.052365+0000","last_clean":"2024-05-30T16:49:06.052365+0000","last_became_active":"2024-05-30T16:49:04.549701+0000","last_became_peered":"2024-05-30T16:49:04.549701+0000","last_unstale":"2024-05-30T16:49:06.052365+0000","last_undegraded":"2024-05-30T16:49:06.052365+0000","last_fullsized":"2024-05-30T16:49:06.052365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:45:42.077957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052757+0000","last_change":"2024-05-30T16:49:03.533071+0000","last_active":"2024-05-30T16:49:06.052757+0000","last_peered":"2024-05-30T16:49:06.052757+0000","last_clean":"2024-05-30T16:49:06.052757+0000","last_became_active":"2024-05-30T16:49:03.532744+0000","last_became_peered":"2024-05-30T16:49:03.532744+0000","last_unstale":"2024-05-30T16:49:06.052757+0000","last_undegraded":"2024-05-30T16:49:06.052757+0000","last_fullsized":"2024-05-30T16:49:06.052757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:51:21.137153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052564+0000","last_change":"2024-05-30T16:49:04.546980+0000","last_active":"2024-05-30T16:49:06.052564+0000","last_peered":"2024-05-30T16:49:06.052564+0000","last_clean":"2024-05-30T16:49:06.052564+0000","last_became_active":"2024-05-30T16:49:04.546205+0000","last_became_peered":"2024-05-30T16:49:04.546205+0000","last_unstale":"2024-05-30T16:49:06.052564+0000","last_undegraded":"2024-05-30T16:49:06.052564+0000","last_fullsized":"2024-05-30T16:49:06.052564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.529988+0000","last_change":"2024-05-30T16:49:03.543445+0000","last_active":"2024-05-30T16:49:05.529988+0000","last_peered":"2024-05-30T16:49:05.529988+0000","last_clean":"2024-05-30T16:49:05.529988+0000","last_became_active":"2024-05-30T16:49:03.543068+0000","last_became_peered":"2024-05-30T16:49:03.543068+0000","last_unstale":"2024-05-30T16:49:05.529988+0000","last_undegraded":"2024-05-30T16:49:05.529988+0000","last_fullsized":"2024-05-30T16:49:05.529988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:51:21.137153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052327+0000","last_change":"2024-05-30T16:49:04.553768+0000","last_active":"2024-05-30T16:49:06.052327+0000","last_peered":"2024-05-30T16:49:06.052327+0000","last_clean":"2024-05-30T16:49:06.052327+0000","last_became_active":"2024-05-30T16:49:04.550850+0000","last_became_peered":"2024-05-30T16:49:04.550850+0000","last_unstale":"2024-05-30T16:49:06.052327+0000","last_undegraded":"2024-05-30T16:49:06.052327+0000","last_fullsized":"2024-05-30T16:49:06.052327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:55.007207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534287+0000","last_change":"2024-05-30T16:49:03.549177+0000","last_active":"2024-05-30T16:49:05.534287+0000","last_peered":"2024-05-30T16:49:05.534287+0000","last_clean":"2024-05-30T16:49:05.534287+0000","last_became_active":"2024-05-30T16:49:03.548803+0000","last_became_peered":"2024-05-30T16:49:03.548803+0000","last_unstale":"2024-05-30T16:49:05.534287+0000","last_undegraded":"2024-05-30T16:49:05.534287+0000","last_fullsized":"2024-05-30T16:49:05.534287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:28:50.120091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052450+0000","last_change":"2024-05-30T16:49:04.552000+0000","last_active":"2024-05-30T16:49:06.052450+0000","last_peered":"2024-05-30T16:49:06.052450+0000","last_clean":"2024-05-30T16:49:06.052450+0000","last_became_active":"2024-05-30T16:49:04.551392+0000","last_became_peered":"2024-05-30T16:49:04.551392+0000","last_unstale":"2024-05-30T16:49:06.052450+0000","last_undegraded":"2024-05-30T16:49:06.052450+0000","last_fullsized":"2024-05-30T16:49:06.052450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:59.487481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530211+0000","last_change":"2024-05-30T16:49:03.548846+0000","last_active":"2024-05-30T16:49:05.530211+0000","last_peered":"2024-05-30T16:49:05.530211+0000","last_clean":"2024-05-30T16:49:05.530211+0000","last_became_active":"2024-05-30T16:49:03.547182+0000","last_became_peered":"2024-05-30T16:49:03.547182+0000","last_unstale":"2024-05-30T16:49:05.530211+0000","last_undegraded":"2024-05-30T16:49:05.530211+0000","last_fullsized":"2024-05-30T16:49:05.530211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052721+0000","last_change":"2024-05-30T16:49:04.558273+0000","last_active":"2024-05-30T16:49:06.052721+0000","last_peered":"2024-05-30T16:49:06.052721+0000","last_clean":"2024-05-30T16:49:06.052721+0000","last_became_active":"2024-05-30T16:49:04.557860+0000","last_became_peered":"2024-05-30T16:49:04.557860+0000","last_unstale":"2024-05-30T16:49:06.052721+0000","last_undegraded":"2024-05-30T16:49:06.052721+0000","last_fullsized":"2024-05-30T16:49:06.052721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:20.040027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053015+0000","last_change":"2024-05-30T16:49:03.532399+0000","last_active":"2024-05-30T16:49:06.053015+0000","last_peered":"2024-05-30T16:49:06.053015+0000","last_clean":"2024-05-30T16:49:06.053015+0000","last_became_active":"2024-05-30T16:49:03.529396+0000","last_became_peered":"2024-05-30T16:49:03.529396+0000","last_unstale":"2024-05-30T16:49:06.053015+0000","last_undegraded":"2024-05-30T16:49:06.053015+0000","last_fullsized":"2024-05-30T16:49:06.053015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:18.318116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534179+0000","last_change":"2024-05-30T16:49:04.549628+0000","last_active":"2024-05-30T16:49:05.534179+0000","last_peered":"2024-05-30T16:49:05.534179+0000","last_clean":"2024-05-30T16:49:05.534179+0000","last_became_active":"2024-05-30T16:49:04.548782+0000","last_became_peered":"2024-05-30T16:49:04.548782+0000","last_unstale":"2024-05-30T16:49:05.534179+0000","last_undegraded":"2024-05-30T16:49:05.534179+0000","last_fullsized":"2024-05-30T16:49:05.534179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:55.007207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530197+0000","last_change":"2024-05-30T16:49:03.540089+0000","last_active":"2024-05-30T16:49:05.530197+0000","last_peered":"2024-05-30T16:49:05.530197+0000","last_clean":"2024-05-30T16:49:05.530197+0000","last_became_active":"2024-05-30T16:49:03.539760+0000","last_became_peered":"2024-05-30T16:49:03.539760+0000","last_unstale":"2024-05-30T16:49:05.530197+0000","last_undegraded":"2024-05-30T16:49:05.530197+0000","last_fullsized":"2024-05-30T16:49:05.530197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:21:15.090452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052910+0000","last_change":"2024-05-30T16:49:04.555284+0000","last_active":"2024-05-30T16:49:06.052910+0000","last_peered":"2024-05-30T16:49:06.052910+0000","last_clean":"2024-05-30T16:49:06.052910+0000","last_became_active":"2024-05-30T16:49:04.555022+0000","last_became_peered":"2024-05-30T16:49:04.555022+0000","last_unstale":"2024-05-30T16:49:06.052910+0000","last_undegraded":"2024-05-30T16:49:06.052910+0000","last_fullsized":"2024-05-30T16:49:06.052910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:42.707877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052217+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:49:06.052217+0000","last_peered":"2024-05-30T16:49:06.052217+0000","last_clean":"2024-05-30T16:49:06.052217+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:49:06.052217+0000","last_undegraded":"2024-05-30T16:49:06.052217+0000","last_fullsized":"2024-05-30T16:49:06.052217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533284+0000","last_change":"2024-05-30T16:49:03.536755+0000","last_active":"2024-05-30T16:49:05.533284+0000","last_peered":"2024-05-30T16:49:05.533284+0000","last_clean":"2024-05-30T16:49:05.533284+0000","last_became_active":"2024-05-30T16:49:03.536335+0000","last_became_peered":"2024-05-30T16:49:03.536335+0000","last_unstale":"2024-05-30T16:49:05.533284+0000","last_undegraded":"2024-05-30T16:49:05.533284+0000","last_fullsized":"2024-05-30T16:49:05.533284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051447+0000","last_change":"2024-05-30T16:49:04.546603+0000","last_active":"2024-05-30T16:49:06.051447+0000","last_peered":"2024-05-30T16:49:06.051447+0000","last_clean":"2024-05-30T16:49:06.051447+0000","last_became_active":"2024-05-30T16:49:04.545130+0000","last_became_peered":"2024-05-30T16:49:04.545130+0000","last_unstale":"2024-05-30T16:49:06.051447+0000","last_undegraded":"2024-05-30T16:49:06.051447+0000","last_fullsized":"2024-05-30T16:49:06.051447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:47.404454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052089+0000","last_change":"2024-05-30T16:49:03.548756+0000","last_active":"2024-05-30T16:49:06.052089+0000","last_peered":"2024-05-30T16:49:06.052089+0000","last_clean":"2024-05-30T16:49:06.052089+0000","last_became_active":"2024-05-30T16:49:03.548431+0000","last_became_peered":"2024-05-30T16:49:03.548431+0000","last_unstale":"2024-05-30T16:49:06.052089+0000","last_undegraded":"2024-05-30T16:49:06.052089+0000","last_fullsized":"2024-05-30T16:49:06.052089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051661+0000","last_change":"2024-05-30T16:49:04.557247+0000","last_active":"2024-05-30T16:49:06.051661+0000","last_peered":"2024-05-30T16:49:06.051661+0000","last_clean":"2024-05-30T16:49:06.051661+0000","last_became_active":"2024-05-30T16:49:04.556957+0000","last_became_peered":"2024-05-30T16:49:04.556957+0000","last_unstale":"2024-05-30T16:49:06.051661+0000","last_undegraded":"2024-05-30T16:49:06.051661+0000","last_fullsized":"2024-05-30T16:49:06.051661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530057+0000","last_change":"2024-05-30T16:49:03.548449+0000","last_active":"2024-05-30T16:49:05.530057+0000","last_peered":"2024-05-30T16:49:05.530057+0000","last_clean":"2024-05-30T16:49:05.530057+0000","last_became_active":"2024-05-30T16:49:03.547447+0000","last_became_peered":"2024-05-30T16:49:03.547447+0000","last_unstale":"2024-05-30T16:49:05.530057+0000","last_undegraded":"2024-05-30T16:49:05.530057+0000","last_fullsized":"2024-05-30T16:49:05.530057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:39:09.796452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052694+0000","last_change":"2024-05-30T16:49:04.535009+0000","last_active":"2024-05-30T16:49:06.052694+0000","last_peered":"2024-05-30T16:49:06.052694+0000","last_clean":"2024-05-30T16:49:06.052694+0000","last_became_active":"2024-05-30T16:49:04.534615+0000","last_became_peered":"2024-05-30T16:49:04.534615+0000","last_unstale":"2024-05-30T16:49:06.052694+0000","last_undegraded":"2024-05-30T16:49:06.052694+0000","last_fullsized":"2024-05-30T16:49:06.052694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534481+0000","last_change":"2024-05-30T16:49:03.526029+0000","last_active":"2024-05-30T16:49:05.534481+0000","last_peered":"2024-05-30T16:49:05.534481+0000","last_clean":"2024-05-30T16:49:05.534481+0000","last_became_active":"2024-05-30T16:49:03.525606+0000","last_became_peered":"2024-05-30T16:49:03.525606+0000","last_unstale":"2024-05-30T16:49:05.534481+0000","last_undegraded":"2024-05-30T16:49:05.534481+0000","last_fullsized":"2024-05-30T16:49:05.534481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533778+0000","last_change":"2024-05-30T16:49:04.553469+0000","last_active":"2024-05-30T16:49:05.533778+0000","last_peered":"2024-05-30T16:49:05.533778+0000","last_clean":"2024-05-30T16:49:05.533778+0000","last_became_active":"2024-05-30T16:49:04.551873+0000","last_became_peered":"2024-05-30T16:49:04.551873+0000","last_unstale":"2024-05-30T16:49:05.533778+0000","last_undegraded":"2024-05-30T16:49:05.533778+0000","last_fullsized":"2024-05-30T16:49:05.533778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:15.394210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052860+0000","last_change":"2024-05-30T16:49:03.537420+0000","last_active":"2024-05-30T16:49:06.052860+0000","last_peered":"2024-05-30T16:49:06.052860+0000","last_clean":"2024-05-30T16:49:06.052860+0000","last_became_active":"2024-05-30T16:49:03.536674+0000","last_became_peered":"2024-05-30T16:49:03.536674+0000","last_unstale":"2024-05-30T16:49:06.052860+0000","last_undegraded":"2024-05-30T16:49:06.052860+0000","last_fullsized":"2024-05-30T16:49:06.052860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534511+0000","last_change":"2024-05-30T16:49:04.557070+0000","last_active":"2024-05-30T16:49:05.534511+0000","last_peered":"2024-05-30T16:49:05.534511+0000","last_clean":"2024-05-30T16:49:05.534511+0000","last_became_active":"2024-05-30T16:49:04.556515+0000","last_became_peered":"2024-05-30T16:49:04.556515+0000","last_unstale":"2024-05-30T16:49:05.534511+0000","last_undegraded":"2024-05-30T16:49:05.534511+0000","last_fullsized":"2024-05-30T16:49:05.534511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:00.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052919+0000","last_change":"2024-05-30T16:49:03.551865+0000","last_active":"2024-05-30T16:49:06.052919+0000","last_peered":"2024-05-30T16:49:06.052919+0000","last_clean":"2024-05-30T16:49:06.052919+0000","last_became_active":"2024-05-30T16:49:03.551582+0000","last_became_peered":"2024-05-30T16:49:03.551582+0000","last_unstale":"2024-05-30T16:49:06.052919+0000","last_undegraded":"2024-05-30T16:49:06.052919+0000","last_fullsized":"2024-05-30T16:49:06.052919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:53:44.885507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052808+0000","last_change":"2024-05-30T16:49:04.537297+0000","last_active":"2024-05-30T16:49:06.052808+0000","last_peered":"2024-05-30T16:49:06.052808+0000","last_clean":"2024-05-30T16:49:06.052808+0000","last_became_active":"2024-05-30T16:49:04.535219+0000","last_became_peered":"2024-05-30T16:49:04.535219+0000","last_unstale":"2024-05-30T16:49:06.052808+0000","last_undegraded":"2024-05-30T16:49:06.052808+0000","last_fullsized":"2024-05-30T16:49:06.052808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053097+0000","last_change":"2024-05-30T16:49:03.534738+0000","last_active":"2024-05-30T16:49:06.053097+0000","last_peered":"2024-05-30T16:49:06.053097+0000","last_clean":"2024-05-30T16:49:06.053097+0000","last_became_active":"2024-05-30T16:49:03.534350+0000","last_became_peered":"2024-05-30T16:49:03.534350+0000","last_unstale":"2024-05-30T16:49:06.053097+0000","last_undegraded":"2024-05-30T16:49:06.053097+0000","last_fullsized":"2024-05-30T16:49:06.053097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052135+0000","last_change":"2024-05-30T16:49:04.544633+0000","last_active":"2024-05-30T16:49:06.052135+0000","last_peered":"2024-05-30T16:49:06.052135+0000","last_clean":"2024-05-30T16:49:06.052135+0000","last_became_active":"2024-05-30T16:49:04.544348+0000","last_became_peered":"2024-05-30T16:49:04.544348+0000","last_unstale":"2024-05-30T16:49:06.052135+0000","last_undegraded":"2024-05-30T16:49:06.052135+0000","last_fullsized":"2024-05-30T16:49:06.052135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:09.918803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053285+0000","last_change":"2024-05-30T16:49:03.547123+0000","last_active":"2024-05-30T16:49:06.053285+0000","last_peered":"2024-05-30T16:49:06.053285+0000","last_clean":"2024-05-30T16:49:06.053285+0000","last_became_active":"2024-05-30T16:49:03.546748+0000","last_became_peered":"2024-05-30T16:49:03.546748+0000","last_unstale":"2024-05-30T16:49:06.053285+0000","last_undegraded":"2024-05-30T16:49:06.053285+0000","last_fullsized":"2024-05-30T16:49:06.053285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051720+0000","last_change":"2024-05-30T16:49:04.536325+0000","last_active":"2024-05-30T16:49:06.051720+0000","last_peered":"2024-05-30T16:49:06.051720+0000","last_clean":"2024-05-30T16:49:06.051720+0000","last_became_active":"2024-05-30T16:49:04.535456+0000","last_became_peered":"2024-05-30T16:49:04.535456+0000","last_unstale":"2024-05-30T16:49:06.051720+0000","last_undegraded":"2024-05-30T16:49:06.051720+0000","last_fullsized":"2024-05-30T16:49:06.051720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051841+0000","last_change":"2024-05-30T16:49:03.551302+0000","last_active":"2024-05-30T16:49:06.051841+0000","last_peered":"2024-05-30T16:49:06.051841+0000","last_clean":"2024-05-30T16:49:06.051841+0000","last_became_active":"2024-05-30T16:49:03.551084+0000","last_became_peered":"2024-05-30T16:49:03.551084+0000","last_unstale":"2024-05-30T16:49:06.051841+0000","last_undegraded":"2024-05-30T16:49:06.051841+0000","last_fullsized":"2024-05-30T16:49:06.051841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533890+0000","last_change":"2024-05-30T16:49:04.548525+0000","last_active":"2024-05-30T16:49:05.533890+0000","last_peered":"2024-05-30T16:49:05.533890+0000","last_clean":"2024-05-30T16:49:05.533890+0000","last_became_active":"2024-05-30T16:49:04.548054+0000","last_became_peered":"2024-05-30T16:49:04.548054+0000","last_unstale":"2024-05-30T16:49:05.533890+0000","last_undegraded":"2024-05-30T16:49:05.533890+0000","last_fullsized":"2024-05-30T16:49:05.533890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:49.724960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052859+0000","last_change":"2024-05-30T16:49:03.546920+0000","last_active":"2024-05-30T16:49:06.052859+0000","last_peered":"2024-05-30T16:49:06.052859+0000","last_clean":"2024-05-30T16:49:06.052859+0000","last_became_active":"2024-05-30T16:49:03.545621+0000","last_became_peered":"2024-05-30T16:49:03.545621+0000","last_unstale":"2024-05-30T16:49:06.052859+0000","last_undegraded":"2024-05-30T16:49:06.052859+0000","last_fullsized":"2024-05-30T16:49:06.052859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051851+0000","last_change":"2024-05-30T16:49:04.535297+0000","last_active":"2024-05-30T16:49:06.051851+0000","last_peered":"2024-05-30T16:49:06.051851+0000","last_clean":"2024-05-30T16:49:06.051851+0000","last_became_active":"2024-05-30T16:49:04.534907+0000","last_became_peered":"2024-05-30T16:49:04.534907+0000","last_unstale":"2024-05-30T16:49:06.051851+0000","last_undegraded":"2024-05-30T16:49:06.051851+0000","last_fullsized":"2024-05-30T16:49:06.051851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:56.163039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052768+0000","last_change":"2024-05-30T16:49:03.536690+0000","last_active":"2024-05-30T16:49:06.052768+0000","last_peered":"2024-05-30T16:49:06.052768+0000","last_clean":"2024-05-30T16:49:06.052768+0000","last_became_active":"2024-05-30T16:49:03.536351+0000","last_became_peered":"2024-05-30T16:49:03.536351+0000","last_unstale":"2024-05-30T16:49:06.052768+0000","last_undegraded":"2024-05-30T16:49:06.052768+0000","last_fullsized":"2024-05-30T16:49:06.052768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051567+0000","last_change":"2024-05-30T16:49:04.556339+0000","last_active":"2024-05-30T16:49:06.051567+0000","last_peered":"2024-05-30T16:49:06.051567+0000","last_clean":"2024-05-30T16:49:06.051567+0000","last_became_active":"2024-05-30T16:49:04.556012+0000","last_became_peered":"2024-05-30T16:49:04.556012+0000","last_unstale":"2024-05-30T16:49:06.051567+0000","last_undegraded":"2024-05-30T16:49:06.051567+0000","last_fullsized":"2024-05-30T16:49:06.051567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:23.369792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052569+0000","last_change":"2024-05-30T16:49:03.550153+0000","last_active":"2024-05-30T16:49:06.052569+0000","last_peered":"2024-05-30T16:49:06.052569+0000","last_clean":"2024-05-30T16:49:06.052569+0000","last_became_active":"2024-05-30T16:49:03.549872+0000","last_became_peered":"2024-05-30T16:49:03.549872+0000","last_unstale":"2024-05-30T16:49:06.052569+0000","last_undegraded":"2024-05-30T16:49:06.052569+0000","last_fullsized":"2024-05-30T16:49:06.052569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:58.145285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052911+0000","last_change":"2024-05-30T16:49:04.558227+0000","last_active":"2024-05-30T16:49:06.052911+0000","last_peered":"2024-05-30T16:49:06.052911+0000","last_clean":"2024-05-30T16:49:06.052911+0000","last_became_active":"2024-05-30T16:49:04.557978+0000","last_became_peered":"2024-05-30T16:49:04.557978+0000","last_unstale":"2024-05-30T16:49:06.052911+0000","last_undegraded":"2024-05-30T16:49:06.052911+0000","last_fullsized":"2024-05-30T16:49:06.052911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534339+0000","last_change":"2024-05-30T16:49:04.561331+0000","last_active":"2024-05-30T16:49:05.534339+0000","last_peered":"2024-05-30T16:49:05.534339+0000","last_clean":"2024-05-30T16:49:05.534339+0000","last_became_active":"2024-05-30T16:49:04.560894+0000","last_became_peered":"2024-05-30T16:49:04.560894+0000","last_unstale":"2024-05-30T16:49:05.534339+0000","last_undegraded":"2024-05-30T16:49:05.534339+0000","last_fullsized":"2024-05-30T16:49:05.534339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:45:42.077957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052112+0000","last_change":"2024-05-30T16:49:03.549087+0000","last_active":"2024-05-30T16:49:06.052112+0000","last_peered":"2024-05-30T16:49:06.052112+0000","last_clean":"2024-05-30T16:49:06.052112+0000","last_became_active":"2024-05-30T16:49:03.548736+0000","last_became_peered":"2024-05-30T16:49:03.548736+0000","last_unstale":"2024-05-30T16:49:06.052112+0000","last_undegraded":"2024-05-30T16:49:06.052112+0000","last_fullsized":"2024-05-30T16:49:06.052112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534726+0000","last_change":"2024-05-30T16:49:04.561436+0000","last_active":"2024-05-30T16:49:05.534726+0000","last_peered":"2024-05-30T16:49:05.534726+0000","last_clean":"2024-05-30T16:49:05.534726+0000","last_became_active":"2024-05-30T16:49:04.561159+0000","last_became_peered":"2024-05-30T16:49:04.561159+0000","last_unstale":"2024-05-30T16:49:05.534726+0000","last_undegraded":"2024-05-30T16:49:05.534726+0000","last_fullsized":"2024-05-30T16:49:05.534726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:47:24.068734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052643+0000","last_change":"2024-05-30T16:49:03.552644+0000","last_active":"2024-05-30T16:49:06.052643+0000","last_peered":"2024-05-30T16:49:06.052643+0000","last_clean":"2024-05-30T16:49:06.052643+0000","last_became_active":"2024-05-30T16:49:03.552304+0000","last_became_peered":"2024-05-30T16:49:03.552304+0000","last_unstale":"2024-05-30T16:49:06.052643+0000","last_undegraded":"2024-05-30T16:49:06.052643+0000","last_fullsized":"2024-05-30T16:49:06.052643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:18.318116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051834+0000","last_change":"2024-05-30T16:49:04.542732+0000","last_active":"2024-05-30T16:49:06.051834+0000","last_peered":"2024-05-30T16:49:06.051834+0000","last_clean":"2024-05-30T16:49:06.051834+0000","last_became_active":"2024-05-30T16:49:04.542400+0000","last_became_peered":"2024-05-30T16:49:04.542400+0000","last_unstale":"2024-05-30T16:49:06.051834+0000","last_undegraded":"2024-05-30T16:49:06.051834+0000","last_fullsized":"2024-05-30T16:49:06.051834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052111+0000","last_change":"2024-05-30T16:49:03.546038+0000","last_active":"2024-05-30T16:49:06.052111+0000","last_peered":"2024-05-30T16:49:06.052111+0000","last_clean":"2024-05-30T16:49:06.052111+0000","last_became_active":"2024-05-30T16:49:03.545623+0000","last_became_peered":"2024-05-30T16:49:03.545623+0000","last_unstale":"2024-05-30T16:49:06.052111+0000","last_undegraded":"2024-05-30T16:49:06.052111+0000","last_fullsized":"2024-05-30T16:49:06.052111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:40.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052052+0000","last_change":"2024-05-30T16:49:04.546841+0000","last_active":"2024-05-30T16:49:06.052052+0000","last_peered":"2024-05-30T16:49:06.052052+0000","last_clean":"2024-05-30T16:49:06.052052+0000","last_became_active":"2024-05-30T16:49:04.546596+0000","last_became_peered":"2024-05-30T16:49:04.546596+0000","last_unstale":"2024-05-30T16:49:06.052052+0000","last_undegraded":"2024-05-30T16:49:06.052052+0000","last_fullsized":"2024-05-30T16:49:06.052052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:06.186315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051977+0000","last_change":"2024-05-30T16:49:03.551604+0000","last_active":"2024-05-30T16:49:06.051977+0000","last_peered":"2024-05-30T16:49:06.051977+0000","last_clean":"2024-05-30T16:49:06.051977+0000","last_became_active":"2024-05-30T16:49:03.551333+0000","last_became_peered":"2024-05-30T16:49:03.551333+0000","last_unstale":"2024-05-30T16:49:06.051977+0000","last_undegraded":"2024-05-30T16:49:06.051977+0000","last_fullsized":"2024-05-30T16:49:06.051977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:23.050556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":81081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":671961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:49:13.237 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:49:13.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9138c00640 1 Processor -- start 2024-05-30T16:49:13.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9138c00640 1 -- start start 2024-05-30T16:49:13.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9138c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f91340d14c0 0x7f913406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:13.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9138c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91340d05b0 0x7f913409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:13.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9138c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913406ea20 con 0x7f913409af80 2024-05-30T16:49:13.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9138c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9134070950 con 0x7f91340d14c0 2024-05-30T16:49:13.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9138c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9134070c30 con 0x7f91340d05b0 2024-05-30T16:49:13.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9132800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f913409af80 0x7f9134162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40020/0 (socket says 172.21.15.59:40020) 2024-05-30T16:49:13.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9132800640 1 -- 172.21.15.59:0/649085229 learned_addr learned my addr 172.21.15.59:0/649085229 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:13.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f912be00640 1 --2- 172.21.15.59:0/649085229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91340d05b0 0x7f913409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:13.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9131e00640 1 --2- 172.21.15.59:0/649085229 >> v2:172.21.15.107:3300/0 conn(0x7f91340d14c0 0x7f913406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:13.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9131400640 1 -- 172.21.15.59:0/649085229 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928994978 0 0) 0x7f912c0014a0 con 0x7f913409af80 2024-05-30T16:49:13.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9131400640 1 -- 172.21.15.59:0/649085229 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9118003530 con 0x7f913409af80 2024-05-30T16:49:13.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9131e00640 1 -- 172.21.15.59:0/649085229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91340d05b0 msgr2=0x7f913409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:13.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9131e00640 1 --2- 172.21.15.59:0/649085229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91340d05b0 0x7f913409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9131e00640 1 -- 172.21.15.59:0/649085229 >> v1:172.21.15.59:6789/0 conn(0x7f913409af80 legacy=0x7f9134162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:13.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f9131e00640 1 -- 172.21.15.59:0/649085229 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9134070f10 con 0x7f91340d14c0 2024-05-30T16:49:13.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.386+0000 7f912be00640 1 --2- 172.21.15.59:0/649085229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91340d05b0 0x7f913409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.390+0000 7f9131e00640 1 --2- 172.21.15.59:0/649085229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91340d14c0 0x7f913406e4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f91240097c0 tx=0x7f912401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fc9a1609dde0dc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.390+0000 7f9131400640 1 -- 172.21.15.59:0/649085229 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91240b0070 con 0x7f91340d14c0 2024-05-30T16:49:13.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.390+0000 7f9131400640 1 -- 172.21.15.59:0/649085229 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91240ab600 con 0x7f91340d14c0 2024-05-30T16:49:13.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.390+0000 7f9131400640 1 -- 172.21.15.59:0/649085229 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91240ab9b0 con 0x7f91340d14c0 2024-05-30T16:49:13.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.390+0000 7f9138c00640 1 -- 172.21.15.59:0/649085229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91340d14c0 msgr2=0x7f913406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:13.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.390+0000 7f9138c00640 1 --2- 172.21.15.59:0/649085229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91340d14c0 0x7f913406e4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f91240097c0 tx=0x7f912401c4a0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.390+0000 7f9138c00640 1 -- 172.21.15.59:0/649085229 shutdown_connections 2024-05-30T16:49:13.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.390+0000 7f9138c00640 1 --2- 172.21.15.59:0/649085229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91340d05b0 0x7f913409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.390+0000 7f9138c00640 1 --2- 172.21.15.59:0/649085229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91340d14c0 0x7f913406e4e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.390+0000 7f9138c00640 1 -- 172.21.15.59:0/649085229 >> 172.21.15.59:0/649085229 conn(0x7f91340b3f80 msgr2=0x7f91340b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:13.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.390+0000 7f9138c00640 1 -- 172.21.15.59:0/649085229 shutdown_connections 2024-05-30T16:49:13.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.390+0000 7f9138c00640 1 -- 172.21.15.59:0/649085229 wait complete. 2024-05-30T16:49:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9138c00640 1 Processor -- start 2024-05-30T16:49:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9138c00640 1 -- start start 2024-05-30T16:49:13.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9138c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f913409af80 0x7f9134154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:13.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9138c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91340d05b0 0x7f91340c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:13.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9138c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91340d14c0 0x7f91340c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:13.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9138c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f91340d0b10 con 0x7f913409af80 2024-05-30T16:49:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9138c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f91340d0990 con 0x7f91340d05b0 2024-05-30T16:49:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9138c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f913406e100 con 0x7f91340d14c0 2024-05-30T16:49:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9131e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f913409af80 0x7f9134154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9131e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f913409af80 0x7f9134154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54110/0 (socket says 172.21.15.59:54110) 2024-05-30T16:49:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9131e00640 1 -- 172.21.15.59:0/2842765755 learned_addr learned my addr 172.21.15.59:0/2842765755 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f912be00640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91340d05b0 0x7f91340c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9132800640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91340d14c0 0x7f91340c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9131e00640 1 -- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91340d14c0 msgr2=0x7f91340c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9131e00640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91340d14c0 0x7f91340c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9131e00640 1 -- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91340d05b0 msgr2=0x7f91340c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9131e00640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91340d05b0 0x7f91340c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9131e00640 1 -- 172.21.15.59:0/2842765755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913415f530 con 0x7f913409af80 2024-05-30T16:49:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9131e00640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f913409af80 0x7f9134154f00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f912401a0d0 tx=0x7f912401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f912a000640 1 -- 172.21.15.59:0/2842765755 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91240b0050 con 0x7f913409af80 2024-05-30T16:49:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f912a000640 1 -- 172.21.15.59:0/2842765755 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91240b1040 con 0x7f913409af80 2024-05-30T16:49:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9138c00640 1 -- 172.21.15.59:0/2842765755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913415f810 con 0x7f913409af80 2024-05-30T16:49:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f912a000640 1 -- 172.21.15.59:0/2842765755 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124006e20 con 0x7f913409af80 2024-05-30T16:49:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.394+0000 7f9138c00640 1 -- 172.21.15.59:0/2842765755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91340af280 con 0x7f913409af80 2024-05-30T16:49:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.398+0000 7f9138c00640 1 -- 172.21.15.59:0/2842765755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9134068a90 con 0x7f913409af80 2024-05-30T16:49:13.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.398+0000 7f912a000640 1 -- 172.21.15.59:0/2842765755 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f91240be030 con 0x7f913409af80 2024-05-30T16:49:13.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.398+0000 7f912a000640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9110068380 0x7f911006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:13.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.398+0000 7f912a000640 1 -- 172.21.15.59:0/2842765755 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9124120420 con 0x7f913409af80 2024-05-30T16:49:13.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.398+0000 7f912be00640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9110068380 0x7f911006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:13.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.398+0000 7f912be00640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9110068380 0x7f911006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f911c009580 tx=0x7f911c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:13.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.402+0000 7f912a000640 1 -- 172.21.15.59:0/2842765755 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f91240c5060 con 0x7f913409af80 2024-05-30T16:49:13.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.562+0000 7f9138c00640 1 -- 172.21.15.59:0/2842765755 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91340b4be0 con 0x7f9110068380 2024-05-30T16:49:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f912a000640 1 -- 172.21.15.59:0/2842765755 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f91340b4be0 con 0x7f9110068380 2024-05-30T16:49:13.579 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:49:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f9138c00640 1 -- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9110068380 msgr2=0x7f911006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f9138c00640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9110068380 0x7f911006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f911c009580 tx=0x7f911c009190 comp rx=0 tx=0).stop 2024-05-30T16:49:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f9138c00640 1 -- 172.21.15.59:0/2842765755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f913409af80 msgr2=0x7f9134154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f9138c00640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f913409af80 0x7f9134154f00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f912401a0d0 tx=0x7f912401ace0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f9138c00640 1 -- 172.21.15.59:0/2842765755 shutdown_connections 2024-05-30T16:49:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f9138c00640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9110068380 0x7f911006a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f9138c00640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91340d14c0 0x7f91340c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f9138c00640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91340d05b0 0x7f91340c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f9138c00640 1 --2- 172.21.15.59:0/2842765755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f913409af80 0x7f9134154f00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f9138c00640 1 -- 172.21.15.59:0/2842765755 >> 172.21.15.59:0/2842765755 conn(0x7f91340b3f80 msgr2=0x7f9134074bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f9138c00640 1 -- 172.21.15.59:0/2842765755 shutdown_connections 2024-05-30T16:49:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.574+0000 7f9138c00640 1 -- 172.21.15.59:0/2842765755 wait complete. 2024-05-30T16:49:13.599 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-05-30T16:49:13.076489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219212,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755508,"statfs":{"total":773094113280,"available":772869640192,"internally_reserved":0,"allocated":3121152,"data_stored":1833196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.556778"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052545+0000","last_change":"2024-05-30T16:49:04.545096+0000","last_active":"2024-05-30T16:49:06.052545+0000","last_peered":"2024-05-30T16:49:06.052545+0000","last_clean":"2024-05-30T16:49:06.052545+0000","last_became_active":"2024-05-30T16:49:04.544532+0000","last_became_peered":"2024-05-30T16:49:04.544532+0000","last_unstale":"2024-05-30T16:49:06.052545+0000","last_undegraded":"2024-05-30T16:49:06.052545+0000","last_fullsized":"2024-05-30T16:49:06.052545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:00.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053033+0000","last_change":"2024-05-30T16:49:04.538139+0000","last_active":"2024-05-30T16:49:06.053033+0000","last_peered":"2024-05-30T16:49:06.053033+0000","last_clean":"2024-05-30T16:49:06.053033+0000","last_became_active":"2024-05-30T16:49:04.537797+0000","last_became_peered":"2024-05-30T16:49:04.537797+0000","last_unstale":"2024-05-30T16:49:06.053033+0000","last_undegraded":"2024-05-30T16:49:06.053033+0000","last_fullsized":"2024-05-30T16:49:06.053033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051246+0000","last_change":"2024-05-30T16:49:04.542945+0000","last_active":"2024-05-30T16:49:06.051246+0000","last_peered":"2024-05-30T16:49:06.051246+0000","last_clean":"2024-05-30T16:49:06.051246+0000","last_became_active":"2024-05-30T16:49:04.542637+0000","last_became_peered":"2024-05-30T16:49:04.542637+0000","last_unstale":"2024-05-30T16:49:06.051246+0000","last_undegraded":"2024-05-30T16:49:06.051246+0000","last_fullsized":"2024-05-30T16:49:06.051246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:55:32.611131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533898+0000","last_change":"2024-05-30T16:49:04.556673+0000","last_active":"2024-05-30T16:49:05.533898+0000","last_peered":"2024-05-30T16:49:05.533898+0000","last_clean":"2024-05-30T16:49:05.533898+0000","last_became_active":"2024-05-30T16:49:04.556386+0000","last_became_peered":"2024-05-30T16:49:04.556386+0000","last_unstale":"2024-05-30T16:49:05.533898+0000","last_undegraded":"2024-05-30T16:49:05.533898+0000","last_fullsized":"2024-05-30T16:49:05.533898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:45.716674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052183+0000","last_change":"2024-05-30T16:49:04.552810+0000","last_active":"2024-05-30T16:49:06.052183+0000","last_peered":"2024-05-30T16:49:06.052183+0000","last_clean":"2024-05-30T16:49:06.052183+0000","last_became_active":"2024-05-30T16:49:04.552478+0000","last_became_peered":"2024-05-30T16:49:04.552478+0000","last_unstale":"2024-05-30T16:49:06.052183+0000","last_undegraded":"2024-05-30T16:49:06.052183+0000","last_fullsized":"2024-05-30T16:49:06.052183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:17:37.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534174+0000","last_change":"2024-05-30T16:49:04.546420+0000","last_active":"2024-05-30T16:49:05.534174+0000","last_peered":"2024-05-30T16:49:05.534174+0000","last_clean":"2024-05-30T16:49:05.534174+0000","last_became_active":"2024-05-30T16:49:04.545288+0000","last_became_peered":"2024-05-30T16:49:04.545288+0000","last_unstale":"2024-05-30T16:49:05.534174+0000","last_undegraded":"2024-05-30T16:49:05.534174+0000","last_fullsized":"2024-05-30T16:49:05.534174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:17:37.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051955+0000","last_change":"2024-05-30T16:49:04.542431+0000","last_active":"2024-05-30T16:49:06.051955+0000","last_peered":"2024-05-30T16:49:06.051955+0000","last_clean":"2024-05-30T16:49:06.051955+0000","last_became_active":"2024-05-30T16:49:04.541958+0000","last_became_peered":"2024-05-30T16:49:04.541958+0000","last_unstale":"2024-05-30T16:49:06.051955+0000","last_undegraded":"2024-05-30T16:49:06.051955+0000","last_fullsized":"2024-05-30T16:49:06.051955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:41.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.050859+0000","last_change":"2024-05-30T16:49:04.546221+0000","last_active":"2024-05-30T16:49:06.050859+0000","last_peered":"2024-05-30T16:49:06.050859+0000","last_clean":"2024-05-30T16:49:06.050859+0000","last_became_active":"2024-05-30T16:49:04.545933+0000","last_became_peered":"2024-05-30T16:49:04.545933+0000","last_unstale":"2024-05-30T16:49:06.050859+0000","last_undegraded":"2024-05-30T16:49:06.050859+0000","last_fullsized":"2024-05-30T16:49:06.050859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:21.914079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052633+0000","last_change":"2024-05-30T16:49:04.554508+0000","last_active":"2024-05-30T16:49:06.052633+0000","last_peered":"2024-05-30T16:49:06.052633+0000","last_clean":"2024-05-30T16:49:06.052633+0000","last_became_active":"2024-05-30T16:49:04.553966+0000","last_became_peered":"2024-05-30T16:49:04.553966+0000","last_unstale":"2024-05-30T16:49:06.052633+0000","last_undegraded":"2024-05-30T16:49:06.052633+0000","last_fullsized":"2024-05-30T16:49:06.052633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:47:24.068734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053243+0000","last_change":"2024-05-30T16:49:04.553475+0000","last_active":"2024-05-30T16:49:06.053243+0000","last_peered":"2024-05-30T16:49:06.053243+0000","last_clean":"2024-05-30T16:49:06.053243+0000","last_became_active":"2024-05-30T16:49:04.552962+0000","last_became_peered":"2024-05-30T16:49:04.552962+0000","last_unstale":"2024-05-30T16:49:06.053243+0000","last_undegraded":"2024-05-30T16:49:06.053243+0000","last_fullsized":"2024-05-30T16:49:06.053243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053178+0000","last_change":"2024-05-30T16:49:04.554233+0000","last_active":"2024-05-30T16:49:06.053178+0000","last_peered":"2024-05-30T16:49:06.053178+0000","last_clean":"2024-05-30T16:49:06.053178+0000","last_became_active":"2024-05-30T16:49:04.553934+0000","last_became_peered":"2024-05-30T16:49:04.553934+0000","last_unstale":"2024-05-30T16:49:06.053178+0000","last_undegraded":"2024-05-30T16:49:06.053178+0000","last_fullsized":"2024-05-30T16:49:06.053178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534485+0000","last_change":"2024-05-30T16:49:04.548278+0000","last_active":"2024-05-30T16:49:05.534485+0000","last_peered":"2024-05-30T16:49:05.534485+0000","last_clean":"2024-05-30T16:49:05.534485+0000","last_became_active":"2024-05-30T16:49:04.547736+0000","last_became_peered":"2024-05-30T16:49:04.547736+0000","last_unstale":"2024-05-30T16:49:05.534485+0000","last_undegraded":"2024-05-30T16:49:05.534485+0000","last_fullsized":"2024-05-30T16:49:05.534485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:02.310302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051507+0000","last_change":"2024-05-30T16:49:04.541147+0000","last_active":"2024-05-30T16:49:06.051507+0000","last_peered":"2024-05-30T16:49:06.051507+0000","last_clean":"2024-05-30T16:49:06.051507+0000","last_became_active":"2024-05-30T16:49:04.540873+0000","last_became_peered":"2024-05-30T16:49:04.540873+0000","last_unstale":"2024-05-30T16:49:06.051507+0000","last_undegraded":"2024-05-30T16:49:06.051507+0000","last_fullsized":"2024-05-30T16:49:06.051507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:31:53.336085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051066+0000","last_change":"2024-05-30T16:49:04.540239+0000","last_active":"2024-05-30T16:49:06.051066+0000","last_peered":"2024-05-30T16:49:06.051066+0000","last_clean":"2024-05-30T16:49:06.051066+0000","last_became_active":"2024-05-30T16:49:04.539685+0000","last_became_peered":"2024-05-30T16:49:04.539685+0000","last_unstale":"2024-05-30T16:49:06.051066+0000","last_undegraded":"2024-05-30T16:49:06.051066+0000","last_fullsized":"2024-05-30T16:49:06.051066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:59.153304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052714+0000","last_change":"2024-05-30T16:49:04.548766+0000","last_active":"2024-05-30T16:49:06.052714+0000","last_peered":"2024-05-30T16:49:06.052714+0000","last_clean":"2024-05-30T16:49:06.052714+0000","last_became_active":"2024-05-30T16:49:04.548490+0000","last_became_peered":"2024-05-30T16:49:04.548490+0000","last_unstale":"2024-05-30T16:49:06.052714+0000","last_undegraded":"2024-05-30T16:49:06.052714+0000","last_fullsized":"2024-05-30T16:49:06.052714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.532984+0000","last_change":"2024-05-30T16:49:04.542268+0000","last_active":"2024-05-30T16:49:05.532984+0000","last_peered":"2024-05-30T16:49:05.532984+0000","last_clean":"2024-05-30T16:49:05.532984+0000","last_became_active":"2024-05-30T16:49:04.541992+0000","last_became_peered":"2024-05-30T16:49:04.541992+0000","last_unstale":"2024-05-30T16:49:05.532984+0000","last_undegraded":"2024-05-30T16:49:05.532984+0000","last_fullsized":"2024-05-30T16:49:05.532984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534099+0000","last_change":"2024-05-30T16:49:04.550221+0000","last_active":"2024-05-30T16:49:05.534099+0000","last_peered":"2024-05-30T16:49:05.534099+0000","last_clean":"2024-05-30T16:49:05.534099+0000","last_became_active":"2024-05-30T16:49:04.549914+0000","last_became_peered":"2024-05-30T16:49:04.549914+0000","last_unstale":"2024-05-30T16:49:05.534099+0000","last_undegraded":"2024-05-30T16:49:05.534099+0000","last_fullsized":"2024-05-30T16:49:05.534099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:41.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530293+0000","last_change":"2024-05-30T16:49:04.551149+0000","last_active":"2024-05-30T16:49:05.530293+0000","last_peered":"2024-05-30T16:49:05.530293+0000","last_clean":"2024-05-30T16:49:05.530293+0000","last_became_active":"2024-05-30T16:49:04.543927+0000","last_became_peered":"2024-05-30T16:49:04.543927+0000","last_unstale":"2024-05-30T16:49:05.530293+0000","last_undegraded":"2024-05-30T16:49:05.530293+0000","last_fullsized":"2024-05-30T16:49:05.530293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:19.326134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052813+0000","last_change":"2024-05-30T16:49:04.536971+0000","last_active":"2024-05-30T16:49:06.052813+0000","last_peered":"2024-05-30T16:49:06.052813+0000","last_clean":"2024-05-30T16:49:06.052813+0000","last_became_active":"2024-05-30T16:49:04.536697+0000","last_became_peered":"2024-05-30T16:49:04.536697+0000","last_unstale":"2024-05-30T16:49:06.052813+0000","last_undegraded":"2024-05-30T16:49:06.052813+0000","last_fullsized":"2024-05-30T16:49:06.052813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:07.305667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052893+0000","last_change":"2024-05-30T16:49:04.554920+0000","last_active":"2024-05-30T16:49:06.052893+0000","last_peered":"2024-05-30T16:49:06.052893+0000","last_clean":"2024-05-30T16:49:06.052893+0000","last_became_active":"2024-05-30T16:49:04.554629+0000","last_became_peered":"2024-05-30T16:49:04.554629+0000","last_unstale":"2024-05-30T16:49:06.052893+0000","last_undegraded":"2024-05-30T16:49:06.052893+0000","last_fullsized":"2024-05-30T16:49:06.052893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051215+0000","last_change":"2024-05-30T16:49:04.546642+0000","last_active":"2024-05-30T16:49:06.051215+0000","last_peered":"2024-05-30T16:49:06.051215+0000","last_clean":"2024-05-30T16:49:06.051215+0000","last_became_active":"2024-05-30T16:49:04.546003+0000","last_became_peered":"2024-05-30T16:49:04.546003+0000","last_unstale":"2024-05-30T16:49:06.051215+0000","last_undegraded":"2024-05-30T16:49:06.051215+0000","last_fullsized":"2024-05-30T16:49:06.051215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:34:33.807678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534275+0000","last_change":"2024-05-30T16:49:04.549251+0000","last_active":"2024-05-30T16:49:05.534275+0000","last_peered":"2024-05-30T16:49:05.534275+0000","last_clean":"2024-05-30T16:49:05.534275+0000","last_became_active":"2024-05-30T16:49:04.548946+0000","last_became_peered":"2024-05-30T16:49:04.548946+0000","last_unstale":"2024-05-30T16:49:05.534275+0000","last_undegraded":"2024-05-30T16:49:05.534275+0000","last_fullsized":"2024-05-30T16:49:05.534275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:53:12.385144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051209+0000","last_change":"2024-05-30T16:49:04.554673+0000","last_active":"2024-05-30T16:49:06.051209+0000","last_peered":"2024-05-30T16:49:06.051209+0000","last_clean":"2024-05-30T16:49:06.051209+0000","last_became_active":"2024-05-30T16:49:04.552406+0000","last_became_peered":"2024-05-30T16:49:04.552406+0000","last_unstale":"2024-05-30T16:49:06.051209+0000","last_undegraded":"2024-05-30T16:49:06.051209+0000","last_fullsized":"2024-05-30T16:49:06.051209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:32:11.592244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534589+0000","last_change":"2024-05-30T16:49:04.539930+0000","last_active":"2024-05-30T16:49:05.534589+0000","last_peered":"2024-05-30T16:49:05.534589+0000","last_clean":"2024-05-30T16:49:05.534589+0000","last_became_active":"2024-05-30T16:49:04.538018+0000","last_became_peered":"2024-05-30T16:49:04.538018+0000","last_unstale":"2024-05-30T16:49:05.534589+0000","last_undegraded":"2024-05-30T16:49:05.534589+0000","last_fullsized":"2024-05-30T16:49:05.534589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052036+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.052036+0000","last_peered":"2024-05-30T16:49:06.052036+0000","last_clean":"2024-05-30T16:49:06.052036+0000","last_became_active":"2024-05-30T16:49:04.556321+0000","last_became_peered":"2024-05-30T16:49:04.556321+0000","last_unstale":"2024-05-30T16:49:06.052036+0000","last_undegraded":"2024-05-30T16:49:06.052036+0000","last_fullsized":"2024-05-30T16:49:06.052036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:44:48.125700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053240+0000","last_change":"2024-05-30T16:49:04.544556+0000","last_active":"2024-05-30T16:49:06.053240+0000","last_peered":"2024-05-30T16:49:06.053240+0000","last_clean":"2024-05-30T16:49:06.053240+0000","last_became_active":"2024-05-30T16:49:04.543181+0000","last_became_peered":"2024-05-30T16:49:04.543181+0000","last_unstale":"2024-05-30T16:49:06.053240+0000","last_undegraded":"2024-05-30T16:49:06.053240+0000","last_fullsized":"2024-05-30T16:49:06.053240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052887+0000","last_change":"2024-05-30T16:49:04.540083+0000","last_active":"2024-05-30T16:49:06.052887+0000","last_peered":"2024-05-30T16:49:06.052887+0000","last_clean":"2024-05-30T16:49:06.052887+0000","last_became_active":"2024-05-30T16:49:04.539760+0000","last_became_peered":"2024-05-30T16:49:04.539760+0000","last_unstale":"2024-05-30T16:49:06.052887+0000","last_undegraded":"2024-05-30T16:49:06.052887+0000","last_fullsized":"2024-05-30T16:49:06.052887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051647+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.051647+0000","last_peered":"2024-05-30T16:49:06.051647+0000","last_clean":"2024-05-30T16:49:06.051647+0000","last_became_active":"2024-05-30T16:49:04.556297+0000","last_became_peered":"2024-05-30T16:49:04.556297+0000","last_unstale":"2024-05-30T16:49:06.051647+0000","last_undegraded":"2024-05-30T16:49:06.051647+0000","last_fullsized":"2024-05-30T16:49:06.051647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:14:09.241699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051361+0000","last_change":"2024-05-30T16:49:04.546093+0000","last_active":"2024-05-30T16:49:06.051361+0000","last_peered":"2024-05-30T16:49:06.051361+0000","last_clean":"2024-05-30T16:49:06.051361+0000","last_became_active":"2024-05-30T16:49:04.545623+0000","last_became_peered":"2024-05-30T16:49:04.545623+0000","last_unstale":"2024-05-30T16:49:06.051361+0000","last_undegraded":"2024-05-30T16:49:06.051361+0000","last_fullsized":"2024-05-30T16:49:06.051361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:38.640365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534360+0000","last_change":"2024-05-30T16:49:04.558192+0000","last_active":"2024-05-30T16:49:05.534360+0000","last_peered":"2024-05-30T16:49:05.534360+0000","last_clean":"2024-05-30T16:49:05.534360+0000","last_became_active":"2024-05-30T16:49:04.557826+0000","last_became_peered":"2024-05-30T16:49:04.557826+0000","last_unstale":"2024-05-30T16:49:05.534360+0000","last_undegraded":"2024-05-30T16:49:05.534360+0000","last_fullsized":"2024-05-30T16:49:05.534360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:59.487481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530068+0000","last_change":"2024-05-30T16:49:04.539369+0000","last_active":"2024-05-30T16:49:05.530068+0000","last_peered":"2024-05-30T16:49:05.530068+0000","last_clean":"2024-05-30T16:49:05.530068+0000","last_became_active":"2024-05-30T16:49:04.538899+0000","last_became_peered":"2024-05-30T16:49:04.538899+0000","last_unstale":"2024-05-30T16:49:05.530068+0000","last_undegraded":"2024-05-30T16:49:05.530068+0000","last_fullsized":"2024-05-30T16:49:05.530068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:39.816197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052013+0000","last_change":"2024-05-30T16:49:04.549536+0000","last_active":"2024-05-30T16:49:06.052013+0000","last_peered":"2024-05-30T16:49:06.052013+0000","last_clean":"2024-05-30T16:49:06.052013+0000","last_became_active":"2024-05-30T16:49:04.546653+0000","last_became_peered":"2024-05-30T16:49:04.546653+0000","last_unstale":"2024-05-30T16:49:06.052013+0000","last_undegraded":"2024-05-30T16:49:06.052013+0000","last_fullsized":"2024-05-30T16:49:06.052013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:38.640365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533225+0000","last_change":"2024-05-30T16:49:04.558267+0000","last_active":"2024-05-30T16:49:05.533225+0000","last_peered":"2024-05-30T16:49:05.533225+0000","last_clean":"2024-05-30T16:49:05.533225+0000","last_became_active":"2024-05-30T16:49:04.558000+0000","last_became_peered":"2024-05-30T16:49:04.558000+0000","last_unstale":"2024-05-30T16:49:05.533225+0000","last_undegraded":"2024-05-30T16:49:05.533225+0000","last_fullsized":"2024-05-30T16:49:05.533225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:11.469445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051650+0000","last_change":"2024-05-30T16:49:03.546643+0000","last_active":"2024-05-30T16:49:06.051650+0000","last_peered":"2024-05-30T16:49:06.051650+0000","last_clean":"2024-05-30T16:49:06.051650+0000","last_became_active":"2024-05-30T16:49:03.546381+0000","last_became_peered":"2024-05-30T16:49:03.546381+0000","last_unstale":"2024-05-30T16:49:06.051650+0000","last_undegraded":"2024-05-30T16:49:06.051650+0000","last_fullsized":"2024-05-30T16:49:06.051650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:44.078644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051517+0000","last_change":"2024-05-30T16:49:04.549134+0000","last_active":"2024-05-30T16:49:06.051517+0000","last_peered":"2024-05-30T16:49:06.051517+0000","last_clean":"2024-05-30T16:49:06.051517+0000","last_became_active":"2024-05-30T16:49:04.548780+0000","last_became_peered":"2024-05-30T16:49:04.548780+0000","last_unstale":"2024-05-30T16:49:06.051517+0000","last_undegraded":"2024-05-30T16:49:06.051517+0000","last_fullsized":"2024-05-30T16:49:06.051517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052899+0000","last_change":"2024-05-30T16:49:03.542612+0000","last_active":"2024-05-30T16:49:06.052899+0000","last_peered":"2024-05-30T16:49:06.052899+0000","last_clean":"2024-05-30T16:49:06.052899+0000","last_became_active":"2024-05-30T16:49:03.541360+0000","last_became_peered":"2024-05-30T16:49:03.541360+0000","last_unstale":"2024-05-30T16:49:06.052899+0000","last_undegraded":"2024-05-30T16:49:06.052899+0000","last_fullsized":"2024-05-30T16:49:06.052899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051315+0000","last_change":"2024-05-30T16:49:03.538756+0000","last_active":"2024-05-30T16:49:06.051315+0000","last_peered":"2024-05-30T16:49:06.051315+0000","last_clean":"2024-05-30T16:49:06.051315+0000","last_became_active":"2024-05-30T16:49:03.538053+0000","last_became_peered":"2024-05-30T16:49:03.538053+0000","last_unstale":"2024-05-30T16:49:06.051315+0000","last_undegraded":"2024-05-30T16:49:06.051315+0000","last_fullsized":"2024-05-30T16:49:06.051315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:07.264297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051433+0000","last_change":"2024-05-30T16:49:04.546048+0000","last_active":"2024-05-30T16:49:06.051433+0000","last_peered":"2024-05-30T16:49:06.051433+0000","last_clean":"2024-05-30T16:49:06.051433+0000","last_became_active":"2024-05-30T16:49:04.545151+0000","last_became_peered":"2024-05-30T16:49:04.545151+0000","last_unstale":"2024-05-30T16:49:06.051433+0000","last_undegraded":"2024-05-30T16:49:06.051433+0000","last_fullsized":"2024-05-30T16:49:06.051433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:07.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533718+0000","last_change":"2024-05-30T16:49:03.529039+0000","last_active":"2024-05-30T16:49:05.533718+0000","last_peered":"2024-05-30T16:49:05.533718+0000","last_clean":"2024-05-30T16:49:05.533718+0000","last_became_active":"2024-05-30T16:49:03.527042+0000","last_became_peered":"2024-05-30T16:49:03.527042+0000","last_unstale":"2024-05-30T16:49:05.533718+0000","last_undegraded":"2024-05-30T16:49:05.533718+0000","last_fullsized":"2024-05-30T16:49:05.533718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052719+0000","last_change":"2024-05-30T16:49:04.540411+0000","last_active":"2024-05-30T16:49:06.052719+0000","last_peered":"2024-05-30T16:49:06.052719+0000","last_clean":"2024-05-30T16:49:06.052719+0000","last_became_active":"2024-05-30T16:49:04.540089+0000","last_became_peered":"2024-05-30T16:49:04.540089+0000","last_unstale":"2024-05-30T16:49:06.052719+0000","last_undegraded":"2024-05-30T16:49:06.052719+0000","last_fullsized":"2024-05-30T16:49:06.052719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053224+0000","last_change":"2024-05-30T16:49:03.542933+0000","last_active":"2024-05-30T16:49:06.053224+0000","last_peered":"2024-05-30T16:49:06.053224+0000","last_clean":"2024-05-30T16:49:06.053224+0000","last_became_active":"2024-05-30T16:49:03.541460+0000","last_became_peered":"2024-05-30T16:49:03.541460+0000","last_unstale":"2024-05-30T16:49:06.053224+0000","last_undegraded":"2024-05-30T16:49:06.053224+0000","last_fullsized":"2024-05-30T16:49:06.053224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533477+0000","last_change":"2024-05-30T16:49:04.549367+0000","last_active":"2024-05-30T16:49:05.533477+0000","last_peered":"2024-05-30T16:49:05.533477+0000","last_clean":"2024-05-30T16:49:05.533477+0000","last_became_active":"2024-05-30T16:49:04.548994+0000","last_became_peered":"2024-05-30T16:49:04.548994+0000","last_unstale":"2024-05-30T16:49:05.533477+0000","last_undegraded":"2024-05-30T16:49:05.533477+0000","last_fullsized":"2024-05-30T16:49:05.533477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533840+0000","last_change":"2024-05-30T16:49:03.540903+0000","last_active":"2024-05-30T16:49:05.533840+0000","last_peered":"2024-05-30T16:49:05.533840+0000","last_clean":"2024-05-30T16:49:05.533840+0000","last_became_active":"2024-05-30T16:49:03.540598+0000","last_became_peered":"2024-05-30T16:49:03.540598+0000","last_unstale":"2024-05-30T16:49:05.533840+0000","last_undegraded":"2024-05-30T16:49:05.533840+0000","last_fullsized":"2024-05-30T16:49:05.533840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:45.462713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051841+0000","last_change":"2024-05-30T16:49:04.542032+0000","last_active":"2024-05-30T16:49:06.051841+0000","last_peered":"2024-05-30T16:49:06.051841+0000","last_clean":"2024-05-30T16:49:06.051841+0000","last_became_active":"2024-05-30T16:49:04.541750+0000","last_became_peered":"2024-05-30T16:49:04.541750+0000","last_unstale":"2024-05-30T16:49:06.051841+0000","last_undegraded":"2024-05-30T16:49:06.051841+0000","last_fullsized":"2024-05-30T16:49:06.051841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052980+0000","last_change":"2024-05-30T16:49:03.537811+0000","last_active":"2024-05-30T16:49:06.052980+0000","last_peered":"2024-05-30T16:49:06.052980+0000","last_clean":"2024-05-30T16:49:06.052980+0000","last_became_active":"2024-05-30T16:49:03.537468+0000","last_became_peered":"2024-05-30T16:49:03.537468+0000","last_unstale":"2024-05-30T16:49:06.052980+0000","last_undegraded":"2024-05-30T16:49:06.052980+0000","last_fullsized":"2024-05-30T16:49:06.052980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534607+0000","last_change":"2024-05-30T16:49:04.548049+0000","last_active":"2024-05-30T16:49:05.534607+0000","last_peered":"2024-05-30T16:49:05.534607+0000","last_clean":"2024-05-30T16:49:05.534607+0000","last_became_active":"2024-05-30T16:49:04.547483+0000","last_became_peered":"2024-05-30T16:49:04.547483+0000","last_unstale":"2024-05-30T16:49:05.534607+0000","last_undegraded":"2024-05-30T16:49:05.534607+0000","last_fullsized":"2024-05-30T16:49:05.534607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:39.816197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053012+0000","last_change":"2024-05-30T16:49:03.542201+0000","last_active":"2024-05-30T16:49:06.053012+0000","last_peered":"2024-05-30T16:49:06.053012+0000","last_clean":"2024-05-30T16:49:06.053012+0000","last_became_active":"2024-05-30T16:49:03.541172+0000","last_became_peered":"2024-05-30T16:49:03.541172+0000","last_unstale":"2024-05-30T16:49:06.053012+0000","last_undegraded":"2024-05-30T16:49:06.053012+0000","last_fullsized":"2024-05-30T16:49:06.053012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:21:15.090452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052243+0000","last_change":"2024-05-30T16:49:04.540546+0000","last_active":"2024-05-30T16:49:06.052243+0000","last_peered":"2024-05-30T16:49:06.052243+0000","last_clean":"2024-05-30T16:49:06.052243+0000","last_became_active":"2024-05-30T16:49:04.539786+0000","last_became_peered":"2024-05-30T16:49:04.539786+0000","last_unstale":"2024-05-30T16:49:06.052243+0000","last_undegraded":"2024-05-30T16:49:06.052243+0000","last_fullsized":"2024-05-30T16:49:06.052243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:53:12.385144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051634+0000","last_change":"2024-05-30T16:49:03.542403+0000","last_active":"2024-05-30T16:49:06.051634+0000","last_peered":"2024-05-30T16:49:06.051634+0000","last_clean":"2024-05-30T16:49:06.051634+0000","last_became_active":"2024-05-30T16:49:03.535558+0000","last_became_peered":"2024-05-30T16:49:03.535558+0000","last_unstale":"2024-05-30T16:49:06.051634+0000","last_undegraded":"2024-05-30T16:49:06.051634+0000","last_fullsized":"2024-05-30T16:49:06.051634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:50:44.488767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051231+0000","last_change":"2024-05-30T16:49:04.543912+0000","last_active":"2024-05-30T16:49:06.051231+0000","last_peered":"2024-05-30T16:49:06.051231+0000","last_clean":"2024-05-30T16:49:06.051231+0000","last_became_active":"2024-05-30T16:49:04.543548+0000","last_became_peered":"2024-05-30T16:49:04.543548+0000","last_unstale":"2024-05-30T16:49:06.051231+0000","last_undegraded":"2024-05-30T16:49:06.051231+0000","last_fullsized":"2024-05-30T16:49:06.051231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:46.470731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534423+0000","last_change":"2024-05-30T16:49:03.533929+0000","last_active":"2024-05-30T16:49:05.534423+0000","last_peered":"2024-05-30T16:49:05.534423+0000","last_clean":"2024-05-30T16:49:05.534423+0000","last_became_active":"2024-05-30T16:49:03.533583+0000","last_became_peered":"2024-05-30T16:49:03.533583+0000","last_unstale":"2024-05-30T16:49:05.534423+0000","last_undegraded":"2024-05-30T16:49:05.534423+0000","last_fullsized":"2024-05-30T16:49:05.534423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052365+0000","last_change":"2024-05-30T16:49:04.550074+0000","last_active":"2024-05-30T16:49:06.052365+0000","last_peered":"2024-05-30T16:49:06.052365+0000","last_clean":"2024-05-30T16:49:06.052365+0000","last_became_active":"2024-05-30T16:49:04.549701+0000","last_became_peered":"2024-05-30T16:49:04.549701+0000","last_unstale":"2024-05-30T16:49:06.052365+0000","last_undegraded":"2024-05-30T16:49:06.052365+0000","last_fullsized":"2024-05-30T16:49:06.052365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:45:42.077957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052757+0000","last_change":"2024-05-30T16:49:03.533071+0000","last_active":"2024-05-30T16:49:06.052757+0000","last_peered":"2024-05-30T16:49:06.052757+0000","last_clean":"2024-05-30T16:49:06.052757+0000","last_became_active":"2024-05-30T16:49:03.532744+0000","last_became_peered":"2024-05-30T16:49:03.532744+0000","last_unstale":"2024-05-30T16:49:06.052757+0000","last_undegraded":"2024-05-30T16:49:06.052757+0000","last_fullsized":"2024-05-30T16:49:06.052757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:51:21.137153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052564+0000","last_change":"2024-05-30T16:49:04.546980+0000","last_active":"2024-05-30T16:49:06.052564+0000","last_peered":"2024-05-30T16:49:06.052564+0000","last_clean":"2024-05-30T16:49:06.052564+0000","last_became_active":"2024-05-30T16:49:04.546205+0000","last_became_peered":"2024-05-30T16:49:04.546205+0000","last_unstale":"2024-05-30T16:49:06.052564+0000","last_undegraded":"2024-05-30T16:49:06.052564+0000","last_fullsized":"2024-05-30T16:49:06.052564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.529988+0000","last_change":"2024-05-30T16:49:03.543445+0000","last_active":"2024-05-30T16:49:05.529988+0000","last_peered":"2024-05-30T16:49:05.529988+0000","last_clean":"2024-05-30T16:49:05.529988+0000","last_became_active":"2024-05-30T16:49:03.543068+0000","last_became_peered":"2024-05-30T16:49:03.543068+0000","last_unstale":"2024-05-30T16:49:05.529988+0000","last_undegraded":"2024-05-30T16:49:05.529988+0000","last_fullsized":"2024-05-30T16:49:05.529988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:51:21.137153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052327+0000","last_change":"2024-05-30T16:49:04.553768+0000","last_active":"2024-05-30T16:49:06.052327+0000","last_peered":"2024-05-30T16:49:06.052327+0000","last_clean":"2024-05-30T16:49:06.052327+0000","last_became_active":"2024-05-30T16:49:04.550850+0000","last_became_peered":"2024-05-30T16:49:04.550850+0000","last_unstale":"2024-05-30T16:49:06.052327+0000","last_undegraded":"2024-05-30T16:49:06.052327+0000","last_fullsized":"2024-05-30T16:49:06.052327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:55.007207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534287+0000","last_change":"2024-05-30T16:49:03.549177+0000","last_active":"2024-05-30T16:49:05.534287+0000","last_peered":"2024-05-30T16:49:05.534287+0000","last_clean":"2024-05-30T16:49:05.534287+0000","last_became_active":"2024-05-30T16:49:03.548803+0000","last_became_peered":"2024-05-30T16:49:03.548803+0000","last_unstale":"2024-05-30T16:49:05.534287+0000","last_undegraded":"2024-05-30T16:49:05.534287+0000","last_fullsized":"2024-05-30T16:49:05.534287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:28:50.120091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052450+0000","last_change":"2024-05-30T16:49:04.552000+0000","last_active":"2024-05-30T16:49:06.052450+0000","last_peered":"2024-05-30T16:49:06.052450+0000","last_clean":"2024-05-30T16:49:06.052450+0000","last_became_active":"2024-05-30T16:49:04.551392+0000","last_became_peered":"2024-05-30T16:49:04.551392+0000","last_unstale":"2024-05-30T16:49:06.052450+0000","last_undegraded":"2024-05-30T16:49:06.052450+0000","last_fullsized":"2024-05-30T16:49:06.052450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:59.487481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530211+0000","last_change":"2024-05-30T16:49:03.548846+0000","last_active":"2024-05-30T16:49:05.530211+0000","last_peered":"2024-05-30T16:49:05.530211+0000","last_clean":"2024-05-30T16:49:05.530211+0000","last_became_active":"2024-05-30T16:49:03.547182+0000","last_became_peered":"2024-05-30T16:49:03.547182+0000","last_unstale":"2024-05-30T16:49:05.530211+0000","last_undegraded":"2024-05-30T16:49:05.530211+0000","last_fullsized":"2024-05-30T16:49:05.530211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052721+0000","last_change":"2024-05-30T16:49:04.558273+0000","last_active":"2024-05-30T16:49:06.052721+0000","last_peered":"2024-05-30T16:49:06.052721+0000","last_clean":"2024-05-30T16:49:06.052721+0000","last_became_active":"2024-05-30T16:49:04.557860+0000","last_became_peered":"2024-05-30T16:49:04.557860+0000","last_unstale":"2024-05-30T16:49:06.052721+0000","last_undegraded":"2024-05-30T16:49:06.052721+0000","last_fullsized":"2024-05-30T16:49:06.052721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:20.040027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053015+0000","last_change":"2024-05-30T16:49:03.532399+0000","last_active":"2024-05-30T16:49:06.053015+0000","last_peered":"2024-05-30T16:49:06.053015+0000","last_clean":"2024-05-30T16:49:06.053015+0000","last_became_active":"2024-05-30T16:49:03.529396+0000","last_became_peered":"2024-05-30T16:49:03.529396+0000","last_unstale":"2024-05-30T16:49:06.053015+0000","last_undegraded":"2024-05-30T16:49:06.053015+0000","last_fullsized":"2024-05-30T16:49:06.053015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:18.318116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534179+0000","last_change":"2024-05-30T16:49:04.549628+0000","last_active":"2024-05-30T16:49:05.534179+0000","last_peered":"2024-05-30T16:49:05.534179+0000","last_clean":"2024-05-30T16:49:05.534179+0000","last_became_active":"2024-05-30T16:49:04.548782+0000","last_became_peered":"2024-05-30T16:49:04.548782+0000","last_unstale":"2024-05-30T16:49:05.534179+0000","last_undegraded":"2024-05-30T16:49:05.534179+0000","last_fullsized":"2024-05-30T16:49:05.534179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:55.007207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530197+0000","last_change":"2024-05-30T16:49:03.540089+0000","last_active":"2024-05-30T16:49:05.530197+0000","last_peered":"2024-05-30T16:49:05.530197+0000","last_clean":"2024-05-30T16:49:05.530197+0000","last_became_active":"2024-05-30T16:49:03.539760+0000","last_became_peered":"2024-05-30T16:49:03.539760+0000","last_unstale":"2024-05-30T16:49:05.530197+0000","last_undegraded":"2024-05-30T16:49:05.530197+0000","last_fullsized":"2024-05-30T16:49:05.530197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:21:15.090452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052910+0000","last_change":"2024-05-30T16:49:04.555284+0000","last_active":"2024-05-30T16:49:06.052910+0000","last_peered":"2024-05-30T16:49:06.052910+0000","last_clean":"2024-05-30T16:49:06.052910+0000","last_became_active":"2024-05-30T16:49:04.555022+0000","last_became_peered":"2024-05-30T16:49:04.555022+0000","last_unstale":"2024-05-30T16:49:06.052910+0000","last_undegraded":"2024-05-30T16:49:06.052910+0000","last_fullsized":"2024-05-30T16:49:06.052910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:42.707877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052217+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:49:06.052217+0000","last_peered":"2024-05-30T16:49:06.052217+0000","last_clean":"2024-05-30T16:49:06.052217+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:49:06.052217+0000","last_undegraded":"2024-05-30T16:49:06.052217+0000","last_fullsized":"2024-05-30T16:49:06.052217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533284+0000","last_change":"2024-05-30T16:49:03.536755+0000","last_active":"2024-05-30T16:49:05.533284+0000","last_peered":"2024-05-30T16:49:05.533284+0000","last_clean":"2024-05-30T16:49:05.533284+0000","last_became_active":"2024-05-30T16:49:03.536335+0000","last_became_peered":"2024-05-30T16:49:03.536335+0000","last_unstale":"2024-05-30T16:49:05.533284+0000","last_undegraded":"2024-05-30T16:49:05.533284+0000","last_fullsized":"2024-05-30T16:49:05.533284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051447+0000","last_change":"2024-05-30T16:49:04.546603+0000","last_active":"2024-05-30T16:49:06.051447+0000","last_peered":"2024-05-30T16:49:06.051447+0000","last_clean":"2024-05-30T16:49:06.051447+0000","last_became_active":"2024-05-30T16:49:04.545130+0000","last_became_peered":"2024-05-30T16:49:04.545130+0000","last_unstale":"2024-05-30T16:49:06.051447+0000","last_undegraded":"2024-05-30T16:49:06.051447+0000","last_fullsized":"2024-05-30T16:49:06.051447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:47.404454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052089+0000","last_change":"2024-05-30T16:49:03.548756+0000","last_active":"2024-05-30T16:49:06.052089+0000","last_peered":"2024-05-30T16:49:06.052089+0000","last_clean":"2024-05-30T16:49:06.052089+0000","last_became_active":"2024-05-30T16:49:03.548431+0000","last_became_peered":"2024-05-30T16:49:03.548431+0000","last_unstale":"2024-05-30T16:49:06.052089+0000","last_undegraded":"2024-05-30T16:49:06.052089+0000","last_fullsized":"2024-05-30T16:49:06.052089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051661+0000","last_change":"2024-05-30T16:49:04.557247+0000","last_active":"2024-05-30T16:49:06.051661+0000","last_peered":"2024-05-30T16:49:06.051661+0000","last_clean":"2024-05-30T16:49:06.051661+0000","last_became_active":"2024-05-30T16:49:04.556957+0000","last_became_peered":"2024-05-30T16:49:04.556957+0000","last_unstale":"2024-05-30T16:49:06.051661+0000","last_undegraded":"2024-05-30T16:49:06.051661+0000","last_fullsized":"2024-05-30T16:49:06.051661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530057+0000","last_change":"2024-05-30T16:49:03.548449+0000","last_active":"2024-05-30T16:49:05.530057+0000","last_peered":"2024-05-30T16:49:05.530057+0000","last_clean":"2024-05-30T16:49:05.530057+0000","last_became_active":"2024-05-30T16:49:03.547447+0000","last_became_peered":"2024-05-30T16:49:03.547447+0000","last_unstale":"2024-05-30T16:49:05.530057+0000","last_undegraded":"2024-05-30T16:49:05.530057+0000","last_fullsized":"2024-05-30T16:49:05.530057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:39:09.796452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052694+0000","last_change":"2024-05-30T16:49:04.535009+0000","last_active":"2024-05-30T16:49:06.052694+0000","last_peered":"2024-05-30T16:49:06.052694+0000","last_clean":"2024-05-30T16:49:06.052694+0000","last_became_active":"2024-05-30T16:49:04.534615+0000","last_became_peered":"2024-05-30T16:49:04.534615+0000","last_unstale":"2024-05-30T16:49:06.052694+0000","last_undegraded":"2024-05-30T16:49:06.052694+0000","last_fullsized":"2024-05-30T16:49:06.052694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534481+0000","last_change":"2024-05-30T16:49:03.526029+0000","last_active":"2024-05-30T16:49:05.534481+0000","last_peered":"2024-05-30T16:49:05.534481+0000","last_clean":"2024-05-30T16:49:05.534481+0000","last_became_active":"2024-05-30T16:49:03.525606+0000","last_became_peered":"2024-05-30T16:49:03.525606+0000","last_unstale":"2024-05-30T16:49:05.534481+0000","last_undegraded":"2024-05-30T16:49:05.534481+0000","last_fullsized":"2024-05-30T16:49:05.534481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533778+0000","last_change":"2024-05-30T16:49:04.553469+0000","last_active":"2024-05-30T16:49:05.533778+0000","last_peered":"2024-05-30T16:49:05.533778+0000","last_clean":"2024-05-30T16:49:05.533778+0000","last_became_active":"2024-05-30T16:49:04.551873+0000","last_became_peered":"2024-05-30T16:49:04.551873+0000","last_unstale":"2024-05-30T16:49:05.533778+0000","last_undegraded":"2024-05-30T16:49:05.533778+0000","last_fullsized":"2024-05-30T16:49:05.533778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:15.394210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052860+0000","last_change":"2024-05-30T16:49:03.537420+0000","last_active":"2024-05-30T16:49:06.052860+0000","last_peered":"2024-05-30T16:49:06.052860+0000","last_clean":"2024-05-30T16:49:06.052860+0000","last_became_active":"2024-05-30T16:49:03.536674+0000","last_became_peered":"2024-05-30T16:49:03.536674+0000","last_unstale":"2024-05-30T16:49:06.052860+0000","last_undegraded":"2024-05-30T16:49:06.052860+0000","last_fullsized":"2024-05-30T16:49:06.052860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534511+0000","last_change":"2024-05-30T16:49:04.557070+0000","last_active":"2024-05-30T16:49:05.534511+0000","last_peered":"2024-05-30T16:49:05.534511+0000","last_clean":"2024-05-30T16:49:05.534511+0000","last_became_active":"2024-05-30T16:49:04.556515+0000","last_became_peered":"2024-05-30T16:49:04.556515+0000","last_unstale":"2024-05-30T16:49:05.534511+0000","last_undegraded":"2024-05-30T16:49:05.534511+0000","last_fullsized":"2024-05-30T16:49:05.534511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:00.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052919+0000","last_change":"2024-05-30T16:49:03.551865+0000","last_active":"2024-05-30T16:49:06.052919+0000","last_peered":"2024-05-30T16:49:06.052919+0000","last_clean":"2024-05-30T16:49:06.052919+0000","last_became_active":"2024-05-30T16:49:03.551582+0000","last_became_peered":"2024-05-30T16:49:03.551582+0000","last_unstale":"2024-05-30T16:49:06.052919+0000","last_undegraded":"2024-05-30T16:49:06.052919+0000","last_fullsized":"2024-05-30T16:49:06.052919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:53:44.885507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052808+0000","last_change":"2024-05-30T16:49:04.537297+0000","last_active":"2024-05-30T16:49:06.052808+0000","last_peered":"2024-05-30T16:49:06.052808+0000","last_clean":"2024-05-30T16:49:06.052808+0000","last_became_active":"2024-05-30T16:49:04.535219+0000","last_became_peered":"2024-05-30T16:49:04.535219+0000","last_unstale":"2024-05-30T16:49:06.052808+0000","last_undegraded":"2024-05-30T16:49:06.052808+0000","last_fullsized":"2024-05-30T16:49:06.052808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053097+0000","last_change":"2024-05-30T16:49:03.534738+0000","last_active":"2024-05-30T16:49:06.053097+0000","last_peered":"2024-05-30T16:49:06.053097+0000","last_clean":"2024-05-30T16:49:06.053097+0000","last_became_active":"2024-05-30T16:49:03.534350+0000","last_became_peered":"2024-05-30T16:49:03.534350+0000","last_unstale":"2024-05-30T16:49:06.053097+0000","last_undegraded":"2024-05-30T16:49:06.053097+0000","last_fullsized":"2024-05-30T16:49:06.053097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052135+0000","last_change":"2024-05-30T16:49:04.544633+0000","last_active":"2024-05-30T16:49:06.052135+0000","last_peered":"2024-05-30T16:49:06.052135+0000","last_clean":"2024-05-30T16:49:06.052135+0000","last_became_active":"2024-05-30T16:49:04.544348+0000","last_became_peered":"2024-05-30T16:49:04.544348+0000","last_unstale":"2024-05-30T16:49:06.052135+0000","last_undegraded":"2024-05-30T16:49:06.052135+0000","last_fullsized":"2024-05-30T16:49:06.052135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:09.918803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053285+0000","last_change":"2024-05-30T16:49:03.547123+0000","last_active":"2024-05-30T16:49:06.053285+0000","last_peered":"2024-05-30T16:49:06.053285+0000","last_clean":"2024-05-30T16:49:06.053285+0000","last_became_active":"2024-05-30T16:49:03.546748+0000","last_became_peered":"2024-05-30T16:49:03.546748+0000","last_unstale":"2024-05-30T16:49:06.053285+0000","last_undegraded":"2024-05-30T16:49:06.053285+0000","last_fullsized":"2024-05-30T16:49:06.053285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051720+0000","last_change":"2024-05-30T16:49:04.536325+0000","last_active":"2024-05-30T16:49:06.051720+0000","last_peered":"2024-05-30T16:49:06.051720+0000","last_clean":"2024-05-30T16:49:06.051720+0000","last_became_active":"2024-05-30T16:49:04.535456+0000","last_became_peered":"2024-05-30T16:49:04.535456+0000","last_unstale":"2024-05-30T16:49:06.051720+0000","last_undegraded":"2024-05-30T16:49:06.051720+0000","last_fullsized":"2024-05-30T16:49:06.051720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051841+0000","last_change":"2024-05-30T16:49:03.551302+0000","last_active":"2024-05-30T16:49:06.051841+0000","last_peered":"2024-05-30T16:49:06.051841+0000","last_clean":"2024-05-30T16:49:06.051841+0000","last_became_active":"2024-05-30T16:49:03.551084+0000","last_became_peered":"2024-05-30T16:49:03.551084+0000","last_unstale":"2024-05-30T16:49:06.051841+0000","last_undegraded":"2024-05-30T16:49:06.051841+0000","last_fullsized":"2024-05-30T16:49:06.051841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533890+0000","last_change":"2024-05-30T16:49:04.548525+0000","last_active":"2024-05-30T16:49:05.533890+0000","last_peered":"2024-05-30T16:49:05.533890+0000","last_clean":"2024-05-30T16:49:05.533890+0000","last_became_active":"2024-05-30T16:49:04.548054+0000","last_became_peered":"2024-05-30T16:49:04.548054+0000","last_unstale":"2024-05-30T16:49:05.533890+0000","last_undegraded":"2024-05-30T16:49:05.533890+0000","last_fullsized":"2024-05-30T16:49:05.533890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:49.724960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052859+0000","last_change":"2024-05-30T16:49:03.546920+0000","last_active":"2024-05-30T16:49:06.052859+0000","last_peered":"2024-05-30T16:49:06.052859+0000","last_clean":"2024-05-30T16:49:06.052859+0000","last_became_active":"2024-05-30T16:49:03.545621+0000","last_became_peered":"2024-05-30T16:49:03.545621+0000","last_unstale":"2024-05-30T16:49:06.052859+0000","last_undegraded":"2024-05-30T16:49:06.052859+0000","last_fullsized":"2024-05-30T16:49:06.052859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051851+0000","last_change":"2024-05-30T16:49:04.535297+0000","last_active":"2024-05-30T16:49:06.051851+0000","last_peered":"2024-05-30T16:49:06.051851+0000","last_clean":"2024-05-30T16:49:06.051851+0000","last_became_active":"2024-05-30T16:49:04.534907+0000","last_became_peered":"2024-05-30T16:49:04.534907+0000","last_unstale":"2024-05-30T16:49:06.051851+0000","last_undegraded":"2024-05-30T16:49:06.051851+0000","last_fullsized":"2024-05-30T16:49:06.051851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:56.163039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052768+0000","last_change":"2024-05-30T16:49:03.536690+0000","last_active":"2024-05-30T16:49:06.052768+0000","last_peered":"2024-05-30T16:49:06.052768+0000","last_clean":"2024-05-30T16:49:06.052768+0000","last_became_active":"2024-05-30T16:49:03.536351+0000","last_became_peered":"2024-05-30T16:49:03.536351+0000","last_unstale":"2024-05-30T16:49:06.052768+0000","last_undegraded":"2024-05-30T16:49:06.052768+0000","last_fullsized":"2024-05-30T16:49:06.052768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051567+0000","last_change":"2024-05-30T16:49:04.556339+0000","last_active":"2024-05-30T16:49:06.051567+0000","last_peered":"2024-05-30T16:49:06.051567+0000","last_clean":"2024-05-30T16:49:06.051567+0000","last_became_active":"2024-05-30T16:49:04.556012+0000","last_became_peered":"2024-05-30T16:49:04.556012+0000","last_unstale":"2024-05-30T16:49:06.051567+0000","last_undegraded":"2024-05-30T16:49:06.051567+0000","last_fullsized":"2024-05-30T16:49:06.051567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:23.369792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052569+0000","last_change":"2024-05-30T16:49:03.550153+0000","last_active":"2024-05-30T16:49:06.052569+0000","last_peered":"2024-05-30T16:49:06.052569+0000","last_clean":"2024-05-30T16:49:06.052569+0000","last_became_active":"2024-05-30T16:49:03.549872+0000","last_became_peered":"2024-05-30T16:49:03.549872+0000","last_unstale":"2024-05-30T16:49:06.052569+0000","last_undegraded":"2024-05-30T16:49:06.052569+0000","last_fullsized":"2024-05-30T16:49:06.052569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:58.145285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052911+0000","last_change":"2024-05-30T16:49:04.558227+0000","last_active":"2024-05-30T16:49:06.052911+0000","last_peered":"2024-05-30T16:49:06.052911+0000","last_clean":"2024-05-30T16:49:06.052911+0000","last_became_active":"2024-05-30T16:49:04.557978+0000","last_became_peered":"2024-05-30T16:49:04.557978+0000","last_unstale":"2024-05-30T16:49:06.052911+0000","last_undegraded":"2024-05-30T16:49:06.052911+0000","last_fullsized":"2024-05-30T16:49:06.052911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534339+0000","last_change":"2024-05-30T16:49:04.561331+0000","last_active":"2024-05-30T16:49:05.534339+0000","last_peered":"2024-05-30T16:49:05.534339+0000","last_clean":"2024-05-30T16:49:05.534339+0000","last_became_active":"2024-05-30T16:49:04.560894+0000","last_became_peered":"2024-05-30T16:49:04.560894+0000","last_unstale":"2024-05-30T16:49:05.534339+0000","last_undegraded":"2024-05-30T16:49:05.534339+0000","last_fullsized":"2024-05-30T16:49:05.534339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:45:42.077957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052112+0000","last_change":"2024-05-30T16:49:03.549087+0000","last_active":"2024-05-30T16:49:06.052112+0000","last_peered":"2024-05-30T16:49:06.052112+0000","last_clean":"2024-05-30T16:49:06.052112+0000","last_became_active":"2024-05-30T16:49:03.548736+0000","last_became_peered":"2024-05-30T16:49:03.548736+0000","last_unstale":"2024-05-30T16:49:06.052112+0000","last_undegraded":"2024-05-30T16:49:06.052112+0000","last_fullsized":"2024-05-30T16:49:06.052112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534726+0000","last_change":"2024-05-30T16:49:04.561436+0000","last_active":"2024-05-30T16:49:05.534726+0000","last_peered":"2024-05-30T16:49:05.534726+0000","last_clean":"2024-05-30T16:49:05.534726+0000","last_became_active":"2024-05-30T16:49:04.561159+0000","last_became_peered":"2024-05-30T16:49:04.561159+0000","last_unstale":"2024-05-30T16:49:05.534726+0000","last_undegraded":"2024-05-30T16:49:05.534726+0000","last_fullsized":"2024-05-30T16:49:05.534726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:47:24.068734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052643+0000","last_change":"2024-05-30T16:49:03.552644+0000","last_active":"2024-05-30T16:49:06.052643+0000","last_peered":"2024-05-30T16:49:06.052643+0000","last_clean":"2024-05-30T16:49:06.052643+0000","last_became_active":"2024-05-30T16:49:03.552304+0000","last_became_peered":"2024-05-30T16:49:03.552304+0000","last_unstale":"2024-05-30T16:49:06.052643+0000","last_undegraded":"2024-05-30T16:49:06.052643+0000","last_fullsized":"2024-05-30T16:49:06.052643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:18.318116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051834+0000","last_change":"2024-05-30T16:49:04.542732+0000","last_active":"2024-05-30T16:49:06.051834+0000","last_peered":"2024-05-30T16:49:06.051834+0000","last_clean":"2024-05-30T16:49:06.051834+0000","last_became_active":"2024-05-30T16:49:04.542400+0000","last_became_peered":"2024-05-30T16:49:04.542400+0000","last_unstale":"2024-05-30T16:49:06.051834+0000","last_undegraded":"2024-05-30T16:49:06.051834+0000","last_fullsized":"2024-05-30T16:49:06.051834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052111+0000","last_change":"2024-05-30T16:49:03.546038+0000","last_active":"2024-05-30T16:49:06.052111+0000","last_peered":"2024-05-30T16:49:06.052111+0000","last_clean":"2024-05-30T16:49:06.052111+0000","last_became_active":"2024-05-30T16:49:03.545623+0000","last_became_peered":"2024-05-30T16:49:03.545623+0000","last_unstale":"2024-05-30T16:49:06.052111+0000","last_undegraded":"2024-05-30T16:49:06.052111+0000","last_fullsized":"2024-05-30T16:49:06.052111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:40.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052052+0000","last_change":"2024-05-30T16:49:04.546841+0000","last_active":"2024-05-30T16:49:06.052052+0000","last_peered":"2024-05-30T16:49:06.052052+0000","last_clean":"2024-05-30T16:49:06.052052+0000","last_became_active":"2024-05-30T16:49:04.546596+0000","last_became_peered":"2024-05-30T16:49:04.546596+0000","last_unstale":"2024-05-30T16:49:06.052052+0000","last_undegraded":"2024-05-30T16:49:06.052052+0000","last_fullsized":"2024-05-30T16:49:06.052052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:06.186315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051977+0000","last_change":"2024-05-30T16:49:03.551604+0000","last_active":"2024-05-30T16:49:06.051977+0000","last_peered":"2024-05-30T16:49:06.051977+0000","last_clean":"2024-05-30T16:49:06.051977+0000","last_became_active":"2024-05-30T16:49:03.551333+0000","last_became_peered":"2024-05-30T16:49:03.551333+0000","last_unstale":"2024-05-30T16:49:06.051977+0000","last_undegraded":"2024-05-30T16:49:06.051977+0000","last_fullsized":"2024-05-30T16:49:06.051977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:23.050556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":81081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":671961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:49:13.603 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:49:13.603 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-30T16:49:13.604 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-30T16:49:13.604 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-30T16:49:13.604 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-30T16:49:13.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.778+0000 7ff911e00640 1 Processor -- start 2024-05-30T16:49:13.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.778+0000 7ff911e00640 1 -- start start 2024-05-30T16:49:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.778+0000 7ff911e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff90c159df0 0x7ff90c0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.778+0000 7ff911e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff90c0b3e50 0x7ff90c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.778+0000 7ff911e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff90c15d730 con 0x7ff90c15a1d0 2024-05-30T16:49:13.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.778+0000 7ff911e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff90c0b3370 con 0x7ff90c0b3e50 2024-05-30T16:49:13.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.778+0000 7ff911e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff90c0b3650 con 0x7ff90c159df0 2024-05-30T16:49:13.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.778+0000 7ff90b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff90c0b3e50 0x7ff90c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:13.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.778+0000 7ff903e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff90c15a1d0 0x7ff90c15ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40030/0 (socket says 172.21.15.59:40030) 2024-05-30T16:49:13.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.778+0000 7ff903e00640 1 -- 172.21.15.59:0/3480418810 learned_addr learned my addr 172.21.15.59:0/3480418810 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff90aa00640 1 --2- 172.21.15.59:0/3480418810 >> v2:172.21.15.107:3300/0 conn(0x7ff90c159df0 0x7ff90c0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff90b400640 1 -- 172.21.15.59:0/3480418810 >> v2:172.21.15.107:3300/0 conn(0x7ff90c159df0 msgr2=0x7ff90c0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff90b400640 1 --2- 172.21.15.59:0/3480418810 >> v2:172.21.15.107:3300/0 conn(0x7ff90c159df0 0x7ff90c0ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff90b400640 1 -- 172.21.15.59:0/3480418810 >> v1:172.21.15.59:6789/0 conn(0x7ff90c15a1d0 legacy=0x7ff90c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff90b400640 1 -- 172.21.15.59:0/3480418810 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c0b3930 con 0x7ff90c0b3e50 2024-05-30T16:49:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff90a000640 1 -- 172.21.15.59:0/3480418810 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 565565781 0 0) 0x7ff90c15d730 con 0x7ff90c15a1d0 2024-05-30T16:49:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff90aa00640 1 --2- 172.21.15.59:0/3480418810 >> v2:172.21.15.107:3300/0 conn(0x7ff90c159df0 0x7ff90c0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff90b400640 1 --2- 172.21.15.59:0/3480418810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c0b3e50 0x7ff90c0ad6f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0b4c20 tx=0x7ff90401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2c08d0633d9b4b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff90a000640 1 -- 172.21.15.59:0/3480418810 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9040b2070 con 0x7ff90c0b3e50 2024-05-30T16:49:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff90a000640 1 -- 172.21.15.59:0/3480418810 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9040a5800 con 0x7ff90c0b3e50 2024-05-30T16:49:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff90a000640 1 -- 172.21.15.59:0/3480418810 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9040a5bd0 con 0x7ff90c0b3e50 2024-05-30T16:49:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff911e00640 1 -- 172.21.15.59:0/3480418810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c0b3e50 msgr2=0x7ff90c0ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff911e00640 1 --2- 172.21.15.59:0/3480418810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c0b3e50 0x7ff90c0ad6f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0b4c20 tx=0x7ff90401c930 comp rx=0 tx=0).stop 2024-05-30T16:49:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff911e00640 1 -- 172.21.15.59:0/3480418810 shutdown_connections 2024-05-30T16:49:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff911e00640 1 --2- 172.21.15.59:0/3480418810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c0b3e50 0x7ff90c0ad6f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff911e00640 1 --2- 172.21.15.59:0/3480418810 >> v2:172.21.15.107:3300/0 conn(0x7ff90c159df0 0x7ff90c0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff911e00640 1 -- 172.21.15.59:0/3480418810 >> 172.21.15.59:0/3480418810 conn(0x7ff90c0b22d0 msgr2=0x7ff90c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.782+0000 7ff911e00640 1 -- 172.21.15.59:0/3480418810 shutdown_connections 2024-05-30T16:49:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff911e00640 1 -- 172.21.15.59:0/3480418810 wait complete. 2024-05-30T16:49:13.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff911e00640 1 Processor -- start 2024-05-30T16:49:13.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff911e00640 1 -- start start 2024-05-30T16:49:13.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff911e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c0b3e50 0x7ff90c072820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff911e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff90c159df0 0x7ff90c14e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff911e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff90c15a1d0 0x7ff90c15efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff911e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c15e720 con 0x7ff90c0b3e50 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff911e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c15e5a0 con 0x7ff90c159df0 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff911e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff90c15e8a0 con 0x7ff90c15a1d0 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff90aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c0b3e50 0x7ff90c072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff90aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c0b3e50 0x7ff90c072820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54122/0 (socket says 172.21.15.59:54122) 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff90aa00640 1 -- 172.21.15.59:0/79216738 learned_addr learned my addr 172.21.15.59:0/79216738 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff903e00640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff90c159df0 0x7ff90c14e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff90b400640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff90c15a1d0 0x7ff90c15efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff90aa00640 1 -- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff90c15a1d0 msgr2=0x7ff90c15efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff90aa00640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff90c15a1d0 0x7ff90c15efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff90aa00640 1 -- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff90c159df0 msgr2=0x7ff90c14e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff90aa00640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff90c159df0 0x7ff90c14e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff90aa00640 1 -- 172.21.15.59:0/79216738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c0b2750 con 0x7ff90c0b3e50 2024-05-30T16:49:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff90aa00640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c0b3e50 0x7ff90c072820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c7c0 tx=0x7ff8fc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff903400640 1 -- 172.21.15.59:0/79216738 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc007a30 con 0x7ff90c0b3e50 2024-05-30T16:49:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff903400640 1 -- 172.21.15.59:0/79216738 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8fc007bd0 con 0x7ff90c0b3e50 2024-05-30T16:49:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff903400640 1 -- 172.21.15.59:0/79216738 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0113f0 con 0x7ff90c0b3e50 2024-05-30T16:49:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.786+0000 7ff911e00640 1 -- 172.21.15.59:0/79216738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff90c14b710 con 0x7ff90c0b3e50 2024-05-30T16:49:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.790+0000 7ff911e00640 1 -- 172.21.15.59:0/79216738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff90c0731b0 con 0x7ff90c0b3e50 2024-05-30T16:49:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.790+0000 7ff911e00640 1 -- 172.21.15.59:0/79216738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff90c068a90 con 0x7ff90c0b3e50 2024-05-30T16:49:13.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.790+0000 7ff903400640 1 -- 172.21.15.59:0/79216738 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff8fc011590 con 0x7ff90c0b3e50 2024-05-30T16:49:13.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.790+0000 7ff903400640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff8e8068380 0x7ff8e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:13.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.790+0000 7ff903400640 1 -- 172.21.15.59:0/79216738 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff8fc086ba0 con 0x7ff90c0b3e50 2024-05-30T16:49:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.790+0000 7ff903e00640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff8e8068380 0x7ff8e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.790+0000 7ff903e00640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff8e8068380 0x7ff8e806a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff90c14cec0 tx=0x7ff8f4007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:13.794+0000 7ff903400640 1 -- 172.21.15.59:0/79216738 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff8fc015020 con 0x7ff90c0b3e50 2024-05-30T16:49:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.002+0000 7ff911e00640 1 -- 172.21.15.59:0/79216738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff90c0cf590 con 0x7ff90c0b3e50 2024-05-30T16:49:14.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.006+0000 7ff903400640 1 -- 172.21.15.59:0/79216738 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168091 (secure 0 0 0) 0x7ff8fc057150 con 0x7ff90c0b3e50 2024-05-30T16:49:14.014 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.010+0000 7ff911e00640 1 -- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff8e8068380 msgr2=0x7ff8e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.010+0000 7ff911e00640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff8e8068380 0x7ff8e806a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff90c14cec0 tx=0x7ff8f4007b60 comp rx=0 tx=0).stop 2024-05-30T16:49:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.010+0000 7ff911e00640 1 -- 172.21.15.59:0/79216738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c0b3e50 msgr2=0x7ff90c072820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.010+0000 7ff911e00640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c0b3e50 0x7ff90c072820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c7c0 tx=0x7ff8fc00cc80 comp rx=0 tx=0).stop 2024-05-30T16:49:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.010+0000 7ff911e00640 1 -- 172.21.15.59:0/79216738 shutdown_connections 2024-05-30T16:49:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.010+0000 7ff911e00640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff8e8068380 0x7ff8e806a840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.010+0000 7ff911e00640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff90c15a1d0 0x7ff90c15efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.010+0000 7ff911e00640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff90c159df0 0x7ff90c14e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.010+0000 7ff911e00640 1 --2- 172.21.15.59:0/79216738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c0b3e50 0x7ff90c072820 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.010+0000 7ff911e00640 1 -- 172.21.15.59:0/79216738 >> 172.21.15.59:0/79216738 conn(0x7ff90c0b22d0 msgr2=0x7ff90c0b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.010+0000 7ff911e00640 1 -- 172.21.15.59:0/79216738 shutdown_connections 2024-05-30T16:49:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.010+0000 7ff911e00640 1 -- 172.21.15.59:0/79216738 wait complete. 2024-05-30T16:49:14.033 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1203848956},{"type":"v1","addr":"172.21.15.107:6833","nonce":1203848956}]},"active_addr":"172.21.15.107:6833/1203848956","active_change":"2024-05-30T16:48:45.057270+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":2504375130}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3400096362}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3118294624}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":682707900}]}]} 2024-05-30T16:49:14.036 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-30T16:49:14.036 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-30T16:49:14.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:14.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3557e00640 1 Processor -- start 2024-05-30T16:49:14.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3557e00640 1 -- start start 2024-05-30T16:49:14.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3557e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f355009b150 0x7f35500cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3557e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f355009b780 0x7f35500ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3557e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35500d1310 con 0x7f3550160d90 2024-05-30T16:49:14.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3557e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f355009bcf0 con 0x7f355009b150 2024-05-30T16:49:14.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3557e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f35500d0a70 con 0x7f355009b780 2024-05-30T16:49:14.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3555400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3550160d90 0x7f355009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40046/0 (socket says 172.21.15.59:40046) 2024-05-30T16:49:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3555400640 1 -- 172.21.15.59:0/4151262931 learned_addr learned my addr 172.21.15.59:0/4151262931 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3555e00640 1 --2- 172.21.15.59:0/4151262931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f355009b780 0x7f35500ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3554a00640 1 --2- 172.21.15.59:0/4151262931 >> v2:172.21.15.107:3300/0 conn(0x7f355009b150 0x7f35500cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f354fe00640 1 -- 172.21.15.59:0/4151262931 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1718883254 0 0) 0x7f35500d1310 con 0x7f3550160d90 2024-05-30T16:49:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f354fe00640 1 -- 172.21.15.59:0/4151262931 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3538003530 con 0x7f3550160d90 2024-05-30T16:49:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3555e00640 1 -- 172.21.15.59:0/4151262931 >> v2:172.21.15.107:3300/0 conn(0x7f355009b150 msgr2=0x7f35500cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3555e00640 1 --2- 172.21.15.59:0/4151262931 >> v2:172.21.15.107:3300/0 conn(0x7f355009b150 0x7f35500cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3555e00640 1 -- 172.21.15.59:0/4151262931 >> v1:172.21.15.59:6789/0 conn(0x7f3550160d90 legacy=0x7f355009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f354fe00640 1 -- 172.21.15.59:0/4151262931 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 366250639 0 0) 0x7f3538003530 con 0x7f3550160d90 2024-05-30T16:49:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.174+0000 7f3555e00640 1 -- 172.21.15.59:0/4151262931 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35500d0d50 con 0x7f355009b780 2024-05-30T16:49:14.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.178+0000 7f3555e00640 1 --2- 172.21.15.59:0/4151262931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f355009b780 0x7f35500ce260 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3548009d90 tx=0x7f354801c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfcb0a6597093a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.178+0000 7f354fe00640 1 -- 172.21.15.59:0/4151262931 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35480b2070 con 0x7f355009b780 2024-05-30T16:49:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.178+0000 7f354fe00640 1 -- 172.21.15.59:0/4151262931 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35480a5510 con 0x7f355009b780 2024-05-30T16:49:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.178+0000 7f354fe00640 1 -- 172.21.15.59:0/4151262931 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544001680 con 0x7f355009b780 2024-05-30T16:49:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.178+0000 7f3557e00640 1 -- 172.21.15.59:0/4151262931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f355009b780 msgr2=0x7f35500ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.178+0000 7f3557e00640 1 --2- 172.21.15.59:0/4151262931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f355009b780 0x7f35500ce260 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3548009d90 tx=0x7f354801c800 comp rx=0 tx=0).stop 2024-05-30T16:49:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.178+0000 7f3557e00640 1 -- 172.21.15.59:0/4151262931 shutdown_connections 2024-05-30T16:49:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.178+0000 7f3557e00640 1 --2- 172.21.15.59:0/4151262931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f355009b780 0x7f35500ce260 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.178+0000 7f3557e00640 1 --2- 172.21.15.59:0/4151262931 >> v2:172.21.15.107:3300/0 conn(0x7f355009b150 0x7f35500cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.178+0000 7f3557e00640 1 -- 172.21.15.59:0/4151262931 >> 172.21.15.59:0/4151262931 conn(0x7f35500b3f80 msgr2=0x7f35500b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.178+0000 7f3557e00640 1 -- 172.21.15.59:0/4151262931 shutdown_connections 2024-05-30T16:49:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.178+0000 7f3557e00640 1 -- 172.21.15.59:0/4151262931 wait complete. 2024-05-30T16:49:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3557e00640 1 Processor -- start 2024-05-30T16:49:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3557e00640 1 -- start start 2024-05-30T16:49:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3557e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355009b150 0x7f355015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3557e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f355009b780 0x7f35501578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3557e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3550160d90 0x7f35501581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3557e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3550071fe0 con 0x7f355009b150 2024-05-30T16:49:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3557e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3550071e60 con 0x7f3550160d90 2024-05-30T16:49:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3557e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3550161170 con 0x7f355009b780 2024-05-30T16:49:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3555400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355009b150 0x7f355015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3555400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355009b150 0x7f355015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54132/0 (socket says 172.21.15.59:54132) 2024-05-30T16:49:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3555400640 1 -- 172.21.15.59:0/1967263557 learned_addr learned my addr 172.21.15.59:0/1967263557 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3554a00640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f355009b780 0x7f35501578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3555400640 1 -- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f355009b780 msgr2=0x7f35501578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3555e00640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3550160d90 0x7f35501581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3555400640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f355009b780 0x7f35501578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3555400640 1 -- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3550160d90 msgr2=0x7f35501581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3555400640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3550160d90 0x7f35501581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3555400640 1 -- 172.21.15.59:0/1967263557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35500c7080 con 0x7f355009b150 2024-05-30T16:49:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3554a00640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f355009b780 0x7f35501578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3555e00640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3550160d90 0x7f35501581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3555400640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355009b150 0x7f355015d7d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f354400c750 tx=0x7f354400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f354d600640 1 -- 172.21.15.59:0/1967263557 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544005ae0 con 0x7f355009b150 2024-05-30T16:49:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f354d600640 1 -- 172.21.15.59:0/1967263557 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3544005ca0 con 0x7f355009b150 2024-05-30T16:49:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f354d600640 1 -- 172.21.15.59:0/1967263557 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440072b0 con 0x7f355009b150 2024-05-30T16:49:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3557e00640 1 -- 172.21.15.59:0/1967263557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35500c7360 con 0x7f355009b150 2024-05-30T16:49:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3557e00640 1 -- 172.21.15.59:0/1967263557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35500c8dd0 con 0x7f355009b150 2024-05-30T16:49:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.182+0000 7f3557e00640 1 -- 172.21.15.59:0/1967263557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3550068a90 con 0x7f355009b150 2024-05-30T16:49:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.186+0000 7f354d600640 1 -- 172.21.15.59:0/1967263557 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3544007450 con 0x7f355009b150 2024-05-30T16:49:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.186+0000 7f354d600640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f35300683b0 0x7f353006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.186+0000 7f354d600640 1 -- 172.21.15.59:0/1967263557 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f35440867d0 con 0x7f355009b150 2024-05-30T16:49:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.186+0000 7f3554a00640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f35300683b0 0x7f353006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.186+0000 7f3554a00640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f35300683b0 0x7f353006a870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f355015dd10 tx=0x7f353c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:14.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.190+0000 7f354d600640 1 -- 172.21.15.59:0/1967263557 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3544010300 con 0x7f355009b150 2024-05-30T16:49:14.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.354+0000 7f3557e00640 1 -- 172.21.15.59:0/1967263557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35500b3d60 con 0x7f355009b150 2024-05-30T16:49:14.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f354d600640 1 -- 172.21.15.59:0/1967263557 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f3544056d90 con 0x7f355009b150 2024-05-30T16:49:14.363 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:14.363 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":23,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:49:05.525706+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:01.850911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:02.883949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:14.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f3557e00640 1 -- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f35300683b0 msgr2=0x7f353006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f3557e00640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f35300683b0 0x7f353006a870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f355015dd10 tx=0x7f353c008040 comp rx=0 tx=0).stop 2024-05-30T16:49:14.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f3557e00640 1 -- 172.21.15.59:0/1967263557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355009b150 msgr2=0x7f355015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f3557e00640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355009b150 0x7f355015d7d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f354400c750 tx=0x7f354400cc10 comp rx=0 tx=0).stop 2024-05-30T16:49:14.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f3557e00640 1 -- 172.21.15.59:0/1967263557 shutdown_connections 2024-05-30T16:49:14.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f3557e00640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f35300683b0 0x7f353006a870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f3557e00640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3550160d90 0x7f35501581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f3557e00640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f355009b780 0x7f35501578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f3557e00640 1 --2- 172.21.15.59:0/1967263557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355009b150 0x7f355015d7d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f3557e00640 1 -- 172.21.15.59:0/1967263557 >> 172.21.15.59:0/1967263557 conn(0x7f35500b3f80 msgr2=0x7f355015ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:14.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f3557e00640 1 -- 172.21.15.59:0/1967263557 shutdown_connections 2024-05-30T16:49:14.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.358+0000 7f3557e00640 1 -- 172.21.15.59:0/1967263557 wait complete. 2024-05-30T16:49:14.385 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-30T16:49:14.385 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.518+0000 7fb322600640 1 Processor -- start 2024-05-30T16:49:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.518+0000 7fb322600640 1 -- start start 2024-05-30T16:49:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.522+0000 7fb322600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb31c070710 0x7fb31c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.522+0000 7fb322600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb31c0cde00 con 0x7fb31c15ff30 2024-05-30T16:49:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.522+0000 7fb322600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb31c070bd0 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.522+0000 7fb322600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb31c070e70 con 0x7fb31c070710 2024-05-30T16:49:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.522+0000 7fb313e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb31c070710 0x7fb31c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.522+0000 7fb31b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb31c15ff30 0x7fb31c070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40056/0 (socket says 172.21.15.59:40056) 2024-05-30T16:49:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.522+0000 7fb31b400640 1 -- 172.21.15.59:0/738480935 learned_addr learned my addr 172.21.15.59:0/738480935 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.522+0000 7fb313e00640 1 -- 172.21.15.59:0/738480935 >> v1:172.21.15.107:6789/0 conn(0x7fb31c0b1ac0 legacy=0x7fb31c09af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.522+0000 7fb313e00640 1 -- 172.21.15.59:0/738480935 >> v1:172.21.15.59:6789/0 conn(0x7fb31c15ff30 legacy=0x7fb31c070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.522+0000 7fb31aa00640 1 -- 172.21.15.59:0/738480935 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2240370444 0 0) 0x7fb31c0cde00 con 0x7fb31c15ff30 2024-05-30T16:49:14.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.522+0000 7fb313e00640 1 -- 172.21.15.59:0/738480935 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31c072020 con 0x7fb31c070710 2024-05-30T16:49:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb313e00640 1 --2- 172.21.15.59:0/738480935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c070710 0x7fb31c09aa40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb3040097c0 tx=0x7fb30401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f8c797140d5361 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb31aa00640 1 -- 172.21.15.59:0/738480935 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3040b0070 con 0x7fb31c070710 2024-05-30T16:49:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb31aa00640 1 -- 172.21.15.59:0/738480935 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3040ab600 con 0x7fb31c070710 2024-05-30T16:49:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb31aa00640 1 -- 172.21.15.59:0/738480935 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3040ab9d0 con 0x7fb31c070710 2024-05-30T16:49:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb322600640 1 -- 172.21.15.59:0/738480935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c070710 msgr2=0x7fb31c09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb322600640 1 --2- 172.21.15.59:0/738480935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c070710 0x7fb31c09aa40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb3040097c0 tx=0x7fb30401c410 comp rx=0 tx=0).stop 2024-05-30T16:49:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb322600640 1 -- 172.21.15.59:0/738480935 shutdown_connections 2024-05-30T16:49:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb322600640 1 --2- 172.21.15.59:0/738480935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c070710 0x7fb31c09aa40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb322600640 1 -- 172.21.15.59:0/738480935 >> 172.21.15.59:0/738480935 conn(0x7fb31c0b3f70 msgr2=0x7fb31c0b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb322600640 1 -- 172.21.15.59:0/738480935 shutdown_connections 2024-05-30T16:49:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb322600640 1 -- 172.21.15.59:0/738480935 wait complete. 2024-05-30T16:49:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb322600640 1 Processor -- start 2024-05-30T16:49:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.526+0000 7fb322600640 1 -- start start 2024-05-30T16:49:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb322600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb31c070710 0x7fb31c1569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb322600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c0b1ac0 0x7fb31c0b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb322600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb31c15ff30 0x7fb31c166810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb322600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c16ad00 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb322600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c09bcf0 con 0x7fb31c15ff30 2024-05-30T16:49:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb322600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb31c16ae80 con 0x7fb31c070710 2024-05-30T16:49:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c0b1ac0 0x7fb31c0b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c0b1ac0 0x7fb31c0b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54140/0 (socket says 172.21.15.59:54140) 2024-05-30T16:49:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313e00640 1 -- 172.21.15.59:0/530621481 learned_addr learned my addr 172.21.15.59:0/530621481 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb31be00640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb31c15ff30 0x7fb31c166810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb31b400640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb31c070710 0x7fb31c1569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313e00640 1 -- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb31c070710 msgr2=0x7fb31c1569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313e00640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb31c070710 0x7fb31c1569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313e00640 1 -- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb31c15ff30 msgr2=0x7fb31c166810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313e00640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb31c15ff30 0x7fb31c166810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313e00640 1 -- 172.21.15.59:0/530621481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31c156f20 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb31be00640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb31c15ff30 0x7fb31c166810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb31b400640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb31c070710 0x7fb31c1569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313e00640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c0b1ac0 0x7fb31c0b52d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb304019020 tx=0x7fb3040191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313400640 1 -- 172.21.15.59:0/530621481 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3040b0040 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313400640 1 -- 172.21.15.59:0/530621481 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3040b4410 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313400640 1 -- 172.21.15.59:0/530621481 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3040b47e0 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb322600640 1 -- 172.21.15.59:0/530621481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb31c165a50 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb322600640 1 -- 172.21.15.59:0/530621481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb31c166010 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb322600640 1 -- 172.21.15.59:0/530621481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb31c068a90 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.530+0000 7fb313400640 1 -- 172.21.15.59:0/530621481 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb3040bc020 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.534+0000 7fb313400640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2f8068380 0x7fb2f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.534+0000 7fb313400640 1 -- 172.21.15.59:0/530621481 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb3041201f0 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.534+0000 7fb31b400640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2f8068380 0x7fb2f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.534+0000 7fb31b400640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2f8068380 0x7fb2f806a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb30c000f70 tx=0x7fb30c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:14.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.538+0000 7fb313400640 1 -- 172.21.15.59:0/530621481 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb304016090 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.702+0000 7fb322600640 1 -- 172.21.15.59:0/530621481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb31c1673b0 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb313400640 1 -- 172.21.15.59:0/530621481 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7fb3040f0680 con 0x7fb31c0b1ac0 2024-05-30T16:49:14.711 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:14.711 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":23,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:49:05.525706+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:01.850911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:02.883949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:14.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb322600640 1 -- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2f8068380 msgr2=0x7fb2f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb322600640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2f8068380 0x7fb2f806a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb30c000f70 tx=0x7fb30c009040 comp rx=0 tx=0).stop 2024-05-30T16:49:14.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb322600640 1 -- 172.21.15.59:0/530621481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c0b1ac0 msgr2=0x7fb31c0b52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb322600640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c0b1ac0 0x7fb31c0b52d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb304019020 tx=0x7fb3040191b0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb322600640 1 -- 172.21.15.59:0/530621481 shutdown_connections 2024-05-30T16:49:14.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb322600640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2f8068380 0x7fb2f806a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb322600640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb31c15ff30 0x7fb31c166810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb322600640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c0b1ac0 0x7fb31c0b52d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb322600640 1 --2- 172.21.15.59:0/530621481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb31c070710 0x7fb31c1569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb322600640 1 -- 172.21.15.59:0/530621481 >> 172.21.15.59:0/530621481 conn(0x7fb31c0b3f70 msgr2=0x7fb31c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:14.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb322600640 1 -- 172.21.15.59:0/530621481 shutdown_connections 2024-05-30T16:49:14.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.706+0000 7fb322600640 1 -- 172.21.15.59:0/530621481 wait complete. 2024-05-30T16:49:14.732 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-30T16:49:14.733 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-30T16:49:14.733 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-30T16:49:14.733 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-30T16:49:14.734 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-30T16:49:14.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-30T16:49:14.738 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-30T16:49:14.738 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-30T16:49:14.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.974+0000 7f58a5600640 1 Processor -- start 2024-05-30T16:49:14.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.974+0000 7f58a5600640 1 -- start start 2024-05-30T16:49:14.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.974+0000 7f58a5600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58a015a950 0x7f58a00b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.974+0000 7f58a5600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f58a00b26e0 0x7f58a00734e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.974+0000 7f58a5600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a00b18d0 con 0x7f58a0073060 2024-05-30T16:49:14.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.974+0000 7f58a5600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f58a00b3b20 con 0x7f58a015a950 2024-05-30T16:49:14.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.974+0000 7f58a5600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f58a00b1bb0 con 0x7f58a00b26e0 2024-05-30T16:49:14.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.974+0000 7f589f400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f58a0073060 0x7f58a00ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:54198/0 (socket says 172.21.15.59:54198) 2024-05-30T16:49:14.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589f400640 1 -- 172.21.15.59:0/3623190789 learned_addr learned my addr 172.21.15.59:0/3623190789 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:14.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268733459 0 0) 0x7f58a00b18d0 con 0x7f58a0073060 2024-05-30T16:49:14.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5884003530 con 0x7f58a0073060 2024-05-30T16:49:14.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2413204832 0 0) 0x7f5884003530 con 0x7f58a0073060 2024-05-30T16:49:14.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 >> v2:172.21.15.107:3300/0 conn(0x7f58a00b26e0 msgr2=0x7f58a00734e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:14.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 --2- 172.21.15.59:0/3623190789 >> v2:172.21.15.107:3300/0 conn(0x7f58a00b26e0 0x7f58a00734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 >> v2:172.21.15.59:3300/0 conn(0x7f58a015a950 msgr2=0x7f58a00b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:14.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 --2- 172.21.15.59:0/3623190789 >> v2:172.21.15.59:3300/0 conn(0x7f58a015a950 0x7f58a00b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a00cde40 con 0x7f58a0073060 2024-05-30T16:49:14.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f5898001a00 con 0x7f58a0073060 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 >> v1:172.21.15.107:6789/0 conn(0x7f58a0073060 legacy=0x7f58a00ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 --2- 172.21.15.59:0/3623190789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58840039c0 0x7f5884003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 --2- 172.21.15.59:0/3623190789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5884004810 0x7f5884004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 --2- 172.21.15.59:0/3623190789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58840051d0 0x7f588400ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58a00b3b20 con 0x7f58840039c0 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f58a00b1bb0 con 0x7f58840051d0 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5884010690 con 0x7f5884004810 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589f400640 1 --2- 172.21.15.59:0/3623190789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5884004810 0x7f5884004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589f400640 1 -- 172.21.15.59:0/3623190789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58840051d0 msgr2=0x7f588400ffe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589f400640 1 --2- 172.21.15.59:0/3623190789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58840051d0 0x7f588400ffe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589f400640 1 -- 172.21.15.59:0/3623190789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58840039c0 msgr2=0x7f5884003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589f400640 1 --2- 172.21.15.59:0/3623190789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58840039c0 0x7f5884003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f589f400640 1 -- 172.21.15.59:0/3623190789 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a00cde40 con 0x7f5884004810 2024-05-30T16:49:14.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f58a4c00640 1 -- 172.21.15.59:0/3623190789 reap_dead start 2024-05-30T16:49:14.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f1397e00640 1 Processor -- start 2024-05-30T16:49:14.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.978+0000 7f1397e00640 1 -- start start 2024-05-30T16:49:14.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1397e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1390047c20 0x7f13900eb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1397e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1390005ea0 0x7f13900062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1397e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1390034220 con 0x7f1390033e40 2024-05-30T16:49:14.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1397e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1390050210 con 0x7f1390047c20 2024-05-30T16:49:14.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1397e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1390037bc0 con 0x7f1390005ea0 2024-05-30T16:49:14.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1397400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1390005ea0 0x7f13900062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1397400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1390005ea0 0x7f13900062b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:58718/0 (socket says 172.21.15.59:58718) 2024-05-30T16:49:14.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1397400640 1 -- 172.21.15.59:0/3871578469 learned_addr learned my addr 172.21.15.59:0/3871578469 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:14.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1396000640 1 --2- 172.21.15.59:0/3871578469 >> v2:172.21.15.59:3300/0 conn(0x7f1390047c20 0x7f13900eb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1397400640 1 -- 172.21.15.59:0/3871578469 >> v2:172.21.15.59:3300/0 conn(0x7f1390047c20 msgr2=0x7f13900eb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:14.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1397400640 1 --2- 172.21.15.59:0/3871578469 >> v2:172.21.15.59:3300/0 conn(0x7f1390047c20 0x7f13900eb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1397400640 1 -- 172.21.15.59:0/3871578469 >> v1:172.21.15.59:6789/0 conn(0x7f1390033e40 legacy=0x7f13900eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:14.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f589f400640 1 --2- 172.21.15.59:0/3623190789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5884004810 0x7f5884004c90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f589800a920 tx=0x7f589801fa80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae249e17137e3777 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:14.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589800a520 con 0x7f5884004810 2024-05-30T16:49:14.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58980aa6b0 con 0x7f5884004810 2024-05-30T16:49:14.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f589ea00640 1 -- 172.21.15.59:0/3623190789 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58980aaae0 con 0x7f5884004810 2024-05-30T16:49:14.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f0553a00640 1 Processor -- start 2024-05-30T16:49:14.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.982+0000 7f1397400640 1 -- 172.21.15.59:0/3871578469 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139004fa30 con 0x7f1390005ea0 2024-05-30T16:49:14.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f58a5600640 1 -- 172.21.15.59:0/3623190789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5884004810 msgr2=0x7f5884004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f58a5600640 1 --2- 172.21.15.59:0/3623190789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5884004810 0x7f5884004c90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f589800a920 tx=0x7f589801fa80 comp rx=0 tx=0).stop 2024-05-30T16:49:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f0553a00640 1 -- start start 2024-05-30T16:49:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f0553a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f054c06dd30 0x7f054c163b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f0553a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f054c0b3b50 0x7f054c0721c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f0553a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054c06e1e0 con 0x7f054c0d0470 2024-05-30T16:49:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f0553a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f054c06ea20 con 0x7f054c06dd30 2024-05-30T16:49:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f0553a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f054c15d4e0 con 0x7f054c0b3b50 2024-05-30T16:49:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7efc52a00640 1 Processor -- start 2024-05-30T16:49:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f58a5600640 1 -- 172.21.15.59:0/3623190789 shutdown_connections 2024-05-30T16:49:14.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f58a5600640 1 --2- 172.21.15.59:0/3623190789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5884004810 0x7f5884004c90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f58a5600640 1 -- 172.21.15.59:0/3623190789 >> 172.21.15.59:0/3623190789 conn(0x7f58a00721b0 msgr2=0x7f58a00b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:14.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f054be00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f054c06dd30 0x7f054c163b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f0551a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f054c0b3b50 0x7f054c0721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f0551a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f054c0b3b50 0x7f054c0721c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:35996/0 (socket says 172.21.15.59:35996) 2024-05-30T16:49:14.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7f0551a00640 1 -- 172.21.15.59:0/468479425 learned_addr learned my addr 172.21.15.59:0/468479425 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:14.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f1397400640 1 --2- 172.21.15.59:0/3871578469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1390005ea0 0x7f13900062b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f139003ac20 tx=0x7f138401ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c14e1644d60f99a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:14.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f0551a00640 1 -- 172.21.15.59:0/468479425 >> v2:172.21.15.107:3300/0 conn(0x7f054c06dd30 msgr2=0x7f054c163b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:14.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f0551a00640 1 --2- 172.21.15.59:0/468479425 >> v2:172.21.15.107:3300/0 conn(0x7f054c06dd30 0x7f054c163b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f0551a00640 1 -- 172.21.15.59:0/468479425 >> v1:172.21.15.59:6789/0 conn(0x7f054c0d0470 legacy=0x7f054c0d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f0551a00640 1 -- 172.21.15.59:0/468479425 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c06e460 con 0x7f054c0b3b50 2024-05-30T16:49:14.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f1395600640 1 -- 172.21.15.59:0/3871578469 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13840b5070 con 0x7f1390005ea0 2024-05-30T16:49:14.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.986+0000 7efc52a00640 1 -- start start 2024-05-30T16:49:14.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc52a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efc4404f500 0x7efc4404f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc52a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc440482b0 0x7efc44038d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc52a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc4404fe20 con 0x7efc44047d60 2024-05-30T16:49:14.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc52a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7efc44006b20 con 0x7efc440482b0 2024-05-30T16:49:14.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc52a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7efc44006e00 con 0x7efc4404f500 2024-05-30T16:49:14.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f1395600640 1 -- 172.21.15.59:0/3871578469 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13840a89d0 con 0x7f1390005ea0 2024-05-30T16:49:14.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f1395600640 1 -- 172.21.15.59:0/3871578469 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13840a8da0 con 0x7f1390005ea0 2024-05-30T16:49:14.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f58a5600640 1 -- 172.21.15.59:0/3623190789 shutdown_connections 2024-05-30T16:49:14.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f58a5600640 1 -- 172.21.15.59:0/3623190789 wait complete. 2024-05-30T16:49:14.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc4be00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efc4404f500 0x7efc4404f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc4b400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7efc44047d60 0x7efc44052e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:54210/0 (socket says 172.21.15.59:54210) 2024-05-30T16:49:14.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc4b400640 1 -- 172.21.15.59:0/1808816876 learned_addr learned my addr 172.21.15.59:0/1808816876 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:14.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc51400640 1 --2- 172.21.15.59:0/1808816876 >> v2:172.21.15.59:3300/0 conn(0x7efc440482b0 0x7efc44038d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f1397e00640 1 -- 172.21.15.59:0/3871578469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1390005ea0 msgr2=0x7f13900062b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f1397e00640 1 --2- 172.21.15.59:0/3871578469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1390005ea0 0x7f13900062b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f139003ac20 tx=0x7f138401ecd0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f53e3e00640 1 Processor -- start 2024-05-30T16:49:15.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc51400640 1 -- 172.21.15.59:0/1808816876 >> v2:172.21.15.107:3300/0 conn(0x7efc4404f500 msgr2=0x7efc4404f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc51400640 1 --2- 172.21.15.59:0/1808816876 >> v2:172.21.15.107:3300/0 conn(0x7efc4404f500 0x7efc4404f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc51400640 1 -- 172.21.15.59:0/1808816876 >> v1:172.21.15.107:6789/0 conn(0x7efc44047d60 legacy=0x7efc44052e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f53e3e00640 1 -- start start 2024-05-30T16:49:15.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc51400640 1 -- 172.21.15.59:0/1808816876 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc440070e0 con 0x7efc440482b0 2024-05-30T16:49:15.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7efc4be00640 1 --2- 172.21.15.59:0/1808816876 >> v2:172.21.15.107:3300/0 conn(0x7efc4404f500 0x7efc4404f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:15.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f0551a00640 1 --2- 172.21.15.59:0/468479425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f054c0b3b50 0x7f054c0721c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0538009870 tx=0x7f053801c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e22e6f0e2443fe30 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f054b400640 1 -- 172.21.15.59:0/468479425 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05380b2070 con 0x7f054c0b3b50 2024-05-30T16:49:15.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f054b400640 1 -- 172.21.15.59:0/468479425 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05380ad680 con 0x7f054c0b3b50 2024-05-30T16:49:15.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f054b400640 1 -- 172.21.15.59:0/468479425 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05380ada50 con 0x7f054c0b3b50 2024-05-30T16:49:15.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f1397e00640 1 -- 172.21.15.59:0/3871578469 shutdown_connections 2024-05-30T16:49:15.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f1397e00640 1 --2- 172.21.15.59:0/3871578469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1390005ea0 0x7f13900062b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f1397e00640 1 --2- 172.21.15.59:0/3871578469 >> v2:172.21.15.59:3300/0 conn(0x7f1390047c20 0x7f13900eb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f1397e00640 1 -- 172.21.15.59:0/3871578469 >> 172.21.15.59:0/3871578469 conn(0x7f1390009fc0 msgr2=0x7f139000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.990+0000 7f1397e00640 1 -- 172.21.15.59:0/3871578469 shutdown_connections 2024-05-30T16:49:15.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f58a5600640 1 Processor -- start 2024-05-30T16:49:15.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f58a5600640 1 -- start start 2024-05-30T16:49:15.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f1397e00640 1 -- 172.21.15.59:0/3871578469 wait complete. 2024-05-30T16:49:15.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f0553a00640 1 -- 172.21.15.59:0/468479425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f054c0b3b50 msgr2=0x7f054c0721c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f0553a00640 1 --2- 172.21.15.59:0/468479425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f054c0b3b50 0x7f054c0721c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0538009870 tx=0x7f053801c4f0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f0553a00640 1 -- 172.21.15.59:0/468479425 shutdown_connections 2024-05-30T16:49:15.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f0553a00640 1 --2- 172.21.15.59:0/468479425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f054c0b3b50 0x7f054c0721c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f0553a00640 1 --2- 172.21.15.59:0/468479425 >> v2:172.21.15.107:3300/0 conn(0x7f054c06dd30 0x7f054c163b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f0553a00640 1 -- 172.21.15.59:0/468479425 >> 172.21.15.59:0/468479425 conn(0x7f054c0b22d0 msgr2=0x7f054c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7fa0f0c00640 1 Processor -- start 2024-05-30T16:49:15.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f53e3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e406fd60 0x7f53e406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f53e3e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53e406ece0 con 0x7f53e4154df0 2024-05-30T16:49:15.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f53e3e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53e406efc0 con 0x7f53e40727b0 2024-05-30T16:49:15.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f53e3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f53e406f2a0 con 0x7f53e406fd60 2024-05-30T16:49:15.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f53e2a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f53e4154df0 0x7f53e40720a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40090/0 (socket says 172.21.15.59:40090) 2024-05-30T16:49:15.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f53e2a00640 1 -- 172.21.15.59:0/3044913757 learned_addr learned my addr 172.21.15.59:0/3044913757 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:15.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f58a5600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884004810 0x7f58a01519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f58a5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a014ce00 0x7f58a015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f58a5600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a015ce60 0x7f58a015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f58a5600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58a015ad30 con 0x7f58a014ce00 2024-05-30T16:49:15.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f58a5600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f58a00ce400 con 0x7f5884004810 2024-05-30T16:49:15.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f58a5600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f58a015aeb0 con 0x7f58a015ce60 2024-05-30T16:49:15.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f589fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884004810 0x7f58a01519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f0553a00640 1 -- 172.21.15.59:0/468479425 shutdown_connections 2024-05-30T16:49:15.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f0553a00640 1 -- 172.21.15.59:0/468479425 wait complete. 2024-05-30T16:49:15.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f53e3400640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e406fd60 0x7f53e406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f5c24600640 1 Processor -- start 2024-05-30T16:49:15.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7fa0f0c00640 1 -- start start 2024-05-30T16:49:15.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f1397e00640 1 Processor -- start 2024-05-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f589fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884004810 0x7f58a01519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:58730/0 (socket says 172.21.15.59:58730) 2024-05-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f589fe00640 1 -- 172.21.15.59:0/885424928 learned_addr learned my addr 172.21.15.59:0/885424928 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f58a4c00640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a015ce60 0x7f58a015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f39e3e00640 1 Processor -- start 2024-05-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f1397e00640 1 -- start start 2024-05-30T16:49:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f589f400640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a014ce00 0x7f58a015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610357033 0 0) 0x7f53e406efc0 con 0x7f53e40727b0 2024-05-30T16:49:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53c8003530 con 0x7f53e40727b0 2024-05-30T16:49:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f58a4c00640 1 -- 172.21.15.59:0/885424928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884004810 msgr2=0x7f58a01519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f58a4c00640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884004810 0x7f58a01519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f58a4c00640 1 -- 172.21.15.59:0/885424928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a014ce00 msgr2=0x7f58a015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f58a4c00640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a014ce00 0x7f58a015d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f58a4c00640 1 -- 172.21.15.59:0/885424928 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a0154530 con 0x7f58a015ce60 2024-05-30T16:49:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0f0c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa0ec15a950 0x7fa0ec0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0f0c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec0cf930 0x7fa0ec0734e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0553a00640 1 Processor -- start 2024-05-30T16:49:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f58a4c00640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a015ce60 0x7f58a015d8f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f58a0071c00 tx=0x7f588c00c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1397e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1390005ea0 0x7f13900e47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1397e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1390033e40 0x7f13900e4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1397e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1390047c20 0x7f13900d9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1397e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f139004fd80 con 0x7f1390005ea0 2024-05-30T16:49:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1397e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f139004f090 con 0x7f1390033e40 2024-05-30T16:49:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1397e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f139004f5c0 con 0x7f1390047c20 2024-05-30T16:49:15.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3990598131 0 0) 0x7f53c8003530 con 0x7f53e40727b0 2024-05-30T16:49:15.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e406fd60 msgr2=0x7f53e406e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e406fd60 0x7f53e406e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 >> v1:172.21.15.59:6789/0 conn(0x7f53e4154df0 legacy=0x7f53e40720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e406f580 con 0x7f53e40727b0 2024-05-30T16:49:15.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f5c24600640 1 -- start start 2024-05-30T16:49:15.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f5c24600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5c1c163b80 0x7f5c1c0721c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f5c24600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c1c06e1e0 con 0x7f5c1c06dd30 2024-05-30T16:49:15.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f5c24600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c1c15d4e0 con 0x7f5c1c0d0470 2024-05-30T16:49:15.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f5c24600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f5c1c06ea20 con 0x7f5c1c163b80 2024-05-30T16:49:15.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0553a00640 1 -- start start 2024-05-30T16:49:15.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0f0c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0ec0b18d0 con 0x7fa0ec073060 2024-05-30T16:49:15.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0e2a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa0ec073060 0x7fa0ec0ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:54222/0 (socket says 172.21.15.59:54222) 2024-05-30T16:49:15.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0f0c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa0ec0b3b20 con 0x7fa0ec15a950 2024-05-30T16:49:15.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0e2a00640 1 -- 172.21.15.59:0/2070798263 learned_addr learned my addr 172.21.15.59:0/2070798263 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:15.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2070798263 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa0ec0b1bb0 con 0x7fa0ec0cf930 2024-05-30T16:49:15.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0ebe00640 1 --2- 172.21.15.59:0/2070798263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec0cf930 0x7fa0ec0734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0eb400640 1 --2- 172.21.15.59:0/2070798263 >> v2:172.21.15.107:3300/0 conn(0x7fa0ec15a950 0x7fa0ec0b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f5897e00640 1 -- 172.21.15.59:0/885424928 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c017070 con 0x7f58a015ce60 2024-05-30T16:49:15.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f53d0001680 con 0x7f53e40727b0 2024-05-30T16:49:15.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 >> v1:172.21.15.107:6789/0 conn(0x7f53e40727b0 legacy=0x7f53e406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c80039c0 0x7f53c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f5897e00640 1 -- 172.21.15.59:0/885424928 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588c005d70 con 0x7f58a015ce60 2024-05-30T16:49:15.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f5897e00640 1 -- 172.21.15.59:0/885424928 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c0072d0 con 0x7f58a015ce60 2024-05-30T16:49:15.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f58a5600640 1 -- 172.21.15.59:0/885424928 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a0154810 con 0x7f58a015ce60 2024-05-30T16:49:15.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1396000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1390033e40 0x7f13900e4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1396000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1390033e40 0x7f13900e4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:58752/0 (socket says 172.21.15.59:58752) 2024-05-30T16:49:15.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1396000640 1 -- 172.21.15.59:0/296392749 learned_addr learned my addr 172.21.15.59:0/296392749 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f58a5600640 1 -- 172.21.15.59:0/885424928 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a0154dd0 con 0x7f58a015ce60 2024-05-30T16:49:15.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1396000640 1 -- 172.21.15.59:0/296392749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1390047c20 msgr2=0x7f13900d9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1396000640 1 --2- 172.21.15.59:0/296392749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1390047c20 0x7f13900d9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1396000640 1 -- 172.21.15.59:0/296392749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1390005ea0 msgr2=0x7f13900e47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1396000640 1 --2- 172.21.15.59:0/296392749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1390005ea0 0x7f13900e47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1396000640 1 -- 172.21.15.59:0/296392749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1390172810 con 0x7f1390033e40 2024-05-30T16:49:15.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0553a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f054c06dd30 0x7f054c0cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0553a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f054c0b3b50 0x7f054c0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0553a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f054c0d0470 0x7f054c15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0553a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f054c0b40d0 con 0x7f054c0b3b50 2024-05-30T16:49:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0553a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f054c0b3f50 con 0x7f054c06dd30 2024-05-30T16:49:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0553a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f054c16fa70 con 0x7f054c0d0470 2024-05-30T16:49:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f054be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f054c0b3b50 0x7f054c0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f054be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f054c0b3b50 0x7f054c0ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54216/0 (socket says 172.21.15.59:54216) 2024-05-30T16:49:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f054be00640 1 -- 172.21.15.59:0/4243764951 learned_addr learned my addr 172.21.15.59:0/4243764951 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0551a00640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f054c0d0470 0x7f054c15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c8004810 0x7f53c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e406fd60 0x7f53c80051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53e406f2a0 con 0x7f53c80039c0 2024-05-30T16:49:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f53c800bae0 con 0x7f53c8004810 2024-05-30T16:49:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f53c800bce0 con 0x7f53e406fd60 2024-05-30T16:49:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f53e2a00640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c80039c0 0x7f53c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7efc51400640 1 --2- 172.21.15.59:0/1808816876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc440482b0 0x7efc44038d40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc4c02db60 tx=0x7efc4c097df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11cf667847b83d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.994+0000 7f39e3e00640 1 -- start start 2024-05-30T16:49:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f39e3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39e40b5260 0x7f39e416d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f39e2000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f39e406c0c0 0x7f39e40cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:54246/0 (socket says 172.21.15.59:54246) 2024-05-30T16:49:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f5c21c00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f5c1c0d0470 0x7f5c1c0d0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:54236/0 (socket says 172.21.15.59:54236) 2024-05-30T16:49:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f5c21c00640 1 -- 172.21.15.59:0/593651868 learned_addr learned my addr 172.21.15.59:0/593651868 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0eaa00640 1 -- 172.21.15.59:0/2070798263 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3863803440 0 0) 0x7fa0ec0b18d0 con 0x7fa0ec073060 2024-05-30T16:49:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0eaa00640 1 -- 172.21.15.59:0/2070798263 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0d0003530 con 0x7fa0ec073060 2024-05-30T16:49:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7efc4aa00640 1 -- 172.21.15.59:0/1808816876 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c120c30 con 0x7efc440482b0 2024-05-30T16:49:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7efc4aa00640 1 -- 172.21.15.59:0/1808816876 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc4c120dd0 con 0x7efc440482b0 2024-05-30T16:49:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7efc4aa00640 1 -- 172.21.15.59:0/1808816876 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c128640 con 0x7efc440482b0 2024-05-30T16:49:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f1396000640 1 --2- 172.21.15.59:0/296392749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1390033e40 0x7f13900e4ce0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f138800d620 tx=0x7f138800dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f138f400640 1 -- 172.21.15.59:0/296392749 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138800b620 con 0x7f1390033e40 2024-05-30T16:49:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f138f400640 1 -- 172.21.15.59:0/296392749 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1388019070 con 0x7f1390033e40 2024-05-30T16:49:15.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f138f400640 1 -- 172.21.15.59:0/296392749 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138800b9e0 con 0x7f1390033e40 2024-05-30T16:49:15.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0551000640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f054c06dd30 0x7f054c0cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0551a00640 1 -- 172.21.15.59:0/4243764951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f054c06dd30 msgr2=0x7f054c0cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0551a00640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f054c06dd30 0x7f054c0cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0551a00640 1 -- 172.21.15.59:0/4243764951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f054c0b3b50 msgr2=0x7f054c0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f39e3e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e41630a0 con 0x7f39e4162cc0 2024-05-30T16:49:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f39e2a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f39e4162cc0 0x7f39e406b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40122/0 (socket says 172.21.15.59:40122) 2024-05-30T16:49:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f39e2a00640 1 -- 172.21.15.59:0/1593528557 learned_addr learned my addr 172.21.15.59:0/1593528557 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f1397e00640 1 -- 172.21.15.59:0/296392749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13900e0370 con 0x7f1390033e40 2024-05-30T16:49:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0551a00640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f054c0b3b50 0x7f054c0ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f0551a00640 1 -- 172.21.15.59:0/4243764951 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c0ad8b0 con 0x7f054c0d0470 2024-05-30T16:49:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f53e2000640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c8004810 0x7f53c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f0551a00640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f054c0d0470 0x7f054c15a0f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f05380ac000 tx=0x7f0538019290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f53e2a00640 1 -- 172.21.15.59:0/3044913757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e406fd60 msgr2=0x7f53c80051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:49:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f53e3400640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e406fd60 0x7f53c80051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f39e3400640 1 --2- 172.21.15.59:0/1593528557 >> v2:172.21.15.59:3300/0 conn(0x7f39e40b5260 0x7f39e416d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7f58a5600640 1 -- 172.21.15.59:0/885424928 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f58a01542e0 con 0x7f58a015ce60 2024-05-30T16:49:15.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f0548c00640 1 -- 172.21.15.59:0/4243764951 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05380bd070 con 0x7f054c0d0470 2024-05-30T16:49:15.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f0548c00640 1 -- 172.21.15.59:0/4243764951 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05380ada30 con 0x7f054c0d0470 2024-05-30T16:49:15.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f0548c00640 1 -- 172.21.15.59:0/4243764951 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05380bd070 con 0x7f054c0d0470 2024-05-30T16:49:15.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f0553a00640 1 -- 172.21.15.59:0/4243764951 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054c0adb90 con 0x7f054c0d0470 2024-05-30T16:49:15.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f39e3e00640 1 -- 172.21.15.59:0/1593528557 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e4070300 con 0x7f39e406c0c0 2024-05-30T16:49:15.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f5c22600640 1 --2- 172.21.15.59:0/593651868 >> v2:172.21.15.59:3300/0 conn(0x7f5c1c163b80 0x7f5c1c0721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7efc52a00640 1 -- 172.21.15.59:0/1808816876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc440482b0 msgr2=0x7efc44038d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7efc52a00640 1 --2- 172.21.15.59:0/1808816876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc440482b0 0x7efc44038d40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc4c02db60 tx=0x7efc4c097df0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f39e3e00640 1 -- 172.21.15.59:0/1593528557 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f39e40705e0 con 0x7f39e40b5260 2024-05-30T16:49:15.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f39e1600640 1 -- 172.21.15.59:0/1593528557 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3822542705 0 0) 0x7f39e41630a0 con 0x7f39e4162cc0 2024-05-30T16:49:15.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f1397e00640 1 -- 172.21.15.59:0/296392749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13900e2d40 con 0x7f1390033e40 2024-05-30T16:49:15.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f0553a00640 1 -- 172.21.15.59:0/4243764951 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f054c0ae150 con 0x7f054c0d0470 2024-05-30T16:49:15.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f5c1be00640 1 -- 172.21.15.59:0/593651868 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523038843 0 0) 0x7f5c1c15d4e0 con 0x7f5c1c0d0470 2024-05-30T16:49:15.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f5c1be00640 1 -- 172.21.15.59:0/593651868 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c04003530 con 0x7f5c1c0d0470 2024-05-30T16:49:15.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0eb400640 1 -- 172.21.15.59:0/2070798263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec0cf930 msgr2=0x7fa0ec0734e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0eb400640 1 --2- 172.21.15.59:0/2070798263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec0cf930 0x7fa0ec0734e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0eb400640 1 -- 172.21.15.59:0/2070798263 >> v1:172.21.15.107:6789/0 conn(0x7fa0ec073060 legacy=0x7fa0ec0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:14.998+0000 7fa0eb400640 1 -- 172.21.15.59:0/2070798263 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ec0cde40 con 0x7fa0ec15a950 2024-05-30T16:49:15.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f39e1600640 1 -- 172.21.15.59:0/1593528557 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39c8003530 con 0x7f39e4162cc0 2024-05-30T16:49:15.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f5c1be00640 1 -- 172.21.15.59:0/593651868 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 526533566 0 0) 0x7f5c04003530 con 0x7f5c1c0d0470 2024-05-30T16:49:15.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f5c22600640 1 -- 172.21.15.59:0/593651868 >> v1:172.21.15.107:6789/0 conn(0x7f5c1c0d0470 legacy=0x7f5c1c0d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f5c22600640 1 -- 172.21.15.59:0/593651868 >> v1:172.21.15.59:6789/0 conn(0x7f5c1c06dd30 legacy=0x7f5c1c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f39e3400640 1 -- 172.21.15.59:0/1593528557 >> v1:172.21.15.107:6789/0 conn(0x7f39e406c0c0 legacy=0x7f39e40cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f39e3400640 1 -- 172.21.15.59:0/1593528557 >> v1:172.21.15.59:6789/0 conn(0x7f39e4162cc0 legacy=0x7f39e406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f53e2a00640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e406fd60 0x7f53c80051f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f39e3400640 1 -- 172.21.15.59:0/1593528557 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e40708c0 con 0x7f39e40b5260 2024-05-30T16:49:15.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f5c22600640 1 -- 172.21.15.59:0/593651868 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c06e460 con 0x7f5c1c163b80 2024-05-30T16:49:15.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f1397e00640 1 -- 172.21.15.59:0/296392749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f13900e0a30 con 0x7f1390033e40 2024-05-30T16:49:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f53e2a00640 1 -- 172.21.15.59:0/3044913757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c8004810 msgr2=0x7f53c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f53e2a00640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c8004810 0x7f53c8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f53e2a00640 1 -- 172.21.15.59:0/3044913757 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e406f580 con 0x7f53c80039c0 2024-05-30T16:49:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f53e2000640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c8004810 0x7f53c8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.002+0000 7f0548c00640 1 -- 172.21.15.59:0/4243764951 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05380adbe0 con 0x7f054c0d0470 2024-05-30T16:49:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f138f400640 1 -- 172.21.15.59:0/296392749 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f138800bb80 con 0x7f1390033e40 2024-05-30T16:49:15.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7fa0eb400640 1 --2- 172.21.15.59:0/2070798263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec15a950 0x7fa0ec0b35e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00d1e0 tx=0x7fa0dc021530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a34569b6b72ba6eb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7fa0eaa00640 1 -- 172.21.15.59:0/2070798263 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc0b8070 con 0x7fa0ec15a950 2024-05-30T16:49:15.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7fa0eaa00640 1 -- 172.21.15.59:0/2070798263 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc0b3410 con 0x7fa0ec15a950 2024-05-30T16:49:15.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7fa0eaa00640 1 -- 172.21.15.59:0/2070798263 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc0b3800 con 0x7fa0ec15a950 2024-05-30T16:49:15.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f0553a00640 1 -- 172.21.15.59:0/4243764951 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0524001040 con 0x7f054c0d0470 2024-05-30T16:49:15.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f0548c00640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f052c068580 0x7f052c06aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2070798263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec15a950 msgr2=0x7fa0ec0b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7fa0f0c00640 1 --2- 172.21.15.59:0/2070798263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec15a950 0x7fa0ec0b35e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00d1e0 tx=0x7fa0dc021530 comp rx=0 tx=0).stop 2024-05-30T16:49:15.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f138f400640 1 --2- 172.21.15.59:0/296392749 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13780683d0 0x7f137806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f138f400640 1 -- 172.21.15.59:0/296392749 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f13880865d0 con 0x7f1390033e40 2024-05-30T16:49:15.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2070798263 shutdown_connections 2024-05-30T16:49:15.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7fa0f0c00640 1 --2- 172.21.15.59:0/2070798263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec0cf930 0x7fa0ec0734e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7fa0f0c00640 1 --2- 172.21.15.59:0/2070798263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec15a950 0x7fa0ec0b35e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2070798263 >> 172.21.15.59:0/2070798263 conn(0x7fa0ec0721b0 msgr2=0x7fa0ec0b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2070798263 shutdown_connections 2024-05-30T16:49:15.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2070798263 wait complete. 2024-05-30T16:49:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f138f400640 1 --2- 172.21.15.59:0/296392749 >> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] conn(0x7f13780705f0 0x7f1378072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f138f400640 1 -- 172.21.15.59:0/296392749 --> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13780730c0 con 0x7f13780705f0 2024-05-30T16:49:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f5897e00640 1 -- 172.21.15.59:0/885424928 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f588c01a070 con 0x7f58a015ce60 2024-05-30T16:49:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f5897e00640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5880068480 0x7f588006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f5897e00640 1 -- 172.21.15.59:0/885424928 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f588c085d00 con 0x7f58a015ce60 2024-05-30T16:49:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f5897e00640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] conn(0x7f58800706a0 0x7f5880072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f5897e00640 1 -- 172.21.15.59:0/885424928 --> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f588c020eb0 con 0x7f58800706a0 2024-05-30T16:49:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f5897e00640 1 -- 172.21.15.59:0/885424928 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f588c0860f0 con 0x7f58a015ce60 2024-05-30T16:49:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f138f400640 1 -- 172.21.15.59:0/296392749 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f138808d050 con 0x7f1390033e40 2024-05-30T16:49:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f1396a00640 1 --2- 172.21.15.59:0/296392749 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13780683d0 0x7f137806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f0548c00640 1 -- 172.21.15.59:0/4243764951 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f053811f6f0 con 0x7f054c0d0470 2024-05-30T16:49:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f0548c00640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] conn(0x7f052c070720 0x7f052c072b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f0548c00640 1 -- 172.21.15.59:0/4243764951 --> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0538001d40 con 0x7f052c070720 2024-05-30T16:49:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f0551000640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f052c068580 0x7f052c06aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f0548c00640 1 -- 172.21.15.59:0/4243764951 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f05380eb870 con 0x7f054c0d0470 2024-05-30T16:49:15.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7efc52a00640 1 -- 172.21.15.59:0/1808816876 shutdown_connections 2024-05-30T16:49:15.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7efc52a00640 1 --2- 172.21.15.59:0/1808816876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc440482b0 0x7efc44038d40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7efc52a00640 1 --2- 172.21.15.59:0/1808816876 >> v2:172.21.15.107:3300/0 conn(0x7efc4404f500 0x7efc4404f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7efc52a00640 1 -- 172.21.15.59:0/1808816876 >> 172.21.15.59:0/1808816876 conn(0x7efc44054ca0 msgr2=0x7efc440550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7efc52a00640 1 -- 172.21.15.59:0/1808816876 shutdown_connections 2024-05-30T16:49:15.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7efc52a00640 1 -- 172.21.15.59:0/1808816876 wait complete. 2024-05-30T16:49:15.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f0551000640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f052c068580 0x7f052c06aa40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05440012f0 tx=0x7f0544009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f53e2a00640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c80039c0 0x7f53c8003de0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f53d4001850 tx=0x7f53d401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac86ff6ef3be613f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f054be00640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] conn(0x7f052c070720 0x7f052c072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f589fe00640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5880068480 0x7f588006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4001470 con 0x7f53c80039c0 2024-05-30T16:49:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d4004ab0 con 0x7f53c80039c0 2024-05-30T16:49:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.006+0000 7f53e1600640 1 -- 172.21.15.59:0/3044913757 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4007110 con 0x7f53c80039c0 2024-05-30T16:49:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f589f400640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] conn(0x7f58800706a0 0x7f5880072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f1397400640 1 --2- 172.21.15.59:0/296392749 >> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] conn(0x7f13780705f0 0x7f1378072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f1396a00640 1 --2- 172.21.15.59:0/296392749 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13780683d0 0x7f137806a890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1398050b40 tx=0x7f139806af10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7fa0f0c00640 1 Processor -- start 2024-05-30T16:49:15.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f054be00640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] conn(0x7f052c070720 0x7f052c072b40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f5c22600640 1 --2- 172.21.15.59:0/593651868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c1c163b80 0x7f5c1c0721c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009d90 tx=0x7f5c1401c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829a7164c8ad860f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f53e3e00640 1 -- 172.21.15.59:0/3044913757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c80039c0 msgr2=0x7f53c8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f53e3e00640 1 --2- 172.21.15.59:0/3044913757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c80039c0 0x7f53c8003de0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f53d4001850 tx=0x7f53d401c4e0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7fa0f0c00640 1 -- start start 2024-05-30T16:49:15.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f1397400640 1 --2- 172.21.15.59:0/296392749 >> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] conn(0x7f13780705f0 0x7f1378072a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f53e3400640 1 -- 172.21.15.59:0/3044913757 reap_dead start 2024-05-30T16:49:15.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f5c1be00640 1 -- 172.21.15.59:0/593651868 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10001680 con 0x7f5c1c163b80 2024-05-30T16:49:15.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f53e3e00640 1 -- 172.21.15.59:0/3044913757 shutdown_connections 2024-05-30T16:49:15.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f53e3e00640 1 -- 172.21.15.59:0/3044913757 >> 172.21.15.59:0/3044913757 conn(0x7f53e40b1fd0 msgr2=0x7f53e40b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f39e3400640 1 --2- 172.21.15.59:0/1593528557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e40b5260 0x7f39e416d800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f39d00097c0 tx=0x7f39d001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3577bdefc0962 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f5c1be00640 1 -- 172.21.15.59:0/593651868 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c140a8460 con 0x7f5c1c163b80 2024-05-30T16:49:15.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f5c1be00640 1 -- 172.21.15.59:0/593651868 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c140a8830 con 0x7f5c1c163b80 2024-05-30T16:49:15.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f589f400640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] conn(0x7f58800706a0 0x7f5880072ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f39e1600640 1 -- 172.21.15.59:0/1593528557 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d00b1070 con 0x7f39e40b5260 2024-05-30T16:49:15.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7efc52a00640 1 Processor -- start 2024-05-30T16:49:15.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f39e1600640 1 -- 172.21.15.59:0/1593528557 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d00ac620 con 0x7f39e40b5260 2024-05-30T16:49:15.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f39e1600640 1 -- 172.21.15.59:0/1593528557 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d00ac9f0 con 0x7f39e40b5260 2024-05-30T16:49:15.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f0548c00640 1 -- 172.21.15.59:0/4243764951 <== osd.2 v2:172.21.15.59:6808/3949011694 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0538001d40 con 0x7f052c070720 2024-05-30T16:49:15.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7fa0f0c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec073060 0x7fa0ec09df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7fa0f0c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec0cf930 0x7fa0ec1f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7efc52a00640 1 -- start start 2024-05-30T16:49:15.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7fa0f0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec15a950 0x7fa0ec14abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7fa0f0c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ec15ad30 con 0x7fa0ec15a950 2024-05-30T16:49:15.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7fa0f0c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ec0ce400 con 0x7fa0ec0cf930 2024-05-30T16:49:15.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7fa0f0c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa0ec15aeb0 con 0x7fa0ec073060 2024-05-30T16:49:15.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f589fe00640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5880068480 0x7f588006a940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5890006fd0 tx=0x7f58900090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f5c24600640 1 -- 172.21.15.59:0/593651868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c1c163b80 msgr2=0x7f5c1c0721c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f5c24600640 1 --2- 172.21.15.59:0/593651868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c1c163b80 0x7f5c1c0721c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009d90 tx=0x7f5c1401c5b0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f53e3e00640 1 -- 172.21.15.59:0/3044913757 shutdown_connections 2024-05-30T16:49:15.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f5c24600640 1 -- 172.21.15.59:0/593651868 shutdown_connections 2024-05-30T16:49:15.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7fa0ebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec15a950 0x7fa0ec14abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7fa0ebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec15a950 0x7fa0ec14abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54242/0 (socket says 172.21.15.59:54242) 2024-05-30T16:49:15.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7fa0ebe00640 1 -- 172.21.15.59:0/2440734673 learned_addr learned my addr 172.21.15.59:0/2440734673 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f39e3e00640 1 -- 172.21.15.59:0/1593528557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e40b5260 msgr2=0x7f39e416d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f39e3e00640 1 --2- 172.21.15.59:0/1593528557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e40b5260 0x7f39e416d800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f39d00097c0 tx=0x7f39d001c3e0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f5c24600640 1 --2- 172.21.15.59:0/593651868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c1c163b80 0x7f5c1c0721c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f5c24600640 1 -- 172.21.15.59:0/593651868 >> 172.21.15.59:0/593651868 conn(0x7f5c1c0b22d0 msgr2=0x7f5c1c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f39e3e00640 1 -- 172.21.15.59:0/1593528557 shutdown_connections 2024-05-30T16:49:15.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f39e3e00640 1 --2- 172.21.15.59:0/1593528557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e40b5260 0x7f39e416d800 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f39e3e00640 1 -- 172.21.15.59:0/1593528557 >> 172.21.15.59:0/1593528557 conn(0x7f39e40b6990 msgr2=0x7f39e40b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7fa0eb400640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec073060 0x7fa0ec09df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f53e3e00640 1 -- 172.21.15.59:0/3044913757 wait complete. 2024-05-30T16:49:15.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc52a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44047d60 0x7efc440cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc52a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc440482b0 0x7efc44035780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7fa0ebe00640 1 -- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec073060 msgr2=0x7fa0ec09df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7fa0ebe00640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec073060 0x7fa0ec09df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7fa0ebe00640 1 -- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec0cf930 msgr2=0x7fa0ec1f84b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:49:15.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7fa0ebe00640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec0cf930 0x7fa0ec1f84b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7fa0ebe00640 1 -- 172.21.15.59:0/2440734673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ec1f8c20 con 0x7fa0ec15a950 2024-05-30T16:49:15.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc52a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc4404f500 0x7efc440c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc4b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc440482b0 0x7efc44035780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc4b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc440482b0 0x7efc44035780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36060/0 (socket says 172.21.15.59:36060) 2024-05-30T16:49:15.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc4be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44047d60 0x7efc440cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc4be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44047d60 0x7efc440cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54256/0 (socket says 172.21.15.59:54256) 2024-05-30T16:49:15.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc4b400640 1 -- 172.21.15.59:0/1296579455 learned_addr learned my addr 172.21.15.59:0/1296579455 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7fa0ebe00640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec15a950 0x7fa0ec14abf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400e930 tx=0x7fa0e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc51400640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc4404f500 0x7efc440c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc52a00640 1 -- 172.21.15.59:0/1296579455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efc44034230 con 0x7efc44047d60 2024-05-30T16:49:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc52a00640 1 -- 172.21.15.59:0/1296579455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efc440501f0 con 0x7efc4404f500 2024-05-30T16:49:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7fa0e3e00640 1 -- 172.21.15.59:0/2440734673 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4017070 con 0x7fa0ec15a950 2024-05-30T16:49:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc52a00640 1 -- 172.21.15.59:0/1296579455 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efc44053570 con 0x7efc440482b0 2024-05-30T16:49:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7fa0e3e00640 1 -- 172.21.15.59:0/2440734673 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e400c9a0 con 0x7fa0ec15a950 2024-05-30T16:49:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7fa0e3e00640 1 -- 172.21.15.59:0/2440734673 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4017070 con 0x7fa0ec15a950 2024-05-30T16:49:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7f138f400640 1 -- 172.21.15.59:0/296392749 <== osd.1 v2:172.21.15.59:6824/743808646 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f13780730c0 con 0x7f13780705f0 2024-05-30T16:49:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7f53e3e00640 1 Processor -- start 2024-05-30T16:49:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2440734673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0ec1f8f00 con 0x7fa0ec15a950 2024-05-30T16:49:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc4b400640 1 -- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc4404f500 msgr2=0x7efc440c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc4b400640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc4404f500 0x7efc440c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7f39e3e00640 1 -- 172.21.15.59:0/1593528557 shutdown_connections 2024-05-30T16:49:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f5c24600640 1 -- 172.21.15.59:0/593651868 shutdown_connections 2024-05-30T16:49:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.010+0000 7f5c24600640 1 -- 172.21.15.59:0/593651868 wait complete. 2024-05-30T16:49:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2440734673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0ec14b130 con 0x7fa0ec15a950 2024-05-30T16:49:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc4b400640 1 -- 172.21.15.59:0/1296579455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44047d60 msgr2=0x7efc440cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc4b400640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44047d60 0x7efc440cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7f5c24600640 1 Processor -- start 2024-05-30T16:49:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7efc4b400640 1 -- 172.21.15.59:0/1296579455 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc440cb970 con 0x7efc440482b0 2024-05-30T16:49:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7f5c24600640 1 -- start start 2024-05-30T16:49:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7f39e3e00640 1 -- 172.21.15.59:0/1593528557 wait complete. 2024-05-30T16:49:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3e00640 1 -- start start 2024-05-30T16:49:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e3e00640 1 Processor -- start 2024-05-30T16:49:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e3e00640 1 -- start start 2024-05-30T16:49:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2440734673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0ec14cc00 con 0x7fa0ec15a950 2024-05-30T16:49:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c24600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c1c06dd30 0x7f5c1c203dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c24600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c1c0d0470 0x7f5c1c159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c24600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c1c163b80 0x7f5c1c15ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c24600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c170a80 con 0x7f5c1c163b80 2024-05-30T16:49:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7efc4b400640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc440482b0 0x7efc44035780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009df0 tx=0x7efc3c00c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c24600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c163f80 con 0x7f5c1c06dd30 2024-05-30T16:49:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c24600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1c170c00 con 0x7f5c1c0d0470 2024-05-30T16:49:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39e406c0c0 0x7f39e4159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e40b5260 0x7f39e415b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39e4162cc0 0x7f39e41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e3e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39e409abc0 con 0x7f39e40b5260 2024-05-30T16:49:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e3e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f39e409aa40 con 0x7f39e4162cc0 2024-05-30T16:49:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f39e4170560 con 0x7f39e406c0c0 2024-05-30T16:49:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7efc3be00640 1 -- 172.21.15.59:0/1296579455 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c019070 con 0x7efc440482b0 2024-05-30T16:49:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7efc3be00640 1 -- 172.21.15.59:0/1296579455 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3c0078f0 con 0x7efc440482b0 2024-05-30T16:49:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7efc3be00640 1 -- 172.21.15.59:0/1296579455 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c007ce0 con 0x7efc440482b0 2024-05-30T16:49:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39e406c0c0 0x7f39e4159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39e406c0c0 0x7f39e4159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36072/0 (socket says 172.21.15.59:36072) 2024-05-30T16:49:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e2a00640 1 -- 172.21.15.59:0/1013946020 learned_addr learned my addr 172.21.15.59:0/1013946020 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7efc52a00640 1 -- 172.21.15.59:0/1296579455 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc440cbc50 con 0x7efc440482b0 2024-05-30T16:49:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7efc52a00640 1 -- 172.21.15.59:0/1296579455 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc440cc210 con 0x7efc440482b0 2024-05-30T16:49:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c80039c0 0x7f53e40ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53e40b1520 0x7f53e41fb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e3400640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39e4162cc0 0x7f39e41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e4152110 0x7f53e41fb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41661b0 con 0x7f53c80039c0 2024-05-30T16:49:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4166030 con 0x7f53e40b1520 2024-05-30T16:49:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f53e4166330 con 0x7f53e4152110 2024-05-30T16:49:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e2a00640 1 -- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39e4162cc0 msgr2=0x7f39e41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.014+0000 7f5897e00640 1 -- 172.21.15.59:0/885424928 <== osd.0 v2:172.21.15.59:6816/1671295766 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f588c020eb0 con 0x7f58800706a0 2024-05-30T16:49:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e4152110 0x7f53e41fb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e4152110 0x7f53e41fb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36076/0 (socket says 172.21.15.59:36076) 2024-05-30T16:49:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3400640 1 -- 172.21.15.59:0/2988551680 learned_addr learned my addr 172.21.15.59:0/2988551680 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7efc52a00640 1 -- 172.21.15.59:0/1296579455 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc28001040 con 0x7efc440482b0 2024-05-30T16:49:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e2a00640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39e4162cc0 0x7f39e41561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e2000640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53e40b1520 0x7f53e41fb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e2a00640 1 -- 172.21.15.59:0/1013946020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e40b5260 msgr2=0x7f39e415b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c21200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c1c0d0470 0x7f5c1c159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c21200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c1c0d0470 0x7f5c1c159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36070/0 (socket says 172.21.15.59:36070) 2024-05-30T16:49:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c21200640 1 -- 172.21.15.59:0/2654757979 learned_addr learned my addr 172.21.15.59:0/2654757979 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c21c00640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c1c06dd30 0x7f5c1c203dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c21200640 1 -- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c1c06dd30 msgr2=0x7f5c1c203dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c21200640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c1c06dd30 0x7f5c1c203dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c21200640 1 -- 172.21.15.59:0/2654757979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c1c163b80 msgr2=0x7f5c1c15ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c21200640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c1c163b80 0x7f5c1c15ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c21200640 1 -- 172.21.15.59:0/2654757979 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c159b90 con 0x7f5c1c0d0470 2024-05-30T16:49:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3400640 1 -- 172.21.15.59:0/2988551680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53e40b1520 msgr2=0x7f53e41fb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3400640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53e40b1520 0x7f53e41fb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f53e3400640 1 -- 172.21.15.59:0/2988551680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c80039c0 msgr2=0x7f53e40ad4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T16:49:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f5c21200640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c1c0d0470 0x7f5c1c159360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800b410 tx=0x7f5c0800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e2a00640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e40b5260 0x7f39e415b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f5c19600640 1 -- 172.21.15.59:0/2654757979 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08015030 con 0x7f5c1c0d0470 2024-05-30T16:49:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f5c19600640 1 -- 172.21.15.59:0/2654757979 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c08004020 con 0x7f5c1c0d0470 2024-05-30T16:49:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f5c19600640 1 -- 172.21.15.59:0/2654757979 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08004450 con 0x7f5c1c0d0470 2024-05-30T16:49:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.018+0000 7f39e2a00640 1 -- 172.21.15.59:0/1013946020 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e415ff60 con 0x7f39e406c0c0 2024-05-30T16:49:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f53e2000640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53e40b1520 0x7f53e41fb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f53e2a00640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c80039c0 0x7f53e40ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f53e3400640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c80039c0 0x7f53e40ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f53e3400640 1 -- 172.21.15.59:0/2988551680 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e414b1b0 con 0x7f53e4152110 2024-05-30T16:49:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f39e3400640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39e4162cc0 0x7f39e41561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f53e2a00640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c80039c0 0x7f53e40ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7efc3be00640 1 -- 172.21.15.59:0/1296579455 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc3c01c070 con 0x7efc440482b0 2024-05-30T16:49:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7fa0e3e00640 1 -- 172.21.15.59:0/2440734673 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa0e401a070 con 0x7fa0ec15a950 2024-05-30T16:49:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7fa0e3e00640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0c8068780 0x7fa0c806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7fa0e3e00640 1 -- 172.21.15.59:0/2440734673 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa0e400f040 con 0x7fa0ec15a950 2024-05-30T16:49:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f53e3400640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e4152110 0x7f53e41fb830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f53e4071190 tx=0x7f53dc009d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f39e2a00640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39e406c0c0 0x7f39e4159210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f39d400c420 tx=0x7f39d400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7fa0eb400640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0c8068780 0x7fa0c806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f5c24600640 1 -- 172.21.15.59:0/2654757979 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1c159e70 con 0x7f5c1c0d0470 2024-05-30T16:49:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f5c24600640 1 -- 172.21.15.59:0/2654757979 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c1c15a430 con 0x7f5c1c0d0470 2024-05-30T16:49:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f39daa00640 1 -- 172.21.15.59:0/1013946020 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4017070 con 0x7f39e406c0c0 2024-05-30T16:49:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f39daa00640 1 -- 172.21.15.59:0/1013946020 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d4005cf0 con 0x7f39e406c0c0 2024-05-30T16:49:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f39daa00640 1 -- 172.21.15.59:0/1013946020 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d40072d0 con 0x7f39e406c0c0 2024-05-30T16:49:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f39e3e00640 1 -- 172.21.15.59:0/1013946020 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e4159b80 con 0x7f39e406c0c0 2024-05-30T16:49:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f39e3e00640 1 -- 172.21.15.59:0/1013946020 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e415aff0 con 0x7f39e406c0c0 2024-05-30T16:49:15.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7fa0e3e00640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] conn(0x7fa0c8070920 0x7fa0c8072d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7fa0e3e00640 1 -- 172.21.15.59:0/2440734673 --> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0c80733f0 con 0x7fa0c8070920 2024-05-30T16:49:15.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7fa0e3e00640 1 -- 172.21.15.59:0/2440734673 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa0e408d050 con 0x7fa0ec15a950 2024-05-30T16:49:15.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7fa0e2a00640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] conn(0x7fa0c8070920 0x7fa0c8072d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f53daa00640 1 -- 172.21.15.59:0/2988551680 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc019070 con 0x7f53e4152110 2024-05-30T16:49:15.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.022+0000 7f53daa00640 1 -- 172.21.15.59:0/2988551680 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53dc007c90 con 0x7f53e4152110 2024-05-30T16:49:15.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7f53daa00640 1 -- 172.21.15.59:0/2988551680 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc014600 con 0x7f53e4152110 2024-05-30T16:49:15.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7f53e3e00640 1 -- 172.21.15.59:0/2988551680 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e4146f20 con 0x7f53e4152110 2024-05-30T16:49:15.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7f53e3e00640 1 -- 172.21.15.59:0/2988551680 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e40ad9e0 con 0x7f53e4152110 2024-05-30T16:49:15.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7efc3be00640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efc30068450 0x7efc3006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7efc3be00640 1 -- 172.21.15.59:0/1296579455 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efc3c088d90 con 0x7efc440482b0 2024-05-30T16:49:15.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7efc3be00640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] conn(0x7efc30070670 0x7efc30072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7efc3be00640 1 -- 172.21.15.59:0/1296579455 --> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc3c01ce50 con 0x7efc30070670 2024-05-30T16:49:15.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7efc3be00640 1 -- 172.21.15.59:0/1296579455 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7efc3c089180 con 0x7efc440482b0 2024-05-30T16:49:15.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7f5c24600640 1 -- 172.21.15.59:0/2654757979 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5c1c15a810 con 0x7f5c1c0d0470 2024-05-30T16:49:15.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7fa0eb400640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0c8068780 0x7fa0c806ac40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec071320 tx=0x7fa0dc0ac000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7f53e3e00640 1 -- 172.21.15.59:0/2988551680 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53e4146cd0 con 0x7f53e4152110 2024-05-30T16:49:15.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7efc4be00640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efc30068450 0x7efc3006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7fa0e2a00640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] conn(0x7fa0c8070920 0x7fa0c8072d40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7efc51400640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] conn(0x7efc30070670 0x7efc30072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7f39e3e00640 1 -- 172.21.15.59:0/1013946020 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39e415b3d0 con 0x7f39e406c0c0 2024-05-30T16:49:15.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7f39daa00640 1 -- 172.21.15.59:0/1013946020 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f39d401a070 con 0x7f39e406c0c0 2024-05-30T16:49:15.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7efc4be00640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efc30068450 0x7efc3006a910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efc40006fd0 tx=0x7efc40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7fa0e3e00640 1 -- 172.21.15.59:0/2440734673 <== osd.7 v2:172.21.15.107:6824/3952746286 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0c80733f0 con 0x7fa0c8070920 2024-05-30T16:49:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f39daa00640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f39c40683d0 0x7f39c406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7f5c19600640 1 -- 172.21.15.59:0/2654757979 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c08018070 con 0x7f5c1c0d0470 2024-05-30T16:49:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7f5c19600640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5bfc0683d0 0x7f5bfc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.026+0000 7f5c19600640 1 -- 172.21.15.59:0/2654757979 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5c080863e0 con 0x7f5c1c0d0470 2024-05-30T16:49:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f5c19600640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] conn(0x7f5bfc0705d0 0x7f5bfc0729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f5c19600640 1 -- 172.21.15.59:0/2654757979 --> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5bfc0730a0 con 0x7f5bfc0705d0 2024-05-30T16:49:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f5c19600640 1 -- 172.21.15.59:0/2654757979 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5c0808d050 con 0x7f5c1c0d0470 2024-05-30T16:49:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f39daa00640 1 -- 172.21.15.59:0/1013946020 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f39d4085b80 con 0x7f39e406c0c0 2024-05-30T16:49:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f39daa00640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] conn(0x7f39c40705f0 0x7f39c4072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f39daa00640 1 -- 172.21.15.59:0/1013946020 --> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39d401be50 con 0x7f39c40705f0 2024-05-30T16:49:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f39daa00640 1 -- 172.21.15.59:0/1013946020 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f39d408b2a0 con 0x7f39e406c0c0 2024-05-30T16:49:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f53daa00640 1 -- 172.21.15.59:0/2988551680 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f53dc01c070 con 0x7f53e4152110 2024-05-30T16:49:15.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f5c21c00640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5bfc0683d0 0x7f5bfc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f5c22600640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] conn(0x7f5bfc0705d0 0x7f5bfc0729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f39e3400640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] conn(0x7f39c40705f0 0x7f39c4072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f39e2000640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f39c40683d0 0x7f39c406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f5c21c00640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5bfc0683d0 0x7f5bfc06a890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5c100011f0 tx=0x7f5c10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f5c22600640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] conn(0x7f5bfc0705d0 0x7f5bfc0729f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f39e3400640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] conn(0x7f39c40705f0 0x7f39c4072a10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f39e2000640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f39c40683d0 0x7f39c406a890 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39e4161090 tx=0x7f39dc007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7efc51400640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] conn(0x7efc30070670 0x7efc30072a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f53daa00640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f53c4068380 0x7f53c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f53daa00640 1 -- 172.21.15.59:0/2988551680 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f53dc086e60 con 0x7f53e4152110 2024-05-30T16:49:15.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f53e2a00640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f53c4068380 0x7f53c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f53daa00640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] conn(0x7f53c4070580 0x7f53c40729a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f53daa00640 1 -- 172.21.15.59:0/2988551680 --> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53dc014e50 con 0x7f53c4070580 2024-05-30T16:49:15.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f53daa00640 1 -- 172.21.15.59:0/2988551680 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f53dc087210 con 0x7f53e4152110 2024-05-30T16:49:15.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f5c19600640 1 -- 172.21.15.59:0/2654757979 <== osd.6 v2:172.21.15.107:6800/518733335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5bfc0730a0 con 0x7f5bfc0705d0 2024-05-30T16:49:15.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f39daa00640 1 -- 172.21.15.59:0/1013946020 <== osd.5 v2:172.21.15.107:6816/4169986841 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39d401be50 con 0x7f39c40705f0 2024-05-30T16:49:15.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f53e2000640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] conn(0x7f53c4070580 0x7f53c40729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7f53e2a00640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f53c4068380 0x7f53c406a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53d40a8000 tx=0x7f53d40011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.034+0000 7f53e2000640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] conn(0x7f53c4070580 0x7f53c40729a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.030+0000 7efc3be00640 1 -- 172.21.15.59:0/1296579455 <== osd.4 v2:172.21.15.107:6808/2449835032 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efc3c01ce50 con 0x7efc30070670 2024-05-30T16:49:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.034+0000 7f53daa00640 1 -- 172.21.15.59:0/2988551680 <== osd.3 v2:172.21.15.59:6800/2728314061 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53dc014e50 con 0x7f53c4070580 2024-05-30T16:49:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f58a5600640 1 -- 172.21.15.59:0/885424928 --> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f58a0154fa0 con 0x7f58800706a0 2024-05-30T16:49:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f1397e00640 1 -- 172.21.15.59:0/296392749 --> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f13900e20f0 con 0x7f13780705f0 2024-05-30T16:49:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f0553a00640 1 -- 172.21.15.59:0/4243764951 --> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0524002de0 con 0x7f052c070720 2024-05-30T16:49:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f138f400640 1 -- 172.21.15.59:0/296392749 <== osd.1 v2:172.21.15.59:6824/743808646 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f13900e20f0 con 0x7f13780705f0 2024-05-30T16:49:15.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f5897e00640 1 -- 172.21.15.59:0/885424928 <== osd.0 v2:172.21.15.59:6816/1671295766 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f58a0154fa0 con 0x7f58800706a0 2024-05-30T16:49:15.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f1397e00640 1 -- 172.21.15.59:0/296392749 >> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] conn(0x7f13780705f0 msgr2=0x7f1378072a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f1397e00640 1 --2- 172.21.15.59:0/296392749 >> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] conn(0x7f13780705f0 0x7f1378072a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f1397e00640 1 -- 172.21.15.59:0/296392749 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13780683d0 msgr2=0x7f137806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f1397e00640 1 --2- 172.21.15.59:0/296392749 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13780683d0 0x7f137806a890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1398050b40 tx=0x7f139806af10 comp rx=0 tx=0).stop 2024-05-30T16:49:15.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f1397e00640 1 -- 172.21.15.59:0/296392749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1390033e40 msgr2=0x7f13900e4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f1397e00640 1 --2- 172.21.15.59:0/296392749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1390033e40 0x7f13900e4ce0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f138800d620 tx=0x7f138800dae0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f1397400640 1 -- 172.21.15.59:0/296392749 reap_dead start 2024-05-30T16:49:15.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f58a5600640 1 -- 172.21.15.59:0/885424928 >> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] conn(0x7f58800706a0 msgr2=0x7f5880072ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f58a5600640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] conn(0x7f58800706a0 0x7f5880072ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f58a5600640 1 -- 172.21.15.59:0/885424928 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5880068480 msgr2=0x7f588006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f58a5600640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5880068480 0x7f588006a940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5890006fd0 tx=0x7f58900090e0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f58a5600640 1 -- 172.21.15.59:0/885424928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a015ce60 msgr2=0x7f58a015d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f58a5600640 1 --2- 172.21.15.59:0/885424928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a015ce60 0x7f58a015d8f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f58a0071c00 tx=0x7f588c00c820 comp rx=0 tx=0).stop 2024-05-30T16:49:15.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f1397e00640 1 -- 172.21.15.59:0/296392749 shutdown_connections 2024-05-30T16:49:15.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f1397e00640 1 -- 172.21.15.59:0/296392749 >> 172.21.15.59:0/296392749 conn(0x7f1390009fc0 msgr2=0x7f1390039b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.046+0000 7f0548c00640 1 -- 172.21.15.59:0/4243764951 <== osd.2 v2:172.21.15.59:6808/3949011694 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0524002de0 con 0x7f052c070720 2024-05-30T16:49:15.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f58a4c00640 1 -- 172.21.15.59:0/885424928 reap_dead start 2024-05-30T16:49:15.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f58a5600640 1 -- 172.21.15.59:0/885424928 shutdown_connections 2024-05-30T16:49:15.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f58a5600640 1 -- 172.21.15.59:0/885424928 >> 172.21.15.59:0/885424928 conn(0x7f58a00721b0 msgr2=0x7f58a00cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f0553a00640 1 -- 172.21.15.59:0/4243764951 >> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] conn(0x7f052c070720 msgr2=0x7f052c072b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f1397e00640 1 -- 172.21.15.59:0/296392749 shutdown_connections 2024-05-30T16:49:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f0553a00640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] conn(0x7f052c070720 0x7f052c072b40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f1397e00640 1 -- 172.21.15.59:0/296392749 wait complete. 2024-05-30T16:49:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f58a5600640 1 -- 172.21.15.59:0/885424928 shutdown_connections 2024-05-30T16:49:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f58a5600640 1 -- 172.21.15.59:0/885424928 wait complete. 2024-05-30T16:49:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f0553a00640 1 -- 172.21.15.59:0/4243764951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f052c068580 msgr2=0x7f052c06aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f0553a00640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f052c068580 0x7f052c06aa40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05440012f0 tx=0x7f0544009040 comp rx=0 tx=0).stop 2024-05-30T16:49:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f0553a00640 1 -- 172.21.15.59:0/4243764951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f054c0d0470 msgr2=0x7f054c15a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f0553a00640 1 --2- 172.21.15.59:0/4243764951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f054c0d0470 0x7f054c15a0f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f05380ac000 tx=0x7f0538019290 comp rx=0 tx=0).stop 2024-05-30T16:49:15.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f0551a00640 1 -- 172.21.15.59:0/4243764951 reap_dead start 2024-05-30T16:49:15.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f0553a00640 1 -- 172.21.15.59:0/4243764951 shutdown_connections 2024-05-30T16:49:15.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f0553a00640 1 -- 172.21.15.59:0/4243764951 >> 172.21.15.59:0/4243764951 conn(0x7f054c0b22d0 msgr2=0x7f054c06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f0553a00640 1 -- 172.21.15.59:0/4243764951 shutdown_connections 2024-05-30T16:49:15.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.050+0000 7f0553a00640 1 -- 172.21.15.59:0/4243764951 wait complete. 2024-05-30T16:49:15.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.054+0000 7f39e3e00640 1 -- 172.21.15.59:0/1013946020 --> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f39e40691a0 con 0x7f39c40705f0 2024-05-30T16:49:15.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.054+0000 7f39daa00640 1 -- 172.21.15.59:0/1013946020 <== osd.5 v2:172.21.15.107:6816/4169986841 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f39e40691a0 con 0x7f39c40705f0 2024-05-30T16:49:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f39e3e00640 1 -- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] conn(0x7f39c40705f0 msgr2=0x7f39c4072a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f39e3e00640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] conn(0x7f39c40705f0 0x7f39c4072a10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f39e3e00640 1 -- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f39c40683d0 msgr2=0x7f39c406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f39e3e00640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f39c40683d0 0x7f39c406a890 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39e4161090 tx=0x7f39dc007d50 comp rx=0 tx=0).stop 2024-05-30T16:49:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f39e3e00640 1 -- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39e406c0c0 msgr2=0x7f39e4159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f39e3e00640 1 --2- 172.21.15.59:0/1013946020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39e406c0c0 0x7f39e4159210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f39d400c420 tx=0x7f39d400c8e0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f39e3400640 1 -- 172.21.15.59:0/1013946020 reap_dead start 2024-05-30T16:49:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f39e3e00640 1 -- 172.21.15.59:0/1013946020 shutdown_connections 2024-05-30T16:49:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f39e3e00640 1 -- 172.21.15.59:0/1013946020 >> 172.21.15.59:0/1013946020 conn(0x7f39e40b6990 msgr2=0x7f39e40cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f39e3e00640 1 -- 172.21.15.59:0/1013946020 shutdown_connections 2024-05-30T16:49:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f39e3e00640 1 -- 172.21.15.59:0/1013946020 wait complete. 2024-05-30T16:49:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f5c24600640 1 -- 172.21.15.59:0/2654757979 --> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5c1c068a90 con 0x7f5bfc0705d0 2024-05-30T16:49:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f5c19600640 1 -- 172.21.15.59:0/2654757979 <== osd.6 v2:172.21.15.107:6800/518733335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5c1c068a90 con 0x7f5bfc0705d0 2024-05-30T16:49:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f5c24600640 1 -- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] conn(0x7f5bfc0705d0 msgr2=0x7f5bfc0729f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f5c24600640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] conn(0x7f5bfc0705d0 0x7f5bfc0729f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f5c24600640 1 -- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5bfc0683d0 msgr2=0x7f5bfc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f5c24600640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5bfc0683d0 0x7f5bfc06a890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5c100011f0 tx=0x7f5c10009040 comp rx=0 tx=0).stop 2024-05-30T16:49:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f5c24600640 1 -- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c1c0d0470 msgr2=0x7f5c1c159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f5c24600640 1 --2- 172.21.15.59:0/2654757979 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c1c0d0470 0x7f5c1c159360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800b410 tx=0x7f5c0800b8d0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.062+0000 7f5c22600640 1 -- 172.21.15.59:0/2654757979 reap_dead start 2024-05-30T16:49:15.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f5c24600640 1 -- 172.21.15.59:0/2654757979 shutdown_connections 2024-05-30T16:49:15.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f5c24600640 1 -- 172.21.15.59:0/2654757979 >> 172.21.15.59:0/2654757979 conn(0x7f5c1c0b22d0 msgr2=0x7f5c1c1616f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2440734673 --> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa0ec0cea70 con 0x7fa0c8070920 2024-05-30T16:49:15.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f5c24600640 1 -- 172.21.15.59:0/2654757979 shutdown_connections 2024-05-30T16:49:15.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f53e3e00640 1 -- 172.21.15.59:0/2988551680 --> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53e40b1ce0 con 0x7f53c4070580 2024-05-30T16:49:15.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f5c24600640 1 -- 172.21.15.59:0/2654757979 wait complete. 2024-05-30T16:49:15.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0e3e00640 1 -- 172.21.15.59:0/2440734673 <== osd.7 v2:172.21.15.107:6824/3952746286 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa0ec0cea70 con 0x7fa0c8070920 2024-05-30T16:49:15.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f53daa00640 1 -- 172.21.15.59:0/2988551680 <== osd.3 v2:172.21.15.59:6800/2728314061 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f53e40b1ce0 con 0x7f53c4070580 2024-05-30T16:49:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7efc52a00640 1 -- 172.21.15.59:0/1296579455 --> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efc28002de0 con 0x7efc30070670 2024-05-30T16:49:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] conn(0x7fa0c8070920 msgr2=0x7fa0c8072d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0f0c00640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] conn(0x7fa0c8070920 0x7fa0c8072d40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7efc3be00640 1 -- 172.21.15.59:0/1296579455 <== osd.4 v2:172.21.15.107:6808/2449835032 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efc28002de0 con 0x7efc30070670 2024-05-30T16:49:15.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7efc39600640 1 -- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] conn(0x7efc30070670 msgr2=0x7efc30072a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7efc39600640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] conn(0x7efc30070670 0x7efc30072a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0c8068780 msgr2=0x7fa0c806ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0f0c00640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0c8068780 0x7fa0c806ac40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec071320 tx=0x7fa0dc0ac000 comp rx=0 tx=0).stop 2024-05-30T16:49:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2440734673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec15a950 msgr2=0x7fa0ec14abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f53e3e00640 1 -- 172.21.15.59:0/2988551680 >> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] conn(0x7f53c4070580 msgr2=0x7f53c40729a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f53e3e00640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] conn(0x7f53c4070580 0x7f53c40729a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f53e3e00640 1 -- 172.21.15.59:0/2988551680 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f53c4068380 msgr2=0x7f53c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f53e3e00640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f53c4068380 0x7f53c406a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53d40a8000 tx=0x7f53d40011a0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f53e3e00640 1 -- 172.21.15.59:0/2988551680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e4152110 msgr2=0x7f53e41fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f53e3e00640 1 --2- 172.21.15.59:0/2988551680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53e4152110 0x7f53e41fb830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f53e4071190 tx=0x7f53dc009d50 comp rx=0 tx=0).stop 2024-05-30T16:49:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0f0c00640 1 --2- 172.21.15.59:0/2440734673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec15a950 0x7fa0ec14abf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400e930 tx=0x7fa0e400edf0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0ebe00640 1 -- 172.21.15.59:0/2440734673 reap_dead start 2024-05-30T16:49:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2440734673 shutdown_connections 2024-05-30T16:49:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2440734673 >> 172.21.15.59:0/2440734673 conn(0x7fa0ec0721b0 msgr2=0x7fa0ec0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7f53e3400640 1 -- 172.21.15.59:0/2988551680 reap_dead start 2024-05-30T16:49:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2440734673 shutdown_connections 2024-05-30T16:49:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.070+0000 7f53e3e00640 1 -- 172.21.15.59:0/2988551680 shutdown_connections 2024-05-30T16:49:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.070+0000 7f53e3e00640 1 -- 172.21.15.59:0/2988551680 >> 172.21.15.59:0/2988551680 conn(0x7f53e40b1fd0 msgr2=0x7f53e4152ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.070+0000 7f53e3e00640 1 -- 172.21.15.59:0/2988551680 shutdown_connections 2024-05-30T16:49:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7efc39600640 1 -- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efc30068450 msgr2=0x7efc3006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7efc39600640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efc30068450 0x7efc3006a910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efc40006fd0 tx=0x7efc40008040 comp rx=0 tx=0).stop 2024-05-30T16:49:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7efc39600640 1 -- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc440482b0 msgr2=0x7efc44035780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7efc39600640 1 --2- 172.21.15.59:0/1296579455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc440482b0 0x7efc44035780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009df0 tx=0x7efc3c00c430 comp rx=0 tx=0).stop 2024-05-30T16:49:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7efc51400640 1 -- 172.21.15.59:0/1296579455 reap_dead start 2024-05-30T16:49:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7efc39600640 1 -- 172.21.15.59:0/1296579455 shutdown_connections 2024-05-30T16:49:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7efc39600640 1 -- 172.21.15.59:0/1296579455 >> 172.21.15.59:0/1296579455 conn(0x7efc44054ca0 msgr2=0x7efc44052e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.070+0000 7efc39600640 1 -- 172.21.15.59:0/1296579455 shutdown_connections 2024-05-30T16:49:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.070+0000 7efc39600640 1 -- 172.21.15.59:0/1296579455 wait complete. 2024-05-30T16:49:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.066+0000 7fa0f0c00640 1 -- 172.21.15.59:0/2440734673 wait complete. 2024-05-30T16:49:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.070+0000 7f53e3e00640 1 -- 172.21.15.59:0/2988551680 wait complete. 2024-05-30T16:49:15.110 INFO:teuthology.orchestra.run.smithi059.stdout:64424509447 2024-05-30T16:49:15.111 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-30T16:49:15.112 INFO:teuthology.orchestra.run.smithi059.stdout:64424509447 2024-05-30T16:49:15.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-30T16:49:15.113 INFO:teuthology.orchestra.run.smithi059.stdout:64424509447 2024-05-30T16:49:15.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-30T16:49:15.115 INFO:teuthology.orchestra.run.smithi059.stdout:64424509447 2024-05-30T16:49:15.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-30T16:49:15.116 INFO:teuthology.orchestra.run.smithi059.stdout:64424509448 2024-05-30T16:49:15.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-30T16:49:15.117 INFO:teuthology.orchestra.run.smithi059.stdout:64424509447 2024-05-30T16:49:15.117 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-30T16:49:15.119 INFO:teuthology.orchestra.run.smithi059.stdout:60129542151 2024-05-30T16:49:15.120 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-30T16:49:15.121 INFO:teuthology.orchestra.run.smithi059.stdout:64424509446 2024-05-30T16:49:15.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-30T16:49:15.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.326+0000 7f1260200640 1 Processor -- start 2024-05-30T16:49:15.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.326+0000 7f1260200640 1 -- start start 2024-05-30T16:49:15.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f1260200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f125815a6e0 0x7f12580d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f1260200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1258073c80 0x7f125806ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f1260200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12580ad320 con 0x7f12580b3dc0 2024-05-30T16:49:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f1260200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f125806def0 con 0x7f125815a6e0 2024-05-30T16:49:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f1260200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f12580d0fa0 con 0x7f1258073c80 2024-05-30T16:49:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f125e200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1258073c80 0x7f125806ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f125e200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1258073c80 0x7f125806ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:58818/0 (socket says 172.21.15.59:58818) 2024-05-30T16:49:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f125e200640 1 -- 172.21.15.59:0/2144130301 learned_addr learned my addr 172.21.15.59:0/2144130301 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f125e200640 1 -- 172.21.15.59:0/2144130301 >> v2:172.21.15.59:3300/0 conn(0x7f125815a6e0 msgr2=0x7f12580d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f125e200640 1 --2- 172.21.15.59:0/2144130301 >> v2:172.21.15.59:3300/0 conn(0x7f125815a6e0 0x7f12580d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f125e200640 1 -- 172.21.15.59:0/2144130301 >> v1:172.21.15.107:6789/0 conn(0x7f12580b3dc0 legacy=0x7f1258073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f125e200640 1 -- 172.21.15.59:0/2144130301 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125806e1b0 con 0x7f1258073c80 2024-05-30T16:49:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.330+0000 7f1257e00640 1 -- 172.21.15.59:0/2144130301 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479320575 0 0) 0x7f124c001120 con 0x7f12580b3dc0 2024-05-30T16:49:15.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.334+0000 7f125e200640 1 --2- 172.21.15.59:0/2144130301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1258073c80 0x7f125806ec90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f125806de60 tx=0x7f124401eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c762d80d372477c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.338+0000 7f1257e00640 1 -- 172.21.15.59:0/2144130301 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12440b4070 con 0x7f1258073c80 2024-05-30T16:49:15.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.338+0000 7f1257e00640 1 -- 172.21.15.59:0/2144130301 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12440a7c00 con 0x7f1258073c80 2024-05-30T16:49:15.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.338+0000 7f1257e00640 1 -- 172.21.15.59:0/2144130301 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12440af440 con 0x7f1258073c80 2024-05-30T16:49:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.338+0000 7f1260200640 1 -- 172.21.15.59:0/2144130301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1258073c80 msgr2=0x7f125806ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.338+0000 7f1260200640 1 --2- 172.21.15.59:0/2144130301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1258073c80 0x7f125806ec90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f125806de60 tx=0x7f124401eb30 comp rx=0 tx=0).stop 2024-05-30T16:49:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.338+0000 7f1260200640 1 -- 172.21.15.59:0/2144130301 shutdown_connections 2024-05-30T16:49:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.338+0000 7f1260200640 1 --2- 172.21.15.59:0/2144130301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1258073c80 0x7f125806ec90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.338+0000 7f1260200640 1 --2- 172.21.15.59:0/2144130301 >> v2:172.21.15.59:3300/0 conn(0x7f125815a6e0 0x7f12580d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.338+0000 7f1260200640 1 -- 172.21.15.59:0/2144130301 >> 172.21.15.59:0/2144130301 conn(0x7f12580b56f0 msgr2=0x7f12580b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.338+0000 7f1260200640 1 -- 172.21.15.59:0/2144130301 shutdown_connections 2024-05-30T16:49:15.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.338+0000 7f1260200640 1 -- 172.21.15.59:0/2144130301 wait complete. 2024-05-30T16:49:15.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f84c9800640 1 Processor -- start 2024-05-30T16:49:15.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f1260200640 1 Processor -- start 2024-05-30T16:49:15.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f1260200640 1 -- start start 2024-05-30T16:49:15.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f1260200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1258073c80 0x7f125815d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f1260200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12580b3dc0 0x7f1258099410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f1260200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f125815a6e0 0x7f125815bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f1260200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f12580b4390 con 0x7f1258073c80 2024-05-30T16:49:15.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f1260200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f12580b4210 con 0x7f12580b3dc0 2024-05-30T16:49:15.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f1260200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f125806f9e0 con 0x7f125815a6e0 2024-05-30T16:49:15.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f84c9800640 1 -- start start 2024-05-30T16:49:15.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f84c9800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f84bc0e76e0 0x7f84bc007190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f84c9800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84bc058a80 0x7f84bc053510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f84c9800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 0x7f84bc053a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f84c9800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f84bc005ea0 con 0x7f84bc058a80 2024-05-30T16:49:15.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f84c9800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f84bc006d00 con 0x7f84bc0e76e0 2024-05-30T16:49:15.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f84c9800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f84bc057f80 con 0x7f84bc056e70 2024-05-30T16:49:15.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f84c3e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f84bc0e76e0 0x7f84bc007190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f84c3e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f84bc0e76e0 0x7f84bc007190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:58834/0 (socket says 172.21.15.59:58834) 2024-05-30T16:49:15.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f84c3e00640 1 -- 172.21.15.59:0/1263128717 learned_addr learned my addr 172.21.15.59:0/1263128717 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.342+0000 7f84c3400640 1 --2- 172.21.15.59:0/1263128717 >> v2:172.21.15.59:3300/0 conn(0x7f84bc058a80 0x7f84bc053510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f125d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1258073c80 0x7f125815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f125d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1258073c80 0x7f125815d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54312/0 (socket says 172.21.15.59:54312) 2024-05-30T16:49:15.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f125d800640 1 -- 172.21.15.59:0/819494034 learned_addr learned my addr 172.21.15.59:0/819494034 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f84c8e00640 1 --2- 172.21.15.59:0/1263128717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 0x7f84bc053a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f84c8e00640 1 -- 172.21.15.59:0/1263128717 >> v2:172.21.15.107:3300/0 conn(0x7f84bc0e76e0 msgr2=0x7f84bc007190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f84c8e00640 1 --2- 172.21.15.59:0/1263128717 >> v2:172.21.15.107:3300/0 conn(0x7f84bc0e76e0 0x7f84bc007190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f84c8e00640 1 -- 172.21.15.59:0/1263128717 >> v2:172.21.15.59:3300/0 conn(0x7f84bc058a80 msgr2=0x7f84bc053510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f125ce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12580b3dc0 0x7f1258099410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f125e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f125815a6e0 0x7f125815bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f125e200640 1 -- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12580b3dc0 msgr2=0x7f1258099410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f125e200640 1 --2- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12580b3dc0 0x7f1258099410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f125e200640 1 -- 172.21.15.59:0/819494034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1258073c80 msgr2=0x7f125815d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f125e200640 1 --2- 172.21.15.59:0/819494034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1258073c80 0x7f125815d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f125e200640 1 -- 172.21.15.59:0/819494034 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125815c6c0 con 0x7f125815a6e0 2024-05-30T16:49:15.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f125e200640 1 --2- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f125815a6e0 0x7f125815bbe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f12440ae000 tx=0x7f124401d370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f1255600640 1 -- 172.21.15.59:0/819494034 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12440bf070 con 0x7f125815a6e0 2024-05-30T16:49:15.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f84c8e00640 1 --2- 172.21.15.59:0/1263128717 >> v2:172.21.15.59:3300/0 conn(0x7f84bc058a80 0x7f84bc053510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f84c8e00640 1 -- 172.21.15.59:0/1263128717 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc0060f0 con 0x7f84bc056e70 2024-05-30T16:49:15.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f84c3e00640 1 --2- 172.21.15.59:0/1263128717 >> v2:172.21.15.107:3300/0 conn(0x7f84bc0e76e0 0x7f84bc007190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:15.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f84c3400640 1 --2- 172.21.15.59:0/1263128717 >> v2:172.21.15.59:3300/0 conn(0x7f84bc058a80 0x7f84bc053510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:15.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f1255600640 1 -- 172.21.15.59:0/819494034 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12440ba640 con 0x7f125815a6e0 2024-05-30T16:49:15.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.346+0000 7f1255600640 1 -- 172.21.15.59:0/819494034 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12440bf070 con 0x7f125815a6e0 2024-05-30T16:49:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f1260200640 1 -- 172.21.15.59:0/819494034 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f125815c9a0 con 0x7f125815a6e0 2024-05-30T16:49:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f1260200640 1 -- 172.21.15.59:0/819494034 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f125815cf60 con 0x7f125815a6e0 2024-05-30T16:49:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f84c8e00640 1 --2- 172.21.15.59:0/1263128717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 0x7f84bc053a50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0100c0 tx=0x7f84b001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=136fc7bf51871172 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f84c2a00640 1 -- 172.21.15.59:0/1263128717 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00b0070 con 0x7f84bc056e70 2024-05-30T16:49:15.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f84c2a00640 1 -- 172.21.15.59:0/1263128717 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b00ab600 con 0x7f84bc056e70 2024-05-30T16:49:15.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f84c2a00640 1 -- 172.21.15.59:0/1263128717 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00ab9d0 con 0x7f84bc056e70 2024-05-30T16:49:15.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f1260200640 1 -- 172.21.15.59:0/819494034 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1258068a90 con 0x7f125815a6e0 2024-05-30T16:49:15.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f84c9800640 1 -- 172.21.15.59:0/1263128717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 msgr2=0x7f84bc053a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f84c9800640 1 --2- 172.21.15.59:0/1263128717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 0x7f84bc053a50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0100c0 tx=0x7f84b001c480 comp rx=0 tx=0).stop 2024-05-30T16:49:15.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f84c9800640 1 -- 172.21.15.59:0/1263128717 shutdown_connections 2024-05-30T16:49:15.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f84c9800640 1 --2- 172.21.15.59:0/1263128717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 0x7f84bc053a50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f84c9800640 1 --2- 172.21.15.59:0/1263128717 >> v2:172.21.15.59:3300/0 conn(0x7f84bc058a80 0x7f84bc053510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f84c9800640 1 --2- 172.21.15.59:0/1263128717 >> v2:172.21.15.107:3300/0 conn(0x7f84bc0e76e0 0x7f84bc007190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f84c9800640 1 -- 172.21.15.59:0/1263128717 >> 172.21.15.59:0/1263128717 conn(0x7f84bc03aa40 msgr2=0x7f84bc03ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.354+0000 7f1255600640 1 -- 172.21.15.59:0/819494034 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12440b93e0 con 0x7f125815a6e0 2024-05-30T16:49:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.358+0000 7f84c9800640 1 -- 172.21.15.59:0/1263128717 shutdown_connections 2024-05-30T16:49:15.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.358+0000 7f84c9800640 1 -- 172.21.15.59:0/1263128717 wait complete. 2024-05-30T16:49:15.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.358+0000 7f1255600640 1 --2- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12380687b0 0x7f123806ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.358+0000 7f125d800640 1 --2- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12380687b0 0x7f123806ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.358+0000 7f1255600640 1 -- 172.21.15.59:0/819494034 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f12440ba440 con 0x7f125815a6e0 2024-05-30T16:49:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.358+0000 7fd7f5600640 1 Processor -- start 2024-05-30T16:49:15.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.358+0000 7fd7f5600640 1 -- start start 2024-05-30T16:49:15.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.358+0000 7f84c9800640 1 Processor -- start 2024-05-30T16:49:15.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.358+0000 7f84c9800640 1 -- start start 2024-05-30T16:49:15.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.358+0000 7f125d800640 1 --2- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12380687b0 0x7f123806ac70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f125000e250 tx=0x7f125000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c9800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 0x7f84bc00d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c9800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84bc058a80 0x7f84bc0d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84bc0e76e0 0x7f84bc04b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c9800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc0076d0 con 0x7f84bc0e76e0 2024-05-30T16:49:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c9800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc03c5b0 con 0x7f84bc058a80 2024-05-30T16:49:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c9800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f84bc0d04d0 con 0x7f84bc056e70 2024-05-30T16:49:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 0x7f84bc00d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 0x7f84bc00d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36114/0 (socket says 172.21.15.59:36114) 2024-05-30T16:49:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c3e00640 1 -- 172.21.15.59:0/4017781716 learned_addr learned my addr 172.21.15.59:0/4017781716 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c3400640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84bc058a80 0x7f84bc0d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c8e00640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84bc0e76e0 0x7f84bc04b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f33db200640 1 Processor -- start 2024-05-30T16:49:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f33db200640 1 -- start start 2024-05-30T16:49:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c3e00640 1 -- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84bc058a80 msgr2=0x7f84bc0d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c3e00640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84bc058a80 0x7f84bc0d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c3e00640 1 -- 172.21.15.59:0/4017781716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84bc0e76e0 msgr2=0x7f84bc04b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c3e00640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84bc0e76e0 0x7f84bc04b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c3e00640 1 -- 172.21.15.59:0/4017781716 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc0cff10 con 0x7f84bc056e70 2024-05-30T16:49:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7fd7f5600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd7f006fd60 0x7fd7f0154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7fd7f5600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7f00720a0 0x7fd7f0072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c3e00640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 0x7f84bc00d390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f84c4000b70 tx=0x7f84c406cd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7fd7ef400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7f00720a0 0x7fd7f0072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7fd7f4c00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd7f006df70 0x7fd7f006e400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:54274/0 (socket says 172.21.15.59:54274) 2024-05-30T16:49:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7fd7f4c00640 1 -- 172.21.15.59:0/294044429 learned_addr learned my addr 172.21.15.59:0/294044429 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7fd7efe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd7f006fd60 0x7fd7f0154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7fd7f5600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7f006ece0 con 0x7fd7f006df70 2024-05-30T16:49:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7fd7f5600640 1 -- 172.21.15.59:0/294044429 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd7f0072a40 con 0x7fd7f006fd60 2024-05-30T16:49:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7fd7f5600640 1 -- 172.21.15.59:0/294044429 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd7f006efc0 con 0x7fd7f00720a0 2024-05-30T16:49:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84b7e00640 1 -- 172.21.15.59:0/4017781716 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4098070 con 0x7f84bc056e70 2024-05-30T16:49:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84b7e00640 1 -- 172.21.15.59:0/4017781716 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c4071b00 con 0x7f84bc056e70 2024-05-30T16:49:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84b7e00640 1 -- 172.21.15.59:0/4017781716 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4093430 con 0x7f84bc056e70 2024-05-30T16:49:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f1255600640 1 -- 172.21.15.59:0/819494034 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12440187e0 con 0x7f125815a6e0 2024-05-30T16:49:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33db200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f33d40b38e0 0x7f33d415f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33db200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33d41620d0 con 0x7f33d4161cf0 2024-05-30T16:49:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33db200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33d4162560 con 0x7f33d406fa10 2024-05-30T16:49:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33db200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f33d4162310 con 0x7f33d40b38e0 2024-05-30T16:49:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066623458 0 0) 0x7fd7f006ece0 con 0x7fd7f006df70 2024-05-30T16:49:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7d4003530 con 0x7fd7f006df70 2024-05-30T16:49:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2305137380 0 0) 0x7fd7d4003530 con 0x7fd7f006df70 2024-05-30T16:49:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7f00720a0 msgr2=0x7fd7f0072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7f00720a0 0x7fd7f0072500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 >> v2:172.21.15.59:3300/0 conn(0x7fd7f006fd60 msgr2=0x7fd7f0154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 --2- 172.21.15.59:0/294044429 >> v2:172.21.15.59:3300/0 conn(0x7fd7f006fd60 0x7fd7f0154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f006f2a0 con 0x7fd7f006df70 2024-05-30T16:49:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fd7e8001a00 con 0x7fd7f006df70 2024-05-30T16:49:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 >> v1:172.21.15.107:6789/0 conn(0x7fd7f006df70 legacy=0x7fd7f006e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7d40039c0 0x7fd7d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7d4004810 0x7fd7d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7d40051d0 0x7fd7d400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f006efc0 con 0x7fd7d4004810 2024-05-30T16:49:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d400bfc0 con 0x7fd7d40051d0 2024-05-30T16:49:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d400c190 con 0x7fd7d40039c0 2024-05-30T16:49:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7efe00640 1 --2- 172.21.15.59:0/294044429 >> v2:172.21.15.59:3300/0 conn(0x7fd7f006fd60 0x7fd7f0154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7ef400640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7f00720a0 0x7fd7f0072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c9800640 1 -- 172.21.15.59:0/4017781716 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84bc0d01f0 con 0x7f84bc056e70 2024-05-30T16:49:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.362+0000 7f84c9800640 1 -- 172.21.15.59:0/4017781716 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84bc0cfbc0 con 0x7f84bc056e70 2024-05-30T16:49:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7efe00640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7d40039c0 0x7fd7d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d9200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f33d406fa10 0x7f33d415fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:54278/0 (socket says 172.21.15.59:54278) 2024-05-30T16:49:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d9200640 1 -- 172.21.15.59:0/243911153 learned_addr learned my addr 172.21.15.59:0/243911153 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d3400640 1 --2- 172.21.15.59:0/243911153 >> v2:172.21.15.59:3300/0 conn(0x7f33d40b38e0 0x7f33d415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2212334370 0 0) 0x7f33d4162560 con 0x7f33d406fa10 2024-05-30T16:49:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33b8003530 con 0x7f33d406fa10 2024-05-30T16:49:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7f4c00640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7d40051d0 0x7fd7d400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7feb6e400640 1 Processor -- start 2024-05-30T16:49:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7feb6e400640 1 -- start start 2024-05-30T16:49:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f84b7e00640 1 -- 172.21.15.59:0/4017781716 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84c4068020 con 0x7f84bc056e70 2024-05-30T16:49:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3629185722 0 0) 0x7f33b8003530 con 0x7f33d406fa10 2024-05-30T16:49:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 >> v2:172.21.15.59:3300/0 conn(0x7f33d40b38e0 msgr2=0x7f33d415f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f84c9800640 1 -- 172.21.15.59:0/4017781716 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a00052a0 con 0x7f84bc056e70 2024-05-30T16:49:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 --2- 172.21.15.59:0/243911153 >> v2:172.21.15.59:3300/0 conn(0x7f33d40b38e0 0x7f33d415f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 >> v1:172.21.15.59:6789/0 conn(0x7f33d4161cf0 legacy=0x7f33d40b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d4162840 con 0x7f33d406fa10 2024-05-30T16:49:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f33cc001a00 con 0x7f33d406fa10 2024-05-30T16:49:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 >> v1:172.21.15.107:6789/0 conn(0x7f33d406fa10 legacy=0x7f33d415fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 --2- 172.21.15.59:0/243911153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b8003a10 0x7f33b8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 --2- 172.21.15.59:0/243911153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33b8004810 0x7f33b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 --2- 172.21.15.59:0/243911153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b8005220 0x7f33b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f33d4162310 con 0x7f33b8005220 2024-05-30T16:49:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f33b800c150 con 0x7f33b8003a10 2024-05-30T16:49:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f33b800c350 con 0x7f33b8004810 2024-05-30T16:49:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d3400640 1 --2- 172.21.15.59:0/243911153 >> v2:172.21.15.59:3300/0 conn(0x7f33d40b38e0 0x7f33d415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7ef400640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7d4004810 0x7fd7d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7efe00640 1 -- 172.21.15.59:0/294044429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7d40051d0 msgr2=0x7fd7d400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7efe00640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7d40051d0 0x7fd7d400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7efe00640 1 -- 172.21.15.59:0/294044429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7d4004810 msgr2=0x7fd7d4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7efe00640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7d4004810 0x7fd7d4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7efe00640 1 -- 172.21.15.59:0/294044429 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f006f2a0 con 0x7fd7d40039c0 2024-05-30T16:49:15.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7fd7ef400640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7d4004810 0x7fd7d4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:15.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f84b7e00640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f84a4068450 0x7f84a406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f84b7e00640 1 -- 172.21.15.59:0/4017781716 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f84c4101a60 con 0x7f84bc056e70 2024-05-30T16:49:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.366+0000 7f33d3400640 1 --2- 172.21.15.59:0/243911153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33b8004810 0x7f33b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7f33d3e00640 1 --2- 172.21.15.59:0/243911153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b8003a10 0x7f33b8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7f33d9200640 1 --2- 172.21.15.59:0/243911153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b8005220 0x7f33b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb6e400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feb680b1010 0x7feb6806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb6e400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 0x7feb680b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb6e400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb680b0610 con 0x7feb680ce4a0 2024-05-30T16:49:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb6e400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7feb680b1930 con 0x7feb680b1010 2024-05-30T16:49:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb6e400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7feb680b0900 con 0x7feb680b3a00 2024-05-30T16:49:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb67e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 0x7feb680b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb67e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 0x7feb680b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36156/0 (socket says 172.21.15.59:36156) 2024-05-30T16:49:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb67e00640 1 -- 172.21.15.59:0/1840735002 learned_addr learned my addr 172.21.15.59:0/1840735002 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7f33d3e00640 1 -- 172.21.15.59:0/243911153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33b8004810 msgr2=0x7f33b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7f33d3e00640 1 --2- 172.21.15.59:0/243911153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33b8004810 0x7f33b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7f33d3e00640 1 -- 172.21.15.59:0/243911153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b8005220 msgr2=0x7f33b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7f33d3e00640 1 --2- 172.21.15.59:0/243911153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b8005220 0x7f33b800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7f33d3e00640 1 -- 172.21.15.59:0/243911153 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b8003530 con 0x7f33b8003a10 2024-05-30T16:49:15.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7f33d9200640 1 -- 172.21.15.59:0/243911153 reap_dead start 2024-05-30T16:49:15.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb6d000640 1 --2- 172.21.15.59:0/1840735002 >> v2:172.21.15.107:3300/0 conn(0x7feb680b1010 0x7feb6806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb67e00640 1 -- 172.21.15.59:0/1840735002 >> v2:172.21.15.107:3300/0 conn(0x7feb680b1010 msgr2=0x7feb6806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb67e00640 1 --2- 172.21.15.59:0/1840735002 >> v2:172.21.15.107:3300/0 conn(0x7feb680b1010 0x7feb6806c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb67e00640 1 -- 172.21.15.59:0/1840735002 >> v1:172.21.15.59:6789/0 conn(0x7feb680ce4a0 legacy=0x7feb680cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7feb67e00640 1 -- 172.21.15.59:0/1840735002 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb680b0be0 con 0x7feb680b3a00 2024-05-30T16:49:15.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7fb6bd200640 1 Processor -- start 2024-05-30T16:49:15.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7fb6bd200640 1 -- start start 2024-05-30T16:49:15.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7f84c3400640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f84a4068450 0x7f84a406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7f84c3400640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f84a4068450 0x7f84a406a910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0ea980 tx=0x7f84b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7fb6bd200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6b8156990 0x7fb6b80b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7fb6bd200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6b806bbe0 0x7fb6b806c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.370+0000 7fb6bd200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b8156d70 con 0x7fb6b80aee30 2024-05-30T16:49:15.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fb6b7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6b8156990 0x7fb6b80b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fd7efe00640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7d40039c0 0x7fd7d4003de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009900 tx=0x7fd7d801c630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c07f386ebec417e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fb6b7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6b8156990 0x7fb6b80b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54350/0 (socket says 172.21.15.59:54350) 2024-05-30T16:49:15.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fb6b7400640 1 -- 172.21.15.59:0/3833535717 learned_addr learned my addr 172.21.15.59:0/3833535717 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fb6bd200640 1 -- 172.21.15.59:0/3833535717 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb6b806c550 con 0x7fb6b8156990 2024-05-30T16:49:15.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fb6bd200640 1 -- 172.21.15.59:0/3833535717 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b80b3f00 con 0x7fb6b806bbe0 2024-05-30T16:49:15.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80ac070 con 0x7fd7d40039c0 2024-05-30T16:49:15.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fb6b7e00640 1 --2- 172.21.15.59:0/3833535717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6b806bbe0 0x7fb6b806c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d80a6640 con 0x7fd7d40039c0 2024-05-30T16:49:15.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fb6b7400640 1 -- 172.21.15.59:0/3833535717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6b806bbe0 msgr2=0x7fb6b806c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fb6b7400640 1 --2- 172.21.15.59:0/3833535717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6b806bbe0 0x7fb6b806c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7f84b7e00640 1 -- 172.21.15.59:0/4017781716 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f84c40d1a40 con 0x7f84bc056e70 2024-05-30T16:49:15.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fb6b7400640 1 -- 172.21.15.59:0/3833535717 >> v1:172.21.15.107:6789/0 conn(0x7fb6b80aee30 legacy=0x7fb6b80b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7f33d3e00640 1 --2- 172.21.15.59:0/243911153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b8003a10 0x7f33b8003e10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f33c0001650 tx=0x7f33c001c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31c30de7327ff01d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c0001250 con 0x7f33b8003a10 2024-05-30T16:49:15.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7f33d2a00640 1 -- 172.21.15.59:0/243911153 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c0005270 con 0x7f33b8003a10 2024-05-30T16:49:15.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7f33db200640 1 -- 172.21.15.59:0/243911153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b8003a10 msgr2=0x7f33b8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7f33db200640 1 --2- 172.21.15.59:0/243911153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b8003a10 0x7f33b8003e10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f33c0001650 tx=0x7f33c001c2e0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fd7eea00640 1 -- 172.21.15.59:0/294044429 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d800f040 con 0x7fd7d40039c0 2024-05-30T16:49:15.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fd7f5600640 1 -- 172.21.15.59:0/294044429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7d40039c0 msgr2=0x7fd7d4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fd7f5600640 1 --2- 172.21.15.59:0/294044429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7d40039c0 0x7fd7d4003de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009900 tx=0x7fd7d801c630 comp rx=0 tx=0).stop 2024-05-30T16:49:15.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fd7f4c00640 1 -- 172.21.15.59:0/294044429 reap_dead start 2024-05-30T16:49:15.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fd7f5600640 1 -- 172.21.15.59:0/294044429 shutdown_connections 2024-05-30T16:49:15.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fd7f5600640 1 -- 172.21.15.59:0/294044429 >> 172.21.15.59:0/294044429 conn(0x7fd7f00b1fd0 msgr2=0x7fd7f00b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.374+0000 7fb6b7400640 1 -- 172.21.15.59:0/3833535717 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b80af3c0 con 0x7fb6b8156990 2024-05-30T16:49:15.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7fd7f5600640 1 -- 172.21.15.59:0/294044429 shutdown_connections 2024-05-30T16:49:15.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7fd7f5600640 1 -- 172.21.15.59:0/294044429 wait complete. 2024-05-30T16:49:15.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7f33db200640 1 -- 172.21.15.59:0/243911153 shutdown_connections 2024-05-30T16:49:15.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7feb67e00640 1 --2- 172.21.15.59:0/1840735002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 0x7feb680b13f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feb60009e50 tx=0x7feb6001c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0a869949eb7f2d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7f33db200640 1 --2- 172.21.15.59:0/243911153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b8003a10 0x7f33b8003e10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7f33db200640 1 -- 172.21.15.59:0/243911153 >> 172.21.15.59:0/243911153 conn(0x7f33d40b56f0 msgr2=0x7f33d40b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7f33db200640 1 -- 172.21.15.59:0/243911153 shutdown_connections 2024-05-30T16:49:15.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7f33db200640 1 -- 172.21.15.59:0/243911153 wait complete. 2024-05-30T16:49:15.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7feb67400640 1 -- 172.21.15.59:0/1840735002 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb600ac020 con 0x7feb680b3a00 2024-05-30T16:49:15.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7feb67400640 1 -- 172.21.15.59:0/1840735002 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb600a64a0 con 0x7feb680b3a00 2024-05-30T16:49:15.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7feb67400640 1 -- 172.21.15.59:0/1840735002 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb600a6870 con 0x7feb680b3a00 2024-05-30T16:49:15.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7feb6e400640 1 -- 172.21.15.59:0/1840735002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 msgr2=0x7feb680b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7feb6e400640 1 --2- 172.21.15.59:0/1840735002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 0x7feb680b13f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feb60009e50 tx=0x7feb6001c810 comp rx=0 tx=0).stop 2024-05-30T16:49:15.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7fd7f5600640 1 Processor -- start 2024-05-30T16:49:15.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7feb6e400640 1 -- 172.21.15.59:0/1840735002 shutdown_connections 2024-05-30T16:49:15.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7feb6e400640 1 --2- 172.21.15.59:0/1840735002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 0x7feb680b13f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7feb6e400640 1 --2- 172.21.15.59:0/1840735002 >> v2:172.21.15.107:3300/0 conn(0x7feb680b1010 0x7feb6806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7feb6e400640 1 -- 172.21.15.59:0/1840735002 >> 172.21.15.59:0/1840735002 conn(0x7feb680b2ee0 msgr2=0x7feb680b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7feb6e400640 1 -- 172.21.15.59:0/1840735002 shutdown_connections 2024-05-30T16:49:15.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7fb6b7400640 1 --2- 172.21.15.59:0/3833535717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b8156990 0x7fb6b80b4a30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8009870 tx=0x7fb6a801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fe76f7a07063b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.378+0000 7fd7f5600640 1 -- start start 2024-05-30T16:49:15.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7f33db200640 1 Processor -- start 2024-05-30T16:49:15.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7feb6e400640 1 -- 172.21.15.59:0/1840735002 wait complete. 2024-05-30T16:49:15.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7f33db200640 1 -- start start 2024-05-30T16:49:15.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fb6b6a00640 1 -- 172.21.15.59:0/3833535717 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80b1070 con 0x7fb6b8156990 2024-05-30T16:49:15.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fb6b6a00640 1 -- 172.21.15.59:0/3833535717 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a80ac630 con 0x7fb6b8156990 2024-05-30T16:49:15.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fb6b6a00640 1 -- 172.21.15.59:0/3833535717 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80a8050 con 0x7fb6b8156990 2024-05-30T16:49:15.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7f33db200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b8003a10 0x7f33d414c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7f33db200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33d409a2c0 0x7f33d40b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7f33db200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33d409a720 0x7f33d414ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7feb6e400640 1 Processor -- start 2024-05-30T16:49:15.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fb6bd200640 1 -- 172.21.15.59:0/3833535717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b8156990 msgr2=0x7fb6b80b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fb6bd200640 1 --2- 172.21.15.59:0/3833535717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b8156990 0x7fb6b80b4a30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8009870 tx=0x7fb6a801c520 comp rx=0 tx=0).stop 2024-05-30T16:49:15.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fd7f5600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7d40039c0 0x7fd7f0156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fd7f5600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f00cc9b0 0x7fd7f00cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fd7f5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f0149f60 0x7fd7f014a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fd7f5600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f0072680 con 0x7fd7f0149f60 2024-05-30T16:49:15.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fd7f5600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f0072500 con 0x7fd7f00cc9b0 2024-05-30T16:49:15.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fd7f5600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd7f0072800 con 0x7fd7d40039c0 2024-05-30T16:49:15.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fd7efe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7d40039c0 0x7fd7f0156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fd7efe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7d40039c0 0x7fd7f0156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36174/0 (socket says 172.21.15.59:36174) 2024-05-30T16:49:15.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fd7efe00640 1 -- 172.21.15.59:0/3632104348 learned_addr learned my addr 172.21.15.59:0/3632104348 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7f33db200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f33d41630e0 con 0x7f33b8003a10 2024-05-30T16:49:15.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7f33db200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f33d4162e00 con 0x7f33d409a720 2024-05-30T16:49:15.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7f33db200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f33d40b31d0 con 0x7f33d409a2c0 2024-05-30T16:49:15.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7f33d3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33d409a2c0 0x7f33d40b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7f33d9200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33d409a720 0x7f33d414ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7f33d9200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33d409a720 0x7f33d414ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:58904/0 (socket says 172.21.15.59:58904) 2024-05-30T16:49:15.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7f33d9200640 1 -- 172.21.15.59:0/1800270777 learned_addr learned my addr 172.21.15.59:0/1800270777 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7fd7f4c00640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f0149f60 0x7fd7f014a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7f33d9200640 1 -- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33d409a2c0 msgr2=0x7f33d40b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7f33d9200640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33d409a2c0 0x7f33d40b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7f33d9200640 1 -- 172.21.15.59:0/1800270777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b8003a10 msgr2=0x7f33d414c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7f33d9200640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b8003a10 0x7f33d414c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7f33d9200640 1 -- 172.21.15.59:0/1800270777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d414cec0 con 0x7f33d409a720 2024-05-30T16:49:15.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fd7efe00640 1 -- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f00cc9b0 msgr2=0x7fd7f00cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fd7efe00640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f00cc9b0 0x7fd7f00cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fd7efe00640 1 -- 172.21.15.59:0/3632104348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f0149f60 msgr2=0x7fd7f014a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fd7efe00640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f0149f60 0x7fd7f014a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fd7efe00640 1 -- 172.21.15.59:0/3632104348 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f0155ec0 con 0x7fd7d40039c0 2024-05-30T16:49:15.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7f33d3400640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33d409a2c0 0x7f33d40b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:15.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7f33d9200640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33d409a720 0x7f33d414ebe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33d40b6450 tx=0x7f33cc011c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.382+0000 7feb6e400640 1 -- start start 2024-05-30T16:49:15.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fb6bd200640 1 -- 172.21.15.59:0/3833535717 shutdown_connections 2024-05-30T16:49:15.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fb6bd200640 1 --2- 172.21.15.59:0/3833535717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6b806bbe0 0x7fb6b806c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fb6bd200640 1 --2- 172.21.15.59:0/3833535717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b8156990 0x7fb6b80b4a30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fb6bd200640 1 -- 172.21.15.59:0/3833535717 >> 172.21.15.59:0/3833535717 conn(0x7fb6b80b21c0 msgr2=0x7fb6b80b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fd7efe00640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7d40039c0 0x7fd7f0156c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009900 tx=0x7fd7d80193d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7f33cbe00640 1 -- 172.21.15.59:0/1800270777 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc010040 con 0x7f33d409a720 2024-05-30T16:49:15.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7feb6e400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb680b1010 0x7feb6814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fb6bd200640 1 -- 172.21.15.59:0/3833535717 shutdown_connections 2024-05-30T16:49:15.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fb6bd200640 1 -- 172.21.15.59:0/3833535717 wait complete. 2024-05-30T16:49:15.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fd7e7e00640 1 -- 172.21.15.59:0/3632104348 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80ac040 con 0x7fd7d40039c0 2024-05-30T16:49:15.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fd7e7e00640 1 -- 172.21.15.59:0/3632104348 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d80a6cc0 con 0x7fd7d40039c0 2024-05-30T16:49:15.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fd7e7e00640 1 -- 172.21.15.59:0/3632104348 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80b1650 con 0x7fd7d40039c0 2024-05-30T16:49:15.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7f33cbe00640 1 -- 172.21.15.59:0/1800270777 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33cc01a070 con 0x7f33d409a720 2024-05-30T16:49:15.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7f33cbe00640 1 -- 172.21.15.59:0/1800270777 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc00fb60 con 0x7f33d409a720 2024-05-30T16:49:15.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fd7f5600640 1 -- 172.21.15.59:0/3632104348 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f01561a0 con 0x7fd7d40039c0 2024-05-30T16:49:15.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fd7f5600640 1 -- 172.21.15.59:0/3632104348 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f00cd370 con 0x7fd7d40039c0 2024-05-30T16:49:15.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7feb6e400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 0x7feb68160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7feb6e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb680ce4a0 0x7feb6815cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7feb6d000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb680b1010 0x7feb6814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7feb6d000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb680b1010 0x7feb6814ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:58914/0 (socket says 172.21.15.59:58914) 2024-05-30T16:49:15.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7feb67e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 0x7feb68160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7feb67e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 0x7feb68160ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36196/0 (socket says 172.21.15.59:36196) 2024-05-30T16:49:15.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7f33db200640 1 -- 172.21.15.59:0/1800270777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d414d1a0 con 0x7f33d409a720 2024-05-30T16:49:15.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7f33db200640 1 -- 172.21.15.59:0/1800270777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d414d760 con 0x7f33d409a720 2024-05-30T16:49:15.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7fd7f5600640 1 -- 172.21.15.59:0/3632104348 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f0068a90 con 0x7fd7d40039c0 2024-05-30T16:49:15.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7feb6d000640 1 -- 172.21.15.59:0/3759544840 learned_addr learned my addr 172.21.15.59:0/3759544840 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7feb6e400640 1 -- 172.21.15.59:0/3759544840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feb680cea90 con 0x7feb680ce4a0 2024-05-30T16:49:15.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.386+0000 7feb6da00640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb680ce4a0 0x7feb6815cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7feb6e400640 1 -- 172.21.15.59:0/3759544840 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7feb680ce910 con 0x7feb680b1010 2024-05-30T16:49:15.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7feb6e400640 1 -- 172.21.15.59:0/3759544840 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7feb68161e90 con 0x7feb680b3a00 2024-05-30T16:49:15.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fb6bd200640 1 Processor -- start 2024-05-30T16:49:15.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fd7e7e00640 1 -- 172.21.15.59:0/3632104348 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd7d80af070 con 0x7fd7d40039c0 2024-05-30T16:49:15.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7feb67e00640 1 -- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb680b1010 msgr2=0x7feb6814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7feb67e00640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb680b1010 0x7feb6814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7feb67e00640 1 -- 172.21.15.59:0/3759544840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb680ce4a0 msgr2=0x7feb6815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7feb67e00640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb680ce4a0 0x7feb6815cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7feb67e00640 1 -- 172.21.15.59:0/3759544840 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6815bdd0 con 0x7feb680b3a00 2024-05-30T16:49:15.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7feb6da00640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb680ce4a0 0x7feb6815cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fb6bd200640 1 -- start start 2024-05-30T16:49:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7f33db200640 1 -- 172.21.15.59:0/1800270777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33ac0052a0 con 0x7f33d409a720 2024-05-30T16:49:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7feb67e00640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 0x7feb68160ca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feb600aa000 tx=0x7feb600195b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fd7e7e00640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7cc068380 0x7fd7cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fd7e7e00640 1 -- 172.21.15.59:0/3632104348 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd7d81204f0 con 0x7fd7d40039c0 2024-05-30T16:49:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fb6bd200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6b806bbe0 0x7fb6b81477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fb6bd200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6b80aee30 0x7fb6b8150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fb6bd200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b8156990 0x7fb6b8155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fb6bd200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b80b50f0 con 0x7fb6b8156990 2024-05-30T16:49:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fb6bd200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b80b4f70 con 0x7fb6b80aee30 2024-05-30T16:49:15.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fb6bd200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b8168ef0 con 0x7fb6b806bbe0 2024-05-30T16:49:15.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fd7ef400640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7cc068380 0x7fd7cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fb6b7400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6b806bbe0 0x7fb6b81477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fb6b7400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6b806bbe0 0x7fb6b81477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36212/0 (socket says 172.21.15.59:36212) 2024-05-30T16:49:15.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.390+0000 7fb6b7400640 1 -- 172.21.15.59:0/2745115834 learned_addr learned my addr 172.21.15.59:0/2745115834 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6afe00640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6b80aee30 0x7fb6b8150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6b7e00640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b8156990 0x7fb6b8155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6b7400640 1 -- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6b80aee30 msgr2=0x7fb6b8150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6b7400640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6b80aee30 0x7fb6b8150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6b7400640 1 -- 172.21.15.59:0/2745115834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b8156990 msgr2=0x7fb6b8155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6b7400640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b8156990 0x7fb6b8155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6b7400640 1 -- 172.21.15.59:0/2745115834 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b8150ad0 con 0x7fb6b806bbe0 2024-05-30T16:49:15.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fd7ef400640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7cc068380 0x7fd7cc06a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00b3f60 tx=0x7fd7e0006e70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7f33cbe00640 1 -- 172.21.15.59:0/1800270777 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33cc00fd00 con 0x7f33d409a720 2024-05-30T16:49:15.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6b7400640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6b806bbe0 0x7fb6b81477a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb6a801a150 tx=0x7fb6a80192c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7f33cbe00640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f33b4068400 0x7f33b406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7f33cbe00640 1 -- 172.21.15.59:0/1800270777 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f33cc08a460 con 0x7f33d409a720 2024-05-30T16:49:15.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7f33d3e00640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f33b4068400 0x7f33b406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7feb64c00640 1 -- 172.21.15.59:0/3759544840 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb600ac040 con 0x7feb680b3a00 2024-05-30T16:49:15.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7feb64c00640 1 -- 172.21.15.59:0/3759544840 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb600a7480 con 0x7feb680b3a00 2024-05-30T16:49:15.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7feb64c00640 1 -- 172.21.15.59:0/3759544840 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60009510 con 0x7feb680b3a00 2024-05-30T16:49:15.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7feb6e400640 1 -- 172.21.15.59:0/3759544840 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6815c0b0 con 0x7feb680b3a00 2024-05-30T16:49:15.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7feb6e400640 1 -- 172.21.15.59:0/3759544840 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feb6815c670 con 0x7feb680b3a00 2024-05-30T16:49:15.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6af400640 1 -- 172.21.15.59:0/2745115834 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80ba070 con 0x7fb6b806bbe0 2024-05-30T16:49:15.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6af400640 1 -- 172.21.15.59:0/2745115834 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a80b5420 con 0x7fb6b806bbe0 2024-05-30T16:49:15.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6af400640 1 -- 172.21.15.59:0/2745115834 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80a8070 con 0x7fb6b806bbe0 2024-05-30T16:49:15.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6bd200640 1 -- 172.21.15.59:0/2745115834 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b8071d60 con 0x7fb6b806bbe0 2024-05-30T16:49:15.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.394+0000 7fb6bd200640 1 -- 172.21.15.59:0/2745115834 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b8072320 con 0x7fb6b806bbe0 2024-05-30T16:49:15.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.398+0000 7f33d3e00640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f33b4068400 0x7f33b406a8c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f33c00aa000 tx=0x7f33c0000fc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.398+0000 7fd7e7e00640 1 -- 172.21.15.59:0/3632104348 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd7d80c2030 con 0x7fd7d40039c0 2024-05-30T16:49:15.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.398+0000 7feb5e000640 1 -- 172.21.15.59:0/3759544840 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3c0052a0 con 0x7feb680b3a00 2024-05-30T16:49:15.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.398+0000 7fb6af400640 1 -- 172.21.15.59:0/2745115834 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6a80ab3d0 con 0x7fb6b806bbe0 2024-05-30T16:49:15.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.398+0000 7fb6af400640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6940683d0 0x7fb69406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.398+0000 7fb6af400640 1 -- 172.21.15.59:0/2745115834 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb6a80edd60 con 0x7fb6b806bbe0 2024-05-30T16:49:15.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.398+0000 7fb6afe00640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6940683d0 0x7fb69406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.402+0000 7fb6afe00640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6940683d0 0x7fb69406a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb6b814ead0 tx=0x7fb6a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.402+0000 7feb64c00640 1 -- 172.21.15.59:0/3759544840 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb600af020 con 0x7feb680b3a00 2024-05-30T16:49:15.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.402+0000 7fb6bd200640 1 -- 172.21.15.59:0/2745115834 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b8068a90 con 0x7fb6b806bbe0 2024-05-30T16:49:15.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.402+0000 7f33cbe00640 1 -- 172.21.15.59:0/1800270777 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f33cc05aa70 con 0x7f33d409a720 2024-05-30T16:49:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.402+0000 7feb64c00640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feb48068450 0x7feb4806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.402+0000 7feb64c00640 1 -- 172.21.15.59:0/3759544840 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7feb60121130 con 0x7feb680b3a00 2024-05-30T16:49:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.402+0000 7feb6d000640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feb48068450 0x7feb4806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.402+0000 7feb6d000640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feb48068450 0x7feb4806a910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feb68154850 tx=0x7feb54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.406+0000 7feb64c00640 1 -- 172.21.15.59:0/3759544840 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feb600c1060 con 0x7feb680b3a00 2024-05-30T16:49:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.414+0000 7fb6af400640 1 -- 172.21.15.59:0/2745115834 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6a8016110 con 0x7fb6b806bbe0 2024-05-30T16:49:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.418+0000 7f8204a00640 1 Processor -- start 2024-05-30T16:49:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.418+0000 7f8204a00640 1 -- start start 2024-05-30T16:49:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.418+0000 7f0260a00640 1 Processor -- start 2024-05-30T16:49:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f8204a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f820015c660 0x7f8200073060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f8204a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f820015ca40 con 0x7f82000cdbb0 2024-05-30T16:49:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f8204a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82000ccdf0 con 0x7f82000cfc00 2024-05-30T16:49:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f8204a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f82000cd0d0 con 0x7f820015c660 2024-05-30T16:49:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.418+0000 7f0260a00640 1 -- start start 2024-05-30T16:49:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fde00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f82000cfc00 0x7f82000735a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:54286/0 (socket says 172.21.15.59:54286) 2024-05-30T16:49:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fde00640 1 -- 172.21.15.59:0/2267653547 learned_addr learned my addr 172.21.15.59:0/2267653547 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f0260a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02540e0f60 0x7f0254056760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f0260a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f025403c9d0 0x7f0254054dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f0260a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02540556c0 con 0x7f0254038770 2024-05-30T16:49:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f0260a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f02540559a0 con 0x7f025403c9d0 2024-05-30T16:49:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f0260a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0254055c80 con 0x7f02540e0f60 2024-05-30T16:49:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040520184 0 0) 0x7f82000ccdf0 con 0x7f82000cfc00 2024-05-30T16:49:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81e4003530 con 0x7f82000cfc00 2024-05-30T16:49:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fe800640 1 --2- 172.21.15.59:0/2267653547 >> v2:172.21.15.107:3300/0 conn(0x7f820015c660 0x7f8200073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1382652434 0 0) 0x7f81e4003530 con 0x7f82000cfc00 2024-05-30T16:49:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 >> v2:172.21.15.107:3300/0 conn(0x7f820015c660 msgr2=0x7f8200073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 --2- 172.21.15.59:0/2267653547 >> v2:172.21.15.107:3300/0 conn(0x7f820015c660 0x7f8200073060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 >> v1:172.21.15.59:6789/0 conn(0x7f82000cdbb0 legacy=0x7f82000cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82000cd3b0 con 0x7f82000cfc00 2024-05-30T16:49:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f81f8001680 con 0x7f82000cfc00 2024-05-30T16:49:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f0259e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02540e0f60 0x7f0254056760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 >> v1:172.21.15.107:6789/0 conn(0x7f82000cfc00 legacy=0x7f82000735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81e40039c0 0x7f81e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e4004810 0x7f81e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81e40051d0 0x7f81e400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f82000cd0d0 con 0x7f81e4004810 2024-05-30T16:49:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f81e400c050 con 0x7f81e40039c0 2024-05-30T16:49:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f81e400c250 con 0x7f81e40051d0 2024-05-30T16:49:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fe800640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81e40039c0 0x7f81e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f81fde00640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e4004810 0x7f81e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.426+0000 7f81fde00640 1 -- 172.21.15.59:0/2267653547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81e40051d0 msgr2=0x7f81e400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.426+0000 7f81ff200640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81e40051d0 0x7f81e400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f0259e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02540e0f60 0x7f0254056760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36222/0 (socket says 172.21.15.59:36222) 2024-05-30T16:49:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f0259e00640 1 -- 172.21.15.59:0/4038936741 learned_addr learned my addr 172.21.15.59:0/4038936741 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f0259e00640 1 -- 172.21.15.59:0/4038936741 >> v2:172.21.15.59:3300/0 conn(0x7f025403c9d0 msgr2=0x7f0254054dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f0259e00640 1 --2- 172.21.15.59:0/4038936741 >> v2:172.21.15.59:3300/0 conn(0x7f025403c9d0 0x7f0254054dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f0259e00640 1 -- 172.21.15.59:0/4038936741 >> v1:172.21.15.59:6789/0 conn(0x7f0254038770 legacy=0x7f025400dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.422+0000 7f0259e00640 1 -- 172.21.15.59:0/4038936741 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0254055f60 con 0x7f02540e0f60 2024-05-30T16:49:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.426+0000 7f81fde00640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81e40051d0 0x7f81e400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.426+0000 7f81fde00640 1 -- 172.21.15.59:0/2267653547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81e40039c0 msgr2=0x7f81e4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.426+0000 7f81fde00640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81e40039c0 0x7f81e4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.426+0000 7f81fde00640 1 -- 172.21.15.59:0/2267653547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82000cd3b0 con 0x7f81e4004810 2024-05-30T16:49:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f81ff200640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81e40051d0 0x7f81e400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f81ff200640 1 -- 172.21.15.59:0/2267653547 reap_dead start 2024-05-30T16:49:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f0259e00640 1 --2- 172.21.15.59:0/4038936741 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02540e0f60 0x7f0254056760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f025c051740 tx=0x7f025c0a07f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b73a0877a9311a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f81fe800640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81e40039c0 0x7f81e4003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:15.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f0258a00640 1 -- 172.21.15.59:0/4038936741 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c12d540 con 0x7f02540e0f60 2024-05-30T16:49:15.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f0258a00640 1 -- 172.21.15.59:0/4038936741 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f025c12d6e0 con 0x7f02540e0f60 2024-05-30T16:49:15.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f0258a00640 1 -- 172.21.15.59:0/4038936741 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c12db30 con 0x7f02540e0f60 2024-05-30T16:49:15.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f0260a00640 1 -- 172.21.15.59:0/4038936741 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02540e0f60 msgr2=0x7f0254056760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f0260a00640 1 --2- 172.21.15.59:0/4038936741 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02540e0f60 0x7f0254056760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f025c051740 tx=0x7f025c0a07f0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f0260a00640 1 -- 172.21.15.59:0/4038936741 shutdown_connections 2024-05-30T16:49:15.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f0260a00640 1 --2- 172.21.15.59:0/4038936741 >> v2:172.21.15.59:3300/0 conn(0x7f025403c9d0 0x7f0254054dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f0260a00640 1 --2- 172.21.15.59:0/4038936741 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02540e0f60 0x7f0254056760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f0260a00640 1 -- 172.21.15.59:0/4038936741 >> 172.21.15.59:0/4038936741 conn(0x7f0254053770 msgr2=0x7f0254053b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f0260a00640 1 -- 172.21.15.59:0/4038936741 shutdown_connections 2024-05-30T16:49:15.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.430+0000 7f0260a00640 1 -- 172.21.15.59:0/4038936741 wait complete. 2024-05-30T16:49:15.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.434+0000 7f0260a00640 1 Processor -- start 2024-05-30T16:49:15.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.434+0000 7f81fde00640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e4004810 0x7f81e4004c90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f81f8007d20 tx=0x7f81f8023880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc12aba66b3e9fbc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.434+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f80b7070 con 0x7f81e4004810 2024-05-30T16:49:15.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.434+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f8005ae0 con 0x7f81e4004810 2024-05-30T16:49:15.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.434+0000 7f8204a00640 1 -- 172.21.15.59:0/2267653547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e4004810 msgr2=0x7f81e4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.434+0000 7f81fd400640 1 -- 172.21.15.59:0/2267653547 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8007d60 con 0x7f81e4004810 2024-05-30T16:49:15.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.434+0000 7f8204a00640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e4004810 0x7f81e4004c90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f81f8007d20 tx=0x7f81f8023880 comp rx=0 tx=0).stop 2024-05-30T16:49:15.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.434+0000 7f0260a00640 1 -- start start 2024-05-30T16:49:15.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0260a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0254038770 0x7f02540db050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0260a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f025403c9d0 0x7f02540cf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0260a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02540e0f60 0x7f0254188570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0260a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0254055480 con 0x7f02540e0f60 2024-05-30T16:49:15.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0260a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0254055300 con 0x7f025403c9d0 2024-05-30T16:49:15.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0260a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f02540ebb50 con 0x7f0254038770 2024-05-30T16:49:15.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f8204a00640 1 -- 172.21.15.59:0/2267653547 shutdown_connections 2024-05-30T16:49:15.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f8204a00640 1 --2- 172.21.15.59:0/2267653547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e4004810 0x7f81e4004c90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f8204a00640 1 -- 172.21.15.59:0/2267653547 >> 172.21.15.59:0/2267653547 conn(0x7f82000721b0 msgr2=0x7f82000b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f025a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02540e0f60 0x7f0254188570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0259400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f025403c9d0 0x7f02540cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0259e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0254038770 0x7f02540db050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f025a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02540e0f60 0x7f0254188570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54414/0 (socket says 172.21.15.59:54414) 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0259400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f025403c9d0 0x7f02540cf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:58960/0 (socket says 172.21.15.59:58960) 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f025a800640 1 -- 172.21.15.59:0/3362143434 learned_addr learned my addr 172.21.15.59:0/3362143434 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0259e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0254038770 0x7f02540db050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36248/0 (socket says 172.21.15.59:36248) 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0259e00640 1 -- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f025403c9d0 msgr2=0x7f02540cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0259e00640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f025403c9d0 0x7f02540cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0259e00640 1 -- 172.21.15.59:0/3362143434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02540e0f60 msgr2=0x7f0254188570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0259e00640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02540e0f60 0x7f0254188570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0259e00640 1 -- 172.21.15.59:0/3362143434 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025404b7e0 con 0x7f0254038770 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0259400640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f025403c9d0 0x7f02540cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f0259e00640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0254038770 0x7f02540db050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f025c06a520 tx=0x7f025c09d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f8204a00640 1 -- 172.21.15.59:0/2267653547 shutdown_connections 2024-05-30T16:49:15.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.438+0000 7f8204a00640 1 -- 172.21.15.59:0/2267653547 wait complete. 2024-05-30T16:49:15.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.442+0000 7f0252000640 1 -- 172.21.15.59:0/3362143434 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c094410 con 0x7f0254038770 2024-05-30T16:49:15.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.442+0000 7f0252000640 1 -- 172.21.15.59:0/3362143434 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f025c0945b0 con 0x7f0254038770 2024-05-30T16:49:15.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.442+0000 7f0252000640 1 -- 172.21.15.59:0/3362143434 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c068610 con 0x7f0254038770 2024-05-30T16:49:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.442+0000 7f0260a00640 1 -- 172.21.15.59:0/3362143434 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f025404bac0 con 0x7f0254038770 2024-05-30T16:49:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.442+0000 7f0260a00640 1 -- 172.21.15.59:0/3362143434 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f025404c080 con 0x7f0254038770 2024-05-30T16:49:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.442+0000 7f8204a00640 1 Processor -- start 2024-05-30T16:49:15.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.442+0000 7f8204a00640 1 -- start start 2024-05-30T16:49:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.442+0000 7f8204a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81e4004810 0x7f820014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.442+0000 7f8204a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8200156b80 0x7f820014e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f8204a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82000b4b90 0x7f82000b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81fde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8200156b80 0x7f820014e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81fde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8200156b80 0x7f820014e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:58972/0 (socket says 172.21.15.59:58972) 2024-05-30T16:49:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81fe800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81e4004810 0x7f820014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81fe800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81e4004810 0x7f820014ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36252/0 (socket says 172.21.15.59:36252) 2024-05-30T16:49:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81fde00640 1 -- 172.21.15.59:0/3165418807 learned_addr learned my addr 172.21.15.59:0/3165418807 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f82000b2a70 con 0x7f82000b4b90 2024-05-30T16:49:15.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f82000b28f0 con 0x7f8200156b80 2024-05-30T16:49:15.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8200073060 con 0x7f81e4004810 2024-05-30T16:49:15.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81ff200640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82000b4b90 0x7f82000b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.442+0000 7f0252000640 1 -- 172.21.15.59:0/3362143434 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f025c12b070 con 0x7f0254038770 2024-05-30T16:49:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81fe800640 1 -- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8200156b80 msgr2=0x7f820014e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81fe800640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8200156b80 0x7f820014e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f0260a00640 1 -- 172.21.15.59:0/3362143434 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0254005c30 con 0x7f0254038770 2024-05-30T16:49:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81fe800640 1 -- 172.21.15.59:0/3165418807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82000b4b90 msgr2=0x7f82000b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81fe800640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82000b4b90 0x7f82000b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81fe800640 1 -- 172.21.15.59:0/3165418807 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820015c110 con 0x7f81e4004810 2024-05-30T16:49:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81ff200640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82000b4b90 0x7f82000b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f0252000640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f023c0683d0 0x7f023c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f0252000640 1 -- 172.21.15.59:0/3362143434 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f025c19c140 con 0x7f0254038770 2024-05-30T16:49:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f0259400640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f023c0683d0 0x7f023c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f0259400640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f023c0683d0 0x7f023c06a890 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f02540d03c0 tx=0x7f0248006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.446+0000 7f81fe800640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81e4004810 0x7f820014ef00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f81f0011e00 tx=0x7f81f000f580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.450+0000 7f81f6a00640 1 -- 172.21.15.59:0/3165418807 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0009c10 con 0x7f81e4004810 2024-05-30T16:49:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.450+0000 7f81f6a00640 1 -- 172.21.15.59:0/3165418807 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f0003ba0 con 0x7f81e4004810 2024-05-30T16:49:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.450+0000 7f81f6a00640 1 -- 172.21.15.59:0/3165418807 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0004020 con 0x7f81e4004810 2024-05-30T16:49:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.450+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820014f600 con 0x7f81e4004810 2024-05-30T16:49:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.450+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f820014fbc0 con 0x7f81e4004810 2024-05-30T16:49:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.450+0000 7f0252000640 1 -- 172.21.15.59:0/3362143434 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f025c13b060 con 0x7f0254038770 2024-05-30T16:49:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.454+0000 7f81f6a00640 1 -- 172.21.15.59:0/3165418807 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f81f00041c0 con 0x7f81e4004810 2024-05-30T16:49:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.454+0000 7f81f6a00640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81e0068450 0x7f81e006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.454+0000 7f81f6a00640 1 -- 172.21.15.59:0/3165418807 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f81f0087a70 con 0x7f81e4004810 2024-05-30T16:49:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.458+0000 7f81fde00640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81e0068450 0x7f81e006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.458+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8200068a90 con 0x7f81e4004810 2024-05-30T16:49:15.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.462+0000 7f81fde00640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81e0068450 0x7f81e006a910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81f80236b0 tx=0x7f81f80af000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:15.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.462+0000 7f81f6a00640 1 -- 172.21.15.59:0/3165418807 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81f0019030 con 0x7f81e4004810 2024-05-30T16:49:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.722+0000 7f84c9800640 1 -- 172.21.15.59:0/4017781716 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f84a0005590 con 0x7f84bc056e70 2024-05-30T16:49:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.722+0000 7f84b7e00640 1 -- 172.21.15.59:0/4017781716 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84c40d5d40 con 0x7f84bc056e70 2024-05-30T16:49:15.727 INFO:teuthology.orchestra.run.smithi059.stdout:64424509447 2024-05-30T16:49:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.726+0000 7f84c9800640 1 -- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f84a4068450 msgr2=0x7f84a406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.726+0000 7f84c9800640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f84a4068450 0x7f84a406a910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0ea980 tx=0x7f84b8008040 comp rx=0 tx=0).stop 2024-05-30T16:49:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.726+0000 7f84c9800640 1 -- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 msgr2=0x7f84bc00d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.726+0000 7f84c9800640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 0x7f84bc00d390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f84c4000b70 tx=0x7f84c406cd90 comp rx=0 tx=0).stop 2024-05-30T16:49:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.726+0000 7f84c9800640 1 -- 172.21.15.59:0/4017781716 shutdown_connections 2024-05-30T16:49:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.726+0000 7f84c9800640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f84a4068450 0x7f84a406a910 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0ea980 tx=0x7f84b8008040 comp rx=0 tx=0).stop 2024-05-30T16:49:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.726+0000 7f84c9800640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84bc0e76e0 0x7f84bc04b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.726+0000 7f84c9800640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84bc058a80 0x7f84bc0d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.726+0000 7f84c9800640 1 --2- 172.21.15.59:0/4017781716 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84bc056e70 0x7f84bc00d390 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.726+0000 7f84c9800640 1 -- 172.21.15.59:0/4017781716 >> 172.21.15.59:0/4017781716 conn(0x7f84bc03aa40 msgr2=0x7f84bc03e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.726+0000 7f84c9800640 1 -- 172.21.15.59:0/4017781716 shutdown_connections 2024-05-30T16:49:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.726+0000 7f84c9800640 1 -- 172.21.15.59:0/4017781716 wait complete. 2024-05-30T16:49:15.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.730+0000 7f1260200640 1 -- 172.21.15.59:0/819494034 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f125806fdb0 con 0x7f125815a6e0 2024-05-30T16:49:15.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.730+0000 7f1255600640 1 -- 172.21.15.59:0/819494034 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f12440f5e20 con 0x7f125815a6e0 2024-05-30T16:49:15.738 INFO:teuthology.orchestra.run.smithi059.stdout:64424509447 2024-05-30T16:49:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.734+0000 7f1260200640 1 -- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12380687b0 msgr2=0x7f123806ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.734+0000 7f1260200640 1 --2- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12380687b0 0x7f123806ac70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f125000e250 tx=0x7f125000b040 comp rx=0 tx=0).stop 2024-05-30T16:49:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.734+0000 7f1260200640 1 -- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f125815a6e0 msgr2=0x7f125815bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.734+0000 7f1260200640 1 --2- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f125815a6e0 0x7f125815bbe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f12440ae000 tx=0x7f124401d370 comp rx=0 tx=0).stop 2024-05-30T16:49:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.734+0000 7f1260200640 1 -- 172.21.15.59:0/819494034 shutdown_connections 2024-05-30T16:49:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.734+0000 7f1260200640 1 --2- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12380687b0 0x7f123806ac70 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f125000e250 tx=0x7f125000b040 comp rx=0 tx=0).stop 2024-05-30T16:49:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.734+0000 7f1260200640 1 --2- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f125815a6e0 0x7f125815bbe0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.734+0000 7f1260200640 1 --2- 172.21.15.59:0/819494034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12580b3dc0 0x7f1258099410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.734+0000 7f1260200640 1 --2- 172.21.15.59:0/819494034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1258073c80 0x7f125815d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.734+0000 7f1260200640 1 -- 172.21.15.59:0/819494034 >> 172.21.15.59:0/819494034 conn(0x7f12580b56f0 msgr2=0x7f1258158400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.734+0000 7f1260200640 1 -- 172.21.15.59:0/819494034 shutdown_connections 2024-05-30T16:49:15.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.734+0000 7f1260200640 1 -- 172.21.15.59:0/819494034 wait complete. 2024-05-30T16:49:15.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.746+0000 7fb6bd200640 1 -- 172.21.15.59:0/2745115834 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb6b80724f0 con 0x7fb6b806bbe0 2024-05-30T16:49:15.753 INFO:teuthology.orchestra.run.smithi059.stdout:64424509448 2024-05-30T16:49:15.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.746+0000 7fb6af400640 1 -- 172.21.15.59:0/2745115834 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb6a80f03c0 con 0x7fb6b806bbe0 2024-05-30T16:49:15.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.750+0000 7fb6bd200640 1 -- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6940683d0 msgr2=0x7fb69406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.750+0000 7fb6bd200640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6940683d0 0x7fb69406a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb6b814ead0 tx=0x7fb6a0009040 comp rx=0 tx=0).stop 2024-05-30T16:49:15.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.750+0000 7fb6bd200640 1 -- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6b806bbe0 msgr2=0x7fb6b81477a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.750+0000 7fb6bd200640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6b806bbe0 0x7fb6b81477a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb6a801a150 tx=0x7fb6a80192c0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.750+0000 7fb6bd200640 1 -- 172.21.15.59:0/2745115834 shutdown_connections 2024-05-30T16:49:15.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.750+0000 7fb6bd200640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6940683d0 0x7fb69406a890 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.750+0000 7fb6bd200640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b8156990 0x7fb6b8155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.750+0000 7fb6bd200640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6b80aee30 0x7fb6b8150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.750+0000 7fb6bd200640 1 --2- 172.21.15.59:0/2745115834 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6b806bbe0 0x7fb6b81477a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.750+0000 7fb6bd200640 1 -- 172.21.15.59:0/2745115834 >> 172.21.15.59:0/2745115834 conn(0x7fb6b80b21c0 msgr2=0x7fb6b815a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.750+0000 7fb6bd200640 1 -- 172.21.15.59:0/2745115834 shutdown_connections 2024-05-30T16:49:15.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.750+0000 7fb6bd200640 1 -- 172.21.15.59:0/2745115834 wait complete. 2024-05-30T16:49:15.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.754+0000 7fd7f5600640 1 -- 172.21.15.59:0/3632104348 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd7f00b2e20 con 0x7fd7d40039c0 2024-05-30T16:49:15.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.754+0000 7fd7e7e00640 1 -- 172.21.15.59:0/3632104348 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd7d8016360 con 0x7fd7d40039c0 2024-05-30T16:49:15.760 INFO:teuthology.orchestra.run.smithi059.stdout:64424509447 2024-05-30T16:49:15.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.754+0000 7f33db200640 1 -- 172.21.15.59:0/1800270777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f33ac005860 con 0x7f33d409a720 2024-05-30T16:49:15.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.754+0000 7f33cbe00640 1 -- 172.21.15.59:0/1800270777 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f33cc05a370 con 0x7f33d409a720 2024-05-30T16:49:15.763 INFO:teuthology.orchestra.run.smithi059.stdout:64424509447 2024-05-30T16:49:15.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.758+0000 7fd7f5600640 1 -- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7cc068380 msgr2=0x7fd7cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.758+0000 7fd7f5600640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7cc068380 0x7fd7cc06a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00b3f60 tx=0x7fd7e0006e70 comp rx=0 tx=0).stop 2024-05-30T16:49:15.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.758+0000 7fd7f5600640 1 -- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7d40039c0 msgr2=0x7fd7f0156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.758+0000 7fd7f5600640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7d40039c0 0x7fd7f0156c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009900 tx=0x7fd7d80193d0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.758+0000 7fd7f5600640 1 -- 172.21.15.59:0/3632104348 shutdown_connections 2024-05-30T16:49:15.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.758+0000 7fd7f5600640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7cc068380 0x7fd7cc06a840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.758+0000 7fd7f5600640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f0149f60 0x7fd7f014a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.758+0000 7fd7f5600640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f00cc9b0 0x7fd7f00cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.758+0000 7fd7f5600640 1 --2- 172.21.15.59:0/3632104348 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7d40039c0 0x7fd7f0156c80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.758+0000 7fd7f5600640 1 -- 172.21.15.59:0/3632104348 >> 172.21.15.59:0/3632104348 conn(0x7fd7f00b1fd0 msgr2=0x7fd7f0153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7f33db200640 1 -- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f33b4068400 msgr2=0x7f33b406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7f33db200640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f33b4068400 0x7f33b406a8c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f33c00aa000 tx=0x7f33c0000fc0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7f33db200640 1 -- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33d409a720 msgr2=0x7f33d414ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7f33db200640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33d409a720 0x7f33d414ebe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33d40b6450 tx=0x7f33cc011c20 comp rx=0 tx=0).stop 2024-05-30T16:49:15.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7f33db200640 1 -- 172.21.15.59:0/1800270777 shutdown_connections 2024-05-30T16:49:15.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7f33db200640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f33b4068400 0x7f33b406a8c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7f33db200640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33d409a720 0x7f33d414ebe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7fd7f5600640 1 -- 172.21.15.59:0/3632104348 shutdown_connections 2024-05-30T16:49:15.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7fd7f5600640 1 -- 172.21.15.59:0/3632104348 wait complete. 2024-05-30T16:49:15.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7f33db200640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33d409a2c0 0x7f33d40b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7f33db200640 1 --2- 172.21.15.59:0/1800270777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b8003a10 0x7f33d414c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7f33db200640 1 -- 172.21.15.59:0/1800270777 >> 172.21.15.59:0/1800270777 conn(0x7f33d40b56f0 msgr2=0x7f33d40af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7f33db200640 1 -- 172.21.15.59:0/1800270777 shutdown_connections 2024-05-30T16:49:15.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7f33db200640 1 -- 172.21.15.59:0/1800270777 wait complete. 2024-05-30T16:49:15.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-05-30T16:49:15.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7feb5e000640 1 -- 172.21.15.59:0/3759544840 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7feb3c005590 con 0x7feb680b3a00 2024-05-30T16:49:15.769 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:15.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.762+0000 7feb64c00640 1 -- 172.21.15.59:0/3759544840 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb680b0610 con 0x7feb680b3a00 2024-05-30T16:49:15.770 INFO:teuthology.orchestra.run.smithi059.stdout:64424509447 2024-05-30T16:49:15.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-05-30T16:49:15.774 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.766+0000 7feb5e000640 1 -- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feb48068450 msgr2=0x7feb4806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.766+0000 7feb5e000640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feb48068450 0x7feb4806a910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feb68154850 tx=0x7feb54008040 comp rx=0 tx=0).stop 2024-05-30T16:49:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.766+0000 7feb5e000640 1 -- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 msgr2=0x7feb68160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.766+0000 7feb5e000640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 0x7feb68160ca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feb600aa000 tx=0x7feb600195b0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.766+0000 7feb5e000640 1 -- 172.21.15.59:0/3759544840 shutdown_connections 2024-05-30T16:49:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.766+0000 7feb5e000640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feb48068450 0x7feb4806a910 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.766+0000 7feb5e000640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb680ce4a0 0x7feb6815cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.766+0000 7feb5e000640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb680b3a00 0x7feb68160ca0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.766+0000 7feb5e000640 1 --2- 172.21.15.59:0/3759544840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb680b1010 0x7feb6814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.766+0000 7feb5e000640 1 -- 172.21.15.59:0/3759544840 >> 172.21.15.59:0/3759544840 conn(0x7feb680b2ee0 msgr2=0x7feb680b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.770+0000 7feb5e000640 1 -- 172.21.15.59:0/3759544840 shutdown_connections 2024-05-30T16:49:15.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.770+0000 7feb5e000640 1 -- 172.21.15.59:0/3759544840 wait complete. 2024-05-30T16:49:15.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.782+0000 7f0260a00640 1 -- 172.21.15.59:0/3362143434 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0254037cf0 con 0x7f0254038770 2024-05-30T16:49:15.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.782+0000 7f0252000640 1 -- 172.21.15.59:0/3362143434 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f025c131030 con 0x7f0254038770 2024-05-30T16:49:15.788 INFO:teuthology.orchestra.run.smithi059.stdout:60129542151 2024-05-30T16:49:15.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.786+0000 7f0260a00640 1 -- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f023c0683d0 msgr2=0x7f023c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.786+0000 7f0260a00640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f023c0683d0 0x7f023c06a890 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f02540d03c0 tx=0x7f0248006f90 comp rx=0 tx=0).stop 2024-05-30T16:49:15.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.786+0000 7f0260a00640 1 -- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0254038770 msgr2=0x7f02540db050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.786+0000 7f0260a00640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0254038770 0x7f02540db050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f025c06a520 tx=0x7f025c09d630 comp rx=0 tx=0).stop 2024-05-30T16:49:15.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.786+0000 7f0260a00640 1 -- 172.21.15.59:0/3362143434 shutdown_connections 2024-05-30T16:49:15.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.786+0000 7f0260a00640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f023c0683d0 0x7f023c06a890 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.786+0000 7f0260a00640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02540e0f60 0x7f0254188570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.786+0000 7f0260a00640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f025403c9d0 0x7f02540cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.786+0000 7f0260a00640 1 --2- 172.21.15.59:0/3362143434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0254038770 0x7f02540db050 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.786+0000 7f0260a00640 1 -- 172.21.15.59:0/3362143434 >> 172.21.15.59:0/3362143434 conn(0x7f0254053770 msgr2=0x7f02540dd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.786+0000 7f0260a00640 1 -- 172.21.15.59:0/3362143434 shutdown_connections 2024-05-30T16:49:15.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.786+0000 7f0260a00640 1 -- 172.21.15.59:0/3362143434 wait complete. 2024-05-30T16:49:15.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-05-30T16:49:15.795 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:15.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f82000cf7d0 con 0x7f81e4004810 2024-05-30T16:49:15.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f81f6a00640 1 -- 172.21.15.59:0/3165418807 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f81f0010040 con 0x7f81e4004810 2024-05-30T16:49:15.799 INFO:teuthology.orchestra.run.smithi059.stdout:64424509446 2024-05-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81e0068450 msgr2=0x7f81e006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81e0068450 0x7f81e006a910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81f80236b0 tx=0x7f81f80af000 comp rx=0 tx=0).stop 2024-05-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81e4004810 msgr2=0x7f820014ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81e4004810 0x7f820014ef00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f81f0011e00 tx=0x7f81f000f580 comp rx=0 tx=0).stop 2024-05-30T16:49:15.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 shutdown_connections 2024-05-30T16:49:15.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81e0068450 0x7f81e006a910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82000b4b90 0x7f82000b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8200156b80 0x7f820014e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 --2- 172.21.15.59:0/3165418807 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81e4004810 0x7f820014ef00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:15.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 >> 172.21.15.59:0/3165418807 conn(0x7f82000721b0 msgr2=0x7f82000b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:15.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 shutdown_connections 2024-05-30T16:49:15.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.794+0000 7f8204a00640 1 -- 172.21.15.59:0/3165418807 wait complete. 2024-05-30T16:49:15.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-05-30T16:49:15.803 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:15.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-05-30T16:49:15.805 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:15.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-05-30T16:49:15.809 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:15.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2024-05-30T16:49:15.819 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:15.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-05-30T16:49:15.823 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:15.824 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:49:15.824 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:49:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.998+0000 7fd47c000640 1 Processor -- start 2024-05-30T16:49:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.998+0000 7fd47c000640 1 -- start start 2024-05-30T16:49:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.998+0000 7fd47c000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd47415a1d0 0x7fd47415db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.998+0000 7fd47c000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd47415d730 con 0x7fd474159df0 2024-05-30T16:49:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.998+0000 7fd47c000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4740b3370 con 0x7fd4740ad8c0 2024-05-30T16:49:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:15.998+0000 7fd47c000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd4740b3650 con 0x7fd47415a1d0 2024-05-30T16:49:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.002+0000 7fd479600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd474159df0 0x7fd4740ad1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40158/0 (socket says 172.21.15.59:40158) 2024-05-30T16:49:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.002+0000 7fd479600640 1 -- 172.21.15.59:0/362171043 learned_addr learned my addr 172.21.15.59:0/362171043 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.002+0000 7fd47a000640 1 --2- 172.21.15.59:0/362171043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd47415a1d0 0x7fd47415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.002+0000 7fd473e00640 1 -- 172.21.15.59:0/362171043 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3833958177 0 0) 0x7fd47415d730 con 0x7fd474159df0 2024-05-30T16:49:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.002+0000 7fd473e00640 1 -- 172.21.15.59:0/362171043 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd45c003530 con 0x7fd474159df0 2024-05-30T16:49:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.002+0000 7fd473e00640 1 -- 172.21.15.59:0/362171043 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2774851219 0 0) 0x7fd4740b3370 con 0x7fd4740ad8c0 2024-05-30T16:49:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.002+0000 7fd473e00640 1 -- 172.21.15.59:0/362171043 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd47415d730 con 0x7fd4740ad8c0 2024-05-30T16:49:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.002+0000 7fd47a000640 1 -- 172.21.15.59:0/362171043 >> v1:172.21.15.107:6789/0 conn(0x7fd4740ad8c0 legacy=0x7fd47415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.002+0000 7fd47a000640 1 -- 172.21.15.59:0/362171043 >> v1:172.21.15.59:6789/0 conn(0x7fd474159df0 legacy=0x7fd4740ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.002+0000 7fd473e00640 1 -- 172.21.15.59:0/362171043 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1011233036 0 0) 0x7fd45c003530 con 0x7fd474159df0 2024-05-30T16:49:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.002+0000 7fd47a000640 1 -- 172.21.15.59:0/362171043 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4740b3930 con 0x7fd47415a1d0 2024-05-30T16:49:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.002+0000 7fd47a000640 1 --2- 172.21.15.59:0/362171043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd47415a1d0 0x7fd47415db80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009dc0 tx=0x7fd46c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea61064b664836e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd473e00640 1 -- 172.21.15.59:0/362171043 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0ac070 con 0x7fd47415a1d0 2024-05-30T16:49:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd473e00640 1 -- 172.21.15.59:0/362171043 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd46c0a6430 con 0x7fd47415a1d0 2024-05-30T16:49:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd473e00640 1 -- 172.21.15.59:0/362171043 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468001680 con 0x7fd47415a1d0 2024-05-30T16:49:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 -- 172.21.15.59:0/362171043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd47415a1d0 msgr2=0x7fd47415db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 --2- 172.21.15.59:0/362171043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd47415a1d0 0x7fd47415db80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009dc0 tx=0x7fd46c01c8b0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 -- 172.21.15.59:0/362171043 shutdown_connections 2024-05-30T16:49:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 --2- 172.21.15.59:0/362171043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd47415a1d0 0x7fd47415db80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 -- 172.21.15.59:0/362171043 >> 172.21.15.59:0/362171043 conn(0x7fd4740b22d0 msgr2=0x7fd4740b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 -- 172.21.15.59:0/362171043 shutdown_connections 2024-05-30T16:49:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 -- 172.21.15.59:0/362171043 wait complete. 2024-05-30T16:49:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 Processor -- start 2024-05-30T16:49:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 -- start start 2024-05-30T16:49:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4740ad8c0 0x7fd4741575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd474159df0 0x7fd47414e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd47415a1d0 0x7fd4741608f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd47416a590 con 0x7fd4740ad8c0 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd47416a410 con 0x7fd47415a1d0 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47c000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd47416a710 con 0x7fd474159df0 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd479600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4740ad8c0 0x7fd4741575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd479600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4740ad8c0 0x7fd4741575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54430/0 (socket says 172.21.15.59:54430) 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd479600640 1 -- 172.21.15.59:0/1745597226 learned_addr learned my addr 172.21.15.59:0/1745597226 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd47a000640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd47415a1d0 0x7fd4741608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.006+0000 7fd478c00640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd474159df0 0x7fd47414e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd479600640 1 -- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd474159df0 msgr2=0x7fd47414e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd479600640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd474159df0 0x7fd47414e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd479600640 1 -- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd47415a1d0 msgr2=0x7fd4741608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd479600640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd47415a1d0 0x7fd4741608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd479600640 1 -- 172.21.15.59:0/1745597226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd474160e30 con 0x7fd4740ad8c0 2024-05-30T16:49:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd479600640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4740ad8c0 0x7fd4741575b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd46800c780 tx=0x7fd46800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd471600640 1 -- 172.21.15.59:0/1745597226 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468017070 con 0x7fd4740ad8c0 2024-05-30T16:49:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd471600640 1 -- 172.21.15.59:0/1745597226 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd468005b00 con 0x7fd4740ad8c0 2024-05-30T16:49:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd47c000640 1 -- 172.21.15.59:0/1745597226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd474157c70 con 0x7fd4740ad8c0 2024-05-30T16:49:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd471600640 1 -- 172.21.15.59:0/1745597226 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468007070 con 0x7fd4740ad8c0 2024-05-30T16:49:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd47c000640 1 -- 172.21.15.59:0/1745597226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd474158230 con 0x7fd4740ad8c0 2024-05-30T16:49:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd47c000640 1 -- 172.21.15.59:0/1745597226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd474068a90 con 0x7fd4740ad8c0 2024-05-30T16:49:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd471600640 1 -- 172.21.15.59:0/1745597226 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd46801a070 con 0x7fd4740ad8c0 2024-05-30T16:49:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd471600640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd454068380 0x7fd45406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd471600640 1 -- 172.21.15.59:0/1745597226 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd468085f30 con 0x7fd4740ad8c0 2024-05-30T16:49:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.010+0000 7fd478c00640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd454068380 0x7fd45406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.014+0000 7fd478c00640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd454068380 0x7fd45406a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd4740b2d40 tx=0x7fd460009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.014+0000 7fd471600640 1 -- 172.21.15.59:0/1745597226 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd468055e00 con 0x7fd4740ad8c0 2024-05-30T16:49:16.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.178+0000 7fd47c000640 1 -- 172.21.15.59:0/1745597226 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4740b4ef0 con 0x7fd454068380 2024-05-30T16:49:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd471600640 1 -- 172.21.15.59:0/1745597226 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7fd4740b4ef0 con 0x7fd454068380 2024-05-30T16:49:16.192 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:49:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd47c000640 1 -- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd454068380 msgr2=0x7fd45406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd47c000640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd454068380 0x7fd45406a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd4740b2d40 tx=0x7fd460009040 comp rx=0 tx=0).stop 2024-05-30T16:49:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd47c000640 1 -- 172.21.15.59:0/1745597226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4740ad8c0 msgr2=0x7fd4741575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd47c000640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4740ad8c0 0x7fd4741575b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd46800c780 tx=0x7fd46800cc40 comp rx=0 tx=0).stop 2024-05-30T16:49:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd47c000640 1 -- 172.21.15.59:0/1745597226 shutdown_connections 2024-05-30T16:49:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd47c000640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd454068380 0x7fd45406a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd47c000640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd47415a1d0 0x7fd4741608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd47c000640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd474159df0 0x7fd47414e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd47c000640 1 --2- 172.21.15.59:0/1745597226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4740ad8c0 0x7fd4741575b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd47c000640 1 -- 172.21.15.59:0/1745597226 >> 172.21.15.59:0/1745597226 conn(0x7fd4740b22d0 msgr2=0x7fd47415c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd47c000640 1 -- 172.21.15.59:0/1745597226 shutdown_connections 2024-05-30T16:49:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.186+0000 7fd47c000640 1 -- 172.21.15.59:0/1745597226 wait complete. 2024-05-30T16:49:16.212 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-05-30T16:49:15.077025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219212,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755508,"statfs":{"total":773094113280,"available":772869640192,"internally_reserved":0,"allocated":3121152,"data_stored":1833196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002798"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052545+0000","last_change":"2024-05-30T16:49:04.545096+0000","last_active":"2024-05-30T16:49:06.052545+0000","last_peered":"2024-05-30T16:49:06.052545+0000","last_clean":"2024-05-30T16:49:06.052545+0000","last_became_active":"2024-05-30T16:49:04.544532+0000","last_became_peered":"2024-05-30T16:49:04.544532+0000","last_unstale":"2024-05-30T16:49:06.052545+0000","last_undegraded":"2024-05-30T16:49:06.052545+0000","last_fullsized":"2024-05-30T16:49:06.052545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:00.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053033+0000","last_change":"2024-05-30T16:49:04.538139+0000","last_active":"2024-05-30T16:49:06.053033+0000","last_peered":"2024-05-30T16:49:06.053033+0000","last_clean":"2024-05-30T16:49:06.053033+0000","last_became_active":"2024-05-30T16:49:04.537797+0000","last_became_peered":"2024-05-30T16:49:04.537797+0000","last_unstale":"2024-05-30T16:49:06.053033+0000","last_undegraded":"2024-05-30T16:49:06.053033+0000","last_fullsized":"2024-05-30T16:49:06.053033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051246+0000","last_change":"2024-05-30T16:49:04.542945+0000","last_active":"2024-05-30T16:49:06.051246+0000","last_peered":"2024-05-30T16:49:06.051246+0000","last_clean":"2024-05-30T16:49:06.051246+0000","last_became_active":"2024-05-30T16:49:04.542637+0000","last_became_peered":"2024-05-30T16:49:04.542637+0000","last_unstale":"2024-05-30T16:49:06.051246+0000","last_undegraded":"2024-05-30T16:49:06.051246+0000","last_fullsized":"2024-05-30T16:49:06.051246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:55:32.611131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533898+0000","last_change":"2024-05-30T16:49:04.556673+0000","last_active":"2024-05-30T16:49:05.533898+0000","last_peered":"2024-05-30T16:49:05.533898+0000","last_clean":"2024-05-30T16:49:05.533898+0000","last_became_active":"2024-05-30T16:49:04.556386+0000","last_became_peered":"2024-05-30T16:49:04.556386+0000","last_unstale":"2024-05-30T16:49:05.533898+0000","last_undegraded":"2024-05-30T16:49:05.533898+0000","last_fullsized":"2024-05-30T16:49:05.533898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:45.716674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052183+0000","last_change":"2024-05-30T16:49:04.552810+0000","last_active":"2024-05-30T16:49:06.052183+0000","last_peered":"2024-05-30T16:49:06.052183+0000","last_clean":"2024-05-30T16:49:06.052183+0000","last_became_active":"2024-05-30T16:49:04.552478+0000","last_became_peered":"2024-05-30T16:49:04.552478+0000","last_unstale":"2024-05-30T16:49:06.052183+0000","last_undegraded":"2024-05-30T16:49:06.052183+0000","last_fullsized":"2024-05-30T16:49:06.052183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:17:37.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534174+0000","last_change":"2024-05-30T16:49:04.546420+0000","last_active":"2024-05-30T16:49:05.534174+0000","last_peered":"2024-05-30T16:49:05.534174+0000","last_clean":"2024-05-30T16:49:05.534174+0000","last_became_active":"2024-05-30T16:49:04.545288+0000","last_became_peered":"2024-05-30T16:49:04.545288+0000","last_unstale":"2024-05-30T16:49:05.534174+0000","last_undegraded":"2024-05-30T16:49:05.534174+0000","last_fullsized":"2024-05-30T16:49:05.534174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:17:37.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051955+0000","last_change":"2024-05-30T16:49:04.542431+0000","last_active":"2024-05-30T16:49:06.051955+0000","last_peered":"2024-05-30T16:49:06.051955+0000","last_clean":"2024-05-30T16:49:06.051955+0000","last_became_active":"2024-05-30T16:49:04.541958+0000","last_became_peered":"2024-05-30T16:49:04.541958+0000","last_unstale":"2024-05-30T16:49:06.051955+0000","last_undegraded":"2024-05-30T16:49:06.051955+0000","last_fullsized":"2024-05-30T16:49:06.051955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:41.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.050859+0000","last_change":"2024-05-30T16:49:04.546221+0000","last_active":"2024-05-30T16:49:06.050859+0000","last_peered":"2024-05-30T16:49:06.050859+0000","last_clean":"2024-05-30T16:49:06.050859+0000","last_became_active":"2024-05-30T16:49:04.545933+0000","last_became_peered":"2024-05-30T16:49:04.545933+0000","last_unstale":"2024-05-30T16:49:06.050859+0000","last_undegraded":"2024-05-30T16:49:06.050859+0000","last_fullsized":"2024-05-30T16:49:06.050859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:21.914079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052633+0000","last_change":"2024-05-30T16:49:04.554508+0000","last_active":"2024-05-30T16:49:06.052633+0000","last_peered":"2024-05-30T16:49:06.052633+0000","last_clean":"2024-05-30T16:49:06.052633+0000","last_became_active":"2024-05-30T16:49:04.553966+0000","last_became_peered":"2024-05-30T16:49:04.553966+0000","last_unstale":"2024-05-30T16:49:06.052633+0000","last_undegraded":"2024-05-30T16:49:06.052633+0000","last_fullsized":"2024-05-30T16:49:06.052633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:47:24.068734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053243+0000","last_change":"2024-05-30T16:49:04.553475+0000","last_active":"2024-05-30T16:49:06.053243+0000","last_peered":"2024-05-30T16:49:06.053243+0000","last_clean":"2024-05-30T16:49:06.053243+0000","last_became_active":"2024-05-30T16:49:04.552962+0000","last_became_peered":"2024-05-30T16:49:04.552962+0000","last_unstale":"2024-05-30T16:49:06.053243+0000","last_undegraded":"2024-05-30T16:49:06.053243+0000","last_fullsized":"2024-05-30T16:49:06.053243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053178+0000","last_change":"2024-05-30T16:49:04.554233+0000","last_active":"2024-05-30T16:49:06.053178+0000","last_peered":"2024-05-30T16:49:06.053178+0000","last_clean":"2024-05-30T16:49:06.053178+0000","last_became_active":"2024-05-30T16:49:04.553934+0000","last_became_peered":"2024-05-30T16:49:04.553934+0000","last_unstale":"2024-05-30T16:49:06.053178+0000","last_undegraded":"2024-05-30T16:49:06.053178+0000","last_fullsized":"2024-05-30T16:49:06.053178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534485+0000","last_change":"2024-05-30T16:49:04.548278+0000","last_active":"2024-05-30T16:49:05.534485+0000","last_peered":"2024-05-30T16:49:05.534485+0000","last_clean":"2024-05-30T16:49:05.534485+0000","last_became_active":"2024-05-30T16:49:04.547736+0000","last_became_peered":"2024-05-30T16:49:04.547736+0000","last_unstale":"2024-05-30T16:49:05.534485+0000","last_undegraded":"2024-05-30T16:49:05.534485+0000","last_fullsized":"2024-05-30T16:49:05.534485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:02.310302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051507+0000","last_change":"2024-05-30T16:49:04.541147+0000","last_active":"2024-05-30T16:49:06.051507+0000","last_peered":"2024-05-30T16:49:06.051507+0000","last_clean":"2024-05-30T16:49:06.051507+0000","last_became_active":"2024-05-30T16:49:04.540873+0000","last_became_peered":"2024-05-30T16:49:04.540873+0000","last_unstale":"2024-05-30T16:49:06.051507+0000","last_undegraded":"2024-05-30T16:49:06.051507+0000","last_fullsized":"2024-05-30T16:49:06.051507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:31:53.336085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051066+0000","last_change":"2024-05-30T16:49:04.540239+0000","last_active":"2024-05-30T16:49:06.051066+0000","last_peered":"2024-05-30T16:49:06.051066+0000","last_clean":"2024-05-30T16:49:06.051066+0000","last_became_active":"2024-05-30T16:49:04.539685+0000","last_became_peered":"2024-05-30T16:49:04.539685+0000","last_unstale":"2024-05-30T16:49:06.051066+0000","last_undegraded":"2024-05-30T16:49:06.051066+0000","last_fullsized":"2024-05-30T16:49:06.051066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:59.153304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052714+0000","last_change":"2024-05-30T16:49:04.548766+0000","last_active":"2024-05-30T16:49:06.052714+0000","last_peered":"2024-05-30T16:49:06.052714+0000","last_clean":"2024-05-30T16:49:06.052714+0000","last_became_active":"2024-05-30T16:49:04.548490+0000","last_became_peered":"2024-05-30T16:49:04.548490+0000","last_unstale":"2024-05-30T16:49:06.052714+0000","last_undegraded":"2024-05-30T16:49:06.052714+0000","last_fullsized":"2024-05-30T16:49:06.052714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.532984+0000","last_change":"2024-05-30T16:49:04.542268+0000","last_active":"2024-05-30T16:49:05.532984+0000","last_peered":"2024-05-30T16:49:05.532984+0000","last_clean":"2024-05-30T16:49:05.532984+0000","last_became_active":"2024-05-30T16:49:04.541992+0000","last_became_peered":"2024-05-30T16:49:04.541992+0000","last_unstale":"2024-05-30T16:49:05.532984+0000","last_undegraded":"2024-05-30T16:49:05.532984+0000","last_fullsized":"2024-05-30T16:49:05.532984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534099+0000","last_change":"2024-05-30T16:49:04.550221+0000","last_active":"2024-05-30T16:49:05.534099+0000","last_peered":"2024-05-30T16:49:05.534099+0000","last_clean":"2024-05-30T16:49:05.534099+0000","last_became_active":"2024-05-30T16:49:04.549914+0000","last_became_peered":"2024-05-30T16:49:04.549914+0000","last_unstale":"2024-05-30T16:49:05.534099+0000","last_undegraded":"2024-05-30T16:49:05.534099+0000","last_fullsized":"2024-05-30T16:49:05.534099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:41.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530293+0000","last_change":"2024-05-30T16:49:04.551149+0000","last_active":"2024-05-30T16:49:05.530293+0000","last_peered":"2024-05-30T16:49:05.530293+0000","last_clean":"2024-05-30T16:49:05.530293+0000","last_became_active":"2024-05-30T16:49:04.543927+0000","last_became_peered":"2024-05-30T16:49:04.543927+0000","last_unstale":"2024-05-30T16:49:05.530293+0000","last_undegraded":"2024-05-30T16:49:05.530293+0000","last_fullsized":"2024-05-30T16:49:05.530293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:19.326134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052813+0000","last_change":"2024-05-30T16:49:04.536971+0000","last_active":"2024-05-30T16:49:06.052813+0000","last_peered":"2024-05-30T16:49:06.052813+0000","last_clean":"2024-05-30T16:49:06.052813+0000","last_became_active":"2024-05-30T16:49:04.536697+0000","last_became_peered":"2024-05-30T16:49:04.536697+0000","last_unstale":"2024-05-30T16:49:06.052813+0000","last_undegraded":"2024-05-30T16:49:06.052813+0000","last_fullsized":"2024-05-30T16:49:06.052813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:07.305667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052893+0000","last_change":"2024-05-30T16:49:04.554920+0000","last_active":"2024-05-30T16:49:06.052893+0000","last_peered":"2024-05-30T16:49:06.052893+0000","last_clean":"2024-05-30T16:49:06.052893+0000","last_became_active":"2024-05-30T16:49:04.554629+0000","last_became_peered":"2024-05-30T16:49:04.554629+0000","last_unstale":"2024-05-30T16:49:06.052893+0000","last_undegraded":"2024-05-30T16:49:06.052893+0000","last_fullsized":"2024-05-30T16:49:06.052893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051215+0000","last_change":"2024-05-30T16:49:04.546642+0000","last_active":"2024-05-30T16:49:06.051215+0000","last_peered":"2024-05-30T16:49:06.051215+0000","last_clean":"2024-05-30T16:49:06.051215+0000","last_became_active":"2024-05-30T16:49:04.546003+0000","last_became_peered":"2024-05-30T16:49:04.546003+0000","last_unstale":"2024-05-30T16:49:06.051215+0000","last_undegraded":"2024-05-30T16:49:06.051215+0000","last_fullsized":"2024-05-30T16:49:06.051215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:34:33.807678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534275+0000","last_change":"2024-05-30T16:49:04.549251+0000","last_active":"2024-05-30T16:49:05.534275+0000","last_peered":"2024-05-30T16:49:05.534275+0000","last_clean":"2024-05-30T16:49:05.534275+0000","last_became_active":"2024-05-30T16:49:04.548946+0000","last_became_peered":"2024-05-30T16:49:04.548946+0000","last_unstale":"2024-05-30T16:49:05.534275+0000","last_undegraded":"2024-05-30T16:49:05.534275+0000","last_fullsized":"2024-05-30T16:49:05.534275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:53:12.385144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051209+0000","last_change":"2024-05-30T16:49:04.554673+0000","last_active":"2024-05-30T16:49:06.051209+0000","last_peered":"2024-05-30T16:49:06.051209+0000","last_clean":"2024-05-30T16:49:06.051209+0000","last_became_active":"2024-05-30T16:49:04.552406+0000","last_became_peered":"2024-05-30T16:49:04.552406+0000","last_unstale":"2024-05-30T16:49:06.051209+0000","last_undegraded":"2024-05-30T16:49:06.051209+0000","last_fullsized":"2024-05-30T16:49:06.051209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:32:11.592244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534589+0000","last_change":"2024-05-30T16:49:04.539930+0000","last_active":"2024-05-30T16:49:05.534589+0000","last_peered":"2024-05-30T16:49:05.534589+0000","last_clean":"2024-05-30T16:49:05.534589+0000","last_became_active":"2024-05-30T16:49:04.538018+0000","last_became_peered":"2024-05-30T16:49:04.538018+0000","last_unstale":"2024-05-30T16:49:05.534589+0000","last_undegraded":"2024-05-30T16:49:05.534589+0000","last_fullsized":"2024-05-30T16:49:05.534589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052036+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.052036+0000","last_peered":"2024-05-30T16:49:06.052036+0000","last_clean":"2024-05-30T16:49:06.052036+0000","last_became_active":"2024-05-30T16:49:04.556321+0000","last_became_peered":"2024-05-30T16:49:04.556321+0000","last_unstale":"2024-05-30T16:49:06.052036+0000","last_undegraded":"2024-05-30T16:49:06.052036+0000","last_fullsized":"2024-05-30T16:49:06.052036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:44:48.125700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053240+0000","last_change":"2024-05-30T16:49:04.544556+0000","last_active":"2024-05-30T16:49:06.053240+0000","last_peered":"2024-05-30T16:49:06.053240+0000","last_clean":"2024-05-30T16:49:06.053240+0000","last_became_active":"2024-05-30T16:49:04.543181+0000","last_became_peered":"2024-05-30T16:49:04.543181+0000","last_unstale":"2024-05-30T16:49:06.053240+0000","last_undegraded":"2024-05-30T16:49:06.053240+0000","last_fullsized":"2024-05-30T16:49:06.053240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052887+0000","last_change":"2024-05-30T16:49:04.540083+0000","last_active":"2024-05-30T16:49:06.052887+0000","last_peered":"2024-05-30T16:49:06.052887+0000","last_clean":"2024-05-30T16:49:06.052887+0000","last_became_active":"2024-05-30T16:49:04.539760+0000","last_became_peered":"2024-05-30T16:49:04.539760+0000","last_unstale":"2024-05-30T16:49:06.052887+0000","last_undegraded":"2024-05-30T16:49:06.052887+0000","last_fullsized":"2024-05-30T16:49:06.052887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051647+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.051647+0000","last_peered":"2024-05-30T16:49:06.051647+0000","last_clean":"2024-05-30T16:49:06.051647+0000","last_became_active":"2024-05-30T16:49:04.556297+0000","last_became_peered":"2024-05-30T16:49:04.556297+0000","last_unstale":"2024-05-30T16:49:06.051647+0000","last_undegraded":"2024-05-30T16:49:06.051647+0000","last_fullsized":"2024-05-30T16:49:06.051647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:14:09.241699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051361+0000","last_change":"2024-05-30T16:49:04.546093+0000","last_active":"2024-05-30T16:49:06.051361+0000","last_peered":"2024-05-30T16:49:06.051361+0000","last_clean":"2024-05-30T16:49:06.051361+0000","last_became_active":"2024-05-30T16:49:04.545623+0000","last_became_peered":"2024-05-30T16:49:04.545623+0000","last_unstale":"2024-05-30T16:49:06.051361+0000","last_undegraded":"2024-05-30T16:49:06.051361+0000","last_fullsized":"2024-05-30T16:49:06.051361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:38.640365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534360+0000","last_change":"2024-05-30T16:49:04.558192+0000","last_active":"2024-05-30T16:49:05.534360+0000","last_peered":"2024-05-30T16:49:05.534360+0000","last_clean":"2024-05-30T16:49:05.534360+0000","last_became_active":"2024-05-30T16:49:04.557826+0000","last_became_peered":"2024-05-30T16:49:04.557826+0000","last_unstale":"2024-05-30T16:49:05.534360+0000","last_undegraded":"2024-05-30T16:49:05.534360+0000","last_fullsized":"2024-05-30T16:49:05.534360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:59.487481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530068+0000","last_change":"2024-05-30T16:49:04.539369+0000","last_active":"2024-05-30T16:49:05.530068+0000","last_peered":"2024-05-30T16:49:05.530068+0000","last_clean":"2024-05-30T16:49:05.530068+0000","last_became_active":"2024-05-30T16:49:04.538899+0000","last_became_peered":"2024-05-30T16:49:04.538899+0000","last_unstale":"2024-05-30T16:49:05.530068+0000","last_undegraded":"2024-05-30T16:49:05.530068+0000","last_fullsized":"2024-05-30T16:49:05.530068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:39.816197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052013+0000","last_change":"2024-05-30T16:49:04.549536+0000","last_active":"2024-05-30T16:49:06.052013+0000","last_peered":"2024-05-30T16:49:06.052013+0000","last_clean":"2024-05-30T16:49:06.052013+0000","last_became_active":"2024-05-30T16:49:04.546653+0000","last_became_peered":"2024-05-30T16:49:04.546653+0000","last_unstale":"2024-05-30T16:49:06.052013+0000","last_undegraded":"2024-05-30T16:49:06.052013+0000","last_fullsized":"2024-05-30T16:49:06.052013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:38.640365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533225+0000","last_change":"2024-05-30T16:49:04.558267+0000","last_active":"2024-05-30T16:49:05.533225+0000","last_peered":"2024-05-30T16:49:05.533225+0000","last_clean":"2024-05-30T16:49:05.533225+0000","last_became_active":"2024-05-30T16:49:04.558000+0000","last_became_peered":"2024-05-30T16:49:04.558000+0000","last_unstale":"2024-05-30T16:49:05.533225+0000","last_undegraded":"2024-05-30T16:49:05.533225+0000","last_fullsized":"2024-05-30T16:49:05.533225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:11.469445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051650+0000","last_change":"2024-05-30T16:49:03.546643+0000","last_active":"2024-05-30T16:49:06.051650+0000","last_peered":"2024-05-30T16:49:06.051650+0000","last_clean":"2024-05-30T16:49:06.051650+0000","last_became_active":"2024-05-30T16:49:03.546381+0000","last_became_peered":"2024-05-30T16:49:03.546381+0000","last_unstale":"2024-05-30T16:49:06.051650+0000","last_undegraded":"2024-05-30T16:49:06.051650+0000","last_fullsized":"2024-05-30T16:49:06.051650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:44.078644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051517+0000","last_change":"2024-05-30T16:49:04.549134+0000","last_active":"2024-05-30T16:49:06.051517+0000","last_peered":"2024-05-30T16:49:06.051517+0000","last_clean":"2024-05-30T16:49:06.051517+0000","last_became_active":"2024-05-30T16:49:04.548780+0000","last_became_peered":"2024-05-30T16:49:04.548780+0000","last_unstale":"2024-05-30T16:49:06.051517+0000","last_undegraded":"2024-05-30T16:49:06.051517+0000","last_fullsized":"2024-05-30T16:49:06.051517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052899+0000","last_change":"2024-05-30T16:49:03.542612+0000","last_active":"2024-05-30T16:49:06.052899+0000","last_peered":"2024-05-30T16:49:06.052899+0000","last_clean":"2024-05-30T16:49:06.052899+0000","last_became_active":"2024-05-30T16:49:03.541360+0000","last_became_peered":"2024-05-30T16:49:03.541360+0000","last_unstale":"2024-05-30T16:49:06.052899+0000","last_undegraded":"2024-05-30T16:49:06.052899+0000","last_fullsized":"2024-05-30T16:49:06.052899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051315+0000","last_change":"2024-05-30T16:49:03.538756+0000","last_active":"2024-05-30T16:49:06.051315+0000","last_peered":"2024-05-30T16:49:06.051315+0000","last_clean":"2024-05-30T16:49:06.051315+0000","last_became_active":"2024-05-30T16:49:03.538053+0000","last_became_peered":"2024-05-30T16:49:03.538053+0000","last_unstale":"2024-05-30T16:49:06.051315+0000","last_undegraded":"2024-05-30T16:49:06.051315+0000","last_fullsized":"2024-05-30T16:49:06.051315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:07.264297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051433+0000","last_change":"2024-05-30T16:49:04.546048+0000","last_active":"2024-05-30T16:49:06.051433+0000","last_peered":"2024-05-30T16:49:06.051433+0000","last_clean":"2024-05-30T16:49:06.051433+0000","last_became_active":"2024-05-30T16:49:04.545151+0000","last_became_peered":"2024-05-30T16:49:04.545151+0000","last_unstale":"2024-05-30T16:49:06.051433+0000","last_undegraded":"2024-05-30T16:49:06.051433+0000","last_fullsized":"2024-05-30T16:49:06.051433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:07.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533718+0000","last_change":"2024-05-30T16:49:03.529039+0000","last_active":"2024-05-30T16:49:05.533718+0000","last_peered":"2024-05-30T16:49:05.533718+0000","last_clean":"2024-05-30T16:49:05.533718+0000","last_became_active":"2024-05-30T16:49:03.527042+0000","last_became_peered":"2024-05-30T16:49:03.527042+0000","last_unstale":"2024-05-30T16:49:05.533718+0000","last_undegraded":"2024-05-30T16:49:05.533718+0000","last_fullsized":"2024-05-30T16:49:05.533718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052719+0000","last_change":"2024-05-30T16:49:04.540411+0000","last_active":"2024-05-30T16:49:06.052719+0000","last_peered":"2024-05-30T16:49:06.052719+0000","last_clean":"2024-05-30T16:49:06.052719+0000","last_became_active":"2024-05-30T16:49:04.540089+0000","last_became_peered":"2024-05-30T16:49:04.540089+0000","last_unstale":"2024-05-30T16:49:06.052719+0000","last_undegraded":"2024-05-30T16:49:06.052719+0000","last_fullsized":"2024-05-30T16:49:06.052719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053224+0000","last_change":"2024-05-30T16:49:03.542933+0000","last_active":"2024-05-30T16:49:06.053224+0000","last_peered":"2024-05-30T16:49:06.053224+0000","last_clean":"2024-05-30T16:49:06.053224+0000","last_became_active":"2024-05-30T16:49:03.541460+0000","last_became_peered":"2024-05-30T16:49:03.541460+0000","last_unstale":"2024-05-30T16:49:06.053224+0000","last_undegraded":"2024-05-30T16:49:06.053224+0000","last_fullsized":"2024-05-30T16:49:06.053224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533477+0000","last_change":"2024-05-30T16:49:04.549367+0000","last_active":"2024-05-30T16:49:05.533477+0000","last_peered":"2024-05-30T16:49:05.533477+0000","last_clean":"2024-05-30T16:49:05.533477+0000","last_became_active":"2024-05-30T16:49:04.548994+0000","last_became_peered":"2024-05-30T16:49:04.548994+0000","last_unstale":"2024-05-30T16:49:05.533477+0000","last_undegraded":"2024-05-30T16:49:05.533477+0000","last_fullsized":"2024-05-30T16:49:05.533477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533840+0000","last_change":"2024-05-30T16:49:03.540903+0000","last_active":"2024-05-30T16:49:05.533840+0000","last_peered":"2024-05-30T16:49:05.533840+0000","last_clean":"2024-05-30T16:49:05.533840+0000","last_became_active":"2024-05-30T16:49:03.540598+0000","last_became_peered":"2024-05-30T16:49:03.540598+0000","last_unstale":"2024-05-30T16:49:05.533840+0000","last_undegraded":"2024-05-30T16:49:05.533840+0000","last_fullsized":"2024-05-30T16:49:05.533840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:45.462713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051841+0000","last_change":"2024-05-30T16:49:04.542032+0000","last_active":"2024-05-30T16:49:06.051841+0000","last_peered":"2024-05-30T16:49:06.051841+0000","last_clean":"2024-05-30T16:49:06.051841+0000","last_became_active":"2024-05-30T16:49:04.541750+0000","last_became_peered":"2024-05-30T16:49:04.541750+0000","last_unstale":"2024-05-30T16:49:06.051841+0000","last_undegraded":"2024-05-30T16:49:06.051841+0000","last_fullsized":"2024-05-30T16:49:06.051841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052980+0000","last_change":"2024-05-30T16:49:03.537811+0000","last_active":"2024-05-30T16:49:06.052980+0000","last_peered":"2024-05-30T16:49:06.052980+0000","last_clean":"2024-05-30T16:49:06.052980+0000","last_became_active":"2024-05-30T16:49:03.537468+0000","last_became_peered":"2024-05-30T16:49:03.537468+0000","last_unstale":"2024-05-30T16:49:06.052980+0000","last_undegraded":"2024-05-30T16:49:06.052980+0000","last_fullsized":"2024-05-30T16:49:06.052980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534607+0000","last_change":"2024-05-30T16:49:04.548049+0000","last_active":"2024-05-30T16:49:05.534607+0000","last_peered":"2024-05-30T16:49:05.534607+0000","last_clean":"2024-05-30T16:49:05.534607+0000","last_became_active":"2024-05-30T16:49:04.547483+0000","last_became_peered":"2024-05-30T16:49:04.547483+0000","last_unstale":"2024-05-30T16:49:05.534607+0000","last_undegraded":"2024-05-30T16:49:05.534607+0000","last_fullsized":"2024-05-30T16:49:05.534607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:39.816197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053012+0000","last_change":"2024-05-30T16:49:03.542201+0000","last_active":"2024-05-30T16:49:06.053012+0000","last_peered":"2024-05-30T16:49:06.053012+0000","last_clean":"2024-05-30T16:49:06.053012+0000","last_became_active":"2024-05-30T16:49:03.541172+0000","last_became_peered":"2024-05-30T16:49:03.541172+0000","last_unstale":"2024-05-30T16:49:06.053012+0000","last_undegraded":"2024-05-30T16:49:06.053012+0000","last_fullsized":"2024-05-30T16:49:06.053012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:21:15.090452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052243+0000","last_change":"2024-05-30T16:49:04.540546+0000","last_active":"2024-05-30T16:49:06.052243+0000","last_peered":"2024-05-30T16:49:06.052243+0000","last_clean":"2024-05-30T16:49:06.052243+0000","last_became_active":"2024-05-30T16:49:04.539786+0000","last_became_peered":"2024-05-30T16:49:04.539786+0000","last_unstale":"2024-05-30T16:49:06.052243+0000","last_undegraded":"2024-05-30T16:49:06.052243+0000","last_fullsized":"2024-05-30T16:49:06.052243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:53:12.385144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051634+0000","last_change":"2024-05-30T16:49:03.542403+0000","last_active":"2024-05-30T16:49:06.051634+0000","last_peered":"2024-05-30T16:49:06.051634+0000","last_clean":"2024-05-30T16:49:06.051634+0000","last_became_active":"2024-05-30T16:49:03.535558+0000","last_became_peered":"2024-05-30T16:49:03.535558+0000","last_unstale":"2024-05-30T16:49:06.051634+0000","last_undegraded":"2024-05-30T16:49:06.051634+0000","last_fullsized":"2024-05-30T16:49:06.051634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:50:44.488767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051231+0000","last_change":"2024-05-30T16:49:04.543912+0000","last_active":"2024-05-30T16:49:06.051231+0000","last_peered":"2024-05-30T16:49:06.051231+0000","last_clean":"2024-05-30T16:49:06.051231+0000","last_became_active":"2024-05-30T16:49:04.543548+0000","last_became_peered":"2024-05-30T16:49:04.543548+0000","last_unstale":"2024-05-30T16:49:06.051231+0000","last_undegraded":"2024-05-30T16:49:06.051231+0000","last_fullsized":"2024-05-30T16:49:06.051231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:46.470731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534423+0000","last_change":"2024-05-30T16:49:03.533929+0000","last_active":"2024-05-30T16:49:05.534423+0000","last_peered":"2024-05-30T16:49:05.534423+0000","last_clean":"2024-05-30T16:49:05.534423+0000","last_became_active":"2024-05-30T16:49:03.533583+0000","last_became_peered":"2024-05-30T16:49:03.533583+0000","last_unstale":"2024-05-30T16:49:05.534423+0000","last_undegraded":"2024-05-30T16:49:05.534423+0000","last_fullsized":"2024-05-30T16:49:05.534423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052365+0000","last_change":"2024-05-30T16:49:04.550074+0000","last_active":"2024-05-30T16:49:06.052365+0000","last_peered":"2024-05-30T16:49:06.052365+0000","last_clean":"2024-05-30T16:49:06.052365+0000","last_became_active":"2024-05-30T16:49:04.549701+0000","last_became_peered":"2024-05-30T16:49:04.549701+0000","last_unstale":"2024-05-30T16:49:06.052365+0000","last_undegraded":"2024-05-30T16:49:06.052365+0000","last_fullsized":"2024-05-30T16:49:06.052365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:45:42.077957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052757+0000","last_change":"2024-05-30T16:49:03.533071+0000","last_active":"2024-05-30T16:49:06.052757+0000","last_peered":"2024-05-30T16:49:06.052757+0000","last_clean":"2024-05-30T16:49:06.052757+0000","last_became_active":"2024-05-30T16:49:03.532744+0000","last_became_peered":"2024-05-30T16:49:03.532744+0000","last_unstale":"2024-05-30T16:49:06.052757+0000","last_undegraded":"2024-05-30T16:49:06.052757+0000","last_fullsized":"2024-05-30T16:49:06.052757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:51:21.137153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052564+0000","last_change":"2024-05-30T16:49:04.546980+0000","last_active":"2024-05-30T16:49:06.052564+0000","last_peered":"2024-05-30T16:49:06.052564+0000","last_clean":"2024-05-30T16:49:06.052564+0000","last_became_active":"2024-05-30T16:49:04.546205+0000","last_became_peered":"2024-05-30T16:49:04.546205+0000","last_unstale":"2024-05-30T16:49:06.052564+0000","last_undegraded":"2024-05-30T16:49:06.052564+0000","last_fullsized":"2024-05-30T16:49:06.052564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.529988+0000","last_change":"2024-05-30T16:49:03.543445+0000","last_active":"2024-05-30T16:49:05.529988+0000","last_peered":"2024-05-30T16:49:05.529988+0000","last_clean":"2024-05-30T16:49:05.529988+0000","last_became_active":"2024-05-30T16:49:03.543068+0000","last_became_peered":"2024-05-30T16:49:03.543068+0000","last_unstale":"2024-05-30T16:49:05.529988+0000","last_undegraded":"2024-05-30T16:49:05.529988+0000","last_fullsized":"2024-05-30T16:49:05.529988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:51:21.137153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052327+0000","last_change":"2024-05-30T16:49:04.553768+0000","last_active":"2024-05-30T16:49:06.052327+0000","last_peered":"2024-05-30T16:49:06.052327+0000","last_clean":"2024-05-30T16:49:06.052327+0000","last_became_active":"2024-05-30T16:49:04.550850+0000","last_became_peered":"2024-05-30T16:49:04.550850+0000","last_unstale":"2024-05-30T16:49:06.052327+0000","last_undegraded":"2024-05-30T16:49:06.052327+0000","last_fullsized":"2024-05-30T16:49:06.052327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:55.007207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534287+0000","last_change":"2024-05-30T16:49:03.549177+0000","last_active":"2024-05-30T16:49:05.534287+0000","last_peered":"2024-05-30T16:49:05.534287+0000","last_clean":"2024-05-30T16:49:05.534287+0000","last_became_active":"2024-05-30T16:49:03.548803+0000","last_became_peered":"2024-05-30T16:49:03.548803+0000","last_unstale":"2024-05-30T16:49:05.534287+0000","last_undegraded":"2024-05-30T16:49:05.534287+0000","last_fullsized":"2024-05-30T16:49:05.534287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:28:50.120091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052450+0000","last_change":"2024-05-30T16:49:04.552000+0000","last_active":"2024-05-30T16:49:06.052450+0000","last_peered":"2024-05-30T16:49:06.052450+0000","last_clean":"2024-05-30T16:49:06.052450+0000","last_became_active":"2024-05-30T16:49:04.551392+0000","last_became_peered":"2024-05-30T16:49:04.551392+0000","last_unstale":"2024-05-30T16:49:06.052450+0000","last_undegraded":"2024-05-30T16:49:06.052450+0000","last_fullsized":"2024-05-30T16:49:06.052450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:59.487481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530211+0000","last_change":"2024-05-30T16:49:03.548846+0000","last_active":"2024-05-30T16:49:05.530211+0000","last_peered":"2024-05-30T16:49:05.530211+0000","last_clean":"2024-05-30T16:49:05.530211+0000","last_became_active":"2024-05-30T16:49:03.547182+0000","last_became_peered":"2024-05-30T16:49:03.547182+0000","last_unstale":"2024-05-30T16:49:05.530211+0000","last_undegraded":"2024-05-30T16:49:05.530211+0000","last_fullsized":"2024-05-30T16:49:05.530211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052721+0000","last_change":"2024-05-30T16:49:04.558273+0000","last_active":"2024-05-30T16:49:06.052721+0000","last_peered":"2024-05-30T16:49:06.052721+0000","last_clean":"2024-05-30T16:49:06.052721+0000","last_became_active":"2024-05-30T16:49:04.557860+0000","last_became_peered":"2024-05-30T16:49:04.557860+0000","last_unstale":"2024-05-30T16:49:06.052721+0000","last_undegraded":"2024-05-30T16:49:06.052721+0000","last_fullsized":"2024-05-30T16:49:06.052721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:20.040027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053015+0000","last_change":"2024-05-30T16:49:03.532399+0000","last_active":"2024-05-30T16:49:06.053015+0000","last_peered":"2024-05-30T16:49:06.053015+0000","last_clean":"2024-05-30T16:49:06.053015+0000","last_became_active":"2024-05-30T16:49:03.529396+0000","last_became_peered":"2024-05-30T16:49:03.529396+0000","last_unstale":"2024-05-30T16:49:06.053015+0000","last_undegraded":"2024-05-30T16:49:06.053015+0000","last_fullsized":"2024-05-30T16:49:06.053015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:18.318116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534179+0000","last_change":"2024-05-30T16:49:04.549628+0000","last_active":"2024-05-30T16:49:05.534179+0000","last_peered":"2024-05-30T16:49:05.534179+0000","last_clean":"2024-05-30T16:49:05.534179+0000","last_became_active":"2024-05-30T16:49:04.548782+0000","last_became_peered":"2024-05-30T16:49:04.548782+0000","last_unstale":"2024-05-30T16:49:05.534179+0000","last_undegraded":"2024-05-30T16:49:05.534179+0000","last_fullsized":"2024-05-30T16:49:05.534179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:55.007207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530197+0000","last_change":"2024-05-30T16:49:03.540089+0000","last_active":"2024-05-30T16:49:05.530197+0000","last_peered":"2024-05-30T16:49:05.530197+0000","last_clean":"2024-05-30T16:49:05.530197+0000","last_became_active":"2024-05-30T16:49:03.539760+0000","last_became_peered":"2024-05-30T16:49:03.539760+0000","last_unstale":"2024-05-30T16:49:05.530197+0000","last_undegraded":"2024-05-30T16:49:05.530197+0000","last_fullsized":"2024-05-30T16:49:05.530197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:21:15.090452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052910+0000","last_change":"2024-05-30T16:49:04.555284+0000","last_active":"2024-05-30T16:49:06.052910+0000","last_peered":"2024-05-30T16:49:06.052910+0000","last_clean":"2024-05-30T16:49:06.052910+0000","last_became_active":"2024-05-30T16:49:04.555022+0000","last_became_peered":"2024-05-30T16:49:04.555022+0000","last_unstale":"2024-05-30T16:49:06.052910+0000","last_undegraded":"2024-05-30T16:49:06.052910+0000","last_fullsized":"2024-05-30T16:49:06.052910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:42.707877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052217+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:49:06.052217+0000","last_peered":"2024-05-30T16:49:06.052217+0000","last_clean":"2024-05-30T16:49:06.052217+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:49:06.052217+0000","last_undegraded":"2024-05-30T16:49:06.052217+0000","last_fullsized":"2024-05-30T16:49:06.052217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533284+0000","last_change":"2024-05-30T16:49:03.536755+0000","last_active":"2024-05-30T16:49:05.533284+0000","last_peered":"2024-05-30T16:49:05.533284+0000","last_clean":"2024-05-30T16:49:05.533284+0000","last_became_active":"2024-05-30T16:49:03.536335+0000","last_became_peered":"2024-05-30T16:49:03.536335+0000","last_unstale":"2024-05-30T16:49:05.533284+0000","last_undegraded":"2024-05-30T16:49:05.533284+0000","last_fullsized":"2024-05-30T16:49:05.533284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051447+0000","last_change":"2024-05-30T16:49:04.546603+0000","last_active":"2024-05-30T16:49:06.051447+0000","last_peered":"2024-05-30T16:49:06.051447+0000","last_clean":"2024-05-30T16:49:06.051447+0000","last_became_active":"2024-05-30T16:49:04.545130+0000","last_became_peered":"2024-05-30T16:49:04.545130+0000","last_unstale":"2024-05-30T16:49:06.051447+0000","last_undegraded":"2024-05-30T16:49:06.051447+0000","last_fullsized":"2024-05-30T16:49:06.051447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:47.404454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052089+0000","last_change":"2024-05-30T16:49:03.548756+0000","last_active":"2024-05-30T16:49:06.052089+0000","last_peered":"2024-05-30T16:49:06.052089+0000","last_clean":"2024-05-30T16:49:06.052089+0000","last_became_active":"2024-05-30T16:49:03.548431+0000","last_became_peered":"2024-05-30T16:49:03.548431+0000","last_unstale":"2024-05-30T16:49:06.052089+0000","last_undegraded":"2024-05-30T16:49:06.052089+0000","last_fullsized":"2024-05-30T16:49:06.052089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051661+0000","last_change":"2024-05-30T16:49:04.557247+0000","last_active":"2024-05-30T16:49:06.051661+0000","last_peered":"2024-05-30T16:49:06.051661+0000","last_clean":"2024-05-30T16:49:06.051661+0000","last_became_active":"2024-05-30T16:49:04.556957+0000","last_became_peered":"2024-05-30T16:49:04.556957+0000","last_unstale":"2024-05-30T16:49:06.051661+0000","last_undegraded":"2024-05-30T16:49:06.051661+0000","last_fullsized":"2024-05-30T16:49:06.051661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530057+0000","last_change":"2024-05-30T16:49:03.548449+0000","last_active":"2024-05-30T16:49:05.530057+0000","last_peered":"2024-05-30T16:49:05.530057+0000","last_clean":"2024-05-30T16:49:05.530057+0000","last_became_active":"2024-05-30T16:49:03.547447+0000","last_became_peered":"2024-05-30T16:49:03.547447+0000","last_unstale":"2024-05-30T16:49:05.530057+0000","last_undegraded":"2024-05-30T16:49:05.530057+0000","last_fullsized":"2024-05-30T16:49:05.530057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:39:09.796452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052694+0000","last_change":"2024-05-30T16:49:04.535009+0000","last_active":"2024-05-30T16:49:06.052694+0000","last_peered":"2024-05-30T16:49:06.052694+0000","last_clean":"2024-05-30T16:49:06.052694+0000","last_became_active":"2024-05-30T16:49:04.534615+0000","last_became_peered":"2024-05-30T16:49:04.534615+0000","last_unstale":"2024-05-30T16:49:06.052694+0000","last_undegraded":"2024-05-30T16:49:06.052694+0000","last_fullsized":"2024-05-30T16:49:06.052694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534481+0000","last_change":"2024-05-30T16:49:03.526029+0000","last_active":"2024-05-30T16:49:05.534481+0000","last_peered":"2024-05-30T16:49:05.534481+0000","last_clean":"2024-05-30T16:49:05.534481+0000","last_became_active":"2024-05-30T16:49:03.525606+0000","last_became_peered":"2024-05-30T16:49:03.525606+0000","last_unstale":"2024-05-30T16:49:05.534481+0000","last_undegraded":"2024-05-30T16:49:05.534481+0000","last_fullsized":"2024-05-30T16:49:05.534481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533778+0000","last_change":"2024-05-30T16:49:04.553469+0000","last_active":"2024-05-30T16:49:05.533778+0000","last_peered":"2024-05-30T16:49:05.533778+0000","last_clean":"2024-05-30T16:49:05.533778+0000","last_became_active":"2024-05-30T16:49:04.551873+0000","last_became_peered":"2024-05-30T16:49:04.551873+0000","last_unstale":"2024-05-30T16:49:05.533778+0000","last_undegraded":"2024-05-30T16:49:05.533778+0000","last_fullsized":"2024-05-30T16:49:05.533778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:15.394210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052860+0000","last_change":"2024-05-30T16:49:03.537420+0000","last_active":"2024-05-30T16:49:06.052860+0000","last_peered":"2024-05-30T16:49:06.052860+0000","last_clean":"2024-05-30T16:49:06.052860+0000","last_became_active":"2024-05-30T16:49:03.536674+0000","last_became_peered":"2024-05-30T16:49:03.536674+0000","last_unstale":"2024-05-30T16:49:06.052860+0000","last_undegraded":"2024-05-30T16:49:06.052860+0000","last_fullsized":"2024-05-30T16:49:06.052860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534511+0000","last_change":"2024-05-30T16:49:04.557070+0000","last_active":"2024-05-30T16:49:05.534511+0000","last_peered":"2024-05-30T16:49:05.534511+0000","last_clean":"2024-05-30T16:49:05.534511+0000","last_became_active":"2024-05-30T16:49:04.556515+0000","last_became_peered":"2024-05-30T16:49:04.556515+0000","last_unstale":"2024-05-30T16:49:05.534511+0000","last_undegraded":"2024-05-30T16:49:05.534511+0000","last_fullsized":"2024-05-30T16:49:05.534511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:00.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052919+0000","last_change":"2024-05-30T16:49:03.551865+0000","last_active":"2024-05-30T16:49:06.052919+0000","last_peered":"2024-05-30T16:49:06.052919+0000","last_clean":"2024-05-30T16:49:06.052919+0000","last_became_active":"2024-05-30T16:49:03.551582+0000","last_became_peered":"2024-05-30T16:49:03.551582+0000","last_unstale":"2024-05-30T16:49:06.052919+0000","last_undegraded":"2024-05-30T16:49:06.052919+0000","last_fullsized":"2024-05-30T16:49:06.052919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:53:44.885507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052808+0000","last_change":"2024-05-30T16:49:04.537297+0000","last_active":"2024-05-30T16:49:06.052808+0000","last_peered":"2024-05-30T16:49:06.052808+0000","last_clean":"2024-05-30T16:49:06.052808+0000","last_became_active":"2024-05-30T16:49:04.535219+0000","last_became_peered":"2024-05-30T16:49:04.535219+0000","last_unstale":"2024-05-30T16:49:06.052808+0000","last_undegraded":"2024-05-30T16:49:06.052808+0000","last_fullsized":"2024-05-30T16:49:06.052808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053097+0000","last_change":"2024-05-30T16:49:03.534738+0000","last_active":"2024-05-30T16:49:06.053097+0000","last_peered":"2024-05-30T16:49:06.053097+0000","last_clean":"2024-05-30T16:49:06.053097+0000","last_became_active":"2024-05-30T16:49:03.534350+0000","last_became_peered":"2024-05-30T16:49:03.534350+0000","last_unstale":"2024-05-30T16:49:06.053097+0000","last_undegraded":"2024-05-30T16:49:06.053097+0000","last_fullsized":"2024-05-30T16:49:06.053097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052135+0000","last_change":"2024-05-30T16:49:04.544633+0000","last_active":"2024-05-30T16:49:06.052135+0000","last_peered":"2024-05-30T16:49:06.052135+0000","last_clean":"2024-05-30T16:49:06.052135+0000","last_became_active":"2024-05-30T16:49:04.544348+0000","last_became_peered":"2024-05-30T16:49:04.544348+0000","last_unstale":"2024-05-30T16:49:06.052135+0000","last_undegraded":"2024-05-30T16:49:06.052135+0000","last_fullsized":"2024-05-30T16:49:06.052135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:09.918803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053285+0000","last_change":"2024-05-30T16:49:03.547123+0000","last_active":"2024-05-30T16:49:06.053285+0000","last_peered":"2024-05-30T16:49:06.053285+0000","last_clean":"2024-05-30T16:49:06.053285+0000","last_became_active":"2024-05-30T16:49:03.546748+0000","last_became_peered":"2024-05-30T16:49:03.546748+0000","last_unstale":"2024-05-30T16:49:06.053285+0000","last_undegraded":"2024-05-30T16:49:06.053285+0000","last_fullsized":"2024-05-30T16:49:06.053285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051720+0000","last_change":"2024-05-30T16:49:04.536325+0000","last_active":"2024-05-30T16:49:06.051720+0000","last_peered":"2024-05-30T16:49:06.051720+0000","last_clean":"2024-05-30T16:49:06.051720+0000","last_became_active":"2024-05-30T16:49:04.535456+0000","last_became_peered":"2024-05-30T16:49:04.535456+0000","last_unstale":"2024-05-30T16:49:06.051720+0000","last_undegraded":"2024-05-30T16:49:06.051720+0000","last_fullsized":"2024-05-30T16:49:06.051720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051841+0000","last_change":"2024-05-30T16:49:03.551302+0000","last_active":"2024-05-30T16:49:06.051841+0000","last_peered":"2024-05-30T16:49:06.051841+0000","last_clean":"2024-05-30T16:49:06.051841+0000","last_became_active":"2024-05-30T16:49:03.551084+0000","last_became_peered":"2024-05-30T16:49:03.551084+0000","last_unstale":"2024-05-30T16:49:06.051841+0000","last_undegraded":"2024-05-30T16:49:06.051841+0000","last_fullsized":"2024-05-30T16:49:06.051841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533890+0000","last_change":"2024-05-30T16:49:04.548525+0000","last_active":"2024-05-30T16:49:05.533890+0000","last_peered":"2024-05-30T16:49:05.533890+0000","last_clean":"2024-05-30T16:49:05.533890+0000","last_became_active":"2024-05-30T16:49:04.548054+0000","last_became_peered":"2024-05-30T16:49:04.548054+0000","last_unstale":"2024-05-30T16:49:05.533890+0000","last_undegraded":"2024-05-30T16:49:05.533890+0000","last_fullsized":"2024-05-30T16:49:05.533890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:49.724960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052859+0000","last_change":"2024-05-30T16:49:03.546920+0000","last_active":"2024-05-30T16:49:06.052859+0000","last_peered":"2024-05-30T16:49:06.052859+0000","last_clean":"2024-05-30T16:49:06.052859+0000","last_became_active":"2024-05-30T16:49:03.545621+0000","last_became_peered":"2024-05-30T16:49:03.545621+0000","last_unstale":"2024-05-30T16:49:06.052859+0000","last_undegraded":"2024-05-30T16:49:06.052859+0000","last_fullsized":"2024-05-30T16:49:06.052859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051851+0000","last_change":"2024-05-30T16:49:04.535297+0000","last_active":"2024-05-30T16:49:06.051851+0000","last_peered":"2024-05-30T16:49:06.051851+0000","last_clean":"2024-05-30T16:49:06.051851+0000","last_became_active":"2024-05-30T16:49:04.534907+0000","last_became_peered":"2024-05-30T16:49:04.534907+0000","last_unstale":"2024-05-30T16:49:06.051851+0000","last_undegraded":"2024-05-30T16:49:06.051851+0000","last_fullsized":"2024-05-30T16:49:06.051851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:56.163039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052768+0000","last_change":"2024-05-30T16:49:03.536690+0000","last_active":"2024-05-30T16:49:06.052768+0000","last_peered":"2024-05-30T16:49:06.052768+0000","last_clean":"2024-05-30T16:49:06.052768+0000","last_became_active":"2024-05-30T16:49:03.536351+0000","last_became_peered":"2024-05-30T16:49:03.536351+0000","last_unstale":"2024-05-30T16:49:06.052768+0000","last_undegraded":"2024-05-30T16:49:06.052768+0000","last_fullsized":"2024-05-30T16:49:06.052768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051567+0000","last_change":"2024-05-30T16:49:04.556339+0000","last_active":"2024-05-30T16:49:06.051567+0000","last_peered":"2024-05-30T16:49:06.051567+0000","last_clean":"2024-05-30T16:49:06.051567+0000","last_became_active":"2024-05-30T16:49:04.556012+0000","last_became_peered":"2024-05-30T16:49:04.556012+0000","last_unstale":"2024-05-30T16:49:06.051567+0000","last_undegraded":"2024-05-30T16:49:06.051567+0000","last_fullsized":"2024-05-30T16:49:06.051567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:23.369792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052569+0000","last_change":"2024-05-30T16:49:03.550153+0000","last_active":"2024-05-30T16:49:06.052569+0000","last_peered":"2024-05-30T16:49:06.052569+0000","last_clean":"2024-05-30T16:49:06.052569+0000","last_became_active":"2024-05-30T16:49:03.549872+0000","last_became_peered":"2024-05-30T16:49:03.549872+0000","last_unstale":"2024-05-30T16:49:06.052569+0000","last_undegraded":"2024-05-30T16:49:06.052569+0000","last_fullsized":"2024-05-30T16:49:06.052569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:58.145285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052911+0000","last_change":"2024-05-30T16:49:04.558227+0000","last_active":"2024-05-30T16:49:06.052911+0000","last_peered":"2024-05-30T16:49:06.052911+0000","last_clean":"2024-05-30T16:49:06.052911+0000","last_became_active":"2024-05-30T16:49:04.557978+0000","last_became_peered":"2024-05-30T16:49:04.557978+0000","last_unstale":"2024-05-30T16:49:06.052911+0000","last_undegraded":"2024-05-30T16:49:06.052911+0000","last_fullsized":"2024-05-30T16:49:06.052911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534339+0000","last_change":"2024-05-30T16:49:04.561331+0000","last_active":"2024-05-30T16:49:05.534339+0000","last_peered":"2024-05-30T16:49:05.534339+0000","last_clean":"2024-05-30T16:49:05.534339+0000","last_became_active":"2024-05-30T16:49:04.560894+0000","last_became_peered":"2024-05-30T16:49:04.560894+0000","last_unstale":"2024-05-30T16:49:05.534339+0000","last_undegraded":"2024-05-30T16:49:05.534339+0000","last_fullsized":"2024-05-30T16:49:05.534339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:45:42.077957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052112+0000","last_change":"2024-05-30T16:49:03.549087+0000","last_active":"2024-05-30T16:49:06.052112+0000","last_peered":"2024-05-30T16:49:06.052112+0000","last_clean":"2024-05-30T16:49:06.052112+0000","last_became_active":"2024-05-30T16:49:03.548736+0000","last_became_peered":"2024-05-30T16:49:03.548736+0000","last_unstale":"2024-05-30T16:49:06.052112+0000","last_undegraded":"2024-05-30T16:49:06.052112+0000","last_fullsized":"2024-05-30T16:49:06.052112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534726+0000","last_change":"2024-05-30T16:49:04.561436+0000","last_active":"2024-05-30T16:49:05.534726+0000","last_peered":"2024-05-30T16:49:05.534726+0000","last_clean":"2024-05-30T16:49:05.534726+0000","last_became_active":"2024-05-30T16:49:04.561159+0000","last_became_peered":"2024-05-30T16:49:04.561159+0000","last_unstale":"2024-05-30T16:49:05.534726+0000","last_undegraded":"2024-05-30T16:49:05.534726+0000","last_fullsized":"2024-05-30T16:49:05.534726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:47:24.068734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052643+0000","last_change":"2024-05-30T16:49:03.552644+0000","last_active":"2024-05-30T16:49:06.052643+0000","last_peered":"2024-05-30T16:49:06.052643+0000","last_clean":"2024-05-30T16:49:06.052643+0000","last_became_active":"2024-05-30T16:49:03.552304+0000","last_became_peered":"2024-05-30T16:49:03.552304+0000","last_unstale":"2024-05-30T16:49:06.052643+0000","last_undegraded":"2024-05-30T16:49:06.052643+0000","last_fullsized":"2024-05-30T16:49:06.052643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:18.318116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051834+0000","last_change":"2024-05-30T16:49:04.542732+0000","last_active":"2024-05-30T16:49:06.051834+0000","last_peered":"2024-05-30T16:49:06.051834+0000","last_clean":"2024-05-30T16:49:06.051834+0000","last_became_active":"2024-05-30T16:49:04.542400+0000","last_became_peered":"2024-05-30T16:49:04.542400+0000","last_unstale":"2024-05-30T16:49:06.051834+0000","last_undegraded":"2024-05-30T16:49:06.051834+0000","last_fullsized":"2024-05-30T16:49:06.051834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052111+0000","last_change":"2024-05-30T16:49:03.546038+0000","last_active":"2024-05-30T16:49:06.052111+0000","last_peered":"2024-05-30T16:49:06.052111+0000","last_clean":"2024-05-30T16:49:06.052111+0000","last_became_active":"2024-05-30T16:49:03.545623+0000","last_became_peered":"2024-05-30T16:49:03.545623+0000","last_unstale":"2024-05-30T16:49:06.052111+0000","last_undegraded":"2024-05-30T16:49:06.052111+0000","last_fullsized":"2024-05-30T16:49:06.052111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:40.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052052+0000","last_change":"2024-05-30T16:49:04.546841+0000","last_active":"2024-05-30T16:49:06.052052+0000","last_peered":"2024-05-30T16:49:06.052052+0000","last_clean":"2024-05-30T16:49:06.052052+0000","last_became_active":"2024-05-30T16:49:04.546596+0000","last_became_peered":"2024-05-30T16:49:04.546596+0000","last_unstale":"2024-05-30T16:49:06.052052+0000","last_undegraded":"2024-05-30T16:49:06.052052+0000","last_fullsized":"2024-05-30T16:49:06.052052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:06.186315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051977+0000","last_change":"2024-05-30T16:49:03.551604+0000","last_active":"2024-05-30T16:49:06.051977+0000","last_peered":"2024-05-30T16:49:06.051977+0000","last_clean":"2024-05-30T16:49:06.051977+0000","last_became_active":"2024-05-30T16:49:03.551333+0000","last_became_peered":"2024-05-30T16:49:03.551333+0000","last_unstale":"2024-05-30T16:49:06.051977+0000","last_undegraded":"2024-05-30T16:49:06.051977+0000","last_fullsized":"2024-05-30T16:49:06.051977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:23.050556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":81081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":671961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:49:16.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:49:16.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.390+0000 7fa7aa600640 1 Processor -- start 2024-05-30T16:49:16.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.390+0000 7fa7aa600640 1 -- start start 2024-05-30T16:49:16.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.390+0000 7fa7aa600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7a40cfe20 0x7fa7a415ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.390+0000 7fa7aa600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7a4073bb0 0x7fa7a4072060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.390+0000 7fa7aa600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7a415f3b0 con 0x7fa7a40cfa40 2024-05-30T16:49:16.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.390+0000 7fa7aa600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa7a415f690 con 0x7fa7a4073bb0 2024-05-30T16:49:16.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.390+0000 7fa7aa600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a415f970 con 0x7fa7a40cfe20 2024-05-30T16:49:16.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.394+0000 7fa7a3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7a4073bb0 0x7fa7a4072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.394+0000 7fa7a3400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa7a40cfa40 0x7fa7a40b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40166/0 (socket says 172.21.15.59:40166) 2024-05-30T16:49:16.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.394+0000 7fa7a3400640 1 -- 172.21.15.59:0/483658272 learned_addr learned my addr 172.21.15.59:0/483658272 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.394+0000 7fa79aa00640 1 --2- 172.21.15.59:0/483658272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7a40cfe20 0x7fa7a415ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.394+0000 7fa7a3e00640 1 -- 172.21.15.59:0/483658272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7a40cfe20 msgr2=0x7fa7a415ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.394+0000 7fa7a3e00640 1 --2- 172.21.15.59:0/483658272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7a40cfe20 0x7fa7a415ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.394+0000 7fa7a3e00640 1 -- 172.21.15.59:0/483658272 >> v1:172.21.15.59:6789/0 conn(0x7fa7a40cfa40 legacy=0x7fa7a40b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.394+0000 7fa7a3e00640 1 -- 172.21.15.59:0/483658272 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a40b3370 con 0x7fa7a4073bb0 2024-05-30T16:49:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.394+0000 7fa7a2a00640 1 -- 172.21.15.59:0/483658272 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296265815 0 0) 0x7fa7a415f3b0 con 0x7fa7a40cfa40 2024-05-30T16:49:16.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.394+0000 7fa7a3e00640 1 --2- 172.21.15.59:0/483658272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7a4073bb0 0x7fa7a4072060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009d90 tx=0x7fa79c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbdccadae9bfc7f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:16.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7a2a00640 1 -- 172.21.15.59:0/483658272 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0b2070 con 0x7fa7a4073bb0 2024-05-30T16:49:16.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7a2a00640 1 -- 172.21.15.59:0/483658272 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79c0a5940 con 0x7fa7a4073bb0 2024-05-30T16:49:16.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7a2a00640 1 -- 172.21.15.59:0/483658272 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0a5d10 con 0x7fa7a4073bb0 2024-05-30T16:49:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 -- 172.21.15.59:0/483658272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7a4073bb0 msgr2=0x7fa7a4072060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 --2- 172.21.15.59:0/483658272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7a4073bb0 0x7fa7a4072060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009d90 tx=0x7fa79c01c970 comp rx=0 tx=0).stop 2024-05-30T16:49:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 -- 172.21.15.59:0/483658272 shutdown_connections 2024-05-30T16:49:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 --2- 172.21.15.59:0/483658272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7a4073bb0 0x7fa7a4072060 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 --2- 172.21.15.59:0/483658272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7a40cfe20 0x7fa7a415ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 -- 172.21.15.59:0/483658272 >> 172.21.15.59:0/483658272 conn(0x7fa7a40b22d0 msgr2=0x7fa7a40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 -- 172.21.15.59:0/483658272 shutdown_connections 2024-05-30T16:49:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 -- 172.21.15.59:0/483658272 wait complete. 2024-05-30T16:49:16.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 Processor -- start 2024-05-30T16:49:16.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 -- start start 2024-05-30T16:49:16.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7a4073bb0 0x7fa7a4158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7a40cfa40 0x7fa7a4151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7a40cfe20 0x7fa7a414c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41551d0 con 0x7fa7a40cfa40 2024-05-30T16:49:16.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a4155050 con 0x7fa7a4073bb0 2024-05-30T16:49:16.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7aa600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a4155350 con 0x7fa7a40cfe20 2024-05-30T16:49:16.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa79aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7a40cfa40 0x7fa7a4151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa79aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7a40cfa40 0x7fa7a4151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54456/0 (socket says 172.21.15.59:54456) 2024-05-30T16:49:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa79aa00640 1 -- 172.21.15.59:0/4012312302 learned_addr learned my addr 172.21.15.59:0/4012312302 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7a3400640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7a4073bb0 0x7fa7a4158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.398+0000 7fa7a3e00640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7a40cfe20 0x7fa7a414c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa79aa00640 1 -- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7a40cfe20 msgr2=0x7fa7a414c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa79aa00640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7a40cfe20 0x7fa7a414c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa79aa00640 1 -- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7a4073bb0 msgr2=0x7fa7a4158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa79aa00640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7a4073bb0 0x7fa7a4158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa79aa00640 1 -- 172.21.15.59:0/4012312302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a414d640 con 0x7fa7a40cfa40 2024-05-30T16:49:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa7a3400640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7a4073bb0 0x7fa7a4158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa79aa00640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7a40cfa40 0x7fa7a4151780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00d620 tx=0x7fa78c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:16.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa79be00640 1 -- 172.21.15.59:0/4012312302 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00b620 con 0x7fa7a40cfa40 2024-05-30T16:49:16.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa79be00640 1 -- 172.21.15.59:0/4012312302 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa78c019070 con 0x7fa7a40cfa40 2024-05-30T16:49:16.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa79be00640 1 -- 172.21.15.59:0/4012312302 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00b9e0 con 0x7fa7a40cfa40 2024-05-30T16:49:16.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa7aa600640 1 -- 172.21.15.59:0/4012312302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a414d920 con 0x7fa7a40cfa40 2024-05-30T16:49:16.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa7aa600640 1 -- 172.21.15.59:0/4012312302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a414dee0 con 0x7fa7a40cfa40 2024-05-30T16:49:16.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa7aa600640 1 -- 172.21.15.59:0/4012312302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a4068a90 con 0x7fa7a40cfa40 2024-05-30T16:49:16.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa79be00640 1 -- 172.21.15.59:0/4012312302 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa78c00bb80 con 0x7fa7a40cfa40 2024-05-30T16:49:16.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa79be00640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa780068380 0x7fa78006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.402+0000 7fa79be00640 1 -- 172.21.15.59:0/4012312302 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa78c086d50 con 0x7fa7a40cfa40 2024-05-30T16:49:16.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.406+0000 7fa7a3400640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa780068380 0x7fa78006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.406+0000 7fa7a3400640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa780068380 0x7fa78006a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa794007fd0 tx=0x7fa794007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:16.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.406+0000 7fa79be00640 1 -- 172.21.15.59:0/4012312302 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa78c057300 con 0x7fa7a40cfa40 2024-05-30T16:49:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.566+0000 7fa7aa600640 1 -- 172.21.15.59:0/4012312302 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7a40b5190 con 0x7fa780068380 2024-05-30T16:49:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.574+0000 7fa79be00640 1 -- 172.21.15.59:0/4012312302 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7fa7a40b5190 con 0x7fa780068380 2024-05-30T16:49:16.582 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:49:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.578+0000 7fa7aa600640 1 -- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa780068380 msgr2=0x7fa78006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.578+0000 7fa7aa600640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa780068380 0x7fa78006a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa794007fd0 tx=0x7fa794007c20 comp rx=0 tx=0).stop 2024-05-30T16:49:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.578+0000 7fa7aa600640 1 -- 172.21.15.59:0/4012312302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7a40cfa40 msgr2=0x7fa7a4151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.578+0000 7fa7aa600640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7a40cfa40 0x7fa7a4151780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00d620 tx=0x7fa78c00dae0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.578+0000 7fa7aa600640 1 -- 172.21.15.59:0/4012312302 shutdown_connections 2024-05-30T16:49:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.578+0000 7fa7aa600640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa780068380 0x7fa78006a840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.578+0000 7fa7aa600640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7a40cfe20 0x7fa7a414c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.578+0000 7fa7aa600640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7a40cfa40 0x7fa7a4151780 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.578+0000 7fa7aa600640 1 --2- 172.21.15.59:0/4012312302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7a4073bb0 0x7fa7a4158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.578+0000 7fa7aa600640 1 -- 172.21.15.59:0/4012312302 >> 172.21.15.59:0/4012312302 conn(0x7fa7a40b22d0 msgr2=0x7fa7a4073240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.578+0000 7fa7aa600640 1 -- 172.21.15.59:0/4012312302 shutdown_connections 2024-05-30T16:49:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.578+0000 7fa7aa600640 1 -- 172.21.15.59:0/4012312302 wait complete. 2024-05-30T16:49:16.603 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-05-30T16:49:15.077025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219212,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755508,"statfs":{"total":773094113280,"available":772869640192,"internally_reserved":0,"allocated":3121152,"data_stored":1833196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002798"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052545+0000","last_change":"2024-05-30T16:49:04.545096+0000","last_active":"2024-05-30T16:49:06.052545+0000","last_peered":"2024-05-30T16:49:06.052545+0000","last_clean":"2024-05-30T16:49:06.052545+0000","last_became_active":"2024-05-30T16:49:04.544532+0000","last_became_peered":"2024-05-30T16:49:04.544532+0000","last_unstale":"2024-05-30T16:49:06.052545+0000","last_undegraded":"2024-05-30T16:49:06.052545+0000","last_fullsized":"2024-05-30T16:49:06.052545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:00.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053033+0000","last_change":"2024-05-30T16:49:04.538139+0000","last_active":"2024-05-30T16:49:06.053033+0000","last_peered":"2024-05-30T16:49:06.053033+0000","last_clean":"2024-05-30T16:49:06.053033+0000","last_became_active":"2024-05-30T16:49:04.537797+0000","last_became_peered":"2024-05-30T16:49:04.537797+0000","last_unstale":"2024-05-30T16:49:06.053033+0000","last_undegraded":"2024-05-30T16:49:06.053033+0000","last_fullsized":"2024-05-30T16:49:06.053033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051246+0000","last_change":"2024-05-30T16:49:04.542945+0000","last_active":"2024-05-30T16:49:06.051246+0000","last_peered":"2024-05-30T16:49:06.051246+0000","last_clean":"2024-05-30T16:49:06.051246+0000","last_became_active":"2024-05-30T16:49:04.542637+0000","last_became_peered":"2024-05-30T16:49:04.542637+0000","last_unstale":"2024-05-30T16:49:06.051246+0000","last_undegraded":"2024-05-30T16:49:06.051246+0000","last_fullsized":"2024-05-30T16:49:06.051246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:55:32.611131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533898+0000","last_change":"2024-05-30T16:49:04.556673+0000","last_active":"2024-05-30T16:49:05.533898+0000","last_peered":"2024-05-30T16:49:05.533898+0000","last_clean":"2024-05-30T16:49:05.533898+0000","last_became_active":"2024-05-30T16:49:04.556386+0000","last_became_peered":"2024-05-30T16:49:04.556386+0000","last_unstale":"2024-05-30T16:49:05.533898+0000","last_undegraded":"2024-05-30T16:49:05.533898+0000","last_fullsized":"2024-05-30T16:49:05.533898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:45.716674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052183+0000","last_change":"2024-05-30T16:49:04.552810+0000","last_active":"2024-05-30T16:49:06.052183+0000","last_peered":"2024-05-30T16:49:06.052183+0000","last_clean":"2024-05-30T16:49:06.052183+0000","last_became_active":"2024-05-30T16:49:04.552478+0000","last_became_peered":"2024-05-30T16:49:04.552478+0000","last_unstale":"2024-05-30T16:49:06.052183+0000","last_undegraded":"2024-05-30T16:49:06.052183+0000","last_fullsized":"2024-05-30T16:49:06.052183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:17:37.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534174+0000","last_change":"2024-05-30T16:49:04.546420+0000","last_active":"2024-05-30T16:49:05.534174+0000","last_peered":"2024-05-30T16:49:05.534174+0000","last_clean":"2024-05-30T16:49:05.534174+0000","last_became_active":"2024-05-30T16:49:04.545288+0000","last_became_peered":"2024-05-30T16:49:04.545288+0000","last_unstale":"2024-05-30T16:49:05.534174+0000","last_undegraded":"2024-05-30T16:49:05.534174+0000","last_fullsized":"2024-05-30T16:49:05.534174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:17:37.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051955+0000","last_change":"2024-05-30T16:49:04.542431+0000","last_active":"2024-05-30T16:49:06.051955+0000","last_peered":"2024-05-30T16:49:06.051955+0000","last_clean":"2024-05-30T16:49:06.051955+0000","last_became_active":"2024-05-30T16:49:04.541958+0000","last_became_peered":"2024-05-30T16:49:04.541958+0000","last_unstale":"2024-05-30T16:49:06.051955+0000","last_undegraded":"2024-05-30T16:49:06.051955+0000","last_fullsized":"2024-05-30T16:49:06.051955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:41.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.050859+0000","last_change":"2024-05-30T16:49:04.546221+0000","last_active":"2024-05-30T16:49:06.050859+0000","last_peered":"2024-05-30T16:49:06.050859+0000","last_clean":"2024-05-30T16:49:06.050859+0000","last_became_active":"2024-05-30T16:49:04.545933+0000","last_became_peered":"2024-05-30T16:49:04.545933+0000","last_unstale":"2024-05-30T16:49:06.050859+0000","last_undegraded":"2024-05-30T16:49:06.050859+0000","last_fullsized":"2024-05-30T16:49:06.050859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:21.914079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052633+0000","last_change":"2024-05-30T16:49:04.554508+0000","last_active":"2024-05-30T16:49:06.052633+0000","last_peered":"2024-05-30T16:49:06.052633+0000","last_clean":"2024-05-30T16:49:06.052633+0000","last_became_active":"2024-05-30T16:49:04.553966+0000","last_became_peered":"2024-05-30T16:49:04.553966+0000","last_unstale":"2024-05-30T16:49:06.052633+0000","last_undegraded":"2024-05-30T16:49:06.052633+0000","last_fullsized":"2024-05-30T16:49:06.052633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:47:24.068734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053243+0000","last_change":"2024-05-30T16:49:04.553475+0000","last_active":"2024-05-30T16:49:06.053243+0000","last_peered":"2024-05-30T16:49:06.053243+0000","last_clean":"2024-05-30T16:49:06.053243+0000","last_became_active":"2024-05-30T16:49:04.552962+0000","last_became_peered":"2024-05-30T16:49:04.552962+0000","last_unstale":"2024-05-30T16:49:06.053243+0000","last_undegraded":"2024-05-30T16:49:06.053243+0000","last_fullsized":"2024-05-30T16:49:06.053243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053178+0000","last_change":"2024-05-30T16:49:04.554233+0000","last_active":"2024-05-30T16:49:06.053178+0000","last_peered":"2024-05-30T16:49:06.053178+0000","last_clean":"2024-05-30T16:49:06.053178+0000","last_became_active":"2024-05-30T16:49:04.553934+0000","last_became_peered":"2024-05-30T16:49:04.553934+0000","last_unstale":"2024-05-30T16:49:06.053178+0000","last_undegraded":"2024-05-30T16:49:06.053178+0000","last_fullsized":"2024-05-30T16:49:06.053178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534485+0000","last_change":"2024-05-30T16:49:04.548278+0000","last_active":"2024-05-30T16:49:05.534485+0000","last_peered":"2024-05-30T16:49:05.534485+0000","last_clean":"2024-05-30T16:49:05.534485+0000","last_became_active":"2024-05-30T16:49:04.547736+0000","last_became_peered":"2024-05-30T16:49:04.547736+0000","last_unstale":"2024-05-30T16:49:05.534485+0000","last_undegraded":"2024-05-30T16:49:05.534485+0000","last_fullsized":"2024-05-30T16:49:05.534485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:02.310302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051507+0000","last_change":"2024-05-30T16:49:04.541147+0000","last_active":"2024-05-30T16:49:06.051507+0000","last_peered":"2024-05-30T16:49:06.051507+0000","last_clean":"2024-05-30T16:49:06.051507+0000","last_became_active":"2024-05-30T16:49:04.540873+0000","last_became_peered":"2024-05-30T16:49:04.540873+0000","last_unstale":"2024-05-30T16:49:06.051507+0000","last_undegraded":"2024-05-30T16:49:06.051507+0000","last_fullsized":"2024-05-30T16:49:06.051507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:31:53.336085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051066+0000","last_change":"2024-05-30T16:49:04.540239+0000","last_active":"2024-05-30T16:49:06.051066+0000","last_peered":"2024-05-30T16:49:06.051066+0000","last_clean":"2024-05-30T16:49:06.051066+0000","last_became_active":"2024-05-30T16:49:04.539685+0000","last_became_peered":"2024-05-30T16:49:04.539685+0000","last_unstale":"2024-05-30T16:49:06.051066+0000","last_undegraded":"2024-05-30T16:49:06.051066+0000","last_fullsized":"2024-05-30T16:49:06.051066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:59.153304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052714+0000","last_change":"2024-05-30T16:49:04.548766+0000","last_active":"2024-05-30T16:49:06.052714+0000","last_peered":"2024-05-30T16:49:06.052714+0000","last_clean":"2024-05-30T16:49:06.052714+0000","last_became_active":"2024-05-30T16:49:04.548490+0000","last_became_peered":"2024-05-30T16:49:04.548490+0000","last_unstale":"2024-05-30T16:49:06.052714+0000","last_undegraded":"2024-05-30T16:49:06.052714+0000","last_fullsized":"2024-05-30T16:49:06.052714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.532984+0000","last_change":"2024-05-30T16:49:04.542268+0000","last_active":"2024-05-30T16:49:05.532984+0000","last_peered":"2024-05-30T16:49:05.532984+0000","last_clean":"2024-05-30T16:49:05.532984+0000","last_became_active":"2024-05-30T16:49:04.541992+0000","last_became_peered":"2024-05-30T16:49:04.541992+0000","last_unstale":"2024-05-30T16:49:05.532984+0000","last_undegraded":"2024-05-30T16:49:05.532984+0000","last_fullsized":"2024-05-30T16:49:05.532984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534099+0000","last_change":"2024-05-30T16:49:04.550221+0000","last_active":"2024-05-30T16:49:05.534099+0000","last_peered":"2024-05-30T16:49:05.534099+0000","last_clean":"2024-05-30T16:49:05.534099+0000","last_became_active":"2024-05-30T16:49:04.549914+0000","last_became_peered":"2024-05-30T16:49:04.549914+0000","last_unstale":"2024-05-30T16:49:05.534099+0000","last_undegraded":"2024-05-30T16:49:05.534099+0000","last_fullsized":"2024-05-30T16:49:05.534099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:41.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530293+0000","last_change":"2024-05-30T16:49:04.551149+0000","last_active":"2024-05-30T16:49:05.530293+0000","last_peered":"2024-05-30T16:49:05.530293+0000","last_clean":"2024-05-30T16:49:05.530293+0000","last_became_active":"2024-05-30T16:49:04.543927+0000","last_became_peered":"2024-05-30T16:49:04.543927+0000","last_unstale":"2024-05-30T16:49:05.530293+0000","last_undegraded":"2024-05-30T16:49:05.530293+0000","last_fullsized":"2024-05-30T16:49:05.530293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:19.326134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052813+0000","last_change":"2024-05-30T16:49:04.536971+0000","last_active":"2024-05-30T16:49:06.052813+0000","last_peered":"2024-05-30T16:49:06.052813+0000","last_clean":"2024-05-30T16:49:06.052813+0000","last_became_active":"2024-05-30T16:49:04.536697+0000","last_became_peered":"2024-05-30T16:49:04.536697+0000","last_unstale":"2024-05-30T16:49:06.052813+0000","last_undegraded":"2024-05-30T16:49:06.052813+0000","last_fullsized":"2024-05-30T16:49:06.052813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:07.305667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052893+0000","last_change":"2024-05-30T16:49:04.554920+0000","last_active":"2024-05-30T16:49:06.052893+0000","last_peered":"2024-05-30T16:49:06.052893+0000","last_clean":"2024-05-30T16:49:06.052893+0000","last_became_active":"2024-05-30T16:49:04.554629+0000","last_became_peered":"2024-05-30T16:49:04.554629+0000","last_unstale":"2024-05-30T16:49:06.052893+0000","last_undegraded":"2024-05-30T16:49:06.052893+0000","last_fullsized":"2024-05-30T16:49:06.052893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051215+0000","last_change":"2024-05-30T16:49:04.546642+0000","last_active":"2024-05-30T16:49:06.051215+0000","last_peered":"2024-05-30T16:49:06.051215+0000","last_clean":"2024-05-30T16:49:06.051215+0000","last_became_active":"2024-05-30T16:49:04.546003+0000","last_became_peered":"2024-05-30T16:49:04.546003+0000","last_unstale":"2024-05-30T16:49:06.051215+0000","last_undegraded":"2024-05-30T16:49:06.051215+0000","last_fullsized":"2024-05-30T16:49:06.051215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:34:33.807678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534275+0000","last_change":"2024-05-30T16:49:04.549251+0000","last_active":"2024-05-30T16:49:05.534275+0000","last_peered":"2024-05-30T16:49:05.534275+0000","last_clean":"2024-05-30T16:49:05.534275+0000","last_became_active":"2024-05-30T16:49:04.548946+0000","last_became_peered":"2024-05-30T16:49:04.548946+0000","last_unstale":"2024-05-30T16:49:05.534275+0000","last_undegraded":"2024-05-30T16:49:05.534275+0000","last_fullsized":"2024-05-30T16:49:05.534275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:53:12.385144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051209+0000","last_change":"2024-05-30T16:49:04.554673+0000","last_active":"2024-05-30T16:49:06.051209+0000","last_peered":"2024-05-30T16:49:06.051209+0000","last_clean":"2024-05-30T16:49:06.051209+0000","last_became_active":"2024-05-30T16:49:04.552406+0000","last_became_peered":"2024-05-30T16:49:04.552406+0000","last_unstale":"2024-05-30T16:49:06.051209+0000","last_undegraded":"2024-05-30T16:49:06.051209+0000","last_fullsized":"2024-05-30T16:49:06.051209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:32:11.592244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534589+0000","last_change":"2024-05-30T16:49:04.539930+0000","last_active":"2024-05-30T16:49:05.534589+0000","last_peered":"2024-05-30T16:49:05.534589+0000","last_clean":"2024-05-30T16:49:05.534589+0000","last_became_active":"2024-05-30T16:49:04.538018+0000","last_became_peered":"2024-05-30T16:49:04.538018+0000","last_unstale":"2024-05-30T16:49:05.534589+0000","last_undegraded":"2024-05-30T16:49:05.534589+0000","last_fullsized":"2024-05-30T16:49:05.534589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052036+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.052036+0000","last_peered":"2024-05-30T16:49:06.052036+0000","last_clean":"2024-05-30T16:49:06.052036+0000","last_became_active":"2024-05-30T16:49:04.556321+0000","last_became_peered":"2024-05-30T16:49:04.556321+0000","last_unstale":"2024-05-30T16:49:06.052036+0000","last_undegraded":"2024-05-30T16:49:06.052036+0000","last_fullsized":"2024-05-30T16:49:06.052036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:44:48.125700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053240+0000","last_change":"2024-05-30T16:49:04.544556+0000","last_active":"2024-05-30T16:49:06.053240+0000","last_peered":"2024-05-30T16:49:06.053240+0000","last_clean":"2024-05-30T16:49:06.053240+0000","last_became_active":"2024-05-30T16:49:04.543181+0000","last_became_peered":"2024-05-30T16:49:04.543181+0000","last_unstale":"2024-05-30T16:49:06.053240+0000","last_undegraded":"2024-05-30T16:49:06.053240+0000","last_fullsized":"2024-05-30T16:49:06.053240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052887+0000","last_change":"2024-05-30T16:49:04.540083+0000","last_active":"2024-05-30T16:49:06.052887+0000","last_peered":"2024-05-30T16:49:06.052887+0000","last_clean":"2024-05-30T16:49:06.052887+0000","last_became_active":"2024-05-30T16:49:04.539760+0000","last_became_peered":"2024-05-30T16:49:04.539760+0000","last_unstale":"2024-05-30T16:49:06.052887+0000","last_undegraded":"2024-05-30T16:49:06.052887+0000","last_fullsized":"2024-05-30T16:49:06.052887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051647+0000","last_change":"2024-05-30T16:49:04.556600+0000","last_active":"2024-05-30T16:49:06.051647+0000","last_peered":"2024-05-30T16:49:06.051647+0000","last_clean":"2024-05-30T16:49:06.051647+0000","last_became_active":"2024-05-30T16:49:04.556297+0000","last_became_peered":"2024-05-30T16:49:04.556297+0000","last_unstale":"2024-05-30T16:49:06.051647+0000","last_undegraded":"2024-05-30T16:49:06.051647+0000","last_fullsized":"2024-05-30T16:49:06.051647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:14:09.241699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051361+0000","last_change":"2024-05-30T16:49:04.546093+0000","last_active":"2024-05-30T16:49:06.051361+0000","last_peered":"2024-05-30T16:49:06.051361+0000","last_clean":"2024-05-30T16:49:06.051361+0000","last_became_active":"2024-05-30T16:49:04.545623+0000","last_became_peered":"2024-05-30T16:49:04.545623+0000","last_unstale":"2024-05-30T16:49:06.051361+0000","last_undegraded":"2024-05-30T16:49:06.051361+0000","last_fullsized":"2024-05-30T16:49:06.051361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:38.640365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534360+0000","last_change":"2024-05-30T16:49:04.558192+0000","last_active":"2024-05-30T16:49:05.534360+0000","last_peered":"2024-05-30T16:49:05.534360+0000","last_clean":"2024-05-30T16:49:05.534360+0000","last_became_active":"2024-05-30T16:49:04.557826+0000","last_became_peered":"2024-05-30T16:49:04.557826+0000","last_unstale":"2024-05-30T16:49:05.534360+0000","last_undegraded":"2024-05-30T16:49:05.534360+0000","last_fullsized":"2024-05-30T16:49:05.534360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:59.487481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530068+0000","last_change":"2024-05-30T16:49:04.539369+0000","last_active":"2024-05-30T16:49:05.530068+0000","last_peered":"2024-05-30T16:49:05.530068+0000","last_clean":"2024-05-30T16:49:05.530068+0000","last_became_active":"2024-05-30T16:49:04.538899+0000","last_became_peered":"2024-05-30T16:49:04.538899+0000","last_unstale":"2024-05-30T16:49:05.530068+0000","last_undegraded":"2024-05-30T16:49:05.530068+0000","last_fullsized":"2024-05-30T16:49:05.530068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:39.816197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052013+0000","last_change":"2024-05-30T16:49:04.549536+0000","last_active":"2024-05-30T16:49:06.052013+0000","last_peered":"2024-05-30T16:49:06.052013+0000","last_clean":"2024-05-30T16:49:06.052013+0000","last_became_active":"2024-05-30T16:49:04.546653+0000","last_became_peered":"2024-05-30T16:49:04.546653+0000","last_unstale":"2024-05-30T16:49:06.052013+0000","last_undegraded":"2024-05-30T16:49:06.052013+0000","last_fullsized":"2024-05-30T16:49:06.052013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:38.640365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533225+0000","last_change":"2024-05-30T16:49:04.558267+0000","last_active":"2024-05-30T16:49:05.533225+0000","last_peered":"2024-05-30T16:49:05.533225+0000","last_clean":"2024-05-30T16:49:05.533225+0000","last_became_active":"2024-05-30T16:49:04.558000+0000","last_became_peered":"2024-05-30T16:49:04.558000+0000","last_unstale":"2024-05-30T16:49:05.533225+0000","last_undegraded":"2024-05-30T16:49:05.533225+0000","last_fullsized":"2024-05-30T16:49:05.533225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:11.469445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051650+0000","last_change":"2024-05-30T16:49:03.546643+0000","last_active":"2024-05-30T16:49:06.051650+0000","last_peered":"2024-05-30T16:49:06.051650+0000","last_clean":"2024-05-30T16:49:06.051650+0000","last_became_active":"2024-05-30T16:49:03.546381+0000","last_became_peered":"2024-05-30T16:49:03.546381+0000","last_unstale":"2024-05-30T16:49:06.051650+0000","last_undegraded":"2024-05-30T16:49:06.051650+0000","last_fullsized":"2024-05-30T16:49:06.051650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:44.078644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051517+0000","last_change":"2024-05-30T16:49:04.549134+0000","last_active":"2024-05-30T16:49:06.051517+0000","last_peered":"2024-05-30T16:49:06.051517+0000","last_clean":"2024-05-30T16:49:06.051517+0000","last_became_active":"2024-05-30T16:49:04.548780+0000","last_became_peered":"2024-05-30T16:49:04.548780+0000","last_unstale":"2024-05-30T16:49:06.051517+0000","last_undegraded":"2024-05-30T16:49:06.051517+0000","last_fullsized":"2024-05-30T16:49:06.051517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052899+0000","last_change":"2024-05-30T16:49:03.542612+0000","last_active":"2024-05-30T16:49:06.052899+0000","last_peered":"2024-05-30T16:49:06.052899+0000","last_clean":"2024-05-30T16:49:06.052899+0000","last_became_active":"2024-05-30T16:49:03.541360+0000","last_became_peered":"2024-05-30T16:49:03.541360+0000","last_unstale":"2024-05-30T16:49:06.052899+0000","last_undegraded":"2024-05-30T16:49:06.052899+0000","last_fullsized":"2024-05-30T16:49:06.052899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051315+0000","last_change":"2024-05-30T16:49:03.538756+0000","last_active":"2024-05-30T16:49:06.051315+0000","last_peered":"2024-05-30T16:49:06.051315+0000","last_clean":"2024-05-30T16:49:06.051315+0000","last_became_active":"2024-05-30T16:49:03.538053+0000","last_became_peered":"2024-05-30T16:49:03.538053+0000","last_unstale":"2024-05-30T16:49:06.051315+0000","last_undegraded":"2024-05-30T16:49:06.051315+0000","last_fullsized":"2024-05-30T16:49:06.051315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:07.264297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051433+0000","last_change":"2024-05-30T16:49:04.546048+0000","last_active":"2024-05-30T16:49:06.051433+0000","last_peered":"2024-05-30T16:49:06.051433+0000","last_clean":"2024-05-30T16:49:06.051433+0000","last_became_active":"2024-05-30T16:49:04.545151+0000","last_became_peered":"2024-05-30T16:49:04.545151+0000","last_unstale":"2024-05-30T16:49:06.051433+0000","last_undegraded":"2024-05-30T16:49:06.051433+0000","last_fullsized":"2024-05-30T16:49:06.051433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:07.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533718+0000","last_change":"2024-05-30T16:49:03.529039+0000","last_active":"2024-05-30T16:49:05.533718+0000","last_peered":"2024-05-30T16:49:05.533718+0000","last_clean":"2024-05-30T16:49:05.533718+0000","last_became_active":"2024-05-30T16:49:03.527042+0000","last_became_peered":"2024-05-30T16:49:03.527042+0000","last_unstale":"2024-05-30T16:49:05.533718+0000","last_undegraded":"2024-05-30T16:49:05.533718+0000","last_fullsized":"2024-05-30T16:49:05.533718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052719+0000","last_change":"2024-05-30T16:49:04.540411+0000","last_active":"2024-05-30T16:49:06.052719+0000","last_peered":"2024-05-30T16:49:06.052719+0000","last_clean":"2024-05-30T16:49:06.052719+0000","last_became_active":"2024-05-30T16:49:04.540089+0000","last_became_peered":"2024-05-30T16:49:04.540089+0000","last_unstale":"2024-05-30T16:49:06.052719+0000","last_undegraded":"2024-05-30T16:49:06.052719+0000","last_fullsized":"2024-05-30T16:49:06.052719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053224+0000","last_change":"2024-05-30T16:49:03.542933+0000","last_active":"2024-05-30T16:49:06.053224+0000","last_peered":"2024-05-30T16:49:06.053224+0000","last_clean":"2024-05-30T16:49:06.053224+0000","last_became_active":"2024-05-30T16:49:03.541460+0000","last_became_peered":"2024-05-30T16:49:03.541460+0000","last_unstale":"2024-05-30T16:49:06.053224+0000","last_undegraded":"2024-05-30T16:49:06.053224+0000","last_fullsized":"2024-05-30T16:49:06.053224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533477+0000","last_change":"2024-05-30T16:49:04.549367+0000","last_active":"2024-05-30T16:49:05.533477+0000","last_peered":"2024-05-30T16:49:05.533477+0000","last_clean":"2024-05-30T16:49:05.533477+0000","last_became_active":"2024-05-30T16:49:04.548994+0000","last_became_peered":"2024-05-30T16:49:04.548994+0000","last_unstale":"2024-05-30T16:49:05.533477+0000","last_undegraded":"2024-05-30T16:49:05.533477+0000","last_fullsized":"2024-05-30T16:49:05.533477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:57.289428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533840+0000","last_change":"2024-05-30T16:49:03.540903+0000","last_active":"2024-05-30T16:49:05.533840+0000","last_peered":"2024-05-30T16:49:05.533840+0000","last_clean":"2024-05-30T16:49:05.533840+0000","last_became_active":"2024-05-30T16:49:03.540598+0000","last_became_peered":"2024-05-30T16:49:03.540598+0000","last_unstale":"2024-05-30T16:49:05.533840+0000","last_undegraded":"2024-05-30T16:49:05.533840+0000","last_fullsized":"2024-05-30T16:49:05.533840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:45.462713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051841+0000","last_change":"2024-05-30T16:49:04.542032+0000","last_active":"2024-05-30T16:49:06.051841+0000","last_peered":"2024-05-30T16:49:06.051841+0000","last_clean":"2024-05-30T16:49:06.051841+0000","last_became_active":"2024-05-30T16:49:04.541750+0000","last_became_peered":"2024-05-30T16:49:04.541750+0000","last_unstale":"2024-05-30T16:49:06.051841+0000","last_undegraded":"2024-05-30T16:49:06.051841+0000","last_fullsized":"2024-05-30T16:49:06.051841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:31:44.761430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052980+0000","last_change":"2024-05-30T16:49:03.537811+0000","last_active":"2024-05-30T16:49:06.052980+0000","last_peered":"2024-05-30T16:49:06.052980+0000","last_clean":"2024-05-30T16:49:06.052980+0000","last_became_active":"2024-05-30T16:49:03.537468+0000","last_became_peered":"2024-05-30T16:49:03.537468+0000","last_unstale":"2024-05-30T16:49:06.052980+0000","last_undegraded":"2024-05-30T16:49:06.052980+0000","last_fullsized":"2024-05-30T16:49:06.052980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534607+0000","last_change":"2024-05-30T16:49:04.548049+0000","last_active":"2024-05-30T16:49:05.534607+0000","last_peered":"2024-05-30T16:49:05.534607+0000","last_clean":"2024-05-30T16:49:05.534607+0000","last_became_active":"2024-05-30T16:49:04.547483+0000","last_became_peered":"2024-05-30T16:49:04.547483+0000","last_unstale":"2024-05-30T16:49:05.534607+0000","last_undegraded":"2024-05-30T16:49:05.534607+0000","last_fullsized":"2024-05-30T16:49:05.534607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:39.816197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053012+0000","last_change":"2024-05-30T16:49:03.542201+0000","last_active":"2024-05-30T16:49:06.053012+0000","last_peered":"2024-05-30T16:49:06.053012+0000","last_clean":"2024-05-30T16:49:06.053012+0000","last_became_active":"2024-05-30T16:49:03.541172+0000","last_became_peered":"2024-05-30T16:49:03.541172+0000","last_unstale":"2024-05-30T16:49:06.053012+0000","last_undegraded":"2024-05-30T16:49:06.053012+0000","last_fullsized":"2024-05-30T16:49:06.053012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:21:15.090452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052243+0000","last_change":"2024-05-30T16:49:04.540546+0000","last_active":"2024-05-30T16:49:06.052243+0000","last_peered":"2024-05-30T16:49:06.052243+0000","last_clean":"2024-05-30T16:49:06.052243+0000","last_became_active":"2024-05-30T16:49:04.539786+0000","last_became_peered":"2024-05-30T16:49:04.539786+0000","last_unstale":"2024-05-30T16:49:06.052243+0000","last_undegraded":"2024-05-30T16:49:06.052243+0000","last_fullsized":"2024-05-30T16:49:06.052243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:53:12.385144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051634+0000","last_change":"2024-05-30T16:49:03.542403+0000","last_active":"2024-05-30T16:49:06.051634+0000","last_peered":"2024-05-30T16:49:06.051634+0000","last_clean":"2024-05-30T16:49:06.051634+0000","last_became_active":"2024-05-30T16:49:03.535558+0000","last_became_peered":"2024-05-30T16:49:03.535558+0000","last_unstale":"2024-05-30T16:49:06.051634+0000","last_undegraded":"2024-05-30T16:49:06.051634+0000","last_fullsized":"2024-05-30T16:49:06.051634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:50:44.488767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051231+0000","last_change":"2024-05-30T16:49:04.543912+0000","last_active":"2024-05-30T16:49:06.051231+0000","last_peered":"2024-05-30T16:49:06.051231+0000","last_clean":"2024-05-30T16:49:06.051231+0000","last_became_active":"2024-05-30T16:49:04.543548+0000","last_became_peered":"2024-05-30T16:49:04.543548+0000","last_unstale":"2024-05-30T16:49:06.051231+0000","last_undegraded":"2024-05-30T16:49:06.051231+0000","last_fullsized":"2024-05-30T16:49:06.051231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:46.470731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534423+0000","last_change":"2024-05-30T16:49:03.533929+0000","last_active":"2024-05-30T16:49:05.534423+0000","last_peered":"2024-05-30T16:49:05.534423+0000","last_clean":"2024-05-30T16:49:05.534423+0000","last_became_active":"2024-05-30T16:49:03.533583+0000","last_became_peered":"2024-05-30T16:49:03.533583+0000","last_unstale":"2024-05-30T16:49:05.534423+0000","last_undegraded":"2024-05-30T16:49:05.534423+0000","last_fullsized":"2024-05-30T16:49:05.534423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052365+0000","last_change":"2024-05-30T16:49:04.550074+0000","last_active":"2024-05-30T16:49:06.052365+0000","last_peered":"2024-05-30T16:49:06.052365+0000","last_clean":"2024-05-30T16:49:06.052365+0000","last_became_active":"2024-05-30T16:49:04.549701+0000","last_became_peered":"2024-05-30T16:49:04.549701+0000","last_unstale":"2024-05-30T16:49:06.052365+0000","last_undegraded":"2024-05-30T16:49:06.052365+0000","last_fullsized":"2024-05-30T16:49:06.052365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:45:42.077957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052757+0000","last_change":"2024-05-30T16:49:03.533071+0000","last_active":"2024-05-30T16:49:06.052757+0000","last_peered":"2024-05-30T16:49:06.052757+0000","last_clean":"2024-05-30T16:49:06.052757+0000","last_became_active":"2024-05-30T16:49:03.532744+0000","last_became_peered":"2024-05-30T16:49:03.532744+0000","last_unstale":"2024-05-30T16:49:06.052757+0000","last_undegraded":"2024-05-30T16:49:06.052757+0000","last_fullsized":"2024-05-30T16:49:06.052757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:51:21.137153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052564+0000","last_change":"2024-05-30T16:49:04.546980+0000","last_active":"2024-05-30T16:49:06.052564+0000","last_peered":"2024-05-30T16:49:06.052564+0000","last_clean":"2024-05-30T16:49:06.052564+0000","last_became_active":"2024-05-30T16:49:04.546205+0000","last_became_peered":"2024-05-30T16:49:04.546205+0000","last_unstale":"2024-05-30T16:49:06.052564+0000","last_undegraded":"2024-05-30T16:49:06.052564+0000","last_fullsized":"2024-05-30T16:49:06.052564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.529988+0000","last_change":"2024-05-30T16:49:03.543445+0000","last_active":"2024-05-30T16:49:05.529988+0000","last_peered":"2024-05-30T16:49:05.529988+0000","last_clean":"2024-05-30T16:49:05.529988+0000","last_became_active":"2024-05-30T16:49:03.543068+0000","last_became_peered":"2024-05-30T16:49:03.543068+0000","last_unstale":"2024-05-30T16:49:05.529988+0000","last_undegraded":"2024-05-30T16:49:05.529988+0000","last_fullsized":"2024-05-30T16:49:05.529988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:51:21.137153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052327+0000","last_change":"2024-05-30T16:49:04.553768+0000","last_active":"2024-05-30T16:49:06.052327+0000","last_peered":"2024-05-30T16:49:06.052327+0000","last_clean":"2024-05-30T16:49:06.052327+0000","last_became_active":"2024-05-30T16:49:04.550850+0000","last_became_peered":"2024-05-30T16:49:04.550850+0000","last_unstale":"2024-05-30T16:49:06.052327+0000","last_undegraded":"2024-05-30T16:49:06.052327+0000","last_fullsized":"2024-05-30T16:49:06.052327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:55.007207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534287+0000","last_change":"2024-05-30T16:49:03.549177+0000","last_active":"2024-05-30T16:49:05.534287+0000","last_peered":"2024-05-30T16:49:05.534287+0000","last_clean":"2024-05-30T16:49:05.534287+0000","last_became_active":"2024-05-30T16:49:03.548803+0000","last_became_peered":"2024-05-30T16:49:03.548803+0000","last_unstale":"2024-05-30T16:49:05.534287+0000","last_undegraded":"2024-05-30T16:49:05.534287+0000","last_fullsized":"2024-05-30T16:49:05.534287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:28:50.120091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052450+0000","last_change":"2024-05-30T16:49:04.552000+0000","last_active":"2024-05-30T16:49:06.052450+0000","last_peered":"2024-05-30T16:49:06.052450+0000","last_clean":"2024-05-30T16:49:06.052450+0000","last_became_active":"2024-05-30T16:49:04.551392+0000","last_became_peered":"2024-05-30T16:49:04.551392+0000","last_unstale":"2024-05-30T16:49:06.052450+0000","last_undegraded":"2024-05-30T16:49:06.052450+0000","last_fullsized":"2024-05-30T16:49:06.052450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:59.487481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530211+0000","last_change":"2024-05-30T16:49:03.548846+0000","last_active":"2024-05-30T16:49:05.530211+0000","last_peered":"2024-05-30T16:49:05.530211+0000","last_clean":"2024-05-30T16:49:05.530211+0000","last_became_active":"2024-05-30T16:49:03.547182+0000","last_became_peered":"2024-05-30T16:49:03.547182+0000","last_unstale":"2024-05-30T16:49:05.530211+0000","last_undegraded":"2024-05-30T16:49:05.530211+0000","last_fullsized":"2024-05-30T16:49:05.530211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052721+0000","last_change":"2024-05-30T16:49:04.558273+0000","last_active":"2024-05-30T16:49:06.052721+0000","last_peered":"2024-05-30T16:49:06.052721+0000","last_clean":"2024-05-30T16:49:06.052721+0000","last_became_active":"2024-05-30T16:49:04.557860+0000","last_became_peered":"2024-05-30T16:49:04.557860+0000","last_unstale":"2024-05-30T16:49:06.052721+0000","last_undegraded":"2024-05-30T16:49:06.052721+0000","last_fullsized":"2024-05-30T16:49:06.052721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:20.040027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053015+0000","last_change":"2024-05-30T16:49:03.532399+0000","last_active":"2024-05-30T16:49:06.053015+0000","last_peered":"2024-05-30T16:49:06.053015+0000","last_clean":"2024-05-30T16:49:06.053015+0000","last_became_active":"2024-05-30T16:49:03.529396+0000","last_became_peered":"2024-05-30T16:49:03.529396+0000","last_unstale":"2024-05-30T16:49:06.053015+0000","last_undegraded":"2024-05-30T16:49:06.053015+0000","last_fullsized":"2024-05-30T16:49:06.053015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:18.318116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534179+0000","last_change":"2024-05-30T16:49:04.549628+0000","last_active":"2024-05-30T16:49:05.534179+0000","last_peered":"2024-05-30T16:49:05.534179+0000","last_clean":"2024-05-30T16:49:05.534179+0000","last_became_active":"2024-05-30T16:49:04.548782+0000","last_became_peered":"2024-05-30T16:49:04.548782+0000","last_unstale":"2024-05-30T16:49:05.534179+0000","last_undegraded":"2024-05-30T16:49:05.534179+0000","last_fullsized":"2024-05-30T16:49:05.534179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:55.007207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530197+0000","last_change":"2024-05-30T16:49:03.540089+0000","last_active":"2024-05-30T16:49:05.530197+0000","last_peered":"2024-05-30T16:49:05.530197+0000","last_clean":"2024-05-30T16:49:05.530197+0000","last_became_active":"2024-05-30T16:49:03.539760+0000","last_became_peered":"2024-05-30T16:49:03.539760+0000","last_unstale":"2024-05-30T16:49:05.530197+0000","last_undegraded":"2024-05-30T16:49:05.530197+0000","last_fullsized":"2024-05-30T16:49:05.530197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:21:15.090452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052910+0000","last_change":"2024-05-30T16:49:04.555284+0000","last_active":"2024-05-30T16:49:06.052910+0000","last_peered":"2024-05-30T16:49:06.052910+0000","last_clean":"2024-05-30T16:49:06.052910+0000","last_became_active":"2024-05-30T16:49:04.555022+0000","last_became_peered":"2024-05-30T16:49:04.555022+0000","last_unstale":"2024-05-30T16:49:06.052910+0000","last_undegraded":"2024-05-30T16:49:06.052910+0000","last_fullsized":"2024-05-30T16:49:06.052910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:42.707877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052217+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:49:06.052217+0000","last_peered":"2024-05-30T16:49:06.052217+0000","last_clean":"2024-05-30T16:49:06.052217+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:49:06.052217+0000","last_undegraded":"2024-05-30T16:49:06.052217+0000","last_fullsized":"2024-05-30T16:49:06.052217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533284+0000","last_change":"2024-05-30T16:49:03.536755+0000","last_active":"2024-05-30T16:49:05.533284+0000","last_peered":"2024-05-30T16:49:05.533284+0000","last_clean":"2024-05-30T16:49:05.533284+0000","last_became_active":"2024-05-30T16:49:03.536335+0000","last_became_peered":"2024-05-30T16:49:03.536335+0000","last_unstale":"2024-05-30T16:49:05.533284+0000","last_undegraded":"2024-05-30T16:49:05.533284+0000","last_fullsized":"2024-05-30T16:49:05.533284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051447+0000","last_change":"2024-05-30T16:49:04.546603+0000","last_active":"2024-05-30T16:49:06.051447+0000","last_peered":"2024-05-30T16:49:06.051447+0000","last_clean":"2024-05-30T16:49:06.051447+0000","last_became_active":"2024-05-30T16:49:04.545130+0000","last_became_peered":"2024-05-30T16:49:04.545130+0000","last_unstale":"2024-05-30T16:49:06.051447+0000","last_undegraded":"2024-05-30T16:49:06.051447+0000","last_fullsized":"2024-05-30T16:49:06.051447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:47.404454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052089+0000","last_change":"2024-05-30T16:49:03.548756+0000","last_active":"2024-05-30T16:49:06.052089+0000","last_peered":"2024-05-30T16:49:06.052089+0000","last_clean":"2024-05-30T16:49:06.052089+0000","last_became_active":"2024-05-30T16:49:03.548431+0000","last_became_peered":"2024-05-30T16:49:03.548431+0000","last_unstale":"2024-05-30T16:49:06.052089+0000","last_undegraded":"2024-05-30T16:49:06.052089+0000","last_fullsized":"2024-05-30T16:49:06.052089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051661+0000","last_change":"2024-05-30T16:49:04.557247+0000","last_active":"2024-05-30T16:49:06.051661+0000","last_peered":"2024-05-30T16:49:06.051661+0000","last_clean":"2024-05-30T16:49:06.051661+0000","last_became_active":"2024-05-30T16:49:04.556957+0000","last_became_peered":"2024-05-30T16:49:04.556957+0000","last_unstale":"2024-05-30T16:49:06.051661+0000","last_undegraded":"2024-05-30T16:49:06.051661+0000","last_fullsized":"2024-05-30T16:49:06.051661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:22.231726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.530057+0000","last_change":"2024-05-30T16:49:03.548449+0000","last_active":"2024-05-30T16:49:05.530057+0000","last_peered":"2024-05-30T16:49:05.530057+0000","last_clean":"2024-05-30T16:49:05.530057+0000","last_became_active":"2024-05-30T16:49:03.547447+0000","last_became_peered":"2024-05-30T16:49:03.547447+0000","last_unstale":"2024-05-30T16:49:05.530057+0000","last_undegraded":"2024-05-30T16:49:05.530057+0000","last_fullsized":"2024-05-30T16:49:05.530057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:39:09.796452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052694+0000","last_change":"2024-05-30T16:49:04.535009+0000","last_active":"2024-05-30T16:49:06.052694+0000","last_peered":"2024-05-30T16:49:06.052694+0000","last_clean":"2024-05-30T16:49:06.052694+0000","last_became_active":"2024-05-30T16:49:04.534615+0000","last_became_peered":"2024-05-30T16:49:04.534615+0000","last_unstale":"2024-05-30T16:49:06.052694+0000","last_undegraded":"2024-05-30T16:49:06.052694+0000","last_fullsized":"2024-05-30T16:49:06.052694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:02.269306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534481+0000","last_change":"2024-05-30T16:49:03.526029+0000","last_active":"2024-05-30T16:49:05.534481+0000","last_peered":"2024-05-30T16:49:05.534481+0000","last_clean":"2024-05-30T16:49:05.534481+0000","last_became_active":"2024-05-30T16:49:03.525606+0000","last_became_peered":"2024-05-30T16:49:03.525606+0000","last_unstale":"2024-05-30T16:49:05.534481+0000","last_undegraded":"2024-05-30T16:49:05.534481+0000","last_fullsized":"2024-05-30T16:49:05.534481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:06:01.302283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533778+0000","last_change":"2024-05-30T16:49:04.553469+0000","last_active":"2024-05-30T16:49:05.533778+0000","last_peered":"2024-05-30T16:49:05.533778+0000","last_clean":"2024-05-30T16:49:05.533778+0000","last_became_active":"2024-05-30T16:49:04.551873+0000","last_became_peered":"2024-05-30T16:49:04.551873+0000","last_unstale":"2024-05-30T16:49:05.533778+0000","last_undegraded":"2024-05-30T16:49:05.533778+0000","last_fullsized":"2024-05-30T16:49:05.533778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:15.394210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052860+0000","last_change":"2024-05-30T16:49:03.537420+0000","last_active":"2024-05-30T16:49:06.052860+0000","last_peered":"2024-05-30T16:49:06.052860+0000","last_clean":"2024-05-30T16:49:06.052860+0000","last_became_active":"2024-05-30T16:49:03.536674+0000","last_became_peered":"2024-05-30T16:49:03.536674+0000","last_unstale":"2024-05-30T16:49:06.052860+0000","last_undegraded":"2024-05-30T16:49:06.052860+0000","last_fullsized":"2024-05-30T16:49:06.052860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534511+0000","last_change":"2024-05-30T16:49:04.557070+0000","last_active":"2024-05-30T16:49:05.534511+0000","last_peered":"2024-05-30T16:49:05.534511+0000","last_clean":"2024-05-30T16:49:05.534511+0000","last_became_active":"2024-05-30T16:49:04.556515+0000","last_became_peered":"2024-05-30T16:49:04.556515+0000","last_unstale":"2024-05-30T16:49:05.534511+0000","last_undegraded":"2024-05-30T16:49:05.534511+0000","last_fullsized":"2024-05-30T16:49:05.534511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:00.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052919+0000","last_change":"2024-05-30T16:49:03.551865+0000","last_active":"2024-05-30T16:49:06.052919+0000","last_peered":"2024-05-30T16:49:06.052919+0000","last_clean":"2024-05-30T16:49:06.052919+0000","last_became_active":"2024-05-30T16:49:03.551582+0000","last_became_peered":"2024-05-30T16:49:03.551582+0000","last_unstale":"2024-05-30T16:49:06.052919+0000","last_undegraded":"2024-05-30T16:49:06.052919+0000","last_fullsized":"2024-05-30T16:49:06.052919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:53:44.885507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052808+0000","last_change":"2024-05-30T16:49:04.537297+0000","last_active":"2024-05-30T16:49:06.052808+0000","last_peered":"2024-05-30T16:49:06.052808+0000","last_clean":"2024-05-30T16:49:06.052808+0000","last_became_active":"2024-05-30T16:49:04.535219+0000","last_became_peered":"2024-05-30T16:49:04.535219+0000","last_unstale":"2024-05-30T16:49:06.052808+0000","last_undegraded":"2024-05-30T16:49:06.052808+0000","last_fullsized":"2024-05-30T16:49:06.052808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053097+0000","last_change":"2024-05-30T16:49:03.534738+0000","last_active":"2024-05-30T16:49:06.053097+0000","last_peered":"2024-05-30T16:49:06.053097+0000","last_clean":"2024-05-30T16:49:06.053097+0000","last_became_active":"2024-05-30T16:49:03.534350+0000","last_became_peered":"2024-05-30T16:49:03.534350+0000","last_unstale":"2024-05-30T16:49:06.053097+0000","last_undegraded":"2024-05-30T16:49:06.053097+0000","last_fullsized":"2024-05-30T16:49:06.053097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052135+0000","last_change":"2024-05-30T16:49:04.544633+0000","last_active":"2024-05-30T16:49:06.052135+0000","last_peered":"2024-05-30T16:49:06.052135+0000","last_clean":"2024-05-30T16:49:06.052135+0000","last_became_active":"2024-05-30T16:49:04.544348+0000","last_became_peered":"2024-05-30T16:49:04.544348+0000","last_unstale":"2024-05-30T16:49:06.052135+0000","last_undegraded":"2024-05-30T16:49:06.052135+0000","last_fullsized":"2024-05-30T16:49:06.052135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:09.918803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.053285+0000","last_change":"2024-05-30T16:49:03.547123+0000","last_active":"2024-05-30T16:49:06.053285+0000","last_peered":"2024-05-30T16:49:06.053285+0000","last_clean":"2024-05-30T16:49:06.053285+0000","last_became_active":"2024-05-30T16:49:03.546748+0000","last_became_peered":"2024-05-30T16:49:03.546748+0000","last_unstale":"2024-05-30T16:49:06.053285+0000","last_undegraded":"2024-05-30T16:49:06.053285+0000","last_fullsized":"2024-05-30T16:49:06.053285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051720+0000","last_change":"2024-05-30T16:49:04.536325+0000","last_active":"2024-05-30T16:49:06.051720+0000","last_peered":"2024-05-30T16:49:06.051720+0000","last_clean":"2024-05-30T16:49:06.051720+0000","last_became_active":"2024-05-30T16:49:04.535456+0000","last_became_peered":"2024-05-30T16:49:04.535456+0000","last_unstale":"2024-05-30T16:49:06.051720+0000","last_undegraded":"2024-05-30T16:49:06.051720+0000","last_fullsized":"2024-05-30T16:49:06.051720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051841+0000","last_change":"2024-05-30T16:49:03.551302+0000","last_active":"2024-05-30T16:49:06.051841+0000","last_peered":"2024-05-30T16:49:06.051841+0000","last_clean":"2024-05-30T16:49:06.051841+0000","last_became_active":"2024-05-30T16:49:03.551084+0000","last_became_peered":"2024-05-30T16:49:03.551084+0000","last_unstale":"2024-05-30T16:49:06.051841+0000","last_undegraded":"2024-05-30T16:49:06.051841+0000","last_fullsized":"2024-05-30T16:49:06.051841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:48.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.533890+0000","last_change":"2024-05-30T16:49:04.548525+0000","last_active":"2024-05-30T16:49:05.533890+0000","last_peered":"2024-05-30T16:49:05.533890+0000","last_clean":"2024-05-30T16:49:05.533890+0000","last_became_active":"2024-05-30T16:49:04.548054+0000","last_became_peered":"2024-05-30T16:49:04.548054+0000","last_unstale":"2024-05-30T16:49:05.533890+0000","last_undegraded":"2024-05-30T16:49:05.533890+0000","last_fullsized":"2024-05-30T16:49:05.533890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:49.724960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052859+0000","last_change":"2024-05-30T16:49:03.546920+0000","last_active":"2024-05-30T16:49:06.052859+0000","last_peered":"2024-05-30T16:49:06.052859+0000","last_clean":"2024-05-30T16:49:06.052859+0000","last_became_active":"2024-05-30T16:49:03.545621+0000","last_became_peered":"2024-05-30T16:49:03.545621+0000","last_unstale":"2024-05-30T16:49:06.052859+0000","last_undegraded":"2024-05-30T16:49:06.052859+0000","last_fullsized":"2024-05-30T16:49:06.052859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:14.386191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051851+0000","last_change":"2024-05-30T16:49:04.535297+0000","last_active":"2024-05-30T16:49:06.051851+0000","last_peered":"2024-05-30T16:49:06.051851+0000","last_clean":"2024-05-30T16:49:06.051851+0000","last_became_active":"2024-05-30T16:49:04.534907+0000","last_became_peered":"2024-05-30T16:49:04.534907+0000","last_unstale":"2024-05-30T16:49:06.051851+0000","last_undegraded":"2024-05-30T16:49:06.051851+0000","last_fullsized":"2024-05-30T16:49:06.051851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:56.163039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052768+0000","last_change":"2024-05-30T16:49:03.536690+0000","last_active":"2024-05-30T16:49:06.052768+0000","last_peered":"2024-05-30T16:49:06.052768+0000","last_clean":"2024-05-30T16:49:06.052768+0000","last_became_active":"2024-05-30T16:49:03.536351+0000","last_became_peered":"2024-05-30T16:49:03.536351+0000","last_unstale":"2024-05-30T16:49:06.052768+0000","last_undegraded":"2024-05-30T16:49:06.052768+0000","last_fullsized":"2024-05-30T16:49:06.052768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:10.461426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051567+0000","last_change":"2024-05-30T16:49:04.556339+0000","last_active":"2024-05-30T16:49:06.051567+0000","last_peered":"2024-05-30T16:49:06.051567+0000","last_clean":"2024-05-30T16:49:06.051567+0000","last_became_active":"2024-05-30T16:49:04.556012+0000","last_became_peered":"2024-05-30T16:49:04.556012+0000","last_unstale":"2024-05-30T16:49:06.051567+0000","last_undegraded":"2024-05-30T16:49:06.051567+0000","last_fullsized":"2024-05-30T16:49:06.051567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:23.369792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052569+0000","last_change":"2024-05-30T16:49:03.550153+0000","last_active":"2024-05-30T16:49:06.052569+0000","last_peered":"2024-05-30T16:49:06.052569+0000","last_clean":"2024-05-30T16:49:06.052569+0000","last_became_active":"2024-05-30T16:49:03.549872+0000","last_became_peered":"2024-05-30T16:49:03.549872+0000","last_unstale":"2024-05-30T16:49:06.052569+0000","last_undegraded":"2024-05-30T16:49:06.052569+0000","last_fullsized":"2024-05-30T16:49:06.052569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:58.145285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052911+0000","last_change":"2024-05-30T16:49:04.558227+0000","last_active":"2024-05-30T16:49:06.052911+0000","last_peered":"2024-05-30T16:49:06.052911+0000","last_clean":"2024-05-30T16:49:06.052911+0000","last_became_active":"2024-05-30T16:49:04.557978+0000","last_became_peered":"2024-05-30T16:49:04.557978+0000","last_unstale":"2024-05-30T16:49:06.052911+0000","last_undegraded":"2024-05-30T16:49:06.052911+0000","last_fullsized":"2024-05-30T16:49:06.052911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:35.589654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534339+0000","last_change":"2024-05-30T16:49:04.561331+0000","last_active":"2024-05-30T16:49:05.534339+0000","last_peered":"2024-05-30T16:49:05.534339+0000","last_clean":"2024-05-30T16:49:05.534339+0000","last_became_active":"2024-05-30T16:49:04.560894+0000","last_became_peered":"2024-05-30T16:49:04.560894+0000","last_unstale":"2024-05-30T16:49:05.534339+0000","last_undegraded":"2024-05-30T16:49:05.534339+0000","last_fullsized":"2024-05-30T16:49:05.534339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:45:42.077957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052112+0000","last_change":"2024-05-30T16:49:03.549087+0000","last_active":"2024-05-30T16:49:06.052112+0000","last_peered":"2024-05-30T16:49:06.052112+0000","last_clean":"2024-05-30T16:49:06.052112+0000","last_became_active":"2024-05-30T16:49:03.548736+0000","last_became_peered":"2024-05-30T16:49:03.548736+0000","last_unstale":"2024-05-30T16:49:06.052112+0000","last_undegraded":"2024-05-30T16:49:06.052112+0000","last_fullsized":"2024-05-30T16:49:06.052112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:38.808178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:05.534726+0000","last_change":"2024-05-30T16:49:04.561436+0000","last_active":"2024-05-30T16:49:05.534726+0000","last_peered":"2024-05-30T16:49:05.534726+0000","last_clean":"2024-05-30T16:49:05.534726+0000","last_became_active":"2024-05-30T16:49:04.561159+0000","last_became_peered":"2024-05-30T16:49:04.561159+0000","last_unstale":"2024-05-30T16:49:05.534726+0000","last_undegraded":"2024-05-30T16:49:05.534726+0000","last_fullsized":"2024-05-30T16:49:05.534726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:47:24.068734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052643+0000","last_change":"2024-05-30T16:49:03.552644+0000","last_active":"2024-05-30T16:49:06.052643+0000","last_peered":"2024-05-30T16:49:06.052643+0000","last_clean":"2024-05-30T16:49:06.052643+0000","last_became_active":"2024-05-30T16:49:03.552304+0000","last_became_peered":"2024-05-30T16:49:03.552304+0000","last_unstale":"2024-05-30T16:49:06.052643+0000","last_undegraded":"2024-05-30T16:49:06.052643+0000","last_fullsized":"2024-05-30T16:49:06.052643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:46:18.318116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051834+0000","last_change":"2024-05-30T16:49:04.542732+0000","last_active":"2024-05-30T16:49:06.051834+0000","last_peered":"2024-05-30T16:49:06.051834+0000","last_clean":"2024-05-30T16:49:06.051834+0000","last_became_active":"2024-05-30T16:49:04.542400+0000","last_became_peered":"2024-05-30T16:49:04.542400+0000","last_unstale":"2024-05-30T16:49:06.051834+0000","last_undegraded":"2024-05-30T16:49:06.051834+0000","last_fullsized":"2024-05-30T16:49:06.051834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:02.149875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052111+0000","last_change":"2024-05-30T16:49:03.546038+0000","last_active":"2024-05-30T16:49:06.052111+0000","last_peered":"2024-05-30T16:49:06.052111+0000","last_clean":"2024-05-30T16:49:06.052111+0000","last_became_active":"2024-05-30T16:49:03.545623+0000","last_became_peered":"2024-05-30T16:49:03.545623+0000","last_unstale":"2024-05-30T16:49:06.052111+0000","last_undegraded":"2024-05-30T16:49:06.052111+0000","last_fullsized":"2024-05-30T16:49:06.052111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:40.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.052052+0000","last_change":"2024-05-30T16:49:04.546841+0000","last_active":"2024-05-30T16:49:06.052052+0000","last_peered":"2024-05-30T16:49:06.052052+0000","last_clean":"2024-05-30T16:49:06.052052+0000","last_became_active":"2024-05-30T16:49:04.546596+0000","last_became_peered":"2024-05-30T16:49:04.546596+0000","last_unstale":"2024-05-30T16:49:06.052052+0000","last_undegraded":"2024-05-30T16:49:06.052052+0000","last_fullsized":"2024-05-30T16:49:06.052052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:03.506009+0000","last_clean_scrub_stamp":"2024-05-30T16:49:03.506009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:06.186315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-30T16:49:06.051977+0000","last_change":"2024-05-30T16:49:03.551604+0000","last_active":"2024-05-30T16:49:06.051977+0000","last_peered":"2024-05-30T16:49:06.051977+0000","last_clean":"2024-05-30T16:49:06.051977+0000","last_became_active":"2024-05-30T16:49:03.551333+0000","last_became_peered":"2024-05-30T16:49:03.551333+0000","last_unstale":"2024-05-30T16:49:06.051977+0000","last_undegraded":"2024-05-30T16:49:06.051977+0000","last_fullsized":"2024-05-30T16:49:06.051977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:02.497990+0000","last_clean_scrub_stamp":"2024-05-30T16:49:02.497990+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:23.050556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":81081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":671961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:49:16.607 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:49:16.607 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-30T16:49:16.608 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-30T16:49:16.608 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-30T16:49:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.782+0000 7f0dd9800640 1 Processor -- start 2024-05-30T16:49:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.782+0000 7f0dd9800640 1 -- start start 2024-05-30T16:49:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.782+0000 7f0dd9800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd415f690 0x7f0dd40b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.782+0000 7f0dd9800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dd406de10 con 0x7f0dd406f8c0 2024-05-30T16:49:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.782+0000 7f0dd9800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dd406e0f0 con 0x7f0dd41558e0 2024-05-30T16:49:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.782+0000 7f0dd9800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd406e3d0 con 0x7f0dd415f690 2024-05-30T16:49:16.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.782+0000 7f0dd3400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0dd406f8c0 0x7f0dd40b46b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40176/0 (socket says 172.21.15.59:40176) 2024-05-30T16:49:16.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.782+0000 7f0dd3400640 1 -- 172.21.15.59:0/493856598 learned_addr learned my addr 172.21.15.59:0/493856598 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dca000640 1 --2- 172.21.15.59:0/493856598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd415f690 0x7f0dd40b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1401584835 0 0) 0x7f0dd406de10 con 0x7f0dd406f8c0 2024-05-30T16:49:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0db8003530 con 0x7f0dd406f8c0 2024-05-30T16:49:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3324617229 0 0) 0x7f0db8003530 con 0x7f0dd406f8c0 2024-05-30T16:49:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd415f690 msgr2=0x7f0dd40b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 --2- 172.21.15.59:0/493856598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd415f690 0x7f0dd40b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 >> v1:172.21.15.107:6789/0 conn(0x7f0dd41558e0 legacy=0x7f0dd415ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd406e6b0 con 0x7f0dd406f8c0 2024-05-30T16:49:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f0dcc001680 con 0x7f0dd406f8c0 2024-05-30T16:49:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 >> v1:172.21.15.59:6789/0 conn(0x7f0dd406f8c0 legacy=0x7f0dd40b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 --2- 172.21.15.59:0/493856598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db80039f0 0x7f0db8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 --2- 172.21.15.59:0/493856598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd415f690 0x7f0db8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 --2- 172.21.15.59:0/493856598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0db8004d50 0x7f0db80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd406e3d0 con 0x7f0db80039f0 2024-05-30T16:49:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0db800b9d0 con 0x7f0db8004d50 2024-05-30T16:49:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0db800dde0 con 0x7f0dd415f690 2024-05-30T16:49:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2a00640 1 --2- 172.21.15.59:0/493856598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db80039f0 0x7f0db8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd3400640 1 --2- 172.21.15.59:0/493856598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0db8004d50 0x7f0db80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dca000640 1 --2- 172.21.15.59:0/493856598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd415f690 0x7f0db8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2a00640 1 -- 172.21.15.59:0/493856598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd415f690 msgr2=0x7f0db8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2a00640 1 --2- 172.21.15.59:0/493856598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd415f690 0x7f0db8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2a00640 1 -- 172.21.15.59:0/493856598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0db8004d50 msgr2=0x7f0db80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2a00640 1 --2- 172.21.15.59:0/493856598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0db8004d50 0x7f0db80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.786+0000 7f0dd2a00640 1 -- 172.21.15.59:0/493856598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db8003530 con 0x7f0db80039f0 2024-05-30T16:49:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd2a00640 1 --2- 172.21.15.59:0/493856598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db80039f0 0x7f0db8003dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4001f60 tx=0x7f0dc401c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307b38fb11c79e95 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4001b60 con 0x7f0db80039f0 2024-05-30T16:49:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dc40a66f0 con 0x7f0db80039f0 2024-05-30T16:49:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd2000640 1 -- 172.21.15.59:0/493856598 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40a6ae0 con 0x7f0db80039f0 2024-05-30T16:49:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 -- 172.21.15.59:0/493856598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db80039f0 msgr2=0x7f0db8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 --2- 172.21.15.59:0/493856598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db80039f0 0x7f0db8003dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4001f60 tx=0x7f0dc401c790 comp rx=0 tx=0).stop 2024-05-30T16:49:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd3400640 1 -- 172.21.15.59:0/493856598 reap_dead start 2024-05-30T16:49:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 -- 172.21.15.59:0/493856598 shutdown_connections 2024-05-30T16:49:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 -- 172.21.15.59:0/493856598 >> 172.21.15.59:0/493856598 conn(0x7f0dd4067d60 msgr2=0x7f0dd406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 -- 172.21.15.59:0/493856598 shutdown_connections 2024-05-30T16:49:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 -- 172.21.15.59:0/493856598 wait complete. 2024-05-30T16:49:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 Processor -- start 2024-05-30T16:49:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 -- start start 2024-05-30T16:49:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0db80039f0 0x7f0dd415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd415d000 0x7f0dd415d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd41fa970 0x7f0dd41fae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd4155cc0 con 0x7f0dd41fa970 2024-05-30T16:49:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd4070010 con 0x7f0dd415d000 2024-05-30T16:49:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.790+0000 7f0dd9800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd4155e40 con 0x7f0db80039f0 2024-05-30T16:49:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd41fa970 0x7f0dd41fae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd41fa970 0x7f0dd41fae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54482/0 (socket says 172.21.15.59:54482) 2024-05-30T16:49:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd3400640 1 -- 172.21.15.59:0/2253752106 learned_addr learned my addr 172.21.15.59:0/2253752106 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd2a00640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0db80039f0 0x7f0dd415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dca000640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd415d000 0x7f0dd415d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd3400640 1 -- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0db80039f0 msgr2=0x7f0dd415e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd3400640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0db80039f0 0x7f0dd415e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd3400640 1 -- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd415d000 msgr2=0x7f0dd415d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd3400640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd415d000 0x7f0dd415d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:16.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd3400640 1 -- 172.21.15.59:0/2253752106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd415d9c0 con 0x7f0dd41fa970 2024-05-30T16:49:16.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dca000640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd415d000 0x7f0dd415d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:16.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd3400640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd41fa970 0x7f0dd41fae20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc000c10 tx=0x7f0dcc004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:16.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dcb400640 1 -- 172.21.15.59:0/2253752106 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc00f660 con 0x7f0dd41fa970 2024-05-30T16:49:16.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dcb400640 1 -- 172.21.15.59:0/2253752106 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dcc018070 con 0x7f0dd41fa970 2024-05-30T16:49:16.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd9800640 1 -- 172.21.15.59:0/2253752106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd40b1010 con 0x7f0dd41fa970 2024-05-30T16:49:16.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dcb400640 1 -- 172.21.15.59:0/2253752106 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc00fa80 con 0x7f0dd41fa970 2024-05-30T16:49:16.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd9800640 1 -- 172.21.15.59:0/2253752106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd40b15d0 con 0x7f0dd41fa970 2024-05-30T16:49:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dd9800640 1 -- 172.21.15.59:0/2253752106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd4068a90 con 0x7f0dd41fa970 2024-05-30T16:49:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.794+0000 7f0dcb400640 1 -- 172.21.15.59:0/2253752106 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0dcc00fc20 con 0x7f0dd41fa970 2024-05-30T16:49:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.798+0000 7f0dcb400640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0db0068380 0x7f0db006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.798+0000 7f0dcb400640 1 -- 172.21.15.59:0/2253752106 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0dcc087240 con 0x7f0dd41fa970 2024-05-30T16:49:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.798+0000 7f0dd2a00640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0db0068380 0x7f0db006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.798+0000 7f0dd2a00640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0db0068380 0x7f0db006a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0dc40af000 tx=0x7f0dc40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:16.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.802+0000 7f0dcb400640 1 -- 172.21.15.59:0/2253752106 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0dcc057220 con 0x7f0dd41fa970 2024-05-30T16:49:17.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.998+0000 7f0dd9800640 1 -- 172.21.15.59:0/2253752106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0dd40b4850 con 0x7f0dd41fa970 2024-05-30T16:49:17.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:16.998+0000 7f0dcb400640 1 -- 172.21.15.59:0/2253752106 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0dcc05b520 con 0x7f0dd41fa970 2024-05-30T16:49:17.005 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:17.005 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-30T16:49:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.002+0000 7f0dd9800640 1 -- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0db0068380 msgr2=0x7f0db006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.002+0000 7f0dd9800640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0db0068380 0x7f0db006a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0dc40af000 tx=0x7f0dc40a7000 comp rx=0 tx=0).stop 2024-05-30T16:49:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.002+0000 7f0dd9800640 1 -- 172.21.15.59:0/2253752106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd41fa970 msgr2=0x7f0dd41fae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.002+0000 7f0dd9800640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd41fa970 0x7f0dd41fae20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc000c10 tx=0x7f0dcc004f90 comp rx=0 tx=0).stop 2024-05-30T16:49:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.002+0000 7f0dd9800640 1 -- 172.21.15.59:0/2253752106 shutdown_connections 2024-05-30T16:49:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.002+0000 7f0dd9800640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0db0068380 0x7f0db006a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.002+0000 7f0dd9800640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd41fa970 0x7f0dd41fae20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.002+0000 7f0dd9800640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd415d000 0x7f0dd415d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.002+0000 7f0dd9800640 1 --2- 172.21.15.59:0/2253752106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0db80039f0 0x7f0dd415e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.002+0000 7f0dd9800640 1 -- 172.21.15.59:0/2253752106 >> 172.21.15.59:0/2253752106 conn(0x7f0dd4067d60 msgr2=0x7f0dd41533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.002+0000 7f0dd9800640 1 -- 172.21.15.59:0/2253752106 shutdown_connections 2024-05-30T16:49:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.002+0000 7f0dd9800640 1 -- 172.21.15.59:0/2253752106 wait complete. 2024-05-30T16:49:17.027 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-30T16:49:17.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:17.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.162+0000 7f1c59a00640 1 Processor -- start 2024-05-30T16:49:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.162+0000 7f1c59a00640 1 -- start start 2024-05-30T16:49:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.162+0000 7f1c59a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5415ff30 0x7f1c54070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.162+0000 7f1c59a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c540b1ac0 0x7f1c54070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c59a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c54070bd0 con 0x7f1c54071280 2024-05-30T16:49:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c59a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1c54070e70 con 0x7f1c540b1ac0 2024-05-30T16:49:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c59a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1c54072020 con 0x7f1c5415ff30 2024-05-30T16:49:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c4be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c540b1ac0 0x7f1c54070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c53400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1c54071280 0x7f1c540ccdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40178/0 (socket says 172.21.15.59:40178) 2024-05-30T16:49:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c4be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c540b1ac0 0x7f1c54070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54494/0 (socket says 172.21.15.59:54494) 2024-05-30T16:49:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c53400640 1 -- 172.21.15.59:0/427587911 learned_addr learned my addr 172.21.15.59:0/427587911 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c52a00640 1 --2- 172.21.15.59:0/427587911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5415ff30 0x7f1c54070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c4be00640 1 -- 172.21.15.59:0/427587911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5415ff30 msgr2=0x7f1c54070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c4be00640 1 --2- 172.21.15.59:0/427587911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5415ff30 0x7f1c54070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c4be00640 1 -- 172.21.15.59:0/427587911 >> v1:172.21.15.59:6789/0 conn(0x7f1c54071280 legacy=0x7f1c540ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c4be00640 1 -- 172.21.15.59:0/427587911 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c54071cd0 con 0x7f1c540b1ac0 2024-05-30T16:49:17.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c4be00640 1 --2- 172.21.15.59:0/427587911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c540b1ac0 0x7f1c54070540 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0097c0 tx=0x7f1c3c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d538a993a179a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c52000640 1 -- 172.21.15.59:0/427587911 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0b0070 con 0x7f1c540b1ac0 2024-05-30T16:49:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c52000640 1 -- 172.21.15.59:0/427587911 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3c0ab600 con 0x7f1c540b1ac0 2024-05-30T16:49:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.166+0000 7f1c52000640 1 -- 172.21.15.59:0/427587911 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0ab9d0 con 0x7f1c540b1ac0 2024-05-30T16:49:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 -- 172.21.15.59:0/427587911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c540b1ac0 msgr2=0x7f1c54070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 --2- 172.21.15.59:0/427587911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c540b1ac0 0x7f1c54070540 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0097c0 tx=0x7f1c3c01c410 comp rx=0 tx=0).stop 2024-05-30T16:49:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 -- 172.21.15.59:0/427587911 shutdown_connections 2024-05-30T16:49:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 --2- 172.21.15.59:0/427587911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c540b1ac0 0x7f1c54070540 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 --2- 172.21.15.59:0/427587911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5415ff30 0x7f1c54070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 -- 172.21.15.59:0/427587911 >> 172.21.15.59:0/427587911 conn(0x7f1c540b3f70 msgr2=0x7f1c540b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 -- 172.21.15.59:0/427587911 shutdown_connections 2024-05-30T16:49:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 -- 172.21.15.59:0/427587911 wait complete. 2024-05-30T16:49:17.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 Processor -- start 2024-05-30T16:49:17.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 -- start start 2024-05-30T16:49:17.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c54071280 0x7f1c5414b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c540b1ac0 0x7f1c540af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5415ff30 0x7f1c540b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1c54169870 con 0x7f1c5415ff30 2024-05-30T16:49:17.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541696f0 con 0x7f1c54071280 2024-05-30T16:49:17.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c59a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1c541699f0 con 0x7f1c540b1ac0 2024-05-30T16:49:17.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c53400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5415ff30 0x7f1c540b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c53400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5415ff30 0x7f1c540b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54496/0 (socket says 172.21.15.59:54496) 2024-05-30T16:49:17.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c53400640 1 -- 172.21.15.59:0/1507110405 learned_addr learned my addr 172.21.15.59:0/1507110405 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:17.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c52a00640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c54071280 0x7f1c5414b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c4be00640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c540b1ac0 0x7f1c540af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c53400640 1 -- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c540b1ac0 msgr2=0x7f1c540af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c53400640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c540b1ac0 0x7f1c540af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c53400640 1 -- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c54071280 msgr2=0x7f1c5414b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c53400640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c54071280 0x7f1c5414b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c53400640 1 -- 172.21.15.59:0/1507110405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5414c1e0 con 0x7f1c5415ff30 2024-05-30T16:49:17.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.170+0000 7f1c52a00640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c54071280 0x7f1c5414b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:17.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.174+0000 7f1c53400640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5415ff30 0x7f1c540b2f30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00ca80 tx=0x7f1c4c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:17.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.174+0000 7f1c4aa00640 1 -- 172.21.15.59:0/1507110405 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c017070 con 0x7f1c5415ff30 2024-05-30T16:49:17.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.174+0000 7f1c4aa00640 1 -- 172.21.15.59:0/1507110405 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4c00ac30 con 0x7f1c5415ff30 2024-05-30T16:49:17.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.174+0000 7f1c59a00640 1 -- 172.21.15.59:0/1507110405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c5414c4c0 con 0x7f1c5415ff30 2024-05-30T16:49:17.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.174+0000 7f1c4aa00640 1 -- 172.21.15.59:0/1507110405 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c012400 con 0x7f1c5415ff30 2024-05-30T16:49:17.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.174+0000 7f1c59a00640 1 -- 172.21.15.59:0/1507110405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c5414ca80 con 0x7f1c5415ff30 2024-05-30T16:49:17.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.174+0000 7f1c59a00640 1 -- 172.21.15.59:0/1507110405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c54068a90 con 0x7f1c5415ff30 2024-05-30T16:49:17.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.174+0000 7f1c4aa00640 1 -- 172.21.15.59:0/1507110405 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1c4c01a070 con 0x7f1c5415ff30 2024-05-30T16:49:17.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.174+0000 7f1c4aa00640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c30068380 0x7f1c3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.174+0000 7f1c4aa00640 1 -- 172.21.15.59:0/1507110405 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1c4c0865a0 con 0x7f1c5415ff30 2024-05-30T16:49:17.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.174+0000 7f1c52a00640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c30068380 0x7f1c3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.178+0000 7f1c52a00640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c30068380 0x7f1c3006a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400b9f0 tx=0x7f1c44008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:17.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.178+0000 7f1c4aa00640 1 -- 172.21.15.59:0/1507110405 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1c4c056500 con 0x7f1c5415ff30 2024-05-30T16:49:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.378+0000 7f1c59a00640 1 -- 172.21.15.59:0/1507110405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c540cf310 con 0x7f1c5415ff30 2024-05-30T16:49:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.378+0000 7f1c4aa00640 1 -- 172.21.15.59:0/1507110405 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7f1c4c05a800 con 0x7f1c5415ff30 2024-05-30T16:49:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:17.384 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/2922739893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2922739893},{"type":"v1","addr":"172.21.15.59:6833","nonce":2922739893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1233400446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1233400446},{"type":"v1","addr":"172.21.15.59:6835","nonce":1233400446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1465510297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1465510297},{"type":"v1","addr":"172.21.15.107:6836","nonce":1465510297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:03.924942+0000","modified":"2024-05-30T16:49:06.937279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3864508560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3864508560},{"type":"v1","addr":"172.21.15.107:6837","nonce":3864508560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-05-30T16:49:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2024-05-30T16:49:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.382+0000 7f1c59a00640 1 -- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c30068380 msgr2=0x7f1c3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.382+0000 7f1c59a00640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c30068380 0x7f1c3006a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400b9f0 tx=0x7f1c44008040 comp rx=0 tx=0).stop 2024-05-30T16:49:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.382+0000 7f1c59a00640 1 -- 172.21.15.59:0/1507110405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5415ff30 msgr2=0x7f1c540b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.382+0000 7f1c59a00640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5415ff30 0x7f1c540b2f30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00ca80 tx=0x7f1c4c00cf40 comp rx=0 tx=0).stop 2024-05-30T16:49:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.382+0000 7f1c59a00640 1 -- 172.21.15.59:0/1507110405 shutdown_connections 2024-05-30T16:49:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.382+0000 7f1c59a00640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c30068380 0x7f1c3006a840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.382+0000 7f1c59a00640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5415ff30 0x7f1c540b2f30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.382+0000 7f1c59a00640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c540b1ac0 0x7f1c540af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.382+0000 7f1c59a00640 1 --2- 172.21.15.59:0/1507110405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c54071280 0x7f1c5414b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.382+0000 7f1c59a00640 1 -- 172.21.15.59:0/1507110405 >> 172.21.15.59:0/1507110405 conn(0x7f1c540b3f70 msgr2=0x7f1c5415d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.382+0000 7f1c59a00640 1 -- 172.21.15.59:0/1507110405 shutdown_connections 2024-05-30T16:49:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.382+0000 7f1c59a00640 1 -- 172.21.15.59:0/1507110405 wait complete. 2024-05-30T16:49:17.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:17.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.542+0000 7fd9cdc00640 1 Processor -- start 2024-05-30T16:49:17.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.542+0000 7fd9cdc00640 1 -- start start 2024-05-30T16:49:17.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.542+0000 7fd9cdc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9c80cfe20 0x7fd9c815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.542+0000 7fd9cdc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c815f3b0 con 0x7fd9c8073bb0 2024-05-30T16:49:17.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.542+0000 7fd9cdc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c815f690 con 0x7fd9c80cfa40 2024-05-30T16:49:17.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.542+0000 7fd9cdc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd9c815f970 con 0x7fd9c80cfe20 2024-05-30T16:49:17.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.542+0000 7fd9bfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9c80cfe20 0x7fd9c815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.542+0000 7fd9c7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd9c8073bb0 0x7fd9c8072060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40180/0 (socket says 172.21.15.59:40180) 2024-05-30T16:49:17.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.542+0000 7fd9c7400640 1 -- 172.21.15.59:0/3489488793 learned_addr learned my addr 172.21.15.59:0/3489488793 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:17.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.542+0000 7fd9bfe00640 1 -- 172.21.15.59:0/3489488793 >> v1:172.21.15.107:6789/0 conn(0x7fd9c80cfa40 legacy=0x7fd9c80b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:17.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.542+0000 7fd9bfe00640 1 -- 172.21.15.59:0/3489488793 >> v1:172.21.15.59:6789/0 conn(0x7fd9c8073bb0 legacy=0x7fd9c8072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.542+0000 7fd9bfe00640 1 -- 172.21.15.59:0/3489488793 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c80b3370 con 0x7fd9c80cfe20 2024-05-30T16:49:17.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.546+0000 7fd9bfe00640 1 --2- 172.21.15.59:0/3489488793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80cfe20 0x7fd9c815ecb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00097c0 tx=0x7fd9b001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e137424060e4e7f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:17.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.546+0000 7fd9c6000640 1 -- 172.21.15.59:0/3489488793 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00b0070 con 0x7fd9c80cfe20 2024-05-30T16:49:17.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.546+0000 7fd9c6000640 1 -- 172.21.15.59:0/3489488793 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b00ab600 con 0x7fd9c80cfe20 2024-05-30T16:49:17.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.546+0000 7fd9c6000640 1 -- 172.21.15.59:0/3489488793 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00ab9d0 con 0x7fd9c80cfe20 2024-05-30T16:49:17.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.546+0000 7fd9cdc00640 1 -- 172.21.15.59:0/3489488793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80cfe20 msgr2=0x7fd9c815ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.546+0000 7fd9cdc00640 1 --2- 172.21.15.59:0/3489488793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80cfe20 0x7fd9c815ecb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00097c0 tx=0x7fd9b001c460 comp rx=0 tx=0).stop 2024-05-30T16:49:17.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.546+0000 7fd9cdc00640 1 -- 172.21.15.59:0/3489488793 shutdown_connections 2024-05-30T16:49:17.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.546+0000 7fd9cdc00640 1 --2- 172.21.15.59:0/3489488793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80cfe20 0x7fd9c815ecb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.546+0000 7fd9cdc00640 1 -- 172.21.15.59:0/3489488793 >> 172.21.15.59:0/3489488793 conn(0x7fd9c80b22d0 msgr2=0x7fd9c80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:17.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.546+0000 7fd9cdc00640 1 -- 172.21.15.59:0/3489488793 shutdown_connections 2024-05-30T16:49:17.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.546+0000 7fd9cdc00640 1 -- 172.21.15.59:0/3489488793 wait complete. 2024-05-30T16:49:17.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9cdc00640 1 Processor -- start 2024-05-30T16:49:17.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9cdc00640 1 -- start start 2024-05-30T16:49:17.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9cdc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9c8073bb0 0x7fd9c814d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9cdc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80cfa40 0x7fd9c809ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9cdc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9c80cfe20 0x7fd9c809b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9cdc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c8154fc0 con 0x7fd9c80cfa40 2024-05-30T16:49:17.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9cdc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c8154e40 con 0x7fd9c8073bb0 2024-05-30T16:49:17.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9cdc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c8155140 con 0x7fd9c80cfe20 2024-05-30T16:49:17.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80cfa40 0x7fd9c809ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80cfa40 0x7fd9c809ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54520/0 (socket says 172.21.15.59:54520) 2024-05-30T16:49:17.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9bfe00640 1 -- 172.21.15.59:0/1521065512 learned_addr learned my addr 172.21.15.59:0/1521065512 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:17.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9bfe00640 1 -- 172.21.15.59:0/1521065512 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9c80cfe20 msgr2=0x7fd9c809b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9bfe00640 1 --2- 172.21.15.59:0/1521065512 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9c80cfe20 0x7fd9c809b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9bfe00640 1 -- 172.21.15.59:0/1521065512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9c8073bb0 msgr2=0x7fd9c814d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9bfe00640 1 --2- 172.21.15.59:0/1521065512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9c8073bb0 0x7fd9c814d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9bfe00640 1 -- 172.21.15.59:0/1521065512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c81f7bd0 con 0x7fd9c80cfa40 2024-05-30T16:49:17.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9bfe00640 1 --2- 172.21.15.59:0/1521065512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80cfa40 0x7fd9c809ab40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0019070 tx=0x7fd9b001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:17.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9bea00640 1 -- 172.21.15.59:0/1521065512 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00b0050 con 0x7fd9c80cfa40 2024-05-30T16:49:17.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9bea00640 1 -- 172.21.15.59:0/1521065512 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b00bc070 con 0x7fd9c80cfa40 2024-05-30T16:49:17.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9bea00640 1 -- 172.21.15.59:0/1521065512 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00b5a30 con 0x7fd9c80cfa40 2024-05-30T16:49:17.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9cdc00640 1 -- 172.21.15.59:0/1521065512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c81f7e90 con 0x7fd9c80cfa40 2024-05-30T16:49:17.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9cdc00640 1 -- 172.21.15.59:0/1521065512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c81f8450 con 0x7fd9c80cfa40 2024-05-30T16:49:17.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.550+0000 7fd9cdc00640 1 -- 172.21.15.59:0/1521065512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c8068a90 con 0x7fd9c80cfa40 2024-05-30T16:49:17.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.554+0000 7fd9bea00640 1 -- 172.21.15.59:0/1521065512 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd9b00ab4c0 con 0x7fd9c80cfa40 2024-05-30T16:49:17.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.554+0000 7fd9bea00640 1 --2- 172.21.15.59:0/1521065512 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd9a4068380 0x7fd9a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.554+0000 7fd9bea00640 1 -- 172.21.15.59:0/1521065512 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd9b0121250 con 0x7fd9c80cfa40 2024-05-30T16:49:17.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.554+0000 7fd9c6a00640 1 --2- 172.21.15.59:0/1521065512 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd9a4068380 0x7fd9a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.554+0000 7fd9c6a00640 1 --2- 172.21.15.59:0/1521065512 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd9a4068380 0x7fd9a406a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8007fd0 tx=0x7fd9b80079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:17.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.558+0000 7fd9bea00640 1 -- 172.21.15.59:0/1521065512 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd9b0016050 con 0x7fd9c80cfa40 2024-05-30T16:49:17.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 -- 172.21.15.59:0/1521065512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9c816b430 con 0x7fd9c80cfa40 2024-05-30T16:49:17.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9bea00640 1 -- 172.21.15.59:0/1521065512 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7fd9b00f16e0 con 0x7fd9c80cfa40 2024-05-30T16:49:17.763 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:17.763 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/2922739893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2922739893},{"type":"v1","addr":"172.21.15.59:6833","nonce":2922739893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1233400446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1233400446},{"type":"v1","addr":"172.21.15.59:6835","nonce":1233400446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1465510297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1465510297},{"type":"v1","addr":"172.21.15.107:6836","nonce":1465510297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:03.924942+0000","modified":"2024-05-30T16:49:06.937279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3864508560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3864508560},{"type":"v1","addr":"172.21.15.107:6837","nonce":3864508560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-05-30T16:49:17.763 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2024-05-30T16:49:17.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 -- 172.21.15.59:0/1521065512 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd9a4068380 msgr2=0x7fd9a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 --2- 172.21.15.59:0/1521065512 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd9a4068380 0x7fd9a406a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8007fd0 tx=0x7fd9b80079a0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 -- 172.21.15.59:0/1521065512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80cfa40 msgr2=0x7fd9c809ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 --2- 172.21.15.59:0/1521065512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80cfa40 0x7fd9c809ab40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0019070 tx=0x7fd9b001aca0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 -- 172.21.15.59:0/1521065512 shutdown_connections 2024-05-30T16:49:17.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 --2- 172.21.15.59:0/1521065512 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd9a4068380 0x7fd9a406a840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 --2- 172.21.15.59:0/1521065512 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9c80cfe20 0x7fd9c809b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 --2- 172.21.15.59:0/1521065512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80cfa40 0x7fd9c809ab40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 --2- 172.21.15.59:0/1521065512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9c8073bb0 0x7fd9c814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 -- 172.21.15.59:0/1521065512 >> 172.21.15.59:0/1521065512 conn(0x7fd9c80b22d0 msgr2=0x7fd9c80729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:17.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 -- 172.21.15.59:0/1521065512 shutdown_connections 2024-05-30T16:49:17.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.758+0000 7fd9cdc00640 1 -- 172.21.15.59:0/1521065512 wait complete. 2024-05-30T16:49:17.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:17.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.918+0000 7f6d37200640 1 Processor -- start 2024-05-30T16:49:17.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.918+0000 7f6d37200640 1 -- start start 2024-05-30T16:49:17.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d37200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380d50c0 0x7f6d380d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d37200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6d380d30b0 0x7f6d3806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d37200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d3815ed70 con 0x7f6d3815e990 2024-05-30T16:49:17.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d37200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6d380cf380 con 0x7f6d380d30b0 2024-05-30T16:49:17.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d37200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6d380d5520 con 0x7f6d380d50c0 2024-05-30T16:49:17.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6d3815e990 0x7f6d380d0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40196/0 (socket says 172.21.15.59:40196) 2024-05-30T16:49:17.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35e00640 1 -- 172.21.15.59:0/2178066503 learned_addr learned my addr 172.21.15.59:0/2178066503 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:17.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d2fe00640 1 --2- 172.21.15.59:0/2178066503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380d50c0 0x7f6d380d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d36800640 1 --2- 172.21.15.59:0/2178066503 >> v2:172.21.15.107:3300/0 conn(0x7f6d380d30b0 0x7f6d3806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 304444953 0 0) 0x7f6d3815ed70 con 0x7f6d3815e990 2024-05-30T16:49:17.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d1c003530 con 0x7f6d3815e990 2024-05-30T16:49:17.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 599123753 0 0) 0x7f6d1c003530 con 0x7f6d3815e990 2024-05-30T16:49:17.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380d50c0 msgr2=0x7f6d380d2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:17.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 --2- 172.21.15.59:0/2178066503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380d50c0 0x7f6d380d2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 >> v2:172.21.15.107:3300/0 conn(0x7f6d380d30b0 msgr2=0x7f6d3806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 --2- 172.21.15.59:0/2178066503 >> v2:172.21.15.107:3300/0 conn(0x7f6d380d30b0 0x7f6d3806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d380b3de0 con 0x7f6d3815e990 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f6d28001680 con 0x7f6d3815e990 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 >> v1:172.21.15.59:6789/0 conn(0x7f6d3815e990 legacy=0x7f6d380d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 --2- 172.21.15.59:0/2178066503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380d50c0 0x7f6d1c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 --2- 172.21.15.59:0/2178066503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d1c003f40 0x7f6d1c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 --2- 172.21.15.59:0/2178066503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c004d50 0x7f6d1c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d380d5520 con 0x7f6d1c004d50 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c00b9d0 con 0x7f6d1c003f40 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1c00bba0 con 0x7f6d380d50c0 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d36800640 1 --2- 172.21.15.59:0/2178066503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c004d50 0x7f6d1c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d35e00640 1 --2- 172.21.15.59:0/2178066503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380d50c0 0x7f6d1c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d2fe00640 1 --2- 172.21.15.59:0/2178066503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d1c003f40 0x7f6d1c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d36800640 1 -- 172.21.15.59:0/2178066503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380d50c0 msgr2=0x7f6d1c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:17.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d36800640 1 --2- 172.21.15.59:0/2178066503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380d50c0 0x7f6d1c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d36800640 1 -- 172.21.15.59:0/2178066503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d1c003f40 msgr2=0x7f6d1c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:17.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d36800640 1 --2- 172.21.15.59:0/2178066503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d1c003f40 0x7f6d1c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.922+0000 7f6d36800640 1 -- 172.21.15.59:0/2178066503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c003530 con 0x7f6d1c004d50 2024-05-30T16:49:17.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d36800640 1 --2- 172.21.15.59:0/2178066503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c004d50 0x7f6d1c0051d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000e170 tx=0x7f6d3001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd784ee7f52aea50 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:17.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d300b0070 con 0x7f6d1c004d50 2024-05-30T16:49:17.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d300ab600 con 0x7f6d1c004d50 2024-05-30T16:49:17.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d35400640 1 -- 172.21.15.59:0/2178066503 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30009c10 con 0x7f6d1c004d50 2024-05-30T16:49:17.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d37200640 1 -- 172.21.15.59:0/2178066503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c004d50 msgr2=0x7f6d1c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d37200640 1 --2- 172.21.15.59:0/2178066503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c004d50 0x7f6d1c0051d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000e170 tx=0x7f6d3001c980 comp rx=0 tx=0).stop 2024-05-30T16:49:17.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d36800640 1 -- 172.21.15.59:0/2178066503 reap_dead start 2024-05-30T16:49:17.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d37200640 1 -- 172.21.15.59:0/2178066503 shutdown_connections 2024-05-30T16:49:17.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d37200640 1 -- 172.21.15.59:0/2178066503 >> 172.21.15.59:0/2178066503 conn(0x7f6d3808bfd0 msgr2=0x7f6d380d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:17.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d37200640 1 -- 172.21.15.59:0/2178066503 shutdown_connections 2024-05-30T16:49:17.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d37200640 1 -- 172.21.15.59:0/2178066503 wait complete. 2024-05-30T16:49:17.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d37200640 1 Processor -- start 2024-05-30T16:49:17.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.926+0000 7f6d37200640 1 -- start start 2024-05-30T16:49:17.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d37200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d1c004d50 0x7f6d380b9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d37200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380b9840 0x7f6d380c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d37200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d380c8410 0x7f6d3814b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d37200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d380cfb70 con 0x7f6d380c8410 2024-05-30T16:49:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d37200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6d380d34c0 con 0x7f6d1c004d50 2024-05-30T16:49:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d37200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6d3806d400 con 0x7f6d380b9840 2024-05-30T16:49:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d36800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d380c8410 0x7f6d3814b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d36800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d380c8410 0x7f6d3814b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54534/0 (socket says 172.21.15.59:54534) 2024-05-30T16:49:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d36800640 1 -- 172.21.15.59:0/2685028154 learned_addr learned my addr 172.21.15.59:0/2685028154 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d2fe00640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380b9840 0x7f6d380c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d35e00640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d1c004d50 0x7f6d380b9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d36800640 1 -- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380b9840 msgr2=0x7f6d380c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d36800640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380b9840 0x7f6d380c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d36800640 1 -- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d1c004d50 msgr2=0x7f6d380b9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d36800640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d1c004d50 0x7f6d380b9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d36800640 1 -- 172.21.15.59:0/2685028154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3814b660 con 0x7f6d380c8410 2024-05-30T16:49:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d36800640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d380c8410 0x7f6d3814b950 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009f90 tx=0x7f6d30009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d2e000640 1 -- 172.21.15.59:0/2685028154 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d300bc020 con 0x7f6d380c8410 2024-05-30T16:49:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d2e000640 1 -- 172.21.15.59:0/2685028154 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d300ab400 con 0x7f6d380c8410 2024-05-30T16:49:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d37200640 1 -- 172.21.15.59:0/2685028154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d380b8260 con 0x7f6d380c8410 2024-05-30T16:49:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d2e000640 1 -- 172.21.15.59:0/2685028154 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d300b0040 con 0x7f6d380c8410 2024-05-30T16:49:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d37200640 1 -- 172.21.15.59:0/2685028154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d380b8820 con 0x7f6d380c8410 2024-05-30T16:49:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d37200640 1 -- 172.21.15.59:0/2685028154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d38068a90 con 0x7f6d380c8410 2024-05-30T16:49:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.930+0000 7f6d2e000640 1 -- 172.21.15.59:0/2685028154 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6d300b6470 con 0x7f6d380c8410 2024-05-30T16:49:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.934+0000 7f6d2e000640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6d14068380 0x7f6d1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.934+0000 7f6d2e000640 1 -- 172.21.15.59:0/2685028154 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6d301208e0 con 0x7f6d380c8410 2024-05-30T16:49:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.934+0000 7f6d35e00640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6d14068380 0x7f6d1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.934+0000 7f6d35e00640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6d14068380 0x7f6d1406a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6d3808c870 tx=0x7f6d28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:17.938+0000 7f6d2e000640 1 -- 172.21.15.59:0/2685028154 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6d30016a30 con 0x7f6d380c8410 2024-05-30T16:49:18.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.102+0000 7f6d37200640 1 -- 172.21.15.59:0/2685028154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d380ba510 con 0x7f6d380c8410 2024-05-30T16:49:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.102+0000 7f6d2e000640 1 -- 172.21.15.59:0/2685028154 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f6d300f0e90 con 0x7f6d380c8410 2024-05-30T16:49:18.109 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:18.109 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":23,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:49:05.525706+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:01.850911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:02.883949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:18.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.106+0000 7f6d37200640 1 -- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6d14068380 msgr2=0x7f6d1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:18.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.106+0000 7f6d37200640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6d14068380 0x7f6d1406a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6d3808c870 tx=0x7f6d28009040 comp rx=0 tx=0).stop 2024-05-30T16:49:18.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.106+0000 7f6d37200640 1 -- 172.21.15.59:0/2685028154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d380c8410 msgr2=0x7f6d3814b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:18.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.106+0000 7f6d37200640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d380c8410 0x7f6d3814b950 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009f90 tx=0x7f6d30009750 comp rx=0 tx=0).stop 2024-05-30T16:49:18.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.106+0000 7f6d37200640 1 -- 172.21.15.59:0/2685028154 shutdown_connections 2024-05-30T16:49:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.106+0000 7f6d37200640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6d14068380 0x7f6d1406a840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.106+0000 7f6d37200640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d380c8410 0x7f6d3814b950 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.106+0000 7f6d37200640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d380b9840 0x7f6d380c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.106+0000 7f6d37200640 1 --2- 172.21.15.59:0/2685028154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d1c004d50 0x7f6d380b9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.106+0000 7f6d37200640 1 -- 172.21.15.59:0/2685028154 >> 172.21.15.59:0/2685028154 conn(0x7f6d3808bfd0 msgr2=0x7f6d380d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.106+0000 7f6d37200640 1 -- 172.21.15.59:0/2685028154 shutdown_connections 2024-05-30T16:49:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.106+0000 7f6d37200640 1 -- 172.21.15.59:0/2685028154 wait complete. 2024-05-30T16:49:18.131 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:18.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f300f200640 1 Processor -- start 2024-05-30T16:49:18.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f300f200640 1 -- start start 2024-05-30T16:49:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f300f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300806e900 0x7f300815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f300f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f300815f060 con 0x7f30080d0560 2024-05-30T16:49:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f300f200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30080afb00 con 0x7f30080af720 2024-05-30T16:49:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f300f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f300815c270 con 0x7f300806e900 2024-05-30T16:49:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f300d200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f30080d0560 0x7f3008072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40202/0 (socket says 172.21.15.59:40202) 2024-05-30T16:49:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f300d200640 1 -- 172.21.15.59:0/631125300 learned_addr learned my addr 172.21.15.59:0/631125300 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f2fffe00640 1 --2- 172.21.15.59:0/631125300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300806e900 0x7f300815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:18.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f3007400640 1 -- 172.21.15.59:0/631125300 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1680168146 0 0) 0x7f300815f060 con 0x7f30080d0560 2024-05-30T16:49:18.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f3007400640 1 -- 172.21.15.59:0/631125300 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fec005740 con 0x7f30080d0560 2024-05-30T16:49:18.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f3007400640 1 -- 172.21.15.59:0/631125300 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2681255495 0 0) 0x7f30080afb00 con 0x7f30080af720 2024-05-30T16:49:18.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f2fffe00640 1 -- 172.21.15.59:0/631125300 >> v1:172.21.15.107:6789/0 conn(0x7f30080af720 legacy=0x7f300815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:18.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f2fffe00640 1 -- 172.21.15.59:0/631125300 >> v1:172.21.15.59:6789/0 conn(0x7f30080d0560 legacy=0x7f3008072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:18.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.266+0000 7f2fffe00640 1 -- 172.21.15.59:0/631125300 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300815c550 con 0x7f300806e900 2024-05-30T16:49:18.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.270+0000 7f2fffe00640 1 --2- 172.21.15.59:0/631125300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300806e900 0x7f300815f7f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00097f0 tx=0x7f2ff001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6af605ef5028ba0b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.270+0000 7f3007400640 1 -- 172.21.15.59:0/631125300 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00aa430 con 0x7f300806e900 2024-05-30T16:49:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.270+0000 7f3007400640 1 -- 172.21.15.59:0/631125300 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff00af070 con 0x7f300806e900 2024-05-30T16:49:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.270+0000 7f3007400640 1 -- 172.21.15.59:0/631125300 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00aa7f0 con 0x7f300806e900 2024-05-30T16:49:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.270+0000 7f300f200640 1 -- 172.21.15.59:0/631125300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300806e900 msgr2=0x7f300815f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.270+0000 7f300f200640 1 --2- 172.21.15.59:0/631125300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300806e900 0x7f300815f7f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00097f0 tx=0x7f2ff001c4b0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.270+0000 7f300f200640 1 -- 172.21.15.59:0/631125300 shutdown_connections 2024-05-30T16:49:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.270+0000 7f300f200640 1 --2- 172.21.15.59:0/631125300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300806e900 0x7f300815f7f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.270+0000 7f300f200640 1 -- 172.21.15.59:0/631125300 >> 172.21.15.59:0/631125300 conn(0x7f30080b22d0 msgr2=0x7f30080b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.270+0000 7f300f200640 1 -- 172.21.15.59:0/631125300 shutdown_connections 2024-05-30T16:49:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.270+0000 7f300f200640 1 -- 172.21.15.59:0/631125300 wait complete. 2024-05-30T16:49:18.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f300f200640 1 Processor -- start 2024-05-30T16:49:18.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f300f200640 1 -- start start 2024-05-30T16:49:18.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f300f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300806e900 0x7f3008164440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:18.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f300f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30080af720 0x7f3008159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:18.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f300f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30080d0560 0x7f3008152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f300f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f300815feb0 con 0x7f30080af720 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f300f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f300815fd30 con 0x7f30080d0560 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f300f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3008158dd0 con 0x7f300806e900 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f2fffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30080af720 0x7f3008159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f2fffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30080af720 0x7f3008159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54546/0 (socket says 172.21.15.59:54546) 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f2fffe00640 1 -- 172.21.15.59:0/730742438 learned_addr learned my addr 172.21.15.59:0/730742438 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f300d200640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30080d0560 0x7f3008152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f3007e00640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300806e900 0x7f3008164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f2fffe00640 1 -- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300806e900 msgr2=0x7f3008164440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f2fffe00640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300806e900 0x7f3008164440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f2fffe00640 1 -- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30080d0560 msgr2=0x7f3008152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f2fffe00640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30080d0560 0x7f3008152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f2fffe00640 1 -- 172.21.15.59:0/730742438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3008151b60 con 0x7f30080af720 2024-05-30T16:49:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f2fffe00640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30080af720 0x7f3008159b40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00097f0 tx=0x7f2ff001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f3004c00640 1 -- 172.21.15.59:0/730742438 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00be610 con 0x7f30080af720 2024-05-30T16:49:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f3004c00640 1 -- 172.21.15.59:0/730742438 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff00be7d0 con 0x7f30080af720 2024-05-30T16:49:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f3004c00640 1 -- 172.21.15.59:0/730742438 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00bebc0 con 0x7f30080af720 2024-05-30T16:49:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f300f200640 1 -- 172.21.15.59:0/730742438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3008151e40 con 0x7f30080af720 2024-05-30T16:49:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.274+0000 7f300f200640 1 -- 172.21.15.59:0/730742438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3008152400 con 0x7f30080af720 2024-05-30T16:49:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.278+0000 7f300f200640 1 -- 172.21.15.59:0/730742438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3008068a90 con 0x7f30080af720 2024-05-30T16:49:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.278+0000 7f3004c00640 1 -- 172.21.15.59:0/730742438 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2ff00bc020 con 0x7f30080af720 2024-05-30T16:49:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.278+0000 7f3004c00640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2fe4068380 0x7f2fe406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.278+0000 7f3004c00640 1 -- 172.21.15.59:0/730742438 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2ff0120a40 con 0x7f30080af720 2024-05-30T16:49:18.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.278+0000 7f3007e00640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2fe4068380 0x7f2fe406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:18.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.282+0000 7f3007e00640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2fe4068380 0x7f2fe406a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8000f70 tx=0x7f2ff8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.282+0000 7f3004c00640 1 -- 172.21.15.59:0/730742438 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2ff00c5030 con 0x7f30080af720 2024-05-30T16:49:18.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.482+0000 7f300f200640 1 -- 172.21.15.59:0/730742438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30080b02a0 con 0x7f30080af720 2024-05-30T16:49:18.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.482+0000 7f3004c00640 1 -- 172.21.15.59:0/730742438 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7f2ff00160d0 con 0x7f30080af720 2024-05-30T16:49:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:18.490 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/2922739893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2922739893},{"type":"v1","addr":"172.21.15.59:6833","nonce":2922739893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1233400446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1233400446},{"type":"v1","addr":"172.21.15.59:6835","nonce":1233400446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1465510297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1465510297},{"type":"v1","addr":"172.21.15.107:6836","nonce":1465510297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:03.924942+0000","modified":"2024-05-30T16:49:06.937279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3864508560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3864508560},{"type":"v1","addr":"172.21.15.107:6837","nonce":3864508560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-05-30T16:49:18.490 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2024-05-30T16:49:18.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.486+0000 7f300f200640 1 -- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2fe4068380 msgr2=0x7f2fe406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:18.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.486+0000 7f300f200640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2fe4068380 0x7f2fe406a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8000f70 tx=0x7f2ff8009040 comp rx=0 tx=0).stop 2024-05-30T16:49:18.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.486+0000 7f300f200640 1 -- 172.21.15.59:0/730742438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30080af720 msgr2=0x7f3008159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:18.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.486+0000 7f300f200640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30080af720 0x7f3008159b40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00097f0 tx=0x7f2ff001acf0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.486+0000 7f300f200640 1 -- 172.21.15.59:0/730742438 shutdown_connections 2024-05-30T16:49:18.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.486+0000 7f300f200640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2fe4068380 0x7f2fe406a840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.486+0000 7f300f200640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30080d0560 0x7f3008152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.486+0000 7f300f200640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30080af720 0x7f3008159b40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.486+0000 7f300f200640 1 --2- 172.21.15.59:0/730742438 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300806e900 0x7f3008164440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:18.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.486+0000 7f300f200640 1 -- 172.21.15.59:0/730742438 >> 172.21.15.59:0/730742438 conn(0x7f30080b22d0 msgr2=0x7f300806f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:18.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.486+0000 7f300f200640 1 -- 172.21.15.59:0/730742438 shutdown_connections 2024-05-30T16:49:18.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:18.486+0000 7f300f200640 1 -- 172.21.15.59:0/730742438 wait complete. 2024-05-30T16:49:18.913 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T16:49:03.924942+0000', 'modified': '2024-05-30T16:49:06.937279+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.107:6837/3864508560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6835', 'nonce': 3864508560}, {'type': 'v1', 'addr': '172.21.15.107:6837', 'nonce': 3864508560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4294, 'qdb_cluster': [4294]} 2024-05-30T16:49:18.913 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T16:49:18.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-30T16:49:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5ada00640 1 Processor -- start 2024-05-30T16:49:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5ada00640 1 -- start start 2024-05-30T16:49:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5ada00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe5a8162a50 0x7fe5a806cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5ada00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5a80d0fb0 con 0x7fe5a809b890 2024-05-30T16:49:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5ada00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5a80d1290 con 0x7fe5a809b4b0 2024-05-30T16:49:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5ada00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe5a806fef0 con 0x7fe5a8162a50 2024-05-30T16:49:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe59f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe5a809b890 0x7fe5a8162340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40212/0 (socket says 172.21.15.59:40212) 2024-05-30T16:49:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe59f400640 1 -- 172.21.15.59:0/1982493621 learned_addr learned my addr 172.21.15.59:0/1982493621 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:19.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5ad000640 1 --2- 172.21.15.59:0/1982493621 >> v2:172.21.15.107:3300/0 conn(0x7fe5a8162a50 0x7fe5a806cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3146802828 0 0) 0x7fe5a80d0fb0 con 0x7fe5a809b890 2024-05-30T16:49:19.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe58c003530 con 0x7fe5a809b890 2024-05-30T16:49:19.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2462806207 0 0) 0x7fe58c003530 con 0x7fe5a809b890 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 >> v2:172.21.15.107:3300/0 conn(0x7fe5a8162a50 msgr2=0x7fe5a806cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 --2- 172.21.15.59:0/1982493621 >> v2:172.21.15.107:3300/0 conn(0x7fe5a8162a50 0x7fe5a806cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 >> v1:172.21.15.107:6789/0 conn(0x7fe5a809b4b0 legacy=0x7fe5a80d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a80d1570 con 0x7fe5a809b890 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fe590001680 con 0x7fe5a809b890 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 >> v1:172.21.15.59:6789/0 conn(0x7fe5a809b890 legacy=0x7fe5a8162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 --2- 172.21.15.59:0/1982493621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 0x7fe58c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 --2- 172.21.15.59:0/1982493621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe58c0043c0 0x7fe58c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 --2- 172.21.15.59:0/1982493621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe58c005130 0x7fe58c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a806fef0 con 0x7fe58c0039c0 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c00c070 con 0x7fe58c0043c0 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe58c00c270 con 0x7fe58c005130 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/1982493621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 0x7fe58c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe5ad000640 1 --2- 172.21.15.59:0/1982493621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe58c005130 0x7fe58c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.054+0000 7fe59f400640 1 --2- 172.21.15.59:0/1982493621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe58c0043c0 0x7fe58c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5a7e00640 1 -- 172.21.15.59:0/1982493621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe58c005130 msgr2=0x7fe58c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/1982493621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe58c005130 0x7fe58c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5a7e00640 1 -- 172.21.15.59:0/1982493621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe58c0043c0 msgr2=0x7fe58c004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/1982493621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe58c0043c0 0x7fe58c004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5a7e00640 1 -- 172.21.15.59:0/1982493621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58c003530 con 0x7fe58c0039c0 2024-05-30T16:49:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5ad000640 1 -- 172.21.15.59:0/1982493621 reap_dead start 2024-05-30T16:49:19.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/1982493621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 0x7fe58c003da0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe598001910 tx=0x7fe59801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66ef6e0e46bfce5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598001510 con 0x7fe58c0039c0 2024-05-30T16:49:19.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5980af070 con 0x7fe58c0039c0 2024-05-30T16:49:19.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5a7400640 1 -- 172.21.15.59:0/1982493621 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5980aa8c0 con 0x7fe58c0039c0 2024-05-30T16:49:19.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5ada00640 1 -- 172.21.15.59:0/1982493621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 msgr2=0x7fe58c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5ada00640 1 --2- 172.21.15.59:0/1982493621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 0x7fe58c003da0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe598001910 tx=0x7fe59801c530 comp rx=0 tx=0).stop 2024-05-30T16:49:19.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5ada00640 1 -- 172.21.15.59:0/1982493621 shutdown_connections 2024-05-30T16:49:19.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5ada00640 1 --2- 172.21.15.59:0/1982493621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 0x7fe58c003da0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5ada00640 1 -- 172.21.15.59:0/1982493621 >> 172.21.15.59:0/1982493621 conn(0x7fe5a80b3ec0 msgr2=0x7fe5a80b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:19.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5ada00640 1 -- 172.21.15.59:0/1982493621 shutdown_connections 2024-05-30T16:49:19.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.058+0000 7fe5ada00640 1 -- 172.21.15.59:0/1982493621 wait complete. 2024-05-30T16:49:19.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5ada00640 1 Processor -- start 2024-05-30T16:49:19.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5ada00640 1 -- start start 2024-05-30T16:49:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5ada00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 0x7fe5a8153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5ada00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a81f78f0 0x7fe5a806daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5ada00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5a806e030 0x7fe5a80c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5ada00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a81626d0 con 0x7fe58c0039c0 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5ada00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a8162550 con 0x7fe5a806e030 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5ada00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a8162850 con 0x7fe5a81f78f0 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5a7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 0x7fe5a8153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5a7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 0x7fe5a8153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54570/0 (socket says 172.21.15.59:54570) 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5a7e00640 1 -- 172.21.15.59:0/3723935175 learned_addr learned my addr 172.21.15.59:0/3723935175 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe59f400640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a81f78f0 0x7fe5a806daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5ad000640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5a806e030 0x7fe5a80c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5a7e00640 1 -- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a81f78f0 msgr2=0x7fe5a806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a81f78f0 0x7fe5a806daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5a7e00640 1 -- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5a806e030 msgr2=0x7fe5a80c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5a806e030 0x7fe5a80c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5a7e00640 1 -- 172.21.15.59:0/3723935175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a80b6110 con 0x7fe58c0039c0 2024-05-30T16:49:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 0x7fe5a8153800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe59801c360 tx=0x7fe5980192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5a4c00640 1 -- 172.21.15.59:0/3723935175 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5980014f0 con 0x7fe58c0039c0 2024-05-30T16:49:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5a4c00640 1 -- 172.21.15.59:0/3723935175 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5980067e0 con 0x7fe58c0039c0 2024-05-30T16:49:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5ada00640 1 -- 172.21.15.59:0/3723935175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a80b63f0 con 0x7fe58c0039c0 2024-05-30T16:49:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5a4c00640 1 -- 172.21.15.59:0/3723935175 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598006b90 con 0x7fe58c0039c0 2024-05-30T16:49:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.062+0000 7fe5ada00640 1 -- 172.21.15.59:0/3723935175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a80b69b0 con 0x7fe58c0039c0 2024-05-30T16:49:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.066+0000 7fe5a4c00640 1 -- 172.21.15.59:0/3723935175 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe598007030 con 0x7fe58c0039c0 2024-05-30T16:49:19.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.066+0000 7fe5a4c00640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe5840683b0 0x7fe58406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.066+0000 7fe5a4c00640 1 -- 172.21.15.59:0/3723935175 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe598121090 con 0x7fe58c0039c0 2024-05-30T16:49:19.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.066+0000 7fe59f400640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe5840683b0 0x7fe58406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.066+0000 7fe5b2519000 1 Processor -- start 2024-05-30T16:49:19.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.066+0000 7fe5b2519000 1 -- start start 2024-05-30T16:49:19.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.066+0000 7fe59f400640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe5840683b0 0x7fe58406a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8161490 tx=0x7fe590009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ffcc120 0x55646ffcc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 0x55646ff7f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ff7f650 0x55646ff7fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55646fdd0420 con 0x55646ff7f650 2024-05-30T16:49:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55646fd6abf0 con 0x55646ffcc120 2024-05-30T16:49:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55646fdcc3e0 con 0x55646ffcca40 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5ad000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ff7f650 0x55646ff7fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5ad000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ff7f650 0x55646ff7fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54574/0 (socket says 172.21.15.59:54574) 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5ad000640 1 -- 172.21.15.59:0/4178354850 learned_addr learned my addr 172.21.15.59:0/4178354850 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe59f400640 1 --2- 172.21.15.59:0/4178354850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 0x55646ff7f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/4178354850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ffcc120 0x55646ffcc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5ad000640 1 -- 172.21.15.59:0/4178354850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 msgr2=0x55646ff7f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5ad000640 1 --2- 172.21.15.59:0/4178354850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 0x55646ff7f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5ad000640 1 -- 172.21.15.59:0/4178354850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ffcc120 msgr2=0x55646ffcc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5ad000640 1 --2- 172.21.15.59:0/4178354850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ffcc120 0x55646ffcc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5ad000640 1 -- 172.21.15.59:0/4178354850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55646fe78450 con 0x55646ff7f650 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/4178354850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ffcc120 0x55646ffcc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5ad000640 1 --2- 172.21.15.59:0/4178354850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ff7f650 0x55646ff7fa30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8071860 tx=0x7fe5a0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bf4b5c98df87ed server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe59cc00640 1 -- 172.21.15.59:0/4178354850 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a001a020 con 0x55646ff7f650 2024-05-30T16:49:19.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe59cc00640 1 -- 172.21.15.59:0/4178354850 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a0016460 con 0x55646ff7f650 2024-05-30T16:49:19.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe59cc00640 1 -- 172.21.15.59:0/4178354850 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0016810 con 0x55646ff7f650 2024-05-30T16:49:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 -- 172.21.15.59:0/4178354850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ff7f650 msgr2=0x55646ff7fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 --2- 172.21.15.59:0/4178354850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ff7f650 0x55646ff7fa30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8071860 tx=0x7fe5a0009750 comp rx=0 tx=0).stop 2024-05-30T16:49:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 -- 172.21.15.59:0/4178354850 shutdown_connections 2024-05-30T16:49:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 --2- 172.21.15.59:0/4178354850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ff7f650 0x55646ff7fa30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 --2- 172.21.15.59:0/4178354850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 0x55646ff7f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 --2- 172.21.15.59:0/4178354850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ffcc120 0x55646ffcc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 -- 172.21.15.59:0/4178354850 >> 172.21.15.59:0/4178354850 conn(0x55646ffacec0 msgr2=0x55646ffaf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 -- 172.21.15.59:0/4178354850 shutdown_connections 2024-05-30T16:49:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 -- 172.21.15.59:0/4178354850 wait complete. 2024-05-30T16:49:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 -- start start 2024-05-30T16:49:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.070+0000 7fe5b2519000 1 Processor -- start 2024-05-30T16:49:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ff7f650 0x55646ff84b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 0x55646ff85080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 0x55646ff855c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55646fd70ec0 con 0x55646ffcc120 2024-05-30T16:49:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55646fe51120 con 0x55646ff7f650 2024-05-30T16:49:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55646fddb350 con 0x55646ffcca40 2024-05-30T16:49:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 10 client.0 _ll_register_callbacks cb 0x55646fdad4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5a7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ff7f650 0x55646ff84b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5a7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ff7f650 0x55646ff84b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:59092/0 (socket says 172.21.15.59:59092) 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5ad000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 0x55646ff855c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5a7e00640 1 -- 172.21.15.59:0/1640542220 learned_addr learned my addr 172.21.15.59:0/1640542220 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe59f400640 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 0x55646ff85080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5a7e00640 1 -- 172.21.15.59:0/1640542220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 msgr2=0x55646ff855c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 0x55646ff855c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5a7e00640 1 -- 172.21.15.59:0/1640542220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 msgr2=0x55646ff85080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 0x55646ff85080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5a7e00640 1 -- 172.21.15.59:0/1640542220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646fe15f80 con 0x55646ff7f650 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe59f400640 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 0x55646ff85080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ff7f650 0x55646ff84b40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe5980f0f80 tx=0x7fe5980f53b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=620f6a3f3bd4a00a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe595600640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe595600640 1 -- 172.21.15.59:0/1640542220 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59811d060 con 0x55646ff7f650 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe595600640 1 -- 172.21.15.59:0/1640542220 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe5980f0640 con 0x55646ff7f650 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 1 -- 172.21.15.59:0/1640542220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5a0016460 con 0x55646ff7f650 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe595600640 1 -- 172.21.15.59:0/1640542220 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fe59810e050 con 0x55646ff7f650 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 10 client.4534 fetch_fsmap learned FSMap version 7 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 1 -- 172.21.15.59:0/1640542220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55646fda9f00 con 0x55646ff7f650 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe595600640 1 -- 172.21.15.59:0/1640542220 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a0016460 con 0x55646ff7f650 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe595600640 1 -- 172.21.15.59:0/1640542220 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 7) ==== 3494+0+0 (secure 0 0 0) 0x7fe5980ecd40 con 0x55646ff7f650 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 10 client.4534 fetch_fsmap finished waiting for FSMap version 7 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 10 client.4534 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 20 client.4534 populate_metadata read hostname 'smithi059' 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.107:6835/3864508560,v1:172.21.15.107:6837/3864508560] conn(0x55646ffdb3c0 0x55646ffdd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 4 client.4534 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe5b2519000 1 -- 172.21.15.59:0/1640542220 --> [v2:172.21.15.107:6835/3864508560,v1:172.21.15.107:6837/3864508560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55646fd69bc0 con 0x55646ffdb3c0 2024-05-30T16:49:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe59f400640 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.107:6835/3864508560,v1:172.21.15.107:6837/3864508560] conn(0x55646ffdb3c0 0x55646ffdd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe59f400640 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.107:6835/3864508560,v1:172.21.15.107:6837/3864508560] conn(0x55646ffdb3c0 0x55646ffdd7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b6029839f0ae9e4 server_cookie=a44db6cdc304b5a0 in_seq=0 out_seq=0 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.074+0000 7fe595600640 10 client.4534 ms_handle_connect on v2:172.21.15.107:6835/3864508560 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe595600640 1 -- 172.21.15.59:0/1640542220 <== mds.0 v2:172.21.15.107:6835/3864508560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55646fd69bc0 con 0x55646ffdb3c0 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe595600640 10 client.4534 handle_command_reply: tid=0 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe5b2519000 1 client.4534 shutdown 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe5b2519000 1 -- 172.21.15.59:0/1640542220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ff7f650 msgr2=0x55646ff84b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe5b2519000 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ff7f650 0x55646ff84b40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe5980f0f80 tx=0x7fe5980f53b0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe5b2519000 1 -- 172.21.15.59:0/1640542220 shutdown_connections 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe5b2519000 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.107:6835/3864508560,v1:172.21.15.107:6837/3864508560] conn(0x55646ffdb3c0 0x55646ffdd7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe5b2519000 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 0x55646ff855c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe5b2519000 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 0x55646ff85080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe5b2519000 1 --2- 172.21.15.59:0/1640542220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ff7f650 0x55646ff84b40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe5b2519000 1 -- 172.21.15.59:0/1640542220 >> 172.21.15.59:0/1640542220 conn(0x55646ffacec0 msgr2=0x55646ffaf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe595600640 0 client.4534 ms_handle_reset on v2:172.21.15.107:6835/3864508560 2024-05-30T16:49:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe5b2519000 1 -- 172.21.15.59:0/1640542220 shutdown_connections 2024-05-30T16:49:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe5b2519000 1 -- 172.21.15.59:0/1640542220 wait complete. 2024-05-30T16:49:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.078+0000 7fe5b2519000 20 client.4534 trim_cache size 0 max 16384 2024-05-30T16:49:19.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.094+0000 7fe5b2519000 1 Processor -- start 2024-05-30T16:49:19.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.094+0000 7fe5b2519000 1 -- start start 2024-05-30T16:49:19.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.094+0000 7fe5b2519000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ff7f650 0x55646ff7e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.094+0000 7fe5b2519000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ffcc120 0x55646ff7ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.094+0000 7fe5b2519000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcca40 0x55646ffdd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.094+0000 7fe5b2519000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a8203180 con 0x55646ffcca40 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.094+0000 7fe5b2519000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a80b52a0 con 0x55646ffcc120 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.094+0000 7fe5b2519000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a80b58f0 con 0x55646ff7f650 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5ad000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcca40 0x55646ffdd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5ad000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcca40 0x55646ffdd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54594/0 (socket says 172.21.15.59:54594) 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5ad000640 1 -- 172.21.15.59:0/395186712 learned_addr learned my addr 172.21.15.59:0/395186712 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe59f400640 1 --2- 172.21.15.59:0/395186712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ffcc120 0x55646ff7ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/395186712 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ff7f650 0x55646ff7e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5ad000640 1 -- 172.21.15.59:0/395186712 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ff7f650 msgr2=0x55646ff7e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5ad000640 1 --2- 172.21.15.59:0/395186712 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ff7f650 0x55646ff7e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5ad000640 1 -- 172.21.15.59:0/395186712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ffcc120 msgr2=0x55646ff7ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5ad000640 1 --2- 172.21.15.59:0/395186712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ffcc120 0x55646ff7ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5ad000640 1 -- 172.21.15.59:0/395186712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55646ffcc870 con 0x55646ffcca40 2024-05-30T16:49:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5ad000640 1 --2- 172.21.15.59:0/395186712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcca40 0x55646ffdd7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0018000 tx=0x7fe5a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684af3000004f139 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe597e00640 1 -- 172.21.15.59:0/395186712 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a001a040 con 0x55646ffcca40 2024-05-30T16:49:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe597e00640 1 -- 172.21.15.59:0/395186712 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a0004850 con 0x55646ffcca40 2024-05-30T16:49:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe597e00640 1 -- 172.21.15.59:0/395186712 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0016680 con 0x55646ffcca40 2024-05-30T16:49:19.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 -- 172.21.15.59:0/395186712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcca40 msgr2=0x55646ffdd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 --2- 172.21.15.59:0/395186712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcca40 0x55646ffdd7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0018000 tx=0x7fe5a0016000 comp rx=0 tx=0).stop 2024-05-30T16:49:19.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 -- 172.21.15.59:0/395186712 shutdown_connections 2024-05-30T16:49:19.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 --2- 172.21.15.59:0/395186712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcca40 0x55646ffdd7b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 --2- 172.21.15.59:0/395186712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ffcc120 0x55646ff7ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 --2- 172.21.15.59:0/395186712 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ff7f650 0x55646ff7e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 -- 172.21.15.59:0/395186712 >> 172.21.15.59:0/395186712 conn(0x55646ffacec0 msgr2=0x55646ff7e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:19.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 -- 172.21.15.59:0/395186712 shutdown_connections 2024-05-30T16:49:19.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 -- 172.21.15.59:0/395186712 wait complete. 2024-05-30T16:49:19.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 -- start start 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 Processor -- start 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ff7f650 0x55646ffe0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 0x55646fff7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 0x55646fff7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55646fdcf730 con 0x55646ffcc120 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55646fd9c9e0 con 0x55646ff7f650 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55646fdd4a50 con 0x55646ffcca40 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5b2519000 10 client.0 _ll_register_callbacks cb 0x7fe5980f0b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe59f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 0x55646fff7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe59f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 0x55646fff7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54598/0 (socket says 172.21.15.59:54598) 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe59f400640 1 -- 172.21.15.59:0/675005386 learned_addr learned my addr 172.21.15.59:0/675005386 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5ad000640 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 0x55646fff7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ff7f650 0x55646ffe0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe59f400640 1 -- 172.21.15.59:0/675005386 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 msgr2=0x55646fff7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe59f400640 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 0x55646fff7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe59f400640 1 -- 172.21.15.59:0/675005386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ff7f650 msgr2=0x55646ffe0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe59f400640 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ff7f650 0x55646ffe0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.098+0000 7fe59f400640 1 -- 172.21.15.59:0/675005386 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646fd56e80 con 0x55646ffcc120 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe59f400640 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 0x55646fff7340 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55646fd657f0 tx=0x7fe590013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4394c4e329c25e89 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe595600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe595600640 1 -- 172.21.15.59:0/675005386 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59001a040 con 0x55646ffcc120 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe595600640 1 -- 172.21.15.59:0/675005386 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe590024da0 con 0x55646ffcc120 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 -- 172.21.15.59:0/675005386 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5a0004850 con 0x55646ffcc120 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe595600640 1 -- 172.21.15.59:0/675005386 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fe59003a050 con 0x55646ffcc120 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 10 client.4563 fetch_fsmap learned FSMap version 7 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 -- 172.21.15.59:0/675005386 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55646fd98b30 con 0x55646ffcc120 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe595600640 1 -- 172.21.15.59:0/675005386 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a0004850 con 0x55646ffcc120 2024-05-30T16:49:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe595600640 1 -- 172.21.15.59:0/675005386 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 7) ==== 3494+0+0 (secure 0 0 0) 0x7fe59003d020 con 0x55646ffcc120 2024-05-30T16:49:19.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 10 client.4563 fetch_fsmap finished waiting for FSMap version 7 2024-05-30T16:49:19.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 10 client.4563 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-30T16:49:19.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 20 client.4563 populate_metadata read hostname 'smithi059' 2024-05-30T16:49:19.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.107:6835/3864508560,v1:172.21.15.107:6837/3864508560] conn(0x55646fff7dc0 0x55647003afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 4 client.4563 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T16:49:19.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 -- 172.21.15.59:0/675005386 --> [v2:172.21.15.107:6835/3864508560,v1:172.21.15.107:6837/3864508560] -- command(tid 0: {"prefix": "status"}) -- 0x55646fddde40 con 0x55646fff7dc0 2024-05-30T16:49:19.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.107:6835/3864508560,v1:172.21.15.107:6837/3864508560] conn(0x55646fff7dc0 0x55647003afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5a7e00640 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.107:6835/3864508560,v1:172.21.15.107:6837/3864508560] conn(0x55646fff7dc0 0x55647003afb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95fd9abc217f957 server_cookie=389d47ac5924babc in_seq=0 out_seq=0 2024-05-30T16:49:19.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe595600640 10 client.4563 ms_handle_connect on v2:172.21.15.107:6835/3864508560 2024-05-30T16:49:19.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe595600640 1 -- 172.21.15.59:0/675005386 <== mds.0 v2:172.21.15.107:6835/3864508560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55646fddde40 con 0x55646fff7dc0 2024-05-30T16:49:19.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe595600640 10 client.4563 handle_command_reply: tid=0 2024-05-30T16:49:19.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 client.4563 shutdown 2024-05-30T16:49:19.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 -- 172.21.15.59:0/675005386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 msgr2=0x55646fff7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 0x55646fff7340 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55646fd657f0 tx=0x7fe590013000 comp rx=0 tx=0).stop 2024-05-30T16:49:19.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 -- 172.21.15.59:0/675005386 shutdown_connections 2024-05-30T16:49:19.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.107:6835/3864508560,v1:172.21.15.107:6837/3864508560] conn(0x55646fff7dc0 0x55647003afb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55646ffcca40 0x55646fff7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55646ffcc120 0x55646fff7340 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 --2- 172.21.15.59:0/675005386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55646ff7f650 0x55646ffe0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe595600640 0 client.4563 ms_handle_reset on v2:172.21.15.107:6835/3864508560 2024-05-30T16:49:19.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 -- 172.21.15.59:0/675005386 >> 172.21.15.59:0/675005386 conn(0x55646ffacec0 msgr2=0x55646ff7e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:19.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 -- 172.21.15.59:0/675005386 shutdown_connections 2024-05-30T16:49:19.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 1 -- 172.21.15.59:0/675005386 wait complete. 2024-05-30T16:49:19.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5b2519000 20 client.4563 trim_cache size 0 max 16384 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4294, 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 14.589216382, 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 7, 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 23, 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 23, 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 20.620163349999999 2024-05-30T16:49:19.113 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:49:19.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5ada00640 1 -- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe5840683b0 msgr2=0x7fe58406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5ada00640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe5840683b0 0x7fe58406a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8161490 tx=0x7fe590009040 comp rx=0 tx=0).stop 2024-05-30T16:49:19.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5ada00640 1 -- 172.21.15.59:0/3723935175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 msgr2=0x7fe5a8153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5ada00640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 0x7fe5a8153800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe59801c360 tx=0x7fe5980192d0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5ada00640 1 -- 172.21.15.59:0/3723935175 shutdown_connections 2024-05-30T16:49:19.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5ada00640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe5840683b0 0x7fe58406a870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5ada00640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5a806e030 0x7fe5a80c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5ada00640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a81f78f0 0x7fe5a806daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5ada00640 1 --2- 172.21.15.59:0/3723935175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe58c0039c0 0x7fe5a8153800 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5ada00640 1 -- 172.21.15.59:0/3723935175 >> 172.21.15.59:0/3723935175 conn(0x7fe5a80b3ec0 msgr2=0x7fe5a815f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:19.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5ada00640 1 -- 172.21.15.59:0/3723935175 shutdown_connections 2024-05-30T16:49:19.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.102+0000 7fe5ada00640 1 -- 172.21.15.59:0/3723935175 wait complete. 2024-05-30T16:49:19.128 INFO:teuthology.run_tasks:Running task sequential... 2024-05-30T16:49:19.137 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-30T16:49:19.137 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-30T16:49:19.138 INFO:teuthology.task.print:Enabling mgr modules 2024-05-30T16:49:19.138 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-30T16:49:19.162 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-30T16:49:19.162 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-30T16:49:19.162 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-30T16:49:19.162 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-30T16:49:19.162 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:19.163 INFO:tasks.ceph_fuse:client.2 config is {} 2024-05-30T16:49:19.163 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-30T16:49:19.163 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-30T16:49:19.163 INFO:tasks.ceph_fuse:client.1 config is {} 2024-05-30T16:49:19.163 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-30T16:49:19.163 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-30T16:49:19.163 INFO:tasks.ceph_fuse:client.3 config is {} 2024-05-30T16:49:19.163 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-30T16:49:19.163 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-30T16:49:19.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:19.163 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-05-30T16:49:19.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:19.174 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2024-05-30T16:49:19.240 INFO:teuthology.orchestra.run.smithi059.stderr:Cannot find device "ceph-brx" 2024-05-30T16:49:19.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:49:19.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:19.242 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-30T16:49:19.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:19.253 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-05-30T16:49:19.324 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-05-30T16:49:19.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:49:19.327 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-30T16:49:19.327 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:49:19.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.462+0000 7fe076600640 1 Processor -- start 2024-05-30T16:49:19.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.462+0000 7fe076600640 1 -- start start 2024-05-30T16:49:19.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.462+0000 7fe076600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe0700d0f30 0x7fe07009ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.462+0000 7fe076600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe07009b080 0x7fe0700cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.462+0000 7fe076600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe07009b900 con 0x7fe07015c7b0 2024-05-30T16:49:19.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.462+0000 7fe076600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe07015cb90 con 0x7fe0700d0f30 2024-05-30T16:49:19.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.462+0000 7fe076600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe0700cd4c0 con 0x7fe07009b080 2024-05-30T16:49:19.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.466+0000 7fe067e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe0700d0f30 0x7fe07009ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.466+0000 7fe075200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe07015c7b0 0x7fe0700d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:54322/0 (socket says 172.21.15.59:54322) 2024-05-30T16:49:19.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.466+0000 7fe075200640 1 -- 172.21.15.59:0/434642592 learned_addr learned my addr 172.21.15.59:0/434642592 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:19.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.466+0000 7fe075c00640 1 --2- 172.21.15.59:0/434642592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe07009b080 0x7fe0700cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.466+0000 7fe067e00640 1 -- 172.21.15.59:0/434642592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe07009b080 msgr2=0x7fe0700cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.466+0000 7fe067e00640 1 --2- 172.21.15.59:0/434642592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe07009b080 0x7fe0700cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.466+0000 7fe067e00640 1 -- 172.21.15.59:0/434642592 >> v1:172.21.15.107:6789/0 conn(0x7fe07015c7b0 legacy=0x7fe0700d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.466+0000 7fe067e00640 1 -- 172.21.15.59:0/434642592 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07009bbe0 con 0x7fe0700d0f30 2024-05-30T16:49:19.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.466+0000 7fe067e00640 1 --2- 172.21.15.59:0/434642592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0700d0f30 0x7fe07009ab40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe0580097c0 tx=0x7fe05801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=945c8cb63ec787d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe06fe00640 1 -- 172.21.15.59:0/434642592 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0580aa5f0 con 0x7fe0700d0f30 2024-05-30T16:49:19.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe06fe00640 1 -- 172.21.15.59:0/434642592 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0580af070 con 0x7fe0700d0f30 2024-05-30T16:49:19.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe06fe00640 1 -- 172.21.15.59:0/434642592 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0580aa9b0 con 0x7fe0700d0f30 2024-05-30T16:49:19.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 -- 172.21.15.59:0/434642592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0700d0f30 msgr2=0x7fe07009ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 --2- 172.21.15.59:0/434642592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0700d0f30 0x7fe07009ab40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe0580097c0 tx=0x7fe05801c470 comp rx=0 tx=0).stop 2024-05-30T16:49:19.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 -- 172.21.15.59:0/434642592 shutdown_connections 2024-05-30T16:49:19.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 --2- 172.21.15.59:0/434642592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe07009b080 0x7fe0700cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 --2- 172.21.15.59:0/434642592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0700d0f30 0x7fe07009ab40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 -- 172.21.15.59:0/434642592 >> 172.21.15.59:0/434642592 conn(0x7fe0700b3ec0 msgr2=0x7fe0700b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:19.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 -- 172.21.15.59:0/434642592 shutdown_connections 2024-05-30T16:49:19.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 -- 172.21.15.59:0/434642592 wait complete. 2024-05-30T16:49:19.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 Processor -- start 2024-05-30T16:49:19.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 -- start start 2024-05-30T16:49:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe07009b080 0x7fe070152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0700d0f30 0x7fe0700ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07015c7b0 0x7fe0701f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0700ce6a0 con 0x7fe07015c7b0 2024-05-30T16:49:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe07009b6a0 con 0x7fe0700d0f30 2024-05-30T16:49:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe076600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe0700ce820 con 0x7fe07009b080 2024-05-30T16:49:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe075c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07015c7b0 0x7fe0701f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe075c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07015c7b0 0x7fe0701f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54602/0 (socket says 172.21.15.59:54602) 2024-05-30T16:49:19.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe075c00640 1 -- 172.21.15.59:0/2554152336 learned_addr learned my addr 172.21.15.59:0/2554152336 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:19.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe075200640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe07009b080 0x7fe070152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe067e00640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0700d0f30 0x7fe0700ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.470+0000 7fe075c00640 1 -- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe07009b080 msgr2=0x7fe070152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe075c00640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe07009b080 0x7fe070152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe075c00640 1 -- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0700d0f30 msgr2=0x7fe0700ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe075c00640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0700d0f30 0x7fe0700ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe075c00640 1 -- 172.21.15.59:0/2554152336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0700c9a10 con 0x7fe07015c7b0 2024-05-30T16:49:19.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe067e00640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0700d0f30 0x7fe0700ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:19.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe075200640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe07009b080 0x7fe070152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:19.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe075c00640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07015c7b0 0x7fe0701f5400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe068009dd0 tx=0x7fe06800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe06d600640 1 -- 172.21.15.59:0/2554152336 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068018020 con 0x7fe07015c7b0 2024-05-30T16:49:19.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe06d600640 1 -- 172.21.15.59:0/2554152336 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe068014480 con 0x7fe07015c7b0 2024-05-30T16:49:19.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe06d600640 1 -- 172.21.15.59:0/2554152336 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068014870 con 0x7fe07015c7b0 2024-05-30T16:49:19.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe076600640 1 -- 172.21.15.59:0/2554152336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0700c9cf0 con 0x7fe07015c7b0 2024-05-30T16:49:19.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe076600640 1 -- 172.21.15.59:0/2554152336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0700ca2b0 con 0x7fe07015c7b0 2024-05-30T16:49:19.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe076600640 1 -- 172.21.15.59:0/2554152336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe070068a90 con 0x7fe07015c7b0 2024-05-30T16:49:19.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe06d600640 1 -- 172.21.15.59:0/2554152336 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe06801b020 con 0x7fe07015c7b0 2024-05-30T16:49:19.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe06d600640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe04c068380 0x7fe04c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe06d600640 1 -- 172.21.15.59:0/2554152336 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe068087660 con 0x7fe07015c7b0 2024-05-30T16:49:19.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.474+0000 7fe075200640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe04c068380 0x7fe04c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.478+0000 7fe075200640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe04c068380 0x7fe04c06a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe060007fd0 tx=0x7fe060007bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.478+0000 7fe06d600640 1 -- 172.21.15.59:0/2554152336 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe068022030 con 0x7fe07015c7b0 2024-05-30T16:49:19.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.682+0000 7fe076600640 1 -- 172.21.15.59:0/2554152336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe0700d03f0 con 0x7fe07015c7b0 2024-05-30T16:49:19.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.682+0000 7fe06d600640 1 -- 172.21.15.59:0/2554152336 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fe068010040 con 0x7fe07015c7b0 2024-05-30T16:49:19.688 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:49:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.686+0000 7fe076600640 1 -- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe04c068380 msgr2=0x7fe04c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.686+0000 7fe076600640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe04c068380 0x7fe04c06a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe060007fd0 tx=0x7fe060007bc0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.686+0000 7fe076600640 1 -- 172.21.15.59:0/2554152336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07015c7b0 msgr2=0x7fe0701f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.686+0000 7fe076600640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07015c7b0 0x7fe0701f5400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe068009dd0 tx=0x7fe06800c490 comp rx=0 tx=0).stop 2024-05-30T16:49:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.686+0000 7fe076600640 1 -- 172.21.15.59:0/2554152336 shutdown_connections 2024-05-30T16:49:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.686+0000 7fe076600640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe04c068380 0x7fe04c06a840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.686+0000 7fe076600640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07015c7b0 0x7fe0701f5400 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.686+0000 7fe076600640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0700d0f30 0x7fe0700ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.686+0000 7fe076600640 1 --2- 172.21.15.59:0/2554152336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe07009b080 0x7fe070152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.686+0000 7fe076600640 1 -- 172.21.15.59:0/2554152336 >> 172.21.15.59:0/2554152336 conn(0x7fe0700b3ec0 msgr2=0x7fe07006fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.686+0000 7fe076600640 1 -- 172.21.15.59:0/2554152336 shutdown_connections 2024-05-30T16:49:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19.686+0000 7fe076600640 1 -- 172.21.15.59:0/2554152336 wait complete. 2024-05-30T16:49:19.709 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:49:19.709 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:49:19.709 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-05-30T16:49:19.709 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T16:49:19.709 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:19.709 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:49:19.709 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:49:19.709 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:49:19.710 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:49:19.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:19.710 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-05-30T16:49:19.719 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:49:19.719 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:49:19.719 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:49:19.719 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:19.719 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-05-30T16:49:19.719 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:19.719 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:19.719 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:19.719 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-05-30T16:49:19.719 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42429sec preferred_lft 42429sec 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T16:49:19.720 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:46:82:05:9a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:19.721 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T16:49:19.721 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:19.722 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-30T16:49:19.722 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:19.722 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:49:19.722 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add name ceph-brx type bridge 2024-05-30T16:49:19.722 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr flush dev ceph-brx 2024-05-30T16:49:19.722 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set ceph-brx up 2024-05-30T16:49:19.722 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-30T16:49:19.722 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:49:19.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:19.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:19.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:19.880 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:49:19.899 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-05-30T16:49:19.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:19.901 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-05-30T16:49:19.969 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-05-30T16:49:19.969 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:49:19.969 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T16:49:19.969 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T16:49:19.969 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T16:49:19.969 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:49:19.970 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:19.970 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:49:19.970 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T16:49:19.970 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T16:49:19.970 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T16:49:19.970 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:49:20.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:20.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:20.106 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-05-30T16:49:20.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:20.115 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2024-05-30T16:49:20.166 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:20.166 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:49:20.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:20.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-30T16:49:20.167 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:49:20.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:20.294 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-30T16:49:20.295 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:20.295 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:49:20.295 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-30T16:49:20.295 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-30T16:49:20.295 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-30T16:49:20.295 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-30T16:49:20.295 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-30T16:49:20.295 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:49:20.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:20.456 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:20.456 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:49:20.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-05-30T16:49:20.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.0 master ceph-brx 2024-05-30T16:49:20.456 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:49:20.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:20.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:20.543 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-30T16:49:20.543 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:49:20.543 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:20.552 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:49:20.553 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:49:20.553 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:20.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:49:20.666 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:49:20.719 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:49:20.719 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:49:20.719 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:49:20.719 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:49:20.719 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:49:20.719 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:20.722 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:20.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:20.723 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:49:20.773 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-30T16:49:20.773 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-30T16:49:20.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:49:20.841 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:49:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:49:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:49:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:49:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:49:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:49:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:49:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:49:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:49:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:49:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:49:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:49:20.892 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:49:20.893 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:49:20.893 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:49:20.893 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:49:20.893 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:49:20.893 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:20.893 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:20.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:20.894 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:49:20.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:2024-05-30T16:49:20.910+0000 7f94840c1580 -1 init, newargv = 0x563a976737a0 newargc=15 2024-05-30T16:49:20.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[34278]: starting ceph client 2024-05-30T16:49:20.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[34278]: starting fuse 2024-05-30T16:49:22.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:49:22.052 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:49:22.108 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:49:22.108 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:49:22.109 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:49:22.109 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:49:22.109 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:49:22.109 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:49:22.109 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:49:22.109 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:49:22.110 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:49:22.110 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:49:22.110 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:49:22.110 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:49:22.110 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:49:22.110 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:49:22.111 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:49:22.111 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:49:22.111 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:49:22.111 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:49:22.111 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:49:22.111 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:49:22.112 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:49:22.112 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:49:22.112 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:49:22.112 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:49:22.112 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:49:22.112 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:49:22.113 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:49:22.113 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:49:22.113 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:49:22.113 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:22.113 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:22.113 INFO:teuthology.orchestra.run.smithi059.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:22.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:22.115 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:49:22.166 INFO:teuthology.orchestra.run.smithi059.stdout:44 2024-05-30T16:49:22.166 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-30T16:49:22.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2024-05-30T16:49:22.167 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2024-05-30T16:49:22.167 DEBUG:teuthology.orchestra.run.smithi059:> import re 2024-05-30T16:49:22.167 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-05-30T16:49:22.167 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2024-05-30T16:49:22.168 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:49:22.168 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2024-05-30T16:49:22.168 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-30T16:49:22.168 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2024-05-30T16:49:22.168 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-30T16:49:22.169 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:49:22.169 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2024-05-30T16:49:22.169 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2024-05-30T16:49:22.169 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2024-05-30T16:49:22.169 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2024-05-30T16:49:22.169 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:49:22.170 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2024-05-30T16:49:22.170 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-30T16:49:22.170 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-30T16:49:22.170 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-30T16:49:22.170 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2024-05-30T16:49:22.170 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2024-05-30T16:49:22.170 DEBUG:teuthology.orchestra.run.smithi059:> return f 2024-05-30T16:49:22.170 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-30T16:49:22.170 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:49:22.170 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.0")) 2024-05-30T16:49:22.170 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-05-30T16:49:22.305 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.0.34278.asok 2024-05-30T16:49:22.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:22.317 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34278.asok 2024-05-30T16:49:22.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:22.318 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34278.asok status 2024-05-30T16:49:22.494 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:49:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2024-05-30T16:49:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "9ed025fbf4406fb54980a0647506b15895b6d863", 2024-05-30T16:49:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-3154-g9ed025fb (9ed025fbf4406fb54980a0647506b15895b6d863) squid (dev)", 2024-05-30T16:49:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "0", 2024-05-30T16:49:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2024-05-30T16:49:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-30T16:49:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "34278", 2024-05-30T16:49:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2024-05-30T16:49:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2024-05-30T16:49:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2024-05-30T16:49:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4575, 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 4575 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1092974642 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:49:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:49:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:49:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1092974642 2024-05-30T16:49:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.4575 192.168.0.1:0/1092974642", 2024-05-30T16:49:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/1092974642", 2024-05-30T16:49:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2024-05-30T16:49:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 7, 2024-05-30T16:49:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 23, 2024-05-30T16:49:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2024-05-30T16:49:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2024-05-30T16:49:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2024-05-30T16:49:22.497 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:49:22.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:49:22.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5c1a00640 1 Processor -- start 2024-05-30T16:49:22.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5c1a00640 1 -- start start 2024-05-30T16:49:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5c1a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5bc0d05b0 0x7ff5bc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5c1a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff5bc09af80 0x7ff5bc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5c1a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5bc070950 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5c1a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff5bc070c30 con 0x7ff5bc09af80 2024-05-30T16:49:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5c1a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff5bc070f10 con 0x7ff5bc0d05b0 2024-05-30T16:49:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5b2000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5bc0d05b0 0x7ff5bc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5baa00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff5bc0d14c0 0x7ff5bc06e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:45166/0 (socket says 172.21.15.59:45166) 2024-05-30T16:49:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5baa00640 1 -- 172.21.15.59:0/205256720 learned_addr learned my addr 172.21.15.59:0/205256720 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5bb400640 1 --2- 172.21.15.59:0/205256720 >> v2:172.21.15.107:3300/0 conn(0x7ff5bc09af80 0x7ff5bc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5ba000640 1 -- 172.21.15.59:0/205256720 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1263630922 0 0) 0x7ff5bc070950 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5ba000640 1 -- 172.21.15.59:0/205256720 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a0003530 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5bb400640 1 -- 172.21.15.59:0/205256720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5bc0d05b0 msgr2=0x7ff5bc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5bb400640 1 --2- 172.21.15.59:0/205256720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5bc0d05b0 0x7ff5bc09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5bb400640 1 -- 172.21.15.59:0/205256720 >> v1:172.21.15.107:6789/0 conn(0x7ff5bc0d14c0 legacy=0x7ff5bc06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5bb400640 1 -- 172.21.15.59:0/205256720 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc06cbd0 con 0x7ff5bc09af80 2024-05-30T16:49:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.646+0000 7ff5b2000640 1 --2- 172.21.15.59:0/205256720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5bc0d05b0 0x7ff5bc09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.650+0000 7ff5bb400640 1 --2- 172.21.15.59:0/205256720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc09af80 0x7ff5bc06d0f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009d90 tx=0x7ff5b401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5121367bf27c8da9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.650+0000 7ff5ba000640 1 -- 172.21.15.59:0/205256720 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40b2070 con 0x7ff5bc09af80 2024-05-30T16:49:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.650+0000 7ff5ba000640 1 -- 172.21.15.59:0/205256720 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b40a5940 con 0x7ff5bc09af80 2024-05-30T16:49:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.650+0000 7ff5ba000640 1 -- 172.21.15.59:0/205256720 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40a5cf0 con 0x7ff5bc09af80 2024-05-30T16:49:22.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.650+0000 7ff5c1a00640 1 -- 172.21.15.59:0/205256720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc09af80 msgr2=0x7ff5bc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:22.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.650+0000 7ff5c1a00640 1 --2- 172.21.15.59:0/205256720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc09af80 0x7ff5bc06d0f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009d90 tx=0x7ff5b401c970 comp rx=0 tx=0).stop 2024-05-30T16:49:22.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.650+0000 7ff5c1a00640 1 -- 172.21.15.59:0/205256720 shutdown_connections 2024-05-30T16:49:22.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.650+0000 7ff5c1a00640 1 --2- 172.21.15.59:0/205256720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc09af80 0x7ff5bc06d0f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:22.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.650+0000 7ff5c1a00640 1 --2- 172.21.15.59:0/205256720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5bc0d05b0 0x7ff5bc09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:22.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.650+0000 7ff5c1a00640 1 -- 172.21.15.59:0/205256720 >> 172.21.15.59:0/205256720 conn(0x7ff5bc0b3f80 msgr2=0x7ff5bc0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:22.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.650+0000 7ff5c1a00640 1 -- 172.21.15.59:0/205256720 shutdown_connections 2024-05-30T16:49:22.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.650+0000 7ff5c1a00640 1 -- 172.21.15.59:0/205256720 wait complete. 2024-05-30T16:49:22.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5c1a00640 1 Processor -- start 2024-05-30T16:49:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5c1a00640 1 -- start start 2024-05-30T16:49:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5c1a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5bc09af80 0x7ff5bc1fb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5c1a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0d05b0 0x7ff5bc15f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5c1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc0d14c0 0x7ff5bc142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5c1a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc06dfc0 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5c1a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc06de40 con 0x7ff5bc0d05b0 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5c1a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff5bc06e140 con 0x7ff5bc09af80 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5bb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc0d14c0 0x7ff5bc142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5baa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5bc09af80 0x7ff5bc1fb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5bb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc0d14c0 0x7ff5bc142f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55818/0 (socket says 172.21.15.59:55818) 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5bb400640 1 -- 172.21.15.59:0/532249143 learned_addr learned my addr 172.21.15.59:0/532249143 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5b2000640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0d05b0 0x7ff5bc15f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5bb400640 1 -- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5bc09af80 msgr2=0x7ff5bc1fb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5bb400640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5bc09af80 0x7ff5bc1fb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5bb400640 1 -- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0d05b0 msgr2=0x7ff5bc15f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:22.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5bb400640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0d05b0 0x7ff5bc15f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:22.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5bb400640 1 -- 172.21.15.59:0/532249143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc15fd70 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5bb400640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc0d14c0 0x7ff5bc142f50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff5b401a5a0 tx=0x7ff5b4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5b3400640 1 -- 172.21.15.59:0/532249143 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40b2040 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5b3400640 1 -- 172.21.15.59:0/532249143 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b40bf070 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5c1a00640 1 -- 172.21.15.59:0/532249143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5bc160050 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5b3400640 1 -- 172.21.15.59:0/532249143 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4003ba0 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.654+0000 7ff5c1a00640 1 -- 172.21.15.59:0/532249143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5bc160610 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.658+0000 7ff5c1a00640 1 -- 172.21.15.59:0/532249143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5bc068a90 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.658+0000 7ff5b3400640 1 -- 172.21.15.59:0/532249143 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff5b4004040 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.658+0000 7ff5b3400640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff598068380 0x7ff59806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.658+0000 7ff5b3400640 1 -- 172.21.15.59:0/532249143 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff5b41216d0 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.658+0000 7ff5baa00640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff598068380 0x7ff59806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:22.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.658+0000 7ff5baa00640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff598068380 0x7ff59806a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac007fd0 tx=0x7ff5ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:22.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.662+0000 7ff5b3400640 1 -- 172.21.15.59:0/532249143 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff5b40c9020 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.862+0000 7ff5c1a00640 1 -- 172.21.15.59:0/532249143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff5bc0d2270 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5b3400640 1 -- 172.21.15.59:0/532249143 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7ff5b4016560 con 0x7ff5bc0d14c0 2024-05-30T16:49:22.870 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:49:22.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5c1a00640 1 -- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff598068380 msgr2=0x7ff59806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:22.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5c1a00640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff598068380 0x7ff59806a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac007fd0 tx=0x7ff5ac009040 comp rx=0 tx=0).stop 2024-05-30T16:49:22.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5c1a00640 1 -- 172.21.15.59:0/532249143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc0d14c0 msgr2=0x7ff5bc142f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:22.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5c1a00640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc0d14c0 0x7ff5bc142f50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff5b401a5a0 tx=0x7ff5b4019710 comp rx=0 tx=0).stop 2024-05-30T16:49:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5c1a00640 1 -- 172.21.15.59:0/532249143 shutdown_connections 2024-05-30T16:49:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5c1a00640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff598068380 0x7ff59806a840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5c1a00640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc0d14c0 0x7ff5bc142f50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5c1a00640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0d05b0 0x7ff5bc15f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5c1a00640 1 --2- 172.21.15.59:0/532249143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5bc09af80 0x7ff5bc1fb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5c1a00640 1 -- 172.21.15.59:0/532249143 >> 172.21.15.59:0/532249143 conn(0x7ff5bc0b3f80 msgr2=0x7ff5bc06ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5c1a00640 1 -- 172.21.15.59:0/532249143 shutdown_connections 2024-05-30T16:49:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:22.866+0000 7ff5c1a00640 1 -- 172.21.15.59:0/532249143 wait complete. 2024-05-30T16:49:22.891 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:49:22.892 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:49:22.892 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-05-30T16:49:22.892 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-30T16:49:22.892 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-30T16:49:22.892 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:49:22.892 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:49:22.892 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:49:22.892 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-30T16:49:22.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:22.893 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-05-30T16:49:22.902 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:49:22.902 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:49:22.902 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:49:22.902 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42426sec preferred_lft 42426sec 2024-05-30T16:49:22.903 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:46:82:05:9a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:22.904 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T16:49:22.905 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:22.905 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:49:22.905 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:22.905 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T16:49:22.905 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:22.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:22.906 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:49:22.963 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-05-30T16:49:22.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:22.965 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-05-30T16:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-05-30T16:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T16:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T16:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T16:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:49:23.019 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:23.019 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:49:23.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T16:49:23.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T16:49:23.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T16:49:23.020 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:49:23.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:23.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:23.158 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-05-30T16:49:23.167 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T16:49:23.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:23.167 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2024-05-30T16:49:23.218 INFO:teuthology.orchestra.run.smithi059.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-30T16:49:23.218 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:23.218 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:49:23.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:49:23.219 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-30T16:49:23.219 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:49:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:23.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:23.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-30T16:49:23.367 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:49:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:49:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:49:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-05-30T16:49:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:23.367 INFO:teuthology.orchestra.run.smithi059.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:49:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 1a:fe:b5:23:14:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-30T16:49:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-30T16:49:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::18fe:b5ff:fe23:1491/64 scope link 2024-05-30T16:49:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:23.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:23.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-30T16:49:23.429 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:49:23.429 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:49:23.429 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:49:23.429 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:23.429 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-05-30T16:49:23.429 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:23.429 INFO:teuthology.orchestra.run.smithi059.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:49:23.429 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 1a:fe:b5:23:14:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-30T16:49:23.429 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-30T16:49:23.430 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:23.430 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::18fe:b5ff:fe23:1491/64 scope link 2024-05-30T16:49:23.430 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:23.431 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-30T16:49:23.431 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:23.431 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:49:23.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-30T16:49:23.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-30T16:49:23.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-30T16:49:23.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-30T16:49:23.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-30T16:49:23.432 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:49:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:23.614 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:23.614 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:49:23.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.1 up 2024-05-30T16:49:23.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.1 master ceph-brx 2024-05-30T16:49:23.614 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:49:23.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:23.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:23.700 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-05-30T16:49:23.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:49:23.700 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-30T16:49:23.753 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-30T16:49:23.754 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:49:23.754 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-30T16:49:23.805 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:49:23.869 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:49:23.923 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:49:23.923 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:49:23.923 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:49:23.923 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:49:23.923 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:49:23.923 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:49:23.923 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:49:23.923 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:49:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:49:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:49:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:49:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:49:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:49:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:49:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:49:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:49:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:49:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:49:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:49:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:49:23.925 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:49:23.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:23.926 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:49:23.977 INFO:teuthology.orchestra.run.smithi059.stdout:44 2024-05-30T16:49:23.977 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-05-30T16:49:23.978 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-05-30T16:49:24.024 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:49:24.045 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:49:24.096 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:49:24.096 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:49:24.096 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:49:24.096 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:49:24.096 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:49:24.096 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:49:24.096 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi059.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:49:24.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:24.099 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:49:24.121 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi059.stderr:2024-05-30T16:49:24.114+0000 7f2611e8e580 -1 init, newargv = 0x56362c938d30 newargc=15 2024-05-30T16:49:24.121 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi059.stderr:ceph-fuse[34423]: starting ceph client 2024-05-30T16:49:24.128 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi059.stderr:ceph-fuse[34423]: starting fuse 2024-05-30T16:49:24.129 INFO:teuthology.orchestra.run.smithi059.stdout:44 2024-05-30T16:49:24.129 INFO:teuthology.orchestra.run.smithi059.stdout:45 2024-05-30T16:49:24.130 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-05-30T16:49:24.130 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2024-05-30T16:49:24.130 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2024-05-30T16:49:24.130 DEBUG:teuthology.orchestra.run.smithi059:> import re 2024-05-30T16:49:24.130 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-30T16:49:24.131 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-30T16:49:24.132 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-30T16:49:24.132 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2024-05-30T16:49:24.132 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2024-05-30T16:49:24.132 DEBUG:teuthology.orchestra.run.smithi059:> return f 2024-05-30T16:49:24.132 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-30T16:49:24.132 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:49:24.132 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.2")) 2024-05-30T16:49:24.132 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-05-30T16:49:24.259 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.2.34423.asok 2024-05-30T16:49:24.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:24.271 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.34423.asok 2024-05-30T16:49:24.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:24.271 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.34423.asok status 2024-05-30T16:49:24.444 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:49:24.444 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2024-05-30T16:49:24.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "9ed025fbf4406fb54980a0647506b15895b6d863", 2024-05-30T16:49:24.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-3154-g9ed025fb (9ed025fbf4406fb54980a0647506b15895b6d863) squid (dev)", 2024-05-30T16:49:24.444 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "2", 2024-05-30T16:49:24.444 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2024-05-30T16:49:24.444 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-05-30T16:49:24.444 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "34423", 2024-05-30T16:49:24.444 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2024-05-30T16:49:24.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:24.444 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4587, 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 4587 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.2:0", 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3145112109 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:49:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.2:0", 2024-05-30T16:49:24.446 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3145112109 2024-05-30T16:49:24.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:24.446 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.4587 192.168.0.2:0/3145112109", 2024-05-30T16:49:24.446 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.2:0/3145112109", 2024-05-30T16:49:24.446 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2024-05-30T16:49:24.446 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 7, 2024-05-30T16:49:24.446 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 23, 2024-05-30T16:49:24.446 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2024-05-30T16:49:24.446 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2024-05-30T16:49:24.446 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2024-05-30T16:49:24.447 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:49:24.459 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:49:24.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.594+0000 7fe9a3e00640 1 Processor -- start 2024-05-30T16:49:24.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.594+0000 7fe9a3e00640 1 -- start start 2024-05-30T16:49:24.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.594+0000 7fe9a3e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe99c15e7e0 0x7fe99c0b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:24.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.594+0000 7fe9a3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 0x7fe99c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.594+0000 7fe9a3e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe99c0b61f0 con 0x7fe99c09af80 2024-05-30T16:49:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.594+0000 7fe9a3e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe99c09b3f0 con 0x7fe99c15e7e0 2024-05-30T16:49:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.594+0000 7fe9a3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c15ebc0 con 0x7fe99c0b73a0 2024-05-30T16:49:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.598+0000 7fe9a0a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 0x7fe99c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.598+0000 7fe9a0a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 0x7fe99c09aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:51588/0 (socket says 172.21.15.59:51588) 2024-05-30T16:49:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.598+0000 7fe9a0a00640 1 -- 172.21.15.59:0/2001004786 learned_addr learned my addr 172.21.15.59:0/2001004786 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.598+0000 7fe9a1400640 1 --2- 172.21.15.59:0/2001004786 >> v2:172.21.15.107:3300/0 conn(0x7fe99c15e7e0 0x7fe99c0b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.598+0000 7fe9a0a00640 1 -- 172.21.15.59:0/2001004786 >> v2:172.21.15.107:3300/0 conn(0x7fe99c15e7e0 msgr2=0x7fe99c0b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.598+0000 7fe9a0a00640 1 --2- 172.21.15.59:0/2001004786 >> v2:172.21.15.107:3300/0 conn(0x7fe99c15e7e0 0x7fe99c0b6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.598+0000 7fe9a0a00640 1 -- 172.21.15.59:0/2001004786 >> v1:172.21.15.107:6789/0 conn(0x7fe99c09af80 legacy=0x7fe99c06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.598+0000 7fe9a0a00640 1 -- 172.21.15.59:0/2001004786 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c15ee60 con 0x7fe99c0b73a0 2024-05-30T16:49:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.598+0000 7fe99be00640 1 -- 172.21.15.59:0/2001004786 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402670418 0 0) 0x7fe9940014a0 con 0x7fe99c09af80 2024-05-30T16:49:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.598+0000 7fe9a1400640 1 --2- 172.21.15.59:0/2001004786 >> v2:172.21.15.107:3300/0 conn(0x7fe99c15e7e0 0x7fe99c0b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:24.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a0a00640 1 --2- 172.21.15.59:0/2001004786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 0x7fe99c09aa40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe988009870 tx=0x7fe98801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3f4fd29e2617884 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe99be00640 1 -- 172.21.15.59:0/2001004786 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9880ab650 con 0x7fe99c0b73a0 2024-05-30T16:49:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe99be00640 1 -- 172.21.15.59:0/2001004786 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9880b0070 con 0x7fe99c0b73a0 2024-05-30T16:49:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe99be00640 1 -- 172.21.15.59:0/2001004786 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9880aba10 con 0x7fe99c0b73a0 2024-05-30T16:49:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 -- 172.21.15.59:0/2001004786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 msgr2=0x7fe99c09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 --2- 172.21.15.59:0/2001004786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 0x7fe99c09aa40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe988009870 tx=0x7fe98801c560 comp rx=0 tx=0).stop 2024-05-30T16:49:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 -- 172.21.15.59:0/2001004786 shutdown_connections 2024-05-30T16:49:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 --2- 172.21.15.59:0/2001004786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 0x7fe99c09aa40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 --2- 172.21.15.59:0/2001004786 >> v2:172.21.15.107:3300/0 conn(0x7fe99c15e7e0 0x7fe99c0b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 -- 172.21.15.59:0/2001004786 >> 172.21.15.59:0/2001004786 conn(0x7fe99c0b41a0 msgr2=0x7fe99c0b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 -- 172.21.15.59:0/2001004786 shutdown_connections 2024-05-30T16:49:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 -- 172.21.15.59:0/2001004786 wait complete. 2024-05-30T16:49:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 Processor -- start 2024-05-30T16:49:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 -- start start 2024-05-30T16:49:24.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c09af80 0x7fe99c1f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:24.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 0x7fe99c1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:24.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe99c15e7e0 0x7fe99c151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:24.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c16b430 con 0x7fe99c09af80 2024-05-30T16:49:24.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c15f9e0 con 0x7fe99c15e7e0 2024-05-30T16:49:24.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c16b5b0 con 0x7fe99c0b73a0 2024-05-30T16:49:24.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c09af80 0x7fe99c1f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:24.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c09af80 0x7fe99c1f78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55828/0 (socket says 172.21.15.59:55828) 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.602+0000 7fe9a1400640 1 -- 172.21.15.59:0/3662004399 learned_addr learned my addr 172.21.15.59:0/3662004399 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a0a00640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 0x7fe99c1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a1e00640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe99c15e7e0 0x7fe99c151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a1400640 1 -- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 msgr2=0x7fe99c1557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a1400640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 0x7fe99c1557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a1400640 1 -- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe99c15e7e0 msgr2=0x7fe99c151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a1400640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe99c15e7e0 0x7fe99c151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a1400640 1 -- 172.21.15.59:0/3662004399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c1509c0 con 0x7fe99c09af80 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a0a00640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 0x7fe99c1557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a1e00640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe99c15e7e0 0x7fe99c151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a1400640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c09af80 0x7fe99c1f78d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe99000e9b0 tx=0x7fe99000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe999600640 1 -- 172.21.15.59:0/3662004399 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe990017070 con 0x7fe99c09af80 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe999600640 1 -- 172.21.15.59:0/3662004399 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99000ca00 con 0x7fe99c09af80 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a3e00640 1 -- 172.21.15.59:0/3662004399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99c14fb10 con 0x7fe99c09af80 2024-05-30T16:49:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe999600640 1 -- 172.21.15.59:0/3662004399 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99000cdd0 con 0x7fe99c09af80 2024-05-30T16:49:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a3e00640 1 -- 172.21.15.59:0/3662004399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99c1500d0 con 0x7fe99c09af80 2024-05-30T16:49:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe9a3e00640 1 -- 172.21.15.59:0/3662004399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99c068a90 con 0x7fe99c09af80 2024-05-30T16:49:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe999600640 1 -- 172.21.15.59:0/3662004399 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe99001a070 con 0x7fe99c09af80 2024-05-30T16:49:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe999600640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe97c068380 0x7fe97c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.606+0000 7fe999600640 1 -- 172.21.15.59:0/3662004399 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe990086cb0 con 0x7fe99c09af80 2024-05-30T16:49:24.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.610+0000 7fe9a0a00640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe97c068380 0x7fe97c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:24.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.610+0000 7fe9a0a00640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe97c068380 0x7fe97c06a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9880af000 tx=0x7fe9880a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.610+0000 7fe999600640 1 -- 172.21.15.59:0/3662004399 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe9900571d0 con 0x7fe99c09af80 2024-05-30T16:49:24.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 -- 172.21.15.59:0/3662004399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe99c169080 con 0x7fe99c09af80 2024-05-30T16:49:24.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe999600640 1 -- 172.21.15.59:0/3662004399 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fe990056ad0 con 0x7fe99c09af80 2024-05-30T16:49:24.818 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:49:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 -- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe97c068380 msgr2=0x7fe97c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe97c068380 0x7fe97c06a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9880af000 tx=0x7fe9880a7000 comp rx=0 tx=0).stop 2024-05-30T16:49:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 -- 172.21.15.59:0/3662004399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c09af80 msgr2=0x7fe99c1f78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c09af80 0x7fe99c1f78d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe99000e9b0 tx=0x7fe99000ee70 comp rx=0 tx=0).stop 2024-05-30T16:49:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 -- 172.21.15.59:0/3662004399 shutdown_connections 2024-05-30T16:49:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe97c068380 0x7fe97c06a840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe99c15e7e0 0x7fe99c151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe99c0b73a0 0x7fe99c1557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 --2- 172.21.15.59:0/3662004399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c09af80 0x7fe99c1f78d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 -- 172.21.15.59:0/3662004399 >> 172.21.15.59:0/3662004399 conn(0x7fe99c0b41a0 msgr2=0x7fe99c0b66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 -- 172.21.15.59:0/3662004399 shutdown_connections 2024-05-30T16:49:24.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:24.814+0000 7fe9a3e00640 1 -- 172.21.15.59:0/3662004399 wait complete. 2024-05-30T16:49:24.840 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:49:24.840 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:49:24.840 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-05-30T16:49:24.840 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-30T16:49:24.841 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-30T16:49:24.841 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:49:24.841 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:49:24.841 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:49:24.841 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-30T16:49:24.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:24.841 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-05-30T16:49:24.851 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:49:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:49:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:49:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-05-30T16:49:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:24.851 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-05-30T16:49:24.852 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-05-30T16:49:24.852 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:24.852 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:49:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-30T16:49:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42426sec preferred_lft 42426sec 2024-05-30T16:49:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-05-30T16:49:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:24.853 INFO:teuthology.orchestra.run.smithi107.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T16:49:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 02:42:e5:a3:48:aa brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T16:49:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:24.854 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-30T16:49:24.854 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:24.854 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-30T16:49:24.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2024-05-30T16:49:24.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2024-05-30T16:49:24.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2024-05-30T16:49:24.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-30T16:49:24.855 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-30T16:49:24.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:25.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:25.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:25.017 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:49:25.035 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-05-30T16:49:25.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:25.038 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-05-30T16:49:25.128 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-05-30T16:49:25.128 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:49:25.128 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-30T16:49:25.128 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-30T16:49:25.128 INFO:teuthology.orchestra.run.smithi107.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-30T16:49:25.128 INFO:teuthology.orchestra.run.smithi107.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T16:49:25.128 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-30T16:49:25.128 INFO:teuthology.orchestra.run.smithi107.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-30T16:49:25.128 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-30T16:49:25.128 INFO:teuthology.orchestra.run.smithi107.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-30T16:49:25.128 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:49:25.129 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:25.129 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-30T16:49:25.129 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-30T16:49:25.129 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-30T16:49:25.129 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-30T16:49:25.129 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-30T16:49:25.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:25.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:25.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:25.225 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-30T16:49:25.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:25.281 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-05-30T16:49:25.336 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:25.336 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-30T16:49:25.336 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:49:25.336 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-30T16:49:25.337 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-30T16:49:25.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:25.467 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-30T16:49:25.467 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:25.467 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-30T16:49:25.467 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-30T16:49:25.467 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-30T16:49:25.467 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-30T16:49:25.467 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-30T16:49:25.468 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-30T16:49:25.468 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-30T16:49:25.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:25.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:25.641 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:25.641 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-30T16:49:25.641 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2024-05-30T16:49:25.642 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2024-05-30T16:49:25.642 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-30T16:49:25.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:25.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:25.772 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-05-30T16:49:25.772 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:49:25.772 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-30T16:49:25.781 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-30T16:49:25.781 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:49:25.781 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-30T16:49:25.835 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-05-30T16:49:25.900 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:49:25.957 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2024-05-30T16:49:25.958 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2024-05-30T16:49:25.958 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2024-05-30T16:49:25.958 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2024-05-30T16:49:25.958 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2024-05-30T16:49:25.958 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2024-05-30T16:49:25.959 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2024-05-30T16:49:25.959 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2024-05-30T16:49:25.959 INFO:teuthology.orchestra.run.smithi107.stdout:/run/lock 2024-05-30T16:49:25.959 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2024-05-30T16:49:25.959 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2024-05-30T16:49:25.959 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2024-05-30T16:49:25.960 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:49:25.960 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2024-05-30T16:49:25.960 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2024-05-30T16:49:25.960 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2024-05-30T16:49:25.960 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2024-05-30T16:49:25.960 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/fs/nfsd 2024-05-30T16:49:25.961 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2024-05-30T16:49:25.961 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2024-05-30T16:49:25.961 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:49:25.961 INFO:teuthology.orchestra.run.smithi107.stdout:/run/rpc_pipefs 2024-05-30T16:49:25.961 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2024-05-30T16:49:25.961 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2024-05-30T16:49:25.962 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-4 2024-05-30T16:49:25.962 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-5 2024-05-30T16:49:25.962 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-6 2024-05-30T16:49:25.962 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-7 2024-05-30T16:49:25.962 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2024-05-30T16:49:25.962 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:49:25.963 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:49:25.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:25.964 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-05-30T16:49:26.016 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-30T16:49:26.017 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-05-30T16:49:26.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-05-30T16:49:26.085 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:49:26.142 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2024-05-30T16:49:26.142 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2024-05-30T16:49:26.142 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2024-05-30T16:49:26.142 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2024-05-30T16:49:26.142 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2024-05-30T16:49:26.142 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2024-05-30T16:49:26.142 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2024-05-30T16:49:26.142 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2024-05-30T16:49:26.142 INFO:teuthology.orchestra.run.smithi107.stdout:/run/lock 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/fs/nfsd 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/run/rpc_pipefs 2024-05-30T16:49:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2024-05-30T16:49:26.144 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2024-05-30T16:49:26.144 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-4 2024-05-30T16:49:26.144 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-5 2024-05-30T16:49:26.144 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-6 2024-05-30T16:49:26.144 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-7 2024-05-30T16:49:26.144 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2024-05-30T16:49:26.144 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:49:26.144 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:49:26.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:26.145 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-05-30T16:49:26.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi107.stderr:2024-05-30T16:49:26.153+0000 7f61a1e46580 -1 init, newargv = 0x555ef9636010 newargc=15 2024-05-30T16:49:26.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi107.stderr:ceph-fuse[33685]: starting ceph client 2024-05-30T16:49:26.165 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi107.stderr:ceph-fuse[33685]: starting fuse 2024-05-30T16:49:26.166 INFO:teuthology.orchestra.run.smithi107.stdout:44 2024-05-30T16:49:26.166 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-30T16:49:26.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo stdin-killer -- python3 -c ' 2024-05-30T16:49:26.166 DEBUG:teuthology.orchestra.run.smithi107:> import glob 2024-05-30T16:49:26.166 DEBUG:teuthology.orchestra.run.smithi107:> import re 2024-05-30T16:49:26.166 DEBUG:teuthology.orchestra.run.smithi107:> import os 2024-05-30T16:49:26.166 DEBUG:teuthology.orchestra.run.smithi107:> import subprocess 2024-05-30T16:49:26.166 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-30T16:49:26.166 DEBUG:teuthology.orchestra.run.smithi107:> def _find_admin_socket(client_name): 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> files = glob.glob(asok_path) 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> # Given a non-glob path, it better be there 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> if "*" not in asok_path: 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> assert(len(files) == 1) 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> return files[0] 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> for f in files: 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> contents = proc_f.read() 2024-05-30T16:49:26.167 DEBUG:teuthology.orchestra.run.smithi107:> if mountpoint in contents: 2024-05-30T16:49:26.168 DEBUG:teuthology.orchestra.run.smithi107:> return f 2024-05-30T16:49:26.168 DEBUG:teuthology.orchestra.run.smithi107:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-30T16:49:26.168 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-30T16:49:26.168 DEBUG:teuthology.orchestra.run.smithi107:> print(_find_admin_socket("client.1")) 2024-05-30T16:49:26.168 DEBUG:teuthology.orchestra.run.smithi107:> ' 2024-05-30T16:49:26.287 INFO:teuthology.orchestra.run.smithi107.stdout:/var/run/ceph/ceph-client.1.33685.asok 2024-05-30T16:49:26.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:26.299 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33685.asok 2024-05-30T16:49:26.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:26.299 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33685.asok status 2024-05-30T16:49:26.468 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-30T16:49:26.468 INFO:teuthology.orchestra.run.smithi107.stdout: "metadata": { 2024-05-30T16:49:26.468 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_sha1": "9ed025fbf4406fb54980a0647506b15895b6d863", 2024-05-30T16:49:26.468 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 19.0.0-3154-g9ed025fb (9ed025fbf4406fb54980a0647506b15895b6d863) squid (dev)", 2024-05-30T16:49:26.468 INFO:teuthology.orchestra.run.smithi107.stdout: "entity_id": "1", 2024-05-30T16:49:26.468 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": "smithi107", 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: "pid": "33685", 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: "root": "/" 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_count": 0, 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_pinned_count": 0, 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 4576, 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: "inst": { 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: "name": { 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "client", 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: "num": 4576 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2024-05-30T16:49:26.469 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 4255527390 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 4255527390 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: "inst_str": "client.4576 192.168.0.1:0/4255527390", 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: "addr_str": "192.168.0.1:0/4255527390", 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: "inode_count": 1, 2024-05-30T16:49:26.470 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_epoch": 7, 2024-05-30T16:49:26.471 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch": 23, 2024-05-30T16:49:26.471 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch_barrier": 0, 2024-05-30T16:49:26.471 INFO:teuthology.orchestra.run.smithi107.stdout: "blocklisted": false, 2024-05-30T16:49:26.471 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs" 2024-05-30T16:49:26.471 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-30T16:49:26.483 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:49:26.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.630+0000 7fcc56600640 1 Processor -- start 2024-05-30T16:49:26.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.630+0000 7fcc56600640 1 -- start start 2024-05-30T16:49:26.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.630+0000 7fcc56600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc50159df0 0x7fcc500ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:26.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.630+0000 7fcc56600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc5015a1d0 0x7fcc500ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:26.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.630+0000 7fcc56600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5015d730 con 0x7fcc500b3e50 2024-05-30T16:49:26.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.630+0000 7fcc56600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fcc500b3370 con 0x7fcc50159df0 2024-05-30T16:49:26.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.630+0000 7fcc56600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcc500b3650 con 0x7fcc5015a1d0 2024-05-30T16:49:26.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.630+0000 7fcc4f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc50159df0 0x7fcc500ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:26.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.630+0000 7fcc4fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcc500b3e50 0x7fcc5015ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45360/0 (socket says 172.21.15.59:45360) 2024-05-30T16:49:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.630+0000 7fcc4fe00640 1 -- 172.21.15.59:0/3449082358 learned_addr learned my addr 172.21.15.59:0/3449082358 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.630+0000 7fcc47e00640 1 --2- 172.21.15.59:0/3449082358 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc5015a1d0 0x7fcc500ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc4f400640 1 -- 172.21.15.59:0/3449082358 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc5015a1d0 msgr2=0x7fcc500ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc4f400640 1 --2- 172.21.15.59:0/3449082358 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc5015a1d0 0x7fcc500ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc4f400640 1 -- 172.21.15.59:0/3449082358 >> v1:172.21.15.59:6789/0 conn(0x7fcc500b3e50 legacy=0x7fcc5015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc4f400640 1 -- 172.21.15.59:0/3449082358 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc500b3930 con 0x7fcc50159df0 2024-05-30T16:49:26.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc4ea00640 1 -- 172.21.15.59:0/3449082358 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2672116749 0 0) 0x7fcc5015d730 con 0x7fcc500b3e50 2024-05-30T16:49:26.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc4f400640 1 --2- 172.21.15.59:0/3449082358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc50159df0 0x7fcc500ad1b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc400097c0 tx=0x7fcc4001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8af8641b474a80 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:26.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc4ea00640 1 -- 172.21.15.59:0/3449082358 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400b0070 con 0x7fcc50159df0 2024-05-30T16:49:26.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc4ea00640 1 -- 172.21.15.59:0/3449082358 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc400ab600 con 0x7fcc50159df0 2024-05-30T16:49:26.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc4ea00640 1 -- 172.21.15.59:0/3449082358 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400ab9d0 con 0x7fcc50159df0 2024-05-30T16:49:26.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc56600640 1 -- 172.21.15.59:0/3449082358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc50159df0 msgr2=0x7fcc500ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:26.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc56600640 1 --2- 172.21.15.59:0/3449082358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc50159df0 0x7fcc500ad1b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc400097c0 tx=0x7fcc4001c4a0 comp rx=0 tx=0).stop 2024-05-30T16:49:26.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc56600640 1 -- 172.21.15.59:0/3449082358 shutdown_connections 2024-05-30T16:49:26.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc56600640 1 --2- 172.21.15.59:0/3449082358 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc5015a1d0 0x7fcc500ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:26.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc56600640 1 --2- 172.21.15.59:0/3449082358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc50159df0 0x7fcc500ad1b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:26.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.634+0000 7fcc56600640 1 -- 172.21.15.59:0/3449082358 >> 172.21.15.59:0/3449082358 conn(0x7fcc500b22d0 msgr2=0x7fcc500b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:26.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc56600640 1 -- 172.21.15.59:0/3449082358 shutdown_connections 2024-05-30T16:49:26.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc56600640 1 -- 172.21.15.59:0/3449082358 wait complete. 2024-05-30T16:49:26.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc56600640 1 Processor -- start 2024-05-30T16:49:26.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc56600640 1 -- start start 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc56600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc500b3e50 0x7fcc50148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc56600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc50159df0 0x7fcc50165d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc56600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5015a1d0 0x7fcc5015fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc56600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5015e720 con 0x7fcc5015a1d0 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc56600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5015e5a0 con 0x7fcc500b3e50 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc56600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5015e8a0 con 0x7fcc50159df0 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc4fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5015a1d0 0x7fcc5015fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc4fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5015a1d0 0x7fcc5015fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55846/0 (socket says 172.21.15.59:55846) 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc4fe00640 1 -- 172.21.15.59:0/2275720871 learned_addr learned my addr 172.21.15.59:0/2275720871 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc4f400640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc500b3e50 0x7fcc50148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc47e00640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc50159df0 0x7fcc50165d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc4fe00640 1 -- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc50159df0 msgr2=0x7fcc50165d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:26.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc4fe00640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc50159df0 0x7fcc50165d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:26.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc4fe00640 1 -- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc500b3e50 msgr2=0x7fcc50148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:26.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc4fe00640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc500b3e50 0x7fcc50148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:26.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc4fe00640 1 -- 172.21.15.59:0/2275720871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc50149270 con 0x7fcc5015a1d0 2024-05-30T16:49:26.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc4f400640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc500b3e50 0x7fcc50148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:26.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc4fe00640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5015a1d0 0x7fcc5015fc20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800c7a0 tx=0x7fcc4800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:26.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc47400640 1 -- 172.21.15.59:0/2275720871 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48018070 con 0x7fcc5015a1d0 2024-05-30T16:49:26.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc47400640 1 -- 172.21.15.59:0/2275720871 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc4800a640 con 0x7fcc5015a1d0 2024-05-30T16:49:26.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc56600640 1 -- 172.21.15.59:0/2275720871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc50159630 con 0x7fcc5015a1d0 2024-05-30T16:49:26.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.638+0000 7fcc47400640 1 -- 172.21.15.59:0/2275720871 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800aab0 con 0x7fcc5015a1d0 2024-05-30T16:49:26.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.642+0000 7fcc56600640 1 -- 172.21.15.59:0/2275720871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc50159070 con 0x7fcc5015a1d0 2024-05-30T16:49:26.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.642+0000 7fcc56600640 1 -- 172.21.15.59:0/2275720871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc50068a90 con 0x7fcc5015a1d0 2024-05-30T16:49:26.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.642+0000 7fcc47400640 1 -- 172.21.15.59:0/2275720871 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcc4801b070 con 0x7fcc5015a1d0 2024-05-30T16:49:26.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.642+0000 7fcc47400640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc2c068380 0x7fcc2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:26.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.642+0000 7fcc47400640 1 -- 172.21.15.59:0/2275720871 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcc48085f70 con 0x7fcc5015a1d0 2024-05-30T16:49:26.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.642+0000 7fcc4f400640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc2c068380 0x7fcc2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:26.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.642+0000 7fcc4f400640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc2c068380 0x7fcc2c06a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc400ad000 tx=0x7fcc400a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:26.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.646+0000 7fcc47400640 1 -- 172.21.15.59:0/2275720871 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcc48055ed0 con 0x7fcc5015a1d0 2024-05-30T16:49:26.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.850+0000 7fcc56600640 1 -- 172.21.15.59:0/2275720871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcc50152aa0 con 0x7fcc5015a1d0 2024-05-30T16:49:26.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.850+0000 7fcc47400640 1 -- 172.21.15.59:0/2275720871 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fcc4805a1d0 con 0x7fcc5015a1d0 2024-05-30T16:49:26.856 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:49:26.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.854+0000 7fcc56600640 1 -- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc2c068380 msgr2=0x7fcc2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.854+0000 7fcc56600640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc2c068380 0x7fcc2c06a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc400ad000 tx=0x7fcc400a6000 comp rx=0 tx=0).stop 2024-05-30T16:49:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.854+0000 7fcc56600640 1 -- 172.21.15.59:0/2275720871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5015a1d0 msgr2=0x7fcc5015fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.854+0000 7fcc56600640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5015a1d0 0x7fcc5015fc20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800c7a0 tx=0x7fcc4800cc60 comp rx=0 tx=0).stop 2024-05-30T16:49:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.854+0000 7fcc56600640 1 -- 172.21.15.59:0/2275720871 shutdown_connections 2024-05-30T16:49:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.854+0000 7fcc56600640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc2c068380 0x7fcc2c06a840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.854+0000 7fcc56600640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5015a1d0 0x7fcc5015fc20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.854+0000 7fcc56600640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc50159df0 0x7fcc50165d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.854+0000 7fcc56600640 1 --2- 172.21.15.59:0/2275720871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc500b3e50 0x7fcc50148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.854+0000 7fcc56600640 1 -- 172.21.15.59:0/2275720871 >> 172.21.15.59:0/2275720871 conn(0x7fcc500b22d0 msgr2=0x7fcc500cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.854+0000 7fcc56600640 1 -- 172.21.15.59:0/2275720871 shutdown_connections 2024-05-30T16:49:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:26.854+0000 7fcc56600640 1 -- 172.21.15.59:0/2275720871 wait complete. 2024-05-30T16:49:26.877 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:49:26.877 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:49:26.878 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-05-30T16:49:26.878 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-30T16:49:26.878 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-30T16:49:26.878 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:49:26.878 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:49:26.878 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:49:26.878 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-30T16:49:26.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:26.878 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-05-30T16:49:26.887 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:49:26.887 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:49:26.888 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42424sec preferred_lft 42424sec 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 02:42:e5:a3:48:aa brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:26.889 INFO:teuthology.orchestra.run.smithi107.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:49:26.890 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:49:26.890 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-05-30T16:49:26.890 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:26.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:26.890 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:49:26.946 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-05-30T16:49:26.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:26.948 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-05-30T16:49:27.002 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-05-30T16:49:27.002 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:49:27.002 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-30T16:49:27.002 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-30T16:49:27.003 INFO:teuthology.orchestra.run.smithi107.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-30T16:49:27.003 INFO:teuthology.orchestra.run.smithi107.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T16:49:27.003 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-30T16:49:27.003 INFO:teuthology.orchestra.run.smithi107.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-30T16:49:27.003 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-30T16:49:27.003 INFO:teuthology.orchestra.run.smithi107.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-30T16:49:27.003 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:49:27.003 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:27.004 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-30T16:49:27.004 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-30T16:49:27.004 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-30T16:49:27.004 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-30T16:49:27.004 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-30T16:49:27.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:27.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:27.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:27.142 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-30T16:49:27.192 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-30T16:49:27.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:27.193 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-05-30T16:49:27.247 INFO:teuthology.orchestra.run.smithi107.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-30T16:49:27.248 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:27.248 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-30T16:49:27.248 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-30T16:49:27.248 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-30T16:49:27.249 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-30T16:49:27.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:27.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:27.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:27.379 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-30T16:49:27.398 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-05-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi107.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 1e:a7:b0:ee:07:d1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::1ca7:b0ff:feee:7d1/64 scope link 2024-05-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:27.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:27.401 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-30T16:49:27.467 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:49:27.467 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:49:27.467 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:49:27.467 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:27.467 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-05-30T16:49:27.467 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:27.468 INFO:teuthology.orchestra.run.smithi107.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:49:27.468 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 1e:a7:b0:ee:07:d1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-30T16:49:27.468 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-30T16:49:27.468 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:27.468 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::1ca7:b0ff:feee:7d1/64 scope link 2024-05-30T16:49:27.468 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:27.469 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-30T16:49:27.469 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:27.469 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-30T16:49:27.470 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-30T16:49:27.470 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-30T16:49:27.470 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-30T16:49:27.470 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-30T16:49:27.470 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-30T16:49:27.470 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-30T16:49:27.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:27.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:27.651 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:27.651 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-30T16:49:27.651 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.1 up 2024-05-30T16:49:27.651 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.1 master ceph-brx 2024-05-30T16:49:27.651 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-30T16:49:27.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:27.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:27.732 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-05-30T16:49:27.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:49:27.733 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-30T16:49:27.784 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-30T16:49:27.784 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:49:27.784 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-30T16:49:27.839 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-05-30T16:49:27.900 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:49:27.949 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2024-05-30T16:49:27.949 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2024-05-30T16:49:27.949 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2024-05-30T16:49:27.949 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/run/lock 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2024-05-30T16:49:27.950 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/fs/nfsd 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/run/rpc_pipefs 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-4 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-5 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-6 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-7 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2024-05-30T16:49:27.951 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:49:27.952 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:49:27.952 INFO:teuthology.orchestra.run.smithi107.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-30T16:49:27.952 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-30T16:49:27.952 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-30T16:49:27.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:27.953 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-05-30T16:49:28.003 INFO:teuthology.orchestra.run.smithi107.stdout:44 2024-05-30T16:49:28.003 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-05-30T16:49:28.004 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-05-30T16:49:28.050 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-05-30T16:49:28.071 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:49:28.121 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2024-05-30T16:49:28.121 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2024-05-30T16:49:28.121 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/run/lock 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2024-05-30T16:49:28.122 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/fs/nfsd 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/run/rpc_pipefs 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-4 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-5 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-6 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-7 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:49:28.123 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:49:28.124 INFO:teuthology.orchestra.run.smithi107.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-30T16:49:28.124 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-30T16:49:28.124 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-30T16:49:28.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:28.125 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-05-30T16:49:28.143 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi107.stderr:2024-05-30T16:49:28.137+0000 7f81e40a8580 -1 init, newargv = 0x558fdc822d40 newargc=15 2024-05-30T16:49:28.143 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi107.stderr:ceph-fuse[33798]: starting ceph client 2024-05-30T16:49:28.151 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi107.stderr:ceph-fuse[33798]: starting fuse 2024-05-30T16:49:28.152 INFO:teuthology.orchestra.run.smithi107.stdout:44 2024-05-30T16:49:28.152 INFO:teuthology.orchestra.run.smithi107.stdout:45 2024-05-30T16:49:28.152 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> sudo stdin-killer -- python3 -c ' 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> import glob 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> import re 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> import os 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> import subprocess 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> def _find_admin_socket(client_name): 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> files = glob.glob(asok_path) 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> # Given a non-glob path, it better be there 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> if "*" not in asok_path: 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> assert(len(files) == 1) 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> return files[0] 2024-05-30T16:49:28.153 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-30T16:49:28.154 DEBUG:teuthology.orchestra.run.smithi107:> for f in files: 2024-05-30T16:49:28.154 DEBUG:teuthology.orchestra.run.smithi107:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-30T16:49:28.154 DEBUG:teuthology.orchestra.run.smithi107:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-30T16:49:28.154 DEBUG:teuthology.orchestra.run.smithi107:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-30T16:49:28.154 DEBUG:teuthology.orchestra.run.smithi107:> contents = proc_f.read() 2024-05-30T16:49:28.154 DEBUG:teuthology.orchestra.run.smithi107:> if mountpoint in contents: 2024-05-30T16:49:28.154 DEBUG:teuthology.orchestra.run.smithi107:> return f 2024-05-30T16:49:28.154 DEBUG:teuthology.orchestra.run.smithi107:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-30T16:49:28.154 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-30T16:49:28.154 DEBUG:teuthology.orchestra.run.smithi107:> print(_find_admin_socket("client.3")) 2024-05-30T16:49:28.154 DEBUG:teuthology.orchestra.run.smithi107:> ' 2024-05-30T16:49:28.279 INFO:teuthology.orchestra.run.smithi107.stdout:/var/run/ceph/ceph-client.3.33798.asok 2024-05-30T16:49:28.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-30T16:49:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:28.291 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.33798.asok 2024-05-30T16:49:28.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:28.291 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.33798.asok status 2024-05-30T16:49:28.459 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-30T16:49:28.459 INFO:teuthology.orchestra.run.smithi107.stdout: "metadata": { 2024-05-30T16:49:28.459 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_sha1": "9ed025fbf4406fb54980a0647506b15895b6d863", 2024-05-30T16:49:28.459 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 19.0.0-3154-g9ed025fb (9ed025fbf4406fb54980a0647506b15895b6d863) squid (dev)", 2024-05-30T16:49:28.459 INFO:teuthology.orchestra.run.smithi107.stdout: "entity_id": "3", 2024-05-30T16:49:28.459 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": "smithi107", 2024-05-30T16:49:28.459 INFO:teuthology.orchestra.run.smithi107.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-05-30T16:49:28.459 INFO:teuthology.orchestra.run.smithi107.stdout: "pid": "33798", 2024-05-30T16:49:28.459 INFO:teuthology.orchestra.run.smithi107.stdout: "root": "/" 2024-05-30T16:49:28.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-30T16:49:28.459 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_count": 0, 2024-05-30T16:49:28.459 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_pinned_count": 0, 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 4472, 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: "inst": { 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: "name": { 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "client", 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: "num": 4472 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.2:0", 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 2303516280 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2024-05-30T16:49:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-05-30T16:49:28.461 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.2:0", 2024-05-30T16:49:28.461 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 2303516280 2024-05-30T16:49:28.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-30T16:49:28.461 INFO:teuthology.orchestra.run.smithi107.stdout: "inst_str": "client.4472 192.168.0.2:0/2303516280", 2024-05-30T16:49:28.461 INFO:teuthology.orchestra.run.smithi107.stdout: "addr_str": "192.168.0.2:0/2303516280", 2024-05-30T16:49:28.461 INFO:teuthology.orchestra.run.smithi107.stdout: "inode_count": 1, 2024-05-30T16:49:28.461 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_epoch": 7, 2024-05-30T16:49:28.461 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch": 23, 2024-05-30T16:49:28.461 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch_barrier": 0, 2024-05-30T16:49:28.461 INFO:teuthology.orchestra.run.smithi107.stdout: "blocklisted": false, 2024-05-30T16:49:28.461 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs" 2024-05-30T16:49:28.461 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-30T16:49:28.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:28.473 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2024-05-30T16:49:28.473 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:28.484 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2024-05-30T16:49:28.484 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:28.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:28.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:28.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:28.552 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2024-05-30T16:49:28.552 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.2 2024-05-30T16:49:28.603 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2024-05-30T16:49:28.603 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-05-30T16:49:28.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:28.603 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-30T16:49:28.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:28.675 DEBUG:teuthology.orchestra.run.smithi107:> stat --file-system '--printf=%T 2024-05-30T16:49:28.675 DEBUG:teuthology.orchestra.run.smithi107:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-30T16:49:28.684 INFO:teuthology.orchestra.run.smithi107.stdout:fuseblk 2024-05-30T16:49:28.685 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-30T16:49:28.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:28.685 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-30T16:49:28.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:28.747 DEBUG:teuthology.orchestra.run.smithi107:> stat --file-system '--printf=%T 2024-05-30T16:49:28.747 DEBUG:teuthology.orchestra.run.smithi107:> ' -- /home/ubuntu/cephtest/mnt.3 2024-05-30T16:49:28.800 INFO:teuthology.orchestra.run.smithi107.stdout:fuseblk 2024-05-30T16:49:28.800 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-05-30T16:49:28.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:28.801 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-30T16:49:28.867 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-30T16:49:28.945 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that when one clone is in progress, one progress bar is printed 2024-05-30T16:49:28.946 INFO:tasks.cephfs_test_runner:test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:49:28.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bdb200640 1 Processor -- start 2024-05-30T16:49:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bdb200640 1 -- start start 2024-05-30T16:49:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bdb200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0bdc15c7b0 0x7f0bdc0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bdb200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0bdc09b250 0x7f0bdc0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bdb200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bdc09b660 con 0x7f0bdc0d0d60 2024-05-30T16:49:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bdb200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0bdc15cb90 con 0x7f0bdc09b250 2024-05-30T16:49:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bdb200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0bdc0cd4c0 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bda800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0bdc09b250 0x7f0bdc0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bda800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0bdc09b250 0x7f0bdc0cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55858/0 (socket says 172.21.15.59:55858) 2024-05-30T16:49:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bda800640 1 -- 172.21.15.59:0/2291017300 learned_addr learned my addr 172.21.15.59:0/2291017300 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bd9e00640 1 --2- 172.21.15.59:0/2291017300 >> v2:172.21.15.107:3300/0 conn(0x7f0bdc15c7b0 0x7f0bdc0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bda800640 1 -- 172.21.15.59:0/2291017300 >> v2:172.21.15.107:3300/0 conn(0x7f0bdc15c7b0 msgr2=0x7f0bdc0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bda800640 1 --2- 172.21.15.59:0/2291017300 >> v2:172.21.15.107:3300/0 conn(0x7f0bdc15c7b0 0x7f0bdc0d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bda800640 1 -- 172.21.15.59:0/2291017300 >> v1:172.21.15.107:6789/0 conn(0x7f0bdc0d0d60 legacy=0x7f0bdc09ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.094+0000 7f0bda800640 1 -- 172.21.15.59:0/2291017300 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc09b900 con 0x7f0bdc09b250 2024-05-30T16:49:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.098+0000 7f0bda800640 1 --2- 172.21.15.59:0/2291017300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc09b250 0x7f0bdc0cd950 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc073720 tx=0x7f0bd401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ccb820f166d3f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.098+0000 7f0bd8a00640 1 -- 172.21.15.59:0/2291017300 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40a57a0 con 0x7f0bdc09b250 2024-05-30T16:49:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.098+0000 7f0bd8a00640 1 -- 172.21.15.59:0/2291017300 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd40a5940 con 0x7f0bdc09b250 2024-05-30T16:49:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.098+0000 7f0bd8a00640 1 -- 172.21.15.59:0/2291017300 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40a5d10 con 0x7f0bdc09b250 2024-05-30T16:49:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.098+0000 7f0bdb200640 1 -- 172.21.15.59:0/2291017300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc09b250 msgr2=0x7f0bdc0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.098+0000 7f0bdb200640 1 --2- 172.21.15.59:0/2291017300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc09b250 0x7f0bdc0cd950 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc073720 tx=0x7f0bd401c9f0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.098+0000 7f0bdb200640 1 -- 172.21.15.59:0/2291017300 shutdown_connections 2024-05-30T16:49:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.098+0000 7f0bdb200640 1 --2- 172.21.15.59:0/2291017300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc09b250 0x7f0bdc0cd950 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.098+0000 7f0bdb200640 1 --2- 172.21.15.59:0/2291017300 >> v2:172.21.15.107:3300/0 conn(0x7f0bdc15c7b0 0x7f0bdc0d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.098+0000 7f0bdb200640 1 -- 172.21.15.59:0/2291017300 >> 172.21.15.59:0/2291017300 conn(0x7f0bdc0b3ec0 msgr2=0x7f0bdc0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:29.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.098+0000 7f0bdb200640 1 -- 172.21.15.59:0/2291017300 shutdown_connections 2024-05-30T16:49:29.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.098+0000 7f0bdb200640 1 -- 172.21.15.59:0/2291017300 wait complete. 2024-05-30T16:49:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bdb200640 1 Processor -- start 2024-05-30T16:49:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bdb200640 1 -- start start 2024-05-30T16:49:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bdb200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bdc09b250 0x7f0bdc153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bdb200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0bdc0d0d60 0x7f0bdc0c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bdb200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc15c7b0 0x7f0bdc0c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bdb200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc0ce820 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bdb200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc0ce6a0 con 0x7f0bdc0d0d60 2024-05-30T16:49:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bdb200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0bdc0ce9a0 con 0x7f0bdc09b250 2024-05-30T16:49:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bda800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc15c7b0 0x7f0bdc0c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bda800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc15c7b0 0x7f0bdc0c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55872/0 (socket says 172.21.15.59:55872) 2024-05-30T16:49:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bda800640 1 -- 172.21.15.59:0/2062923479 learned_addr learned my addr 172.21.15.59:0/2062923479 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bd9e00640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bdc09b250 0x7f0bdc153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bd9400640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0bdc0d0d60 0x7f0bdc0c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bda800640 1 -- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bdc09b250 msgr2=0x7f0bdc153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bda800640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bdc09b250 0x7f0bdc153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bda800640 1 -- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0bdc0d0d60 msgr2=0x7f0bdc0c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bda800640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0bdc0d0d60 0x7f0bdc0c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bda800640 1 -- 172.21.15.59:0/2062923479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc0c8a80 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bda800640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc15c7b0 0x7f0bdc0c8440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40af040 tx=0x7f0bd4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bd2000640 1 -- 172.21.15.59:0/2062923479 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40b8670 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bd2000640 1 -- 172.21.15.59:0/2062923479 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd40be070 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bd2000640 1 -- 172.21.15.59:0/2062923479 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40b8a50 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bdb200640 1 -- 172.21.15.59:0/2062923479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bdc0c8d60 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.102+0000 7f0bdb200640 1 -- 172.21.15.59:0/2062923479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bdc142940 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.106+0000 7f0bdb200640 1 -- 172.21.15.59:0/2062923479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bdc068a90 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.106+0000 7f0bd2000640 1 -- 172.21.15.59:0/2062923479 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0bd40b8bf0 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.106+0000 7f0bd2000640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0bbc068380 0x7f0bbc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.106+0000 7f0bd2000640 1 -- 172.21.15.59:0/2062923479 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0bd4121a80 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.106+0000 7f0bd9e00640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0bbc068380 0x7f0bbc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.106+0000 7f0bd9e00640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0bbc068380 0x7f0bbc06a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0079c0 tx=0x7f0bcc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:29.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.110+0000 7f0bd2000640 1 -- 172.21.15.59:0/2062923479 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0bd40165e0 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 -- 172.21.15.59:0/2062923479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0bdc0d03f0 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bd2000640 1 -- 172.21.15.59:0/2062923479 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f0bd40f1af0 con 0x7f0bdc15c7b0 2024-05-30T16:49:29.283 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:29.283 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":23,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:49:05.525706+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:01.850911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:02.883949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:29.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 -- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0bbc068380 msgr2=0x7f0bbc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0bbc068380 0x7f0bbc06a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0079c0 tx=0x7f0bcc008040 comp rx=0 tx=0).stop 2024-05-30T16:49:29.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 -- 172.21.15.59:0/2062923479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc15c7b0 msgr2=0x7f0bdc0c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc15c7b0 0x7f0bdc0c8440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40af040 tx=0x7f0bd4019790 comp rx=0 tx=0).stop 2024-05-30T16:49:29.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 -- 172.21.15.59:0/2062923479 shutdown_connections 2024-05-30T16:49:29.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0bbc068380 0x7f0bbc06a840 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc15c7b0 0x7f0bdc0c8440 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0bdc0d0d60 0x7f0bdc0c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 --2- 172.21.15.59:0/2062923479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bdc09b250 0x7f0bdc153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 -- 172.21.15.59:0/2062923479 >> 172.21.15.59:0/2062923479 conn(0x7f0bdc0b3ec0 msgr2=0x7f0bdc0b75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:29.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 -- 172.21.15.59:0/2062923479 shutdown_connections 2024-05-30T16:49:29.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.278+0000 7f0bdb200640 1 -- 172.21.15.59:0/2062923479 wait complete. 2024-05-30T16:49:29.306 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T16:48:53.098546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T16:49:01.850911+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T16:49:02.883949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T16:49:29.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T16:49:29.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.442+0000 7fb480800640 1 Processor -- start 2024-05-30T16:49:29.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.442+0000 7fb480800640 1 -- start start 2024-05-30T16:49:29.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb480800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb47809aa40 0x7fb4780b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb480800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb478160190 con 0x7fb47815fdb0 2024-05-30T16:49:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb480800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4780b3c20 con 0x7fb4780b3840 2024-05-30T16:49:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb480800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb4780b2ea0 con 0x7fb47809aa40 2024-05-30T16:49:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb47de00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb47815fdb0 0x7fb4780b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45372/0 (socket says 172.21.15.59:45372) 2024-05-30T16:49:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb47de00640 1 -- 172.21.15.59:0/1604307317 learned_addr learned my addr 172.21.15.59:0/1604307317 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb47d400640 1 --2- 172.21.15.59:0/1604307317 >> v2:172.21.15.107:3300/0 conn(0x7fb47809aa40 0x7fb4780b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb47ca00640 1 -- 172.21.15.59:0/1604307317 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1746072093 0 0) 0x7fb478160190 con 0x7fb47815fdb0 2024-05-30T16:49:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb47ca00640 1 -- 172.21.15.59:0/1604307317 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb460003530 con 0x7fb47815fdb0 2024-05-30T16:49:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb47ca00640 1 -- 172.21.15.59:0/1604307317 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077717529 0 0) 0x7fb4780b3c20 con 0x7fb4780b3840 2024-05-30T16:49:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb47ca00640 1 -- 172.21.15.59:0/1604307317 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb478160190 con 0x7fb4780b3840 2024-05-30T16:49:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb47d400640 1 -- 172.21.15.59:0/1604307317 >> v1:172.21.15.107:6789/0 conn(0x7fb4780b3840 legacy=0x7fb4780cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb47d400640 1 -- 172.21.15.59:0/1604307317 >> v1:172.21.15.59:6789/0 conn(0x7fb47815fdb0 legacy=0x7fb4780b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.446+0000 7fb47d400640 1 -- 172.21.15.59:0/1604307317 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4780b2600 con 0x7fb47809aa40 2024-05-30T16:49:29.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb47d400640 1 --2- 172.21.15.59:0/1604307317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb47809aa40 0x7fb4780b3300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb4680097c0 tx=0x7fb46801c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fe9fde23690166d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:29.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb47ca00640 1 -- 172.21.15.59:0/1604307317 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4680b0070 con 0x7fb47809aa40 2024-05-30T16:49:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb47ca00640 1 -- 172.21.15.59:0/1604307317 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb468004230 con 0x7fb47809aa40 2024-05-30T16:49:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb47ca00640 1 -- 172.21.15.59:0/1604307317 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb468003620 con 0x7fb47809aa40 2024-05-30T16:49:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb480800640 1 -- 172.21.15.59:0/1604307317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb47809aa40 msgr2=0x7fb4780b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb480800640 1 --2- 172.21.15.59:0/1604307317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb47809aa40 0x7fb4780b3300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb4680097c0 tx=0x7fb46801c350 comp rx=0 tx=0).stop 2024-05-30T16:49:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb480800640 1 -- 172.21.15.59:0/1604307317 shutdown_connections 2024-05-30T16:49:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb480800640 1 --2- 172.21.15.59:0/1604307317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb47809aa40 0x7fb4780b3300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb480800640 1 -- 172.21.15.59:0/1604307317 >> 172.21.15.59:0/1604307317 conn(0x7fb4780d24c0 msgr2=0x7fb4780d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb480800640 1 -- 172.21.15.59:0/1604307317 shutdown_connections 2024-05-30T16:49:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb480800640 1 -- 172.21.15.59:0/1604307317 wait complete. 2024-05-30T16:49:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb480800640 1 Processor -- start 2024-05-30T16:49:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.450+0000 7fb480800640 1 -- start start 2024-05-30T16:49:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb480800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb47809aa40 0x7fb478157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb480800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4780b3840 0x7fb4780cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb480800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb47815fdb0 0x7fb4781595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb480800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb4780af4b0 con 0x7fb4780b3840 2024-05-30T16:49:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb480800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb4780af330 con 0x7fb47809aa40 2024-05-30T16:49:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb480800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb47816a430 con 0x7fb47815fdb0 2024-05-30T16:49:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb47d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4780b3840 0x7fb4780cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb47d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4780b3840 0x7fb4780cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55884/0 (socket says 172.21.15.59:55884) 2024-05-30T16:49:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb47d400640 1 -- 172.21.15.59:0/3496108484 learned_addr learned my addr 172.21.15.59:0/3496108484 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb47de00640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb47809aa40 0x7fb478157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb47e800640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb47815fdb0 0x7fb4781595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb47d400640 1 -- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb47815fdb0 msgr2=0x7fb4781595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb47d400640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb47815fdb0 0x7fb4781595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb47d400640 1 -- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb47809aa40 msgr2=0x7fb478157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb47d400640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb47809aa40 0x7fb478157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb47d400640 1 -- 172.21.15.59:0/3496108484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4780b52c0 con 0x7fb4780b3840 2024-05-30T16:49:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb47e800640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb47815fdb0 0x7fb4781595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb47d400640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4780b3840 0x7fb4780cbfd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb468018f60 tx=0x7fb4680190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb472000640 1 -- 172.21.15.59:0/3496108484 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4680b9020 con 0x7fb4780b3840 2024-05-30T16:49:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb472000640 1 -- 172.21.15.59:0/3496108484 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb468003d60 con 0x7fb4780b3840 2024-05-30T16:49:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb480800640 1 -- 172.21.15.59:0/3496108484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4780b5560 con 0x7fb4780b3840 2024-05-30T16:49:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb472000640 1 -- 172.21.15.59:0/3496108484 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4680b0040 con 0x7fb4780b3840 2024-05-30T16:49:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb480800640 1 -- 172.21.15.59:0/3496108484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4780b5b20 con 0x7fb4780b3840 2024-05-30T16:49:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb480800640 1 -- 172.21.15.59:0/3496108484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb478068a90 con 0x7fb4780b3840 2024-05-30T16:49:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.454+0000 7fb472000640 1 -- 172.21.15.59:0/3496108484 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb4680bc020 con 0x7fb4780b3840 2024-05-30T16:49:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.458+0000 7fb472000640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb45c068380 0x7fb45c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.458+0000 7fb472000640 1 -- 172.21.15.59:0/3496108484 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb4681209e0 con 0x7fb4780b3840 2024-05-30T16:49:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.458+0000 7fb47de00640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb45c068380 0x7fb45c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.458+0000 7fb47de00640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb45c068380 0x7fb45c06a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb46c000f70 tx=0x7fb46c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:29.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.462+0000 7fb472000640 1 -- 172.21.15.59:0/3496108484 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb4680c3030 con 0x7fb4780b3840 2024-05-30T16:49:29.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 -- 172.21.15.59:0/3496108484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb4780691a0 con 0x7fb4780b3840 2024-05-30T16:49:29.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb472000640 1 -- 172.21.15.59:0/3496108484 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fb468016090 con 0x7fb4780b3840 2024-05-30T16:49:29.631 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-05-30T16:49:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 -- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb45c068380 msgr2=0x7fb45c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb45c068380 0x7fb45c06a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb46c000f70 tx=0x7fb46c009040 comp rx=0 tx=0).stop 2024-05-30T16:49:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 -- 172.21.15.59:0/3496108484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4780b3840 msgr2=0x7fb4780cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4780b3840 0x7fb4780cbfd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb468018f60 tx=0x7fb4680190f0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 -- 172.21.15.59:0/3496108484 shutdown_connections 2024-05-30T16:49:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb45c068380 0x7fb45c06a840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb47815fdb0 0x7fb4781595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4780b3840 0x7fb4780cbfd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 --2- 172.21.15.59:0/3496108484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb47809aa40 0x7fb478157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 -- 172.21.15.59:0/3496108484 >> 172.21.15.59:0/3496108484 conn(0x7fb4780d24c0 msgr2=0x7fb4780d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 -- 172.21.15.59:0/3496108484 shutdown_connections 2024-05-30T16:49:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.626+0000 7fb480800640 1 -- 172.21.15.59:0/3496108484 wait complete. 2024-05-30T16:49:29.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T16:49:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0297600640 1 Processor -- start 2024-05-30T16:49:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0297600640 1 -- start start 2024-05-30T16:49:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0297600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02900d14c0 0x7f029006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0297600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02900d05b0 0x7f029009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0297600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f029006ea20 con 0x7f029009af80 2024-05-30T16:49:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0297600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0290070950 con 0x7f02900d14c0 2024-05-30T16:49:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0297600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0290070c30 con 0x7f02900d05b0 2024-05-30T16:49:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0294c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02900d14c0 0x7f029006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0295600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f029009af80 0x7f0290162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45374/0 (socket says 172.21.15.59:45374) 2024-05-30T16:49:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0294c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02900d14c0 0x7f029006e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55896/0 (socket says 172.21.15.59:55896) 2024-05-30T16:49:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0295600640 1 -- 172.21.15.59:0/2960539994 learned_addr learned my addr 172.21.15.59:0/2960539994 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0287e00640 1 --2- 172.21.15.59:0/2960539994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02900d05b0 0x7f029009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0294c00640 1 -- 172.21.15.59:0/2960539994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02900d05b0 msgr2=0x7f029009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0294c00640 1 --2- 172.21.15.59:0/2960539994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02900d05b0 0x7f029009aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0294c00640 1 -- 172.21.15.59:0/2960539994 >> v1:172.21.15.59:6789/0 conn(0x7f029009af80 legacy=0x7f0290162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f0294c00640 1 -- 172.21.15.59:0/2960539994 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0290070f10 con 0x7f02900d14c0 2024-05-30T16:49:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.790+0000 7f028fe00640 1 -- 172.21.15.59:0/2960539994 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653556847 0 0) 0x7f02880014a0 con 0x7f029009af80 2024-05-30T16:49:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.794+0000 7f0294c00640 1 --2- 172.21.15.59:0/2960539994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900d14c0 0x7f029006e4e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f02800097c0 tx=0x7f028001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d156013a8580b1a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.794+0000 7f028fe00640 1 -- 172.21.15.59:0/2960539994 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02800b0070 con 0x7f02900d14c0 2024-05-30T16:49:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.794+0000 7f028fe00640 1 -- 172.21.15.59:0/2960539994 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02800ab600 con 0x7f02900d14c0 2024-05-30T16:49:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.794+0000 7f028fe00640 1 -- 172.21.15.59:0/2960539994 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02800ab9d0 con 0x7f02900d14c0 2024-05-30T16:49:29.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.794+0000 7f0297600640 1 -- 172.21.15.59:0/2960539994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900d14c0 msgr2=0x7f029006e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.794+0000 7f0297600640 1 --2- 172.21.15.59:0/2960539994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900d14c0 0x7f029006e4e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f02800097c0 tx=0x7f028001c4a0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.794+0000 7f0297600640 1 -- 172.21.15.59:0/2960539994 shutdown_connections 2024-05-30T16:49:29.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.794+0000 7f0297600640 1 --2- 172.21.15.59:0/2960539994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02900d05b0 0x7f029009aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.794+0000 7f0297600640 1 --2- 172.21.15.59:0/2960539994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900d14c0 0x7f029006e4e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.794+0000 7f0297600640 1 -- 172.21.15.59:0/2960539994 >> 172.21.15.59:0/2960539994 conn(0x7f02900b3f80 msgr2=0x7f02900b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:29.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.794+0000 7f0297600640 1 -- 172.21.15.59:0/2960539994 shutdown_connections 2024-05-30T16:49:29.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.794+0000 7f0297600640 1 -- 172.21.15.59:0/2960539994 wait complete. 2024-05-30T16:49:29.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0297600640 1 Processor -- start 2024-05-30T16:49:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0297600640 1 -- start start 2024-05-30T16:49:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0297600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029009af80 0x7f02900c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0297600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900d05b0 0x7f0290149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0297600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02900d14c0 0x7f029014cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0297600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f02900d0b10 con 0x7f02900d05b0 2024-05-30T16:49:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0297600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f02900d0990 con 0x7f029009af80 2024-05-30T16:49:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0297600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f029006e100 con 0x7f02900d14c0 2024-05-30T16:49:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0287e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900d05b0 0x7f0290149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0287e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900d05b0 0x7f0290149fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55900/0 (socket says 172.21.15.59:55900) 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0287e00640 1 -- 172.21.15.59:0/1034224943 learned_addr learned my addr 172.21.15.59:0/1034224943 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0294c00640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029009af80 0x7f02900c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0295600640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02900d14c0 0x7f029014cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0287e00640 1 -- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02900d14c0 msgr2=0x7f029014cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0287e00640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02900d14c0 0x7f029014cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0287e00640 1 -- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029009af80 msgr2=0x7f02900c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0287e00640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029009af80 0x7f02900c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0287e00640 1 -- 172.21.15.59:0/1034224943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02900c92e0 con 0x7f02900d05b0 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0295600640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02900d14c0 0x7f029014cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0287e00640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900d05b0 0x7f0290149fc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f027800e930 tx=0x7f027800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f028d600640 1 -- 172.21.15.59:0/1034224943 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278017070 con 0x7f02900d05b0 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f028d600640 1 -- 172.21.15.59:0/1034224943 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027800ca00 con 0x7f02900d05b0 2024-05-30T16:49:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f028d600640 1 -- 172.21.15.59:0/1034224943 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027800cdb0 con 0x7f02900d05b0 2024-05-30T16:49:29.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0297600640 1 -- 172.21.15.59:0/1034224943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02900cbd00 con 0x7f02900d05b0 2024-05-30T16:49:29.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.798+0000 7f0297600640 1 -- 172.21.15.59:0/1034224943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02900cc2c0 con 0x7f02900d05b0 2024-05-30T16:49:29.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.802+0000 7f0297600640 1 -- 172.21.15.59:0/1034224943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0290068a90 con 0x7f02900d05b0 2024-05-30T16:49:29.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.802+0000 7f028d600640 1 -- 172.21.15.59:0/1034224943 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f027801a070 con 0x7f02900d05b0 2024-05-30T16:49:29.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.802+0000 7f028d600640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f026c068380 0x7f026c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:29.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.802+0000 7f028d600640 1 -- 172.21.15.59:0/1034224943 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0278086a10 con 0x7f02900d05b0 2024-05-30T16:49:29.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.802+0000 7f0294c00640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f026c068380 0x7f026c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:29.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.802+0000 7f0294c00640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f026c068380 0x7f026c06a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f02800ad000 tx=0x7f02800a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:29.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.806+0000 7f028d600640 1 -- 172.21.15.59:0/1034224943 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f02780569a0 con 0x7f02900d05b0 2024-05-30T16:49:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.970+0000 7f0297600640 1 -- 172.21.15.59:0/1034224943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f02900b4be0 con 0x7f02900d05b0 2024-05-30T16:49:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.970+0000 7f028d600640 1 -- 172.21.15.59:0/1034224943 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f027805aca0 con 0x7f02900d05b0 2024-05-30T16:49:29.976 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-05-30T16:49:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.974+0000 7f0297600640 1 -- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f026c068380 msgr2=0x7f026c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.974+0000 7f0297600640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f026c068380 0x7f026c06a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f02800ad000 tx=0x7f02800a6000 comp rx=0 tx=0).stop 2024-05-30T16:49:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.974+0000 7f0297600640 1 -- 172.21.15.59:0/1034224943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900d05b0 msgr2=0x7f0290149fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.974+0000 7f0297600640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900d05b0 0x7f0290149fc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f027800e930 tx=0x7f027800edf0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.974+0000 7f0297600640 1 -- 172.21.15.59:0/1034224943 shutdown_connections 2024-05-30T16:49:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.974+0000 7f0297600640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f026c068380 0x7f026c06a840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.974+0000 7f0297600640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02900d14c0 0x7f029014cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.974+0000 7f0297600640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900d05b0 0x7f0290149fc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.974+0000 7f0297600640 1 --2- 172.21.15.59:0/1034224943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029009af80 0x7f02900c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.974+0000 7f0297600640 1 -- 172.21.15.59:0/1034224943 >> 172.21.15.59:0/1034224943 conn(0x7f02900b3f80 msgr2=0x7f02901624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.974+0000 7f0297600640 1 -- 172.21.15.59:0/1034224943 shutdown_connections 2024-05-30T16:49:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:29.974+0000 7f0297600640 1 -- 172.21.15.59:0/1034224943 wait complete. 2024-05-30T16:49:29.998 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T16:49:30.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe792e00640 1 Processor -- start 2024-05-30T16:49:30.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe792e00640 1 -- start start 2024-05-30T16:49:30.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe792e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe78c1569e0 0x7fe78c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:30.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe792e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe78c0d0660 0x7fe78c0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:30.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe792e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe78c0ad770 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe792e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe78c0d1010 con 0x7fe78c0d0660 2024-05-30T16:49:30.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe792e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe78c15cb40 con 0x7fe78c1569e0 2024-05-30T16:49:30.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe790e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe78c0d0660 0x7fe78c0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:30.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe783400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe78c0ad2b0 0x7fe78c0cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45380/0 (socket says 172.21.15.59:45380) 2024-05-30T16:49:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe783400640 1 -- 172.21.15.59:0/2947198443 learned_addr learned my addr 172.21.15.59:0/2947198443 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe78be00640 1 --2- 172.21.15.59:0/2947198443 >> v2:172.21.15.107:3300/0 conn(0x7fe78c1569e0 0x7fe78c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe790e00640 1 -- 172.21.15.59:0/2947198443 >> v2:172.21.15.107:3300/0 conn(0x7fe78c1569e0 msgr2=0x7fe78c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe790e00640 1 --2- 172.21.15.59:0/2947198443 >> v2:172.21.15.107:3300/0 conn(0x7fe78c1569e0 0x7fe78c15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe790e00640 1 -- 172.21.15.59:0/2947198443 >> v1:172.21.15.59:6789/0 conn(0x7fe78c0ad2b0 legacy=0x7fe78c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe790e00640 1 -- 172.21.15.59:0/2947198443 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c15ce20 con 0x7fe78c0d0660 2024-05-30T16:49:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.138+0000 7fe78b400640 1 -- 172.21.15.59:0/2947198443 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060463987 0 0) 0x7fe78c0ad770 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe790e00640 1 --2- 172.21.15.59:0/2947198443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c0d0660 0x7fe78c0d0ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0b4c40 tx=0x7fe78401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea07f93d3adc04d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe78b400640 1 -- 172.21.15.59:0/2947198443 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7840b2070 con 0x7fe78c0d0660 2024-05-30T16:49:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe78b400640 1 -- 172.21.15.59:0/2947198443 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7840a57e0 con 0x7fe78c0d0660 2024-05-30T16:49:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe78b400640 1 -- 172.21.15.59:0/2947198443 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7840a5bb0 con 0x7fe78c0d0660 2024-05-30T16:49:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe792e00640 1 -- 172.21.15.59:0/2947198443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c0d0660 msgr2=0x7fe78c0d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe792e00640 1 --2- 172.21.15.59:0/2947198443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c0d0660 0x7fe78c0d0ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0b4c40 tx=0x7fe78401c8a0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe792e00640 1 -- 172.21.15.59:0/2947198443 shutdown_connections 2024-05-30T16:49:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe792e00640 1 --2- 172.21.15.59:0/2947198443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c0d0660 0x7fe78c0d0ad0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe792e00640 1 --2- 172.21.15.59:0/2947198443 >> v2:172.21.15.107:3300/0 conn(0x7fe78c1569e0 0x7fe78c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe792e00640 1 -- 172.21.15.59:0/2947198443 >> 172.21.15.59:0/2947198443 conn(0x7fe78c06bdb0 msgr2=0x7fe78c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe792e00640 1 -- 172.21.15.59:0/2947198443 shutdown_connections 2024-05-30T16:49:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe792e00640 1 -- 172.21.15.59:0/2947198443 wait complete. 2024-05-30T16:49:30.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe792e00640 1 Processor -- start 2024-05-30T16:49:30.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.142+0000 7fe792e00640 1 -- start start 2024-05-30T16:49:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe792e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c0ad2b0 0x7fe78c14bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe792e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe78c0d0660 0x7fe78c15b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe792e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe78c1569e0 0x7fe78c15b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe792e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c0b3c60 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe792e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c0b3ae0 con 0x7fe78c0d0660 2024-05-30T16:49:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe792e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe78c0b3de0 con 0x7fe78c1569e0 2024-05-30T16:49:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe78be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c0ad2b0 0x7fe78c14bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe78be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c0ad2b0 0x7fe78c14bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55930/0 (socket says 172.21.15.59:55930) 2024-05-30T16:49:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe78be00640 1 -- 172.21.15.59:0/1683749007 learned_addr learned my addr 172.21.15.59:0/1683749007 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe783400640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe78c0d0660 0x7fe78c15b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe78be00640 1 -- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe78c1569e0 msgr2=0x7fe78c15b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe78be00640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe78c1569e0 0x7fe78c15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe78be00640 1 -- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe78c0d0660 msgr2=0x7fe78c15b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:30.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe78be00640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe78c0d0660 0x7fe78c15b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe78be00640 1 -- 172.21.15.59:0/1683749007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c073b00 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe783400640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe78c0d0660 0x7fe78c15b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:30.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe78be00640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c0ad2b0 0x7fe78c14bf10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00e8a0 tx=0x7fe77c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe788c00640 1 -- 172.21.15.59:0/1683749007 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c017070 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe788c00640 1 -- 172.21.15.59:0/1683749007 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77c00c940 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe788c00640 1 -- 172.21.15.59:0/1683749007 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c00ccf0 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe792e00640 1 -- 172.21.15.59:0/1683749007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78c14c450 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe792e00640 1 -- 172.21.15.59:0/1683749007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe78c09d9b0 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe792e00640 1 -- 172.21.15.59:0/1683749007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe78c068a90 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.146+0000 7fe788c00640 1 -- 172.21.15.59:0/1683749007 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe77c01a070 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.150+0000 7fe788c00640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe768068380 0x7fe76806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.150+0000 7fe788c00640 1 -- 172.21.15.59:0/1683749007 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe77c0868b0 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.150+0000 7fe783400640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe768068380 0x7fe76806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.150+0000 7fe783400640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe768068380 0x7fe76806a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe78c1f8240 tx=0x7fe774009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.154+0000 7fe788c00640 1 -- 172.21.15.59:0/1683749007 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe77c056e60 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 -- 172.21.15.59:0/1683749007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe78c06ccd0 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe788c00640 1 -- 172.21.15.59:0/1683749007 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fe77c056760 con 0x7fe78c0ad2b0 2024-05-30T16:49:30.323 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-05-30T16:49:30.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 -- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe768068380 msgr2=0x7fe76806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:30.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe768068380 0x7fe76806a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe78c1f8240 tx=0x7fe774009040 comp rx=0 tx=0).stop 2024-05-30T16:49:30.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 -- 172.21.15.59:0/1683749007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c0ad2b0 msgr2=0x7fe78c14bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:30.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c0ad2b0 0x7fe78c14bf10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00e8a0 tx=0x7fe77c00eca0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 -- 172.21.15.59:0/1683749007 shutdown_connections 2024-05-30T16:49:30.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe768068380 0x7fe76806a840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe78c1569e0 0x7fe78c15b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe78c0d0660 0x7fe78c15b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 --2- 172.21.15.59:0/1683749007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c0ad2b0 0x7fe78c14bf10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 -- 172.21.15.59:0/1683749007 >> 172.21.15.59:0/1683749007 conn(0x7fe78c06bdb0 msgr2=0x7fe78c155130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:30.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 -- 172.21.15.59:0/1683749007 shutdown_connections 2024-05-30T16:49:30.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.318+0000 7fe792e00640 1 -- 172.21.15.59:0/1683749007 wait complete. 2024-05-30T16:49:30.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone' 2024-05-30T16:49:30.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6bed000640 1 Processor -- start 2024-05-30T16:49:30.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6bed000640 1 -- start start 2024-05-30T16:49:30.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6bed000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6be80d50c0 0x7f6be80d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:30.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6bed000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6be80d30b0 0x7f6be806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6bed000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be815ed70 con 0x7f6be815e990 2024-05-30T16:49:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6bed000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6be80cf380 con 0x7f6be80d30b0 2024-05-30T16:49:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6bed000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6be80d5520 con 0x7f6be80d50c0 2024-05-30T16:49:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6be7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6be80d30b0 0x7f6be806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6be7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6be80d30b0 0x7f6be806cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55942/0 (socket says 172.21.15.59:55942) 2024-05-30T16:49:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6be7e00640 1 -- 172.21.15.59:0/519119745 learned_addr learned my addr 172.21.15.59:0/519119745 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6bdfe00640 1 --2- 172.21.15.59:0/519119745 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6be80d50c0 0x7f6be80d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6be7e00640 1 -- 172.21.15.59:0/519119745 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6be80d50c0 msgr2=0x7f6be80d2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6be7e00640 1 --2- 172.21.15.59:0/519119745 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6be80d50c0 0x7f6be80d2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6be7e00640 1 -- 172.21.15.59:0/519119745 >> v1:172.21.15.107:6789/0 conn(0x7f6be815e990 legacy=0x7f6be80d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.482+0000 7f6be7e00640 1 -- 172.21.15.59:0/519119745 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be80b3de0 con 0x7f6be80d30b0 2024-05-30T16:49:30.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6be7e00640 1 --2- 172.21.15.59:0/519119745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be80d30b0 0x7f6be806cab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009e50 tx=0x7f6be001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464bd5efa066b46f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6be6a00640 1 -- 172.21.15.59:0/519119745 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be00a5660 con 0x7f6be80d30b0 2024-05-30T16:49:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6be6a00640 1 -- 172.21.15.59:0/519119745 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be00a5800 con 0x7f6be80d30b0 2024-05-30T16:49:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6be6a00640 1 -- 172.21.15.59:0/519119745 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be00a5bd0 con 0x7f6be80d30b0 2024-05-30T16:49:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6bed000640 1 -- 172.21.15.59:0/519119745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be80d30b0 msgr2=0x7f6be806cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6bed000640 1 --2- 172.21.15.59:0/519119745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be80d30b0 0x7f6be806cab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009e50 tx=0x7f6be001c9a0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6bed000640 1 -- 172.21.15.59:0/519119745 shutdown_connections 2024-05-30T16:49:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6bed000640 1 --2- 172.21.15.59:0/519119745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be80d30b0 0x7f6be806cab0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6bed000640 1 --2- 172.21.15.59:0/519119745 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6be80d50c0 0x7f6be80d2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6bed000640 1 -- 172.21.15.59:0/519119745 >> 172.21.15.59:0/519119745 conn(0x7f6be808bfd0 msgr2=0x7f6be80d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6bed000640 1 -- 172.21.15.59:0/519119745 shutdown_connections 2024-05-30T16:49:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6bed000640 1 -- 172.21.15.59:0/519119745 wait complete. 2024-05-30T16:49:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6bed000640 1 Processor -- start 2024-05-30T16:49:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.486+0000 7f6bed000640 1 -- start start 2024-05-30T16:49:30.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bed000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6be80d30b0 0x7f6be815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bed000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6be80d50c0 0x7f6be8159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bed000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be815e990 0x7f6be814f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bed000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6be806d400 con 0x7f6be815e990 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bed000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6be80cfb70 con 0x7f6be80d30b0 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bed000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6be80d2550 con 0x7f6be80d50c0 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6be7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be815e990 0x7f6be814f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6be7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be815e990 0x7f6be814f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55956/0 (socket says 172.21.15.59:55956) 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6be7e00640 1 -- 172.21.15.59:0/2648183048 learned_addr learned my addr 172.21.15.59:0/2648183048 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bdfe00640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6be80d50c0 0x7f6be8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6be7400640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6be80d30b0 0x7f6be815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6be7e00640 1 -- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6be80d50c0 msgr2=0x7f6be8159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6be7e00640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6be80d50c0 0x7f6be8159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6be7e00640 1 -- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6be80d30b0 msgr2=0x7f6be815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:30.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6be7e00640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6be80d30b0 0x7f6be815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:30.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6be7e00640 1 -- 172.21.15.59:0/2648183048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be815b4d0 con 0x7f6be815e990 2024-05-30T16:49:30.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6be7e00640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be815e990 0x7f6be814f8a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6be001a5d0 tx=0x7f6be0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:30.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bdf400640 1 -- 172.21.15.59:0/2648183048 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be00bc020 con 0x7f6be815e990 2024-05-30T16:49:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bdf400640 1 -- 172.21.15.59:0/2648183048 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be00b8880 con 0x7f6be815e990 2024-05-30T16:49:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bed000640 1 -- 172.21.15.59:0/2648183048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be815b1f0 con 0x7f6be815e990 2024-05-30T16:49:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bdf400640 1 -- 172.21.15.59:0/2648183048 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be00a5660 con 0x7f6be815e990 2024-05-30T16:49:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bed000640 1 -- 172.21.15.59:0/2648183048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be815d3f0 con 0x7f6be815e990 2024-05-30T16:49:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bed000640 1 -- 172.21.15.59:0/2648183048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be8068a90 con 0x7f6be815e990 2024-05-30T16:49:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.490+0000 7f6bdf400640 1 -- 172.21.15.59:0/2648183048 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6be00bf020 con 0x7f6be815e990 2024-05-30T16:49:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.494+0000 7f6bdf400640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6bc4068380 0x7f6bc406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.494+0000 7f6bdf400640 1 -- 172.21.15.59:0/2648183048 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6be0121990 con 0x7f6be815e990 2024-05-30T16:49:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.494+0000 7f6be7400640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6bc4068380 0x7f6bc406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.494+0000 7f6be7400640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6bc4068380 0x7f6bc406a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8007fd0 tx=0x7f6bd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:30.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.498+0000 7f6bdf400640 1 -- 172.21.15.59:0/2648183048 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6be00c6030 con 0x7f6be815e990 2024-05-30T16:49:30.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:30.722+0000 7f6bed000640 1 -- 172.21.15.59:0/2648183048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]} v 0) -- 0x7f6be80ba510 con 0x7f6be815e990 2024-05-30T16:49:31.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.190+0000 7f6bdf400640 1 -- 172.21.15.59:0/2648183048 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]}]=0 v49) ==== 163+0+0 (secure 0 0 0) 0x7f6be0016620 con 0x7f6be815e990 2024-05-30T16:49:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.194+0000 7f6bed000640 1 -- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6bc4068380 msgr2=0x7f6bc406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.194+0000 7f6bed000640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6bc4068380 0x7f6bc406a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8007fd0 tx=0x7f6bd8009040 comp rx=0 tx=0).stop 2024-05-30T16:49:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.194+0000 7f6bed000640 1 -- 172.21.15.59:0/2648183048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be815e990 msgr2=0x7f6be814f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.194+0000 7f6bed000640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be815e990 0x7f6be814f8a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6be001a5d0 tx=0x7f6be0019740 comp rx=0 tx=0).stop 2024-05-30T16:49:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.194+0000 7f6bed000640 1 -- 172.21.15.59:0/2648183048 shutdown_connections 2024-05-30T16:49:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.194+0000 7f6bed000640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6bc4068380 0x7f6bc406a840 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.194+0000 7f6bed000640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be815e990 0x7f6be814f8a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.194+0000 7f6bed000640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6be80d50c0 0x7f6be8159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.194+0000 7f6bed000640 1 --2- 172.21.15.59:0/2648183048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6be80d30b0 0x7f6be815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.194+0000 7f6bed000640 1 -- 172.21.15.59:0/2648183048 >> 172.21.15.59:0/2648183048 conn(0x7f6be808bfd0 msgr2=0x7f6be8161430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.194+0000 7f6bed000640 1 -- 172.21.15.59:0/2648183048 shutdown_connections 2024-05-30T16:49:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.194+0000 7f6bed000640 1 -- 172.21.15.59:0/2648183048 wait complete. 2024-05-30T16:49:31.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:49:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe11a00640 1 Processor -- start 2024-05-30T16:49:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe11a00640 1 -- start start 2024-05-30T16:49:31.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe11a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efe0c0723a0 0x7efe0c0b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe11a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe0c15ebf0 0x7efe0c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe11a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0c0b3ff0 0x7efe0c06dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe11a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7efe0c0b32d0 con 0x7efe0c15ebf0 2024-05-30T16:49:31.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe11a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7efe0c15f490 con 0x7efe0c0723a0 2024-05-30T16:49:31.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe11a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efe0c15f770 con 0x7efe0c0b3ff0 2024-05-30T16:49:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe0a000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe0c15ebf0 0x7efe0c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe0a000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe0c15ebf0 0x7efe0c0b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55966/0 (socket says 172.21.15.59:55966) 2024-05-30T16:49:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe0a000640 1 -- 172.21.15.59:0/3857318634 learned_addr learned my addr 172.21.15.59:0/3857318634 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe0aa00640 1 --2- 172.21.15.59:0/3857318634 >> v2:172.21.15.107:3300/0 conn(0x7efe0c0723a0 0x7efe0c0b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe0b400640 1 --2- 172.21.15.59:0/3857318634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0c0b3ff0 0x7efe0c06dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe0a000640 1 -- 172.21.15.59:0/3857318634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0c0b3ff0 msgr2=0x7efe0c06dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe0a000640 1 --2- 172.21.15.59:0/3857318634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0c0b3ff0 0x7efe0c06dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe0a000640 1 -- 172.21.15.59:0/3857318634 >> v2:172.21.15.107:3300/0 conn(0x7efe0c0723a0 msgr2=0x7efe0c0b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:31.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe0a000640 1 --2- 172.21.15.59:0/3857318634 >> v2:172.21.15.107:3300/0 conn(0x7efe0c0723a0 0x7efe0c0b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.362+0000 7efe0a000640 1 -- 172.21.15.59:0/3857318634 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0c15fa50 con 0x7efe0c15ebf0 2024-05-30T16:49:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe0a000640 1 --2- 172.21.15.59:0/3857318634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c15ebf0 0x7efe0c0b3ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0b3020 tx=0x7efdf801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb79b4af58d0516 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe09600640 1 -- 172.21.15.59:0/3857318634 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf80b1070 con 0x7efe0c15ebf0 2024-05-30T16:49:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe09600640 1 -- 172.21.15.59:0/3857318634 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf80ac620 con 0x7efe0c15ebf0 2024-05-30T16:49:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe09600640 1 -- 172.21.15.59:0/3857318634 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf80ac9f0 con 0x7efe0c15ebf0 2024-05-30T16:49:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe11a00640 1 -- 172.21.15.59:0/3857318634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c15ebf0 msgr2=0x7efe0c0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe11a00640 1 --2- 172.21.15.59:0/3857318634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c15ebf0 0x7efe0c0b3ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0b3020 tx=0x7efdf801c4f0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe11a00640 1 -- 172.21.15.59:0/3857318634 shutdown_connections 2024-05-30T16:49:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe11a00640 1 --2- 172.21.15.59:0/3857318634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0c0b3ff0 0x7efe0c06dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe11a00640 1 --2- 172.21.15.59:0/3857318634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c15ebf0 0x7efe0c0b3ab0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe11a00640 1 --2- 172.21.15.59:0/3857318634 >> v2:172.21.15.107:3300/0 conn(0x7efe0c0723a0 0x7efe0c0b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe11a00640 1 -- 172.21.15.59:0/3857318634 >> 172.21.15.59:0/3857318634 conn(0x7efe0c06bdb0 msgr2=0x7efe0c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe11a00640 1 -- 172.21.15.59:0/3857318634 shutdown_connections 2024-05-30T16:49:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe11a00640 1 -- 172.21.15.59:0/3857318634 wait complete. 2024-05-30T16:49:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe11a00640 1 Processor -- start 2024-05-30T16:49:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.366+0000 7efe11a00640 1 -- start start 2024-05-30T16:49:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe11a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c0723a0 0x7efe0c14ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe11a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe0c0b3ff0 0x7efe0c14c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe11a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0c15ebf0 0x7efe0c14a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe11a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c154e60 con 0x7efe0c0723a0 2024-05-30T16:49:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe11a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c154fe0 con 0x7efe0c0b3ff0 2024-05-30T16:49:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe11a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efe0c155160 con 0x7efe0c15ebf0 2024-05-30T16:49:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe0aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c0723a0 0x7efe0c14ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe0aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c0723a0 0x7efe0c14ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55968/0 (socket says 172.21.15.59:55968) 2024-05-30T16:49:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe0aa00640 1 -- 172.21.15.59:0/131974523 learned_addr learned my addr 172.21.15.59:0/131974523 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe0aa00640 1 -- 172.21.15.59:0/131974523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0c15ebf0 msgr2=0x7efe0c14a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:31.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe0aa00640 1 --2- 172.21.15.59:0/131974523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0c15ebf0 0x7efe0c14a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe0aa00640 1 -- 172.21.15.59:0/131974523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe0c0b3ff0 msgr2=0x7efe0c14c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:31.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe0aa00640 1 --2- 172.21.15.59:0/131974523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe0c0b3ff0 0x7efe0c14c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe0aa00640 1 -- 172.21.15.59:0/131974523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0c14da20 con 0x7efe0c0723a0 2024-05-30T16:49:31.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe0aa00640 1 --2- 172.21.15.59:0/131974523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c0723a0 0x7efe0c14ed30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00d800 tx=0x7efdfc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:31.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe02a00640 1 -- 172.21.15.59:0/131974523 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00b6c0 con 0x7efe0c0723a0 2024-05-30T16:49:31.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe02a00640 1 -- 172.21.15.59:0/131974523 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdfc019070 con 0x7efe0c0723a0 2024-05-30T16:49:31.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe11a00640 1 -- 172.21.15.59:0/131974523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe0c14dd00 con 0x7efe0c0723a0 2024-05-30T16:49:31.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe02a00640 1 -- 172.21.15.59:0/131974523 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00ba60 con 0x7efe0c0723a0 2024-05-30T16:49:31.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe11a00640 1 -- 172.21.15.59:0/131974523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe0c14e2c0 con 0x7efe0c0723a0 2024-05-30T16:49:31.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.370+0000 7efe11a00640 1 -- 172.21.15.59:0/131974523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe0c068a90 con 0x7efe0c0723a0 2024-05-30T16:49:31.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.374+0000 7efe02a00640 1 -- 172.21.15.59:0/131974523 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efdfc00bc00 con 0x7efe0c0723a0 2024-05-30T16:49:31.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.374+0000 7efe02a00640 1 --2- 172.21.15.59:0/131974523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efdec068380 0x7efdec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.374+0000 7efe02a00640 1 -- 172.21.15.59:0/131974523 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efdfc086e20 con 0x7efe0c0723a0 2024-05-30T16:49:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.374+0000 7efe0a000640 1 --2- 172.21.15.59:0/131974523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efdec068380 0x7efdec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.374+0000 7efe0a000640 1 --2- 172.21.15.59:0/131974523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efdec068380 0x7efdec06a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efdf80ae000 tx=0x7efdf8004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:31.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.378+0000 7efe02a00640 1 -- 172.21.15.59:0/131974523 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efdfc057470 con 0x7efe0c0723a0 2024-05-30T16:49:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.542+0000 7efe11a00640 1 -- 172.21.15.59:0/131974523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efe0c169ef0 con 0x7efe0c0723a0 2024-05-30T16:49:31.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe02a00640 1 -- 172.21.15.59:0/131974523 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7efdfc056d70 con 0x7efe0c0723a0 2024-05-30T16:49:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe11a00640 1 -- 172.21.15.59:0/131974523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efdec068380 msgr2=0x7efdec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe11a00640 1 --2- 172.21.15.59:0/131974523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efdec068380 0x7efdec06a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efdf80ae000 tx=0x7efdf8004740 comp rx=0 tx=0).stop 2024-05-30T16:49:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe11a00640 1 -- 172.21.15.59:0/131974523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c0723a0 msgr2=0x7efe0c14ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe11a00640 1 --2- 172.21.15.59:0/131974523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c0723a0 0x7efe0c14ed30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00d800 tx=0x7efdfc00dcc0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe11a00640 1 -- 172.21.15.59:0/131974523 shutdown_connections 2024-05-30T16:49:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe11a00640 1 --2- 172.21.15.59:0/131974523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efdec068380 0x7efdec06a840 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe11a00640 1 --2- 172.21.15.59:0/131974523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0c15ebf0 0x7efe0c14a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe11a00640 1 --2- 172.21.15.59:0/131974523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe0c0b3ff0 0x7efe0c14c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe11a00640 1 --2- 172.21.15.59:0/131974523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c0723a0 0x7efe0c14ed30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe11a00640 1 -- 172.21.15.59:0/131974523 >> 172.21.15.59:0/131974523 conn(0x7efe0c06bdb0 msgr2=0x7efe0c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe11a00640 1 -- 172.21.15.59:0/131974523 shutdown_connections 2024-05-30T16:49:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:31.546+0000 7efe11a00640 1 -- 172.21.15.59:0/131974523 wait complete. 2024-05-30T16:49:31.571 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:49:31.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:49:31.672 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:49:31.763 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:49:31.764 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:49:31.764 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:31.772 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:49:31.772 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:31.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:49:32.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4fe00640 1 Processor -- start 2024-05-30T16:49:32.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4fe00640 1 -- start start 2024-05-30T16:49:32.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde48160d90 0x7fde4809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fde4809b780 0x7fde4809af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4fe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde480d1310 con 0x7fde480711e0 2024-05-30T16:49:32.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4fe00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fde480ced30 con 0x7fde48160d90 2024-05-30T16:49:32.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4fe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fde4809bcf0 con 0x7fde4809b780 2024-05-30T16:49:32.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde48160d90 0x7fde4809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4de00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fde480711e0 0x7fde4806ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56438/0 (socket says 172.21.15.59:56438) 2024-05-30T16:49:32.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde48160d90 0x7fde4809aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33368/0 (socket says 172.21.15.59:33368) 2024-05-30T16:49:32.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4de00640 1 -- 172.21.15.59:0/1812617074 learned_addr learned my addr 172.21.15.59:0/1812617074 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:32.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4ca00640 1 --2- 172.21.15.59:0/1812617074 >> v2:172.21.15.107:3300/0 conn(0x7fde4809b780 0x7fde4809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4d400640 1 -- 172.21.15.59:0/1812617074 >> v2:172.21.15.107:3300/0 conn(0x7fde4809b780 msgr2=0x7fde4809af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:32.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4d400640 1 --2- 172.21.15.59:0/1812617074 >> v2:172.21.15.107:3300/0 conn(0x7fde4809b780 0x7fde4809af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4d400640 1 -- 172.21.15.59:0/1812617074 >> v1:172.21.15.59:6789/0 conn(0x7fde480711e0 legacy=0x7fde4806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.006+0000 7fde4d400640 1 -- 172.21.15.59:0/1812617074 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde480d0a70 con 0x7fde48160d90 2024-05-30T16:49:32.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.010+0000 7fde4d400640 1 --2- 172.21.15.59:0/1812617074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde48160d90 0x7fde4809aa40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fde48073b70 tx=0x7fde3c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895ad2142dc34e37 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:32.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.010+0000 7fde47e00640 1 -- 172.21.15.59:0/1812617074 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0b0070 con 0x7fde48160d90 2024-05-30T16:49:32.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.010+0000 7fde47e00640 1 -- 172.21.15.59:0/1812617074 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3c0ab600 con 0x7fde48160d90 2024-05-30T16:49:32.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.010+0000 7fde47e00640 1 -- 172.21.15.59:0/1812617074 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0ab9d0 con 0x7fde48160d90 2024-05-30T16:49:32.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.010+0000 7fde4fe00640 1 -- 172.21.15.59:0/1812617074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde48160d90 msgr2=0x7fde4809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.010+0000 7fde4fe00640 1 --2- 172.21.15.59:0/1812617074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde48160d90 0x7fde4809aa40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fde48073b70 tx=0x7fde3c01c3f0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.010+0000 7fde4fe00640 1 -- 172.21.15.59:0/1812617074 shutdown_connections 2024-05-30T16:49:32.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.010+0000 7fde4fe00640 1 --2- 172.21.15.59:0/1812617074 >> v2:172.21.15.107:3300/0 conn(0x7fde4809b780 0x7fde4809af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.010+0000 7fde4fe00640 1 --2- 172.21.15.59:0/1812617074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde48160d90 0x7fde4809aa40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.010+0000 7fde4fe00640 1 -- 172.21.15.59:0/1812617074 >> 172.21.15.59:0/1812617074 conn(0x7fde480b3f80 msgr2=0x7fde480b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:32.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.010+0000 7fde4fe00640 1 -- 172.21.15.59:0/1812617074 shutdown_connections 2024-05-30T16:49:32.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.010+0000 7fde4fe00640 1 -- 172.21.15.59:0/1812617074 wait complete. 2024-05-30T16:49:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4fe00640 1 Processor -- start 2024-05-30T16:49:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4fe00640 1 -- start start 2024-05-30T16:49:32.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde480711e0 0x7fde480b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde4809b780 0x7fde4815ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde48160d90 0x7fde4806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fde48071fe0 con 0x7fde48160d90 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fde48071e60 con 0x7fde4809b780 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fde48161170 con 0x7fde480711e0 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde48160d90 0x7fde4806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde48160d90 0x7fde4806d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33374/0 (socket says 172.21.15.59:33374) 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4de00640 1 -- 172.21.15.59:0/3564683622 learned_addr learned my addr 172.21.15.59:0/3564683622 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4d400640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde480711e0 0x7fde480b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4ca00640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde4809b780 0x7fde4815ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4de00640 1 -- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde480711e0 msgr2=0x7fde480b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4de00640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde480711e0 0x7fde480b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4de00640 1 -- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde4809b780 msgr2=0x7fde4815ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4de00640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde4809b780 0x7fde4815ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4de00640 1 -- 172.21.15.59:0/3564683622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4806dff0 con 0x7fde48160d90 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4de00640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde48160d90 0x7fde4806d4d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fde4000cae0 tx=0x7fde4000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde45600640 1 -- 172.21.15.59:0/3564683622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40017070 con 0x7fde48160d90 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde45600640 1 -- 172.21.15.59:0/3564683622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4000ac40 con 0x7fde48160d90 2024-05-30T16:49:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde45600640 1 -- 172.21.15.59:0/3564683622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40012400 con 0x7fde48160d90 2024-05-30T16:49:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4fe00640 1 -- 172.21.15.59:0/3564683622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4806e2d0 con 0x7fde48160d90 2024-05-30T16:49:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4fe00640 1 -- 172.21.15.59:0/3564683622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde480b6970 con 0x7fde48160d90 2024-05-30T16:49:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.014+0000 7fde4fe00640 1 -- 172.21.15.59:0/3564683622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde480b6780 con 0x7fde48160d90 2024-05-30T16:49:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.018+0000 7fde45600640 1 -- 172.21.15.59:0/3564683622 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fde4001a070 con 0x7fde48160d90 2024-05-30T16:49:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.018+0000 7fde45600640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fde28068380 0x7fde2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.018+0000 7fde45600640 1 -- 172.21.15.59:0/3564683622 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fde40086820 con 0x7fde48160d90 2024-05-30T16:49:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.018+0000 7fde4d400640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fde28068380 0x7fde2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.018+0000 7fde4d400640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fde28068380 0x7fde2806a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0ad000 tx=0x7fde3c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:32.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.022+0000 7fde45600640 1 -- 172.21.15.59:0/3564683622 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fde40056d40 con 0x7fde48160d90 2024-05-30T16:49:32.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.202+0000 7fde4fe00640 1 -- 172.21.15.59:0/3564683622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fde480b4be0 con 0x7fde48160d90 2024-05-30T16:49:32.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.202+0000 7fde45600640 1 -- 172.21.15.59:0/3564683622 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fde40056640 con 0x7fde48160d90 2024-05-30T16:49:32.208 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T16:49:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.206+0000 7fde4fe00640 1 -- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fde28068380 msgr2=0x7fde2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.206+0000 7fde4fe00640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fde28068380 0x7fde2806a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0ad000 tx=0x7fde3c0a6000 comp rx=0 tx=0).stop 2024-05-30T16:49:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.206+0000 7fde4fe00640 1 -- 172.21.15.59:0/3564683622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde48160d90 msgr2=0x7fde4806d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.206+0000 7fde4fe00640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde48160d90 0x7fde4806d4d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fde4000cae0 tx=0x7fde4000a060 comp rx=0 tx=0).stop 2024-05-30T16:49:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.206+0000 7fde4fe00640 1 -- 172.21.15.59:0/3564683622 shutdown_connections 2024-05-30T16:49:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.206+0000 7fde4fe00640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fde28068380 0x7fde2806a840 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.206+0000 7fde4fe00640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde48160d90 0x7fde4806d4d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.206+0000 7fde4fe00640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde4809b780 0x7fde4815ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.206+0000 7fde4fe00640 1 --2- 172.21.15.59:0/3564683622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde480711e0 0x7fde480b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.206+0000 7fde4fe00640 1 -- 172.21.15.59:0/3564683622 >> 172.21.15.59:0/3564683622 conn(0x7fde480b3f80 msgr2=0x7fde480af800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.206+0000 7fde4fe00640 1 -- 172.21.15.59:0/3564683622 shutdown_connections 2024-05-30T16:49:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.206+0000 7fde4fe00640 1 -- 172.21.15.59:0/3564683622 wait complete. 2024-05-30T16:49:32.229 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:49:32.229 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:32.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:49:32.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c9800640 1 Processor -- start 2024-05-30T16:49:32.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c9800640 1 -- start start 2024-05-30T16:49:32.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c9800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49c4159df0 0x7f49c40ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c9800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f49c415a1d0 0x7f49c40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c9800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c415d730 con 0x7f49c40b3e50 2024-05-30T16:49:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c9800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f49c40b3370 con 0x7f49c4159df0 2024-05-30T16:49:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c9800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f49c40b3650 con 0x7f49c415a1d0 2024-05-30T16:49:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49c4159df0 0x7f49c40ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49c4159df0 0x7f49c40ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33384/0 (socket says 172.21.15.59:33384) 2024-05-30T16:49:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c3400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f49c40b3e50 0x7f49c415ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56440/0 (socket says 172.21.15.59:56440) 2024-05-30T16:49:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c2a00640 1 -- 172.21.15.59:0/649894882 learned_addr learned my addr 172.21.15.59:0/649894882 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49bbe00640 1 --2- 172.21.15.59:0/649894882 >> v2:172.21.15.107:3300/0 conn(0x7f49c415a1d0 0x7f49c40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c2a00640 1 -- 172.21.15.59:0/649894882 >> v2:172.21.15.107:3300/0 conn(0x7f49c415a1d0 msgr2=0x7f49c40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c2a00640 1 --2- 172.21.15.59:0/649894882 >> v2:172.21.15.107:3300/0 conn(0x7f49c415a1d0 0x7f49c40ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c2a00640 1 -- 172.21.15.59:0/649894882 >> v1:172.21.15.59:6789/0 conn(0x7f49c40b3e50 legacy=0x7f49c415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.422+0000 7f49c2a00640 1 -- 172.21.15.59:0/649894882 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c40b3930 con 0x7f49c4159df0 2024-05-30T16:49:32.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c2a00640 1 --2- 172.21.15.59:0/649894882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c4159df0 0x7f49c40ad1b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f49c40b4bf0 tx=0x7f49b401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea40b6bad43a03e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:32.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c2000640 1 -- 172.21.15.59:0/649894882 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b40b0070 con 0x7f49c4159df0 2024-05-30T16:49:32.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c2000640 1 -- 172.21.15.59:0/649894882 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b40ab600 con 0x7f49c4159df0 2024-05-30T16:49:32.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c2000640 1 -- 172.21.15.59:0/649894882 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b40ab9d0 con 0x7f49c4159df0 2024-05-30T16:49:32.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c9800640 1 -- 172.21.15.59:0/649894882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c4159df0 msgr2=0x7f49c40ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c9800640 1 --2- 172.21.15.59:0/649894882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c4159df0 0x7f49c40ad1b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f49c40b4bf0 tx=0x7f49b401c520 comp rx=0 tx=0).stop 2024-05-30T16:49:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c9800640 1 -- 172.21.15.59:0/649894882 shutdown_connections 2024-05-30T16:49:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c9800640 1 --2- 172.21.15.59:0/649894882 >> v2:172.21.15.107:3300/0 conn(0x7f49c415a1d0 0x7f49c40ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c9800640 1 --2- 172.21.15.59:0/649894882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c4159df0 0x7f49c40ad1b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c9800640 1 -- 172.21.15.59:0/649894882 >> 172.21.15.59:0/649894882 conn(0x7f49c40b22d0 msgr2=0x7f49c40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c9800640 1 -- 172.21.15.59:0/649894882 shutdown_connections 2024-05-30T16:49:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c9800640 1 -- 172.21.15.59:0/649894882 wait complete. 2024-05-30T16:49:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c9800640 1 Processor -- start 2024-05-30T16:49:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.426+0000 7f49c9800640 1 -- start start 2024-05-30T16:49:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c40b3e50 0x7f49c4154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c9800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49c4159df0 0x7f49c415f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c9800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49c415a1d0 0x7f49c414e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c9800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f49c415e720 con 0x7f49c40b3e50 2024-05-30T16:49:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c9800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f49c415e5a0 con 0x7f49c4159df0 2024-05-30T16:49:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c9800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f49c415e8a0 con 0x7f49c415a1d0 2024-05-30T16:49:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c40b3e50 0x7f49c4154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c40b3e50 0x7f49c4154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33394/0 (socket says 172.21.15.59:33394) 2024-05-30T16:49:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c2a00640 1 -- 172.21.15.59:0/371259494 learned_addr learned my addr 172.21.15.59:0/371259494 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49bbe00640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49c4159df0 0x7f49c415f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c3400640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49c415a1d0 0x7f49c414e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c2a00640 1 -- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49c415a1d0 msgr2=0x7f49c414e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c2a00640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49c415a1d0 0x7f49c414e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c2a00640 1 -- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49c4159df0 msgr2=0x7f49c415f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c2a00640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49c4159df0 0x7f49c415f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c2a00640 1 -- 172.21.15.59:0/371259494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c4153640 con 0x7f49c40b3e50 2024-05-30T16:49:32.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49bbe00640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49c4159df0 0x7f49c415f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c2a00640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c40b3e50 0x7f49c4154550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f49b40ae040 tx=0x7f49b401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49baa00640 1 -- 172.21.15.59:0/371259494 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b40ba020 con 0x7f49c40b3e50 2024-05-30T16:49:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49baa00640 1 -- 172.21.15.59:0/371259494 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b40aa7d0 con 0x7f49c40b3e50 2024-05-30T16:49:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49baa00640 1 -- 172.21.15.59:0/371259494 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b40b0040 con 0x7f49c40b3e50 2024-05-30T16:49:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c9800640 1 -- 172.21.15.59:0/371259494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c4153920 con 0x7f49c40b3e50 2024-05-30T16:49:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c9800640 1 -- 172.21.15.59:0/371259494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c414eb80 con 0x7f49c40b3e50 2024-05-30T16:49:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49c9800640 1 -- 172.21.15.59:0/371259494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c4068a90 con 0x7f49c40b3e50 2024-05-30T16:49:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.430+0000 7f49baa00640 1 -- 172.21.15.59:0/371259494 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f49b40bd020 con 0x7f49c40b3e50 2024-05-30T16:49:32.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.434+0000 7f49baa00640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49a0068380 0x7f49a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.434+0000 7f49baa00640 1 -- 172.21.15.59:0/371259494 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f49b4120ee0 con 0x7f49c40b3e50 2024-05-30T16:49:32.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.434+0000 7f49bbe00640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49a0068380 0x7f49a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.434+0000 7f49bbe00640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49a0068380 0x7f49a006a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49c415f060 tx=0x7f49ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:32.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.438+0000 7f49baa00640 1 -- 172.21.15.59:0/371259494 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f49b40c4030 con 0x7f49c40b3e50 2024-05-30T16:49:32.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.614+0000 7f49c9800640 1 -- 172.21.15.59:0/371259494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f49c40b0260 con 0x7f49c40b3e50 2024-05-30T16:49:32.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.614+0000 7f49baa00640 1 -- 172.21.15.59:0/371259494 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f49b4016110 con 0x7f49c40b3e50 2024-05-30T16:49:32.620 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T16:49:32.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.614+0000 7f49c9800640 1 -- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49a0068380 msgr2=0x7f49a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.614+0000 7f49c9800640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49a0068380 0x7f49a006a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49c415f060 tx=0x7f49ac008040 comp rx=0 tx=0).stop 2024-05-30T16:49:32.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.614+0000 7f49c9800640 1 -- 172.21.15.59:0/371259494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c40b3e50 msgr2=0x7f49c4154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.614+0000 7f49c9800640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c40b3e50 0x7f49c4154550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f49b40ae040 tx=0x7f49b401ad60 comp rx=0 tx=0).stop 2024-05-30T16:49:32.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.614+0000 7f49c9800640 1 -- 172.21.15.59:0/371259494 shutdown_connections 2024-05-30T16:49:32.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.614+0000 7f49c9800640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49a0068380 0x7f49a006a840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.614+0000 7f49c9800640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49c415a1d0 0x7f49c414e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.614+0000 7f49c9800640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49c4159df0 0x7f49c415f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.614+0000 7f49c9800640 1 --2- 172.21.15.59:0/371259494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c40b3e50 0x7f49c4154550 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.614+0000 7f49c9800640 1 -- 172.21.15.59:0/371259494 >> 172.21.15.59:0/371259494 conn(0x7f49c40b22d0 msgr2=0x7f49c40b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:32.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.618+0000 7f49c9800640 1 -- 172.21.15.59:0/371259494 shutdown_connections 2024-05-30T16:49:32.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.618+0000 7f49c9800640 1 -- 172.21.15.59:0/371259494 wait complete. 2024-05-30T16:49:32.642 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2024-05-30T16:49:32.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:32.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:32.678 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:49:32.679 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T16:49:32.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:32.679 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T16:49:32.739 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:49:32.739 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:32.748 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:49:32.748 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:32.800 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:49:32.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1478200640 1 Processor -- start 2024-05-30T16:49:32.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1478200640 1 -- start start 2024-05-30T16:49:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1478200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1470160d90 0x7f147009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1478200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14700711e0 0x7f147009af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1478200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14700d1310 con 0x7f147009b780 2024-05-30T16:49:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1478200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f14700ced30 con 0x7f14700711e0 2024-05-30T16:49:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1478200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f147009bcf0 con 0x7f1470160d90 2024-05-30T16:49:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1476200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14700711e0 0x7f147009af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1476200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14700711e0 0x7f147009af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33398/0 (socket says 172.21.15.59:33398) 2024-05-30T16:49:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1476200640 1 -- 172.21.15.59:0/1690291775 learned_addr learned my addr 172.21.15.59:0/1690291775 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1475800640 1 --2- 172.21.15.59:0/1690291775 >> v2:172.21.15.107:3300/0 conn(0x7f1470160d90 0x7f147009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1476200640 1 -- 172.21.15.59:0/1690291775 >> v2:172.21.15.107:3300/0 conn(0x7f1470160d90 msgr2=0x7f147009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:32.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1476200640 1 --2- 172.21.15.59:0/1690291775 >> v2:172.21.15.107:3300/0 conn(0x7f1470160d90 0x7f147009aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1476200640 1 -- 172.21.15.59:0/1690291775 >> v1:172.21.15.107:6789/0 conn(0x7f147009b780 legacy=0x7f147006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.938+0000 7f1476200640 1 -- 172.21.15.59:0/1690291775 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14700d0a70 con 0x7f14700711e0 2024-05-30T16:49:32.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.942+0000 7f1476200640 1 --2- 172.21.15.59:0/1690291775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700711e0 0x7f147009af80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1470073010 tx=0x7f146801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47af9f8d976ad788 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:32.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.942+0000 7f146fe00640 1 -- 172.21.15.59:0/1690291775 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14680a5630 con 0x7f14700711e0 2024-05-30T16:49:32.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.942+0000 7f146fe00640 1 -- 172.21.15.59:0/1690291775 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14680a57d0 con 0x7f14700711e0 2024-05-30T16:49:32.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.942+0000 7f146fe00640 1 -- 172.21.15.59:0/1690291775 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14680a5ba0 con 0x7f14700711e0 2024-05-30T16:49:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.942+0000 7f1478200640 1 -- 172.21.15.59:0/1690291775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700711e0 msgr2=0x7f147009af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.942+0000 7f1478200640 1 --2- 172.21.15.59:0/1690291775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700711e0 0x7f147009af80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1470073010 tx=0x7f146801c960 comp rx=0 tx=0).stop 2024-05-30T16:49:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.942+0000 7f1478200640 1 -- 172.21.15.59:0/1690291775 shutdown_connections 2024-05-30T16:49:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.942+0000 7f1478200640 1 --2- 172.21.15.59:0/1690291775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700711e0 0x7f147009af80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.942+0000 7f1478200640 1 --2- 172.21.15.59:0/1690291775 >> v2:172.21.15.107:3300/0 conn(0x7f1470160d90 0x7f147009aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.942+0000 7f1478200640 1 -- 172.21.15.59:0/1690291775 >> 172.21.15.59:0/1690291775 conn(0x7f14700b3f80 msgr2=0x7f14700b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:32.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.942+0000 7f1478200640 1 -- 172.21.15.59:0/1690291775 shutdown_connections 2024-05-30T16:49:32.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.942+0000 7f1478200640 1 -- 172.21.15.59:0/1690291775 wait complete. 2024-05-30T16:49:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1478200640 1 Processor -- start 2024-05-30T16:49:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1478200640 1 -- start start 2024-05-30T16:49:32.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1478200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700711e0 0x7f14700b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1478200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f147009b780 0x7f147006dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1478200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1470160d90 0x7f1470166990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1478200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1470071fe0 con 0x7f14700711e0 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1478200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1470071e60 con 0x7f147009b780 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1478200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1470161170 con 0x7f1470160d90 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1475800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700711e0 0x7f14700b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1475800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700711e0 0x7f14700b0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33402/0 (socket says 172.21.15.59:33402) 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1475800640 1 -- 172.21.15.59:0/1613379350 learned_addr learned my addr 172.21.15.59:0/1613379350 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1476200640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1470160d90 0x7f1470166990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1474e00640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f147009b780 0x7f147006dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1475800640 1 -- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1470160d90 msgr2=0x7f1470166990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1475800640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1470160d90 0x7f1470166990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1475800640 1 -- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f147009b780 msgr2=0x7f147006dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1475800640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f147009b780 0x7f147006dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1475800640 1 -- 172.21.15.59:0/1613379350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14701658f0 con 0x7f14700711e0 2024-05-30T16:49:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1476200640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1470160d90 0x7f1470166990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1475800640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700711e0 0x7f14700b0df0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f146400d5f0 tx=0x7f146400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f146d600640 1 -- 172.21.15.59:0/1613379350 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640125f0 con 0x7f14700711e0 2024-05-30T16:49:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f146d600640 1 -- 172.21.15.59:0/1613379350 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1464019070 con 0x7f14700711e0 2024-05-30T16:49:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1478200640 1 -- 172.21.15.59:0/1613379350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1470165bd0 con 0x7f14700711e0 2024-05-30T16:49:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f146d600640 1 -- 172.21.15.59:0/1613379350 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640129d0 con 0x7f14700711e0 2024-05-30T16:49:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1478200640 1 -- 172.21.15.59:0/1613379350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1470166190 con 0x7f14700711e0 2024-05-30T16:49:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.946+0000 7f1478200640 1 -- 172.21.15.59:0/1613379350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1470068a90 con 0x7f14700711e0 2024-05-30T16:49:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.950+0000 7f146d600640 1 -- 172.21.15.59:0/1613379350 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1464012b70 con 0x7f14700711e0 2024-05-30T16:49:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.950+0000 7f146d600640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1450068380 0x7f145006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.950+0000 7f146d600640 1 -- 172.21.15.59:0/1613379350 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1464086e00 con 0x7f14700711e0 2024-05-30T16:49:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.950+0000 7f1474e00640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1450068380 0x7f145006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:32.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.950+0000 7f1474e00640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1450068380 0x7f145006a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f14701fb130 tx=0x7f145c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:32.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:32.954+0000 7f146d600640 1 -- 172.21.15.59:0/1613379350 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f14640573b0 con 0x7f14700711e0 2024-05-30T16:49:33.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.130+0000 7f1478200640 1 -- 172.21.15.59:0/1613379350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f14700b4be0 con 0x7f14700711e0 2024-05-30T16:49:33.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f146d600640 1 -- 172.21.15.59:0/1613379350 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f1464056cb0 con 0x7f14700711e0 2024-05-30T16:49:33.138 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T16:49:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f1478200640 1 -- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1450068380 msgr2=0x7f145006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f1478200640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1450068380 0x7f145006a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f14701fb130 tx=0x7f145c009040 comp rx=0 tx=0).stop 2024-05-30T16:49:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f1478200640 1 -- 172.21.15.59:0/1613379350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700711e0 msgr2=0x7f14700b0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f1478200640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700711e0 0x7f14700b0df0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f146400d5f0 tx=0x7f146400dab0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f1478200640 1 -- 172.21.15.59:0/1613379350 shutdown_connections 2024-05-30T16:49:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f1478200640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1450068380 0x7f145006a840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f1478200640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1470160d90 0x7f1470166990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f1478200640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f147009b780 0x7f147006dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f1478200640 1 --2- 172.21.15.59:0/1613379350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700711e0 0x7f14700b0df0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f1478200640 1 -- 172.21.15.59:0/1613379350 >> 172.21.15.59:0/1613379350 conn(0x7f14700b3f80 msgr2=0x7f14701560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f1478200640 1 -- 172.21.15.59:0/1613379350 shutdown_connections 2024-05-30T16:49:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.134+0000 7f1478200640 1 -- 172.21.15.59:0/1613379350 wait complete. 2024-05-30T16:49:33.160 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:49:33.160 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:33.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:49:33.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:49:33.284 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:49:33.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.306+0000 7fae87200640 1 Processor -- start 2024-05-30T16:49:33.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.306+0000 7fae87200640 1 -- start start 2024-05-30T16:49:33.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.310+0000 7fae87200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae8015a1d0 0x7fae8015db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.310+0000 7fae87200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8015d730 con 0x7fae800ad8c0 2024-05-30T16:49:33.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.310+0000 7fae87200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae800b3370 con 0x7fae80159df0 2024-05-30T16:49:33.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.310+0000 7fae87200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fae800b3650 con 0x7fae8015a1d0 2024-05-30T16:49:33.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.310+0000 7fae85200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae8015a1d0 0x7fae8015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.310+0000 7fae85200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae8015a1d0 0x7fae8015db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33418/0 (socket says 172.21.15.59:33418) 2024-05-30T16:49:33.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.310+0000 7fae85200640 1 -- 172.21.15.59:0/319006782 learned_addr learned my addr 172.21.15.59:0/319006782 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:33.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.310+0000 7fae77e00640 1 --1- 172.21.15.59:0/319006782 >> v1:172.21.15.59:6789/0 conn(0x7fae800ad8c0 0x7fae8015ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56454/0 (socket says 172.21.15.59:56454) 2024-05-30T16:49:33.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.310+0000 7fae85200640 1 -- 172.21.15.59:0/319006782 >> v1:172.21.15.107:6789/0 conn(0x7fae80159df0 legacy=0x7fae800ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.310+0000 7fae85200640 1 -- 172.21.15.59:0/319006782 >> v1:172.21.15.59:6789/0 conn(0x7fae800ad8c0 legacy=0x7fae8015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.310+0000 7fae85200640 1 -- 172.21.15.59:0/319006782 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae800b3930 con 0x7fae8015a1d0 2024-05-30T16:49:33.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae85200640 1 --2- 172.21.15.59:0/319006782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae8015a1d0 0x7fae8015db80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fae78009e50 tx=0x7fae7801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a454378498defff server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:33.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae7f400640 1 -- 172.21.15.59:0/319006782 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780a5620 con 0x7fae8015a1d0 2024-05-30T16:49:33.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae7f400640 1 -- 172.21.15.59:0/319006782 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae780a57c0 con 0x7fae8015a1d0 2024-05-30T16:49:33.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae7f400640 1 -- 172.21.15.59:0/319006782 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780a5b90 con 0x7fae8015a1d0 2024-05-30T16:49:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae87200640 1 -- 172.21.15.59:0/319006782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae8015a1d0 msgr2=0x7fae8015db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae87200640 1 --2- 172.21.15.59:0/319006782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae8015a1d0 0x7fae8015db80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fae78009e50 tx=0x7fae7801ca30 comp rx=0 tx=0).stop 2024-05-30T16:49:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae87200640 1 -- 172.21.15.59:0/319006782 shutdown_connections 2024-05-30T16:49:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae87200640 1 --2- 172.21.15.59:0/319006782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae8015a1d0 0x7fae8015db80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae87200640 1 -- 172.21.15.59:0/319006782 >> 172.21.15.59:0/319006782 conn(0x7fae800b22d0 msgr2=0x7fae800b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae87200640 1 -- 172.21.15.59:0/319006782 shutdown_connections 2024-05-30T16:49:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae87200640 1 -- 172.21.15.59:0/319006782 wait complete. 2024-05-30T16:49:33.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae87200640 1 Processor -- start 2024-05-30T16:49:33.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae87200640 1 -- start start 2024-05-30T16:49:33.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.314+0000 7fae87200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae800ad8c0 0x7fae8014a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae87200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae80159df0 0x7fae80072b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae87200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae8015a1d0 0x7fae8014d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae87200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fae8016a590 con 0x7fae800ad8c0 2024-05-30T16:49:33.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae87200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fae8016a410 con 0x7fae8015a1d0 2024-05-30T16:49:33.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae87200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fae8016a710 con 0x7fae80159df0 2024-05-30T16:49:33.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae800ad8c0 0x7fae8014a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae800ad8c0 0x7fae8014a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33428/0 (socket says 172.21.15.59:33428) 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7fe00640 1 -- 172.21.15.59:0/3258772326 learned_addr learned my addr 172.21.15.59:0/3258772326 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae77e00640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae80159df0 0x7fae80072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7fe00640 1 -- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae80159df0 msgr2=0x7fae80072b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae85200640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae8015a1d0 0x7fae8014d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7fe00640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae80159df0 0x7fae80072b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7fe00640 1 -- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae8015a1d0 msgr2=0x7fae8014d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7fe00640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae8015a1d0 0x7fae8014d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7fe00640 1 -- 172.21.15.59:0/3258772326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8014c190 con 0x7fae800ad8c0 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae85200640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae8015a1d0 0x7fae8014d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae77e00640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae80159df0 0x7fae80072b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7fe00640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae800ad8c0 0x7fae8014a600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c420 tx=0x7fae7000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:33.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7cc00640 1 -- 172.21.15.59:0/3258772326 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae700052d0 con 0x7fae800ad8c0 2024-05-30T16:49:33.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7cc00640 1 -- 172.21.15.59:0/3258772326 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae70005470 con 0x7fae800ad8c0 2024-05-30T16:49:33.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae87200640 1 -- 172.21.15.59:0/3258772326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8014c430 con 0x7fae800ad8c0 2024-05-30T16:49:33.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7cc00640 1 -- 172.21.15.59:0/3258772326 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae70007260 con 0x7fae800ad8c0 2024-05-30T16:49:33.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae87200640 1 -- 172.21.15.59:0/3258772326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae8014c9f0 con 0x7fae800ad8c0 2024-05-30T16:49:33.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae87200640 1 -- 172.21.15.59:0/3258772326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae80068a90 con 0x7fae800ad8c0 2024-05-30T16:49:33.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.318+0000 7fae7cc00640 1 -- 172.21.15.59:0/3258772326 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fae70007400 con 0x7fae800ad8c0 2024-05-30T16:49:33.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.322+0000 7fae7cc00640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fae5c068380 0x7fae5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.322+0000 7fae7cc00640 1 -- 172.21.15.59:0/3258772326 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fae70085e70 con 0x7fae800ad8c0 2024-05-30T16:49:33.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.322+0000 7fae77e00640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fae5c068380 0x7fae5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.322+0000 7fae77e00640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fae5c068380 0x7fae5c06a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fae801681b0 tx=0x7fae68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:33.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.326+0000 7fae7cc00640 1 -- 172.21.15.59:0/3258772326 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fae70056420 con 0x7fae800ad8c0 2024-05-30T16:49:33.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.502+0000 7fae87200640 1 -- 172.21.15.59:0/3258772326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fae801681e0 con 0x7fae800ad8c0 2024-05-30T16:49:33.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.502+0000 7fae7cc00640 1 -- 172.21.15.59:0/3258772326 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fae70055d20 con 0x7fae800ad8c0 2024-05-30T16:49:33.508 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T16:49:33.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.506+0000 7fae87200640 1 -- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fae5c068380 msgr2=0x7fae5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.506+0000 7fae87200640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fae5c068380 0x7fae5c06a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fae801681b0 tx=0x7fae68009040 comp rx=0 tx=0).stop 2024-05-30T16:49:33.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.506+0000 7fae87200640 1 -- 172.21.15.59:0/3258772326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae800ad8c0 msgr2=0x7fae8014a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.506+0000 7fae87200640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae800ad8c0 0x7fae8014a600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c420 tx=0x7fae7000c8e0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.506+0000 7fae87200640 1 -- 172.21.15.59:0/3258772326 shutdown_connections 2024-05-30T16:49:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.506+0000 7fae87200640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fae5c068380 0x7fae5c06a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.506+0000 7fae87200640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae8015a1d0 0x7fae8014d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.506+0000 7fae87200640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae80159df0 0x7fae80072b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.506+0000 7fae87200640 1 --2- 172.21.15.59:0/3258772326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae800ad8c0 0x7fae8014a600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.506+0000 7fae87200640 1 -- 172.21.15.59:0/3258772326 >> 172.21.15.59:0/3258772326 conn(0x7fae800b22d0 msgr2=0x7fae800af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.506+0000 7fae87200640 1 -- 172.21.15.59:0/3258772326 shutdown_connections 2024-05-30T16:49:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.506+0000 7fae87200640 1 -- 172.21.15.59:0/3258772326 wait complete. 2024-05-30T16:49:33.529 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi107.front.sepia.ceph.com... 2024-05-30T16:49:33.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:33.530 DEBUG:teuthology.orchestra.run.smithi107:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-30T16:49:33.559 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:49:33.559 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T16:49:33.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:33.559 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-30T16:49:33.625 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:49:33.626 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:33.635 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:49:33.635 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:33.686 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:49:33.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.870+0000 7f9c4a400640 1 Processor -- start 2024-05-30T16:49:33.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.870+0000 7f9c4a400640 1 -- start start 2024-05-30T16:49:33.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.870+0000 7f9c4a400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c44071000 0x7f9c4406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.870+0000 7f9c4a400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4409b7c0 con 0x7f9c440ce2e0 2024-05-30T16:49:33.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.870+0000 7f9c4a400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4409baa0 con 0x7f9c440ce6c0 2024-05-30T16:49:33.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.870+0000 7f9c4a400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c4409bd80 con 0x7f9c44071000 2024-05-30T16:49:33.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.870+0000 7f9c43400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9c440ce2e0 0x7f9c440708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56456/0 (socket says 172.21.15.59:56456) 2024-05-30T16:49:33.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.870+0000 7f9c43400640 1 -- 172.21.15.59:0/3542612890 learned_addr learned my addr 172.21.15.59:0/3542612890 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:33.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4196370525 0 0) 0x7f9c4409b7c0 con 0x7f9c440ce2e0 2024-05-30T16:49:33.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c28003530 con 0x7f9c440ce2e0 2024-05-30T16:49:33.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42a00640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c44071000 0x7f9c4406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 826611161 0 0) 0x7f9c28003530 con 0x7f9c440ce2e0 2024-05-30T16:49:33.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c44071000 msgr2=0x7f9c4406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:33.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c44071000 0x7f9c4406cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 >> v1:172.21.15.107:6789/0 conn(0x7f9c440ce6c0 legacy=0x7f9c4406d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c440d0980 con 0x7f9c440ce2e0 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f9c34001680 con 0x7f9c440ce2e0 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 >> v1:172.21.15.59:6789/0 conn(0x7f9c440ce2e0 legacy=0x7f9c440708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c280039f0 0x7f9c28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c44071000 0x7f9c28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c28004d50 0x7f9c280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4409bd80 con 0x7f9c28004d50 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2800ba00 con 0x7f9c280039f0 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2800bc00 con 0x7f9c44071000 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c43400640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c280039f0 0x7f9c28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c43e00640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c28004d50 0x7f9c280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c42a00640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c44071000 0x7f9c28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c43e00640 1 -- 172.21.15.59:0/3542612890 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c44071000 msgr2=0x7f9c28004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:33.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c43e00640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c44071000 0x7f9c28004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c43e00640 1 -- 172.21.15.59:0/3542612890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c280039f0 msgr2=0x7f9c28003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:33.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c43e00640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c280039f0 0x7f9c28003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c43e00640 1 -- 172.21.15.59:0/3542612890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c28003530 con 0x7f9c28004d50 2024-05-30T16:49:33.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.874+0000 7f9c43400640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c280039f0 0x7f9c28003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:33.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c43e00640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c28004d50 0x7f9c280051d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9c440ceac0 tx=0x7f9c3c01c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de41fd1583989d2f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:33.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0b2070 con 0x7f9c28004d50 2024-05-30T16:49:33.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3c0a5730 con 0x7f9c28004d50 2024-05-30T16:49:33.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c42000640 1 -- 172.21.15.59:0/3542612890 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c001b60 con 0x7f9c28004d50 2024-05-30T16:49:33.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 -- 172.21.15.59:0/3542612890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c28004d50 msgr2=0x7f9c280051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 --2- 172.21.15.59:0/3542612890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c28004d50 0x7f9c280051d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9c440ceac0 tx=0x7f9c3c01c840 comp rx=0 tx=0).stop 2024-05-30T16:49:33.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c43e00640 1 -- 172.21.15.59:0/3542612890 reap_dead start 2024-05-30T16:49:33.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 -- 172.21.15.59:0/3542612890 shutdown_connections 2024-05-30T16:49:33.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 -- 172.21.15.59:0/3542612890 >> 172.21.15.59:0/3542612890 conn(0x7f9c440b3f70 msgr2=0x7f9c440b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:33.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 -- 172.21.15.59:0/3542612890 shutdown_connections 2024-05-30T16:49:33.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 -- 172.21.15.59:0/3542612890 wait complete. 2024-05-30T16:49:33.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 Processor -- start 2024-05-30T16:49:33.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 -- start start 2024-05-30T16:49:33.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c28004d50 0x7f9c4415c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c440cd3d0 0x7f9c441f8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4415bd30 0x7f9c440b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c440d0720 con 0x7f9c4415bd30 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c440d05a0 con 0x7f9c28004d50 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c4a400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c440d1eb0 con 0x7f9c440cd3d0 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.878+0000 7f9c43e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4415bd30 0x7f9c440b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c43e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4415bd30 0x7f9c440b2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33448/0 (socket says 172.21.15.59:33448) 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c43e00640 1 -- 172.21.15.59:0/2444494631 learned_addr learned my addr 172.21.15.59:0/2444494631 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c42a00640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c440cd3d0 0x7f9c441f8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c43400640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c28004d50 0x7f9c4415c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c43e00640 1 -- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c440cd3d0 msgr2=0x7f9c441f8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c43e00640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c440cd3d0 0x7f9c441f8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c43e00640 1 -- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c28004d50 msgr2=0x7f9c4415c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c43e00640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c28004d50 0x7f9c4415c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c43e00640 1 -- 172.21.15.59:0/2444494631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4415ce40 con 0x7f9c4415bd30 2024-05-30T16:49:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c43e00640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4415bd30 0x7f9c440b2f90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c01cd20 tx=0x7f9c28005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c3b400640 1 -- 172.21.15.59:0/2444494631 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0bc070 con 0x7f9c4415bd30 2024-05-30T16:49:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c3b400640 1 -- 172.21.15.59:0/2444494631 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3c001b40 con 0x7f9c4415bd30 2024-05-30T16:49:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c4a400640 1 -- 172.21.15.59:0/2444494631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c441f8c60 con 0x7f9c4415bd30 2024-05-30T16:49:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c3b400640 1 -- 172.21.15.59:0/2444494631 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0b2040 con 0x7f9c4415bd30 2024-05-30T16:49:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c4a400640 1 -- 172.21.15.59:0/2444494631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c440ca2c0 con 0x7f9c4415bd30 2024-05-30T16:49:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c4a400640 1 -- 172.21.15.59:0/2444494631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c44068a90 con 0x7f9c4415bd30 2024-05-30T16:49:33.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c3b400640 1 -- 172.21.15.59:0/2444494631 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9c3c0bf070 con 0x7f9c4415bd30 2024-05-30T16:49:33.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c3b400640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c200683b0 0x7f9c2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:33.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.882+0000 7f9c3b400640 1 -- 172.21.15.59:0/2444494631 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9c3c11fa30 con 0x7f9c4415bd30 2024-05-30T16:49:33.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.886+0000 7f9c43400640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c200683b0 0x7f9c2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:33.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.886+0000 7f9c43400640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c200683b0 0x7f9c2006a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c340015e0 tx=0x7f9c34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:33.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:33.890+0000 7f9c3b400640 1 -- 172.21.15.59:0/2444494631 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c3c016550 con 0x7f9c4415bd30 2024-05-30T16:49:34.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c4a400640 1 -- 172.21.15.59:0/2444494631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9c440704c0 con 0x7f9c4415bd30 2024-05-30T16:49:34.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c3b400640 1 -- 172.21.15.59:0/2444494631 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f9c3c0f4e20 con 0x7f9c4415bd30 2024-05-30T16:49:34.072 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T16:49:34.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c4a400640 1 -- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c200683b0 msgr2=0x7f9c2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c4a400640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c200683b0 0x7f9c2006a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c340015e0 tx=0x7f9c34009040 comp rx=0 tx=0).stop 2024-05-30T16:49:34.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c4a400640 1 -- 172.21.15.59:0/2444494631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4415bd30 msgr2=0x7f9c440b2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c4a400640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4415bd30 0x7f9c440b2f90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c01cd20 tx=0x7f9c28005840 comp rx=0 tx=0).stop 2024-05-30T16:49:34.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c4a400640 1 -- 172.21.15.59:0/2444494631 shutdown_connections 2024-05-30T16:49:34.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c4a400640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c200683b0 0x7f9c2006a870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c4a400640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4415bd30 0x7f9c440b2f90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c4a400640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c440cd3d0 0x7f9c441f8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c4a400640 1 --2- 172.21.15.59:0/2444494631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c28004d50 0x7f9c4415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c4a400640 1 -- 172.21.15.59:0/2444494631 >> 172.21.15.59:0/2444494631 conn(0x7f9c440b3f70 msgr2=0x7f9c440b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:34.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.066+0000 7f9c4a400640 1 -- 172.21.15.59:0/2444494631 shutdown_connections 2024-05-30T16:49:34.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.070+0000 7f9c4a400640 1 -- 172.21.15.59:0/2444494631 wait complete. 2024-05-30T16:49:34.093 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:49:34.094 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:34.103 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:49:34.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f3c000640 1 Processor -- start 2024-05-30T16:49:34.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f3c000640 1 -- start start 2024-05-30T16:49:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f3c000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f340d0560 0x7f7f340d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f3c000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3415f060 con 0x7f7f340af720 2024-05-30T16:49:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f3c000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3415ff00 con 0x7f7f3406e900 2024-05-30T16:49:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f3c000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7f340afb00 con 0x7f7f340d0560 2024-05-30T16:49:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f39600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7f340af720 0x7f7f3415b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56466/0 (socket says 172.21.15.59:56466) 2024-05-30T16:49:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f39600640 1 -- 172.21.15.59:0/2945231143 learned_addr learned my addr 172.21.15.59:0/2945231143 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f3a000640 1 --2- 172.21.15.59:0/2945231143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f340d0560 0x7f7f340d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f33e00640 1 -- 172.21.15.59:0/2945231143 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1844616098 0 0) 0x7f7f3415f060 con 0x7f7f340af720 2024-05-30T16:49:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f33e00640 1 -- 172.21.15.59:0/2945231143 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f1c003530 con 0x7f7f340af720 2024-05-30T16:49:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f33e00640 1 -- 172.21.15.59:0/2945231143 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1964866565 0 0) 0x7f7f3415ff00 con 0x7f7f3406e900 2024-05-30T16:49:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f33e00640 1 -- 172.21.15.59:0/2945231143 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f3415f060 con 0x7f7f3406e900 2024-05-30T16:49:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f3a000640 1 -- 172.21.15.59:0/2945231143 >> v1:172.21.15.107:6789/0 conn(0x7f7f3406e900 legacy=0x7f7f3415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f3a000640 1 -- 172.21.15.59:0/2945231143 >> v1:172.21.15.59:6789/0 conn(0x7f7f340af720 legacy=0x7f7f3415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.282+0000 7f7f3a000640 1 -- 172.21.15.59:0/2945231143 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3415c270 con 0x7f7f340d0560 2024-05-30T16:49:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.286+0000 7f7f3a000640 1 --2- 172.21.15.59:0/2945231143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f340d0560 0x7f7f340d0a10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009dc0 tx=0x7f7f2c01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a28fdc2b1b42595e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.286+0000 7f7f33e00640 1 -- 172.21.15.59:0/2945231143 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0b2070 con 0x7f7f340d0560 2024-05-30T16:49:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.286+0000 7f7f33e00640 1 -- 172.21.15.59:0/2945231143 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f2c0a5940 con 0x7f7f340d0560 2024-05-30T16:49:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.286+0000 7f7f33e00640 1 -- 172.21.15.59:0/2945231143 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0a5d10 con 0x7f7f340d0560 2024-05-30T16:49:34.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.286+0000 7f7f3c000640 1 -- 172.21.15.59:0/2945231143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f340d0560 msgr2=0x7f7f340d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.286+0000 7f7f3c000640 1 --2- 172.21.15.59:0/2945231143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f340d0560 0x7f7f340d0a10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009dc0 tx=0x7f7f2c01c990 comp rx=0 tx=0).stop 2024-05-30T16:49:34.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.286+0000 7f7f3c000640 1 -- 172.21.15.59:0/2945231143 shutdown_connections 2024-05-30T16:49:34.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.286+0000 7f7f3c000640 1 --2- 172.21.15.59:0/2945231143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f340d0560 0x7f7f340d0a10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.286+0000 7f7f3c000640 1 -- 172.21.15.59:0/2945231143 >> 172.21.15.59:0/2945231143 conn(0x7f7f340b22d0 msgr2=0x7f7f340b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:34.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.286+0000 7f7f3c000640 1 -- 172.21.15.59:0/2945231143 shutdown_connections 2024-05-30T16:49:34.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.286+0000 7f7f3c000640 1 -- 172.21.15.59:0/2945231143 wait complete. 2024-05-30T16:49:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3c000640 1 Processor -- start 2024-05-30T16:49:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3c000640 1 -- start start 2024-05-30T16:49:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3c000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f3406e900 0x7f7f3414fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3c000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f340af720 0x7f7f340c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3c000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f340d0560 0x7f7f34151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3c000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7f340732d0 con 0x7f7f340d0560 2024-05-30T16:49:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3c000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7f34073150 con 0x7f7f340af720 2024-05-30T16:49:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3c000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7f341585c0 con 0x7f7f3406e900 2024-05-30T16:49:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f340d0560 0x7f7f34151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f340d0560 0x7f7f34151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33456/0 (socket says 172.21.15.59:33456) 2024-05-30T16:49:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3a000640 1 -- 172.21.15.59:0/3127001891 learned_addr learned my addr 172.21.15.59:0/3127001891 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f38c00640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f340af720 0x7f7f340c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f39600640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f3406e900 0x7f7f3414fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3a000640 1 -- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f3406e900 msgr2=0x7f7f3414fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3a000640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f3406e900 0x7f7f3414fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3a000640 1 -- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f340af720 msgr2=0x7f7f340c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3a000640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f340af720 0x7f7f340c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3a000640 1 -- 172.21.15.59:0/3127001891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f341597d0 con 0x7f7f340d0560 2024-05-30T16:49:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f38c00640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f340af720 0x7f7f340c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3a000640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f340d0560 0x7f7f34151850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c01ce70 tx=0x7f7f2c019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:34.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f31600640 1 -- 172.21.15.59:0/3127001891 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0b2050 con 0x7f7f340d0560 2024-05-30T16:49:34.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f31600640 1 -- 172.21.15.59:0/3127001891 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f2c0be070 con 0x7f7f340d0560 2024-05-30T16:49:34.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f31600640 1 -- 172.21.15.59:0/3127001891 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0ad8b0 con 0x7f7f340d0560 2024-05-30T16:49:34.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3c000640 1 -- 172.21.15.59:0/3127001891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f340b3730 con 0x7f7f340d0560 2024-05-30T16:49:34.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3c000640 1 -- 172.21.15.59:0/3127001891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f340b3cf0 con 0x7f7f340d0560 2024-05-30T16:49:34.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.290+0000 7f7f3c000640 1 -- 172.21.15.59:0/3127001891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f34068a90 con 0x7f7f340d0560 2024-05-30T16:49:34.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.294+0000 7f7f31600640 1 -- 172.21.15.59:0/3127001891 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7f2c0ada50 con 0x7f7f340d0560 2024-05-30T16:49:34.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.294+0000 7f7f31600640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7f14068380 0x7f7f1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:34.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.294+0000 7f7f31600640 1 -- 172.21.15.59:0/3127001891 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7f2c1219f0 con 0x7f7f340d0560 2024-05-30T16:49:34.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.294+0000 7f7f39600640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7f14068380 0x7f7f1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:34.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.294+0000 7f7f39600640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7f14068380 0x7f7f1406a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7f28000f70 tx=0x7f7f28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.298+0000 7f7f31600640 1 -- 172.21.15.59:0/3127001891 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7f2c016580 con 0x7f7f340d0560 2024-05-30T16:49:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 -- 172.21.15.59:0/3127001891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7f3415ec50 con 0x7f7f340d0560 2024-05-30T16:49:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f31600640 1 -- 172.21.15.59:0/3127001891 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f7f2c0f2160 con 0x7f7f340d0560 2024-05-30T16:49:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T16:49:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 -- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7f14068380 msgr2=0x7f7f1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7f14068380 0x7f7f1406a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7f28000f70 tx=0x7f7f28009040 comp rx=0 tx=0).stop 2024-05-30T16:49:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 -- 172.21.15.59:0/3127001891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f340d0560 msgr2=0x7f7f34151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f340d0560 0x7f7f34151850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c01ce70 tx=0x7f7f2c019730 comp rx=0 tx=0).stop 2024-05-30T16:49:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 -- 172.21.15.59:0/3127001891 shutdown_connections 2024-05-30T16:49:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7f14068380 0x7f7f1406a840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f340d0560 0x7f7f34151850 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f340af720 0x7f7f340c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 --2- 172.21.15.59:0/3127001891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f3406e900 0x7f7f3414fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 -- 172.21.15.59:0/3127001891 >> 172.21.15.59:0/3127001891 conn(0x7f7f340b22d0 msgr2=0x7f7f340aded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 -- 172.21.15.59:0/3127001891 shutdown_connections 2024-05-30T16:49:34.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.474+0000 7f7f3c000640 1 -- 172.21.15.59:0/3127001891 wait complete. 2024-05-30T16:49:34.501 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2024-05-30T16:49:34.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:34.501 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-05-30T16:49:34.521 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:49:34.522 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T16:49:34.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:34.522 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-30T16:49:34.578 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:49:34.578 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:34.588 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:49:34.588 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:34.641 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:49:34.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f7400640 1 Processor -- start 2024-05-30T16:49:34.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f7400640 1 -- start start 2024-05-30T16:49:34.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f7400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23f00ae330 0x7f23f00708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:34.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23f00d13a0 0x7f23f00d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:34.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f7400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23f00b66f0 con 0x7f23f0147670 2024-05-30T16:49:34.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f7400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f23f0070e30 con 0x7f23f00d13a0 2024-05-30T16:49:34.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f7400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f23f006f050 con 0x7f23f00ae330 2024-05-30T16:49:34.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f4a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f23f0147670 0x7f23f00b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56468/0 (socket says 172.21.15.59:56468) 2024-05-30T16:49:34.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f4a00640 1 -- 172.21.15.59:0/1002363954 learned_addr learned my addr 172.21.15.59:0/1002363954 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:34.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f5400640 1 --2- 172.21.15.59:0/1002363954 >> v2:172.21.15.59:3300/0 conn(0x7f23f00d13a0 0x7f23f00d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:34.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23e7e00640 1 --2- 172.21.15.59:0/1002363954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23f00ae330 0x7f23f00708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:34.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f5400640 1 -- 172.21.15.59:0/1002363954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23f00ae330 msgr2=0x7f23f00708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:34.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f5400640 1 --2- 172.21.15.59:0/1002363954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23f00ae330 0x7f23f00708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f5400640 1 -- 172.21.15.59:0/1002363954 >> v1:172.21.15.59:6789/0 conn(0x7f23f0147670 legacy=0x7f23f00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23f5400640 1 -- 172.21.15.59:0/1002363954 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f00ae790 con 0x7f23f00d13a0 2024-05-30T16:49:34.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.778+0000 7f23efe00640 1 -- 172.21.15.59:0/1002363954 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1629948740 0 0) 0x7f23f00b66f0 con 0x7f23f0147670 2024-05-30T16:49:34.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.782+0000 7f23f5400640 1 --2- 172.21.15.59:0/1002363954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f00d13a0 0x7f23f00d1830 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009d90 tx=0x7f23e801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21971f740b0000b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.782+0000 7f23efe00640 1 -- 172.21.15.59:0/1002363954 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e80b2070 con 0x7f23f00d13a0 2024-05-30T16:49:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.782+0000 7f23efe00640 1 -- 172.21.15.59:0/1002363954 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e80a5920 con 0x7f23f00d13a0 2024-05-30T16:49:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.782+0000 7f23efe00640 1 -- 172.21.15.59:0/1002363954 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e80a5cf0 con 0x7f23f00d13a0 2024-05-30T16:49:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.782+0000 7f23f7400640 1 -- 172.21.15.59:0/1002363954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f00d13a0 msgr2=0x7f23f00d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.782+0000 7f23f7400640 1 --2- 172.21.15.59:0/1002363954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f00d13a0 0x7f23f00d1830 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009d90 tx=0x7f23e801c970 comp rx=0 tx=0).stop 2024-05-30T16:49:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.782+0000 7f23f7400640 1 -- 172.21.15.59:0/1002363954 shutdown_connections 2024-05-30T16:49:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.782+0000 7f23f7400640 1 --2- 172.21.15.59:0/1002363954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f00d13a0 0x7f23f00d1830 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.782+0000 7f23f7400640 1 --2- 172.21.15.59:0/1002363954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23f00ae330 0x7f23f00708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.782+0000 7f23f7400640 1 -- 172.21.15.59:0/1002363954 >> 172.21.15.59:0/1002363954 conn(0x7f23f009aa40 msgr2=0x7f23f00b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.782+0000 7f23f7400640 1 -- 172.21.15.59:0/1002363954 shutdown_connections 2024-05-30T16:49:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.782+0000 7f23f7400640 1 -- 172.21.15.59:0/1002363954 wait complete. 2024-05-30T16:49:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f7400640 1 Processor -- start 2024-05-30T16:49:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f7400640 1 -- start start 2024-05-30T16:49:34.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f00ae330 0x7f23f015c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:34.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f7400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23f00d13a0 0x7f23f013aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:34.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23f0147670 0x7f23f006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:34.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f7400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f23f006fe70 con 0x7f23f00ae330 2024-05-30T16:49:34.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f7400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f23f006fcf0 con 0x7f23f0147670 2024-05-30T16:49:34.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f7400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f23f006fff0 con 0x7f23f00d13a0 2024-05-30T16:49:34.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f00ae330 0x7f23f015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:34.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f00ae330 0x7f23f015c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33466/0 (socket says 172.21.15.59:33466) 2024-05-30T16:49:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f4a00640 1 -- 172.21.15.59:0/3523657428 learned_addr learned my addr 172.21.15.59:0/3523657428 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23e7e00640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23f00d13a0 0x7f23f013aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f5400640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23f0147670 0x7f23f006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f4a00640 1 -- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23f00d13a0 msgr2=0x7f23f013aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f4a00640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23f00d13a0 0x7f23f013aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f4a00640 1 -- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23f0147670 msgr2=0x7f23f006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f4a00640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23f0147670 0x7f23f006b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f4a00640 1 -- 172.21.15.59:0/3523657428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f01f7810 con 0x7f23f00ae330 2024-05-30T16:49:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23e7e00640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23f00d13a0 0x7f23f013aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f4a00640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f00ae330 0x7f23f015c840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f23e000c480 tx=0x7f23e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23ed600640 1 -- 172.21.15.59:0/3523657428 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0018070 con 0x7f23f00ae330 2024-05-30T16:49:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23ed600640 1 -- 172.21.15.59:0/3523657428 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e0007500 con 0x7f23f00ae330 2024-05-30T16:49:34.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f7400640 1 -- 172.21.15.59:0/3523657428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f01f7af0 con 0x7f23f00ae330 2024-05-30T16:49:34.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23ed600640 1 -- 172.21.15.59:0/3523657428 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0004a30 con 0x7f23f00ae330 2024-05-30T16:49:34.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f7400640 1 -- 172.21.15.59:0/3523657428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f01f80b0 con 0x7f23f00ae330 2024-05-30T16:49:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.786+0000 7f23f7400640 1 -- 172.21.15.59:0/3523657428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23f0068a90 con 0x7f23f00ae330 2024-05-30T16:49:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.790+0000 7f23ed600640 1 -- 172.21.15.59:0/3523657428 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f23e001b070 con 0x7f23f00ae330 2024-05-30T16:49:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.790+0000 7f23ed600640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f23cc068380 0x7f23cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.790+0000 7f23ed600640 1 -- 172.21.15.59:0/3523657428 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f23e0085d60 con 0x7f23f00ae330 2024-05-30T16:49:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.790+0000 7f23e7e00640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f23cc068380 0x7f23cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.790+0000 7f23e7e00640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f23cc068380 0x7f23cc06a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23f009bd20 tx=0x7f23d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:34.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.794+0000 7f23ed600640 1 -- 172.21.15.59:0/3523657428 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f23e0056310 con 0x7f23f00ae330 2024-05-30T16:49:34.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.974+0000 7f23f7400640 1 -- 172.21.15.59:0/3523657428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f23f015e850 con 0x7f23f00ae330 2024-05-30T16:49:34.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.974+0000 7f23ed600640 1 -- 172.21.15.59:0/3523657428 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f23e0055c10 con 0x7f23f00ae330 2024-05-30T16:49:34.980 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T16:49:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.978+0000 7f23f7400640 1 -- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f23cc068380 msgr2=0x7f23cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.978+0000 7f23f7400640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f23cc068380 0x7f23cc06a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23f009bd20 tx=0x7f23d8008040 comp rx=0 tx=0).stop 2024-05-30T16:49:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.978+0000 7f23f7400640 1 -- 172.21.15.59:0/3523657428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f00ae330 msgr2=0x7f23f015c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.978+0000 7f23f7400640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f00ae330 0x7f23f015c840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f23e000c480 tx=0x7f23e000c940 comp rx=0 tx=0).stop 2024-05-30T16:49:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.978+0000 7f23f7400640 1 -- 172.21.15.59:0/3523657428 shutdown_connections 2024-05-30T16:49:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.978+0000 7f23f7400640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f23cc068380 0x7f23cc06a840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.978+0000 7f23f7400640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23f0147670 0x7f23f006b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.978+0000 7f23f7400640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23f00d13a0 0x7f23f013aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.978+0000 7f23f7400640 1 --2- 172.21.15.59:0/3523657428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f00ae330 0x7f23f015c840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.978+0000 7f23f7400640 1 -- 172.21.15.59:0/3523657428 >> 172.21.15.59:0/3523657428 conn(0x7f23f009aa40 msgr2=0x7f23f015f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.978+0000 7f23f7400640 1 -- 172.21.15.59:0/3523657428 shutdown_connections 2024-05-30T16:49:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:34.978+0000 7f23f7400640 1 -- 172.21.15.59:0/3523657428 wait complete. 2024-05-30T16:49:35.002 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:49:35.002 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:35.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:49:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff717200640 1 Processor -- start 2024-05-30T16:49:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff717200640 1 -- start start 2024-05-30T16:49:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff717200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7180aeaa0 0x7ff718067760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff717200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff718162270 0x7ff718162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff717200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff718162bc0 con 0x7ff71815e790 2024-05-30T16:49:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff717200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff71815eb70 con 0x7ff7180aeaa0 2024-05-30T16:49:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff717200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff7180aef60 con 0x7ff718162270 2024-05-30T16:49:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff70fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7180aeaa0 0x7ff718067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff70fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7180aeaa0 0x7ff718067760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33476/0 (socket says 172.21.15.59:33476) 2024-05-30T16:49:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff70fe00640 1 -- 172.21.15.59:0/2844239743 learned_addr learned my addr 172.21.15.59:0/2844239743 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff716800640 1 --2- 172.21.15.59:0/2844239743 >> v2:172.21.15.107:3300/0 conn(0x7ff718162270 0x7ff718162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff70fe00640 1 -- 172.21.15.59:0/2844239743 >> v2:172.21.15.107:3300/0 conn(0x7ff718162270 msgr2=0x7ff718162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff70fe00640 1 --2- 172.21.15.59:0/2844239743 >> v2:172.21.15.107:3300/0 conn(0x7ff718162270 0x7ff718162680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff70fe00640 1 -- 172.21.15.59:0/2844239743 >> v1:172.21.15.107:6789/0 conn(0x7ff71815e790 legacy=0x7ff7180b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.150+0000 7ff70fe00640 1 -- 172.21.15.59:0/2844239743 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7180af240 con 0x7ff7180aeaa0 2024-05-30T16:49:35.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.154+0000 7ff70fe00640 1 --2- 172.21.15.59:0/2844239743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7180aeaa0 0x7ff718067760 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff7180adf50 tx=0x7ff70001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3b555d51d6969f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:35.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.154+0000 7ff715400640 1 -- 172.21.15.59:0/2844239743 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7000ab610 con 0x7ff7180aeaa0 2024-05-30T16:49:35.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.154+0000 7ff715400640 1 -- 172.21.15.59:0/2844239743 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7000b0070 con 0x7ff7180aeaa0 2024-05-30T16:49:35.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.154+0000 7ff715400640 1 -- 172.21.15.59:0/2844239743 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7000ab9d0 con 0x7ff7180aeaa0 2024-05-30T16:49:35.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.154+0000 7ff717200640 1 -- 172.21.15.59:0/2844239743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7180aeaa0 msgr2=0x7ff718067760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.154+0000 7ff717200640 1 --2- 172.21.15.59:0/2844239743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7180aeaa0 0x7ff718067760 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff7180adf50 tx=0x7ff70001c520 comp rx=0 tx=0).stop 2024-05-30T16:49:35.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.154+0000 7ff717200640 1 -- 172.21.15.59:0/2844239743 shutdown_connections 2024-05-30T16:49:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.154+0000 7ff717200640 1 --2- 172.21.15.59:0/2844239743 >> v2:172.21.15.107:3300/0 conn(0x7ff718162270 0x7ff718162680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.154+0000 7ff717200640 1 --2- 172.21.15.59:0/2844239743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7180aeaa0 0x7ff718067760 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.154+0000 7ff717200640 1 -- 172.21.15.59:0/2844239743 >> 172.21.15.59:0/2844239743 conn(0x7ff7180733a0 msgr2=0x7ff71806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.154+0000 7ff717200640 1 -- 172.21.15.59:0/2844239743 shutdown_connections 2024-05-30T16:49:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.154+0000 7ff717200640 1 -- 172.21.15.59:0/2844239743 wait complete. 2024-05-30T16:49:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff717200640 1 Processor -- start 2024-05-30T16:49:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff717200640 1 -- start start 2024-05-30T16:49:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff717200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7180aeaa0 0x7ff7181404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff717200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff71815e790 0x7ff718152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff717200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff718162270 0x7ff718155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff717200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff7180b43a0 con 0x7ff718162270 2024-05-30T16:49:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff717200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff718162fc0 con 0x7ff7180aeaa0 2024-05-30T16:49:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff717200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff7180b4520 con 0x7ff71815e790 2024-05-30T16:49:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff716800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff718162270 0x7ff718155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff716800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff718162270 0x7ff718155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33490/0 (socket says 172.21.15.59:33490) 2024-05-30T16:49:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff716800640 1 -- 172.21.15.59:0/161820777 learned_addr learned my addr 172.21.15.59:0/161820777 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff715e00640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7180aeaa0 0x7ff7181404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff70fe00640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff71815e790 0x7ff718152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff716800640 1 -- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff71815e790 msgr2=0x7ff718152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff716800640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff71815e790 0x7ff718152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff716800640 1 -- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7180aeaa0 msgr2=0x7ff7181404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff716800640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7180aeaa0 0x7ff7181404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff716800640 1 -- 172.21.15.59:0/161820777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71815d150 con 0x7ff718162270 2024-05-30T16:49:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff716800640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff718162270 0x7ff718155c30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff710007e90 tx=0x7ff71000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff70e000640 1 -- 172.21.15.59:0/161820777 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710014420 con 0x7ff718162270 2024-05-30T16:49:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff70e000640 1 -- 172.21.15.59:0/161820777 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff710019070 con 0x7ff718162270 2024-05-30T16:49:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff70e000640 1 -- 172.21.15.59:0/161820777 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710014800 con 0x7ff718162270 2024-05-30T16:49:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff717200640 1 -- 172.21.15.59:0/161820777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff718158bf0 con 0x7ff718162270 2024-05-30T16:49:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.158+0000 7ff717200640 1 -- 172.21.15.59:0/161820777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7181591b0 con 0x7ff718162270 2024-05-30T16:49:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.162+0000 7ff717200640 1 -- 172.21.15.59:0/161820777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7180691a0 con 0x7ff718162270 2024-05-30T16:49:35.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.162+0000 7ff70e000640 1 -- 172.21.15.59:0/161820777 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff7100149a0 con 0x7ff718162270 2024-05-30T16:49:35.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.162+0000 7ff70e000640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff6f4068380 0x7ff6f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.162+0000 7ff70e000640 1 -- 172.21.15.59:0/161820777 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff7100870e0 con 0x7ff718162270 2024-05-30T16:49:35.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.162+0000 7ff715e00640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff6f4068380 0x7ff6f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.162+0000 7ff715e00640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff6f4068380 0x7ff6f406a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff708001810 tx=0x7ff708009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:35.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.166+0000 7ff70e000640 1 -- 172.21.15.59:0/161820777 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff710056fb0 con 0x7ff718162270 2024-05-30T16:49:35.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.342+0000 7ff717200640 1 -- 172.21.15.59:0/161820777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff718162da0 con 0x7ff718162270 2024-05-30T16:49:35.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.342+0000 7ff70e000640 1 -- 172.21.15.59:0/161820777 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7ff71005b2b0 con 0x7ff718162270 2024-05-30T16:49:35.348 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T16:49:35.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.346+0000 7ff717200640 1 -- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff6f4068380 msgr2=0x7ff6f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.346+0000 7ff717200640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff6f4068380 0x7ff6f406a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff708001810 tx=0x7ff708009040 comp rx=0 tx=0).stop 2024-05-30T16:49:35.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.346+0000 7ff717200640 1 -- 172.21.15.59:0/161820777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff718162270 msgr2=0x7ff718155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.346+0000 7ff717200640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff718162270 0x7ff718155c30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff710007e90 tx=0x7ff71000e4b0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.346+0000 7ff717200640 1 -- 172.21.15.59:0/161820777 shutdown_connections 2024-05-30T16:49:35.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.346+0000 7ff717200640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff6f4068380 0x7ff6f406a840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.346+0000 7ff717200640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff718162270 0x7ff718155c30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.346+0000 7ff717200640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff71815e790 0x7ff718152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.346+0000 7ff717200640 1 --2- 172.21.15.59:0/161820777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7180aeaa0 0x7ff7181404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.346+0000 7ff717200640 1 -- 172.21.15.59:0/161820777 >> 172.21.15.59:0/161820777 conn(0x7ff7180733a0 msgr2=0x7ff7180b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:35.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.346+0000 7ff717200640 1 -- 172.21.15.59:0/161820777 shutdown_connections 2024-05-30T16:49:35.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.346+0000 7ff717200640 1 -- 172.21.15.59:0/161820777 wait complete. 2024-05-30T16:49:35.370 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi107.front.sepia.ceph.com... 2024-05-30T16:49:35.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:35.370 DEBUG:teuthology.orchestra.run.smithi107:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-05-30T16:49:35.393 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:49:35.394 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T16:49:35.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:35.394 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-30T16:49:35.446 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T16:49:35.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:35.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37efc00640 1 Processor -- start 2024-05-30T16:49:35.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37efc00640 1 -- start start 2024-05-30T16:49:35.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37efc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e80cfa40 0x7f37e815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37efc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f37e80cfe20 0x7f37e80b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37efc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e815f3b0 con 0x7f37e80b3dd0 2024-05-30T16:49:35.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37efc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f37e815f690 con 0x7f37e80cfe20 2024-05-30T16:49:35.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37efc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f37e815f970 con 0x7f37e80cfa40 2024-05-30T16:49:35.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37edc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f37e80b3dd0 0x7f37e8072060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56472/0 (socket says 172.21.15.59:56472) 2024-05-30T16:49:35.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37edc00640 1 -- 172.21.15.59:0/3925809185 learned_addr learned my addr 172.21.15.59:0/3925809185 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:35.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37e7e00640 1 --2- 172.21.15.59:0/3925809185 >> v2:172.21.15.107:3300/0 conn(0x7f37e80cfe20 0x7f37e80b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37ed200640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e80cfa40 0x7f37e815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253271450 0 0) 0x7f37e815f3b0 con 0x7f37e80b3dd0 2024-05-30T16:49:35.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.582+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37d0003530 con 0x7f37e80b3dd0 2024-05-30T16:49:35.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3236710552 0 0) 0x7f37d0003530 con 0x7f37e80b3dd0 2024-05-30T16:49:35.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e80cfa40 msgr2=0x7f37e815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:35.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e80cfa40 0x7f37e815ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 >> v2:172.21.15.107:3300/0 conn(0x7f37e80cfe20 msgr2=0x7f37e80b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 --2- 172.21.15.59:0/3925809185 >> v2:172.21.15.107:3300/0 conn(0x7f37e80cfe20 0x7f37e80b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e80b3370 con 0x7f37e80b3dd0 2024-05-30T16:49:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f37e0001a00 con 0x7f37e80b3dd0 2024-05-30T16:49:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37ed200640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e80cfa40 0x7f37e815ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7e00640 1 --2- 172.21.15.59:0/3925809185 >> v2:172.21.15.107:3300/0 conn(0x7f37e80cfe20 0x7f37e80b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 >> v1:172.21.15.59:6789/0 conn(0x7f37e80b3dd0 legacy=0x7f37e8072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37d00039c0 0x7f37d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e80cfa40 0x7f37d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d0004d50 0x7f37d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f37e815f690 con 0x7f37d0004d50 2024-05-30T16:49:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f37e815f970 con 0x7f37d00039c0 2024-05-30T16:49:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f37d000b9d0 con 0x7f37e80cfa40 2024-05-30T16:49:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37edc00640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d0004d50 0x7f37d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37ed200640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37d00039c0 0x7f37d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37e7e00640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e80cfa40 0x7f37d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37edc00640 1 -- 172.21.15.59:0/3925809185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e80cfa40 msgr2=0x7f37d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37edc00640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e80cfa40 0x7f37d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37edc00640 1 -- 172.21.15.59:0/3925809185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37d00039c0 msgr2=0x7f37d0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37edc00640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37d00039c0 0x7f37d0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.586+0000 7f37edc00640 1 -- 172.21.15.59:0/3925809185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d0003530 con 0x7f37d0004d50 2024-05-30T16:49:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37edc00640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d0004d50 0x7f37d00051d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f37e000a880 tx=0x7f37e001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8776aedae402154 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e000a4a0 con 0x7f37d0004d50 2024-05-30T16:49:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e00ad630 con 0x7f37d0004d50 2024-05-30T16:49:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37e7400640 1 -- 172.21.15.59:0/3925809185 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e00ada60 con 0x7f37d0004d50 2024-05-30T16:49:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 -- 172.21.15.59:0/3925809185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d0004d50 msgr2=0x7f37d00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 --2- 172.21.15.59:0/3925809185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d0004d50 0x7f37d00051d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f37e000a880 tx=0x7f37e001d3a0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37edc00640 1 -- 172.21.15.59:0/3925809185 reap_dead start 2024-05-30T16:49:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 -- 172.21.15.59:0/3925809185 shutdown_connections 2024-05-30T16:49:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 -- 172.21.15.59:0/3925809185 >> 172.21.15.59:0/3925809185 conn(0x7f37e80b22d0 msgr2=0x7f37e80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 -- 172.21.15.59:0/3925809185 shutdown_connections 2024-05-30T16:49:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 -- 172.21.15.59:0/3925809185 wait complete. 2024-05-30T16:49:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 Processor -- start 2024-05-30T16:49:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 -- start start 2024-05-30T16:49:35.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d0004d50 0x7f37e809df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e809bf50 0x7f37e81e8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e8156f60 0x7f37e81573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f37e80728f0 con 0x7f37d0004d50 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f37e8072770 con 0x7f37e809bf50 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37efc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f37e8073bb0 con 0x7f37e8156f60 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37ed200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d0004d50 0x7f37e809df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37ed200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d0004d50 0x7f37e809df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33512/0 (socket says 172.21.15.59:33512) 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.590+0000 7f37ed200640 1 -- 172.21.15.59:0/1806742084 learned_addr learned my addr 172.21.15.59:0/1806742084 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37e7e00640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e809bf50 0x7f37e81e8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37edc00640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e8156f60 0x7f37e81573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37ed200640 1 -- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e8156f60 msgr2=0x7f37e81573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37ed200640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e8156f60 0x7f37e81573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37ed200640 1 -- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e809bf50 msgr2=0x7f37e81e8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37ed200640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e809bf50 0x7f37e81e8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37ed200640 1 -- 172.21.15.59:0/1806742084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e809c3b0 con 0x7f37d0004d50 2024-05-30T16:49:35.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37e7e00640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e809bf50 0x7f37e81e8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:35.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37ed200640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d0004d50 0x7f37e809df50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f37dc011910 tx=0x7f37dc011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:35.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37e4c00640 1 -- 172.21.15.59:0/1806742084 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00faf0 con 0x7f37d0004d50 2024-05-30T16:49:35.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37e4c00640 1 -- 172.21.15.59:0/1806742084 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc00fc90 con 0x7f37d0004d50 2024-05-30T16:49:35.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37efc00640 1 -- 172.21.15.59:0/1806742084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e8143ed0 con 0x7f37d0004d50 2024-05-30T16:49:35.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37e4c00640 1 -- 172.21.15.59:0/1806742084 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc004030 con 0x7f37d0004d50 2024-05-30T16:49:35.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37efc00640 1 -- 172.21.15.59:0/1806742084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e8144490 con 0x7f37d0004d50 2024-05-30T16:49:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37efc00640 1 -- 172.21.15.59:0/1806742084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e8068a90 con 0x7f37d0004d50 2024-05-30T16:49:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37e4c00640 1 -- 172.21.15.59:0/1806742084 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f37dc012040 con 0x7f37d0004d50 2024-05-30T16:49:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37e4c00640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f37c8068380 0x7f37c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37e4c00640 1 -- 172.21.15.59:0/1806742084 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f37dc086e70 con 0x7f37d0004d50 2024-05-30T16:49:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.594+0000 7f37e7e00640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f37c8068380 0x7f37c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.598+0000 7f37e7e00640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f37c8068380 0x7f37c806a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f37e81f7f70 tx=0x7f37d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:35.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.598+0000 7f37e4c00640 1 -- 172.21.15.59:0/1806742084 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f37dc019070 con 0x7f37d0004d50 2024-05-30T16:49:35.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 -- 172.21.15.59:0/1806742084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37e806f1d0 con 0x7f37d0004d50 2024-05-30T16:49:35.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37e4c00640 1 -- 172.21.15.59:0/1806742084 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7f37dc057300 con 0x7f37d0004d50 2024-05-30T16:49:35.804 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:35.804 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/2922739893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2922739893},{"type":"v1","addr":"172.21.15.59:6833","nonce":2922739893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1233400446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1233400446},{"type":"v1","addr":"172.21.15.59:6835","nonce":1233400446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1465510297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1465510297},{"type":"v1","addr":"172.21.15.107:6836","nonce":1465510297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:03.924942+0000","modified":"2024-05-30T16:49:06.937279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3864508560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3864508560},{"type":"v1","addr":"172.21.15.107:6837","nonce":3864508560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-05-30T16:49:35.804 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2024-05-30T16:49:35.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 -- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f37c8068380 msgr2=0x7f37c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f37c8068380 0x7f37c806a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f37e81f7f70 tx=0x7f37d4008040 comp rx=0 tx=0).stop 2024-05-30T16:49:35.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 -- 172.21.15.59:0/1806742084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d0004d50 msgr2=0x7f37e809df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d0004d50 0x7f37e809df50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f37dc011910 tx=0x7f37dc011dd0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 -- 172.21.15.59:0/1806742084 shutdown_connections 2024-05-30T16:49:35.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f37c8068380 0x7f37c806a840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37e8156f60 0x7f37e81573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e809bf50 0x7f37e81e8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 --2- 172.21.15.59:0/1806742084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d0004d50 0x7f37e809df50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 -- 172.21.15.59:0/1806742084 >> 172.21.15.59:0/1806742084 conn(0x7f37e80b22d0 msgr2=0x7f37e815e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:35.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 -- 172.21.15.59:0/1806742084 shutdown_connections 2024-05-30T16:49:35.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.798+0000 7f37efc00640 1 -- 172.21.15.59:0/1806742084 wait complete. 2024-05-30T16:49:35.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8397400640 1 Processor -- start 2024-05-30T16:49:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8397400640 1 -- start start 2024-05-30T16:49:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8397400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f839009b150 0x7f83900cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8397400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f839009b780 0x7f83900ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8397400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83900d1310 con 0x7f8390160d90 2024-05-30T16:49:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8397400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f839009bcf0 con 0x7f839009b780 2024-05-30T16:49:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8397400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f83900d0a70 con 0x7f839009b150 2024-05-30T16:49:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8395400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f839009b780 0x7f83900ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8395400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f839009b780 0x7f83900ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33526/0 (socket says 172.21.15.59:33526) 2024-05-30T16:49:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8395400640 1 -- 172.21.15.59:0/319324945 learned_addr learned my addr 172.21.15.59:0/319324945 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:35.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f838fe00640 1 --2- 172.21.15.59:0/319324945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f839009b150 0x7f83900cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8395400640 1 -- 172.21.15.59:0/319324945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f839009b150 msgr2=0x7f83900cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:35.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8395400640 1 --2- 172.21.15.59:0/319324945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f839009b150 0x7f83900cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8395400640 1 -- 172.21.15.59:0/319324945 >> v1:172.21.15.107:6789/0 conn(0x7f8390160d90 legacy=0x7f839009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f8395400640 1 -- 172.21.15.59:0/319324945 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83900d0d50 con 0x7f839009b780 2024-05-30T16:49:35.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.962+0000 7f838fe00640 1 --2- 172.21.15.59:0/319324945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f839009b150 0x7f83900cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.966+0000 7f8395400640 1 --2- 172.21.15.59:0/319324945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839009b780 0x7f83900ce260 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8388009e50 tx=0x7f838801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca98b443b4660650 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.966+0000 7f838f400640 1 -- 172.21.15.59:0/319324945 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880a5770 con 0x7f839009b780 2024-05-30T16:49:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.966+0000 7f838f400640 1 -- 172.21.15.59:0/319324945 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83880a5910 con 0x7f839009b780 2024-05-30T16:49:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.966+0000 7f838f400640 1 -- 172.21.15.59:0/319324945 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880a5ce0 con 0x7f839009b780 2024-05-30T16:49:35.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.966+0000 7f8397400640 1 -- 172.21.15.59:0/319324945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839009b780 msgr2=0x7f83900ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.966+0000 7f8397400640 1 --2- 172.21.15.59:0/319324945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839009b780 0x7f83900ce260 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8388009e50 tx=0x7f838801c9a0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.966+0000 7f8397400640 1 -- 172.21.15.59:0/319324945 shutdown_connections 2024-05-30T16:49:35.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.966+0000 7f8397400640 1 --2- 172.21.15.59:0/319324945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839009b780 0x7f83900ce260 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.966+0000 7f8397400640 1 --2- 172.21.15.59:0/319324945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f839009b150 0x7f83900cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.966+0000 7f8397400640 1 -- 172.21.15.59:0/319324945 >> 172.21.15.59:0/319324945 conn(0x7f83900b3f80 msgr2=0x7f83900b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:35.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.966+0000 7f8397400640 1 -- 172.21.15.59:0/319324945 shutdown_connections 2024-05-30T16:49:35.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.966+0000 7f8397400640 1 -- 172.21.15.59:0/319324945 wait complete. 2024-05-30T16:49:35.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8397400640 1 Processor -- start 2024-05-30T16:49:35.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8397400640 1 -- start start 2024-05-30T16:49:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8397400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f839009b150 0x7f83900b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8397400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f839009b780 0x7f8390158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8397400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8390160d90 0x7f83901582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8397400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8390071fe0 con 0x7f8390160d90 2024-05-30T16:49:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8397400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8390071e60 con 0x7f839009b150 2024-05-30T16:49:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8397400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8390161170 con 0x7f839009b780 2024-05-30T16:49:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8395400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8390160d90 0x7f83901582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8395400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8390160d90 0x7f83901582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33530/0 (socket says 172.21.15.59:33530) 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8395400640 1 -- 172.21.15.59:0/372823901 learned_addr learned my addr 172.21.15.59:0/372823901 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f838fe00640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f839009b780 0x7f8390158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8394a00640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f839009b150 0x7f83900b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8395400640 1 -- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f839009b780 msgr2=0x7f8390158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8395400640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f839009b780 0x7f8390158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8395400640 1 -- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f839009b150 msgr2=0x7f83900b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8395400640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f839009b150 0x7f83900b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8395400640 1 -- 172.21.15.59:0/372823901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83900d0760 con 0x7f8390160d90 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8394a00640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f839009b150 0x7f83900b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8395400640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8390160d90 0x7f83901582e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f83880af040 tx=0x7f8388019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f838cc00640 1 -- 172.21.15.59:0/372823901 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880bc020 con 0x7f8390160d90 2024-05-30T16:49:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f838cc00640 1 -- 172.21.15.59:0/372823901 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83880b8670 con 0x7f8390160d90 2024-05-30T16:49:35.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f838cc00640 1 -- 172.21.15.59:0/372823901 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880b8a60 con 0x7f8390160d90 2024-05-30T16:49:35.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8397400640 1 -- 172.21.15.59:0/372823901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83900b61f0 con 0x7f8390160d90 2024-05-30T16:49:35.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8397400640 1 -- 172.21.15.59:0/372823901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83900b6ca0 con 0x7f8390160d90 2024-05-30T16:49:35.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.970+0000 7f8397400640 1 -- 172.21.15.59:0/372823901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83900b6a90 con 0x7f8390160d90 2024-05-30T16:49:35.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.974+0000 7f838cc00640 1 -- 172.21.15.59:0/372823901 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f83880bf020 con 0x7f8390160d90 2024-05-30T16:49:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.974+0000 7f838cc00640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8370068380 0x7f837006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.974+0000 7f838cc00640 1 -- 172.21.15.59:0/372823901 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8388121950 con 0x7f8390160d90 2024-05-30T16:49:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.974+0000 7f8394a00640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8370068380 0x7f837006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.974+0000 7f8394a00640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8370068380 0x7f837006a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f83900c9510 tx=0x7f8384009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:35.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:35.978+0000 7f838cc00640 1 -- 172.21.15.59:0/372823901 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f83880c6030 con 0x7f8390160d90 2024-05-30T16:49:36.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.182+0000 7f8397400640 1 -- 172.21.15.59:0/372823901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83900b4be0 con 0x7f8390160d90 2024-05-30T16:49:36.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.182+0000 7f838cc00640 1 -- 172.21.15.59:0/372823901 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7f8388016620 con 0x7f8390160d90 2024-05-30T16:49:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:36.188 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/2922739893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2922739893},{"type":"v1","addr":"172.21.15.59:6833","nonce":2922739893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1233400446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1233400446},{"type":"v1","addr":"172.21.15.59:6835","nonce":1233400446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1465510297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1465510297},{"type":"v1","addr":"172.21.15.107:6836","nonce":1465510297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:03.924942+0000","modified":"2024-05-30T16:49:06.937279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3864508560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3864508560},{"type":"v1","addr":"172.21.15.107:6837","nonce":3864508560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-05-30T16:49:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2024-05-30T16:49:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.182+0000 7f8397400640 1 -- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8370068380 msgr2=0x7f837006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.182+0000 7f8397400640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8370068380 0x7f837006a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f83900c9510 tx=0x7f8384009040 comp rx=0 tx=0).stop 2024-05-30T16:49:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.182+0000 7f8397400640 1 -- 172.21.15.59:0/372823901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8390160d90 msgr2=0x7f83901582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.182+0000 7f8397400640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8390160d90 0x7f83901582e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f83880af040 tx=0x7f8388019740 comp rx=0 tx=0).stop 2024-05-30T16:49:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.186+0000 7f8397400640 1 -- 172.21.15.59:0/372823901 shutdown_connections 2024-05-30T16:49:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.186+0000 7f8397400640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8370068380 0x7f837006a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.186+0000 7f8397400640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8390160d90 0x7f83901582e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.186+0000 7f8397400640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f839009b780 0x7f8390158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.186+0000 7f8397400640 1 --2- 172.21.15.59:0/372823901 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f839009b150 0x7f83900b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.186+0000 7f8397400640 1 -- 172.21.15.59:0/372823901 >> 172.21.15.59:0/372823901 conn(0x7f83900b3f80 msgr2=0x7f8390166b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.186+0000 7f8397400640 1 -- 172.21.15.59:0/372823901 shutdown_connections 2024-05-30T16:49:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.186+0000 7f8397400640 1 -- 172.21.15.59:0/372823901 wait complete. 2024-05-30T16:49:36.209 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f6493a00640 1 Processor -- start 2024-05-30T16:49:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f6493a00640 1 -- start start 2024-05-30T16:49:36.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f6493a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f648c0d14c0 0x7f648c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f6493a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c06ea20 con 0x7f648c0d05b0 2024-05-30T16:49:36.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f6493a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c070950 con 0x7f648c09b150 2024-05-30T16:49:36.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f6493a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f648c070c30 con 0x7f648c0d14c0 2024-05-30T16:49:36.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f648c0d05b0 0x7f648c09aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56488/0 (socket says 172.21.15.59:56488) 2024-05-30T16:49:36.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648be00640 1 -- 172.21.15.59:0/819581683 learned_addr learned my addr 172.21.15.59:0/819581683 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:36.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f6491000640 1 --2- 172.21.15.59:0/819581683 >> v2:172.21.15.107:3300/0 conn(0x7f648c0d14c0 0x7f648c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2454360683 0 0) 0x7f6478001120 con 0x7f648c0d05b0 2024-05-30T16:49:36.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6474003530 con 0x7f648c0d05b0 2024-05-30T16:49:36.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233356349 0 0) 0x7f648c070950 con 0x7f648c09b150 2024-05-30T16:49:36.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6478001120 con 0x7f648c09b150 2024-05-30T16:49:36.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2306238325 0 0) 0x7f6474003530 con 0x7f648c0d05b0 2024-05-30T16:49:36.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 >> v2:172.21.15.107:3300/0 conn(0x7f648c0d14c0 msgr2=0x7f648c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:36.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 --2- 172.21.15.59:0/819581683 >> v2:172.21.15.107:3300/0 conn(0x7f648c0d14c0 0x7f648c06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 >> v1:172.21.15.107:6789/0 conn(0x7f648c09b150 legacy=0x7f648c06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c070f10 con 0x7f648c0d05b0 2024-05-30T16:49:36.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f6478001850 con 0x7f648c0d05b0 2024-05-30T16:49:36.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f6491000640 1 --2- 172.21.15.59:0/819581683 >> v2:172.21.15.107:3300/0 conn(0x7f648c0d14c0 0x7f648c06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:36.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 >> v1:172.21.15.59:6789/0 conn(0x7f648c0d05b0 legacy=0x7f648c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 --2- 172.21.15.59:0/819581683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474003b50 0x7f6474003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 --2- 172.21.15.59:0/819581683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6474004810 0x7f6474004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 --2- 172.21.15.59:0/819581683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64740051d0 0x7f647400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f648c070c30 con 0x7f6474004810 2024-05-30T16:49:36.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f647400c050 con 0x7f6474003b50 2024-05-30T16:49:36.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f647400c250 con 0x7f64740051d0 2024-05-30T16:49:36.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648be00640 1 --2- 172.21.15.59:0/819581683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6474004810 0x7f6474004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f6491000640 1 --2- 172.21.15.59:0/819581683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474003b50 0x7f6474003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f6491a00640 1 --2- 172.21.15.59:0/819581683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64740051d0 0x7f647400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648be00640 1 -- 172.21.15.59:0/819581683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64740051d0 msgr2=0x7f647400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:36.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648be00640 1 --2- 172.21.15.59:0/819581683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64740051d0 0x7f647400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648be00640 1 -- 172.21.15.59:0/819581683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474003b50 msgr2=0x7f6474003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:36.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648be00640 1 --2- 172.21.15.59:0/819581683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474003b50 0x7f6474003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f648be00640 1 -- 172.21.15.59:0/819581683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6474003530 con 0x7f6474004810 2024-05-30T16:49:36.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f6491a00640 1 --2- 172.21.15.59:0/819581683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64740051d0 0x7f647400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:36.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.346+0000 7f6491a00640 1 -- 172.21.15.59:0/819581683 reap_dead start 2024-05-30T16:49:36.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.350+0000 7f648be00640 1 --2- 172.21.15.59:0/819581683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6474004810 0x7f6474004c90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f647800c490 tx=0x7f647801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a655cec9fda90a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:36.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.350+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647800c0e0 con 0x7f6474004810 2024-05-30T16:49:36.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.350+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64780a9020 con 0x7f6474004810 2024-05-30T16:49:36.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.350+0000 7f648b400640 1 -- 172.21.15.59:0/819581683 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64780a5b00 con 0x7f6474004810 2024-05-30T16:49:36.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.350+0000 7f6493a00640 1 -- 172.21.15.59:0/819581683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6474004810 msgr2=0x7f6474004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.350+0000 7f6493a00640 1 --2- 172.21.15.59:0/819581683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6474004810 0x7f6474004c90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f647800c490 tx=0x7f647801cc00 comp rx=0 tx=0).stop 2024-05-30T16:49:36.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.350+0000 7f6493a00640 1 -- 172.21.15.59:0/819581683 shutdown_connections 2024-05-30T16:49:36.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.350+0000 7f6493a00640 1 --2- 172.21.15.59:0/819581683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6474004810 0x7f6474004c90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.350+0000 7f6493a00640 1 -- 172.21.15.59:0/819581683 >> 172.21.15.59:0/819581683 conn(0x7f648c0b3f80 msgr2=0x7f648c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:36.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.350+0000 7f6493a00640 1 -- 172.21.15.59:0/819581683 shutdown_connections 2024-05-30T16:49:36.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.350+0000 7f6493a00640 1 -- 172.21.15.59:0/819581683 wait complete. 2024-05-30T16:49:36.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6493a00640 1 Processor -- start 2024-05-30T16:49:36.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6493a00640 1 -- start start 2024-05-30T16:49:36.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6493a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474004810 0x7f648c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6493a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f648c0b7bd0 0x7f648c158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6493a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c15bc30 0x7f648c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6493a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0d0a60 con 0x7f648c15bc30 2024-05-30T16:49:36.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6493a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0711f0 con 0x7f6474004810 2024-05-30T16:49:36.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6493a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f648c0d18a0 con 0x7f648c0b7bd0 2024-05-30T16:49:36.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6491a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c15bc30 0x7f648c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6491a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c15bc30 0x7f648c15c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33560/0 (socket says 172.21.15.59:33560) 2024-05-30T16:49:36.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6491a00640 1 -- 172.21.15.59:0/2297567161 learned_addr learned my addr 172.21.15.59:0/2297567161 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6491000640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474004810 0x7f648c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f648be00640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f648c0b7bd0 0x7f648c158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6491a00640 1 -- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f648c0b7bd0 msgr2=0x7f648c158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6491a00640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f648c0b7bd0 0x7f648c158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6491a00640 1 -- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474004810 msgr2=0x7f648c0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6491a00640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474004810 0x7f648c0c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6491a00640 1 -- 172.21.15.59:0/2297567161 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c0c6a30 con 0x7f648c15bc30 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6491a00640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c15bc30 0x7f648c15c0b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f648c0b3f30 tx=0x7f648400f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6488c00640 1 -- 172.21.15.59:0/2297567161 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6484010040 con 0x7f648c15bc30 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6488c00640 1 -- 172.21.15.59:0/2297567161 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648401a070 con 0x7f648c15bc30 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6488c00640 1 -- 172.21.15.59:0/2297567161 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6484015410 con 0x7f648c15bc30 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6493a00640 1 -- 172.21.15.59:0/2297567161 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c0c6cd0 con 0x7f648c15bc30 2024-05-30T16:49:36.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.354+0000 7f6493a00640 1 -- 172.21.15.59:0/2297567161 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c15d0a0 con 0x7f648c15bc30 2024-05-30T16:49:36.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.358+0000 7f6493a00640 1 -- 172.21.15.59:0/2297567161 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648c068a90 con 0x7f648c15bc30 2024-05-30T16:49:36.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.358+0000 7f6488c00640 1 -- 172.21.15.59:0/2297567161 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f64840155b0 con 0x7f648c15bc30 2024-05-30T16:49:36.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.358+0000 7f6488c00640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f646c0683b0 0x7f646c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.358+0000 7f6488c00640 1 -- 172.21.15.59:0/2297567161 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6484089c70 con 0x7f648c15bc30 2024-05-30T16:49:36.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.358+0000 7f6491000640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f646c0683b0 0x7f646c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.358+0000 7f6491000640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f646c0683b0 0x7f646c06a870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6480009d00 tx=0x7f6480009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:36.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.362+0000 7f6488c00640 1 -- 172.21.15.59:0/2297567161 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6484059be0 con 0x7f648c15bc30 2024-05-30T16:49:36.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.530+0000 7f6493a00640 1 -- 172.21.15.59:0/2297567161 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f648c0d2270 con 0x7f648c15bc30 2024-05-30T16:49:36.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.530+0000 7f6488c00640 1 -- 172.21.15.59:0/2297567161 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f648405dee0 con 0x7f648c15bc30 2024-05-30T16:49:36.536 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:36.536 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":23,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:49:05.525706+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:01.850911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:02.883949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.534+0000 7f6493a00640 1 -- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f646c0683b0 msgr2=0x7f646c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.534+0000 7f6493a00640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f646c0683b0 0x7f646c06a870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6480009d00 tx=0x7f6480009190 comp rx=0 tx=0).stop 2024-05-30T16:49:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.534+0000 7f6493a00640 1 -- 172.21.15.59:0/2297567161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c15bc30 msgr2=0x7f648c15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.534+0000 7f6493a00640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c15bc30 0x7f648c15c0b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f648c0b3f30 tx=0x7f648400f540 comp rx=0 tx=0).stop 2024-05-30T16:49:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.534+0000 7f6493a00640 1 -- 172.21.15.59:0/2297567161 shutdown_connections 2024-05-30T16:49:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.534+0000 7f6493a00640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f646c0683b0 0x7f646c06a870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.534+0000 7f6493a00640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c15bc30 0x7f648c15c0b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.534+0000 7f6493a00640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f648c0b7bd0 0x7f648c158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.534+0000 7f6493a00640 1 --2- 172.21.15.59:0/2297567161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474004810 0x7f648c0c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.534+0000 7f6493a00640 1 -- 172.21.15.59:0/2297567161 >> 172.21.15.59:0/2297567161 conn(0x7f648c0b3f80 msgr2=0x7f648c163010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.534+0000 7f6493a00640 1 -- 172.21.15.59:0/2297567161 shutdown_connections 2024-05-30T16:49:36.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.534+0000 7f6493a00640 1 -- 172.21.15.59:0/2297567161 wait complete. 2024-05-30T16:49:36.561 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T16:49:36.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:36.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f7297c00640 1 Processor -- start 2024-05-30T16:49:36.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f7297c00640 1 -- start start 2024-05-30T16:49:36.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f7297c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7290070710 0x7f729009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f7297c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72900cde00 con 0x7f729015ff30 2024-05-30T16:49:36.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f7297c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7290070bd0 con 0x7f72900b1ac0 2024-05-30T16:49:36.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f7297c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f7290070e70 con 0x7f7290070710 2024-05-30T16:49:36.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f7295200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f729015ff30 0x7f7290070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56496/0 (socket says 172.21.15.59:56496) 2024-05-30T16:49:36.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f7295200640 1 -- 172.21.15.59:0/3561096105 learned_addr learned my addr 172.21.15.59:0/3561096105 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:36.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f728fe00640 1 --2- 172.21.15.59:0/3561096105 >> v2:172.21.15.59:3300/0 conn(0x7f7290070710 0x7f729009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f728f400640 1 -- 172.21.15.59:0/3561096105 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3191259483 0 0) 0x7f72900cde00 con 0x7f729015ff30 2024-05-30T16:49:36.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f728f400640 1 -- 172.21.15.59:0/3561096105 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7278003530 con 0x7f729015ff30 2024-05-30T16:49:36.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f728fe00640 1 -- 172.21.15.59:0/3561096105 >> v1:172.21.15.107:6789/0 conn(0x7f72900b1ac0 legacy=0x7f729009af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f728fe00640 1 -- 172.21.15.59:0/3561096105 >> v1:172.21.15.59:6789/0 conn(0x7f729015ff30 legacy=0x7f7290070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.698+0000 7f728fe00640 1 -- 172.21.15.59:0/3561096105 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7290072020 con 0x7f7290070710 2024-05-30T16:49:36.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f728fe00640 1 --2- 172.21.15.59:0/3561096105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7290070710 0x7f729009aa40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f727c0097c0 tx=0x7f727c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c0a07805ce2074 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:36.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f728f400640 1 -- 172.21.15.59:0/3561096105 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c0b0070 con 0x7f7290070710 2024-05-30T16:49:36.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f728f400640 1 -- 172.21.15.59:0/3561096105 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727c0ab600 con 0x7f7290070710 2024-05-30T16:49:36.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f728f400640 1 -- 172.21.15.59:0/3561096105 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c0ab9d0 con 0x7f7290070710 2024-05-30T16:49:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f7297c00640 1 -- 172.21.15.59:0/3561096105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7290070710 msgr2=0x7f729009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f7297c00640 1 --2- 172.21.15.59:0/3561096105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7290070710 0x7f729009aa40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f727c0097c0 tx=0x7f727c01c410 comp rx=0 tx=0).stop 2024-05-30T16:49:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f7297c00640 1 -- 172.21.15.59:0/3561096105 shutdown_connections 2024-05-30T16:49:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f7297c00640 1 --2- 172.21.15.59:0/3561096105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7290070710 0x7f729009aa40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f7297c00640 1 -- 172.21.15.59:0/3561096105 >> 172.21.15.59:0/3561096105 conn(0x7f72900b3f70 msgr2=0x7f72900b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f7297c00640 1 -- 172.21.15.59:0/3561096105 shutdown_connections 2024-05-30T16:49:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f7297c00640 1 -- 172.21.15.59:0/3561096105 wait complete. 2024-05-30T16:49:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f7297c00640 1 Processor -- start 2024-05-30T16:49:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.702+0000 7f7297c00640 1 -- start start 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7297c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7290070710 0x7f729015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7297c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72900b1ac0 0x7f7290153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7297c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f729015ff30 0x7f72901542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7297c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f729016ad00 con 0x7f72900b1ac0 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7297c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f729009bcf0 con 0x7f729015ff30 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7297c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f729016ae80 con 0x7f7290070710 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f728fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72900b1ac0 0x7f7290153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f728fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72900b1ac0 0x7f7290153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33572/0 (socket says 172.21.15.59:33572) 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f728fe00640 1 -- 172.21.15.59:0/1591629634 learned_addr learned my addr 172.21.15.59:0/1591629634 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7295200640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7290070710 0x7f729015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f728fe00640 1 -- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7290070710 msgr2=0x7f729015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f728fe00640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7290070710 0x7f729015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f728fe00640 1 -- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f729015ff30 msgr2=0x7f72901542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7295c00640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f729015ff30 0x7f72901542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f728fe00640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f729015ff30 0x7f72901542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f728fe00640 1 -- 172.21.15.59:0/1591629634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729015d2f0 con 0x7f72900b1ac0 2024-05-30T16:49:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7295200640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7290070710 0x7f729015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7295c00640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f729015ff30 0x7f72901542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f728fe00640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72900b1ac0 0x7f7290153ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f727c01a040 tx=0x7f727c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f728cc00640 1 -- 172.21.15.59:0/1591629634 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c0b8020 con 0x7f72900b1ac0 2024-05-30T16:49:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f728cc00640 1 -- 172.21.15.59:0/1591629634 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727c0b4410 con 0x7f72900b1ac0 2024-05-30T16:49:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f728cc00640 1 -- 172.21.15.59:0/1591629634 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c0b0040 con 0x7f72900b1ac0 2024-05-30T16:49:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7297c00640 1 -- 172.21.15.59:0/1591629634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729015d570 con 0x7f72900b1ac0 2024-05-30T16:49:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7297c00640 1 -- 172.21.15.59:0/1591629634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f729015daf0 con 0x7f72900b1ac0 2024-05-30T16:49:36.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.706+0000 7f7297c00640 1 -- 172.21.15.59:0/1591629634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7290068a90 con 0x7f72900b1ac0 2024-05-30T16:49:36.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.710+0000 7f728cc00640 1 -- 172.21.15.59:0/1591629634 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f727c0bb020 con 0x7f72900b1ac0 2024-05-30T16:49:36.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.710+0000 7f728cc00640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7270068380 0x7f727006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.710+0000 7f728cc00640 1 -- 172.21.15.59:0/1591629634 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f727c120340 con 0x7f72900b1ac0 2024-05-30T16:49:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.710+0000 7f7295200640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7270068380 0x7f727006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.710+0000 7f7295200640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7270068380 0x7f727006a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f72840011f0 tx=0x7f7284009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:36.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.714+0000 7f728cc00640 1 -- 172.21.15.59:0/1591629634 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f727c0c2030 con 0x7f72900b1ac0 2024-05-30T16:49:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 -- 172.21.15.59:0/1591629634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72901575e0 con 0x7f72900b1ac0 2024-05-30T16:49:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f728cc00640 1 -- 172.21.15.59:0/1591629634 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7f729015d2f0 con 0x7f72900b1ac0 2024-05-30T16:49:36.918 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:36.919 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/2922739893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2922739893},{"type":"v1","addr":"172.21.15.59:6833","nonce":2922739893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1233400446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1233400446},{"type":"v1","addr":"172.21.15.59:6835","nonce":1233400446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1465510297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1465510297},{"type":"v1","addr":"172.21.15.107:6836","nonce":1465510297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:03.924942+0000","modified":"2024-05-30T16:49:06.937279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3864508560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3864508560},{"type":"v1","addr":"172.21.15.107:6837","nonce":3864508560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-05-30T16:49:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2024-05-30T16:49:36.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 -- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7270068380 msgr2=0x7f727006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7270068380 0x7f727006a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f72840011f0 tx=0x7f7284009040 comp rx=0 tx=0).stop 2024-05-30T16:49:36.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 -- 172.21.15.59:0/1591629634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72900b1ac0 msgr2=0x7f7290153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72900b1ac0 0x7f7290153ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f727c01a040 tx=0x7f727c0191b0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 -- 172.21.15.59:0/1591629634 shutdown_connections 2024-05-30T16:49:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7270068380 0x7f727006a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f729015ff30 0x7f72901542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72900b1ac0 0x7f7290153ab0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 --2- 172.21.15.59:0/1591629634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7290070710 0x7f729015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 -- 172.21.15.59:0/1591629634 >> 172.21.15.59:0/1591629634 conn(0x7f72900b3f70 msgr2=0x7f7290157de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 -- 172.21.15.59:0/1591629634 shutdown_connections 2024-05-30T16:49:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:36.914+0000 7f7297c00640 1 -- 172.21.15.59:0/1591629634 wait complete. 2024-05-30T16:49:36.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:37.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.074+0000 7f4a48e00640 1 Processor -- start 2024-05-30T16:49:37.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.074+0000 7f4a48e00640 1 -- start start 2024-05-30T16:49:37.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a48e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a44160d90 0x7f4a4409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a48e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a4409b780 0x7f4a4409af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a48e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4a440711e0 0x7f4a4406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a48e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4a440d1310 con 0x7f4a4409b780 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a48e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4a4409bcf0 con 0x7f4a440711e0 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a48e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4a440d0a70 con 0x7f4a44160d90 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a3be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a4409b780 0x7f4a4409af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a3be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a4409b780 0x7f4a4409af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33586/0 (socket says 172.21.15.59:33586) 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a3be00640 1 -- 172.21.15.59:0/3805138401 learned_addr learned my addr 172.21.15.59:0/3805138401 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a41e00640 1 --2- 172.21.15.59:0/3805138401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a44160d90 0x7f4a4409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a42800640 1 --2- 172.21.15.59:0/3805138401 >> v2:172.21.15.107:3300/0 conn(0x7f4a440711e0 0x7f4a4406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a3be00640 1 -- 172.21.15.59:0/3805138401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a44160d90 msgr2=0x7f4a4409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a3be00640 1 --2- 172.21.15.59:0/3805138401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a44160d90 0x7f4a4409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a3be00640 1 -- 172.21.15.59:0/3805138401 >> v2:172.21.15.107:3300/0 conn(0x7f4a440711e0 msgr2=0x7f4a4406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:37.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a3be00640 1 --2- 172.21.15.59:0/3805138401 >> v2:172.21.15.107:3300/0 conn(0x7f4a440711e0 0x7f4a4406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.078+0000 7f4a3be00640 1 -- 172.21.15.59:0/3805138401 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a440d0d50 con 0x7f4a4409b780 2024-05-30T16:49:37.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a3be00640 1 --2- 172.21.15.59:0/3805138401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a4409b780 0x7f4a4409af80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4a44073b70 tx=0x7f4a2c01c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4dd6473b2697e4f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a41400640 1 -- 172.21.15.59:0/3805138401 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0b0070 con 0x7f4a4409b780 2024-05-30T16:49:37.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a41400640 1 -- 172.21.15.59:0/3805138401 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0ab600 con 0x7f4a4409b780 2024-05-30T16:49:37.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a41400640 1 -- 172.21.15.59:0/3805138401 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0ab9d0 con 0x7f4a4409b780 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 -- 172.21.15.59:0/3805138401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a4409b780 msgr2=0x7f4a4409af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 --2- 172.21.15.59:0/3805138401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a4409b780 0x7f4a4409af80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4a44073b70 tx=0x7f4a2c01c1d0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 -- 172.21.15.59:0/3805138401 shutdown_connections 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 --2- 172.21.15.59:0/3805138401 >> v2:172.21.15.107:3300/0 conn(0x7f4a440711e0 0x7f4a4406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 --2- 172.21.15.59:0/3805138401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a4409b780 0x7f4a4409af80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 --2- 172.21.15.59:0/3805138401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a44160d90 0x7f4a4409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 -- 172.21.15.59:0/3805138401 >> 172.21.15.59:0/3805138401 conn(0x7f4a440b3f80 msgr2=0x7f4a440b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 -- 172.21.15.59:0/3805138401 shutdown_connections 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 -- 172.21.15.59:0/3805138401 wait complete. 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 Processor -- start 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 -- start start 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a440711e0 0x7f4a441545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a4409b780 0x7f4a44155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a44160d90 0x7f4a440b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441612f0 con 0x7f4a440711e0 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4a44161170 con 0x7f4a4409b780 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a48e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4a440cdd20 con 0x7f4a44160d90 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a41e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a440711e0 0x7f4a441545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a41e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a440711e0 0x7f4a441545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33588/0 (socket says 172.21.15.59:33588) 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a41e00640 1 -- 172.21.15.59:0/2566374577 learned_addr learned my addr 172.21.15.59:0/2566374577 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.082+0000 7f4a3be00640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a4409b780 0x7f4a44155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a42800640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a44160d90 0x7f4a440b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a41e00640 1 -- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a44160d90 msgr2=0x7f4a440b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a41e00640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a44160d90 0x7f4a440b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a41e00640 1 -- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a4409b780 msgr2=0x7f4a44155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a41e00640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a4409b780 0x7f4a44155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a41e00640 1 -- 172.21.15.59:0/2566374577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a44158e60 con 0x7f4a440711e0 2024-05-30T16:49:37.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a42800640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a44160d90 0x7f4a440b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:37.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a41e00640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a440711e0 0x7f4a441545f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400d620 tx=0x7f4a3400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a3a000640 1 -- 172.21.15.59:0/2566374577 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400b620 con 0x7f4a440711e0 2024-05-30T16:49:37.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a3a000640 1 -- 172.21.15.59:0/2566374577 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a34019070 con 0x7f4a440711e0 2024-05-30T16:49:37.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a3a000640 1 -- 172.21.15.59:0/2566374577 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400b9e0 con 0x7f4a440711e0 2024-05-30T16:49:37.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a48e00640 1 -- 172.21.15.59:0/2566374577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a44159140 con 0x7f4a440711e0 2024-05-30T16:49:37.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a48e00640 1 -- 172.21.15.59:0/2566374577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a44159700 con 0x7f4a440711e0 2024-05-30T16:49:37.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a48e00640 1 -- 172.21.15.59:0/2566374577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a44068a90 con 0x7f4a440711e0 2024-05-30T16:49:37.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a3a000640 1 -- 172.21.15.59:0/2566374577 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a3400bb80 con 0x7f4a440711e0 2024-05-30T16:49:37.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a3a000640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a20068380 0x7f4a2006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.086+0000 7f4a3a000640 1 -- 172.21.15.59:0/2566374577 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4a34086d50 con 0x7f4a440711e0 2024-05-30T16:49:37.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.090+0000 7f4a3be00640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a20068380 0x7f4a2006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.090+0000 7f4a3be00640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a20068380 0x7f4a2006a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0ad000 tx=0x7f4a2c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.090+0000 7f4a3a000640 1 -- 172.21.15.59:0/2566374577 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4a34057300 con 0x7f4a440711e0 2024-05-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.302+0000 7f4a48e00640 1 -- 172.21.15.59:0/2566374577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a440b4be0 con 0x7f4a440711e0 2024-05-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.302+0000 7f4a3a000640 1 -- 172.21.15.59:0/2566374577 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7f4a34056c00 con 0x7f4a440711e0 2024-05-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/2922739893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2922739893},{"type":"v1","addr":"172.21.15.59:6833","nonce":2922739893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1233400446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1233400446},{"type":"v1","addr":"172.21.15.59:6835","nonce":1233400446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1465510297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1465510297},{"type":"v1","addr":"172.21.15.107:6836","nonce":1465510297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:03.924942+0000","modified":"2024-05-30T16:49:06.937279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3864508560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3864508560},{"type":"v1","addr":"172.21.15.107:6837","nonce":3864508560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-05-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2024-05-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.302+0000 7f4a48e00640 1 -- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a20068380 msgr2=0x7f4a2006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.302+0000 7f4a48e00640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a20068380 0x7f4a2006a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0ad000 tx=0x7f4a2c008040 comp rx=0 tx=0).stop 2024-05-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.302+0000 7f4a48e00640 1 -- 172.21.15.59:0/2566374577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a440711e0 msgr2=0x7f4a441545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.302+0000 7f4a48e00640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a440711e0 0x7f4a441545f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400d620 tx=0x7f4a3400dae0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.302+0000 7f4a48e00640 1 -- 172.21.15.59:0/2566374577 shutdown_connections 2024-05-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.302+0000 7f4a48e00640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a20068380 0x7f4a2006a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.302+0000 7f4a48e00640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a44160d90 0x7f4a440b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.302+0000 7f4a48e00640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a4409b780 0x7f4a44155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.302+0000 7f4a48e00640 1 --2- 172.21.15.59:0/2566374577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a440711e0 0x7f4a441545f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.302+0000 7f4a48e00640 1 -- 172.21.15.59:0/2566374577 >> 172.21.15.59:0/2566374577 conn(0x7f4a440b3f80 msgr2=0x7f4a44074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:37.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.306+0000 7f4a48e00640 1 -- 172.21.15.59:0/2566374577 shutdown_connections 2024-05-30T16:49:37.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.306+0000 7f4a48e00640 1 -- 172.21.15.59:0/2566374577 wait complete. 2024-05-30T16:49:37.328 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.462+0000 7fc937600640 1 Processor -- start 2024-05-30T16:49:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.462+0000 7fc937600640 1 -- start start 2024-05-30T16:49:37.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.462+0000 7fc937600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9300af720 0x7fc93015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.462+0000 7fc937600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9300d0560 0x7fc9300d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.462+0000 7fc937600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc93015f060 con 0x7fc93006e900 2024-05-30T16:49:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.462+0000 7fc937600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc9300afb00 con 0x7fc9300d0560 2024-05-30T16:49:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.462+0000 7fc937600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc93015c270 con 0x7fc9300af720 2024-05-30T16:49:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.466+0000 7fc935600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9300d0560 0x7fc9300d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.466+0000 7fc935600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9300d0560 0x7fc9300d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33594/0 (socket says 172.21.15.59:33594) 2024-05-30T16:49:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.466+0000 7fc935600640 1 -- 172.21.15.59:0/3667120022 learned_addr learned my addr 172.21.15.59:0/3667120022 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.466+0000 7fc934c00640 1 --2- 172.21.15.59:0/3667120022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9300af720 0x7fc93015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.466+0000 7fc935600640 1 -- 172.21.15.59:0/3667120022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9300af720 msgr2=0x7fc93015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.466+0000 7fc935600640 1 --2- 172.21.15.59:0/3667120022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9300af720 0x7fc93015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.466+0000 7fc935600640 1 -- 172.21.15.59:0/3667120022 >> v1:172.21.15.107:6789/0 conn(0x7fc93006e900 legacy=0x7fc93015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.466+0000 7fc935600640 1 -- 172.21.15.59:0/3667120022 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93015ff00 con 0x7fc9300d0560 2024-05-30T16:49:37.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.466+0000 7fc935600640 1 --2- 172.21.15.59:0/3667120022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300d0560 0x7fc9300d0a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc928009e50 tx=0x7fc92801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892a3cc8435490f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.466+0000 7fc92f400640 1 -- 172.21.15.59:0/3667120022 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9280a57f0 con 0x7fc9300d0560 2024-05-30T16:49:37.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc92f400640 1 -- 172.21.15.59:0/3667120022 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9280a5990 con 0x7fc9300d0560 2024-05-30T16:49:37.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc92f400640 1 -- 172.21.15.59:0/3667120022 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9280a5d60 con 0x7fc9300d0560 2024-05-30T16:49:37.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 -- 172.21.15.59:0/3667120022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300d0560 msgr2=0x7fc9300d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 --2- 172.21.15.59:0/3667120022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300d0560 0x7fc9300d0a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc928009e50 tx=0x7fc92801ca30 comp rx=0 tx=0).stop 2024-05-30T16:49:37.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 -- 172.21.15.59:0/3667120022 shutdown_connections 2024-05-30T16:49:37.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 --2- 172.21.15.59:0/3667120022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300d0560 0x7fc9300d0a10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 --2- 172.21.15.59:0/3667120022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9300af720 0x7fc93015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 -- 172.21.15.59:0/3667120022 >> 172.21.15.59:0/3667120022 conn(0x7fc9300b22d0 msgr2=0x7fc9300b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:37.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 -- 172.21.15.59:0/3667120022 shutdown_connections 2024-05-30T16:49:37.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 -- 172.21.15.59:0/3667120022 wait complete. 2024-05-30T16:49:37.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 Processor -- start 2024-05-30T16:49:37.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 -- start start 2024-05-30T16:49:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc93006e900 0x7fc93014fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300af720 0x7fc930151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9300d0560 0x7fc930152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc930073150 con 0x7fc9300af720 2024-05-30T16:49:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc93015c830 con 0x7fc93006e900 2024-05-30T16:49:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc937600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc9300732d0 con 0x7fc9300d0560 2024-05-30T16:49:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc92fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300af720 0x7fc930151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc92fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300af720 0x7fc930151f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33610/0 (socket says 172.21.15.59:33610) 2024-05-30T16:49:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc92fe00640 1 -- 172.21.15.59:0/3091321602 learned_addr learned my addr 172.21.15.59:0/3091321602 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc935600640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9300d0560 0x7fc930152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc934c00640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc93006e900 0x7fc93014fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc92fe00640 1 -- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9300d0560 msgr2=0x7fc930152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.470+0000 7fc92fe00640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9300d0560 0x7fc930152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc92fe00640 1 -- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc93006e900 msgr2=0x7fc93014fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc92fe00640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc93006e900 0x7fc93014fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc92fe00640 1 -- 172.21.15.59:0/3091321602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93014cb50 con 0x7fc9300af720 2024-05-30T16:49:37.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc92fe00640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300af720 0x7fc930151f10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00c340 tx=0x7fc91c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc92cc00640 1 -- 172.21.15.59:0/3091321602 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0052d0 con 0x7fc9300af720 2024-05-30T16:49:37.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc92cc00640 1 -- 172.21.15.59:0/3091321602 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c005470 con 0x7fc9300af720 2024-05-30T16:49:37.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc92cc00640 1 -- 172.21.15.59:0/3091321602 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c007260 con 0x7fc9300af720 2024-05-30T16:49:37.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc937600640 1 -- 172.21.15.59:0/3091321602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc930150770 con 0x7fc9300af720 2024-05-30T16:49:37.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc937600640 1 -- 172.21.15.59:0/3091321602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93015d0e0 con 0x7fc9300af720 2024-05-30T16:49:37.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc937600640 1 -- 172.21.15.59:0/3091321602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc930068a90 con 0x7fc9300af720 2024-05-30T16:49:37.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc92cc00640 1 -- 172.21.15.59:0/3091321602 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc91c007400 con 0x7fc9300af720 2024-05-30T16:49:37.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc92cc00640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc910068380 0x7fc91006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc92cc00640 1 -- 172.21.15.59:0/3091321602 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc91c085e50 con 0x7fc9300af720 2024-05-30T16:49:37.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.474+0000 7fc934c00640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc910068380 0x7fc91006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.478+0000 7fc934c00640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc910068380 0x7fc91006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9300b53a0 tx=0x7fc924008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.478+0000 7fc92cc00640 1 -- 172.21.15.59:0/3091321602 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc91c056410 con 0x7fc9300af720 2024-05-30T16:49:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 -- 172.21.15.59:0/3091321602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc930167300 con 0x7fc9300af720 2024-05-30T16:49:37.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc92cc00640 1 -- 172.21.15.59:0/3091321602 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7fc91c055d10 con 0x7fc9300af720 2024-05-30T16:49:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:37.653 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":23,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:49:05.525706+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:01.850911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:02.883949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:37.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 -- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc910068380 msgr2=0x7fc91006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc910068380 0x7fc91006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9300b53a0 tx=0x7fc924008040 comp rx=0 tx=0).stop 2024-05-30T16:49:37.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 -- 172.21.15.59:0/3091321602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300af720 msgr2=0x7fc930151f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300af720 0x7fc930151f10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00c340 tx=0x7fc91c00c800 comp rx=0 tx=0).stop 2024-05-30T16:49:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 -- 172.21.15.59:0/3091321602 shutdown_connections 2024-05-30T16:49:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc910068380 0x7fc91006a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9300d0560 0x7fc930152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300af720 0x7fc930151f10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 --2- 172.21.15.59:0/3091321602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc93006e900 0x7fc93014fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 -- 172.21.15.59:0/3091321602 >> 172.21.15.59:0/3091321602 conn(0x7fc9300b22d0 msgr2=0x7fc9300adf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 -- 172.21.15.59:0/3091321602 shutdown_connections 2024-05-30T16:49:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.646+0000 7fc937600640 1 -- 172.21.15.59:0/3091321602 wait complete. 2024-05-30T16:49:37.673 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T16:49:37.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010f800640 1 Processor -- start 2024-05-30T16:49:37.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010f800640 1 -- start start 2024-05-30T16:49:37.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010f800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f010806e900 0x7f010815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010f800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01080d0560 0x7f01080d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010f800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010815f060 con 0x7f01080af720 2024-05-30T16:49:37.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010f800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f01080afb00 con 0x7f01080d0560 2024-05-30T16:49:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010f800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f010815c270 con 0x7f010806e900 2024-05-30T16:49:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010d800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01080d0560 0x7f01080d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010d800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01080d0560 0x7f01080d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33618/0 (socket says 172.21.15.59:33618) 2024-05-30T16:49:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010d800640 1 -- 172.21.15.59:0/3057330907 learned_addr learned my addr 172.21.15.59:0/3057330907 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f00ffe00640 1 --2- 172.21.15.59:0/3057330907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f010806e900 0x7f010815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010d800640 1 -- 172.21.15.59:0/3057330907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f010806e900 msgr2=0x7f010815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010d800640 1 --2- 172.21.15.59:0/3057330907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f010806e900 0x7f010815f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010d800640 1 -- 172.21.15.59:0/3057330907 >> v1:172.21.15.107:6789/0 conn(0x7f01080af720 legacy=0x7f010815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.810+0000 7f010d800640 1 -- 172.21.15.59:0/3057330907 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010815c550 con 0x7f01080d0560 2024-05-30T16:49:37.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.814+0000 7f010d800640 1 --2- 172.21.15.59:0/3057330907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01080d0560 0x7f01080d0a10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0100009e50 tx=0x7f010001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324bebf4e3b14ab6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.814+0000 7f0107e00640 1 -- 172.21.15.59:0/3057330907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01000a56c0 con 0x7f01080d0560 2024-05-30T16:49:37.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.814+0000 7f0107e00640 1 -- 172.21.15.59:0/3057330907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01000a5860 con 0x7f01080d0560 2024-05-30T16:49:37.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.814+0000 7f0107e00640 1 -- 172.21.15.59:0/3057330907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01000a5c30 con 0x7f01080d0560 2024-05-30T16:49:37.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.814+0000 7f010f800640 1 -- 172.21.15.59:0/3057330907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01080d0560 msgr2=0x7f01080d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.814+0000 7f010f800640 1 --2- 172.21.15.59:0/3057330907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01080d0560 0x7f01080d0a10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0100009e50 tx=0x7f010001c9f0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.814+0000 7f010f800640 1 -- 172.21.15.59:0/3057330907 shutdown_connections 2024-05-30T16:49:37.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.814+0000 7f010f800640 1 --2- 172.21.15.59:0/3057330907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01080d0560 0x7f01080d0a10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.814+0000 7f010f800640 1 --2- 172.21.15.59:0/3057330907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f010806e900 0x7f010815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.814+0000 7f010f800640 1 -- 172.21.15.59:0/3057330907 >> 172.21.15.59:0/3057330907 conn(0x7f01080b22d0 msgr2=0x7f01080b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:37.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.814+0000 7f010f800640 1 -- 172.21.15.59:0/3057330907 shutdown_connections 2024-05-30T16:49:37.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.814+0000 7f010f800640 1 -- 172.21.15.59:0/3057330907 wait complete. 2024-05-30T16:49:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010f800640 1 Processor -- start 2024-05-30T16:49:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010f800640 1 -- start start 2024-05-30T16:49:37.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010f800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f010806e900 0x7f0108155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010f800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01080af720 0x7f010815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010f800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01080d0560 0x7f010815ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010f800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0108073150 con 0x7f010806e900 2024-05-30T16:49:37.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010f800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f01080732d0 con 0x7f01080d0560 2024-05-30T16:49:37.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010f800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f01081585c0 con 0x7f01080af720 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f010806e900 0x7f0108155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f010806e900 0x7f0108155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33634/0 (socket says 172.21.15.59:33634) 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010ce00640 1 -- 172.21.15.59:0/1613470849 learned_addr learned my addr 172.21.15.59:0/1613470849 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f00ffe00640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01080af720 0x7f010815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010d800640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01080d0560 0x7f010815ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010ce00640 1 -- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01080af720 msgr2=0x7f010815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010ce00640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01080af720 0x7f010815a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010ce00640 1 -- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01080d0560 msgr2=0x7f010815ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010ce00640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01080d0560 0x7f010815ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010ce00640 1 -- 172.21.15.59:0/1613470849 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0108165090 con 0x7f010806e900 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f00ffe00640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01080af720 0x7f010815a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010ce00640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f010806e900 0x7f0108155720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c450 tx=0x7f00f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f0105600640 1 -- 172.21.15.59:0/1613470849 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011790 con 0x7f010806e900 2024-05-30T16:49:37.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f0105600640 1 -- 172.21.15.59:0/1613470849 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f8017070 con 0x7f010806e900 2024-05-30T16:49:37.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010f800640 1 -- 172.21.15.59:0/1613470849 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0108165370 con 0x7f010806e900 2024-05-30T16:49:37.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f0105600640 1 -- 172.21.15.59:0/1613470849 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011b90 con 0x7f010806e900 2024-05-30T16:49:37.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010f800640 1 -- 172.21.15.59:0/1613470849 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0108165930 con 0x7f010806e900 2024-05-30T16:49:37.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.818+0000 7f010f800640 1 -- 172.21.15.59:0/1613470849 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0108068a90 con 0x7f010806e900 2024-05-30T16:49:37.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.822+0000 7f0105600640 1 -- 172.21.15.59:0/1613470849 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00f8011d30 con 0x7f010806e900 2024-05-30T16:49:37.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.822+0000 7f0105600640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f00e4068380 0x7f00e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.822+0000 7f0105600640 1 -- 172.21.15.59:0/1613470849 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f00f8086870 con 0x7f010806e900 2024-05-30T16:49:37.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.822+0000 7f00ffe00640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f00e4068380 0x7f00e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.822+0000 7f00ffe00640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f00e4068380 0x7f00e406a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0108167ce0 tx=0x7f00f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:37.826+0000 7f0105600640 1 -- 172.21.15.59:0/1613470849 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f00f8056d90 con 0x7f010806e900 2024-05-30T16:49:38.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.026+0000 7f010f800640 1 -- 172.21.15.59:0/1613470849 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f010816a130 con 0x7f010806e900 2024-05-30T16:49:38.032 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-05-30T16:49:38.026+0000 7f2f74c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T16:49:38.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.030+0000 7f0105600640 1 -- 172.21.15.59:0/1613470849 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f00f8056690 con 0x7f010806e900 2024-05-30T16:49:38.034 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T16:49:38.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.030+0000 7f010f800640 1 -- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f00e4068380 msgr2=0x7f00e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.030+0000 7f010f800640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f00e4068380 0x7f00e406a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0108167ce0 tx=0x7f00f0008040 comp rx=0 tx=0).stop 2024-05-30T16:49:38.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.030+0000 7f010f800640 1 -- 172.21.15.59:0/1613470849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f010806e900 msgr2=0x7f0108155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.030+0000 7f010f800640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f010806e900 0x7f0108155720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c450 tx=0x7f00f800c910 comp rx=0 tx=0).stop 2024-05-30T16:49:38.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.034+0000 7f010f800640 1 -- 172.21.15.59:0/1613470849 shutdown_connections 2024-05-30T16:49:38.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.034+0000 7f010f800640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f00e4068380 0x7f00e406a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.034+0000 7f010f800640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01080d0560 0x7f010815ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.034+0000 7f010f800640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01080af720 0x7f010815a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.034+0000 7f010f800640 1 --2- 172.21.15.59:0/1613470849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f010806e900 0x7f0108155720 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.034+0000 7f010f800640 1 -- 172.21.15.59:0/1613470849 >> 172.21.15.59:0/1613470849 conn(0x7f01080b22d0 msgr2=0x7f010815cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:38.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.034+0000 7f010f800640 1 -- 172.21.15.59:0/1613470849 shutdown_connections 2024-05-30T16:49:38.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.034+0000 7f010f800640 1 -- 172.21.15.59:0/1613470849 wait complete. 2024-05-30T16:49:38.045 INFO:tasks.ceph.mds.d.smithi107.stderr: -2114> 2024-05-30T16:49:09.494+0000 7eff78200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:49:38.059 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T16:49:38.092 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-30T16:49:38.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff639a00640 1 Processor -- start 2024-05-30T16:49:38.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff639a00640 1 -- start start 2024-05-30T16:49:38.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff639a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6341569e0 0x7ff63415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff639a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff6340ad2b0 0x7ff6340cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff639a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6340d0660 0x7ff6340d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff639a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff6340ad770 con 0x7ff6340d0660 2024-05-30T16:49:38.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff639a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff63415cb40 con 0x7ff6340ad2b0 2024-05-30T16:49:38.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff639a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff63415ce20 con 0x7ff6341569e0 2024-05-30T16:49:38.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff633400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6340d0660 0x7ff6340d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff633400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6340d0660 0x7ff6340d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33648/0 (socket says 172.21.15.59:33648) 2024-05-30T16:49:38.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff633400640 1 -- 172.21.15.59:0/3382714515 learned_addr learned my addr 172.21.15.59:0/3382714515 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:38.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff632a00640 1 --2- 172.21.15.59:0/3382714515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6341569e0 0x7ff63415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff62a000640 1 --2- 172.21.15.59:0/3382714515 >> v2:172.21.15.107:3300/0 conn(0x7ff6340ad2b0 0x7ff6340cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff633400640 1 -- 172.21.15.59:0/3382714515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6341569e0 msgr2=0x7ff63415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:38.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff633400640 1 --2- 172.21.15.59:0/3382714515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6341569e0 0x7ff63415d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff633400640 1 -- 172.21.15.59:0/3382714515 >> v2:172.21.15.107:3300/0 conn(0x7ff6340ad2b0 msgr2=0x7ff6340cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:38.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff633400640 1 --2- 172.21.15.59:0/3382714515 >> v2:172.21.15.107:3300/0 conn(0x7ff6340ad2b0 0x7ff6340cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.198+0000 7ff633400640 1 -- 172.21.15.59:0/3382714515 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63415d100 con 0x7ff6340d0660 2024-05-30T16:49:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff633400640 1 --2- 172.21.15.59:0/3382714515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6340d0660 0x7ff6340d0af0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff63406c970 tx=0x7ff62c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f91f1544eae61f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff632000640 1 -- 172.21.15.59:0/3382714515 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0a56f0 con 0x7ff6340d0660 2024-05-30T16:49:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff632000640 1 -- 172.21.15.59:0/3382714515 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff62c0a5890 con 0x7ff6340d0660 2024-05-30T16:49:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff632000640 1 -- 172.21.15.59:0/3382714515 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0a5c60 con 0x7ff6340d0660 2024-05-30T16:49:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff639a00640 1 -- 172.21.15.59:0/3382714515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6340d0660 msgr2=0x7ff6340d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff639a00640 1 --2- 172.21.15.59:0/3382714515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6340d0660 0x7ff6340d0af0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff63406c970 tx=0x7ff62c01c960 comp rx=0 tx=0).stop 2024-05-30T16:49:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff639a00640 1 -- 172.21.15.59:0/3382714515 shutdown_connections 2024-05-30T16:49:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff639a00640 1 --2- 172.21.15.59:0/3382714515 >> v2:172.21.15.107:3300/0 conn(0x7ff6340ad2b0 0x7ff6340cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff639a00640 1 --2- 172.21.15.59:0/3382714515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6340d0660 0x7ff6340d0af0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff639a00640 1 --2- 172.21.15.59:0/3382714515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6341569e0 0x7ff63415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff639a00640 1 -- 172.21.15.59:0/3382714515 >> 172.21.15.59:0/3382714515 conn(0x7ff63406bdb0 msgr2=0x7ff63406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff639a00640 1 -- 172.21.15.59:0/3382714515 shutdown_connections 2024-05-30T16:49:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff639a00640 1 -- 172.21.15.59:0/3382714515 wait complete. 2024-05-30T16:49:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff639a00640 1 Processor -- start 2024-05-30T16:49:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.202+0000 7ff639a00640 1 -- start start 2024-05-30T16:49:38.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff639a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6340ad2b0 0x7ff634150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff639a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6340d0660 0x7ff63409b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff639a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6341569e0 0x7ff6341544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff639a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff6340b3c60 con 0x7ff6340ad2b0 2024-05-30T16:49:38.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff639a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff6340b3ae0 con 0x7ff6341569e0 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff639a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff6340b3de0 con 0x7ff6340d0660 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff632a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6340ad2b0 0x7ff634150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff632a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6340ad2b0 0x7ff634150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33664/0 (socket says 172.21.15.59:33664) 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff632a00640 1 -- 172.21.15.59:0/1575339451 learned_addr learned my addr 172.21.15.59:0/1575339451 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff632a00640 1 -- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6340d0660 msgr2=0x7ff63409b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff633400640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6341569e0 0x7ff6341544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff632a00640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6340d0660 0x7ff63409b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff632a00640 1 -- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6341569e0 msgr2=0x7ff6341544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff632a00640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6341569e0 0x7ff6341544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff632a00640 1 -- 172.21.15.59:0/1575339451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63409bf30 con 0x7ff6340ad2b0 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff632a00640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6340ad2b0 0x7ff634150030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff62400e870 tx=0x7ff62400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff62b400640 1 -- 172.21.15.59:0/1575339451 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624017070 con 0x7ff6340ad2b0 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff62b400640 1 -- 172.21.15.59:0/1575339451 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff62400c940 con 0x7ff6340ad2b0 2024-05-30T16:49:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff639a00640 1 -- 172.21.15.59:0/1575339451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6340b02e0 con 0x7ff6340ad2b0 2024-05-30T16:49:38.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff62b400640 1 -- 172.21.15.59:0/1575339451 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62400ccf0 con 0x7ff6340ad2b0 2024-05-30T16:49:38.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff639a00640 1 -- 172.21.15.59:0/1575339451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6340b08a0 con 0x7ff6340ad2b0 2024-05-30T16:49:38.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.206+0000 7ff639a00640 1 -- 172.21.15.59:0/1575339451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff634068a90 con 0x7ff6340ad2b0 2024-05-30T16:49:38.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.210+0000 7ff62b400640 1 -- 172.21.15.59:0/1575339451 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff62401a070 con 0x7ff6340ad2b0 2024-05-30T16:49:38.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.210+0000 7ff62b400640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff610068380 0x7ff61006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.210+0000 7ff62b400640 1 -- 172.21.15.59:0/1575339451 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7ff624086820 con 0x7ff6340ad2b0 2024-05-30T16:49:38.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.210+0000 7ff62a000640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff610068380 0x7ff61006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.210+0000 7ff62a000640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff610068380 0x7ff61006a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff61c006aa0 tx=0x7ff61c006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.214+0000 7ff62b400640 1 -- 172.21.15.59:0/1575339451 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff624056d80 con 0x7ff6340ad2b0 2024-05-30T16:49:38.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:38.414+0000 7ff639a00640 1 -- 172.21.15.59:0/1575339451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff6340b1640 con 0x7ff6340ad2b0 2024-05-30T16:49:39.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.030+0000 7ff62b400640 1 -- 172.21.15.59:0/1575339451 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7ff624056680 con 0x7ff6340ad2b0 2024-05-30T16:49:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.034+0000 7ff639a00640 1 -- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff610068380 msgr2=0x7ff61006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.034+0000 7ff639a00640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff610068380 0x7ff61006a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff61c006aa0 tx=0x7ff61c006a30 comp rx=0 tx=0).stop 2024-05-30T16:49:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.034+0000 7ff639a00640 1 -- 172.21.15.59:0/1575339451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6340ad2b0 msgr2=0x7ff634150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.034+0000 7ff639a00640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6340ad2b0 0x7ff634150030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff62400e870 tx=0x7ff62400ec70 comp rx=0 tx=0).stop 2024-05-30T16:49:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.034+0000 7ff639a00640 1 -- 172.21.15.59:0/1575339451 shutdown_connections 2024-05-30T16:49:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.034+0000 7ff639a00640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff610068380 0x7ff61006a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.034+0000 7ff639a00640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6341569e0 0x7ff6341544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.034+0000 7ff639a00640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6340d0660 0x7ff63409b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.034+0000 7ff639a00640 1 --2- 172.21.15.59:0/1575339451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6340ad2b0 0x7ff634150030 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.034+0000 7ff639a00640 1 -- 172.21.15.59:0/1575339451 >> 172.21.15.59:0/1575339451 conn(0x7ff63406bdb0 msgr2=0x7ff6340cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:39.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.034+0000 7ff639a00640 1 -- 172.21.15.59:0/1575339451 shutdown_connections 2024-05-30T16:49:39.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.034+0000 7ff639a00640 1 -- 172.21.15.59:0/1575339451 wait complete. 2024-05-30T16:49:39.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T16:49:39.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efdb2400640 1 Processor -- start 2024-05-30T16:49:39.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efdb2400640 1 -- start start 2024-05-30T16:49:39.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efdb2400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efdac15ed00 0x7efdac09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efdb2400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdac0b4aa0 0x7efdac09af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efdb2400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdac0d0ed0 con 0x7efdac0b32e0 2024-05-30T16:49:39.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efdb2400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7efdac15f0e0 con 0x7efdac15ed00 2024-05-30T16:49:39.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efdb2400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efdac0b3830 con 0x7efdac0b4aa0 2024-05-30T16:49:39.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efdab400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efdac15ed00 0x7efdac09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efda3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdac0b4aa0 0x7efdac09af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efdabe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7efdac0b32e0 0x7efdac162780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:56794/0 (socket says 172.21.15.59:56794) 2024-05-30T16:49:39.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efdabe00640 1 -- 172.21.15.59:0/1866060688 learned_addr learned my addr 172.21.15.59:0/1866060688 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:39.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efdaaa00640 1 -- 172.21.15.59:0/1866060688 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1868488857 0 0) 0x7efdac0d0ed0 con 0x7efdac0b32e0 2024-05-30T16:49:39.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efda3e00640 1 -- 172.21.15.59:0/1866060688 >> v2:172.21.15.59:3300/0 conn(0x7efdac15ed00 msgr2=0x7efdac09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:39.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efda3e00640 1 --2- 172.21.15.59:0/1866060688 >> v2:172.21.15.59:3300/0 conn(0x7efdac15ed00 0x7efdac09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efda3e00640 1 -- 172.21.15.59:0/1866060688 >> v1:172.21.15.107:6789/0 conn(0x7efdac0b32e0 legacy=0x7efdac162780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efda3e00640 1 -- 172.21.15.59:0/1866060688 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdac0d1690 con 0x7efdac0b4aa0 2024-05-30T16:49:39.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.202+0000 7efdab400640 1 --2- 172.21.15.59:0/1866060688 >> v2:172.21.15.59:3300/0 conn(0x7efdac15ed00 0x7efdac09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:39.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.206+0000 7efda3e00640 1 --2- 172.21.15.59:0/1866060688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdac0b4aa0 0x7efdac09af80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd940097f0 tx=0x7efd9401c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa27e43d997b5d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:39.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.206+0000 7efdaaa00640 1 -- 172.21.15.59:0/1866060688 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940b0070 con 0x7efdac0b4aa0 2024-05-30T16:49:39.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.206+0000 7efdaaa00640 1 -- 172.21.15.59:0/1866060688 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd940ab600 con 0x7efdac0b4aa0 2024-05-30T16:49:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.206+0000 7efdaaa00640 1 -- 172.21.15.59:0/1866060688 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940ab9d0 con 0x7efdac0b4aa0 2024-05-30T16:49:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.206+0000 7efdb2400640 1 -- 172.21.15.59:0/1866060688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdac0b4aa0 msgr2=0x7efdac09af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.206+0000 7efdb2400640 1 --2- 172.21.15.59:0/1866060688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdac0b4aa0 0x7efdac09af80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd940097f0 tx=0x7efd9401c380 comp rx=0 tx=0).stop 2024-05-30T16:49:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.206+0000 7efdb2400640 1 -- 172.21.15.59:0/1866060688 shutdown_connections 2024-05-30T16:49:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.206+0000 7efdb2400640 1 --2- 172.21.15.59:0/1866060688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdac0b4aa0 0x7efdac09af80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.206+0000 7efdb2400640 1 --2- 172.21.15.59:0/1866060688 >> v2:172.21.15.59:3300/0 conn(0x7efdac15ed00 0x7efdac09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.206+0000 7efdb2400640 1 -- 172.21.15.59:0/1866060688 >> 172.21.15.59:0/1866060688 conn(0x7efdac0b3f80 msgr2=0x7efdac0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:39.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.206+0000 7efdb2400640 1 -- 172.21.15.59:0/1866060688 shutdown_connections 2024-05-30T16:49:39.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.206+0000 7efdb2400640 1 -- 172.21.15.59:0/1866060688 wait complete. 2024-05-30T16:49:39.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdb2400640 1 Processor -- start 2024-05-30T16:49:39.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdb2400640 1 -- start start 2024-05-30T16:49:39.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdb2400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdac0b32e0 0x7efdac159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdb2400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdac0b4aa0 0x7efdac161660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdb2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdac15ed00 0x7efdac161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdb2400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efdac0b2de0 con 0x7efdac15ed00 2024-05-30T16:49:39.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdb2400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efdac0b2c60 con 0x7efdac0b4aa0 2024-05-30T16:49:39.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdb2400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efdac16bac0 con 0x7efdac0b32e0 2024-05-30T16:49:39.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdabe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdac15ed00 0x7efdac161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdabe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdac15ed00 0x7efdac161ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33684/0 (socket says 172.21.15.59:33684) 2024-05-30T16:49:39.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdabe00640 1 -- 172.21.15.59:0/220091572 learned_addr learned my addr 172.21.15.59:0/220091572 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:39.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdab400640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdac0b32e0 0x7efdac159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efda3e00640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdac0b4aa0 0x7efdac161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdabe00640 1 -- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdac0b32e0 msgr2=0x7efdac159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdabe00640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdac0b32e0 0x7efdac159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdabe00640 1 -- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdac0b4aa0 msgr2=0x7efdac161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdabe00640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdac0b4aa0 0x7efdac161660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdabe00640 1 -- 172.21.15.59:0/220091572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdac0ce930 con 0x7efdac15ed00 2024-05-30T16:49:39.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdabe00640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdac15ed00 0x7efdac161ba0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efda400c700 tx=0x7efda400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:39.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efda3400640 1 -- 172.21.15.59:0/220091572 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda4018070 con 0x7efdac15ed00 2024-05-30T16:49:39.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efda3400640 1 -- 172.21.15.59:0/220091572 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda400ce10 con 0x7efdac15ed00 2024-05-30T16:49:39.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efda3400640 1 -- 172.21.15.59:0/220091572 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda400a860 con 0x7efdac15ed00 2024-05-30T16:49:39.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.210+0000 7efdb2400640 1 -- 172.21.15.59:0/220091572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdac1620e0 con 0x7efdac15ed00 2024-05-30T16:49:39.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.214+0000 7efdb2400640 1 -- 172.21.15.59:0/220091572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdac0c6e50 con 0x7efdac15ed00 2024-05-30T16:49:39.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.214+0000 7efdb2400640 1 -- 172.21.15.59:0/220091572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdac068a90 con 0x7efdac15ed00 2024-05-30T16:49:39.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.214+0000 7efda3400640 1 -- 172.21.15.59:0/220091572 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efda400aa00 con 0x7efdac15ed00 2024-05-30T16:49:39.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.214+0000 7efda3400640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd88068380 0x7efd8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.214+0000 7efda3400640 1 -- 172.21.15.59:0/220091572 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7efda40860a0 con 0x7efdac15ed00 2024-05-30T16:49:39.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.214+0000 7efdab400640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd88068380 0x7efd8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.214+0000 7efdab400640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd88068380 0x7efd8806a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009580 tx=0x7efd9c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:39.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.218+0000 7efda3400640 1 -- 172.21.15.59:0/220091572 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efda4055e80 con 0x7efdac15ed00 2024-05-30T16:49:39.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:39.386+0000 7efdb2400640 1 -- 172.21.15.59:0/220091572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7efdac0b8410 con 0x7efdac15ed00 2024-05-30T16:49:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.230+0000 7efda3400640 1 -- 172.21.15.59:0/220091572 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7efda405a180 con 0x7efdac15ed00 2024-05-30T16:49:40.236 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-05-30T16:49:40.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.234+0000 7efdb2400640 1 -- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd88068380 msgr2=0x7efd8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.234+0000 7efdb2400640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd88068380 0x7efd8806a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009580 tx=0x7efd9c009190 comp rx=0 tx=0).stop 2024-05-30T16:49:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.234+0000 7efdb2400640 1 -- 172.21.15.59:0/220091572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdac15ed00 msgr2=0x7efdac161ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.234+0000 7efdb2400640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdac15ed00 0x7efdac161ba0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efda400c700 tx=0x7efda400cbc0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.234+0000 7efdb2400640 1 -- 172.21.15.59:0/220091572 shutdown_connections 2024-05-30T16:49:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.234+0000 7efdb2400640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd88068380 0x7efd8806a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.234+0000 7efdb2400640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdac15ed00 0x7efdac161ba0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.234+0000 7efdb2400640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdac0b4aa0 0x7efdac161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.234+0000 7efdb2400640 1 --2- 172.21.15.59:0/220091572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdac0b32e0 0x7efdac159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.234+0000 7efdb2400640 1 -- 172.21.15.59:0/220091572 >> 172.21.15.59:0/220091572 conn(0x7efdac0b3f80 msgr2=0x7efdac0b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.234+0000 7efdb2400640 1 -- 172.21.15.59:0/220091572 shutdown_connections 2024-05-30T16:49:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.234+0000 7efdb2400640 1 -- 172.21.15.59:0/220091572 wait complete. 2024-05-30T16:49:40.264 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T16:49:40.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.414+0000 7f3776600640 1 Processor -- start 2024-05-30T16:49:40.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.414+0000 7f3776600640 1 -- start start 2024-05-30T16:49:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3776600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700d0f90 0x7f377009b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3776600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37700b5c90 0x7f37700b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3776600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f377015fe20 con 0x7f377015fa40 2024-05-30T16:49:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3776600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f37700d02e0 con 0x7f37700b5c90 2024-05-30T16:49:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3776600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f37700d05c0 con 0x7f37700d0f90 2024-05-30T16:49:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3775c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37700b5c90 0x7f37700b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3775c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37700b5c90 0x7f37700b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33698/0 (socket says 172.21.15.59:33698) 2024-05-30T16:49:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3775c00640 1 -- 172.21.15.59:0/3423337393 learned_addr learned my addr 172.21.15.59:0/3423337393 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f376fe00640 1 --2- 172.21.15.59:0/3423337393 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700d0f90 0x7f377009b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3775c00640 1 -- 172.21.15.59:0/3423337393 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700d0f90 msgr2=0x7f377009b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3775c00640 1 --2- 172.21.15.59:0/3423337393 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700d0f90 0x7f377009b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3775c00640 1 -- 172.21.15.59:0/3423337393 >> v1:172.21.15.107:6789/0 conn(0x7f377015fa40 legacy=0x7f37700d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3775c00640 1 -- 172.21.15.59:0/3423337393 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37700b51b0 con 0x7f37700b5c90 2024-05-30T16:49:40.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f3775c00640 1 --2- 172.21.15.59:0/3423337393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37700b5c90 0x7f37700b60d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3768009e50 tx=0x7f376801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c63c059c0471aa server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:40.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.418+0000 7f376f400640 1 -- 172.21.15.59:0/3423337393 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37680a56e0 con 0x7f37700b5c90 2024-05-30T16:49:40.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f376f400640 1 -- 172.21.15.59:0/3423337393 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37680a5880 con 0x7f37700b5c90 2024-05-30T16:49:40.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f376f400640 1 -- 172.21.15.59:0/3423337393 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37680a5c50 con 0x7f37700b5c90 2024-05-30T16:49:40.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 -- 172.21.15.59:0/3423337393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37700b5c90 msgr2=0x7f37700b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 --2- 172.21.15.59:0/3423337393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37700b5c90 0x7f37700b60d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3768009e50 tx=0x7f376801c910 comp rx=0 tx=0).stop 2024-05-30T16:49:40.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 -- 172.21.15.59:0/3423337393 shutdown_connections 2024-05-30T16:49:40.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 --2- 172.21.15.59:0/3423337393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37700b5c90 0x7f37700b60d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 --2- 172.21.15.59:0/3423337393 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700d0f90 0x7f377009b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 -- 172.21.15.59:0/3423337393 >> 172.21.15.59:0/3423337393 conn(0x7f37700b3db0 msgr2=0x7f37700b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:40.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 -- 172.21.15.59:0/3423337393 shutdown_connections 2024-05-30T16:49:40.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 -- 172.21.15.59:0/3423337393 wait complete. 2024-05-30T16:49:40.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 Processor -- start 2024-05-30T16:49:40.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 -- start start 2024-05-30T16:49:40.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700b5c90 0x7f377015b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37700d0f90 0x7f3770149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f377015fa40 0x7f37700c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3770169270 con 0x7f37700d0f90 2024-05-30T16:49:40.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f37701690f0 con 0x7f377015fa40 2024-05-30T16:49:40.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3776600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f37701693f0 con 0x7f37700b5c90 2024-05-30T16:49:40.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f376fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37700d0f90 0x7f3770149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f376fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37700d0f90 0x7f3770149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33704/0 (socket says 172.21.15.59:33704) 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f376fe00640 1 -- 172.21.15.59:0/1664788407 learned_addr learned my addr 172.21.15.59:0/1664788407 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3775200640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700b5c90 0x7f377015b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3775c00640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f377015fa40 0x7f37700c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f376fe00640 1 -- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700b5c90 msgr2=0x7f377015b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f376fe00640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700b5c90 0x7f377015b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f376fe00640 1 -- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f377015fa40 msgr2=0x7f37700c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f376fe00640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f377015fa40 0x7f37700c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f376fe00640 1 -- 172.21.15.59:0/1664788407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377014a480 con 0x7f37700d0f90 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.422+0000 7f3775c00640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f377015fa40 0x7f37700c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.426+0000 7f376fe00640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37700d0f90 0x7f3770149f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f375c00d620 tx=0x7f375c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.426+0000 7f376cc00640 1 -- 172.21.15.59:0/1664788407 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c00b620 con 0x7f37700d0f90 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.426+0000 7f376cc00640 1 -- 172.21.15.59:0/1664788407 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c019070 con 0x7f37700d0f90 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.426+0000 7f376cc00640 1 -- 172.21.15.59:0/1664788407 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c00ba20 con 0x7f37700d0f90 2024-05-30T16:49:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.426+0000 7f3776600640 1 -- 172.21.15.59:0/1664788407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377015bc90 con 0x7f37700d0f90 2024-05-30T16:49:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.426+0000 7f3776600640 1 -- 172.21.15.59:0/1664788407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f377015c250 con 0x7f37700d0f90 2024-05-30T16:49:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.426+0000 7f3776600640 1 -- 172.21.15.59:0/1664788407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3770068a90 con 0x7f37700d0f90 2024-05-30T16:49:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.426+0000 7f376cc00640 1 -- 172.21.15.59:0/1664788407 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f375c00bbc0 con 0x7f37700d0f90 2024-05-30T16:49:40.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.426+0000 7f376cc00640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3750068380 0x7f375006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.426+0000 7f376cc00640 1 -- 172.21.15.59:0/1664788407 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5357+0+0 (secure 0 0 0) 0x7f375c086ce0 con 0x7f37700d0f90 2024-05-30T16:49:40.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.426+0000 7f3775200640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3750068380 0x7f375006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.430+0000 7f3775200640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3750068380 0x7f375006a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3764007fd0 tx=0x7f3764009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.430+0000 7f376cc00640 1 -- 172.21.15.59:0/1664788407 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f377014a480 con 0x7f37700d0f90 2024-05-30T16:49:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:40.598+0000 7f3776600640 1 -- 172.21.15.59:0/1664788407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f37700cc780 con 0x7f37700d0f90 2024-05-30T16:49:41.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.238+0000 7f376cc00640 1 -- 172.21.15.59:0/1664788407 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f375c057360 con 0x7f37700d0f90 2024-05-30T16:49:41.243 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-05-30T16:49:41.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.238+0000 7f3776600640 1 -- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3750068380 msgr2=0x7f375006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.238+0000 7f3776600640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3750068380 0x7f375006a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3764007fd0 tx=0x7f3764009040 comp rx=0 tx=0).stop 2024-05-30T16:49:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.238+0000 7f3776600640 1 -- 172.21.15.59:0/1664788407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37700d0f90 msgr2=0x7f3770149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.238+0000 7f3776600640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37700d0f90 0x7f3770149f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f375c00d620 tx=0x7f375c00dae0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.238+0000 7f3776600640 1 -- 172.21.15.59:0/1664788407 shutdown_connections 2024-05-30T16:49:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.238+0000 7f3776600640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3750068380 0x7f375006a840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.238+0000 7f3776600640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f377015fa40 0x7f37700c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.238+0000 7f3776600640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37700d0f90 0x7f3770149f40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.238+0000 7f3776600640 1 --2- 172.21.15.59:0/1664788407 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700b5c90 0x7f377015b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.238+0000 7f3776600640 1 -- 172.21.15.59:0/1664788407 >> 172.21.15.59:0/1664788407 conn(0x7f37700b3db0 msgr2=0x7f37701668b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.242+0000 7f3776600640 1 -- 172.21.15.59:0/1664788407 shutdown_connections 2024-05-30T16:49:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.242+0000 7f3776600640 1 -- 172.21.15.59:0/1664788407 wait complete. 2024-05-30T16:49:41.274 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T16:49:41.274 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T16:49:41.274 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T16:49:41.274 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:49:41.274 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T16:49:41.274 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T16:49:41.274 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T16:49:41.275 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:49:41.275 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T16:49:41.275 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T16:49:41.275 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T16:49:41.275 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:49:41.275 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T16:49:41.275 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T16:49:41.276 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T16:49:41.276 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:49:41.287 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T16:49:41.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T16:49:41.288 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T16:49:41.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T16:49:41.289 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T16:49:41.290 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T16:49:41.290 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T16:49:41.290 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T16:49:41.335 INFO:tasks.ceph.mds.b:Started 2024-05-30T16:49:41.335 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:41.336 INFO:tasks.ceph.mds.a:Started 2024-05-30T16:49:41.336 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:41.337 INFO:tasks.ceph.mds.d:Started 2024-05-30T16:49:41.337 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:41.337 INFO:tasks.ceph.mds.c:Started 2024-05-30T16:49:41.338 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:41.338 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T16:49:41.426 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-30T16:49:41.427 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-30T16:49:41.428 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-05-30T16:49:41.429 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T16:49:41.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd053600640 1 Processor -- start 2024-05-30T16:49:41.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd053600640 1 -- start start 2024-05-30T16:49:41.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd053600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd04c0d14c0 0x7fd04c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd053600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd04c0d05b0 0x7fd04c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd053600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04c06ea20 con 0x7fd04c09af80 2024-05-30T16:49:41.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd053600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd04c070950 con 0x7fd04c0d05b0 2024-05-30T16:49:41.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd053600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd04c070c30 con 0x7fd04c0d14c0 2024-05-30T16:49:41.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd04be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd04c0d05b0 0x7fd04c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd050c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd04c0d14c0 0x7fd04c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd050c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd04c0d14c0 0x7fd04c06e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:45298/0 (socket says 172.21.15.59:45298) 2024-05-30T16:49:41.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd050c00640 1 -- 172.21.15.59:0/1995347555 learned_addr learned my addr 172.21.15.59:0/1995347555 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:41.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd050c00640 1 -- 172.21.15.59:0/1995347555 >> v2:172.21.15.59:3300/0 conn(0x7fd04c0d05b0 msgr2=0x7fd04c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:41.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd050c00640 1 --2- 172.21.15.59:0/1995347555 >> v2:172.21.15.59:3300/0 conn(0x7fd04c0d05b0 0x7fd04c09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd050c00640 1 -- 172.21.15.59:0/1995347555 >> v1:172.21.15.59:6789/0 conn(0x7fd04c09af80 legacy=0x7fd04c162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.494+0000 7fd050c00640 1 -- 172.21.15.59:0/1995347555 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c070f10 con 0x7fd04c0d14c0 2024-05-30T16:49:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.498+0000 7fd050c00640 1 --2- 172.21.15.59:0/1995347555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd04c0d14c0 0x7fd04c06e4e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd040009870 tx=0x7fd04001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce8599351007cca6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.498+0000 7fd04b400640 1 -- 172.21.15.59:0/1995347555 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0400b0070 con 0x7fd04c0d14c0 2024-05-30T16:49:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.498+0000 7fd04b400640 1 -- 172.21.15.59:0/1995347555 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0400ab600 con 0x7fd04c0d14c0 2024-05-30T16:49:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.498+0000 7fd04b400640 1 -- 172.21.15.59:0/1995347555 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0400ab9d0 con 0x7fd04c0d14c0 2024-05-30T16:49:41.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.498+0000 7fd053600640 1 -- 172.21.15.59:0/1995347555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd04c0d14c0 msgr2=0x7fd04c06e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.498+0000 7fd053600640 1 --2- 172.21.15.59:0/1995347555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd04c0d14c0 0x7fd04c06e4e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd040009870 tx=0x7fd04001c560 comp rx=0 tx=0).stop 2024-05-30T16:49:41.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.498+0000 7fd053600640 1 -- 172.21.15.59:0/1995347555 shutdown_connections 2024-05-30T16:49:41.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.498+0000 7fd053600640 1 --2- 172.21.15.59:0/1995347555 >> v2:172.21.15.59:3300/0 conn(0x7fd04c0d05b0 0x7fd04c09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.498+0000 7fd053600640 1 --2- 172.21.15.59:0/1995347555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd04c0d14c0 0x7fd04c06e4e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.498+0000 7fd053600640 1 -- 172.21.15.59:0/1995347555 >> 172.21.15.59:0/1995347555 conn(0x7fd04c0b3f80 msgr2=0x7fd04c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:41.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.498+0000 7fd053600640 1 -- 172.21.15.59:0/1995347555 shutdown_connections 2024-05-30T16:49:41.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.498+0000 7fd053600640 1 -- 172.21.15.59:0/1995347555 wait complete. 2024-05-30T16:49:41.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd053600640 1 Processor -- start 2024-05-30T16:49:41.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd053600640 1 -- start start 2024-05-30T16:49:41.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd053600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c09af80 0x7fd04c0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd053600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd04c0d05b0 0x7fd04c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd053600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd04c0d14c0 0x7fd04c0cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd053600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c0d0b10 con 0x7fd04c0d05b0 2024-05-30T16:49:41.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd053600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c0d0990 con 0x7fd04c09af80 2024-05-30T16:49:41.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd053600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd04c06e100 con 0x7fd04c0d14c0 2024-05-30T16:49:41.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd04be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd04c0d05b0 0x7fd04c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd04be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd04c0d05b0 0x7fd04c0c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33768/0 (socket says 172.21.15.59:33768) 2024-05-30T16:49:41.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd04be00640 1 -- 172.21.15.59:0/3550251866 learned_addr learned my addr 172.21.15.59:0/3550251866 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:41.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd050c00640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c09af80 0x7fd04c0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd051600640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd04c0d14c0 0x7fd04c0cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd04be00640 1 -- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd04c0d14c0 msgr2=0x7fd04c0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd04be00640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd04c0d14c0 0x7fd04c0cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd04be00640 1 -- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c09af80 msgr2=0x7fd04c0c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd04be00640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c09af80 0x7fd04c0c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd04be00640 1 -- 172.21.15.59:0/3550251866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c0c9690 con 0x7fd04c0d05b0 2024-05-30T16:49:41.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd04be00640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd04c0d05b0 0x7fd04c0c8d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd03800e960 tx=0x7fd03800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:41.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd048c00640 1 -- 172.21.15.59:0/3550251866 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038017070 con 0x7fd04c0d05b0 2024-05-30T16:49:41.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd048c00640 1 -- 172.21.15.59:0/3550251866 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd03800ca00 con 0x7fd04c0d05b0 2024-05-30T16:49:41.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd048c00640 1 -- 172.21.15.59:0/3550251866 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03800cdb0 con 0x7fd04c0d05b0 2024-05-30T16:49:41.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd053600640 1 -- 172.21.15.59:0/3550251866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04c0c9970 con 0x7fd04c0d05b0 2024-05-30T16:49:41.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.502+0000 7fd053600640 1 -- 172.21.15.59:0/3550251866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04c0c9250 con 0x7fd04c0d05b0 2024-05-30T16:49:41.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.506+0000 7fd053600640 1 -- 172.21.15.59:0/3550251866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04c0c9b70 con 0x7fd04c0d05b0 2024-05-30T16:49:41.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.506+0000 7fd048c00640 1 -- 172.21.15.59:0/3550251866 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd03801a070 con 0x7fd04c0d05b0 2024-05-30T16:49:41.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.506+0000 7fd048c00640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd02c068380 0x7fd02c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.506+0000 7fd048c00640 1 -- 172.21.15.59:0/3550251866 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7fd038086a10 con 0x7fd04c0d05b0 2024-05-30T16:49:41.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.506+0000 7fd050c00640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd02c068380 0x7fd02c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.506+0000 7fd050c00640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd02c068380 0x7fd02c06a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd0400ad000 tx=0x7fd0400a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:41.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.510+0000 7fd048c00640 1 -- 172.21.15.59:0/3550251866 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd038056c70 con 0x7fd04c0d05b0 2024-05-30T16:49:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:41.686+0000 7fd053600640 1 -- 172.21.15.59:0/3550251866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd04c068a90 con 0x7fd04c0d05b0 2024-05-30T16:49:42.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.250+0000 7fd048c00640 1 -- 172.21.15.59:0/3550251866 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7fd03805af70 con 0x7fd04c0d05b0 2024-05-30T16:49:42.255 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-05-30T16:49:42.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.254+0000 7fd053600640 1 -- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd02c068380 msgr2=0x7fd02c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.254+0000 7fd053600640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd02c068380 0x7fd02c06a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd0400ad000 tx=0x7fd0400a6000 comp rx=0 tx=0).stop 2024-05-30T16:49:42.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.254+0000 7fd053600640 1 -- 172.21.15.59:0/3550251866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd04c0d05b0 msgr2=0x7fd04c0c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.254+0000 7fd053600640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd04c0d05b0 0x7fd04c0c8d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd03800e960 tx=0x7fd03800ee20 comp rx=0 tx=0).stop 2024-05-30T16:49:42.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.254+0000 7fd053600640 1 -- 172.21.15.59:0/3550251866 shutdown_connections 2024-05-30T16:49:42.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.254+0000 7fd053600640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd02c068380 0x7fd02c06a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.254+0000 7fd053600640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd04c0d14c0 0x7fd04c0cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.254+0000 7fd053600640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd04c0d05b0 0x7fd04c0c8d10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.254+0000 7fd053600640 1 --2- 172.21.15.59:0/3550251866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c09af80 0x7fd04c0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.254+0000 7fd053600640 1 -- 172.21.15.59:0/3550251866 >> 172.21.15.59:0/3550251866 conn(0x7fd04c0b3f80 msgr2=0x7fd04c162580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:42.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.254+0000 7fd053600640 1 -- 172.21.15.59:0/3550251866 shutdown_connections 2024-05-30T16:49:42.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.254+0000 7fd053600640 1 -- 172.21.15.59:0/3550251866 wait complete. 2024-05-30T16:49:42.282 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T16:49:42.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc216200640 1 Processor -- start 2024-05-30T16:49:42.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc216200640 1 -- start start 2024-05-30T16:49:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc216200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc210070710 0x7fc21009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc216200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2100b1ac0 0x7fc21009af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc216200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2100cde00 con 0x7fc21015ff30 2024-05-30T16:49:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc216200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc210070bd0 con 0x7fc2100b1ac0 2024-05-30T16:49:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc216200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc210070e70 con 0x7fc210070710 2024-05-30T16:49:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc20fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2100b1ac0 0x7fc21009af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc20fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2100b1ac0 0x7fc21009af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53148/0 (socket says 172.21.15.59:53148) 2024-05-30T16:49:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc20fe00640 1 -- 172.21.15.59:0/3023718301 learned_addr learned my addr 172.21.15.59:0/3023718301 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc20ea00640 1 --2- 172.21.15.59:0/3023718301 >> v2:172.21.15.107:3300/0 conn(0x7fc210070710 0x7fc21009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc20fe00640 1 -- 172.21.15.59:0/3023718301 >> v2:172.21.15.107:3300/0 conn(0x7fc210070710 msgr2=0x7fc21009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc20fe00640 1 --2- 172.21.15.59:0/3023718301 >> v2:172.21.15.107:3300/0 conn(0x7fc210070710 0x7fc21009aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc20fe00640 1 -- 172.21.15.59:0/3023718301 >> v1:172.21.15.107:6789/0 conn(0x7fc21015ff30 legacy=0x7fc210070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.422+0000 7fc20fe00640 1 -- 172.21.15.59:0/3023718301 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc210072020 con 0x7fc2100b1ac0 2024-05-30T16:49:42.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc20fe00640 1 --2- 172.21.15.59:0/3023718301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2100b1ac0 0x7fc21009af80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc210073360 tx=0x7fc20801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc483587607a296 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:42.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc20e000640 1 -- 172.21.15.59:0/3023718301 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2080a5730 con 0x7fc2100b1ac0 2024-05-30T16:49:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc20e000640 1 -- 172.21.15.59:0/3023718301 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2080a58d0 con 0x7fc2100b1ac0 2024-05-30T16:49:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc20e000640 1 -- 172.21.15.59:0/3023718301 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2080a5ca0 con 0x7fc2100b1ac0 2024-05-30T16:49:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc216200640 1 -- 172.21.15.59:0/3023718301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2100b1ac0 msgr2=0x7fc21009af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc216200640 1 --2- 172.21.15.59:0/3023718301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2100b1ac0 0x7fc21009af80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc210073360 tx=0x7fc20801c960 comp rx=0 tx=0).stop 2024-05-30T16:49:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc216200640 1 -- 172.21.15.59:0/3023718301 shutdown_connections 2024-05-30T16:49:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc216200640 1 --2- 172.21.15.59:0/3023718301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2100b1ac0 0x7fc21009af80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc216200640 1 --2- 172.21.15.59:0/3023718301 >> v2:172.21.15.107:3300/0 conn(0x7fc210070710 0x7fc21009aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc216200640 1 -- 172.21.15.59:0/3023718301 >> 172.21.15.59:0/3023718301 conn(0x7fc2100b3f70 msgr2=0x7fc2100b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc216200640 1 -- 172.21.15.59:0/3023718301 shutdown_connections 2024-05-30T16:49:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc216200640 1 -- 172.21.15.59:0/3023718301 wait complete. 2024-05-30T16:49:42.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.426+0000 7fc216200640 1 Processor -- start 2024-05-30T16:49:42.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc216200640 1 -- start start 2024-05-30T16:49:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc216200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc210070710 0x7fc210154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc216200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2100b1ac0 0x7fc210155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc216200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21015ff30 0x7fc2100b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc216200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc210169870 con 0x7fc21015ff30 2024-05-30T16:49:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc216200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc2101696f0 con 0x7fc2100b1ac0 2024-05-30T16:49:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc216200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc2101699f0 con 0x7fc210070710 2024-05-30T16:49:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc20fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21015ff30 0x7fc2100b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc20f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc210070710 0x7fc210154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc20fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21015ff30 0x7fc2100b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53152/0 (socket says 172.21.15.59:53152) 2024-05-30T16:49:42.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc20fe00640 1 -- 172.21.15.59:0/3313380056 learned_addr learned my addr 172.21.15.59:0/3313380056 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:42.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc20ea00640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2100b1ac0 0x7fc210155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc20fe00640 1 -- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc210070710 msgr2=0x7fc210154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc20fe00640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc210070710 0x7fc210154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc20fe00640 1 -- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2100b1ac0 msgr2=0x7fc210155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc20fe00640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2100b1ac0 0x7fc210155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc20fe00640 1 -- 172.21.15.59:0/3313380056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2100c95f0 con 0x7fc21015ff30 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc20fe00640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21015ff30 0x7fc2100b0110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc2080af040 tx=0x7fc208019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc207400640 1 -- 172.21.15.59:0/3313380056 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2080bc020 con 0x7fc21015ff30 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc207400640 1 -- 172.21.15.59:0/3313380056 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2080b8670 con 0x7fc21015ff30 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc207400640 1 -- 172.21.15.59:0/3313380056 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208009510 con 0x7fc21015ff30 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc216200640 1 -- 172.21.15.59:0/3313380056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2100c98d0 con 0x7fc21015ff30 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc216200640 1 -- 172.21.15.59:0/3313380056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc210155890 con 0x7fc21015ff30 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.430+0000 7fc216200640 1 -- 172.21.15.59:0/3313380056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc210068a90 con 0x7fc21015ff30 2024-05-30T16:49:42.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.434+0000 7fc207400640 1 -- 172.21.15.59:0/3313380056 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc2080bf020 con 0x7fc21015ff30 2024-05-30T16:49:42.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.434+0000 7fc207400640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc1f0068380 0x7fc1f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.434+0000 7fc207400640 1 -- 172.21.15.59:0/3313380056 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fc2081213f0 con 0x7fc21015ff30 2024-05-30T16:49:42.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.434+0000 7fc20f400640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc1f0068380 0x7fc1f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.434+0000 7fc20f400640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc1f0068380 0x7fc1f006a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc2100afff0 tx=0x7fc200009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:42.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.438+0000 7fc207400640 1 -- 172.21.15.59:0/3313380056 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc2080c6030 con 0x7fc21015ff30 2024-05-30T16:49:42.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.662+0000 7fc216200640 1 -- 172.21.15.59:0/3313380056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc2100cf680 con 0x7fc21015ff30 2024-05-30T16:49:42.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.662+0000 7fc207400640 1 -- 172.21.15.59:0/3313380056 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7fc2080165e0 con 0x7fc21015ff30 2024-05-30T16:49:42.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:42.669 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:49:42.670 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-05-30T16:49:42.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.670 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-05-30T16:49:42.670 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmAAjIJhAA5/FZHJtfSZuYcD6bEfCGDA==", 2024-05-30T16:49:42.670 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.670 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:49:42.670 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:49:42.670 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:49:42.670 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.670 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmELVkMxAA/vOsM3Z0z4YEmUqoPtrPBQ==", 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmD2pGLhAAWmDw/02mc8T7upvRXnj1yw==", 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.671 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmYLbYOhAAxggGfPZU/ryu+8vciSXjUw==", 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:49:42.672 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDJrVhmU0fpBhAA2tKWGJF24DlEjG+iuO4djg==", 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.673 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDMrVhmxE2HERAA4N9Bsb0fxl5GERpgyKCl6Q==", 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDPrVhm6v7AGhAAqOQCN90pL0AmnXYIPIb48A==", 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:42.674 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSrVhm3BEDJxAA4SOWC/qF90R9ivrCvN92ZA==", 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDYrVhmFzmDHhAAQtbXd6haolYB98wfEbpvTQ==", 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDbrVhmHqkEKRAAKfFPdTqaVhBNnc5lKeEFpg==", 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.676 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDerVhm72bzMBAA+FfnxIOnkESuTervY23ruw==", 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.678 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-05-30T16:49:42.678 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDhrVhmXGv/OhAAr2k7IXDA9VDi9ZJwrQ+u6A==", 2024-05-30T16:49:42.678 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.678 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:42.678 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:49:42.678 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.678 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.678 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-05-30T16:49:42.678 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA==", 2024-05-30T16:49:42.678 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.679 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:49:42.679 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:49:42.679 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:49:42.679 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:49:42.679 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.679 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-05-30T16:49:42.679 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmncPjDBAAWEJOkxm9xfRjonO6U1hO6A==", 2024-05-30T16:49:42.679 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.679 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:49:42.679 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmvlFFCRAAZCq7ijfrVqy8Ukh7jKZESQ==", 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmcpjuEhAA0q+PfNy0IWhqQSiIZuyBlg==", 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmnikpCxAA6Q4udmvjQXBmC4f1irI2Xg==", 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.681 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:49:42.682 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:49:42.682 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:49:42.682 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.682 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.682 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-mds", 2024-05-30T16:49:42.682 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDorVhmTIAYAhAAIFB39qpAiusKca3X6QUzFA==", 2024-05-30T16:49:42.682 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.682 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-mds" 2024-05-30T16:49:42.682 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-mgr", 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDorVhmXooYAhAAp/yVTYPSKsBs6EMdkSiuuA==", 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-osd", 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDorVhmP5MYAhAA9QbL8w2N5YXx+zq6M0HCyA==", 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-osd" 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-rbd", 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDorVhmC5wYAhAAVZ7LTqpIVpC9JBonC38aJQ==", 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDorVhm3KQYAhAA4FS6BDTUMi2vAxEJOJsOPw==", 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-rgw", 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDorVhm9a0YAhAAnmnDuWrB24BfD83yL3UllA==", 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmWZq9IhAAFuEZeFiLGCitIiNARjoDTA==", 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:42.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:42.686 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-05-30T16:49:42.686 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhm0UKsHhAAimqtE18XjW/1vA7uMsJmEw==", 2024-05-30T16:49:42.686 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:49:42.686 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:49:42.686 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T16:49:42.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:49:42.686 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.686 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:42.686 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-05-30T16:49:42.686 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:49:42.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.666+0000 7fc216200640 1 -- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc1f0068380 msgr2=0x7fc1f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.666+0000 7fc216200640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc1f0068380 0x7fc1f006a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc2100afff0 tx=0x7fc200009040 comp rx=0 tx=0).stop 2024-05-30T16:49:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.666+0000 7fc216200640 1 -- 172.21.15.59:0/3313380056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21015ff30 msgr2=0x7fc2100b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.666+0000 7fc216200640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21015ff30 0x7fc2100b0110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc2080af040 tx=0x7fc208019700 comp rx=0 tx=0).stop 2024-05-30T16:49:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.666+0000 7fc216200640 1 -- 172.21.15.59:0/3313380056 shutdown_connections 2024-05-30T16:49:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.666+0000 7fc216200640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc1f0068380 0x7fc1f006a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.666+0000 7fc216200640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21015ff30 0x7fc2100b0110 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.666+0000 7fc216200640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2100b1ac0 0x7fc210155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.666+0000 7fc216200640 1 --2- 172.21.15.59:0/3313380056 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc210070710 0x7fc210154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.666+0000 7fc216200640 1 -- 172.21.15.59:0/3313380056 >> 172.21.15.59:0/3313380056 conn(0x7fc2100b3f70 msgr2=0x7fc21009aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.666+0000 7fc216200640 1 -- 172.21.15.59:0/3313380056 shutdown_connections 2024-05-30T16:49:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.666+0000 7fc216200640 1 -- 172.21.15.59:0/3313380056 wait complete. 2024-05-30T16:49:42.691 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-30T16:49:42.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.826+0000 7f7d88a00640 1 Processor -- start 2024-05-30T16:49:42.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.826+0000 7f7d88a00640 1 -- start start 2024-05-30T16:49:42.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d88a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d8415ff30 0x7f7d84070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d88a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7d8409ba50 0x7f7d84070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d88a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d84070bd0 con 0x7f7d840b1ac0 2024-05-30T16:49:42.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d88a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7d84070e70 con 0x7f7d8409ba50 2024-05-30T16:49:42.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d88a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7d84072020 con 0x7f7d8415ff30 2024-05-30T16:49:42.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d81400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7d840b1ac0 0x7f7d840ccdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46140/0 (socket says 172.21.15.59:46140) 2024-05-30T16:49:42.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d81400640 1 -- 172.21.15.59:0/2642733147 learned_addr learned my addr 172.21.15.59:0/2642733147 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:42.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d81e00640 1 --2- 172.21.15.59:0/2642733147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d8415ff30 0x7f7d84070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d82800640 1 --2- 172.21.15.59:0/2642733147 >> v2:172.21.15.107:3300/0 conn(0x7f7d8409ba50 0x7f7d84070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d80a00640 1 -- 172.21.15.59:0/2642733147 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237916065 0 0) 0x7f7d84070bd0 con 0x7f7d840b1ac0 2024-05-30T16:49:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d80a00640 1 -- 172.21.15.59:0/2642733147 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d68003530 con 0x7f7d840b1ac0 2024-05-30T16:49:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d82800640 1 -- 172.21.15.59:0/2642733147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d8415ff30 msgr2=0x7f7d84070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d82800640 1 --2- 172.21.15.59:0/2642733147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d8415ff30 0x7f7d84070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d82800640 1 -- 172.21.15.59:0/2642733147 >> v1:172.21.15.59:6789/0 conn(0x7f7d840b1ac0 legacy=0x7f7d840ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d82800640 1 -- 172.21.15.59:0/2642733147 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d84071cd0 con 0x7f7d8409ba50 2024-05-30T16:49:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.830+0000 7f7d81e00640 1 --2- 172.21.15.59:0/2642733147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d8415ff30 0x7f7d84070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:42.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d82800640 1 --2- 172.21.15.59:0/2642733147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8409ba50 0x7f7d84070540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009d90 tx=0x7f7d7c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ea89355e0205c6e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:42.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d80a00640 1 -- 172.21.15.59:0/2642733147 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0b2070 con 0x7f7d8409ba50 2024-05-30T16:49:42.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d80a00640 1 -- 172.21.15.59:0/2642733147 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c0a58b0 con 0x7f7d8409ba50 2024-05-30T16:49:42.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d80a00640 1 -- 172.21.15.59:0/2642733147 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0a5c80 con 0x7f7d8409ba50 2024-05-30T16:49:42.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d88a00640 1 -- 172.21.15.59:0/2642733147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8409ba50 msgr2=0x7f7d84070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d88a00640 1 --2- 172.21.15.59:0/2642733147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8409ba50 0x7f7d84070540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009d90 tx=0x7f7d7c01c8e0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d88a00640 1 -- 172.21.15.59:0/2642733147 shutdown_connections 2024-05-30T16:49:42.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d88a00640 1 --2- 172.21.15.59:0/2642733147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8409ba50 0x7f7d84070540 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d88a00640 1 --2- 172.21.15.59:0/2642733147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d8415ff30 0x7f7d84070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d88a00640 1 -- 172.21.15.59:0/2642733147 >> 172.21.15.59:0/2642733147 conn(0x7f7d840b3f70 msgr2=0x7f7d840b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:42.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d88a00640 1 -- 172.21.15.59:0/2642733147 shutdown_connections 2024-05-30T16:49:42.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d88a00640 1 -- 172.21.15.59:0/2642733147 wait complete. 2024-05-30T16:49:42.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d88a00640 1 Processor -- start 2024-05-30T16:49:42.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.834+0000 7f7d88a00640 1 -- start start 2024-05-30T16:49:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d88a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8409ba50 0x7f7d8414cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d88a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d840b1ac0 0x7f7d8406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d88a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d8415ff30 0x7f7d84158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d88a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d84169870 con 0x7f7d8415ff30 2024-05-30T16:49:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d88a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7d841696f0 con 0x7f7d8409ba50 2024-05-30T16:49:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d88a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7d841699f0 con 0x7f7d840b1ac0 2024-05-30T16:49:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d82800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d8415ff30 0x7f7d84158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d82800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d8415ff30 0x7f7d84158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53166/0 (socket says 172.21.15.59:53166) 2024-05-30T16:49:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d82800640 1 -- 172.21.15.59:0/1985872523 learned_addr learned my addr 172.21.15.59:0/1985872523 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d81e00640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8409ba50 0x7f7d8414cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d81400640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d840b1ac0 0x7f7d8406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d82800640 1 -- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d840b1ac0 msgr2=0x7f7d8406ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d82800640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d840b1ac0 0x7f7d8406ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d82800640 1 -- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8409ba50 msgr2=0x7f7d8414cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d82800640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8409ba50 0x7f7d8414cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d82800640 1 -- 172.21.15.59:0/1985872523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d84166f50 con 0x7f7d8415ff30 2024-05-30T16:49:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d82800640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d8415ff30 0x7f7d84158260 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009d90 tx=0x7f7d7c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:42.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d7a000640 1 -- 172.21.15.59:0/1985872523 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0b2050 con 0x7f7d8415ff30 2024-05-30T16:49:42.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d7a000640 1 -- 172.21.15.59:0/1985872523 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c0be070 con 0x7f7d8415ff30 2024-05-30T16:49:42.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d7a000640 1 -- 172.21.15.59:0/1985872523 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c009450 con 0x7f7d8415ff30 2024-05-30T16:49:42.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d88a00640 1 -- 172.21.15.59:0/1985872523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d84153d30 con 0x7f7d8415ff30 2024-05-30T16:49:42.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d88a00640 1 -- 172.21.15.59:0/1985872523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d841542f0 con 0x7f7d8415ff30 2024-05-30T16:49:42.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.838+0000 7f7d88a00640 1 -- 172.21.15.59:0/1985872523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d84068a90 con 0x7f7d8415ff30 2024-05-30T16:49:42.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.842+0000 7f7d7a000640 1 -- 172.21.15.59:0/1985872523 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7d7c0adc40 con 0x7f7d8415ff30 2024-05-30T16:49:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.842+0000 7f7d7a000640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d64068380 0x7f7d6406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.842+0000 7f7d7a000640 1 -- 172.21.15.59:0/1985872523 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f7d7c122260 con 0x7f7d8415ff30 2024-05-30T16:49:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.842+0000 7f7d81e00640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d64068380 0x7f7d6406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.842+0000 7f7d81e00640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d64068380 0x7f7d6406a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009580 tx=0x7f7d74009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:42.846+0000 7f7d7a000640 1 -- 172.21.15.59:0/1985872523 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7d7c016560 con 0x7f7d8415ff30 2024-05-30T16:49:43.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.066+0000 7f7d88a00640 1 -- 172.21.15.59:0/1985872523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f7d84156ab0 con 0x7f7d8415ff30 2024-05-30T16:49:43.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d7a000640 1 -- 172.21.15.59:0/1985872523 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f7d7c0f2590 con 0x7f7d8415ff30 2024-05-30T16:49:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d88a00640 1 -- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d64068380 msgr2=0x7f7d6406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d88a00640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d64068380 0x7f7d6406a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009580 tx=0x7f7d74009190 comp rx=0 tx=0).stop 2024-05-30T16:49:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d88a00640 1 -- 172.21.15.59:0/1985872523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d8415ff30 msgr2=0x7f7d84158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d88a00640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d8415ff30 0x7f7d84158260 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009d90 tx=0x7f7d7c019680 comp rx=0 tx=0).stop 2024-05-30T16:49:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d88a00640 1 -- 172.21.15.59:0/1985872523 shutdown_connections 2024-05-30T16:49:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d88a00640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d64068380 0x7f7d6406a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d88a00640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d8415ff30 0x7f7d84158260 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d88a00640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d840b1ac0 0x7f7d8406ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d88a00640 1 --2- 172.21.15.59:0/1985872523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8409ba50 0x7f7d8414cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d88a00640 1 -- 172.21.15.59:0/1985872523 >> 172.21.15.59:0/1985872523 conn(0x7f7d840b3f70 msgr2=0x7f7d840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d88a00640 1 -- 172.21.15.59:0/1985872523 shutdown_connections 2024-05-30T16:49:43.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.070+0000 7f7d88a00640 1 -- 172.21.15.59:0/1985872523 wait complete. 2024-05-30T16:49:43.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-30T16:49:43.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cb3a00640 1 Processor -- start 2024-05-30T16:49:43.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cb3a00640 1 -- start start 2024-05-30T16:49:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cb3a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4cac0af720 0x7f4cac15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cb3a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cac15f060 con 0x7f4cac0d0560 2024-05-30T16:49:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cb3a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cac15ff00 con 0x7f4cac06e900 2024-05-30T16:49:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cb3a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4cac0afb00 con 0x7f4cac0af720 2024-05-30T16:49:43.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cb1a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4cac0d0560 0x7f4cac072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46154/0 (socket says 172.21.15.59:46154) 2024-05-30T16:49:43.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cb1a00640 1 -- 172.21.15.59:0/3048727770 learned_addr learned my addr 172.21.15.59:0/3048727770 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:43.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cb1000640 1 --2- 172.21.15.59:0/3048727770 >> v2:172.21.15.107:3300/0 conn(0x7f4cac0af720 0x7f4cac15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cab400640 1 -- 172.21.15.59:0/3048727770 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 744216518 0 0) 0x7f4cac15f060 con 0x7f4cac0d0560 2024-05-30T16:49:43.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cab400640 1 -- 172.21.15.59:0/3048727770 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c94003530 con 0x7f4cac0d0560 2024-05-30T16:49:43.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cab400640 1 -- 172.21.15.59:0/3048727770 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977590273 0 0) 0x7f4cac15ff00 con 0x7f4cac06e900 2024-05-30T16:49:43.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cab400640 1 -- 172.21.15.59:0/3048727770 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cac15f060 con 0x7f4cac06e900 2024-05-30T16:49:43.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cb1000640 1 -- 172.21.15.59:0/3048727770 >> v1:172.21.15.107:6789/0 conn(0x7f4cac06e900 legacy=0x7f4cac15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cb1000640 1 -- 172.21.15.59:0/3048727770 >> v1:172.21.15.59:6789/0 conn(0x7f4cac0d0560 legacy=0x7f4cac072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.234+0000 7f4cb1000640 1 -- 172.21.15.59:0/3048727770 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac15c270 con 0x7f4cac0af720 2024-05-30T16:49:43.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.238+0000 7f4cb1000640 1 --2- 172.21.15.59:0/3048727770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac0af720 0x7f4cac15b9d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00097c0 tx=0x7f4ca001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46a0c2942e0b49d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.238+0000 7f4cab400640 1 -- 172.21.15.59:0/3048727770 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00aa5f0 con 0x7f4cac0af720 2024-05-30T16:49:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.238+0000 7f4cab400640 1 -- 172.21.15.59:0/3048727770 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca00af070 con 0x7f4cac0af720 2024-05-30T16:49:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.238+0000 7f4cab400640 1 -- 172.21.15.59:0/3048727770 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00aa9b0 con 0x7f4cac0af720 2024-05-30T16:49:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.238+0000 7f4cb3a00640 1 -- 172.21.15.59:0/3048727770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac0af720 msgr2=0x7f4cac15b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.238+0000 7f4cb3a00640 1 --2- 172.21.15.59:0/3048727770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac0af720 0x7f4cac15b9d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00097c0 tx=0x7f4ca001c470 comp rx=0 tx=0).stop 2024-05-30T16:49:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.238+0000 7f4cb3a00640 1 -- 172.21.15.59:0/3048727770 shutdown_connections 2024-05-30T16:49:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.238+0000 7f4cb3a00640 1 --2- 172.21.15.59:0/3048727770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac0af720 0x7f4cac15b9d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.238+0000 7f4cb3a00640 1 -- 172.21.15.59:0/3048727770 >> 172.21.15.59:0/3048727770 conn(0x7f4cac0b22d0 msgr2=0x7f4cac0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:43.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.238+0000 7f4cb3a00640 1 -- 172.21.15.59:0/3048727770 shutdown_connections 2024-05-30T16:49:43.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.238+0000 7f4cb3a00640 1 -- 172.21.15.59:0/3048727770 wait complete. 2024-05-30T16:49:43.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb3a00640 1 Processor -- start 2024-05-30T16:49:43.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb3a00640 1 -- start start 2024-05-30T16:49:43.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb3a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4cac06e900 0x7f4cac15e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb3a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac0af720 0x7f4cac0cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb3a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac0d0560 0x7f4cac0cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb3a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac0d0da0 con 0x7f4cac0d0560 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb3a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac15c830 con 0x7f4cac0af720 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb3a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4cac158dd0 con 0x7f4cac06e900 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac0d0560 0x7f4cac0cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac0d0560 0x7f4cac0cbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53172/0 (socket says 172.21.15.59:53172) 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb1a00640 1 -- 172.21.15.59:0/1102935346 learned_addr learned my addr 172.21.15.59:0/1102935346 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cabe00640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac0af720 0x7f4cac0cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb1000640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4cac06e900 0x7f4cac15e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb1a00640 1 -- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4cac06e900 msgr2=0x7f4cac15e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb1a00640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4cac06e900 0x7f4cac15e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb1a00640 1 -- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac0af720 msgr2=0x7f4cac0cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb1a00640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac0af720 0x7f4cac0cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb1a00640 1 -- 172.21.15.59:0/1102935346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac151c40 con 0x7f4cac0d0560 2024-05-30T16:49:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb1a00640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac0d0560 0x7f4cac0cbe40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400caf0 tx=0x7f4ca400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4ca8c00640 1 -- 172.21.15.59:0/1102935346 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4017070 con 0x7f4cac0d0560 2024-05-30T16:49:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4ca8c00640 1 -- 172.21.15.59:0/1102935346 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca400aca0 con 0x7f4cac0d0560 2024-05-30T16:49:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4ca8c00640 1 -- 172.21.15.59:0/1102935346 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4012620 con 0x7f4cac0d0560 2024-05-30T16:49:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb3a00640 1 -- 172.21.15.59:0/1102935346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cac1510c0 con 0x7f4cac0d0560 2024-05-30T16:49:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb3a00640 1 -- 172.21.15.59:0/1102935346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cac151680 con 0x7f4cac0d0560 2024-05-30T16:49:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.242+0000 7f4cb3a00640 1 -- 172.21.15.59:0/1102935346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cac15c9e0 con 0x7f4cac0d0560 2024-05-30T16:49:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.246+0000 7f4ca8c00640 1 -- 172.21.15.59:0/1102935346 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ca401a070 con 0x7f4cac0d0560 2024-05-30T16:49:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.246+0000 7f4ca8c00640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4c8c068380 0x7f4c8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.246+0000 7f4ca8c00640 1 -- 172.21.15.59:0/1102935346 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f4ca40863c0 con 0x7f4cac0d0560 2024-05-30T16:49:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.246+0000 7f4cb1000640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4c8c068380 0x7f4c8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.246+0000 7f4cb1000640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4c8c068380 0x7f4c8c06a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00ae000 tx=0x7f4ca00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:43.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.250+0000 7f4ca8c00640 1 -- 172.21.15.59:0/1102935346 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4cac15c9e0 con 0x7f4cac0d0560 2024-05-30T16:49:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.490+0000 7f4cb3a00640 1 -- 172.21.15.59:0/1102935346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f4cac068a90 con 0x7f4cac0d0560 2024-05-30T16:49:43.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.490+0000 7f4ca8c00640 1 -- 172.21.15.59:0/1102935346 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f4ca40565e0 con 0x7f4cac0d0560 2024-05-30T16:49:43.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.494+0000 7f4cb3a00640 1 -- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4c8c068380 msgr2=0x7f4c8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.494+0000 7f4cb3a00640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4c8c068380 0x7f4c8c06a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00ae000 tx=0x7f4ca00a7000 comp rx=0 tx=0).stop 2024-05-30T16:49:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.494+0000 7f4cb3a00640 1 -- 172.21.15.59:0/1102935346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac0d0560 msgr2=0x7f4cac0cbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.494+0000 7f4cb3a00640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac0d0560 0x7f4cac0cbe40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400caf0 tx=0x7f4ca400a060 comp rx=0 tx=0).stop 2024-05-30T16:49:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.494+0000 7f4cb3a00640 1 -- 172.21.15.59:0/1102935346 shutdown_connections 2024-05-30T16:49:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.494+0000 7f4cb3a00640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4c8c068380 0x7f4c8c06a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.494+0000 7f4cb3a00640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac0d0560 0x7f4cac0cbe40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.494+0000 7f4cb3a00640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cac0af720 0x7f4cac0cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.494+0000 7f4cb3a00640 1 --2- 172.21.15.59:0/1102935346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4cac06e900 0x7f4cac15e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.494+0000 7f4cb3a00640 1 -- 172.21.15.59:0/1102935346 >> 172.21.15.59:0/1102935346 conn(0x7f4cac0b22d0 msgr2=0x7f4cac0afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.494+0000 7f4cb3a00640 1 -- 172.21.15.59:0/1102935346 shutdown_connections 2024-05-30T16:49:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.494+0000 7f4cb3a00640 1 -- 172.21.15.59:0/1102935346 wait complete. 2024-05-30T16:49:43.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-30T16:49:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4abc600640 1 Processor -- start 2024-05-30T16:49:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4abc600640 1 -- start start 2024-05-30T16:49:43.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4abc600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40ad8c0 0x7f4ab415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4abc600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ab415a1d0 0x7f4ab415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4abc600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ab415d730 con 0x7f4ab4159df0 2024-05-30T16:49:43.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4abc600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4ab415d4f0 con 0x7f4ab415a1d0 2024-05-30T16:49:43.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4abc600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4ab40b3370 con 0x7f4ab40ad8c0 2024-05-30T16:49:43.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4aba600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ab415a1d0 0x7f4ab415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4aba600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ab415a1d0 0x7f4ab415cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53188/0 (socket says 172.21.15.59:53188) 2024-05-30T16:49:43.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4aba600640 1 -- 172.21.15.59:0/682594101 learned_addr learned my addr 172.21.15.59:0/682594101 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:43.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4aba600640 1 -- 172.21.15.59:0/682594101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40ad8c0 msgr2=0x7f4ab415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:43.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4ab9200640 1 --2- 172.21.15.59:0/682594101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40ad8c0 0x7f4ab415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4aba600640 1 --2- 172.21.15.59:0/682594101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40ad8c0 0x7f4ab415ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4aba600640 1 -- 172.21.15.59:0/682594101 >> v1:172.21.15.107:6789/0 conn(0x7f4ab4159df0 legacy=0x7f4ab40ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:43.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4aba600640 1 -- 172.21.15.59:0/682594101 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab40b3650 con 0x7f4ab415a1d0 2024-05-30T16:49:43.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.654+0000 7f4ab9200640 1 --2- 172.21.15.59:0/682594101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40ad8c0 0x7f4ab415ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:43.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.658+0000 7f4aba600640 1 --2- 172.21.15.59:0/682594101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab415a1d0 0x7f4ab415cfb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009e50 tx=0x7f4aac01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1739efc15ca3fc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:43.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.658+0000 7f4ab3e00640 1 -- 172.21.15.59:0/682594101 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac0a5780 con 0x7f4ab415a1d0 2024-05-30T16:49:43.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.658+0000 7f4ab3e00640 1 -- 172.21.15.59:0/682594101 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aac0a5920 con 0x7f4ab415a1d0 2024-05-30T16:49:43.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.658+0000 7f4ab3e00640 1 -- 172.21.15.59:0/682594101 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac0a5cf0 con 0x7f4ab415a1d0 2024-05-30T16:49:43.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.658+0000 7f4abc600640 1 -- 172.21.15.59:0/682594101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab415a1d0 msgr2=0x7f4ab415cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.658+0000 7f4abc600640 1 --2- 172.21.15.59:0/682594101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab415a1d0 0x7f4ab415cfb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009e50 tx=0x7f4aac01c9f0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.658+0000 7f4abc600640 1 -- 172.21.15.59:0/682594101 shutdown_connections 2024-05-30T16:49:43.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.658+0000 7f4abc600640 1 --2- 172.21.15.59:0/682594101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab415a1d0 0x7f4ab415cfb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.658+0000 7f4abc600640 1 --2- 172.21.15.59:0/682594101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40ad8c0 0x7f4ab415ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.658+0000 7f4abc600640 1 -- 172.21.15.59:0/682594101 >> 172.21.15.59:0/682594101 conn(0x7f4ab40b22d0 msgr2=0x7f4ab40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:43.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.658+0000 7f4abc600640 1 -- 172.21.15.59:0/682594101 shutdown_connections 2024-05-30T16:49:43.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.658+0000 7f4abc600640 1 -- 172.21.15.59:0/682594101 wait complete. 2024-05-30T16:49:43.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4abc600640 1 Processor -- start 2024-05-30T16:49:43.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4abc600640 1 -- start start 2024-05-30T16:49:43.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4abc600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40ad8c0 0x7f4ab4073820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4abc600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ab4159df0 0x7f4ab4071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4abc600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab415a1d0 0x7f4ab406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4abc600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab415e720 con 0x7f4ab415a1d0 2024-05-30T16:49:43.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4abc600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab415e5a0 con 0x7f4ab4159df0 2024-05-30T16:49:43.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4abc600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4ab415e8a0 con 0x7f4ab40ad8c0 2024-05-30T16:49:43.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4aba600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab415a1d0 0x7f4ab406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4aba600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab415a1d0 0x7f4ab406dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53190/0 (socket says 172.21.15.59:53190) 2024-05-30T16:49:43.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4aba600640 1 -- 172.21.15.59:0/1700087360 learned_addr learned my addr 172.21.15.59:0/1700087360 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:43.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4ab9c00640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40ad8c0 0x7f4ab4073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4ab9200640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ab4159df0 0x7f4ab4071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4aba600640 1 -- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40ad8c0 msgr2=0x7f4ab4073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4aba600640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40ad8c0 0x7f4ab4073820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4aba600640 1 -- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ab4159df0 msgr2=0x7f4ab4071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4aba600640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ab4159df0 0x7f4ab4071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4aba600640 1 -- 172.21.15.59:0/1700087360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab4073d60 con 0x7f4ab415a1d0 2024-05-30T16:49:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4aba600640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab415a1d0 0x7f4ab406dd30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0af040 tx=0x7f4aac019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4ab1600640 1 -- 172.21.15.59:0/1700087360 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac0b8880 con 0x7f4ab415a1d0 2024-05-30T16:49:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4ab1600640 1 -- 172.21.15.59:0/1700087360 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aac0be070 con 0x7f4ab415a1d0 2024-05-30T16:49:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4ab1600640 1 -- 172.21.15.59:0/1700087360 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac0b8ca0 con 0x7f4ab415a1d0 2024-05-30T16:49:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4abc600640 1 -- 172.21.15.59:0/1700087360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab415ba20 con 0x7f4ab415a1d0 2024-05-30T16:49:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.662+0000 7f4abc600640 1 -- 172.21.15.59:0/1700087360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab4158ed0 con 0x7f4ab415a1d0 2024-05-30T16:49:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.666+0000 7f4abc600640 1 -- 172.21.15.59:0/1700087360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab415b290 con 0x7f4ab415a1d0 2024-05-30T16:49:43.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.666+0000 7f4ab1600640 1 -- 172.21.15.59:0/1700087360 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4aac0c3460 con 0x7f4ab415a1d0 2024-05-30T16:49:43.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.666+0000 7f4ab1600640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a94068380 0x7f4a9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.666+0000 7f4ab1600640 1 -- 172.21.15.59:0/1700087360 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f4aac1219c0 con 0x7f4ab415a1d0 2024-05-30T16:49:43.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.666+0000 7f4ab9c00640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a94068380 0x7f4a9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.666+0000 7f4ab9c00640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a94068380 0x7f4a9406a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8007fd0 tx=0x7f4aa8007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:43.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.670+0000 7f4ab1600640 1 -- 172.21.15.59:0/1700087360 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ab4073d60 con 0x7f4ab415a1d0 2024-05-30T16:49:43.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.890+0000 7f4abc600640 1 -- 172.21.15.59:0/1700087360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f4ab4068a90 con 0x7f4ab415a1d0 2024-05-30T16:49:43.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.894+0000 7f4ab1600640 1 -- 172.21.15.59:0/1700087360 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f4aac0165e0 con 0x7f4ab415a1d0 2024-05-30T16:49:43.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.898+0000 7f4abc600640 1 -- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a94068380 msgr2=0x7f4a9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.898+0000 7f4abc600640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a94068380 0x7f4a9406a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8007fd0 tx=0x7f4aa8007e40 comp rx=0 tx=0).stop 2024-05-30T16:49:43.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.898+0000 7f4abc600640 1 -- 172.21.15.59:0/1700087360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab415a1d0 msgr2=0x7f4ab406dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.898+0000 7f4abc600640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab415a1d0 0x7f4ab406dd30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0af040 tx=0x7f4aac019790 comp rx=0 tx=0).stop 2024-05-30T16:49:43.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.898+0000 7f4abc600640 1 -- 172.21.15.59:0/1700087360 shutdown_connections 2024-05-30T16:49:43.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.898+0000 7f4abc600640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a94068380 0x7f4a9406a840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.898+0000 7f4abc600640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab415a1d0 0x7f4ab406dd30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.898+0000 7f4abc600640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ab4159df0 0x7f4ab4071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.898+0000 7f4abc600640 1 --2- 172.21.15.59:0/1700087360 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40ad8c0 0x7f4ab4073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.898+0000 7f4abc600640 1 -- 172.21.15.59:0/1700087360 >> 172.21.15.59:0/1700087360 conn(0x7f4ab40b22d0 msgr2=0x7f4ab415c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.898+0000 7f4abc600640 1 -- 172.21.15.59:0/1700087360 shutdown_connections 2024-05-30T16:49:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:43.898+0000 7f4abc600640 1 -- 172.21.15.59:0/1700087360 wait complete. 2024-05-30T16:49:43.921 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-30T16:49:44.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4abb600640 1 Processor -- start 2024-05-30T16:49:44.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4abb600640 1 -- start start 2024-05-30T16:49:44.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4abb600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40d14c0 0x7f4ab406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4abb600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ab40d05b0 0x7f4ab409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4abb600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ab406ea20 con 0x7f4ab409af80 2024-05-30T16:49:44.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4abb600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4ab4070950 con 0x7f4ab40d05b0 2024-05-30T16:49:44.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4abb600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4ab4070c30 con 0x7f4ab40d14c0 2024-05-30T16:49:44.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab9600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4ab409af80 0x7f4ab4162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46160/0 (socket says 172.21.15.59:46160) 2024-05-30T16:49:44.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab9600640 1 -- 172.21.15.59:0/2984719727 learned_addr learned my addr 172.21.15.59:0/2984719727 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:44.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3e00640 1 --2- 172.21.15.59:0/2984719727 >> v2:172.21.15.107:3300/0 conn(0x7f4ab40d05b0 0x7f4ab409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab8c00640 1 --2- 172.21.15.59:0/2984719727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40d14c0 0x7f4ab406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705714141 0 0) 0x7f4aac0014a0 con 0x7f4ab409af80 2024-05-30T16:49:44.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a9c003530 con 0x7f4ab409af80 2024-05-30T16:49:44.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4004337991 0 0) 0x7f4a9c003530 con 0x7f4ab409af80 2024-05-30T16:49:44.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40d14c0 msgr2=0x7f4ab406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:44.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 --2- 172.21.15.59:0/2984719727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40d14c0 0x7f4ab406e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 >> v2:172.21.15.107:3300/0 conn(0x7f4ab40d05b0 msgr2=0x7f4ab409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:44.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 --2- 172.21.15.59:0/2984719727 >> v2:172.21.15.107:3300/0 conn(0x7f4ab40d05b0 0x7f4ab409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab4070f10 con 0x7f4ab409af80 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f4aac001bd0 con 0x7f4ab409af80 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 >> v1:172.21.15.59:6789/0 conn(0x7f4ab409af80 legacy=0x7f4ab4162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 --2- 172.21.15.59:0/2984719727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40d14c0 0x7f4a9c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 --2- 172.21.15.59:0/2984719727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a9c003f40 0x7f4a9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 --2- 172.21.15.59:0/2984719727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a9c004d50 0x7f4a9c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab4070950 con 0x7f4a9c004d50 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab4070c30 con 0x7f4a9c003f40 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9c00b9d0 con 0x7f4ab40d14c0 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab9600640 1 --2- 172.21.15.59:0/2984719727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a9c004d50 0x7f4a9c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab8c00640 1 --2- 172.21.15.59:0/2984719727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40d14c0 0x7f4a9c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.058+0000 7f4ab3e00640 1 --2- 172.21.15.59:0/2984719727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a9c003f40 0x7f4a9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4ab9600640 1 -- 172.21.15.59:0/2984719727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40d14c0 msgr2=0x7f4a9c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:44.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4ab9600640 1 --2- 172.21.15.59:0/2984719727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab40d14c0 0x7f4a9c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4ab9600640 1 -- 172.21.15.59:0/2984719727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a9c003f40 msgr2=0x7f4a9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:44.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4ab9600640 1 --2- 172.21.15.59:0/2984719727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a9c003f40 0x7f4a9c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4ab9600640 1 -- 172.21.15.59:0/2984719727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c003530 con 0x7f4a9c004d50 2024-05-30T16:49:44.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4ab9600640 1 --2- 172.21.15.59:0/2984719727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a9c004d50 0x7f4a9c0051d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00aa70 tx=0x7f4aac01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c74d73043e5cd6d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:44.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00a690 con 0x7f4a9c004d50 2024-05-30T16:49:44.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aac0a9070 con 0x7f4a9c004d50 2024-05-30T16:49:44.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4ab3400640 1 -- 172.21.15.59:0/2984719727 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac0ae910 con 0x7f4a9c004d50 2024-05-30T16:49:44.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4abb600640 1 -- 172.21.15.59:0/2984719727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a9c004d50 msgr2=0x7f4a9c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4abb600640 1 --2- 172.21.15.59:0/2984719727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a9c004d50 0x7f4a9c0051d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00aa70 tx=0x7f4aac01d360 comp rx=0 tx=0).stop 2024-05-30T16:49:44.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4ab9600640 1 -- 172.21.15.59:0/2984719727 reap_dead start 2024-05-30T16:49:44.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4abb600640 1 -- 172.21.15.59:0/2984719727 shutdown_connections 2024-05-30T16:49:44.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.062+0000 7f4abb600640 1 -- 172.21.15.59:0/2984719727 >> 172.21.15.59:0/2984719727 conn(0x7f4ab40b3f80 msgr2=0x7f4ab40b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:44.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4abb600640 1 -- 172.21.15.59:0/2984719727 shutdown_connections 2024-05-30T16:49:44.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4abb600640 1 -- 172.21.15.59:0/2984719727 wait complete. 2024-05-30T16:49:44.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4abb600640 1 Processor -- start 2024-05-30T16:49:44.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4abb600640 1 -- start start 2024-05-30T16:49:44.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4abb600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a9c004d50 0x7f4ab4156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4abb600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab40c8bc0 0x7f4ab40b7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4abb600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab4157a30 0x7f4ab40b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4abb600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab40d18a0 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4abb600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab40711f0 con 0x7f4a9c004d50 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4abb600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4ab40d0a30 con 0x7f4ab4157a30 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab40c8bc0 0x7f4ab40b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab40c8bc0 0x7f4ab40b7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53206/0 (socket says 172.21.15.59:53206) 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab3e00640 1 -- 172.21.15.59:0/3682699627 learned_addr learned my addr 172.21.15.59:0/3682699627 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab8c00640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a9c004d50 0x7f4ab4156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab9600640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab4157a30 0x7f4ab40b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab3e00640 1 -- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab4157a30 msgr2=0x7f4ab40b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab3e00640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab4157a30 0x7f4ab40b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab3e00640 1 -- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a9c004d50 msgr2=0x7f4ab4156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab3e00640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a9c004d50 0x7f4ab4156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab3e00640 1 -- 172.21.15.59:0/3682699627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab41572c0 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab9600640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab4157a30 0x7f4ab40b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab3e00640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab40c8bc0 0x7f4ab40b7620 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00119d0 tx=0x7f4aa0011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.066+0000 7f4ab0c00640 1 -- 172.21.15.59:0/3682699627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa000faf0 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.070+0000 7f4ab0c00640 1 -- 172.21.15.59:0/3682699627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa000fc90 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.070+0000 7f4abb600640 1 -- 172.21.15.59:0/3682699627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab4157730 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.070+0000 7f4ab0c00640 1 -- 172.21.15.59:0/3682699627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0014440 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.070+0000 7f4abb600640 1 -- 172.21.15.59:0/3682699627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab40b5c80 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.070+0000 7f4abb600640 1 -- 172.21.15.59:0/3682699627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab4068a90 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.070+0000 7f4ab0c00640 1 -- 172.21.15.59:0/3682699627 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4aa0012040 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.070+0000 7f4ab0c00640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a940683b0 0x7f4a9406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.070+0000 7f4ab0c00640 1 -- 172.21.15.59:0/3682699627 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f4aa0086d30 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.070+0000 7f4ab8c00640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a940683b0 0x7f4a9406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.074+0000 7f4ab8c00640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a940683b0 0x7f4a9406a870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009be0 tx=0x7f4aa8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.078+0000 7f4ab0c00640 1 -- 172.21.15.59:0/3682699627 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4aa0019030 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.298+0000 7f4abb600640 1 -- 172.21.15.59:0/3682699627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f4ab40d2270 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.302+0000 7f4ab0c00640 1 -- 172.21.15.59:0/3682699627 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f4aa0057660 con 0x7f4ab40c8bc0 2024-05-30T16:49:44.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.306+0000 7f4abb600640 1 -- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a940683b0 msgr2=0x7f4a9406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.306+0000 7f4abb600640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a940683b0 0x7f4a9406a870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009be0 tx=0x7f4aa8009190 comp rx=0 tx=0).stop 2024-05-30T16:49:44.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.306+0000 7f4abb600640 1 -- 172.21.15.59:0/3682699627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab40c8bc0 msgr2=0x7f4ab40b7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.306+0000 7f4abb600640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab40c8bc0 0x7f4ab40b7620 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00119d0 tx=0x7f4aa0011dd0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.306+0000 7f4abb600640 1 -- 172.21.15.59:0/3682699627 shutdown_connections 2024-05-30T16:49:44.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.306+0000 7f4abb600640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a940683b0 0x7f4a9406a870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.306+0000 7f4abb600640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ab4157a30 0x7f4ab40b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.306+0000 7f4abb600640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ab40c8bc0 0x7f4ab40b7620 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.306+0000 7f4abb600640 1 --2- 172.21.15.59:0/3682699627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a9c004d50 0x7f4ab4156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.306+0000 7f4abb600640 1 -- 172.21.15.59:0/3682699627 >> 172.21.15.59:0/3682699627 conn(0x7f4ab40b3f80 msgr2=0x7f4ab406dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:44.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.306+0000 7f4abb600640 1 -- 172.21.15.59:0/3682699627 shutdown_connections 2024-05-30T16:49:44.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.306+0000 7f4abb600640 1 -- 172.21.15.59:0/3682699627 wait complete. 2024-05-30T16:49:44.329 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-30T16:49:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8be00640 1 Processor -- start 2024-05-30T16:49:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8be00640 1 -- start start 2024-05-30T16:49:44.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f8c15e8b0 0x7f8f8c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f8c06c0c0 0x7f8f8c0cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8be00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f8c15ec90 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8be00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f8f8c073590 con 0x7f8f8c15e8b0 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8be00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8f8c0ce080 con 0x7f8f8c06c0c0 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f8c15e8b0 0x7f8f8c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f83e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8f8c0cdbc0 0x7f8f8c06b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46162/0 (socket says 172.21.15.59:46162) 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f8c15e8b0 0x7f8f8c0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53218/0 (socket says 172.21.15.59:53218) 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f83e00640 1 -- 172.21.15.59:0/3283794885 learned_addr learned my addr 172.21.15.59:0/3283794885 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8b400640 1 --2- 172.21.15.59:0/3283794885 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f8c06c0c0 0x7f8f8c0cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8aa00640 1 -- 172.21.15.59:0/3283794885 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f8c06c0c0 msgr2=0x7f8f8c0cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8aa00640 1 --2- 172.21.15.59:0/3283794885 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f8c06c0c0 0x7f8f8c0cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8aa00640 1 -- 172.21.15.59:0/3283794885 >> v1:172.21.15.59:6789/0 conn(0x7f8f8c0cdbc0 legacy=0x7f8f8c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8a000640 1 -- 172.21.15.59:0/3283794885 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3742390744 0 0) 0x7f8f74001120 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.466+0000 7f8f8aa00640 1 -- 172.21.15.59:0/3283794885 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c0ce360 con 0x7f8f8c15e8b0 2024-05-30T16:49:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.470+0000 7f8f8aa00640 1 --2- 172.21.15.59:0/3283794885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8c15e8b0 0x7f8f8c0b3990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0097c0 tx=0x7f8f7c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420c89a7821520c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.470+0000 7f8f8a000640 1 -- 172.21.15.59:0/3283794885 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0b0070 con 0x7f8f8c15e8b0 2024-05-30T16:49:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.470+0000 7f8f8a000640 1 -- 172.21.15.59:0/3283794885 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f7c0ab600 con 0x7f8f8c15e8b0 2024-05-30T16:49:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.470+0000 7f8f8a000640 1 -- 172.21.15.59:0/3283794885 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0ab9d0 con 0x7f8f8c15e8b0 2024-05-30T16:49:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.470+0000 7f8f8be00640 1 -- 172.21.15.59:0/3283794885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8c15e8b0 msgr2=0x7f8f8c0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.470+0000 7f8f8be00640 1 --2- 172.21.15.59:0/3283794885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8c15e8b0 0x7f8f8c0b3990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0097c0 tx=0x7f8f7c01c4a0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.470+0000 7f8f8be00640 1 -- 172.21.15.59:0/3283794885 shutdown_connections 2024-05-30T16:49:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.470+0000 7f8f8be00640 1 --2- 172.21.15.59:0/3283794885 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f8c06c0c0 0x7f8f8c0cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.470+0000 7f8f8be00640 1 --2- 172.21.15.59:0/3283794885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8c15e8b0 0x7f8f8c0b3990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.470+0000 7f8f8be00640 1 -- 172.21.15.59:0/3283794885 >> 172.21.15.59:0/3283794885 conn(0x7f8f8c0b6990 msgr2=0x7f8f8c0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.470+0000 7f8f8be00640 1 -- 172.21.15.59:0/3283794885 shutdown_connections 2024-05-30T16:49:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.470+0000 7f8f8be00640 1 -- 172.21.15.59:0/3283794885 wait complete. 2024-05-30T16:49:44.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f8be00640 1 Processor -- start 2024-05-30T16:49:44.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f8be00640 1 -- start start 2024-05-30T16:49:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f8be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f8c06c0c0 0x7f8f8c0cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f8be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8c0cdbc0 0x7f8f8c0b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f8be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f8c15e8b0 0x7f8f8c0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f8be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c0d0270 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f8be00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c06f960 con 0x7f8f8c06c0c0 2024-05-30T16:49:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f8be00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8f8c0d03f0 con 0x7f8f8c15e8b0 2024-05-30T16:49:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f83e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8c0cdbc0 0x7f8f8c0b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f83e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8c0cdbc0 0x7f8f8c0b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53234/0 (socket says 172.21.15.59:53234) 2024-05-30T16:49:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f83e00640 1 -- 172.21.15.59:0/28222078 learned_addr learned my addr 172.21.15.59:0/28222078 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f8aa00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f8c06c0c0 0x7f8f8c0cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f8b400640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f8c15e8b0 0x7f8f8c0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f83e00640 1 -- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f8c15e8b0 msgr2=0x7f8f8c0b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f83e00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f8c15e8b0 0x7f8f8c0b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f83e00640 1 -- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f8c06c0c0 msgr2=0x7f8f8c0cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f83e00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f8c06c0c0 0x7f8f8c0cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f83e00640 1 -- 172.21.15.59:0/28222078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c0ca5d0 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f83e00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8c0cdbc0 0x7f8f8c0b5090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400c7b0 tx=0x7f8f7400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:44.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f82a00640 1 -- 172.21.15.59:0/28222078 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f74018070 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f82a00640 1 -- 172.21.15.59:0/28222078 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f740072f0 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f82a00640 1 -- 172.21.15.59:0/28222078 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f740047f0 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f8be00640 1 -- 172.21.15.59:0/28222078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8c0ca890 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.474+0000 7f8f8be00640 1 -- 172.21.15.59:0/28222078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8c0cae50 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.478+0000 7f8f8be00640 1 -- 172.21.15.59:0/28222078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f8c0691a0 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.478+0000 7f8f82a00640 1 -- 172.21.15.59:0/28222078 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8f74004990 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.478+0000 7f8f82a00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f68068380 0x7f8f6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.478+0000 7f8f82a00640 1 -- 172.21.15.59:0/28222078 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8f740859d0 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.478+0000 7f8f8aa00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f68068380 0x7f8f6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.478+0000 7f8f8aa00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f68068380 0x7f8f6806a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0ad000 tx=0x7f8f7c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:44.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.482+0000 7f8f82a00640 1 -- 172.21.15.59:0/28222078 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f8c15ec90 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.718+0000 7f8f8be00640 1 -- 172.21.15.59:0/28222078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f8f8c0cd830 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f82a00640 1 -- 172.21.15.59:0/28222078 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f8f74055bf0 con 0x7f8f8c0cdbc0 2024-05-30T16:49:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f8be00640 1 -- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f68068380 msgr2=0x7f8f6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f8be00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f68068380 0x7f8f6806a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0ad000 tx=0x7f8f7c0a6000 comp rx=0 tx=0).stop 2024-05-30T16:49:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f8be00640 1 -- 172.21.15.59:0/28222078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8c0cdbc0 msgr2=0x7f8f8c0b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f8be00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8c0cdbc0 0x7f8f8c0b5090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400c7b0 tx=0x7f8f7400cc70 comp rx=0 tx=0).stop 2024-05-30T16:49:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f8be00640 1 -- 172.21.15.59:0/28222078 shutdown_connections 2024-05-30T16:49:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f8be00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f68068380 0x7f8f6806a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f8be00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f8c15e8b0 0x7f8f8c0b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f8be00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8c0cdbc0 0x7f8f8c0b5090 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f8be00640 1 --2- 172.21.15.59:0/28222078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f8c06c0c0 0x7f8f8c0cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f8be00640 1 -- 172.21.15.59:0/28222078 >> 172.21.15.59:0/28222078 conn(0x7f8f8c0b6990 msgr2=0x7f8f8c06fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f8be00640 1 -- 172.21.15.59:0/28222078 shutdown_connections 2024-05-30T16:49:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.722+0000 7f8f8be00640 1 -- 172.21.15.59:0/28222078 wait complete. 2024-05-30T16:49:44.747 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-30T16:49:44.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.882+0000 7f024a000640 1 Processor -- start 2024-05-30T16:49:44.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.882+0000 7f024a000640 1 -- start start 2024-05-30T16:49:44.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.882+0000 7f024a000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0244159df0 0x7f02440ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.882+0000 7f024a000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f024415a1d0 0x7f02440ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.882+0000 7f024a000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f024415d730 con 0x7f02440b3e50 2024-05-30T16:49:44.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.882+0000 7f024a000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f02440b3370 con 0x7f024415a1d0 2024-05-30T16:49:44.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.882+0000 7f024a000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f02440b3650 con 0x7f0244159df0 2024-05-30T16:49:44.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.882+0000 7f023aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f024415a1d0 0x7f02440ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.882+0000 7f023aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f024415a1d0 0x7f02440ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53242/0 (socket says 172.21.15.59:53242) 2024-05-30T16:49:44.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.882+0000 7f023aa00640 1 -- 172.21.15.59:0/3227308180 learned_addr learned my addr 172.21.15.59:0/3227308180 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:44.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.882+0000 7f0243e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f02440b3e50 0x7f024415ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46172/0 (socket says 172.21.15.59:46172) 2024-05-30T16:49:44.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.882+0000 7f0243400640 1 --2- 172.21.15.59:0/3227308180 >> v2:172.21.15.107:3300/0 conn(0x7f0244159df0 0x7f02440ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f023aa00640 1 -- 172.21.15.59:0/3227308180 >> v2:172.21.15.107:3300/0 conn(0x7f0244159df0 msgr2=0x7f02440ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:44.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f023aa00640 1 --2- 172.21.15.59:0/3227308180 >> v2:172.21.15.107:3300/0 conn(0x7f0244159df0 0x7f02440ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f023aa00640 1 -- 172.21.15.59:0/3227308180 >> v1:172.21.15.59:6789/0 conn(0x7f02440b3e50 legacy=0x7f024415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f023aa00640 1 -- 172.21.15.59:0/3227308180 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02440b3930 con 0x7f024415a1d0 2024-05-30T16:49:44.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f0243400640 1 --2- 172.21.15.59:0/3227308180 >> v2:172.21.15.107:3300/0 conn(0x7f0244159df0 0x7f02440ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:44.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f0242a00640 1 -- 172.21.15.59:0/3227308180 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494905340 0 0) 0x7f024415d730 con 0x7f02440b3e50 2024-05-30T16:49:44.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f023aa00640 1 --2- 172.21.15.59:0/3227308180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024415a1d0 0x7f02440ad6f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f02440b4c20 tx=0x7f022c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caee4b8c198ddb1d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:44.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f0242a00640 1 -- 172.21.15.59:0/3227308180 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c0b0070 con 0x7f024415a1d0 2024-05-30T16:49:44.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f0242a00640 1 -- 172.21.15.59:0/3227308180 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022c0ab600 con 0x7f024415a1d0 2024-05-30T16:49:44.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f0242a00640 1 -- 172.21.15.59:0/3227308180 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c0ab9d0 con 0x7f024415a1d0 2024-05-30T16:49:44.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f024a000640 1 -- 172.21.15.59:0/3227308180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024415a1d0 msgr2=0x7f02440ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f024a000640 1 --2- 172.21.15.59:0/3227308180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024415a1d0 0x7f02440ad6f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f02440b4c20 tx=0x7f022c01c520 comp rx=0 tx=0).stop 2024-05-30T16:49:44.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f024a000640 1 -- 172.21.15.59:0/3227308180 shutdown_connections 2024-05-30T16:49:44.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f024a000640 1 --2- 172.21.15.59:0/3227308180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024415a1d0 0x7f02440ad6f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f024a000640 1 --2- 172.21.15.59:0/3227308180 >> v2:172.21.15.107:3300/0 conn(0x7f0244159df0 0x7f02440ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f024a000640 1 -- 172.21.15.59:0/3227308180 >> 172.21.15.59:0/3227308180 conn(0x7f02440b22d0 msgr2=0x7f02440b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:44.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f024a000640 1 -- 172.21.15.59:0/3227308180 shutdown_connections 2024-05-30T16:49:44.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.886+0000 7f024a000640 1 -- 172.21.15.59:0/3227308180 wait complete. 2024-05-30T16:49:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f024a000640 1 Processor -- start 2024-05-30T16:49:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f024a000640 1 -- start start 2024-05-30T16:49:44.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f024a000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02440b3e50 0x7f024414f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f024a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0244159df0 0x7f02441600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f024a000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f024415a1d0 0x7f02441605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f024a000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f024415e720 con 0x7f0244159df0 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f024a000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f024415e5a0 con 0x7f024415a1d0 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f024a000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f024415e8a0 con 0x7f02440b3e50 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f023aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0244159df0 0x7f02441600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f023aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0244159df0 0x7f02441600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53244/0 (socket says 172.21.15.59:53244) 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f023aa00640 1 -- 172.21.15.59:0/1798488485 learned_addr learned my addr 172.21.15.59:0/1798488485 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f0243400640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02440b3e50 0x7f024414f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f0243e00640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f024415a1d0 0x7f02441605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f023aa00640 1 -- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02440b3e50 msgr2=0x7f024414f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f023aa00640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02440b3e50 0x7f024414f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f023aa00640 1 -- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f024415a1d0 msgr2=0x7f02441605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f023aa00640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f024415a1d0 0x7f02441605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f023aa00640 1 -- 172.21.15.59:0/1798488485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0244152930 con 0x7f0244159df0 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f0243400640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02440b3e50 0x7f024414f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f023aa00640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0244159df0 0x7f02441600a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f022c0ae040 tx=0x7f022c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f023be00640 1 -- 172.21.15.59:0/1798488485 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c0bb070 con 0x7f0244159df0 2024-05-30T16:49:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f023be00640 1 -- 172.21.15.59:0/1798488485 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022c0aa730 con 0x7f0244159df0 2024-05-30T16:49:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f024a000640 1 -- 172.21.15.59:0/1798488485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0244152bd0 con 0x7f0244159df0 2024-05-30T16:49:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f023be00640 1 -- 172.21.15.59:0/1798488485 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c0b0040 con 0x7f0244159df0 2024-05-30T16:49:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.890+0000 7f024a000640 1 -- 172.21.15.59:0/1798488485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0244153190 con 0x7f0244159df0 2024-05-30T16:49:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.894+0000 7f024a000640 1 -- 172.21.15.59:0/1798488485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0244068a90 con 0x7f0244159df0 2024-05-30T16:49:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.894+0000 7f023be00640 1 -- 172.21.15.59:0/1798488485 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f022c0be070 con 0x7f0244159df0 2024-05-30T16:49:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.894+0000 7f023be00640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0220068380 0x7f022006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.894+0000 7f023be00640 1 -- 172.21.15.59:0/1798488485 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f022c1200a0 con 0x7f0244159df0 2024-05-30T16:49:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.894+0000 7f0243400640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0220068380 0x7f022006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.894+0000 7f0243400640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0220068380 0x7f022006a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0234009970 tx=0x7f0234008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:44.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:44.898+0000 7f023be00640 1 -- 172.21.15.59:0/1798488485 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f022c016110 con 0x7f0244159df0 2024-05-30T16:49:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.122+0000 7f024a000640 1 -- 172.21.15.59:0/1798488485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f02441671d0 con 0x7f0244159df0 2024-05-30T16:49:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.122+0000 7f023be00640 1 -- 172.21.15.59:0/1798488485 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f022c0f0a20 con 0x7f0244159df0 2024-05-30T16:49:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.126+0000 7f024a000640 1 -- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0220068380 msgr2=0x7f022006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.126+0000 7f024a000640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0220068380 0x7f022006a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0234009970 tx=0x7f0234008040 comp rx=0 tx=0).stop 2024-05-30T16:49:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.126+0000 7f024a000640 1 -- 172.21.15.59:0/1798488485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0244159df0 msgr2=0x7f02441600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.126+0000 7f024a000640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0244159df0 0x7f02441600a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f022c0ae040 tx=0x7f022c0192c0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.126+0000 7f024a000640 1 -- 172.21.15.59:0/1798488485 shutdown_connections 2024-05-30T16:49:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.126+0000 7f024a000640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0220068380 0x7f022006a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.126+0000 7f024a000640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f024415a1d0 0x7f02441605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.126+0000 7f024a000640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0244159df0 0x7f02441600a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.126+0000 7f024a000640 1 --2- 172.21.15.59:0/1798488485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02440b3e50 0x7f024414f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.126+0000 7f024a000640 1 -- 172.21.15.59:0/1798488485 >> 172.21.15.59:0/1798488485 conn(0x7f02440b22d0 msgr2=0x7f024406e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.126+0000 7f024a000640 1 -- 172.21.15.59:0/1798488485 shutdown_connections 2024-05-30T16:49:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.126+0000 7f024a000640 1 -- 172.21.15.59:0/1798488485 wait complete. 2024-05-30T16:49:45.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T16:49:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.286+0000 7f0699200640 1 Processor -- start 2024-05-30T16:49:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.286+0000 7f0699200640 1 -- start start 2024-05-30T16:49:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.286+0000 7f0699200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0694159df0 0x7f06940ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0699200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f06940b3e50 0x7f06940ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0699200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f069415d730 con 0x7f069415a1d0 2024-05-30T16:49:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0699200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f06940b3370 con 0x7f0694159df0 2024-05-30T16:49:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0699200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f06940b3650 con 0x7f06940b3e50 2024-05-30T16:49:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0691e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0694159df0 0x7f06940ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0691e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0694159df0 0x7f06940ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53250/0 (socket says 172.21.15.59:53250) 2024-05-30T16:49:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0691e00640 1 -- 172.21.15.59:0/2932362464 learned_addr learned my addr 172.21.15.59:0/2932362464 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:45.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0691e00640 1 -- 172.21.15.59:0/2932362464 >> v2:172.21.15.107:3300/0 conn(0x7f06940b3e50 msgr2=0x7f06940ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:45.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0692800640 1 --2- 172.21.15.59:0/2932362464 >> v2:172.21.15.107:3300/0 conn(0x7f06940b3e50 0x7f06940ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0691e00640 1 --2- 172.21.15.59:0/2932362464 >> v2:172.21.15.107:3300/0 conn(0x7f06940b3e50 0x7f06940ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0691e00640 1 -- 172.21.15.59:0/2932362464 >> v1:172.21.15.107:6789/0 conn(0x7f069415a1d0 legacy=0x7f069415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:45.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0691e00640 1 -- 172.21.15.59:0/2932362464 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06940b3930 con 0x7f0694159df0 2024-05-30T16:49:45.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0692800640 1 --2- 172.21.15.59:0/2932362464 >> v2:172.21.15.107:3300/0 conn(0x7f06940b3e50 0x7f06940ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0691e00640 1 --2- 172.21.15.59:0/2932362464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0694159df0 0x7f06940ad1b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f06940add30 tx=0x7f068401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3678556b52a834e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0690a00640 1 -- 172.21.15.59:0/2932362464 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06840b0070 con 0x7f0694159df0 2024-05-30T16:49:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0690a00640 1 -- 172.21.15.59:0/2932362464 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06840ab600 con 0x7f0694159df0 2024-05-30T16:49:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.290+0000 7f0690a00640 1 -- 172.21.15.59:0/2932362464 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06840ab9d0 con 0x7f0694159df0 2024-05-30T16:49:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 -- 172.21.15.59:0/2932362464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0694159df0 msgr2=0x7f06940ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 --2- 172.21.15.59:0/2932362464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0694159df0 0x7f06940ad1b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f06940add30 tx=0x7f068401c4e0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 -- 172.21.15.59:0/2932362464 shutdown_connections 2024-05-30T16:49:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 --2- 172.21.15.59:0/2932362464 >> v2:172.21.15.107:3300/0 conn(0x7f06940b3e50 0x7f06940ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 --2- 172.21.15.59:0/2932362464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0694159df0 0x7f06940ad1b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 -- 172.21.15.59:0/2932362464 >> 172.21.15.59:0/2932362464 conn(0x7f06940b22d0 msgr2=0x7f06940b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 -- 172.21.15.59:0/2932362464 shutdown_connections 2024-05-30T16:49:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 -- 172.21.15.59:0/2932362464 wait complete. 2024-05-30T16:49:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 Processor -- start 2024-05-30T16:49:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 -- start start 2024-05-30T16:49:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06940b3e50 0x7f0694152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0694159df0 0x7f0694150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f069415a1d0 0x7f069406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f069415e720 con 0x7f06940b3e50 2024-05-30T16:49:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f069415e5a0 con 0x7f069415a1d0 2024-05-30T16:49:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0699200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f069415e8a0 con 0x7f0694159df0 2024-05-30T16:49:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0691e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06940b3e50 0x7f0694152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0691e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06940b3e50 0x7f0694152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53266/0 (socket says 172.21.15.59:53266) 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0691e00640 1 -- 172.21.15.59:0/2243933505 learned_addr learned my addr 172.21.15.59:0/2243933505 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0692800640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f069415a1d0 0x7f069406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0691400640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0694159df0 0x7f0694150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0691e00640 1 -- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0694159df0 msgr2=0x7f0694150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0691e00640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0694159df0 0x7f0694150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0691e00640 1 -- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f069415a1d0 msgr2=0x7f069406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0691e00640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f069415a1d0 0x7f069406dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0691e00640 1 -- 172.21.15.59:0/2243933505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0694150db0 con 0x7f06940b3e50 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.294+0000 7f0691400640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0694159df0 0x7f0694150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.298+0000 7f0691e00640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06940b3e50 0x7f0694152120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f06840ae040 tx=0x7f068401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.298+0000 7f068a000640 1 -- 172.21.15.59:0/2243933505 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06840ba020 con 0x7f06940b3e50 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.298+0000 7f068a000640 1 -- 172.21.15.59:0/2243933505 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06840aa9f0 con 0x7f06940b3e50 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.298+0000 7f0699200640 1 -- 172.21.15.59:0/2243933505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0694151090 con 0x7f06940b3e50 2024-05-30T16:49:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.298+0000 7f068a000640 1 -- 172.21.15.59:0/2243933505 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06840b0040 con 0x7f06940b3e50 2024-05-30T16:49:45.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.298+0000 7f0699200640 1 -- 172.21.15.59:0/2243933505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0694149510 con 0x7f06940b3e50 2024-05-30T16:49:45.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.298+0000 7f0699200640 1 -- 172.21.15.59:0/2243933505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0694068a90 con 0x7f06940b3e50 2024-05-30T16:49:45.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.298+0000 7f068a000640 1 -- 172.21.15.59:0/2243933505 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f06840bd020 con 0x7f06940b3e50 2024-05-30T16:49:45.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.298+0000 7f068a000640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0674068380 0x7f067406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.298+0000 7f068a000640 1 -- 172.21.15.59:0/2243933505 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f06841208f0 con 0x7f06940b3e50 2024-05-30T16:49:45.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.298+0000 7f0691400640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0674068380 0x7f067406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.302+0000 7f0691400640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0674068380 0x7f067406a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f069406fad0 tx=0x7f0680009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:45.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.302+0000 7f068a000640 1 -- 172.21.15.59:0/2243933505 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06840c4070 con 0x7f06940b3e50 2024-05-30T16:49:45.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 -- 172.21.15.59:0/2243933505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f06940b4ef0 con 0x7f06940b3e50 2024-05-30T16:49:45.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f068a000640 1 -- 172.21.15.59:0/2243933505 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7f06840160d0 con 0x7f06940b3e50 2024-05-30T16:49:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:45.476 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:49:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-05-30T16:49:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-05-30T16:49:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:45.477 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:49:45.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 -- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0674068380 msgr2=0x7f067406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0674068380 0x7f067406a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f069406fad0 tx=0x7f0680009040 comp rx=0 tx=0).stop 2024-05-30T16:49:45.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 -- 172.21.15.59:0/2243933505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06940b3e50 msgr2=0x7f0694152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06940b3e50 0x7f0694152120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f06840ae040 tx=0x7f068401ad20 comp rx=0 tx=0).stop 2024-05-30T16:49:45.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 -- 172.21.15.59:0/2243933505 shutdown_connections 2024-05-30T16:49:45.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0674068380 0x7f067406a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f069415a1d0 0x7f069406dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0694159df0 0x7f0694150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 --2- 172.21.15.59:0/2243933505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06940b3e50 0x7f0694152120 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 -- 172.21.15.59:0/2243933505 >> 172.21.15.59:0/2243933505 conn(0x7f06940b22d0 msgr2=0x7f06941532c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:45.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 -- 172.21.15.59:0/2243933505 shutdown_connections 2024-05-30T16:49:45.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.470+0000 7f0699200640 1 -- 172.21.15.59:0/2243933505 wait complete. 2024-05-30T16:49:45.497 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T16:49:45.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T16:49:45.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.634+0000 7fd196200640 1 Processor -- start 2024-05-30T16:49:45.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd196200640 1 -- start start 2024-05-30T16:49:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd196200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19015ad90 0x7fd190071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd196200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd19006f6a0 0x7fd19006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd196200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1900b5140 con 0x7fd19006ea30 2024-05-30T16:49:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd196200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd1900b3370 con 0x7fd19006f6a0 2024-05-30T16:49:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd196200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd1900b3650 con 0x7fd19015ad90 2024-05-30T16:49:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd187e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd19006f6a0 0x7fd19006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd18f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19015ad90 0x7fd190071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd187e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd19006f6a0 0x7fd19006e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:37560/0 (socket says 172.21.15.59:37560) 2024-05-30T16:49:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd187e00640 1 -- 172.21.15.59:0/3389033588 learned_addr learned my addr 172.21.15.59:0/3389033588 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd18f400640 1 -- 172.21.15.59:0/3389033588 >> v2:172.21.15.107:3300/0 conn(0x7fd19006f6a0 msgr2=0x7fd19006e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd18f400640 1 --2- 172.21.15.59:0/3389033588 >> v2:172.21.15.107:3300/0 conn(0x7fd19006f6a0 0x7fd19006e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd18f400640 1 -- 172.21.15.59:0/3389033588 >> v1:172.21.15.107:6789/0 conn(0x7fd19006ea30 legacy=0x7fd19015e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd18f400640 1 -- 172.21.15.59:0/3389033588 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1900b3930 con 0x7fd19015ad90 2024-05-30T16:49:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.638+0000 7fd187e00640 1 --2- 172.21.15.59:0/3389033588 >> v2:172.21.15.107:3300/0 conn(0x7fd19006f6a0 0x7fd19006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd18f400640 1 --2- 172.21.15.59:0/3389033588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19015ad90 0x7fd190071cb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd1800097c0 tx=0x7fd18001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3f1ce15605daa8c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd18ea00640 1 -- 172.21.15.59:0/3389033588 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1800b0070 con 0x7fd19015ad90 2024-05-30T16:49:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd18ea00640 1 -- 172.21.15.59:0/3389033588 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1800ab600 con 0x7fd19015ad90 2024-05-30T16:49:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd18ea00640 1 -- 172.21.15.59:0/3389033588 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1800ab9d0 con 0x7fd19015ad90 2024-05-30T16:49:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd196200640 1 -- 172.21.15.59:0/3389033588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19015ad90 msgr2=0x7fd190071cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd196200640 1 --2- 172.21.15.59:0/3389033588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19015ad90 0x7fd190071cb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd1800097c0 tx=0x7fd18001c4a0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd196200640 1 -- 172.21.15.59:0/3389033588 shutdown_connections 2024-05-30T16:49:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd196200640 1 --2- 172.21.15.59:0/3389033588 >> v2:172.21.15.107:3300/0 conn(0x7fd19006f6a0 0x7fd19006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd196200640 1 --2- 172.21.15.59:0/3389033588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19015ad90 0x7fd190071cb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd196200640 1 -- 172.21.15.59:0/3389033588 >> 172.21.15.59:0/3389033588 conn(0x7fd1900b1e60 msgr2=0x7fd1900b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd196200640 1 -- 172.21.15.59:0/3389033588 shutdown_connections 2024-05-30T16:49:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd196200640 1 -- 172.21.15.59:0/3389033588 wait complete. 2024-05-30T16:49:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd196200640 1 Processor -- start 2024-05-30T16:49:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.642+0000 7fd196200640 1 -- start start 2024-05-30T16:49:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd196200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd19006ea30 0x7fd190147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd196200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19006f6a0 0x7fd1900ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd196200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd19015ad90 0x7fd19014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd196200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd1900ad7f0 con 0x7fd19006ea30 2024-05-30T16:49:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd196200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd1900ad670 con 0x7fd19015ad90 2024-05-30T16:49:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd196200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd19015f070 con 0x7fd19006f6a0 2024-05-30T16:49:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd18f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd19006ea30 0x7fd190147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd18f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd19006ea30 0x7fd190147a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53270/0 (socket says 172.21.15.59:53270) 2024-05-30T16:49:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd18f400640 1 -- 172.21.15.59:0/2824740035 learned_addr learned my addr 172.21.15.59:0/2824740035 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd187e00640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19006f6a0 0x7fd1900ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd18fe00640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd19015ad90 0x7fd19014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd18f400640 1 -- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19006f6a0 msgr2=0x7fd1900ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd18f400640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19006f6a0 0x7fd1900ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd18f400640 1 -- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd19015ad90 msgr2=0x7fd19014d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd18f400640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd19015ad90 0x7fd19014d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd18f400640 1 -- 172.21.15.59:0/2824740035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1900ae6e0 con 0x7fd19006ea30 2024-05-30T16:49:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd18fe00640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd19015ad90 0x7fd19014d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd18f400640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd19006ea30 0x7fd190147a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1800ae040 tx=0x7fd18001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd187400640 1 -- 172.21.15.59:0/2824740035 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1800b0050 con 0x7fd19006ea30 2024-05-30T16:49:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd187400640 1 -- 172.21.15.59:0/2824740035 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1800bc070 con 0x7fd19006ea30 2024-05-30T16:49:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd196200640 1 -- 172.21.15.59:0/2824740035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1901f94b0 con 0x7fd19006ea30 2024-05-30T16:49:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd187400640 1 -- 172.21.15.59:0/2824740035 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1800b5870 con 0x7fd19006ea30 2024-05-30T16:49:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd196200640 1 -- 172.21.15.59:0/2824740035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1901f9a70 con 0x7fd19006ea30 2024-05-30T16:49:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.646+0000 7fd196200640 1 -- 172.21.15.59:0/2824740035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd190068a90 con 0x7fd19006ea30 2024-05-30T16:49:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.650+0000 7fd187400640 1 -- 172.21.15.59:0/2824740035 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd1800b5a10 con 0x7fd19006ea30 2024-05-30T16:49:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.650+0000 7fd187400640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd16c0683b0 0x7fd16c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.650+0000 7fd187400640 1 -- 172.21.15.59:0/2824740035 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fd180120df0 con 0x7fd19006ea30 2024-05-30T16:49:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.650+0000 7fd187e00640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd16c0683b0 0x7fd16c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.650+0000 7fd187e00640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd16c0683b0 0x7fd16c06a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd1901f9370 tx=0x7fd178009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:45.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.654+0000 7fd187400640 1 -- 172.21.15.59:0/2824740035 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd180016090 con 0x7fd19006ea30 2024-05-30T16:49:45.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:45.822+0000 7fd196200640 1 -- 172.21.15.59:0/2824740035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd19006f020 con 0x7fd19006ea30 2024-05-30T16:49:46.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.726+0000 7fd187400640 1 -- 172.21.15.59:0/2824740035 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7fd1800f1660 con 0x7fd19006ea30 2024-05-30T16:49:46.732 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-05-30T16:49:46.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.730+0000 7fd196200640 1 -- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd16c0683b0 msgr2=0x7fd16c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.730+0000 7fd196200640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd16c0683b0 0x7fd16c06a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd1901f9370 tx=0x7fd178009240 comp rx=0 tx=0).stop 2024-05-30T16:49:46.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.730+0000 7fd196200640 1 -- 172.21.15.59:0/2824740035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd19006ea30 msgr2=0x7fd190147a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.730+0000 7fd196200640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd19006ea30 0x7fd190147a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1800ae040 tx=0x7fd18001ace0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.730+0000 7fd196200640 1 -- 172.21.15.59:0/2824740035 shutdown_connections 2024-05-30T16:49:46.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.730+0000 7fd196200640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd16c0683b0 0x7fd16c06a870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.730+0000 7fd196200640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd19015ad90 0x7fd19014d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.730+0000 7fd196200640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19006f6a0 0x7fd1900ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.730+0000 7fd196200640 1 --2- 172.21.15.59:0/2824740035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd19006ea30 0x7fd190147a70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.730+0000 7fd196200640 1 -- 172.21.15.59:0/2824740035 >> 172.21.15.59:0/2824740035 conn(0x7fd1900b1e60 msgr2=0x7fd1900d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:46.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.730+0000 7fd196200640 1 -- 172.21.15.59:0/2824740035 shutdown_connections 2024-05-30T16:49:46.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.730+0000 7fd196200640 1 -- 172.21.15.59:0/2824740035 wait complete. 2024-05-30T16:49:46.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T16:49:46.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.910+0000 7f2f00c00640 1 Processor -- start 2024-05-30T16:49:46.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.910+0000 7f2f00c00640 1 -- start start 2024-05-30T16:49:46.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2f00c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 0x7f2efc0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2f00c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2efc0d0370 0x7f2efc160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2f00c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2efc0cd7f0 con 0x7f2efc06b9b0 2024-05-30T16:49:46.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2f00c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2efc0d1180 con 0x7f2efc0d0370 2024-05-30T16:49:46.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2f00c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2efc15d060 con 0x7f2efc0cced0 2024-05-30T16:49:46.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2efa800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2efc0d0370 0x7f2efc160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2ef9e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 0x7f2efc0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2efa800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2efc0d0370 0x7f2efc160140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:37586/0 (socket says 172.21.15.59:37586) 2024-05-30T16:49:46.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2ef9e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 0x7f2efc0cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:54374/0 (socket says 172.21.15.59:54374) 2024-05-30T16:49:46.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2efa800640 1 -- 172.21.15.59:0/307288327 learned_addr learned my addr 172.21.15.59:0/307288327 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:46.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2efa800640 1 -- 172.21.15.59:0/307288327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 msgr2=0x7f2efc0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:46.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2efa800640 1 --2- 172.21.15.59:0/307288327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 0x7f2efc0cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2efa800640 1 -- 172.21.15.59:0/307288327 >> v1:172.21.15.107:6789/0 conn(0x7f2efc06b9b0 legacy=0x7f2efc15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2efa800640 1 -- 172.21.15.59:0/307288327 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc0d0bc0 con 0x7f2efc0d0370 2024-05-30T16:49:46.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.914+0000 7f2ef9e00640 1 --2- 172.21.15.59:0/307288327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 0x7f2efc0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:46.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2efa800640 1 --2- 172.21.15.59:0/307288327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc0d0370 0x7f2efc160140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009e50 tx=0x7f2ef401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7de199e254f72c57 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:46.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2ef9400640 1 -- 172.21.15.59:0/307288327 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40a5830 con 0x7f2efc0d0370 2024-05-30T16:49:46.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2ef9400640 1 -- 172.21.15.59:0/307288327 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef40a59d0 con 0x7f2efc0d0370 2024-05-30T16:49:46.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2ef9400640 1 -- 172.21.15.59:0/307288327 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40a5da0 con 0x7f2efc0d0370 2024-05-30T16:49:46.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2f00c00640 1 -- 172.21.15.59:0/307288327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc0d0370 msgr2=0x7f2efc160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2f00c00640 1 --2- 172.21.15.59:0/307288327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc0d0370 0x7f2efc160140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009e50 tx=0x7f2ef401c970 comp rx=0 tx=0).stop 2024-05-30T16:49:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2f00c00640 1 -- 172.21.15.59:0/307288327 shutdown_connections 2024-05-30T16:49:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2f00c00640 1 --2- 172.21.15.59:0/307288327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc0d0370 0x7f2efc160140 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2f00c00640 1 --2- 172.21.15.59:0/307288327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 0x7f2efc0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2f00c00640 1 -- 172.21.15.59:0/307288327 >> 172.21.15.59:0/307288327 conn(0x7f2efc0b2f50 msgr2=0x7f2efc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2f00c00640 1 -- 172.21.15.59:0/307288327 shutdown_connections 2024-05-30T16:49:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2f00c00640 1 -- 172.21.15.59:0/307288327 wait complete. 2024-05-30T16:49:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2f00c00640 1 Processor -- start 2024-05-30T16:49:46.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.918+0000 7f2f00c00640 1 -- start start 2024-05-30T16:49:46.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2f00c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc06b9b0 0x7f2efc0b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2f00c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 0x7f2efc0b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2f00c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc0d0370 0x7f2efc0cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2f00c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc06c6d0 con 0x7f2efc06b9b0 2024-05-30T16:49:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2f00c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc06c550 con 0x7f2efc0d0370 2024-05-30T16:49:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2f00c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2efc160a90 con 0x7f2efc0cced0 2024-05-30T16:49:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc06b9b0 0x7f2efc0b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc06b9b0 0x7f2efc0b6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53272/0 (socket says 172.21.15.59:53272) 2024-05-30T16:49:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef9e00640 1 -- 172.21.15.59:0/3760529963 learned_addr learned my addr 172.21.15.59:0/3760529963 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef1400640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 0x7f2efc0b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2efa800640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc0d0370 0x7f2efc0cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef9e00640 1 -- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 msgr2=0x7f2efc0b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef9e00640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 0x7f2efc0b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef9e00640 1 -- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc0d0370 msgr2=0x7f2efc0cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef9e00640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc0d0370 0x7f2efc0cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef9e00640 1 -- 172.21.15.59:0/3760529963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc0c87d0 con 0x7f2efc06b9b0 2024-05-30T16:49:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef1400640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 0x7f2efc0b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2efa800640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc0d0370 0x7f2efc0cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef9e00640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc06b9b0 0x7f2efc0b6ae0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00e980 tx=0x7f2eec00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef2a00640 1 -- 172.21.15.59:0/3760529963 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec017070 con 0x7f2efc06b9b0 2024-05-30T16:49:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef2a00640 1 -- 172.21.15.59:0/3760529963 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eec00ca00 con 0x7f2efc06b9b0 2024-05-30T16:49:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2ef2a00640 1 -- 172.21.15.59:0/3760529963 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00cdd0 con 0x7f2efc06b9b0 2024-05-30T16:49:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2f00c00640 1 -- 172.21.15.59:0/3760529963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2efc0b5a40 con 0x7f2efc06b9b0 2024-05-30T16:49:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2f00c00640 1 -- 172.21.15.59:0/3760529963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2efc0b6000 con 0x7f2efc06b9b0 2024-05-30T16:49:46.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.922+0000 7f2f00c00640 1 -- 172.21.15.59:0/3760529963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2efc068a90 con 0x7f2efc06b9b0 2024-05-30T16:49:46.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.926+0000 7f2ef2a00640 1 -- 172.21.15.59:0/3760529963 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2eec01a070 con 0x7f2efc06b9b0 2024-05-30T16:49:46.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.926+0000 7f2ef2a00640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2ed8068380 0x7f2ed806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.926+0000 7f2ef2a00640 1 -- 172.21.15.59:0/3760529963 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7f2eec086f10 con 0x7f2efc06b9b0 2024-05-30T16:49:46.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.926+0000 7f2ef1400640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2ed8068380 0x7f2ed806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.926+0000 7f2ef1400640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2ed8068380 0x7f2ed806a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4001670 tx=0x7f2ee4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:46.930+0000 7f2ef2a00640 1 -- 172.21.15.59:0/3760529963 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2eec057690 con 0x7f2efc06b9b0 2024-05-30T16:49:47.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.098+0000 7f2f00c00640 1 -- 172.21.15.59:0/3760529963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2efc15cad0 con 0x7f2efc06b9b0 2024-05-30T16:49:47.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.734+0000 7f2ef2a00640 1 -- 172.21.15.59:0/3760529963 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7f2eec056f90 con 0x7f2efc06b9b0 2024-05-30T16:49:47.739 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-05-30T16:49:47.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.738+0000 7f2f00c00640 1 -- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2ed8068380 msgr2=0x7f2ed806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.738+0000 7f2f00c00640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2ed8068380 0x7f2ed806a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4001670 tx=0x7f2ee4009040 comp rx=0 tx=0).stop 2024-05-30T16:49:47.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.738+0000 7f2f00c00640 1 -- 172.21.15.59:0/3760529963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc06b9b0 msgr2=0x7f2efc0b6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.738+0000 7f2f00c00640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc06b9b0 0x7f2efc0b6ae0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00e980 tx=0x7f2eec00ee40 comp rx=0 tx=0).stop 2024-05-30T16:49:47.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.738+0000 7f2f00c00640 1 -- 172.21.15.59:0/3760529963 shutdown_connections 2024-05-30T16:49:47.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.738+0000 7f2f00c00640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2ed8068380 0x7f2ed806a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.738+0000 7f2f00c00640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc0d0370 0x7f2efc0cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.738+0000 7f2f00c00640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2efc0cced0 0x7f2efc0b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.738+0000 7f2f00c00640 1 --2- 172.21.15.59:0/3760529963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc06b9b0 0x7f2efc0b6ae0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.738+0000 7f2f00c00640 1 -- 172.21.15.59:0/3760529963 >> 172.21.15.59:0/3760529963 conn(0x7f2efc0b2f50 msgr2=0x7f2efc15c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:47.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.738+0000 7f2f00c00640 1 -- 172.21.15.59:0/3760529963 shutdown_connections 2024-05-30T16:49:47.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.738+0000 7f2f00c00640 1 -- 172.21.15.59:0/3760529963 wait complete. 2024-05-30T16:49:47.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T16:49:47.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.918+0000 7fe9cc000640 1 Processor -- start 2024-05-30T16:49:47.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.918+0000 7fe9cc000640 1 -- start start 2024-05-30T16:49:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.918+0000 7fe9cc000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9c41569e0 0x7fe9c415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.918+0000 7fe9cc000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe9c40d0660 0x7fe9c40d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.918+0000 7fe9cc000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c40ad770 con 0x7fe9c40ad2b0 2024-05-30T16:49:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.918+0000 7fe9cc000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c40d1010 con 0x7fe9c41569e0 2024-05-30T16:49:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.918+0000 7fe9cc000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c415cb40 con 0x7fe9c40d0660 2024-05-30T16:49:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9c9600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9c41569e0 0x7fe9c415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9c9600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9c41569e0 0x7fe9c415d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53278/0 (socket says 172.21.15.59:53278) 2024-05-30T16:49:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9c8c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe9c40ad2b0 0x7fe9c40cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46180/0 (socket says 172.21.15.59:46180) 2024-05-30T16:49:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9c9600640 1 -- 172.21.15.59:0/2769823744 learned_addr learned my addr 172.21.15.59:0/2769823744 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:47.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9ca000640 1 --2- 172.21.15.59:0/2769823744 >> v2:172.21.15.107:3300/0 conn(0x7fe9c40d0660 0x7fe9c40d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9c9600640 1 -- 172.21.15.59:0/2769823744 >> v2:172.21.15.107:3300/0 conn(0x7fe9c40d0660 msgr2=0x7fe9c40d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:47.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9c9600640 1 --2- 172.21.15.59:0/2769823744 >> v2:172.21.15.107:3300/0 conn(0x7fe9c40d0660 0x7fe9c40d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9c9600640 1 -- 172.21.15.59:0/2769823744 >> v1:172.21.15.59:6789/0 conn(0x7fe9c40ad2b0 legacy=0x7fe9c40cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9c9600640 1 -- 172.21.15.59:0/2769823744 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c415ce20 con 0x7fe9c41569e0 2024-05-30T16:49:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9c9600640 1 --2- 172.21.15.59:0/2769823744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c41569e0 0x7fe9c415d620 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40ae820 tx=0x7fe9b801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51cf3674aec57ab server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9c3e00640 1 -- 172.21.15.59:0/2769823744 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80b1070 con 0x7fe9c41569e0 2024-05-30T16:49:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9c3e00640 1 -- 172.21.15.59:0/2769823744 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b80ac640 con 0x7fe9c41569e0 2024-05-30T16:49:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.922+0000 7fe9c3e00640 1 -- 172.21.15.59:0/2769823744 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80aca10 con 0x7fe9c41569e0 2024-05-30T16:49:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 -- 172.21.15.59:0/2769823744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c41569e0 msgr2=0x7fe9c415d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 --2- 172.21.15.59:0/2769823744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c41569e0 0x7fe9c415d620 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40ae820 tx=0x7fe9b801c490 comp rx=0 tx=0).stop 2024-05-30T16:49:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 -- 172.21.15.59:0/2769823744 shutdown_connections 2024-05-30T16:49:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 --2- 172.21.15.59:0/2769823744 >> v2:172.21.15.107:3300/0 conn(0x7fe9c40d0660 0x7fe9c40d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 --2- 172.21.15.59:0/2769823744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c41569e0 0x7fe9c415d620 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 -- 172.21.15.59:0/2769823744 >> 172.21.15.59:0/2769823744 conn(0x7fe9c406bdb0 msgr2=0x7fe9c406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 -- 172.21.15.59:0/2769823744 shutdown_connections 2024-05-30T16:49:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 -- 172.21.15.59:0/2769823744 wait complete. 2024-05-30T16:49:47.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 Processor -- start 2024-05-30T16:49:47.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 -- start start 2024-05-30T16:49:47.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c40ad2b0 0x7fe9c4155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c40d0660 0x7fe9c4145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9c41569e0 0x7fe9c4145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c40b3c60 con 0x7fe9c40ad2b0 2024-05-30T16:49:47.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c40b3ae0 con 0x7fe9c40d0660 2024-05-30T16:49:47.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9cc000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c40b3de0 con 0x7fe9c41569e0 2024-05-30T16:49:47.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9c9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c40ad2b0 0x7fe9c4155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9c9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c40ad2b0 0x7fe9c4155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53288/0 (socket says 172.21.15.59:53288) 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9c9600640 1 -- 172.21.15.59:0/519169780 learned_addr learned my addr 172.21.15.59:0/519169780 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9c8c00640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c40d0660 0x7fe9c4145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9ca000640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9c41569e0 0x7fe9c4145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9c9600640 1 -- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9c41569e0 msgr2=0x7fe9c4145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9c9600640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9c41569e0 0x7fe9c4145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9c9600640 1 -- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c40d0660 msgr2=0x7fe9c4145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9c9600640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c40d0660 0x7fe9c4145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.926+0000 7fe9c9600640 1 -- 172.21.15.59:0/519169780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c4142e70 con 0x7fe9c40ad2b0 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.930+0000 7fe9c9600640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c40ad2b0 0x7fe9c4155980 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80af040 tx=0x7fe9b801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.930+0000 7fe9c1600640 1 -- 172.21.15.59:0/519169780 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80bb020 con 0x7fe9c40ad2b0 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.930+0000 7fe9c1600640 1 -- 172.21.15.59:0/519169780 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b80b7640 con 0x7fe9c40ad2b0 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.930+0000 7fe9cc000640 1 -- 172.21.15.59:0/519169780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c4143150 con 0x7fe9c40ad2b0 2024-05-30T16:49:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.930+0000 7fe9c1600640 1 -- 172.21.15.59:0/519169780 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80b1040 con 0x7fe9c40ad2b0 2024-05-30T16:49:47.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.930+0000 7fe9cc000640 1 -- 172.21.15.59:0/519169780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c4143710 con 0x7fe9c40ad2b0 2024-05-30T16:49:47.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.930+0000 7fe9cc000640 1 -- 172.21.15.59:0/519169780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c4068a90 con 0x7fe9c40ad2b0 2024-05-30T16:49:47.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.930+0000 7fe9c1600640 1 -- 172.21.15.59:0/519169780 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9b80be020 con 0x7fe9c40ad2b0 2024-05-30T16:49:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.930+0000 7fe9c1600640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe9a4068380 0x7fe9a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.934+0000 7fe9c1600640 1 -- 172.21.15.59:0/519169780 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7fe9b81210d0 con 0x7fe9c40ad2b0 2024-05-30T16:49:47.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.934+0000 7fe9c8c00640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe9a4068380 0x7fe9a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.934+0000 7fe9c8c00640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe9a4068380 0x7fe9a406a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40d00d0 tx=0x7fe9b0007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:47.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:47.934+0000 7fe9c1600640 1 -- 172.21.15.59:0/519169780 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe9b80c5030 con 0x7fe9c40ad2b0 2024-05-30T16:49:48.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.134+0000 7fe9cc000640 1 -- 172.21.15.59:0/519169780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe9c41460f0 con 0x7fe9c40ad2b0 2024-05-30T16:49:48.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.738+0000 7fe9c1600640 1 -- 172.21.15.59:0/519169780 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7fe9b8016110 con 0x7fe9c40ad2b0 2024-05-30T16:49:48.741 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 4 and data pool 5 2024-05-30T16:49:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.738+0000 7fe9cc000640 1 -- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe9a4068380 msgr2=0x7fe9a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.738+0000 7fe9cc000640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe9a4068380 0x7fe9a406a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40d00d0 tx=0x7fe9b0007cd0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.738+0000 7fe9cc000640 1 -- 172.21.15.59:0/519169780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c40ad2b0 msgr2=0x7fe9c4155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.738+0000 7fe9cc000640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c40ad2b0 0x7fe9c4155980 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80af040 tx=0x7fe9b801acd0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.742+0000 7fe9cc000640 1 -- 172.21.15.59:0/519169780 shutdown_connections 2024-05-30T16:49:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.742+0000 7fe9cc000640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe9a4068380 0x7fe9a406a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.742+0000 7fe9cc000640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9c41569e0 0x7fe9c4145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.742+0000 7fe9cc000640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c40d0660 0x7fe9c4145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.742+0000 7fe9cc000640 1 --2- 172.21.15.59:0/519169780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c40ad2b0 0x7fe9c4155980 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.742+0000 7fe9cc000640 1 -- 172.21.15.59:0/519169780 >> 172.21.15.59:0/519169780 conn(0x7fe9c406bdb0 msgr2=0x7fe9c4153710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.746+0000 7fe9cc000640 1 -- 172.21.15.59:0/519169780 shutdown_connections 2024-05-30T16:49:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.746+0000 7fe9cc000640 1 -- 172.21.15.59:0/519169780 wait complete. 2024-05-30T16:49:48.803 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:48.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.938+0000 7fabd9e00640 1 Processor -- start 2024-05-30T16:49:48.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd9e00640 1 -- start start 2024-05-30T16:49:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd9e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabd415e8b0 0x7fabd40b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd9e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fabd406c0c0 0x7fabd40cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd9e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd415ec90 con 0x7fabd40cdbc0 2024-05-30T16:49:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd9e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fabd4073590 con 0x7fabd415e8b0 2024-05-30T16:49:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd9e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fabd40ce080 con 0x7fabd406c0c0 2024-05-30T16:49:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd8a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabd415e8b0 0x7fabd40b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fabd40cdbc0 0x7fabd406b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46188/0 (socket says 172.21.15.59:46188) 2024-05-30T16:49:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd3e00640 1 -- 172.21.15.59:0/3529394716 learned_addr learned my addr 172.21.15.59:0/3529394716 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd8a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabd415e8b0 0x7fabd40b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53290/0 (socket says 172.21.15.59:53290) 2024-05-30T16:49:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd9400640 1 --2- 172.21.15.59:0/3529394716 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fabd406c0c0 0x7fabd40cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd8a00640 1 -- 172.21.15.59:0/3529394716 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fabd406c0c0 msgr2=0x7fabd40cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd8a00640 1 --2- 172.21.15.59:0/3529394716 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fabd406c0c0 0x7fabd40cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd8a00640 1 -- 172.21.15.59:0/3529394716 >> v1:172.21.15.59:6789/0 conn(0x7fabd40cdbc0 legacy=0x7fabd406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:48.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd3400640 1 -- 172.21.15.59:0/3529394716 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2711345202 0 0) 0x7fabc0001120 con 0x7fabd40cdbc0 2024-05-30T16:49:48.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.942+0000 7fabd8a00640 1 -- 172.21.15.59:0/3529394716 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd40ce360 con 0x7fabd415e8b0 2024-05-30T16:49:48.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd8a00640 1 --2- 172.21.15.59:0/3529394716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd415e8b0 0x7fabd40b3990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fabc80097c0 tx=0x7fabc801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6911239ba42e9177 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:48.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd3400640 1 -- 172.21.15.59:0/3529394716 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc80b0070 con 0x7fabd415e8b0 2024-05-30T16:49:48.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd3400640 1 -- 172.21.15.59:0/3529394716 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc80ab600 con 0x7fabd415e8b0 2024-05-30T16:49:48.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd3400640 1 -- 172.21.15.59:0/3529394716 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc80ab9d0 con 0x7fabd415e8b0 2024-05-30T16:49:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd9e00640 1 -- 172.21.15.59:0/3529394716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd415e8b0 msgr2=0x7fabd40b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd9e00640 1 --2- 172.21.15.59:0/3529394716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd415e8b0 0x7fabd40b3990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fabc80097c0 tx=0x7fabc801c4a0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd9e00640 1 -- 172.21.15.59:0/3529394716 shutdown_connections 2024-05-30T16:49:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd9e00640 1 --2- 172.21.15.59:0/3529394716 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fabd406c0c0 0x7fabd40cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd9e00640 1 --2- 172.21.15.59:0/3529394716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd415e8b0 0x7fabd40b3990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd9e00640 1 -- 172.21.15.59:0/3529394716 >> 172.21.15.59:0/3529394716 conn(0x7fabd40b6990 msgr2=0x7fabd40b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd9e00640 1 -- 172.21.15.59:0/3529394716 shutdown_connections 2024-05-30T16:49:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd9e00640 1 -- 172.21.15.59:0/3529394716 wait complete. 2024-05-30T16:49:48.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd9e00640 1 Processor -- start 2024-05-30T16:49:48.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.946+0000 7fabd9e00640 1 -- start start 2024-05-30T16:49:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fabd406c0c0 0x7fabd40cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fabd40cdbc0 0x7fabd40b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd415e8b0 0x7fabd40b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fabd40d0270 con 0x7fabd415e8b0 2024-05-30T16:49:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fabd406f960 con 0x7fabd406c0c0 2024-05-30T16:49:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fabd40d03f0 con 0x7fabd40cdbc0 2024-05-30T16:49:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd415e8b0 0x7fabd40b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd415e8b0 0x7fabd40b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53300/0 (socket says 172.21.15.59:53300) 2024-05-30T16:49:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd3e00640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fabd40cdbc0 0x7fabd40b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9400640 1 -- 172.21.15.59:0/54582918 learned_addr learned my addr 172.21.15.59:0/54582918 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd8a00640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fabd406c0c0 0x7fabd40cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9400640 1 -- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fabd40cdbc0 msgr2=0x7fabd40b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9400640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fabd40cdbc0 0x7fabd40b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9400640 1 -- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fabd406c0c0 msgr2=0x7fabd40cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9400640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fabd406c0c0 0x7fabd40cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9400640 1 -- 172.21.15.59:0/54582918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd40ca5d0 con 0x7fabd415e8b0 2024-05-30T16:49:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9400640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd415e8b0 0x7fabd40b55d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009dd0 tx=0x7fabcc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd0c00640 1 -- 172.21.15.59:0/54582918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc018020 con 0x7fabd415e8b0 2024-05-30T16:49:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd0c00640 1 -- 172.21.15.59:0/54582918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabcc014480 con 0x7fabd415e8b0 2024-05-30T16:49:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd0c00640 1 -- 172.21.15.59:0/54582918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc014870 con 0x7fabd415e8b0 2024-05-30T16:49:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9e00640 1 -- 172.21.15.59:0/54582918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd40ca890 con 0x7fabd415e8b0 2024-05-30T16:49:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9e00640 1 -- 172.21.15.59:0/54582918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd40cae50 con 0x7fabd415e8b0 2024-05-30T16:49:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.950+0000 7fabd9e00640 1 -- 172.21.15.59:0/54582918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd40691a0 con 0x7fabd415e8b0 2024-05-30T16:49:48.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.954+0000 7fabd0c00640 1 -- 172.21.15.59:0/54582918 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fabcc01b020 con 0x7fabd415e8b0 2024-05-30T16:49:48.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.954+0000 7fabd0c00640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fabb4068380 0x7fabb406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:48.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.954+0000 7fabd0c00640 1 -- 172.21.15.59:0/54582918 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fabcc0873e0 con 0x7fabd415e8b0 2024-05-30T16:49:48.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.954+0000 7fabd8a00640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fabb4068380 0x7fabb406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:48.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.954+0000 7fabd8a00640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fabb4068380 0x7fabb406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fabc80ad000 tx=0x7fabc80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:48.958+0000 7fabd0c00640 1 -- 172.21.15.59:0/54582918 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fabcc022070 con 0x7fabd415e8b0 2024-05-30T16:49:49.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 -- 172.21.15.59:0/54582918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fabd40cd830 con 0x7fabd415e8b0 2024-05-30T16:49:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd0c00640 1 -- 172.21.15.59:0/54582918 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16670 (secure 0 0 0) 0x7fabcc010040 con 0x7fabd415e8b0 2024-05-30T16:49:49.131 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:49.131 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":33,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:49:48.139887+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:45.836560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:47.111349+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 -- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fabb4068380 msgr2=0x7fabb406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fabb4068380 0x7fabb406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fabc80ad000 tx=0x7fabc80a6000 comp rx=0 tx=0).stop 2024-05-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 -- 172.21.15.59:0/54582918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd415e8b0 msgr2=0x7fabd40b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd415e8b0 0x7fabd40b55d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009dd0 tx=0x7fabcc00c490 comp rx=0 tx=0).stop 2024-05-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 -- 172.21.15.59:0/54582918 shutdown_connections 2024-05-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fabb4068380 0x7fabb406a840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd415e8b0 0x7fabd40b55d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fabd40cdbc0 0x7fabd40b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 --2- 172.21.15.59:0/54582918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fabd406c0c0 0x7fabd40cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 -- 172.21.15.59:0/54582918 >> 172.21.15.59:0/54582918 conn(0x7fabd40b6990 msgr2=0x7fabd406fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 -- 172.21.15.59:0/54582918 shutdown_connections 2024-05-30T16:49:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.126+0000 7fabd9e00640 1 -- 172.21.15.59:0/54582918 wait complete. 2024-05-30T16:49:49.153 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.286+0000 7f7970000640 1 Processor -- start 2024-05-30T16:49:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f7970000640 1 -- start start 2024-05-30T16:49:49.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f7970000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79680b4510 0x7f79681630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f7970000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f796815fbe0 con 0x7f79680b48f0 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f7970000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f796815fec0 con 0x7f7968072d00 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f7970000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f79681635f0 con 0x7f79680b4510 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f796cc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f79680b48f0 0x7f796815f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46194/0 (socket says 172.21.15.59:46194) 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f796cc00640 1 -- 172.21.15.59:0/1476250215 learned_addr learned my addr 172.21.15.59:0/1476250215 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f796d600640 1 --2- 172.21.15.59:0/1476250215 >> v2:172.21.15.107:3300/0 conn(0x7f79680b4510 0x7f79681630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f7967e00640 1 -- 172.21.15.59:0/1476250215 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2021037746 0 0) 0x7f796815fbe0 con 0x7f79680b48f0 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f7967e00640 1 -- 172.21.15.59:0/1476250215 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7950003530 con 0x7f79680b48f0 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f7967e00640 1 -- 172.21.15.59:0/1476250215 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1673787658 0 0) 0x7f796815fec0 con 0x7f7968072d00 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f7967e00640 1 -- 172.21.15.59:0/1476250215 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f796815fbe0 con 0x7f7968072d00 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f796d600640 1 -- 172.21.15.59:0/1476250215 >> v1:172.21.15.107:6789/0 conn(0x7f7968072d00 legacy=0x7f796806e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f796d600640 1 -- 172.21.15.59:0/1476250215 >> v1:172.21.15.59:6789/0 conn(0x7f79680b48f0 legacy=0x7f796815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.290+0000 7f796d600640 1 -- 172.21.15.59:0/1476250215 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79681628b0 con 0x7f79680b4510 2024-05-30T16:49:49.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f796d600640 1 --2- 172.21.15.59:0/1476250215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79680b4510 0x7f79681630b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f795c0097c0 tx=0x7f795c01cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e26bb2748f91990 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f7967e00640 1 -- 172.21.15.59:0/1476250215 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c0b1070 con 0x7f79680b4510 2024-05-30T16:49:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f7967e00640 1 -- 172.21.15.59:0/1476250215 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f795c0ac410 con 0x7f79680b4510 2024-05-30T16:49:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f7967e00640 1 -- 172.21.15.59:0/1476250215 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c0ac7e0 con 0x7f79680b4510 2024-05-30T16:49:49.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f7970000640 1 -- 172.21.15.59:0/1476250215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79680b4510 msgr2=0x7f79681630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f7970000640 1 --2- 172.21.15.59:0/1476250215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79680b4510 0x7f79681630b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f795c0097c0 tx=0x7f795c01cf00 comp rx=0 tx=0).stop 2024-05-30T16:49:49.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f7970000640 1 -- 172.21.15.59:0/1476250215 shutdown_connections 2024-05-30T16:49:49.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f7970000640 1 --2- 172.21.15.59:0/1476250215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79680b4510 0x7f79681630b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f7970000640 1 -- 172.21.15.59:0/1476250215 >> 172.21.15.59:0/1476250215 conn(0x7f79680b3240 msgr2=0x7f79680725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:49.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f7970000640 1 -- 172.21.15.59:0/1476250215 shutdown_connections 2024-05-30T16:49:49.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f7970000640 1 -- 172.21.15.59:0/1476250215 wait complete. 2024-05-30T16:49:49.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f7970000640 1 Processor -- start 2024-05-30T16:49:49.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.294+0000 7f7970000640 1 -- start start 2024-05-30T16:49:49.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f7970000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7968072d00 0x7f7968153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:49.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f7970000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79680b4510 0x7f7968157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:49.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f7970000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79680b48f0 0x7f79681542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f7970000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7968073520 con 0x7f79680b4510 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f7970000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f796815f7c0 con 0x7f7968072d00 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f7970000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7968157860 con 0x7f79680b48f0 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f796cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79680b4510 0x7f7968157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f796cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79680b4510 0x7f7968157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53316/0 (socket says 172.21.15.59:53316) 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f796cc00640 1 -- 172.21.15.59:0/2220290936 learned_addr learned my addr 172.21.15.59:0/2220290936 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f796e000640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79680b48f0 0x7f79681542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f796d600640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7968072d00 0x7f7968153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f796cc00640 1 -- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79680b48f0 msgr2=0x7f79681542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f796cc00640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79680b48f0 0x7f79681542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f796cc00640 1 -- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7968072d00 msgr2=0x7f7968153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f796cc00640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7968072d00 0x7f7968153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f796cc00640 1 -- 172.21.15.59:0/2220290936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7968158320 con 0x7f79680b4510 2024-05-30T16:49:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f796cc00640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79680b4510 0x7f7968157320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f795400c430 tx=0x7f795400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:49.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f7965600640 1 -- 172.21.15.59:0/2220290936 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7954017070 con 0x7f79680b4510 2024-05-30T16:49:49.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f7965600640 1 -- 172.21.15.59:0/2220290936 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7954005db0 con 0x7f79680b4510 2024-05-30T16:49:49.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f7970000640 1 -- 172.21.15.59:0/2220290936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7968153bf0 con 0x7f79680b4510 2024-05-30T16:49:49.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f7965600640 1 -- 172.21.15.59:0/2220290936 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7954007310 con 0x7f79680b4510 2024-05-30T16:49:49.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f7970000640 1 -- 172.21.15.59:0/2220290936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7968156840 con 0x7f79680b4510 2024-05-30T16:49:49.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.298+0000 7f7970000640 1 -- 172.21.15.59:0/2220290936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7968068a90 con 0x7f79680b4510 2024-05-30T16:49:49.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.302+0000 7f7965600640 1 -- 172.21.15.59:0/2220290936 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f795401a070 con 0x7f79680b4510 2024-05-30T16:49:49.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.302+0000 7f7965600640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f79480683b0 0x7f794806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:49.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.302+0000 7f7965600640 1 -- 172.21.15.59:0/2220290936 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7954085cf0 con 0x7f79680b4510 2024-05-30T16:49:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.302+0000 7f796d600640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f79480683b0 0x7f794806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.302+0000 7f796d600640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f79480683b0 0x7f794806a870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f795c0ae000 tx=0x7f795c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:49.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.306+0000 7f7965600640 1 -- 172.21.15.59:0/2220290936 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7954055c50 con 0x7f79680b4510 2024-05-30T16:49:49.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 -- 172.21.15.59:0/2220290936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f796806d2c0 con 0x7f79680b4510 2024-05-30T16:49:49.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7965600640 1 -- 172.21.15.59:0/2220290936 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16670 (secure 0 0 0) 0x7f7954059f50 con 0x7f79680b4510 2024-05-30T16:49:49.479 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:49.479 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":33,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:49:48.139887+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:45.836560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:47.111349+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:49.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 -- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f79480683b0 msgr2=0x7f794806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f79480683b0 0x7f794806a870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f795c0ae000 tx=0x7f795c008040 comp rx=0 tx=0).stop 2024-05-30T16:49:49.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 -- 172.21.15.59:0/2220290936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79680b4510 msgr2=0x7f7968157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79680b4510 0x7f7968157320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f795400c430 tx=0x7f795400c8f0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 -- 172.21.15.59:0/2220290936 shutdown_connections 2024-05-30T16:49:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f79480683b0 0x7f794806a870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79680b48f0 0x7f79681542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79680b4510 0x7f7968157320 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 --2- 172.21.15.59:0/2220290936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7968072d00 0x7f7968153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 -- 172.21.15.59:0/2220290936 >> 172.21.15.59:0/2220290936 conn(0x7f79680b3240 msgr2=0x7f7968074b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 -- 172.21.15.59:0/2220290936 shutdown_connections 2024-05-30T16:49:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.474+0000 7f7970000640 1 -- 172.21.15.59:0/2220290936 wait complete. 2024-05-30T16:49:49.500 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T16:49:49.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d26c00640 1 Processor -- start 2024-05-30T16:49:49.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d26c00640 1 -- start start 2024-05-30T16:49:49.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d26c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d2015c010 0x7f4d2015c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:49.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d26c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d200b52d0 con 0x7f4d200b44e0 2024-05-30T16:49:49.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d26c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d200b4a30 con 0x7f4d20159100 2024-05-30T16:49:49.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d26c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4d200b4d10 con 0x7f4d2015c010 2024-05-30T16:49:49.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d24c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d2015c010 0x7f4d2015c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d1f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4d200b44e0 0x7f4d2015efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46204/0 (socket says 172.21.15.59:46204) 2024-05-30T16:49:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d1f400640 1 -- 172.21.15.59:0/2043936478 learned_addr learned my addr 172.21.15.59:0/2043936478 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d24c00640 1 -- 172.21.15.59:0/2043936478 >> v1:172.21.15.107:6789/0 conn(0x7f4d20159100 legacy=0x7f4d2006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d1ea00640 1 -- 172.21.15.59:0/2043936478 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475941212 0 0) 0x7f4d200b52d0 con 0x7f4d200b44e0 2024-05-30T16:49:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d24c00640 1 -- 172.21.15.59:0/2043936478 >> v1:172.21.15.59:6789/0 conn(0x7f4d200b44e0 legacy=0x7f4d2015efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.642+0000 7f4d24c00640 1 -- 172.21.15.59:0/2043936478 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d200b4ff0 con 0x7f4d2015c010 2024-05-30T16:49:49.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d24c00640 1 --2- 172.21.15.59:0/2043936478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d2015c010 0x7f4d2015c440 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009d90 tx=0x7f4d1801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71912a771cb2e822 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:49.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d1ea00640 1 -- 172.21.15.59:0/2043936478 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d180b2070 con 0x7f4d2015c010 2024-05-30T16:49:49.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d1ea00640 1 -- 172.21.15.59:0/2043936478 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d180a57b0 con 0x7f4d2015c010 2024-05-30T16:49:49.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d1ea00640 1 -- 172.21.15.59:0/2043936478 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d180a5b80 con 0x7f4d2015c010 2024-05-30T16:49:49.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d26c00640 1 -- 172.21.15.59:0/2043936478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d2015c010 msgr2=0x7f4d2015c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d26c00640 1 --2- 172.21.15.59:0/2043936478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d2015c010 0x7f4d2015c440 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009d90 tx=0x7f4d1801c8e0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d26c00640 1 -- 172.21.15.59:0/2043936478 shutdown_connections 2024-05-30T16:49:49.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d26c00640 1 --2- 172.21.15.59:0/2043936478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d2015c010 0x7f4d2015c440 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d26c00640 1 -- 172.21.15.59:0/2043936478 >> 172.21.15.59:0/2043936478 conn(0x7f4d2006bdb0 msgr2=0x7f4d2006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:49.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d26c00640 1 -- 172.21.15.59:0/2043936478 shutdown_connections 2024-05-30T16:49:49.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d26c00640 1 -- 172.21.15.59:0/2043936478 wait complete. 2024-05-30T16:49:49.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d26c00640 1 Processor -- start 2024-05-30T16:49:49.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.646+0000 7f4d26c00640 1 -- start start 2024-05-30T16:49:49.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d26c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d200b44e0 0x7f4d20164780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:49.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d26c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20159100 0x7f4d20166540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:49.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d26c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d2015c010 0x7f4d2014f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:49.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d26c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4d201694e0 con 0x7f4d20159100 2024-05-30T16:49:49.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d26c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4d20169360 con 0x7f4d2015c010 2024-05-30T16:49:49.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d26c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4d20169660 con 0x7f4d200b44e0 2024-05-30T16:49:49.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d1f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20159100 0x7f4d20166540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:49.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d1f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20159100 0x7f4d20166540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53336/0 (socket says 172.21.15.59:53336) 2024-05-30T16:49:49.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d1f400640 1 -- 172.21.15.59:0/916754185 learned_addr learned my addr 172.21.15.59:0/916754185 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:49.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d1fe00640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d200b44e0 0x7f4d20164780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:49.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d24c00640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d2015c010 0x7f4d2014f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:49.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d1f400640 1 -- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d200b44e0 msgr2=0x7f4d20164780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d1f400640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d200b44e0 0x7f4d20164780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d1f400640 1 -- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d2015c010 msgr2=0x7f4d2014f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d1f400640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d2015c010 0x7f4d2014f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d1f400640 1 -- 172.21.15.59:0/916754185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d200af9c0 con 0x7f4d20159100 2024-05-30T16:49:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d1f400640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20159100 0x7f4d20166540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00c440 tx=0x7f4d0c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d17e00640 1 -- 172.21.15.59:0/916754185 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c018070 con 0x7f4d20159100 2024-05-30T16:49:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d17e00640 1 -- 172.21.15.59:0/916754185 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c0074e0 con 0x7f4d20159100 2024-05-30T16:49:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d17e00640 1 -- 172.21.15.59:0/916754185 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c004a10 con 0x7f4d20159100 2024-05-30T16:49:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d26c00640 1 -- 172.21.15.59:0/916754185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d20153c40 con 0x7f4d20159100 2024-05-30T16:49:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d26c00640 1 -- 172.21.15.59:0/916754185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d200cd890 con 0x7f4d20159100 2024-05-30T16:49:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.650+0000 7f4d26c00640 1 -- 172.21.15.59:0/916754185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d20068a90 con 0x7f4d20159100 2024-05-30T16:49:49.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.654+0000 7f4d17e00640 1 -- 172.21.15.59:0/916754185 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d0c004bb0 con 0x7f4d20159100 2024-05-30T16:49:49.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.654+0000 7f4d17e00640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d00068380 0x7f4d0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:49.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.654+0000 7f4d17e00640 1 -- 172.21.15.59:0/916754185 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4d0c085c40 con 0x7f4d20159100 2024-05-30T16:49:49.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.654+0000 7f4d1fe00640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d00068380 0x7f4d0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:49.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.654+0000 7f4d1fe00640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d00068380 0x7f4d0006a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4d10000f70 tx=0x7f4d10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:49.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.658+0000 7f4d17e00640 1 -- 172.21.15.59:0/916754185 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d0c0561f0 con 0x7f4d20159100 2024-05-30T16:49:49.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:49.862+0000 7f4d26c00640 1 -- 172.21.15.59:0/916754185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4d2006ccd0 con 0x7f4d20159100 2024-05-30T16:49:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.762+0000 7f4d17e00640 1 -- 172.21.15.59:0/916754185 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f4d0c055af0 con 0x7f4d20159100 2024-05-30T16:49:50.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.766+0000 7f4d26c00640 1 -- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d00068380 msgr2=0x7f4d0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:50.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.766+0000 7f4d26c00640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d00068380 0x7f4d0006a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4d10000f70 tx=0x7f4d10009040 comp rx=0 tx=0).stop 2024-05-30T16:49:50.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.766+0000 7f4d26c00640 1 -- 172.21.15.59:0/916754185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20159100 msgr2=0x7f4d20166540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.766+0000 7f4d26c00640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20159100 0x7f4d20166540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00c440 tx=0x7f4d0c00c900 comp rx=0 tx=0).stop 2024-05-30T16:49:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.766+0000 7f4d26c00640 1 -- 172.21.15.59:0/916754185 shutdown_connections 2024-05-30T16:49:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.766+0000 7f4d26c00640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d00068380 0x7f4d0006a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.766+0000 7f4d26c00640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d2015c010 0x7f4d2014f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.766+0000 7f4d26c00640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20159100 0x7f4d20166540 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.766+0000 7f4d26c00640 1 --2- 172.21.15.59:0/916754185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d200b44e0 0x7f4d20164780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.766+0000 7f4d26c00640 1 -- 172.21.15.59:0/916754185 >> 172.21.15.59:0/916754185 conn(0x7f4d2006bdb0 msgr2=0x7f4d2015cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.766+0000 7f4d26c00640 1 -- 172.21.15.59:0/916754185 shutdown_connections 2024-05-30T16:49:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.766+0000 7f4d26c00640 1 -- 172.21.15.59:0/916754185 wait complete. 2024-05-30T16:49:50.793 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T16:49:50.794 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T16:49:50.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c32600640 1 Processor -- start 2024-05-30T16:49:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c32600640 1 -- start start 2024-05-30T16:49:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c32600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c2c0b0500 0x7f6c2c0cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c32600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c2c0ccd40 0x7f6c2c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c32600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2c0cbab0 con 0x7f6c2c15ea20 2024-05-30T16:49:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c32600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6c2c15ee00 con 0x7f6c2c0ccd40 2024-05-30T16:49:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c32600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2c0cc370 con 0x7f6c2c0b0500 2024-05-30T16:49:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c2b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6c2c15ea20 0x7f6c2c0ae230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46208/0 (socket says 172.21.15.59:46208) 2024-05-30T16:49:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c2b400640 1 -- 172.21.15.59:0/1013368614 learned_addr learned my addr 172.21.15.59:0/1013368614 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c2be00640 1 --2- 172.21.15.59:0/1013368614 >> v2:172.21.15.59:3300/0 conn(0x7f6c2c0ccd40 0x7f6c2c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c22a00640 1 --2- 172.21.15.59:0/1013368614 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c2c0b0500 0x7f6c2c0cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c2aa00640 1 -- 172.21.15.59:0/1013368614 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2743544353 0 0) 0x7f6c2c0cbab0 con 0x7f6c2c15ea20 2024-05-30T16:49:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c2aa00640 1 -- 172.21.15.59:0/1013368614 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c10003530 con 0x7f6c2c15ea20 2024-05-30T16:49:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c2be00640 1 -- 172.21.15.59:0/1013368614 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c2c0b0500 msgr2=0x7f6c2c0cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c2be00640 1 --2- 172.21.15.59:0/1013368614 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c2c0b0500 0x7f6c2c0cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c2be00640 1 -- 172.21.15.59:0/1013368614 >> v1:172.21.15.59:6789/0 conn(0x7f6c2c15ea20 legacy=0x7f6c2c0ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.938+0000 7f6c2be00640 1 -- 172.21.15.59:0/1013368614 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c0cbd20 con 0x7f6c2c0ccd40 2024-05-30T16:49:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.942+0000 7f6c2be00640 1 --2- 172.21.15.59:0/1013368614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2c0ccd40 0x7f6c2c06b9b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009d90 tx=0x7f6c2401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7c3daead7cd0b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.942+0000 7f6c2aa00640 1 -- 172.21.15.59:0/1013368614 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240b2070 con 0x7f6c2c0ccd40 2024-05-30T16:49:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.942+0000 7f6c2aa00640 1 -- 172.21.15.59:0/1013368614 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c240a5880 con 0x7f6c2c0ccd40 2024-05-30T16:49:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.942+0000 7f6c2aa00640 1 -- 172.21.15.59:0/1013368614 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240a5c50 con 0x7f6c2c0ccd40 2024-05-30T16:49:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.942+0000 7f6c32600640 1 -- 172.21.15.59:0/1013368614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2c0ccd40 msgr2=0x7f6c2c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.942+0000 7f6c32600640 1 --2- 172.21.15.59:0/1013368614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2c0ccd40 0x7f6c2c06b9b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009d90 tx=0x7f6c2401c8b0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.942+0000 7f6c32600640 1 -- 172.21.15.59:0/1013368614 shutdown_connections 2024-05-30T16:49:50.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.942+0000 7f6c32600640 1 --2- 172.21.15.59:0/1013368614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2c0ccd40 0x7f6c2c06b9b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.942+0000 7f6c32600640 1 --2- 172.21.15.59:0/1013368614 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c2c0b0500 0x7f6c2c0cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.942+0000 7f6c32600640 1 -- 172.21.15.59:0/1013368614 >> 172.21.15.59:0/1013368614 conn(0x7f6c2c0b2f50 msgr2=0x7f6c2c0b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:50.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.942+0000 7f6c32600640 1 -- 172.21.15.59:0/1013368614 shutdown_connections 2024-05-30T16:49:50.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.942+0000 7f6c32600640 1 -- 172.21.15.59:0/1013368614 wait complete. 2024-05-30T16:49:50.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c32600640 1 Processor -- start 2024-05-30T16:49:50.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c32600640 1 -- start start 2024-05-30T16:49:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c32600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2c0b0500 0x7f6c2c1597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c32600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c2c0ccd40 0x7f6c2c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c32600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2c15ea20 0x7f6c2c0c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c32600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c0ae940 con 0x7f6c2c15ea20 2024-05-30T16:49:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c32600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c06c300 con 0x7f6c2c0b0500 2024-05-30T16:49:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c32600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2c159db0 con 0x7f6c2c0ccd40 2024-05-30T16:49:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c2be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2c15ea20 0x7f6c2c0c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c2be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2c15ea20 0x7f6c2c0c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53350/0 (socket says 172.21.15.59:53350) 2024-05-30T16:49:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c2be00640 1 -- 172.21.15.59:0/1658170299 learned_addr learned my addr 172.21.15.59:0/1658170299 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c2b400640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2c0b0500 0x7f6c2c1597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c2be00640 1 -- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c2c0ccd40 msgr2=0x7f6c2c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c2be00640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c2c0ccd40 0x7f6c2c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c2be00640 1 -- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2c0b0500 msgr2=0x7f6c2c1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c2be00640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2c0b0500 0x7f6c2c1597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c2be00640 1 -- 172.21.15.59:0/1658170299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c0c4e20 con 0x7f6c2c15ea20 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c2b400640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2c0b0500 0x7f6c2c1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c2be00640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2c15ea20 0x7f6c2c0c6bc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009d90 tx=0x7f6c24019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c23e00640 1 -- 172.21.15.59:0/1658170299 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240bd020 con 0x7f6c2c15ea20 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c23e00640 1 -- 172.21.15.59:0/1658170299 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c240b8470 con 0x7f6c2c15ea20 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c23e00640 1 -- 172.21.15.59:0/1658170299 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240b2040 con 0x7f6c2c15ea20 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c32600640 1 -- 172.21.15.59:0/1658170299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c0c5100 con 0x7f6c2c15ea20 2024-05-30T16:49:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c32600640 1 -- 172.21.15.59:0/1658170299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c0c56c0 con 0x7f6c2c15ea20 2024-05-30T16:49:50.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.946+0000 7f6c32600640 1 -- 172.21.15.59:0/1658170299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c2c075680 con 0x7f6c2c15ea20 2024-05-30T16:49:50.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.950+0000 7f6c23e00640 1 -- 172.21.15.59:0/1658170299 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c240c0020 con 0x7f6c2c15ea20 2024-05-30T16:49:50.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.950+0000 7f6c23e00640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6c08068380 0x7f6c0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.950+0000 7f6c23e00640 1 -- 172.21.15.59:0/1658170299 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c24121890 con 0x7f6c2c15ea20 2024-05-30T16:49:50.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.950+0000 7f6c2b400640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6c08068380 0x7f6c0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:50.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.950+0000 7f6c2b400640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6c08068380 0x7f6c0806a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c005890 tx=0x7f6c1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:50.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:50.954+0000 7f6c23e00640 1 -- 172.21.15.59:0/1658170299 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6c240c7030 con 0x7f6c2c15ea20 2024-05-30T16:49:51.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.154+0000 7f6c32600640 1 -- 172.21.15.59:0/1658170299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6c2c068a90 con 0x7f6c2c15ea20 2024-05-30T16:49:51.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c23e00640 1 -- 172.21.15.59:0/1658170299 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f6c24016560 con 0x7f6c2c15ea20 2024-05-30T16:49:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c32600640 1 -- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6c08068380 msgr2=0x7f6c0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c32600640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6c08068380 0x7f6c0806a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c005890 tx=0x7f6c1c009040 comp rx=0 tx=0).stop 2024-05-30T16:49:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c32600640 1 -- 172.21.15.59:0/1658170299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2c15ea20 msgr2=0x7f6c2c0c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c32600640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2c15ea20 0x7f6c2c0c6bc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009d90 tx=0x7f6c24019650 comp rx=0 tx=0).stop 2024-05-30T16:49:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c32600640 1 -- 172.21.15.59:0/1658170299 shutdown_connections 2024-05-30T16:49:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c32600640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6c08068380 0x7f6c0806a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c32600640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2c15ea20 0x7f6c2c0c6bc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c32600640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c2c0ccd40 0x7f6c2c0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c32600640 1 --2- 172.21.15.59:0/1658170299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2c0b0500 0x7f6c2c1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c32600640 1 -- 172.21.15.59:0/1658170299 >> 172.21.15.59:0/1658170299 conn(0x7f6c2c0b2f50 msgr2=0x7f6c2c15ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c32600640 1 -- 172.21.15.59:0/1658170299 shutdown_connections 2024-05-30T16:49:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.766+0000 7f6c32600640 1 -- 172.21.15.59:0/1658170299 wait complete. 2024-05-30T16:49:51.797 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T16:49:51.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18fd200640 1 Processor -- start 2024-05-30T16:49:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18fd200640 1 -- start start 2024-05-30T16:49:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18fd200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18f80d05b0 0x7f18f809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18fd200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18f809af80 0x7f18f806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18fd200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f8070950 con 0x7f18f80d14c0 2024-05-30T16:49:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18fd200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f18f809b3f0 con 0x7f18f809af80 2024-05-30T16:49:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18fd200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f18f8070c30 con 0x7f18f80d05b0 2024-05-30T16:49:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18f5e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f18f80d14c0 0x7f18f806e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39164/0 (socket says 172.21.15.59:39164) 2024-05-30T16:49:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18f5e00640 1 -- 172.21.15.59:0/2961508801 learned_addr learned my addr 172.21.15.59:0/2961508801 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18f6800640 1 --2- 172.21.15.59:0/2961508801 >> v2:172.21.15.59:3300/0 conn(0x7f18f809af80 0x7f18f806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18ed400640 1 --2- 172.21.15.59:0/2961508801 >> v2:172.21.15.107:3300/0 conn(0x7f18f80d05b0 0x7f18f809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18f5400640 1 -- 172.21.15.59:0/2961508801 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523530883 0 0) 0x7f18f8070950 con 0x7f18f80d14c0 2024-05-30T16:49:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18f6800640 1 -- 172.21.15.59:0/2961508801 >> v2:172.21.15.107:3300/0 conn(0x7f18f80d05b0 msgr2=0x7f18f809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18f6800640 1 --2- 172.21.15.59:0/2961508801 >> v2:172.21.15.107:3300/0 conn(0x7f18f80d05b0 0x7f18f809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18f6800640 1 -- 172.21.15.59:0/2961508801 >> v1:172.21.15.59:6789/0 conn(0x7f18f80d14c0 legacy=0x7f18f806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.938+0000 7f18f6800640 1 -- 172.21.15.59:0/2961508801 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f8070f10 con 0x7f18f809af80 2024-05-30T16:49:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.942+0000 7f18f6800640 1 --2- 172.21.15.59:0/2961508801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f809af80 0x7f18f806d0f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f18f8072190 tx=0x7f18f001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6421506dfe025b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:51.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.942+0000 7f18f5400640 1 -- 172.21.15.59:0/2961508801 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f00ab610 con 0x7f18f809af80 2024-05-30T16:49:51.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.942+0000 7f18f5400640 1 -- 172.21.15.59:0/2961508801 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f00b0070 con 0x7f18f809af80 2024-05-30T16:49:51.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.942+0000 7f18f5400640 1 -- 172.21.15.59:0/2961508801 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f00ab9d0 con 0x7f18f809af80 2024-05-30T16:49:51.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.942+0000 7f18fd200640 1 -- 172.21.15.59:0/2961508801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f809af80 msgr2=0x7f18f806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.942+0000 7f18fd200640 1 --2- 172.21.15.59:0/2961508801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f809af80 0x7f18f806d0f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f18f8072190 tx=0x7f18f001c450 comp rx=0 tx=0).stop 2024-05-30T16:49:51.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.942+0000 7f18fd200640 1 -- 172.21.15.59:0/2961508801 shutdown_connections 2024-05-30T16:49:51.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.942+0000 7f18fd200640 1 --2- 172.21.15.59:0/2961508801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f809af80 0x7f18f806d0f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.942+0000 7f18fd200640 1 --2- 172.21.15.59:0/2961508801 >> v2:172.21.15.107:3300/0 conn(0x7f18f80d05b0 0x7f18f809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.942+0000 7f18fd200640 1 -- 172.21.15.59:0/2961508801 >> 172.21.15.59:0/2961508801 conn(0x7f18f80b3f80 msgr2=0x7f18f80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:51.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.942+0000 7f18fd200640 1 -- 172.21.15.59:0/2961508801 shutdown_connections 2024-05-30T16:49:51.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.942+0000 7f18fd200640 1 -- 172.21.15.59:0/2961508801 wait complete. 2024-05-30T16:49:51.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18fd200640 1 Processor -- start 2024-05-30T16:49:51.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18fd200640 1 -- start start 2024-05-30T16:49:51.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18fd200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18f809af80 0x7f18f80b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18fd200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f80d05b0 0x7f18f80c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18fd200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18f80d14c0 0x7f18f80c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18fd200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f18f80d0b40 con 0x7f18f80d05b0 2024-05-30T16:49:51.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18fd200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f18f80d09c0 con 0x7f18f80d14c0 2024-05-30T16:49:51.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18fd200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f18f806de40 con 0x7f18f809af80 2024-05-30T16:49:51.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18ed400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f80d05b0 0x7f18f80c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18ed400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f80d05b0 0x7f18f80c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54984/0 (socket says 172.21.15.59:54984) 2024-05-30T16:49:51.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18ed400640 1 -- 172.21.15.59:0/969316132 learned_addr learned my addr 172.21.15.59:0/969316132 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:51.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18f5e00640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18f809af80 0x7f18f80b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18f6800640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18f80d14c0 0x7f18f80c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18ed400640 1 -- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18f809af80 msgr2=0x7f18f80b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18ed400640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18f809af80 0x7f18f80b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18ed400640 1 -- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18f80d14c0 msgr2=0x7f18f80c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18ed400640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18f80d14c0 0x7f18f80c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18ed400640 1 -- 172.21.15.59:0/969316132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f80b5d70 con 0x7f18f80d05b0 2024-05-30T16:49:51.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18ed400640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f80d05b0 0x7f18f80c5f80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f18e0007ef0 tx=0x7f18e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:51.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18eea00640 1 -- 172.21.15.59:0/969316132 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0014620 con 0x7f18f80d05b0 2024-05-30T16:49:51.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18eea00640 1 -- 172.21.15.59:0/969316132 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e0019070 con 0x7f18f80d05b0 2024-05-30T16:49:51.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18fd200640 1 -- 172.21.15.59:0/969316132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f80b6050 con 0x7f18f80d05b0 2024-05-30T16:49:51.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18eea00640 1 -- 172.21.15.59:0/969316132 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0014a00 con 0x7f18f80d05b0 2024-05-30T16:49:51.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.946+0000 7f18fd200640 1 -- 172.21.15.59:0/969316132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f80b6610 con 0x7f18f80d05b0 2024-05-30T16:49:51.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.950+0000 7f18fd200640 1 -- 172.21.15.59:0/969316132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f8068a90 con 0x7f18f80d05b0 2024-05-30T16:49:51.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.950+0000 7f18eea00640 1 -- 172.21.15.59:0/969316132 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18e0014ba0 con 0x7f18f80d05b0 2024-05-30T16:49:51.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.950+0000 7f18eea00640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f18d4068380 0x7f18d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.950+0000 7f18eea00640 1 -- 172.21.15.59:0/969316132 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f18e0087360 con 0x7f18f80d05b0 2024-05-30T16:49:51.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.950+0000 7f18f5e00640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f18d4068380 0x7f18d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.950+0000 7f18f5e00640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f18d4068380 0x7f18d406a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f18e8000f70 tx=0x7f18e8007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:51.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:51.954+0000 7f18eea00640 1 -- 172.21.15.59:0/969316132 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f18e0057880 con 0x7f18f80d05b0 2024-05-30T16:49:52.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 -- 172.21.15.59:0/969316132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18f80d2270 con 0x7f18f80d05b0 2024-05-30T16:49:52.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18eea00640 1 -- 172.21.15.59:0/969316132 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5184 (secure 0 0 0) 0x7f18e0057180 con 0x7f18f80d05b0 2024-05-30T16:49:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:52.163 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1119687744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1119687744},{"type":"v1","addr":"172.21.15.107:6836","nonce":1119687744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/985448024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":985448024},{"type":"v1","addr":"172.21.15.107:6837","nonce":985448024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4747,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1214274073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1214274073},{"type":"v1","addr":"172.21.15.59:6834","nonce":1214274073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:48.139853+0000","modified":"2024-05-30T16:49:51.161912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4803},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4803":{"gid":4803,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3713717108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3713717108},{"type":"v1","addr":"172.21.15.59:6835","nonce":3713717108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4803,"qdb_cluster":[4803]},"id":2}]} 2024-05-30T16:49:52.163 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 16 2024-05-30T16:49:52.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 -- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f18d4068380 msgr2=0x7f18d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f18d4068380 0x7f18d406a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f18e8000f70 tx=0x7f18e8007c10 comp rx=0 tx=0).stop 2024-05-30T16:49:52.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 -- 172.21.15.59:0/969316132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f80d05b0 msgr2=0x7f18f80c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f80d05b0 0x7f18f80c5f80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f18e0007ef0 tx=0x7f18e000e4b0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 -- 172.21.15.59:0/969316132 shutdown_connections 2024-05-30T16:49:52.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f18d4068380 0x7f18d406a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18f80d14c0 0x7f18f80c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f80d05b0 0x7f18f80c5f80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 --2- 172.21.15.59:0/969316132 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18f809af80 0x7f18f80b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 -- 172.21.15.59:0/969316132 >> 172.21.15.59:0/969316132 conn(0x7f18f80b3f80 msgr2=0x7f18f80aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:52.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 -- 172.21.15.59:0/969316132 shutdown_connections 2024-05-30T16:49:52.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.158+0000 7f18fd200640 1 -- 172.21.15.59:0/969316132 wait complete. 2024-05-30T16:49:52.184 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:52.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.318+0000 7f7fd7200640 1 Processor -- start 2024-05-30T16:49:52.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd7200640 1 -- start start 2024-05-30T16:49:52.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd7200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7fd815c420 0x7f7fd815c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd7200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7fd8067760 0x7f7fd80cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd7200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd8067d00 con 0x7f7fd80cea10 2024-05-30T16:49:52.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd7200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f7fd8070380 con 0x7f7fd815c420 2024-05-30T16:49:52.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd7200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7fd806e5b0 con 0x7f7fd8067760 2024-05-30T16:49:52.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd5e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7fd815c420 0x7f7fd815c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd6800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7fd80cea10 0x7f7fd80cedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39174/0 (socket says 172.21.15.59:39174) 2024-05-30T16:49:52.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd6800640 1 -- 172.21.15.59:0/142042592 learned_addr learned my addr 172.21.15.59:0/142042592 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:52.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fcfe00640 1 --2- 172.21.15.59:0/142042592 >> v2:172.21.15.107:3300/0 conn(0x7f7fd8067760 0x7f7fd80cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd5e00640 1 -- 172.21.15.59:0/142042592 >> v2:172.21.15.107:3300/0 conn(0x7f7fd8067760 msgr2=0x7f7fd80cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:52.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd5e00640 1 --2- 172.21.15.59:0/142042592 >> v2:172.21.15.107:3300/0 conn(0x7f7fd8067760 0x7f7fd80cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd5e00640 1 -- 172.21.15.59:0/142042592 >> v1:172.21.15.59:6789/0 conn(0x7f7fd80cea10 legacy=0x7f7fd80cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd5e00640 1 -- 172.21.15.59:0/142042592 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd806e890 con 0x7f7fd815c420 2024-05-30T16:49:52.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.322+0000 7f7fd5400640 1 -- 172.21.15.59:0/142042592 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255949288 0 0) 0x7f7fd8067d00 con 0x7f7fd80cea10 2024-05-30T16:49:52.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd5e00640 1 --2- 172.21.15.59:0/142042592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd815c420 0x7f7fd815c800 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80b07b0 tx=0x7f7fc801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e34f67b35728df7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:52.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd5400640 1 -- 172.21.15.59:0/142042592 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80b1070 con 0x7f7fd815c420 2024-05-30T16:49:52.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd5400640 1 -- 172.21.15.59:0/142042592 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc80ac620 con 0x7f7fd815c420 2024-05-30T16:49:52.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd5400640 1 -- 172.21.15.59:0/142042592 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80ac9f0 con 0x7f7fd815c420 2024-05-30T16:49:52.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd7200640 1 -- 172.21.15.59:0/142042592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd815c420 msgr2=0x7f7fd815c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd7200640 1 --2- 172.21.15.59:0/142042592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd815c420 0x7f7fd815c800 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80b07b0 tx=0x7f7fc801c3c0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd7200640 1 -- 172.21.15.59:0/142042592 shutdown_connections 2024-05-30T16:49:52.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd7200640 1 --2- 172.21.15.59:0/142042592 >> v2:172.21.15.107:3300/0 conn(0x7f7fd8067760 0x7f7fd80cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd7200640 1 --2- 172.21.15.59:0/142042592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd815c420 0x7f7fd815c800 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd7200640 1 -- 172.21.15.59:0/142042592 >> 172.21.15.59:0/142042592 conn(0x7f7fd80733a0 msgr2=0x7f7fd806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:52.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd7200640 1 -- 172.21.15.59:0/142042592 shutdown_connections 2024-05-30T16:49:52.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd7200640 1 -- 172.21.15.59:0/142042592 wait complete. 2024-05-30T16:49:52.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd7200640 1 Processor -- start 2024-05-30T16:49:52.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.326+0000 7f7fd7200640 1 -- start start 2024-05-30T16:49:52.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd8067760 0x7f7fd80aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fd80cea10 0x7f7fd80b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fd815c420 0x7f7fd80b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd806fd00 con 0x7f7fd8067760 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd806fb80 con 0x7f7fd815c420 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd806fe80 con 0x7f7fd80cea10 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd8067760 0x7f7fd80aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd8067760 0x7f7fd80aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55006/0 (socket says 172.21.15.59:55006) 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd5e00640 1 -- 172.21.15.59:0/1440335457 learned_addr learned my addr 172.21.15.59:0/1440335457 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd6800640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fd815c420 0x7f7fd80b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fcfe00640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fd80cea10 0x7f7fd80b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd5e00640 1 -- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fd80cea10 msgr2=0x7f7fd80b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd5e00640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fd80cea10 0x7f7fd80b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd5e00640 1 -- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fd815c420 msgr2=0x7f7fd80b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd5e00640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fd815c420 0x7f7fd80b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd5e00640 1 -- 172.21.15.59:0/1440335457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd8154b70 con 0x7f7fd8067760 2024-05-30T16:49:52.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd6800640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fd815c420 0x7f7fd80b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:52.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd5e00640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd8067760 0x7f7fd80aeb80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80af040 tx=0x7f7fc801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:52.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fce000640 1 -- 172.21.15.59:0/1440335457 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80bd070 con 0x7f7fd8067760 2024-05-30T16:49:52.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fce000640 1 -- 172.21.15.59:0/1440335457 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc80b2040 con 0x7f7fd8067760 2024-05-30T16:49:52.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd7200640 1 -- 172.21.15.59:0/1440335457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd8154e50 con 0x7f7fd8067760 2024-05-30T16:49:52.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fce000640 1 -- 172.21.15.59:0/1440335457 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80b1050 con 0x7f7fd8067760 2024-05-30T16:49:52.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd7200640 1 -- 172.21.15.59:0/1440335457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd8155410 con 0x7f7fd8067760 2024-05-30T16:49:52.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fd7200640 1 -- 172.21.15.59:0/1440335457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd80691a0 con 0x7f7fd8067760 2024-05-30T16:49:52.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.330+0000 7f7fce000640 1 -- 172.21.15.59:0/1440335457 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7fc80c0070 con 0x7f7fd8067760 2024-05-30T16:49:52.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.334+0000 7f7fce000640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7fb4068380 0x7f7fb406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.334+0000 7f7fce000640 1 -- 172.21.15.59:0/1440335457 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7fc8120580 con 0x7f7fd8067760 2024-05-30T16:49:52.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.334+0000 7f7fcfe00640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7fb4068380 0x7f7fb406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.334+0000 7f7fcfe00640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7fb4068380 0x7f7fb406a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8153440 tx=0x7f7fc0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:52.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.338+0000 7f7fce000640 1 -- 172.21.15.59:0/1440335457 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7fc8016070 con 0x7f7fd8067760 2024-05-30T16:49:52.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.502+0000 7f7fd7200640 1 -- 172.21.15.59:0/1440335457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fd8158660 con 0x7f7fd8067760 2024-05-30T16:49:52.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fce000640 1 -- 172.21.15.59:0/1440335457 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16657 (secure 0 0 0) 0x7f7fc80f0aa0 con 0x7f7fd8067760 2024-05-30T16:49:52.510 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:52.511 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":34,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:49:49.752711+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:45.836560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:47.111349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:52.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fd7200640 1 -- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7fb4068380 msgr2=0x7f7fb406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fd7200640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7fb4068380 0x7f7fb406a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8153440 tx=0x7f7fc0008040 comp rx=0 tx=0).stop 2024-05-30T16:49:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fd7200640 1 -- 172.21.15.59:0/1440335457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd8067760 msgr2=0x7f7fd80aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fd7200640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd8067760 0x7f7fd80aeb80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80af040 tx=0x7f7fc801ac00 comp rx=0 tx=0).stop 2024-05-30T16:49:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fd7200640 1 -- 172.21.15.59:0/1440335457 shutdown_connections 2024-05-30T16:49:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fd7200640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7fb4068380 0x7f7fb406a840 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fd7200640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fd815c420 0x7f7fd80b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fd7200640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fd80cea10 0x7f7fd80b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fd7200640 1 --2- 172.21.15.59:0/1440335457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd8067760 0x7f7fd80aeb80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fd7200640 1 -- 172.21.15.59:0/1440335457 >> 172.21.15.59:0/1440335457 conn(0x7f7fd80733a0 msgr2=0x7f7fd806c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fd7200640 1 -- 172.21.15.59:0/1440335457 shutdown_connections 2024-05-30T16:49:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.506+0000 7f7fd7200640 1 -- 172.21.15.59:0/1440335457 wait complete. 2024-05-30T16:49:52.532 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:49:52.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:49:52.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.666+0000 7f12eb200640 1 Processor -- start 2024-05-30T16:49:52.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.666+0000 7f12eb200640 1 -- start start 2024-05-30T16:49:52.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.666+0000 7f12eb200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f12e40b4510 0x7f12e41630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.666+0000 7f12eb200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12e4072d00 0x7f12e4073170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.666+0000 7f12eb200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12e415fbe0 con 0x7f12e40b48f0 2024-05-30T16:49:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.666+0000 7f12eb200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f12e41635f0 con 0x7f12e4072d00 2024-05-30T16:49:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.666+0000 7f12eb200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f12e40736b0 con 0x7f12e40b4510 2024-05-30T16:49:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e9200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12e4072d00 0x7f12e4073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e9200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12e4072d00 0x7f12e4073170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55022/0 (socket says 172.21.15.59:55022) 2024-05-30T16:49:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e9200640 1 -- 172.21.15.59:0/2790036743 learned_addr learned my addr 172.21.15.59:0/2790036743 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e3e00640 1 --2- 172.21.15.59:0/2790036743 >> v2:172.21.15.107:3300/0 conn(0x7f12e40b4510 0x7f12e41630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e9200640 1 -- 172.21.15.59:0/2790036743 >> v2:172.21.15.107:3300/0 conn(0x7f12e40b4510 msgr2=0x7f12e41630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e9200640 1 --2- 172.21.15.59:0/2790036743 >> v2:172.21.15.107:3300/0 conn(0x7f12e40b4510 0x7f12e41630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e9200640 1 -- 172.21.15.59:0/2790036743 >> v1:172.21.15.107:6789/0 conn(0x7f12e40b48f0 legacy=0x7f12e415f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e9200640 1 -- 172.21.15.59:0/2790036743 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e415fec0 con 0x7f12e4072d00 2024-05-30T16:49:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e3e00640 1 --2- 172.21.15.59:0/2790036743 >> v2:172.21.15.107:3300/0 conn(0x7f12e40b4510 0x7f12e41630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:52.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e9200640 1 --2- 172.21.15.59:0/2790036743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4072d00 0x7f12e4073170 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f12e4073850 tx=0x7f12dc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ade4c944572e01c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:52.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e3400640 1 -- 172.21.15.59:0/2790036743 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0a57a0 con 0x7f12e4072d00 2024-05-30T16:49:52.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e3400640 1 -- 172.21.15.59:0/2790036743 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12dc0a5940 con 0x7f12e4072d00 2024-05-30T16:49:52.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.670+0000 7f12e3400640 1 -- 172.21.15.59:0/2790036743 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0a5d10 con 0x7f12e4072d00 2024-05-30T16:49:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 -- 172.21.15.59:0/2790036743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4072d00 msgr2=0x7f12e4073170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 --2- 172.21.15.59:0/2790036743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4072d00 0x7f12e4073170 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f12e4073850 tx=0x7f12dc01c9f0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 -- 172.21.15.59:0/2790036743 shutdown_connections 2024-05-30T16:49:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 --2- 172.21.15.59:0/2790036743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4072d00 0x7f12e4073170 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 --2- 172.21.15.59:0/2790036743 >> v2:172.21.15.107:3300/0 conn(0x7f12e40b4510 0x7f12e41630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 -- 172.21.15.59:0/2790036743 >> 172.21.15.59:0/2790036743 conn(0x7f12e40b3240 msgr2=0x7f12e40725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 -- 172.21.15.59:0/2790036743 shutdown_connections 2024-05-30T16:49:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 -- 172.21.15.59:0/2790036743 wait complete. 2024-05-30T16:49:52.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 Processor -- start 2024-05-30T16:49:52.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 -- start start 2024-05-30T16:49:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4072d00 0x7f12e415bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12e40b4510 0x7f12e415c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12e40b48f0 0x7f12e4151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f12e415f940 con 0x7f12e4072d00 2024-05-30T16:49:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f12e415f7c0 con 0x7f12e40b48f0 2024-05-30T16:49:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12eb200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f12e406ee60 con 0x7f12e40b4510 2024-05-30T16:49:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12e3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4072d00 0x7f12e415bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12e3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4072d00 0x7f12e415bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55026/0 (socket says 172.21.15.59:55026) 2024-05-30T16:49:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12e3e00640 1 -- 172.21.15.59:0/1185457384 learned_addr learned my addr 172.21.15.59:0/1185457384 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12e9200640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12e40b48f0 0x7f12e4151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12dbe00640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12e40b4510 0x7f12e415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12e3e00640 1 -- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12e40b4510 msgr2=0x7f12e415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12e3e00640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12e40b4510 0x7f12e415c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12e3e00640 1 -- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12e40b48f0 msgr2=0x7f12e4151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12e3e00640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12e40b48f0 0x7f12e4151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12e3e00640 1 -- 172.21.15.59:0/1185457384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e4153bd0 con 0x7f12e4072d00 2024-05-30T16:49:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12e9200640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12e40b48f0 0x7f12e4151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12dbe00640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12e40b4510 0x7f12e415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.674+0000 7f12e3e00640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4072d00 0x7f12e415bad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f12d400e810 tx=0x7f12d400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.678+0000 7f12e0c00640 1 -- 172.21.15.59:0/1185457384 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4017070 con 0x7f12e4072d00 2024-05-30T16:49:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.678+0000 7f12e0c00640 1 -- 172.21.15.59:0/1185457384 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d400c8d0 con 0x7f12e4072d00 2024-05-30T16:49:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.678+0000 7f12e0c00640 1 -- 172.21.15.59:0/1185457384 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d400f040 con 0x7f12e4072d00 2024-05-30T16:49:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.678+0000 7f12eb200640 1 -- 172.21.15.59:0/1185457384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e4153eb0 con 0x7f12e4072d00 2024-05-30T16:49:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.678+0000 7f12eb200640 1 -- 172.21.15.59:0/1185457384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e4155cd0 con 0x7f12e4072d00 2024-05-30T16:49:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.678+0000 7f12eb200640 1 -- 172.21.15.59:0/1185457384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e4068a90 con 0x7f12e4072d00 2024-05-30T16:49:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.678+0000 7f12e0c00640 1 -- 172.21.15.59:0/1185457384 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12d401a070 con 0x7f12e4072d00 2024-05-30T16:49:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.678+0000 7f12e0c00640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12c0068380 0x7f12c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.678+0000 7f12e0c00640 1 -- 172.21.15.59:0/1185457384 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f12d4086620 con 0x7f12e4072d00 2024-05-30T16:49:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.678+0000 7f12dbe00640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12c0068380 0x7f12c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.682+0000 7f12dbe00640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12c0068380 0x7f12c006a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f12e4152f20 tx=0x7f12cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.682+0000 7f12e0c00640 1 -- 172.21.15.59:0/1185457384 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12d4056bd0 con 0x7f12e4072d00 2024-05-30T16:49:52.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.846+0000 7f12eb200640 1 -- 172.21.15.59:0/1185457384 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12e4153980 con 0x7f12c0068380 2024-05-30T16:49:52.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12e0c00640 1 -- 172.21.15.59:0/1185457384 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239390 (secure 0 0 0) 0x7f12e4153980 con 0x7f12c0068380 2024-05-30T16:49:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:52.861 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:49:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12eb200640 1 -- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12c0068380 msgr2=0x7f12c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12eb200640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12c0068380 0x7f12c006a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f12e4152f20 tx=0x7f12cc009040 comp rx=0 tx=0).stop 2024-05-30T16:49:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12eb200640 1 -- 172.21.15.59:0/1185457384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4072d00 msgr2=0x7f12e415bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12eb200640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4072d00 0x7f12e415bad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f12d400e810 tx=0x7f12d400ecd0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12eb200640 1 -- 172.21.15.59:0/1185457384 shutdown_connections 2024-05-30T16:49:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12eb200640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12c0068380 0x7f12c006a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12eb200640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12e40b48f0 0x7f12e4151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12eb200640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12e40b4510 0x7f12e415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12eb200640 1 --2- 172.21.15.59:0/1185457384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4072d00 0x7f12e415bad0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12eb200640 1 -- 172.21.15.59:0/1185457384 >> 172.21.15.59:0/1185457384 conn(0x7f12e40b3240 msgr2=0x7f12e40b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12eb200640 1 -- 172.21.15.59:0/1185457384 shutdown_connections 2024-05-30T16:49:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:52.854+0000 7f12eb200640 1 -- 172.21.15.59:0/1185457384 wait complete. 2024-05-30T16:49:52.882 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-05-30T16:49:51.086397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":52,"acting":52,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219944,"kb_used_data":3720,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3809280,"data_stored":2132640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.352364"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.741447+0000","last_change":"2024-05-30T16:49:46.741447+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.741447+0000","last_undegraded":"2024-05-30T16:49:46.741447+0000","last_fullsized":"2024-05-30T16:49:46.741447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.740887+0000","last_change":"2024-05-30T16:49:46.740887+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.740887+0000","last_undegraded":"2024-05-30T16:49:46.740887+0000","last_fullsized":"2024-05-30T16:49:46.740887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:46.728372+0000","last_change":"2024-05-30T16:49:46.728372+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.728372+0000","last_undegraded":"2024-05-30T16:49:46.728372+0000","last_fullsized":"2024-05-30T16:49:46.728372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.744974+0000","last_change":"2024-05-30T16:49:46.744974+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.744974+0000","last_undegraded":"2024-05-30T16:49:46.744974+0000","last_fullsized":"2024-05-30T16:49:46.744974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.737992+0000","last_change":"2024-05-30T16:49:46.737992+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.737992+0000","last_undegraded":"2024-05-30T16:49:46.737992+0000","last_fullsized":"2024-05-30T16:49:46.737992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.736256+0000","last_change":"2024-05-30T16:49:46.736256+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.736256+0000","last_undegraded":"2024-05-30T16:49:46.736256+0000","last_fullsized":"2024-05-30T16:49:46.736256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:46.728372+0000","last_change":"2024-05-30T16:49:46.728372+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.728372+0000","last_undegraded":"2024-05-30T16:49:46.728372+0000","last_fullsized":"2024-05-30T16:49:46.728372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.736159+0000","last_change":"2024-05-30T16:49:46.736159+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.736159+0000","last_undegraded":"2024-05-30T16:49:46.736159+0000","last_fullsized":"2024-05-30T16:49:46.736159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:46.728372+0000","last_change":"2024-05-30T16:49:46.728372+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.728372+0000","last_undegraded":"2024-05-30T16:49:46.728372+0000","last_fullsized":"2024-05-30T16:49:46.728372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.740344+0000","last_change":"2024-05-30T16:49:46.740344+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.740344+0000","last_undegraded":"2024-05-30T16:49:46.740344+0000","last_fullsized":"2024-05-30T16:49:46.740344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.736023+0000","last_change":"2024-05-30T16:49:46.736023+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.736023+0000","last_undegraded":"2024-05-30T16:49:46.736023+0000","last_fullsized":"2024-05-30T16:49:46.736023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:46.728372+0000","last_change":"2024-05-30T16:49:46.728372+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.728372+0000","last_undegraded":"2024-05-30T16:49:46.728372+0000","last_fullsized":"2024-05-30T16:49:46.728372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.736212+0000","last_change":"2024-05-30T16:49:46.736212+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.736212+0000","last_undegraded":"2024-05-30T16:49:46.736212+0000","last_fullsized":"2024-05-30T16:49:46.736212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.742277+0000","last_change":"2024-05-30T16:49:46.742277+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.742277+0000","last_undegraded":"2024-05-30T16:49:46.742277+0000","last_fullsized":"2024-05-30T16:49:46.742277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:46.728372+0000","last_change":"2024-05-30T16:49:46.728372+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.728372+0000","last_undegraded":"2024-05-30T16:49:46.728372+0000","last_fullsized":"2024-05-30T16:49:46.728372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:46.728372+0000","last_change":"2024-05-30T16:49:46.728372+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.728372+0000","last_undegraded":"2024-05-30T16:49:46.728372+0000","last_fullsized":"2024-05-30T16:49:46.728372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.742722+0000","last_change":"2024-05-30T16:49:46.742722+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.742722+0000","last_undegraded":"2024-05-30T16:49:46.742722+0000","last_fullsized":"2024-05-30T16:49:46.742722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.737229+0000","last_change":"2024-05-30T16:49:46.737229+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.737229+0000","last_undegraded":"2024-05-30T16:49:46.737229+0000","last_fullsized":"2024-05-30T16:49:46.737229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.737976+0000","last_change":"2024-05-30T16:49:46.737976+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.737976+0000","last_undegraded":"2024-05-30T16:49:46.737976+0000","last_fullsized":"2024-05-30T16:49:46.737976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.736486+0000","last_change":"2024-05-30T16:49:46.736486+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.736486+0000","last_undegraded":"2024-05-30T16:49:46.736486+0000","last_fullsized":"2024-05-30T16:49:46.736486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.740401+0000","last_change":"2024-05-30T16:49:46.740401+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.740401+0000","last_undegraded":"2024-05-30T16:49:46.740401+0000","last_fullsized":"2024-05-30T16:49:46.740401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.741565+0000","last_change":"2024-05-30T16:49:46.741565+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.741565+0000","last_undegraded":"2024-05-30T16:49:46.741565+0000","last_fullsized":"2024-05-30T16:49:46.741565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.737267+0000","last_change":"2024-05-30T16:49:46.737267+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.737267+0000","last_undegraded":"2024-05-30T16:49:46.737267+0000","last_fullsized":"2024-05-30T16:49:46.737267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.736709+0000","last_change":"2024-05-30T16:49:46.736709+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.736709+0000","last_undegraded":"2024-05-30T16:49:46.736709+0000","last_fullsized":"2024-05-30T16:49:46.736709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.742155+0000","last_change":"2024-05-30T16:49:46.742155+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.742155+0000","last_undegraded":"2024-05-30T16:49:46.742155+0000","last_fullsized":"2024-05-30T16:49:46.742155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.738892+0000","last_change":"2024-05-30T16:49:46.738892+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.738892+0000","last_undegraded":"2024-05-30T16:49:46.738892+0000","last_fullsized":"2024-05-30T16:49:46.738892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.742019+0000","last_change":"2024-05-30T16:49:46.742019+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.742019+0000","last_undegraded":"2024-05-30T16:49:46.742019+0000","last_fullsized":"2024-05-30T16:49:46.742019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.738903+0000","last_change":"2024-05-30T16:49:46.738903+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.738903+0000","last_undegraded":"2024-05-30T16:49:46.738903+0000","last_fullsized":"2024-05-30T16:49:46.738903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.741732+0000","last_change":"2024-05-30T16:49:46.741732+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.741732+0000","last_undegraded":"2024-05-30T16:49:46.741732+0000","last_fullsized":"2024-05-30T16:49:46.741732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.736696+0000","last_change":"2024-05-30T16:49:46.736696+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.736696+0000","last_undegraded":"2024-05-30T16:49:46.736696+0000","last_fullsized":"2024-05-30T16:49:46.736696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:46.728372+0000","last_change":"2024-05-30T16:49:46.728372+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.728372+0000","last_undegraded":"2024-05-30T16:49:46.728372+0000","last_fullsized":"2024-05-30T16:49:46.728372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:49:47.732928+0000","last_change":"2024-05-30T16:49:47.732928+0000","last_active":"2024-05-30T16:49:47.732928+0000","last_peered":"2024-05-30T16:49:47.732928+0000","last_clean":"2024-05-30T16:49:47.732928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:47.732928+0000","last_undegraded":"2024-05-30T16:49:47.732928+0000","last_fullsized":"2024-05-30T16:49:47.732928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-30T16:49:46.741591+0000","last_change":"2024-05-30T16:49:46.741591+0000","last_active":"2024-05-30T16:49:46.728372+0000","last_peered":"2024-05-30T16:49:46.728372+0000","last_clean":"2024-05-30T16:49:46.728372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:49:46.741591+0000","last_undegraded":"2024-05-30T16:49:46.741591+0000","last_fullsized":"2024-05-30T16:49:46.741591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":184,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:49:46.741149+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:49:46.741149+0000","last_peered":"2024-05-30T16:49:46.741149+0000","last_clean":"2024-05-30T16:49:46.741149+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:49:46.741149+0000","last_undegraded":"2024-05-30T16:49:46.741149+0000","last_fullsized":"2024-05-30T16:49:46.741149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":50,"acting":50,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":709356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":118988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":118988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":118988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":118988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":118988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":709356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":118988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:49:52.886 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:49:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f0176000640 1 Processor -- start 2024-05-30T16:49:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f0176000640 1 -- start start 2024-05-30T16:49:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f0176000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0170159df0 0x7f01700ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f0176000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017015d730 con 0x7f01700b3e50 2024-05-30T16:49:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f0176000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01700b3370 con 0x7f017015a1d0 2024-05-30T16:49:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f0176000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f01700b3650 con 0x7f0170159df0 2024-05-30T16:49:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f016f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0170159df0 0x7f01700ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f016fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f01700b3e50 0x7f017015db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39176/0 (socket says 172.21.15.59:39176) 2024-05-30T16:49:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f016f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0170159df0 0x7f01700ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55030/0 (socket says 172.21.15.59:55030) 2024-05-30T16:49:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f016fe00640 1 -- 172.21.15.59:0/1177651252 learned_addr learned my addr 172.21.15.59:0/1177651252 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f016f400640 1 -- 172.21.15.59:0/1177651252 >> v1:172.21.15.107:6789/0 conn(0x7f017015a1d0 legacy=0x7f017015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f016f400640 1 -- 172.21.15.59:0/1177651252 >> v1:172.21.15.59:6789/0 conn(0x7f01700b3e50 legacy=0x7f017015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f016f400640 1 -- 172.21.15.59:0/1177651252 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01700b3930 con 0x7f0170159df0 2024-05-30T16:49:53.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.062+0000 7f016ea00640 1 -- 172.21.15.59:0/1177651252 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4119653267 0 0) 0x7f017015d730 con 0x7f01700b3e50 2024-05-30T16:49:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.066+0000 7f016f400640 1 --2- 172.21.15.59:0/1177651252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0170159df0 0x7f01700ad1b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f01600097c0 tx=0x7f016001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fccb230505cb291 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.066+0000 7f016ea00640 1 -- 172.21.15.59:0/1177651252 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01600b0070 con 0x7f0170159df0 2024-05-30T16:49:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.066+0000 7f016ea00640 1 -- 172.21.15.59:0/1177651252 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01600ab600 con 0x7f0170159df0 2024-05-30T16:49:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.066+0000 7f016ea00640 1 -- 172.21.15.59:0/1177651252 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01600ab9d0 con 0x7f0170159df0 2024-05-30T16:49:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.066+0000 7f0176000640 1 -- 172.21.15.59:0/1177651252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0170159df0 msgr2=0x7f01700ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.066+0000 7f0176000640 1 --2- 172.21.15.59:0/1177651252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0170159df0 0x7f01700ad1b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f01600097c0 tx=0x7f016001c4a0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.066+0000 7f0176000640 1 -- 172.21.15.59:0/1177651252 shutdown_connections 2024-05-30T16:49:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.066+0000 7f0176000640 1 --2- 172.21.15.59:0/1177651252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0170159df0 0x7f01700ad1b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.066+0000 7f0176000640 1 -- 172.21.15.59:0/1177651252 >> 172.21.15.59:0/1177651252 conn(0x7f01700b22d0 msgr2=0x7f01700b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.066+0000 7f0176000640 1 -- 172.21.15.59:0/1177651252 shutdown_connections 2024-05-30T16:49:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.066+0000 7f0176000640 1 -- 172.21.15.59:0/1177651252 wait complete. 2024-05-30T16:49:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0176000640 1 Processor -- start 2024-05-30T16:49:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0176000640 1 -- start start 2024-05-30T16:49:53.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0176000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b3e50 0x7f0170071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0176000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0170159df0 0x7f017015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0176000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f017015a1d0 0x7f017015be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0176000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f017016a7a0 con 0x7f01700b3e50 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0176000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f017016a620 con 0x7f0170159df0 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0176000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f017016a920 con 0x7f017015a1d0 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f016f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b3e50 0x7f0170071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f016f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b3e50 0x7f0170071d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55040/0 (socket says 172.21.15.59:55040) 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f016f400640 1 -- 172.21.15.59:0/932068687 learned_addr learned my addr 172.21.15.59:0/932068687 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0167e00640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0170159df0 0x7f017015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f016fe00640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f017015a1d0 0x7f017015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f016f400640 1 -- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f017015a1d0 msgr2=0x7f017015be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f016f400640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f017015a1d0 0x7f017015be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f016f400640 1 -- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0170159df0 msgr2=0x7f017015b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f016f400640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0170159df0 0x7f017015b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f016f400640 1 -- 172.21.15.59:0/932068687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0170072580 con 0x7f01700b3e50 2024-05-30T16:49:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f016f400640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b3e50 0x7f0170071d30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f01600ae040 tx=0x7f016001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0167400640 1 -- 172.21.15.59:0/932068687 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01600b0050 con 0x7f01700b3e50 2024-05-30T16:49:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0167400640 1 -- 172.21.15.59:0/932068687 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01600bc070 con 0x7f01700b3e50 2024-05-30T16:49:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0167400640 1 -- 172.21.15.59:0/932068687 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01600aae20 con 0x7f01700b3e50 2024-05-30T16:49:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0176000640 1 -- 172.21.15.59:0/932068687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0170072860 con 0x7f01700b3e50 2024-05-30T16:49:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0176000640 1 -- 172.21.15.59:0/932068687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0170072e20 con 0x7f01700b3e50 2024-05-30T16:49:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.070+0000 7f0176000640 1 -- 172.21.15.59:0/932068687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0170073150 con 0x7f01700b3e50 2024-05-30T16:49:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.074+0000 7f0167400640 1 -- 172.21.15.59:0/932068687 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01600ab440 con 0x7f01700b3e50 2024-05-30T16:49:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.074+0000 7f0167400640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f014c068380 0x7f014c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.074+0000 7f0167400640 1 -- 172.21.15.59:0/932068687 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f01601215d0 con 0x7f01700b3e50 2024-05-30T16:49:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.074+0000 7f0167e00640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f014c068380 0x7f014c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.074+0000 7f0167e00640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f014c068380 0x7f014c06a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f01701592b0 tx=0x7f0158009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.078+0000 7f0167400640 1 -- 172.21.15.59:0/932068687 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01700adb00 con 0x7f01700b3e50 2024-05-30T16:49:53.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.238+0000 7f0176000640 1 -- 172.21.15.59:0/932068687 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0170068a90 con 0x7f014c068380 2024-05-30T16:49:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.246+0000 7f0167400640 1 -- 172.21.15.59:0/932068687 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251940 (secure 0 0 0) 0x7f0170068a90 con 0x7f014c068380 2024-05-30T16:49:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:53.255 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:49:53.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.250+0000 7f0176000640 1 -- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f014c068380 msgr2=0x7f014c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.250+0000 7f0176000640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f014c068380 0x7f014c06a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f01701592b0 tx=0x7f0158009040 comp rx=0 tx=0).stop 2024-05-30T16:49:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.250+0000 7f0176000640 1 -- 172.21.15.59:0/932068687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b3e50 msgr2=0x7f0170071d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.250+0000 7f0176000640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b3e50 0x7f0170071d30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f01600ae040 tx=0x7f016001ace0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.250+0000 7f0176000640 1 -- 172.21.15.59:0/932068687 shutdown_connections 2024-05-30T16:49:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.250+0000 7f0176000640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f014c068380 0x7f014c06a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.250+0000 7f0176000640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f017015a1d0 0x7f017015be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.250+0000 7f0176000640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0170159df0 0x7f017015b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.250+0000 7f0176000640 1 --2- 172.21.15.59:0/932068687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b3e50 0x7f0170071d30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.250+0000 7f0176000640 1 -- 172.21.15.59:0/932068687 >> 172.21.15.59:0/932068687 conn(0x7f01700b22d0 msgr2=0x7f01700cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.250+0000 7f0176000640 1 -- 172.21.15.59:0/932068687 shutdown_connections 2024-05-30T16:49:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.250+0000 7f0176000640 1 -- 172.21.15.59:0/932068687 wait complete. 2024-05-30T16:49:53.266 INFO:tasks.ceph.mds.c.smithi059.stderr:2024-05-30T16:49:53.262+0000 7fb5df600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:49:53.275 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-05-30T16:49:53.086745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220348,"kb_used_data":4156,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754372,"statfs":{"total":773094113280,"available":772868476928,"internally_reserved":0,"allocated":4255744,"data_stored":2332432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001542"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259772+0000","last_change":"2024-05-30T16:49:48.768209+0000","last_active":"2024-05-30T16:49:51.259772+0000","last_peered":"2024-05-30T16:49:51.259772+0000","last_clean":"2024-05-30T16:49:51.259772+0000","last_became_active":"2024-05-30T16:49:48.767956+0000","last_became_peered":"2024-05-30T16:49:48.767956+0000","last_unstale":"2024-05-30T16:49:51.259772+0000","last_undegraded":"2024-05-30T16:49:51.259772+0000","last_fullsized":"2024-05-30T16:49:51.259772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:24.334469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.765331+0000","last_change":"2024-05-30T16:49:48.758506+0000","last_active":"2024-05-30T16:49:48.765331+0000","last_peered":"2024-05-30T16:49:48.765331+0000","last_clean":"2024-05-30T16:49:48.765331+0000","last_became_active":"2024-05-30T16:49:48.758231+0000","last_became_peered":"2024-05-30T16:49:48.758231+0000","last_unstale":"2024-05-30T16:49:48.765331+0000","last_undegraded":"2024-05-30T16:49:48.765331+0000","last_fullsized":"2024-05-30T16:49:48.765331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:22:01.570450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.763683+0000","last_change":"2024-05-30T16:49:48.778372+0000","last_active":"2024-05-30T16:49:49.763683+0000","last_peered":"2024-05-30T16:49:49.763683+0000","last_clean":"2024-05-30T16:49:49.763683+0000","last_became_active":"2024-05-30T16:49:48.777276+0000","last_became_peered":"2024-05-30T16:49:48.777276+0000","last_unstale":"2024-05-30T16:49:49.763683+0000","last_undegraded":"2024-05-30T16:49:49.763683+0000","last_fullsized":"2024-05-30T16:49:49.763683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:00:26.774209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.756030+0000","last_change":"2024-05-30T16:49:48.773399+0000","last_active":"2024-05-30T16:49:50.756030+0000","last_peered":"2024-05-30T16:49:50.756030+0000","last_clean":"2024-05-30T16:49:50.756030+0000","last_became_active":"2024-05-30T16:49:48.771056+0000","last_became_peered":"2024-05-30T16:49:48.771056+0000","last_unstale":"2024-05-30T16:49:50.756030+0000","last_undegraded":"2024-05-30T16:49:50.756030+0000","last_fullsized":"2024-05-30T16:49:50.756030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:59:50.201533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259253+0000","last_change":"2024-05-30T16:49:48.765331+0000","last_active":"2024-05-30T16:49:51.259253+0000","last_peered":"2024-05-30T16:49:51.259253+0000","last_clean":"2024-05-30T16:49:51.259253+0000","last_became_active":"2024-05-30T16:49:48.765046+0000","last_became_peered":"2024-05-30T16:49:48.765046+0000","last_unstale":"2024-05-30T16:49:51.259253+0000","last_undegraded":"2024-05-30T16:49:51.259253+0000","last_fullsized":"2024-05-30T16:49:51.259253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:58.300315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.763045+0000","last_change":"2024-05-30T16:49:48.756318+0000","last_active":"2024-05-30T16:49:48.763045+0000","last_peered":"2024-05-30T16:49:48.763045+0000","last_clean":"2024-05-30T16:49:48.763045+0000","last_became_active":"2024-05-30T16:49:48.756043+0000","last_became_peered":"2024-05-30T16:49:48.756043+0000","last_unstale":"2024-05-30T16:49:48.763045+0000","last_undegraded":"2024-05-30T16:49:48.763045+0000","last_fullsized":"2024-05-30T16:49:48.763045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:19.414855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.580134+0000","last_change":"2024-05-30T16:49:48.769321+0000","last_active":"2024-05-30T16:49:50.580134+0000","last_peered":"2024-05-30T16:49:50.580134+0000","last_clean":"2024-05-30T16:49:50.580134+0000","last_became_active":"2024-05-30T16:49:48.768854+0000","last_became_peered":"2024-05-30T16:49:48.768854+0000","last_unstale":"2024-05-30T16:49:50.580134+0000","last_undegraded":"2024-05-30T16:49:50.580134+0000","last_fullsized":"2024-05-30T16:49:50.580134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:32:34.119568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.579956+0000","last_change":"2024-05-30T16:49:48.769786+0000","last_active":"2024-05-30T16:49:50.579956+0000","last_peered":"2024-05-30T16:49:50.579956+0000","last_clean":"2024-05-30T16:49:50.579956+0000","last_became_active":"2024-05-30T16:49:48.766379+0000","last_became_peered":"2024-05-30T16:49:48.766379+0000","last_unstale":"2024-05-30T16:49:50.579956+0000","last_undegraded":"2024-05-30T16:49:50.579956+0000","last_fullsized":"2024-05-30T16:49:50.579956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:20.039272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.765303+0000","last_change":"2024-05-30T16:49:48.774578+0000","last_active":"2024-05-30T16:49:49.765303+0000","last_peered":"2024-05-30T16:49:49.765303+0000","last_clean":"2024-05-30T16:49:49.765303+0000","last_became_active":"2024-05-30T16:49:48.774256+0000","last_became_peered":"2024-05-30T16:49:48.774256+0000","last_unstale":"2024-05-30T16:49:49.765303+0000","last_undegraded":"2024-05-30T16:49:49.765303+0000","last_fullsized":"2024-05-30T16:49:49.765303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:19:20.274679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.756146+0000","last_change":"2024-05-30T16:49:48.779171+0000","last_active":"2024-05-30T16:49:50.756146+0000","last_peered":"2024-05-30T16:49:50.756146+0000","last_clean":"2024-05-30T16:49:50.756146+0000","last_became_active":"2024-05-30T16:49:48.778872+0000","last_became_peered":"2024-05-30T16:49:48.778872+0000","last_unstale":"2024-05-30T16:49:50.756146+0000","last_undegraded":"2024-05-30T16:49:50.756146+0000","last_fullsized":"2024-05-30T16:49:50.756146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:38:17.594200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.579999+0000","last_change":"2024-05-30T16:49:48.778100+0000","last_active":"2024-05-30T16:49:50.579999+0000","last_peered":"2024-05-30T16:49:50.579999+0000","last_clean":"2024-05-30T16:49:50.579999+0000","last_became_active":"2024-05-30T16:49:48.777796+0000","last_became_peered":"2024-05-30T16:49:48.777796+0000","last_unstale":"2024-05-30T16:49:50.579999+0000","last_undegraded":"2024-05-30T16:49:50.579999+0000","last_fullsized":"2024-05-30T16:49:50.579999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:19:38.537282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.763578+0000","last_change":"2024-05-30T16:49:48.759208+0000","last_active":"2024-05-30T16:49:49.763578+0000","last_peered":"2024-05-30T16:49:49.763578+0000","last_clean":"2024-05-30T16:49:49.763578+0000","last_became_active":"2024-05-30T16:49:48.757266+0000","last_became_peered":"2024-05-30T16:49:48.757266+0000","last_unstale":"2024-05-30T16:49:49.763578+0000","last_undegraded":"2024-05-30T16:49:49.763578+0000","last_fullsized":"2024-05-30T16:49:49.763578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:31:49.647657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259137+0000","last_change":"2024-05-30T16:49:48.777371+0000","last_active":"2024-05-30T16:49:51.259137+0000","last_peered":"2024-05-30T16:49:51.259137+0000","last_clean":"2024-05-30T16:49:51.259137+0000","last_became_active":"2024-05-30T16:49:48.777174+0000","last_became_peered":"2024-05-30T16:49:48.777174+0000","last_unstale":"2024-05-30T16:49:51.259137+0000","last_undegraded":"2024-05-30T16:49:51.259137+0000","last_fullsized":"2024-05-30T16:49:51.259137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:59:38.823017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.776946+0000","last_change":"2024-05-30T16:49:48.764144+0000","last_active":"2024-05-30T16:49:48.776946+0000","last_peered":"2024-05-30T16:49:48.776946+0000","last_clean":"2024-05-30T16:49:48.776946+0000","last_became_active":"2024-05-30T16:49:48.763818+0000","last_became_peered":"2024-05-30T16:49:48.763818+0000","last_unstale":"2024-05-30T16:49:48.776946+0000","last_undegraded":"2024-05-30T16:49:48.776946+0000","last_fullsized":"2024-05-30T16:49:48.776946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:07.983224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764568+0000","last_change":"2024-05-30T16:49:48.767046+0000","last_active":"2024-05-30T16:49:49.764568+0000","last_peered":"2024-05-30T16:49:49.764568+0000","last_clean":"2024-05-30T16:49:49.764568+0000","last_became_active":"2024-05-30T16:49:48.766799+0000","last_became_peered":"2024-05-30T16:49:48.766799+0000","last_unstale":"2024-05-30T16:49:49.764568+0000","last_undegraded":"2024-05-30T16:49:49.764568+0000","last_fullsized":"2024-05-30T16:49:49.764568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:38.529638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.580191+0000","last_change":"2024-05-30T16:49:48.767136+0000","last_active":"2024-05-30T16:49:50.580191+0000","last_peered":"2024-05-30T16:49:50.580191+0000","last_clean":"2024-05-30T16:49:50.580191+0000","last_became_active":"2024-05-30T16:49:48.766702+0000","last_became_peered":"2024-05-30T16:49:48.766702+0000","last_unstale":"2024-05-30T16:49:50.580191+0000","last_undegraded":"2024-05-30T16:49:50.580191+0000","last_fullsized":"2024-05-30T16:49:50.580191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:55:49.104669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.580254+0000","last_change":"2024-05-30T16:49:48.768807+0000","last_active":"2024-05-30T16:49:50.580254+0000","last_peered":"2024-05-30T16:49:50.580254+0000","last_clean":"2024-05-30T16:49:50.580254+0000","last_became_active":"2024-05-30T16:49:48.766521+0000","last_became_peered":"2024-05-30T16:49:48.766521+0000","last_unstale":"2024-05-30T16:49:50.580254+0000","last_undegraded":"2024-05-30T16:49:50.580254+0000","last_fullsized":"2024-05-30T16:49:50.580254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:13:05.285083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.785455+0000","last_change":"2024-05-30T16:49:48.775567+0000","last_active":"2024-05-30T16:49:48.785455+0000","last_peered":"2024-05-30T16:49:48.785455+0000","last_clean":"2024-05-30T16:49:48.785455+0000","last_became_active":"2024-05-30T16:49:48.775311+0000","last_became_peered":"2024-05-30T16:49:48.775311+0000","last_unstale":"2024-05-30T16:49:48.785455+0000","last_undegraded":"2024-05-30T16:49:48.785455+0000","last_fullsized":"2024-05-30T16:49:48.785455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:01.450391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.778751+0000","last_change":"2024-05-30T16:49:48.774026+0000","last_active":"2024-05-30T16:49:48.778751+0000","last_peered":"2024-05-30T16:49:48.778751+0000","last_clean":"2024-05-30T16:49:48.778751+0000","last_became_active":"2024-05-30T16:49:48.773693+0000","last_became_peered":"2024-05-30T16:49:48.773693+0000","last_unstale":"2024-05-30T16:49:48.778751+0000","last_undegraded":"2024-05-30T16:49:48.778751+0000","last_fullsized":"2024-05-30T16:49:48.778751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:11.032201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259260+0000","last_change":"2024-05-30T16:49:48.769567+0000","last_active":"2024-05-30T16:49:51.259260+0000","last_peered":"2024-05-30T16:49:51.259260+0000","last_clean":"2024-05-30T16:49:51.259260+0000","last_became_active":"2024-05-30T16:49:48.769293+0000","last_became_peered":"2024-05-30T16:49:48.769293+0000","last_unstale":"2024-05-30T16:49:51.259260+0000","last_undegraded":"2024-05-30T16:49:51.259260+0000","last_fullsized":"2024-05-30T16:49:51.259260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:15.133205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764282+0000","last_change":"2024-05-30T16:49:48.757059+0000","last_active":"2024-05-30T16:49:49.764282+0000","last_peered":"2024-05-30T16:49:49.764282+0000","last_clean":"2024-05-30T16:49:49.764282+0000","last_became_active":"2024-05-30T16:49:48.756764+0000","last_became_peered":"2024-05-30T16:49:48.756764+0000","last_unstale":"2024-05-30T16:49:49.764282+0000","last_undegraded":"2024-05-30T16:49:49.764282+0000","last_fullsized":"2024-05-30T16:49:49.764282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:08:03.270343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764713+0000","last_change":"2024-05-30T16:49:48.759039+0000","last_active":"2024-05-30T16:49:49.764713+0000","last_peered":"2024-05-30T16:49:49.764713+0000","last_clean":"2024-05-30T16:49:49.764713+0000","last_became_active":"2024-05-30T16:49:48.758741+0000","last_became_peered":"2024-05-30T16:49:48.758741+0000","last_unstale":"2024-05-30T16:49:49.764713+0000","last_undegraded":"2024-05-30T16:49:49.764713+0000","last_fullsized":"2024-05-30T16:49:49.764713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:36:37.132187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.760483+0000","last_change":"2024-05-30T16:49:48.761991+0000","last_active":"2024-05-30T16:49:49.760483+0000","last_peered":"2024-05-30T16:49:49.760483+0000","last_clean":"2024-05-30T16:49:49.760483+0000","last_became_active":"2024-05-30T16:49:48.761589+0000","last_became_peered":"2024-05-30T16:49:48.761589+0000","last_unstale":"2024-05-30T16:49:49.760483+0000","last_undegraded":"2024-05-30T16:49:49.760483+0000","last_fullsized":"2024-05-30T16:49:49.760483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:28:22.415831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764157+0000","last_change":"2024-05-30T16:49:48.774068+0000","last_active":"2024-05-30T16:49:49.764157+0000","last_peered":"2024-05-30T16:49:49.764157+0000","last_clean":"2024-05-30T16:49:49.764157+0000","last_became_active":"2024-05-30T16:49:48.773825+0000","last_became_peered":"2024-05-30T16:49:48.773825+0000","last_unstale":"2024-05-30T16:49:49.764157+0000","last_undegraded":"2024-05-30T16:49:49.764157+0000","last_fullsized":"2024-05-30T16:49:49.764157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:19:38.537282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.756266+0000","last_change":"2024-05-30T16:49:48.776677+0000","last_active":"2024-05-30T16:49:50.756266+0000","last_peered":"2024-05-30T16:49:50.756266+0000","last_clean":"2024-05-30T16:49:50.756266+0000","last_became_active":"2024-05-30T16:49:48.776365+0000","last_became_peered":"2024-05-30T16:49:48.776365+0000","last_unstale":"2024-05-30T16:49:50.756266+0000","last_undegraded":"2024-05-30T16:49:50.756266+0000","last_fullsized":"2024-05-30T16:49:50.756266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:22:41.702711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.765888+0000","last_change":"2024-05-30T16:49:48.760429+0000","last_active":"2024-05-30T16:49:48.765888+0000","last_peered":"2024-05-30T16:49:48.765888+0000","last_clean":"2024-05-30T16:49:48.765888+0000","last_became_active":"2024-05-30T16:49:48.759821+0000","last_became_peered":"2024-05-30T16:49:48.759821+0000","last_unstale":"2024-05-30T16:49:48.765888+0000","last_undegraded":"2024-05-30T16:49:48.765888+0000","last_fullsized":"2024-05-30T16:49:48.765888+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:23:45.334091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.756696+0000","last_change":"2024-05-30T16:49:48.768042+0000","last_active":"2024-05-30T16:49:50.756696+0000","last_peered":"2024-05-30T16:49:50.756696+0000","last_clean":"2024-05-30T16:49:50.756696+0000","last_became_active":"2024-05-30T16:49:48.767750+0000","last_became_peered":"2024-05-30T16:49:48.767750+0000","last_unstale":"2024-05-30T16:49:50.756696+0000","last_undegraded":"2024-05-30T16:49:50.756696+0000","last_fullsized":"2024-05-30T16:49:50.756696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:36:37.132187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.763731+0000","last_change":"2024-05-30T16:49:48.758097+0000","last_active":"2024-05-30T16:49:49.763731+0000","last_peered":"2024-05-30T16:49:49.763731+0000","last_clean":"2024-05-30T16:49:49.763731+0000","last_became_active":"2024-05-30T16:49:48.757761+0000","last_became_peered":"2024-05-30T16:49:48.757761+0000","last_unstale":"2024-05-30T16:49:49.763731+0000","last_undegraded":"2024-05-30T16:49:49.763731+0000","last_fullsized":"2024-05-30T16:49:49.763731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:20.039272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764512+0000","last_change":"2024-05-30T16:49:48.761997+0000","last_active":"2024-05-30T16:49:49.764512+0000","last_peered":"2024-05-30T16:49:49.764512+0000","last_clean":"2024-05-30T16:49:49.764512+0000","last_became_active":"2024-05-30T16:49:48.761775+0000","last_became_peered":"2024-05-30T16:49:48.761775+0000","last_unstale":"2024-05-30T16:49:49.764512+0000","last_undegraded":"2024-05-30T16:49:49.764512+0000","last_fullsized":"2024-05-30T16:49:49.764512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:22:41.702711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.579833+0000","last_change":"2024-05-30T16:49:48.759288+0000","last_active":"2024-05-30T16:49:50.579833+0000","last_peered":"2024-05-30T16:49:50.579833+0000","last_clean":"2024-05-30T16:49:50.579833+0000","last_became_active":"2024-05-30T16:49:48.758965+0000","last_became_peered":"2024-05-30T16:49:48.758965+0000","last_unstale":"2024-05-30T16:49:50.579833+0000","last_undegraded":"2024-05-30T16:49:50.579833+0000","last_fullsized":"2024-05-30T16:49:50.579833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:31:49.647657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259666+0000","last_change":"2024-05-30T16:49:48.766853+0000","last_active":"2024-05-30T16:49:51.259666+0000","last_peered":"2024-05-30T16:49:51.259666+0000","last_clean":"2024-05-30T16:49:51.259666+0000","last_became_active":"2024-05-30T16:49:48.766491+0000","last_became_peered":"2024-05-30T16:49:48.766491+0000","last_unstale":"2024-05-30T16:49:51.259666+0000","last_undegraded":"2024-05-30T16:49:51.259666+0000","last_fullsized":"2024-05-30T16:49:51.259666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:12:23.652534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.579956+0000","last_change":"2024-05-30T16:49:48.760668+0000","last_active":"2024-05-30T16:49:50.579956+0000","last_peered":"2024-05-30T16:49:50.579956+0000","last_clean":"2024-05-30T16:49:50.579956+0000","last_became_active":"2024-05-30T16:49:48.760034+0000","last_became_peered":"2024-05-30T16:49:48.760034+0000","last_unstale":"2024-05-30T16:49:50.579956+0000","last_undegraded":"2024-05-30T16:49:50.579956+0000","last_fullsized":"2024-05-30T16:49:50.579956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:49:18.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.760937+0000","last_change":"2024-05-30T16:49:48.769412+0000","last_active":"2024-05-30T16:49:49.760937+0000","last_peered":"2024-05-30T16:49:49.760937+0000","last_clean":"2024-05-30T16:49:49.760937+0000","last_became_active":"2024-05-30T16:49:48.767988+0000","last_became_peered":"2024-05-30T16:49:48.767988+0000","last_unstale":"2024-05-30T16:49:49.760937+0000","last_undegraded":"2024-05-30T16:49:49.760937+0000","last_fullsized":"2024-05-30T16:49:49.760937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:21.059698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259813+0000","last_change":"2024-05-30T16:49:47.766952+0000","last_active":"2024-05-30T16:49:51.259813+0000","last_peered":"2024-05-30T16:49:51.259813+0000","last_clean":"2024-05-30T16:49:51.259813+0000","last_became_active":"2024-05-30T16:49:47.766424+0000","last_became_peered":"2024-05-30T16:49:47.766424+0000","last_unstale":"2024-05-30T16:49:51.259813+0000","last_undegraded":"2024-05-30T16:49:51.259813+0000","last_fullsized":"2024-05-30T16:49:51.259813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:58.491466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259795+0000","last_change":"2024-05-30T16:49:48.766045+0000","last_active":"2024-05-30T16:49:51.259795+0000","last_peered":"2024-05-30T16:49:51.259795+0000","last_clean":"2024-05-30T16:49:51.259795+0000","last_became_active":"2024-05-30T16:49:48.765744+0000","last_became_peered":"2024-05-30T16:49:48.765744+0000","last_unstale":"2024-05-30T16:49:51.259795+0000","last_undegraded":"2024-05-30T16:49:51.259795+0000","last_fullsized":"2024-05-30T16:49:51.259795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:28:22.415831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.760989+0000","last_change":"2024-05-30T16:49:47.763398+0000","last_active":"2024-05-30T16:49:49.760989+0000","last_peered":"2024-05-30T16:49:49.760989+0000","last_clean":"2024-05-30T16:49:49.760989+0000","last_became_active":"2024-05-30T16:49:47.762989+0000","last_became_peered":"2024-05-30T16:49:47.762989+0000","last_unstale":"2024-05-30T16:49:49.760989+0000","last_undegraded":"2024-05-30T16:49:49.760989+0000","last_fullsized":"2024-05-30T16:49:49.760989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:14.128649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764002+0000","last_change":"2024-05-30T16:49:48.759609+0000","last_active":"2024-05-30T16:49:49.764002+0000","last_peered":"2024-05-30T16:49:49.764002+0000","last_clean":"2024-05-30T16:49:49.764002+0000","last_became_active":"2024-05-30T16:49:48.759343+0000","last_became_peered":"2024-05-30T16:49:48.759343+0000","last_unstale":"2024-05-30T16:49:49.764002+0000","last_undegraded":"2024-05-30T16:49:49.764002+0000","last_fullsized":"2024-05-30T16:49:49.764002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:59:50.201533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.789999+0000","last_change":"2024-05-30T16:49:47.761715+0000","last_active":"2024-05-30T16:49:48.789999+0000","last_peered":"2024-05-30T16:49:48.789999+0000","last_clean":"2024-05-30T16:49:48.789999+0000","last_became_active":"2024-05-30T16:49:47.761396+0000","last_became_peered":"2024-05-30T16:49:47.761396+0000","last_unstale":"2024-05-30T16:49:48.789999+0000","last_undegraded":"2024-05-30T16:49:48.789999+0000","last_fullsized":"2024-05-30T16:49:48.789999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:18.078808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.756749+0000","last_change":"2024-05-30T16:49:48.773634+0000","last_active":"2024-05-30T16:49:50.756749+0000","last_peered":"2024-05-30T16:49:50.756749+0000","last_clean":"2024-05-30T16:49:50.756749+0000","last_became_active":"2024-05-30T16:49:48.773270+0000","last_became_peered":"2024-05-30T16:49:48.773270+0000","last_unstale":"2024-05-30T16:49:50.756749+0000","last_undegraded":"2024-05-30T16:49:50.756749+0000","last_fullsized":"2024-05-30T16:49:50.756749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:42:26.473315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259173+0000","last_change":"2024-05-30T16:49:47.761110+0000","last_active":"2024-05-30T16:49:51.259173+0000","last_peered":"2024-05-30T16:49:51.259173+0000","last_clean":"2024-05-30T16:49:51.259173+0000","last_became_active":"2024-05-30T16:49:47.760844+0000","last_became_peered":"2024-05-30T16:49:47.760844+0000","last_unstale":"2024-05-30T16:49:51.259173+0000","last_undegraded":"2024-05-30T16:49:51.259173+0000","last_fullsized":"2024-05-30T16:49:51.259173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:20.590196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.580203+0000","last_change":"2024-05-30T16:49:48.760393+0000","last_active":"2024-05-30T16:49:50.580203+0000","last_peered":"2024-05-30T16:49:50.580203+0000","last_clean":"2024-05-30T16:49:50.580203+0000","last_became_active":"2024-05-30T16:49:48.760064+0000","last_became_peered":"2024-05-30T16:49:48.760064+0000","last_unstale":"2024-05-30T16:49:50.580203+0000","last_undegraded":"2024-05-30T16:49:50.580203+0000","last_fullsized":"2024-05-30T16:49:50.580203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:38.529638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764595+0000","last_change":"2024-05-30T16:49:47.759408+0000","last_active":"2024-05-30T16:49:49.764595+0000","last_peered":"2024-05-30T16:49:49.764595+0000","last_clean":"2024-05-30T16:49:49.764595+0000","last_became_active":"2024-05-30T16:49:47.759143+0000","last_became_peered":"2024-05-30T16:49:47.759143+0000","last_unstale":"2024-05-30T16:49:49.764595+0000","last_undegraded":"2024-05-30T16:49:49.764595+0000","last_fullsized":"2024-05-30T16:49:49.764595+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:30:39.683275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.763422+0000","last_change":"2024-05-30T16:49:48.758403+0000","last_active":"2024-05-30T16:49:49.763422+0000","last_peered":"2024-05-30T16:49:49.763422+0000","last_clean":"2024-05-30T16:49:49.763422+0000","last_became_active":"2024-05-30T16:49:48.758006+0000","last_became_peered":"2024-05-30T16:49:48.758006+0000","last_unstale":"2024-05-30T16:49:49.763422+0000","last_undegraded":"2024-05-30T16:49:49.763422+0000","last_fullsized":"2024-05-30T16:49:49.763422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:17:40.837404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764891+0000","last_change":"2024-05-30T16:49:47.761594+0000","last_active":"2024-05-30T16:49:49.764891+0000","last_peered":"2024-05-30T16:49:49.764891+0000","last_clean":"2024-05-30T16:49:49.764891+0000","last_became_active":"2024-05-30T16:49:47.761297+0000","last_became_peered":"2024-05-30T16:49:47.761297+0000","last_unstale":"2024-05-30T16:49:49.764891+0000","last_undegraded":"2024-05-30T16:49:49.764891+0000","last_fullsized":"2024-05-30T16:49:49.764891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:07:15.854852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.763880+0000","last_change":"2024-05-30T16:49:48.757195+0000","last_active":"2024-05-30T16:49:49.763880+0000","last_peered":"2024-05-30T16:49:49.763880+0000","last_clean":"2024-05-30T16:49:49.763880+0000","last_became_active":"2024-05-30T16:49:48.756900+0000","last_became_peered":"2024-05-30T16:49:48.756900+0000","last_unstale":"2024-05-30T16:49:49.763880+0000","last_undegraded":"2024-05-30T16:49:49.763880+0000","last_fullsized":"2024-05-30T16:49:49.763880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:10:39.866739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.750113+0000","last_change":"2024-05-30T16:49:47.760627+0000","last_active":"2024-05-30T16:49:48.750113+0000","last_peered":"2024-05-30T16:49:48.750113+0000","last_clean":"2024-05-30T16:49:48.750113+0000","last_became_active":"2024-05-30T16:49:47.760368+0000","last_became_peered":"2024-05-30T16:49:47.760368+0000","last_unstale":"2024-05-30T16:49:48.750113+0000","last_undegraded":"2024-05-30T16:49:48.750113+0000","last_fullsized":"2024-05-30T16:49:48.750113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:35.913559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.755788+0000","last_change":"2024-05-30T16:49:48.777126+0000","last_active":"2024-05-30T16:49:50.755788+0000","last_peered":"2024-05-30T16:49:50.755788+0000","last_clean":"2024-05-30T16:49:50.755788+0000","last_became_active":"2024-05-30T16:49:48.776838+0000","last_became_peered":"2024-05-30T16:49:48.776838+0000","last_unstale":"2024-05-30T16:49:50.755788+0000","last_undegraded":"2024-05-30T16:49:50.755788+0000","last_fullsized":"2024-05-30T16:49:50.755788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:21.059698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.763946+0000","last_change":"2024-05-30T16:49:47.758923+0000","last_active":"2024-05-30T16:49:49.763946+0000","last_peered":"2024-05-30T16:49:49.763946+0000","last_clean":"2024-05-30T16:49:49.763946+0000","last_became_active":"2024-05-30T16:49:47.758668+0000","last_became_peered":"2024-05-30T16:49:47.758668+0000","last_unstale":"2024-05-30T16:49:49.763946+0000","last_undegraded":"2024-05-30T16:49:49.763946+0000","last_fullsized":"2024-05-30T16:49:49.763946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:33:02.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.763907+0000","last_change":"2024-05-30T16:49:48.765028+0000","last_active":"2024-05-30T16:49:49.763907+0000","last_peered":"2024-05-30T16:49:49.763907+0000","last_clean":"2024-05-30T16:49:49.763907+0000","last_became_active":"2024-05-30T16:49:48.764663+0000","last_became_peered":"2024-05-30T16:49:48.764663+0000","last_unstale":"2024-05-30T16:49:49.763907+0000","last_undegraded":"2024-05-30T16:49:49.763907+0000","last_fullsized":"2024-05-30T16:49:49.763907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:49:18.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.750321+0000","last_change":"2024-05-30T16:49:47.768676+0000","last_active":"2024-05-30T16:49:48.750321+0000","last_peered":"2024-05-30T16:49:48.750321+0000","last_clean":"2024-05-30T16:49:48.750321+0000","last_became_active":"2024-05-30T16:49:47.768432+0000","last_became_peered":"2024-05-30T16:49:47.768432+0000","last_unstale":"2024-05-30T16:49:48.750321+0000","last_undegraded":"2024-05-30T16:49:48.750321+0000","last_fullsized":"2024-05-30T16:49:48.750321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:55:07.908863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.782379+0000","last_change":"2024-05-30T16:49:48.779417+0000","last_active":"2024-05-30T16:49:48.782379+0000","last_peered":"2024-05-30T16:49:48.782379+0000","last_clean":"2024-05-30T16:49:48.782379+0000","last_became_active":"2024-05-30T16:49:48.779150+0000","last_became_peered":"2024-05-30T16:49:48.779150+0000","last_unstale":"2024-05-30T16:49:48.782379+0000","last_undegraded":"2024-05-30T16:49:48.782379+0000","last_fullsized":"2024-05-30T16:49:48.782379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:29:26.590502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.761085+0000","last_change":"2024-05-30T16:49:47.756327+0000","last_active":"2024-05-30T16:49:49.761085+0000","last_peered":"2024-05-30T16:49:49.761085+0000","last_clean":"2024-05-30T16:49:49.761085+0000","last_became_active":"2024-05-30T16:49:47.756074+0000","last_became_peered":"2024-05-30T16:49:47.756074+0000","last_unstale":"2024-05-30T16:49:49.761085+0000","last_undegraded":"2024-05-30T16:49:49.761085+0000","last_fullsized":"2024-05-30T16:49:49.761085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:30:17.893908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.765398+0000","last_change":"2024-05-30T16:49:48.760127+0000","last_active":"2024-05-30T16:49:48.765398+0000","last_peered":"2024-05-30T16:49:48.765398+0000","last_clean":"2024-05-30T16:49:48.765398+0000","last_became_active":"2024-05-30T16:49:48.759750+0000","last_became_peered":"2024-05-30T16:49:48.759750+0000","last_unstale":"2024-05-30T16:49:48.765398+0000","last_undegraded":"2024-05-30T16:49:48.765398+0000","last_fullsized":"2024-05-30T16:49:48.765398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:26:04.034546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764046+0000","last_change":"2024-05-30T16:49:47.769786+0000","last_active":"2024-05-30T16:49:49.764046+0000","last_peered":"2024-05-30T16:49:49.764046+0000","last_clean":"2024-05-30T16:49:49.764046+0000","last_became_active":"2024-05-30T16:49:47.769519+0000","last_became_peered":"2024-05-30T16:49:47.769519+0000","last_unstale":"2024-05-30T16:49:49.764046+0000","last_undegraded":"2024-05-30T16:49:49.764046+0000","last_fullsized":"2024-05-30T16:49:49.764046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:31:55.413537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764517+0000","last_change":"2024-05-30T16:49:48.778460+0000","last_active":"2024-05-30T16:49:49.764517+0000","last_peered":"2024-05-30T16:49:49.764517+0000","last_clean":"2024-05-30T16:49:49.764517+0000","last_became_active":"2024-05-30T16:49:48.777494+0000","last_became_peered":"2024-05-30T16:49:48.777494+0000","last_unstale":"2024-05-30T16:49:49.764517+0000","last_undegraded":"2024-05-30T16:49:49.764517+0000","last_fullsized":"2024-05-30T16:49:49.764517+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:55:49.104669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.793147+0000","last_change":"2024-05-30T16:49:47.762955+0000","last_active":"2024-05-30T16:49:48.793147+0000","last_peered":"2024-05-30T16:49:48.793147+0000","last_clean":"2024-05-30T16:49:48.793147+0000","last_became_active":"2024-05-30T16:49:47.761437+0000","last_became_peered":"2024-05-30T16:49:47.761437+0000","last_unstale":"2024-05-30T16:49:48.793147+0000","last_undegraded":"2024-05-30T16:49:48.793147+0000","last_fullsized":"2024-05-30T16:49:48.793147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:52.015114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.755828+0000","last_change":"2024-05-30T16:49:48.772307+0000","last_active":"2024-05-30T16:49:50.755828+0000","last_peered":"2024-05-30T16:49:50.755828+0000","last_clean":"2024-05-30T16:49:50.755828+0000","last_became_active":"2024-05-30T16:49:48.769940+0000","last_became_peered":"2024-05-30T16:49:48.769940+0000","last_unstale":"2024-05-30T16:49:50.755828+0000","last_undegraded":"2024-05-30T16:49:50.755828+0000","last_fullsized":"2024-05-30T16:49:50.755828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:10:39.866739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764711+0000","last_change":"2024-05-30T16:49:47.765283+0000","last_active":"2024-05-30T16:49:49.764711+0000","last_peered":"2024-05-30T16:49:49.764711+0000","last_clean":"2024-05-30T16:49:49.764711+0000","last_became_active":"2024-05-30T16:49:47.761924+0000","last_became_peered":"2024-05-30T16:49:47.761924+0000","last_unstale":"2024-05-30T16:49:49.764711+0000","last_undegraded":"2024-05-30T16:49:49.764711+0000","last_fullsized":"2024-05-30T16:49:49.764711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:30:17.893908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.763997+0000","last_change":"2024-05-30T16:49:48.757570+0000","last_active":"2024-05-30T16:49:48.763997+0000","last_peered":"2024-05-30T16:49:48.763997+0000","last_clean":"2024-05-30T16:49:48.763997+0000","last_became_active":"2024-05-30T16:49:48.757298+0000","last_became_peered":"2024-05-30T16:49:48.757298+0000","last_unstale":"2024-05-30T16:49:48.763997+0000","last_undegraded":"2024-05-30T16:49:48.763997+0000","last_fullsized":"2024-05-30T16:49:48.763997+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:13:42.653785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.755711+0000","last_change":"2024-05-30T16:49:47.765169+0000","last_active":"2024-05-30T16:49:50.755711+0000","last_peered":"2024-05-30T16:49:50.755711+0000","last_clean":"2024-05-30T16:49:50.755711+0000","last_became_active":"2024-05-30T16:49:47.764718+0000","last_became_peered":"2024-05-30T16:49:47.764718+0000","last_unstale":"2024-05-30T16:49:50.755711+0000","last_undegraded":"2024-05-30T16:49:50.755711+0000","last_fullsized":"2024-05-30T16:49:50.755711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:33:02.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.580127+0000","last_change":"2024-05-30T16:49:48.762721+0000","last_active":"2024-05-30T16:49:50.580127+0000","last_peered":"2024-05-30T16:49:50.580127+0000","last_clean":"2024-05-30T16:49:50.580127+0000","last_became_active":"2024-05-30T16:49:48.760399+0000","last_became_peered":"2024-05-30T16:49:48.760399+0000","last_unstale":"2024-05-30T16:49:50.580127+0000","last_undegraded":"2024-05-30T16:49:50.580127+0000","last_fullsized":"2024-05-30T16:49:50.580127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:28:11.129361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.748509+0000","last_change":"2024-05-30T16:49:47.766657+0000","last_active":"2024-05-30T16:49:48.748509+0000","last_peered":"2024-05-30T16:49:48.748509+0000","last_clean":"2024-05-30T16:49:48.748509+0000","last_became_active":"2024-05-30T16:49:47.766310+0000","last_became_peered":"2024-05-30T16:49:47.766310+0000","last_unstale":"2024-05-30T16:49:48.748509+0000","last_undegraded":"2024-05-30T16:49:48.748509+0000","last_fullsized":"2024-05-30T16:49:48.748509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:58.546515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259672+0000","last_change":"2024-05-30T16:49:48.765765+0000","last_active":"2024-05-30T16:49:51.259672+0000","last_peered":"2024-05-30T16:49:51.259672+0000","last_clean":"2024-05-30T16:49:51.259672+0000","last_became_active":"2024-05-30T16:49:48.765360+0000","last_became_peered":"2024-05-30T16:49:48.765360+0000","last_unstale":"2024-05-30T16:49:51.259672+0000","last_undegraded":"2024-05-30T16:49:51.259672+0000","last_fullsized":"2024-05-30T16:49:51.259672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:39.885601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.792821+0000","last_change":"2024-05-30T16:49:47.762754+0000","last_active":"2024-05-30T16:49:48.792821+0000","last_peered":"2024-05-30T16:49:48.792821+0000","last_clean":"2024-05-30T16:49:48.792821+0000","last_became_active":"2024-05-30T16:49:47.762596+0000","last_became_peered":"2024-05-30T16:49:47.762596+0000","last_unstale":"2024-05-30T16:49:48.792821+0000","last_undegraded":"2024-05-30T16:49:48.792821+0000","last_fullsized":"2024-05-30T16:49:48.792821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:41:54.897651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.765218+0000","last_change":"2024-05-30T16:49:48.763710+0000","last_active":"2024-05-30T16:49:49.765218+0000","last_peered":"2024-05-30T16:49:49.765218+0000","last_clean":"2024-05-30T16:49:49.765218+0000","last_became_active":"2024-05-30T16:49:48.763417+0000","last_became_peered":"2024-05-30T16:49:48.763417+0000","last_unstale":"2024-05-30T16:49:49.765218+0000","last_undegraded":"2024-05-30T16:49:49.765218+0000","last_fullsized":"2024-05-30T16:49:49.765218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:42:26.473315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.756270+0000","last_change":"2024-05-30T16:49:47.759674+0000","last_active":"2024-05-30T16:49:50.756270+0000","last_peered":"2024-05-30T16:49:50.756270+0000","last_clean":"2024-05-30T16:49:50.756270+0000","last_became_active":"2024-05-30T16:49:47.759337+0000","last_became_peered":"2024-05-30T16:49:47.759337+0000","last_unstale":"2024-05-30T16:49:50.756270+0000","last_undegraded":"2024-05-30T16:49:50.756270+0000","last_fullsized":"2024-05-30T16:49:50.756270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:30:39.683275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764277+0000","last_change":"2024-05-30T16:49:48.754565+0000","last_active":"2024-05-30T16:49:49.764277+0000","last_peered":"2024-05-30T16:49:49.764277+0000","last_clean":"2024-05-30T16:49:49.764277+0000","last_became_active":"2024-05-30T16:49:48.754258+0000","last_became_peered":"2024-05-30T16:49:48.754258+0000","last_unstale":"2024-05-30T16:49:49.764277+0000","last_undegraded":"2024-05-30T16:49:49.764277+0000","last_fullsized":"2024-05-30T16:49:49.764277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:28:11.129361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.765227+0000","last_change":"2024-05-30T16:49:47.760329+0000","last_active":"2024-05-30T16:49:49.765227+0000","last_peered":"2024-05-30T16:49:49.765227+0000","last_clean":"2024-05-30T16:49:49.765227+0000","last_became_active":"2024-05-30T16:49:47.760055+0000","last_became_peered":"2024-05-30T16:49:47.760055+0000","last_unstale":"2024-05-30T16:49:49.765227+0000","last_undegraded":"2024-05-30T16:49:49.765227+0000","last_fullsized":"2024-05-30T16:49:49.765227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:57.295759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.756125+0000","last_change":"2024-05-30T16:49:48.769023+0000","last_active":"2024-05-30T16:49:50.756125+0000","last_peered":"2024-05-30T16:49:50.756125+0000","last_clean":"2024-05-30T16:49:50.756125+0000","last_became_active":"2024-05-30T16:49:48.768703+0000","last_became_peered":"2024-05-30T16:49:48.768703+0000","last_unstale":"2024-05-30T16:49:50.756125+0000","last_undegraded":"2024-05-30T16:49:50.756125+0000","last_fullsized":"2024-05-30T16:49:50.756125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:08:03.270343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.765139+0000","last_change":"2024-05-30T16:49:47.759103+0000","last_active":"2024-05-30T16:49:49.765139+0000","last_peered":"2024-05-30T16:49:49.765139+0000","last_clean":"2024-05-30T16:49:49.765139+0000","last_became_active":"2024-05-30T16:49:47.758802+0000","last_became_peered":"2024-05-30T16:49:47.758802+0000","last_unstale":"2024-05-30T16:49:49.765139+0000","last_undegraded":"2024-05-30T16:49:49.765139+0000","last_fullsized":"2024-05-30T16:49:49.765139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:59:37.818460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259242+0000","last_change":"2024-05-30T16:49:48.779230+0000","last_active":"2024-05-30T16:49:51.259242+0000","last_peered":"2024-05-30T16:49:51.259242+0000","last_clean":"2024-05-30T16:49:51.259242+0000","last_became_active":"2024-05-30T16:49:48.778951+0000","last_became_peered":"2024-05-30T16:49:48.778951+0000","last_unstale":"2024-05-30T16:49:51.259242+0000","last_undegraded":"2024-05-30T16:49:51.259242+0000","last_fullsized":"2024-05-30T16:49:51.259242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:33:03.078359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764954+0000","last_change":"2024-05-30T16:49:47.762353+0000","last_active":"2024-05-30T16:49:49.764954+0000","last_peered":"2024-05-30T16:49:49.764954+0000","last_clean":"2024-05-30T16:49:49.764954+0000","last_became_active":"2024-05-30T16:49:47.762009+0000","last_became_peered":"2024-05-30T16:49:47.762009+0000","last_unstale":"2024-05-30T16:49:49.764954+0000","last_undegraded":"2024-05-30T16:49:49.764954+0000","last_fullsized":"2024-05-30T16:49:49.764954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:50:09.775923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259120+0000","last_change":"2024-05-30T16:49:48.777434+0000","last_active":"2024-05-30T16:49:51.259120+0000","last_peered":"2024-05-30T16:49:51.259120+0000","last_clean":"2024-05-30T16:49:51.259120+0000","last_became_active":"2024-05-30T16:49:48.777117+0000","last_became_peered":"2024-05-30T16:49:48.777117+0000","last_unstale":"2024-05-30T16:49:51.259120+0000","last_undegraded":"2024-05-30T16:49:51.259120+0000","last_fullsized":"2024-05-30T16:49:51.259120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:59.496022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.760785+0000","last_change":"2024-05-30T16:49:47.764210+0000","last_active":"2024-05-30T16:49:49.760785+0000","last_peered":"2024-05-30T16:49:49.760785+0000","last_clean":"2024-05-30T16:49:49.760785+0000","last_became_active":"2024-05-30T16:49:47.763877+0000","last_became_peered":"2024-05-30T16:49:47.763877+0000","last_unstale":"2024-05-30T16:49:49.760785+0000","last_undegraded":"2024-05-30T16:49:49.760785+0000","last_fullsized":"2024-05-30T16:49:49.760785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:33:02.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259383+0000","last_change":"2024-05-30T16:49:48.766842+0000","last_active":"2024-05-30T16:49:51.259383+0000","last_peered":"2024-05-30T16:49:51.259383+0000","last_clean":"2024-05-30T16:49:51.259383+0000","last_became_active":"2024-05-30T16:49:48.766542+0000","last_became_peered":"2024-05-30T16:49:48.766542+0000","last_unstale":"2024-05-30T16:49:51.259383+0000","last_undegraded":"2024-05-30T16:49:51.259383+0000","last_fullsized":"2024-05-30T16:49:51.259383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:30:40.687832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259490+0000","last_change":"2024-05-30T16:49:47.771034+0000","last_active":"2024-05-30T16:49:51.259490+0000","last_peered":"2024-05-30T16:49:51.259490+0000","last_clean":"2024-05-30T16:49:51.259490+0000","last_became_active":"2024-05-30T16:49:47.770725+0000","last_became_peered":"2024-05-30T16:49:47.770725+0000","last_unstale":"2024-05-30T16:49:51.259490+0000","last_undegraded":"2024-05-30T16:49:51.259490+0000","last_fullsized":"2024-05-30T16:49:51.259490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:59:37.818460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259305+0000","last_change":"2024-05-30T16:49:48.765977+0000","last_active":"2024-05-30T16:49:51.259305+0000","last_peered":"2024-05-30T16:49:51.259305+0000","last_clean":"2024-05-30T16:49:51.259305+0000","last_became_active":"2024-05-30T16:49:48.765707+0000","last_became_peered":"2024-05-30T16:49:48.765707+0000","last_unstale":"2024-05-30T16:49:51.259305+0000","last_undegraded":"2024-05-30T16:49:51.259305+0000","last_fullsized":"2024-05-30T16:49:51.259305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:30:18.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764487+0000","last_change":"2024-05-30T16:49:47.762070+0000","last_active":"2024-05-30T16:49:49.764487+0000","last_peered":"2024-05-30T16:49:49.764487+0000","last_clean":"2024-05-30T16:49:49.764487+0000","last_became_active":"2024-05-30T16:49:47.761732+0000","last_became_peered":"2024-05-30T16:49:47.761732+0000","last_unstale":"2024-05-30T16:49:49.764487+0000","last_undegraded":"2024-05-30T16:49:49.764487+0000","last_fullsized":"2024-05-30T16:49:49.764487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:58.491466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.579843+0000","last_change":"2024-05-30T16:49:48.769099+0000","last_active":"2024-05-30T16:49:50.579843+0000","last_peered":"2024-05-30T16:49:50.579843+0000","last_clean":"2024-05-30T16:49:50.579843+0000","last_became_active":"2024-05-30T16:49:48.768440+0000","last_became_peered":"2024-05-30T16:49:48.768440+0000","last_unstale":"2024-05-30T16:49:50.579843+0000","last_undegraded":"2024-05-30T16:49:50.579843+0000","last_fullsized":"2024-05-30T16:49:50.579843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:00:26.774209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.763248+0000","last_change":"2024-05-30T16:49:47.767680+0000","last_active":"2024-05-30T16:49:49.763248+0000","last_peered":"2024-05-30T16:49:49.763248+0000","last_clean":"2024-05-30T16:49:49.763248+0000","last_became_active":"2024-05-30T16:49:47.767356+0000","last_became_peered":"2024-05-30T16:49:47.767356+0000","last_unstale":"2024-05-30T16:49:49.763248+0000","last_undegraded":"2024-05-30T16:49:49.763248+0000","last_fullsized":"2024-05-30T16:49:49.763248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:27:57.606762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259432+0000","last_change":"2024-05-30T16:49:48.769695+0000","last_active":"2024-05-30T16:49:51.259432+0000","last_peered":"2024-05-30T16:49:51.259432+0000","last_clean":"2024-05-30T16:49:51.259432+0000","last_became_active":"2024-05-30T16:49:48.769417+0000","last_became_peered":"2024-05-30T16:49:48.769417+0000","last_unstale":"2024-05-30T16:49:51.259432+0000","last_undegraded":"2024-05-30T16:49:51.259432+0000","last_fullsized":"2024-05-30T16:49:51.259432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:50:10.780480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.756326+0000","last_change":"2024-05-30T16:49:47.768239+0000","last_active":"2024-05-30T16:49:50.756326+0000","last_peered":"2024-05-30T16:49:50.756326+0000","last_clean":"2024-05-30T16:49:50.756326+0000","last_became_active":"2024-05-30T16:49:47.767305+0000","last_became_peered":"2024-05-30T16:49:47.767305+0000","last_unstale":"2024-05-30T16:49:50.756326+0000","last_undegraded":"2024-05-30T16:49:50.756326+0000","last_fullsized":"2024-05-30T16:49:50.756326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:50:09.775923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764414+0000","last_change":"2024-05-30T16:49:48.779564+0000","last_active":"2024-05-30T16:49:49.764414+0000","last_peered":"2024-05-30T16:49:49.764414+0000","last_clean":"2024-05-30T16:49:49.764414+0000","last_became_active":"2024-05-30T16:49:48.779115+0000","last_became_peered":"2024-05-30T16:49:48.779115+0000","last_unstale":"2024-05-30T16:49:49.764414+0000","last_undegraded":"2024-05-30T16:49:49.764414+0000","last_fullsized":"2024-05-30T16:49:49.764414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:32:34.119568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.761163+0000","last_change":"2024-05-30T16:49:47.765960+0000","last_active":"2024-05-30T16:49:49.761163+0000","last_peered":"2024-05-30T16:49:49.761163+0000","last_clean":"2024-05-30T16:49:49.761163+0000","last_became_active":"2024-05-30T16:49:47.765697+0000","last_became_peered":"2024-05-30T16:49:47.765697+0000","last_unstale":"2024-05-30T16:49:49.761163+0000","last_undegraded":"2024-05-30T16:49:49.761163+0000","last_fullsized":"2024-05-30T16:49:49.761163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:30:39.683275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.760782+0000","last_change":"2024-05-30T16:49:48.774121+0000","last_active":"2024-05-30T16:49:49.760782+0000","last_peered":"2024-05-30T16:49:49.760782+0000","last_clean":"2024-05-30T16:49:49.760782+0000","last_became_active":"2024-05-30T16:49:48.773822+0000","last_became_peered":"2024-05-30T16:49:48.773822+0000","last_unstale":"2024-05-30T16:49:49.760782+0000","last_undegraded":"2024-05-30T16:49:49.760782+0000","last_fullsized":"2024-05-30T16:49:49.760782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:27:58.611319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.756096+0000","last_change":"2024-05-30T16:49:47.759859+0000","last_active":"2024-05-30T16:49:50.756096+0000","last_peered":"2024-05-30T16:49:50.756096+0000","last_clean":"2024-05-30T16:49:50.756096+0000","last_became_active":"2024-05-30T16:49:47.759534+0000","last_became_peered":"2024-05-30T16:49:47.759534+0000","last_unstale":"2024-05-30T16:49:50.756096+0000","last_undegraded":"2024-05-30T16:49:50.756096+0000","last_fullsized":"2024-05-30T16:49:50.756096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:14.128649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259481+0000","last_change":"2024-05-30T16:49:48.760998+0000","last_active":"2024-05-30T16:49:51.259481+0000","last_peered":"2024-05-30T16:49:51.259481+0000","last_clean":"2024-05-30T16:49:51.259481+0000","last_became_active":"2024-05-30T16:49:48.759886+0000","last_became_peered":"2024-05-30T16:49:48.759886+0000","last_unstale":"2024-05-30T16:49:51.259481+0000","last_undegraded":"2024-05-30T16:49:51.259481+0000","last_fullsized":"2024-05-30T16:49:51.259481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.760918+0000","last_change":"2024-05-30T16:49:47.755101+0000","last_active":"2024-05-30T16:49:49.760918+0000","last_peered":"2024-05-30T16:49:49.760918+0000","last_clean":"2024-05-30T16:49:49.760918+0000","last_became_active":"2024-05-30T16:49:47.754696+0000","last_became_peered":"2024-05-30T16:49:47.754696+0000","last_unstale":"2024-05-30T16:49:49.760918+0000","last_undegraded":"2024-05-30T16:49:49.760918+0000","last_fullsized":"2024-05-30T16:49:49.760918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:57.295759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.760828+0000","last_change":"2024-05-30T16:49:48.767124+0000","last_active":"2024-05-30T16:49:49.760828+0000","last_peered":"2024-05-30T16:49:49.760828+0000","last_clean":"2024-05-30T16:49:49.760828+0000","last_became_active":"2024-05-30T16:49:48.766423+0000","last_became_peered":"2024-05-30T16:49:48.766423+0000","last_unstale":"2024-05-30T16:49:49.760828+0000","last_undegraded":"2024-05-30T16:49:49.760828+0000","last_fullsized":"2024-05-30T16:49:49.760828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:31:56.418094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.755912+0000","last_change":"2024-05-30T16:49:47.769239+0000","last_active":"2024-05-30T16:49:50.755912+0000","last_peered":"2024-05-30T16:49:50.755912+0000","last_clean":"2024-05-30T16:49:50.755912+0000","last_became_active":"2024-05-30T16:49:47.769046+0000","last_became_peered":"2024-05-30T16:49:47.769046+0000","last_unstale":"2024-05-30T16:49:50.755912+0000","last_undegraded":"2024-05-30T16:49:50.755912+0000","last_fullsized":"2024-05-30T16:49:50.755912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:57.295759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.777980+0000","last_change":"2024-05-30T16:49:48.772340+0000","last_active":"2024-05-30T16:49:48.777980+0000","last_peered":"2024-05-30T16:49:48.777980+0000","last_clean":"2024-05-30T16:49:48.777980+0000","last_became_active":"2024-05-30T16:49:48.771022+0000","last_became_peered":"2024-05-30T16:49:48.771022+0000","last_unstale":"2024-05-30T16:49:48.777980+0000","last_undegraded":"2024-05-30T16:49:48.777980+0000","last_fullsized":"2024-05-30T16:49:48.777980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:02:03.952402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764593+0000","last_change":"2024-05-30T16:49:47.766480+0000","last_active":"2024-05-30T16:49:49.764593+0000","last_peered":"2024-05-30T16:49:49.764593+0000","last_clean":"2024-05-30T16:49:49.764593+0000","last_became_active":"2024-05-30T16:49:47.766009+0000","last_became_peered":"2024-05-30T16:49:47.766009+0000","last_unstale":"2024-05-30T16:49:49.764593+0000","last_undegraded":"2024-05-30T16:49:49.764593+0000","last_fullsized":"2024-05-30T16:49:49.764593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:14.128649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:49.764418+0000","last_change":"2024-05-30T16:49:48.758111+0000","last_active":"2024-05-30T16:49:49.764418+0000","last_peered":"2024-05-30T16:49:49.764418+0000","last_clean":"2024-05-30T16:49:49.764418+0000","last_became_active":"2024-05-30T16:49:48.757848+0000","last_became_peered":"2024-05-30T16:49:48.757848+0000","last_unstale":"2024-05-30T16:49:49.764418+0000","last_undegraded":"2024-05-30T16:49:49.764418+0000","last_fullsized":"2024-05-30T16:49:49.764418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:38:17.594200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T16:49:48.746921+0000","last_change":"2024-05-30T16:49:47.766635+0000","last_active":"2024-05-30T16:49:48.746921+0000","last_peered":"2024-05-30T16:49:48.746921+0000","last_clean":"2024-05-30T16:49:48.746921+0000","last_became_active":"2024-05-30T16:49:47.766313+0000","last_became_peered":"2024-05-30T16:49:47.766313+0000","last_unstale":"2024-05-30T16:49:48.746921+0000","last_undegraded":"2024-05-30T16:49:48.746921+0000","last_fullsized":"2024-05-30T16:49:48.746921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:29:09.992593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.580275+0000","last_change":"2024-05-30T16:49:48.772440+0000","last_active":"2024-05-30T16:49:50.580275+0000","last_peered":"2024-05-30T16:49:50.580275+0000","last_clean":"2024-05-30T16:49:50.580275+0000","last_became_active":"2024-05-30T16:49:48.772137+0000","last_became_peered":"2024-05-30T16:49:48.772137+0000","last_unstale":"2024-05-30T16:49:50.580275+0000","last_undegraded":"2024-05-30T16:49:50.580275+0000","last_fullsized":"2024-05-30T16:49:50.580275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:47.732928+0000","last_clean_scrub_stamp":"2024-05-30T16:49:47.732928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:36:42.059573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:51.259450+0000","last_change":"2024-05-30T16:49:47.772095+0000","last_active":"2024-05-30T16:49:51.259450+0000","last_peered":"2024-05-30T16:49:51.259450+0000","last_clean":"2024-05-30T16:49:51.259450+0000","last_became_active":"2024-05-30T16:49:47.771734+0000","last_became_peered":"2024-05-30T16:49:47.771734+0000","last_unstale":"2024-05-30T16:49:51.259450+0000","last_undegraded":"2024-05-30T16:49:51.259450+0000","last_fullsized":"2024-05-30T16:49:51.259450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:46.728372+0000","last_clean_scrub_stamp":"2024-05-30T16:49:46.728372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:57.295759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-30T16:49:50.580205+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:49:50.580205+0000","last_peered":"2024-05-30T16:49:50.580205+0000","last_clean":"2024-05-30T16:49:50.580205+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:49:50.580205+0000","last_undegraded":"2024-05-30T16:49:50.580205+0000","last_fullsized":"2024-05-30T16:49:50.580205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":974848,"data_stored":734605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":144763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":144819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":144251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":144217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":145781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":734515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":139481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:49:53.279 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:49:53.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T16:49:53.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.462+0000 7f8c03200640 1 Processor -- start 2024-05-30T16:49:53.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.462+0000 7f8c03200640 1 -- start start 2024-05-30T16:49:53.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.462+0000 7f8c03200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bfc15c010 0x7f8bfc15c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.462+0000 7f8c03200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bfc0b52d0 con 0x7f8bfc159100 2024-05-30T16:49:53.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.462+0000 7f8c03200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bfc0b4a30 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.462+0000 7f8c03200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f8bfc0b4d10 con 0x7f8bfc15c010 2024-05-30T16:49:53.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.462+0000 7f8c01200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bfc15c010 0x7f8bfc15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.462+0000 7f8c01200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bfc15c010 0x7f8bfc15c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55048/0 (socket says 172.21.15.59:55048) 2024-05-30T16:49:53.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.462+0000 7f8c01200640 1 -- 172.21.15.59:0/2794584734 learned_addr learned my addr 172.21.15.59:0/2794584734 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8c01200640 1 -- 172.21.15.59:0/2794584734 >> v1:172.21.15.107:6789/0 conn(0x7f8bfc0b44e0 legacy=0x7f8bfc15efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8c01200640 1 -- 172.21.15.59:0/2794584734 >> v1:172.21.15.59:6789/0 conn(0x7f8bfc159100 legacy=0x7f8bfc06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8c01200640 1 -- 172.21.15.59:0/2794584734 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc0b4ff0 con 0x7f8bfc15c010 2024-05-30T16:49:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8c01200640 1 --2- 172.21.15.59:0/2794584734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc15c010 0x7f8bfc15c440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009e50 tx=0x7f8bf401eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b6a80ffccf1c67 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8bfb400640 1 -- 172.21.15.59:0/2794584734 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40a7850 con 0x7f8bfc15c010 2024-05-30T16:49:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8bfb400640 1 -- 172.21.15.59:0/2794584734 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf40a79f0 con 0x7f8bfc15c010 2024-05-30T16:49:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8bfb400640 1 -- 172.21.15.59:0/2794584734 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40a7dc0 con 0x7f8bfc15c010 2024-05-30T16:49:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8c03200640 1 -- 172.21.15.59:0/2794584734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc15c010 msgr2=0x7f8bfc15c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8c03200640 1 --2- 172.21.15.59:0/2794584734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc15c010 0x7f8bfc15c440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009e50 tx=0x7f8bf401eb70 comp rx=0 tx=0).stop 2024-05-30T16:49:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8c03200640 1 -- 172.21.15.59:0/2794584734 shutdown_connections 2024-05-30T16:49:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8c03200640 1 --2- 172.21.15.59:0/2794584734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc15c010 0x7f8bfc15c440 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8c03200640 1 -- 172.21.15.59:0/2794584734 >> 172.21.15.59:0/2794584734 conn(0x7f8bfc06bdb0 msgr2=0x7f8bfc06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:53.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8c03200640 1 -- 172.21.15.59:0/2794584734 shutdown_connections 2024-05-30T16:49:53.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.466+0000 7f8c03200640 1 -- 172.21.15.59:0/2794584734 wait complete. 2024-05-30T16:49:53.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8c03200640 1 Processor -- start 2024-05-30T16:49:53.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8c03200640 1 -- start start 2024-05-30T16:49:53.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8c03200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0b44e0 0x7f8bfc146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8c03200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bfc159100 0x7f8bfc1525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8c03200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bfc15c010 0x7f8bfc0b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8c03200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc0b37e0 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8c03200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc0b3660 con 0x7f8bfc159100 2024-05-30T16:49:53.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8c03200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8bfc0b3960 con 0x7f8bfc15c010 2024-05-30T16:49:53.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8bfbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0b44e0 0x7f8bfc146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8bfbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0b44e0 0x7f8bfc146200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55064/0 (socket says 172.21.15.59:55064) 2024-05-30T16:49:53.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8bfbe00640 1 -- 172.21.15.59:0/1823428494 learned_addr learned my addr 172.21.15.59:0/1823428494 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:53.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8bfbe00640 1 -- 172.21.15.59:0/1823428494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bfc15c010 msgr2=0x7f8bfc0b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8bfbe00640 1 --2- 172.21.15.59:0/1823428494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bfc15c010 0x7f8bfc0b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8bfbe00640 1 -- 172.21.15.59:0/1823428494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bfc159100 msgr2=0x7f8bfc1525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8bfbe00640 1 --2- 172.21.15.59:0/1823428494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bfc159100 0x7f8bfc1525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8bfbe00640 1 -- 172.21.15.59:0/1823428494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc146740 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8bfbe00640 1 --2- 172.21.15.59:0/1823428494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0b44e0 0x7f8bfc146200 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00c450 tx=0x7f8bec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8bf8c00640 1 -- 172.21.15.59:0/1823428494 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec016020 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8bf8c00640 1 -- 172.21.15.59:0/1823428494 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bec0052d0 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8c03200640 1 -- 172.21.15.59:0/1823428494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bfc153090 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8bf8c00640 1 -- 172.21.15.59:0/1823428494 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec007260 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.470+0000 7f8c03200640 1 -- 172.21.15.59:0/1823428494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bfc153650 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.474+0000 7f8c03200640 1 -- 172.21.15.59:0/1823428494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bfc068a90 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.474+0000 7f8bf8c00640 1 -- 172.21.15.59:0/1823428494 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8bec007400 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.474+0000 7f8bf8c00640 1 --2- 172.21.15.59:0/1823428494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8bd8068380 0x7f8bd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.474+0000 7f8bf8c00640 1 -- 172.21.15.59:0/1823428494 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8bec086390 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.474+0000 7f8bf3400640 1 --2- 172.21.15.59:0/1823428494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8bd8068380 0x7f8bd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.474+0000 7f8bf3400640 1 --2- 172.21.15.59:0/1823428494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8bd8068380 0x7f8bd806a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc15ec00 tx=0x7f8be40079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.478+0000 7f8bf8c00640 1 -- 172.21.15.59:0/1823428494 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8bec020020 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.702+0000 7f8c03200640 1 -- 172.21.15.59:0/1823428494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8bfc074c90 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.702+0000 7f8bf8c00640 1 -- 172.21.15.59:0/1823428494 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f8bec005480 con 0x7f8bfc0b44e0 2024-05-30T16:49:53.708 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-05-30T16:49:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA== 2024-05-30T16:49:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-05-30T16:49:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-05-30T16:49:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T16:49:53.709 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-05-30T16:49:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.706+0000 7f8c03200640 1 -- 172.21.15.59:0/1823428494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8bd8068380 msgr2=0x7f8bd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.706+0000 7f8c03200640 1 --2- 172.21.15.59:0/1823428494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8bd8068380 0x7f8bd806a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc15ec00 tx=0x7f8be40079c0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.706+0000 7f8c03200640 1 -- 172.21.15.59:0/1823428494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0b44e0 msgr2=0x7f8bfc146200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.706+0000 7f8c03200640 1 --2- 172.21.15.59:0/1823428494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0b44e0 0x7f8bfc146200 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00c450 tx=0x7f8bec00c910 comp rx=0 tx=0).stop 2024-05-30T16:49:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.706+0000 7f8c03200640 1 -- 172.21.15.59:0/1823428494 shutdown_connections 2024-05-30T16:49:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.706+0000 7f8c03200640 1 --2- 172.21.15.59:0/1823428494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8bd8068380 0x7f8bd806a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.706+0000 7f8c03200640 1 --2- 172.21.15.59:0/1823428494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bfc15c010 0x7f8bfc0b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.706+0000 7f8c03200640 1 --2- 172.21.15.59:0/1823428494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bfc159100 0x7f8bfc1525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.706+0000 7f8c03200640 1 --2- 172.21.15.59:0/1823428494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0b44e0 0x7f8bfc146200 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.706+0000 7f8c03200640 1 -- 172.21.15.59:0/1823428494 >> 172.21.15.59:0/1823428494 conn(0x7f8bfc06bdb0 msgr2=0x7f8bfc0b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.706+0000 7f8c03200640 1 -- 172.21.15.59:0/1823428494 shutdown_connections 2024-05-30T16:49:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.706+0000 7f8c03200640 1 -- 172.21.15.59:0/1823428494 wait complete. 2024-05-30T16:49:53.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47c5800640 1 Processor -- start 2024-05-30T16:49:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47c5800640 1 -- start start 2024-05-30T16:49:53.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47c5800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47c0156ca0 0x7f47c00ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47c5800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47c00ce880 0x7f47c00720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47c5800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c01601d0 con 0x7f47c0160c90 2024-05-30T16:49:53.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47c5800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f47c00b0250 con 0x7f47c0156ca0 2024-05-30T16:49:53.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47c5800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f47c0160800 con 0x7f47c00ce880 2024-05-30T16:49:53.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47bfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47c0156ca0 0x7f47c00ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47bfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47c0156ca0 0x7f47c00ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55070/0 (socket says 172.21.15.59:55070) 2024-05-30T16:49:53.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47bfe00640 1 -- 172.21.15.59:0/3151987364 learned_addr learned my addr 172.21.15.59:0/3151987364 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:53.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47b7e00640 1 --2- 172.21.15.59:0/3151987364 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47c00ce880 0x7f47c00720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47bfe00640 1 -- 172.21.15.59:0/3151987364 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47c00ce880 msgr2=0x7f47c00720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:53.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47bfe00640 1 --2- 172.21.15.59:0/3151987364 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47c00ce880 0x7f47c00720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47bfe00640 1 -- 172.21.15.59:0/3151987364 >> v1:172.21.15.107:6789/0 conn(0x7f47c0160c90 legacy=0x7f47c00cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:53.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47bfe00640 1 -- 172.21.15.59:0/3151987364 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c00ced50 con 0x7f47c0156ca0 2024-05-30T16:49:53.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.866+0000 7f47b7e00640 1 --2- 172.21.15.59:0/3151987364 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47c00ce880 0x7f47c00720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:53.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.870+0000 7f47bfe00640 1 --2- 172.21.15.59:0/3151987364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c0156ca0 0x7f47c00ce340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009870 tx=0x7f47b001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6d74f2c47ef6bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.870+0000 7f47bf400640 1 -- 172.21.15.59:0/3151987364 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b00b0070 con 0x7f47c0156ca0 2024-05-30T16:49:53.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.870+0000 7f47bf400640 1 -- 172.21.15.59:0/3151987364 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b00ab600 con 0x7f47c0156ca0 2024-05-30T16:49:53.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.870+0000 7f47bf400640 1 -- 172.21.15.59:0/3151987364 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b00ab9d0 con 0x7f47c0156ca0 2024-05-30T16:49:53.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.870+0000 7f47c5800640 1 -- 172.21.15.59:0/3151987364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c0156ca0 msgr2=0x7f47c00ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.870+0000 7f47c5800640 1 --2- 172.21.15.59:0/3151987364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c0156ca0 0x7f47c00ce340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009870 tx=0x7f47b001c520 comp rx=0 tx=0).stop 2024-05-30T16:49:53.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.870+0000 7f47c5800640 1 -- 172.21.15.59:0/3151987364 shutdown_connections 2024-05-30T16:49:53.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.870+0000 7f47c5800640 1 --2- 172.21.15.59:0/3151987364 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47c00ce880 0x7f47c00720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.870+0000 7f47c5800640 1 --2- 172.21.15.59:0/3151987364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c0156ca0 0x7f47c00ce340 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.870+0000 7f47c5800640 1 -- 172.21.15.59:0/3151987364 >> 172.21.15.59:0/3151987364 conn(0x7f47c006b9b0 msgr2=0x7f47c006bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:53.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.870+0000 7f47c5800640 1 -- 172.21.15.59:0/3151987364 shutdown_connections 2024-05-30T16:49:53.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.870+0000 7f47c5800640 1 -- 172.21.15.59:0/3151987364 wait complete. 2024-05-30T16:49:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47c5800640 1 Processor -- start 2024-05-30T16:49:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47c5800640 1 -- start start 2024-05-30T16:49:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47c5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c00ce880 0x7f47c01532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47c5800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47c0156ca0 0x7f47c0151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47c5800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47c0160c90 0x7f47c015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47c5800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f47c0169600 con 0x7f47c00ce880 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47c5800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f47c00729f0 con 0x7f47c0156ca0 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47c5800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f47c0169780 con 0x7f47c0160c90 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c00ce880 0x7f47c01532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c00ce880 0x7f47c01532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55084/0 (socket says 172.21.15.59:55084) 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47bfe00640 1 -- 172.21.15.59:0/2472653413 learned_addr learned my addr 172.21.15.59:0/2472653413 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47b7e00640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47c0156ca0 0x7f47c0151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47bfe00640 1 -- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47c0160c90 msgr2=0x7f47c015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47c4e00640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47c0160c90 0x7f47c015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47bfe00640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47c0160c90 0x7f47c015b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47bfe00640 1 -- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47c0156ca0 msgr2=0x7f47c0151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47bfe00640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47c0156ca0 0x7f47c0151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47bfe00640 1 -- 172.21.15.59:0/2472653413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c00aa3c0 con 0x7f47c00ce880 2024-05-30T16:49:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47b7e00640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47c0156ca0 0x7f47c0151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47c4e00640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47c0160c90 0x7f47c015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47bfe00640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c00ce880 0x7f47c01532f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f47b00ae040 tx=0x7f47b001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47bcc00640 1 -- 172.21.15.59:0/2472653413 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b00ba020 con 0x7f47c00ce880 2024-05-30T16:49:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47bcc00640 1 -- 172.21.15.59:0/2472653413 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b00b6640 con 0x7f47c00ce880 2024-05-30T16:49:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47c5800640 1 -- 172.21.15.59:0/2472653413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c0151d10 con 0x7f47c00ce880 2024-05-30T16:49:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47bcc00640 1 -- 172.21.15.59:0/2472653413 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b00b0040 con 0x7f47c00ce880 2024-05-30T16:49:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.874+0000 7f47c5800640 1 -- 172.21.15.59:0/2472653413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c01522d0 con 0x7f47c00ce880 2024-05-30T16:49:53.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.878+0000 7f47c5800640 1 -- 172.21.15.59:0/2472653413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c00691a0 con 0x7f47c00ce880 2024-05-30T16:49:53.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.878+0000 7f47bcc00640 1 -- 172.21.15.59:0/2472653413 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f47b00bd020 con 0x7f47c00ce880 2024-05-30T16:49:53.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.878+0000 7f47bcc00640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f479c068380 0x7f479c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.878+0000 7f47bcc00640 1 -- 172.21.15.59:0/2472653413 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f47b0120d10 con 0x7f47c00ce880 2024-05-30T16:49:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.878+0000 7f47b7e00640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f479c068380 0x7f479c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.878+0000 7f47b7e00640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f479c068380 0x7f479c06a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f47c0167340 tx=0x7f47a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:53.882+0000 7f47bcc00640 1 -- 172.21.15.59:0/2472653413 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f47b0126020 con 0x7f47c00ce880 2024-05-30T16:49:54.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 -- 172.21.15.59:0/2472653413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47c00b0850 con 0x7f47c00ce880 2024-05-30T16:49:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47bcc00640 1 -- 172.21.15.59:0/2472653413 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5184 (secure 0 0 0) 0x7f47b00c4030 con 0x7f47c00ce880 2024-05-30T16:49:54.086 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:49:54.086 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1119687744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1119687744},{"type":"v1","addr":"172.21.15.107:6836","nonce":1119687744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/985448024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":985448024},{"type":"v1","addr":"172.21.15.107:6837","nonce":985448024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4747,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1214274073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1214274073},{"type":"v1","addr":"172.21.15.59:6834","nonce":1214274073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:48.139853+0000","modified":"2024-05-30T16:49:51.161912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4803},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4803":{"gid":4803,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3713717108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3713717108},{"type":"v1","addr":"172.21.15.59:6835","nonce":3713717108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4803,"qdb_cluster":[4803]},"id":2}]} 2024-05-30T16:49:54.087 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 16 2024-05-30T16:49:54.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 -- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f479c068380 msgr2=0x7f479c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f479c068380 0x7f479c06a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f47c0167340 tx=0x7f47a8008040 comp rx=0 tx=0).stop 2024-05-30T16:49:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 -- 172.21.15.59:0/2472653413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c00ce880 msgr2=0x7f47c01532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c00ce880 0x7f47c01532f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f47b00ae040 tx=0x7f47b001ad60 comp rx=0 tx=0).stop 2024-05-30T16:49:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 -- 172.21.15.59:0/2472653413 shutdown_connections 2024-05-30T16:49:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f479c068380 0x7f479c06a840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47c0160c90 0x7f47c015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47c0156ca0 0x7f47c0151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 --2- 172.21.15.59:0/2472653413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c00ce880 0x7f47c01532f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 -- 172.21.15.59:0/2472653413 >> 172.21.15.59:0/2472653413 conn(0x7f47c006b9b0 msgr2=0x7f47c00b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 -- 172.21.15.59:0/2472653413 shutdown_connections 2024-05-30T16:49:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.082+0000 7f47c5800640 1 -- 172.21.15.59:0/2472653413 wait complete. 2024-05-30T16:49:54.511 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T16:49:48.139853+0000', 'modified': '2024-05-30T16:49:51.161912+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4803}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4803': {'gid': 4803, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/3713717108', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 3713717108}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 3713717108}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4803, 'qdb_cluster': [4803]} 2024-05-30T16:49:54.512 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T16:49:54.512 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-30T16:49:54.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.650+0000 7f87d5c00640 1 Processor -- start 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.650+0000 7f87d5c00640 1 -- start start 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87d5c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87d00ce2e0 0x7f87d00708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87d5c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f87d006dad0 0x7f87d0070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87d5c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87d009b7c0 con 0x7f87d00ce6c0 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87d5c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f87d009baa0 con 0x7f87d00ce2e0 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87d5c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f87d009bd80 con 0x7f87d006dad0 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87cea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87d00ce2e0 0x7f87d00708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87cea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87d00ce2e0 0x7f87d00708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55092/0 (socket says 172.21.15.59:55092) 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87cea00640 1 -- 172.21.15.59:0/2646643034 learned_addr learned my addr 172.21.15.59:0/2646643034 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87cf400640 1 --2- 172.21.15.59:0/2646643034 >> v2:172.21.15.107:3300/0 conn(0x7f87d006dad0 0x7f87d0070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87cea00640 1 -- 172.21.15.59:0/2646643034 >> v2:172.21.15.107:3300/0 conn(0x7f87d006dad0 msgr2=0x7f87d0070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87cea00640 1 --2- 172.21.15.59:0/2646643034 >> v2:172.21.15.107:3300/0 conn(0x7f87d006dad0 0x7f87d0070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87cea00640 1 -- 172.21.15.59:0/2646643034 >> v1:172.21.15.107:6789/0 conn(0x7f87d00ce6c0 legacy=0x7f87d00d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.654+0000 7f87cea00640 1 -- 172.21.15.59:0/2646643034 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d00d0980 con 0x7f87d00ce2e0 2024-05-30T16:49:54.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87cea00640 1 --2- 172.21.15.59:0/2646643034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d00ce2e0 0x7f87d00708f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f87d0071480 tx=0x7f87c001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fb95d06065bb52 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87ce000640 1 -- 172.21.15.59:0/2646643034 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c00ab640 con 0x7f87d00ce2e0 2024-05-30T16:49:54.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87ce000640 1 -- 172.21.15.59:0/2646643034 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c00b0070 con 0x7f87d00ce2e0 2024-05-30T16:49:54.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87ce000640 1 -- 172.21.15.59:0/2646643034 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c00aba00 con 0x7f87d00ce2e0 2024-05-30T16:49:54.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87d5c00640 1 -- 172.21.15.59:0/2646643034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d00ce2e0 msgr2=0x7f87d00708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87d5c00640 1 --2- 172.21.15.59:0/2646643034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d00ce2e0 0x7f87d00708f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f87d0071480 tx=0x7f87c001c420 comp rx=0 tx=0).stop 2024-05-30T16:49:54.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87d5c00640 1 -- 172.21.15.59:0/2646643034 shutdown_connections 2024-05-30T16:49:54.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87d5c00640 1 --2- 172.21.15.59:0/2646643034 >> v2:172.21.15.107:3300/0 conn(0x7f87d006dad0 0x7f87d0070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87d5c00640 1 --2- 172.21.15.59:0/2646643034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d00ce2e0 0x7f87d00708f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87d5c00640 1 -- 172.21.15.59:0/2646643034 >> 172.21.15.59:0/2646643034 conn(0x7f87d00b3f70 msgr2=0x7f87d00b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:54.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87d5c00640 1 -- 172.21.15.59:0/2646643034 shutdown_connections 2024-05-30T16:49:54.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87d5c00640 1 -- 172.21.15.59:0/2646643034 wait complete. 2024-05-30T16:49:54.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87d5c00640 1 Processor -- start 2024-05-30T16:49:54.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87d5c00640 1 -- start start 2024-05-30T16:49:54.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87d5c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d006dad0 0x7f87d014dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.658+0000 7f87d5c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87d00ce2e0 0x7f87d00b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87d5c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d00ce6c0 0x7f87d0151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87d5c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f87d00d2150 con 0x7f87d006dad0 2024-05-30T16:49:54.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87d5c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f87d00d1fd0 con 0x7f87d00ce2e0 2024-05-30T16:49:54.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87d5c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f87d016b6c0 con 0x7f87d00ce6c0 2024-05-30T16:49:54.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87cea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d006dad0 0x7f87d014dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87cea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d006dad0 0x7f87d014dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55108/0 (socket says 172.21.15.59:55108) 2024-05-30T16:49:54.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87cea00640 1 -- 172.21.15.59:0/4047484977 learned_addr learned my addr 172.21.15.59:0/4047484977 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:54.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87cf400640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d00ce6c0 0x7f87d0151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87cea00640 1 -- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d00ce6c0 msgr2=0x7f87d0151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87c7e00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87d00ce2e0 0x7f87d00b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87cea00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d00ce6c0 0x7f87d0151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87cea00640 1 -- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87d00ce2e0 msgr2=0x7f87d00b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87cea00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87d00ce2e0 0x7f87d00b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87cea00640 1 -- 172.21.15.59:0/4047484977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d00b5810 con 0x7f87d006dad0 2024-05-30T16:49:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87cf400640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d00ce6c0 0x7f87d0151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87c7e00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87d00ce2e0 0x7f87d00b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87cea00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d006dad0 0x7f87d014dd80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f87c001a050 tx=0x7f87c001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87c6a00640 1 -- 172.21.15.59:0/4047484977 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c00be3f0 con 0x7f87d006dad0 2024-05-30T16:49:54.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87c6a00640 1 -- 172.21.15.59:0/4047484977 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c00be590 con 0x7f87d006dad0 2024-05-30T16:49:54.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87c6a00640 1 -- 172.21.15.59:0/4047484977 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c00be980 con 0x7f87d006dad0 2024-05-30T16:49:54.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87d5c00640 1 -- 172.21.15.59:0/4047484977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d0156f40 con 0x7f87d006dad0 2024-05-30T16:49:54.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87d5c00640 1 -- 172.21.15.59:0/4047484977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d0157500 con 0x7f87d006dad0 2024-05-30T16:49:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.662+0000 7f87c6a00640 1 -- 172.21.15.59:0/4047484977 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f87c00b43f0 con 0x7f87d006dad0 2024-05-30T16:49:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c6a00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f87ac068380 0x7f87ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c6a00640 1 -- 172.21.15.59:0/4047484977 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f87c0120bd0 con 0x7f87d006dad0 2024-05-30T16:49:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c7e00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f87ac068380 0x7f87ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 Processor -- start 2024-05-30T16:49:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 -- start start 2024-05-30T16:49:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c7e00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f87ac068380 0x7f87ac06a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f87d0156000 tx=0x7f87b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5120 0x55b5077a5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5a40 0x55b507758110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b507758650 0x55b507758a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b5075a9420 con 0x55b5077a5a40 2024-05-30T16:49:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b507543bf0 con 0x55b507758650 2024-05-30T16:49:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55b5075a53e0 con 0x55b5077a5120 2024-05-30T16:49:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5a40 0x55b507758110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87cea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5120 0x55b5077a5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5a40 0x55b507758110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55124/0 (socket says 172.21.15.59:55124) 2024-05-30T16:49:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c7e00640 1 -- 172.21.15.59:0/138417607 learned_addr learned my addr 172.21.15.59:0/138417607 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87cf400640 1 --2- 172.21.15.59:0/138417607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b507758650 0x55b507758a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c7e00640 1 -- 172.21.15.59:0/138417607 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5120 msgr2=0x55b5077a5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c7e00640 1 --2- 172.21.15.59:0/138417607 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5120 0x55b5077a5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c7e00640 1 -- 172.21.15.59:0/138417607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b507758650 msgr2=0x55b507758a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c7e00640 1 --2- 172.21.15.59:0/138417607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b507758650 0x55b507758a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c7e00640 1 -- 172.21.15.59:0/138417607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b507651450 con 0x55b5077a5a40 2024-05-30T16:49:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87c7e00640 1 --2- 172.21.15.59:0/138417607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5a40 0x55b507758110 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f87b800d880 tx=0x7f87b8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ad763e2fa78c27 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87bf400640 1 -- 172.21.15.59:0/138417607 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8024070 con 0x55b5077a5a40 2024-05-30T16:49:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87bf400640 1 -- 172.21.15.59:0/138417607 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b8014bc0 con 0x55b5077a5a40 2024-05-30T16:49:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87bf400640 1 -- 172.21.15.59:0/138417607 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b801f400 con 0x55b5077a5a40 2024-05-30T16:49:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 -- 172.21.15.59:0/138417607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5a40 msgr2=0x55b507758110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 --2- 172.21.15.59:0/138417607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5a40 0x55b507758110 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f87b800d880 tx=0x7f87b8010000 comp rx=0 tx=0).stop 2024-05-30T16:49:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 -- 172.21.15.59:0/138417607 shutdown_connections 2024-05-30T16:49:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 --2- 172.21.15.59:0/138417607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b507758650 0x55b507758a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 --2- 172.21.15.59:0/138417607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5a40 0x55b507758110 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 --2- 172.21.15.59:0/138417607 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5120 0x55b5077a5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 -- 172.21.15.59:0/138417607 >> 172.21.15.59:0/138417607 conn(0x55b507785ec0 msgr2=0x55b5077882b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 -- 172.21.15.59:0/138417607 shutdown_connections 2024-05-30T16:49:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.666+0000 7f87d919a000 1 -- 172.21.15.59:0/138417607 wait complete. 2024-05-30T16:49:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 1 -- start start 2024-05-30T16:49:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 1 Processor -- start 2024-05-30T16:49:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b507758650 0x55b50775db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 0x55b50775e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5a40 0x55b50775e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b507549ec0 con 0x55b5077a5120 2024-05-30T16:49:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b50762a120 con 0x55b507758650 2024-05-30T16:49:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55b5075b4350 con 0x55b5077a5a40 2024-05-30T16:49:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 10 client.0 _ll_register_callbacks cb 0x55b5075864d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:49:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87c7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 0x55b50775e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87c7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 0x55b50775e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55136/0 (socket says 172.21.15.59:55136) 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87c7e00640 1 -- 172.21.15.59:0/3676129730 learned_addr learned my addr 172.21.15.59:0/3676129730 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87cf400640 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5a40 0x55b50775e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87cea00640 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b507758650 0x55b50775db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87c7e00640 1 -- 172.21.15.59:0/3676129730 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5a40 msgr2=0x55b50775e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87c7e00640 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5a40 0x55b50775e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87c7e00640 1 -- 172.21.15.59:0/3676129730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b507758650 msgr2=0x55b50775db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87c7e00640 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b507758650 0x55b50775db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87c7e00640 1 -- 172.21.15.59:0/3676129730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5075eef80 con 0x55b5077a5120 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87cf400640 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5a40 0x55b50775e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87cea00640 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b507758650 0x55b50775db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87c7e00640 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 0x55b50775e080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f87b8005450 tx=0x7f87b8003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8521dcaf4fb9abb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87b3e00640 1 -- 172.21.15.59:0/3676129730 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b802d020 con 0x55b5077a5120 2024-05-30T16:49:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87b3e00640 1 -- 172.21.15.59:0/3676129730 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f87b80069e0 con 0x55b5077a5120 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 1 -- 172.21.15.59:0/3676129730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87b8014bc0 con 0x55b5077a5120 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87b3e00640 1 -- 172.21.15.59:0/3676129730 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f87b8037050 con 0x55b5077a5120 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 10 client.4974 fetch_fsmap learned FSMap version 16 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 1 -- 172.21.15.59:0/3676129730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55b507582f00 con 0x55b5077a5120 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87b3e00640 1 -- 172.21.15.59:0/3676129730 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b8014bc0 con 0x55b5077a5120 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87b3e00640 1 -- 172.21.15.59:0/3676129730 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7f87b8006c20 con 0x55b5077a5120 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 10 client.4974 fetch_fsmap finished waiting for FSMap version 16 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 10 client.4974 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 20 client.4974 populate_metadata read hostname 'smithi059' 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.59:6833/3713717108,v1:172.21.15.59:6835/3713717108] conn(0x55b5077b43c0 0x55b5077b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 4 client.4974 mds_command: new command op to 4803 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.670+0000 7f87d919a000 1 -- 172.21.15.59:0/3676129730 --> [v2:172.21.15.59:6833/3713717108,v1:172.21.15.59:6835/3713717108] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b507542bc0 con 0x55b5077b43c0 2024-05-30T16:49:54.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87cea00640 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.59:6833/3713717108,v1:172.21.15.59:6835/3713717108] conn(0x55b5077b43c0 0x55b5077b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87cea00640 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.59:6833/3713717108,v1:172.21.15.59:6835/3713717108] conn(0x55b5077b43c0 0x55b5077b67b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc87b52570ef5bea server_cookie=66f609e7aa320546 in_seq=0 out_seq=0 2024-05-30T16:49:54.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87b3e00640 10 client.4974 ms_handle_connect on v2:172.21.15.59:6833/3713717108 2024-05-30T16:49:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87b3e00640 1 -- 172.21.15.59:0/3676129730 <== mds.0 v2:172.21.15.59:6833/3713717108 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b507542bc0 con 0x55b5077b43c0 2024-05-30T16:49:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87b3e00640 10 client.4974 handle_command_reply: tid=0 2024-05-30T16:49:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87d919a000 1 client.4974 shutdown 2024-05-30T16:49:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87d919a000 1 -- 172.21.15.59:0/3676129730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 msgr2=0x55b50775e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87d919a000 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 0x55b50775e080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f87b8005450 tx=0x7f87b8003700 comp rx=0 tx=0).stop 2024-05-30T16:49:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87d919a000 1 -- 172.21.15.59:0/3676129730 shutdown_connections 2024-05-30T16:49:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87d919a000 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.59:6833/3713717108,v1:172.21.15.59:6835/3713717108] conn(0x55b5077b43c0 0x55b5077b67b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87d919a000 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5a40 0x55b50775e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87d919a000 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 0x55b50775e080 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87d919a000 1 --2- 172.21.15.59:0/3676129730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b507758650 0x55b50775db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87b3e00640 0 client.4974 ms_handle_reset on v2:172.21.15.59:6833/3713717108 2024-05-30T16:49:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87d919a000 1 -- 172.21.15.59:0/3676129730 >> 172.21.15.59:0/3676129730 conn(0x55b507785ec0 msgr2=0x55b5077882b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87d919a000 1 -- 172.21.15.59:0/3676129730 shutdown_connections 2024-05-30T16:49:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87d919a000 1 -- 172.21.15.59:0/3676129730 wait complete. 2024-05-30T16:49:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.674+0000 7f87d919a000 20 client.4974 trim_cache size 0 max 16384 2024-05-30T16:49:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.690+0000 7f87d919a000 1 Processor -- start 2024-05-30T16:49:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.690+0000 7f87d919a000 1 -- start start 2024-05-30T16:49:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b507758650 0x55b5077a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b5077a5120 0x55b5077a4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5a40 0x55b5077b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f87d015d1a0 con 0x55b507758650 2024-05-30T16:49:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f87d01566f0 con 0x55b5077a5120 2024-05-30T16:49:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f87d015cb50 con 0x55b5077a5a40 2024-05-30T16:49:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87cea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b507758650 0x55b5077a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87cea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b507758650 0x55b5077a41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55152/0 (socket says 172.21.15.59:55152) 2024-05-30T16:49:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87cea00640 1 -- 172.21.15.59:0/3770405684 learned_addr learned my addr 172.21.15.59:0/3770405684 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87cf400640 1 --2- 172.21.15.59:0/3770405684 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5a40 0x55b5077b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87c7e00640 1 --2- 172.21.15.59:0/3770405684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b5077a5120 0x55b5077a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87cea00640 1 -- 172.21.15.59:0/3770405684 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5a40 msgr2=0x55b5077b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87cea00640 1 --2- 172.21.15.59:0/3770405684 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5a40 0x55b5077b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87cea00640 1 -- 172.21.15.59:0/3770405684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b5077a5120 msgr2=0x55b5077a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87cea00640 1 --2- 172.21.15.59:0/3770405684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b5077a5120 0x55b5077a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87cea00640 1 -- 172.21.15.59:0/3770405684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5077a5870 con 0x55b507758650 2024-05-30T16:49:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87c7e00640 1 --2- 172.21.15.59:0/3770405684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b5077a5120 0x55b5077a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87cea00640 1 --2- 172.21.15.59:0/3770405684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b507758650 0x55b5077a41e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f87c011f060 tx=0x7f87c011ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8ba7a5172939cf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87bea00640 1 -- 172.21.15.59:0/3770405684 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c00c4040 con 0x55b507758650 2024-05-30T16:49:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87bea00640 1 -- 172.21.15.59:0/3770405684 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c00b0040 con 0x55b507758650 2024-05-30T16:49:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87bea00640 1 -- 172.21.15.59:0/3770405684 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c00f0d00 con 0x55b507758650 2024-05-30T16:49:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 -- 172.21.15.59:0/3770405684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b507758650 msgr2=0x55b5077a41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 --2- 172.21.15.59:0/3770405684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b507758650 0x55b5077a41e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f87c011f060 tx=0x7f87c011ef30 comp rx=0 tx=0).stop 2024-05-30T16:49:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 -- 172.21.15.59:0/3770405684 shutdown_connections 2024-05-30T16:49:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 --2- 172.21.15.59:0/3770405684 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b5077a5a40 0x55b5077b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 --2- 172.21.15.59:0/3770405684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b5077a5120 0x55b5077a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 --2- 172.21.15.59:0/3770405684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b507758650 0x55b5077a41e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 -- 172.21.15.59:0/3770405684 >> 172.21.15.59:0/3770405684 conn(0x55b507785ec0 msgr2=0x55b507757100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 -- 172.21.15.59:0/3770405684 shutdown_connections 2024-05-30T16:49:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 -- 172.21.15.59:0/3770405684 wait complete. 2024-05-30T16:49:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 -- start start 2024-05-30T16:49:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 Processor -- start 2024-05-30T16:49:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b507758650 0x55b5077b9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 0x55b5077d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b5077a5a40 0x55b5077d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.694+0000 7f87d919a000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b5075a8730 con 0x55b5077a5120 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b5075759e0 con 0x55b5077a5a40 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55b5075ada50 con 0x55b507758650 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 10 client.0 _ll_register_callbacks cb 0x7f87b8022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87c7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 0x55b5077d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87c7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 0x55b5077d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55166/0 (socket says 172.21.15.59:55166) 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87c7e00640 1 -- 172.21.15.59:0/233541885 learned_addr learned my addr 172.21.15.59:0/233541885 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87cea00640 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b507758650 0x55b5077b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87cf400640 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b5077a5a40 0x55b5077d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87c7e00640 1 -- 172.21.15.59:0/233541885 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b507758650 msgr2=0x55b5077b9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87c7e00640 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b507758650 0x55b5077b9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87c7e00640 1 -- 172.21.15.59:0/233541885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b5077a5a40 msgr2=0x55b5077d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87c7e00640 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b5077a5a40 0x55b5077d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87c7e00640 1 -- 172.21.15.59:0/233541885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b50752fe80 con 0x55b5077a5120 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87c7e00640 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 0x55b5077d0340 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f87b800d590 tx=0x7f87b8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8568b8d8a6de8c78 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87b3e00640 1 -- 172.21.15.59:0/233541885 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8040060 con 0x55b5077a5120 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87b3e00640 1 -- 172.21.15.59:0/233541885 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f87b8006bf0 con 0x55b5077a5120 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 -- 172.21.15.59:0/233541885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87c00b0040 con 0x55b5077a5120 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87b3e00640 1 -- 172.21.15.59:0/233541885 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f87b8046050 con 0x55b5077a5120 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 10 client.4980 fetch_fsmap learned FSMap version 16 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 -- 172.21.15.59:0/233541885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55b507571b30 con 0x55b5077a5120 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87b3e00640 1 -- 172.21.15.59:0/233541885 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c00b0040 con 0x55b5077a5120 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87b3e00640 1 -- 172.21.15.59:0/233541885 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7f87b8049020 con 0x55b5077a5120 2024-05-30T16:49:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 10 client.4980 fetch_fsmap finished waiting for FSMap version 16 2024-05-30T16:49:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 10 client.4980 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T16:49:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 20 client.4980 populate_metadata read hostname 'smithi059' 2024-05-30T16:49:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.59:6833/3713717108,v1:172.21.15.59:6835/3713717108] conn(0x55b5078145e0 0x55b5078149c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 4 client.4980 mds_command: new command op to 4803 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T16:49:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 -- 172.21.15.59:0/233541885 --> [v2:172.21.15.59:6833/3713717108,v1:172.21.15.59:6835/3713717108] -- command(tid 0: {"prefix": "status"}) -- 0x55b5075b6e40 con 0x55b5078145e0 2024-05-30T16:49:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87cea00640 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.59:6833/3713717108,v1:172.21.15.59:6835/3713717108] conn(0x55b5078145e0 0x55b5078149c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87b3e00640 10 client.4980 ms_handle_connect on v2:172.21.15.59:6833/3713717108 2024-05-30T16:49:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87cea00640 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.59:6833/3713717108,v1:172.21.15.59:6835/3713717108] conn(0x55b5078145e0 0x55b5078149c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=693ce55094f42ef6 server_cookie=b949e58fdfd7d6e0 in_seq=0 out_seq=0 2024-05-30T16:49:54.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87b3e00640 1 -- 172.21.15.59:0/233541885 <== mds.0 v2:172.21.15.59:6833/3713717108 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55b5075b6e40 con 0x55b5078145e0 2024-05-30T16:49:54.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87b3e00640 10 client.4980 handle_command_reply: tid=0 2024-05-30T16:49:54.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 client.4980 shutdown 2024-05-30T16:49:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 -- 172.21.15.59:0/233541885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 msgr2=0x55b5077d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 0x55b5077d0340 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f87b800d590 tx=0x7f87b8013000 comp rx=0 tx=0).stop 2024-05-30T16:49:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 -- 172.21.15.59:0/233541885 shutdown_connections 2024-05-30T16:49:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.59:6833/3713717108,v1:172.21.15.59:6835/3713717108] conn(0x55b5078145e0 0x55b5078149c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b5077a5a40 0x55b5077d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5077a5120 0x55b5077d0340 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87b3e00640 0 client.4980 ms_handle_reset on v2:172.21.15.59:6833/3713717108 2024-05-30T16:49:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 --2- 172.21.15.59:0/233541885 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b507758650 0x55b5077b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 -- 172.21.15.59:0/233541885 >> 172.21.15.59:0/233541885 conn(0x55b507785ec0 msgr2=0x55b507757100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 -- 172.21.15.59:0/233541885 shutdown_connections 2024-05-30T16:49:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 1 -- 172.21.15.59:0/233541885 wait complete. 2024-05-30T16:49:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d919a000 20 client.4980 trim_cache size 0 max 16384 2024-05-30T16:49:54.710 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:49:54.710 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:49:54.710 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-05-30T16:49:54.710 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4803, 2024-05-30T16:49:54.710 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-05-30T16:49:54.710 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-05-30T16:49:54.710 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-05-30T16:49:54.710 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 5.9627619430000003, 2024-05-30T16:49:54.710 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 16, 2024-05-30T16:49:54.710 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 34, 2024-05-30T16:49:54.710 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 34, 2024-05-30T16:49:54.710 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 13.270221423000001 2024-05-30T16:49:54.711 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:49:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d5c00640 1 -- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f87ac068380 msgr2=0x7f87ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d5c00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f87ac068380 0x7f87ac06a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f87d0156000 tx=0x7f87b8009040 comp rx=0 tx=0).stop 2024-05-30T16:49:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d5c00640 1 -- 172.21.15.59:0/4047484977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d006dad0 msgr2=0x7f87d014dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.698+0000 7f87d5c00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d006dad0 0x7f87d014dd80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f87c001a050 tx=0x7f87c001ac60 comp rx=0 tx=0).stop 2024-05-30T16:49:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.702+0000 7f87d5c00640 1 -- 172.21.15.59:0/4047484977 shutdown_connections 2024-05-30T16:49:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.702+0000 7f87d5c00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f87ac068380 0x7f87ac06a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.702+0000 7f87d5c00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d00ce6c0 0x7f87d0151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.702+0000 7f87d5c00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87d00ce2e0 0x7f87d00b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.702+0000 7f87d5c00640 1 --2- 172.21.15.59:0/4047484977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d006dad0 0x7f87d014dd80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.702+0000 7f87d5c00640 1 -- 172.21.15.59:0/4047484977 >> 172.21.15.59:0/4047484977 conn(0x7f87d00b3f70 msgr2=0x7f87d0158db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.702+0000 7f87d5c00640 1 -- 172.21.15.59:0/4047484977 shutdown_connections 2024-05-30T16:49:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.702+0000 7f87d5c00640 1 -- 172.21.15.59:0/4047484977 wait complete. 2024-05-30T16:49:54.725 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:49:54.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.862+0000 7fb28b600640 1 Processor -- start 2024-05-30T16:49:54.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.862+0000 7fb28b600640 1 -- start start 2024-05-30T16:49:54.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.862+0000 7fb28b600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2840af720 0x7fb28415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.862+0000 7fb28b600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28415f060 con 0x7fb28406e900 2024-05-30T16:49:54.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.862+0000 7fb28b600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28415ff00 con 0x7fb2840d0560 2024-05-30T16:49:54.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.862+0000 7fb28b600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb2840afb00 con 0x7fb2840af720 2024-05-30T16:49:54.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.862+0000 7fb288c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2840af720 0x7fb28415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.862+0000 7fb27be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb28406e900 0x7fb28415f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39190/0 (socket says 172.21.15.59:39190) 2024-05-30T16:49:54.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.862+0000 7fb27be00640 1 -- 172.21.15.59:0/2668179985 learned_addr learned my addr 172.21.15.59:0/2668179985 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb288c00640 1 -- 172.21.15.59:0/2668179985 >> v1:172.21.15.107:6789/0 conn(0x7fb2840d0560 legacy=0x7fb284072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb288c00640 1 -- 172.21.15.59:0/2668179985 >> v1:172.21.15.59:6789/0 conn(0x7fb28406e900 legacy=0x7fb28415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb288c00640 1 -- 172.21.15.59:0/2668179985 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28415c270 con 0x7fb2840af720 2024-05-30T16:49:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb283e00640 1 -- 172.21.15.59:0/2668179985 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2927190594 0 0) 0x7fb28415f060 con 0x7fb28406e900 2024-05-30T16:49:54.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb288c00640 1 --2- 172.21.15.59:0/2668179985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2840af720 0x7fb28415b9d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb2740097c0 tx=0x7fb27401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c59948928e7bb64 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb283e00640 1 -- 172.21.15.59:0/2668179985 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740ab650 con 0x7fb2840af720 2024-05-30T16:49:54.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb283e00640 1 -- 172.21.15.59:0/2668179985 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2740b0070 con 0x7fb2840af720 2024-05-30T16:49:54.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb283e00640 1 -- 172.21.15.59:0/2668179985 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740aba10 con 0x7fb2840af720 2024-05-30T16:49:54.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb28b600640 1 -- 172.21.15.59:0/2668179985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2840af720 msgr2=0x7fb28415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb28b600640 1 --2- 172.21.15.59:0/2668179985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2840af720 0x7fb28415b9d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb2740097c0 tx=0x7fb27401c430 comp rx=0 tx=0).stop 2024-05-30T16:49:54.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb28b600640 1 -- 172.21.15.59:0/2668179985 shutdown_connections 2024-05-30T16:49:54.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb28b600640 1 --2- 172.21.15.59:0/2668179985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2840af720 0x7fb28415b9d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.866+0000 7fb28b600640 1 -- 172.21.15.59:0/2668179985 >> 172.21.15.59:0/2668179985 conn(0x7fb2840b22d0 msgr2=0x7fb2840b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:54.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb28b600640 1 -- 172.21.15.59:0/2668179985 shutdown_connections 2024-05-30T16:49:54.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb28b600640 1 -- 172.21.15.59:0/2668179985 wait complete. 2024-05-30T16:49:54.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb28b600640 1 Processor -- start 2024-05-30T16:49:54.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb28b600640 1 -- start start 2024-05-30T16:49:54.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb28b600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28406e900 0x7fb284150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb28b600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2840af720 0x7fb284164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb28b600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2840d0560 0x7fb28406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb28b600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb28415c830 con 0x7fb28406e900 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb28b600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb28415bf10 con 0x7fb2840af720 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb28b600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb284158dd0 con 0x7fb2840d0560 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb288c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28406e900 0x7fb284150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb288c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28406e900 0x7fb284150050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55174/0 (socket says 172.21.15.59:55174) 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb288c00640 1 -- 172.21.15.59:0/1946015528 learned_addr learned my addr 172.21.15.59:0/1946015528 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb27be00640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2840af720 0x7fb284164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb289600640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2840d0560 0x7fb28406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb288c00640 1 -- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2840d0560 msgr2=0x7fb28406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb288c00640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2840d0560 0x7fb28406b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb288c00640 1 -- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2840af720 msgr2=0x7fb284164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb288c00640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2840af720 0x7fb284164cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb288c00640 1 -- 172.21.15.59:0/1946015528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2840b0930 con 0x7fb28406e900 2024-05-30T16:49:54.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb27be00640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2840af720 0x7fb284164cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:54.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb289600640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2840d0560 0x7fb28406b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:54.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb288c00640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28406e900 0x7fb284150050 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb274019040 tx=0x7fb27401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb281600640 1 -- 172.21.15.59:0/1946015528 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740bf610 con 0x7fb28406e900 2024-05-30T16:49:54.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb281600640 1 -- 172.21.15.59:0/1946015528 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2740bf7d0 con 0x7fb28406e900 2024-05-30T16:49:54.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb281600640 1 -- 172.21.15.59:0/1946015528 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740bfbc0 con 0x7fb28406e900 2024-05-30T16:49:54.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.870+0000 7fb28b600640 1 -- 172.21.15.59:0/1946015528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb284155300 con 0x7fb28406e900 2024-05-30T16:49:54.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.874+0000 7fb28b600640 1 -- 172.21.15.59:0/1946015528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb284155880 con 0x7fb28406e900 2024-05-30T16:49:54.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.874+0000 7fb28b600640 1 -- 172.21.15.59:0/1946015528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb284068a90 con 0x7fb28406e900 2024-05-30T16:49:54.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.874+0000 7fb281600640 1 -- 172.21.15.59:0/1946015528 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb2740bd020 con 0x7fb28406e900 2024-05-30T16:49:54.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.874+0000 7fb281600640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb260068380 0x7fb26006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.874+0000 7fb281600640 1 -- 172.21.15.59:0/1946015528 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb274121550 con 0x7fb28406e900 2024-05-30T16:49:54.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.874+0000 7fb27be00640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb260068380 0x7fb26006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.874+0000 7fb27be00640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb260068380 0x7fb26006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb284164910 tx=0x7fb26c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:54.878+0000 7fb281600640 1 -- 172.21.15.59:0/1946015528 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb274016050 con 0x7fb28406e900 2024-05-30T16:49:55.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.078+0000 7fb28b600640 1 -- 172.21.15.59:0/1946015528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb2840b29c0 con 0x7fb28406e900 2024-05-30T16:49:55.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb281600640 1 -- 172.21.15.59:0/1946015528 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7fb2740f1a70 con 0x7fb28406e900 2024-05-30T16:49:55.086 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:49:55.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb28b600640 1 -- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb260068380 msgr2=0x7fb26006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:55.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb28b600640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb260068380 0x7fb26006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb284164910 tx=0x7fb26c009040 comp rx=0 tx=0).stop 2024-05-30T16:49:55.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb28b600640 1 -- 172.21.15.59:0/1946015528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28406e900 msgr2=0x7fb284150050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:55.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb28b600640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28406e900 0x7fb284150050 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb274019040 tx=0x7fb27401ac70 comp rx=0 tx=0).stop 2024-05-30T16:49:55.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb28b600640 1 -- 172.21.15.59:0/1946015528 shutdown_connections 2024-05-30T16:49:55.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb28b600640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb260068380 0x7fb26006a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb28b600640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2840d0560 0x7fb28406b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb28b600640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2840af720 0x7fb284164cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb28b600640 1 --2- 172.21.15.59:0/1946015528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28406e900 0x7fb284150050 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb28b600640 1 -- 172.21.15.59:0/1946015528 >> 172.21.15.59:0/1946015528 conn(0x7fb2840b22d0 msgr2=0x7fb28415f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:55.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb28b600640 1 -- 172.21.15.59:0/1946015528 shutdown_connections 2024-05-30T16:49:55.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55.082+0000 7fb28b600640 1 -- 172.21.15.59:0/1946015528 wait complete. 2024-05-30T16:49:55.107 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:49:55.108 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:49:55.108 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-05-30T16:49:55.108 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T16:49:55.108 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:55.108 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:49:55.108 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:49:55.108 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:49:55.108 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:49:55.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:55.108 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-05-30T16:49:55.118 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:49:55.118 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:49:55.118 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:49:55.118 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:55.118 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-05-30T16:49:55.118 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:55.118 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:55.118 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:55.118 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-05-30T16:49:55.118 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:55.118 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42394sec preferred_lft 42394sec 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T16:49:55.119 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:46:82:05:9a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:55.120 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T16:49:55.120 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:55.120 INFO:teuthology.orchestra.run.smithi059.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:49:55.120 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T16:49:55.120 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:49:55.120 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:55.120 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T16:49:55.120 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:55.120 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:49:55.120 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:55.120 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T16:49:55.120 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:55.121 INFO:teuthology.orchestra.run.smithi059.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:49:55.121 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:49:55.121 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T16:49:55.121 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:49:55.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:55.122 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:49:55.183 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-05-30T16:49:55.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:55.185 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-05-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-05-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:49:55.239 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T16:49:55.239 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T16:49:55.239 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T16:49:55.239 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:49:55.239 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:49:55.239 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:49:55.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T16:49:55.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T16:49:55.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T16:49:55.239 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:49:55.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:49:55.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:55.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:55.378 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-05-30T16:49:55.387 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T16:49:55.387 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T16:49:55.388 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:49:55.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:55.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-05-30T16:49:55.449 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-30T16:49:55.449 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:49:55.449 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:55.501 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:49:55.501 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:49:55.501 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:55.552 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:49:55.613 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:49:55.667 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:49:55.667 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:49:55.667 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:49:55.667 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:49:55.668 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:49:55.668 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:49:55.668 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:49:55.668 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:49:55.668 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:49:55.668 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:49:55.669 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:49:55.669 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:49:55.669 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:49:55.669 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:49:55.669 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:49:55.669 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:49:55.669 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:49:55.670 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:49:55.670 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:49:55.670 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:49:55.670 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:49:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:49:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:49:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:49:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:49:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:49:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:49:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:49:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:49:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:49:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:49:55.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:55.672 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:49:55.725 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-30T16:49:55.725 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-30T16:49:55.776 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:49:55.798 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:49:55.851 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:49:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:49:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:49:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:49:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:49:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:49:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:49:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:49:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:49:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:49:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:49:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:49:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:49:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:49:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:49:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:49:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:49:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:49:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:49:55.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:55.855 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:49:55.873 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:2024-05-30T16:49:55.866+0000 7f70da874580 -1 init, newargv = 0x5593a37c4cf0 newargc=15 2024-05-30T16:49:55.873 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[35912]: starting ceph client 2024-05-30T16:49:55.880 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[35912]: starting fuse 2024-05-30T16:49:55.883 INFO:teuthology.orchestra.run.smithi059.stdout:44 2024-05-30T16:49:55.883 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-30T16:49:55.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2024-05-30T16:49:55.883 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2024-05-30T16:49:55.883 DEBUG:teuthology.orchestra.run.smithi059:> import re 2024-05-30T16:49:55.883 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-05-30T16:49:55.883 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2024-05-30T16:49:55.883 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:49:55.883 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2024-05-30T16:49:55.884 DEBUG:teuthology.orchestra.run.smithi059:> return f 2024-05-30T16:49:55.885 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-30T16:49:55.885 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:49:55.885 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.0")) 2024-05-30T16:49:55.885 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-05-30T16:49:56.011 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.0.35912.asok 2024-05-30T16:49:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:56.022 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35912.asok 2024-05-30T16:49:56.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:56.022 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35912.asok status 2024-05-30T16:49:56.197 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:49:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2024-05-30T16:49:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "9ed025fbf4406fb54980a0647506b15895b6d863", 2024-05-30T16:49:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-3154-g9ed025fb (9ed025fbf4406fb54980a0647506b15895b6d863) squid (dev)", 2024-05-30T16:49:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "0", 2024-05-30T16:49:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "35912", 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4995, 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 4995 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 696430975 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 696430975 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.4995 192.168.0.1:0/696430975", 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/696430975", 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2024-05-30T16:49:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 16, 2024-05-30T16:49:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 34, 2024-05-30T16:49:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2024-05-30T16:49:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2024-05-30T16:49:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2024-05-30T16:49:56.200 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:49:56.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:56.214 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2024-05-30T16:49:56.214 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:56.223 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2024-05-30T16:49:56.223 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:56.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:56.223 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:56.284 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T16:49:56.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22d7000640 1 Processor -- start 2024-05-30T16:49:56.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22d7000640 1 -- start start 2024-05-30T16:49:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22d7000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f22d00af840 0x7f22d006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22d7000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d006e120 con 0x7f22d006dc60 2024-05-30T16:49:56.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22d7000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d006e400 con 0x7f22d0156e40 2024-05-30T16:49:56.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22d7000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f22d006e6e0 con 0x7f22d00af840 2024-05-30T16:49:56.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22c7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f22d006dc60 0x7f22d00af130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39192/0 (socket says 172.21.15.59:39192) 2024-05-30T16:49:56.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22c7400640 1 -- 172.21.15.59:0/2094226799 learned_addr learned my addr 172.21.15.59:0/2094226799 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:56.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22d5000640 1 --2- 172.21.15.59:0/2094226799 >> v2:172.21.15.107:3300/0 conn(0x7f22d00af840 0x7f22d006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22cf400640 1 -- 172.21.15.59:0/2094226799 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4032842189 0 0) 0x7f22d006e120 con 0x7f22d006dc60 2024-05-30T16:49:56.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22cf400640 1 -- 172.21.15.59:0/2094226799 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22b4003530 con 0x7f22d006dc60 2024-05-30T16:49:56.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22d5000640 1 -- 172.21.15.59:0/2094226799 >> v1:172.21.15.107:6789/0 conn(0x7f22d0156e40 legacy=0x7f22d015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22d5000640 1 -- 172.21.15.59:0/2094226799 >> v1:172.21.15.59:6789/0 conn(0x7f22d006dc60 legacy=0x7f22d00af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.470+0000 7f22d5000640 1 -- 172.21.15.59:0/2094226799 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d006e9c0 con 0x7f22d00af840 2024-05-30T16:49:56.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.474+0000 7f22d5000640 1 --2- 172.21.15.59:0/2094226799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22d00af840 0x7f22d006f1c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009d90 tx=0x7f22c801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22052f6c7cc4e10f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:56.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.474+0000 7f22cf400640 1 -- 172.21.15.59:0/2094226799 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c80b2070 con 0x7f22d00af840 2024-05-30T16:49:56.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.474+0000 7f22cf400640 1 -- 172.21.15.59:0/2094226799 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c80a5940 con 0x7f22d00af840 2024-05-30T16:49:56.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.474+0000 7f22cf400640 1 -- 172.21.15.59:0/2094226799 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c80a5cf0 con 0x7f22d00af840 2024-05-30T16:49:56.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.474+0000 7f22d7000640 1 -- 172.21.15.59:0/2094226799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22d00af840 msgr2=0x7f22d006f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.474+0000 7f22d7000640 1 --2- 172.21.15.59:0/2094226799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22d00af840 0x7f22d006f1c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009d90 tx=0x7f22c801c970 comp rx=0 tx=0).stop 2024-05-30T16:49:56.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.474+0000 7f22d7000640 1 -- 172.21.15.59:0/2094226799 shutdown_connections 2024-05-30T16:49:56.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.474+0000 7f22d7000640 1 --2- 172.21.15.59:0/2094226799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22d00af840 0x7f22d006f1c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.474+0000 7f22d7000640 1 -- 172.21.15.59:0/2094226799 >> 172.21.15.59:0/2094226799 conn(0x7f22d00b1e60 msgr2=0x7f22d00b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:56.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.474+0000 7f22d7000640 1 -- 172.21.15.59:0/2094226799 shutdown_connections 2024-05-30T16:49:56.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.474+0000 7f22d7000640 1 -- 172.21.15.59:0/2094226799 wait complete. 2024-05-30T16:49:56.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22d7000640 1 Processor -- start 2024-05-30T16:49:56.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22d7000640 1 -- start start 2024-05-30T16:49:56.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22d7000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22d006dc60 0x7f22d014cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22d7000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00af840 0x7f22d00994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22d7000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22d0156e40 0x7f22d014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22d7000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f22d015eb70 con 0x7f22d00af840 2024-05-30T16:49:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22d7000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f22d015e9f0 con 0x7f22d006dc60 2024-05-30T16:49:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22d7000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f22d016a560 con 0x7f22d0156e40 2024-05-30T16:49:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22c7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00af840 0x7f22d00994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22cfe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22d006dc60 0x7f22d014cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22c7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00af840 0x7f22d00994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55178/0 (socket says 172.21.15.59:55178) 2024-05-30T16:49:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22c7400640 1 -- 172.21.15.59:0/1972744708 learned_addr learned my addr 172.21.15.59:0/1972744708 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22d5000640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22d0156e40 0x7f22d014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22c7400640 1 -- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22d0156e40 msgr2=0x7f22d014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22c7400640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22d0156e40 0x7f22d014b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22c7400640 1 -- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22d006dc60 msgr2=0x7f22d014cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22c7400640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22d006dc60 0x7f22d014cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22c7400640 1 -- 172.21.15.59:0/1972744708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d015d9e0 con 0x7f22d00af840 2024-05-30T16:49:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22c7400640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00af840 0x7f22d00994f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f22b800c400 tx=0x7f22b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22ccc00640 1 -- 172.21.15.59:0/1972744708 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8017070 con 0x7f22d00af840 2024-05-30T16:49:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22ccc00640 1 -- 172.21.15.59:0/1972744708 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b8005cf0 con 0x7f22d00af840 2024-05-30T16:49:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22ccc00640 1 -- 172.21.15.59:0/1972744708 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b80072d0 con 0x7f22d00af840 2024-05-30T16:49:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22d7000640 1 -- 172.21.15.59:0/1972744708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d0149f90 con 0x7f22d00af840 2024-05-30T16:49:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.478+0000 7f22d7000640 1 -- 172.21.15.59:0/1972744708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d015dc80 con 0x7f22d00af840 2024-05-30T16:49:56.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.482+0000 7f22d7000640 1 -- 172.21.15.59:0/1972744708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d0068a90 con 0x7f22d00af840 2024-05-30T16:49:56.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.482+0000 7f22ccc00640 1 -- 172.21.15.59:0/1972744708 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f22b8007470 con 0x7f22d00af840 2024-05-30T16:49:56.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.482+0000 7f22ccc00640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f22ac068380 0x7f22ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.482+0000 7f22ccc00640 1 -- 172.21.15.59:0/1972744708 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f22b8085d10 con 0x7f22d00af840 2024-05-30T16:49:56.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.482+0000 7f22cfe00640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f22ac068380 0x7f22ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.482+0000 7f22cfe00640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f22ac068380 0x7f22ac06a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f22d009e490 tx=0x7f22c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:56.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.486+0000 7f22ccc00640 1 -- 172.21.15.59:0/1972744708 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f22b808b020 con 0x7f22d00af840 2024-05-30T16:49:56.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.686+0000 7f22d7000640 1 -- 172.21.15.59:0/1972744708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f22d0073fe0 con 0x7f22d00af840 2024-05-30T16:49:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22ccc00640 1 -- 172.21.15.59:0/1972744708 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) ==== 136+0+0 (secure 0 0 0) 0x7f22b8055ca0 con 0x7f22d00af840 2024-05-30T16:49:56.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22d7000640 1 -- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f22ac068380 msgr2=0x7f22ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22d7000640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f22ac068380 0x7f22ac06a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f22d009e490 tx=0x7f22c0009040 comp rx=0 tx=0).stop 2024-05-30T16:49:56.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22d7000640 1 -- 172.21.15.59:0/1972744708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00af840 msgr2=0x7f22d00994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22d7000640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00af840 0x7f22d00994f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f22b800c400 tx=0x7f22b800c8c0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22d7000640 1 -- 172.21.15.59:0/1972744708 shutdown_connections 2024-05-30T16:49:56.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22d7000640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f22ac068380 0x7f22ac06a840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22d7000640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22d0156e40 0x7f22d014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22d7000640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00af840 0x7f22d00994f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22d7000640 1 --2- 172.21.15.59:0/1972744708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22d006dc60 0x7f22d014cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22d7000640 1 -- 172.21.15.59:0/1972744708 >> 172.21.15.59:0/1972744708 conn(0x7f22d00b1e60 msgr2=0x7f22d0145760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:56.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22d7000640 1 -- 172.21.15.59:0/1972744708 shutdown_connections 2024-05-30T16:49:56.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.790+0000 7f22d7000640 1 -- 172.21.15.59:0/1972744708 wait complete. 2024-05-30T16:49:56.816 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:49:56.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f6241200640 1 Processor -- start 2024-05-30T16:49:56.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f6241200640 1 -- start start 2024-05-30T16:49:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f6241200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f623c160c90 0x7f623c0720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f6241200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f623c0725e0 0x7f623c0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f6241200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623c1601d0 con 0x7f623c156ca0 2024-05-30T16:49:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f6241200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f623c0b0250 con 0x7f623c160c90 2024-05-30T16:49:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f6241200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f623c160800 con 0x7f623c0725e0 2024-05-30T16:49:56.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f623be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f623c0725e0 0x7f623c0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f6232a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f623c160c90 0x7f623c0720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f623b400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f623c156ca0 0x7f623c0ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:42554/0 (socket says 172.21.15.59:42554) 2024-05-30T16:49:56.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f623b400640 1 -- 172.21.15.59:0/3080080552 learned_addr learned my addr 172.21.15.59:0/3080080552 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:56.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f623be00640 1 -- 172.21.15.59:0/3080080552 >> v2:172.21.15.107:3300/0 conn(0x7f623c160c90 msgr2=0x7f623c0720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:56.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f623be00640 1 --2- 172.21.15.59:0/3080080552 >> v2:172.21.15.107:3300/0 conn(0x7f623c160c90 0x7f623c0720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f623be00640 1 -- 172.21.15.59:0/3080080552 >> v1:172.21.15.107:6789/0 conn(0x7f623c156ca0 legacy=0x7f623c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f623be00640 1 -- 172.21.15.59:0/3080080552 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c0ced50 con 0x7f623c0725e0 2024-05-30T16:49:56.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.954+0000 7f6232a00640 1 --2- 172.21.15.59:0/3080080552 >> v2:172.21.15.107:3300/0 conn(0x7f623c160c90 0x7f623c0720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.958+0000 7f623be00640 1 --2- 172.21.15.59:0/3080080552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f623c0725e0 0x7f623c0cd140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6234009d90 tx=0x7f623401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcdfd875247c87fd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.958+0000 7f623aa00640 1 -- 172.21.15.59:0/3080080552 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340b2070 con 0x7f623c0725e0 2024-05-30T16:49:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.958+0000 7f623aa00640 1 -- 172.21.15.59:0/3080080552 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62340a57a0 con 0x7f623c0725e0 2024-05-30T16:49:56.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.958+0000 7f623aa00640 1 -- 172.21.15.59:0/3080080552 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340a5b70 con 0x7f623c0725e0 2024-05-30T16:49:56.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.958+0000 7f6241200640 1 -- 172.21.15.59:0/3080080552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f623c0725e0 msgr2=0x7f623c0cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.958+0000 7f6241200640 1 --2- 172.21.15.59:0/3080080552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f623c0725e0 0x7f623c0cd140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6234009d90 tx=0x7f623401c8e0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.958+0000 7f6241200640 1 -- 172.21.15.59:0/3080080552 shutdown_connections 2024-05-30T16:49:56.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.958+0000 7f6241200640 1 --2- 172.21.15.59:0/3080080552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f623c0725e0 0x7f623c0cd140 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.958+0000 7f6241200640 1 --2- 172.21.15.59:0/3080080552 >> v2:172.21.15.107:3300/0 conn(0x7f623c160c90 0x7f623c0720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.958+0000 7f6241200640 1 -- 172.21.15.59:0/3080080552 >> 172.21.15.59:0/3080080552 conn(0x7f623c06b9b0 msgr2=0x7f623c06bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:56.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.958+0000 7f6241200640 1 -- 172.21.15.59:0/3080080552 shutdown_connections 2024-05-30T16:49:56.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.958+0000 7f6241200640 1 -- 172.21.15.59:0/3080080552 wait complete. 2024-05-30T16:49:56.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6241200640 1 Processor -- start 2024-05-30T16:49:56.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6241200640 1 -- start start 2024-05-30T16:49:56.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6241200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f623c0725e0 0x7f623c15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6241200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f623c156ca0 0x7f623c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6241200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f623c160c90 0x7f623c14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6241200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f623c1693f0 con 0x7f623c160c90 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6241200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f623c0cf030 con 0x7f623c0725e0 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6241200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f623c169570 con 0x7f623c156ca0 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f623be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f623c160c90 0x7f623c14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f623be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f623c160c90 0x7f623c14e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55190/0 (socket says 172.21.15.59:55190) 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f623be00640 1 -- 172.21.15.59:0/3990442317 learned_addr learned my addr 172.21.15.59:0/3990442317 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f623b400640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f623c0725e0 0x7f623c15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6232a00640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f623c156ca0 0x7f623c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f623be00640 1 -- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f623c156ca0 msgr2=0x7f623c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f623be00640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f623c156ca0 0x7f623c15ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f623be00640 1 -- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f623c0725e0 msgr2=0x7f623c15b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f623be00640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f623c0725e0 0x7f623c15b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f623be00640 1 -- 172.21.15.59:0/3990442317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c152740 con 0x7f623c160c90 2024-05-30T16:49:56.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f623be00640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f623c160c90 0x7f623c14e740 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f62340b0040 tx=0x7f6234019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:56.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6233e00640 1 -- 172.21.15.59:0/3990442317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340b2050 con 0x7f623c160c90 2024-05-30T16:49:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6233e00640 1 -- 172.21.15.59:0/3990442317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62340be070 con 0x7f623c160c90 2024-05-30T16:49:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6241200640 1 -- 172.21.15.59:0/3990442317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623c152a00 con 0x7f623c160c90 2024-05-30T16:49:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6233e00640 1 -- 172.21.15.59:0/3990442317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340ad890 con 0x7f623c160c90 2024-05-30T16:49:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.962+0000 7f6241200640 1 -- 172.21.15.59:0/3990442317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f623c152fc0 con 0x7f623c160c90 2024-05-30T16:49:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.966+0000 7f6241200640 1 -- 172.21.15.59:0/3990442317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f623c0691a0 con 0x7f623c160c90 2024-05-30T16:49:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.966+0000 7f6233e00640 1 -- 172.21.15.59:0/3990442317 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f62340ada30 con 0x7f623c160c90 2024-05-30T16:49:56.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.966+0000 7f6233e00640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6218068380 0x7f621806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.966+0000 7f6233e00640 1 -- 172.21.15.59:0/3990442317 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6234121cd0 con 0x7f623c160c90 2024-05-30T16:49:56.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.966+0000 7f623b400640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6218068380 0x7f621806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.966+0000 7f623b400640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6218068380 0x7f621806a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f622c000f70 tx=0x7f622c007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:56.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:56.970+0000 7f6233e00640 1 -- 172.21.15.59:0/3990442317 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6234016560 con 0x7f623c160c90 2024-05-30T16:49:57.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.158+0000 7f6241200640 1 -- 172.21.15.59:0/3990442317 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f623c072fc0 con 0x7f6218068380 2024-05-30T16:49:57.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.158+0000 7f6233e00640 1 -- 172.21.15.59:0/3990442317 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f623c072fc0 con 0x7f6218068380 2024-05-30T16:49:57.165 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:49:57.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:49:57.165 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T16:49:57.165 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:49:57.165 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:49:57.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.162+0000 7f6241200640 1 -- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6218068380 msgr2=0x7f621806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.162+0000 7f6241200640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6218068380 0x7f621806a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f622c000f70 tx=0x7f622c007e90 comp rx=0 tx=0).stop 2024-05-30T16:49:57.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.162+0000 7f6241200640 1 -- 172.21.15.59:0/3990442317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f623c160c90 msgr2=0x7f623c14e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.162+0000 7f6241200640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f623c160c90 0x7f623c14e740 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f62340b0040 tx=0x7f6234019680 comp rx=0 tx=0).stop 2024-05-30T16:49:57.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.162+0000 7f6241200640 1 -- 172.21.15.59:0/3990442317 shutdown_connections 2024-05-30T16:49:57.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.162+0000 7f6241200640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6218068380 0x7f621806a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.162+0000 7f6241200640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f623c160c90 0x7f623c14e740 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.162+0000 7f6241200640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f623c156ca0 0x7f623c15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.162+0000 7f6241200640 1 --2- 172.21.15.59:0/3990442317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f623c0725e0 0x7f623c15b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.162+0000 7f6241200640 1 -- 172.21.15.59:0/3990442317 >> 172.21.15.59:0/3990442317 conn(0x7f623c06b9b0 msgr2=0x7f623c0b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:57.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.162+0000 7f6241200640 1 -- 172.21.15.59:0/3990442317 shutdown_connections 2024-05-30T16:49:57.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.162+0000 7f6241200640 1 -- 172.21.15.59:0/3990442317 wait complete. 2024-05-30T16:49:57.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:49:57.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.322+0000 7f6324e00640 1 Processor -- start 2024-05-30T16:49:57.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.322+0000 7f6324e00640 1 -- start start 2024-05-30T16:49:57.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f6324e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63200723a0 0x7f63200b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f6324e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f632006dc80 0x7f632006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f6324e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63200b32d0 con 0x7f632015ebf0 2024-05-30T16:49:57.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f6324e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f632015f490 con 0x7f632006dc80 2024-05-30T16:49:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f6324e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f632015f770 con 0x7f63200723a0 2024-05-30T16:49:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f6317e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f632015ebf0 0x7f63200b3ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39206/0 (socket says 172.21.15.59:39206) 2024-05-30T16:49:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f6317e00640 1 -- 172.21.15.59:0/3795871775 learned_addr learned my addr 172.21.15.59:0/3795871775 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f631e800640 1 --2- 172.21.15.59:0/3795871775 >> v2:172.21.15.107:3300/0 conn(0x7f632006dc80 0x7f632006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f631de00640 1 --2- 172.21.15.59:0/3795871775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63200723a0 0x7f63200b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f631d400640 1 -- 172.21.15.59:0/3795871775 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254279909 0 0) 0x7f63200b32d0 con 0x7f632015ebf0 2024-05-30T16:49:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f631d400640 1 -- 172.21.15.59:0/3795871775 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6304003530 con 0x7f632015ebf0 2024-05-30T16:49:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f631e800640 1 -- 172.21.15.59:0/3795871775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63200723a0 msgr2=0x7f63200b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f631e800640 1 --2- 172.21.15.59:0/3795871775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63200723a0 0x7f63200b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f631e800640 1 -- 172.21.15.59:0/3795871775 >> v1:172.21.15.59:6789/0 conn(0x7f632015ebf0 legacy=0x7f63200b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f631d400640 1 -- 172.21.15.59:0/3795871775 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3504171657 0 0) 0x7f6304003530 con 0x7f632015ebf0 2024-05-30T16:49:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.326+0000 7f631e800640 1 -- 172.21.15.59:0/3795871775 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632015fa50 con 0x7f632006dc80 2024-05-30T16:49:57.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f631e800640 1 --2- 172.21.15.59:0/3795871775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632006dc80 0x7f632006e110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6318009d90 tx=0x7f631801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=affc4593f6899a7d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f631d400640 1 -- 172.21.15.59:0/3795871775 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180b2070 con 0x7f632006dc80 2024-05-30T16:49:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f631d400640 1 -- 172.21.15.59:0/3795871775 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63180a5520 con 0x7f632006dc80 2024-05-30T16:49:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f631d400640 1 -- 172.21.15.59:0/3795871775 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6308001680 con 0x7f632006dc80 2024-05-30T16:49:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f6324e00640 1 -- 172.21.15.59:0/3795871775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632006dc80 msgr2=0x7f632006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f6324e00640 1 --2- 172.21.15.59:0/3795871775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632006dc80 0x7f632006e110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6318009d90 tx=0x7f631801c890 comp rx=0 tx=0).stop 2024-05-30T16:49:57.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f6324e00640 1 -- 172.21.15.59:0/3795871775 shutdown_connections 2024-05-30T16:49:57.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f6324e00640 1 --2- 172.21.15.59:0/3795871775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632006dc80 0x7f632006e110 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f6324e00640 1 --2- 172.21.15.59:0/3795871775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63200723a0 0x7f63200b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f6324e00640 1 -- 172.21.15.59:0/3795871775 >> 172.21.15.59:0/3795871775 conn(0x7f632006bdb0 msgr2=0x7f632006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:57.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f6324e00640 1 -- 172.21.15.59:0/3795871775 shutdown_connections 2024-05-30T16:49:57.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f6324e00640 1 -- 172.21.15.59:0/3795871775 wait complete. 2024-05-30T16:49:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f6324e00640 1 Processor -- start 2024-05-30T16:49:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.330+0000 7f6324e00640 1 -- start start 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6324e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632006dc80 0x7f63201530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6324e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63200723a0 0x7f6320099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6324e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f632015ebf0 0x7f6320155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6324e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6320072780 con 0x7f63200723a0 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6324e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6320072900 con 0x7f632006dc80 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6324e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6320154e60 con 0x7f632015ebf0 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6317e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63200723a0 0x7f6320099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6317e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63200723a0 0x7f6320099980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55200/0 (socket says 172.21.15.59:55200) 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6317e00640 1 -- 172.21.15.59:0/2107611676 learned_addr learned my addr 172.21.15.59:0/2107611676 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f631e800640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f632015ebf0 0x7f6320155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f631de00640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632006dc80 0x7f63201530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6317e00640 1 -- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f632015ebf0 msgr2=0x7f6320155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6317e00640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f632015ebf0 0x7f6320155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6317e00640 1 -- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632006dc80 msgr2=0x7f63201530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6317e00640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632006dc80 0x7f63201530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6317e00640 1 -- 172.21.15.59:0/2107611676 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6320099ec0 con 0x7f63200723a0 2024-05-30T16:49:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6317e00640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63200723a0 0x7f6320099980 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f63080017f0 tx=0x7f630800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6316000640 1 -- 172.21.15.59:0/2107611676 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6308005ae0 con 0x7f63200723a0 2024-05-30T16:49:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6316000640 1 -- 172.21.15.59:0/2107611676 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6308005ca0 con 0x7f63200723a0 2024-05-30T16:49:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6324e00640 1 -- 172.21.15.59:0/2107611676 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632015d380 con 0x7f63200723a0 2024-05-30T16:49:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6316000640 1 -- 172.21.15.59:0/2107611676 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63080072b0 con 0x7f63200723a0 2024-05-30T16:49:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6324e00640 1 -- 172.21.15.59:0/2107611676 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632015d900 con 0x7f63200723a0 2024-05-30T16:49:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.334+0000 7f6324e00640 1 -- 172.21.15.59:0/2107611676 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6320068a90 con 0x7f63200723a0 2024-05-30T16:49:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.338+0000 7f6316000640 1 -- 172.21.15.59:0/2107611676 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6308007450 con 0x7f63200723a0 2024-05-30T16:49:57.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.338+0000 7f6316000640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f62fc068380 0x7f62fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.338+0000 7f6316000640 1 -- 172.21.15.59:0/2107611676 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6308086680 con 0x7f63200723a0 2024-05-30T16:49:57.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.338+0000 7f631de00640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f62fc068380 0x7f62fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.338+0000 7f631de00640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f62fc068380 0x7f62fc06a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6310009b60 tx=0x7f6310009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:57.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.342+0000 7f6316000640 1 -- 172.21.15.59:0/2107611676 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63080565d0 con 0x7f63200723a0 2024-05-30T16:49:57.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.506+0000 7f6324e00640 1 -- 172.21.15.59:0/2107611676 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f63200b4620 con 0x7f63200723a0 2024-05-30T16:49:57.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.506+0000 7f6316000640 1 -- 172.21.15.59:0/2107611676 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f630805a8d0 con 0x7f63200723a0 2024-05-30T16:49:57.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.510+0000 7f6324e00640 1 -- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f62fc068380 msgr2=0x7f62fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.510+0000 7f6324e00640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f62fc068380 0x7f62fc06a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6310009b60 tx=0x7f6310009190 comp rx=0 tx=0).stop 2024-05-30T16:49:57.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.510+0000 7f6324e00640 1 -- 172.21.15.59:0/2107611676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63200723a0 msgr2=0x7f6320099980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.510+0000 7f6324e00640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63200723a0 0x7f6320099980 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f63080017f0 tx=0x7f630800cbe0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.510+0000 7f6324e00640 1 -- 172.21.15.59:0/2107611676 shutdown_connections 2024-05-30T16:49:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.510+0000 7f6324e00640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f62fc068380 0x7f62fc06a840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.510+0000 7f6324e00640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f632015ebf0 0x7f6320155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.510+0000 7f6324e00640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63200723a0 0x7f6320099980 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.510+0000 7f6324e00640 1 --2- 172.21.15.59:0/2107611676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632006dc80 0x7f63201530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.510+0000 7f6324e00640 1 -- 172.21.15.59:0/2107611676 >> 172.21.15.59:0/2107611676 conn(0x7f632006bdb0 msgr2=0x7f63200b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.510+0000 7f6324e00640 1 -- 172.21.15.59:0/2107611676 shutdown_connections 2024-05-30T16:49:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.510+0000 7f6324e00640 1 -- 172.21.15.59:0/2107611676 wait complete. 2024-05-30T16:49:57.534 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T16:49:57.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.674+0000 7f79aa600640 1 Processor -- start 2024-05-30T16:49:57.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.674+0000 7f79aa600640 1 -- start start 2024-05-30T16:49:57.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.674+0000 7f79aa600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79a415b3b0 0x7f79a40adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.674+0000 7f79aa600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a415b790 0x7f79a40af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.674+0000 7f79aa600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a4072850 con 0x7f79a4071cb0 2024-05-30T16:49:57.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.674+0000 7f79aa600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f79a40afaf0 con 0x7f79a415b3b0 2024-05-30T16:49:57.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.674+0000 7f79aa600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f79a40ae510 con 0x7f79a415b790 2024-05-30T16:49:57.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.674+0000 7f79a3400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79a415b3b0 0x7f79a40adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.674+0000 7f79a3e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f79a4071cb0 0x7f79a4072140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:42564/0 (socket says 172.21.15.59:42564) 2024-05-30T16:49:57.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.674+0000 7f79a3e00640 1 -- 172.21.15.59:0/598230640 learned_addr learned my addr 172.21.15.59:0/598230640 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:49:57.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.674+0000 7f799aa00640 1 --2- 172.21.15.59:0/598230640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a415b790 0x7f79a40af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79a3400640 1 -- 172.21.15.59:0/598230640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a415b790 msgr2=0x7f79a40af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:57.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79a3400640 1 --2- 172.21.15.59:0/598230640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a415b790 0x7f79a40af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79a3400640 1 -- 172.21.15.59:0/598230640 >> v1:172.21.15.107:6789/0 conn(0x7f79a4071cb0 legacy=0x7f79a4072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79a3400640 1 -- 172.21.15.59:0/598230640 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a40ae7f0 con 0x7f79a415b3b0 2024-05-30T16:49:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79a3400640 1 --2- 172.21.15.59:0/598230640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a415b3b0 0x7f79a40adf30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f79940097c0 tx=0x7f799401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=826ac6ecd6aad72e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:57.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79a2a00640 1 -- 172.21.15.59:0/598230640 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79940a7070 con 0x7f79a415b3b0 2024-05-30T16:49:57.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79a2a00640 1 -- 172.21.15.59:0/598230640 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79940b0070 con 0x7f79a415b3b0 2024-05-30T16:49:57.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79a2a00640 1 -- 172.21.15.59:0/598230640 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79940ab890 con 0x7f79a415b3b0 2024-05-30T16:49:57.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79aa600640 1 -- 172.21.15.59:0/598230640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a415b3b0 msgr2=0x7f79a40adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79aa600640 1 --2- 172.21.15.59:0/598230640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a415b3b0 0x7f79a40adf30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f79940097c0 tx=0x7f799401c470 comp rx=0 tx=0).stop 2024-05-30T16:49:57.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79aa600640 1 -- 172.21.15.59:0/598230640 shutdown_connections 2024-05-30T16:49:57.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79aa600640 1 --2- 172.21.15.59:0/598230640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a415b790 0x7f79a40af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79aa600640 1 --2- 172.21.15.59:0/598230640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a415b3b0 0x7f79a40adf30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.678+0000 7f79aa600640 1 -- 172.21.15.59:0/598230640 >> 172.21.15.59:0/598230640 conn(0x7f79a40b1e60 msgr2=0x7f79a40b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:57.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79aa600640 1 -- 172.21.15.59:0/598230640 shutdown_connections 2024-05-30T16:49:57.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79aa600640 1 -- 172.21.15.59:0/598230640 wait complete. 2024-05-30T16:49:57.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79aa600640 1 Processor -- start 2024-05-30T16:49:57.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79aa600640 1 -- start start 2024-05-30T16:49:57.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79aa600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a4071cb0 0x7f79a4099910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79aa600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a415b3b0 0x7f79a414fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79aa600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a415b790 0x7f79a409a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79aa600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f79a40cc7d0 con 0x7f79a415b3b0 2024-05-30T16:49:57.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79aa600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f79a40cc650 con 0x7f79a415b790 2024-05-30T16:49:57.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79aa600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f79a40b3970 con 0x7f79a4071cb0 2024-05-30T16:49:57.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f799aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a415b3b0 0x7f79a414fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79a3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a4071cb0 0x7f79a4099910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f799aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a415b3b0 0x7f79a414fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55208/0 (socket says 172.21.15.59:55208) 2024-05-30T16:49:57.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79a3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a4071cb0 0x7f79a4099910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:35452/0 (socket says 172.21.15.59:35452) 2024-05-30T16:49:57.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f799aa00640 1 -- 172.21.15.59:0/1993053183 learned_addr learned my addr 172.21.15.59:0/1993053183 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:57.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79a3e00640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a415b790 0x7f79a409a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79a3400640 1 -- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a415b790 msgr2=0x7f79a409a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79a3400640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a415b790 0x7f79a409a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79a3400640 1 -- 172.21.15.59:0/1993053183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a415b3b0 msgr2=0x7f79a414fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79a3400640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a415b3b0 0x7f79a414fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79a3400640 1 -- 172.21.15.59:0/1993053183 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a41508a0 con 0x7f79a4071cb0 2024-05-30T16:49:57.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f799aa00640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a415b3b0 0x7f79a414fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:57.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.682+0000 7f79a3400640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a4071cb0 0x7f79a4099910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f79940ac000 tx=0x7f799401acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:57.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.686+0000 7f799be00640 1 -- 172.21.15.59:0/1993053183 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79940bf610 con 0x7f79a4071cb0 2024-05-30T16:49:57.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.686+0000 7f799be00640 1 -- 172.21.15.59:0/1993053183 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79940bf7b0 con 0x7f79a4071cb0 2024-05-30T16:49:57.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.686+0000 7f79aa600640 1 -- 172.21.15.59:0/1993053183 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a4150b80 con 0x7f79a4071cb0 2024-05-30T16:49:57.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.686+0000 7f799be00640 1 -- 172.21.15.59:0/1993053183 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79940bfba0 con 0x7f79a4071cb0 2024-05-30T16:49:57.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.686+0000 7f79aa600640 1 -- 172.21.15.59:0/1993053183 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a415d240 con 0x7f79a4071cb0 2024-05-30T16:49:57.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.686+0000 7f79aa600640 1 -- 172.21.15.59:0/1993053183 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a4068a90 con 0x7f79a4071cb0 2024-05-30T16:49:57.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.686+0000 7f799be00640 1 -- 172.21.15.59:0/1993053183 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f79940bd020 con 0x7f79a4071cb0 2024-05-30T16:49:57.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.686+0000 7f799be00640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7980068380 0x7f798006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.686+0000 7f799be00640 1 -- 172.21.15.59:0/1993053183 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7994121650 con 0x7f79a4071cb0 2024-05-30T16:49:57.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.686+0000 7f799aa00640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7980068380 0x7f798006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.690+0000 7f799aa00640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7980068380 0x7f798006a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f79a415a330 tx=0x7f798c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:57.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.690+0000 7f799be00640 1 -- 172.21.15.59:0/1993053183 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7994016090 con 0x7f79a4071cb0 2024-05-30T16:49:57.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:57.886+0000 7f79aa600640 1 -- 172.21.15.59:0/1993053183 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f79a40cc140 con 0x7f7980068380 2024-05-30T16:49:57.896 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:49:57.892+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:57.896 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:49:57.892+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:57.896 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:49:57.892+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:57.896 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:49:57.892+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:57.896 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:49:57.892+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.254+0000 7f799be00640 1 -- 172.21.15.59:0/1993053183 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f79a40cc140 con 0x7f7980068380 2024-05-30T16:49:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.258+0000 7f79aa600640 1 -- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7980068380 msgr2=0x7f798006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.258+0000 7f79aa600640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7980068380 0x7f798006a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f79a415a330 tx=0x7f798c009190 comp rx=0 tx=0).stop 2024-05-30T16:49:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.258+0000 7f79aa600640 1 -- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a4071cb0 msgr2=0x7f79a4099910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.258+0000 7f79aa600640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a4071cb0 0x7f79a4099910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f79940ac000 tx=0x7f799401acb0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.258+0000 7f79aa600640 1 -- 172.21.15.59:0/1993053183 shutdown_connections 2024-05-30T16:49:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.258+0000 7f79aa600640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7980068380 0x7f798006a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.258+0000 7f79aa600640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a415b790 0x7f79a409a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.258+0000 7f79aa600640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a415b3b0 0x7f79a414fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.258+0000 7f79aa600640 1 --2- 172.21.15.59:0/1993053183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a4071cb0 0x7f79a4099910 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.258+0000 7f79aa600640 1 -- 172.21.15.59:0/1993053183 >> 172.21.15.59:0/1993053183 conn(0x7f79a40b1e60 msgr2=0x7f79a4072140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.258+0000 7f79aa600640 1 -- 172.21.15.59:0/1993053183 shutdown_connections 2024-05-30T16:49:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.258+0000 7f79aa600640 1 -- 172.21.15.59:0/1993053183 wait complete. 2024-05-30T16:49:58.282 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:49:58.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36e7000640 1 Processor -- start 2024-05-30T16:49:58.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36e7000640 1 -- start start 2024-05-30T16:49:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36e7000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e00d14c0 0x7f36e006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36e7000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36e00d05b0 0x7f36e009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36e7000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36e006ea20 con 0x7f36e009af80 2024-05-30T16:49:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36e7000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f36e0070950 con 0x7f36e00d05b0 2024-05-30T16:49:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36e7000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f36e0070c30 con 0x7f36e00d14c0 2024-05-30T16:49:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36d7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36e00d05b0 0x7f36e009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36d7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36e00d05b0 0x7f36e009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55214/0 (socket says 172.21.15.59:55214) 2024-05-30T16:49:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36d7400640 1 -- 172.21.15.59:0/1309043948 learned_addr learned my addr 172.21.15.59:0/1309043948 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36dfe00640 1 --2- 172.21.15.59:0/1309043948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e00d14c0 0x7f36e006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36d7400640 1 -- 172.21.15.59:0/1309043948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e00d14c0 msgr2=0x7f36e006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36d7400640 1 --2- 172.21.15.59:0/1309043948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e00d14c0 0x7f36e006e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36d7400640 1 -- 172.21.15.59:0/1309043948 >> v1:172.21.15.107:6789/0 conn(0x7f36e009af80 legacy=0x7f36e0162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36d7400640 1 -- 172.21.15.59:0/1309043948 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e0070f10 con 0x7f36e00d05b0 2024-05-30T16:49:58.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.422+0000 7f36dfe00640 1 --2- 172.21.15.59:0/1309043948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e00d14c0 0x7f36e006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.426+0000 7f36d7400640 1 --2- 172.21.15.59:0/1309043948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00d05b0 0x7f36e009aa40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009870 tx=0x7f36c801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192d98ff1c7953d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.426+0000 7f36df400640 1 -- 172.21.15.59:0/1309043948 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c80b0070 con 0x7f36e00d05b0 2024-05-30T16:49:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.426+0000 7f36df400640 1 -- 172.21.15.59:0/1309043948 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c80ab600 con 0x7f36e00d05b0 2024-05-30T16:49:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.426+0000 7f36df400640 1 -- 172.21.15.59:0/1309043948 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c80ab9d0 con 0x7f36e00d05b0 2024-05-30T16:49:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.426+0000 7f36e7000640 1 -- 172.21.15.59:0/1309043948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00d05b0 msgr2=0x7f36e009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.426+0000 7f36e7000640 1 --2- 172.21.15.59:0/1309043948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00d05b0 0x7f36e009aa40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009870 tx=0x7f36c801c560 comp rx=0 tx=0).stop 2024-05-30T16:49:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.426+0000 7f36e7000640 1 -- 172.21.15.59:0/1309043948 shutdown_connections 2024-05-30T16:49:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.426+0000 7f36e7000640 1 --2- 172.21.15.59:0/1309043948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00d05b0 0x7f36e009aa40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.426+0000 7f36e7000640 1 --2- 172.21.15.59:0/1309043948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e00d14c0 0x7f36e006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.426+0000 7f36e7000640 1 -- 172.21.15.59:0/1309043948 >> 172.21.15.59:0/1309043948 conn(0x7f36e00b3f80 msgr2=0x7f36e00b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.426+0000 7f36e7000640 1 -- 172.21.15.59:0/1309043948 shutdown_connections 2024-05-30T16:49:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.426+0000 7f36e7000640 1 -- 172.21.15.59:0/1309043948 wait complete. 2024-05-30T16:49:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e7000640 1 Processor -- start 2024-05-30T16:49:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e7000640 1 -- start start 2024-05-30T16:49:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e7000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e009af80 0x7f36e00b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e7000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36e00d05b0 0x7f36e00b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e7000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00d14c0 0x7f36e014e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e7000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f36e006e100 con 0x7f36e00d14c0 2024-05-30T16:49:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e7000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f36e00d0a30 con 0x7f36e00d05b0 2024-05-30T16:49:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e7000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f36e006e280 con 0x7f36e009af80 2024-05-30T16:49:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00d14c0 0x7f36e014e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00d14c0 0x7f36e014e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55216/0 (socket says 172.21.15.59:55216) 2024-05-30T16:49:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36d7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36e00d05b0 0x7f36e00b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e5000640 1 -- 172.21.15.59:0/1207672634 learned_addr learned my addr 172.21.15.59:0/1207672634 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:49:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36dfe00640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e009af80 0x7f36e00b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e5000640 1 -- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e009af80 msgr2=0x7f36e00b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e5000640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e009af80 0x7f36e00b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e5000640 1 -- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36e00d05b0 msgr2=0x7f36e00b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e5000640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36e00d05b0 0x7f36e00b7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e5000640 1 -- 172.21.15.59:0/1207672634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e00c9560 con 0x7f36e00d14c0 2024-05-30T16:49:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36d7400640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36e00d05b0 0x7f36e00b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e5000640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00d14c0 0x7f36e014e350 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f36d800c730 tx=0x7f36d800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36dcc00640 1 -- 172.21.15.59:0/1207672634 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8003b80 con 0x7f36e00d14c0 2024-05-30T16:49:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36dcc00640 1 -- 172.21.15.59:0/1207672634 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d8003d20 con 0x7f36e00d14c0 2024-05-30T16:49:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36dcc00640 1 -- 172.21.15.59:0/1207672634 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d800aa30 con 0x7f36e00d14c0 2024-05-30T16:49:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e7000640 1 -- 172.21.15.59:0/1207672634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e00c9800 con 0x7f36e00d14c0 2024-05-30T16:49:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.430+0000 7f36e7000640 1 -- 172.21.15.59:0/1207672634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e00c9dc0 con 0x7f36e00d14c0 2024-05-30T16:49:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.434+0000 7f36e7000640 1 -- 172.21.15.59:0/1207672634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e0068a90 con 0x7f36e00d14c0 2024-05-30T16:49:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.434+0000 7f36dcc00640 1 -- 172.21.15.59:0/1207672634 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f36d800abd0 con 0x7f36e00d14c0 2024-05-30T16:49:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.434+0000 7f36dcc00640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36bc068380 0x7f36bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.434+0000 7f36dcc00640 1 -- 172.21.15.59:0/1207672634 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f36d80867a0 con 0x7f36e00d14c0 2024-05-30T16:49:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.434+0000 7f36dfe00640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36bc068380 0x7f36bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.434+0000 7f36dfe00640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36bc068380 0x7f36bc06a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009950 tx=0x7f36d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.438+0000 7f36dcc00640 1 -- 172.21.15.59:0/1207672634 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f36e006ea20 con 0x7f36e00d14c0 2024-05-30T16:49:58.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.630+0000 7f36e7000640 1 -- 172.21.15.59:0/1207672634 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f36e00ce090 con 0x7f36bc068380 2024-05-30T16:49:58.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36dcc00640 1 -- 172.21.15.59:0/1207672634 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f36e00ce090 con 0x7f36bc068380 2024-05-30T16:49:58.641 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9 2024-05-30T16:49:58.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36e7000640 1 -- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36bc068380 msgr2=0x7f36bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36e7000640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36bc068380 0x7f36bc06a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009950 tx=0x7f36d0008040 comp rx=0 tx=0).stop 2024-05-30T16:49:58.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36e7000640 1 -- 172.21.15.59:0/1207672634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00d14c0 msgr2=0x7f36e014e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36e7000640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00d14c0 0x7f36e014e350 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f36d800c730 tx=0x7f36d800cbf0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36e7000640 1 -- 172.21.15.59:0/1207672634 shutdown_connections 2024-05-30T16:49:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36e7000640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36bc068380 0x7f36bc06a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36e7000640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00d14c0 0x7f36e014e350 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36e7000640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36e00d05b0 0x7f36e00b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36e7000640 1 --2- 172.21.15.59:0/1207672634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e009af80 0x7f36e00b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36e7000640 1 -- 172.21.15.59:0/1207672634 >> 172.21.15.59:0/1207672634 conn(0x7f36e00b3f80 msgr2=0x7f36e00b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36e7000640 1 -- 172.21.15.59:0/1207672634 shutdown_connections 2024-05-30T16:49:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:49:58.638+0000 7f36e7000640 1 -- 172.21.15.59:0/1207672634 wait complete. 2024-05-30T16:49:58.662 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9 2024-05-30T16:49:58.662 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:49:58.663 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:58.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:58.671 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:50:03.416 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:50:03.419 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:50:05.908 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:50:05.908 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:50:05.908 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.17416 s, 150 MB/s 2024-05-30T16:50:05.910 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:50:05.910 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:50:05.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:05.919 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:50:12.792 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:50:12.792 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:50:12.792 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.82 s, 157 MB/s 2024-05-30T16:50:12.794 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:50:12.794 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:50:12.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:12.803 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:50:19.699 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:50:19.700 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:50:19.700 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.84288 s, 157 MB/s 2024-05-30T16:50:19.701 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:50:19.701 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:50:19.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:19.710 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:50:26.657 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:50:26.657 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:50:26.657 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.89138 s, 156 MB/s 2024-05-30T16:50:26.658 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:50:26.658 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:50:26.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:26.667 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:50:33.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:50:33.481 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:50:33.639 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:50:33.639 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:50:33.639 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.91848 s, 155 MB/s 2024-05-30T16:50:33.640 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:50:33.641 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:50:33.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:33.649 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:50:40.607 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:50:40.607 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:50:40.607 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.90099 s, 156 MB/s 2024-05-30T16:50:40.607 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:50:40.607 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:50:40.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:40.616 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:50:47.487 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:50:47.488 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:50:47.488 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.81825 s, 157 MB/s 2024-05-30T16:50:47.488 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:50:47.488 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:50:47.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:47.497 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:50:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:50:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:50:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.94899 s, 155 MB/s 2024-05-30T16:50:54.504 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:50:54.504 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:50:54.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:54.513 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:51:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:51:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:51:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.93777 s, 155 MB/s 2024-05-30T16:51:01.504 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:51:01.504 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:51:01.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:51:01.513 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:51:03.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:51:03.655 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:51:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:51:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:51:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.87069 s, 156 MB/s 2024-05-30T16:51:08.441 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T16:51:08.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30aaa00640 1 Processor -- start 2024-05-30T16:51:08.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30aaa00640 1 -- start start 2024-05-30T16:51:08.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30aaa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f30a409b420 0x7f30a40b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:08.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30aaa00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a415fe20 con 0x7f30a415fa40 2024-05-30T16:51:08.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30aaa00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a40d02e0 con 0x7f30a40d0f90 2024-05-30T16:51:08.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30aaa00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f30a409b8d0 con 0x7f30a409b420 2024-05-30T16:51:08.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30a9600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f30a415fa40 0x7f30a40d0880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41330/0 (socket says 172.21.15.59:41330) 2024-05-30T16:51:08.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30a9600640 1 -- 172.21.15.59:0/3320496023 learned_addr learned my addr 172.21.15.59:0/3320496023 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:08.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30aa000640 1 --2- 172.21.15.59:0/3320496023 >> v2:172.21.15.107:3300/0 conn(0x7f30a409b420 0x7f30a40b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:08.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30a3e00640 1 -- 172.21.15.59:0/3320496023 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340143679 0 0) 0x7f30a415fe20 con 0x7f30a415fa40 2024-05-30T16:51:08.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30a3e00640 1 -- 172.21.15.59:0/3320496023 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f308c003530 con 0x7f30a415fa40 2024-05-30T16:51:08.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30a3e00640 1 -- 172.21.15.59:0/3320496023 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589530096 0 0) 0x7f30a40d02e0 con 0x7f30a40d0f90 2024-05-30T16:51:08.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30a3e00640 1 -- 172.21.15.59:0/3320496023 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30a415fe20 con 0x7f30a40d0f90 2024-05-30T16:51:08.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30a3e00640 1 -- 172.21.15.59:0/3320496023 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2540636649 0 0) 0x7f308c003530 con 0x7f30a415fa40 2024-05-30T16:51:08.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30aa000640 1 -- 172.21.15.59:0/3320496023 >> v1:172.21.15.107:6789/0 conn(0x7f30a40d0f90 legacy=0x7f30a40b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:08.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30aa000640 1 -- 172.21.15.59:0/3320496023 >> v1:172.21.15.59:6789/0 conn(0x7f30a415fa40 legacy=0x7f30a40d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:08.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.585+0000 7f30aa000640 1 -- 172.21.15.59:0/3320496023 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a40d05c0 con 0x7f30a409b420 2024-05-30T16:51:08.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.589+0000 7f30aa000640 1 --2- 172.21.15.59:0/3320496023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30a409b420 0x7f30a40b63a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f309c009d90 tx=0x7f309c01c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f143f0b981e2179 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:08.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.589+0000 7f30a3e00640 1 -- 172.21.15.59:0/3320496023 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c0b2070 con 0x7f30a409b420 2024-05-30T16:51:08.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.589+0000 7f30a3e00640 1 -- 172.21.15.59:0/3320496023 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c0a5530 con 0x7f30a409b420 2024-05-30T16:51:08.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.589+0000 7f30a3e00640 1 -- 172.21.15.59:0/3320496023 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098001680 con 0x7f30a409b420 2024-05-30T16:51:08.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.589+0000 7f30aaa00640 1 -- 172.21.15.59:0/3320496023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30a409b420 msgr2=0x7f30a40b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:08.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.589+0000 7f30aaa00640 1 --2- 172.21.15.59:0/3320496023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30a409b420 0x7f30a40b63a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f309c009d90 tx=0x7f309c01c800 comp rx=0 tx=0).stop 2024-05-30T16:51:08.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.589+0000 7f30aaa00640 1 -- 172.21.15.59:0/3320496023 shutdown_connections 2024-05-30T16:51:08.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.589+0000 7f30aaa00640 1 --2- 172.21.15.59:0/3320496023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30a409b420 0x7f30a40b63a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.589+0000 7f30aaa00640 1 -- 172.21.15.59:0/3320496023 >> 172.21.15.59:0/3320496023 conn(0x7f30a40b3db0 msgr2=0x7f30a40b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:08.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.589+0000 7f30aaa00640 1 -- 172.21.15.59:0/3320496023 shutdown_connections 2024-05-30T16:51:08.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.589+0000 7f30aaa00640 1 -- 172.21.15.59:0/3320496023 wait complete. 2024-05-30T16:51:08.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30aaa00640 1 Processor -- start 2024-05-30T16:51:08.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30aaa00640 1 -- start start 2024-05-30T16:51:08.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30aaa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a409b420 0x7f30a41556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30aaa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30a40d0f90 0x7f30a415b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30aaa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30a415fa40 0x7f30a40705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30aaa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f30a40d0010 con 0x7f30a409b420 2024-05-30T16:51:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30aaa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f30a40cfe90 con 0x7f30a40d0f90 2024-05-30T16:51:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30aaa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f30a416a100 con 0x7f30a415fa40 2024-05-30T16:51:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a409b420 0x7f30a41556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a409b420 0x7f30a41556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47382/0 (socket says 172.21.15.59:47382) 2024-05-30T16:51:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a9600640 1 -- 172.21.15.59:0/4038849303 learned_addr learned my addr 172.21.15.59:0/4038849303 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a8c00640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30a40d0f90 0x7f30a415b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30aa000640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30a415fa40 0x7f30a40705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a9600640 1 -- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30a415fa40 msgr2=0x7f30a40705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a9600640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30a415fa40 0x7f30a40705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a9600640 1 -- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30a40d0f90 msgr2=0x7f30a415b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:08.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a9600640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30a40d0f90 0x7f30a415b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a9600640 1 -- 172.21.15.59:0/4038849303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a41598f0 con 0x7f30a409b420 2024-05-30T16:51:08.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30aa000640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30a415fa40 0x7f30a40705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:08.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a9600640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a409b420 0x7f30a41556f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f309800c760 tx=0x7f309800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:08.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a1600640 1 -- 172.21.15.59:0/4038849303 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098017070 con 0x7f30a409b420 2024-05-30T16:51:08.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a1600640 1 -- 172.21.15.59:0/4038849303 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3098005b00 con 0x7f30a409b420 2024-05-30T16:51:08.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30aaa00640 1 -- 172.21.15.59:0/4038849303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a4159bd0 con 0x7f30a409b420 2024-05-30T16:51:08.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30a1600640 1 -- 172.21.15.59:0/4038849303 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098007070 con 0x7f30a409b420 2024-05-30T16:51:08.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.593+0000 7f30aaa00640 1 -- 172.21.15.59:0/4038849303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a415a190 con 0x7f30a409b420 2024-05-30T16:51:08.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.597+0000 7f30aaa00640 1 -- 172.21.15.59:0/4038849303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a4068a90 con 0x7f30a409b420 2024-05-30T16:51:08.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.597+0000 7f30a1600640 1 -- 172.21.15.59:0/4038849303 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f309801a070 con 0x7f30a409b420 2024-05-30T16:51:08.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.597+0000 7f30a1600640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3084068410 0x7f308406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:08.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.597+0000 7f30a1600640 1 -- 172.21.15.59:0/4038849303 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3098085fe0 con 0x7f30a409b420 2024-05-30T16:51:08.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.597+0000 7f30a8c00640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3084068410 0x7f308406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.597+0000 7f30a8c00640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3084068410 0x7f308406a8d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f30a40718c0 tx=0x7f3090009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:08.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.601+0000 7f30a1600640 1 -- 172.21.15.59:0/4038849303 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3098056470 con 0x7f30a409b420 2024-05-30T16:51:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.797+0000 7f30aaa00640 1 -- 172.21.15.59:0/4038849303 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f30a4155fd0 con 0x7f3084068410 2024-05-30T16:51:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.809+0000 7f30a1600640 1 -- 172.21.15.59:0/4038849303 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f30a4155fd0 con 0x7f3084068410 2024-05-30T16:51:08.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.809+0000 7f30aaa00640 1 -- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3084068410 msgr2=0x7f308406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:08.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.809+0000 7f30aaa00640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3084068410 0x7f308406a8d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f30a40718c0 tx=0x7f3090009040 comp rx=0 tx=0).stop 2024-05-30T16:51:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.809+0000 7f30aaa00640 1 -- 172.21.15.59:0/4038849303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a409b420 msgr2=0x7f30a41556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.809+0000 7f30aaa00640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a409b420 0x7f30a41556f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f309800c760 tx=0x7f309800cc20 comp rx=0 tx=0).stop 2024-05-30T16:51:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.809+0000 7f30aaa00640 1 -- 172.21.15.59:0/4038849303 shutdown_connections 2024-05-30T16:51:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.809+0000 7f30aaa00640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3084068410 0x7f308406a8d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.809+0000 7f30aaa00640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30a415fa40 0x7f30a40705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.809+0000 7f30aaa00640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30a40d0f90 0x7f30a415b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.809+0000 7f30aaa00640 1 --2- 172.21.15.59:0/4038849303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a409b420 0x7f30a41556f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.813+0000 7f30aaa00640 1 -- 172.21.15.59:0/4038849303 >> 172.21.15.59:0/4038849303 conn(0x7f30a40b3db0 msgr2=0x7f30a40cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.813+0000 7f30aaa00640 1 -- 172.21.15.59:0/4038849303 shutdown_connections 2024-05-30T16:51:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.813+0000 7f30aaa00640 1 -- 172.21.15.59:0/4038849303 wait complete. 2024-05-30T16:51:08.833 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:51:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d22000640 1 Processor -- start 2024-05-30T16:51:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d22000640 1 -- start start 2024-05-30T16:51:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d22000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d1c09b4b0 0x7f9d1c06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d22000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9d1c09b890 0x7f9d1c0d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d22000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d1c0d0fb0 con 0x7f9d1c0d0aa0 2024-05-30T16:51:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d22000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9d1c06fef0 con 0x7f9d1c09b890 2024-05-30T16:51:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d22000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9d1c0d1290 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d20c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d1c09b4b0 0x7f9d1c06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d21600640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9d1c0d0aa0 0x7f9d1c162340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:46242/0 (socket says 172.21.15.59:46242) 2024-05-30T16:51:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d21600640 1 -- 172.21.15.59:0/3119298532 learned_addr learned my addr 172.21.15.59:0/3119298532 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d1be00640 1 --2- 172.21.15.59:0/3119298532 >> v2:172.21.15.107:3300/0 conn(0x7f9d1c09b890 0x7f9d1c0d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d20c00640 1 -- 172.21.15.59:0/3119298532 >> v2:172.21.15.107:3300/0 conn(0x7f9d1c09b890 msgr2=0x7f9d1c0d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:08.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d1b400640 1 -- 172.21.15.59:0/3119298532 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961659726 0 0) 0x7f9d1c0d0fb0 con 0x7f9d1c0d0aa0 2024-05-30T16:51:08.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d20c00640 1 --2- 172.21.15.59:0/3119298532 >> v2:172.21.15.107:3300/0 conn(0x7f9d1c09b890 0x7f9d1c0d0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d20c00640 1 -- 172.21.15.59:0/3119298532 >> v1:172.21.15.107:6789/0 conn(0x7f9d1c0d0aa0 legacy=0x7f9d1c162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:08.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d20c00640 1 -- 172.21.15.59:0/3119298532 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c0d1570 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.977+0000 7f9d1be00640 1 --2- 172.21.15.59:0/3119298532 >> v2:172.21.15.107:3300/0 conn(0x7f9d1c09b890 0x7f9d1c0d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:08.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.981+0000 7f9d20c00640 1 --2- 172.21.15.59:0/3119298532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d1c09b4b0 0x7f9d1c06cac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d100097c0 tx=0x7f9d1001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1b9f9b06a89eff4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:08.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.981+0000 7f9d1b400640 1 -- 172.21.15.59:0/3119298532 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d100ab600 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.981+0000 7f9d1b400640 1 -- 172.21.15.59:0/3119298532 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d100b0070 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.981+0000 7f9d1b400640 1 -- 172.21.15.59:0/3119298532 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d100ab9c0 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.981+0000 7f9d22000640 1 -- 172.21.15.59:0/3119298532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d1c09b4b0 msgr2=0x7f9d1c06cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:08.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.981+0000 7f9d22000640 1 --2- 172.21.15.59:0/3119298532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d1c09b4b0 0x7f9d1c06cac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d100097c0 tx=0x7f9d1001c3e0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.981+0000 7f9d22000640 1 -- 172.21.15.59:0/3119298532 shutdown_connections 2024-05-30T16:51:08.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.981+0000 7f9d22000640 1 --2- 172.21.15.59:0/3119298532 >> v2:172.21.15.107:3300/0 conn(0x7f9d1c09b890 0x7f9d1c0d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.981+0000 7f9d22000640 1 --2- 172.21.15.59:0/3119298532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d1c09b4b0 0x7f9d1c06cac0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.981+0000 7f9d22000640 1 -- 172.21.15.59:0/3119298532 >> 172.21.15.59:0/3119298532 conn(0x7f9d1c0b3ec0 msgr2=0x7f9d1c0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:08.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.981+0000 7f9d22000640 1 -- 172.21.15.59:0/3119298532 shutdown_connections 2024-05-30T16:51:08.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.981+0000 7f9d22000640 1 -- 172.21.15.59:0/3119298532 wait complete. 2024-05-30T16:51:08.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d22000640 1 Processor -- start 2024-05-30T16:51:08.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d22000640 1 -- start start 2024-05-30T16:51:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d22000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d1c09b4b0 0x7f9d1c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d22000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d1c09b890 0x7f9d1c158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d22000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d1c0d0aa0 0x7f9d1c159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d22000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c15fbf0 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d22000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c15fa70 con 0x7f9d1c09b890 2024-05-30T16:51:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d22000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9d1c070380 con 0x7f9d1c0d0aa0 2024-05-30T16:51:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d20c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d1c09b4b0 0x7f9d1c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d20c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d1c09b4b0 0x7f9d1c0cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47398/0 (socket says 172.21.15.59:47398) 2024-05-30T16:51:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d20c00640 1 -- 172.21.15.59:0/3684823500 learned_addr learned my addr 172.21.15.59:0/3684823500 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d21600640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d1c0d0aa0 0x7f9d1c159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d1be00640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d1c09b890 0x7f9d1c158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d20c00640 1 -- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d1c0d0aa0 msgr2=0x7f9d1c159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d20c00640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d1c0d0aa0 0x7f9d1c159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d20c00640 1 -- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d1c09b890 msgr2=0x7f9d1c158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d20c00640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d1c09b890 0x7f9d1c158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d20c00640 1 -- 172.21.15.59:0/3684823500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c151c10 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d21600640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d1c0d0aa0 0x7f9d1c159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:51:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d20c00640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d1c09b4b0 0x7f9d1c0cdea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9d100097c0 tx=0x7f9d1001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d18c00640 1 -- 172.21.15.59:0/3684823500 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10006e20 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d18c00640 1 -- 172.21.15.59:0/3684823500 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d100abde0 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d22000640 1 -- 172.21.15.59:0/3684823500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1c0b12e0 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d18c00640 1 -- 172.21.15.59:0/3684823500 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10004220 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d22000640 1 -- 172.21.15.59:0/3684823500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1c1600f0 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.985+0000 7f9d22000640 1 -- 172.21.15.59:0/3684823500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d1c068a90 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.989+0000 7f9d18c00640 1 -- 172.21.15.59:0/3684823500 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f9d100aa070 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.989+0000 7f9d18c00640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9cfc068440 0x7f9cfc06a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:08.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.989+0000 7f9d18c00640 1 -- 172.21.15.59:0/3684823500 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9d10120b30 con 0x7f9d1c09b4b0 2024-05-30T16:51:08.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.989+0000 7f9d1be00640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9cfc068440 0x7f9cfc06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:08.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.989+0000 7f9d1be00640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9cfc068440 0x7f9cfc06a900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009580 tx=0x7f9d08009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:08.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:08.993+0000 7f9d18c00640 1 -- 172.21.15.59:0/3684823500 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9d10016090 con 0x7f9d1c09b4b0 2024-05-30T16:51:09.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.181+0000 7f9d22000640 1 -- 172.21.15.59:0/3684823500 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f9d1c0ce3e0 con 0x7f9cfc068440 2024-05-30T16:51:09.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d18c00640 1 -- 172.21.15.59:0/3684823500 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f9d1c0ce3e0 con 0x7f9cfc068440 2024-05-30T16:51:09.190 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9 2024-05-30T16:51:09.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d22000640 1 -- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9cfc068440 msgr2=0x7f9cfc06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:09.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d22000640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9cfc068440 0x7f9cfc06a900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009580 tx=0x7f9d08009190 comp rx=0 tx=0).stop 2024-05-30T16:51:09.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d22000640 1 -- 172.21.15.59:0/3684823500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d1c09b4b0 msgr2=0x7f9d1c0cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:09.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d22000640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d1c09b4b0 0x7f9d1c0cdea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9d100097c0 tx=0x7f9d1001ac20 comp rx=0 tx=0).stop 2024-05-30T16:51:09.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d22000640 1 -- 172.21.15.59:0/3684823500 shutdown_connections 2024-05-30T16:51:09.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d22000640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9cfc068440 0x7f9cfc06a900 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:09.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d22000640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d1c0d0aa0 0x7f9d1c159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:09.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d22000640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d1c09b890 0x7f9d1c158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:09.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d22000640 1 --2- 172.21.15.59:0/3684823500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d1c09b4b0 0x7f9d1c0cdea0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:09.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d22000640 1 -- 172.21.15.59:0/3684823500 >> 172.21.15.59:0/3684823500 conn(0x7f9d1c0b3ec0 msgr2=0x7f9d1c074d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:09.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d22000640 1 -- 172.21.15.59:0/3684823500 shutdown_connections 2024-05-30T16:51:09.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:09.189+0000 7f9d22000640 1 -- 172.21.15.59:0/3684823500 wait complete. 2024-05-30T16:51:09.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:51:09.210 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9 2024-05-30T16:51:09.211 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T16:51:09.342 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9 2024-05-30T16:51:09.342 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="10654449664" 2024-05-30T16:51:09.342 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:09.342 INFO:tasks.cephfs.test_volumes:r_size = 10654449664 exp_size = 10737418240 2024-05-30T16:51:11.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:51:11.344 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9 2024-05-30T16:51:11.344 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T16:51:11.359 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9 2024-05-30T16:51:11.359 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="10654449664" 2024-05-30T16:51:11.359 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:11.360 INFO:tasks.cephfs.test_volumes:r_size = 10654449664 exp_size = 10737418240 2024-05-30T16:51:13.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:51:13.360 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9 2024-05-30T16:51:13.360 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T16:51:13.374 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/53f8a3f5-9cb7-4238-bd12-01f50b7b8da9 2024-05-30T16:51:13.374 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="10737418240" 2024-05-30T16:51:13.375 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:13.375 INFO:tasks.cephfs.test_volumes:r_size = 10737418240 exp_size = 10737418240 2024-05-30T16:51:13.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-05-30T16:51:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2ebb000640 1 Processor -- start 2024-05-30T16:51:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2ebb000640 1 -- start start 2024-05-30T16:51:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2ebb000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2eb40ad2b0 0x7f2eb415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2ebb000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb40ad770 con 0x7f2eb41569e0 2024-05-30T16:51:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2ebb000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb415cb40 con 0x7f2eb40d0660 2024-05-30T16:51:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2ebb000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb415ce20 con 0x7f2eb40ad2b0 2024-05-30T16:51:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2eb3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2eb41569e0 0x7f2eb40cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57784/0 (socket says 172.21.15.59:57784) 2024-05-30T16:51:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2eb3e00640 1 -- 172.21.15.59:0/2354726 learned_addr learned my addr 172.21.15.59:0/2354726 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2eabe00640 1 --2- 172.21.15.59:0/2354726 >> v2:172.21.15.107:3300/0 conn(0x7f2eb40ad2b0 0x7f2eb415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2eb3400640 1 -- 172.21.15.59:0/2354726 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902188921 0 0) 0x7f2eb40ad770 con 0x7f2eb41569e0 2024-05-30T16:51:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2eb3400640 1 -- 172.21.15.59:0/2354726 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e98003530 con 0x7f2eb41569e0 2024-05-30T16:51:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2eb3400640 1 -- 172.21.15.59:0/2354726 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673800162 0 0) 0x7f2eb415cb40 con 0x7f2eb40d0660 2024-05-30T16:51:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2eb3400640 1 -- 172.21.15.59:0/2354726 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2eb40ad770 con 0x7f2eb40d0660 2024-05-30T16:51:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2eb3400640 1 -- 172.21.15.59:0/2354726 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2222648786 0 0) 0x7f2e98003530 con 0x7f2eb41569e0 2024-05-30T16:51:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2eabe00640 1 -- 172.21.15.59:0/2354726 >> v1:172.21.15.107:6789/0 conn(0x7f2eb40d0660 legacy=0x7f2eb40b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2eabe00640 1 -- 172.21.15.59:0/2354726 >> v1:172.21.15.59:6789/0 conn(0x7f2eb41569e0 legacy=0x7f2eb40cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.573+0000 7f2eabe00640 1 -- 172.21.15.59:0/2354726 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb415d100 con 0x7f2eb40ad2b0 2024-05-30T16:51:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.577+0000 7f2eabe00640 1 --2- 172.21.15.59:0/2354726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40ad2b0 0x7f2eb415d620 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0097c0 tx=0x7f2e9c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7ee81221709bb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.577+0000 7f2eb3400640 1 -- 172.21.15.59:0/2354726 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0b0070 con 0x7f2eb40ad2b0 2024-05-30T16:51:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.577+0000 7f2eb3400640 1 -- 172.21.15.59:0/2354726 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9c0ab400 con 0x7f2eb40ad2b0 2024-05-30T16:51:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.577+0000 7f2eb3400640 1 -- 172.21.15.59:0/2354726 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4001680 con 0x7f2eb40ad2b0 2024-05-30T16:51:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.577+0000 7f2ebb000640 1 -- 172.21.15.59:0/2354726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40ad2b0 msgr2=0x7f2eb415d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.577+0000 7f2ebb000640 1 --2- 172.21.15.59:0/2354726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40ad2b0 0x7f2eb415d620 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0097c0 tx=0x7f2e9c01c330 comp rx=0 tx=0).stop 2024-05-30T16:51:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.577+0000 7f2ebb000640 1 -- 172.21.15.59:0/2354726 shutdown_connections 2024-05-30T16:51:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.577+0000 7f2ebb000640 1 --2- 172.21.15.59:0/2354726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40ad2b0 0x7f2eb415d620 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.577+0000 7f2ebb000640 1 -- 172.21.15.59:0/2354726 >> 172.21.15.59:0/2354726 conn(0x7f2eb406bdb0 msgr2=0x7f2eb406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.577+0000 7f2ebb000640 1 -- 172.21.15.59:0/2354726 shutdown_connections 2024-05-30T16:51:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.577+0000 7f2ebb000640 1 -- 172.21.15.59:0/2354726 wait complete. 2024-05-30T16:51:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2ebb000640 1 Processor -- start 2024-05-30T16:51:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2ebb000640 1 -- start start 2024-05-30T16:51:13.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2ebb000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40ad2b0 0x7f2eb40b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:13.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2ebb000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2eb40d0660 0x7f2eb40b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:13.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2ebb000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb41569e0 0x7f2eb40b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:13.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2ebb000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb416a340 con 0x7f2eb41569e0 2024-05-30T16:51:13.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2ebb000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb416a1c0 con 0x7f2eb40ad2b0 2024-05-30T16:51:13.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2ebb000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb416a4c0 con 0x7f2eb40d0660 2024-05-30T16:51:13.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb41569e0 0x7f2eb40b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:13.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb41569e0 0x7f2eb40b11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35730/0 (socket says 172.21.15.59:35730) 2024-05-30T16:51:13.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb9000640 1 -- 172.21.15.59:0/1974474875 learned_addr learned my addr 172.21.15.59:0/1974474875 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:13.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb3e00640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40ad2b0 0x7f2eb40b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:13.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eabe00640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2eb40d0660 0x7f2eb40b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:13.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb9000640 1 -- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2eb40d0660 msgr2=0x7f2eb40b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:13.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb9000640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2eb40d0660 0x7f2eb40b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:13.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb9000640 1 -- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40ad2b0 msgr2=0x7f2eb40b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:13.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb9000640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40ad2b0 0x7f2eb40b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:13.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb9000640 1 -- 172.21.15.59:0/1974474875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb409a3c0 con 0x7f2eb41569e0 2024-05-30T16:51:13.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb9000640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb41569e0 0x7f2eb40b11c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00c790 tx=0x7f2eac00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:13.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb0c00640 1 -- 172.21.15.59:0/1974474875 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac003b80 con 0x7f2eb41569e0 2024-05-30T16:51:13.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb0c00640 1 -- 172.21.15.59:0/1974474875 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac003d20 con 0x7f2eb41569e0 2024-05-30T16:51:13.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2eb0c00640 1 -- 172.21.15.59:0/1974474875 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac00aa50 con 0x7f2eb41569e0 2024-05-30T16:51:13.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2ebb000640 1 -- 172.21.15.59:0/1974474875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb409a6a0 con 0x7f2eb41569e0 2024-05-30T16:51:13.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.581+0000 7f2ebb000640 1 -- 172.21.15.59:0/1974474875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb4148130 con 0x7f2eb41569e0 2024-05-30T16:51:13.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.585+0000 7f2ebb000640 1 -- 172.21.15.59:0/1974474875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb4152cc0 con 0x7f2eb41569e0 2024-05-30T16:51:13.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.585+0000 7f2eb0c00640 1 -- 172.21.15.59:0/1974474875 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f2eac00abf0 con 0x7f2eb41569e0 2024-05-30T16:51:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.585+0000 7f2eb0c00640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2e90068410 0x7f2e9006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.585+0000 7f2eb0c00640 1 -- 172.21.15.59:0/1974474875 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2eac086930 con 0x7f2eb41569e0 2024-05-30T16:51:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.585+0000 7f2eb3e00640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2e90068410 0x7f2e9006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:13.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.589+0000 7f2eb3e00640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2e90068410 0x7f2e9006a8d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4001000 tx=0x7f2ea4001160 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:13.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.589+0000 7f2eb0c00640 1 -- 172.21.15.59:0/1974474875 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2eac0567b0 con 0x7f2eb41569e0 2024-05-30T16:51:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.785+0000 7f2ebb000640 1 -- 172.21.15.59:0/1974474875 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f2eb4068a90 con 0x7f2e90068410 2024-05-30T16:51:13.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.857+0000 7f2eb0c00640 1 -- 172.21.15.59:0/1974474875 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2eb4068a90 con 0x7f2e90068410 2024-05-30T16:51:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.857+0000 7f2ebb000640 1 -- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2e90068410 msgr2=0x7f2e9006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.857+0000 7f2ebb000640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2e90068410 0x7f2e9006a8d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4001000 tx=0x7f2ea4001160 comp rx=0 tx=0).stop 2024-05-30T16:51:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.857+0000 7f2ebb000640 1 -- 172.21.15.59:0/1974474875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb41569e0 msgr2=0x7f2eb40b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.857+0000 7f2ebb000640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb41569e0 0x7f2eb40b11c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00c790 tx=0x7f2eac00cc50 comp rx=0 tx=0).stop 2024-05-30T16:51:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.861+0000 7f2ebb000640 1 -- 172.21.15.59:0/1974474875 shutdown_connections 2024-05-30T16:51:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.861+0000 7f2ebb000640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2e90068410 0x7f2e9006a8d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.861+0000 7f2ebb000640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb41569e0 0x7f2eb40b11c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.861+0000 7f2ebb000640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2eb40d0660 0x7f2eb40b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.861+0000 7f2ebb000640 1 --2- 172.21.15.59:0/1974474875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40ad2b0 0x7f2eb40b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.861+0000 7f2ebb000640 1 -- 172.21.15.59:0/1974474875 >> 172.21.15.59:0/1974474875 conn(0x7f2eb406bdb0 msgr2=0x7f2eb4155c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.861+0000 7f2ebb000640 1 -- 172.21.15.59:0/1974474875 shutdown_connections 2024-05-30T16:51:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:13.861+0000 7f2ebb000640 1 -- 172.21.15.59:0/1974474875 wait complete. 2024-05-30T16:51:13.863 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:13.859+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:13.863 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:13.859+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:13.863 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:13.859+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:13.863 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:13.859+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:13.863 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:13.859+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:13.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:51:13.883 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:13.879+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:13.883 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:13.879+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:13.884 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:13.879+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:13.884 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:13.879+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:13.884 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:13.879+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:14.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad9ce00640 1 Processor -- start 2024-05-30T16:51:14.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad9ce00640 1 -- start start 2024-05-30T16:51:14.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad9ce00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad9815f690 0x7fad980b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:14.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad9ce00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad9806de10 con 0x7fad9806f8c0 2024-05-30T16:51:14.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad9ce00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad9806e0f0 con 0x7fad981558e0 2024-05-30T16:51:14.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad9ce00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fad9806e3d0 con 0x7fad9815f690 2024-05-30T16:51:14.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad96800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fad9806f8c0 0x7fad980b46b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57788/0 (socket says 172.21.15.59:57788) 2024-05-30T16:51:14.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad96800640 1 -- 172.21.15.59:0/3603116361 learned_addr learned my addr 172.21.15.59:0/3603116361 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:14.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad8d400640 1 --2- 172.21.15.59:0/3603116361 >> v2:172.21.15.59:3300/0 conn(0x7fad9815f690 0x7fad980b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:14.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad95400640 1 -- 172.21.15.59:0/3603116361 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3947155335 0 0) 0x7fad9806de10 con 0x7fad9806f8c0 2024-05-30T16:51:14.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad8d400640 1 -- 172.21.15.59:0/3603116361 >> v1:172.21.15.107:6789/0 conn(0x7fad981558e0 legacy=0x7fad9815ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:14.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad8d400640 1 -- 172.21.15.59:0/3603116361 >> v1:172.21.15.59:6789/0 conn(0x7fad9806f8c0 legacy=0x7fad980b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:14.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.029+0000 7fad8d400640 1 -- 172.21.15.59:0/3603116361 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9806e6b0 con 0x7fad9815f690 2024-05-30T16:51:14.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.033+0000 7fad8d400640 1 --2- 172.21.15.59:0/3603116361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9815f690 0x7fad980b3e30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fad80009d90 tx=0x7fad8001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44466f4bc752634 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:14.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.033+0000 7fad95400640 1 -- 172.21.15.59:0/3603116361 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad800b2070 con 0x7fad9815f690 2024-05-30T16:51:14.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.033+0000 7fad95400640 1 -- 172.21.15.59:0/3603116361 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad800a5870 con 0x7fad9815f690 2024-05-30T16:51:14.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.033+0000 7fad95400640 1 -- 172.21.15.59:0/3603116361 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad800a5c40 con 0x7fad9815f690 2024-05-30T16:51:14.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.033+0000 7fad9ce00640 1 -- 172.21.15.59:0/3603116361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9815f690 msgr2=0x7fad980b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:14.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.033+0000 7fad9ce00640 1 --2- 172.21.15.59:0/3603116361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9815f690 0x7fad980b3e30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fad80009d90 tx=0x7fad8001c930 comp rx=0 tx=0).stop 2024-05-30T16:51:14.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.033+0000 7fad9ce00640 1 -- 172.21.15.59:0/3603116361 shutdown_connections 2024-05-30T16:51:14.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.033+0000 7fad9ce00640 1 --2- 172.21.15.59:0/3603116361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9815f690 0x7fad980b3e30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:14.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.033+0000 7fad9ce00640 1 -- 172.21.15.59:0/3603116361 >> 172.21.15.59:0/3603116361 conn(0x7fad98067d60 msgr2=0x7fad9806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:14.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.033+0000 7fad9ce00640 1 -- 172.21.15.59:0/3603116361 shutdown_connections 2024-05-30T16:51:14.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.033+0000 7fad9ce00640 1 -- 172.21.15.59:0/3603116361 wait complete. 2024-05-30T16:51:14.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad9ce00640 1 Processor -- start 2024-05-30T16:51:14.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad9ce00640 1 -- start start 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad9ce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad9806f8c0 0x7fad9814bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad9ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad981558e0 0x7fad98151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad9ce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9815f690 0x7fad98152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad9ce00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fad98155e40 con 0x7fad981558e0 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad9ce00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fad98155cc0 con 0x7fad9815f690 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad9ce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fad98169100 con 0x7fad9806f8c0 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad8d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad981558e0 0x7fad98151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad8d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad981558e0 0x7fad98151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35742/0 (socket says 172.21.15.59:35742) 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad8d400640 1 -- 172.21.15.59:0/3276031020 learned_addr learned my addr 172.21.15.59:0/3276031020 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad95e00640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad9806f8c0 0x7fad9814bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad96800640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9815f690 0x7fad98152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad8d400640 1 -- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad9806f8c0 msgr2=0x7fad9814bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad8d400640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad9806f8c0 0x7fad9814bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad8d400640 1 -- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9815f690 msgr2=0x7fad98152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:14.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad8d400640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9815f690 0x7fad98152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:14.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad8d400640 1 -- 172.21.15.59:0/3276031020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad98072bb0 con 0x7fad981558e0 2024-05-30T16:51:14.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad8d400640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad981558e0 0x7fad98151ae0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fad800b0040 tx=0x7fad800196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:14.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad8ea00640 1 -- 172.21.15.59:0/3276031020 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad800b2040 con 0x7fad981558e0 2024-05-30T16:51:14.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad8ea00640 1 -- 172.21.15.59:0/3276031020 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad800b8470 con 0x7fad981558e0 2024-05-30T16:51:14.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad8ea00640 1 -- 172.21.15.59:0/3276031020 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad800b8820 con 0x7fad981558e0 2024-05-30T16:51:14.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad9ce00640 1 -- 172.21.15.59:0/3276031020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9806f6f0 con 0x7fad981558e0 2024-05-30T16:51:14.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad9ce00640 1 -- 172.21.15.59:0/3276031020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad98156870 con 0x7fad981558e0 2024-05-30T16:51:14.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.037+0000 7fad9ce00640 1 -- 172.21.15.59:0/3276031020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad98068a90 con 0x7fad981558e0 2024-05-30T16:51:14.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.041+0000 7fad8ea00640 1 -- 172.21.15.59:0/3276031020 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fad800c1020 con 0x7fad981558e0 2024-05-30T16:51:14.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.041+0000 7fad8ea00640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fad74068410 0x7fad7406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:14.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.041+0000 7fad8ea00640 1 -- 172.21.15.59:0/3276031020 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fad80121640 con 0x7fad981558e0 2024-05-30T16:51:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.041+0000 7fad95e00640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fad74068410 0x7fad7406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.041+0000 7fad95e00640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fad74068410 0x7fad7406a8d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fad88004e30 tx=0x7fad88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.045+0000 7fad8ea00640 1 -- 172.21.15.59:0/3276031020 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad80016520 con 0x7fad981558e0 2024-05-30T16:51:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.269+0000 7fad9ce00640 1 -- 172.21.15.59:0/3276031020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fad980b3260 con 0x7fad981558e0 2024-05-30T16:51:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.269+0000 7fad8ea00640 1 -- 172.21.15.59:0/3276031020 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1830 (secure 0 0 0) 0x7fad800f1c30 con 0x7fad981558e0 2024-05-30T16:51:14.271 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:14.271 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:51:14.271 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:51:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 154, 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 34, 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:51:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:51:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 2585, 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 10738547826, 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 21735579648, 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 751358533632, 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 147481540, 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 38 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2, 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:51:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 2, 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 4803 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:51:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 6, 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:50:55.098975+0000", 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": {} 2024-05-30T16:51:14.278 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:51:14.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.269+0000 7fad9ce00640 1 -- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fad74068410 msgr2=0x7fad7406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.269+0000 7fad9ce00640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fad74068410 0x7fad7406a8d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fad88004e30 tx=0x7fad88009040 comp rx=0 tx=0).stop 2024-05-30T16:51:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.269+0000 7fad9ce00640 1 -- 172.21.15.59:0/3276031020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad981558e0 msgr2=0x7fad98151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.269+0000 7fad9ce00640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad981558e0 0x7fad98151ae0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fad800b0040 tx=0x7fad800196d0 comp rx=0 tx=0).stop 2024-05-30T16:51:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.273+0000 7fad9ce00640 1 -- 172.21.15.59:0/3276031020 shutdown_connections 2024-05-30T16:51:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.273+0000 7fad9ce00640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fad74068410 0x7fad7406a8d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.273+0000 7fad9ce00640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9815f690 0x7fad98152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.273+0000 7fad9ce00640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad981558e0 0x7fad98151ae0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.273+0000 7fad9ce00640 1 --2- 172.21.15.59:0/3276031020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad9806f8c0 0x7fad9814bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.273+0000 7fad9ce00640 1 -- 172.21.15.59:0/3276031020 >> 172.21.15.59:0/3276031020 conn(0x7fad98067d60 msgr2=0x7fad9806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.273+0000 7fad9ce00640 1 -- 172.21.15.59:0/3276031020 shutdown_connections 2024-05-30T16:51:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:14.273+0000 7fad9ce00640 1 -- 172.21.15.59:0/3276031020 wait complete. 2024-05-30T16:51:16.294 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:51:16.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.445+0000 7f4e3ee00640 1 Processor -- start 2024-05-30T16:51:16.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.445+0000 7f4e3ee00640 1 -- start start 2024-05-30T16:51:16.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.445+0000 7f4e3ee00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e3815c890 0x7f4e38160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:16.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.445+0000 7f4e3ee00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e3806c390 con 0x7f4e380b2b00 2024-05-30T16:51:16.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.445+0000 7f4e3ee00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e3806c670 con 0x7f4e3806b9b0 2024-05-30T16:51:16.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.445+0000 7f4e3ee00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4e38160790 con 0x7f4e3815c890 2024-05-30T16:51:16.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.445+0000 7f4e37e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e3815c890 0x7f4e38160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:16.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.445+0000 7f4e3ce00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4e380b2b00 0x7f4e380b0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57790/0 (socket says 172.21.15.59:57790) 2024-05-30T16:51:16.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.445+0000 7f4e3ce00640 1 -- 172.21.15.59:0/163269316 learned_addr learned my addr 172.21.15.59:0/163269316 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:16.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.445+0000 7f4e37e00640 1 -- 172.21.15.59:0/163269316 >> v1:172.21.15.107:6789/0 conn(0x7f4e3806b9b0 legacy=0x7f4e380b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:16.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.445+0000 7f4e37e00640 1 -- 172.21.15.59:0/163269316 >> v1:172.21.15.59:6789/0 conn(0x7f4e380b2b00 legacy=0x7f4e380b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:16.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.445+0000 7f4e37e00640 1 -- 172.21.15.59:0/163269316 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e38160420 con 0x7f4e3815c890 2024-05-30T16:51:16.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.449+0000 7f4e37e00640 1 --2- 172.21.15.59:0/163269316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e3815c890 0x7f4e38160c20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4e280097c0 tx=0x7f4e2801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8d1b551fc8c24f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:16.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.449+0000 7f4e36a00640 1 -- 172.21.15.59:0/163269316 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e280b0070 con 0x7f4e3815c890 2024-05-30T16:51:16.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.449+0000 7f4e36a00640 1 -- 172.21.15.59:0/163269316 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e280ab600 con 0x7f4e3815c890 2024-05-30T16:51:16.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.449+0000 7f4e36a00640 1 -- 172.21.15.59:0/163269316 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e280ab9d0 con 0x7f4e3815c890 2024-05-30T16:51:16.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.449+0000 7f4e3ee00640 1 -- 172.21.15.59:0/163269316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e3815c890 msgr2=0x7f4e38160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:16.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.449+0000 7f4e3ee00640 1 --2- 172.21.15.59:0/163269316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e3815c890 0x7f4e38160c20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4e280097c0 tx=0x7f4e2801c330 comp rx=0 tx=0).stop 2024-05-30T16:51:16.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.453+0000 7f4e3ee00640 1 -- 172.21.15.59:0/163269316 shutdown_connections 2024-05-30T16:51:16.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.453+0000 7f4e3ee00640 1 --2- 172.21.15.59:0/163269316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e3815c890 0x7f4e38160c20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:16.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.453+0000 7f4e3ee00640 1 -- 172.21.15.59:0/163269316 >> 172.21.15.59:0/163269316 conn(0x7f4e3809aa40 msgr2=0x7f4e380b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:16.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.453+0000 7f4e3ee00640 1 -- 172.21.15.59:0/163269316 shutdown_connections 2024-05-30T16:51:16.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.453+0000 7f4e3ee00640 1 -- 172.21.15.59:0/163269316 wait complete. 2024-05-30T16:51:16.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.453+0000 7f4e3ee00640 1 Processor -- start 2024-05-30T16:51:16.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.453+0000 7f4e3ee00640 1 -- start start 2024-05-30T16:51:16.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e3ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e3806b9b0 0x7f4e381f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:16.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e3ee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e380b2b00 0x7f4e380af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:16.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e3ee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e3815c890 0x7f4e380af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e3ee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4e380b3dd0 con 0x7f4e380b2b00 2024-05-30T16:51:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e3ee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4e380b3c50 con 0x7f4e3815c890 2024-05-30T16:51:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e3ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3806be10 con 0x7f4e3806b9b0 2024-05-30T16:51:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e37400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e380b2b00 0x7f4e380af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e37400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e380b2b00 0x7f4e380af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35748/0 (socket says 172.21.15.59:35748) 2024-05-30T16:51:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e37400640 1 -- 172.21.15.59:0/3360145056 learned_addr learned my addr 172.21.15.59:0/3360145056 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e37e00640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e3806b9b0 0x7f4e381f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e3ce00640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e3815c890 0x7f4e380af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e37400640 1 -- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e3806b9b0 msgr2=0x7f4e381f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e37400640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e3806b9b0 0x7f4e381f5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e37400640 1 -- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e3815c890 msgr2=0x7f4e380af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e37400640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e3815c890 0x7f4e380af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:16.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e37400640 1 -- 172.21.15.59:0/3360145056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3815cc70 con 0x7f4e380b2b00 2024-05-30T16:51:16.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e37400640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e380b2b00 0x7f4e380af310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400c420 tx=0x7f4e2400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:16.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e2fe00640 1 -- 172.21.15.59:0/3360145056 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e240052d0 con 0x7f4e380b2b00 2024-05-30T16:51:16.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e2fe00640 1 -- 172.21.15.59:0/3360145056 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e24005470 con 0x7f4e380b2b00 2024-05-30T16:51:16.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e2fe00640 1 -- 172.21.15.59:0/3360145056 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24007260 con 0x7f4e380b2b00 2024-05-30T16:51:16.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e3ee00640 1 -- 172.21.15.59:0/3360145056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e381f58d0 con 0x7f4e380b2b00 2024-05-30T16:51:16.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e3ee00640 1 -- 172.21.15.59:0/3360145056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e3815d1f0 con 0x7f4e380b2b00 2024-05-30T16:51:16.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.457+0000 7f4e3ee00640 1 -- 172.21.15.59:0/3360145056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e38068a90 con 0x7f4e380b2b00 2024-05-30T16:51:16.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.461+0000 7f4e2fe00640 1 -- 172.21.15.59:0/3360145056 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f4e24007400 con 0x7f4e380b2b00 2024-05-30T16:51:16.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.461+0000 7f4e2fe00640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4e18068530 0x7f4e1806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:16.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.461+0000 7f4e2fe00640 1 -- 172.21.15.59:0/3360145056 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4e240861e0 con 0x7f4e380b2b00 2024-05-30T16:51:16.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.461+0000 7f4e37e00640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4e18068530 0x7f4e1806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:16.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.461+0000 7f4e37e00640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4e18068530 0x7f4e1806a9f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e280ad000 tx=0x7f4e28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:16.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.465+0000 7f4e2fe00640 1 -- 172.21.15.59:0/3360145056 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4e24055e30 con 0x7f4e380b2b00 2024-05-30T16:51:16.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.745+0000 7f4e3ee00640 1 -- 172.21.15.59:0/3360145056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4e3815de50 con 0x7f4e380b2b00 2024-05-30T16:51:16.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.745+0000 7f4e2fe00640 1 -- 172.21.15.59:0/3360145056 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1829 (secure 0 0 0) 0x7f4e2405a130 con 0x7f4e380b2b00 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:51:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 156, 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 34, 2024-05-30T16:51:16.748 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:51:16.749 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:51:16.749 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:51:16.749 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:51:16.749 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:51:16.749 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:51:16.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:16.749 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:51:16.749 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:51:16.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:16.749 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:51:16.749 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 2585, 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 10738547826, 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 21735579648, 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 751358533632, 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 84923302, 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 22 2024-05-30T16:51:16.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2, 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 2, 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 4803 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:16.751 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 6, 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:50:55.098975+0000", 2024-05-30T16:51:16.752 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:16.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:16.753 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": {} 2024-05-30T16:51:16.753 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:51:16.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.749+0000 7f4e3ee00640 1 -- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4e18068530 msgr2=0x7f4e1806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:16.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.749+0000 7f4e3ee00640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4e18068530 0x7f4e1806a9f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e280ad000 tx=0x7f4e28008040 comp rx=0 tx=0).stop 2024-05-30T16:51:16.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.749+0000 7f4e3ee00640 1 -- 172.21.15.59:0/3360145056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e380b2b00 msgr2=0x7f4e380af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:16.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.749+0000 7f4e3ee00640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e380b2b00 0x7f4e380af310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400c420 tx=0x7f4e2400c8e0 comp rx=0 tx=0).stop 2024-05-30T16:51:16.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.749+0000 7f4e3ee00640 1 -- 172.21.15.59:0/3360145056 shutdown_connections 2024-05-30T16:51:16.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.749+0000 7f4e3ee00640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4e18068530 0x7f4e1806a9f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:16.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.749+0000 7f4e3ee00640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e3815c890 0x7f4e380af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:16.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.749+0000 7f4e3ee00640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e380b2b00 0x7f4e380af310 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:16.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.749+0000 7f4e3ee00640 1 --2- 172.21.15.59:0/3360145056 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e3806b9b0 0x7f4e381f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:16.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.749+0000 7f4e3ee00640 1 -- 172.21.15.59:0/3360145056 >> 172.21.15.59:0/3360145056 conn(0x7f4e3809aa40 msgr2=0x7f4e3806f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:16.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.749+0000 7f4e3ee00640 1 -- 172.21.15.59:0/3360145056 shutdown_connections 2024-05-30T16:51:16.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:16.749+0000 7f4e3ee00640 1 -- 172.21.15.59:0/3360145056 wait complete. 2024-05-30T16:51:18.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:51:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.009+0000 7f8f73600640 1 Processor -- start 2024-05-30T16:51:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.009+0000 7f8f73600640 1 -- start start 2024-05-30T16:51:19.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.009+0000 7f8f73600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f6c163230 0x7f8f6c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.009+0000 7f8f73600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8f6c0b36d0 0x7f8f6c06bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.009+0000 7f8f73600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f6c070d10 con 0x7f8f6c0d0e40 2024-05-30T16:51:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.009+0000 7f8f73600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f8f6c162750 con 0x7f8f6c163230 2024-05-30T16:51:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.009+0000 7f8f73600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8f6c162a30 con 0x7f8f6c0b36d0 2024-05-30T16:51:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.013+0000 7f8f70c00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8f6c0d0e40 0x7f8f6c070410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:45056/0 (socket says 172.21.15.59:45056) 2024-05-30T16:51:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.013+0000 7f8f70c00640 1 -- 172.21.15.59:0/2823669741 learned_addr learned my addr 172.21.15.59:0/2823669741 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.013+0000 7f8f71600640 1 --2- 172.21.15.59:0/2823669741 >> v2:172.21.15.107:3300/0 conn(0x7f8f6c0b36d0 0x7f8f6c06bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.013+0000 7f8f6be00640 1 --2- 172.21.15.59:0/2823669741 >> v2:172.21.15.59:3300/0 conn(0x7f8f6c163230 0x7f8f6c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.013+0000 7f8f71600640 1 -- 172.21.15.59:0/2823669741 >> v2:172.21.15.59:3300/0 conn(0x7f8f6c163230 msgr2=0x7f8f6c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.013+0000 7f8f71600640 1 --2- 172.21.15.59:0/2823669741 >> v2:172.21.15.59:3300/0 conn(0x7f8f6c163230 0x7f8f6c06b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.013+0000 7f8f71600640 1 -- 172.21.15.59:0/2823669741 >> v1:172.21.15.107:6789/0 conn(0x7f8f6c0d0e40 legacy=0x7f8f6c070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.013+0000 7f8f71600640 1 -- 172.21.15.59:0/2823669741 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6c162d10 con 0x7f8f6c0b36d0 2024-05-30T16:51:19.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.017+0000 7f8f71600640 1 --2- 172.21.15.59:0/2823669741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f6c0b36d0 0x7f8f6c06bef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c073e30 tx=0x7f8f6401f110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=576dc63272288260 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:19.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.017+0000 7f8f6b400640 1 -- 172.21.15.59:0/2823669741 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f640b4070 con 0x7f8f6c0b36d0 2024-05-30T16:51:19.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.017+0000 7f8f6b400640 1 -- 172.21.15.59:0/2823669741 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f640af600 con 0x7f8f6c0b36d0 2024-05-30T16:51:19.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.017+0000 7f8f6b400640 1 -- 172.21.15.59:0/2823669741 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f640af9d0 con 0x7f8f6c0b36d0 2024-05-30T16:51:19.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.017+0000 7f8f73600640 1 -- 172.21.15.59:0/2823669741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f6c0b36d0 msgr2=0x7f8f6c06bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.017+0000 7f8f73600640 1 --2- 172.21.15.59:0/2823669741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f6c0b36d0 0x7f8f6c06bef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c073e30 tx=0x7f8f6401f110 comp rx=0 tx=0).stop 2024-05-30T16:51:19.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.017+0000 7f8f73600640 1 -- 172.21.15.59:0/2823669741 shutdown_connections 2024-05-30T16:51:19.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.017+0000 7f8f73600640 1 --2- 172.21.15.59:0/2823669741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f6c0b36d0 0x7f8f6c06bef0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.017+0000 7f8f73600640 1 --2- 172.21.15.59:0/2823669741 >> v2:172.21.15.59:3300/0 conn(0x7f8f6c163230 0x7f8f6c06b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.017+0000 7f8f73600640 1 -- 172.21.15.59:0/2823669741 >> 172.21.15.59:0/2823669741 conn(0x7f8f6c09aa40 msgr2=0x7f8f6c0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:19.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.017+0000 7f8f73600640 1 -- 172.21.15.59:0/2823669741 shutdown_connections 2024-05-30T16:51:19.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.017+0000 7f8f73600640 1 -- 172.21.15.59:0/2823669741 wait complete. 2024-05-30T16:51:19.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f73600640 1 Processor -- start 2024-05-30T16:51:19.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f73600640 1 -- start start 2024-05-30T16:51:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f73600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f6c0b36d0 0x7f8f6c1e9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f73600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f6c0d0e40 0x7f8f6c15bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f73600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f6c163230 0x7f8f6c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f73600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c15e470 con 0x7f8f6c163230 2024-05-30T16:51:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f73600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c15e2f0 con 0x7f8f6c0b36d0 2024-05-30T16:51:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f73600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8f6c15e5f0 con 0x7f8f6c0d0e40 2024-05-30T16:51:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f71600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f6c163230 0x7f8f6c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f71600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f6c163230 0x7f8f6c0b6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35760/0 (socket says 172.21.15.59:35760) 2024-05-30T16:51:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f71600640 1 -- 172.21.15.59:0/1457290271 learned_addr learned my addr 172.21.15.59:0/1457290271 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f71600640 1 -- 172.21.15.59:0/1457290271 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f6c0d0e40 msgr2=0x7f8f6c15bc30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:51:19.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f71600640 1 --2- 172.21.15.59:0/1457290271 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f6c0d0e40 0x7f8f6c15bc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f71600640 1 -- 172.21.15.59:0/1457290271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f6c0b36d0 msgr2=0x7f8f6c1e9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f71600640 1 --2- 172.21.15.59:0/1457290271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f6c0b36d0 0x7f8f6c1e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f71600640 1 -- 172.21.15.59:0/1457290271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6c1e9820 con 0x7f8f6c163230 2024-05-30T16:51:19.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f71600640 1 --2- 172.21.15.59:0/1457290271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f6c163230 0x7f8f6c0b6110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8f6401bd20 tx=0x7f8f6401beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:19.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f68c00640 1 -- 172.21.15.59:0/1457290271 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f640b4040 con 0x7f8f6c163230 2024-05-30T16:51:19.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f68c00640 1 -- 172.21.15.59:0/1457290271 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f640c1070 con 0x7f8f6c163230 2024-05-30T16:51:19.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f68c00640 1 -- 172.21.15.59:0/1457290271 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f64009450 con 0x7f8f6c163230 2024-05-30T16:51:19.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f73600640 1 -- 172.21.15.59:0/1457290271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f6c1e9b00 con 0x7f8f6c163230 2024-05-30T16:51:19.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.021+0000 7f8f73600640 1 -- 172.21.15.59:0/1457290271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f6c0c6680 con 0x7f8f6c163230 2024-05-30T16:51:19.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.025+0000 7f8f73600640 1 -- 172.21.15.59:0/1457290271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f6c068a90 con 0x7f8f6c163230 2024-05-30T16:51:19.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.025+0000 7f8f68c00640 1 -- 172.21.15.59:0/1457290271 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f8f640ba6b0 con 0x7f8f6c163230 2024-05-30T16:51:19.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.025+0000 7f8f68c00640 1 --2- 172.21.15.59:0/1457290271 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f4c068530 0x7f8f4c06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.025+0000 7f8f68c00640 1 -- 172.21.15.59:0/1457290271 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8f641258a0 con 0x7f8f6c163230 2024-05-30T16:51:19.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.029+0000 7f8f68c00640 1 -- 172.21.15.59:0/1457290271 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f64018c70 con 0x7f8f6c163230 2024-05-30T16:51:19.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.033+0000 7f8f70c00640 1 --2- 172.21.15.59:0/1457290271 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f4c068530 0x7f8f4c06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.033+0000 7f8f70c00640 1 --2- 172.21.15.59:0/1457290271 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f4c068530 0x7f8f4c06a9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f58001600 tx=0x7f8f58007a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:19.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 -- 172.21.15.59:0/1457290271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8f6c0ce980 con 0x7f8f6c163230 2024-05-30T16:51:19.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f68c00640 1 -- 172.21.15.59:0/1457290271 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2064 (secure 0 0 0) 0x7f8f640f5ad0 con 0x7f8f6c163230 2024-05-30T16:51:19.346 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:19.346 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:51:19.346 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:51:19.346 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:51:19.346 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:51:19.346 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:51:19.347 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 159, 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 34, 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:51:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 2585, 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 10738610813, 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 21735645184, 2024-05-30T16:51:19.349 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 751358468096, 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 84929717, 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 23 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2, 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 2, 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 4803 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:51:19.351 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 6, 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:50:55.098975+0000", 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: "fde5f67a-5844-48ae-9ab8-e075610119d8": { 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "1 ongoing clones; Avg progress is 0.0% (0s)\n [............................] ", 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0, 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:51:19.352 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:19.353 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:19.353 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:51:19.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 -- 172.21.15.59:0/1457290271 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f4c068530 msgr2=0x7f8f4c06a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 --2- 172.21.15.59:0/1457290271 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f4c068530 0x7f8f4c06a9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f58001600 tx=0x7f8f58007a50 comp rx=0 tx=0).stop 2024-05-30T16:51:19.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 -- 172.21.15.59:0/1457290271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f6c163230 msgr2=0x7f8f6c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 --2- 172.21.15.59:0/1457290271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f6c163230 0x7f8f6c0b6110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8f6401bd20 tx=0x7f8f6401beb0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 -- 172.21.15.59:0/1457290271 shutdown_connections 2024-05-30T16:51:19.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 --2- 172.21.15.59:0/1457290271 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f4c068530 0x7f8f4c06a9f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 --2- 172.21.15.59:0/1457290271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f6c163230 0x7f8f6c0b6110 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 --2- 172.21.15.59:0/1457290271 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f6c0d0e40 0x7f8f6c15bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 --2- 172.21.15.59:0/1457290271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f6c0b36d0 0x7f8f6c1e9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 -- 172.21.15.59:0/1457290271 >> 172.21.15.59:0/1457290271 conn(0x7f8f6c09aa40 msgr2=0x7f8f6c0700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:19.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 -- 172.21.15.59:0/1457290271 shutdown_connections 2024-05-30T16:51:19.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.345+0000 7f8f73600640 1 -- 172.21.15.59:0/1457290271 wait complete. 2024-05-30T16:51:19.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs ss1clone1 2024-05-30T16:51:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.605+0000 7f5b12a00640 1 Processor -- start 2024-05-30T16:51:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.605+0000 7f5b12a00640 1 -- start start 2024-05-30T16:51:19.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.605+0000 7f5b12a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b0c15c7b0 0x7f5b0c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.605+0000 7f5b12a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5b0c09b250 0x7f5b0c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.605+0000 7f5b12a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0c09b900 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.605+0000 7f5b12a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5b0c0d11c0 con 0x7f5b0c09b250 2024-05-30T16:51:19.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.605+0000 7f5b12a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0c09b6c0 con 0x7f5b0c15c7b0 2024-05-30T16:51:19.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.609+0000 7f5b11600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b0c15c7b0 0x7f5b0c0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.609+0000 7f5b12000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5b0c09b250 0x7f5b0c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.609+0000 7f5b10c00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f5b0c0d0d60 0x7f5b0c09ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:45066/0 (socket says 172.21.15.59:45066) 2024-05-30T16:51:19.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.609+0000 7f5b10c00640 1 -- 172.21.15.59:0/1164056698 learned_addr learned my addr 172.21.15.59:0/1164056698 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:19.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.609+0000 7f5b0be00640 1 -- 172.21.15.59:0/1164056698 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3948289287 0 0) 0x7f5b0c09b900 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.609+0000 7f5b0be00640 1 -- 172.21.15.59:0/1164056698 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5af4003530 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.609+0000 7f5b11600640 1 -- 172.21.15.59:0/1164056698 >> v2:172.21.15.107:3300/0 conn(0x7f5b0c09b250 msgr2=0x7f5b0c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:19.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.609+0000 7f5b11600640 1 --2- 172.21.15.59:0/1164056698 >> v2:172.21.15.107:3300/0 conn(0x7f5b0c09b250 0x7f5b0c0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.609+0000 7f5b11600640 1 -- 172.21.15.59:0/1164056698 >> v1:172.21.15.107:6789/0 conn(0x7f5b0c0d0d60 legacy=0x7f5b0c09ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.609+0000 7f5b11600640 1 -- 172.21.15.59:0/1164056698 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c09bbe0 con 0x7f5b0c15c7b0 2024-05-30T16:51:19.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.613+0000 7f5b11600640 1 --2- 172.21.15.59:0/1164056698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b0c15c7b0 0x7f5b0c0d0820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b000097c0 tx=0x7f5b0001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc90bcd012791afa server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.613+0000 7f5b0be00640 1 -- 172.21.15.59:0/1164056698 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b000b0070 con 0x7f5b0c15c7b0 2024-05-30T16:51:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.613+0000 7f5b0be00640 1 -- 172.21.15.59:0/1164056698 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b000ab600 con 0x7f5b0c15c7b0 2024-05-30T16:51:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.613+0000 7f5b0be00640 1 -- 172.21.15.59:0/1164056698 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b000ab9b0 con 0x7f5b0c15c7b0 2024-05-30T16:51:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.617+0000 7f5b12a00640 1 -- 172.21.15.59:0/1164056698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b0c15c7b0 msgr2=0x7f5b0c0d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.617+0000 7f5b12a00640 1 --2- 172.21.15.59:0/1164056698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b0c15c7b0 0x7f5b0c0d0820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b000097c0 tx=0x7f5b0001c4a0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.617+0000 7f5b12a00640 1 -- 172.21.15.59:0/1164056698 shutdown_connections 2024-05-30T16:51:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.617+0000 7f5b12a00640 1 --2- 172.21.15.59:0/1164056698 >> v2:172.21.15.107:3300/0 conn(0x7f5b0c09b250 0x7f5b0c0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.617+0000 7f5b12a00640 1 --2- 172.21.15.59:0/1164056698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b0c15c7b0 0x7f5b0c0d0820 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.617+0000 7f5b12a00640 1 -- 172.21.15.59:0/1164056698 >> 172.21.15.59:0/1164056698 conn(0x7f5b0c0b3ec0 msgr2=0x7f5b0c0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.617+0000 7f5b12a00640 1 -- 172.21.15.59:0/1164056698 shutdown_connections 2024-05-30T16:51:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.617+0000 7f5b12a00640 1 -- 172.21.15.59:0/1164056698 wait complete. 2024-05-30T16:51:19.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.617+0000 7f5b12a00640 1 Processor -- start 2024-05-30T16:51:19.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.617+0000 7f5b12a00640 1 -- start start 2024-05-30T16:51:19.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b12a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b0c09b250 0x7f5b0c151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b12a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0c0d0d60 0x7f5b0c15a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b12a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c15c7b0 0x7f5b0c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b12a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c0cea70 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b12a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c0ce8f0 con 0x7f5b0c15c7b0 2024-05-30T16:51:19.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b12a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0c0cebf0 con 0x7f5b0c09b250 2024-05-30T16:51:19.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b10c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0c0d0d60 0x7f5b0c15a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b10c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0c0d0d60 0x7f5b0c15a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35776/0 (socket says 172.21.15.59:35776) 2024-05-30T16:51:19.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b10c00640 1 -- 172.21.15.59:0/24688889 learned_addr learned my addr 172.21.15.59:0/24688889 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:19.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b11600640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b0c09b250 0x7f5b0c151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b12000640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c15c7b0 0x7f5b0c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b10c00640 1 -- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b0c09b250 msgr2=0x7f5b0c151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b10c00640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b0c09b250 0x7f5b0c151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b10c00640 1 -- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c15c7b0 msgr2=0x7f5b0c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b10c00640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c15c7b0 0x7f5b0c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b10c00640 1 -- 172.21.15.59:0/24688889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c0c9eb0 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b10c00640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0c0d0d60 0x7f5b0c15a0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5af800c3c0 tx=0x7f5af800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:19.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b09600640 1 -- 172.21.15.59:0/24688889 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8017070 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b09600640 1 -- 172.21.15.59:0/24688889 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af8005cf0 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b09600640 1 -- 172.21.15.59:0/24688889 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af80072f0 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b12a00640 1 -- 172.21.15.59:0/24688889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0c0ca150 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b12a00640 1 -- 172.21.15.59:0/24688889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b0c0ca710 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.621+0000 7f5b12a00640 1 -- 172.21.15.59:0/24688889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0c068a90 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.625+0000 7f5b09600640 1 -- 172.21.15.59:0/24688889 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f5af801a070 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.625+0000 7f5b09600640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5aec068530 0x7f5aec06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.625+0000 7f5b09600640 1 -- 172.21.15.59:0/24688889 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5af8085f30 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.629+0000 7f5b11600640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5aec068530 0x7f5aec06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.629+0000 7f5b11600640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5aec068530 0x7f5aec06a9f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5b000097c0 tx=0x7f5b000a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:19.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.633+0000 7f5b09600640 1 -- 172.21.15.59:0/24688889 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5af8055cd0 con 0x7f5b0c0d0d60 2024-05-30T16:51:19.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:19.969+0000 7f5b12a00640 1 -- 172.21.15.59:0/24688889 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f5b0c0b4b20 con 0x7f5aec068530 2024-05-30T16:51:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.113+0000 7f5b09600640 1 -- 172.21.15.59:0/24688889 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5b0c0b4b20 con 0x7f5aec068530 2024-05-30T16:51:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.113+0000 7f5b12a00640 1 -- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5aec068530 msgr2=0x7f5aec06a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.113+0000 7f5b12a00640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5aec068530 0x7f5aec06a9f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5b000097c0 tx=0x7f5b000a6000 comp rx=0 tx=0).stop 2024-05-30T16:51:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.113+0000 7f5b12a00640 1 -- 172.21.15.59:0/24688889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0c0d0d60 msgr2=0x7f5b0c15a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.113+0000 7f5b12a00640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0c0d0d60 0x7f5b0c15a0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5af800c3c0 tx=0x7f5af800c880 comp rx=0 tx=0).stop 2024-05-30T16:51:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.113+0000 7f5b12a00640 1 -- 172.21.15.59:0/24688889 shutdown_connections 2024-05-30T16:51:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.113+0000 7f5b12a00640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5aec068530 0x7f5aec06a9f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.113+0000 7f5b12a00640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c15c7b0 0x7f5b0c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.113+0000 7f5b12a00640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0c0d0d60 0x7f5b0c15a0a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.113+0000 7f5b12a00640 1 --2- 172.21.15.59:0/24688889 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b0c09b250 0x7f5b0c151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.113+0000 7f5b12a00640 1 -- 172.21.15.59:0/24688889 >> 172.21.15.59:0/24688889 conn(0x7f5b0c0b3ec0 msgr2=0x7f5b0c06dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.117+0000 7f5b12a00640 1 -- 172.21.15.59:0/24688889 shutdown_connections 2024-05-30T16:51:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.117+0000 7f5b12a00640 1 -- 172.21.15.59:0/24688889 wait complete. 2024-05-30T16:51:20.137 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:51:20.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f1949800640 1 Processor -- start 2024-05-30T16:51:20.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f1949800640 1 -- start start 2024-05-30T16:51:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f1949800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f194406db40 0x7f194415f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f1949800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19441627a0 con 0x7f1944161bf0 2024-05-30T16:51:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f1949800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1944162a80 con 0x7f194415e710 2024-05-30T16:51:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f1949800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f19440d0660 con 0x7f194406db40 2024-05-30T16:51:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f193a000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1944161bf0 0x7f194415eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57796/0 (socket says 172.21.15.59:57796) 2024-05-30T16:51:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f193a000640 1 -- 172.21.15.59:0/1251021162 learned_addr learned my addr 172.21.15.59:0/1251021162 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f1943400640 1 --2- 172.21.15.59:0/1251021162 >> v2:172.21.15.107:3300/0 conn(0x7f194406db40 0x7f194415f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f1942000640 1 -- 172.21.15.59:0/1251021162 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2657069105 0 0) 0x7f19441627a0 con 0x7f1944161bf0 2024-05-30T16:51:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f1942000640 1 -- 172.21.15.59:0/1251021162 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1928003530 con 0x7f1944161bf0 2024-05-30T16:51:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f1943400640 1 -- 172.21.15.59:0/1251021162 >> v1:172.21.15.107:6789/0 conn(0x7f194415e710 legacy=0x7f19441614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f1943400640 1 -- 172.21.15.59:0/1251021162 >> v1:172.21.15.59:6789/0 conn(0x7f1944161bf0 legacy=0x7f194415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.277+0000 7f1943400640 1 -- 172.21.15.59:0/1251021162 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1944162d60 con 0x7f194406db40 2024-05-30T16:51:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.281+0000 7f1943400640 1 --2- 172.21.15.59:0/1251021162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f194406db40 0x7f194415f200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f193c009d90 tx=0x7f193c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd6210292ca15c12 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.281+0000 7f1942000640 1 -- 172.21.15.59:0/1251021162 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c0b2070 con 0x7f194406db40 2024-05-30T16:51:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.281+0000 7f1942000640 1 -- 172.21.15.59:0/1251021162 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193c0a5830 con 0x7f194406db40 2024-05-30T16:51:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.281+0000 7f1942000640 1 -- 172.21.15.59:0/1251021162 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c0a5be0 con 0x7f194406db40 2024-05-30T16:51:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.281+0000 7f1949800640 1 -- 172.21.15.59:0/1251021162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f194406db40 msgr2=0x7f194415f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.281+0000 7f1949800640 1 --2- 172.21.15.59:0/1251021162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f194406db40 0x7f194415f200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f193c009d90 tx=0x7f193c01c970 comp rx=0 tx=0).stop 2024-05-30T16:51:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.281+0000 7f1949800640 1 -- 172.21.15.59:0/1251021162 shutdown_connections 2024-05-30T16:51:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.281+0000 7f1949800640 1 --2- 172.21.15.59:0/1251021162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f194406db40 0x7f194415f200 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.281+0000 7f1949800640 1 -- 172.21.15.59:0/1251021162 >> 172.21.15.59:0/1251021162 conn(0x7f19440b3f50 msgr2=0x7f19440b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.281+0000 7f1949800640 1 -- 172.21.15.59:0/1251021162 shutdown_connections 2024-05-30T16:51:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.281+0000 7f1949800640 1 -- 172.21.15.59:0/1251021162 wait complete. 2024-05-30T16:51:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1949800640 1 Processor -- start 2024-05-30T16:51:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1949800640 1 -- start start 2024-05-30T16:51:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1949800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f194406db40 0x7f1944158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1949800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f194415e710 0x7f194409fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1949800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944161bf0 0x7f19440b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1949800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1944162540 con 0x7f1944161bf0 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1949800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f19441623c0 con 0x7f194406db40 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1949800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1944161ff0 con 0x7f194415e710 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1943400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944161bf0 0x7f19440b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1943400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944161bf0 0x7f19440b7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35788/0 (socket says 172.21.15.59:35788) 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1943400640 1 -- 172.21.15.59:0/3548035816 learned_addr learned my addr 172.21.15.59:0/3548035816 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f193a000640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f194415e710 0x7f194409fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1942a00640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f194406db40 0x7f1944158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1943400640 1 -- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f194415e710 msgr2=0x7f194409fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1943400640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f194415e710 0x7f194409fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1943400640 1 -- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f194406db40 msgr2=0x7f1944158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1943400640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f194406db40 0x7f1944158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1943400640 1 -- 172.21.15.59:0/3548035816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194415d1d0 con 0x7f1944161bf0 2024-05-30T16:51:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1943400640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944161bf0 0x7f19440b7090 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f193c009d90 tx=0x7f193c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f193b400640 1 -- 172.21.15.59:0/3548035816 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c0b2050 con 0x7f1944161bf0 2024-05-30T16:51:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f193b400640 1 -- 172.21.15.59:0/3548035816 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193c0b3040 con 0x7f1944161bf0 2024-05-30T16:51:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f193b400640 1 -- 172.21.15.59:0/3548035816 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c0ad650 con 0x7f1944161bf0 2024-05-30T16:51:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1949800640 1 -- 172.21.15.59:0/3548035816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194415d4b0 con 0x7f1944161bf0 2024-05-30T16:51:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1949800640 1 -- 172.21.15.59:0/3548035816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1944159200 con 0x7f1944161bf0 2024-05-30T16:51:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.285+0000 7f1949800640 1 -- 172.21.15.59:0/3548035816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1944068a90 con 0x7f1944161bf0 2024-05-30T16:51:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.289+0000 7f193b400640 1 -- 172.21.15.59:0/3548035816 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f193c0c0020 con 0x7f1944161bf0 2024-05-30T16:51:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.289+0000 7f193b400640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1920068560 0x7f192006aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.289+0000 7f193b400640 1 -- 172.21.15.59:0/3548035816 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f193c121450 con 0x7f1944161bf0 2024-05-30T16:51:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.289+0000 7f1942a00640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1920068560 0x7f192006aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.289+0000 7f1942a00640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1920068560 0x7f192006aa20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1934001770 tx=0x7f1934009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.293+0000 7f193b400640 1 -- 172.21.15.59:0/3548035816 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f193c016560 con 0x7f1944161bf0 2024-05-30T16:51:20.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.481+0000 7f1949800640 1 -- 172.21.15.59:0/3548035816 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f194415cf80 con 0x7f1920068560 2024-05-30T16:51:20.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.481+0000 7f193b400640 1 -- 172.21.15.59:0/3548035816 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f194415cf80 con 0x7f1920068560 2024-05-30T16:51:20.484 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:51:20.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:20.485 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T16:51:20.485 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:20.485 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:51:20.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.485+0000 7f1949800640 1 -- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1920068560 msgr2=0x7f192006aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.485+0000 7f1949800640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1920068560 0x7f192006aa20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1934001770 tx=0x7f1934009040 comp rx=0 tx=0).stop 2024-05-30T16:51:20.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.485+0000 7f1949800640 1 -- 172.21.15.59:0/3548035816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944161bf0 msgr2=0x7f19440b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.485+0000 7f1949800640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944161bf0 0x7f19440b7090 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f193c009d90 tx=0x7f193c019710 comp rx=0 tx=0).stop 2024-05-30T16:51:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.485+0000 7f1949800640 1 -- 172.21.15.59:0/3548035816 shutdown_connections 2024-05-30T16:51:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.485+0000 7f1949800640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1920068560 0x7f192006aa20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.485+0000 7f1949800640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944161bf0 0x7f19440b7090 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.485+0000 7f1949800640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f194415e710 0x7f194409fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.485+0000 7f1949800640 1 --2- 172.21.15.59:0/3548035816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f194406db40 0x7f1944158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.485+0000 7f1949800640 1 -- 172.21.15.59:0/3548035816 >> 172.21.15.59:0/3548035816 conn(0x7f19440b3f50 msgr2=0x7f194409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.485+0000 7f1949800640 1 -- 172.21.15.59:0/3548035816 shutdown_connections 2024-05-30T16:51:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.485+0000 7f1949800640 1 -- 172.21.15.59:0/3548035816 wait complete. 2024-05-30T16:51:20.506 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:51:20.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70cbc00640 1 Processor -- start 2024-05-30T16:51:20.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70cbc00640 1 -- start start 2024-05-30T16:51:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70cbc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f70c40b37a0 0x7f70c40d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70cbc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 0x7f70c40cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70cbc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c40d0260 con 0x7f70c40cdb60 2024-05-30T16:51:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70cbc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f70c40d0010 con 0x7f70c40b37a0 2024-05-30T16:51:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70cbc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f70c40d0540 con 0x7f70c409b150 2024-05-30T16:51:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70c9c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 0x7f70c40cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70c9c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 0x7f70c40cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:54426/0 (socket says 172.21.15.59:54426) 2024-05-30T16:51:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70c9c00640 1 -- 172.21.15.59:0/3224697235 learned_addr learned my addr 172.21.15.59:0/3224697235 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70c9200640 1 --2- 172.21.15.59:0/3224697235 >> v2:172.21.15.107:3300/0 conn(0x7f70c40b37a0 0x7f70c40d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70c9c00640 1 -- 172.21.15.59:0/3224697235 >> v2:172.21.15.107:3300/0 conn(0x7f70c40b37a0 msgr2=0x7f70c40d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70c9c00640 1 --2- 172.21.15.59:0/3224697235 >> v2:172.21.15.107:3300/0 conn(0x7f70c40b37a0 0x7f70c40d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70c9c00640 1 -- 172.21.15.59:0/3224697235 >> v1:172.21.15.107:6789/0 conn(0x7f70c40cdb60 legacy=0x7f70c409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.645+0000 7f70c9c00640 1 -- 172.21.15.59:0/3224697235 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c40d0820 con 0x7f70c409b150 2024-05-30T16:51:20.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.649+0000 7f70c9c00640 1 --2- 172.21.15.59:0/3224697235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 0x7f70c40cdfc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009e50 tx=0x7f70bc01c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95f42b874adfe19 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:20.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.649+0000 7f70c3e00640 1 -- 172.21.15.59:0/3224697235 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc0a5770 con 0x7f70c409b150 2024-05-30T16:51:20.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.649+0000 7f70c3e00640 1 -- 172.21.15.59:0/3224697235 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70bc0a5910 con 0x7f70c409b150 2024-05-30T16:51:20.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.649+0000 7f70c3e00640 1 -- 172.21.15.59:0/3224697235 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc0a5ce0 con 0x7f70c409b150 2024-05-30T16:51:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.649+0000 7f70cbc00640 1 -- 172.21.15.59:0/3224697235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 msgr2=0x7f70c40cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.649+0000 7f70cbc00640 1 --2- 172.21.15.59:0/3224697235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 0x7f70c40cdfc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009e50 tx=0x7f70bc01c9a0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.649+0000 7f70cbc00640 1 -- 172.21.15.59:0/3224697235 shutdown_connections 2024-05-30T16:51:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.649+0000 7f70cbc00640 1 --2- 172.21.15.59:0/3224697235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 0x7f70c40cdfc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.649+0000 7f70cbc00640 1 --2- 172.21.15.59:0/3224697235 >> v2:172.21.15.107:3300/0 conn(0x7f70c40b37a0 0x7f70c40d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.649+0000 7f70cbc00640 1 -- 172.21.15.59:0/3224697235 >> 172.21.15.59:0/3224697235 conn(0x7f70c40b3f30 msgr2=0x7f70c40b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.649+0000 7f70cbc00640 1 -- 172.21.15.59:0/3224697235 shutdown_connections 2024-05-30T16:51:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.649+0000 7f70cbc00640 1 -- 172.21.15.59:0/3224697235 wait complete. 2024-05-30T16:51:20.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70cbc00640 1 Processor -- start 2024-05-30T16:51:20.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70cbc00640 1 -- start start 2024-05-30T16:51:20.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70cbc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 0x7f70c41475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70cbc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70c40b37a0 0x7f70c40afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70cbc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c40cdb60 0x7f70c40b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70cbc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70c40b29c0 con 0x7f70c40cdb60 2024-05-30T16:51:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70cbc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f70c40b2840 con 0x7f70c40b37a0 2024-05-30T16:51:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70cbc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f70c40b2b40 con 0x7f70c409b150 2024-05-30T16:51:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c9c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c40cdb60 0x7f70c40b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c9c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c40cdb60 0x7f70c40b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35798/0 (socket says 172.21.15.59:35798) 2024-05-30T16:51:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c9200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 0x7f70c41475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c9c00640 1 -- 172.21.15.59:0/293370892 learned_addr learned my addr 172.21.15.59:0/293370892 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70bbe00640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70c40b37a0 0x7f70c40afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c9200640 1 -- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70c40b37a0 msgr2=0x7f70c40afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c9200640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70c40b37a0 0x7f70c40afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c9200640 1 -- 172.21.15.59:0/293370892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c40cdb60 msgr2=0x7f70c40b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c9200640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c40cdb60 0x7f70c40b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c9200640 1 -- 172.21.15.59:0/293370892 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c415dbc0 con 0x7f70c409b150 2024-05-30T16:51:20.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c9c00640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c40cdb60 0x7f70c40b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:20.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c9200640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 0x7f70c41475f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70b400e850 tx=0x7f70b400ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:20.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c1600640 1 -- 172.21.15.59:0/293370892 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4017070 con 0x7f70c409b150 2024-05-30T16:51:20.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c1600640 1 -- 172.21.15.59:0/293370892 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b400c940 con 0x7f70c409b150 2024-05-30T16:51:20.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70cbc00640 1 -- 172.21.15.59:0/293370892 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c415dea0 con 0x7f70c409b150 2024-05-30T16:51:20.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70c1600640 1 -- 172.21.15.59:0/293370892 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b400ccf0 con 0x7f70c409b150 2024-05-30T16:51:20.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70cbc00640 1 -- 172.21.15.59:0/293370892 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c4147b30 con 0x7f70c409b150 2024-05-30T16:51:20.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.653+0000 7f70cbc00640 1 -- 172.21.15.59:0/293370892 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c4068a90 con 0x7f70c409b150 2024-05-30T16:51:20.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.657+0000 7f70c1600640 1 -- 172.21.15.59:0/293370892 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f70b401a070 con 0x7f70c409b150 2024-05-30T16:51:20.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.657+0000 7f70c1600640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f70a0068530 0x7f70a006a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:20.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.657+0000 7f70c1600640 1 -- 172.21.15.59:0/293370892 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f70b40874f0 con 0x7f70c409b150 2024-05-30T16:51:20.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.657+0000 7f70bbe00640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f70a0068530 0x7f70a006a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:20.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.657+0000 7f70bbe00640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f70a0068530 0x7f70a006a9f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70c41f8cd0 tx=0x7f70ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:20.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.661+0000 7f70c1600640 1 -- 172.21.15.59:0/293370892 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f70b4057270 con 0x7f70c409b150 2024-05-30T16:51:20.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.885+0000 7f70cbc00640 1 -- 172.21.15.59:0/293370892 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f70c40af450 con 0x7f70c409b150 2024-05-30T16:51:20.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.885+0000 7f70c1600640 1 -- 172.21.15.59:0/293370892 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2137 (secure 0 0 0) 0x7f70b405b570 con 0x7f70c409b150 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:51:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 160, 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:20.890 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 34, 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:51:20.891 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 2649, 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 10990269627, 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 21836427264, 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 751257686016, 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 22715018, 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 96807981, 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 5, 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 26 2024-05-30T16:51:20.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2, 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 2, 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 4803 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:20.893 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:51:20.894 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 6, 2024-05-30T16:51:20.895 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:50:55.098975+0000", 2024-05-30T16:51:20.895 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:20.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:20.895 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:51:20.895 INFO:teuthology.orchestra.run.smithi059.stdout: "fde5f67a-5844-48ae-9ab8-e075610119d8": { 2024-05-30T16:51:20.895 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "1 ongoing clones; Avg progress is 6.172% (2s)\n [=...........................] (remaining: 31s)", 2024-05-30T16:51:20.895 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.061719998717308044, 2024-05-30T16:51:20.895 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:51:20.895 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:20.895 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:20.895 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:51:20.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.889+0000 7f70cbc00640 1 -- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f70a0068530 msgr2=0x7f70a006a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.889+0000 7f70cbc00640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f70a0068530 0x7f70a006a9f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70c41f8cd0 tx=0x7f70ac009040 comp rx=0 tx=0).stop 2024-05-30T16:51:20.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.889+0000 7f70cbc00640 1 -- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 msgr2=0x7f70c41475f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:20.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.889+0000 7f70cbc00640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 0x7f70c41475f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70b400e850 tx=0x7f70b400ed10 comp rx=0 tx=0).stop 2024-05-30T16:51:20.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.889+0000 7f70cbc00640 1 -- 172.21.15.59:0/293370892 shutdown_connections 2024-05-30T16:51:20.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.889+0000 7f70cbc00640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f70a0068530 0x7f70a006a9f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.889+0000 7f70cbc00640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c40cdb60 0x7f70c40b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.889+0000 7f70cbc00640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70c40b37a0 0x7f70c40afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.889+0000 7f70cbc00640 1 --2- 172.21.15.59:0/293370892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70c409b150 0x7f70c41475f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:20.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.889+0000 7f70cbc00640 1 -- 172.21.15.59:0/293370892 >> 172.21.15.59:0/293370892 conn(0x7f70c40b3f30 msgr2=0x7f70c415d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:20.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.889+0000 7f70cbc00640 1 -- 172.21.15.59:0/293370892 shutdown_connections 2024-05-30T16:51:20.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:20.889+0000 7f70cbc00640 1 -- 172.21.15.59:0/293370892 wait complete. 2024-05-30T16:51:25.912 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:51:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.061+0000 7fdd8b000640 1 Processor -- start 2024-05-30T16:51:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.061+0000 7fdd8b000640 1 -- start start 2024-05-30T16:51:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.061+0000 7fdd8b000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd840d0e40 0x7fdd84070410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.061+0000 7fdd8b000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd84163230 0x7fdd8406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.061+0000 7fdd8b000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdd840b36d0 0x7fdd8406bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.061+0000 7fdd8b000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fdd84070d10 con 0x7fdd84163230 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.061+0000 7fdd8b000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fdd84162750 con 0x7fdd840b36d0 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.061+0000 7fdd8b000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdd84162a30 con 0x7fdd840d0e40 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd7be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd84163230 0x7fdd8406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd7be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd84163230 0x7fdd8406b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42420/0 (socket says 172.21.15.59:42420) 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd7be00640 1 -- 172.21.15.59:0/1866409356 learned_addr learned my addr 172.21.15.59:0/1866409356 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd83e00640 1 --2- 172.21.15.59:0/1866409356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd840d0e40 0x7fdd84070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd89000640 1 --2- 172.21.15.59:0/1866409356 >> v2:172.21.15.107:3300/0 conn(0x7fdd840b36d0 0x7fdd8406bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd7be00640 1 -- 172.21.15.59:0/1866409356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd840d0e40 msgr2=0x7fdd84070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd7be00640 1 --2- 172.21.15.59:0/1866409356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd840d0e40 0x7fdd84070410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd7be00640 1 -- 172.21.15.59:0/1866409356 >> v2:172.21.15.107:3300/0 conn(0x7fdd840b36d0 msgr2=0x7fdd8406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd7be00640 1 --2- 172.21.15.59:0/1866409356 >> v2:172.21.15.107:3300/0 conn(0x7fdd840b36d0 0x7fdd8406bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd7be00640 1 -- 172.21.15.59:0/1866409356 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd84162d10 con 0x7fdd84163230 2024-05-30T16:51:26.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd7be00640 1 --2- 172.21.15.59:0/1866409356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd84163230 0x7fdd8406b9b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdd84072da0 tx=0x7fdd6c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ce340170399118 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:26.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd83400640 1 -- 172.21.15.59:0/1866409356 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c0b5070 con 0x7fdd84163230 2024-05-30T16:51:26.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd83400640 1 -- 172.21.15.59:0/1866409356 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd6c0a89d0 con 0x7fdd84163230 2024-05-30T16:51:26.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.065+0000 7fdd83400640 1 -- 172.21.15.59:0/1866409356 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c0a8da0 con 0x7fdd84163230 2024-05-30T16:51:26.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 -- 172.21.15.59:0/1866409356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd84163230 msgr2=0x7fdd8406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 --2- 172.21.15.59:0/1866409356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd84163230 0x7fdd8406b9b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdd84072da0 tx=0x7fdd6c01ed10 comp rx=0 tx=0).stop 2024-05-30T16:51:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 -- 172.21.15.59:0/1866409356 shutdown_connections 2024-05-30T16:51:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 --2- 172.21.15.59:0/1866409356 >> v2:172.21.15.107:3300/0 conn(0x7fdd840b36d0 0x7fdd8406bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 --2- 172.21.15.59:0/1866409356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd84163230 0x7fdd8406b9b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 --2- 172.21.15.59:0/1866409356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd840d0e40 0x7fdd84070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 -- 172.21.15.59:0/1866409356 >> 172.21.15.59:0/1866409356 conn(0x7fdd8409aa40 msgr2=0x7fdd840b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 -- 172.21.15.59:0/1866409356 shutdown_connections 2024-05-30T16:51:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 -- 172.21.15.59:0/1866409356 wait complete. 2024-05-30T16:51:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 Processor -- start 2024-05-30T16:51:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 -- start start 2024-05-30T16:51:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd840b36d0 0x7fdd840c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd840d0e40 0x7fdd840af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd84163230 0x7fdd840cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8406f030 con 0x7fdd840d0e40 2024-05-30T16:51:26.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8406eeb0 con 0x7fdd840b36d0 2024-05-30T16:51:26.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd8b000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdd8406f1b0 con 0x7fdd84163230 2024-05-30T16:51:26.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd7be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd840d0e40 0x7fdd840af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:26.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd7be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd840d0e40 0x7fdd840af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42434/0 (socket says 172.21.15.59:42434) 2024-05-30T16:51:26.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd7be00640 1 -- 172.21.15.59:0/1071523943 learned_addr learned my addr 172.21.15.59:0/1071523943 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:26.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd83e00640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd840b36d0 0x7fdd840c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:26.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd89000640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd84163230 0x7fdd840cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:26.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd7be00640 1 -- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd84163230 msgr2=0x7fdd840cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:26.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd7be00640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd84163230 0x7fdd840cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:26.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd7be00640 1 -- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd840b36d0 msgr2=0x7fdd840c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:26.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd7be00640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd840b36d0 0x7fdd840c4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:26.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.069+0000 7fdd7be00640 1 -- 172.21.15.59:0/1071523943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd840b4dc0 con 0x7fdd840d0e40 2024-05-30T16:51:26.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.073+0000 7fdd7be00640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd840d0e40 0x7fdd840af4e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c01d3c0 tx=0x7fdd6c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:26.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.073+0000 7fdd80c00640 1 -- 172.21.15.59:0/1071523943 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c0b5070 con 0x7fdd840d0e40 2024-05-30T16:51:26.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.073+0000 7fdd80c00640 1 -- 172.21.15.59:0/1071523943 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd6c0b0a50 con 0x7fdd840d0e40 2024-05-30T16:51:26.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.073+0000 7fdd8b000640 1 -- 172.21.15.59:0/1071523943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd840b50a0 con 0x7fdd840d0e40 2024-05-30T16:51:26.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.073+0000 7fdd80c00640 1 -- 172.21.15.59:0/1071523943 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c0b0e20 con 0x7fdd840d0e40 2024-05-30T16:51:26.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.073+0000 7fdd8b000640 1 -- 172.21.15.59:0/1071523943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd840b5660 con 0x7fdd840d0e40 2024-05-30T16:51:26.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.073+0000 7fdd8b000640 1 -- 172.21.15.59:0/1071523943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd840b5b50 con 0x7fdd840d0e40 2024-05-30T16:51:26.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.073+0000 7fdd80c00640 1 -- 172.21.15.59:0/1071523943 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7fdd6c0c2060 con 0x7fdd840d0e40 2024-05-30T16:51:26.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.073+0000 7fdd80c00640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdd60068560 0x7fdd6006aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:26.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.073+0000 7fdd80c00640 1 -- 172.21.15.59:0/1071523943 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdd6c123e40 con 0x7fdd840d0e40 2024-05-30T16:51:26.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.073+0000 7fdd83e00640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdd60068560 0x7fdd6006aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:26.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.077+0000 7fdd83e00640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdd60068560 0x7fdd6006aa20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdd74007a60 tx=0x7fdd74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:26.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.081+0000 7fdd80c00640 1 -- 172.21.15.59:0/1071523943 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdd6c018870 con 0x7fdd840d0e40 2024-05-30T16:51:26.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.305+0000 7fdd8b000640 1 -- 172.21.15.59:0/1071523943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fdd84068a90 con 0x7fdd840d0e40 2024-05-30T16:51:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.305+0000 7fdd80c00640 1 -- 172.21.15.59:0/1071523943 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2122 (secure 0 0 0) 0x7fdd6c0f3b20 con 0x7fdd840d0e40 2024-05-30T16:51:26.307 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:26.307 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:51:26.307 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:51:26.307 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:51:26.307 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:51:26.308 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 166, 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 34, 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:51:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:51:26.310 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 3074, 2024-05-30T16:51:26.311 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 12760384534, 2024-05-30T16:51:26.311 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 25783578624, 2024-05-30T16:51:26.311 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 747310534656, 2024-05-30T16:51:26.311 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:51:26.311 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 170522980, 2024-05-30T16:51:26.311 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 168443201, 2024-05-30T16:51:26.311 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 41, 2024-05-30T16:51:26.311 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 45 2024-05-30T16:51:26.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:26.311 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:51:26.311 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T16:51:26.311 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2, 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 2, 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 4803 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:51:26.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 6, 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:50:55.098975+0000", 2024-05-30T16:51:26.313 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:26.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:26.314 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:51:26.314 INFO:teuthology.orchestra.run.smithi059.stdout: "fde5f67a-5844-48ae-9ab8-e075610119d8": { 2024-05-30T16:51:26.314 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 26.0 seconds before exiting (8s)\n [============================] ", 2024-05-30T16:51:26.314 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:51:26.314 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:51:26.314 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:26.314 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:26.314 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:51:26.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.309+0000 7fdd8b000640 1 -- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdd60068560 msgr2=0x7fdd6006aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:26.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.309+0000 7fdd8b000640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdd60068560 0x7fdd6006aa20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdd74007a60 tx=0x7fdd74008040 comp rx=0 tx=0).stop 2024-05-30T16:51:26.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.309+0000 7fdd8b000640 1 -- 172.21.15.59:0/1071523943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd840d0e40 msgr2=0x7fdd840af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:26.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.309+0000 7fdd8b000640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd840d0e40 0x7fdd840af4e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c01d3c0 tx=0x7fdd6c01bab0 comp rx=0 tx=0).stop 2024-05-30T16:51:26.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.309+0000 7fdd8b000640 1 -- 172.21.15.59:0/1071523943 shutdown_connections 2024-05-30T16:51:26.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.309+0000 7fdd8b000640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdd60068560 0x7fdd6006aa20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:26.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.309+0000 7fdd8b000640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd84163230 0x7fdd840cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:26.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.309+0000 7fdd8b000640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd840d0e40 0x7fdd840af4e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:26.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.309+0000 7fdd8b000640 1 --2- 172.21.15.59:0/1071523943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd840b36d0 0x7fdd840c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:26.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.309+0000 7fdd8b000640 1 -- 172.21.15.59:0/1071523943 >> 172.21.15.59:0/1071523943 conn(0x7fdd8409aa40 msgr2=0x7fdd840b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:26.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.309+0000 7fdd8b000640 1 -- 172.21.15.59:0/1071523943 shutdown_connections 2024-05-30T16:51:26.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:26.309+0000 7fdd8b000640 1 -- 172.21.15.59:0/1071523943 wait complete. 2024-05-30T16:51:31.329 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:51:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd9400640 1 Processor -- start 2024-05-30T16:51:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd9400640 1 -- start start 2024-05-30T16:51:31.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddd409aa40 0x7fddd409ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:31.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd9400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd41600a0 con 0x7fddd415fcc0 2024-05-30T16:51:31.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd9400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd409ba80 con 0x7fddd40b3770 2024-05-30T16:51:31.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd9400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fddd40b4b80 con 0x7fddd409aa40 2024-05-30T16:51:31.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fddd415fcc0 0x7fddd40d0c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39442/0 (socket says 172.21.15.59:39442) 2024-05-30T16:51:31.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd3e00640 1 -- 172.21.15.59:0/1386998680 learned_addr learned my addr 172.21.15.59:0/1386998680 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:31.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd8a00640 1 --2- 172.21.15.59:0/1386998680 >> v2:172.21.15.59:3300/0 conn(0x7fddd409aa40 0x7fddd409ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:31.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd3400640 1 -- 172.21.15.59:0/1386998680 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716259951 0 0) 0x7fddd41600a0 con 0x7fddd415fcc0 2024-05-30T16:51:31.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd3400640 1 -- 172.21.15.59:0/1386998680 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddb8003530 con 0x7fddd415fcc0 2024-05-30T16:51:31.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd8a00640 1 -- 172.21.15.59:0/1386998680 >> v1:172.21.15.107:6789/0 conn(0x7fddd40b3770 legacy=0x7fddd40b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:31.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd8a00640 1 -- 172.21.15.59:0/1386998680 >> v1:172.21.15.59:6789/0 conn(0x7fddd415fcc0 legacy=0x7fddd40d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:31.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.481+0000 7fddd8a00640 1 -- 172.21.15.59:0/1386998680 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd409b710 con 0x7fddd409aa40 2024-05-30T16:51:31.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.485+0000 7fddd8a00640 1 --2- 172.21.15.59:0/1386998680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd409aa40 0x7fddd409ae90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009d90 tx=0x7fddcc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219f35ad307db0cb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:31.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.485+0000 7fddd3400640 1 -- 172.21.15.59:0/1386998680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0b2070 con 0x7fddd409aa40 2024-05-30T16:51:31.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.485+0000 7fddd3400640 1 -- 172.21.15.59:0/1386998680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddcc0a5830 con 0x7fddd409aa40 2024-05-30T16:51:31.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.485+0000 7fddd3400640 1 -- 172.21.15.59:0/1386998680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0a5c00 con 0x7fddd409aa40 2024-05-30T16:51:31.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.485+0000 7fddd9400640 1 -- 172.21.15.59:0/1386998680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd409aa40 msgr2=0x7fddd409ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:31.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.485+0000 7fddd9400640 1 --2- 172.21.15.59:0/1386998680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd409aa40 0x7fddd409ae90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009d90 tx=0x7fddcc01c970 comp rx=0 tx=0).stop 2024-05-30T16:51:31.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.485+0000 7fddd9400640 1 -- 172.21.15.59:0/1386998680 shutdown_connections 2024-05-30T16:51:31.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.485+0000 7fddd9400640 1 --2- 172.21.15.59:0/1386998680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd409aa40 0x7fddd409ae90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:31.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.485+0000 7fddd9400640 1 -- 172.21.15.59:0/1386998680 >> 172.21.15.59:0/1386998680 conn(0x7fddd40b3ec0 msgr2=0x7fddd40b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:31.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.485+0000 7fddd9400640 1 -- 172.21.15.59:0/1386998680 shutdown_connections 2024-05-30T16:51:31.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.485+0000 7fddd9400640 1 -- 172.21.15.59:0/1386998680 wait complete. 2024-05-30T16:51:31.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd9400640 1 Processor -- start 2024-05-30T16:51:31.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd9400640 1 -- start start 2024-05-30T16:51:31.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd9400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddd409aa40 0x7fddd40ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:31.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd9400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddd40b3770 0x7fddd4153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:31.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd415fcc0 0x7fddd4157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd9400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fddd40cdaa0 con 0x7fddd415fcc0 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd9400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fddd40cd920 con 0x7fddd40b3770 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd9400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fddd416a340 con 0x7fddd409aa40 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd8a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd415fcc0 0x7fddd4157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd8a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd415fcc0 0x7fddd4157ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42448/0 (socket says 172.21.15.59:42448) 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd8a00640 1 -- 172.21.15.59:0/1995941248 learned_addr learned my addr 172.21.15.59:0/1995941248 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd3e00640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddd409aa40 0x7fddd40ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddcb400640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddd40b3770 0x7fddd4153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd8a00640 1 -- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddd409aa40 msgr2=0x7fddd40ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd8a00640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddd409aa40 0x7fddd40ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd8a00640 1 -- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddd40b3770 msgr2=0x7fddd4153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd8a00640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddd40b3770 0x7fddd4153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:31.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd8a00640 1 -- 172.21.15.59:0/1995941248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd4153960 con 0x7fddd415fcc0 2024-05-30T16:51:31.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd8a00640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd415fcc0 0x7fddd4157ae0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fddcc01a5a0 tx=0x7fddcc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:31.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd0c00640 1 -- 172.21.15.59:0/1995941248 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0b2050 con 0x7fddd415fcc0 2024-05-30T16:51:31.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd0c00640 1 -- 172.21.15.59:0/1995941248 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddcc0be070 con 0x7fddd415fcc0 2024-05-30T16:51:31.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd0c00640 1 -- 172.21.15.59:0/1995941248 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc009450 con 0x7fddd415fcc0 2024-05-30T16:51:31.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd9400640 1 -- 172.21.15.59:0/1995941248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd40af200 con 0x7fddd415fcc0 2024-05-30T16:51:31.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.489+0000 7fddd9400640 1 -- 172.21.15.59:0/1995941248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd40af7c0 con 0x7fddd415fcc0 2024-05-30T16:51:31.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.493+0000 7fddd9400640 1 -- 172.21.15.59:0/1995941248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd4068a90 con 0x7fddd415fcc0 2024-05-30T16:51:31.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.493+0000 7fddd0c00640 1 -- 172.21.15.59:0/1995941248 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7fddcc0adc20 con 0x7fddd415fcc0 2024-05-30T16:51:31.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.493+0000 7fddd0c00640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddb0068560 0x7fddb006aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:31.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.493+0000 7fddd0c00640 1 -- 172.21.15.59:0/1995941248 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fddcc121900 con 0x7fddd415fcc0 2024-05-30T16:51:31.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.493+0000 7fddd3e00640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddb0068560 0x7fddb006aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:31.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.493+0000 7fddd3e00640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddb0068560 0x7fddb006aa20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fddc40011f0 tx=0x7fddc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:31.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.497+0000 7fddd0c00640 1 -- 172.21.15.59:0/1995941248 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fddcc0c7020 con 0x7fddd415fcc0 2024-05-30T16:51:31.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 -- 172.21.15.59:0/1995941248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fddd406fe70 con 0x7fddd415fcc0 2024-05-30T16:51:31.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd0c00640 1 -- 172.21.15.59:0/1995941248 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2123 (secure 0 0 0) 0x7fddcc121020 con 0x7fddd415fcc0 2024-05-30T16:51:31.723 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:31.723 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:51:31.723 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:51:31.723 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:51:31.723 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:51:31.723 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:51:31.723 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:51:31.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:31.723 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:51:31.723 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:51:31.723 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 171, 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:51:31.724 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 34, 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:51:31.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 3071, 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 12760403442, 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 25783599104, 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 747310514176, 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 170523436, 2024-05-30T16:51:31.726 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 168439815, 2024-05-30T16:51:31.727 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 41, 2024-05-30T16:51:31.727 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 46 2024-05-30T16:51:31.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:31.727 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:51:31.727 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T16:51:31.727 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2, 2024-05-30T16:51:31.727 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:51:31.727 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:51:31.727 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:51:31.727 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:51:31.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:31.727 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 2, 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 4803 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:51:31.728 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 6, 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:50:55.098975+0000", 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: "fde5f67a-5844-48ae-9ab8-e075610119d8": { 2024-05-30T16:51:31.729 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 22.0 seconds before exiting (12s)\n [============================] ", 2024-05-30T16:51:31.730 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:51:31.730 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:51:31.730 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:31.730 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:31.730 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:51:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 -- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddb0068560 msgr2=0x7fddb006aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddb0068560 0x7fddb006aa20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fddc40011f0 tx=0x7fddc4009040 comp rx=0 tx=0).stop 2024-05-30T16:51:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 -- 172.21.15.59:0/1995941248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd415fcc0 msgr2=0x7fddd4157ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd415fcc0 0x7fddd4157ae0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fddcc01a5a0 tx=0x7fddcc019710 comp rx=0 tx=0).stop 2024-05-30T16:51:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 -- 172.21.15.59:0/1995941248 shutdown_connections 2024-05-30T16:51:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddb0068560 0x7fddb006aa20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd415fcc0 0x7fddd4157ae0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddd40b3770 0x7fddd4153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:31.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 --2- 172.21.15.59:0/1995941248 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddd409aa40 0x7fddd40ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:31.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 -- 172.21.15.59:0/1995941248 >> 172.21.15.59:0/1995941248 conn(0x7fddd40b3ec0 msgr2=0x7fddd406e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:31.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 -- 172.21.15.59:0/1995941248 shutdown_connections 2024-05-30T16:51:31.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:31.721+0000 7fddd9400640 1 -- 172.21.15.59:0/1995941248 wait complete. 2024-05-30T16:51:33.699 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:51:33.703 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:51:36.746 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:51:36.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad53200640 1 Processor -- start 2024-05-30T16:51:36.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad53200640 1 -- start start 2024-05-30T16:51:36.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad53200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad4c0b37a0 0x7fad4c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:36.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad53200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad4c0cdb60 0x7fad4c0cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:36.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad53200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad4c0d0260 con 0x7fad4c09aa40 2024-05-30T16:51:36.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad53200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fad4c0d0010 con 0x7fad4c0b37a0 2024-05-30T16:51:36.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad53200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fad4c0d0540 con 0x7fad4c0cdb60 2024-05-30T16:51:36.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad4be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad4c0b37a0 0x7fad4c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:36.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad4be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad4c0b37a0 0x7fad4c0d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42756/0 (socket says 172.21.15.59:42756) 2024-05-30T16:51:36.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad4be00640 1 -- 172.21.15.59:0/3939813019 learned_addr learned my addr 172.21.15.59:0/3939813019 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:36.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad43400640 1 --2- 172.21.15.59:0/3939813019 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad4c0cdb60 0x7fad4c0cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:36.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad4be00640 1 -- 172.21.15.59:0/3939813019 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad4c0cdb60 msgr2=0x7fad4c0cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:36.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad4be00640 1 --2- 172.21.15.59:0/3939813019 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad4c0cdb60 0x7fad4c0cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:36.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad4be00640 1 -- 172.21.15.59:0/3939813019 >> v1:172.21.15.107:6789/0 conn(0x7fad4c09aa40 legacy=0x7fad4c0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:36.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.897+0000 7fad4be00640 1 -- 172.21.15.59:0/3939813019 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4c0d0820 con 0x7fad4c0b37a0 2024-05-30T16:51:36.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.901+0000 7fad4be00640 1 --2- 172.21.15.59:0/3939813019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c0b37a0 0x7fad4c0d1020 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009ea0 tx=0x7fad3c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39238b113470e578 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:36.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.901+0000 7fad4b400640 1 -- 172.21.15.59:0/3939813019 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0a56c0 con 0x7fad4c0b37a0 2024-05-30T16:51:36.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.901+0000 7fad4b400640 1 -- 172.21.15.59:0/3939813019 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad3c0a5860 con 0x7fad4c0b37a0 2024-05-30T16:51:36.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.901+0000 7fad4b400640 1 -- 172.21.15.59:0/3939813019 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0a5c30 con 0x7fad4c0b37a0 2024-05-30T16:51:36.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.901+0000 7fad53200640 1 -- 172.21.15.59:0/3939813019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c0b37a0 msgr2=0x7fad4c0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:36.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.901+0000 7fad53200640 1 --2- 172.21.15.59:0/3939813019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c0b37a0 0x7fad4c0d1020 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009ea0 tx=0x7fad3c01c9e0 comp rx=0 tx=0).stop 2024-05-30T16:51:36.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.901+0000 7fad53200640 1 -- 172.21.15.59:0/3939813019 shutdown_connections 2024-05-30T16:51:36.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.901+0000 7fad53200640 1 --2- 172.21.15.59:0/3939813019 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad4c0cdb60 0x7fad4c0cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:36.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.901+0000 7fad53200640 1 --2- 172.21.15.59:0/3939813019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c0b37a0 0x7fad4c0d1020 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:36.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.901+0000 7fad53200640 1 -- 172.21.15.59:0/3939813019 >> 172.21.15.59:0/3939813019 conn(0x7fad4c0b3f30 msgr2=0x7fad4c0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:36.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.901+0000 7fad53200640 1 -- 172.21.15.59:0/3939813019 shutdown_connections 2024-05-30T16:51:36.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.901+0000 7fad53200640 1 -- 172.21.15.59:0/3939813019 wait complete. 2024-05-30T16:51:36.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad53200640 1 Processor -- start 2024-05-30T16:51:36.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad53200640 1 -- start start 2024-05-30T16:51:36.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad53200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad4c09aa40 0x7fad4c157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:36.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad53200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad4c0b37a0 0x7fad4c0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:36.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad53200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c0cdb60 0x7fad4c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:36.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad53200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c169810 con 0x7fad4c0cdb60 2024-05-30T16:51:36.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad53200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c169690 con 0x7fad4c0b37a0 2024-05-30T16:51:36.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad53200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fad4c169990 con 0x7fad4c09aa40 2024-05-30T16:51:36.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad51200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c0cdb60 0x7fad4c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:36.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad51200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c0cdb60 0x7fad4c0c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42768/0 (socket says 172.21.15.59:42768) 2024-05-30T16:51:36.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad51200640 1 -- 172.21.15.59:0/639999570 learned_addr learned my addr 172.21.15.59:0/639999570 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:36.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad4be00640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad4c09aa40 0x7fad4c157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:36.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad43400640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad4c0b37a0 0x7fad4c0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:36.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad51200640 1 -- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad4c09aa40 msgr2=0x7fad4c157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:36.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad51200640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad4c09aa40 0x7fad4c157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:36.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad51200640 1 -- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad4c0b37a0 msgr2=0x7fad4c0b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:36.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad51200640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad4c0b37a0 0x7fad4c0b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:36.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad51200640 1 -- 172.21.15.59:0/639999570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4c1579b0 con 0x7fad4c0cdb60 2024-05-30T16:51:36.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad51200640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c0cdb60 0x7fad4c0c52a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fad4400c370 tx=0x7fad4400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:36.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad48c00640 1 -- 172.21.15.59:0/639999570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44005220 con 0x7fad4c0cdb60 2024-05-30T16:51:36.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad48c00640 1 -- 172.21.15.59:0/639999570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad440053c0 con 0x7fad4c0cdb60 2024-05-30T16:51:36.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad48c00640 1 -- 172.21.15.59:0/639999570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44007270 con 0x7fad4c0cdb60 2024-05-30T16:51:36.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad53200640 1 -- 172.21.15.59:0/639999570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4c0b56f0 con 0x7fad4c0cdb60 2024-05-30T16:51:36.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad53200640 1 -- 172.21.15.59:0/639999570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4c0b5cb0 con 0x7fad4c0cdb60 2024-05-30T16:51:36.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.905+0000 7fad53200640 1 -- 172.21.15.59:0/639999570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad4c068a90 con 0x7fad4c0cdb60 2024-05-30T16:51:36.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.909+0000 7fad48c00640 1 -- 172.21.15.59:0/639999570 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7fad44019020 con 0x7fad4c0cdb60 2024-05-30T16:51:36.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.909+0000 7fad48c00640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fad28068530 0x7fad2806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:36.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.909+0000 7fad48c00640 1 -- 172.21.15.59:0/639999570 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fad44085ed0 con 0x7fad4c0cdb60 2024-05-30T16:51:36.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.909+0000 7fad4be00640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fad28068530 0x7fad2806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:36.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.909+0000 7fad4be00640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fad28068530 0x7fad2806a9f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0ae000 tx=0x7fad3c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:36.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:36.913+0000 7fad48c00640 1 -- 172.21.15.59:0/639999570 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad4c1579b0 con 0x7fad4c0cdb60 2024-05-30T16:51:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.137+0000 7fad53200640 1 -- 172.21.15.59:0/639999570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fad4c0ce950 con 0x7fad4c0cdb60 2024-05-30T16:51:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.137+0000 7fad48c00640 1 -- 172.21.15.59:0/639999570 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2110 (secure 0 0 0) 0x7fad44055b20 con 0x7fad4c0cdb60 2024-05-30T16:51:37.179 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:37.179 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:51:37.179 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:51:37.179 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:51:37.179 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:51:37.179 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:51:37.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:51:37.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:37.179 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:51:37.179 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 177, 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:51:37.180 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 34, 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:51:37.181 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 3071, 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 12760430735, 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 25783631872, 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 747310481408, 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 255, 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 4692, 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 1 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:51:37.182 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2, 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 2, 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 4803 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 6, 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:50:55.098975+0000", 2024-05-30T16:51:37.184 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:37.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:37.185 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:51:37.185 INFO:teuthology.orchestra.run.smithi059.stdout: "fde5f67a-5844-48ae-9ab8-e075610119d8": { 2024-05-30T16:51:37.185 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 16.0 seconds before exiting (18s)\n [============================] ", 2024-05-30T16:51:37.185 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:51:37.185 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:51:37.185 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:37.185 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:37.185 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:51:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.141+0000 7fad53200640 1 -- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fad28068530 msgr2=0x7fad2806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.141+0000 7fad53200640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fad28068530 0x7fad2806a9f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0ae000 tx=0x7fad3c0a7070 comp rx=0 tx=0).stop 2024-05-30T16:51:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.141+0000 7fad53200640 1 -- 172.21.15.59:0/639999570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c0cdb60 msgr2=0x7fad4c0c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.141+0000 7fad53200640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c0cdb60 0x7fad4c0c52a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fad4400c370 tx=0x7fad4400c830 comp rx=0 tx=0).stop 2024-05-30T16:51:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.141+0000 7fad53200640 1 -- 172.21.15.59:0/639999570 shutdown_connections 2024-05-30T16:51:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.141+0000 7fad53200640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fad28068530 0x7fad2806a9f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.141+0000 7fad53200640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c0cdb60 0x7fad4c0c52a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.141+0000 7fad53200640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad4c0b37a0 0x7fad4c0b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.141+0000 7fad53200640 1 --2- 172.21.15.59:0/639999570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad4c09aa40 0x7fad4c157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.141+0000 7fad53200640 1 -- 172.21.15.59:0/639999570 >> 172.21.15.59:0/639999570 conn(0x7fad4c0b3f30 msgr2=0x7fad4c070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.141+0000 7fad53200640 1 -- 172.21.15.59:0/639999570 shutdown_connections 2024-05-30T16:51:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:37.141+0000 7fad53200640 1 -- 172.21.15.59:0/639999570 wait complete. 2024-05-30T16:51:42.189 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:51:42.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.333+0000 7f146fe00640 1 Processor -- start 2024-05-30T16:51:42.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.333+0000 7f146fe00640 1 -- start start 2024-05-30T16:51:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f147015e890 0x7f14700b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f147015ec70 0x7f147009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146fe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f147006ddd0 con 0x7f14700b3590 2024-05-30T16:51:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146fe00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f14700b3300 con 0x7f147015e890 2024-05-30T16:51:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146fe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f14700d0560 con 0x7f147015ec70 2024-05-30T16:51:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14700b3590 0x7f14700b1d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36286/0 (socket says 172.21.15.59:36286) 2024-05-30T16:51:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146f400640 1 -- 172.21.15.59:0/258880559 learned_addr learned my addr 172.21.15.59:0/258880559 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146ea00640 1 --2- 172.21.15.59:0/258880559 >> v2:172.21.15.59:3300/0 conn(0x7f147015e890 0x7f14700b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f1467e00640 1 --2- 172.21.15.59:0/258880559 >> v2:172.21.15.107:3300/0 conn(0x7f147015ec70 0x7f147009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146e000640 1 -- 172.21.15.59:0/258880559 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4254106583 0 0) 0x7f147006ddd0 con 0x7f14700b3590 2024-05-30T16:51:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146ea00640 1 -- 172.21.15.59:0/258880559 >> v2:172.21.15.107:3300/0 conn(0x7f147015ec70 msgr2=0x7f147009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146ea00640 1 --2- 172.21.15.59:0/258880559 >> v2:172.21.15.107:3300/0 conn(0x7f147015ec70 0x7f147009aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146ea00640 1 -- 172.21.15.59:0/258880559 >> v1:172.21.15.59:6789/0 conn(0x7f14700b3590 legacy=0x7f14700b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.337+0000 7f146ea00640 1 -- 172.21.15.59:0/258880559 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14700b3020 con 0x7f147015e890 2024-05-30T16:51:42.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146ea00640 1 --2- 172.21.15.59:0/258880559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f147015e890 0x7f14700b49e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1470074200 tx=0x7f146001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21e585da4038d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:42.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146e000640 1 -- 172.21.15.59:0/258880559 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14600b1070 con 0x7f147015e890 2024-05-30T16:51:42.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146e000640 1 -- 172.21.15.59:0/258880559 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14600ac620 con 0x7f147015e890 2024-05-30T16:51:42.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146e000640 1 -- 172.21.15.59:0/258880559 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14600ac9f0 con 0x7f147015e890 2024-05-30T16:51:42.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 -- 172.21.15.59:0/258880559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f147015e890 msgr2=0x7f14700b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:42.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 --2- 172.21.15.59:0/258880559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f147015e890 0x7f14700b49e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1470074200 tx=0x7f146001c3c0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 -- 172.21.15.59:0/258880559 shutdown_connections 2024-05-30T16:51:42.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 --2- 172.21.15.59:0/258880559 >> v2:172.21.15.107:3300/0 conn(0x7f147015ec70 0x7f147009aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 --2- 172.21.15.59:0/258880559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f147015e890 0x7f14700b49e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 -- 172.21.15.59:0/258880559 >> 172.21.15.59:0/258880559 conn(0x7f14700b3ec0 msgr2=0x7f14700b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:42.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 -- 172.21.15.59:0/258880559 shutdown_connections 2024-05-30T16:51:42.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 -- 172.21.15.59:0/258880559 wait complete. 2024-05-30T16:51:42.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 Processor -- start 2024-05-30T16:51:42.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 -- start start 2024-05-30T16:51:42.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700b3590 0x7f14701564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f147015e890 0x7f14700b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f147015ec70 0x7f14700b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f147016b610 con 0x7f14700b3590 2024-05-30T16:51:42.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f147009b390 con 0x7f147015e890 2024-05-30T16:51:42.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f147016b790 con 0x7f147015ec70 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.341+0000 7f146ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700b3590 0x7f14701564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f146ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700b3590 0x7f14701564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56836/0 (socket says 172.21.15.59:56836) 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f146ea00640 1 -- 172.21.15.59:0/3087265424 learned_addr learned my addr 172.21.15.59:0/3087265424 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f146f400640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f147015ec70 0x7f14700b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f1467e00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f147015e890 0x7f14700b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f146ea00640 1 -- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f147015ec70 msgr2=0x7f14700b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f146ea00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f147015ec70 0x7f14700b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f146ea00640 1 -- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f147015e890 msgr2=0x7f14700b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f146ea00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f147015e890 0x7f14700b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f146ea00640 1 -- 172.21.15.59:0/3087265424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14700cfe40 con 0x7f14700b3590 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f146ea00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700b3590 0x7f14701564d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f14600af040 tx=0x7f1460019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f1466a00640 1 -- 172.21.15.59:0/3087265424 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14600b9070 con 0x7f14700b3590 2024-05-30T16:51:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f1466a00640 1 -- 172.21.15.59:0/3087265424 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14600b5410 con 0x7f14700b3590 2024-05-30T16:51:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f1466a00640 1 -- 172.21.15.59:0/3087265424 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14600b1040 con 0x7f14700b3590 2024-05-30T16:51:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f146fe00640 1 -- 172.21.15.59:0/3087265424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147015d580 con 0x7f14700b3590 2024-05-30T16:51:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f146fe00640 1 -- 172.21.15.59:0/3087265424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14700b59c0 con 0x7f14700b3590 2024-05-30T16:51:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f146fe00640 1 -- 172.21.15.59:0/3087265424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14700cf980 con 0x7f14700b3590 2024-05-30T16:51:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f1466a00640 1 -- 172.21.15.59:0/3087265424 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f14600bc070 con 0x7f14700b3590 2024-05-30T16:51:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f1466a00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f144c068530 0x7f144c06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.345+0000 7f1466a00640 1 -- 172.21.15.59:0/3087265424 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1460120cf0 con 0x7f14700b3590 2024-05-30T16:51:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.349+0000 7f1467e00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f144c068530 0x7f144c06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.349+0000 7f1467e00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f144c068530 0x7f144c06a9f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f14701694f0 tx=0x7f1458008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:42.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.353+0000 7f1466a00640 1 -- 172.21.15.59:0/3087265424 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f14700cf980 con 0x7f14700b3590 2024-05-30T16:51:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.573+0000 7f146fe00640 1 -- 172.21.15.59:0/3087265424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1470068a90 con 0x7f14700b3590 2024-05-30T16:51:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.573+0000 7f1466a00640 1 -- 172.21.15.59:0/3087265424 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2079 (secure 0 0 0) 0x7f1460016070 con 0x7f14700b3590 2024-05-30T16:51:42.575 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:51:42.576 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 182, 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:51:42.577 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 34, 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:42.578 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 3071, 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 12760438164, 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 25783640064, 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 747310473216, 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 3241, 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2, 2024-05-30T16:51:42.579 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 2, 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 4803 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:42.580 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 6, 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:50:55.098975+0000", 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:42.581 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:51:42.582 INFO:teuthology.orchestra.run.smithi059.stdout: "fde5f67a-5844-48ae-9ab8-e075610119d8": { 2024-05-30T16:51:42.582 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 10.0 seconds before exiting (24s)\n [============================] ", 2024-05-30T16:51:42.582 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:51:42.582 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:51:42.582 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:42.582 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:42.582 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:51:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.577+0000 7f146fe00640 1 -- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f144c068530 msgr2=0x7f144c06a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.577+0000 7f146fe00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f144c068530 0x7f144c06a9f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f14701694f0 tx=0x7f1458008040 comp rx=0 tx=0).stop 2024-05-30T16:51:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.577+0000 7f146fe00640 1 -- 172.21.15.59:0/3087265424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700b3590 msgr2=0x7f14701564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.577+0000 7f146fe00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700b3590 0x7f14701564d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f14600af040 tx=0x7f1460019160 comp rx=0 tx=0).stop 2024-05-30T16:51:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.577+0000 7f146fe00640 1 -- 172.21.15.59:0/3087265424 shutdown_connections 2024-05-30T16:51:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.577+0000 7f146fe00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f144c068530 0x7f144c06a9f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.577+0000 7f146fe00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f147015ec70 0x7f14700b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.577+0000 7f146fe00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f147015e890 0x7f14700b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.577+0000 7f146fe00640 1 --2- 172.21.15.59:0/3087265424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14700b3590 0x7f14701564d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.577+0000 7f146fe00640 1 -- 172.21.15.59:0/3087265424 >> 172.21.15.59:0/3087265424 conn(0x7f14700b3ec0 msgr2=0x7f14700b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.577+0000 7f146fe00640 1 -- 172.21.15.59:0/3087265424 shutdown_connections 2024-05-30T16:51:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:42.577+0000 7f146fe00640 1 -- 172.21.15.59:0/3087265424 wait complete. 2024-05-30T16:51:47.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:51:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa154600640 1 Processor -- start 2024-05-30T16:51:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa154600640 1 -- start start 2024-05-30T16:51:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa154600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa14c0b37a0 0x7fa14c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa154600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa14c0cdb60 0x7fa14c0cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa154600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa14c0d0260 con 0x7fa14c09aa40 2024-05-30T16:51:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa154600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa14c0d0010 con 0x7fa14c0b37a0 2024-05-30T16:51:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa154600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c0d0540 con 0x7fa14c0cdb60 2024-05-30T16:51:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa151c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa14c0b37a0 0x7fa14c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa151c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa14c0b37a0 0x7fa14c0d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56844/0 (socket says 172.21.15.59:56844) 2024-05-30T16:51:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa151c00640 1 -- 172.21.15.59:0/4205786975 learned_addr learned my addr 172.21.15.59:0/4205786975 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa151200640 1 --2- 172.21.15.59:0/4205786975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa14c0cdb60 0x7fa14c0cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa151c00640 1 -- 172.21.15.59:0/4205786975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa14c0cdb60 msgr2=0x7fa14c0cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa151c00640 1 --2- 172.21.15.59:0/4205786975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa14c0cdb60 0x7fa14c0cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa151c00640 1 -- 172.21.15.59:0/4205786975 >> v1:172.21.15.107:6789/0 conn(0x7fa14c09aa40 legacy=0x7fa14c0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.749+0000 7fa151c00640 1 -- 172.21.15.59:0/4205786975 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c0d0820 con 0x7fa14c0b37a0 2024-05-30T16:51:47.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.753+0000 7fa151c00640 1 --2- 172.21.15.59:0/4205786975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c0b37a0 0x7fa14c0d1020 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa140006fd0 tx=0x7fa14001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec8e7f474c6f478 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.753+0000 7fa14be00640 1 -- 172.21.15.59:0/4205786975 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1400b0070 con 0x7fa14c0b37a0 2024-05-30T16:51:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.753+0000 7fa14be00640 1 -- 172.21.15.59:0/4205786975 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1400ab600 con 0x7fa14c0b37a0 2024-05-30T16:51:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.753+0000 7fa14be00640 1 -- 172.21.15.59:0/4205786975 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1400ab9d0 con 0x7fa14c0b37a0 2024-05-30T16:51:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.753+0000 7fa154600640 1 -- 172.21.15.59:0/4205786975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c0b37a0 msgr2=0x7fa14c0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.753+0000 7fa154600640 1 --2- 172.21.15.59:0/4205786975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c0b37a0 0x7fa14c0d1020 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa140006fd0 tx=0x7fa14001c4b0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.753+0000 7fa154600640 1 -- 172.21.15.59:0/4205786975 shutdown_connections 2024-05-30T16:51:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.753+0000 7fa154600640 1 --2- 172.21.15.59:0/4205786975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa14c0cdb60 0x7fa14c0cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.753+0000 7fa154600640 1 --2- 172.21.15.59:0/4205786975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c0b37a0 0x7fa14c0d1020 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.753+0000 7fa154600640 1 -- 172.21.15.59:0/4205786975 >> 172.21.15.59:0/4205786975 conn(0x7fa14c0b3f30 msgr2=0x7fa14c0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.753+0000 7fa154600640 1 -- 172.21.15.59:0/4205786975 shutdown_connections 2024-05-30T16:51:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.753+0000 7fa154600640 1 -- 172.21.15.59:0/4205786975 wait complete. 2024-05-30T16:51:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa154600640 1 Processor -- start 2024-05-30T16:51:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa154600640 1 -- start start 2024-05-30T16:51:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa154600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c09aa40 0x7fa14c158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa154600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa14c0b37a0 0x7fa14c070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa154600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa14c0cdb60 0x7fa14c0713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa154600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c169810 con 0x7fa14c09aa40 2024-05-30T16:51:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa154600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c169690 con 0x7fa14c0cdb60 2024-05-30T16:51:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa154600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c169990 con 0x7fa14c0b37a0 2024-05-30T16:51:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa151c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c09aa40 0x7fa14c158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa151c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c09aa40 0x7fa14c158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56858/0 (socket says 172.21.15.59:56858) 2024-05-30T16:51:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa151c00640 1 -- 172.21.15.59:0/4197030035 learned_addr learned my addr 172.21.15.59:0/4197030035 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa151200640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa14c0b37a0 0x7fa14c070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa152600640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa14c0cdb60 0x7fa14c0713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa151c00640 1 -- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa14c0b37a0 msgr2=0x7fa14c070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa151c00640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa14c0b37a0 0x7fa14c070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa151c00640 1 -- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa14c0cdb60 msgr2=0x7fa14c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa151c00640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa14c0cdb60 0x7fa14c0713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa151c00640 1 -- 172.21.15.59:0/4197030035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c15f230 con 0x7fa14c09aa40 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa151200640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa14c0b37a0 0x7fa14c070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa152600640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa14c0cdb60 0x7fa14c0713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa151c00640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c09aa40 0x7fa14c158930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa14001c990 tx=0x7fa140019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa149600640 1 -- 172.21.15.59:0/4197030035 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1400b0040 con 0x7fa14c09aa40 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa149600640 1 -- 172.21.15.59:0/4197030035 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa140005ba0 con 0x7fa14c09aa40 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa149600640 1 -- 172.21.15.59:0/4197030035 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1400ab7b0 con 0x7fa14c09aa40 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa154600640 1 -- 172.21.15.59:0/4197030035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14c15f510 con 0x7fa14c09aa40 2024-05-30T16:51:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa154600640 1 -- 172.21.15.59:0/4197030035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa14c15a570 con 0x7fa14c09aa40 2024-05-30T16:51:47.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.757+0000 7fa154600640 1 -- 172.21.15.59:0/4197030035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa14c068a90 con 0x7fa14c09aa40 2024-05-30T16:51:47.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.761+0000 7fa149600640 1 -- 172.21.15.59:0/4197030035 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7fa1400ab950 con 0x7fa14c09aa40 2024-05-30T16:51:47.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.761+0000 7fa149600640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa12c068530 0x7fa12c06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:47.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.761+0000 7fa149600640 1 -- 172.21.15.59:0/4197030035 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa140120740 con 0x7fa14c09aa40 2024-05-30T16:51:47.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.761+0000 7fa151200640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa12c068530 0x7fa12c06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:47.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.761+0000 7fa151200640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa12c068530 0x7fa12c06a9f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa14c15c740 tx=0x7fa138008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:47.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.765+0000 7fa149600640 1 -- 172.21.15.59:0/4197030035 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa140016130 con 0x7fa14c09aa40 2024-05-30T16:51:47.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 -- 172.21.15.59:0/4197030035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa14c0b4ae0 con 0x7fa14c09aa40 2024-05-30T16:51:47.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa149600640 1 -- 172.21.15.59:0/4197030035 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2077 (secure 0 0 0) 0x7fa1400f0a00 con 0x7fa14c09aa40 2024-05-30T16:51:47.994 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:47.994 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:51:47.994 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:51:47.995 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 187, 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 34, 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:47.998 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:51:47.998 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:51:47.998 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 3071, 2024-05-30T16:51:47.998 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 12760438164, 2024-05-30T16:51:47.998 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 25783640064, 2024-05-30T16:51:47.998 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 747310473216, 2024-05-30T16:51:47.998 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:51:47.998 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 767, 2024-05-30T16:51:47.998 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:51:47.998 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T16:51:47.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:47.998 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2, 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 2, 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 4803 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 6, 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:50:55.098975+0000", 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: "fde5f67a-5844-48ae-9ab8-e075610119d8": { 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 6.0 seconds before exiting (28s)\n [============================] ", 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:51:48.002 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:51:48.002 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:48.002 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:48.002 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 -- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa12c068530 msgr2=0x7fa12c06a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa12c068530 0x7fa12c06a9f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa14c15c740 tx=0x7fa138008040 comp rx=0 tx=0).stop 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 -- 172.21.15.59:0/4197030035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c09aa40 msgr2=0x7fa14c158930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c09aa40 0x7fa14c158930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa14001c990 tx=0x7fa140019250 comp rx=0 tx=0).stop 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 -- 172.21.15.59:0/4197030035 shutdown_connections 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa12c068530 0x7fa12c06a9f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa14c0cdb60 0x7fa14c0713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa14c0b37a0 0x7fa14c070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 --2- 172.21.15.59:0/4197030035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c09aa40 0x7fa14c158930 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:48.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 -- 172.21.15.59:0/4197030035 >> 172.21.15.59:0/4197030035 conn(0x7fa14c0b3f30 msgr2=0x7fa14c15d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:48.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 -- 172.21.15.59:0/4197030035 shutdown_connections 2024-05-30T16:51:48.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:47.993+0000 7fa154600640 1 -- 172.21.15.59:0/4197030035 wait complete. 2024-05-30T16:51:53.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:51:53.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae59000640 1 Processor -- start 2024-05-30T16:51:53.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae59000640 1 -- start start 2024-05-30T16:51:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae59000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae540b46e0 0x7fae540b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae59000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fae540cf0d0 0x7fae540cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae59000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae540b3c20 con 0x7fae54146000 2024-05-30T16:51:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae59000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fae540b5060 con 0x7fae540b46e0 2024-05-30T16:51:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae59000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fae5415ce50 con 0x7fae540cf0d0 2024-05-30T16:51:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae51e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fae54146000 0x7fae541600d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36154/0 (socket says 172.21.15.59:36154) 2024-05-30T16:51:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae51400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae540b46e0 0x7fae540b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae51e00640 1 -- 172.21.15.59:0/2409521225 learned_addr learned my addr 172.21.15.59:0/2409521225 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae52800640 1 --2- 172.21.15.59:0/2409521225 >> v2:172.21.15.107:3300/0 conn(0x7fae540cf0d0 0x7fae540cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae51400640 1 -- 172.21.15.59:0/2409521225 >> v2:172.21.15.107:3300/0 conn(0x7fae540cf0d0 msgr2=0x7fae540cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae51400640 1 --2- 172.21.15.59:0/2409521225 >> v2:172.21.15.107:3300/0 conn(0x7fae540cf0d0 0x7fae540cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae51400640 1 -- 172.21.15.59:0/2409521225 >> v1:172.21.15.59:6789/0 conn(0x7fae54146000 legacy=0x7fae541600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.169+0000 7fae51400640 1 -- 172.21.15.59:0/2409521225 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae54160c40 con 0x7fae540b46e0 2024-05-30T16:51:53.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae51400640 1 --2- 172.21.15.59:0/2409521225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae540b46e0 0x7fae540b4b20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fae540731f0 tx=0x7fae4001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e05d5c60a167a75 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:53.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae50a00640 1 -- 172.21.15.59:0/2409521225 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae400b0070 con 0x7fae540b46e0 2024-05-30T16:51:53.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae50a00640 1 -- 172.21.15.59:0/2409521225 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae400ab600 con 0x7fae540b46e0 2024-05-30T16:51:53.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae50a00640 1 -- 172.21.15.59:0/2409521225 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae400ab9d0 con 0x7fae540b46e0 2024-05-30T16:51:53.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae59000640 1 -- 172.21.15.59:0/2409521225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae540b46e0 msgr2=0x7fae540b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae59000640 1 --2- 172.21.15.59:0/2409521225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae540b46e0 0x7fae540b4b20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fae540731f0 tx=0x7fae4001c480 comp rx=0 tx=0).stop 2024-05-30T16:51:53.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae59000640 1 -- 172.21.15.59:0/2409521225 shutdown_connections 2024-05-30T16:51:53.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae59000640 1 --2- 172.21.15.59:0/2409521225 >> v2:172.21.15.107:3300/0 conn(0x7fae540cf0d0 0x7fae540cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae59000640 1 --2- 172.21.15.59:0/2409521225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae540b46e0 0x7fae540b4b20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae59000640 1 -- 172.21.15.59:0/2409521225 >> 172.21.15.59:0/2409521225 conn(0x7fae54067d60 msgr2=0x7fae5406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:53.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae59000640 1 -- 172.21.15.59:0/2409521225 shutdown_connections 2024-05-30T16:51:53.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae59000640 1 -- 172.21.15.59:0/2409521225 wait complete. 2024-05-30T16:51:53.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.173+0000 7fae59000640 1 Processor -- start 2024-05-30T16:51:53.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae59000640 1 -- start start 2024-05-30T16:51:53.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae59000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae540b46e0 0x7fae54141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae59000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae540cf0d0 0x7fae54142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae59000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae54146000 0x7fae5415f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae59000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fae54160960 con 0x7fae540b46e0 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae59000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fae541607e0 con 0x7fae54146000 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae59000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fae54169470 con 0x7fae540cf0d0 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae51e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae540b46e0 0x7fae54141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae51e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae540b46e0 0x7fae54141d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33584/0 (socket says 172.21.15.59:33584) 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae51e00640 1 -- 172.21.15.59:0/714322610 learned_addr learned my addr 172.21.15.59:0/714322610 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae51400640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae540cf0d0 0x7fae54142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae52800640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae54146000 0x7fae5415f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae51e00640 1 -- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae540cf0d0 msgr2=0x7fae54142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae51e00640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae540cf0d0 0x7fae54142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae51e00640 1 -- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae54146000 msgr2=0x7fae5415f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae51e00640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae54146000 0x7fae5415f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae51e00640 1 -- 172.21.15.59:0/714322610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5415fe10 con 0x7fae540b46e0 2024-05-30T16:51:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae52800640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae54146000 0x7fae5415f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:51:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae51e00640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae540b46e0 0x7fae54141d90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c420 tx=0x7fae4400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae4a000640 1 -- 172.21.15.59:0/714322610 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae44017070 con 0x7fae540b46e0 2024-05-30T16:51:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae4a000640 1 -- 172.21.15.59:0/714322610 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae44005cf0 con 0x7fae540b46e0 2024-05-30T16:51:53.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae59000640 1 -- 172.21.15.59:0/714322610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae54140fd0 con 0x7fae540b46e0 2024-05-30T16:51:53.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae4a000640 1 -- 172.21.15.59:0/714322610 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae440072f0 con 0x7fae540b46e0 2024-05-30T16:51:53.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae59000640 1 -- 172.21.15.59:0/714322610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae54141590 con 0x7fae540b46e0 2024-05-30T16:51:53.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.177+0000 7fae59000640 1 -- 172.21.15.59:0/714322610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae54068a90 con 0x7fae540b46e0 2024-05-30T16:51:53.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.181+0000 7fae4a000640 1 -- 172.21.15.59:0/714322610 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7fae4401a070 con 0x7fae540b46e0 2024-05-30T16:51:53.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.181+0000 7fae4a000640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fae34068530 0x7fae3406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.181+0000 7fae4a000640 1 -- 172.21.15.59:0/714322610 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fae44086110 con 0x7fae540b46e0 2024-05-30T16:51:53.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.181+0000 7fae51400640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fae34068530 0x7fae3406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.181+0000 7fae51400640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fae34068530 0x7fae3406a9f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fae400ad000 tx=0x7fae400a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:53.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.185+0000 7fae4a000640 1 -- 172.21.15.59:0/714322610 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fae44055cd0 con 0x7fae540b46e0 2024-05-30T16:51:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.413+0000 7fae59000640 1 -- 172.21.15.59:0/714322610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fae540b3490 con 0x7fae540b46e0 2024-05-30T16:51:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.413+0000 7fae4a000640 1 -- 172.21.15.59:0/714322610 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1730 (secure 0 0 0) 0x7fae44059fd0 con 0x7fae540b46e0 2024-05-30T16:51:53.416 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:53.416 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:51:53.416 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:51:53.416 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:51:53.416 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:51:53.416 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:51:53.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:51:53.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:53.416 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:51:53.416 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 193, 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:51:53.417 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 34, 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:51:53.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 3071, 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 12760438164, 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 25783640064, 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 747310473216, 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2, 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 2, 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 4803 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:53.420 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:53.421 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:51:53.422 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 6, 2024-05-30T16:51:53.422 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:50:55.098975+0000", 2024-05-30T16:51:53.422 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:51:53.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:53.422 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": {} 2024-05-30T16:51:53.422 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:51:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.417+0000 7fae59000640 1 -- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fae34068530 msgr2=0x7fae3406a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.417+0000 7fae59000640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fae34068530 0x7fae3406a9f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fae400ad000 tx=0x7fae400a6000 comp rx=0 tx=0).stop 2024-05-30T16:51:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.417+0000 7fae59000640 1 -- 172.21.15.59:0/714322610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae540b46e0 msgr2=0x7fae54141d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.417+0000 7fae59000640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae540b46e0 0x7fae54141d90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c420 tx=0x7fae4400c8e0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.417+0000 7fae59000640 1 -- 172.21.15.59:0/714322610 shutdown_connections 2024-05-30T16:51:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.417+0000 7fae59000640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fae34068530 0x7fae3406a9f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.417+0000 7fae59000640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae54146000 0x7fae5415f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.417+0000 7fae59000640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae540cf0d0 0x7fae54142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.417+0000 7fae59000640 1 --2- 172.21.15.59:0/714322610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae540b46e0 0x7fae54141d90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.417+0000 7fae59000640 1 -- 172.21.15.59:0/714322610 >> 172.21.15.59:0/714322610 conn(0x7fae54067d60 msgr2=0x7fae54074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.417+0000 7fae59000640 1 -- 172.21.15.59:0/714322610 shutdown_connections 2024-05-30T16:51:53.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.417+0000 7fae59000640 1 -- 172.21.15.59:0/714322610 wait complete. 2024-05-30T16:51:53.437 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T16:51:53.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.577+0000 7febd1e00640 1 Processor -- start 2024-05-30T16:51:53.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.577+0000 7febd1e00640 1 -- start start 2024-05-30T16:51:53.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.577+0000 7febd1e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7febcc1569e0 0x7febcc15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.577+0000 7febd1e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febcc0ad2b0 0x7febcc0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.577+0000 7febd1e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7febcc0d0660 0x7febcc0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.577+0000 7febd1e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7febcc0ad770 con 0x7febcc0d0660 2024-05-30T16:51:53.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.577+0000 7febd1e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7febcc15cb40 con 0x7febcc1569e0 2024-05-30T16:51:53.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.577+0000 7febd1e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7febcc15ce20 con 0x7febcc0ad2b0 2024-05-30T16:51:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.577+0000 7febcb400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7febcc0d0660 0x7febcc0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.577+0000 7febcb400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7febcc0d0660 0x7febcc0d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33592/0 (socket says 172.21.15.59:33592) 2024-05-30T16:51:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.577+0000 7febcb400640 1 -- 172.21.15.59:0/4213268639 learned_addr learned my addr 172.21.15.59:0/4213268639 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febc2000640 1 --2- 172.21.15.59:0/4213268639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febcc0ad2b0 0x7febcc0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febcaa00640 1 --2- 172.21.15.59:0/4213268639 >> v2:172.21.15.107:3300/0 conn(0x7febcc1569e0 0x7febcc15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febcb400640 1 -- 172.21.15.59:0/4213268639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febcc0ad2b0 msgr2=0x7febcc0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febcb400640 1 --2- 172.21.15.59:0/4213268639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febcc0ad2b0 0x7febcc0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febcb400640 1 -- 172.21.15.59:0/4213268639 >> v2:172.21.15.107:3300/0 conn(0x7febcc1569e0 msgr2=0x7febcc15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febcb400640 1 --2- 172.21.15.59:0/4213268639 >> v2:172.21.15.107:3300/0 conn(0x7febcc1569e0 0x7febcc15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febcb400640 1 -- 172.21.15.59:0/4213268639 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febcc15d100 con 0x7febcc0d0660 2024-05-30T16:51:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febc2000640 1 --2- 172.21.15.59:0/4213268639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febcc0ad2b0 0x7febcc0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:51:53.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febcb400640 1 --2- 172.21.15.59:0/4213268639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febcc0d0660 0x7febcc0d0af0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7febcc0b4c40 tx=0x7febc401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d2da292c99c4a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febca000640 1 -- 172.21.15.59:0/4213268639 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc40b2070 con 0x7febcc0d0660 2024-05-30T16:51:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febca000640 1 -- 172.21.15.59:0/4213268639 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc40a9070 con 0x7febcc0d0660 2024-05-30T16:51:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febca000640 1 -- 172.21.15.59:0/4213268639 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc40ad880 con 0x7febcc0d0660 2024-05-30T16:51:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febd1e00640 1 -- 172.21.15.59:0/4213268639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febcc0d0660 msgr2=0x7febcc0d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.581+0000 7febd1e00640 1 --2- 172.21.15.59:0/4213268639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febcc0d0660 0x7febcc0d0af0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7febcc0b4c40 tx=0x7febc401c490 comp rx=0 tx=0).stop 2024-05-30T16:51:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 -- 172.21.15.59:0/4213268639 shutdown_connections 2024-05-30T16:51:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 --2- 172.21.15.59:0/4213268639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febcc0d0660 0x7febcc0d0af0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 --2- 172.21.15.59:0/4213268639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febcc0ad2b0 0x7febcc0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 --2- 172.21.15.59:0/4213268639 >> v2:172.21.15.107:3300/0 conn(0x7febcc1569e0 0x7febcc15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 -- 172.21.15.59:0/4213268639 >> 172.21.15.59:0/4213268639 conn(0x7febcc06bdb0 msgr2=0x7febcc06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 -- 172.21.15.59:0/4213268639 shutdown_connections 2024-05-30T16:51:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 -- 172.21.15.59:0/4213268639 wait complete. 2024-05-30T16:51:53.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 Processor -- start 2024-05-30T16:51:53.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 -- start start 2024-05-30T16:51:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febcc0ad2b0 0x7febcc14f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febcc0d0660 0x7febcc09d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febcc1569e0 0x7febcc15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7febcc0b3c60 con 0x7febcc0d0660 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7febcc0b3ae0 con 0x7febcc1569e0 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7febcc0b3de0 con 0x7febcc0ad2b0 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febc2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febcc0d0660 0x7febcc09d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febc2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febcc0d0660 0x7febcc09d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33596/0 (socket says 172.21.15.59:33596) 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febc2000640 1 -- 172.21.15.59:0/2955235975 learned_addr learned my addr 172.21.15.59:0/2955235975 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febcaa00640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febcc0ad2b0 0x7febcc14f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febcb400640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febcc1569e0 0x7febcc15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febc2000640 1 -- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febcc0ad2b0 msgr2=0x7febcc14f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febc2000640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febcc0ad2b0 0x7febcc14f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febc2000640 1 -- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febcc1569e0 msgr2=0x7febcc15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febc2000640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febcc1569e0 0x7febcc15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febc2000640 1 -- 172.21.15.59:0/2955235975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febcc09de50 con 0x7febcc0d0660 2024-05-30T16:51:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febcb400640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febcc1569e0 0x7febcc15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febc2000640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febcc0d0660 0x7febcc09d4e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7febb400e810 tx=0x7febb400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febc3e00640 1 -- 172.21.15.59:0/2955235975 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4017070 con 0x7febcc0d0660 2024-05-30T16:51:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febc3e00640 1 -- 172.21.15.59:0/2955235975 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb400c8d0 con 0x7febcc0d0660 2024-05-30T16:51:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 -- 172.21.15.59:0/2955235975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febcc09e130 con 0x7febcc0d0660 2024-05-30T16:51:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febc3e00640 1 -- 172.21.15.59:0/2955235975 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb400f040 con 0x7febcc0d0660 2024-05-30T16:51:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.585+0000 7febd1e00640 1 -- 172.21.15.59:0/2955235975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febcc06ddf0 con 0x7febcc0d0660 2024-05-30T16:51:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.589+0000 7febd1e00640 1 -- 172.21.15.59:0/2955235975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febcc068a90 con 0x7febcc0d0660 2024-05-30T16:51:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.589+0000 7febc3e00640 1 -- 172.21.15.59:0/2955235975 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7febb401a070 con 0x7febcc0d0660 2024-05-30T16:51:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.589+0000 7febc3e00640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feba8068560 0x7feba806aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.589+0000 7febc3e00640 1 -- 172.21.15.59:0/2955235975 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7febb4086970 con 0x7febcc0d0660 2024-05-30T16:51:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.589+0000 7febcaa00640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feba8068560 0x7feba806aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.589+0000 7febcaa00640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feba8068560 0x7feba806aa20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7febbc0073f0 tx=0x7febbc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.593+0000 7febc3e00640 1 -- 172.21.15.59:0/2955235975 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7febb4056c30 con 0x7febcc0d0660 2024-05-30T16:51:53.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.785+0000 7febd1e00640 1 -- 172.21.15.59:0/2955235975 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7febcc154a90 con 0x7feba8068560 2024-05-30T16:51:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febc3e00640 1 -- 172.21.15.59:0/2955235975 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+79 (secure 0 0 0) 0x7febcc154a90 con 0x7feba8068560 2024-05-30T16:51:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:53.791 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:51:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sv1" 2024-05-30T16:51:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:51:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ss1clone1" 2024-05-30T16:51:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:53.791 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:51:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febd1e00640 1 -- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feba8068560 msgr2=0x7feba806aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febd1e00640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feba8068560 0x7feba806aa20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7febbc0073f0 tx=0x7febbc00b040 comp rx=0 tx=0).stop 2024-05-30T16:51:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febd1e00640 1 -- 172.21.15.59:0/2955235975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febcc0d0660 msgr2=0x7febcc09d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febd1e00640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febcc0d0660 0x7febcc09d4e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7febb400e810 tx=0x7febb400ecd0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febd1e00640 1 -- 172.21.15.59:0/2955235975 shutdown_connections 2024-05-30T16:51:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febd1e00640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feba8068560 0x7feba806aa20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febd1e00640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febcc1569e0 0x7febcc15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febd1e00640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febcc0d0660 0x7febcc09d4e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febd1e00640 1 --2- 172.21.15.59:0/2955235975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febcc0ad2b0 0x7febcc14f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febd1e00640 1 -- 172.21.15.59:0/2955235975 >> 172.21.15.59:0/2955235975 conn(0x7febcc06bdb0 msgr2=0x7febcc153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:53.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febd1e00640 1 -- 172.21.15.59:0/2955235975 shutdown_connections 2024-05-30T16:51:53.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.789+0000 7febd1e00640 1 -- 172.21.15.59:0/2955235975 wait complete. 2024-05-30T16:51:53.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T16:51:53.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.953+0000 7fcc3f400640 1 Processor -- start 2024-05-30T16:51:53.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc3f400640 1 -- start start 2024-05-30T16:51:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc3f400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcc38156e40 0x7fcc3806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc3f400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc3806e120 con 0x7fcc3806dc60 2024-05-30T16:51:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc3f400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc3806e400 con 0x7fcc380af130 2024-05-30T16:51:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc3f400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fcc3806e6e0 con 0x7fcc38156e40 2024-05-30T16:51:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc2fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcc3806dc60 0x7fcc3815d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36168/0 (socket says 172.21.15.59:36168) 2024-05-30T16:51:53.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc2fe00640 1 -- 172.21.15.59:0/1242114039 learned_addr learned my addr 172.21.15.59:0/1242114039 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:53.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc3ca00640 1 --2- 172.21.15.59:0/1242114039 >> v2:172.21.15.107:3300/0 conn(0x7fcc38156e40 0x7fcc3806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc37e00640 1 -- 172.21.15.59:0/1242114039 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398753614 0 0) 0x7fcc3806e120 con 0x7fcc3806dc60 2024-05-30T16:51:53.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc37e00640 1 -- 172.21.15.59:0/1242114039 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc1c003530 con 0x7fcc3806dc60 2024-05-30T16:51:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc37e00640 1 -- 172.21.15.59:0/1242114039 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1074800605 0 0) 0x7fcc1c003530 con 0x7fcc3806dc60 2024-05-30T16:51:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc3ca00640 1 -- 172.21.15.59:0/1242114039 >> v1:172.21.15.107:6789/0 conn(0x7fcc380af130 legacy=0x7fcc380af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc3ca00640 1 -- 172.21.15.59:0/1242114039 >> v1:172.21.15.59:6789/0 conn(0x7fcc3806dc60 legacy=0x7fcc3815d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.957+0000 7fcc3ca00640 1 -- 172.21.15.59:0/1242114039 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3806e9c0 con 0x7fcc38156e40 2024-05-30T16:51:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc3ca00640 1 --2- 172.21.15.59:0/1242114039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc38156e40 0x7fcc3806f1c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc280097c0 tx=0x7fcc2801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a631d2d2894b6003 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc37e00640 1 -- 172.21.15.59:0/1242114039 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc280b0070 con 0x7fcc38156e40 2024-05-30T16:51:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc37e00640 1 -- 172.21.15.59:0/1242114039 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc280ab400 con 0x7fcc38156e40 2024-05-30T16:51:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc37e00640 1 -- 172.21.15.59:0/1242114039 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20001680 con 0x7fcc38156e40 2024-05-30T16:51:53.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc3f400640 1 -- 172.21.15.59:0/1242114039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc38156e40 msgr2=0x7fcc3806f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc3f400640 1 --2- 172.21.15.59:0/1242114039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc38156e40 0x7fcc3806f1c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc280097c0 tx=0x7fcc2801c3c0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc3f400640 1 -- 172.21.15.59:0/1242114039 shutdown_connections 2024-05-30T16:51:53.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc3f400640 1 --2- 172.21.15.59:0/1242114039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc38156e40 0x7fcc3806f1c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc3f400640 1 -- 172.21.15.59:0/1242114039 >> 172.21.15.59:0/1242114039 conn(0x7fcc380b1e60 msgr2=0x7fcc380b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:53.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc3f400640 1 -- 172.21.15.59:0/1242114039 shutdown_connections 2024-05-30T16:51:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc3f400640 1 -- 172.21.15.59:0/1242114039 wait complete. 2024-05-30T16:51:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc3f400640 1 Processor -- start 2024-05-30T16:51:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.961+0000 7fcc3f400640 1 -- start start 2024-05-30T16:51:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc3806dc60 0x7fcc381475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc380af130 0x7fcc380b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38156e40 0x7fcc3815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3f400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3815eb70 con 0x7fcc38156e40 2024-05-30T16:51:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3f400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3815e9f0 con 0x7fcc380af130 2024-05-30T16:51:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3f400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcc3816a560 con 0x7fcc3806dc60 2024-05-30T16:51:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38156e40 0x7fcc3815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38156e40 0x7fcc3815ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33598/0 (socket says 172.21.15.59:33598) 2024-05-30T16:51:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3d400640 1 -- 172.21.15.59:0/2399582902 learned_addr learned my addr 172.21.15.59:0/2399582902 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3ca00640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc3806dc60 0x7fcc381475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc2fe00640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc380af130 0x7fcc380b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3d400640 1 -- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc3806dc60 msgr2=0x7fcc381475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3d400640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc3806dc60 0x7fcc381475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3d400640 1 -- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc380af130 msgr2=0x7fcc380b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3d400640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc380af130 0x7fcc380b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3d400640 1 -- 172.21.15.59:0/2399582902 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc38149fa0 con 0x7fcc38156e40 2024-05-30T16:51:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3d400640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38156e40 0x7fcc3815ecf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000c770 tx=0x7fcc3000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc35600640 1 -- 172.21.15.59:0/2399582902 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30003b80 con 0x7fcc38156e40 2024-05-30T16:51:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc35600640 1 -- 172.21.15.59:0/2399582902 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc30003d20 con 0x7fcc38156e40 2024-05-30T16:51:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc35600640 1 -- 172.21.15.59:0/2399582902 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3000aa90 con 0x7fcc38156e40 2024-05-30T16:51:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3f400640 1 -- 172.21.15.59:0/2399582902 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3814a280 con 0x7fcc38156e40 2024-05-30T16:51:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3f400640 1 -- 172.21.15.59:0/2399582902 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc38147eb0 con 0x7fcc38156e40 2024-05-30T16:51:53.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.965+0000 7fcc3f400640 1 -- 172.21.15.59:0/2399582902 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc38068a90 con 0x7fcc38156e40 2024-05-30T16:51:53.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.969+0000 7fcc35600640 1 -- 172.21.15.59:0/2399582902 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7fcc3000ac30 con 0x7fcc38156e40 2024-05-30T16:51:53.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.969+0000 7fcc35600640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc14068530 0x7fcc1406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:53.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.969+0000 7fcc35600640 1 -- 172.21.15.59:0/2399582902 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fcc30086ca0 con 0x7fcc38156e40 2024-05-30T16:51:53.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.969+0000 7fcc3ca00640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc14068530 0x7fcc1406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.969+0000 7fcc3ca00640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc14068530 0x7fcc1406a9f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcc280ad000 tx=0x7fcc280a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:53.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:53.973+0000 7fcc35600640 1 -- 172.21.15.59:0/2399582902 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcc30056f40 con 0x7fcc38156e40 2024-05-30T16:51:54.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.161+0000 7fcc3f400640 1 -- 172.21.15.59:0/2399582902 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc38168330 con 0x7fcc14068530 2024-05-30T16:51:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.177+0000 7fcc35600640 1 -- 172.21.15.59:0/2399582902 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fcc38168330 con 0x7fcc14068530 2024-05-30T16:51:54.179 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:54.179 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:51:54.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:51:54.179 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ss1" 2024-05-30T16:51:54.179 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:51:54.179 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:51:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.177+0000 7fcc3f400640 1 -- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc14068530 msgr2=0x7fcc1406a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.177+0000 7fcc3f400640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc14068530 0x7fcc1406a9f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcc280ad000 tx=0x7fcc280a6000 comp rx=0 tx=0).stop 2024-05-30T16:51:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.177+0000 7fcc3f400640 1 -- 172.21.15.59:0/2399582902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38156e40 msgr2=0x7fcc3815ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.177+0000 7fcc3f400640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38156e40 0x7fcc3815ecf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000c770 tx=0x7fcc3000cc30 comp rx=0 tx=0).stop 2024-05-30T16:51:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.181+0000 7fcc3f400640 1 -- 172.21.15.59:0/2399582902 shutdown_connections 2024-05-30T16:51:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.181+0000 7fcc3f400640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc14068530 0x7fcc1406a9f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.181+0000 7fcc3f400640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38156e40 0x7fcc3815ecf0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.181+0000 7fcc3f400640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc380af130 0x7fcc380b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.181+0000 7fcc3f400640 1 --2- 172.21.15.59:0/2399582902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc3806dc60 0x7fcc381475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.181+0000 7fcc3f400640 1 -- 172.21.15.59:0/2399582902 >> 172.21.15.59:0/2399582902 conn(0x7fcc380b1e60 msgr2=0x7fcc38072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.181+0000 7fcc3f400640 1 -- 172.21.15.59:0/2399582902 shutdown_connections 2024-05-30T16:51:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.181+0000 7fcc3f400640 1 -- 172.21.15.59:0/2399582902 wait complete. 2024-05-30T16:51:54.201 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T16:51:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.345+0000 7f1a6c000640 1 Processor -- start 2024-05-30T16:51:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.345+0000 7f1a6c000640 1 -- start start 2024-05-30T16:51:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a6c000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 0x7f1a640ae230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a6c000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1a640ae770 0x7f1a640cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a6c000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a640cbab0 con 0x7f1a640b0500 2024-05-30T16:51:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a6c000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6415ee00 con 0x7f1a640ae770 2024-05-30T16:51:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a6c000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a640cc370 con 0x7f1a6415ea20 2024-05-30T16:51:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a69600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 0x7f1a640ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a68c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1a640ae770 0x7f1a640cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a6a000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1a640b0500 0x7f1a6406b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:60778/0 (socket says 172.21.15.59:60778) 2024-05-30T16:51:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a69600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 0x7f1a640ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:33104/0 (socket says 172.21.15.59:33104) 2024-05-30T16:51:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a6a000640 1 -- 172.21.15.59:0/3989146779 learned_addr learned my addr 172.21.15.59:0/3989146779 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a69600640 1 -- 172.21.15.59:0/3989146779 >> v2:172.21.15.107:3300/0 conn(0x7f1a640ae770 msgr2=0x7f1a640cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a69600640 1 --2- 172.21.15.59:0/3989146779 >> v2:172.21.15.107:3300/0 conn(0x7f1a640ae770 0x7f1a640cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a69600640 1 -- 172.21.15.59:0/3989146779 >> v1:172.21.15.107:6789/0 conn(0x7f1a640b0500 legacy=0x7f1a6406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a69600640 1 -- 172.21.15.59:0/3989146779 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a640cbd20 con 0x7f1a6415ea20 2024-05-30T16:51:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a68c00640 1 --2- 172.21.15.59:0/3989146779 >> v2:172.21.15.107:3300/0 conn(0x7f1a640ae770 0x7f1a640cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.349+0000 7f1a69600640 1 --2- 172.21.15.59:0/3989146779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 0x7f1a640ae230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a580097c0 tx=0x7f1a5801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb20673d8c38a42 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a63e00640 1 -- 172.21.15.59:0/3989146779 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a580ab600 con 0x7f1a6415ea20 2024-05-30T16:51:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a63e00640 1 -- 172.21.15.59:0/3989146779 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a580b0070 con 0x7f1a6415ea20 2024-05-30T16:51:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a63e00640 1 -- 172.21.15.59:0/3989146779 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a580ab9c0 con 0x7f1a6415ea20 2024-05-30T16:51:54.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 -- 172.21.15.59:0/3989146779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 msgr2=0x7f1a640ae230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 --2- 172.21.15.59:0/3989146779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 0x7f1a640ae230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a580097c0 tx=0x7f1a5801c3e0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 -- 172.21.15.59:0/3989146779 shutdown_connections 2024-05-30T16:51:54.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 --2- 172.21.15.59:0/3989146779 >> v2:172.21.15.107:3300/0 conn(0x7f1a640ae770 0x7f1a640cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 --2- 172.21.15.59:0/3989146779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 0x7f1a640ae230 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 -- 172.21.15.59:0/3989146779 >> 172.21.15.59:0/3989146779 conn(0x7f1a640b2f50 msgr2=0x7f1a640b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:54.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 -- 172.21.15.59:0/3989146779 shutdown_connections 2024-05-30T16:51:54.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 -- 172.21.15.59:0/3989146779 wait complete. 2024-05-30T16:51:54.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 Processor -- start 2024-05-30T16:51:54.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 -- start start 2024-05-30T16:51:54.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a640ae770 0x7f1a640c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a640b0500 0x7f1a640c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 0x7f1a640b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640b3e00 con 0x7f1a640b0500 2024-05-30T16:51:54.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640b3c80 con 0x7f1a640ae770 2024-05-30T16:51:54.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6c000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6406c0c0 con 0x7f1a6415ea20 2024-05-30T16:51:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a68c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a640b0500 0x7f1a640c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a68c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a640b0500 0x7f1a640c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33614/0 (socket says 172.21.15.59:33614) 2024-05-30T16:51:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a68c00640 1 -- 172.21.15.59:0/444857083 learned_addr learned my addr 172.21.15.59:0/444857083 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a69600640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a640ae770 0x7f1a640c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.353+0000 7f1a6a000640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 0x7f1a640b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a68c00640 1 -- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 msgr2=0x7f1a640b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a68c00640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 0x7f1a640b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a68c00640 1 -- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a640ae770 msgr2=0x7f1a640c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a68c00640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a640ae770 0x7f1a640c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a68c00640 1 -- 172.21.15.59:0/444857083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a640c7330 con 0x7f1a640b0500 2024-05-30T16:51:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a69600640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a640ae770 0x7f1a640c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:51:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a6a000640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 0x7f1a640b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:51:54.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a68c00640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a640b0500 0x7f1a640c8d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000ebe0 tx=0x7f1a5000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:54.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a61600640 1 -- 172.21.15.59:0/444857083 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50017070 con 0x7f1a640b0500 2024-05-30T16:51:54.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a61600640 1 -- 172.21.15.59:0/444857083 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5000cc30 con 0x7f1a640b0500 2024-05-30T16:51:54.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a6c000640 1 -- 172.21.15.59:0/444857083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a640b0b30 con 0x7f1a640b0500 2024-05-30T16:51:54.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a61600640 1 -- 172.21.15.59:0/444857083 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50013470 con 0x7f1a640b0500 2024-05-30T16:51:54.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a6c000640 1 -- 172.21.15.59:0/444857083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a640b10f0 con 0x7f1a640b0500 2024-05-30T16:51:54.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a6c000640 1 -- 172.21.15.59:0/444857083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a64075680 con 0x7f1a640b0500 2024-05-30T16:51:54.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.357+0000 7f1a61600640 1 -- 172.21.15.59:0/444857083 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f1a5001a070 con 0x7f1a640b0500 2024-05-30T16:51:54.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.361+0000 7f1a61600640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a44068530 0x7f1a4406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.361+0000 7f1a61600640 1 -- 172.21.15.59:0/444857083 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1a50086ff0 con 0x7f1a640b0500 2024-05-30T16:51:54.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.361+0000 7f1a69600640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a44068530 0x7f1a4406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.361+0000 7f1a69600640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a44068530 0x7f1a4406a9f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a580af000 tx=0x7f1a580b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:54.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.365+0000 7f1a61600640 1 -- 172.21.15.59:0/444857083 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1a50057320 con 0x7f1a640b0500 2024-05-30T16:51:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.561+0000 7f1a6c000640 1 -- 172.21.15.59:0/444857083 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a64068a90 con 0x7f1a44068530 2024-05-30T16:51:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.589+0000 7f1a61600640 1 -- 172.21.15.59:0/444857083 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1a64068a90 con 0x7f1a44068530 2024-05-30T16:51:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.593+0000 7f1a6c000640 1 -- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a44068530 msgr2=0x7f1a4406a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.593+0000 7f1a6c000640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a44068530 0x7f1a4406a9f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a580af000 tx=0x7f1a580b6040 comp rx=0 tx=0).stop 2024-05-30T16:51:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.593+0000 7f1a6c000640 1 -- 172.21.15.59:0/444857083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a640b0500 msgr2=0x7f1a640c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.593+0000 7f1a6c000640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a640b0500 0x7f1a640c8d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000ebe0 tx=0x7f1a5000c520 comp rx=0 tx=0).stop 2024-05-30T16:51:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.593+0000 7f1a6c000640 1 -- 172.21.15.59:0/444857083 shutdown_connections 2024-05-30T16:51:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.593+0000 7f1a6c000640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a44068530 0x7f1a4406a9f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.593+0000 7f1a6c000640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a6415ea20 0x7f1a640b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.593+0000 7f1a6c000640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a640b0500 0x7f1a640c8d30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.593+0000 7f1a6c000640 1 --2- 172.21.15.59:0/444857083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a640ae770 0x7f1a640c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.593+0000 7f1a6c000640 1 -- 172.21.15.59:0/444857083 >> 172.21.15.59:0/444857083 conn(0x7f1a640b2f50 msgr2=0x7f1a640d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.593+0000 7f1a6c000640 1 -- 172.21.15.59:0/444857083 shutdown_connections 2024-05-30T16:51:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.593+0000 7f1a6c000640 1 -- 172.21.15.59:0/444857083 wait complete. 2024-05-30T16:51:54.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T16:51:54.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41c4c00640 1 Processor -- start 2024-05-30T16:51:54.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41c4c00640 1 -- start start 2024-05-30T16:51:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41c4c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c00ad2b0 0x7f41c015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41c4c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41c00d0660 0x7f41c00d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41c4c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c00ad770 con 0x7f41c01569e0 2024-05-30T16:51:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41c4c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f41c015cb40 con 0x7f41c00d0660 2024-05-30T16:51:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41c4c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f41c015ce20 con 0x7f41c00ad2b0 2024-05-30T16:51:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41be800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41c00d0660 0x7f41c00d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41bde00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f41c01569e0 0x7f41c00cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36174/0 (socket says 172.21.15.59:36174) 2024-05-30T16:51:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41bde00640 1 -- 172.21.15.59:0/3897832513 learned_addr learned my addr 172.21.15.59:0/3897832513 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:54.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41b5400640 1 --2- 172.21.15.59:0/3897832513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c00ad2b0 0x7f41c015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41be800640 1 -- 172.21.15.59:0/3897832513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c00ad2b0 msgr2=0x7f41c015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:54.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41be800640 1 --2- 172.21.15.59:0/3897832513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c00ad2b0 0x7f41c015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41be800640 1 -- 172.21.15.59:0/3897832513 >> v1:172.21.15.59:6789/0 conn(0x7f41c01569e0 legacy=0x7f41c00cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.757+0000 7f41be800640 1 -- 172.21.15.59:0/3897832513 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c015d100 con 0x7f41c00d0660 2024-05-30T16:51:54.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.761+0000 7f41be800640 1 --2- 172.21.15.59:0/3897832513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c00d0660 0x7f41c00d0af0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f41b80097c0 tx=0x7f41b801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b98c681c7c8564 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:54.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.761+0000 7f41bd400640 1 -- 172.21.15.59:0/3897832513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b80b0070 con 0x7f41c00d0660 2024-05-30T16:51:54.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.761+0000 7f41bd400640 1 -- 172.21.15.59:0/3897832513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b80ab600 con 0x7f41c00d0660 2024-05-30T16:51:54.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.761+0000 7f41bd400640 1 -- 172.21.15.59:0/3897832513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b80ab9d0 con 0x7f41c00d0660 2024-05-30T16:51:54.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.761+0000 7f41c4c00640 1 -- 172.21.15.59:0/3897832513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c00d0660 msgr2=0x7f41c00d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.761+0000 7f41c4c00640 1 --2- 172.21.15.59:0/3897832513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c00d0660 0x7f41c00d0af0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f41b80097c0 tx=0x7f41b801c410 comp rx=0 tx=0).stop 2024-05-30T16:51:54.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.761+0000 7f41c4c00640 1 -- 172.21.15.59:0/3897832513 shutdown_connections 2024-05-30T16:51:54.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.761+0000 7f41c4c00640 1 --2- 172.21.15.59:0/3897832513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c00d0660 0x7f41c00d0af0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.761+0000 7f41c4c00640 1 --2- 172.21.15.59:0/3897832513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c00ad2b0 0x7f41c015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.761+0000 7f41c4c00640 1 -- 172.21.15.59:0/3897832513 >> 172.21.15.59:0/3897832513 conn(0x7f41c006bdb0 msgr2=0x7f41c006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.761+0000 7f41c4c00640 1 -- 172.21.15.59:0/3897832513 shutdown_connections 2024-05-30T16:51:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.761+0000 7f41c4c00640 1 -- 172.21.15.59:0/3897832513 wait complete. 2024-05-30T16:51:54.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41c4c00640 1 Processor -- start 2024-05-30T16:51:54.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41c4c00640 1 -- start start 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41c4c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c00ad2b0 0x7f41c014fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41c4c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41c00d0660 0x7f41c015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41c4c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c01569e0 0x7f41c01496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41c4c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f41c00b3e70 con 0x7f41c01569e0 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41c4c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f41c00b3cf0 con 0x7f41c00d0660 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41c4c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f41c00b3ff0 con 0x7f41c00ad2b0 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41be800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c01569e0 0x7f41c01496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41be800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c01569e0 0x7f41c01496b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33636/0 (socket says 172.21.15.59:33636) 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41be800640 1 -- 172.21.15.59:0/3346646654 learned_addr learned my addr 172.21.15.59:0/3346646654 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41bde00640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c00ad2b0 0x7f41c014fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41b5400640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41c00d0660 0x7f41c015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41be800640 1 -- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c00ad2b0 msgr2=0x7f41c014fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41be800640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c00ad2b0 0x7f41c014fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41be800640 1 -- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41c00d0660 msgr2=0x7f41c015bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41be800640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41c00d0660 0x7f41c015bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41be800640 1 -- 172.21.15.59:0/3346646654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c00b24f0 con 0x7f41c01569e0 2024-05-30T16:51:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41be800640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c01569e0 0x7f41c01496b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f41b80ae040 tx=0x7f41b80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41b6a00640 1 -- 172.21.15.59:0/3346646654 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b80b0040 con 0x7f41c01569e0 2024-05-30T16:51:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41b6a00640 1 -- 172.21.15.59:0/3346646654 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b80b9070 con 0x7f41c01569e0 2024-05-30T16:51:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41b6a00640 1 -- 172.21.15.59:0/3346646654 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b80b4630 con 0x7f41c01569e0 2024-05-30T16:51:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41c4c00640 1 -- 172.21.15.59:0/3346646654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c00b03a0 con 0x7f41c01569e0 2024-05-30T16:51:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.765+0000 7f41c4c00640 1 -- 172.21.15.59:0/3346646654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c00b2a70 con 0x7f41c01569e0 2024-05-30T16:51:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.769+0000 7f41c4c00640 1 -- 172.21.15.59:0/3346646654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c0068a90 con 0x7f41c01569e0 2024-05-30T16:51:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.769+0000 7f41b6a00640 1 -- 172.21.15.59:0/3346646654 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f41b80b47d0 con 0x7f41c01569e0 2024-05-30T16:51:54.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.769+0000 7f41b6a00640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f419c068530 0x7f419c06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.769+0000 7f41b6a00640 1 -- 172.21.15.59:0/3346646654 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f41b8120b00 con 0x7f41c01569e0 2024-05-30T16:51:54.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.769+0000 7f41bde00640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f419c068530 0x7f419c06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.769+0000 7f41bde00640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f419c068530 0x7f419c06a9f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f41b00012f0 tx=0x7f41b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:54.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.773+0000 7f41b6a00640 1 -- 172.21.15.59:0/3346646654 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f41b8016090 con 0x7f41c01569e0 2024-05-30T16:51:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.961+0000 7f41c4c00640 1 -- 172.21.15.59:0/3346646654 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f41c014ff70 con 0x7f419c068530 2024-05-30T16:51:54.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41b6a00640 1 -- 172.21.15.59:0/3346646654 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f41c014ff70 con 0x7f419c068530 2024-05-30T16:51:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41c4c00640 1 -- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f419c068530 msgr2=0x7f419c06a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41c4c00640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f419c068530 0x7f419c06a9f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f41b00012f0 tx=0x7f41b0009040 comp rx=0 tx=0).stop 2024-05-30T16:51:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41c4c00640 1 -- 172.21.15.59:0/3346646654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c01569e0 msgr2=0x7f41c01496b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41c4c00640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c01569e0 0x7f41c01496b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f41b80ae040 tx=0x7f41b80191b0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41c4c00640 1 -- 172.21.15.59:0/3346646654 shutdown_connections 2024-05-30T16:51:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41c4c00640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f419c068530 0x7f419c06a9f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41c4c00640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c01569e0 0x7f41c01496b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41c4c00640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41c00d0660 0x7f41c015bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41c4c00640 1 --2- 172.21.15.59:0/3346646654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c00ad2b0 0x7f41c014fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41c4c00640 1 -- 172.21.15.59:0/3346646654 >> 172.21.15.59:0/3346646654 conn(0x7f41c006bdb0 msgr2=0x7f41c0155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41c4c00640 1 -- 172.21.15.59:0/3346646654 shutdown_connections 2024-05-30T16:51:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:54.981+0000 7f41c4c00640 1 -- 172.21.15.59:0/3346646654 wait complete. 2024-05-30T16:51:54.987 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:54.983+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:54.987 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:54.983+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:54.987 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:54.983+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:54.987 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:54.983+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:54.987 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:54.983+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:55.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-05-30T16:51:55.006 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:55.003+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:55.006 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:55.003+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:55.006 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:55.003+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:55.006 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:55.003+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:55.006 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:51:55.003+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:55.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.153+0000 7f8040600640 1 Processor -- start 2024-05-30T16:51:55.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.153+0000 7f8040600640 1 -- start start 2024-05-30T16:51:55.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.153+0000 7f8040600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f803815ffb0 0x7f803809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:55.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.153+0000 7f8040600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80380b30c0 con 0x7f80380b35e0 2024-05-30T16:51:55.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f8040600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80380c5d70 con 0x7f80380b3b20 2024-05-30T16:51:55.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f8040600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f80380c5b20 con 0x7f803815ffb0 2024-05-30T16:51:55.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f803d200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f80380b35e0 0x7f803809af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36176/0 (socket says 172.21.15.59:36176) 2024-05-30T16:51:55.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f803d200640 1 -- 172.21.15.59:0/217874402 learned_addr learned my addr 172.21.15.59:0/217874402 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:55.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f803dc00640 1 --2- 172.21.15.59:0/217874402 >> v2:172.21.15.107:3300/0 conn(0x7f803815ffb0 0x7f803809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:55.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f8037e00640 1 -- 172.21.15.59:0/217874402 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3127784543 0 0) 0x7f80380b30c0 con 0x7f80380b35e0 2024-05-30T16:51:55.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f8037e00640 1 -- 172.21.15.59:0/217874402 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8020003530 con 0x7f80380b35e0 2024-05-30T16:51:55.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f8037e00640 1 -- 172.21.15.59:0/217874402 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624304437 0 0) 0x7f80380c5d70 con 0x7f80380b3b20 2024-05-30T16:51:55.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f8037e00640 1 -- 172.21.15.59:0/217874402 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80380b30c0 con 0x7f80380b3b20 2024-05-30T16:51:55.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f803dc00640 1 -- 172.21.15.59:0/217874402 >> v1:172.21.15.107:6789/0 conn(0x7f80380b3b20 legacy=0x7f80380d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:55.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f803dc00640 1 -- 172.21.15.59:0/217874402 >> v1:172.21.15.59:6789/0 conn(0x7f80380b35e0 legacy=0x7f803809af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:55.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f803dc00640 1 -- 172.21.15.59:0/217874402 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80380d0aa0 con 0x7f803815ffb0 2024-05-30T16:51:55.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.157+0000 7f803dc00640 1 --2- 172.21.15.59:0/217874402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f803815ffb0 0x7f803809aa40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f802c0097c0 tx=0x7f802c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e9071b15fef64df server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:55.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.161+0000 7f8037e00640 1 -- 172.21.15.59:0/217874402 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c0b0070 con 0x7f803815ffb0 2024-05-30T16:51:55.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.161+0000 7f8037e00640 1 -- 172.21.15.59:0/217874402 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f802c0ab600 con 0x7f803815ffb0 2024-05-30T16:51:55.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.161+0000 7f8037e00640 1 -- 172.21.15.59:0/217874402 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c0ab9d0 con 0x7f803815ffb0 2024-05-30T16:51:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.161+0000 7f8040600640 1 -- 172.21.15.59:0/217874402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f803815ffb0 msgr2=0x7f803809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.161+0000 7f8040600640 1 --2- 172.21.15.59:0/217874402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f803815ffb0 0x7f803809aa40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f802c0097c0 tx=0x7f802c01c4a0 comp rx=0 tx=0).stop 2024-05-30T16:51:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.161+0000 7f8040600640 1 -- 172.21.15.59:0/217874402 shutdown_connections 2024-05-30T16:51:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.161+0000 7f8040600640 1 --2- 172.21.15.59:0/217874402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f803815ffb0 0x7f803809aa40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.161+0000 7f8040600640 1 -- 172.21.15.59:0/217874402 >> 172.21.15.59:0/217874402 conn(0x7f80380b3f80 msgr2=0x7f80380b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.161+0000 7f8040600640 1 -- 172.21.15.59:0/217874402 shutdown_connections 2024-05-30T16:51:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.161+0000 7f8040600640 1 -- 172.21.15.59:0/217874402 wait complete. 2024-05-30T16:51:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.161+0000 7f8040600640 1 Processor -- start 2024-05-30T16:51:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.161+0000 7f8040600640 1 -- start start 2024-05-30T16:51:55.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8040600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80380b35e0 0x7f8038154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:55.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8040600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80380b3b20 0x7f80380c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:55.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8040600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f803815ffb0 0x7f80380c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:55.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8040600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f803809b690 con 0x7f80380b3b20 2024-05-30T16:51:55.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8040600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f80380b2a30 con 0x7f803815ffb0 2024-05-30T16:51:55.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8040600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f803816b280 con 0x7f80380b35e0 2024-05-30T16:51:55.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f803d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80380b3b20 0x7f80380c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:55.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f803d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80380b3b20 0x7f80380c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33650/0 (socket says 172.21.15.59:33650) 2024-05-30T16:51:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f803d200640 1 -- 172.21.15.59:0/451077970 learned_addr learned my addr 172.21.15.59:0/451077970 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f803dc00640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80380b35e0 0x7f8038154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f803e600640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f803815ffb0 0x7f80380c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f803d200640 1 -- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80380b35e0 msgr2=0x7f8038154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f803d200640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80380b35e0 0x7f8038154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f803d200640 1 -- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f803815ffb0 msgr2=0x7f80380c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f803d200640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f803815ffb0 0x7f80380c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f803d200640 1 -- 172.21.15.59:0/451077970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80381677f0 con 0x7f80380b3b20 2024-05-30T16:51:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f803d200640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80380b3b20 0x7f80380c6da0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f802400c420 tx=0x7f802400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8035600640 1 -- 172.21.15.59:0/451077970 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024017070 con 0x7f80380b3b20 2024-05-30T16:51:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8035600640 1 -- 172.21.15.59:0/451077970 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8024005cf0 con 0x7f80380b3b20 2024-05-30T16:51:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8040600640 1 -- 172.21.15.59:0/451077970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8038167230 con 0x7f80380b3b20 2024-05-30T16:51:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8035600640 1 -- 172.21.15.59:0/451077970 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024007310 con 0x7f80380b3b20 2024-05-30T16:51:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8040600640 1 -- 172.21.15.59:0/451077970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8038141300 con 0x7f80380b3b20 2024-05-30T16:51:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8040600640 1 -- 172.21.15.59:0/451077970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8038068a90 con 0x7f80380b3b20 2024-05-30T16:51:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.165+0000 7f8035600640 1 -- 172.21.15.59:0/451077970 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f802401a070 con 0x7f80380b3b20 2024-05-30T16:51:55.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.169+0000 7f8035600640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8018068530 0x7f801806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:55.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.169+0000 7f8035600640 1 -- 172.21.15.59:0/451077970 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8024085fa0 con 0x7f80380b3b20 2024-05-30T16:51:55.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.169+0000 7f803dc00640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8018068530 0x7f801806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:55.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.169+0000 7f803dc00640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8018068530 0x7f801806a9f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f802c0ad000 tx=0x7f802c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.173+0000 7f8035600640 1 -- 172.21.15.59:0/451077970 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8024055ca0 con 0x7f80380b3b20 2024-05-30T16:51:55.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.365+0000 7f8040600640 1 -- 172.21.15.59:0/451077970 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f80380b8410 con 0x7f8018068530 2024-05-30T16:51:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8035600640 1 -- 172.21.15.59:0/451077970 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f80380b8410 con 0x7f8018068530 2024-05-30T16:51:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8040600640 1 -- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8018068530 msgr2=0x7f801806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8040600640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8018068530 0x7f801806a9f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f802c0ad000 tx=0x7f802c008040 comp rx=0 tx=0).stop 2024-05-30T16:51:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8040600640 1 -- 172.21.15.59:0/451077970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80380b3b20 msgr2=0x7f80380c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8040600640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80380b3b20 0x7f80380c6da0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f802400c420 tx=0x7f802400c8e0 comp rx=0 tx=0).stop 2024-05-30T16:51:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8040600640 1 -- 172.21.15.59:0/451077970 shutdown_connections 2024-05-30T16:51:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8040600640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8018068530 0x7f801806a9f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8040600640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f803815ffb0 0x7f80380c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8040600640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80380b3b20 0x7f80380c6da0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8040600640 1 --2- 172.21.15.59:0/451077970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80380b35e0 0x7f8038154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8040600640 1 -- 172.21.15.59:0/451077970 >> 172.21.15.59:0/451077970 conn(0x7f80380b3f80 msgr2=0x7f80380b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8040600640 1 -- 172.21.15.59:0/451077970 shutdown_connections 2024-05-30T16:51:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.389+0000 7f8040600640 1 -- 172.21.15.59:0/451077970 wait complete. 2024-05-30T16:51:55.414 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T16:51:55.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:51:55.475 INFO:teuthology.orchestra.run.smithi059.stdout:2 2024-05-30T16:51:55.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:51:55.482 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:51:55.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:51:55.680 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:51:55.746 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:51:55.747 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:51:55.747 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:51:55.747 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:51:55.756 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:51:55.756 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:51:55.805 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:51:55.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.989+0000 7f437fe00640 1 Processor -- start 2024-05-30T16:51:55.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.989+0000 7f437fe00640 1 -- start start 2024-05-30T16:51:55.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.989+0000 7f437fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f43800d0f30 0x7f438009ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:55.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.989+0000 7f437fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f438009b080 0x7f43800cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:55.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.989+0000 7f437fe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f438009b900 con 0x7f438015c7b0 2024-05-30T16:51:55.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.989+0000 7f437fe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f438015cb90 con 0x7f438009b080 2024-05-30T16:51:55.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.989+0000 7f437fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f43800cd4c0 con 0x7f43800d0f30 2024-05-30T16:51:55.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.989+0000 7f4376000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f43800d0f30 0x7f438009ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:55.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.989+0000 7f437f400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f438009b080 0x7f43800cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:55.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.989+0000 7f437ea00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f438015c7b0 0x7f43800d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:60786/0 (socket says 172.21.15.59:60786) 2024-05-30T16:51:55.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.989+0000 7f437ea00640 1 -- 172.21.15.59:0/2624844322 learned_addr learned my addr 172.21.15.59:0/2624844322 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:55.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f4376000640 1 -- 172.21.15.59:0/2624844322 >> v2:172.21.15.107:3300/0 conn(0x7f438009b080 msgr2=0x7f43800cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:55.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f4376000640 1 --2- 172.21.15.59:0/2624844322 >> v2:172.21.15.107:3300/0 conn(0x7f438009b080 0x7f43800cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:55.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f4376000640 1 -- 172.21.15.59:0/2624844322 >> v1:172.21.15.107:6789/0 conn(0x7f438015c7b0 legacy=0x7f43800d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:55.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f4376000640 1 -- 172.21.15.59:0/2624844322 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438009bbe0 con 0x7f43800d0f30 2024-05-30T16:51:55.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f437f400640 1 --2- 172.21.15.59:0/2624844322 >> v2:172.21.15.107:3300/0 conn(0x7f438009b080 0x7f43800cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:55.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f4376000640 1 --2- 172.21.15.59:0/2624844322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f43800d0f30 0x7f438009ab40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f43680097c0 tx=0x7f436801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17cd5866f5989cd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:55.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f437e000640 1 -- 172.21.15.59:0/2624844322 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43680aa5f0 con 0x7f43800d0f30 2024-05-30T16:51:55.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f437e000640 1 -- 172.21.15.59:0/2624844322 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43680af070 con 0x7f43800d0f30 2024-05-30T16:51:55.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f437e000640 1 -- 172.21.15.59:0/2624844322 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43680aa9b0 con 0x7f43800d0f30 2024-05-30T16:51:55.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f437fe00640 1 -- 172.21.15.59:0/2624844322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f43800d0f30 msgr2=0x7f438009ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:55.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f437fe00640 1 --2- 172.21.15.59:0/2624844322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f43800d0f30 0x7f438009ab40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f43680097c0 tx=0x7f436801c470 comp rx=0 tx=0).stop 2024-05-30T16:51:55.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f437fe00640 1 -- 172.21.15.59:0/2624844322 shutdown_connections 2024-05-30T16:51:55.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f437fe00640 1 --2- 172.21.15.59:0/2624844322 >> v2:172.21.15.107:3300/0 conn(0x7f438009b080 0x7f43800cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:55.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f437fe00640 1 --2- 172.21.15.59:0/2624844322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f43800d0f30 0x7f438009ab40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:55.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.993+0000 7f437fe00640 1 -- 172.21.15.59:0/2624844322 >> 172.21.15.59:0/2624844322 conn(0x7f43800b3ec0 msgr2=0x7f43800b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:55.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437fe00640 1 -- 172.21.15.59:0/2624844322 shutdown_connections 2024-05-30T16:51:55.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437fe00640 1 -- 172.21.15.59:0/2624844322 wait complete. 2024-05-30T16:51:55.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437fe00640 1 Processor -- start 2024-05-30T16:51:55.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437fe00640 1 -- start start 2024-05-30T16:51:55.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f438009b080 0x7f4380150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:56.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f43800d0f30 0x7f4380154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:56.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438015c7b0 0x7f4380155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:56.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43800ce820 con 0x7f438009b080 2024-05-30T16:51:56.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f43800ce6a0 con 0x7f438015c7b0 2024-05-30T16:51:56.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f43800ce9a0 con 0x7f43800d0f30 2024-05-30T16:51:56.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f438009b080 0x7f4380150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:56.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f438009b080 0x7f4380150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33664/0 (socket says 172.21.15.59:33664) 2024-05-30T16:51:56.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437ea00640 1 -- 172.21.15.59:0/2416784333 learned_addr learned my addr 172.21.15.59:0/2416784333 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f4376000640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f43800d0f30 0x7f4380154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437f400640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438015c7b0 0x7f4380155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437ea00640 1 -- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f43800d0f30 msgr2=0x7f4380154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437ea00640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f43800d0f30 0x7f4380154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437ea00640 1 -- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438015c7b0 msgr2=0x7f4380155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437ea00640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438015c7b0 0x7f4380155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437ea00640 1 -- 172.21.15.59:0/2416784333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43800b5a10 con 0x7f438009b080 2024-05-30T16:51:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437f400640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438015c7b0 0x7f4380155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:55.997+0000 7f437ea00640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f438009b080 0x7f4380150110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f437000c450 tx=0x7f437000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.001+0000 7f4377400640 1 -- 172.21.15.59:0/2416784333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4370017070 con 0x7f438009b080 2024-05-30T16:51:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.001+0000 7f4377400640 1 -- 172.21.15.59:0/2416784333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4370005cf0 con 0x7f438009b080 2024-05-30T16:51:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.001+0000 7f437fe00640 1 -- 172.21.15.59:0/2416784333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43800c8020 con 0x7f438009b080 2024-05-30T16:51:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.001+0000 7f4377400640 1 -- 172.21.15.59:0/2416784333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4370007290 con 0x7f438009b080 2024-05-30T16:51:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.001+0000 7f437fe00640 1 -- 172.21.15.59:0/2416784333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43800b5cb0 con 0x7f438009b080 2024-05-30T16:51:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.001+0000 7f437fe00640 1 -- 172.21.15.59:0/2416784333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4380068a90 con 0x7f438009b080 2024-05-30T16:51:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.001+0000 7f4377400640 1 -- 172.21.15.59:0/2416784333 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f437001a070 con 0x7f438009b080 2024-05-30T16:51:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.001+0000 7f4377400640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f435c068530 0x7f435c06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.001+0000 7f4377400640 1 -- 172.21.15.59:0/2416784333 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4370086070 con 0x7f438009b080 2024-05-30T16:51:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.001+0000 7f4376000640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f435c068530 0x7f435c06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.005+0000 7f4376000640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f435c068530 0x7f435c06a9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f43680ae000 tx=0x7f43680a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:56.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.005+0000 7f4377400640 1 -- 172.21.15.59:0/2416784333 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4370056310 con 0x7f438009b080 2024-05-30T16:51:56.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.113+0000 7f4377400640 1 -- 172.21.15.59:0/2416784333 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f4370052280 con 0x7f438009b080 2024-05-30T16:51:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.185+0000 7f437fe00640 1 -- 172.21.15.59:0/2416784333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f43800b4b20 con 0x7f438009b080 2024-05-30T16:51:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.185+0000 7f4377400640 1 -- 172.21.15.59:0/2416784333 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f4370018ca0 con 0x7f438009b080 2024-05-30T16:51:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T16:51:56.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.189+0000 7f437fe00640 1 -- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f435c068530 msgr2=0x7f435c06a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:56.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.189+0000 7f437fe00640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f435c068530 0x7f435c06a9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f43680ae000 tx=0x7f43680a7000 comp rx=0 tx=0).stop 2024-05-30T16:51:56.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.189+0000 7f437fe00640 1 -- 172.21.15.59:0/2416784333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f438009b080 msgr2=0x7f4380150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:56.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.189+0000 7f437fe00640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f438009b080 0x7f4380150110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f437000c450 tx=0x7f437000c910 comp rx=0 tx=0).stop 2024-05-30T16:51:56.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.189+0000 7f437fe00640 1 -- 172.21.15.59:0/2416784333 shutdown_connections 2024-05-30T16:51:56.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.189+0000 7f437fe00640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f435c068530 0x7f435c06a9f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.189+0000 7f437fe00640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438015c7b0 0x7f4380155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.189+0000 7f437fe00640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f43800d0f30 0x7f4380154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.189+0000 7f437fe00640 1 --2- 172.21.15.59:0/2416784333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f438009b080 0x7f4380150110 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.189+0000 7f437fe00640 1 -- 172.21.15.59:0/2416784333 >> 172.21.15.59:0/2416784333 conn(0x7f43800b3ec0 msgr2=0x7f43800c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:56.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.189+0000 7f437fe00640 1 -- 172.21.15.59:0/2416784333 shutdown_connections 2024-05-30T16:51:56.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:56.189+0000 7f437fe00640 1 -- 172.21.15.59:0/2416784333 wait complete. 2024-05-30T16:51:56.211 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2024-05-30T16:51:56.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:51:56.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-30T16:51:56.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[35912]: fuse finished with error 0 and tester_r 0 2024-05-30T16:51:56.827 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T16:51:56.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:51:56.828 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T16:51:56.837 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:51:56.837 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:51:56.837 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:51:56.846 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:51:56.847 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:51:56.847 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:51:56.847 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:51:56.893 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:51:56.893 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:51:56.893 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:51:56.893 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:51:56.902 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:51:56.903 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:51:57.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.077+0000 7f0b65800640 1 Processor -- start 2024-05-30T16:51:57.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b65800640 1 -- start start 2024-05-30T16:51:57.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b65800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b600b61f0 0x7f0b60155b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b65800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b6015f6a0 0x7f0b6006f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b65800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b600b43a0 con 0x7f0b60155720 2024-05-30T16:51:57.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b65800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0b600b4680 con 0x7f0b600b61f0 2024-05-30T16:51:57.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b65800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0b600b4960 con 0x7f0b6015f6a0 2024-05-30T16:51:57.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b56000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b600b61f0 0x7f0b60155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b5ea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0b60155720 0x7f0b60070a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36190/0 (socket says 172.21.15.59:36190) 2024-05-30T16:51:57.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b5ea00640 1 -- 172.21.15.59:0/3000979534 learned_addr learned my addr 172.21.15.59:0/3000979534 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:57.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b56000640 1 -- 172.21.15.59:0/3000979534 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b6015f6a0 msgr2=0x7f0b6006f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:57.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b5f400640 1 --2- 172.21.15.59:0/3000979534 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b6015f6a0 0x7f0b6006f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b56000640 1 --2- 172.21.15.59:0/3000979534 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b6015f6a0 0x7f0b6006f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b56000640 1 -- 172.21.15.59:0/3000979534 >> v1:172.21.15.59:6789/0 conn(0x7f0b60155720 legacy=0x7f0b60070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b56000640 1 -- 172.21.15.59:0/3000979534 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6015faf0 con 0x7f0b600b61f0 2024-05-30T16:51:57.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b5f400640 1 --2- 172.21.15.59:0/3000979534 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b6015f6a0 0x7f0b6006f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:57.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.081+0000 7f0b5e000640 1 -- 172.21.15.59:0/3000979534 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2238509402 0 0) 0x7f0b600b43a0 con 0x7f0b60155720 2024-05-30T16:51:57.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b56000640 1 --2- 172.21.15.59:0/3000979534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b600b61f0 0x7f0b60155b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009d90 tx=0x7f0b4801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a0c1d49ba87b21 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:57.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b5e000640 1 -- 172.21.15.59:0/3000979534 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b480b2070 con 0x7f0b600b61f0 2024-05-30T16:51:57.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b5e000640 1 -- 172.21.15.59:0/3000979534 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b480a5940 con 0x7f0b600b61f0 2024-05-30T16:51:57.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b5e000640 1 -- 172.21.15.59:0/3000979534 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b480a5d10 con 0x7f0b600b61f0 2024-05-30T16:51:57.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b65800640 1 -- 172.21.15.59:0/3000979534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b600b61f0 msgr2=0x7f0b60155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b65800640 1 --2- 172.21.15.59:0/3000979534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b600b61f0 0x7f0b60155b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009d90 tx=0x7f0b4801c970 comp rx=0 tx=0).stop 2024-05-30T16:51:57.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b65800640 1 -- 172.21.15.59:0/3000979534 shutdown_connections 2024-05-30T16:51:57.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b65800640 1 --2- 172.21.15.59:0/3000979534 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b6015f6a0 0x7f0b6006f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b65800640 1 --2- 172.21.15.59:0/3000979534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b600b61f0 0x7f0b60155b00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b65800640 1 -- 172.21.15.59:0/3000979534 >> 172.21.15.59:0/3000979534 conn(0x7f0b6009aa40 msgr2=0x7f0b600b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:57.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b65800640 1 -- 172.21.15.59:0/3000979534 shutdown_connections 2024-05-30T16:51:57.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b65800640 1 -- 172.21.15.59:0/3000979534 wait complete. 2024-05-30T16:51:57.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b65800640 1 Processor -- start 2024-05-30T16:51:57.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.085+0000 7f0b65800640 1 -- start start 2024-05-30T16:51:57.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b65800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b600b61f0 0x7f0b60154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b65800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b60155720 0x7f0b60144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b65800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6015f6a0 0x7f0b60159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b65800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0b600d1b60 con 0x7f0b6015f6a0 2024-05-30T16:51:57.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b65800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0b600d19e0 con 0x7f0b60155720 2024-05-30T16:51:57.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b65800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0b600d1ce0 con 0x7f0b600b61f0 2024-05-30T16:51:57.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b5f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6015f6a0 0x7f0b60159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b5f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6015f6a0 0x7f0b60159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33682/0 (socket says 172.21.15.59:33682) 2024-05-30T16:51:57.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b5f400640 1 -- 172.21.15.59:0/4293247898 learned_addr learned my addr 172.21.15.59:0/4293247898 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b5ea00640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b600b61f0 0x7f0b60154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b56000640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b60155720 0x7f0b60144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b5f400640 1 -- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b600b61f0 msgr2=0x7f0b60154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b5f400640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b600b61f0 0x7f0b60154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b5f400640 1 -- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b60155720 msgr2=0x7f0b60144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b5f400640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b60155720 0x7f0b60144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b5f400640 1 -- 172.21.15.59:0/4293247898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6014c020 con 0x7f0b6015f6a0 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b56000640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b60155720 0x7f0b60144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b5ea00640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b600b61f0 0x7f0b60154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b5f400640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6015f6a0 0x7f0b60159630 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c7f0 tx=0x7f0b5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b57400640 1 -- 172.21.15.59:0/4293247898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58015070 con 0x7f0b6015f6a0 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b57400640 1 -- 172.21.15.59:0/4293247898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b58007860 con 0x7f0b6015f6a0 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b57400640 1 -- 172.21.15.59:0/4293247898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58007c50 con 0x7f0b6015f6a0 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b65800640 1 -- 172.21.15.59:0/4293247898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b60159e60 con 0x7f0b6015f6a0 2024-05-30T16:51:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b65800640 1 -- 172.21.15.59:0/4293247898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b60159b70 con 0x7f0b6015f6a0 2024-05-30T16:51:57.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.089+0000 7f0b65800640 1 -- 172.21.15.59:0/4293247898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b60068a90 con 0x7f0b6015f6a0 2024-05-30T16:51:57.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.093+0000 7f0b57400640 1 -- 172.21.15.59:0/4293247898 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f0b58018070 con 0x7f0b6015f6a0 2024-05-30T16:51:57.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.093+0000 7f0b57400640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0b3c068650 0x7f0b3c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.093+0000 7f0b57400640 1 -- 172.21.15.59:0/4293247898 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0b580870a0 con 0x7f0b6015f6a0 2024-05-30T16:51:57.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.093+0000 7f0b5ea00640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0b3c068650 0x7f0b3c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.093+0000 7f0b5ea00640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0b3c068650 0x7f0b3c06ab10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b50000f70 tx=0x7f0b50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:57.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.097+0000 7f0b57400640 1 -- 172.21.15.59:0/4293247898 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b58057250 con 0x7f0b6015f6a0 2024-05-30T16:51:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.305+0000 7f0b65800640 1 -- 172.21.15.59:0/4293247898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b6006c620 con 0x7f0b6015f6a0 2024-05-30T16:51:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.305+0000 7f0b57400640 1 -- 172.21.15.59:0/4293247898 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f0b58056b50 con 0x7f0b6015f6a0 2024-05-30T16:51:57.309 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:57.309 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1119687744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1119687744},{"type":"v1","addr":"172.21.15.107:6836","nonce":1119687744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/985448024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":985448024},{"type":"v1","addr":"172.21.15.107:6837","nonce":985448024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4747,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1214274073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1214274073},{"type":"v1","addr":"172.21.15.59:6834","nonce":1214274073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:48.139853+0000","modified":"2024-05-30T16:49:51.161912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4803},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4803":{"gid":4803,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3713717108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3713717108},{"type":"v1","addr":"172.21.15.59:6835","nonce":3713717108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4803,"qdb_cluster":[4803]},"id":2}]} 2024-05-30T16:51:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 17 2024-05-30T16:51:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.309+0000 7f0b65800640 1 -- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0b3c068650 msgr2=0x7f0b3c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.309+0000 7f0b65800640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0b3c068650 0x7f0b3c06ab10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b50000f70 tx=0x7f0b50009040 comp rx=0 tx=0).stop 2024-05-30T16:51:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.309+0000 7f0b65800640 1 -- 172.21.15.59:0/4293247898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6015f6a0 msgr2=0x7f0b60159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.309+0000 7f0b65800640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6015f6a0 0x7f0b60159630 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c7f0 tx=0x7f0b5800ccb0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.309+0000 7f0b65800640 1 -- 172.21.15.59:0/4293247898 shutdown_connections 2024-05-30T16:51:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.309+0000 7f0b65800640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0b3c068650 0x7f0b3c06ab10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.309+0000 7f0b65800640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6015f6a0 0x7f0b60159630 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.309+0000 7f0b65800640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b60155720 0x7f0b60144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.309+0000 7f0b65800640 1 --2- 172.21.15.59:0/4293247898 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b600b61f0 0x7f0b60154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.309+0000 7f0b65800640 1 -- 172.21.15.59:0/4293247898 >> 172.21.15.59:0/4293247898 conn(0x7f0b6009aa40 msgr2=0x7f0b600ae380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.309+0000 7f0b65800640 1 -- 172.21.15.59:0/4293247898 shutdown_connections 2024-05-30T16:51:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.309+0000 7f0b65800640 1 -- 172.21.15.59:0/4293247898 wait complete. 2024-05-30T16:51:57.331 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:51:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.473+0000 7f20ee200640 1 Processor -- start 2024-05-30T16:51:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.473+0000 7f20ee200640 1 -- start start 2024-05-30T16:51:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.473+0000 7f20ee200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f20e80af720 0x7f20e815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.473+0000 7f20ee200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20e80d0560 0x7f20e80d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.473+0000 7f20ee200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20e815f060 con 0x7f20e806e900 2024-05-30T16:51:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.473+0000 7f20ee200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f20e80afb00 con 0x7f20e80af720 2024-05-30T16:51:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.473+0000 7f20ee200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f20e815c270 con 0x7f20e80d0560 2024-05-30T16:51:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.477+0000 7f20e7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20e80d0560 0x7f20e80d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.477+0000 7f20e7400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f20e80af720 0x7f20e815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.477+0000 7f20e7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20e80d0560 0x7f20e80d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:33196/0 (socket says 172.21.15.59:33196) 2024-05-30T16:51:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.477+0000 7f20e7e00640 1 -- 172.21.15.59:0/3699764348 learned_addr learned my addr 172.21.15.59:0/3699764348 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.477+0000 7f20dea00640 1 --1- 172.21.15.59:0/3699764348 >> v1:172.21.15.107:6789/0 conn(0x7f20e806e900 0x7f20e815f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:60792/0 (socket says 172.21.15.59:60792) 2024-05-30T16:51:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.477+0000 7f20e7e00640 1 -- 172.21.15.59:0/3699764348 >> v2:172.21.15.107:3300/0 conn(0x7f20e80af720 msgr2=0x7f20e815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.477+0000 7f20e7e00640 1 --2- 172.21.15.59:0/3699764348 >> v2:172.21.15.107:3300/0 conn(0x7f20e80af720 0x7f20e815b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.477+0000 7f20e7e00640 1 -- 172.21.15.59:0/3699764348 >> v1:172.21.15.107:6789/0 conn(0x7f20e806e900 legacy=0x7f20e815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.477+0000 7f20e7e00640 1 -- 172.21.15.59:0/3699764348 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e815ff00 con 0x7f20e80d0560 2024-05-30T16:51:57.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.477+0000 7f20e7e00640 1 --2- 172.21.15.59:0/3699764348 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20e80d0560 0x7f20e80d0a10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009e50 tx=0x7f20e001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd6032ddb7d9c1bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20e6a00640 1 -- 172.21.15.59:0/3699764348 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e00a57f0 con 0x7f20e80d0560 2024-05-30T16:51:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20e6a00640 1 -- 172.21.15.59:0/3699764348 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e00a5990 con 0x7f20e80d0560 2024-05-30T16:51:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20e6a00640 1 -- 172.21.15.59:0/3699764348 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e00a5d60 con 0x7f20e80d0560 2024-05-30T16:51:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 -- 172.21.15.59:0/3699764348 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20e80d0560 msgr2=0x7f20e80d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 --2- 172.21.15.59:0/3699764348 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20e80d0560 0x7f20e80d0a10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009e50 tx=0x7f20e001ca30 comp rx=0 tx=0).stop 2024-05-30T16:51:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 -- 172.21.15.59:0/3699764348 shutdown_connections 2024-05-30T16:51:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 --2- 172.21.15.59:0/3699764348 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20e80d0560 0x7f20e80d0a10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 --2- 172.21.15.59:0/3699764348 >> v2:172.21.15.107:3300/0 conn(0x7f20e80af720 0x7f20e815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 -- 172.21.15.59:0/3699764348 >> 172.21.15.59:0/3699764348 conn(0x7f20e80b22d0 msgr2=0x7f20e80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 -- 172.21.15.59:0/3699764348 shutdown_connections 2024-05-30T16:51:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 -- 172.21.15.59:0/3699764348 wait complete. 2024-05-30T16:51:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 Processor -- start 2024-05-30T16:51:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 -- start start 2024-05-30T16:51:57.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e806e900 0x7f20e81562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20e80af720 0x7f20e81f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e80d0560 0x7f20e814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f20e8073150 con 0x7f20e80d0560 2024-05-30T16:51:57.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f20e815c830 con 0x7f20e806e900 2024-05-30T16:51:57.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20ee200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f20e80732d0 con 0x7f20e80af720 2024-05-30T16:51:57.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e80d0560 0x7f20e814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20e7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e806e900 0x7f20e81562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20e7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e806e900 0x7f20e81562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:45028/0 (socket says 172.21.15.59:45028) 2024-05-30T16:51:57.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20e7400640 1 -- 172.21.15.59:0/368066808 learned_addr learned my addr 172.21.15.59:0/368066808 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:57.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.481+0000 7f20dea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20e80af720 0x7f20e81f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20e7400640 1 -- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20e80af720 msgr2=0x7f20e81f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20e7400640 1 --2- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20e80af720 0x7f20e81f6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20e7400640 1 -- 172.21.15.59:0/368066808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e80d0560 msgr2=0x7f20e814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20e7400640 1 --2- 172.21.15.59:0/368066808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e80d0560 0x7f20e814f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20e7400640 1 -- 172.21.15.59:0/368066808 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e8165e30 con 0x7f20e806e900 2024-05-30T16:51:57.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20e7400640 1 --2- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e806e900 0x7f20e81562c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f20d800e870 tx=0x7f20d800ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:57.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20dfe00640 1 -- 172.21.15.59:0/368066808 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8017070 con 0x7f20e806e900 2024-05-30T16:51:57.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20dfe00640 1 -- 172.21.15.59:0/368066808 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d800c8e0 con 0x7f20e806e900 2024-05-30T16:51:57.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20dfe00640 1 -- 172.21.15.59:0/368066808 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d800cc90 con 0x7f20e806e900 2024-05-30T16:51:57.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20ee200640 1 -- 172.21.15.59:0/368066808 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e8166110 con 0x7f20e806e900 2024-05-30T16:51:57.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20ee200640 1 -- 172.21.15.59:0/368066808 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e8157e30 con 0x7f20e806e900 2024-05-30T16:51:57.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20ee200640 1 -- 172.21.15.59:0/368066808 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e8068a90 con 0x7f20e806e900 2024-05-30T16:51:57.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20dfe00640 1 -- 172.21.15.59:0/368066808 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f20d801a070 con 0x7f20e806e900 2024-05-30T16:51:57.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.485+0000 7f20dfe00640 1 --2- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f20c4068650 0x7f20c406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.489+0000 7f20dfe00640 1 -- 172.21.15.59:0/368066808 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7f20d80872a0 con 0x7f20e806e900 2024-05-30T16:51:57.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.489+0000 7f20dea00640 1 --2- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f20c4068650 0x7f20c406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.489+0000 7f20dea00640 1 --2- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f20c4068650 0x7f20c406ab10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f20e8072770 tx=0x7f20d0007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:57.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.493+0000 7f20dfe00640 1 -- 172.21.15.59:0/368066808 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f20d8056f50 con 0x7f20e806e900 2024-05-30T16:51:57.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.693+0000 7f20ee200640 1 -- 172.21.15.59:0/368066808 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20e806cd10 con 0x7f20e806e900 2024-05-30T16:51:57.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.693+0000 7f20dfe00640 1 -- 172.21.15.59:0/368066808 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f20d805b250 con 0x7f20e806e900 2024-05-30T16:51:57.695 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:57.696 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1119687744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1119687744},{"type":"v1","addr":"172.21.15.107:6836","nonce":1119687744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/985448024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":985448024},{"type":"v1","addr":"172.21.15.107:6837","nonce":985448024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4747,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1214274073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1214274073},{"type":"v1","addr":"172.21.15.59:6834","nonce":1214274073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:48.139853+0000","modified":"2024-05-30T16:49:51.161912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4803},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4803":{"gid":4803,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3713717108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3713717108},{"type":"v1","addr":"172.21.15.59:6835","nonce":3713717108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4803,"qdb_cluster":[4803]},"id":2}]} 2024-05-30T16:51:57.696 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 17 2024-05-30T16:51:57.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.697+0000 7f20ee200640 1 -- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f20c4068650 msgr2=0x7f20c406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.697+0000 7f20ee200640 1 --2- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f20c4068650 0x7f20c406ab10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f20e8072770 tx=0x7f20d0007e90 comp rx=0 tx=0).stop 2024-05-30T16:51:57.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.697+0000 7f20ee200640 1 -- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e806e900 msgr2=0x7f20e81562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.697+0000 7f20ee200640 1 --2- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e806e900 0x7f20e81562c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f20d800e870 tx=0x7f20d800ec70 comp rx=0 tx=0).stop 2024-05-30T16:51:57.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.697+0000 7f20ee200640 1 -- 172.21.15.59:0/368066808 shutdown_connections 2024-05-30T16:51:57.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.697+0000 7f20ee200640 1 --2- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f20c4068650 0x7f20c406ab10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.697+0000 7f20ee200640 1 --2- 172.21.15.59:0/368066808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e80d0560 0x7f20e814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.697+0000 7f20ee200640 1 --2- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20e80af720 0x7f20e81f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.697+0000 7f20ee200640 1 --2- 172.21.15.59:0/368066808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e806e900 0x7f20e81562c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.697+0000 7f20ee200640 1 -- 172.21.15.59:0/368066808 >> 172.21.15.59:0/368066808 conn(0x7f20e80b22d0 msgr2=0x7f20e80b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:57.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.697+0000 7f20ee200640 1 -- 172.21.15.59:0/368066808 shutdown_connections 2024-05-30T16:51:57.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.697+0000 7f20ee200640 1 -- 172.21.15.59:0/368066808 wait complete. 2024-05-30T16:51:57.717 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:51:57.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.857+0000 7f151dc00640 1 Processor -- start 2024-05-30T16:51:57.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.857+0000 7f151dc00640 1 -- start start 2024-05-30T16:51:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.857+0000 7f151dc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1518160d90 0x7f151809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.857+0000 7f151dc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1518070d60 con 0x7f15180711e0 2024-05-30T16:51:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.857+0000 7f151dc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15180d1310 con 0x7f151809b780 2024-05-30T16:51:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.857+0000 7f151dc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f15180ced30 con 0x7f1518160d90 2024-05-30T16:51:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.857+0000 7f1517400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f15180711e0 0x7f1518070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36192/0 (socket says 172.21.15.59:36192) 2024-05-30T16:51:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.857+0000 7f1517400640 1 -- 172.21.15.59:0/3799304836 learned_addr learned my addr 172.21.15.59:0/3799304836 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.857+0000 7f1516a00640 1 --2- 172.21.15.59:0/3799304836 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1518160d90 0x7f151809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.861+0000 7f1516000640 1 -- 172.21.15.59:0/3799304836 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2582570800 0 0) 0x7f1518070d60 con 0x7f15180711e0 2024-05-30T16:51:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.861+0000 7f1516000640 1 -- 172.21.15.59:0/3799304836 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14fc003530 con 0x7f15180711e0 2024-05-30T16:51:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.861+0000 7f1516000640 1 -- 172.21.15.59:0/3799304836 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 204425713 0 0) 0x7f15180d1310 con 0x7f151809b780 2024-05-30T16:51:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.861+0000 7f1516000640 1 -- 172.21.15.59:0/3799304836 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1518070d60 con 0x7f151809b780 2024-05-30T16:51:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.861+0000 7f1516a00640 1 -- 172.21.15.59:0/3799304836 >> v1:172.21.15.107:6789/0 conn(0x7f151809b780 legacy=0x7f151806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.861+0000 7f1516a00640 1 -- 172.21.15.59:0/3799304836 >> v1:172.21.15.59:6789/0 conn(0x7f15180711e0 legacy=0x7f1518070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.861+0000 7f1516a00640 1 -- 172.21.15.59:0/3799304836 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151809bcf0 con 0x7f1518160d90 2024-05-30T16:51:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.861+0000 7f1516a00640 1 --2- 172.21.15.59:0/3799304836 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1518160d90 0x7f151809aa40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f15080097f0 tx=0x7f150801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71e5167e26bcb77e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.861+0000 7f1516000640 1 -- 172.21.15.59:0/3799304836 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15080b0070 con 0x7f1518160d90 2024-05-30T16:51:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.861+0000 7f1516000640 1 -- 172.21.15.59:0/3799304836 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15080ab600 con 0x7f1518160d90 2024-05-30T16:51:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.861+0000 7f1516000640 1 -- 172.21.15.59:0/3799304836 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15080ab9d0 con 0x7f1518160d90 2024-05-30T16:51:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 -- 172.21.15.59:0/3799304836 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1518160d90 msgr2=0x7f151809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 --2- 172.21.15.59:0/3799304836 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1518160d90 0x7f151809aa40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f15080097f0 tx=0x7f150801c450 comp rx=0 tx=0).stop 2024-05-30T16:51:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 -- 172.21.15.59:0/3799304836 shutdown_connections 2024-05-30T16:51:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 --2- 172.21.15.59:0/3799304836 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1518160d90 0x7f151809aa40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 -- 172.21.15.59:0/3799304836 >> 172.21.15.59:0/3799304836 conn(0x7f15180b3f80 msgr2=0x7f15180b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 -- 172.21.15.59:0/3799304836 shutdown_connections 2024-05-30T16:51:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 -- 172.21.15.59:0/3799304836 wait complete. 2024-05-30T16:51:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 Processor -- start 2024-05-30T16:51:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 -- start start 2024-05-30T16:51:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15180711e0 0x7f15180c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f151809b780 0x7f15180c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1518160d90 0x7f15181fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f15180af360 con 0x7f1518160d90 2024-05-30T16:51:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f15180af1e0 con 0x7f15180711e0 2024-05-30T16:51:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f151dc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1518071e60 con 0x7f151809b780 2024-05-30T16:51:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f1517400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1518160d90 0x7f15181fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f1517400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1518160d90 0x7f15181fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33710/0 (socket says 172.21.15.59:33710) 2024-05-30T16:51:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f1517400640 1 -- 172.21.15.59:0/931343525 learned_addr learned my addr 172.21.15.59:0/931343525 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f1516a00640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15180711e0 0x7f15180c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f150fe00640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f151809b780 0x7f15180c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f1517400640 1 -- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f151809b780 msgr2=0x7f15180c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f1517400640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f151809b780 0x7f15180c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f1517400640 1 -- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15180711e0 msgr2=0x7f15180c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f1517400640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15180711e0 0x7f15180c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f1517400640 1 -- 172.21.15.59:0/931343525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15180a0320 con 0x7f1518160d90 2024-05-30T16:51:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.865+0000 7f150fe00640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f151809b780 0x7f15180c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:51:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.869+0000 7f1517400640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1518160d90 0x7f15181fb930 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f151000cba0 tx=0x7f151000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.869+0000 7f150ea00640 1 -- 172.21.15.59:0/931343525 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510017070 con 0x7f1518160d90 2024-05-30T16:51:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.869+0000 7f150ea00640 1 -- 172.21.15.59:0/931343525 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f151000ace0 con 0x7f1518160d90 2024-05-30T16:51:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.869+0000 7f150ea00640 1 -- 172.21.15.59:0/931343525 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510012620 con 0x7f1518160d90 2024-05-30T16:51:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.869+0000 7f151dc00640 1 -- 172.21.15.59:0/931343525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151809fb40 con 0x7f1518160d90 2024-05-30T16:51:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.869+0000 7f151dc00640 1 -- 172.21.15.59:0/931343525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f151814d320 con 0x7f1518160d90 2024-05-30T16:51:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.869+0000 7f151dc00640 1 -- 172.21.15.59:0/931343525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1518068a90 con 0x7f1518160d90 2024-05-30T16:51:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.873+0000 7f150ea00640 1 -- 172.21.15.59:0/931343525 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f151001a070 con 0x7f1518160d90 2024-05-30T16:51:57.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.873+0000 7f150ea00640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f14f4068650 0x7f14f406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:57.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.873+0000 7f150ea00640 1 -- 172.21.15.59:0/931343525 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7f1510086b90 con 0x7f1518160d90 2024-05-30T16:51:57.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.873+0000 7f1516a00640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f14f4068650 0x7f14f406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.877+0000 7f1516a00640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f14f4068650 0x7f14f406ab10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f15080ad000 tx=0x7f15080a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:57.877+0000 7f150ea00640 1 -- 172.21.15.59:0/931343525 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f15100567c0 con 0x7f1518160d90 2024-05-30T16:51:58.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.169+0000 7f151dc00640 1 -- 172.21.15.59:0/931343525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f151806e9d0 con 0x7f1518160d90 2024-05-30T16:51:58.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.169+0000 7f150ea00640 1 -- 172.21.15.59:0/931343525 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16765 (secure 0 0 0) 0x7f151005aac0 con 0x7f1518160d90 2024-05-30T16:51:58.172 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:58.172 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":35,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:51:57.110276+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:45.836560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:47.111349+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:51:58.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.173+0000 7f151dc00640 1 -- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f14f4068650 msgr2=0x7f14f406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:58.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.173+0000 7f151dc00640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f14f4068650 0x7f14f406ab10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f15080ad000 tx=0x7f15080a6000 comp rx=0 tx=0).stop 2024-05-30T16:51:58.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.173+0000 7f151dc00640 1 -- 172.21.15.59:0/931343525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1518160d90 msgr2=0x7f15181fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:58.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.173+0000 7f151dc00640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1518160d90 0x7f15181fb930 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f151000cba0 tx=0x7f151000a430 comp rx=0 tx=0).stop 2024-05-30T16:51:58.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.173+0000 7f151dc00640 1 -- 172.21.15.59:0/931343525 shutdown_connections 2024-05-30T16:51:58.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.173+0000 7f151dc00640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f14f4068650 0x7f14f406ab10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.173+0000 7f151dc00640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1518160d90 0x7f15181fb930 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.173+0000 7f151dc00640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f151809b780 0x7f15180c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.173+0000 7f151dc00640 1 --2- 172.21.15.59:0/931343525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15180711e0 0x7f15180c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.173+0000 7f151dc00640 1 -- 172.21.15.59:0/931343525 >> 172.21.15.59:0/931343525 conn(0x7f15180b3f80 msgr2=0x7f151806d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:58.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.173+0000 7f151dc00640 1 -- 172.21.15.59:0/931343525 shutdown_connections 2024-05-30T16:51:58.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.173+0000 7f151dc00640 1 -- 172.21.15.59:0/931343525 wait complete. 2024-05-30T16:51:58.206 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T16:51:58.207 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:51:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.421+0000 7fe741600640 1 Processor -- start 2024-05-30T16:51:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.421+0000 7fe741600640 1 -- start start 2024-05-30T16:51:58.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.421+0000 7fe741600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe73c09b150 0x7fe73c0cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:58.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.421+0000 7fe741600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe73c09b780 0x7fe73c0ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:58.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.421+0000 7fe741600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73c0d1310 con 0x7fe73c160d90 2024-05-30T16:51:58.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.421+0000 7fe741600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe73c09bcf0 con 0x7fe73c09b150 2024-05-30T16:51:58.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.421+0000 7fe741600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe73c0d0a70 con 0x7fe73c09b780 2024-05-30T16:51:58.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.425+0000 7fe73b400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe73c09b780 0x7fe73c0ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:58.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.425+0000 7fe73b400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe73c09b780 0x7fe73c0ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:45054/0 (socket says 172.21.15.59:45054) 2024-05-30T16:51:58.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.425+0000 7fe73b400640 1 -- 172.21.15.59:0/1350598761 learned_addr learned my addr 172.21.15.59:0/1350598761 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:58.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.425+0000 7fe73b400640 1 -- 172.21.15.59:0/1350598761 >> v2:172.21.15.59:3300/0 conn(0x7fe73c09b150 msgr2=0x7fe73c0cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:58.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.425+0000 7fe73b400640 1 --2- 172.21.15.59:0/1350598761 >> v2:172.21.15.59:3300/0 conn(0x7fe73c09b150 0x7fe73c0cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.425+0000 7fe73b400640 1 -- 172.21.15.59:0/1350598761 >> v1:172.21.15.59:6789/0 conn(0x7fe73c160d90 legacy=0x7fe73c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:58.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.425+0000 7fe73b400640 1 -- 172.21.15.59:0/1350598761 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c0d0d50 con 0x7fe73c09b780 2024-05-30T16:51:58.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.429+0000 7fe73b400640 1 --2- 172.21.15.59:0/1350598761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c09b780 0x7fe73c0ce260 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0d1a30 tx=0x7fe72c01c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14b384eb58e94576 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.429+0000 7fe739600640 1 -- 172.21.15.59:0/1350598761 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0b1070 con 0x7fe73c09b780 2024-05-30T16:51:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.429+0000 7fe739600640 1 -- 172.21.15.59:0/1350598761 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72c0ac640 con 0x7fe73c09b780 2024-05-30T16:51:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.429+0000 7fe739600640 1 -- 172.21.15.59:0/1350598761 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0aca10 con 0x7fe73c09b780 2024-05-30T16:51:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.429+0000 7fe741600640 1 -- 172.21.15.59:0/1350598761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c09b780 msgr2=0x7fe73c0ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.429+0000 7fe741600640 1 --2- 172.21.15.59:0/1350598761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c09b780 0x7fe73c0ce260 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0d1a30 tx=0x7fe72c01c420 comp rx=0 tx=0).stop 2024-05-30T16:51:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.429+0000 7fe741600640 1 -- 172.21.15.59:0/1350598761 shutdown_connections 2024-05-30T16:51:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.429+0000 7fe741600640 1 --2- 172.21.15.59:0/1350598761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c09b780 0x7fe73c0ce260 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.429+0000 7fe741600640 1 --2- 172.21.15.59:0/1350598761 >> v2:172.21.15.59:3300/0 conn(0x7fe73c09b150 0x7fe73c0cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.429+0000 7fe741600640 1 -- 172.21.15.59:0/1350598761 >> 172.21.15.59:0/1350598761 conn(0x7fe73c0b3f80 msgr2=0x7fe73c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.429+0000 7fe741600640 1 -- 172.21.15.59:0/1350598761 shutdown_connections 2024-05-30T16:51:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.429+0000 7fe741600640 1 -- 172.21.15.59:0/1350598761 wait complete. 2024-05-30T16:51:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.433+0000 7fe741600640 1 Processor -- start 2024-05-30T16:51:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.433+0000 7fe741600640 1 -- start start 2024-05-30T16:51:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.433+0000 7fe741600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe73c09b150 0x7fe73c15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.433+0000 7fe741600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe73c09b780 0x7fe73c15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.433+0000 7fe741600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c160d90 0x7fe73c15d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.433+0000 7fe741600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c071fe0 con 0x7fe73c09b780 2024-05-30T16:51:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.433+0000 7fe741600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c071e60 con 0x7fe73c160d90 2024-05-30T16:51:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.433+0000 7fe741600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe73c161170 con 0x7fe73c09b150 2024-05-30T16:51:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe73aa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe73c09b150 0x7fe73c15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe73a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe73c09b780 0x7fe73c15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe73b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c160d90 0x7fe73c15d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe73b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c160d90 0x7fe73c15d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:45058/0 (socket says 172.21.15.59:45058) 2024-05-30T16:51:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe73b400640 1 -- 172.21.15.59:0/2192361632 learned_addr learned my addr 172.21.15.59:0/2192361632 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe73a000640 1 -- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe73c09b150 msgr2=0x7fe73c15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe73a000640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe73c09b150 0x7fe73c15adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe73a000640 1 -- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c160d90 msgr2=0x7fe73c15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe73a000640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c160d90 0x7fe73c15d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe73a000640 1 -- 172.21.15.59:0/2192361632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c0c8cb0 con 0x7fe73c09b780 2024-05-30T16:51:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe73b400640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c160d90 0x7fe73c15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe73a000640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe73c09b780 0x7fe73c15cbb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe72800b3c0 tx=0x7fe72800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe732a00640 1 -- 172.21.15.59:0/2192361632 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728011830 con 0x7fe73c09b780 2024-05-30T16:51:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe732a00640 1 -- 172.21.15.59:0/2192361632 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe728016070 con 0x7fe73c09b780 2024-05-30T16:51:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe741600640 1 -- 172.21.15.59:0/2192361632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73c0b51e0 con 0x7fe73c09b780 2024-05-30T16:51:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe732a00640 1 -- 172.21.15.59:0/2192361632 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728011c30 con 0x7fe73c09b780 2024-05-30T16:51:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe741600640 1 -- 172.21.15.59:0/2192361632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73c0b57a0 con 0x7fe73c09b780 2024-05-30T16:51:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.437+0000 7fe741600640 1 -- 172.21.15.59:0/2192361632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73c0b5c80 con 0x7fe73c09b780 2024-05-30T16:51:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.441+0000 7fe732a00640 1 -- 172.21.15.59:0/2192361632 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fe72801b460 con 0x7fe73c09b780 2024-05-30T16:51:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.441+0000 7fe732a00640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe71c068650 0x7fe71c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.441+0000 7fe732a00640 1 -- 172.21.15.59:0/2192361632 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7fe728086a40 con 0x7fe73c09b780 2024-05-30T16:51:58.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.441+0000 7fe73aa00640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe71c068650 0x7fe71c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.441+0000 7fe73aa00640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe71c068650 0x7fe71c06ab10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe734001cb0 tx=0x7fe734009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.449+0000 7fe732a00640 1 -- 172.21.15.59:0/2192361632 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe73c0b5c80 con 0x7fe73c09b780 2024-05-30T16:51:58.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.821+0000 7fe741600640 1 -- 172.21.15.59:0/2192361632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe73c068a90 con 0x7fe73c09b780 2024-05-30T16:51:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.821+0000 7fe732a00640 1 -- 172.21.15.59:0/2192361632 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7fe728056c70 con 0x7fe73c09b780 2024-05-30T16:51:58.823 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:58.823 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1119687744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1119687744},{"type":"v1","addr":"172.21.15.107:6836","nonce":1119687744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/985448024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":985448024},{"type":"v1","addr":"172.21.15.107:6837","nonce":985448024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4747,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1214274073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1214274073},{"type":"v1","addr":"172.21.15.59:6834","nonce":1214274073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:48.139853+0000","modified":"2024-05-30T16:49:51.161912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4803},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4803":{"gid":4803,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3713717108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3713717108},{"type":"v1","addr":"172.21.15.59:6835","nonce":3713717108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4803,"qdb_cluster":[4803]},"id":2}]} 2024-05-30T16:51:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 17 2024-05-30T16:51:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.825+0000 7fe741600640 1 -- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe71c068650 msgr2=0x7fe71c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.825+0000 7fe741600640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe71c068650 0x7fe71c06ab10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe734001cb0 tx=0x7fe734009040 comp rx=0 tx=0).stop 2024-05-30T16:51:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.825+0000 7fe741600640 1 -- 172.21.15.59:0/2192361632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe73c09b780 msgr2=0x7fe73c15cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.825+0000 7fe741600640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe73c09b780 0x7fe73c15cbb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe72800b3c0 tx=0x7fe72800b880 comp rx=0 tx=0).stop 2024-05-30T16:51:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.825+0000 7fe741600640 1 -- 172.21.15.59:0/2192361632 shutdown_connections 2024-05-30T16:51:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.825+0000 7fe741600640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe71c068650 0x7fe71c06ab10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.825+0000 7fe741600640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c160d90 0x7fe73c15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.825+0000 7fe741600640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe73c09b780 0x7fe73c15cbb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.825+0000 7fe741600640 1 --2- 172.21.15.59:0/2192361632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe73c09b150 0x7fe73c15adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.825+0000 7fe741600640 1 -- 172.21.15.59:0/2192361632 >> 172.21.15.59:0/2192361632 conn(0x7fe73c0b3f80 msgr2=0x7fe73c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.825+0000 7fe741600640 1 -- 172.21.15.59:0/2192361632 shutdown_connections 2024-05-30T16:51:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:58.825+0000 7fe741600640 1 -- 172.21.15.59:0/2192361632 wait complete. 2024-05-30T16:51:58.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:51:59.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.073+0000 7f887fa00640 1 Processor -- start 2024-05-30T16:51:59.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.073+0000 7f887fa00640 1 -- start start 2024-05-30T16:51:59.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.077+0000 7f887fa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f88780d0560 0x7f88780d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.077+0000 7f887fa00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887815f060 con 0x7f88780af720 2024-05-30T16:51:59.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.077+0000 7f887fa00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887815ff00 con 0x7f887806e900 2024-05-30T16:51:59.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.077+0000 7f887fa00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f88780afb00 con 0x7f88780d0560 2024-05-30T16:51:59.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.077+0000 7f8877e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f887806e900 0x7f887815f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:60816/0 (socket says 172.21.15.59:60816) 2024-05-30T16:51:59.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.077+0000 7f8877e00640 1 -- 172.21.15.59:0/444983252 learned_addr learned my addr 172.21.15.59:0/444983252 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.077+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250655567 0 0) 0x7f887815ff00 con 0x7f887806e900 2024-05-30T16:51:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.077+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8860003530 con 0x7f887806e900 2024-05-30T16:51:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.077+0000 7f887da00640 1 --2- 172.21.15.59:0/444983252 >> v2:172.21.15.107:3300/0 conn(0x7f88780d0560 0x7f88780d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.077+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1138046148 0 0) 0x7f8860003530 con 0x7f887806e900 2024-05-30T16:51:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.077+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 >> v2:172.21.15.107:3300/0 conn(0x7f88780d0560 msgr2=0x7f88780d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.077+0000 7f8877400640 1 --2- 172.21.15.59:0/444983252 >> v2:172.21.15.107:3300/0 conn(0x7f88780d0560 0x7f88780d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 >> v1:172.21.15.59:6789/0 conn(0x7f88780af720 legacy=0x7f887815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887815c270 con 0x7f887806e900 2024-05-30T16:51:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f8864001680 con 0x7f887806e900 2024-05-30T16:51:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 >> v1:172.21.15.107:6789/0 conn(0x7f887806e900 legacy=0x7f887815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f8877400640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88600039c0 0x7f8860003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f8877400640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8860004810 0x7f8860004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f8877400640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600051d0 0x7f886000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f88780afb00 con 0x7f88600051d0 2024-05-30T16:51:59.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f886000c020 con 0x7f8860004810 2024-05-30T16:51:59.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f886000c220 con 0x7f88600039c0 2024-05-30T16:51:59.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f887da00640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600051d0 0x7f886000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f8877e00640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8860004810 0x7f8860004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f887d000640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88600039c0 0x7f8860003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f887da00640 1 -- 172.21.15.59:0/444983252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88600039c0 msgr2=0x7f8860003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:59.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f887da00640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88600039c0 0x7f8860003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f887da00640 1 -- 172.21.15.59:0/444983252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8860004810 msgr2=0x7f8860004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:59.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f887da00640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8860004810 0x7f8860004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.081+0000 7f887da00640 1 -- 172.21.15.59:0/444983252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887815c270 con 0x7f88600051d0 2024-05-30T16:51:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.085+0000 7f8877e00640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8860004810 0x7f8860004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:51:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.085+0000 7f887da00640 1 -- 172.21.15.59:0/444983252 reap_dead start 2024-05-30T16:51:59.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.085+0000 7f887d000640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88600039c0 0x7f8860003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:59.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.085+0000 7f887da00640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600051d0 0x7f886000b9d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8870009fa0 tx=0x7f887001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2486305d3a5d89 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:59.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.085+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700b2070 con 0x7f88600051d0 2024-05-30T16:51:59.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.085+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88700a5d70 con 0x7f88600051d0 2024-05-30T16:51:59.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.085+0000 7f8877400640 1 -- 172.21.15.59:0/444983252 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870009bf0 con 0x7f88600051d0 2024-05-30T16:51:59.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.085+0000 7f887fa00640 1 -- 172.21.15.59:0/444983252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600051d0 msgr2=0x7f886000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.085+0000 7f887fa00640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600051d0 0x7f886000b9d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8870009fa0 tx=0x7f887001cca0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.085+0000 7f887fa00640 1 -- 172.21.15.59:0/444983252 shutdown_connections 2024-05-30T16:51:59.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.085+0000 7f887fa00640 1 --2- 172.21.15.59:0/444983252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600051d0 0x7f886000b9d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.085+0000 7f887fa00640 1 -- 172.21.15.59:0/444983252 >> 172.21.15.59:0/444983252 conn(0x7f88780b22d0 msgr2=0x7f88780b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:59.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.089+0000 7f887fa00640 1 -- 172.21.15.59:0/444983252 shutdown_connections 2024-05-30T16:51:59.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.089+0000 7f887fa00640 1 -- 172.21.15.59:0/444983252 wait complete. 2024-05-30T16:51:59.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.089+0000 7f887fa00640 1 Processor -- start 2024-05-30T16:51:59.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.089+0000 7f887fa00640 1 -- start start 2024-05-30T16:51:59.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.089+0000 7f887fa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88600051d0 0x7f8878148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.089+0000 7f887fa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f887815d710 0x7f887814a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.089+0000 7f887fa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f887815c9b0 0x7f887815ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.089+0000 7f887fa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f887815c830 con 0x7f887815c9b0 2024-05-30T16:51:59.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.089+0000 7f887fa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f887815f2d0 con 0x7f887815d710 2024-05-30T16:51:59.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.089+0000 7f887fa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f88780d0a10 con 0x7f88600051d0 2024-05-30T16:51:59.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f887da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f887815c9b0 0x7f887815ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f887d000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88600051d0 0x7f8878148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f8877e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f887815d710 0x7f887814a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f887d000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88600051d0 0x7f8878148cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:33262/0 (socket says 172.21.15.59:33262) 2024-05-30T16:51:59.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f887d000640 1 -- 172.21.15.59:0/3599149268 learned_addr learned my addr 172.21.15.59:0/3599149268 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:59.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f887d000640 1 -- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f887815d710 msgr2=0x7f887814a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f887d000640 1 --2- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f887815d710 0x7f887814a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f887d000640 1 -- 172.21.15.59:0/3599149268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f887815c9b0 msgr2=0x7f887815ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f887d000640 1 --2- 172.21.15.59:0/3599149268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f887815c9b0 0x7f887815ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f887d000640 1 -- 172.21.15.59:0/3599149268 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887814af30 con 0x7f88600051d0 2024-05-30T16:51:59.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f887d000640 1 --2- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88600051d0 0x7f8878148cd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f886c00f7a0 tx=0x7f886c00fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:59.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f8874c00640 1 -- 172.21.15.59:0/3599149268 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c0013a0 con 0x7f88600051d0 2024-05-30T16:51:59.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f8874c00640 1 -- 172.21.15.59:0/3599149268 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f886c018070 con 0x7f88600051d0 2024-05-30T16:51:59.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f8874c00640 1 -- 172.21.15.59:0/3599149268 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c00fe50 con 0x7f88600051d0 2024-05-30T16:51:59.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f887fa00640 1 -- 172.21.15.59:0/3599149268 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887815ebd0 con 0x7f88600051d0 2024-05-30T16:51:59.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.093+0000 7f887fa00640 1 -- 172.21.15.59:0/3599149268 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f887815e8f0 con 0x7f88600051d0 2024-05-30T16:51:59.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.097+0000 7f887fa00640 1 -- 172.21.15.59:0/3599149268 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8878068a90 con 0x7f88600051d0 2024-05-30T16:51:59.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.097+0000 7f8874c00640 1 -- 172.21.15.59:0/3599149268 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f886c00d730 con 0x7f88600051d0 2024-05-30T16:51:59.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.097+0000 7f8874c00640 1 --2- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f88580686a0 0x7f885806ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.097+0000 7f8874c00640 1 -- 172.21.15.59:0/3599149268 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7f886c0545f0 con 0x7f88600051d0 2024-05-30T16:51:59.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.101+0000 7f8877e00640 1 --2- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f88580686a0 0x7f885806ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.101+0000 7f8877e00640 1 --2- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f88580686a0 0x7f885806ab60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8864001a20 tx=0x7f8864007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:59.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.109+0000 7f8874c00640 1 -- 172.21.15.59:0/3599149268 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f886c056c50 con 0x7f88600051d0 2024-05-30T16:51:59.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.485+0000 7f887fa00640 1 -- 172.21.15.59:0/3599149268 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88780cc4f0 con 0x7f88600051d0 2024-05-30T16:51:59.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.485+0000 7f8874c00640 1 -- 172.21.15.59:0/3599149268 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f886c056550 con 0x7f88600051d0 2024-05-30T16:51:59.489 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:59.489 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1119687744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1119687744},{"type":"v1","addr":"172.21.15.107:6836","nonce":1119687744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/985448024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":985448024},{"type":"v1","addr":"172.21.15.107:6837","nonce":985448024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4747,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1214274073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1214274073},{"type":"v1","addr":"172.21.15.59:6834","nonce":1214274073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:49:48.139853+0000","modified":"2024-05-30T16:49:51.161912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4803},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4803":{"gid":4803,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3713717108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3713717108},{"type":"v1","addr":"172.21.15.59:6835","nonce":3713717108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4803,"qdb_cluster":[4803]},"id":2}]} 2024-05-30T16:51:59.490 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 17 2024-05-30T16:51:59.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.489+0000 7f887fa00640 1 -- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f88580686a0 msgr2=0x7f885806ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.489+0000 7f887fa00640 1 --2- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f88580686a0 0x7f885806ab60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8864001a20 tx=0x7f8864007040 comp rx=0 tx=0).stop 2024-05-30T16:51:59.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.489+0000 7f887fa00640 1 -- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88600051d0 msgr2=0x7f8878148cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.489+0000 7f887fa00640 1 --2- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88600051d0 0x7f8878148cd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f886c00f7a0 tx=0x7f886c00fc60 comp rx=0 tx=0).stop 2024-05-30T16:51:59.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.489+0000 7f887fa00640 1 -- 172.21.15.59:0/3599149268 shutdown_connections 2024-05-30T16:51:59.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.489+0000 7f887fa00640 1 --2- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f88580686a0 0x7f885806ab60 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8864001a20 tx=0x7f8864007040 comp rx=0 tx=0).stop 2024-05-30T16:51:59.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.489+0000 7f887fa00640 1 --2- 172.21.15.59:0/3599149268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f887815c9b0 0x7f887815ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.489+0000 7f887fa00640 1 --2- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f887815d710 0x7f887814a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.489+0000 7f887fa00640 1 --2- 172.21.15.59:0/3599149268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88600051d0 0x7f8878148cd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.489+0000 7f887fa00640 1 -- 172.21.15.59:0/3599149268 >> 172.21.15.59:0/3599149268 conn(0x7f88780b22d0 msgr2=0x7f887814d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:59.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.493+0000 7f887fa00640 1 -- 172.21.15.59:0/3599149268 shutdown_connections 2024-05-30T16:51:59.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.493+0000 7f887fa00640 1 -- 172.21.15.59:0/3599149268 wait complete. 2024-05-30T16:51:59.531 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:51:59.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.741+0000 7f16e1000640 1 Processor -- start 2024-05-30T16:51:59.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.741+0000 7f16e1000640 1 -- start start 2024-05-30T16:51:59.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16e1000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16dc06e900 0x7f16dc15f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16e1000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16dc0d0560 0x7f16dc0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16e1000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16dc15f060 con 0x7f16dc0af720 2024-05-30T16:51:59.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16e1000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f16dc0afb00 con 0x7f16dc0d0560 2024-05-30T16:51:59.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16e1000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f16dc15c270 con 0x7f16dc06e900 2024-05-30T16:51:59.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16d9e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f16dc0af720 0x7f16dc15b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36210/0 (socket says 172.21.15.59:36210) 2024-05-30T16:51:59.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16d9e00640 1 -- 172.21.15.59:0/453261943 learned_addr learned my addr 172.21.15.59:0/453261943 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:51:59.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16da800640 1 --2- 172.21.15.59:0/453261943 >> v2:172.21.15.59:3300/0 conn(0x7f16dc0d0560 0x7f16dc0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16d1400640 1 --2- 172.21.15.59:0/453261943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16dc06e900 0x7f16dc15f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16d9400640 1 -- 172.21.15.59:0/453261943 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3857273261 0 0) 0x7f16dc15f060 con 0x7f16dc0af720 2024-05-30T16:51:59.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16d9400640 1 -- 172.21.15.59:0/453261943 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16c0003530 con 0x7f16dc0af720 2024-05-30T16:51:59.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16da800640 1 -- 172.21.15.59:0/453261943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16dc06e900 msgr2=0x7f16dc15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:59.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16da800640 1 --2- 172.21.15.59:0/453261943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16dc06e900 0x7f16dc15f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16da800640 1 -- 172.21.15.59:0/453261943 >> v1:172.21.15.59:6789/0 conn(0x7f16dc0af720 legacy=0x7f16dc15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.745+0000 7f16da800640 1 -- 172.21.15.59:0/453261943 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16dc15c550 con 0x7f16dc0d0560 2024-05-30T16:51:59.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16da800640 1 --2- 172.21.15.59:0/453261943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16dc0d0560 0x7f16dc0d0a10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009d90 tx=0x7f16d401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57300f8ecbdfa38 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:59.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16d9400640 1 -- 172.21.15.59:0/453261943 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d40b2070 con 0x7f16dc0d0560 2024-05-30T16:51:59.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16d9400640 1 -- 172.21.15.59:0/453261943 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d40a5880 con 0x7f16dc0d0560 2024-05-30T16:51:59.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16d9400640 1 -- 172.21.15.59:0/453261943 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d40a5c50 con 0x7f16dc0d0560 2024-05-30T16:51:59.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 -- 172.21.15.59:0/453261943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16dc0d0560 msgr2=0x7f16dc0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 --2- 172.21.15.59:0/453261943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16dc0d0560 0x7f16dc0d0a10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009d90 tx=0x7f16d401c970 comp rx=0 tx=0).stop 2024-05-30T16:51:59.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 -- 172.21.15.59:0/453261943 shutdown_connections 2024-05-30T16:51:59.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 --2- 172.21.15.59:0/453261943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16dc0d0560 0x7f16dc0d0a10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 --2- 172.21.15.59:0/453261943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16dc06e900 0x7f16dc15f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 -- 172.21.15.59:0/453261943 >> 172.21.15.59:0/453261943 conn(0x7f16dc0b22d0 msgr2=0x7f16dc0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:59.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 -- 172.21.15.59:0/453261943 shutdown_connections 2024-05-30T16:51:59.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 -- 172.21.15.59:0/453261943 wait complete. 2024-05-30T16:51:59.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 Processor -- start 2024-05-30T16:51:59.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 -- start start 2024-05-30T16:51:59.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16dc06e900 0x7f16dc099b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16dc0af720 0x7f16dc09a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16dc0d0560 0x7f16dc09a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc073150 con 0x7f16dc0af720 2024-05-30T16:51:59.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc0732d0 con 0x7f16dc06e900 2024-05-30T16:51:59.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16e1000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f16dc1585c0 con 0x7f16dc0d0560 2024-05-30T16:51:59.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.749+0000 7f16d1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16dc0af720 0x7f16dc09a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16dc0af720 0x7f16dc09a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33766/0 (socket says 172.21.15.59:33766) 2024-05-30T16:51:59.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d1400640 1 -- 172.21.15.59:0/1143204180 learned_addr learned my addr 172.21.15.59:0/1143204180 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:51:59.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d9e00640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16dc06e900 0x7f16dc099b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16da800640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16dc0d0560 0x7f16dc09a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d1400640 1 -- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16dc0d0560 msgr2=0x7f16dc09a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d1400640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16dc0d0560 0x7f16dc09a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d1400640 1 -- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16dc06e900 msgr2=0x7f16dc099b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d1400640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16dc06e900 0x7f16dc099b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d1400640 1 -- 172.21.15.59:0/1143204180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16dc09d390 con 0x7f16dc0af720 2024-05-30T16:51:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d1400640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16dc0af720 0x7f16dc09a2c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f16c400e930 tx=0x7f16c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d2a00640 1 -- 172.21.15.59:0/1143204180 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4017070 con 0x7f16dc0af720 2024-05-30T16:51:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d2a00640 1 -- 172.21.15.59:0/1143204180 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16c400ca00 con 0x7f16dc0af720 2024-05-30T16:51:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d2a00640 1 -- 172.21.15.59:0/1143204180 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c400cdd0 con 0x7f16dc0af720 2024-05-30T16:51:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16e1000640 1 -- 172.21.15.59:0/1143204180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16dc09d670 con 0x7f16dc0af720 2024-05-30T16:51:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16e1000640 1 -- 172.21.15.59:0/1143204180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16dc09dc30 con 0x7f16dc0af720 2024-05-30T16:51:59.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16e1000640 1 -- 172.21.15.59:0/1143204180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16dc068a90 con 0x7f16dc0af720 2024-05-30T16:51:59.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d2a00640 1 -- 172.21.15.59:0/1143204180 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f16c401a070 con 0x7f16dc0af720 2024-05-30T16:51:59.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.753+0000 7f16d2a00640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f16b8068680 0x7f16b806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.757+0000 7f16d2a00640 1 -- 172.21.15.59:0/1143204180 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7f16c4086d80 con 0x7f16dc0af720 2024-05-30T16:51:59.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.757+0000 7f16d9e00640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f16b8068680 0x7f16b806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.757+0000 7f16d9e00640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f16b8068680 0x7f16b806ab40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f16cc007fd0 tx=0x7f16cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:59.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.757+0000 7f16d2a00640 1 -- 172.21.15.59:0/1143204180 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f16c40569e0 con 0x7f16dc0af720 2024-05-30T16:51:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.925+0000 7f16e1000640 1 -- 172.21.15.59:0/1143204180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16dc0cf510 con 0x7f16dc0af720 2024-05-30T16:51:59.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.925+0000 7f16d2a00640 1 -- 172.21.15.59:0/1143204180 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16765 (secure 0 0 0) 0x7f16c405ace0 con 0x7f16dc0af720 2024-05-30T16:51:59.930 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:51:59.930 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":35,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:51:57.110276+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:45.836560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:47.111349+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:51:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.929+0000 7f16e1000640 1 -- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f16b8068680 msgr2=0x7f16b806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.929+0000 7f16e1000640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f16b8068680 0x7f16b806ab40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f16cc007fd0 tx=0x7f16cc009040 comp rx=0 tx=0).stop 2024-05-30T16:51:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.929+0000 7f16e1000640 1 -- 172.21.15.59:0/1143204180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16dc0af720 msgr2=0x7f16dc09a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.929+0000 7f16e1000640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16dc0af720 0x7f16dc09a2c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f16c400e930 tx=0x7f16c400edf0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.929+0000 7f16e1000640 1 -- 172.21.15.59:0/1143204180 shutdown_connections 2024-05-30T16:51:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.929+0000 7f16e1000640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f16b8068680 0x7f16b806ab40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.929+0000 7f16e1000640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16dc0d0560 0x7f16dc09a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.929+0000 7f16e1000640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16dc0af720 0x7f16dc09a2c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.929+0000 7f16e1000640 1 --2- 172.21.15.59:0/1143204180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16dc06e900 0x7f16dc099b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.929+0000 7f16e1000640 1 -- 172.21.15.59:0/1143204180 >> 172.21.15.59:0/1143204180 conn(0x7f16dc0b22d0 msgr2=0x7f16dc0b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:59.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.929+0000 7f16e1000640 1 -- 172.21.15.59:0/1143204180 shutdown_connections 2024-05-30T16:51:59.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:51:59.929+0000 7f16e1000640 1 -- 172.21.15.59:0/1143204180 wait complete. 2024-05-30T16:51:59.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T16:52:00.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.089+0000 7feadfa00640 1 Processor -- start 2024-05-30T16:52:00.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.089+0000 7feadfa00640 1 -- start start 2024-05-30T16:52:00.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feadfa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fead8160d90 0x7fead809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:00.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feadfa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fead809b780 0x7fead809af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:00.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feadfa00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead80d1310 con 0x7fead80711e0 2024-05-30T16:52:00.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feadfa00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fead80ced30 con 0x7fead8160d90 2024-05-30T16:52:00.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feadfa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fead809bcf0 con 0x7fead809b780 2024-05-30T16:52:00.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feadda00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fead80711e0 0x7fead806ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36220/0 (socket says 172.21.15.59:36220) 2024-05-30T16:52:00.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feadda00640 1 -- 172.21.15.59:0/3175042308 learned_addr learned my addr 172.21.15.59:0/3175042308 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:00.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feacfe00640 1 --2- 172.21.15.59:0/3175042308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fead809b780 0x7fead809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:00.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feadd000640 1 --2- 172.21.15.59:0/3175042308 >> v2:172.21.15.107:3300/0 conn(0x7fead8160d90 0x7fead809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:00.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7fead7e00640 1 -- 172.21.15.59:0/3175042308 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4143408489 0 0) 0x7fead80d1310 con 0x7fead80711e0 2024-05-30T16:52:00.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7fead7e00640 1 -- 172.21.15.59:0/3175042308 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feabc003530 con 0x7fead80711e0 2024-05-30T16:52:00.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feacfe00640 1 -- 172.21.15.59:0/3175042308 >> v2:172.21.15.107:3300/0 conn(0x7fead8160d90 msgr2=0x7fead809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:00.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feacfe00640 1 --2- 172.21.15.59:0/3175042308 >> v2:172.21.15.107:3300/0 conn(0x7fead8160d90 0x7fead809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feacfe00640 1 -- 172.21.15.59:0/3175042308 >> v1:172.21.15.59:6789/0 conn(0x7fead80711e0 legacy=0x7fead806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:00.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feacfe00640 1 -- 172.21.15.59:0/3175042308 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead80d0a70 con 0x7fead809b780 2024-05-30T16:52:00.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.093+0000 7feadd000640 1 --2- 172.21.15.59:0/3175042308 >> v2:172.21.15.107:3300/0 conn(0x7fead8160d90 0x7fead809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:00.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7feacfe00640 1 --2- 172.21.15.59:0/3175042308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fead809b780 0x7fead809af80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feac00097c0 tx=0x7feac001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b63604274fc03203 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:00.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7fead7e00640 1 -- 172.21.15.59:0/3175042308 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac00b0070 con 0x7fead809b780 2024-05-30T16:52:00.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7fead7e00640 1 -- 172.21.15.59:0/3175042308 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac00ab600 con 0x7fead809b780 2024-05-30T16:52:00.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7fead7e00640 1 -- 172.21.15.59:0/3175042308 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac00ab9d0 con 0x7fead809b780 2024-05-30T16:52:00.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7feadfa00640 1 -- 172.21.15.59:0/3175042308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fead809b780 msgr2=0x7fead809af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:00.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7feadfa00640 1 --2- 172.21.15.59:0/3175042308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fead809b780 0x7fead809af80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feac00097c0 tx=0x7feac001c410 comp rx=0 tx=0).stop 2024-05-30T16:52:00.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7feadfa00640 1 -- 172.21.15.59:0/3175042308 shutdown_connections 2024-05-30T16:52:00.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7feadfa00640 1 --2- 172.21.15.59:0/3175042308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fead809b780 0x7fead809af80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7feadfa00640 1 --2- 172.21.15.59:0/3175042308 >> v2:172.21.15.107:3300/0 conn(0x7fead8160d90 0x7fead809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7feadfa00640 1 -- 172.21.15.59:0/3175042308 >> 172.21.15.59:0/3175042308 conn(0x7fead80b3f80 msgr2=0x7fead80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:00.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7feadfa00640 1 -- 172.21.15.59:0/3175042308 shutdown_connections 2024-05-30T16:52:00.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7feadfa00640 1 -- 172.21.15.59:0/3175042308 wait complete. 2024-05-30T16:52:00.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7feadfa00640 1 Processor -- start 2024-05-30T16:52:00.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.097+0000 7feadfa00640 1 -- start start 2024-05-30T16:52:00.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadfa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fead80711e0 0x7fead80c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:00.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadfa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fead809b780 0x7fead80cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:00.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadfa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fead8160d90 0x7fead81f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:00.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadfa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fead8071fe0 con 0x7fead80711e0 2024-05-30T16:52:00.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadfa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fead8071e60 con 0x7fead809b780 2024-05-30T16:52:00.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadfa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fead8161170 con 0x7fead8160d90 2024-05-30T16:52:00.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadd000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fead80711e0 0x7fead80c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:00.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadd000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fead80711e0 0x7fead80c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33768/0 (socket says 172.21.15.59:33768) 2024-05-30T16:52:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadd000640 1 -- 172.21.15.59:0/1782335558 learned_addr learned my addr 172.21.15.59:0/1782335558 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feacfe00640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fead809b780 0x7fead80cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadda00640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fead8160d90 0x7fead81f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadd000640 1 -- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fead8160d90 msgr2=0x7fead81f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadd000640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fead8160d90 0x7fead81f7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadd000640 1 -- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fead809b780 msgr2=0x7fead80cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadd000640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fead809b780 0x7fead80cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadd000640 1 -- 172.21.15.59:0/1782335558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead806d450 con 0x7fead80711e0 2024-05-30T16:52:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadd000640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fead80711e0 0x7fead80c8cb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feac800ebe0 tx=0x7feac800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7fead5600640 1 -- 172.21.15.59:0/1782335558 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8017070 con 0x7fead80711e0 2024-05-30T16:52:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7fead5600640 1 -- 172.21.15.59:0/1782335558 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac800cc30 con 0x7fead80711e0 2024-05-30T16:52:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7fead5600640 1 -- 172.21.15.59:0/1782335558 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8013470 con 0x7fead80711e0 2024-05-30T16:52:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadfa00640 1 -- 172.21.15.59:0/1782335558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead806d730 con 0x7fead80711e0 2024-05-30T16:52:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadfa00640 1 -- 172.21.15.59:0/1782335558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead806dcf0 con 0x7fead80711e0 2024-05-30T16:52:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.101+0000 7feadfa00640 1 -- 172.21.15.59:0/1782335558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead8068a90 con 0x7fead80711e0 2024-05-30T16:52:00.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.105+0000 7fead5600640 1 -- 172.21.15.59:0/1782335558 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7feac801a070 con 0x7fead80711e0 2024-05-30T16:52:00.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.105+0000 7fead5600640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feab4068650 0x7feab406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:00.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.105+0000 7fead5600640 1 -- 172.21.15.59:0/1782335558 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7feac80870f0 con 0x7fead80711e0 2024-05-30T16:52:00.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.105+0000 7feacfe00640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feab4068650 0x7feab406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:00.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.105+0000 7feacfe00640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feab4068650 0x7feab406ab10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feac00ad000 tx=0x7feac0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:00.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.109+0000 7fead5600640 1 -- 172.21.15.59:0/1782335558 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feac8056c90 con 0x7fead80711e0 2024-05-30T16:52:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.313+0000 7feadfa00640 1 -- 172.21.15.59:0/1782335558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fead80b4be0 con 0x7fead80711e0 2024-05-30T16:52:00.313 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-05-30T16:52:00.313+0000 7f2f74c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T16:52:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.313+0000 7fead5600640 1 -- 172.21.15.59:0/1782335558 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7feac805af90 con 0x7fead80711e0 2024-05-30T16:52:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T16:52:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.317+0000 7feadfa00640 1 -- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feab4068650 msgr2=0x7feab406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.317+0000 7feadfa00640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feab4068650 0x7feab406ab10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feac00ad000 tx=0x7feac0008040 comp rx=0 tx=0).stop 2024-05-30T16:52:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.317+0000 7feadfa00640 1 -- 172.21.15.59:0/1782335558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fead80711e0 msgr2=0x7fead80c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.317+0000 7feadfa00640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fead80711e0 0x7fead80c8cb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feac800ebe0 tx=0x7feac800c520 comp rx=0 tx=0).stop 2024-05-30T16:52:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.317+0000 7feadfa00640 1 -- 172.21.15.59:0/1782335558 shutdown_connections 2024-05-30T16:52:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.317+0000 7feadfa00640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feab4068650 0x7feab406ab10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.317+0000 7feadfa00640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fead8160d90 0x7fead81f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.317+0000 7feadfa00640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fead809b780 0x7fead80cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.317+0000 7feadfa00640 1 --2- 172.21.15.59:0/1782335558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fead80711e0 0x7fead80c8cb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.317+0000 7feadfa00640 1 -- 172.21.15.59:0/1782335558 >> 172.21.15.59:0/1782335558 conn(0x7fead80b3f80 msgr2=0x7fead80b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.321+0000 7feadfa00640 1 -- 172.21.15.59:0/1782335558 shutdown_connections 2024-05-30T16:52:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.321+0000 7feadfa00640 1 -- 172.21.15.59:0/1782335558 wait complete. 2024-05-30T16:52:00.343 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T16:52:00.386 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T16:52:00.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.485+0000 7f81c2800640 1 Processor -- start 2024-05-30T16:52:00.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.485+0000 7f81c2800640 1 -- start start 2024-05-30T16:52:00.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81c2800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81bc0b44e0 0x7f81bc15efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81c2800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81bc15f510 0x7f81bc15c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81c2800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81bc0b52d0 con 0x7f81bc159100 2024-05-30T16:52:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81c2800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f81bc0b4a30 con 0x7f81bc15f510 2024-05-30T16:52:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81c2800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f81bc0b4d10 con 0x7f81bc0b44e0 2024-05-30T16:52:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81bbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81bc15f510 0x7f81bc15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81bbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81bc15f510 0x7f81bc15c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33806/0 (socket says 172.21.15.59:33806) 2024-05-30T16:52:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81bbe00640 1 -- 172.21.15.59:0/174049447 learned_addr learned my addr 172.21.15.59:0/174049447 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81b2a00640 1 --2- 172.21.15.59:0/174049447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81bc0b44e0 0x7f81bc15efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:00.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81bbe00640 1 -- 172.21.15.59:0/174049447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81bc0b44e0 msgr2=0x7f81bc15efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:00.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81bbe00640 1 --2- 172.21.15.59:0/174049447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81bc0b44e0 0x7f81bc15efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81bbe00640 1 -- 172.21.15.59:0/174049447 >> v1:172.21.15.107:6789/0 conn(0x7f81bc159100 legacy=0x7f81bc06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:00.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81bbe00640 1 -- 172.21.15.59:0/174049447 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc0b4ff0 con 0x7f81bc15f510 2024-05-30T16:52:00.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.489+0000 7f81baa00640 1 -- 172.21.15.59:0/174049447 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 854791010 0 0) 0x7f81bc0b52d0 con 0x7f81bc159100 2024-05-30T16:52:00.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81bbe00640 1 --2- 172.21.15.59:0/174049447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81bc15f510 0x7f81bc15c010 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009870 tx=0x7f81b401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb99a6a65aced8b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:00.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81baa00640 1 -- 172.21.15.59:0/174049447 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b40b0070 con 0x7f81bc15f510 2024-05-30T16:52:00.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81baa00640 1 -- 172.21.15.59:0/174049447 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b40ab600 con 0x7f81bc15f510 2024-05-30T16:52:00.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81baa00640 1 -- 172.21.15.59:0/174049447 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b40ab9d0 con 0x7f81bc15f510 2024-05-30T16:52:00.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 -- 172.21.15.59:0/174049447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81bc15f510 msgr2=0x7f81bc15c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:00.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 --2- 172.21.15.59:0/174049447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81bc15f510 0x7f81bc15c010 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009870 tx=0x7f81b401c410 comp rx=0 tx=0).stop 2024-05-30T16:52:00.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 -- 172.21.15.59:0/174049447 shutdown_connections 2024-05-30T16:52:00.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 --2- 172.21.15.59:0/174049447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81bc15f510 0x7f81bc15c010 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 --2- 172.21.15.59:0/174049447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81bc0b44e0 0x7f81bc15efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 -- 172.21.15.59:0/174049447 >> 172.21.15.59:0/174049447 conn(0x7f81bc06bdb0 msgr2=0x7f81bc06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:00.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 -- 172.21.15.59:0/174049447 shutdown_connections 2024-05-30T16:52:00.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 -- 172.21.15.59:0/174049447 wait complete. 2024-05-30T16:52:00.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 Processor -- start 2024-05-30T16:52:00.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 -- start start 2024-05-30T16:52:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81bc0b44e0 0x7f81bc1f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81bc159100 0x7f81bc1fa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81bc15f510 0x7f81bc1faf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1684d0 con 0x7f81bc0b44e0 2024-05-30T16:52:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc168350 con 0x7f81bc15f510 2024-05-30T16:52:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81c2800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f81bc168650 con 0x7f81bc159100 2024-05-30T16:52:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81bb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81bc0b44e0 0x7f81bc1f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81bb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81bc0b44e0 0x7f81bc1f6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33810/0 (socket says 172.21.15.59:33810) 2024-05-30T16:52:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81bb400640 1 -- 172.21.15.59:0/2882716151 learned_addr learned my addr 172.21.15.59:0/2882716151 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81bbe00640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81bc15f510 0x7f81bc1faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.493+0000 7f81b2a00640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81bc159100 0x7f81bc1fa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81bb400640 1 -- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81bc159100 msgr2=0x7f81bc1fa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81bb400640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81bc159100 0x7f81bc1fa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81bb400640 1 -- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81bc15f510 msgr2=0x7f81bc1faf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81bb400640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81bc15f510 0x7f81bc1faf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81bb400640 1 -- 172.21.15.59:0/2882716151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc0cf190 con 0x7f81bc0b44e0 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81bb400640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81bc0b44e0 0x7f81bc1f6bb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f81ac001570 tx=0x7f81ac00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81b3e00640 1 -- 172.21.15.59:0/2882716151 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac017070 con 0x7f81bc0b44e0 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81b3e00640 1 -- 172.21.15.59:0/2882716151 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ac003db0 con 0x7f81bc0b44e0 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81b3e00640 1 -- 172.21.15.59:0/2882716151 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac0052b0 con 0x7f81bc0b44e0 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81c2800640 1 -- 172.21.15.59:0/2882716151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc0cf470 con 0x7f81bc0b44e0 2024-05-30T16:52:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81c2800640 1 -- 172.21.15.59:0/2882716151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc0cfa30 con 0x7f81bc0b44e0 2024-05-30T16:52:00.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81c2800640 1 -- 172.21.15.59:0/2882716151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81bc068a90 con 0x7f81bc0b44e0 2024-05-30T16:52:00.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81b3e00640 1 -- 172.21.15.59:0/2882716151 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f81ac01a070 con 0x7f81bc0b44e0 2024-05-30T16:52:00.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81b3e00640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8198068650 0x7f819806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:00.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.497+0000 7f81b3e00640 1 -- 172.21.15.59:0/2882716151 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5823+0+0 (secure 0 0 0) 0x7f81ac086470 con 0x7f81bc0b44e0 2024-05-30T16:52:00.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.501+0000 7f81b2a00640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8198068650 0x7f819806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:00.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.501+0000 7f81b2a00640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8198068650 0x7f819806ab10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f81bc158110 tx=0x7f81a4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:00.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.505+0000 7f81b3e00640 1 -- 172.21.15.59:0/2882716151 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81ac056070 con 0x7f81bc0b44e0 2024-05-30T16:52:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:00.705+0000 7f81c2800640 1 -- 172.21.15.59:0/2882716151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f81bc06f560 con 0x7f81bc0b44e0 2024-05-30T16:52:01.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.317+0000 7f81b3e00640 1 -- 172.21.15.59:0/2882716151 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f81ac05a370 con 0x7f81bc0b44e0 2024-05-30T16:52:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.321+0000 7f81c2800640 1 -- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8198068650 msgr2=0x7f819806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.321+0000 7f81c2800640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8198068650 0x7f819806ab10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f81bc158110 tx=0x7f81a4009190 comp rx=0 tx=0).stop 2024-05-30T16:52:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.321+0000 7f81c2800640 1 -- 172.21.15.59:0/2882716151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81bc0b44e0 msgr2=0x7f81bc1f6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.321+0000 7f81c2800640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81bc0b44e0 0x7f81bc1f6bb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f81ac001570 tx=0x7f81ac00cd00 comp rx=0 tx=0).stop 2024-05-30T16:52:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.321+0000 7f81c2800640 1 -- 172.21.15.59:0/2882716151 shutdown_connections 2024-05-30T16:52:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.321+0000 7f81c2800640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8198068650 0x7f819806ab10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.321+0000 7f81c2800640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81bc15f510 0x7f81bc1faf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.321+0000 7f81c2800640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81bc159100 0x7f81bc1fa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.321+0000 7f81c2800640 1 --2- 172.21.15.59:0/2882716151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81bc0b44e0 0x7f81bc1f6bb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.321+0000 7f81c2800640 1 -- 172.21.15.59:0/2882716151 >> 172.21.15.59:0/2882716151 conn(0x7f81bc06bdb0 msgr2=0x7f81bc15f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.321+0000 7f81c2800640 1 -- 172.21.15.59:0/2882716151 shutdown_connections 2024-05-30T16:52:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.321+0000 7f81c2800640 1 -- 172.21.15.59:0/2882716151 wait complete. 2024-05-30T16:52:01.348 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T16:52:01.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.537+0000 7f1a6b800640 1 Processor -- start 2024-05-30T16:52:01.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.537+0000 7f1a6b800640 1 -- start start 2024-05-30T16:52:01.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.537+0000 7f1a6b800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a64161e20 0x7f1a6406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:01.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.537+0000 7f1a6b800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a640730e0 0x7f1a6406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:01.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.537+0000 7f1a6b800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a640b3d50 con 0x7f1a64162310 2024-05-30T16:52:01.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.537+0000 7f1a6b800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1a640b4030 con 0x7f1a64161e20 2024-05-30T16:52:01.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.537+0000 7f1a6b800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6406e7c0 con 0x7f1a640730e0 2024-05-30T16:52:01.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.537+0000 7f1a68e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a64161e20 0x7f1a6406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:01.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.537+0000 7f1a69800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1a64162310 0x7f1a641627a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36230/0 (socket says 172.21.15.59:36230) 2024-05-30T16:52:01.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.537+0000 7f1a69800640 1 -- 172.21.15.59:0/1849866505 learned_addr learned my addr 172.21.15.59:0/1849866505 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:01.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.537+0000 7f1a5be00640 1 --2- 172.21.15.59:0/1849866505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a640730e0 0x7f1a6406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:01.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.541+0000 7f1a68e00640 1 -- 172.21.15.59:0/1849866505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a640730e0 msgr2=0x7f1a6406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:01.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.541+0000 7f1a68e00640 1 --2- 172.21.15.59:0/1849866505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a640730e0 0x7f1a6406cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.541+0000 7f1a68e00640 1 -- 172.21.15.59:0/1849866505 >> v1:172.21.15.59:6789/0 conn(0x7f1a64162310 legacy=0x7f1a641627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:01.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.541+0000 7f1a68e00640 1 -- 172.21.15.59:0/1849866505 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6406eaa0 con 0x7f1a64161e20 2024-05-30T16:52:01.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.541+0000 7f1a68e00640 1 --2- 172.21.15.59:0/1849866505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a64161e20 0x7f1a6406c9c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1a540097c0 tx=0x7f1a5401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26aa5916590b8e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:01.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.541+0000 7f1a63e00640 1 -- 172.21.15.59:0/1849866505 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a540b5070 con 0x7f1a64161e20 2024-05-30T16:52:01.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.541+0000 7f1a63e00640 1 -- 172.21.15.59:0/1849866505 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a540a8990 con 0x7f1a64161e20 2024-05-30T16:52:01.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.541+0000 7f1a63e00640 1 -- 172.21.15.59:0/1849866505 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a540a8d60 con 0x7f1a64161e20 2024-05-30T16:52:01.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.541+0000 7f1a6b800640 1 -- 172.21.15.59:0/1849866505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a64161e20 msgr2=0x7f1a6406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:01.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.541+0000 7f1a6b800640 1 --2- 172.21.15.59:0/1849866505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a64161e20 0x7f1a6406c9c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1a540097c0 tx=0x7f1a5401ec90 comp rx=0 tx=0).stop 2024-05-30T16:52:01.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 -- 172.21.15.59:0/1849866505 shutdown_connections 2024-05-30T16:52:01.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 --2- 172.21.15.59:0/1849866505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a640730e0 0x7f1a6406cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 --2- 172.21.15.59:0/1849866505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a64161e20 0x7f1a6406c9c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 -- 172.21.15.59:0/1849866505 >> 172.21.15.59:0/1849866505 conn(0x7f1a640725c0 msgr2=0x7f1a640729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:01.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 -- 172.21.15.59:0/1849866505 shutdown_connections 2024-05-30T16:52:01.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 -- 172.21.15.59:0/1849866505 wait complete. 2024-05-30T16:52:01.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 Processor -- start 2024-05-30T16:52:01.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 -- start start 2024-05-30T16:52:01.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a640730e0 0x7f1a64160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:01.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a64161e20 0x7f1a64144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:01.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a64162310 0x7f1a640b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640d0820 con 0x7f1a64162310 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640b3a20 con 0x7f1a640730e0 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a6b800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a640cd0d0 con 0x7f1a64161e20 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a69800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a64162310 0x7f1a640b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a69800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a64162310 0x7f1a640b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33826/0 (socket says 172.21.15.59:33826) 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a69800640 1 -- 172.21.15.59:0/2612771424 learned_addr learned my addr 172.21.15.59:0/2612771424 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a5be00640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a64161e20 0x7f1a64144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a68e00640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a640730e0 0x7f1a64160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a69800640 1 -- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a64161e20 msgr2=0x7f1a64144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a69800640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a64161e20 0x7f1a64144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a69800640 1 -- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a640730e0 msgr2=0x7f1a64160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a69800640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a640730e0 0x7f1a64160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a69800640 1 -- 172.21.15.59:0/2612771424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a641456d0 con 0x7f1a64162310 2024-05-30T16:52:01.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.545+0000 7f1a69800640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a64162310 0x7f1a640b0000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00cab0 tx=0x7f1a5c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:01.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.549+0000 7f1a61600640 1 -- 172.21.15.59:0/2612771424 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c017070 con 0x7f1a64162310 2024-05-30T16:52:01.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.549+0000 7f1a61600640 1 -- 172.21.15.59:0/2612771424 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c00ac30 con 0x7f1a64162310 2024-05-30T16:52:01.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.549+0000 7f1a61600640 1 -- 172.21.15.59:0/2612771424 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c012400 con 0x7f1a64162310 2024-05-30T16:52:01.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.549+0000 7f1a6b800640 1 -- 172.21.15.59:0/2612771424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a641459b0 con 0x7f1a64162310 2024-05-30T16:52:01.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.549+0000 7f1a6b800640 1 -- 172.21.15.59:0/2612771424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a64146560 con 0x7f1a64162310 2024-05-30T16:52:01.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.549+0000 7f1a6b800640 1 -- 172.21.15.59:0/2612771424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a64146760 con 0x7f1a64162310 2024-05-30T16:52:01.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.549+0000 7f1a61600640 1 -- 172.21.15.59:0/2612771424 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f1a5c01a070 con 0x7f1a64162310 2024-05-30T16:52:01.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.549+0000 7f1a61600640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a40068650 0x7f1a4006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:01.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.549+0000 7f1a61600640 1 -- 172.21.15.59:0/2612771424 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5823+0+0 (secure 0 0 0) 0x7f1a5c086a10 con 0x7f1a64162310 2024-05-30T16:52:01.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.549+0000 7f1a68e00640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a40068650 0x7f1a4006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:01.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.553+0000 7f1a68e00640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a40068650 0x7f1a4006ab10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a540b2000 tx=0x7f1a54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.553+0000 7f1a61600640 1 -- 172.21.15.59:0/2612771424 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1a5c056610 con 0x7f1a64162310 2024-05-30T16:52:01.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:01.717+0000 7f1a6b800640 1 -- 172.21.15.59:0/2612771424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1a64146350 con 0x7f1a64162310 2024-05-30T16:52:02.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.321+0000 7f1a61600640 1 -- 172.21.15.59:0/2612771424 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) ==== 181+0+0 (secure 0 0 0) 0x7f1a5c05a910 con 0x7f1a64162310 2024-05-30T16:52:02.324 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-05-30T16:52:02.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.325+0000 7f1a6b800640 1 -- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a40068650 msgr2=0x7f1a4006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.325+0000 7f1a6b800640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a40068650 0x7f1a4006ab10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a540b2000 tx=0x7f1a54008040 comp rx=0 tx=0).stop 2024-05-30T16:52:02.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.325+0000 7f1a6b800640 1 -- 172.21.15.59:0/2612771424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a64162310 msgr2=0x7f1a640b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.325+0000 7f1a6b800640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a64162310 0x7f1a640b0000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00cab0 tx=0x7f1a5c00cf70 comp rx=0 tx=0).stop 2024-05-30T16:52:02.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.325+0000 7f1a6b800640 1 -- 172.21.15.59:0/2612771424 shutdown_connections 2024-05-30T16:52:02.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.325+0000 7f1a6b800640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a40068650 0x7f1a4006ab10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.325+0000 7f1a6b800640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a64162310 0x7f1a640b0000 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.325+0000 7f1a6b800640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a64161e20 0x7f1a64144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.325+0000 7f1a6b800640 1 --2- 172.21.15.59:0/2612771424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a640730e0 0x7f1a64160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.325+0000 7f1a6b800640 1 -- 172.21.15.59:0/2612771424 >> 172.21.15.59:0/2612771424 conn(0x7f1a640725c0 msgr2=0x7f1a640cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:02.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.325+0000 7f1a6b800640 1 -- 172.21.15.59:0/2612771424 shutdown_connections 2024-05-30T16:52:02.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.325+0000 7f1a6b800640 1 -- 172.21.15.59:0/2612771424 wait complete. 2024-05-30T16:52:02.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T16:52:02.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.497+0000 7fe228a00640 1 Processor -- start 2024-05-30T16:52:02.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.497+0000 7fe228a00640 1 -- start start 2024-05-30T16:52:02.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe228a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe22415b790 0x7fe2240adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:02.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe228a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2240723c0 0x7fe2240af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:02.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe228a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe224072870 con 0x7fe22415b3b0 2024-05-30T16:52:02.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe228a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe2240afaf0 con 0x7fe22415b790 2024-05-30T16:52:02.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe228a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe2240ae510 con 0x7fe2240723c0 2024-05-30T16:52:02.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe221e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe22415b3b0 0x7fe224071cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50232/0 (socket says 172.21.15.59:50232) 2024-05-30T16:52:02.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe221e00640 1 -- 172.21.15.59:0/3542712423 learned_addr learned my addr 172.21.15.59:0/3542712423 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe21be00640 1 --2- 172.21.15.59:0/3542712423 >> v2:172.21.15.107:3300/0 conn(0x7fe22415b790 0x7fe2240adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe222800640 1 --2- 172.21.15.59:0/3542712423 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2240723c0 0x7fe2240af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe221400640 1 -- 172.21.15.59:0/3542712423 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802552382 0 0) 0x7fe224072870 con 0x7fe22415b3b0 2024-05-30T16:52:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe221400640 1 -- 172.21.15.59:0/3542712423 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe208005740 con 0x7fe22415b3b0 2024-05-30T16:52:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe222800640 1 -- 172.21.15.59:0/3542712423 >> v2:172.21.15.107:3300/0 conn(0x7fe22415b790 msgr2=0x7fe2240adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe222800640 1 --2- 172.21.15.59:0/3542712423 >> v2:172.21.15.107:3300/0 conn(0x7fe22415b790 0x7fe2240adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe222800640 1 -- 172.21.15.59:0/3542712423 >> v1:172.21.15.59:6789/0 conn(0x7fe22415b3b0 legacy=0x7fe224071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe222800640 1 -- 172.21.15.59:0/3542712423 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2240ae7f0 con 0x7fe2240723c0 2024-05-30T16:52:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.501+0000 7fe21be00640 1 --2- 172.21.15.59:0/3542712423 >> v2:172.21.15.107:3300/0 conn(0x7fe22415b790 0x7fe2240adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:02.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe222800640 1 --2- 172.21.15.59:0/3542712423 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2240723c0 0x7fe2240af5b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009dc0 tx=0x7fe21c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=908ce32660f8bc72 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:02.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe221400640 1 -- 172.21.15.59:0/3542712423 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0b2070 con 0x7fe2240723c0 2024-05-30T16:52:02.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe221400640 1 -- 172.21.15.59:0/3542712423 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21c0a59e0 con 0x7fe2240723c0 2024-05-30T16:52:02.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe221400640 1 -- 172.21.15.59:0/3542712423 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0a5d90 con 0x7fe2240723c0 2024-05-30T16:52:02.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe228a00640 1 -- 172.21.15.59:0/3542712423 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2240723c0 msgr2=0x7fe2240af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe228a00640 1 --2- 172.21.15.59:0/3542712423 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2240723c0 0x7fe2240af5b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009dc0 tx=0x7fe21c01c920 comp rx=0 tx=0).stop 2024-05-30T16:52:02.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe228a00640 1 -- 172.21.15.59:0/3542712423 shutdown_connections 2024-05-30T16:52:02.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe228a00640 1 --2- 172.21.15.59:0/3542712423 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2240723c0 0x7fe2240af5b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe228a00640 1 --2- 172.21.15.59:0/3542712423 >> v2:172.21.15.107:3300/0 conn(0x7fe22415b790 0x7fe2240adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe228a00640 1 -- 172.21.15.59:0/3542712423 >> 172.21.15.59:0/3542712423 conn(0x7fe2240b1e60 msgr2=0x7fe2240b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:02.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe228a00640 1 -- 172.21.15.59:0/3542712423 shutdown_connections 2024-05-30T16:52:02.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe228a00640 1 -- 172.21.15.59:0/3542712423 wait complete. 2024-05-30T16:52:02.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe228a00640 1 Processor -- start 2024-05-30T16:52:02.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.505+0000 7fe228a00640 1 -- start start 2024-05-30T16:52:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe228a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2240723c0 0x7fe224099910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe228a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe22415b3b0 0x7fe22415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe228a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe22415b790 0x7fe22415d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe228a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2240cc7d0 con 0x7fe2240723c0 2024-05-30T16:52:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe228a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe2240cc650 con 0x7fe22415b3b0 2024-05-30T16:52:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe228a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe2240b3970 con 0x7fe22415b790 2024-05-30T16:52:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe221e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2240723c0 0x7fe224099910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe221e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2240723c0 0x7fe224099910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50108/0 (socket says 172.21.15.59:50108) 2024-05-30T16:52:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe221e00640 1 -- 172.21.15.59:0/1475412886 learned_addr learned my addr 172.21.15.59:0/1475412886 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe21be00640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe22415b3b0 0x7fe22415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe222800640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe22415b790 0x7fe22415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe221e00640 1 -- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe22415b790 msgr2=0x7fe22415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe221e00640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe22415b790 0x7fe22415d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe221e00640 1 -- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe22415b3b0 msgr2=0x7fe22415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe221e00640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe22415b3b0 0x7fe22415d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe221e00640 1 -- 172.21.15.59:0/1475412886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2241555c0 con 0x7fe2240723c0 2024-05-30T16:52:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe221e00640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2240723c0 0x7fe224099910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c450 tx=0x7fe21400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe21a000640 1 -- 172.21.15.59:0/1475412886 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214017070 con 0x7fe2240723c0 2024-05-30T16:52:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe21a000640 1 -- 172.21.15.59:0/1475412886 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe214005cf0 con 0x7fe2240723c0 2024-05-30T16:52:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe228a00640 1 -- 172.21.15.59:0/1475412886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe224154050 con 0x7fe2240723c0 2024-05-30T16:52:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe21a000640 1 -- 172.21.15.59:0/1475412886 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214007290 con 0x7fe2240723c0 2024-05-30T16:52:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe228a00640 1 -- 172.21.15.59:0/1475412886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe224154610 con 0x7fe2240723c0 2024-05-30T16:52:02.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.509+0000 7fe228a00640 1 -- 172.21.15.59:0/1475412886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe224153e80 con 0x7fe2240723c0 2024-05-30T16:52:02.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.513+0000 7fe21a000640 1 -- 172.21.15.59:0/1475412886 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fe21401a070 con 0x7fe2240723c0 2024-05-30T16:52:02.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.513+0000 7fe21a000640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe200068650 0x7fe20006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:02.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.513+0000 7fe21a000640 1 -- 172.21.15.59:0/1475412886 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5385+0+0 (secure 0 0 0) 0x7fe214085fa0 con 0x7fe2240723c0 2024-05-30T16:52:02.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.513+0000 7fe21be00640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe200068650 0x7fe20006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:02.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.513+0000 7fe21be00640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe200068650 0x7fe20006ab10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe22414e170 tx=0x7fe20c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:02.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.517+0000 7fe21a000640 1 -- 172.21.15.59:0/1475412886 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe214055d50 con 0x7fe2240723c0 2024-05-30T16:52:02.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:02.681+0000 7fe228a00640 1 -- 172.21.15.59:0/1475412886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe224148cd0 con 0x7fe2240723c0 2024-05-30T16:52:03.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.329+0000 7fe21a000640 1 -- 172.21.15.59:0/1475412886 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) ==== 169+0+0 (secure 0 0 0) 0x7fe224148cd0 con 0x7fe2240723c0 2024-05-30T16:52:03.330 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-05-30T16:52:03.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.333+0000 7fe228a00640 1 -- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe200068650 msgr2=0x7fe20006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.333+0000 7fe228a00640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe200068650 0x7fe20006ab10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe22414e170 tx=0x7fe20c009190 comp rx=0 tx=0).stop 2024-05-30T16:52:03.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.333+0000 7fe228a00640 1 -- 172.21.15.59:0/1475412886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2240723c0 msgr2=0x7fe224099910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.333+0000 7fe228a00640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2240723c0 0x7fe224099910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c450 tx=0x7fe21400c910 comp rx=0 tx=0).stop 2024-05-30T16:52:03.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.333+0000 7fe228a00640 1 -- 172.21.15.59:0/1475412886 shutdown_connections 2024-05-30T16:52:03.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.333+0000 7fe228a00640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe200068650 0x7fe20006ab10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.333+0000 7fe228a00640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe22415b790 0x7fe22415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.333+0000 7fe228a00640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe22415b3b0 0x7fe22415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.333+0000 7fe228a00640 1 --2- 172.21.15.59:0/1475412886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2240723c0 0x7fe224099910 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.333+0000 7fe228a00640 1 -- 172.21.15.59:0/1475412886 >> 172.21.15.59:0/1475412886 conn(0x7fe2240b1e60 msgr2=0x7fe22414e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:03.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.333+0000 7fe228a00640 1 -- 172.21.15.59:0/1475412886 shutdown_connections 2024-05-30T16:52:03.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.333+0000 7fe228a00640 1 -- 172.21.15.59:0/1475412886 wait complete. 2024-05-30T16:52:03.363 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T16:52:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.505+0000 7f8413c00640 1 Processor -- start 2024-05-30T16:52:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.505+0000 7f8413c00640 1 -- start start 2024-05-30T16:52:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8413c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f840c0b44e0 0x7f840c15efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8413c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f840c15f510 0x7f840c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8413c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f840c0b52d0 con 0x7f840c159100 2024-05-30T16:52:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8413c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f840c0b4a30 con 0x7f840c15f510 2024-05-30T16:52:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8413c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f840c0b4d10 con 0x7f840c0b44e0 2024-05-30T16:52:03.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8411c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f840c15f510 0x7f840c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8411200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f840c159100 0x7f840c06e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:60038/0 (socket says 172.21.15.59:60038) 2024-05-30T16:52:03.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8411200640 1 -- 172.21.15.59:0/335656724 learned_addr learned my addr 172.21.15.59:0/335656724 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:03.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8403e00640 1 --2- 172.21.15.59:0/335656724 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f840c0b44e0 0x7f840c15efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8411c00640 1 -- 172.21.15.59:0/335656724 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f840c0b44e0 msgr2=0x7f840c15efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:03.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8411c00640 1 --2- 172.21.15.59:0/335656724 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f840c0b44e0 0x7f840c15efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8411c00640 1 -- 172.21.15.59:0/335656724 >> v1:172.21.15.107:6789/0 conn(0x7f840c159100 legacy=0x7f840c06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f8411c00640 1 -- 172.21.15.59:0/335656724 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840c0b4ff0 con 0x7f840c15f510 2024-05-30T16:52:03.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.509+0000 7f840be00640 1 -- 172.21.15.59:0/335656724 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1334820328 0 0) 0x7f840c0b52d0 con 0x7f840c159100 2024-05-30T16:52:03.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f8411c00640 1 --2- 172.21.15.59:0/335656724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f840c15f510 0x7f840c15c010 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8404009d90 tx=0x7f840401c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9efc44c90c5433d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:03.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f840be00640 1 -- 172.21.15.59:0/335656724 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84040b2070 con 0x7f840c15f510 2024-05-30T16:52:03.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f840be00640 1 -- 172.21.15.59:0/335656724 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84040a57f0 con 0x7f840c15f510 2024-05-30T16:52:03.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f840be00640 1 -- 172.21.15.59:0/335656724 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84040a5bc0 con 0x7f840c15f510 2024-05-30T16:52:03.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f8413c00640 1 -- 172.21.15.59:0/335656724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f840c15f510 msgr2=0x7f840c15c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f8413c00640 1 --2- 172.21.15.59:0/335656724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f840c15f510 0x7f840c15c010 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8404009d90 tx=0x7f840401c820 comp rx=0 tx=0).stop 2024-05-30T16:52:03.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f8413c00640 1 -- 172.21.15.59:0/335656724 shutdown_connections 2024-05-30T16:52:03.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f8413c00640 1 --2- 172.21.15.59:0/335656724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f840c15f510 0x7f840c15c010 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f8413c00640 1 --2- 172.21.15.59:0/335656724 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f840c0b44e0 0x7f840c15efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f8413c00640 1 -- 172.21.15.59:0/335656724 >> 172.21.15.59:0/335656724 conn(0x7f840c06bdb0 msgr2=0x7f840c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:03.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f8413c00640 1 -- 172.21.15.59:0/335656724 shutdown_connections 2024-05-30T16:52:03.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f8413c00640 1 -- 172.21.15.59:0/335656724 wait complete. 2024-05-30T16:52:03.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f8413c00640 1 Processor -- start 2024-05-30T16:52:03.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.513+0000 7f8413c00640 1 -- start start 2024-05-30T16:52:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8413c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840c0b44e0 0x7f840c0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8413c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f840c159100 0x7f840c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8413c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f840c15f510 0x7f840c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8413c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f840c1664c0 con 0x7f840c0b44e0 2024-05-30T16:52:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8413c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f840c166340 con 0x7f840c159100 2024-05-30T16:52:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8413c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f840c166640 con 0x7f840c15f510 2024-05-30T16:52:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8411200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840c0b44e0 0x7f840c0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8411200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840c0b44e0 0x7f840c0cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50124/0 (socket says 172.21.15.59:50124) 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8411200640 1 -- 172.21.15.59:0/3331428775 learned_addr learned my addr 172.21.15.59:0/3331428775 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8403e00640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f840c159100 0x7f840c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8411c00640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f840c15f510 0x7f840c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8411200640 1 -- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f840c15f510 msgr2=0x7f840c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8411200640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f840c15f510 0x7f840c0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8411200640 1 -- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f840c159100 msgr2=0x7f840c153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8411200640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f840c159100 0x7f840c153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8411200640 1 -- 172.21.15.59:0/3331428775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840c167de0 con 0x7f840c0b44e0 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8403e00640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f840c159100 0x7f840c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8411200640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840c0b44e0 0x7f840c0cd6a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0011f0 tx=0x7f83fc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8409600640 1 -- 172.21.15.59:0/3331428775 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc018070 con 0x7f840c0b44e0 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8409600640 1 -- 172.21.15.59:0/3331428775 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83fc0074e0 con 0x7f840c0b44e0 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8409600640 1 -- 172.21.15.59:0/3331428775 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc004a10 con 0x7f840c0b44e0 2024-05-30T16:52:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8413c00640 1 -- 172.21.15.59:0/3331428775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f840c1680c0 con 0x7f840c0b44e0 2024-05-30T16:52:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8413c00640 1 -- 172.21.15.59:0/3331428775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f840c154f80 con 0x7f840c0b44e0 2024-05-30T16:52:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.517+0000 7f8413c00640 1 -- 172.21.15.59:0/3331428775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f840c068a90 con 0x7f840c0b44e0 2024-05-30T16:52:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.521+0000 7f8409600640 1 -- 172.21.15.59:0/3331428775 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f83fc01b070 con 0x7f840c0b44e0 2024-05-30T16:52:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.521+0000 7f8409600640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f83e8068650 0x7f83e806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.521+0000 7f8409600640 1 -- 172.21.15.59:0/3331428775 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4971+0+0 (secure 0 0 0) 0x7f83fc085e40 con 0x7f840c0b44e0 2024-05-30T16:52:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.521+0000 7f8403e00640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f83e8068650 0x7f83e806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.521+0000 7f8403e00640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f83e8068650 0x7f83e806ab10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f840c154880 tx=0x7f83f4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:03.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.525+0000 7f8409600640 1 -- 172.21.15.59:0/3331428775 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f83fc055d00 con 0x7f840c0b44e0 2024-05-30T16:52:03.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.689+0000 7f8413c00640 1 -- 172.21.15.59:0/3331428775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f840c15b390 con 0x7f840c0b44e0 2024-05-30T16:52:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.693+0000 7f8409600640 1 -- 172.21.15.59:0/3331428775 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f83fc05a000 con 0x7f840c0b44e0 2024-05-30T16:52:03.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.697+0000 7f8413c00640 1 -- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f83e8068650 msgr2=0x7f83e806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.697+0000 7f8413c00640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f83e8068650 0x7f83e806ab10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f840c154880 tx=0x7f83f4009190 comp rx=0 tx=0).stop 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.697+0000 7f8413c00640 1 -- 172.21.15.59:0/3331428775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840c0b44e0 msgr2=0x7f840c0cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.697+0000 7f8413c00640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840c0b44e0 0x7f840c0cd6a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0011f0 tx=0x7f83fc00c9b0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.697+0000 7f8413c00640 1 -- 172.21.15.59:0/3331428775 shutdown_connections 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.697+0000 7f8413c00640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f83e8068650 0x7f83e806ab10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.697+0000 7f8413c00640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f840c15f510 0x7f840c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.697+0000 7f8413c00640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f840c159100 0x7f840c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.697+0000 7f8413c00640 1 --2- 172.21.15.59:0/3331428775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840c0b44e0 0x7f840c0cd6a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.697+0000 7f8413c00640 1 -- 172.21.15.59:0/3331428775 >> 172.21.15.59:0/3331428775 conn(0x7f840c06bdb0 msgr2=0x7f840c15f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.697+0000 7f8413c00640 1 -- 172.21.15.59:0/3331428775 shutdown_connections 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.697+0000 7f8413c00640 1 -- 172.21.15.59:0/3331428775 wait complete. 2024-05-30T16:52:03.717 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone' 2024-05-30T16:52:03.771 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:52:03.774 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:52:03.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa622200640 1 Processor -- start 2024-05-30T16:52:03.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa622200640 1 -- start start 2024-05-30T16:52:03.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa622200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c159df0 0x7fa61c0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa622200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa61c0b3e50 0x7fa61c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa622200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa61c15d730 con 0x7fa61c15a1d0 2024-05-30T16:52:03.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa622200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa61c0b3370 con 0x7fa61c0b3e50 2024-05-30T16:52:03.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa622200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa61c0b3650 con 0x7fa61c159df0 2024-05-30T16:52:03.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa612a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa61c15a1d0 0x7fa61c15ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50242/0 (socket says 172.21.15.59:50242) 2024-05-30T16:52:03.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa612a00640 1 -- 172.21.15.59:0/4174874509 learned_addr learned my addr 172.21.15.59:0/4174874509 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:03.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa61b400640 1 --2- 172.21.15.59:0/4174874509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c159df0 0x7fa61c0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa61be00640 1 --2- 172.21.15.59:0/4174874509 >> v2:172.21.15.107:3300/0 conn(0x7fa61c0b3e50 0x7fa61c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa61aa00640 1 -- 172.21.15.59:0/4174874509 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315078691 0 0) 0x7fa61c15d730 con 0x7fa61c15a1d0 2024-05-30T16:52:03.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa61aa00640 1 -- 172.21.15.59:0/4174874509 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa600003530 con 0x7fa61c15a1d0 2024-05-30T16:52:03.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa61b400640 1 -- 172.21.15.59:0/4174874509 >> v2:172.21.15.107:3300/0 conn(0x7fa61c0b3e50 msgr2=0x7fa61c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:03.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa61b400640 1 --2- 172.21.15.59:0/4174874509 >> v2:172.21.15.107:3300/0 conn(0x7fa61c0b3e50 0x7fa61c0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa61b400640 1 -- 172.21.15.59:0/4174874509 >> v1:172.21.15.59:6789/0 conn(0x7fa61c15a1d0 legacy=0x7fa61c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.857+0000 7fa61b400640 1 -- 172.21.15.59:0/4174874509 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa61c0b3930 con 0x7fa61c159df0 2024-05-30T16:52:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.861+0000 7fa61b400640 1 --2- 172.21.15.59:0/4174874509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c159df0 0x7fa61c0ad1b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0097c0 tx=0x7fa60c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27a577a92210bdd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.861+0000 7fa61aa00640 1 -- 172.21.15.59:0/4174874509 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0b0070 con 0x7fa61c159df0 2024-05-30T16:52:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.861+0000 7fa61aa00640 1 -- 172.21.15.59:0/4174874509 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa60c0ab600 con 0x7fa61c159df0 2024-05-30T16:52:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.861+0000 7fa61aa00640 1 -- 172.21.15.59:0/4174874509 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0ab9d0 con 0x7fa61c159df0 2024-05-30T16:52:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.861+0000 7fa622200640 1 -- 172.21.15.59:0/4174874509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c159df0 msgr2=0x7fa61c0ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.861+0000 7fa622200640 1 --2- 172.21.15.59:0/4174874509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c159df0 0x7fa61c0ad1b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0097c0 tx=0x7fa60c01c4a0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.861+0000 7fa622200640 1 -- 172.21.15.59:0/4174874509 shutdown_connections 2024-05-30T16:52:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.861+0000 7fa622200640 1 --2- 172.21.15.59:0/4174874509 >> v2:172.21.15.107:3300/0 conn(0x7fa61c0b3e50 0x7fa61c0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.861+0000 7fa622200640 1 --2- 172.21.15.59:0/4174874509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c159df0 0x7fa61c0ad1b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.861+0000 7fa622200640 1 -- 172.21.15.59:0/4174874509 >> 172.21.15.59:0/4174874509 conn(0x7fa61c0b22d0 msgr2=0x7fa61c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:03.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.861+0000 7fa622200640 1 -- 172.21.15.59:0/4174874509 shutdown_connections 2024-05-30T16:52:03.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.861+0000 7fa622200640 1 -- 172.21.15.59:0/4174874509 wait complete. 2024-05-30T16:52:03.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa622200640 1 Processor -- start 2024-05-30T16:52:03.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa622200640 1 -- start start 2024-05-30T16:52:03.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa622200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa61c0b3e50 0x7fa61c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa622200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa61c159df0 0x7fa61c071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa622200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c15a1d0 0x7fa61c1f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa622200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa61c15e720 con 0x7fa61c159df0 2024-05-30T16:52:03.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa622200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa61c15e5a0 con 0x7fa61c0b3e50 2024-05-30T16:52:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa622200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa61c15e8a0 con 0x7fa61c15a1d0 2024-05-30T16:52:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa612a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa61c159df0 0x7fa61c071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa612a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa61c159df0 0x7fa61c071ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50140/0 (socket says 172.21.15.59:50140) 2024-05-30T16:52:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa612a00640 1 -- 172.21.15.59:0/2641319388 learned_addr learned my addr 172.21.15.59:0/2641319388 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa61b400640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa61c0b3e50 0x7fa61c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa61be00640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c15a1d0 0x7fa61c1f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa612a00640 1 -- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c15a1d0 msgr2=0x7fa61c1f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa612a00640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c15a1d0 0x7fa61c1f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa612a00640 1 -- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa61c0b3e50 msgr2=0x7fa61c06e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa612a00640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa61c0b3e50 0x7fa61c06e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa612a00640 1 -- 172.21.15.59:0/2641319388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa61c072430 con 0x7fa61c159df0 2024-05-30T16:52:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa61be00640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c15a1d0 0x7fa61c1f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa612a00640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa61c159df0 0x7fa61c071ef0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa60400c420 tx=0x7fa60400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa613e00640 1 -- 172.21.15.59:0/2641319388 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604017070 con 0x7fa61c159df0 2024-05-30T16:52:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa613e00640 1 -- 172.21.15.59:0/2641319388 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa604005d10 con 0x7fa61c159df0 2024-05-30T16:52:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa622200640 1 -- 172.21.15.59:0/2641319388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa61c1f6d60 con 0x7fa61c159df0 2024-05-30T16:52:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa613e00640 1 -- 172.21.15.59:0/2641319388 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604007310 con 0x7fa61c159df0 2024-05-30T16:52:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.865+0000 7fa622200640 1 -- 172.21.15.59:0/2641319388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa61c166ed0 con 0x7fa61c159df0 2024-05-30T16:52:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.869+0000 7fa622200640 1 -- 172.21.15.59:0/2641319388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa61c068a90 con 0x7fa61c159df0 2024-05-30T16:52:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.869+0000 7fa613e00640 1 -- 172.21.15.59:0/2641319388 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fa60401a070 con 0x7fa61c159df0 2024-05-30T16:52:03.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.869+0000 7fa613e00640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa5f8068650 0x7fa5f806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.869+0000 7fa613e00640 1 -- 172.21.15.59:0/2641319388 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4971+0+0 (secure 0 0 0) 0x7fa604085ed0 con 0x7fa61c159df0 2024-05-30T16:52:03.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.869+0000 7fa61b400640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa5f8068650 0x7fa5f806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.869+0000 7fa61b400640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa5f8068650 0x7fa5f806ab10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0ad000 tx=0x7fa60c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:03.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:03.873+0000 7fa613e00640 1 -- 172.21.15.59:0/2641319388 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa61c072430 con 0x7fa61c159df0 2024-05-30T16:52:04.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.097+0000 7fa622200640 1 -- 172.21.15.59:0/2641319388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]} v 0) -- 0x7fa61c0b4ef0 con 0x7fa61c159df0 2024-05-30T16:52:04.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.329+0000 7fa613e00640 1 -- 172.21.15.59:0/2641319388 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]}]=0 v150) ==== 160+0+0 (secure 0 0 0) 0x7fa604056530 con 0x7fa61c159df0 2024-05-30T16:52:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.333+0000 7fa622200640 1 -- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa5f8068650 msgr2=0x7fa5f806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.333+0000 7fa622200640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa5f8068650 0x7fa5f806ab10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0ad000 tx=0x7fa60c0a6000 comp rx=0 tx=0).stop 2024-05-30T16:52:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.333+0000 7fa622200640 1 -- 172.21.15.59:0/2641319388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa61c159df0 msgr2=0x7fa61c071ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.333+0000 7fa622200640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa61c159df0 0x7fa61c071ef0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa60400c420 tx=0x7fa60400c8e0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.333+0000 7fa622200640 1 -- 172.21.15.59:0/2641319388 shutdown_connections 2024-05-30T16:52:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.333+0000 7fa622200640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa5f8068650 0x7fa5f806ab10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.333+0000 7fa622200640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c15a1d0 0x7fa61c1f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.333+0000 7fa622200640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa61c159df0 0x7fa61c071ef0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.333+0000 7fa622200640 1 --2- 172.21.15.59:0/2641319388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa61c0b3e50 0x7fa61c06e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.333+0000 7fa622200640 1 -- 172.21.15.59:0/2641319388 >> 172.21.15.59:0/2641319388 conn(0x7fa61c0b22d0 msgr2=0x7fa61c0cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:04.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.333+0000 7fa622200640 1 -- 172.21.15.59:0/2641319388 shutdown_connections 2024-05-30T16:52:04.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.333+0000 7fa622200640 1 -- 172.21.15.59:0/2641319388 wait complete. 2024-05-30T16:52:04.354 INFO:tasks.cephfs_test_runner:Test that when one clone is in progress, one progress bar is printed ... ok 2024-05-30T16:52:04.354 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bars_for_4_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that one progress bar is printed when number of clone jobs is 2024-05-30T16:52:04.354 INFO:tasks.cephfs_test_runner:test_progress_bars_for_4_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:52:04.355 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:52:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f724aa00640 1 Processor -- start 2024-05-30T16:52:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f724aa00640 1 -- start start 2024-05-30T16:52:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f724aa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7244160d90 0x7f724409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f724aa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f724409b780 0x7f724409af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f724aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72440711e0 0x7f724406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f724aa00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f72440d1310 con 0x7f72440711e0 2024-05-30T16:52:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f724aa00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f724409bcf0 con 0x7f724409b780 2024-05-30T16:52:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f724aa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f72440d0a70 con 0x7f7244160d90 2024-05-30T16:52:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f7248a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72440711e0 0x7f724406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f7248a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72440711e0 0x7f724406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50148/0 (socket says 172.21.15.59:50148) 2024-05-30T16:52:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f7248a00640 1 -- 172.21.15.59:0/402346092 learned_addr learned my addr 172.21.15.59:0/402346092 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f7243e00640 1 --2- 172.21.15.59:0/402346092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7244160d90 0x7f724409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:04.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f723b400640 1 --2- 172.21.15.59:0/402346092 >> v2:172.21.15.107:3300/0 conn(0x7f724409b780 0x7f724409af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:04.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f7248a00640 1 -- 172.21.15.59:0/402346092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7244160d90 msgr2=0x7f724409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:04.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f7248a00640 1 --2- 172.21.15.59:0/402346092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7244160d90 0x7f724409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f7248a00640 1 -- 172.21.15.59:0/402346092 >> v2:172.21.15.107:3300/0 conn(0x7f724409b780 msgr2=0x7f724409af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:04.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f7248a00640 1 --2- 172.21.15.59:0/402346092 >> v2:172.21.15.107:3300/0 conn(0x7f724409b780 0x7f724409af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.537+0000 7f7248a00640 1 -- 172.21.15.59:0/402346092 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72440d0d50 con 0x7f72440711e0 2024-05-30T16:52:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f7248a00640 1 --2- 172.21.15.59:0/402346092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72440711e0 0x7f724406ff40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7244072e30 tx=0x7f723c01c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7605c736929e3a8f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f7243400640 1 -- 172.21.15.59:0/402346092 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c0b0070 con 0x7f72440711e0 2024-05-30T16:52:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f7243400640 1 -- 172.21.15.59:0/402346092 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f723c0ab600 con 0x7f72440711e0 2024-05-30T16:52:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f7243400640 1 -- 172.21.15.59:0/402346092 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c0ab9d0 con 0x7f72440711e0 2024-05-30T16:52:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f724aa00640 1 -- 172.21.15.59:0/402346092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72440711e0 msgr2=0x7f724406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f724aa00640 1 --2- 172.21.15.59:0/402346092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72440711e0 0x7f724406ff40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7244072e30 tx=0x7f723c01c1d0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f724aa00640 1 -- 172.21.15.59:0/402346092 shutdown_connections 2024-05-30T16:52:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f724aa00640 1 --2- 172.21.15.59:0/402346092 >> v2:172.21.15.107:3300/0 conn(0x7f724409b780 0x7f724409af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f724aa00640 1 --2- 172.21.15.59:0/402346092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72440711e0 0x7f724406ff40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f724aa00640 1 --2- 172.21.15.59:0/402346092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7244160d90 0x7f724409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f724aa00640 1 -- 172.21.15.59:0/402346092 >> 172.21.15.59:0/402346092 conn(0x7f72440b3f80 msgr2=0x7f72440b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f724aa00640 1 -- 172.21.15.59:0/402346092 shutdown_connections 2024-05-30T16:52:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.541+0000 7f724aa00640 1 -- 172.21.15.59:0/402346092 wait complete. 2024-05-30T16:52:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f724aa00640 1 Processor -- start 2024-05-30T16:52:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f724aa00640 1 -- start start 2024-05-30T16:52:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f724aa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72440711e0 0x7f7244159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f724aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f724409b780 0x7f7244154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f724aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7244160d90 0x7f7244156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f724aa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f72441612f0 con 0x7f7244160d90 2024-05-30T16:52:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f724aa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7244161170 con 0x7f724409b780 2024-05-30T16:52:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f724aa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f72440cdd20 con 0x7f72440711e0 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f7248a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7244160d90 0x7f7244156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f7248a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7244160d90 0x7f7244156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50160/0 (socket says 172.21.15.59:50160) 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f7248a00640 1 -- 172.21.15.59:0/4278750352 learned_addr learned my addr 172.21.15.59:0/4278750352 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f7248a00640 1 -- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72440711e0 msgr2=0x7f7244159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f7248a00640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72440711e0 0x7f7244159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f7248a00640 1 -- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f724409b780 msgr2=0x7f7244154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f723b400640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f724409b780 0x7f7244154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f7248a00640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f724409b780 0x7f7244154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f7248a00640 1 -- 172.21.15.59:0/4278750352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7244155210 con 0x7f7244160d90 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f723b400640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f724409b780 0x7f7244154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f7248a00640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7244160d90 0x7f7244156280 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f723c0ae040 tx=0x7f723c018f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f7240c00640 1 -- 172.21.15.59:0/4278750352 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c0b0040 con 0x7f7244160d90 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f7240c00640 1 -- 172.21.15.59:0/4278750352 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f723c0b9070 con 0x7f7244160d90 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f7240c00640 1 -- 172.21.15.59:0/4278750352 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c0b4440 con 0x7f7244160d90 2024-05-30T16:52:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f724aa00640 1 -- 172.21.15.59:0/4278750352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724415ab10 con 0x7f7244160d90 2024-05-30T16:52:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f724aa00640 1 -- 172.21.15.59:0/4278750352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724415a550 con 0x7f7244160d90 2024-05-30T16:52:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.545+0000 7f724aa00640 1 -- 172.21.15.59:0/4278750352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7244068a90 con 0x7f7244160d90 2024-05-30T16:52:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.549+0000 7f7240c00640 1 -- 172.21.15.59:0/4278750352 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f723c0b45e0 con 0x7f7244160d90 2024-05-30T16:52:04.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.549+0000 7f7240c00640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7220068650 0x7f722006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.549+0000 7f7240c00640 1 -- 172.21.15.59:0/4278750352 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4971+0+0 (secure 0 0 0) 0x7f723c1207f0 con 0x7f7244160d90 2024-05-30T16:52:04.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.549+0000 7f7243e00640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7220068650 0x7f722006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.549+0000 7f7243e00640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7220068650 0x7f722006ab10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7234006aa0 tx=0x7f7234006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.553+0000 7f7240c00640 1 -- 172.21.15.59:0/4278750352 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f723c016110 con 0x7f7244160d90 2024-05-30T16:52:04.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.717+0000 7f724aa00640 1 -- 172.21.15.59:0/4278750352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72441567c0 con 0x7f7244160d90 2024-05-30T16:52:04.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.717+0000 7f7240c00640 1 -- 172.21.15.59:0/4278750352 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+13051 (secure 0 0 0) 0x7f723c0f0c80 con 0x7f7244160d90 2024-05-30T16:52:04.719 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:04.719 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":38,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:52:03.325808+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/3713717108":"2024-05-31T16:52:00.314630+0000","172.21.15.59:6833/3713717108":"2024-05-31T16:52:00.314630+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:52:04.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.717+0000 7f724aa00640 1 -- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7220068650 msgr2=0x7f722006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:04.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.717+0000 7f724aa00640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7220068650 0x7f722006ab10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7234006aa0 tx=0x7f7234006a30 comp rx=0 tx=0).stop 2024-05-30T16:52:04.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.717+0000 7f724aa00640 1 -- 172.21.15.59:0/4278750352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7244160d90 msgr2=0x7f7244156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:04.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.717+0000 7f724aa00640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7244160d90 0x7f7244156280 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f723c0ae040 tx=0x7f723c018f70 comp rx=0 tx=0).stop 2024-05-30T16:52:04.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.721+0000 7f724aa00640 1 -- 172.21.15.59:0/4278750352 shutdown_connections 2024-05-30T16:52:04.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.721+0000 7f724aa00640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7220068650 0x7f722006ab10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.721+0000 7f724aa00640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7244160d90 0x7f7244156280 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.721+0000 7f724aa00640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f724409b780 0x7f7244154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.721+0000 7f724aa00640 1 --2- 172.21.15.59:0/4278750352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72440711e0 0x7f7244159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.721+0000 7f724aa00640 1 -- 172.21.15.59:0/4278750352 >> 172.21.15.59:0/4278750352 conn(0x7f72440b3f80 msgr2=0x7f72440b3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:04.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.721+0000 7f724aa00640 1 -- 172.21.15.59:0/4278750352 shutdown_connections 2024-05-30T16:52:04.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.721+0000 7f724aa00640 1 -- 172.21.15.59:0/4278750352 wait complete. 2024-05-30T16:52:04.740 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T16:48:53.098546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T16:52:04.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T16:52:04.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.881+0000 7ff80f400640 1 Processor -- start 2024-05-30T16:52:04.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.881+0000 7ff80f400640 1 -- start start 2024-05-30T16:52:04.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff80f400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff8080ad2b0 0x7ff80815d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff80f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8080d0660 0x7ff8080d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff80f400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8080ad770 con 0x7ff8081569e0 2024-05-30T16:52:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff80f400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff8080d1010 con 0x7ff8080ad2b0 2024-05-30T16:52:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff80f400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff80815cb40 con 0x7ff8080d0660 2024-05-30T16:52:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff80d400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8080d0660 0x7ff8080d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:04.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff7ffe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff8080ad2b0 0x7ff80815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:04.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff80ca00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff8081569e0 0x7ff8080cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:60048/0 (socket says 172.21.15.59:60048) 2024-05-30T16:52:04.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff80ca00640 1 -- 172.21.15.59:0/641686769 learned_addr learned my addr 172.21.15.59:0/641686769 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:04.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff80d400640 1 -- 172.21.15.59:0/641686769 >> v2:172.21.15.107:3300/0 conn(0x7ff8080ad2b0 msgr2=0x7ff80815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:04.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff80d400640 1 --2- 172.21.15.59:0/641686769 >> v2:172.21.15.107:3300/0 conn(0x7ff8080ad2b0 0x7ff80815d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff80d400640 1 -- 172.21.15.59:0/641686769 >> v1:172.21.15.107:6789/0 conn(0x7ff8081569e0 legacy=0x7ff8080cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:04.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff80d400640 1 -- 172.21.15.59:0/641686769 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80815ce20 con 0x7ff8080d0660 2024-05-30T16:52:04.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.885+0000 7ff7ffe00640 1 --2- 172.21.15.59:0/641686769 >> v2:172.21.15.107:3300/0 conn(0x7ff8080ad2b0 0x7ff80815d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:04.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff80d400640 1 --2- 172.21.15.59:0/641686769 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8080d0660 0x7ff8080d0ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff800009d90 tx=0x7ff80001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f47433c8a01a5e57 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:04.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff807e00640 1 -- 172.21.15.59:0/641686769 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8000b2070 con 0x7ff8080d0660 2024-05-30T16:52:04.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff807e00640 1 -- 172.21.15.59:0/641686769 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8000a5820 con 0x7ff8080d0660 2024-05-30T16:52:04.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff807e00640 1 -- 172.21.15.59:0/641686769 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8000a5bf0 con 0x7ff8080d0660 2024-05-30T16:52:04.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff80f400640 1 -- 172.21.15.59:0/641686769 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8080d0660 msgr2=0x7ff8080d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:04.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff80f400640 1 --2- 172.21.15.59:0/641686769 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8080d0660 0x7ff8080d0ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff800009d90 tx=0x7ff80001c8e0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff80f400640 1 -- 172.21.15.59:0/641686769 shutdown_connections 2024-05-30T16:52:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff80f400640 1 --2- 172.21.15.59:0/641686769 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8080d0660 0x7ff8080d0ad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff80f400640 1 --2- 172.21.15.59:0/641686769 >> v2:172.21.15.107:3300/0 conn(0x7ff8080ad2b0 0x7ff80815d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff80f400640 1 -- 172.21.15.59:0/641686769 >> 172.21.15.59:0/641686769 conn(0x7ff80806bdb0 msgr2=0x7ff80806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff80f400640 1 -- 172.21.15.59:0/641686769 shutdown_connections 2024-05-30T16:52:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff80f400640 1 -- 172.21.15.59:0/641686769 wait complete. 2024-05-30T16:52:04.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff80f400640 1 Processor -- start 2024-05-30T16:52:04.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.889+0000 7ff80f400640 1 -- start start 2024-05-30T16:52:04.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8080ad2b0 0x7ff8080afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8080d0660 0x7ff808099b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8081569e0 0x7ff80815b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80f400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff8080b3c60 con 0x7ff8081569e0 2024-05-30T16:52:04.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80f400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff8080b3ae0 con 0x7ff8080d0660 2024-05-30T16:52:04.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80f400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff8080b3de0 con 0x7ff8080ad2b0 2024-05-30T16:52:04.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8081569e0 0x7ff80815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:04.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8081569e0 0x7ff80815b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50162/0 (socket says 172.21.15.59:50162) 2024-05-30T16:52:04.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff7ffe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8080d0660 0x7ff808099b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:04.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80ca00640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8080ad2b0 0x7ff8080afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:04.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80d400640 1 -- 172.21.15.59:0/1179607636 learned_addr learned my addr 172.21.15.59:0/1179607636 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:04.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80d400640 1 -- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8080ad2b0 msgr2=0x7ff8080afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:04.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80d400640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8080ad2b0 0x7ff8080afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80d400640 1 -- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8080d0660 msgr2=0x7ff808099b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:04.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80d400640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8080d0660 0x7ff808099b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:04.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80d400640 1 -- 172.21.15.59:0/1179607636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8080b0d00 con 0x7ff8081569e0 2024-05-30T16:52:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80d400640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8081569e0 0x7ff80815b470 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff80001af90 tx=0x7ff800019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff805600640 1 -- 172.21.15.59:0/1179607636 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8000b2050 con 0x7ff8081569e0 2024-05-30T16:52:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff805600640 1 -- 172.21.15.59:0/1179607636 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8000be070 con 0x7ff8081569e0 2024-05-30T16:52:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff805600640 1 -- 172.21.15.59:0/1179607636 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8000ad850 con 0x7ff8081569e0 2024-05-30T16:52:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80f400640 1 -- 172.21.15.59:0/1179607636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8080b0fe0 con 0x7ff8081569e0 2024-05-30T16:52:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80f400640 1 -- 172.21.15.59:0/1179607636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8080b0940 con 0x7ff8081569e0 2024-05-30T16:52:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff80f400640 1 -- 172.21.15.59:0/1179607636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff808068a90 con 0x7ff8081569e0 2024-05-30T16:52:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.893+0000 7ff805600640 1 -- 172.21.15.59:0/1179607636 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7ff8000ad9f0 con 0x7ff8081569e0 2024-05-30T16:52:04.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.897+0000 7ff805600640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff7e4068650 0x7ff7e406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:04.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.897+0000 7ff805600640 1 -- 172.21.15.59:0/1179607636 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4971+0+0 (secure 0 0 0) 0x7ff800121ba0 con 0x7ff8081569e0 2024-05-30T16:52:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.897+0000 7ff80ca00640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff7e4068650 0x7ff7e406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:04.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.897+0000 7ff80ca00640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff7e4068650 0x7ff7e406ab10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8000f70 tx=0x7ff7f8007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:04.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:04.901+0000 7ff805600640 1 -- 172.21.15.59:0/1179607636 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff800016560 con 0x7ff8081569e0 2024-05-30T16:52:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 -- 172.21.15.59:0/1179607636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff8080b1490 con 0x7ff8081569e0 2024-05-30T16:52:05.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff805600640 1 -- 172.21.15.59:0/1179607636 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) ==== 93+0+10 (secure 0 0 0) 0x7ff8000f1b80 con 0x7ff8081569e0 2024-05-30T16:52:05.066 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-05-30T16:52:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 -- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff7e4068650 msgr2=0x7ff7e406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff7e4068650 0x7ff7e406ab10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8000f70 tx=0x7ff7f8007e90 comp rx=0 tx=0).stop 2024-05-30T16:52:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 -- 172.21.15.59:0/1179607636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8081569e0 msgr2=0x7ff80815b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8081569e0 0x7ff80815b470 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff80001af90 tx=0x7ff800019680 comp rx=0 tx=0).stop 2024-05-30T16:52:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 -- 172.21.15.59:0/1179607636 shutdown_connections 2024-05-30T16:52:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff7e4068650 0x7ff7e406ab10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8081569e0 0x7ff80815b470 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8080d0660 0x7ff808099b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 --2- 172.21.15.59:0/1179607636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8080ad2b0 0x7ff8080afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 -- 172.21.15.59:0/1179607636 >> 172.21.15.59:0/1179607636 conn(0x7ff80806bdb0 msgr2=0x7ff80814fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 -- 172.21.15.59:0/1179607636 shutdown_connections 2024-05-30T16:52:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.065+0000 7ff80f400640 1 -- 172.21.15.59:0/1179607636 wait complete. 2024-05-30T16:52:05.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones' 2024-05-30T16:52:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.225+0000 7fb6dd800640 1 Processor -- start 2024-05-30T16:52:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6dd800640 1 -- start start 2024-05-30T16:52:05.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6dd800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb6d80af720 0x7fb6d815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:05.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6dd800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d806e900 0x7fb6d815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:05.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6dd800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d815f060 con 0x7fb6d80d0560 2024-05-30T16:52:05.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6dd800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d80afb00 con 0x7fb6d80af720 2024-05-30T16:52:05.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6dd800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d815c270 con 0x7fb6d806e900 2024-05-30T16:52:05.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6d7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb6d80d0560 0x7fb6d8072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50258/0 (socket says 172.21.15.59:50258) 2024-05-30T16:52:05.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6d7400640 1 -- 172.21.15.59:0/2936279189 learned_addr learned my addr 172.21.15.59:0/2936279189 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:05.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6ce000640 1 --2- 172.21.15.59:0/2936279189 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d806e900 0x7fb6d815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:05.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6d6a00640 1 --2- 172.21.15.59:0/2936279189 >> v2:172.21.15.107:3300/0 conn(0x7fb6d80af720 0x7fb6d815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:05.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6d6000640 1 -- 172.21.15.59:0/2936279189 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067763172 0 0) 0x7fb6d815f060 con 0x7fb6d80d0560 2024-05-30T16:52:05.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6d6000640 1 -- 172.21.15.59:0/2936279189 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6bc003530 con 0x7fb6d80d0560 2024-05-30T16:52:05.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6ce000640 1 -- 172.21.15.59:0/2936279189 >> v2:172.21.15.107:3300/0 conn(0x7fb6d80af720 msgr2=0x7fb6d815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:05.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6ce000640 1 --2- 172.21.15.59:0/2936279189 >> v2:172.21.15.107:3300/0 conn(0x7fb6d80af720 0x7fb6d815b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:05.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6ce000640 1 -- 172.21.15.59:0/2936279189 >> v1:172.21.15.59:6789/0 conn(0x7fb6d80d0560 legacy=0x7fb6d8072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:05.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6ce000640 1 -- 172.21.15.59:0/2936279189 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d815c550 con 0x7fb6d806e900 2024-05-30T16:52:05.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.229+0000 7fb6d6a00640 1 --2- 172.21.15.59:0/2936279189 >> v2:172.21.15.107:3300/0 conn(0x7fb6d80af720 0x7fb6d815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6ce000640 1 --2- 172.21.15.59:0/2936279189 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d806e900 0x7fb6d815f7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00097c0 tx=0x7fb6c001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a47b194889881e5d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6d6000640 1 -- 172.21.15.59:0/2936279189 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00aa5f0 con 0x7fb6d806e900 2024-05-30T16:52:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6d6000640 1 -- 172.21.15.59:0/2936279189 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c00af070 con 0x7fb6d806e900 2024-05-30T16:52:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6d6000640 1 -- 172.21.15.59:0/2936279189 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00aa990 con 0x7fb6d806e900 2024-05-30T16:52:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6dd800640 1 -- 172.21.15.59:0/2936279189 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d806e900 msgr2=0x7fb6d815f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6dd800640 1 --2- 172.21.15.59:0/2936279189 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d806e900 0x7fb6d815f7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00097c0 tx=0x7fb6c001c470 comp rx=0 tx=0).stop 2024-05-30T16:52:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6dd800640 1 -- 172.21.15.59:0/2936279189 shutdown_connections 2024-05-30T16:52:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6dd800640 1 --2- 172.21.15.59:0/2936279189 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d806e900 0x7fb6d815f7f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6dd800640 1 --2- 172.21.15.59:0/2936279189 >> v2:172.21.15.107:3300/0 conn(0x7fb6d80af720 0x7fb6d815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6dd800640 1 -- 172.21.15.59:0/2936279189 >> 172.21.15.59:0/2936279189 conn(0x7fb6d80b22d0 msgr2=0x7fb6d80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6dd800640 1 -- 172.21.15.59:0/2936279189 shutdown_connections 2024-05-30T16:52:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6dd800640 1 -- 172.21.15.59:0/2936279189 wait complete. 2024-05-30T16:52:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6dd800640 1 Processor -- start 2024-05-30T16:52:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.233+0000 7fb6dd800640 1 -- start start 2024-05-30T16:52:05.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6dd800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d806e900 0x7fb6d8152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:05.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6dd800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d80af720 0x7fb6d80b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6dd800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80d0560 0x7fb6d80b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6dd800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d815fd30 con 0x7fb6d806e900 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6dd800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d80d0da0 con 0x7fb6d80d0560 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6dd800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d815feb0 con 0x7fb6d80af720 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6d6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d806e900 0x7fb6d8152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6d6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d806e900 0x7fb6d8152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50174/0 (socket says 172.21.15.59:50174) 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6d6a00640 1 -- 172.21.15.59:0/269045206 learned_addr learned my addr 172.21.15.59:0/269045206 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6d6a00640 1 -- 172.21.15.59:0/269045206 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d80af720 msgr2=0x7fb6d80b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6d6a00640 1 --2- 172.21.15.59:0/269045206 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d80af720 0x7fb6d80b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6d6a00640 1 -- 172.21.15.59:0/269045206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80d0560 msgr2=0x7fb6d80b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6d6a00640 1 --2- 172.21.15.59:0/269045206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80d0560 0x7fb6d80b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6d6a00640 1 -- 172.21.15.59:0/269045206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d80b4cb0 con 0x7fb6d806e900 2024-05-30T16:52:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6d6a00640 1 --2- 172.21.15.59:0/269045206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d806e900 0x7fb6d8152780 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009ec0 tx=0x7fb6c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6cf400640 1 -- 172.21.15.59:0/269045206 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8018020 con 0x7fb6d806e900 2024-05-30T16:52:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6cf400640 1 -- 172.21.15.59:0/269045206 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c8014680 con 0x7fb6d806e900 2024-05-30T16:52:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6cf400640 1 -- 172.21.15.59:0/269045206 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8014a50 con 0x7fb6d806e900 2024-05-30T16:52:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6dd800640 1 -- 172.21.15.59:0/269045206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d81f7ce0 con 0x7fb6d806e900 2024-05-30T16:52:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6dd800640 1 -- 172.21.15.59:0/269045206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d81f82a0 con 0x7fb6d806e900 2024-05-30T16:52:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6dd800640 1 -- 172.21.15.59:0/269045206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d8068a90 con 0x7fb6d806e900 2024-05-30T16:52:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.237+0000 7fb6cf400640 1 -- 172.21.15.59:0/269045206 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fb6c801b020 con 0x7fb6d806e900 2024-05-30T16:52:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.241+0000 7fb6cf400640 1 --2- 172.21.15.59:0/269045206 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6b4068650 0x7fb6b406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.241+0000 7fb6cf400640 1 -- 172.21.15.59:0/269045206 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4971+0+0 (secure 0 0 0) 0x7fb6c80879e0 con 0x7fb6d806e900 2024-05-30T16:52:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.241+0000 7fb6ce000640 1 --2- 172.21.15.59:0/269045206 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6b4068650 0x7fb6b406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.241+0000 7fb6ce000640 1 --2- 172.21.15.59:0/269045206 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6b4068650 0x7fb6b406ab10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00ae000 tx=0x7fb6c0004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.245+0000 7fb6cf400640 1 -- 172.21.15.59:0/269045206 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6c8022030 con 0x7fb6d806e900 2024-05-30T16:52:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:05.473+0000 7fb6dd800640 1 -- 172.21.15.59:0/269045206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]} v 0) -- 0x7fb6d81f7ad0 con 0x7fb6d806e900 2024-05-30T16:52:06.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6cf400640 1 -- 172.21.15.59:0/269045206 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]}]=0 v152) ==== 165+0+0 (secure 0 0 0) 0x7fb6c8010040 con 0x7fb6d806e900 2024-05-30T16:52:06.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6dd800640 1 -- 172.21.15.59:0/269045206 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6b4068650 msgr2=0x7fb6b406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:06.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6dd800640 1 --2- 172.21.15.59:0/269045206 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6b4068650 0x7fb6b406ab10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00ae000 tx=0x7fb6c0004740 comp rx=0 tx=0).stop 2024-05-30T16:52:06.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6dd800640 1 -- 172.21.15.59:0/269045206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d806e900 msgr2=0x7fb6d8152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6dd800640 1 --2- 172.21.15.59:0/269045206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d806e900 0x7fb6d8152780 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009ec0 tx=0x7fb6c800c490 comp rx=0 tx=0).stop 2024-05-30T16:52:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6dd800640 1 -- 172.21.15.59:0/269045206 shutdown_connections 2024-05-30T16:52:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6dd800640 1 --2- 172.21.15.59:0/269045206 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6b4068650 0x7fb6b406ab10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6dd800640 1 --2- 172.21.15.59:0/269045206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80d0560 0x7fb6d80b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6dd800640 1 --2- 172.21.15.59:0/269045206 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d80af720 0x7fb6d80b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6dd800640 1 --2- 172.21.15.59:0/269045206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d806e900 0x7fb6d8152780 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6dd800640 1 -- 172.21.15.59:0/269045206 >> 172.21.15.59:0/269045206 conn(0x7fb6d80b22d0 msgr2=0x7fb6d80afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6dd800640 1 -- 172.21.15.59:0/269045206 shutdown_connections 2024-05-30T16:52:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.341+0000 7fb6dd800640 1 -- 172.21.15.59:0/269045206 wait complete. 2024-05-30T16:52:06.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:52:06.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85b3200640 1 Processor -- start 2024-05-30T16:52:06.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85b3200640 1 -- start start 2024-05-30T16:52:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85b3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85ac159100 0x7f85ac06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85b3200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f85ac15c010 0x7f85ac15c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85b3200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ac0b52d0 con 0x7f85ac0b44e0 2024-05-30T16:52:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85b3200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f85ac0b4a30 con 0x7f85ac15c010 2024-05-30T16:52:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85b3200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f85ac0b4d10 con 0x7f85ac159100 2024-05-30T16:52:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85a3400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f85ac0b44e0 0x7f85ac15efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50272/0 (socket says 172.21.15.59:50272) 2024-05-30T16:52:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85a3400640 1 -- 172.21.15.59:0/2559209505 learned_addr learned my addr 172.21.15.59:0/2559209505 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:06.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85abe00640 1 --2- 172.21.15.59:0/2559209505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85ac159100 0x7f85ac06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:06.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85b1200640 1 --2- 172.21.15.59:0/2559209505 >> v2:172.21.15.107:3300/0 conn(0x7f85ac15c010 0x7f85ac15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:06.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85ab400640 1 -- 172.21.15.59:0/2559209505 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1993356822 0 0) 0x7f85ac0b52d0 con 0x7f85ac0b44e0 2024-05-30T16:52:06.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85ab400640 1 -- 172.21.15.59:0/2559209505 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8590003530 con 0x7f85ac0b44e0 2024-05-30T16:52:06.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85b1200640 1 -- 172.21.15.59:0/2559209505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85ac159100 msgr2=0x7f85ac06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:06.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85b1200640 1 --2- 172.21.15.59:0/2559209505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85ac159100 0x7f85ac06e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85b1200640 1 -- 172.21.15.59:0/2559209505 >> v1:172.21.15.59:6789/0 conn(0x7f85ac0b44e0 legacy=0x7f85ac15efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:06.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85b1200640 1 -- 172.21.15.59:0/2559209505 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac0b4ff0 con 0x7f85ac15c010 2024-05-30T16:52:06.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.517+0000 7f85abe00640 1 --2- 172.21.15.59:0/2559209505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85ac159100 0x7f85ac06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:06.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.521+0000 7f85b1200640 1 --2- 172.21.15.59:0/2559209505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ac15c010 0x7f85ac15c480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f85a40097c0 tx=0x7f85a401c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b34c248acab87649 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:06.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.521+0000 7f85ab400640 1 -- 172.21.15.59:0/2559209505 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a40b0070 con 0x7f85ac15c010 2024-05-30T16:52:06.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.521+0000 7f85ab400640 1 -- 172.21.15.59:0/2559209505 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a4004230 con 0x7f85ac15c010 2024-05-30T16:52:06.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.521+0000 7f85ab400640 1 -- 172.21.15.59:0/2559209505 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4003620 con 0x7f85ac15c010 2024-05-30T16:52:06.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.521+0000 7f85b3200640 1 -- 172.21.15.59:0/2559209505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ac15c010 msgr2=0x7f85ac15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:06.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.521+0000 7f85b3200640 1 --2- 172.21.15.59:0/2559209505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ac15c010 0x7f85ac15c480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f85a40097c0 tx=0x7f85a401c350 comp rx=0 tx=0).stop 2024-05-30T16:52:06.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.521+0000 7f85b3200640 1 -- 172.21.15.59:0/2559209505 shutdown_connections 2024-05-30T16:52:06.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.521+0000 7f85b3200640 1 --2- 172.21.15.59:0/2559209505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ac15c010 0x7f85ac15c480 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.521+0000 7f85b3200640 1 --2- 172.21.15.59:0/2559209505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85ac159100 0x7f85ac06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.521+0000 7f85b3200640 1 -- 172.21.15.59:0/2559209505 >> 172.21.15.59:0/2559209505 conn(0x7f85ac06bdb0 msgr2=0x7f85ac06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:06.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.521+0000 7f85b3200640 1 -- 172.21.15.59:0/2559209505 shutdown_connections 2024-05-30T16:52:06.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.521+0000 7f85b3200640 1 -- 172.21.15.59:0/2559209505 wait complete. 2024-05-30T16:52:06.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b3200640 1 Processor -- start 2024-05-30T16:52:06.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b3200640 1 -- start start 2024-05-30T16:52:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85ac0b44e0 0x7f85ac145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b3200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ac159100 0x7f85ac0cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ac15c010 0x7f85ac1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b3200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac1682c0 con 0x7f85ac15c010 2024-05-30T16:52:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b3200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac168140 con 0x7f85ac159100 2024-05-30T16:52:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b3200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f85ac168440 con 0x7f85ac0b44e0 2024-05-30T16:52:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ac15c010 0x7f85ac1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ac15c010 0x7f85ac1578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50182/0 (socket says 172.21.15.59:50182) 2024-05-30T16:52:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b1200640 1 -- 172.21.15.59:0/2268783330 learned_addr learned my addr 172.21.15.59:0/2268783330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85a3400640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ac159100 0x7f85ac0cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85abe00640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85ac0b44e0 0x7f85ac145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b1200640 1 -- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85ac0b44e0 msgr2=0x7f85ac145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b1200640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85ac0b44e0 0x7f85ac145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b1200640 1 -- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ac159100 msgr2=0x7f85ac0cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b1200640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ac159100 0x7f85ac0cf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b1200640 1 -- 172.21.15.59:0/2268783330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac143800 con 0x7f85ac15c010 2024-05-30T16:52:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85a3400640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ac159100 0x7f85ac0cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85abe00640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85ac0b44e0 0x7f85ac145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b1200640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ac15c010 0x7f85ac1578b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f85a40ae040 tx=0x7f85a40190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85a8c00640 1 -- 172.21.15.59:0/2268783330 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a40b9020 con 0x7f85ac15c010 2024-05-30T16:52:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85a8c00640 1 -- 172.21.15.59:0/2268783330 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a40043e0 con 0x7f85ac15c010 2024-05-30T16:52:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85a8c00640 1 -- 172.21.15.59:0/2268783330 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a40b0040 con 0x7f85ac15c010 2024-05-30T16:52:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b3200640 1 -- 172.21.15.59:0/2268783330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ac143ae0 con 0x7f85ac15c010 2024-05-30T16:52:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.525+0000 7f85b3200640 1 -- 172.21.15.59:0/2268783330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ac1440a0 con 0x7f85ac15c010 2024-05-30T16:52:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.529+0000 7f85b3200640 1 -- 172.21.15.59:0/2268783330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85ac068a90 con 0x7f85ac15c010 2024-05-30T16:52:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.529+0000 7f85a8c00640 1 -- 172.21.15.59:0/2268783330 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f85a40bc020 con 0x7f85ac15c010 2024-05-30T16:52:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.529+0000 7f85a8c00640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8588068650 0x7f858806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.529+0000 7f85a8c00640 1 -- 172.21.15.59:0/2268783330 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4971+0+0 (secure 0 0 0) 0x7f85a4120a90 con 0x7f85ac15c010 2024-05-30T16:52:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.529+0000 7f85abe00640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8588068650 0x7f858806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.529+0000 7f85abe00640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8588068650 0x7f858806ab10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f859c007520 tx=0x7f859c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.533+0000 7f85a8c00640 1 -- 172.21.15.59:0/2268783330 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f85a40c3030 con 0x7f85ac15c010 2024-05-30T16:52:06.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.701+0000 7f85b3200640 1 -- 172.21.15.59:0/2268783330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f85ac073270 con 0x7f85ac15c010 2024-05-30T16:52:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.705+0000 7f85a8c00640 1 -- 172.21.15.59:0/2268783330 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f85a4016090 con 0x7f85ac15c010 2024-05-30T16:52:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.709+0000 7f85b3200640 1 -- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8588068650 msgr2=0x7f858806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.709+0000 7f85b3200640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8588068650 0x7f858806ab10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f859c007520 tx=0x7f859c00b040 comp rx=0 tx=0).stop 2024-05-30T16:52:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.709+0000 7f85b3200640 1 -- 172.21.15.59:0/2268783330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ac15c010 msgr2=0x7f85ac1578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.709+0000 7f85b3200640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ac15c010 0x7f85ac1578b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f85a40ae040 tx=0x7f85a40190f0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.709+0000 7f85b3200640 1 -- 172.21.15.59:0/2268783330 shutdown_connections 2024-05-30T16:52:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.709+0000 7f85b3200640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8588068650 0x7f858806ab10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.709+0000 7f85b3200640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ac15c010 0x7f85ac1578b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.709+0000 7f85b3200640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ac159100 0x7f85ac0cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.709+0000 7f85b3200640 1 --2- 172.21.15.59:0/2268783330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85ac0b44e0 0x7f85ac145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.709+0000 7f85b3200640 1 -- 172.21.15.59:0/2268783330 >> 172.21.15.59:0/2268783330 conn(0x7f85ac06bdb0 msgr2=0x7f85ac06c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.709+0000 7f85b3200640 1 -- 172.21.15.59:0/2268783330 shutdown_connections 2024-05-30T16:52:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:06.709+0000 7f85b3200640 1 -- 172.21.15.59:0/2268783330 wait complete. 2024-05-30T16:52:06.729 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:52:06.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:52:06.779 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:52:06.843 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:52:06.843 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:52:06.843 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:06.852 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:52:06.852 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:52:06.852 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:06.861 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:52:06.861 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:52:06.861 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:06.900 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:52:06.900 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:52:06.900 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:06.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:52:06.916 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T16:52:06.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:52:07.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.081+0000 7f5a05a00640 1 Processor -- start 2024-05-30T16:52:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.081+0000 7f5a05a00640 1 -- start start 2024-05-30T16:52:07.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f5a05a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5a000af720 0x7f5a0015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f5a05a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a0006e900 0x7f5a0015f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f5a05a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a000d0560 0x7f5a000d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f5a05a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f5a0015f060 con 0x7f5a000d0560 2024-05-30T16:52:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f5a05a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5a000afb00 con 0x7f5a000af720 2024-05-30T16:52:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f5a05a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0015c270 con 0x7f5a0006e900 2024-05-30T16:52:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f59ff400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a000d0560 0x7f5a000d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f59fea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5a000af720 0x7f5a0015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f59ff400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a000d0560 0x7f5a000d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50190/0 (socket says 172.21.15.59:50190) 2024-05-30T16:52:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f59ff400640 1 -- 172.21.15.59:0/1581933525 learned_addr learned my addr 172.21.15.59:0/1581933525 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f59f6000640 1 --2- 172.21.15.59:0/1581933525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a0006e900 0x7f5a0015f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f59ff400640 1 -- 172.21.15.59:0/1581933525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a0006e900 msgr2=0x7f5a0015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f59ff400640 1 --2- 172.21.15.59:0/1581933525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a0006e900 0x7f5a0015f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f59ff400640 1 -- 172.21.15.59:0/1581933525 >> v2:172.21.15.107:3300/0 conn(0x7f5a000af720 msgr2=0x7f5a0015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f59ff400640 1 --2- 172.21.15.59:0/1581933525 >> v2:172.21.15.107:3300/0 conn(0x7f5a000af720 0x7f5a0015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.085+0000 7f59ff400640 1 -- 172.21.15.59:0/1581933525 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0015c550 con 0x7f5a000d0560 2024-05-30T16:52:07.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f59ff400640 1 --2- 172.21.15.59:0/1581933525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a000d0560 0x7f5a000d0a10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5a000d04b0 tx=0x7f59f801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e08f469e3c3bf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f59fe000640 1 -- 172.21.15.59:0/1581933525 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f800b2d0 con 0x7f5a000d0560 2024-05-30T16:52:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f59fe000640 1 -- 172.21.15.59:0/1581933525 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f800b470 con 0x7f5a000d0560 2024-05-30T16:52:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f59fe000640 1 -- 172.21.15.59:0/1581933525 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f80a7aa0 con 0x7f5a000d0560 2024-05-30T16:52:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f5a05a00640 1 -- 172.21.15.59:0/1581933525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a000d0560 msgr2=0x7f5a000d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f5a05a00640 1 --2- 172.21.15.59:0/1581933525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a000d0560 0x7f5a000d0a10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5a000d04b0 tx=0x7f59f801ebf0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f5a05a00640 1 -- 172.21.15.59:0/1581933525 shutdown_connections 2024-05-30T16:52:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f5a05a00640 1 --2- 172.21.15.59:0/1581933525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a000d0560 0x7f5a000d0a10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f5a05a00640 1 --2- 172.21.15.59:0/1581933525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a0006e900 0x7f5a0015f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f5a05a00640 1 --2- 172.21.15.59:0/1581933525 >> v2:172.21.15.107:3300/0 conn(0x7f5a000af720 0x7f5a0015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f5a05a00640 1 -- 172.21.15.59:0/1581933525 >> 172.21.15.59:0/1581933525 conn(0x7f5a000b22d0 msgr2=0x7f5a000b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f5a05a00640 1 -- 172.21.15.59:0/1581933525 shutdown_connections 2024-05-30T16:52:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f5a05a00640 1 -- 172.21.15.59:0/1581933525 wait complete. 2024-05-30T16:52:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f5a05a00640 1 Processor -- start 2024-05-30T16:52:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.089+0000 7f5a05a00640 1 -- start start 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f5a05a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a0006e900 0x7f5a0009bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f5a05a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a000af720 0x7f5a000c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f5a05a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a000d0560 0x7f5a000c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f5a05a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0015feb0 con 0x7f5a000d0560 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f5a05a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0015fd30 con 0x7f5a000af720 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f5a05a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5a00073150 con 0x7f5a0006e900 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59ff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a000d0560 0x7f5a000c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59ff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a000d0560 0x7f5a000c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50196/0 (socket says 172.21.15.59:50196) 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59ff400640 1 -- 172.21.15.59:0/1194585801 learned_addr learned my addr 172.21.15.59:0/1194585801 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59f6000640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a000af720 0x7f5a000c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59fea00640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a0006e900 0x7f5a0009bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59ff400640 1 -- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a0006e900 msgr2=0x7f5a0009bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59ff400640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a0006e900 0x7f5a0009bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59ff400640 1 -- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a000af720 msgr2=0x7f5a000c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:07.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59ff400640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a000af720 0x7f5a000c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59ff400640 1 -- 172.21.15.59:0/1194585801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0006dd30 con 0x7f5a000d0560 2024-05-30T16:52:07.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59f6000640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a000af720 0x7f5a000c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:07.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59fea00640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a0006e900 0x7f5a0009bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:07.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59ff400640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a000d0560 0x7f5a000c9a90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f59f800b040 tx=0x7f59f801b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:07.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59f7400640 1 -- 172.21.15.59:0/1194585801 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f80bd030 con 0x7f5a000d0560 2024-05-30T16:52:07.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59f7400640 1 -- 172.21.15.59:0/1194585801 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f8009600 con 0x7f5a000d0560 2024-05-30T16:52:07.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f5a05a00640 1 -- 172.21.15.59:0/1194585801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a001f7e90 con 0x7f5a000d0560 2024-05-30T16:52:07.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59f7400640 1 -- 172.21.15.59:0/1194585801 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f800b720 con 0x7f5a000d0560 2024-05-30T16:52:07.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f5a05a00640 1 -- 172.21.15.59:0/1194585801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a0009d750 con 0x7f5a000d0560 2024-05-30T16:52:07.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f5a05a00640 1 -- 172.21.15.59:0/1194585801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a00068a90 con 0x7f5a000d0560 2024-05-30T16:52:07.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.093+0000 7f59f7400640 1 -- 172.21.15.59:0/1194585801 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f59f80c0070 con 0x7f5a000d0560 2024-05-30T16:52:07.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.097+0000 7f59f7400640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f59dc068650 0x7f59dc06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.097+0000 7f59f7400640 1 -- 172.21.15.59:0/1194585801 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4971+0+0 (secure 0 0 0) 0x7f59f81216c0 con 0x7f5a000d0560 2024-05-30T16:52:07.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.097+0000 7f59fea00640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f59dc068650 0x7f59dc06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.097+0000 7f59fea00640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f59dc068650 0x7f59dc06ab10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a000cfd50 tx=0x7f59f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:07.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.101+0000 7f59f7400640 1 -- 172.21.15.59:0/1194585801 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59f80c7070 con 0x7f5a000d0560 2024-05-30T16:52:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.297+0000 7f5a05a00640 1 -- 172.21.15.59:0/1194585801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a0009d120 con 0x7f5a000d0560 2024-05-30T16:52:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.297+0000 7f59f7400640 1 -- 172.21.15.59:0/1194585801 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3872 (secure 0 0 0) 0x7f59f80187e0 con 0x7f5a000d0560 2024-05-30T16:52:07.299 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:07.300 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1119687744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1119687744},{"type":"v1","addr":"172.21.15.107:6836","nonce":1119687744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/985448024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":985448024},{"type":"v1","addr":"172.21.15.107:6837","nonce":985448024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4747,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1214274073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1214274073},{"type":"v1","addr":"172.21.15.59:6834","nonce":1214274073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/4278929498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":4278929498},{"type":"v1","addr":"172.21.15.59:6835","nonce":4278929498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-05-30T16:52:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 19 2024-05-30T16:52:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.301+0000 7f5a05a00640 1 -- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f59dc068650 msgr2=0x7f59dc06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.301+0000 7f5a05a00640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f59dc068650 0x7f59dc06ab10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a000cfd50 tx=0x7f59f0008040 comp rx=0 tx=0).stop 2024-05-30T16:52:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.301+0000 7f5a05a00640 1 -- 172.21.15.59:0/1194585801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a000d0560 msgr2=0x7f5a000c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.301+0000 7f5a05a00640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a000d0560 0x7f5a000c9a90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f59f800b040 tx=0x7f59f801b990 comp rx=0 tx=0).stop 2024-05-30T16:52:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.301+0000 7f5a05a00640 1 -- 172.21.15.59:0/1194585801 shutdown_connections 2024-05-30T16:52:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.301+0000 7f5a05a00640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f59dc068650 0x7f59dc06ab10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.301+0000 7f5a05a00640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a000d0560 0x7f5a000c9a90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.301+0000 7f5a05a00640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a000af720 0x7f5a000c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.301+0000 7f5a05a00640 1 --2- 172.21.15.59:0/1194585801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a0006e900 0x7f5a0009bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.301+0000 7f5a05a00640 1 -- 172.21.15.59:0/1194585801 >> 172.21.15.59:0/1194585801 conn(0x7f5a000b22d0 msgr2=0x7f5a001e6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.301+0000 7f5a05a00640 1 -- 172.21.15.59:0/1194585801 shutdown_connections 2024-05-30T16:52:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.301+0000 7f5a05a00640 1 -- 172.21.15.59:0/1194585801 wait complete. 2024-05-30T16:52:07.321 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T16:52:07.322 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T16:52:07.322 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T16:52:07.322 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:52:07.322 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T16:52:07.322 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T16:52:07.322 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T16:52:07.322 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:52:07.323 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T16:52:07.323 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T16:52:07.323 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T16:52:07.323 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:52:07.323 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T16:52:07.323 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T16:52:07.323 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T16:52:07.324 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:52:07.338 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T16:52:07.338 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T16:52:07.339 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T16:52:07.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T16:52:07.340 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T16:52:07.340 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T16:52:07.341 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T16:52:07.341 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T16:52:07.383 INFO:tasks.ceph.mds.a:Started 2024-05-30T16:52:07.383 DEBUG:teuthology.parallel:result is None 2024-05-30T16:52:07.384 INFO:tasks.ceph.mds.c:Started 2024-05-30T16:52:07.385 DEBUG:teuthology.parallel:result is None 2024-05-30T16:52:07.386 INFO:tasks.ceph.mds.b:Started 2024-05-30T16:52:07.387 DEBUG:teuthology.parallel:result is None 2024-05-30T16:52:07.389 INFO:tasks.ceph.mds.d:Started 2024-05-30T16:52:07.389 DEBUG:teuthology.parallel:result is None 2024-05-30T16:52:07.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T16:52:07.470 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T16:52:07.470 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-05-30T16:52:07.479 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-30T16:52:07.480 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-30T16:52:07.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.533+0000 7f6893000640 1 Processor -- start 2024-05-30T16:52:07.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.533+0000 7f6893000640 1 -- start start 2024-05-30T16:52:07.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.533+0000 7f6893000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f688c06e900 0x7f688c15f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.533+0000 7f6893000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0d0560 0x7f688c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.533+0000 7f6893000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688c15f060 con 0x7f688c0af720 2024-05-30T16:52:07.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.533+0000 7f6893000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f688c0afb00 con 0x7f688c06e900 2024-05-30T16:52:07.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.533+0000 7f6893000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f688c15c270 con 0x7f688c0d0560 2024-05-30T16:52:07.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.533+0000 7f688be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f688c0af720 0x7f688c15b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50290/0 (socket says 172.21.15.59:50290) 2024-05-30T16:52:07.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.533+0000 7f688be00640 1 -- 172.21.15.59:0/2949946284 learned_addr learned my addr 172.21.15.59:0/2949946284 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:07.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2873040036 0 0) 0x7f688c15f060 con 0x7f688c0af720 2024-05-30T16:52:07.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6870005740 con 0x7f688c0af720 2024-05-30T16:52:07.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f6891000640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0d0560 0x7f688c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f6883400640 1 --2- 172.21.15.59:0/2949946284 >> v2:172.21.15.107:3300/0 conn(0x7f688c06e900 0x7f688c15f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 998726708 0 0) 0x7f6870005740 con 0x7f688c0af720 2024-05-30T16:52:07.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0d0560 msgr2=0x7f688c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:07.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0d0560 0x7f688c0d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 >> v2:172.21.15.107:3300/0 conn(0x7f688c06e900 msgr2=0x7f688c15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:07.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 --2- 172.21.15.59:0/2949946284 >> v2:172.21.15.107:3300/0 conn(0x7f688c06e900 0x7f688c15f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688c15c550 con 0x7f688c0af720 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f687c001680 con 0x7f688c0af720 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f6883400640 1 --2- 172.21.15.59:0/2949946284 >> v2:172.21.15.107:3300/0 conn(0x7f688c06e900 0x7f688c15f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 >> v1:172.21.15.59:6789/0 conn(0x7f688c0af720 legacy=0x7f688c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6870005bd0 0x7f6870005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6870006a20 0x7f6870006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0d0560 0x7f68700073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f688c0afb00 con 0x7f6870005bd0 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f688c15c270 con 0x7f6870006a20 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f687000dcc0 con 0x7f688c0d0560 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688be00640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6870005bd0 0x7f6870005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f6883400640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6870006a20 0x7f6870006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f6891000640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0d0560 0x7f68700073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688be00640 1 -- 172.21.15.59:0/2949946284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0d0560 msgr2=0x7f68700073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688be00640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0d0560 0x7f68700073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688be00640 1 -- 172.21.15.59:0/2949946284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6870006a20 msgr2=0x7f6870006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:07.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688be00640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6870006a20 0x7f6870006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f688be00640 1 -- 172.21.15.59:0/2949946284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6870005740 con 0x7f6870005bd0 2024-05-30T16:52:07.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.537+0000 7f6883400640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6870006a20 0x7f6870006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f688be00640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6870005bd0 0x7f6870005ff0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f687c00c210 tx=0x7f687c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ef31a67f8d34c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c007d60 con 0x7f6870005bd0 2024-05-30T16:52:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687c0a9020 con 0x7f6870005bd0 2024-05-30T16:52:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f688b400640 1 -- 172.21.15.59:0/2949946284 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c005b00 con 0x7f6870005bd0 2024-05-30T16:52:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 -- 172.21.15.59:0/2949946284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6870005bd0 msgr2=0x7f6870005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 --2- 172.21.15.59:0/2949946284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6870005bd0 0x7f6870005ff0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f687c00c210 tx=0x7f687c01cc50 comp rx=0 tx=0).stop 2024-05-30T16:52:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6891000640 1 -- 172.21.15.59:0/2949946284 reap_dead start 2024-05-30T16:52:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 -- 172.21.15.59:0/2949946284 shutdown_connections 2024-05-30T16:52:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 -- 172.21.15.59:0/2949946284 >> 172.21.15.59:0/2949946284 conn(0x7f688c0b22d0 msgr2=0x7f688c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:07.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 -- 172.21.15.59:0/2949946284 shutdown_connections 2024-05-30T16:52:07.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 -- 172.21.15.59:0/2949946284 wait complete. 2024-05-30T16:52:07.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 Processor -- start 2024-05-30T16:52:07.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 -- start start 2024-05-30T16:52:07.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6870005bd0 0x7f688c14b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f688c0b0280 0x7f688c0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0b3450 0x7f688c0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f688c15feb0 con 0x7f688c0b0280 2024-05-30T16:52:07.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f688c15fd30 con 0x7f6870005bd0 2024-05-30T16:52:07.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6893000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f688c073150 con 0x7f688c0b3450 2024-05-30T16:52:07.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6883400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f688c0b0280 0x7f688c0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6883400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f688c0b0280 0x7f688c0b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50228/0 (socket says 172.21.15.59:50228) 2024-05-30T16:52:07.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.541+0000 7f6883400640 1 -- 172.21.15.59:0/98314299 learned_addr learned my addr 172.21.15.59:0/98314299 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f688be00640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6870005bd0 0x7f688c14b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6891000640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0b3450 0x7f688c0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6883400640 1 -- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0b3450 msgr2=0x7f688c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6883400640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0b3450 0x7f688c0b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6883400640 1 -- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6870005bd0 msgr2=0x7f688c14b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6883400640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6870005bd0 0x7f688c14b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6883400640 1 -- 172.21.15.59:0/98314299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688c14b730 con 0x7f688c0b0280 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6891000640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0b3450 0x7f688c0b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6883400640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f688c0b0280 0x7f688c0b0700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6874010850 tx=0x7f6874010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6888c00640 1 -- 172.21.15.59:0/98314299 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687401a020 con 0x7f688c0b0280 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6888c00640 1 -- 172.21.15.59:0/98314299 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687400eb00 con 0x7f688c0b0280 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6888c00640 1 -- 172.21.15.59:0/98314299 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687400f040 con 0x7f688c0b0280 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6893000640 1 -- 172.21.15.59:0/98314299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688c0b4180 con 0x7f688c0b0280 2024-05-30T16:52:07.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6893000640 1 -- 172.21.15.59:0/98314299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688c0b4740 con 0x7f688c0b0280 2024-05-30T16:52:07.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6893000640 1 -- 172.21.15.59:0/98314299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f688c0b0c40 con 0x7f688c0b0280 2024-05-30T16:52:07.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6888c00640 1 -- 172.21.15.59:0/98314299 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f687401d020 con 0x7f688c0b0280 2024-05-30T16:52:07.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6888c00640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f68680686d0 0x7f686806ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:07.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.545+0000 7f6888c00640 1 -- 172.21.15.59:0/98314299 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4971+0+0 (secure 0 0 0) 0x7f6874087320 con 0x7f688c0b0280 2024-05-30T16:52:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.549+0000 7f688be00640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f68680686d0 0x7f686806ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:07.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.549+0000 7f688be00640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f68680686d0 0x7f686806ab90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f687c0aa000 tx=0x7f687c001ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:07.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.549+0000 7f6888c00640 1 -- 172.21.15.59:0/98314299 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f688c0b0c40 con 0x7f688c0b0280 2024-05-30T16:52:07.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:07.729+0000 7f6893000640 1 -- 172.21.15.59:0/98314299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f688c068a90 con 0x7f688c0b0280 2024-05-30T16:52:08.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.725+0000 7f6888c00640 1 -- 172.21.15.59:0/98314299 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) ==== 97+0+0 (secure 0 0 0) 0x7f6874024020 con 0x7f688c0b0280 2024-05-30T16:52:08.726 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-05-30T16:52:08.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.725+0000 7f6893000640 1 -- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f68680686d0 msgr2=0x7f686806ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:08.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.725+0000 7f6893000640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f68680686d0 0x7f686806ab90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f687c0aa000 tx=0x7f687c001ac0 comp rx=0 tx=0).stop 2024-05-30T16:52:08.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.725+0000 7f6893000640 1 -- 172.21.15.59:0/98314299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f688c0b0280 msgr2=0x7f688c0b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:08.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.725+0000 7f6893000640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f688c0b0280 0x7f688c0b0700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6874010850 tx=0x7f6874010d10 comp rx=0 tx=0).stop 2024-05-30T16:52:08.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.729+0000 7f6893000640 1 -- 172.21.15.59:0/98314299 shutdown_connections 2024-05-30T16:52:08.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.729+0000 7f6893000640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f68680686d0 0x7f686806ab90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:08.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.729+0000 7f6893000640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f688c0b3450 0x7f688c0b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:08.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.729+0000 7f6893000640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f688c0b0280 0x7f688c0b0700 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:08.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.729+0000 7f6893000640 1 --2- 172.21.15.59:0/98314299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6870005bd0 0x7f688c14b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:08.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.729+0000 7f6893000640 1 -- 172.21.15.59:0/98314299 >> 172.21.15.59:0/98314299 conn(0x7f688c0b22d0 msgr2=0x7f688c06f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:08.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.729+0000 7f6893000640 1 -- 172.21.15.59:0/98314299 shutdown_connections 2024-05-30T16:52:08.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.729+0000 7f6893000640 1 -- 172.21.15.59:0/98314299 wait complete. 2024-05-30T16:52:08.753 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T16:52:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ace800640 1 Processor -- start 2024-05-30T16:52:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ace800640 1 -- start start 2024-05-30T16:52:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ace800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ac80af720 0x7f1ac815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ace800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ac80d0560 0x7f1ac80d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ace800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac815f060 con 0x7f1ac806e900 2024-05-30T16:52:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ace800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1ac80afb00 con 0x7f1ac80d0560 2024-05-30T16:52:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ace800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac815c270 con 0x7f1ac80af720 2024-05-30T16:52:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1abea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1ac806e900 0x7f1ac815f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50302/0 (socket says 172.21.15.59:50302) 2024-05-30T16:52:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1abea00640 1 -- 172.21.15.59:0/1344956017 learned_addr learned my addr 172.21.15.59:0/1344956017 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ac7e00640 1 --2- 172.21.15.59:0/1344956017 >> v2:172.21.15.59:3300/0 conn(0x7f1ac80d0560 0x7f1ac80d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ac7400640 1 --2- 172.21.15.59:0/1344956017 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ac80af720 0x7f1ac815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ac6a00640 1 -- 172.21.15.59:0/1344956017 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777539888 0 0) 0x7f1ac815f060 con 0x7f1ac806e900 2024-05-30T16:52:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ac6a00640 1 -- 172.21.15.59:0/1344956017 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1aac003530 con 0x7f1ac806e900 2024-05-30T16:52:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ac7e00640 1 -- 172.21.15.59:0/1344956017 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ac80af720 msgr2=0x7f1ac815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ac7e00640 1 --2- 172.21.15.59:0/1344956017 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ac80af720 0x7f1ac815b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ac7e00640 1 -- 172.21.15.59:0/1344956017 >> v1:172.21.15.59:6789/0 conn(0x7f1ac806e900 legacy=0x7f1ac815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.897+0000 7f1ac7e00640 1 -- 172.21.15.59:0/1344956017 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac815ff00 con 0x7f1ac80d0560 2024-05-30T16:52:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ac7e00640 1 --2- 172.21.15.59:0/1344956017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac80d0560 0x7f1ac80d0a10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009d90 tx=0x7f1ac001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea62ab883e67c93 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ac6a00640 1 -- 172.21.15.59:0/1344956017 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00b2070 con 0x7f1ac80d0560 2024-05-30T16:52:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ac6a00640 1 -- 172.21.15.59:0/1344956017 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac00a5920 con 0x7f1ac80d0560 2024-05-30T16:52:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ac6a00640 1 -- 172.21.15.59:0/1344956017 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00a5cf0 con 0x7f1ac80d0560 2024-05-30T16:52:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ace800640 1 -- 172.21.15.59:0/1344956017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac80d0560 msgr2=0x7f1ac80d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ace800640 1 --2- 172.21.15.59:0/1344956017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac80d0560 0x7f1ac80d0a10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009d90 tx=0x7f1ac001c970 comp rx=0 tx=0).stop 2024-05-30T16:52:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ace800640 1 -- 172.21.15.59:0/1344956017 shutdown_connections 2024-05-30T16:52:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ace800640 1 --2- 172.21.15.59:0/1344956017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac80d0560 0x7f1ac80d0a10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ace800640 1 --2- 172.21.15.59:0/1344956017 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ac80af720 0x7f1ac815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ace800640 1 -- 172.21.15.59:0/1344956017 >> 172.21.15.59:0/1344956017 conn(0x7f1ac80b22d0 msgr2=0x7f1ac80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ace800640 1 -- 172.21.15.59:0/1344956017 shutdown_connections 2024-05-30T16:52:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ace800640 1 -- 172.21.15.59:0/1344956017 wait complete. 2024-05-30T16:52:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.901+0000 7f1ace800640 1 Processor -- start 2024-05-30T16:52:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1ace800640 1 -- start start 2024-05-30T16:52:08.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1ace800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ac806e900 0x7f1ac8099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:08.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1ace800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac80af720 0x7f1ac8154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1ace800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ac80d0560 0x7f1ac815a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1ace800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac8073150 con 0x7f1ac80af720 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1ace800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac815c830 con 0x7f1ac806e900 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1ace800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac80732d0 con 0x7f1ac80d0560 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1abea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac80af720 0x7f1ac8154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1abea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac80af720 0x7f1ac8154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50260/0 (socket says 172.21.15.59:50260) 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1abea00640 1 -- 172.21.15.59:0/636981502 learned_addr learned my addr 172.21.15.59:0/636981502 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1ac7e00640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ac80d0560 0x7f1ac815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1ac7400640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ac806e900 0x7f1ac8099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1abea00640 1 -- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ac80d0560 msgr2=0x7f1ac815a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1abea00640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ac80d0560 0x7f1ac815a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1abea00640 1 -- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ac806e900 msgr2=0x7f1ac8099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1abea00640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ac806e900 0x7f1ac8099ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1abea00640 1 -- 172.21.15.59:0/636981502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac8154500 con 0x7f1ac80af720 2024-05-30T16:52:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1abea00640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac80af720 0x7f1ac8154f80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000c390 tx=0x7f1ab000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1abfe00640 1 -- 172.21.15.59:0/636981502 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0017070 con 0x7f1ac80af720 2024-05-30T16:52:08.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1abfe00640 1 -- 172.21.15.59:0/636981502 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab0005d10 con 0x7f1ac80af720 2024-05-30T16:52:08.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1abfe00640 1 -- 172.21.15.59:0/636981502 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0007310 con 0x7f1ac80af720 2024-05-30T16:52:08.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1ace800640 1 -- 172.21.15.59:0/636981502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac8156dc0 con 0x7f1ac80af720 2024-05-30T16:52:08.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1ace800640 1 -- 172.21.15.59:0/636981502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac8154a80 con 0x7f1ac80af720 2024-05-30T16:52:08.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.905+0000 7f1ace800640 1 -- 172.21.15.59:0/636981502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac8068a90 con 0x7f1ac80af720 2024-05-30T16:52:08.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.909+0000 7f1abfe00640 1 -- 172.21.15.59:0/636981502 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f1ab001a070 con 0x7f1ac80af720 2024-05-30T16:52:08.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.909+0000 7f1abfe00640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aa4068650 0x7f1aa406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:08.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.909+0000 7f1abfe00640 1 -- 172.21.15.59:0/636981502 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4885+0+0 (secure 0 0 0) 0x7f1ab0085df0 con 0x7f1ac80af720 2024-05-30T16:52:08.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.909+0000 7f1ac7400640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aa4068650 0x7f1aa406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.909+0000 7f1ac7400640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aa4068650 0x7f1aa406ab10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009ac0 tx=0x7f1ab8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:08.913+0000 7f1abfe00640 1 -- 172.21.15.59:0/636981502 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ab0055e50 con 0x7f1ac80af720 2024-05-30T16:52:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 -- 172.21.15.59:0/636981502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f1ac81570a0 con 0x7f1ac80af720 2024-05-30T16:52:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1abfe00640 1 -- 172.21.15.59:0/636981502 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f1ab005a150 con 0x7f1ac80af720 2024-05-30T16:52:09.138 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:09.138 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:52:09.138 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-05-30T16:52:09.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.138 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-05-30T16:52:09.138 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmAAjIJhAA5/FZHJtfSZuYcD6bEfCGDA==", 2024-05-30T16:52:09.139 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.139 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:52:09.139 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:52:09.139 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:52:09.139 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.139 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.139 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-05-30T16:52:09.139 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmELVkMxAA/vOsM3Z0z4YEmUqoPtrPBQ==", 2024-05-30T16:52:09.139 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.139 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmD2pGLhAAWmDw/02mc8T7upvRXnj1yw==", 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:52:09.140 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmYLbYOhAAxggGfPZU/ryu+8vciSXjUw==", 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.141 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDJrVhmU0fpBhAA2tKWGJF24DlEjG+iuO4djg==", 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDMrVhmxE2HERAA4N9Bsb0fxl5GERpgyKCl6Q==", 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:52:09.142 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDPrVhm6v7AGhAAqOQCN90pL0AmnXYIPIb48A==", 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSrVhm3BEDJxAA4SOWC/qF90R9ivrCvN92ZA==", 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDYrVhmFzmDHhAAQtbXd6haolYB98wfEbpvTQ==", 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:52:09.144 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDbrVhmHqkEKRAAKfFPdTqaVhBNnc5lKeEFpg==", 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-05-30T16:52:09.145 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDerVhm72bzMBAA+FfnxIOnkESuTervY23ruw==", 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDhrVhmXGv/OhAAr2k7IXDA9VDi9ZJwrQ+u6A==", 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.146 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA==", 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmncPjDBAAWEJOkxm9xfRjonO6U1hO6A==", 2024-05-30T16:52:09.147 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmvlFFCRAAZCq7ijfrVqy8Ukh7jKZESQ==", 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:52:09.148 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmcpjuEhAA0q+PfNy0IWhqQSiIZuyBlg==", 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.149 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmnikpCxAA6Q4udmvjQXBmC4f1irI2Xg==", 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmWZq9IhAAFuEZeFiLGCitIiNARjoDTA==", 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:52:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhm0UKsHhAAimqtE18XjW/1vA7uMsJmEw==", 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.151 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-05-30T16:52:09.152 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:52:09.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 -- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aa4068650 msgr2=0x7f1aa406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aa4068650 0x7f1aa406ab10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009ac0 tx=0x7f1ab8009190 comp rx=0 tx=0).stop 2024-05-30T16:52:09.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 -- 172.21.15.59:0/636981502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac80af720 msgr2=0x7f1ac8154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac80af720 0x7f1ac8154f80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000c390 tx=0x7f1ab000c850 comp rx=0 tx=0).stop 2024-05-30T16:52:09.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 -- 172.21.15.59:0/636981502 shutdown_connections 2024-05-30T16:52:09.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aa4068650 0x7f1aa406ab10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ac80d0560 0x7f1ac815a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac80af720 0x7f1ac8154f80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 --2- 172.21.15.59:0/636981502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ac806e900 0x7f1ac8099ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 -- 172.21.15.59:0/636981502 >> 172.21.15.59:0/636981502 conn(0x7f1ac80b22d0 msgr2=0x7f1ac80b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:09.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 -- 172.21.15.59:0/636981502 shutdown_connections 2024-05-30T16:52:09.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.137+0000 7f1ace800640 1 -- 172.21.15.59:0/636981502 wait complete. 2024-05-30T16:52:09.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T16:52:09.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff077800640 1 Processor -- start 2024-05-30T16:52:09.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff077800640 1 -- start start 2024-05-30T16:52:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff077800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff07015b440 0x7ff070072d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff077800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0700add80 0x7ff070073240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff077800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff07015b9b0 con 0x7ff070155620 2024-05-30T16:52:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff077800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff07015bc90 con 0x7ff0700add80 2024-05-30T16:52:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff077800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff07015bf70 con 0x7ff07015b440 2024-05-30T16:52:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff075800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0700add80 0x7ff070073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff075800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0700add80 0x7ff070073240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50276/0 (socket says 172.21.15.59:50276) 2024-05-30T16:52:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff075800640 1 -- 172.21.15.59:0/1480349762 learned_addr learned my addr 172.21.15.59:0/1480349762 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff067e00640 1 --2- 172.21.15.59:0/1480349762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff07015b440 0x7ff070072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff075800640 1 -- 172.21.15.59:0/1480349762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff07015b440 msgr2=0x7ff070072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff075800640 1 --2- 172.21.15.59:0/1480349762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff07015b440 0x7ff070072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff075800640 1 -- 172.21.15.59:0/1480349762 >> v1:172.21.15.107:6789/0 conn(0x7ff070155620 legacy=0x7ff07006e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.301+0000 7ff075800640 1 -- 172.21.15.59:0/1480349762 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07015c250 con 0x7ff0700add80 2024-05-30T16:52:09.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.305+0000 7ff075800640 1 --2- 172.21.15.59:0/1480349762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0700add80 0x7ff070073240 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff06800af60 tx=0x7ff06801db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2a6b9705521d9c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.305+0000 7ff06fe00640 1 -- 172.21.15.59:0/1480349762 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06800a2d0 con 0x7ff0700add80 2024-05-30T16:52:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.305+0000 7ff06fe00640 1 -- 172.21.15.59:0/1480349762 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0680a6770 con 0x7ff0700add80 2024-05-30T16:52:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.305+0000 7ff06fe00640 1 -- 172.21.15.59:0/1480349762 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0680a6b40 con 0x7ff0700add80 2024-05-30T16:52:09.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.305+0000 7ff077800640 1 -- 172.21.15.59:0/1480349762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0700add80 msgr2=0x7ff070073240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.305+0000 7ff077800640 1 --2- 172.21.15.59:0/1480349762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0700add80 0x7ff070073240 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff06800af60 tx=0x7ff06801db30 comp rx=0 tx=0).stop 2024-05-30T16:52:09.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.305+0000 7ff077800640 1 -- 172.21.15.59:0/1480349762 shutdown_connections 2024-05-30T16:52:09.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.305+0000 7ff077800640 1 --2- 172.21.15.59:0/1480349762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0700add80 0x7ff070073240 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.305+0000 7ff077800640 1 --2- 172.21.15.59:0/1480349762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff07015b440 0x7ff070072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.305+0000 7ff077800640 1 -- 172.21.15.59:0/1480349762 >> 172.21.15.59:0/1480349762 conn(0x7ff0700b3240 msgr2=0x7ff0700725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:09.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.305+0000 7ff077800640 1 -- 172.21.15.59:0/1480349762 shutdown_connections 2024-05-30T16:52:09.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.305+0000 7ff077800640 1 -- 172.21.15.59:0/1480349762 wait complete. 2024-05-30T16:52:09.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff077800640 1 Processor -- start 2024-05-30T16:52:09.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff077800640 1 -- start start 2024-05-30T16:52:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff077800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0700add80 0x7ff070153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff077800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff070155620 0x7ff070164940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff077800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07015b440 0x7ff07013d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff077800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff070167dd0 con 0x7ff07015b440 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff077800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff0700b4a70 con 0x7ff0700add80 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff077800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff070167f50 con 0x7ff070155620 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff075800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07015b440 0x7ff07013d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff075800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07015b440 0x7ff07013d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50288/0 (socket says 172.21.15.59:50288) 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff075800640 1 -- 172.21.15.59:0/2789315501 learned_addr learned my addr 172.21.15.59:0/2789315501 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff074e00640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0700add80 0x7ff070153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff067e00640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff070155620 0x7ff070164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff075800640 1 -- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff070155620 msgr2=0x7ff070164940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff075800640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff070155620 0x7ff070164940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff075800640 1 -- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0700add80 msgr2=0x7ff070153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff075800640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0700add80 0x7ff070153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff075800640 1 -- 172.21.15.59:0/2789315501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff070165190 con 0x7ff07015b440 2024-05-30T16:52:09.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff067e00640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff070155620 0x7ff070164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:09.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff074e00640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0700add80 0x7ff070153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:09.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff075800640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07015b440 0x7ff07013d630 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff06801c1e0 tx=0x7ff06801a8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:09.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff06d600640 1 -- 172.21.15.59:0/2789315501 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068008700 con 0x7ff07015b440 2024-05-30T16:52:09.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff06d600640 1 -- 172.21.15.59:0/2789315501 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0680bd070 con 0x7ff07015b440 2024-05-30T16:52:09.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff06d600640 1 -- 172.21.15.59:0/2789315501 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068008b00 con 0x7ff07015b440 2024-05-30T16:52:09.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff077800640 1 -- 172.21.15.59:0/2789315501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff070165470 con 0x7ff07015b440 2024-05-30T16:52:09.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff077800640 1 -- 172.21.15.59:0/2789315501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff070155fc0 con 0x7ff07015b440 2024-05-30T16:52:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.309+0000 7ff077800640 1 -- 172.21.15.59:0/2789315501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff070068a90 con 0x7ff07015b440 2024-05-30T16:52:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.313+0000 7ff06d600640 1 -- 172.21.15.59:0/2789315501 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7ff068008ca0 con 0x7ff07015b440 2024-05-30T16:52:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.313+0000 7ff06d600640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff04c068650 0x7ff04c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.313+0000 7ff06d600640 1 -- 172.21.15.59:0/2789315501 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4885+0+0 (secure 0 0 0) 0x7ff068121d10 con 0x7ff07015b440 2024-05-30T16:52:09.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.313+0000 7ff074e00640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff04c068650 0x7ff04c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.313+0000 7ff074e00640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff04c068650 0x7ff04c06ab10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff060001710 tx=0x7ff060009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:09.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.317+0000 7ff06d600640 1 -- 172.21.15.59:0/2789315501 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff068127020 con 0x7ff07015b440 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 -- 172.21.15.59:0/2789315501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff07006fee0 con 0x7ff07015b440 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff06d600640 1 -- 172.21.15.59:0/2789315501 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) ==== 84+0+65 (secure 0 0 0) 0x7ff068017720 con 0x7ff07015b440 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:52:09.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 -- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff04c068650 msgr2=0x7ff04c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff04c068650 0x7ff04c06ab10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff060001710 tx=0x7ff060009040 comp rx=0 tx=0).stop 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 -- 172.21.15.59:0/2789315501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07015b440 msgr2=0x7ff07013d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07015b440 0x7ff07013d630 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff06801c1e0 tx=0x7ff06801a8d0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 -- 172.21.15.59:0/2789315501 shutdown_connections 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff04c068650 0x7ff04c06ab10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07015b440 0x7ff07013d630 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff070155620 0x7ff070164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 --2- 172.21.15.59:0/2789315501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0700add80 0x7ff070153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 -- 172.21.15.59:0/2789315501 >> 172.21.15.59:0/2789315501 conn(0x7ff0700b3240 msgr2=0x7ff0700b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 -- 172.21.15.59:0/2789315501 shutdown_connections 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.489+0000 7ff077800640 1 -- 172.21.15.59:0/2789315501 wait complete. 2024-05-30T16:52:09.511 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T16:52:09.512 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T16:52:09.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.653+0000 7fe148600640 1 Processor -- start 2024-05-30T16:52:09.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.653+0000 7fe148600640 1 -- start start 2024-05-30T16:52:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe148600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe140161ce0 0x7fe14009b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe148600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1400d0ba0 0x7fe14015e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe148600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1400d1020 con 0x7fe1400d0710 2024-05-30T16:52:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe148600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe1400d1300 con 0x7fe1400d0ba0 2024-05-30T16:52:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe148600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe1400d15e0 con 0x7fe140161ce0 2024-05-30T16:52:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe146600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1400d0ba0 0x7fe14015e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe145200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe1400d0710 0x7fe140162410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50314/0 (socket says 172.21.15.59:50314) 2024-05-30T16:52:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe145200640 1 -- 172.21.15.59:0/2007622026 learned_addr learned my addr 172.21.15.59:0/2007622026 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:09.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe145c00640 1 --2- 172.21.15.59:0/2007622026 >> v2:172.21.15.107:3300/0 conn(0x7fe140161ce0 0x7fe14009b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe146600640 1 -- 172.21.15.59:0/2007622026 >> v2:172.21.15.107:3300/0 conn(0x7fe140161ce0 msgr2=0x7fe14009b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:09.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe146600640 1 --2- 172.21.15.59:0/2007622026 >> v2:172.21.15.107:3300/0 conn(0x7fe140161ce0 0x7fe14009b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe146600640 1 -- 172.21.15.59:0/2007622026 >> v1:172.21.15.59:6789/0 conn(0x7fe1400d0710 legacy=0x7fe140162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.657+0000 7fe146600640 1 -- 172.21.15.59:0/2007622026 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1400d18c0 con 0x7fe1400d0ba0 2024-05-30T16:52:09.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe146600640 1 --2- 172.21.15.59:0/2007622026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1400d0ba0 0x7fe14015e180 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe140073460 tx=0x7fe13801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a9ccf69cf81c12 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe13fe00640 1 -- 172.21.15.59:0/2007622026 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1380b2070 con 0x7fe1400d0ba0 2024-05-30T16:52:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe13fe00640 1 -- 172.21.15.59:0/2007622026 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1380a5a10 con 0x7fe1400d0ba0 2024-05-30T16:52:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe13fe00640 1 -- 172.21.15.59:0/2007622026 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1380a5de0 con 0x7fe1400d0ba0 2024-05-30T16:52:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 -- 172.21.15.59:0/2007622026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1400d0ba0 msgr2=0x7fe14015e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 --2- 172.21.15.59:0/2007622026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1400d0ba0 0x7fe14015e180 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe140073460 tx=0x7fe13801c930 comp rx=0 tx=0).stop 2024-05-30T16:52:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 -- 172.21.15.59:0/2007622026 shutdown_connections 2024-05-30T16:52:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 --2- 172.21.15.59:0/2007622026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1400d0ba0 0x7fe14015e180 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 --2- 172.21.15.59:0/2007622026 >> v2:172.21.15.107:3300/0 conn(0x7fe140161ce0 0x7fe14009b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 -- 172.21.15.59:0/2007622026 >> 172.21.15.59:0/2007622026 conn(0x7fe1400b4000 msgr2=0x7fe1400b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:09.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 -- 172.21.15.59:0/2007622026 shutdown_connections 2024-05-30T16:52:09.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 -- 172.21.15.59:0/2007622026 wait complete. 2024-05-30T16:52:09.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 Processor -- start 2024-05-30T16:52:09.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 -- start start 2024-05-30T16:52:09.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1400d0710 0x7fe14009b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1400d0ba0 0x7fe140150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe140161ce0 0x7fe1400b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe14015eed0 con 0x7fe140161ce0 2024-05-30T16:52:09.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe140162d30 con 0x7fe1400d0ba0 2024-05-30T16:52:09.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.661+0000 7fe148600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe14015f050 con 0x7fe1400d0710 2024-05-30T16:52:09.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe146600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe140161ce0 0x7fe1400b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe146600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe140161ce0 0x7fe1400b5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50308/0 (socket says 172.21.15.59:50308) 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe146600640 1 -- 172.21.15.59:0/1052088397 learned_addr learned my addr 172.21.15.59:0/1052088397 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe145200640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1400d0ba0 0x7fe140150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe145c00640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1400d0710 0x7fe14009b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe146600640 1 -- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1400d0710 msgr2=0x7fe14009b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe146600640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1400d0710 0x7fe14009b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe146600640 1 -- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1400d0ba0 msgr2=0x7fe140150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe146600640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1400d0ba0 0x7fe140150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe146600640 1 -- 172.21.15.59:0/1052088397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14015ca80 con 0x7fe140161ce0 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe145c00640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1400d0710 0x7fe14009b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe145200640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1400d0ba0 0x7fe140150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe146600640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe140161ce0 0x7fe1400b5360 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe138019540 tx=0x7fe1380196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe13d600640 1 -- 172.21.15.59:0/1052088397 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1380b2050 con 0x7fe140161ce0 2024-05-30T16:52:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe13d600640 1 -- 172.21.15.59:0/1052088397 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1380be070 con 0x7fe140161ce0 2024-05-30T16:52:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe13d600640 1 -- 172.21.15.59:0/1052088397 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1380adb90 con 0x7fe140161ce0 2024-05-30T16:52:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe148600640 1 -- 172.21.15.59:0/1052088397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14015cd60 con 0x7fe140161ce0 2024-05-30T16:52:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe148600640 1 -- 172.21.15.59:0/1052088397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe140150fc0 con 0x7fe140161ce0 2024-05-30T16:52:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe148600640 1 -- 172.21.15.59:0/1052088397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe140068a90 con 0x7fe140161ce0 2024-05-30T16:52:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe13d600640 1 -- 172.21.15.59:0/1052088397 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fe1380c3460 con 0x7fe140161ce0 2024-05-30T16:52:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.665+0000 7fe13d600640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe120068650 0x7fe12006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.669+0000 7fe13d600640 1 -- 172.21.15.59:0/1052088397 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4885+0+0 (secure 0 0 0) 0x7fe138121da0 con 0x7fe140161ce0 2024-05-30T16:52:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.669+0000 7fe145c00640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe120068650 0x7fe12006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.669+0000 7fe145c00640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe120068650 0x7fe12006ab10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b9f0 tx=0x7fe134008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:09.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.673+0000 7fe13d600640 1 -- 172.21.15.59:0/1052088397 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe138016520 con 0x7fe140161ce0 2024-05-30T16:52:09.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:09.837+0000 7fe148600640 1 -- 172.21.15.59:0/1052088397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe1400b4bb0 con 0x7fe140161ce0 2024-05-30T16:52:10.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe13d600640 1 -- 172.21.15.59:0/1052088397 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) ==== 138+0+0 (secure 0 0 0) 0x7fe1380f2300 con 0x7fe140161ce0 2024-05-30T16:52:10.733 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-05-30T16:52:10.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe148600640 1 -- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe120068650 msgr2=0x7fe12006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:10.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe148600640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe120068650 0x7fe12006ab10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b9f0 tx=0x7fe134008040 comp rx=0 tx=0).stop 2024-05-30T16:52:10.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe148600640 1 -- 172.21.15.59:0/1052088397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe140161ce0 msgr2=0x7fe1400b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:10.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe148600640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe140161ce0 0x7fe1400b5360 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe138019540 tx=0x7fe1380196d0 comp rx=0 tx=0).stop 2024-05-30T16:52:10.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe148600640 1 -- 172.21.15.59:0/1052088397 shutdown_connections 2024-05-30T16:52:10.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe148600640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe120068650 0x7fe12006ab10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:10.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe148600640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe140161ce0 0x7fe1400b5360 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:10.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe148600640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1400d0ba0 0x7fe140150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:10.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe148600640 1 --2- 172.21.15.59:0/1052088397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1400d0710 0x7fe14009b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:10.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe148600640 1 -- 172.21.15.59:0/1052088397 >> 172.21.15.59:0/1052088397 conn(0x7fe1400b4000 msgr2=0x7fe1400ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:10.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe148600640 1 -- 172.21.15.59:0/1052088397 shutdown_connections 2024-05-30T16:52:10.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.733+0000 7fe148600640 1 -- 172.21.15.59:0/1052088397 wait complete. 2024-05-30T16:52:10.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T16:52:10.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f1288e00640 1 Processor -- start 2024-05-30T16:52:10.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f1288e00640 1 -- start start 2024-05-30T16:52:10.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f1288e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f12841569e0 0x7f128415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:10.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f1288e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12840ad770 con 0x7f12840ad2b0 2024-05-30T16:52:10.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f1288e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128415cb40 con 0x7f12840d0660 2024-05-30T16:52:10.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f1288e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f128415ce20 con 0x7f12841569e0 2024-05-30T16:52:10.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f127be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f12840ad2b0 0x7f12840cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50328/0 (socket says 172.21.15.59:50328) 2024-05-30T16:52:10.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f127be00640 1 -- 172.21.15.59:0/4176596125 learned_addr learned my addr 172.21.15.59:0/4176596125 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:10.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f1281e00640 1 --2- 172.21.15.59:0/4176596125 >> v2:172.21.15.107:3300/0 conn(0x7f12841569e0 0x7f128415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:10.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f1281400640 1 -- 172.21.15.59:0/4176596125 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1781558899 0 0) 0x7f12840ad770 con 0x7f12840ad2b0 2024-05-30T16:52:10.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f1281400640 1 -- 172.21.15.59:0/4176596125 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1268003530 con 0x7f12840ad2b0 2024-05-30T16:52:10.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f1281e00640 1 -- 172.21.15.59:0/4176596125 >> v1:172.21.15.107:6789/0 conn(0x7f12840d0660 legacy=0x7f12840b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:10.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f1281e00640 1 -- 172.21.15.59:0/4176596125 >> v1:172.21.15.59:6789/0 conn(0x7f12840ad2b0 legacy=0x7f12840cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:10.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.917+0000 7f1281e00640 1 -- 172.21.15.59:0/4176596125 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128415d100 con 0x7f12841569e0 2024-05-30T16:52:10.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.921+0000 7f1281e00640 1 --2- 172.21.15.59:0/4176596125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12841569e0 0x7f128415d620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f12740097c0 tx=0x7f127401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=759a3b316ae131af server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:10.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.921+0000 7f1281400640 1 -- 172.21.15.59:0/4176596125 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12740b0070 con 0x7f12841569e0 2024-05-30T16:52:10.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.921+0000 7f1281400640 1 -- 172.21.15.59:0/4176596125 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12740ab600 con 0x7f12841569e0 2024-05-30T16:52:10.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.921+0000 7f1281400640 1 -- 172.21.15.59:0/4176596125 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12740ab9d0 con 0x7f12841569e0 2024-05-30T16:52:10.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.921+0000 7f1288e00640 1 -- 172.21.15.59:0/4176596125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12841569e0 msgr2=0x7f128415d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:10.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.921+0000 7f1288e00640 1 --2- 172.21.15.59:0/4176596125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12841569e0 0x7f128415d620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f12740097c0 tx=0x7f127401c410 comp rx=0 tx=0).stop 2024-05-30T16:52:10.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.921+0000 7f1288e00640 1 -- 172.21.15.59:0/4176596125 shutdown_connections 2024-05-30T16:52:10.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.921+0000 7f1288e00640 1 --2- 172.21.15.59:0/4176596125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12841569e0 0x7f128415d620 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:10.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.921+0000 7f1288e00640 1 -- 172.21.15.59:0/4176596125 >> 172.21.15.59:0/4176596125 conn(0x7f128406bdb0 msgr2=0x7f128406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:10.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.921+0000 7f1288e00640 1 -- 172.21.15.59:0/4176596125 shutdown_connections 2024-05-30T16:52:10.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.921+0000 7f1288e00640 1 -- 172.21.15.59:0/4176596125 wait complete. 2024-05-30T16:52:10.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1288e00640 1 Processor -- start 2024-05-30T16:52:10.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1288e00640 1 -- start start 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1288e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12840ad2b0 0x7f12840cf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1288e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12840d0660 0x7f128415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1288e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12841569e0 0x7f128415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1288e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f128416a340 con 0x7f12840ad2b0 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1288e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f128416a1c0 con 0x7f12841569e0 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1288e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f128416a4c0 con 0x7f12840d0660 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1281e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12840ad2b0 0x7f12840cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1281e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12840ad2b0 0x7f12840cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50320/0 (socket says 172.21.15.59:50320) 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1281e00640 1 -- 172.21.15.59:0/2952945585 learned_addr learned my addr 172.21.15.59:0/2952945585 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1282800640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12841569e0 0x7f128415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f127be00640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12840d0660 0x7f128415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1281e00640 1 -- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12840d0660 msgr2=0x7f128415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1281e00640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12840d0660 0x7f128415b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:10.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1281e00640 1 -- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12841569e0 msgr2=0x7f128415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:10.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1281e00640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12841569e0 0x7f128415b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:10.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1281e00640 1 -- 172.21.15.59:0/2952945585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12840997b0 con 0x7f12840ad2b0 2024-05-30T16:52:10.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1281e00640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12840ad2b0 0x7f12840cf770 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f12740ae040 tx=0x7f127401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:10.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f127a000640 1 -- 172.21.15.59:0/2952945585 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12740b0050 con 0x7f12840ad2b0 2024-05-30T16:52:10.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f127a000640 1 -- 172.21.15.59:0/2952945585 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12740b1040 con 0x7f12840ad2b0 2024-05-30T16:52:10.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f127a000640 1 -- 172.21.15.59:0/2952945585 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274006e20 con 0x7f12840ad2b0 2024-05-30T16:52:10.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1288e00640 1 -- 172.21.15.59:0/2952945585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128415e940 con 0x7f12840ad2b0 2024-05-30T16:52:10.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1288e00640 1 -- 172.21.15.59:0/2952945585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1284099d80 con 0x7f12840ad2b0 2024-05-30T16:52:10.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.925+0000 7f1288e00640 1 -- 172.21.15.59:0/2952945585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f128415ef50 con 0x7f12840ad2b0 2024-05-30T16:52:10.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.929+0000 7f127a000640 1 -- 172.21.15.59:0/2952945585 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f12740be060 con 0x7f12840ad2b0 2024-05-30T16:52:10.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.929+0000 7f127a000640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1260068650 0x7f126006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:10.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.929+0000 7f127a000640 1 -- 172.21.15.59:0/2952945585 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5255+0+0 (secure 0 0 0) 0x7f12741209e0 con 0x7f12840ad2b0 2024-05-30T16:52:10.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.929+0000 7f127be00640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1260068650 0x7f126006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:10.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.929+0000 7f127be00640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1260068650 0x7f126006ab10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f12840b3150 tx=0x7f126c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:10.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:10.933+0000 7f127a000640 1 -- 172.21.15.59:0/2952945585 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1274016090 con 0x7f12840ad2b0 2024-05-30T16:52:11.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.097+0000 7f1288e00640 1 -- 172.21.15.59:0/2952945585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1284068a90 con 0x7f12840ad2b0 2024-05-30T16:52:11.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.737+0000 7f127a000640 1 -- 172.21.15.59:0/2952945585 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) ==== 170+0+0 (secure 0 0 0) 0x7f12740f0d40 con 0x7f12840ad2b0 2024-05-30T16:52:11.740 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-05-30T16:52:11.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.741+0000 7f1288e00640 1 -- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1260068650 msgr2=0x7f126006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:11.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.741+0000 7f1288e00640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1260068650 0x7f126006ab10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f12840b3150 tx=0x7f126c009040 comp rx=0 tx=0).stop 2024-05-30T16:52:11.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.741+0000 7f1288e00640 1 -- 172.21.15.59:0/2952945585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12840ad2b0 msgr2=0x7f12840cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:11.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.741+0000 7f1288e00640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12840ad2b0 0x7f12840cf770 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f12740ae040 tx=0x7f127401ac50 comp rx=0 tx=0).stop 2024-05-30T16:52:11.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.741+0000 7f1288e00640 1 -- 172.21.15.59:0/2952945585 shutdown_connections 2024-05-30T16:52:11.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.741+0000 7f1288e00640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1260068650 0x7f126006ab10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:11.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.741+0000 7f1288e00640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12841569e0 0x7f128415b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:11.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.741+0000 7f1288e00640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12840d0660 0x7f128415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:11.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.741+0000 7f1288e00640 1 --2- 172.21.15.59:0/2952945585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12840ad2b0 0x7f12840cf770 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:11.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.741+0000 7f1288e00640 1 -- 172.21.15.59:0/2952945585 >> 172.21.15.59:0/2952945585 conn(0x7f128406bdb0 msgr2=0x7f128414b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:11.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.741+0000 7f1288e00640 1 -- 172.21.15.59:0/2952945585 shutdown_connections 2024-05-30T16:52:11.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.741+0000 7f1288e00640 1 -- 172.21.15.59:0/2952945585 wait complete. 2024-05-30T16:52:11.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T16:52:11.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.929+0000 7fa189200640 1 Processor -- start 2024-05-30T16:52:11.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.929+0000 7fa189200640 1 -- start start 2024-05-30T16:52:11.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.933+0000 7fa189200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa18406ce90 0x7fa18406c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:11.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.933+0000 7fa189200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa184163260 con 0x7fa184141f20 2024-05-30T16:52:11.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.933+0000 7fa189200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1841626e0 con 0x7fa1840c9e10 2024-05-30T16:52:11.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.933+0000 7fa189200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa1841629c0 con 0x7fa18406ce90 2024-05-30T16:52:11.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.933+0000 7fa182800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa18406ce90 0x7fa18406c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:11.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.933+0000 7fa179400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa184141f20 0x7fa18406bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53826/0 (socket says 172.21.15.59:53826) 2024-05-30T16:52:11.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.933+0000 7fa179400640 1 -- 172.21.15.59:0/3992005563 learned_addr learned my addr 172.21.15.59:0/3992005563 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:11.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.933+0000 7fa182800640 1 -- 172.21.15.59:0/3992005563 >> v1:172.21.15.107:6789/0 conn(0x7fa1840c9e10 legacy=0x7fa1840ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:11.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.933+0000 7fa182800640 1 -- 172.21.15.59:0/3992005563 >> v1:172.21.15.59:6789/0 conn(0x7fa184141f20 legacy=0x7fa18406bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:11.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.933+0000 7fa182800640 1 -- 172.21.15.59:0/3992005563 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa184162ca0 con 0x7fa18406ce90 2024-05-30T16:52:11.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa182800640 1 --2- 172.21.15.59:0/3992005563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa18406ce90 0x7fa18406c3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0097c0 tx=0x7fa17c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af023bbebb54eb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:11.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa181400640 1 -- 172.21.15.59:0/3992005563 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0b0070 con 0x7fa18406ce90 2024-05-30T16:52:11.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa181400640 1 -- 172.21.15.59:0/3992005563 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17c0ab600 con 0x7fa18406ce90 2024-05-30T16:52:11.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa181400640 1 -- 172.21.15.59:0/3992005563 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0ab9d0 con 0x7fa18406ce90 2024-05-30T16:52:11.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 -- 172.21.15.59:0/3992005563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa18406ce90 msgr2=0x7fa18406c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:11.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 --2- 172.21.15.59:0/3992005563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa18406ce90 0x7fa18406c3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0097c0 tx=0x7fa17c01c350 comp rx=0 tx=0).stop 2024-05-30T16:52:11.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 -- 172.21.15.59:0/3992005563 shutdown_connections 2024-05-30T16:52:11.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 --2- 172.21.15.59:0/3992005563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa18406ce90 0x7fa18406c3f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:11.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 -- 172.21.15.59:0/3992005563 >> 172.21.15.59:0/3992005563 conn(0x7fa1840cd540 msgr2=0x7fa1840cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:11.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 -- 172.21.15.59:0/3992005563 shutdown_connections 2024-05-30T16:52:11.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 -- 172.21.15.59:0/3992005563 wait complete. 2024-05-30T16:52:11.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 Processor -- start 2024-05-30T16:52:11.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 -- start start 2024-05-30T16:52:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa18406ce90 0x7fa18413c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1840c9e10 0x7fa1840b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184141f20 0x7fa1840b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa184162480 con 0x7fa184141f20 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa184162300 con 0x7fa1840c9e10 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.937+0000 7fa189200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa18406c930 con 0x7fa18406ce90 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa182800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184141f20 0x7fa1840b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa182800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184141f20 0x7fa1840b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46536/0 (socket says 172.21.15.59:46536) 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa182800640 1 -- 172.21.15.59:0/3318495446 learned_addr learned my addr 172.21.15.59:0/3318495446 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa181e00640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa18406ce90 0x7fa18413c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa179400640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1840c9e10 0x7fa1840b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa182800640 1 -- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa18406ce90 msgr2=0x7fa18413c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa182800640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa18406ce90 0x7fa18413c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa182800640 1 -- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1840c9e10 msgr2=0x7fa1840b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa182800640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1840c9e10 0x7fa1840b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa182800640 1 -- 172.21.15.59:0/3318495446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18413e030 con 0x7fa184141f20 2024-05-30T16:52:11.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa182800640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184141f20 0x7fa1840b6120 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0ae040 tx=0x7fa17c0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:11.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa17aa00640 1 -- 172.21.15.59:0/3318495446 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0b8020 con 0x7fa184141f20 2024-05-30T16:52:11.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa17aa00640 1 -- 172.21.15.59:0/3318495446 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17c0b4610 con 0x7fa184141f20 2024-05-30T16:52:11.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa17aa00640 1 -- 172.21.15.59:0/3318495446 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0b0040 con 0x7fa184141f20 2024-05-30T16:52:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa189200640 1 -- 172.21.15.59:0/3318495446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18413cab0 con 0x7fa184141f20 2024-05-30T16:52:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa189200640 1 -- 172.21.15.59:0/3318495446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa18413e5b0 con 0x7fa184141f20 2024-05-30T16:52:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa189200640 1 -- 172.21.15.59:0/3318495446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa184068a90 con 0x7fa184141f20 2024-05-30T16:52:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.941+0000 7fa17aa00640 1 -- 172.21.15.59:0/3318495446 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fa17c0bb020 con 0x7fa184141f20 2024-05-30T16:52:11.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.945+0000 7fa17aa00640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa160068650 0x7fa16006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:11.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.945+0000 7fa17aa00640 1 -- 172.21.15.59:0/3318495446 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5637+0+0 (secure 0 0 0) 0x7fa17c120c60 con 0x7fa184141f20 2024-05-30T16:52:11.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.945+0000 7fa181e00640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa160068650 0x7fa16006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:11.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.945+0000 7fa181e00640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa160068650 0x7fa16006ab10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa18415e860 tx=0x7fa174009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:11.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:11.945+0000 7fa17aa00640 1 -- 172.21.15.59:0/3318495446 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa17c0c2030 con 0x7fa184141f20 2024-05-30T16:52:12.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.145+0000 7fa189200640 1 -- 172.21.15.59:0/3318495446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa18406cc70 con 0x7fa184141f20 2024-05-30T16:52:12.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.741+0000 7fa17aa00640 1 -- 172.21.15.59:0/3318495446 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) ==== 172+0+0 (secure 0 0 0) 0x7fa17c016090 con 0x7fa184141f20 2024-05-30T16:52:12.743 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 6 and data pool 7 2024-05-30T16:52:12.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.745+0000 7fa189200640 1 -- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa160068650 msgr2=0x7fa16006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:12.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.745+0000 7fa189200640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa160068650 0x7fa16006ab10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa18415e860 tx=0x7fa174009040 comp rx=0 tx=0).stop 2024-05-30T16:52:12.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.745+0000 7fa189200640 1 -- 172.21.15.59:0/3318495446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184141f20 msgr2=0x7fa1840b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:12.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.745+0000 7fa189200640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184141f20 0x7fa1840b6120 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0ae040 tx=0x7fa17c0190f0 comp rx=0 tx=0).stop 2024-05-30T16:52:12.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.745+0000 7fa189200640 1 -- 172.21.15.59:0/3318495446 shutdown_connections 2024-05-30T16:52:12.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.745+0000 7fa189200640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa160068650 0x7fa16006ab10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:12.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.745+0000 7fa189200640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184141f20 0x7fa1840b6120 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:12.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.745+0000 7fa189200640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1840c9e10 0x7fa1840b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:12.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.745+0000 7fa189200640 1 --2- 172.21.15.59:0/3318495446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa18406ce90 0x7fa18413c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:12.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.745+0000 7fa189200640 1 -- 172.21.15.59:0/3318495446 >> 172.21.15.59:0/3318495446 conn(0x7fa1840cd540 msgr2=0x7fa18413d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:12.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.745+0000 7fa189200640 1 -- 172.21.15.59:0/3318495446 shutdown_connections 2024-05-30T16:52:12.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.749+0000 7fa189200640 1 -- 172.21.15.59:0/3318495446 wait complete. 2024-05-30T16:52:12.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:52:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.937+0000 7f5a17000640 1 Processor -- start 2024-05-30T16:52:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.937+0000 7f5a17000640 1 -- start start 2024-05-30T16:52:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a17000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5a100d0470 0x7f5a1006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a17000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a10163b80 0x7f5a100d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a17000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a10164030 con 0x7f5a100b3b50 2024-05-30T16:52:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a17000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1006ea20 con 0x7f5a10163b80 2024-05-30T16:52:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a17000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5a100d0d90 con 0x7f5a100d0470 2024-05-30T16:52:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a07e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a10163b80 0x7f5a100d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a07e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a10163b80 0x7f5a100d0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46548/0 (socket says 172.21.15.59:46548) 2024-05-30T16:52:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a07e00640 1 -- 172.21.15.59:0/1966737053 learned_addr learned my addr 172.21.15.59:0/1966737053 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a0fe00640 1 --2- 172.21.15.59:0/1966737053 >> v2:172.21.15.107:3300/0 conn(0x7f5a100d0470 0x7f5a1006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a07e00640 1 -- 172.21.15.59:0/1966737053 >> v2:172.21.15.107:3300/0 conn(0x7f5a100d0470 msgr2=0x7f5a1006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a07e00640 1 --2- 172.21.15.59:0/1966737053 >> v2:172.21.15.107:3300/0 conn(0x7f5a100d0470 0x7f5a1006dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a07e00640 1 -- 172.21.15.59:0/1966737053 >> v1:172.21.15.107:6789/0 conn(0x7f5a100b3b50 legacy=0x7f5a100721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.941+0000 7f5a07e00640 1 -- 172.21.15.59:0/1966737053 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1015d4e0 con 0x7f5a10163b80 2024-05-30T16:52:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a07e00640 1 --2- 172.21.15.59:0/1966737053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a10163b80 0x7f5a100d0850 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5a100b46c0 tx=0x7f59f801c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c68eb43c6e123d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a0f400640 1 -- 172.21.15.59:0/1966737053 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f80b0070 con 0x7f5a10163b80 2024-05-30T16:52:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a0f400640 1 -- 172.21.15.59:0/1966737053 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f80ab600 con 0x7f5a10163b80 2024-05-30T16:52:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a0f400640 1 -- 172.21.15.59:0/1966737053 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f80ab9d0 con 0x7f5a10163b80 2024-05-30T16:52:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 -- 172.21.15.59:0/1966737053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a10163b80 msgr2=0x7f5a100d0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 --2- 172.21.15.59:0/1966737053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a10163b80 0x7f5a100d0850 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5a100b46c0 tx=0x7f59f801c270 comp rx=0 tx=0).stop 2024-05-30T16:52:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 -- 172.21.15.59:0/1966737053 shutdown_connections 2024-05-30T16:52:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 --2- 172.21.15.59:0/1966737053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a10163b80 0x7f5a100d0850 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 --2- 172.21.15.59:0/1966737053 >> v2:172.21.15.107:3300/0 conn(0x7f5a100d0470 0x7f5a1006dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:12.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 -- 172.21.15.59:0/1966737053 >> 172.21.15.59:0/1966737053 conn(0x7f5a100b22d0 msgr2=0x7f5a100b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:12.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 -- 172.21.15.59:0/1966737053 shutdown_connections 2024-05-30T16:52:12.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 -- 172.21.15.59:0/1966737053 wait complete. 2024-05-30T16:52:12.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 Processor -- start 2024-05-30T16:52:12.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 -- start start 2024-05-30T16:52:12.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a100b3b50 0x7f5a100ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:12.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a100d0470 0x7f5a1015b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:12.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a10163b80 0x7f5a1015ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:12.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5a10072ce0 con 0x7f5a10163b80 2024-05-30T16:52:12.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5a100b3630 con 0x7f5a100b3b50 2024-05-30T16:52:12.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.945+0000 7f5a17000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5a100b3f90 con 0x7f5a100d0470 2024-05-30T16:52:12.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a15000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a10163b80 0x7f5a1015ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:12.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a15000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a10163b80 0x7f5a1015ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46564/0 (socket says 172.21.15.59:46564) 2024-05-30T16:52:12.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a15000640 1 -- 172.21.15.59:0/1231615786 learned_addr learned my addr 172.21.15.59:0/1231615786 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a0fe00640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a100b3b50 0x7f5a100ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a07e00640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a100d0470 0x7f5a1015b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a15000640 1 -- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a100d0470 msgr2=0x7f5a1015b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a15000640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a100d0470 0x7f5a1015b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a15000640 1 -- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a100b3b50 msgr2=0x7f5a100ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a15000640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a100b3b50 0x7f5a100ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a15000640 1 -- 172.21.15.59:0/1231615786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a100b1570 con 0x7f5a10163b80 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a15000640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a10163b80 0x7f5a1015ba10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800b970 tx=0x7f5a0800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a0cc00640 1 -- 172.21.15.59:0/1231615786 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08019070 con 0x7f5a10163b80 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a0cc00640 1 -- 172.21.15.59:0/1231615786 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0800cb40 con 0x7f5a10163b80 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a17000640 1 -- 172.21.15.59:0/1231615786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a10167250 con 0x7f5a10163b80 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a0cc00640 1 -- 172.21.15.59:0/1231615786 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08014440 con 0x7f5a10163b80 2024-05-30T16:52:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a17000640 1 -- 172.21.15.59:0/1231615786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a101642b0 con 0x7f5a10163b80 2024-05-30T16:52:12.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a17000640 1 -- 172.21.15.59:0/1231615786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a10068a90 con 0x7f5a10163b80 2024-05-30T16:52:12.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a0cc00640 1 -- 172.21.15.59:0/1231615786 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f5a0801c070 con 0x7f5a10163b80 2024-05-30T16:52:12.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.949+0000 7f5a0cc00640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f59ec068650 0x7f59ec06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:12.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.953+0000 7f5a0cc00640 1 -- 172.21.15.59:0/1231615786 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5737+0+0 (secure 0 0 0) 0x7f5a08086990 con 0x7f5a10163b80 2024-05-30T16:52:12.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.953+0000 7f5a0fe00640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f59ec068650 0x7f59ec06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:12.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.953+0000 7f5a0fe00640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f59ec068650 0x7f59ec06ab10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5a000079c0 tx=0x7f5a00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:12.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:12.957+0000 7f5a0cc00640 1 -- 172.21.15.59:0/1231615786 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5a080565e0 con 0x7f5a10163b80 2024-05-30T16:52:13.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.121+0000 7f5a17000640 1 -- 172.21.15.59:0/1231615786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a100b1cb0 con 0x7f5a10163b80 2024-05-30T16:52:13.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.121+0000 7f5a0cc00640 1 -- 172.21.15.59:0/1231615786 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16657 (secure 0 0 0) 0x7f5a0805a8e0 con 0x7f5a10163b80 2024-05-30T16:52:13.124 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:13.124 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":46,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:52:12.149999+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:52:09.850441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T16:52:11.108687+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:52:13.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.125+0000 7f5a17000640 1 -- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f59ec068650 msgr2=0x7f59ec06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:13.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.125+0000 7f5a17000640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f59ec068650 0x7f59ec06ab10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5a000079c0 tx=0x7f5a00008040 comp rx=0 tx=0).stop 2024-05-30T16:52:13.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.125+0000 7f5a17000640 1 -- 172.21.15.59:0/1231615786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a10163b80 msgr2=0x7f5a1015ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:13.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.125+0000 7f5a17000640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a10163b80 0x7f5a1015ba10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800b970 tx=0x7f5a0800be30 comp rx=0 tx=0).stop 2024-05-30T16:52:13.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.125+0000 7f5a17000640 1 -- 172.21.15.59:0/1231615786 shutdown_connections 2024-05-30T16:52:13.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.125+0000 7f5a17000640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f59ec068650 0x7f59ec06ab10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.125+0000 7f5a17000640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a10163b80 0x7f5a1015ba10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.125+0000 7f5a17000640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a100d0470 0x7f5a1015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.125+0000 7f5a17000640 1 --2- 172.21.15.59:0/1231615786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a100b3b50 0x7f5a100ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.125+0000 7f5a17000640 1 -- 172.21.15.59:0/1231615786 >> 172.21.15.59:0/1231615786 conn(0x7f5a100b22d0 msgr2=0x7f5a100735d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:13.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.125+0000 7f5a17000640 1 -- 172.21.15.59:0/1231615786 shutdown_connections 2024-05-30T16:52:13.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.125+0000 7f5a17000640 1 -- 172.21.15.59:0/1231615786 wait complete. 2024-05-30T16:52:13.146 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:52:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d95800640 1 Processor -- start 2024-05-30T16:52:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d95800640 1 -- start start 2024-05-30T16:52:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d95800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d9009b890 0x7f3d9006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d95800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3d90162340 0x7f3d901627d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d95800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d900d0fb0 con 0x7f3d9009b4b0 2024-05-30T16:52:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d95800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3d9006fef0 con 0x7f3d90162340 2024-05-30T16:52:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d95800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3d900d1290 con 0x7f3d9009b890 2024-05-30T16:52:13.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d87400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d9009b890 0x7f3d9006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:13.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d94e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3d90162340 0x7f3d901627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:13.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d87400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d9009b890 0x7f3d9006cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:37198/0 (socket says 172.21.15.59:37198) 2024-05-30T16:52:13.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d87400640 1 -- 172.21.15.59:0/1781272481 learned_addr learned my addr 172.21.15.59:0/1781272481 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:13.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d94e00640 1 -- 172.21.15.59:0/1781272481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d9009b890 msgr2=0x7f3d9006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:13.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d94e00640 1 --2- 172.21.15.59:0/1781272481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d9009b890 0x7f3d9006cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d94e00640 1 -- 172.21.15.59:0/1781272481 >> v1:172.21.15.107:6789/0 conn(0x7f3d9009b4b0 legacy=0x7f3d900d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:13.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d94e00640 1 -- 172.21.15.59:0/1781272481 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d900d1570 con 0x7f3d90162340 2024-05-30T16:52:13.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.285+0000 7f3d87400640 1 --2- 172.21.15.59:0/1781272481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d9009b890 0x7f3d9006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:13.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.289+0000 7f3d94e00640 1 --2- 172.21.15.59:0/1781272481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d90162340 0x7f3d901627d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009d90 tx=0x7f3d8801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=417cc6b0c7bf0a4a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:13.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.289+0000 7f3d8f400640 1 -- 172.21.15.59:0/1781272481 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d880b2070 con 0x7f3d90162340 2024-05-30T16:52:13.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.289+0000 7f3d8f400640 1 -- 172.21.15.59:0/1781272481 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d880a5820 con 0x7f3d90162340 2024-05-30T16:52:13.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.289+0000 7f3d8f400640 1 -- 172.21.15.59:0/1781272481 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d880a5bf0 con 0x7f3d90162340 2024-05-30T16:52:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.289+0000 7f3d95800640 1 -- 172.21.15.59:0/1781272481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d90162340 msgr2=0x7f3d901627d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.289+0000 7f3d95800640 1 --2- 172.21.15.59:0/1781272481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d90162340 0x7f3d901627d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009d90 tx=0x7f3d8801c8e0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.289+0000 7f3d95800640 1 -- 172.21.15.59:0/1781272481 shutdown_connections 2024-05-30T16:52:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.289+0000 7f3d95800640 1 --2- 172.21.15.59:0/1781272481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d90162340 0x7f3d901627d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.289+0000 7f3d95800640 1 --2- 172.21.15.59:0/1781272481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d9009b890 0x7f3d9006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.289+0000 7f3d95800640 1 -- 172.21.15.59:0/1781272481 >> 172.21.15.59:0/1781272481 conn(0x7f3d900b3ec0 msgr2=0x7f3d900b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:13.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.289+0000 7f3d95800640 1 -- 172.21.15.59:0/1781272481 shutdown_connections 2024-05-30T16:52:13.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.289+0000 7f3d95800640 1 -- 172.21.15.59:0/1781272481 wait complete. 2024-05-30T16:52:13.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d95800640 1 Processor -- start 2024-05-30T16:52:13.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d95800640 1 -- start start 2024-05-30T16:52:13.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d95800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d9009b4b0 0x7f3d901534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:13.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d95800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d9009b890 0x7f3d90158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:13.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d95800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d90162340 0x7f3d90159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d95800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9015fc30 con 0x7f3d90162340 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d95800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9015fab0 con 0x7f3d9009b4b0 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d95800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3d90070360 con 0x7f3d9009b890 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d94e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d90162340 0x7f3d90159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d94e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d90162340 0x7f3d90159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46570/0 (socket says 172.21.15.59:46570) 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d94e00640 1 -- 172.21.15.59:0/1313170495 learned_addr learned my addr 172.21.15.59:0/1313170495 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d87400640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d9009b890 0x7f3d90158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d8fe00640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d9009b4b0 0x7f3d901534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d94e00640 1 -- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d9009b890 msgr2=0x7f3d90158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d94e00640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d9009b890 0x7f3d90158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d94e00640 1 -- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d9009b4b0 msgr2=0x7f3d901534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d94e00640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d9009b4b0 0x7f3d901534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d94e00640 1 -- 172.21.15.59:0/1313170495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9016a4d0 con 0x7f3d90162340 2024-05-30T16:52:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d94e00640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d90162340 0x7f3d90159440 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d8801af90 tx=0x7f3d88019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d8cc00640 1 -- 172.21.15.59:0/1313170495 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d880b2050 con 0x7f3d90162340 2024-05-30T16:52:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d8cc00640 1 -- 172.21.15.59:0/1313170495 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d880be070 con 0x7f3d90162340 2024-05-30T16:52:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d95800640 1 -- 172.21.15.59:0/1313170495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d901600d0 con 0x7f3d90162340 2024-05-30T16:52:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d8cc00640 1 -- 172.21.15.59:0/1313170495 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d880ad870 con 0x7f3d90162340 2024-05-30T16:52:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.293+0000 7f3d95800640 1 -- 172.21.15.59:0/1313170495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d90159e10 con 0x7f3d90162340 2024-05-30T16:52:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.297+0000 7f3d95800640 1 -- 172.21.15.59:0/1313170495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d90068a90 con 0x7f3d90162340 2024-05-30T16:52:13.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.297+0000 7f3d8cc00640 1 -- 172.21.15.59:0/1313170495 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f3d880ada10 con 0x7f3d90162340 2024-05-30T16:52:13.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.297+0000 7f3d8cc00640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d6c068650 0x7f3d6c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:13.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.297+0000 7f3d8cc00640 1 -- 172.21.15.59:0/1313170495 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5737+0+0 (secure 0 0 0) 0x7f3d88121d50 con 0x7f3d90162340 2024-05-30T16:52:13.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.297+0000 7f3d8fe00640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d6c068650 0x7f3d6c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:13.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.297+0000 7f3d8fe00640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d6c068650 0x7f3d6c06ab10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3d80001810 tx=0x7f3d80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:13.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.301+0000 7f3d8cc00640 1 -- 172.21.15.59:0/1313170495 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d88016560 con 0x7f3d90162340 2024-05-30T16:52:13.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.465+0000 7f3d95800640 1 -- 172.21.15.59:0/1313170495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d900d1e60 con 0x7f3d90162340 2024-05-30T16:52:13.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.465+0000 7f3d8cc00640 1 -- 172.21.15.59:0/1313170495 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16657 (secure 0 0 0) 0x7f3d880f1ac0 con 0x7f3d90162340 2024-05-30T16:52:13.469 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:13.469 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":46,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:52:12.149999+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:52:09.850441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T16:52:11.108687+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:52:13.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.469+0000 7f3d95800640 1 -- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d6c068650 msgr2=0x7f3d6c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:13.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.469+0000 7f3d95800640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d6c068650 0x7f3d6c06ab10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3d80001810 tx=0x7f3d80009040 comp rx=0 tx=0).stop 2024-05-30T16:52:13.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.469+0000 7f3d95800640 1 -- 172.21.15.59:0/1313170495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d90162340 msgr2=0x7f3d90159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:13.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.469+0000 7f3d95800640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d90162340 0x7f3d90159440 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d8801af90 tx=0x7f3d88019680 comp rx=0 tx=0).stop 2024-05-30T16:52:13.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.469+0000 7f3d95800640 1 -- 172.21.15.59:0/1313170495 shutdown_connections 2024-05-30T16:52:13.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.469+0000 7f3d95800640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d6c068650 0x7f3d6c06ab10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.469+0000 7f3d95800640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d90162340 0x7f3d90159440 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.469+0000 7f3d95800640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d9009b890 0x7f3d90158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.469+0000 7f3d95800640 1 --2- 172.21.15.59:0/1313170495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d9009b4b0 0x7f3d901534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.469+0000 7f3d95800640 1 -- 172.21.15.59:0/1313170495 >> 172.21.15.59:0/1313170495 conn(0x7f3d900b3ec0 msgr2=0x7f3d900706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:13.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.469+0000 7f3d95800640 1 -- 172.21.15.59:0/1313170495 shutdown_connections 2024-05-30T16:52:13.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.469+0000 7f3d95800640 1 -- 172.21.15.59:0/1313170495 wait complete. 2024-05-30T16:52:13.490 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T16:52:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c60a00640 1 Processor -- start 2024-05-30T16:52:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c60a00640 1 -- start start 2024-05-30T16:52:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c60a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0c5c1569e0 0x7f0c5c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c60a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c5c0ad2b0 0x7f0c5c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c60a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c5c0ad770 con 0x7f0c5c0d0660 2024-05-30T16:52:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c60a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0c5c15cb40 con 0x7f0c5c0ad2b0 2024-05-30T16:52:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c60a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0c5c15ce20 con 0x7f0c5c1569e0 2024-05-30T16:52:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c51400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c5c0ad2b0 0x7f0c5c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c5a800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0c5c0d0660 0x7f0c5c0b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53836/0 (socket says 172.21.15.59:53836) 2024-05-30T16:52:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c5a800640 1 -- 172.21.15.59:0/2637253979 learned_addr learned my addr 172.21.15.59:0/2637253979 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c59e00640 1 --2- 172.21.15.59:0/2637253979 >> v2:172.21.15.107:3300/0 conn(0x7f0c5c1569e0 0x7f0c5c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:13.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c51400640 1 -- 172.21.15.59:0/2637253979 >> v2:172.21.15.107:3300/0 conn(0x7f0c5c1569e0 msgr2=0x7f0c5c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:13.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c51400640 1 --2- 172.21.15.59:0/2637253979 >> v2:172.21.15.107:3300/0 conn(0x7f0c5c1569e0 0x7f0c5c15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c51400640 1 -- 172.21.15.59:0/2637253979 >> v1:172.21.15.59:6789/0 conn(0x7f0c5c0d0660 legacy=0x7f0c5c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:13.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c51400640 1 -- 172.21.15.59:0/2637253979 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5c15d100 con 0x7f0c5c0ad2b0 2024-05-30T16:52:13.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.633+0000 7f0c59400640 1 -- 172.21.15.59:0/2637253979 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664236847 0 0) 0x7f0c5c0ad770 con 0x7f0c5c0d0660 2024-05-30T16:52:13.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c51400640 1 --2- 172.21.15.59:0/2637253979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c5c0ad2b0 0x7f0c5c0cf9f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0b4c40 tx=0x7f0c4401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acb220c31249a40 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:13.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c59400640 1 -- 172.21.15.59:0/2637253979 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c440b0070 con 0x7f0c5c0ad2b0 2024-05-30T16:52:13.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c59400640 1 -- 172.21.15.59:0/2637253979 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c44004230 con 0x7f0c5c0ad2b0 2024-05-30T16:52:13.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c59400640 1 -- 172.21.15.59:0/2637253979 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c44003620 con 0x7f0c5c0ad2b0 2024-05-30T16:52:13.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c60a00640 1 -- 172.21.15.59:0/2637253979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c5c0ad2b0 msgr2=0x7f0c5c0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:13.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c60a00640 1 --2- 172.21.15.59:0/2637253979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c5c0ad2b0 0x7f0c5c0cf9f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0b4c40 tx=0x7f0c4401c360 comp rx=0 tx=0).stop 2024-05-30T16:52:13.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c60a00640 1 -- 172.21.15.59:0/2637253979 shutdown_connections 2024-05-30T16:52:13.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c60a00640 1 --2- 172.21.15.59:0/2637253979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c5c0ad2b0 0x7f0c5c0cf9f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c60a00640 1 --2- 172.21.15.59:0/2637253979 >> v2:172.21.15.107:3300/0 conn(0x7f0c5c1569e0 0x7f0c5c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c60a00640 1 -- 172.21.15.59:0/2637253979 >> 172.21.15.59:0/2637253979 conn(0x7f0c5c06bdb0 msgr2=0x7f0c5c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c60a00640 1 -- 172.21.15.59:0/2637253979 shutdown_connections 2024-05-30T16:52:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c60a00640 1 -- 172.21.15.59:0/2637253979 wait complete. 2024-05-30T16:52:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.637+0000 7f0c60a00640 1 Processor -- start 2024-05-30T16:52:13.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c60a00640 1 -- start start 2024-05-30T16:52:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c60a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c5c0ad2b0 0x7f0c5c145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c60a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c5c0d0660 0x7f0c5c099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c60a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c5c1569e0 0x7f0c5c14e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c60a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c0d00b0 con 0x7f0c5c1569e0 2024-05-30T16:52:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c60a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c0cff30 con 0x7f0c5c0d0660 2024-05-30T16:52:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c60a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0c5c1691b0 con 0x7f0c5c0ad2b0 2024-05-30T16:52:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c5a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c5c1569e0 0x7f0c5c14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c5a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c5c1569e0 0x7f0c5c14e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46596/0 (socket says 172.21.15.59:46596) 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c5a800640 1 -- 172.21.15.59:0/2764540781 learned_addr learned my addr 172.21.15.59:0/2764540781 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c51400640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c5c0d0660 0x7f0c5c099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c59e00640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c5c0ad2b0 0x7f0c5c145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c5a800640 1 -- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c5c0ad2b0 msgr2=0x7f0c5c145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c5a800640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c5c0ad2b0 0x7f0c5c145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c5a800640 1 -- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c5c0d0660 msgr2=0x7f0c5c099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c5a800640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c5c0d0660 0x7f0c5c099980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c5a800640 1 -- 172.21.15.59:0/2764540781 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5c099ec0 con 0x7f0c5c1569e0 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c5a800640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c5c1569e0 0x7f0c5c14e040 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400c7a0 tx=0x7f0c5400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c52a00640 1 -- 172.21.15.59:0/2764540781 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54018070 con 0x7f0c5c1569e0 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c52a00640 1 -- 172.21.15.59:0/2764540781 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c5400a640 con 0x7f0c5c1569e0 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c52a00640 1 -- 172.21.15.59:0/2764540781 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5400aab0 con 0x7f0c5c1569e0 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c60a00640 1 -- 172.21.15.59:0/2764540781 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5c151790 con 0x7f0c5c1569e0 2024-05-30T16:52:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c60a00640 1 -- 172.21.15.59:0/2764540781 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c5c151d10 con 0x7f0c5c1569e0 2024-05-30T16:52:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.641+0000 7f0c60a00640 1 -- 172.21.15.59:0/2764540781 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c5c068a90 con 0x7f0c5c1569e0 2024-05-30T16:52:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.645+0000 7f0c52a00640 1 -- 172.21.15.59:0/2764540781 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f0c5401b070 con 0x7f0c5c1569e0 2024-05-30T16:52:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.645+0000 7f0c52a00640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c38068650 0x7f0c3806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.645+0000 7f0c52a00640 1 -- 172.21.15.59:0/2764540781 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5737+0+0 (secure 0 0 0) 0x7f0c540862d0 con 0x7f0c5c1569e0 2024-05-30T16:52:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.645+0000 7f0c59e00640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c38068650 0x7f0c3806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.645+0000 7f0c59e00640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c38068650 0x7f0c3806ab10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c06dfe0 tx=0x7f0c4c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.649+0000 7f0c52a00640 1 -- 172.21.15.59:0/2764540781 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0c54055f20 con 0x7f0c5c1569e0 2024-05-30T16:52:13.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:13.853+0000 7f0c60a00640 1 -- 172.21.15.59:0/2764540781 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0c5c156090 con 0x7f0c5c1569e0 2024-05-30T16:52:14.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.777+0000 7f0c52a00640 1 -- 172.21.15.59:0/2764540781 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f0c5405a220 con 0x7f0c5c1569e0 2024-05-30T16:52:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.781+0000 7f0c60a00640 1 -- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c38068650 msgr2=0x7f0c3806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.781+0000 7f0c60a00640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c38068650 0x7f0c3806ab10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c06dfe0 tx=0x7f0c4c009190 comp rx=0 tx=0).stop 2024-05-30T16:52:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.781+0000 7f0c60a00640 1 -- 172.21.15.59:0/2764540781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c5c1569e0 msgr2=0x7f0c5c14e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.781+0000 7f0c60a00640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c5c1569e0 0x7f0c5c14e040 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400c7a0 tx=0x7f0c5400cc60 comp rx=0 tx=0).stop 2024-05-30T16:52:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.781+0000 7f0c60a00640 1 -- 172.21.15.59:0/2764540781 shutdown_connections 2024-05-30T16:52:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.781+0000 7f0c60a00640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c38068650 0x7f0c3806ab10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.781+0000 7f0c60a00640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c5c1569e0 0x7f0c5c14e040 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.781+0000 7f0c60a00640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c5c0d0660 0x7f0c5c099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.781+0000 7f0c60a00640 1 --2- 172.21.15.59:0/2764540781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c5c0ad2b0 0x7f0c5c145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.781+0000 7f0c60a00640 1 -- 172.21.15.59:0/2764540781 >> 172.21.15.59:0/2764540781 conn(0x7f0c5c06bdb0 msgr2=0x7f0c5c15b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.781+0000 7f0c60a00640 1 -- 172.21.15.59:0/2764540781 shutdown_connections 2024-05-30T16:52:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.781+0000 7f0c60a00640 1 -- 172.21.15.59:0/2764540781 wait complete. 2024-05-30T16:52:14.806 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T16:52:14.806 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T16:52:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c33000640 1 Processor -- start 2024-05-30T16:52:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c33000640 1 -- start start 2024-05-30T16:52:14.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c33000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c2c0ad2b0 0x7f2c2c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c33000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2c2c0d0660 0x7f2c2c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c33000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c2c0ad770 con 0x7f2c2c1569e0 2024-05-30T16:52:14.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c33000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2c2c15cb40 con 0x7f2c2c0d0660 2024-05-30T16:52:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c33000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2c15ce20 con 0x7f2c2c0ad2b0 2024-05-30T16:52:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2c2c1569e0 0x7f2c2c0cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53838/0 (socket says 172.21.15.59:53838) 2024-05-30T16:52:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2be00640 1 -- 172.21.15.59:0/1410572068 learned_addr learned my addr 172.21.15.59:0/1410572068 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c31000640 1 --2- 172.21.15.59:0/1410572068 >> v2:172.21.15.107:3300/0 conn(0x7f2c2c0d0660 0x7f2c2c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2b400640 1 --2- 172.21.15.59:0/1410572068 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c2c0ad2b0 0x7f2c2c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755219665 0 0) 0x7f2c2c0ad770 con 0x7f2c2c1569e0 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c10003530 con 0x7f2c2c1569e0 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3008714573 0 0) 0x7f2c10003530 con 0x7f2c2c1569e0 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c2c0ad2b0 msgr2=0x7f2c2c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 --2- 172.21.15.59:0/1410572068 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c2c0ad2b0 0x7f2c2c15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 >> v2:172.21.15.107:3300/0 conn(0x7f2c2c0d0660 msgr2=0x7f2c2c0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 --2- 172.21.15.59:0/1410572068 >> v2:172.21.15.107:3300/0 conn(0x7f2c2c0d0660 0x7f2c2c0d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2c15d100 con 0x7f2c2c1569e0 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c31000640 1 --2- 172.21.15.59:0/1410572068 >> v2:172.21.15.107:3300/0 conn(0x7f2c2c0d0660 0x7f2c2c0d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f2c1c001680 con 0x7f2c2c1569e0 2024-05-30T16:52:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 >> v1:172.21.15.59:6789/0 conn(0x7f2c2c1569e0 legacy=0x7f2c2c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 --2- 172.21.15.59:0/1410572068 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c2c0ad2b0 0x7f2c100039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 --2- 172.21.15.59:0/1410572068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c10003f40 0x7f2c10004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 --2- 172.21.15.59:0/1410572068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c10004d50 0x7f2c100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c15cb40 con 0x7f2c10003f40 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c15ce20 con 0x7f2c10004d50 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.953+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1000ba20 con 0x7f2c2c0ad2b0 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.957+0000 7f2c2b400640 1 --2- 172.21.15.59:0/1410572068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c10003f40 0x7f2c10004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.957+0000 7f2c2be00640 1 --2- 172.21.15.59:0/1410572068 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c2c0ad2b0 0x7f2c100039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.957+0000 7f2c31000640 1 --2- 172.21.15.59:0/1410572068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c10004d50 0x7f2c100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.957+0000 7f2c2b400640 1 -- 172.21.15.59:0/1410572068 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c2c0ad2b0 msgr2=0x7f2c100039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.957+0000 7f2c2b400640 1 --2- 172.21.15.59:0/1410572068 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c2c0ad2b0 0x7f2c100039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.957+0000 7f2c2b400640 1 -- 172.21.15.59:0/1410572068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c10004d50 msgr2=0x7f2c100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.957+0000 7f2c2b400640 1 --2- 172.21.15.59:0/1410572068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c10004d50 0x7f2c100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.957+0000 7f2c2b400640 1 -- 172.21.15.59:0/1410572068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c10003530 con 0x7f2c10003f40 2024-05-30T16:52:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.957+0000 7f2c2b400640 1 --2- 172.21.15.59:0/1410572068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c10003f40 0x7f2c10004810 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009b10 tx=0x7f2c1801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccf5017a9ed4465 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.957+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c180096b0 con 0x7f2c10003f40 2024-05-30T16:52:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.957+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c180a6450 con 0x7f2c10003f40 2024-05-30T16:52:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.957+0000 7f2c2aa00640 1 -- 172.21.15.59:0/1410572068 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c180a6840 con 0x7f2c10003f40 2024-05-30T16:52:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 -- 172.21.15.59:0/1410572068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c10003f40 msgr2=0x7f2c10004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 --2- 172.21.15.59:0/1410572068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c10003f40 0x7f2c10004810 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009b10 tx=0x7f2c1801ca70 comp rx=0 tx=0).stop 2024-05-30T16:52:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c31000640 1 -- 172.21.15.59:0/1410572068 reap_dead start 2024-05-30T16:52:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 -- 172.21.15.59:0/1410572068 shutdown_connections 2024-05-30T16:52:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 -- 172.21.15.59:0/1410572068 >> 172.21.15.59:0/1410572068 conn(0x7f2c2c06bdb0 msgr2=0x7f2c2c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 -- 172.21.15.59:0/1410572068 shutdown_connections 2024-05-30T16:52:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 -- 172.21.15.59:0/1410572068 wait complete. 2024-05-30T16:52:14.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 Processor -- start 2024-05-30T16:52:14.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 -- start start 2024-05-30T16:52:14.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c10003f40 0x7f2c2c0998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2c15eb90 0x7f2c2c09a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2c15f010 0x7f2c2c09a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c0b3e70 con 0x7f2c2c15f010 2024-05-30T16:52:14.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c0b3cf0 con 0x7f2c2c15eb90 2024-05-30T16:52:14.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c33000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2c0b3ff0 con 0x7f2c10003f40 2024-05-30T16:52:14.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c31000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2c15f010 0x7f2c2c09a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c31000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2c15f010 0x7f2c2c09a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46620/0 (socket says 172.21.15.59:46620) 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c31000640 1 -- 172.21.15.59:0/3503011983 learned_addr learned my addr 172.21.15.59:0/3503011983 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c2b400640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2c15eb90 0x7f2c2c09a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c2be00640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c10003f40 0x7f2c2c0998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c31000640 1 -- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c10003f40 msgr2=0x7f2c2c0998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c31000640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c10003f40 0x7f2c2c0998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c31000640 1 -- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2c15eb90 msgr2=0x7f2c2c09a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c31000640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2c15eb90 0x7f2c2c09a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.961+0000 7f2c31000640 1 -- 172.21.15.59:0/3503011983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2c15f5e0 con 0x7f2c2c15f010 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.965+0000 7f2c31000640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2c15f010 0x7f2c2c09a800 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0b3020 tx=0x7f2c2400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.965+0000 7f2c23e00640 1 -- 172.21.15.59:0/3503011983 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400fdf0 con 0x7f2c2c15f010 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.965+0000 7f2c23e00640 1 -- 172.21.15.59:0/3503011983 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c240039a0 con 0x7f2c2c15f010 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.965+0000 7f2c23e00640 1 -- 172.21.15.59:0/3503011983 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24003d90 con 0x7f2c2c15f010 2024-05-30T16:52:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.965+0000 7f2c33000640 1 -- 172.21.15.59:0/3503011983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2c15f8c0 con 0x7f2c2c15f010 2024-05-30T16:52:14.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.965+0000 7f2c33000640 1 -- 172.21.15.59:0/3503011983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2c15fe80 con 0x7f2c2c15f010 2024-05-30T16:52:14.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.965+0000 7f2c33000640 1 -- 172.21.15.59:0/3503011983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c2c068a90 con 0x7f2c2c15f010 2024-05-30T16:52:14.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.965+0000 7f2c23e00640 1 -- 172.21.15.59:0/3503011983 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f2c2401f020 con 0x7f2c2c15f010 2024-05-30T16:52:14.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.965+0000 7f2c23e00640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2c0c068650 0x7f2c0c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.965+0000 7f2c23e00640 1 -- 172.21.15.59:0/3503011983 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7f2c24087380 con 0x7f2c2c15f010 2024-05-30T16:52:14.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.965+0000 7f2c2be00640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2c0c068650 0x7f2c0c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.969+0000 7f2c2be00640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2c0c068650 0x7f2c0c06ab10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c000c10 tx=0x7f2c1c007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:14.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:14.969+0000 7f2c23e00640 1 -- 172.21.15.59:0/3503011983 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2c24010040 con 0x7f2c2c15f010 2024-05-30T16:52:15.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.173+0000 7f2c33000640 1 -- 172.21.15.59:0/3503011983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2c2c099e30 con 0x7f2c2c15f010 2024-05-30T16:52:15.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.785+0000 7f2c23e00640 1 -- 172.21.15.59:0/3503011983 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7f2c24056e30 con 0x7f2c2c15f010 2024-05-30T16:52:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.785+0000 7f2c33000640 1 -- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2c0c068650 msgr2=0x7f2c0c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.785+0000 7f2c33000640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2c0c068650 0x7f2c0c06ab10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c000c10 tx=0x7f2c1c007900 comp rx=0 tx=0).stop 2024-05-30T16:52:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.785+0000 7f2c33000640 1 -- 172.21.15.59:0/3503011983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2c15f010 msgr2=0x7f2c2c09a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.785+0000 7f2c33000640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2c15f010 0x7f2c2c09a800 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0b3020 tx=0x7f2c2400f580 comp rx=0 tx=0).stop 2024-05-30T16:52:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.785+0000 7f2c33000640 1 -- 172.21.15.59:0/3503011983 shutdown_connections 2024-05-30T16:52:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.785+0000 7f2c33000640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2c0c068650 0x7f2c0c06ab10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.785+0000 7f2c33000640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2c15f010 0x7f2c2c09a800 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.785+0000 7f2c33000640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2c15eb90 0x7f2c2c09a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.785+0000 7f2c33000640 1 --2- 172.21.15.59:0/3503011983 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c10003f40 0x7f2c2c0998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.789+0000 7f2c33000640 1 -- 172.21.15.59:0/3503011983 >> 172.21.15.59:0/3503011983 conn(0x7f2c2c06bdb0 msgr2=0x7f2c2c160850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.789+0000 7f2c33000640 1 -- 172.21.15.59:0/3503011983 shutdown_connections 2024-05-30T16:52:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.789+0000 7f2c33000640 1 -- 172.21.15.59:0/3503011983 wait complete. 2024-05-30T16:52:15.812 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T16:52:15.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:52:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.953+0000 7fd245c00640 1 Processor -- start 2024-05-30T16:52:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.953+0000 7fd245c00640 1 -- start start 2024-05-30T16:52:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.953+0000 7fd245c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd2400af720 0x7fd24015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.953+0000 7fd245c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2400d0560 0x7fd2400d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd245c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd24015f060 con 0x7fd24006e900 2024-05-30T16:52:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd245c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd2400afb00 con 0x7fd2400d0560 2024-05-30T16:52:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd245c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd24015c270 con 0x7fd2400af720 2024-05-30T16:52:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd23f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2400d0560 0x7fd2400d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd23f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2400d0560 0x7fd2400d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46624/0 (socket says 172.21.15.59:46624) 2024-05-30T16:52:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd23f400640 1 -- 172.21.15.59:0/2493587280 learned_addr learned my addr 172.21.15.59:0/2493587280 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd23ea00640 1 --2- 172.21.15.59:0/2493587280 >> v2:172.21.15.107:3300/0 conn(0x7fd2400af720 0x7fd24015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd23f400640 1 -- 172.21.15.59:0/2493587280 >> v2:172.21.15.107:3300/0 conn(0x7fd2400af720 msgr2=0x7fd24015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd23f400640 1 --2- 172.21.15.59:0/2493587280 >> v2:172.21.15.107:3300/0 conn(0x7fd2400af720 0x7fd24015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd23f400640 1 -- 172.21.15.59:0/2493587280 >> v1:172.21.15.107:6789/0 conn(0x7fd24006e900 legacy=0x7fd24015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd23f400640 1 -- 172.21.15.59:0/2493587280 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24015ff00 con 0x7fd2400d0560 2024-05-30T16:52:15.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd23f400640 1 --2- 172.21.15.59:0/2493587280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2400d0560 0x7fd2400d0a10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd2400d04b0 tx=0x7fd23801ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccee27ad1b42069 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:15.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.957+0000 7fd23e000640 1 -- 172.21.15.59:0/2493587280 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2380b4070 con 0x7fd2400d0560 2024-05-30T16:52:15.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd23e000640 1 -- 172.21.15.59:0/2493587280 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2380a7b70 con 0x7fd2400d0560 2024-05-30T16:52:15.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd23e000640 1 -- 172.21.15.59:0/2493587280 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2380af440 con 0x7fd2400d0560 2024-05-30T16:52:15.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 -- 172.21.15.59:0/2493587280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2400d0560 msgr2=0x7fd2400d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:15.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 --2- 172.21.15.59:0/2493587280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2400d0560 0x7fd2400d0a10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd2400d04b0 tx=0x7fd23801ebb0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 -- 172.21.15.59:0/2493587280 shutdown_connections 2024-05-30T16:52:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 --2- 172.21.15.59:0/2493587280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2400d0560 0x7fd2400d0a10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 --2- 172.21.15.59:0/2493587280 >> v2:172.21.15.107:3300/0 conn(0x7fd2400af720 0x7fd24015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 -- 172.21.15.59:0/2493587280 >> 172.21.15.59:0/2493587280 conn(0x7fd2400b22d0 msgr2=0x7fd2400b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 -- 172.21.15.59:0/2493587280 shutdown_connections 2024-05-30T16:52:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 -- 172.21.15.59:0/2493587280 wait complete. 2024-05-30T16:52:15.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 Processor -- start 2024-05-30T16:52:15.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 -- start start 2024-05-30T16:52:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd24006e900 0x7fd24014c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2400af720 0x7fd24009db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2400d0560 0x7fd24015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd240073150 con 0x7fd2400af720 2024-05-30T16:52:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd24015c830 con 0x7fd24006e900 2024-05-30T16:52:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd245c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd2400732d0 con 0x7fd2400d0560 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd236000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2400af720 0x7fd24009db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd236000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2400af720 0x7fd24009db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46634/0 (socket says 172.21.15.59:46634) 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd236000640 1 -- 172.21.15.59:0/77634497 learned_addr learned my addr 172.21.15.59:0/77634497 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd23f400640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2400d0560 0x7fd24015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd23ea00640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd24006e900 0x7fd24014c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd236000640 1 -- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2400d0560 msgr2=0x7fd24015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd236000640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2400d0560 0x7fd24015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd236000640 1 -- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd24006e900 msgr2=0x7fd24014c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd236000640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd24006e900 0x7fd24014c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd236000640 1 -- 172.21.15.59:0/77634497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24009c050 con 0x7fd2400af720 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.961+0000 7fd23f400640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2400d0560 0x7fd24015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.965+0000 7fd236000640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2400af720 0x7fd24009db30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd22800b3e0 tx=0x7fd22800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.965+0000 7fd237400640 1 -- 172.21.15.59:0/77634497 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228015020 con 0x7fd2400af720 2024-05-30T16:52:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.965+0000 7fd237400640 1 -- 172.21.15.59:0/77634497 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd228011830 con 0x7fd2400af720 2024-05-30T16:52:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.965+0000 7fd237400640 1 -- 172.21.15.59:0/77634497 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228011c60 con 0x7fd2400af720 2024-05-30T16:52:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.965+0000 7fd245c00640 1 -- 172.21.15.59:0/77634497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24009c330 con 0x7fd2400af720 2024-05-30T16:52:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.965+0000 7fd245c00640 1 -- 172.21.15.59:0/77634497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24009c8f0 con 0x7fd2400af720 2024-05-30T16:52:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.965+0000 7fd245c00640 1 -- 172.21.15.59:0/77634497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd240068a90 con 0x7fd2400af720 2024-05-30T16:52:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.965+0000 7fd237400640 1 -- 172.21.15.59:0/77634497 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fd228018020 con 0x7fd2400af720 2024-05-30T16:52:15.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.965+0000 7fd237400640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd21c068720 0x7fd21c06abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:15.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.965+0000 7fd237400640 1 -- 172.21.15.59:0/77634497 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7fd2280869e0 con 0x7fd2400af720 2024-05-30T16:52:15.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.969+0000 7fd23ea00640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd21c068720 0x7fd21c06abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:15.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.969+0000 7fd23ea00640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd21c068720 0x7fd21c06abe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd230003fd0 tx=0x7fd2300039a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:15.973+0000 7fd237400640 1 -- 172.21.15.59:0/77634497 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd22801f030 con 0x7fd2400af720 2024-05-30T16:52:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.169+0000 7fd245c00640 1 -- 172.21.15.59:0/77634497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd24015b500 con 0x7fd2400af720 2024-05-30T16:52:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.169+0000 7fd237400640 1 -- 172.21.15.59:0/77634497 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5187 (secure 0 0 0) 0x7fd228056c70 con 0x7fd2400af720 2024-05-30T16:52:16.173 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:16.173 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4919,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2045783783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2045783783},{"type":"v1","addr":"172.21.15.107:6836","nonce":2045783783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4922,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3405430037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3405430037},{"type":"v1","addr":"172.21.15.107:6837","nonce":3405430037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3338903229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3338903229},{"type":"v1","addr":"172.21.15.59:6834","nonce":3338903229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:52:12.149964+0000","modified":"2024-05-30T16:52:15.176696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3019371755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3019371755},{"type":"v1","addr":"172.21.15.59:6835","nonce":3019371755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-05-30T16:52:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 25 2024-05-30T16:52:16.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.173+0000 7fd245c00640 1 -- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd21c068720 msgr2=0x7fd21c06abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.173+0000 7fd245c00640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd21c068720 0x7fd21c06abe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd230003fd0 tx=0x7fd2300039a0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.173+0000 7fd245c00640 1 -- 172.21.15.59:0/77634497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2400af720 msgr2=0x7fd24009db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.173+0000 7fd245c00640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2400af720 0x7fd24009db30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd22800b3e0 tx=0x7fd22800b8a0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.173+0000 7fd245c00640 1 -- 172.21.15.59:0/77634497 shutdown_connections 2024-05-30T16:52:16.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.173+0000 7fd245c00640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd21c068720 0x7fd21c06abe0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.173+0000 7fd245c00640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2400d0560 0x7fd24015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.173+0000 7fd245c00640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2400af720 0x7fd24009db30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.173+0000 7fd245c00640 1 --2- 172.21.15.59:0/77634497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd24006e900 0x7fd24014c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.173+0000 7fd245c00640 1 -- 172.21.15.59:0/77634497 >> 172.21.15.59:0/77634497 conn(0x7fd2400b22d0 msgr2=0x7fd2400b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:16.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.173+0000 7fd245c00640 1 -- 172.21.15.59:0/77634497 shutdown_connections 2024-05-30T16:52:16.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.173+0000 7fd245c00640 1 -- 172.21.15.59:0/77634497 wait complete. 2024-05-30T16:52:16.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:52:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.333+0000 7fb6daa00640 1 Processor -- start 2024-05-30T16:52:16.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.333+0000 7fb6daa00640 1 -- start start 2024-05-30T16:52:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.333+0000 7fb6daa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6d40af720 0x7fb6d415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6daa00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d415f060 con 0x7fb6d40d0560 2024-05-30T16:52:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6daa00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d415ff00 con 0x7fb6d406e900 2024-05-30T16:52:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6daa00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d40afb00 con 0x7fb6d40af720 2024-05-30T16:52:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6d3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6d40af720 0x7fb6d415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6d8a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb6d40d0560 0x7fb6d4072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53850/0 (socket says 172.21.15.59:53850) 2024-05-30T16:52:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6d8a00640 1 -- 172.21.15.59:0/1177765177 learned_addr learned my addr 172.21.15.59:0/1177765177 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6d3e00640 1 -- 172.21.15.59:0/1177765177 >> v1:172.21.15.107:6789/0 conn(0x7fb6d406e900 legacy=0x7fb6d415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6d3e00640 1 -- 172.21.15.59:0/1177765177 >> v1:172.21.15.59:6789/0 conn(0x7fb6d40d0560 legacy=0x7fb6d4072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6d3e00640 1 -- 172.21.15.59:0/1177765177 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d415c270 con 0x7fb6d40af720 2024-05-30T16:52:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6d3400640 1 -- 172.21.15.59:0/1177765177 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 274233784 0 0) 0x7fb6d415f060 con 0x7fb6d40d0560 2024-05-30T16:52:16.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6d3e00640 1 --2- 172.21.15.59:0/1177765177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d40af720 0x7fb6d415b9d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40097c0 tx=0x7fb6c401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bac51fb0dc57e5e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:16.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6d3400640 1 -- 172.21.15.59:0/1177765177 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40aa5f0 con 0x7fb6d40af720 2024-05-30T16:52:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6d3400640 1 -- 172.21.15.59:0/1177765177 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c40af070 con 0x7fb6d40af720 2024-05-30T16:52:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.337+0000 7fb6d3400640 1 -- 172.21.15.59:0/1177765177 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40aa9b0 con 0x7fb6d40af720 2024-05-30T16:52:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 -- 172.21.15.59:0/1177765177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d40af720 msgr2=0x7fb6d415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 --2- 172.21.15.59:0/1177765177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d40af720 0x7fb6d415b9d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40097c0 tx=0x7fb6c401c470 comp rx=0 tx=0).stop 2024-05-30T16:52:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 -- 172.21.15.59:0/1177765177 shutdown_connections 2024-05-30T16:52:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 --2- 172.21.15.59:0/1177765177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d40af720 0x7fb6d415b9d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 -- 172.21.15.59:0/1177765177 >> 172.21.15.59:0/1177765177 conn(0x7fb6d40b22d0 msgr2=0x7fb6d40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 -- 172.21.15.59:0/1177765177 shutdown_connections 2024-05-30T16:52:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 -- 172.21.15.59:0/1177765177 wait complete. 2024-05-30T16:52:16.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 Processor -- start 2024-05-30T16:52:16.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 -- start start 2024-05-30T16:52:16.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d406e900 0x7fb6d415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:16.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d40af720 0x7fb6d414bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:16.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d40d0560 0x7fb6d4156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d415c830 con 0x7fb6d406e900 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d415bf10 con 0x7fb6d40d0560 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6daa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d4158dd0 con 0x7fb6d40af720 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d406e900 0x7fb6d415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d406e900 0x7fb6d415aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46640/0 (socket says 172.21.15.59:46640) 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6d3e00640 1 -- 172.21.15.59:0/1129500591 learned_addr learned my addr 172.21.15.59:0/1129500591 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6cb400640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d40af720 0x7fb6d414bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6d8a00640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d40d0560 0x7fb6d4156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6d3e00640 1 -- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d40af720 msgr2=0x7fb6d414bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6d3e00640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d40af720 0x7fb6d414bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6d3e00640 1 -- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d40d0560 msgr2=0x7fb6d4156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6d3e00640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d40d0560 0x7fb6d4156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6d3e00640 1 -- 172.21.15.59:0/1129500591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d40b2c20 con 0x7fb6d406e900 2024-05-30T16:52:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.341+0000 7fb6cb400640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d40af720 0x7fb6d414bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.345+0000 7fb6d3e00640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d406e900 0x7fb6d415aa60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40ac040 tx=0x7fb6c401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.345+0000 7fb6d0c00640 1 -- 172.21.15.59:0/1129500591 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40be610 con 0x7fb6d406e900 2024-05-30T16:52:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.345+0000 7fb6d0c00640 1 -- 172.21.15.59:0/1129500591 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c40be7b0 con 0x7fb6d406e900 2024-05-30T16:52:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.345+0000 7fb6d0c00640 1 -- 172.21.15.59:0/1129500591 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40beba0 con 0x7fb6d406e900 2024-05-30T16:52:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.345+0000 7fb6daa00640 1 -- 172.21.15.59:0/1129500591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d40b2fc0 con 0x7fb6d406e900 2024-05-30T16:52:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.345+0000 7fb6daa00640 1 -- 172.21.15.59:0/1129500591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d40cebc0 con 0x7fb6d406e900 2024-05-30T16:52:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.345+0000 7fb6daa00640 1 -- 172.21.15.59:0/1129500591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d4068a90 con 0x7fb6d406e900 2024-05-30T16:52:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.345+0000 7fb6d0c00640 1 -- 172.21.15.59:0/1129500591 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fb6c40bc020 con 0x7fb6d406e900 2024-05-30T16:52:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.345+0000 7fb6d0c00640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6b0068680 0x7fb6b006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.345+0000 7fb6d0c00640 1 -- 172.21.15.59:0/1129500591 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7fb6c4121200 con 0x7fb6d406e900 2024-05-30T16:52:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.345+0000 7fb6cb400640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6b0068680 0x7fb6b006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.349+0000 7fb6cb400640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6b0068680 0x7fb6b006ab40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4157fa0 tx=0x7fb6bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.349+0000 7fb6d0c00640 1 -- 172.21.15.59:0/1129500591 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6c40c5030 con 0x7fb6d406e900 2024-05-30T16:52:16.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.517+0000 7fb6daa00640 1 -- 172.21.15.59:0/1129500591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6d406cd10 con 0x7fb6d406e900 2024-05-30T16:52:16.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.517+0000 7fb6d0c00640 1 -- 172.21.15.59:0/1129500591 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16644 (secure 0 0 0) 0x7fb6c4016090 con 0x7fb6d406e900 2024-05-30T16:52:16.520 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:16.520 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":47,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:52:13.757616+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:52:09.850441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T16:52:11.108687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:52:16.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.521+0000 7fb6daa00640 1 -- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6b0068680 msgr2=0x7fb6b006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.521+0000 7fb6daa00640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6b0068680 0x7fb6b006ab40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4157fa0 tx=0x7fb6bc009040 comp rx=0 tx=0).stop 2024-05-30T16:52:16.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.521+0000 7fb6daa00640 1 -- 172.21.15.59:0/1129500591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d406e900 msgr2=0x7fb6d415aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.521+0000 7fb6daa00640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d406e900 0x7fb6d415aa60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40ac040 tx=0x7fb6c401acb0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.521+0000 7fb6daa00640 1 -- 172.21.15.59:0/1129500591 shutdown_connections 2024-05-30T16:52:16.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.521+0000 7fb6daa00640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6b0068680 0x7fb6b006ab40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.521+0000 7fb6daa00640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d40d0560 0x7fb6d4156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.521+0000 7fb6daa00640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d40af720 0x7fb6d414bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.521+0000 7fb6daa00640 1 --2- 172.21.15.59:0/1129500591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d406e900 0x7fb6d415aa60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.521+0000 7fb6daa00640 1 -- 172.21.15.59:0/1129500591 >> 172.21.15.59:0/1129500591 conn(0x7fb6d40b22d0 msgr2=0x7fb6d4073580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:16.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.521+0000 7fb6daa00640 1 -- 172.21.15.59:0/1129500591 shutdown_connections 2024-05-30T16:52:16.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.521+0000 7fb6daa00640 1 -- 172.21.15.59:0/1129500591 wait complete. 2024-05-30T16:52:16.541 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:52:16.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:52:16.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.677+0000 7fddd9c00640 1 Processor -- start 2024-05-30T16:52:16.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.677+0000 7fddd9c00640 1 -- start start 2024-05-30T16:52:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.681+0000 7fddd9c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddd4159df0 0x7fddd40ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.681+0000 7fddd9c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd415d730 con 0x7fddd415a1d0 2024-05-30T16:52:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.681+0000 7fddd9c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd40b3370 con 0x7fddd40b3e50 2024-05-30T16:52:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.681+0000 7fddd9c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fddd40b3650 con 0x7fddd4159df0 2024-05-30T16:52:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.681+0000 7fddcbe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fddd415a1d0 0x7fddd415ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53858/0 (socket says 172.21.15.59:53858) 2024-05-30T16:52:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.681+0000 7fddcbe00640 1 -- 172.21.15.59:0/1058124085 learned_addr learned my addr 172.21.15.59:0/1058124085 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.681+0000 7fddd2a00640 1 --2- 172.21.15.59:0/1058124085 >> v2:172.21.15.59:3300/0 conn(0x7fddd4159df0 0x7fddd40ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:16.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.681+0000 7fddd2a00640 1 -- 172.21.15.59:0/1058124085 >> v1:172.21.15.107:6789/0 conn(0x7fddd40b3e50 legacy=0x7fddd415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:16.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.681+0000 7fddd2a00640 1 -- 172.21.15.59:0/1058124085 >> v1:172.21.15.59:6789/0 conn(0x7fddd415a1d0 legacy=0x7fddd415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.681+0000 7fddd2a00640 1 -- 172.21.15.59:0/1058124085 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd40b3930 con 0x7fddd4159df0 2024-05-30T16:52:16.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.681+0000 7fddd2000640 1 -- 172.21.15.59:0/1058124085 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940786179 0 0) 0x7fddd415d730 con 0x7fddd415a1d0 2024-05-30T16:52:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd2a00640 1 --2- 172.21.15.59:0/1058124085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd4159df0 0x7fddd40ad1b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fddc40097c0 tx=0x7fddc401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771e817a0b149db2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd2000640 1 -- 172.21.15.59:0/1058124085 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40b0070 con 0x7fddd4159df0 2024-05-30T16:52:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd2000640 1 -- 172.21.15.59:0/1058124085 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc40ab600 con 0x7fddd4159df0 2024-05-30T16:52:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd2000640 1 -- 172.21.15.59:0/1058124085 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40ab9d0 con 0x7fddd4159df0 2024-05-30T16:52:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd9c00640 1 -- 172.21.15.59:0/1058124085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd4159df0 msgr2=0x7fddd40ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd9c00640 1 --2- 172.21.15.59:0/1058124085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd4159df0 0x7fddd40ad1b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fddc40097c0 tx=0x7fddc401c460 comp rx=0 tx=0).stop 2024-05-30T16:52:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd9c00640 1 -- 172.21.15.59:0/1058124085 shutdown_connections 2024-05-30T16:52:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd9c00640 1 --2- 172.21.15.59:0/1058124085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd4159df0 0x7fddd40ad1b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd9c00640 1 -- 172.21.15.59:0/1058124085 >> 172.21.15.59:0/1058124085 conn(0x7fddd40b22d0 msgr2=0x7fddd40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd9c00640 1 -- 172.21.15.59:0/1058124085 shutdown_connections 2024-05-30T16:52:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd9c00640 1 -- 172.21.15.59:0/1058124085 wait complete. 2024-05-30T16:52:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd9c00640 1 Processor -- start 2024-05-30T16:52:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.685+0000 7fddd9c00640 1 -- start start 2024-05-30T16:52:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd9c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd40b3e50 0x7fddd4167900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd9c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddd4159df0 0x7fddd4099910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd9c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddd415a1d0 0x7fddd4138650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd9c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fddd416a7a0 con 0x7fddd40b3e50 2024-05-30T16:52:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd9c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fddd416a620 con 0x7fddd4159df0 2024-05-30T16:52:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd9c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fddd416a920 con 0x7fddd415a1d0 2024-05-30T16:52:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd40b3e50 0x7fddd4167900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd40b3e50 0x7fddd4167900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46660/0 (socket says 172.21.15.59:46660) 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd2a00640 1 -- 172.21.15.59:0/3463239384 learned_addr learned my addr 172.21.15.59:0/3463239384 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddcbe00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddd4159df0 0x7fddd4099910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd3400640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddd415a1d0 0x7fddd4138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd2a00640 1 -- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddd415a1d0 msgr2=0x7fddd4138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd2a00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddd415a1d0 0x7fddd4138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd2a00640 1 -- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddd4159df0 msgr2=0x7fddd4099910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd2a00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddd4159df0 0x7fddd4099910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd2a00640 1 -- 172.21.15.59:0/3463239384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd4166860 con 0x7fddd40b3e50 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd3400640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddd415a1d0 0x7fddd4138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd2a00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd40b3e50 0x7fddd4167900 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fddc40ae040 tx=0x7fddc401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddcaa00640 1 -- 172.21.15.59:0/3463239384 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40b0050 con 0x7fddd40b3e50 2024-05-30T16:52:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddcaa00640 1 -- 172.21.15.59:0/3463239384 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc40bc070 con 0x7fddd40b3e50 2024-05-30T16:52:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddcaa00640 1 -- 172.21.15.59:0/3463239384 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40aae20 con 0x7fddd40b3e50 2024-05-30T16:52:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd9c00640 1 -- 172.21.15.59:0/3463239384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd4166b40 con 0x7fddd40b3e50 2024-05-30T16:52:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd9c00640 1 -- 172.21.15.59:0/3463239384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd4167100 con 0x7fddd40b3e50 2024-05-30T16:52:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddd9c00640 1 -- 172.21.15.59:0/3463239384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd4068a90 con 0x7fddd40b3e50 2024-05-30T16:52:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.689+0000 7fddcaa00640 1 -- 172.21.15.59:0/3463239384 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fddc40ab440 con 0x7fddd40b3e50 2024-05-30T16:52:16.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.693+0000 7fddcaa00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddb0068680 0x7fddb006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:16.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.693+0000 7fddcaa00640 1 -- 172.21.15.59:0/3463239384 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7fddc4121af0 con 0x7fddd40b3e50 2024-05-30T16:52:16.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.693+0000 7fddcbe00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddb0068680 0x7fddb006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:16.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.693+0000 7fddcbe00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddb0068680 0x7fddb006ab40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fddd414de80 tx=0x7fddbc007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:16.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.697+0000 7fddcaa00640 1 -- 172.21.15.59:0/3463239384 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fddd40adb00 con 0x7fddd40b3e50 2024-05-30T16:52:16.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.857+0000 7fddd9c00640 1 -- 172.21.15.59:0/3463239384 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fddd40b2900 con 0x7fddb0068680 2024-05-30T16:52:16.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.865+0000 7fddcaa00640 1 -- 172.21.15.59:0/3463239384 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245545 (secure 0 0 0) 0x7fddd40b2900 con 0x7fddb0068680 2024-05-30T16:52:16.872 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:16.873 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:52:16.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.869+0000 7fddd9c00640 1 -- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddb0068680 msgr2=0x7fddb006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.869+0000 7fddd9c00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddb0068680 0x7fddb006ab40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fddd414de80 tx=0x7fddbc007df0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.869+0000 7fddd9c00640 1 -- 172.21.15.59:0/3463239384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd40b3e50 msgr2=0x7fddd4167900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:16.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.869+0000 7fddd9c00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd40b3e50 0x7fddd4167900 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fddc40ae040 tx=0x7fddc401aca0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.869+0000 7fddd9c00640 1 -- 172.21.15.59:0/3463239384 shutdown_connections 2024-05-30T16:52:16.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.869+0000 7fddd9c00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddb0068680 0x7fddb006ab40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.869+0000 7fddd9c00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddd415a1d0 0x7fddd4138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.869+0000 7fddd9c00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddd4159df0 0x7fddd4099910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.869+0000 7fddd9c00640 1 --2- 172.21.15.59:0/3463239384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd40b3e50 0x7fddd4167900 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:16.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.869+0000 7fddd9c00640 1 -- 172.21.15.59:0/3463239384 >> 172.21.15.59:0/3463239384 conn(0x7fddd40b22d0 msgr2=0x7fddd40af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:16.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.869+0000 7fddd9c00640 1 -- 172.21.15.59:0/3463239384 shutdown_connections 2024-05-30T16:52:16.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:16.869+0000 7fddd9c00640 1 -- 172.21.15.59:0/3463239384 wait complete. 2024-05-30T16:52:16.889 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-05-30T16:52:15.116857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275436,"kb_used_data":5164,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754699284,"statfs":{"total":773094113280,"available":772812066816,"internally_reserved":0,"allocated":5287936,"data_stored":2799205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.379628"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747138+0000","last_change":"2024-05-30T16:52:11.747138+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747138+0000","last_undegraded":"2024-05-30T16:52:11.747138+0000","last_fullsized":"2024-05-30T16:52:11.747138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745784+0000","last_change":"2024-05-30T16:52:11.745784+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745784+0000","last_undegraded":"2024-05-30T16:52:11.745784+0000","last_fullsized":"2024-05-30T16:52:11.745784+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.756091+0000","last_change":"2024-05-30T16:52:11.756091+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.756091+0000","last_undegraded":"2024-05-30T16:52:11.756091+0000","last_fullsized":"2024-05-30T16:52:11.756091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.757759+0000","last_change":"2024-05-30T16:52:11.757759+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.757759+0000","last_undegraded":"2024-05-30T16:52:11.757759+0000","last_fullsized":"2024-05-30T16:52:11.757759+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746121+0000","last_change":"2024-05-30T16:52:11.746121+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746121+0000","last_undegraded":"2024-05-30T16:52:11.746121+0000","last_fullsized":"2024-05-30T16:52:11.746121+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:52:11.734755+0000","last_change":"2024-05-30T16:52:11.734755+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.734755+0000","last_undegraded":"2024-05-30T16:52:11.734755+0000","last_fullsized":"2024-05-30T16:52:11.734755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745496+0000","last_change":"2024-05-30T16:52:11.745496+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745496+0000","last_undegraded":"2024-05-30T16:52:11.745496+0000","last_fullsized":"2024-05-30T16:52:11.745496+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.761114+0000","last_change":"2024-05-30T16:52:11.761114+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.761114+0000","last_undegraded":"2024-05-30T16:52:11.761114+0000","last_fullsized":"2024-05-30T16:52:11.761114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.760182+0000","last_change":"2024-05-30T16:52:11.760182+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.760182+0000","last_undegraded":"2024-05-30T16:52:11.760182+0000","last_fullsized":"2024-05-30T16:52:11.760182+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.758558+0000","last_change":"2024-05-30T16:52:11.758558+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.758558+0000","last_undegraded":"2024-05-30T16:52:11.758558+0000","last_fullsized":"2024-05-30T16:52:11.758558+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.766067+0000","last_change":"2024-05-30T16:52:11.766067+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.766067+0000","last_undegraded":"2024-05-30T16:52:11.766067+0000","last_fullsized":"2024-05-30T16:52:11.766067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748560+0000","last_change":"2024-05-30T16:52:11.748560+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748560+0000","last_undegraded":"2024-05-30T16:52:11.748560+0000","last_fullsized":"2024-05-30T16:52:11.748560+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.755351+0000","last_change":"2024-05-30T16:52:11.755351+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.755351+0000","last_undegraded":"2024-05-30T16:52:11.755351+0000","last_fullsized":"2024-05-30T16:52:11.755351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.767001+0000","last_change":"2024-05-30T16:52:11.767001+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.767001+0000","last_undegraded":"2024-05-30T16:52:11.767001+0000","last_fullsized":"2024-05-30T16:52:11.767001+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:52:11.734755+0000","last_change":"2024-05-30T16:52:11.734755+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.734755+0000","last_undegraded":"2024-05-30T16:52:11.734755+0000","last_fullsized":"2024-05-30T16:52:11.734755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752070+0000","last_change":"2024-05-30T16:52:11.752070+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752070+0000","last_undegraded":"2024-05-30T16:52:11.752070+0000","last_fullsized":"2024-05-30T16:52:11.752070+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753351+0000","last_change":"2024-05-30T16:52:11.753351+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753351+0000","last_undegraded":"2024-05-30T16:52:11.753351+0000","last_fullsized":"2024-05-30T16:52:11.753351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.754200+0000","last_change":"2024-05-30T16:52:11.754200+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.754200+0000","last_undegraded":"2024-05-30T16:52:11.754200+0000","last_fullsized":"2024-05-30T16:52:11.754200+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753706+0000","last_change":"2024-05-30T16:52:11.753706+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753706+0000","last_undegraded":"2024-05-30T16:52:11.753706+0000","last_fullsized":"2024-05-30T16:52:11.753706+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748657+0000","last_change":"2024-05-30T16:52:11.748657+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748657+0000","last_undegraded":"2024-05-30T16:52:11.748657+0000","last_fullsized":"2024-05-30T16:52:11.748657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:52:11.734755+0000","last_change":"2024-05-30T16:52:11.734755+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.734755+0000","last_undegraded":"2024-05-30T16:52:11.734755+0000","last_fullsized":"2024-05-30T16:52:11.734755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.766551+0000","last_change":"2024-05-30T16:52:11.766551+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.766551+0000","last_undegraded":"2024-05-30T16:52:11.766551+0000","last_fullsized":"2024-05-30T16:52:11.766551+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.751797+0000","last_change":"2024-05-30T16:52:11.751797+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.751797+0000","last_undegraded":"2024-05-30T16:52:11.751797+0000","last_fullsized":"2024-05-30T16:52:11.751797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.751513+0000","last_change":"2024-05-30T16:52:11.751513+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.751513+0000","last_undegraded":"2024-05-30T16:52:11.751513+0000","last_fullsized":"2024-05-30T16:52:11.751513+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753951+0000","last_change":"2024-05-30T16:52:11.753951+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753951+0000","last_undegraded":"2024-05-30T16:52:11.753951+0000","last_fullsized":"2024-05-30T16:52:11.753951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748138+0000","last_change":"2024-05-30T16:52:11.748138+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748138+0000","last_undegraded":"2024-05-30T16:52:11.748138+0000","last_fullsized":"2024-05-30T16:52:11.748138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752041+0000","last_change":"2024-05-30T16:52:11.752041+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752041+0000","last_undegraded":"2024-05-30T16:52:11.752041+0000","last_fullsized":"2024-05-30T16:52:11.752041+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747847+0000","last_change":"2024-05-30T16:52:11.747847+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747847+0000","last_undegraded":"2024-05-30T16:52:11.747847+0000","last_fullsized":"2024-05-30T16:52:11.747847+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.751469+0000","last_change":"2024-05-30T16:52:11.751469+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.751469+0000","last_undegraded":"2024-05-30T16:52:11.751469+0000","last_fullsized":"2024-05-30T16:52:11.751469+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750983+0000","last_change":"2024-05-30T16:52:11.750983+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750983+0000","last_undegraded":"2024-05-30T16:52:11.750983+0000","last_fullsized":"2024-05-30T16:52:11.750983+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:52:11.734755+0000","last_change":"2024-05-30T16:52:11.734755+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.734755+0000","last_undegraded":"2024-05-30T16:52:11.734755+0000","last_fullsized":"2024-05-30T16:52:11.734755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747251+0000","last_change":"2024-05-30T16:52:11.747251+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747251+0000","last_undegraded":"2024-05-30T16:52:11.747251+0000","last_fullsized":"2024-05-30T16:52:11.747251+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750137+0000","last_change":"2024-05-30T16:52:11.750137+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750137+0000","last_undegraded":"2024-05-30T16:52:11.750137+0000","last_fullsized":"2024-05-30T16:52:11.750137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-05-30T16:52:10.742930+0000","last_change":"2024-05-30T16:52:10.742930+0000","last_active":"2024-05-30T16:52:10.729975+0000","last_peered":"2024-05-30T16:52:10.729975+0000","last_clean":"2024-05-30T16:52:10.729975+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:10.742930+0000","last_undegraded":"2024-05-30T16:52:10.742930+0000","last_fullsized":"2024-05-30T16:52:10.742930+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753479+0000","last_change":"2024-05-30T16:52:11.753479+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753479+0000","last_undegraded":"2024-05-30T16:52:11.753479+0000","last_fullsized":"2024-05-30T16:52:11.753479+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.768971+0000","last_change":"2024-05-30T16:52:11.767326+0000","last_active":"2024-05-30T16:52:11.768971+0000","last_peered":"2024-05-30T16:52:11.768971+0000","last_clean":"2024-05-30T16:52:11.768971+0000","last_became_active":"2024-05-30T16:52:11.766962+0000","last_became_peered":"2024-05-30T16:52:11.766962+0000","last_unstale":"2024-05-30T16:52:11.768971+0000","last_undegraded":"2024-05-30T16:52:11.768971+0000","last_fullsized":"2024-05-30T16:52:11.768971+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:35.144180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745368+0000","last_change":"2024-05-30T16:52:11.745368+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745368+0000","last_undegraded":"2024-05-30T16:52:11.745368+0000","last_fullsized":"2024-05-30T16:52:11.745368+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.769786+0000","last_change":"2024-05-30T16:52:11.762080+0000","last_active":"2024-05-30T16:52:11.769786+0000","last_peered":"2024-05-30T16:52:11.769786+0000","last_clean":"2024-05-30T16:52:11.769786+0000","last_became_active":"2024-05-30T16:52:11.761680+0000","last_became_peered":"2024-05-30T16:52:11.761680+0000","last_unstale":"2024-05-30T16:52:11.769786+0000","last_undegraded":"2024-05-30T16:52:11.769786+0000","last_fullsized":"2024-05-30T16:52:11.769786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:00.336519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.749399+0000","last_change":"2024-05-30T16:52:11.749399+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.749399+0000","last_undegraded":"2024-05-30T16:52:11.749399+0000","last_fullsized":"2024-05-30T16:52:11.749399+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.759758+0000","last_change":"2024-05-30T16:52:11.756991+0000","last_active":"2024-05-30T16:52:11.759758+0000","last_peered":"2024-05-30T16:52:11.759758+0000","last_clean":"2024-05-30T16:52:11.759758+0000","last_became_active":"2024-05-30T16:52:11.756716+0000","last_became_peered":"2024-05-30T16:52:11.756716+0000","last_unstale":"2024-05-30T16:52:11.759758+0000","last_undegraded":"2024-05-30T16:52:11.759758+0000","last_fullsized":"2024-05-30T16:52:11.759758+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:42:42.339988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750426+0000","last_change":"2024-05-30T16:52:11.750426+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750426+0000","last_undegraded":"2024-05-30T16:52:11.750426+0000","last_fullsized":"2024-05-30T16:52:11.750426+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-05-30T16:52:10.743712+0000","last_change":"2024-05-30T16:52:10.743712+0000","last_active":"2024-05-30T16:52:10.729975+0000","last_peered":"2024-05-30T16:52:10.729975+0000","last_clean":"2024-05-30T16:52:10.729975+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:10.743712+0000","last_undegraded":"2024-05-30T16:52:10.743712+0000","last_fullsized":"2024-05-30T16:52:10.743712+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.760252+0000","last_change":"2024-05-30T16:52:11.760252+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.760252+0000","last_undegraded":"2024-05-30T16:52:11.760252+0000","last_fullsized":"2024-05-30T16:52:11.760252+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.763688+0000","last_change":"2024-05-30T16:52:11.757778+0000","last_active":"2024-05-30T16:52:11.763688+0000","last_peered":"2024-05-30T16:52:11.763688+0000","last_clean":"2024-05-30T16:52:11.763688+0000","last_became_active":"2024-05-30T16:52:11.757401+0000","last_became_peered":"2024-05-30T16:52:11.757401+0000","last_unstale":"2024-05-30T16:52:11.763688+0000","last_undegraded":"2024-05-30T16:52:11.763688+0000","last_fullsized":"2024-05-30T16:52:11.763688+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:30.838153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750162+0000","last_change":"2024-05-30T16:52:11.750162+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750162+0000","last_undegraded":"2024-05-30T16:52:11.750162+0000","last_fullsized":"2024-05-30T16:52:11.750162+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.760258+0000","last_change":"2024-05-30T16:52:11.754254+0000","last_active":"2024-05-30T16:52:11.760258+0000","last_peered":"2024-05-30T16:52:11.760258+0000","last_clean":"2024-05-30T16:52:11.760258+0000","last_became_active":"2024-05-30T16:52:11.753946+0000","last_became_peered":"2024-05-30T16:52:11.753946+0000","last_unstale":"2024-05-30T16:52:11.760258+0000","last_undegraded":"2024-05-30T16:52:11.760258+0000","last_fullsized":"2024-05-30T16:52:11.760258+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:15.949367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752244+0000","last_change":"2024-05-30T16:52:11.752244+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752244+0000","last_undegraded":"2024-05-30T16:52:11.752244+0000","last_fullsized":"2024-05-30T16:52:11.752244+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.776273+0000","last_change":"2024-05-30T16:52:11.771861+0000","last_active":"2024-05-30T16:52:11.776273+0000","last_peered":"2024-05-30T16:52:11.776273+0000","last_clean":"2024-05-30T16:52:11.776273+0000","last_became_active":"2024-05-30T16:52:11.771573+0000","last_became_peered":"2024-05-30T16:52:11.771573+0000","last_unstale":"2024-05-30T16:52:11.776273+0000","last_undegraded":"2024-05-30T16:52:11.776273+0000","last_fullsized":"2024-05-30T16:52:11.776273+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:34.799686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753597+0000","last_change":"2024-05-30T16:52:11.753597+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753597+0000","last_undegraded":"2024-05-30T16:52:11.753597+0000","last_fullsized":"2024-05-30T16:52:11.753597+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.768990+0000","last_change":"2024-05-30T16:52:11.768155+0000","last_active":"2024-05-30T16:52:11.768990+0000","last_peered":"2024-05-30T16:52:11.768990+0000","last_clean":"2024-05-30T16:52:11.768990+0000","last_became_active":"2024-05-30T16:52:11.767557+0000","last_became_peered":"2024-05-30T16:52:11.767557+0000","last_unstale":"2024-05-30T16:52:11.768990+0000","last_undegraded":"2024-05-30T16:52:11.768990+0000","last_fullsized":"2024-05-30T16:52:11.768990+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:47:42.557576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746658+0000","last_change":"2024-05-30T16:52:11.746658+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746658+0000","last_undegraded":"2024-05-30T16:52:11.746658+0000","last_fullsized":"2024-05-30T16:52:11.746658+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.776371+0000","last_change":"2024-05-30T16:52:11.773802+0000","last_active":"2024-05-30T16:52:11.776371+0000","last_peered":"2024-05-30T16:52:11.776371+0000","last_clean":"2024-05-30T16:52:11.776371+0000","last_became_active":"2024-05-30T16:52:11.771528+0000","last_became_peered":"2024-05-30T16:52:11.771528+0000","last_unstale":"2024-05-30T16:52:11.776371+0000","last_undegraded":"2024-05-30T16:52:11.776371+0000","last_fullsized":"2024-05-30T16:52:11.776371+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:01:16.197933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:52:11.734755+0000","last_change":"2024-05-30T16:52:11.734755+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.734755+0000","last_undegraded":"2024-05-30T16:52:11.734755+0000","last_fullsized":"2024-05-30T16:52:11.734755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.765260+0000","last_change":"2024-05-30T16:52:11.763496+0000","last_active":"2024-05-30T16:52:11.765260+0000","last_peered":"2024-05-30T16:52:11.765260+0000","last_clean":"2024-05-30T16:52:11.765260+0000","last_became_active":"2024-05-30T16:52:11.763141+0000","last_became_peered":"2024-05-30T16:52:11.763141+0000","last_unstale":"2024-05-30T16:52:11.765260+0000","last_undegraded":"2024-05-30T16:52:11.765260+0000","last_fullsized":"2024-05-30T16:52:11.765260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:19:41.036951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748364+0000","last_change":"2024-05-30T16:52:11.748364+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748364+0000","last_undegraded":"2024-05-30T16:52:11.748364+0000","last_fullsized":"2024-05-30T16:52:11.748364+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.770892+0000","last_change":"2024-05-30T16:52:11.763318+0000","last_active":"2024-05-30T16:52:11.770892+0000","last_peered":"2024-05-30T16:52:11.770892+0000","last_clean":"2024-05-30T16:52:11.770892+0000","last_became_active":"2024-05-30T16:52:11.763052+0000","last_became_peered":"2024-05-30T16:52:11.763052+0000","last_unstale":"2024-05-30T16:52:11.770892+0000","last_undegraded":"2024-05-30T16:52:11.770892+0000","last_fullsized":"2024-05-30T16:52:11.770892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:37:33.427945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752659+0000","last_change":"2024-05-30T16:52:11.752659+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752659+0000","last_undegraded":"2024-05-30T16:52:11.752659+0000","last_fullsized":"2024-05-30T16:52:11.752659+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-05-30T16:52:10.743308+0000","last_change":"2024-05-30T16:52:10.743308+0000","last_active":"2024-05-30T16:52:10.729975+0000","last_peered":"2024-05-30T16:52:10.729975+0000","last_clean":"2024-05-30T16:52:10.729975+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:10.743308+0000","last_undegraded":"2024-05-30T16:52:10.743308+0000","last_fullsized":"2024-05-30T16:52:10.743308+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.759822+0000","last_change":"2024-05-30T16:52:11.759822+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.759822+0000","last_undegraded":"2024-05-30T16:52:11.759822+0000","last_fullsized":"2024-05-30T16:52:11.759822+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.766760+0000","last_change":"2024-05-30T16:52:11.765673+0000","last_active":"2024-05-30T16:52:11.766760+0000","last_peered":"2024-05-30T16:52:11.766760+0000","last_clean":"2024-05-30T16:52:11.766760+0000","last_became_active":"2024-05-30T16:52:11.765157+0000","last_became_peered":"2024-05-30T16:52:11.765157+0000","last_unstale":"2024-05-30T16:52:11.766760+0000","last_undegraded":"2024-05-30T16:52:11.766760+0000","last_fullsized":"2024-05-30T16:52:11.766760+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:20.133814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:52:11.734755+0000","last_change":"2024-05-30T16:52:11.734755+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.734755+0000","last_undegraded":"2024-05-30T16:52:11.734755+0000","last_fullsized":"2024-05-30T16:52:11.734755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-05-30T16:52:10.742700+0000","last_change":"2024-05-30T16:52:10.742700+0000","last_active":"2024-05-30T16:52:10.729975+0000","last_peered":"2024-05-30T16:52:10.729975+0000","last_clean":"2024-05-30T16:52:10.729975+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:10.742700+0000","last_undegraded":"2024-05-30T16:52:10.742700+0000","last_fullsized":"2024-05-30T16:52:10.742700+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.744985+0000","last_change":"2024-05-30T16:52:11.744985+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.744985+0000","last_undegraded":"2024-05-30T16:52:11.744985+0000","last_fullsized":"2024-05-30T16:52:11.744985+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.761275+0000","last_change":"2024-05-30T16:52:11.754549+0000","last_active":"2024-05-30T16:52:11.761275+0000","last_peered":"2024-05-30T16:52:11.761275+0000","last_clean":"2024-05-30T16:52:11.761275+0000","last_became_active":"2024-05-30T16:52:11.754201+0000","last_became_peered":"2024-05-30T16:52:11.754201+0000","last_unstale":"2024-05-30T16:52:11.761275+0000","last_undegraded":"2024-05-30T16:52:11.761275+0000","last_fullsized":"2024-05-30T16:52:11.761275+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:07:32.823371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747354+0000","last_change":"2024-05-30T16:52:11.747354+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747354+0000","last_undegraded":"2024-05-30T16:52:11.747354+0000","last_fullsized":"2024-05-30T16:52:11.747354+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.766290+0000","last_change":"2024-05-30T16:52:11.759174+0000","last_active":"2024-05-30T16:52:11.766290+0000","last_peered":"2024-05-30T16:52:11.766290+0000","last_clean":"2024-05-30T16:52:11.766290+0000","last_became_active":"2024-05-30T16:52:11.758846+0000","last_became_peered":"2024-05-30T16:52:11.758846+0000","last_unstale":"2024-05-30T16:52:11.766290+0000","last_undegraded":"2024-05-30T16:52:11.766290+0000","last_fullsized":"2024-05-30T16:52:11.766290+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:55:12.259158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.759726+0000","last_change":"2024-05-30T16:52:11.759726+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.759726+0000","last_undegraded":"2024-05-30T16:52:11.759726+0000","last_fullsized":"2024-05-30T16:52:11.759726+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.764953+0000","last_change":"2024-05-30T16:52:11.762654+0000","last_active":"2024-05-30T16:52:11.764953+0000","last_peered":"2024-05-30T16:52:11.764953+0000","last_clean":"2024-05-30T16:52:11.764953+0000","last_became_active":"2024-05-30T16:52:11.762385+0000","last_became_peered":"2024-05-30T16:52:11.762385+0000","last_unstale":"2024-05-30T16:52:11.764953+0000","last_undegraded":"2024-05-30T16:52:11.764953+0000","last_fullsized":"2024-05-30T16:52:11.764953+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:28:04.301693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752775+0000","last_change":"2024-05-30T16:52:11.752775+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752775+0000","last_undegraded":"2024-05-30T16:52:11.752775+0000","last_fullsized":"2024-05-30T16:52:11.752775+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.760366+0000","last_change":"2024-05-30T16:52:11.754550+0000","last_active":"2024-05-30T16:52:11.760366+0000","last_peered":"2024-05-30T16:52:11.760366+0000","last_clean":"2024-05-30T16:52:11.760366+0000","last_became_active":"2024-05-30T16:52:11.754274+0000","last_became_peered":"2024-05-30T16:52:11.754274+0000","last_unstale":"2024-05-30T16:52:11.760366+0000","last_undegraded":"2024-05-30T16:52:11.760366+0000","last_fullsized":"2024-05-30T16:52:11.760366+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:48.116676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.754740+0000","last_change":"2024-05-30T16:52:11.754740+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.754740+0000","last_undegraded":"2024-05-30T16:52:11.754740+0000","last_fullsized":"2024-05-30T16:52:11.754740+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-05-30T16:52:10.742811+0000","last_change":"2024-05-30T16:52:10.742811+0000","last_active":"2024-05-30T16:52:10.729975+0000","last_peered":"2024-05-30T16:52:10.729975+0000","last_clean":"2024-05-30T16:52:10.729975+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:10.742811+0000","last_undegraded":"2024-05-30T16:52:10.742811+0000","last_fullsized":"2024-05-30T16:52:10.742811+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:52:11.734755+0000","last_change":"2024-05-30T16:52:11.734755+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.734755+0000","last_undegraded":"2024-05-30T16:52:11.734755+0000","last_fullsized":"2024-05-30T16:52:11.734755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-05-30T16:52:10.742806+0000","last_change":"2024-05-30T16:52:10.742806+0000","last_active":"2024-05-30T16:52:10.729975+0000","last_peered":"2024-05-30T16:52:10.729975+0000","last_clean":"2024-05-30T16:52:10.729975+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:10.742806+0000","last_undegraded":"2024-05-30T16:52:10.742806+0000","last_fullsized":"2024-05-30T16:52:10.742806+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.749065+0000","last_change":"2024-05-30T16:52:11.749065+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.749065+0000","last_undegraded":"2024-05-30T16:52:11.749065+0000","last_fullsized":"2024-05-30T16:52:11.749065+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.766062+0000","last_change":"2024-05-30T16:52:11.761712+0000","last_active":"2024-05-30T16:52:11.766062+0000","last_peered":"2024-05-30T16:52:11.766062+0000","last_clean":"2024-05-30T16:52:11.766062+0000","last_became_active":"2024-05-30T16:52:11.761375+0000","last_became_peered":"2024-05-30T16:52:11.761375+0000","last_unstale":"2024-05-30T16:52:11.766062+0000","last_undegraded":"2024-05-30T16:52:11.766062+0000","last_fullsized":"2024-05-30T16:52:11.766062+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:42:42.339988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746595+0000","last_change":"2024-05-30T16:52:11.746595+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746595+0000","last_undegraded":"2024-05-30T16:52:11.746595+0000","last_fullsized":"2024-05-30T16:52:11.746595+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.770418+0000","last_change":"2024-05-30T16:52:11.765519+0000","last_active":"2024-05-30T16:52:11.770418+0000","last_peered":"2024-05-30T16:52:11.770418+0000","last_clean":"2024-05-30T16:52:11.770418+0000","last_became_active":"2024-05-30T16:52:11.765207+0000","last_became_peered":"2024-05-30T16:52:11.765207+0000","last_unstale":"2024-05-30T16:52:11.770418+0000","last_undegraded":"2024-05-30T16:52:11.770418+0000","last_fullsized":"2024-05-30T16:52:11.770418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:58.645778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750923+0000","last_change":"2024-05-30T16:52:11.750923+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750923+0000","last_undegraded":"2024-05-30T16:52:11.750923+0000","last_fullsized":"2024-05-30T16:52:11.750923+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.759671+0000","last_change":"2024-05-30T16:52:11.755523+0000","last_active":"2024-05-30T16:52:11.759671+0000","last_peered":"2024-05-30T16:52:11.759671+0000","last_clean":"2024-05-30T16:52:11.759671+0000","last_became_active":"2024-05-30T16:52:11.755205+0000","last_became_peered":"2024-05-30T16:52:11.755205+0000","last_unstale":"2024-05-30T16:52:11.759671+0000","last_undegraded":"2024-05-30T16:52:11.759671+0000","last_fullsized":"2024-05-30T16:52:11.759671+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:39:58.679050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753019+0000","last_change":"2024-05-30T16:52:11.753019+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753019+0000","last_undegraded":"2024-05-30T16:52:11.753019+0000","last_fullsized":"2024-05-30T16:52:11.753019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-05-30T16:52:10.742857+0000","last_change":"2024-05-30T16:52:10.742857+0000","last_active":"2024-05-30T16:52:10.729975+0000","last_peered":"2024-05-30T16:52:10.729975+0000","last_clean":"2024-05-30T16:52:10.729975+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:10.742857+0000","last_undegraded":"2024-05-30T16:52:10.742857+0000","last_fullsized":"2024-05-30T16:52:10.742857+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.757205+0000","last_change":"2024-05-30T16:52:11.757205+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.757205+0000","last_undegraded":"2024-05-30T16:52:11.757205+0000","last_fullsized":"2024-05-30T16:52:11.757205+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.765239+0000","last_change":"2024-05-30T16:52:11.763269+0000","last_active":"2024-05-30T16:52:11.765239+0000","last_peered":"2024-05-30T16:52:11.765239+0000","last_clean":"2024-05-30T16:52:11.765239+0000","last_became_active":"2024-05-30T16:52:11.762926+0000","last_became_peered":"2024-05-30T16:52:11.762926+0000","last_unstale":"2024-05-30T16:52:11.765239+0000","last_undegraded":"2024-05-30T16:52:11.765239+0000","last_fullsized":"2024-05-30T16:52:11.765239+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:30.572646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746228+0000","last_change":"2024-05-30T16:52:11.746228+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746228+0000","last_undegraded":"2024-05-30T16:52:11.746228+0000","last_fullsized":"2024-05-30T16:52:11.746228+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.762891+0000","last_change":"2024-05-30T16:52:11.761194+0000","last_active":"2024-05-30T16:52:11.762891+0000","last_peered":"2024-05-30T16:52:11.762891+0000","last_clean":"2024-05-30T16:52:11.762891+0000","last_became_active":"2024-05-30T16:52:11.760872+0000","last_became_peered":"2024-05-30T16:52:11.760872+0000","last_unstale":"2024-05-30T16:52:11.762891+0000","last_undegraded":"2024-05-30T16:52:11.762891+0000","last_fullsized":"2024-05-30T16:52:11.762891+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:30.838153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:52:11.734755+0000","last_change":"2024-05-30T16:52:11.734755+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.734755+0000","last_undegraded":"2024-05-30T16:52:11.734755+0000","last_fullsized":"2024-05-30T16:52:11.734755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.764421+0000","last_change":"2024-05-30T16:52:11.758596+0000","last_active":"2024-05-30T16:52:11.764421+0000","last_peered":"2024-05-30T16:52:11.764421+0000","last_clean":"2024-05-30T16:52:11.764421+0000","last_became_active":"2024-05-30T16:52:11.758334+0000","last_became_peered":"2024-05-30T16:52:11.758334+0000","last_unstale":"2024-05-30T16:52:11.764421+0000","last_undegraded":"2024-05-30T16:52:11.764421+0000","last_fullsized":"2024-05-30T16:52:11.764421+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:18.604651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:52:11.734755+0000","last_change":"2024-05-30T16:52:11.734755+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.734755+0000","last_undegraded":"2024-05-30T16:52:11.734755+0000","last_fullsized":"2024-05-30T16:52:11.734755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.765004+0000","last_change":"2024-05-30T16:52:11.762668+0000","last_active":"2024-05-30T16:52:11.765004+0000","last_peered":"2024-05-30T16:52:11.765004+0000","last_clean":"2024-05-30T16:52:11.765004+0000","last_became_active":"2024-05-30T16:52:11.761436+0000","last_became_peered":"2024-05-30T16:52:11.761436+0000","last_unstale":"2024-05-30T16:52:11.765004+0000","last_undegraded":"2024-05-30T16:52:11.765004+0000","last_fullsized":"2024-05-30T16:52:11.765004+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:00.336519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745044+0000","last_change":"2024-05-30T16:52:11.745044+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745044+0000","last_undegraded":"2024-05-30T16:52:11.745044+0000","last_fullsized":"2024-05-30T16:52:11.745044+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.763275+0000","last_change":"2024-05-30T16:52:11.761404+0000","last_active":"2024-05-30T16:52:11.763275+0000","last_peered":"2024-05-30T16:52:11.763275+0000","last_clean":"2024-05-30T16:52:11.763275+0000","last_became_active":"2024-05-30T16:52:11.761125+0000","last_became_peered":"2024-05-30T16:52:11.761125+0000","last_unstale":"2024-05-30T16:52:11.763275+0000","last_undegraded":"2024-05-30T16:52:11.763275+0000","last_fullsized":"2024-05-30T16:52:11.763275+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:28:04.301693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.749547+0000","last_change":"2024-05-30T16:52:11.749547+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.749547+0000","last_undegraded":"2024-05-30T16:52:11.749547+0000","last_fullsized":"2024-05-30T16:52:11.749547+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.776295+0000","last_change":"2024-05-30T16:52:11.771973+0000","last_active":"2024-05-30T16:52:11.776295+0000","last_peered":"2024-05-30T16:52:11.776295+0000","last_clean":"2024-05-30T16:52:11.776295+0000","last_became_active":"2024-05-30T16:52:11.771710+0000","last_became_peered":"2024-05-30T16:52:11.771710+0000","last_unstale":"2024-05-30T16:52:11.776295+0000","last_undegraded":"2024-05-30T16:52:11.776295+0000","last_fullsized":"2024-05-30T16:52:11.776295+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:48:23.620060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.758116+0000","last_change":"2024-05-30T16:52:11.758116+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.758116+0000","last_undegraded":"2024-05-30T16:52:11.758116+0000","last_fullsized":"2024-05-30T16:52:11.758116+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.762019+0000","last_change":"2024-05-30T16:52:11.759259+0000","last_active":"2024-05-30T16:52:11.762019+0000","last_peered":"2024-05-30T16:52:11.762019+0000","last_clean":"2024-05-30T16:52:11.762019+0000","last_became_active":"2024-05-30T16:52:11.758515+0000","last_became_peered":"2024-05-30T16:52:11.758515+0000","last_unstale":"2024-05-30T16:52:11.762019+0000","last_undegraded":"2024-05-30T16:52:11.762019+0000","last_fullsized":"2024-05-30T16:52:11.762019+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:39:58.679050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":211,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.746315+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:52:11.746315+0000","last_peered":"2024-05-30T16:52:11.746315+0000","last_clean":"2024-05-30T16:52:11.746315+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:52:11.746315+0000","last_undegraded":"2024-05-30T16:52:11.746315+0000","last_fullsized":"2024-05-30T16:52:11.746315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335420,"statfs":{"total":96636764160,"available":96599470080,"internally_reserved":0,"allocated":1101824,"data_stored":790316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":507904,"data_stored":199948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35836,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":507904,"data_stored":199948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35852,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335988,"statfs":{"total":96636764160,"available":96600051712,"internally_reserved":0,"allocated":520192,"data_stored":206243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509483,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":520192,"data_stored":206243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35852,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335988,"statfs":{"total":96636764160,"available":96600051712,"internally_reserved":0,"allocated":520192,"data_stored":206243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1101824,"data_stored":790316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35840,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336000,"statfs":{"total":96636764160,"available":96600064000,"internally_reserved":0,"allocated":507904,"data_stored":199948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:52:16.894 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:52:17.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.069+0000 7fc0d0a00640 1 Processor -- start 2024-05-30T16:52:17.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.069+0000 7fc0d0a00640 1 -- start start 2024-05-30T16:52:17.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0d0a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0cc070710 0x7fc0cc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0d0a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0cc0cde00 con 0x7fc0cc0b1ac0 2024-05-30T16:52:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0d0a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0cc070bd0 con 0x7fc0cc15ff30 2024-05-30T16:52:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0d0a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc0cc070e70 con 0x7fc0cc070710 2024-05-30T16:52:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0ca800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc0cc0b1ac0 0x7fc0cc09af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53872/0 (socket says 172.21.15.59:53872) 2024-05-30T16:52:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0ca800640 1 -- 172.21.15.59:0/49765337 learned_addr learned my addr 172.21.15.59:0/49765337 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0c3e00640 1 --2- 172.21.15.59:0/49765337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0cc070710 0x7fc0cc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0c9400640 1 -- 172.21.15.59:0/49765337 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300653780 0 0) 0x7fc0cc0cde00 con 0x7fc0cc0b1ac0 2024-05-30T16:52:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0c9400640 1 -- 172.21.15.59:0/49765337 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0b0003530 con 0x7fc0cc0b1ac0 2024-05-30T16:52:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0c3e00640 1 -- 172.21.15.59:0/49765337 >> v1:172.21.15.107:6789/0 conn(0x7fc0cc15ff30 legacy=0x7fc0cc070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0c9400640 1 -- 172.21.15.59:0/49765337 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3618614184 0 0) 0x7fc0cc070bd0 con 0x7fc0cc15ff30 2024-05-30T16:52:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0c3e00640 1 -- 172.21.15.59:0/49765337 >> v1:172.21.15.59:6789/0 conn(0x7fc0cc0b1ac0 legacy=0x7fc0cc09af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.073+0000 7fc0c3e00640 1 -- 172.21.15.59:0/49765337 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc072020 con 0x7fc0cc070710 2024-05-30T16:52:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0c3e00640 1 --2- 172.21.15.59:0/49765337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0cc070710 0x7fc0cc09aa40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40097f0 tx=0x7fc0b401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bbabe4b335d196d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:17.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0c9400640 1 -- 172.21.15.59:0/49765337 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40b0070 con 0x7fc0cc070710 2024-05-30T16:52:17.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0c9400640 1 -- 172.21.15.59:0/49765337 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b40ab600 con 0x7fc0cc070710 2024-05-30T16:52:17.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0c9400640 1 -- 172.21.15.59:0/49765337 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40ab9b0 con 0x7fc0cc070710 2024-05-30T16:52:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0d0a00640 1 -- 172.21.15.59:0/49765337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0cc070710 msgr2=0x7fc0cc09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0d0a00640 1 --2- 172.21.15.59:0/49765337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0cc070710 0x7fc0cc09aa40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40097f0 tx=0x7fc0b401c450 comp rx=0 tx=0).stop 2024-05-30T16:52:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0d0a00640 1 -- 172.21.15.59:0/49765337 shutdown_connections 2024-05-30T16:52:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0d0a00640 1 --2- 172.21.15.59:0/49765337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0cc070710 0x7fc0cc09aa40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0d0a00640 1 -- 172.21.15.59:0/49765337 >> 172.21.15.59:0/49765337 conn(0x7fc0cc0b3f70 msgr2=0x7fc0cc0b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0d0a00640 1 -- 172.21.15.59:0/49765337 shutdown_connections 2024-05-30T16:52:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0d0a00640 1 -- 172.21.15.59:0/49765337 wait complete. 2024-05-30T16:52:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0d0a00640 1 Processor -- start 2024-05-30T16:52:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.077+0000 7fc0d0a00640 1 -- start start 2024-05-30T16:52:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0d0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc070710 0x7fc0cc167360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0d0a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0cc0b1ac0 0x7fc0cc164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0d0a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc15ff30 0x7fc0cc0c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0d0a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc16ae80 con 0x7fc0cc070710 2024-05-30T16:52:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0d0a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc16ad00 con 0x7fc0cc15ff30 2024-05-30T16:52:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0d0a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc0cc16b000 con 0x7fc0cc0b1ac0 2024-05-30T16:52:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc070710 0x7fc0cc167360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc070710 0x7fc0cc167360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46668/0 (socket says 172.21.15.59:46668) 2024-05-30T16:52:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c9e00640 1 -- 172.21.15.59:0/3645528532 learned_addr learned my addr 172.21.15.59:0/3645528532 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c3e00640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0cc0b1ac0 0x7fc0cc164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0ca800640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc15ff30 0x7fc0cc0c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c9e00640 1 -- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0cc0b1ac0 msgr2=0x7fc0cc164830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c9e00640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0cc0b1ac0 0x7fc0cc164830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c9e00640 1 -- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc15ff30 msgr2=0x7fc0cc0c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c9e00640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc15ff30 0x7fc0cc0c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c9e00640 1 -- 172.21.15.59:0/3645528532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc0c8750 con 0x7fc0cc070710 2024-05-30T16:52:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0ca800640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc15ff30 0x7fc0cc0c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c9e00640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc070710 0x7fc0cc167360 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00c480 tx=0x7fc0bc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c2000640 1 -- 172.21.15.59:0/3645528532 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc005480 con 0x7fc0cc070710 2024-05-30T16:52:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c2000640 1 -- 172.21.15.59:0/3645528532 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0bc003600 con 0x7fc0cc070710 2024-05-30T16:52:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0d0a00640 1 -- 172.21.15.59:0/3645528532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0cc164ea0 con 0x7fc0cc070710 2024-05-30T16:52:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c2000640 1 -- 172.21.15.59:0/3645528532 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0039f0 con 0x7fc0cc070710 2024-05-30T16:52:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0d0a00640 1 -- 172.21.15.59:0/3645528532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0cc166b60 con 0x7fc0cc070710 2024-05-30T16:52:17.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0d0a00640 1 -- 172.21.15.59:0/3645528532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0cc068a90 con 0x7fc0cc070710 2024-05-30T16:52:17.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.081+0000 7fc0c2000640 1 -- 172.21.15.59:0/3645528532 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fc0bc003b90 con 0x7fc0cc070710 2024-05-30T16:52:17.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.085+0000 7fc0c2000640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc0a8068680 0x7fc0a806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.085+0000 7fc0c2000640 1 -- 172.21.15.59:0/3645528532 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7fc0bc086ae0 con 0x7fc0cc070710 2024-05-30T16:52:17.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.085+0000 7fc0c3e00640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc0a8068680 0x7fc0a806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.085+0000 7fc0c3e00640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc0a8068680 0x7fc0a806ab40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40ad000 tx=0x7fc0b40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:17.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.089+0000 7fc0c2000640 1 -- 172.21.15.59:0/3645528532 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc0bc056d80 con 0x7fc0cc070710 2024-05-30T16:52:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.249+0000 7fc0d0a00640 1 -- 172.21.15.59:0/3645528532 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0cc09aec0 con 0x7fc0a8068680 2024-05-30T16:52:17.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.257+0000 7fc0c2000640 1 -- 172.21.15.59:0/3645528532 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247405 (secure 0 0 0) 0x7fc0b40f7680 con 0x7fc0a8068680 2024-05-30T16:52:17.262 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:17.263 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:52:17.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.261+0000 7fc0d0a00640 1 -- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc0a8068680 msgr2=0x7fc0a806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.261+0000 7fc0d0a00640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc0a8068680 0x7fc0a806ab40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40ad000 tx=0x7fc0b40a6000 comp rx=0 tx=0).stop 2024-05-30T16:52:17.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.261+0000 7fc0d0a00640 1 -- 172.21.15.59:0/3645528532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc070710 msgr2=0x7fc0cc167360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.261+0000 7fc0d0a00640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc070710 0x7fc0cc167360 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00c480 tx=0x7fc0bc00c940 comp rx=0 tx=0).stop 2024-05-30T16:52:17.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.261+0000 7fc0d0a00640 1 -- 172.21.15.59:0/3645528532 shutdown_connections 2024-05-30T16:52:17.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.261+0000 7fc0d0a00640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc0a8068680 0x7fc0a806ab40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.261+0000 7fc0d0a00640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc15ff30 0x7fc0cc0c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.261+0000 7fc0d0a00640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0cc0b1ac0 0x7fc0cc164830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.261+0000 7fc0d0a00640 1 --2- 172.21.15.59:0/3645528532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc070710 0x7fc0cc167360 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.261+0000 7fc0d0a00640 1 -- 172.21.15.59:0/3645528532 >> 172.21.15.59:0/3645528532 conn(0x7fc0cc0b3f70 msgr2=0x7fc0cc06dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:17.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.261+0000 7fc0d0a00640 1 -- 172.21.15.59:0/3645528532 shutdown_connections 2024-05-30T16:52:17.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.261+0000 7fc0d0a00640 1 -- 172.21.15.59:0/3645528532 wait complete. 2024-05-30T16:52:17.282 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-05-30T16:52:17.117379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275480,"kb_used_data":5212,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754699240,"statfs":{"total":773094113280,"available":772812021760,"internally_reserved":0,"allocated":5337088,"data_stored":2819269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001323"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747138+0000","last_change":"2024-05-30T16:52:11.747138+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747138+0000","last_undegraded":"2024-05-30T16:52:11.747138+0000","last_fullsized":"2024-05-30T16:52:11.747138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745784+0000","last_change":"2024-05-30T16:52:11.745784+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745784+0000","last_undegraded":"2024-05-30T16:52:11.745784+0000","last_fullsized":"2024-05-30T16:52:11.745784+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.756091+0000","last_change":"2024-05-30T16:52:11.756091+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.756091+0000","last_undegraded":"2024-05-30T16:52:11.756091+0000","last_fullsized":"2024-05-30T16:52:11.756091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.757759+0000","last_change":"2024-05-30T16:52:11.757759+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.757759+0000","last_undegraded":"2024-05-30T16:52:11.757759+0000","last_fullsized":"2024-05-30T16:52:11.757759+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746121+0000","last_change":"2024-05-30T16:52:11.746121+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746121+0000","last_undegraded":"2024-05-30T16:52:11.746121+0000","last_fullsized":"2024-05-30T16:52:11.746121+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297925+0000","last_change":"2024-05-30T16:52:12.771108+0000","last_active":"2024-05-30T16:52:14.297925+0000","last_peered":"2024-05-30T16:52:14.297925+0000","last_clean":"2024-05-30T16:52:14.297925+0000","last_became_active":"2024-05-30T16:52:12.770805+0000","last_became_peered":"2024-05-30T16:52:12.770805+0000","last_unstale":"2024-05-30T16:52:14.297925+0000","last_undegraded":"2024-05-30T16:52:14.297925+0000","last_fullsized":"2024-05-30T16:52:14.297925+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:29:26.725308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745496+0000","last_change":"2024-05-30T16:52:11.745496+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745496+0000","last_undegraded":"2024-05-30T16:52:11.745496+0000","last_fullsized":"2024-05-30T16:52:11.745496+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.761114+0000","last_change":"2024-05-30T16:52:11.761114+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.761114+0000","last_undegraded":"2024-05-30T16:52:11.761114+0000","last_fullsized":"2024-05-30T16:52:11.761114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.760182+0000","last_change":"2024-05-30T16:52:11.760182+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.760182+0000","last_undegraded":"2024-05-30T16:52:11.760182+0000","last_fullsized":"2024-05-30T16:52:11.760182+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.758558+0000","last_change":"2024-05-30T16:52:11.758558+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.758558+0000","last_undegraded":"2024-05-30T16:52:11.758558+0000","last_fullsized":"2024-05-30T16:52:11.758558+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.766067+0000","last_change":"2024-05-30T16:52:11.766067+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.766067+0000","last_undegraded":"2024-05-30T16:52:11.766067+0000","last_fullsized":"2024-05-30T16:52:11.766067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748560+0000","last_change":"2024-05-30T16:52:11.748560+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748560+0000","last_undegraded":"2024-05-30T16:52:11.748560+0000","last_fullsized":"2024-05-30T16:52:11.748560+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.755351+0000","last_change":"2024-05-30T16:52:11.755351+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.755351+0000","last_undegraded":"2024-05-30T16:52:11.755351+0000","last_fullsized":"2024-05-30T16:52:11.755351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.767001+0000","last_change":"2024-05-30T16:52:11.767001+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.767001+0000","last_undegraded":"2024-05-30T16:52:11.767001+0000","last_fullsized":"2024-05-30T16:52:11.767001+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297516+0000","last_change":"2024-05-30T16:52:12.772027+0000","last_active":"2024-05-30T16:52:14.297516+0000","last_peered":"2024-05-30T16:52:14.297516+0000","last_clean":"2024-05-30T16:52:14.297516+0000","last_became_active":"2024-05-30T16:52:12.771761+0000","last_became_peered":"2024-05-30T16:52:12.771761+0000","last_unstale":"2024-05-30T16:52:14.297516+0000","last_undegraded":"2024-05-30T16:52:14.297516+0000","last_fullsized":"2024-05-30T16:52:14.297516+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:59:54.866618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752070+0000","last_change":"2024-05-30T16:52:11.752070+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752070+0000","last_undegraded":"2024-05-30T16:52:11.752070+0000","last_fullsized":"2024-05-30T16:52:11.752070+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753351+0000","last_change":"2024-05-30T16:52:11.753351+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753351+0000","last_undegraded":"2024-05-30T16:52:11.753351+0000","last_fullsized":"2024-05-30T16:52:11.753351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.754200+0000","last_change":"2024-05-30T16:52:11.754200+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.754200+0000","last_undegraded":"2024-05-30T16:52:11.754200+0000","last_fullsized":"2024-05-30T16:52:11.754200+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753706+0000","last_change":"2024-05-30T16:52:11.753706+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753706+0000","last_undegraded":"2024-05-30T16:52:11.753706+0000","last_fullsized":"2024-05-30T16:52:11.753706+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748657+0000","last_change":"2024-05-30T16:52:11.748657+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748657+0000","last_undegraded":"2024-05-30T16:52:11.748657+0000","last_fullsized":"2024-05-30T16:52:11.748657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297955+0000","last_change":"2024-05-30T16:52:12.775532+0000","last_active":"2024-05-30T16:52:14.297955+0000","last_peered":"2024-05-30T16:52:14.297955+0000","last_clean":"2024-05-30T16:52:14.297955+0000","last_became_active":"2024-05-30T16:52:12.775054+0000","last_became_peered":"2024-05-30T16:52:12.775054+0000","last_unstale":"2024-05-30T16:52:14.297955+0000","last_undegraded":"2024-05-30T16:52:14.297955+0000","last_fullsized":"2024-05-30T16:52:14.297955+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:31:14.760035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.766551+0000","last_change":"2024-05-30T16:52:11.766551+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.766551+0000","last_undegraded":"2024-05-30T16:52:11.766551+0000","last_fullsized":"2024-05-30T16:52:11.766551+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.751797+0000","last_change":"2024-05-30T16:52:11.751797+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.751797+0000","last_undegraded":"2024-05-30T16:52:11.751797+0000","last_fullsized":"2024-05-30T16:52:11.751797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.751513+0000","last_change":"2024-05-30T16:52:11.751513+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.751513+0000","last_undegraded":"2024-05-30T16:52:11.751513+0000","last_fullsized":"2024-05-30T16:52:11.751513+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753951+0000","last_change":"2024-05-30T16:52:11.753951+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753951+0000","last_undegraded":"2024-05-30T16:52:11.753951+0000","last_fullsized":"2024-05-30T16:52:11.753951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748138+0000","last_change":"2024-05-30T16:52:11.748138+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748138+0000","last_undegraded":"2024-05-30T16:52:11.748138+0000","last_fullsized":"2024-05-30T16:52:11.748138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752041+0000","last_change":"2024-05-30T16:52:11.752041+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752041+0000","last_undegraded":"2024-05-30T16:52:11.752041+0000","last_fullsized":"2024-05-30T16:52:11.752041+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747847+0000","last_change":"2024-05-30T16:52:11.747847+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747847+0000","last_undegraded":"2024-05-30T16:52:11.747847+0000","last_fullsized":"2024-05-30T16:52:11.747847+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.751469+0000","last_change":"2024-05-30T16:52:11.751469+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.751469+0000","last_undegraded":"2024-05-30T16:52:11.751469+0000","last_fullsized":"2024-05-30T16:52:11.751469+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750983+0000","last_change":"2024-05-30T16:52:11.750983+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750983+0000","last_undegraded":"2024-05-30T16:52:11.750983+0000","last_fullsized":"2024-05-30T16:52:11.750983+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297628+0000","last_change":"2024-05-30T16:52:12.766158+0000","last_active":"2024-05-30T16:52:14.297628+0000","last_peered":"2024-05-30T16:52:14.297628+0000","last_clean":"2024-05-30T16:52:14.297628+0000","last_became_active":"2024-05-30T16:52:12.765499+0000","last_became_peered":"2024-05-30T16:52:12.765499+0000","last_unstale":"2024-05-30T16:52:14.297628+0000","last_undegraded":"2024-05-30T16:52:14.297628+0000","last_fullsized":"2024-05-30T16:52:14.297628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:45:32.830341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747251+0000","last_change":"2024-05-30T16:52:11.747251+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747251+0000","last_undegraded":"2024-05-30T16:52:11.747251+0000","last_fullsized":"2024-05-30T16:52:11.747251+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750137+0000","last_change":"2024-05-30T16:52:11.750137+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750137+0000","last_undegraded":"2024-05-30T16:52:11.750137+0000","last_fullsized":"2024-05-30T16:52:11.750137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298463+0000","last_change":"2024-05-30T16:52:11.768213+0000","last_active":"2024-05-30T16:52:14.298463+0000","last_peered":"2024-05-30T16:52:14.298463+0000","last_clean":"2024-05-30T16:52:14.298463+0000","last_became_active":"2024-05-30T16:52:11.767915+0000","last_became_peered":"2024-05-30T16:52:11.767915+0000","last_unstale":"2024-05-30T16:52:14.298463+0000","last_undegraded":"2024-05-30T16:52:14.298463+0000","last_fullsized":"2024-05-30T16:52:14.298463+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:32:49.346808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753479+0000","last_change":"2024-05-30T16:52:11.753479+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753479+0000","last_undegraded":"2024-05-30T16:52:11.753479+0000","last_fullsized":"2024-05-30T16:52:11.753479+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.768971+0000","last_change":"2024-05-30T16:52:11.767326+0000","last_active":"2024-05-30T16:52:11.768971+0000","last_peered":"2024-05-30T16:52:11.768971+0000","last_clean":"2024-05-30T16:52:11.768971+0000","last_became_active":"2024-05-30T16:52:11.766962+0000","last_became_peered":"2024-05-30T16:52:11.766962+0000","last_unstale":"2024-05-30T16:52:11.768971+0000","last_undegraded":"2024-05-30T16:52:11.768971+0000","last_fullsized":"2024-05-30T16:52:11.768971+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:35.144180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745368+0000","last_change":"2024-05-30T16:52:11.745368+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745368+0000","last_undegraded":"2024-05-30T16:52:11.745368+0000","last_fullsized":"2024-05-30T16:52:11.745368+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.769786+0000","last_change":"2024-05-30T16:52:11.762080+0000","last_active":"2024-05-30T16:52:11.769786+0000","last_peered":"2024-05-30T16:52:11.769786+0000","last_clean":"2024-05-30T16:52:11.769786+0000","last_became_active":"2024-05-30T16:52:11.761680+0000","last_became_peered":"2024-05-30T16:52:11.761680+0000","last_unstale":"2024-05-30T16:52:11.769786+0000","last_undegraded":"2024-05-30T16:52:11.769786+0000","last_fullsized":"2024-05-30T16:52:11.769786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:00.336519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.749399+0000","last_change":"2024-05-30T16:52:11.749399+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.749399+0000","last_undegraded":"2024-05-30T16:52:11.749399+0000","last_fullsized":"2024-05-30T16:52:11.749399+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.759758+0000","last_change":"2024-05-30T16:52:11.756991+0000","last_active":"2024-05-30T16:52:11.759758+0000","last_peered":"2024-05-30T16:52:11.759758+0000","last_clean":"2024-05-30T16:52:11.759758+0000","last_became_active":"2024-05-30T16:52:11.756716+0000","last_became_peered":"2024-05-30T16:52:11.756716+0000","last_unstale":"2024-05-30T16:52:11.759758+0000","last_undegraded":"2024-05-30T16:52:11.759758+0000","last_fullsized":"2024-05-30T16:52:11.759758+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:42:42.339988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750426+0000","last_change":"2024-05-30T16:52:11.750426+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750426+0000","last_undegraded":"2024-05-30T16:52:11.750426+0000","last_fullsized":"2024-05-30T16:52:11.750426+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298034+0000","last_change":"2024-05-30T16:52:11.765391+0000","last_active":"2024-05-30T16:52:14.298034+0000","last_peered":"2024-05-30T16:52:14.298034+0000","last_clean":"2024-05-30T16:52:14.298034+0000","last_became_active":"2024-05-30T16:52:11.765096+0000","last_became_peered":"2024-05-30T16:52:11.765096+0000","last_unstale":"2024-05-30T16:52:14.298034+0000","last_undegraded":"2024-05-30T16:52:14.298034+0000","last_fullsized":"2024-05-30T16:52:14.298034+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:19:40.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.760252+0000","last_change":"2024-05-30T16:52:11.760252+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.760252+0000","last_undegraded":"2024-05-30T16:52:11.760252+0000","last_fullsized":"2024-05-30T16:52:11.760252+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.763688+0000","last_change":"2024-05-30T16:52:11.757778+0000","last_active":"2024-05-30T16:52:11.763688+0000","last_peered":"2024-05-30T16:52:11.763688+0000","last_clean":"2024-05-30T16:52:11.763688+0000","last_became_active":"2024-05-30T16:52:11.757401+0000","last_became_peered":"2024-05-30T16:52:11.757401+0000","last_unstale":"2024-05-30T16:52:11.763688+0000","last_undegraded":"2024-05-30T16:52:11.763688+0000","last_fullsized":"2024-05-30T16:52:11.763688+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:30.838153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750162+0000","last_change":"2024-05-30T16:52:11.750162+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750162+0000","last_undegraded":"2024-05-30T16:52:11.750162+0000","last_fullsized":"2024-05-30T16:52:11.750162+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.760258+0000","last_change":"2024-05-30T16:52:11.754254+0000","last_active":"2024-05-30T16:52:11.760258+0000","last_peered":"2024-05-30T16:52:11.760258+0000","last_clean":"2024-05-30T16:52:11.760258+0000","last_became_active":"2024-05-30T16:52:11.753946+0000","last_became_peered":"2024-05-30T16:52:11.753946+0000","last_unstale":"2024-05-30T16:52:11.760258+0000","last_undegraded":"2024-05-30T16:52:11.760258+0000","last_fullsized":"2024-05-30T16:52:11.760258+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:15.949367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752244+0000","last_change":"2024-05-30T16:52:11.752244+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752244+0000","last_undegraded":"2024-05-30T16:52:11.752244+0000","last_fullsized":"2024-05-30T16:52:11.752244+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.776273+0000","last_change":"2024-05-30T16:52:11.771861+0000","last_active":"2024-05-30T16:52:11.776273+0000","last_peered":"2024-05-30T16:52:11.776273+0000","last_clean":"2024-05-30T16:52:11.776273+0000","last_became_active":"2024-05-30T16:52:11.771573+0000","last_became_peered":"2024-05-30T16:52:11.771573+0000","last_unstale":"2024-05-30T16:52:11.776273+0000","last_undegraded":"2024-05-30T16:52:11.776273+0000","last_fullsized":"2024-05-30T16:52:11.776273+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:34.799686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753597+0000","last_change":"2024-05-30T16:52:11.753597+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753597+0000","last_undegraded":"2024-05-30T16:52:11.753597+0000","last_fullsized":"2024-05-30T16:52:11.753597+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.768990+0000","last_change":"2024-05-30T16:52:11.768155+0000","last_active":"2024-05-30T16:52:11.768990+0000","last_peered":"2024-05-30T16:52:11.768990+0000","last_clean":"2024-05-30T16:52:11.768990+0000","last_became_active":"2024-05-30T16:52:11.767557+0000","last_became_peered":"2024-05-30T16:52:11.767557+0000","last_unstale":"2024-05-30T16:52:11.768990+0000","last_undegraded":"2024-05-30T16:52:11.768990+0000","last_fullsized":"2024-05-30T16:52:11.768990+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:47:42.557576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746658+0000","last_change":"2024-05-30T16:52:11.746658+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746658+0000","last_undegraded":"2024-05-30T16:52:11.746658+0000","last_fullsized":"2024-05-30T16:52:11.746658+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.776371+0000","last_change":"2024-05-30T16:52:11.773802+0000","last_active":"2024-05-30T16:52:11.776371+0000","last_peered":"2024-05-30T16:52:11.776371+0000","last_clean":"2024-05-30T16:52:11.776371+0000","last_became_active":"2024-05-30T16:52:11.771528+0000","last_became_peered":"2024-05-30T16:52:11.771528+0000","last_unstale":"2024-05-30T16:52:11.776371+0000","last_undegraded":"2024-05-30T16:52:11.776371+0000","last_fullsized":"2024-05-30T16:52:11.776371+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:01:16.197933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298144+0000","last_change":"2024-05-30T16:52:12.773756+0000","last_active":"2024-05-30T16:52:14.298144+0000","last_peered":"2024-05-30T16:52:14.298144+0000","last_clean":"2024-05-30T16:52:14.298144+0000","last_became_active":"2024-05-30T16:52:12.773592+0000","last_became_peered":"2024-05-30T16:52:12.773592+0000","last_unstale":"2024-05-30T16:52:14.298144+0000","last_undegraded":"2024-05-30T16:52:14.298144+0000","last_fullsized":"2024-05-30T16:52:14.298144+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:31:13.580941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.765260+0000","last_change":"2024-05-30T16:52:11.763496+0000","last_active":"2024-05-30T16:52:11.765260+0000","last_peered":"2024-05-30T16:52:11.765260+0000","last_clean":"2024-05-30T16:52:11.765260+0000","last_became_active":"2024-05-30T16:52:11.763141+0000","last_became_peered":"2024-05-30T16:52:11.763141+0000","last_unstale":"2024-05-30T16:52:11.765260+0000","last_undegraded":"2024-05-30T16:52:11.765260+0000","last_fullsized":"2024-05-30T16:52:11.765260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:19:41.036951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748364+0000","last_change":"2024-05-30T16:52:11.748364+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748364+0000","last_undegraded":"2024-05-30T16:52:11.748364+0000","last_fullsized":"2024-05-30T16:52:11.748364+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.770892+0000","last_change":"2024-05-30T16:52:11.763318+0000","last_active":"2024-05-30T16:52:11.770892+0000","last_peered":"2024-05-30T16:52:11.770892+0000","last_clean":"2024-05-30T16:52:11.770892+0000","last_became_active":"2024-05-30T16:52:11.763052+0000","last_became_peered":"2024-05-30T16:52:11.763052+0000","last_unstale":"2024-05-30T16:52:11.770892+0000","last_undegraded":"2024-05-30T16:52:11.770892+0000","last_fullsized":"2024-05-30T16:52:11.770892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:37:33.427945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752659+0000","last_change":"2024-05-30T16:52:11.752659+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752659+0000","last_undegraded":"2024-05-30T16:52:11.752659+0000","last_fullsized":"2024-05-30T16:52:11.752659+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298083+0000","last_change":"2024-05-30T16:52:11.775662+0000","last_active":"2024-05-30T16:52:14.298083+0000","last_peered":"2024-05-30T16:52:14.298083+0000","last_clean":"2024-05-30T16:52:14.298083+0000","last_became_active":"2024-05-30T16:52:11.775356+0000","last_became_peered":"2024-05-30T16:52:11.775356+0000","last_unstale":"2024-05-30T16:52:14.298083+0000","last_undegraded":"2024-05-30T16:52:14.298083+0000","last_fullsized":"2024-05-30T16:52:14.298083+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:32:56.547786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.759822+0000","last_change":"2024-05-30T16:52:11.759822+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.759822+0000","last_undegraded":"2024-05-30T16:52:11.759822+0000","last_fullsized":"2024-05-30T16:52:11.759822+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.766760+0000","last_change":"2024-05-30T16:52:11.765673+0000","last_active":"2024-05-30T16:52:11.766760+0000","last_peered":"2024-05-30T16:52:11.766760+0000","last_clean":"2024-05-30T16:52:11.766760+0000","last_became_active":"2024-05-30T16:52:11.765157+0000","last_became_peered":"2024-05-30T16:52:11.765157+0000","last_unstale":"2024-05-30T16:52:11.766760+0000","last_undegraded":"2024-05-30T16:52:11.766760+0000","last_fullsized":"2024-05-30T16:52:11.766760+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:20.133814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297416+0000","last_change":"2024-05-30T16:52:12.781216+0000","last_active":"2024-05-30T16:52:14.297416+0000","last_peered":"2024-05-30T16:52:14.297416+0000","last_clean":"2024-05-30T16:52:14.297416+0000","last_became_active":"2024-05-30T16:52:12.779763+0000","last_became_peered":"2024-05-30T16:52:12.779763+0000","last_unstale":"2024-05-30T16:52:14.297416+0000","last_undegraded":"2024-05-30T16:52:14.297416+0000","last_fullsized":"2024-05-30T16:52:14.297416+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:21:02.860921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297657+0000","last_change":"2024-05-30T16:52:11.771843+0000","last_active":"2024-05-30T16:52:14.297657+0000","last_peered":"2024-05-30T16:52:14.297657+0000","last_clean":"2024-05-30T16:52:14.297657+0000","last_became_active":"2024-05-30T16:52:11.771540+0000","last_became_peered":"2024-05-30T16:52:11.771540+0000","last_unstale":"2024-05-30T16:52:14.297657+0000","last_undegraded":"2024-05-30T16:52:14.297657+0000","last_fullsized":"2024-05-30T16:52:14.297657+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:47:01.601969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.744985+0000","last_change":"2024-05-30T16:52:11.744985+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.744985+0000","last_undegraded":"2024-05-30T16:52:11.744985+0000","last_fullsized":"2024-05-30T16:52:11.744985+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.761275+0000","last_change":"2024-05-30T16:52:11.754549+0000","last_active":"2024-05-30T16:52:11.761275+0000","last_peered":"2024-05-30T16:52:11.761275+0000","last_clean":"2024-05-30T16:52:11.761275+0000","last_became_active":"2024-05-30T16:52:11.754201+0000","last_became_peered":"2024-05-30T16:52:11.754201+0000","last_unstale":"2024-05-30T16:52:11.761275+0000","last_undegraded":"2024-05-30T16:52:11.761275+0000","last_fullsized":"2024-05-30T16:52:11.761275+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:07:32.823371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747354+0000","last_change":"2024-05-30T16:52:11.747354+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747354+0000","last_undegraded":"2024-05-30T16:52:11.747354+0000","last_fullsized":"2024-05-30T16:52:11.747354+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.766290+0000","last_change":"2024-05-30T16:52:11.759174+0000","last_active":"2024-05-30T16:52:11.766290+0000","last_peered":"2024-05-30T16:52:11.766290+0000","last_clean":"2024-05-30T16:52:11.766290+0000","last_became_active":"2024-05-30T16:52:11.758846+0000","last_became_peered":"2024-05-30T16:52:11.758846+0000","last_unstale":"2024-05-30T16:52:11.766290+0000","last_undegraded":"2024-05-30T16:52:11.766290+0000","last_fullsized":"2024-05-30T16:52:11.766290+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:55:12.259158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.759726+0000","last_change":"2024-05-30T16:52:11.759726+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.759726+0000","last_undegraded":"2024-05-30T16:52:11.759726+0000","last_fullsized":"2024-05-30T16:52:11.759726+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.764953+0000","last_change":"2024-05-30T16:52:11.762654+0000","last_active":"2024-05-30T16:52:11.764953+0000","last_peered":"2024-05-30T16:52:11.764953+0000","last_clean":"2024-05-30T16:52:11.764953+0000","last_became_active":"2024-05-30T16:52:11.762385+0000","last_became_peered":"2024-05-30T16:52:11.762385+0000","last_unstale":"2024-05-30T16:52:11.764953+0000","last_undegraded":"2024-05-30T16:52:11.764953+0000","last_fullsized":"2024-05-30T16:52:11.764953+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:28:04.301693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752775+0000","last_change":"2024-05-30T16:52:11.752775+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752775+0000","last_undegraded":"2024-05-30T16:52:11.752775+0000","last_fullsized":"2024-05-30T16:52:11.752775+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.760366+0000","last_change":"2024-05-30T16:52:11.754550+0000","last_active":"2024-05-30T16:52:11.760366+0000","last_peered":"2024-05-30T16:52:11.760366+0000","last_clean":"2024-05-30T16:52:11.760366+0000","last_became_active":"2024-05-30T16:52:11.754274+0000","last_became_peered":"2024-05-30T16:52:11.754274+0000","last_unstale":"2024-05-30T16:52:11.760366+0000","last_undegraded":"2024-05-30T16:52:11.760366+0000","last_fullsized":"2024-05-30T16:52:11.760366+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:48.116676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.754740+0000","last_change":"2024-05-30T16:52:11.754740+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.754740+0000","last_undegraded":"2024-05-30T16:52:11.754740+0000","last_fullsized":"2024-05-30T16:52:11.754740+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298194+0000","last_change":"2024-05-30T16:52:11.767257+0000","last_active":"2024-05-30T16:52:14.298194+0000","last_peered":"2024-05-30T16:52:14.298194+0000","last_clean":"2024-05-30T16:52:14.298194+0000","last_became_active":"2024-05-30T16:52:11.766776+0000","last_became_peered":"2024-05-30T16:52:11.766776+0000","last_unstale":"2024-05-30T16:52:14.298194+0000","last_undegraded":"2024-05-30T16:52:14.298194+0000","last_fullsized":"2024-05-30T16:52:14.298194+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:49.907573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297942+0000","last_change":"2024-05-30T16:52:12.783213+0000","last_active":"2024-05-30T16:52:14.297942+0000","last_peered":"2024-05-30T16:52:14.297942+0000","last_clean":"2024-05-30T16:52:14.297942+0000","last_became_active":"2024-05-30T16:52:12.782012+0000","last_became_peered":"2024-05-30T16:52:12.782012+0000","last_unstale":"2024-05-30T16:52:14.297942+0000","last_undegraded":"2024-05-30T16:52:14.297942+0000","last_fullsized":"2024-05-30T16:52:14.297942+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:28.261365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298198+0000","last_change":"2024-05-30T16:52:11.762594+0000","last_active":"2024-05-30T16:52:14.298198+0000","last_peered":"2024-05-30T16:52:14.298198+0000","last_clean":"2024-05-30T16:52:14.298198+0000","last_became_active":"2024-05-30T16:52:11.760414+0000","last_became_peered":"2024-05-30T16:52:11.760414+0000","last_unstale":"2024-05-30T16:52:14.298198+0000","last_undegraded":"2024-05-30T16:52:14.298198+0000","last_fullsized":"2024-05-30T16:52:14.298198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:31.025155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.749065+0000","last_change":"2024-05-30T16:52:11.749065+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.749065+0000","last_undegraded":"2024-05-30T16:52:11.749065+0000","last_fullsized":"2024-05-30T16:52:11.749065+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.766062+0000","last_change":"2024-05-30T16:52:11.761712+0000","last_active":"2024-05-30T16:52:11.766062+0000","last_peered":"2024-05-30T16:52:11.766062+0000","last_clean":"2024-05-30T16:52:11.766062+0000","last_became_active":"2024-05-30T16:52:11.761375+0000","last_became_peered":"2024-05-30T16:52:11.761375+0000","last_unstale":"2024-05-30T16:52:11.766062+0000","last_undegraded":"2024-05-30T16:52:11.766062+0000","last_fullsized":"2024-05-30T16:52:11.766062+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:42:42.339988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746595+0000","last_change":"2024-05-30T16:52:11.746595+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746595+0000","last_undegraded":"2024-05-30T16:52:11.746595+0000","last_fullsized":"2024-05-30T16:52:11.746595+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.770418+0000","last_change":"2024-05-30T16:52:11.765519+0000","last_active":"2024-05-30T16:52:11.770418+0000","last_peered":"2024-05-30T16:52:11.770418+0000","last_clean":"2024-05-30T16:52:11.770418+0000","last_became_active":"2024-05-30T16:52:11.765207+0000","last_became_peered":"2024-05-30T16:52:11.765207+0000","last_unstale":"2024-05-30T16:52:11.770418+0000","last_undegraded":"2024-05-30T16:52:11.770418+0000","last_fullsized":"2024-05-30T16:52:11.770418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:58.645778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750923+0000","last_change":"2024-05-30T16:52:11.750923+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750923+0000","last_undegraded":"2024-05-30T16:52:11.750923+0000","last_fullsized":"2024-05-30T16:52:11.750923+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.759671+0000","last_change":"2024-05-30T16:52:11.755523+0000","last_active":"2024-05-30T16:52:11.759671+0000","last_peered":"2024-05-30T16:52:11.759671+0000","last_clean":"2024-05-30T16:52:11.759671+0000","last_became_active":"2024-05-30T16:52:11.755205+0000","last_became_peered":"2024-05-30T16:52:11.755205+0000","last_unstale":"2024-05-30T16:52:11.759671+0000","last_undegraded":"2024-05-30T16:52:11.759671+0000","last_fullsized":"2024-05-30T16:52:11.759671+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:39:58.679050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753019+0000","last_change":"2024-05-30T16:52:11.753019+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753019+0000","last_undegraded":"2024-05-30T16:52:11.753019+0000","last_fullsized":"2024-05-30T16:52:11.753019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"47'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298371+0000","last_change":"2024-05-30T16:52:11.768139+0000","last_active":"2024-05-30T16:52:14.298371+0000","last_peered":"2024-05-30T16:52:14.298371+0000","last_clean":"2024-05-30T16:52:14.298371+0000","last_became_active":"2024-05-30T16:52:11.766096+0000","last_became_peered":"2024-05-30T16:52:11.766096+0000","last_unstale":"2024-05-30T16:52:14.298371+0000","last_undegraded":"2024-05-30T16:52:14.298371+0000","last_fullsized":"2024-05-30T16:52:14.298371+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:16:34.282104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.757205+0000","last_change":"2024-05-30T16:52:11.757205+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.757205+0000","last_undegraded":"2024-05-30T16:52:11.757205+0000","last_fullsized":"2024-05-30T16:52:11.757205+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.765239+0000","last_change":"2024-05-30T16:52:11.763269+0000","last_active":"2024-05-30T16:52:11.765239+0000","last_peered":"2024-05-30T16:52:11.765239+0000","last_clean":"2024-05-30T16:52:11.765239+0000","last_became_active":"2024-05-30T16:52:11.762926+0000","last_became_peered":"2024-05-30T16:52:11.762926+0000","last_unstale":"2024-05-30T16:52:11.765239+0000","last_undegraded":"2024-05-30T16:52:11.765239+0000","last_fullsized":"2024-05-30T16:52:11.765239+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:30.572646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746228+0000","last_change":"2024-05-30T16:52:11.746228+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746228+0000","last_undegraded":"2024-05-30T16:52:11.746228+0000","last_fullsized":"2024-05-30T16:52:11.746228+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.762891+0000","last_change":"2024-05-30T16:52:11.761194+0000","last_active":"2024-05-30T16:52:11.762891+0000","last_peered":"2024-05-30T16:52:11.762891+0000","last_clean":"2024-05-30T16:52:11.762891+0000","last_became_active":"2024-05-30T16:52:11.760872+0000","last_became_peered":"2024-05-30T16:52:11.760872+0000","last_unstale":"2024-05-30T16:52:11.762891+0000","last_undegraded":"2024-05-30T16:52:11.762891+0000","last_fullsized":"2024-05-30T16:52:11.762891+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:30.838153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298128+0000","last_change":"2024-05-30T16:52:12.763798+0000","last_active":"2024-05-30T16:52:14.298128+0000","last_peered":"2024-05-30T16:52:14.298128+0000","last_clean":"2024-05-30T16:52:14.298128+0000","last_became_active":"2024-05-30T16:52:12.763310+0000","last_became_peered":"2024-05-30T16:52:12.763310+0000","last_unstale":"2024-05-30T16:52:14.298128+0000","last_undegraded":"2024-05-30T16:52:14.298128+0000","last_fullsized":"2024-05-30T16:52:14.298128+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:20:22.951037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.764421+0000","last_change":"2024-05-30T16:52:11.758596+0000","last_active":"2024-05-30T16:52:11.764421+0000","last_peered":"2024-05-30T16:52:11.764421+0000","last_clean":"2024-05-30T16:52:11.764421+0000","last_became_active":"2024-05-30T16:52:11.758334+0000","last_became_peered":"2024-05-30T16:52:11.758334+0000","last_unstale":"2024-05-30T16:52:11.764421+0000","last_undegraded":"2024-05-30T16:52:11.764421+0000","last_fullsized":"2024-05-30T16:52:11.764421+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:18.604651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298016+0000","last_change":"2024-05-30T16:52:12.775324+0000","last_active":"2024-05-30T16:52:14.298016+0000","last_peered":"2024-05-30T16:52:14.298016+0000","last_clean":"2024-05-30T16:52:14.298016+0000","last_became_active":"2024-05-30T16:52:12.774192+0000","last_became_peered":"2024-05-30T16:52:12.774192+0000","last_unstale":"2024-05-30T16:52:14.298016+0000","last_undegraded":"2024-05-30T16:52:14.298016+0000","last_fullsized":"2024-05-30T16:52:14.298016+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:02:30.718470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.765004+0000","last_change":"2024-05-30T16:52:11.762668+0000","last_active":"2024-05-30T16:52:11.765004+0000","last_peered":"2024-05-30T16:52:11.765004+0000","last_clean":"2024-05-30T16:52:11.765004+0000","last_became_active":"2024-05-30T16:52:11.761436+0000","last_became_peered":"2024-05-30T16:52:11.761436+0000","last_unstale":"2024-05-30T16:52:11.765004+0000","last_undegraded":"2024-05-30T16:52:11.765004+0000","last_fullsized":"2024-05-30T16:52:11.765004+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:00.336519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745044+0000","last_change":"2024-05-30T16:52:11.745044+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745044+0000","last_undegraded":"2024-05-30T16:52:11.745044+0000","last_fullsized":"2024-05-30T16:52:11.745044+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.763275+0000","last_change":"2024-05-30T16:52:11.761404+0000","last_active":"2024-05-30T16:52:11.763275+0000","last_peered":"2024-05-30T16:52:11.763275+0000","last_clean":"2024-05-30T16:52:11.763275+0000","last_became_active":"2024-05-30T16:52:11.761125+0000","last_became_peered":"2024-05-30T16:52:11.761125+0000","last_unstale":"2024-05-30T16:52:11.763275+0000","last_undegraded":"2024-05-30T16:52:11.763275+0000","last_fullsized":"2024-05-30T16:52:11.763275+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:28:04.301693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.749547+0000","last_change":"2024-05-30T16:52:11.749547+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.749547+0000","last_undegraded":"2024-05-30T16:52:11.749547+0000","last_fullsized":"2024-05-30T16:52:11.749547+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.776295+0000","last_change":"2024-05-30T16:52:11.771973+0000","last_active":"2024-05-30T16:52:11.776295+0000","last_peered":"2024-05-30T16:52:11.776295+0000","last_clean":"2024-05-30T16:52:11.776295+0000","last_became_active":"2024-05-30T16:52:11.771710+0000","last_became_peered":"2024-05-30T16:52:11.771710+0000","last_unstale":"2024-05-30T16:52:11.776295+0000","last_undegraded":"2024-05-30T16:52:11.776295+0000","last_fullsized":"2024-05-30T16:52:11.776295+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:48:23.620060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.758116+0000","last_change":"2024-05-30T16:52:11.758116+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.758116+0000","last_undegraded":"2024-05-30T16:52:11.758116+0000","last_fullsized":"2024-05-30T16:52:11.758116+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.762019+0000","last_change":"2024-05-30T16:52:11.759259+0000","last_active":"2024-05-30T16:52:11.762019+0000","last_peered":"2024-05-30T16:52:11.762019+0000","last_clean":"2024-05-30T16:52:11.762019+0000","last_became_active":"2024-05-30T16:52:11.758515+0000","last_became_peered":"2024-05-30T16:52:11.758515+0000","last_unstale":"2024-05-30T16:52:11.762019+0000","last_undegraded":"2024-05-30T16:52:11.762019+0000","last_fullsized":"2024-05-30T16:52:11.762019+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:39:58.679050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":211,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.746315+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:52:11.746315+0000","last_peered":"2024-05-30T16:52:11.746315+0000","last_clean":"2024-05-30T16:52:11.746315+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:52:11.746315+0000","last_undegraded":"2024-05-30T16:52:11.746315+0000","last_fullsized":"2024-05-30T16:52:11.746315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335420,"statfs":{"total":96636764160,"available":96599470080,"internally_reserved":0,"allocated":1101824,"data_stored":790316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":507904,"data_stored":199948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35836,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":507904,"data_stored":199948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35852,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335988,"statfs":{"total":96636764160,"available":96600051712,"internally_reserved":0,"allocated":520192,"data_stored":206243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509483,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":520192,"data_stored":206243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35852,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335988,"statfs":{"total":96636764160,"available":96600051712,"internally_reserved":0,"allocated":520192,"data_stored":206243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1101824,"data_stored":790316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35884,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335956,"statfs":{"total":96636764160,"available":96600018944,"internally_reserved":0,"allocated":557056,"data_stored":220012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:52:17.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:52:17.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.461+0000 7fd3f0e00640 1 Processor -- start 2024-05-30T16:52:17.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.461+0000 7fd3f0e00640 1 -- start start 2024-05-30T16:52:17.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3f0e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd3ec0b48f0 0x7fd3ec1630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3f0e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd3ec072d00 0x7fd3ec073170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3f0e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3ec15fbe0 con 0x7fd3ec0b4510 2024-05-30T16:52:17.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3f0e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd3ec1635f0 con 0x7fd3ec0b48f0 2024-05-30T16:52:17.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3f0e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd3ec0736b0 con 0x7fd3ec072d00 2024-05-30T16:52:17.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3e3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd3ec0b48f0 0x7fd3ec1630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3e3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd3ec0b48f0 0x7fd3ec1630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46680/0 (socket says 172.21.15.59:46680) 2024-05-30T16:52:17.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3e3e00640 1 -- 172.21.15.59:0/1307540383 learned_addr learned my addr 172.21.15.59:0/1307540383 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:17.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3ea800640 1 --2- 172.21.15.59:0/1307540383 >> v2:172.21.15.107:3300/0 conn(0x7fd3ec072d00 0x7fd3ec073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3e3e00640 1 -- 172.21.15.59:0/1307540383 >> v2:172.21.15.107:3300/0 conn(0x7fd3ec072d00 msgr2=0x7fd3ec073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:17.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3e3e00640 1 --2- 172.21.15.59:0/1307540383 >> v2:172.21.15.107:3300/0 conn(0x7fd3ec072d00 0x7fd3ec073170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3e3e00640 1 -- 172.21.15.59:0/1307540383 >> v1:172.21.15.107:6789/0 conn(0x7fd3ec0b4510 legacy=0x7fd3ec15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3e3e00640 1 -- 172.21.15.59:0/1307540383 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ec15fec0 con 0x7fd3ec0b48f0 2024-05-30T16:52:17.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.465+0000 7fd3ea800640 1 --2- 172.21.15.59:0/1307540383 >> v2:172.21.15.107:3300/0 conn(0x7fd3ec072d00 0x7fd3ec073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:17.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3e3e00640 1 --2- 172.21.15.59:0/1307540383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ec0b48f0 0x7fd3ec1630b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0b07e0 tx=0x7fd3d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5924fff1b3ac33fe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:17.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3e9400640 1 -- 172.21.15.59:0/1307540383 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40ab610 con 0x7fd3ec0b48f0 2024-05-30T16:52:17.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3e9400640 1 -- 172.21.15.59:0/1307540383 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d40b0070 con 0x7fd3ec0b48f0 2024-05-30T16:52:17.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3e9400640 1 -- 172.21.15.59:0/1307540383 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40ab9d0 con 0x7fd3ec0b48f0 2024-05-30T16:52:17.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1307540383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ec0b48f0 msgr2=0x7fd3ec1630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3f0e00640 1 --2- 172.21.15.59:0/1307540383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ec0b48f0 0x7fd3ec1630b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0b07e0 tx=0x7fd3d401c520 comp rx=0 tx=0).stop 2024-05-30T16:52:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1307540383 shutdown_connections 2024-05-30T16:52:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3f0e00640 1 --2- 172.21.15.59:0/1307540383 >> v2:172.21.15.107:3300/0 conn(0x7fd3ec072d00 0x7fd3ec073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3f0e00640 1 --2- 172.21.15.59:0/1307540383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ec0b48f0 0x7fd3ec1630b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1307540383 >> 172.21.15.59:0/1307540383 conn(0x7fd3ec0b3240 msgr2=0x7fd3ec0725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1307540383 shutdown_connections 2024-05-30T16:52:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1307540383 wait complete. 2024-05-30T16:52:17.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3f0e00640 1 Processor -- start 2024-05-30T16:52:17.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.469+0000 7fd3f0e00640 1 -- start start 2024-05-30T16:52:17.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3f0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ec072d00 0x7fd3ec0b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3f0e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3ec0b4510 0x7fd3ec15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3f0e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3ec0b48f0 0x7fd3ec159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3f0e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ec15f940 con 0x7fd3ec072d00 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3f0e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ec15f7c0 con 0x7fd3ec0b4510 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3f0e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd3ec06ee60 con 0x7fd3ec0b48f0 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ec072d00 0x7fd3ec0b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ec072d00 0x7fd3ec0b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46682/0 (socket says 172.21.15.59:46682) 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e9e00640 1 -- 172.21.15.59:0/1292152812 learned_addr learned my addr 172.21.15.59:0/1292152812 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e3e00640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3ec0b4510 0x7fd3ec15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3ea800640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3ec0b48f0 0x7fd3ec159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e9e00640 1 -- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3ec0b48f0 msgr2=0x7fd3ec159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e9e00640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3ec0b48f0 0x7fd3ec159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e9e00640 1 -- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3ec0b4510 msgr2=0x7fd3ec15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e9e00640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3ec0b4510 0x7fd3ec15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e9e00640 1 -- 172.21.15.59:0/1292152812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ec154cc0 con 0x7fd3ec072d00 2024-05-30T16:52:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e9e00640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ec072d00 0x7fd3ec0b0ce0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c530 tx=0x7fd3dc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e2000640 1 -- 172.21.15.59:0/1292152812 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc016020 con 0x7fd3ec072d00 2024-05-30T16:52:17.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e2000640 1 -- 172.21.15.59:0/1292152812 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3dc005220 con 0x7fd3ec072d00 2024-05-30T16:52:17.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e2000640 1 -- 172.21.15.59:0/1292152812 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc007030 con 0x7fd3ec072d00 2024-05-30T16:52:17.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1292152812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3ec15d3e0 con 0x7fd3ec072d00 2024-05-30T16:52:17.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1292152812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3ec15d0d0 con 0x7fd3ec072d00 2024-05-30T16:52:17.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1292152812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3ec15d5b0 con 0x7fd3ec072d00 2024-05-30T16:52:17.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.473+0000 7fd3e2000640 1 -- 172.21.15.59:0/1292152812 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fd3dc0071d0 con 0x7fd3ec072d00 2024-05-30T16:52:17.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.477+0000 7fd3e2000640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd3c8068650 0x7fd3c806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.477+0000 7fd3e2000640 1 -- 172.21.15.59:0/1292152812 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7fd3dc086680 con 0x7fd3ec072d00 2024-05-30T16:52:17.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.477+0000 7fd3e3e00640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd3c8068650 0x7fd3c806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.477+0000 7fd3e3e00640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd3c8068650 0x7fd3c806ab10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40af000 tx=0x7fd3d40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:17.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.481+0000 7fd3e2000640 1 -- 172.21.15.59:0/1292152812 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd3dc020020 con 0x7fd3ec072d00 2024-05-30T16:52:17.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.641+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1292152812 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3ec15dbe0 con 0x7fd3c8068650 2024-05-30T16:52:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.649+0000 7fd3e2000640 1 -- 172.21.15.59:0/1292152812 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247405 (secure 0 0 0) 0x7fd3ec15dbe0 con 0x7fd3c8068650 2024-05-30T16:52:17.654 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:17.655 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:52:17.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.653+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd3c8068650 msgr2=0x7fd3c806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.653+0000 7fd3f0e00640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd3c8068650 0x7fd3c806ab10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40af000 tx=0x7fd3d40a7000 comp rx=0 tx=0).stop 2024-05-30T16:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.653+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1292152812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ec072d00 msgr2=0x7fd3ec0b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.653+0000 7fd3f0e00640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ec072d00 0x7fd3ec0b0ce0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c530 tx=0x7fd3dc00c9f0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.653+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1292152812 shutdown_connections 2024-05-30T16:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.653+0000 7fd3f0e00640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd3c8068650 0x7fd3c806ab10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.653+0000 7fd3f0e00640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3ec0b48f0 0x7fd3ec159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.653+0000 7fd3f0e00640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3ec0b4510 0x7fd3ec15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.653+0000 7fd3f0e00640 1 --2- 172.21.15.59:0/1292152812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ec072d00 0x7fd3ec0b0ce0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.653+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1292152812 >> 172.21.15.59:0/1292152812 conn(0x7fd3ec0b3240 msgr2=0x7fd3ec158600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.653+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1292152812 shutdown_connections 2024-05-30T16:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.653+0000 7fd3f0e00640 1 -- 172.21.15.59:0/1292152812 wait complete. 2024-05-30T16:52:17.675 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-05-30T16:52:17.117379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275480,"kb_used_data":5212,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754699240,"statfs":{"total":773094113280,"available":772812021760,"internally_reserved":0,"allocated":5337088,"data_stored":2819269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001323"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747138+0000","last_change":"2024-05-30T16:52:11.747138+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747138+0000","last_undegraded":"2024-05-30T16:52:11.747138+0000","last_fullsized":"2024-05-30T16:52:11.747138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745784+0000","last_change":"2024-05-30T16:52:11.745784+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745784+0000","last_undegraded":"2024-05-30T16:52:11.745784+0000","last_fullsized":"2024-05-30T16:52:11.745784+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.756091+0000","last_change":"2024-05-30T16:52:11.756091+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.756091+0000","last_undegraded":"2024-05-30T16:52:11.756091+0000","last_fullsized":"2024-05-30T16:52:11.756091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.757759+0000","last_change":"2024-05-30T16:52:11.757759+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.757759+0000","last_undegraded":"2024-05-30T16:52:11.757759+0000","last_fullsized":"2024-05-30T16:52:11.757759+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746121+0000","last_change":"2024-05-30T16:52:11.746121+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746121+0000","last_undegraded":"2024-05-30T16:52:11.746121+0000","last_fullsized":"2024-05-30T16:52:11.746121+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297925+0000","last_change":"2024-05-30T16:52:12.771108+0000","last_active":"2024-05-30T16:52:14.297925+0000","last_peered":"2024-05-30T16:52:14.297925+0000","last_clean":"2024-05-30T16:52:14.297925+0000","last_became_active":"2024-05-30T16:52:12.770805+0000","last_became_peered":"2024-05-30T16:52:12.770805+0000","last_unstale":"2024-05-30T16:52:14.297925+0000","last_undegraded":"2024-05-30T16:52:14.297925+0000","last_fullsized":"2024-05-30T16:52:14.297925+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:29:26.725308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745496+0000","last_change":"2024-05-30T16:52:11.745496+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745496+0000","last_undegraded":"2024-05-30T16:52:11.745496+0000","last_fullsized":"2024-05-30T16:52:11.745496+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.761114+0000","last_change":"2024-05-30T16:52:11.761114+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.761114+0000","last_undegraded":"2024-05-30T16:52:11.761114+0000","last_fullsized":"2024-05-30T16:52:11.761114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.760182+0000","last_change":"2024-05-30T16:52:11.760182+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.760182+0000","last_undegraded":"2024-05-30T16:52:11.760182+0000","last_fullsized":"2024-05-30T16:52:11.760182+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.758558+0000","last_change":"2024-05-30T16:52:11.758558+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.758558+0000","last_undegraded":"2024-05-30T16:52:11.758558+0000","last_fullsized":"2024-05-30T16:52:11.758558+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.766067+0000","last_change":"2024-05-30T16:52:11.766067+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.766067+0000","last_undegraded":"2024-05-30T16:52:11.766067+0000","last_fullsized":"2024-05-30T16:52:11.766067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748560+0000","last_change":"2024-05-30T16:52:11.748560+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748560+0000","last_undegraded":"2024-05-30T16:52:11.748560+0000","last_fullsized":"2024-05-30T16:52:11.748560+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.755351+0000","last_change":"2024-05-30T16:52:11.755351+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.755351+0000","last_undegraded":"2024-05-30T16:52:11.755351+0000","last_fullsized":"2024-05-30T16:52:11.755351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.767001+0000","last_change":"2024-05-30T16:52:11.767001+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.767001+0000","last_undegraded":"2024-05-30T16:52:11.767001+0000","last_fullsized":"2024-05-30T16:52:11.767001+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297516+0000","last_change":"2024-05-30T16:52:12.772027+0000","last_active":"2024-05-30T16:52:14.297516+0000","last_peered":"2024-05-30T16:52:14.297516+0000","last_clean":"2024-05-30T16:52:14.297516+0000","last_became_active":"2024-05-30T16:52:12.771761+0000","last_became_peered":"2024-05-30T16:52:12.771761+0000","last_unstale":"2024-05-30T16:52:14.297516+0000","last_undegraded":"2024-05-30T16:52:14.297516+0000","last_fullsized":"2024-05-30T16:52:14.297516+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:59:54.866618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752070+0000","last_change":"2024-05-30T16:52:11.752070+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752070+0000","last_undegraded":"2024-05-30T16:52:11.752070+0000","last_fullsized":"2024-05-30T16:52:11.752070+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753351+0000","last_change":"2024-05-30T16:52:11.753351+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753351+0000","last_undegraded":"2024-05-30T16:52:11.753351+0000","last_fullsized":"2024-05-30T16:52:11.753351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.754200+0000","last_change":"2024-05-30T16:52:11.754200+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.754200+0000","last_undegraded":"2024-05-30T16:52:11.754200+0000","last_fullsized":"2024-05-30T16:52:11.754200+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753706+0000","last_change":"2024-05-30T16:52:11.753706+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753706+0000","last_undegraded":"2024-05-30T16:52:11.753706+0000","last_fullsized":"2024-05-30T16:52:11.753706+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748657+0000","last_change":"2024-05-30T16:52:11.748657+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748657+0000","last_undegraded":"2024-05-30T16:52:11.748657+0000","last_fullsized":"2024-05-30T16:52:11.748657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297955+0000","last_change":"2024-05-30T16:52:12.775532+0000","last_active":"2024-05-30T16:52:14.297955+0000","last_peered":"2024-05-30T16:52:14.297955+0000","last_clean":"2024-05-30T16:52:14.297955+0000","last_became_active":"2024-05-30T16:52:12.775054+0000","last_became_peered":"2024-05-30T16:52:12.775054+0000","last_unstale":"2024-05-30T16:52:14.297955+0000","last_undegraded":"2024-05-30T16:52:14.297955+0000","last_fullsized":"2024-05-30T16:52:14.297955+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:31:14.760035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.766551+0000","last_change":"2024-05-30T16:52:11.766551+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.766551+0000","last_undegraded":"2024-05-30T16:52:11.766551+0000","last_fullsized":"2024-05-30T16:52:11.766551+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.751797+0000","last_change":"2024-05-30T16:52:11.751797+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.751797+0000","last_undegraded":"2024-05-30T16:52:11.751797+0000","last_fullsized":"2024-05-30T16:52:11.751797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.751513+0000","last_change":"2024-05-30T16:52:11.751513+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.751513+0000","last_undegraded":"2024-05-30T16:52:11.751513+0000","last_fullsized":"2024-05-30T16:52:11.751513+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753951+0000","last_change":"2024-05-30T16:52:11.753951+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753951+0000","last_undegraded":"2024-05-30T16:52:11.753951+0000","last_fullsized":"2024-05-30T16:52:11.753951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748138+0000","last_change":"2024-05-30T16:52:11.748138+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748138+0000","last_undegraded":"2024-05-30T16:52:11.748138+0000","last_fullsized":"2024-05-30T16:52:11.748138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752041+0000","last_change":"2024-05-30T16:52:11.752041+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752041+0000","last_undegraded":"2024-05-30T16:52:11.752041+0000","last_fullsized":"2024-05-30T16:52:11.752041+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747847+0000","last_change":"2024-05-30T16:52:11.747847+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747847+0000","last_undegraded":"2024-05-30T16:52:11.747847+0000","last_fullsized":"2024-05-30T16:52:11.747847+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.751469+0000","last_change":"2024-05-30T16:52:11.751469+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.751469+0000","last_undegraded":"2024-05-30T16:52:11.751469+0000","last_fullsized":"2024-05-30T16:52:11.751469+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750983+0000","last_change":"2024-05-30T16:52:11.750983+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750983+0000","last_undegraded":"2024-05-30T16:52:11.750983+0000","last_fullsized":"2024-05-30T16:52:11.750983+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297628+0000","last_change":"2024-05-30T16:52:12.766158+0000","last_active":"2024-05-30T16:52:14.297628+0000","last_peered":"2024-05-30T16:52:14.297628+0000","last_clean":"2024-05-30T16:52:14.297628+0000","last_became_active":"2024-05-30T16:52:12.765499+0000","last_became_peered":"2024-05-30T16:52:12.765499+0000","last_unstale":"2024-05-30T16:52:14.297628+0000","last_undegraded":"2024-05-30T16:52:14.297628+0000","last_fullsized":"2024-05-30T16:52:14.297628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:45:32.830341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747251+0000","last_change":"2024-05-30T16:52:11.747251+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747251+0000","last_undegraded":"2024-05-30T16:52:11.747251+0000","last_fullsized":"2024-05-30T16:52:11.747251+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750137+0000","last_change":"2024-05-30T16:52:11.750137+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750137+0000","last_undegraded":"2024-05-30T16:52:11.750137+0000","last_fullsized":"2024-05-30T16:52:11.750137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298463+0000","last_change":"2024-05-30T16:52:11.768213+0000","last_active":"2024-05-30T16:52:14.298463+0000","last_peered":"2024-05-30T16:52:14.298463+0000","last_clean":"2024-05-30T16:52:14.298463+0000","last_became_active":"2024-05-30T16:52:11.767915+0000","last_became_peered":"2024-05-30T16:52:11.767915+0000","last_unstale":"2024-05-30T16:52:14.298463+0000","last_undegraded":"2024-05-30T16:52:14.298463+0000","last_fullsized":"2024-05-30T16:52:14.298463+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:32:49.346808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753479+0000","last_change":"2024-05-30T16:52:11.753479+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753479+0000","last_undegraded":"2024-05-30T16:52:11.753479+0000","last_fullsized":"2024-05-30T16:52:11.753479+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.768971+0000","last_change":"2024-05-30T16:52:11.767326+0000","last_active":"2024-05-30T16:52:11.768971+0000","last_peered":"2024-05-30T16:52:11.768971+0000","last_clean":"2024-05-30T16:52:11.768971+0000","last_became_active":"2024-05-30T16:52:11.766962+0000","last_became_peered":"2024-05-30T16:52:11.766962+0000","last_unstale":"2024-05-30T16:52:11.768971+0000","last_undegraded":"2024-05-30T16:52:11.768971+0000","last_fullsized":"2024-05-30T16:52:11.768971+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:35.144180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745368+0000","last_change":"2024-05-30T16:52:11.745368+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745368+0000","last_undegraded":"2024-05-30T16:52:11.745368+0000","last_fullsized":"2024-05-30T16:52:11.745368+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.769786+0000","last_change":"2024-05-30T16:52:11.762080+0000","last_active":"2024-05-30T16:52:11.769786+0000","last_peered":"2024-05-30T16:52:11.769786+0000","last_clean":"2024-05-30T16:52:11.769786+0000","last_became_active":"2024-05-30T16:52:11.761680+0000","last_became_peered":"2024-05-30T16:52:11.761680+0000","last_unstale":"2024-05-30T16:52:11.769786+0000","last_undegraded":"2024-05-30T16:52:11.769786+0000","last_fullsized":"2024-05-30T16:52:11.769786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:00.336519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.749399+0000","last_change":"2024-05-30T16:52:11.749399+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.749399+0000","last_undegraded":"2024-05-30T16:52:11.749399+0000","last_fullsized":"2024-05-30T16:52:11.749399+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.759758+0000","last_change":"2024-05-30T16:52:11.756991+0000","last_active":"2024-05-30T16:52:11.759758+0000","last_peered":"2024-05-30T16:52:11.759758+0000","last_clean":"2024-05-30T16:52:11.759758+0000","last_became_active":"2024-05-30T16:52:11.756716+0000","last_became_peered":"2024-05-30T16:52:11.756716+0000","last_unstale":"2024-05-30T16:52:11.759758+0000","last_undegraded":"2024-05-30T16:52:11.759758+0000","last_fullsized":"2024-05-30T16:52:11.759758+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:42:42.339988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750426+0000","last_change":"2024-05-30T16:52:11.750426+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750426+0000","last_undegraded":"2024-05-30T16:52:11.750426+0000","last_fullsized":"2024-05-30T16:52:11.750426+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298034+0000","last_change":"2024-05-30T16:52:11.765391+0000","last_active":"2024-05-30T16:52:14.298034+0000","last_peered":"2024-05-30T16:52:14.298034+0000","last_clean":"2024-05-30T16:52:14.298034+0000","last_became_active":"2024-05-30T16:52:11.765096+0000","last_became_peered":"2024-05-30T16:52:11.765096+0000","last_unstale":"2024-05-30T16:52:14.298034+0000","last_undegraded":"2024-05-30T16:52:14.298034+0000","last_fullsized":"2024-05-30T16:52:14.298034+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:19:40.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.760252+0000","last_change":"2024-05-30T16:52:11.760252+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.760252+0000","last_undegraded":"2024-05-30T16:52:11.760252+0000","last_fullsized":"2024-05-30T16:52:11.760252+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.763688+0000","last_change":"2024-05-30T16:52:11.757778+0000","last_active":"2024-05-30T16:52:11.763688+0000","last_peered":"2024-05-30T16:52:11.763688+0000","last_clean":"2024-05-30T16:52:11.763688+0000","last_became_active":"2024-05-30T16:52:11.757401+0000","last_became_peered":"2024-05-30T16:52:11.757401+0000","last_unstale":"2024-05-30T16:52:11.763688+0000","last_undegraded":"2024-05-30T16:52:11.763688+0000","last_fullsized":"2024-05-30T16:52:11.763688+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:30.838153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750162+0000","last_change":"2024-05-30T16:52:11.750162+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750162+0000","last_undegraded":"2024-05-30T16:52:11.750162+0000","last_fullsized":"2024-05-30T16:52:11.750162+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.760258+0000","last_change":"2024-05-30T16:52:11.754254+0000","last_active":"2024-05-30T16:52:11.760258+0000","last_peered":"2024-05-30T16:52:11.760258+0000","last_clean":"2024-05-30T16:52:11.760258+0000","last_became_active":"2024-05-30T16:52:11.753946+0000","last_became_peered":"2024-05-30T16:52:11.753946+0000","last_unstale":"2024-05-30T16:52:11.760258+0000","last_undegraded":"2024-05-30T16:52:11.760258+0000","last_fullsized":"2024-05-30T16:52:11.760258+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:15.949367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752244+0000","last_change":"2024-05-30T16:52:11.752244+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752244+0000","last_undegraded":"2024-05-30T16:52:11.752244+0000","last_fullsized":"2024-05-30T16:52:11.752244+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.776273+0000","last_change":"2024-05-30T16:52:11.771861+0000","last_active":"2024-05-30T16:52:11.776273+0000","last_peered":"2024-05-30T16:52:11.776273+0000","last_clean":"2024-05-30T16:52:11.776273+0000","last_became_active":"2024-05-30T16:52:11.771573+0000","last_became_peered":"2024-05-30T16:52:11.771573+0000","last_unstale":"2024-05-30T16:52:11.776273+0000","last_undegraded":"2024-05-30T16:52:11.776273+0000","last_fullsized":"2024-05-30T16:52:11.776273+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:34.799686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753597+0000","last_change":"2024-05-30T16:52:11.753597+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753597+0000","last_undegraded":"2024-05-30T16:52:11.753597+0000","last_fullsized":"2024-05-30T16:52:11.753597+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.768990+0000","last_change":"2024-05-30T16:52:11.768155+0000","last_active":"2024-05-30T16:52:11.768990+0000","last_peered":"2024-05-30T16:52:11.768990+0000","last_clean":"2024-05-30T16:52:11.768990+0000","last_became_active":"2024-05-30T16:52:11.767557+0000","last_became_peered":"2024-05-30T16:52:11.767557+0000","last_unstale":"2024-05-30T16:52:11.768990+0000","last_undegraded":"2024-05-30T16:52:11.768990+0000","last_fullsized":"2024-05-30T16:52:11.768990+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:47:42.557576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746658+0000","last_change":"2024-05-30T16:52:11.746658+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746658+0000","last_undegraded":"2024-05-30T16:52:11.746658+0000","last_fullsized":"2024-05-30T16:52:11.746658+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.776371+0000","last_change":"2024-05-30T16:52:11.773802+0000","last_active":"2024-05-30T16:52:11.776371+0000","last_peered":"2024-05-30T16:52:11.776371+0000","last_clean":"2024-05-30T16:52:11.776371+0000","last_became_active":"2024-05-30T16:52:11.771528+0000","last_became_peered":"2024-05-30T16:52:11.771528+0000","last_unstale":"2024-05-30T16:52:11.776371+0000","last_undegraded":"2024-05-30T16:52:11.776371+0000","last_fullsized":"2024-05-30T16:52:11.776371+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:01:16.197933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298144+0000","last_change":"2024-05-30T16:52:12.773756+0000","last_active":"2024-05-30T16:52:14.298144+0000","last_peered":"2024-05-30T16:52:14.298144+0000","last_clean":"2024-05-30T16:52:14.298144+0000","last_became_active":"2024-05-30T16:52:12.773592+0000","last_became_peered":"2024-05-30T16:52:12.773592+0000","last_unstale":"2024-05-30T16:52:14.298144+0000","last_undegraded":"2024-05-30T16:52:14.298144+0000","last_fullsized":"2024-05-30T16:52:14.298144+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:31:13.580941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.765260+0000","last_change":"2024-05-30T16:52:11.763496+0000","last_active":"2024-05-30T16:52:11.765260+0000","last_peered":"2024-05-30T16:52:11.765260+0000","last_clean":"2024-05-30T16:52:11.765260+0000","last_became_active":"2024-05-30T16:52:11.763141+0000","last_became_peered":"2024-05-30T16:52:11.763141+0000","last_unstale":"2024-05-30T16:52:11.765260+0000","last_undegraded":"2024-05-30T16:52:11.765260+0000","last_fullsized":"2024-05-30T16:52:11.765260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:19:41.036951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748364+0000","last_change":"2024-05-30T16:52:11.748364+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748364+0000","last_undegraded":"2024-05-30T16:52:11.748364+0000","last_fullsized":"2024-05-30T16:52:11.748364+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.770892+0000","last_change":"2024-05-30T16:52:11.763318+0000","last_active":"2024-05-30T16:52:11.770892+0000","last_peered":"2024-05-30T16:52:11.770892+0000","last_clean":"2024-05-30T16:52:11.770892+0000","last_became_active":"2024-05-30T16:52:11.763052+0000","last_became_peered":"2024-05-30T16:52:11.763052+0000","last_unstale":"2024-05-30T16:52:11.770892+0000","last_undegraded":"2024-05-30T16:52:11.770892+0000","last_fullsized":"2024-05-30T16:52:11.770892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:37:33.427945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752659+0000","last_change":"2024-05-30T16:52:11.752659+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752659+0000","last_undegraded":"2024-05-30T16:52:11.752659+0000","last_fullsized":"2024-05-30T16:52:11.752659+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298083+0000","last_change":"2024-05-30T16:52:11.775662+0000","last_active":"2024-05-30T16:52:14.298083+0000","last_peered":"2024-05-30T16:52:14.298083+0000","last_clean":"2024-05-30T16:52:14.298083+0000","last_became_active":"2024-05-30T16:52:11.775356+0000","last_became_peered":"2024-05-30T16:52:11.775356+0000","last_unstale":"2024-05-30T16:52:14.298083+0000","last_undegraded":"2024-05-30T16:52:14.298083+0000","last_fullsized":"2024-05-30T16:52:14.298083+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:32:56.547786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.759822+0000","last_change":"2024-05-30T16:52:11.759822+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.759822+0000","last_undegraded":"2024-05-30T16:52:11.759822+0000","last_fullsized":"2024-05-30T16:52:11.759822+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.766760+0000","last_change":"2024-05-30T16:52:11.765673+0000","last_active":"2024-05-30T16:52:11.766760+0000","last_peered":"2024-05-30T16:52:11.766760+0000","last_clean":"2024-05-30T16:52:11.766760+0000","last_became_active":"2024-05-30T16:52:11.765157+0000","last_became_peered":"2024-05-30T16:52:11.765157+0000","last_unstale":"2024-05-30T16:52:11.766760+0000","last_undegraded":"2024-05-30T16:52:11.766760+0000","last_fullsized":"2024-05-30T16:52:11.766760+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:20.133814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297416+0000","last_change":"2024-05-30T16:52:12.781216+0000","last_active":"2024-05-30T16:52:14.297416+0000","last_peered":"2024-05-30T16:52:14.297416+0000","last_clean":"2024-05-30T16:52:14.297416+0000","last_became_active":"2024-05-30T16:52:12.779763+0000","last_became_peered":"2024-05-30T16:52:12.779763+0000","last_unstale":"2024-05-30T16:52:14.297416+0000","last_undegraded":"2024-05-30T16:52:14.297416+0000","last_fullsized":"2024-05-30T16:52:14.297416+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:21:02.860921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297657+0000","last_change":"2024-05-30T16:52:11.771843+0000","last_active":"2024-05-30T16:52:14.297657+0000","last_peered":"2024-05-30T16:52:14.297657+0000","last_clean":"2024-05-30T16:52:14.297657+0000","last_became_active":"2024-05-30T16:52:11.771540+0000","last_became_peered":"2024-05-30T16:52:11.771540+0000","last_unstale":"2024-05-30T16:52:14.297657+0000","last_undegraded":"2024-05-30T16:52:14.297657+0000","last_fullsized":"2024-05-30T16:52:14.297657+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:47:01.601969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.744985+0000","last_change":"2024-05-30T16:52:11.744985+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.744985+0000","last_undegraded":"2024-05-30T16:52:11.744985+0000","last_fullsized":"2024-05-30T16:52:11.744985+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.761275+0000","last_change":"2024-05-30T16:52:11.754549+0000","last_active":"2024-05-30T16:52:11.761275+0000","last_peered":"2024-05-30T16:52:11.761275+0000","last_clean":"2024-05-30T16:52:11.761275+0000","last_became_active":"2024-05-30T16:52:11.754201+0000","last_became_peered":"2024-05-30T16:52:11.754201+0000","last_unstale":"2024-05-30T16:52:11.761275+0000","last_undegraded":"2024-05-30T16:52:11.761275+0000","last_fullsized":"2024-05-30T16:52:11.761275+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:07:32.823371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747354+0000","last_change":"2024-05-30T16:52:11.747354+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747354+0000","last_undegraded":"2024-05-30T16:52:11.747354+0000","last_fullsized":"2024-05-30T16:52:11.747354+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.766290+0000","last_change":"2024-05-30T16:52:11.759174+0000","last_active":"2024-05-30T16:52:11.766290+0000","last_peered":"2024-05-30T16:52:11.766290+0000","last_clean":"2024-05-30T16:52:11.766290+0000","last_became_active":"2024-05-30T16:52:11.758846+0000","last_became_peered":"2024-05-30T16:52:11.758846+0000","last_unstale":"2024-05-30T16:52:11.766290+0000","last_undegraded":"2024-05-30T16:52:11.766290+0000","last_fullsized":"2024-05-30T16:52:11.766290+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:55:12.259158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.759726+0000","last_change":"2024-05-30T16:52:11.759726+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.759726+0000","last_undegraded":"2024-05-30T16:52:11.759726+0000","last_fullsized":"2024-05-30T16:52:11.759726+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.764953+0000","last_change":"2024-05-30T16:52:11.762654+0000","last_active":"2024-05-30T16:52:11.764953+0000","last_peered":"2024-05-30T16:52:11.764953+0000","last_clean":"2024-05-30T16:52:11.764953+0000","last_became_active":"2024-05-30T16:52:11.762385+0000","last_became_peered":"2024-05-30T16:52:11.762385+0000","last_unstale":"2024-05-30T16:52:11.764953+0000","last_undegraded":"2024-05-30T16:52:11.764953+0000","last_fullsized":"2024-05-30T16:52:11.764953+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:28:04.301693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752775+0000","last_change":"2024-05-30T16:52:11.752775+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752775+0000","last_undegraded":"2024-05-30T16:52:11.752775+0000","last_fullsized":"2024-05-30T16:52:11.752775+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.760366+0000","last_change":"2024-05-30T16:52:11.754550+0000","last_active":"2024-05-30T16:52:11.760366+0000","last_peered":"2024-05-30T16:52:11.760366+0000","last_clean":"2024-05-30T16:52:11.760366+0000","last_became_active":"2024-05-30T16:52:11.754274+0000","last_became_peered":"2024-05-30T16:52:11.754274+0000","last_unstale":"2024-05-30T16:52:11.760366+0000","last_undegraded":"2024-05-30T16:52:11.760366+0000","last_fullsized":"2024-05-30T16:52:11.760366+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:48.116676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.754740+0000","last_change":"2024-05-30T16:52:11.754740+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.754740+0000","last_undegraded":"2024-05-30T16:52:11.754740+0000","last_fullsized":"2024-05-30T16:52:11.754740+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298194+0000","last_change":"2024-05-30T16:52:11.767257+0000","last_active":"2024-05-30T16:52:14.298194+0000","last_peered":"2024-05-30T16:52:14.298194+0000","last_clean":"2024-05-30T16:52:14.298194+0000","last_became_active":"2024-05-30T16:52:11.766776+0000","last_became_peered":"2024-05-30T16:52:11.766776+0000","last_unstale":"2024-05-30T16:52:14.298194+0000","last_undegraded":"2024-05-30T16:52:14.298194+0000","last_fullsized":"2024-05-30T16:52:14.298194+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:49.907573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297942+0000","last_change":"2024-05-30T16:52:12.783213+0000","last_active":"2024-05-30T16:52:14.297942+0000","last_peered":"2024-05-30T16:52:14.297942+0000","last_clean":"2024-05-30T16:52:14.297942+0000","last_became_active":"2024-05-30T16:52:12.782012+0000","last_became_peered":"2024-05-30T16:52:12.782012+0000","last_unstale":"2024-05-30T16:52:14.297942+0000","last_undegraded":"2024-05-30T16:52:14.297942+0000","last_fullsized":"2024-05-30T16:52:14.297942+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:28.261365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298198+0000","last_change":"2024-05-30T16:52:11.762594+0000","last_active":"2024-05-30T16:52:14.298198+0000","last_peered":"2024-05-30T16:52:14.298198+0000","last_clean":"2024-05-30T16:52:14.298198+0000","last_became_active":"2024-05-30T16:52:11.760414+0000","last_became_peered":"2024-05-30T16:52:11.760414+0000","last_unstale":"2024-05-30T16:52:14.298198+0000","last_undegraded":"2024-05-30T16:52:14.298198+0000","last_fullsized":"2024-05-30T16:52:14.298198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:31.025155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.749065+0000","last_change":"2024-05-30T16:52:11.749065+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.749065+0000","last_undegraded":"2024-05-30T16:52:11.749065+0000","last_fullsized":"2024-05-30T16:52:11.749065+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.766062+0000","last_change":"2024-05-30T16:52:11.761712+0000","last_active":"2024-05-30T16:52:11.766062+0000","last_peered":"2024-05-30T16:52:11.766062+0000","last_clean":"2024-05-30T16:52:11.766062+0000","last_became_active":"2024-05-30T16:52:11.761375+0000","last_became_peered":"2024-05-30T16:52:11.761375+0000","last_unstale":"2024-05-30T16:52:11.766062+0000","last_undegraded":"2024-05-30T16:52:11.766062+0000","last_fullsized":"2024-05-30T16:52:11.766062+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:42:42.339988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746595+0000","last_change":"2024-05-30T16:52:11.746595+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746595+0000","last_undegraded":"2024-05-30T16:52:11.746595+0000","last_fullsized":"2024-05-30T16:52:11.746595+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.770418+0000","last_change":"2024-05-30T16:52:11.765519+0000","last_active":"2024-05-30T16:52:11.770418+0000","last_peered":"2024-05-30T16:52:11.770418+0000","last_clean":"2024-05-30T16:52:11.770418+0000","last_became_active":"2024-05-30T16:52:11.765207+0000","last_became_peered":"2024-05-30T16:52:11.765207+0000","last_unstale":"2024-05-30T16:52:11.770418+0000","last_undegraded":"2024-05-30T16:52:11.770418+0000","last_fullsized":"2024-05-30T16:52:11.770418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:58.645778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750923+0000","last_change":"2024-05-30T16:52:11.750923+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750923+0000","last_undegraded":"2024-05-30T16:52:11.750923+0000","last_fullsized":"2024-05-30T16:52:11.750923+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.759671+0000","last_change":"2024-05-30T16:52:11.755523+0000","last_active":"2024-05-30T16:52:11.759671+0000","last_peered":"2024-05-30T16:52:11.759671+0000","last_clean":"2024-05-30T16:52:11.759671+0000","last_became_active":"2024-05-30T16:52:11.755205+0000","last_became_peered":"2024-05-30T16:52:11.755205+0000","last_unstale":"2024-05-30T16:52:11.759671+0000","last_undegraded":"2024-05-30T16:52:11.759671+0000","last_fullsized":"2024-05-30T16:52:11.759671+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:39:58.679050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753019+0000","last_change":"2024-05-30T16:52:11.753019+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753019+0000","last_undegraded":"2024-05-30T16:52:11.753019+0000","last_fullsized":"2024-05-30T16:52:11.753019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"47'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298371+0000","last_change":"2024-05-30T16:52:11.768139+0000","last_active":"2024-05-30T16:52:14.298371+0000","last_peered":"2024-05-30T16:52:14.298371+0000","last_clean":"2024-05-30T16:52:14.298371+0000","last_became_active":"2024-05-30T16:52:11.766096+0000","last_became_peered":"2024-05-30T16:52:11.766096+0000","last_unstale":"2024-05-30T16:52:14.298371+0000","last_undegraded":"2024-05-30T16:52:14.298371+0000","last_fullsized":"2024-05-30T16:52:14.298371+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:16:34.282104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.757205+0000","last_change":"2024-05-30T16:52:11.757205+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.757205+0000","last_undegraded":"2024-05-30T16:52:11.757205+0000","last_fullsized":"2024-05-30T16:52:11.757205+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.765239+0000","last_change":"2024-05-30T16:52:11.763269+0000","last_active":"2024-05-30T16:52:11.765239+0000","last_peered":"2024-05-30T16:52:11.765239+0000","last_clean":"2024-05-30T16:52:11.765239+0000","last_became_active":"2024-05-30T16:52:11.762926+0000","last_became_peered":"2024-05-30T16:52:11.762926+0000","last_unstale":"2024-05-30T16:52:11.765239+0000","last_undegraded":"2024-05-30T16:52:11.765239+0000","last_fullsized":"2024-05-30T16:52:11.765239+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:30.572646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746228+0000","last_change":"2024-05-30T16:52:11.746228+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746228+0000","last_undegraded":"2024-05-30T16:52:11.746228+0000","last_fullsized":"2024-05-30T16:52:11.746228+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.762891+0000","last_change":"2024-05-30T16:52:11.761194+0000","last_active":"2024-05-30T16:52:11.762891+0000","last_peered":"2024-05-30T16:52:11.762891+0000","last_clean":"2024-05-30T16:52:11.762891+0000","last_became_active":"2024-05-30T16:52:11.760872+0000","last_became_peered":"2024-05-30T16:52:11.760872+0000","last_unstale":"2024-05-30T16:52:11.762891+0000","last_undegraded":"2024-05-30T16:52:11.762891+0000","last_fullsized":"2024-05-30T16:52:11.762891+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:30.838153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298128+0000","last_change":"2024-05-30T16:52:12.763798+0000","last_active":"2024-05-30T16:52:14.298128+0000","last_peered":"2024-05-30T16:52:14.298128+0000","last_clean":"2024-05-30T16:52:14.298128+0000","last_became_active":"2024-05-30T16:52:12.763310+0000","last_became_peered":"2024-05-30T16:52:12.763310+0000","last_unstale":"2024-05-30T16:52:14.298128+0000","last_undegraded":"2024-05-30T16:52:14.298128+0000","last_fullsized":"2024-05-30T16:52:14.298128+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:20:22.951037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.764421+0000","last_change":"2024-05-30T16:52:11.758596+0000","last_active":"2024-05-30T16:52:11.764421+0000","last_peered":"2024-05-30T16:52:11.764421+0000","last_clean":"2024-05-30T16:52:11.764421+0000","last_became_active":"2024-05-30T16:52:11.758334+0000","last_became_peered":"2024-05-30T16:52:11.758334+0000","last_unstale":"2024-05-30T16:52:11.764421+0000","last_undegraded":"2024-05-30T16:52:11.764421+0000","last_fullsized":"2024-05-30T16:52:11.764421+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:18.604651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298016+0000","last_change":"2024-05-30T16:52:12.775324+0000","last_active":"2024-05-30T16:52:14.298016+0000","last_peered":"2024-05-30T16:52:14.298016+0000","last_clean":"2024-05-30T16:52:14.298016+0000","last_became_active":"2024-05-30T16:52:12.774192+0000","last_became_peered":"2024-05-30T16:52:12.774192+0000","last_unstale":"2024-05-30T16:52:14.298016+0000","last_undegraded":"2024-05-30T16:52:14.298016+0000","last_fullsized":"2024-05-30T16:52:14.298016+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:02:30.718470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.765004+0000","last_change":"2024-05-30T16:52:11.762668+0000","last_active":"2024-05-30T16:52:11.765004+0000","last_peered":"2024-05-30T16:52:11.765004+0000","last_clean":"2024-05-30T16:52:11.765004+0000","last_became_active":"2024-05-30T16:52:11.761436+0000","last_became_peered":"2024-05-30T16:52:11.761436+0000","last_unstale":"2024-05-30T16:52:11.765004+0000","last_undegraded":"2024-05-30T16:52:11.765004+0000","last_fullsized":"2024-05-30T16:52:11.765004+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:00.336519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745044+0000","last_change":"2024-05-30T16:52:11.745044+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745044+0000","last_undegraded":"2024-05-30T16:52:11.745044+0000","last_fullsized":"2024-05-30T16:52:11.745044+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.763275+0000","last_change":"2024-05-30T16:52:11.761404+0000","last_active":"2024-05-30T16:52:11.763275+0000","last_peered":"2024-05-30T16:52:11.763275+0000","last_clean":"2024-05-30T16:52:11.763275+0000","last_became_active":"2024-05-30T16:52:11.761125+0000","last_became_peered":"2024-05-30T16:52:11.761125+0000","last_unstale":"2024-05-30T16:52:11.763275+0000","last_undegraded":"2024-05-30T16:52:11.763275+0000","last_fullsized":"2024-05-30T16:52:11.763275+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:28:04.301693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.749547+0000","last_change":"2024-05-30T16:52:11.749547+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.749547+0000","last_undegraded":"2024-05-30T16:52:11.749547+0000","last_fullsized":"2024-05-30T16:52:11.749547+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.776295+0000","last_change":"2024-05-30T16:52:11.771973+0000","last_active":"2024-05-30T16:52:11.776295+0000","last_peered":"2024-05-30T16:52:11.776295+0000","last_clean":"2024-05-30T16:52:11.776295+0000","last_became_active":"2024-05-30T16:52:11.771710+0000","last_became_peered":"2024-05-30T16:52:11.771710+0000","last_unstale":"2024-05-30T16:52:11.776295+0000","last_undegraded":"2024-05-30T16:52:11.776295+0000","last_fullsized":"2024-05-30T16:52:11.776295+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:48:23.620060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.758116+0000","last_change":"2024-05-30T16:52:11.758116+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.758116+0000","last_undegraded":"2024-05-30T16:52:11.758116+0000","last_fullsized":"2024-05-30T16:52:11.758116+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.762019+0000","last_change":"2024-05-30T16:52:11.759259+0000","last_active":"2024-05-30T16:52:11.762019+0000","last_peered":"2024-05-30T16:52:11.762019+0000","last_clean":"2024-05-30T16:52:11.762019+0000","last_became_active":"2024-05-30T16:52:11.758515+0000","last_became_peered":"2024-05-30T16:52:11.758515+0000","last_unstale":"2024-05-30T16:52:11.762019+0000","last_undegraded":"2024-05-30T16:52:11.762019+0000","last_fullsized":"2024-05-30T16:52:11.762019+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:39:58.679050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":211,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.746315+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:52:11.746315+0000","last_peered":"2024-05-30T16:52:11.746315+0000","last_clean":"2024-05-30T16:52:11.746315+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:52:11.746315+0000","last_undegraded":"2024-05-30T16:52:11.746315+0000","last_fullsized":"2024-05-30T16:52:11.746315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335420,"statfs":{"total":96636764160,"available":96599470080,"internally_reserved":0,"allocated":1101824,"data_stored":790316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":507904,"data_stored":199948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35836,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":507904,"data_stored":199948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35852,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335988,"statfs":{"total":96636764160,"available":96600051712,"internally_reserved":0,"allocated":520192,"data_stored":206243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509483,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":520192,"data_stored":206243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35852,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335988,"statfs":{"total":96636764160,"available":96600051712,"internally_reserved":0,"allocated":520192,"data_stored":206243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1101824,"data_stored":790316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35884,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335956,"statfs":{"total":96636764160,"available":96600018944,"internally_reserved":0,"allocated":557056,"data_stored":220012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:52:17.679 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3f is not active+clean 2024-05-30T16:52:17.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.747138+0000', 'last_change': '2024-05-30T16:52:11.747138+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.747138+0000', 'last_undegraded': '2024-05-30T16:52:11.747138+0000', 'last_fullsized': '2024-05-30T16:52:11.747138+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:52:17.679 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3e is not active+clean 2024-05-30T16:52:17.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.745784+0000', 'last_change': '2024-05-30T16:52:11.745784+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.745784+0000', 'last_undegraded': '2024-05-30T16:52:11.745784+0000', 'last_fullsized': '2024-05-30T16:52:11.745784+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:52:17.679 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3d is not active+clean 2024-05-30T16:52:17.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.756091+0000', 'last_change': '2024-05-30T16:52:11.756091+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.756091+0000', 'last_undegraded': '2024-05-30T16:52:11.756091+0000', 'last_fullsized': '2024-05-30T16:52:11.756091+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:52:17.680 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-05-30T16:52:17.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.757759+0000', 'last_change': '2024-05-30T16:52:11.757759+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.757759+0000', 'last_undegraded': '2024-05-30T16:52:11.757759+0000', 'last_fullsized': '2024-05-30T16:52:11.757759+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.680 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3b is not active+clean 2024-05-30T16:52:17.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.746121+0000', 'last_change': '2024-05-30T16:52:11.746121+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.746121+0000', 'last_undegraded': '2024-05-30T16:52:11.746121+0000', 'last_fullsized': '2024-05-30T16:52:11.746121+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:52:17.680 INFO:tasks.ceph.ceph_manager.ceph:PG 7.39 is not active+clean 2024-05-30T16:52:17.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.745496+0000', 'last_change': '2024-05-30T16:52:11.745496+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.745496+0000', 'last_undegraded': '2024-05-30T16:52:11.745496+0000', 'last_fullsized': '2024-05-30T16:52:11.745496+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:52:17.680 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-05-30T16:52:17.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.761114+0000', 'last_change': '2024-05-30T16:52:11.761114+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.761114+0000', 'last_undegraded': '2024-05-30T16:52:11.761114+0000', 'last_fullsized': '2024-05-30T16:52:11.761114+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.680 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-05-30T16:52:17.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.760182+0000', 'last_change': '2024-05-30T16:52:11.760182+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.760182+0000', 'last_undegraded': '2024-05-30T16:52:11.760182+0000', 'last_fullsized': '2024-05-30T16:52:11.760182+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.681 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-05-30T16:52:17.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.758558+0000', 'last_change': '2024-05-30T16:52:11.758558+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.758558+0000', 'last_undegraded': '2024-05-30T16:52:11.758558+0000', 'last_fullsized': '2024-05-30T16:52:11.758558+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.681 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-05-30T16:52:17.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.766067+0000', 'last_change': '2024-05-30T16:52:11.766067+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.766067+0000', 'last_undegraded': '2024-05-30T16:52:11.766067+0000', 'last_fullsized': '2024-05-30T16:52:11.766067+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.681 INFO:tasks.ceph.ceph_manager.ceph:PG 7.34 is not active+clean 2024-05-30T16:52:17.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.748560+0000', 'last_change': '2024-05-30T16:52:11.748560+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.748560+0000', 'last_undegraded': '2024-05-30T16:52:11.748560+0000', 'last_fullsized': '2024-05-30T16:52:11.748560+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:52:17.681 INFO:tasks.ceph.ceph_manager.ceph:PG 7.33 is not active+clean 2024-05-30T16:52:17.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.755351+0000', 'last_change': '2024-05-30T16:52:11.755351+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.755351+0000', 'last_undegraded': '2024-05-30T16:52:11.755351+0000', 'last_fullsized': '2024-05-30T16:52:11.755351+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:52:17.681 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-05-30T16:52:17.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.767001+0000', 'last_change': '2024-05-30T16:52:11.767001+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.767001+0000', 'last_undegraded': '2024-05-30T16:52:11.767001+0000', 'last_fullsized': '2024-05-30T16:52:11.767001+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.681 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-05-30T16:52:17.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.752070+0000', 'last_change': '2024-05-30T16:52:11.752070+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.752070+0000', 'last_undegraded': '2024-05-30T16:52:11.752070+0000', 'last_fullsized': '2024-05-30T16:52:11.752070+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:52:17.682 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2f is not active+clean 2024-05-30T16:52:17.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.753351+0000', 'last_change': '2024-05-30T16:52:11.753351+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.753351+0000', 'last_undegraded': '2024-05-30T16:52:11.753351+0000', 'last_fullsized': '2024-05-30T16:52:11.753351+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:52:17.682 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2e is not active+clean 2024-05-30T16:52:17.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.754200+0000', 'last_change': '2024-05-30T16:52:11.754200+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.754200+0000', 'last_undegraded': '2024-05-30T16:52:11.754200+0000', 'last_fullsized': '2024-05-30T16:52:11.754200+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:52:17.682 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-05-30T16:52:17.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.753706+0000', 'last_change': '2024-05-30T16:52:11.753706+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.753706+0000', 'last_undegraded': '2024-05-30T16:52:11.753706+0000', 'last_fullsized': '2024-05-30T16:52:11.753706+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:52:17.682 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2c is not active+clean 2024-05-30T16:52:17.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.748657+0000', 'last_change': '2024-05-30T16:52:11.748657+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.748657+0000', 'last_undegraded': '2024-05-30T16:52:11.748657+0000', 'last_fullsized': '2024-05-30T16:52:11.748657+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:52:17.682 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-05-30T16:52:17.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.766551+0000', 'last_change': '2024-05-30T16:52:11.766551+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.766551+0000', 'last_undegraded': '2024-05-30T16:52:11.766551+0000', 'last_fullsized': '2024-05-30T16:52:11.766551+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.682 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-05-30T16:52:17.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.751797+0000', 'last_change': '2024-05-30T16:52:11.751797+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.751797+0000', 'last_undegraded': '2024-05-30T16:52:11.751797+0000', 'last_fullsized': '2024-05-30T16:52:11.751797+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:52:17.685 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-05-30T16:52:17.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.751513+0000', 'last_change': '2024-05-30T16:52:11.751513+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.751513+0000', 'last_undegraded': '2024-05-30T16:52:11.751513+0000', 'last_fullsized': '2024-05-30T16:52:11.751513+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:52:17.686 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-05-30T16:52:17.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.753951+0000', 'last_change': '2024-05-30T16:52:11.753951+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.753951+0000', 'last_undegraded': '2024-05-30T16:52:11.753951+0000', 'last_fullsized': '2024-05-30T16:52:11.753951+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:52:17.686 INFO:tasks.ceph.ceph_manager.ceph:PG 7.26 is not active+clean 2024-05-30T16:52:17.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.748138+0000', 'last_change': '2024-05-30T16:52:11.748138+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.748138+0000', 'last_undegraded': '2024-05-30T16:52:11.748138+0000', 'last_fullsized': '2024-05-30T16:52:11.748138+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:52:17.686 INFO:tasks.ceph.ceph_manager.ceph:PG 7.25 is not active+clean 2024-05-30T16:52:17.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.752041+0000', 'last_change': '2024-05-30T16:52:11.752041+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.752041+0000', 'last_undegraded': '2024-05-30T16:52:11.752041+0000', 'last_fullsized': '2024-05-30T16:52:11.752041+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:52:17.686 INFO:tasks.ceph.ceph_manager.ceph:PG 7.24 is not active+clean 2024-05-30T16:52:17.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.747847+0000', 'last_change': '2024-05-30T16:52:11.747847+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.747847+0000', 'last_undegraded': '2024-05-30T16:52:11.747847+0000', 'last_fullsized': '2024-05-30T16:52:11.747847+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:52:17.687 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-05-30T16:52:17.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.751469+0000', 'last_change': '2024-05-30T16:52:11.751469+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.751469+0000', 'last_undegraded': '2024-05-30T16:52:11.751469+0000', 'last_fullsized': '2024-05-30T16:52:11.751469+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:52:17.687 INFO:tasks.ceph.ceph_manager.ceph:PG 7.22 is not active+clean 2024-05-30T16:52:17.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.750983+0000', 'last_change': '2024-05-30T16:52:11.750983+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.750983+0000', 'last_undegraded': '2024-05-30T16:52:11.750983+0000', 'last_fullsized': '2024-05-30T16:52:11.750983+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:52:17.687 INFO:tasks.ceph.ceph_manager.ceph:PG 7.20 is not active+clean 2024-05-30T16:52:17.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.747251+0000', 'last_change': '2024-05-30T16:52:11.747251+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.747251+0000', 'last_undegraded': '2024-05-30T16:52:11.747251+0000', 'last_fullsized': '2024-05-30T16:52:11.747251+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:52:17.687 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-05-30T16:52:17.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.750137+0000', 'last_change': '2024-05-30T16:52:11.750137+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.750137+0000', 'last_undegraded': '2024-05-30T16:52:11.750137+0000', 'last_fullsized': '2024-05-30T16:52:11.750137+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T16:52:17.687 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-05-30T16:52:17.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.753479+0000', 'last_change': '2024-05-30T16:52:11.753479+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.753479+0000', 'last_undegraded': '2024-05-30T16:52:11.753479+0000', 'last_fullsized': '2024-05-30T16:52:11.753479+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:52:17.688 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-05-30T16:52:17.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.745368+0000', 'last_change': '2024-05-30T16:52:11.745368+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.745368+0000', 'last_undegraded': '2024-05-30T16:52:11.745368+0000', 'last_fullsized': '2024-05-30T16:52:11.745368+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:52:17.688 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-05-30T16:52:17.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.749399+0000', 'last_change': '2024-05-30T16:52:11.749399+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.749399+0000', 'last_undegraded': '2024-05-30T16:52:11.749399+0000', 'last_fullsized': '2024-05-30T16:52:11.749399+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T16:52:17.688 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-05-30T16:52:17.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.750426+0000', 'last_change': '2024-05-30T16:52:11.750426+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.750426+0000', 'last_undegraded': '2024-05-30T16:52:11.750426+0000', 'last_fullsized': '2024-05-30T16:52:11.750426+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:52:17.688 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-05-30T16:52:17.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.760252+0000', 'last_change': '2024-05-30T16:52:11.760252+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.760252+0000', 'last_undegraded': '2024-05-30T16:52:11.760252+0000', 'last_fullsized': '2024-05-30T16:52:11.760252+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.688 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-05-30T16:52:17.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.750162+0000', 'last_change': '2024-05-30T16:52:11.750162+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.750162+0000', 'last_undegraded': '2024-05-30T16:52:11.750162+0000', 'last_fullsized': '2024-05-30T16:52:11.750162+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.689 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-05-30T16:52:17.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.752244+0000', 'last_change': '2024-05-30T16:52:11.752244+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.752244+0000', 'last_undegraded': '2024-05-30T16:52:11.752244+0000', 'last_fullsized': '2024-05-30T16:52:11.752244+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:52:17.689 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-05-30T16:52:17.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.753597+0000', 'last_change': '2024-05-30T16:52:11.753597+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.753597+0000', 'last_undegraded': '2024-05-30T16:52:11.753597+0000', 'last_fullsized': '2024-05-30T16:52:11.753597+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:52:17.689 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-05-30T16:52:17.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.746658+0000', 'last_change': '2024-05-30T16:52:11.746658+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.746658+0000', 'last_undegraded': '2024-05-30T16:52:11.746658+0000', 'last_fullsized': '2024-05-30T16:52:11.746658+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:52:17.689 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-05-30T16:52:17.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.748364+0000', 'last_change': '2024-05-30T16:52:11.748364+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.748364+0000', 'last_undegraded': '2024-05-30T16:52:11.748364+0000', 'last_fullsized': '2024-05-30T16:52:11.748364+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:52:17.689 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-05-30T16:52:17.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.752659+0000', 'last_change': '2024-05-30T16:52:11.752659+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.752659+0000', 'last_undegraded': '2024-05-30T16:52:11.752659+0000', 'last_fullsized': '2024-05-30T16:52:11.752659+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:52:17.690 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-05-30T16:52:17.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.759822+0000', 'last_change': '2024-05-30T16:52:11.759822+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.759822+0000', 'last_undegraded': '2024-05-30T16:52:11.759822+0000', 'last_fullsized': '2024-05-30T16:52:11.759822+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.690 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-05-30T16:52:17.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.744985+0000', 'last_change': '2024-05-30T16:52:11.744985+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.744985+0000', 'last_undegraded': '2024-05-30T16:52:11.744985+0000', 'last_fullsized': '2024-05-30T16:52:11.744985+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:52:17.690 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-05-30T16:52:17.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.747354+0000', 'last_change': '2024-05-30T16:52:11.747354+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.747354+0000', 'last_undegraded': '2024-05-30T16:52:11.747354+0000', 'last_fullsized': '2024-05-30T16:52:11.747354+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:52:17.690 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-05-30T16:52:17.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.759726+0000', 'last_change': '2024-05-30T16:52:11.759726+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.759726+0000', 'last_undegraded': '2024-05-30T16:52:11.759726+0000', 'last_fullsized': '2024-05-30T16:52:11.759726+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.690 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-05-30T16:52:17.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.752775+0000', 'last_change': '2024-05-30T16:52:11.752775+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.752775+0000', 'last_undegraded': '2024-05-30T16:52:11.752775+0000', 'last_fullsized': '2024-05-30T16:52:11.752775+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:52:17.691 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-05-30T16:52:17.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.754740+0000', 'last_change': '2024-05-30T16:52:11.754740+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.754740+0000', 'last_undegraded': '2024-05-30T16:52:11.754740+0000', 'last_fullsized': '2024-05-30T16:52:11.754740+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:52:17.691 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-05-30T16:52:17.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.749065+0000', 'last_change': '2024-05-30T16:52:11.749065+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.749065+0000', 'last_undegraded': '2024-05-30T16:52:11.749065+0000', 'last_fullsized': '2024-05-30T16:52:11.749065+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T16:52:17.691 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-05-30T16:52:17.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.746595+0000', 'last_change': '2024-05-30T16:52:11.746595+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.746595+0000', 'last_undegraded': '2024-05-30T16:52:11.746595+0000', 'last_fullsized': '2024-05-30T16:52:11.746595+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:52:17.691 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-05-30T16:52:17.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.750923+0000', 'last_change': '2024-05-30T16:52:11.750923+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.750923+0000', 'last_undegraded': '2024-05-30T16:52:11.750923+0000', 'last_fullsized': '2024-05-30T16:52:11.750923+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.691 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-05-30T16:52:17.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.753019+0000', 'last_change': '2024-05-30T16:52:11.753019+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.753019+0000', 'last_undegraded': '2024-05-30T16:52:11.753019+0000', 'last_fullsized': '2024-05-30T16:52:11.753019+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:52:17.692 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-05-30T16:52:17.692 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.757205+0000', 'last_change': '2024-05-30T16:52:11.757205+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.757205+0000', 'last_undegraded': '2024-05-30T16:52:11.757205+0000', 'last_fullsized': '2024-05-30T16:52:11.757205+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.692 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-05-30T16:52:17.692 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.746228+0000', 'last_change': '2024-05-30T16:52:11.746228+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.746228+0000', 'last_undegraded': '2024-05-30T16:52:11.746228+0000', 'last_fullsized': '2024-05-30T16:52:11.746228+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:52:17.692 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-05-30T16:52:17.692 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.745044+0000', 'last_change': '2024-05-30T16:52:11.745044+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.745044+0000', 'last_undegraded': '2024-05-30T16:52:11.745044+0000', 'last_fullsized': '2024-05-30T16:52:11.745044+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:52:17.692 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-05-30T16:52:17.692 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.749547+0000', 'last_change': '2024-05-30T16:52:11.749547+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.749547+0000', 'last_undegraded': '2024-05-30T16:52:11.749547+0000', 'last_fullsized': '2024-05-30T16:52:11.749547+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:52:17.692 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-05-30T16:52:17.692 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:52:11.758116+0000', 'last_change': '2024-05-30T16:52:11.758116+0000', 'last_active': '2024-05-30T16:52:11.734755+0000', 'last_peered': '2024-05-30T16:52:11.734755+0000', 'last_clean': '2024-05-30T16:52:11.734755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:52:11.758116+0000', 'last_undegraded': '2024-05-30T16:52:11.758116+0000', 'last_fullsized': '2024-05-30T16:52:11.758116+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'last_clean_scrub_stamp': '2024-05-30T16:52:11.734755+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T16:52:17.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T16:52:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa589000640 1 Processor -- start 2024-05-30T16:52:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa589000640 1 -- start start 2024-05-30T16:52:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa589000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa584146000 0x7fa5841600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa589000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa584160610 0x7fa5840b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa589000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5840b3c20 con 0x7fa5840b4c20 2024-05-30T16:52:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa589000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa58415ce50 con 0x7fa584146000 2024-05-30T16:52:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa589000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa584160c40 con 0x7fa584160610 2024-05-30T16:52:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa581e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa584146000 0x7fa5841600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa581e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa584146000 0x7fa5841600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46686/0 (socket says 172.21.15.59:46686) 2024-05-30T16:52:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa581e00640 1 -- 172.21.15.59:0/1463123244 learned_addr learned my addr 172.21.15.59:0/1463123244 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa57be00640 1 --2- 172.21.15.59:0/1463123244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa584160610 0x7fa5840b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa581e00640 1 -- 172.21.15.59:0/1463123244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa584160610 msgr2=0x7fa5840b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:17.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa581e00640 1 --2- 172.21.15.59:0/1463123244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa584160610 0x7fa5840b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa581e00640 1 -- 172.21.15.59:0/1463123244 >> v1:172.21.15.107:6789/0 conn(0x7fa5840b4c20 legacy=0x7fa5840cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.861+0000 7fa581e00640 1 -- 172.21.15.59:0/1463123244 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa584160f20 con 0x7fa584146000 2024-05-30T16:52:17.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa581e00640 1 --2- 172.21.15.59:0/1463123244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa584146000 0x7fa5841600d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa574009870 tx=0x7fa57401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710431395068634b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:17.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa581400640 1 -- 172.21.15.59:0/1463123244 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5740b2070 con 0x7fa584146000 2024-05-30T16:52:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa581400640 1 -- 172.21.15.59:0/1463123244 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5740a9070 con 0x7fa584146000 2024-05-30T16:52:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa581400640 1 -- 172.21.15.59:0/1463123244 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5740ad880 con 0x7fa584146000 2024-05-30T16:52:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa589000640 1 -- 172.21.15.59:0/1463123244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa584146000 msgr2=0x7fa5841600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa589000640 1 --2- 172.21.15.59:0/1463123244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa584146000 0x7fa5841600d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa574009870 tx=0x7fa57401c560 comp rx=0 tx=0).stop 2024-05-30T16:52:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa589000640 1 -- 172.21.15.59:0/1463123244 shutdown_connections 2024-05-30T16:52:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa589000640 1 --2- 172.21.15.59:0/1463123244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa584160610 0x7fa5840b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa589000640 1 --2- 172.21.15.59:0/1463123244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa584146000 0x7fa5841600d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa589000640 1 -- 172.21.15.59:0/1463123244 >> 172.21.15.59:0/1463123244 conn(0x7fa584067d60 msgr2=0x7fa58406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa589000640 1 -- 172.21.15.59:0/1463123244 shutdown_connections 2024-05-30T16:52:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa589000640 1 -- 172.21.15.59:0/1463123244 wait complete. 2024-05-30T16:52:17.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa589000640 1 Processor -- start 2024-05-30T16:52:17.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.865+0000 7fa589000640 1 -- start start 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa589000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5840b4c20 0x7fa5840ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa589000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa584146000 0x7fa58412eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa589000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa584160610 0x7fa5840aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa589000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa584169800 con 0x7fa5840b4c20 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa589000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa584169680 con 0x7fa584146000 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa589000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa584169980 con 0x7fa584160610 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa581e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5840b4c20 0x7fa5840ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa581e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5840b4c20 0x7fa5840ac180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46694/0 (socket says 172.21.15.59:46694) 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa581e00640 1 -- 172.21.15.59:0/1465553604 learned_addr learned my addr 172.21.15.59:0/1465553604 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa57be00640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa584146000 0x7fa58412eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa582800640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa584160610 0x7fa5840aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa581e00640 1 -- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa584160610 msgr2=0x7fa5840aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa581e00640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa584160610 0x7fa5840aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa581e00640 1 -- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa584146000 msgr2=0x7fa58412eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa581e00640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa584146000 0x7fa58412eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa581e00640 1 -- 172.21.15.59:0/1465553604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58406f520 con 0x7fa5840b4c20 2024-05-30T16:52:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa582800640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa584160610 0x7fa5840aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa581e00640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5840b4c20 0x7fa5840ac180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa5740b0040 tx=0x7fa574019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa57a000640 1 -- 172.21.15.59:0/1465553604 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5740b2040 con 0x7fa5840b4c20 2024-05-30T16:52:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa57a000640 1 -- 172.21.15.59:0/1465553604 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5740adae0 con 0x7fa5840b4c20 2024-05-30T16:52:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa57a000640 1 -- 172.21.15.59:0/1465553604 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5740b6440 con 0x7fa5840b4c20 2024-05-30T16:52:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa589000640 1 -- 172.21.15.59:0/1465553604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5840ae030 con 0x7fa5840b4c20 2024-05-30T16:52:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa589000640 1 -- 172.21.15.59:0/1465553604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5840ae5f0 con 0x7fa5840b4c20 2024-05-30T16:52:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa589000640 1 -- 172.21.15.59:0/1465553604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa584068a90 con 0x7fa5840b4c20 2024-05-30T16:52:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.869+0000 7fa57a000640 1 -- 172.21.15.59:0/1465553604 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fa5740bd020 con 0x7fa5840b4c20 2024-05-30T16:52:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.873+0000 7fa57a000640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa560068650 0x7fa56006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.873+0000 7fa57a000640 1 -- 172.21.15.59:0/1465553604 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7fa574120320 con 0x7fa5840b4c20 2024-05-30T16:52:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.873+0000 7fa57be00640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa560068650 0x7fa56006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.873+0000 7fa57be00640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa560068650 0x7fa56006ab10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa5840cf470 tx=0x7fa56c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:17.877+0000 7fa57a000640 1 -- 172.21.15.59:0/1465553604 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa5740c4020 con 0x7fa5840b4c20 2024-05-30T16:52:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 -- 172.21.15.59:0/1465553604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa5840b3490 con 0x7fa5840b4c20 2024-05-30T16:52:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa57a000640 1 -- 172.21.15.59:0/1465553604 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1098 (secure 0 0 0) 0x7fa574016150 con 0x7fa5840b4c20 2024-05-30T16:52:18.102 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:18.102 INFO:teuthology.orchestra.run.smithi059.stdout:{"fsid":"97857630-028c-48a2-897f-bf5f996be133","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":218,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":47,"num_osds":8,"num_up_osds":8,"osd_up_since":1717087732,"num_in_osds":8,"osd_in_since":1717087722,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":55},{"state_name":"active+clean","count":42}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":590984,"bytes_used":282091520,"bytes_avail":772812021760,"bytes_total":773094113280,"inactive_pgs_ratio":0.56701028347015381,"write_bytes_sec":1365,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5304}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-05-30T16:50:55.098975+0000","services":{}},"progress_events":{}} 2024-05-30T16:52:18.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 -- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa560068650 msgr2=0x7fa56006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:18.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa560068650 0x7fa56006ab10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa5840cf470 tx=0x7fa56c008040 comp rx=0 tx=0).stop 2024-05-30T16:52:18.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 -- 172.21.15.59:0/1465553604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5840b4c20 msgr2=0x7fa5840ac180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:18.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5840b4c20 0x7fa5840ac180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa5740b0040 tx=0x7fa574019300 comp rx=0 tx=0).stop 2024-05-30T16:52:18.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 -- 172.21.15.59:0/1465553604 shutdown_connections 2024-05-30T16:52:18.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa560068650 0x7fa56006ab10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa584160610 0x7fa5840aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa584146000 0x7fa58412eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 --2- 172.21.15.59:0/1465553604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5840b4c20 0x7fa5840ac180 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 -- 172.21.15.59:0/1465553604 >> 172.21.15.59:0/1465553604 conn(0x7fa584067d60 msgr2=0x7fa5840cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:18.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 -- 172.21.15.59:0/1465553604 shutdown_connections 2024-05-30T16:52:18.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.101+0000 7fa589000640 1 -- 172.21.15.59:0/1465553604 wait complete. 2024-05-30T16:52:18.122 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-30T16:52:18.123 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:52:18.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.265+0000 7f0e59000640 1 Processor -- start 2024-05-30T16:52:18.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.265+0000 7f0e59000640 1 -- start start 2024-05-30T16:52:18.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.265+0000 7f0e59000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e54159df0 0x7f0e540ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:18.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.265+0000 7f0e59000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e5415a1d0 0x7f0e540ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:18.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.265+0000 7f0e59000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e5415d730 con 0x7f0e540b3e50 2024-05-30T16:52:18.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.265+0000 7f0e59000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0e540b3370 con 0x7f0e5415a1d0 2024-05-30T16:52:18.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.265+0000 7f0e59000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0e540b3650 con 0x7f0e54159df0 2024-05-30T16:52:18.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.265+0000 7f0e52800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0e540b3e50 0x7f0e5415ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53884/0 (socket says 172.21.15.59:53884) 2024-05-30T16:52:18.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.265+0000 7f0e4be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e5415a1d0 0x7f0e540ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:18.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.265+0000 7f0e52800640 1 -- 172.21.15.59:0/1751649333 learned_addr learned my addr 172.21.15.59:0/1751649333 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:18.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.265+0000 7f0e51e00640 1 --2- 172.21.15.59:0/1751649333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e54159df0 0x7f0e540ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:18.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e4be00640 1 -- 172.21.15.59:0/1751649333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e54159df0 msgr2=0x7f0e540ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:18.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e4be00640 1 --2- 172.21.15.59:0/1751649333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e54159df0 0x7f0e540ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e4be00640 1 -- 172.21.15.59:0/1751649333 >> v1:172.21.15.59:6789/0 conn(0x7f0e540b3e50 legacy=0x7f0e5415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:18.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e4be00640 1 -- 172.21.15.59:0/1751649333 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e540b3930 con 0x7f0e5415a1d0 2024-05-30T16:52:18.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e4be00640 1 --2- 172.21.15.59:0/1751649333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5415a1d0 0x7f0e540ad6f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0097c0 tx=0x7f0e3c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6af5ad12a5490e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:18.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e51400640 1 -- 172.21.15.59:0/1751649333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0b0070 con 0x7f0e5415a1d0 2024-05-30T16:52:18.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e51400640 1 -- 172.21.15.59:0/1751649333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3c0ab600 con 0x7f0e5415a1d0 2024-05-30T16:52:18.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e51400640 1 -- 172.21.15.59:0/1751649333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0ab9d0 con 0x7f0e5415a1d0 2024-05-30T16:52:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e59000640 1 -- 172.21.15.59:0/1751649333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5415a1d0 msgr2=0x7f0e540ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e59000640 1 --2- 172.21.15.59:0/1751649333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5415a1d0 0x7f0e540ad6f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0097c0 tx=0x7f0e3c01c4a0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e59000640 1 -- 172.21.15.59:0/1751649333 shutdown_connections 2024-05-30T16:52:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e59000640 1 --2- 172.21.15.59:0/1751649333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5415a1d0 0x7f0e540ad6f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e59000640 1 --2- 172.21.15.59:0/1751649333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e54159df0 0x7f0e540ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.269+0000 7f0e59000640 1 -- 172.21.15.59:0/1751649333 >> 172.21.15.59:0/1751649333 conn(0x7f0e540b22d0 msgr2=0x7f0e540b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e59000640 1 -- 172.21.15.59:0/1751649333 shutdown_connections 2024-05-30T16:52:18.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e59000640 1 -- 172.21.15.59:0/1751649333 wait complete. 2024-05-30T16:52:18.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e59000640 1 Processor -- start 2024-05-30T16:52:18.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e59000640 1 -- start start 2024-05-30T16:52:18.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e59000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e540b3e50 0x7f0e5413a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e59000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e54159df0 0x7f0e541583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e59000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e5415a1d0 0x7f0e54158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e59000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5415e760 con 0x7f0e540b3e50 2024-05-30T16:52:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e59000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5415e5e0 con 0x7f0e54159df0 2024-05-30T16:52:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e59000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5415e8e0 con 0x7f0e5415a1d0 2024-05-30T16:52:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e51e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e540b3e50 0x7f0e5413a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e51e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e540b3e50 0x7f0e5413a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46718/0 (socket says 172.21.15.59:46718) 2024-05-30T16:52:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e51e00640 1 -- 172.21.15.59:0/2791943963 learned_addr learned my addr 172.21.15.59:0/2791943963 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e4be00640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e54159df0 0x7f0e541583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e52800640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e5415a1d0 0x7f0e54158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e51e00640 1 -- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e5415a1d0 msgr2=0x7f0e54158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:18.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e51e00640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e5415a1d0 0x7f0e54158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e51e00640 1 -- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e54159df0 msgr2=0x7f0e541583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e51e00640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e54159df0 0x7f0e541583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e51e00640 1 -- 172.21.15.59:0/2791943963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e54153d50 con 0x7f0e540b3e50 2024-05-30T16:52:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e4be00640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e54159df0 0x7f0e541583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e51e00640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e540b3e50 0x7f0e5413a380 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400d800 tx=0x7f0e4400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e4a000640 1 -- 172.21.15.59:0/2791943963 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400b6c0 con 0x7f0e540b3e50 2024-05-30T16:52:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e4a000640 1 -- 172.21.15.59:0/2791943963 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e44019070 con 0x7f0e540b3e50 2024-05-30T16:52:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e4a000640 1 -- 172.21.15.59:0/2791943963 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400ba60 con 0x7f0e540b3e50 2024-05-30T16:52:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e59000640 1 -- 172.21.15.59:0/2791943963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e54154030 con 0x7f0e540b3e50 2024-05-30T16:52:18.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.273+0000 7f0e59000640 1 -- 172.21.15.59:0/2791943963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e541545f0 con 0x7f0e540b3e50 2024-05-30T16:52:18.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.277+0000 7f0e59000640 1 -- 172.21.15.59:0/2791943963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e54068a90 con 0x7f0e540b3e50 2024-05-30T16:52:18.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.277+0000 7f0e4a000640 1 -- 172.21.15.59:0/2791943963 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f0e4400bc00 con 0x7f0e540b3e50 2024-05-30T16:52:18.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.277+0000 7f0e4a000640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0e30068650 0x7f0e3006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:18.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.277+0000 7f0e4a000640 1 -- 172.21.15.59:0/2791943963 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7f0e440872d0 con 0x7f0e540b3e50 2024-05-30T16:52:18.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.281+0000 7f0e4be00640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0e30068650 0x7f0e3006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:18.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.281+0000 7f0e4be00640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0e30068650 0x7f0e3006ab10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0ad000 tx=0x7f0e3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.281+0000 7f0e4a000640 1 -- 172.21.15.59:0/2791943963 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e44057570 con 0x7f0e540b3e50 2024-05-30T16:52:18.362 INFO:tasks.ceph.mds.c.smithi059.stderr:2024-05-30T16:52:18.361+0000 7f1293a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:52:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.449+0000 7f0e59000640 1 -- 172.21.15.59:0/2791943963 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e541671d0 con 0x7f0e30068650 2024-05-30T16:52:18.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.457+0000 7f0e4a000640 1 -- 172.21.15.59:0/2791943963 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247405 (secure 0 0 0) 0x7f0e541671d0 con 0x7f0e30068650 2024-05-30T16:52:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:18.461 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:52:18.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.461+0000 7f0e59000640 1 -- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0e30068650 msgr2=0x7f0e3006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:18.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.461+0000 7f0e59000640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0e30068650 0x7f0e3006ab10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0ad000 tx=0x7f0e3c008040 comp rx=0 tx=0).stop 2024-05-30T16:52:18.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.461+0000 7f0e59000640 1 -- 172.21.15.59:0/2791943963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e540b3e50 msgr2=0x7f0e5413a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:18.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.461+0000 7f0e59000640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e540b3e50 0x7f0e5413a380 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400d800 tx=0x7f0e4400dcc0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.461+0000 7f0e59000640 1 -- 172.21.15.59:0/2791943963 shutdown_connections 2024-05-30T16:52:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.461+0000 7f0e59000640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0e30068650 0x7f0e3006ab10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.461+0000 7f0e59000640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e5415a1d0 0x7f0e54158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.461+0000 7f0e59000640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e54159df0 0x7f0e541583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.461+0000 7f0e59000640 1 --2- 172.21.15.59:0/2791943963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e540b3e50 0x7f0e5413a380 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.461+0000 7f0e59000640 1 -- 172.21.15.59:0/2791943963 >> 172.21.15.59:0/2791943963 conn(0x7f0e540b22d0 msgr2=0x7f0e541604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.461+0000 7f0e59000640 1 -- 172.21.15.59:0/2791943963 shutdown_connections 2024-05-30T16:52:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:18.461+0000 7f0e59000640 1 -- 172.21.15.59:0/2791943963 wait complete. 2024-05-30T16:52:18.480 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-05-30T16:52:17.117379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275480,"kb_used_data":5212,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754699240,"statfs":{"total":773094113280,"available":772812021760,"internally_reserved":0,"allocated":5337088,"data_stored":2819269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001323"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747138+0000","last_change":"2024-05-30T16:52:11.747138+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747138+0000","last_undegraded":"2024-05-30T16:52:11.747138+0000","last_fullsized":"2024-05-30T16:52:11.747138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745784+0000","last_change":"2024-05-30T16:52:11.745784+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745784+0000","last_undegraded":"2024-05-30T16:52:11.745784+0000","last_fullsized":"2024-05-30T16:52:11.745784+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.756091+0000","last_change":"2024-05-30T16:52:11.756091+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.756091+0000","last_undegraded":"2024-05-30T16:52:11.756091+0000","last_fullsized":"2024-05-30T16:52:11.756091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.757759+0000","last_change":"2024-05-30T16:52:11.757759+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.757759+0000","last_undegraded":"2024-05-30T16:52:11.757759+0000","last_fullsized":"2024-05-30T16:52:11.757759+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746121+0000","last_change":"2024-05-30T16:52:11.746121+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746121+0000","last_undegraded":"2024-05-30T16:52:11.746121+0000","last_fullsized":"2024-05-30T16:52:11.746121+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297925+0000","last_change":"2024-05-30T16:52:12.771108+0000","last_active":"2024-05-30T16:52:14.297925+0000","last_peered":"2024-05-30T16:52:14.297925+0000","last_clean":"2024-05-30T16:52:14.297925+0000","last_became_active":"2024-05-30T16:52:12.770805+0000","last_became_peered":"2024-05-30T16:52:12.770805+0000","last_unstale":"2024-05-30T16:52:14.297925+0000","last_undegraded":"2024-05-30T16:52:14.297925+0000","last_fullsized":"2024-05-30T16:52:14.297925+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:29:26.725308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745496+0000","last_change":"2024-05-30T16:52:11.745496+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745496+0000","last_undegraded":"2024-05-30T16:52:11.745496+0000","last_fullsized":"2024-05-30T16:52:11.745496+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.761114+0000","last_change":"2024-05-30T16:52:11.761114+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.761114+0000","last_undegraded":"2024-05-30T16:52:11.761114+0000","last_fullsized":"2024-05-30T16:52:11.761114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.760182+0000","last_change":"2024-05-30T16:52:11.760182+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.760182+0000","last_undegraded":"2024-05-30T16:52:11.760182+0000","last_fullsized":"2024-05-30T16:52:11.760182+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.758558+0000","last_change":"2024-05-30T16:52:11.758558+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.758558+0000","last_undegraded":"2024-05-30T16:52:11.758558+0000","last_fullsized":"2024-05-30T16:52:11.758558+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.766067+0000","last_change":"2024-05-30T16:52:11.766067+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.766067+0000","last_undegraded":"2024-05-30T16:52:11.766067+0000","last_fullsized":"2024-05-30T16:52:11.766067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748560+0000","last_change":"2024-05-30T16:52:11.748560+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748560+0000","last_undegraded":"2024-05-30T16:52:11.748560+0000","last_fullsized":"2024-05-30T16:52:11.748560+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.755351+0000","last_change":"2024-05-30T16:52:11.755351+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.755351+0000","last_undegraded":"2024-05-30T16:52:11.755351+0000","last_fullsized":"2024-05-30T16:52:11.755351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.767001+0000","last_change":"2024-05-30T16:52:11.767001+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.767001+0000","last_undegraded":"2024-05-30T16:52:11.767001+0000","last_fullsized":"2024-05-30T16:52:11.767001+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297516+0000","last_change":"2024-05-30T16:52:12.772027+0000","last_active":"2024-05-30T16:52:14.297516+0000","last_peered":"2024-05-30T16:52:14.297516+0000","last_clean":"2024-05-30T16:52:14.297516+0000","last_became_active":"2024-05-30T16:52:12.771761+0000","last_became_peered":"2024-05-30T16:52:12.771761+0000","last_unstale":"2024-05-30T16:52:14.297516+0000","last_undegraded":"2024-05-30T16:52:14.297516+0000","last_fullsized":"2024-05-30T16:52:14.297516+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:59:54.866618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752070+0000","last_change":"2024-05-30T16:52:11.752070+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752070+0000","last_undegraded":"2024-05-30T16:52:11.752070+0000","last_fullsized":"2024-05-30T16:52:11.752070+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753351+0000","last_change":"2024-05-30T16:52:11.753351+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753351+0000","last_undegraded":"2024-05-30T16:52:11.753351+0000","last_fullsized":"2024-05-30T16:52:11.753351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.754200+0000","last_change":"2024-05-30T16:52:11.754200+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.754200+0000","last_undegraded":"2024-05-30T16:52:11.754200+0000","last_fullsized":"2024-05-30T16:52:11.754200+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753706+0000","last_change":"2024-05-30T16:52:11.753706+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753706+0000","last_undegraded":"2024-05-30T16:52:11.753706+0000","last_fullsized":"2024-05-30T16:52:11.753706+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748657+0000","last_change":"2024-05-30T16:52:11.748657+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748657+0000","last_undegraded":"2024-05-30T16:52:11.748657+0000","last_fullsized":"2024-05-30T16:52:11.748657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297955+0000","last_change":"2024-05-30T16:52:12.775532+0000","last_active":"2024-05-30T16:52:14.297955+0000","last_peered":"2024-05-30T16:52:14.297955+0000","last_clean":"2024-05-30T16:52:14.297955+0000","last_became_active":"2024-05-30T16:52:12.775054+0000","last_became_peered":"2024-05-30T16:52:12.775054+0000","last_unstale":"2024-05-30T16:52:14.297955+0000","last_undegraded":"2024-05-30T16:52:14.297955+0000","last_fullsized":"2024-05-30T16:52:14.297955+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:31:14.760035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.766551+0000","last_change":"2024-05-30T16:52:11.766551+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.766551+0000","last_undegraded":"2024-05-30T16:52:11.766551+0000","last_fullsized":"2024-05-30T16:52:11.766551+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.751797+0000","last_change":"2024-05-30T16:52:11.751797+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.751797+0000","last_undegraded":"2024-05-30T16:52:11.751797+0000","last_fullsized":"2024-05-30T16:52:11.751797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.751513+0000","last_change":"2024-05-30T16:52:11.751513+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.751513+0000","last_undegraded":"2024-05-30T16:52:11.751513+0000","last_fullsized":"2024-05-30T16:52:11.751513+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753951+0000","last_change":"2024-05-30T16:52:11.753951+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753951+0000","last_undegraded":"2024-05-30T16:52:11.753951+0000","last_fullsized":"2024-05-30T16:52:11.753951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748138+0000","last_change":"2024-05-30T16:52:11.748138+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748138+0000","last_undegraded":"2024-05-30T16:52:11.748138+0000","last_fullsized":"2024-05-30T16:52:11.748138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752041+0000","last_change":"2024-05-30T16:52:11.752041+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752041+0000","last_undegraded":"2024-05-30T16:52:11.752041+0000","last_fullsized":"2024-05-30T16:52:11.752041+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747847+0000","last_change":"2024-05-30T16:52:11.747847+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747847+0000","last_undegraded":"2024-05-30T16:52:11.747847+0000","last_fullsized":"2024-05-30T16:52:11.747847+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.751469+0000","last_change":"2024-05-30T16:52:11.751469+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.751469+0000","last_undegraded":"2024-05-30T16:52:11.751469+0000","last_fullsized":"2024-05-30T16:52:11.751469+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750983+0000","last_change":"2024-05-30T16:52:11.750983+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750983+0000","last_undegraded":"2024-05-30T16:52:11.750983+0000","last_fullsized":"2024-05-30T16:52:11.750983+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297628+0000","last_change":"2024-05-30T16:52:12.766158+0000","last_active":"2024-05-30T16:52:14.297628+0000","last_peered":"2024-05-30T16:52:14.297628+0000","last_clean":"2024-05-30T16:52:14.297628+0000","last_became_active":"2024-05-30T16:52:12.765499+0000","last_became_peered":"2024-05-30T16:52:12.765499+0000","last_unstale":"2024-05-30T16:52:14.297628+0000","last_undegraded":"2024-05-30T16:52:14.297628+0000","last_fullsized":"2024-05-30T16:52:14.297628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:45:32.830341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747251+0000","last_change":"2024-05-30T16:52:11.747251+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747251+0000","last_undegraded":"2024-05-30T16:52:11.747251+0000","last_fullsized":"2024-05-30T16:52:11.747251+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750137+0000","last_change":"2024-05-30T16:52:11.750137+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750137+0000","last_undegraded":"2024-05-30T16:52:11.750137+0000","last_fullsized":"2024-05-30T16:52:11.750137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298463+0000","last_change":"2024-05-30T16:52:11.768213+0000","last_active":"2024-05-30T16:52:14.298463+0000","last_peered":"2024-05-30T16:52:14.298463+0000","last_clean":"2024-05-30T16:52:14.298463+0000","last_became_active":"2024-05-30T16:52:11.767915+0000","last_became_peered":"2024-05-30T16:52:11.767915+0000","last_unstale":"2024-05-30T16:52:14.298463+0000","last_undegraded":"2024-05-30T16:52:14.298463+0000","last_fullsized":"2024-05-30T16:52:14.298463+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:32:49.346808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753479+0000","last_change":"2024-05-30T16:52:11.753479+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753479+0000","last_undegraded":"2024-05-30T16:52:11.753479+0000","last_fullsized":"2024-05-30T16:52:11.753479+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.768971+0000","last_change":"2024-05-30T16:52:11.767326+0000","last_active":"2024-05-30T16:52:11.768971+0000","last_peered":"2024-05-30T16:52:11.768971+0000","last_clean":"2024-05-30T16:52:11.768971+0000","last_became_active":"2024-05-30T16:52:11.766962+0000","last_became_peered":"2024-05-30T16:52:11.766962+0000","last_unstale":"2024-05-30T16:52:11.768971+0000","last_undegraded":"2024-05-30T16:52:11.768971+0000","last_fullsized":"2024-05-30T16:52:11.768971+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:35.144180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745368+0000","last_change":"2024-05-30T16:52:11.745368+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745368+0000","last_undegraded":"2024-05-30T16:52:11.745368+0000","last_fullsized":"2024-05-30T16:52:11.745368+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.769786+0000","last_change":"2024-05-30T16:52:11.762080+0000","last_active":"2024-05-30T16:52:11.769786+0000","last_peered":"2024-05-30T16:52:11.769786+0000","last_clean":"2024-05-30T16:52:11.769786+0000","last_became_active":"2024-05-30T16:52:11.761680+0000","last_became_peered":"2024-05-30T16:52:11.761680+0000","last_unstale":"2024-05-30T16:52:11.769786+0000","last_undegraded":"2024-05-30T16:52:11.769786+0000","last_fullsized":"2024-05-30T16:52:11.769786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:00.336519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.749399+0000","last_change":"2024-05-30T16:52:11.749399+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.749399+0000","last_undegraded":"2024-05-30T16:52:11.749399+0000","last_fullsized":"2024-05-30T16:52:11.749399+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.759758+0000","last_change":"2024-05-30T16:52:11.756991+0000","last_active":"2024-05-30T16:52:11.759758+0000","last_peered":"2024-05-30T16:52:11.759758+0000","last_clean":"2024-05-30T16:52:11.759758+0000","last_became_active":"2024-05-30T16:52:11.756716+0000","last_became_peered":"2024-05-30T16:52:11.756716+0000","last_unstale":"2024-05-30T16:52:11.759758+0000","last_undegraded":"2024-05-30T16:52:11.759758+0000","last_fullsized":"2024-05-30T16:52:11.759758+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:42:42.339988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750426+0000","last_change":"2024-05-30T16:52:11.750426+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750426+0000","last_undegraded":"2024-05-30T16:52:11.750426+0000","last_fullsized":"2024-05-30T16:52:11.750426+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298034+0000","last_change":"2024-05-30T16:52:11.765391+0000","last_active":"2024-05-30T16:52:14.298034+0000","last_peered":"2024-05-30T16:52:14.298034+0000","last_clean":"2024-05-30T16:52:14.298034+0000","last_became_active":"2024-05-30T16:52:11.765096+0000","last_became_peered":"2024-05-30T16:52:11.765096+0000","last_unstale":"2024-05-30T16:52:14.298034+0000","last_undegraded":"2024-05-30T16:52:14.298034+0000","last_fullsized":"2024-05-30T16:52:14.298034+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:19:40.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.760252+0000","last_change":"2024-05-30T16:52:11.760252+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.760252+0000","last_undegraded":"2024-05-30T16:52:11.760252+0000","last_fullsized":"2024-05-30T16:52:11.760252+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.763688+0000","last_change":"2024-05-30T16:52:11.757778+0000","last_active":"2024-05-30T16:52:11.763688+0000","last_peered":"2024-05-30T16:52:11.763688+0000","last_clean":"2024-05-30T16:52:11.763688+0000","last_became_active":"2024-05-30T16:52:11.757401+0000","last_became_peered":"2024-05-30T16:52:11.757401+0000","last_unstale":"2024-05-30T16:52:11.763688+0000","last_undegraded":"2024-05-30T16:52:11.763688+0000","last_fullsized":"2024-05-30T16:52:11.763688+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:30.838153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750162+0000","last_change":"2024-05-30T16:52:11.750162+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750162+0000","last_undegraded":"2024-05-30T16:52:11.750162+0000","last_fullsized":"2024-05-30T16:52:11.750162+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.760258+0000","last_change":"2024-05-30T16:52:11.754254+0000","last_active":"2024-05-30T16:52:11.760258+0000","last_peered":"2024-05-30T16:52:11.760258+0000","last_clean":"2024-05-30T16:52:11.760258+0000","last_became_active":"2024-05-30T16:52:11.753946+0000","last_became_peered":"2024-05-30T16:52:11.753946+0000","last_unstale":"2024-05-30T16:52:11.760258+0000","last_undegraded":"2024-05-30T16:52:11.760258+0000","last_fullsized":"2024-05-30T16:52:11.760258+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:15.949367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752244+0000","last_change":"2024-05-30T16:52:11.752244+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752244+0000","last_undegraded":"2024-05-30T16:52:11.752244+0000","last_fullsized":"2024-05-30T16:52:11.752244+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.776273+0000","last_change":"2024-05-30T16:52:11.771861+0000","last_active":"2024-05-30T16:52:11.776273+0000","last_peered":"2024-05-30T16:52:11.776273+0000","last_clean":"2024-05-30T16:52:11.776273+0000","last_became_active":"2024-05-30T16:52:11.771573+0000","last_became_peered":"2024-05-30T16:52:11.771573+0000","last_unstale":"2024-05-30T16:52:11.776273+0000","last_undegraded":"2024-05-30T16:52:11.776273+0000","last_fullsized":"2024-05-30T16:52:11.776273+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:34.799686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753597+0000","last_change":"2024-05-30T16:52:11.753597+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753597+0000","last_undegraded":"2024-05-30T16:52:11.753597+0000","last_fullsized":"2024-05-30T16:52:11.753597+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.768990+0000","last_change":"2024-05-30T16:52:11.768155+0000","last_active":"2024-05-30T16:52:11.768990+0000","last_peered":"2024-05-30T16:52:11.768990+0000","last_clean":"2024-05-30T16:52:11.768990+0000","last_became_active":"2024-05-30T16:52:11.767557+0000","last_became_peered":"2024-05-30T16:52:11.767557+0000","last_unstale":"2024-05-30T16:52:11.768990+0000","last_undegraded":"2024-05-30T16:52:11.768990+0000","last_fullsized":"2024-05-30T16:52:11.768990+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:47:42.557576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746658+0000","last_change":"2024-05-30T16:52:11.746658+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746658+0000","last_undegraded":"2024-05-30T16:52:11.746658+0000","last_fullsized":"2024-05-30T16:52:11.746658+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.776371+0000","last_change":"2024-05-30T16:52:11.773802+0000","last_active":"2024-05-30T16:52:11.776371+0000","last_peered":"2024-05-30T16:52:11.776371+0000","last_clean":"2024-05-30T16:52:11.776371+0000","last_became_active":"2024-05-30T16:52:11.771528+0000","last_became_peered":"2024-05-30T16:52:11.771528+0000","last_unstale":"2024-05-30T16:52:11.776371+0000","last_undegraded":"2024-05-30T16:52:11.776371+0000","last_fullsized":"2024-05-30T16:52:11.776371+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:01:16.197933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298144+0000","last_change":"2024-05-30T16:52:12.773756+0000","last_active":"2024-05-30T16:52:14.298144+0000","last_peered":"2024-05-30T16:52:14.298144+0000","last_clean":"2024-05-30T16:52:14.298144+0000","last_became_active":"2024-05-30T16:52:12.773592+0000","last_became_peered":"2024-05-30T16:52:12.773592+0000","last_unstale":"2024-05-30T16:52:14.298144+0000","last_undegraded":"2024-05-30T16:52:14.298144+0000","last_fullsized":"2024-05-30T16:52:14.298144+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:31:13.580941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.765260+0000","last_change":"2024-05-30T16:52:11.763496+0000","last_active":"2024-05-30T16:52:11.765260+0000","last_peered":"2024-05-30T16:52:11.765260+0000","last_clean":"2024-05-30T16:52:11.765260+0000","last_became_active":"2024-05-30T16:52:11.763141+0000","last_became_peered":"2024-05-30T16:52:11.763141+0000","last_unstale":"2024-05-30T16:52:11.765260+0000","last_undegraded":"2024-05-30T16:52:11.765260+0000","last_fullsized":"2024-05-30T16:52:11.765260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:19:41.036951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.748364+0000","last_change":"2024-05-30T16:52:11.748364+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.748364+0000","last_undegraded":"2024-05-30T16:52:11.748364+0000","last_fullsized":"2024-05-30T16:52:11.748364+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.770892+0000","last_change":"2024-05-30T16:52:11.763318+0000","last_active":"2024-05-30T16:52:11.770892+0000","last_peered":"2024-05-30T16:52:11.770892+0000","last_clean":"2024-05-30T16:52:11.770892+0000","last_became_active":"2024-05-30T16:52:11.763052+0000","last_became_peered":"2024-05-30T16:52:11.763052+0000","last_unstale":"2024-05-30T16:52:11.770892+0000","last_undegraded":"2024-05-30T16:52:11.770892+0000","last_fullsized":"2024-05-30T16:52:11.770892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:37:33.427945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752659+0000","last_change":"2024-05-30T16:52:11.752659+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752659+0000","last_undegraded":"2024-05-30T16:52:11.752659+0000","last_fullsized":"2024-05-30T16:52:11.752659+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298083+0000","last_change":"2024-05-30T16:52:11.775662+0000","last_active":"2024-05-30T16:52:14.298083+0000","last_peered":"2024-05-30T16:52:14.298083+0000","last_clean":"2024-05-30T16:52:14.298083+0000","last_became_active":"2024-05-30T16:52:11.775356+0000","last_became_peered":"2024-05-30T16:52:11.775356+0000","last_unstale":"2024-05-30T16:52:14.298083+0000","last_undegraded":"2024-05-30T16:52:14.298083+0000","last_fullsized":"2024-05-30T16:52:14.298083+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:32:56.547786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.759822+0000","last_change":"2024-05-30T16:52:11.759822+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.759822+0000","last_undegraded":"2024-05-30T16:52:11.759822+0000","last_fullsized":"2024-05-30T16:52:11.759822+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.766760+0000","last_change":"2024-05-30T16:52:11.765673+0000","last_active":"2024-05-30T16:52:11.766760+0000","last_peered":"2024-05-30T16:52:11.766760+0000","last_clean":"2024-05-30T16:52:11.766760+0000","last_became_active":"2024-05-30T16:52:11.765157+0000","last_became_peered":"2024-05-30T16:52:11.765157+0000","last_unstale":"2024-05-30T16:52:11.766760+0000","last_undegraded":"2024-05-30T16:52:11.766760+0000","last_fullsized":"2024-05-30T16:52:11.766760+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:20.133814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297416+0000","last_change":"2024-05-30T16:52:12.781216+0000","last_active":"2024-05-30T16:52:14.297416+0000","last_peered":"2024-05-30T16:52:14.297416+0000","last_clean":"2024-05-30T16:52:14.297416+0000","last_became_active":"2024-05-30T16:52:12.779763+0000","last_became_peered":"2024-05-30T16:52:12.779763+0000","last_unstale":"2024-05-30T16:52:14.297416+0000","last_undegraded":"2024-05-30T16:52:14.297416+0000","last_fullsized":"2024-05-30T16:52:14.297416+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:21:02.860921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297657+0000","last_change":"2024-05-30T16:52:11.771843+0000","last_active":"2024-05-30T16:52:14.297657+0000","last_peered":"2024-05-30T16:52:14.297657+0000","last_clean":"2024-05-30T16:52:14.297657+0000","last_became_active":"2024-05-30T16:52:11.771540+0000","last_became_peered":"2024-05-30T16:52:11.771540+0000","last_unstale":"2024-05-30T16:52:14.297657+0000","last_undegraded":"2024-05-30T16:52:14.297657+0000","last_fullsized":"2024-05-30T16:52:14.297657+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:47:01.601969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.744985+0000","last_change":"2024-05-30T16:52:11.744985+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.744985+0000","last_undegraded":"2024-05-30T16:52:11.744985+0000","last_fullsized":"2024-05-30T16:52:11.744985+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.761275+0000","last_change":"2024-05-30T16:52:11.754549+0000","last_active":"2024-05-30T16:52:11.761275+0000","last_peered":"2024-05-30T16:52:11.761275+0000","last_clean":"2024-05-30T16:52:11.761275+0000","last_became_active":"2024-05-30T16:52:11.754201+0000","last_became_peered":"2024-05-30T16:52:11.754201+0000","last_unstale":"2024-05-30T16:52:11.761275+0000","last_undegraded":"2024-05-30T16:52:11.761275+0000","last_fullsized":"2024-05-30T16:52:11.761275+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:07:32.823371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.747354+0000","last_change":"2024-05-30T16:52:11.747354+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.747354+0000","last_undegraded":"2024-05-30T16:52:11.747354+0000","last_fullsized":"2024-05-30T16:52:11.747354+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.766290+0000","last_change":"2024-05-30T16:52:11.759174+0000","last_active":"2024-05-30T16:52:11.766290+0000","last_peered":"2024-05-30T16:52:11.766290+0000","last_clean":"2024-05-30T16:52:11.766290+0000","last_became_active":"2024-05-30T16:52:11.758846+0000","last_became_peered":"2024-05-30T16:52:11.758846+0000","last_unstale":"2024-05-30T16:52:11.766290+0000","last_undegraded":"2024-05-30T16:52:11.766290+0000","last_fullsized":"2024-05-30T16:52:11.766290+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:55:12.259158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.759726+0000","last_change":"2024-05-30T16:52:11.759726+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.759726+0000","last_undegraded":"2024-05-30T16:52:11.759726+0000","last_fullsized":"2024-05-30T16:52:11.759726+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.764953+0000","last_change":"2024-05-30T16:52:11.762654+0000","last_active":"2024-05-30T16:52:11.764953+0000","last_peered":"2024-05-30T16:52:11.764953+0000","last_clean":"2024-05-30T16:52:11.764953+0000","last_became_active":"2024-05-30T16:52:11.762385+0000","last_became_peered":"2024-05-30T16:52:11.762385+0000","last_unstale":"2024-05-30T16:52:11.764953+0000","last_undegraded":"2024-05-30T16:52:11.764953+0000","last_fullsized":"2024-05-30T16:52:11.764953+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:28:04.301693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.752775+0000","last_change":"2024-05-30T16:52:11.752775+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.752775+0000","last_undegraded":"2024-05-30T16:52:11.752775+0000","last_fullsized":"2024-05-30T16:52:11.752775+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.760366+0000","last_change":"2024-05-30T16:52:11.754550+0000","last_active":"2024-05-30T16:52:11.760366+0000","last_peered":"2024-05-30T16:52:11.760366+0000","last_clean":"2024-05-30T16:52:11.760366+0000","last_became_active":"2024-05-30T16:52:11.754274+0000","last_became_peered":"2024-05-30T16:52:11.754274+0000","last_unstale":"2024-05-30T16:52:11.760366+0000","last_undegraded":"2024-05-30T16:52:11.760366+0000","last_fullsized":"2024-05-30T16:52:11.760366+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:48.116676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.754740+0000","last_change":"2024-05-30T16:52:11.754740+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.754740+0000","last_undegraded":"2024-05-30T16:52:11.754740+0000","last_fullsized":"2024-05-30T16:52:11.754740+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298194+0000","last_change":"2024-05-30T16:52:11.767257+0000","last_active":"2024-05-30T16:52:14.298194+0000","last_peered":"2024-05-30T16:52:14.298194+0000","last_clean":"2024-05-30T16:52:14.298194+0000","last_became_active":"2024-05-30T16:52:11.766776+0000","last_became_peered":"2024-05-30T16:52:11.766776+0000","last_unstale":"2024-05-30T16:52:14.298194+0000","last_undegraded":"2024-05-30T16:52:14.298194+0000","last_fullsized":"2024-05-30T16:52:14.298194+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:49.907573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297942+0000","last_change":"2024-05-30T16:52:12.783213+0000","last_active":"2024-05-30T16:52:14.297942+0000","last_peered":"2024-05-30T16:52:14.297942+0000","last_clean":"2024-05-30T16:52:14.297942+0000","last_became_active":"2024-05-30T16:52:12.782012+0000","last_became_peered":"2024-05-30T16:52:12.782012+0000","last_unstale":"2024-05-30T16:52:14.297942+0000","last_undegraded":"2024-05-30T16:52:14.297942+0000","last_fullsized":"2024-05-30T16:52:14.297942+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:28.261365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298198+0000","last_change":"2024-05-30T16:52:11.762594+0000","last_active":"2024-05-30T16:52:14.298198+0000","last_peered":"2024-05-30T16:52:14.298198+0000","last_clean":"2024-05-30T16:52:14.298198+0000","last_became_active":"2024-05-30T16:52:11.760414+0000","last_became_peered":"2024-05-30T16:52:11.760414+0000","last_unstale":"2024-05-30T16:52:14.298198+0000","last_undegraded":"2024-05-30T16:52:14.298198+0000","last_fullsized":"2024-05-30T16:52:14.298198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:31.025155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.749065+0000","last_change":"2024-05-30T16:52:11.749065+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.749065+0000","last_undegraded":"2024-05-30T16:52:11.749065+0000","last_fullsized":"2024-05-30T16:52:11.749065+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.766062+0000","last_change":"2024-05-30T16:52:11.761712+0000","last_active":"2024-05-30T16:52:11.766062+0000","last_peered":"2024-05-30T16:52:11.766062+0000","last_clean":"2024-05-30T16:52:11.766062+0000","last_became_active":"2024-05-30T16:52:11.761375+0000","last_became_peered":"2024-05-30T16:52:11.761375+0000","last_unstale":"2024-05-30T16:52:11.766062+0000","last_undegraded":"2024-05-30T16:52:11.766062+0000","last_fullsized":"2024-05-30T16:52:11.766062+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:42:42.339988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746595+0000","last_change":"2024-05-30T16:52:11.746595+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746595+0000","last_undegraded":"2024-05-30T16:52:11.746595+0000","last_fullsized":"2024-05-30T16:52:11.746595+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.770418+0000","last_change":"2024-05-30T16:52:11.765519+0000","last_active":"2024-05-30T16:52:11.770418+0000","last_peered":"2024-05-30T16:52:11.770418+0000","last_clean":"2024-05-30T16:52:11.770418+0000","last_became_active":"2024-05-30T16:52:11.765207+0000","last_became_peered":"2024-05-30T16:52:11.765207+0000","last_unstale":"2024-05-30T16:52:11.770418+0000","last_undegraded":"2024-05-30T16:52:11.770418+0000","last_fullsized":"2024-05-30T16:52:11.770418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:58.645778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.750923+0000","last_change":"2024-05-30T16:52:11.750923+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.750923+0000","last_undegraded":"2024-05-30T16:52:11.750923+0000","last_fullsized":"2024-05-30T16:52:11.750923+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.759671+0000","last_change":"2024-05-30T16:52:11.755523+0000","last_active":"2024-05-30T16:52:11.759671+0000","last_peered":"2024-05-30T16:52:11.759671+0000","last_clean":"2024-05-30T16:52:11.759671+0000","last_became_active":"2024-05-30T16:52:11.755205+0000","last_became_peered":"2024-05-30T16:52:11.755205+0000","last_unstale":"2024-05-30T16:52:11.759671+0000","last_undegraded":"2024-05-30T16:52:11.759671+0000","last_fullsized":"2024-05-30T16:52:11.759671+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:39:58.679050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.753019+0000","last_change":"2024-05-30T16:52:11.753019+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.753019+0000","last_undegraded":"2024-05-30T16:52:11.753019+0000","last_fullsized":"2024-05-30T16:52:11.753019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"47'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298371+0000","last_change":"2024-05-30T16:52:11.768139+0000","last_active":"2024-05-30T16:52:14.298371+0000","last_peered":"2024-05-30T16:52:14.298371+0000","last_clean":"2024-05-30T16:52:14.298371+0000","last_became_active":"2024-05-30T16:52:11.766096+0000","last_became_peered":"2024-05-30T16:52:11.766096+0000","last_unstale":"2024-05-30T16:52:14.298371+0000","last_undegraded":"2024-05-30T16:52:14.298371+0000","last_fullsized":"2024-05-30T16:52:14.298371+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:16:34.282104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.757205+0000","last_change":"2024-05-30T16:52:11.757205+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.757205+0000","last_undegraded":"2024-05-30T16:52:11.757205+0000","last_fullsized":"2024-05-30T16:52:11.757205+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.765239+0000","last_change":"2024-05-30T16:52:11.763269+0000","last_active":"2024-05-30T16:52:11.765239+0000","last_peered":"2024-05-30T16:52:11.765239+0000","last_clean":"2024-05-30T16:52:11.765239+0000","last_became_active":"2024-05-30T16:52:11.762926+0000","last_became_peered":"2024-05-30T16:52:11.762926+0000","last_unstale":"2024-05-30T16:52:11.765239+0000","last_undegraded":"2024-05-30T16:52:11.765239+0000","last_fullsized":"2024-05-30T16:52:11.765239+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:30.572646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.746228+0000","last_change":"2024-05-30T16:52:11.746228+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.746228+0000","last_undegraded":"2024-05-30T16:52:11.746228+0000","last_fullsized":"2024-05-30T16:52:11.746228+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.762891+0000","last_change":"2024-05-30T16:52:11.761194+0000","last_active":"2024-05-30T16:52:11.762891+0000","last_peered":"2024-05-30T16:52:11.762891+0000","last_clean":"2024-05-30T16:52:11.762891+0000","last_became_active":"2024-05-30T16:52:11.760872+0000","last_became_peered":"2024-05-30T16:52:11.760872+0000","last_unstale":"2024-05-30T16:52:11.762891+0000","last_undegraded":"2024-05-30T16:52:11.762891+0000","last_fullsized":"2024-05-30T16:52:11.762891+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:30.838153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298128+0000","last_change":"2024-05-30T16:52:12.763798+0000","last_active":"2024-05-30T16:52:14.298128+0000","last_peered":"2024-05-30T16:52:14.298128+0000","last_clean":"2024-05-30T16:52:14.298128+0000","last_became_active":"2024-05-30T16:52:12.763310+0000","last_became_peered":"2024-05-30T16:52:12.763310+0000","last_unstale":"2024-05-30T16:52:14.298128+0000","last_undegraded":"2024-05-30T16:52:14.298128+0000","last_fullsized":"2024-05-30T16:52:14.298128+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:20:22.951037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.764421+0000","last_change":"2024-05-30T16:52:11.758596+0000","last_active":"2024-05-30T16:52:11.764421+0000","last_peered":"2024-05-30T16:52:11.764421+0000","last_clean":"2024-05-30T16:52:11.764421+0000","last_became_active":"2024-05-30T16:52:11.758334+0000","last_became_peered":"2024-05-30T16:52:11.758334+0000","last_unstale":"2024-05-30T16:52:11.764421+0000","last_undegraded":"2024-05-30T16:52:11.764421+0000","last_fullsized":"2024-05-30T16:52:11.764421+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:18.604651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298016+0000","last_change":"2024-05-30T16:52:12.775324+0000","last_active":"2024-05-30T16:52:14.298016+0000","last_peered":"2024-05-30T16:52:14.298016+0000","last_clean":"2024-05-30T16:52:14.298016+0000","last_became_active":"2024-05-30T16:52:12.774192+0000","last_became_peered":"2024-05-30T16:52:12.774192+0000","last_unstale":"2024-05-30T16:52:14.298016+0000","last_undegraded":"2024-05-30T16:52:14.298016+0000","last_fullsized":"2024-05-30T16:52:14.298016+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:02:30.718470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.765004+0000","last_change":"2024-05-30T16:52:11.762668+0000","last_active":"2024-05-30T16:52:11.765004+0000","last_peered":"2024-05-30T16:52:11.765004+0000","last_clean":"2024-05-30T16:52:11.765004+0000","last_became_active":"2024-05-30T16:52:11.761436+0000","last_became_peered":"2024-05-30T16:52:11.761436+0000","last_unstale":"2024-05-30T16:52:11.765004+0000","last_undegraded":"2024-05-30T16:52:11.765004+0000","last_fullsized":"2024-05-30T16:52:11.765004+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:00.336519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.745044+0000","last_change":"2024-05-30T16:52:11.745044+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.745044+0000","last_undegraded":"2024-05-30T16:52:11.745044+0000","last_fullsized":"2024-05-30T16:52:11.745044+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.763275+0000","last_change":"2024-05-30T16:52:11.761404+0000","last_active":"2024-05-30T16:52:11.763275+0000","last_peered":"2024-05-30T16:52:11.763275+0000","last_clean":"2024-05-30T16:52:11.763275+0000","last_became_active":"2024-05-30T16:52:11.761125+0000","last_became_peered":"2024-05-30T16:52:11.761125+0000","last_unstale":"2024-05-30T16:52:11.763275+0000","last_undegraded":"2024-05-30T16:52:11.763275+0000","last_fullsized":"2024-05-30T16:52:11.763275+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:28:04.301693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.749547+0000","last_change":"2024-05-30T16:52:11.749547+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.749547+0000","last_undegraded":"2024-05-30T16:52:11.749547+0000","last_fullsized":"2024-05-30T16:52:11.749547+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.776295+0000","last_change":"2024-05-30T16:52:11.771973+0000","last_active":"2024-05-30T16:52:11.776295+0000","last_peered":"2024-05-30T16:52:11.776295+0000","last_clean":"2024-05-30T16:52:11.776295+0000","last_became_active":"2024-05-30T16:52:11.771710+0000","last_became_peered":"2024-05-30T16:52:11.771710+0000","last_unstale":"2024-05-30T16:52:11.776295+0000","last_undegraded":"2024-05-30T16:52:11.776295+0000","last_fullsized":"2024-05-30T16:52:11.776295+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:48:23.620060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-05-30T16:52:11.758116+0000","last_change":"2024-05-30T16:52:11.758116+0000","last_active":"2024-05-30T16:52:11.734755+0000","last_peered":"2024-05-30T16:52:11.734755+0000","last_clean":"2024-05-30T16:52:11.734755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:52:11.758116+0000","last_undegraded":"2024-05-30T16:52:11.758116+0000","last_fullsized":"2024-05-30T16:52:11.758116+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.762019+0000","last_change":"2024-05-30T16:52:11.759259+0000","last_active":"2024-05-30T16:52:11.762019+0000","last_peered":"2024-05-30T16:52:11.762019+0000","last_clean":"2024-05-30T16:52:11.762019+0000","last_became_active":"2024-05-30T16:52:11.758515+0000","last_became_peered":"2024-05-30T16:52:11.758515+0000","last_unstale":"2024-05-30T16:52:11.762019+0000","last_undegraded":"2024-05-30T16:52:11.762019+0000","last_fullsized":"2024-05-30T16:52:11.762019+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:39:58.679050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":211,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-30T16:52:11.746315+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:52:11.746315+0000","last_peered":"2024-05-30T16:52:11.746315+0000","last_clean":"2024-05-30T16:52:11.746315+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:52:11.746315+0000","last_undegraded":"2024-05-30T16:52:11.746315+0000","last_fullsized":"2024-05-30T16:52:11.746315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335420,"statfs":{"total":96636764160,"available":96599470080,"internally_reserved":0,"allocated":1101824,"data_stored":790316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":507904,"data_stored":199948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35836,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":507904,"data_stored":199948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35852,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335988,"statfs":{"total":96636764160,"available":96600051712,"internally_reserved":0,"allocated":520192,"data_stored":206243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509483,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":520192,"data_stored":206243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35852,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335988,"statfs":{"total":96636764160,"available":96600051712,"internally_reserved":0,"allocated":520192,"data_stored":206243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1101824,"data_stored":790316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35884,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335956,"statfs":{"total":96636764160,"available":96600018944,"internally_reserved":0,"allocated":557056,"data_stored":220012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:52:21.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:52:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.633+0000 7f558fc00640 1 Processor -- start 2024-05-30T16:52:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.633+0000 7f558fc00640 1 -- start start 2024-05-30T16:52:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558fc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f55880af720 0x7f558815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558fc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558806e900 0x7f558815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558fc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55880d0560 0x7f55880d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558fc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f558815f060 con 0x7f55880d0560 2024-05-30T16:52:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558fc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f55880afb00 con 0x7f55880af720 2024-05-30T16:52:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558fc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f558815c270 con 0x7f558806e900 2024-05-30T16:52:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55880d0560 0x7f55880d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55880d0560 0x7f55880d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46728/0 (socket says 172.21.15.59:46728) 2024-05-30T16:52:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558dc00640 1 -- 172.21.15.59:0/2189900682 learned_addr learned my addr 172.21.15.59:0/2189900682 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558d200640 1 --2- 172.21.15.59:0/2189900682 >> v2:172.21.15.107:3300/0 conn(0x7f55880af720 0x7f558815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f557fe00640 1 --2- 172.21.15.59:0/2189900682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558806e900 0x7f558815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558dc00640 1 -- 172.21.15.59:0/2189900682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558806e900 msgr2=0x7f558815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558dc00640 1 --2- 172.21.15.59:0/2189900682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558806e900 0x7f558815f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558dc00640 1 -- 172.21.15.59:0/2189900682 >> v2:172.21.15.107:3300/0 conn(0x7f55880af720 msgr2=0x7f558815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558dc00640 1 --2- 172.21.15.59:0/2189900682 >> v2:172.21.15.107:3300/0 conn(0x7f55880af720 0x7f558815b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f558dc00640 1 -- 172.21.15.59:0/2189900682 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558815c550 con 0x7f55880d0560 2024-05-30T16:52:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.637+0000 7f557fe00640 1 --2- 172.21.15.59:0/2189900682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558806e900 0x7f558815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f558dc00640 1 --2- 172.21.15.59:0/2189900682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55880d0560 0x7f55880d0a10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f55880d04b0 tx=0x7f558001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22818832424b1a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f5587e00640 1 -- 172.21.15.59:0/2189900682 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55800a5780 con 0x7f55880d0560 2024-05-30T16:52:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f5587e00640 1 -- 172.21.15.59:0/2189900682 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55800a5920 con 0x7f55880d0560 2024-05-30T16:52:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f5587e00640 1 -- 172.21.15.59:0/2189900682 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55800a5cf0 con 0x7f55880d0560 2024-05-30T16:52:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f558fc00640 1 -- 172.21.15.59:0/2189900682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55880d0560 msgr2=0x7f55880d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f558fc00640 1 --2- 172.21.15.59:0/2189900682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55880d0560 0x7f55880d0a10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f55880d04b0 tx=0x7f558001c9f0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f558fc00640 1 -- 172.21.15.59:0/2189900682 shutdown_connections 2024-05-30T16:52:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f558fc00640 1 --2- 172.21.15.59:0/2189900682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55880d0560 0x7f55880d0a10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f558fc00640 1 --2- 172.21.15.59:0/2189900682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558806e900 0x7f558815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f558fc00640 1 --2- 172.21.15.59:0/2189900682 >> v2:172.21.15.107:3300/0 conn(0x7f55880af720 0x7f558815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f558fc00640 1 -- 172.21.15.59:0/2189900682 >> 172.21.15.59:0/2189900682 conn(0x7f55880b22d0 msgr2=0x7f55880b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f558fc00640 1 -- 172.21.15.59:0/2189900682 shutdown_connections 2024-05-30T16:52:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f558fc00640 1 -- 172.21.15.59:0/2189900682 wait complete. 2024-05-30T16:52:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f558fc00640 1 Processor -- start 2024-05-30T16:52:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.641+0000 7f558fc00640 1 -- start start 2024-05-30T16:52:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f558fc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558806e900 0x7f558809c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f558fc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55880af720 0x7f558809cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f558fc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55880d0560 0x7f5588165490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f558fc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f558815feb0 con 0x7f55880af720 2024-05-30T16:52:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f558fc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f558815fd30 con 0x7f55880d0560 2024-05-30T16:52:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f558fc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5588073150 con 0x7f558806e900 2024-05-30T16:52:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f557fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55880af720 0x7f558809cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f557fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55880af720 0x7f558809cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46732/0 (socket says 172.21.15.59:46732) 2024-05-30T16:52:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f557fe00640 1 -- 172.21.15.59:0/232992849 learned_addr learned my addr 172.21.15.59:0/232992849 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f558d200640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558806e900 0x7f558809c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f558dc00640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55880d0560 0x7f5588165490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f557fe00640 1 -- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558806e900 msgr2=0x7f558809c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f557fe00640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558806e900 0x7f558809c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f557fe00640 1 -- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55880d0560 msgr2=0x7f5588165490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f557fe00640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55880d0560 0x7f5588165490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f557fe00640 1 -- 172.21.15.59:0/232992849 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558809d570 con 0x7f55880af720 2024-05-30T16:52:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f558dc00640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55880d0560 0x7f5588165490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f557fe00640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55880af720 0x7f558809cef0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f557000c7f0 tx=0x7f557000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f5585600640 1 -- 172.21.15.59:0/232992849 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570004230 con 0x7f55880af720 2024-05-30T16:52:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f5585600640 1 -- 172.21.15.59:0/232992849 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55700043d0 con 0x7f55880af720 2024-05-30T16:52:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f558fc00640 1 -- 172.21.15.59:0/232992849 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558809d850 con 0x7f55880af720 2024-05-30T16:52:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f5585600640 1 -- 172.21.15.59:0/232992849 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570007a50 con 0x7f55880af720 2024-05-30T16:52:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f558fc00640 1 -- 172.21.15.59:0/232992849 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f558809de10 con 0x7f55880af720 2024-05-30T16:52:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.645+0000 7f558fc00640 1 -- 172.21.15.59:0/232992849 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5588068a90 con 0x7f55880af720 2024-05-30T16:52:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.649+0000 7f5585600640 1 -- 172.21.15.59:0/232992849 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f5570007bf0 con 0x7f55880af720 2024-05-30T16:52:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.649+0000 7f5585600640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5564068650 0x7f556406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.649+0000 7f5585600640 1 -- 172.21.15.59:0/232992849 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7f5570087120 con 0x7f55880af720 2024-05-30T16:52:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.649+0000 7f558d200640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5564068650 0x7f556406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:21.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.649+0000 7f558d200640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5564068650 0x7f556406ab10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5578007a60 tx=0x7f5578008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.653+0000 7f5585600640 1 -- 172.21.15.59:0/232992849 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5570015020 con 0x7f55880af720 2024-05-30T16:52:21.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.817+0000 7f558fc00640 1 -- 172.21.15.59:0/232992849 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55880b3060 con 0x7f5564068650 2024-05-30T16:52:21.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.821+0000 7f5585600640 1 -- 172.21.15.59:0/232992849 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251960 (secure 0 0 0) 0x7f55880b3060 con 0x7f5564068650 2024-05-30T16:52:21.827 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:52:21.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.825+0000 7f558fc00640 1 -- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5564068650 msgr2=0x7f556406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:21.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.825+0000 7f558fc00640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5564068650 0x7f556406ab10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5578007a60 tx=0x7f5578008040 comp rx=0 tx=0).stop 2024-05-30T16:52:21.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.825+0000 7f558fc00640 1 -- 172.21.15.59:0/232992849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55880af720 msgr2=0x7f558809cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:21.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.825+0000 7f558fc00640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55880af720 0x7f558809cef0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f557000c7f0 tx=0x7f557000ccb0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.825+0000 7f558fc00640 1 -- 172.21.15.59:0/232992849 shutdown_connections 2024-05-30T16:52:21.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.825+0000 7f558fc00640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5564068650 0x7f556406ab10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.825+0000 7f558fc00640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55880d0560 0x7f5588165490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.825+0000 7f558fc00640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55880af720 0x7f558809cef0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.825+0000 7f558fc00640 1 --2- 172.21.15.59:0/232992849 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558806e900 0x7f558809c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:21.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.825+0000 7f558fc00640 1 -- 172.21.15.59:0/232992849 >> 172.21.15.59:0/232992849 conn(0x7f55880b22d0 msgr2=0x7f55880b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:21.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.825+0000 7f558fc00640 1 -- 172.21.15.59:0/232992849 shutdown_connections 2024-05-30T16:52:21.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:21.825+0000 7f558fc00640 1 -- 172.21.15.59:0/232992849 wait complete. 2024-05-30T16:52:21.847 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-05-30T16:52:21.118454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279904,"kb_used_data":5480,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754694816,"statfs":{"total":773094113280,"available":772807491584,"internally_reserved":0,"allocated":5611520,"data_stored":2940548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.373279"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.768805+0000","last_change":"2024-05-30T16:52:12.762098+0000","last_active":"2024-05-30T16:52:13.768805+0000","last_peered":"2024-05-30T16:52:13.768805+0000","last_clean":"2024-05-30T16:52:13.768805+0000","last_became_active":"2024-05-30T16:52:12.761733+0000","last_became_peered":"2024-05-30T16:52:12.761733+0000","last_unstale":"2024-05-30T16:52:13.768805+0000","last_undegraded":"2024-05-30T16:52:13.768805+0000","last_fullsized":"2024-05-30T16:52:13.768805+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:05:04.712902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.768408+0000","last_change":"2024-05-30T16:52:12.776731+0000","last_active":"2024-05-30T16:52:13.768408+0000","last_peered":"2024-05-30T16:52:13.768408+0000","last_clean":"2024-05-30T16:52:13.768408+0000","last_became_active":"2024-05-30T16:52:12.776454+0000","last_became_peered":"2024-05-30T16:52:12.776454+0000","last_unstale":"2024-05-30T16:52:13.768408+0000","last_undegraded":"2024-05-30T16:52:13.768408+0000","last_fullsized":"2024-05-30T16:52:13.768408+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:59.117813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297167+0000","last_change":"2024-05-30T16:52:12.767291+0000","last_active":"2024-05-30T16:52:14.297167+0000","last_peered":"2024-05-30T16:52:14.297167+0000","last_clean":"2024-05-30T16:52:14.297167+0000","last_became_active":"2024-05-30T16:52:12.766713+0000","last_became_peered":"2024-05-30T16:52:12.766713+0000","last_unstale":"2024-05-30T16:52:14.297167+0000","last_undegraded":"2024-05-30T16:52:14.297167+0000","last_fullsized":"2024-05-30T16:52:14.297167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:14.522356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297296+0000","last_change":"2024-05-30T16:52:12.787702+0000","last_active":"2024-05-30T16:52:14.297296+0000","last_peered":"2024-05-30T16:52:14.297296+0000","last_clean":"2024-05-30T16:52:14.297296+0000","last_became_active":"2024-05-30T16:52:12.786384+0000","last_became_peered":"2024-05-30T16:52:12.786384+0000","last_unstale":"2024-05-30T16:52:14.297296+0000","last_undegraded":"2024-05-30T16:52:14.297296+0000","last_fullsized":"2024-05-30T16:52:14.297296+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:31:17.025174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767951+0000","last_change":"2024-05-30T16:52:12.776254+0000","last_active":"2024-05-30T16:52:13.767951+0000","last_peered":"2024-05-30T16:52:13.767951+0000","last_clean":"2024-05-30T16:52:13.767951+0000","last_became_active":"2024-05-30T16:52:12.776038+0000","last_became_peered":"2024-05-30T16:52:12.776038+0000","last_unstale":"2024-05-30T16:52:13.767951+0000","last_undegraded":"2024-05-30T16:52:13.767951+0000","last_fullsized":"2024-05-30T16:52:13.767951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:08:43.759500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297925+0000","last_change":"2024-05-30T16:52:12.771108+0000","last_active":"2024-05-30T16:52:14.297925+0000","last_peered":"2024-05-30T16:52:14.297925+0000","last_clean":"2024-05-30T16:52:14.297925+0000","last_became_active":"2024-05-30T16:52:12.770805+0000","last_became_peered":"2024-05-30T16:52:12.770805+0000","last_unstale":"2024-05-30T16:52:14.297925+0000","last_undegraded":"2024-05-30T16:52:14.297925+0000","last_fullsized":"2024-05-30T16:52:14.297925+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:29:26.725308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.768419+0000","last_change":"2024-05-30T16:52:12.762359+0000","last_active":"2024-05-30T16:52:13.768419+0000","last_peered":"2024-05-30T16:52:13.768419+0000","last_clean":"2024-05-30T16:52:13.768419+0000","last_became_active":"2024-05-30T16:52:12.762096+0000","last_became_peered":"2024-05-30T16:52:12.762096+0000","last_unstale":"2024-05-30T16:52:13.768419+0000","last_undegraded":"2024-05-30T16:52:13.768419+0000","last_fullsized":"2024-05-30T16:52:13.768419+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:23.532038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296416+0000","last_change":"2024-05-30T16:52:12.787028+0000","last_active":"2024-05-30T16:52:14.296416+0000","last_peered":"2024-05-30T16:52:14.296416+0000","last_clean":"2024-05-30T16:52:14.296416+0000","last_became_active":"2024-05-30T16:52:12.786745+0000","last_became_peered":"2024-05-30T16:52:12.786745+0000","last_unstale":"2024-05-30T16:52:14.296416+0000","last_undegraded":"2024-05-30T16:52:14.296416+0000","last_fullsized":"2024-05-30T16:52:14.296416+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:42:43.344768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297217+0000","last_change":"2024-05-30T16:52:12.788301+0000","last_active":"2024-05-30T16:52:14.297217+0000","last_peered":"2024-05-30T16:52:14.297217+0000","last_clean":"2024-05-30T16:52:14.297217+0000","last_became_active":"2024-05-30T16:52:12.788027+0000","last_became_peered":"2024-05-30T16:52:12.788027+0000","last_unstale":"2024-05-30T16:52:14.297217+0000","last_undegraded":"2024-05-30T16:52:14.297217+0000","last_fullsized":"2024-05-30T16:52:14.297217+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:32:18.345109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297400+0000","last_change":"2024-05-30T16:52:12.786717+0000","last_active":"2024-05-30T16:52:14.297400+0000","last_peered":"2024-05-30T16:52:14.297400+0000","last_clean":"2024-05-30T16:52:14.297400+0000","last_became_active":"2024-05-30T16:52:12.786518+0000","last_became_peered":"2024-05-30T16:52:12.786518+0000","last_unstale":"2024-05-30T16:52:14.297400+0000","last_undegraded":"2024-05-30T16:52:14.297400+0000","last_fullsized":"2024-05-30T16:52:14.297400+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:36.741444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296791+0000","last_change":"2024-05-30T16:52:12.788236+0000","last_active":"2024-05-30T16:52:14.296791+0000","last_peered":"2024-05-30T16:52:14.296791+0000","last_clean":"2024-05-30T16:52:14.296791+0000","last_became_active":"2024-05-30T16:52:12.787963+0000","last_became_peered":"2024-05-30T16:52:12.787963+0000","last_unstale":"2024-05-30T16:52:14.296791+0000","last_undegraded":"2024-05-30T16:52:14.296791+0000","last_fullsized":"2024-05-30T16:52:14.296791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:19:42.041732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767990+0000","last_change":"2024-05-30T16:52:12.759876+0000","last_active":"2024-05-30T16:52:13.767990+0000","last_peered":"2024-05-30T16:52:13.767990+0000","last_clean":"2024-05-30T16:52:13.767990+0000","last_became_active":"2024-05-30T16:52:12.759296+0000","last_became_peered":"2024-05-30T16:52:12.759296+0000","last_unstale":"2024-05-30T16:52:13.767990+0000","last_undegraded":"2024-05-30T16:52:13.767990+0000","last_fullsized":"2024-05-30T16:52:13.767990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:39.009654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297583+0000","last_change":"2024-05-30T16:52:12.769314+0000","last_active":"2024-05-30T16:52:14.297583+0000","last_peered":"2024-05-30T16:52:14.297583+0000","last_clean":"2024-05-30T16:52:14.297583+0000","last_became_active":"2024-05-30T16:52:12.769049+0000","last_became_peered":"2024-05-30T16:52:12.769049+0000","last_unstale":"2024-05-30T16:52:14.297583+0000","last_undegraded":"2024-05-30T16:52:14.297583+0000","last_fullsized":"2024-05-30T16:52:14.297583+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:47:43.562357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297069+0000","last_change":"2024-05-30T16:52:12.788250+0000","last_active":"2024-05-30T16:52:14.297069+0000","last_peered":"2024-05-30T16:52:14.297069+0000","last_clean":"2024-05-30T16:52:14.297069+0000","last_became_active":"2024-05-30T16:52:12.787907+0000","last_became_peered":"2024-05-30T16:52:12.787907+0000","last_unstale":"2024-05-30T16:52:14.297069+0000","last_undegraded":"2024-05-30T16:52:14.297069+0000","last_fullsized":"2024-05-30T16:52:14.297069+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:54.275397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297516+0000","last_change":"2024-05-30T16:52:12.772027+0000","last_active":"2024-05-30T16:52:14.297516+0000","last_peered":"2024-05-30T16:52:14.297516+0000","last_clean":"2024-05-30T16:52:14.297516+0000","last_became_active":"2024-05-30T16:52:12.771761+0000","last_became_peered":"2024-05-30T16:52:12.771761+0000","last_unstale":"2024-05-30T16:52:14.297516+0000","last_undegraded":"2024-05-30T16:52:14.297516+0000","last_fullsized":"2024-05-30T16:52:14.297516+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:59:54.866618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296344+0000","last_change":"2024-05-30T16:52:12.781177+0000","last_active":"2024-05-30T16:52:14.296344+0000","last_peered":"2024-05-30T16:52:14.296344+0000","last_clean":"2024-05-30T16:52:14.296344+0000","last_became_active":"2024-05-30T16:52:12.778698+0000","last_became_peered":"2024-05-30T16:52:12.778698+0000","last_unstale":"2024-05-30T16:52:14.296344+0000","last_undegraded":"2024-05-30T16:52:14.296344+0000","last_fullsized":"2024-05-30T16:52:14.296344+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:36.148961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297320+0000","last_change":"2024-05-30T16:52:12.758562+0000","last_active":"2024-05-30T16:52:14.297320+0000","last_peered":"2024-05-30T16:52:14.297320+0000","last_clean":"2024-05-30T16:52:14.297320+0000","last_became_active":"2024-05-30T16:52:12.758277+0000","last_became_peered":"2024-05-30T16:52:12.758277+0000","last_unstale":"2024-05-30T16:52:14.297320+0000","last_undegraded":"2024-05-30T16:52:14.297320+0000","last_fullsized":"2024-05-30T16:52:14.297320+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:36.741444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297064+0000","last_change":"2024-05-30T16:52:12.781690+0000","last_active":"2024-05-30T16:52:14.297064+0000","last_peered":"2024-05-30T16:52:14.297064+0000","last_clean":"2024-05-30T16:52:14.297064+0000","last_became_active":"2024-05-30T16:52:12.779391+0000","last_became_peered":"2024-05-30T16:52:12.779391+0000","last_unstale":"2024-05-30T16:52:14.297064+0000","last_undegraded":"2024-05-30T16:52:14.297064+0000","last_fullsized":"2024-05-30T16:52:14.297064+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:32:18.345109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297300+0000","last_change":"2024-05-30T16:52:12.777890+0000","last_active":"2024-05-30T16:52:14.297300+0000","last_peered":"2024-05-30T16:52:14.297300+0000","last_clean":"2024-05-30T16:52:14.297300+0000","last_became_active":"2024-05-30T16:52:12.777615+0000","last_became_peered":"2024-05-30T16:52:12.777615+0000","last_unstale":"2024-05-30T16:52:14.297300+0000","last_undegraded":"2024-05-30T16:52:14.297300+0000","last_fullsized":"2024-05-30T16:52:14.297300+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:20.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296600+0000","last_change":"2024-05-30T16:52:12.781347+0000","last_active":"2024-05-30T16:52:14.296600+0000","last_peered":"2024-05-30T16:52:14.296600+0000","last_clean":"2024-05-30T16:52:14.296600+0000","last_became_active":"2024-05-30T16:52:12.781024+0000","last_became_peered":"2024-05-30T16:52:12.781024+0000","last_unstale":"2024-05-30T16:52:14.296600+0000","last_undegraded":"2024-05-30T16:52:14.296600+0000","last_fullsized":"2024-05-30T16:52:14.296600+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:28:05.306474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297955+0000","last_change":"2024-05-30T16:52:12.775532+0000","last_active":"2024-05-30T16:52:14.297955+0000","last_peered":"2024-05-30T16:52:14.297955+0000","last_clean":"2024-05-30T16:52:14.297955+0000","last_became_active":"2024-05-30T16:52:12.775054+0000","last_became_peered":"2024-05-30T16:52:12.775054+0000","last_unstale":"2024-05-30T16:52:14.297955+0000","last_undegraded":"2024-05-30T16:52:14.297955+0000","last_fullsized":"2024-05-30T16:52:14.297955+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:31:14.760035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297119+0000","last_change":"2024-05-30T16:52:12.786101+0000","last_active":"2024-05-30T16:52:14.297119+0000","last_peered":"2024-05-30T16:52:14.297119+0000","last_clean":"2024-05-30T16:52:14.297119+0000","last_became_active":"2024-05-30T16:52:12.785837+0000","last_became_peered":"2024-05-30T16:52:12.785837+0000","last_unstale":"2024-05-30T16:52:14.297119+0000","last_undegraded":"2024-05-30T16:52:14.297119+0000","last_fullsized":"2024-05-30T16:52:14.297119+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:09.054398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296813+0000","last_change":"2024-05-30T16:52:12.772511+0000","last_active":"2024-05-30T16:52:14.296813+0000","last_peered":"2024-05-30T16:52:14.296813+0000","last_clean":"2024-05-30T16:52:14.296813+0000","last_became_active":"2024-05-30T16:52:12.769501+0000","last_became_peered":"2024-05-30T16:52:12.769501+0000","last_unstale":"2024-05-30T16:52:14.296813+0000","last_undegraded":"2024-05-30T16:52:14.296813+0000","last_fullsized":"2024-05-30T16:52:14.296813+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:25:37.355674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296350+0000","last_change":"2024-05-30T16:52:12.775590+0000","last_active":"2024-05-30T16:52:14.296350+0000","last_peered":"2024-05-30T16:52:14.296350+0000","last_clean":"2024-05-30T16:52:14.296350+0000","last_became_active":"2024-05-30T16:52:12.769503+0000","last_became_peered":"2024-05-30T16:52:12.769503+0000","last_unstale":"2024-05-30T16:52:14.296350+0000","last_undegraded":"2024-05-30T16:52:14.296350+0000","last_fullsized":"2024-05-30T16:52:14.296350+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:01.341299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297561+0000","last_change":"2024-05-30T16:52:12.763693+0000","last_active":"2024-05-30T16:52:14.297561+0000","last_peered":"2024-05-30T16:52:14.297561+0000","last_clean":"2024-05-30T16:52:14.297561+0000","last_became_active":"2024-05-30T16:52:12.763425+0000","last_became_peered":"2024-05-30T16:52:12.763425+0000","last_unstale":"2024-05-30T16:52:14.297561+0000","last_undegraded":"2024-05-30T16:52:14.297561+0000","last_fullsized":"2024-05-30T16:52:14.297561+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:35:06.831495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296531+0000","last_change":"2024-05-30T16:52:12.772404+0000","last_active":"2024-05-30T16:52:14.296531+0000","last_peered":"2024-05-30T16:52:14.296531+0000","last_clean":"2024-05-30T16:52:14.296531+0000","last_became_active":"2024-05-30T16:52:12.771614+0000","last_became_peered":"2024-05-30T16:52:12.771614+0000","last_unstale":"2024-05-30T16:52:14.296531+0000","last_undegraded":"2024-05-30T16:52:14.296531+0000","last_fullsized":"2024-05-30T16:52:14.296531+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:36.148961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297344+0000","last_change":"2024-05-30T16:52:12.767366+0000","last_active":"2024-05-30T16:52:14.297344+0000","last_peered":"2024-05-30T16:52:14.297344+0000","last_clean":"2024-05-30T16:52:14.297344+0000","last_became_active":"2024-05-30T16:52:12.765935+0000","last_became_peered":"2024-05-30T16:52:12.765935+0000","last_unstale":"2024-05-30T16:52:14.297344+0000","last_undegraded":"2024-05-30T16:52:14.297344+0000","last_fullsized":"2024-05-30T16:52:14.297344+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:08:43.759500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.768017+0000","last_change":"2024-05-30T16:52:12.760010+0000","last_active":"2024-05-30T16:52:13.768017+0000","last_peered":"2024-05-30T16:52:13.768017+0000","last_clean":"2024-05-30T16:52:13.768017+0000","last_became_active":"2024-05-30T16:52:12.759715+0000","last_became_peered":"2024-05-30T16:52:12.759715+0000","last_unstale":"2024-05-30T16:52:13.768017+0000","last_undegraded":"2024-05-30T16:52:13.768017+0000","last_fullsized":"2024-05-30T16:52:13.768017+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:58:25.384030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296676+0000","last_change":"2024-05-30T16:52:12.772709+0000","last_active":"2024-05-30T16:52:14.296676+0000","last_peered":"2024-05-30T16:52:14.296676+0000","last_clean":"2024-05-30T16:52:14.296676+0000","last_became_active":"2024-05-30T16:52:12.772331+0000","last_became_peered":"2024-05-30T16:52:12.772331+0000","last_unstale":"2024-05-30T16:52:14.296676+0000","last_undegraded":"2024-05-30T16:52:14.296676+0000","last_fullsized":"2024-05-30T16:52:14.296676+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:31:10.350394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296335+0000","last_change":"2024-05-30T16:52:12.757954+0000","last_active":"2024-05-30T16:52:14.296335+0000","last_peered":"2024-05-30T16:52:14.296335+0000","last_clean":"2024-05-30T16:52:14.296335+0000","last_became_active":"2024-05-30T16:52:12.757443+0000","last_became_peered":"2024-05-30T16:52:12.757443+0000","last_unstale":"2024-05-30T16:52:14.296335+0000","last_undegraded":"2024-05-30T16:52:14.296335+0000","last_fullsized":"2024-05-30T16:52:14.296335+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:35:04.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297628+0000","last_change":"2024-05-30T16:52:12.766158+0000","last_active":"2024-05-30T16:52:14.297628+0000","last_peered":"2024-05-30T16:52:14.297628+0000","last_clean":"2024-05-30T16:52:14.297628+0000","last_became_active":"2024-05-30T16:52:12.765499+0000","last_became_peered":"2024-05-30T16:52:12.765499+0000","last_unstale":"2024-05-30T16:52:14.297628+0000","last_undegraded":"2024-05-30T16:52:14.297628+0000","last_fullsized":"2024-05-30T16:52:14.297628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:45:32.830341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296301+0000","last_change":"2024-05-30T16:52:12.762793+0000","last_active":"2024-05-30T16:52:14.296301+0000","last_peered":"2024-05-30T16:52:14.296301+0000","last_clean":"2024-05-30T16:52:14.296301+0000","last_became_active":"2024-05-30T16:52:12.762123+0000","last_became_peered":"2024-05-30T16:52:12.762123+0000","last_unstale":"2024-05-30T16:52:14.296301+0000","last_undegraded":"2024-05-30T16:52:14.296301+0000","last_fullsized":"2024-05-30T16:52:14.296301+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:17:44.465995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.772702+0000","last_change":"2024-05-30T16:52:12.773207+0000","last_active":"2024-05-30T16:52:13.772702+0000","last_peered":"2024-05-30T16:52:13.772702+0000","last_clean":"2024-05-30T16:52:13.772702+0000","last_became_active":"2024-05-30T16:52:12.772964+0000","last_became_peered":"2024-05-30T16:52:12.772964+0000","last_unstale":"2024-05-30T16:52:13.772702+0000","last_undegraded":"2024-05-30T16:52:13.772702+0000","last_fullsized":"2024-05-30T16:52:13.772702+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:20.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298463+0000","last_change":"2024-05-30T16:52:11.768213+0000","last_active":"2024-05-30T16:52:14.298463+0000","last_peered":"2024-05-30T16:52:14.298463+0000","last_clean":"2024-05-30T16:52:14.298463+0000","last_became_active":"2024-05-30T16:52:11.767915+0000","last_became_peered":"2024-05-30T16:52:11.767915+0000","last_unstale":"2024-05-30T16:52:14.298463+0000","last_undegraded":"2024-05-30T16:52:14.298463+0000","last_fullsized":"2024-05-30T16:52:14.298463+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:32:49.346808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297569+0000","last_change":"2024-05-30T16:52:12.772666+0000","last_active":"2024-05-30T16:52:14.297569+0000","last_peered":"2024-05-30T16:52:14.297569+0000","last_clean":"2024-05-30T16:52:14.297569+0000","last_became_active":"2024-05-30T16:52:12.772388+0000","last_became_peered":"2024-05-30T16:52:12.772388+0000","last_unstale":"2024-05-30T16:52:14.297569+0000","last_undegraded":"2024-05-30T16:52:14.297569+0000","last_fullsized":"2024-05-30T16:52:14.297569+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:16.954148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297202+0000","last_change":"2024-05-30T16:52:11.767326+0000","last_active":"2024-05-30T16:52:14.297202+0000","last_peered":"2024-05-30T16:52:14.297202+0000","last_clean":"2024-05-30T16:52:14.297202+0000","last_became_active":"2024-05-30T16:52:11.766962+0000","last_became_peered":"2024-05-30T16:52:11.766962+0000","last_unstale":"2024-05-30T16:52:14.297202+0000","last_undegraded":"2024-05-30T16:52:14.297202+0000","last_fullsized":"2024-05-30T16:52:14.297202+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:42:41.918810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.768152+0000","last_change":"2024-05-30T16:52:12.764754+0000","last_active":"2024-05-30T16:52:13.768152+0000","last_peered":"2024-05-30T16:52:13.768152+0000","last_clean":"2024-05-30T16:52:13.768152+0000","last_became_active":"2024-05-30T16:52:12.764485+0000","last_became_peered":"2024-05-30T16:52:12.764485+0000","last_unstale":"2024-05-30T16:52:13.768152+0000","last_undegraded":"2024-05-30T16:52:13.768152+0000","last_fullsized":"2024-05-30T16:52:13.768152+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:16.490740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.772845+0000","last_change":"2024-05-30T16:52:11.762080+0000","last_active":"2024-05-30T16:52:13.772845+0000","last_peered":"2024-05-30T16:52:13.772845+0000","last_clean":"2024-05-30T16:52:13.772845+0000","last_became_active":"2024-05-30T16:52:11.761680+0000","last_became_peered":"2024-05-30T16:52:11.761680+0000","last_unstale":"2024-05-30T16:52:13.772845+0000","last_undegraded":"2024-05-30T16:52:13.772845+0000","last_fullsized":"2024-05-30T16:52:13.772845+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:31:09.345614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.772720+0000","last_change":"2024-05-30T16:52:12.770572+0000","last_active":"2024-05-30T16:52:13.772720+0000","last_peered":"2024-05-30T16:52:13.772720+0000","last_clean":"2024-05-30T16:52:13.772720+0000","last_became_active":"2024-05-30T16:52:12.768180+0000","last_became_peered":"2024-05-30T16:52:12.768180+0000","last_unstale":"2024-05-30T16:52:13.772720+0000","last_undegraded":"2024-05-30T16:52:13.772720+0000","last_fullsized":"2024-05-30T16:52:13.772720+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:35:06.831495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767316+0000","last_change":"2024-05-30T16:52:11.756991+0000","last_active":"2024-05-30T16:52:13.767316+0000","last_peered":"2024-05-30T16:52:13.767316+0000","last_clean":"2024-05-30T16:52:13.767316+0000","last_became_active":"2024-05-30T16:52:11.756716+0000","last_became_peered":"2024-05-30T16:52:11.756716+0000","last_unstale":"2024-05-30T16:52:13.767316+0000","last_undegraded":"2024-05-30T16:52:13.767316+0000","last_fullsized":"2024-05-30T16:52:13.767316+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:35:03.130328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296533+0000","last_change":"2024-05-30T16:52:12.768193+0000","last_active":"2024-05-30T16:52:14.296533+0000","last_peered":"2024-05-30T16:52:14.296533+0000","last_clean":"2024-05-30T16:52:14.296533+0000","last_became_active":"2024-05-30T16:52:12.767879+0000","last_became_peered":"2024-05-30T16:52:12.767879+0000","last_unstale":"2024-05-30T16:52:14.296533+0000","last_undegraded":"2024-05-30T16:52:14.296533+0000","last_fullsized":"2024-05-30T16:52:14.296533+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:09.054398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298034+0000","last_change":"2024-05-30T16:52:11.765391+0000","last_active":"2024-05-30T16:52:14.298034+0000","last_peered":"2024-05-30T16:52:14.298034+0000","last_clean":"2024-05-30T16:52:14.298034+0000","last_became_active":"2024-05-30T16:52:11.765096+0000","last_became_peered":"2024-05-30T16:52:11.765096+0000","last_unstale":"2024-05-30T16:52:14.298034+0000","last_undegraded":"2024-05-30T16:52:14.298034+0000","last_fullsized":"2024-05-30T16:52:14.298034+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:19:40.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296890+0000","last_change":"2024-05-30T16:52:12.784672+0000","last_active":"2024-05-30T16:52:14.296890+0000","last_peered":"2024-05-30T16:52:14.296890+0000","last_clean":"2024-05-30T16:52:14.296890+0000","last_became_active":"2024-05-30T16:52:12.784400+0000","last_became_peered":"2024-05-30T16:52:12.784400+0000","last_unstale":"2024-05-30T16:52:14.296890+0000","last_undegraded":"2024-05-30T16:52:14.296890+0000","last_fullsized":"2024-05-30T16:52:14.296890+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:21.138595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296993+0000","last_change":"2024-05-30T16:52:11.757778+0000","last_active":"2024-05-30T16:52:14.296993+0000","last_peered":"2024-05-30T16:52:14.296993+0000","last_clean":"2024-05-30T16:52:14.296993+0000","last_became_active":"2024-05-30T16:52:11.757401+0000","last_became_peered":"2024-05-30T16:52:11.757401+0000","last_unstale":"2024-05-30T16:52:14.296993+0000","last_undegraded":"2024-05-30T16:52:14.296993+0000","last_fullsized":"2024-05-30T16:52:14.296993+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:06:48.215980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296670+0000","last_change":"2024-05-30T16:52:12.787137+0000","last_active":"2024-05-30T16:52:14.296670+0000","last_peered":"2024-05-30T16:52:14.296670+0000","last_clean":"2024-05-30T16:52:14.296670+0000","last_became_active":"2024-05-30T16:52:12.786758+0000","last_became_peered":"2024-05-30T16:52:12.786758+0000","last_unstale":"2024-05-30T16:52:14.296670+0000","last_undegraded":"2024-05-30T16:52:14.296670+0000","last_fullsized":"2024-05-30T16:52:14.296670+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:31.577427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767652+0000","last_change":"2024-05-30T16:52:11.754254+0000","last_active":"2024-05-30T16:52:13.767652+0000","last_peered":"2024-05-30T16:52:13.767652+0000","last_clean":"2024-05-30T16:52:13.767652+0000","last_became_active":"2024-05-30T16:52:11.753946+0000","last_became_peered":"2024-05-30T16:52:11.753946+0000","last_unstale":"2024-05-30T16:52:13.767652+0000","last_undegraded":"2024-05-30T16:52:13.767652+0000","last_fullsized":"2024-05-30T16:52:13.767652+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:18.604651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296438+0000","last_change":"2024-05-30T16:52:12.773271+0000","last_active":"2024-05-30T16:52:14.296438+0000","last_peered":"2024-05-30T16:52:14.296438+0000","last_clean":"2024-05-30T16:52:14.296438+0000","last_became_active":"2024-05-30T16:52:12.772983+0000","last_became_peered":"2024-05-30T16:52:12.772983+0000","last_unstale":"2024-05-30T16:52:14.296438+0000","last_undegraded":"2024-05-30T16:52:14.296438+0000","last_fullsized":"2024-05-30T16:52:14.296438+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:47:43.562357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296771+0000","last_change":"2024-05-30T16:52:11.771861+0000","last_active":"2024-05-30T16:52:14.296771+0000","last_peered":"2024-05-30T16:52:14.296771+0000","last_clean":"2024-05-30T16:52:14.296771+0000","last_became_active":"2024-05-30T16:52:11.771573+0000","last_became_peered":"2024-05-30T16:52:11.771573+0000","last_unstale":"2024-05-30T16:52:14.296771+0000","last_undegraded":"2024-05-30T16:52:14.296771+0000","last_fullsized":"2024-05-30T16:52:14.296771+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:29:37.464301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297071+0000","last_change":"2024-05-30T16:52:12.779371+0000","last_active":"2024-05-30T16:52:14.297071+0000","last_peered":"2024-05-30T16:52:14.297071+0000","last_clean":"2024-05-30T16:52:14.297071+0000","last_became_active":"2024-05-30T16:52:12.779099+0000","last_became_peered":"2024-05-30T16:52:12.779099+0000","last_unstale":"2024-05-30T16:52:14.297071+0000","last_undegraded":"2024-05-30T16:52:14.297071+0000","last_fullsized":"2024-05-30T16:52:14.297071+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:31:17.025174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297404+0000","last_change":"2024-05-30T16:52:11.768155+0000","last_active":"2024-05-30T16:52:14.297404+0000","last_peered":"2024-05-30T16:52:14.297404+0000","last_clean":"2024-05-30T16:52:14.297404+0000","last_became_active":"2024-05-30T16:52:11.767557+0000","last_became_peered":"2024-05-30T16:52:11.767557+0000","last_unstale":"2024-05-30T16:52:14.297404+0000","last_undegraded":"2024-05-30T16:52:14.297404+0000","last_fullsized":"2024-05-30T16:52:14.297404+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:31:09.345614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.768818+0000","last_change":"2024-05-30T16:52:12.773037+0000","last_active":"2024-05-30T16:52:13.768818+0000","last_peered":"2024-05-30T16:52:13.768818+0000","last_clean":"2024-05-30T16:52:13.768818+0000","last_became_active":"2024-05-30T16:52:12.772756+0000","last_became_peered":"2024-05-30T16:52:12.772756+0000","last_unstale":"2024-05-30T16:52:13.768818+0000","last_undegraded":"2024-05-30T16:52:13.768818+0000","last_fullsized":"2024-05-30T16:52:13.768818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:58:54.720874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297711+0000","last_change":"2024-05-30T16:52:11.773802+0000","last_active":"2024-05-30T16:52:14.297711+0000","last_peered":"2024-05-30T16:52:14.297711+0000","last_clean":"2024-05-30T16:52:14.297711+0000","last_became_active":"2024-05-30T16:52:11.771528+0000","last_became_peered":"2024-05-30T16:52:11.771528+0000","last_unstale":"2024-05-30T16:52:14.297711+0000","last_undegraded":"2024-05-30T16:52:14.297711+0000","last_fullsized":"2024-05-30T16:52:14.297711+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:30.838153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298144+0000","last_change":"2024-05-30T16:52:12.773756+0000","last_active":"2024-05-30T16:52:14.298144+0000","last_peered":"2024-05-30T16:52:14.298144+0000","last_clean":"2024-05-30T16:52:14.298144+0000","last_became_active":"2024-05-30T16:52:12.773592+0000","last_became_peered":"2024-05-30T16:52:12.773592+0000","last_unstale":"2024-05-30T16:52:14.298144+0000","last_undegraded":"2024-05-30T16:52:14.298144+0000","last_fullsized":"2024-05-30T16:52:14.298144+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:31:13.580941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767704+0000","last_change":"2024-05-30T16:52:11.763496+0000","last_active":"2024-05-30T16:52:13.767704+0000","last_peered":"2024-05-30T16:52:13.767704+0000","last_clean":"2024-05-30T16:52:13.767704+0000","last_became_active":"2024-05-30T16:52:11.763141+0000","last_became_peered":"2024-05-30T16:52:11.763141+0000","last_unstale":"2024-05-30T16:52:13.767704+0000","last_undegraded":"2024-05-30T16:52:13.767704+0000","last_fullsized":"2024-05-30T16:52:13.767704+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:31:16.020393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767571+0000","last_change":"2024-05-30T16:52:12.768467+0000","last_active":"2024-05-30T16:52:13.767571+0000","last_peered":"2024-05-30T16:52:13.767571+0000","last_clean":"2024-05-30T16:52:13.767571+0000","last_became_active":"2024-05-30T16:52:12.768195+0000","last_became_peered":"2024-05-30T16:52:12.768195+0000","last_unstale":"2024-05-30T16:52:13.767571+0000","last_undegraded":"2024-05-30T16:52:13.767571+0000","last_fullsized":"2024-05-30T16:52:13.767571+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:34:18.955748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296715+0000","last_change":"2024-05-30T16:52:11.763318+0000","last_active":"2024-05-30T16:52:14.296715+0000","last_peered":"2024-05-30T16:52:14.296715+0000","last_clean":"2024-05-30T16:52:14.296715+0000","last_became_active":"2024-05-30T16:52:11.763052+0000","last_became_peered":"2024-05-30T16:52:11.763052+0000","last_unstale":"2024-05-30T16:52:14.296715+0000","last_undegraded":"2024-05-30T16:52:14.296715+0000","last_fullsized":"2024-05-30T16:52:14.296715+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:58.645778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296731+0000","last_change":"2024-05-30T16:52:12.779846+0000","last_active":"2024-05-30T16:52:14.296731+0000","last_peered":"2024-05-30T16:52:14.296731+0000","last_clean":"2024-05-30T16:52:14.296731+0000","last_became_active":"2024-05-30T16:52:12.779489+0000","last_became_peered":"2024-05-30T16:52:12.779489+0000","last_unstale":"2024-05-30T16:52:14.296731+0000","last_undegraded":"2024-05-30T16:52:14.296731+0000","last_fullsized":"2024-05-30T16:52:14.296731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:42:42.923591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298083+0000","last_change":"2024-05-30T16:52:11.775662+0000","last_active":"2024-05-30T16:52:14.298083+0000","last_peered":"2024-05-30T16:52:14.298083+0000","last_clean":"2024-05-30T16:52:14.298083+0000","last_became_active":"2024-05-30T16:52:11.775356+0000","last_became_peered":"2024-05-30T16:52:11.775356+0000","last_unstale":"2024-05-30T16:52:14.298083+0000","last_undegraded":"2024-05-30T16:52:14.298083+0000","last_fullsized":"2024-05-30T16:52:14.298083+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:32:56.547786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297077+0000","last_change":"2024-05-30T16:52:12.778325+0000","last_active":"2024-05-30T16:52:14.297077+0000","last_peered":"2024-05-30T16:52:14.297077+0000","last_clean":"2024-05-30T16:52:14.297077+0000","last_became_active":"2024-05-30T16:52:12.776064+0000","last_became_peered":"2024-05-30T16:52:12.776064+0000","last_unstale":"2024-05-30T16:52:14.297077+0000","last_undegraded":"2024-05-30T16:52:14.297077+0000","last_fullsized":"2024-05-30T16:52:14.297077+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:35:04.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767369+0000","last_change":"2024-05-30T16:52:11.765673+0000","last_active":"2024-05-30T16:52:13.767369+0000","last_peered":"2024-05-30T16:52:13.767369+0000","last_clean":"2024-05-30T16:52:13.767369+0000","last_became_active":"2024-05-30T16:52:11.765157+0000","last_became_peered":"2024-05-30T16:52:11.765157+0000","last_unstale":"2024-05-30T16:52:13.767369+0000","last_undegraded":"2024-05-30T16:52:13.767369+0000","last_fullsized":"2024-05-30T16:52:13.767369+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:32:17.340328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297416+0000","last_change":"2024-05-30T16:52:12.781216+0000","last_active":"2024-05-30T16:52:14.297416+0000","last_peered":"2024-05-30T16:52:14.297416+0000","last_clean":"2024-05-30T16:52:14.297416+0000","last_became_active":"2024-05-30T16:52:12.779763+0000","last_became_peered":"2024-05-30T16:52:12.779763+0000","last_unstale":"2024-05-30T16:52:14.297416+0000","last_undegraded":"2024-05-30T16:52:14.297416+0000","last_fullsized":"2024-05-30T16:52:14.297416+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:21:02.860921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297657+0000","last_change":"2024-05-30T16:52:11.771843+0000","last_active":"2024-05-30T16:52:14.297657+0000","last_peered":"2024-05-30T16:52:14.297657+0000","last_clean":"2024-05-30T16:52:14.297657+0000","last_became_active":"2024-05-30T16:52:11.771540+0000","last_became_peered":"2024-05-30T16:52:11.771540+0000","last_unstale":"2024-05-30T16:52:14.297657+0000","last_undegraded":"2024-05-30T16:52:14.297657+0000","last_fullsized":"2024-05-30T16:52:14.297657+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:47:01.601969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.768574+0000","last_change":"2024-05-30T16:52:12.770896+0000","last_active":"2024-05-30T16:52:13.768574+0000","last_peered":"2024-05-30T16:52:13.768574+0000","last_clean":"2024-05-30T16:52:13.768574+0000","last_became_active":"2024-05-30T16:52:12.770178+0000","last_became_peered":"2024-05-30T16:52:12.770178+0000","last_unstale":"2024-05-30T16:52:13.768574+0000","last_undegraded":"2024-05-30T16:52:13.768574+0000","last_fullsized":"2024-05-30T16:52:13.768574+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:29:50.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296851+0000","last_change":"2024-05-30T16:52:11.754549+0000","last_active":"2024-05-30T16:52:14.296851+0000","last_peered":"2024-05-30T16:52:14.296851+0000","last_clean":"2024-05-30T16:52:14.296851+0000","last_became_active":"2024-05-30T16:52:11.754201+0000","last_became_peered":"2024-05-30T16:52:11.754201+0000","last_unstale":"2024-05-30T16:52:14.296851+0000","last_undegraded":"2024-05-30T16:52:14.296851+0000","last_fullsized":"2024-05-30T16:52:14.296851+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:35.217273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296643+0000","last_change":"2024-05-30T16:52:12.758571+0000","last_active":"2024-05-30T16:52:14.296643+0000","last_peered":"2024-05-30T16:52:14.296643+0000","last_clean":"2024-05-30T16:52:14.296643+0000","last_became_active":"2024-05-30T16:52:12.757686+0000","last_became_peered":"2024-05-30T16:52:12.757686+0000","last_unstale":"2024-05-30T16:52:14.296643+0000","last_undegraded":"2024-05-30T16:52:14.296643+0000","last_fullsized":"2024-05-30T16:52:14.296643+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:01.341299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296611+0000","last_change":"2024-05-30T16:52:11.759174+0000","last_active":"2024-05-30T16:52:14.296611+0000","last_peered":"2024-05-30T16:52:14.296611+0000","last_clean":"2024-05-30T16:52:14.296611+0000","last_became_active":"2024-05-30T16:52:11.758846+0000","last_became_peered":"2024-05-30T16:52:11.758846+0000","last_unstale":"2024-05-30T16:52:14.296611+0000","last_undegraded":"2024-05-30T16:52:14.296611+0000","last_fullsized":"2024-05-30T16:52:14.296611+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:34.799686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297366+0000","last_change":"2024-05-30T16:52:12.785008+0000","last_active":"2024-05-30T16:52:14.297366+0000","last_peered":"2024-05-30T16:52:14.297366+0000","last_clean":"2024-05-30T16:52:14.297366+0000","last_became_active":"2024-05-30T16:52:12.784110+0000","last_became_peered":"2024-05-30T16:52:12.784110+0000","last_unstale":"2024-05-30T16:52:14.297366+0000","last_undegraded":"2024-05-30T16:52:14.297366+0000","last_fullsized":"2024-05-30T16:52:14.297366+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:14.522356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297257+0000","last_change":"2024-05-30T16:52:11.762654+0000","last_active":"2024-05-30T16:52:14.297257+0000","last_peered":"2024-05-30T16:52:14.297257+0000","last_clean":"2024-05-30T16:52:14.297257+0000","last_became_active":"2024-05-30T16:52:11.762385+0000","last_became_peered":"2024-05-30T16:52:11.762385+0000","last_unstale":"2024-05-30T16:52:14.297257+0000","last_undegraded":"2024-05-30T16:52:14.297257+0000","last_fullsized":"2024-05-30T16:52:14.297257+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:25:36.350893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296903+0000","last_change":"2024-05-30T16:52:12.777656+0000","last_active":"2024-05-30T16:52:14.296903+0000","last_peered":"2024-05-30T16:52:14.296903+0000","last_clean":"2024-05-30T16:52:14.296903+0000","last_became_active":"2024-05-30T16:52:12.777265+0000","last_became_peered":"2024-05-30T16:52:12.777265+0000","last_unstale":"2024-05-30T16:52:14.296903+0000","last_undegraded":"2024-05-30T16:52:14.296903+0000","last_fullsized":"2024-05-30T16:52:14.296903+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:53:43.668024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.768225+0000","last_change":"2024-05-30T16:52:11.754550+0000","last_active":"2024-05-30T16:52:13.768225+0000","last_peered":"2024-05-30T16:52:13.768225+0000","last_clean":"2024-05-30T16:52:13.768225+0000","last_became_active":"2024-05-30T16:52:11.754274+0000","last_became_peered":"2024-05-30T16:52:11.754274+0000","last_unstale":"2024-05-30T16:52:13.768225+0000","last_undegraded":"2024-05-30T16:52:13.768225+0000","last_fullsized":"2024-05-30T16:52:13.768225+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:20.133814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296862+0000","last_change":"2024-05-30T16:52:12.764662+0000","last_active":"2024-05-30T16:52:14.296862+0000","last_peered":"2024-05-30T16:52:14.296862+0000","last_clean":"2024-05-30T16:52:14.296862+0000","last_became_active":"2024-05-30T16:52:12.764327+0000","last_became_peered":"2024-05-30T16:52:12.764327+0000","last_unstale":"2024-05-30T16:52:14.296862+0000","last_undegraded":"2024-05-30T16:52:14.296862+0000","last_fullsized":"2024-05-30T16:52:14.296862+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:06:49.220761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298194+0000","last_change":"2024-05-30T16:52:11.767257+0000","last_active":"2024-05-30T16:52:14.298194+0000","last_peered":"2024-05-30T16:52:14.298194+0000","last_clean":"2024-05-30T16:52:14.298194+0000","last_became_active":"2024-05-30T16:52:11.766776+0000","last_became_peered":"2024-05-30T16:52:11.766776+0000","last_unstale":"2024-05-30T16:52:14.298194+0000","last_undegraded":"2024-05-30T16:52:14.298194+0000","last_fullsized":"2024-05-30T16:52:14.298194+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:49.907573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297942+0000","last_change":"2024-05-30T16:52:12.783213+0000","last_active":"2024-05-30T16:52:14.297942+0000","last_peered":"2024-05-30T16:52:14.297942+0000","last_clean":"2024-05-30T16:52:14.297942+0000","last_became_active":"2024-05-30T16:52:12.782012+0000","last_became_peered":"2024-05-30T16:52:12.782012+0000","last_unstale":"2024-05-30T16:52:14.297942+0000","last_undegraded":"2024-05-30T16:52:14.297942+0000","last_fullsized":"2024-05-30T16:52:14.297942+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:28.261365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298198+0000","last_change":"2024-05-30T16:52:11.762594+0000","last_active":"2024-05-30T16:52:14.298198+0000","last_peered":"2024-05-30T16:52:14.298198+0000","last_clean":"2024-05-30T16:52:14.298198+0000","last_became_active":"2024-05-30T16:52:11.760414+0000","last_became_peered":"2024-05-30T16:52:11.760414+0000","last_unstale":"2024-05-30T16:52:14.298198+0000","last_undegraded":"2024-05-30T16:52:14.298198+0000","last_fullsized":"2024-05-30T16:52:14.298198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:31.025155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.772563+0000","last_change":"2024-05-30T16:52:12.767337+0000","last_active":"2024-05-30T16:52:13.772563+0000","last_peered":"2024-05-30T16:52:13.772563+0000","last_clean":"2024-05-30T16:52:13.772563+0000","last_became_active":"2024-05-30T16:52:12.767042+0000","last_became_peered":"2024-05-30T16:52:12.767042+0000","last_unstale":"2024-05-30T16:52:13.772563+0000","last_undegraded":"2024-05-30T16:52:13.772563+0000","last_fullsized":"2024-05-30T16:52:13.772563+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:53:43.668024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767514+0000","last_change":"2024-05-30T16:52:11.761712+0000","last_active":"2024-05-30T16:52:13.767514+0000","last_peered":"2024-05-30T16:52:13.767514+0000","last_clean":"2024-05-30T16:52:13.767514+0000","last_became_active":"2024-05-30T16:52:11.761375+0000","last_became_peered":"2024-05-30T16:52:11.761375+0000","last_unstale":"2024-05-30T16:52:13.767514+0000","last_undegraded":"2024-05-30T16:52:13.767514+0000","last_fullsized":"2024-05-30T16:52:13.767514+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:30.572646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296476+0000","last_change":"2024-05-30T16:52:12.763014+0000","last_active":"2024-05-30T16:52:14.296476+0000","last_peered":"2024-05-30T16:52:14.296476+0000","last_clean":"2024-05-30T16:52:14.296476+0000","last_became_active":"2024-05-30T16:52:12.762537+0000","last_became_peered":"2024-05-30T16:52:12.762537+0000","last_unstale":"2024-05-30T16:52:14.296476+0000","last_undegraded":"2024-05-30T16:52:14.296476+0000","last_fullsized":"2024-05-30T16:52:14.296476+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:31.842934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296650+0000","last_change":"2024-05-30T16:52:11.765519+0000","last_active":"2024-05-30T16:52:14.296650+0000","last_peered":"2024-05-30T16:52:14.296650+0000","last_clean":"2024-05-30T16:52:14.296650+0000","last_became_active":"2024-05-30T16:52:11.765207+0000","last_became_peered":"2024-05-30T16:52:11.765207+0000","last_unstale":"2024-05-30T16:52:14.296650+0000","last_undegraded":"2024-05-30T16:52:14.296650+0000","last_fullsized":"2024-05-30T16:52:14.296650+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:17:43.461214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296556+0000","last_change":"2024-05-30T16:52:12.788287+0000","last_active":"2024-05-30T16:52:14.296556+0000","last_peered":"2024-05-30T16:52:14.296556+0000","last_clean":"2024-05-30T16:52:14.296556+0000","last_became_active":"2024-05-30T16:52:12.787948+0000","last_became_peered":"2024-05-30T16:52:12.787948+0000","last_unstale":"2024-05-30T16:52:14.296556+0000","last_undegraded":"2024-05-30T16:52:14.296556+0000","last_fullsized":"2024-05-30T16:52:14.296556+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:19.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767802+0000","last_change":"2024-05-30T16:52:11.755523+0000","last_active":"2024-05-30T16:52:13.767802+0000","last_peered":"2024-05-30T16:52:13.767802+0000","last_clean":"2024-05-30T16:52:13.767802+0000","last_became_active":"2024-05-30T16:52:11.755205+0000","last_became_peered":"2024-05-30T16:52:11.755205+0000","last_unstale":"2024-05-30T16:52:13.767802+0000","last_undegraded":"2024-05-30T16:52:13.767802+0000","last_fullsized":"2024-05-30T16:52:13.767802+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:53.270617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297661+0000","last_change":"2024-05-30T16:52:12.778013+0000","last_active":"2024-05-30T16:52:14.297661+0000","last_peered":"2024-05-30T16:52:14.297661+0000","last_clean":"2024-05-30T16:52:14.297661+0000","last_became_active":"2024-05-30T16:52:12.777732+0000","last_became_peered":"2024-05-30T16:52:12.777732+0000","last_unstale":"2024-05-30T16:52:14.297661+0000","last_undegraded":"2024-05-30T16:52:14.297661+0000","last_fullsized":"2024-05-30T16:52:14.297661+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:49.121456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"47'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298371+0000","last_change":"2024-05-30T16:52:11.768139+0000","last_active":"2024-05-30T16:52:14.298371+0000","last_peered":"2024-05-30T16:52:14.298371+0000","last_clean":"2024-05-30T16:52:14.298371+0000","last_became_active":"2024-05-30T16:52:11.766096+0000","last_became_peered":"2024-05-30T16:52:11.766096+0000","last_unstale":"2024-05-30T16:52:14.298371+0000","last_undegraded":"2024-05-30T16:52:14.298371+0000","last_fullsized":"2024-05-30T16:52:14.298371+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:16:34.282104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297785+0000","last_change":"2024-05-30T16:52:12.778829+0000","last_active":"2024-05-30T16:52:14.297785+0000","last_peered":"2024-05-30T16:52:14.297785+0000","last_clean":"2024-05-30T16:52:14.297785+0000","last_became_active":"2024-05-30T16:52:12.778545+0000","last_became_peered":"2024-05-30T16:52:12.778545+0000","last_unstale":"2024-05-30T16:52:14.297785+0000","last_undegraded":"2024-05-30T16:52:14.297785+0000","last_fullsized":"2024-05-30T16:52:14.297785+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:39.009654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767815+0000","last_change":"2024-05-30T16:52:11.763269+0000","last_active":"2024-05-30T16:52:13.767815+0000","last_peered":"2024-05-30T16:52:13.767815+0000","last_clean":"2024-05-30T16:52:13.767815+0000","last_became_active":"2024-05-30T16:52:11.762926+0000","last_became_peered":"2024-05-30T16:52:11.762926+0000","last_unstale":"2024-05-30T16:52:13.767815+0000","last_undegraded":"2024-05-30T16:52:13.767815+0000","last_fullsized":"2024-05-30T16:52:13.767815+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:13.517575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767708+0000","last_change":"2024-05-30T16:52:12.780163+0000","last_active":"2024-05-30T16:52:13.767708+0000","last_peered":"2024-05-30T16:52:13.767708+0000","last_clean":"2024-05-30T16:52:13.767708+0000","last_became_active":"2024-05-30T16:52:12.779888+0000","last_became_peered":"2024-05-30T16:52:12.779888+0000","last_unstale":"2024-05-30T16:52:13.767708+0000","last_undegraded":"2024-05-30T16:52:13.767708+0000","last_fullsized":"2024-05-30T16:52:13.767708+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:26:06.097284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.772522+0000","last_change":"2024-05-30T16:52:11.761194+0000","last_active":"2024-05-30T16:52:13.772522+0000","last_peered":"2024-05-30T16:52:13.772522+0000","last_clean":"2024-05-30T16:52:13.772522+0000","last_became_active":"2024-05-30T16:52:11.760872+0000","last_became_peered":"2024-05-30T16:52:11.760872+0000","last_unstale":"2024-05-30T16:52:13.772522+0000","last_undegraded":"2024-05-30T16:52:13.772522+0000","last_fullsized":"2024-05-30T16:52:13.772522+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:47:42.557576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298128+0000","last_change":"2024-05-30T16:52:12.763798+0000","last_active":"2024-05-30T16:52:14.298128+0000","last_peered":"2024-05-30T16:52:14.298128+0000","last_clean":"2024-05-30T16:52:14.298128+0000","last_became_active":"2024-05-30T16:52:12.763310+0000","last_became_peered":"2024-05-30T16:52:12.763310+0000","last_unstale":"2024-05-30T16:52:14.298128+0000","last_undegraded":"2024-05-30T16:52:14.298128+0000","last_fullsized":"2024-05-30T16:52:14.298128+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:20:22.951037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767586+0000","last_change":"2024-05-30T16:52:11.758596+0000","last_active":"2024-05-30T16:52:13.767586+0000","last_peered":"2024-05-30T16:52:13.767586+0000","last_clean":"2024-05-30T16:52:13.767586+0000","last_became_active":"2024-05-30T16:52:11.758334+0000","last_became_peered":"2024-05-30T16:52:11.758334+0000","last_unstale":"2024-05-30T16:52:13.767586+0000","last_undegraded":"2024-05-30T16:52:13.767586+0000","last_fullsized":"2024-05-30T16:52:13.767586+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:08.049617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.298016+0000","last_change":"2024-05-30T16:52:12.775324+0000","last_active":"2024-05-30T16:52:14.298016+0000","last_peered":"2024-05-30T16:52:14.298016+0000","last_clean":"2024-05-30T16:52:14.298016+0000","last_became_active":"2024-05-30T16:52:12.774192+0000","last_became_peered":"2024-05-30T16:52:12.774192+0000","last_unstale":"2024-05-30T16:52:14.298016+0000","last_undegraded":"2024-05-30T16:52:14.298016+0000","last_fullsized":"2024-05-30T16:52:14.298016+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:02:30.718470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297069+0000","last_change":"2024-05-30T16:52:11.762668+0000","last_active":"2024-05-30T16:52:14.297069+0000","last_peered":"2024-05-30T16:52:14.297069+0000","last_clean":"2024-05-30T16:52:14.297069+0000","last_became_active":"2024-05-30T16:52:11.761436+0000","last_became_peered":"2024-05-30T16:52:11.761436+0000","last_unstale":"2024-05-30T16:52:14.297069+0000","last_undegraded":"2024-05-30T16:52:14.297069+0000","last_fullsized":"2024-05-30T16:52:14.297069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:53:42.663244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767622+0000","last_change":"2024-05-30T16:52:12.764044+0000","last_active":"2024-05-30T16:52:13.767622+0000","last_peered":"2024-05-30T16:52:13.767622+0000","last_clean":"2024-05-30T16:52:13.767622+0000","last_became_active":"2024-05-30T16:52:12.763816+0000","last_became_peered":"2024-05-30T16:52:12.763816+0000","last_unstale":"2024-05-30T16:52:13.767622+0000","last_undegraded":"2024-05-30T16:52:13.767622+0000","last_fullsized":"2024-05-30T16:52:13.767622+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:36.741444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.772345+0000","last_change":"2024-05-30T16:52:11.761404+0000","last_active":"2024-05-30T16:52:13.772345+0000","last_peered":"2024-05-30T16:52:13.772345+0000","last_clean":"2024-05-30T16:52:13.772345+0000","last_became_active":"2024-05-30T16:52:11.761125+0000","last_became_peered":"2024-05-30T16:52:11.761125+0000","last_unstale":"2024-05-30T16:52:13.772345+0000","last_undegraded":"2024-05-30T16:52:13.772345+0000","last_fullsized":"2024-05-30T16:52:13.772345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:35.144180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296233+0000","last_change":"2024-05-30T16:52:12.764177+0000","last_active":"2024-05-30T16:52:14.296233+0000","last_peered":"2024-05-30T16:52:14.296233+0000","last_clean":"2024-05-30T16:52:14.296233+0000","last_became_active":"2024-05-30T16:52:12.763851+0000","last_became_peered":"2024-05-30T16:52:12.763851+0000","last_unstale":"2024-05-30T16:52:14.296233+0000","last_undegraded":"2024-05-30T16:52:14.296233+0000","last_fullsized":"2024-05-30T16:52:14.296233+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:54.275397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.296929+0000","last_change":"2024-05-30T16:52:11.771973+0000","last_active":"2024-05-30T16:52:14.296929+0000","last_peered":"2024-05-30T16:52:14.296929+0000","last_clean":"2024-05-30T16:52:14.296929+0000","last_became_active":"2024-05-30T16:52:11.771710+0000","last_became_peered":"2024-05-30T16:52:11.771710+0000","last_unstale":"2024-05-30T16:52:14.296929+0000","last_undegraded":"2024-05-30T16:52:14.296929+0000","last_fullsized":"2024-05-30T16:52:14.296929+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:39:59.372560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:14.297567+0000","last_change":"2024-05-30T16:52:12.780849+0000","last_active":"2024-05-30T16:52:14.297567+0000","last_peered":"2024-05-30T16:52:14.297567+0000","last_clean":"2024-05-30T16:52:14.297567+0000","last_became_active":"2024-05-30T16:52:12.776309+0000","last_became_peered":"2024-05-30T16:52:12.776309+0000","last_unstale":"2024-05-30T16:52:14.297567+0000","last_undegraded":"2024-05-30T16:52:14.297567+0000","last_fullsized":"2024-05-30T16:52:14.297567+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:11.734755+0000","last_clean_scrub_stamp":"2024-05-30T16:52:11.734755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:08:43.759500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.768274+0000","last_change":"2024-05-30T16:52:11.759259+0000","last_active":"2024-05-30T16:52:13.768274+0000","last_peered":"2024-05-30T16:52:13.768274+0000","last_clean":"2024-05-30T16:52:13.768274+0000","last_became_active":"2024-05-30T16:52:11.758515+0000","last_became_peered":"2024-05-30T16:52:11.758515+0000","last_unstale":"2024-05-30T16:52:13.768274+0000","last_undegraded":"2024-05-30T16:52:13.768274+0000","last_fullsized":"2024-05-30T16:52:13.768274+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:52:10.729975+0000","last_clean_scrub_stamp":"2024-05-30T16:52:10.729975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:19:41.036951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":215,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-30T16:52:13.767184+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:52:13.767184+0000","last_peered":"2024-05-30T16:52:13.767184+0000","last_clean":"2024-05-30T16:52:13.767184+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:52:13.767184+0000","last_undegraded":"2024-05-30T16:52:13.767184+0000","last_fullsized":"2024-05-30T16:52:13.767184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36460,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335380,"statfs":{"total":96636764160,"available":96599429120,"internally_reserved":0,"allocated":1142784,"data_stored":809832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509484,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":552960,"data_stored":220046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35880,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":548864,"data_stored":219444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35888,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335952,"statfs":{"total":96636764160,"available":96600014848,"internally_reserved":0,"allocated":557056,"data_stored":220986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509484,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35892,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335948,"statfs":{"total":96636764160,"available":96600010752,"internally_reserved":0,"allocated":561152,"data_stored":221008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35876,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335964,"statfs":{"total":96636764160,"available":96600027136,"internally_reserved":0,"allocated":548864,"data_stored":219444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1142784,"data_stored":809776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35884,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335956,"statfs":{"total":96636764160,"available":96600018944,"internally_reserved":0,"allocated":557056,"data_stored":220012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:52:21.851 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:52:21.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T16:52:22.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.037+0000 7fc42f800640 1 Processor -- start 2024-05-30T16:52:22.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.037+0000 7fc42f800640 1 -- start start 2024-05-30T16:52:22.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.041+0000 7fc42f800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc42815e940 0x7fc42806ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:22.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.041+0000 7fc42f800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc42815ed20 con 0x7fc4280b18c0 2024-05-30T16:52:22.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.041+0000 7fc42f800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4280d0830 con 0x7fc4280af230 2024-05-30T16:52:22.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.041+0000 7fc42f800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc4280d10f0 con 0x7fc42815e940 2024-05-30T16:52:22.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.041+0000 7fc42ce00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc42815e940 0x7fc42806ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:22.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.041+0000 7fc427e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc4280b18c0 0x7fc4280d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57184/0 (socket says 172.21.15.59:57184) 2024-05-30T16:52:22.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.041+0000 7fc427e00640 1 -- 172.21.15.59:0/2980087958 learned_addr learned my addr 172.21.15.59:0/2980087958 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:22.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.041+0000 7fc42ce00640 1 -- 172.21.15.59:0/2980087958 >> v1:172.21.15.107:6789/0 conn(0x7fc4280af230 legacy=0x7fc42809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.041+0000 7fc42ce00640 1 -- 172.21.15.59:0/2980087958 >> v1:172.21.15.59:6789/0 conn(0x7fc4280b18c0 legacy=0x7fc4280d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.041+0000 7fc42ce00640 1 -- 172.21.15.59:0/2980087958 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4280b1d00 con 0x7fc42815e940 2024-05-30T16:52:22.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42ce00640 1 --2- 172.21.15.59:0/2980087958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42815e940 0x7fc42806ffe0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0097c0 tx=0x7fc41c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f071acf9ac6919b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:22.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc427400640 1 -- 172.21.15.59:0/2980087958 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c0b5070 con 0x7fc42815e940 2024-05-30T16:52:22.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc427400640 1 -- 172.21.15.59:0/2980087958 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc41c0a8990 con 0x7fc42815e940 2024-05-30T16:52:22.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc427400640 1 -- 172.21.15.59:0/2980087958 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c0a8d60 con 0x7fc42815e940 2024-05-30T16:52:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 -- 172.21.15.59:0/2980087958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42815e940 msgr2=0x7fc42806ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 --2- 172.21.15.59:0/2980087958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42815e940 0x7fc42806ffe0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0097c0 tx=0x7fc41c01ec90 comp rx=0 tx=0).stop 2024-05-30T16:52:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 -- 172.21.15.59:0/2980087958 shutdown_connections 2024-05-30T16:52:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 --2- 172.21.15.59:0/2980087958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42815e940 0x7fc42806ffe0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 -- 172.21.15.59:0/2980087958 >> 172.21.15.59:0/2980087958 conn(0x7fc4280b3f70 msgr2=0x7fc4280b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 -- 172.21.15.59:0/2980087958 shutdown_connections 2024-05-30T16:52:22.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 -- 172.21.15.59:0/2980087958 wait complete. 2024-05-30T16:52:22.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 Processor -- start 2024-05-30T16:52:22.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 -- start start 2024-05-30T16:52:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4280af230 0x7fc42815a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4280b18c0 0x7fc4280c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42815e940 0x7fc4280c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc4280d0d80 con 0x7fc42815e940 2024-05-30T16:52:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc4280d0aa0 con 0x7fc4280b18c0 2024-05-30T16:52:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42f800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc4280d1c90 con 0x7fc4280af230 2024-05-30T16:52:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.045+0000 7fc42d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42815e940 0x7fc4280c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42815e940 0x7fc4280c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54568/0 (socket says 172.21.15.59:54568) 2024-05-30T16:52:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42d800640 1 -- 172.21.15.59:0/2401048703 learned_addr learned my addr 172.21.15.59:0/2401048703 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc427e00640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4280b18c0 0x7fc4280c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42ce00640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4280af230 0x7fc42815a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42d800640 1 -- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4280af230 msgr2=0x7fc42815a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42d800640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4280af230 0x7fc42815a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42d800640 1 -- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4280b18c0 msgr2=0x7fc4280c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42d800640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4280b18c0 0x7fc4280c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42d800640 1 -- 172.21.15.59:0/2401048703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42815f930 con 0x7fc42815e940 2024-05-30T16:52:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc427e00640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4280b18c0 0x7fc4280c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42ce00640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4280af230 0x7fc42815a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42d800640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42815e940 0x7fc4280c64b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c730 tx=0x7fc42000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc424c00640 1 -- 172.21.15.59:0/2401048703 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420003b80 con 0x7fc42815e940 2024-05-30T16:52:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc424c00640 1 -- 172.21.15.59:0/2401048703 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc420003d20 con 0x7fc42815e940 2024-05-30T16:52:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc424c00640 1 -- 172.21.15.59:0/2401048703 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42000aa30 con 0x7fc42815e940 2024-05-30T16:52:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42f800640 1 -- 172.21.15.59:0/2401048703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42815fc10 con 0x7fc42815e940 2024-05-30T16:52:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42f800640 1 -- 172.21.15.59:0/2401048703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4281601d0 con 0x7fc42815e940 2024-05-30T16:52:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc42f800640 1 -- 172.21.15.59:0/2401048703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc428068a90 con 0x7fc42815e940 2024-05-30T16:52:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.049+0000 7fc424c00640 1 -- 172.21.15.59:0/2401048703 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fc42000abd0 con 0x7fc42815e940 2024-05-30T16:52:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.053+0000 7fc424c00640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc408068650 0x7fc40806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.053+0000 7fc424c00640 1 -- 172.21.15.59:0/2401048703 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7fc420086c80 con 0x7fc42815e940 2024-05-30T16:52:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.053+0000 7fc42ce00640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc408068650 0x7fc40806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:22.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.053+0000 7fc42ce00640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc408068650 0x7fc40806ab10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0b2000 tx=0x7fc41c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:22.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.057+0000 7fc424c00640 1 -- 172.21.15.59:0/2401048703 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc420056f20 con 0x7fc42815e940 2024-05-30T16:52:22.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.281+0000 7fc42f800640 1 -- 172.21.15.59:0/2401048703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc4280b4da0 con 0x7fc42815e940 2024-05-30T16:52:22.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.281+0000 7fc424c00640 1 -- 172.21.15.59:0/2401048703 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7fc420056820 con 0x7fc42815e940 2024-05-30T16:52:22.284 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-05-30T16:52:22.285 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA== 2024-05-30T16:52:22.285 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-05-30T16:52:22.285 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-05-30T16:52:22.285 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T16:52:22.285 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-05-30T16:52:22.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.285+0000 7fc42f800640 1 -- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc408068650 msgr2=0x7fc40806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.285+0000 7fc42f800640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc408068650 0x7fc40806ab10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0b2000 tx=0x7fc41c008040 comp rx=0 tx=0).stop 2024-05-30T16:52:22.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.285+0000 7fc42f800640 1 -- 172.21.15.59:0/2401048703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42815e940 msgr2=0x7fc4280c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.285+0000 7fc42f800640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42815e940 0x7fc4280c64b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c730 tx=0x7fc42000cbf0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.285+0000 7fc42f800640 1 -- 172.21.15.59:0/2401048703 shutdown_connections 2024-05-30T16:52:22.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.285+0000 7fc42f800640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc408068650 0x7fc40806ab10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.285+0000 7fc42f800640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42815e940 0x7fc4280c64b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.285+0000 7fc42f800640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4280b18c0 0x7fc4280c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.285+0000 7fc42f800640 1 --2- 172.21.15.59:0/2401048703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4280af230 0x7fc42815a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.285+0000 7fc42f800640 1 -- 172.21.15.59:0/2401048703 >> 172.21.15.59:0/2401048703 conn(0x7fc4280b3f70 msgr2=0x7fc4280b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:22.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.285+0000 7fc42f800640 1 -- 172.21.15.59:0/2401048703 shutdown_connections 2024-05-30T16:52:22.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.285+0000 7fc42f800640 1 -- 172.21.15.59:0/2401048703 wait complete. 2024-05-30T16:52:22.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:52:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.445+0000 7f7230000640 1 Processor -- start 2024-05-30T16:52:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.445+0000 7f7230000640 1 -- start start 2024-05-30T16:52:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.445+0000 7f7230000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72280ad8c0 0x7f722815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.445+0000 7f7230000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f722815a1d0 0x7f722815cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.445+0000 7f7230000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f722815d730 con 0x7f7228159df0 2024-05-30T16:52:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.445+0000 7f7230000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f722815d4f0 con 0x7f72280ad8c0 2024-05-30T16:52:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.445+0000 7f7230000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f72280b3370 con 0x7f722815a1d0 2024-05-30T16:52:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.445+0000 7f722d600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7228159df0 0x7f72280ad1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57196/0 (socket says 172.21.15.59:57196) 2024-05-30T16:52:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.445+0000 7f722cc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72280ad8c0 0x7f722815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.445+0000 7f722d600640 1 -- 172.21.15.59:0/2930172779 learned_addr learned my addr 172.21.15.59:0/2930172779 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.445+0000 7f722e000640 1 --2- 172.21.15.59:0/2930172779 >> v2:172.21.15.107:3300/0 conn(0x7f722815a1d0 0x7f722815cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f722cc00640 1 -- 172.21.15.59:0/2930172779 >> v2:172.21.15.107:3300/0 conn(0x7f722815a1d0 msgr2=0x7f722815cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f722cc00640 1 --2- 172.21.15.59:0/2930172779 >> v2:172.21.15.107:3300/0 conn(0x7f722815a1d0 0x7f722815cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f722cc00640 1 -- 172.21.15.59:0/2930172779 >> v1:172.21.15.59:6789/0 conn(0x7f7228159df0 legacy=0x7f72280ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f722cc00640 1 -- 172.21.15.59:0/2930172779 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72280b3650 con 0x7f72280ad8c0 2024-05-30T16:52:22.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f722cc00640 1 --2- 172.21.15.59:0/2930172779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72280ad8c0 0x7f722815ca70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f72280add30 tx=0x7f721401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfe8f067ac868fe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:22.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f7227e00640 1 -- 172.21.15.59:0/2930172779 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72140b1070 con 0x7f72280ad8c0 2024-05-30T16:52:22.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f7227e00640 1 -- 172.21.15.59:0/2930172779 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72140ac5f0 con 0x7f72280ad8c0 2024-05-30T16:52:22.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f7227e00640 1 -- 172.21.15.59:0/2930172779 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72140ac9c0 con 0x7f72280ad8c0 2024-05-30T16:52:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f7230000640 1 -- 172.21.15.59:0/2930172779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72280ad8c0 msgr2=0x7f722815ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f7230000640 1 --2- 172.21.15.59:0/2930172779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72280ad8c0 0x7f722815ca70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f72280add30 tx=0x7f721401c480 comp rx=0 tx=0).stop 2024-05-30T16:52:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f7230000640 1 -- 172.21.15.59:0/2930172779 shutdown_connections 2024-05-30T16:52:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f7230000640 1 --2- 172.21.15.59:0/2930172779 >> v2:172.21.15.107:3300/0 conn(0x7f722815a1d0 0x7f722815cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f7230000640 1 --2- 172.21.15.59:0/2930172779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72280ad8c0 0x7f722815ca70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f7230000640 1 -- 172.21.15.59:0/2930172779 >> 172.21.15.59:0/2930172779 conn(0x7f72280b22d0 msgr2=0x7f72280b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f7230000640 1 -- 172.21.15.59:0/2930172779 shutdown_connections 2024-05-30T16:52:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.449+0000 7f7230000640 1 -- 172.21.15.59:0/2930172779 wait complete. 2024-05-30T16:52:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7230000640 1 Processor -- start 2024-05-30T16:52:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7230000640 1 -- start start 2024-05-30T16:52:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7230000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72280ad8c0 0x7f722814abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7230000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7228159df0 0x7f722814e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7230000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f722815a1d0 0x7f72280738c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7230000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f722815e760 con 0x7f722815a1d0 2024-05-30T16:52:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7230000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f722815e5e0 con 0x7f7228159df0 2024-05-30T16:52:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7230000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f722815e8e0 con 0x7f72280ad8c0 2024-05-30T16:52:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f722e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f722815a1d0 0x7f72280738c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f722e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f722815a1d0 0x7f72280738c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54586/0 (socket says 172.21.15.59:54586) 2024-05-30T16:52:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f722e000640 1 -- 172.21.15.59:0/21189104 learned_addr learned my addr 172.21.15.59:0/21189104 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f722d600640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72280ad8c0 0x7f722814abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f722cc00640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7228159df0 0x7f722814e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f722e000640 1 -- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72280ad8c0 msgr2=0x7f722814abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f722e000640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72280ad8c0 0x7f722814abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f722e000640 1 -- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7228159df0 msgr2=0x7f722814e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f722e000640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7228159df0 0x7f722814e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f722e000640 1 -- 172.21.15.59:0/21189104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72281502a0 con 0x7f722815a1d0 2024-05-30T16:52:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f722e000640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f722815a1d0 0x7f72280738c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7220009fd0 tx=0x7f722000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7225600640 1 -- 172.21.15.59:0/21189104 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220014420 con 0x7f722815a1d0 2024-05-30T16:52:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7225600640 1 -- 172.21.15.59:0/21189104 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7220019070 con 0x7f722815a1d0 2024-05-30T16:52:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7225600640 1 -- 172.21.15.59:0/21189104 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220014800 con 0x7f722815a1d0 2024-05-30T16:52:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7230000640 1 -- 172.21.15.59:0/21189104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7228150540 con 0x7f722815a1d0 2024-05-30T16:52:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.453+0000 7f7230000640 1 -- 172.21.15.59:0/21189104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7228160280 con 0x7f722815a1d0 2024-05-30T16:52:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.457+0000 7f7230000640 1 -- 172.21.15.59:0/21189104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7228068a90 con 0x7f722815a1d0 2024-05-30T16:52:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.457+0000 7f7225600640 1 -- 172.21.15.59:0/21189104 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f72200149a0 con 0x7f722815a1d0 2024-05-30T16:52:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.457+0000 7f7225600640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7208068650 0x7f720806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.457+0000 7f7225600640 1 -- 172.21.15.59:0/21189104 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7f7220087550 con 0x7f722815a1d0 2024-05-30T16:52:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.457+0000 7f722d600640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7208068650 0x7f720806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.457+0000 7f722d600640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7208068650 0x7f720806ab10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f721c000f70 tx=0x7f721c007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:22.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.461+0000 7f7225600640 1 -- 172.21.15.59:0/21189104 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7220057110 con 0x7f722815a1d0 2024-05-30T16:52:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.657+0000 7f7230000640 1 -- 172.21.15.59:0/21189104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72281671d0 con 0x7f722815a1d0 2024-05-30T16:52:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7225600640 1 -- 172.21.15.59:0/21189104 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5187 (secure 0 0 0) 0x7f722005b410 con 0x7f722815a1d0 2024-05-30T16:52:22.661 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:52:22.662 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4919,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2045783783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2045783783},{"type":"v1","addr":"172.21.15.107:6836","nonce":2045783783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4922,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3405430037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3405430037},{"type":"v1","addr":"172.21.15.107:6837","nonce":3405430037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3338903229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3338903229},{"type":"v1","addr":"172.21.15.59:6834","nonce":3338903229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:52:12.149964+0000","modified":"2024-05-30T16:52:15.176696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3019371755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3019371755},{"type":"v1","addr":"172.21.15.59:6835","nonce":3019371755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-05-30T16:52:22.662 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 25 2024-05-30T16:52:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7230000640 1 -- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7208068650 msgr2=0x7f720806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7230000640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7208068650 0x7f720806ab10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f721c000f70 tx=0x7f721c007e90 comp rx=0 tx=0).stop 2024-05-30T16:52:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7230000640 1 -- 172.21.15.59:0/21189104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f722815a1d0 msgr2=0x7f72280738c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7230000640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f722815a1d0 0x7f72280738c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7220009fd0 tx=0x7f722000e4b0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7230000640 1 -- 172.21.15.59:0/21189104 shutdown_connections 2024-05-30T16:52:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7230000640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7208068650 0x7f720806ab10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7230000640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f722815a1d0 0x7f72280738c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7230000640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7228159df0 0x7f722814e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7230000640 1 --2- 172.21.15.59:0/21189104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72280ad8c0 0x7f722814abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7230000640 1 -- 172.21.15.59:0/21189104 >> 172.21.15.59:0/21189104 conn(0x7f72280b22d0 msgr2=0x7f722815c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7230000640 1 -- 172.21.15.59:0/21189104 shutdown_connections 2024-05-30T16:52:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:22.661+0000 7f7230000640 1 -- 172.21.15.59:0/21189104 wait complete. 2024-05-30T16:52:23.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T16:52:12.149964+0000', 'modified': '2024-05-30T16:52:15.176696+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5304}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5304': {'gid': 5304, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/3019371755', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 3019371755}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 3019371755}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5304, 'qdb_cluster': [5304]} 2024-05-30T16:52:23.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T16:52:23.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-30T16:52:23.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.225+0000 7f06c6200640 1 Processor -- start 2024-05-30T16:52:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.225+0000 7f06c6200640 1 -- start start 2024-05-30T16:52:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06c6200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f06c0159df0 0x7f06c00ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06c6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06c015a1d0 0x7f06c00ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06c6200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06c00b3e50 0x7f06c015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06c6200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f06c015d730 con 0x7f06c00b3e50 2024-05-30T16:52:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06c6200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f06c00b3370 con 0x7f06c0159df0 2024-05-30T16:52:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06c6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f06c00b3650 con 0x7f06c015a1d0 2024-05-30T16:52:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06bfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06c00b3e50 0x7f06c015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06bfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06c00b3e50 0x7f06c015ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54592/0 (socket says 172.21.15.59:54592) 2024-05-30T16:52:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06bfe00640 1 -- 172.21.15.59:0/248667466 learned_addr learned my addr 172.21.15.59:0/248667466 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06bfe00640 1 -- 172.21.15.59:0/248667466 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06c015a1d0 msgr2=0x7f06c00ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06bfe00640 1 --2- 172.21.15.59:0/248667466 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06c015a1d0 0x7f06c00ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06bfe00640 1 -- 172.21.15.59:0/248667466 >> v2:172.21.15.107:3300/0 conn(0x7f06c0159df0 msgr2=0x7f06c00ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06bfe00640 1 --2- 172.21.15.59:0/248667466 >> v2:172.21.15.107:3300/0 conn(0x7f06c0159df0 0x7f06c00ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.229+0000 7f06bfe00640 1 -- 172.21.15.59:0/248667466 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c00b3930 con 0x7f06c00b3e50 2024-05-30T16:52:23.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06bfe00640 1 --2- 172.21.15.59:0/248667466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c00b3e50 0x7f06c015ca70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f06c00b3580 tx=0x7f06b801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03cffe70898e5ec server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:23.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06bea00640 1 -- 172.21.15.59:0/248667466 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b80a5780 con 0x7f06c00b3e50 2024-05-30T16:52:23.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06bea00640 1 -- 172.21.15.59:0/248667466 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b80a5920 con 0x7f06c00b3e50 2024-05-30T16:52:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06bea00640 1 -- 172.21.15.59:0/248667466 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b80a5cf0 con 0x7f06c00b3e50 2024-05-30T16:52:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06c6200640 1 -- 172.21.15.59:0/248667466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c00b3e50 msgr2=0x7f06c015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06c6200640 1 --2- 172.21.15.59:0/248667466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c00b3e50 0x7f06c015ca70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f06c00b3580 tx=0x7f06b801c9f0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06c6200640 1 -- 172.21.15.59:0/248667466 shutdown_connections 2024-05-30T16:52:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06c6200640 1 --2- 172.21.15.59:0/248667466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c00b3e50 0x7f06c015ca70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06c6200640 1 --2- 172.21.15.59:0/248667466 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06c015a1d0 0x7f06c00ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06c6200640 1 --2- 172.21.15.59:0/248667466 >> v2:172.21.15.107:3300/0 conn(0x7f06c0159df0 0x7f06c00ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06c6200640 1 -- 172.21.15.59:0/248667466 >> 172.21.15.59:0/248667466 conn(0x7f06c00b22d0 msgr2=0x7f06c00b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06c6200640 1 -- 172.21.15.59:0/248667466 shutdown_connections 2024-05-30T16:52:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06c6200640 1 -- 172.21.15.59:0/248667466 wait complete. 2024-05-30T16:52:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06c6200640 1 Processor -- start 2024-05-30T16:52:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.233+0000 7f06c6200640 1 -- start start 2024-05-30T16:52:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06c6200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c00b3e50 0x7f06c0160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06c6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06c0159df0 0x7f06c01493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06c6200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06c015a1d0 0x7f06c0071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06c6200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06c015e760 con 0x7f06c00b3e50 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06c6200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f06c015e5e0 con 0x7f06c015a1d0 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06c6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f06c015e8e0 con 0x7f06c0159df0 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06bf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c00b3e50 0x7f06c0160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06bf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c00b3e50 0x7f06c0160220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54604/0 (socket says 172.21.15.59:54604) 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06bf400640 1 -- 172.21.15.59:0/2122413632 learned_addr learned my addr 172.21.15.59:0/2122413632 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06bfe00640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06c015a1d0 0x7f06c0071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06b7e00640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06c0159df0 0x7f06c01493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06bf400640 1 -- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06c0159df0 msgr2=0x7f06c01493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06bf400640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06c0159df0 0x7f06c01493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06bf400640 1 -- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06c015a1d0 msgr2=0x7f06c0071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06bf400640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06c015a1d0 0x7f06c0071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06bf400640 1 -- 172.21.15.59:0/2122413632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c015c010 con 0x7f06c00b3e50 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06bf400640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c00b3e50 0x7f06c0160220 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f06b000b580 tx=0x7f06b000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06b7400640 1 -- 172.21.15.59:0/2122413632 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0014070 con 0x7f06c00b3e50 2024-05-30T16:52:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06b7400640 1 -- 172.21.15.59:0/2122413632 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b0010890 con 0x7f06c00b3e50 2024-05-30T16:52:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06b7400640 1 -- 172.21.15.59:0/2122413632 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0010c80 con 0x7f06c00b3e50 2024-05-30T16:52:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06c6200640 1 -- 172.21.15.59:0/2122413632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c015c2f0 con 0x7f06c00b3e50 2024-05-30T16:52:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06c6200640 1 -- 172.21.15.59:0/2122413632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c00b0d50 con 0x7f06c00b3e50 2024-05-30T16:52:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.237+0000 7f06b7400640 1 -- 172.21.15.59:0/2122413632 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f06b0017070 con 0x7f06c00b3e50 2024-05-30T16:52:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7400640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f069c068650 0x7f069c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7400640 1 -- 172.21.15.59:0/2122413632 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7f06b0086c70 con 0x7f06c00b3e50 2024-05-30T16:52:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7e00640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f069c068650 0x7f069c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06c9692000 1 Processor -- start 2024-05-30T16:52:23.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06c9692000 1 -- start start 2024-05-30T16:52:23.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7e00640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f069c068650 0x7f069c06ab10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f06a8006fd0 tx=0x7f06a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06c9692000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529120 0x5619e0529500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06c9692000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 0x5619e04dc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06c9692000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e04dc650 0x5619e04dca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06c9692000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5619e032d420 con 0x5619e0529a40 2024-05-30T16:52:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06c9692000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5619e02c7bf0 con 0x5619e04dc650 2024-05-30T16:52:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06c9692000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5619e03293e0 con 0x5619e0529120 2024-05-30T16:52:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 0x5619e04dc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 0x5619e04dc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54620/0 (socket says 172.21.15.59:54620) 2024-05-30T16:52:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7e00640 1 -- 172.21.15.59:0/687791472 learned_addr learned my addr 172.21.15.59:0/687791472 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06bfe00640 1 --2- 172.21.15.59:0/687791472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e04dc650 0x5619e04dca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06bf400640 1 --2- 172.21.15.59:0/687791472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529120 0x5619e0529500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7e00640 1 -- 172.21.15.59:0/687791472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529120 msgr2=0x5619e0529500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7e00640 1 --2- 172.21.15.59:0/687791472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529120 0x5619e0529500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7e00640 1 -- 172.21.15.59:0/687791472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e04dc650 msgr2=0x5619e04dca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7e00640 1 --2- 172.21.15.59:0/687791472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e04dc650 0x5619e04dca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7e00640 1 -- 172.21.15.59:0/687791472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619e03d5450 con 0x5619e0529a40 2024-05-30T16:52:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06bfe00640 1 --2- 172.21.15.59:0/687791472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e04dc650 0x5619e04dca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06bf400640 1 --2- 172.21.15.59:0/687791472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529120 0x5619e0529500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06b7e00640 1 --2- 172.21.15.59:0/687791472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 0x5619e04dc110 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f06a800d7e0 tx=0x7f06a8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62ef17b2f26c844 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:23.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.241+0000 7f06afe00640 1 -- 172.21.15.59:0/687791472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a8024070 con 0x5619e0529a40 2024-05-30T16:52:23.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06afe00640 1 -- 172.21.15.59:0/687791472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a80149b0 con 0x5619e0529a40 2024-05-30T16:52:23.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06afe00640 1 -- 172.21.15.59:0/687791472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a8014d60 con 0x5619e0529a40 2024-05-30T16:52:23.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 -- 172.21.15.59:0/687791472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 msgr2=0x5619e04dc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 --2- 172.21.15.59:0/687791472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 0x5619e04dc110 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f06a800d7e0 tx=0x7f06a8010000 comp rx=0 tx=0).stop 2024-05-30T16:52:23.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 -- 172.21.15.59:0/687791472 shutdown_connections 2024-05-30T16:52:23.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 --2- 172.21.15.59:0/687791472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e04dc650 0x5619e04dca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 --2- 172.21.15.59:0/687791472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 0x5619e04dc110 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 --2- 172.21.15.59:0/687791472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529120 0x5619e0529500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 -- 172.21.15.59:0/687791472 >> 172.21.15.59:0/687791472 conn(0x5619e0509ec0 msgr2=0x5619e050c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 -- 172.21.15.59:0/687791472 shutdown_connections 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 -- 172.21.15.59:0/687791472 wait complete. 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 -- start start 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 Processor -- start 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e04dc650 0x5619e05288b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529120 0x5619e04e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 0x5619e04e20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5619e02cdec0 con 0x5619e0529a40 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5619e03ae120 con 0x5619e0529120 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5619e0338350 con 0x5619e04dc650 2024-05-30T16:52:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06c9692000 10 client.0 _ll_register_callbacks cb 0x5619e030a4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:52:23.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 0x5619e04e20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 0x5619e04e20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54636/0 (socket says 172.21.15.59:54636) 2024-05-30T16:52:23.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06bfe00640 1 -- 172.21.15.59:0/483359193 learned_addr learned my addr 172.21.15.59:0/483359193 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:23.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06bf400640 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e04dc650 0x5619e05288b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06b7e00640 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529120 0x5619e04e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06bfe00640 1 -- 172.21.15.59:0/483359193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e04dc650 msgr2=0x5619e05288b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:23.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06bfe00640 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e04dc650 0x5619e05288b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06bfe00640 1 -- 172.21.15.59:0/483359193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529120 msgr2=0x5619e04e1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:23.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06bfe00640 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529120 0x5619e04e1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06bfe00640 1 -- 172.21.15.59:0/483359193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619e0372f80 con 0x5619e0529a40 2024-05-30T16:52:23.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06bfe00640 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 0x5619e04e20c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f06b801d290 tx=0x7f06b801b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4df7b94a4ff2f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.245+0000 7f06acc00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06acc00640 1 -- 172.21.15.59:0/483359193 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b80b63f0 con 0x5619e0529a40 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 -- 172.21.15.59:0/483359193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06a80149b0 con 0x5619e0529a40 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06acc00640 1 -- 172.21.15.59:0/483359193 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7f06b80c1ac0 con 0x5619e0529a40 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06acc00640 1 -- 172.21.15.59:0/483359193 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f06b80c1cc0 con 0x5619e0529a40 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 10 client.5466 fetch_fsmap learned FSMap version 25 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 -- 172.21.15.59:0/483359193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5619e0306f00 con 0x5619e0529a40 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06acc00640 1 -- 172.21.15.59:0/483359193 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a80149b0 con 0x5619e0529a40 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06acc00640 1 -- 172.21.15.59:0/483359193 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f06b80b6590 con 0x5619e0529a40 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 10 client.5466 fetch_fsmap finished waiting for FSMap version 25 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 10 client.5466 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 20 client.5466 populate_metadata read hostname 'smithi059' 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.59:6833/3019371755,v1:172.21.15.59:6835/3019371755] conn(0x5619e0538890 0x5619e053ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 4 client.5466 mds_command: new command op to 5304 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T16:52:23.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 -- 172.21.15.59:0/483359193 --> [v2:172.21.15.59:6833/3019371755,v1:172.21.15.59:6835/3019371755] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619e02c6bc0 con 0x5619e0538890 2024-05-30T16:52:23.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06bf400640 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.59:6833/3019371755,v1:172.21.15.59:6835/3019371755] conn(0x5619e0538890 0x5619e053ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06bf400640 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.59:6833/3019371755,v1:172.21.15.59:6835/3019371755] conn(0x5619e0538890 0x5619e053ac80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3aa60873ea85537 server_cookie=daa3ffa31f3c0086 in_seq=0 out_seq=0 2024-05-30T16:52:23.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06acc00640 10 client.5466 ms_handle_connect on v2:172.21.15.59:6833/3019371755 2024-05-30T16:52:23.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06acc00640 1 -- 172.21.15.59:0/483359193 <== mds.0 v2:172.21.15.59:6833/3019371755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5619e02c6bc0 con 0x5619e0538890 2024-05-30T16:52:23.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06acc00640 10 client.5466 handle_command_reply: tid=0 2024-05-30T16:52:23.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 client.5466 shutdown 2024-05-30T16:52:23.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 -- 172.21.15.59:0/483359193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 msgr2=0x5619e04e20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 0x5619e04e20c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f06b801d290 tx=0x7f06b801b230 comp rx=0 tx=0).stop 2024-05-30T16:52:23.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 -- 172.21.15.59:0/483359193 shutdown_connections 2024-05-30T16:52:23.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e0529a40 0x5619e04e20c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.59:6833/3019371755,v1:172.21.15.59:6835/3019371755] conn(0x5619e0538890 0x5619e053ac80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529120 0x5619e04e1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 --2- 172.21.15.59:0/483359193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e04dc650 0x5619e05288b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 -- 172.21.15.59:0/483359193 >> 172.21.15.59:0/483359193 conn(0x5619e0509ec0 msgr2=0x5619e050c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:23.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06acc00640 0 client.5466 ms_handle_reset on v2:172.21.15.59:6833/3019371755 2024-05-30T16:52:23.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 -- 172.21.15.59:0/483359193 shutdown_connections 2024-05-30T16:52:23.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 1 -- 172.21.15.59:0/483359193 wait complete. 2024-05-30T16:52:23.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.249+0000 7f06c9692000 20 client.5466 trim_cache size 0 max 16384 2024-05-30T16:52:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 Processor -- start 2024-05-30T16:52:23.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 -- start start 2024-05-30T16:52:23.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 0x5619e04db100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529120 0x5619e04db640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529a40 0x5619e053ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06c015b2d0 con 0x5619e04dc650 2024-05-30T16:52:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f06c015a630 con 0x5619e0529a40 2024-05-30T16:52:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f06c015ac80 con 0x5619e0529120 2024-05-30T16:52:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06bf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 0x5619e04db100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06bf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 0x5619e04db100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54638/0 (socket says 172.21.15.59:54638) 2024-05-30T16:52:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06bf400640 1 -- 172.21.15.59:0/15227655 learned_addr learned my addr 172.21.15.59:0/15227655 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06bfe00640 1 --2- 172.21.15.59:0/15227655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529a40 0x5619e053ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06b7e00640 1 --2- 172.21.15.59:0/15227655 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529120 0x5619e04db640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06bf400640 1 -- 172.21.15.59:0/15227655 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529120 msgr2=0x5619e04db640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06bf400640 1 --2- 172.21.15.59:0/15227655 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529120 0x5619e04db640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06bf400640 1 -- 172.21.15.59:0/15227655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529a40 msgr2=0x5619e053ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:23.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06bf400640 1 --2- 172.21.15.59:0/15227655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529a40 0x5619e053ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06bf400640 1 -- 172.21.15.59:0/15227655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619e02b3e80 con 0x5619e04dc650 2024-05-30T16:52:23.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06bf400640 1 --2- 172.21.15.59:0/15227655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 0x5619e04db100 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f06b0056690 tx=0x7f06b00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a814ddbb43926f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:23.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06af400640 1 -- 172.21.15.59:0/15227655 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0073070 con 0x5619e04dc650 2024-05-30T16:52:23.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06af400640 1 -- 172.21.15.59:0/15227655 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b0052d70 con 0x5619e04dc650 2024-05-30T16:52:23.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06af400640 1 -- 172.21.15.59:0/15227655 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b001e040 con 0x5619e04dc650 2024-05-30T16:52:23.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 -- 172.21.15.59:0/15227655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 msgr2=0x5619e04db100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 --2- 172.21.15.59:0/15227655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 0x5619e04db100 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f06b0056690 tx=0x7f06b00046d0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 -- 172.21.15.59:0/15227655 shutdown_connections 2024-05-30T16:52:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 --2- 172.21.15.59:0/15227655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529a40 0x5619e053ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 --2- 172.21.15.59:0/15227655 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529120 0x5619e04db640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 --2- 172.21.15.59:0/15227655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 0x5619e04db100 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 -- 172.21.15.59:0/15227655 >> 172.21.15.59:0/15227655 conn(0x5619e0509ec0 msgr2=0x5619e0527a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 -- 172.21.15.59:0/15227655 shutdown_connections 2024-05-30T16:52:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.269+0000 7f06c9692000 1 -- 172.21.15.59:0/15227655 wait complete. 2024-05-30T16:52:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 1 -- start start 2024-05-30T16:52:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 1 Processor -- start 2024-05-30T16:52:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 0x5619e053d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529120 0x5619e0554810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529a40 0x5619e0554d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5619e032c730 con 0x5619e04dc650 2024-05-30T16:52:23.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5619e02f99e0 con 0x5619e0529120 2024-05-30T16:52:23.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5619e0331a50 con 0x5619e0529a40 2024-05-30T16:52:23.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 10 client.0 _ll_register_callbacks cb 0x7f06b8009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:52:23.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06bf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 0x5619e053d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06bf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 0x5619e053d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54642/0 (socket says 172.21.15.59:54642) 2024-05-30T16:52:23.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06bf400640 1 -- 172.21.15.59:0/2040321036 learned_addr learned my addr 172.21.15.59:0/2040321036 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:23.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06b7e00640 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529120 0x5619e0554810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06bfe00640 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529a40 0x5619e0554d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06bf400640 1 -- 172.21.15.59:0/2040321036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529a40 msgr2=0x5619e0554d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:23.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06bf400640 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529a40 0x5619e0554d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06bf400640 1 -- 172.21.15.59:0/2040321036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529120 msgr2=0x5619e0554810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06bf400640 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529120 0x5619e0554810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06bf400640 1 -- 172.21.15.59:0/2040321036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619e02f5b30 con 0x5619e04dc650 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06bf400640 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 0x5619e053d850 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f06b0056400 tx=0x7f06b0075040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed4ba7564ebcd95 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06acc00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06acc00640 1 -- 172.21.15.59:0/2040321036 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b001e040 con 0x5619e04dc650 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06acc00640 1 -- 172.21.15.59:0/2040321036 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7f06b0076ce0 con 0x5619e04dc650 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 1 -- 172.21.15.59:0/2040321036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06b0052d70 con 0x5619e04dc650 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06acc00640 1 -- 172.21.15.59:0/2040321036 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f06b0073040 con 0x5619e04dc650 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 10 client.5472 fetch_fsmap learned FSMap version 25 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 1 -- 172.21.15.59:0/2040321036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5619e03ae5b0 con 0x5619e04dc650 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06acc00640 1 -- 172.21.15.59:0/2040321036 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b0052d70 con 0x5619e04dc650 2024-05-30T16:52:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06acc00640 1 -- 172.21.15.59:0/2040321036 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f06b0055b50 con 0x5619e04dc650 2024-05-30T16:52:23.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 10 client.5472 fetch_fsmap finished waiting for FSMap version 25 2024-05-30T16:52:23.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 10 client.5472 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T16:52:23.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 20 client.5472 populate_metadata read hostname 'smithi059' 2024-05-30T16:52:23.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.59:6833/3019371755,v1:172.21.15.59:6835/3019371755] conn(0x5619e0598480 0x5619e0598860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 4 client.5472 mds_command: new command op to 5304 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T16:52:23.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06c9692000 1 -- 172.21.15.59:0/2040321036 --> [v2:172.21.15.59:6833/3019371755,v1:172.21.15.59:6835/3019371755] -- command(tid 0: {"prefix": "status"}) -- 0x5619e033ae40 con 0x5619e0598480 2024-05-30T16:52:23.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06b7e00640 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.59:6833/3019371755,v1:172.21.15.59:6835/3019371755] conn(0x5619e0598480 0x5619e0598860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06b7e00640 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.59:6833/3019371755,v1:172.21.15.59:6835/3019371755] conn(0x5619e0598480 0x5619e0598860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11344507b86f1df7 server_cookie=5b712947d6d72b35 in_seq=0 out_seq=0 2024-05-30T16:52:23.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.273+0000 7f06acc00640 10 client.5472 ms_handle_connect on v2:172.21.15.59:6833/3019371755 2024-05-30T16:52:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06acc00640 1 -- 172.21.15.59:0/2040321036 <== mds.0 v2:172.21.15.59:6833/3019371755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5619e033ae40 con 0x5619e0598480 2024-05-30T16:52:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06acc00640 10 client.5472 handle_command_reply: tid=0 2024-05-30T16:52:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c9692000 1 client.5472 shutdown 2024-05-30T16:52:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c9692000 1 -- 172.21.15.59:0/2040321036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 msgr2=0x5619e053d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c9692000 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 0x5619e053d850 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f06b0056400 tx=0x7f06b0075040 comp rx=0 tx=0).stop 2024-05-30T16:52:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c9692000 1 -- 172.21.15.59:0/2040321036 shutdown_connections 2024-05-30T16:52:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c9692000 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5619e0529a40 0x5619e0554d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c9692000 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.59:6833/3019371755,v1:172.21.15.59:6835/3019371755] conn(0x5619e0598480 0x5619e0598860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c9692000 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619e0529120 0x5619e0554810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06acc00640 0 client.5472 ms_handle_reset on v2:172.21.15.59:6833/3019371755 2024-05-30T16:52:23.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c9692000 1 --2- 172.21.15.59:0/2040321036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619e04dc650 0x5619e053d850 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c9692000 1 -- 172.21.15.59:0/2040321036 >> 172.21.15.59:0/2040321036 conn(0x5619e0509ec0 msgr2=0x5619e04db100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:23.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c9692000 1 -- 172.21.15.59:0/2040321036 shutdown_connections 2024-05-30T16:52:23.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c9692000 1 -- 172.21.15.59:0/2040321036 wait complete. 2024-05-30T16:52:23.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c9692000 20 client.5472 trim_cache size 0 max 16384 2024-05-30T16:52:23.283 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:52:23.283 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:52:23.283 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-05-30T16:52:23.283 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5304, 2024-05-30T16:52:23.284 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-05-30T16:52:23.284 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-05-30T16:52:23.284 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-05-30T16:52:23.284 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 10.533879025999999, 2024-05-30T16:52:23.284 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 25, 2024-05-30T16:52:23.284 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 47, 2024-05-30T16:52:23.284 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 47, 2024-05-30T16:52:23.284 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 15.802898939 2024-05-30T16:52:23.284 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:52:23.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c6200640 1 -- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f069c068650 msgr2=0x7f069c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c6200640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f069c068650 0x7f069c06ab10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f06a8006fd0 tx=0x7f06a8008040 comp rx=0 tx=0).stop 2024-05-30T16:52:23.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c6200640 1 -- 172.21.15.59:0/2122413632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c00b3e50 msgr2=0x7f06c0160220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c6200640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c00b3e50 0x7f06c0160220 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f06b000b580 tx=0x7f06b000ba40 comp rx=0 tx=0).stop 2024-05-30T16:52:23.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c6200640 1 -- 172.21.15.59:0/2122413632 shutdown_connections 2024-05-30T16:52:23.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c6200640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f069c068650 0x7f069c06ab10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c6200640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06c015a1d0 0x7f06c0071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c6200640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06c0159df0 0x7f06c01493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c6200640 1 --2- 172.21.15.59:0/2122413632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c00b3e50 0x7f06c0160220 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c6200640 1 -- 172.21.15.59:0/2122413632 >> 172.21.15.59:0/2122413632 conn(0x7f06c00b22d0 msgr2=0x7f06c006e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:23.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c6200640 1 -- 172.21.15.59:0/2122413632 shutdown_connections 2024-05-30T16:52:23.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.277+0000 7f06c6200640 1 -- 172.21.15.59:0/2122413632 wait complete. 2024-05-30T16:52:23.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:52:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.437+0000 7f29dfa00640 1 Processor -- start 2024-05-30T16:52:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.437+0000 7f29dfa00640 1 -- start start 2024-05-30T16:52:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.437+0000 7f29dfa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f29d80ad630 0x7f29d815a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.437+0000 7f29dfa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29d80d0900 0x7f29d806e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.437+0000 7f29dfa00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29d80b31d0 con 0x7f29d80d0470 2024-05-30T16:52:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.437+0000 7f29dfa00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f29d8073c30 con 0x7f29d80ad630 2024-05-30T16:52:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.437+0000 7f29dfa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f29d8073f10 con 0x7f29d80d0900 2024-05-30T16:52:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.441+0000 7f29dd000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f29d80ad630 0x7f29d815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.441+0000 7f29dd000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f29d80ad630 0x7f29d815a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:46458/0 (socket says 172.21.15.59:46458) 2024-05-30T16:52:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.441+0000 7f29dd000640 1 -- 172.21.15.59:0/944384155 learned_addr learned my addr 172.21.15.59:0/944384155 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.441+0000 7f29dda00640 1 --2- 172.21.15.59:0/944384155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29d80d0900 0x7f29d806e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.441+0000 7f29dd000640 1 -- 172.21.15.59:0/944384155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29d80d0900 msgr2=0x7f29d806e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:23.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.441+0000 7f29dd000640 1 --2- 172.21.15.59:0/944384155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29d80d0900 0x7f29d806e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.441+0000 7f29dd000640 1 -- 172.21.15.59:0/944384155 >> v1:172.21.15.107:6789/0 conn(0x7f29d80d0470 legacy=0x7f29d80731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.441+0000 7f29dd000640 1 -- 172.21.15.59:0/944384155 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d80b3470 con 0x7f29d80ad630 2024-05-30T16:52:23.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.441+0000 7f29dd000640 1 --2- 172.21.15.59:0/944384155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29d80ad630 0x7f29d815a980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009870 tx=0x7f29cc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=798ff51c4e0c34ad server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.441+0000 7f29d7400640 1 -- 172.21.15.59:0/944384155 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0b1070 con 0x7f29d80ad630 2024-05-30T16:52:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29d7400640 1 -- 172.21.15.59:0/944384155 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29cc0ac410 con 0x7f29d80ad630 2024-05-30T16:52:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29d7400640 1 -- 172.21.15.59:0/944384155 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0ac7e0 con 0x7f29d80ad630 2024-05-30T16:52:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 -- 172.21.15.59:0/944384155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29d80ad630 msgr2=0x7f29d815a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 --2- 172.21.15.59:0/944384155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29d80ad630 0x7f29d815a980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009870 tx=0x7f29cc01c4a0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 -- 172.21.15.59:0/944384155 shutdown_connections 2024-05-30T16:52:23.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 --2- 172.21.15.59:0/944384155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29d80d0900 0x7f29d806e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 --2- 172.21.15.59:0/944384155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29d80ad630 0x7f29d815a980 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 -- 172.21.15.59:0/944384155 >> 172.21.15.59:0/944384155 conn(0x7f29d80b22d0 msgr2=0x7f29d80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:23.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 -- 172.21.15.59:0/944384155 shutdown_connections 2024-05-30T16:52:23.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 -- 172.21.15.59:0/944384155 wait complete. 2024-05-30T16:52:23.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 Processor -- start 2024-05-30T16:52:23.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 -- start start 2024-05-30T16:52:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29d80ad630 0x7f29d80ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d80d0470 0x7f29d81458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29d80d0900 0x7f29d814e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29d806e000 con 0x7f29d80d0470 2024-05-30T16:52:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f29d806de80 con 0x7f29d80d0900 2024-05-30T16:52:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dfa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f29d80b3c70 con 0x7f29d80ad630 2024-05-30T16:52:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d80d0470 0x7f29d81458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d80d0470 0x7f29d81458b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54654/0 (socket says 172.21.15.59:54654) 2024-05-30T16:52:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29d7e00640 1 -- 172.21.15.59:0/2536236751 learned_addr learned my addr 172.21.15.59:0/2536236751 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dda00640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29d80d0900 0x7f29d814e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.445+0000 7f29dd000640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29d80ad630 0x7f29d80ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29d7e00640 1 -- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29d80ad630 msgr2=0x7f29d80ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29d7e00640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29d80ad630 0x7f29d80ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29d7e00640 1 -- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29d80d0900 msgr2=0x7f29d814e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29d7e00640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29d80d0900 0x7f29d814e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29d7e00640 1 -- 172.21.15.59:0/2536236751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d8157f70 con 0x7f29d80d0470 2024-05-30T16:52:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29dd000640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29d80ad630 0x7f29d80ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29dda00640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29d80d0900 0x7f29d814e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:23.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29d7e00640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d80d0470 0x7f29d81458b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f29c400c420 tx=0x7f29c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:23.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29d4c00640 1 -- 172.21.15.59:0/2536236751 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c40052d0 con 0x7f29d80d0470 2024-05-30T16:52:23.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29d4c00640 1 -- 172.21.15.59:0/2536236751 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c4005470 con 0x7f29d80d0470 2024-05-30T16:52:23.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29d4c00640 1 -- 172.21.15.59:0/2536236751 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4007260 con 0x7f29d80d0470 2024-05-30T16:52:23.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29dfa00640 1 -- 172.21.15.59:0/2536236751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d8158250 con 0x7f29d80d0470 2024-05-30T16:52:23.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29dfa00640 1 -- 172.21.15.59:0/2536236751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d8158810 con 0x7f29d80d0470 2024-05-30T16:52:23.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29dfa00640 1 -- 172.21.15.59:0/2536236751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d815bf90 con 0x7f29d80d0470 2024-05-30T16:52:23.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29d4c00640 1 -- 172.21.15.59:0/2536236751 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f29c4007400 con 0x7f29d80d0470 2024-05-30T16:52:23.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29d4c00640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f29b8068650 0x7f29b806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:23.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.449+0000 7f29d4c00640 1 -- 172.21.15.59:0/2536236751 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7f29c4086390 con 0x7f29d80d0470 2024-05-30T16:52:23.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.453+0000 7f29dd000640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f29b8068650 0x7f29b806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:23.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.453+0000 7f29dd000640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f29b8068650 0x7f29b806ab10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0ae000 tx=0x7f29cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.453+0000 7f29d4c00640 1 -- 172.21.15.59:0/2536236751 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f29d815bf90 con 0x7f29d80d0470 2024-05-30T16:52:23.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 -- 172.21.15.59:0/2536236751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f29d806f9c0 con 0x7f29d80d0470 2024-05-30T16:52:23.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29d4c00640 1 -- 172.21.15.59:0/2536236751 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f29c40565a0 con 0x7f29d80d0470 2024-05-30T16:52:23.658 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:52:23.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 -- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f29b8068650 msgr2=0x7f29b806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f29b8068650 0x7f29b806ab10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0ae000 tx=0x7f29cc008040 comp rx=0 tx=0).stop 2024-05-30T16:52:23.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 -- 172.21.15.59:0/2536236751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d80d0470 msgr2=0x7f29d81458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:23.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d80d0470 0x7f29d81458b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f29c400c420 tx=0x7f29c400c8e0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 -- 172.21.15.59:0/2536236751 shutdown_connections 2024-05-30T16:52:23.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f29b8068650 0x7f29b806ab10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29d80d0900 0x7f29d814e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d80d0470 0x7f29d81458b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 --2- 172.21.15.59:0/2536236751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29d80ad630 0x7f29d80ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:23.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 -- 172.21.15.59:0/2536236751 >> 172.21.15.59:0/2536236751 conn(0x7f29d80b22d0 msgr2=0x7f29d80b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:23.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 -- 172.21.15.59:0/2536236751 shutdown_connections 2024-05-30T16:52:23.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23.657+0000 7f29dfa00640 1 -- 172.21.15.59:0/2536236751 wait complete. 2024-05-30T16:52:23.680 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:52:23.680 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:52:23.681 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-05-30T16:52:23.681 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T16:52:23.681 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:52:23.681 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:52:23.681 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:52:23.681 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:52:23.681 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:52:23.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:23.681 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-05-30T16:52:23.690 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:52:23.690 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:52:23.690 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42245sec preferred_lft 42245sec 2024-05-30T16:52:23.691 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:46:82:05:9a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:52:23.692 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:52:23.693 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:52:23.693 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T16:52:23.693 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:52:23.693 INFO:teuthology.orchestra.run.smithi059.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:52:23.693 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:52:23.693 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T16:52:23.693 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:52:23.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:23.694 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:52:23.758 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-05-30T16:52:23.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:23.761 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-05-30T16:52:23.819 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-05-30T16:52:23.819 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:52:23.819 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T16:52:23.819 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T16:52:23.819 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T16:52:23.819 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:52:23.819 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:52:23.820 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:52:23.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T16:52:23.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T16:52:23.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T16:52:23.820 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:52:23.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:52:23.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:52:23.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:23.957 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-05-30T16:52:23.966 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T16:52:23.966 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T16:52:23.966 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:52:23.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:23.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-05-30T16:52:24.028 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-30T16:52:24.028 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:52:24.028 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T16:52:24.080 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:52:24.081 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:52:24.081 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:52:24.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:52:24.193 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:52:24.246 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:52:24.246 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:52:24.246 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:52:24.246 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:52:24.246 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:52:24.247 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:52:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:52:24.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:24.249 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:52:24.304 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-30T16:52:24.305 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-30T16:52:24.351 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:52:24.371 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:52:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:52:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:52:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:52:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:52:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:52:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:52:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:52:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:52:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:52:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:52:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:52:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:52:24.424 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:52:24.425 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:52:24.425 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:52:24.425 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:52:24.425 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:52:24.425 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:52:24.425 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:52:24.425 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:52:24.425 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:52:24.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:24.426 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:52:24.503 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:2024-05-30T16:52:24.501+0000 7f770b34a580 -1 init, newargv = 0x55af2e10ba30 newargc=15 2024-05-30T16:52:24.503 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[37862]: starting ceph client 2024-05-30T16:52:24.509 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[37862]: starting fuse 2024-05-30T16:52:25.581 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:52:25.606 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:52:25.659 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:52:25.659 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:52:25.659 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:52:25.659 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:52:25.659 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:52:25.659 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:52:25.659 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:52:25.659 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:52:25.659 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:52:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:52:25.661 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:52:25.661 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:52:25.661 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:52:25.661 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:52:25.661 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:52:25.661 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:52:25.661 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:52:25.661 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:52:25.661 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:52:25.661 INFO:teuthology.orchestra.run.smithi059.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-30T16:52:25.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:25.662 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:52:25.713 INFO:teuthology.orchestra.run.smithi059.stdout:44 2024-05-30T16:52:25.713 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-30T16:52:25.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2024-05-30T16:52:25.713 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2024-05-30T16:52:25.713 DEBUG:teuthology.orchestra.run.smithi059:> import re 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-30T16:52:25.714 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-30T16:52:25.715 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-30T16:52:25.715 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2024-05-30T16:52:25.715 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2024-05-30T16:52:25.715 DEBUG:teuthology.orchestra.run.smithi059:> return f 2024-05-30T16:52:25.715 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-30T16:52:25.715 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:52:25.715 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.0")) 2024-05-30T16:52:25.715 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-05-30T16:52:25.849 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.0.37862.asok 2024-05-30T16:52:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:52:25.861 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37862.asok 2024-05-30T16:52:25.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:25.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37862.asok status 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "9ed025fbf4406fb54980a0647506b15895b6d863", 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-3154-g9ed025fb (9ed025fbf4406fb54980a0647506b15895b6d863) squid (dev)", 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "0", 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "37862", 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5481, 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 5481 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2402734418 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2402734418 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.5481 192.168.0.1:0/2402734418", 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/2402734418", 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 25, 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 47, 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:52:26.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:26.059 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2024-05-30T16:52:26.059 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-30T16:52:26.068 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2024-05-30T16:52:26.068 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-30T16:52:26.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:26.068 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:52:26.136 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T16:52:26.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.321+0000 7f0aa7800640 1 Processor -- start 2024-05-30T16:52:26.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.321+0000 7f0aa7800640 1 -- start start 2024-05-30T16:52:26.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0aa7800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0aa00b2a50 0x7f0aa00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:26.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0aa7800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0aa00b0830 0x7f0aa00af570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:26.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0aa7800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aa00b42f0 con 0x7f0aa015e830 2024-05-30T16:52:26.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0aa7800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0aa00b64e0 con 0x7f0aa00b0830 2024-05-30T16:52:26.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0aa7800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa00b45d0 con 0x7f0aa00b2a50 2024-05-30T16:52:26.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0aa5800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0aa00b0830 0x7f0aa00af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:26.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0aa4e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0aa015e830 0x7f0aa00b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57206/0 (socket says 172.21.15.59:57206) 2024-05-30T16:52:26.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0aa4e00640 1 -- 172.21.15.59:0/904975476 learned_addr learned my addr 172.21.15.59:0/904975476 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:26.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0a9fe00640 1 --2- 172.21.15.59:0/904975476 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0aa00b2a50 0x7f0aa00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:26.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0aa5800640 1 -- 172.21.15.59:0/904975476 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0aa00b2a50 msgr2=0x7f0aa00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:26.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0aa5800640 1 --2- 172.21.15.59:0/904975476 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0aa00b2a50 0x7f0aa00b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0aa5800640 1 -- 172.21.15.59:0/904975476 >> v1:172.21.15.59:6789/0 conn(0x7f0aa015e830 legacy=0x7f0aa00b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:26.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0aa5800640 1 -- 172.21.15.59:0/904975476 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa00aed70 con 0x7f0aa00b0830 2024-05-30T16:52:26.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.325+0000 7f0a9f400640 1 -- 172.21.15.59:0/904975476 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3686942113 0 0) 0x7f0aa00b42f0 con 0x7f0aa015e830 2024-05-30T16:52:26.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0aa5800640 1 --2- 172.21.15.59:0/904975476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa00b0830 0x7f0aa00af570 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009d90 tx=0x7f0a9801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52ed78797d80ed4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:26.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0a9f400640 1 -- 172.21.15.59:0/904975476 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a980b2070 con 0x7f0aa00b0830 2024-05-30T16:52:26.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0a9f400640 1 -- 172.21.15.59:0/904975476 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a980a5990 con 0x7f0aa00b0830 2024-05-30T16:52:26.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0a9f400640 1 -- 172.21.15.59:0/904975476 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a980a5d60 con 0x7f0aa00b0830 2024-05-30T16:52:26.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0aa7800640 1 -- 172.21.15.59:0/904975476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa00b0830 msgr2=0x7f0aa00af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:26.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0aa7800640 1 --2- 172.21.15.59:0/904975476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa00b0830 0x7f0aa00af570 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009d90 tx=0x7f0a9801c8b0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0aa7800640 1 -- 172.21.15.59:0/904975476 shutdown_connections 2024-05-30T16:52:26.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0aa7800640 1 --2- 172.21.15.59:0/904975476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa00b0830 0x7f0aa00af570 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0aa7800640 1 --2- 172.21.15.59:0/904975476 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0aa00b2a50 0x7f0aa00b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0aa7800640 1 -- 172.21.15.59:0/904975476 >> 172.21.15.59:0/904975476 conn(0x7f0aa00b6770 msgr2=0x7f0aa00b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:26.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0aa7800640 1 -- 172.21.15.59:0/904975476 shutdown_connections 2024-05-30T16:52:26.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0aa7800640 1 -- 172.21.15.59:0/904975476 wait complete. 2024-05-30T16:52:26.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0aa7800640 1 Processor -- start 2024-05-30T16:52:26.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.329+0000 7f0aa7800640 1 -- start start 2024-05-30T16:52:26.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0aa7800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aa00b0830 0x7f0aa0156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:26.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0aa7800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa00b2a50 0x7f0aa014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:26.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0aa7800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0aa015e830 0x7f0aa015f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:26.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0aa7800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa016b420 con 0x7f0aa00b2a50 2024-05-30T16:52:26.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0aa7800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa00afec0 con 0x7f0aa00b0830 2024-05-30T16:52:26.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0aa7800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa016b5a0 con 0x7f0aa015e830 2024-05-30T16:52:26.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa00b2a50 0x7f0aa014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:26.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa00b2a50 0x7f0aa014e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54662/0 (socket says 172.21.15.59:54662) 2024-05-30T16:52:26.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9fe00640 1 -- 172.21.15.59:0/785932294 learned_addr learned my addr 172.21.15.59:0/785932294 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:26.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0aa5800640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0aa015e830 0x7f0aa015f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:26.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0aa4e00640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aa00b0830 0x7f0aa0156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:26.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9fe00640 1 -- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0aa015e830 msgr2=0x7f0aa015f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:26.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9fe00640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0aa015e830 0x7f0aa015f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9fe00640 1 -- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aa00b0830 msgr2=0x7f0aa0156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:26.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9fe00640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aa00b0830 0x7f0aa0156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9fe00640 1 -- 172.21.15.59:0/785932294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa0156870 con 0x7f0aa00b2a50 2024-05-30T16:52:26.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9fe00640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa00b2a50 0x7f0aa014e940 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00d5f0 tx=0x7f0a8c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:26.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9cc00640 1 -- 172.21.15.59:0/785932294 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0125f0 con 0x7f0aa00b2a50 2024-05-30T16:52:26.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9cc00640 1 -- 172.21.15.59:0/785932294 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8c019070 con 0x7f0aa00b2a50 2024-05-30T16:52:26.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0aa7800640 1 -- 172.21.15.59:0/785932294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa015fe10 con 0x7f0aa00b2a50 2024-05-30T16:52:26.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9cc00640 1 -- 172.21.15.59:0/785932294 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0129b0 con 0x7f0aa00b2a50 2024-05-30T16:52:26.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0aa7800640 1 -- 172.21.15.59:0/785932294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa0156e10 con 0x7f0aa00b2a50 2024-05-30T16:52:26.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0aa7800640 1 -- 172.21.15.59:0/785932294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa01566a0 con 0x7f0aa00b2a50 2024-05-30T16:52:26.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.333+0000 7f0a9cc00640 1 -- 172.21.15.59:0/785932294 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f0a8c012b50 con 0x7f0aa00b2a50 2024-05-30T16:52:26.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.337+0000 7f0a9cc00640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a80068650 0x7f0a8006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:26.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.337+0000 7f0a9cc00640 1 -- 172.21.15.59:0/785932294 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7f0a8c087030 con 0x7f0aa00b2a50 2024-05-30T16:52:26.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.337+0000 7f0aa4e00640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a80068650 0x7f0a8006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:26.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.337+0000 7f0aa4e00640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a80068650 0x7f0a8006ab10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0a94007fd0 tx=0x7f0a94007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:26.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.341+0000 7f0a9cc00640 1 -- 172.21.15.59:0/785932294 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a8c056cc0 con 0x7f0aa00b2a50 2024-05-30T16:52:26.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.541+0000 7f0aa7800640 1 -- 172.21.15.59:0/785932294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f0aa0068a90 con 0x7f0aa00b2a50 2024-05-30T16:52:26.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.825+0000 7f0a9cc00640 1 -- 172.21.15.59:0/785932294 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v26) ==== 136+0+0 (secure 0 0 0) 0x7f0a8c05afc0 con 0x7f0aa00b2a50 2024-05-30T16:52:26.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.829+0000 7f0aa7800640 1 -- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a80068650 msgr2=0x7f0a8006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:26.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.829+0000 7f0aa7800640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a80068650 0x7f0a8006ab10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0a94007fd0 tx=0x7f0a94007d60 comp rx=0 tx=0).stop 2024-05-30T16:52:26.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.829+0000 7f0aa7800640 1 -- 172.21.15.59:0/785932294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa00b2a50 msgr2=0x7f0aa014e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:26.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.829+0000 7f0aa7800640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa00b2a50 0x7f0aa014e940 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00d5f0 tx=0x7f0a8c00dab0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.829+0000 7f0aa7800640 1 -- 172.21.15.59:0/785932294 shutdown_connections 2024-05-30T16:52:26.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.829+0000 7f0aa7800640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a80068650 0x7f0a8006ab10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.829+0000 7f0aa7800640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0aa015e830 0x7f0aa015f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.829+0000 7f0aa7800640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa00b2a50 0x7f0aa014e940 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.829+0000 7f0aa7800640 1 --2- 172.21.15.59:0/785932294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aa00b0830 0x7f0aa0156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.829+0000 7f0aa7800640 1 -- 172.21.15.59:0/785932294 >> 172.21.15.59:0/785932294 conn(0x7f0aa00b6770 msgr2=0x7f0aa0074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:26.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.829+0000 7f0aa7800640 1 -- 172.21.15.59:0/785932294 shutdown_connections 2024-05-30T16:52:26.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.829+0000 7f0aa7800640 1 -- 172.21.15.59:0/785932294 wait complete. 2024-05-30T16:52:26.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:52:26.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.989+0000 7f94f7a00640 1 Processor -- start 2024-05-30T16:52:26.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.989+0000 7f94f7a00640 1 -- start start 2024-05-30T16:52:26.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.989+0000 7f94f7a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f94f00cfe20 0x7f94f015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:26.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.989+0000 7f94f7a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94f0073bb0 0x7f94f0072060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.989+0000 7f94f7a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f015f3b0 con 0x7f94f00cfa40 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.989+0000 7f94f7a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f94f015f690 con 0x7f94f00cfe20 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.989+0000 7f94f7a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f94f015f970 con 0x7f94f0073bb0 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.993+0000 7f94f5000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f94f00cfa40 0x7f94f00b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57210/0 (socket says 172.21.15.59:57210) 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.993+0000 7f94f5000640 1 -- 172.21.15.59:0/2027041155 learned_addr learned my addr 172.21.15.59:0/2027041155 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.993+0000 7f94e7e00640 1 --2- 172.21.15.59:0/2027041155 >> v2:172.21.15.107:3300/0 conn(0x7f94f00cfe20 0x7f94f015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.993+0000 7f94f5a00640 1 --2- 172.21.15.59:0/2027041155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94f0073bb0 0x7f94f0072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.993+0000 7f94efe00640 1 -- 172.21.15.59:0/2027041155 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2423780757 0 0) 0x7f94f015f3b0 con 0x7f94f00cfa40 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.993+0000 7f94efe00640 1 -- 172.21.15.59:0/2027041155 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94d4003530 con 0x7f94f00cfa40 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.993+0000 7f94e7e00640 1 -- 172.21.15.59:0/2027041155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94f0073bb0 msgr2=0x7f94f0072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.993+0000 7f94e7e00640 1 --2- 172.21.15.59:0/2027041155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94f0073bb0 0x7f94f0072060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.993+0000 7f94e7e00640 1 -- 172.21.15.59:0/2027041155 >> v1:172.21.15.59:6789/0 conn(0x7f94f00cfa40 legacy=0x7f94f00b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.993+0000 7f94e7e00640 1 -- 172.21.15.59:0/2027041155 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f00b3370 con 0x7f94f00cfe20 2024-05-30T16:52:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.993+0000 7f94f5a00640 1 --2- 172.21.15.59:0/2027041155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94f0073bb0 0x7f94f0072060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:26.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.993+0000 7f94e7e00640 1 --2- 172.21.15.59:0/2027041155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94f00cfe20 0x7f94f015ecb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f94d80097c0 tx=0x7f94d801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c4640831f545c5b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:26.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94efe00640 1 -- 172.21.15.59:0/2027041155 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d80b1070 con 0x7f94f00cfe20 2024-05-30T16:52:26.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94efe00640 1 -- 172.21.15.59:0/2027041155 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d80ac410 con 0x7f94f00cfe20 2024-05-30T16:52:26.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94efe00640 1 -- 172.21.15.59:0/2027041155 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d80ac7e0 con 0x7f94f00cfe20 2024-05-30T16:52:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 -- 172.21.15.59:0/2027041155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94f00cfe20 msgr2=0x7f94f015ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 --2- 172.21.15.59:0/2027041155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94f00cfe20 0x7f94f015ecb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f94d80097c0 tx=0x7f94d801c4a0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 -- 172.21.15.59:0/2027041155 shutdown_connections 2024-05-30T16:52:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 --2- 172.21.15.59:0/2027041155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94f0073bb0 0x7f94f0072060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 --2- 172.21.15.59:0/2027041155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94f00cfe20 0x7f94f015ecb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 -- 172.21.15.59:0/2027041155 >> 172.21.15.59:0/2027041155 conn(0x7f94f00b22d0 msgr2=0x7f94f00b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 -- 172.21.15.59:0/2027041155 shutdown_connections 2024-05-30T16:52:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 -- 172.21.15.59:0/2027041155 wait complete. 2024-05-30T16:52:26.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 Processor -- start 2024-05-30T16:52:26.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 -- start start 2024-05-30T16:52:27.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94f0073bb0 0x7f94f00b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94f00cfa40 0x7f94f0099b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f00cfe20 0x7f94f01557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94f0155210 con 0x7f94f00cfe20 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f94f0155090 con 0x7f94f00cfa40 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f7a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f94f0155390 con 0x7f94f0073bb0 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f5a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f00cfe20 0x7f94f01557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f5a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f00cfe20 0x7f94f01557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54672/0 (socket says 172.21.15.59:54672) 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f5a00640 1 -- 172.21.15.59:0/598319326 learned_addr learned my addr 172.21.15.59:0/598319326 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94e7e00640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94f00cfa40 0x7f94f0099b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:26.997+0000 7f94f5000640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94f0073bb0 0x7f94f00b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94f5a00640 1 -- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94f0073bb0 msgr2=0x7f94f00b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94f5a00640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94f0073bb0 0x7f94f00b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94f5a00640 1 -- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94f00cfa40 msgr2=0x7f94f0099b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94f5a00640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94f00cfa40 0x7f94f0099b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94f5a00640 1 -- 172.21.15.59:0/598319326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f00ad590 con 0x7f94f00cfe20 2024-05-30T16:52:27.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94f5a00640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f00cfe20 0x7f94f01557f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f94e800efc0 tx=0x7f94e8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:27.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94ed600640 1 -- 172.21.15.59:0/598319326 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8018030 con 0x7f94f00cfe20 2024-05-30T16:52:27.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94ed600640 1 -- 172.21.15.59:0/598319326 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e800cd80 con 0x7f94f00cfe20 2024-05-30T16:52:27.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94f7a00640 1 -- 172.21.15.59:0/598319326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f00ad870 con 0x7f94f00cfe20 2024-05-30T16:52:27.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94ed600640 1 -- 172.21.15.59:0/598319326 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8003bc0 con 0x7f94f00cfe20 2024-05-30T16:52:27.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94f7a00640 1 -- 172.21.15.59:0/598319326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f00ade30 con 0x7f94f00cfe20 2024-05-30T16:52:27.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94f7a00640 1 -- 172.21.15.59:0/598319326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f0068a90 con 0x7f94f00cfe20 2024-05-30T16:52:27.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94ed600640 1 -- 172.21.15.59:0/598319326 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f94e801b070 con 0x7f94f00cfe20 2024-05-30T16:52:27.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94ed600640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f94cc068650 0x7f94cc06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94ed600640 1 -- 172.21.15.59:0/598319326 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7f94e8087790 con 0x7f94f00cfe20 2024-05-30T16:52:27.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.001+0000 7f94f5000640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f94cc068650 0x7f94cc06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.005+0000 7f94f5000640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f94cc068650 0x7f94cc06ab10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f94e0007fd0 tx=0x7f94e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:27.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.005+0000 7f94ed600640 1 -- 172.21.15.59:0/598319326 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f94e8010040 con 0x7f94f00cfe20 2024-05-30T16:52:27.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.193+0000 7f94f7a00640 1 -- 172.21.15.59:0/598319326 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f94f0069330 con 0x7f94cc068650 2024-05-30T16:52:27.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94ed600640 1 -- 172.21.15.59:0/598319326 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f94f0069330 con 0x7f94cc068650 2024-05-30T16:52:27.197 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:52:27.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:52:27.197 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T16:52:27.197 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:52:27.197 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:52:27.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94f7a00640 1 -- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f94cc068650 msgr2=0x7f94cc06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94f7a00640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f94cc068650 0x7f94cc06ab10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f94e0007fd0 tx=0x7f94e0009040 comp rx=0 tx=0).stop 2024-05-30T16:52:27.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94f7a00640 1 -- 172.21.15.59:0/598319326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f00cfe20 msgr2=0x7f94f01557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94f7a00640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f00cfe20 0x7f94f01557f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f94e800efc0 tx=0x7f94e8009f90 comp rx=0 tx=0).stop 2024-05-30T16:52:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94f7a00640 1 -- 172.21.15.59:0/598319326 shutdown_connections 2024-05-30T16:52:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94f7a00640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f94cc068650 0x7f94cc06ab10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94f7a00640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f00cfe20 0x7f94f01557f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94f7a00640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94f00cfa40 0x7f94f0099b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94f7a00640 1 --2- 172.21.15.59:0/598319326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94f0073bb0 0x7f94f00b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94f7a00640 1 -- 172.21.15.59:0/598319326 >> 172.21.15.59:0/598319326 conn(0x7f94f00b22d0 msgr2=0x7f94f0162230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94f7a00640 1 -- 172.21.15.59:0/598319326 shutdown_connections 2024-05-30T16:52:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.197+0000 7f94f7a00640 1 -- 172.21.15.59:0/598319326 wait complete. 2024-05-30T16:52:27.220 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:52:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.361+0000 7fd393800640 1 Processor -- start 2024-05-30T16:52:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.361+0000 7fd393800640 1 -- start start 2024-05-30T16:52:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.361+0000 7fd393800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd38c1569e0 0x7fd38c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.361+0000 7fd393800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd38c0ad2b0 0x7fd38c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.361+0000 7fd393800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd38c0ad770 con 0x7fd38c0d0660 2024-05-30T16:52:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.361+0000 7fd393800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd38c15cb40 con 0x7fd38c1569e0 2024-05-30T16:52:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.361+0000 7fd393800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd38c15ce20 con 0x7fd38c0ad2b0 2024-05-30T16:52:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.361+0000 7fd390e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd38c1569e0 0x7fd38c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.361+0000 7fd390e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd38c1569e0 0x7fd38c15d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54688/0 (socket says 172.21.15.59:54688) 2024-05-30T16:52:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.361+0000 7fd390e00640 1 -- 172.21.15.59:0/2644428025 learned_addr learned my addr 172.21.15.59:0/2644428025 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.361+0000 7fd391800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd38c0d0660 0x7fd38c0b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57224/0 (socket says 172.21.15.59:57224) 2024-05-30T16:52:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.361+0000 7fd383e00640 1 --2- 172.21.15.59:0/2644428025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd38c0ad2b0 0x7fd38c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd390e00640 1 -- 172.21.15.59:0/2644428025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd38c0ad2b0 msgr2=0x7fd38c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd38be00640 1 -- 172.21.15.59:0/2644428025 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958105275 0 0) 0x7fd38c0ad770 con 0x7fd38c0d0660 2024-05-30T16:52:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd390e00640 1 --2- 172.21.15.59:0/2644428025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd38c0ad2b0 0x7fd38c0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd390e00640 1 -- 172.21.15.59:0/2644428025 >> v1:172.21.15.59:6789/0 conn(0x7fd38c0d0660 legacy=0x7fd38c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd390e00640 1 -- 172.21.15.59:0/2644428025 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c15d100 con 0x7fd38c1569e0 2024-05-30T16:52:27.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd390e00640 1 --2- 172.21.15.59:0/2644428025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c1569e0 0x7fd38c15d620 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009870 tx=0x7fd37c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b967d7c1bb87072 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:27.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd38be00640 1 -- 172.21.15.59:0/2644428025 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0ab430 con 0x7fd38c1569e0 2024-05-30T16:52:27.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd38be00640 1 -- 172.21.15.59:0/2644428025 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37c0b0070 con 0x7fd38c1569e0 2024-05-30T16:52:27.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd38be00640 1 -- 172.21.15.59:0/2644428025 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0ab7f0 con 0x7fd38c1569e0 2024-05-30T16:52:27.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd393800640 1 -- 172.21.15.59:0/2644428025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c1569e0 msgr2=0x7fd38c15d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd393800640 1 --2- 172.21.15.59:0/2644428025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c1569e0 0x7fd38c15d620 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009870 tx=0x7fd37c01c440 comp rx=0 tx=0).stop 2024-05-30T16:52:27.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd393800640 1 -- 172.21.15.59:0/2644428025 shutdown_connections 2024-05-30T16:52:27.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd393800640 1 --2- 172.21.15.59:0/2644428025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd38c0ad2b0 0x7fd38c0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd393800640 1 --2- 172.21.15.59:0/2644428025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c1569e0 0x7fd38c15d620 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd393800640 1 -- 172.21.15.59:0/2644428025 >> 172.21.15.59:0/2644428025 conn(0x7fd38c06bdb0 msgr2=0x7fd38c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:27.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd393800640 1 -- 172.21.15.59:0/2644428025 shutdown_connections 2024-05-30T16:52:27.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.365+0000 7fd393800640 1 -- 172.21.15.59:0/2644428025 wait complete. 2024-05-30T16:52:27.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd393800640 1 Processor -- start 2024-05-30T16:52:27.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd393800640 1 -- start start 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd393800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd38c0ad2b0 0x7fd38c153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd393800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c0d0660 0x7fd38c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd393800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd38c1569e0 0x7fd38c1402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd393800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c0d00b0 con 0x7fd38c0d0660 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd393800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c0cff30 con 0x7fd38c0ad2b0 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd393800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd38c1691b0 con 0x7fd38c1569e0 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd383e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c0d0660 0x7fd38c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd383e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c0d0660 0x7fd38c0b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54700/0 (socket says 172.21.15.59:54700) 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd383e00640 1 -- 172.21.15.59:0/1732713954 learned_addr learned my addr 172.21.15.59:0/1732713954 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd390e00640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd38c0ad2b0 0x7fd38c153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd391800640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd38c1569e0 0x7fd38c1402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd383e00640 1 -- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd38c1569e0 msgr2=0x7fd38c1402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd383e00640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd38c1569e0 0x7fd38c1402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd383e00640 1 -- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd38c0ad2b0 msgr2=0x7fd38c153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd383e00640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd38c0ad2b0 0x7fd38c153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd383e00640 1 -- 172.21.15.59:0/1732713954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c153970 con 0x7fd38c0d0660 2024-05-30T16:52:27.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd383e00640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c0d0660 0x7fd38c0b1cf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd37400e930 tx=0x7fd37400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:27.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd389600640 1 -- 172.21.15.59:0/1732713954 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374017070 con 0x7fd38c0d0660 2024-05-30T16:52:27.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd389600640 1 -- 172.21.15.59:0/1732713954 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37400ca00 con 0x7fd38c0d0660 2024-05-30T16:52:27.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd389600640 1 -- 172.21.15.59:0/1732713954 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37400cdb0 con 0x7fd38c0d0660 2024-05-30T16:52:27.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd393800640 1 -- 172.21.15.59:0/1732713954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38c153c50 con 0x7fd38c0d0660 2024-05-30T16:52:27.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.369+0000 7fd393800640 1 -- 172.21.15.59:0/1732713954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38c154210 con 0x7fd38c0d0660 2024-05-30T16:52:27.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.373+0000 7fd393800640 1 -- 172.21.15.59:0/1732713954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd38c068a90 con 0x7fd38c0d0660 2024-05-30T16:52:27.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.373+0000 7fd389600640 1 -- 172.21.15.59:0/1732713954 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fd37401a070 con 0x7fd38c0d0660 2024-05-30T16:52:27.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.373+0000 7fd389600640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd368068650 0x7fd36806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.373+0000 7fd389600640 1 -- 172.21.15.59:0/1732713954 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7fd374086e40 con 0x7fd38c0d0660 2024-05-30T16:52:27.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.373+0000 7fd390e00640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd368068650 0x7fd36806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.373+0000 7fd390e00640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd368068650 0x7fd36806ab10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0af000 tx=0x7fd37c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:27.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.377+0000 7fd389600640 1 -- 172.21.15.59:0/1732713954 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd3740571a0 con 0x7fd38c0d0660 2024-05-30T16:52:27.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.541+0000 7fd393800640 1 -- 172.21.15.59:0/1732713954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd38c06c3a0 con 0x7fd38c0d0660 2024-05-30T16:52:27.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd389600640 1 -- 172.21.15.59:0/1732713954 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fd374056aa0 con 0x7fd38c0d0660 2024-05-30T16:52:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd393800640 1 -- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd368068650 msgr2=0x7fd36806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd393800640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd368068650 0x7fd36806ab10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0af000 tx=0x7fd37c0a7000 comp rx=0 tx=0).stop 2024-05-30T16:52:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd393800640 1 -- 172.21.15.59:0/1732713954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c0d0660 msgr2=0x7fd38c0b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd393800640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c0d0660 0x7fd38c0b1cf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd37400e930 tx=0x7fd37400edf0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd393800640 1 -- 172.21.15.59:0/1732713954 shutdown_connections 2024-05-30T16:52:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd393800640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd368068650 0x7fd36806ab10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd393800640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd38c1569e0 0x7fd38c1402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd393800640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c0d0660 0x7fd38c0b1cf0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd393800640 1 --2- 172.21.15.59:0/1732713954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd38c0ad2b0 0x7fd38c153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd393800640 1 -- 172.21.15.59:0/1732713954 >> 172.21.15.59:0/1732713954 conn(0x7fd38c06bdb0 msgr2=0x7fd38c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:27.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd393800640 1 -- 172.21.15.59:0/1732713954 shutdown_connections 2024-05-30T16:52:27.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.545+0000 7fd393800640 1 -- 172.21.15.59:0/1732713954 wait complete. 2024-05-30T16:52:27.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T16:52:27.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a72600640 1 Processor -- start 2024-05-30T16:52:27.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a72600640 1 -- start start 2024-05-30T16:52:27.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a72600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a6c06dc60 0x7f0a6c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a72600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a6c06e120 con 0x7f0a6c0af130 2024-05-30T16:52:27.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a72600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a6c06e400 con 0x7f0a6c156e40 2024-05-30T16:52:27.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a72600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0a6c06e6e0 con 0x7f0a6c06dc60 2024-05-30T16:52:27.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a62a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a6c06dc60 0x7f0a6c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a62a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a6c06dc60 0x7f0a6c06f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54706/0 (socket says 172.21.15.59:54706) 2024-05-30T16:52:27.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a62a00640 1 -- 172.21.15.59:0/3148383072 learned_addr learned my addr 172.21.15.59:0/3148383072 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:27.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a6be00640 1 --1- 172.21.15.59:0/3148383072 >> v1:172.21.15.59:6789/0 conn(0x7f0a6c0af130 0x7f0a6c0af550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57226/0 (socket says 172.21.15.59:57226) 2024-05-30T16:52:27.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a62a00640 1 -- 172.21.15.59:0/3148383072 >> v1:172.21.15.107:6789/0 conn(0x7f0a6c156e40 legacy=0x7f0a6c15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:27.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a62a00640 1 -- 172.21.15.59:0/3148383072 >> v1:172.21.15.59:6789/0 conn(0x7f0a6c0af130 legacy=0x7f0a6c0af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.709+0000 7f0a62a00640 1 -- 172.21.15.59:0/3148383072 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6c06e9c0 con 0x7f0a6c06dc60 2024-05-30T16:52:27.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.713+0000 7f0a62a00640 1 --2- 172.21.15.59:0/3148383072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a6c06dc60 0x7f0a6c06f1c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009870 tx=0x7f0a5401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695c21e699fc7472 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:27.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.713+0000 7f0a6aa00640 1 -- 172.21.15.59:0/3148383072 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a540ab430 con 0x7f0a6c06dc60 2024-05-30T16:52:27.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.713+0000 7f0a6aa00640 1 -- 172.21.15.59:0/3148383072 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a540b0070 con 0x7f0a6c06dc60 2024-05-30T16:52:27.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.713+0000 7f0a6aa00640 1 -- 172.21.15.59:0/3148383072 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a540ab7f0 con 0x7f0a6c06dc60 2024-05-30T16:52:27.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.713+0000 7f0a72600640 1 -- 172.21.15.59:0/3148383072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a6c06dc60 msgr2=0x7f0a6c06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.713+0000 7f0a72600640 1 --2- 172.21.15.59:0/3148383072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a6c06dc60 0x7f0a6c06f1c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009870 tx=0x7f0a5401c520 comp rx=0 tx=0).stop 2024-05-30T16:52:27.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.713+0000 7f0a72600640 1 -- 172.21.15.59:0/3148383072 shutdown_connections 2024-05-30T16:52:27.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.713+0000 7f0a72600640 1 --2- 172.21.15.59:0/3148383072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a6c06dc60 0x7f0a6c06f1c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.713+0000 7f0a72600640 1 -- 172.21.15.59:0/3148383072 >> 172.21.15.59:0/3148383072 conn(0x7f0a6c0b1e60 msgr2=0x7f0a6c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:27.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.713+0000 7f0a72600640 1 -- 172.21.15.59:0/3148383072 shutdown_connections 2024-05-30T16:52:27.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.713+0000 7f0a72600640 1 -- 172.21.15.59:0/3148383072 wait complete. 2024-05-30T16:52:27.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a72600640 1 Processor -- start 2024-05-30T16:52:27.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a72600640 1 -- start start 2024-05-30T16:52:27.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a72600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c06dc60 0x7f0a6c14a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a72600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a6c0af130 0x7f0a6c146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a72600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a6c156e40 0x7f0a6c1470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a72600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c15eb70 con 0x7f0a6c156e40 2024-05-30T16:52:27.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a72600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c15e9f0 con 0x7f0a6c06dc60 2024-05-30T16:52:27.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a72600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0a6c16a560 con 0x7f0a6c0af130 2024-05-30T16:52:27.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a6be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a6c156e40 0x7f0a6c1470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a6be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a6c156e40 0x7f0a6c1470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54710/0 (socket says 172.21.15.59:54710) 2024-05-30T16:52:27.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a6be00640 1 -- 172.21.15.59:0/2004620122 learned_addr learned my addr 172.21.15.59:0/2004620122 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:27.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a62a00640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a6c0af130 0x7f0a6c146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a6b400640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c06dc60 0x7f0a6c14a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a6be00640 1 -- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a6c0af130 msgr2=0x7f0a6c146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a6be00640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a6c0af130 0x7f0a6c146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a6be00640 1 -- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c06dc60 msgr2=0x7f0a6c14a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a6be00640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c06dc60 0x7f0a6c14a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a6be00640 1 -- 172.21.15.59:0/2004620122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6c0b0c50 con 0x7f0a6c156e40 2024-05-30T16:52:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a6b400640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c06dc60 0x7f0a6c14a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a6be00640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a6c156e40 0x7f0a6c1470f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400c7a0 tx=0x7f0a6400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a63e00640 1 -- 172.21.15.59:0/2004620122 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a64017070 con 0x7f0a6c156e40 2024-05-30T16:52:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a63e00640 1 -- 172.21.15.59:0/2004620122 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a6400a640 con 0x7f0a6c156e40 2024-05-30T16:52:27.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a63e00640 1 -- 172.21.15.59:0/2004620122 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6400a9f0 con 0x7f0a6c156e40 2024-05-30T16:52:27.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a72600640 1 -- 172.21.15.59:0/2004620122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6c0b0f30 con 0x7f0a6c156e40 2024-05-30T16:52:27.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.717+0000 7f0a72600640 1 -- 172.21.15.59:0/2004620122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a6c0b14f0 con 0x7f0a6c156e40 2024-05-30T16:52:27.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.721+0000 7f0a72600640 1 -- 172.21.15.59:0/2004620122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a6c068a90 con 0x7f0a6c156e40 2024-05-30T16:52:27.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.721+0000 7f0a63e00640 1 -- 172.21.15.59:0/2004620122 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f0a6401a070 con 0x7f0a6c156e40 2024-05-30T16:52:27.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.721+0000 7f0a63e00640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a48068650 0x7f0a4806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:27.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.721+0000 7f0a63e00640 1 -- 172.21.15.59:0/2004620122 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7f0a64086360 con 0x7f0a6c156e40 2024-05-30T16:52:27.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.721+0000 7f0a6b400640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a48068650 0x7f0a4806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:27.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.721+0000 7f0a6b400640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a48068650 0x7f0a4806ab10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c075240 tx=0x7f0a5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:27.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.725+0000 7f0a63e00640 1 -- 172.21.15.59:0/2004620122 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a64055fb0 con 0x7f0a6c156e40 2024-05-30T16:52:27.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.917+0000 7f0a72600640 1 -- 172.21.15.59:0/2004620122 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f0a6c073fe0 con 0x7f0a48068650 2024-05-30T16:52:27.926 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:52:27.923+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:52:27.927 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:52:27.923+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:52:27.927 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:52:27.923+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:52:27.927 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:52:27.923+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:52:27.927 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:52:27.923+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:52:27.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.957+0000 7f0a63e00640 1 -- 172.21.15.59:0/2004620122 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0a6c073fe0 con 0x7f0a48068650 2024-05-30T16:52:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.961+0000 7f0a72600640 1 -- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a48068650 msgr2=0x7f0a4806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.961+0000 7f0a72600640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a48068650 0x7f0a4806ab10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c075240 tx=0x7f0a5c009040 comp rx=0 tx=0).stop 2024-05-30T16:52:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.961+0000 7f0a72600640 1 -- 172.21.15.59:0/2004620122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a6c156e40 msgr2=0x7f0a6c1470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.961+0000 7f0a72600640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a6c156e40 0x7f0a6c1470f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400c7a0 tx=0x7f0a6400cc60 comp rx=0 tx=0).stop 2024-05-30T16:52:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.961+0000 7f0a72600640 1 -- 172.21.15.59:0/2004620122 shutdown_connections 2024-05-30T16:52:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.961+0000 7f0a72600640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a48068650 0x7f0a4806ab10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.961+0000 7f0a72600640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a6c156e40 0x7f0a6c1470f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.961+0000 7f0a72600640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a6c0af130 0x7f0a6c146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.961+0000 7f0a72600640 1 --2- 172.21.15.59:0/2004620122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c06dc60 0x7f0a6c14a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:27.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.961+0000 7f0a72600640 1 -- 172.21.15.59:0/2004620122 >> 172.21.15.59:0/2004620122 conn(0x7f0a6c0b1e60 msgr2=0x7f0a6c15d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:27.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.961+0000 7f0a72600640 1 -- 172.21.15.59:0/2004620122 shutdown_connections 2024-05-30T16:52:27.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:27.961+0000 7f0a72600640 1 -- 172.21.15.59:0/2004620122 wait complete. 2024-05-30T16:52:27.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:52:28.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f21a6200640 1 Processor -- start 2024-05-30T16:52:28.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f21a6200640 1 -- start start 2024-05-30T16:52:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f21a6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21a00d3180 0x7f21a00b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f21a6200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f21a00b7de0 0x7f21a00b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f21a6200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a015ebf0 con 0x7f21a015e810 2024-05-30T16:52:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f21a6200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f21a00d3680 con 0x7f21a00b7de0 2024-05-30T16:52:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f21a6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f21a00d3960 con 0x7f21a00d3180 2024-05-30T16:52:28.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f219fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f21a00b7de0 0x7f21a00b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:28.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f2197e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21a00d3180 0x7f21a00b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:28.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f219fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f21a00b7de0 0x7f21a00b61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:46526/0 (socket says 172.21.15.59:46526) 2024-05-30T16:52:28.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f219fe00640 1 -- 172.21.15.59:0/1185432020 learned_addr learned my addr 172.21.15.59:0/1185432020 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:28.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f219fe00640 1 -- 172.21.15.59:0/1185432020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21a00d3180 msgr2=0x7f21a00b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:28.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f219fe00640 1 --2- 172.21.15.59:0/1185432020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21a00d3180 0x7f21a00b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:28.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f219fe00640 1 -- 172.21.15.59:0/1185432020 >> v1:172.21.15.107:6789/0 conn(0x7f21a015e810 legacy=0x7f21a00cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:28.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f219fe00640 1 -- 172.21.15.59:0/1185432020 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a00d3c40 con 0x7f21a00b7de0 2024-05-30T16:52:28.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.125+0000 7f2197e00640 1 --2- 172.21.15.59:0/1185432020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21a00d3180 0x7f21a00b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:28.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.129+0000 7f219fe00640 1 --2- 172.21.15.59:0/1185432020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a00b7de0 0x7f21a00b61f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2198009e50 tx=0x7f219801ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e12994ef5d58766 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:28.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.129+0000 7f219ea00640 1 -- 172.21.15.59:0/1185432020 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21980a57e0 con 0x7f21a00b7de0 2024-05-30T16:52:28.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.129+0000 7f219ea00640 1 -- 172.21.15.59:0/1185432020 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21980a5980 con 0x7f21a00b7de0 2024-05-30T16:52:28.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.129+0000 7f219ea00640 1 -- 172.21.15.59:0/1185432020 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21980a5d50 con 0x7f21a00b7de0 2024-05-30T16:52:28.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.129+0000 7f21a6200640 1 -- 172.21.15.59:0/1185432020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a00b7de0 msgr2=0x7f21a00b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:28.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.129+0000 7f21a6200640 1 --2- 172.21.15.59:0/1185432020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a00b7de0 0x7f21a00b61f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2198009e50 tx=0x7f219801ca00 comp rx=0 tx=0).stop 2024-05-30T16:52:28.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.129+0000 7f21a6200640 1 -- 172.21.15.59:0/1185432020 shutdown_connections 2024-05-30T16:52:28.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.129+0000 7f21a6200640 1 --2- 172.21.15.59:0/1185432020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a00b7de0 0x7f21a00b61f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:28.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.129+0000 7f21a6200640 1 --2- 172.21.15.59:0/1185432020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21a00d3180 0x7f21a00b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:28.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.129+0000 7f21a6200640 1 -- 172.21.15.59:0/1185432020 >> 172.21.15.59:0/1185432020 conn(0x7f21a0067b60 msgr2=0x7f21a0067f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:28.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.129+0000 7f21a6200640 1 -- 172.21.15.59:0/1185432020 shutdown_connections 2024-05-30T16:52:28.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.129+0000 7f21a6200640 1 -- 172.21.15.59:0/1185432020 wait complete. 2024-05-30T16:52:28.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f21a6200640 1 Processor -- start 2024-05-30T16:52:28.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f21a6200640 1 -- start start 2024-05-30T16:52:28.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f21a6200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a00b7de0 0x7f21a00c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:28.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f21a6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21a00d3180 0x7f21a0153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:28.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f21a6200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a015e810 0x7f21a01542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:28.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f21a6200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f21a016b4a0 con 0x7f21a00b7de0 2024-05-30T16:52:28.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f21a6200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f21a016b320 con 0x7f21a015e810 2024-05-30T16:52:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f21a6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f21a016b620 con 0x7f21a00d3180 2024-05-30T16:52:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f219f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a00b7de0 0x7f21a00c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f219f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a00b7de0 0x7f21a00c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54714/0 (socket says 172.21.15.59:54714) 2024-05-30T16:52:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f219f400640 1 -- 172.21.15.59:0/3986493839 learned_addr learned my addr 172.21.15.59:0/3986493839 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:52:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f219fe00640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a015e810 0x7f21a01542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f2197e00640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21a00d3180 0x7f21a0153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f219f400640 1 -- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21a00d3180 msgr2=0x7f21a0153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f219f400640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21a00d3180 0x7f21a0153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f219f400640 1 -- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a015e810 msgr2=0x7f21a01542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f219f400640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a015e810 0x7f21a01542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f219f400640 1 -- 172.21.15.59:0/3986493839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a00cbd90 con 0x7f21a00b7de0 2024-05-30T16:52:28.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f219f400640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a00b7de0 0x7f21a00c6f00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f219000c370 tx=0x7f219000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:28.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f2197400640 1 -- 172.21.15.59:0/3986493839 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21900052d0 con 0x7f21a00b7de0 2024-05-30T16:52:28.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f2197400640 1 -- 172.21.15.59:0/3986493839 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2190005470 con 0x7f21a00b7de0 2024-05-30T16:52:28.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f2197400640 1 -- 172.21.15.59:0/3986493839 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190007260 con 0x7f21a00b7de0 2024-05-30T16:52:28.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f21a6200640 1 -- 172.21.15.59:0/3986493839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a014b6e0 con 0x7f21a00b7de0 2024-05-30T16:52:28.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.133+0000 7f21a6200640 1 -- 172.21.15.59:0/3986493839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a014bca0 con 0x7f21a00b7de0 2024-05-30T16:52:28.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.137+0000 7f21a6200640 1 -- 172.21.15.59:0/3986493839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a0068a90 con 0x7f21a00b7de0 2024-05-30T16:52:28.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.137+0000 7f2197400640 1 -- 172.21.15.59:0/3986493839 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f2190007400 con 0x7f21a00b7de0 2024-05-30T16:52:28.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.137+0000 7f2197400640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f217c068650 0x7f217c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:28.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.137+0000 7f2197400640 1 -- 172.21.15.59:0/3986493839 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5737+0+0 (secure 0 0 0) 0x7f21900862b0 con 0x7f21a00b7de0 2024-05-30T16:52:28.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.137+0000 7f2197e00640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f217c068650 0x7f217c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:28.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.137+0000 7f2197e00640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f217c068650 0x7f217c06ab10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2188009580 tx=0x7f2188009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:28.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.141+0000 7f2197400640 1 -- 172.21.15.59:0/3986493839 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f21a00cbd90 con 0x7f21a00b7de0 2024-05-30T16:52:28.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.337+0000 7f21a6200640 1 -- 172.21.15.59:0/3986493839 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f21a00b79d0 con 0x7f217c068650 2024-05-30T16:52:28.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.341+0000 7f2197400640 1 -- 172.21.15.59:0/3986493839 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f21a00b79d0 con 0x7f217c068650 2024-05-30T16:52:28.398 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970 2024-05-30T16:52:28.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.345+0000 7f21a6200640 1 -- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f217c068650 msgr2=0x7f217c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:28.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.345+0000 7f21a6200640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f217c068650 0x7f217c06ab10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2188009580 tx=0x7f2188009190 comp rx=0 tx=0).stop 2024-05-30T16:52:28.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.345+0000 7f21a6200640 1 -- 172.21.15.59:0/3986493839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a00b7de0 msgr2=0x7f21a00c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:28.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.345+0000 7f21a6200640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a00b7de0 0x7f21a00c6f00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f219000c370 tx=0x7f219000c830 comp rx=0 tx=0).stop 2024-05-30T16:52:28.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.345+0000 7f21a6200640 1 -- 172.21.15.59:0/3986493839 shutdown_connections 2024-05-30T16:52:28.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.345+0000 7f21a6200640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f217c068650 0x7f217c06ab10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:28.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.345+0000 7f21a6200640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a015e810 0x7f21a01542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:28.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.345+0000 7f21a6200640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21a00d3180 0x7f21a0153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:28.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.345+0000 7f21a6200640 1 --2- 172.21.15.59:0/3986493839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a00b7de0 0x7f21a00c6f00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:28.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.345+0000 7f21a6200640 1 -- 172.21.15.59:0/3986493839 >> 172.21.15.59:0/3986493839 conn(0x7f21a0067b60 msgr2=0x7f21a015be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:28.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.345+0000 7f21a6200640 1 -- 172.21.15.59:0/3986493839 shutdown_connections 2024-05-30T16:52:28.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:52:28.345+0000 7f21a6200640 1 -- 172.21.15.59:0/3986493839 wait complete. 2024-05-30T16:52:28.400 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970 2024-05-30T16:52:28.400 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:52:28.400 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:28.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:28.409 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:52:33.833 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:52:33.837 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:52:35.533 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:52:35.533 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:52:35.533 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.06007 s, 152 MB/s 2024-05-30T16:52:35.534 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:52:35.534 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:35.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:35.543 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:52:42.393 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:52:42.394 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:52:42.394 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.79807 s, 158 MB/s 2024-05-30T16:52:42.395 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:52:42.395 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:42.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:42.404 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:52:49.306 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:52:49.306 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:52:49.306 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.84571 s, 157 MB/s 2024-05-30T16:52:49.307 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:52:49.307 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:49.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:49.317 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:52:56.384 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:52:56.384 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:52:56.384 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.01208 s, 153 MB/s 2024-05-30T16:52:56.386 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:52:56.386 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:56.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:56.395 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:53:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:53:03.378 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:53:03.378 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.92574 s, 155 MB/s 2024-05-30T16:53:03.379 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:53:03.379 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:53:03.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:53:03.388 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:53:03.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:53:03.894 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:53:10.237 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:53:10.237 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:53:10.237 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.79274 s, 158 MB/s 2024-05-30T16:53:10.238 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:53:10.238 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:53:10.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:53:10.247 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:53:17.097 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:53:17.097 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:53:17.097 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.79722 s, 158 MB/s 2024-05-30T16:53:17.098 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:53:17.098 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:53:17.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:53:17.107 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:53:24.036 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:53:24.036 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:53:24.036 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.87544 s, 156 MB/s 2024-05-30T16:53:24.037 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:53:24.037 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:53:24.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:53:24.047 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:53:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:53:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:53:30.973 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.86813 s, 156 MB/s 2024-05-30T16:53:30.974 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:53:30.974 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:53:30.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:53:30.983 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:53:33.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:53:33.953 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:53:37.824 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:53:37.824 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:53:37.824 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.78813 s, 158 MB/s 2024-05-30T16:53:37.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T16:53:37.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f1330400640 1 Processor -- start 2024-05-30T16:53:37.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f1330400640 1 -- start start 2024-05-30T16:53:37.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f1330400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f13280b13b0 0x7f13280ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:37.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f1330400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13280d0520 con 0x7f132809b150 2024-05-30T16:53:37.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f1330400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13280cd250 con 0x7f132815fe50 2024-05-30T16:53:37.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f1330400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f13280cd020 con 0x7f13280b13b0 2024-05-30T16:53:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f132d000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f132809b150 0x7f13280af0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39996/0 (socket says 172.21.15.59:39996) 2024-05-30T16:53:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f132d000640 1 -- 172.21.15.59:0/4178533002 learned_addr learned my addr 172.21.15.59:0/4178533002 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:53:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f132e400640 1 --2- 172.21.15.59:0/4178533002 >> v2:172.21.15.107:3300/0 conn(0x7f13280b13b0 0x7f13280ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f1327e00640 1 -- 172.21.15.59:0/4178533002 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3319166192 0 0) 0x7f1314001120 con 0x7f132809b150 2024-05-30T16:53:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f1327e00640 1 -- 172.21.15.59:0/4178533002 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1310003530 con 0x7f132809b150 2024-05-30T16:53:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f132e400640 1 -- 172.21.15.59:0/4178533002 >> v1:172.21.15.107:6789/0 conn(0x7f132815fe50 legacy=0x7f132809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f132e400640 1 -- 172.21.15.59:0/4178533002 >> v1:172.21.15.59:6789/0 conn(0x7f132809b150 legacy=0x7f13280af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:37.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.968+0000 7f132e400640 1 -- 172.21.15.59:0/4178533002 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13280cd530 con 0x7f13280b13b0 2024-05-30T16:53:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.972+0000 7f132e400640 1 --2- 172.21.15.59:0/4178533002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13280b13b0 0x7f13280ce010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f13200097c0 tx=0x7f13280b0000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de105fef11d6be01 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.972+0000 7f1327e00640 1 -- 172.21.15.59:0/4178533002 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13200b0070 con 0x7f13280b13b0 2024-05-30T16:53:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.972+0000 7f1327e00640 1 -- 172.21.15.59:0/4178533002 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13200ab600 con 0x7f13280b13b0 2024-05-30T16:53:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.972+0000 7f1327e00640 1 -- 172.21.15.59:0/4178533002 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13200ab9b0 con 0x7f13280b13b0 2024-05-30T16:53:37.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.972+0000 7f1330400640 1 -- 172.21.15.59:0/4178533002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13280b13b0 msgr2=0x7f13280ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:37.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.972+0000 7f1330400640 1 --2- 172.21.15.59:0/4178533002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13280b13b0 0x7f13280ce010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f13200097c0 tx=0x7f13280b0000 comp rx=0 tx=0).stop 2024-05-30T16:53:37.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.972+0000 7f1330400640 1 -- 172.21.15.59:0/4178533002 shutdown_connections 2024-05-30T16:53:37.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.972+0000 7f1330400640 1 --2- 172.21.15.59:0/4178533002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13280b13b0 0x7f13280ce010 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:37.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.972+0000 7f1330400640 1 -- 172.21.15.59:0/4178533002 >> 172.21.15.59:0/4178533002 conn(0x7f13280b3f00 msgr2=0x7f13280b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:37.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.972+0000 7f1330400640 1 -- 172.21.15.59:0/4178533002 shutdown_connections 2024-05-30T16:53:37.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.972+0000 7f1330400640 1 -- 172.21.15.59:0/4178533002 wait complete. 2024-05-30T16:53:37.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1330400640 1 Processor -- start 2024-05-30T16:53:37.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1330400640 1 -- start start 2024-05-30T16:53:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1330400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f132809b150 0x7f13281535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1330400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13280b13b0 0x7f132806cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1330400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132815fe50 0x7f1328152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1330400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f132816a930 con 0x7f13280b13b0 2024-05-30T16:53:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1330400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f13280cdb80 con 0x7f132815fe50 2024-05-30T16:53:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1330400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f132816aab0 con 0x7f132809b150 2024-05-30T16:53:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f132d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13280b13b0 0x7f132806cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f132d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13280b13b0 0x7f132806cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46290/0 (socket says 172.21.15.59:46290) 2024-05-30T16:53:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f132d000640 1 -- 172.21.15.59:0/2553581975 learned_addr learned my addr 172.21.15.59:0/2553581975 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f132e400640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132815fe50 0x7f1328152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f132da00640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f132809b150 0x7f13281535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f132d000640 1 -- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f132809b150 msgr2=0x7f13281535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f132d000640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f132809b150 0x7f13281535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f132d000640 1 -- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132815fe50 msgr2=0x7f1328152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f132d000640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132815fe50 0x7f1328152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f132d000640 1 -- 172.21.15.59:0/2553581975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132806d210 con 0x7f13280b13b0 2024-05-30T16:53:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f132e400640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132815fe50 0x7f1328152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:53:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f132d000640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13280b13b0 0x7f132806cac0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f131400c430 tx=0x7f131400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1325600640 1 -- 172.21.15.59:0/2553581975 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314017070 con 0x7f13280b13b0 2024-05-30T16:53:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1325600640 1 -- 172.21.15.59:0/2553581975 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1314005cf0 con 0x7f13280b13b0 2024-05-30T16:53:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1330400640 1 -- 172.21.15.59:0/2553581975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132806d4f0 con 0x7f13280b13b0 2024-05-30T16:53:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1325600640 1 -- 172.21.15.59:0/2553581975 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13140072f0 con 0x7f13280b13b0 2024-05-30T16:53:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.976+0000 7f1330400640 1 -- 172.21.15.59:0/2553581975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f132806dab0 con 0x7f13280b13b0 2024-05-30T16:53:37.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.980+0000 7f1330400640 1 -- 172.21.15.59:0/2553581975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1328068a90 con 0x7f13280b13b0 2024-05-30T16:53:37.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.980+0000 7f1325600640 1 -- 172.21.15.59:0/2553581975 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) ==== 88293+0+0 (secure 0 0 0) 0x7f131401a070 con 0x7f13280b13b0 2024-05-30T16:53:37.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.980+0000 7f1325600640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13080686e0 0x7f130806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:37.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.980+0000 7f1325600640 1 -- 172.21.15.59:0/2553581975 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f13140862f0 con 0x7f13280b13b0 2024-05-30T16:53:37.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.980+0000 7f132da00640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13080686e0 0x7f130806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:37.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.980+0000 7f132da00640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13080686e0 0x7f130806aba0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1328168520 tx=0x7f131c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:37.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:37.984+0000 7f1325600640 1 -- 172.21.15.59:0/2553581975 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f13280d0520 con 0x7f13280b13b0 2024-05-30T16:53:38.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.180+0000 7f1330400640 1 -- 172.21.15.59:0/2553581975 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f13280b4ab0 con 0x7f13080686e0 2024-05-30T16:53:38.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1325600640 1 -- 172.21.15.59:0/2553581975 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f13280b4ab0 con 0x7f13080686e0 2024-05-30T16:53:38.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1330400640 1 -- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13080686e0 msgr2=0x7f130806aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:38.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1330400640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13080686e0 0x7f130806aba0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1328168520 tx=0x7f131c009040 comp rx=0 tx=0).stop 2024-05-30T16:53:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1330400640 1 -- 172.21.15.59:0/2553581975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13280b13b0 msgr2=0x7f132806cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1330400640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13280b13b0 0x7f132806cac0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f131400c430 tx=0x7f131400c8f0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1330400640 1 -- 172.21.15.59:0/2553581975 shutdown_connections 2024-05-30T16:53:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1330400640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13080686e0 0x7f130806aba0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1330400640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132815fe50 0x7f1328152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1330400640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13280b13b0 0x7f132806cac0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1330400640 1 --2- 172.21.15.59:0/2553581975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f132809b150 0x7f13281535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1330400640 1 -- 172.21.15.59:0/2553581975 >> 172.21.15.59:0/2553581975 conn(0x7f13280b3f00 msgr2=0x7f13280b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1330400640 1 -- 172.21.15.59:0/2553581975 shutdown_connections 2024-05-30T16:53:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.196+0000 7f1330400640 1 -- 172.21.15.59:0/2553581975 wait complete. 2024-05-30T16:53:38.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:53:38.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4fdc00640 1 Processor -- start 2024-05-30T16:53:38.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4fdc00640 1 -- start start 2024-05-30T16:53:38.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4fdc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f80b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:38.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4fdc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa4f815ebf0 0x7fa4f80b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:38.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4fdc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f80b32d0 con 0x7fa4f80b3ff0 2024-05-30T16:53:38.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4fdc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f815f490 con 0x7fa4f815ebf0 2024-05-30T16:53:38.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4fdc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f815f770 con 0x7fa4f80723a0 2024-05-30T16:53:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4f6000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa4f815ebf0 0x7fa4f80b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4f6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f80b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4f7400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa4f80b3ff0 0x7fa4f806dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:37434/0 (socket says 172.21.15.59:37434) 2024-05-30T16:53:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4f7400640 1 -- 172.21.15.59:0/945347932 learned_addr learned my addr 172.21.15.59:0/945347932 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:53:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4f5600640 1 -- 172.21.15.59:0/945347932 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 758493705 0 0) 0x7fa4f80b32d0 con 0x7fa4f80b3ff0 2024-05-30T16:53:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4f5600640 1 -- 172.21.15.59:0/945347932 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4dc003530 con 0x7fa4f80b3ff0 2024-05-30T16:53:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4f6000640 1 -- 172.21.15.59:0/945347932 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 msgr2=0x7fa4f80b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4f6000640 1 --2- 172.21.15.59:0/945347932 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f80b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4f6000640 1 -- 172.21.15.59:0/945347932 >> v1:172.21.15.107:6789/0 conn(0x7fa4f80b3ff0 legacy=0x7fa4f806dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4f6000640 1 -- 172.21.15.59:0/945347932 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f815fa50 con 0x7fa4f815ebf0 2024-05-30T16:53:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.360+0000 7fa4f6a00640 1 --2- 172.21.15.59:0/945347932 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f80b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:53:38.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.364+0000 7fa4f6000640 1 --2- 172.21.15.59:0/945347932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f815ebf0 0x7fa4f80b3ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40097c0 tx=0x7fa4e401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c36343dbc66e48db server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:38.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.364+0000 7fa4f5600640 1 -- 172.21.15.59:0/945347932 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40aa5f0 con 0x7fa4f815ebf0 2024-05-30T16:53:38.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.364+0000 7fa4f5600640 1 -- 172.21.15.59:0/945347932 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e40af070 con 0x7fa4f815ebf0 2024-05-30T16:53:38.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.364+0000 7fa4f5600640 1 -- 172.21.15.59:0/945347932 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40aa9b0 con 0x7fa4f815ebf0 2024-05-30T16:53:38.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.364+0000 7fa4fdc00640 1 -- 172.21.15.59:0/945347932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f815ebf0 msgr2=0x7fa4f80b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:38.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.364+0000 7fa4fdc00640 1 --2- 172.21.15.59:0/945347932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f815ebf0 0x7fa4f80b3ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40097c0 tx=0x7fa4e401c470 comp rx=0 tx=0).stop 2024-05-30T16:53:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.364+0000 7fa4fdc00640 1 -- 172.21.15.59:0/945347932 shutdown_connections 2024-05-30T16:53:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.364+0000 7fa4fdc00640 1 --2- 172.21.15.59:0/945347932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f815ebf0 0x7fa4f80b3ab0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.364+0000 7fa4fdc00640 1 --2- 172.21.15.59:0/945347932 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f80b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.364+0000 7fa4fdc00640 1 -- 172.21.15.59:0/945347932 >> 172.21.15.59:0/945347932 conn(0x7fa4f806bdb0 msgr2=0x7fa4f806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.364+0000 7fa4fdc00640 1 -- 172.21.15.59:0/945347932 shutdown_connections 2024-05-30T16:53:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.364+0000 7fa4fdc00640 1 -- 172.21.15.59:0/945347932 wait complete. 2024-05-30T16:53:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4fdc00640 1 Processor -- start 2024-05-30T16:53:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4fdc00640 1 -- start start 2024-05-30T16:53:38.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4fdc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f814c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:38.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4fdc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f80b3ff0 0x7fa4f80b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:38.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4fdc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f815ebf0 0x7fa4f815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4fdc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8072900 con 0x7fa4f815ebf0 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4fdc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8072780 con 0x7fa4f80b3ff0 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4fdc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f806e390 con 0x7fa4f80723a0 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4f7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f815ebf0 0x7fa4f815c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4f7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f815ebf0 0x7fa4f815c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46306/0 (socket says 172.21.15.59:46306) 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4f7400640 1 -- 172.21.15.59:0/883020656 learned_addr learned my addr 172.21.15.59:0/883020656 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4f6000640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f80b3ff0 0x7fa4f80b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4f6a00640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f814c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4f7400640 1 -- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 msgr2=0x7fa4f814c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4f7400640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f814c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4f7400640 1 -- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f80b3ff0 msgr2=0x7fa4f80b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4f7400640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f80b3ff0 0x7fa4f80b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4f7400640 1 -- 172.21.15.59:0/883020656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f80b1680 con 0x7fa4f815ebf0 2024-05-30T16:53:38.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4f7400640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f815ebf0 0x7fa4f815c7d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000cbb0 tx=0x7fa4f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4eea00640 1 -- 172.21.15.59:0/883020656 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0017070 con 0x7fa4f815ebf0 2024-05-30T16:53:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4eea00640 1 -- 172.21.15.59:0/883020656 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f000ad40 con 0x7fa4f815ebf0 2024-05-30T16:53:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4fdc00640 1 -- 172.21.15.59:0/883020656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f80b1960 con 0x7fa4f815ebf0 2024-05-30T16:53:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4eea00640 1 -- 172.21.15.59:0/883020656 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0012600 con 0x7fa4f815ebf0 2024-05-30T16:53:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4fdc00640 1 -- 172.21.15.59:0/883020656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f80b1f20 con 0x7fa4f815ebf0 2024-05-30T16:53:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.368+0000 7fa4fdc00640 1 -- 172.21.15.59:0/883020656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f8068a90 con 0x7fa4f815ebf0 2024-05-30T16:53:38.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.372+0000 7fa4eea00640 1 -- 172.21.15.59:0/883020656 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) ==== 88293+0+0 (secure 0 0 0) 0x7fa4f001a070 con 0x7fa4f815ebf0 2024-05-30T16:53:38.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.372+0000 7fa4eea00640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa4d80686e0 0x7fa4d806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:38.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.372+0000 7fa4eea00640 1 -- 172.21.15.59:0/883020656 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7fa4f0086d50 con 0x7fa4f815ebf0 2024-05-30T16:53:38.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.372+0000 7fa4f6a00640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa4d80686e0 0x7fa4d806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:38.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.372+0000 7fa4f6a00640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa4d80686e0 0x7fa4d806aba0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa4f815d580 tx=0x7fa4e8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:38.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.376+0000 7fa4eea00640 1 -- 172.21.15.59:0/883020656 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa4f00567a0 con 0x7fa4f815ebf0 2024-05-30T16:53:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.568+0000 7fa4fdc00640 1 -- 172.21.15.59:0/883020656 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fa4f815e0f0 con 0x7fa4d80686e0 2024-05-30T16:53:38.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4eea00640 1 -- 172.21.15.59:0/883020656 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fa4f815e0f0 con 0x7fa4d80686e0 2024-05-30T16:53:38.574 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970 2024-05-30T16:53:38.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4fdc00640 1 -- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa4d80686e0 msgr2=0x7fa4d806aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:38.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4fdc00640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa4d80686e0 0x7fa4d806aba0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa4f815d580 tx=0x7fa4e8009190 comp rx=0 tx=0).stop 2024-05-30T16:53:38.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4fdc00640 1 -- 172.21.15.59:0/883020656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f815ebf0 msgr2=0x7fa4f815c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:38.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4fdc00640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f815ebf0 0x7fa4f815c7d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000cbb0 tx=0x7fa4f000a430 comp rx=0 tx=0).stop 2024-05-30T16:53:38.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4fdc00640 1 -- 172.21.15.59:0/883020656 shutdown_connections 2024-05-30T16:53:38.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4fdc00640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa4d80686e0 0x7fa4d806aba0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4fdc00640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f815ebf0 0x7fa4f815c7d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4fdc00640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f80b3ff0 0x7fa4f80b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4fdc00640 1 --2- 172.21.15.59:0/883020656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f814c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:38.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4fdc00640 1 -- 172.21.15.59:0/883020656 >> 172.21.15.59:0/883020656 conn(0x7fa4f806bdb0 msgr2=0x7fa4f8074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:38.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4fdc00640 1 -- 172.21.15.59:0/883020656 shutdown_connections 2024-05-30T16:53:38.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:38.572+0000 7fa4fdc00640 1 -- 172.21.15.59:0/883020656 wait complete. 2024-05-30T16:53:38.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:53:38.595 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970 2024-05-30T16:53:38.596 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T16:53:38.608 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970 2024-05-30T16:53:38.608 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="10654449664" 2024-05-30T16:53:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:53:38.609 INFO:tasks.cephfs.test_volumes:r_size = 10654449664 exp_size = 10737418240 2024-05-30T16:53:40.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:53:40.610 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970 2024-05-30T16:53:40.610 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T16:53:40.625 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970 2024-05-30T16:53:40.625 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="10654449664" 2024-05-30T16:53:40.625 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:53:40.626 INFO:tasks.cephfs.test_volumes:r_size = 10654449664 exp_size = 10737418240 2024-05-30T16:53:42.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:53:42.627 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970 2024-05-30T16:53:42.628 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T16:53:42.642 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/35d58d55-62f5-4062-9efa-c3a814f85970 2024-05-30T16:53:42.642 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="10737418240" 2024-05-30T16:53:42.642 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:53:42.643 INFO:tasks.cephfs.test_volumes:r_size = 10737418240 exp_size = 10737418240 2024-05-30T16:53:42.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69361 2024-05-30T16:53:42.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc7a800640 1 Processor -- start 2024-05-30T16:53:42.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc7a800640 1 -- start start 2024-05-30T16:53:42.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc7a800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbc740b44e0 0x7fbc7415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:42.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc7a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc7415f510 0x7fbc7415c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:42.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc7a800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc740b52d0 con 0x7fbc74159100 2024-05-30T16:53:42.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc7a800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbc740b4a30 con 0x7fbc740b44e0 2024-05-30T16:53:42.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc7a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbc740b4d10 con 0x7fbc7415f510 2024-05-30T16:53:42.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc73400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbc74159100 0x7fbc7406e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33944/0 (socket says 172.21.15.59:33944) 2024-05-30T16:53:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc73400640 1 -- 172.21.15.59:0/3201016267 learned_addr learned my addr 172.21.15.59:0/3201016267 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:53:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc73e00640 1 --2- 172.21.15.59:0/3201016267 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc7415f510 0x7fbc7415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72a00640 1 --2- 172.21.15.59:0/3201016267 >> v2:172.21.15.107:3300/0 conn(0x7fbc740b44e0 0x7fbc7415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2151872771 0 0) 0x7fbc740b52d0 con 0x7fbc74159100 2024-05-30T16:53:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc58003530 con 0x7fbc74159100 2024-05-30T16:53:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 902144627 0 0) 0x7fbc58003530 con 0x7fbc74159100 2024-05-30T16:53:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc7415f510 msgr2=0x7fbc7415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 --2- 172.21.15.59:0/3201016267 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc7415f510 0x7fbc7415c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 >> v2:172.21.15.107:3300/0 conn(0x7fbc740b44e0 msgr2=0x7fbc7415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 --2- 172.21.15.59:0/3201016267 >> v2:172.21.15.107:3300/0 conn(0x7fbc740b44e0 0x7fbc7415efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc740b4ff0 con 0x7fbc74159100 2024-05-30T16:53:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fbc64001680 con 0x7fbc74159100 2024-05-30T16:53:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 >> v1:172.21.15.59:6789/0 conn(0x7fbc74159100 legacy=0x7fbc7406e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 --2- 172.21.15.59:0/3201016267 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc7415f510 0x7fbc580039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 --2- 172.21.15.59:0/3201016267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc58003f40 0x7fbc58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 --2- 172.21.15.59:0/3201016267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc58004d50 0x7fbc580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbc740b4a30 con 0x7fbc58003f40 2024-05-30T16:53:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbc740b4d10 con 0x7fbc58004d50 2024-05-30T16:53:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5800ba20 con 0x7fbc7415f510 2024-05-30T16:53:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72a00640 1 --2- 172.21.15.59:0/3201016267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc58003f40 0x7fbc58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc73400640 1 --2- 172.21.15.59:0/3201016267 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc7415f510 0x7fbc580039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc73e00640 1 --2- 172.21.15.59:0/3201016267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc58004d50 0x7fbc580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72a00640 1 -- 172.21.15.59:0/3201016267 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc7415f510 msgr2=0x7fbc580039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72a00640 1 --2- 172.21.15.59:0/3201016267 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc7415f510 0x7fbc580039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72a00640 1 -- 172.21.15.59:0/3201016267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc58004d50 msgr2=0x7fbc580051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72a00640 1 --2- 172.21.15.59:0/3201016267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc58004d50 0x7fbc580051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.844+0000 7fbc72a00640 1 -- 172.21.15.59:0/3201016267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc58003530 con 0x7fbc58003f40 2024-05-30T16:53:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.848+0000 7fbc72a00640 1 --2- 172.21.15.59:0/3201016267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc58003f40 0x7fbc58004810 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbc60009b10 tx=0x7fbc6001ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125716755daaf2ee server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.848+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc600b2070 con 0x7fbc58003f40 2024-05-30T16:53:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.848+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc600a55f0 con 0x7fbc58003f40 2024-05-30T16:53:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.848+0000 7fbc72000640 1 -- 172.21.15.59:0/3201016267 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc600096b0 con 0x7fbc58003f40 2024-05-30T16:53:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.848+0000 7fbc7a800640 1 -- 172.21.15.59:0/3201016267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc58003f40 msgr2=0x7fbc58004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.848+0000 7fbc7a800640 1 --2- 172.21.15.59:0/3201016267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc58003f40 0x7fbc58004810 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbc60009b10 tx=0x7fbc6001ca80 comp rx=0 tx=0).stop 2024-05-30T16:53:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.848+0000 7fbc73e00640 1 -- 172.21.15.59:0/3201016267 reap_dead start 2024-05-30T16:53:42.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.848+0000 7fbc7a800640 1 -- 172.21.15.59:0/3201016267 shutdown_connections 2024-05-30T16:53:42.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.848+0000 7fbc7a800640 1 -- 172.21.15.59:0/3201016267 >> 172.21.15.59:0/3201016267 conn(0x7fbc7406bdb0 msgr2=0x7fbc7406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:42.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.848+0000 7fbc7a800640 1 -- 172.21.15.59:0/3201016267 shutdown_connections 2024-05-30T16:53:42.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.848+0000 7fbc7a800640 1 -- 172.21.15.59:0/3201016267 wait complete. 2024-05-30T16:53:42.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc7a800640 1 Processor -- start 2024-05-30T16:53:42.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc7a800640 1 -- start start 2024-05-30T16:53:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc7a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc58003f40 0x7fbc74150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc7a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc74151d80 0x7fbc740b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc7a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc740b1680 0x7fbc740b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc7a800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbc740b3530 con 0x7fbc58003f40 2024-05-30T16:53:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc7a800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbc740b33b0 con 0x7fbc740b1680 2024-05-30T16:53:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc7a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbc740b36b0 con 0x7fbc74151d80 2024-05-30T16:53:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc73400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc58003f40 0x7fbc74150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc73400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc58003f40 0x7fbc74150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49168/0 (socket says 172.21.15.59:49168) 2024-05-30T16:53:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc73400640 1 -- 172.21.15.59:0/3245409447 learned_addr learned my addr 172.21.15.59:0/3245409447 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc72a00640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc74151d80 0x7fbc740b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc73e00640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc740b1680 0x7fbc740b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc73400640 1 -- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc74151d80 msgr2=0x7fbc740b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc73400640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc74151d80 0x7fbc740b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:42.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc73400640 1 -- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc740b1680 msgr2=0x7fbc740b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:42.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc73400640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc740b1680 0x7fbc740b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:42.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc73400640 1 -- 172.21.15.59:0/3245409447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc74152210 con 0x7fbc58003f40 2024-05-30T16:53:42.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc73e00640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc740b1680 0x7fbc740b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:53:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc73400640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc58003f40 0x7fbc74150880 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbc64007310 tx=0x7fbc640077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc6b400640 1 -- 172.21.15.59:0/3245409447 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6400f9c0 con 0x7fbc58003f40 2024-05-30T16:53:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc6b400640 1 -- 172.21.15.59:0/3245409447 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc64018070 con 0x7fbc58003f40 2024-05-30T16:53:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc7a800640 1 -- 172.21.15.59:0/3245409447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc741524f0 con 0x7fbc58003f40 2024-05-30T16:53:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc6b400640 1 -- 172.21.15.59:0/3245409447 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6400fde0 con 0x7fbc58003f40 2024-05-30T16:53:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.852+0000 7fbc7a800640 1 -- 172.21.15.59:0/3245409447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc74152ab0 con 0x7fbc58003f40 2024-05-30T16:53:42.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.856+0000 7fbc7a800640 1 -- 172.21.15.59:0/3245409447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc74068a90 con 0x7fbc58003f40 2024-05-30T16:53:42.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.856+0000 7fbc6b400640 1 -- 172.21.15.59:0/3245409447 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) ==== 88293+0+0 (secure 0 0 0) 0x7fbc6401c410 con 0x7fbc58003f40 2024-05-30T16:53:42.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.856+0000 7fbc6b400640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbc540686b0 0x7fbc5406ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:42.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.856+0000 7fbc6b400640 1 -- 172.21.15.59:0/3245409447 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7fbc64086c60 con 0x7fbc58003f40 2024-05-30T16:53:42.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.856+0000 7fbc72a00640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbc540686b0 0x7fbc5406ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:42.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.856+0000 7fbc72a00640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbc540686b0 0x7fbc5406ab70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbc600af000 tx=0x7fbc600046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:42.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:42.860+0000 7fbc6b400640 1 -- 172.21.15.59:0/3245409447 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbc64056e00 con 0x7fbc58003f40 2024-05-30T16:53:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.060+0000 7fbc7a800640 1 -- 172.21.15.59:0/3245409447 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69361", "target": ["mon-mgr", ""]}) -- 0x7fbc740b3ee0 con 0x7fbc540686b0 2024-05-30T16:53:43.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.128+0000 7fbc6b400640 1 -- 172.21.15.59:0/3245409447 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbc740b3ee0 con 0x7fbc540686b0 2024-05-30T16:53:43.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.128+0000 7fbc7a800640 1 -- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbc540686b0 msgr2=0x7fbc5406ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:43.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.128+0000 7fbc7a800640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbc540686b0 0x7fbc5406ab70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbc600af000 tx=0x7fbc600046d0 comp rx=0 tx=0).stop 2024-05-30T16:53:43.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.128+0000 7fbc7a800640 1 -- 172.21.15.59:0/3245409447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc58003f40 msgr2=0x7fbc74150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:43.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.128+0000 7fbc7a800640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc58003f40 0x7fbc74150880 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbc64007310 tx=0x7fbc640077d0 comp rx=0 tx=0).stop 2024-05-30T16:53:43.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.128+0000 7fbc7a800640 1 -- 172.21.15.59:0/3245409447 shutdown_connections 2024-05-30T16:53:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.128+0000 7fbc7a800640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbc540686b0 0x7fbc5406ab70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.128+0000 7fbc7a800640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc740b1680 0x7fbc740b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.128+0000 7fbc7a800640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc74151d80 0x7fbc740b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.128+0000 7fbc7a800640 1 --2- 172.21.15.59:0/3245409447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc58003f40 0x7fbc74150880 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.128+0000 7fbc7a800640 1 -- 172.21.15.59:0/3245409447 >> 172.21.15.59:0/3245409447 conn(0x7fbc7406bdb0 msgr2=0x7fbc7415df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.132+0000 7fbc7a800640 1 -- 172.21.15.59:0/3245409447 shutdown_connections 2024-05-30T16:53:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.132+0000 7fbc7a800640 1 -- 172.21.15.59:0/3245409447 wait complete. 2024-05-30T16:53:43.134 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:43.130+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:43.135 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:43.130+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:43.135 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:43.130+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:43.135 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:43.130+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:43.135 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:43.130+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:43.151 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:43.146+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:43.151 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:43.146+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:43.151 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:43.146+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:43.151 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:43.146+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:43.152 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:43.146+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:43.153 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69362 2024-05-30T16:53:43.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.300+0000 7f01cdc00640 1 Processor -- start 2024-05-30T16:53:43.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.300+0000 7f01cdc00640 1 -- start start 2024-05-30T16:53:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01cdc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01c815c010 0x7f01c815c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01cdc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c80b52d0 con 0x7f01c8159100 2024-05-30T16:53:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01cdc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c80b4a30 con 0x7f01c80b44e0 2024-05-30T16:53:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01cdc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f01c80b4d10 con 0x7f01c815c010 2024-05-30T16:53:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01c6a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f01c8159100 0x7f01c806e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33946/0 (socket says 172.21.15.59:33946) 2024-05-30T16:53:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01c6a00640 1 -- 172.21.15.59:0/4019817369 learned_addr learned my addr 172.21.15.59:0/4019817369 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:53:43.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01c7400640 1 --2- 172.21.15.59:0/4019817369 >> v2:172.21.15.59:3300/0 conn(0x7f01c815c010 0x7f01c815c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:43.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01c6000640 1 -- 172.21.15.59:0/4019817369 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1775552480 0 0) 0x7f01c80b52d0 con 0x7f01c8159100 2024-05-30T16:53:43.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01c6000640 1 -- 172.21.15.59:0/4019817369 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01ac003530 con 0x7f01c8159100 2024-05-30T16:53:43.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01c7400640 1 -- 172.21.15.59:0/4019817369 >> v1:172.21.15.107:6789/0 conn(0x7f01c80b44e0 legacy=0x7f01c815efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:43.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01c6000640 1 -- 172.21.15.59:0/4019817369 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4086756863 0 0) 0x7f01c80b4a30 con 0x7f01c80b44e0 2024-05-30T16:53:43.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01c7400640 1 -- 172.21.15.59:0/4019817369 >> v1:172.21.15.59:6789/0 conn(0x7f01c8159100 legacy=0x7f01c806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:43.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01c7400640 1 -- 172.21.15.59:0/4019817369 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c80b4ff0 con 0x7f01c815c010 2024-05-30T16:53:43.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.304+0000 7f01c7400640 1 --2- 172.21.15.59:0/4019817369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c815c010 0x7f01c815c440 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009d90 tx=0x7f01c001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff1e776a5625403 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01c6000640 1 -- 172.21.15.59:0/4019817369 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c00b2070 con 0x7f01c815c010 2024-05-30T16:53:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01c6000640 1 -- 172.21.15.59:0/4019817369 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01c00a57b0 con 0x7f01c815c010 2024-05-30T16:53:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01c6000640 1 -- 172.21.15.59:0/4019817369 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c00a5b80 con 0x7f01c815c010 2024-05-30T16:53:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01cdc00640 1 -- 172.21.15.59:0/4019817369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c815c010 msgr2=0x7f01c815c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:43.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01cdc00640 1 --2- 172.21.15.59:0/4019817369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c815c010 0x7f01c815c440 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009d90 tx=0x7f01c001c8e0 comp rx=0 tx=0).stop 2024-05-30T16:53:43.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01cdc00640 1 -- 172.21.15.59:0/4019817369 shutdown_connections 2024-05-30T16:53:43.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01cdc00640 1 --2- 172.21.15.59:0/4019817369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c815c010 0x7f01c815c440 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:43.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01cdc00640 1 -- 172.21.15.59:0/4019817369 >> 172.21.15.59:0/4019817369 conn(0x7f01c806bdb0 msgr2=0x7f01c806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:43.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01cdc00640 1 -- 172.21.15.59:0/4019817369 shutdown_connections 2024-05-30T16:53:43.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01cdc00640 1 -- 172.21.15.59:0/4019817369 wait complete. 2024-05-30T16:53:43.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01cdc00640 1 Processor -- start 2024-05-30T16:53:43.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01cdc00640 1 -- start start 2024-05-30T16:53:43.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01cdc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01c80b44e0 0x7f01c8157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01c6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01c80b44e0 0x7f01c8157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.308+0000 7f01c6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01c80b44e0 0x7f01c8157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:43700/0 (socket says 172.21.15.59:43700) 2024-05-30T16:53:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01cdc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01c8159100 0x7f01c814c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01c6a00640 1 -- 172.21.15.59:0/1271473284 learned_addr learned my addr 172.21.15.59:0/1271473284 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01cdc00640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c815c010 0x7f01c8071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f01c81694e0 con 0x7f01c815c010 2024-05-30T16:53:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8169360 con 0x7f01c80b44e0 2024-05-30T16:53:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f01c8169660 con 0x7f01c8159100 2024-05-30T16:53:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01c7400640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c815c010 0x7f01c8071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01be000640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01c8159100 0x7f01c814c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01c6a00640 1 -- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01c8159100 msgr2=0x7f01c814c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01c6a00640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01c8159100 0x7f01c814c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01c6a00640 1 -- 172.21.15.59:0/1271473284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c815c010 msgr2=0x7f01c8071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01c6a00640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c815c010 0x7f01c8071cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01c6a00640 1 -- 172.21.15.59:0/1271473284 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c8156510 con 0x7f01c80b44e0 2024-05-30T16:53:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01c6a00640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01c80b44e0 0x7f01c8157e00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f01b800c450 tx=0x7f01b800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01bf400640 1 -- 172.21.15.59:0/1271473284 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8017070 con 0x7f01c80b44e0 2024-05-30T16:53:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01bf400640 1 -- 172.21.15.59:0/1271473284 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b8005cf0 con 0x7f01c80b44e0 2024-05-30T16:53:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01bf400640 1 -- 172.21.15.59:0/1271473284 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8007290 con 0x7f01c80b44e0 2024-05-30T16:53:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c81567f0 con 0x7f01c80b44e0 2024-05-30T16:53:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c815ad40 con 0x7f01c80b44e0 2024-05-30T16:53:43.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c8156330 con 0x7f01c80b44e0 2024-05-30T16:53:43.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.312+0000 7f01bf400640 1 -- 172.21.15.59:0/1271473284 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 9) ==== 88293+0+0 (secure 0 0 0) 0x7f01b801a070 con 0x7f01c80b44e0 2024-05-30T16:53:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.316+0000 7f01bf400640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f01a40686e0 0x7f01a406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.316+0000 7f01bf400640 1 -- 172.21.15.59:0/1271473284 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f01b8086350 con 0x7f01c80b44e0 2024-05-30T16:53:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.316+0000 7f01be000640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f01a40686e0 0x7f01a406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.316+0000 7f01be000640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f01a40686e0 0x7f01a406aba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f01c814d040 tx=0x7f01b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.320+0000 7f01bf400640 1 -- 172.21.15.59:0/1271473284 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01c8156330 con 0x7f01c80b44e0 2024-05-30T16:53:43.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:43.516+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69362", "target": ["mon-mgr", ""]}) -- 0x7f01c8068a90 con 0x7f01a40686e0 2024-05-30T16:53:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.044+0000 7f01bf400640 1 -- 172.21.15.59:0/1271473284 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 10) ==== 88344+0+0 (secure 0 0 0) 0x7f01b80523f0 con 0x7f01c80b44e0 2024-05-30T16:53:44.135 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:44.130+0000 7efd4fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:44.135 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:44.130+0000 7efd4fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:44.135 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:44.130+0000 7efd4fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:44.135 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:44.130+0000 7efd4fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:44.135 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:44.130+0000 7efd4fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:44.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.204+0000 7f01bf400640 1 -- 172.21.15.59:0/1271473284 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f01c8068a90 con 0x7f01a40686e0 2024-05-30T16:53:44.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.208+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f01a40686e0 msgr2=0x7f01a406aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:44.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.208+0000 7f01cdc00640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f01a40686e0 0x7f01a406aba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f01c814d040 tx=0x7f01b0009040 comp rx=0 tx=0).stop 2024-05-30T16:53:44.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.208+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01c80b44e0 msgr2=0x7f01c8157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:44.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.208+0000 7f01cdc00640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01c80b44e0 0x7f01c8157e00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f01b800c450 tx=0x7f01b800c910 comp rx=0 tx=0).stop 2024-05-30T16:53:44.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.208+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 shutdown_connections 2024-05-30T16:53:44.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.208+0000 7f01cdc00640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f01a40686e0 0x7f01a406aba0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:44.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.208+0000 7f01cdc00640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c815c010 0x7f01c8071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:44.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.208+0000 7f01cdc00640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01c8159100 0x7f01c814c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:44.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.208+0000 7f01cdc00640 1 --2- 172.21.15.59:0/1271473284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01c80b44e0 0x7f01c8157e00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:44.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.208+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 >> 172.21.15.59:0/1271473284 conn(0x7f01c806bdb0 msgr2=0x7f01c806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:44.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.208+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 shutdown_connections 2024-05-30T16:53:44.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.208+0000 7f01cdc00640 1 -- 172.21.15.59:0/1271473284 wait complete. 2024-05-30T16:53:44.230 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:44.226+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:44.230 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:44.226+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:44.230 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:44.226+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:44.231 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:44.226+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:44.231 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:44.226+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:44.237 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69363 2024-05-30T16:53:44.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.488+0000 7f7b0f200640 1 Processor -- start 2024-05-30T16:53:44.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.488+0000 7f7b0f200640 1 -- start start 2024-05-30T16:53:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.488+0000 7f7b0f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b100ce960 0x7f7b1009b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.488+0000 7f7b0f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1009b900 con 0x7f7b1015c7b0 2024-05-30T16:53:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.488+0000 7f7b0f200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1009bbe0 con 0x7f7b100d0f30 2024-05-30T16:53:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.488+0000 7f7b0f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1015cb90 con 0x7f7b100ce960 2024-05-30T16:53:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0de00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7b1015c7b0 0x7f7b100d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33956/0 (socket says 172.21.15.59:33956) 2024-05-30T16:53:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0de00640 1 -- 172.21.15.59:0/1897263005 learned_addr learned my addr 172.21.15.59:0/1897263005 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:53:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0e800640 1 --2- 172.21.15.59:0/1897263005 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b100ce960 0x7f7b1009b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716547806 0 0) 0x7f7b1009b900 con 0x7f7b1015c7b0 2024-05-30T16:53:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7af4003530 con 0x7f7b1015c7b0 2024-05-30T16:53:44.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 387771950 0 0) 0x7f7af4003530 con 0x7f7b1015c7b0 2024-05-30T16:53:44.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b100ce960 msgr2=0x7f7b1009b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:44.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 --2- 172.21.15.59:0/1897263005 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b100ce960 0x7f7b1009b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:44.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 >> v1:172.21.15.107:6789/0 conn(0x7f7b100d0f30 legacy=0x7f7b1009ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b100cd150 con 0x7f7b1015c7b0 2024-05-30T16:53:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f7b00001680 con 0x7f7b1015c7b0 2024-05-30T16:53:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 >> v1:172.21.15.59:6789/0 conn(0x7f7b1015c7b0 legacy=0x7f7b100d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 --2- 172.21.15.59:0/1897263005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40039f0 0x7f7af4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 --2- 172.21.15.59:0/1897263005 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7af4004810 0x7f7af4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 --2- 172.21.15.59:0/1897263005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7af40051d0 0x7f7af40079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1015cb90 con 0x7f7af40039f0 2024-05-30T16:53:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7af4008020 con 0x7f7af40051d0 2024-05-30T16:53:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7af40081d0 con 0x7f7af4004810 2024-05-30T16:53:44.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0de00640 1 --2- 172.21.15.59:0/1897263005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40039f0 0x7f7af4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:44.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0de00640 1 -- 172.21.15.59:0/1897263005 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7af4004810 msgr2=0x7f7af4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:44.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0de00640 1 --2- 172.21.15.59:0/1897263005 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7af4004810 0x7f7af4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:44.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0de00640 1 -- 172.21.15.59:0/1897263005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7af40051d0 msgr2=0x7f7af40079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:44.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0de00640 1 --2- 172.21.15.59:0/1897263005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7af40051d0 0x7f7af40079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:44.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.492+0000 7f7b0de00640 1 -- 172.21.15.59:0/1897263005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af4003530 con 0x7f7af40039f0 2024-05-30T16:53:44.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.496+0000 7f7b0de00640 1 --2- 172.21.15.59:0/1897263005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40039f0 0x7f7af4003df0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c160 tx=0x7f7b0001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbd5c9eb3239c2d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:44.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.496+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00007c90 con 0x7f7af40039f0 2024-05-30T16:53:44.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.496+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b000a9070 con 0x7f7af40039f0 2024-05-30T16:53:44.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.496+0000 7f7b0ca00640 1 -- 172.21.15.59:0/1897263005 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00005ae0 con 0x7f7af40039f0 2024-05-30T16:53:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 -- 172.21.15.59:0/1897263005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40039f0 msgr2=0x7f7af4003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 --2- 172.21.15.59:0/1897263005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40039f0 0x7f7af4003df0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c160 tx=0x7f7b0001cba0 comp rx=0 tx=0).stop 2024-05-30T16:53:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0e800640 1 -- 172.21.15.59:0/1897263005 reap_dead start 2024-05-30T16:53:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 -- 172.21.15.59:0/1897263005 shutdown_connections 2024-05-30T16:53:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 -- 172.21.15.59:0/1897263005 >> 172.21.15.59:0/1897263005 conn(0x7f7b100b3ec0 msgr2=0x7f7b100b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 -- 172.21.15.59:0/1897263005 shutdown_connections 2024-05-30T16:53:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 -- 172.21.15.59:0/1897263005 wait complete. 2024-05-30T16:53:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 Processor -- start 2024-05-30T16:53:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 -- start start 2024-05-30T16:53:44.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7af40039f0 0x7f7b101563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:44.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b100c94a0 0x7f7b100cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b10152940 0x7f7b100cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10166100 con 0x7f7b10152940 2024-05-30T16:53:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10165f80 con 0x7f7af40039f0 2024-05-30T16:53:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7b10166280 con 0x7f7b100c94a0 2024-05-30T16:53:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b10152940 0x7f7b100cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b10152940 0x7f7b100cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49212/0 (socket says 172.21.15.59:49212) 2024-05-30T16:53:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.500+0000 7f7b0e800640 1 -- 172.21.15.59:0/818822718 learned_addr learned my addr 172.21.15.59:0/818822718 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b0de00640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7af40039f0 0x7f7b101563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b0d400640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b100c94a0 0x7f7b100cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:44.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b0e800640 1 -- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b100c94a0 msgr2=0x7f7b100cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:44.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b0e800640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b100c94a0 0x7f7b100cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:44.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b0e800640 1 -- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7af40039f0 msgr2=0x7f7b101563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:44.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b0e800640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7af40039f0 0x7f7b101563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:44.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b0e800640 1 -- 172.21.15.59:0/818822718 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b100c9a60 con 0x7f7b10152940 2024-05-30T16:53:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b0e800640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b10152940 0x7f7b100cb8e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7b100ced90 tx=0x7f7b0800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b06000640 1 -- 172.21.15.59:0/818822718 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0800cc80 con 0x7f7b10152940 2024-05-30T16:53:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b06000640 1 -- 172.21.15.59:0/818822718 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0801a070 con 0x7f7b10152940 2024-05-30T16:53:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b06000640 1 -- 172.21.15.59:0/818822718 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08014480 con 0x7f7b10152940 2024-05-30T16:53:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b0f200640 1 -- 172.21.15.59:0/818822718 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b100c9d40 con 0x7f7b10152940 2024-05-30T16:53:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b0f200640 1 -- 172.21.15.59:0/818822718 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b100ca300 con 0x7f7b10152940 2024-05-30T16:53:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.504+0000 7f7b0f200640 1 -- 172.21.15.59:0/818822718 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b10068a90 con 0x7f7b10152940 2024-05-30T16:53:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.508+0000 7f7b06000640 1 -- 172.21.15.59:0/818822718 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) ==== 88344+0+0 (secure 0 0 0) 0x7f7b08012050 con 0x7f7b10152940 2024-05-30T16:53:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.508+0000 7f7b06000640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7af00687a0 0x7f7af006ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.508+0000 7f7b06000640 1 -- 172.21.15.59:0/818822718 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f7b080876d0 con 0x7f7b10152940 2024-05-30T16:53:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.512+0000 7f7b0de00640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7af00687a0 0x7f7af006ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.512+0000 7f7b0de00640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7af00687a0 0x7f7af006ac60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7b000ab000 tx=0x7f7b000b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:44.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.516+0000 7f7b06000640 1 -- 172.21.15.59:0/818822718 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b08024020 con 0x7f7b10152940 2024-05-30T16:53:44.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:44.856+0000 7f7b0f200640 1 -- 172.21.15.59:0/818822718 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69363", "target": ["mon-mgr", ""]}) -- 0x7f7b100b4b20 con 0x7f7af00687a0 2024-05-30T16:53:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.536+0000 7f7b06000640 1 -- 172.21.15.59:0/818822718 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7b100b4b20 con 0x7f7af00687a0 2024-05-30T16:53:45.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.540+0000 7f7b0f200640 1 -- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7af00687a0 msgr2=0x7f7af006ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:45.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.540+0000 7f7b0f200640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7af00687a0 0x7f7af006ac60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7b000ab000 tx=0x7f7b000b1040 comp rx=0 tx=0).stop 2024-05-30T16:53:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.540+0000 7f7b0f200640 1 -- 172.21.15.59:0/818822718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b10152940 msgr2=0x7f7b100cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.540+0000 7f7b0f200640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b10152940 0x7f7b100cb8e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7b100ced90 tx=0x7f7b0800ef90 comp rx=0 tx=0).stop 2024-05-30T16:53:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.540+0000 7f7b0f200640 1 -- 172.21.15.59:0/818822718 shutdown_connections 2024-05-30T16:53:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.540+0000 7f7b0f200640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7af00687a0 0x7f7af006ac60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.540+0000 7f7b0f200640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b10152940 0x7f7b100cb8e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.540+0000 7f7b0f200640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b100c94a0 0x7f7b100cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.540+0000 7f7b0f200640 1 --2- 172.21.15.59:0/818822718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7af40039f0 0x7f7b101563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.540+0000 7f7b0f200640 1 -- 172.21.15.59:0/818822718 >> 172.21.15.59:0/818822718 conn(0x7f7b100b3ec0 msgr2=0x7f7b100b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.540+0000 7f7b0f200640 1 -- 172.21.15.59:0/818822718 shutdown_connections 2024-05-30T16:53:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.540+0000 7f7b0f200640 1 -- 172.21.15.59:0/818822718 wait complete. 2024-05-30T16:53:45.591 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69364 2024-05-30T16:53:45.597 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:45.594+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:45.597 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:45.594+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:45.597 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:45.594+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:45.597 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:45.594+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:45.597 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:45.594+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.852+0000 7effb8a00640 1 Processor -- start 2024-05-30T16:53:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.852+0000 7effb8a00640 1 -- start start 2024-05-30T16:53:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb8a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effb406b9b0 0x7effb40ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb8a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7effb40d1ad0 0x7effb4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb8a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb40d1f30 con 0x7effb406bd90 2024-05-30T16:53:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb8a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7effb40d21d0 con 0x7effb406b9b0 2024-05-30T16:53:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb8a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7effb40b5f30 con 0x7effb40d1ad0 2024-05-30T16:53:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb1e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effb406b9b0 0x7effb40ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb1e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effb406b9b0 0x7effb40ae2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49226/0 (socket says 172.21.15.59:49226) 2024-05-30T16:53:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb1e00640 1 -- 172.21.15.59:0/2258059239 learned_addr learned my addr 172.21.15.59:0/2258059239 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb1400640 1 --2- 172.21.15.59:0/2258059239 >> v2:172.21.15.107:3300/0 conn(0x7effb40d1ad0 0x7effb4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb1e00640 1 -- 172.21.15.59:0/2258059239 >> v2:172.21.15.107:3300/0 conn(0x7effb40d1ad0 msgr2=0x7effb4070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb1e00640 1 --2- 172.21.15.59:0/2258059239 >> v2:172.21.15.107:3300/0 conn(0x7effb40d1ad0 0x7effb4070b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb1e00640 1 -- 172.21.15.59:0/2258059239 >> v1:172.21.15.107:6789/0 conn(0x7effb406bd90 legacy=0x7effb406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.856+0000 7effb1e00640 1 -- 172.21.15.59:0/2258059239 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb40b6210 con 0x7effb406b9b0 2024-05-30T16:53:45.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.860+0000 7effb1e00640 1 --2- 172.21.15.59:0/2258059239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb406b9b0 0x7effb40ae2a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7effb4071830 tx=0x7effa401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1d49aa3d2d0d78 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:45.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.860+0000 7effb0a00640 1 -- 172.21.15.59:0/2258059239 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa40aa660 con 0x7effb406b9b0 2024-05-30T16:53:45.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.860+0000 7effb0a00640 1 -- 172.21.15.59:0/2258059239 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa40af070 con 0x7effb406b9b0 2024-05-30T16:53:45.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.860+0000 7effb0a00640 1 -- 172.21.15.59:0/2258059239 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa40aaa20 con 0x7effb406b9b0 2024-05-30T16:53:45.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.860+0000 7effb8a00640 1 -- 172.21.15.59:0/2258059239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb406b9b0 msgr2=0x7effb40ae2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:45.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.860+0000 7effb8a00640 1 --2- 172.21.15.59:0/2258059239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb406b9b0 0x7effb40ae2a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7effb4071830 tx=0x7effa401c4e0 comp rx=0 tx=0).stop 2024-05-30T16:53:45.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.860+0000 7effb8a00640 1 -- 172.21.15.59:0/2258059239 shutdown_connections 2024-05-30T16:53:45.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.860+0000 7effb8a00640 1 --2- 172.21.15.59:0/2258059239 >> v2:172.21.15.107:3300/0 conn(0x7effb40d1ad0 0x7effb4070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.860+0000 7effb8a00640 1 --2- 172.21.15.59:0/2258059239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb406b9b0 0x7effb40ae2a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.860+0000 7effb8a00640 1 -- 172.21.15.59:0/2258059239 >> 172.21.15.59:0/2258059239 conn(0x7effb409aa40 msgr2=0x7effb40b6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.860+0000 7effb8a00640 1 -- 172.21.15.59:0/2258059239 shutdown_connections 2024-05-30T16:53:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.860+0000 7effb8a00640 1 -- 172.21.15.59:0/2258059239 wait complete. 2024-05-30T16:53:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb8a00640 1 Processor -- start 2024-05-30T16:53:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb8a00640 1 -- start start 2024-05-30T16:53:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb8a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effb406b9b0 0x7effb415deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb8a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb406bd90 0x7effb4147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb8a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb40d1ad0 0x7effb4141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb8a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7effb4070070 con 0x7effb40d1ad0 2024-05-30T16:53:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb8a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7effb406fef0 con 0x7effb406b9b0 2024-05-30T16:53:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb8a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7effb416b410 con 0x7effb406bd90 2024-05-30T16:53:45.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb40d1ad0 0x7effb4141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:45.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb40d1ad0 0x7effb4141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49242/0 (socket says 172.21.15.59:49242) 2024-05-30T16:53:45.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb2800640 1 -- 172.21.15.59:0/1467905156 learned_addr learned my addr 172.21.15.59:0/1467905156 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:45.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb2800640 1 -- 172.21.15.59:0/1467905156 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb406bd90 msgr2=0x7effb4147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:45.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb2800640 1 --2- 172.21.15.59:0/1467905156 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb406bd90 0x7effb4147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:45.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb2800640 1 -- 172.21.15.59:0/1467905156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effb406b9b0 msgr2=0x7effb415deb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:53:45.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb2800640 1 --2- 172.21.15.59:0/1467905156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effb406b9b0 0x7effb415deb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:45.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.864+0000 7effb2800640 1 -- 172.21.15.59:0/1467905156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb409e1f0 con 0x7effb40d1ad0 2024-05-30T16:53:45.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.868+0000 7effb2800640 1 --2- 172.21.15.59:0/1467905156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb40d1ad0 0x7effb4141080 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7effac00c780 tx=0x7effac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:45.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.868+0000 7effaa000640 1 -- 172.21.15.59:0/1467905156 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac017070 con 0x7effb40d1ad0 2024-05-30T16:53:45.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.868+0000 7effaa000640 1 -- 172.21.15.59:0/1467905156 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effac003db0 con 0x7effb40d1ad0 2024-05-30T16:53:45.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.868+0000 7effaa000640 1 -- 172.21.15.59:0/1467905156 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac0052b0 con 0x7effb40d1ad0 2024-05-30T16:53:45.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.868+0000 7effb8a00640 1 -- 172.21.15.59:0/1467905156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb409e4d0 con 0x7effb40d1ad0 2024-05-30T16:53:45.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.868+0000 7effb8a00640 1 -- 172.21.15.59:0/1467905156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb409ea90 con 0x7effb40d1ad0 2024-05-30T16:53:45.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.868+0000 7effb8a00640 1 -- 172.21.15.59:0/1467905156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb40691a0 con 0x7effb40d1ad0 2024-05-30T16:53:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.872+0000 7effaa000640 1 -- 172.21.15.59:0/1467905156 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) ==== 88344+0+0 (secure 0 0 0) 0x7effac01a070 con 0x7effb40d1ad0 2024-05-30T16:53:45.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.876+0000 7effaa000640 1 --2- 172.21.15.59:0/1467905156 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff94068870 0x7eff9406ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:45.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.876+0000 7effaa000640 1 -- 172.21.15.59:0/1467905156 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7effac086f80 con 0x7effb40d1ad0 2024-05-30T16:53:45.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.876+0000 7effb1e00640 1 --2- 172.21.15.59:0/1467905156 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff94068870 0x7eff9406ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:45.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.880+0000 7effb1e00640 1 --2- 172.21.15.59:0/1467905156 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff94068870 0x7eff9406ad30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7effa40ae000 tx=0x7effa40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:45.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:45.880+0000 7effaa000640 1 -- 172.21.15.59:0/1467905156 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7effac0568f0 con 0x7effb40d1ad0 2024-05-30T16:53:46.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:46.100+0000 7effaa000640 1 -- 172.21.15.59:0/1467905156 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 11) ==== 88497+0+0 (secure 0 0 0) 0x7effac052f60 con 0x7effb40d1ad0 2024-05-30T16:53:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:46.216+0000 7effb8a00640 1 -- 172.21.15.59:0/1467905156 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69364", "target": ["mon-mgr", ""]}) -- 0x7effb413de30 con 0x7eff94068870 2024-05-30T16:53:47.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.064+0000 7effaa000640 1 -- 172.21.15.59:0/1467905156 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7effb413de30 con 0x7eff94068870 2024-05-30T16:53:47.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.064+0000 7effb8a00640 1 -- 172.21.15.59:0/1467905156 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff94068870 msgr2=0x7eff9406ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:47.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.064+0000 7effb8a00640 1 --2- 172.21.15.59:0/1467905156 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff94068870 0x7eff9406ad30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7effa40ae000 tx=0x7effa40a7000 comp rx=0 tx=0).stop 2024-05-30T16:53:47.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.064+0000 7effb8a00640 1 -- 172.21.15.59:0/1467905156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb40d1ad0 msgr2=0x7effb4141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:47.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.064+0000 7effb8a00640 1 --2- 172.21.15.59:0/1467905156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb40d1ad0 0x7effb4141080 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7effac00c780 tx=0x7effac00cc40 comp rx=0 tx=0).stop 2024-05-30T16:53:47.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.068+0000 7effb8a00640 1 -- 172.21.15.59:0/1467905156 shutdown_connections 2024-05-30T16:53:47.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.068+0000 7effb8a00640 1 --2- 172.21.15.59:0/1467905156 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff94068870 0x7eff9406ad30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.068+0000 7effb8a00640 1 --2- 172.21.15.59:0/1467905156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb40d1ad0 0x7effb4141080 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.068+0000 7effb8a00640 1 --2- 172.21.15.59:0/1467905156 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb406bd90 0x7effb4147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.068+0000 7effb8a00640 1 --2- 172.21.15.59:0/1467905156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effb406b9b0 0x7effb415deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.068+0000 7effb8a00640 1 -- 172.21.15.59:0/1467905156 >> 172.21.15.59:0/1467905156 conn(0x7effb409aa40 msgr2=0x7effb406c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:47.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.068+0000 7effb8a00640 1 -- 172.21.15.59:0/1467905156 shutdown_connections 2024-05-30T16:53:47.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.068+0000 7effb8a00640 1 -- 172.21.15.59:0/1467905156 wait complete. 2024-05-30T16:53:47.093 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:53:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.332+0000 7f123ae00640 1 Processor -- start 2024-05-30T16:53:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.332+0000 7f123ae00640 1 -- start start 2024-05-30T16:53:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f123ae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1234072220 0x7f12340b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f123ae00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f123406f620 con 0x7f1234071d70 2024-05-30T16:53:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f123ae00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12340b34c0 con 0x7f123415a800 2024-05-30T16:53:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f123ae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f123406f900 con 0x7f1234072220 2024-05-30T16:53:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1238e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1234072220 0x7f12340b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1238e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1234072220 0x7f12340b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:42574/0 (socket says 172.21.15.59:42574) 2024-05-30T16:53:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1238e00640 1 -- 172.21.15.59:0/1726426152 learned_addr learned my addr 172.21.15.59:0/1726426152 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1233400640 1 --1- 172.21.15.59:0/1726426152 >> v1:172.21.15.59:6789/0 conn(0x7f1234071d70 0x7f12340b3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33958/0 (socket says 172.21.15.59:33958) 2024-05-30T16:53:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2809064160 0 0) 0x7f123406f620 con 0x7f1234071d70 2024-05-30T16:53:47.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1218004640 con 0x7f1234071d70 2024-05-30T16:53:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 693202444 0 0) 0x7f1218004640 con 0x7f1234071d70 2024-05-30T16:53:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1234072220 msgr2=0x7f12340b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 --2- 172.21.15.59:0/1726426152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1234072220 0x7f12340b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 >> v1:172.21.15.107:6789/0 conn(0x7f123415a800 legacy=0x7f123406ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12340b37a0 con 0x7f1234071d70 2024-05-30T16:53:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f122c001a00 con 0x7f1234071d70 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 >> v1:172.21.15.59:6789/0 conn(0x7f1234071d70 legacy=0x7f12340b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 --2- 172.21.15.59:0/1726426152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1218004b00 0x7f1218004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 --2- 172.21.15.59:0/1726426152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1234072220 0x7f1218005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 --2- 172.21.15.59:0/1726426152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1218005e60 0x7f12180062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f123406f900 con 0x7f1218004b00 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f121800cb90 con 0x7f1218005e60 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.336+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f121800cd90 con 0x7f1234072220 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.340+0000 7f1233e00640 1 --2- 172.21.15.59:0/1726426152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1218004b00 0x7f1218004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.340+0000 7f1233e00640 1 -- 172.21.15.59:0/1726426152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1234072220 msgr2=0x7f1218005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.340+0000 7f1233e00640 1 --2- 172.21.15.59:0/1726426152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1234072220 0x7f1218005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.340+0000 7f1233e00640 1 -- 172.21.15.59:0/1726426152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1218005e60 msgr2=0x7f12180062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.340+0000 7f1233e00640 1 --2- 172.21.15.59:0/1726426152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1218005e60 0x7f12180062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.340+0000 7f1233e00640 1 -- 172.21.15.59:0/1726426152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12340b37a0 con 0x7f1218004b00 2024-05-30T16:53:47.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.344+0000 7f1233e00640 1 --2- 172.21.15.59:0/1726426152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1218004b00 0x7f1218004f00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1224001650 tx=0x7f122401c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20274793653605a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:47.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.344+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224001250 con 0x7f1218004b00 2024-05-30T16:53:47.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.344+0000 7f1232a00640 1 -- 172.21.15.59:0/1726426152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1224005270 con 0x7f1218004b00 2024-05-30T16:53:47.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.348+0000 7f123ae00640 1 -- 172.21.15.59:0/1726426152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1218004b00 msgr2=0x7f1218004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:47.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.348+0000 7f123ae00640 1 --2- 172.21.15.59:0/1726426152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1218004b00 0x7f1218004f00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1224001650 tx=0x7f122401c2d0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.348+0000 7f1238e00640 1 -- 172.21.15.59:0/1726426152 reap_dead start 2024-05-30T16:53:47.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.348+0000 7f123ae00640 1 -- 172.21.15.59:0/1726426152 shutdown_connections 2024-05-30T16:53:47.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.348+0000 7f123ae00640 1 -- 172.21.15.59:0/1726426152 >> 172.21.15.59:0/1726426152 conn(0x7f123406bb80 msgr2=0x7f123406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:47.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.348+0000 7f123ae00640 1 -- 172.21.15.59:0/1726426152 shutdown_connections 2024-05-30T16:53:47.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.348+0000 7f123ae00640 1 -- 172.21.15.59:0/1726426152 wait complete. 2024-05-30T16:53:47.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.352+0000 7f123ae00640 1 Processor -- start 2024-05-30T16:53:47.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.352+0000 7f123ae00640 1 -- start start 2024-05-30T16:53:47.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.356+0000 7f123ae00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1218004b00 0x7f12340cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:47.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.356+0000 7f123ae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12341f7d40 0x7f12340aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:47.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.356+0000 7f123ae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12340cea60 0x7f1234155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:47.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.356+0000 7f123ae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f12340cfbe0 con 0x7f12341f7d40 2024-05-30T16:53:47.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.356+0000 7f123ae00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1234072630 con 0x7f1218004b00 2024-05-30T16:53:47.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.356+0000 7f123ae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f12340cfd60 con 0x7f12340cea60 2024-05-30T16:53:47.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.356+0000 7f1233e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1218004b00 0x7f12340cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:47.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.356+0000 7f1233e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1218004b00 0x7f12340cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:43748/0 (socket says 172.21.15.59:43748) 2024-05-30T16:53:47.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.356+0000 7f1233e00640 1 -- 172.21.15.59:0/1108601634 learned_addr learned my addr 172.21.15.59:0/1108601634 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:47.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.360+0000 7f1233400640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12341f7d40 0x7f12340aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.360+0000 7f1233400640 1 -- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12340cea60 msgr2=0x7f1234155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.360+0000 7f1238e00640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12340cea60 0x7f1234155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.360+0000 7f1233400640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12340cea60 0x7f1234155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.360+0000 7f1233400640 1 -- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1218004b00 msgr2=0x7f12340cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.360+0000 7f1233400640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1218004b00 0x7f12340cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.360+0000 7f1233400640 1 -- 172.21.15.59:0/1108601634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12340cf320 con 0x7f12341f7d40 2024-05-30T16:53:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.360+0000 7f1238e00640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12340cea60 0x7f1234155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.364+0000 7f1233400640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12341f7d40 0x7f12340aede0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f122c00cbc0 tx=0x7f122c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:47.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.364+0000 7f122be00640 1 -- 172.21.15.59:0/1108601634 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c018070 con 0x7f12341f7d40 2024-05-30T16:53:47.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.364+0000 7f122be00640 1 -- 172.21.15.59:0/1108601634 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f122c004d70 con 0x7f12341f7d40 2024-05-30T16:53:47.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.364+0000 7f122be00640 1 -- 172.21.15.59:0/1108601634 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c00ad00 con 0x7f12341f7d40 2024-05-30T16:53:47.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.368+0000 7f123ae00640 1 -- 172.21.15.59:0/1108601634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12340cd3e0 con 0x7f12341f7d40 2024-05-30T16:53:47.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.368+0000 7f123ae00640 1 -- 172.21.15.59:0/1108601634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12340cd9a0 con 0x7f12341f7d40 2024-05-30T16:53:47.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.372+0000 7f123ae00640 1 -- 172.21.15.59:0/1108601634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12340cdba0 con 0x7f12341f7d40 2024-05-30T16:53:47.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.372+0000 7f122be00640 1 -- 172.21.15.59:0/1108601634 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 11) ==== 88497+0+0 (secure 0 0 0) 0x7f122c01b070 con 0x7f12341f7d40 2024-05-30T16:53:47.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.376+0000 7f122be00640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12100689f0 0x7f121006aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:47.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.376+0000 7f122be00640 1 -- 172.21.15.59:0/1108601634 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f122c086e70 con 0x7f12341f7d40 2024-05-30T16:53:47.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.388+0000 7f122be00640 1 -- 172.21.15.59:0/1108601634 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12340cdba0 con 0x7f12341f7d40 2024-05-30T16:53:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.424+0000 7f1233e00640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12100689f0 0x7f121006aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.452+0000 7f1233e00640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12100689f0 0x7f121006aeb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1224007bd0 tx=0x7f12240b0040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:47.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.860+0000 7f123ae00640 1 -- 172.21.15.59:0/1108601634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1234068a90 con 0x7f12341f7d40 2024-05-30T16:53:47.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.860+0000 7f122be00640 1 -- 172.21.15.59:0/1108601634 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2064 (secure 0 0 0) 0x7f122c056550 con 0x7f12341f7d40 2024-05-30T16:53:47.862 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:53:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 307, 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 49, 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:53:47.864 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 2585, 2024-05-30T16:53:47.865 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 10738552324, 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 21783986176, 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 751310127104, 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 77579797, 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 19 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 26, 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 3, 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:53:47.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 3, 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5304 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:53:47.867 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 8, 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:53:19.132075+0000", 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: "6a26690c-32f2-46e2-957d-eb8bb7219da5": { 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "1 ongoing clones; Avg progress is 0.0% (0s)\n [............................] ", 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0, 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:47.868 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:47.869 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:53:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.864+0000 7f123ae00640 1 -- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12100689f0 msgr2=0x7f121006aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.864+0000 7f123ae00640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12100689f0 0x7f121006aeb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1224007bd0 tx=0x7f12240b0040 comp rx=0 tx=0).stop 2024-05-30T16:53:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.864+0000 7f123ae00640 1 -- 172.21.15.59:0/1108601634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12341f7d40 msgr2=0x7f12340aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.864+0000 7f123ae00640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12341f7d40 0x7f12340aede0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f122c00cbc0 tx=0x7f122c00a430 comp rx=0 tx=0).stop 2024-05-30T16:53:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.864+0000 7f123ae00640 1 -- 172.21.15.59:0/1108601634 shutdown_connections 2024-05-30T16:53:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.864+0000 7f123ae00640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f12100689f0 0x7f121006aeb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.864+0000 7f123ae00640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12340cea60 0x7f1234155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.864+0000 7f123ae00640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12341f7d40 0x7f12340aede0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.864+0000 7f123ae00640 1 --2- 172.21.15.59:0/1108601634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1218004b00 0x7f12340cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.864+0000 7f123ae00640 1 -- 172.21.15.59:0/1108601634 >> 172.21.15.59:0/1108601634 conn(0x7f123406bb80 msgr2=0x7f12340b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.864+0000 7f123ae00640 1 -- 172.21.15.59:0/1108601634 shutdown_connections 2024-05-30T16:53:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:47.864+0000 7f123ae00640 1 -- 172.21.15.59:0/1108601634 wait complete. 2024-05-30T16:53:47.897 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69361 2024-05-30T16:53:48.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.144+0000 7fd0ece00640 1 Processor -- start 2024-05-30T16:53:48.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.144+0000 7fd0ece00640 1 -- start start 2024-05-30T16:53:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.144+0000 7fd0ece00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0e8161d90 0x7fd0e80b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.144+0000 7fd0ece00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0e806d500 0x7fd0e80d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.148+0000 7fd0ece00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e80d0340 con 0x7fd0e80d2e70 2024-05-30T16:53:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.148+0000 7fd0ece00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e8162170 con 0x7fd0e8161d90 2024-05-30T16:53:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.148+0000 7fd0ece00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e809b580 con 0x7fd0e806d500 2024-05-30T16:53:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.148+0000 7fd0e7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0e8161d90 0x7fd0e80b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:48.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.148+0000 7fd0e7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0e8161d90 0x7fd0e80b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49264/0 (socket says 172.21.15.59:49264) 2024-05-30T16:53:48.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.148+0000 7fd0e7400640 1 -- 172.21.15.59:0/1539103909 learned_addr learned my addr 172.21.15.59:0/1539103909 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:48.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.148+0000 7fd0e7400640 1 -- 172.21.15.59:0/1539103909 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0e806d500 msgr2=0x7fd0e80d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:48.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.148+0000 7fd0e7400640 1 --2- 172.21.15.59:0/1539103909 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0e806d500 0x7fd0e80d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:48.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.148+0000 7fd0e7400640 1 -- 172.21.15.59:0/1539103909 >> v1:172.21.15.107:6789/0 conn(0x7fd0e80d2e70 legacy=0x7fd0e806cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:48.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.148+0000 7fd0e7400640 1 -- 172.21.15.59:0/1539103909 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e809b860 con 0x7fd0e8161d90 2024-05-30T16:53:48.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.152+0000 7fd0e7400640 1 --2- 172.21.15.59:0/1539103909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e8161d90 0x7fd0e80b11f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009870 tx=0x7fd0d801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee773c91f2a65c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:48.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.160+0000 7fd0e6000640 1 -- 172.21.15.59:0/1539103909 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80b0070 con 0x7fd0e8161d90 2024-05-30T16:53:48.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.160+0000 7fd0e6000640 1 -- 172.21.15.59:0/1539103909 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d80ab600 con 0x7fd0e8161d90 2024-05-30T16:53:48.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.160+0000 7fd0e6000640 1 -- 172.21.15.59:0/1539103909 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80ab9d0 con 0x7fd0e8161d90 2024-05-30T16:53:48.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.160+0000 7fd0ece00640 1 -- 172.21.15.59:0/1539103909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e8161d90 msgr2=0x7fd0e80b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:48.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.160+0000 7fd0ece00640 1 --2- 172.21.15.59:0/1539103909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e8161d90 0x7fd0e80b11f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009870 tx=0x7fd0d801c4d0 comp rx=0 tx=0).stop 2024-05-30T16:53:48.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.160+0000 7fd0ece00640 1 -- 172.21.15.59:0/1539103909 shutdown_connections 2024-05-30T16:53:48.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.160+0000 7fd0ece00640 1 --2- 172.21.15.59:0/1539103909 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0e806d500 0x7fd0e80d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:48.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.160+0000 7fd0ece00640 1 --2- 172.21.15.59:0/1539103909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e8161d90 0x7fd0e80b11f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:48.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.160+0000 7fd0ece00640 1 -- 172.21.15.59:0/1539103909 >> 172.21.15.59:0/1539103909 conn(0x7fd0e80d2350 msgr2=0x7fd0e80d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:48.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.160+0000 7fd0ece00640 1 -- 172.21.15.59:0/1539103909 shutdown_connections 2024-05-30T16:53:48.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.160+0000 7fd0ece00640 1 -- 172.21.15.59:0/1539103909 wait complete. 2024-05-30T16:53:48.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.164+0000 7fd0ece00640 1 Processor -- start 2024-05-30T16:53:48.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.164+0000 7fd0ece00640 1 -- start start 2024-05-30T16:53:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0ece00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e806d500 0x7fd0e80b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0ece00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0e80d2e70 0x7fd0e80c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0ece00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8161d90 0x7fd0e815a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0ece00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e80d1940 con 0x7fd0e806d500 2024-05-30T16:53:48.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0ece00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e80d17c0 con 0x7fd0e8161d90 2024-05-30T16:53:48.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0ece00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e816b730 con 0x7fd0e80d2e70 2024-05-30T16:53:48.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e806d500 0x7fd0e80b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:48.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e806d500 0x7fd0e80b51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49278/0 (socket says 172.21.15.59:49278) 2024-05-30T16:53:48.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0e7400640 1 -- 172.21.15.59:0/3307918221 learned_addr learned my addr 172.21.15.59:0/3307918221 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0e7400640 1 -- 172.21.15.59:0/3307918221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0e80d2e70 msgr2=0x7fd0e80c8550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T16:53:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0e7400640 1 --2- 172.21.15.59:0/3307918221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0e80d2e70 0x7fd0e80c8550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0e7400640 1 -- 172.21.15.59:0/3307918221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8161d90 msgr2=0x7fd0e815a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0e7400640 1 --2- 172.21.15.59:0/3307918221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8161d90 0x7fd0e815a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0e7400640 1 -- 172.21.15.59:0/3307918221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e80c8bc0 con 0x7fd0e806d500 2024-05-30T16:53:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.168+0000 7fd0e7400640 1 --2- 172.21.15.59:0/3307918221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e806d500 0x7fd0e80b51a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80ae040 tx=0x7fd0d801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:48.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.172+0000 7fd0df400640 1 -- 172.21.15.59:0/3307918221 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80ba020 con 0x7fd0e806d500 2024-05-30T16:53:48.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.172+0000 7fd0df400640 1 -- 172.21.15.59:0/3307918221 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d80abe30 con 0x7fd0e806d500 2024-05-30T16:53:48.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.172+0000 7fd0df400640 1 -- 172.21.15.59:0/3307918221 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80b0040 con 0x7fd0e806d500 2024-05-30T16:53:48.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.172+0000 7fd0ece00640 1 -- 172.21.15.59:0/3307918221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e80ca710 con 0x7fd0e806d500 2024-05-30T16:53:48.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.172+0000 7fd0ece00640 1 -- 172.21.15.59:0/3307918221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e8158a70 con 0x7fd0e806d500 2024-05-30T16:53:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.172+0000 7fd0ece00640 1 -- 172.21.15.59:0/3307918221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e8068a90 con 0x7fd0e806d500 2024-05-30T16:53:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.176+0000 7fd0df400640 1 -- 172.21.15.59:0/3307918221 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 12) ==== 88548+0+0 (secure 0 0 0) 0x7fd0d80bd020 con 0x7fd0e806d500 2024-05-30T16:53:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.180+0000 7fd0df400640 1 --2- 172.21.15.59:0/3307918221 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd0c8068ab0 0x7fd0c806af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.180+0000 7fd0df400640 1 -- 172.21.15.59:0/3307918221 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7fd0d81218d0 con 0x7fd0e806d500 2024-05-30T16:53:48.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.188+0000 7fd0df400640 1 -- 172.21.15.59:0/3307918221 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd0d80c4030 con 0x7fd0e806d500 2024-05-30T16:53:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.196+0000 7fd0e6a00640 1 --2- 172.21.15.59:0/3307918221 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd0c8068ab0 0x7fd0c806af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:48.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.200+0000 7fd0e6a00640 1 --2- 172.21.15.59:0/3307918221 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd0c8068ab0 0x7fd0c806af70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd0e81fed50 tx=0x7fd0d40079e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:48.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:48.512+0000 7fd0ece00640 1 -- 172.21.15.59:0/3307918221 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69361", "target": ["mon-mgr", ""]}) -- 0x7fd0e80b82d0 con 0x7fd0c8068ab0 2024-05-30T16:53:48.665 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:48.662+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:48.665 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:48.662+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:48.665 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:48.662+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:48.666 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:48.662+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:48.666 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:53:48.662+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:53:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.296+0000 7fd0df400640 1 -- 172.21.15.59:0/3307918221 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7fd0d80ed590 con 0x7fd0e806d500 2024-05-30T16:53:49.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.936+0000 7fd0df400640 1 -- 172.21.15.59:0/3307918221 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd0e80b82d0 con 0x7fd0c8068ab0 2024-05-30T16:53:49.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.940+0000 7fd0ece00640 1 -- 172.21.15.59:0/3307918221 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd0c8068ab0 msgr2=0x7fd0c806af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:49.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.940+0000 7fd0ece00640 1 --2- 172.21.15.59:0/3307918221 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd0c8068ab0 0x7fd0c806af70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd0e81fed50 tx=0x7fd0d40079e0 comp rx=0 tx=0).stop 2024-05-30T16:53:49.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.940+0000 7fd0ece00640 1 -- 172.21.15.59:0/3307918221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e806d500 msgr2=0x7fd0e80b51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:49.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.940+0000 7fd0ece00640 1 --2- 172.21.15.59:0/3307918221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e806d500 0x7fd0e80b51a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80ae040 tx=0x7fd0d801ad10 comp rx=0 tx=0).stop 2024-05-30T16:53:49.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.940+0000 7fd0ece00640 1 -- 172.21.15.59:0/3307918221 shutdown_connections 2024-05-30T16:53:49.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.940+0000 7fd0ece00640 1 --2- 172.21.15.59:0/3307918221 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd0c8068ab0 0x7fd0c806af70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:49.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.940+0000 7fd0ece00640 1 --2- 172.21.15.59:0/3307918221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8161d90 0x7fd0e815a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:49.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.940+0000 7fd0ece00640 1 --2- 172.21.15.59:0/3307918221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0e80d2e70 0x7fd0e80c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:49.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.940+0000 7fd0ece00640 1 --2- 172.21.15.59:0/3307918221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e806d500 0x7fd0e80b51a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:49.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.940+0000 7fd0ece00640 1 -- 172.21.15.59:0/3307918221 >> 172.21.15.59:0/3307918221 conn(0x7fd0e80d2350 msgr2=0x7fd0e809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:49.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.940+0000 7fd0ece00640 1 -- 172.21.15.59:0/3307918221 shutdown_connections 2024-05-30T16:53:49.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:49.940+0000 7fd0ece00640 1 -- 172.21.15.59:0/3307918221 wait complete. 2024-05-30T16:53:49.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69362 2024-05-30T16:53:50.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.268+0000 7f7d4a400640 1 Processor -- start 2024-05-30T16:53:50.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.268+0000 7f7d4a400640 1 -- start start 2024-05-30T16:53:50.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.272+0000 7f7d4a400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7d440d0d70 0x7f7d44162b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:50.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.272+0000 7f7d4a400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d440b32d0 0x7f7d440b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:50.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.272+0000 7f7d4a400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d440b3fc0 con 0x7f7d44162780 2024-05-30T16:53:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.272+0000 7f7d4a400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f7d440b42a0 con 0x7f7d440b32d0 2024-05-30T16:53:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.272+0000 7f7d4a400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7d4406ddb0 con 0x7f7d440d0d70 2024-05-30T16:53:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.272+0000 7f7d43400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7d44162780 0x7f7d440d0660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33974/0 (socket says 172.21.15.59:33974) 2024-05-30T16:53:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.272+0000 7f7d43400640 1 -- 172.21.15.59:0/4207497041 learned_addr learned my addr 172.21.15.59:0/4207497041 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:53:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.272+0000 7f7d43e00640 1 --2- 172.21.15.59:0/4207497041 >> v2:172.21.15.59:3300/0 conn(0x7f7d440b32d0 0x7f7d440b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.276+0000 7f7d42a00640 1 --2- 172.21.15.59:0/4207497041 >> v2:172.21.15.107:3300/0 conn(0x7f7d440d0d70 0x7f7d44162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.276+0000 7f7d42a00640 1 -- 172.21.15.59:0/4207497041 >> v2:172.21.15.59:3300/0 conn(0x7f7d440b32d0 msgr2=0x7f7d440b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.276+0000 7f7d42a00640 1 --2- 172.21.15.59:0/4207497041 >> v2:172.21.15.59:3300/0 conn(0x7f7d440b32d0 0x7f7d440b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.276+0000 7f7d42a00640 1 -- 172.21.15.59:0/4207497041 >> v1:172.21.15.59:6789/0 conn(0x7f7d44162780 legacy=0x7f7d440d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.276+0000 7f7d42a00640 1 -- 172.21.15.59:0/4207497041 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4406e090 con 0x7f7d440d0d70 2024-05-30T16:53:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.280+0000 7f7d42a00640 1 --2- 172.21.15.59:0/4207497041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d440d0d70 0x7f7d44162b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7d440b6590 tx=0x7f7d3401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebf7c7e100ebae38 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.280+0000 7f7d42000640 1 -- 172.21.15.59:0/4207497041 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d340b0070 con 0x7f7d440d0d70 2024-05-30T16:53:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.280+0000 7f7d42000640 1 -- 172.21.15.59:0/4207497041 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d340ab600 con 0x7f7d440d0d70 2024-05-30T16:53:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.280+0000 7f7d42000640 1 -- 172.21.15.59:0/4207497041 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d340ab9d0 con 0x7f7d440d0d70 2024-05-30T16:53:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.284+0000 7f7d4a400640 1 -- 172.21.15.59:0/4207497041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d440d0d70 msgr2=0x7f7d44162b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.284+0000 7f7d4a400640 1 --2- 172.21.15.59:0/4207497041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d440d0d70 0x7f7d44162b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7d440b6590 tx=0x7f7d3401c3f0 comp rx=0 tx=0).stop 2024-05-30T16:53:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.288+0000 7f7d4a400640 1 -- 172.21.15.59:0/4207497041 shutdown_connections 2024-05-30T16:53:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.288+0000 7f7d4a400640 1 --2- 172.21.15.59:0/4207497041 >> v2:172.21.15.59:3300/0 conn(0x7f7d440b32d0 0x7f7d440b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.288+0000 7f7d4a400640 1 --2- 172.21.15.59:0/4207497041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d440d0d70 0x7f7d44162b60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.288+0000 7f7d4a400640 1 -- 172.21.15.59:0/4207497041 >> 172.21.15.59:0/4207497041 conn(0x7f7d4406bdb0 msgr2=0x7f7d4406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.288+0000 7f7d4a400640 1 -- 172.21.15.59:0/4207497041 shutdown_connections 2024-05-30T16:53:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.288+0000 7f7d4a400640 1 -- 172.21.15.59:0/4207497041 wait complete. 2024-05-30T16:53:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.288+0000 7f7d4a400640 1 Processor -- start 2024-05-30T16:53:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.292+0000 7f7d4a400640 1 -- start start 2024-05-30T16:53:50.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.296+0000 7f7d4a400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d440b32d0 0x7f7d4415df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:50.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.296+0000 7f7d4a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d440d0d70 0x7f7d441492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:50.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.296+0000 7f7d4a400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d44162780 0x7f7d44149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:50.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.296+0000 7f7d4a400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4406f470 con 0x7f7d440d0d70 2024-05-30T16:53:50.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.296+0000 7f7d4a400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4406f2f0 con 0x7f7d440b32d0 2024-05-30T16:53:50.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.296+0000 7f7d4a400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7d4406f5f0 con 0x7f7d44162780 2024-05-30T16:53:50.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.296+0000 7f7d43e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d44162780 0x7f7d44149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:50.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.296+0000 7f7d43e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d44162780 0x7f7d44149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:42612/0 (socket says 172.21.15.59:42612) 2024-05-30T16:53:50.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.296+0000 7f7d43e00640 1 -- 172.21.15.59:0/2217573138 learned_addr learned my addr 172.21.15.59:0/2217573138 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:50.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.296+0000 7f7d42a00640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d440d0d70 0x7f7d441492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:50.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.300+0000 7f7d43400640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d440b32d0 0x7f7d4415df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:50.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.300+0000 7f7d43e00640 1 -- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d440b32d0 msgr2=0x7f7d4415df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:50.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.300+0000 7f7d43e00640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d440b32d0 0x7f7d4415df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:50.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.300+0000 7f7d43e00640 1 -- 172.21.15.59:0/2217573138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d440d0d70 msgr2=0x7f7d441492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:50.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.300+0000 7f7d43e00640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d440d0d70 0x7f7d441492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:50.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.300+0000 7f7d43e00640 1 -- 172.21.15.59:0/2217573138 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d44162ff0 con 0x7f7d44162780 2024-05-30T16:53:50.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.300+0000 7f7d43e00640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d44162780 0x7f7d44149830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c007e60 tx=0x7f7d3c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.316+0000 7f7d3b400640 1 -- 172.21.15.59:0/2217573138 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c014420 con 0x7f7d44162780 2024-05-30T16:53:50.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.316+0000 7f7d3b400640 1 -- 172.21.15.59:0/2217573138 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3c019070 con 0x7f7d44162780 2024-05-30T16:53:50.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.316+0000 7f7d3b400640 1 -- 172.21.15.59:0/2217573138 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c014800 con 0x7f7d44162780 2024-05-30T16:53:50.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.316+0000 7f7d4a400640 1 -- 172.21.15.59:0/2217573138 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4415fdd0 con 0x7f7d44162780 2024-05-30T16:53:50.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.316+0000 7f7d4a400640 1 -- 172.21.15.59:0/2217573138 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d44160390 con 0x7f7d44162780 2024-05-30T16:53:50.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.324+0000 7f7d4a400640 1 -- 172.21.15.59:0/2217573138 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d44160590 con 0x7f7d44162780 2024-05-30T16:53:50.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.332+0000 7f7d3b400640 1 -- 172.21.15.59:0/2217573138 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7f7d3c0149a0 con 0x7f7d44162780 2024-05-30T16:53:50.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.336+0000 7f7d3b400640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d24068b10 0x7f7d2406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:50.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.336+0000 7f7d3b400640 1 -- 172.21.15.59:0/2217573138 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f7d3c087d20 con 0x7f7d44162780 2024-05-30T16:53:50.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.344+0000 7f7d43400640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d24068b10 0x7f7d2406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:50.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.344+0000 7f7d3b400640 1 -- 172.21.15.59:0/2217573138 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7d44160590 con 0x7f7d44162780 2024-05-30T16:53:50.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.360+0000 7f7d43400640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d24068b10 0x7f7d2406afd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7d441577c0 tx=0x7f7d30009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:50.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:50.724+0000 7f7d4a400640 1 -- 172.21.15.59:0/2217573138 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69362", "target": ["mon-mgr", ""]}) -- 0x7f7d44068a90 con 0x7f7d24068b10 2024-05-30T16:53:51.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.336+0000 7f7d3b400640 1 -- 172.21.15.59:0/2217573138 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7d44068a90 con 0x7f7d24068b10 2024-05-30T16:53:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.348+0000 7f7d4a400640 1 -- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d24068b10 msgr2=0x7f7d2406afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.348+0000 7f7d4a400640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d24068b10 0x7f7d2406afd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7d441577c0 tx=0x7f7d30009040 comp rx=0 tx=0).stop 2024-05-30T16:53:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.348+0000 7f7d4a400640 1 -- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d44162780 msgr2=0x7f7d44149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.348+0000 7f7d4a400640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d44162780 0x7f7d44149830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c007e60 tx=0x7f7d3c00e4b0 comp rx=0 tx=0).stop 2024-05-30T16:53:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.352+0000 7f7d4a400640 1 -- 172.21.15.59:0/2217573138 shutdown_connections 2024-05-30T16:53:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.352+0000 7f7d4a400640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d24068b10 0x7f7d2406afd0 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7d441577c0 tx=0x7f7d30009040 comp rx=0 tx=0).stop 2024-05-30T16:53:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.352+0000 7f7d4a400640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d44162780 0x7f7d44149830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.352+0000 7f7d4a400640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d440d0d70 0x7f7d441492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.352+0000 7f7d4a400640 1 --2- 172.21.15.59:0/2217573138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d440b32d0 0x7f7d4415df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.352+0000 7f7d4a400640 1 -- 172.21.15.59:0/2217573138 >> 172.21.15.59:0/2217573138 conn(0x7f7d4406bdb0 msgr2=0x7f7d4416c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.352+0000 7f7d4a400640 1 -- 172.21.15.59:0/2217573138 shutdown_connections 2024-05-30T16:53:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.352+0000 7f7d4a400640 1 -- 172.21.15.59:0/2217573138 wait complete. 2024-05-30T16:53:51.422 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69363 2024-05-30T16:53:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.644+0000 7fe33ea00640 1 Processor -- start 2024-05-30T16:53:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.644+0000 7fe33ea00640 1 -- start start 2024-05-30T16:53:51.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.644+0000 7fe33ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe3380cfe00 0x7fe33806ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:51.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.644+0000 7fe33ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe3380ce490 0x7fe3380cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:51.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.644+0000 7fe33ea00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3380679b0 con 0x7fe3380d01e0 2024-05-30T16:53:51.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.644+0000 7fe33ea00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe3380704c0 con 0x7fe3380cfe00 2024-05-30T16:53:51.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.644+0000 7fe33ea00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe338067760 con 0x7fe3380ce490 2024-05-30T16:53:51.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.644+0000 7fe337e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe3380cfe00 0x7fe33806ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:51.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.644+0000 7fe337e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe3380cfe00 0x7fe33806ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49326/0 (socket says 172.21.15.59:49326) 2024-05-30T16:53:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.644+0000 7fe337e00640 1 -- 172.21.15.59:0/1949271917 learned_addr learned my addr 172.21.15.59:0/1949271917 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.644+0000 7fe337400640 1 --2- 172.21.15.59:0/1949271917 >> v2:172.21.15.107:3300/0 conn(0x7fe3380ce490 0x7fe3380cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.648+0000 7fe337e00640 1 -- 172.21.15.59:0/1949271917 >> v2:172.21.15.107:3300/0 conn(0x7fe3380ce490 msgr2=0x7fe3380cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.648+0000 7fe337e00640 1 --2- 172.21.15.59:0/1949271917 >> v2:172.21.15.107:3300/0 conn(0x7fe3380ce490 0x7fe3380cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.648+0000 7fe337e00640 1 -- 172.21.15.59:0/1949271917 >> v1:172.21.15.107:6789/0 conn(0x7fe3380d01e0 legacy=0x7fe3380cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.648+0000 7fe337e00640 1 -- 172.21.15.59:0/1949271917 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe338067c90 con 0x7fe3380cfe00 2024-05-30T16:53:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.648+0000 7fe337e00640 1 --2- 172.21.15.59:0/1949271917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3380cfe00 0x7fe33806ff80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe338068e70 tx=0x7fe32801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db0e7211b69544b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:51.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.648+0000 7fe336a00640 1 -- 172.21.15.59:0/1949271917 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3280b0070 con 0x7fe3380cfe00 2024-05-30T16:53:51.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.648+0000 7fe336a00640 1 -- 172.21.15.59:0/1949271917 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3280ab600 con 0x7fe3380cfe00 2024-05-30T16:53:51.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.648+0000 7fe336a00640 1 -- 172.21.15.59:0/1949271917 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3280ab9d0 con 0x7fe3380cfe00 2024-05-30T16:53:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 -- 172.21.15.59:0/1949271917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3380cfe00 msgr2=0x7fe33806ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 --2- 172.21.15.59:0/1949271917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3380cfe00 0x7fe33806ff80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe338068e70 tx=0x7fe32801c450 comp rx=0 tx=0).stop 2024-05-30T16:53:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 -- 172.21.15.59:0/1949271917 shutdown_connections 2024-05-30T16:53:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 --2- 172.21.15.59:0/1949271917 >> v2:172.21.15.107:3300/0 conn(0x7fe3380ce490 0x7fe3380cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 --2- 172.21.15.59:0/1949271917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3380cfe00 0x7fe33806ff80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 -- 172.21.15.59:0/1949271917 >> 172.21.15.59:0/1949271917 conn(0x7fe3380cd680 msgr2=0x7fe3380cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 -- 172.21.15.59:0/1949271917 shutdown_connections 2024-05-30T16:53:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 -- 172.21.15.59:0/1949271917 wait complete. 2024-05-30T16:53:51.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 Processor -- start 2024-05-30T16:53:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 -- start start 2024-05-30T16:53:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe3380ce490 0x7fe338156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3380cfe00 0x7fe3381407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3380d01e0 0x7fe338155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe3380cf850 con 0x7fe3380d01e0 2024-05-30T16:53:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe3380cf6d0 con 0x7fe3380cfe00 2024-05-30T16:53:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe33816b730 con 0x7fe3380ce490 2024-05-30T16:53:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3380d01e0 0x7fe338155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3380d01e0 0x7fe338155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49336/0 (socket says 172.21.15.59:49336) 2024-05-30T16:53:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe33ca00640 1 -- 172.21.15.59:0/1339383620 learned_addr learned my addr 172.21.15.59:0/1339383620 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe337400640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3380cfe00 0x7fe3381407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.652+0000 7fe337e00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe3380ce490 0x7fe338156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe33ca00640 1 -- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe3380ce490 msgr2=0x7fe338156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe33ca00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe3380ce490 0x7fe338156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe33ca00640 1 -- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3380cfe00 msgr2=0x7fe3381407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe33ca00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3380cfe00 0x7fe3381407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe33ca00640 1 -- 172.21.15.59:0/1339383620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe338156470 con 0x7fe3380d01e0 2024-05-30T16:53:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe33ca00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3380d01e0 0x7fe338155990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe33000b410 tx=0x7fe33000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe32fe00640 1 -- 172.21.15.59:0/1339383620 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330015020 con 0x7fe3380d01e0 2024-05-30T16:53:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe32fe00640 1 -- 172.21.15.59:0/1339383620 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe330011870 con 0x7fe3380d01e0 2024-05-30T16:53:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe32fe00640 1 -- 172.21.15.59:0/1339383620 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330011c60 con 0x7fe3380d01e0 2024-05-30T16:53:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe33ea00640 1 -- 172.21.15.59:0/1339383620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe338156750 con 0x7fe3380d01e0 2024-05-30T16:53:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe33ea00640 1 -- 172.21.15.59:0/1339383620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33814e900 con 0x7fe3380d01e0 2024-05-30T16:53:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe33ea00640 1 -- 172.21.15.59:0/1339383620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3380691a0 con 0x7fe3380d01e0 2024-05-30T16:53:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe32fe00640 1 -- 172.21.15.59:0/1339383620 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7fe330018020 con 0x7fe3380d01e0 2024-05-30T16:53:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.656+0000 7fe32fe00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe318068a40 0x7fe31806af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.660+0000 7fe32fe00640 1 -- 172.21.15.59:0/1339383620 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7fe3300871b0 con 0x7fe3380d01e0 2024-05-30T16:53:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.660+0000 7fe337e00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe318068a40 0x7fe31806af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.664+0000 7fe32fe00640 1 -- 172.21.15.59:0/1339383620 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe33001f030 con 0x7fe3380d01e0 2024-05-30T16:53:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:51.664+0000 7fe337e00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe318068a40 0x7fe31806af00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe3280ad000 tx=0x7fe3280a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.008+0000 7fe33ea00640 1 -- 172.21.15.59:0/1339383620 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69363", "target": ["mon-mgr", ""]}) -- 0x7fe338168cf0 con 0x7fe318068a40 2024-05-30T16:53:52.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.300+0000 7fe32fe00640 1 -- 172.21.15.59:0/1339383620 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe338168cf0 con 0x7fe318068a40 2024-05-30T16:53:52.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.304+0000 7fe33ea00640 1 -- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe318068a40 msgr2=0x7fe31806af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.304+0000 7fe33ea00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe318068a40 0x7fe31806af00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe3280ad000 tx=0x7fe3280a6000 comp rx=0 tx=0).stop 2024-05-30T16:53:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.304+0000 7fe33ea00640 1 -- 172.21.15.59:0/1339383620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3380d01e0 msgr2=0x7fe338155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.304+0000 7fe33ea00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3380d01e0 0x7fe338155990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe33000b410 tx=0x7fe33000b8d0 comp rx=0 tx=0).stop 2024-05-30T16:53:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.304+0000 7fe33ea00640 1 -- 172.21.15.59:0/1339383620 shutdown_connections 2024-05-30T16:53:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.304+0000 7fe33ea00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe318068a40 0x7fe31806af00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.304+0000 7fe33ea00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3380d01e0 0x7fe338155990 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.304+0000 7fe33ea00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3380cfe00 0x7fe3381407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.304+0000 7fe33ea00640 1 --2- 172.21.15.59:0/1339383620 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe3380ce490 0x7fe338156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.304+0000 7fe33ea00640 1 -- 172.21.15.59:0/1339383620 >> 172.21.15.59:0/1339383620 conn(0x7fe3380cd680 msgr2=0x7fe3380b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.304+0000 7fe33ea00640 1 -- 172.21.15.59:0/1339383620 shutdown_connections 2024-05-30T16:53:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.304+0000 7fe33ea00640 1 -- 172.21.15.59:0/1339383620 wait complete. 2024-05-30T16:53:52.333 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69364 2024-05-30T16:53:52.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.580+0000 7fea22c00640 1 Processor -- start 2024-05-30T16:53:52.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.580+0000 7fea22c00640 1 -- start start 2024-05-30T16:53:52.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.580+0000 7fea22c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fea1c0720b0 0x7fea1c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:52.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.584+0000 7fea22c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea1c0ced40 con 0x7fea1c072490 2024-05-30T16:53:52.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.584+0000 7fea22c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea1c0cf020 con 0x7fea1c162d50 2024-05-30T16:53:52.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.584+0000 7fea22c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fea1c0cf300 con 0x7fea1c0720b0 2024-05-30T16:53:52.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.584+0000 7fea20c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fea1c072490 0x7fea1c0cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48518/0 (socket says 172.21.15.59:48518) 2024-05-30T16:53:52.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.584+0000 7fea20c00640 1 -- 172.21.15.59:0/978640086 learned_addr learned my addr 172.21.15.59:0/978640086 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:53:52.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.584+0000 7fea1be00640 1 --2- 172.21.15.59:0/978640086 >> v2:172.21.15.107:3300/0 conn(0x7fea1c0720b0 0x7fea1c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:52.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.584+0000 7fea1aa00640 1 -- 172.21.15.59:0/978640086 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1370622622 0 0) 0x7fea1c0ced40 con 0x7fea1c072490 2024-05-30T16:53:52.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.584+0000 7fea1aa00640 1 -- 172.21.15.59:0/978640086 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea00003530 con 0x7fea1c072490 2024-05-30T16:53:52.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.584+0000 7fea1aa00640 1 -- 172.21.15.59:0/978640086 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 504897102 0 0) 0x7fea00003530 con 0x7fea1c072490 2024-05-30T16:53:52.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.584+0000 7fea1be00640 1 -- 172.21.15.59:0/978640086 >> v1:172.21.15.107:6789/0 conn(0x7fea1c162d50 legacy=0x7fea1c0ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:52.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.584+0000 7fea1be00640 1 -- 172.21.15.59:0/978640086 >> v1:172.21.15.59:6789/0 conn(0x7fea1c072490 legacy=0x7fea1c0cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:52.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.584+0000 7fea1be00640 1 -- 172.21.15.59:0/978640086 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1c0cf5e0 con 0x7fea1c0720b0 2024-05-30T16:53:52.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.588+0000 7fea1be00640 1 --2- 172.21.15.59:0/978640086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea1c0720b0 0x7fea1c06fa60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0097c0 tx=0x7fea0c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3453d4c4064a2b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:52.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.592+0000 7fea1aa00640 1 -- 172.21.15.59:0/978640086 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0b0070 con 0x7fea1c0720b0 2024-05-30T16:53:52.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.592+0000 7fea1aa00640 1 -- 172.21.15.59:0/978640086 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea0c0ab400 con 0x7fea1c0720b0 2024-05-30T16:53:52.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.592+0000 7fea1aa00640 1 -- 172.21.15.59:0/978640086 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14001a20 con 0x7fea1c0720b0 2024-05-30T16:53:52.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.592+0000 7fea22c00640 1 -- 172.21.15.59:0/978640086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea1c0720b0 msgr2=0x7fea1c06fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:52.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.592+0000 7fea22c00640 1 --2- 172.21.15.59:0/978640086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea1c0720b0 0x7fea1c06fa60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0097c0 tx=0x7fea0c01c3e0 comp rx=0 tx=0).stop 2024-05-30T16:53:52.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.592+0000 7fea22c00640 1 -- 172.21.15.59:0/978640086 shutdown_connections 2024-05-30T16:53:52.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.592+0000 7fea22c00640 1 --2- 172.21.15.59:0/978640086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea1c0720b0 0x7fea1c06fa60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:52.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.592+0000 7fea22c00640 1 -- 172.21.15.59:0/978640086 >> 172.21.15.59:0/978640086 conn(0x7fea1c067ea0 msgr2=0x7fea1c06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:52.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.592+0000 7fea22c00640 1 -- 172.21.15.59:0/978640086 shutdown_connections 2024-05-30T16:53:52.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.592+0000 7fea22c00640 1 -- 172.21.15.59:0/978640086 wait complete. 2024-05-30T16:53:52.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.596+0000 7fea22c00640 1 Processor -- start 2024-05-30T16:53:52.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.596+0000 7fea22c00640 1 -- start start 2024-05-30T16:53:52.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.596+0000 7fea22c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea1c072490 0x7fea1c165040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:52.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.596+0000 7fea22c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea1c162d50 0x7fea1c14c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:52.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.596+0000 7fea22c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea1c14da30 0x7fea1c1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:52.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.596+0000 7fea22c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c170740 con 0x7fea1c072490 2024-05-30T16:53:52.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.596+0000 7fea22c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c0b4250 con 0x7fea1c162d50 2024-05-30T16:53:52.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.596+0000 7fea22c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fea1c1708c0 con 0x7fea1c14da30 2024-05-30T16:53:52.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea1b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea1c162d50 0x7fea1c14c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:52.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea1b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea1c162d50 0x7fea1c14c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:39826/0 (socket says 172.21.15.59:39826) 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea1b400640 1 -- 172.21.15.59:0/3687183073 learned_addr learned my addr 172.21.15.59:0/3687183073 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea1be00640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea1c072490 0x7fea1c165040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea20c00640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea1c14da30 0x7fea1c1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea1b400640 1 -- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea1c14da30 msgr2=0x7fea1c1515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea1b400640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea1c14da30 0x7fea1c1515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea1b400640 1 -- 172.21.15.59:0/3687183073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea1c072490 msgr2=0x7fea1c165040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea1b400640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea1c072490 0x7fea1c165040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea1b400640 1 -- 172.21.15.59:0/3687183073 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1c14dff0 con 0x7fea1c162d50 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea1b400640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea1c162d50 0x7fea1c14c7b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fea0400c340 tx=0x7fea0400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea13e00640 1 -- 172.21.15.59:0/3687183073 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea040052d0 con 0x7fea1c162d50 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea13e00640 1 -- 172.21.15.59:0/3687183073 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea04005470 con 0x7fea1c162d50 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea13e00640 1 -- 172.21.15.59:0/3687183073 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea04007260 con 0x7fea1c162d50 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea22c00640 1 -- 172.21.15.59:0/3687183073 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1c14e2d0 con 0x7fea1c162d50 2024-05-30T16:53:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.600+0000 7fea22c00640 1 -- 172.21.15.59:0/3687183073 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea1c14e890 con 0x7fea1c162d50 2024-05-30T16:53:52.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.604+0000 7fea22c00640 1 -- 172.21.15.59:0/3687183073 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f40052a0 con 0x7fea1c162d50 2024-05-30T16:53:52.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.604+0000 7fea13e00640 1 -- 172.21.15.59:0/3687183073 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7fea04007400 con 0x7fea1c162d50 2024-05-30T16:53:52.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.604+0000 7fea13e00640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe9f8068a90 0x7fe9f806af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:52.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.608+0000 7fea13e00640 1 -- 172.21.15.59:0/3687183073 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7fea04086930 con 0x7fea1c162d50 2024-05-30T16:53:52.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.608+0000 7fea1be00640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe9f8068a90 0x7fe9f806af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:52.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.608+0000 7fea1be00640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe9f8068a90 0x7fe9f806af50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0ad000 tx=0x7fea0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:52.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.612+0000 7fea13e00640 1 -- 172.21.15.59:0/3687183073 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fea04055ef0 con 0x7fea1c162d50 2024-05-30T16:53:52.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:52.920+0000 7fea22c00640 1 -- 172.21.15.59:0/3687183073 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69364", "target": ["mon-mgr", ""]}) -- 0x7fe9f4000bd0 con 0x7fe9f8068a90 2024-05-30T16:53:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.052+0000 7fea13e00640 1 -- 172.21.15.59:0/3687183073 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe9f4000bd0 con 0x7fe9f8068a90 2024-05-30T16:53:53.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.056+0000 7fea22c00640 1 -- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe9f8068a90 msgr2=0x7fe9f806af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.056+0000 7fea22c00640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe9f8068a90 0x7fe9f806af50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0ad000 tx=0x7fea0c008040 comp rx=0 tx=0).stop 2024-05-30T16:53:53.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.056+0000 7fea22c00640 1 -- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea1c162d50 msgr2=0x7fea1c14c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.056+0000 7fea22c00640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea1c162d50 0x7fea1c14c7b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fea0400c340 tx=0x7fea0400c800 comp rx=0 tx=0).stop 2024-05-30T16:53:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.056+0000 7fea22c00640 1 -- 172.21.15.59:0/3687183073 shutdown_connections 2024-05-30T16:53:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.056+0000 7fea22c00640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe9f8068a90 0x7fe9f806af50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.056+0000 7fea22c00640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea1c14da30 0x7fea1c1515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.056+0000 7fea22c00640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea1c162d50 0x7fea1c14c7b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.056+0000 7fea22c00640 1 --2- 172.21.15.59:0/3687183073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea1c072490 0x7fea1c165040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.056+0000 7fea22c00640 1 -- 172.21.15.59:0/3687183073 >> 172.21.15.59:0/3687183073 conn(0x7fea1c0720b0 msgr2=0x7fea1c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.056+0000 7fea22c00640 1 -- 172.21.15.59:0/3687183073 shutdown_connections 2024-05-30T16:53:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.056+0000 7fea22c00640 1 -- 172.21.15.59:0/3687183073 wait complete. 2024-05-30T16:53:53.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:53:53.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.216+0000 7fe249400640 1 Processor -- start 2024-05-30T16:53:53.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.216+0000 7fe249400640 1 -- start start 2024-05-30T16:53:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe249400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2440c53a0 0x7fe244163c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe249400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe24409b2e0 0x7fe2440af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe249400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe244070000 con 0x7fe2440b49e0 2024-05-30T16:53:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe249400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe2440702e0 con 0x7fe24409b2e0 2024-05-30T16:53:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe249400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe24409aae0 con 0x7fe2440c53a0 2024-05-30T16:53:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe248a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe24409b2e0 0x7fe2440af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe248a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe24409b2e0 0x7fe2440af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35882/0 (socket says 172.21.15.59:35882) 2024-05-30T16:53:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe248a00640 1 -- 172.21.15.59:0/4138180290 learned_addr learned my addr 172.21.15.59:0/4138180290 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe243e00640 1 --2- 172.21.15.59:0/4138180290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2440c53a0 0x7fe244163c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe248a00640 1 -- 172.21.15.59:0/4138180290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2440c53a0 msgr2=0x7fe244163c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe248a00640 1 --2- 172.21.15.59:0/4138180290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2440c53a0 0x7fe244163c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe248a00640 1 -- 172.21.15.59:0/4138180290 >> v1:172.21.15.107:6789/0 conn(0x7fe2440b49e0 legacy=0x7fe2440c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.220+0000 7fe248a00640 1 -- 172.21.15.59:0/4138180290 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24409adc0 con 0x7fe24409b2e0 2024-05-30T16:53:53.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe248a00640 1 --2- 172.21.15.59:0/4138180290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe24409b2e0 0x7fe2440af140 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009e50 tx=0x7fe23c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6b611369badf31 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:53.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe242a00640 1 -- 172.21.15.59:0/4138180290 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0a5810 con 0x7fe24409b2e0 2024-05-30T16:53:53.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe242a00640 1 -- 172.21.15.59:0/4138180290 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c0a59b0 con 0x7fe24409b2e0 2024-05-30T16:53:53.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe242a00640 1 -- 172.21.15.59:0/4138180290 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0a5d80 con 0x7fe24409b2e0 2024-05-30T16:53:53.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe249400640 1 -- 172.21.15.59:0/4138180290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe24409b2e0 msgr2=0x7fe2440af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe249400640 1 --2- 172.21.15.59:0/4138180290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe24409b2e0 0x7fe2440af140 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009e50 tx=0x7fe23c01ca30 comp rx=0 tx=0).stop 2024-05-30T16:53:53.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe249400640 1 -- 172.21.15.59:0/4138180290 shutdown_connections 2024-05-30T16:53:53.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe249400640 1 --2- 172.21.15.59:0/4138180290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe24409b2e0 0x7fe2440af140 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe249400640 1 --2- 172.21.15.59:0/4138180290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2440c53a0 0x7fe244163c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe249400640 1 -- 172.21.15.59:0/4138180290 >> 172.21.15.59:0/4138180290 conn(0x7fe2440b3ec0 msgr2=0x7fe2440b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:53.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe249400640 1 -- 172.21.15.59:0/4138180290 shutdown_connections 2024-05-30T16:53:53.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe249400640 1 -- 172.21.15.59:0/4138180290 wait complete. 2024-05-30T16:53:53.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe249400640 1 Processor -- start 2024-05-30T16:53:53.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.224+0000 7fe249400640 1 -- start start 2024-05-30T16:53:53.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe249400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe24409b2e0 0x7fe24406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:53.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe249400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2440b49e0 0x7fe2441556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:53.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe249400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2440c53a0 0x7fe244155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:53.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe249400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440af680 con 0x7fe2440c53a0 2024-05-30T16:53:53.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe249400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe24409b980 con 0x7fe24409b2e0 2024-05-30T16:53:53.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe249400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe2440af800 con 0x7fe2440b49e0 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe248a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2440c53a0 0x7fe244155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe248a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2440c53a0 0x7fe244155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35890/0 (socket says 172.21.15.59:35890) 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe248a00640 1 -- 172.21.15.59:0/3486616720 learned_addr learned my addr 172.21.15.59:0/3486616720 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe243e00640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe24409b2e0 0x7fe24406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe243400640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2440b49e0 0x7fe2441556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe248a00640 1 -- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2440b49e0 msgr2=0x7fe2441556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe248a00640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2440b49e0 0x7fe2441556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe248a00640 1 -- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe24409b2e0 msgr2=0x7fe24406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe248a00640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe24409b2e0 0x7fe24406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe248a00640 1 -- 172.21.15.59:0/3486616720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2441575b0 con 0x7fe2440c53a0 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe248a00640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2440c53a0 0x7fe244155c00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0af040 tx=0x7fe23c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe23be00640 1 -- 172.21.15.59:0/3486616720 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0b8670 con 0x7fe2440c53a0 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe23be00640 1 -- 172.21.15.59:0/3486616720 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c0be070 con 0x7fe2440c53a0 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe23be00640 1 -- 172.21.15.59:0/3486616720 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0b8a50 con 0x7fe2440c53a0 2024-05-30T16:53:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe249400640 1 -- 172.21.15.59:0/3486616720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe244156510 con 0x7fe2440c53a0 2024-05-30T16:53:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe249400640 1 -- 172.21.15.59:0/3486616720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe244156ad0 con 0x7fe2440c53a0 2024-05-30T16:53:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe249400640 1 -- 172.21.15.59:0/3486616720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe244068a90 con 0x7fe2440c53a0 2024-05-30T16:53:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.228+0000 7fe23be00640 1 -- 172.21.15.59:0/3486616720 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7fe23c0b8bf0 con 0x7fe2440c53a0 2024-05-30T16:53:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.232+0000 7fe23be00640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe224068a40 0x7fe22406af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.232+0000 7fe23be00640 1 -- 172.21.15.59:0/3486616720 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7fe23c122540 con 0x7fe2440c53a0 2024-05-30T16:53:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.232+0000 7fe243e00640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe224068a40 0x7fe22406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.232+0000 7fe243e00640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe224068a40 0x7fe22406af00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe234009ac0 tx=0x7fe234009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:53.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.236+0000 7fe23be00640 1 -- 172.21.15.59:0/3486616720 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe23c016620 con 0x7fe2440c53a0 2024-05-30T16:53:53.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.424+0000 7fe249400640 1 -- 172.21.15.59:0/3486616720 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fe2441562c0 con 0x7fe224068a40 2024-05-30T16:53:53.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.424+0000 7fe23be00640 1 -- 172.21.15.59:0/3486616720 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fe2441562c0 con 0x7fe224068a40 2024-05-30T16:53:53.428 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:53:53.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:53:53.429 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T16:53:53.429 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:53.429 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:53:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.428+0000 7fe249400640 1 -- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe224068a40 msgr2=0x7fe22406af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.428+0000 7fe249400640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe224068a40 0x7fe22406af00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe234009ac0 tx=0x7fe234009190 comp rx=0 tx=0).stop 2024-05-30T16:53:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.428+0000 7fe249400640 1 -- 172.21.15.59:0/3486616720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2440c53a0 msgr2=0x7fe244155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.428+0000 7fe249400640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2440c53a0 0x7fe244155c00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0af040 tx=0x7fe23c0197d0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.428+0000 7fe249400640 1 -- 172.21.15.59:0/3486616720 shutdown_connections 2024-05-30T16:53:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.428+0000 7fe249400640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe224068a40 0x7fe22406af00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.428+0000 7fe249400640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2440c53a0 0x7fe244155c00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.428+0000 7fe249400640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2440b49e0 0x7fe2441556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.428+0000 7fe249400640 1 --2- 172.21.15.59:0/3486616720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe24409b2e0 0x7fe24406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.428+0000 7fe249400640 1 -- 172.21.15.59:0/3486616720 >> 172.21.15.59:0/3486616720 conn(0x7fe2440b3ec0 msgr2=0x7fe2440b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.428+0000 7fe249400640 1 -- 172.21.15.59:0/3486616720 shutdown_connections 2024-05-30T16:53:53.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.428+0000 7fe249400640 1 -- 172.21.15.59:0/3486616720 wait complete. 2024-05-30T16:53:53.450 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:53:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa60d400640 1 Processor -- start 2024-05-30T16:53:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa60d400640 1 -- start start 2024-05-30T16:53:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa60d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa60815fcc0 0x7fa6080d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa60d400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa60809b150 0x7fa6080b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa60d400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6081600a0 con 0x7fa6080b3770 2024-05-30T16:53:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa60d400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa60809ba80 con 0x7fa60815fcc0 2024-05-30T16:53:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa60d400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa6080b4b80 con 0x7fa60809b150 2024-05-30T16:53:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa607e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa60815fcc0 0x7fa6080d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa607e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa60815fcc0 0x7fa6080d0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35894/0 (socket says 172.21.15.59:35894) 2024-05-30T16:53:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa607e00640 1 -- 172.21.15.59:0/1514255206 learned_addr learned my addr 172.21.15.59:0/1514255206 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa60ca00640 1 --2- 172.21.15.59:0/1514255206 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa60809b150 0x7fa6080b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa607e00640 1 -- 172.21.15.59:0/1514255206 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa60809b150 msgr2=0x7fa6080b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa607e00640 1 --2- 172.21.15.59:0/1514255206 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa60809b150 0x7fa6080b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa607e00640 1 -- 172.21.15.59:0/1514255206 >> v1:172.21.15.107:6789/0 conn(0x7fa6080b3770 legacy=0x7fa60809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa607e00640 1 -- 172.21.15.59:0/1514255206 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60809b710 con 0x7fa60815fcc0 2024-05-30T16:53:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.588+0000 7fa60ca00640 1 --2- 172.21.15.59:0/1514255206 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa60809b150 0x7fa6080b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:53:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.592+0000 7fa607e00640 1 --2- 172.21.15.59:0/1514255206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa60815fcc0 0x7fa6080d0c90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009870 tx=0x7fa5f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96923b0c5aa5d7b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.592+0000 7fa607400640 1 -- 172.21.15.59:0/1514255206 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80b0070 con 0x7fa60815fcc0 2024-05-30T16:53:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.592+0000 7fa607400640 1 -- 172.21.15.59:0/1514255206 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f80ab600 con 0x7fa60815fcc0 2024-05-30T16:53:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.592+0000 7fa607400640 1 -- 172.21.15.59:0/1514255206 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80ab9d0 con 0x7fa60815fcc0 2024-05-30T16:53:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.592+0000 7fa60d400640 1 -- 172.21.15.59:0/1514255206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa60815fcc0 msgr2=0x7fa6080d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.592+0000 7fa60d400640 1 --2- 172.21.15.59:0/1514255206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa60815fcc0 0x7fa6080d0c90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009870 tx=0x7fa5f801c4d0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.592+0000 7fa60d400640 1 -- 172.21.15.59:0/1514255206 shutdown_connections 2024-05-30T16:53:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.592+0000 7fa60d400640 1 --2- 172.21.15.59:0/1514255206 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa60809b150 0x7fa6080b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.592+0000 7fa60d400640 1 --2- 172.21.15.59:0/1514255206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa60815fcc0 0x7fa6080d0c90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.592+0000 7fa60d400640 1 -- 172.21.15.59:0/1514255206 >> 172.21.15.59:0/1514255206 conn(0x7fa6080b3ec0 msgr2=0x7fa6080b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.592+0000 7fa60d400640 1 -- 172.21.15.59:0/1514255206 shutdown_connections 2024-05-30T16:53:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.592+0000 7fa60d400640 1 -- 172.21.15.59:0/1514255206 wait complete. 2024-05-30T16:53:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa60d400640 1 Processor -- start 2024-05-30T16:53:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa60d400640 1 -- start start 2024-05-30T16:53:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa60d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa60809b150 0x7fa60815b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa60d400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6080b3770 0x7fa60814a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa60d400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa60815fcc0 0x7fa60815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa60d400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa6080cd9e0 con 0x7fa60809b150 2024-05-30T16:53:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa60d400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa6080cd860 con 0x7fa6080b3770 2024-05-30T16:53:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa60d400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa608169330 con 0x7fa60815fcc0 2024-05-30T16:53:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa607e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa60809b150 0x7fa60815b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa607e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa60809b150 0x7fa60815b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35902/0 (socket says 172.21.15.59:35902) 2024-05-30T16:53:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa607e00640 1 -- 172.21.15.59:0/127842051 learned_addr learned my addr 172.21.15.59:0/127842051 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa60ca00640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa60815fcc0 0x7fa60815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa5ffe00640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6080b3770 0x7fa60814a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa607e00640 1 -- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa60815fcc0 msgr2=0x7fa60815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa607e00640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa60815fcc0 0x7fa60815ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa607e00640 1 -- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6080b3770 msgr2=0x7fa60814a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa607e00640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6080b3770 0x7fa60814a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa607e00640 1 -- 172.21.15.59:0/127842051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60809ad60 con 0x7fa60809b150 2024-05-30T16:53:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa5ffe00640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6080b3770 0x7fa60814a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:53:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa607e00640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa60809b150 0x7fa60815b890 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80ae040 tx=0x7fa5f801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa604c00640 1 -- 172.21.15.59:0/127842051 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80b0040 con 0x7fa60809b150 2024-05-30T16:53:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa604c00640 1 -- 172.21.15.59:0/127842051 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f80bc070 con 0x7fa60809b150 2024-05-30T16:53:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa60d400640 1 -- 172.21.15.59:0/127842051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60815d860 con 0x7fa60809b150 2024-05-30T16:53:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa604c00640 1 -- 172.21.15.59:0/127842051 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80b6880 con 0x7fa60809b150 2024-05-30T16:53:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.596+0000 7fa60d400640 1 -- 172.21.15.59:0/127842051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60815f2d0 con 0x7fa60809b150 2024-05-30T16:53:53.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.600+0000 7fa60d400640 1 -- 172.21.15.59:0/127842051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa608068a90 con 0x7fa60809b150 2024-05-30T16:53:53.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.600+0000 7fa604c00640 1 -- 172.21.15.59:0/127842051 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7fa5f80ab480 con 0x7fa60809b150 2024-05-30T16:53:53.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.600+0000 7fa604c00640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa5e4068a40 0x7fa5e406af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:53.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.600+0000 7fa604c00640 1 -- 172.21.15.59:0/127842051 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7fa5f8121960 con 0x7fa60809b150 2024-05-30T16:53:53.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.600+0000 7fa5ffe00640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa5e4068a40 0x7fa5e406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:53.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.600+0000 7fa5ffe00640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa5e4068a40 0x7fa5e406af00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa6080c93d0 tx=0x7fa5f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:53.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.604+0000 7fa604c00640 1 -- 172.21.15.59:0/127842051 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa5f8016150 con 0x7fa60809b150 2024-05-30T16:53:53.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.828+0000 7fa60d400640 1 -- 172.21.15.59:0/127842051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa608158490 con 0x7fa60809b150 2024-05-30T16:53:53.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.828+0000 7fa604c00640 1 -- 172.21.15.59:0/127842051 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2142 (secure 0 0 0) 0x7fa5f80f14e0 con 0x7fa60809b150 2024-05-30T16:53:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:53:53.832 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:53:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:53:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:53:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:53:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:53:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:53:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:53:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:53:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 313, 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:53:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 49, 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:53:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 3922, 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 16300741195, 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 32159600640, 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 740934512640, 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 472126104, 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 473574071, 2024-05-30T16:53:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 115, 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 129 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 26, 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 3, 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 3, 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:53:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5304 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:53:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:53:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 8, 2024-05-30T16:53:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:53:19.132075+0000", 2024-05-30T16:53:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:53:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:53:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "6a26690c-32f2-46e2-957d-eb8bb7219da5": { 2024-05-30T16:53:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "1 ongoing clones; Avg progress is 8.359% (8s)\n [==..........................] (remaining: 93s)", 2024-05-30T16:53:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.083590000867843628, 2024-05-30T16:53:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:53:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:53.839 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:53:53.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.832+0000 7fa60d400640 1 -- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa5e4068a40 msgr2=0x7fa5e406af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.832+0000 7fa60d400640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa5e4068a40 0x7fa5e406af00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa6080c93d0 tx=0x7fa5f0009040 comp rx=0 tx=0).stop 2024-05-30T16:53:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.832+0000 7fa60d400640 1 -- 172.21.15.59:0/127842051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa60809b150 msgr2=0x7fa60815b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.832+0000 7fa60d400640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa60809b150 0x7fa60815b890 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80ae040 tx=0x7fa5f801ad10 comp rx=0 tx=0).stop 2024-05-30T16:53:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.832+0000 7fa60d400640 1 -- 172.21.15.59:0/127842051 shutdown_connections 2024-05-30T16:53:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.832+0000 7fa60d400640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa5e4068a40 0x7fa5e406af00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.832+0000 7fa60d400640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa60815fcc0 0x7fa60815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.832+0000 7fa60d400640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6080b3770 0x7fa60814a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.832+0000 7fa60d400640 1 --2- 172.21.15.59:0/127842051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa60809b150 0x7fa60815b890 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.832+0000 7fa60d400640 1 -- 172.21.15.59:0/127842051 >> 172.21.15.59:0/127842051 conn(0x7fa6080b3ec0 msgr2=0x7fa608158c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.832+0000 7fa60d400640 1 -- 172.21.15.59:0/127842051 shutdown_connections 2024-05-30T16:53:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:53.832+0000 7fa60d400640 1 -- 172.21.15.59:0/127842051 wait complete. 2024-05-30T16:53:58.857 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:53:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e6e00640 1 Processor -- start 2024-05-30T16:53:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e6e00640 1 -- start start 2024-05-30T16:53:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e6e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e00b1700 0x7f36e00b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e6e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f36e00b22e0 0x7f36e009b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e6e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36e009b900 0x7f36e01624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e6e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f36e009bd70 con 0x7f36e009b900 2024-05-30T16:53:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e6e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f36e00b1ae0 con 0x7f36e00b22e0 2024-05-30T16:53:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e6e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f36e00ce220 con 0x7f36e00b1700 2024-05-30T16:53:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e4e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36e009b900 0x7f36e01624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e4e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36e009b900 0x7f36e01624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35906/0 (socket says 172.21.15.59:35906) 2024-05-30T16:53:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e4e00640 1 -- 172.21.15.59:0/1975167790 learned_addr learned my addr 172.21.15.59:0/1975167790 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36dfe00640 1 --2- 172.21.15.59:0/1975167790 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e00b1700 0x7f36e00b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36df400640 1 --2- 172.21.15.59:0/1975167790 >> v2:172.21.15.107:3300/0 conn(0x7f36e00b22e0 0x7f36e009b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e4e00640 1 -- 172.21.15.59:0/1975167790 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e00b1700 msgr2=0x7f36e00b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e4e00640 1 --2- 172.21.15.59:0/1975167790 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e00b1700 0x7f36e00b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e4e00640 1 -- 172.21.15.59:0/1975167790 >> v2:172.21.15.107:3300/0 conn(0x7f36e00b22e0 msgr2=0x7f36e009b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e4e00640 1 --2- 172.21.15.59:0/1975167790 >> v2:172.21.15.107:3300/0 conn(0x7f36e00b22e0 0x7f36e009b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.008+0000 7f36e4e00640 1 -- 172.21.15.59:0/1975167790 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e00ce500 con 0x7f36e009b900 2024-05-30T16:53:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36e4e00640 1 --2- 172.21.15.59:0/1975167790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e009b900 0x7f36e01624e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f36e0073310 tx=0x7f36d801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94188279d9dc88b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36dea00640 1 -- 172.21.15.59:0/1975167790 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d80ac020 con 0x7f36e009b900 2024-05-30T16:53:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36dea00640 1 -- 172.21.15.59:0/1975167790 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d80a6440 con 0x7f36e009b900 2024-05-30T16:53:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36dea00640 1 -- 172.21.15.59:0/1975167790 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d80a6810 con 0x7f36e009b900 2024-05-30T16:53:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36e6e00640 1 -- 172.21.15.59:0/1975167790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e009b900 msgr2=0x7f36e01624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36e6e00640 1 --2- 172.21.15.59:0/1975167790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e009b900 0x7f36e01624e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f36e0073310 tx=0x7f36d801c6a0 comp rx=0 tx=0).stop 2024-05-30T16:53:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36e6e00640 1 -- 172.21.15.59:0/1975167790 shutdown_connections 2024-05-30T16:53:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36e6e00640 1 --2- 172.21.15.59:0/1975167790 >> v2:172.21.15.107:3300/0 conn(0x7f36e00b22e0 0x7f36e009b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36e6e00640 1 --2- 172.21.15.59:0/1975167790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e009b900 0x7f36e01624e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36e6e00640 1 --2- 172.21.15.59:0/1975167790 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e00b1700 0x7f36e00b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36e6e00640 1 -- 172.21.15.59:0/1975167790 >> 172.21.15.59:0/1975167790 conn(0x7f36e00b3f30 msgr2=0x7f36e00b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36e6e00640 1 -- 172.21.15.59:0/1975167790 shutdown_connections 2024-05-30T16:53:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36e6e00640 1 -- 172.21.15.59:0/1975167790 wait complete. 2024-05-30T16:53:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36e6e00640 1 Processor -- start 2024-05-30T16:53:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.012+0000 7f36e6e00640 1 -- start start 2024-05-30T16:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e6e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e009b900 0x7f36e014c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e6e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36e00b1700 0x7f36e006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e6e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00b22e0 0x7f36e006e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e6e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f36e00d05b0 con 0x7f36e00b22e0 2024-05-30T16:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e6e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f36e00d0430 con 0x7f36e00b1700 2024-05-30T16:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e6e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f36e00d0730 con 0x7f36e009b900 2024-05-30T16:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e4e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00b22e0 0x7f36e006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e4e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00b22e0 0x7f36e006e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35908/0 (socket says 172.21.15.59:35908) 2024-05-30T16:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e4e00640 1 -- 172.21.15.59:0/2282698838 learned_addr learned my addr 172.21.15.59:0/2282698838 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36dfe00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e009b900 0x7f36e014c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36df400640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36e00b1700 0x7f36e006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e4e00640 1 -- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e009b900 msgr2=0x7f36e014c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e4e00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e009b900 0x7f36e014c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e4e00640 1 -- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36e00b1700 msgr2=0x7f36e006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e4e00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36e00b1700 0x7f36e006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e4e00640 1 -- 172.21.15.59:0/2282698838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e00c96b0 con 0x7f36e00b22e0 2024-05-30T16:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e4e00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00b22e0 0x7f36e006e420 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f36d80ab040 tx=0x7f36d8019440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36d7e00640 1 -- 172.21.15.59:0/2282698838 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d80ac040 con 0x7f36e00b22e0 2024-05-30T16:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36d7e00640 1 -- 172.21.15.59:0/2282698838 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d80a6aa0 con 0x7f36e00b22e0 2024-05-30T16:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36d7e00640 1 -- 172.21.15.59:0/2282698838 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d80bb440 con 0x7f36e00b22e0 2024-05-30T16:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e6e00640 1 -- 172.21.15.59:0/2282698838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e00c9990 con 0x7f36e00b22e0 2024-05-30T16:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e6e00640 1 -- 172.21.15.59:0/2282698838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e00c9f50 con 0x7f36e00b22e0 2024-05-30T16:53:59.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.016+0000 7f36e6e00640 1 -- 172.21.15.59:0/2282698838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e0068a90 con 0x7f36e00b22e0 2024-05-30T16:53:59.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.020+0000 7f36d7e00640 1 -- 172.21.15.59:0/2282698838 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7f36d80af020 con 0x7f36e00b22e0 2024-05-30T16:53:59.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.020+0000 7f36d7e00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36c0068a40 0x7f36c006af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:59.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.020+0000 7f36d7e00640 1 -- 172.21.15.59:0/2282698838 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f36d81209a0 con 0x7f36e00b22e0 2024-05-30T16:53:59.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.020+0000 7f36dfe00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36c0068a40 0x7f36c006af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:59.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.020+0000 7f36dfe00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36c0068a40 0x7f36c006af00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36d0006fd0 tx=0x7f36d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.024+0000 7f36d7e00640 1 -- 172.21.15.59:0/2282698838 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f36d80c2020 con 0x7f36e00b22e0 2024-05-30T16:53:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 -- 172.21.15.59:0/2282698838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f36e00ca120 con 0x7f36e00b22e0 2024-05-30T16:53:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36d7e00640 1 -- 172.21.15.59:0/2282698838 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2125 (secure 0 0 0) 0x7f36d80165e0 con 0x7f36e00b22e0 2024-05-30T16:53:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:53:59.254 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:53:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:53:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:53:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:53:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:53:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:53:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:53:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:53:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:53:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:53:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:53:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:53:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:53:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:53:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:53:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 319, 2024-05-30T16:53:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:53:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:53:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:53:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 49, 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:53:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 3958, 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 16455930251, 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 32562241536, 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 740531871744, 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 485040240, 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 476010522, 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 118, 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 130 2024-05-30T16:53:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 26, 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 3, 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 3, 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5304 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:59.258 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 8, 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:53:19.132075+0000", 2024-05-30T16:53:59.259 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:53:59.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:53:59.260 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:53:59.260 INFO:teuthology.orchestra.run.smithi059.stdout: "6a26690c-32f2-46e2-957d-eb8bb7219da5": { 2024-05-30T16:53:59.260 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 27.0 seconds before exiting (12s)\n [============================] ", 2024-05-30T16:53:59.260 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:53:59.260 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:53:59.260 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:59.260 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:53:59.260 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:53:59.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 -- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36c0068a40 msgr2=0x7f36c006af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:59.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36c0068a40 0x7f36c006af00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36d0006fd0 tx=0x7f36d0008040 comp rx=0 tx=0).stop 2024-05-30T16:53:59.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 -- 172.21.15.59:0/2282698838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00b22e0 msgr2=0x7f36e006e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:59.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00b22e0 0x7f36e006e420 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f36d80ab040 tx=0x7f36d8019440 comp rx=0 tx=0).stop 2024-05-30T16:53:59.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 -- 172.21.15.59:0/2282698838 shutdown_connections 2024-05-30T16:53:59.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36c0068a40 0x7f36c006af00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:59.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e00b22e0 0x7f36e006e420 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:59.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36e00b1700 0x7f36e006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:59.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 --2- 172.21.15.59:0/2282698838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36e009b900 0x7f36e014c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:59.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 -- 172.21.15.59:0/2282698838 >> 172.21.15.59:0/2282698838 conn(0x7f36e00b3f30 msgr2=0x7f36e00d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 -- 172.21.15.59:0/2282698838 shutdown_connections 2024-05-30T16:53:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:53:59.252+0000 7f36e6e00640 1 -- 172.21.15.59:0/2282698838 wait complete. 2024-05-30T16:54:04.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:54:04.008 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:54:04.276 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:54:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.424+0000 7f0ccf200640 1 Processor -- start 2024-05-30T16:54:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.424+0000 7f0ccf200640 1 -- start start 2024-05-30T16:54:04.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0ccf200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cd006b9b0 0x7f0cd0162d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:04.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0ccf200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cd00b07b0 0x7f0cd006bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:04.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0ccf200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd0163280 con 0x7f0cd00d1f00 2024-05-30T16:54:04.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0ccf200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0cd006c2d0 con 0x7f0cd00b07b0 2024-05-30T16:54:04.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0ccf200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd00d0bf0 con 0x7f0cd006b9b0 2024-05-30T16:54:04.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0cc5400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cd00b07b0 0x7f0cd006bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0cc5400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cd00b07b0 0x7f0cd006bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55240/0 (socket says 172.21.15.59:55240) 2024-05-30T16:54:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0cc5400640 1 -- 172.21.15.59:0/2104062642 learned_addr learned my addr 172.21.15.59:0/2104062642 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0ccde00640 1 --2- 172.21.15.59:0/2104062642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cd006b9b0 0x7f0cd0162d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0cc5400640 1 -- 172.21.15.59:0/2104062642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cd006b9b0 msgr2=0x7f0cd0162d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0cc5400640 1 --2- 172.21.15.59:0/2104062642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cd006b9b0 0x7f0cd0162d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0cc5400640 1 -- 172.21.15.59:0/2104062642 >> v1:172.21.15.59:6789/0 conn(0x7f0cd00d1f00 legacy=0x7f0cd006ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0ccd400640 1 -- 172.21.15.59:0/2104062642 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665132318 0 0) 0x7f0cd0163280 con 0x7f0cd00d1f00 2024-05-30T16:54:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.428+0000 7f0cc5400640 1 -- 172.21.15.59:0/2104062642 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd00d0ed0 con 0x7f0cd00b07b0 2024-05-30T16:54:04.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0cc5400640 1 --2- 172.21.15.59:0/2104062642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00b07b0 0x7f0cd006bd90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009870 tx=0x7f0cb801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fe582c4ca7af62 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:04.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccd400640 1 -- 172.21.15.59:0/2104062642 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80b2070 con 0x7f0cd00b07b0 2024-05-30T16:54:04.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccd400640 1 -- 172.21.15.59:0/2104062642 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb80a9070 con 0x7f0cd00b07b0 2024-05-30T16:54:04.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccd400640 1 -- 172.21.15.59:0/2104062642 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80ad880 con 0x7f0cd00b07b0 2024-05-30T16:54:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccf200640 1 -- 172.21.15.59:0/2104062642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00b07b0 msgr2=0x7f0cd006bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccf200640 1 --2- 172.21.15.59:0/2104062642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00b07b0 0x7f0cd006bd90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009870 tx=0x7f0cb801c560 comp rx=0 tx=0).stop 2024-05-30T16:54:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccf200640 1 -- 172.21.15.59:0/2104062642 shutdown_connections 2024-05-30T16:54:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccf200640 1 --2- 172.21.15.59:0/2104062642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00b07b0 0x7f0cd006bd90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccf200640 1 --2- 172.21.15.59:0/2104062642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cd006b9b0 0x7f0cd0162d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccf200640 1 -- 172.21.15.59:0/2104062642 >> 172.21.15.59:0/2104062642 conn(0x7f0cd009aa40 msgr2=0x7f0cd00d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccf200640 1 -- 172.21.15.59:0/2104062642 shutdown_connections 2024-05-30T16:54:04.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccf200640 1 -- 172.21.15.59:0/2104062642 wait complete. 2024-05-30T16:54:04.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccf200640 1 Processor -- start 2024-05-30T16:54:04.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.432+0000 7f0ccf200640 1 -- start start 2024-05-30T16:54:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0ccf200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cd006b9b0 0x7f0cd00c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0ccf200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00b07b0 0x7f0cd00c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0ccf200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd00d1f00 0x7f0cd00b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0ccf200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd015f380 con 0x7f0cd00b07b0 2024-05-30T16:54:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0ccf200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd015f200 con 0x7f0cd00d1f00 2024-05-30T16:54:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0ccf200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd015f500 con 0x7f0cd006b9b0 2024-05-30T16:54:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00b07b0 0x7f0cd00c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00b07b0 0x7f0cd00c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55244/0 (socket says 172.21.15.59:55244) 2024-05-30T16:54:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc5400640 1 -- 172.21.15.59:0/2133118960 learned_addr learned my addr 172.21.15.59:0/2133118960 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0ccde00640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cd006b9b0 0x7f0cd00c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cce800640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd00d1f00 0x7f0cd00b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc5400640 1 -- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cd006b9b0 msgr2=0x7f0cd00c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc5400640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cd006b9b0 0x7f0cd00c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc5400640 1 -- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd00d1f00 msgr2=0x7f0cd00b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc5400640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd00d1f00 0x7f0cd00b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc5400640 1 -- 172.21.15.59:0/2133118960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd00c9170 con 0x7f0cd00b07b0 2024-05-30T16:54:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0ccde00640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cd006b9b0 0x7f0cd00c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc5400640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00b07b0 0x7f0cd00c8b90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0cb801ac10 tx=0x7f0cb8019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc6a00640 1 -- 172.21.15.59:0/2133118960 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80bb070 con 0x7f0cd00b07b0 2024-05-30T16:54:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc6a00640 1 -- 172.21.15.59:0/2133118960 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb80adce0 con 0x7f0cd00b07b0 2024-05-30T16:54:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc6a00640 1 -- 172.21.15.59:0/2133118960 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80b2040 con 0x7f0cd00b07b0 2024-05-30T16:54:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0ccf200640 1 -- 172.21.15.59:0/2133118960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd00c9450 con 0x7f0cd00b07b0 2024-05-30T16:54:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0ccf200640 1 -- 172.21.15.59:0/2133118960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd00c9a10 con 0x7f0cd00b07b0 2024-05-30T16:54:04.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0ccf200640 1 -- 172.21.15.59:0/2133118960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd0068a90 con 0x7f0cd00b07b0 2024-05-30T16:54:04.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.436+0000 7f0cc6a00640 1 -- 172.21.15.59:0/2133118960 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7f0cb80be070 con 0x7f0cd00b07b0 2024-05-30T16:54:04.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.440+0000 7f0cc6a00640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0cac068a70 0x7f0cac06af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.440+0000 7f0cc6a00640 1 -- 172.21.15.59:0/2133118960 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f0cb81206e0 con 0x7f0cd00b07b0 2024-05-30T16:54:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.440+0000 7f0ccde00640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0cac068a70 0x7f0cac06af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.440+0000 7f0ccde00640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0cac068a70 0x7f0cac06af30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00ca990 tx=0x7f0cc000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.444+0000 7f0cc6a00640 1 -- 172.21.15.59:0/2133118960 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0cb8016150 con 0x7f0cd00b07b0 2024-05-30T16:54:04.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.664+0000 7f0ccf200640 1 -- 172.21.15.59:0/2133118960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0cd006c570 con 0x7f0cd00b07b0 2024-05-30T16:54:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.664+0000 7f0cc6a00640 1 -- 172.21.15.59:0/2133118960 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2123 (secure 0 0 0) 0x7f0cb80f00d0 con 0x7f0cd00b07b0 2024-05-30T16:54:04.667 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:04.667 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:54:04.667 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:54:04.667 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:54:04.667 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:54:04.667 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:54:04.667 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:54:04.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:04.667 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:54:04.667 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 324, 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:54:04.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 49, 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:54:04.669 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:54:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:54:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4056, 2024-05-30T16:54:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 16879746423, 2024-05-30T16:54:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 34120417280, 2024-05-30T16:54:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 738973696000, 2024-05-30T16:54:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:54:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 353283807, 2024-05-30T16:54:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 351576207, 2024-05-30T16:54:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 87, 2024-05-30T16:54:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 98 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 26, 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 3, 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 3, 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:54:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5304 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:54:04.673 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 8, 2024-05-30T16:54:04.673 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:53:19.132075+0000", 2024-05-30T16:54:04.673 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:54:04.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:04.673 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:54:04.673 INFO:teuthology.orchestra.run.smithi059.stdout: "6a26690c-32f2-46e2-957d-eb8bb7219da5": { 2024-05-30T16:54:04.673 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 21.0 seconds before exiting (18s)\n [============================] ", 2024-05-30T16:54:04.673 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:54:04.673 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:54:04.673 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:04.673 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:04.673 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:54:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.664+0000 7f0ccf200640 1 -- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0cac068a70 msgr2=0x7f0cac06af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.664+0000 7f0ccf200640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0cac068a70 0x7f0cac06af30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00ca990 tx=0x7f0cc000b040 comp rx=0 tx=0).stop 2024-05-30T16:54:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.664+0000 7f0ccf200640 1 -- 172.21.15.59:0/2133118960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00b07b0 msgr2=0x7f0cd00c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.664+0000 7f0ccf200640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00b07b0 0x7f0cd00c8b90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0cb801ac10 tx=0x7f0cb8019300 comp rx=0 tx=0).stop 2024-05-30T16:54:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.664+0000 7f0ccf200640 1 -- 172.21.15.59:0/2133118960 shutdown_connections 2024-05-30T16:54:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.664+0000 7f0ccf200640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0cac068a70 0x7f0cac06af30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.664+0000 7f0ccf200640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd00d1f00 0x7f0cd00b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.664+0000 7f0ccf200640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00b07b0 0x7f0cd00c8b90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.664+0000 7f0ccf200640 1 --2- 172.21.15.59:0/2133118960 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cd006b9b0 0x7f0cd00c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.664+0000 7f0ccf200640 1 -- 172.21.15.59:0/2133118960 >> 172.21.15.59:0/2133118960 conn(0x7f0cd009aa40 msgr2=0x7f0cd00ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.668+0000 7f0ccf200640 1 -- 172.21.15.59:0/2133118960 shutdown_connections 2024-05-30T16:54:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:04.668+0000 7f0ccf200640 1 -- 172.21.15.59:0/2133118960 wait complete. 2024-05-30T16:54:09.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:54:09.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f188b800640 1 Processor -- start 2024-05-30T16:54:09.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f188b800640 1 -- start start 2024-05-30T16:54:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f188b800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18840b37a0 0x7f18840d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f188b800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f188409b150 0x7f18840cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f188b800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18840d0260 con 0x7f18840cdb60 2024-05-30T16:54:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f188b800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f18840d0010 con 0x7f188409b150 2024-05-30T16:54:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f188b800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f18840d0540 con 0x7f18840b37a0 2024-05-30T16:54:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f18840cdb60 0x7f188409aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39694/0 (socket says 172.21.15.59:39694) 2024-05-30T16:54:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883e00640 1 -- 172.21.15.59:0/3070114198 learned_addr learned my addr 172.21.15.59:0/3070114198 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1889800640 1 --2- 172.21.15.59:0/3070114198 >> v2:172.21.15.107:3300/0 conn(0x7f188409b150 0x7f18840cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1888e00640 1 --2- 172.21.15.59:0/3070114198 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18840b37a0 0x7f18840d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2469990357 0 0) 0x7f18840d0260 con 0x7f18840cdb60 2024-05-30T16:54:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f186c003530 con 0x7f18840cdb60 2024-05-30T16:54:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1244776837 0 0) 0x7f186c003530 con 0x7f18840cdb60 2024-05-30T16:54:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18840b37a0 msgr2=0x7f18840d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 --2- 172.21.15.59:0/3070114198 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18840b37a0 0x7f18840d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 >> v2:172.21.15.107:3300/0 conn(0x7f188409b150 msgr2=0x7f18840cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 --2- 172.21.15.59:0/3070114198 >> v2:172.21.15.107:3300/0 conn(0x7f188409b150 0x7f18840cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18840d0820 con 0x7f18840cdb60 2024-05-30T16:54:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f1870001680 con 0x7f18840cdb60 2024-05-30T16:54:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 >> v1:172.21.15.59:6789/0 conn(0x7f18840cdb60 legacy=0x7f188409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 --2- 172.21.15.59:0/3070114198 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18840b37a0 0x7f186c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 --2- 172.21.15.59:0/3070114198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186c003f40 0x7f186c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 --2- 172.21.15.59:0/3070114198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f186c004d50 0x7f186c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f18840d0010 con 0x7f186c003f40 2024-05-30T16:54:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f18840d0540 con 0x7f186c004d50 2024-05-30T16:54:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f186c00ba20 con 0x7f18840b37a0 2024-05-30T16:54:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883e00640 1 --2- 172.21.15.59:0/3070114198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186c003f40 0x7f186c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1888e00640 1 --2- 172.21.15.59:0/3070114198 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18840b37a0 0x7f186c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1889800640 1 --2- 172.21.15.59:0/3070114198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f186c004d50 0x7f186c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883e00640 1 -- 172.21.15.59:0/3070114198 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18840b37a0 msgr2=0x7f186c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883e00640 1 --2- 172.21.15.59:0/3070114198 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18840b37a0 0x7f186c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883e00640 1 -- 172.21.15.59:0/3070114198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f186c004d50 msgr2=0x7f186c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883e00640 1 --2- 172.21.15.59:0/3070114198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f186c004d50 0x7f186c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.839+0000 7f1883e00640 1 -- 172.21.15.59:0/3070114198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c003530 con 0x7f186c003f40 2024-05-30T16:54:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.843+0000 7f1883e00640 1 --2- 172.21.15.59:0/3070114198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186c003f40 0x7f186c004810 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f187000c270 tx=0x7f187001cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b6e035bd9c3cb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.843+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870007d60 con 0x7f186c003f40 2024-05-30T16:54:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.843+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18700a9020 con 0x7f186c003f40 2024-05-30T16:54:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.843+0000 7f1883400640 1 -- 172.21.15.59:0/3070114198 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18700a5b10 con 0x7f186c003f40 2024-05-30T16:54:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.843+0000 7f188b800640 1 -- 172.21.15.59:0/3070114198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186c003f40 msgr2=0x7f186c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.843+0000 7f188b800640 1 --2- 172.21.15.59:0/3070114198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186c003f40 0x7f186c004810 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f187000c270 tx=0x7f187001cc90 comp rx=0 tx=0).stop 2024-05-30T16:54:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.843+0000 7f1889800640 1 -- 172.21.15.59:0/3070114198 reap_dead start 2024-05-30T16:54:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.843+0000 7f188b800640 1 -- 172.21.15.59:0/3070114198 shutdown_connections 2024-05-30T16:54:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.843+0000 7f188b800640 1 -- 172.21.15.59:0/3070114198 >> 172.21.15.59:0/3070114198 conn(0x7f18840b3f30 msgr2=0x7f18840b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.843+0000 7f188b800640 1 -- 172.21.15.59:0/3070114198 shutdown_connections 2024-05-30T16:54:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.843+0000 7f188b800640 1 -- 172.21.15.59:0/3070114198 wait complete. 2024-05-30T16:54:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f188b800640 1 Processor -- start 2024-05-30T16:54:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f188b800640 1 -- start start 2024-05-30T16:54:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f188b800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186c003f40 0x7f188415ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f188b800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18840cbb30 0x7f18840cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f188b800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18841f7a70 0x7f18841f7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f188b800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f18840b2730 con 0x7f186c003f40 2024-05-30T16:54:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f188b800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f18840b25b0 con 0x7f18840cbb30 2024-05-30T16:54:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f188b800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f18840b28b0 con 0x7f18841f7a70 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1888e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186c003f40 0x7f188415ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1888e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186c003f40 0x7f188415ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55258/0 (socket says 172.21.15.59:55258) 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1888e00640 1 -- 172.21.15.59:0/3148423163 learned_addr learned my addr 172.21.15.59:0/3148423163 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1889800640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18841f7a70 0x7f18841f7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1883e00640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18840cbb30 0x7f18840cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1888e00640 1 -- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18841f7a70 msgr2=0x7f18841f7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1888e00640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18841f7a70 0x7f18841f7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1888e00640 1 -- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18840cbb30 msgr2=0x7f18840cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1888e00640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18840cbb30 0x7f18840cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1888e00640 1 -- 172.21.15.59:0/3148423163 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18841f8420 con 0x7f186c003f40 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1889800640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18841f7a70 0x7f18841f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1888e00640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186c003f40 0x7f188415ae90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1878011a00 tx=0x7f1878011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1880c00640 1 -- 172.21.15.59:0/3148423163 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878005bb0 con 0x7f186c003f40 2024-05-30T16:54:09.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1880c00640 1 -- 172.21.15.59:0/3148423163 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1878005d50 con 0x7f186c003f40 2024-05-30T16:54:09.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f1880c00640 1 -- 172.21.15.59:0/3148423163 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187800fb00 con 0x7f186c003f40 2024-05-30T16:54:09.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f188b800640 1 -- 172.21.15.59:0/3148423163 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188414d6b0 con 0x7f186c003f40 2024-05-30T16:54:09.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.847+0000 7f188b800640 1 -- 172.21.15.59:0/3148423163 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188415a690 con 0x7f186c003f40 2024-05-30T16:54:09.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.851+0000 7f188b800640 1 -- 172.21.15.59:0/3148423163 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1884068a90 con 0x7f186c003f40 2024-05-30T16:54:09.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.851+0000 7f1880c00640 1 -- 172.21.15.59:0/3148423163 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7f1878012040 con 0x7f186c003f40 2024-05-30T16:54:09.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.851+0000 7f1880c00640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1864068a40 0x7f186406af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:09.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.851+0000 7f1880c00640 1 -- 172.21.15.59:0/3148423163 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f1878087cb0 con 0x7f186c003f40 2024-05-30T16:54:09.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.851+0000 7f1883e00640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1864068a40 0x7f186406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:09.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.851+0000 7f1883e00640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1864068a40 0x7f186406af00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f18700aa000 tx=0x7f1870001ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:09.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:09.855+0000 7f1880c00640 1 -- 172.21.15.59:0/3148423163 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1878018030 con 0x7f186c003f40 2024-05-30T16:54:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 -- 172.21.15.59:0/3148423163 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f18840ce950 con 0x7f186c003f40 2024-05-30T16:54:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f1880c00640 1 -- 172.21.15.59:0/3148423163 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2120 (secure 0 0 0) 0x7f187801b360 con 0x7f186c003f40 2024-05-30T16:54:10.082 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:10.082 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:54:10.082 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:54:10.082 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:54:10.082 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:54:10.083 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:10.084 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 330, 2024-05-30T16:54:10.084 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:54:10.084 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:54:10.084 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:54:10.084 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:54:10.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:10.084 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:54:10.084 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 49, 2024-05-30T16:54:10.084 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:54:10.084 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:54:10.084 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:54:10.085 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4056, 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 16879761280, 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 34120450048, 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 738973663232, 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 34595501, 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 35313489, 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 9, 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 14 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 26, 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 3, 2024-05-30T16:54:10.086 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 3, 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5304 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:54:10.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 8, 2024-05-30T16:54:10.088 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:53:19.132075+0000", 2024-05-30T16:54:10.089 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:54:10.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:10.089 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:54:10.089 INFO:teuthology.orchestra.run.smithi059.stdout: "6a26690c-32f2-46e2-957d-eb8bb7219da5": { 2024-05-30T16:54:10.089 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 15.0 seconds before exiting (24s)\n [============================] ", 2024-05-30T16:54:10.089 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:54:10.089 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:54:10.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:10.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:10.089 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:54:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 -- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1864068a40 msgr2=0x7f186406af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1864068a40 0x7f186406af00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f18700aa000 tx=0x7f1870001ac0 comp rx=0 tx=0).stop 2024-05-30T16:54:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 -- 172.21.15.59:0/3148423163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186c003f40 msgr2=0x7f188415ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186c003f40 0x7f188415ae90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1878011a00 tx=0x7f1878011ec0 comp rx=0 tx=0).stop 2024-05-30T16:54:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 -- 172.21.15.59:0/3148423163 shutdown_connections 2024-05-30T16:54:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1864068a40 0x7f186406af00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18841f7a70 0x7f18841f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18840cbb30 0x7f18840cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 --2- 172.21.15.59:0/3148423163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186c003f40 0x7f188415ae90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 -- 172.21.15.59:0/3148423163 >> 172.21.15.59:0/3148423163 conn(0x7f18840b3f30 msgr2=0x7f188406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:10.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 -- 172.21.15.59:0/3148423163 shutdown_connections 2024-05-30T16:54:10.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:10.079+0000 7f188b800640 1 -- 172.21.15.59:0/3148423163 wait complete. 2024-05-30T16:54:15.105 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:54:15.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.255+0000 7f7b34e00640 1 Processor -- start 2024-05-30T16:54:15.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.255+0000 7f7b34e00640 1 -- start start 2024-05-30T16:54:15.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.255+0000 7f7b34e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b3015f690 0x7f7b300b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:15.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.255+0000 7f7b34e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7b3006f8c0 0x7f7b300b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:15.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.255+0000 7f7b34e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b3006de10 con 0x7f7b301558e0 2024-05-30T16:54:15.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.255+0000 7f7b34e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7b3006e0f0 con 0x7f7b3006f8c0 2024-05-30T16:54:15.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.255+0000 7f7b34e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3006e3d0 con 0x7f7b3015f690 2024-05-30T16:54:15.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.259+0000 7f7b25400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b3015f690 0x7f7b300b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:15.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.259+0000 7f7b2e800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7b3006f8c0 0x7f7b300b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:15.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.259+0000 7f7b25400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b3015f690 0x7f7b300b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:45392/0 (socket says 172.21.15.59:45392) 2024-05-30T16:54:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.259+0000 7f7b25400640 1 -- 172.21.15.59:0/325748082 learned_addr learned my addr 172.21.15.59:0/325748082 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.259+0000 7f7b2e800640 1 --2- 172.21.15.59:0/325748082 >> v2:172.21.15.107:3300/0 conn(0x7f7b3006f8c0 0x7f7b300b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:42562/0 (socket says 172.21.15.59:42562) 2024-05-30T16:54:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.259+0000 7f7b25400640 1 -- 172.21.15.59:0/325748082 >> v2:172.21.15.107:3300/0 conn(0x7f7b3006f8c0 msgr2=0x7f7b300b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.259+0000 7f7b25400640 1 --2- 172.21.15.59:0/325748082 >> v2:172.21.15.107:3300/0 conn(0x7f7b3006f8c0 0x7f7b300b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.259+0000 7f7b25400640 1 -- 172.21.15.59:0/325748082 >> v1:172.21.15.107:6789/0 conn(0x7f7b301558e0 legacy=0x7f7b3015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.259+0000 7f7b25400640 1 -- 172.21.15.59:0/325748082 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3006e6b0 con 0x7f7b3015f690 2024-05-30T16:54:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.259+0000 7f7b2e800640 1 --2- 172.21.15.59:0/325748082 >> v2:172.21.15.107:3300/0 conn(0x7f7b3006f8c0 0x7f7b300b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:54:15.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.259+0000 7f7b25400640 1 --2- 172.21.15.59:0/325748082 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b3015f690 0x7f7b300b3e30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800d150 tx=0x7f7b1801ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e86f5adaabb1d337 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:15.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b2d400640 1 -- 172.21.15.59:0/325748082 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1800b2d0 con 0x7f7b3015f690 2024-05-30T16:54:15.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b2d400640 1 -- 172.21.15.59:0/325748082 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1800b470 con 0x7f7b3015f690 2024-05-30T16:54:15.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b2d400640 1 -- 172.21.15.59:0/325748082 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b180a7ba0 con 0x7f7b3015f690 2024-05-30T16:54:15.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 -- 172.21.15.59:0/325748082 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b3015f690 msgr2=0x7f7b300b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:15.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 --2- 172.21.15.59:0/325748082 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b3015f690 0x7f7b300b3e30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800d150 tx=0x7f7b1801ec30 comp rx=0 tx=0).stop 2024-05-30T16:54:15.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 -- 172.21.15.59:0/325748082 shutdown_connections 2024-05-30T16:54:15.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 --2- 172.21.15.59:0/325748082 >> v2:172.21.15.107:3300/0 conn(0x7f7b3006f8c0 0x7f7b300b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:15.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 --2- 172.21.15.59:0/325748082 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b3015f690 0x7f7b300b3e30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:15.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 -- 172.21.15.59:0/325748082 >> 172.21.15.59:0/325748082 conn(0x7f7b30067d60 msgr2=0x7f7b3006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:15.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 -- 172.21.15.59:0/325748082 shutdown_connections 2024-05-30T16:54:15.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 -- 172.21.15.59:0/325748082 wait complete. 2024-05-30T16:54:15.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 Processor -- start 2024-05-30T16:54:15.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 -- start start 2024-05-30T16:54:15.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b3006f8c0 0x7f7b3013a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:15.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b301558e0 0x7f7b301644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:15.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b3015f690 0x7f7b301649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:15.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7b30155e40 con 0x7f7b3006f8c0 2024-05-30T16:54:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7b30155cc0 con 0x7f7b301558e0 2024-05-30T16:54:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b34e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7b300b5400 con 0x7f7b3015f690 2024-05-30T16:54:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b2de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b3006f8c0 0x7f7b3013a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b2de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b3006f8c0 0x7f7b3013a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33944/0 (socket says 172.21.15.59:33944) 2024-05-30T16:54:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b2de00640 1 -- 172.21.15.59:0/1880228435 learned_addr learned my addr 172.21.15.59:0/1880228435 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b2e800640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b3015f690 0x7f7b301649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.263+0000 7f7b25400640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b301558e0 0x7f7b301644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:15.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b2de00640 1 -- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b3015f690 msgr2=0x7f7b301649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:15.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b2de00640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b3015f690 0x7f7b301649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:15.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b2de00640 1 -- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b301558e0 msgr2=0x7f7b301644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:15.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b2de00640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b301558e0 0x7f7b301644a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:15.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b2de00640 1 -- 172.21.15.59:0/1880228435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b300b3a50 con 0x7f7b3006f8c0 2024-05-30T16:54:15.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b2de00640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b3006f8c0 0x7f7b3013a620 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000c420 tx=0x7f7b2000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:15.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b26a00640 1 -- 172.21.15.59:0/1880228435 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200052d0 con 0x7f7b3006f8c0 2024-05-30T16:54:15.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b26a00640 1 -- 172.21.15.59:0/1880228435 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b20005470 con 0x7f7b3006f8c0 2024-05-30T16:54:15.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b26a00640 1 -- 172.21.15.59:0/1880228435 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20007260 con 0x7f7b3006f8c0 2024-05-30T16:54:15.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b34e00640 1 -- 172.21.15.59:0/1880228435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b300b2250 con 0x7f7b3006f8c0 2024-05-30T16:54:15.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b34e00640 1 -- 172.21.15.59:0/1880228435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b300b2810 con 0x7f7b3006f8c0 2024-05-30T16:54:15.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b34e00640 1 -- 172.21.15.59:0/1880228435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b30068a90 con 0x7f7b3006f8c0 2024-05-30T16:54:15.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b26a00640 1 -- 172.21.15.59:0/1880228435 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7f7b20007400 con 0x7f7b3006f8c0 2024-05-30T16:54:15.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.267+0000 7f7b26a00640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7b0c068a70 0x7f7b0c06af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:15.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.271+0000 7f7b26a00640 1 -- 172.21.15.59:0/1880228435 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f7b200869f0 con 0x7f7b3006f8c0 2024-05-30T16:54:15.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.271+0000 7f7b25400640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7b0c068a70 0x7f7b0c06af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:15.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.271+0000 7f7b25400640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7b0c068a70 0x7f7b0c06af30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7b180b0000 tx=0x7f7b180a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:15.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.275+0000 7f7b26a00640 1 -- 172.21.15.59:0/1880228435 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b20055f30 con 0x7f7b3006f8c0 2024-05-30T16:54:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.499+0000 7f7b34e00640 1 -- 172.21.15.59:0/1880228435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7b3013d0b0 con 0x7f7b3006f8c0 2024-05-30T16:54:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.499+0000 7f7b26a00640 1 -- 172.21.15.59:0/1880228435 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2078 (secure 0 0 0) 0x7f7b2005a230 con 0x7f7b3006f8c0 2024-05-30T16:54:15.503 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:15.503 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:54:15.503 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:54:15.503 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:54:15.503 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:54:15.503 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:54:15.504 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:54:15.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:15.504 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:54:15.504 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:54:15.504 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:54:15.504 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:54:15.504 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:54:15.504 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:15.504 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:54:15.504 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:54:15.504 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:54:15.504 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 335, 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 49, 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:54:15.505 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:54:15.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:15.506 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:54:15.506 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:54:15.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:15.506 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:54:15.506 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:54:15.506 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:15.506 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:15.506 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:54:15.506 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:54:15.506 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4056, 2024-05-30T16:54:15.506 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 16879770851, 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 34138947584, 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 738955165696, 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 2388, 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 26, 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 3, 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:54:15.507 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 3, 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5304 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:54:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 8, 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:53:19.132075+0000", 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: "6a26690c-32f2-46e2-957d-eb8bb7219da5": { 2024-05-30T16:54:15.509 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 9.0 seconds before exiting (30s)\n [============================] ", 2024-05-30T16:54:15.510 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:54:15.510 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:54:15.510 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:15.510 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:15.510 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:54:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.503+0000 7f7b34e00640 1 -- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7b0c068a70 msgr2=0x7f7b0c06af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.503+0000 7f7b34e00640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7b0c068a70 0x7f7b0c06af30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7b180b0000 tx=0x7f7b180a9070 comp rx=0 tx=0).stop 2024-05-30T16:54:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.503+0000 7f7b34e00640 1 -- 172.21.15.59:0/1880228435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b3006f8c0 msgr2=0x7f7b3013a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.503+0000 7f7b34e00640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b3006f8c0 0x7f7b3013a620 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000c420 tx=0x7f7b2000c820 comp rx=0 tx=0).stop 2024-05-30T16:54:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.503+0000 7f7b34e00640 1 -- 172.21.15.59:0/1880228435 shutdown_connections 2024-05-30T16:54:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.503+0000 7f7b34e00640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7b0c068a70 0x7f7b0c06af30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.503+0000 7f7b34e00640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b3015f690 0x7f7b301649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.503+0000 7f7b34e00640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b301558e0 0x7f7b301644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.503+0000 7f7b34e00640 1 --2- 172.21.15.59:0/1880228435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b3006f8c0 0x7f7b3013a620 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.503+0000 7f7b34e00640 1 -- 172.21.15.59:0/1880228435 >> 172.21.15.59:0/1880228435 conn(0x7f7b30067d60 msgr2=0x7f7b3006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.503+0000 7f7b34e00640 1 -- 172.21.15.59:0/1880228435 shutdown_connections 2024-05-30T16:54:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:15.503+0000 7f7b34e00640 1 -- 172.21.15.59:0/1880228435 wait complete. 2024-05-30T16:54:20.526 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:54:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.675+0000 7f4e6da00640 1 Processor -- start 2024-05-30T16:54:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.675+0000 7f4e6da00640 1 -- start start 2024-05-30T16:54:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.675+0000 7f4e6da00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e6806fa10 0x7f4e681642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.675+0000 7f4e6da00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e681647e0 0x7f4e68071d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.675+0000 7f4e6da00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e680b3eb0 con 0x7f4e680cf990 2024-05-30T16:54:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.675+0000 7f4e6da00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4e68164000 con 0x7f4e681647e0 2024-05-30T16:54:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.675+0000 7f4e6da00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6806e4d0 con 0x7f4e6806fa10 2024-05-30T16:54:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e66a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4e680cf990 0x7f4e680d0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36306/0 (socket says 172.21.15.59:36306) 2024-05-30T16:54:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e66a00640 1 -- 172.21.15.59:0/1850065601 learned_addr learned my addr 172.21.15.59:0/1850065601 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e67400640 1 --2- 172.21.15.59:0/1850065601 >> v2:172.21.15.59:3300/0 conn(0x7f4e681647e0 0x7f4e68071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e5fe00640 1 --2- 172.21.15.59:0/1850065601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e6806fa10 0x7f4e681642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e67400640 1 -- 172.21.15.59:0/1850065601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e6806fa10 msgr2=0x7f4e681642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e67400640 1 --2- 172.21.15.59:0/1850065601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e6806fa10 0x7f4e681642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e67400640 1 -- 172.21.15.59:0/1850065601 >> v1:172.21.15.59:6789/0 conn(0x7f4e680cf990 legacy=0x7f4e680d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e67400640 1 -- 172.21.15.59:0/1850065601 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e680b4190 con 0x7f4e681647e0 2024-05-30T16:54:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e5fe00640 1 --2- 172.21.15.59:0/1850065601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e6806fa10 0x7f4e681642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e66000640 1 -- 172.21.15.59:0/1850065601 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3956780588 0 0) 0x7f4e680b3eb0 con 0x7f4e680cf990 2024-05-30T16:54:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e67400640 1 --2- 172.21.15.59:0/1850065601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e681647e0 0x7f4e68071d70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009d90 tx=0x7f4e6001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e7e9562b72cac8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e66000640 1 -- 172.21.15.59:0/1850065601 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600b4070 con 0x7f4e681647e0 2024-05-30T16:54:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e66000640 1 -- 172.21.15.59:0/1850065601 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e600af600 con 0x7f4e681647e0 2024-05-30T16:54:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.679+0000 7f4e66000640 1 -- 172.21.15.59:0/1850065601 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600af9d0 con 0x7f4e681647e0 2024-05-30T16:54:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 -- 172.21.15.59:0/1850065601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e681647e0 msgr2=0x7f4e68071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 --2- 172.21.15.59:0/1850065601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e681647e0 0x7f4e68071d70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009d90 tx=0x7f4e6001f150 comp rx=0 tx=0).stop 2024-05-30T16:54:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 -- 172.21.15.59:0/1850065601 shutdown_connections 2024-05-30T16:54:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 --2- 172.21.15.59:0/1850065601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e681647e0 0x7f4e68071d70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 --2- 172.21.15.59:0/1850065601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e6806fa10 0x7f4e681642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:20.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 -- 172.21.15.59:0/1850065601 >> 172.21.15.59:0/1850065601 conn(0x7f4e68067d60 msgr2=0x7f4e6806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:20.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 -- 172.21.15.59:0/1850065601 shutdown_connections 2024-05-30T16:54:20.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 -- 172.21.15.59:0/1850065601 wait complete. 2024-05-30T16:54:20.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 Processor -- start 2024-05-30T16:54:20.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 -- start start 2024-05-30T16:54:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e6806fa10 0x7f4e680afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e680cf990 0x7f4e680b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e681647e0 0x7f4e680b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680722b0 con 0x7f4e681647e0 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6806e720 con 0x7f4e6806fa10 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e6da00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4e68072430 con 0x7f4e680cf990 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e67400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e681647e0 0x7f4e680b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e67400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e681647e0 0x7f4e680b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33970/0 (socket says 172.21.15.59:33970) 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e67400640 1 -- 172.21.15.59:0/3800933239 learned_addr learned my addr 172.21.15.59:0/3800933239 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e66a00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e6806fa10 0x7f4e680afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e5fe00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e680cf990 0x7f4e680b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e67400640 1 -- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e680cf990 msgr2=0x7f4e680b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e67400640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e680cf990 0x7f4e680b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e67400640 1 -- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e6806fa10 msgr2=0x7f4e680afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e67400640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e6806fa10 0x7f4e680afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e67400640 1 -- 172.21.15.59:0/3800933239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e680cd010 con 0x7f4e681647e0 2024-05-30T16:54:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e66a00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e6806fa10 0x7f4e680afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:20.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.683+0000 7f4e5fe00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e680cf990 0x7f4e680b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.687+0000 7f4e67400640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e681647e0 0x7f4e680b26f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009d90 tx=0x7f4e6001bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.687+0000 7f4e5ea00640 1 -- 172.21.15.59:0/3800933239 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600b4040 con 0x7f4e681647e0 2024-05-30T16:54:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.687+0000 7f4e5ea00640 1 -- 172.21.15.59:0/3800933239 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e600039a0 con 0x7f4e681647e0 2024-05-30T16:54:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.687+0000 7f4e6da00640 1 -- 172.21.15.59:0/3800933239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e680b0360 con 0x7f4e681647e0 2024-05-30T16:54:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.687+0000 7f4e5ea00640 1 -- 172.21.15.59:0/3800933239 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60009450 con 0x7f4e681647e0 2024-05-30T16:54:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.687+0000 7f4e6da00640 1 -- 172.21.15.59:0/3800933239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e680b0920 con 0x7f4e681647e0 2024-05-30T16:54:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.687+0000 7f4e6da00640 1 -- 172.21.15.59:0/3800933239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e68068a90 con 0x7f4e681647e0 2024-05-30T16:54:20.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.687+0000 7f4e5ea00640 1 -- 172.21.15.59:0/3800933239 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7f4e600c4060 con 0x7f4e681647e0 2024-05-30T16:54:20.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.687+0000 7f4e5ea00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4e44068a40 0x7f4e4406af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:20.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.687+0000 7f4e5ea00640 1 -- 172.21.15.59:0/3800933239 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f4e60125560 con 0x7f4e681647e0 2024-05-30T16:54:20.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.691+0000 7f4e66a00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4e44068a40 0x7f4e4406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:20.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.691+0000 7f4e66a00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4e44068a40 0x7f4e4406af00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4e58000f70 tx=0x7f4e58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:20.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.695+0000 7f4e5ea00640 1 -- 172.21.15.59:0/3800933239 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4e60018cb0 con 0x7f4e681647e0 2024-05-30T16:54:20.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.919+0000 7f4e6da00640 1 -- 172.21.15.59:0/3800933239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4e6806bda0 con 0x7f4e681647e0 2024-05-30T16:54:20.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.919+0000 7f4e5ea00640 1 -- 172.21.15.59:0/3800933239 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2078 (secure 0 0 0) 0x7f4e600b8370 con 0x7f4e681647e0 2024-05-30T16:54:20.923 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:54:20.924 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 340, 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 49, 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:54:20.925 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4056, 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 16879770851, 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 34138947584, 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 738955165696, 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 2388, 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 26, 2024-05-30T16:54:20.927 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 3, 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 3, 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5304 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:54:20.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 8, 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:53:19.132075+0000", 2024-05-30T16:54:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:54:20.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:20.930 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:54:20.930 INFO:teuthology.orchestra.run.smithi059.stdout: "6a26690c-32f2-46e2-957d-eb8bb7219da5": { 2024-05-30T16:54:20.930 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 5.0 seconds before exiting (34s)\n [============================] ", 2024-05-30T16:54:20.930 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:54:20.930 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:54:20.930 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:20.930 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:20.930 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:54:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.923+0000 7f4e6da00640 1 -- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4e44068a40 msgr2=0x7f4e4406af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.923+0000 7f4e6da00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4e44068a40 0x7f4e4406af00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4e58000f70 tx=0x7f4e58009040 comp rx=0 tx=0).stop 2024-05-30T16:54:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.923+0000 7f4e6da00640 1 -- 172.21.15.59:0/3800933239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e681647e0 msgr2=0x7f4e680b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.923+0000 7f4e6da00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e681647e0 0x7f4e680b26f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009d90 tx=0x7f4e6001bef0 comp rx=0 tx=0).stop 2024-05-30T16:54:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.923+0000 7f4e6da00640 1 -- 172.21.15.59:0/3800933239 shutdown_connections 2024-05-30T16:54:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.923+0000 7f4e6da00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4e44068a40 0x7f4e4406af00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.923+0000 7f4e6da00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e681647e0 0x7f4e680b26f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.923+0000 7f4e6da00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e680cf990 0x7f4e680b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.923+0000 7f4e6da00640 1 --2- 172.21.15.59:0/3800933239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e6806fa10 0x7f4e680afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.923+0000 7f4e6da00640 1 -- 172.21.15.59:0/3800933239 >> 172.21.15.59:0/3800933239 conn(0x7f4e68067d60 msgr2=0x7f4e680d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.923+0000 7f4e6da00640 1 -- 172.21.15.59:0/3800933239 shutdown_connections 2024-05-30T16:54:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:20.923+0000 7f4e6da00640 1 -- 172.21.15.59:0/3800933239 wait complete. 2024-05-30T16:54:25.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:54:26.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.095+0000 7f0977a00640 1 Processor -- start 2024-05-30T16:54:26.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.095+0000 7f0977a00640 1 -- start start 2024-05-30T16:54:26.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0977a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0970146000 0x7f09701600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0977a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f09700b4df0 0x7f09700cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0977a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09700b3c20 con 0x7f0970160610 2024-05-30T16:54:26.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0977a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f097015ce50 con 0x7f09700b4df0 2024-05-30T16:54:26.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0977a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0970160c40 con 0x7f0970146000 2024-05-30T16:54:26.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0967e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0970160610 0x7f09700b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47688/0 (socket says 172.21.15.59:47688) 2024-05-30T16:54:26.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0967e00640 1 -- 172.21.15.59:0/2696319010 learned_addr learned my addr 172.21.15.59:0/2696319010 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:26.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0975a00640 1 --2- 172.21.15.59:0/2696319010 >> v2:172.21.15.107:3300/0 conn(0x7f09700b4df0 0x7f09700cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731369205 0 0) 0x7f09700b3c20 con 0x7f0970160610 2024-05-30T16:54:26.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0975000640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0970146000 0x7f09701600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0954003530 con 0x7f0970160610 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3631576107 0 0) 0x7f0954003530 con 0x7f0970160610 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0970146000 msgr2=0x7f09701600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0970146000 0x7f09701600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 >> v2:172.21.15.107:3300/0 conn(0x7f09700b4df0 msgr2=0x7f09700cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 --2- 172.21.15.59:0/2696319010 >> v2:172.21.15.107:3300/0 conn(0x7f09700b4df0 0x7f09700cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0970160f20 con 0x7f0970160610 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f0958001680 con 0x7f0970160610 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 >> v1:172.21.15.59:6789/0 conn(0x7f0970160610 legacy=0x7f09700b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09540039c0 0x7f0954003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0954004810 0x7f0954004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0970146000 0x7f09540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0970160c40 con 0x7f0954004810 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f095400b9d0 con 0x7f09540039c0 2024-05-30T16:54:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f095400bb50 con 0x7f0970146000 2024-05-30T16:54:26.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0967e00640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0954004810 0x7f0954004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0975000640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09540039c0 0x7f0954003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0975a00640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0970146000 0x7f09540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0967e00640 1 -- 172.21.15.59:0/2696319010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0970146000 msgr2=0x7f09540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:26.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0967e00640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0970146000 0x7f09540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0967e00640 1 -- 172.21.15.59:0/2696319010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09540039c0 msgr2=0x7f0954003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:26.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0967e00640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09540039c0 0x7f0954003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0967e00640 1 -- 172.21.15.59:0/2696319010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0954003530 con 0x7f0954004810 2024-05-30T16:54:26.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.099+0000 7f0975000640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09540039c0 0x7f0954003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:54:26.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.103+0000 7f0967e00640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0954004810 0x7f0954004c90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0958001060 tx=0x7f095801f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f39637724922f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:26.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.103+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958007d80 con 0x7f0954004810 2024-05-30T16:54:26.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.103+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0958005b00 con 0x7f0954004810 2024-05-30T16:54:26.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.103+0000 7f096fe00640 1 -- 172.21.15.59:0/2696319010 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958007070 con 0x7f0954004810 2024-05-30T16:54:26.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.103+0000 7f0977a00640 1 -- 172.21.15.59:0/2696319010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0954004810 msgr2=0x7f0954004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.103+0000 7f0977a00640 1 --2- 172.21.15.59:0/2696319010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0954004810 0x7f0954004c90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0958001060 tx=0x7f095801f410 comp rx=0 tx=0).stop 2024-05-30T16:54:26.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.103+0000 7f0975a00640 1 -- 172.21.15.59:0/2696319010 reap_dead start 2024-05-30T16:54:26.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.103+0000 7f0977a00640 1 -- 172.21.15.59:0/2696319010 shutdown_connections 2024-05-30T16:54:26.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.103+0000 7f0977a00640 1 -- 172.21.15.59:0/2696319010 >> 172.21.15.59:0/2696319010 conn(0x7f0970067d60 msgr2=0x7f097006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:26.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.103+0000 7f0977a00640 1 -- 172.21.15.59:0/2696319010 shutdown_connections 2024-05-30T16:54:26.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.103+0000 7f0977a00640 1 -- 172.21.15.59:0/2696319010 wait complete. 2024-05-30T16:54:26.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0977a00640 1 Processor -- start 2024-05-30T16:54:26.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0977a00640 1 -- start start 2024-05-30T16:54:26.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0977a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0954004810 0x7f097015be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0977a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f097013d110 0x7f097013d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0977a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f097006f430 0x7f097006f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0977a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09701600d0 con 0x7f0954004810 2024-05-30T16:54:26.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0977a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f09700b41c0 con 0x7f097006f430 2024-05-30T16:54:26.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0977a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0970160250 con 0x7f097013d110 2024-05-30T16:54:26.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0975000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0954004810 0x7f097015be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0975000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0954004810 0x7f097015be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47772/0 (socket says 172.21.15.59:47772) 2024-05-30T16:54:26.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0975000640 1 -- 172.21.15.59:0/433701223 learned_addr learned my addr 172.21.15.59:0/433701223 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:26.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0975a00640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f097006f430 0x7f097006f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0967e00640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f097013d110 0x7f097013d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0975000640 1 -- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f097013d110 msgr2=0x7f097013d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0975000640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f097013d110 0x7f097013d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0975000640 1 -- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f097006f430 msgr2=0x7f097006f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0975000640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f097006f430 0x7f097006f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0975000640 1 -- 172.21.15.59:0/433701223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097006e3d0 con 0x7f0954004810 2024-05-30T16:54:26.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0975a00640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f097006f430 0x7f097006f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:26.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0975000640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0954004810 0x7f097015be90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0960011b20 tx=0x7f096000f240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:26.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f096d600640 1 -- 172.21.15.59:0/433701223 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096000fc20 con 0x7f0954004810 2024-05-30T16:54:26.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f096d600640 1 -- 172.21.15.59:0/433701223 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f096000fdc0 con 0x7f0954004810 2024-05-30T16:54:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f096d600640 1 -- 172.21.15.59:0/433701223 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960004240 con 0x7f0954004810 2024-05-30T16:54:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0977a00640 1 -- 172.21.15.59:0/433701223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f097015c3d0 con 0x7f0954004810 2024-05-30T16:54:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0977a00640 1 -- 172.21.15.59:0/433701223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f097006e950 con 0x7f0954004810 2024-05-30T16:54:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.107+0000 7f0977a00640 1 -- 172.21.15.59:0/433701223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0970068a90 con 0x7f0954004810 2024-05-30T16:54:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.111+0000 7f096d600640 1 -- 172.21.15.59:0/433701223 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7f0960012040 con 0x7f0954004810 2024-05-30T16:54:26.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.111+0000 7f096d600640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f094c068a70 0x7f094c06af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.111+0000 7f096d600640 1 -- 172.21.15.59:0/433701223 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f0960087a80 con 0x7f0954004810 2024-05-30T16:54:26.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.111+0000 7f0967e00640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f094c068a70 0x7f094c06af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.111+0000 7f0967e00640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f094c068a70 0x7f094c06af30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f09580ae000 tx=0x7f0958001a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:26.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.115+0000 7f096d600640 1 -- 172.21.15.59:0/433701223 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0960019030 con 0x7f0954004810 2024-05-30T16:54:26.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 -- 172.21.15.59:0/433701223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f09700b3490 con 0x7f0954004810 2024-05-30T16:54:26.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f096d600640 1 -- 172.21.15.59:0/433701223 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1823 (secure 0 0 0) 0x7f0960057580 con 0x7f0954004810 2024-05-30T16:54:26.346 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:26.346 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:54:26.346 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:54:26.346 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:54:26.346 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:54:26.346 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:54:26.346 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:54:26.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:26.346 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 346, 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:54:26.347 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 49, 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:26.348 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4056, 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 16879772466, 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 34138947584, 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 738955165696, 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 255, 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:26.349 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:54:26.350 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 26, 2024-05-30T16:54:26.350 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 3, 2024-05-30T16:54:26.350 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:54:26.350 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:54:26.350 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:54:26.350 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:54:26.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:26.350 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 3, 2024-05-30T16:54:26.350 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:54:26.350 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:54:26.350 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:54:26.350 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5304 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:54:26.351 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 8, 2024-05-30T16:54:26.352 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:53:19.132075+0000", 2024-05-30T16:54:26.352 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:54:26.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:26.352 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": {} 2024-05-30T16:54:26.352 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:54:26.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 -- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f094c068a70 msgr2=0x7f094c06af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f094c068a70 0x7f094c06af30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f09580ae000 tx=0x7f0958001a50 comp rx=0 tx=0).stop 2024-05-30T16:54:26.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 -- 172.21.15.59:0/433701223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0954004810 msgr2=0x7f097015be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0954004810 0x7f097015be90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0960011b20 tx=0x7f096000f240 comp rx=0 tx=0).stop 2024-05-30T16:54:26.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 -- 172.21.15.59:0/433701223 shutdown_connections 2024-05-30T16:54:26.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f094c068a70 0x7f094c06af30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f097006f430 0x7f097006f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f097013d110 0x7f097013d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 --2- 172.21.15.59:0/433701223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0954004810 0x7f097015be90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 -- 172.21.15.59:0/433701223 >> 172.21.15.59:0/433701223 conn(0x7f0970067d60 msgr2=0x7f09700af830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:26.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 -- 172.21.15.59:0/433701223 shutdown_connections 2024-05-30T16:54:26.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.343+0000 7f0977a00640 1 -- 172.21.15.59:0/433701223 wait complete. 2024-05-30T16:54:26.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T16:54:26.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.507+0000 7fa580200640 1 Processor -- start 2024-05-30T16:54:26.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.507+0000 7fa580200640 1 -- start start 2024-05-30T16:54:26.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.507+0000 7fa580200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b44e0 0x7fa57815efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.507+0000 7fa580200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5780b52d0 con 0x7fa578159100 2024-05-30T16:54:26.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.507+0000 7fa580200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5780b4a30 con 0x7fa57815f510 2024-05-30T16:54:26.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.507+0000 7fa580200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa5780b4d10 con 0x7fa5780b44e0 2024-05-30T16:54:26.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.507+0000 7fa57d800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa578159100 0x7fa57806e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47704/0 (socket says 172.21.15.59:47704) 2024-05-30T16:54:26.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.507+0000 7fa57d800640 1 -- 172.21.15.59:0/2751575611 learned_addr learned my addr 172.21.15.59:0/2751575611 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:26.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.507+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255457548 0 0) 0x7fa5780b52d0 con 0x7fa578159100 2024-05-30T16:54:26.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.507+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa560005740 con 0x7fa578159100 2024-05-30T16:54:26.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.507+0000 7fa57ce00640 1 --2- 172.21.15.59:0/2751575611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b44e0 0x7fa57815efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2009479341 0 0) 0x7fa560005740 con 0x7fa578159100 2024-05-30T16:54:26.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b44e0 msgr2=0x7fa57815efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:26.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 --2- 172.21.15.59:0/2751575611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b44e0 0x7fa57815efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 >> v1:172.21.15.107:6789/0 conn(0x7fa57815f510 legacy=0x7fa57815c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5780b4ff0 con 0x7fa578159100 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fa56c001680 con 0x7fa578159100 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 >> v1:172.21.15.59:6789/0 conn(0x7fa578159100 legacy=0x7fa57806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 --2- 172.21.15.59:0/2751575611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa560005c00 0x7fa560006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 --2- 172.21.15.59:0/2751575611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b44e0 0x7fa560006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 --2- 172.21.15.59:0/2751575611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa560006f60 0x7fa5600073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa5780b4d10 con 0x7fa560006f60 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa56000dda0 con 0x7fa560005c00 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa56000dfa0 con 0x7fa5780b44e0 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa57d800640 1 --2- 172.21.15.59:0/2751575611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa560005c00 0x7fa560006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa57ce00640 1 --2- 172.21.15.59:0/2751575611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b44e0 0x7fa560006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa57e200640 1 --2- 172.21.15.59:0/2751575611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa560006f60 0x7fa5600073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa57ce00640 1 -- 172.21.15.59:0/2751575611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa560005c00 msgr2=0x7fa560006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa57ce00640 1 --2- 172.21.15.59:0/2751575611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa560005c00 0x7fa560006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa57ce00640 1 -- 172.21.15.59:0/2751575611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa560006f60 msgr2=0x7fa5600073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa57ce00640 1 --2- 172.21.15.59:0/2751575611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa560006f60 0x7fa5600073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.511+0000 7fa57ce00640 1 -- 172.21.15.59:0/2751575611 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa560005740 con 0x7fa5780b44e0 2024-05-30T16:54:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa57ce00640 1 --2- 172.21.15.59:0/2751575611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b44e0 0x7fa560006a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa564009ae0 tx=0x7fa56401ca80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52dab52a5dee795f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:26.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5640b2070 con 0x7fa5780b44e0 2024-05-30T16:54:26.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5640a5560 con 0x7fa5780b44e0 2024-05-30T16:54:26.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa577e00640 1 -- 172.21.15.59:0/2751575611 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5640096b0 con 0x7fa5780b44e0 2024-05-30T16:54:26.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 -- 172.21.15.59:0/2751575611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b44e0 msgr2=0x7fa560006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 --2- 172.21.15.59:0/2751575611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b44e0 0x7fa560006a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa564009ae0 tx=0x7fa56401ca80 comp rx=0 tx=0).stop 2024-05-30T16:54:26.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa57e200640 1 -- 172.21.15.59:0/2751575611 reap_dead start 2024-05-30T16:54:26.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 -- 172.21.15.59:0/2751575611 shutdown_connections 2024-05-30T16:54:26.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 -- 172.21.15.59:0/2751575611 >> 172.21.15.59:0/2751575611 conn(0x7fa57806bdb0 msgr2=0x7fa57806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:26.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 -- 172.21.15.59:0/2751575611 shutdown_connections 2024-05-30T16:54:26.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 -- 172.21.15.59:0/2751575611 wait complete. 2024-05-30T16:54:26.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 Processor -- start 2024-05-30T16:54:26.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 -- start start 2024-05-30T16:54:26.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5780b44e0 0x7fa5780cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b24d0 0x7fa57814a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5780b2950 0x7fa57814a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa5780b3740 con 0x7fa5780b2950 2024-05-30T16:54:26.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa5780b35c0 con 0x7fa5780b44e0 2024-05-30T16:54:26.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.515+0000 7fa580200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa5780b38c0 con 0x7fa5780b24d0 2024-05-30T16:54:26.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5780b2950 0x7fa57814a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5780b2950 0x7fa57814a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47788/0 (socket says 172.21.15.59:47788) 2024-05-30T16:54:26.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57e200640 1 -- 172.21.15.59:0/1727464116 learned_addr learned my addr 172.21.15.59:0/1727464116 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:26.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57ce00640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b24d0 0x7fa57814a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57d800640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5780b44e0 0x7fa5780cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57e200640 1 -- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b24d0 msgr2=0x7fa57814a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57e200640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b24d0 0x7fa57814a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57e200640 1 -- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5780b44e0 msgr2=0x7fa5780cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57e200640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5780b44e0 0x7fa5780cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57e200640 1 -- 172.21.15.59:0/1727464116 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5780ccb80 con 0x7fa5780b2950 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57ce00640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b24d0 0x7fa57814a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57d800640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5780b44e0 0x7fa5780cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa57e200640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5780b2950 0x7fa57814a7b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa57815f8f0 tx=0x7fa57000fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa575600640 1 -- 172.21.15.59:0/1727464116 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57001a070 con 0x7fa5780b2950 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa575600640 1 -- 172.21.15.59:0/1727464116 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa570006d70 con 0x7fa5780b2950 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa575600640 1 -- 172.21.15.59:0/1727464116 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570003ba0 con 0x7fa5780b2950 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa580200640 1 -- 172.21.15.59:0/1727464116 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5780cce20 con 0x7fa5780b2950 2024-05-30T16:54:26.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa580200640 1 -- 172.21.15.59:0/1727464116 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5780cd3e0 con 0x7fa5780b2950 2024-05-30T16:54:26.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa580200640 1 -- 172.21.15.59:0/1727464116 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa578068a90 con 0x7fa5780b2950 2024-05-30T16:54:26.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.519+0000 7fa575600640 1 -- 172.21.15.59:0/1727464116 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7fa570005110 con 0x7fa5780b2950 2024-05-30T16:54:26.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.523+0000 7fa575600640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa558068a40 0x7fa55806af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.523+0000 7fa575600640 1 -- 172.21.15.59:0/1727464116 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7fa570086d60 con 0x7fa5780b2950 2024-05-30T16:54:26.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.523+0000 7fa57d800640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa558068a40 0x7fa55806af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.523+0000 7fa57d800640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa558068a40 0x7fa55806af00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa5780b1cc0 tx=0x7fa56c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:26.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.527+0000 7fa575600640 1 -- 172.21.15.59:0/1727464116 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa570056930 con 0x7fa5780b2950 2024-05-30T16:54:26.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.715+0000 7fa580200640 1 -- 172.21.15.59:0/1727464116 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa57815a2b0 con 0x7fa558068a40 2024-05-30T16:54:26.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.723+0000 7fa575600640 1 -- 172.21.15.59:0/1727464116 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+234 (secure 0 0 0) 0x7fa57815a2b0 con 0x7fa558068a40 2024-05-30T16:54:26.727 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:26.727 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:54:26.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:26.727 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69361" 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sv1" 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69362" 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69364" 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69363" 2024-05-30T16:54:26.728 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:26.729 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:54:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.727+0000 7fa580200640 1 -- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa558068a40 msgr2=0x7fa55806af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.727+0000 7fa580200640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa558068a40 0x7fa55806af00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa5780b1cc0 tx=0x7fa56c009040 comp rx=0 tx=0).stop 2024-05-30T16:54:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.727+0000 7fa580200640 1 -- 172.21.15.59:0/1727464116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5780b2950 msgr2=0x7fa57814a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.727+0000 7fa580200640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5780b2950 0x7fa57814a7b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa57815f8f0 tx=0x7fa57000fcd0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.727+0000 7fa580200640 1 -- 172.21.15.59:0/1727464116 shutdown_connections 2024-05-30T16:54:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.727+0000 7fa580200640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa558068a40 0x7fa55806af00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.727+0000 7fa580200640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5780b2950 0x7fa57814a7b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.727+0000 7fa580200640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5780b24d0 0x7fa57814a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.727+0000 7fa580200640 1 --2- 172.21.15.59:0/1727464116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5780b44e0 0x7fa5780cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.727+0000 7fa580200640 1 -- 172.21.15.59:0/1727464116 >> 172.21.15.59:0/1727464116 conn(0x7fa57806bdb0 msgr2=0x7fa57815f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.727+0000 7fa580200640 1 -- 172.21.15.59:0/1727464116 shutdown_connections 2024-05-30T16:54:26.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.727+0000 7fa580200640 1 -- 172.21.15.59:0/1727464116 wait complete. 2024-05-30T16:54:26.749 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69361 2024-05-30T16:54:26.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f617d800640 1 Processor -- start 2024-05-30T16:54:26.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f617d800640 1 -- start start 2024-05-30T16:54:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f617d800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f617815fe50 0x7f61780ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f617d800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f61780b13b0 0x7f617809b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f617d800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61780d0520 con 0x7f617809aa40 2024-05-30T16:54:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f617d800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f61780cd020 con 0x7f617815fe50 2024-05-30T16:54:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f617d800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f617809be80 con 0x7f61780b13b0 2024-05-30T16:54:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f6176a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f617815fe50 0x7f61780ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f6176a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f617815fe50 0x7f61780ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47798/0 (socket says 172.21.15.59:47798) 2024-05-30T16:54:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f6176a00640 1 -- 172.21.15.59:0/1067929042 learned_addr learned my addr 172.21.15.59:0/1067929042 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f616fe00640 1 --2- 172.21.15.59:0/1067929042 >> v2:172.21.15.107:3300/0 conn(0x7f61780b13b0 0x7f617809b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f6176a00640 1 -- 172.21.15.59:0/1067929042 >> v2:172.21.15.107:3300/0 conn(0x7f61780b13b0 msgr2=0x7f617809b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f6176a00640 1 --2- 172.21.15.59:0/1067929042 >> v2:172.21.15.107:3300/0 conn(0x7f61780b13b0 0x7f617809b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f6176a00640 1 -- 172.21.15.59:0/1067929042 >> v1:172.21.15.107:6789/0 conn(0x7f617809aa40 legacy=0x7f61780af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.891+0000 7f6176a00640 1 -- 172.21.15.59:0/1067929042 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61780cd250 con 0x7f617815fe50 2024-05-30T16:54:26.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.895+0000 7f6176a00640 1 --2- 172.21.15.59:0/1067929042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617815fe50 0x7f61780ce010 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f61780d1db0 tx=0x7f61780b0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b67ef261b7d1f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:26.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.895+0000 7f6176000640 1 -- 172.21.15.59:0/1067929042 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61680a9400 con 0x7f617815fe50 2024-05-30T16:54:26.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.895+0000 7f6176000640 1 -- 172.21.15.59:0/1067929042 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61680a95a0 con 0x7f617815fe50 2024-05-30T16:54:26.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.895+0000 7f6176000640 1 -- 172.21.15.59:0/1067929042 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61680a9970 con 0x7f617815fe50 2024-05-30T16:54:26.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.895+0000 7f617d800640 1 -- 172.21.15.59:0/1067929042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617815fe50 msgr2=0x7f61780ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.895+0000 7f617d800640 1 --2- 172.21.15.59:0/1067929042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617815fe50 0x7f61780ce010 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f61780d1db0 tx=0x7f61780b0000 comp rx=0 tx=0).stop 2024-05-30T16:54:26.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.895+0000 7f617d800640 1 -- 172.21.15.59:0/1067929042 shutdown_connections 2024-05-30T16:54:26.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.895+0000 7f617d800640 1 --2- 172.21.15.59:0/1067929042 >> v2:172.21.15.107:3300/0 conn(0x7f61780b13b0 0x7f617809b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.895+0000 7f617d800640 1 --2- 172.21.15.59:0/1067929042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617815fe50 0x7f61780ce010 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.895+0000 7f617d800640 1 -- 172.21.15.59:0/1067929042 >> 172.21.15.59:0/1067929042 conn(0x7f61780b3f00 msgr2=0x7f61780b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:26.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.895+0000 7f617d800640 1 -- 172.21.15.59:0/1067929042 shutdown_connections 2024-05-30T16:54:26.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.895+0000 7f617d800640 1 -- 172.21.15.59:0/1067929042 wait complete. 2024-05-30T16:54:26.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f617d800640 1 Processor -- start 2024-05-30T16:54:26.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f617d800640 1 -- start start 2024-05-30T16:54:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f617d800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f617809aa40 0x7f61780c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f617d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61780b13b0 0x7f61780b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f617d800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f617815fe50 0x7f6178154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f617d800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6178169710 con 0x7f61780b13b0 2024-05-30T16:54:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f617d800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f61780cdb80 con 0x7f617809aa40 2024-05-30T16:54:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f617d800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6178169890 con 0x7f617815fe50 2024-05-30T16:54:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f616fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61780b13b0 0x7f61780b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f616fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61780b13b0 0x7f61780b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47814/0 (socket says 172.21.15.59:47814) 2024-05-30T16:54:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f616fe00640 1 -- 172.21.15.59:0/3377145503 learned_addr learned my addr 172.21.15.59:0/3377145503 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f6176a00640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f617809aa40 0x7f61780c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f6177400640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f617815fe50 0x7f6178154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f616fe00640 1 -- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f617815fe50 msgr2=0x7f6178154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f616fe00640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f617815fe50 0x7f6178154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f616fe00640 1 -- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f617809aa40 msgr2=0x7f61780c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f616fe00640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f617809aa40 0x7f61780c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f616fe00640 1 -- 172.21.15.59:0/3377145503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61780b6ad0 con 0x7f61780b13b0 2024-05-30T16:54:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f616fe00640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61780b13b0 0x7f61780b59d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f616000e9e0 tx=0x7f616000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f616ea00640 1 -- 172.21.15.59:0/3377145503 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160017070 con 0x7f61780b13b0 2024-05-30T16:54:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f616ea00640 1 -- 172.21.15.59:0/3377145503 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616000c9d0 con 0x7f61780b13b0 2024-05-30T16:54:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f616ea00640 1 -- 172.21.15.59:0/3377145503 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616000cda0 con 0x7f61780b13b0 2024-05-30T16:54:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f617d800640 1 -- 172.21.15.59:0/3377145503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f617806e5d0 con 0x7f61780b13b0 2024-05-30T16:54:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.899+0000 7f617d800640 1 -- 172.21.15.59:0/3377145503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61780b51d0 con 0x7f61780b13b0 2024-05-30T16:54:26.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.903+0000 7f617d800640 1 -- 172.21.15.59:0/3377145503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f617806eaf0 con 0x7f61780b13b0 2024-05-30T16:54:26.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.903+0000 7f616ea00640 1 -- 172.21.15.59:0/3377145503 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7f616001a070 con 0x7f61780b13b0 2024-05-30T16:54:26.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.903+0000 7f616ea00640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6154068a40 0x7f615406af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:26.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.903+0000 7f616ea00640 1 -- 172.21.15.59:0/3377145503 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f61600876e0 con 0x7f61780b13b0 2024-05-30T16:54:26.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.903+0000 7f6176a00640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6154068a40 0x7f615406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:26.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.903+0000 7f6176a00640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6154068a40 0x7f615406af00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f61680ae000 tx=0x7f61680b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:26.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:26.907+0000 7f616ea00640 1 -- 172.21.15.59:0/3377145503 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f617806eaf0 con 0x7f61780b13b0 2024-05-30T16:54:27.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.095+0000 7f617d800640 1 -- 172.21.15.59:0/3377145503 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69361", "target": ["mon-mgr", ""]}) -- 0x7f6178068a90 con 0x7f6154068a40 2024-05-30T16:54:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f616ea00640 1 -- 172.21.15.59:0/3377145503 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6178068a90 con 0x7f6154068a40 2024-05-30T16:54:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f617d800640 1 -- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6154068a40 msgr2=0x7f615406af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f617d800640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6154068a40 0x7f615406af00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f61680ae000 tx=0x7f61680b3040 comp rx=0 tx=0).stop 2024-05-30T16:54:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f617d800640 1 -- 172.21.15.59:0/3377145503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61780b13b0 msgr2=0x7f61780b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f617d800640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61780b13b0 0x7f61780b59d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f616000e9e0 tx=0x7f616000eea0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f617d800640 1 -- 172.21.15.59:0/3377145503 shutdown_connections 2024-05-30T16:54:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f617d800640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6154068a40 0x7f615406af00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f617d800640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f617815fe50 0x7f6178154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f617d800640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61780b13b0 0x7f61780b59d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f617d800640 1 --2- 172.21.15.59:0/3377145503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f617809aa40 0x7f61780c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f617d800640 1 -- 172.21.15.59:0/3377145503 >> 172.21.15.59:0/3377145503 conn(0x7f61780b3f00 msgr2=0x7f61781550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:27.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f617d800640 1 -- 172.21.15.59:0/3377145503 shutdown_connections 2024-05-30T16:54:27.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.115+0000 7f617d800640 1 -- 172.21.15.59:0/3377145503 wait complete. 2024-05-30T16:54:27.122 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:54:27.117+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:54:27.123 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:54:27.117+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:54:27.123 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:54:27.117+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:54:27.123 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:54:27.117+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:54:27.123 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:54:27.117+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:54:27.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T16:54:27.142 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:54:27.137+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:54:27.142 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:54:27.137+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:54:27.143 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:54:27.137+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:54:27.143 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:54:27.137+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:54:27.143 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:54:27.137+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:54:27.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72ca000640 1 Processor -- start 2024-05-30T16:54:27.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72ca000640 1 -- start start 2024-05-30T16:54:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72ca000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c415ed00 0x7f72c409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72ca000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f72c40b32e0 0x7f72c409af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72ca000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c40d0ed0 con 0x7f72c40b4aa0 2024-05-30T16:54:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72ca000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f72c415f0e0 con 0x7f72c40b32e0 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72ca000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f72c40b3830 con 0x7f72c415ed00 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72baa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f72c40b4aa0 0x7f72c4162780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47720/0 (socket says 172.21.15.59:47720) 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72baa00640 1 -- 172.21.15.59:0/3844053665 learned_addr learned my addr 172.21.15.59:0/3844053665 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c3400640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c415ed00 0x7f72c409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c3e00640 1 --2- 172.21.15.59:0/3844053665 >> v2:172.21.15.107:3300/0 conn(0x7f72c40b32e0 0x7f72c409af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2025487927 0 0) 0x7f72c40d0ed0 con 0x7f72c40b4aa0 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72a8003530 con 0x7f72c40b4aa0 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1841773338 0 0) 0x7f72a8003530 con 0x7f72c40b4aa0 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c415ed00 msgr2=0x7f72c409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c2a00640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c415ed00 0x7f72c409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 >> v2:172.21.15.107:3300/0 conn(0x7f72c40b32e0 msgr2=0x7f72c409af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c2a00640 1 --2- 172.21.15.59:0/3844053665 >> v2:172.21.15.107:3300/0 conn(0x7f72c40b32e0 0x7f72c409af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c40d1690 con 0x7f72c40b4aa0 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f72ac001680 con 0x7f72c40b4aa0 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c3e00640 1 --2- 172.21.15.59:0/3844053665 >> v2:172.21.15.107:3300/0 conn(0x7f72c40b32e0 0x7f72c409af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.287+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 >> v1:172.21.15.59:6789/0 conn(0x7f72c40b4aa0 legacy=0x7f72c4162780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72c2a00640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72a80039c0 0x7f72a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72c2a00640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a8004810 0x7f72a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72c2a00640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c415ed00 0x7f72a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f72c415f0e0 con 0x7f72a8004810 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f72c40b3830 con 0x7f72a80039c0 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f72a800bab0 con 0x7f72c415ed00 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72baa00640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a8004810 0x7f72a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72c3400640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72a80039c0 0x7f72a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72c3e00640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c415ed00 0x7f72a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72baa00640 1 -- 172.21.15.59:0/3844053665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c415ed00 msgr2=0x7f72a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:27.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72baa00640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c415ed00 0x7f72a80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72baa00640 1 -- 172.21.15.59:0/3844053665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72a80039c0 msgr2=0x7f72a8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:27.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72baa00640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72a80039c0 0x7f72a8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72baa00640 1 -- 172.21.15.59:0/3844053665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a8003530 con 0x7f72a8004810 2024-05-30T16:54:27.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72c3400640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72a80039c0 0x7f72a8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:54:27.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72baa00640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a8004810 0x7f72a8004c90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f72ac001ec0 tx=0x7f72ac01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93771bd893b2462 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:27.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac007d40 con 0x7f72a8004810 2024-05-30T16:54:27.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac0a9070 con 0x7f72a8004810 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.291+0000 7f72c2a00640 1 -- 172.21.15.59:0/3844053665 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac005d40 con 0x7f72a8004810 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 -- 172.21.15.59:0/3844053665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a8004810 msgr2=0x7f72a8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 --2- 172.21.15.59:0/3844053665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a8004810 0x7f72a8004c90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f72ac001ec0 tx=0x7f72ac01cc40 comp rx=0 tx=0).stop 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72c3e00640 1 -- 172.21.15.59:0/3844053665 reap_dead start 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 -- 172.21.15.59:0/3844053665 shutdown_connections 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 -- 172.21.15.59:0/3844053665 >> 172.21.15.59:0/3844053665 conn(0x7f72c40b3f80 msgr2=0x7f72c40b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 -- 172.21.15.59:0/3844053665 shutdown_connections 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 -- 172.21.15.59:0/3844053665 wait complete. 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 Processor -- start 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 -- start start 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72a8004810 0x7f72c4165a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c4167680 0x7f72c415a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c40b6cb0 0x7f72c40b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f72c40b2de0 con 0x7f72c4167680 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f72c40b2c60 con 0x7f72a8004810 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72ca000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f72c4169ab0 con 0x7f72c40b6cb0 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72baa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c4167680 0x7f72c415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72baa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c4167680 0x7f72c415a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47828/0 (socket says 172.21.15.59:47828) 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72baa00640 1 -- 172.21.15.59:0/2518928232 learned_addr learned my addr 172.21.15.59:0/2518928232 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72c3400640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72a8004810 0x7f72c4165a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72c3e00640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c40b6cb0 0x7f72c40b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72baa00640 1 -- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c40b6cb0 msgr2=0x7f72c40b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72baa00640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c40b6cb0 0x7f72c40b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72baa00640 1 -- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72a8004810 msgr2=0x7f72c4165a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72baa00640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72a8004810 0x7f72c4165a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.295+0000 7f72baa00640 1 -- 172.21.15.59:0/2518928232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c4167ae0 con 0x7f72c4167680 2024-05-30T16:54:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.299+0000 7f72baa00640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c4167680 0x7f72c415a670 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f72ac01c6b0 tx=0x7f72a8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.299+0000 7f72bbe00640 1 -- 172.21.15.59:0/2518928232 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac005d20 con 0x7f72c4167680 2024-05-30T16:54:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.299+0000 7f72bbe00640 1 -- 172.21.15.59:0/2518928232 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac001440 con 0x7f72c4167680 2024-05-30T16:54:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.299+0000 7f72bbe00640 1 -- 172.21.15.59:0/2518928232 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac001810 con 0x7f72c4167680 2024-05-30T16:54:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.299+0000 7f72ca000640 1 -- 172.21.15.59:0/2518928232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c4166190 con 0x7f72c4167680 2024-05-30T16:54:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.299+0000 7f72ca000640 1 -- 172.21.15.59:0/2518928232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c4166750 con 0x7f72c4167680 2024-05-30T16:54:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.299+0000 7f72ca000640 1 -- 172.21.15.59:0/2518928232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c4068a90 con 0x7f72c4167680 2024-05-30T16:54:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.299+0000 7f72bbe00640 1 -- 172.21.15.59:0/2518928232 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7f72ac0a5830 con 0x7f72c4167680 2024-05-30T16:54:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.299+0000 7f72bbe00640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f72a0068a70 0x7f72a006af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.299+0000 7f72bbe00640 1 -- 172.21.15.59:0/2518928232 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f72ac1209b0 con 0x7f72c4167680 2024-05-30T16:54:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.299+0000 7f72c3400640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f72a0068a70 0x7f72a006af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.303+0000 7f72c3400640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f72a0068a70 0x7f72a006af30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009c20 tx=0x7f72b4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.303+0000 7f72bbe00640 1 -- 172.21.15.59:0/2518928232 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f72ac0bf060 con 0x7f72c4167680 2024-05-30T16:54:27.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.499+0000 7f72ca000640 1 -- 172.21.15.59:0/2518928232 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f72c40c7370 con 0x7f72a0068a70 2024-05-30T16:54:27.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.511+0000 7f72bbe00640 1 -- 172.21.15.59:0/2518928232 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f72c40c7370 con 0x7f72a0068a70 2024-05-30T16:54:27.515 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:27.515 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:54:27.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:27.515 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ss1" 2024-05-30T16:54:27.515 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:27.515 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:54:27.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.515+0000 7f72ca000640 1 -- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f72a0068a70 msgr2=0x7f72a006af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.515+0000 7f72ca000640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f72a0068a70 0x7f72a006af30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009c20 tx=0x7f72b4009190 comp rx=0 tx=0).stop 2024-05-30T16:54:27.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.515+0000 7f72ca000640 1 -- 172.21.15.59:0/2518928232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c4167680 msgr2=0x7f72c415a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.515+0000 7f72ca000640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c4167680 0x7f72c415a670 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f72ac01c6b0 tx=0x7f72a8005840 comp rx=0 tx=0).stop 2024-05-30T16:54:27.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.515+0000 7f72ca000640 1 -- 172.21.15.59:0/2518928232 shutdown_connections 2024-05-30T16:54:27.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.515+0000 7f72ca000640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f72a0068a70 0x7f72a006af30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.515+0000 7f72ca000640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72c40b6cb0 0x7f72c40b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.515+0000 7f72ca000640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c4167680 0x7f72c415a670 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.515+0000 7f72ca000640 1 --2- 172.21.15.59:0/2518928232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72a8004810 0x7f72c4165a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.515+0000 7f72ca000640 1 -- 172.21.15.59:0/2518928232 >> 172.21.15.59:0/2518928232 conn(0x7f72c40b3f80 msgr2=0x7f72c40b5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:27.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.515+0000 7f72ca000640 1 -- 172.21.15.59:0/2518928232 shutdown_connections 2024-05-30T16:54:27.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.515+0000 7f72ca000640 1 -- 172.21.15.59:0/2518928232 wait complete. 2024-05-30T16:54:27.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T16:54:27.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.679+0000 7f3b96400640 1 Processor -- start 2024-05-30T16:54:27.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.679+0000 7f3b96400640 1 -- start start 2024-05-30T16:54:27.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.679+0000 7f3b96400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b90161fd0 0x7f3b900d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.679+0000 7f3b96400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b900d1150 con 0x7f3b900cb9b0 2024-05-30T16:54:27.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.679+0000 7f3b96400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b900d0b90 con 0x7f3b9006c0c0 2024-05-30T16:54:27.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.679+0000 7f3b96400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3b900d0e70 con 0x7f3b90161fd0 2024-05-30T16:54:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8ea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3b900cb9b0 0x7f3b9006b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47736/0 (socket says 172.21.15.59:47736) 2024-05-30T16:54:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8ea00640 1 -- 172.21.15.59:0/1333279789 learned_addr learned my addr 172.21.15.59:0/1333279789 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:27.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8f400640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b90161fd0 0x7f3b900d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578606737 0 0) 0x7f3b900d1150 con 0x7f3b900cb9b0 2024-05-30T16:54:27.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b74003530 con 0x7f3b900cb9b0 2024-05-30T16:54:27.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 373756872 0 0) 0x7f3b74003530 con 0x7f3b900cb9b0 2024-05-30T16:54:27.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b90161fd0 msgr2=0x7f3b900d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:27.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b90161fd0 0x7f3b900d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 >> v1:172.21.15.107:6789/0 conn(0x7f3b9006c0c0 legacy=0x7f3b900cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b900cd620 con 0x7f3b900cb9b0 2024-05-30T16:54:27.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f3b7c001680 con 0x7f3b900cb9b0 2024-05-30T16:54:27.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 >> v1:172.21.15.59:6789/0 conn(0x7f3b900cb9b0 legacy=0x7f3b9006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b90161fd0 0x7f3b740039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b74003f70 0x7f3b74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74004d50 0x7f3b740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3b900d0e70 con 0x7f3b74004d50 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7400bb60 con 0x7f3b74003f70 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7400bd60 con 0x7f3b90161fd0 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8f400640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b90161fd0 0x7f3b740039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8ea00640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b74003f70 0x7f3b74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8fe00640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74004d50 0x7f3b740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8f400640 1 -- 172.21.15.59:0/1333279789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b74003f70 msgr2=0x7f3b74004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8f400640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b74003f70 0x7f3b74004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8f400640 1 -- 172.21.15.59:0/1333279789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74004d50 msgr2=0x7f3b740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8f400640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74004d50 0x7f3b740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8f400640 1 -- 172.21.15.59:0/1333279789 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b74003530 con 0x7f3b90161fd0 2024-05-30T16:54:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.683+0000 7f3b8fe00640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74004d50 0x7f3b740051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:54:27.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b8f400640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b90161fd0 0x7f3b740039f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009b10 tx=0x7f3b8001cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3d4da0a871dbfe6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:27.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b800b2070 con 0x7f3b90161fd0 2024-05-30T16:54:27.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b800a5590 con 0x7f3b90161fd0 2024-05-30T16:54:27.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b8e000640 1 -- 172.21.15.59:0/1333279789 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b800096b0 con 0x7f3b90161fd0 2024-05-30T16:54:27.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b96400640 1 -- 172.21.15.59:0/1333279789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b90161fd0 msgr2=0x7f3b740039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b96400640 1 --2- 172.21.15.59:0/1333279789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b90161fd0 0x7f3b740039f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009b10 tx=0x7f3b8001cab0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b8fe00640 1 -- 172.21.15.59:0/1333279789 reap_dead start 2024-05-30T16:54:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b96400640 1 -- 172.21.15.59:0/1333279789 shutdown_connections 2024-05-30T16:54:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b96400640 1 -- 172.21.15.59:0/1333279789 >> 172.21.15.59:0/1333279789 conn(0x7f3b900b2f50 msgr2=0x7f3b900b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b96400640 1 -- 172.21.15.59:0/1333279789 shutdown_connections 2024-05-30T16:54:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b96400640 1 -- 172.21.15.59:0/1333279789 wait complete. 2024-05-30T16:54:27.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b96400640 1 Processor -- start 2024-05-30T16:54:27.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.687+0000 7f3b96400640 1 -- start start 2024-05-30T16:54:27.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b96400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b90161fd0 0x7f3b901588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b96400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b900b6420 0x7f3b9015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b96400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b9015c2d0 0x7f3b900c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b96400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3b900b0960 con 0x7f3b9015c2d0 2024-05-30T16:54:27.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b96400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3b900b07e0 con 0x7f3b90161fd0 2024-05-30T16:54:27.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b96400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3b900d05b0 con 0x7f3b900b6420 2024-05-30T16:54:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b8fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b9015c2d0 0x7f3b900c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b8fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b9015c2d0 0x7f3b900c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47840/0 (socket says 172.21.15.59:47840) 2024-05-30T16:54:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b8fe00640 1 -- 172.21.15.59:0/497813283 learned_addr learned my addr 172.21.15.59:0/497813283 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b8ea00640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b900b6420 0x7f3b9015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b8f400640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b90161fd0 0x7f3b901588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b8fe00640 1 -- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b900b6420 msgr2=0x7f3b9015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b8fe00640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b900b6420 0x7f3b9015bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b8fe00640 1 -- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b90161fd0 msgr2=0x7f3b901588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b8fe00640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b90161fd0 0x7f3b901588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b8fe00640 1 -- 172.21.15.59:0/497813283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b900b5380 con 0x7f3b9015c2d0 2024-05-30T16:54:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b8fe00640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b9015c2d0 0x7f3b900c9b40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3b900d0040 tx=0x7f3b8800ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b87400640 1 -- 172.21.15.59:0/497813283 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88001a90 con 0x7f3b9015c2d0 2024-05-30T16:54:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b87400640 1 -- 172.21.15.59:0/497813283 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b88018070 con 0x7f3b9015c2d0 2024-05-30T16:54:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b87400640 1 -- 172.21.15.59:0/497813283 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88003db0 con 0x7f3b9015c2d0 2024-05-30T16:54:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b96400640 1 -- 172.21.15.59:0/497813283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b900b5660 con 0x7f3b9015c2d0 2024-05-30T16:54:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b96400640 1 -- 172.21.15.59:0/497813283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b900b5c20 con 0x7f3b9015c2d0 2024-05-30T16:54:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b96400640 1 -- 172.21.15.59:0/497813283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b90068a90 con 0x7f3b9015c2d0 2024-05-30T16:54:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.691+0000 7f3b87400640 1 -- 172.21.15.59:0/497813283 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7f3b8800d7a0 con 0x7f3b9015c2d0 2024-05-30T16:54:27.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.695+0000 7f3b87400640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3b70068a40 0x7f3b7006af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:27.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.695+0000 7f3b87400640 1 -- 172.21.15.59:0/497813283 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f3b880873f0 con 0x7f3b9015c2d0 2024-05-30T16:54:27.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.695+0000 7f3b8f400640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3b70068a40 0x7f3b7006af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:27.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.695+0000 7f3b8f400640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3b70068a40 0x7f3b7006af00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3b800af000 tx=0x7f3b800046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:27.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.699+0000 7f3b87400640 1 -- 172.21.15.59:0/497813283 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3b88057110 con 0x7f3b9015c2d0 2024-05-30T16:54:27.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.895+0000 7f3b96400640 1 -- 172.21.15.59:0/497813283 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b90158e30 con 0x7f3b70068a40 2024-05-30T16:54:27.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.923+0000 7f3b87400640 1 -- 172.21.15.59:0/497813283 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3b90158e30 con 0x7f3b70068a40 2024-05-30T16:54:27.928 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:27.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.927+0000 7f3b96400640 1 -- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3b70068a40 msgr2=0x7f3b7006af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.927+0000 7f3b96400640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3b70068a40 0x7f3b7006af00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3b800af000 tx=0x7f3b800046d0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.927+0000 7f3b96400640 1 -- 172.21.15.59:0/497813283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b9015c2d0 msgr2=0x7f3b900c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:27.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.927+0000 7f3b96400640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b9015c2d0 0x7f3b900c9b40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3b900d0040 tx=0x7f3b8800ff70 comp rx=0 tx=0).stop 2024-05-30T16:54:27.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.927+0000 7f3b96400640 1 -- 172.21.15.59:0/497813283 shutdown_connections 2024-05-30T16:54:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.927+0000 7f3b96400640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3b70068a40 0x7f3b7006af00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.927+0000 7f3b96400640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b9015c2d0 0x7f3b900c9b40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.927+0000 7f3b96400640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b900b6420 0x7f3b9015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.927+0000 7f3b96400640 1 --2- 172.21.15.59:0/497813283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b90161fd0 0x7f3b901588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.927+0000 7f3b96400640 1 -- 172.21.15.59:0/497813283 >> 172.21.15.59:0/497813283 conn(0x7f3b900b2f50 msgr2=0x7f3b9006fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.927+0000 7f3b96400640 1 -- 172.21.15.59:0/497813283 shutdown_connections 2024-05-30T16:54:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:27.927+0000 7f3b96400640 1 -- 172.21.15.59:0/497813283 wait complete. 2024-05-30T16:54:27.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T16:54:28.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a8600640 1 Processor -- start 2024-05-30T16:54:28.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a8600640 1 -- start start 2024-05-30T16:54:28.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a8600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89a01447c0 0x7f89a00b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a8600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f89a00b4a70 0x7f89a006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a8600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a00b39d0 con 0x7f89a00726e0 2024-05-30T16:54:28.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a8600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f89a00b3cb0 con 0x7f89a00b4a70 2024-05-30T16:54:28.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a8600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f89a00b3f90 con 0x7f89a01447c0 2024-05-30T16:54:28.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a6600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f89a00726e0 0x7f89a015e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47740/0 (socket says 172.21.15.59:47740) 2024-05-30T16:54:28.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a6600640 1 -- 172.21.15.59:0/1075809413 learned_addr learned my addr 172.21.15.59:0/1075809413 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:28.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a5c00640 1 --2- 172.21.15.59:0/1075809413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89a01447c0 0x7f89a00b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a5200640 1 --2- 172.21.15.59:0/1075809413 >> v2:172.21.15.107:3300/0 conn(0x7f89a00b4a70 0x7f89a006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f899fe00640 1 -- 172.21.15.59:0/1075809413 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4221243905 0 0) 0x7f89a00b39d0 con 0x7f89a00726e0 2024-05-30T16:54:28.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f899fe00640 1 -- 172.21.15.59:0/1075809413 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8988003530 con 0x7f89a00726e0 2024-05-30T16:54:28.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a5c00640 1 -- 172.21.15.59:0/1075809413 >> v2:172.21.15.107:3300/0 conn(0x7f89a00b4a70 msgr2=0x7f89a006f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:28.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a5c00640 1 --2- 172.21.15.59:0/1075809413 >> v2:172.21.15.107:3300/0 conn(0x7f89a00b4a70 0x7f89a006f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a5c00640 1 -- 172.21.15.59:0/1075809413 >> v1:172.21.15.59:6789/0 conn(0x7f89a00726e0 legacy=0x7f89a015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.091+0000 7f89a5c00640 1 -- 172.21.15.59:0/1075809413 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a00b4270 con 0x7f89a01447c0 2024-05-30T16:54:28.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.095+0000 7f89a5c00640 1 --2- 172.21.15.59:0/1075809413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89a01447c0 0x7f89a00b32d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89940097c0 tx=0x7f899401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61e7959dce8284b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:28.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.095+0000 7f899fe00640 1 -- 172.21.15.59:0/1075809413 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89940b0070 con 0x7f89a01447c0 2024-05-30T16:54:28.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.095+0000 7f899fe00640 1 -- 172.21.15.59:0/1075809413 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89940ab600 con 0x7f89a01447c0 2024-05-30T16:54:28.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.095+0000 7f899fe00640 1 -- 172.21.15.59:0/1075809413 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89940ab9d0 con 0x7f89a01447c0 2024-05-30T16:54:28.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.095+0000 7f89a8600640 1 -- 172.21.15.59:0/1075809413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89a01447c0 msgr2=0x7f89a00b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.095+0000 7f89a8600640 1 --2- 172.21.15.59:0/1075809413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89a01447c0 0x7f89a00b32d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89940097c0 tx=0x7f899401c4a0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.095+0000 7f89a8600640 1 -- 172.21.15.59:0/1075809413 shutdown_connections 2024-05-30T16:54:28.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.095+0000 7f89a8600640 1 --2- 172.21.15.59:0/1075809413 >> v2:172.21.15.107:3300/0 conn(0x7f89a00b4a70 0x7f89a006f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.095+0000 7f89a8600640 1 --2- 172.21.15.59:0/1075809413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89a01447c0 0x7f89a00b32d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.095+0000 7f89a8600640 1 -- 172.21.15.59:0/1075809413 >> 172.21.15.59:0/1075809413 conn(0x7f89a006bdb0 msgr2=0x7f89a006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:28.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.095+0000 7f89a8600640 1 -- 172.21.15.59:0/1075809413 shutdown_connections 2024-05-30T16:54:28.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.095+0000 7f89a8600640 1 -- 172.21.15.59:0/1075809413 wait complete. 2024-05-30T16:54:28.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a8600640 1 Processor -- start 2024-05-30T16:54:28.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a8600640 1 -- start start 2024-05-30T16:54:28.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a8600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89a00726e0 0x7f89a015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a8600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89a00b4a70 0x7f89a00997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a8600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a01447c0 0x7f89a0151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a8600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89a015f250 con 0x7f89a01447c0 2024-05-30T16:54:28.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a8600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f89a015f0d0 con 0x7f89a00726e0 2024-05-30T16:54:28.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a8600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f89a015f3d0 con 0x7f89a00b4a70 2024-05-30T16:54:28.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a01447c0 0x7f89a0151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a01447c0 0x7f89a0151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47856/0 (socket says 172.21.15.59:47856) 2024-05-30T16:54:28.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a6600640 1 -- 172.21.15.59:0/1233216854 learned_addr learned my addr 172.21.15.59:0/1233216854 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:28.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a5c00640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89a00726e0 0x7f89a015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a5200640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89a00b4a70 0x7f89a00997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a6600640 1 -- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89a00b4a70 msgr2=0x7f89a00997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a6600640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89a00b4a70 0x7f89a00997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a6600640 1 -- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89a00726e0 msgr2=0x7f89a015a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a6600640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89a00726e0 0x7f89a015a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a6600640 1 -- 172.21.15.59:0/1233216854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a015ab30 con 0x7f89a01447c0 2024-05-30T16:54:28.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a6600640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a01447c0 0x7f89a0151000 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f899800cad0 tx=0x7f899800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:28.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f899d600640 1 -- 172.21.15.59:0/1233216854 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998017070 con 0x7f89a01447c0 2024-05-30T16:54:28.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f899d600640 1 -- 172.21.15.59:0/1233216854 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899800ac30 con 0x7f89a01447c0 2024-05-30T16:54:28.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f899d600640 1 -- 172.21.15.59:0/1233216854 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998012400 con 0x7f89a01447c0 2024-05-30T16:54:28.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a8600640 1 -- 172.21.15.59:0/1233216854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a015a850 con 0x7f89a01447c0 2024-05-30T16:54:28.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.099+0000 7f89a8600640 1 -- 172.21.15.59:0/1233216854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a0167f80 con 0x7f89a01447c0 2024-05-30T16:54:28.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.103+0000 7f89a8600640 1 -- 172.21.15.59:0/1233216854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a0068a90 con 0x7f89a01447c0 2024-05-30T16:54:28.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.103+0000 7f899d600640 1 -- 172.21.15.59:0/1233216854 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 88599+0+0 (secure 0 0 0) 0x7f899801a070 con 0x7f89a01447c0 2024-05-30T16:54:28.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.103+0000 7f899d600640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8980068a40 0x7f898006af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.103+0000 7f899d600640 1 -- 172.21.15.59:0/1233216854 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f89980873f0 con 0x7f89a01447c0 2024-05-30T16:54:28.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.103+0000 7f89a5c00640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8980068a40 0x7f898006af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.103+0000 7f89a5c00640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8980068a40 0x7f898006af00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f89940ad000 tx=0x7f8994008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:28.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.107+0000 7f899d600640 1 -- 172.21.15.59:0/1233216854 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f89980568a0 con 0x7f89a01447c0 2024-05-30T16:54:28.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.139+0000 7f899d600640 1 -- 172.21.15.59:0/1233216854 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f8998052f10 con 0x7f89a01447c0 2024-05-30T16:54:28.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.303+0000 7f89a8600640 1 -- 172.21.15.59:0/1233216854 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f89a006ddf0 con 0x7f8980068a40 2024-05-30T16:54:28.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.327+0000 7f899d600640 1 -- 172.21.15.59:0/1233216854 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f89a006ddf0 con 0x7f8980068a40 2024-05-30T16:54:28.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.331+0000 7f89a8600640 1 -- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8980068a40 msgr2=0x7f898006af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.331+0000 7f89a8600640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8980068a40 0x7f898006af00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f89940ad000 tx=0x7f8994008040 comp rx=0 tx=0).stop 2024-05-30T16:54:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.331+0000 7f89a8600640 1 -- 172.21.15.59:0/1233216854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a01447c0 msgr2=0x7f89a0151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.331+0000 7f89a8600640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a01447c0 0x7f89a0151000 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f899800cad0 tx=0x7f899800cf90 comp rx=0 tx=0).stop 2024-05-30T16:54:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.331+0000 7f89a8600640 1 -- 172.21.15.59:0/1233216854 shutdown_connections 2024-05-30T16:54:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.331+0000 7f89a8600640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8980068a40 0x7f898006af00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.331+0000 7f89a8600640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a01447c0 0x7f89a0151000 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.331+0000 7f89a8600640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89a00b4a70 0x7f89a00997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.331+0000 7f89a8600640 1 --2- 172.21.15.59:0/1233216854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89a00726e0 0x7f89a015a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.331+0000 7f89a8600640 1 -- 172.21.15.59:0/1233216854 >> 172.21.15.59:0/1233216854 conn(0x7f89a006bdb0 msgr2=0x7f89a00b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.331+0000 7f89a8600640 1 -- 172.21.15.59:0/1233216854 shutdown_connections 2024-05-30T16:54:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.331+0000 7f89a8600640 1 -- 172.21.15.59:0/1233216854 wait complete. 2024-05-30T16:54:28.358 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69362 2024-05-30T16:54:28.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.511+0000 7f26a3400640 1 Processor -- start 2024-05-30T16:54:28.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.511+0000 7f26a3400640 1 -- start start 2024-05-30T16:54:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.511+0000 7f26a3400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f269c06c0c0 0x7f269c167210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.511+0000 7f26a3400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f269c0b0340 con 0x7f269c0b7010 2024-05-30T16:54:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.511+0000 7f26a3400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f269c0b0620 con 0x7f269c145470 2024-05-30T16:54:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.511+0000 7f26a3400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f269c0b7470 con 0x7f269c06c0c0 2024-05-30T16:54:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.511+0000 7f269be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f269c0b7010 0x7f269c06b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47746/0 (socket says 172.21.15.59:47746) 2024-05-30T16:54:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.511+0000 7f269be00640 1 -- 172.21.15.59:0/1740140637 learned_addr learned my addr 172.21.15.59:0/1740140637 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:28.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.511+0000 7f26a1400640 1 --2- 172.21.15.59:0/1740140637 >> v2:172.21.15.107:3300/0 conn(0x7f269c06c0c0 0x7f269c167210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.515+0000 7f269b400640 1 -- 172.21.15.59:0/1740140637 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829819016 0 0) 0x7f269c0b0340 con 0x7f269c0b7010 2024-05-30T16:54:28.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.515+0000 7f269b400640 1 -- 172.21.15.59:0/1740140637 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2684003530 con 0x7f269c0b7010 2024-05-30T16:54:28.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.515+0000 7f26a1400640 1 -- 172.21.15.59:0/1740140637 >> v1:172.21.15.107:6789/0 conn(0x7f269c145470 legacy=0x7f269c0afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.515+0000 7f26a1400640 1 -- 172.21.15.59:0/1740140637 >> v1:172.21.15.59:6789/0 conn(0x7f269c0b7010 legacy=0x7f269c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.515+0000 7f269b400640 1 -- 172.21.15.59:0/1740140637 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1163911624 0 0) 0x7f2684003530 con 0x7f269c0b7010 2024-05-30T16:54:28.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.515+0000 7f26a1400640 1 -- 172.21.15.59:0/1740140637 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c0b0900 con 0x7f269c06c0c0 2024-05-30T16:54:28.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.515+0000 7f26a1400640 1 --2- 172.21.15.59:0/1740140637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c06c0c0 0x7f269c167210 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2694009d90 tx=0x7f269401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eac5cf8216614488 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.515+0000 7f269b400640 1 -- 172.21.15.59:0/1740140637 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2688001680 con 0x7f269c06c0c0 2024-05-30T16:54:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.515+0000 7f269b400640 1 -- 172.21.15.59:0/1740140637 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26940a64e0 con 0x7f269c06c0c0 2024-05-30T16:54:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.515+0000 7f269b400640 1 -- 172.21.15.59:0/1740140637 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26940a68b0 con 0x7f269c06c0c0 2024-05-30T16:54:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 -- 172.21.15.59:0/1740140637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c06c0c0 msgr2=0x7f269c167210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 --2- 172.21.15.59:0/1740140637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c06c0c0 0x7f269c167210 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2694009d90 tx=0x7f269401c890 comp rx=0 tx=0).stop 2024-05-30T16:54:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 -- 172.21.15.59:0/1740140637 shutdown_connections 2024-05-30T16:54:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 --2- 172.21.15.59:0/1740140637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c06c0c0 0x7f269c167210 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 -- 172.21.15.59:0/1740140637 >> 172.21.15.59:0/1740140637 conn(0x7f269c09aa40 msgr2=0x7f269c0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 -- 172.21.15.59:0/1740140637 shutdown_connections 2024-05-30T16:54:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 -- 172.21.15.59:0/1740140637 wait complete. 2024-05-30T16:54:28.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 Processor -- start 2024-05-30T16:54:28.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 -- start start 2024-05-30T16:54:28.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c06c0c0 0x7f269c132730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c0b7010 0x7f269c140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f269c145470 0x7f269c06f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f269c16a300 con 0x7f269c06c0c0 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f269c16a180 con 0x7f269c0b7010 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a3400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f269c16a480 con 0x7f269c145470 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c06c0c0 0x7f269c132730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c06c0c0 0x7f269c132730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47862/0 (socket says 172.21.15.59:47862) 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a0a00640 1 -- 172.21.15.59:0/2376364277 learned_addr learned my addr 172.21.15.59:0/2376364277 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a1400640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f269c145470 0x7f269c06f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f269be00640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c0b7010 0x7f269c140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a0a00640 1 -- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f269c145470 msgr2=0x7f269c06f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a0a00640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f269c145470 0x7f269c06f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a0a00640 1 -- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c0b7010 msgr2=0x7f269c140530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a0a00640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c0b7010 0x7f269c140530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.519+0000 7f26a0a00640 1 -- 172.21.15.59:0/2376364277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c0b45d0 con 0x7f269c06c0c0 2024-05-30T16:54:28.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.523+0000 7f26a0a00640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c06c0c0 0x7f269c132730 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f269000c500 tx=0x7f269000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:28.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.523+0000 7f2698c00640 1 -- 172.21.15.59:0/2376364277 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690016020 con 0x7f269c06c0c0 2024-05-30T16:54:28.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.523+0000 7f2698c00640 1 -- 172.21.15.59:0/2376364277 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2690005220 con 0x7f269c06c0c0 2024-05-30T16:54:28.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.523+0000 7f26a3400640 1 -- 172.21.15.59:0/2376364277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269c0b48b0 con 0x7f269c06c0c0 2024-05-30T16:54:28.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.523+0000 7f2698c00640 1 -- 172.21.15.59:0/2376364277 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690007030 con 0x7f269c06c0c0 2024-05-30T16:54:28.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.523+0000 7f26a3400640 1 -- 172.21.15.59:0/2376364277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269c06fd20 con 0x7f269c06c0c0 2024-05-30T16:54:28.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.523+0000 7f26a3400640 1 -- 172.21.15.59:0/2376364277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269c068a90 con 0x7f269c06c0c0 2024-05-30T16:54:28.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.523+0000 7f2698c00640 1 -- 172.21.15.59:0/2376364277 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f26900071f0 con 0x7f269c06c0c0 2024-05-30T16:54:28.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.523+0000 7f2698c00640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f267c068b90 0x7f267c06b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.523+0000 7f2698c00640 1 -- 172.21.15.59:0/2376364277 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f2690087620 con 0x7f269c06c0c0 2024-05-30T16:54:28.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.523+0000 7f269be00640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f267c068b90 0x7f267c06b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.527+0000 7f269be00640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f267c068b90 0x7f267c06b050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f269c0d0430 tx=0x7f2688005800 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.531+0000 7f2698c00640 1 -- 172.21.15.59:0/2376364277 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2690020020 con 0x7f269c06c0c0 2024-05-30T16:54:28.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.727+0000 7f26a3400640 1 -- 172.21.15.59:0/2376364277 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69362", "target": ["mon-mgr", ""]}) -- 0x7f269c0b6ac0 con 0x7f267c068b90 2024-05-30T16:54:28.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.743+0000 7f2698c00640 1 -- 172.21.15.59:0/2376364277 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f269c0b6ac0 con 0x7f267c068b90 2024-05-30T16:54:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.747+0000 7f26a3400640 1 -- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f267c068b90 msgr2=0x7f267c06b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.747+0000 7f26a3400640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f267c068b90 0x7f267c06b050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f269c0d0430 tx=0x7f2688005800 comp rx=0 tx=0).stop 2024-05-30T16:54:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.747+0000 7f26a3400640 1 -- 172.21.15.59:0/2376364277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c06c0c0 msgr2=0x7f269c132730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.747+0000 7f26a3400640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c06c0c0 0x7f269c132730 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f269000c500 tx=0x7f269000c9c0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.747+0000 7f26a3400640 1 -- 172.21.15.59:0/2376364277 shutdown_connections 2024-05-30T16:54:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.747+0000 7f26a3400640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f267c068b90 0x7f267c06b050 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.747+0000 7f26a3400640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f269c145470 0x7f269c06f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.747+0000 7f26a3400640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c0b7010 0x7f269c140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.747+0000 7f26a3400640 1 --2- 172.21.15.59:0/2376364277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c06c0c0 0x7f269c132730 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.747+0000 7f26a3400640 1 -- 172.21.15.59:0/2376364277 >> 172.21.15.59:0/2376364277 conn(0x7f269c09aa40 msgr2=0x7f269c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:28.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.747+0000 7f26a3400640 1 -- 172.21.15.59:0/2376364277 shutdown_connections 2024-05-30T16:54:28.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.747+0000 7f26a3400640 1 -- 172.21.15.59:0/2376364277 wait complete. 2024-05-30T16:54:28.772 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69364 2024-05-30T16:54:28.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc24000640 1 Processor -- start 2024-05-30T16:54:28.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc24000640 1 -- start start 2024-05-30T16:54:28.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc24000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdc1c15ed00 0x7fdc1c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc24000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc1c0b4aa0 0x7fdc1c09af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc24000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc1c0b32e0 0x7fdc1c162780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc24000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fdc1c15f0e0 con 0x7fdc1c0b32e0 2024-05-30T16:54:28.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc24000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fdc1c0b3830 con 0x7fdc1c15ed00 2024-05-30T16:54:28.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc24000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1c0d1200 con 0x7fdc1c0b4aa0 2024-05-30T16:54:28.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc22000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc1c0b32e0 0x7fdc1c162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc22000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc1c0b32e0 0x7fdc1c162780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47876/0 (socket says 172.21.15.59:47876) 2024-05-30T16:54:28.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc22000640 1 -- 172.21.15.59:0/81485194 learned_addr learned my addr 172.21.15.59:0/81485194 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:28.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc21600640 1 --2- 172.21.15.59:0/81485194 >> v2:172.21.15.107:3300/0 conn(0x7fdc1c15ed00 0x7fdc1c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc20c00640 1 --2- 172.21.15.59:0/81485194 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc1c0b4aa0 0x7fdc1c09af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc22000640 1 -- 172.21.15.59:0/81485194 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc1c0b4aa0 msgr2=0x7fdc1c09af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:28.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc22000640 1 --2- 172.21.15.59:0/81485194 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc1c0b4aa0 0x7fdc1c09af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc22000640 1 -- 172.21.15.59:0/81485194 >> v2:172.21.15.107:3300/0 conn(0x7fdc1c15ed00 msgr2=0x7fdc1c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:28.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc22000640 1 --2- 172.21.15.59:0/81485194 >> v2:172.21.15.107:3300/0 conn(0x7fdc1c15ed00 0x7fdc1c09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc22000640 1 -- 172.21.15.59:0/81485194 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1c0d0ed0 con 0x7fdc1c0b32e0 2024-05-30T16:54:28.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.919+0000 7fdc21600640 1 --2- 172.21.15.59:0/81485194 >> v2:172.21.15.107:3300/0 conn(0x7fdc1c15ed00 0x7fdc1c09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:28.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc22000640 1 --2- 172.21.15.59:0/81485194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc1c0b32e0 0x7fdc1c162780 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009e50 tx=0x7fdc1401c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22a13bc0845ac49 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:28.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc1be00640 1 -- 172.21.15.59:0/81485194 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc140a64c0 con 0x7fdc1c0b32e0 2024-05-30T16:54:28.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc1be00640 1 -- 172.21.15.59:0/81485194 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc140a6660 con 0x7fdc1c0b32e0 2024-05-30T16:54:28.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc1be00640 1 -- 172.21.15.59:0/81485194 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc140a6a30 con 0x7fdc1c0b32e0 2024-05-30T16:54:28.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc24000640 1 -- 172.21.15.59:0/81485194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc1c0b32e0 msgr2=0x7fdc1c162780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc24000640 1 --2- 172.21.15.59:0/81485194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc1c0b32e0 0x7fdc1c162780 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009e50 tx=0x7fdc1401c610 comp rx=0 tx=0).stop 2024-05-30T16:54:28.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc24000640 1 -- 172.21.15.59:0/81485194 shutdown_connections 2024-05-30T16:54:28.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc24000640 1 --2- 172.21.15.59:0/81485194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc1c0b32e0 0x7fdc1c162780 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc24000640 1 --2- 172.21.15.59:0/81485194 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc1c0b4aa0 0x7fdc1c09af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc24000640 1 --2- 172.21.15.59:0/81485194 >> v2:172.21.15.107:3300/0 conn(0x7fdc1c15ed00 0x7fdc1c09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc24000640 1 -- 172.21.15.59:0/81485194 >> 172.21.15.59:0/81485194 conn(0x7fdc1c0b3f80 msgr2=0x7fdc1c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:28.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc24000640 1 -- 172.21.15.59:0/81485194 shutdown_connections 2024-05-30T16:54:28.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc24000640 1 -- 172.21.15.59:0/81485194 wait complete. 2024-05-30T16:54:28.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc24000640 1 Processor -- start 2024-05-30T16:54:28.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.927+0000 7fdc24000640 1 -- start start 2024-05-30T16:54:28.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc24000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc1c0b32e0 0x7fdc1c15f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc24000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc1c0b4aa0 0x7fdc1c160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc24000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc1c15ed00 0x7fdc1c0b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc24000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c09b8b0 con 0x7fdc1c15ed00 2024-05-30T16:54:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc24000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c09b730 con 0x7fdc1c0b32e0 2024-05-30T16:54:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc24000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1c0b1c50 con 0x7fdc1c0b4aa0 2024-05-30T16:54:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc22000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc1c15ed00 0x7fdc1c0b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc22000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc1c15ed00 0x7fdc1c0b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47882/0 (socket says 172.21.15.59:47882) 2024-05-30T16:54:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc22000640 1 -- 172.21.15.59:0/1573811007 learned_addr learned my addr 172.21.15.59:0/1573811007 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc21600640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc1c0b32e0 0x7fdc1c15f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc20c00640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc1c0b4aa0 0x7fdc1c160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc22000640 1 -- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc1c0b4aa0 msgr2=0x7fdc1c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc22000640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc1c0b4aa0 0x7fdc1c160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc22000640 1 -- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc1c0b32e0 msgr2=0x7fdc1c15f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc22000640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc1c0b32e0 0x7fdc1c15f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc22000640 1 -- 172.21.15.59:0/1573811007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1c15f7a0 con 0x7fdc1c15ed00 2024-05-30T16:54:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc21600640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc1c0b32e0 0x7fdc1c15f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:28.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc22000640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc1c15ed00 0x7fdc1c0b0020 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdc1401acc0 tx=0x7fdc140193b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:28.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc19600640 1 -- 172.21.15.59:0/1573811007 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc140bf070 con 0x7fdc1c15ed00 2024-05-30T16:54:28.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc19600640 1 -- 172.21.15.59:0/1573811007 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc140a6b40 con 0x7fdc1c15ed00 2024-05-30T16:54:28.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc24000640 1 -- 172.21.15.59:0/1573811007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1c15fa70 con 0x7fdc1c15ed00 2024-05-30T16:54:28.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc19600640 1 -- 172.21.15.59:0/1573811007 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14009510 con 0x7fdc1c15ed00 2024-05-30T16:54:28.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc24000640 1 -- 172.21.15.59:0/1573811007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc1c160030 con 0x7fdc1c15ed00 2024-05-30T16:54:28.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.931+0000 7fdc24000640 1 -- 172.21.15.59:0/1573811007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc1c068a90 con 0x7fdc1c15ed00 2024-05-30T16:54:28.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.935+0000 7fdc19600640 1 -- 172.21.15.59:0/1573811007 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fdc140c2070 con 0x7fdc1c15ed00 2024-05-30T16:54:28.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.935+0000 7fdc19600640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdbfc068b60 0x7fdbfc06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:28.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.935+0000 7fdc19600640 1 -- 172.21.15.59:0/1573811007 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7fdc14121700 con 0x7fdc1c15ed00 2024-05-30T16:54:28.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.935+0000 7fdc21600640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdbfc068b60 0x7fdbfc06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:28.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.935+0000 7fdc21600640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdbfc068b60 0x7fdbfc06b020 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdc100079d0 tx=0x7fdc10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:28.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:28.943+0000 7fdc19600640 1 -- 172.21.15.59:0/1573811007 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdc140165e0 con 0x7fdc1c15ed00 2024-05-30T16:54:29.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.135+0000 7fdc24000640 1 -- 172.21.15.59:0/1573811007 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69364", "target": ["mon-mgr", ""]}) -- 0x7fdc1c0b8410 con 0x7fdbfc068b60 2024-05-30T16:54:29.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc19600640 1 -- 172.21.15.59:0/1573811007 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdc1c0b8410 con 0x7fdbfc068b60 2024-05-30T16:54:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc24000640 1 -- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdbfc068b60 msgr2=0x7fdbfc06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc24000640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdbfc068b60 0x7fdbfc06b020 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdc100079d0 tx=0x7fdc10008040 comp rx=0 tx=0).stop 2024-05-30T16:54:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc24000640 1 -- 172.21.15.59:0/1573811007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc1c15ed00 msgr2=0x7fdc1c0b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc24000640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc1c15ed00 0x7fdc1c0b0020 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdc1401acc0 tx=0x7fdc140193b0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc24000640 1 -- 172.21.15.59:0/1573811007 shutdown_connections 2024-05-30T16:54:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc24000640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdbfc068b60 0x7fdbfc06b020 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc24000640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc1c15ed00 0x7fdc1c0b0020 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc24000640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc1c0b4aa0 0x7fdc1c160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc24000640 1 --2- 172.21.15.59:0/1573811007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc1c0b32e0 0x7fdc1c15f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc24000640 1 -- 172.21.15.59:0/1573811007 >> 172.21.15.59:0/1573811007 conn(0x7fdc1c0b3f80 msgr2=0x7fdc1c06fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:29.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc24000640 1 -- 172.21.15.59:0/1573811007 shutdown_connections 2024-05-30T16:54:29.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.159+0000 7fdc24000640 1 -- 172.21.15.59:0/1573811007 wait complete. 2024-05-30T16:54:29.189 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69363 2024-05-30T16:54:29.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.331+0000 7f2f2a600640 1 Processor -- start 2024-05-30T16:54:29.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.331+0000 7f2f2a600640 1 -- start start 2024-05-30T16:54:29.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.331+0000 7f2f2a600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f240ce2f0 0x7f2f2409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:29.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.331+0000 7f2f2a600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f24163480 con 0x7f2f240ce6d0 2024-05-30T16:54:29.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f2a600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f240d0880 con 0x7f2f2406ccd0 2024-05-30T16:54:29.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f2a600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f2f240cdb00 con 0x7f2f240ce2f0 2024-05-30T16:54:29.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f23400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f240ce2f0 0x7f2f2409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:29.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f1aa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2f240ce6d0 0x7f2f24162660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47748/0 (socket says 172.21.15.59:47748) 2024-05-30T16:54:29.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f23400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f240ce2f0 0x7f2f2409aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47884/0 (socket says 172.21.15.59:47884) 2024-05-30T16:54:29.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f1aa00640 1 -- 172.21.15.59:0/3770407353 learned_addr learned my addr 172.21.15.59:0/3770407353 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:29.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f23400640 1 -- 172.21.15.59:0/3770407353 >> v1:172.21.15.107:6789/0 conn(0x7f2f2406ccd0 legacy=0x7f2f24162d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:29.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f23400640 1 -- 172.21.15.59:0/3770407353 >> v1:172.21.15.59:6789/0 conn(0x7f2f240ce6d0 legacy=0x7f2f24162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:29.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f23400640 1 -- 172.21.15.59:0/3770407353 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f240d0b60 con 0x7f2f240ce2f0 2024-05-30T16:54:29.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f23400640 1 --2- 172.21.15.59:0/3770407353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f240ce2f0 0x7f2f2409aa40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2f140097c0 tx=0x7f2f1401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e63679b86c1dc74 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:29.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f22a00640 1 -- 172.21.15.59:0/3770407353 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f140b5070 con 0x7f2f240ce2f0 2024-05-30T16:54:29.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f22a00640 1 -- 172.21.15.59:0/3770407353 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f140a8990 con 0x7f2f240ce2f0 2024-05-30T16:54:29.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.335+0000 7f2f22a00640 1 -- 172.21.15.59:0/3770407353 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f140a8d60 con 0x7f2f240ce2f0 2024-05-30T16:54:29.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 -- 172.21.15.59:0/3770407353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f240ce2f0 msgr2=0x7f2f2409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:29.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 --2- 172.21.15.59:0/3770407353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f240ce2f0 0x7f2f2409aa40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2f140097c0 tx=0x7f2f1401ecb0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 -- 172.21.15.59:0/3770407353 shutdown_connections 2024-05-30T16:54:29.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 --2- 172.21.15.59:0/3770407353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f240ce2f0 0x7f2f2409aa40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 -- 172.21.15.59:0/3770407353 >> 172.21.15.59:0/3770407353 conn(0x7f2f240b3f90 msgr2=0x7f2f240b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:29.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 -- 172.21.15.59:0/3770407353 shutdown_connections 2024-05-30T16:54:29.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 -- 172.21.15.59:0/3770407353 wait complete. 2024-05-30T16:54:29.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 Processor -- start 2024-05-30T16:54:29.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 -- start start 2024-05-30T16:54:29.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2406ccd0 0x7f2f2415c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:29.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f240ce2f0 0x7f2f240caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:29.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f240ce6d0 0x7f2f240c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:29.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2f240d1400 con 0x7f2f240ce6d0 2024-05-30T16:54:29.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2f240d1120 con 0x7f2f240ce2f0 2024-05-30T16:54:29.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f2a600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2f2409b690 con 0x7f2f2406ccd0 2024-05-30T16:54:29.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f23e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f240ce6d0 0x7f2f240c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:29.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f23e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f240ce6d0 0x7f2f240c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47894/0 (socket says 172.21.15.59:47894) 2024-05-30T16:54:29.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f23e00640 1 -- 172.21.15.59:0/411485508 learned_addr learned my addr 172.21.15.59:0/411485508 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:29.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f23400640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2406ccd0 0x7f2f2415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:29.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.339+0000 7f2f1aa00640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f240ce2f0 0x7f2f240caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:29.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f23e00640 1 -- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2406ccd0 msgr2=0x7f2f2415c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:29.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f23e00640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2406ccd0 0x7f2f2415c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f23e00640 1 -- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f240ce2f0 msgr2=0x7f2f240caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:29.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f23e00640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f240ce2f0 0x7f2f240caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f23e00640 1 -- 172.21.15.59:0/411485508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f240c5fd0 con 0x7f2f240ce6d0 2024-05-30T16:54:29.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f23e00640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f240ce6d0 0x7f2f240c89b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00c760 tx=0x7f2f1c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:29.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f1be00640 1 -- 172.21.15.59:0/411485508 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c003b80 con 0x7f2f240ce6d0 2024-05-30T16:54:29.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f1be00640 1 -- 172.21.15.59:0/411485508 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1c003d20 con 0x7f2f240ce6d0 2024-05-30T16:54:29.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f2a600640 1 -- 172.21.15.59:0/411485508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f240cb5b0 con 0x7f2f240ce6d0 2024-05-30T16:54:29.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f1be00640 1 -- 172.21.15.59:0/411485508 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00aa30 con 0x7f2f240ce6d0 2024-05-30T16:54:29.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f2a600640 1 -- 172.21.15.59:0/411485508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f240cbb70 con 0x7f2f240ce6d0 2024-05-30T16:54:29.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f2a600640 1 -- 172.21.15.59:0/411485508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f24068a90 con 0x7f2f240ce6d0 2024-05-30T16:54:29.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f1be00640 1 -- 172.21.15.59:0/411485508 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f2f1c00abd0 con 0x7f2f240ce6d0 2024-05-30T16:54:29.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f1be00640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f00068b60 0x7f2f0006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:29.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.343+0000 7f2f1be00640 1 -- 172.21.15.59:0/411485508 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f2f1c087b60 con 0x7f2f240ce6d0 2024-05-30T16:54:29.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.347+0000 7f2f23400640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f00068b60 0x7f2f0006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:29.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.347+0000 7f2f23400640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f00068b60 0x7f2f0006b020 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2f140b2000 tx=0x7f2f14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:29.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.351+0000 7f2f1be00640 1 -- 172.21.15.59:0/411485508 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2f1c0570a0 con 0x7f2f240ce6d0 2024-05-30T16:54:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.539+0000 7f2f2a600640 1 -- 172.21.15.59:0/411485508 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69363", "target": ["mon-mgr", ""]}) -- 0x7f2f240b31e0 con 0x7f2f00068b60 2024-05-30T16:54:29.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.563+0000 7f2f1be00640 1 -- 172.21.15.59:0/411485508 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2f240b31e0 con 0x7f2f00068b60 2024-05-30T16:54:29.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.567+0000 7f2f2a600640 1 -- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f00068b60 msgr2=0x7f2f0006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:29.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.567+0000 7f2f2a600640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f00068b60 0x7f2f0006b020 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2f140b2000 tx=0x7f2f14008040 comp rx=0 tx=0).stop 2024-05-30T16:54:29.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.567+0000 7f2f2a600640 1 -- 172.21.15.59:0/411485508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f240ce6d0 msgr2=0x7f2f240c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:29.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.567+0000 7f2f2a600640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f240ce6d0 0x7f2f240c89b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00c760 tx=0x7f2f1c00cc20 comp rx=0 tx=0).stop 2024-05-30T16:54:29.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.567+0000 7f2f2a600640 1 -- 172.21.15.59:0/411485508 shutdown_connections 2024-05-30T16:54:29.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.567+0000 7f2f2a600640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f00068b60 0x7f2f0006b020 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.567+0000 7f2f2a600640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f240ce6d0 0x7f2f240c89b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.567+0000 7f2f2a600640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f240ce2f0 0x7f2f240caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.567+0000 7f2f2a600640 1 --2- 172.21.15.59:0/411485508 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2406ccd0 0x7f2f2415c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:29.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.567+0000 7f2f2a600640 1 -- 172.21.15.59:0/411485508 >> 172.21.15.59:0/411485508 conn(0x7f2f240b3f90 msgr2=0x7f2f2415d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:29.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.567+0000 7f2f2a600640 1 -- 172.21.15.59:0/411485508 shutdown_connections 2024-05-30T16:54:29.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29.567+0000 7f2f2a600640 1 -- 172.21.15.59:0/411485508 wait complete. 2024-05-30T16:54:29.591 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T16:54:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:54:29.651 INFO:teuthology.orchestra.run.smithi059.stdout:2 2024-05-30T16:54:29.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:54:29.658 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:54:29.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:54:29.743 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:54:29.838 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:54:29.838 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:54:29.838 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:54:29.839 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:54:29.847 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:54:29.847 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:54:29.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:54:30.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.123+0000 7fbc36800640 1 Processor -- start 2024-05-30T16:54:30.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.123+0000 7fbc36800640 1 -- start start 2024-05-30T16:54:30.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.123+0000 7fbc36800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc3015ea20 0x7fbc300ae230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:30.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.123+0000 7fbc36800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc300cbab0 con 0x7fbc300b0500 2024-05-30T16:54:30.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.123+0000 7fbc36800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc300cbd20 con 0x7fbc300ae770 2024-05-30T16:54:30.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.123+0000 7fbc36800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbc3015ee00 con 0x7fbc3015ea20 2024-05-30T16:54:30.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.123+0000 7fbc2f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc3015ea20 0x7fbc300ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:30.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.123+0000 7fbc2fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbc300b0500 0x7fbc3006b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47750/0 (socket says 172.21.15.59:47750) 2024-05-30T16:54:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.123+0000 7fbc2fe00640 1 -- 172.21.15.59:0/1397388067 learned_addr learned my addr 172.21.15.59:0/1397388067 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.127+0000 7fbc2f400640 1 -- 172.21.15.59:0/1397388067 >> v1:172.21.15.107:6789/0 conn(0x7fbc300ae770 legacy=0x7fbc300cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.127+0000 7fbc2f400640 1 -- 172.21.15.59:0/1397388067 >> v1:172.21.15.59:6789/0 conn(0x7fbc300b0500 legacy=0x7fbc3006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.127+0000 7fbc2f400640 1 -- 172.21.15.59:0/1397388067 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc300cc000 con 0x7fbc3015ea20 2024-05-30T16:54:30.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.127+0000 7fbc2f400640 1 --2- 172.21.15.59:0/1397388067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc3015ea20 0x7fbc300ae230 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbc200097c0 tx=0x7fbc2001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156c8663ba245c89 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.127+0000 7fbc2ea00640 1 -- 172.21.15.59:0/1397388067 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc200b0070 con 0x7fbc3015ea20 2024-05-30T16:54:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.127+0000 7fbc2ea00640 1 -- 172.21.15.59:0/1397388067 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc200ab600 con 0x7fbc3015ea20 2024-05-30T16:54:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.127+0000 7fbc2ea00640 1 -- 172.21.15.59:0/1397388067 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc200ab9d0 con 0x7fbc3015ea20 2024-05-30T16:54:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.127+0000 7fbc36800640 1 -- 172.21.15.59:0/1397388067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc3015ea20 msgr2=0x7fbc300ae230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.127+0000 7fbc36800640 1 --2- 172.21.15.59:0/1397388067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc3015ea20 0x7fbc300ae230 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbc200097c0 tx=0x7fbc2001c410 comp rx=0 tx=0).stop 2024-05-30T16:54:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 -- 172.21.15.59:0/1397388067 shutdown_connections 2024-05-30T16:54:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 --2- 172.21.15.59:0/1397388067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc3015ea20 0x7fbc300ae230 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 -- 172.21.15.59:0/1397388067 >> 172.21.15.59:0/1397388067 conn(0x7fbc300b2f50 msgr2=0x7fbc300b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 -- 172.21.15.59:0/1397388067 shutdown_connections 2024-05-30T16:54:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 -- 172.21.15.59:0/1397388067 wait complete. 2024-05-30T16:54:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 Processor -- start 2024-05-30T16:54:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 -- start start 2024-05-30T16:54:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc300ae770 0x7fbc30154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc300b0500 0x7fbc30151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3015ea20 0x7fbc300b6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbc300b3e00 con 0x7fbc300b0500 2024-05-30T16:54:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbc300b3c80 con 0x7fbc3015ea20 2024-05-30T16:54:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc36800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3006c0c0 con 0x7fbc300ae770 2024-05-30T16:54:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc26a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc300b0500 0x7fbc30151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc26a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc300b0500 0x7fbc30151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47912/0 (socket says 172.21.15.59:47912) 2024-05-30T16:54:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc26a00640 1 -- 172.21.15.59:0/2235479920 learned_addr learned my addr 172.21.15.59:0/2235479920 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc2fe00640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3015ea20 0x7fbc300b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc2f400640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc300ae770 0x7fbc30154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc26a00640 1 -- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc300ae770 msgr2=0x7fbc30154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc26a00640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc300ae770 0x7fbc30154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc26a00640 1 -- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3015ea20 msgr2=0x7fbc300b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc26a00640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3015ea20 0x7fbc300b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc26a00640 1 -- 172.21.15.59:0/2235479920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc300b6db0 con 0x7fbc300b0500 2024-05-30T16:54:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc2f400640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc300ae770 0x7fbc30154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc2fe00640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3015ea20 0x7fbc300b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.131+0000 7fbc26a00640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc300b0500 0x7fbc30151fa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800c3c0 tx=0x7fbc1800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:30.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.135+0000 7fbc27e00640 1 -- 172.21.15.59:0/2235479920 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18017070 con 0x7fbc300b0500 2024-05-30T16:54:30.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.135+0000 7fbc27e00640 1 -- 172.21.15.59:0/2235479920 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc180052d0 con 0x7fbc300b0500 2024-05-30T16:54:30.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.135+0000 7fbc27e00640 1 -- 172.21.15.59:0/2235479920 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18003840 con 0x7fbc300b0500 2024-05-30T16:54:30.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.135+0000 7fbc36800640 1 -- 172.21.15.59:0/2235479920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc300b45e0 con 0x7fbc300b0500 2024-05-30T16:54:30.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.135+0000 7fbc36800640 1 -- 172.21.15.59:0/2235479920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc300b4300 con 0x7fbc300b0500 2024-05-30T16:54:30.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.135+0000 7fbc36800640 1 -- 172.21.15.59:0/2235479920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc30075680 con 0x7fbc300b0500 2024-05-30T16:54:30.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.135+0000 7fbc27e00640 1 -- 172.21.15.59:0/2235479920 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fbc1801a070 con 0x7fbc300b0500 2024-05-30T16:54:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.135+0000 7fbc27e00640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbc0c068b60 0x7fbc0c06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.135+0000 7fbc27e00640 1 -- 172.21.15.59:0/2235479920 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7fbc18084690 con 0x7fbc300b0500 2024-05-30T16:54:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.139+0000 7fbc2f400640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbc0c068b60 0x7fbc0c06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:30.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.139+0000 7fbc2f400640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbc0c068b60 0x7fbc0c06b020 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbc200ad000 tx=0x7fbc200a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.147+0000 7fbc27e00640 1 -- 172.21.15.59:0/2235479920 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbc18005480 con 0x7fbc300b0500 2024-05-30T16:54:30.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.327+0000 7fbc36800640 1 -- 172.21.15.59:0/2235479920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbc300af0d0 con 0x7fbc300b0500 2024-05-30T16:54:30.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.327+0000 7fbc27e00640 1 -- 172.21.15.59:0/2235479920 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) ==== 80+0+0 (secure 0 0 0) 0x7fbc18056540 con 0x7fbc300b0500 2024-05-30T16:54:30.331 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T16:54:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.327+0000 7fbc36800640 1 -- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbc0c068b60 msgr2=0x7fbc0c06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.327+0000 7fbc36800640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbc0c068b60 0x7fbc0c06b020 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbc200ad000 tx=0x7fbc200a6000 comp rx=0 tx=0).stop 2024-05-30T16:54:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.327+0000 7fbc36800640 1 -- 172.21.15.59:0/2235479920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc300b0500 msgr2=0x7fbc30151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.327+0000 7fbc36800640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc300b0500 0x7fbc30151fa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800c3c0 tx=0x7fbc1800c880 comp rx=0 tx=0).stop 2024-05-30T16:54:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.327+0000 7fbc36800640 1 -- 172.21.15.59:0/2235479920 shutdown_connections 2024-05-30T16:54:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.327+0000 7fbc36800640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbc0c068b60 0x7fbc0c06b020 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.327+0000 7fbc36800640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3015ea20 0x7fbc300b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.327+0000 7fbc36800640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc300b0500 0x7fbc30151fa0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.327+0000 7fbc36800640 1 --2- 172.21.15.59:0/2235479920 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc300ae770 0x7fbc30154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.327+0000 7fbc36800640 1 -- 172.21.15.59:0/2235479920 >> 172.21.15.59:0/2235479920 conn(0x7fbc300b2f50 msgr2=0x7fbc300af990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.331+0000 7fbc36800640 1 -- 172.21.15.59:0/2235479920 shutdown_connections 2024-05-30T16:54:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.331+0000 7fbc36800640 1 -- 172.21.15.59:0/2235479920 wait complete. 2024-05-30T16:54:30.352 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2024-05-30T16:54:30.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:54:30.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-30T16:54:30.370 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[37862]: fuse finished with error 0 and tester_r 0 2024-05-30T16:54:30.372 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T16:54:30.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:54:30.372 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T16:54:30.546 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:54:30.546 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:54:30.546 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:54:30.555 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:54:30.555 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:54:30.555 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:54:30.555 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:54:30.601 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:54:30.601 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:54:30.601 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:54:30.601 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:54:30.609 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:54:30.610 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:54:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.783+0000 7f362dc00640 1 Processor -- start 2024-05-30T16:54:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.783+0000 7f362dc00640 1 -- start start 2024-05-30T16:54:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f362dc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f362809aa40 0x7f362815e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f362dc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f36280b34b0 0x7f362809ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f362dc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36280cce40 con 0x7f362809b360 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f362dc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f36280d0260 con 0x7f36280b34b0 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f362dc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f36280b3ba0 con 0x7f362809aa40 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f3627400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f362809b360 0x7f36280cd5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47762/0 (socket says 172.21.15.59:47762) 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f3627400640 1 -- 172.21.15.59:0/2193559897 learned_addr learned my addr 172.21.15.59:0/2193559897 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f3626a00640 1 --2- 172.21.15.59:0/2193559897 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f362809aa40 0x7f362815e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f361e000640 1 --2- 172.21.15.59:0/2193559897 >> v2:172.21.15.107:3300/0 conn(0x7f36280b34b0 0x7f362809ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f3626000640 1 -- 172.21.15.59:0/2193559897 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289081180 0 0) 0x7f3620001120 con 0x7f362809b360 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f3626000640 1 -- 172.21.15.59:0/2193559897 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f360c003530 con 0x7f362809b360 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f3626a00640 1 -- 172.21.15.59:0/2193559897 >> v2:172.21.15.107:3300/0 conn(0x7f36280b34b0 msgr2=0x7f362809ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f3626a00640 1 --2- 172.21.15.59:0/2193559897 >> v2:172.21.15.107:3300/0 conn(0x7f36280b34b0 0x7f362809ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f3626a00640 1 -- 172.21.15.59:0/2193559897 >> v1:172.21.15.59:6789/0 conn(0x7f362809b360 legacy=0x7f36280cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f3626a00640 1 -- 172.21.15.59:0/2193559897 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36280ceac0 con 0x7f362809aa40 2024-05-30T16:54:30.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.787+0000 7f3626a00640 1 --2- 172.21.15.59:0/2193559897 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f362809aa40 0x7f362815e2e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3618009d90 tx=0x7f361801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53ef859e549e1803 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:30.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f3626000640 1 -- 172.21.15.59:0/2193559897 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36180b2070 con 0x7f362809aa40 2024-05-30T16:54:30.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f3626000640 1 -- 172.21.15.59:0/2193559897 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36180a59c0 con 0x7f362809aa40 2024-05-30T16:54:30.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f3626000640 1 -- 172.21.15.59:0/2193559897 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36180a5d90 con 0x7f362809aa40 2024-05-30T16:54:30.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 -- 172.21.15.59:0/2193559897 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f362809aa40 msgr2=0x7f362815e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:30.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 --2- 172.21.15.59:0/2193559897 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f362809aa40 0x7f362815e2e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3618009d90 tx=0x7f361801c8e0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 -- 172.21.15.59:0/2193559897 shutdown_connections 2024-05-30T16:54:30.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 --2- 172.21.15.59:0/2193559897 >> v2:172.21.15.107:3300/0 conn(0x7f36280b34b0 0x7f362809ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 --2- 172.21.15.59:0/2193559897 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f362809aa40 0x7f362815e2e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 -- 172.21.15.59:0/2193559897 >> 172.21.15.59:0/2193559897 conn(0x7f36280b3f50 msgr2=0x7f36280b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:30.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 -- 172.21.15.59:0/2193559897 shutdown_connections 2024-05-30T16:54:30.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 -- 172.21.15.59:0/2193559897 wait complete. 2024-05-30T16:54:30.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 Processor -- start 2024-05-30T16:54:30.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 -- start start 2024-05-30T16:54:30.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f362809aa40 0x7f3628153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:30.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f362809b360 0x7f362815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36280b34b0 0x7f36280b7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f362815deb0 con 0x7f362809b360 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f362815dd30 con 0x7f36280b34b0 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f362dc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3628169ec0 con 0x7f362809aa40 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f361e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f362809b360 0x7f362815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f361e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f362809b360 0x7f362815a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47926/0 (socket says 172.21.15.59:47926) 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f361e000640 1 -- 172.21.15.59:0/485780219 learned_addr learned my addr 172.21.15.59:0/485780219 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f3626a00640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f362809aa40 0x7f3628153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.791+0000 7f3627400640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36280b34b0 0x7f36280b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f361e000640 1 -- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f362809aa40 msgr2=0x7f3628153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f361e000640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f362809aa40 0x7f3628153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f361e000640 1 -- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36280b34b0 msgr2=0x7f36280b7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f361e000640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36280b34b0 0x7f36280b7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:30.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f361e000640 1 -- 172.21.15.59:0/485780219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362815d530 con 0x7f362809b360 2024-05-30T16:54:30.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f3627400640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36280b34b0 0x7f36280b7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:30.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f361e000640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f362809b360 0x7f362815a3c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f361000e870 tx=0x7f361000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:30.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f361f400640 1 -- 172.21.15.59:0/485780219 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610017070 con 0x7f362809b360 2024-05-30T16:54:30.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f361f400640 1 -- 172.21.15.59:0/485780219 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361000c940 con 0x7f362809b360 2024-05-30T16:54:30.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f361f400640 1 -- 172.21.15.59:0/485780219 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361000ccf0 con 0x7f362809b360 2024-05-30T16:54:30.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f362dc00640 1 -- 172.21.15.59:0/485780219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36280b6000 con 0x7f362809b360 2024-05-30T16:54:30.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f362dc00640 1 -- 172.21.15.59:0/485780219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36280b65c0 con 0x7f362809b360 2024-05-30T16:54:30.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f362dc00640 1 -- 172.21.15.59:0/485780219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3628068a90 con 0x7f362809b360 2024-05-30T16:54:30.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f361f400640 1 -- 172.21.15.59:0/485780219 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f361001a070 con 0x7f362809b360 2024-05-30T16:54:30.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f361f400640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3604068b90 0x7f360406b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:30.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.795+0000 7f361f400640 1 -- 172.21.15.59:0/485780219 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f3610087a80 con 0x7f362809b360 2024-05-30T16:54:30.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.799+0000 7f3626a00640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3604068b90 0x7f360406b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:30.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.799+0000 7f3626a00640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3604068b90 0x7f360406b050 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f36180af000 tx=0x7f36180a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:30.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:30.799+0000 7f361f400640 1 -- 172.21.15.59:0/485780219 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3610056970 con 0x7f362809b360 2024-05-30T16:54:31.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.147+0000 7f362dc00640 1 -- 172.21.15.59:0/485780219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3628159ee0 con 0x7f362809b360 2024-05-30T16:54:31.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.147+0000 7f361f400640 1 -- 172.21.15.59:0/485780219 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5187 (secure 0 0 0) 0x7f361005ac70 con 0x7f362809b360 2024-05-30T16:54:31.155 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:31.155 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4919,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2045783783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2045783783},{"type":"v1","addr":"172.21.15.107:6836","nonce":2045783783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4922,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3405430037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3405430037},{"type":"v1","addr":"172.21.15.107:6837","nonce":3405430037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3338903229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3338903229},{"type":"v1","addr":"172.21.15.59:6834","nonce":3338903229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:52:12.149964+0000","modified":"2024-05-30T16:52:15.176696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3019371755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3019371755},{"type":"v1","addr":"172.21.15.59:6835","nonce":3019371755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-05-30T16:54:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 26 2024-05-30T16:54:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.151+0000 7f362dc00640 1 -- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3604068b90 msgr2=0x7f360406b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.151+0000 7f362dc00640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3604068b90 0x7f360406b050 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f36180af000 tx=0x7f36180a7070 comp rx=0 tx=0).stop 2024-05-30T16:54:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.151+0000 7f362dc00640 1 -- 172.21.15.59:0/485780219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f362809b360 msgr2=0x7f362815a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.151+0000 7f362dc00640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f362809b360 0x7f362815a3c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f361000e870 tx=0x7f361000ec70 comp rx=0 tx=0).stop 2024-05-30T16:54:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.151+0000 7f362dc00640 1 -- 172.21.15.59:0/485780219 shutdown_connections 2024-05-30T16:54:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.151+0000 7f362dc00640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3604068b90 0x7f360406b050 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.151+0000 7f362dc00640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36280b34b0 0x7f36280b7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.151+0000 7f362dc00640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f362809b360 0x7f362815a3c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.151+0000 7f362dc00640 1 --2- 172.21.15.59:0/485780219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f362809aa40 0x7f3628153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.151+0000 7f362dc00640 1 -- 172.21.15.59:0/485780219 >> 172.21.15.59:0/485780219 conn(0x7f36280b3f50 msgr2=0x7f3628156840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.151+0000 7f362dc00640 1 -- 172.21.15.59:0/485780219 shutdown_connections 2024-05-30T16:54:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.151+0000 7f362dc00640 1 -- 172.21.15.59:0/485780219 wait complete. 2024-05-30T16:54:31.185 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:54:31.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.407+0000 7f83d3000640 1 Processor -- start 2024-05-30T16:54:31.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.407+0000 7f83d3000640 1 -- start start 2024-05-30T16:54:31.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83d3000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83cc15b5f0 0x7f83cc0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:31.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83d3000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f83cc06fc20 0x7f83cc0cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:31.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83d3000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83cc0c74d0 con 0x7f83cc0c7f70 2024-05-30T16:54:31.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83d3000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f83cc0c7d30 con 0x7f83cc15b5f0 2024-05-30T16:54:31.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83d3000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f83cc0cec00 con 0x7f83cc06fc20 2024-05-30T16:54:31.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83d1000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f83cc06fc20 0x7f83cc0cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:31.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83d1000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f83cc06fc20 0x7f83cc0cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:35052/0 (socket says 172.21.15.59:35052) 2024-05-30T16:54:31.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83d1000640 1 -- 172.21.15.59:0/1712173736 learned_addr learned my addr 172.21.15.59:0/1712173736 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:31.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83cbe00640 1 --2- 172.21.15.59:0/1712173736 >> v2:172.21.15.59:3300/0 conn(0x7f83cc15b5f0 0x7f83cc0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:31.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83cbe00640 1 -- 172.21.15.59:0/1712173736 >> v2:172.21.15.107:3300/0 conn(0x7f83cc06fc20 msgr2=0x7f83cc0cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:31.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83cbe00640 1 --2- 172.21.15.59:0/1712173736 >> v2:172.21.15.107:3300/0 conn(0x7f83cc06fc20 0x7f83cc0cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83cbe00640 1 -- 172.21.15.59:0/1712173736 >> v1:172.21.15.107:6789/0 conn(0x7f83cc0c7f70 legacy=0x7f83cc06f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:31.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.411+0000 7f83cbe00640 1 -- 172.21.15.59:0/1712173736 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc0c7770 con 0x7f83cc15b5f0 2024-05-30T16:54:31.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.415+0000 7f83cbe00640 1 --2- 172.21.15.59:0/1712173736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83cc15b5f0 0x7f83cc0ce600 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0d1340 tx=0x7f83bc020c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa006902f9deb671 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:31.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.415+0000 7f83caa00640 1 -- 172.21.15.59:0/1712173736 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0b6070 con 0x7f83cc15b5f0 2024-05-30T16:54:31.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.419+0000 7f83caa00640 1 -- 172.21.15.59:0/1712173736 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc0a9d50 con 0x7f83cc15b5f0 2024-05-30T16:54:31.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.419+0000 7f83caa00640 1 -- 172.21.15.59:0/1712173736 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0b1660 con 0x7f83cc15b5f0 2024-05-30T16:54:31.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.419+0000 7f83d3000640 1 -- 172.21.15.59:0/1712173736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83cc15b5f0 msgr2=0x7f83cc0ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:31.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.419+0000 7f83d3000640 1 --2- 172.21.15.59:0/1712173736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83cc15b5f0 0x7f83cc0ce600 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0d1340 tx=0x7f83bc020c80 comp rx=0 tx=0).stop 2024-05-30T16:54:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.419+0000 7f83d3000640 1 -- 172.21.15.59:0/1712173736 shutdown_connections 2024-05-30T16:54:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.419+0000 7f83d3000640 1 --2- 172.21.15.59:0/1712173736 >> v2:172.21.15.107:3300/0 conn(0x7f83cc06fc20 0x7f83cc0cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.419+0000 7f83d3000640 1 --2- 172.21.15.59:0/1712173736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83cc15b5f0 0x7f83cc0ce600 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.419+0000 7f83d3000640 1 -- 172.21.15.59:0/1712173736 >> 172.21.15.59:0/1712173736 conn(0x7f83cc0b2fc0 msgr2=0x7f83cc0b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.419+0000 7f83d3000640 1 -- 172.21.15.59:0/1712173736 shutdown_connections 2024-05-30T16:54:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.419+0000 7f83d3000640 1 -- 172.21.15.59:0/1712173736 wait complete. 2024-05-30T16:54:31.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.423+0000 7f83d3000640 1 Processor -- start 2024-05-30T16:54:31.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.423+0000 7f83d3000640 1 -- start start 2024-05-30T16:54:31.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.423+0000 7f83d3000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83cc06fc20 0x7f83cc14b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:31.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.423+0000 7f83d3000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83cc0c7f70 0x7f83cc0b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:31.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.423+0000 7f83d3000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83cc15b5f0 0x7f83cc0b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:31.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.423+0000 7f83d3000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc0d0950 con 0x7f83cc06fc20 2024-05-30T16:54:31.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.423+0000 7f83d3000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc0d07d0 con 0x7f83cc0c7f70 2024-05-30T16:54:31.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.423+0000 7f83d3000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f83cc0d0ad0 con 0x7f83cc15b5f0 2024-05-30T16:54:31.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.423+0000 7f83d1000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83cc15b5f0 0x7f83cc0b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:31.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.427+0000 7f83cb400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83cc0c7f70 0x7f83cc0b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:31.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.427+0000 7f83d1000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83cc15b5f0 0x7f83cc0b0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:53888/0 (socket says 172.21.15.59:53888) 2024-05-30T16:54:31.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.427+0000 7f83d1000640 1 -- 172.21.15.59:0/1644168267 learned_addr learned my addr 172.21.15.59:0/1644168267 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:31.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.427+0000 7f83cbe00640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83cc06fc20 0x7f83cc14b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.431+0000 7f83d1000640 1 -- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83cc0c7f70 msgr2=0x7f83cc0b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.431+0000 7f83d1000640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83cc0c7f70 0x7f83cc0b0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.431+0000 7f83d1000640 1 -- 172.21.15.59:0/1644168267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83cc06fc20 msgr2=0x7f83cc14b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.431+0000 7f83d1000640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83cc06fc20 0x7f83cc14b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.431+0000 7f83d1000640 1 -- 172.21.15.59:0/1644168267 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc14f1a0 con 0x7f83cc15b5f0 2024-05-30T16:54:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.431+0000 7f83d1000640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83cc15b5f0 0x7f83cc0b0f70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f83c4007a90 tx=0x7f83c4007f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.431+0000 7f83c3e00640 1 -- 172.21.15.59:0/1644168267 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c400dd00 con 0x7f83cc15b5f0 2024-05-30T16:54:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.431+0000 7f83d3000640 1 -- 172.21.15.59:0/1644168267 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83cc14f480 con 0x7f83cc15b5f0 2024-05-30T16:54:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.431+0000 7f83d3000640 1 -- 172.21.15.59:0/1644168267 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f83cc14fa40 con 0x7f83cc15b5f0 2024-05-30T16:54:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.431+0000 7f83c3e00640 1 -- 172.21.15.59:0/1644168267 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c40039a0 con 0x7f83cc15b5f0 2024-05-30T16:54:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.431+0000 7f83c3e00640 1 -- 172.21.15.59:0/1644168267 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c4003d90 con 0x7f83cc15b5f0 2024-05-30T16:54:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.431+0000 7f83d3000640 1 -- 172.21.15.59:0/1644168267 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a40052a0 con 0x7f83cc15b5f0 2024-05-30T16:54:31.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.435+0000 7f83c3e00640 1 -- 172.21.15.59:0/1644168267 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f83c401c020 con 0x7f83cc15b5f0 2024-05-30T16:54:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.435+0000 7f83c3e00640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f83ac068b60 0x7f83ac06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.435+0000 7f83c3e00640 1 -- 172.21.15.59:0/1644168267 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f83c4087a40 con 0x7f83cc15b5f0 2024-05-30T16:54:31.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.435+0000 7f83cbe00640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f83ac068b60 0x7f83ac06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:31.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.439+0000 7f83cbe00640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f83ac068b60 0x7f83ac06b020 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0b3000 tx=0x7f83bc0ab070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:31.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.447+0000 7f83c3e00640 1 -- 172.21.15.59:0/1644168267 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f83c4010070 con 0x7f83cc15b5f0 2024-05-30T16:54:31.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.827+0000 7f83d3000640 1 -- 172.21.15.59:0/1644168267 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83a4005860 con 0x7f83cc15b5f0 2024-05-30T16:54:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.827+0000 7f83c3e00640 1 -- 172.21.15.59:0/1644168267 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5187 (secure 0 0 0) 0x7f83c4056820 con 0x7f83cc15b5f0 2024-05-30T16:54:31.831 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:31.831 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4919,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2045783783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2045783783},{"type":"v1","addr":"172.21.15.107:6836","nonce":2045783783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4922,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3405430037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3405430037},{"type":"v1","addr":"172.21.15.107:6837","nonce":3405430037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3338903229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3338903229},{"type":"v1","addr":"172.21.15.59:6834","nonce":3338903229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:52:12.149964+0000","modified":"2024-05-30T16:52:15.176696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3019371755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3019371755},{"type":"v1","addr":"172.21.15.59:6835","nonce":3019371755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-05-30T16:54:31.832 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 26 2024-05-30T16:54:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.831+0000 7f83d3000640 1 -- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f83ac068b60 msgr2=0x7f83ac06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.831+0000 7f83d3000640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f83ac068b60 0x7f83ac06b020 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0b3000 tx=0x7f83bc0ab070 comp rx=0 tx=0).stop 2024-05-30T16:54:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.831+0000 7f83d3000640 1 -- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83cc15b5f0 msgr2=0x7f83cc0b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.831+0000 7f83d3000640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83cc15b5f0 0x7f83cc0b0f70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f83c4007a90 tx=0x7f83c4007f50 comp rx=0 tx=0).stop 2024-05-30T16:54:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.831+0000 7f83d3000640 1 -- 172.21.15.59:0/1644168267 shutdown_connections 2024-05-30T16:54:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.831+0000 7f83d3000640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f83ac068b60 0x7f83ac06b020 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.831+0000 7f83d3000640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83cc15b5f0 0x7f83cc0b0f70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.831+0000 7f83d3000640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83cc0c7f70 0x7f83cc0b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.831+0000 7f83d3000640 1 --2- 172.21.15.59:0/1644168267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83cc06fc20 0x7f83cc14b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.831+0000 7f83d3000640 1 -- 172.21.15.59:0/1644168267 >> 172.21.15.59:0/1644168267 conn(0x7f83cc0b2fc0 msgr2=0x7f83cc153e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:31.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.835+0000 7f83d3000640 1 -- 172.21.15.59:0/1644168267 shutdown_connections 2024-05-30T16:54:31.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:31.835+0000 7f83d3000640 1 -- 172.21.15.59:0/1644168267 wait complete. 2024-05-30T16:54:31.870 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:54:32.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.099+0000 7fe116c00640 1 Processor -- start 2024-05-30T16:54:32.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.099+0000 7fe116c00640 1 -- start start 2024-05-30T16:54:32.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe116c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1100c6f50 0x7fe11006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe116c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe11015ec40 con 0x7fe11015e860 2024-05-30T16:54:32.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe116c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1100c8200 con 0x7fe1100d0e80 2024-05-30T16:54:32.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe116c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe1100cf650 con 0x7fe1100c6f50 2024-05-30T16:54:32.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe11015e860 0x7fe1100cef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58658/0 (socket says 172.21.15.59:58658) 2024-05-30T16:54:32.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10fe00640 1 -- 172.21.15.59:0/2998933513 learned_addr learned my addr 172.21.15.59:0/2998933513 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:32.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10f400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe1100d0e80 0x7fe1100c6840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:38018/0 (socket says 172.21.15.59:38018) 2024-05-30T16:54:32.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe114c00640 1 --2- 172.21.15.59:0/2998933513 >> v2:172.21.15.59:3300/0 conn(0x7fe1100c6f50 0x7fe11006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680009850 0 0) 0x7fe11015ec40 con 0x7fe11015e860 2024-05-30T16:54:32.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0f4003530 con 0x7fe11015e860 2024-05-30T16:54:32.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 216787771 0 0) 0x7fe1100c8200 con 0x7fe1100d0e80 2024-05-30T16:54:32.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe11015ec40 con 0x7fe1100d0e80 2024-05-30T16:54:32.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3230810547 0 0) 0x7fe11015ec40 con 0x7fe1100d0e80 2024-05-30T16:54:32.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 >> v2:172.21.15.59:3300/0 conn(0x7fe1100c6f50 msgr2=0x7fe11006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:32.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 --2- 172.21.15.59:0/2998933513 >> v2:172.21.15.59:3300/0 conn(0x7fe1100c6f50 0x7fe11006b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 >> v1:172.21.15.59:6789/0 conn(0x7fe11015e860 legacy=0x7fe1100cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:32.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1100c7960 con 0x7fe1100d0e80 2024-05-30T16:54:32.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fe0fc001680 con 0x7fe1100d0e80 2024-05-30T16:54:32.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 >> v1:172.21.15.107:6789/0 conn(0x7fe1100d0e80 legacy=0x7fe1100c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:32.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 --2- 172.21.15.59:0/2998933513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0f4003b50 0x7fe0f4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 --2- 172.21.15.59:0/2998933513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0f4004810 0x7fe0f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 --2- 172.21.15.59:0/2998933513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0f4005220 0x7fe0f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe1100cf650 con 0x7fe0f4004810 2024-05-30T16:54:32.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f400c150 con 0x7fe0f4003b50 2024-05-30T16:54:32.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f400c350 con 0x7fe0f4005220 2024-05-30T16:54:32.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe10fe00640 1 --2- 172.21.15.59:0/2998933513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0f4003b50 0x7fe0f4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.103+0000 7fe114c00640 1 --2- 172.21.15.59:0/2998933513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0f4005220 0x7fe0f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.107+0000 7fe114c00640 1 -- 172.21.15.59:0/2998933513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0f4003b50 msgr2=0x7fe0f4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:32.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.107+0000 7fe114c00640 1 --2- 172.21.15.59:0/2998933513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0f4003b50 0x7fe0f4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.107+0000 7fe114c00640 1 -- 172.21.15.59:0/2998933513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0f4004810 msgr2=0x7fe0f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:32.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.107+0000 7fe114c00640 1 --2- 172.21.15.59:0/2998933513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0f4004810 0x7fe0f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.107+0000 7fe114c00640 1 -- 172.21.15.59:0/2998933513 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1100c8200 con 0x7fe0f4005220 2024-05-30T16:54:32.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.111+0000 7fe114c00640 1 -- 172.21.15.59:0/2998933513 reap_dead start 2024-05-30T16:54:32.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.111+0000 7fe114c00640 1 --2- 172.21.15.59:0/2998933513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0f4005220 0x7fe0f400b9d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe108009fc0 tx=0x7fe10801ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c65ef254ed76e78a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:32.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.111+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108009c10 con 0x7fe0f4005220 2024-05-30T16:54:32.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.111+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe108003be0 con 0x7fe0f4005220 2024-05-30T16:54:32.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.111+0000 7fe10ea00640 1 -- 172.21.15.59:0/2998933513 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1080a58b0 con 0x7fe0f4005220 2024-05-30T16:54:32.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.111+0000 7fe116c00640 1 -- 172.21.15.59:0/2998933513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0f4005220 msgr2=0x7fe0f400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:32.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.111+0000 7fe116c00640 1 --2- 172.21.15.59:0/2998933513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0f4005220 0x7fe0f400b9d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe108009fc0 tx=0x7fe10801ccc0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.111+0000 7fe116c00640 1 -- 172.21.15.59:0/2998933513 shutdown_connections 2024-05-30T16:54:32.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.111+0000 7fe116c00640 1 --2- 172.21.15.59:0/2998933513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0f4005220 0x7fe0f400b9d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.111+0000 7fe116c00640 1 -- 172.21.15.59:0/2998933513 >> 172.21.15.59:0/2998933513 conn(0x7fe1100b2fc0 msgr2=0x7fe1100b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:32.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.111+0000 7fe116c00640 1 -- 172.21.15.59:0/2998933513 shutdown_connections 2024-05-30T16:54:32.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.111+0000 7fe116c00640 1 -- 172.21.15.59:0/2998933513 wait complete. 2024-05-30T16:54:32.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.115+0000 7fe116c00640 1 Processor -- start 2024-05-30T16:54:32.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.115+0000 7fe116c00640 1 -- start start 2024-05-30T16:54:32.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe116c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0f4005220 0x7fe110158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe116c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe11015aea0 0x7fe11015cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe116c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe11015d2a0 0x7fe110168690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe116c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe11006b9b0 con 0x7fe0f4005220 2024-05-30T16:54:32.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe116c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe1100b3dd0 con 0x7fe11015d2a0 2024-05-30T16:54:32.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe116c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe11006bb30 con 0x7fe11015aea0 2024-05-30T16:54:32.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe10f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe11015aea0 0x7fe11015cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe10f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe11015aea0 0x7fe11015cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:45098/0 (socket says 172.21.15.59:45098) 2024-05-30T16:54:32.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe10f400640 1 -- 172.21.15.59:0/568189817 learned_addr learned my addr 172.21.15.59:0/568189817 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:32.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe114c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe11015d2a0 0x7fe110168690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe10fe00640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0f4005220 0x7fe110158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe10f400640 1 -- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe11015d2a0 msgr2=0x7fe110168690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:32.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe10f400640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe11015d2a0 0x7fe110168690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe10f400640 1 -- 172.21.15.59:0/568189817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0f4005220 msgr2=0x7fe110158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:32.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe10f400640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0f4005220 0x7fe110158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe10f400640 1 -- 172.21.15.59:0/568189817 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11015bbf0 con 0x7fe11015aea0 2024-05-30T16:54:32.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe10f400640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe11015aea0 0x7fe11015cd60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc000f70 tx=0x7fe0fc00cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:32.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe107e00640 1 -- 172.21.15.59:0/568189817 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc018070 con 0x7fe11015aea0 2024-05-30T16:54:32.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe107e00640 1 -- 172.21.15.59:0/568189817 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0fc0074e0 con 0x7fe11015aea0 2024-05-30T16:54:32.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.119+0000 7fe107e00640 1 -- 172.21.15.59:0/568189817 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc004a30 con 0x7fe11015aea0 2024-05-30T16:54:32.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.123+0000 7fe116c00640 1 -- 172.21.15.59:0/568189817 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe11015b630 con 0x7fe11015aea0 2024-05-30T16:54:32.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.123+0000 7fe116c00640 1 -- 172.21.15.59:0/568189817 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe110151960 con 0x7fe11015aea0 2024-05-30T16:54:32.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.123+0000 7fe116c00640 1 -- 172.21.15.59:0/568189817 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe110068a90 con 0x7fe11015aea0 2024-05-30T16:54:32.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.127+0000 7fe107e00640 1 -- 172.21.15.59:0/568189817 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fe0fc01b070 con 0x7fe11015aea0 2024-05-30T16:54:32.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.127+0000 7fe107e00640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe0f0068bb0 0x7fe0f006b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.127+0000 7fe107e00640 1 -- 172.21.15.59:0/568189817 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7fe0fc087700 con 0x7fe11015aea0 2024-05-30T16:54:32.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.127+0000 7fe10fe00640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe0f0068bb0 0x7fe0f006b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.131+0000 7fe10fe00640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe0f0068bb0 0x7fe0f006b070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe100004c30 tx=0x7fe100009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:32.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.131+0000 7fe107e00640 1 -- 172.21.15.59:0/568189817 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe0fc056670 con 0x7fe11015aea0 2024-05-30T16:54:32.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.427+0000 7fe116c00640 1 -- 172.21.15.59:0/568189817 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe110157df0 con 0x7fe11015aea0 2024-05-30T16:54:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.431+0000 7fe107e00640 1 -- 172.21.15.59:0/568189817 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16736 (secure 0 0 0) 0x7fe0fc05a970 con 0x7fe11015aea0 2024-05-30T16:54:32.434 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:32.434 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":49,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:52:46.890179+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:52:09.850441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T16:52:11.108687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":5}]},{"pgid":"7.18","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:54:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.435+0000 7fe116c00640 1 -- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe0f0068bb0 msgr2=0x7fe0f006b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.435+0000 7fe116c00640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe0f0068bb0 0x7fe0f006b070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe100004c30 tx=0x7fe100009040 comp rx=0 tx=0).stop 2024-05-30T16:54:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.435+0000 7fe116c00640 1 -- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe11015aea0 msgr2=0x7fe11015cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.435+0000 7fe116c00640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe11015aea0 0x7fe11015cd60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc000f70 tx=0x7fe0fc00cc20 comp rx=0 tx=0).stop 2024-05-30T16:54:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.435+0000 7fe116c00640 1 -- 172.21.15.59:0/568189817 shutdown_connections 2024-05-30T16:54:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.435+0000 7fe116c00640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe0f0068bb0 0x7fe0f006b070 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.435+0000 7fe116c00640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe11015d2a0 0x7fe110168690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.435+0000 7fe116c00640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe11015aea0 0x7fe11015cd60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.435+0000 7fe116c00640 1 --2- 172.21.15.59:0/568189817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0f4005220 0x7fe110158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.435+0000 7fe116c00640 1 -- 172.21.15.59:0/568189817 >> 172.21.15.59:0/568189817 conn(0x7fe1100b2fc0 msgr2=0x7fe1101572d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:32.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.435+0000 7fe116c00640 1 -- 172.21.15.59:0/568189817 shutdown_connections 2024-05-30T16:54:32.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.435+0000 7fe116c00640 1 -- 172.21.15.59:0/568189817 wait complete. 2024-05-30T16:54:32.472 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T16:54:32.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:54:32.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.691+0000 7ff170400640 1 Processor -- start 2024-05-30T16:54:32.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.691+0000 7ff170400640 1 -- start start 2024-05-30T16:54:32.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.691+0000 7ff170400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff168163b80 0x7ff1680721c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.691+0000 7ff170400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff16806e1e0 con 0x7ff16806dd30 2024-05-30T16:54:32.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.691+0000 7ff170400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff16815d4e0 con 0x7ff1680d0470 2024-05-30T16:54:32.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.691+0000 7ff170400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff16806ea20 con 0x7ff168163b80 2024-05-30T16:54:32.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff16d000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff16806dd30 0x7ff1680b3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58672/0 (socket says 172.21.15.59:58672) 2024-05-30T16:54:32.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff16d000640 1 -- 172.21.15.59:0/48671244 learned_addr learned my addr 172.21.15.59:0/48671244 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:32.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911172934 0 0) 0x7ff16815d4e0 con 0x7ff1680d0470 2024-05-30T16:54:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff16e400640 1 --2- 172.21.15.59:0/48671244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff168163b80 0x7ff1680721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff150003530 con 0x7ff1680d0470 2024-05-30T16:54:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2734436767 0 0) 0x7ff154001120 con 0x7ff16806dd30 2024-05-30T16:54:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff16815d4e0 con 0x7ff16806dd30 2024-05-30T16:54:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2588509803 0 0) 0x7ff16815d4e0 con 0x7ff16806dd30 2024-05-30T16:54:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff168163b80 msgr2=0x7ff1680721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 --2- 172.21.15.59:0/48671244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff168163b80 0x7ff1680721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 >> v1:172.21.15.107:6789/0 conn(0x7ff1680d0470 legacy=0x7ff1680d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:32.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16806e460 con 0x7ff16806dd30 2024-05-30T16:54:32.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7ff154001870 con 0x7ff16806dd30 2024-05-30T16:54:32.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 >> v1:172.21.15.59:6789/0 conn(0x7ff16806dd30 legacy=0x7ff1680b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:32.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 --2- 172.21.15.59:0/48671244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150004c30 0x7ff150005030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 --2- 172.21.15.59:0/48671244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1500037b0 0x7ff150003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 --2- 172.21.15.59:0/48671244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff150004270 0x7ff15000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff16806ea20 con 0x7ff150004c30 2024-05-30T16:54:32.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff15000c1a0 con 0x7ff1500037b0 2024-05-30T16:54:32.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff15000c3a0 con 0x7ff150004270 2024-05-30T16:54:32.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff16d000640 1 --2- 172.21.15.59:0/48671244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1500037b0 0x7ff150003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff16da00640 1 --2- 172.21.15.59:0/48671244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150004c30 0x7ff150005030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff16d000640 1 -- 172.21.15.59:0/48671244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff150004270 msgr2=0x7ff15000b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:54:32.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff16d000640 1 --2- 172.21.15.59:0/48671244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff150004270 0x7ff15000b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff16d000640 1 -- 172.21.15.59:0/48671244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150004c30 msgr2=0x7ff150005030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:32.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff16d000640 1 --2- 172.21.15.59:0/48671244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150004c30 0x7ff150005030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff16d000640 1 -- 172.21.15.59:0/48671244 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16815d4e0 con 0x7ff1500037b0 2024-05-30T16:54:32.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.695+0000 7ff16da00640 1 --2- 172.21.15.59:0/48671244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150004c30 0x7ff150005030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:32.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.699+0000 7ff16d000640 1 --2- 172.21.15.59:0/48671244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1500037b0 0x7ff150003c30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff15400c2f0 tx=0x7ff15401caf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f2c5490124b882 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.699+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff154007df0 con 0x7ff1500037b0 2024-05-30T16:54:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.699+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1540a9070 con 0x7ff1500037b0 2024-05-30T16:54:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.703+0000 7ff167e00640 1 -- 172.21.15.59:0/48671244 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff154005d40 con 0x7ff1500037b0 2024-05-30T16:54:32.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.703+0000 7ff170400640 1 -- 172.21.15.59:0/48671244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1500037b0 msgr2=0x7ff150003c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:32.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.703+0000 7ff170400640 1 --2- 172.21.15.59:0/48671244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1500037b0 0x7ff150003c30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff15400c2f0 tx=0x7ff15401caf0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.703+0000 7ff16e400640 1 -- 172.21.15.59:0/48671244 reap_dead start 2024-05-30T16:54:32.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.703+0000 7ff170400640 1 -- 172.21.15.59:0/48671244 shutdown_connections 2024-05-30T16:54:32.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.703+0000 7ff170400640 1 -- 172.21.15.59:0/48671244 >> 172.21.15.59:0/48671244 conn(0x7ff1680b22d0 msgr2=0x7ff1680b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.703+0000 7ff170400640 1 -- 172.21.15.59:0/48671244 shutdown_connections 2024-05-30T16:54:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.703+0000 7ff170400640 1 -- 172.21.15.59:0/48671244 wait complete. 2024-05-30T16:54:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff170400640 1 Processor -- start 2024-05-30T16:54:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff170400640 1 -- start start 2024-05-30T16:54:32.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff170400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1500037b0 0x7ff168156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff170400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1680afe40 0x7ff1680b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff170400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1680b07e0 0x7ff1680ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff170400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff1680729d0 con 0x7ff1500037b0 2024-05-30T16:54:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff170400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff168163f60 con 0x7ff1680b07e0 2024-05-30T16:54:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff170400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff168072b50 con 0x7ff1680afe40 2024-05-30T16:54:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff16da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1500037b0 0x7ff168156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff16da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1500037b0 0x7ff168156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54606/0 (socket says 172.21.15.59:54606) 2024-05-30T16:54:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff16da00640 1 -- 172.21.15.59:0/2681450643 learned_addr learned my addr 172.21.15.59:0/2681450643 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff16e400640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1680b07e0 0x7ff1680ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff16da00640 1 -- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1680afe40 msgr2=0x7ff1680b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff16d000640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1680afe40 0x7ff1680b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff16da00640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1680afe40 0x7ff1680b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff16da00640 1 -- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1680b07e0 msgr2=0x7ff1680ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:32.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff16da00640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1680b07e0 0x7ff1680ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:32.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff16da00640 1 -- 172.21.15.59:0/2681450643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1681558a0 con 0x7ff1500037b0 2024-05-30T16:54:32.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.707+0000 7ff16d000640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1680afe40 0x7ff1680b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:32.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.711+0000 7ff16da00640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1500037b0 0x7ff168156940 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff16000eaf0 tx=0x7ff16000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:32.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.711+0000 7ff165600640 1 -- 172.21.15.59:0/2681450643 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160003b90 con 0x7ff1500037b0 2024-05-30T16:54:32.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.711+0000 7ff170400640 1 -- 172.21.15.59:0/2681450643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff168155b80 con 0x7ff1500037b0 2024-05-30T16:54:32.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.711+0000 7ff165600640 1 -- 172.21.15.59:0/2681450643 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff160018070 con 0x7ff1500037b0 2024-05-30T16:54:32.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.711+0000 7ff165600640 1 -- 172.21.15.59:0/2681450643 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1600050d0 con 0x7ff1500037b0 2024-05-30T16:54:32.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.711+0000 7ff170400640 1 -- 172.21.15.59:0/2681450643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff168156140 con 0x7ff1500037b0 2024-05-30T16:54:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.711+0000 7ff170400640 1 -- 172.21.15.59:0/2681450643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1440052a0 con 0x7ff1500037b0 2024-05-30T16:54:32.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.715+0000 7ff165600640 1 -- 172.21.15.59:0/2681450643 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7ff160005270 con 0x7ff1500037b0 2024-05-30T16:54:32.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.715+0000 7ff165600640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff148068b90 0x7ff14806b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:32.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.715+0000 7ff165600640 1 -- 172.21.15.59:0/2681450643 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7ff160087950 con 0x7ff1500037b0 2024-05-30T16:54:32.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.715+0000 7ff16d000640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff148068b90 0x7ff14806b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:32.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.719+0000 7ff16d000640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff148068b90 0x7ff14806b050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff1540ab000 tx=0x7ff1540a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:32.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:32.723+0000 7ff165600640 1 -- 172.21.15.59:0/2681450643 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff1600112e0 con 0x7ff1500037b0 2024-05-30T16:54:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.083+0000 7ff170400640 1 -- 172.21.15.59:0/2681450643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff144005860 con 0x7ff1500037b0 2024-05-30T16:54:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff165600640 1 -- 172.21.15.59:0/2681450643 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5187 (secure 0 0 0) 0x7ff160056e00 con 0x7ff1500037b0 2024-05-30T16:54:33.089 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:33.089 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4919,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2045783783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2045783783},{"type":"v1","addr":"172.21.15.107:6836","nonce":2045783783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4922,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3405430037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3405430037},{"type":"v1","addr":"172.21.15.107:6837","nonce":3405430037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3338903229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3338903229},{"type":"v1","addr":"172.21.15.59:6834","nonce":3338903229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:52:12.149964+0000","modified":"2024-05-30T16:52:15.176696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3019371755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3019371755},{"type":"v1","addr":"172.21.15.59:6835","nonce":3019371755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-05-30T16:54:33.089 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 26 2024-05-30T16:54:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff170400640 1 -- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff148068b90 msgr2=0x7ff14806b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff170400640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff148068b90 0x7ff14806b050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff1540ab000 tx=0x7ff1540a7070 comp rx=0 tx=0).stop 2024-05-30T16:54:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff170400640 1 -- 172.21.15.59:0/2681450643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1500037b0 msgr2=0x7ff168156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff170400640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1500037b0 0x7ff168156940 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff16000eaf0 tx=0x7ff16000eef0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff170400640 1 -- 172.21.15.59:0/2681450643 shutdown_connections 2024-05-30T16:54:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff170400640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff148068b90 0x7ff14806b050 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff170400640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1680b07e0 0x7ff1680ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff170400640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1680afe40 0x7ff1680b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff170400640 1 --2- 172.21.15.59:0/2681450643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1500037b0 0x7ff168156940 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff170400640 1 -- 172.21.15.59:0/2681450643 >> 172.21.15.59:0/2681450643 conn(0x7ff1680b22d0 msgr2=0x7ff168160c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:33.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff170400640 1 -- 172.21.15.59:0/2681450643 shutdown_connections 2024-05-30T16:54:33.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.087+0000 7ff170400640 1 -- 172.21.15.59:0/2681450643 wait complete. 2024-05-30T16:54:33.111 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:54:33.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.251+0000 7f8347600640 1 Processor -- start 2024-05-30T16:54:33.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.251+0000 7f8347600640 1 -- start start 2024-05-30T16:54:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f8347600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83400af720 0x7f834015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f8347600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f83400d0560 0x7f83400d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f8347600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f834015f060 con 0x7f834006e900 2024-05-30T16:54:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f8347600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f83400afb00 con 0x7f83400d0560 2024-05-30T16:54:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f8347600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f834015c270 con 0x7f83400af720 2024-05-30T16:54:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f833fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f834006e900 0x7f834015f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58688/0 (socket says 172.21.15.59:58688) 2024-05-30T16:54:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f833fe00640 1 -- 172.21.15.59:0/663155406 learned_addr learned my addr 172.21.15.59:0/663155406 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f8344c00640 1 --2- 172.21.15.59:0/663155406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83400af720 0x7f834015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f8345600640 1 --2- 172.21.15.59:0/663155406 >> v2:172.21.15.107:3300/0 conn(0x7f83400d0560 0x7f83400d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f833f400640 1 -- 172.21.15.59:0/663155406 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 777186940 0 0) 0x7f834015f060 con 0x7f834006e900 2024-05-30T16:54:33.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f833f400640 1 -- 172.21.15.59:0/663155406 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8328003530 con 0x7f834006e900 2024-05-30T16:54:33.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f8344c00640 1 -- 172.21.15.59:0/663155406 >> v2:172.21.15.107:3300/0 conn(0x7f83400d0560 msgr2=0x7f83400d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:33.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f8344c00640 1 --2- 172.21.15.59:0/663155406 >> v2:172.21.15.107:3300/0 conn(0x7f83400d0560 0x7f83400d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f8344c00640 1 -- 172.21.15.59:0/663155406 >> v1:172.21.15.59:6789/0 conn(0x7f834006e900 legacy=0x7f834015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f8344c00640 1 -- 172.21.15.59:0/663155406 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834015ff00 con 0x7f83400af720 2024-05-30T16:54:33.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.255+0000 7f8345600640 1 --2- 172.21.15.59:0/663155406 >> v2:172.21.15.107:3300/0 conn(0x7f83400d0560 0x7f83400d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:54:33.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f8344c00640 1 --2- 172.21.15.59:0/663155406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83400af720 0x7f834015b9d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f83340097c0 tx=0x7f833401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ebc6643eae329e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:33.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f833f400640 1 -- 172.21.15.59:0/663155406 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83340b2070 con 0x7f83400af720 2024-05-30T16:54:33.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f833f400640 1 -- 172.21.15.59:0/663155406 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83340ad640 con 0x7f83400af720 2024-05-30T16:54:33.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f833f400640 1 -- 172.21.15.59:0/663155406 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83340ada10 con 0x7f83400af720 2024-05-30T16:54:33.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f8347600640 1 -- 172.21.15.59:0/663155406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83400af720 msgr2=0x7f834015b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f8347600640 1 --2- 172.21.15.59:0/663155406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83400af720 0x7f834015b9d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f83340097c0 tx=0x7f833401c4a0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f8347600640 1 -- 172.21.15.59:0/663155406 shutdown_connections 2024-05-30T16:54:33.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f8347600640 1 --2- 172.21.15.59:0/663155406 >> v2:172.21.15.107:3300/0 conn(0x7f83400d0560 0x7f83400d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f8347600640 1 --2- 172.21.15.59:0/663155406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83400af720 0x7f834015b9d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f8347600640 1 -- 172.21.15.59:0/663155406 >> 172.21.15.59:0/663155406 conn(0x7f83400b22d0 msgr2=0x7f83400b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:33.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f8347600640 1 -- 172.21.15.59:0/663155406 shutdown_connections 2024-05-30T16:54:33.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f8347600640 1 -- 172.21.15.59:0/663155406 wait complete. 2024-05-30T16:54:33.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f8347600640 1 Processor -- start 2024-05-30T16:54:33.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.259+0000 7f8347600640 1 -- start start 2024-05-30T16:54:33.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f8347600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f834006e900 0x7f834014b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f8347600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83400af720 0x7f834009c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f8347600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83400d0560 0x7f834009cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f8347600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8340073150 con 0x7f83400af720 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f8347600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f834015c830 con 0x7f834006e900 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f8347600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f83400732d0 con 0x7f83400d0560 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83400af720 0x7f834009c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83400af720 0x7f834009c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54620/0 (socket says 172.21.15.59:54620) 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833fe00640 1 -- 172.21.15.59:0/4041410127 learned_addr learned my addr 172.21.15.59:0/4041410127 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f8344c00640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f834006e900 0x7f834014b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833fe00640 1 -- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83400d0560 msgr2=0x7f834009cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833fe00640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83400d0560 0x7f834009cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833fe00640 1 -- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f834006e900 msgr2=0x7f834014b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833fe00640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f834006e900 0x7f834014b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833fe00640 1 -- 172.21.15.59:0/4041410127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8340166730 con 0x7f83400af720 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f8344c00640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f834006e900 0x7f834014b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:33.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833fe00640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83400af720 0x7f834009c640 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f832c00c310 tx=0x7f832c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:33.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833cc00640 1 -- 172.21.15.59:0/4041410127 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c017070 con 0x7f83400af720 2024-05-30T16:54:33.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833cc00640 1 -- 172.21.15.59:0/4041410127 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832c005d10 con 0x7f83400af720 2024-05-30T16:54:33.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f8347600640 1 -- 172.21.15.59:0/4041410127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8340166a10 con 0x7f83400af720 2024-05-30T16:54:33.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833cc00640 1 -- 172.21.15.59:0/4041410127 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c007310 con 0x7f83400af720 2024-05-30T16:54:33.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f8347600640 1 -- 172.21.15.59:0/4041410127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83401651d0 con 0x7f83400af720 2024-05-30T16:54:33.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f8347600640 1 -- 172.21.15.59:0/4041410127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8340068a90 con 0x7f83400af720 2024-05-30T16:54:33.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.263+0000 7f833cc00640 1 -- 172.21.15.59:0/4041410127 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f832c01a070 con 0x7f83400af720 2024-05-30T16:54:33.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.267+0000 7f833cc00640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8320068b60 0x7f832006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.267+0000 7f833cc00640 1 -- 172.21.15.59:0/4041410127 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5851+0+0 (secure 0 0 0) 0x7f832c087090 con 0x7f83400af720 2024-05-30T16:54:33.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.267+0000 7f8344c00640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8320068b60 0x7f832006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.267+0000 7f8344c00640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8320068b60 0x7f832006b020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f83340af000 tx=0x7f8334008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:33.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.271+0000 7f833cc00640 1 -- 172.21.15.59:0/4041410127 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f832c056660 con 0x7f83400af720 2024-05-30T16:54:33.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.471+0000 7f8347600640 1 -- 172.21.15.59:0/4041410127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f834015eaf0 con 0x7f83400af720 2024-05-30T16:54:33.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.471+0000 7f833cc00640 1 -- 172.21.15.59:0/4041410127 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5187 (secure 0 0 0) 0x7f832c055f60 con 0x7f83400af720 2024-05-30T16:54:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:33.476 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4919,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2045783783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2045783783},{"type":"v1","addr":"172.21.15.107:6836","nonce":2045783783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4922,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3405430037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3405430037},{"type":"v1","addr":"172.21.15.107:6837","nonce":3405430037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3338903229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3338903229},{"type":"v1","addr":"172.21.15.59:6834","nonce":3338903229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:52:12.149964+0000","modified":"2024-05-30T16:52:15.176696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3019371755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3019371755},{"type":"v1","addr":"172.21.15.59:6835","nonce":3019371755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-05-30T16:54:33.476 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 26 2024-05-30T16:54:33.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.475+0000 7f8347600640 1 -- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8320068b60 msgr2=0x7f832006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.475+0000 7f8347600640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8320068b60 0x7f832006b020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f83340af000 tx=0x7f8334008040 comp rx=0 tx=0).stop 2024-05-30T16:54:33.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.475+0000 7f8347600640 1 -- 172.21.15.59:0/4041410127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83400af720 msgr2=0x7f834009c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.475+0000 7f8347600640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83400af720 0x7f834009c640 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f832c00c310 tx=0x7f832c00c7d0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.475+0000 7f8347600640 1 -- 172.21.15.59:0/4041410127 shutdown_connections 2024-05-30T16:54:33.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.475+0000 7f8347600640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8320068b60 0x7f832006b020 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.475+0000 7f8347600640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83400d0560 0x7f834009cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.475+0000 7f8347600640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83400af720 0x7f834009c640 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.475+0000 7f8347600640 1 --2- 172.21.15.59:0/4041410127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f834006e900 0x7f834014b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.475+0000 7f8347600640 1 -- 172.21.15.59:0/4041410127 >> 172.21.15.59:0/4041410127 conn(0x7f83400b22d0 msgr2=0x7f834015b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:33.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.475+0000 7f8347600640 1 -- 172.21.15.59:0/4041410127 shutdown_connections 2024-05-30T16:54:33.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.475+0000 7f8347600640 1 -- 172.21.15.59:0/4041410127 wait complete. 2024-05-30T16:54:33.498 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:54:33.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.635+0000 7fa478200640 1 Processor -- start 2024-05-30T16:54:33.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.635+0000 7fa478200640 1 -- start start 2024-05-30T16:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa478200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa470159df0 0x7fa4700ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa478200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa47015a1d0 0x7fa4700ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa478200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa47015d730 con 0x7fa4700b3e50 2024-05-30T16:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa478200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa4700b3370 con 0x7fa470159df0 2024-05-30T16:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa478200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa4700b3650 con 0x7fa47015a1d0 2024-05-30T16:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa475800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa470159df0 0x7fa4700ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa475800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa470159df0 0x7fa4700ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54624/0 (socket says 172.21.15.59:54624) 2024-05-30T16:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa475800640 1 -- 172.21.15.59:0/1085808304 learned_addr learned my addr 172.21.15.59:0/1085808304 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:33.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa474e00640 1 --2- 172.21.15.59:0/1085808304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa47015a1d0 0x7fa4700ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa475800640 1 -- 172.21.15.59:0/1085808304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa47015a1d0 msgr2=0x7fa4700ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:33.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa475800640 1 --2- 172.21.15.59:0/1085808304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa47015a1d0 0x7fa4700ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa475800640 1 -- 172.21.15.59:0/1085808304 >> v1:172.21.15.107:6789/0 conn(0x7fa4700b3e50 legacy=0x7fa47015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa475800640 1 -- 172.21.15.59:0/1085808304 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4700b3930 con 0x7fa470159df0 2024-05-30T16:54:33.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.639+0000 7fa475800640 1 --2- 172.21.15.59:0/1085808304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470159df0 0x7fa4700ad1b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa464009870 tx=0x7fa46401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2174a69a5cf99c21 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa46fe00640 1 -- 172.21.15.59:0/1085808304 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4640b0070 con 0x7fa470159df0 2024-05-30T16:54:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa46fe00640 1 -- 172.21.15.59:0/1085808304 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4640ab600 con 0x7fa470159df0 2024-05-30T16:54:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa46fe00640 1 -- 172.21.15.59:0/1085808304 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4640ab9d0 con 0x7fa470159df0 2024-05-30T16:54:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 -- 172.21.15.59:0/1085808304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470159df0 msgr2=0x7fa4700ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 --2- 172.21.15.59:0/1085808304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470159df0 0x7fa4700ad1b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa464009870 tx=0x7fa46401c560 comp rx=0 tx=0).stop 2024-05-30T16:54:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 -- 172.21.15.59:0/1085808304 shutdown_connections 2024-05-30T16:54:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 --2- 172.21.15.59:0/1085808304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa47015a1d0 0x7fa4700ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 --2- 172.21.15.59:0/1085808304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470159df0 0x7fa4700ad1b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 -- 172.21.15.59:0/1085808304 >> 172.21.15.59:0/1085808304 conn(0x7fa4700b22d0 msgr2=0x7fa4700b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 -- 172.21.15.59:0/1085808304 shutdown_connections 2024-05-30T16:54:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 -- 172.21.15.59:0/1085808304 wait complete. 2024-05-30T16:54:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 Processor -- start 2024-05-30T16:54:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 -- start start 2024-05-30T16:54:33.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4700b3e50 0x7fa47006f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470159df0 0x7fa470165580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa47015a1d0 0x7fa470165ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa47015e720 con 0x7fa470159df0 2024-05-30T16:54:33.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa47015e5a0 con 0x7fa47015a1d0 2024-05-30T16:54:33.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa478200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa47015e8a0 con 0x7fa4700b3e50 2024-05-30T16:54:33.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa474e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470159df0 0x7fa470165580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa474e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470159df0 0x7fa470165580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54634/0 (socket says 172.21.15.59:54634) 2024-05-30T16:54:33.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa474e00640 1 -- 172.21.15.59:0/3881551086 learned_addr learned my addr 172.21.15.59:0/3881551086 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:33.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa475800640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4700b3e50 0x7fa47006f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.643+0000 7fa476200640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa47015a1d0 0x7fa470165ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa474e00640 1 -- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4700b3e50 msgr2=0x7fa47006f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa474e00640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4700b3e50 0x7fa47006f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa474e00640 1 -- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa47015a1d0 msgr2=0x7fa470165ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa474e00640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa47015a1d0 0x7fa470165ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa474e00640 1 -- 172.21.15.59:0/3881551086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa470072c00 con 0x7fa470159df0 2024-05-30T16:54:33.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa474e00640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470159df0 0x7fa470165580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00d800 tx=0x7fa45c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:33.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa46d600640 1 -- 172.21.15.59:0/3881551086 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c00b6c0 con 0x7fa470159df0 2024-05-30T16:54:33.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa46d600640 1 -- 172.21.15.59:0/3881551086 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa45c019070 con 0x7fa470159df0 2024-05-30T16:54:33.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa46d600640 1 -- 172.21.15.59:0/3881551086 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c00baa0 con 0x7fa470159df0 2024-05-30T16:54:33.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa478200640 1 -- 172.21.15.59:0/3881551086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa47015c090 con 0x7fa470159df0 2024-05-30T16:54:33.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa478200640 1 -- 172.21.15.59:0/3881551086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa470073160 con 0x7fa470159df0 2024-05-30T16:54:33.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa478200640 1 -- 172.21.15.59:0/3881551086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa470068a90 con 0x7fa470159df0 2024-05-30T16:54:33.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa46d600640 1 -- 172.21.15.59:0/3881551086 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fa45c00bc40 con 0x7fa470159df0 2024-05-30T16:54:33.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa46d600640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa450068b60 0x7fa45006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.647+0000 7fa46d600640 1 -- 172.21.15.59:0/3881551086 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5851+0+0 (secure 0 0 0) 0x7fa45c088080 con 0x7fa470159df0 2024-05-30T16:54:33.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.651+0000 7fa475800640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa450068b60 0x7fa45006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.651+0000 7fa475800640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa450068b60 0x7fa45006b020 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa4640ad000 tx=0x7fa4640a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:33.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.651+0000 7fa46d600640 1 -- 172.21.15.59:0/3881551086 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa470072c00 con 0x7fa470159df0 2024-05-30T16:54:33.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 -- 172.21.15.59:0/3881551086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4700b3150 con 0x7fa470159df0 2024-05-30T16:54:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa46d600640 1 -- 172.21.15.59:0/3881551086 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16845 (secure 0 0 0) 0x7fa45c056f40 con 0x7fa470159df0 2024-05-30T16:54:33.826 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:33.826 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":50,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:54:33.167446+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:52:09.850441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T16:52:11.108687+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":5}]},{"pgid":"7.18","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:54:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 -- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa450068b60 msgr2=0x7fa45006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa450068b60 0x7fa45006b020 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa4640ad000 tx=0x7fa4640a6000 comp rx=0 tx=0).stop 2024-05-30T16:54:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 -- 172.21.15.59:0/3881551086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470159df0 msgr2=0x7fa470165580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470159df0 0x7fa470165580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00d800 tx=0x7fa45c00dcc0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 -- 172.21.15.59:0/3881551086 shutdown_connections 2024-05-30T16:54:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa450068b60 0x7fa45006b020 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa47015a1d0 0x7fa470165ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470159df0 0x7fa470165580 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 --2- 172.21.15.59:0/3881551086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4700b3e50 0x7fa47006f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 -- 172.21.15.59:0/3881551086 >> 172.21.15.59:0/3881551086 conn(0x7fa4700b22d0 msgr2=0x7fa4700afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 -- 172.21.15.59:0/3881551086 shutdown_connections 2024-05-30T16:54:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.823+0000 7fa478200640 1 -- 172.21.15.59:0/3881551086 wait complete. 2024-05-30T16:54:33.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T16:54:33.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f99ab200640 1 Processor -- start 2024-05-30T16:54:33.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f99ab200640 1 -- start start 2024-05-30T16:54:33.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f99ab200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a40cfa40 0x7f99a415ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f99ab200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99a40cfe20 0x7f99a40b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f99ab200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f99a40b3dd0 0x7f99a4072060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f99ab200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f99a415f3b0 con 0x7f99a40cfe20 2024-05-30T16:54:33.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f99ab200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f99a415f690 con 0x7f99a40b3dd0 2024-05-30T16:54:33.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f99ab200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f99a415f970 con 0x7f99a40cfa40 2024-05-30T16:54:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f999be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99a40cfe20 0x7f99a40b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f99a3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a40cfa40 0x7f99a415ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f99a9200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f99a40b3dd0 0x7f99a4072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f999be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99a40cfe20 0x7f99a40b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54646/0 (socket says 172.21.15.59:54646) 2024-05-30T16:54:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f999be00640 1 -- 172.21.15.59:0/3491382194 learned_addr learned my addr 172.21.15.59:0/3491382194 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f999be00640 1 -- 172.21.15.59:0/3491382194 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a40cfa40 msgr2=0x7f99a415ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f999be00640 1 --2- 172.21.15.59:0/3491382194 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a40cfa40 0x7f99a415ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f999be00640 1 -- 172.21.15.59:0/3491382194 >> v2:172.21.15.107:3300/0 conn(0x7f99a40b3dd0 msgr2=0x7f99a4072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f999be00640 1 --2- 172.21.15.59:0/3491382194 >> v2:172.21.15.107:3300/0 conn(0x7f99a40b3dd0 0x7f99a4072060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f999be00640 1 -- 172.21.15.59:0/3491382194 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a40b3370 con 0x7f99a40cfe20 2024-05-30T16:54:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f99a3e00640 1 --2- 172.21.15.59:0/3491382194 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a40cfa40 0x7f99a415ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:54:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.987+0000 7f99a9200640 1 --2- 172.21.15.59:0/3491382194 >> v2:172.21.15.107:3300/0 conn(0x7f99a40b3dd0 0x7f99a4072060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:54:33.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f999be00640 1 --2- 172.21.15.59:0/3491382194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99a40cfe20 0x7f99a40b3890 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f99a40d1100 tx=0x7f998c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e61c1140e1ca18 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:33.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f99a3400640 1 -- 172.21.15.59:0/3491382194 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c0ab5f0 con 0x7f99a40cfe20 2024-05-30T16:54:33.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f99a3400640 1 -- 172.21.15.59:0/3491382194 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f998c0b0070 con 0x7f99a40cfe20 2024-05-30T16:54:33.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f99a3400640 1 -- 172.21.15.59:0/3491382194 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c0ab9b0 con 0x7f99a40cfe20 2024-05-30T16:54:33.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f99ab200640 1 -- 172.21.15.59:0/3491382194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99a40cfe20 msgr2=0x7f99a40b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f99ab200640 1 --2- 172.21.15.59:0/3491382194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99a40cfe20 0x7f99a40b3890 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f99a40d1100 tx=0x7f998c01c520 comp rx=0 tx=0).stop 2024-05-30T16:54:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f99ab200640 1 -- 172.21.15.59:0/3491382194 shutdown_connections 2024-05-30T16:54:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f99ab200640 1 --2- 172.21.15.59:0/3491382194 >> v2:172.21.15.107:3300/0 conn(0x7f99a40b3dd0 0x7f99a4072060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f99ab200640 1 --2- 172.21.15.59:0/3491382194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99a40cfe20 0x7f99a40b3890 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f99ab200640 1 --2- 172.21.15.59:0/3491382194 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a40cfa40 0x7f99a415ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f99ab200640 1 -- 172.21.15.59:0/3491382194 >> 172.21.15.59:0/3491382194 conn(0x7f99a40b22d0 msgr2=0x7f99a40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f99ab200640 1 -- 172.21.15.59:0/3491382194 shutdown_connections 2024-05-30T16:54:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.991+0000 7f99ab200640 1 -- 172.21.15.59:0/3491382194 wait complete. 2024-05-30T16:54:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99ab200640 1 Processor -- start 2024-05-30T16:54:33.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99ab200640 1 -- start start 2024-05-30T16:54:33.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99ab200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a40b3dd0 0x7f99a41faa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99ab200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a40cfa40 0x7f99a414b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99ab200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99a40cfe20 0x7f99a414bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99ab200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4154fc0 con 0x7f99a40cfe20 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99ab200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4154e40 con 0x7f99a40b3dd0 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99ab200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f99a4155140 con 0x7f99a40cfa40 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a9200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99a40cfe20 0x7f99a414bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a9200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99a40cfe20 0x7f99a414bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54648/0 (socket says 172.21.15.59:54648) 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a9200640 1 -- 172.21.15.59:0/2870232237 learned_addr learned my addr 172.21.15.59:0/2870232237 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f999be00640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a40cfa40 0x7f99a414b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a3e00640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a40b3dd0 0x7f99a41faa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a9200640 1 -- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a40cfa40 msgr2=0x7f99a414b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a9200640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a40cfa40 0x7f99a414b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a9200640 1 -- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a40b3dd0 msgr2=0x7f99a41faa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a9200640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a40b3dd0 0x7f99a41faa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a9200640 1 -- 172.21.15.59:0/2870232237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a41516d0 con 0x7f99a40cfe20 2024-05-30T16:54:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a9200640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99a40cfe20 0x7f99a414bb60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f999c00efc0 tx=0x7f999c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:34.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a0c00640 1 -- 172.21.15.59:0/2870232237 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c018030 con 0x7f99a40cfe20 2024-05-30T16:54:34.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a0c00640 1 -- 172.21.15.59:0/2870232237 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f999c00cde0 con 0x7f99a40cfe20 2024-05-30T16:54:34.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99a0c00640 1 -- 172.21.15.59:0/2870232237 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c003bc0 con 0x7f99a40cfe20 2024-05-30T16:54:34.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99ab200640 1 -- 172.21.15.59:0/2870232237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a41519b0 con 0x7f99a40cfe20 2024-05-30T16:54:34.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99ab200640 1 -- 172.21.15.59:0/2870232237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a4151f70 con 0x7f99a40cfe20 2024-05-30T16:54:34.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.995+0000 7f99ab200640 1 -- 172.21.15.59:0/2870232237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a4068a90 con 0x7f99a40cfe20 2024-05-30T16:54:34.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.999+0000 7f99a0c00640 1 -- 172.21.15.59:0/2870232237 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f999c01b070 con 0x7f99a40cfe20 2024-05-30T16:54:34.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.999+0000 7f99a0c00640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9980068b90 0x7f998006b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:34.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.999+0000 7f99a0c00640 1 -- 172.21.15.59:0/2870232237 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5851+0+0 (secure 0 0 0) 0x7f999c085c80 con 0x7f99a40cfe20 2024-05-30T16:54:34.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.999+0000 7f99a3e00640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9980068b90 0x7f998006b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:34.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:33.999+0000 7f99a3e00640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9980068b90 0x7f998006b050 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9994009580 tx=0x7f9994009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:34.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.003+0000 7f99a0c00640 1 -- 172.21.15.59:0/2870232237 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f999c010040 con 0x7f99a40cfe20 2024-05-30T16:54:34.057 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:54:34.062 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:54:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.207+0000 7f99ab200640 1 -- 172.21.15.59:0/2870232237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f99a40b5190 con 0x7f99a40cfe20 2024-05-30T16:54:34.209 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-05-30T16:54:34.207+0000 7f2f74c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T16:54:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.207+0000 7f99a0c00640 1 -- 172.21.15.59:0/2870232237 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7f999c0574e0 con 0x7f99a40cfe20 2024-05-30T16:54:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T16:54:34.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.211+0000 7f99ab200640 1 -- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9980068b90 msgr2=0x7f998006b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:34.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.211+0000 7f99ab200640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9980068b90 0x7f998006b050 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9994009580 tx=0x7f9994009190 comp rx=0 tx=0).stop 2024-05-30T16:54:34.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.211+0000 7f99ab200640 1 -- 172.21.15.59:0/2870232237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99a40cfe20 msgr2=0x7f99a414bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:34.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.211+0000 7f99ab200640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99a40cfe20 0x7f99a414bb60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f999c00efc0 tx=0x7f999c009f90 comp rx=0 tx=0).stop 2024-05-30T16:54:34.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.211+0000 7f99ab200640 1 -- 172.21.15.59:0/2870232237 shutdown_connections 2024-05-30T16:54:34.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.211+0000 7f99ab200640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9980068b90 0x7f998006b050 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:34.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.211+0000 7f99ab200640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99a40cfe20 0x7f99a414bb60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:34.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.211+0000 7f99ab200640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a40cfa40 0x7f99a414b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:34.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.211+0000 7f99ab200640 1 --2- 172.21.15.59:0/2870232237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a40b3dd0 0x7f99a41faa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:34.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.211+0000 7f99ab200640 1 -- 172.21.15.59:0/2870232237 >> 172.21.15.59:0/2870232237 conn(0x7f99a40b22d0 msgr2=0x7f99a406c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:34.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.211+0000 7f99ab200640 1 -- 172.21.15.59:0/2870232237 shutdown_connections 2024-05-30T16:54:34.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.211+0000 7f99ab200640 1 -- 172.21.15.59:0/2870232237 wait complete. 2024-05-30T16:54:34.236 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T16:54:34.281 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T16:54:34.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.375+0000 7f2732000640 1 Processor -- start 2024-05-30T16:54:34.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.375+0000 7f2732000640 1 -- start start 2024-05-30T16:54:34.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f2732000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f272c159100 0x7f272c06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:34.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f2732000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f272c15c010 0x7f272c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:34.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f2732000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f272c0b52d0 con 0x7f272c0b44e0 2024-05-30T16:54:34.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f2732000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f272c0b4a30 con 0x7f272c15c010 2024-05-30T16:54:34.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f2732000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f272c0b4d10 con 0x7f272c159100 2024-05-30T16:54:34.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f272be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f272c15c010 0x7f272c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:34.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f272be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f272c15c010 0x7f272c15c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54670/0 (socket says 172.21.15.59:54670) 2024-05-30T16:54:34.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f272be00640 1 -- 172.21.15.59:0/2164788443 learned_addr learned my addr 172.21.15.59:0/2164788443 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:34.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f2722a00640 1 --1- 172.21.15.59:0/2164788443 >> v1:172.21.15.59:6789/0 conn(0x7f272c0b44e0 0x7f272c15efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58694/0 (socket says 172.21.15.59:58694) 2024-05-30T16:54:34.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f272b400640 1 --2- 172.21.15.59:0/2164788443 >> v2:172.21.15.107:3300/0 conn(0x7f272c159100 0x7f272c06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:34.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f272be00640 1 -- 172.21.15.59:0/2164788443 >> v2:172.21.15.107:3300/0 conn(0x7f272c159100 msgr2=0x7f272c06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:34.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f272be00640 1 --2- 172.21.15.59:0/2164788443 >> v2:172.21.15.107:3300/0 conn(0x7f272c159100 0x7f272c06e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:34.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f272be00640 1 -- 172.21.15.59:0/2164788443 >> v1:172.21.15.59:6789/0 conn(0x7f272c0b44e0 legacy=0x7f272c15efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:34.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.379+0000 7f272be00640 1 -- 172.21.15.59:0/2164788443 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c0b4ff0 con 0x7f272c15c010 2024-05-30T16:54:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f272be00640 1 --2- 172.21.15.59:0/2164788443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15c010 0x7f272c15c440 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f272c06c8f0 tx=0x7f272401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7858df96441c68b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f272aa00640 1 -- 172.21.15.59:0/2164788443 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27240b2070 con 0x7f272c15c010 2024-05-30T16:54:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f272aa00640 1 -- 172.21.15.59:0/2164788443 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27240ad680 con 0x7f272c15c010 2024-05-30T16:54:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f272aa00640 1 -- 172.21.15.59:0/2164788443 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27240ada50 con 0x7f272c15c010 2024-05-30T16:54:34.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f2732000640 1 -- 172.21.15.59:0/2164788443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15c010 msgr2=0x7f272c15c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:34.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f2732000640 1 --2- 172.21.15.59:0/2164788443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15c010 0x7f272c15c440 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f272c06c8f0 tx=0x7f272401c490 comp rx=0 tx=0).stop 2024-05-30T16:54:34.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f2732000640 1 -- 172.21.15.59:0/2164788443 shutdown_connections 2024-05-30T16:54:34.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f2732000640 1 --2- 172.21.15.59:0/2164788443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15c010 0x7f272c15c440 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:34.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f2732000640 1 --2- 172.21.15.59:0/2164788443 >> v2:172.21.15.107:3300/0 conn(0x7f272c159100 0x7f272c06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:34.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f2732000640 1 -- 172.21.15.59:0/2164788443 >> 172.21.15.59:0/2164788443 conn(0x7f272c06bdb0 msgr2=0x7f272c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:34.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f2732000640 1 -- 172.21.15.59:0/2164788443 shutdown_connections 2024-05-30T16:54:34.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f2732000640 1 -- 172.21.15.59:0/2164788443 wait complete. 2024-05-30T16:54:34.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f2732000640 1 Processor -- start 2024-05-30T16:54:34.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.383+0000 7f2732000640 1 -- start start 2024-05-30T16:54:34.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2732000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c0b44e0 0x7f272c0b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:34.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2732000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f272c159100 0x7f272c146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:34.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2732000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f272c15c010 0x7f272c159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:34.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2732000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f272c1682c0 con 0x7f272c0b44e0 2024-05-30T16:54:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2732000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f272c168140 con 0x7f272c15c010 2024-05-30T16:54:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2732000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f272c168440 con 0x7f272c159100 2024-05-30T16:54:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f272b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c0b44e0 0x7f272c0b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f272b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c0b44e0 0x7f272c0b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54684/0 (socket says 172.21.15.59:54684) 2024-05-30T16:54:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f272b400640 1 -- 172.21.15.59:0/957538650 learned_addr learned my addr 172.21.15.59:0/957538650 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f272b400640 1 -- 172.21.15.59:0/957538650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f272c159100 msgr2=0x7f272c146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f272b400640 1 --2- 172.21.15.59:0/957538650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f272c159100 0x7f272c146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f272b400640 1 -- 172.21.15.59:0/957538650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f272c15c010 msgr2=0x7f272c159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f272b400640 1 --2- 172.21.15.59:0/957538650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f272c15c010 0x7f272c159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f272b400640 1 -- 172.21.15.59:0/957538650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c146b90 con 0x7f272c0b44e0 2024-05-30T16:54:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f272b400640 1 --2- 172.21.15.59:0/957538650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c0b44e0 0x7f272c0b1ad0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e930 tx=0x7f271c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:34.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2723e00640 1 -- 172.21.15.59:0/957538650 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c017070 con 0x7f272c0b44e0 2024-05-30T16:54:34.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2723e00640 1 -- 172.21.15.59:0/957538650 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c00ca00 con 0x7f272c0b44e0 2024-05-30T16:54:34.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2723e00640 1 -- 172.21.15.59:0/957538650 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c00cdb0 con 0x7f272c0b44e0 2024-05-30T16:54:34.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2732000640 1 -- 172.21.15.59:0/957538650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f272c15ae90 con 0x7f272c0b44e0 2024-05-30T16:54:34.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2732000640 1 -- 172.21.15.59:0/957538650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f272c15a1d0 con 0x7f272c0b44e0 2024-05-30T16:54:34.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2732000640 1 -- 172.21.15.59:0/957538650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f272c068a90 con 0x7f272c0b44e0 2024-05-30T16:54:34.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.387+0000 7f2723e00640 1 -- 172.21.15.59:0/957538650 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f271c01a070 con 0x7f272c0b44e0 2024-05-30T16:54:34.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.391+0000 7f2723e00640 1 --2- 172.21.15.59:0/957538650 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2708068b60 0x7f270806b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:34.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.391+0000 7f2723e00640 1 -- 172.21.15.59:0/957538650 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5909+0+0 (secure 0 0 0) 0x7f271c088090 con 0x7f272c0b44e0 2024-05-30T16:54:34.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.391+0000 7f2722a00640 1 --2- 172.21.15.59:0/957538650 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2708068b60 0x7f270806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:34.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.391+0000 7f2722a00640 1 --2- 172.21.15.59:0/957538650 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2708068b60 0x7f270806b020 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f27140012f0 tx=0x7f2714007d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:34.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.395+0000 7f2723e00640 1 -- 172.21.15.59:0/957538650 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f271c0576b0 con 0x7f272c0b44e0 2024-05-30T16:54:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:34.591+0000 7f2732000640 1 -- 172.21.15.59:0/957538650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f272c0aff40 con 0x7f272c0b44e0 2024-05-30T16:54:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2723e00640 1 -- 172.21.15.59:0/957538650 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7f271c056fb0 con 0x7f272c0b44e0 2024-05-30T16:54:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2732000640 1 -- 172.21.15.59:0/957538650 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2708068b60 msgr2=0x7f270806b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2732000640 1 --2- 172.21.15.59:0/957538650 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2708068b60 0x7f270806b020 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f27140012f0 tx=0x7f2714007d90 comp rx=0 tx=0).stop 2024-05-30T16:54:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2732000640 1 -- 172.21.15.59:0/957538650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c0b44e0 msgr2=0x7f272c0b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2732000640 1 --2- 172.21.15.59:0/957538650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c0b44e0 0x7f272c0b1ad0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e930 tx=0x7f271c00edf0 comp rx=0 tx=0).stop 2024-05-30T16:54:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2732000640 1 -- 172.21.15.59:0/957538650 shutdown_connections 2024-05-30T16:54:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2732000640 1 --2- 172.21.15.59:0/957538650 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2708068b60 0x7f270806b020 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2732000640 1 --2- 172.21.15.59:0/957538650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f272c15c010 0x7f272c159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2732000640 1 --2- 172.21.15.59:0/957538650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f272c159100 0x7f272c146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2732000640 1 --2- 172.21.15.59:0/957538650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c0b44e0 0x7f272c0b1ad0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2732000640 1 -- 172.21.15.59:0/957538650 >> 172.21.15.59:0/957538650 conn(0x7f272c06bdb0 msgr2=0x7f272c1538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2732000640 1 -- 172.21.15.59:0/957538650 shutdown_connections 2024-05-30T16:54:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.215+0000 7f2732000640 1 -- 172.21.15.59:0/957538650 wait complete. 2024-05-30T16:54:35.243 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T16:54:35.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8664000640 1 Processor -- start 2024-05-30T16:54:35.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8664000640 1 -- start start 2024-05-30T16:54:35.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8664000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f865c161e20 0x7f865c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:35.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8664000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f865c0730e0 0x7f865c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:35.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8664000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f865c0b3d50 con 0x7f865c162310 2024-05-30T16:54:35.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8664000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f865c0b4030 con 0x7f865c0730e0 2024-05-30T16:54:35.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8664000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f865c06e7c0 con 0x7f865c161e20 2024-05-30T16:54:35.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8660c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f865c0730e0 0x7f865c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:35.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8660c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f865c0730e0 0x7f865c06cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54694/0 (socket says 172.21.15.59:54694) 2024-05-30T16:54:35.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8660c00640 1 -- 172.21.15.59:0/1710465638 learned_addr learned my addr 172.21.15.59:0/1710465638 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:35.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8661600640 1 --2- 172.21.15.59:0/1710465638 >> v2:172.21.15.107:3300/0 conn(0x7f865c161e20 0x7f865c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:35.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8660c00640 1 -- 172.21.15.59:0/1710465638 >> v2:172.21.15.107:3300/0 conn(0x7f865c161e20 msgr2=0x7f865c06c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:35.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8660c00640 1 --2- 172.21.15.59:0/1710465638 >> v2:172.21.15.107:3300/0 conn(0x7f865c161e20 0x7f865c06c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:35.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8660c00640 1 -- 172.21.15.59:0/1710465638 >> v1:172.21.15.107:6789/0 conn(0x7f865c162310 legacy=0x7f865c1627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:35.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.431+0000 7f8660c00640 1 -- 172.21.15.59:0/1710465638 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865c06eaa0 con 0x7f865c0730e0 2024-05-30T16:54:35.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.435+0000 7f8660c00640 1 --2- 172.21.15.59:0/1710465638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865c0730e0 0x7f865c06cf00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f865c0d1b10 tx=0x7f864801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d56f6b35b7a180 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:35.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.435+0000 7f865be00640 1 -- 172.21.15.59:0/1710465638 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86480b5070 con 0x7f865c0730e0 2024-05-30T16:54:35.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.435+0000 7f865be00640 1 -- 172.21.15.59:0/1710465638 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86480a8a10 con 0x7f865c0730e0 2024-05-30T16:54:35.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.435+0000 7f865be00640 1 -- 172.21.15.59:0/1710465638 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86480a8de0 con 0x7f865c0730e0 2024-05-30T16:54:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.435+0000 7f8664000640 1 -- 172.21.15.59:0/1710465638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865c0730e0 msgr2=0x7f865c06cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.435+0000 7f8664000640 1 --2- 172.21.15.59:0/1710465638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865c0730e0 0x7f865c06cf00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f865c0d1b10 tx=0x7f864801ed10 comp rx=0 tx=0).stop 2024-05-30T16:54:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.435+0000 7f8664000640 1 -- 172.21.15.59:0/1710465638 shutdown_connections 2024-05-30T16:54:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.435+0000 7f8664000640 1 --2- 172.21.15.59:0/1710465638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865c0730e0 0x7f865c06cf00 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.435+0000 7f8664000640 1 --2- 172.21.15.59:0/1710465638 >> v2:172.21.15.107:3300/0 conn(0x7f865c161e20 0x7f865c06c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.435+0000 7f8664000640 1 -- 172.21.15.59:0/1710465638 >> 172.21.15.59:0/1710465638 conn(0x7f865c0725c0 msgr2=0x7f865c0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.435+0000 7f8664000640 1 -- 172.21.15.59:0/1710465638 shutdown_connections 2024-05-30T16:54:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.435+0000 7f8664000640 1 -- 172.21.15.59:0/1710465638 wait complete. 2024-05-30T16:54:35.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8664000640 1 Processor -- start 2024-05-30T16:54:35.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8664000640 1 -- start start 2024-05-30T16:54:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8664000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865c0730e0 0x7f865c14a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8664000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f865c161e20 0x7f865c15de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8664000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c162310 0x7f865c0cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8664000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f865c0d0820 con 0x7f865c0730e0 2024-05-30T16:54:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8664000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f865c0b3a20 con 0x7f865c162310 2024-05-30T16:54:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8664000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f865c0cd0d0 con 0x7f865c161e20 2024-05-30T16:54:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8661600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865c0730e0 0x7f865c14a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8661600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865c0730e0 0x7f865c14a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54702/0 (socket says 172.21.15.59:54702) 2024-05-30T16:54:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8661600640 1 -- 172.21.15.59:0/1988674143 learned_addr learned my addr 172.21.15.59:0/1988674143 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8662000640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c162310 0x7f865c0cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8660c00640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f865c161e20 0x7f865c15de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:35.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8661600640 1 -- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f865c161e20 msgr2=0x7f865c15de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8661600640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f865c161e20 0x7f865c15de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8661600640 1 -- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c162310 msgr2=0x7f865c0cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8661600640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c162310 0x7f865c0cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8661600640 1 -- 172.21.15.59:0/1988674143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865c158d50 con 0x7f865c0730e0 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8660c00640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f865c161e20 0x7f865c15de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8662000640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c162310 0x7f865c0cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8661600640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865c0730e0 0x7f865c14a510 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f865000e870 tx=0x7f865000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8659600640 1 -- 172.21.15.59:0/1988674143 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650017070 con 0x7f865c0730e0 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8659600640 1 -- 172.21.15.59:0/1988674143 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f865000c8e0 con 0x7f865c0730e0 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8659600640 1 -- 172.21.15.59:0/1988674143 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865000ccb0 con 0x7f865c0730e0 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8664000640 1 -- 172.21.15.59:0/1988674143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865c159030 con 0x7f865c0730e0 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.439+0000 7f8664000640 1 -- 172.21.15.59:0/1988674143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865c1595f0 con 0x7f865c0730e0 2024-05-30T16:54:35.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.443+0000 7f8664000640 1 -- 172.21.15.59:0/1988674143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f865c068a90 con 0x7f865c0730e0 2024-05-30T16:54:35.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.443+0000 7f8659600640 1 -- 172.21.15.59:0/1988674143 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f865001a070 con 0x7f865c0730e0 2024-05-30T16:54:35.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.443+0000 7f8659600640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f863c068b60 0x7f863c06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:35.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.443+0000 7f8659600640 1 -- 172.21.15.59:0/1988674143 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5909+0+0 (secure 0 0 0) 0x7f8650088060 con 0x7f865c0730e0 2024-05-30T16:54:35.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.443+0000 7f8660c00640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f863c068b60 0x7f863c06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:35.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.443+0000 7f8660c00640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f863c068b60 0x7f863c06b020 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f86480b2000 tx=0x7f8648008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:35.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.447+0000 7f8659600640 1 -- 172.21.15.59:0/1988674143 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f86500574a0 con 0x7f865c0730e0 2024-05-30T16:54:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:35.615+0000 7f8664000640 1 -- 172.21.15.59:0/1988674143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f865c0678a0 con 0x7f865c0730e0 2024-05-30T16:54:36.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.215+0000 7f8659600640 1 -- 172.21.15.59:0/1988674143 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) ==== 181+0+0 (secure 0 0 0) 0x7f8650056da0 con 0x7f865c0730e0 2024-05-30T16:54:36.219 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-05-30T16:54:36.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.219+0000 7f8664000640 1 -- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f863c068b60 msgr2=0x7f863c06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:36.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.219+0000 7f8664000640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f863c068b60 0x7f863c06b020 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f86480b2000 tx=0x7f8648008040 comp rx=0 tx=0).stop 2024-05-30T16:54:36.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.219+0000 7f8664000640 1 -- 172.21.15.59:0/1988674143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865c0730e0 msgr2=0x7f865c14a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:36.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.219+0000 7f8664000640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865c0730e0 0x7f865c14a510 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f865000e870 tx=0x7f865000ed30 comp rx=0 tx=0).stop 2024-05-30T16:54:36.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.219+0000 7f8664000640 1 -- 172.21.15.59:0/1988674143 shutdown_connections 2024-05-30T16:54:36.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.219+0000 7f8664000640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f863c068b60 0x7f863c06b020 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:36.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.219+0000 7f8664000640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c162310 0x7f865c0cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:36.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.219+0000 7f8664000640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f865c161e20 0x7f865c15de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:36.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.219+0000 7f8664000640 1 --2- 172.21.15.59:0/1988674143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865c0730e0 0x7f865c14a510 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:36.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.219+0000 7f8664000640 1 -- 172.21.15.59:0/1988674143 >> 172.21.15.59:0/1988674143 conn(0x7f865c0725c0 msgr2=0x7f865c0cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:36.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.219+0000 7f8664000640 1 -- 172.21.15.59:0/1988674143 shutdown_connections 2024-05-30T16:54:36.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.219+0000 7f8664000640 1 -- 172.21.15.59:0/1988674143 wait complete. 2024-05-30T16:54:36.245 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T16:54:36.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.387+0000 7f7651000640 1 Processor -- start 2024-05-30T16:54:36.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.387+0000 7f7651000640 1 -- start start 2024-05-30T16:54:36.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.387+0000 7f7651000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764c09b7a0 0x7f764c162410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.387+0000 7f7651000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f764c0d1020 con 0x7f764c162950 2024-05-30T16:54:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.387+0000 7f7651000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f764c0d1300 con 0x7f764c161ce0 2024-05-30T16:54:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.387+0000 7f7651000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f764c0d15e0 con 0x7f764c09b7a0 2024-05-30T16:54:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.387+0000 7f764a800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f764c162950 0x7f764c15e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58696/0 (socket says 172.21.15.59:58696) 2024-05-30T16:54:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.387+0000 7f764a800640 1 -- 172.21.15.59:0/2774599117 learned_addr learned my addr 172.21.15.59:0/2774599117 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.387+0000 7f7641400640 1 --2- 172.21.15.59:0/2774599117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764c09b7a0 0x7f764c162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.387+0000 7f7649400640 1 -- 172.21.15.59:0/2774599117 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1434436775 0 0) 0x7f764c0d1020 con 0x7f764c162950 2024-05-30T16:54:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7649400640 1 -- 172.21.15.59:0/2774599117 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7630003530 con 0x7f764c162950 2024-05-30T16:54:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7649400640 1 -- 172.21.15.59:0/2774599117 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863733064 0 0) 0x7f764c0d1300 con 0x7f764c161ce0 2024-05-30T16:54:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7649400640 1 -- 172.21.15.59:0/2774599117 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f764c0d1020 con 0x7f764c161ce0 2024-05-30T16:54:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7641400640 1 -- 172.21.15.59:0/2774599117 >> v1:172.21.15.107:6789/0 conn(0x7f764c161ce0 legacy=0x7f764c0d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7641400640 1 -- 172.21.15.59:0/2774599117 >> v1:172.21.15.59:6789/0 conn(0x7f764c162950 legacy=0x7f764c15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7641400640 1 -- 172.21.15.59:0/2774599117 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764c0d18c0 con 0x7f764c09b7a0 2024-05-30T16:54:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7641400640 1 --2- 172.21.15.59:0/2774599117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764c09b7a0 0x7f764c162410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f76340097f0 tx=0x7f763401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36be173e98d86f04 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7649400640 1 -- 172.21.15.59:0/2774599117 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76340ab5f0 con 0x7f764c09b7a0 2024-05-30T16:54:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7649400640 1 -- 172.21.15.59:0/2774599117 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76340b0070 con 0x7f764c09b7a0 2024-05-30T16:54:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7649400640 1 -- 172.21.15.59:0/2774599117 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76340ab9b0 con 0x7f764c09b7a0 2024-05-30T16:54:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7651000640 1 -- 172.21.15.59:0/2774599117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764c09b7a0 msgr2=0x7f764c162410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7651000640 1 --2- 172.21.15.59:0/2774599117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764c09b7a0 0x7f764c162410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f76340097f0 tx=0x7f763401c4e0 comp rx=0 tx=0).stop 2024-05-30T16:54:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7651000640 1 -- 172.21.15.59:0/2774599117 shutdown_connections 2024-05-30T16:54:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7651000640 1 --2- 172.21.15.59:0/2774599117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764c09b7a0 0x7f764c162410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.391+0000 7f7651000640 1 -- 172.21.15.59:0/2774599117 >> 172.21.15.59:0/2774599117 conn(0x7f764c0b4000 msgr2=0x7f764c0b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7651000640 1 -- 172.21.15.59:0/2774599117 shutdown_connections 2024-05-30T16:54:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7651000640 1 -- 172.21.15.59:0/2774599117 wait complete. 2024-05-30T16:54:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7651000640 1 Processor -- start 2024-05-30T16:54:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7651000640 1 -- start start 2024-05-30T16:54:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7651000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f764c09b7a0 0x7f764c156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7651000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f764c161ce0 0x7f764c0c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7651000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764c162950 0x7f764c160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7651000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f764c162d60 con 0x7f764c09b7a0 2024-05-30T16:54:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7651000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f764c16cf70 con 0x7f764c161ce0 2024-05-30T16:54:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7651000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f764c16d0f0 con 0x7f764c162950 2024-05-30T16:54:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7649e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f764c09b7a0 0x7f764c156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7649e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f764c09b7a0 0x7f764c156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54704/0 (socket says 172.21.15.59:54704) 2024-05-30T16:54:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7649e00640 1 -- 172.21.15.59:0/1634156512 learned_addr learned my addr 172.21.15.59:0/1634156512 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f764a800640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764c162950 0x7f764c160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7641400640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f764c161ce0 0x7f764c0c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7649e00640 1 -- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764c162950 msgr2=0x7f764c160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7649e00640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764c162950 0x7f764c160850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7649e00640 1 -- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f764c161ce0 msgr2=0x7f764c0c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7649e00640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f764c161ce0 0x7f764c0c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7649e00640 1 -- 172.21.15.59:0/1634156512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764c0b82b0 con 0x7f764c09b7a0 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7649e00640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f764c09b7a0 0x7f764c156ea0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c830 tx=0x7f763c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7642a00640 1 -- 172.21.15.59:0/1634156512 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c003b80 con 0x7f764c09b7a0 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7642a00640 1 -- 172.21.15.59:0/1634156512 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c003d40 con 0x7f764c09b7a0 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7642a00640 1 -- 172.21.15.59:0/1634156512 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c00aa90 con 0x7f764c09b7a0 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.395+0000 7f7651000640 1 -- 172.21.15.59:0/1634156512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764c0c7480 con 0x7f764c09b7a0 2024-05-30T16:54:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.399+0000 7f7651000640 1 -- 172.21.15.59:0/1634156512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f764c0c6460 con 0x7f764c09b7a0 2024-05-30T16:54:36.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.399+0000 7f7651000640 1 -- 172.21.15.59:0/1634156512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764c068a90 con 0x7f764c09b7a0 2024-05-30T16:54:36.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.399+0000 7f7642a00640 1 -- 172.21.15.59:0/1634156512 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f763c00ac30 con 0x7f764c09b7a0 2024-05-30T16:54:36.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.399+0000 7f7642a00640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7628068b90 0x7f762806b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:36.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.399+0000 7f7642a00640 1 -- 172.21.15.59:0/1634156512 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5471+0+0 (secure 0 0 0) 0x7f763c087b20 con 0x7f764c09b7a0 2024-05-30T16:54:36.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.399+0000 7f7641400640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7628068b90 0x7f762806b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:36.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.403+0000 7f7641400640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7628068b90 0x7f762806b050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f76340af000 tx=0x7f76340a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:36.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.403+0000 7f7642a00640 1 -- 172.21.15.59:0/1634156512 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f764c0c7480 con 0x7f764c09b7a0 2024-05-30T16:54:36.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:36.571+0000 7f7651000640 1 -- 172.21.15.59:0/1634156512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f764c0d0260 con 0x7f764c09b7a0 2024-05-30T16:54:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.219+0000 7f7642a00640 1 -- 172.21.15.59:0/1634156512 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) ==== 169+0+0 (secure 0 0 0) 0x7f764c0b82b0 con 0x7f764c09b7a0 2024-05-30T16:54:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-05-30T16:54:37.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.223+0000 7f7651000640 1 -- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7628068b90 msgr2=0x7f762806b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.223+0000 7f7651000640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7628068b90 0x7f762806b050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f76340af000 tx=0x7f76340a7000 comp rx=0 tx=0).stop 2024-05-30T16:54:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.223+0000 7f7651000640 1 -- 172.21.15.59:0/1634156512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f764c09b7a0 msgr2=0x7f764c156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.223+0000 7f7651000640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f764c09b7a0 0x7f764c156ea0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c830 tx=0x7f763c00ccf0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.227+0000 7f7651000640 1 -- 172.21.15.59:0/1634156512 shutdown_connections 2024-05-30T16:54:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.227+0000 7f7651000640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7628068b90 0x7f762806b050 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.227+0000 7f7651000640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764c162950 0x7f764c160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.227+0000 7f7651000640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f764c161ce0 0x7f764c0c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.227+0000 7f7651000640 1 --2- 172.21.15.59:0/1634156512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f764c09b7a0 0x7f764c156ea0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.227+0000 7f7651000640 1 -- 172.21.15.59:0/1634156512 >> 172.21.15.59:0/1634156512 conn(0x7f764c0b4000 msgr2=0x7f764c09ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.227+0000 7f7651000640 1 -- 172.21.15.59:0/1634156512 shutdown_connections 2024-05-30T16:54:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.227+0000 7f7651000640 1 -- 172.21.15.59:0/1634156512 wait complete. 2024-05-30T16:54:37.256 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T16:54:37.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.395+0000 7fc25f200640 1 Processor -- start 2024-05-30T16:54:37.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.395+0000 7fc25f200640 1 -- start start 2024-05-30T16:54:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc25f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc26009b890 0x7fc26006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc25f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2600d0fb0 con 0x7fc260162340 2024-05-30T16:54:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc25f200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2600d1290 con 0x7fc26009b4b0 2024-05-30T16:54:37.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc25f200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc26006fef0 con 0x7fc26009b890 2024-05-30T16:54:37.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc25e800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc260162340 0x7fc26015f050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58700/0 (socket says 172.21.15.59:58700) 2024-05-30T16:54:37.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc25e800640 1 -- 172.21.15.59:0/4130587151 learned_addr learned my addr 172.21.15.59:0/4130587151 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:37.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc255400640 1 --2- 172.21.15.59:0/4130587151 >> v2:172.21.15.107:3300/0 conn(0x7fc26009b890 0x7fc26006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:37.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc25d400640 1 -- 172.21.15.59:0/4130587151 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3956123769 0 0) 0x7fc2600d0fb0 con 0x7fc260162340 2024-05-30T16:54:37.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc25d400640 1 -- 172.21.15.59:0/4130587151 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc244003530 con 0x7fc260162340 2024-05-30T16:54:37.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc25d400640 1 -- 172.21.15.59:0/4130587151 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182243070 0 0) 0x7fc2600d1290 con 0x7fc26009b4b0 2024-05-30T16:54:37.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc25d400640 1 -- 172.21.15.59:0/4130587151 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2600d0fb0 con 0x7fc26009b4b0 2024-05-30T16:54:37.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc25d400640 1 -- 172.21.15.59:0/4130587151 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2819678122 0 0) 0x7fc244003530 con 0x7fc260162340 2024-05-30T16:54:37.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc255400640 1 -- 172.21.15.59:0/4130587151 >> v1:172.21.15.107:6789/0 conn(0x7fc26009b4b0 legacy=0x7fc2600d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc255400640 1 -- 172.21.15.59:0/4130587151 >> v1:172.21.15.59:6789/0 conn(0x7fc260162340 legacy=0x7fc26015f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.399+0000 7fc255400640 1 -- 172.21.15.59:0/4130587151 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2600d1570 con 0x7fc26009b890 2024-05-30T16:54:37.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc255400640 1 --2- 172.21.15.59:0/4130587151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc26009b890 0x7fc26006cac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc2480097c0 tx=0x7fc24801c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e08966d1b758a583 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:37.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc25d400640 1 -- 172.21.15.59:0/4130587151 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2480b0070 con 0x7fc26009b890 2024-05-30T16:54:37.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc25d400640 1 -- 172.21.15.59:0/4130587151 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2480ab400 con 0x7fc26009b890 2024-05-30T16:54:37.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc25d400640 1 -- 172.21.15.59:0/4130587151 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258001680 con 0x7fc26009b890 2024-05-30T16:54:37.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc25f200640 1 -- 172.21.15.59:0/4130587151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc26009b890 msgr2=0x7fc26006cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc25f200640 1 --2- 172.21.15.59:0/4130587151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc26009b890 0x7fc26006cac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc2480097c0 tx=0x7fc24801c300 comp rx=0 tx=0).stop 2024-05-30T16:54:37.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc25f200640 1 -- 172.21.15.59:0/4130587151 shutdown_connections 2024-05-30T16:54:37.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc25f200640 1 --2- 172.21.15.59:0/4130587151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc26009b890 0x7fc26006cac0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc25f200640 1 -- 172.21.15.59:0/4130587151 >> 172.21.15.59:0/4130587151 conn(0x7fc2600b3ec0 msgr2=0x7fc2600b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:37.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc25f200640 1 -- 172.21.15.59:0/4130587151 shutdown_connections 2024-05-30T16:54:37.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc25f200640 1 -- 172.21.15.59:0/4130587151 wait complete. 2024-05-30T16:54:37.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc25f200640 1 Processor -- start 2024-05-30T16:54:37.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.403+0000 7fc25f200640 1 -- start start 2024-05-30T16:54:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc25f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc26009b4b0 0x7fc26006e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc25f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26009b890 0x7fc26015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc25f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc260162340 0x7fc26015ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc25f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc260070b70 con 0x7fc26009b890 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc25f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc26015fb70 con 0x7fc260162340 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc25f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc260070cf0 con 0x7fc26009b4b0 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc255400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26009b890 0x7fc26015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc255400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26009b890 0x7fc26015a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54712/0 (socket says 172.21.15.59:54712) 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc255400640 1 -- 172.21.15.59:0/1614777853 learned_addr learned my addr 172.21.15.59:0/1614777853 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc25e800640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc260162340 0x7fc26015ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc25de00640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc26009b4b0 0x7fc26006e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc255400640 1 -- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc26009b4b0 msgr2=0x7fc26006e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc255400640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc26009b4b0 0x7fc26006e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc255400640 1 -- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc260162340 msgr2=0x7fc26015ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc255400640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc260162340 0x7fc26015ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc255400640 1 -- 172.21.15.59:0/1614777853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2600c6cb0 con 0x7fc26009b890 2024-05-30T16:54:37.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc25de00640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc26009b4b0 0x7fc26006e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:37.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc255400640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26009b890 0x7fc26015a8f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc2480ae040 tx=0x7fc2480190a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:37.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc256a00640 1 -- 172.21.15.59:0/1614777853 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2480b0040 con 0x7fc26009b890 2024-05-30T16:54:37.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc256a00640 1 -- 172.21.15.59:0/1614777853 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2480b9070 con 0x7fc26009b890 2024-05-30T16:54:37.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc256a00640 1 -- 172.21.15.59:0/1614777853 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2480b4830 con 0x7fc26009b890 2024-05-30T16:54:37.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc25f200640 1 -- 172.21.15.59:0/1614777853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2600c6f90 con 0x7fc26009b890 2024-05-30T16:54:37.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc25f200640 1 -- 172.21.15.59:0/1614777853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2600c7550 con 0x7fc26009b890 2024-05-30T16:54:37.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.407+0000 7fc25f200640 1 -- 172.21.15.59:0/1614777853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc260068a90 con 0x7fc26009b890 2024-05-30T16:54:37.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.411+0000 7fc256a00640 1 -- 172.21.15.59:0/1614777853 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fc2480b49d0 con 0x7fc26009b890 2024-05-30T16:54:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.411+0000 7fc256a00640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc23c068b60 0x7fc23c06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.411+0000 7fc256a00640 1 -- 172.21.15.59:0/1614777853 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4999+0+0 (secure 0 0 0) 0x7fc248121730 con 0x7fc26009b890 2024-05-30T16:54:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.411+0000 7fc25de00640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc23c068b60 0x7fc23c06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.411+0000 7fc25de00640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc23c068b60 0x7fc23c06b020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc250001570 tx=0x7fc250009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:37.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.415+0000 7fc256a00640 1 -- 172.21.15.59:0/1614777853 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc248015fb0 con 0x7fc26009b890 2024-05-30T16:54:37.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.611+0000 7fc25f200640 1 -- 172.21.15.59:0/1614777853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc26006cbd0 con 0x7fc26009b890 2024-05-30T16:54:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.615+0000 7fc256a00640 1 -- 172.21.15.59:0/1614777853 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fc2480f1210 con 0x7fc26009b890 2024-05-30T16:54:37.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.619+0000 7fc25f200640 1 -- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc23c068b60 msgr2=0x7fc23c06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.619+0000 7fc25f200640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc23c068b60 0x7fc23c06b020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc250001570 tx=0x7fc250009040 comp rx=0 tx=0).stop 2024-05-30T16:54:37.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.619+0000 7fc25f200640 1 -- 172.21.15.59:0/1614777853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26009b890 msgr2=0x7fc26015a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.619+0000 7fc25f200640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26009b890 0x7fc26015a8f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc2480ae040 tx=0x7fc2480190a0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.619+0000 7fc25f200640 1 -- 172.21.15.59:0/1614777853 shutdown_connections 2024-05-30T16:54:37.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.619+0000 7fc25f200640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc23c068b60 0x7fc23c06b020 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.619+0000 7fc25f200640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc260162340 0x7fc26015ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.619+0000 7fc25f200640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26009b890 0x7fc26015a8f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.619+0000 7fc25f200640 1 --2- 172.21.15.59:0/1614777853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc26009b4b0 0x7fc26006e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.619+0000 7fc25f200640 1 -- 172.21.15.59:0/1614777853 >> 172.21.15.59:0/1614777853 conn(0x7fc2600b3ec0 msgr2=0x7fc2600b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.619+0000 7fc25f200640 1 -- 172.21.15.59:0/1614777853 shutdown_connections 2024-05-30T16:54:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.619+0000 7fc25f200640 1 -- 172.21.15.59:0/1614777853 wait complete. 2024-05-30T16:54:37.641 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones' 2024-05-30T16:54:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76cd600640 1 Processor -- start 2024-05-30T16:54:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76cd600640 1 -- start start 2024-05-30T16:54:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76cd600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f76c806e900 0x7f76c815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76cd600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c815f060 con 0x7f76c80af720 2024-05-30T16:54:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76cd600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c80afb00 con 0x7f76c80d0560 2024-05-30T16:54:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76cd600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f76c815c270 con 0x7f76c806e900 2024-05-30T16:54:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76c6a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f76c80af720 0x7f76c815b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58708/0 (socket says 172.21.15.59:58708) 2024-05-30T16:54:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76c6a00640 1 -- 172.21.15.59:0/3107287975 learned_addr learned my addr 172.21.15.59:0/3107287975 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76bfe00640 1 --2- 172.21.15.59:0/3107287975 >> v2:172.21.15.59:3300/0 conn(0x7f76c806e900 0x7f76c815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76bfe00640 1 -- 172.21.15.59:0/3107287975 >> v1:172.21.15.107:6789/0 conn(0x7f76c80d0560 legacy=0x7f76c8072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76bfe00640 1 -- 172.21.15.59:0/3107287975 >> v1:172.21.15.59:6789/0 conn(0x7f76c80af720 legacy=0x7f76c815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76c6000640 1 -- 172.21.15.59:0/3107287975 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3698687838 0 0) 0x7f76c815f060 con 0x7f76c80af720 2024-05-30T16:54:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.779+0000 7f76bfe00640 1 -- 172.21.15.59:0/3107287975 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c815c550 con 0x7f76c806e900 2024-05-30T16:54:37.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.783+0000 7f76bfe00640 1 --2- 172.21.15.59:0/3107287975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c806e900 0x7f76c815f7f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f76b00097c0 tx=0x7f76b001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225ddec7f823645d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:37.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.783+0000 7f76c6000640 1 -- 172.21.15.59:0/3107287975 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b00aa5f0 con 0x7f76c806e900 2024-05-30T16:54:37.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.783+0000 7f76c6000640 1 -- 172.21.15.59:0/3107287975 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b00af070 con 0x7f76c806e900 2024-05-30T16:54:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.783+0000 7f76c6000640 1 -- 172.21.15.59:0/3107287975 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b00aa9b0 con 0x7f76c806e900 2024-05-30T16:54:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.783+0000 7f76cd600640 1 -- 172.21.15.59:0/3107287975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c806e900 msgr2=0x7f76c815f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.783+0000 7f76cd600640 1 --2- 172.21.15.59:0/3107287975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c806e900 0x7f76c815f7f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f76b00097c0 tx=0x7f76b001c470 comp rx=0 tx=0).stop 2024-05-30T16:54:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.783+0000 7f76cd600640 1 -- 172.21.15.59:0/3107287975 shutdown_connections 2024-05-30T16:54:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.783+0000 7f76cd600640 1 --2- 172.21.15.59:0/3107287975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c806e900 0x7f76c815f7f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.783+0000 7f76cd600640 1 -- 172.21.15.59:0/3107287975 >> 172.21.15.59:0/3107287975 conn(0x7f76c80b22d0 msgr2=0x7f76c80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.783+0000 7f76cd600640 1 -- 172.21.15.59:0/3107287975 shutdown_connections 2024-05-30T16:54:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.783+0000 7f76cd600640 1 -- 172.21.15.59:0/3107287975 wait complete. 2024-05-30T16:54:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76cd600640 1 Processor -- start 2024-05-30T16:54:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76cd600640 1 -- start start 2024-05-30T16:54:37.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76cd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c806e900 0x7f76c813cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:37.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76cd600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76c80af720 0x7f76c8159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:37.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76cd600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c80d0560 0x7f76c814e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76cd600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76c815feb0 con 0x7f76c806e900 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76cd600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f76c815fd30 con 0x7f76c80af720 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76cd600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f76c8158dd0 con 0x7f76c80d0560 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76c6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c806e900 0x7f76c813cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76c6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c806e900 0x7f76c813cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54740/0 (socket says 172.21.15.59:54740) 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76c6a00640 1 -- 172.21.15.59:0/1773955106 learned_addr learned my addr 172.21.15.59:0/1773955106 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76c7400640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c80d0560 0x7f76c814e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76bfe00640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76c80af720 0x7f76c8159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76c6a00640 1 -- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c80d0560 msgr2=0x7f76c814e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76c6a00640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c80d0560 0x7f76c814e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76c6a00640 1 -- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76c80af720 msgr2=0x7f76c8159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76c6a00640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76c80af720 0x7f76c8159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76c6a00640 1 -- 172.21.15.59:0/1773955106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c813fb10 con 0x7f76c806e900 2024-05-30T16:54:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76c6a00640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c806e900 0x7f76c813cdc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f76b800c4a0 tx=0x7f76b800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76bea00640 1 -- 172.21.15.59:0/1773955106 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8018070 con 0x7f76c806e900 2024-05-30T16:54:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76bea00640 1 -- 172.21.15.59:0/1773955106 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b80074e0 con 0x7f76c806e900 2024-05-30T16:54:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76bea00640 1 -- 172.21.15.59:0/1773955106 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8004a30 con 0x7f76c806e900 2024-05-30T16:54:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76cd600640 1 -- 172.21.15.59:0/1773955106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c81438b0 con 0x7f76c806e900 2024-05-30T16:54:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.787+0000 7f76cd600640 1 -- 172.21.15.59:0/1773955106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c8143e70 con 0x7f76c806e900 2024-05-30T16:54:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.791+0000 7f76cd600640 1 -- 172.21.15.59:0/1773955106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c8068a90 con 0x7f76c806e900 2024-05-30T16:54:37.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.791+0000 7f76bea00640 1 -- 172.21.15.59:0/1773955106 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f76b8004bd0 con 0x7f76c806e900 2024-05-30T16:54:37.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.791+0000 7f76bea00640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76a4068b60 0x7f76a406b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:37.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.791+0000 7f76bea00640 1 -- 172.21.15.59:0/1773955106 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4999+0+0 (secure 0 0 0) 0x7f76b8086cc0 con 0x7f76c806e900 2024-05-30T16:54:37.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.791+0000 7f76bfe00640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76a4068b60 0x7f76a406b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:37.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.791+0000 7f76bfe00640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76a4068b60 0x7f76a406b020 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f76b00ae000 tx=0x7f76b00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:37.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:37.795+0000 7f76bea00640 1 -- 172.21.15.59:0/1773955106 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f76b8055ed0 con 0x7f76c806e900 2024-05-30T16:54:38.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.023+0000 7f76cd600640 1 -- 172.21.15.59:0/1773955106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]} v 0) -- 0x7f76c80cf3a0 con 0x7f76c806e900 2024-05-30T16:54:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76bea00640 1 -- 172.21.15.59:0/1773955106 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]}]=0 v255) ==== 162+0+0 (secure 0 0 0) 0x7f76b805a1d0 con 0x7f76c806e900 2024-05-30T16:54:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76cd600640 1 -- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76a4068b60 msgr2=0x7f76a406b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76cd600640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76a4068b60 0x7f76a406b020 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f76b00ae000 tx=0x7f76b00a7000 comp rx=0 tx=0).stop 2024-05-30T16:54:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76cd600640 1 -- 172.21.15.59:0/1773955106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c806e900 msgr2=0x7f76c813cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76cd600640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c806e900 0x7f76c813cdc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f76b800c4a0 tx=0x7f76b800c960 comp rx=0 tx=0).stop 2024-05-30T16:54:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76cd600640 1 -- 172.21.15.59:0/1773955106 shutdown_connections 2024-05-30T16:54:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76cd600640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76a4068b60 0x7f76a406b020 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76cd600640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76c80d0560 0x7f76c814e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76cd600640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76c80af720 0x7f76c8159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76cd600640 1 --2- 172.21.15.59:0/1773955106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76c806e900 0x7f76c813cdc0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76cd600640 1 -- 172.21.15.59:0/1773955106 >> 172.21.15.59:0/1773955106 conn(0x7f76c80b22d0 msgr2=0x7f76c80afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76cd600640 1 -- 172.21.15.59:0/1773955106 shutdown_connections 2024-05-30T16:54:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.223+0000 7f76cd600640 1 -- 172.21.15.59:0/1773955106 wait complete. 2024-05-30T16:54:38.248 INFO:tasks.cephfs_test_runner:Test that one progress bar is printed when number of clone jobs is ... ok 2024-05-30T16:54:38.248 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that 2 progress bars are printed when number of clone jobs is 2024-05-30T16:54:38.248 INFO:tasks.cephfs_test_runner:test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:54:38.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:54:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb753e00640 1 Processor -- start 2024-05-30T16:54:38.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb753e00640 1 -- start start 2024-05-30T16:54:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb753e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb75415b4b0 0x7fb75406f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb753e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540b0170 0x7fb75406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb753e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7540d0890 con 0x7fb754067760 2024-05-30T16:54:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb753e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb754067d00 con 0x7fb75415b4b0 2024-05-30T16:54:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb753e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb75415ef20 con 0x7fb7540b0170 2024-05-30T16:54:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb74be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540b0170 0x7fb75406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb752a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb75415b4b0 0x7fb75406f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb753400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb754067760 0x7fb75415b890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:38096/0 (socket says 172.21.15.59:38096) 2024-05-30T16:54:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb752a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb75415b4b0 0x7fb75406f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:52342/0 (socket says 172.21.15.59:52342) 2024-05-30T16:54:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb753400640 1 -- 172.21.15.59:0/2700519642 learned_addr learned my addr 172.21.15.59:0/2700519642 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb74be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540b0170 0x7fb75406fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:45248/0 (socket says 172.21.15.59:45248) 2024-05-30T16:54:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb74be00640 1 -- 172.21.15.59:0/2700519642 >> v2:172.21.15.107:3300/0 conn(0x7fb75415b4b0 msgr2=0x7fb75406f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb74be00640 1 --2- 172.21.15.59:0/2700519642 >> v2:172.21.15.107:3300/0 conn(0x7fb75415b4b0 0x7fb75406f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb74be00640 1 -- 172.21.15.59:0/2700519642 >> v1:172.21.15.107:6789/0 conn(0x7fb754067760 legacy=0x7fb75415b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb752000640 1 -- 172.21.15.59:0/2700519642 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1272037326 0 0) 0x7fb7540d0890 con 0x7fb754067760 2024-05-30T16:54:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb74be00640 1 -- 172.21.15.59:0/2700519642 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75415f200 con 0x7fb7540b0170 2024-05-30T16:54:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.387+0000 7fb752a00640 1 --2- 172.21.15.59:0/2700519642 >> v2:172.21.15.107:3300/0 conn(0x7fb75415b4b0 0x7fb75406f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:54:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.391+0000 7fb74be00640 1 --2- 172.21.15.59:0/2700519642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540b0170 0x7fb75406fc00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0097f0 tx=0x7fb73c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17bbc79e736e2950 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.391+0000 7fb752000640 1 -- 172.21.15.59:0/2700519642 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0a7070 con 0x7fb7540b0170 2024-05-30T16:54:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.391+0000 7fb752000640 1 -- 172.21.15.59:0/2700519642 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb73c0b0070 con 0x7fb7540b0170 2024-05-30T16:54:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.391+0000 7fb752000640 1 -- 172.21.15.59:0/2700519642 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0ab890 con 0x7fb7540b0170 2024-05-30T16:54:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.391+0000 7fb753e00640 1 -- 172.21.15.59:0/2700519642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540b0170 msgr2=0x7fb75406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.391+0000 7fb753e00640 1 --2- 172.21.15.59:0/2700519642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540b0170 0x7fb75406fc00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0097f0 tx=0x7fb73c01c470 comp rx=0 tx=0).stop 2024-05-30T16:54:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.391+0000 7fb753e00640 1 -- 172.21.15.59:0/2700519642 shutdown_connections 2024-05-30T16:54:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.391+0000 7fb753e00640 1 --2- 172.21.15.59:0/2700519642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540b0170 0x7fb75406fc00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.391+0000 7fb753e00640 1 --2- 172.21.15.59:0/2700519642 >> v2:172.21.15.107:3300/0 conn(0x7fb75415b4b0 0x7fb75406f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.391+0000 7fb753e00640 1 -- 172.21.15.59:0/2700519642 >> 172.21.15.59:0/2700519642 conn(0x7fb7540733a0 msgr2=0x7fb75406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.391+0000 7fb753e00640 1 -- 172.21.15.59:0/2700519642 shutdown_connections 2024-05-30T16:54:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.391+0000 7fb753e00640 1 -- 172.21.15.59:0/2700519642 wait complete. 2024-05-30T16:54:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb753e00640 1 Processor -- start 2024-05-30T16:54:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb753e00640 1 -- start start 2024-05-30T16:54:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb753e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb754067760 0x7fb75414d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb753e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540b0170 0x7fb7541393b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb753e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb75415b4b0 0x7fb75414b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb753e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb75406e5b0 con 0x7fb754067760 2024-05-30T16:54:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb753e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb75406d1f0 con 0x7fb75415b4b0 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb753e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb75406e730 con 0x7fb7540b0170 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb752a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb754067760 0x7fb75414d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb752a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb754067760 0x7fb75414d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54754/0 (socket says 172.21.15.59:54754) 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb752a00640 1 -- 172.21.15.59:0/4124478180 learned_addr learned my addr 172.21.15.59:0/4124478180 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb74be00640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540b0170 0x7fb7541393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb753400640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb75415b4b0 0x7fb75414b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb752a00640 1 -- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540b0170 msgr2=0x7fb7541393b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb752a00640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540b0170 0x7fb7541393b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb752a00640 1 -- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb75415b4b0 msgr2=0x7fb75414b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb752a00640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb75415b4b0 0x7fb75414b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb752a00640 1 -- 172.21.15.59:0/4124478180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75414bbe0 con 0x7fb754067760 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb753400640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb75415b4b0 0x7fb75414b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb752a00640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb754067760 0x7fb75414d190 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb74400e980 tx=0x7fb74400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb74b400640 1 -- 172.21.15.59:0/4124478180 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744017070 con 0x7fb754067760 2024-05-30T16:54:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb74b400640 1 -- 172.21.15.59:0/4124478180 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74400ca00 con 0x7fb754067760 2024-05-30T16:54:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb74b400640 1 -- 172.21.15.59:0/4124478180 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74400cdd0 con 0x7fb754067760 2024-05-30T16:54:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb753e00640 1 -- 172.21.15.59:0/4124478180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7541555d0 con 0x7fb754067760 2024-05-30T16:54:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.395+0000 7fb753e00640 1 -- 172.21.15.59:0/4124478180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb754155b90 con 0x7fb754067760 2024-05-30T16:54:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.399+0000 7fb753e00640 1 -- 172.21.15.59:0/4124478180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7540691a0 con 0x7fb754067760 2024-05-30T16:54:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.399+0000 7fb74b400640 1 -- 172.21.15.59:0/4124478180 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fb74401a070 con 0x7fb754067760 2024-05-30T16:54:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.399+0000 7fb74b400640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb730068b60 0x7fb73006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.399+0000 7fb74b400640 1 -- 172.21.15.59:0/4124478180 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4999+0+0 (secure 0 0 0) 0x7fb744087bf0 con 0x7fb754067760 2024-05-30T16:54:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.399+0000 7fb74be00640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb730068b60 0x7fb73006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.399+0000 7fb74be00640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb730068b60 0x7fb73006b020 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0af000 tx=0x7fb73c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.403+0000 7fb74b400640 1 -- 172.21.15.59:0/4124478180 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb744056e00 con 0x7fb754067760 2024-05-30T16:54:38.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.571+0000 7fb753e00640 1 -- 172.21.15.59:0/4124478180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7540cd1a0 con 0x7fb754067760 2024-05-30T16:54:38.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.571+0000 7fb74b400640 1 -- 172.21.15.59:0/4124478180 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+13095 (secure 0 0 0) 0x7fb74405b100 con 0x7fb754067760 2024-05-30T16:54:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:38.576 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":53,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:54:37.220852+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/3019371755":"2024-05-31T16:54:34.210983+0000","172.21.15.59:6833/3019371755":"2024-05-31T16:54:34.210983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:54:38.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.575+0000 7fb753e00640 1 -- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb730068b60 msgr2=0x7fb73006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.575+0000 7fb753e00640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb730068b60 0x7fb73006b020 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0af000 tx=0x7fb73c0a7000 comp rx=0 tx=0).stop 2024-05-30T16:54:38.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.575+0000 7fb753e00640 1 -- 172.21.15.59:0/4124478180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb754067760 msgr2=0x7fb75414d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.575+0000 7fb753e00640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb754067760 0x7fb75414d190 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb74400e980 tx=0x7fb74400ee40 comp rx=0 tx=0).stop 2024-05-30T16:54:38.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.575+0000 7fb753e00640 1 -- 172.21.15.59:0/4124478180 shutdown_connections 2024-05-30T16:54:38.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.575+0000 7fb753e00640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb730068b60 0x7fb73006b020 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.575+0000 7fb753e00640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb75415b4b0 0x7fb75414b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.575+0000 7fb753e00640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540b0170 0x7fb7541393b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.575+0000 7fb753e00640 1 --2- 172.21.15.59:0/4124478180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb754067760 0x7fb75414d190 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.575+0000 7fb753e00640 1 -- 172.21.15.59:0/4124478180 >> 172.21.15.59:0/4124478180 conn(0x7fb7540733a0 msgr2=0x7fb75415cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:38.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.575+0000 7fb753e00640 1 -- 172.21.15.59:0/4124478180 shutdown_connections 2024-05-30T16:54:38.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.575+0000 7fb753e00640 1 -- 172.21.15.59:0/4124478180 wait complete. 2024-05-30T16:54:38.597 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T16:48:53.098546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T16:54:38.598 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T16:54:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f8693a00640 1 Processor -- start 2024-05-30T16:54:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f8693a00640 1 -- start start 2024-05-30T16:54:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f8693a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f868c0d05b0 0x7f868c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f8693a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868c070950 con 0x7f868c0d14c0 2024-05-30T16:54:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f8693a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868c070c30 con 0x7f868c09af80 2024-05-30T16:54:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f8693a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f868c09b3f0 con 0x7f868c0d05b0 2024-05-30T16:54:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f8691000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f868c0d14c0 0x7f868c06e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58712/0 (socket says 172.21.15.59:58712) 2024-05-30T16:54:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f8691000640 1 -- 172.21.15.59:0/1367318404 learned_addr learned my addr 172.21.15.59:0/1367318404 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868be00640 1 --2- 172.21.15.59:0/1367318404 >> v2:172.21.15.107:3300/0 conn(0x7f868c0d05b0 0x7f868c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 771796441 0 0) 0x7f868c070950 con 0x7f868c0d14c0 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8674003530 con 0x7f868c0d14c0 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1710482930 0 0) 0x7f8674003530 con 0x7f868c0d14c0 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 >> v2:172.21.15.107:3300/0 conn(0x7f868c0d05b0 msgr2=0x7f868c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 --2- 172.21.15.59:0/1367318404 >> v2:172.21.15.107:3300/0 conn(0x7f868c0d05b0 0x7f868c09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 >> v1:172.21.15.107:6789/0 conn(0x7f868c09af80 legacy=0x7f868c06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c070f10 con 0x7f868c0d14c0 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f8680001680 con 0x7f868c0d14c0 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 >> v1:172.21.15.59:6789/0 conn(0x7f868c0d14c0 legacy=0x7f868c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 --2- 172.21.15.59:0/1367318404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86740039c0 0x7f8674003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 --2- 172.21.15.59:0/1367318404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8674004810 0x7f8674004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 --2- 172.21.15.59:0/1367318404 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86740051d0 0x7f867400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f868c09b3f0 con 0x7f8674004810 2024-05-30T16:54:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f867400c070 con 0x7f86740039c0 2024-05-30T16:54:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f867400c270 con 0x7f86740051d0 2024-05-30T16:54:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.739+0000 7f868be00640 1 --2- 172.21.15.59:0/1367318404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8674004810 0x7f8674004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f8691000640 1 --2- 172.21.15.59:0/1367318404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86740039c0 0x7f8674003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f8691a00640 1 --2- 172.21.15.59:0/1367318404 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86740051d0 0x7f867400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f868be00640 1 -- 172.21.15.59:0/1367318404 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86740051d0 msgr2=0x7f867400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f868be00640 1 --2- 172.21.15.59:0/1367318404 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86740051d0 0x7f867400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f868be00640 1 -- 172.21.15.59:0/1367318404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86740039c0 msgr2=0x7f8674003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f868be00640 1 --2- 172.21.15.59:0/1367318404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86740039c0 0x7f8674003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f868be00640 1 -- 172.21.15.59:0/1367318404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8674003530 con 0x7f8674004810 2024-05-30T16:54:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f8691a00640 1 --2- 172.21.15.59:0/1367318404 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86740051d0 0x7f867400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:38.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f8691a00640 1 -- 172.21.15.59:0/1367318404 reap_dead start 2024-05-30T16:54:38.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f868be00640 1 --2- 172.21.15.59:0/1367318404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8674004810 0x7f8674004c90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8678009ae0 tx=0x7f867801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e137d020a9a6840c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86780b2070 con 0x7f8674004810 2024-05-30T16:54:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86780a5550 con 0x7f8674004810 2024-05-30T16:54:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f868b400640 1 -- 172.21.15.59:0/1367318404 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86780096b0 con 0x7f8674004810 2024-05-30T16:54:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f8693a00640 1 -- 172.21.15.59:0/1367318404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8674004810 msgr2=0x7f8674004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.743+0000 7f8693a00640 1 --2- 172.21.15.59:0/1367318404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8674004810 0x7f8674004c90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8678009ae0 tx=0x7f867801ca70 comp rx=0 tx=0).stop 2024-05-30T16:54:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 -- 172.21.15.59:0/1367318404 shutdown_connections 2024-05-30T16:54:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 --2- 172.21.15.59:0/1367318404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8674004810 0x7f8674004c90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 -- 172.21.15.59:0/1367318404 >> 172.21.15.59:0/1367318404 conn(0x7f868c0b3f80 msgr2=0x7f868c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 -- 172.21.15.59:0/1367318404 shutdown_connections 2024-05-30T16:54:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 -- 172.21.15.59:0/1367318404 wait complete. 2024-05-30T16:54:38.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 Processor -- start 2024-05-30T16:54:38.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 -- start start 2024-05-30T16:54:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8674004810 0x7f868c0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f868c1f5300 0x7f868c1ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c1dcd40 0x7f868c0c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f868c0d0a60 con 0x7f868c1dcd40 2024-05-30T16:54:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f868c0711f0 con 0x7f868c1f5300 2024-05-30T16:54:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8693a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f868c0d18a0 con 0x7f8674004810 2024-05-30T16:54:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8691a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c1dcd40 0x7f868c0c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8691a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c1dcd40 0x7f868c0c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54762/0 (socket says 172.21.15.59:54762) 2024-05-30T16:54:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8691a00640 1 -- 172.21.15.59:0/3573384177 learned_addr learned my addr 172.21.15.59:0/3573384177 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8691000640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8674004810 0x7f868c0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f868be00640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f868c1f5300 0x7f868c1ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8691a00640 1 -- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8674004810 msgr2=0x7f868c0c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8691a00640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8674004810 0x7f868c0c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8691a00640 1 -- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f868c1f5300 msgr2=0x7f868c1ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8691a00640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f868c1f5300 0x7f868c1ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8691a00640 1 -- 172.21.15.59:0/3573384177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c1e76b0 con 0x7f868c1dcd40 2024-05-30T16:54:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f868be00640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f868c1f5300 0x7f868c1ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.747+0000 7f8691a00640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c1dcd40 0x7f868c0c5f80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f868c0a0530 tx=0x7f868400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.751+0000 7f8688c00640 1 -- 172.21.15.59:0/3573384177 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684003980 con 0x7f868c1dcd40 2024-05-30T16:54:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.751+0000 7f8688c00640 1 -- 172.21.15.59:0/3573384177 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8684018070 con 0x7f868c1dcd40 2024-05-30T16:54:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.751+0000 7f8688c00640 1 -- 172.21.15.59:0/3573384177 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684003d60 con 0x7f868c1dcd40 2024-05-30T16:54:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.751+0000 7f8693a00640 1 -- 172.21.15.59:0/3573384177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f868c1e7950 con 0x7f868c1dcd40 2024-05-30T16:54:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.751+0000 7f8693a00640 1 -- 172.21.15.59:0/3573384177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f868c0c8e40 con 0x7f868c1dcd40 2024-05-30T16:54:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.751+0000 7f8693a00640 1 -- 172.21.15.59:0/3573384177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f868c068a90 con 0x7f868c1dcd40 2024-05-30T16:54:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.751+0000 7f8688c00640 1 -- 172.21.15.59:0/3573384177 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f86840050d0 con 0x7f868c1dcd40 2024-05-30T16:54:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.751+0000 7f8688c00640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f866c068b60 0x7f866c06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.751+0000 7f8688c00640 1 -- 172.21.15.59:0/3573384177 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4999+0+0 (secure 0 0 0) 0x7f8684084d20 con 0x7f868c1dcd40 2024-05-30T16:54:38.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.751+0000 7f8691000640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f866c068b60 0x7f866c06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:38.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.755+0000 7f8691000640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f866c068b60 0x7f866c06b020 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8680001060 tx=0x7f8680001c40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:38.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.755+0000 7f8688c00640 1 -- 172.21.15.59:0/3573384177 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8684022020 con 0x7f868c1dcd40 2024-05-30T16:54:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 -- 172.21.15.59:0/3573384177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f868c0b4be0 con 0x7f868c1dcd40 2024-05-30T16:54:38.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8688c00640 1 -- 172.21.15.59:0/3573384177 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) ==== 93+0+10 (secure 0 0 0) 0x7f8684056bd0 con 0x7f868c1dcd40 2024-05-30T16:54:38.926 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-05-30T16:54:38.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 -- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f866c068b60 msgr2=0x7f866c06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f866c068b60 0x7f866c06b020 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8680001060 tx=0x7f8680001c40 comp rx=0 tx=0).stop 2024-05-30T16:54:38.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 -- 172.21.15.59:0/3573384177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c1dcd40 msgr2=0x7f868c0c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:38.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c1dcd40 0x7f868c0c5f80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f868c0a0530 tx=0x7f868400eb90 comp rx=0 tx=0).stop 2024-05-30T16:54:38.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 -- 172.21.15.59:0/3573384177 shutdown_connections 2024-05-30T16:54:38.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f866c068b60 0x7f866c06b020 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c1dcd40 0x7f868c0c5f80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f868c1f5300 0x7f868c1ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 --2- 172.21.15.59:0/3573384177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8674004810 0x7f868c0c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:38.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 -- 172.21.15.59:0/3573384177 >> 172.21.15.59:0/3573384177 conn(0x7f868c0b3f80 msgr2=0x7f868c0b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:38.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 -- 172.21.15.59:0/3573384177 shutdown_connections 2024-05-30T16:54:38.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:38.923+0000 7f8693a00640 1 -- 172.21.15.59:0/3573384177 wait complete. 2024-05-30T16:54:38.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones' 2024-05-30T16:54:39.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d82800640 1 Processor -- start 2024-05-30T16:54:39.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d82800640 1 -- start start 2024-05-30T16:54:39.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d82800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d7c09b150 0x7f3d7c1699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:39.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d82800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7c070950 con 0x7f3d7c0d05b0 2024-05-30T16:54:39.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d82800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7c070c30 con 0x7f3d7c0d14c0 2024-05-30T16:54:39.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d82800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3d7c070f10 con 0x7f3d7c09b150 2024-05-30T16:54:39.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d7be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d7c09b150 0x7f3d7c1699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:39.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d73e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3d7c0d05b0 0x7f3d7c09aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58724/0 (socket says 172.21.15.59:58724) 2024-05-30T16:54:39.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d7be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d7c09b150 0x7f3d7c1699b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54766/0 (socket says 172.21.15.59:54766) 2024-05-30T16:54:39.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d73e00640 1 -- 172.21.15.59:0/3148170919 learned_addr learned my addr 172.21.15.59:0/3148170919 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:39.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d7be00640 1 -- 172.21.15.59:0/3148170919 >> v1:172.21.15.107:6789/0 conn(0x7f3d7c0d14c0 legacy=0x7f3d7c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:39.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d7be00640 1 -- 172.21.15.59:0/3148170919 >> v1:172.21.15.59:6789/0 conn(0x7f3d7c0d05b0 legacy=0x7f3d7c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:39.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d7be00640 1 -- 172.21.15.59:0/3148170919 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c06cbd0 con 0x7f3d7c09b150 2024-05-30T16:54:39.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.087+0000 7f3d7aa00640 1 -- 172.21.15.59:0/3148170919 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211520658 0 0) 0x7f3d7c070950 con 0x7f3d7c0d05b0 2024-05-30T16:54:39.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.091+0000 7f3d7be00640 1 --2- 172.21.15.59:0/3148170919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c09b150 0x7f3d7c1699b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009d90 tx=0x7f3d7401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7f5a213df0a70c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:39.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.091+0000 7f3d7aa00640 1 -- 172.21.15.59:0/3148170919 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d740b2070 con 0x7f3d7c09b150 2024-05-30T16:54:39.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.091+0000 7f3d7aa00640 1 -- 172.21.15.59:0/3148170919 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d740a59b0 con 0x7f3d7c09b150 2024-05-30T16:54:39.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.091+0000 7f3d7aa00640 1 -- 172.21.15.59:0/3148170919 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d740a5d80 con 0x7f3d7c09b150 2024-05-30T16:54:39.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.091+0000 7f3d82800640 1 -- 172.21.15.59:0/3148170919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c09b150 msgr2=0x7f3d7c1699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:39.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.091+0000 7f3d82800640 1 --2- 172.21.15.59:0/3148170919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c09b150 0x7f3d7c1699b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009d90 tx=0x7f3d7401c8d0 comp rx=0 tx=0).stop 2024-05-30T16:54:39.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.091+0000 7f3d82800640 1 -- 172.21.15.59:0/3148170919 shutdown_connections 2024-05-30T16:54:39.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.091+0000 7f3d82800640 1 --2- 172.21.15.59:0/3148170919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c09b150 0x7f3d7c1699b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:39.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.091+0000 7f3d82800640 1 -- 172.21.15.59:0/3148170919 >> 172.21.15.59:0/3148170919 conn(0x7f3d7c0b3f80 msgr2=0x7f3d7c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:39.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.091+0000 7f3d82800640 1 -- 172.21.15.59:0/3148170919 shutdown_connections 2024-05-30T16:54:39.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.091+0000 7f3d82800640 1 -- 172.21.15.59:0/3148170919 wait complete. 2024-05-30T16:54:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d82800640 1 Processor -- start 2024-05-30T16:54:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d82800640 1 -- start start 2024-05-30T16:54:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d82800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c09b150 0x7f3d7c0b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d82800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d7c0d05b0 0x7f3d7c0ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d82800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d7c0d14c0 0x7f3d7c0b76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d82800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c06e280 con 0x7f3d7c09b150 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d82800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c06e100 con 0x7f3d7c0d05b0 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d82800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7c16c710 con 0x7f3d7c0d14c0 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d7b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c09b150 0x7f3d7c0b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d7b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c09b150 0x7f3d7c0b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54780/0 (socket says 172.21.15.59:54780) 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d7b400640 1 -- 172.21.15.59:0/567730926 learned_addr learned my addr 172.21.15.59:0/567730926 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d73e00640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d7c0d05b0 0x7f3d7c0ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d7be00640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d7c0d14c0 0x7f3d7c0b76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d7b400640 1 -- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d7c0d14c0 msgr2=0x7f3d7c0b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d7b400640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d7c0d14c0 0x7f3d7c0b76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d7b400640 1 -- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d7c0d05b0 msgr2=0x7f3d7c0ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d7b400640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d7c0d05b0 0x7f3d7c0ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d7b400640 1 -- 172.21.15.59:0/567730926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c0c97b0 con 0x7f3d7c09b150 2024-05-30T16:54:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d7b400640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c09b150 0x7f3d7c0b6d60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00b410 tx=0x7f3d6c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d73400640 1 -- 172.21.15.59:0/567730926 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c015030 con 0x7f3d7c09b150 2024-05-30T16:54:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d73400640 1 -- 172.21.15.59:0/567730926 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6c004020 con 0x7f3d7c09b150 2024-05-30T16:54:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d73400640 1 -- 172.21.15.59:0/567730926 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c004450 con 0x7f3d7c09b150 2024-05-30T16:54:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d82800640 1 -- 172.21.15.59:0/567730926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c0c9a90 con 0x7f3d7c09b150 2024-05-30T16:54:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d82800640 1 -- 172.21.15.59:0/567730926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7c0ca050 con 0x7f3d7c09b150 2024-05-30T16:54:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.095+0000 7f3d82800640 1 -- 172.21.15.59:0/567730926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7c068a90 con 0x7f3d7c09b150 2024-05-30T16:54:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.099+0000 7f3d73400640 1 -- 172.21.15.59:0/567730926 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f3d6c018070 con 0x7f3d7c09b150 2024-05-30T16:54:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.099+0000 7f3d73400640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d58068b60 0x7f3d5806b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.099+0000 7f3d73400640 1 -- 172.21.15.59:0/567730926 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4999+0+0 (secure 0 0 0) 0x7f3d6c0873a0 con 0x7f3d7c09b150 2024-05-30T16:54:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.099+0000 7f3d73e00640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d58068b60 0x7f3d5806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:39.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.099+0000 7f3d73e00640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d58068b60 0x7f3d5806b020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0b72a0 tx=0x7f3d64007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:39.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.103+0000 7f3d73400640 1 -- 172.21.15.59:0/567730926 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d6c056640 con 0x7f3d7c09b150 2024-05-30T16:54:39.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:39.331+0000 7f3d82800640 1 -- 172.21.15.59:0/567730926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]} v 0) -- 0x7f3d7c0b2d40 con 0x7f3d7c09b150 2024-05-30T16:54:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.231+0000 7f3d73400640 1 -- 172.21.15.59:0/567730926 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]}]=0 v257) ==== 165+0+0 (secure 0 0 0) 0x7f3d6c05a940 con 0x7f3d7c09b150 2024-05-30T16:54:40.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.235+0000 7f3d82800640 1 -- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d58068b60 msgr2=0x7f3d5806b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:40.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.235+0000 7f3d82800640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d58068b60 0x7f3d5806b020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0b72a0 tx=0x7f3d64007d60 comp rx=0 tx=0).stop 2024-05-30T16:54:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.235+0000 7f3d82800640 1 -- 172.21.15.59:0/567730926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c09b150 msgr2=0x7f3d7c0b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.235+0000 7f3d82800640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c09b150 0x7f3d7c0b6d60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00b410 tx=0x7f3d6c00b8d0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.235+0000 7f3d82800640 1 -- 172.21.15.59:0/567730926 shutdown_connections 2024-05-30T16:54:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.235+0000 7f3d82800640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d58068b60 0x7f3d5806b020 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.235+0000 7f3d82800640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d7c0d14c0 0x7f3d7c0b76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.235+0000 7f3d82800640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d7c0d05b0 0x7f3d7c0ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.235+0000 7f3d82800640 1 --2- 172.21.15.59:0/567730926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c09b150 0x7f3d7c0b6d60 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.235+0000 7f3d82800640 1 -- 172.21.15.59:0/567730926 >> 172.21.15.59:0/567730926 conn(0x7f3d7c0b3f80 msgr2=0x7f3d7c0b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.235+0000 7f3d82800640 1 -- 172.21.15.59:0/567730926 shutdown_connections 2024-05-30T16:54:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.235+0000 7f3d82800640 1 -- 172.21.15.59:0/567730926 wait complete. 2024-05-30T16:54:40.262 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:54:40.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.407+0000 7fc809c00640 1 Processor -- start 2024-05-30T16:54:40.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.407+0000 7fc809c00640 1 -- start start 2024-05-30T16:54:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.407+0000 7fc809c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc804159100 0x7fc80406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.407+0000 7fc809c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8040b52d0 con 0x7fc80415c010 2024-05-30T16:54:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.407+0000 7fc809c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8040b4a30 con 0x7fc8040b44e0 2024-05-30T16:54:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.407+0000 7fc809c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc8040b4d10 con 0x7fc804159100 2024-05-30T16:54:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc803400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc80415c010 0x7fc8040d0790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58726/0 (socket says 172.21.15.59:58726) 2024-05-30T16:54:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc803400640 1 -- 172.21.15.59:0/2277148528 learned_addr learned my addr 172.21.15.59:0/2277148528 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:40.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802a00640 1 --2- 172.21.15.59:0/2277148528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc804159100 0x7fc80406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:40.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2007867250 0 0) 0x7fc8040b52d0 con 0x7fc80415c010 2024-05-30T16:54:40.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7e8003530 con 0x7fc80415c010 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788020760 0 0) 0x7fc8040b4a30 con 0x7fc8040b44e0 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8040b52d0 con 0x7fc8040b44e0 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2698988738 0 0) 0x7fc7e8003530 con 0x7fc80415c010 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc804159100 msgr2=0x7fc80406e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 --2- 172.21.15.59:0/2277148528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc804159100 0x7fc80406e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 >> v1:172.21.15.107:6789/0 conn(0x7fc8040b44e0 legacy=0x7fc80415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8040b4ff0 con 0x7fc80415c010 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fc7fc001a00 con 0x7fc80415c010 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 >> v1:172.21.15.59:6789/0 conn(0x7fc80415c010 legacy=0x7fc8040d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 --2- 172.21.15.59:0/2277148528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7e8003b80 0x7fc7e8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 --2- 172.21.15.59:0/2277148528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc804159100 0x7fc7e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 --2- 172.21.15.59:0/2277148528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8004d50 0x7fc7e80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc8040b4d10 con 0x7fc7e8004d50 2024-05-30T16:54:40.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e800ddf0 con 0x7fc7e8003b80 2024-05-30T16:54:40.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e800dff0 con 0x7fc804159100 2024-05-30T16:54:40.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc803400640 1 --2- 172.21.15.59:0/2277148528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8004d50 0x7fc7e80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:40.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc802a00640 1 --2- 172.21.15.59:0/2277148528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7e8003b80 0x7fc7e8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:40.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc7fbe00640 1 --2- 172.21.15.59:0/2277148528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc804159100 0x7fc7e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:40.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc803400640 1 -- 172.21.15.59:0/2277148528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc804159100 msgr2=0x7fc7e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:40.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc803400640 1 --2- 172.21.15.59:0/2277148528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc804159100 0x7fc7e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc803400640 1 -- 172.21.15.59:0/2277148528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7e8003b80 msgr2=0x7fc7e8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:40.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc803400640 1 --2- 172.21.15.59:0/2277148528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7e8003b80 0x7fc7e8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.411+0000 7fc803400640 1 -- 172.21.15.59:0/2277148528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e8003530 con 0x7fc7e8004d50 2024-05-30T16:54:40.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc803400640 1 --2- 172.21.15.59:0/2277148528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8004d50 0x7fc7e80051d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00a720 tx=0x7fc7fc01d210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34809b34fccbf8a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:40.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00a370 con 0x7fc7e8004d50 2024-05-30T16:54:40.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7fc0ad650 con 0x7fc7e8004d50 2024-05-30T16:54:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc802000640 1 -- 172.21.15.59:0/2277148528 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc0ada40 con 0x7fc7e8004d50 2024-05-30T16:54:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc809c00640 1 -- 172.21.15.59:0/2277148528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8004d50 msgr2=0x7fc7e80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc809c00640 1 --2- 172.21.15.59:0/2277148528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8004d50 0x7fc7e80051d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00a720 tx=0x7fc7fc01d210 comp rx=0 tx=0).stop 2024-05-30T16:54:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc803400640 1 -- 172.21.15.59:0/2277148528 reap_dead start 2024-05-30T16:54:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc809c00640 1 -- 172.21.15.59:0/2277148528 shutdown_connections 2024-05-30T16:54:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc809c00640 1 -- 172.21.15.59:0/2277148528 >> 172.21.15.59:0/2277148528 conn(0x7fc80406bdb0 msgr2=0x7fc80406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc809c00640 1 -- 172.21.15.59:0/2277148528 shutdown_connections 2024-05-30T16:54:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc809c00640 1 -- 172.21.15.59:0/2277148528 wait complete. 2024-05-30T16:54:40.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc809c00640 1 Processor -- start 2024-05-30T16:54:40.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.415+0000 7fc809c00640 1 -- start start 2024-05-30T16:54:40.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc809c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7e8004d50 0x7fc80409a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:40.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc809c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8040b0f90 0x7fc8041476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:40.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc809c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc804147be0 0x7fc8040cf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:40.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc809c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc80415c440 con 0x7fc804147be0 2024-05-30T16:54:40.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc809c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc8040d10b0 con 0x7fc7e8004d50 2024-05-30T16:54:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc809c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc80415c5c0 con 0x7fc8040b0f90 2024-05-30T16:54:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc803400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc804147be0 0x7fc8040cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc803400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc804147be0 0x7fc8040cf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54798/0 (socket says 172.21.15.59:54798) 2024-05-30T16:54:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc803400640 1 -- 172.21.15.59:0/962586169 learned_addr learned my addr 172.21.15.59:0/962586169 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc7fbe00640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8040b0f90 0x7fc8041476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc802a00640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7e8004d50 0x7fc80409a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc803400640 1 -- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8040b0f90 msgr2=0x7fc8041476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc803400640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8040b0f90 0x7fc8041476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc803400640 1 -- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7e8004d50 msgr2=0x7fc80409a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc803400640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7e8004d50 0x7fc80409a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc803400640 1 -- 172.21.15.59:0/962586169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc804148060 con 0x7fc804147be0 2024-05-30T16:54:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc7fbe00640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8040b0f90 0x7fc8041476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc803400640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc804147be0 0x7fc8040cf240 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc01dab0 tx=0x7fc7e8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc7faa00640 1 -- 172.21.15.59:0/962586169 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc0b2040 con 0x7fc804147be0 2024-05-30T16:54:40.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc7faa00640 1 -- 172.21.15.59:0/962586169 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7fc0bc070 con 0x7fc804147be0 2024-05-30T16:54:40.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc809c00640 1 -- 172.21.15.59:0/962586169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8040b1730 con 0x7fc804147be0 2024-05-30T16:54:40.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc7faa00640 1 -- 172.21.15.59:0/962586169 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00a350 con 0x7fc804147be0 2024-05-30T16:54:40.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc809c00640 1 -- 172.21.15.59:0/962586169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8040b1cf0 con 0x7fc804147be0 2024-05-30T16:54:40.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc809c00640 1 -- 172.21.15.59:0/962586169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc804068a90 con 0x7fc804147be0 2024-05-30T16:54:40.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.419+0000 7fc7faa00640 1 -- 172.21.15.59:0/962586169 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fc7fc001800 con 0x7fc804147be0 2024-05-30T16:54:40.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.423+0000 7fc7faa00640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc7e0068b60 0x7fc7e006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:40.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.423+0000 7fc7faa00640 1 -- 172.21.15.59:0/962586169 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4999+0+0 (secure 0 0 0) 0x7fc7fc122010 con 0x7fc804147be0 2024-05-30T16:54:40.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.423+0000 7fc802a00640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc7e0068b60 0x7fc7e006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:40.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.423+0000 7fc802a00640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc7e0068b60 0x7fc7e006b020 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009be0 tx=0x7fc7f4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:40.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.427+0000 7fc7faa00640 1 -- 172.21.15.59:0/962586169 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc7fc016f50 con 0x7fc804147be0 2024-05-30T16:54:40.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.591+0000 7fc809c00640 1 -- 172.21.15.59:0/962586169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc80406ccd0 con 0x7fc804147be0 2024-05-30T16:54:40.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.595+0000 7fc7faa00640 1 -- 172.21.15.59:0/962586169 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fc7fc0c03c0 con 0x7fc804147be0 2024-05-30T16:54:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.599+0000 7fc809c00640 1 -- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc7e0068b60 msgr2=0x7fc7e006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.599+0000 7fc809c00640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc7e0068b60 0x7fc7e006b020 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009be0 tx=0x7fc7f4009190 comp rx=0 tx=0).stop 2024-05-30T16:54:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.599+0000 7fc809c00640 1 -- 172.21.15.59:0/962586169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc804147be0 msgr2=0x7fc8040cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.599+0000 7fc809c00640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc804147be0 0x7fc8040cf240 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc01dab0 tx=0x7fc7e8005840 comp rx=0 tx=0).stop 2024-05-30T16:54:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.599+0000 7fc809c00640 1 -- 172.21.15.59:0/962586169 shutdown_connections 2024-05-30T16:54:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.599+0000 7fc809c00640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc7e0068b60 0x7fc7e006b020 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.599+0000 7fc809c00640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc804147be0 0x7fc8040cf240 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.599+0000 7fc809c00640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8040b0f90 0x7fc8041476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.599+0000 7fc809c00640 1 --2- 172.21.15.59:0/962586169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7e8004d50 0x7fc80409a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.599+0000 7fc809c00640 1 -- 172.21.15.59:0/962586169 >> 172.21.15.59:0/962586169 conn(0x7fc80406bdb0 msgr2=0x7fc8041574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.599+0000 7fc809c00640 1 -- 172.21.15.59:0/962586169 shutdown_connections 2024-05-30T16:54:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:40.599+0000 7fc809c00640 1 -- 172.21.15.59:0/962586169 wait complete. 2024-05-30T16:54:40.621 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:54:40.621 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:54:40.715 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:54:40.798 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:54:40.798 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:54:40.798 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:54:40.807 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:54:40.807 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:54:40.807 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:54:40.817 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:54:40.817 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:54:40.817 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:54:40.856 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:54:40.856 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:54:40.856 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:54:40.867 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:54:40.867 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T16:54:40.867 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:54:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa687800640 1 Processor -- start 2024-05-30T16:54:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa687800640 1 -- start start 2024-05-30T16:54:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa687800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa680146090 0x7fa6800b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa687800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa68006b9b0 0x7fa68006be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa687800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6800b6510 con 0x7fa6800b5f50 2024-05-30T16:54:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa687800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa6800b05d0 con 0x7fa680146090 2024-05-30T16:54:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa687800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa6800aff80 con 0x7fa68006b9b0 2024-05-30T16:54:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa684e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa680146090 0x7fa6800b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa684e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa680146090 0x7fa6800b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54808/0 (socket says 172.21.15.59:54808) 2024-05-30T16:54:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa684e00640 1 -- 172.21.15.59:0/3956884659 learned_addr learned my addr 172.21.15.59:0/3956884659 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa684e00640 1 -- 172.21.15.59:0/3956884659 >> v2:172.21.15.107:3300/0 conn(0x7fa68006b9b0 msgr2=0x7fa68006be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa684e00640 1 --2- 172.21.15.59:0/3956884659 >> v2:172.21.15.107:3300/0 conn(0x7fa68006b9b0 0x7fa68006be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa684e00640 1 -- 172.21.15.59:0/3956884659 >> v1:172.21.15.107:6789/0 conn(0x7fa6800b5f50 legacy=0x7fa680160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.039+0000 7fa684e00640 1 -- 172.21.15.59:0/3956884659 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6800b0260 con 0x7fa680146090 2024-05-30T16:54:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.043+0000 7fa684e00640 1 --2- 172.21.15.59:0/3956884659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa680146090 0x7fa6800b0a60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa6800b0540 tx=0x7fa67401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9b8ad213003652 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.043+0000 7fa67f400640 1 -- 172.21.15.59:0/3956884659 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6740b0070 con 0x7fa680146090 2024-05-30T16:54:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.043+0000 7fa67f400640 1 -- 172.21.15.59:0/3956884659 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6740ab600 con 0x7fa680146090 2024-05-30T16:54:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.043+0000 7fa67f400640 1 -- 172.21.15.59:0/3956884659 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6740ab9d0 con 0x7fa680146090 2024-05-30T16:54:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.043+0000 7fa687800640 1 -- 172.21.15.59:0/3956884659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa680146090 msgr2=0x7fa6800b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.043+0000 7fa687800640 1 --2- 172.21.15.59:0/3956884659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa680146090 0x7fa6800b0a60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa6800b0540 tx=0x7fa67401c4e0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.043+0000 7fa687800640 1 -- 172.21.15.59:0/3956884659 shutdown_connections 2024-05-30T16:54:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.043+0000 7fa687800640 1 --2- 172.21.15.59:0/3956884659 >> v2:172.21.15.107:3300/0 conn(0x7fa68006b9b0 0x7fa68006be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.043+0000 7fa687800640 1 --2- 172.21.15.59:0/3956884659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa680146090 0x7fa6800b0a60 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.043+0000 7fa687800640 1 -- 172.21.15.59:0/3956884659 >> 172.21.15.59:0/3956884659 conn(0x7fa68009aa40 msgr2=0x7fa6800b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:41.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.043+0000 7fa687800640 1 -- 172.21.15.59:0/3956884659 shutdown_connections 2024-05-30T16:54:41.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.043+0000 7fa687800640 1 -- 172.21.15.59:0/3956884659 wait complete. 2024-05-30T16:54:41.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa687800640 1 Processor -- start 2024-05-30T16:54:41.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa687800640 1 -- start start 2024-05-30T16:54:41.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa687800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa68006b9b0 0x7fa6801394d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa687800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6800b5f50 0x7fa68015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa687800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa680146090 0x7fa6801f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa687800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa6800b4f40 con 0x7fa680146090 2024-05-30T16:54:41.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa687800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa6800b4dc0 con 0x7fa6800b5f50 2024-05-30T16:54:41.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa687800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa6800b50c0 con 0x7fa68006b9b0 2024-05-30T16:54:41.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa685800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa680146090 0x7fa6801f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:41.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa685800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa680146090 0x7fa6801f7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54816/0 (socket says 172.21.15.59:54816) 2024-05-30T16:54:41.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa685800640 1 -- 172.21.15.59:0/1352609532 learned_addr learned my addr 172.21.15.59:0/1352609532 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:41.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa684e00640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa68006b9b0 0x7fa6801394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:41.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa67fe00640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6800b5f50 0x7fa68015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa685800640 1 -- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa68006b9b0 msgr2=0x7fa6801394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa685800640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa68006b9b0 0x7fa6801394d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa685800640 1 -- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6800b5f50 msgr2=0x7fa68015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa685800640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6800b5f50 0x7fa68015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa685800640 1 -- 172.21.15.59:0/1352609532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa680137ba0 con 0x7fa680146090 2024-05-30T16:54:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa685800640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa680146090 0x7fa6801f7aa0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa67800b9a0 tx=0x7fa67800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa67cc00640 1 -- 172.21.15.59:0/1352609532 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678019070 con 0x7fa680146090 2024-05-30T16:54:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa67cc00640 1 -- 172.21.15.59:0/1352609532 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67800cbc0 con 0x7fa680146090 2024-05-30T16:54:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa67cc00640 1 -- 172.21.15.59:0/1352609532 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678014440 con 0x7fa680146090 2024-05-30T16:54:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa687800640 1 -- 172.21.15.59:0/1352609532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6801f8ad0 con 0x7fa680146090 2024-05-30T16:54:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa687800640 1 -- 172.21.15.59:0/1352609532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6801370c0 con 0x7fa680146090 2024-05-30T16:54:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.047+0000 7fa687800640 1 -- 172.21.15.59:0/1352609532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa680068a90 con 0x7fa680146090 2024-05-30T16:54:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.051+0000 7fa67cc00640 1 -- 172.21.15.59:0/1352609532 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fa67801c070 con 0x7fa680146090 2024-05-30T16:54:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.051+0000 7fa67cc00640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa660068b60 0x7fa66006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.051+0000 7fa67cc00640 1 -- 172.21.15.59:0/1352609532 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4999+0+0 (secure 0 0 0) 0x7fa678084fe0 con 0x7fa680146090 2024-05-30T16:54:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.051+0000 7fa684e00640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa660068b60 0x7fa66006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.051+0000 7fa684e00640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa660068b60 0x7fa66006b020 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa6740ad000 tx=0x7fa6740a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:41.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.055+0000 7fa67cc00640 1 -- 172.21.15.59:0/1352609532 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa678056840 con 0x7fa680146090 2024-05-30T16:54:41.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 -- 172.21.15.59:0/1352609532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6800703a0 con 0x7fa680146090 2024-05-30T16:54:41.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa67cc00640 1 -- 172.21.15.59:0/1352609532 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+3872 (secure 0 0 0) 0x7fa67805ab40 con 0x7fa680146090 2024-05-30T16:54:41.258 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:41.258 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4919,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2045783783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2045783783},{"type":"v1","addr":"172.21.15.107:6836","nonce":2045783783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4922,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3405430037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3405430037},{"type":"v1","addr":"172.21.15.107:6837","nonce":3405430037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3338903229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3338903229},{"type":"v1","addr":"172.21.15.59:6834","nonce":3338903229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5784,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/271409386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":271409386},{"type":"v1","addr":"172.21.15.59:6835","nonce":271409386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[]} 2024-05-30T16:54:41.259 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-05-30T16:54:41.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 -- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa660068b60 msgr2=0x7fa66006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:41.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa660068b60 0x7fa66006b020 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa6740ad000 tx=0x7fa6740a6000 comp rx=0 tx=0).stop 2024-05-30T16:54:41.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 -- 172.21.15.59:0/1352609532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa680146090 msgr2=0x7fa6801f7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa680146090 0x7fa6801f7aa0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa67800b9a0 tx=0x7fa67800be60 comp rx=0 tx=0).stop 2024-05-30T16:54:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 -- 172.21.15.59:0/1352609532 shutdown_connections 2024-05-30T16:54:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa660068b60 0x7fa66006b020 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa680146090 0x7fa6801f7aa0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6800b5f50 0x7fa68015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 --2- 172.21.15.59:0/1352609532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa68006b9b0 0x7fa6801394d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 -- 172.21.15.59:0/1352609532 >> 172.21.15.59:0/1352609532 conn(0x7fa68009aa40 msgr2=0x7fa680135720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 -- 172.21.15.59:0/1352609532 shutdown_connections 2024-05-30T16:54:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.255+0000 7fa687800640 1 -- 172.21.15.59:0/1352609532 wait complete. 2024-05-30T16:54:41.281 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T16:54:41.281 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T16:54:41.281 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T16:54:41.281 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:54:41.281 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T16:54:41.282 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T16:54:41.282 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T16:54:41.282 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:54:41.282 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T16:54:41.282 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T16:54:41.282 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T16:54:41.282 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:54:41.283 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T16:54:41.283 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T16:54:41.283 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T16:54:41.283 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:54:41.293 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T16:54:41.294 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T16:54:41.295 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T16:54:41.295 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T16:54:41.297 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T16:54:41.298 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T16:54:41.298 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T16:54:41.299 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T16:54:41.338 INFO:tasks.ceph.mds.a:Started 2024-05-30T16:54:41.338 DEBUG:teuthology.parallel:result is None 2024-05-30T16:54:41.340 INFO:tasks.ceph.mds.c:Started 2024-05-30T16:54:41.341 DEBUG:teuthology.parallel:result is None 2024-05-30T16:54:41.346 INFO:tasks.ceph.mds.d:Started 2024-05-30T16:54:41.346 DEBUG:teuthology.parallel:result is None 2024-05-30T16:54:41.347 INFO:tasks.ceph.mds.b:Started 2024-05-30T16:54:41.347 DEBUG:teuthology.parallel:result is None 2024-05-30T16:54:41.348 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T16:54:41.424 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-05-30T16:54:41.427 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T16:54:41.436 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-30T16:54:41.439 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-30T16:54:41.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.491+0000 7f6ac3a00640 1 Processor -- start 2024-05-30T16:54:41.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.491+0000 7f6ac3a00640 1 -- start start 2024-05-30T16:54:41.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ac3a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6abc159df0 0x7f6abc0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ac3a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6abc15a1d0 0x7f6abc0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ac3a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6abc0b3e50 0x7f6abc15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ac3a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6abc15d730 con 0x7f6abc15a1d0 2024-05-30T16:54:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ac3a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6abc0b3370 con 0x7f6abc159df0 2024-05-30T16:54:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ac3a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6abc0b3650 con 0x7f6abc0b3e50 2024-05-30T16:54:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ab3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6abc15a1d0 0x7f6abc0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ab3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6abc15a1d0 0x7f6abc0ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54854/0 (socket says 172.21.15.59:54854) 2024-05-30T16:54:41.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ab3e00640 1 -- 172.21.15.59:0/478028395 learned_addr learned my addr 172.21.15.59:0/478028395 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:41.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ac1a00640 1 --2- 172.21.15.59:0/478028395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6abc0b3e50 0x7f6abc15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:41.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ab3e00640 1 -- 172.21.15.59:0/478028395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6abc0b3e50 msgr2=0x7f6abc15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:41.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ab3e00640 1 --2- 172.21.15.59:0/478028395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6abc0b3e50 0x7f6abc15ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ab3e00640 1 -- 172.21.15.59:0/478028395 >> v2:172.21.15.107:3300/0 conn(0x7f6abc159df0 msgr2=0x7f6abc0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:41.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ac1000640 1 --2- 172.21.15.59:0/478028395 >> v2:172.21.15.107:3300/0 conn(0x7f6abc159df0 0x7f6abc0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ab3e00640 1 --2- 172.21.15.59:0/478028395 >> v2:172.21.15.107:3300/0 conn(0x7f6abc159df0 0x7f6abc0ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ab3e00640 1 -- 172.21.15.59:0/478028395 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc0b3930 con 0x7f6abc15a1d0 2024-05-30T16:54:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ac1a00640 1 --2- 172.21.15.59:0/478028395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6abc0b3e50 0x7f6abc15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ac1000640 1 --2- 172.21.15.59:0/478028395 >> v2:172.21.15.107:3300/0 conn(0x7f6abc159df0 0x7f6abc0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.495+0000 7f6ab3e00640 1 --2- 172.21.15.59:0/478028395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc15a1d0 0x7f6abc0ad6f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0b4c20 tx=0x7f6aa401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d46026fc97d6aa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6abbe00640 1 -- 172.21.15.59:0/478028395 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40ab5f0 con 0x7f6abc15a1d0 2024-05-30T16:54:41.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6abbe00640 1 -- 172.21.15.59:0/478028395 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa40b0070 con 0x7f6abc15a1d0 2024-05-30T16:54:41.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6abbe00640 1 -- 172.21.15.59:0/478028395 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40ab9b0 con 0x7f6abc15a1d0 2024-05-30T16:54:41.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 -- 172.21.15.59:0/478028395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc15a1d0 msgr2=0x7f6abc0ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:41.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 --2- 172.21.15.59:0/478028395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc15a1d0 0x7f6abc0ad6f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0b4c20 tx=0x7f6aa401c520 comp rx=0 tx=0).stop 2024-05-30T16:54:41.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 -- 172.21.15.59:0/478028395 shutdown_connections 2024-05-30T16:54:41.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 --2- 172.21.15.59:0/478028395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6abc0b3e50 0x7f6abc15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 --2- 172.21.15.59:0/478028395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc15a1d0 0x7f6abc0ad6f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 --2- 172.21.15.59:0/478028395 >> v2:172.21.15.107:3300/0 conn(0x7f6abc159df0 0x7f6abc0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 -- 172.21.15.59:0/478028395 >> 172.21.15.59:0/478028395 conn(0x7f6abc0b22d0 msgr2=0x7f6abc0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:41.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 -- 172.21.15.59:0/478028395 shutdown_connections 2024-05-30T16:54:41.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 -- 172.21.15.59:0/478028395 wait complete. 2024-05-30T16:54:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 Processor -- start 2024-05-30T16:54:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 -- start start 2024-05-30T16:54:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc0b3e50 0x7f6abc155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6abc159df0 0x7f6abc14a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6abc15a1d0 0x7f6abc14b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc15e720 con 0x7f6abc0b3e50 2024-05-30T16:54:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc15e5a0 con 0x7f6abc15a1d0 2024-05-30T16:54:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac3a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6abc15e8a0 con 0x7f6abc159df0 2024-05-30T16:54:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc0b3e50 0x7f6abc155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc0b3e50 0x7f6abc155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54868/0 (socket says 172.21.15.59:54868) 2024-05-30T16:54:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac1000640 1 -- 172.21.15.59:0/4104139681 learned_addr learned my addr 172.21.15.59:0/4104139681 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ab3e00640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6abc159df0 0x7f6abc14a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.499+0000 7f6ac1a00640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6abc15a1d0 0x7f6abc14b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ac1000640 1 -- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6abc159df0 msgr2=0x7f6abc14a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ac1000640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6abc159df0 0x7f6abc14a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ac1000640 1 -- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6abc15a1d0 msgr2=0x7f6abc14b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ac1000640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6abc15a1d0 0x7f6abc14b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ac1000640 1 -- 172.21.15.59:0/4104139681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc1577d0 con 0x7f6abc0b3e50 2024-05-30T16:54:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ac1a00640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6abc15a1d0 0x7f6abc14b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ac1000640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc0b3e50 0x7f6abc155490 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c7f0 tx=0x7f6aac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ab9600640 1 -- 172.21.15.59:0/4104139681 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac015070 con 0x7f6abc0b3e50 2024-05-30T16:54:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ab9600640 1 -- 172.21.15.59:0/4104139681 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aac007820 con 0x7f6abc0b3e50 2024-05-30T16:54:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ab9600640 1 -- 172.21.15.59:0/4104139681 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac007c10 con 0x7f6abc0b3e50 2024-05-30T16:54:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ac3a00640 1 -- 172.21.15.59:0/4104139681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6abc157a70 con 0x7f6abc0b3e50 2024-05-30T16:54:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ac3a00640 1 -- 172.21.15.59:0/4104139681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6abc158310 con 0x7f6abc0b3e50 2024-05-30T16:54:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ac3a00640 1 -- 172.21.15.59:0/4104139681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6abc157e60 con 0x7f6abc0b3e50 2024-05-30T16:54:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ab9600640 1 -- 172.21.15.59:0/4104139681 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f6aac018070 con 0x7f6abc0b3e50 2024-05-30T16:54:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ab9600640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6a98068b60 0x7f6a9806b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.503+0000 7f6ab9600640 1 -- 172.21.15.59:0/4104139681 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4999+0+0 (secure 0 0 0) 0x7f6aac087b90 con 0x7f6abc0b3e50 2024-05-30T16:54:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.507+0000 7f6ab3e00640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6a98068b60 0x7f6a9806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.507+0000 7f6ab3e00640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6a98068b60 0x7f6a9806b020 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40af000 tx=0x7f6aa40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.507+0000 7f6ab9600640 1 -- 172.21.15.59:0/4104139681 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6aac056c90 con 0x7f6abc0b3e50 2024-05-30T16:54:41.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:41.695+0000 7f6ac3a00640 1 -- 172.21.15.59:0/4104139681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6abc068a90 con 0x7f6abc0b3e50 2024-05-30T16:54:42.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.619+0000 7f6ab9600640 1 -- 172.21.15.59:0/4104139681 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) ==== 97+0+0 (secure 0 0 0) 0x7f6aac05af90 con 0x7f6abc0b3e50 2024-05-30T16:54:42.622 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-05-30T16:54:42.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.623+0000 7f6ac3a00640 1 -- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6a98068b60 msgr2=0x7f6a9806b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.623+0000 7f6ac3a00640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6a98068b60 0x7f6a9806b020 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40af000 tx=0x7f6aa40a7000 comp rx=0 tx=0).stop 2024-05-30T16:54:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.623+0000 7f6ac3a00640 1 -- 172.21.15.59:0/4104139681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc0b3e50 msgr2=0x7f6abc155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.623+0000 7f6ac3a00640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc0b3e50 0x7f6abc155490 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c7f0 tx=0x7f6aac00ccb0 comp rx=0 tx=0).stop 2024-05-30T16:54:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.623+0000 7f6ac3a00640 1 -- 172.21.15.59:0/4104139681 shutdown_connections 2024-05-30T16:54:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.623+0000 7f6ac3a00640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6a98068b60 0x7f6a9806b020 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.623+0000 7f6ac3a00640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6abc15a1d0 0x7f6abc14b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.623+0000 7f6ac3a00640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6abc159df0 0x7f6abc14a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.623+0000 7f6ac3a00640 1 --2- 172.21.15.59:0/4104139681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc0b3e50 0x7f6abc155490 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.623+0000 7f6ac3a00640 1 -- 172.21.15.59:0/4104139681 >> 172.21.15.59:0/4104139681 conn(0x7f6abc0b22d0 msgr2=0x7f6abc06ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.623+0000 7f6ac3a00640 1 -- 172.21.15.59:0/4104139681 shutdown_connections 2024-05-30T16:54:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.623+0000 7f6ac3a00640 1 -- 172.21.15.59:0/4104139681 wait complete. 2024-05-30T16:54:42.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T16:54:42.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa9d200640 1 Processor -- start 2024-05-30T16:54:42.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa9d200640 1 -- start start 2024-05-30T16:54:42.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa9d200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa980af720 0x7ffa9815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:42.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa9d200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa9806e900 0x7ffa9815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:42.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa9d200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa9815f060 con 0x7ffa980d0560 2024-05-30T16:54:42.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa9d200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ffa980afb00 con 0x7ffa980af720 2024-05-30T16:54:42.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa9d200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ffa9815c270 con 0x7ffa9806e900 2024-05-30T16:54:42.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa95e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa980af720 0x7ffa9815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:42.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa96800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffa980d0560 0x7ffa98072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40578/0 (socket says 172.21.15.59:40578) 2024-05-30T16:54:42.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa96800640 1 -- 172.21.15.59:0/1907311571 learned_addr learned my addr 172.21.15.59:0/1907311571 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:42.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa8d400640 1 --2- 172.21.15.59:0/1907311571 >> v2:172.21.15.107:3300/0 conn(0x7ffa9806e900 0x7ffa9815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:42.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa95e00640 1 -- 172.21.15.59:0/1907311571 >> v2:172.21.15.107:3300/0 conn(0x7ffa9806e900 msgr2=0x7ffa9815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:42.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa95400640 1 -- 172.21.15.59:0/1907311571 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189609761 0 0) 0x7ffa9815f060 con 0x7ffa980d0560 2024-05-30T16:54:42.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa95e00640 1 --2- 172.21.15.59:0/1907311571 >> v2:172.21.15.107:3300/0 conn(0x7ffa9806e900 0x7ffa9815f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:42.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa95e00640 1 -- 172.21.15.59:0/1907311571 >> v1:172.21.15.59:6789/0 conn(0x7ffa980d0560 legacy=0x7ffa98072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:42.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa95e00640 1 -- 172.21.15.59:0/1907311571 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9815c550 con 0x7ffa980af720 2024-05-30T16:54:42.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.787+0000 7ffa8d400640 1 --2- 172.21.15.59:0/1907311571 >> v2:172.21.15.107:3300/0 conn(0x7ffa9806e900 0x7ffa9815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:42.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.791+0000 7ffa95e00640 1 --2- 172.21.15.59:0/1907311571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa980af720 0x7ffa9815b9d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffa980b5410 tx=0x7ffa8801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b696726bc40d1fb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:42.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.791+0000 7ffa95400640 1 -- 172.21.15.59:0/1907311571 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa880a7070 con 0x7ffa980af720 2024-05-30T16:54:42.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.791+0000 7ffa95400640 1 -- 172.21.15.59:0/1907311571 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa880b0070 con 0x7ffa980af720 2024-05-30T16:54:42.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.791+0000 7ffa95400640 1 -- 172.21.15.59:0/1907311571 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa880ab890 con 0x7ffa980af720 2024-05-30T16:54:42.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.791+0000 7ffa9d200640 1 -- 172.21.15.59:0/1907311571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa980af720 msgr2=0x7ffa9815b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:42.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.791+0000 7ffa9d200640 1 --2- 172.21.15.59:0/1907311571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa980af720 0x7ffa9815b9d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffa980b5410 tx=0x7ffa8801c450 comp rx=0 tx=0).stop 2024-05-30T16:54:42.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.791+0000 7ffa9d200640 1 -- 172.21.15.59:0/1907311571 shutdown_connections 2024-05-30T16:54:42.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.791+0000 7ffa9d200640 1 --2- 172.21.15.59:0/1907311571 >> v2:172.21.15.107:3300/0 conn(0x7ffa9806e900 0x7ffa9815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:42.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.791+0000 7ffa9d200640 1 --2- 172.21.15.59:0/1907311571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa980af720 0x7ffa9815b9d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:42.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.791+0000 7ffa9d200640 1 -- 172.21.15.59:0/1907311571 >> 172.21.15.59:0/1907311571 conn(0x7ffa980b22d0 msgr2=0x7ffa980b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:42.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.791+0000 7ffa9d200640 1 -- 172.21.15.59:0/1907311571 shutdown_connections 2024-05-30T16:54:42.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.791+0000 7ffa9d200640 1 -- 172.21.15.59:0/1907311571 wait complete. 2024-05-30T16:54:42.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa9d200640 1 Processor -- start 2024-05-30T16:54:42.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa9d200640 1 -- start start 2024-05-30T16:54:42.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa9d200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa9806e900 0x7ffa981fa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:42.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa9d200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa980af720 0x7ffa9815a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:42.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa9d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa980d0560 0x7ffa9809a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:42.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa9d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9815fd30 con 0x7ffa980d0560 2024-05-30T16:54:42.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa9d200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9815c830 con 0x7ffa9806e900 2024-05-30T16:54:42.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa9d200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffa9815feb0 con 0x7ffa980af720 2024-05-30T16:54:42.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa96800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa980d0560 0x7ffa9809a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa96800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa980d0560 0x7ffa9809a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34712/0 (socket says 172.21.15.59:34712) 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa96800640 1 -- 172.21.15.59:0/759658133 learned_addr learned my addr 172.21.15.59:0/759658133 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa95e00640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa9806e900 0x7ffa981fa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa8d400640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa980af720 0x7ffa9815a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa96800640 1 -- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa980af720 msgr2=0x7ffa9815a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa96800640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa980af720 0x7ffa9815a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa96800640 1 -- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa9806e900 msgr2=0x7ffa981fa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa96800640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa9806e900 0x7ffa981fa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa96800640 1 -- 172.21.15.59:0/759658133 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa981583f0 con 0x7ffa980d0560 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa96800640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa980d0560 0x7ffa9809a2c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c480 tx=0x7ffa9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa8ea00640 1 -- 172.21.15.59:0/759658133 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90018070 con 0x7ffa980d0560 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa8ea00640 1 -- 172.21.15.59:0/759658133 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa900074e0 con 0x7ffa980d0560 2024-05-30T16:54:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa8ea00640 1 -- 172.21.15.59:0/759658133 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90004a30 con 0x7ffa980d0560 2024-05-30T16:54:42.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa9d200640 1 -- 172.21.15.59:0/759658133 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa980b2bf0 con 0x7ffa980d0560 2024-05-30T16:54:42.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa9d200640 1 -- 172.21.15.59:0/759658133 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa9809e1e0 con 0x7ffa980d0560 2024-05-30T16:54:42.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.795+0000 7ffa9d200640 1 -- 172.21.15.59:0/759658133 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa98068a90 con 0x7ffa980d0560 2024-05-30T16:54:42.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.799+0000 7ffa8ea00640 1 -- 172.21.15.59:0/759658133 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7ffa90004bd0 con 0x7ffa980d0560 2024-05-30T16:54:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.799+0000 7ffa8ea00640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa74068b90 0x7ffa7406b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.799+0000 7ffa8ea00640 1 -- 172.21.15.59:0/759658133 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4913+0+0 (secure 0 0 0) 0x7ffa90086b20 con 0x7ffa980d0560 2024-05-30T16:54:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.799+0000 7ffa95e00640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa74068b90 0x7ffa7406b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.799+0000 7ffa95e00640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa74068b90 0x7ffa7406b050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffa880af000 tx=0x7ffa880a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:42.803+0000 7ffa8ea00640 1 -- 172.21.15.59:0/759658133 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa90055e10 con 0x7ffa980d0560 2024-05-30T16:54:43.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.027+0000 7ffa9d200640 1 -- 172.21.15.59:0/759658133 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ffa98072a50 con 0x7ffa980d0560 2024-05-30T16:54:43.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.027+0000 7ffa8ea00640 1 -- 172.21.15.59:0/759658133 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7ffa9005a110 con 0x7ffa980d0560 2024-05-30T16:54:43.032 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:43.032 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:54:43.032 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-05-30T16:54:43.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.032 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-05-30T16:54:43.032 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmAAjIJhAA5/FZHJtfSZuYcD6bEfCGDA==", 2024-05-30T16:54:43.032 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.033 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:54:43.033 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:54:43.033 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:54:43.033 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.033 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.033 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-05-30T16:54:43.033 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmELVkMxAA/vOsM3Z0z4YEmUqoPtrPBQ==", 2024-05-30T16:54:43.033 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.033 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:54:43.033 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:54:43.034 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:54:43.034 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.034 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.034 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-05-30T16:54:43.034 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmD2pGLhAAWmDw/02mc8T7upvRXnj1yw==", 2024-05-30T16:54:43.034 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.034 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:54:43.034 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:54:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:54:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-05-30T16:54:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmYLbYOhAAxggGfPZU/ryu+8vciSXjUw==", 2024-05-30T16:54:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:54:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:54:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:54:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.036 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.036 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-05-30T16:54:43.036 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDJrVhmU0fpBhAA2tKWGJF24DlEjG+iuO4djg==", 2024-05-30T16:54:43.036 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.036 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:54:43.036 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:54:43.036 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.036 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.037 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-05-30T16:54:43.037 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDMrVhmxE2HERAA4N9Bsb0fxl5GERpgyKCl6Q==", 2024-05-30T16:54:43.037 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.037 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:54:43.037 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:54:43.037 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.037 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.037 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-05-30T16:54:43.037 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDPrVhm6v7AGhAAqOQCN90pL0AmnXYIPIb48A==", 2024-05-30T16:54:43.037 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.038 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:54:43.038 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:54:43.038 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.038 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.038 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-05-30T16:54:43.038 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSrVhm3BEDJxAA4SOWC/qF90R9ivrCvN92ZA==", 2024-05-30T16:54:43.038 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.038 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:54:43.038 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:54:43.039 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.039 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.039 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-05-30T16:54:43.039 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDYrVhmFzmDHhAAQtbXd6haolYB98wfEbpvTQ==", 2024-05-30T16:54:43.039 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.039 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:54:43.039 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:54:43.039 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.039 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.040 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-05-30T16:54:43.040 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDbrVhmHqkEKRAAKfFPdTqaVhBNnc5lKeEFpg==", 2024-05-30T16:54:43.040 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.040 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:54:43.040 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:54:43.040 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.040 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.041 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-05-30T16:54:43.041 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDerVhm72bzMBAA+FfnxIOnkESuTervY23ruw==", 2024-05-30T16:54:43.041 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.041 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:54:43.041 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:54:43.041 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.041 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.041 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-05-30T16:54:43.041 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDhrVhmXGv/OhAAr2k7IXDA9VDi9ZJwrQ+u6A==", 2024-05-30T16:54:43.041 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.042 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:54:43.042 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:54:43.042 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.042 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.042 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-05-30T16:54:43.042 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA==", 2024-05-30T16:54:43.042 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.042 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:54:43.042 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-05-30T16:54:43.042 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T16:54:43.043 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.043 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-05-30T16:54:43.043 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmncPjDBAAWEJOkxm9xfRjonO6U1hO6A==", 2024-05-30T16:54:43.043 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.043 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:54:43.043 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:54:43.043 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:54:43.043 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:54:43.043 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.044 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-05-30T16:54:43.044 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmvlFFCRAAZCq7ijfrVqy8Ukh7jKZESQ==", 2024-05-30T16:54:43.044 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.044 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:54:43.044 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:54:43.044 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:54:43.044 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:54:43.044 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.045 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-05-30T16:54:43.045 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmcpjuEhAA0q+PfNy0IWhqQSiIZuyBlg==", 2024-05-30T16:54:43.045 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.045 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:54:43.045 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:54:43.045 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:54:43.045 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:54:43.045 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.045 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-05-30T16:54:43.045 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmnikpCxAA6Q4udmvjQXBmC4f1irI2Xg==", 2024-05-30T16:54:43.046 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.046 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:54:43.046 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:54:43.046 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:54:43.046 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.046 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.046 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-05-30T16:54:43.046 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmWZq9IhAAFuEZeFiLGCitIiNARjoDTA==", 2024-05-30T16:54:43.046 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhm0UKsHhAAimqtE18XjW/1vA7uMsJmEw==", 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:54:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.048 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.048 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-05-30T16:54:43.048 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:54:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.031+0000 7ffa9d200640 1 -- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa74068b90 msgr2=0x7ffa7406b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.031+0000 7ffa9d200640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa74068b90 0x7ffa7406b050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffa880af000 tx=0x7ffa880a7000 comp rx=0 tx=0).stop 2024-05-30T16:54:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.031+0000 7ffa9d200640 1 -- 172.21.15.59:0/759658133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa980d0560 msgr2=0x7ffa9809a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.031+0000 7ffa9d200640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa980d0560 0x7ffa9809a2c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c480 tx=0x7ffa9000c940 comp rx=0 tx=0).stop 2024-05-30T16:54:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.031+0000 7ffa9d200640 1 -- 172.21.15.59:0/759658133 shutdown_connections 2024-05-30T16:54:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.031+0000 7ffa9d200640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa74068b90 0x7ffa7406b050 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.031+0000 7ffa9d200640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa980d0560 0x7ffa9809a2c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.031+0000 7ffa9d200640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa980af720 0x7ffa9815a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.031+0000 7ffa9d200640 1 --2- 172.21.15.59:0/759658133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa9806e900 0x7ffa981fa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.031+0000 7ffa9d200640 1 -- 172.21.15.59:0/759658133 >> 172.21.15.59:0/759658133 conn(0x7ffa980b22d0 msgr2=0x7ffa980b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:43.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.031+0000 7ffa9d200640 1 -- 172.21.15.59:0/759658133 shutdown_connections 2024-05-30T16:54:43.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.031+0000 7ffa9d200640 1 -- 172.21.15.59:0/759658133 wait complete. 2024-05-30T16:54:43.054 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T16:54:43.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.191+0000 7f7851000640 1 Processor -- start 2024-05-30T16:54:43.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.191+0000 7f7851000640 1 -- start start 2024-05-30T16:54:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.195+0000 7f7851000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f784c0c6f50 0x7f784c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.195+0000 7f7851000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784c15ec40 con 0x7f784c15e860 2024-05-30T16:54:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.195+0000 7f7851000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784c0c8200 con 0x7f784c0d0e80 2024-05-30T16:54:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.195+0000 7f7851000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f784c0cf650 con 0x7f784c0c6f50 2024-05-30T16:54:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.195+0000 7f7849e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f784c15e860 0x7f784c0cef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40594/0 (socket says 172.21.15.59:40594) 2024-05-30T16:54:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.195+0000 7f7849e00640 1 -- 172.21.15.59:0/4005309731 learned_addr learned my addr 172.21.15.59:0/4005309731 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.195+0000 7f784a800640 1 --2- 172.21.15.59:0/4005309731 >> v2:172.21.15.107:3300/0 conn(0x7f784c0c6f50 0x7f784c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.195+0000 7f7849400640 1 -- 172.21.15.59:0/4005309731 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534096747 0 0) 0x7f784c15ec40 con 0x7f784c15e860 2024-05-30T16:54:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.195+0000 7f7849400640 1 -- 172.21.15.59:0/4005309731 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7830003530 con 0x7f784c15e860 2024-05-30T16:54:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.195+0000 7f784a800640 1 -- 172.21.15.59:0/4005309731 >> v1:172.21.15.107:6789/0 conn(0x7f784c0d0e80 legacy=0x7f784c0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.195+0000 7f784a800640 1 -- 172.21.15.59:0/4005309731 >> v1:172.21.15.59:6789/0 conn(0x7f784c15e860 legacy=0x7f784c0cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.195+0000 7f784a800640 1 -- 172.21.15.59:0/4005309731 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c0c7960 con 0x7f784c0c6f50 2024-05-30T16:54:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f784a800640 1 --2- 172.21.15.59:0/4005309731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f784c0c6f50 0x7f784c06b9b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7844009d90 tx=0x7f784401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65e436c8bc022037 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f7849400640 1 -- 172.21.15.59:0/4005309731 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78440b2070 con 0x7f784c0c6f50 2024-05-30T16:54:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f7849400640 1 -- 172.21.15.59:0/4005309731 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78440a57a0 con 0x7f784c0c6f50 2024-05-30T16:54:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f7849400640 1 -- 172.21.15.59:0/4005309731 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78440a5b50 con 0x7f784c0c6f50 2024-05-30T16:54:43.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f7851000640 1 -- 172.21.15.59:0/4005309731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f784c0c6f50 msgr2=0x7f784c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f7851000640 1 --2- 172.21.15.59:0/4005309731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f784c0c6f50 0x7f784c06b9b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7844009d90 tx=0x7f784401c8e0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f7851000640 1 -- 172.21.15.59:0/4005309731 shutdown_connections 2024-05-30T16:54:43.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f7851000640 1 --2- 172.21.15.59:0/4005309731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f784c0c6f50 0x7f784c06b9b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f7851000640 1 -- 172.21.15.59:0/4005309731 >> 172.21.15.59:0/4005309731 conn(0x7f784c0b2fc0 msgr2=0x7f784c0b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:43.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f7851000640 1 -- 172.21.15.59:0/4005309731 shutdown_connections 2024-05-30T16:54:43.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f7851000640 1 -- 172.21.15.59:0/4005309731 wait complete. 2024-05-30T16:54:43.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f7851000640 1 Processor -- start 2024-05-30T16:54:43.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.199+0000 7f7851000640 1 -- start start 2024-05-30T16:54:43.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7851000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f784c0c6f50 0x7f784c1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:43.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7851000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c0d0e80 0x7f784c15b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:43.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7851000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f784c15e860 0x7f784c15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:43.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7851000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f784c16c530 con 0x7f784c0d0e80 2024-05-30T16:54:43.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7851000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f784c16c3b0 con 0x7f784c15e860 2024-05-30T16:54:43.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7851000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f784c16c6b0 con 0x7f784c0c6f50 2024-05-30T16:54:43.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7843e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c0d0e80 0x7f784c15b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7843e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c0d0e80 0x7f784c15b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34724/0 (socket says 172.21.15.59:34724) 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7843e00640 1 -- 172.21.15.59:0/1585517869 learned_addr learned my addr 172.21.15.59:0/1585517869 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f784a800640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f784c15e860 0x7f784c15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7849e00640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f784c0c6f50 0x7f784c1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7843e00640 1 -- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f784c0c6f50 msgr2=0x7f784c1522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7843e00640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f784c0c6f50 0x7f784c1522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7843e00640 1 -- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f784c15e860 msgr2=0x7f784c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7843e00640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f784c15e860 0x7f784c15c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7843e00640 1 -- 172.21.15.59:0/1585517869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c15bae0 con 0x7f784c0d0e80 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7843e00640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c0d0e80 0x7f784c15b5a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f783400c370 tx=0x7f783400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7842000640 1 -- 172.21.15.59:0/1585517869 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340052d0 con 0x7f784c0d0e80 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7842000640 1 -- 172.21.15.59:0/1585517869 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7834005470 con 0x7f784c0d0e80 2024-05-30T16:54:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7851000640 1 -- 172.21.15.59:0/1585517869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784c157fb0 con 0x7f784c0d0e80 2024-05-30T16:54:43.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7842000640 1 -- 172.21.15.59:0/1585517869 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834007260 con 0x7f784c0d0e80 2024-05-30T16:54:43.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7851000640 1 -- 172.21.15.59:0/1585517869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784c153140 con 0x7f784c0d0e80 2024-05-30T16:54:43.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7851000640 1 -- 172.21.15.59:0/1585517869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f784c152f60 con 0x7f784c0d0e80 2024-05-30T16:54:43.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.203+0000 7f7842000640 1 -- 172.21.15.59:0/1585517869 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f7834007400 con 0x7f784c0d0e80 2024-05-30T16:54:43.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.207+0000 7f7842000640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7828068b60 0x7f782806b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:43.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.207+0000 7f7842000640 1 -- 172.21.15.59:0/1585517869 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4913+0+0 (secure 0 0 0) 0x7f7834086cf0 con 0x7f784c0d0e80 2024-05-30T16:54:43.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.207+0000 7f7849e00640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7828068b60 0x7f782806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:43.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.207+0000 7f7849e00640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7828068b60 0x7f782806b020 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f783c0011f0 tx=0x7f783c007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.211+0000 7f7842000640 1 -- 172.21.15.59:0/1585517869 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f784c152f60 con 0x7f784c0d0e80 2024-05-30T16:54:43.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.375+0000 7f7851000640 1 -- 172.21.15.59:0/1585517869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f784c068a90 con 0x7f784c0d0e80 2024-05-30T16:54:43.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7842000640 1 -- 172.21.15.59:0/1585517869 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) ==== 84+0+65 (secure 0 0 0) 0x7f7834055fe0 con 0x7f784c0d0e80 2024-05-30T16:54:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:43.381 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:54:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:54:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-05-30T16:54:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-05-30T16:54:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:43.381 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:54:43.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7851000640 1 -- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7828068b60 msgr2=0x7f782806b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7851000640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7828068b60 0x7f782806b020 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f783c0011f0 tx=0x7f783c007d40 comp rx=0 tx=0).stop 2024-05-30T16:54:43.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7851000640 1 -- 172.21.15.59:0/1585517869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c0d0e80 msgr2=0x7f784c15b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7851000640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c0d0e80 0x7f784c15b5a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f783400c370 tx=0x7f783400c830 comp rx=0 tx=0).stop 2024-05-30T16:54:43.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7851000640 1 -- 172.21.15.59:0/1585517869 shutdown_connections 2024-05-30T16:54:43.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7851000640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7828068b60 0x7f782806b020 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7851000640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f784c15e860 0x7f784c15c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7851000640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c0d0e80 0x7f784c15b5a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7851000640 1 --2- 172.21.15.59:0/1585517869 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f784c0c6f50 0x7f784c1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7851000640 1 -- 172.21.15.59:0/1585517869 >> 172.21.15.59:0/1585517869 conn(0x7f784c0b2fc0 msgr2=0x7f784c15da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:43.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7851000640 1 -- 172.21.15.59:0/1585517869 shutdown_connections 2024-05-30T16:54:43.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.379+0000 7f7851000640 1 -- 172.21.15.59:0/1585517869 wait complete. 2024-05-30T16:54:43.402 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T16:54:43.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T16:54:43.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.543+0000 7fa0ea200640 1 Processor -- start 2024-05-30T16:54:43.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.543+0000 7fa0ea200640 1 -- start start 2024-05-30T16:54:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0ea200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa0e4161ce0 0x7fa0e409b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0ea200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0e40d0710 0x7fa0e4162410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0ea200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e40d1020 con 0x7fa0e40d0ba0 2024-05-30T16:54:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0ea200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e40d1300 con 0x7fa0e40d0710 2024-05-30T16:54:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0ea200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e40d15e0 con 0x7fa0e4161ce0 2024-05-30T16:54:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0daa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0e40d0710 0x7fa0e4162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:43.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0e3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa0e40d0ba0 0x7fa0e406cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40598/0 (socket says 172.21.15.59:40598) 2024-05-30T16:54:43.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0e3e00640 1 -- 172.21.15.59:0/973432201 learned_addr learned my addr 172.21.15.59:0/973432201 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:43.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0e3400640 1 --2- 172.21.15.59:0/973432201 >> v2:172.21.15.107:3300/0 conn(0x7fa0e4161ce0 0x7fa0e409b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:43.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0daa00640 1 -- 172.21.15.59:0/973432201 >> v2:172.21.15.107:3300/0 conn(0x7fa0e4161ce0 msgr2=0x7fa0e409b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:43.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0daa00640 1 --2- 172.21.15.59:0/973432201 >> v2:172.21.15.107:3300/0 conn(0x7fa0e4161ce0 0x7fa0e409b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0daa00640 1 -- 172.21.15.59:0/973432201 >> v1:172.21.15.59:6789/0 conn(0x7fa0e40d0ba0 legacy=0x7fa0e406cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0daa00640 1 -- 172.21.15.59:0/973432201 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e40d18c0 con 0x7fa0e40d0710 2024-05-30T16:54:43.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0e2a00640 1 -- 172.21.15.59:0/973432201 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1396179418 0 0) 0x7fa0e40d1020 con 0x7fa0e40d0ba0 2024-05-30T16:54:43.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.547+0000 7fa0e3400640 1 --2- 172.21.15.59:0/973432201 >> v2:172.21.15.107:3300/0 conn(0x7fa0e4161ce0 0x7fa0e409b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:43.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0daa00640 1 --2- 172.21.15.59:0/973432201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e40d0710 0x7fa0e4162410 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4073460 tx=0x7fa0cc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646fa63a2a576a08 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:43.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0e2a00640 1 -- 172.21.15.59:0/973432201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc0b1070 con 0x7fa0e40d0710 2024-05-30T16:54:43.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0e2a00640 1 -- 172.21.15.59:0/973432201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0cc0ac5f0 con 0x7fa0e40d0710 2024-05-30T16:54:43.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0e2a00640 1 -- 172.21.15.59:0/973432201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc0ac9c0 con 0x7fa0e40d0710 2024-05-30T16:54:43.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 -- 172.21.15.59:0/973432201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e40d0710 msgr2=0x7fa0e4162410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 --2- 172.21.15.59:0/973432201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e40d0710 0x7fa0e4162410 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4073460 tx=0x7fa0cc01c480 comp rx=0 tx=0).stop 2024-05-30T16:54:43.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 -- 172.21.15.59:0/973432201 shutdown_connections 2024-05-30T16:54:43.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 --2- 172.21.15.59:0/973432201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e40d0710 0x7fa0e4162410 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 --2- 172.21.15.59:0/973432201 >> v2:172.21.15.107:3300/0 conn(0x7fa0e4161ce0 0x7fa0e409b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 -- 172.21.15.59:0/973432201 >> 172.21.15.59:0/973432201 conn(0x7fa0e40b4000 msgr2=0x7fa0e40b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:43.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 -- 172.21.15.59:0/973432201 shutdown_connections 2024-05-30T16:54:43.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 -- 172.21.15.59:0/973432201 wait complete. 2024-05-30T16:54:43.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 Processor -- start 2024-05-30T16:54:43.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 -- start start 2024-05-30T16:54:43.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e40d0710 0x7fa0e415a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:43.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0e40d0ba0 0x7fa0e4158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:43.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0e4161ce0 0x7fa0e4158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:43.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e415f520 con 0x7fa0e40d0710 2024-05-30T16:54:43.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e415f3a0 con 0x7fa0e40d0ba0 2024-05-30T16:54:43.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0ea200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e415f6a0 con 0x7fa0e4161ce0 2024-05-30T16:54:43.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.551+0000 7fa0e3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e40d0710 0x7fa0e415a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:43.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0e3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e40d0710 0x7fa0e415a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34748/0 (socket says 172.21.15.59:34748) 2024-05-30T16:54:43.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0e3400640 1 -- 172.21.15.59:0/677685977 learned_addr learned my addr 172.21.15.59:0/677685977 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:43.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0daa00640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0e40d0ba0 0x7fa0e4158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:43.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0e3e00640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0e4161ce0 0x7fa0e4158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:43.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0e3400640 1 -- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0e4161ce0 msgr2=0x7fa0e4158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0e3400640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0e4161ce0 0x7fa0e4158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0e3400640 1 -- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0e40d0ba0 msgr2=0x7fa0e4158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:43.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0e3400640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0e40d0ba0 0x7fa0e4158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:43.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0e3400640 1 -- 172.21.15.59:0/677685977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e40c6bc0 con 0x7fa0e40d0710 2024-05-30T16:54:43.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0e3400640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e40d0710 0x7fa0e415a110 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400c7f0 tx=0x7fa0d400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:43.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0dbe00640 1 -- 172.21.15.59:0/677685977 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4015070 con 0x7fa0e40d0710 2024-05-30T16:54:43.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0dbe00640 1 -- 172.21.15.59:0/677685977 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d4007820 con 0x7fa0e40d0710 2024-05-30T16:54:43.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0ea200640 1 -- 172.21.15.59:0/677685977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e40c6ea0 con 0x7fa0e40d0710 2024-05-30T16:54:43.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0dbe00640 1 -- 172.21.15.59:0/677685977 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4007c10 con 0x7fa0e40d0710 2024-05-30T16:54:43.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0ea200640 1 -- 172.21.15.59:0/677685977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e40c7460 con 0x7fa0e40d0710 2024-05-30T16:54:43.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0ea200640 1 -- 172.21.15.59:0/677685977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e4068a90 con 0x7fa0e40d0710 2024-05-30T16:54:43.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.555+0000 7fa0dbe00640 1 -- 172.21.15.59:0/677685977 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fa0d4018070 con 0x7fa0e40d0710 2024-05-30T16:54:43.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.559+0000 7fa0dbe00640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0c0068b60 0x7fa0c006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:43.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.559+0000 7fa0dbe00640 1 -- 172.21.15.59:0/677685977 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4913+0+0 (secure 0 0 0) 0x7fa0d4087b00 con 0x7fa0e40d0710 2024-05-30T16:54:43.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.559+0000 7fa0daa00640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0c0068b60 0x7fa0c006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:43.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.559+0000 7fa0daa00640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0c0068b60 0x7fa0c006b020 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0ae000 tx=0x7fa0cc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:43.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.563+0000 7fa0dbe00640 1 -- 172.21.15.59:0/677685977 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa0d4056c50 con 0x7fa0e40d0710 2024-05-30T16:54:43.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:43.727+0000 7fa0ea200640 1 -- 172.21.15.59:0/677685977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa0e40b4bb0 con 0x7fa0e40d0710 2024-05-30T16:54:44.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.623+0000 7fa0dbe00640 1 -- 172.21.15.59:0/677685977 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) ==== 138+0+0 (secure 0 0 0) 0x7fa0d405af50 con 0x7fa0e40d0710 2024-05-30T16:54:44.626 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-05-30T16:54:44.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.627+0000 7fa0ea200640 1 -- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0c0068b60 msgr2=0x7fa0c006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.627+0000 7fa0ea200640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0c0068b60 0x7fa0c006b020 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0ae000 tx=0x7fa0cc0a7000 comp rx=0 tx=0).stop 2024-05-30T16:54:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.627+0000 7fa0ea200640 1 -- 172.21.15.59:0/677685977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e40d0710 msgr2=0x7fa0e415a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.627+0000 7fa0ea200640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e40d0710 0x7fa0e415a110 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400c7f0 tx=0x7fa0d400ccb0 comp rx=0 tx=0).stop 2024-05-30T16:54:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.627+0000 7fa0ea200640 1 -- 172.21.15.59:0/677685977 shutdown_connections 2024-05-30T16:54:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.627+0000 7fa0ea200640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0c0068b60 0x7fa0c006b020 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.627+0000 7fa0ea200640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0e4161ce0 0x7fa0e4158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.627+0000 7fa0ea200640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0e40d0ba0 0x7fa0e4158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.627+0000 7fa0ea200640 1 --2- 172.21.15.59:0/677685977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e40d0710 0x7fa0e415a110 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.627+0000 7fa0ea200640 1 -- 172.21.15.59:0/677685977 >> 172.21.15.59:0/677685977 conn(0x7fa0e40b4000 msgr2=0x7fa0e406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.627+0000 7fa0ea200640 1 -- 172.21.15.59:0/677685977 shutdown_connections 2024-05-30T16:54:44.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.627+0000 7fa0ea200640 1 -- 172.21.15.59:0/677685977 wait complete. 2024-05-30T16:54:44.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T16:54:44.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.807+0000 7f7512400640 1 Processor -- start 2024-05-30T16:54:44.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.807+0000 7f7512400640 1 -- start start 2024-05-30T16:54:44.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7512400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f750c162a50 0x7f750c06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:44.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7512400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f750c0d0fb0 con 0x7f750c09b890 2024-05-30T16:54:44.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7512400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f750c0d1290 con 0x7f750c09b4b0 2024-05-30T16:54:44.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7512400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f750c06fef0 con 0x7f750c162a50 2024-05-30T16:54:44.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7503e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f750c09b890 0x7f750c162340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40602/0 (socket says 172.21.15.59:40602) 2024-05-30T16:54:44.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7503e00640 1 -- 172.21.15.59:0/2667564376 learned_addr learned my addr 172.21.15.59:0/2667564376 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7511a00640 1 --2- 172.21.15.59:0/2667564376 >> v2:172.21.15.107:3300/0 conn(0x7f750c162a50 0x7f750c06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446241308 0 0) 0x7f750c0d0fb0 con 0x7f750c09b890 2024-05-30T16:54:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74f0003530 con 0x7f750c09b890 2024-05-30T16:54:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2456925076 0 0) 0x7f74f0003530 con 0x7f750c09b890 2024-05-30T16:54:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 >> v2:172.21.15.107:3300/0 conn(0x7f750c162a50 msgr2=0x7f750c06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 --2- 172.21.15.59:0/2667564376 >> v2:172.21.15.107:3300/0 conn(0x7f750c162a50 0x7f750c06cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 >> v1:172.21.15.107:6789/0 conn(0x7f750c09b4b0 legacy=0x7f750c0d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750c0d1570 con 0x7f750c09b890 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f74f4001680 con 0x7f750c09b890 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 >> v1:172.21.15.59:6789/0 conn(0x7f750c09b890 legacy=0x7f750c162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 --2- 172.21.15.59:0/2667564376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74f00039c0 0x7f74f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 --2- 172.21.15.59:0/2667564376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74f0004810 0x7f74f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 --2- 172.21.15.59:0/2667564376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74f00051d0 0x7f74f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f750c06fef0 con 0x7f74f00051d0 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f74f000c170 con 0x7f74f0004810 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f74f000c370 con 0x7f74f00039c0 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7511a00640 1 --2- 172.21.15.59:0/2667564376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74f00051d0 0x7f74f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7503e00640 1 --2- 172.21.15.59:0/2667564376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74f0004810 0x7f74f0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7511000640 1 --2- 172.21.15.59:0/2667564376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74f00039c0 0x7f74f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7511a00640 1 -- 172.21.15.59:0/2667564376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74f00039c0 msgr2=0x7f74f0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7511a00640 1 --2- 172.21.15.59:0/2667564376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74f00039c0 0x7f74f0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7511a00640 1 -- 172.21.15.59:0/2667564376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74f0004810 msgr2=0x7f74f0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:44.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7511a00640 1 --2- 172.21.15.59:0/2667564376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74f0004810 0x7f74f0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:44.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.811+0000 7f7511a00640 1 -- 172.21.15.59:0/2667564376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f0003530 con 0x7f74f00051d0 2024-05-30T16:54:44.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f7511a00640 1 -- 172.21.15.59:0/2667564376 reap_dead start 2024-05-30T16:54:44.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f7511a00640 1 --2- 172.21.15.59:0/2667564376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74f00051d0 0x7f74f000b9d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7504009f90 tx=0x7f750401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74e870fabd303d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:44.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504009c10 con 0x7f74f00051d0 2024-05-30T16:54:44.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7504003ba0 con 0x7f74f00051d0 2024-05-30T16:54:44.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f750be00640 1 -- 172.21.15.59:0/2667564376 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75040a5980 con 0x7f74f00051d0 2024-05-30T16:54:44.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f7512400640 1 -- 172.21.15.59:0/2667564376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74f00051d0 msgr2=0x7f74f000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f7512400640 1 --2- 172.21.15.59:0/2667564376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74f00051d0 0x7f74f000b9d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7504009f90 tx=0x7f750401cc80 comp rx=0 tx=0).stop 2024-05-30T16:54:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f7512400640 1 -- 172.21.15.59:0/2667564376 shutdown_connections 2024-05-30T16:54:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f7512400640 1 --2- 172.21.15.59:0/2667564376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74f00051d0 0x7f74f000b9d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f7512400640 1 -- 172.21.15.59:0/2667564376 >> 172.21.15.59:0/2667564376 conn(0x7f750c0b3ec0 msgr2=0x7f750c0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f7512400640 1 -- 172.21.15.59:0/2667564376 shutdown_connections 2024-05-30T16:54:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f7512400640 1 -- 172.21.15.59:0/2667564376 wait complete. 2024-05-30T16:54:44.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f7512400640 1 Processor -- start 2024-05-30T16:54:44.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.815+0000 7f7512400640 1 -- start start 2024-05-30T16:54:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7512400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74f00051d0 0x7f750c14d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7512400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f750c14a040 0x7f750c14a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7512400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f750c14ab00 0x7f750c0c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7512400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f750c06cc40 con 0x7f750c14ab00 2024-05-30T16:54:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7512400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f750c06cac0 con 0x7f74f00051d0 2024-05-30T16:54:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7512400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f750c06cdc0 con 0x7f750c14a040 2024-05-30T16:54:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7511a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f750c14ab00 0x7f750c0c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7511a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f750c14ab00 0x7f750c0c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34768/0 (socket says 172.21.15.59:34768) 2024-05-30T16:54:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7511a00640 1 -- 172.21.15.59:0/3776629574 learned_addr learned my addr 172.21.15.59:0/3776629574 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7503e00640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f750c14a040 0x7f750c14a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7511000640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74f00051d0 0x7f750c14d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7511a00640 1 -- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f750c14a040 msgr2=0x7f750c14a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7511a00640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f750c14a040 0x7f750c14a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7511a00640 1 -- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74f00051d0 msgr2=0x7f750c14d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7511a00640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74f00051d0 0x7f750c14d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7511a00640 1 -- 172.21.15.59:0/3776629574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750c0c6140 con 0x7f750c14ab00 2024-05-30T16:54:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7511a00640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f750c14ab00 0x7f750c0c8610 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f75040986a0 tx=0x7f7504009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7509600640 1 -- 172.21.15.59:0/3776629574 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504009c10 con 0x7f750c14ab00 2024-05-30T16:54:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7509600640 1 -- 172.21.15.59:0/3776629574 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75040039a0 con 0x7f750c14ab00 2024-05-30T16:54:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7509600640 1 -- 172.21.15.59:0/3776629574 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75040b6870 con 0x7f750c14ab00 2024-05-30T16:54:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7512400640 1 -- 172.21.15.59:0/3776629574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f750c0c6420 con 0x7f750c14ab00 2024-05-30T16:54:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7512400640 1 -- 172.21.15.59:0/3776629574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f750c14d540 con 0x7f750c14ab00 2024-05-30T16:54:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.819+0000 7f7512400640 1 -- 172.21.15.59:0/3776629574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f750c068a90 con 0x7f750c14ab00 2024-05-30T16:54:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.823+0000 7f7509600640 1 -- 172.21.15.59:0/3776629574 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f75040bf020 con 0x7f750c14ab00 2024-05-30T16:54:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.823+0000 7f7509600640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74e8068b90 0x7f74e806b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.823+0000 7f7509600640 1 -- 172.21.15.59:0/3776629574 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5283+0+0 (secure 0 0 0) 0x7f75041225b0 con 0x7f750c14ab00 2024-05-30T16:54:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.823+0000 7f7511000640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74e8068b90 0x7f74e806b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.823+0000 7f7511000640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74e8068b90 0x7f74e806b050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f74fc001100 tx=0x7f74fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:44.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.827+0000 7f7509600640 1 -- 172.21.15.59:0/3776629574 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f75040c6020 con 0x7f750c14ab00 2024-05-30T16:54:44.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:44.991+0000 7f7512400640 1 -- 172.21.15.59:0/3776629574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f750c1e8b10 con 0x7f750c14ab00 2024-05-30T16:54:45.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.627+0000 7f7509600640 1 -- 172.21.15.59:0/3776629574 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) ==== 170+0+0 (secure 0 0 0) 0x7f7504016990 con 0x7f750c14ab00 2024-05-30T16:54:45.632 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-05-30T16:54:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.631+0000 7f7512400640 1 -- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74e8068b90 msgr2=0x7f74e806b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.631+0000 7f7512400640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74e8068b90 0x7f74e806b050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f74fc001100 tx=0x7f74fc009040 comp rx=0 tx=0).stop 2024-05-30T16:54:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.631+0000 7f7512400640 1 -- 172.21.15.59:0/3776629574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f750c14ab00 msgr2=0x7f750c0c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.631+0000 7f7512400640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f750c14ab00 0x7f750c0c8610 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f75040986a0 tx=0x7f7504009750 comp rx=0 tx=0).stop 2024-05-30T16:54:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.631+0000 7f7512400640 1 -- 172.21.15.59:0/3776629574 shutdown_connections 2024-05-30T16:54:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.631+0000 7f7512400640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74e8068b90 0x7f74e806b050 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.631+0000 7f7512400640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f750c14ab00 0x7f750c0c8610 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.631+0000 7f7512400640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f750c14a040 0x7f750c14a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.631+0000 7f7512400640 1 --2- 172.21.15.59:0/3776629574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74f00051d0 0x7f750c14d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.631+0000 7f7512400640 1 -- 172.21.15.59:0/3776629574 >> 172.21.15.59:0/3776629574 conn(0x7f750c0b3ec0 msgr2=0x7f750c0cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.631+0000 7f7512400640 1 -- 172.21.15.59:0/3776629574 shutdown_connections 2024-05-30T16:54:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.631+0000 7f7512400640 1 -- 172.21.15.59:0/3776629574 wait complete. 2024-05-30T16:54:45.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T16:54:45.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.819+0000 7f8921000640 1 Processor -- start 2024-05-30T16:54:45.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.819+0000 7f8921000640 1 -- start start 2024-05-30T16:54:45.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.819+0000 7f8921000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f891c09b4b0 0x7f891c06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.819+0000 7f8921000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f891c162340 0x7f891c1627d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.819+0000 7f8921000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f891c0d0fb0 con 0x7f891c09b890 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.819+0000 7f8921000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f891c06fef0 con 0x7f891c162340 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.819+0000 7f8921000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f891c0d1290 con 0x7f891c09b4b0 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.819+0000 7f891be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f891c162340 0x7f891c1627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.819+0000 7f891be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f891c162340 0x7f891c1627d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34778/0 (socket says 172.21.15.59:34778) 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.819+0000 7f891be00640 1 -- 172.21.15.59:0/4097873503 learned_addr learned my addr 172.21.15.59:0/4097873503 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.819+0000 7f8913e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f891c09b890 0x7f891c0d0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40616/0 (socket says 172.21.15.59:40616) 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.823+0000 7f891b400640 1 --2- 172.21.15.59:0/4097873503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f891c09b4b0 0x7f891c06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.823+0000 7f891be00640 1 -- 172.21.15.59:0/4097873503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f891c09b4b0 msgr2=0x7f891c06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.823+0000 7f891be00640 1 --2- 172.21.15.59:0/4097873503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f891c09b4b0 0x7f891c06cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.823+0000 7f891be00640 1 -- 172.21.15.59:0/4097873503 >> v1:172.21.15.59:6789/0 conn(0x7f891c09b890 legacy=0x7f891c0d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.823+0000 7f891be00640 1 -- 172.21.15.59:0/4097873503 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891c0d1570 con 0x7f891c162340 2024-05-30T16:54:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.823+0000 7f891aa00640 1 -- 172.21.15.59:0/4097873503 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3522331618 0 0) 0x7f891c0d0fb0 con 0x7f891c09b890 2024-05-30T16:54:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.823+0000 7f891be00640 1 --2- 172.21.15.59:0/4097873503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891c162340 0x7f891c1627d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8914009e50 tx=0x7f891401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5bc048b9ed5e15 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.823+0000 7f891aa00640 1 -- 172.21.15.59:0/4097873503 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89140a56e0 con 0x7f891c162340 2024-05-30T16:54:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.823+0000 7f891aa00640 1 -- 172.21.15.59:0/4097873503 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89140a5880 con 0x7f891c162340 2024-05-30T16:54:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.823+0000 7f891aa00640 1 -- 172.21.15.59:0/4097873503 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89140a5c50 con 0x7f891c162340 2024-05-30T16:54:45.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.823+0000 7f8921000640 1 -- 172.21.15.59:0/4097873503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891c162340 msgr2=0x7f891c1627d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:45.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.823+0000 7f8921000640 1 --2- 172.21.15.59:0/4097873503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891c162340 0x7f891c1627d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8914009e50 tx=0x7f891401c9a0 comp rx=0 tx=0).stop 2024-05-30T16:54:45.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 -- 172.21.15.59:0/4097873503 shutdown_connections 2024-05-30T16:54:45.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 --2- 172.21.15.59:0/4097873503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891c162340 0x7f891c1627d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:45.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 --2- 172.21.15.59:0/4097873503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f891c09b4b0 0x7f891c06cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:45.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 -- 172.21.15.59:0/4097873503 >> 172.21.15.59:0/4097873503 conn(0x7f891c0b3ec0 msgr2=0x7f891c0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:45.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 -- 172.21.15.59:0/4097873503 shutdown_connections 2024-05-30T16:54:45.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 -- 172.21.15.59:0/4097873503 wait complete. 2024-05-30T16:54:45.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 Processor -- start 2024-05-30T16:54:45.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 -- start start 2024-05-30T16:54:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891c09b4b0 0x7f891c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f891c09b890 0x7f891c15ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f891c162340 0x7f891c0af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f891c15fbf0 con 0x7f891c09b4b0 2024-05-30T16:54:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f891c15fa70 con 0x7f891c09b890 2024-05-30T16:54:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8921000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f891c070360 con 0x7f891c162340 2024-05-30T16:54:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f891b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891c09b4b0 0x7f891c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f891b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891c09b4b0 0x7f891c0b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34782/0 (socket says 172.21.15.59:34782) 2024-05-30T16:54:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f891b400640 1 -- 172.21.15.59:0/264351727 learned_addr learned my addr 172.21.15.59:0/264351727 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f891be00640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f891c162340 0x7f891c0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:45.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8913e00640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f891c09b890 0x7f891c15ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:45.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f891b400640 1 -- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f891c162340 msgr2=0x7f891c0af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:45.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f891b400640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f891c162340 0x7f891c0af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:45.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f891b400640 1 -- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f891c09b890 msgr2=0x7f891c15ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:45.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f891b400640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f891c09b890 0x7f891c15ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:45.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f891b400640 1 -- 172.21.15.59:0/264351727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891c0af680 con 0x7f891c09b4b0 2024-05-30T16:54:45.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f891be00640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f891c162340 0x7f891c0af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:45.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f891b400640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891c09b4b0 0x7f891c0b09c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f890c00d800 tx=0x7f890c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:45.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.827+0000 7f8913400640 1 -- 172.21.15.59:0/264351727 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c00b6c0 con 0x7f891c09b4b0 2024-05-30T16:54:45.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.831+0000 7f8913400640 1 -- 172.21.15.59:0/264351727 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f890c019070 con 0x7f891c09b4b0 2024-05-30T16:54:45.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.831+0000 7f8913400640 1 -- 172.21.15.59:0/264351727 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c00ba60 con 0x7f891c09b4b0 2024-05-30T16:54:45.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.831+0000 7f8921000640 1 -- 172.21.15.59:0/264351727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891c0af920 con 0x7f891c09b4b0 2024-05-30T16:54:45.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.831+0000 7f8921000640 1 -- 172.21.15.59:0/264351727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f891c0afee0 con 0x7f891c09b4b0 2024-05-30T16:54:45.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.831+0000 7f8921000640 1 -- 172.21.15.59:0/264351727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f891c068a90 con 0x7f891c09b4b0 2024-05-30T16:54:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.831+0000 7f8913400640 1 -- 172.21.15.59:0/264351727 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f890c00bc00 con 0x7f891c09b4b0 2024-05-30T16:54:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.831+0000 7f8913400640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f88f8068b60 0x7f88f806b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.831+0000 7f8913400640 1 -- 172.21.15.59:0/264351727 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5665+0+0 (secure 0 0 0) 0x7f890c088120 con 0x7f891c09b4b0 2024-05-30T16:54:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.831+0000 7f8913e00640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f88f8068b60 0x7f88f806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.835+0000 7f8913e00640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f88f8068b60 0x7f88f806b020 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f891c0b1e60 tx=0x7f8904007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:45.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:45.839+0000 7f8913400640 1 -- 172.21.15.59:0/264351727 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f890c0576e0 con 0x7f891c09b4b0 2024-05-30T16:54:46.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.035+0000 7f8921000640 1 -- 172.21.15.59:0/264351727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f891c16a480 con 0x7f891c09b4b0 2024-05-30T16:54:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.631+0000 7f8913400640 1 -- 172.21.15.59:0/264351727 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v30) ==== 172+0+0 (secure 0 0 0) 0x7f890c056fe0 con 0x7f891c09b4b0 2024-05-30T16:54:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 8 and data pool 9 2024-05-30T16:54:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.635+0000 7f8921000640 1 -- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f88f8068b60 msgr2=0x7f88f806b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.635+0000 7f8921000640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f88f8068b60 0x7f88f806b020 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f891c0b1e60 tx=0x7f8904007b60 comp rx=0 tx=0).stop 2024-05-30T16:54:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.635+0000 7f8921000640 1 -- 172.21.15.59:0/264351727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891c09b4b0 msgr2=0x7f891c0b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.635+0000 7f8921000640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891c09b4b0 0x7f891c0b09c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f890c00d800 tx=0x7f890c00dcc0 comp rx=0 tx=0).stop 2024-05-30T16:54:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.635+0000 7f8921000640 1 -- 172.21.15.59:0/264351727 shutdown_connections 2024-05-30T16:54:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.635+0000 7f8921000640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f88f8068b60 0x7f88f806b020 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.635+0000 7f8921000640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f891c162340 0x7f891c0af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.635+0000 7f8921000640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f891c09b890 0x7f891c15ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.635+0000 7f8921000640 1 --2- 172.21.15.59:0/264351727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891c09b4b0 0x7f891c0b09c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.635+0000 7f8921000640 1 -- 172.21.15.59:0/264351727 >> 172.21.15.59:0/264351727 conn(0x7f891c0b3ec0 msgr2=0x7f891c0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:46.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.643+0000 7f8921000640 1 -- 172.21.15.59:0/264351727 shutdown_connections 2024-05-30T16:54:46.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.643+0000 7f8921000640 1 -- 172.21.15.59:0/264351727 wait complete. 2024-05-30T16:54:46.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:54:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.823+0000 7f47d5800640 1 Processor -- start 2024-05-30T16:54:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.823+0000 7f47d5800640 1 -- start start 2024-05-30T16:54:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.823+0000 7f47d5800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47d00d0560 0x7f47d00d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47d5800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d015f060 con 0x7f47d00af720 2024-05-30T16:54:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47d5800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d015ff00 con 0x7f47d006e900 2024-05-30T16:54:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47d5800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f47d00afb00 con 0x7f47d00d0560 2024-05-30T16:54:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47cf400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47d00d0560 0x7f47d00d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47cf400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47d00d0560 0x7f47d00d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34788/0 (socket says 172.21.15.59:34788) 2024-05-30T16:54:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47cf400640 1 -- 172.21.15.59:0/3654961105 learned_addr learned my addr 172.21.15.59:0/3654961105 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47cf400640 1 -- 172.21.15.59:0/3654961105 >> v1:172.21.15.107:6789/0 conn(0x7f47d006e900 legacy=0x7f47d015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47cf400640 1 -- 172.21.15.59:0/3654961105 >> v1:172.21.15.59:6789/0 conn(0x7f47d00af720 legacy=0x7f47d015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47cf400640 1 -- 172.21.15.59:0/3654961105 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d015c270 con 0x7f47d00d0560 2024-05-30T16:54:46.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47cf400640 1 --2- 172.21.15.59:0/3654961105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d00d0560 0x7f47d00d0a10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009e50 tx=0x7f47c801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851eaad32c49ae15 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:46.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47cd600640 1 -- 172.21.15.59:0/3654961105 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c80a57a0 con 0x7f47d00d0560 2024-05-30T16:54:46.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47cd600640 1 -- 172.21.15.59:0/3654961105 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c80a5940 con 0x7f47d00d0560 2024-05-30T16:54:46.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.827+0000 7f47cd600640 1 -- 172.21.15.59:0/3654961105 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c80a5d10 con 0x7f47d00d0560 2024-05-30T16:54:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 -- 172.21.15.59:0/3654961105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d00d0560 msgr2=0x7f47d00d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 --2- 172.21.15.59:0/3654961105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d00d0560 0x7f47d00d0a10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009e50 tx=0x7f47c801c9f0 comp rx=0 tx=0).stop 2024-05-30T16:54:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 -- 172.21.15.59:0/3654961105 shutdown_connections 2024-05-30T16:54:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 --2- 172.21.15.59:0/3654961105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d00d0560 0x7f47d00d0a10 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 -- 172.21.15.59:0/3654961105 >> 172.21.15.59:0/3654961105 conn(0x7f47d00b22d0 msgr2=0x7f47d00b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 -- 172.21.15.59:0/3654961105 shutdown_connections 2024-05-30T16:54:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 -- 172.21.15.59:0/3654961105 wait complete. 2024-05-30T16:54:46.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 Processor -- start 2024-05-30T16:54:46.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 -- start start 2024-05-30T16:54:46.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d006e900 0x7f47d009ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:46.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d00af720 0x7f47d01548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:46.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47d00d0560 0x7f47d01679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:46.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f47d00732d0 con 0x7f47d00af720 2024-05-30T16:54:46.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f47d0073150 con 0x7f47d00d0560 2024-05-30T16:54:46.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47d5800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f47d01585c0 con 0x7f47d006e900 2024-05-30T16:54:46.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47ce000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d00af720 0x7f47d01548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:46.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47ce000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d00af720 0x7f47d01548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34804/0 (socket says 172.21.15.59:34804) 2024-05-30T16:54:46.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47ce000640 1 -- 172.21.15.59:0/2334365636 learned_addr learned my addr 172.21.15.59:0/2334365636 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:46.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47cea00640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d006e900 0x7f47d009ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:46.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47cf400640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47d00d0560 0x7f47d01679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47ce000640 1 -- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d006e900 msgr2=0x7f47d009ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47ce000640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d006e900 0x7f47d009ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47ce000640 1 -- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47d00d0560 msgr2=0x7f47d01679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47ce000640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47d00d0560 0x7f47d01679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.831+0000 7f47ce000640 1 -- 172.21.15.59:0/2334365636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d0154e30 con 0x7f47d00af720 2024-05-30T16:54:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.835+0000 7f47ce000640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d00af720 0x7f47d01548f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00c440 tx=0x7f47bc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.835+0000 7f47c6a00640 1 -- 172.21.15.59:0/2334365636 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc017070 con 0x7f47d00af720 2024-05-30T16:54:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.835+0000 7f47c6a00640 1 -- 172.21.15.59:0/2334365636 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc003600 con 0x7f47d00af720 2024-05-30T16:54:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.835+0000 7f47c6a00640 1 -- 172.21.15.59:0/2334365636 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc005480 con 0x7f47d00af720 2024-05-30T16:54:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.835+0000 7f47d5800640 1 -- 172.21.15.59:0/2334365636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d009d140 con 0x7f47d00af720 2024-05-30T16:54:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.835+0000 7f47d5800640 1 -- 172.21.15.59:0/2334365636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d009d700 con 0x7f47d00af720 2024-05-30T16:54:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.835+0000 7f47d5800640 1 -- 172.21.15.59:0/2334365636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d0068a90 con 0x7f47d00af720 2024-05-30T16:54:46.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.835+0000 7f47c6a00640 1 -- 172.21.15.59:0/2334365636 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f47bc0039d0 con 0x7f47d00af720 2024-05-30T16:54:46.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.835+0000 7f47c6a00640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f47b0068b60 0x7f47b006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:46.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.835+0000 7f47c6a00640 1 -- 172.21.15.59:0/2334365636 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7f47bc086dc0 con 0x7f47d00af720 2024-05-30T16:54:46.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.835+0000 7f47cea00640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f47b0068b60 0x7f47b006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:46.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.839+0000 7f47cea00640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f47b0068b60 0x7f47b006b020 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f47d015e850 tx=0x7f47c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:46.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:46.839+0000 7f47c6a00640 1 -- 172.21.15.59:0/2334365636 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f47bc0010d0 con 0x7f47d00af720 2024-05-30T16:54:47.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.007+0000 7f47d5800640 1 -- 172.21.15.59:0/2334365636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47d0073640 con 0x7f47d00af720 2024-05-30T16:54:47.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.007+0000 7f47c6a00640 1 -- 172.21.15.59:0/2334365636 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16753 (secure 0 0 0) 0x7f47bc055d60 con 0x7f47d00af720 2024-05-30T16:54:47.011 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:47.011 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":61,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:54:46.040679+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:54:43.741524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T16:54:45.005283+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:54:47.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.011+0000 7f47d5800640 1 -- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f47b0068b60 msgr2=0x7f47b006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.011+0000 7f47d5800640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f47b0068b60 0x7f47b006b020 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f47d015e850 tx=0x7f47c0009040 comp rx=0 tx=0).stop 2024-05-30T16:54:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.011+0000 7f47d5800640 1 -- 172.21.15.59:0/2334365636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d00af720 msgr2=0x7f47d01548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.011+0000 7f47d5800640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d00af720 0x7f47d01548f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00c440 tx=0x7f47bc00c900 comp rx=0 tx=0).stop 2024-05-30T16:54:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.011+0000 7f47d5800640 1 -- 172.21.15.59:0/2334365636 shutdown_connections 2024-05-30T16:54:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.011+0000 7f47d5800640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f47b0068b60 0x7f47b006b020 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.011+0000 7f47d5800640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47d00d0560 0x7f47d01679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.011+0000 7f47d5800640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d00af720 0x7f47d01548f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.011+0000 7f47d5800640 1 --2- 172.21.15.59:0/2334365636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d006e900 0x7f47d009ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.011+0000 7f47d5800640 1 -- 172.21.15.59:0/2334365636 >> 172.21.15.59:0/2334365636 conn(0x7f47d00b22d0 msgr2=0x7f47d015ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.011+0000 7f47d5800640 1 -- 172.21.15.59:0/2334365636 shutdown_connections 2024-05-30T16:54:47.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.011+0000 7f47d5800640 1 -- 172.21.15.59:0/2334365636 wait complete. 2024-05-30T16:54:47.034 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:54:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f972ec00640 1 Processor -- start 2024-05-30T16:54:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f972ec00640 1 -- start start 2024-05-30T16:54:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f972ec00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f97280cfe20 0x7f972815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f972ec00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972815f3b0 con 0x7f9728073bb0 2024-05-30T16:54:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f972ec00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972815f690 con 0x7f97280cfa40 2024-05-30T16:54:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f972ec00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f972815f970 con 0x7f97280cfe20 2024-05-30T16:54:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f972cc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9728073bb0 0x7f9728072060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40636/0 (socket says 172.21.15.59:40636) 2024-05-30T16:54:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f972cc00640 1 -- 172.21.15.59:0/1380347971 learned_addr learned my addr 172.21.15.59:0/1380347971 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f971fe00640 1 --2- 172.21.15.59:0/1380347971 >> v2:172.21.15.107:3300/0 conn(0x7f97280cfe20 0x7f972815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f9727400640 1 -- 172.21.15.59:0/1380347971 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414821077 0 0) 0x7f972815f3b0 con 0x7f9728073bb0 2024-05-30T16:54:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f9727400640 1 -- 172.21.15.59:0/1380347971 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f970c003530 con 0x7f9728073bb0 2024-05-30T16:54:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f9727400640 1 -- 172.21.15.59:0/1380347971 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 327591421 0 0) 0x7f972815f690 con 0x7f97280cfa40 2024-05-30T16:54:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f9727400640 1 -- 172.21.15.59:0/1380347971 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f972815f3b0 con 0x7f97280cfa40 2024-05-30T16:54:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f971fe00640 1 -- 172.21.15.59:0/1380347971 >> v1:172.21.15.107:6789/0 conn(0x7f97280cfa40 legacy=0x7f97280b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f971fe00640 1 -- 172.21.15.59:0/1380347971 >> v1:172.21.15.59:6789/0 conn(0x7f9728073bb0 legacy=0x7f9728072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.171+0000 7f971fe00640 1 -- 172.21.15.59:0/1380347971 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97280b3370 con 0x7f97280cfe20 2024-05-30T16:54:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.175+0000 7f971fe00640 1 --2- 172.21.15.59:0/1380347971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97280cfe20 0x7f972815ecb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f97100097c0 tx=0x7f971001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a118734794119b9a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.175+0000 7f9727400640 1 -- 172.21.15.59:0/1380347971 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97100b1070 con 0x7f97280cfe20 2024-05-30T16:54:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.175+0000 7f9727400640 1 -- 172.21.15.59:0/1380347971 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97100ac410 con 0x7f97280cfe20 2024-05-30T16:54:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.175+0000 7f9727400640 1 -- 172.21.15.59:0/1380347971 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97100ac7e0 con 0x7f97280cfe20 2024-05-30T16:54:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.175+0000 7f972ec00640 1 -- 172.21.15.59:0/1380347971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97280cfe20 msgr2=0x7f972815ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.175+0000 7f972ec00640 1 --2- 172.21.15.59:0/1380347971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97280cfe20 0x7f972815ecb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f97100097c0 tx=0x7f971001c4a0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.175+0000 7f972ec00640 1 -- 172.21.15.59:0/1380347971 shutdown_connections 2024-05-30T16:54:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.175+0000 7f972ec00640 1 --2- 172.21.15.59:0/1380347971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97280cfe20 0x7f972815ecb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.175+0000 7f972ec00640 1 -- 172.21.15.59:0/1380347971 >> 172.21.15.59:0/1380347971 conn(0x7f97280b22d0 msgr2=0x7f97280b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.175+0000 7f972ec00640 1 -- 172.21.15.59:0/1380347971 shutdown_connections 2024-05-30T16:54:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.175+0000 7f972ec00640 1 -- 172.21.15.59:0/1380347971 wait complete. 2024-05-30T16:54:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f972ec00640 1 Processor -- start 2024-05-30T16:54:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f972ec00640 1 -- start start 2024-05-30T16:54:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f972ec00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9728073bb0 0x7f972814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f972ec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97280cfa40 0x7f9728157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f972ec00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97280cfe20 0x7f9728157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f972ec00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9728154fc0 con 0x7f9728073bb0 2024-05-30T16:54:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f972ec00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9728154e40 con 0x7f97280cfe20 2024-05-30T16:54:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f972ec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9728155140 con 0x7f97280cfa40 2024-05-30T16:54:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f9727e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9728073bb0 0x7f972814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f9727e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9728073bb0 0x7f972814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34814/0 (socket says 172.21.15.59:34814) 2024-05-30T16:54:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f9727e00640 1 -- 172.21.15.59:0/3464127480 learned_addr learned my addr 172.21.15.59:0/3464127480 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f971fe00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97280cfa40 0x7f9728157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f9727e00640 1 -- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97280cfa40 msgr2=0x7f9728157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f9727e00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97280cfa40 0x7f9728157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f9727e00640 1 -- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97280cfe20 msgr2=0x7f9728157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f9727e00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97280cfe20 0x7f9728157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f9727e00640 1 -- 172.21.15.59:0/3464127480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97281f77f0 con 0x7f9728073bb0 2024-05-30T16:54:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f971fe00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97280cfa40 0x7f9728157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f9727e00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9728073bb0 0x7f972814b330 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f971800c490 tx=0x7f971800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f9724c00640 1 -- 172.21.15.59:0/3464127480 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97180052d0 con 0x7f9728073bb0 2024-05-30T16:54:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f9724c00640 1 -- 172.21.15.59:0/3464127480 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9718005470 con 0x7f9728073bb0 2024-05-30T16:54:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f972ec00640 1 -- 172.21.15.59:0/3464127480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97281f7ad0 con 0x7f9728073bb0 2024-05-30T16:54:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f9724c00640 1 -- 172.21.15.59:0/3464127480 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718012870 con 0x7f9728073bb0 2024-05-30T16:54:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.179+0000 7f972ec00640 1 -- 172.21.15.59:0/3464127480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97281f8090 con 0x7f9728073bb0 2024-05-30T16:54:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.183+0000 7f972ec00640 1 -- 172.21.15.59:0/3464127480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97281f8470 con 0x7f9728073bb0 2024-05-30T16:54:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.183+0000 7f9724c00640 1 -- 172.21.15.59:0/3464127480 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f9718012a10 con 0x7f9728073bb0 2024-05-30T16:54:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.183+0000 7f9724c00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9704068b60 0x7f970406b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.183+0000 7f9724c00640 1 -- 172.21.15.59:0/3464127480 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7f9718085040 con 0x7f9728073bb0 2024-05-30T16:54:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.183+0000 7f971fe00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9704068b60 0x7f970406b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.183+0000 7f971fe00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9704068b60 0x7f970406b020 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f97100ae000 tx=0x7f97100a6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.187+0000 7f9724c00640 1 -- 172.21.15.59:0/3464127480 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f97281f8470 con 0x7f9728073bb0 2024-05-30T16:54:47.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.355+0000 7f972ec00640 1 -- 172.21.15.59:0/3464127480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9728068a90 con 0x7f9728073bb0 2024-05-30T16:54:47.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.355+0000 7f9724c00640 1 -- 172.21.15.59:0/3464127480 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16753 (secure 0 0 0) 0x7f9718056ef0 con 0x7f9728073bb0 2024-05-30T16:54:47.360 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:47.360 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":61,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:54:46.040679+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:54:43.741524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T16:54:45.005283+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:54:47.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.359+0000 7f972ec00640 1 -- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9704068b60 msgr2=0x7f970406b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.359+0000 7f972ec00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9704068b60 0x7f970406b020 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f97100ae000 tx=0x7f97100a6040 comp rx=0 tx=0).stop 2024-05-30T16:54:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.359+0000 7f972ec00640 1 -- 172.21.15.59:0/3464127480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9728073bb0 msgr2=0x7f972814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.359+0000 7f972ec00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9728073bb0 0x7f972814b330 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f971800c490 tx=0x7f971800c950 comp rx=0 tx=0).stop 2024-05-30T16:54:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.359+0000 7f972ec00640 1 -- 172.21.15.59:0/3464127480 shutdown_connections 2024-05-30T16:54:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.359+0000 7f972ec00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9704068b60 0x7f970406b020 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.359+0000 7f972ec00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97280cfe20 0x7f9728157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.359+0000 7f972ec00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97280cfa40 0x7f9728157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.359+0000 7f972ec00640 1 --2- 172.21.15.59:0/3464127480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9728073bb0 0x7f972814b330 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.359+0000 7f972ec00640 1 -- 172.21.15.59:0/3464127480 >> 172.21.15.59:0/3464127480 conn(0x7f97280b22d0 msgr2=0x7f9728072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.359+0000 7f972ec00640 1 -- 172.21.15.59:0/3464127480 shutdown_connections 2024-05-30T16:54:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.359+0000 7f972ec00640 1 -- 172.21.15.59:0/3464127480 wait complete. 2024-05-30T16:54:47.382 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T16:54:47.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.523+0000 7f54d3400640 1 Processor -- start 2024-05-30T16:54:47.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.523+0000 7f54d3400640 1 -- start start 2024-05-30T16:54:47.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.523+0000 7f54d3400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f54cc15e940 0x7f54cc06ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:47.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.523+0000 7f54d3400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54cc15ed20 con 0x7f54cc0af230 2024-05-30T16:54:47.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.523+0000 7f54d3400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54cc0d0830 con 0x7f54cc0b18c0 2024-05-30T16:54:47.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.523+0000 7f54d3400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f54cc0d10f0 con 0x7f54cc15e940 2024-05-30T16:54:47.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.527+0000 7f54d1400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f54cc0af230 0x7f54cc09aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40652/0 (socket says 172.21.15.59:40652) 2024-05-30T16:54:47.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.527+0000 7f54d1400640 1 -- 172.21.15.59:0/379478970 learned_addr learned my addr 172.21.15.59:0/379478970 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:47.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.527+0000 7f54d0a00640 1 --2- 172.21.15.59:0/379478970 >> v2:172.21.15.107:3300/0 conn(0x7f54cc15e940 0x7f54cc06ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:47.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.527+0000 7f54cbe00640 1 -- 172.21.15.59:0/379478970 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923681061 0 0) 0x7f54cc15ed20 con 0x7f54cc0af230 2024-05-30T16:54:47.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.527+0000 7f54cbe00640 1 -- 172.21.15.59:0/379478970 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54b0003530 con 0x7f54cc0af230 2024-05-30T16:54:47.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.527+0000 7f54d0a00640 1 -- 172.21.15.59:0/379478970 >> v1:172.21.15.107:6789/0 conn(0x7f54cc0b18c0 legacy=0x7f54cc0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.527+0000 7f54cbe00640 1 -- 172.21.15.59:0/379478970 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858545897 0 0) 0x7f54cc0d0830 con 0x7f54cc0b18c0 2024-05-30T16:54:47.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.527+0000 7f54d0a00640 1 -- 172.21.15.59:0/379478970 >> v1:172.21.15.59:6789/0 conn(0x7f54cc0af230 legacy=0x7f54cc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.527+0000 7f54d0a00640 1 -- 172.21.15.59:0/379478970 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc0b1d00 con 0x7f54cc15e940 2024-05-30T16:54:47.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.527+0000 7f54d0a00640 1 --2- 172.21.15.59:0/379478970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54cc15e940 0x7f54cc06ffe0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0097c0 tx=0x7f54bc01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d241307122a53bd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:47.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54cbe00640 1 -- 172.21.15.59:0/379478970 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0b5070 con 0x7f54cc15e940 2024-05-30T16:54:47.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54cbe00640 1 -- 172.21.15.59:0/379478970 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54bc0a8990 con 0x7f54cc15e940 2024-05-30T16:54:47.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54cbe00640 1 -- 172.21.15.59:0/379478970 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0a8d60 con 0x7f54cc15e940 2024-05-30T16:54:47.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 -- 172.21.15.59:0/379478970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54cc15e940 msgr2=0x7f54cc06ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 --2- 172.21.15.59:0/379478970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54cc15e940 0x7f54cc06ffe0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0097c0 tx=0x7f54bc01ec90 comp rx=0 tx=0).stop 2024-05-30T16:54:47.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 -- 172.21.15.59:0/379478970 shutdown_connections 2024-05-30T16:54:47.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 --2- 172.21.15.59:0/379478970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54cc15e940 0x7f54cc06ffe0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 -- 172.21.15.59:0/379478970 >> 172.21.15.59:0/379478970 conn(0x7f54cc0b3f70 msgr2=0x7f54cc0b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:47.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 -- 172.21.15.59:0/379478970 shutdown_connections 2024-05-30T16:54:47.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 -- 172.21.15.59:0/379478970 wait complete. 2024-05-30T16:54:47.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 Processor -- start 2024-05-30T16:54:47.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 -- start start 2024-05-30T16:54:47.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54cc0af230 0x7f54cc0b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:47.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54cc0b18c0 0x7f54cc14ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:47.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54cc15e940 0x7f54cc14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:47.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc0d0d80 con 0x7f54cc0af230 2024-05-30T16:54:47.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc0d0aa0 con 0x7f54cc0b18c0 2024-05-30T16:54:47.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d3400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f54cc0d1c90 con 0x7f54cc15e940 2024-05-30T16:54:47.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54cc0af230 0x7f54cc0b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:47.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54cc0af230 0x7f54cc0b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34820/0 (socket says 172.21.15.59:34820) 2024-05-30T16:54:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d0a00640 1 -- 172.21.15.59:0/3372022118 learned_addr learned my addr 172.21.15.59:0/3372022118 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54d1400640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54cc15e940 0x7f54cc14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.531+0000 7f54c3e00640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54cc0b18c0 0x7f54cc14ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54d0a00640 1 -- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54cc15e940 msgr2=0x7f54cc14a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54d0a00640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54cc15e940 0x7f54cc14a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54d0a00640 1 -- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54cc0b18c0 msgr2=0x7f54cc14ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54d0a00640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54cc0b18c0 0x7f54cc14ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54d0a00640 1 -- 172.21.15.59:0/3372022118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc1f84a0 con 0x7f54cc0af230 2024-05-30T16:54:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54d0a00640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54cc0af230 0x7f54cc0b7f40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0b3040 tx=0x7f54bc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54c9600640 1 -- 172.21.15.59:0/3372022118 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0b5040 con 0x7f54cc0af230 2024-05-30T16:54:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54c9600640 1 -- 172.21.15.59:0/3372022118 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54bc0b0500 con 0x7f54cc0af230 2024-05-30T16:54:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54d3400640 1 -- 172.21.15.59:0/3372022118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54cc0b54e0 con 0x7f54cc0af230 2024-05-30T16:54:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54c9600640 1 -- 172.21.15.59:0/3372022118 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0b08d0 con 0x7f54cc0af230 2024-05-30T16:54:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54d3400640 1 -- 172.21.15.59:0/3372022118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54cc160780 con 0x7f54cc0af230 2024-05-30T16:54:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54d3400640 1 -- 172.21.15.59:0/3372022118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54cc0b52d0 con 0x7f54cc0af230 2024-05-30T16:54:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54c9600640 1 -- 172.21.15.59:0/3372022118 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f54bc0c1020 con 0x7f54cc0af230 2024-05-30T16:54:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54c9600640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f54a8068b60 0x7f54a806b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54c9600640 1 -- 172.21.15.59:0/3372022118 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7f54bc124460 con 0x7f54cc0af230 2024-05-30T16:54:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.535+0000 7f54c3e00640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f54a8068b60 0x7f54a806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:47.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.539+0000 7f54c3e00640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f54a8068b60 0x7f54a806b020 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0d0850 tx=0x7f54b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.539+0000 7f54c9600640 1 -- 172.21.15.59:0/3372022118 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f54bc0c8020 con 0x7f54cc0af230 2024-05-30T16:54:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:47.747+0000 7f54d3400640 1 -- 172.21.15.59:0/3372022118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f54cc068a90 con 0x7f54cc0af230 2024-05-30T16:54:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.663+0000 7f54c9600640 1 -- 172.21.15.59:0/3372022118 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) ==== 118+0+0 (secure 0 0 0) 0x7f54cc0b1d00 con 0x7f54cc0af230 2024-05-30T16:54:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.667+0000 7f54d3400640 1 -- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f54a8068b60 msgr2=0x7f54a806b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.667+0000 7f54d3400640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f54a8068b60 0x7f54a806b020 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0d0850 tx=0x7f54b4009040 comp rx=0 tx=0).stop 2024-05-30T16:54:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.667+0000 7f54d3400640 1 -- 172.21.15.59:0/3372022118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54cc0af230 msgr2=0x7f54cc0b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.667+0000 7f54d3400640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54cc0af230 0x7f54cc0b7f40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0b3040 tx=0x7f54bc01ba30 comp rx=0 tx=0).stop 2024-05-30T16:54:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.667+0000 7f54d3400640 1 -- 172.21.15.59:0/3372022118 shutdown_connections 2024-05-30T16:54:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.667+0000 7f54d3400640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f54a8068b60 0x7f54a806b020 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.667+0000 7f54d3400640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54cc15e940 0x7f54cc14a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.667+0000 7f54d3400640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54cc0b18c0 0x7f54cc14ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.667+0000 7f54d3400640 1 --2- 172.21.15.59:0/3372022118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54cc0af230 0x7f54cc0b7f40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.667+0000 7f54d3400640 1 -- 172.21.15.59:0/3372022118 >> 172.21.15.59:0/3372022118 conn(0x7f54cc0b3f70 msgr2=0x7f54cc15db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.667+0000 7f54d3400640 1 -- 172.21.15.59:0/3372022118 shutdown_connections 2024-05-30T16:54:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.667+0000 7f54d3400640 1 -- 172.21.15.59:0/3372022118 wait complete. 2024-05-30T16:54:48.693 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T16:54:48.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T16:54:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0e7000640 1 Processor -- start 2024-05-30T16:54:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0e7000640 1 -- start start 2024-05-30T16:54:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0e7000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0e015fc30 0x7ff0e01602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0e7000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff0e00cea50 0x7ff0e01607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0e7000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e00b3970 con 0x7ff0e00ce0b0 2024-05-30T16:54:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0e7000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e00d2290 con 0x7ff0e015fc30 2024-05-30T16:54:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0e7000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e0160010 con 0x7ff0e00cea50 2024-05-30T16:54:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0dfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0e015fc30 0x7ff0e01602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0dfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0e015fc30 0x7ff0e01602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34822/0 (socket says 172.21.15.59:34822) 2024-05-30T16:54:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0dfe00640 1 -- 172.21.15.59:0/1472177191 learned_addr learned my addr 172.21.15.59:0/1472177191 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0d7400640 1 --2- 172.21.15.59:0/1472177191 >> v2:172.21.15.107:3300/0 conn(0x7ff0e00cea50 0x7ff0e01607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0dfe00640 1 -- 172.21.15.59:0/1472177191 >> v2:172.21.15.107:3300/0 conn(0x7ff0e00cea50 msgr2=0x7ff0e01607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0dfe00640 1 --2- 172.21.15.59:0/1472177191 >> v2:172.21.15.107:3300/0 conn(0x7ff0e00cea50 0x7ff0e01607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0dfe00640 1 -- 172.21.15.59:0/1472177191 >> v1:172.21.15.107:6789/0 conn(0x7ff0e00ce0b0 legacy=0x7ff0e009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0dfe00640 1 -- 172.21.15.59:0/1472177191 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e00b33b0 con 0x7ff0e015fc30 2024-05-30T16:54:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.839+0000 7ff0d7400640 1 --2- 172.21.15.59:0/1472177191 >> v2:172.21.15.107:3300/0 conn(0x7ff0e00cea50 0x7ff0e01607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.843+0000 7ff0dfe00640 1 --2- 172.21.15.59:0/1472177191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e015fc30 0x7ff0e01602b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0072c00 tx=0x7ff0d001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6956e355e9a5681 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:48.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.843+0000 7ff0df400640 1 -- 172.21.15.59:0/1472177191 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00b2070 con 0x7ff0e015fc30 2024-05-30T16:54:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.843+0000 7ff0df400640 1 -- 172.21.15.59:0/1472177191 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d00ad680 con 0x7ff0e015fc30 2024-05-30T16:54:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.843+0000 7ff0df400640 1 -- 172.21.15.59:0/1472177191 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00ada50 con 0x7ff0e015fc30 2024-05-30T16:54:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.843+0000 7ff0e7000640 1 -- 172.21.15.59:0/1472177191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e015fc30 msgr2=0x7ff0e01602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.843+0000 7ff0e7000640 1 --2- 172.21.15.59:0/1472177191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e015fc30 0x7ff0e01602b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0072c00 tx=0x7ff0d001c490 comp rx=0 tx=0).stop 2024-05-30T16:54:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.843+0000 7ff0e7000640 1 -- 172.21.15.59:0/1472177191 shutdown_connections 2024-05-30T16:54:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.843+0000 7ff0e7000640 1 --2- 172.21.15.59:0/1472177191 >> v2:172.21.15.107:3300/0 conn(0x7ff0e00cea50 0x7ff0e01607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.843+0000 7ff0e7000640 1 --2- 172.21.15.59:0/1472177191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e015fc30 0x7ff0e01602b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.843+0000 7ff0e7000640 1 -- 172.21.15.59:0/1472177191 >> 172.21.15.59:0/1472177191 conn(0x7ff0e00d2440 msgr2=0x7ff0e00d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.843+0000 7ff0e7000640 1 -- 172.21.15.59:0/1472177191 shutdown_connections 2024-05-30T16:54:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.843+0000 7ff0e7000640 1 -- 172.21.15.59:0/1472177191 wait complete. 2024-05-30T16:54:48.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0e7000640 1 Processor -- start 2024-05-30T16:54:48.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0e7000640 1 -- start start 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0e7000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0e00ce0b0 0x7ff0e0155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0e7000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e00cea50 0x7ff0e0157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0e7000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0e015fc30 0x7ff0e01575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0e7000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0169770 con 0x7ff0e00cea50 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0e7000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e01695f0 con 0x7ff0e00ce0b0 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0e7000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e01698f0 con 0x7ff0e015fc30 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0d7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e00cea50 0x7ff0e0157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0d7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e00cea50 0x7ff0e0157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34828/0 (socket says 172.21.15.59:34828) 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0d7400640 1 -- 172.21.15.59:0/1227364376 learned_addr learned my addr 172.21.15.59:0/1227364376 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0dfe00640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0e00ce0b0 0x7ff0e0155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0d7400640 1 -- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0e015fc30 msgr2=0x7ff0e01575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0e5000640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0e015fc30 0x7ff0e01575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0d7400640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0e015fc30 0x7ff0e01575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0d7400640 1 -- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0e00ce0b0 msgr2=0x7ff0e0155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0d7400640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0e00ce0b0 0x7ff0e0155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0d7400640 1 -- 172.21.15.59:0/1227364376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e0166260 con 0x7ff0e00cea50 2024-05-30T16:54:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0e5000640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0e015fc30 0x7ff0e01575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0d7400640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e00cea50 0x7ff0e0157060 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800d830 tx=0x7ff0c800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0dcc00640 1 -- 172.21.15.59:0/1227364376 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800b6c0 con 0x7ff0e00cea50 2024-05-30T16:54:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0dcc00640 1 -- 172.21.15.59:0/1227364376 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c8019070 con 0x7ff0e00cea50 2024-05-30T16:54:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0dcc00640 1 -- 172.21.15.59:0/1227364376 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800baa0 con 0x7ff0e00cea50 2024-05-30T16:54:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0e7000640 1 -- 172.21.15.59:0/1227364376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e0166540 con 0x7ff0e00cea50 2024-05-30T16:54:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.847+0000 7ff0e7000640 1 -- 172.21.15.59:0/1227364376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e0166b00 con 0x7ff0e00cea50 2024-05-30T16:54:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.851+0000 7ff0e7000640 1 -- 172.21.15.59:0/1227364376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e0068a90 con 0x7ff0e00cea50 2024-05-30T16:54:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.851+0000 7ff0dcc00640 1 -- 172.21.15.59:0/1227364376 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7ff0c801e460 con 0x7ff0e00cea50 2024-05-30T16:54:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.851+0000 7ff0dcc00640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff0bc068b60 0x7ff0bc06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.851+0000 7ff0dcc00640 1 -- 172.21.15.59:0/1227364376 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7ff0c8088370 con 0x7ff0e00cea50 2024-05-30T16:54:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.851+0000 7ff0dfe00640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff0bc068b60 0x7ff0bc06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:48.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.851+0000 7ff0dfe00640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff0bc068b60 0x7ff0bc06b020 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00af000 tx=0x7ff0d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:48.855+0000 7ff0dcc00640 1 -- 172.21.15.59:0/1227364376 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff0c80578d0 con 0x7ff0e00cea50 2024-05-30T16:54:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.055+0000 7ff0e7000640 1 -- 172.21.15.59:0/1227364376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff0e00ce620 con 0x7ff0e00cea50 2024-05-30T16:54:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.667+0000 7ff0dcc00640 1 -- 172.21.15.59:0/1227364376 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7ff0c80571d0 con 0x7ff0e00cea50 2024-05-30T16:54:49.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.671+0000 7ff0e7000640 1 -- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff0bc068b60 msgr2=0x7ff0bc06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:49.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.671+0000 7ff0e7000640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff0bc068b60 0x7ff0bc06b020 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00af000 tx=0x7ff0d0008040 comp rx=0 tx=0).stop 2024-05-30T16:54:49.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.671+0000 7ff0e7000640 1 -- 172.21.15.59:0/1227364376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e00cea50 msgr2=0x7ff0e0157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:49.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.671+0000 7ff0e7000640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e00cea50 0x7ff0e0157060 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800d830 tx=0x7ff0c800dcf0 comp rx=0 tx=0).stop 2024-05-30T16:54:49.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.671+0000 7ff0e7000640 1 -- 172.21.15.59:0/1227364376 shutdown_connections 2024-05-30T16:54:49.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.671+0000 7ff0e7000640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff0bc068b60 0x7ff0bc06b020 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:49.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.671+0000 7ff0e7000640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0e015fc30 0x7ff0e01575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:49.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.671+0000 7ff0e7000640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e00cea50 0x7ff0e0157060 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:49.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.671+0000 7ff0e7000640 1 --2- 172.21.15.59:0/1227364376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0e00ce0b0 0x7ff0e0155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:49.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.671+0000 7ff0e7000640 1 -- 172.21.15.59:0/1227364376 >> 172.21.15.59:0/1227364376 conn(0x7ff0e00d2440 msgr2=0x7ff0e00cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:49.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.671+0000 7ff0e7000640 1 -- 172.21.15.59:0/1227364376 shutdown_connections 2024-05-30T16:54:49.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.671+0000 7ff0e7000640 1 -- 172.21.15.59:0/1227364376 wait complete. 2024-05-30T16:54:49.700 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T16:54:49.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:54:49.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f055de00640 1 Processor -- start 2024-05-30T16:54:49.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f055de00640 1 -- start start 2024-05-30T16:54:49.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f055de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05580af720 0x7f055815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:49.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f055de00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f055806e900 0x7f055815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:49.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f055de00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055815f060 con 0x7f05580d0560 2024-05-30T16:54:49.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f055de00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f05580afb00 con 0x7f05580af720 2024-05-30T16:54:49.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f055de00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f055815c270 con 0x7f055806e900 2024-05-30T16:54:49.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f0556a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05580af720 0x7f055815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:49.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f0556a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05580af720 0x7f055815b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34844/0 (socket says 172.21.15.59:34844) 2024-05-30T16:54:49.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f0556a00640 1 -- 172.21.15.59:0/1894452225 learned_addr learned my addr 172.21.15.59:0/1894452225 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:49.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f054e000640 1 --2- 172.21.15.59:0/1894452225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f055806e900 0x7f055815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:49.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f0556a00640 1 -- 172.21.15.59:0/1894452225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f055806e900 msgr2=0x7f055815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:49.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f0556a00640 1 --2- 172.21.15.59:0/1894452225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f055806e900 0x7f055815f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:49.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f0556a00640 1 -- 172.21.15.59:0/1894452225 >> v1:172.21.15.107:6789/0 conn(0x7f05580d0560 legacy=0x7f0558072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:49.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f0556a00640 1 -- 172.21.15.59:0/1894452225 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055815c550 con 0x7f05580af720 2024-05-30T16:54:49.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.843+0000 7f054e000640 1 --2- 172.21.15.59:0/1894452225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f055806e900 0x7f055815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:49.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.847+0000 7f0556a00640 1 --2- 172.21.15.59:0/1894452225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05580af720 0x7f055815b9d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0548009870 tx=0x7f054801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d3faef10af844a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:49.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.847+0000 7f0556000640 1 -- 172.21.15.59:0/1894452225 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05480aa430 con 0x7f05580af720 2024-05-30T16:54:49.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.847+0000 7f0556000640 1 -- 172.21.15.59:0/1894452225 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05480af070 con 0x7f05580af720 2024-05-30T16:54:49.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.847+0000 7f0556000640 1 -- 172.21.15.59:0/1894452225 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05480aa7f0 con 0x7f05580af720 2024-05-30T16:54:49.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.847+0000 7f055de00640 1 -- 172.21.15.59:0/1894452225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05580af720 msgr2=0x7f055815b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:49.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.847+0000 7f055de00640 1 --2- 172.21.15.59:0/1894452225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05580af720 0x7f055815b9d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0548009870 tx=0x7f054801c4f0 comp rx=0 tx=0).stop 2024-05-30T16:54:49.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.847+0000 7f055de00640 1 -- 172.21.15.59:0/1894452225 shutdown_connections 2024-05-30T16:54:49.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.847+0000 7f055de00640 1 --2- 172.21.15.59:0/1894452225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f055806e900 0x7f055815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:49.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.847+0000 7f055de00640 1 --2- 172.21.15.59:0/1894452225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05580af720 0x7f055815b9d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:49.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.847+0000 7f055de00640 1 -- 172.21.15.59:0/1894452225 >> 172.21.15.59:0/1894452225 conn(0x7f05580b22d0 msgr2=0x7f05580b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:49.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.847+0000 7f055de00640 1 -- 172.21.15.59:0/1894452225 shutdown_connections 2024-05-30T16:54:49.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.847+0000 7f055de00640 1 -- 172.21.15.59:0/1894452225 wait complete. 2024-05-30T16:54:49.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f055de00640 1 Processor -- start 2024-05-30T16:54:49.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f055de00640 1 -- start start 2024-05-30T16:54:49.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f055de00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f055806e900 0x7f0558149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:49.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f055de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05580af720 0x7f0558149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:49.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f055de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05580d0560 0x7f055814e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:49.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f055de00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f055815fd30 con 0x7f05580af720 2024-05-30T16:54:49.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f055de00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f055815c830 con 0x7f05580d0560 2024-05-30T16:54:49.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f055de00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f055815feb0 con 0x7f055806e900 2024-05-30T16:54:49.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f054e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05580af720 0x7f0558149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:49.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f054e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05580af720 0x7f0558149480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34846/0 (socket says 172.21.15.59:34846) 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f054e000640 1 -- 172.21.15.59:0/640313837 learned_addr learned my addr 172.21.15.59:0/640313837 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f0556a00640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f055806e900 0x7f0558149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f0557400640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05580d0560 0x7f055814e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f054e000640 1 -- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f055806e900 msgr2=0x7f0558149ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f054e000640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f055806e900 0x7f0558149ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f054e000640 1 -- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05580d0560 msgr2=0x7f055814e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f054e000640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05580d0560 0x7f055814e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f054e000640 1 -- 172.21.15.59:0/640313837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055814f880 con 0x7f05580af720 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f0557400640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05580d0560 0x7f055814e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f054e000640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05580af720 0x7f0558149480 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f054000c7f0 tx=0x7f054000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f054fe00640 1 -- 172.21.15.59:0/640313837 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540015070 con 0x7f05580af720 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f054fe00640 1 -- 172.21.15.59:0/640313837 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540007820 con 0x7f05580af720 2024-05-30T16:54:49.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f055de00640 1 -- 172.21.15.59:0/640313837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055814b920 con 0x7f05580af720 2024-05-30T16:54:49.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f054fe00640 1 -- 172.21.15.59:0/640313837 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540007bd0 con 0x7f05580af720 2024-05-30T16:54:49.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.851+0000 7f055de00640 1 -- 172.21.15.59:0/640313837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f055814bee0 con 0x7f05580af720 2024-05-30T16:54:49.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.855+0000 7f055de00640 1 -- 172.21.15.59:0/640313837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0558068a90 con 0x7f05580af720 2024-05-30T16:54:49.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.855+0000 7f054fe00640 1 -- 172.21.15.59:0/640313837 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f0540018070 con 0x7f05580af720 2024-05-30T16:54:49.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.855+0000 7f054fe00640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0534068b60 0x7f053406b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:49.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.855+0000 7f054fe00640 1 -- 172.21.15.59:0/640313837 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f0540087de0 con 0x7f05580af720 2024-05-30T16:54:49.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.855+0000 7f0556a00640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0534068b60 0x7f053406b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:49.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.855+0000 7f0556a00640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0534068b60 0x7f053406b020 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f05480ae000 tx=0x7f05480a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:49.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:49.859+0000 7f054fe00640 1 -- 172.21.15.59:0/640313837 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0540056c70 con 0x7f05580af720 2024-05-30T16:54:50.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 -- 172.21.15.59:0/640313837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0558152ce0 con 0x7f05580af720 2024-05-30T16:54:50.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f054fe00640 1 -- 172.21.15.59:0/640313837 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5187 (secure 0 0 0) 0x7f054005af70 con 0x7f05580af720 2024-05-30T16:54:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:50.066 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1920809274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1920809274},{"type":"v1","addr":"172.21.15.107:6837","nonce":1920809274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5719,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/4161936082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":4161936082},{"type":"v1","addr":"172.21.15.107:6835","nonce":4161936082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4040110781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4040110781},{"type":"v1","addr":"172.21.15.59:6833","nonce":4040110781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:54:46.040632+0000","modified":"2024-05-30T16:54:49.061772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2433633874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2433633874},{"type":"v1","addr":"172.21.15.59:6835","nonce":2433633874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5865,"qdb_cluster":[5865]},"id":4}]} 2024-05-30T16:54:50.066 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 34 2024-05-30T16:54:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 -- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0534068b60 msgr2=0x7f053406b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0534068b60 0x7f053406b020 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f05480ae000 tx=0x7f05480a7000 comp rx=0 tx=0).stop 2024-05-30T16:54:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 -- 172.21.15.59:0/640313837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05580af720 msgr2=0x7f0558149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05580af720 0x7f0558149480 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f054000c7f0 tx=0x7f054000ccb0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 -- 172.21.15.59:0/640313837 shutdown_connections 2024-05-30T16:54:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0534068b60 0x7f053406b020 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05580d0560 0x7f055814e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05580af720 0x7f0558149480 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 --2- 172.21.15.59:0/640313837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f055806e900 0x7f0558149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 -- 172.21.15.59:0/640313837 >> 172.21.15.59:0/640313837 conn(0x7f05580b22d0 msgr2=0x7f05580b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:50.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 -- 172.21.15.59:0/640313837 shutdown_connections 2024-05-30T16:54:50.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.063+0000 7f055de00640 1 -- 172.21.15.59:0/640313837 wait complete. 2024-05-30T16:54:50.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:54:50.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73ae000640 1 Processor -- start 2024-05-30T16:54:50.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73ae000640 1 -- start start 2024-05-30T16:54:50.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73ae000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f73a8160d90 0x7f73a809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73ae000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73a80711e0 0x7f73a809af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73ae000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a80d1310 con 0x7f73a809b780 2024-05-30T16:54:50.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73ae000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f73a80ced30 con 0x7f73a8160d90 2024-05-30T16:54:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73ae000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f73a809bcf0 con 0x7f73a80711e0 2024-05-30T16:54:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f739fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f73a809b780 0x7f73a806ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40664/0 (socket says 172.21.15.59:40664) 2024-05-30T16:54:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f739fe00640 1 -- 172.21.15.59:0/3720595709 learned_addr learned my addr 172.21.15.59:0/3720595709 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73a7400640 1 --2- 172.21.15.59:0/3720595709 >> v2:172.21.15.107:3300/0 conn(0x7f73a8160d90 0x7f73a809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73a7e00640 1 --2- 172.21.15.59:0/3720595709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73a80711e0 0x7f73a809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73a6a00640 1 -- 172.21.15.59:0/3720595709 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876723954 0 0) 0x7f73a80d1310 con 0x7f73a809b780 2024-05-30T16:54:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73a6a00640 1 -- 172.21.15.59:0/3720595709 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f738c003530 con 0x7f73a809b780 2024-05-30T16:54:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73a7e00640 1 -- 172.21.15.59:0/3720595709 >> v2:172.21.15.107:3300/0 conn(0x7f73a8160d90 msgr2=0x7f73a809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73a7e00640 1 --2- 172.21.15.59:0/3720595709 >> v2:172.21.15.107:3300/0 conn(0x7f73a8160d90 0x7f73a809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73a7e00640 1 -- 172.21.15.59:0/3720595709 >> v1:172.21.15.59:6789/0 conn(0x7f73a809b780 legacy=0x7f73a806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.227+0000 7f73a7e00640 1 -- 172.21.15.59:0/3720595709 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a80d0a70 con 0x7f73a80711e0 2024-05-30T16:54:50.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.231+0000 7f73a7e00640 1 --2- 172.21.15.59:0/3720595709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73a80711e0 0x7f73a809af80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009d90 tx=0x7f73a001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebfa78c062352d56 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:50.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.231+0000 7f73a6a00640 1 -- 172.21.15.59:0/3720595709 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a00b2070 con 0x7f73a80711e0 2024-05-30T16:54:50.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.231+0000 7f73a6a00640 1 -- 172.21.15.59:0/3720595709 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a00a5720 con 0x7f73a80711e0 2024-05-30T16:54:50.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.231+0000 7f73a6a00640 1 -- 172.21.15.59:0/3720595709 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a00a5ad0 con 0x7f73a80711e0 2024-05-30T16:54:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.231+0000 7f73ae000640 1 -- 172.21.15.59:0/3720595709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73a80711e0 msgr2=0x7f73a809af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.231+0000 7f73ae000640 1 --2- 172.21.15.59:0/3720595709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73a80711e0 0x7f73a809af80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009d90 tx=0x7f73a001c850 comp rx=0 tx=0).stop 2024-05-30T16:54:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.231+0000 7f73ae000640 1 -- 172.21.15.59:0/3720595709 shutdown_connections 2024-05-30T16:54:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.231+0000 7f73ae000640 1 --2- 172.21.15.59:0/3720595709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73a80711e0 0x7f73a809af80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.231+0000 7f73ae000640 1 --2- 172.21.15.59:0/3720595709 >> v2:172.21.15.107:3300/0 conn(0x7f73a8160d90 0x7f73a809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.231+0000 7f73ae000640 1 -- 172.21.15.59:0/3720595709 >> 172.21.15.59:0/3720595709 conn(0x7f73a80b3f80 msgr2=0x7f73a80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.231+0000 7f73ae000640 1 -- 172.21.15.59:0/3720595709 shutdown_connections 2024-05-30T16:54:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.231+0000 7f73ae000640 1 -- 172.21.15.59:0/3720595709 wait complete. 2024-05-30T16:54:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73ae000640 1 Processor -- start 2024-05-30T16:54:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73ae000640 1 -- start start 2024-05-30T16:54:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73ae000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80711e0 0x7f73a80b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73ae000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73a809b780 0x7f73a80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73ae000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73a8160d90 0x7f73a815f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73ae000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73a8071fe0 con 0x7f73a8160d90 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73ae000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f73a8071e60 con 0x7f73a80711e0 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73ae000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f73a8161170 con 0x7f73a809b780 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73a7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73a8160d90 0x7f73a815f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73a7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73a8160d90 0x7f73a815f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34854/0 (socket says 172.21.15.59:34854) 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73a7e00640 1 -- 172.21.15.59:0/3893815978 learned_addr learned my addr 172.21.15.59:0/3893815978 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f739fe00640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73a809b780 0x7f73a80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73a7400640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80711e0 0x7f73a80b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73a7e00640 1 -- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73a809b780 msgr2=0x7f73a80b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73a7e00640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73a809b780 0x7f73a80b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73a7e00640 1 -- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80711e0 msgr2=0x7f73a80b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73a7e00640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80711e0 0x7f73a80b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73a7e00640 1 -- 172.21.15.59:0/3893815978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a814e470 con 0x7f73a8160d90 2024-05-30T16:54:50.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73a7e00640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73a8160d90 0x7f73a815f510 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f73a00b0040 tx=0x7f73a00195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:50.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f739f400640 1 -- 172.21.15.59:0/3893815978 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a00b2050 con 0x7f73a8160d90 2024-05-30T16:54:50.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f739f400640 1 -- 172.21.15.59:0/3893815978 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a00be070 con 0x7f73a8160d90 2024-05-30T16:54:50.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f739f400640 1 -- 172.21.15.59:0/3893815978 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a0009450 con 0x7f73a8160d90 2024-05-30T16:54:50.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73ae000640 1 -- 172.21.15.59:0/3893815978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a814e750 con 0x7f73a8160d90 2024-05-30T16:54:50.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.235+0000 7f73ae000640 1 -- 172.21.15.59:0/3893815978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a80b1450 con 0x7f73a8160d90 2024-05-30T16:54:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.239+0000 7f73ae000640 1 -- 172.21.15.59:0/3893815978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a8068a90 con 0x7f73a8160d90 2024-05-30T16:54:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.239+0000 7f739f400640 1 -- 172.21.15.59:0/3893815978 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f73a00ad890 con 0x7f73a8160d90 2024-05-30T16:54:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.239+0000 7f739f400640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7384068b60 0x7f738406b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.239+0000 7f739f400640 1 -- 172.21.15.59:0/3893815978 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f73a0122600 con 0x7f73a8160d90 2024-05-30T16:54:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.239+0000 7f73a7400640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7384068b60 0x7f738406b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.239+0000 7f73a7400640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7384068b60 0x7f738406b020 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7398009af0 tx=0x7f7398008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:50.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.243+0000 7f739f400640 1 -- 172.21.15.59:0/3893815978 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f73a0016560 con 0x7f73a8160d90 2024-05-30T16:54:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.419+0000 7f73ae000640 1 -- 172.21.15.59:0/3893815978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73a80b4be0 con 0x7f73a8160d90 2024-05-30T16:54:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.419+0000 7f739f400640 1 -- 172.21.15.59:0/3893815978 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16740 (secure 0 0 0) 0x7f73a00f2260 con 0x7f73a8160d90 2024-05-30T16:54:50.424 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:50.424 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":62,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:54:47.635812+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:54:43.741524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T16:54:45.005283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:54:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.423+0000 7f73ae000640 1 -- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7384068b60 msgr2=0x7f738406b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.423+0000 7f73ae000640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7384068b60 0x7f738406b020 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7398009af0 tx=0x7f7398008040 comp rx=0 tx=0).stop 2024-05-30T16:54:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.423+0000 7f73ae000640 1 -- 172.21.15.59:0/3893815978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73a8160d90 msgr2=0x7f73a815f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.423+0000 7f73ae000640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73a8160d90 0x7f73a815f510 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f73a00b0040 tx=0x7f73a00195f0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.423+0000 7f73ae000640 1 -- 172.21.15.59:0/3893815978 shutdown_connections 2024-05-30T16:54:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.423+0000 7f73ae000640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7384068b60 0x7f738406b020 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.423+0000 7f73ae000640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73a8160d90 0x7f73a815f510 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.423+0000 7f73ae000640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73a809b780 0x7f73a80b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.423+0000 7f73ae000640 1 --2- 172.21.15.59:0/3893815978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80711e0 0x7f73a80b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.423+0000 7f73ae000640 1 -- 172.21.15.59:0/3893815978 >> 172.21.15.59:0/3893815978 conn(0x7f73a80b3f80 msgr2=0x7f73a8159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.423+0000 7f73ae000640 1 -- 172.21.15.59:0/3893815978 shutdown_connections 2024-05-30T16:54:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.423+0000 7f73ae000640 1 -- 172.21.15.59:0/3893815978 wait complete. 2024-05-30T16:54:50.446 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:54:50.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:54:50.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.583+0000 7fbb9cc00640 1 Processor -- start 2024-05-30T16:54:50.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.583+0000 7fbb9cc00640 1 -- start start 2024-05-30T16:54:50.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.583+0000 7fbb9cc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb9806e900 0x7fbb9815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.583+0000 7fbb9cc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb980d0560 0x7fbb980d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.583+0000 7fbb9cc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb9815f060 con 0x7fbb980af720 2024-05-30T16:54:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.583+0000 7fbb9cc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbb980afb00 con 0x7fbb9806e900 2024-05-30T16:54:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.583+0000 7fbb9cc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbb9815c270 con 0x7fbb980d0560 2024-05-30T16:54:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.587+0000 7fbb95400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb9806e900 0x7fbb9815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.587+0000 7fbb95400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb9806e900 0x7fbb9815f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34856/0 (socket says 172.21.15.59:34856) 2024-05-30T16:54:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.587+0000 7fbb95400640 1 -- 172.21.15.59:0/2939253230 learned_addr learned my addr 172.21.15.59:0/2939253230 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.587+0000 7fbb96800640 1 --2- 172.21.15.59:0/2939253230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb980d0560 0x7fbb980d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.587+0000 7fbb95400640 1 -- 172.21.15.59:0/2939253230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb980d0560 msgr2=0x7fbb980d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.587+0000 7fbb95400640 1 --2- 172.21.15.59:0/2939253230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb980d0560 0x7fbb980d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.587+0000 7fbb95400640 1 -- 172.21.15.59:0/2939253230 >> v1:172.21.15.107:6789/0 conn(0x7fbb980af720 legacy=0x7fbb9815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.587+0000 7fbb95400640 1 -- 172.21.15.59:0/2939253230 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9815c550 con 0x7fbb9806e900 2024-05-30T16:54:50.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.587+0000 7fbb95400640 1 --2- 172.21.15.59:0/2939253230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806e900 0x7fbb9815f7f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400bb10 tx=0x7fbb8401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b81ff1c1927738 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:50.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.587+0000 7fbb94a00640 1 -- 172.21.15.59:0/2939253230 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb840b4070 con 0x7fbb9806e900 2024-05-30T16:54:50.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.587+0000 7fbb94a00640 1 -- 172.21.15.59:0/2939253230 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb840a7b50 con 0x7fbb9806e900 2024-05-30T16:54:50.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.587+0000 7fbb94a00640 1 -- 172.21.15.59:0/2939253230 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb840af440 con 0x7fbb9806e900 2024-05-30T16:54:50.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 -- 172.21.15.59:0/2939253230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806e900 msgr2=0x7fbb9815f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 --2- 172.21.15.59:0/2939253230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806e900 0x7fbb9815f7f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400bb10 tx=0x7fbb8401ec30 comp rx=0 tx=0).stop 2024-05-30T16:54:50.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 -- 172.21.15.59:0/2939253230 shutdown_connections 2024-05-30T16:54:50.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 --2- 172.21.15.59:0/2939253230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb980d0560 0x7fbb980d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 --2- 172.21.15.59:0/2939253230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806e900 0x7fbb9815f7f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 -- 172.21.15.59:0/2939253230 >> 172.21.15.59:0/2939253230 conn(0x7fbb980b22d0 msgr2=0x7fbb980b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:50.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 -- 172.21.15.59:0/2939253230 shutdown_connections 2024-05-30T16:54:50.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 -- 172.21.15.59:0/2939253230 wait complete. 2024-05-30T16:54:50.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 Processor -- start 2024-05-30T16:54:50.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 -- start start 2024-05-30T16:54:50.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806e900 0x7fbb98154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb980af720 0x7fbb98155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb980d0560 0x7fbb981564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbb980732d0 con 0x7fbb9806e900 2024-05-30T16:54:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbb98073150 con 0x7fbb980af720 2024-05-30T16:54:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb9cc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbb981585c0 con 0x7fbb980d0560 2024-05-30T16:54:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb95e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806e900 0x7fbb98154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb95e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806e900 0x7fbb98154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34868/0 (socket says 172.21.15.59:34868) 2024-05-30T16:54:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb95e00640 1 -- 172.21.15.59:0/1765445290 learned_addr learned my addr 172.21.15.59:0/1765445290 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb95400640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb980af720 0x7fbb98155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb95e00640 1 -- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb980d0560 msgr2=0x7fbb981564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb96800640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb980d0560 0x7fbb981564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb95e00640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb980d0560 0x7fbb981564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb95e00640 1 -- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb980af720 msgr2=0x7fbb98155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb95e00640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb980af720 0x7fbb98155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb95e00640 1 -- 172.21.15.59:0/1765445290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9815b3e0 con 0x7fbb9806e900 2024-05-30T16:54:50.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb95400640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb980af720 0x7fbb98155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:50.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.591+0000 7fbb96800640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb980d0560 0x7fbb981564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:50.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.595+0000 7fbb95e00640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806e900 0x7fbb98154bf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c420 tx=0x7fbb8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:50.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.595+0000 7fbb8e000640 1 -- 172.21.15.59:0/1765445290 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb880052d0 con 0x7fbb9806e900 2024-05-30T16:54:50.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.595+0000 7fbb8e000640 1 -- 172.21.15.59:0/1765445290 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb88005470 con 0x7fbb9806e900 2024-05-30T16:54:50.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.595+0000 7fbb9cc00640 1 -- 172.21.15.59:0/1765445290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb980ce850 con 0x7fbb9806e900 2024-05-30T16:54:50.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.595+0000 7fbb8e000640 1 -- 172.21.15.59:0/1765445290 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88007260 con 0x7fbb9806e900 2024-05-30T16:54:50.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.595+0000 7fbb9cc00640 1 -- 172.21.15.59:0/1765445290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb980cee10 con 0x7fbb9806e900 2024-05-30T16:54:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.595+0000 7fbb9cc00640 1 -- 172.21.15.59:0/1765445290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb98068a90 con 0x7fbb9806e900 2024-05-30T16:54:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.595+0000 7fbb8e000640 1 -- 172.21.15.59:0/1765445290 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fbb88007400 con 0x7fbb9806e900 2024-05-30T16:54:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.595+0000 7fbb8e000640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbb78068b90 0x7fbb7806b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.595+0000 7fbb8e000640 1 -- 172.21.15.59:0/1765445290 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fbb88087110 con 0x7fbb9806e900 2024-05-30T16:54:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.595+0000 7fbb95400640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbb78068b90 0x7fbb7806b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.599+0000 7fbb95400640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbb78068b90 0x7fbb7806b050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbb840b1000 tx=0x7fbb840a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:50.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.599+0000 7fbb8e000640 1 -- 172.21.15.59:0/1765445290 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbb88056700 con 0x7fbb9806e900 2024-05-30T16:54:50.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.763+0000 7fbb9cc00640 1 -- 172.21.15.59:0/1765445290 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb9815b6f0 con 0x7fbb78068b90 2024-05-30T16:54:50.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.771+0000 7fbb8e000640 1 -- 172.21.15.59:0/1765445290 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250828 (secure 0 0 0) 0x7fbb9815b6f0 con 0x7fbb78068b90 2024-05-30T16:54:50.777 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:50.779 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:54:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.775+0000 7fbb9cc00640 1 -- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbb78068b90 msgr2=0x7fbb7806b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.775+0000 7fbb9cc00640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbb78068b90 0x7fbb7806b050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbb840b1000 tx=0x7fbb840a9070 comp rx=0 tx=0).stop 2024-05-30T16:54:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.775+0000 7fbb9cc00640 1 -- 172.21.15.59:0/1765445290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806e900 msgr2=0x7fbb98154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.775+0000 7fbb9cc00640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806e900 0x7fbb98154bf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c420 tx=0x7fbb8800c8e0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.775+0000 7fbb9cc00640 1 -- 172.21.15.59:0/1765445290 shutdown_connections 2024-05-30T16:54:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.775+0000 7fbb9cc00640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbb78068b90 0x7fbb7806b050 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.775+0000 7fbb9cc00640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb980d0560 0x7fbb981564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.775+0000 7fbb9cc00640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb980af720 0x7fbb98155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.775+0000 7fbb9cc00640 1 --2- 172.21.15.59:0/1765445290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806e900 0x7fbb98154bf0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.775+0000 7fbb9cc00640 1 -- 172.21.15.59:0/1765445290 >> 172.21.15.59:0/1765445290 conn(0x7fbb980b22d0 msgr2=0x7fbb980aded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.775+0000 7fbb9cc00640 1 -- 172.21.15.59:0/1765445290 shutdown_connections 2024-05-30T16:54:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.775+0000 7fbb9cc00640 1 -- 172.21.15.59:0/1765445290 wait complete. 2024-05-30T16:54:50.797 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-05-30T16:54:49.162302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":359004,"kb_used_data":6824,"kb_used_omap":12,"kb_used_meta":352051,"kb_avail":754615716,"statfs":{"total":773094113280,"available":772726493184,"internally_reserved":0,"allocated":6987776,"data_stored":3570791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":360500784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.532187"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.661703+0000","last_change":"2024-05-30T16:54:46.653537+0000","last_active":"2024-05-30T16:54:46.661703+0000","last_peered":"2024-05-30T16:54:46.661703+0000","last_clean":"2024-05-30T16:54:46.661703+0000","last_became_active":"2024-05-30T16:54:46.653287+0000","last_became_peered":"2024-05-30T16:54:46.653287+0000","last_unstale":"2024-05-30T16:54:46.661703+0000","last_undegraded":"2024-05-30T16:54:46.661703+0000","last_fullsized":"2024-05-30T16:54:46.661703+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:53.883132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.646545+0000","last_change":"2024-05-30T16:54:45.646545+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.646545+0000","last_undegraded":"2024-05-30T16:54:45.646545+0000","last_fullsized":"2024-05-30T16:54:45.646545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.665343+0000","last_change":"2024-05-30T16:54:46.658753+0000","last_active":"2024-05-30T16:54:46.665343+0000","last_peered":"2024-05-30T16:54:46.665343+0000","last_clean":"2024-05-30T16:54:46.665343+0000","last_became_active":"2024-05-30T16:54:46.658476+0000","last_became_peered":"2024-05-30T16:54:46.658476+0000","last_unstale":"2024-05-30T16:54:46.665343+0000","last_undegraded":"2024-05-30T16:54:46.665343+0000","last_fullsized":"2024-05-30T16:54:46.665343+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:49.445877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668376+0000","last_change":"2024-05-30T16:54:46.662427+0000","last_active":"2024-05-30T16:54:46.668376+0000","last_peered":"2024-05-30T16:54:46.668376+0000","last_clean":"2024-05-30T16:54:46.668376+0000","last_became_active":"2024-05-30T16:54:46.662157+0000","last_became_peered":"2024-05-30T16:54:46.662157+0000","last_unstale":"2024-05-30T16:54:46.668376+0000","last_undegraded":"2024-05-30T16:54:46.668376+0000","last_fullsized":"2024-05-30T16:54:46.668376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:43.670842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670358+0000","last_change":"2024-05-30T16:54:46.660389+0000","last_active":"2024-05-30T16:54:46.670358+0000","last_peered":"2024-05-30T16:54:46.670358+0000","last_clean":"2024-05-30T16:54:46.670358+0000","last_became_active":"2024-05-30T16:54:46.660137+0000","last_became_peered":"2024-05-30T16:54:46.660137+0000","last_unstale":"2024-05-30T16:54:46.670358+0000","last_undegraded":"2024-05-30T16:54:46.670358+0000","last_fullsized":"2024-05-30T16:54:46.670358+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:33.138067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671112+0000","last_change":"2024-05-30T16:54:46.666587+0000","last_active":"2024-05-30T16:54:46.671112+0000","last_peered":"2024-05-30T16:54:46.671112+0000","last_clean":"2024-05-30T16:54:46.671112+0000","last_became_active":"2024-05-30T16:54:46.663836+0000","last_became_peered":"2024-05-30T16:54:46.663836+0000","last_unstale":"2024-05-30T16:54:46.671112+0000","last_undegraded":"2024-05-30T16:54:46.671112+0000","last_fullsized":"2024-05-30T16:54:46.671112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:49:29.390734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.649812+0000","last_change":"2024-05-30T16:54:46.648712+0000","last_active":"2024-05-30T16:54:46.649812+0000","last_peered":"2024-05-30T16:54:46.649812+0000","last_clean":"2024-05-30T16:54:46.649812+0000","last_became_active":"2024-05-30T16:54:46.648462+0000","last_became_peered":"2024-05-30T16:54:46.648462+0000","last_unstale":"2024-05-30T16:54:46.649812+0000","last_undegraded":"2024-05-30T16:54:46.649812+0000","last_fullsized":"2024-05-30T16:54:46.649812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:52:39.449932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.648247+0000","last_change":"2024-05-30T16:54:45.648247+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.648247+0000","last_undegraded":"2024-05-30T16:54:45.648247+0000","last_fullsized":"2024-05-30T16:54:45.648247+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670868+0000","last_change":"2024-05-30T16:54:46.661707+0000","last_active":"2024-05-30T16:54:46.670868+0000","last_peered":"2024-05-30T16:54:46.670868+0000","last_clean":"2024-05-30T16:54:46.670868+0000","last_became_active":"2024-05-30T16:54:46.661402+0000","last_became_peered":"2024-05-30T16:54:46.661402+0000","last_unstale":"2024-05-30T16:54:46.670868+0000","last_undegraded":"2024-05-30T16:54:46.670868+0000","last_fullsized":"2024-05-30T16:54:46.670868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:47.830462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.676122+0000","last_change":"2024-05-30T16:54:46.672351+0000","last_active":"2024-05-30T16:54:46.676122+0000","last_peered":"2024-05-30T16:54:46.676122+0000","last_clean":"2024-05-30T16:54:46.676122+0000","last_became_active":"2024-05-30T16:54:46.672097+0000","last_became_peered":"2024-05-30T16:54:46.672097+0000","last_unstale":"2024-05-30T16:54:46.676122+0000","last_undegraded":"2024-05-30T16:54:46.676122+0000","last_fullsized":"2024-05-30T16:54:46.676122+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:42.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675941+0000","last_change":"2024-05-30T16:54:46.669733+0000","last_active":"2024-05-30T16:54:46.675941+0000","last_peered":"2024-05-30T16:54:46.675941+0000","last_clean":"2024-05-30T16:54:46.675941+0000","last_became_active":"2024-05-30T16:54:46.666565+0000","last_became_peered":"2024-05-30T16:54:46.666565+0000","last_unstale":"2024-05-30T16:54:46.675941+0000","last_undegraded":"2024-05-30T16:54:46.675941+0000","last_fullsized":"2024-05-30T16:54:46.675941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:25.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668399+0000","last_change":"2024-05-30T16:54:46.665480+0000","last_active":"2024-05-30T16:54:46.668399+0000","last_peered":"2024-05-30T16:54:46.668399+0000","last_clean":"2024-05-30T16:54:46.668399+0000","last_became_active":"2024-05-30T16:54:46.665069+0000","last_became_peered":"2024-05-30T16:54:46.665069+0000","last_unstale":"2024-05-30T16:54:46.668399+0000","last_undegraded":"2024-05-30T16:54:46.668399+0000","last_fullsized":"2024-05-30T16:54:46.668399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:18.915849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664156+0000","last_change":"2024-05-30T16:54:46.657415+0000","last_active":"2024-05-30T16:54:46.664156+0000","last_peered":"2024-05-30T16:54:46.664156+0000","last_clean":"2024-05-30T16:54:46.664156+0000","last_became_active":"2024-05-30T16:54:46.655817+0000","last_became_peered":"2024-05-30T16:54:46.655817+0000","last_unstale":"2024-05-30T16:54:46.664156+0000","last_undegraded":"2024-05-30T16:54:46.664156+0000","last_fullsized":"2024-05-30T16:54:46.664156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:50:40.823158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.655382+0000","last_change":"2024-05-30T16:54:46.653603+0000","last_active":"2024-05-30T16:54:46.655382+0000","last_peered":"2024-05-30T16:54:46.655382+0000","last_clean":"2024-05-30T16:54:46.655382+0000","last_became_active":"2024-05-30T16:54:46.653302+0000","last_became_peered":"2024-05-30T16:54:46.653302+0000","last_unstale":"2024-05-30T16:54:46.655382+0000","last_undegraded":"2024-05-30T16:54:46.655382+0000","last_fullsized":"2024-05-30T16:54:46.655382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:57:14.688215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670838+0000","last_change":"2024-05-30T16:54:46.662800+0000","last_active":"2024-05-30T16:54:46.670838+0000","last_peered":"2024-05-30T16:54:46.670838+0000","last_clean":"2024-05-30T16:54:46.670838+0000","last_became_active":"2024-05-30T16:54:46.662524+0000","last_became_peered":"2024-05-30T16:54:46.662524+0000","last_unstale":"2024-05-30T16:54:46.670838+0000","last_undegraded":"2024-05-30T16:54:46.670838+0000","last_fullsized":"2024-05-30T16:54:46.670838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:05.577972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664583+0000","last_change":"2024-05-30T16:54:46.657592+0000","last_active":"2024-05-30T16:54:46.664583+0000","last_peered":"2024-05-30T16:54:46.664583+0000","last_clean":"2024-05-30T16:54:46.664583+0000","last_became_active":"2024-05-30T16:54:46.656008+0000","last_became_peered":"2024-05-30T16:54:46.656008+0000","last_unstale":"2024-05-30T16:54:46.664583+0000","last_undegraded":"2024-05-30T16:54:46.664583+0000","last_fullsized":"2024-05-30T16:54:46.664583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:05.577972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.646987+0000","last_change":"2024-05-30T16:54:45.646987+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.646987+0000","last_undegraded":"2024-05-30T16:54:45.646987+0000","last_fullsized":"2024-05-30T16:54:45.646987+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.673804+0000","last_change":"2024-05-30T16:54:46.669925+0000","last_active":"2024-05-30T16:54:46.673804+0000","last_peered":"2024-05-30T16:54:46.673804+0000","last_clean":"2024-05-30T16:54:46.673804+0000","last_became_active":"2024-05-30T16:54:46.669377+0000","last_became_peered":"2024-05-30T16:54:46.669377+0000","last_unstale":"2024-05-30T16:54:46.673804+0000","last_undegraded":"2024-05-30T16:54:46.673804+0000","last_fullsized":"2024-05-30T16:54:46.673804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:18.915849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.661945+0000","last_change":"2024-05-30T16:54:46.652970+0000","last_active":"2024-05-30T16:54:46.661945+0000","last_peered":"2024-05-30T16:54:46.661945+0000","last_clean":"2024-05-30T16:54:46.661945+0000","last_became_active":"2024-05-30T16:54:46.652703+0000","last_became_peered":"2024-05-30T16:54:46.652703+0000","last_unstale":"2024-05-30T16:54:46.661945+0000","last_undegraded":"2024-05-30T16:54:46.661945+0000","last_fullsized":"2024-05-30T16:54:46.661945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:05.374326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.645176+0000","last_change":"2024-05-30T16:54:45.645176+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.645176+0000","last_undegraded":"2024-05-30T16:54:45.645176+0000","last_fullsized":"2024-05-30T16:54:45.645176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663695+0000","last_change":"2024-05-30T16:54:46.659978+0000","last_active":"2024-05-30T16:54:46.663695+0000","last_peered":"2024-05-30T16:54:46.663695+0000","last_clean":"2024-05-30T16:54:46.663695+0000","last_became_active":"2024-05-30T16:54:46.659698+0000","last_became_peered":"2024-05-30T16:54:46.659698+0000","last_unstale":"2024-05-30T16:54:46.663695+0000","last_undegraded":"2024-05-30T16:54:46.663695+0000","last_fullsized":"2024-05-30T16:54:46.663695+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:53.545049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.642021+0000","last_change":"2024-05-30T16:54:45.642021+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.642021+0000","last_undegraded":"2024-05-30T16:54:45.642021+0000","last_fullsized":"2024-05-30T16:54:45.642021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670643+0000","last_change":"2024-05-30T16:54:46.666968+0000","last_active":"2024-05-30T16:54:46.670643+0000","last_peered":"2024-05-30T16:54:46.670643+0000","last_clean":"2024-05-30T16:54:46.670643+0000","last_became_active":"2024-05-30T16:54:46.666488+0000","last_became_peered":"2024-05-30T16:54:46.666488+0000","last_unstale":"2024-05-30T16:54:46.670643+0000","last_undegraded":"2024-05-30T16:54:46.670643+0000","last_fullsized":"2024-05-30T16:54:46.670643+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:32.939644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.657728+0000","last_change":"2024-05-30T16:54:46.656716+0000","last_active":"2024-05-30T16:54:46.657728+0000","last_peered":"2024-05-30T16:54:46.657728+0000","last_clean":"2024-05-30T16:54:46.657728+0000","last_became_active":"2024-05-30T16:54:46.656437+0000","last_became_peered":"2024-05-30T16:54:46.656437+0000","last_unstale":"2024-05-30T16:54:46.657728+0000","last_undegraded":"2024-05-30T16:54:46.657728+0000","last_fullsized":"2024-05-30T16:54:46.657728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:30.131348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675046+0000","last_change":"2024-05-30T16:54:46.669569+0000","last_active":"2024-05-30T16:54:46.675046+0000","last_peered":"2024-05-30T16:54:46.675046+0000","last_clean":"2024-05-30T16:54:46.675046+0000","last_became_active":"2024-05-30T16:54:46.669337+0000","last_became_peered":"2024-05-30T16:54:46.669337+0000","last_unstale":"2024-05-30T16:54:46.675046+0000","last_undegraded":"2024-05-30T16:54:46.675046+0000","last_fullsized":"2024-05-30T16:54:46.675046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:49:46.787342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.650983+0000","last_change":"2024-05-30T16:54:46.648131+0000","last_active":"2024-05-30T16:54:46.650983+0000","last_peered":"2024-05-30T16:54:46.650983+0000","last_clean":"2024-05-30T16:54:46.650983+0000","last_became_active":"2024-05-30T16:54:46.647835+0000","last_became_peered":"2024-05-30T16:54:46.647835+0000","last_unstale":"2024-05-30T16:54:46.650983+0000","last_undegraded":"2024-05-30T16:54:46.650983+0000","last_fullsized":"2024-05-30T16:54:46.650983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668308+0000","last_change":"2024-05-30T16:54:46.664412+0000","last_active":"2024-05-30T16:54:46.668308+0000","last_peered":"2024-05-30T16:54:46.668308+0000","last_clean":"2024-05-30T16:54:46.668308+0000","last_became_active":"2024-05-30T16:54:46.664116+0000","last_became_peered":"2024-05-30T16:54:46.664116+0000","last_unstale":"2024-05-30T16:54:46.668308+0000","last_undegraded":"2024-05-30T16:54:46.668308+0000","last_fullsized":"2024-05-30T16:54:46.668308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:18.915849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670559+0000","last_change":"2024-05-30T16:54:46.665560+0000","last_active":"2024-05-30T16:54:46.670559+0000","last_peered":"2024-05-30T16:54:46.670559+0000","last_clean":"2024-05-30T16:54:46.670559+0000","last_became_active":"2024-05-30T16:54:46.665248+0000","last_became_peered":"2024-05-30T16:54:46.665248+0000","last_unstale":"2024-05-30T16:54:46.670559+0000","last_undegraded":"2024-05-30T16:54:46.670559+0000","last_fullsized":"2024-05-30T16:54:46.670559+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:05:21.158010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.645874+0000","last_change":"2024-05-30T16:54:45.645874+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.645874+0000","last_undegraded":"2024-05-30T16:54:45.645874+0000","last_fullsized":"2024-05-30T16:54:45.645874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664509+0000","last_change":"2024-05-30T16:54:46.658606+0000","last_active":"2024-05-30T16:54:46.664509+0000","last_peered":"2024-05-30T16:54:46.664509+0000","last_clean":"2024-05-30T16:54:46.664509+0000","last_became_active":"2024-05-30T16:54:46.658313+0000","last_became_peered":"2024-05-30T16:54:46.658313+0000","last_unstale":"2024-05-30T16:54:46.664509+0000","last_undegraded":"2024-05-30T16:54:46.664509+0000","last_fullsized":"2024-05-30T16:54:46.664509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:35.259565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671340+0000","last_change":"2024-05-30T16:54:46.664673+0000","last_active":"2024-05-30T16:54:46.671340+0000","last_peered":"2024-05-30T16:54:46.671340+0000","last_clean":"2024-05-30T16:54:46.671340+0000","last_became_active":"2024-05-30T16:54:46.664411+0000","last_became_peered":"2024-05-30T16:54:46.664411+0000","last_unstale":"2024-05-30T16:54:46.671340+0000","last_undegraded":"2024-05-30T16:54:46.671340+0000","last_fullsized":"2024-05-30T16:54:46.671340+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:37.399050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.667166+0000","last_change":"2024-05-30T16:54:46.661133+0000","last_active":"2024-05-30T16:54:46.667166+0000","last_peered":"2024-05-30T16:54:46.667166+0000","last_clean":"2024-05-30T16:54:46.667166+0000","last_became_active":"2024-05-30T16:54:46.660444+0000","last_became_peered":"2024-05-30T16:54:46.660444+0000","last_unstale":"2024-05-30T16:54:46.667166+0000","last_undegraded":"2024-05-30T16:54:46.667166+0000","last_fullsized":"2024-05-30T16:54:46.667166+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:53.545049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668209+0000","last_change":"2024-05-30T16:54:46.662959+0000","last_active":"2024-05-30T16:54:46.668209+0000","last_peered":"2024-05-30T16:54:46.668209+0000","last_clean":"2024-05-30T16:54:46.668209+0000","last_became_active":"2024-05-30T16:54:46.662617+0000","last_became_peered":"2024-05-30T16:54:46.662617+0000","last_unstale":"2024-05-30T16:54:46.668209+0000","last_undegraded":"2024-05-30T16:54:46.668209+0000","last_fullsized":"2024-05-30T16:54:46.668209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.674431+0000","last_change":"2024-05-30T16:54:45.647654+0000","last_active":"2024-05-30T16:54:46.674431+0000","last_peered":"2024-05-30T16:54:46.674431+0000","last_clean":"2024-05-30T16:54:46.674431+0000","last_became_active":"2024-05-30T16:54:45.647348+0000","last_became_peered":"2024-05-30T16:54:45.647348+0000","last_unstale":"2024-05-30T16:54:46.674431+0000","last_undegraded":"2024-05-30T16:54:46.674431+0000","last_fullsized":"2024-05-30T16:54:46.674431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:42.667446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671009+0000","last_change":"2024-05-30T16:54:46.665719+0000","last_active":"2024-05-30T16:54:46.671009+0000","last_peered":"2024-05-30T16:54:46.671009+0000","last_clean":"2024-05-30T16:54:46.671009+0000","last_became_active":"2024-05-30T16:54:46.665454+0000","last_became_peered":"2024-05-30T16:54:46.665454+0000","last_unstale":"2024-05-30T16:54:46.671009+0000","last_undegraded":"2024-05-30T16:54:46.671009+0000","last_fullsized":"2024-05-30T16:54:46.671009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:29:51.209287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.662480+0000","last_change":"2024-05-30T16:54:45.661521+0000","last_active":"2024-05-30T16:54:45.662480+0000","last_peered":"2024-05-30T16:54:45.662480+0000","last_clean":"2024-05-30T16:54:45.662480+0000","last_became_active":"2024-05-30T16:54:45.660638+0000","last_became_peered":"2024-05-30T16:54:45.660638+0000","last_unstale":"2024-05-30T16:54:45.662480+0000","last_undegraded":"2024-05-30T16:54:45.662480+0000","last_fullsized":"2024-05-30T16:54:45.662480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:41:10.905828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671960+0000","last_change":"2024-05-30T16:54:46.667652+0000","last_active":"2024-05-30T16:54:46.671960+0000","last_peered":"2024-05-30T16:54:46.671960+0000","last_clean":"2024-05-30T16:54:46.671960+0000","last_became_active":"2024-05-30T16:54:46.667421+0000","last_became_peered":"2024-05-30T16:54:46.667421+0000","last_unstale":"2024-05-30T16:54:46.671960+0000","last_undegraded":"2024-05-30T16:54:46.671960+0000","last_fullsized":"2024-05-30T16:54:46.671960+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:03.419391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.672100+0000","last_change":"2024-05-30T16:54:45.648517+0000","last_active":"2024-05-30T16:54:46.672100+0000","last_peered":"2024-05-30T16:54:46.672100+0000","last_clean":"2024-05-30T16:54:46.672100+0000","last_became_active":"2024-05-30T16:54:45.647977+0000","last_became_peered":"2024-05-30T16:54:45.647977+0000","last_unstale":"2024-05-30T16:54:46.672100+0000","last_undegraded":"2024-05-30T16:54:46.672100+0000","last_fullsized":"2024-05-30T16:54:46.672100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670659+0000","last_change":"2024-05-30T16:54:46.666945+0000","last_active":"2024-05-30T16:54:46.670659+0000","last_peered":"2024-05-30T16:54:46.670659+0000","last_clean":"2024-05-30T16:54:46.670659+0000","last_became_active":"2024-05-30T16:54:46.666678+0000","last_became_peered":"2024-05-30T16:54:46.666678+0000","last_unstale":"2024-05-30T16:54:46.670659+0000","last_undegraded":"2024-05-30T16:54:46.670659+0000","last_fullsized":"2024-05-30T16:54:46.670659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:37.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.669908+0000","last_change":"2024-05-30T16:54:45.655293+0000","last_active":"2024-05-30T16:54:46.669908+0000","last_peered":"2024-05-30T16:54:46.669908+0000","last_clean":"2024-05-30T16:54:46.669908+0000","last_became_active":"2024-05-30T16:54:45.652639+0000","last_became_peered":"2024-05-30T16:54:45.652639+0000","last_unstale":"2024-05-30T16:54:46.669908+0000","last_undegraded":"2024-05-30T16:54:46.669908+0000","last_fullsized":"2024-05-30T16:54:46.669908+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:26.354745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.643013+0000","last_change":"2024-05-30T16:54:45.643013+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.643013+0000","last_undegraded":"2024-05-30T16:54:45.643013+0000","last_fullsized":"2024-05-30T16:54:45.643013+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663460+0000","last_change":"2024-05-30T16:54:45.649596+0000","last_active":"2024-05-30T16:54:46.663460+0000","last_peered":"2024-05-30T16:54:46.663460+0000","last_clean":"2024-05-30T16:54:46.663460+0000","last_became_active":"2024-05-30T16:54:45.649230+0000","last_became_peered":"2024-05-30T16:54:45.649230+0000","last_unstale":"2024-05-30T16:54:46.663460+0000","last_undegraded":"2024-05-30T16:54:46.663460+0000","last_fullsized":"2024-05-30T16:54:46.663460+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:28:17.157569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.646670+0000","last_change":"2024-05-30T16:54:45.646670+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.646670+0000","last_undegraded":"2024-05-30T16:54:45.646670+0000","last_fullsized":"2024-05-30T16:54:45.646670+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666789+0000","last_change":"2024-05-30T16:54:45.653322+0000","last_active":"2024-05-30T16:54:46.666789+0000","last_peered":"2024-05-30T16:54:46.666789+0000","last_clean":"2024-05-30T16:54:46.666789+0000","last_became_active":"2024-05-30T16:54:45.653039+0000","last_became_peered":"2024-05-30T16:54:45.653039+0000","last_unstale":"2024-05-30T16:54:46.666789+0000","last_undegraded":"2024-05-30T16:54:46.666789+0000","last_fullsized":"2024-05-30T16:54:46.666789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:46.827065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666643+0000","last_change":"2024-05-30T16:54:46.664566+0000","last_active":"2024-05-30T16:54:46.666643+0000","last_peered":"2024-05-30T16:54:46.666643+0000","last_clean":"2024-05-30T16:54:46.666643+0000","last_became_active":"2024-05-30T16:54:46.664293+0000","last_became_peered":"2024-05-30T16:54:46.664293+0000","last_unstale":"2024-05-30T16:54:46.666643+0000","last_undegraded":"2024-05-30T16:54:46.666643+0000","last_fullsized":"2024-05-30T16:54:46.666643+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:12.383279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.642607+0000","last_change":"2024-05-30T16:54:45.649519+0000","last_active":"2024-05-30T16:54:46.642607+0000","last_peered":"2024-05-30T16:54:46.642607+0000","last_clean":"2024-05-30T16:54:46.642607+0000","last_became_active":"2024-05-30T16:54:45.649210+0000","last_became_peered":"2024-05-30T16:54:45.649210+0000","last_unstale":"2024-05-30T16:54:46.642607+0000","last_undegraded":"2024-05-30T16:54:46.642607+0000","last_fullsized":"2024-05-30T16:54:46.642607+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:04.574576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.650395+0000","last_change":"2024-05-30T16:54:45.650395+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.650395+0000","last_undegraded":"2024-05-30T16:54:45.650395+0000","last_fullsized":"2024-05-30T16:54:45.650395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.643656+0000","last_change":"2024-05-30T16:54:45.657461+0000","last_active":"2024-05-30T16:54:46.643656+0000","last_peered":"2024-05-30T16:54:46.643656+0000","last_clean":"2024-05-30T16:54:46.643656+0000","last_became_active":"2024-05-30T16:54:45.657185+0000","last_became_peered":"2024-05-30T16:54:45.657185+0000","last_unstale":"2024-05-30T16:54:46.643656+0000","last_undegraded":"2024-05-30T16:54:46.643656+0000","last_fullsized":"2024-05-30T16:54:46.643656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:01.690937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.673829+0000","last_change":"2024-05-30T16:54:46.672121+0000","last_active":"2024-05-30T16:54:46.673829+0000","last_peered":"2024-05-30T16:54:46.673829+0000","last_clean":"2024-05-30T16:54:46.673829+0000","last_became_active":"2024-05-30T16:54:46.671781+0000","last_became_peered":"2024-05-30T16:54:46.671781+0000","last_unstale":"2024-05-30T16:54:46.673829+0000","last_undegraded":"2024-05-30T16:54:46.673829+0000","last_fullsized":"2024-05-30T16:54:46.673829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:35.848386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.652601+0000","last_change":"2024-05-30T16:54:45.658364+0000","last_active":"2024-05-30T16:54:46.652601+0000","last_peered":"2024-05-30T16:54:46.652601+0000","last_clean":"2024-05-30T16:54:46.652601+0000","last_became_active":"2024-05-30T16:54:45.658015+0000","last_became_peered":"2024-05-30T16:54:45.658015+0000","last_unstale":"2024-05-30T16:54:46.652601+0000","last_undegraded":"2024-05-30T16:54:46.652601+0000","last_fullsized":"2024-05-30T16:54:46.652601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:04.574576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.676193+0000","last_change":"2024-05-30T16:54:46.673850+0000","last_active":"2024-05-30T16:54:46.676193+0000","last_peered":"2024-05-30T16:54:46.676193+0000","last_clean":"2024-05-30T16:54:46.676193+0000","last_became_active":"2024-05-30T16:54:46.673493+0000","last_became_peered":"2024-05-30T16:54:46.673493+0000","last_unstale":"2024-05-30T16:54:46.676193+0000","last_undegraded":"2024-05-30T16:54:46.676193+0000","last_fullsized":"2024-05-30T16:54:46.676193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:03.419391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.661693+0000","last_change":"2024-05-30T16:54:45.655634+0000","last_active":"2024-05-30T16:54:45.661693+0000","last_peered":"2024-05-30T16:54:45.661693+0000","last_clean":"2024-05-30T16:54:45.661693+0000","last_became_active":"2024-05-30T16:54:45.655296+0000","last_became_peered":"2024-05-30T16:54:45.655296+0000","last_unstale":"2024-05-30T16:54:45.661693+0000","last_undegraded":"2024-05-30T16:54:45.661693+0000","last_fullsized":"2024-05-30T16:54:45.661693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:17:37.296238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670966+0000","last_change":"2024-05-30T16:54:46.665621+0000","last_active":"2024-05-30T16:54:46.670966+0000","last_peered":"2024-05-30T16:54:46.670966+0000","last_clean":"2024-05-30T16:54:46.670966+0000","last_became_active":"2024-05-30T16:54:46.665034+0000","last_became_peered":"2024-05-30T16:54:46.665034+0000","last_unstale":"2024-05-30T16:54:46.670966+0000","last_undegraded":"2024-05-30T16:54:46.670966+0000","last_fullsized":"2024-05-30T16:54:46.670966+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:18.243815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.677071+0000","last_change":"2024-05-30T16:54:45.661725+0000","last_active":"2024-05-30T16:54:46.677071+0000","last_peered":"2024-05-30T16:54:46.677071+0000","last_clean":"2024-05-30T16:54:46.677071+0000","last_became_active":"2024-05-30T16:54:45.661411+0000","last_became_peered":"2024-05-30T16:54:45.661411+0000","last_unstale":"2024-05-30T16:54:46.677071+0000","last_undegraded":"2024-05-30T16:54:46.677071+0000","last_fullsized":"2024-05-30T16:54:46.677071+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675745+0000","last_change":"2024-05-30T16:54:46.672644+0000","last_active":"2024-05-30T16:54:46.675745+0000","last_peered":"2024-05-30T16:54:46.675745+0000","last_clean":"2024-05-30T16:54:46.675745+0000","last_became_active":"2024-05-30T16:54:46.672183+0000","last_became_peered":"2024-05-30T16:54:46.672183+0000","last_unstale":"2024-05-30T16:54:46.675745+0000","last_undegraded":"2024-05-30T16:54:46.675745+0000","last_fullsized":"2024-05-30T16:54:46.675745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:37.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675700+0000","last_change":"2024-05-30T16:54:45.645709+0000","last_active":"2024-05-30T16:54:46.675700+0000","last_peered":"2024-05-30T16:54:46.675700+0000","last_clean":"2024-05-30T16:54:46.675700+0000","last_became_active":"2024-05-30T16:54:45.644794+0000","last_became_peered":"2024-05-30T16:54:45.644794+0000","last_unstale":"2024-05-30T16:54:46.675700+0000","last_undegraded":"2024-05-30T16:54:46.675700+0000","last_fullsized":"2024-05-30T16:54:46.675700+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:37.221162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670171+0000","last_change":"2024-05-30T16:54:46.666387+0000","last_active":"2024-05-30T16:54:46.670171+0000","last_peered":"2024-05-30T16:54:46.670171+0000","last_clean":"2024-05-30T16:54:46.670171+0000","last_became_active":"2024-05-30T16:54:46.666160+0000","last_became_peered":"2024-05-30T16:54:46.666160+0000","last_unstale":"2024-05-30T16:54:46.670171+0000","last_undegraded":"2024-05-30T16:54:46.670171+0000","last_fullsized":"2024-05-30T16:54:46.670171+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:49:29.390734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.662205+0000","last_change":"2024-05-30T16:54:45.660979+0000","last_active":"2024-05-30T16:54:45.662205+0000","last_peered":"2024-05-30T16:54:45.662205+0000","last_clean":"2024-05-30T16:54:45.662205+0000","last_became_active":"2024-05-30T16:54:45.660628+0000","last_became_peered":"2024-05-30T16:54:45.660628+0000","last_unstale":"2024-05-30T16:54:45.662205+0000","last_undegraded":"2024-05-30T16:54:45.662205+0000","last_fullsized":"2024-05-30T16:54:45.662205+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:21:25.478498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.673884+0000","last_change":"2024-05-30T16:54:46.669298+0000","last_active":"2024-05-30T16:54:46.673884+0000","last_peered":"2024-05-30T16:54:46.673884+0000","last_clean":"2024-05-30T16:54:46.673884+0000","last_became_active":"2024-05-30T16:54:46.669004+0000","last_became_peered":"2024-05-30T16:54:46.669004+0000","last_unstale":"2024-05-30T16:54:46.673884+0000","last_undegraded":"2024-05-30T16:54:46.673884+0000","last_fullsized":"2024-05-30T16:54:46.673884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:43.670842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.644949+0000","last_change":"2024-05-30T16:54:45.657137+0000","last_active":"2024-05-30T16:54:46.644949+0000","last_peered":"2024-05-30T16:54:46.644949+0000","last_clean":"2024-05-30T16:54:46.644949+0000","last_became_active":"2024-05-30T16:54:45.656852+0000","last_became_peered":"2024-05-30T16:54:45.656852+0000","last_unstale":"2024-05-30T16:54:46.644949+0000","last_undegraded":"2024-05-30T16:54:46.644949+0000","last_fullsized":"2024-05-30T16:54:46.644949+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:30:37.379158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663572+0000","last_change":"2024-05-30T16:54:46.659555+0000","last_active":"2024-05-30T16:54:46.663572+0000","last_peered":"2024-05-30T16:54:46.663572+0000","last_clean":"2024-05-30T16:54:46.663572+0000","last_became_active":"2024-05-30T16:54:46.659213+0000","last_became_peered":"2024-05-30T16:54:46.659213+0000","last_unstale":"2024-05-30T16:54:46.663572+0000","last_undegraded":"2024-05-30T16:54:46.663572+0000","last_fullsized":"2024-05-30T16:54:46.663572+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:01.137841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.642813+0000","last_change":"2024-05-30T16:54:45.658679+0000","last_active":"2024-05-30T16:54:46.642813+0000","last_peered":"2024-05-30T16:54:46.642813+0000","last_clean":"2024-05-30T16:54:46.642813+0000","last_became_active":"2024-05-30T16:54:45.658329+0000","last_became_peered":"2024-05-30T16:54:45.658329+0000","last_unstale":"2024-05-30T16:54:46.642813+0000","last_undegraded":"2024-05-30T16:54:46.642813+0000","last_fullsized":"2024-05-30T16:54:46.642813+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:48.442480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670623+0000","last_change":"2024-05-30T16:54:46.666749+0000","last_active":"2024-05-30T16:54:46.670623+0000","last_peered":"2024-05-30T16:54:46.670623+0000","last_clean":"2024-05-30T16:54:46.670623+0000","last_became_active":"2024-05-30T16:54:46.665986+0000","last_became_peered":"2024-05-30T16:54:46.665986+0000","last_unstale":"2024-05-30T16:54:46.670623+0000","last_undegraded":"2024-05-30T16:54:46.670623+0000","last_fullsized":"2024-05-30T16:54:46.670623+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:26.161079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675768+0000","last_change":"2024-05-30T16:54:45.660854+0000","last_active":"2024-05-30T16:54:46.675768+0000","last_peered":"2024-05-30T16:54:46.675768+0000","last_clean":"2024-05-30T16:54:46.675768+0000","last_became_active":"2024-05-30T16:54:45.660575+0000","last_became_peered":"2024-05-30T16:54:45.660575+0000","last_unstale":"2024-05-30T16:54:46.675768+0000","last_undegraded":"2024-05-30T16:54:46.675768+0000","last_fullsized":"2024-05-30T16:54:46.675768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:46.827065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663814+0000","last_change":"2024-05-30T16:54:46.660412+0000","last_active":"2024-05-30T16:54:46.663814+0000","last_peered":"2024-05-30T16:54:46.663814+0000","last_clean":"2024-05-30T16:54:46.663814+0000","last_became_active":"2024-05-30T16:54:46.660132+0000","last_became_peered":"2024-05-30T16:54:46.660132+0000","last_unstale":"2024-05-30T16:54:46.663814+0000","last_undegraded":"2024-05-30T16:54:46.663814+0000","last_fullsized":"2024-05-30T16:54:46.663814+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:27.358141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.661017+0000","last_change":"2024-05-30T16:54:45.658736+0000","last_active":"2024-05-30T16:54:45.661017+0000","last_peered":"2024-05-30T16:54:45.661017+0000","last_clean":"2024-05-30T16:54:45.661017+0000","last_became_active":"2024-05-30T16:54:45.658382+0000","last_became_peered":"2024-05-30T16:54:45.658382+0000","last_unstale":"2024-05-30T16:54:45.661017+0000","last_undegraded":"2024-05-30T16:54:45.661017+0000","last_fullsized":"2024-05-30T16:54:45.661017+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:33.856990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.674113+0000","last_change":"2024-05-30T16:54:46.668478+0000","last_active":"2024-05-30T16:54:46.674113+0000","last_peered":"2024-05-30T16:54:46.674113+0000","last_clean":"2024-05-30T16:54:46.674113+0000","last_became_active":"2024-05-30T16:54:46.668127+0000","last_became_peered":"2024-05-30T16:54:46.668127+0000","last_unstale":"2024-05-30T16:54:46.674113+0000","last_undegraded":"2024-05-30T16:54:46.674113+0000","last_fullsized":"2024-05-30T16:54:46.674113+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:03.419391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675376+0000","last_change":"2024-05-30T16:54:45.651393+0000","last_active":"2024-05-30T16:54:46.675376+0000","last_peered":"2024-05-30T16:54:46.675376+0000","last_clean":"2024-05-30T16:54:46.675376+0000","last_became_active":"2024-05-30T16:54:45.650980+0000","last_became_peered":"2024-05-30T16:54:45.650980+0000","last_unstale":"2024-05-30T16:54:46.675376+0000","last_undegraded":"2024-05-30T16:54:46.675376+0000","last_fullsized":"2024-05-30T16:54:46.675376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:25.157682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.644782+0000","last_change":"2024-05-30T16:54:45.644782+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.644782+0000","last_undegraded":"2024-05-30T16:54:45.644782+0000","last_fullsized":"2024-05-30T16:54:45.644782+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670736+0000","last_change":"2024-05-30T16:54:45.655629+0000","last_active":"2024-05-30T16:54:46.670736+0000","last_peered":"2024-05-30T16:54:46.670736+0000","last_clean":"2024-05-30T16:54:46.670736+0000","last_became_active":"2024-05-30T16:54:45.655351+0000","last_became_peered":"2024-05-30T16:54:45.655351+0000","last_unstale":"2024-05-30T16:54:46.670736+0000","last_undegraded":"2024-05-30T16:54:46.670736+0000","last_fullsized":"2024-05-30T16:54:46.670736+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:34.256169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675732+0000","last_change":"2024-05-30T16:54:46.672424+0000","last_active":"2024-05-30T16:54:46.675732+0000","last_peered":"2024-05-30T16:54:46.675732+0000","last_clean":"2024-05-30T16:54:46.675732+0000","last_became_active":"2024-05-30T16:54:46.671842+0000","last_became_peered":"2024-05-30T16:54:46.671842+0000","last_unstale":"2024-05-30T16:54:46.675732+0000","last_undegraded":"2024-05-30T16:54:46.675732+0000","last_fullsized":"2024-05-30T16:54:46.675732+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:49:29.390734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.660180+0000","last_change":"2024-05-30T16:54:45.656675+0000","last_active":"2024-05-30T16:54:46.660180+0000","last_peered":"2024-05-30T16:54:46.660180+0000","last_clean":"2024-05-30T16:54:46.660180+0000","last_became_active":"2024-05-30T16:54:45.656400+0000","last_became_peered":"2024-05-30T16:54:45.656400+0000","last_unstale":"2024-05-30T16:54:46.660180+0000","last_undegraded":"2024-05-30T16:54:46.660180+0000","last_fullsized":"2024-05-30T16:54:46.660180+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:48.442480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.672601+0000","last_change":"2024-05-30T16:54:46.667135+0000","last_active":"2024-05-30T16:54:46.672601+0000","last_peered":"2024-05-30T16:54:46.672601+0000","last_clean":"2024-05-30T16:54:46.672601+0000","last_became_active":"2024-05-30T16:54:46.666764+0000","last_became_peered":"2024-05-30T16:54:46.666764+0000","last_unstale":"2024-05-30T16:54:46.672601+0000","last_undegraded":"2024-05-30T16:54:46.672601+0000","last_fullsized":"2024-05-30T16:54:46.672601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:37.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.660884+0000","last_change":"2024-05-30T16:54:45.655577+0000","last_active":"2024-05-30T16:54:45.660884+0000","last_peered":"2024-05-30T16:54:45.660884+0000","last_clean":"2024-05-30T16:54:45.660884+0000","last_became_active":"2024-05-30T16:54:45.655197+0000","last_became_peered":"2024-05-30T16:54:45.655197+0000","last_unstale":"2024-05-30T16:54:45.660884+0000","last_undegraded":"2024-05-30T16:54:45.660884+0000","last_fullsized":"2024-05-30T16:54:45.660884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:52:20.023991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664248+0000","last_change":"2024-05-30T16:54:46.655167+0000","last_active":"2024-05-30T16:54:46.664248+0000","last_peered":"2024-05-30T16:54:46.664248+0000","last_clean":"2024-05-30T16:54:46.664248+0000","last_became_active":"2024-05-30T16:54:46.654866+0000","last_became_peered":"2024-05-30T16:54:46.654866+0000","last_unstale":"2024-05-30T16:54:46.664248+0000","last_undegraded":"2024-05-30T16:54:46.664248+0000","last_fullsized":"2024-05-30T16:54:46.664248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:01.137841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.661131+0000","last_change":"2024-05-30T16:54:45.647369+0000","last_active":"2024-05-30T16:54:46.661131+0000","last_peered":"2024-05-30T16:54:46.661131+0000","last_clean":"2024-05-30T16:54:46.661131+0000","last_became_active":"2024-05-30T16:54:45.647108+0000","last_became_peered":"2024-05-30T16:54:45.647108+0000","last_unstale":"2024-05-30T16:54:46.661131+0000","last_undegraded":"2024-05-30T16:54:46.661131+0000","last_fullsized":"2024-05-30T16:54:46.661131+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:20:36.722964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668263+0000","last_change":"2024-05-30T16:54:46.662209+0000","last_active":"2024-05-30T16:54:46.668263+0000","last_peered":"2024-05-30T16:54:46.668263+0000","last_clean":"2024-05-30T16:54:46.668263+0000","last_became_active":"2024-05-30T16:54:46.661882+0000","last_became_peered":"2024-05-30T16:54:46.661882+0000","last_unstale":"2024-05-30T16:54:46.668263+0000","last_undegraded":"2024-05-30T16:54:46.668263+0000","last_fullsized":"2024-05-30T16:54:46.668263+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:27.358141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.642644+0000","last_change":"2024-05-30T16:54:45.657812+0000","last_active":"2024-05-30T16:54:46.642644+0000","last_peered":"2024-05-30T16:54:46.642644+0000","last_clean":"2024-05-30T16:54:46.642644+0000","last_became_active":"2024-05-30T16:54:45.656848+0000","last_became_peered":"2024-05-30T16:54:45.656848+0000","last_unstale":"2024-05-30T16:54:46.642644+0000","last_undegraded":"2024-05-30T16:54:46.642644+0000","last_fullsized":"2024-05-30T16:54:46.642644+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.658294+0000","last_change":"2024-05-30T16:54:46.654546+0000","last_active":"2024-05-30T16:54:46.658294+0000","last_peered":"2024-05-30T16:54:46.658294+0000","last_clean":"2024-05-30T16:54:46.658294+0000","last_became_active":"2024-05-30T16:54:46.653161+0000","last_became_peered":"2024-05-30T16:54:46.653161+0000","last_unstale":"2024-05-30T16:54:46.658294+0000","last_undegraded":"2024-05-30T16:54:46.658294+0000","last_fullsized":"2024-05-30T16:54:46.658294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:26.161079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.676208+0000","last_change":"2024-05-30T16:54:45.658652+0000","last_active":"2024-05-30T16:54:46.676208+0000","last_peered":"2024-05-30T16:54:46.676208+0000","last_clean":"2024-05-30T16:54:46.676208+0000","last_became_active":"2024-05-30T16:54:45.658367+0000","last_became_peered":"2024-05-30T16:54:45.658367+0000","last_unstale":"2024-05-30T16:54:46.676208+0000","last_undegraded":"2024-05-30T16:54:46.676208+0000","last_fullsized":"2024-05-30T16:54:46.676208+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:30:37.379158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666735+0000","last_change":"2024-05-30T16:54:46.662119+0000","last_active":"2024-05-30T16:54:46.666735+0000","last_peered":"2024-05-30T16:54:46.666735+0000","last_clean":"2024-05-30T16:54:46.666735+0000","last_became_active":"2024-05-30T16:54:46.661785+0000","last_became_peered":"2024-05-30T16:54:46.661785+0000","last_unstale":"2024-05-30T16:54:46.666735+0000","last_undegraded":"2024-05-30T16:54:46.666735+0000","last_fullsized":"2024-05-30T16:54:46.666735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:32.939644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663723+0000","last_change":"2024-05-30T16:54:45.653028+0000","last_active":"2024-05-30T16:54:46.663723+0000","last_peered":"2024-05-30T16:54:46.663723+0000","last_clean":"2024-05-30T16:54:46.663723+0000","last_became_active":"2024-05-30T16:54:45.652710+0000","last_became_peered":"2024-05-30T16:54:45.652710+0000","last_unstale":"2024-05-30T16:54:46.663723+0000","last_undegraded":"2024-05-30T16:54:46.663723+0000","last_fullsized":"2024-05-30T16:54:46.663723+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:31.936247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670882+0000","last_change":"2024-05-30T16:54:46.665362+0000","last_active":"2024-05-30T16:54:46.670882+0000","last_peered":"2024-05-30T16:54:46.670882+0000","last_clean":"2024-05-30T16:54:46.670882+0000","last_became_active":"2024-05-30T16:54:46.664731+0000","last_became_peered":"2024-05-30T16:54:46.664731+0000","last_unstale":"2024-05-30T16:54:46.670882+0000","last_undegraded":"2024-05-30T16:54:46.670882+0000","last_fullsized":"2024-05-30T16:54:46.670882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:59.959822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.645071+0000","last_change":"2024-05-30T16:54:45.653794+0000","last_active":"2024-05-30T16:54:46.645071+0000","last_peered":"2024-05-30T16:54:46.645071+0000","last_clean":"2024-05-30T16:54:46.645071+0000","last_became_active":"2024-05-30T16:54:45.652243+0000","last_became_peered":"2024-05-30T16:54:45.652243+0000","last_unstale":"2024-05-30T16:54:46.645071+0000","last_undegraded":"2024-05-30T16:54:46.645071+0000","last_fullsized":"2024-05-30T16:54:46.645071+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:41.075478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666830+0000","last_change":"2024-05-30T16:54:46.659899+0000","last_active":"2024-05-30T16:54:46.666830+0000","last_peered":"2024-05-30T16:54:46.666830+0000","last_clean":"2024-05-30T16:54:46.666830+0000","last_became_active":"2024-05-30T16:54:46.658860+0000","last_became_peered":"2024-05-30T16:54:46.658860+0000","last_unstale":"2024-05-30T16:54:46.666830+0000","last_undegraded":"2024-05-30T16:54:46.666830+0000","last_fullsized":"2024-05-30T16:54:46.666830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:35.259565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.644190+0000","last_change":"2024-05-30T16:54:45.652157+0000","last_active":"2024-05-30T16:54:46.644190+0000","last_peered":"2024-05-30T16:54:46.644190+0000","last_clean":"2024-05-30T16:54:46.644190+0000","last_became_active":"2024-05-30T16:54:45.651109+0000","last_became_peered":"2024-05-30T16:54:45.651109+0000","last_unstale":"2024-05-30T16:54:46.644190+0000","last_undegraded":"2024-05-30T16:54:46.644190+0000","last_fullsized":"2024-05-30T16:54:46.644190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:52.541652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.642572+0000","last_change":"2024-05-30T16:54:45.642572+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.642572+0000","last_undegraded":"2024-05-30T16:54:45.642572+0000","last_fullsized":"2024-05-30T16:54:45.642572+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.660933+0000","last_change":"2024-05-30T16:54:45.650576+0000","last_active":"2024-05-30T16:54:46.660933+0000","last_peered":"2024-05-30T16:54:46.660933+0000","last_clean":"2024-05-30T16:54:46.660933+0000","last_became_active":"2024-05-30T16:54:45.650316+0000","last_became_peered":"2024-05-30T16:54:45.650316+0000","last_unstale":"2024-05-30T16:54:46.660933+0000","last_undegraded":"2024-05-30T16:54:46.660933+0000","last_fullsized":"2024-05-30T16:54:46.660933+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:32:02.321051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663762+0000","last_change":"2024-05-30T16:54:46.660833+0000","last_active":"2024-05-30T16:54:46.663762+0000","last_peered":"2024-05-30T16:54:46.663762+0000","last_clean":"2024-05-30T16:54:46.663762+0000","last_became_active":"2024-05-30T16:54:46.660017+0000","last_became_peered":"2024-05-30T16:54:46.660017+0000","last_unstale":"2024-05-30T16:54:46.663762+0000","last_undegraded":"2024-05-30T16:54:46.663762+0000","last_fullsized":"2024-05-30T16:54:46.663762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.644778+0000","last_change":"2024-05-30T16:54:45.645109+0000","last_active":"2024-05-30T16:54:46.644778+0000","last_peered":"2024-05-30T16:54:46.644778+0000","last_clean":"2024-05-30T16:54:46.644778+0000","last_became_active":"2024-05-30T16:54:45.644753+0000","last_became_peered":"2024-05-30T16:54:45.644753+0000","last_unstale":"2024-05-30T16:54:46.644778+0000","last_undegraded":"2024-05-30T16:54:46.644778+0000","last_fullsized":"2024-05-30T16:54:46.644778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:57:37.286999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670848+0000","last_change":"2024-05-30T16:54:46.659487+0000","last_active":"2024-05-30T16:54:46.670848+0000","last_peered":"2024-05-30T16:54:46.670848+0000","last_clean":"2024-05-30T16:54:46.670848+0000","last_became_active":"2024-05-30T16:54:46.659243+0000","last_became_peered":"2024-05-30T16:54:46.659243+0000","last_unstale":"2024-05-30T16:54:46.670848+0000","last_undegraded":"2024-05-30T16:54:46.670848+0000","last_fullsized":"2024-05-30T16:54:46.670848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:33.056889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.660879+0000","last_change":"2024-05-30T16:54:45.654729+0000","last_active":"2024-05-30T16:54:46.660879+0000","last_peered":"2024-05-30T16:54:46.660879+0000","last_clean":"2024-05-30T16:54:46.660879+0000","last_became_active":"2024-05-30T16:54:45.654447+0000","last_became_peered":"2024-05-30T16:54:45.654447+0000","last_unstale":"2024-05-30T16:54:46.660879+0000","last_undegraded":"2024-05-30T16:54:46.660879+0000","last_fullsized":"2024-05-30T16:54:46.660879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:28.492293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.649949+0000","last_change":"2024-05-30T16:54:45.649949+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.649949+0000","last_undegraded":"2024-05-30T16:54:45.649949+0000","last_fullsized":"2024-05-30T16:54:45.649949+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.660891+0000","last_change":"2024-05-30T16:54:45.655443+0000","last_active":"2024-05-30T16:54:45.660891+0000","last_peered":"2024-05-30T16:54:45.660891+0000","last_clean":"2024-05-30T16:54:45.660891+0000","last_became_active":"2024-05-30T16:54:45.655068+0000","last_became_peered":"2024-05-30T16:54:45.655068+0000","last_unstale":"2024-05-30T16:54:45.660891+0000","last_undegraded":"2024-05-30T16:54:45.660891+0000","last_fullsized":"2024-05-30T16:54:45.660891+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:43:52.793573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.649866+0000","last_change":"2024-05-30T16:54:45.649866+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.649866+0000","last_undegraded":"2024-05-30T16:54:45.649866+0000","last_fullsized":"2024-05-30T16:54:45.649866+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.647166+0000","last_change":"2024-05-30T16:54:45.654457+0000","last_active":"2024-05-30T16:54:46.647166+0000","last_peered":"2024-05-30T16:54:46.647166+0000","last_clean":"2024-05-30T16:54:46.647166+0000","last_became_active":"2024-05-30T16:54:45.654115+0000","last_became_peered":"2024-05-30T16:54:45.654115+0000","last_unstale":"2024-05-30T16:54:46.647166+0000","last_undegraded":"2024-05-30T16:54:46.647166+0000","last_fullsized":"2024-05-30T16:54:46.647166+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:38.027264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":244,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.648534+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:54:46.648534+0000","last_peered":"2024-05-30T16:54:46.648534+0000","last_clean":"2024-05-30T16:54:46.648534+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:54:46.648534+0000","last_undegraded":"2024-05-30T16:54:46.648534+0000","last_fullsized":"2024-05-30T16:54:46.648534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509513,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44948,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326892,"statfs":{"total":96636764160,"available":96590737408,"internally_reserved":0,"allocated":1318912,"data_stored":891249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509514,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45780,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326060,"statfs":{"total":96636764160,"available":96589885440,"internally_reserved":0,"allocated":724992,"data_stored":300881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509514,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40216,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331624,"statfs":{"total":96636764160,"available":96595582976,"internally_reserved":0,"allocated":733184,"data_stored":301533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45768,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326072,"statfs":{"total":96636764160,"available":96589897728,"internally_reserved":0,"allocated":712704,"data_stored":294050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44384,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327456,"statfs":{"total":96636764160,"available":96591314944,"internally_reserved":0,"allocated":733184,"data_stored":300937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45780,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326060,"statfs":{"total":96636764160,"available":96589885440,"internally_reserved":0,"allocated":729088,"data_stored":300971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509514,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46376,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325464,"statfs":{"total":96636764160,"available":96589275136,"internally_reserved":0,"allocated":1335296,"data_stored":893443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542218,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45752,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326088,"statfs":{"total":96636764160,"available":96589914112,"internally_reserved":0,"allocated":700416,"data_stored":287727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:54:50.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:54:50.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.979+0000 7ff177600640 1 Processor -- start 2024-05-30T16:54:50.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.979+0000 7ff177600640 1 -- start start 2024-05-30T16:54:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff177600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006e900 0x7ff17015f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff177600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17015f060 con 0x7ff1700af720 2024-05-30T16:54:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff177600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1700afb00 con 0x7ff1700d0560 2024-05-30T16:54:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff177600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff17015c270 con 0x7ff17006e900 2024-05-30T16:54:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff174c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff1700af720 0x7ff17015b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40666/0 (socket says 172.21.15.59:40666) 2024-05-30T16:54:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff174c00640 1 -- 172.21.15.59:0/2087611844 learned_addr learned my addr 172.21.15.59:0/2087611844 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff167e00640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006e900 0x7ff17015f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3123122362 0 0) 0x7ff17015f060 con 0x7ff1700af720 2024-05-30T16:54:50.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff154003530 con 0x7ff1700af720 2024-05-30T16:54:50.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452770708 0 0) 0x7ff1700afb00 con 0x7ff1700d0560 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff17015f060 con 0x7ff1700d0560 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3742340928 0 0) 0x7ff154003530 con 0x7ff1700af720 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006e900 msgr2=0x7ff17015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006e900 0x7ff17015f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 >> v1:172.21.15.107:6789/0 conn(0x7ff1700d0560 legacy=0x7ff170072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17015c550 con 0x7ff1700af720 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7ff160001680 con 0x7ff1700af720 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff167e00640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006e900 0x7ff17015f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 >> v1:172.21.15.59:6789/0 conn(0x7ff1700af720 legacy=0x7ff17015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff154003b80 0x7ff154003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006e900 0x7ff154004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff154004d50 0x7ff1540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff17015c270 con 0x7ff154003b80 2024-05-30T16:54:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff15400dc90 con 0x7ff154004d50 2024-05-30T16:54:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff15400de10 con 0x7ff17006e900 2024-05-30T16:54:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff174c00640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff154003b80 0x7ff154003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff167e00640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006e900 0x7ff154004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff175600640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff154004d50 0x7ff1540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff174c00640 1 -- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006e900 msgr2=0x7ff154004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff174c00640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006e900 0x7ff154004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff174c00640 1 -- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff154004d50 msgr2=0x7ff1540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff174c00640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff154004d50 0x7ff1540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff174c00640 1 -- 172.21.15.59:0/2087611844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff154003530 con 0x7ff154003b80 2024-05-30T16:54:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.983+0000 7ff175600640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff154004d50 0x7ff1540051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:50.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.987+0000 7ff174c00640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff154003b80 0x7ff154003f80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c1f0 tx=0x7ff16001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdaf9498adcf1595 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:50.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.987+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160007cf0 con 0x7ff154003b80 2024-05-30T16:54:50.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.987+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1600a9020 con 0x7ff154003b80 2024-05-30T16:54:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.987+0000 7ff16fe00640 1 -- 172.21.15.59:0/2087611844 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1600a5b10 con 0x7ff154003b80 2024-05-30T16:54:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.987+0000 7ff177600640 1 -- 172.21.15.59:0/2087611844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff154003b80 msgr2=0x7ff154003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.987+0000 7ff177600640 1 --2- 172.21.15.59:0/2087611844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff154003b80 0x7ff154003f80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c1f0 tx=0x7ff16001cbf0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.987+0000 7ff175600640 1 -- 172.21.15.59:0/2087611844 reap_dead start 2024-05-30T16:54:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.987+0000 7ff177600640 1 -- 172.21.15.59:0/2087611844 shutdown_connections 2024-05-30T16:54:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.987+0000 7ff177600640 1 -- 172.21.15.59:0/2087611844 >> 172.21.15.59:0/2087611844 conn(0x7ff1700b22d0 msgr2=0x7ff1700b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.987+0000 7ff177600640 1 -- 172.21.15.59:0/2087611844 shutdown_connections 2024-05-30T16:54:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.987+0000 7ff177600640 1 -- 172.21.15.59:0/2087611844 wait complete. 2024-05-30T16:54:50.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff177600640 1 Processor -- start 2024-05-30T16:54:50.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff177600640 1 -- start start 2024-05-30T16:54:50.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff177600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff154003b80 0x7ff17015d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff177600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1700cea40 0x7ff1701f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff177600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006f2b0 0x7ff17006f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff177600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff170158740 con 0x7ff1700cea40 2024-05-30T16:54:50.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff177600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff1701585c0 con 0x7ff154003b80 2024-05-30T16:54:50.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff177600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff1701588c0 con 0x7ff17006f2b0 2024-05-30T16:54:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff167e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1700cea40 0x7ff1701f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff167e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1700cea40 0x7ff1701f75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34888/0 (socket says 172.21.15.59:34888) 2024-05-30T16:54:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff167e00640 1 -- 172.21.15.59:0/3585669804 learned_addr learned my addr 172.21.15.59:0/3585669804 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff175600640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006f2b0 0x7ff17006f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff174c00640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff154003b80 0x7ff17015d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff167e00640 1 -- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006f2b0 msgr2=0x7ff17006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff167e00640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006f2b0 0x7ff17006f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff167e00640 1 -- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff154003b80 msgr2=0x7ff17015d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff167e00640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff154003b80 0x7ff17015d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff167e00640 1 -- 172.21.15.59:0/3585669804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1701fb4f0 con 0x7ff1700cea40 2024-05-30T16:54:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff175600640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006f2b0 0x7ff17006f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff174c00640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff154003b80 0x7ff17015d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff167e00640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1700cea40 0x7ff1701f75c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff158011970 tx=0x7ff158011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff16d600640 1 -- 172.21.15.59:0/3585669804 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15800fb50 con 0x7ff1700cea40 2024-05-30T16:54:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff16d600640 1 -- 172.21.15.59:0/3585669804 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff15800fcf0 con 0x7ff1700cea40 2024-05-30T16:54:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff16d600640 1 -- 172.21.15.59:0/3585669804 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15800fea0 con 0x7ff1700cea40 2024-05-30T16:54:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff177600640 1 -- 172.21.15.59:0/3585669804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1701fb7d0 con 0x7ff1700cea40 2024-05-30T16:54:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff177600640 1 -- 172.21.15.59:0/3585669804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1701fbd90 con 0x7ff1700cea40 2024-05-30T16:54:50.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.991+0000 7ff177600640 1 -- 172.21.15.59:0/3585669804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff170068a90 con 0x7ff1700cea40 2024-05-30T16:54:50.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.995+0000 7ff16d600640 1 -- 172.21.15.59:0/3585669804 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7ff158012040 con 0x7ff1700cea40 2024-05-30T16:54:50.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.995+0000 7ff16d600640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff14c068b60 0x7ff14c06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:50.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.995+0000 7ff16d600640 1 -- 172.21.15.59:0/3585669804 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7ff1580859f0 con 0x7ff1700cea40 2024-05-30T16:54:50.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.995+0000 7ff174c00640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff14c068b60 0x7ff14c06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:50.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.995+0000 7ff174c00640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff14c068b60 0x7ff14c06b020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff1600aa000 tx=0x7ff160001a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:51.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:50.999+0000 7ff16d600640 1 -- 172.21.15.59:0/3585669804 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff158019030 con 0x7ff1700cea40 2024-05-30T16:54:51.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.163+0000 7ff177600640 1 -- 172.21.15.59:0/3585669804 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1701583a0 con 0x7ff14c068b60 2024-05-30T16:54:51.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.167+0000 7ff16d600640 1 -- 172.21.15.59:0/3585669804 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250828 (secure 0 0 0) 0x7ff1701583a0 con 0x7ff14c068b60 2024-05-30T16:54:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:51.176 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:54:51.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.171+0000 7ff177600640 1 -- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff14c068b60 msgr2=0x7ff14c06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:51.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.171+0000 7ff177600640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff14c068b60 0x7ff14c06b020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff1600aa000 tx=0x7ff160001a40 comp rx=0 tx=0).stop 2024-05-30T16:54:51.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.171+0000 7ff177600640 1 -- 172.21.15.59:0/3585669804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1700cea40 msgr2=0x7ff1701f75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:51.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.171+0000 7ff177600640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1700cea40 0x7ff1701f75c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff158011970 tx=0x7ff158011e30 comp rx=0 tx=0).stop 2024-05-30T16:54:51.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.171+0000 7ff177600640 1 -- 172.21.15.59:0/3585669804 shutdown_connections 2024-05-30T16:54:51.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.171+0000 7ff177600640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff14c068b60 0x7ff14c06b020 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.171+0000 7ff177600640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff17006f2b0 0x7ff17006f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.171+0000 7ff177600640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1700cea40 0x7ff1701f75c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.171+0000 7ff177600640 1 --2- 172.21.15.59:0/3585669804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff154003b80 0x7ff17015d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.171+0000 7ff177600640 1 -- 172.21.15.59:0/3585669804 >> 172.21.15.59:0/3585669804 conn(0x7ff1700b22d0 msgr2=0x7ff1700b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:51.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.171+0000 7ff177600640 1 -- 172.21.15.59:0/3585669804 shutdown_connections 2024-05-30T16:54:51.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.171+0000 7ff177600640 1 -- 172.21.15.59:0/3585669804 wait complete. 2024-05-30T16:54:51.196 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-05-30T16:54:51.162969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":359004,"kb_used_data":6824,"kb_used_omap":12,"kb_used_meta":352051,"kb_avail":754615716,"statfs":{"total":773094113280,"available":772726493184,"internally_reserved":0,"allocated":6987776,"data_stored":3570791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":360500784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001500"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.661703+0000","last_change":"2024-05-30T16:54:46.653537+0000","last_active":"2024-05-30T16:54:46.661703+0000","last_peered":"2024-05-30T16:54:46.661703+0000","last_clean":"2024-05-30T16:54:46.661703+0000","last_became_active":"2024-05-30T16:54:46.653287+0000","last_became_peered":"2024-05-30T16:54:46.653287+0000","last_unstale":"2024-05-30T16:54:46.661703+0000","last_undegraded":"2024-05-30T16:54:46.661703+0000","last_fullsized":"2024-05-30T16:54:46.661703+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:53.883132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.646545+0000","last_change":"2024-05-30T16:54:45.646545+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.646545+0000","last_undegraded":"2024-05-30T16:54:45.646545+0000","last_fullsized":"2024-05-30T16:54:45.646545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.665343+0000","last_change":"2024-05-30T16:54:46.658753+0000","last_active":"2024-05-30T16:54:46.665343+0000","last_peered":"2024-05-30T16:54:46.665343+0000","last_clean":"2024-05-30T16:54:46.665343+0000","last_became_active":"2024-05-30T16:54:46.658476+0000","last_became_peered":"2024-05-30T16:54:46.658476+0000","last_unstale":"2024-05-30T16:54:46.665343+0000","last_undegraded":"2024-05-30T16:54:46.665343+0000","last_fullsized":"2024-05-30T16:54:46.665343+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:49.445877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668376+0000","last_change":"2024-05-30T16:54:46.662427+0000","last_active":"2024-05-30T16:54:46.668376+0000","last_peered":"2024-05-30T16:54:46.668376+0000","last_clean":"2024-05-30T16:54:46.668376+0000","last_became_active":"2024-05-30T16:54:46.662157+0000","last_became_peered":"2024-05-30T16:54:46.662157+0000","last_unstale":"2024-05-30T16:54:46.668376+0000","last_undegraded":"2024-05-30T16:54:46.668376+0000","last_fullsized":"2024-05-30T16:54:46.668376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:43.670842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670358+0000","last_change":"2024-05-30T16:54:46.660389+0000","last_active":"2024-05-30T16:54:46.670358+0000","last_peered":"2024-05-30T16:54:46.670358+0000","last_clean":"2024-05-30T16:54:46.670358+0000","last_became_active":"2024-05-30T16:54:46.660137+0000","last_became_peered":"2024-05-30T16:54:46.660137+0000","last_unstale":"2024-05-30T16:54:46.670358+0000","last_undegraded":"2024-05-30T16:54:46.670358+0000","last_fullsized":"2024-05-30T16:54:46.670358+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:33.138067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671112+0000","last_change":"2024-05-30T16:54:46.666587+0000","last_active":"2024-05-30T16:54:46.671112+0000","last_peered":"2024-05-30T16:54:46.671112+0000","last_clean":"2024-05-30T16:54:46.671112+0000","last_became_active":"2024-05-30T16:54:46.663836+0000","last_became_peered":"2024-05-30T16:54:46.663836+0000","last_unstale":"2024-05-30T16:54:46.671112+0000","last_undegraded":"2024-05-30T16:54:46.671112+0000","last_fullsized":"2024-05-30T16:54:46.671112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:49:29.390734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.649812+0000","last_change":"2024-05-30T16:54:46.648712+0000","last_active":"2024-05-30T16:54:46.649812+0000","last_peered":"2024-05-30T16:54:46.649812+0000","last_clean":"2024-05-30T16:54:46.649812+0000","last_became_active":"2024-05-30T16:54:46.648462+0000","last_became_peered":"2024-05-30T16:54:46.648462+0000","last_unstale":"2024-05-30T16:54:46.649812+0000","last_undegraded":"2024-05-30T16:54:46.649812+0000","last_fullsized":"2024-05-30T16:54:46.649812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:52:39.449932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.648247+0000","last_change":"2024-05-30T16:54:45.648247+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.648247+0000","last_undegraded":"2024-05-30T16:54:45.648247+0000","last_fullsized":"2024-05-30T16:54:45.648247+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670868+0000","last_change":"2024-05-30T16:54:46.661707+0000","last_active":"2024-05-30T16:54:46.670868+0000","last_peered":"2024-05-30T16:54:46.670868+0000","last_clean":"2024-05-30T16:54:46.670868+0000","last_became_active":"2024-05-30T16:54:46.661402+0000","last_became_peered":"2024-05-30T16:54:46.661402+0000","last_unstale":"2024-05-30T16:54:46.670868+0000","last_undegraded":"2024-05-30T16:54:46.670868+0000","last_fullsized":"2024-05-30T16:54:46.670868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:47.830462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.676122+0000","last_change":"2024-05-30T16:54:46.672351+0000","last_active":"2024-05-30T16:54:46.676122+0000","last_peered":"2024-05-30T16:54:46.676122+0000","last_clean":"2024-05-30T16:54:46.676122+0000","last_became_active":"2024-05-30T16:54:46.672097+0000","last_became_peered":"2024-05-30T16:54:46.672097+0000","last_unstale":"2024-05-30T16:54:46.676122+0000","last_undegraded":"2024-05-30T16:54:46.676122+0000","last_fullsized":"2024-05-30T16:54:46.676122+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:42.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675941+0000","last_change":"2024-05-30T16:54:46.669733+0000","last_active":"2024-05-30T16:54:46.675941+0000","last_peered":"2024-05-30T16:54:46.675941+0000","last_clean":"2024-05-30T16:54:46.675941+0000","last_became_active":"2024-05-30T16:54:46.666565+0000","last_became_peered":"2024-05-30T16:54:46.666565+0000","last_unstale":"2024-05-30T16:54:46.675941+0000","last_undegraded":"2024-05-30T16:54:46.675941+0000","last_fullsized":"2024-05-30T16:54:46.675941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:25.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668399+0000","last_change":"2024-05-30T16:54:46.665480+0000","last_active":"2024-05-30T16:54:46.668399+0000","last_peered":"2024-05-30T16:54:46.668399+0000","last_clean":"2024-05-30T16:54:46.668399+0000","last_became_active":"2024-05-30T16:54:46.665069+0000","last_became_peered":"2024-05-30T16:54:46.665069+0000","last_unstale":"2024-05-30T16:54:46.668399+0000","last_undegraded":"2024-05-30T16:54:46.668399+0000","last_fullsized":"2024-05-30T16:54:46.668399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:18.915849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664156+0000","last_change":"2024-05-30T16:54:46.657415+0000","last_active":"2024-05-30T16:54:46.664156+0000","last_peered":"2024-05-30T16:54:46.664156+0000","last_clean":"2024-05-30T16:54:46.664156+0000","last_became_active":"2024-05-30T16:54:46.655817+0000","last_became_peered":"2024-05-30T16:54:46.655817+0000","last_unstale":"2024-05-30T16:54:46.664156+0000","last_undegraded":"2024-05-30T16:54:46.664156+0000","last_fullsized":"2024-05-30T16:54:46.664156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:50:40.823158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.655382+0000","last_change":"2024-05-30T16:54:46.653603+0000","last_active":"2024-05-30T16:54:46.655382+0000","last_peered":"2024-05-30T16:54:46.655382+0000","last_clean":"2024-05-30T16:54:46.655382+0000","last_became_active":"2024-05-30T16:54:46.653302+0000","last_became_peered":"2024-05-30T16:54:46.653302+0000","last_unstale":"2024-05-30T16:54:46.655382+0000","last_undegraded":"2024-05-30T16:54:46.655382+0000","last_fullsized":"2024-05-30T16:54:46.655382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:57:14.688215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670838+0000","last_change":"2024-05-30T16:54:46.662800+0000","last_active":"2024-05-30T16:54:46.670838+0000","last_peered":"2024-05-30T16:54:46.670838+0000","last_clean":"2024-05-30T16:54:46.670838+0000","last_became_active":"2024-05-30T16:54:46.662524+0000","last_became_peered":"2024-05-30T16:54:46.662524+0000","last_unstale":"2024-05-30T16:54:46.670838+0000","last_undegraded":"2024-05-30T16:54:46.670838+0000","last_fullsized":"2024-05-30T16:54:46.670838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:05.577972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664583+0000","last_change":"2024-05-30T16:54:46.657592+0000","last_active":"2024-05-30T16:54:46.664583+0000","last_peered":"2024-05-30T16:54:46.664583+0000","last_clean":"2024-05-30T16:54:46.664583+0000","last_became_active":"2024-05-30T16:54:46.656008+0000","last_became_peered":"2024-05-30T16:54:46.656008+0000","last_unstale":"2024-05-30T16:54:46.664583+0000","last_undegraded":"2024-05-30T16:54:46.664583+0000","last_fullsized":"2024-05-30T16:54:46.664583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:05.577972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.646987+0000","last_change":"2024-05-30T16:54:45.646987+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.646987+0000","last_undegraded":"2024-05-30T16:54:45.646987+0000","last_fullsized":"2024-05-30T16:54:45.646987+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.673804+0000","last_change":"2024-05-30T16:54:46.669925+0000","last_active":"2024-05-30T16:54:46.673804+0000","last_peered":"2024-05-30T16:54:46.673804+0000","last_clean":"2024-05-30T16:54:46.673804+0000","last_became_active":"2024-05-30T16:54:46.669377+0000","last_became_peered":"2024-05-30T16:54:46.669377+0000","last_unstale":"2024-05-30T16:54:46.673804+0000","last_undegraded":"2024-05-30T16:54:46.673804+0000","last_fullsized":"2024-05-30T16:54:46.673804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:18.915849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.661945+0000","last_change":"2024-05-30T16:54:46.652970+0000","last_active":"2024-05-30T16:54:46.661945+0000","last_peered":"2024-05-30T16:54:46.661945+0000","last_clean":"2024-05-30T16:54:46.661945+0000","last_became_active":"2024-05-30T16:54:46.652703+0000","last_became_peered":"2024-05-30T16:54:46.652703+0000","last_unstale":"2024-05-30T16:54:46.661945+0000","last_undegraded":"2024-05-30T16:54:46.661945+0000","last_fullsized":"2024-05-30T16:54:46.661945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:05.374326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.645176+0000","last_change":"2024-05-30T16:54:45.645176+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.645176+0000","last_undegraded":"2024-05-30T16:54:45.645176+0000","last_fullsized":"2024-05-30T16:54:45.645176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663695+0000","last_change":"2024-05-30T16:54:46.659978+0000","last_active":"2024-05-30T16:54:46.663695+0000","last_peered":"2024-05-30T16:54:46.663695+0000","last_clean":"2024-05-30T16:54:46.663695+0000","last_became_active":"2024-05-30T16:54:46.659698+0000","last_became_peered":"2024-05-30T16:54:46.659698+0000","last_unstale":"2024-05-30T16:54:46.663695+0000","last_undegraded":"2024-05-30T16:54:46.663695+0000","last_fullsized":"2024-05-30T16:54:46.663695+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:53.545049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.642021+0000","last_change":"2024-05-30T16:54:45.642021+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.642021+0000","last_undegraded":"2024-05-30T16:54:45.642021+0000","last_fullsized":"2024-05-30T16:54:45.642021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670643+0000","last_change":"2024-05-30T16:54:46.666968+0000","last_active":"2024-05-30T16:54:46.670643+0000","last_peered":"2024-05-30T16:54:46.670643+0000","last_clean":"2024-05-30T16:54:46.670643+0000","last_became_active":"2024-05-30T16:54:46.666488+0000","last_became_peered":"2024-05-30T16:54:46.666488+0000","last_unstale":"2024-05-30T16:54:46.670643+0000","last_undegraded":"2024-05-30T16:54:46.670643+0000","last_fullsized":"2024-05-30T16:54:46.670643+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:32.939644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.657728+0000","last_change":"2024-05-30T16:54:46.656716+0000","last_active":"2024-05-30T16:54:46.657728+0000","last_peered":"2024-05-30T16:54:46.657728+0000","last_clean":"2024-05-30T16:54:46.657728+0000","last_became_active":"2024-05-30T16:54:46.656437+0000","last_became_peered":"2024-05-30T16:54:46.656437+0000","last_unstale":"2024-05-30T16:54:46.657728+0000","last_undegraded":"2024-05-30T16:54:46.657728+0000","last_fullsized":"2024-05-30T16:54:46.657728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:30.131348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675046+0000","last_change":"2024-05-30T16:54:46.669569+0000","last_active":"2024-05-30T16:54:46.675046+0000","last_peered":"2024-05-30T16:54:46.675046+0000","last_clean":"2024-05-30T16:54:46.675046+0000","last_became_active":"2024-05-30T16:54:46.669337+0000","last_became_peered":"2024-05-30T16:54:46.669337+0000","last_unstale":"2024-05-30T16:54:46.675046+0000","last_undegraded":"2024-05-30T16:54:46.675046+0000","last_fullsized":"2024-05-30T16:54:46.675046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:49:46.787342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.650983+0000","last_change":"2024-05-30T16:54:46.648131+0000","last_active":"2024-05-30T16:54:46.650983+0000","last_peered":"2024-05-30T16:54:46.650983+0000","last_clean":"2024-05-30T16:54:46.650983+0000","last_became_active":"2024-05-30T16:54:46.647835+0000","last_became_peered":"2024-05-30T16:54:46.647835+0000","last_unstale":"2024-05-30T16:54:46.650983+0000","last_undegraded":"2024-05-30T16:54:46.650983+0000","last_fullsized":"2024-05-30T16:54:46.650983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668308+0000","last_change":"2024-05-30T16:54:46.664412+0000","last_active":"2024-05-30T16:54:46.668308+0000","last_peered":"2024-05-30T16:54:46.668308+0000","last_clean":"2024-05-30T16:54:46.668308+0000","last_became_active":"2024-05-30T16:54:46.664116+0000","last_became_peered":"2024-05-30T16:54:46.664116+0000","last_unstale":"2024-05-30T16:54:46.668308+0000","last_undegraded":"2024-05-30T16:54:46.668308+0000","last_fullsized":"2024-05-30T16:54:46.668308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:18.915849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670559+0000","last_change":"2024-05-30T16:54:46.665560+0000","last_active":"2024-05-30T16:54:46.670559+0000","last_peered":"2024-05-30T16:54:46.670559+0000","last_clean":"2024-05-30T16:54:46.670559+0000","last_became_active":"2024-05-30T16:54:46.665248+0000","last_became_peered":"2024-05-30T16:54:46.665248+0000","last_unstale":"2024-05-30T16:54:46.670559+0000","last_undegraded":"2024-05-30T16:54:46.670559+0000","last_fullsized":"2024-05-30T16:54:46.670559+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:05:21.158010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.645874+0000","last_change":"2024-05-30T16:54:45.645874+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.645874+0000","last_undegraded":"2024-05-30T16:54:45.645874+0000","last_fullsized":"2024-05-30T16:54:45.645874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664509+0000","last_change":"2024-05-30T16:54:46.658606+0000","last_active":"2024-05-30T16:54:46.664509+0000","last_peered":"2024-05-30T16:54:46.664509+0000","last_clean":"2024-05-30T16:54:46.664509+0000","last_became_active":"2024-05-30T16:54:46.658313+0000","last_became_peered":"2024-05-30T16:54:46.658313+0000","last_unstale":"2024-05-30T16:54:46.664509+0000","last_undegraded":"2024-05-30T16:54:46.664509+0000","last_fullsized":"2024-05-30T16:54:46.664509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:35.259565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671340+0000","last_change":"2024-05-30T16:54:46.664673+0000","last_active":"2024-05-30T16:54:46.671340+0000","last_peered":"2024-05-30T16:54:46.671340+0000","last_clean":"2024-05-30T16:54:46.671340+0000","last_became_active":"2024-05-30T16:54:46.664411+0000","last_became_peered":"2024-05-30T16:54:46.664411+0000","last_unstale":"2024-05-30T16:54:46.671340+0000","last_undegraded":"2024-05-30T16:54:46.671340+0000","last_fullsized":"2024-05-30T16:54:46.671340+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:37.399050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.667166+0000","last_change":"2024-05-30T16:54:46.661133+0000","last_active":"2024-05-30T16:54:46.667166+0000","last_peered":"2024-05-30T16:54:46.667166+0000","last_clean":"2024-05-30T16:54:46.667166+0000","last_became_active":"2024-05-30T16:54:46.660444+0000","last_became_peered":"2024-05-30T16:54:46.660444+0000","last_unstale":"2024-05-30T16:54:46.667166+0000","last_undegraded":"2024-05-30T16:54:46.667166+0000","last_fullsized":"2024-05-30T16:54:46.667166+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:53.545049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668209+0000","last_change":"2024-05-30T16:54:46.662959+0000","last_active":"2024-05-30T16:54:46.668209+0000","last_peered":"2024-05-30T16:54:46.668209+0000","last_clean":"2024-05-30T16:54:46.668209+0000","last_became_active":"2024-05-30T16:54:46.662617+0000","last_became_peered":"2024-05-30T16:54:46.662617+0000","last_unstale":"2024-05-30T16:54:46.668209+0000","last_undegraded":"2024-05-30T16:54:46.668209+0000","last_fullsized":"2024-05-30T16:54:46.668209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.674431+0000","last_change":"2024-05-30T16:54:45.647654+0000","last_active":"2024-05-30T16:54:46.674431+0000","last_peered":"2024-05-30T16:54:46.674431+0000","last_clean":"2024-05-30T16:54:46.674431+0000","last_became_active":"2024-05-30T16:54:45.647348+0000","last_became_peered":"2024-05-30T16:54:45.647348+0000","last_unstale":"2024-05-30T16:54:46.674431+0000","last_undegraded":"2024-05-30T16:54:46.674431+0000","last_fullsized":"2024-05-30T16:54:46.674431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:42.667446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671009+0000","last_change":"2024-05-30T16:54:46.665719+0000","last_active":"2024-05-30T16:54:46.671009+0000","last_peered":"2024-05-30T16:54:46.671009+0000","last_clean":"2024-05-30T16:54:46.671009+0000","last_became_active":"2024-05-30T16:54:46.665454+0000","last_became_peered":"2024-05-30T16:54:46.665454+0000","last_unstale":"2024-05-30T16:54:46.671009+0000","last_undegraded":"2024-05-30T16:54:46.671009+0000","last_fullsized":"2024-05-30T16:54:46.671009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:29:51.209287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.662480+0000","last_change":"2024-05-30T16:54:45.661521+0000","last_active":"2024-05-30T16:54:45.662480+0000","last_peered":"2024-05-30T16:54:45.662480+0000","last_clean":"2024-05-30T16:54:45.662480+0000","last_became_active":"2024-05-30T16:54:45.660638+0000","last_became_peered":"2024-05-30T16:54:45.660638+0000","last_unstale":"2024-05-30T16:54:45.662480+0000","last_undegraded":"2024-05-30T16:54:45.662480+0000","last_fullsized":"2024-05-30T16:54:45.662480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:41:10.905828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671960+0000","last_change":"2024-05-30T16:54:46.667652+0000","last_active":"2024-05-30T16:54:46.671960+0000","last_peered":"2024-05-30T16:54:46.671960+0000","last_clean":"2024-05-30T16:54:46.671960+0000","last_became_active":"2024-05-30T16:54:46.667421+0000","last_became_peered":"2024-05-30T16:54:46.667421+0000","last_unstale":"2024-05-30T16:54:46.671960+0000","last_undegraded":"2024-05-30T16:54:46.671960+0000","last_fullsized":"2024-05-30T16:54:46.671960+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:03.419391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.672100+0000","last_change":"2024-05-30T16:54:45.648517+0000","last_active":"2024-05-30T16:54:46.672100+0000","last_peered":"2024-05-30T16:54:46.672100+0000","last_clean":"2024-05-30T16:54:46.672100+0000","last_became_active":"2024-05-30T16:54:45.647977+0000","last_became_peered":"2024-05-30T16:54:45.647977+0000","last_unstale":"2024-05-30T16:54:46.672100+0000","last_undegraded":"2024-05-30T16:54:46.672100+0000","last_fullsized":"2024-05-30T16:54:46.672100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670659+0000","last_change":"2024-05-30T16:54:46.666945+0000","last_active":"2024-05-30T16:54:46.670659+0000","last_peered":"2024-05-30T16:54:46.670659+0000","last_clean":"2024-05-30T16:54:46.670659+0000","last_became_active":"2024-05-30T16:54:46.666678+0000","last_became_peered":"2024-05-30T16:54:46.666678+0000","last_unstale":"2024-05-30T16:54:46.670659+0000","last_undegraded":"2024-05-30T16:54:46.670659+0000","last_fullsized":"2024-05-30T16:54:46.670659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:37.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.669908+0000","last_change":"2024-05-30T16:54:45.655293+0000","last_active":"2024-05-30T16:54:46.669908+0000","last_peered":"2024-05-30T16:54:46.669908+0000","last_clean":"2024-05-30T16:54:46.669908+0000","last_became_active":"2024-05-30T16:54:45.652639+0000","last_became_peered":"2024-05-30T16:54:45.652639+0000","last_unstale":"2024-05-30T16:54:46.669908+0000","last_undegraded":"2024-05-30T16:54:46.669908+0000","last_fullsized":"2024-05-30T16:54:46.669908+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:26.354745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.643013+0000","last_change":"2024-05-30T16:54:45.643013+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.643013+0000","last_undegraded":"2024-05-30T16:54:45.643013+0000","last_fullsized":"2024-05-30T16:54:45.643013+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663460+0000","last_change":"2024-05-30T16:54:45.649596+0000","last_active":"2024-05-30T16:54:46.663460+0000","last_peered":"2024-05-30T16:54:46.663460+0000","last_clean":"2024-05-30T16:54:46.663460+0000","last_became_active":"2024-05-30T16:54:45.649230+0000","last_became_peered":"2024-05-30T16:54:45.649230+0000","last_unstale":"2024-05-30T16:54:46.663460+0000","last_undegraded":"2024-05-30T16:54:46.663460+0000","last_fullsized":"2024-05-30T16:54:46.663460+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:28:17.157569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.646670+0000","last_change":"2024-05-30T16:54:45.646670+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.646670+0000","last_undegraded":"2024-05-30T16:54:45.646670+0000","last_fullsized":"2024-05-30T16:54:45.646670+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666789+0000","last_change":"2024-05-30T16:54:45.653322+0000","last_active":"2024-05-30T16:54:46.666789+0000","last_peered":"2024-05-30T16:54:46.666789+0000","last_clean":"2024-05-30T16:54:46.666789+0000","last_became_active":"2024-05-30T16:54:45.653039+0000","last_became_peered":"2024-05-30T16:54:45.653039+0000","last_unstale":"2024-05-30T16:54:46.666789+0000","last_undegraded":"2024-05-30T16:54:46.666789+0000","last_fullsized":"2024-05-30T16:54:46.666789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:46.827065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666643+0000","last_change":"2024-05-30T16:54:46.664566+0000","last_active":"2024-05-30T16:54:46.666643+0000","last_peered":"2024-05-30T16:54:46.666643+0000","last_clean":"2024-05-30T16:54:46.666643+0000","last_became_active":"2024-05-30T16:54:46.664293+0000","last_became_peered":"2024-05-30T16:54:46.664293+0000","last_unstale":"2024-05-30T16:54:46.666643+0000","last_undegraded":"2024-05-30T16:54:46.666643+0000","last_fullsized":"2024-05-30T16:54:46.666643+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:12.383279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.642607+0000","last_change":"2024-05-30T16:54:45.649519+0000","last_active":"2024-05-30T16:54:46.642607+0000","last_peered":"2024-05-30T16:54:46.642607+0000","last_clean":"2024-05-30T16:54:46.642607+0000","last_became_active":"2024-05-30T16:54:45.649210+0000","last_became_peered":"2024-05-30T16:54:45.649210+0000","last_unstale":"2024-05-30T16:54:46.642607+0000","last_undegraded":"2024-05-30T16:54:46.642607+0000","last_fullsized":"2024-05-30T16:54:46.642607+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:04.574576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.650395+0000","last_change":"2024-05-30T16:54:45.650395+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.650395+0000","last_undegraded":"2024-05-30T16:54:45.650395+0000","last_fullsized":"2024-05-30T16:54:45.650395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.643656+0000","last_change":"2024-05-30T16:54:45.657461+0000","last_active":"2024-05-30T16:54:46.643656+0000","last_peered":"2024-05-30T16:54:46.643656+0000","last_clean":"2024-05-30T16:54:46.643656+0000","last_became_active":"2024-05-30T16:54:45.657185+0000","last_became_peered":"2024-05-30T16:54:45.657185+0000","last_unstale":"2024-05-30T16:54:46.643656+0000","last_undegraded":"2024-05-30T16:54:46.643656+0000","last_fullsized":"2024-05-30T16:54:46.643656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:01.690937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.673829+0000","last_change":"2024-05-30T16:54:46.672121+0000","last_active":"2024-05-30T16:54:46.673829+0000","last_peered":"2024-05-30T16:54:46.673829+0000","last_clean":"2024-05-30T16:54:46.673829+0000","last_became_active":"2024-05-30T16:54:46.671781+0000","last_became_peered":"2024-05-30T16:54:46.671781+0000","last_unstale":"2024-05-30T16:54:46.673829+0000","last_undegraded":"2024-05-30T16:54:46.673829+0000","last_fullsized":"2024-05-30T16:54:46.673829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:35.848386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.652601+0000","last_change":"2024-05-30T16:54:45.658364+0000","last_active":"2024-05-30T16:54:46.652601+0000","last_peered":"2024-05-30T16:54:46.652601+0000","last_clean":"2024-05-30T16:54:46.652601+0000","last_became_active":"2024-05-30T16:54:45.658015+0000","last_became_peered":"2024-05-30T16:54:45.658015+0000","last_unstale":"2024-05-30T16:54:46.652601+0000","last_undegraded":"2024-05-30T16:54:46.652601+0000","last_fullsized":"2024-05-30T16:54:46.652601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:04.574576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.676193+0000","last_change":"2024-05-30T16:54:46.673850+0000","last_active":"2024-05-30T16:54:46.676193+0000","last_peered":"2024-05-30T16:54:46.676193+0000","last_clean":"2024-05-30T16:54:46.676193+0000","last_became_active":"2024-05-30T16:54:46.673493+0000","last_became_peered":"2024-05-30T16:54:46.673493+0000","last_unstale":"2024-05-30T16:54:46.676193+0000","last_undegraded":"2024-05-30T16:54:46.676193+0000","last_fullsized":"2024-05-30T16:54:46.676193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:03.419391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.661693+0000","last_change":"2024-05-30T16:54:45.655634+0000","last_active":"2024-05-30T16:54:45.661693+0000","last_peered":"2024-05-30T16:54:45.661693+0000","last_clean":"2024-05-30T16:54:45.661693+0000","last_became_active":"2024-05-30T16:54:45.655296+0000","last_became_peered":"2024-05-30T16:54:45.655296+0000","last_unstale":"2024-05-30T16:54:45.661693+0000","last_undegraded":"2024-05-30T16:54:45.661693+0000","last_fullsized":"2024-05-30T16:54:45.661693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:17:37.296238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670966+0000","last_change":"2024-05-30T16:54:46.665621+0000","last_active":"2024-05-30T16:54:46.670966+0000","last_peered":"2024-05-30T16:54:46.670966+0000","last_clean":"2024-05-30T16:54:46.670966+0000","last_became_active":"2024-05-30T16:54:46.665034+0000","last_became_peered":"2024-05-30T16:54:46.665034+0000","last_unstale":"2024-05-30T16:54:46.670966+0000","last_undegraded":"2024-05-30T16:54:46.670966+0000","last_fullsized":"2024-05-30T16:54:46.670966+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:18.243815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.677071+0000","last_change":"2024-05-30T16:54:45.661725+0000","last_active":"2024-05-30T16:54:46.677071+0000","last_peered":"2024-05-30T16:54:46.677071+0000","last_clean":"2024-05-30T16:54:46.677071+0000","last_became_active":"2024-05-30T16:54:45.661411+0000","last_became_peered":"2024-05-30T16:54:45.661411+0000","last_unstale":"2024-05-30T16:54:46.677071+0000","last_undegraded":"2024-05-30T16:54:46.677071+0000","last_fullsized":"2024-05-30T16:54:46.677071+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675745+0000","last_change":"2024-05-30T16:54:46.672644+0000","last_active":"2024-05-30T16:54:46.675745+0000","last_peered":"2024-05-30T16:54:46.675745+0000","last_clean":"2024-05-30T16:54:46.675745+0000","last_became_active":"2024-05-30T16:54:46.672183+0000","last_became_peered":"2024-05-30T16:54:46.672183+0000","last_unstale":"2024-05-30T16:54:46.675745+0000","last_undegraded":"2024-05-30T16:54:46.675745+0000","last_fullsized":"2024-05-30T16:54:46.675745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:37.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675700+0000","last_change":"2024-05-30T16:54:45.645709+0000","last_active":"2024-05-30T16:54:46.675700+0000","last_peered":"2024-05-30T16:54:46.675700+0000","last_clean":"2024-05-30T16:54:46.675700+0000","last_became_active":"2024-05-30T16:54:45.644794+0000","last_became_peered":"2024-05-30T16:54:45.644794+0000","last_unstale":"2024-05-30T16:54:46.675700+0000","last_undegraded":"2024-05-30T16:54:46.675700+0000","last_fullsized":"2024-05-30T16:54:46.675700+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:37.221162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670171+0000","last_change":"2024-05-30T16:54:46.666387+0000","last_active":"2024-05-30T16:54:46.670171+0000","last_peered":"2024-05-30T16:54:46.670171+0000","last_clean":"2024-05-30T16:54:46.670171+0000","last_became_active":"2024-05-30T16:54:46.666160+0000","last_became_peered":"2024-05-30T16:54:46.666160+0000","last_unstale":"2024-05-30T16:54:46.670171+0000","last_undegraded":"2024-05-30T16:54:46.670171+0000","last_fullsized":"2024-05-30T16:54:46.670171+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:49:29.390734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.662205+0000","last_change":"2024-05-30T16:54:45.660979+0000","last_active":"2024-05-30T16:54:45.662205+0000","last_peered":"2024-05-30T16:54:45.662205+0000","last_clean":"2024-05-30T16:54:45.662205+0000","last_became_active":"2024-05-30T16:54:45.660628+0000","last_became_peered":"2024-05-30T16:54:45.660628+0000","last_unstale":"2024-05-30T16:54:45.662205+0000","last_undegraded":"2024-05-30T16:54:45.662205+0000","last_fullsized":"2024-05-30T16:54:45.662205+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:21:25.478498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.673884+0000","last_change":"2024-05-30T16:54:46.669298+0000","last_active":"2024-05-30T16:54:46.673884+0000","last_peered":"2024-05-30T16:54:46.673884+0000","last_clean":"2024-05-30T16:54:46.673884+0000","last_became_active":"2024-05-30T16:54:46.669004+0000","last_became_peered":"2024-05-30T16:54:46.669004+0000","last_unstale":"2024-05-30T16:54:46.673884+0000","last_undegraded":"2024-05-30T16:54:46.673884+0000","last_fullsized":"2024-05-30T16:54:46.673884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:43.670842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.644949+0000","last_change":"2024-05-30T16:54:45.657137+0000","last_active":"2024-05-30T16:54:46.644949+0000","last_peered":"2024-05-30T16:54:46.644949+0000","last_clean":"2024-05-30T16:54:46.644949+0000","last_became_active":"2024-05-30T16:54:45.656852+0000","last_became_peered":"2024-05-30T16:54:45.656852+0000","last_unstale":"2024-05-30T16:54:46.644949+0000","last_undegraded":"2024-05-30T16:54:46.644949+0000","last_fullsized":"2024-05-30T16:54:46.644949+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:30:37.379158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663572+0000","last_change":"2024-05-30T16:54:46.659555+0000","last_active":"2024-05-30T16:54:46.663572+0000","last_peered":"2024-05-30T16:54:46.663572+0000","last_clean":"2024-05-30T16:54:46.663572+0000","last_became_active":"2024-05-30T16:54:46.659213+0000","last_became_peered":"2024-05-30T16:54:46.659213+0000","last_unstale":"2024-05-30T16:54:46.663572+0000","last_undegraded":"2024-05-30T16:54:46.663572+0000","last_fullsized":"2024-05-30T16:54:46.663572+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:01.137841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.642813+0000","last_change":"2024-05-30T16:54:45.658679+0000","last_active":"2024-05-30T16:54:46.642813+0000","last_peered":"2024-05-30T16:54:46.642813+0000","last_clean":"2024-05-30T16:54:46.642813+0000","last_became_active":"2024-05-30T16:54:45.658329+0000","last_became_peered":"2024-05-30T16:54:45.658329+0000","last_unstale":"2024-05-30T16:54:46.642813+0000","last_undegraded":"2024-05-30T16:54:46.642813+0000","last_fullsized":"2024-05-30T16:54:46.642813+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:48.442480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670623+0000","last_change":"2024-05-30T16:54:46.666749+0000","last_active":"2024-05-30T16:54:46.670623+0000","last_peered":"2024-05-30T16:54:46.670623+0000","last_clean":"2024-05-30T16:54:46.670623+0000","last_became_active":"2024-05-30T16:54:46.665986+0000","last_became_peered":"2024-05-30T16:54:46.665986+0000","last_unstale":"2024-05-30T16:54:46.670623+0000","last_undegraded":"2024-05-30T16:54:46.670623+0000","last_fullsized":"2024-05-30T16:54:46.670623+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:26.161079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675768+0000","last_change":"2024-05-30T16:54:45.660854+0000","last_active":"2024-05-30T16:54:46.675768+0000","last_peered":"2024-05-30T16:54:46.675768+0000","last_clean":"2024-05-30T16:54:46.675768+0000","last_became_active":"2024-05-30T16:54:45.660575+0000","last_became_peered":"2024-05-30T16:54:45.660575+0000","last_unstale":"2024-05-30T16:54:46.675768+0000","last_undegraded":"2024-05-30T16:54:46.675768+0000","last_fullsized":"2024-05-30T16:54:46.675768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:46.827065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663814+0000","last_change":"2024-05-30T16:54:46.660412+0000","last_active":"2024-05-30T16:54:46.663814+0000","last_peered":"2024-05-30T16:54:46.663814+0000","last_clean":"2024-05-30T16:54:46.663814+0000","last_became_active":"2024-05-30T16:54:46.660132+0000","last_became_peered":"2024-05-30T16:54:46.660132+0000","last_unstale":"2024-05-30T16:54:46.663814+0000","last_undegraded":"2024-05-30T16:54:46.663814+0000","last_fullsized":"2024-05-30T16:54:46.663814+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:27.358141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.661017+0000","last_change":"2024-05-30T16:54:45.658736+0000","last_active":"2024-05-30T16:54:45.661017+0000","last_peered":"2024-05-30T16:54:45.661017+0000","last_clean":"2024-05-30T16:54:45.661017+0000","last_became_active":"2024-05-30T16:54:45.658382+0000","last_became_peered":"2024-05-30T16:54:45.658382+0000","last_unstale":"2024-05-30T16:54:45.661017+0000","last_undegraded":"2024-05-30T16:54:45.661017+0000","last_fullsized":"2024-05-30T16:54:45.661017+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:33.856990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.674113+0000","last_change":"2024-05-30T16:54:46.668478+0000","last_active":"2024-05-30T16:54:46.674113+0000","last_peered":"2024-05-30T16:54:46.674113+0000","last_clean":"2024-05-30T16:54:46.674113+0000","last_became_active":"2024-05-30T16:54:46.668127+0000","last_became_peered":"2024-05-30T16:54:46.668127+0000","last_unstale":"2024-05-30T16:54:46.674113+0000","last_undegraded":"2024-05-30T16:54:46.674113+0000","last_fullsized":"2024-05-30T16:54:46.674113+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:03.419391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675376+0000","last_change":"2024-05-30T16:54:45.651393+0000","last_active":"2024-05-30T16:54:46.675376+0000","last_peered":"2024-05-30T16:54:46.675376+0000","last_clean":"2024-05-30T16:54:46.675376+0000","last_became_active":"2024-05-30T16:54:45.650980+0000","last_became_peered":"2024-05-30T16:54:45.650980+0000","last_unstale":"2024-05-30T16:54:46.675376+0000","last_undegraded":"2024-05-30T16:54:46.675376+0000","last_fullsized":"2024-05-30T16:54:46.675376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:25.157682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.644782+0000","last_change":"2024-05-30T16:54:45.644782+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.644782+0000","last_undegraded":"2024-05-30T16:54:45.644782+0000","last_fullsized":"2024-05-30T16:54:45.644782+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670736+0000","last_change":"2024-05-30T16:54:45.655629+0000","last_active":"2024-05-30T16:54:46.670736+0000","last_peered":"2024-05-30T16:54:46.670736+0000","last_clean":"2024-05-30T16:54:46.670736+0000","last_became_active":"2024-05-30T16:54:45.655351+0000","last_became_peered":"2024-05-30T16:54:45.655351+0000","last_unstale":"2024-05-30T16:54:46.670736+0000","last_undegraded":"2024-05-30T16:54:46.670736+0000","last_fullsized":"2024-05-30T16:54:46.670736+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:34.256169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675732+0000","last_change":"2024-05-30T16:54:46.672424+0000","last_active":"2024-05-30T16:54:46.675732+0000","last_peered":"2024-05-30T16:54:46.675732+0000","last_clean":"2024-05-30T16:54:46.675732+0000","last_became_active":"2024-05-30T16:54:46.671842+0000","last_became_peered":"2024-05-30T16:54:46.671842+0000","last_unstale":"2024-05-30T16:54:46.675732+0000","last_undegraded":"2024-05-30T16:54:46.675732+0000","last_fullsized":"2024-05-30T16:54:46.675732+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:49:29.390734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.660180+0000","last_change":"2024-05-30T16:54:45.656675+0000","last_active":"2024-05-30T16:54:46.660180+0000","last_peered":"2024-05-30T16:54:46.660180+0000","last_clean":"2024-05-30T16:54:46.660180+0000","last_became_active":"2024-05-30T16:54:45.656400+0000","last_became_peered":"2024-05-30T16:54:45.656400+0000","last_unstale":"2024-05-30T16:54:46.660180+0000","last_undegraded":"2024-05-30T16:54:46.660180+0000","last_fullsized":"2024-05-30T16:54:46.660180+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:48.442480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.672601+0000","last_change":"2024-05-30T16:54:46.667135+0000","last_active":"2024-05-30T16:54:46.672601+0000","last_peered":"2024-05-30T16:54:46.672601+0000","last_clean":"2024-05-30T16:54:46.672601+0000","last_became_active":"2024-05-30T16:54:46.666764+0000","last_became_peered":"2024-05-30T16:54:46.666764+0000","last_unstale":"2024-05-30T16:54:46.672601+0000","last_undegraded":"2024-05-30T16:54:46.672601+0000","last_fullsized":"2024-05-30T16:54:46.672601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:37.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.660884+0000","last_change":"2024-05-30T16:54:45.655577+0000","last_active":"2024-05-30T16:54:45.660884+0000","last_peered":"2024-05-30T16:54:45.660884+0000","last_clean":"2024-05-30T16:54:45.660884+0000","last_became_active":"2024-05-30T16:54:45.655197+0000","last_became_peered":"2024-05-30T16:54:45.655197+0000","last_unstale":"2024-05-30T16:54:45.660884+0000","last_undegraded":"2024-05-30T16:54:45.660884+0000","last_fullsized":"2024-05-30T16:54:45.660884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:52:20.023991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664248+0000","last_change":"2024-05-30T16:54:46.655167+0000","last_active":"2024-05-30T16:54:46.664248+0000","last_peered":"2024-05-30T16:54:46.664248+0000","last_clean":"2024-05-30T16:54:46.664248+0000","last_became_active":"2024-05-30T16:54:46.654866+0000","last_became_peered":"2024-05-30T16:54:46.654866+0000","last_unstale":"2024-05-30T16:54:46.664248+0000","last_undegraded":"2024-05-30T16:54:46.664248+0000","last_fullsized":"2024-05-30T16:54:46.664248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:01.137841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.661131+0000","last_change":"2024-05-30T16:54:45.647369+0000","last_active":"2024-05-30T16:54:46.661131+0000","last_peered":"2024-05-30T16:54:46.661131+0000","last_clean":"2024-05-30T16:54:46.661131+0000","last_became_active":"2024-05-30T16:54:45.647108+0000","last_became_peered":"2024-05-30T16:54:45.647108+0000","last_unstale":"2024-05-30T16:54:46.661131+0000","last_undegraded":"2024-05-30T16:54:46.661131+0000","last_fullsized":"2024-05-30T16:54:46.661131+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:20:36.722964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668263+0000","last_change":"2024-05-30T16:54:46.662209+0000","last_active":"2024-05-30T16:54:46.668263+0000","last_peered":"2024-05-30T16:54:46.668263+0000","last_clean":"2024-05-30T16:54:46.668263+0000","last_became_active":"2024-05-30T16:54:46.661882+0000","last_became_peered":"2024-05-30T16:54:46.661882+0000","last_unstale":"2024-05-30T16:54:46.668263+0000","last_undegraded":"2024-05-30T16:54:46.668263+0000","last_fullsized":"2024-05-30T16:54:46.668263+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:27.358141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.642644+0000","last_change":"2024-05-30T16:54:45.657812+0000","last_active":"2024-05-30T16:54:46.642644+0000","last_peered":"2024-05-30T16:54:46.642644+0000","last_clean":"2024-05-30T16:54:46.642644+0000","last_became_active":"2024-05-30T16:54:45.656848+0000","last_became_peered":"2024-05-30T16:54:45.656848+0000","last_unstale":"2024-05-30T16:54:46.642644+0000","last_undegraded":"2024-05-30T16:54:46.642644+0000","last_fullsized":"2024-05-30T16:54:46.642644+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.658294+0000","last_change":"2024-05-30T16:54:46.654546+0000","last_active":"2024-05-30T16:54:46.658294+0000","last_peered":"2024-05-30T16:54:46.658294+0000","last_clean":"2024-05-30T16:54:46.658294+0000","last_became_active":"2024-05-30T16:54:46.653161+0000","last_became_peered":"2024-05-30T16:54:46.653161+0000","last_unstale":"2024-05-30T16:54:46.658294+0000","last_undegraded":"2024-05-30T16:54:46.658294+0000","last_fullsized":"2024-05-30T16:54:46.658294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:26.161079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.676208+0000","last_change":"2024-05-30T16:54:45.658652+0000","last_active":"2024-05-30T16:54:46.676208+0000","last_peered":"2024-05-30T16:54:46.676208+0000","last_clean":"2024-05-30T16:54:46.676208+0000","last_became_active":"2024-05-30T16:54:45.658367+0000","last_became_peered":"2024-05-30T16:54:45.658367+0000","last_unstale":"2024-05-30T16:54:46.676208+0000","last_undegraded":"2024-05-30T16:54:46.676208+0000","last_fullsized":"2024-05-30T16:54:46.676208+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:30:37.379158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666735+0000","last_change":"2024-05-30T16:54:46.662119+0000","last_active":"2024-05-30T16:54:46.666735+0000","last_peered":"2024-05-30T16:54:46.666735+0000","last_clean":"2024-05-30T16:54:46.666735+0000","last_became_active":"2024-05-30T16:54:46.661785+0000","last_became_peered":"2024-05-30T16:54:46.661785+0000","last_unstale":"2024-05-30T16:54:46.666735+0000","last_undegraded":"2024-05-30T16:54:46.666735+0000","last_fullsized":"2024-05-30T16:54:46.666735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:32.939644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663723+0000","last_change":"2024-05-30T16:54:45.653028+0000","last_active":"2024-05-30T16:54:46.663723+0000","last_peered":"2024-05-30T16:54:46.663723+0000","last_clean":"2024-05-30T16:54:46.663723+0000","last_became_active":"2024-05-30T16:54:45.652710+0000","last_became_peered":"2024-05-30T16:54:45.652710+0000","last_unstale":"2024-05-30T16:54:46.663723+0000","last_undegraded":"2024-05-30T16:54:46.663723+0000","last_fullsized":"2024-05-30T16:54:46.663723+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:31.936247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670882+0000","last_change":"2024-05-30T16:54:46.665362+0000","last_active":"2024-05-30T16:54:46.670882+0000","last_peered":"2024-05-30T16:54:46.670882+0000","last_clean":"2024-05-30T16:54:46.670882+0000","last_became_active":"2024-05-30T16:54:46.664731+0000","last_became_peered":"2024-05-30T16:54:46.664731+0000","last_unstale":"2024-05-30T16:54:46.670882+0000","last_undegraded":"2024-05-30T16:54:46.670882+0000","last_fullsized":"2024-05-30T16:54:46.670882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:59.959822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.645071+0000","last_change":"2024-05-30T16:54:45.653794+0000","last_active":"2024-05-30T16:54:46.645071+0000","last_peered":"2024-05-30T16:54:46.645071+0000","last_clean":"2024-05-30T16:54:46.645071+0000","last_became_active":"2024-05-30T16:54:45.652243+0000","last_became_peered":"2024-05-30T16:54:45.652243+0000","last_unstale":"2024-05-30T16:54:46.645071+0000","last_undegraded":"2024-05-30T16:54:46.645071+0000","last_fullsized":"2024-05-30T16:54:46.645071+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:41.075478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666830+0000","last_change":"2024-05-30T16:54:46.659899+0000","last_active":"2024-05-30T16:54:46.666830+0000","last_peered":"2024-05-30T16:54:46.666830+0000","last_clean":"2024-05-30T16:54:46.666830+0000","last_became_active":"2024-05-30T16:54:46.658860+0000","last_became_peered":"2024-05-30T16:54:46.658860+0000","last_unstale":"2024-05-30T16:54:46.666830+0000","last_undegraded":"2024-05-30T16:54:46.666830+0000","last_fullsized":"2024-05-30T16:54:46.666830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:35.259565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.644190+0000","last_change":"2024-05-30T16:54:45.652157+0000","last_active":"2024-05-30T16:54:46.644190+0000","last_peered":"2024-05-30T16:54:46.644190+0000","last_clean":"2024-05-30T16:54:46.644190+0000","last_became_active":"2024-05-30T16:54:45.651109+0000","last_became_peered":"2024-05-30T16:54:45.651109+0000","last_unstale":"2024-05-30T16:54:46.644190+0000","last_undegraded":"2024-05-30T16:54:46.644190+0000","last_fullsized":"2024-05-30T16:54:46.644190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:52.541652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.642572+0000","last_change":"2024-05-30T16:54:45.642572+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.642572+0000","last_undegraded":"2024-05-30T16:54:45.642572+0000","last_fullsized":"2024-05-30T16:54:45.642572+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.660933+0000","last_change":"2024-05-30T16:54:45.650576+0000","last_active":"2024-05-30T16:54:46.660933+0000","last_peered":"2024-05-30T16:54:46.660933+0000","last_clean":"2024-05-30T16:54:46.660933+0000","last_became_active":"2024-05-30T16:54:45.650316+0000","last_became_peered":"2024-05-30T16:54:45.650316+0000","last_unstale":"2024-05-30T16:54:46.660933+0000","last_undegraded":"2024-05-30T16:54:46.660933+0000","last_fullsized":"2024-05-30T16:54:46.660933+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:32:02.321051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663762+0000","last_change":"2024-05-30T16:54:46.660833+0000","last_active":"2024-05-30T16:54:46.663762+0000","last_peered":"2024-05-30T16:54:46.663762+0000","last_clean":"2024-05-30T16:54:46.663762+0000","last_became_active":"2024-05-30T16:54:46.660017+0000","last_became_peered":"2024-05-30T16:54:46.660017+0000","last_unstale":"2024-05-30T16:54:46.663762+0000","last_undegraded":"2024-05-30T16:54:46.663762+0000","last_fullsized":"2024-05-30T16:54:46.663762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.644778+0000","last_change":"2024-05-30T16:54:45.645109+0000","last_active":"2024-05-30T16:54:46.644778+0000","last_peered":"2024-05-30T16:54:46.644778+0000","last_clean":"2024-05-30T16:54:46.644778+0000","last_became_active":"2024-05-30T16:54:45.644753+0000","last_became_peered":"2024-05-30T16:54:45.644753+0000","last_unstale":"2024-05-30T16:54:46.644778+0000","last_undegraded":"2024-05-30T16:54:46.644778+0000","last_fullsized":"2024-05-30T16:54:46.644778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:57:37.286999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670848+0000","last_change":"2024-05-30T16:54:46.659487+0000","last_active":"2024-05-30T16:54:46.670848+0000","last_peered":"2024-05-30T16:54:46.670848+0000","last_clean":"2024-05-30T16:54:46.670848+0000","last_became_active":"2024-05-30T16:54:46.659243+0000","last_became_peered":"2024-05-30T16:54:46.659243+0000","last_unstale":"2024-05-30T16:54:46.670848+0000","last_undegraded":"2024-05-30T16:54:46.670848+0000","last_fullsized":"2024-05-30T16:54:46.670848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:33.056889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.660879+0000","last_change":"2024-05-30T16:54:45.654729+0000","last_active":"2024-05-30T16:54:46.660879+0000","last_peered":"2024-05-30T16:54:46.660879+0000","last_clean":"2024-05-30T16:54:46.660879+0000","last_became_active":"2024-05-30T16:54:45.654447+0000","last_became_peered":"2024-05-30T16:54:45.654447+0000","last_unstale":"2024-05-30T16:54:46.660879+0000","last_undegraded":"2024-05-30T16:54:46.660879+0000","last_fullsized":"2024-05-30T16:54:46.660879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:28.492293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.649949+0000","last_change":"2024-05-30T16:54:45.649949+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.649949+0000","last_undegraded":"2024-05-30T16:54:45.649949+0000","last_fullsized":"2024-05-30T16:54:45.649949+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.660891+0000","last_change":"2024-05-30T16:54:45.655443+0000","last_active":"2024-05-30T16:54:45.660891+0000","last_peered":"2024-05-30T16:54:45.660891+0000","last_clean":"2024-05-30T16:54:45.660891+0000","last_became_active":"2024-05-30T16:54:45.655068+0000","last_became_peered":"2024-05-30T16:54:45.655068+0000","last_unstale":"2024-05-30T16:54:45.660891+0000","last_undegraded":"2024-05-30T16:54:45.660891+0000","last_fullsized":"2024-05-30T16:54:45.660891+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:43:52.793573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.649866+0000","last_change":"2024-05-30T16:54:45.649866+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.649866+0000","last_undegraded":"2024-05-30T16:54:45.649866+0000","last_fullsized":"2024-05-30T16:54:45.649866+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.647166+0000","last_change":"2024-05-30T16:54:45.654457+0000","last_active":"2024-05-30T16:54:46.647166+0000","last_peered":"2024-05-30T16:54:46.647166+0000","last_clean":"2024-05-30T16:54:46.647166+0000","last_became_active":"2024-05-30T16:54:45.654115+0000","last_became_peered":"2024-05-30T16:54:45.654115+0000","last_unstale":"2024-05-30T16:54:46.647166+0000","last_undegraded":"2024-05-30T16:54:46.647166+0000","last_fullsized":"2024-05-30T16:54:46.647166+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:38.027264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":244,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.648534+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:54:46.648534+0000","last_peered":"2024-05-30T16:54:46.648534+0000","last_clean":"2024-05-30T16:54:46.648534+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:54:46.648534+0000","last_undegraded":"2024-05-30T16:54:46.648534+0000","last_fullsized":"2024-05-30T16:54:46.648534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509513,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44948,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326892,"statfs":{"total":96636764160,"available":96590737408,"internally_reserved":0,"allocated":1318912,"data_stored":891249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509514,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45780,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326060,"statfs":{"total":96636764160,"available":96589885440,"internally_reserved":0,"allocated":724992,"data_stored":300881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509514,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40216,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331624,"statfs":{"total":96636764160,"available":96595582976,"internally_reserved":0,"allocated":733184,"data_stored":301533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45768,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326072,"statfs":{"total":96636764160,"available":96589897728,"internally_reserved":0,"allocated":712704,"data_stored":294050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44384,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327456,"statfs":{"total":96636764160,"available":96591314944,"internally_reserved":0,"allocated":733184,"data_stored":300937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45780,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326060,"statfs":{"total":96636764160,"available":96589885440,"internally_reserved":0,"allocated":729088,"data_stored":300971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509514,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46376,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325464,"statfs":{"total":96636764160,"available":96589275136,"internally_reserved":0,"allocated":1335296,"data_stored":893443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542218,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45752,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326088,"statfs":{"total":96636764160,"available":96589914112,"internally_reserved":0,"allocated":700416,"data_stored":287727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:54:51.200 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:54:51.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.375+0000 7f9747800640 1 Processor -- start 2024-05-30T16:54:51.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9747800640 1 -- start start 2024-05-30T16:54:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9747800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9740161e60 0x7f97400cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9747800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97400d1d40 0x7f97400b7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9747800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97400d4410 con 0x7f97400d3c90 2024-05-30T16:54:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9747800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9740162240 con 0x7f97400d1d40 2024-05-30T16:54:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9747800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f97400d5490 con 0x7f9740161e60 2024-05-30T16:54:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9745800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97400d1d40 0x7f97400b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9745800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97400d1d40 0x7f97400b7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34904/0 (socket says 172.21.15.59:34904) 2024-05-30T16:54:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9745800640 1 -- 172.21.15.59:0/796481573 learned_addr learned my addr 172.21.15.59:0/796481573 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:51.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9744e00640 1 --2- 172.21.15.59:0/796481573 >> v2:172.21.15.107:3300/0 conn(0x7f9740161e60 0x7f97400cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:51.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9745800640 1 -- 172.21.15.59:0/796481573 >> v2:172.21.15.107:3300/0 conn(0x7f9740161e60 msgr2=0x7f97400cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:51.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9745800640 1 --2- 172.21.15.59:0/796481573 >> v2:172.21.15.107:3300/0 conn(0x7f9740161e60 0x7f97400cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9745800640 1 -- 172.21.15.59:0/796481573 >> v1:172.21.15.59:6789/0 conn(0x7f97400d3c90 legacy=0x7f97400d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:51.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f9745800640 1 -- 172.21.15.59:0/796481573 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97400d46d0 con 0x7f97400d1d40 2024-05-30T16:54:51.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.379+0000 7f973f400640 1 -- 172.21.15.59:0/796481573 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555622918 0 0) 0x7f97400d4410 con 0x7f97400d3c90 2024-05-30T16:54:51.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f9745800640 1 --2- 172.21.15.59:0/796481573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97400d1d40 0x7f97400b7770 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9738009e50 tx=0x7f973801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536ec700cddc6578 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:51.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f973f400640 1 -- 172.21.15.59:0/796481573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97380b4070 con 0x7f97400d1d40 2024-05-30T16:54:51.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f973f400640 1 -- 172.21.15.59:0/796481573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97380af400 con 0x7f97400d1d40 2024-05-30T16:54:51.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f973f400640 1 -- 172.21.15.59:0/796481573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97380af7d0 con 0x7f97400d1d40 2024-05-30T16:54:51.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f9747800640 1 -- 172.21.15.59:0/796481573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97400d1d40 msgr2=0x7f97400b7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:51.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f9747800640 1 --2- 172.21.15.59:0/796481573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97400d1d40 0x7f97400b7770 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9738009e50 tx=0x7f973801f1e0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f9747800640 1 -- 172.21.15.59:0/796481573 shutdown_connections 2024-05-30T16:54:51.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f9747800640 1 --2- 172.21.15.59:0/796481573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97400d1d40 0x7f97400b7770 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f9747800640 1 --2- 172.21.15.59:0/796481573 >> v2:172.21.15.107:3300/0 conn(0x7f9740161e60 0x7f97400cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f9747800640 1 -- 172.21.15.59:0/796481573 >> 172.21.15.59:0/796481573 conn(0x7f9740067b60 msgr2=0x7f9740067f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:51.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f9747800640 1 -- 172.21.15.59:0/796481573 shutdown_connections 2024-05-30T16:54:51.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f9747800640 1 -- 172.21.15.59:0/796481573 wait complete. 2024-05-30T16:54:51.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f9747800640 1 Processor -- start 2024-05-30T16:54:51.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.383+0000 7f9747800640 1 -- start start 2024-05-30T16:54:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f9747800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97400d1d40 0x7f97400ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f9747800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97400d3c90 0x7f97400cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f9747800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9740161e60 0x7f974015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f9747800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f97400d4f70 con 0x7f97400d3c90 2024-05-30T16:54:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f9747800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f97400d4c90 con 0x7f9740161e60 2024-05-30T16:54:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f9747800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f97400d4120 con 0x7f97400d1d40 2024-05-30T16:54:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97400d3c90 0x7f97400cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97400d3c90 0x7f97400cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34920/0 (socket says 172.21.15.59:34920) 2024-05-30T16:54:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973fe00640 1 -- 172.21.15.59:0/2266540032 learned_addr learned my addr 172.21.15.59:0/2266540032 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f9745800640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9740161e60 0x7f974015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f9744e00640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97400d1d40 0x7f97400ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973fe00640 1 -- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97400d1d40 msgr2=0x7f97400ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973fe00640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97400d1d40 0x7f97400ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973fe00640 1 -- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9740161e60 msgr2=0x7f974015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973fe00640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9740161e60 0x7f974015c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973fe00640 1 -- 172.21.15.59:0/2266540032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97400cc190 con 0x7f97400d3c90 2024-05-30T16:54:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973fe00640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97400d3c90 0x7f97400cb7b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f972c00c500 tx=0x7f972c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973cc00640 1 -- 172.21.15.59:0/2266540032 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c017070 con 0x7f97400d3c90 2024-05-30T16:54:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973cc00640 1 -- 172.21.15.59:0/2266540032 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f972c003600 con 0x7f97400d3c90 2024-05-30T16:54:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973cc00640 1 -- 172.21.15.59:0/2266540032 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c0039f0 con 0x7f97400d3c90 2024-05-30T16:54:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f9747800640 1 -- 172.21.15.59:0/2266540032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97400cc470 con 0x7f97400d3c90 2024-05-30T16:54:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f9747800640 1 -- 172.21.15.59:0/2266540032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97400cca30 con 0x7f97400d3c90 2024-05-30T16:54:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f9747800640 1 -- 172.21.15.59:0/2266540032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9740068a90 con 0x7f97400d3c90 2024-05-30T16:54:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.387+0000 7f973cc00640 1 -- 172.21.15.59:0/2266540032 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f972c01a070 con 0x7f97400d3c90 2024-05-30T16:54:51.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.391+0000 7f973cc00640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9720068b90 0x7f972006b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:51.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.391+0000 7f973cc00640 1 -- 172.21.15.59:0/2266540032 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f972c086f90 con 0x7f97400d3c90 2024-05-30T16:54:51.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.391+0000 7f9744e00640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9720068b90 0x7f972006b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:51.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.391+0000 7f9744e00640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9720068b90 0x7f972006b050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f97400b3420 tx=0x7f9734009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.395+0000 7f973cc00640 1 -- 172.21.15.59:0/2266540032 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f972c08a030 con 0x7f97400d3c90 2024-05-30T16:54:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.555+0000 7f9747800640 1 -- 172.21.15.59:0/2266540032 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97400cee90 con 0x7f9720068b90 2024-05-30T16:54:51.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.563+0000 7f973cc00640 1 -- 172.21.15.59:0/2266540032 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250828 (secure 0 0 0) 0x7f97400cee90 con 0x7f9720068b90 2024-05-30T16:54:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:51.570 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:54:51.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.567+0000 7f9747800640 1 -- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9720068b90 msgr2=0x7f972006b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:51.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.567+0000 7f9747800640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9720068b90 0x7f972006b050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f97400b3420 tx=0x7f9734009190 comp rx=0 tx=0).stop 2024-05-30T16:54:51.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.567+0000 7f9747800640 1 -- 172.21.15.59:0/2266540032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97400d3c90 msgr2=0x7f97400cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:51.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.567+0000 7f9747800640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97400d3c90 0x7f97400cb7b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f972c00c500 tx=0x7f972c00c9c0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.567+0000 7f9747800640 1 -- 172.21.15.59:0/2266540032 shutdown_connections 2024-05-30T16:54:51.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.567+0000 7f9747800640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9720068b90 0x7f972006b050 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.567+0000 7f9747800640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9740161e60 0x7f974015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.567+0000 7f9747800640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97400d3c90 0x7f97400cb7b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.567+0000 7f9747800640 1 --2- 172.21.15.59:0/2266540032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97400d1d40 0x7f97400ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.567+0000 7f9747800640 1 -- 172.21.15.59:0/2266540032 >> 172.21.15.59:0/2266540032 conn(0x7f9740067b60 msgr2=0x7f97400cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:51.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.567+0000 7f9747800640 1 -- 172.21.15.59:0/2266540032 shutdown_connections 2024-05-30T16:54:51.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.567+0000 7f9747800640 1 -- 172.21.15.59:0/2266540032 wait complete. 2024-05-30T16:54:51.589 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-05-30T16:54:51.162969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":359004,"kb_used_data":6824,"kb_used_omap":12,"kb_used_meta":352051,"kb_avail":754615716,"statfs":{"total":773094113280,"available":772726493184,"internally_reserved":0,"allocated":6987776,"data_stored":3570791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":360500784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001500"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.661703+0000","last_change":"2024-05-30T16:54:46.653537+0000","last_active":"2024-05-30T16:54:46.661703+0000","last_peered":"2024-05-30T16:54:46.661703+0000","last_clean":"2024-05-30T16:54:46.661703+0000","last_became_active":"2024-05-30T16:54:46.653287+0000","last_became_peered":"2024-05-30T16:54:46.653287+0000","last_unstale":"2024-05-30T16:54:46.661703+0000","last_undegraded":"2024-05-30T16:54:46.661703+0000","last_fullsized":"2024-05-30T16:54:46.661703+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:53.883132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.646545+0000","last_change":"2024-05-30T16:54:45.646545+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.646545+0000","last_undegraded":"2024-05-30T16:54:45.646545+0000","last_fullsized":"2024-05-30T16:54:45.646545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.665343+0000","last_change":"2024-05-30T16:54:46.658753+0000","last_active":"2024-05-30T16:54:46.665343+0000","last_peered":"2024-05-30T16:54:46.665343+0000","last_clean":"2024-05-30T16:54:46.665343+0000","last_became_active":"2024-05-30T16:54:46.658476+0000","last_became_peered":"2024-05-30T16:54:46.658476+0000","last_unstale":"2024-05-30T16:54:46.665343+0000","last_undegraded":"2024-05-30T16:54:46.665343+0000","last_fullsized":"2024-05-30T16:54:46.665343+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:49.445877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668376+0000","last_change":"2024-05-30T16:54:46.662427+0000","last_active":"2024-05-30T16:54:46.668376+0000","last_peered":"2024-05-30T16:54:46.668376+0000","last_clean":"2024-05-30T16:54:46.668376+0000","last_became_active":"2024-05-30T16:54:46.662157+0000","last_became_peered":"2024-05-30T16:54:46.662157+0000","last_unstale":"2024-05-30T16:54:46.668376+0000","last_undegraded":"2024-05-30T16:54:46.668376+0000","last_fullsized":"2024-05-30T16:54:46.668376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:43.670842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670358+0000","last_change":"2024-05-30T16:54:46.660389+0000","last_active":"2024-05-30T16:54:46.670358+0000","last_peered":"2024-05-30T16:54:46.670358+0000","last_clean":"2024-05-30T16:54:46.670358+0000","last_became_active":"2024-05-30T16:54:46.660137+0000","last_became_peered":"2024-05-30T16:54:46.660137+0000","last_unstale":"2024-05-30T16:54:46.670358+0000","last_undegraded":"2024-05-30T16:54:46.670358+0000","last_fullsized":"2024-05-30T16:54:46.670358+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:33.138067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671112+0000","last_change":"2024-05-30T16:54:46.666587+0000","last_active":"2024-05-30T16:54:46.671112+0000","last_peered":"2024-05-30T16:54:46.671112+0000","last_clean":"2024-05-30T16:54:46.671112+0000","last_became_active":"2024-05-30T16:54:46.663836+0000","last_became_peered":"2024-05-30T16:54:46.663836+0000","last_unstale":"2024-05-30T16:54:46.671112+0000","last_undegraded":"2024-05-30T16:54:46.671112+0000","last_fullsized":"2024-05-30T16:54:46.671112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:49:29.390734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.649812+0000","last_change":"2024-05-30T16:54:46.648712+0000","last_active":"2024-05-30T16:54:46.649812+0000","last_peered":"2024-05-30T16:54:46.649812+0000","last_clean":"2024-05-30T16:54:46.649812+0000","last_became_active":"2024-05-30T16:54:46.648462+0000","last_became_peered":"2024-05-30T16:54:46.648462+0000","last_unstale":"2024-05-30T16:54:46.649812+0000","last_undegraded":"2024-05-30T16:54:46.649812+0000","last_fullsized":"2024-05-30T16:54:46.649812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:52:39.449932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.648247+0000","last_change":"2024-05-30T16:54:45.648247+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.648247+0000","last_undegraded":"2024-05-30T16:54:45.648247+0000","last_fullsized":"2024-05-30T16:54:45.648247+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670868+0000","last_change":"2024-05-30T16:54:46.661707+0000","last_active":"2024-05-30T16:54:46.670868+0000","last_peered":"2024-05-30T16:54:46.670868+0000","last_clean":"2024-05-30T16:54:46.670868+0000","last_became_active":"2024-05-30T16:54:46.661402+0000","last_became_peered":"2024-05-30T16:54:46.661402+0000","last_unstale":"2024-05-30T16:54:46.670868+0000","last_undegraded":"2024-05-30T16:54:46.670868+0000","last_fullsized":"2024-05-30T16:54:46.670868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:47.830462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.676122+0000","last_change":"2024-05-30T16:54:46.672351+0000","last_active":"2024-05-30T16:54:46.676122+0000","last_peered":"2024-05-30T16:54:46.676122+0000","last_clean":"2024-05-30T16:54:46.676122+0000","last_became_active":"2024-05-30T16:54:46.672097+0000","last_became_peered":"2024-05-30T16:54:46.672097+0000","last_unstale":"2024-05-30T16:54:46.676122+0000","last_undegraded":"2024-05-30T16:54:46.676122+0000","last_fullsized":"2024-05-30T16:54:46.676122+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:42.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675941+0000","last_change":"2024-05-30T16:54:46.669733+0000","last_active":"2024-05-30T16:54:46.675941+0000","last_peered":"2024-05-30T16:54:46.675941+0000","last_clean":"2024-05-30T16:54:46.675941+0000","last_became_active":"2024-05-30T16:54:46.666565+0000","last_became_peered":"2024-05-30T16:54:46.666565+0000","last_unstale":"2024-05-30T16:54:46.675941+0000","last_undegraded":"2024-05-30T16:54:46.675941+0000","last_fullsized":"2024-05-30T16:54:46.675941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:25.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668399+0000","last_change":"2024-05-30T16:54:46.665480+0000","last_active":"2024-05-30T16:54:46.668399+0000","last_peered":"2024-05-30T16:54:46.668399+0000","last_clean":"2024-05-30T16:54:46.668399+0000","last_became_active":"2024-05-30T16:54:46.665069+0000","last_became_peered":"2024-05-30T16:54:46.665069+0000","last_unstale":"2024-05-30T16:54:46.668399+0000","last_undegraded":"2024-05-30T16:54:46.668399+0000","last_fullsized":"2024-05-30T16:54:46.668399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:18.915849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664156+0000","last_change":"2024-05-30T16:54:46.657415+0000","last_active":"2024-05-30T16:54:46.664156+0000","last_peered":"2024-05-30T16:54:46.664156+0000","last_clean":"2024-05-30T16:54:46.664156+0000","last_became_active":"2024-05-30T16:54:46.655817+0000","last_became_peered":"2024-05-30T16:54:46.655817+0000","last_unstale":"2024-05-30T16:54:46.664156+0000","last_undegraded":"2024-05-30T16:54:46.664156+0000","last_fullsized":"2024-05-30T16:54:46.664156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:50:40.823158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.655382+0000","last_change":"2024-05-30T16:54:46.653603+0000","last_active":"2024-05-30T16:54:46.655382+0000","last_peered":"2024-05-30T16:54:46.655382+0000","last_clean":"2024-05-30T16:54:46.655382+0000","last_became_active":"2024-05-30T16:54:46.653302+0000","last_became_peered":"2024-05-30T16:54:46.653302+0000","last_unstale":"2024-05-30T16:54:46.655382+0000","last_undegraded":"2024-05-30T16:54:46.655382+0000","last_fullsized":"2024-05-30T16:54:46.655382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:57:14.688215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670838+0000","last_change":"2024-05-30T16:54:46.662800+0000","last_active":"2024-05-30T16:54:46.670838+0000","last_peered":"2024-05-30T16:54:46.670838+0000","last_clean":"2024-05-30T16:54:46.670838+0000","last_became_active":"2024-05-30T16:54:46.662524+0000","last_became_peered":"2024-05-30T16:54:46.662524+0000","last_unstale":"2024-05-30T16:54:46.670838+0000","last_undegraded":"2024-05-30T16:54:46.670838+0000","last_fullsized":"2024-05-30T16:54:46.670838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:05.577972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664583+0000","last_change":"2024-05-30T16:54:46.657592+0000","last_active":"2024-05-30T16:54:46.664583+0000","last_peered":"2024-05-30T16:54:46.664583+0000","last_clean":"2024-05-30T16:54:46.664583+0000","last_became_active":"2024-05-30T16:54:46.656008+0000","last_became_peered":"2024-05-30T16:54:46.656008+0000","last_unstale":"2024-05-30T16:54:46.664583+0000","last_undegraded":"2024-05-30T16:54:46.664583+0000","last_fullsized":"2024-05-30T16:54:46.664583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:05.577972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.646987+0000","last_change":"2024-05-30T16:54:45.646987+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.646987+0000","last_undegraded":"2024-05-30T16:54:45.646987+0000","last_fullsized":"2024-05-30T16:54:45.646987+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.673804+0000","last_change":"2024-05-30T16:54:46.669925+0000","last_active":"2024-05-30T16:54:46.673804+0000","last_peered":"2024-05-30T16:54:46.673804+0000","last_clean":"2024-05-30T16:54:46.673804+0000","last_became_active":"2024-05-30T16:54:46.669377+0000","last_became_peered":"2024-05-30T16:54:46.669377+0000","last_unstale":"2024-05-30T16:54:46.673804+0000","last_undegraded":"2024-05-30T16:54:46.673804+0000","last_fullsized":"2024-05-30T16:54:46.673804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:18.915849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.661945+0000","last_change":"2024-05-30T16:54:46.652970+0000","last_active":"2024-05-30T16:54:46.661945+0000","last_peered":"2024-05-30T16:54:46.661945+0000","last_clean":"2024-05-30T16:54:46.661945+0000","last_became_active":"2024-05-30T16:54:46.652703+0000","last_became_peered":"2024-05-30T16:54:46.652703+0000","last_unstale":"2024-05-30T16:54:46.661945+0000","last_undegraded":"2024-05-30T16:54:46.661945+0000","last_fullsized":"2024-05-30T16:54:46.661945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:05.374326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.645176+0000","last_change":"2024-05-30T16:54:45.645176+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.645176+0000","last_undegraded":"2024-05-30T16:54:45.645176+0000","last_fullsized":"2024-05-30T16:54:45.645176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663695+0000","last_change":"2024-05-30T16:54:46.659978+0000","last_active":"2024-05-30T16:54:46.663695+0000","last_peered":"2024-05-30T16:54:46.663695+0000","last_clean":"2024-05-30T16:54:46.663695+0000","last_became_active":"2024-05-30T16:54:46.659698+0000","last_became_peered":"2024-05-30T16:54:46.659698+0000","last_unstale":"2024-05-30T16:54:46.663695+0000","last_undegraded":"2024-05-30T16:54:46.663695+0000","last_fullsized":"2024-05-30T16:54:46.663695+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:53.545049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.642021+0000","last_change":"2024-05-30T16:54:45.642021+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.642021+0000","last_undegraded":"2024-05-30T16:54:45.642021+0000","last_fullsized":"2024-05-30T16:54:45.642021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670643+0000","last_change":"2024-05-30T16:54:46.666968+0000","last_active":"2024-05-30T16:54:46.670643+0000","last_peered":"2024-05-30T16:54:46.670643+0000","last_clean":"2024-05-30T16:54:46.670643+0000","last_became_active":"2024-05-30T16:54:46.666488+0000","last_became_peered":"2024-05-30T16:54:46.666488+0000","last_unstale":"2024-05-30T16:54:46.670643+0000","last_undegraded":"2024-05-30T16:54:46.670643+0000","last_fullsized":"2024-05-30T16:54:46.670643+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:32.939644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.657728+0000","last_change":"2024-05-30T16:54:46.656716+0000","last_active":"2024-05-30T16:54:46.657728+0000","last_peered":"2024-05-30T16:54:46.657728+0000","last_clean":"2024-05-30T16:54:46.657728+0000","last_became_active":"2024-05-30T16:54:46.656437+0000","last_became_peered":"2024-05-30T16:54:46.656437+0000","last_unstale":"2024-05-30T16:54:46.657728+0000","last_undegraded":"2024-05-30T16:54:46.657728+0000","last_fullsized":"2024-05-30T16:54:46.657728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:30.131348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675046+0000","last_change":"2024-05-30T16:54:46.669569+0000","last_active":"2024-05-30T16:54:46.675046+0000","last_peered":"2024-05-30T16:54:46.675046+0000","last_clean":"2024-05-30T16:54:46.675046+0000","last_became_active":"2024-05-30T16:54:46.669337+0000","last_became_peered":"2024-05-30T16:54:46.669337+0000","last_unstale":"2024-05-30T16:54:46.675046+0000","last_undegraded":"2024-05-30T16:54:46.675046+0000","last_fullsized":"2024-05-30T16:54:46.675046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:49:46.787342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.650983+0000","last_change":"2024-05-30T16:54:46.648131+0000","last_active":"2024-05-30T16:54:46.650983+0000","last_peered":"2024-05-30T16:54:46.650983+0000","last_clean":"2024-05-30T16:54:46.650983+0000","last_became_active":"2024-05-30T16:54:46.647835+0000","last_became_peered":"2024-05-30T16:54:46.647835+0000","last_unstale":"2024-05-30T16:54:46.650983+0000","last_undegraded":"2024-05-30T16:54:46.650983+0000","last_fullsized":"2024-05-30T16:54:46.650983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668308+0000","last_change":"2024-05-30T16:54:46.664412+0000","last_active":"2024-05-30T16:54:46.668308+0000","last_peered":"2024-05-30T16:54:46.668308+0000","last_clean":"2024-05-30T16:54:46.668308+0000","last_became_active":"2024-05-30T16:54:46.664116+0000","last_became_peered":"2024-05-30T16:54:46.664116+0000","last_unstale":"2024-05-30T16:54:46.668308+0000","last_undegraded":"2024-05-30T16:54:46.668308+0000","last_fullsized":"2024-05-30T16:54:46.668308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:18.915849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670559+0000","last_change":"2024-05-30T16:54:46.665560+0000","last_active":"2024-05-30T16:54:46.670559+0000","last_peered":"2024-05-30T16:54:46.670559+0000","last_clean":"2024-05-30T16:54:46.670559+0000","last_became_active":"2024-05-30T16:54:46.665248+0000","last_became_peered":"2024-05-30T16:54:46.665248+0000","last_unstale":"2024-05-30T16:54:46.670559+0000","last_undegraded":"2024-05-30T16:54:46.670559+0000","last_fullsized":"2024-05-30T16:54:46.670559+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:05:21.158010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.645874+0000","last_change":"2024-05-30T16:54:45.645874+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.645874+0000","last_undegraded":"2024-05-30T16:54:45.645874+0000","last_fullsized":"2024-05-30T16:54:45.645874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664509+0000","last_change":"2024-05-30T16:54:46.658606+0000","last_active":"2024-05-30T16:54:46.664509+0000","last_peered":"2024-05-30T16:54:46.664509+0000","last_clean":"2024-05-30T16:54:46.664509+0000","last_became_active":"2024-05-30T16:54:46.658313+0000","last_became_peered":"2024-05-30T16:54:46.658313+0000","last_unstale":"2024-05-30T16:54:46.664509+0000","last_undegraded":"2024-05-30T16:54:46.664509+0000","last_fullsized":"2024-05-30T16:54:46.664509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:35.259565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671340+0000","last_change":"2024-05-30T16:54:46.664673+0000","last_active":"2024-05-30T16:54:46.671340+0000","last_peered":"2024-05-30T16:54:46.671340+0000","last_clean":"2024-05-30T16:54:46.671340+0000","last_became_active":"2024-05-30T16:54:46.664411+0000","last_became_peered":"2024-05-30T16:54:46.664411+0000","last_unstale":"2024-05-30T16:54:46.671340+0000","last_undegraded":"2024-05-30T16:54:46.671340+0000","last_fullsized":"2024-05-30T16:54:46.671340+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:37.399050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.667166+0000","last_change":"2024-05-30T16:54:46.661133+0000","last_active":"2024-05-30T16:54:46.667166+0000","last_peered":"2024-05-30T16:54:46.667166+0000","last_clean":"2024-05-30T16:54:46.667166+0000","last_became_active":"2024-05-30T16:54:46.660444+0000","last_became_peered":"2024-05-30T16:54:46.660444+0000","last_unstale":"2024-05-30T16:54:46.667166+0000","last_undegraded":"2024-05-30T16:54:46.667166+0000","last_fullsized":"2024-05-30T16:54:46.667166+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:53.545049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668209+0000","last_change":"2024-05-30T16:54:46.662959+0000","last_active":"2024-05-30T16:54:46.668209+0000","last_peered":"2024-05-30T16:54:46.668209+0000","last_clean":"2024-05-30T16:54:46.668209+0000","last_became_active":"2024-05-30T16:54:46.662617+0000","last_became_peered":"2024-05-30T16:54:46.662617+0000","last_unstale":"2024-05-30T16:54:46.668209+0000","last_undegraded":"2024-05-30T16:54:46.668209+0000","last_fullsized":"2024-05-30T16:54:46.668209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.674431+0000","last_change":"2024-05-30T16:54:45.647654+0000","last_active":"2024-05-30T16:54:46.674431+0000","last_peered":"2024-05-30T16:54:46.674431+0000","last_clean":"2024-05-30T16:54:46.674431+0000","last_became_active":"2024-05-30T16:54:45.647348+0000","last_became_peered":"2024-05-30T16:54:45.647348+0000","last_unstale":"2024-05-30T16:54:46.674431+0000","last_undegraded":"2024-05-30T16:54:46.674431+0000","last_fullsized":"2024-05-30T16:54:46.674431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:42.667446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671009+0000","last_change":"2024-05-30T16:54:46.665719+0000","last_active":"2024-05-30T16:54:46.671009+0000","last_peered":"2024-05-30T16:54:46.671009+0000","last_clean":"2024-05-30T16:54:46.671009+0000","last_became_active":"2024-05-30T16:54:46.665454+0000","last_became_peered":"2024-05-30T16:54:46.665454+0000","last_unstale":"2024-05-30T16:54:46.671009+0000","last_undegraded":"2024-05-30T16:54:46.671009+0000","last_fullsized":"2024-05-30T16:54:46.671009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:29:51.209287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.662480+0000","last_change":"2024-05-30T16:54:45.661521+0000","last_active":"2024-05-30T16:54:45.662480+0000","last_peered":"2024-05-30T16:54:45.662480+0000","last_clean":"2024-05-30T16:54:45.662480+0000","last_became_active":"2024-05-30T16:54:45.660638+0000","last_became_peered":"2024-05-30T16:54:45.660638+0000","last_unstale":"2024-05-30T16:54:45.662480+0000","last_undegraded":"2024-05-30T16:54:45.662480+0000","last_fullsized":"2024-05-30T16:54:45.662480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:41:10.905828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671960+0000","last_change":"2024-05-30T16:54:46.667652+0000","last_active":"2024-05-30T16:54:46.671960+0000","last_peered":"2024-05-30T16:54:46.671960+0000","last_clean":"2024-05-30T16:54:46.671960+0000","last_became_active":"2024-05-30T16:54:46.667421+0000","last_became_peered":"2024-05-30T16:54:46.667421+0000","last_unstale":"2024-05-30T16:54:46.671960+0000","last_undegraded":"2024-05-30T16:54:46.671960+0000","last_fullsized":"2024-05-30T16:54:46.671960+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:03.419391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.672100+0000","last_change":"2024-05-30T16:54:45.648517+0000","last_active":"2024-05-30T16:54:46.672100+0000","last_peered":"2024-05-30T16:54:46.672100+0000","last_clean":"2024-05-30T16:54:46.672100+0000","last_became_active":"2024-05-30T16:54:45.647977+0000","last_became_peered":"2024-05-30T16:54:45.647977+0000","last_unstale":"2024-05-30T16:54:46.672100+0000","last_undegraded":"2024-05-30T16:54:46.672100+0000","last_fullsized":"2024-05-30T16:54:46.672100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670659+0000","last_change":"2024-05-30T16:54:46.666945+0000","last_active":"2024-05-30T16:54:46.670659+0000","last_peered":"2024-05-30T16:54:46.670659+0000","last_clean":"2024-05-30T16:54:46.670659+0000","last_became_active":"2024-05-30T16:54:46.666678+0000","last_became_peered":"2024-05-30T16:54:46.666678+0000","last_unstale":"2024-05-30T16:54:46.670659+0000","last_undegraded":"2024-05-30T16:54:46.670659+0000","last_fullsized":"2024-05-30T16:54:46.670659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:37.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.669908+0000","last_change":"2024-05-30T16:54:45.655293+0000","last_active":"2024-05-30T16:54:46.669908+0000","last_peered":"2024-05-30T16:54:46.669908+0000","last_clean":"2024-05-30T16:54:46.669908+0000","last_became_active":"2024-05-30T16:54:45.652639+0000","last_became_peered":"2024-05-30T16:54:45.652639+0000","last_unstale":"2024-05-30T16:54:46.669908+0000","last_undegraded":"2024-05-30T16:54:46.669908+0000","last_fullsized":"2024-05-30T16:54:46.669908+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:26.354745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.643013+0000","last_change":"2024-05-30T16:54:45.643013+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.643013+0000","last_undegraded":"2024-05-30T16:54:45.643013+0000","last_fullsized":"2024-05-30T16:54:45.643013+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663460+0000","last_change":"2024-05-30T16:54:45.649596+0000","last_active":"2024-05-30T16:54:46.663460+0000","last_peered":"2024-05-30T16:54:46.663460+0000","last_clean":"2024-05-30T16:54:46.663460+0000","last_became_active":"2024-05-30T16:54:45.649230+0000","last_became_peered":"2024-05-30T16:54:45.649230+0000","last_unstale":"2024-05-30T16:54:46.663460+0000","last_undegraded":"2024-05-30T16:54:46.663460+0000","last_fullsized":"2024-05-30T16:54:46.663460+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:28:17.157569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.646670+0000","last_change":"2024-05-30T16:54:45.646670+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.646670+0000","last_undegraded":"2024-05-30T16:54:45.646670+0000","last_fullsized":"2024-05-30T16:54:45.646670+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666789+0000","last_change":"2024-05-30T16:54:45.653322+0000","last_active":"2024-05-30T16:54:46.666789+0000","last_peered":"2024-05-30T16:54:46.666789+0000","last_clean":"2024-05-30T16:54:46.666789+0000","last_became_active":"2024-05-30T16:54:45.653039+0000","last_became_peered":"2024-05-30T16:54:45.653039+0000","last_unstale":"2024-05-30T16:54:46.666789+0000","last_undegraded":"2024-05-30T16:54:46.666789+0000","last_fullsized":"2024-05-30T16:54:46.666789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:46.827065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666643+0000","last_change":"2024-05-30T16:54:46.664566+0000","last_active":"2024-05-30T16:54:46.666643+0000","last_peered":"2024-05-30T16:54:46.666643+0000","last_clean":"2024-05-30T16:54:46.666643+0000","last_became_active":"2024-05-30T16:54:46.664293+0000","last_became_peered":"2024-05-30T16:54:46.664293+0000","last_unstale":"2024-05-30T16:54:46.666643+0000","last_undegraded":"2024-05-30T16:54:46.666643+0000","last_fullsized":"2024-05-30T16:54:46.666643+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:12.383279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.642607+0000","last_change":"2024-05-30T16:54:45.649519+0000","last_active":"2024-05-30T16:54:46.642607+0000","last_peered":"2024-05-30T16:54:46.642607+0000","last_clean":"2024-05-30T16:54:46.642607+0000","last_became_active":"2024-05-30T16:54:45.649210+0000","last_became_peered":"2024-05-30T16:54:45.649210+0000","last_unstale":"2024-05-30T16:54:46.642607+0000","last_undegraded":"2024-05-30T16:54:46.642607+0000","last_fullsized":"2024-05-30T16:54:46.642607+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:04.574576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.650395+0000","last_change":"2024-05-30T16:54:45.650395+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.650395+0000","last_undegraded":"2024-05-30T16:54:45.650395+0000","last_fullsized":"2024-05-30T16:54:45.650395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.643656+0000","last_change":"2024-05-30T16:54:45.657461+0000","last_active":"2024-05-30T16:54:46.643656+0000","last_peered":"2024-05-30T16:54:46.643656+0000","last_clean":"2024-05-30T16:54:46.643656+0000","last_became_active":"2024-05-30T16:54:45.657185+0000","last_became_peered":"2024-05-30T16:54:45.657185+0000","last_unstale":"2024-05-30T16:54:46.643656+0000","last_undegraded":"2024-05-30T16:54:46.643656+0000","last_fullsized":"2024-05-30T16:54:46.643656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:01.690937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.673829+0000","last_change":"2024-05-30T16:54:46.672121+0000","last_active":"2024-05-30T16:54:46.673829+0000","last_peered":"2024-05-30T16:54:46.673829+0000","last_clean":"2024-05-30T16:54:46.673829+0000","last_became_active":"2024-05-30T16:54:46.671781+0000","last_became_peered":"2024-05-30T16:54:46.671781+0000","last_unstale":"2024-05-30T16:54:46.673829+0000","last_undegraded":"2024-05-30T16:54:46.673829+0000","last_fullsized":"2024-05-30T16:54:46.673829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:35.848386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.652601+0000","last_change":"2024-05-30T16:54:45.658364+0000","last_active":"2024-05-30T16:54:46.652601+0000","last_peered":"2024-05-30T16:54:46.652601+0000","last_clean":"2024-05-30T16:54:46.652601+0000","last_became_active":"2024-05-30T16:54:45.658015+0000","last_became_peered":"2024-05-30T16:54:45.658015+0000","last_unstale":"2024-05-30T16:54:46.652601+0000","last_undegraded":"2024-05-30T16:54:46.652601+0000","last_fullsized":"2024-05-30T16:54:46.652601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:04.574576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.676193+0000","last_change":"2024-05-30T16:54:46.673850+0000","last_active":"2024-05-30T16:54:46.676193+0000","last_peered":"2024-05-30T16:54:46.676193+0000","last_clean":"2024-05-30T16:54:46.676193+0000","last_became_active":"2024-05-30T16:54:46.673493+0000","last_became_peered":"2024-05-30T16:54:46.673493+0000","last_unstale":"2024-05-30T16:54:46.676193+0000","last_undegraded":"2024-05-30T16:54:46.676193+0000","last_fullsized":"2024-05-30T16:54:46.676193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:03.419391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.661693+0000","last_change":"2024-05-30T16:54:45.655634+0000","last_active":"2024-05-30T16:54:45.661693+0000","last_peered":"2024-05-30T16:54:45.661693+0000","last_clean":"2024-05-30T16:54:45.661693+0000","last_became_active":"2024-05-30T16:54:45.655296+0000","last_became_peered":"2024-05-30T16:54:45.655296+0000","last_unstale":"2024-05-30T16:54:45.661693+0000","last_undegraded":"2024-05-30T16:54:45.661693+0000","last_fullsized":"2024-05-30T16:54:45.661693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:17:37.296238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670966+0000","last_change":"2024-05-30T16:54:46.665621+0000","last_active":"2024-05-30T16:54:46.670966+0000","last_peered":"2024-05-30T16:54:46.670966+0000","last_clean":"2024-05-30T16:54:46.670966+0000","last_became_active":"2024-05-30T16:54:46.665034+0000","last_became_peered":"2024-05-30T16:54:46.665034+0000","last_unstale":"2024-05-30T16:54:46.670966+0000","last_undegraded":"2024-05-30T16:54:46.670966+0000","last_fullsized":"2024-05-30T16:54:46.670966+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:18.243815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.677071+0000","last_change":"2024-05-30T16:54:45.661725+0000","last_active":"2024-05-30T16:54:46.677071+0000","last_peered":"2024-05-30T16:54:46.677071+0000","last_clean":"2024-05-30T16:54:46.677071+0000","last_became_active":"2024-05-30T16:54:45.661411+0000","last_became_peered":"2024-05-30T16:54:45.661411+0000","last_unstale":"2024-05-30T16:54:46.677071+0000","last_undegraded":"2024-05-30T16:54:46.677071+0000","last_fullsized":"2024-05-30T16:54:46.677071+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675745+0000","last_change":"2024-05-30T16:54:46.672644+0000","last_active":"2024-05-30T16:54:46.675745+0000","last_peered":"2024-05-30T16:54:46.675745+0000","last_clean":"2024-05-30T16:54:46.675745+0000","last_became_active":"2024-05-30T16:54:46.672183+0000","last_became_peered":"2024-05-30T16:54:46.672183+0000","last_unstale":"2024-05-30T16:54:46.675745+0000","last_undegraded":"2024-05-30T16:54:46.675745+0000","last_fullsized":"2024-05-30T16:54:46.675745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:37.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675700+0000","last_change":"2024-05-30T16:54:45.645709+0000","last_active":"2024-05-30T16:54:46.675700+0000","last_peered":"2024-05-30T16:54:46.675700+0000","last_clean":"2024-05-30T16:54:46.675700+0000","last_became_active":"2024-05-30T16:54:45.644794+0000","last_became_peered":"2024-05-30T16:54:45.644794+0000","last_unstale":"2024-05-30T16:54:46.675700+0000","last_undegraded":"2024-05-30T16:54:46.675700+0000","last_fullsized":"2024-05-30T16:54:46.675700+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:37.221162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670171+0000","last_change":"2024-05-30T16:54:46.666387+0000","last_active":"2024-05-30T16:54:46.670171+0000","last_peered":"2024-05-30T16:54:46.670171+0000","last_clean":"2024-05-30T16:54:46.670171+0000","last_became_active":"2024-05-30T16:54:46.666160+0000","last_became_peered":"2024-05-30T16:54:46.666160+0000","last_unstale":"2024-05-30T16:54:46.670171+0000","last_undegraded":"2024-05-30T16:54:46.670171+0000","last_fullsized":"2024-05-30T16:54:46.670171+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:49:29.390734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.662205+0000","last_change":"2024-05-30T16:54:45.660979+0000","last_active":"2024-05-30T16:54:45.662205+0000","last_peered":"2024-05-30T16:54:45.662205+0000","last_clean":"2024-05-30T16:54:45.662205+0000","last_became_active":"2024-05-30T16:54:45.660628+0000","last_became_peered":"2024-05-30T16:54:45.660628+0000","last_unstale":"2024-05-30T16:54:45.662205+0000","last_undegraded":"2024-05-30T16:54:45.662205+0000","last_fullsized":"2024-05-30T16:54:45.662205+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:21:25.478498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.673884+0000","last_change":"2024-05-30T16:54:46.669298+0000","last_active":"2024-05-30T16:54:46.673884+0000","last_peered":"2024-05-30T16:54:46.673884+0000","last_clean":"2024-05-30T16:54:46.673884+0000","last_became_active":"2024-05-30T16:54:46.669004+0000","last_became_peered":"2024-05-30T16:54:46.669004+0000","last_unstale":"2024-05-30T16:54:46.673884+0000","last_undegraded":"2024-05-30T16:54:46.673884+0000","last_fullsized":"2024-05-30T16:54:46.673884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:43.670842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.644949+0000","last_change":"2024-05-30T16:54:45.657137+0000","last_active":"2024-05-30T16:54:46.644949+0000","last_peered":"2024-05-30T16:54:46.644949+0000","last_clean":"2024-05-30T16:54:46.644949+0000","last_became_active":"2024-05-30T16:54:45.656852+0000","last_became_peered":"2024-05-30T16:54:45.656852+0000","last_unstale":"2024-05-30T16:54:46.644949+0000","last_undegraded":"2024-05-30T16:54:46.644949+0000","last_fullsized":"2024-05-30T16:54:46.644949+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:30:37.379158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663572+0000","last_change":"2024-05-30T16:54:46.659555+0000","last_active":"2024-05-30T16:54:46.663572+0000","last_peered":"2024-05-30T16:54:46.663572+0000","last_clean":"2024-05-30T16:54:46.663572+0000","last_became_active":"2024-05-30T16:54:46.659213+0000","last_became_peered":"2024-05-30T16:54:46.659213+0000","last_unstale":"2024-05-30T16:54:46.663572+0000","last_undegraded":"2024-05-30T16:54:46.663572+0000","last_fullsized":"2024-05-30T16:54:46.663572+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:01.137841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.642813+0000","last_change":"2024-05-30T16:54:45.658679+0000","last_active":"2024-05-30T16:54:46.642813+0000","last_peered":"2024-05-30T16:54:46.642813+0000","last_clean":"2024-05-30T16:54:46.642813+0000","last_became_active":"2024-05-30T16:54:45.658329+0000","last_became_peered":"2024-05-30T16:54:45.658329+0000","last_unstale":"2024-05-30T16:54:46.642813+0000","last_undegraded":"2024-05-30T16:54:46.642813+0000","last_fullsized":"2024-05-30T16:54:46.642813+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:48.442480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670623+0000","last_change":"2024-05-30T16:54:46.666749+0000","last_active":"2024-05-30T16:54:46.670623+0000","last_peered":"2024-05-30T16:54:46.670623+0000","last_clean":"2024-05-30T16:54:46.670623+0000","last_became_active":"2024-05-30T16:54:46.665986+0000","last_became_peered":"2024-05-30T16:54:46.665986+0000","last_unstale":"2024-05-30T16:54:46.670623+0000","last_undegraded":"2024-05-30T16:54:46.670623+0000","last_fullsized":"2024-05-30T16:54:46.670623+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:26.161079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675768+0000","last_change":"2024-05-30T16:54:45.660854+0000","last_active":"2024-05-30T16:54:46.675768+0000","last_peered":"2024-05-30T16:54:46.675768+0000","last_clean":"2024-05-30T16:54:46.675768+0000","last_became_active":"2024-05-30T16:54:45.660575+0000","last_became_peered":"2024-05-30T16:54:45.660575+0000","last_unstale":"2024-05-30T16:54:46.675768+0000","last_undegraded":"2024-05-30T16:54:46.675768+0000","last_fullsized":"2024-05-30T16:54:46.675768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:46.827065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663814+0000","last_change":"2024-05-30T16:54:46.660412+0000","last_active":"2024-05-30T16:54:46.663814+0000","last_peered":"2024-05-30T16:54:46.663814+0000","last_clean":"2024-05-30T16:54:46.663814+0000","last_became_active":"2024-05-30T16:54:46.660132+0000","last_became_peered":"2024-05-30T16:54:46.660132+0000","last_unstale":"2024-05-30T16:54:46.663814+0000","last_undegraded":"2024-05-30T16:54:46.663814+0000","last_fullsized":"2024-05-30T16:54:46.663814+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:27.358141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.661017+0000","last_change":"2024-05-30T16:54:45.658736+0000","last_active":"2024-05-30T16:54:45.661017+0000","last_peered":"2024-05-30T16:54:45.661017+0000","last_clean":"2024-05-30T16:54:45.661017+0000","last_became_active":"2024-05-30T16:54:45.658382+0000","last_became_peered":"2024-05-30T16:54:45.658382+0000","last_unstale":"2024-05-30T16:54:45.661017+0000","last_undegraded":"2024-05-30T16:54:45.661017+0000","last_fullsized":"2024-05-30T16:54:45.661017+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:33.856990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.674113+0000","last_change":"2024-05-30T16:54:46.668478+0000","last_active":"2024-05-30T16:54:46.674113+0000","last_peered":"2024-05-30T16:54:46.674113+0000","last_clean":"2024-05-30T16:54:46.674113+0000","last_became_active":"2024-05-30T16:54:46.668127+0000","last_became_peered":"2024-05-30T16:54:46.668127+0000","last_unstale":"2024-05-30T16:54:46.674113+0000","last_undegraded":"2024-05-30T16:54:46.674113+0000","last_fullsized":"2024-05-30T16:54:46.674113+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:03.419391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675376+0000","last_change":"2024-05-30T16:54:45.651393+0000","last_active":"2024-05-30T16:54:46.675376+0000","last_peered":"2024-05-30T16:54:46.675376+0000","last_clean":"2024-05-30T16:54:46.675376+0000","last_became_active":"2024-05-30T16:54:45.650980+0000","last_became_peered":"2024-05-30T16:54:45.650980+0000","last_unstale":"2024-05-30T16:54:46.675376+0000","last_undegraded":"2024-05-30T16:54:46.675376+0000","last_fullsized":"2024-05-30T16:54:46.675376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:25.157682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.644782+0000","last_change":"2024-05-30T16:54:45.644782+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.644782+0000","last_undegraded":"2024-05-30T16:54:45.644782+0000","last_fullsized":"2024-05-30T16:54:45.644782+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670736+0000","last_change":"2024-05-30T16:54:45.655629+0000","last_active":"2024-05-30T16:54:46.670736+0000","last_peered":"2024-05-30T16:54:46.670736+0000","last_clean":"2024-05-30T16:54:46.670736+0000","last_became_active":"2024-05-30T16:54:45.655351+0000","last_became_peered":"2024-05-30T16:54:45.655351+0000","last_unstale":"2024-05-30T16:54:46.670736+0000","last_undegraded":"2024-05-30T16:54:46.670736+0000","last_fullsized":"2024-05-30T16:54:46.670736+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:34.256169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675732+0000","last_change":"2024-05-30T16:54:46.672424+0000","last_active":"2024-05-30T16:54:46.675732+0000","last_peered":"2024-05-30T16:54:46.675732+0000","last_clean":"2024-05-30T16:54:46.675732+0000","last_became_active":"2024-05-30T16:54:46.671842+0000","last_became_peered":"2024-05-30T16:54:46.671842+0000","last_unstale":"2024-05-30T16:54:46.675732+0000","last_undegraded":"2024-05-30T16:54:46.675732+0000","last_fullsized":"2024-05-30T16:54:46.675732+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:49:29.390734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.660180+0000","last_change":"2024-05-30T16:54:45.656675+0000","last_active":"2024-05-30T16:54:46.660180+0000","last_peered":"2024-05-30T16:54:46.660180+0000","last_clean":"2024-05-30T16:54:46.660180+0000","last_became_active":"2024-05-30T16:54:45.656400+0000","last_became_peered":"2024-05-30T16:54:45.656400+0000","last_unstale":"2024-05-30T16:54:46.660180+0000","last_undegraded":"2024-05-30T16:54:46.660180+0000","last_fullsized":"2024-05-30T16:54:46.660180+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:48.442480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.672601+0000","last_change":"2024-05-30T16:54:46.667135+0000","last_active":"2024-05-30T16:54:46.672601+0000","last_peered":"2024-05-30T16:54:46.672601+0000","last_clean":"2024-05-30T16:54:46.672601+0000","last_became_active":"2024-05-30T16:54:46.666764+0000","last_became_peered":"2024-05-30T16:54:46.666764+0000","last_unstale":"2024-05-30T16:54:46.672601+0000","last_undegraded":"2024-05-30T16:54:46.672601+0000","last_fullsized":"2024-05-30T16:54:46.672601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:37.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.660884+0000","last_change":"2024-05-30T16:54:45.655577+0000","last_active":"2024-05-30T16:54:45.660884+0000","last_peered":"2024-05-30T16:54:45.660884+0000","last_clean":"2024-05-30T16:54:45.660884+0000","last_became_active":"2024-05-30T16:54:45.655197+0000","last_became_peered":"2024-05-30T16:54:45.655197+0000","last_unstale":"2024-05-30T16:54:45.660884+0000","last_undegraded":"2024-05-30T16:54:45.660884+0000","last_fullsized":"2024-05-30T16:54:45.660884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:52:20.023991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664248+0000","last_change":"2024-05-30T16:54:46.655167+0000","last_active":"2024-05-30T16:54:46.664248+0000","last_peered":"2024-05-30T16:54:46.664248+0000","last_clean":"2024-05-30T16:54:46.664248+0000","last_became_active":"2024-05-30T16:54:46.654866+0000","last_became_peered":"2024-05-30T16:54:46.654866+0000","last_unstale":"2024-05-30T16:54:46.664248+0000","last_undegraded":"2024-05-30T16:54:46.664248+0000","last_fullsized":"2024-05-30T16:54:46.664248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:01.137841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.661131+0000","last_change":"2024-05-30T16:54:45.647369+0000","last_active":"2024-05-30T16:54:46.661131+0000","last_peered":"2024-05-30T16:54:46.661131+0000","last_clean":"2024-05-30T16:54:46.661131+0000","last_became_active":"2024-05-30T16:54:45.647108+0000","last_became_peered":"2024-05-30T16:54:45.647108+0000","last_unstale":"2024-05-30T16:54:46.661131+0000","last_undegraded":"2024-05-30T16:54:46.661131+0000","last_fullsized":"2024-05-30T16:54:46.661131+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:20:36.722964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668263+0000","last_change":"2024-05-30T16:54:46.662209+0000","last_active":"2024-05-30T16:54:46.668263+0000","last_peered":"2024-05-30T16:54:46.668263+0000","last_clean":"2024-05-30T16:54:46.668263+0000","last_became_active":"2024-05-30T16:54:46.661882+0000","last_became_peered":"2024-05-30T16:54:46.661882+0000","last_unstale":"2024-05-30T16:54:46.668263+0000","last_undegraded":"2024-05-30T16:54:46.668263+0000","last_fullsized":"2024-05-30T16:54:46.668263+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:27.358141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.642644+0000","last_change":"2024-05-30T16:54:45.657812+0000","last_active":"2024-05-30T16:54:46.642644+0000","last_peered":"2024-05-30T16:54:46.642644+0000","last_clean":"2024-05-30T16:54:46.642644+0000","last_became_active":"2024-05-30T16:54:45.656848+0000","last_became_peered":"2024-05-30T16:54:45.656848+0000","last_unstale":"2024-05-30T16:54:46.642644+0000","last_undegraded":"2024-05-30T16:54:46.642644+0000","last_fullsized":"2024-05-30T16:54:46.642644+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.658294+0000","last_change":"2024-05-30T16:54:46.654546+0000","last_active":"2024-05-30T16:54:46.658294+0000","last_peered":"2024-05-30T16:54:46.658294+0000","last_clean":"2024-05-30T16:54:46.658294+0000","last_became_active":"2024-05-30T16:54:46.653161+0000","last_became_peered":"2024-05-30T16:54:46.653161+0000","last_unstale":"2024-05-30T16:54:46.658294+0000","last_undegraded":"2024-05-30T16:54:46.658294+0000","last_fullsized":"2024-05-30T16:54:46.658294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:26.161079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.676208+0000","last_change":"2024-05-30T16:54:45.658652+0000","last_active":"2024-05-30T16:54:46.676208+0000","last_peered":"2024-05-30T16:54:46.676208+0000","last_clean":"2024-05-30T16:54:46.676208+0000","last_became_active":"2024-05-30T16:54:45.658367+0000","last_became_peered":"2024-05-30T16:54:45.658367+0000","last_unstale":"2024-05-30T16:54:46.676208+0000","last_undegraded":"2024-05-30T16:54:46.676208+0000","last_fullsized":"2024-05-30T16:54:46.676208+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:30:37.379158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666735+0000","last_change":"2024-05-30T16:54:46.662119+0000","last_active":"2024-05-30T16:54:46.666735+0000","last_peered":"2024-05-30T16:54:46.666735+0000","last_clean":"2024-05-30T16:54:46.666735+0000","last_became_active":"2024-05-30T16:54:46.661785+0000","last_became_peered":"2024-05-30T16:54:46.661785+0000","last_unstale":"2024-05-30T16:54:46.666735+0000","last_undegraded":"2024-05-30T16:54:46.666735+0000","last_fullsized":"2024-05-30T16:54:46.666735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:32.939644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663723+0000","last_change":"2024-05-30T16:54:45.653028+0000","last_active":"2024-05-30T16:54:46.663723+0000","last_peered":"2024-05-30T16:54:46.663723+0000","last_clean":"2024-05-30T16:54:46.663723+0000","last_became_active":"2024-05-30T16:54:45.652710+0000","last_became_peered":"2024-05-30T16:54:45.652710+0000","last_unstale":"2024-05-30T16:54:46.663723+0000","last_undegraded":"2024-05-30T16:54:46.663723+0000","last_fullsized":"2024-05-30T16:54:46.663723+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:31.936247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670882+0000","last_change":"2024-05-30T16:54:46.665362+0000","last_active":"2024-05-30T16:54:46.670882+0000","last_peered":"2024-05-30T16:54:46.670882+0000","last_clean":"2024-05-30T16:54:46.670882+0000","last_became_active":"2024-05-30T16:54:46.664731+0000","last_became_peered":"2024-05-30T16:54:46.664731+0000","last_unstale":"2024-05-30T16:54:46.670882+0000","last_undegraded":"2024-05-30T16:54:46.670882+0000","last_fullsized":"2024-05-30T16:54:46.670882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:59.959822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.645071+0000","last_change":"2024-05-30T16:54:45.653794+0000","last_active":"2024-05-30T16:54:46.645071+0000","last_peered":"2024-05-30T16:54:46.645071+0000","last_clean":"2024-05-30T16:54:46.645071+0000","last_became_active":"2024-05-30T16:54:45.652243+0000","last_became_peered":"2024-05-30T16:54:45.652243+0000","last_unstale":"2024-05-30T16:54:46.645071+0000","last_undegraded":"2024-05-30T16:54:46.645071+0000","last_fullsized":"2024-05-30T16:54:46.645071+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:41.075478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666830+0000","last_change":"2024-05-30T16:54:46.659899+0000","last_active":"2024-05-30T16:54:46.666830+0000","last_peered":"2024-05-30T16:54:46.666830+0000","last_clean":"2024-05-30T16:54:46.666830+0000","last_became_active":"2024-05-30T16:54:46.658860+0000","last_became_peered":"2024-05-30T16:54:46.658860+0000","last_unstale":"2024-05-30T16:54:46.666830+0000","last_undegraded":"2024-05-30T16:54:46.666830+0000","last_fullsized":"2024-05-30T16:54:46.666830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:35.259565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.644190+0000","last_change":"2024-05-30T16:54:45.652157+0000","last_active":"2024-05-30T16:54:46.644190+0000","last_peered":"2024-05-30T16:54:46.644190+0000","last_clean":"2024-05-30T16:54:46.644190+0000","last_became_active":"2024-05-30T16:54:45.651109+0000","last_became_peered":"2024-05-30T16:54:45.651109+0000","last_unstale":"2024-05-30T16:54:46.644190+0000","last_undegraded":"2024-05-30T16:54:46.644190+0000","last_fullsized":"2024-05-30T16:54:46.644190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:52.541652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.642572+0000","last_change":"2024-05-30T16:54:45.642572+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.642572+0000","last_undegraded":"2024-05-30T16:54:45.642572+0000","last_fullsized":"2024-05-30T16:54:45.642572+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.660933+0000","last_change":"2024-05-30T16:54:45.650576+0000","last_active":"2024-05-30T16:54:46.660933+0000","last_peered":"2024-05-30T16:54:46.660933+0000","last_clean":"2024-05-30T16:54:46.660933+0000","last_became_active":"2024-05-30T16:54:45.650316+0000","last_became_peered":"2024-05-30T16:54:45.650316+0000","last_unstale":"2024-05-30T16:54:46.660933+0000","last_undegraded":"2024-05-30T16:54:46.660933+0000","last_fullsized":"2024-05-30T16:54:46.660933+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:32:02.321051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663762+0000","last_change":"2024-05-30T16:54:46.660833+0000","last_active":"2024-05-30T16:54:46.663762+0000","last_peered":"2024-05-30T16:54:46.663762+0000","last_clean":"2024-05-30T16:54:46.663762+0000","last_became_active":"2024-05-30T16:54:46.660017+0000","last_became_peered":"2024-05-30T16:54:46.660017+0000","last_unstale":"2024-05-30T16:54:46.663762+0000","last_undegraded":"2024-05-30T16:54:46.663762+0000","last_fullsized":"2024-05-30T16:54:46.663762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.644778+0000","last_change":"2024-05-30T16:54:45.645109+0000","last_active":"2024-05-30T16:54:46.644778+0000","last_peered":"2024-05-30T16:54:46.644778+0000","last_clean":"2024-05-30T16:54:46.644778+0000","last_became_active":"2024-05-30T16:54:45.644753+0000","last_became_peered":"2024-05-30T16:54:45.644753+0000","last_unstale":"2024-05-30T16:54:46.644778+0000","last_undegraded":"2024-05-30T16:54:46.644778+0000","last_fullsized":"2024-05-30T16:54:46.644778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:57:37.286999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670848+0000","last_change":"2024-05-30T16:54:46.659487+0000","last_active":"2024-05-30T16:54:46.670848+0000","last_peered":"2024-05-30T16:54:46.670848+0000","last_clean":"2024-05-30T16:54:46.670848+0000","last_became_active":"2024-05-30T16:54:46.659243+0000","last_became_peered":"2024-05-30T16:54:46.659243+0000","last_unstale":"2024-05-30T16:54:46.670848+0000","last_undegraded":"2024-05-30T16:54:46.670848+0000","last_fullsized":"2024-05-30T16:54:46.670848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:33.056889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.660879+0000","last_change":"2024-05-30T16:54:45.654729+0000","last_active":"2024-05-30T16:54:46.660879+0000","last_peered":"2024-05-30T16:54:46.660879+0000","last_clean":"2024-05-30T16:54:46.660879+0000","last_became_active":"2024-05-30T16:54:45.654447+0000","last_became_peered":"2024-05-30T16:54:45.654447+0000","last_unstale":"2024-05-30T16:54:46.660879+0000","last_undegraded":"2024-05-30T16:54:46.660879+0000","last_fullsized":"2024-05-30T16:54:46.660879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:28.492293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.649949+0000","last_change":"2024-05-30T16:54:45.649949+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.649949+0000","last_undegraded":"2024-05-30T16:54:45.649949+0000","last_fullsized":"2024-05-30T16:54:45.649949+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.660891+0000","last_change":"2024-05-30T16:54:45.655443+0000","last_active":"2024-05-30T16:54:45.660891+0000","last_peered":"2024-05-30T16:54:45.660891+0000","last_clean":"2024-05-30T16:54:45.660891+0000","last_became_active":"2024-05-30T16:54:45.655068+0000","last_became_peered":"2024-05-30T16:54:45.655068+0000","last_unstale":"2024-05-30T16:54:45.660891+0000","last_undegraded":"2024-05-30T16:54:45.660891+0000","last_fullsized":"2024-05-30T16:54:45.660891+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:43:52.793573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.649866+0000","last_change":"2024-05-30T16:54:45.649866+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.649866+0000","last_undegraded":"2024-05-30T16:54:45.649866+0000","last_fullsized":"2024-05-30T16:54:45.649866+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.647166+0000","last_change":"2024-05-30T16:54:45.654457+0000","last_active":"2024-05-30T16:54:46.647166+0000","last_peered":"2024-05-30T16:54:46.647166+0000","last_clean":"2024-05-30T16:54:46.647166+0000","last_became_active":"2024-05-30T16:54:45.654115+0000","last_became_peered":"2024-05-30T16:54:45.654115+0000","last_unstale":"2024-05-30T16:54:46.647166+0000","last_undegraded":"2024-05-30T16:54:46.647166+0000","last_fullsized":"2024-05-30T16:54:46.647166+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:38.027264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":244,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.648534+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:54:46.648534+0000","last_peered":"2024-05-30T16:54:46.648534+0000","last_clean":"2024-05-30T16:54:46.648534+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:54:46.648534+0000","last_undegraded":"2024-05-30T16:54:46.648534+0000","last_fullsized":"2024-05-30T16:54:46.648534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509513,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44948,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326892,"statfs":{"total":96636764160,"available":96590737408,"internally_reserved":0,"allocated":1318912,"data_stored":891249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509514,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45780,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326060,"statfs":{"total":96636764160,"available":96589885440,"internally_reserved":0,"allocated":724992,"data_stored":300881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509514,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40216,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331624,"statfs":{"total":96636764160,"available":96595582976,"internally_reserved":0,"allocated":733184,"data_stored":301533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45768,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326072,"statfs":{"total":96636764160,"available":96589897728,"internally_reserved":0,"allocated":712704,"data_stored":294050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44384,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327456,"statfs":{"total":96636764160,"available":96591314944,"internally_reserved":0,"allocated":733184,"data_stored":300937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45780,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326060,"statfs":{"total":96636764160,"available":96589885440,"internally_reserved":0,"allocated":729088,"data_stored":300971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509514,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46376,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325464,"statfs":{"total":96636764160,"available":96589275136,"internally_reserved":0,"allocated":1335296,"data_stored":893443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542218,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45752,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326088,"statfs":{"total":96636764160,"available":96589914112,"internally_reserved":0,"allocated":700416,"data_stored":287727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:54:51.596 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3e is not active+clean 2024-05-30T16:54:51.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.646545+0000', 'last_change': '2024-05-30T16:54:45.646545+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.646545+0000', 'last_undegraded': '2024-05-30T16:54:45.646545+0000', 'last_fullsized': '2024-05-30T16:54:45.646545+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.596 INFO:tasks.ceph.ceph_manager.ceph:PG 9.38 is not active+clean 2024-05-30T16:54:51.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.648247+0000', 'last_change': '2024-05-30T16:54:45.648247+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.648247+0000', 'last_undegraded': '2024-05-30T16:54:45.648247+0000', 'last_fullsized': '2024-05-30T16:54:45.648247+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.596 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2f is not active+clean 2024-05-30T16:54:51.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.646987+0000', 'last_change': '2024-05-30T16:54:45.646987+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.646987+0000', 'last_undegraded': '2024-05-30T16:54:45.646987+0000', 'last_fullsized': '2024-05-30T16:54:45.646987+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.596 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2c is not active+clean 2024-05-30T16:54:51.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.645176+0000', 'last_change': '2024-05-30T16:54:45.645176+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.645176+0000', 'last_undegraded': '2024-05-30T16:54:45.645176+0000', 'last_fullsized': '2024-05-30T16:54:45.645176+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.597 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2a is not active+clean 2024-05-30T16:54:51.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.642021+0000', 'last_change': '2024-05-30T16:54:45.642021+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.642021+0000', 'last_undegraded': '2024-05-30T16:54:45.642021+0000', 'last_fullsized': '2024-05-30T16:54:45.642021+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.597 INFO:tasks.ceph.ceph_manager.ceph:PG 9.23 is not active+clean 2024-05-30T16:54:51.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.645874+0000', 'last_change': '2024-05-30T16:54:45.645874+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.645874+0000', 'last_undegraded': '2024-05-30T16:54:45.645874+0000', 'last_fullsized': '2024-05-30T16:54:45.645874+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.597 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1a is not active+clean 2024-05-30T16:54:51.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.643013+0000', 'last_change': '2024-05-30T16:54:45.643013+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.643013+0000', 'last_undegraded': '2024-05-30T16:54:45.643013+0000', 'last_fullsized': '2024-05-30T16:54:45.643013+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.597 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-05-30T16:54:51.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.646670+0000', 'last_change': '2024-05-30T16:54:45.646670+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.646670+0000', 'last_undegraded': '2024-05-30T16:54:45.646670+0000', 'last_fullsized': '2024-05-30T16:54:45.646670+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.597 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-05-30T16:54:51.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.650395+0000', 'last_change': '2024-05-30T16:54:45.650395+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.650395+0000', 'last_undegraded': '2024-05-30T16:54:45.650395+0000', 'last_fullsized': '2024-05-30T16:54:45.650395+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.598 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-05-30T16:54:51.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.644782+0000', 'last_change': '2024-05-30T16:54:45.644782+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.644782+0000', 'last_undegraded': '2024-05-30T16:54:45.644782+0000', 'last_fullsized': '2024-05-30T16:54:45.644782+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.598 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-05-30T16:54:51.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.642572+0000', 'last_change': '2024-05-30T16:54:45.642572+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.642572+0000', 'last_undegraded': '2024-05-30T16:54:45.642572+0000', 'last_fullsized': '2024-05-30T16:54:45.642572+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.598 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-05-30T16:54:51.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.649949+0000', 'last_change': '2024-05-30T16:54:45.649949+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.649949+0000', 'last_undegraded': '2024-05-30T16:54:45.649949+0000', 'last_fullsized': '2024-05-30T16:54:45.649949+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.598 INFO:tasks.ceph.ceph_manager.ceph:PG 9.8 is not active+clean 2024-05-30T16:54:51.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:54:45.649866+0000', 'last_change': '2024-05-30T16:54:45.649866+0000', 'last_active': '2024-05-30T16:54:45.627785+0000', 'last_peered': '2024-05-30T16:54:45.627785+0000', 'last_clean': '2024-05-30T16:54:45.627785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:54:45.649866+0000', 'last_undegraded': '2024-05-30T16:54:45.649866+0000', 'last_fullsized': '2024-05-30T16:54:45.649866+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'last_clean_scrub_stamp': '2024-05-30T16:54:45.627785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:54:51.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T16:54:51.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.767+0000 7f05e5a00640 1 Processor -- start 2024-05-30T16:54:51.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.767+0000 7f05e5a00640 1 -- start start 2024-05-30T16:54:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05e5a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f05e00b37a0 0x7f05e00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05e5a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05e00cdb60 0x7f05e00cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05e5a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e00d0260 con 0x7f05e009aa40 2024-05-30T16:54:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05e5a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f05e00d0010 con 0x7f05e00cdb60 2024-05-30T16:54:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05e5a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f05e00d0540 con 0x7f05e00b37a0 2024-05-30T16:54:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05d6000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05e00cdb60 0x7f05e00cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05d6000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05e00cdb60 0x7f05e00cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34928/0 (socket says 172.21.15.59:34928) 2024-05-30T16:54:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05d6000640 1 -- 172.21.15.59:0/942760658 learned_addr learned my addr 172.21.15.59:0/942760658 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05dea00640 1 --2- 172.21.15.59:0/942760658 >> v2:172.21.15.107:3300/0 conn(0x7f05e00b37a0 0x7f05e00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:51.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05d6000640 1 -- 172.21.15.59:0/942760658 >> v2:172.21.15.107:3300/0 conn(0x7f05e00b37a0 msgr2=0x7f05e00d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:51.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05d6000640 1 --2- 172.21.15.59:0/942760658 >> v2:172.21.15.107:3300/0 conn(0x7f05e00b37a0 0x7f05e00d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05d6000640 1 -- 172.21.15.59:0/942760658 >> v1:172.21.15.107:6789/0 conn(0x7f05e009aa40 legacy=0x7f05e00b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:51.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.771+0000 7f05d6000640 1 -- 172.21.15.59:0/942760658 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e00d0820 con 0x7f05e00cdb60 2024-05-30T16:54:51.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05d6000640 1 --2- 172.21.15.59:0/942760658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05e00cdb60 0x7f05e00cdfc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f05e006c990 tx=0x7f05c801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a41747515a0dfb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05de000640 1 -- 172.21.15.59:0/942760658 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c80b0070 con 0x7f05e00cdb60 2024-05-30T16:54:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05de000640 1 -- 172.21.15.59:0/942760658 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c80ab600 con 0x7f05e00cdb60 2024-05-30T16:54:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05de000640 1 -- 172.21.15.59:0/942760658 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c80ab9d0 con 0x7f05e00cdb60 2024-05-30T16:54:51.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 -- 172.21.15.59:0/942760658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05e00cdb60 msgr2=0x7f05e00cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:51.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 --2- 172.21.15.59:0/942760658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05e00cdb60 0x7f05e00cdfc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f05e006c990 tx=0x7f05c801c490 comp rx=0 tx=0).stop 2024-05-30T16:54:51.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 -- 172.21.15.59:0/942760658 shutdown_connections 2024-05-30T16:54:51.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 --2- 172.21.15.59:0/942760658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05e00cdb60 0x7f05e00cdfc0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 --2- 172.21.15.59:0/942760658 >> v2:172.21.15.107:3300/0 conn(0x7f05e00b37a0 0x7f05e00d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 -- 172.21.15.59:0/942760658 >> 172.21.15.59:0/942760658 conn(0x7f05e00b3f30 msgr2=0x7f05e00b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:51.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 -- 172.21.15.59:0/942760658 shutdown_connections 2024-05-30T16:54:51.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 -- 172.21.15.59:0/942760658 wait complete. 2024-05-30T16:54:51.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 Processor -- start 2024-05-30T16:54:51.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 -- start start 2024-05-30T16:54:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05e009aa40 0x7f05e00c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e00b37a0 0x7f05e015bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05e00cdb60 0x7f05e015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f05e0169810 con 0x7f05e00cdb60 2024-05-30T16:54:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f05e0169690 con 0x7f05e00b37a0 2024-05-30T16:54:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.775+0000 7f05e5a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f05e0169990 con 0x7f05e009aa40 2024-05-30T16:54:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05df400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05e00cdb60 0x7f05e015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05df400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05e00cdb60 0x7f05e015c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34938/0 (socket says 172.21.15.59:34938) 2024-05-30T16:54:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05df400640 1 -- 172.21.15.59:0/348787898 learned_addr learned my addr 172.21.15.59:0/348787898 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05dea00640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05e009aa40 0x7f05e00c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05d6000640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e00b37a0 0x7f05e015bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05df400640 1 -- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05e009aa40 msgr2=0x7f05e00c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05df400640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05e009aa40 0x7f05e00c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05df400640 1 -- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e00b37a0 msgr2=0x7f05e015bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05df400640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e00b37a0 0x7f05e015bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05df400640 1 -- 172.21.15.59:0/348787898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e00cb670 con 0x7f05e00cdb60 2024-05-30T16:54:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05df400640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05e00cdb60 0x7f05e015c320 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c760 tx=0x7f05d800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05d7400640 1 -- 172.21.15.59:0/348787898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8016020 con 0x7f05e00cdb60 2024-05-30T16:54:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05d7400640 1 -- 172.21.15.59:0/348787898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d8006d60 con 0x7f05e00cdb60 2024-05-30T16:54:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05d7400640 1 -- 172.21.15.59:0/348787898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8003bc0 con 0x7f05e00cdb60 2024-05-30T16:54:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05e5a00640 1 -- 172.21.15.59:0/348787898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e00cb950 con 0x7f05e00cdb60 2024-05-30T16:54:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05e5a00640 1 -- 172.21.15.59:0/348787898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e00cbf10 con 0x7f05e00cdb60 2024-05-30T16:54:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05e5a00640 1 -- 172.21.15.59:0/348787898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e0068a90 con 0x7f05e00cdb60 2024-05-30T16:54:51.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.779+0000 7f05d7400640 1 -- 172.21.15.59:0/348787898 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f05d80050d0 con 0x7f05e00cdb60 2024-05-30T16:54:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.783+0000 7f05d7400640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f05bc068b60 0x7f05bc06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.783+0000 7f05d7400640 1 -- 172.21.15.59:0/348787898 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f05d80876c0 con 0x7f05e00cdb60 2024-05-30T16:54:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.783+0000 7f05dea00640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f05bc068b60 0x7f05bc06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:51.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.783+0000 7f05dea00640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f05bc068b60 0x7f05bc06b020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f05d0006fd0 tx=0x7f05d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:51.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:51.787+0000 7f05d7400640 1 -- 172.21.15.59:0/348787898 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f05d8020020 con 0x7f05e00cdb60 2024-05-30T16:54:52.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 -- 172.21.15.59:0/348787898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f05e006ffe0 con 0x7f05e00cdb60 2024-05-30T16:54:52.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05d7400640 1 -- 172.21.15.59:0/348787898 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1098 (secure 0 0 0) 0x7f05d80566a0 con 0x7f05e00cdb60 2024-05-30T16:54:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:52.010 INFO:teuthology.orchestra.run.smithi059.stdout:{"fsid":"97857630-028c-48a2-897f-bf5f996be133","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":371,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1717087732,"num_in_osds":8,"osd_in_since":1717087722,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":84},{"state_name":"creating+peering","count":13}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":592722,"bytes_used":367620096,"bytes_avail":772726493184,"bytes_total":773094113280,"inactive_pgs_ratio":0.1340206116437912,"write_bytes_sec":1023,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":34,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5865}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-05-30T16:53:19.132075+0000","services":{}},"progress_events":{}} 2024-05-30T16:54:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 -- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f05bc068b60 msgr2=0x7f05bc06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f05bc068b60 0x7f05bc06b020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f05d0006fd0 tx=0x7f05d0008040 comp rx=0 tx=0).stop 2024-05-30T16:54:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 -- 172.21.15.59:0/348787898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05e00cdb60 msgr2=0x7f05e015c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05e00cdb60 0x7f05e015c320 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c760 tx=0x7f05d800cb60 comp rx=0 tx=0).stop 2024-05-30T16:54:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 -- 172.21.15.59:0/348787898 shutdown_connections 2024-05-30T16:54:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f05bc068b60 0x7f05bc06b020 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05e00cdb60 0x7f05e015c320 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e00b37a0 0x7f05e015bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 --2- 172.21.15.59:0/348787898 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05e009aa40 0x7f05e00c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 -- 172.21.15.59:0/348787898 >> 172.21.15.59:0/348787898 conn(0x7f05e00b3f30 msgr2=0x7f05e00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 -- 172.21.15.59:0/348787898 shutdown_connections 2024-05-30T16:54:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.007+0000 7f05e5a00640 1 -- 172.21.15.59:0/348787898 wait complete. 2024-05-30T16:54:52.031 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-30T16:54:52.031 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:54:52.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.167+0000 7f7cd6c00640 1 Processor -- start 2024-05-30T16:54:52.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.167+0000 7f7cd6c00640 1 -- start start 2024-05-30T16:54:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.167+0000 7f7cd6c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7cd0159df0 0x7f7cd00ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.167+0000 7f7cd6c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd015a1d0 0x7f7cd00ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.167+0000 7f7cd6c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd015d730 con 0x7f7cd00b3e50 2024-05-30T16:54:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.167+0000 7f7cd6c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f7cd00b3370 con 0x7f7cd0159df0 2024-05-30T16:54:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.167+0000 7f7cd6c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd00b3650 con 0x7f7cd015a1d0 2024-05-30T16:54:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.167+0000 7f7ccfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7cd0159df0 0x7f7cd00ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7ccfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7cd0159df0 0x7f7cd00ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42650/0 (socket says 172.21.15.59:42650) 2024-05-30T16:54:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7ccfe00640 1 -- 172.21.15.59:0/1896117651 learned_addr learned my addr 172.21.15.59:0/1896117651 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7cc7400640 1 --2- 172.21.15.59:0/1896117651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd015a1d0 0x7f7cd00ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7ccfe00640 1 -- 172.21.15.59:0/1896117651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd015a1d0 msgr2=0x7f7cd00ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7ccfe00640 1 --2- 172.21.15.59:0/1896117651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd015a1d0 0x7f7cd00ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7ccfe00640 1 -- 172.21.15.59:0/1896117651 >> v1:172.21.15.107:6789/0 conn(0x7f7cd00b3e50 legacy=0x7f7cd015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7ccfe00640 1 -- 172.21.15.59:0/1896117651 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd00b3930 con 0x7f7cd0159df0 2024-05-30T16:54:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7ccfe00640 1 --2- 172.21.15.59:0/1896117651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd0159df0 0x7f7cd00ad1b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009870 tx=0x7f7cc001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e9ea3fe67cd1b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7ccf400640 1 -- 172.21.15.59:0/1896117651 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00b0070 con 0x7f7cd0159df0 2024-05-30T16:54:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7ccf400640 1 -- 172.21.15.59:0/1896117651 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc00ab600 con 0x7f7cd0159df0 2024-05-30T16:54:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7ccf400640 1 -- 172.21.15.59:0/1896117651 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00ab9d0 con 0x7f7cd0159df0 2024-05-30T16:54:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7cd6c00640 1 -- 172.21.15.59:0/1896117651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd0159df0 msgr2=0x7f7cd00ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.171+0000 7f7cd6c00640 1 --2- 172.21.15.59:0/1896117651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd0159df0 0x7f7cd00ad1b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009870 tx=0x7f7cc001c520 comp rx=0 tx=0).stop 2024-05-30T16:54:52.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 -- 172.21.15.59:0/1896117651 shutdown_connections 2024-05-30T16:54:52.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 --2- 172.21.15.59:0/1896117651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd015a1d0 0x7f7cd00ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 --2- 172.21.15.59:0/1896117651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd0159df0 0x7f7cd00ad1b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 -- 172.21.15.59:0/1896117651 >> 172.21.15.59:0/1896117651 conn(0x7f7cd00b22d0 msgr2=0x7f7cd00b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:52.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 -- 172.21.15.59:0/1896117651 shutdown_connections 2024-05-30T16:54:52.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 -- 172.21.15.59:0/1896117651 wait complete. 2024-05-30T16:54:52.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 Processor -- start 2024-05-30T16:54:52.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 -- start start 2024-05-30T16:54:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd00b3e50 0x7f7cd0157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cd0159df0 0x7f7cd0150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd015a1d0 0x7f7cd0154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd015e720 con 0x7f7cd00b3e50 2024-05-30T16:54:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd015e5a0 con 0x7f7cd0159df0 2024-05-30T16:54:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd015e8a0 con 0x7f7cd015a1d0 2024-05-30T16:54:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7ccfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd00b3e50 0x7f7cd0157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7ccfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd00b3e50 0x7f7cd0157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42654/0 (socket says 172.21.15.59:42654) 2024-05-30T16:54:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7ccfe00640 1 -- 172.21.15.59:0/2774294050 learned_addr learned my addr 172.21.15.59:0/2774294050 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cc7400640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cd0159df0 0x7f7cd0150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd4c00640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd015a1d0 0x7f7cd0154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7ccfe00640 1 -- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd015a1d0 msgr2=0x7f7cd0154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7ccfe00640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd015a1d0 0x7f7cd0154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7ccfe00640 1 -- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cd0159df0 msgr2=0x7f7cd0150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7ccfe00640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cd0159df0 0x7f7cd0150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7ccfe00640 1 -- 172.21.15.59:0/2774294050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd0151100 con 0x7f7cd00b3e50 2024-05-30T16:54:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cc7400640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cd0159df0 0x7f7cd0150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7ccfe00640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd00b3e50 0x7f7cd0157060 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00ae040 tx=0x7f7cc001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cccc00640 1 -- 172.21.15.59:0/2774294050 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00b0040 con 0x7f7cd00b3e50 2024-05-30T16:54:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cccc00640 1 -- 172.21.15.59:0/2774294050 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc00bc070 con 0x7f7cd00b3e50 2024-05-30T16:54:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cccc00640 1 -- 172.21.15.59:0/2774294050 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00aac30 con 0x7f7cd00b3e50 2024-05-30T16:54:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.175+0000 7f7cd6c00640 1 -- 172.21.15.59:0/2774294050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd01f9dc0 con 0x7f7cd00b3e50 2024-05-30T16:54:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.179+0000 7f7cd6c00640 1 -- 172.21.15.59:0/2774294050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd0157d50 con 0x7f7cd00b3e50 2024-05-30T16:54:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.179+0000 7f7cd6c00640 1 -- 172.21.15.59:0/2774294050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd0068a90 con 0x7f7cd00b3e50 2024-05-30T16:54:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.179+0000 7f7cccc00640 1 -- 172.21.15.59:0/2774294050 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f7cc00ab4c0 con 0x7f7cd00b3e50 2024-05-30T16:54:52.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.179+0000 7f7cccc00640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7cac068b60 0x7f7cac06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:52.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.179+0000 7f7cccc00640 1 -- 172.21.15.59:0/2774294050 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f7cc01220a0 con 0x7f7cd00b3e50 2024-05-30T16:54:52.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.179+0000 7f7cc7400640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7cac068b60 0x7f7cac06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:52.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.183+0000 7f7cc7400640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7cac068b60 0x7f7cac06b020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7cd01673c0 tx=0x7f7cb8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:52.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.183+0000 7f7cccc00640 1 -- 172.21.15.59:0/2774294050 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7cc0016110 con 0x7f7cd00b3e50 2024-05-30T16:54:52.252 INFO:tasks.ceph.mds.c.smithi059.stderr:2024-05-30T16:54:52.251+0000 7fa3acc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:54:52.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.343+0000 7f7cd6c00640 1 -- 172.21.15.59:0/2774294050 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7cd00ae600 con 0x7f7cac068b60 2024-05-30T16:54:52.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.351+0000 7f7cccc00640 1 -- 172.21.15.59:0/2774294050 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250828 (secure 0 0 0) 0x7f7cd00ae600 con 0x7f7cac068b60 2024-05-30T16:54:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:52.360 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:54:52.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.355+0000 7f7cd6c00640 1 -- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7cac068b60 msgr2=0x7f7cac06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:52.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.355+0000 7f7cd6c00640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7cac068b60 0x7f7cac06b020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7cd01673c0 tx=0x7f7cb8008040 comp rx=0 tx=0).stop 2024-05-30T16:54:52.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.355+0000 7f7cd6c00640 1 -- 172.21.15.59:0/2774294050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd00b3e50 msgr2=0x7f7cd0157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:52.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.355+0000 7f7cd6c00640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd00b3e50 0x7f7cd0157060 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00ae040 tx=0x7f7cc001ad60 comp rx=0 tx=0).stop 2024-05-30T16:54:52.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.355+0000 7f7cd6c00640 1 -- 172.21.15.59:0/2774294050 shutdown_connections 2024-05-30T16:54:52.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.355+0000 7f7cd6c00640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7cac068b60 0x7f7cac06b020 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.355+0000 7f7cd6c00640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd015a1d0 0x7f7cd0154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.355+0000 7f7cd6c00640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cd0159df0 0x7f7cd0150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.355+0000 7f7cd6c00640 1 --2- 172.21.15.59:0/2774294050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd00b3e50 0x7f7cd0157060 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.355+0000 7f7cd6c00640 1 -- 172.21.15.59:0/2774294050 >> 172.21.15.59:0/2774294050 conn(0x7f7cd00b22d0 msgr2=0x7f7cd00af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.355+0000 7f7cd6c00640 1 -- 172.21.15.59:0/2774294050 shutdown_connections 2024-05-30T16:54:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:52.355+0000 7f7cd6c00640 1 -- 172.21.15.59:0/2774294050 wait complete. 2024-05-30T16:54:52.377 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-05-30T16:54:51.162969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":359004,"kb_used_data":6824,"kb_used_omap":12,"kb_used_meta":352051,"kb_avail":754615716,"statfs":{"total":773094113280,"available":772726493184,"internally_reserved":0,"allocated":6987776,"data_stored":3570791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":360500784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001500"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.661703+0000","last_change":"2024-05-30T16:54:46.653537+0000","last_active":"2024-05-30T16:54:46.661703+0000","last_peered":"2024-05-30T16:54:46.661703+0000","last_clean":"2024-05-30T16:54:46.661703+0000","last_became_active":"2024-05-30T16:54:46.653287+0000","last_became_peered":"2024-05-30T16:54:46.653287+0000","last_unstale":"2024-05-30T16:54:46.661703+0000","last_undegraded":"2024-05-30T16:54:46.661703+0000","last_fullsized":"2024-05-30T16:54:46.661703+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:53.883132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.646545+0000","last_change":"2024-05-30T16:54:45.646545+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.646545+0000","last_undegraded":"2024-05-30T16:54:45.646545+0000","last_fullsized":"2024-05-30T16:54:45.646545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.665343+0000","last_change":"2024-05-30T16:54:46.658753+0000","last_active":"2024-05-30T16:54:46.665343+0000","last_peered":"2024-05-30T16:54:46.665343+0000","last_clean":"2024-05-30T16:54:46.665343+0000","last_became_active":"2024-05-30T16:54:46.658476+0000","last_became_peered":"2024-05-30T16:54:46.658476+0000","last_unstale":"2024-05-30T16:54:46.665343+0000","last_undegraded":"2024-05-30T16:54:46.665343+0000","last_fullsized":"2024-05-30T16:54:46.665343+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:49.445877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668376+0000","last_change":"2024-05-30T16:54:46.662427+0000","last_active":"2024-05-30T16:54:46.668376+0000","last_peered":"2024-05-30T16:54:46.668376+0000","last_clean":"2024-05-30T16:54:46.668376+0000","last_became_active":"2024-05-30T16:54:46.662157+0000","last_became_peered":"2024-05-30T16:54:46.662157+0000","last_unstale":"2024-05-30T16:54:46.668376+0000","last_undegraded":"2024-05-30T16:54:46.668376+0000","last_fullsized":"2024-05-30T16:54:46.668376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:43.670842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670358+0000","last_change":"2024-05-30T16:54:46.660389+0000","last_active":"2024-05-30T16:54:46.670358+0000","last_peered":"2024-05-30T16:54:46.670358+0000","last_clean":"2024-05-30T16:54:46.670358+0000","last_became_active":"2024-05-30T16:54:46.660137+0000","last_became_peered":"2024-05-30T16:54:46.660137+0000","last_unstale":"2024-05-30T16:54:46.670358+0000","last_undegraded":"2024-05-30T16:54:46.670358+0000","last_fullsized":"2024-05-30T16:54:46.670358+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:33.138067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671112+0000","last_change":"2024-05-30T16:54:46.666587+0000","last_active":"2024-05-30T16:54:46.671112+0000","last_peered":"2024-05-30T16:54:46.671112+0000","last_clean":"2024-05-30T16:54:46.671112+0000","last_became_active":"2024-05-30T16:54:46.663836+0000","last_became_peered":"2024-05-30T16:54:46.663836+0000","last_unstale":"2024-05-30T16:54:46.671112+0000","last_undegraded":"2024-05-30T16:54:46.671112+0000","last_fullsized":"2024-05-30T16:54:46.671112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:49:29.390734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.649812+0000","last_change":"2024-05-30T16:54:46.648712+0000","last_active":"2024-05-30T16:54:46.649812+0000","last_peered":"2024-05-30T16:54:46.649812+0000","last_clean":"2024-05-30T16:54:46.649812+0000","last_became_active":"2024-05-30T16:54:46.648462+0000","last_became_peered":"2024-05-30T16:54:46.648462+0000","last_unstale":"2024-05-30T16:54:46.649812+0000","last_undegraded":"2024-05-30T16:54:46.649812+0000","last_fullsized":"2024-05-30T16:54:46.649812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:52:39.449932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.648247+0000","last_change":"2024-05-30T16:54:45.648247+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.648247+0000","last_undegraded":"2024-05-30T16:54:45.648247+0000","last_fullsized":"2024-05-30T16:54:45.648247+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670868+0000","last_change":"2024-05-30T16:54:46.661707+0000","last_active":"2024-05-30T16:54:46.670868+0000","last_peered":"2024-05-30T16:54:46.670868+0000","last_clean":"2024-05-30T16:54:46.670868+0000","last_became_active":"2024-05-30T16:54:46.661402+0000","last_became_peered":"2024-05-30T16:54:46.661402+0000","last_unstale":"2024-05-30T16:54:46.670868+0000","last_undegraded":"2024-05-30T16:54:46.670868+0000","last_fullsized":"2024-05-30T16:54:46.670868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:47.830462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.676122+0000","last_change":"2024-05-30T16:54:46.672351+0000","last_active":"2024-05-30T16:54:46.676122+0000","last_peered":"2024-05-30T16:54:46.676122+0000","last_clean":"2024-05-30T16:54:46.676122+0000","last_became_active":"2024-05-30T16:54:46.672097+0000","last_became_peered":"2024-05-30T16:54:46.672097+0000","last_unstale":"2024-05-30T16:54:46.676122+0000","last_undegraded":"2024-05-30T16:54:46.676122+0000","last_fullsized":"2024-05-30T16:54:46.676122+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:42.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675941+0000","last_change":"2024-05-30T16:54:46.669733+0000","last_active":"2024-05-30T16:54:46.675941+0000","last_peered":"2024-05-30T16:54:46.675941+0000","last_clean":"2024-05-30T16:54:46.675941+0000","last_became_active":"2024-05-30T16:54:46.666565+0000","last_became_peered":"2024-05-30T16:54:46.666565+0000","last_unstale":"2024-05-30T16:54:46.675941+0000","last_undegraded":"2024-05-30T16:54:46.675941+0000","last_fullsized":"2024-05-30T16:54:46.675941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:25.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668399+0000","last_change":"2024-05-30T16:54:46.665480+0000","last_active":"2024-05-30T16:54:46.668399+0000","last_peered":"2024-05-30T16:54:46.668399+0000","last_clean":"2024-05-30T16:54:46.668399+0000","last_became_active":"2024-05-30T16:54:46.665069+0000","last_became_peered":"2024-05-30T16:54:46.665069+0000","last_unstale":"2024-05-30T16:54:46.668399+0000","last_undegraded":"2024-05-30T16:54:46.668399+0000","last_fullsized":"2024-05-30T16:54:46.668399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:18.915849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664156+0000","last_change":"2024-05-30T16:54:46.657415+0000","last_active":"2024-05-30T16:54:46.664156+0000","last_peered":"2024-05-30T16:54:46.664156+0000","last_clean":"2024-05-30T16:54:46.664156+0000","last_became_active":"2024-05-30T16:54:46.655817+0000","last_became_peered":"2024-05-30T16:54:46.655817+0000","last_unstale":"2024-05-30T16:54:46.664156+0000","last_undegraded":"2024-05-30T16:54:46.664156+0000","last_fullsized":"2024-05-30T16:54:46.664156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:50:40.823158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.655382+0000","last_change":"2024-05-30T16:54:46.653603+0000","last_active":"2024-05-30T16:54:46.655382+0000","last_peered":"2024-05-30T16:54:46.655382+0000","last_clean":"2024-05-30T16:54:46.655382+0000","last_became_active":"2024-05-30T16:54:46.653302+0000","last_became_peered":"2024-05-30T16:54:46.653302+0000","last_unstale":"2024-05-30T16:54:46.655382+0000","last_undegraded":"2024-05-30T16:54:46.655382+0000","last_fullsized":"2024-05-30T16:54:46.655382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:57:14.688215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670838+0000","last_change":"2024-05-30T16:54:46.662800+0000","last_active":"2024-05-30T16:54:46.670838+0000","last_peered":"2024-05-30T16:54:46.670838+0000","last_clean":"2024-05-30T16:54:46.670838+0000","last_became_active":"2024-05-30T16:54:46.662524+0000","last_became_peered":"2024-05-30T16:54:46.662524+0000","last_unstale":"2024-05-30T16:54:46.670838+0000","last_undegraded":"2024-05-30T16:54:46.670838+0000","last_fullsized":"2024-05-30T16:54:46.670838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:05.577972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664583+0000","last_change":"2024-05-30T16:54:46.657592+0000","last_active":"2024-05-30T16:54:46.664583+0000","last_peered":"2024-05-30T16:54:46.664583+0000","last_clean":"2024-05-30T16:54:46.664583+0000","last_became_active":"2024-05-30T16:54:46.656008+0000","last_became_peered":"2024-05-30T16:54:46.656008+0000","last_unstale":"2024-05-30T16:54:46.664583+0000","last_undegraded":"2024-05-30T16:54:46.664583+0000","last_fullsized":"2024-05-30T16:54:46.664583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:05.577972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.646987+0000","last_change":"2024-05-30T16:54:45.646987+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.646987+0000","last_undegraded":"2024-05-30T16:54:45.646987+0000","last_fullsized":"2024-05-30T16:54:45.646987+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.673804+0000","last_change":"2024-05-30T16:54:46.669925+0000","last_active":"2024-05-30T16:54:46.673804+0000","last_peered":"2024-05-30T16:54:46.673804+0000","last_clean":"2024-05-30T16:54:46.673804+0000","last_became_active":"2024-05-30T16:54:46.669377+0000","last_became_peered":"2024-05-30T16:54:46.669377+0000","last_unstale":"2024-05-30T16:54:46.673804+0000","last_undegraded":"2024-05-30T16:54:46.673804+0000","last_fullsized":"2024-05-30T16:54:46.673804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:18.915849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.661945+0000","last_change":"2024-05-30T16:54:46.652970+0000","last_active":"2024-05-30T16:54:46.661945+0000","last_peered":"2024-05-30T16:54:46.661945+0000","last_clean":"2024-05-30T16:54:46.661945+0000","last_became_active":"2024-05-30T16:54:46.652703+0000","last_became_peered":"2024-05-30T16:54:46.652703+0000","last_unstale":"2024-05-30T16:54:46.661945+0000","last_undegraded":"2024-05-30T16:54:46.661945+0000","last_fullsized":"2024-05-30T16:54:46.661945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:05.374326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.645176+0000","last_change":"2024-05-30T16:54:45.645176+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.645176+0000","last_undegraded":"2024-05-30T16:54:45.645176+0000","last_fullsized":"2024-05-30T16:54:45.645176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663695+0000","last_change":"2024-05-30T16:54:46.659978+0000","last_active":"2024-05-30T16:54:46.663695+0000","last_peered":"2024-05-30T16:54:46.663695+0000","last_clean":"2024-05-30T16:54:46.663695+0000","last_became_active":"2024-05-30T16:54:46.659698+0000","last_became_peered":"2024-05-30T16:54:46.659698+0000","last_unstale":"2024-05-30T16:54:46.663695+0000","last_undegraded":"2024-05-30T16:54:46.663695+0000","last_fullsized":"2024-05-30T16:54:46.663695+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:53.545049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.642021+0000","last_change":"2024-05-30T16:54:45.642021+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.642021+0000","last_undegraded":"2024-05-30T16:54:45.642021+0000","last_fullsized":"2024-05-30T16:54:45.642021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670643+0000","last_change":"2024-05-30T16:54:46.666968+0000","last_active":"2024-05-30T16:54:46.670643+0000","last_peered":"2024-05-30T16:54:46.670643+0000","last_clean":"2024-05-30T16:54:46.670643+0000","last_became_active":"2024-05-30T16:54:46.666488+0000","last_became_peered":"2024-05-30T16:54:46.666488+0000","last_unstale":"2024-05-30T16:54:46.670643+0000","last_undegraded":"2024-05-30T16:54:46.670643+0000","last_fullsized":"2024-05-30T16:54:46.670643+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:32.939644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.657728+0000","last_change":"2024-05-30T16:54:46.656716+0000","last_active":"2024-05-30T16:54:46.657728+0000","last_peered":"2024-05-30T16:54:46.657728+0000","last_clean":"2024-05-30T16:54:46.657728+0000","last_became_active":"2024-05-30T16:54:46.656437+0000","last_became_peered":"2024-05-30T16:54:46.656437+0000","last_unstale":"2024-05-30T16:54:46.657728+0000","last_undegraded":"2024-05-30T16:54:46.657728+0000","last_fullsized":"2024-05-30T16:54:46.657728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:30.131348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675046+0000","last_change":"2024-05-30T16:54:46.669569+0000","last_active":"2024-05-30T16:54:46.675046+0000","last_peered":"2024-05-30T16:54:46.675046+0000","last_clean":"2024-05-30T16:54:46.675046+0000","last_became_active":"2024-05-30T16:54:46.669337+0000","last_became_peered":"2024-05-30T16:54:46.669337+0000","last_unstale":"2024-05-30T16:54:46.675046+0000","last_undegraded":"2024-05-30T16:54:46.675046+0000","last_fullsized":"2024-05-30T16:54:46.675046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:49:46.787342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.650983+0000","last_change":"2024-05-30T16:54:46.648131+0000","last_active":"2024-05-30T16:54:46.650983+0000","last_peered":"2024-05-30T16:54:46.650983+0000","last_clean":"2024-05-30T16:54:46.650983+0000","last_became_active":"2024-05-30T16:54:46.647835+0000","last_became_peered":"2024-05-30T16:54:46.647835+0000","last_unstale":"2024-05-30T16:54:46.650983+0000","last_undegraded":"2024-05-30T16:54:46.650983+0000","last_fullsized":"2024-05-30T16:54:46.650983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668308+0000","last_change":"2024-05-30T16:54:46.664412+0000","last_active":"2024-05-30T16:54:46.668308+0000","last_peered":"2024-05-30T16:54:46.668308+0000","last_clean":"2024-05-30T16:54:46.668308+0000","last_became_active":"2024-05-30T16:54:46.664116+0000","last_became_peered":"2024-05-30T16:54:46.664116+0000","last_unstale":"2024-05-30T16:54:46.668308+0000","last_undegraded":"2024-05-30T16:54:46.668308+0000","last_fullsized":"2024-05-30T16:54:46.668308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:24:18.915849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670559+0000","last_change":"2024-05-30T16:54:46.665560+0000","last_active":"2024-05-30T16:54:46.670559+0000","last_peered":"2024-05-30T16:54:46.670559+0000","last_clean":"2024-05-30T16:54:46.670559+0000","last_became_active":"2024-05-30T16:54:46.665248+0000","last_became_peered":"2024-05-30T16:54:46.665248+0000","last_unstale":"2024-05-30T16:54:46.670559+0000","last_undegraded":"2024-05-30T16:54:46.670559+0000","last_fullsized":"2024-05-30T16:54:46.670559+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:05:21.158010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.645874+0000","last_change":"2024-05-30T16:54:45.645874+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.645874+0000","last_undegraded":"2024-05-30T16:54:45.645874+0000","last_fullsized":"2024-05-30T16:54:45.645874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664509+0000","last_change":"2024-05-30T16:54:46.658606+0000","last_active":"2024-05-30T16:54:46.664509+0000","last_peered":"2024-05-30T16:54:46.664509+0000","last_clean":"2024-05-30T16:54:46.664509+0000","last_became_active":"2024-05-30T16:54:46.658313+0000","last_became_peered":"2024-05-30T16:54:46.658313+0000","last_unstale":"2024-05-30T16:54:46.664509+0000","last_undegraded":"2024-05-30T16:54:46.664509+0000","last_fullsized":"2024-05-30T16:54:46.664509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:35.259565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671340+0000","last_change":"2024-05-30T16:54:46.664673+0000","last_active":"2024-05-30T16:54:46.671340+0000","last_peered":"2024-05-30T16:54:46.671340+0000","last_clean":"2024-05-30T16:54:46.671340+0000","last_became_active":"2024-05-30T16:54:46.664411+0000","last_became_peered":"2024-05-30T16:54:46.664411+0000","last_unstale":"2024-05-30T16:54:46.671340+0000","last_undegraded":"2024-05-30T16:54:46.671340+0000","last_fullsized":"2024-05-30T16:54:46.671340+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:37.399050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.667166+0000","last_change":"2024-05-30T16:54:46.661133+0000","last_active":"2024-05-30T16:54:46.667166+0000","last_peered":"2024-05-30T16:54:46.667166+0000","last_clean":"2024-05-30T16:54:46.667166+0000","last_became_active":"2024-05-30T16:54:46.660444+0000","last_became_peered":"2024-05-30T16:54:46.660444+0000","last_unstale":"2024-05-30T16:54:46.667166+0000","last_undegraded":"2024-05-30T16:54:46.667166+0000","last_fullsized":"2024-05-30T16:54:46.667166+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:53.545049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668209+0000","last_change":"2024-05-30T16:54:46.662959+0000","last_active":"2024-05-30T16:54:46.668209+0000","last_peered":"2024-05-30T16:54:46.668209+0000","last_clean":"2024-05-30T16:54:46.668209+0000","last_became_active":"2024-05-30T16:54:46.662617+0000","last_became_peered":"2024-05-30T16:54:46.662617+0000","last_unstale":"2024-05-30T16:54:46.668209+0000","last_undegraded":"2024-05-30T16:54:46.668209+0000","last_fullsized":"2024-05-30T16:54:46.668209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.674431+0000","last_change":"2024-05-30T16:54:45.647654+0000","last_active":"2024-05-30T16:54:46.674431+0000","last_peered":"2024-05-30T16:54:46.674431+0000","last_clean":"2024-05-30T16:54:46.674431+0000","last_became_active":"2024-05-30T16:54:45.647348+0000","last_became_peered":"2024-05-30T16:54:45.647348+0000","last_unstale":"2024-05-30T16:54:46.674431+0000","last_undegraded":"2024-05-30T16:54:46.674431+0000","last_fullsized":"2024-05-30T16:54:46.674431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:42.667446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671009+0000","last_change":"2024-05-30T16:54:46.665719+0000","last_active":"2024-05-30T16:54:46.671009+0000","last_peered":"2024-05-30T16:54:46.671009+0000","last_clean":"2024-05-30T16:54:46.671009+0000","last_became_active":"2024-05-30T16:54:46.665454+0000","last_became_peered":"2024-05-30T16:54:46.665454+0000","last_unstale":"2024-05-30T16:54:46.671009+0000","last_undegraded":"2024-05-30T16:54:46.671009+0000","last_fullsized":"2024-05-30T16:54:46.671009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:29:51.209287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.662480+0000","last_change":"2024-05-30T16:54:45.661521+0000","last_active":"2024-05-30T16:54:45.662480+0000","last_peered":"2024-05-30T16:54:45.662480+0000","last_clean":"2024-05-30T16:54:45.662480+0000","last_became_active":"2024-05-30T16:54:45.660638+0000","last_became_peered":"2024-05-30T16:54:45.660638+0000","last_unstale":"2024-05-30T16:54:45.662480+0000","last_undegraded":"2024-05-30T16:54:45.662480+0000","last_fullsized":"2024-05-30T16:54:45.662480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:41:10.905828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.671960+0000","last_change":"2024-05-30T16:54:46.667652+0000","last_active":"2024-05-30T16:54:46.671960+0000","last_peered":"2024-05-30T16:54:46.671960+0000","last_clean":"2024-05-30T16:54:46.671960+0000","last_became_active":"2024-05-30T16:54:46.667421+0000","last_became_peered":"2024-05-30T16:54:46.667421+0000","last_unstale":"2024-05-30T16:54:46.671960+0000","last_undegraded":"2024-05-30T16:54:46.671960+0000","last_fullsized":"2024-05-30T16:54:46.671960+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:03.419391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.672100+0000","last_change":"2024-05-30T16:54:45.648517+0000","last_active":"2024-05-30T16:54:46.672100+0000","last_peered":"2024-05-30T16:54:46.672100+0000","last_clean":"2024-05-30T16:54:46.672100+0000","last_became_active":"2024-05-30T16:54:45.647977+0000","last_became_peered":"2024-05-30T16:54:45.647977+0000","last_unstale":"2024-05-30T16:54:46.672100+0000","last_undegraded":"2024-05-30T16:54:46.672100+0000","last_fullsized":"2024-05-30T16:54:46.672100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670659+0000","last_change":"2024-05-30T16:54:46.666945+0000","last_active":"2024-05-30T16:54:46.670659+0000","last_peered":"2024-05-30T16:54:46.670659+0000","last_clean":"2024-05-30T16:54:46.670659+0000","last_became_active":"2024-05-30T16:54:46.666678+0000","last_became_peered":"2024-05-30T16:54:46.666678+0000","last_unstale":"2024-05-30T16:54:46.670659+0000","last_undegraded":"2024-05-30T16:54:46.670659+0000","last_fullsized":"2024-05-30T16:54:46.670659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:37.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.669908+0000","last_change":"2024-05-30T16:54:45.655293+0000","last_active":"2024-05-30T16:54:46.669908+0000","last_peered":"2024-05-30T16:54:46.669908+0000","last_clean":"2024-05-30T16:54:46.669908+0000","last_became_active":"2024-05-30T16:54:45.652639+0000","last_became_peered":"2024-05-30T16:54:45.652639+0000","last_unstale":"2024-05-30T16:54:46.669908+0000","last_undegraded":"2024-05-30T16:54:46.669908+0000","last_fullsized":"2024-05-30T16:54:46.669908+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:26.354745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.643013+0000","last_change":"2024-05-30T16:54:45.643013+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.643013+0000","last_undegraded":"2024-05-30T16:54:45.643013+0000","last_fullsized":"2024-05-30T16:54:45.643013+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663460+0000","last_change":"2024-05-30T16:54:45.649596+0000","last_active":"2024-05-30T16:54:46.663460+0000","last_peered":"2024-05-30T16:54:46.663460+0000","last_clean":"2024-05-30T16:54:46.663460+0000","last_became_active":"2024-05-30T16:54:45.649230+0000","last_became_peered":"2024-05-30T16:54:45.649230+0000","last_unstale":"2024-05-30T16:54:46.663460+0000","last_undegraded":"2024-05-30T16:54:46.663460+0000","last_fullsized":"2024-05-30T16:54:46.663460+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:28:17.157569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.646670+0000","last_change":"2024-05-30T16:54:45.646670+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.646670+0000","last_undegraded":"2024-05-30T16:54:45.646670+0000","last_fullsized":"2024-05-30T16:54:45.646670+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666789+0000","last_change":"2024-05-30T16:54:45.653322+0000","last_active":"2024-05-30T16:54:46.666789+0000","last_peered":"2024-05-30T16:54:46.666789+0000","last_clean":"2024-05-30T16:54:46.666789+0000","last_became_active":"2024-05-30T16:54:45.653039+0000","last_became_peered":"2024-05-30T16:54:45.653039+0000","last_unstale":"2024-05-30T16:54:46.666789+0000","last_undegraded":"2024-05-30T16:54:46.666789+0000","last_fullsized":"2024-05-30T16:54:46.666789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:46.827065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666643+0000","last_change":"2024-05-30T16:54:46.664566+0000","last_active":"2024-05-30T16:54:46.666643+0000","last_peered":"2024-05-30T16:54:46.666643+0000","last_clean":"2024-05-30T16:54:46.666643+0000","last_became_active":"2024-05-30T16:54:46.664293+0000","last_became_peered":"2024-05-30T16:54:46.664293+0000","last_unstale":"2024-05-30T16:54:46.666643+0000","last_undegraded":"2024-05-30T16:54:46.666643+0000","last_fullsized":"2024-05-30T16:54:46.666643+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:12.383279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.642607+0000","last_change":"2024-05-30T16:54:45.649519+0000","last_active":"2024-05-30T16:54:46.642607+0000","last_peered":"2024-05-30T16:54:46.642607+0000","last_clean":"2024-05-30T16:54:46.642607+0000","last_became_active":"2024-05-30T16:54:45.649210+0000","last_became_peered":"2024-05-30T16:54:45.649210+0000","last_unstale":"2024-05-30T16:54:46.642607+0000","last_undegraded":"2024-05-30T16:54:46.642607+0000","last_fullsized":"2024-05-30T16:54:46.642607+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:04.574576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.650395+0000","last_change":"2024-05-30T16:54:45.650395+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.650395+0000","last_undegraded":"2024-05-30T16:54:45.650395+0000","last_fullsized":"2024-05-30T16:54:45.650395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.643656+0000","last_change":"2024-05-30T16:54:45.657461+0000","last_active":"2024-05-30T16:54:46.643656+0000","last_peered":"2024-05-30T16:54:46.643656+0000","last_clean":"2024-05-30T16:54:46.643656+0000","last_became_active":"2024-05-30T16:54:45.657185+0000","last_became_peered":"2024-05-30T16:54:45.657185+0000","last_unstale":"2024-05-30T16:54:46.643656+0000","last_undegraded":"2024-05-30T16:54:46.643656+0000","last_fullsized":"2024-05-30T16:54:46.643656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:01.690937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.673829+0000","last_change":"2024-05-30T16:54:46.672121+0000","last_active":"2024-05-30T16:54:46.673829+0000","last_peered":"2024-05-30T16:54:46.673829+0000","last_clean":"2024-05-30T16:54:46.673829+0000","last_became_active":"2024-05-30T16:54:46.671781+0000","last_became_peered":"2024-05-30T16:54:46.671781+0000","last_unstale":"2024-05-30T16:54:46.673829+0000","last_undegraded":"2024-05-30T16:54:46.673829+0000","last_fullsized":"2024-05-30T16:54:46.673829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:35.848386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.652601+0000","last_change":"2024-05-30T16:54:45.658364+0000","last_active":"2024-05-30T16:54:46.652601+0000","last_peered":"2024-05-30T16:54:46.652601+0000","last_clean":"2024-05-30T16:54:46.652601+0000","last_became_active":"2024-05-30T16:54:45.658015+0000","last_became_peered":"2024-05-30T16:54:45.658015+0000","last_unstale":"2024-05-30T16:54:46.652601+0000","last_undegraded":"2024-05-30T16:54:46.652601+0000","last_fullsized":"2024-05-30T16:54:46.652601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:04.574576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.676193+0000","last_change":"2024-05-30T16:54:46.673850+0000","last_active":"2024-05-30T16:54:46.676193+0000","last_peered":"2024-05-30T16:54:46.676193+0000","last_clean":"2024-05-30T16:54:46.676193+0000","last_became_active":"2024-05-30T16:54:46.673493+0000","last_became_peered":"2024-05-30T16:54:46.673493+0000","last_unstale":"2024-05-30T16:54:46.676193+0000","last_undegraded":"2024-05-30T16:54:46.676193+0000","last_fullsized":"2024-05-30T16:54:46.676193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:03.419391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.661693+0000","last_change":"2024-05-30T16:54:45.655634+0000","last_active":"2024-05-30T16:54:45.661693+0000","last_peered":"2024-05-30T16:54:45.661693+0000","last_clean":"2024-05-30T16:54:45.661693+0000","last_became_active":"2024-05-30T16:54:45.655296+0000","last_became_peered":"2024-05-30T16:54:45.655296+0000","last_unstale":"2024-05-30T16:54:45.661693+0000","last_undegraded":"2024-05-30T16:54:45.661693+0000","last_fullsized":"2024-05-30T16:54:45.661693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:17:37.296238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670966+0000","last_change":"2024-05-30T16:54:46.665621+0000","last_active":"2024-05-30T16:54:46.670966+0000","last_peered":"2024-05-30T16:54:46.670966+0000","last_clean":"2024-05-30T16:54:46.670966+0000","last_became_active":"2024-05-30T16:54:46.665034+0000","last_became_peered":"2024-05-30T16:54:46.665034+0000","last_unstale":"2024-05-30T16:54:46.670966+0000","last_undegraded":"2024-05-30T16:54:46.670966+0000","last_fullsized":"2024-05-30T16:54:46.670966+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:18.243815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.677071+0000","last_change":"2024-05-30T16:54:45.661725+0000","last_active":"2024-05-30T16:54:46.677071+0000","last_peered":"2024-05-30T16:54:46.677071+0000","last_clean":"2024-05-30T16:54:46.677071+0000","last_became_active":"2024-05-30T16:54:45.661411+0000","last_became_peered":"2024-05-30T16:54:45.661411+0000","last_unstale":"2024-05-30T16:54:46.677071+0000","last_undegraded":"2024-05-30T16:54:46.677071+0000","last_fullsized":"2024-05-30T16:54:46.677071+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675745+0000","last_change":"2024-05-30T16:54:46.672644+0000","last_active":"2024-05-30T16:54:46.675745+0000","last_peered":"2024-05-30T16:54:46.675745+0000","last_clean":"2024-05-30T16:54:46.675745+0000","last_became_active":"2024-05-30T16:54:46.672183+0000","last_became_peered":"2024-05-30T16:54:46.672183+0000","last_unstale":"2024-05-30T16:54:46.675745+0000","last_undegraded":"2024-05-30T16:54:46.675745+0000","last_fullsized":"2024-05-30T16:54:46.675745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:37.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675700+0000","last_change":"2024-05-30T16:54:45.645709+0000","last_active":"2024-05-30T16:54:46.675700+0000","last_peered":"2024-05-30T16:54:46.675700+0000","last_clean":"2024-05-30T16:54:46.675700+0000","last_became_active":"2024-05-30T16:54:45.644794+0000","last_became_peered":"2024-05-30T16:54:45.644794+0000","last_unstale":"2024-05-30T16:54:46.675700+0000","last_undegraded":"2024-05-30T16:54:46.675700+0000","last_fullsized":"2024-05-30T16:54:46.675700+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:37.221162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670171+0000","last_change":"2024-05-30T16:54:46.666387+0000","last_active":"2024-05-30T16:54:46.670171+0000","last_peered":"2024-05-30T16:54:46.670171+0000","last_clean":"2024-05-30T16:54:46.670171+0000","last_became_active":"2024-05-30T16:54:46.666160+0000","last_became_peered":"2024-05-30T16:54:46.666160+0000","last_unstale":"2024-05-30T16:54:46.670171+0000","last_undegraded":"2024-05-30T16:54:46.670171+0000","last_fullsized":"2024-05-30T16:54:46.670171+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:49:29.390734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.662205+0000","last_change":"2024-05-30T16:54:45.660979+0000","last_active":"2024-05-30T16:54:45.662205+0000","last_peered":"2024-05-30T16:54:45.662205+0000","last_clean":"2024-05-30T16:54:45.662205+0000","last_became_active":"2024-05-30T16:54:45.660628+0000","last_became_peered":"2024-05-30T16:54:45.660628+0000","last_unstale":"2024-05-30T16:54:45.662205+0000","last_undegraded":"2024-05-30T16:54:45.662205+0000","last_fullsized":"2024-05-30T16:54:45.662205+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:21:25.478498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.673884+0000","last_change":"2024-05-30T16:54:46.669298+0000","last_active":"2024-05-30T16:54:46.673884+0000","last_peered":"2024-05-30T16:54:46.673884+0000","last_clean":"2024-05-30T16:54:46.673884+0000","last_became_active":"2024-05-30T16:54:46.669004+0000","last_became_peered":"2024-05-30T16:54:46.669004+0000","last_unstale":"2024-05-30T16:54:46.673884+0000","last_undegraded":"2024-05-30T16:54:46.673884+0000","last_fullsized":"2024-05-30T16:54:46.673884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:43.670842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.644949+0000","last_change":"2024-05-30T16:54:45.657137+0000","last_active":"2024-05-30T16:54:46.644949+0000","last_peered":"2024-05-30T16:54:46.644949+0000","last_clean":"2024-05-30T16:54:46.644949+0000","last_became_active":"2024-05-30T16:54:45.656852+0000","last_became_peered":"2024-05-30T16:54:45.656852+0000","last_unstale":"2024-05-30T16:54:46.644949+0000","last_undegraded":"2024-05-30T16:54:46.644949+0000","last_fullsized":"2024-05-30T16:54:46.644949+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:30:37.379158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663572+0000","last_change":"2024-05-30T16:54:46.659555+0000","last_active":"2024-05-30T16:54:46.663572+0000","last_peered":"2024-05-30T16:54:46.663572+0000","last_clean":"2024-05-30T16:54:46.663572+0000","last_became_active":"2024-05-30T16:54:46.659213+0000","last_became_peered":"2024-05-30T16:54:46.659213+0000","last_unstale":"2024-05-30T16:54:46.663572+0000","last_undegraded":"2024-05-30T16:54:46.663572+0000","last_fullsized":"2024-05-30T16:54:46.663572+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:01.137841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.642813+0000","last_change":"2024-05-30T16:54:45.658679+0000","last_active":"2024-05-30T16:54:46.642813+0000","last_peered":"2024-05-30T16:54:46.642813+0000","last_clean":"2024-05-30T16:54:46.642813+0000","last_became_active":"2024-05-30T16:54:45.658329+0000","last_became_peered":"2024-05-30T16:54:45.658329+0000","last_unstale":"2024-05-30T16:54:46.642813+0000","last_undegraded":"2024-05-30T16:54:46.642813+0000","last_fullsized":"2024-05-30T16:54:46.642813+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:48.442480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670623+0000","last_change":"2024-05-30T16:54:46.666749+0000","last_active":"2024-05-30T16:54:46.670623+0000","last_peered":"2024-05-30T16:54:46.670623+0000","last_clean":"2024-05-30T16:54:46.670623+0000","last_became_active":"2024-05-30T16:54:46.665986+0000","last_became_peered":"2024-05-30T16:54:46.665986+0000","last_unstale":"2024-05-30T16:54:46.670623+0000","last_undegraded":"2024-05-30T16:54:46.670623+0000","last_fullsized":"2024-05-30T16:54:46.670623+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:26.161079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675768+0000","last_change":"2024-05-30T16:54:45.660854+0000","last_active":"2024-05-30T16:54:46.675768+0000","last_peered":"2024-05-30T16:54:46.675768+0000","last_clean":"2024-05-30T16:54:46.675768+0000","last_became_active":"2024-05-30T16:54:45.660575+0000","last_became_peered":"2024-05-30T16:54:45.660575+0000","last_unstale":"2024-05-30T16:54:46.675768+0000","last_undegraded":"2024-05-30T16:54:46.675768+0000","last_fullsized":"2024-05-30T16:54:46.675768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:46.827065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663814+0000","last_change":"2024-05-30T16:54:46.660412+0000","last_active":"2024-05-30T16:54:46.663814+0000","last_peered":"2024-05-30T16:54:46.663814+0000","last_clean":"2024-05-30T16:54:46.663814+0000","last_became_active":"2024-05-30T16:54:46.660132+0000","last_became_peered":"2024-05-30T16:54:46.660132+0000","last_unstale":"2024-05-30T16:54:46.663814+0000","last_undegraded":"2024-05-30T16:54:46.663814+0000","last_fullsized":"2024-05-30T16:54:46.663814+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:27.358141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.661017+0000","last_change":"2024-05-30T16:54:45.658736+0000","last_active":"2024-05-30T16:54:45.661017+0000","last_peered":"2024-05-30T16:54:45.661017+0000","last_clean":"2024-05-30T16:54:45.661017+0000","last_became_active":"2024-05-30T16:54:45.658382+0000","last_became_peered":"2024-05-30T16:54:45.658382+0000","last_unstale":"2024-05-30T16:54:45.661017+0000","last_undegraded":"2024-05-30T16:54:45.661017+0000","last_fullsized":"2024-05-30T16:54:45.661017+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:33.856990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.674113+0000","last_change":"2024-05-30T16:54:46.668478+0000","last_active":"2024-05-30T16:54:46.674113+0000","last_peered":"2024-05-30T16:54:46.674113+0000","last_clean":"2024-05-30T16:54:46.674113+0000","last_became_active":"2024-05-30T16:54:46.668127+0000","last_became_peered":"2024-05-30T16:54:46.668127+0000","last_unstale":"2024-05-30T16:54:46.674113+0000","last_undegraded":"2024-05-30T16:54:46.674113+0000","last_fullsized":"2024-05-30T16:54:46.674113+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:03.419391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675376+0000","last_change":"2024-05-30T16:54:45.651393+0000","last_active":"2024-05-30T16:54:46.675376+0000","last_peered":"2024-05-30T16:54:46.675376+0000","last_clean":"2024-05-30T16:54:46.675376+0000","last_became_active":"2024-05-30T16:54:45.650980+0000","last_became_peered":"2024-05-30T16:54:45.650980+0000","last_unstale":"2024-05-30T16:54:46.675376+0000","last_undegraded":"2024-05-30T16:54:46.675376+0000","last_fullsized":"2024-05-30T16:54:46.675376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:25.157682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.644782+0000","last_change":"2024-05-30T16:54:45.644782+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.644782+0000","last_undegraded":"2024-05-30T16:54:45.644782+0000","last_fullsized":"2024-05-30T16:54:45.644782+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670736+0000","last_change":"2024-05-30T16:54:45.655629+0000","last_active":"2024-05-30T16:54:46.670736+0000","last_peered":"2024-05-30T16:54:46.670736+0000","last_clean":"2024-05-30T16:54:46.670736+0000","last_became_active":"2024-05-30T16:54:45.655351+0000","last_became_peered":"2024-05-30T16:54:45.655351+0000","last_unstale":"2024-05-30T16:54:46.670736+0000","last_undegraded":"2024-05-30T16:54:46.670736+0000","last_fullsized":"2024-05-30T16:54:46.670736+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:34.256169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.675732+0000","last_change":"2024-05-30T16:54:46.672424+0000","last_active":"2024-05-30T16:54:46.675732+0000","last_peered":"2024-05-30T16:54:46.675732+0000","last_clean":"2024-05-30T16:54:46.675732+0000","last_became_active":"2024-05-30T16:54:46.671842+0000","last_became_peered":"2024-05-30T16:54:46.671842+0000","last_unstale":"2024-05-30T16:54:46.675732+0000","last_undegraded":"2024-05-30T16:54:46.675732+0000","last_fullsized":"2024-05-30T16:54:46.675732+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:49:29.390734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.660180+0000","last_change":"2024-05-30T16:54:45.656675+0000","last_active":"2024-05-30T16:54:46.660180+0000","last_peered":"2024-05-30T16:54:46.660180+0000","last_clean":"2024-05-30T16:54:46.660180+0000","last_became_active":"2024-05-30T16:54:45.656400+0000","last_became_peered":"2024-05-30T16:54:45.656400+0000","last_unstale":"2024-05-30T16:54:46.660180+0000","last_undegraded":"2024-05-30T16:54:46.660180+0000","last_fullsized":"2024-05-30T16:54:46.660180+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:48.442480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.672601+0000","last_change":"2024-05-30T16:54:46.667135+0000","last_active":"2024-05-30T16:54:46.672601+0000","last_peered":"2024-05-30T16:54:46.672601+0000","last_clean":"2024-05-30T16:54:46.672601+0000","last_became_active":"2024-05-30T16:54:46.666764+0000","last_became_peered":"2024-05-30T16:54:46.666764+0000","last_unstale":"2024-05-30T16:54:46.672601+0000","last_undegraded":"2024-05-30T16:54:46.672601+0000","last_fullsized":"2024-05-30T16:54:46.672601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:37.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.660884+0000","last_change":"2024-05-30T16:54:45.655577+0000","last_active":"2024-05-30T16:54:45.660884+0000","last_peered":"2024-05-30T16:54:45.660884+0000","last_clean":"2024-05-30T16:54:45.660884+0000","last_became_active":"2024-05-30T16:54:45.655197+0000","last_became_peered":"2024-05-30T16:54:45.655197+0000","last_unstale":"2024-05-30T16:54:45.660884+0000","last_undegraded":"2024-05-30T16:54:45.660884+0000","last_fullsized":"2024-05-30T16:54:45.660884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:52:20.023991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.664248+0000","last_change":"2024-05-30T16:54:46.655167+0000","last_active":"2024-05-30T16:54:46.664248+0000","last_peered":"2024-05-30T16:54:46.664248+0000","last_clean":"2024-05-30T16:54:46.664248+0000","last_became_active":"2024-05-30T16:54:46.654866+0000","last_became_peered":"2024-05-30T16:54:46.654866+0000","last_unstale":"2024-05-30T16:54:46.664248+0000","last_undegraded":"2024-05-30T16:54:46.664248+0000","last_fullsized":"2024-05-30T16:54:46.664248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:01.137841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.661131+0000","last_change":"2024-05-30T16:54:45.647369+0000","last_active":"2024-05-30T16:54:46.661131+0000","last_peered":"2024-05-30T16:54:46.661131+0000","last_clean":"2024-05-30T16:54:46.661131+0000","last_became_active":"2024-05-30T16:54:45.647108+0000","last_became_peered":"2024-05-30T16:54:45.647108+0000","last_unstale":"2024-05-30T16:54:46.661131+0000","last_undegraded":"2024-05-30T16:54:46.661131+0000","last_fullsized":"2024-05-30T16:54:46.661131+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:20:36.722964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.668263+0000","last_change":"2024-05-30T16:54:46.662209+0000","last_active":"2024-05-30T16:54:46.668263+0000","last_peered":"2024-05-30T16:54:46.668263+0000","last_clean":"2024-05-30T16:54:46.668263+0000","last_became_active":"2024-05-30T16:54:46.661882+0000","last_became_peered":"2024-05-30T16:54:46.661882+0000","last_unstale":"2024-05-30T16:54:46.668263+0000","last_undegraded":"2024-05-30T16:54:46.668263+0000","last_fullsized":"2024-05-30T16:54:46.668263+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:27.358141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.642644+0000","last_change":"2024-05-30T16:54:45.657812+0000","last_active":"2024-05-30T16:54:46.642644+0000","last_peered":"2024-05-30T16:54:46.642644+0000","last_clean":"2024-05-30T16:54:46.642644+0000","last_became_active":"2024-05-30T16:54:45.656848+0000","last_became_peered":"2024-05-30T16:54:45.656848+0000","last_unstale":"2024-05-30T16:54:46.642644+0000","last_undegraded":"2024-05-30T16:54:46.642644+0000","last_fullsized":"2024-05-30T16:54:46.642644+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.658294+0000","last_change":"2024-05-30T16:54:46.654546+0000","last_active":"2024-05-30T16:54:46.658294+0000","last_peered":"2024-05-30T16:54:46.658294+0000","last_clean":"2024-05-30T16:54:46.658294+0000","last_became_active":"2024-05-30T16:54:46.653161+0000","last_became_peered":"2024-05-30T16:54:46.653161+0000","last_unstale":"2024-05-30T16:54:46.658294+0000","last_undegraded":"2024-05-30T16:54:46.658294+0000","last_fullsized":"2024-05-30T16:54:46.658294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:26.161079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.676208+0000","last_change":"2024-05-30T16:54:45.658652+0000","last_active":"2024-05-30T16:54:46.676208+0000","last_peered":"2024-05-30T16:54:46.676208+0000","last_clean":"2024-05-30T16:54:46.676208+0000","last_became_active":"2024-05-30T16:54:45.658367+0000","last_became_peered":"2024-05-30T16:54:45.658367+0000","last_unstale":"2024-05-30T16:54:46.676208+0000","last_undegraded":"2024-05-30T16:54:46.676208+0000","last_fullsized":"2024-05-30T16:54:46.676208+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:30:37.379158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666735+0000","last_change":"2024-05-30T16:54:46.662119+0000","last_active":"2024-05-30T16:54:46.666735+0000","last_peered":"2024-05-30T16:54:46.666735+0000","last_clean":"2024-05-30T16:54:46.666735+0000","last_became_active":"2024-05-30T16:54:46.661785+0000","last_became_peered":"2024-05-30T16:54:46.661785+0000","last_unstale":"2024-05-30T16:54:46.666735+0000","last_undegraded":"2024-05-30T16:54:46.666735+0000","last_fullsized":"2024-05-30T16:54:46.666735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:32.939644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663723+0000","last_change":"2024-05-30T16:54:45.653028+0000","last_active":"2024-05-30T16:54:46.663723+0000","last_peered":"2024-05-30T16:54:46.663723+0000","last_clean":"2024-05-30T16:54:46.663723+0000","last_became_active":"2024-05-30T16:54:45.652710+0000","last_became_peered":"2024-05-30T16:54:45.652710+0000","last_unstale":"2024-05-30T16:54:46.663723+0000","last_undegraded":"2024-05-30T16:54:46.663723+0000","last_fullsized":"2024-05-30T16:54:46.663723+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:31.936247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670882+0000","last_change":"2024-05-30T16:54:46.665362+0000","last_active":"2024-05-30T16:54:46.670882+0000","last_peered":"2024-05-30T16:54:46.670882+0000","last_clean":"2024-05-30T16:54:46.670882+0000","last_became_active":"2024-05-30T16:54:46.664731+0000","last_became_peered":"2024-05-30T16:54:46.664731+0000","last_unstale":"2024-05-30T16:54:46.670882+0000","last_undegraded":"2024-05-30T16:54:46.670882+0000","last_fullsized":"2024-05-30T16:54:46.670882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:59.959822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.645071+0000","last_change":"2024-05-30T16:54:45.653794+0000","last_active":"2024-05-30T16:54:46.645071+0000","last_peered":"2024-05-30T16:54:46.645071+0000","last_clean":"2024-05-30T16:54:46.645071+0000","last_became_active":"2024-05-30T16:54:45.652243+0000","last_became_peered":"2024-05-30T16:54:45.652243+0000","last_unstale":"2024-05-30T16:54:46.645071+0000","last_undegraded":"2024-05-30T16:54:46.645071+0000","last_fullsized":"2024-05-30T16:54:46.645071+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:41.075478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.666830+0000","last_change":"2024-05-30T16:54:46.659899+0000","last_active":"2024-05-30T16:54:46.666830+0000","last_peered":"2024-05-30T16:54:46.666830+0000","last_clean":"2024-05-30T16:54:46.666830+0000","last_became_active":"2024-05-30T16:54:46.658860+0000","last_became_peered":"2024-05-30T16:54:46.658860+0000","last_unstale":"2024-05-30T16:54:46.666830+0000","last_undegraded":"2024-05-30T16:54:46.666830+0000","last_fullsized":"2024-05-30T16:54:46.666830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:35.259565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.644190+0000","last_change":"2024-05-30T16:54:45.652157+0000","last_active":"2024-05-30T16:54:46.644190+0000","last_peered":"2024-05-30T16:54:46.644190+0000","last_clean":"2024-05-30T16:54:46.644190+0000","last_became_active":"2024-05-30T16:54:45.651109+0000","last_became_peered":"2024-05-30T16:54:45.651109+0000","last_unstale":"2024-05-30T16:54:46.644190+0000","last_undegraded":"2024-05-30T16:54:46.644190+0000","last_fullsized":"2024-05-30T16:54:46.644190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:52.541652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.642572+0000","last_change":"2024-05-30T16:54:45.642572+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.642572+0000","last_undegraded":"2024-05-30T16:54:45.642572+0000","last_fullsized":"2024-05-30T16:54:45.642572+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.660933+0000","last_change":"2024-05-30T16:54:45.650576+0000","last_active":"2024-05-30T16:54:46.660933+0000","last_peered":"2024-05-30T16:54:46.660933+0000","last_clean":"2024-05-30T16:54:46.660933+0000","last_became_active":"2024-05-30T16:54:45.650316+0000","last_became_peered":"2024-05-30T16:54:45.650316+0000","last_unstale":"2024-05-30T16:54:46.660933+0000","last_undegraded":"2024-05-30T16:54:46.660933+0000","last_fullsized":"2024-05-30T16:54:46.660933+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:32:02.321051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.663762+0000","last_change":"2024-05-30T16:54:46.660833+0000","last_active":"2024-05-30T16:54:46.663762+0000","last_peered":"2024-05-30T16:54:46.663762+0000","last_clean":"2024-05-30T16:54:46.663762+0000","last_became_active":"2024-05-30T16:54:46.660017+0000","last_became_peered":"2024-05-30T16:54:46.660017+0000","last_unstale":"2024-05-30T16:54:46.663762+0000","last_undegraded":"2024-05-30T16:54:46.663762+0000","last_fullsized":"2024-05-30T16:54:46.663762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.644778+0000","last_change":"2024-05-30T16:54:45.645109+0000","last_active":"2024-05-30T16:54:46.644778+0000","last_peered":"2024-05-30T16:54:46.644778+0000","last_clean":"2024-05-30T16:54:46.644778+0000","last_became_active":"2024-05-30T16:54:45.644753+0000","last_became_peered":"2024-05-30T16:54:45.644753+0000","last_unstale":"2024-05-30T16:54:46.644778+0000","last_undegraded":"2024-05-30T16:54:46.644778+0000","last_fullsized":"2024-05-30T16:54:46.644778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:57:37.286999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.670848+0000","last_change":"2024-05-30T16:54:46.659487+0000","last_active":"2024-05-30T16:54:46.670848+0000","last_peered":"2024-05-30T16:54:46.670848+0000","last_clean":"2024-05-30T16:54:46.670848+0000","last_became_active":"2024-05-30T16:54:46.659243+0000","last_became_peered":"2024-05-30T16:54:46.659243+0000","last_unstale":"2024-05-30T16:54:46.670848+0000","last_undegraded":"2024-05-30T16:54:46.670848+0000","last_fullsized":"2024-05-30T16:54:46.670848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:33.056889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.660879+0000","last_change":"2024-05-30T16:54:45.654729+0000","last_active":"2024-05-30T16:54:46.660879+0000","last_peered":"2024-05-30T16:54:46.660879+0000","last_clean":"2024-05-30T16:54:46.660879+0000","last_became_active":"2024-05-30T16:54:45.654447+0000","last_became_peered":"2024-05-30T16:54:45.654447+0000","last_unstale":"2024-05-30T16:54:46.660879+0000","last_undegraded":"2024-05-30T16:54:46.660879+0000","last_fullsized":"2024-05-30T16:54:46.660879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:28.492293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.649949+0000","last_change":"2024-05-30T16:54:45.649949+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.649949+0000","last_undegraded":"2024-05-30T16:54:45.649949+0000","last_fullsized":"2024-05-30T16:54:45.649949+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T16:54:45.660891+0000","last_change":"2024-05-30T16:54:45.655443+0000","last_active":"2024-05-30T16:54:45.660891+0000","last_peered":"2024-05-30T16:54:45.660891+0000","last_clean":"2024-05-30T16:54:45.660891+0000","last_became_active":"2024-05-30T16:54:45.655068+0000","last_became_peered":"2024-05-30T16:54:45.655068+0000","last_unstale":"2024-05-30T16:54:45.660891+0000","last_undegraded":"2024-05-30T16:54:45.660891+0000","last_fullsized":"2024-05-30T16:54:45.660891+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:43:52.793573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-05-30T16:54:45.649866+0000","last_change":"2024-05-30T16:54:45.649866+0000","last_active":"2024-05-30T16:54:45.627785+0000","last_peered":"2024-05-30T16:54:45.627785+0000","last_clean":"2024-05-30T16:54:45.627785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:54:45.649866+0000","last_undegraded":"2024-05-30T16:54:45.649866+0000","last_fullsized":"2024-05-30T16:54:45.649866+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.647166+0000","last_change":"2024-05-30T16:54:45.654457+0000","last_active":"2024-05-30T16:54:46.647166+0000","last_peered":"2024-05-30T16:54:46.647166+0000","last_clean":"2024-05-30T16:54:46.647166+0000","last_became_active":"2024-05-30T16:54:45.654115+0000","last_became_peered":"2024-05-30T16:54:45.654115+0000","last_unstale":"2024-05-30T16:54:46.647166+0000","last_undegraded":"2024-05-30T16:54:46.647166+0000","last_fullsized":"2024-05-30T16:54:46.647166+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:38.027264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":244,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-30T16:54:46.648534+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:54:46.648534+0000","last_peered":"2024-05-30T16:54:46.648534+0000","last_clean":"2024-05-30T16:54:46.648534+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:54:46.648534+0000","last_undegraded":"2024-05-30T16:54:46.648534+0000","last_fullsized":"2024-05-30T16:54:46.648534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509513,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44948,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326892,"statfs":{"total":96636764160,"available":96590737408,"internally_reserved":0,"allocated":1318912,"data_stored":891249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509514,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45780,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326060,"statfs":{"total":96636764160,"available":96589885440,"internally_reserved":0,"allocated":724992,"data_stored":300881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509514,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40216,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331624,"statfs":{"total":96636764160,"available":96595582976,"internally_reserved":0,"allocated":733184,"data_stored":301533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45768,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326072,"statfs":{"total":96636764160,"available":96589897728,"internally_reserved":0,"allocated":712704,"data_stored":294050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44384,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327456,"statfs":{"total":96636764160,"available":96591314944,"internally_reserved":0,"allocated":733184,"data_stored":300937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45780,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326060,"statfs":{"total":96636764160,"available":96589885440,"internally_reserved":0,"allocated":729088,"data_stored":300971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509514,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46376,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325464,"statfs":{"total":96636764160,"available":96589275136,"internally_reserved":0,"allocated":1335296,"data_stored":893443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542218,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45752,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326088,"statfs":{"total":96636764160,"available":96589914112,"internally_reserved":0,"allocated":700416,"data_stored":287727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:54:55.382 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:54:55.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.531+0000 7f8862400640 1 Processor -- start 2024-05-30T16:54:55.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.531+0000 7f8862400640 1 -- start start 2024-05-30T16:54:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f8862400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f885c0af720 0x7f885c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f8862400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f885c0d0560 0x7f885c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f8862400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f885c15f060 con 0x7f885c06e900 2024-05-30T16:54:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f8862400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f885c0afb00 con 0x7f885c0d0560 2024-05-30T16:54:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f8862400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f885c15c270 con 0x7f885c0af720 2024-05-30T16:54:55.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f885b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f885c0af720 0x7f885c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:55.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f885b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f885c0af720 0x7f885c15b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:53904/0 (socket says 172.21.15.59:53904) 2024-05-30T16:54:55.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f8852a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f885c06e900 0x7f885c15f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:50012/0 (socket says 172.21.15.59:50012) 2024-05-30T16:54:55.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f885b400640 1 -- 172.21.15.59:0/3588862614 learned_addr learned my addr 172.21.15.59:0/3588862614 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:55.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f885be00640 1 --2- 172.21.15.59:0/3588862614 >> v2:172.21.15.107:3300/0 conn(0x7f885c0d0560 0x7f885c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:55.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f885b400640 1 -- 172.21.15.59:0/3588862614 >> v2:172.21.15.107:3300/0 conn(0x7f885c0d0560 msgr2=0x7f885c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:55.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f885b400640 1 --2- 172.21.15.59:0/3588862614 >> v2:172.21.15.107:3300/0 conn(0x7f885c0d0560 0x7f885c0d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f885b400640 1 -- 172.21.15.59:0/3588862614 >> v1:172.21.15.107:6789/0 conn(0x7f885c06e900 legacy=0x7f885c15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:55.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f885b400640 1 -- 172.21.15.59:0/3588862614 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c15ff00 con 0x7f885c0af720 2024-05-30T16:54:55.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.535+0000 7f885be00640 1 --2- 172.21.15.59:0/3588862614 >> v2:172.21.15.107:3300/0 conn(0x7f885c0d0560 0x7f885c0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:54:55.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f885b400640 1 --2- 172.21.15.59:0/3588862614 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f885c0af720 0x7f885c15b9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f884c009870 tx=0x7f884c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8de7af8393cb639d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:55.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f885aa00640 1 -- 172.21.15.59:0/3588862614 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0ab650 con 0x7f885c0af720 2024-05-30T16:54:55.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f885aa00640 1 -- 172.21.15.59:0/3588862614 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884c0b0070 con 0x7f885c0af720 2024-05-30T16:54:55.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f885aa00640 1 -- 172.21.15.59:0/3588862614 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0aba10 con 0x7f885c0af720 2024-05-30T16:54:55.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f8862400640 1 -- 172.21.15.59:0/3588862614 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f885c0af720 msgr2=0x7f885c15b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:55.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f8862400640 1 --2- 172.21.15.59:0/3588862614 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f885c0af720 0x7f885c15b9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f884c009870 tx=0x7f884c01c560 comp rx=0 tx=0).stop 2024-05-30T16:54:55.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f8862400640 1 -- 172.21.15.59:0/3588862614 shutdown_connections 2024-05-30T16:54:55.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f8862400640 1 --2- 172.21.15.59:0/3588862614 >> v2:172.21.15.107:3300/0 conn(0x7f885c0d0560 0x7f885c0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f8862400640 1 --2- 172.21.15.59:0/3588862614 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f885c0af720 0x7f885c15b9d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f8862400640 1 -- 172.21.15.59:0/3588862614 >> 172.21.15.59:0/3588862614 conn(0x7f885c0b22d0 msgr2=0x7f885c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:55.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f8862400640 1 -- 172.21.15.59:0/3588862614 shutdown_connections 2024-05-30T16:54:55.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f8862400640 1 -- 172.21.15.59:0/3588862614 wait complete. 2024-05-30T16:54:55.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f8862400640 1 Processor -- start 2024-05-30T16:54:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.539+0000 7f8862400640 1 -- start start 2024-05-30T16:54:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8862400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f885c06e900 0x7f885c153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8862400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f885c0af720 0x7f885c159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8862400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f885c0d0560 0x7f885c1562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8862400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f885c073150 con 0x7f885c06e900 2024-05-30T16:54:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8862400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f885c15c830 con 0x7f885c0d0560 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8862400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f885c0732d0 con 0x7f885c0af720 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f885b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f885c06e900 0x7f885c153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f885b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f885c06e900 0x7f885c153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42660/0 (socket says 172.21.15.59:42660) 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f885b400640 1 -- 172.21.15.59:0/3742544057 learned_addr learned my addr 172.21.15.59:0/3742544057 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f885be00640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f885c0d0560 0x7f885c1562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8852a00640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f885c0af720 0x7f885c159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f885b400640 1 -- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f885c0af720 msgr2=0x7f885c159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f885b400640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f885c0af720 0x7f885c159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f885b400640 1 -- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f885c0d0560 msgr2=0x7f885c1562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f885b400640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f885c0d0560 0x7f885c1562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f885b400640 1 -- 172.21.15.59:0/3742544057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c157180 con 0x7f885c06e900 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f885be00640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f885c0d0560 0x7f885c1562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f885b400640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f885c06e900 0x7f885c153320 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f884c01ac10 tx=0x7f884c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8853e00640 1 -- 172.21.15.59:0/3742544057 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0be5f0 con 0x7f885c06e900 2024-05-30T16:54:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8853e00640 1 -- 172.21.15.59:0/3742544057 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884c0be790 con 0x7f885c06e900 2024-05-30T16:54:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8853e00640 1 -- 172.21.15.59:0/3742544057 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0beb80 con 0x7f885c06e900 2024-05-30T16:54:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8862400640 1 -- 172.21.15.59:0/3742544057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885c157460 con 0x7f885c06e900 2024-05-30T16:54:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8862400640 1 -- 172.21.15.59:0/3742544057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885c15b3b0 con 0x7f885c06e900 2024-05-30T16:54:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8862400640 1 -- 172.21.15.59:0/3742544057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885c068a90 con 0x7f885c06e900 2024-05-30T16:54:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.543+0000 7f8853e00640 1 -- 172.21.15.59:0/3742544057 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f884c0b43f0 con 0x7f885c06e900 2024-05-30T16:54:55.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.547+0000 7f8853e00640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8838068b60 0x7f883806b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:55.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.547+0000 7f8853e00640 1 -- 172.21.15.59:0/3742544057 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f884c122660 con 0x7f885c06e900 2024-05-30T16:54:55.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.547+0000 7f8852a00640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8838068b60 0x7f883806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:55.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.547+0000 7f8852a00640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8838068b60 0x7f883806b020 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f885c09e4d0 tx=0x7f8844007cf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:55.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.551+0000 7f8853e00640 1 -- 172.21.15.59:0/3742544057 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f884c0c4060 con 0x7f885c06e900 2024-05-30T16:54:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.711+0000 7f8862400640 1 -- 172.21.15.59:0/3742544057 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f885c157d10 con 0x7f8838068b60 2024-05-30T16:54:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8853e00640 1 -- 172.21.15.59:0/3742544057 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251927 (secure 0 0 0) 0x7f885c157d10 con 0x7f8838068b60 2024-05-30T16:54:55.726 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:54:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8862400640 1 -- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8838068b60 msgr2=0x7f883806b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8862400640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8838068b60 0x7f883806b020 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f885c09e4d0 tx=0x7f8844007cf0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8862400640 1 -- 172.21.15.59:0/3742544057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f885c06e900 msgr2=0x7f885c153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8862400640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f885c06e900 0x7f885c153320 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f884c01ac10 tx=0x7f884c01ada0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8862400640 1 -- 172.21.15.59:0/3742544057 shutdown_connections 2024-05-30T16:54:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8862400640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8838068b60 0x7f883806b020 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8862400640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f885c0d0560 0x7f885c1562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8862400640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f885c0af720 0x7f885c159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8862400640 1 --2- 172.21.15.59:0/3742544057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f885c06e900 0x7f885c153320 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8862400640 1 -- 172.21.15.59:0/3742544057 >> 172.21.15.59:0/3742544057 conn(0x7f885c0b22d0 msgr2=0x7f885c0b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8862400640 1 -- 172.21.15.59:0/3742544057 shutdown_connections 2024-05-30T16:54:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.723+0000 7f8862400640 1 -- 172.21.15.59:0/3742544057 wait complete. 2024-05-30T16:54:55.747 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-05-30T16:54:55.164089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":359172,"kb_used_data":6984,"kb_used_omap":12,"kb_used_meta":352051,"kb_avail":754615548,"statfs":{"total":773094113280,"available":772726321152,"internally_reserved":0,"allocated":7151616,"data_stored":3643452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":360500784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.526216"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.642263+0000","last_change":"2024-05-30T16:54:46.653537+0000","last_active":"2024-05-30T16:54:47.642263+0000","last_peered":"2024-05-30T16:54:47.642263+0000","last_clean":"2024-05-30T16:54:47.642263+0000","last_became_active":"2024-05-30T16:54:46.653287+0000","last_became_peered":"2024-05-30T16:54:46.653287+0000","last_unstale":"2024-05-30T16:54:47.642263+0000","last_undegraded":"2024-05-30T16:54:47.642263+0000","last_fullsized":"2024-05-30T16:54:47.642263+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:25:20.338330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499940+0000","last_change":"2024-05-30T16:54:46.672556+0000","last_active":"2024-05-30T16:54:48.499940+0000","last_peered":"2024-05-30T16:54:48.499940+0000","last_clean":"2024-05-30T16:54:48.499940+0000","last_became_active":"2024-05-30T16:54:46.672194+0000","last_became_peered":"2024-05-30T16:54:46.672194+0000","last_unstale":"2024-05-30T16:54:48.499940+0000","last_undegraded":"2024-05-30T16:54:48.499940+0000","last_fullsized":"2024-05-30T16:54:48.499940+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:37:03.899223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923168+0000","last_change":"2024-05-30T16:54:46.658753+0000","last_active":"2024-05-30T16:54:47.923168+0000","last_peered":"2024-05-30T16:54:47.923168+0000","last_clean":"2024-05-30T16:54:47.923168+0000","last_became_active":"2024-05-30T16:54:46.658476+0000","last_became_peered":"2024-05-30T16:54:46.658476+0000","last_unstale":"2024-05-30T16:54:47.923168+0000","last_undegraded":"2024-05-30T16:54:47.923168+0000","last_fullsized":"2024-05-30T16:54:47.923168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:43:36.740785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.645013+0000","last_change":"2024-05-30T16:54:46.662427+0000","last_active":"2024-05-30T16:54:47.645013+0000","last_peered":"2024-05-30T16:54:47.645013+0000","last_clean":"2024-05-30T16:54:47.645013+0000","last_became_active":"2024-05-30T16:54:46.662157+0000","last_became_peered":"2024-05-30T16:54:46.662157+0000","last_unstale":"2024-05-30T16:54:47.645013+0000","last_undegraded":"2024-05-30T16:54:47.645013+0000","last_fullsized":"2024-05-30T16:54:47.645013+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:06:09.978683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.642071+0000","last_change":"2024-05-30T16:54:46.660389+0000","last_active":"2024-05-30T16:54:47.642071+0000","last_peered":"2024-05-30T16:54:47.642071+0000","last_clean":"2024-05-30T16:54:47.642071+0000","last_became_active":"2024-05-30T16:54:46.660137+0000","last_became_peered":"2024-05-30T16:54:46.660137+0000","last_unstale":"2024-05-30T16:54:47.642071+0000","last_undegraded":"2024-05-30T16:54:47.642071+0000","last_fullsized":"2024-05-30T16:54:47.642071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:08.541067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.007838+0000","last_change":"2024-05-30T16:54:46.666587+0000","last_active":"2024-05-30T16:54:48.007838+0000","last_peered":"2024-05-30T16:54:48.007838+0000","last_clean":"2024-05-30T16:54:48.007838+0000","last_became_active":"2024-05-30T16:54:46.663836+0000","last_became_peered":"2024-05-30T16:54:46.663836+0000","last_unstale":"2024-05-30T16:54:48.007838+0000","last_undegraded":"2024-05-30T16:54:48.007838+0000","last_fullsized":"2024-05-30T16:54:48.007838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:27.929563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.644161+0000","last_change":"2024-05-30T16:54:46.648712+0000","last_active":"2024-05-30T16:54:47.644161+0000","last_peered":"2024-05-30T16:54:47.644161+0000","last_clean":"2024-05-30T16:54:47.644161+0000","last_became_active":"2024-05-30T16:54:46.648462+0000","last_became_peered":"2024-05-30T16:54:46.648462+0000","last_unstale":"2024-05-30T16:54:47.644161+0000","last_undegraded":"2024-05-30T16:54:47.644161+0000","last_fullsized":"2024-05-30T16:54:47.644161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:49.445877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499060+0000","last_change":"2024-05-30T16:54:46.644799+0000","last_active":"2024-05-30T16:54:48.499060+0000","last_peered":"2024-05-30T16:54:48.499060+0000","last_clean":"2024-05-30T16:54:48.499060+0000","last_became_active":"2024-05-30T16:54:46.644523+0000","last_became_peered":"2024-05-30T16:54:46.644523+0000","last_unstale":"2024-05-30T16:54:48.499060+0000","last_undegraded":"2024-05-30T16:54:48.499060+0000","last_fullsized":"2024-05-30T16:54:48.499060+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:29:19.068447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.645232+0000","last_change":"2024-05-30T16:54:46.661707+0000","last_active":"2024-05-30T16:54:47.645232+0000","last_peered":"2024-05-30T16:54:47.645232+0000","last_clean":"2024-05-30T16:54:47.645232+0000","last_became_active":"2024-05-30T16:54:46.661402+0000","last_became_peered":"2024-05-30T16:54:46.661402+0000","last_unstale":"2024-05-30T16:54:47.645232+0000","last_undegraded":"2024-05-30T16:54:47.645232+0000","last_fullsized":"2024-05-30T16:54:47.645232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:03.777914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499400+0000","last_change":"2024-05-30T16:54:46.672351+0000","last_active":"2024-05-30T16:54:48.499400+0000","last_peered":"2024-05-30T16:54:48.499400+0000","last_clean":"2024-05-30T16:54:48.499400+0000","last_became_active":"2024-05-30T16:54:46.672097+0000","last_became_peered":"2024-05-30T16:54:46.672097+0000","last_unstale":"2024-05-30T16:54:48.499400+0000","last_undegraded":"2024-05-30T16:54:48.499400+0000","last_fullsized":"2024-05-30T16:54:48.499400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:12.383279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499520+0000","last_change":"2024-05-30T16:54:46.669733+0000","last_active":"2024-05-30T16:54:48.499520+0000","last_peered":"2024-05-30T16:54:48.499520+0000","last_clean":"2024-05-30T16:54:48.499520+0000","last_became_active":"2024-05-30T16:54:46.666565+0000","last_became_peered":"2024-05-30T16:54:46.666565+0000","last_unstale":"2024-05-30T16:54:48.499520+0000","last_undegraded":"2024-05-30T16:54:48.499520+0000","last_fullsized":"2024-05-30T16:54:48.499520+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:08:48.971261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.645046+0000","last_change":"2024-05-30T16:54:46.665480+0000","last_active":"2024-05-30T16:54:47.645046+0000","last_peered":"2024-05-30T16:54:47.645046+0000","last_clean":"2024-05-30T16:54:47.645046+0000","last_became_active":"2024-05-30T16:54:46.665069+0000","last_became_peered":"2024-05-30T16:54:46.665069+0000","last_unstale":"2024-05-30T16:54:47.645046+0000","last_undegraded":"2024-05-30T16:54:47.645046+0000","last_fullsized":"2024-05-30T16:54:47.645046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:27.929563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.989460+0000","last_change":"2024-05-30T16:54:46.657415+0000","last_active":"2024-05-30T16:54:47.989460+0000","last_peered":"2024-05-30T16:54:47.989460+0000","last_clean":"2024-05-30T16:54:47.989460+0000","last_became_active":"2024-05-30T16:54:46.655817+0000","last_became_peered":"2024-05-30T16:54:46.655817+0000","last_unstale":"2024-05-30T16:54:47.989460+0000","last_undegraded":"2024-05-30T16:54:47.989460+0000","last_fullsized":"2024-05-30T16:54:47.989460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:11:06.643179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.644666+0000","last_change":"2024-05-30T16:54:46.653603+0000","last_active":"2024-05-30T16:54:47.644666+0000","last_peered":"2024-05-30T16:54:47.644666+0000","last_clean":"2024-05-30T16:54:47.644666+0000","last_became_active":"2024-05-30T16:54:46.653302+0000","last_became_peered":"2024-05-30T16:54:46.653302+0000","last_unstale":"2024-05-30T16:54:47.644666+0000","last_undegraded":"2024-05-30T16:54:47.644666+0000","last_fullsized":"2024-05-30T16:54:47.644666+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:27.358141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.644359+0000","last_change":"2024-05-30T16:54:46.662800+0000","last_active":"2024-05-30T16:54:47.644359+0000","last_peered":"2024-05-30T16:54:47.644359+0000","last_clean":"2024-05-30T16:54:47.644359+0000","last_became_active":"2024-05-30T16:54:46.662524+0000","last_became_peered":"2024-05-30T16:54:46.662524+0000","last_unstale":"2024-05-30T16:54:47.644359+0000","last_undegraded":"2024-05-30T16:54:47.644359+0000","last_fullsized":"2024-05-30T16:54:47.644359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:53.545049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.007817+0000","last_change":"2024-05-30T16:54:46.657592+0000","last_active":"2024-05-30T16:54:48.007817+0000","last_peered":"2024-05-30T16:54:48.007817+0000","last_clean":"2024-05-30T16:54:48.007817+0000","last_became_active":"2024-05-30T16:54:46.656008+0000","last_became_peered":"2024-05-30T16:54:46.656008+0000","last_unstale":"2024-05-30T16:54:48.007817+0000","last_undegraded":"2024-05-30T16:54:48.007817+0000","last_fullsized":"2024-05-30T16:54:48.007817+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:06:09.978683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499984+0000","last_change":"2024-05-30T16:54:46.650661+0000","last_active":"2024-05-30T16:54:48.499984+0000","last_peered":"2024-05-30T16:54:48.499984+0000","last_clean":"2024-05-30T16:54:48.499984+0000","last_became_active":"2024-05-30T16:54:46.650334+0000","last_became_peered":"2024-05-30T16:54:46.650334+0000","last_unstale":"2024-05-30T16:54:48.499984+0000","last_undegraded":"2024-05-30T16:54:48.499984+0000","last_fullsized":"2024-05-30T16:54:48.499984+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:01:07.113460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923498+0000","last_change":"2024-05-30T16:54:46.669925+0000","last_active":"2024-05-30T16:54:47.923498+0000","last_peered":"2024-05-30T16:54:47.923498+0000","last_clean":"2024-05-30T16:54:47.923498+0000","last_became_active":"2024-05-30T16:54:46.669377+0000","last_became_peered":"2024-05-30T16:54:46.669377+0000","last_unstale":"2024-05-30T16:54:47.923498+0000","last_undegraded":"2024-05-30T16:54:47.923498+0000","last_fullsized":"2024-05-30T16:54:47.923498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:42:44.289174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.642210+0000","last_change":"2024-05-30T16:54:46.652970+0000","last_active":"2024-05-30T16:54:47.642210+0000","last_peered":"2024-05-30T16:54:47.642210+0000","last_clean":"2024-05-30T16:54:47.642210+0000","last_became_active":"2024-05-30T16:54:46.652703+0000","last_became_peered":"2024-05-30T16:54:46.652703+0000","last_unstale":"2024-05-30T16:54:47.642210+0000","last_undegraded":"2024-05-30T16:54:47.642210+0000","last_fullsized":"2024-05-30T16:54:47.642210+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:57:36.517542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499735+0000","last_change":"2024-05-30T16:54:46.656703+0000","last_active":"2024-05-30T16:54:48.499735+0000","last_peered":"2024-05-30T16:54:48.499735+0000","last_clean":"2024-05-30T16:54:48.499735+0000","last_became_active":"2024-05-30T16:54:46.656443+0000","last_became_peered":"2024-05-30T16:54:46.656443+0000","last_unstale":"2024-05-30T16:54:48.499735+0000","last_undegraded":"2024-05-30T16:54:48.499735+0000","last_fullsized":"2024-05-30T16:54:48.499735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:00.284334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923133+0000","last_change":"2024-05-30T16:54:46.659978+0000","last_active":"2024-05-30T16:54:47.923133+0000","last_peered":"2024-05-30T16:54:47.923133+0000","last_clean":"2024-05-30T16:54:47.923133+0000","last_became_active":"2024-05-30T16:54:46.659698+0000","last_became_peered":"2024-05-30T16:54:46.659698+0000","last_unstale":"2024-05-30T16:54:47.923133+0000","last_undegraded":"2024-05-30T16:54:47.923133+0000","last_fullsized":"2024-05-30T16:54:47.923133+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:30.994078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499938+0000","last_change":"2024-05-30T16:54:46.656851+0000","last_active":"2024-05-30T16:54:48.499938+0000","last_peered":"2024-05-30T16:54:48.499938+0000","last_clean":"2024-05-30T16:54:48.499938+0000","last_became_active":"2024-05-30T16:54:46.656304+0000","last_became_peered":"2024-05-30T16:54:46.656304+0000","last_unstale":"2024-05-30T16:54:48.499938+0000","last_undegraded":"2024-05-30T16:54:48.499938+0000","last_fullsized":"2024-05-30T16:54:48.499938+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:06:52.956164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.922869+0000","last_change":"2024-05-30T16:54:46.666968+0000","last_active":"2024-05-30T16:54:47.922869+0000","last_peered":"2024-05-30T16:54:47.922869+0000","last_clean":"2024-05-30T16:54:47.922869+0000","last_became_active":"2024-05-30T16:54:46.666488+0000","last_became_peered":"2024-05-30T16:54:46.666488+0000","last_unstale":"2024-05-30T16:54:47.922869+0000","last_undegraded":"2024-05-30T16:54:47.922869+0000","last_fullsized":"2024-05-30T16:54:47.922869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:06:09.978683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.989242+0000","last_change":"2024-05-30T16:54:46.656716+0000","last_active":"2024-05-30T16:54:47.989242+0000","last_peered":"2024-05-30T16:54:47.989242+0000","last_clean":"2024-05-30T16:54:47.989242+0000","last_became_active":"2024-05-30T16:54:46.656437+0000","last_became_peered":"2024-05-30T16:54:46.656437+0000","last_unstale":"2024-05-30T16:54:47.989242+0000","last_undegraded":"2024-05-30T16:54:47.989242+0000","last_fullsized":"2024-05-30T16:54:47.989242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:08:48.971261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.642463+0000","last_change":"2024-05-30T16:54:46.669569+0000","last_active":"2024-05-30T16:54:47.642463+0000","last_peered":"2024-05-30T16:54:47.642463+0000","last_clean":"2024-05-30T16:54:47.642463+0000","last_became_active":"2024-05-30T16:54:46.669337+0000","last_became_peered":"2024-05-30T16:54:46.669337+0000","last_unstale":"2024-05-30T16:54:47.642463+0000","last_undegraded":"2024-05-30T16:54:47.642463+0000","last_fullsized":"2024-05-30T16:54:47.642463+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:33.056889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.645159+0000","last_change":"2024-05-30T16:54:46.648131+0000","last_active":"2024-05-30T16:54:47.645159+0000","last_peered":"2024-05-30T16:54:47.645159+0000","last_clean":"2024-05-30T16:54:47.645159+0000","last_became_active":"2024-05-30T16:54:46.647835+0000","last_became_peered":"2024-05-30T16:54:46.647835+0000","last_unstale":"2024-05-30T16:54:47.645159+0000","last_undegraded":"2024-05-30T16:54:47.645159+0000","last_fullsized":"2024-05-30T16:54:47.645159+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:21:46.477906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.007983+0000","last_change":"2024-05-30T16:54:46.664412+0000","last_active":"2024-05-30T16:54:48.007983+0000","last_peered":"2024-05-30T16:54:48.007983+0000","last_clean":"2024-05-30T16:54:48.007983+0000","last_became_active":"2024-05-30T16:54:46.664116+0000","last_became_peered":"2024-05-30T16:54:46.664116+0000","last_unstale":"2024-05-30T16:54:48.007983+0000","last_undegraded":"2024-05-30T16:54:48.007983+0000","last_fullsized":"2024-05-30T16:54:48.007983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:21:46.477906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.642197+0000","last_change":"2024-05-30T16:54:46.665560+0000","last_active":"2024-05-30T16:54:47.642197+0000","last_peered":"2024-05-30T16:54:47.642197+0000","last_clean":"2024-05-30T16:54:47.642197+0000","last_became_active":"2024-05-30T16:54:46.665248+0000","last_became_peered":"2024-05-30T16:54:46.665248+0000","last_unstale":"2024-05-30T16:54:47.642197+0000","last_undegraded":"2024-05-30T16:54:47.642197+0000","last_fullsized":"2024-05-30T16:54:47.642197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:31:54.008315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.500162+0000","last_change":"2024-05-30T16:54:46.645186+0000","last_active":"2024-05-30T16:54:48.500162+0000","last_peered":"2024-05-30T16:54:48.500162+0000","last_clean":"2024-05-30T16:54:48.500162+0000","last_became_active":"2024-05-30T16:54:46.644504+0000","last_became_peered":"2024-05-30T16:54:46.644504+0000","last_unstale":"2024-05-30T16:54:48.500162+0000","last_undegraded":"2024-05-30T16:54:48.500162+0000","last_fullsized":"2024-05-30T16:54:48.500162+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:30:41.104294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923503+0000","last_change":"2024-05-30T16:54:46.658606+0000","last_active":"2024-05-30T16:54:47.923503+0000","last_peered":"2024-05-30T16:54:47.923503+0000","last_clean":"2024-05-30T16:54:47.923503+0000","last_became_active":"2024-05-30T16:54:46.658313+0000","last_became_peered":"2024-05-30T16:54:46.658313+0000","last_unstale":"2024-05-30T16:54:47.923503+0000","last_undegraded":"2024-05-30T16:54:47.923503+0000","last_fullsized":"2024-05-30T16:54:47.923503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:38:44.292824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.641894+0000","last_change":"2024-05-30T16:54:46.664673+0000","last_active":"2024-05-30T16:54:47.641894+0000","last_peered":"2024-05-30T16:54:47.641894+0000","last_clean":"2024-05-30T16:54:47.641894+0000","last_became_active":"2024-05-30T16:54:46.664411+0000","last_became_peered":"2024-05-30T16:54:46.664411+0000","last_unstale":"2024-05-30T16:54:47.641894+0000","last_undegraded":"2024-05-30T16:54:47.641894+0000","last_fullsized":"2024-05-30T16:54:47.641894+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:23:42.155034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.008429+0000","last_change":"2024-05-30T16:54:46.661133+0000","last_active":"2024-05-30T16:54:48.008429+0000","last_peered":"2024-05-30T16:54:48.008429+0000","last_clean":"2024-05-30T16:54:48.008429+0000","last_became_active":"2024-05-30T16:54:46.660444+0000","last_became_peered":"2024-05-30T16:54:46.660444+0000","last_unstale":"2024-05-30T16:54:48.008429+0000","last_undegraded":"2024-05-30T16:54:48.008429+0000","last_fullsized":"2024-05-30T16:54:48.008429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:42:44.289174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.008178+0000","last_change":"2024-05-30T16:54:46.662959+0000","last_active":"2024-05-30T16:54:48.008178+0000","last_peered":"2024-05-30T16:54:48.008178+0000","last_clean":"2024-05-30T16:54:48.008178+0000","last_became_active":"2024-05-30T16:54:46.662617+0000","last_became_peered":"2024-05-30T16:54:46.662617+0000","last_unstale":"2024-05-30T16:54:48.008178+0000","last_undegraded":"2024-05-30T16:54:48.008178+0000","last_fullsized":"2024-05-30T16:54:48.008178+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:09:11.755993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.008208+0000","last_change":"2024-05-30T16:54:45.647654+0000","last_active":"2024-05-30T16:54:48.008208+0000","last_peered":"2024-05-30T16:54:48.008208+0000","last_clean":"2024-05-30T16:54:48.008208+0000","last_became_active":"2024-05-30T16:54:45.647348+0000","last_became_peered":"2024-05-30T16:54:45.647348+0000","last_unstale":"2024-05-30T16:54:48.008208+0000","last_undegraded":"2024-05-30T16:54:48.008208+0000","last_fullsized":"2024-05-30T16:54:48.008208+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:42.667446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499497+0000","last_change":"2024-05-30T16:54:46.665719+0000","last_active":"2024-05-30T16:54:48.499497+0000","last_peered":"2024-05-30T16:54:48.499497+0000","last_clean":"2024-05-30T16:54:48.499497+0000","last_became_active":"2024-05-30T16:54:46.665454+0000","last_became_peered":"2024-05-30T16:54:46.665454+0000","last_unstale":"2024-05-30T16:54:48.499497+0000","last_undegraded":"2024-05-30T16:54:48.499497+0000","last_fullsized":"2024-05-30T16:54:48.499497+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:52.187097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.500056+0000","last_change":"2024-05-30T16:54:45.661521+0000","last_active":"2024-05-30T16:54:48.500056+0000","last_peered":"2024-05-30T16:54:48.500056+0000","last_clean":"2024-05-30T16:54:48.500056+0000","last_became_active":"2024-05-30T16:54:45.660638+0000","last_became_peered":"2024-05-30T16:54:45.660638+0000","last_unstale":"2024-05-30T16:54:48.500056+0000","last_undegraded":"2024-05-30T16:54:48.500056+0000","last_fullsized":"2024-05-30T16:54:48.500056+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:30:44.646305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.008033+0000","last_change":"2024-05-30T16:54:46.667652+0000","last_active":"2024-05-30T16:54:48.008033+0000","last_peered":"2024-05-30T16:54:48.008033+0000","last_clean":"2024-05-30T16:54:48.008033+0000","last_became_active":"2024-05-30T16:54:46.667421+0000","last_became_peered":"2024-05-30T16:54:46.667421+0000","last_unstale":"2024-05-30T16:54:48.008033+0000","last_undegraded":"2024-05-30T16:54:48.008033+0000","last_fullsized":"2024-05-30T16:54:48.008033+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:30.994078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.008286+0000","last_change":"2024-05-30T16:54:45.648517+0000","last_active":"2024-05-30T16:54:48.008286+0000","last_peered":"2024-05-30T16:54:48.008286+0000","last_clean":"2024-05-30T16:54:48.008286+0000","last_became_active":"2024-05-30T16:54:45.647977+0000","last_became_peered":"2024-05-30T16:54:45.647977+0000","last_unstale":"2024-05-30T16:54:48.008286+0000","last_undegraded":"2024-05-30T16:54:48.008286+0000","last_fullsized":"2024-05-30T16:54:48.008286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.008159+0000","last_change":"2024-05-30T16:54:46.666945+0000","last_active":"2024-05-30T16:54:48.008159+0000","last_peered":"2024-05-30T16:54:48.008159+0000","last_clean":"2024-05-30T16:54:48.008159+0000","last_became_active":"2024-05-30T16:54:46.666678+0000","last_became_peered":"2024-05-30T16:54:46.666678+0000","last_unstale":"2024-05-30T16:54:48.008159+0000","last_undegraded":"2024-05-30T16:54:48.008159+0000","last_fullsized":"2024-05-30T16:54:48.008159+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:43:36.740785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.645117+0000","last_change":"2024-05-30T16:54:45.655293+0000","last_active":"2024-05-30T16:54:47.645117+0000","last_peered":"2024-05-30T16:54:47.645117+0000","last_clean":"2024-05-30T16:54:47.645117+0000","last_became_active":"2024-05-30T16:54:45.652639+0000","last_became_peered":"2024-05-30T16:54:45.652639+0000","last_unstale":"2024-05-30T16:54:47.645117+0000","last_undegraded":"2024-05-30T16:54:47.645117+0000","last_fullsized":"2024-05-30T16:54:47.645117+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:26.354745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499799+0000","last_change":"2024-05-30T16:54:46.657037+0000","last_active":"2024-05-30T16:54:48.499799+0000","last_peered":"2024-05-30T16:54:48.499799+0000","last_clean":"2024-05-30T16:54:48.499799+0000","last_became_active":"2024-05-30T16:54:46.656600+0000","last_became_peered":"2024-05-30T16:54:46.656600+0000","last_unstale":"2024-05-30T16:54:48.499799+0000","last_undegraded":"2024-05-30T16:54:48.499799+0000","last_fullsized":"2024-05-30T16:54:48.499799+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:14.666621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.644394+0000","last_change":"2024-05-30T16:54:45.649596+0000","last_active":"2024-05-30T16:54:47.644394+0000","last_peered":"2024-05-30T16:54:47.644394+0000","last_clean":"2024-05-30T16:54:47.644394+0000","last_became_active":"2024-05-30T16:54:45.649230+0000","last_became_peered":"2024-05-30T16:54:45.649230+0000","last_unstale":"2024-05-30T16:54:47.644394+0000","last_undegraded":"2024-05-30T16:54:47.644394+0000","last_fullsized":"2024-05-30T16:54:47.644394+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:28:17.157569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.500018+0000","last_change":"2024-05-30T16:54:46.659830+0000","last_active":"2024-05-30T16:54:48.500018+0000","last_peered":"2024-05-30T16:54:48.500018+0000","last_clean":"2024-05-30T16:54:48.500018+0000","last_became_active":"2024-05-30T16:54:46.659562+0000","last_became_peered":"2024-05-30T16:54:46.659562+0000","last_unstale":"2024-05-30T16:54:48.500018+0000","last_undegraded":"2024-05-30T16:54:48.500018+0000","last_fullsized":"2024-05-30T16:54:48.500018+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:53:19.237584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.007874+0000","last_change":"2024-05-30T16:54:45.653322+0000","last_active":"2024-05-30T16:54:48.007874+0000","last_peered":"2024-05-30T16:54:48.007874+0000","last_clean":"2024-05-30T16:54:48.007874+0000","last_became_active":"2024-05-30T16:54:45.653039+0000","last_became_peered":"2024-05-30T16:54:45.653039+0000","last_unstale":"2024-05-30T16:54:48.007874+0000","last_undegraded":"2024-05-30T16:54:48.007874+0000","last_fullsized":"2024-05-30T16:54:48.007874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:46.827065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.989291+0000","last_change":"2024-05-30T16:54:46.664566+0000","last_active":"2024-05-30T16:54:47.989291+0000","last_peered":"2024-05-30T16:54:47.989291+0000","last_clean":"2024-05-30T16:54:47.989291+0000","last_became_active":"2024-05-30T16:54:46.664293+0000","last_became_peered":"2024-05-30T16:54:46.664293+0000","last_unstale":"2024-05-30T16:54:47.989291+0000","last_undegraded":"2024-05-30T16:54:47.989291+0000","last_fullsized":"2024-05-30T16:54:47.989291+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:38:28.276519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.644155+0000","last_change":"2024-05-30T16:54:45.649519+0000","last_active":"2024-05-30T16:54:47.644155+0000","last_peered":"2024-05-30T16:54:47.644155+0000","last_clean":"2024-05-30T16:54:47.644155+0000","last_became_active":"2024-05-30T16:54:45.649210+0000","last_became_peered":"2024-05-30T16:54:45.649210+0000","last_unstale":"2024-05-30T16:54:47.644155+0000","last_undegraded":"2024-05-30T16:54:47.644155+0000","last_fullsized":"2024-05-30T16:54:47.644155+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:04.574576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499496+0000","last_change":"2024-05-30T16:54:46.659370+0000","last_active":"2024-05-30T16:54:48.499496+0000","last_peered":"2024-05-30T16:54:48.499496+0000","last_clean":"2024-05-30T16:54:48.499496+0000","last_became_active":"2024-05-30T16:54:46.658407+0000","last_became_peered":"2024-05-30T16:54:46.658407+0000","last_unstale":"2024-05-30T16:54:48.499496+0000","last_undegraded":"2024-05-30T16:54:48.499496+0000","last_fullsized":"2024-05-30T16:54:48.499496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:34.559777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.643868+0000","last_change":"2024-05-30T16:54:45.657461+0000","last_active":"2024-05-30T16:54:47.643868+0000","last_peered":"2024-05-30T16:54:47.643868+0000","last_clean":"2024-05-30T16:54:47.643868+0000","last_became_active":"2024-05-30T16:54:45.657185+0000","last_became_peered":"2024-05-30T16:54:45.657185+0000","last_unstale":"2024-05-30T16:54:47.643868+0000","last_undegraded":"2024-05-30T16:54:47.643868+0000","last_fullsized":"2024-05-30T16:54:47.643868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:01.690937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.645458+0000","last_change":"2024-05-30T16:54:46.672121+0000","last_active":"2024-05-30T16:54:47.645458+0000","last_peered":"2024-05-30T16:54:47.645458+0000","last_clean":"2024-05-30T16:54:47.645458+0000","last_became_active":"2024-05-30T16:54:46.671781+0000","last_became_peered":"2024-05-30T16:54:46.671781+0000","last_unstale":"2024-05-30T16:54:47.645458+0000","last_undegraded":"2024-05-30T16:54:47.645458+0000","last_fullsized":"2024-05-30T16:54:47.645458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:26.161079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923627+0000","last_change":"2024-05-30T16:54:45.658364+0000","last_active":"2024-05-30T16:54:47.923627+0000","last_peered":"2024-05-30T16:54:47.923627+0000","last_clean":"2024-05-30T16:54:47.923627+0000","last_became_active":"2024-05-30T16:54:45.658015+0000","last_became_peered":"2024-05-30T16:54:45.658015+0000","last_unstale":"2024-05-30T16:54:47.923627+0000","last_undegraded":"2024-05-30T16:54:47.923627+0000","last_fullsized":"2024-05-30T16:54:47.923627+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:04.574576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923600+0000","last_change":"2024-05-30T16:54:46.673850+0000","last_active":"2024-05-30T16:54:47.923600+0000","last_peered":"2024-05-30T16:54:47.923600+0000","last_clean":"2024-05-30T16:54:47.923600+0000","last_became_active":"2024-05-30T16:54:46.673493+0000","last_became_peered":"2024-05-30T16:54:46.673493+0000","last_unstale":"2024-05-30T16:54:47.923600+0000","last_undegraded":"2024-05-30T16:54:47.923600+0000","last_fullsized":"2024-05-30T16:54:47.923600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:38.114951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.500105+0000","last_change":"2024-05-30T16:54:45.655634+0000","last_active":"2024-05-30T16:54:48.500105+0000","last_peered":"2024-05-30T16:54:48.500105+0000","last_clean":"2024-05-30T16:54:48.500105+0000","last_became_active":"2024-05-30T16:54:45.655296+0000","last_became_peered":"2024-05-30T16:54:45.655296+0000","last_unstale":"2024-05-30T16:54:48.500105+0000","last_undegraded":"2024-05-30T16:54:48.500105+0000","last_fullsized":"2024-05-30T16:54:48.500105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:25.505141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499163+0000","last_change":"2024-05-30T16:54:46.665621+0000","last_active":"2024-05-30T16:54:48.499163+0000","last_peered":"2024-05-30T16:54:48.499163+0000","last_clean":"2024-05-30T16:54:48.499163+0000","last_became_active":"2024-05-30T16:54:46.665034+0000","last_became_peered":"2024-05-30T16:54:46.665034+0000","last_unstale":"2024-05-30T16:54:48.499163+0000","last_undegraded":"2024-05-30T16:54:48.499163+0000","last_fullsized":"2024-05-30T16:54:48.499163+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:30.131348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923515+0000","last_change":"2024-05-30T16:54:45.661725+0000","last_active":"2024-05-30T16:54:47.923515+0000","last_peered":"2024-05-30T16:54:47.923515+0000","last_clean":"2024-05-30T16:54:47.923515+0000","last_became_active":"2024-05-30T16:54:45.661411+0000","last_became_peered":"2024-05-30T16:54:45.661411+0000","last_unstale":"2024-05-30T16:54:47.923515+0000","last_undegraded":"2024-05-30T16:54:47.923515+0000","last_fullsized":"2024-05-30T16:54:47.923515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923373+0000","last_change":"2024-05-30T16:54:46.672644+0000","last_active":"2024-05-30T16:54:47.923373+0000","last_peered":"2024-05-30T16:54:47.923373+0000","last_clean":"2024-05-30T16:54:47.923373+0000","last_became_active":"2024-05-30T16:54:46.672183+0000","last_became_peered":"2024-05-30T16:54:46.672183+0000","last_unstale":"2024-05-30T16:54:47.923373+0000","last_undegraded":"2024-05-30T16:54:47.923373+0000","last_fullsized":"2024-05-30T16:54:47.923373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:18:53.807314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.644996+0000","last_change":"2024-05-30T16:54:45.645709+0000","last_active":"2024-05-30T16:54:47.644996+0000","last_peered":"2024-05-30T16:54:47.644996+0000","last_clean":"2024-05-30T16:54:47.644996+0000","last_became_active":"2024-05-30T16:54:45.644794+0000","last_became_peered":"2024-05-30T16:54:45.644794+0000","last_unstale":"2024-05-30T16:54:47.644996+0000","last_undegraded":"2024-05-30T16:54:47.644996+0000","last_fullsized":"2024-05-30T16:54:47.644996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:37.221162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.644565+0000","last_change":"2024-05-30T16:54:46.666387+0000","last_active":"2024-05-30T16:54:47.644565+0000","last_peered":"2024-05-30T16:54:47.644565+0000","last_clean":"2024-05-30T16:54:47.644565+0000","last_became_active":"2024-05-30T16:54:46.666160+0000","last_became_peered":"2024-05-30T16:54:46.666160+0000","last_unstale":"2024-05-30T16:54:47.644565+0000","last_undegraded":"2024-05-30T16:54:47.644565+0000","last_fullsized":"2024-05-30T16:54:47.644565+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:24.586107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.500130+0000","last_change":"2024-05-30T16:54:45.660979+0000","last_active":"2024-05-30T16:54:48.500130+0000","last_peered":"2024-05-30T16:54:48.500130+0000","last_clean":"2024-05-30T16:54:48.500130+0000","last_became_active":"2024-05-30T16:54:45.660628+0000","last_became_peered":"2024-05-30T16:54:45.660628+0000","last_unstale":"2024-05-30T16:54:48.500130+0000","last_undegraded":"2024-05-30T16:54:48.500130+0000","last_fullsized":"2024-05-30T16:54:48.500130+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:24.501334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923020+0000","last_change":"2024-05-30T16:54:46.669298+0000","last_active":"2024-05-30T16:54:47.923020+0000","last_peered":"2024-05-30T16:54:47.923020+0000","last_clean":"2024-05-30T16:54:47.923020+0000","last_became_active":"2024-05-30T16:54:46.669004+0000","last_became_peered":"2024-05-30T16:54:46.669004+0000","last_unstale":"2024-05-30T16:54:47.923020+0000","last_undegraded":"2024-05-30T16:54:47.923020+0000","last_fullsized":"2024-05-30T16:54:47.923020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:59:27.929563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.989273+0000","last_change":"2024-05-30T16:54:45.657137+0000","last_active":"2024-05-30T16:54:47.989273+0000","last_peered":"2024-05-30T16:54:47.989273+0000","last_clean":"2024-05-30T16:54:47.989273+0000","last_became_active":"2024-05-30T16:54:45.656852+0000","last_became_peered":"2024-05-30T16:54:45.656852+0000","last_unstale":"2024-05-30T16:54:47.989273+0000","last_undegraded":"2024-05-30T16:54:47.989273+0000","last_fullsized":"2024-05-30T16:54:47.989273+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:30:37.379158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.643843+0000","last_change":"2024-05-30T16:54:46.659555+0000","last_active":"2024-05-30T16:54:47.643843+0000","last_peered":"2024-05-30T16:54:47.643843+0000","last_clean":"2024-05-30T16:54:47.643843+0000","last_became_active":"2024-05-30T16:54:46.659213+0000","last_became_peered":"2024-05-30T16:54:46.659213+0000","last_unstale":"2024-05-30T16:54:47.643843+0000","last_undegraded":"2024-05-30T16:54:47.643843+0000","last_fullsized":"2024-05-30T16:54:47.643843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:35.259565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.644436+0000","last_change":"2024-05-30T16:54:45.658679+0000","last_active":"2024-05-30T16:54:47.644436+0000","last_peered":"2024-05-30T16:54:47.644436+0000","last_clean":"2024-05-30T16:54:47.644436+0000","last_became_active":"2024-05-30T16:54:45.658329+0000","last_became_peered":"2024-05-30T16:54:45.658329+0000","last_unstale":"2024-05-30T16:54:47.644436+0000","last_undegraded":"2024-05-30T16:54:47.644436+0000","last_fullsized":"2024-05-30T16:54:47.644436+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:48.442480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923005+0000","last_change":"2024-05-30T16:54:46.666749+0000","last_active":"2024-05-30T16:54:47.923005+0000","last_peered":"2024-05-30T16:54:47.923005+0000","last_clean":"2024-05-30T16:54:47.923005+0000","last_became_active":"2024-05-30T16:54:46.665986+0000","last_became_peered":"2024-05-30T16:54:46.665986+0000","last_unstale":"2024-05-30T16:54:47.923005+0000","last_undegraded":"2024-05-30T16:54:47.923005+0000","last_fullsized":"2024-05-30T16:54:47.923005+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:21:46.477906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.922893+0000","last_change":"2024-05-30T16:54:45.660854+0000","last_active":"2024-05-30T16:54:47.922893+0000","last_peered":"2024-05-30T16:54:47.922893+0000","last_clean":"2024-05-30T16:54:47.922893+0000","last_became_active":"2024-05-30T16:54:45.660575+0000","last_became_peered":"2024-05-30T16:54:45.660575+0000","last_unstale":"2024-05-30T16:54:47.922893+0000","last_undegraded":"2024-05-30T16:54:47.922893+0000","last_fullsized":"2024-05-30T16:54:47.922893+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:29:46.827065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923541+0000","last_change":"2024-05-30T16:54:46.660412+0000","last_active":"2024-05-30T16:54:47.923541+0000","last_peered":"2024-05-30T16:54:47.923541+0000","last_clean":"2024-05-30T16:54:47.923541+0000","last_became_active":"2024-05-30T16:54:46.660132+0000","last_became_peered":"2024-05-30T16:54:46.660132+0000","last_unstale":"2024-05-30T16:54:47.923541+0000","last_undegraded":"2024-05-30T16:54:47.923541+0000","last_fullsized":"2024-05-30T16:54:47.923541+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:04:46.404088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499981+0000","last_change":"2024-05-30T16:54:45.658736+0000","last_active":"2024-05-30T16:54:48.499981+0000","last_peered":"2024-05-30T16:54:48.499981+0000","last_clean":"2024-05-30T16:54:48.499981+0000","last_became_active":"2024-05-30T16:54:45.658382+0000","last_became_peered":"2024-05-30T16:54:45.658382+0000","last_unstale":"2024-05-30T16:54:48.499981+0000","last_undegraded":"2024-05-30T16:54:48.499981+0000","last_fullsized":"2024-05-30T16:54:48.499981+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:48.854085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.645485+0000","last_change":"2024-05-30T16:54:46.668478+0000","last_active":"2024-05-30T16:54:47.645485+0000","last_peered":"2024-05-30T16:54:47.645485+0000","last_clean":"2024-05-30T16:54:47.645485+0000","last_became_active":"2024-05-30T16:54:46.668127+0000","last_became_peered":"2024-05-30T16:54:46.668127+0000","last_unstale":"2024-05-30T16:54:47.645485+0000","last_undegraded":"2024-05-30T16:54:47.645485+0000","last_fullsized":"2024-05-30T16:54:47.645485+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:43:36.740785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.008179+0000","last_change":"2024-05-30T16:54:45.651393+0000","last_active":"2024-05-30T16:54:48.008179+0000","last_peered":"2024-05-30T16:54:48.008179+0000","last_clean":"2024-05-30T16:54:48.008179+0000","last_became_active":"2024-05-30T16:54:45.650980+0000","last_became_peered":"2024-05-30T16:54:45.650980+0000","last_unstale":"2024-05-30T16:54:48.008179+0000","last_undegraded":"2024-05-30T16:54:48.008179+0000","last_fullsized":"2024-05-30T16:54:48.008179+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:48:25.157682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499930+0000","last_change":"2024-05-30T16:54:46.647153+0000","last_active":"2024-05-30T16:54:48.499930+0000","last_peered":"2024-05-30T16:54:48.499930+0000","last_clean":"2024-05-30T16:54:48.499930+0000","last_became_active":"2024-05-30T16:54:46.646875+0000","last_became_peered":"2024-05-30T16:54:46.646875+0000","last_unstale":"2024-05-30T16:54:48.499930+0000","last_undegraded":"2024-05-30T16:54:48.499930+0000","last_fullsized":"2024-05-30T16:54:48.499930+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:34:26.259350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.645352+0000","last_change":"2024-05-30T16:54:45.655629+0000","last_active":"2024-05-30T16:54:47.645352+0000","last_peered":"2024-05-30T16:54:47.645352+0000","last_clean":"2024-05-30T16:54:47.645352+0000","last_became_active":"2024-05-30T16:54:45.655351+0000","last_became_peered":"2024-05-30T16:54:45.655351+0000","last_unstale":"2024-05-30T16:54:47.645352+0000","last_undegraded":"2024-05-30T16:54:47.645352+0000","last_fullsized":"2024-05-30T16:54:47.645352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:44:34.256169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923270+0000","last_change":"2024-05-30T16:54:46.672424+0000","last_active":"2024-05-30T16:54:47.923270+0000","last_peered":"2024-05-30T16:54:47.923270+0000","last_clean":"2024-05-30T16:54:47.923270+0000","last_became_active":"2024-05-30T16:54:46.671842+0000","last_became_peered":"2024-05-30T16:54:46.671842+0000","last_unstale":"2024-05-30T16:54:47.923270+0000","last_undegraded":"2024-05-30T16:54:47.923270+0000","last_fullsized":"2024-05-30T16:54:47.923270+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:51.630234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.008100+0000","last_change":"2024-05-30T16:54:45.656675+0000","last_active":"2024-05-30T16:54:48.008100+0000","last_peered":"2024-05-30T16:54:48.008100+0000","last_clean":"2024-05-30T16:54:48.008100+0000","last_became_active":"2024-05-30T16:54:45.656400+0000","last_became_peered":"2024-05-30T16:54:45.656400+0000","last_unstale":"2024-05-30T16:54:48.008100+0000","last_undegraded":"2024-05-30T16:54:48.008100+0000","last_fullsized":"2024-05-30T16:54:48.008100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:48.442480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.644669+0000","last_change":"2024-05-30T16:54:46.667135+0000","last_active":"2024-05-30T16:54:47.644669+0000","last_peered":"2024-05-30T16:54:47.644669+0000","last_clean":"2024-05-30T16:54:47.644669+0000","last_became_active":"2024-05-30T16:54:46.666764+0000","last_became_peered":"2024-05-30T16:54:46.666764+0000","last_unstale":"2024-05-30T16:54:47.644669+0000","last_undegraded":"2024-05-30T16:54:47.644669+0000","last_fullsized":"2024-05-30T16:54:47.644669+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:38:03.829171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.500203+0000","last_change":"2024-05-30T16:54:45.655577+0000","last_active":"2024-05-30T16:54:48.500203+0000","last_peered":"2024-05-30T16:54:48.500203+0000","last_clean":"2024-05-30T16:54:48.500203+0000","last_became_active":"2024-05-30T16:54:45.655197+0000","last_became_peered":"2024-05-30T16:54:45.655197+0000","last_unstale":"2024-05-30T16:54:48.500203+0000","last_undegraded":"2024-05-30T16:54:48.500203+0000","last_fullsized":"2024-05-30T16:54:48.500203+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:44:00.656324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.008231+0000","last_change":"2024-05-30T16:54:46.655167+0000","last_active":"2024-05-30T16:54:48.008231+0000","last_peered":"2024-05-30T16:54:48.008231+0000","last_clean":"2024-05-30T16:54:48.008231+0000","last_became_active":"2024-05-30T16:54:46.654866+0000","last_became_peered":"2024-05-30T16:54:46.654866+0000","last_unstale":"2024-05-30T16:54:48.008231+0000","last_undegraded":"2024-05-30T16:54:48.008231+0000","last_fullsized":"2024-05-30T16:54:48.008231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:18:53.807314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499064+0000","last_change":"2024-05-30T16:54:45.647369+0000","last_active":"2024-05-30T16:54:48.499064+0000","last_peered":"2024-05-30T16:54:48.499064+0000","last_clean":"2024-05-30T16:54:48.499064+0000","last_became_active":"2024-05-30T16:54:45.647108+0000","last_became_peered":"2024-05-30T16:54:45.647108+0000","last_unstale":"2024-05-30T16:54:48.499064+0000","last_undegraded":"2024-05-30T16:54:48.499064+0000","last_fullsized":"2024-05-30T16:54:48.499064+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:20:36.722964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.008367+0000","last_change":"2024-05-30T16:54:46.662209+0000","last_active":"2024-05-30T16:54:48.008367+0000","last_peered":"2024-05-30T16:54:48.008367+0000","last_clean":"2024-05-30T16:54:48.008367+0000","last_became_active":"2024-05-30T16:54:46.661882+0000","last_became_peered":"2024-05-30T16:54:46.661882+0000","last_unstale":"2024-05-30T16:54:48.008367+0000","last_undegraded":"2024-05-30T16:54:48.008367+0000","last_fullsized":"2024-05-30T16:54:48.008367+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:38:44.292824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.644048+0000","last_change":"2024-05-30T16:54:45.657812+0000","last_active":"2024-05-30T16:54:47.644048+0000","last_peered":"2024-05-30T16:54:47.644048+0000","last_clean":"2024-05-30T16:54:47.644048+0000","last_became_active":"2024-05-30T16:54:45.656848+0000","last_became_peered":"2024-05-30T16:54:45.656848+0000","last_unstale":"2024-05-30T16:54:47.644048+0000","last_undegraded":"2024-05-30T16:54:47.644048+0000","last_fullsized":"2024-05-30T16:54:47.644048+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:34.844989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.645391+0000","last_change":"2024-05-30T16:54:46.654546+0000","last_active":"2024-05-30T16:54:47.645391+0000","last_peered":"2024-05-30T16:54:47.645391+0000","last_clean":"2024-05-30T16:54:47.645391+0000","last_became_active":"2024-05-30T16:54:46.653161+0000","last_became_peered":"2024-05-30T16:54:46.653161+0000","last_unstale":"2024-05-30T16:54:47.645391+0000","last_undegraded":"2024-05-30T16:54:47.645391+0000","last_fullsized":"2024-05-30T16:54:47.645391+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:30.994078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499460+0000","last_change":"2024-05-30T16:54:45.658652+0000","last_active":"2024-05-30T16:54:48.499460+0000","last_peered":"2024-05-30T16:54:48.499460+0000","last_clean":"2024-05-30T16:54:48.499460+0000","last_became_active":"2024-05-30T16:54:45.658367+0000","last_became_peered":"2024-05-30T16:54:45.658367+0000","last_unstale":"2024-05-30T16:54:48.499460+0000","last_undegraded":"2024-05-30T16:54:48.499460+0000","last_fullsized":"2024-05-30T16:54:48.499460+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:30:37.379158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.645543+0000","last_change":"2024-05-30T16:54:46.662119+0000","last_active":"2024-05-30T16:54:47.645543+0000","last_peered":"2024-05-30T16:54:47.645543+0000","last_clean":"2024-05-30T16:54:47.645543+0000","last_became_active":"2024-05-30T16:54:46.661785+0000","last_became_peered":"2024-05-30T16:54:46.661785+0000","last_unstale":"2024-05-30T16:54:47.645543+0000","last_undegraded":"2024-05-30T16:54:47.645543+0000","last_fullsized":"2024-05-30T16:54:47.645543+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:51.630234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.008353+0000","last_change":"2024-05-30T16:54:45.653028+0000","last_active":"2024-05-30T16:54:48.008353+0000","last_peered":"2024-05-30T16:54:48.008353+0000","last_clean":"2024-05-30T16:54:48.008353+0000","last_became_active":"2024-05-30T16:54:45.652710+0000","last_became_peered":"2024-05-30T16:54:45.652710+0000","last_unstale":"2024-05-30T16:54:48.008353+0000","last_undegraded":"2024-05-30T16:54:48.008353+0000","last_fullsized":"2024-05-30T16:54:48.008353+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:31.936247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499237+0000","last_change":"2024-05-30T16:54:46.665362+0000","last_active":"2024-05-30T16:54:48.499237+0000","last_peered":"2024-05-30T16:54:48.499237+0000","last_clean":"2024-05-30T16:54:48.499237+0000","last_became_active":"2024-05-30T16:54:46.664731+0000","last_became_peered":"2024-05-30T16:54:46.664731+0000","last_unstale":"2024-05-30T16:54:48.499237+0000","last_undegraded":"2024-05-30T16:54:48.499237+0000","last_fullsized":"2024-05-30T16:54:48.499237+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:50:40.823158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.989399+0000","last_change":"2024-05-30T16:54:45.653794+0000","last_active":"2024-05-30T16:54:47.989399+0000","last_peered":"2024-05-30T16:54:47.989399+0000","last_clean":"2024-05-30T16:54:47.989399+0000","last_became_active":"2024-05-30T16:54:45.652243+0000","last_became_peered":"2024-05-30T16:54:45.652243+0000","last_unstale":"2024-05-30T16:54:47.989399+0000","last_undegraded":"2024-05-30T16:54:47.989399+0000","last_fullsized":"2024-05-30T16:54:47.989399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:41.075478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.008190+0000","last_change":"2024-05-30T16:54:46.659899+0000","last_active":"2024-05-30T16:54:48.008190+0000","last_peered":"2024-05-30T16:54:48.008190+0000","last_clean":"2024-05-30T16:54:48.008190+0000","last_became_active":"2024-05-30T16:54:46.658860+0000","last_became_peered":"2024-05-30T16:54:46.658860+0000","last_unstale":"2024-05-30T16:54:48.008190+0000","last_undegraded":"2024-05-30T16:54:48.008190+0000","last_fullsized":"2024-05-30T16:54:48.008190+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:51.630234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.645170+0000","last_change":"2024-05-30T16:54:45.652157+0000","last_active":"2024-05-30T16:54:47.645170+0000","last_peered":"2024-05-30T16:54:47.645170+0000","last_clean":"2024-05-30T16:54:47.645170+0000","last_became_active":"2024-05-30T16:54:45.651109+0000","last_became_peered":"2024-05-30T16:54:45.651109+0000","last_unstale":"2024-05-30T16:54:47.645170+0000","last_undegraded":"2024-05-30T16:54:47.645170+0000","last_fullsized":"2024-05-30T16:54:47.645170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:52.541652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499674+0000","last_change":"2024-05-30T16:54:46.667327+0000","last_active":"2024-05-30T16:54:48.499674+0000","last_peered":"2024-05-30T16:54:48.499674+0000","last_clean":"2024-05-30T16:54:48.499674+0000","last_became_active":"2024-05-30T16:54:46.667030+0000","last_became_peered":"2024-05-30T16:54:46.667030+0000","last_unstale":"2024-05-30T16:54:48.499674+0000","last_undegraded":"2024-05-30T16:54:48.499674+0000","last_fullsized":"2024-05-30T16:54:48.499674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:36:50.859727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499010+0000","last_change":"2024-05-30T16:54:45.650576+0000","last_active":"2024-05-30T16:54:48.499010+0000","last_peered":"2024-05-30T16:54:48.499010+0000","last_clean":"2024-05-30T16:54:48.499010+0000","last_became_active":"2024-05-30T16:54:45.650316+0000","last_became_peered":"2024-05-30T16:54:45.650316+0000","last_unstale":"2024-05-30T16:54:48.499010+0000","last_undegraded":"2024-05-30T16:54:48.499010+0000","last_fullsized":"2024-05-30T16:54:48.499010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:32:02.321051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.923382+0000","last_change":"2024-05-30T16:54:46.660833+0000","last_active":"2024-05-30T16:54:47.923382+0000","last_peered":"2024-05-30T16:54:47.923382+0000","last_clean":"2024-05-30T16:54:47.923382+0000","last_became_active":"2024-05-30T16:54:46.660017+0000","last_became_peered":"2024-05-30T16:54:46.660017+0000","last_unstale":"2024-05-30T16:54:47.923382+0000","last_undegraded":"2024-05-30T16:54:47.923382+0000","last_fullsized":"2024-05-30T16:54:47.923382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:09:11.755993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.644516+0000","last_change":"2024-05-30T16:54:45.645109+0000","last_active":"2024-05-30T16:54:47.644516+0000","last_peered":"2024-05-30T16:54:47.644516+0000","last_clean":"2024-05-30T16:54:47.644516+0000","last_became_active":"2024-05-30T16:54:45.644753+0000","last_became_peered":"2024-05-30T16:54:45.644753+0000","last_unstale":"2024-05-30T16:54:47.644516+0000","last_undegraded":"2024-05-30T16:54:47.644516+0000","last_fullsized":"2024-05-30T16:54:47.644516+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:57:37.286999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.498794+0000","last_change":"2024-05-30T16:54:46.659487+0000","last_active":"2024-05-30T16:54:48.498794+0000","last_peered":"2024-05-30T16:54:48.498794+0000","last_clean":"2024-05-30T16:54:48.498794+0000","last_became_active":"2024-05-30T16:54:46.659243+0000","last_became_peered":"2024-05-30T16:54:46.659243+0000","last_unstale":"2024-05-30T16:54:48.498794+0000","last_undegraded":"2024-05-30T16:54:48.498794+0000","last_fullsized":"2024-05-30T16:54:48.498794+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:39.030660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.498848+0000","last_change":"2024-05-30T16:54:45.654729+0000","last_active":"2024-05-30T16:54:48.498848+0000","last_peered":"2024-05-30T16:54:48.498848+0000","last_clean":"2024-05-30T16:54:48.498848+0000","last_became_active":"2024-05-30T16:54:45.654447+0000","last_became_peered":"2024-05-30T16:54:45.654447+0000","last_unstale":"2024-05-30T16:54:48.498848+0000","last_undegraded":"2024-05-30T16:54:48.498848+0000","last_fullsized":"2024-05-30T16:54:48.498848+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:28.492293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499650+0000","last_change":"2024-05-30T16:54:46.659617+0000","last_active":"2024-05-30T16:54:48.499650+0000","last_peered":"2024-05-30T16:54:48.499650+0000","last_clean":"2024-05-30T16:54:48.499650+0000","last_became_active":"2024-05-30T16:54:46.659126+0000","last_became_peered":"2024-05-30T16:54:46.659126+0000","last_unstale":"2024-05-30T16:54:48.499650+0000","last_undegraded":"2024-05-30T16:54:48.499650+0000","last_fullsized":"2024-05-30T16:54:48.499650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:29:06.497436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.499171+0000","last_change":"2024-05-30T16:54:45.655443+0000","last_active":"2024-05-30T16:54:48.499171+0000","last_peered":"2024-05-30T16:54:48.499171+0000","last_clean":"2024-05-30T16:54:48.499171+0000","last_became_active":"2024-05-30T16:54:45.655068+0000","last_became_peered":"2024-05-30T16:54:45.655068+0000","last_unstale":"2024-05-30T16:54:48.499171+0000","last_undegraded":"2024-05-30T16:54:48.499171+0000","last_fullsized":"2024-05-30T16:54:48.499171+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:48:21.829480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:48.498859+0000","last_change":"2024-05-30T16:54:46.659507+0000","last_active":"2024-05-30T16:54:48.498859+0000","last_peered":"2024-05-30T16:54:48.498859+0000","last_clean":"2024-05-30T16:54:48.498859+0000","last_became_active":"2024-05-30T16:54:46.659246+0000","last_became_peered":"2024-05-30T16:54:46.659246+0000","last_unstale":"2024-05-30T16:54:48.498859+0000","last_undegraded":"2024-05-30T16:54:48.498859+0000","last_fullsized":"2024-05-30T16:54:48.498859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:45.627785+0000","last_clean_scrub_stamp":"2024-05-30T16:54:45.627785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:41:28.175388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.989229+0000","last_change":"2024-05-30T16:54:45.654457+0000","last_active":"2024-05-30T16:54:47.989229+0000","last_peered":"2024-05-30T16:54:47.989229+0000","last_clean":"2024-05-30T16:54:47.989229+0000","last_became_active":"2024-05-30T16:54:45.654115+0000","last_became_peered":"2024-05-30T16:54:45.654115+0000","last_unstale":"2024-05-30T16:54:47.989229+0000","last_undegraded":"2024-05-30T16:54:47.989229+0000","last_fullsized":"2024-05-30T16:54:47.989229+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:54:44.624388+0000","last_clean_scrub_stamp":"2024-05-30T16:54:44.624388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:38.027264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":246,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-30T16:54:47.922899+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:54:47.922899+0000","last_peered":"2024-05-30T16:54:47.922899+0000","last_clean":"2024-05-30T16:54:47.922899+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:54:47.922899+0000","last_undegraded":"2024-05-30T16:54:47.922899+0000","last_fullsized":"2024-05-30T16:54:47.922899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509514,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44972,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326868,"statfs":{"total":96636764160,"available":96590712832,"internally_reserved":0,"allocated":1339392,"data_stored":897765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509515,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45796,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326044,"statfs":{"total":96636764160,"available":96589869056,"internally_reserved":0,"allocated":737280,"data_stored":307237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509515,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40232,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331608,"statfs":{"total":96636764160,"available":96595566592,"internally_reserved":0,"allocated":745472,"data_stored":307889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45800,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326040,"statfs":{"total":96636764160,"available":96589864960,"internally_reserved":0,"allocated":749568,"data_stored":308849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509515,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44388,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327452,"statfs":{"total":96636764160,"available":96591310848,"internally_reserved":0,"allocated":745472,"data_stored":307293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45796,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326044,"statfs":{"total":96636764160,"available":96589869056,"internally_reserved":0,"allocated":741376,"data_stored":307327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509515,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46392,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325448,"statfs":{"total":96636764160,"available":96589258752,"internally_reserved":0,"allocated":1347584,"data_stored":899799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542219,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45796,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326044,"statfs":{"total":96636764160,"available":96589869056,"internally_reserved":0,"allocated":745472,"data_stored":307293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:54:55.750 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:54:55.751 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T16:54:55.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfcc000640 1 Processor -- start 2024-05-30T16:54:55.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfcc000640 1 -- start start 2024-05-30T16:54:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfcc000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdfc41569e0 0x7fdfc415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfcc000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfc40d0660 0x7fdfc40d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfcc000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc40ad770 con 0x7fdfc40ad2b0 2024-05-30T16:54:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfcc000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fdfc40d1010 con 0x7fdfc40d0660 2024-05-30T16:54:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfcc000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fdfc415cb40 con 0x7fdfc41569e0 2024-05-30T16:54:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfca000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfc40d0660 0x7fdfc40d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfc8c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdfc40ad2b0 0x7fdfc40cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35968/0 (socket says 172.21.15.59:35968) 2024-05-30T16:54:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfc8c00640 1 -- 172.21.15.59:0/1132811876 learned_addr learned my addr 172.21.15.59:0/1132811876 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfc9600640 1 --2- 172.21.15.59:0/1132811876 >> v2:172.21.15.107:3300/0 conn(0x7fdfc41569e0 0x7fdfc415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfca000640 1 -- 172.21.15.59:0/1132811876 >> v2:172.21.15.107:3300/0 conn(0x7fdfc41569e0 msgr2=0x7fdfc415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfca000640 1 --2- 172.21.15.59:0/1132811876 >> v2:172.21.15.107:3300/0 conn(0x7fdfc41569e0 0x7fdfc415d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfca000640 1 -- 172.21.15.59:0/1132811876 >> v1:172.21.15.59:6789/0 conn(0x7fdfc40ad2b0 legacy=0x7fdfc40cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.931+0000 7fdfca000640 1 -- 172.21.15.59:0/1132811876 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc415ce20 con 0x7fdfc40d0660 2024-05-30T16:54:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.935+0000 7fdfca000640 1 --2- 172.21.15.59:0/1132811876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfc40d0660 0x7fdfc40d0ad0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40b4c40 tx=0x7fdfbc01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bea5d4c7f7e827e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.935+0000 7fdfc3e00640 1 -- 172.21.15.59:0/1132811876 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0b2070 con 0x7fdfc40d0660 2024-05-30T16:54:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.935+0000 7fdfc3e00640 1 -- 172.21.15.59:0/1132811876 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0a57e0 con 0x7fdfc40d0660 2024-05-30T16:54:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.935+0000 7fdfc3e00640 1 -- 172.21.15.59:0/1132811876 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0a5bb0 con 0x7fdfc40d0660 2024-05-30T16:54:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.935+0000 7fdfcc000640 1 -- 172.21.15.59:0/1132811876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfc40d0660 msgr2=0x7fdfc40d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.935+0000 7fdfcc000640 1 --2- 172.21.15.59:0/1132811876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfc40d0660 0x7fdfc40d0ad0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40b4c40 tx=0x7fdfbc01c8a0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.935+0000 7fdfcc000640 1 -- 172.21.15.59:0/1132811876 shutdown_connections 2024-05-30T16:54:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.935+0000 7fdfcc000640 1 --2- 172.21.15.59:0/1132811876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfc40d0660 0x7fdfc40d0ad0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.935+0000 7fdfcc000640 1 --2- 172.21.15.59:0/1132811876 >> v2:172.21.15.107:3300/0 conn(0x7fdfc41569e0 0x7fdfc415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.935+0000 7fdfcc000640 1 -- 172.21.15.59:0/1132811876 >> 172.21.15.59:0/1132811876 conn(0x7fdfc406bdb0 msgr2=0x7fdfc406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.935+0000 7fdfcc000640 1 -- 172.21.15.59:0/1132811876 shutdown_connections 2024-05-30T16:54:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.935+0000 7fdfcc000640 1 -- 172.21.15.59:0/1132811876 wait complete. 2024-05-30T16:54:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfcc000640 1 Processor -- start 2024-05-30T16:54:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfcc000640 1 -- start start 2024-05-30T16:54:55.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfcc000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfc40ad2b0 0x7fdfc415dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:55.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfcc000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdfc40d0660 0x7fdfc4098190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfcc000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc41569e0 0x7fdfc40986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfcc000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc40b3c60 con 0x7fdfc40ad2b0 2024-05-30T16:54:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfcc000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc40b3ae0 con 0x7fdfc41569e0 2024-05-30T16:54:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfcc000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc40b3de0 con 0x7fdfc40d0660 2024-05-30T16:54:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfc40ad2b0 0x7fdfc415dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfc40ad2b0 0x7fdfc415dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42672/0 (socket says 172.21.15.59:42672) 2024-05-30T16:54:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc9600640 1 -- 172.21.15.59:0/1660677918 learned_addr learned my addr 172.21.15.59:0/1660677918 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfca000640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc41569e0 0x7fdfc40986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc8c00640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdfc40d0660 0x7fdfc4098190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc9600640 1 -- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdfc40d0660 msgr2=0x7fdfc4098190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc9600640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdfc40d0660 0x7fdfc4098190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc9600640 1 -- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc41569e0 msgr2=0x7fdfc40986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc9600640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc41569e0 0x7fdfc40986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc9600640 1 -- 172.21.15.59:0/1660677918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc4098de0 con 0x7fdfc40ad2b0 2024-05-30T16:54:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfca000640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc41569e0 0x7fdfc40986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc9600640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfc40ad2b0 0x7fdfc415dd90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800d5f0 tx=0x7fdfb800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc1600640 1 -- 172.21.15.59:0/1660677918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80125f0 con 0x7fdfc40ad2b0 2024-05-30T16:54:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc1600640 1 -- 172.21.15.59:0/1660677918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb8019070 con 0x7fdfc40ad2b0 2024-05-30T16:54:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfc1600640 1 -- 172.21.15.59:0/1660677918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80129b0 con 0x7fdfc40ad2b0 2024-05-30T16:54:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfcc000640 1 -- 172.21.15.59:0/1660677918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc409c690 con 0x7fdfc40ad2b0 2024-05-30T16:54:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.939+0000 7fdfcc000640 1 -- 172.21.15.59:0/1660677918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc409cc50 con 0x7fdfc40ad2b0 2024-05-30T16:54:55.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.943+0000 7fdfcc000640 1 -- 172.21.15.59:0/1660677918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc4068a90 con 0x7fdfc40ad2b0 2024-05-30T16:54:55.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.943+0000 7fdfc1600640 1 -- 172.21.15.59:0/1660677918 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fdfb8012b50 con 0x7fdfc40ad2b0 2024-05-30T16:54:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.943+0000 7fdfc1600640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfa4068b90 0x7fdfa406b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.943+0000 7fdfc1600640 1 -- 172.21.15.59:0/1660677918 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fdfb8087ff0 con 0x7fdfc40ad2b0 2024-05-30T16:54:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.943+0000 7fdfc8c00640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfa4068b90 0x7fdfa406b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.943+0000 7fdfc8c00640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfa4068b90 0x7fdfa406b050 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdfc409c060 tx=0x7fdfb0007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:55.947+0000 7fdfc1600640 1 -- 172.21.15.59:0/1660677918 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdfb80575e0 con 0x7fdfc40ad2b0 2024-05-30T16:54:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.171+0000 7fdfcc000640 1 -- 172.21.15.59:0/1660677918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fdfc4072fc0 con 0x7fdfc40ad2b0 2024-05-30T16:54:56.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.171+0000 7fdfc1600640 1 -- 172.21.15.59:0/1660677918 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fdfb8056ee0 con 0x7fdfc40ad2b0 2024-05-30T16:54:56.176 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-05-30T16:54:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA== 2024-05-30T16:54:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-05-30T16:54:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-05-30T16:54:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T16:54:56.176 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-05-30T16:54:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.175+0000 7fdfcc000640 1 -- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfa4068b90 msgr2=0x7fdfa406b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.175+0000 7fdfcc000640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfa4068b90 0x7fdfa406b050 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdfc409c060 tx=0x7fdfb0007e90 comp rx=0 tx=0).stop 2024-05-30T16:54:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.175+0000 7fdfcc000640 1 -- 172.21.15.59:0/1660677918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfc40ad2b0 msgr2=0x7fdfc415dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.175+0000 7fdfcc000640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfc40ad2b0 0x7fdfc415dd90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800d5f0 tx=0x7fdfb800dab0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.175+0000 7fdfcc000640 1 -- 172.21.15.59:0/1660677918 shutdown_connections 2024-05-30T16:54:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.175+0000 7fdfcc000640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfa4068b90 0x7fdfa406b050 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.175+0000 7fdfcc000640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc41569e0 0x7fdfc40986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.175+0000 7fdfcc000640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdfc40d0660 0x7fdfc4098190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.175+0000 7fdfcc000640 1 --2- 172.21.15.59:0/1660677918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfc40ad2b0 0x7fdfc415dd90 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.175+0000 7fdfcc000640 1 -- 172.21.15.59:0/1660677918 >> 172.21.15.59:0/1660677918 conn(0x7fdfc406bdb0 msgr2=0x7fdfc414bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.175+0000 7fdfcc000640 1 -- 172.21.15.59:0/1660677918 shutdown_connections 2024-05-30T16:54:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.175+0000 7fdfcc000640 1 -- 172.21.15.59:0/1660677918 wait complete. 2024-05-30T16:54:56.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:54:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd60800640 1 Processor -- start 2024-05-30T16:54:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd60800640 1 -- start start 2024-05-30T16:54:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd60800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd58155720 0x7fbd58155b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd60800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd5815f6a0 0x7fbd5806f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd60800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd580b43a0 con 0x7fbd580b61f0 2024-05-30T16:54:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd60800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbd580b4680 con 0x7fbd5815f6a0 2024-05-30T16:54:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd60800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbd580b4960 con 0x7fbd58155720 2024-05-30T16:54:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd5e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd5815f6a0 0x7fbd5806f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd5d400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbd580b61f0 0x7fbd58070a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35970/0 (socket says 172.21.15.59:35970) 2024-05-30T16:54:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd5d400640 1 -- 172.21.15.59:0/2814232708 learned_addr learned my addr 172.21.15.59:0/2814232708 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd5de00640 1 --2- 172.21.15.59:0/2814232708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd58155720 0x7fbd58155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:56.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd5e800640 1 -- 172.21.15.59:0/2814232708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd58155720 msgr2=0x7fbd58155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:56.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd5e800640 1 --2- 172.21.15.59:0/2814232708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd58155720 0x7fbd58155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd5e800640 1 -- 172.21.15.59:0/2814232708 >> v1:172.21.15.59:6789/0 conn(0x7fbd580b61f0 legacy=0x7fbd58070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:56.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd5e800640 1 -- 172.21.15.59:0/2814232708 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5815fb10 con 0x7fbd5815f6a0 2024-05-30T16:54:56.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.335+0000 7fbd5ca00640 1 -- 172.21.15.59:0/2814232708 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279690029 0 0) 0x7fbd580b43a0 con 0x7fbd580b61f0 2024-05-30T16:54:56.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.339+0000 7fbd5e800640 1 --2- 172.21.15.59:0/2814232708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd5815f6a0 0x7fbd5806f010 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009d90 tx=0x7fbd5401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd524314521db0d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:56.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.339+0000 7fbd5ca00640 1 -- 172.21.15.59:0/2814232708 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd540b2070 con 0x7fbd5815f6a0 2024-05-30T16:54:56.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.339+0000 7fbd5ca00640 1 -- 172.21.15.59:0/2814232708 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd540a58c0 con 0x7fbd5815f6a0 2024-05-30T16:54:56.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.339+0000 7fbd5ca00640 1 -- 172.21.15.59:0/2814232708 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd540a5c90 con 0x7fbd5815f6a0 2024-05-30T16:54:56.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.339+0000 7fbd60800640 1 -- 172.21.15.59:0/2814232708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd5815f6a0 msgr2=0x7fbd5806f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:56.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.339+0000 7fbd60800640 1 --2- 172.21.15.59:0/2814232708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd5815f6a0 0x7fbd5806f010 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009d90 tx=0x7fbd5401c970 comp rx=0 tx=0).stop 2024-05-30T16:54:56.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.339+0000 7fbd60800640 1 -- 172.21.15.59:0/2814232708 shutdown_connections 2024-05-30T16:54:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.339+0000 7fbd60800640 1 --2- 172.21.15.59:0/2814232708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd5815f6a0 0x7fbd5806f010 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.339+0000 7fbd60800640 1 --2- 172.21.15.59:0/2814232708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd58155720 0x7fbd58155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.339+0000 7fbd60800640 1 -- 172.21.15.59:0/2814232708 >> 172.21.15.59:0/2814232708 conn(0x7fbd5809aa40 msgr2=0x7fbd580b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.339+0000 7fbd60800640 1 -- 172.21.15.59:0/2814232708 shutdown_connections 2024-05-30T16:54:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.339+0000 7fbd60800640 1 -- 172.21.15.59:0/2814232708 wait complete. 2024-05-30T16:54:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd60800640 1 Processor -- start 2024-05-30T16:54:56.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd60800640 1 -- start start 2024-05-30T16:54:56.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd60800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd580b61f0 0x7fbd581524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:56.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd60800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd58155720 0x7fbd581529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:56.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd60800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd5815f6a0 0x7fbd58149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:56.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd60800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbd580d1b20 con 0x7fbd580b61f0 2024-05-30T16:54:56.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd60800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbd580d19a0 con 0x7fbd58155720 2024-05-30T16:54:56.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd60800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbd580d1ca0 con 0x7fbd5815f6a0 2024-05-30T16:54:56.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd5de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd580b61f0 0x7fbd581524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:56.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd5de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd580b61f0 0x7fbd581524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42688/0 (socket says 172.21.15.59:42688) 2024-05-30T16:54:56.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd5de00640 1 -- 172.21.15.59:0/3321635876 learned_addr learned my addr 172.21.15.59:0/3321635876 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd5e800640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd5815f6a0 0x7fbd58149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd5d400640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd58155720 0x7fbd581529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd5de00640 1 -- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd5815f6a0 msgr2=0x7fbd58149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd5de00640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd5815f6a0 0x7fbd58149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd5de00640 1 -- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd58155720 msgr2=0x7fbd581529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd5de00640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd58155720 0x7fbd581529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd5de00640 1 -- 172.21.15.59:0/3321635876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5814aa80 con 0x7fbd580b61f0 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd5de00640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd580b61f0 0x7fbd581524a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00d800 tx=0x7fbd4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd52000640 1 -- 172.21.15.59:0/3321635876 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00b6c0 con 0x7fbd580b61f0 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd52000640 1 -- 172.21.15.59:0/3321635876 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd4c019070 con 0x7fbd580b61f0 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd60800640 1 -- 172.21.15.59:0/3321635876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5814ad60 con 0x7fbd580b61f0 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd52000640 1 -- 172.21.15.59:0/3321635876 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00ba60 con 0x7fbd580b61f0 2024-05-30T16:54:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.343+0000 7fbd60800640 1 -- 172.21.15.59:0/3321635876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5814b320 con 0x7fbd580b61f0 2024-05-30T16:54:56.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.347+0000 7fbd60800640 1 -- 172.21.15.59:0/3321635876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd58068a90 con 0x7fbd580b61f0 2024-05-30T16:54:56.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.347+0000 7fbd52000640 1 -- 172.21.15.59:0/3321635876 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fbd4c00bc00 con 0x7fbd580b61f0 2024-05-30T16:54:56.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.347+0000 7fbd52000640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbd3c068b60 0x7fbd3c06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:56.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.347+0000 7fbd52000640 1 -- 172.21.15.59:0/3321635876 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fbd4c088050 con 0x7fbd580b61f0 2024-05-30T16:54:56.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.347+0000 7fbd5d400640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbd3c068b60 0x7fbd3c06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:56.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.347+0000 7fbd5d400640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbd3c068b60 0x7fbd3c06b020 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbd58151f50 tx=0x7fbd48007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.351+0000 7fbd52000640 1 -- 172.21.15.59:0/3321635876 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbd4c056f60 con 0x7fbd580b61f0 2024-05-30T16:54:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 -- 172.21.15.59:0/3321635876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd5806c620 con 0x7fbd580b61f0 2024-05-30T16:54:56.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd52000640 1 -- 172.21.15.59:0/3321635876 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5187 (secure 0 0 0) 0x7fbd4c05b260 con 0x7fbd580b61f0 2024-05-30T16:54:56.554 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:54:56.554 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1920809274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1920809274},{"type":"v1","addr":"172.21.15.107:6837","nonce":1920809274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5719,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/4161936082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":4161936082},{"type":"v1","addr":"172.21.15.107:6835","nonce":4161936082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4040110781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4040110781},{"type":"v1","addr":"172.21.15.59:6833","nonce":4040110781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:54:46.040632+0000","modified":"2024-05-30T16:54:49.061772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2433633874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2433633874},{"type":"v1","addr":"172.21.15.59:6835","nonce":2433633874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5865,"qdb_cluster":[5865]},"id":4}]} 2024-05-30T16:54:56.554 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 34 2024-05-30T16:54:56.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 -- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbd3c068b60 msgr2=0x7fbd3c06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:56.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbd3c068b60 0x7fbd3c06b020 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbd58151f50 tx=0x7fbd48007df0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 -- 172.21.15.59:0/3321635876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd580b61f0 msgr2=0x7fbd581524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd580b61f0 0x7fbd581524a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00d800 tx=0x7fbd4c00dcc0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 -- 172.21.15.59:0/3321635876 shutdown_connections 2024-05-30T16:54:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbd3c068b60 0x7fbd3c06b020 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd5815f6a0 0x7fbd58149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd58155720 0x7fbd581529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 --2- 172.21.15.59:0/3321635876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd580b61f0 0x7fbd581524a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 -- 172.21.15.59:0/3321635876 >> 172.21.15.59:0/3321635876 conn(0x7fbd5809aa40 msgr2=0x7fbd581608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 -- 172.21.15.59:0/3321635876 shutdown_connections 2024-05-30T16:54:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:56.551+0000 7fbd60800640 1 -- 172.21.15.59:0/3321635876 wait complete. 2024-05-30T16:54:56.978 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T16:54:46.040632+0000', 'modified': '2024-05-30T16:54:49.061772+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5865}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5865': {'gid': 5865, 'name': 'c', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/2433633874', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6834', 'nonce': 2433633874}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2433633874}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5865, 'qdb_cluster': [5865]} 2024-05-30T16:54:56.978 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T16:54:56.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-30T16:54:57.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fccf1a00640 1 Processor -- start 2024-05-30T16:54:57.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fccf1a00640 1 -- start start 2024-05-30T16:54:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fccf1a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccec0b4510 0x7fccec1630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fccf1a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fccec0b48f0 0x7fccec15f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fccf1a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccec15f5f0 0x7fccec072d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fccf1a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fccec1635f0 con 0x7fccec0b4510 2024-05-30T16:54:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fccf1a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fccec15fbe0 con 0x7fccec0b48f0 2024-05-30T16:54:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fccf1a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fccec15fec0 con 0x7fccec15f5f0 2024-05-30T16:54:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fcceaa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccec0b4510 0x7fccec1630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fcceaa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccec0b4510 0x7fccec1630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42700/0 (socket says 172.21.15.59:42700) 2024-05-30T16:54:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fcceaa00640 1 -- 172.21.15.59:0/744818115 learned_addr learned my addr 172.21.15.59:0/744818115 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fcceb400640 1 --2- 172.21.15.59:0/744818115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccec15f5f0 0x7fccec072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fccea000640 1 --2- 172.21.15.59:0/744818115 >> v2:172.21.15.107:3300/0 conn(0x7fccec0b48f0 0x7fccec15f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fcceaa00640 1 -- 172.21.15.59:0/744818115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccec15f5f0 msgr2=0x7fccec072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fcceaa00640 1 --2- 172.21.15.59:0/744818115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccec15f5f0 0x7fccec072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fcceaa00640 1 -- 172.21.15.59:0/744818115 >> v2:172.21.15.107:3300/0 conn(0x7fccec0b48f0 msgr2=0x7fccec15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fcceaa00640 1 --2- 172.21.15.59:0/744818115 >> v2:172.21.15.107:3300/0 conn(0x7fccec0b48f0 0x7fccec15f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fcceaa00640 1 -- 172.21.15.59:0/744818115 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccec1628b0 con 0x7fccec0b4510 2024-05-30T16:54:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fcceb400640 1 --2- 172.21.15.59:0/744818115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccec15f5f0 0x7fccec072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.119+0000 7fccea000640 1 --2- 172.21.15.59:0/744818115 >> v2:172.21.15.107:3300/0 conn(0x7fccec0b48f0 0x7fccec15f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fcceaa00640 1 --2- 172.21.15.59:0/744818115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccec0b4510 0x7fccec1630b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fccec0b3980 tx=0x7fccdc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc03fdb70439d58 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fcce9600640 1 -- 172.21.15.59:0/744818115 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0b0070 con 0x7fccec0b4510 2024-05-30T16:54:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fcce9600640 1 -- 172.21.15.59:0/744818115 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccdc0ab600 con 0x7fccec0b4510 2024-05-30T16:54:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fcce9600640 1 -- 172.21.15.59:0/744818115 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0ab9d0 con 0x7fccec0b4510 2024-05-30T16:54:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fccf1a00640 1 -- 172.21.15.59:0/744818115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccec0b4510 msgr2=0x7fccec1630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fccf1a00640 1 --2- 172.21.15.59:0/744818115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccec0b4510 0x7fccec1630b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fccec0b3980 tx=0x7fccdc01c520 comp rx=0 tx=0).stop 2024-05-30T16:54:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fccf1a00640 1 -- 172.21.15.59:0/744818115 shutdown_connections 2024-05-30T16:54:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fccf1a00640 1 --2- 172.21.15.59:0/744818115 >> v2:172.21.15.107:3300/0 conn(0x7fccec0b48f0 0x7fccec15f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fccf1a00640 1 --2- 172.21.15.59:0/744818115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccec15f5f0 0x7fccec072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fccf1a00640 1 --2- 172.21.15.59:0/744818115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccec0b4510 0x7fccec1630b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fccf1a00640 1 -- 172.21.15.59:0/744818115 >> 172.21.15.59:0/744818115 conn(0x7fccec0b3240 msgr2=0x7fccec0725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fccf1a00640 1 -- 172.21.15.59:0/744818115 shutdown_connections 2024-05-30T16:54:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.123+0000 7fccf1a00640 1 -- 172.21.15.59:0/744818115 wait complete. 2024-05-30T16:54:57.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccf1a00640 1 Processor -- start 2024-05-30T16:54:57.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccf1a00640 1 -- start start 2024-05-30T16:54:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccf1a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccec0b4510 0x7fccec13b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccf1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccec0b48f0 0x7fccec152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccf1a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccec15f5f0 0x7fccec152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccf1a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fccec06f1f0 con 0x7fccec0b48f0 2024-05-30T16:54:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccf1a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fccec06f070 con 0x7fccec15f5f0 2024-05-30T16:54:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccf1a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fccec073650 con 0x7fccec0b4510 2024-05-30T16:54:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccea000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccec0b48f0 0x7fccec152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccea000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccec0b48f0 0x7fccec152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42712/0 (socket says 172.21.15.59:42712) 2024-05-30T16:54:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccea000640 1 -- 172.21.15.59:0/4210838368 learned_addr learned my addr 172.21.15.59:0/4210838368 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fcceb400640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccec15f5f0 0x7fccec152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fcceaa00640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccec0b4510 0x7fccec13b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccea000640 1 -- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccec0b4510 msgr2=0x7fccec13b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccea000640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccec0b4510 0x7fccec13b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccea000640 1 -- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccec15f5f0 msgr2=0x7fccec152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccea000640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccec15f5f0 0x7fccec152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccea000640 1 -- 172.21.15.59:0/4210838368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccec13b8c0 con 0x7fccec0b48f0 2024-05-30T16:54:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fcceb400640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccec15f5f0 0x7fccec152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccea000640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccec0b48f0 0x7fccec152590 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fccd800d5c0 tx=0x7fccd800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fcce2a00640 1 -- 172.21.15.59:0/4210838368 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8018020 con 0x7fccec0b48f0 2024-05-30T16:54:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fcce2a00640 1 -- 172.21.15.59:0/4210838368 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd8014620 con 0x7fccec0b48f0 2024-05-30T16:54:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fcce2a00640 1 -- 172.21.15.59:0/4210838368 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8014a10 con 0x7fccec0b48f0 2024-05-30T16:54:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccf1a00640 1 -- 172.21.15.59:0/4210838368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccec14c900 con 0x7fccec0b48f0 2024-05-30T16:54:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.127+0000 7fccf1a00640 1 -- 172.21.15.59:0/4210838368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccec14cec0 con 0x7fccec0b48f0 2024-05-30T16:54:57.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcce2a00640 1 -- 172.21.15.59:0/4210838368 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fccd801b020 con 0x7fccec0b48f0 2024-05-30T16:54:57.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcce2a00640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcccc068b60 0x7fcccc06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcce2a00640 1 -- 172.21.15.59:0/4210838368 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fccd8088010 con 0x7fccec0b48f0 2024-05-30T16:54:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcceaa00640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcccc068b60 0x7fcccc06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fccf4fb6000 1 Processor -- start 2024-05-30T16:54:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fccf4fb6000 1 -- start start 2024-05-30T16:54:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcceaa00640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcccc068b60 0x7fcccc06b020 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0ad000 tx=0x7fccdc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fccf4fb6000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978120 0x55e792978500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fccf4fb6000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e792978a40 0x55e79292b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fccf4fb6000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e79292b650 0x55e79292ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fccf4fb6000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e79277c420 con 0x55e79292b650 2024-05-30T16:54:57.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fccf4fb6000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e792716bf0 con 0x55e792978120 2024-05-30T16:54:57.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fccf4fb6000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55e7927783e0 con 0x55e792978a40 2024-05-30T16:54:57.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcceb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e79292b650 0x55e79292ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcceb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e79292b650 0x55e79292ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42714/0 (socket says 172.21.15.59:42714) 2024-05-30T16:54:57.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcceb400640 1 -- 172.21.15.59:0/1834973539 learned_addr learned my addr 172.21.15.59:0/1834973539 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:57.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcceaa00640 1 --2- 172.21.15.59:0/1834973539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978120 0x55e792978500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fccea000640 1 --2- 172.21.15.59:0/1834973539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e792978a40 0x55e79292b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcceb400640 1 -- 172.21.15.59:0/1834973539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e792978a40 msgr2=0x55e79292b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:57.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcceb400640 1 --2- 172.21.15.59:0/1834973539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e792978a40 0x55e79292b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcceb400640 1 -- 172.21.15.59:0/1834973539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978120 msgr2=0x55e792978500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:57.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcceb400640 1 --2- 172.21.15.59:0/1834973539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978120 0x55e792978500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcceb400640 1 -- 172.21.15.59:0/1834973539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e792824450 con 0x55e79292b650 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fccea000640 1 --2- 172.21.15.59:0/1834973539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e792978a40 0x55e79292b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.131+0000 7fcceb400640 1 --2- 172.21.15.59:0/1834973539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e79292b650 0x55e79292ba30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009bc0 tx=0x7fcce4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec99e50524f914 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccd7400640 1 -- 172.21.15.59:0/1834973539 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4013780 con 0x55e79292b650 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccd7400640 1 -- 172.21.15.59:0/1834973539 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce4019070 con 0x55e79292b650 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccd7400640 1 -- 172.21.15.59:0/1834973539 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4013b20 con 0x55e79292b650 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 -- 172.21.15.59:0/1834973539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e79292b650 msgr2=0x55e79292ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/1834973539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e79292b650 0x55e79292ba30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009bc0 tx=0x7fcce4004410 comp rx=0 tx=0).stop 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 -- 172.21.15.59:0/1834973539 shutdown_connections 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/1834973539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e79292b650 0x55e79292ba30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/1834973539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e792978a40 0x55e79292b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/1834973539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978120 0x55e792978500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 -- 172.21.15.59:0/1834973539 >> 172.21.15.59:0/1834973539 conn(0x55e792958ec0 msgr2=0x55e79295b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 -- 172.21.15.59:0/1834973539 shutdown_connections 2024-05-30T16:54:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 -- 172.21.15.59:0/1834973539 wait complete. 2024-05-30T16:54:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 -- start start 2024-05-30T16:54:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 Processor -- start 2024-05-30T16:54:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e79292b650 0x55e792930b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978120 0x55e792931080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978a40 0x55e7929315c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e79271cec0 con 0x55e792978a40 2024-05-30T16:54:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e7927fd120 con 0x55e792978120 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55e792787350 con 0x55e79292b650 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 10 client.0 _ll_register_callbacks cb 0x55e7927594d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcceb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978a40 0x55e7929315c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcceb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978a40 0x55e7929315c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42726/0 (socket says 172.21.15.59:42726) 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcceb400640 1 -- 172.21.15.59:0/3959523546 learned_addr learned my addr 172.21.15.59:0/3959523546 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcceaa00640 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e79292b650 0x55e792930b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccea000640 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978120 0x55e792931080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcceb400640 1 -- 172.21.15.59:0/3959523546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e79292b650 msgr2=0x55e792930b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcceb400640 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e79292b650 0x55e792930b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcceb400640 1 -- 172.21.15.59:0/3959523546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978120 msgr2=0x55e792931080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcceb400640 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978120 0x55e792931080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcceb400640 1 -- 172.21.15.59:0/3959523546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7927c1f80 con 0x55e792978a40 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcceaa00640 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e79292b650 0x55e792930b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcceb400640 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978a40 0x55e7929315c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcce4016040 tx=0x7fcce4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e30f6ad088471c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcccbe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcccbe00640 1 -- 172.21.15.59:0/3959523546 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4013d30 con 0x55e792978a40 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fcccbe00640 1 -- 172.21.15.59:0/3959523546 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fcce4029b20 con 0x55e792978a40 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.135+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3959523546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcce4019070 con 0x55e792978a40 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fcccbe00640 1 -- 172.21.15.59:0/3959523546 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fcce4030050 con 0x55e792978a40 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 10 client.6024 fetch_fsmap learned FSMap version 34 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3959523546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55e792755f00 con 0x55e792978a40 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fcccbe00640 1 -- 172.21.15.59:0/3959523546 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce4019070 con 0x55e792978a40 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fcccbe00640 1 -- 172.21.15.59:0/3959523546 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7fcce4033020 con 0x55e792978a40 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 10 client.6024 fetch_fsmap finished waiting for FSMap version 34 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 10 client.6024 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 20 client.6024 populate_metadata read hostname 'smithi059' 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.59:6834/2433633874,v1:172.21.15.59:6835/2433633874] conn(0x55e7929873c0 0x55e7929897b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 4 client.6024 mds_command: new command op to 5865 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3959523546 --> [v2:172.21.15.59:6834/2433633874,v1:172.21.15.59:6835/2433633874] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e792715bc0 con 0x55e7929873c0 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fcceaa00640 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.59:6834/2433633874,v1:172.21.15.59:6835/2433633874] conn(0x55e7929873c0 0x55e7929897b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fcceaa00640 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.59:6834/2433633874,v1:172.21.15.59:6835/2433633874] conn(0x55e7929873c0 0x55e7929897b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f3518c57106fdb9 server_cookie=b09f7cbcaaf14659 in_seq=0 out_seq=0 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fcccbe00640 10 client.6024 ms_handle_connect on v2:172.21.15.59:6834/2433633874 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fcccbe00640 1 -- 172.21.15.59:0/3959523546 <== mds.0 v2:172.21.15.59:6834/2433633874 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e792715bc0 con 0x55e7929873c0 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fcccbe00640 10 client.6024 handle_command_reply: tid=0 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 client.6024 shutdown 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3959523546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978a40 msgr2=0x55e7929315c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978a40 0x55e7929315c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcce4016040 tx=0x7fcce4004ac0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3959523546 shutdown_connections 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.59:6834/2433633874,v1:172.21.15.59:6835/2433633874] conn(0x55e7929873c0 0x55e7929897b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978a40 0x55e7929315c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978120 0x55e792931080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/3959523546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e79292b650 0x55e792930b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fcccbe00640 0 client.6024 ms_handle_reset on v2:172.21.15.59:6834/2433633874 2024-05-30T16:54:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3959523546 >> 172.21.15.59:0/3959523546 conn(0x55e792958ec0 msgr2=0x55e79295b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3959523546 shutdown_connections 2024-05-30T16:54:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3959523546 wait complete. 2024-05-30T16:54:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.139+0000 7fccf4fb6000 20 client.6024 trim_cache size 0 max 16384 2024-05-30T16:54:57.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 Processor -- start 2024-05-30T16:54:57.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 -- start start 2024-05-30T16:54:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e79292b650 0x55e7929e3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 0x55e7929e38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978a40 0x55e7929e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fccec2031e0 con 0x55e792978120 2024-05-30T16:54:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fccec2025a0 con 0x55e792978a40 2024-05-30T16:54:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fccec202bc0 con 0x55e79292b650 2024-05-30T16:54:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccea000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 0x55e7929e38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccea000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 0x55e7929e38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42730/0 (socket says 172.21.15.59:42730) 2024-05-30T16:54:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccea000640 1 -- 172.21.15.59:0/3488512703 learned_addr learned my addr 172.21.15.59:0/3488512703 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fcceb400640 1 --2- 172.21.15.59:0/3488512703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978a40 0x55e7929e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fcceaa00640 1 --2- 172.21.15.59:0/3488512703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e79292b650 0x55e7929e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccea000640 1 -- 172.21.15.59:0/3488512703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e79292b650 msgr2=0x55e7929e3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:57.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccea000640 1 --2- 172.21.15.59:0/3488512703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e79292b650 0x55e7929e3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccea000640 1 -- 172.21.15.59:0/3488512703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978a40 msgr2=0x55e7929e3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:57.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccea000640 1 --2- 172.21.15.59:0/3488512703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978a40 0x55e7929e3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccea000640 1 -- 172.21.15.59:0/3488512703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e792702e80 con 0x55e792978120 2024-05-30T16:54:57.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccea000640 1 --2- 172.21.15.59:0/3488512703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 0x55e7929e38d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fccd8056e90 tx=0x7fccd8016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237f3fbc6066480d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:57.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccd6a00640 1 -- 172.21.15.59:0/3488512703 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd805b2b0 con 0x55e792978120 2024-05-30T16:54:57.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccd6a00640 1 -- 172.21.15.59:0/3488512703 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd8083070 con 0x55e792978120 2024-05-30T16:54:57.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccd6a00640 1 -- 172.21.15.59:0/3488512703 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd805fae0 con 0x55e792978120 2024-05-30T16:54:57.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3488512703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 msgr2=0x55e7929e38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/3488512703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 0x55e7929e38d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fccd8056e90 tx=0x7fccd8016040 comp rx=0 tx=0).stop 2024-05-30T16:54:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3488512703 shutdown_connections 2024-05-30T16:54:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/3488512703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e792978a40 0x55e7929e3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/3488512703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 0x55e7929e38d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/3488512703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e79292b650 0x55e7929e3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3488512703 >> 172.21.15.59:0/3488512703 conn(0x55e792958ec0 msgr2=0x55e792929870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3488512703 shutdown_connections 2024-05-30T16:54:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.159+0000 7fccf4fb6000 1 -- 172.21.15.59:0/3488512703 wait complete. 2024-05-30T16:54:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 1 -- start start 2024-05-30T16:54:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 1 Processor -- start 2024-05-30T16:54:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79292b650 0x55e79298bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 0x55e7929a3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e792978a40 0x55e7929a3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e79277b730 con 0x55e792978120 2024-05-30T16:54:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e7927489e0 con 0x55e79292b650 2024-05-30T16:54:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55e792780a50 con 0x55e792978a40 2024-05-30T16:54:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 10 client.0 _ll_register_callbacks cb 0x7fcce4009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:54:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccea000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 0x55e7929a3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccea000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 0x55e7929a3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42746/0 (socket says 172.21.15.59:42746) 2024-05-30T16:54:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccea000640 1 -- 172.21.15.59:0/806869815 learned_addr learned my addr 172.21.15.59:0/806869815 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fcceb400640 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e792978a40 0x55e7929a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccea000640 1 -- 172.21.15.59:0/806869815 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e792978a40 msgr2=0x55e7929a3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccea000640 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e792978a40 0x55e7929a3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fcceaa00640 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79292b650 0x55e79298bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccea000640 1 -- 172.21.15.59:0/806869815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79292b650 msgr2=0x55e79298bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccea000640 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79292b650 0x55e79298bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccea000640 1 -- 172.21.15.59:0/806869815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e792744b30 con 0x55e792978120 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fcceb400640 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e792978a40 0x55e7929a3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fcceaa00640 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79292b650 0x55e79298bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccea000640 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 0x55e7929a3340 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fccd8053360 tx=0x7fccd8006f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482c869d25c29103 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fcccbe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fcccbe00640 1 -- 172.21.15.59:0/806869815 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8014db0 con 0x55e792978120 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fcccbe00640 1 -- 172.21.15.59:0/806869815 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fccd8056350 con 0x55e792978120 2024-05-30T16:54:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 1 -- 172.21.15.59:0/806869815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccd8083070 con 0x55e792978120 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fcccbe00640 1 -- 172.21.15.59:0/806869815 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fccd805b2b0 con 0x55e792978120 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 10 client.6030 fetch_fsmap learned FSMap version 34 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 1 -- 172.21.15.59:0/806869815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55e7927fd5b0 con 0x55e792978120 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fcccbe00640 1 -- 172.21.15.59:0/806869815 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd8083070 con 0x55e792978120 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fcccbe00640 1 -- 172.21.15.59:0/806869815 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7fccd8013050 con 0x55e792978120 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 10 client.6030 fetch_fsmap finished waiting for FSMap version 34 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 10 client.6030 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 20 client.6030 populate_metadata read hostname 'smithi059' 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.59:6834/2433633874,v1:172.21.15.59:6835/2433633874] conn(0x55e7929e6770 0x55e7929e6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 4 client.6030 mds_command: new command op to 5865 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fccf4fb6000 1 -- 172.21.15.59:0/806869815 --> [v2:172.21.15.59:6834/2433633874,v1:172.21.15.59:6835/2433633874] -- command(tid 0: {"prefix": "status"}) -- 0x55e7929588f0 con 0x55e7929e6770 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.163+0000 7fcceaa00640 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.59:6834/2433633874,v1:172.21.15.59:6835/2433633874] conn(0x55e7929e6770 0x55e7929e6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fcceaa00640 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.59:6834/2433633874,v1:172.21.15.59:6835/2433633874] conn(0x55e7929e6770 0x55e7929e6b50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f11263fe987fec7b server_cookie=4212a541a3f593ce in_seq=0 out_seq=0 2024-05-30T16:54:57.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fcccbe00640 10 client.6030 ms_handle_connect on v2:172.21.15.59:6834/2433633874 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fcccbe00640 1 -- 172.21.15.59:0/806869815 <== mds.0 v2:172.21.15.59:6834/2433633874 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55e7929588f0 con 0x55e7929e6770 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fcccbe00640 10 client.6030 handle_command_reply: tid=0 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf4fb6000 1 client.6030 shutdown 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf4fb6000 1 -- 172.21.15.59:0/806869815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 msgr2=0x55e7929a3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 0x55e7929a3340 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fccd8053360 tx=0x7fccd8006f60 comp rx=0 tx=0).stop 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf4fb6000 1 -- 172.21.15.59:0/806869815 shutdown_connections 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e792978a40 0x55e7929a3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.59:6834/2433633874,v1:172.21.15.59:6835/2433633874] conn(0x55e7929e6770 0x55e7929e6b50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e792978120 0x55e7929a3340 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf4fb6000 1 --2- 172.21.15.59:0/806869815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79292b650 0x55e79298bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf4fb6000 1 -- 172.21.15.59:0/806869815 >> 172.21.15.59:0/806869815 conn(0x55e792958ec0 msgr2=0x55e79292a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fcccbe00640 0 client.6030 ms_handle_reset on v2:172.21.15.59:6834/2433633874 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf4fb6000 1 -- 172.21.15.59:0/806869815 shutdown_connections 2024-05-30T16:54:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf4fb6000 1 -- 172.21.15.59:0/806869815 wait complete. 2024-05-30T16:54:57.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf4fb6000 20 client.6030 trim_cache size 0 max 16384 2024-05-30T16:54:57.174 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:54:57.174 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:54:57.174 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-05-30T16:54:57.174 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5865, 2024-05-30T16:54:57.174 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-05-30T16:54:57.174 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-05-30T16:54:57.174 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-05-30T16:54:57.174 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 10.534011293000001, 2024-05-30T16:54:57.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 34, 2024-05-30T16:54:57.174 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 62, 2024-05-30T16:54:57.175 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 62, 2024-05-30T16:54:57.175 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 15.737695723 2024-05-30T16:54:57.175 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:54:57.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf1a00640 1 -- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcccc068b60 msgr2=0x7fcccc06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf1a00640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcccc068b60 0x7fcccc06b020 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0ad000 tx=0x7fccdc0a6000 comp rx=0 tx=0).stop 2024-05-30T16:54:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf1a00640 1 -- 172.21.15.59:0/4210838368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccec0b48f0 msgr2=0x7fccec152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf1a00640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccec0b48f0 0x7fccec152590 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fccd800d5c0 tx=0x7fccd800da80 comp rx=0 tx=0).stop 2024-05-30T16:54:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf1a00640 1 -- 172.21.15.59:0/4210838368 shutdown_connections 2024-05-30T16:54:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf1a00640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcccc068b60 0x7fcccc06b020 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf1a00640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccec15f5f0 0x7fccec152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf1a00640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccec0b48f0 0x7fccec152590 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf1a00640 1 --2- 172.21.15.59:0/4210838368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccec0b4510 0x7fccec13b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf1a00640 1 -- 172.21.15.59:0/4210838368 >> 172.21.15.59:0/4210838368 conn(0x7fccec0b3240 msgr2=0x7fccec06fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf1a00640 1 -- 172.21.15.59:0/4210838368 shutdown_connections 2024-05-30T16:54:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.167+0000 7fccf1a00640 1 -- 172.21.15.59:0/4210838368 wait complete. 2024-05-30T16:54:57.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:54:57.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.327+0000 7fd9eb400640 1 Processor -- start 2024-05-30T16:54:57.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.327+0000 7fd9eb400640 1 -- start start 2024-05-30T16:54:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.327+0000 7fd9eb400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9e406e900 0x7fd9e415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.327+0000 7fd9eb400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9e40d0560 0x7fd9e40d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.327+0000 7fd9eb400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9e415f060 con 0x7fd9e40af720 2024-05-30T16:54:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.327+0000 7fd9eb400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd9e40afb00 con 0x7fd9e406e900 2024-05-30T16:54:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.327+0000 7fd9eb400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e415c270 con 0x7fd9e40d0560 2024-05-30T16:54:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.327+0000 7fd9e3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9e406e900 0x7fd9e415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e8a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd9e40af720 0x7fd9e415b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35982/0 (socket says 172.21.15.59:35982) 2024-05-30T16:54:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9e406e900 0x7fd9e415f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42760/0 (socket says 172.21.15.59:42760) 2024-05-30T16:54:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e8a00640 1 -- 172.21.15.59:0/810560911 learned_addr learned my addr 172.21.15.59:0/810560911 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:57.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e9400640 1 --2- 172.21.15.59:0/810560911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9e40d0560 0x7fd9e40d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e3e00640 1 -- 172.21.15.59:0/810560911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9e40d0560 msgr2=0x7fd9e40d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:57.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e3e00640 1 --2- 172.21.15.59:0/810560911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9e40d0560 0x7fd9e40d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e3e00640 1 -- 172.21.15.59:0/810560911 >> v1:172.21.15.59:6789/0 conn(0x7fd9e40af720 legacy=0x7fd9e415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e3e00640 1 -- 172.21.15.59:0/810560911 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e415c550 con 0x7fd9e406e900 2024-05-30T16:54:57.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e3400640 1 -- 172.21.15.59:0/810560911 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099425101 0 0) 0x7fd9e415f060 con 0x7fd9e40af720 2024-05-30T16:54:57.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e9400640 1 --2- 172.21.15.59:0/810560911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9e40d0560 0x7fd9e40d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e3e00640 1 --2- 172.21.15.59:0/810560911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e406e900 0x7fd9e415f7f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00097c0 tx=0x7fd9d001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe3af883aa3f952 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:57.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e3400640 1 -- 172.21.15.59:0/810560911 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d00b0070 con 0x7fd9e406e900 2024-05-30T16:54:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e3400640 1 -- 172.21.15.59:0/810560911 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d00ab600 con 0x7fd9e406e900 2024-05-30T16:54:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.331+0000 7fd9e3400640 1 -- 172.21.15.59:0/810560911 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d00ab9d0 con 0x7fd9e406e900 2024-05-30T16:54:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 -- 172.21.15.59:0/810560911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e406e900 msgr2=0x7fd9e415f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 --2- 172.21.15.59:0/810560911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e406e900 0x7fd9e415f7f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00097c0 tx=0x7fd9d001c4a0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 -- 172.21.15.59:0/810560911 shutdown_connections 2024-05-30T16:54:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 --2- 172.21.15.59:0/810560911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9e40d0560 0x7fd9e40d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 --2- 172.21.15.59:0/810560911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e406e900 0x7fd9e415f7f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 -- 172.21.15.59:0/810560911 >> 172.21.15.59:0/810560911 conn(0x7fd9e40b22d0 msgr2=0x7fd9e40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 -- 172.21.15.59:0/810560911 shutdown_connections 2024-05-30T16:54:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 -- 172.21.15.59:0/810560911 wait complete. 2024-05-30T16:54:57.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 Processor -- start 2024-05-30T16:54:57.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 -- start start 2024-05-30T16:54:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9e406e900 0x7fd9e40cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9e40af720 0x7fd9e4152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e40d0560 0x7fd9e41532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e40732d0 con 0x7fd9e40d0560 2024-05-30T16:54:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4073150 con 0x7fd9e40af720 2024-05-30T16:54:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9eb400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e41585c0 con 0x7fd9e406e900 2024-05-30T16:54:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9e9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e40d0560 0x7fd9e41532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9e9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e40d0560 0x7fd9e41532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42774/0 (socket says 172.21.15.59:42774) 2024-05-30T16:54:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9e9400640 1 -- 172.21.15.59:0/1382818377 learned_addr learned my addr 172.21.15.59:0/1382818377 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9e8a00640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9e406e900 0x7fd9e40cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9e3e00640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9e40af720 0x7fd9e4152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9e9400640 1 -- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9e406e900 msgr2=0x7fd9e40cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9e9400640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9e406e900 0x7fd9e40cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9e9400640 1 -- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9e40af720 msgr2=0x7fd9e4152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9e9400640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9e40af720 0x7fd9e4152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9e9400640 1 -- 172.21.15.59:0/1382818377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e40cf920 con 0x7fd9e40d0560 2024-05-30T16:54:57.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.335+0000 7fd9e9400640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e40d0560 0x7fd9e41532f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00cd80 tx=0x7fd9dc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:57.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.339+0000 7fd9e0c00640 1 -- 172.21.15.59:0/1382818377 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc00f680 con 0x7fd9e40d0560 2024-05-30T16:54:57.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.339+0000 7fd9e0c00640 1 -- 172.21.15.59:0/1382818377 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9dc00f840 con 0x7fd9e40d0560 2024-05-30T16:54:57.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.339+0000 7fd9eb400640 1 -- 172.21.15.59:0/1382818377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e40cdda0 con 0x7fd9e40d0560 2024-05-30T16:54:57.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.339+0000 7fd9e0c00640 1 -- 172.21.15.59:0/1382818377 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc00fc30 con 0x7fd9e40d0560 2024-05-30T16:54:57.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.339+0000 7fd9eb400640 1 -- 172.21.15.59:0/1382818377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e40ce320 con 0x7fd9e40d0560 2024-05-30T16:54:57.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.339+0000 7fd9eb400640 1 -- 172.21.15.59:0/1382818377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e4068a90 con 0x7fd9e40d0560 2024-05-30T16:54:57.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.339+0000 7fd9e0c00640 1 -- 172.21.15.59:0/1382818377 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fd9dc0213f0 con 0x7fd9e40d0560 2024-05-30T16:54:57.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.339+0000 7fd9e0c00640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd9c4068b60 0x7fd9c406b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:57.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.339+0000 7fd9e0c00640 1 -- 172.21.15.59:0/1382818377 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fd9dc088640 con 0x7fd9e40d0560 2024-05-30T16:54:57.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.339+0000 7fd9e8a00640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd9c4068b60 0x7fd9c406b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:57.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.343+0000 7fd9e8a00640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd9c4068b60 0x7fd9c406b020 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8007fd0 tx=0x7fd9d8007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:57.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.343+0000 7fd9e0c00640 1 -- 172.21.15.59:0/1382818377 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd9dc014030 con 0x7fd9e40d0560 2024-05-30T16:54:57.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 -- 172.21.15.59:0/1382818377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd9e41562d0 con 0x7fd9e40d0560 2024-05-30T16:54:57.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9e0c00640 1 -- 172.21.15.59:0/1382818377 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7fd9dc057850 con 0x7fd9e40d0560 2024-05-30T16:54:57.549 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:54:57.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 -- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd9c4068b60 msgr2=0x7fd9c406b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd9c4068b60 0x7fd9c406b020 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8007fd0 tx=0x7fd9d8007d60 comp rx=0 tx=0).stop 2024-05-30T16:54:57.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 -- 172.21.15.59:0/1382818377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e40d0560 msgr2=0x7fd9e41532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:57.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e40d0560 0x7fd9e41532f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00cd80 tx=0x7fd9dc00a650 comp rx=0 tx=0).stop 2024-05-30T16:54:57.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 -- 172.21.15.59:0/1382818377 shutdown_connections 2024-05-30T16:54:57.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd9c4068b60 0x7fd9c406b020 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e40d0560 0x7fd9e41532f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9e40af720 0x7fd9e4152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 --2- 172.21.15.59:0/1382818377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9e406e900 0x7fd9e40cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:57.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 -- 172.21.15.59:0/1382818377 >> 172.21.15.59:0/1382818377 conn(0x7fd9e40b22d0 msgr2=0x7fd9e40b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:57.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 -- 172.21.15.59:0/1382818377 shutdown_connections 2024-05-30T16:54:57.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57.547+0000 7fd9eb400640 1 -- 172.21.15.59:0/1382818377 wait complete. 2024-05-30T16:54:57.571 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:54:57.571 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:54:57.571 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-05-30T16:54:57.571 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T16:54:57.571 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:54:57.571 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:54:57.571 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:54:57.571 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:54:57.571 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:54:57.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:54:57.572 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-05-30T16:54:57.581 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:54:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:54:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:54:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:54:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-05-30T16:54:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:54:57.581 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:54:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-05-30T16:54:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-05-30T16:54:57.581 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42092sec preferred_lft 42092sec 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-05-30T16:54:57.582 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:46:82:05:9a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:54:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:54:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T16:54:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:54:57.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:54:57.585 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:54:57.646 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-05-30T16:54:57.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:54:57.648 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-05-30T16:54:57.702 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-05-30T16:54:57.702 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:54:57.702 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T16:54:57.702 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T16:54:57.702 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T16:54:57.702 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:54:57.703 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:54:57.703 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:54:57.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T16:54:57.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T16:54:57.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T16:54:57.703 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:54:57.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:54:57.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:54:57.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:54:57.839 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-05-30T16:54:57.847 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T16:54:57.847 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T16:54:57.848 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:54:57.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:54:57.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-05-30T16:54:57.911 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-30T16:54:57.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:54:57.912 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T16:54:57.960 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:54:57.960 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:54:57.960 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:54:58.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:54:58.076 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:54:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:54:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:54:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:54:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:54:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:54:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:54:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:54:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:54:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:54:58.135 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:54:58.135 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:54:58.135 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:54:58.135 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:54:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:54:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:54:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:54:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:54:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:54:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:54:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:54:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:54:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:54:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:54:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:54:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:54:58.139 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:54:58.139 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:54:58.139 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:54:58.139 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:54:58.139 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:54:58.139 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:54:58.139 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:54:58.139 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:54:58.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:54:58.140 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:54:58.196 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-30T16:54:58.196 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-30T16:54:58.242 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:54:58.263 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:54:58.313 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:54:58.313 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:54:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:54:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:54:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:54:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:54:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:54:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:54:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:54:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:54:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:54:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:54:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:54:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:54:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:54:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:54:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:54:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:54:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:54:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:54:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:54:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:54:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:54:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:54:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:54:58.316 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:54:58.316 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:54:58.316 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:54:58.316 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:54:58.316 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:54:58.316 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:54:58.316 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:54:58.316 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:54:58.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:54:58.317 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:54:58.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:2024-05-30T16:54:58.335+0000 7f0e62094580 -1 init, newargv = 0x55bb8e93fd10 newargc=15 2024-05-30T16:54:58.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[39997]: starting ceph client 2024-05-30T16:54:58.344 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[39997]: starting fuse 2024-05-30T16:54:58.347 INFO:teuthology.orchestra.run.smithi059.stdout:44 2024-05-30T16:54:58.347 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> import re 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2024-05-30T16:54:58.348 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> return f 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.0")) 2024-05-30T16:54:58.349 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-05-30T16:54:58.476 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.0.39997.asok 2024-05-30T16:54:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:54:58.487 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39997.asok 2024-05-30T16:54:58.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:54:58.488 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39997.asok status 2024-05-30T16:54:58.659 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:54:58.659 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2024-05-30T16:54:58.659 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "9ed025fbf4406fb54980a0647506b15895b6d863", 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-3154-g9ed025fb (9ed025fbf4406fb54980a0647506b15895b6d863) squid (dev)", 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "0", 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "39997", 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6045, 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2024-05-30T16:54:58.660 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 6045 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 4241624892 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 4241624892 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.6045 192.168.0.1:0/4241624892", 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/4241624892", 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2024-05-30T16:54:58.661 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 34, 2024-05-30T16:54:58.662 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 62, 2024-05-30T16:54:58.662 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2024-05-30T16:54:58.662 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2024-05-30T16:54:58.662 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2024-05-30T16:54:58.662 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:54:58.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:54:58.675 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2024-05-30T16:54:58.675 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-30T16:54:58.684 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2024-05-30T16:54:58.684 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-30T16:54:58.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:54:58.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:54:58.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T16:54:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.935+0000 7ffa90600640 1 Processor -- start 2024-05-30T16:54:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.935+0000 7ffa90600640 1 -- start start 2024-05-30T16:54:58.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa90600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa880cfbb0 0x7ffa8815ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa90600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa880b3730 0x7ffa88071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa90600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa880721f0 0x7ffa88162460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa90600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ffa880b3cf0 con 0x7ffa880721f0 2024-05-30T16:54:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa90600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ffa880b3fd0 con 0x7ffa880b3730 2024-05-30T16:54:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa90600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffa880b42b0 con 0x7ffa880cfbb0 2024-05-30T16:54:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa8e600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa880721f0 0x7ffa88162460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa8e600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa880721f0 0x7ffa88162460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42780/0 (socket says 172.21.15.59:42780) 2024-05-30T16:54:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa8e600640 1 -- 172.21.15.59:0/3978176964 learned_addr learned my addr 172.21.15.59:0/3978176964 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa8d200640 1 --2- 172.21.15.59:0/3978176964 >> v2:172.21.15.107:3300/0 conn(0x7ffa880b3730 0x7ffa88071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa8dc00640 1 --2- 172.21.15.59:0/3978176964 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa880cfbb0 0x7ffa8815ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa8e600640 1 -- 172.21.15.59:0/3978176964 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa880cfbb0 msgr2=0x7ffa8815ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa8e600640 1 --2- 172.21.15.59:0/3978176964 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa880cfbb0 0x7ffa8815ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa8e600640 1 -- 172.21.15.59:0/3978176964 >> v2:172.21.15.107:3300/0 conn(0x7ffa880b3730 msgr2=0x7ffa88071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:54:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa8e600640 1 --2- 172.21.15.59:0/3978176964 >> v2:172.21.15.107:3300/0 conn(0x7ffa880b3730 0x7ffa88071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa8e600640 1 -- 172.21.15.59:0/3978176964 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa880b4590 con 0x7ffa880721f0 2024-05-30T16:54:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.939+0000 7ffa8dc00640 1 --2- 172.21.15.59:0/3978176964 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa880cfbb0 0x7ffa8815ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:54:58.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa8e600640 1 --2- 172.21.15.59:0/3978176964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa880721f0 0x7ffa88162460 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ffa880701c0 tx=0x7ffa8001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9f8d8bd58f4729 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:58.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa87e00640 1 -- 172.21.15.59:0/3978176964 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa800ac070 con 0x7ffa880721f0 2024-05-30T16:54:58.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa87e00640 1 -- 172.21.15.59:0/3978176964 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa800a8420 con 0x7ffa880721f0 2024-05-30T16:54:58.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa87e00640 1 -- 172.21.15.59:0/3978176964 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa800a87f0 con 0x7ffa880721f0 2024-05-30T16:54:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa90600640 1 -- 172.21.15.59:0/3978176964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa880721f0 msgr2=0x7ffa88162460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa90600640 1 --2- 172.21.15.59:0/3978176964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa880721f0 0x7ffa88162460 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ffa880701c0 tx=0x7ffa8001c730 comp rx=0 tx=0).stop 2024-05-30T16:54:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa90600640 1 -- 172.21.15.59:0/3978176964 shutdown_connections 2024-05-30T16:54:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa90600640 1 --2- 172.21.15.59:0/3978176964 >> v2:172.21.15.107:3300/0 conn(0x7ffa880b3730 0x7ffa88071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa90600640 1 --2- 172.21.15.59:0/3978176964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa880721f0 0x7ffa88162460 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa90600640 1 --2- 172.21.15.59:0/3978176964 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa880cfbb0 0x7ffa8815ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa90600640 1 -- 172.21.15.59:0/3978176964 >> 172.21.15.59:0/3978176964 conn(0x7ffa880b1e60 msgr2=0x7ffa880b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa90600640 1 -- 172.21.15.59:0/3978176964 shutdown_connections 2024-05-30T16:54:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa90600640 1 -- 172.21.15.59:0/3978176964 wait complete. 2024-05-30T16:54:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa90600640 1 Processor -- start 2024-05-30T16:54:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.943+0000 7ffa90600640 1 -- start start 2024-05-30T16:54:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa90600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa880721f0 0x7ffa8814faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa90600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa880b3730 0x7ffa8815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa90600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa880cfbb0 0x7ffa8809a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa90600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8806e4f0 con 0x7ffa880721f0 2024-05-30T16:54:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa90600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8806e370 con 0x7ffa880b3730 2024-05-30T16:54:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa90600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffa8806e670 con 0x7ffa880cfbb0 2024-05-30T16:54:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa880721f0 0x7ffa8814faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa880721f0 0x7ffa8814faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42786/0 (socket says 172.21.15.59:42786) 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8dc00640 1 -- 172.21.15.59:0/688097912 learned_addr learned my addr 172.21.15.59:0/688097912 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8d200640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa880b3730 0x7ffa8815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8e600640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa880cfbb0 0x7ffa8809a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8dc00640 1 -- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa880cfbb0 msgr2=0x7ffa8809a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8dc00640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa880cfbb0 0x7ffa8809a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8dc00640 1 -- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa880b3730 msgr2=0x7ffa8815a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8dc00640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa880b3730 0x7ffa8815a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8dc00640 1 -- 172.21.15.59:0/688097912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8815a680 con 0x7ffa880721f0 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8d200640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa880b3730 0x7ffa8815a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8e600640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa880cfbb0 0x7ffa8809a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa8dc00640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa880721f0 0x7ffa8814faf0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00e840 tx=0x7ffa7c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa85600640 1 -- 172.21.15.59:0/688097912 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c017070 con 0x7ffa880721f0 2024-05-30T16:54:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa85600640 1 -- 172.21.15.59:0/688097912 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7c00c8d0 con 0x7ffa880721f0 2024-05-30T16:54:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa85600640 1 -- 172.21.15.59:0/688097912 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00f040 con 0x7ffa880721f0 2024-05-30T16:54:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa90600640 1 -- 172.21.15.59:0/688097912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa88150d80 con 0x7ffa880721f0 2024-05-30T16:54:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa90600640 1 -- 172.21.15.59:0/688097912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa88151340 con 0x7ffa880721f0 2024-05-30T16:54:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa90600640 1 -- 172.21.15.59:0/688097912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa88068a90 con 0x7ffa880721f0 2024-05-30T16:54:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.947+0000 7ffa85600640 1 -- 172.21.15.59:0/688097912 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7ffa7c01a070 con 0x7ffa880721f0 2024-05-30T16:54:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.951+0000 7ffa85600640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa68068b90 0x7ffa6806b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.951+0000 7ffa85600640 1 -- 172.21.15.59:0/688097912 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7ffa7c087930 con 0x7ffa880721f0 2024-05-30T16:54:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.951+0000 7ffa8d200640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa68068b90 0x7ffa6806b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.951+0000 7ffa8d200640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa68068b90 0x7ffa6806b050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ffa88159f60 tx=0x7ffa74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:58.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:58.955+0000 7ffa85600640 1 -- 172.21.15.59:0/688097912 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa7c056e10 con 0x7ffa880721f0 2024-05-30T16:54:59.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.151+0000 7ffa90600640 1 -- 172.21.15.59:0/688097912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7ffa88161ef0 con 0x7ffa880721f0 2024-05-30T16:54:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.707+0000 7ffa85600640 1 -- 172.21.15.59:0/688097912 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v35) ==== 136+0+0 (secure 0 0 0) 0x7ffa7c056710 con 0x7ffa880721f0 2024-05-30T16:54:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.711+0000 7ffa90600640 1 -- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa68068b90 msgr2=0x7ffa6806b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.711+0000 7ffa90600640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa68068b90 0x7ffa6806b050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ffa88159f60 tx=0x7ffa74008040 comp rx=0 tx=0).stop 2024-05-30T16:54:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.711+0000 7ffa90600640 1 -- 172.21.15.59:0/688097912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa880721f0 msgr2=0x7ffa8814faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.711+0000 7ffa90600640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa880721f0 0x7ffa8814faf0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00e840 tx=0x7ffa7c00ed00 comp rx=0 tx=0).stop 2024-05-30T16:54:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.711+0000 7ffa90600640 1 -- 172.21.15.59:0/688097912 shutdown_connections 2024-05-30T16:54:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.711+0000 7ffa90600640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa68068b90 0x7ffa6806b050 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.711+0000 7ffa90600640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa880cfbb0 0x7ffa8809a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.711+0000 7ffa90600640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa880b3730 0x7ffa8815a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.711+0000 7ffa90600640 1 --2- 172.21.15.59:0/688097912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa880721f0 0x7ffa8814faf0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.711+0000 7ffa90600640 1 -- 172.21.15.59:0/688097912 >> 172.21.15.59:0/688097912 conn(0x7ffa880b1e60 msgr2=0x7ffa880afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.711+0000 7ffa90600640 1 -- 172.21.15.59:0/688097912 shutdown_connections 2024-05-30T16:54:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.711+0000 7ffa90600640 1 -- 172.21.15.59:0/688097912 wait complete. 2024-05-30T16:54:59.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:54:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.879+0000 7f169bc00640 1 Processor -- start 2024-05-30T16:54:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.879+0000 7f169bc00640 1 -- start start 2024-05-30T16:54:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.879+0000 7f169bc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1694073410 0x7f16941630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.879+0000 7f169bc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f169415fbe0 con 0x7f16940b4510 2024-05-30T16:54:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.879+0000 7f169bc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f169415fec0 con 0x7f16940b48f0 2024-05-30T16:54:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.879+0000 7f169bc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f16941635f0 con 0x7f1694073410 2024-05-30T16:54:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.883+0000 7f1699200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f16940b4510 0x7f169415f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35986/0 (socket says 172.21.15.59:35986) 2024-05-30T16:54:59.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.883+0000 7f1699200640 1 -- 172.21.15.59:0/3501050334 learned_addr learned my addr 172.21.15.59:0/3501050334 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:54:59.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.883+0000 7f1699c00640 1 --2- 172.21.15.59:0/3501050334 >> v2:172.21.15.59:3300/0 conn(0x7f1694073410 0x7f16941630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:59.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.883+0000 7f1699c00640 1 -- 172.21.15.59:0/3501050334 >> v1:172.21.15.107:6789/0 conn(0x7f16940b48f0 legacy=0x7f1694072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:59.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.883+0000 7f1699c00640 1 -- 172.21.15.59:0/3501050334 >> v1:172.21.15.59:6789/0 conn(0x7f16940b4510 legacy=0x7f169415f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:59.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.883+0000 7f1699c00640 1 -- 172.21.15.59:0/3501050334 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16941628b0 con 0x7f1694073410 2024-05-30T16:54:59.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.883+0000 7f1693400640 1 -- 172.21.15.59:0/3501050334 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3591373173 0 0) 0x7f169415fbe0 con 0x7f16940b4510 2024-05-30T16:54:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.883+0000 7f1699c00640 1 --2- 172.21.15.59:0/3501050334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1694073410 0x7f16941630b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f168c009d90 tx=0x7f168c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a721dfdda55bc727 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.883+0000 7f1693400640 1 -- 172.21.15.59:0/3501050334 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c0b2070 con 0x7f1694073410 2024-05-30T16:54:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.883+0000 7f1693400640 1 -- 172.21.15.59:0/3501050334 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168c0a5940 con 0x7f1694073410 2024-05-30T16:54:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.883+0000 7f1693400640 1 -- 172.21.15.59:0/3501050334 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c0a5d10 con 0x7f1694073410 2024-05-30T16:54:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 -- 172.21.15.59:0/3501050334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1694073410 msgr2=0x7f16941630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 --2- 172.21.15.59:0/3501050334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1694073410 0x7f16941630b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f168c009d90 tx=0x7f168c01c970 comp rx=0 tx=0).stop 2024-05-30T16:54:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 -- 172.21.15.59:0/3501050334 shutdown_connections 2024-05-30T16:54:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 --2- 172.21.15.59:0/3501050334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1694073410 0x7f16941630b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 -- 172.21.15.59:0/3501050334 >> 172.21.15.59:0/3501050334 conn(0x7f16940b3240 msgr2=0x7f16940725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:54:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 -- 172.21.15.59:0/3501050334 shutdown_connections 2024-05-30T16:54:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 -- 172.21.15.59:0/3501050334 wait complete. 2024-05-30T16:54:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 Processor -- start 2024-05-30T16:54:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 -- start start 2024-05-30T16:54:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1694073410 0x7f16940af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16940b4510 0x7f16940af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16940b48f0 0x7f1694157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f169406efe0 con 0x7f16940b48f0 2024-05-30T16:54:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f169406ee60 con 0x7f1694073410 2024-05-30T16:54:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f169bc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f169406f160 con 0x7f16940b4510 2024-05-30T16:54:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f1699c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16940b48f0 0x7f1694157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f1699200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1694073410 0x7f16940af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f1699c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16940b48f0 0x7f1694157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42798/0 (socket says 172.21.15.59:42798) 2024-05-30T16:54:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f1699c00640 1 -- 172.21.15.59:0/3432228884 learned_addr learned my addr 172.21.15.59:0/3432228884 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:54:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f1693e00640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16940b4510 0x7f16940af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f1699c00640 1 -- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16940b4510 msgr2=0x7f16940af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f1699c00640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16940b4510 0x7f16940af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f1699c00640 1 -- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1694073410 msgr2=0x7f16940af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:54:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f1699c00640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1694073410 0x7f16940af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:54:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.887+0000 7f1699c00640 1 -- 172.21.15.59:0/3432228884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1694074a40 con 0x7f16940b48f0 2024-05-30T16:54:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.891+0000 7f1699c00640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16940b48f0 0x7f1694157030 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f168c01a5a0 tx=0x7f168c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.891+0000 7f1690c00640 1 -- 172.21.15.59:0/3432228884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c0bd020 con 0x7f16940b48f0 2024-05-30T16:54:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.891+0000 7f1690c00640 1 -- 172.21.15.59:0/3432228884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168c0b8670 con 0x7f16940b48f0 2024-05-30T16:54:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.891+0000 7f1690c00640 1 -- 172.21.15.59:0/3432228884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c0b2040 con 0x7f16940b48f0 2024-05-30T16:54:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.891+0000 7f169bc00640 1 -- 172.21.15.59:0/3432228884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169415cb20 con 0x7f16940b48f0 2024-05-30T16:54:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.891+0000 7f169bc00640 1 -- 172.21.15.59:0/3432228884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169415d0e0 con 0x7f16940b48f0 2024-05-30T16:54:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.891+0000 7f169bc00640 1 -- 172.21.15.59:0/3432228884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1694068a90 con 0x7f16940b48f0 2024-05-30T16:54:59.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.891+0000 7f1690c00640 1 -- 172.21.15.59:0/3432228884 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f168c0c0020 con 0x7f16940b48f0 2024-05-30T16:54:59.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.891+0000 7f1690c00640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1674068b60 0x7f167406b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:54:59.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.891+0000 7f1690c00640 1 -- 172.21.15.59:0/3432228884 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f168c122690 con 0x7f16940b48f0 2024-05-30T16:54:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.891+0000 7f1699200640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1674068b60 0x7f167406b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:54:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.895+0000 7f1699200640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1674068b60 0x7f167406b020 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1688000f70 tx=0x7f1688007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:54:59.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:54:59.895+0000 7f1690c00640 1 -- 172.21.15.59:0/3432228884 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f168c0c7030 con 0x7f16940b48f0 2024-05-30T16:55:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.083+0000 7f169bc00640 1 -- 172.21.15.59:0/3432228884 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f169406d2c0 con 0x7f1674068b60 2024-05-30T16:55:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f1690c00640 1 -- 172.21.15.59:0/3432228884 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f169406d2c0 con 0x7f1674068b60 2024-05-30T16:55:00.090 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:55:00.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:55:00.090 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T16:55:00.090 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:00.090 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:55:00.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f169bc00640 1 -- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1674068b60 msgr2=0x7f167406b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f169bc00640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1674068b60 0x7f167406b020 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1688000f70 tx=0x7f1688007240 comp rx=0 tx=0).stop 2024-05-30T16:55:00.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f169bc00640 1 -- 172.21.15.59:0/3432228884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16940b48f0 msgr2=0x7f1694157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f169bc00640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16940b48f0 0x7f1694157030 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f168c01a5a0 tx=0x7f168c019710 comp rx=0 tx=0).stop 2024-05-30T16:55:00.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f169bc00640 1 -- 172.21.15.59:0/3432228884 shutdown_connections 2024-05-30T16:55:00.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f169bc00640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1674068b60 0x7f167406b020 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f169bc00640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16940b48f0 0x7f1694157030 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f169bc00640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16940b4510 0x7f16940af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f169bc00640 1 --2- 172.21.15.59:0/3432228884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1694073410 0x7f16940af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f169bc00640 1 -- 172.21.15.59:0/3432228884 >> 172.21.15.59:0/3432228884 conn(0x7f16940b3240 msgr2=0x7f16940725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:00.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f169bc00640 1 -- 172.21.15.59:0/3432228884 shutdown_connections 2024-05-30T16:55:00.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.087+0000 7f169bc00640 1 -- 172.21.15.59:0/3432228884 wait complete. 2024-05-30T16:55:00.123 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:55:00.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.263+0000 7fe6eee00640 1 Processor -- start 2024-05-30T16:55:00.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.263+0000 7fe6eee00640 1 -- start start 2024-05-30T16:55:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.263+0000 7fe6eee00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe6e809b150 0x7fe6e81699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.263+0000 7fe6eee00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e8070950 con 0x7fe6e80d14c0 2024-05-30T16:55:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.263+0000 7fe6eee00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e8070c30 con 0x7fe6e80d05b0 2024-05-30T16:55:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.263+0000 7fe6eee00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe6e8070f10 con 0x7fe6e809b150 2024-05-30T16:55:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.263+0000 7fe6e7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe6e80d14c0 0x7fe6e806e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36000/0 (socket says 172.21.15.59:36000) 2024-05-30T16:55:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.263+0000 7fe6ece00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe6e809b150 0x7fe6e81699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.263+0000 7fe6e7e00640 1 -- 172.21.15.59:0/534355437 learned_addr learned my addr 172.21.15.59:0/534355437 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:55:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6ece00640 1 -- 172.21.15.59:0/534355437 >> v1:172.21.15.107:6789/0 conn(0x7fe6e80d05b0 legacy=0x7fe6e809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6ece00640 1 -- 172.21.15.59:0/534355437 >> v1:172.21.15.59:6789/0 conn(0x7fe6e80d14c0 legacy=0x7fe6e806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6e7400640 1 -- 172.21.15.59:0/534355437 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808383266 0 0) 0x7fe6e8070950 con 0x7fe6e80d14c0 2024-05-30T16:55:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6ece00640 1 -- 172.21.15.59:0/534355437 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e806cbd0 con 0x7fe6e809b150 2024-05-30T16:55:00.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6ece00640 1 --2- 172.21.15.59:0/534355437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e809b150 0x7fe6e81699b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009d90 tx=0x7fe6e001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8a0159d4983f93 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:00.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6e7400640 1 -- 172.21.15.59:0/534355437 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e00b2070 con 0x7fe6e809b150 2024-05-30T16:55:00.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6e7400640 1 -- 172.21.15.59:0/534355437 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e00a59f0 con 0x7fe6e809b150 2024-05-30T16:55:00.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6e7400640 1 -- 172.21.15.59:0/534355437 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e00a5dc0 con 0x7fe6e809b150 2024-05-30T16:55:00.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6eee00640 1 -- 172.21.15.59:0/534355437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e809b150 msgr2=0x7fe6e81699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6eee00640 1 --2- 172.21.15.59:0/534355437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e809b150 0x7fe6e81699b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009d90 tx=0x7fe6e001c910 comp rx=0 tx=0).stop 2024-05-30T16:55:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6eee00640 1 -- 172.21.15.59:0/534355437 shutdown_connections 2024-05-30T16:55:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6eee00640 1 --2- 172.21.15.59:0/534355437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e809b150 0x7fe6e81699b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.267+0000 7fe6eee00640 1 -- 172.21.15.59:0/534355437 >> 172.21.15.59:0/534355437 conn(0x7fe6e80b3f80 msgr2=0x7fe6e80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6eee00640 1 -- 172.21.15.59:0/534355437 shutdown_connections 2024-05-30T16:55:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6eee00640 1 -- 172.21.15.59:0/534355437 wait complete. 2024-05-30T16:55:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6eee00640 1 Processor -- start 2024-05-30T16:55:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6eee00640 1 -- start start 2024-05-30T16:55:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6eee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6e809b150 0x7fe6e815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6eee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6e80d05b0 0x7fe6e8157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6eee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e80d14c0 0x7fe6e80cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6eee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e806e280 con 0x7fe6e80d14c0 2024-05-30T16:55:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6eee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e806e100 con 0x7fe6e809b150 2024-05-30T16:55:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6eee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e816c710 con 0x7fe6e80d05b0 2024-05-30T16:55:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6ece00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e80d14c0 0x7fe6e80cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6ece00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e80d14c0 0x7fe6e80cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42810/0 (socket says 172.21.15.59:42810) 2024-05-30T16:55:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6ece00640 1 -- 172.21.15.59:0/3355611282 learned_addr learned my addr 172.21.15.59:0/3355611282 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6e7e00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6e809b150 0x7fe6e815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6df400640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6e80d05b0 0x7fe6e8157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6ece00640 1 -- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6e80d05b0 msgr2=0x7fe6e8157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6ece00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6e80d05b0 0x7fe6e8157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6ece00640 1 -- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6e809b150 msgr2=0x7fe6e815c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6ece00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6e809b150 0x7fe6e815c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6ece00640 1 -- 172.21.15.59:0/3355611282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e815ce20 con 0x7fe6e80d14c0 2024-05-30T16:55:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6df400640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6e80d05b0 0x7fe6e8157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:55:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6ece00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e80d14c0 0x7fe6e80cb360 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe6e001a5a0 tx=0x7fe6e0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6e4c00640 1 -- 172.21.15.59:0/3355611282 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e00b2040 con 0x7fe6e80d14c0 2024-05-30T16:55:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6e4c00640 1 -- 172.21.15.59:0/3355611282 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e00bf070 con 0x7fe6e80d14c0 2024-05-30T16:55:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6e4c00640 1 -- 172.21.15.59:0/3355611282 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e00adad0 con 0x7fe6e80d14c0 2024-05-30T16:55:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.271+0000 7fe6eee00640 1 -- 172.21.15.59:0/3355611282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e80b5880 con 0x7fe6e80d14c0 2024-05-30T16:55:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.275+0000 7fe6eee00640 1 -- 172.21.15.59:0/3355611282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e80c8d50 con 0x7fe6e80d14c0 2024-05-30T16:55:00.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.275+0000 7fe6eee00640 1 -- 172.21.15.59:0/3355611282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e8068a90 con 0x7fe6e80d14c0 2024-05-30T16:55:00.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.275+0000 7fe6e4c00640 1 -- 172.21.15.59:0/3355611282 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fe6e00adc70 con 0x7fe6e80d14c0 2024-05-30T16:55:00.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.275+0000 7fe6e4c00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe6c4068b60 0x7fe6c406b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.275+0000 7fe6e4c00640 1 -- 172.21.15.59:0/3355611282 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fe6e0122b20 con 0x7fe6e80d14c0 2024-05-30T16:55:00.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.275+0000 7fe6e7e00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe6c4068b60 0x7fe6c406b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.275+0000 7fe6e7e00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe6c4068b60 0x7fe6c406b020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8007bc0 tx=0x7fe6d8007b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.279+0000 7fe6e4c00640 1 -- 172.21.15.59:0/3355611282 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe6e0016560 con 0x7fe6e80d14c0 2024-05-30T16:55:00.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 -- 172.21.15.59:0/3355611282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe6e80cfc50 con 0x7fe6e80d14c0 2024-05-30T16:55:00.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6e4c00640 1 -- 172.21.15.59:0/3355611282 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fe6e00f2520 con 0x7fe6e80d14c0 2024-05-30T16:55:00.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 -- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe6c4068b60 msgr2=0x7fe6c406b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe6c4068b60 0x7fe6c406b020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8007bc0 tx=0x7fe6d8007b10 comp rx=0 tx=0).stop 2024-05-30T16:55:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 -- 172.21.15.59:0/3355611282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e80d14c0 msgr2=0x7fe6e80cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e80d14c0 0x7fe6e80cb360 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe6e001a5a0 tx=0x7fe6e0019710 comp rx=0 tx=0).stop 2024-05-30T16:55:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 -- 172.21.15.59:0/3355611282 shutdown_connections 2024-05-30T16:55:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe6c4068b60 0x7fe6c406b020 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e80d14c0 0x7fe6e80cb360 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6e80d05b0 0x7fe6e8157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 --2- 172.21.15.59:0/3355611282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6e809b150 0x7fe6e815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 -- 172.21.15.59:0/3355611282 >> 172.21.15.59:0/3355611282 conn(0x7fe6e80b3f80 msgr2=0x7fe6e80ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 -- 172.21.15.59:0/3355611282 shutdown_connections 2024-05-30T16:55:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.447+0000 7fe6eee00640 1 -- 172.21.15.59:0/3355611282 wait complete. 2024-05-30T16:55:00.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait false 2024-05-30T16:55:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.611+0000 7f134fa00640 1 Processor -- start 2024-05-30T16:55:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.611+0000 7f134fa00640 1 -- start start 2024-05-30T16:55:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134fa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1348159100 0x7f134806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134fa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13480b44e0 0x7f134815efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134fa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f134815f510 0x7f134815c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134fa00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f13480b52d0 con 0x7f134815f510 2024-05-30T16:55:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134fa00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f13480b4a30 con 0x7f1348159100 2024-05-30T16:55:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134fa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f13480b4d10 con 0x7f13480b44e0 2024-05-30T16:55:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134da00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f134815f510 0x7f134815c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134da00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f134815f510 0x7f134815c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42822/0 (socket says 172.21.15.59:42822) 2024-05-30T16:55:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134da00640 1 -- 172.21.15.59:0/4175395195 learned_addr learned my addr 172.21.15.59:0/4175395195 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134d000640 1 --2- 172.21.15.59:0/4175395195 >> v2:172.21.15.107:3300/0 conn(0x7f1348159100 0x7f134806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f133fe00640 1 --2- 172.21.15.59:0/4175395195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13480b44e0 0x7f134815efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134d000640 1 -- 172.21.15.59:0/4175395195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13480b44e0 msgr2=0x7f134815efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134d000640 1 --2- 172.21.15.59:0/4175395195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13480b44e0 0x7f134815efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134d000640 1 -- 172.21.15.59:0/4175395195 >> v2:172.21.15.59:3300/0 conn(0x7f134815f510 msgr2=0x7f134815c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134d000640 1 --2- 172.21.15.59:0/4175395195 >> v2:172.21.15.59:3300/0 conn(0x7f134815f510 0x7f134815c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134d000640 1 -- 172.21.15.59:0/4175395195 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13480b4ff0 con 0x7f1348159100 2024-05-30T16:55:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.615+0000 7f134da00640 1 --2- 172.21.15.59:0/4175395195 >> v2:172.21.15.59:3300/0 conn(0x7f134815f510 0x7f134815c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:55:00.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f134d000640 1 --2- 172.21.15.59:0/4175395195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1348159100 0x7f134806e590 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f134806c8f0 tx=0x7f133801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b717c0b614a9bc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:00.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f1347e00640 1 -- 172.21.15.59:0/4175395195 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13380b0070 con 0x7f1348159100 2024-05-30T16:55:00.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f1347e00640 1 -- 172.21.15.59:0/4175395195 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13380ab600 con 0x7f1348159100 2024-05-30T16:55:00.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f1347e00640 1 -- 172.21.15.59:0/4175395195 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13380ab9d0 con 0x7f1348159100 2024-05-30T16:55:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f134fa00640 1 -- 172.21.15.59:0/4175395195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1348159100 msgr2=0x7f134806e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f134fa00640 1 --2- 172.21.15.59:0/4175395195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1348159100 0x7f134806e590 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f134806c8f0 tx=0x7f133801c330 comp rx=0 tx=0).stop 2024-05-30T16:55:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f134fa00640 1 -- 172.21.15.59:0/4175395195 shutdown_connections 2024-05-30T16:55:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f134fa00640 1 --2- 172.21.15.59:0/4175395195 >> v2:172.21.15.59:3300/0 conn(0x7f134815f510 0x7f134815c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f134fa00640 1 --2- 172.21.15.59:0/4175395195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13480b44e0 0x7f134815efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f134fa00640 1 --2- 172.21.15.59:0/4175395195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1348159100 0x7f134806e590 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f134fa00640 1 -- 172.21.15.59:0/4175395195 >> 172.21.15.59:0/4175395195 conn(0x7f134806bdb0 msgr2=0x7f134806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f134fa00640 1 -- 172.21.15.59:0/4175395195 shutdown_connections 2024-05-30T16:55:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f134fa00640 1 -- 172.21.15.59:0/4175395195 wait complete. 2024-05-30T16:55:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f134fa00640 1 Processor -- start 2024-05-30T16:55:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.619+0000 7f134fa00640 1 -- start start 2024-05-30T16:55:00.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134fa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13480b44e0 0x7f13481579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134fa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1348159100 0x7f1348150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134fa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134815f510 0x7f13480b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134fa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1348072080 con 0x7f134815f510 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134fa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1348071f00 con 0x7f1348159100 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134fa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1348072200 con 0x7f13480b44e0 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134815f510 0x7f13480b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134815f510 0x7f13480b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42838/0 (socket says 172.21.15.59:42838) 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134da00640 1 -- 172.21.15.59:0/687906305 learned_addr learned my addr 172.21.15.59:0/687906305 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134d000640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13480b44e0 0x7f13481579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f133fe00640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1348159100 0x7f1348150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134da00640 1 -- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13480b44e0 msgr2=0x7f13481579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134da00640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13480b44e0 0x7f13481579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134da00640 1 -- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1348159100 msgr2=0x7f1348150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134da00640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1348159100 0x7f1348150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134da00640 1 -- 172.21.15.59:0/687906305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13480affe0 con 0x7f134815f510 2024-05-30T16:55:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134d000640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13480b44e0 0x7f13481579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:55:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134da00640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134815f510 0x7f13480b07a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f134000efc0 tx=0x7f134000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f1345600640 1 -- 172.21.15.59:0/687906305 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134000cbe0 con 0x7f134815f510 2024-05-30T16:55:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f1345600640 1 -- 172.21.15.59:0/687906305 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f134000cd80 con 0x7f134815f510 2024-05-30T16:55:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134fa00640 1 -- 172.21.15.59:0/687906305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13481558e0 con 0x7f134815f510 2024-05-30T16:55:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f1345600640 1 -- 172.21.15.59:0/687906305 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340003bc0 con 0x7f134815f510 2024-05-30T16:55:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134fa00640 1 -- 172.21.15.59:0/687906305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1348157ef0 con 0x7f134815f510 2024-05-30T16:55:00.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f134fa00640 1 -- 172.21.15.59:0/687906305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1348068a90 con 0x7f134815f510 2024-05-30T16:55:00.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.623+0000 7f1345600640 1 -- 172.21.15.59:0/687906305 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7f134001b030 con 0x7f134815f510 2024-05-30T16:55:00.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.627+0000 7f1345600640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1324068b60 0x7f132406b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.627+0000 7f1345600640 1 -- 172.21.15.59:0/687906305 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f1340087bc0 con 0x7f134815f510 2024-05-30T16:55:00.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.627+0000 7f134d000640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1324068b60 0x7f132406b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.627+0000 7f134d000640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1324068b60 0x7f132406b020 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f13380ad000 tx=0x7f1338008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:00.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.631+0000 7f1345600640 1 -- 172.21.15.59:0/687906305 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1340022020 con 0x7f134815f510 2024-05-30T16:55:00.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.791+0000 7f134fa00640 1 -- 172.21.15.59:0/687906305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}] v 0) -- 0x7f13480ad630 con 0x7f134815f510 2024-05-30T16:55:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.795+0000 7f1345600640 1 -- 172.21.15.59:0/687906305 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}]=0 v15)=0 v15) ==== 136+0+0 (secure 0 0 0) 0x7f1340010040 con 0x7f134815f510 2024-05-30T16:55:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.799+0000 7f134fa00640 1 -- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1324068b60 msgr2=0x7f132406b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.799+0000 7f134fa00640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1324068b60 0x7f132406b020 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f13380ad000 tx=0x7f1338008040 comp rx=0 tx=0).stop 2024-05-30T16:55:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.799+0000 7f134fa00640 1 -- 172.21.15.59:0/687906305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134815f510 msgr2=0x7f13480b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.799+0000 7f134fa00640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134815f510 0x7f13480b07a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f134000efc0 tx=0x7f134000c490 comp rx=0 tx=0).stop 2024-05-30T16:55:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.799+0000 7f134fa00640 1 -- 172.21.15.59:0/687906305 shutdown_connections 2024-05-30T16:55:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.799+0000 7f134fa00640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1324068b60 0x7f132406b020 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.799+0000 7f134fa00640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134815f510 0x7f13480b07a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.799+0000 7f134fa00640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1348159100 0x7f1348150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.799+0000 7f134fa00640 1 --2- 172.21.15.59:0/687906305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13480b44e0 0x7f13481579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.799+0000 7f134fa00640 1 -- 172.21.15.59:0/687906305 >> 172.21.15.59:0/687906305 conn(0x7f134806bdb0 msgr2=0x7f1348153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.799+0000 7f134fa00640 1 -- 172.21.15.59:0/687906305 shutdown_connections 2024-05-30T16:55:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.799+0000 7f134fa00640 1 -- 172.21.15.59:0/687906305 wait complete. 2024-05-30T16:55:00.816 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:00.817+0000 7efd6f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:00.816 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:00.817+0000 7efd6f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:00.816 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:00.817+0000 7efd6f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:00.816 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:00.817+0000 7efd6f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:00.816 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:00.817+0000 7efd6f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:00.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T16:55:00.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.963+0000 7fbfbb600640 1 Processor -- start 2024-05-30T16:55:00.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.963+0000 7fbfbb600640 1 -- start start 2024-05-30T16:55:00.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfbb600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfb415cc70 0x7fbfb415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfbb600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbfb40cdaf0 0x7fbfb40cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfbb600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb415d590 con 0x7fbfb4160170 2024-05-30T16:55:00.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfbb600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb409ba50 con 0x7fbfb415cc70 2024-05-30T16:55:00.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfbb600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb40d0280 con 0x7fbfb40cdaf0 2024-05-30T16:55:00.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfb8c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfb415cc70 0x7fbfb415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfb9600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbfb4160170 0x7fbfb4160600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36014/0 (socket says 172.21.15.59:36014) 2024-05-30T16:55:00.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfb9600640 1 -- 172.21.15.59:0/1874968108 learned_addr learned my addr 172.21.15.59:0/1874968108 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:55:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfabe00640 1 --2- 172.21.15.59:0/1874968108 >> v2:172.21.15.107:3300/0 conn(0x7fbfb40cdaf0 0x7fbfb40cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfb8c00640 1 -- 172.21.15.59:0/1874968108 >> v2:172.21.15.107:3300/0 conn(0x7fbfb40cdaf0 msgr2=0x7fbfb40cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfb8c00640 1 --2- 172.21.15.59:0/1874968108 >> v2:172.21.15.107:3300/0 conn(0x7fbfb40cdaf0 0x7fbfb40cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfb8c00640 1 -- 172.21.15.59:0/1874968108 >> v1:172.21.15.59:6789/0 conn(0x7fbfb4160170 legacy=0x7fbfb4160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfb3e00640 1 -- 172.21.15.59:0/1874968108 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2565386079 0 0) 0x7fbfb415d590 con 0x7fbfb4160170 2024-05-30T16:55:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfb8c00640 1 -- 172.21.15.59:0/1874968108 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb40d0560 con 0x7fbfb415cc70 2024-05-30T16:55:00.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.967+0000 7fbfb8c00640 1 --2- 172.21.15.59:0/1874968108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfb415cc70 0x7fbfb415d050 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4072f00 tx=0x7fbfa401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc66ab47ff562941 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:00.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfb3e00640 1 -- 172.21.15.59:0/1874968108 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40ab5f0 con 0x7fbfb415cc70 2024-05-30T16:55:00.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfb3e00640 1 -- 172.21.15.59:0/1874968108 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa40b0070 con 0x7fbfb415cc70 2024-05-30T16:55:00.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfb3e00640 1 -- 172.21.15.59:0/1874968108 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40ab9b0 con 0x7fbfb415cc70 2024-05-30T16:55:00.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 -- 172.21.15.59:0/1874968108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfb415cc70 msgr2=0x7fbfb415d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 --2- 172.21.15.59:0/1874968108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfb415cc70 0x7fbfb415d050 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4072f00 tx=0x7fbfa401c3f0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 -- 172.21.15.59:0/1874968108 shutdown_connections 2024-05-30T16:55:00.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 --2- 172.21.15.59:0/1874968108 >> v2:172.21.15.107:3300/0 conn(0x7fbfb40cdaf0 0x7fbfb40cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 --2- 172.21.15.59:0/1874968108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfb415cc70 0x7fbfb415d050 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 -- 172.21.15.59:0/1874968108 >> 172.21.15.59:0/1874968108 conn(0x7fbfb40b4000 msgr2=0x7fbfb40b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:00.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 -- 172.21.15.59:0/1874968108 shutdown_connections 2024-05-30T16:55:00.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 -- 172.21.15.59:0/1874968108 wait complete. 2024-05-30T16:55:00.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 Processor -- start 2024-05-30T16:55:00.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 -- start start 2024-05-30T16:55:00.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfb40cdaf0 0x7fbfb4157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfb415cc70 0x7fbfb415a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfb4160170 0x7fbfb415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb40d14a0 con 0x7fbfb40cdaf0 2024-05-30T16:55:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb40d1320 con 0x7fbfb4160170 2024-05-30T16:55:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfbb600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb415c8a0 con 0x7fbfb415cc70 2024-05-30T16:55:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfb8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfb40cdaf0 0x7fbfb4157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfb8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfb40cdaf0 0x7fbfb4157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42856/0 (socket says 172.21.15.59:42856) 2024-05-30T16:55:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfb8c00640 1 -- 172.21.15.59:0/180250958 learned_addr learned my addr 172.21.15.59:0/180250958 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfabe00640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfb415cc70 0x7fbfb415a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.971+0000 7fbfb9600640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfb4160170 0x7fbfb415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb8c00640 1 -- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfb415cc70 msgr2=0x7fbfb415a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb8c00640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfb415cc70 0x7fbfb415a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb8c00640 1 -- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfb4160170 msgr2=0x7fbfb415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb8c00640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfb4160170 0x7fbfb415ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb8c00640 1 -- 172.21.15.59:0/180250958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb41543a0 con 0x7fbfb40cdaf0 2024-05-30T16:55:00.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb9600640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfb4160170 0x7fbfb415ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:55:00.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb8c00640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfb40cdaf0 0x7fbfb4157780 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4019000 tx=0x7fbfa401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:00.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb1600640 1 -- 172.21.15.59:0/180250958 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40bf410 con 0x7fbfb40cdaf0 2024-05-30T16:55:00.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb1600640 1 -- 172.21.15.59:0/180250958 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa40bf5d0 con 0x7fbfb40cdaf0 2024-05-30T16:55:00.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb1600640 1 -- 172.21.15.59:0/180250958 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40bf9c0 con 0x7fbfb40cdaf0 2024-05-30T16:55:00.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfbb600640 1 -- 172.21.15.59:0/180250958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb4154680 con 0x7fbfb40cdaf0 2024-05-30T16:55:00.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfbb600640 1 -- 172.21.15.59:0/180250958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb4154c40 con 0x7fbfb40cdaf0 2024-05-30T16:55:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfbb600640 1 -- 172.21.15.59:0/180250958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb4068a90 con 0x7fbfb40cdaf0 2024-05-30T16:55:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb1600640 1 -- 172.21.15.59:0/180250958 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fbfa40bd020 con 0x7fbfb40cdaf0 2024-05-30T16:55:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb1600640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbf90068b60 0x7fbf9006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfb1600640 1 -- 172.21.15.59:0/180250958 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fbfa4121a50 con 0x7fbfb40cdaf0 2024-05-30T16:55:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.975+0000 7fbfabe00640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbf90068b60 0x7fbf9006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.979+0000 7fbfabe00640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbf90068b60 0x7fbf9006b020 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40718f0 tx=0x7fbf9c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:00.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:00.979+0000 7fbfb1600640 1 -- 172.21.15.59:0/180250958 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbfa4016070 con 0x7fbfb40cdaf0 2024-05-30T16:55:01.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.171+0000 7fbfbb600640 1 -- 172.21.15.59:0/180250958 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7fbfb40b8490 con 0x7fbf90068b60 2024-05-30T16:55:01.181 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:01.181+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:01.181 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:01.181+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:01.181 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:01.181+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:01.181 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:01.181+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:01.181 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:01.181+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:01.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.207+0000 7fbfb1600640 1 -- 172.21.15.59:0/180250958 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbfb40b8490 con 0x7fbf90068b60 2024-05-30T16:55:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.211+0000 7fbfbb600640 1 -- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbf90068b60 msgr2=0x7fbf9006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.211+0000 7fbfbb600640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbf90068b60 0x7fbf9006b020 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40718f0 tx=0x7fbf9c009190 comp rx=0 tx=0).stop 2024-05-30T16:55:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.211+0000 7fbfbb600640 1 -- 172.21.15.59:0/180250958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfb40cdaf0 msgr2=0x7fbfb4157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.211+0000 7fbfbb600640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfb40cdaf0 0x7fbfb4157780 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4019000 tx=0x7fbfa401ac30 comp rx=0 tx=0).stop 2024-05-30T16:55:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.211+0000 7fbfbb600640 1 -- 172.21.15.59:0/180250958 shutdown_connections 2024-05-30T16:55:01.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.211+0000 7fbfbb600640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbf90068b60 0x7fbf9006b020 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.211+0000 7fbfbb600640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfb4160170 0x7fbfb415ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.211+0000 7fbfbb600640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfb415cc70 0x7fbfb415a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.211+0000 7fbfbb600640 1 --2- 172.21.15.59:0/180250958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfb40cdaf0 0x7fbfb4157780 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.211+0000 7fbfbb600640 1 -- 172.21.15.59:0/180250958 >> 172.21.15.59:0/180250958 conn(0x7fbfb40b4000 msgr2=0x7fbfb415b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:01.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.211+0000 7fbfbb600640 1 -- 172.21.15.59:0/180250958 shutdown_connections 2024-05-30T16:55:01.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.211+0000 7fbfbb600640 1 -- 172.21.15.59:0/180250958 wait complete. 2024-05-30T16:55:01.234 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:55:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa95b000640 1 Processor -- start 2024-05-30T16:55:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa95b000640 1 -- start start 2024-05-30T16:55:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa95b000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa954159100 0x7fa95406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa95b000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa9540b44e0 0x7fa95415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa95b000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95415f510 0x7fa95415c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa95b000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa9540b52d0 con 0x7fa954159100 2024-05-30T16:55:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa95b000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa9540b4a30 con 0x7fa9540b44e0 2024-05-30T16:55:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa95b000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa9540b4d10 con 0x7fa95415f510 2024-05-30T16:55:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa953e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa954159100 0x7fa95406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa953e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa954159100 0x7fa95406e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42862/0 (socket says 172.21.15.59:42862) 2024-05-30T16:55:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa953e00640 1 -- 172.21.15.59:0/2173933951 learned_addr learned my addr 172.21.15.59:0/2173933951 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa94be00640 1 --2- 172.21.15.59:0/2173933951 >> v2:172.21.15.107:3300/0 conn(0x7fa9540b44e0 0x7fa95415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa959000640 1 --2- 172.21.15.59:0/2173933951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95415f510 0x7fa95415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa953e00640 1 -- 172.21.15.59:0/2173933951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95415f510 msgr2=0x7fa95415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa953e00640 1 --2- 172.21.15.59:0/2173933951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95415f510 0x7fa95415c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa953e00640 1 -- 172.21.15.59:0/2173933951 >> v2:172.21.15.107:3300/0 conn(0x7fa9540b44e0 msgr2=0x7fa95415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa953e00640 1 --2- 172.21.15.59:0/2173933951 >> v2:172.21.15.107:3300/0 conn(0x7fa9540b44e0 0x7fa95415efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.375+0000 7fa953e00640 1 -- 172.21.15.59:0/2173933951 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9540b4ff0 con 0x7fa954159100 2024-05-30T16:55:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa953e00640 1 --2- 172.21.15.59:0/2173933951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954159100 0x7fa95406e590 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa9540b3060 tx=0x7fa94401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ef76cfc3078cdc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa953400640 1 -- 172.21.15.59:0/2173933951 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440b0070 con 0x7fa954159100 2024-05-30T16:55:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa953400640 1 -- 172.21.15.59:0/2173933951 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9440ab600 con 0x7fa954159100 2024-05-30T16:55:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa953400640 1 -- 172.21.15.59:0/2173933951 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440ab9d0 con 0x7fa954159100 2024-05-30T16:55:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa95b000640 1 -- 172.21.15.59:0/2173933951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954159100 msgr2=0x7fa95406e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa95b000640 1 --2- 172.21.15.59:0/2173933951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954159100 0x7fa95406e590 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa9540b3060 tx=0x7fa94401c460 comp rx=0 tx=0).stop 2024-05-30T16:55:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa95b000640 1 -- 172.21.15.59:0/2173933951 shutdown_connections 2024-05-30T16:55:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa95b000640 1 --2- 172.21.15.59:0/2173933951 >> v2:172.21.15.107:3300/0 conn(0x7fa9540b44e0 0x7fa95415efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa95b000640 1 --2- 172.21.15.59:0/2173933951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95415f510 0x7fa95415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa95b000640 1 --2- 172.21.15.59:0/2173933951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954159100 0x7fa95406e590 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa95b000640 1 -- 172.21.15.59:0/2173933951 >> 172.21.15.59:0/2173933951 conn(0x7fa95406bdb0 msgr2=0x7fa95406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa95b000640 1 -- 172.21.15.59:0/2173933951 shutdown_connections 2024-05-30T16:55:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.379+0000 7fa95b000640 1 -- 172.21.15.59:0/2173933951 wait complete. 2024-05-30T16:55:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa95b000640 1 Processor -- start 2024-05-30T16:55:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa95b000640 1 -- start start 2024-05-30T16:55:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa95b000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9540b44e0 0x7fa954151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa95b000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954159100 0x7fa95414c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa95b000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa95415f510 0x7fa954159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa95b000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa954072080 con 0x7fa954159100 2024-05-30T16:55:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa95b000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa954071f00 con 0x7fa95415f510 2024-05-30T16:55:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa95b000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa954072200 con 0x7fa9540b44e0 2024-05-30T16:55:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa94be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954159100 0x7fa95414c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa953e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9540b44e0 0x7fa954151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa953e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9540b44e0 0x7fa954151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:54078/0 (socket says 172.21.15.59:54078) 2024-05-30T16:55:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa953e00640 1 -- 172.21.15.59:0/304935694 learned_addr learned my addr 172.21.15.59:0/304935694 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa959000640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa95415f510 0x7fa954159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa953e00640 1 -- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa95415f510 msgr2=0x7fa954159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa953e00640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa95415f510 0x7fa954159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa953e00640 1 -- 172.21.15.59:0/304935694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954159100 msgr2=0x7fa95414c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa953e00640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954159100 0x7fa95414c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa953e00640 1 -- 172.21.15.59:0/304935694 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95414f500 con 0x7fa9540b44e0 2024-05-30T16:55:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa953e00640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9540b44e0 0x7fa954151300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa9440ae040 tx=0x7fa944019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa950c00640 1 -- 172.21.15.59:0/304935694 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440bb070 con 0x7fa9540b44e0 2024-05-30T16:55:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa950c00640 1 -- 172.21.15.59:0/304935694 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9440b6430 con 0x7fa9540b44e0 2024-05-30T16:55:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa95b000640 1 -- 172.21.15.59:0/304935694 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95414f7e0 con 0x7fa9540b44e0 2024-05-30T16:55:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa950c00640 1 -- 172.21.15.59:0/304935694 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440b0040 con 0x7fa9540b44e0 2024-05-30T16:55:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.383+0000 7fa95b000640 1 -- 172.21.15.59:0/304935694 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa95414c9c0 con 0x7fa9540b44e0 2024-05-30T16:55:01.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.387+0000 7fa95b000640 1 -- 172.21.15.59:0/304935694 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa954068a90 con 0x7fa9540b44e0 2024-05-30T16:55:01.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.387+0000 7fa950c00640 1 -- 172.21.15.59:0/304935694 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 14) ==== 88701+0+0 (secure 0 0 0) 0x7fa9440be070 con 0x7fa9540b44e0 2024-05-30T16:55:01.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.387+0000 7fa950c00640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930068b60 0x7fa93006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:01.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.387+0000 7fa950c00640 1 -- 172.21.15.59:0/304935694 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fa944121100 con 0x7fa9540b44e0 2024-05-30T16:55:01.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.387+0000 7fa94be00640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930068b60 0x7fa93006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:01.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.387+0000 7fa94be00640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930068b60 0x7fa93006b020 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa9541500d0 tx=0x7fa93c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:01.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.391+0000 7fa950c00640 1 -- 172.21.15.59:0/304935694 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa944016110 con 0x7fa9540b44e0 2024-05-30T16:55:01.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.587+0000 7fa95b000640 1 -- 172.21.15.59:0/304935694 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fa95414fd00 con 0x7fa930068b60 2024-05-30T16:55:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.591+0000 7fa950c00640 1 -- 172.21.15.59:0/304935694 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fa95414fd00 con 0x7fa930068b60 2024-05-30T16:55:01.596 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/4bb05405-ca9f-464d-bc84-b2024eaeb183 2024-05-30T16:55:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.595+0000 7fa95b000640 1 -- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930068b60 msgr2=0x7fa93006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.595+0000 7fa95b000640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930068b60 0x7fa93006b020 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa9541500d0 tx=0x7fa93c008040 comp rx=0 tx=0).stop 2024-05-30T16:55:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.595+0000 7fa95b000640 1 -- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9540b44e0 msgr2=0x7fa954151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.595+0000 7fa95b000640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9540b44e0 0x7fa954151300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa9440ae040 tx=0x7fa944019200 comp rx=0 tx=0).stop 2024-05-30T16:55:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.595+0000 7fa95b000640 1 -- 172.21.15.59:0/304935694 shutdown_connections 2024-05-30T16:55:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.595+0000 7fa95b000640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930068b60 0x7fa93006b020 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.595+0000 7fa95b000640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa95415f510 0x7fa954159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.595+0000 7fa95b000640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954159100 0x7fa95414c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.595+0000 7fa95b000640 1 --2- 172.21.15.59:0/304935694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9540b44e0 0x7fa954151300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.595+0000 7fa95b000640 1 -- 172.21.15.59:0/304935694 >> 172.21.15.59:0/304935694 conn(0x7fa95406bdb0 msgr2=0x7fa95406f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.595+0000 7fa95b000640 1 -- 172.21.15.59:0/304935694 shutdown_connections 2024-05-30T16:55:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:01.595+0000 7fa95b000640 1 -- 172.21.15.59:0/304935694 wait complete. 2024-05-30T16:55:01.618 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/4bb05405-ca9f-464d-bc84-b2024eaeb183 2024-05-30T16:55:01.619 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:55:01.619 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:55:01.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:55:01.628 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/4bb05405-ca9f-464d-bc84-b2024eaeb183/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:55:04.335 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:55:04.339 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:55:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:55:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:55:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.05283 s, 152 MB/s 2024-05-30T16:55:08.747 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:55:08.747 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:55:08.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:55:08.756 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/4bb05405-ca9f-464d-bc84-b2024eaeb183/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:55:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:55:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:55:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.84902 s, 157 MB/s 2024-05-30T16:55:15.661 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:55:15.662 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:55:15.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:55:15.671 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/4bb05405-ca9f-464d-bc84-b2024eaeb183/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:55:22.516 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:55:22.516 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:55:22.516 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.79142 s, 158 MB/s 2024-05-30T16:55:22.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T16:55:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.659+0000 7f5463e00640 1 Processor -- start 2024-05-30T16:55:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.659+0000 7f5463e00640 1 -- start start 2024-05-30T16:55:22.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.663+0000 7f5463e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f545c0af840 0x7f545c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:22.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.663+0000 7f5463e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f545c06e120 con 0x7f545c156e40 2024-05-30T16:55:22.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.663+0000 7f5463e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f545c06e400 con 0x7f545c06dc60 2024-05-30T16:55:22.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.663+0000 7f5463e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f545c06e6e0 con 0x7f545c0af840 2024-05-30T16:55:22.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.663+0000 7f5461e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f545c0af840 0x7f545c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:22.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.663+0000 7f5461e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f545c0af840 0x7f545c06f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51988/0 (socket says 172.21.15.59:51988) 2024-05-30T16:55:22.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.663+0000 7f5461e00640 1 -- 172.21.15.59:0/1208667251 learned_addr learned my addr 172.21.15.59:0/1208667251 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:22.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.663+0000 7f5461400640 1 --1- 172.21.15.59:0/1208667251 >> v1:172.21.15.59:6789/0 conn(0x7f545c156e40 0x7f545c15d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41648/0 (socket says 172.21.15.59:41648) 2024-05-30T16:55:22.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.663+0000 7f5461e00640 1 -- 172.21.15.59:0/1208667251 >> v1:172.21.15.107:6789/0 conn(0x7f545c06dc60 legacy=0x7f545c0af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:22.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.663+0000 7f5461e00640 1 -- 172.21.15.59:0/1208667251 >> v1:172.21.15.59:6789/0 conn(0x7f545c156e40 legacy=0x7f545c15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:22.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.663+0000 7f545be00640 1 -- 172.21.15.59:0/1208667251 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853881558 0 0) 0x7f545c06e120 con 0x7f545c156e40 2024-05-30T16:55:22.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.663+0000 7f5461e00640 1 -- 172.21.15.59:0/1208667251 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c06e9c0 con 0x7f545c0af840 2024-05-30T16:55:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5461e00640 1 --2- 172.21.15.59:0/1208667251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f545c0af840 0x7f545c06f1c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5454009e50 tx=0x7f545401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aef12093f578788 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f545be00640 1 -- 172.21.15.59:0/1208667251 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54540a5810 con 0x7f545c0af840 2024-05-30T16:55:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f545be00640 1 -- 172.21.15.59:0/1208667251 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54540a59b0 con 0x7f545c0af840 2024-05-30T16:55:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f545be00640 1 -- 172.21.15.59:0/1208667251 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54540a5d80 con 0x7f545c0af840 2024-05-30T16:55:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5463e00640 1 -- 172.21.15.59:0/1208667251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f545c0af840 msgr2=0x7f545c06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5463e00640 1 --2- 172.21.15.59:0/1208667251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f545c0af840 0x7f545c06f1c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5454009e50 tx=0x7f545401ca30 comp rx=0 tx=0).stop 2024-05-30T16:55:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5463e00640 1 -- 172.21.15.59:0/1208667251 shutdown_connections 2024-05-30T16:55:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5463e00640 1 --2- 172.21.15.59:0/1208667251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f545c0af840 0x7f545c06f1c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5463e00640 1 -- 172.21.15.59:0/1208667251 >> 172.21.15.59:0/1208667251 conn(0x7f545c0b1e60 msgr2=0x7f545c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5463e00640 1 -- 172.21.15.59:0/1208667251 shutdown_connections 2024-05-30T16:55:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5463e00640 1 -- 172.21.15.59:0/1208667251 wait complete. 2024-05-30T16:55:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5463e00640 1 Processor -- start 2024-05-30T16:55:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5463e00640 1 -- start start 2024-05-30T16:55:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5463e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f545c06dc60 0x7f545c14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5463e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f545c0af840 0x7f545c099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.667+0000 7f5463e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f545c156e40 0x7f545c143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5463e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f545c15eb70 con 0x7f545c06dc60 2024-05-30T16:55:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5463e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f545c15e9f0 con 0x7f545c0af840 2024-05-30T16:55:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5463e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f545c16a560 con 0x7f545c156e40 2024-05-30T16:55:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5461400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f545c06dc60 0x7f545c14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5461400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f545c06dc60 0x7f545c14d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51990/0 (socket says 172.21.15.59:51990) 2024-05-30T16:55:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5461400640 1 -- 172.21.15.59:0/729837011 learned_addr learned my addr 172.21.15.59:0/729837011 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5461400640 1 -- 172.21.15.59:0/729837011 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f545c156e40 msgr2=0x7f545c143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5461400640 1 --2- 172.21.15.59:0/729837011 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f545c156e40 0x7f545c143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5461400640 1 -- 172.21.15.59:0/729837011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f545c0af840 msgr2=0x7f545c099850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5461400640 1 --2- 172.21.15.59:0/729837011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f545c0af840 0x7f545c099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5461400640 1 -- 172.21.15.59:0/729837011 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c151060 con 0x7f545c06dc60 2024-05-30T16:55:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5461400640 1 --2- 172.21.15.59:0/729837011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f545c06dc60 0x7f545c14d940 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f545000c4d0 tx=0x7f545000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5459600640 1 -- 172.21.15.59:0/729837011 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5450018070 con 0x7f545c06dc60 2024-05-30T16:55:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5459600640 1 -- 172.21.15.59:0/729837011 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54500075a0 con 0x7f545c06dc60 2024-05-30T16:55:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5459600640 1 -- 172.21.15.59:0/729837011 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5450004a30 con 0x7f545c06dc60 2024-05-30T16:55:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5463e00640 1 -- 172.21.15.59:0/729837011 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c151340 con 0x7f545c06dc60 2024-05-30T16:55:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5463e00640 1 -- 172.21.15.59:0/729837011 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c151900 con 0x7f545c06dc60 2024-05-30T16:55:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5463e00640 1 -- 172.21.15.59:0/729837011 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c068a90 con 0x7f545c06dc60 2024-05-30T16:55:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.671+0000 7f5459600640 1 -- 172.21.15.59:0/729837011 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 88803+0+0 (secure 0 0 0) 0x7f545001b070 con 0x7f545c06dc60 2024-05-30T16:55:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.675+0000 7f5459600640 1 --2- 172.21.15.59:0/729837011 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f543c068c80 0x7f543c06b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.675+0000 7f5459600640 1 -- 172.21.15.59:0/729837011 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f54500845b0 con 0x7f545c06dc60 2024-05-30T16:55:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.675+0000 7f5460a00640 1 --2- 172.21.15.59:0/729837011 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f543c068c80 0x7f543c06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.675+0000 7f5460a00640 1 --2- 172.21.15.59:0/729837011 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f543c068c80 0x7f543c06b140 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5448000f70 tx=0x7f54480079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:22.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.679+0000 7f5459600640 1 -- 172.21.15.59:0/729837011 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f54500565c0 con 0x7f545c06dc60 2024-05-30T16:55:22.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.871+0000 7f5463e00640 1 -- 172.21.15.59:0/729837011 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f545c073fe0 con 0x7f543c068c80 2024-05-30T16:55:22.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.883+0000 7f5459600640 1 -- 172.21.15.59:0/729837011 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f545c073fe0 con 0x7f543c068c80 2024-05-30T16:55:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.883+0000 7f5463e00640 1 -- 172.21.15.59:0/729837011 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f543c068c80 msgr2=0x7f543c06b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.883+0000 7f5463e00640 1 --2- 172.21.15.59:0/729837011 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f543c068c80 0x7f543c06b140 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5448000f70 tx=0x7f54480079c0 comp rx=0 tx=0).stop 2024-05-30T16:55:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.883+0000 7f5463e00640 1 -- 172.21.15.59:0/729837011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f545c06dc60 msgr2=0x7f545c14d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.883+0000 7f5463e00640 1 --2- 172.21.15.59:0/729837011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f545c06dc60 0x7f545c14d940 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f545000c4d0 tx=0x7f545000c990 comp rx=0 tx=0).stop 2024-05-30T16:55:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.883+0000 7f5463e00640 1 -- 172.21.15.59:0/729837011 shutdown_connections 2024-05-30T16:55:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.883+0000 7f5463e00640 1 --2- 172.21.15.59:0/729837011 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f543c068c80 0x7f543c06b140 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.883+0000 7f5463e00640 1 --2- 172.21.15.59:0/729837011 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f545c156e40 0x7f545c143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.883+0000 7f5463e00640 1 --2- 172.21.15.59:0/729837011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f545c0af840 0x7f545c099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.883+0000 7f5463e00640 1 --2- 172.21.15.59:0/729837011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f545c06dc60 0x7f545c14d940 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.887+0000 7f5463e00640 1 -- 172.21.15.59:0/729837011 >> 172.21.15.59:0/729837011 conn(0x7f545c0b1e60 msgr2=0x7f545c14d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.887+0000 7f5463e00640 1 -- 172.21.15.59:0/729837011 shutdown_connections 2024-05-30T16:55:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:22.887+0000 7f5463e00640 1 -- 172.21.15.59:0/729837011 wait complete. 2024-05-30T16:55:22.907 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:55:23.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.047+0000 7f1092000640 1 Processor -- start 2024-05-30T16:55:23.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.047+0000 7f1092000640 1 -- start start 2024-05-30T16:55:23.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.047+0000 7f1092000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f108c0ad2b0 0x7f108c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:23.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.047+0000 7f1092000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f108c0d0660 0x7f108c0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:23.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.047+0000 7f1092000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f108c0ad770 con 0x7f108c1569e0 2024-05-30T16:55:23.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.047+0000 7f1092000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f108c0d1010 con 0x7f108c0ad2b0 2024-05-30T16:55:23.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.047+0000 7f1092000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f108c15cb40 con 0x7f108c0d0660 2024-05-30T16:55:23.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.051+0000 7f108b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f108c1569e0 0x7f108c0cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41656/0 (socket says 172.21.15.59:41656) 2024-05-30T16:55:23.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.051+0000 7f108b400640 1 -- 172.21.15.59:0/2973316026 learned_addr learned my addr 172.21.15.59:0/2973316026 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:55:23.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.051+0000 7f108be00640 1 --2- 172.21.15.59:0/2973316026 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f108c0d0660 0x7f108c0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:23.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.051+0000 7f1082a00640 1 --2- 172.21.15.59:0/2973316026 >> v2:172.21.15.107:3300/0 conn(0x7f108c0ad2b0 0x7f108c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:23.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.051+0000 7f108aa00640 1 -- 172.21.15.59:0/2973316026 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455773184 0 0) 0x7f108c0ad770 con 0x7f108c1569e0 2024-05-30T16:55:23.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.051+0000 7f108aa00640 1 -- 172.21.15.59:0/2973316026 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1070003530 con 0x7f108c1569e0 2024-05-30T16:55:23.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.051+0000 7f108be00640 1 -- 172.21.15.59:0/2973316026 >> v2:172.21.15.107:3300/0 conn(0x7f108c0ad2b0 msgr2=0x7f108c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:23.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.051+0000 7f108be00640 1 --2- 172.21.15.59:0/2973316026 >> v2:172.21.15.107:3300/0 conn(0x7f108c0ad2b0 0x7f108c15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:23.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.051+0000 7f108be00640 1 -- 172.21.15.59:0/2973316026 >> v1:172.21.15.59:6789/0 conn(0x7f108c1569e0 legacy=0x7f108c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:23.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.051+0000 7f108be00640 1 -- 172.21.15.59:0/2973316026 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c15ce20 con 0x7f108c0d0660 2024-05-30T16:55:23.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.051+0000 7f108be00640 1 --2- 172.21.15.59:0/2973316026 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f108c0d0660 0x7f108c0d0ad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f10840097c0 tx=0x7f108401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=637ef2bdb8ead194 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.051+0000 7f108aa00640 1 -- 172.21.15.59:0/2973316026 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10840b0070 con 0x7f108c0d0660 2024-05-30T16:55:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f108aa00640 1 -- 172.21.15.59:0/2973316026 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10840ab600 con 0x7f108c0d0660 2024-05-30T16:55:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f108aa00640 1 -- 172.21.15.59:0/2973316026 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10840ab9b0 con 0x7f108c0d0660 2024-05-30T16:55:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 -- 172.21.15.59:0/2973316026 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f108c0d0660 msgr2=0x7f108c0d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 --2- 172.21.15.59:0/2973316026 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f108c0d0660 0x7f108c0d0ad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f10840097c0 tx=0x7f108401c410 comp rx=0 tx=0).stop 2024-05-30T16:55:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 -- 172.21.15.59:0/2973316026 shutdown_connections 2024-05-30T16:55:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 --2- 172.21.15.59:0/2973316026 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f108c0d0660 0x7f108c0d0ad0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 --2- 172.21.15.59:0/2973316026 >> v2:172.21.15.107:3300/0 conn(0x7f108c0ad2b0 0x7f108c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 -- 172.21.15.59:0/2973316026 >> 172.21.15.59:0/2973316026 conn(0x7f108c06bdb0 msgr2=0x7f108c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 -- 172.21.15.59:0/2973316026 shutdown_connections 2024-05-30T16:55:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 -- 172.21.15.59:0/2973316026 wait complete. 2024-05-30T16:55:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 Processor -- start 2024-05-30T16:55:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 -- start start 2024-05-30T16:55:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f108c0ad2b0 0x7f108c14ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f108c0d0660 0x7f108c09db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c1569e0 0x7f108c14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f108c0b3c60 con 0x7f108c1569e0 2024-05-30T16:55:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f108c0b3ae0 con 0x7f108c0ad2b0 2024-05-30T16:55:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1092000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f108c0b3de0 con 0x7f108c0d0660 2024-05-30T16:55:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f108be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c1569e0 0x7f108c14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f108be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c1569e0 0x7f108c14c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52004/0 (socket says 172.21.15.59:52004) 2024-05-30T16:55:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f108be00640 1 -- 172.21.15.59:0/552617492 learned_addr learned my addr 172.21.15.59:0/552617492 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f108b400640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f108c0ad2b0 0x7f108c14ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f1082a00640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f108c0d0660 0x7f108c09db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f108be00640 1 -- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f108c0d0660 msgr2=0x7f108c09db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f108be00640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f108c0d0660 0x7f108c09db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f108be00640 1 -- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f108c0ad2b0 msgr2=0x7f108c14ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f108be00640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f108c0ad2b0 0x7f108c14ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.055+0000 7f108be00640 1 -- 172.21.15.59:0/552617492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c0b0f20 con 0x7f108c1569e0 2024-05-30T16:55:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.059+0000 7f108be00640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c1569e0 0x7f108c14c2e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f10840ae040 tx=0x7f10840191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.059+0000 7f1083e00640 1 -- 172.21.15.59:0/552617492 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10840b8020 con 0x7f108c1569e0 2024-05-30T16:55:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.059+0000 7f1083e00640 1 -- 172.21.15.59:0/552617492 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10840b4410 con 0x7f108c1569e0 2024-05-30T16:55:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.059+0000 7f1083e00640 1 -- 172.21.15.59:0/552617492 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10840b0040 con 0x7f108c1569e0 2024-05-30T16:55:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.059+0000 7f1092000640 1 -- 172.21.15.59:0/552617492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f108c0b1200 con 0x7f108c1569e0 2024-05-30T16:55:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.059+0000 7f1092000640 1 -- 172.21.15.59:0/552617492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f108c09a3c0 con 0x7f108c1569e0 2024-05-30T16:55:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.059+0000 7f1092000640 1 -- 172.21.15.59:0/552617492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f108c068a90 con 0x7f108c1569e0 2024-05-30T16:55:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.059+0000 7f1083e00640 1 -- 172.21.15.59:0/552617492 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 88803+0+0 (secure 0 0 0) 0x7f10840bb020 con 0x7f108c1569e0 2024-05-30T16:55:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.063+0000 7f1083e00640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1068068c80 0x7f106806b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.063+0000 7f1083e00640 1 -- 172.21.15.59:0/552617492 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f108411ec10 con 0x7f108c1569e0 2024-05-30T16:55:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.063+0000 7f108b400640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1068068c80 0x7f106806b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.063+0000 7f108b400640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1068068c80 0x7f106806b140 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f107c005c10 tx=0x7f107c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:23.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.067+0000 7f1083e00640 1 -- 172.21.15.59:0/552617492 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f10840c2030 con 0x7f108c1569e0 2024-05-30T16:55:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.259+0000 7f1092000640 1 -- 172.21.15.59:0/552617492 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f108c15e170 con 0x7f1068068c80 2024-05-30T16:55:23.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.263+0000 7f1083e00640 1 -- 172.21.15.59:0/552617492 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f108c15e170 con 0x7f1068068c80 2024-05-30T16:55:23.266 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/4bb05405-ca9f-464d-bc84-b2024eaeb183 2024-05-30T16:55:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.263+0000 7f1092000640 1 -- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1068068c80 msgr2=0x7f106806b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.263+0000 7f1092000640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1068068c80 0x7f106806b140 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f107c005c10 tx=0x7f107c009040 comp rx=0 tx=0).stop 2024-05-30T16:55:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.263+0000 7f1092000640 1 -- 172.21.15.59:0/552617492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c1569e0 msgr2=0x7f108c14c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.263+0000 7f1092000640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c1569e0 0x7f108c14c2e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f10840ae040 tx=0x7f10840191b0 comp rx=0 tx=0).stop 2024-05-30T16:55:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.267+0000 7f1092000640 1 -- 172.21.15.59:0/552617492 shutdown_connections 2024-05-30T16:55:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.267+0000 7f1092000640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1068068c80 0x7f106806b140 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.267+0000 7f1092000640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c1569e0 0x7f108c14c2e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.267+0000 7f1092000640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f108c0d0660 0x7f108c09db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.267+0000 7f1092000640 1 --2- 172.21.15.59:0/552617492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f108c0ad2b0 0x7f108c14ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.267+0000 7f1092000640 1 -- 172.21.15.59:0/552617492 >> 172.21.15.59:0/552617492 conn(0x7f108c06bdb0 msgr2=0x7f108c15d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.267+0000 7f1092000640 1 -- 172.21.15.59:0/552617492 shutdown_connections 2024-05-30T16:55:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:23.267+0000 7f1092000640 1 -- 172.21.15.59:0/552617492 wait complete. 2024-05-30T16:55:23.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:55:23.287 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/4bb05405-ca9f-464d-bc84-b2024eaeb183 2024-05-30T16:55:23.287 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T16:55:23.300 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/4bb05405-ca9f-464d-bc84-b2024eaeb183 2024-05-30T16:55:23.300 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3138256896" 2024-05-30T16:55:23.300 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:55:23.301 INFO:tasks.cephfs.test_volumes:r_size = 3138256896 exp_size = 3221225472 2024-05-30T16:55:25.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:55:25.303 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/4bb05405-ca9f-464d-bc84-b2024eaeb183 2024-05-30T16:55:25.303 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T16:55:25.318 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/4bb05405-ca9f-464d-bc84-b2024eaeb183 2024-05-30T16:55:25.318 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3138256896" 2024-05-30T16:55:25.318 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:55:25.319 INFO:tasks.cephfs.test_volumes:r_size = 3138256896 exp_size = 3221225472 2024-05-30T16:55:27.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:55:27.320 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/4bb05405-ca9f-464d-bc84-b2024eaeb183 2024-05-30T16:55:27.320 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T16:55:27.335 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/4bb05405-ca9f-464d-bc84-b2024eaeb183 2024-05-30T16:55:27.335 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T16:55:27.335 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:55:27.336 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T16:55:27.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone86891 2024-05-30T16:55:27.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.535+0000 7f6455400640 1 Processor -- start 2024-05-30T16:55:27.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.535+0000 7f6455400640 1 -- start start 2024-05-30T16:55:27.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.535+0000 7f6455400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64500ad2b0 0x7f645015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:27.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.535+0000 7f6455400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f64500d0660 0x7f64500d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:27.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.535+0000 7f6455400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64500ad770 con 0x7f64501569e0 2024-05-30T16:55:27.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.535+0000 7f6455400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f645015cb40 con 0x7f64500d0660 2024-05-30T16:55:27.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.535+0000 7f6455400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f645015ce20 con 0x7f64500ad2b0 2024-05-30T16:55:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.539+0000 7f644f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f64500d0660 0x7f64500d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.539+0000 7f6447e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64500ad2b0 0x7f645015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.539+0000 7f644f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f64500d0660 0x7f64500d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:42120/0 (socket says 172.21.15.59:42120) 2024-05-30T16:55:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.539+0000 7f644e800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f64501569e0 0x7f64500cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:33888/0 (socket says 172.21.15.59:33888) 2024-05-30T16:55:27.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.539+0000 7f644f200640 1 -- 172.21.15.59:0/4098577906 learned_addr learned my addr 172.21.15.59:0/4098577906 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:27.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.539+0000 7f644f200640 1 -- 172.21.15.59:0/4098577906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64500ad2b0 msgr2=0x7f645015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:27.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.539+0000 7f644f200640 1 --2- 172.21.15.59:0/4098577906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64500ad2b0 0x7f645015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:27.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.539+0000 7f644f200640 1 -- 172.21.15.59:0/4098577906 >> v1:172.21.15.107:6789/0 conn(0x7f64501569e0 legacy=0x7f64500cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:27.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.539+0000 7f644f200640 1 -- 172.21.15.59:0/4098577906 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645015d100 con 0x7f64500d0660 2024-05-30T16:55:27.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.539+0000 7f6447e00640 1 --2- 172.21.15.59:0/4098577906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64500ad2b0 0x7f645015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:55:27.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.539+0000 7f644f200640 1 --2- 172.21.15.59:0/4098577906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64500d0660 0x7f64500d0af0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6448009e50 tx=0x7f644801c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80e63ace12a6b94f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:27.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f644de00640 1 -- 172.21.15.59:0/4098577906 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64480a5660 con 0x7f64500d0660 2024-05-30T16:55:27.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f644de00640 1 -- 172.21.15.59:0/4098577906 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64480a5800 con 0x7f64500d0660 2024-05-30T16:55:27.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f644de00640 1 -- 172.21.15.59:0/4098577906 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64480a5bd0 con 0x7f64500d0660 2024-05-30T16:55:27.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 -- 172.21.15.59:0/4098577906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64500d0660 msgr2=0x7f64500d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:27.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 --2- 172.21.15.59:0/4098577906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64500d0660 0x7f64500d0af0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6448009e50 tx=0x7f644801c9a0 comp rx=0 tx=0).stop 2024-05-30T16:55:27.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 -- 172.21.15.59:0/4098577906 shutdown_connections 2024-05-30T16:55:27.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 --2- 172.21.15.59:0/4098577906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64500d0660 0x7f64500d0af0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:27.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 --2- 172.21.15.59:0/4098577906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64500ad2b0 0x7f645015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:27.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 -- 172.21.15.59:0/4098577906 >> 172.21.15.59:0/4098577906 conn(0x7f645006bdb0 msgr2=0x7f645006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:27.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 -- 172.21.15.59:0/4098577906 shutdown_connections 2024-05-30T16:55:27.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 -- 172.21.15.59:0/4098577906 wait complete. 2024-05-30T16:55:27.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 Processor -- start 2024-05-30T16:55:27.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 -- start start 2024-05-30T16:55:27.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64500ad2b0 0x7f64500b0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:27.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64500d0660 0x7f64501f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:27.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64501569e0 0x7f6450154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f64500b3e70 con 0x7f64500d0660 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f64500b3cf0 con 0x7f64501569e0 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6455400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f64500b3ff0 con 0x7f64500ad2b0 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6447e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64500d0660 0x7f64501f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6447e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64500d0660 0x7f64501f5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52008/0 (socket says 172.21.15.59:52008) 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f6447e00640 1 -- 172.21.15.59:0/4065006304 learned_addr learned my addr 172.21.15.59:0/4065006304 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f644e800640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64500ad2b0 0x7f64500b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.543+0000 7f644f200640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64501569e0 0x7f6450154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6447e00640 1 -- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64500ad2b0 msgr2=0x7f64500b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6447e00640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64500ad2b0 0x7f64500b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6447e00640 1 -- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64501569e0 msgr2=0x7f6450154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6447e00640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64501569e0 0x7f6450154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6447e00640 1 -- 172.21.15.59:0/4065006304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64501f5ed0 con 0x7f64500d0660 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f644f200640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64501569e0 0x7f6450154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:55:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f644e800640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64500ad2b0 0x7f64500b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:55:27.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6447e00640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64500d0660 0x7f64501f5560 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f643800e9b0 tx=0x7f643800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:27.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6446a00640 1 -- 172.21.15.59:0/4065006304 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438017070 con 0x7f64500d0660 2024-05-30T16:55:27.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6446a00640 1 -- 172.21.15.59:0/4065006304 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643800ca00 con 0x7f64500d0660 2024-05-30T16:55:27.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6446a00640 1 -- 172.21.15.59:0/4065006304 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643800cdd0 con 0x7f64500d0660 2024-05-30T16:55:27.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6455400640 1 -- 172.21.15.59:0/4065006304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64501f61b0 con 0x7f64500d0660 2024-05-30T16:55:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6455400640 1 -- 172.21.15.59:0/4065006304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64500b0c50 con 0x7f64500d0660 2024-05-30T16:55:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6455400640 1 -- 172.21.15.59:0/4065006304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6450068a90 con 0x7f64500d0660 2024-05-30T16:55:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.547+0000 7f6446a00640 1 -- 172.21.15.59:0/4065006304 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 88803+0+0 (secure 0 0 0) 0x7f643801a070 con 0x7f64500d0660 2024-05-30T16:55:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.551+0000 7f6446a00640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f642c068c80 0x7f642c06b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.551+0000 7f6446a00640 1 -- 172.21.15.59:0/4065006304 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f64380856e0 con 0x7f64500d0660 2024-05-30T16:55:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.551+0000 7f644e800640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f642c068c80 0x7f642c06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.551+0000 7f644e800640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f642c068c80 0x7f642c06b140 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6440000f70 tx=0x7f6440007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:27.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.555+0000 7f6446a00640 1 -- 172.21.15.59:0/4065006304 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6438057500 con 0x7f64500d0660 2024-05-30T16:55:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.751+0000 7f6455400640 1 -- 172.21.15.59:0/4065006304 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone86891", "target": ["mon-mgr", ""]}) -- 0x7f645015c790 con 0x7f642c068c80 2024-05-30T16:55:27.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6446a00640 1 -- 172.21.15.59:0/4065006304 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f645015c790 con 0x7f642c068c80 2024-05-30T16:55:27.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6455400640 1 -- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f642c068c80 msgr2=0x7f642c06b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:27.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6455400640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f642c068c80 0x7f642c06b140 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6440000f70 tx=0x7f6440007d70 comp rx=0 tx=0).stop 2024-05-30T16:55:27.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6455400640 1 -- 172.21.15.59:0/4065006304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64500d0660 msgr2=0x7f64501f5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:27.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6455400640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64500d0660 0x7f64501f5560 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f643800e9b0 tx=0x7f643800ee70 comp rx=0 tx=0).stop 2024-05-30T16:55:27.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6455400640 1 -- 172.21.15.59:0/4065006304 shutdown_connections 2024-05-30T16:55:27.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6455400640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f642c068c80 0x7f642c06b140 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:27.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6455400640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64501569e0 0x7f6450154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:27.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6455400640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64500d0660 0x7f64501f5560 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:27.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6455400640 1 --2- 172.21.15.59:0/4065006304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64500ad2b0 0x7f64500b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:27.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6455400640 1 -- 172.21.15.59:0/4065006304 >> 172.21.15.59:0/4065006304 conn(0x7f645006bdb0 msgr2=0x7f6450155990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:27.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6455400640 1 -- 172.21.15.59:0/4065006304 shutdown_connections 2024-05-30T16:55:27.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.815+0000 7f6455400640 1 -- 172.21.15.59:0/4065006304 wait complete. 2024-05-30T16:55:27.821 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:27.821+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:27.821 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:27.821+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:27.822 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:27.821+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:27.822 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:27.821+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:27.822 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:27.821+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:27.837 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:27.837+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:27.838 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:27.837+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:27.838 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:27.837+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:27.838 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:27.837+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:27.838 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:27.837+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:27.840 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone86892 2024-05-30T16:55:27.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb1ce00640 1 Processor -- start 2024-05-30T16:55:27.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb1ce00640 1 -- start start 2024-05-30T16:55:27.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb1ce00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffb18159100 0x7ffb1806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:27.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb1ce00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb180b52d0 con 0x7ffb180b44e0 2024-05-30T16:55:27.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb1ce00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb180b4a30 con 0x7ffb1815c010 2024-05-30T16:55:27.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb1ce00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ffb180b4d10 con 0x7ffb18159100 2024-05-30T16:55:27.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb0d400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffb180b44e0 0x7ffb1815efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41670/0 (socket says 172.21.15.59:41670) 2024-05-30T16:55:27.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb0d400640 1 -- 172.21.15.59:0/41201086 learned_addr learned my addr 172.21.15.59:0/41201086 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:55:27.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb15e00640 1 --2- 172.21.15.59:0/41201086 >> v2:172.21.15.107:3300/0 conn(0x7ffb18159100 0x7ffb1806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:27.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb15400640 1 -- 172.21.15.59:0/41201086 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3798061055 0 0) 0x7ffb180b52d0 con 0x7ffb180b44e0 2024-05-30T16:55:27.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb15400640 1 -- 172.21.15.59:0/41201086 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffafc005740 con 0x7ffb180b44e0 2024-05-30T16:55:27.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb15400640 1 -- 172.21.15.59:0/41201086 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3751728374 0 0) 0x7ffb180b4a30 con 0x7ffb1815c010 2024-05-30T16:55:27.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb15400640 1 -- 172.21.15.59:0/41201086 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb180b52d0 con 0x7ffb1815c010 2024-05-30T16:55:27.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb15e00640 1 -- 172.21.15.59:0/41201086 >> v1:172.21.15.107:6789/0 conn(0x7ffb1815c010 legacy=0x7ffb180d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:27.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb15e00640 1 -- 172.21.15.59:0/41201086 >> v1:172.21.15.59:6789/0 conn(0x7ffb180b44e0 legacy=0x7ffb1815efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:27.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.987+0000 7ffb15e00640 1 -- 172.21.15.59:0/41201086 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb180b4ff0 con 0x7ffb18159100 2024-05-30T16:55:27.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.991+0000 7ffb15e00640 1 --2- 172.21.15.59:0/41201086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb18159100 0x7ffb1806e590 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffb080097c0 tx=0x7ffb0801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddac06719b09a6d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:27.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.991+0000 7ffb15400640 1 -- 172.21.15.59:0/41201086 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080b1070 con 0x7ffb18159100 2024-05-30T16:55:27.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.991+0000 7ffb15400640 1 -- 172.21.15.59:0/41201086 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb080a8050 con 0x7ffb18159100 2024-05-30T16:55:27.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.991+0000 7ffb15400640 1 -- 172.21.15.59:0/41201086 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080ac840 con 0x7ffb18159100 2024-05-30T16:55:27.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.991+0000 7ffb1ce00640 1 -- 172.21.15.59:0/41201086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb18159100 msgr2=0x7ffb1806e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:27.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.991+0000 7ffb1ce00640 1 --2- 172.21.15.59:0/41201086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb18159100 0x7ffb1806e590 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffb080097c0 tx=0x7ffb0801c3e0 comp rx=0 tx=0).stop 2024-05-30T16:55:27.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.991+0000 7ffb1ce00640 1 -- 172.21.15.59:0/41201086 shutdown_connections 2024-05-30T16:55:27.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.991+0000 7ffb1ce00640 1 --2- 172.21.15.59:0/41201086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb18159100 0x7ffb1806e590 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:27.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.991+0000 7ffb1ce00640 1 -- 172.21.15.59:0/41201086 >> 172.21.15.59:0/41201086 conn(0x7ffb1806bdb0 msgr2=0x7ffb1806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:27.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.991+0000 7ffb1ce00640 1 -- 172.21.15.59:0/41201086 shutdown_connections 2024-05-30T16:55:27.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.991+0000 7ffb1ce00640 1 -- 172.21.15.59:0/41201086 wait complete. 2024-05-30T16:55:27.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb1ce00640 1 Processor -- start 2024-05-30T16:55:27.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb1ce00640 1 -- start start 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb1ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb180b44e0 0x7ffb180cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb1ce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb18159100 0x7ffb1815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb1ce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb1815c010 0x7ffb180cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb1ce00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180d1020 con 0x7ffb180b44e0 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb1ce00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180d0ea0 con 0x7ffb18159100 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb1ce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1815c420 con 0x7ffb1815c010 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb15e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb180b44e0 0x7ffb180cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb15e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb180b44e0 0x7ffb180cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52016/0 (socket says 172.21.15.59:52016) 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb15e00640 1 -- 172.21.15.59:0/3371544566 learned_addr learned my addr 172.21.15.59:0/3371544566 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb0d400640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb18159100 0x7ffb1815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb16800640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb1815c010 0x7ffb180cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb15e00640 1 -- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb1815c010 msgr2=0x7ffb180cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:27.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb15e00640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb1815c010 0x7ffb180cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:28.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb15e00640 1 -- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb18159100 msgr2=0x7ffb1815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:28.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb15e00640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb18159100 0x7ffb1815a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:28.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb15e00640 1 -- 172.21.15.59:0/3371544566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1815ab00 con 0x7ffb180b44e0 2024-05-30T16:55:28.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb15e00640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb180b44e0 0x7ffb180cf700 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ffb080097c0 tx=0x7ffb08019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:28.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb0ea00640 1 -- 172.21.15.59:0/3371544566 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080b1040 con 0x7ffb180b44e0 2024-05-30T16:55:28.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb0ea00640 1 -- 172.21.15.59:0/3371544566 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb080bb070 con 0x7ffb180b44e0 2024-05-30T16:55:28.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb0ea00640 1 -- 172.21.15.59:0/3371544566 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080b5410 con 0x7ffb180b44e0 2024-05-30T16:55:28.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb1ce00640 1 -- 172.21.15.59:0/3371544566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb180cb110 con 0x7ffb180b44e0 2024-05-30T16:55:28.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb1ce00640 1 -- 172.21.15.59:0/3371544566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb180cb6d0 con 0x7ffb180b44e0 2024-05-30T16:55:28.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.995+0000 7ffb1ce00640 1 -- 172.21.15.59:0/3371544566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb18068a90 con 0x7ffb180b44e0 2024-05-30T16:55:28.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.999+0000 7ffb0ea00640 1 -- 172.21.15.59:0/3371544566 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 88803+0+0 (secure 0 0 0) 0x7ffb080b55b0 con 0x7ffb180b44e0 2024-05-30T16:55:28.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.999+0000 7ffb0ea00640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffaf4068c80 0x7ffaf406b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:28.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.999+0000 7ffb0ea00640 1 -- 172.21.15.59:0/3371544566 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7ffb0811edf0 con 0x7ffb180b44e0 2024-05-30T16:55:28.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.999+0000 7ffb0d400640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffaf4068c80 0x7ffaf406b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:27.999+0000 7ffb0d400640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffaf4068c80 0x7ffaf406b140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffb1806e620 tx=0x7ffb00001ae0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:28.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.003+0000 7ffb0ea00640 1 -- 172.21.15.59:0/3371544566 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffb080c5020 con 0x7ffb180b44e0 2024-05-30T16:55:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.203+0000 7ffb1ce00640 1 -- 172.21.15.59:0/3371544566 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone86892", "target": ["mon-mgr", ""]}) -- 0x7ffb1806c610 con 0x7ffaf4068c80 2024-05-30T16:55:28.823 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:28.825+0000 7efd38800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:28.823 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:28.825+0000 7efd38800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:28.823 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:28.825+0000 7efd38800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:28.824 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:28.825+0000 7efd38800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:28.824 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:28.825+0000 7efd38800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:28.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.903+0000 7ffb0ea00640 1 -- 172.21.15.59:0/3371544566 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ffb1806c610 con 0x7ffaf4068c80 2024-05-30T16:55:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.907+0000 7ffb1ce00640 1 -- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffaf4068c80 msgr2=0x7ffaf406b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.907+0000 7ffb1ce00640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffaf4068c80 0x7ffaf406b140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffb1806e620 tx=0x7ffb00001ae0 comp rx=0 tx=0).stop 2024-05-30T16:55:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.907+0000 7ffb1ce00640 1 -- 172.21.15.59:0/3371544566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb180b44e0 msgr2=0x7ffb180cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.907+0000 7ffb1ce00640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb180b44e0 0x7ffb180cf700 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ffb080097c0 tx=0x7ffb08019180 comp rx=0 tx=0).stop 2024-05-30T16:55:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.907+0000 7ffb1ce00640 1 -- 172.21.15.59:0/3371544566 shutdown_connections 2024-05-30T16:55:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.907+0000 7ffb1ce00640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffaf4068c80 0x7ffaf406b140 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.907+0000 7ffb1ce00640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb1815c010 0x7ffb180cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.907+0000 7ffb1ce00640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb18159100 0x7ffb1815a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.907+0000 7ffb1ce00640 1 --2- 172.21.15.59:0/3371544566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb180b44e0 0x7ffb180cf700 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.907+0000 7ffb1ce00640 1 -- 172.21.15.59:0/3371544566 >> 172.21.15.59:0/3371544566 conn(0x7ffb1806bdb0 msgr2=0x7ffb1815cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.907+0000 7ffb1ce00640 1 -- 172.21.15.59:0/3371544566 shutdown_connections 2024-05-30T16:55:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:28.907+0000 7ffb1ce00640 1 -- 172.21.15.59:0/3371544566 wait complete. 2024-05-30T16:55:28.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone86893 2024-05-30T16:55:28.933 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:28.933+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:28.933 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:28.933+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:28.933 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:28.933+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:28.933 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:28.933+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:28.933 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:28.933+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:29.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.167+0000 7f0117200640 1 Processor -- start 2024-05-30T16:55:29.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.167+0000 7f0117200640 1 -- start start 2024-05-30T16:55:29.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.171+0000 7f0117200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01180702f0 0x7f01180d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:29.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.171+0000 7f0117200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01180d0b70 con 0x7f011809abf0 2024-05-30T16:55:29.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.171+0000 7f0117200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01180d0e50 con 0x7f0118162bd0 2024-05-30T16:55:29.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.171+0000 7f0117200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f011815ffd0 con 0x7f01180702f0 2024-05-30T16:55:29.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.171+0000 7f0115e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01180702f0 0x7f01180d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:29.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.171+0000 7f0116800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f011809abf0 0x7f011809b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41686/0 (socket says 172.21.15.59:41686) 2024-05-30T16:55:29.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.171+0000 7f0116800640 1 -- 172.21.15.59:0/2663241268 learned_addr learned my addr 172.21.15.59:0/2663241268 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:55:29.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.171+0000 7f0115e00640 1 -- 172.21.15.59:0/2663241268 >> v1:172.21.15.107:6789/0 conn(0x7f0118162bd0 legacy=0x7f01180706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:29.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.171+0000 7f0115e00640 1 -- 172.21.15.59:0/2663241268 >> v1:172.21.15.59:6789/0 conn(0x7f011809abf0 legacy=0x7f011809b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:29.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.171+0000 7f0115e00640 1 -- 172.21.15.59:0/2663241268 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01180d1130 con 0x7f01180702f0 2024-05-30T16:55:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.175+0000 7f0115e00640 1 --2- 172.21.15.59:0/2663241268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01180702f0 0x7f01180d0490 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f01080097c0 tx=0x7f010801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc510f69ea920ca server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:29.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.175+0000 7f0114a00640 1 -- 172.21.15.59:0/2663241268 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01080b0070 con 0x7f01180702f0 2024-05-30T16:55:29.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.175+0000 7f0114a00640 1 -- 172.21.15.59:0/2663241268 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01080ab600 con 0x7f01180702f0 2024-05-30T16:55:29.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.175+0000 7f0114a00640 1 -- 172.21.15.59:0/2663241268 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01080ab9d0 con 0x7f01180702f0 2024-05-30T16:55:29.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.175+0000 7f0117200640 1 -- 172.21.15.59:0/2663241268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01180702f0 msgr2=0x7f01180d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:29.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.175+0000 7f0117200640 1 --2- 172.21.15.59:0/2663241268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01180702f0 0x7f01180d0490 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f01080097c0 tx=0x7f010801c460 comp rx=0 tx=0).stop 2024-05-30T16:55:29.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.175+0000 7f0117200640 1 -- 172.21.15.59:0/2663241268 shutdown_connections 2024-05-30T16:55:29.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.175+0000 7f0117200640 1 --2- 172.21.15.59:0/2663241268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01180702f0 0x7f01180d0490 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:29.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.175+0000 7f0117200640 1 -- 172.21.15.59:0/2663241268 >> 172.21.15.59:0/2663241268 conn(0x7f01180b3df0 msgr2=0x7f01180b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:29.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.175+0000 7f0117200640 1 -- 172.21.15.59:0/2663241268 shutdown_connections 2024-05-30T16:55:29.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.175+0000 7f0117200640 1 -- 172.21.15.59:0/2663241268 wait complete. 2024-05-30T16:55:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0117200640 1 Processor -- start 2024-05-30T16:55:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0117200640 1 -- start start 2024-05-30T16:55:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0117200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01180702f0 0x7f01180cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0117200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f011809abf0 0x7f011815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0117200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0118162bd0 0x7f01180cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0117200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f011816cf30 con 0x7f01180702f0 2024-05-30T16:55:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0117200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f011816cdb0 con 0x7f011809abf0 2024-05-30T16:55:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0117200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f011816d0b0 con 0x7f0118162bd0 2024-05-30T16:55:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0115e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01180702f0 0x7f01180cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0115e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01180702f0 0x7f01180cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52046/0 (socket says 172.21.15.59:52046) 2024-05-30T16:55:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0115e00640 1 -- 172.21.15.59:0/1839570800 learned_addr learned my addr 172.21.15.59:0/1839570800 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0116800640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0118162bd0 0x7f01180cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0115400640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f011809abf0 0x7f011815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0115e00640 1 -- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0118162bd0 msgr2=0x7f01180cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0115e00640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0118162bd0 0x7f01180cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0115e00640 1 -- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f011809abf0 msgr2=0x7f011815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0115e00640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f011809abf0 0x7f011815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0115e00640 1 -- 172.21.15.59:0/1839570800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0118156c70 con 0x7f01180702f0 2024-05-30T16:55:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0115e00640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01180702f0 0x7f01180cc710 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f01080ae040 tx=0x7f010801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f010e000640 1 -- 172.21.15.59:0/1839570800 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01080b0050 con 0x7f01180702f0 2024-05-30T16:55:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f010e000640 1 -- 172.21.15.59:0/1839570800 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01080bc070 con 0x7f01180702f0 2024-05-30T16:55:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0117200640 1 -- 172.21.15.59:0/1839570800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0118156f50 con 0x7f01180702f0 2024-05-30T16:55:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f010e000640 1 -- 172.21.15.59:0/1839570800 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01080b5a70 con 0x7f01180702f0 2024-05-30T16:55:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.179+0000 7f0117200640 1 -- 172.21.15.59:0/1839570800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0118157510 con 0x7f01180702f0 2024-05-30T16:55:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.183+0000 7f0117200640 1 -- 172.21.15.59:0/1839570800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01180691a0 con 0x7f01180702f0 2024-05-30T16:55:29.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.183+0000 7f010e000640 1 -- 172.21.15.59:0/1839570800 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 88803+0+0 (secure 0 0 0) 0x7f01080ab4c0 con 0x7f01180702f0 2024-05-30T16:55:29.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.183+0000 7f010e000640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f00f8068c80 0x7f00f806b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:29.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.183+0000 7f010e000640 1 -- 172.21.15.59:0/1839570800 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f010811faa0 con 0x7f01180702f0 2024-05-30T16:55:29.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.191+0000 7f010e000640 1 -- 172.21.15.59:0/1839570800 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0108016050 con 0x7f01180702f0 2024-05-30T16:55:29.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.195+0000 7f0115400640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f00f8068c80 0x7f00f806b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:29.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.199+0000 7f0115400640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f00f8068c80 0x7f00f806b140 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0118162910 tx=0x7f0104009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:29.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.575+0000 7f0117200640 1 -- 172.21.15.59:0/1839570800 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone86893", "target": ["mon-mgr", ""]}) -- 0x7f01180d2070 con 0x7f00f8068c80 2024-05-30T16:55:29.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:29.915+0000 7f010e000640 1 -- 172.21.15.59:0/1839570800 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 17) ==== 89007+0+0 (secure 0 0 0) 0x7f01080eda20 con 0x7f01180702f0 2024-05-30T16:55:30.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.147+0000 7f010e000640 1 -- 172.21.15.59:0/1839570800 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f01180d2070 con 0x7f00f8068c80 2024-05-30T16:55:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.151+0000 7f0117200640 1 -- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f00f8068c80 msgr2=0x7f00f806b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.151+0000 7f0117200640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f00f8068c80 0x7f00f806b140 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0118162910 tx=0x7f0104009040 comp rx=0 tx=0).stop 2024-05-30T16:55:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.151+0000 7f0117200640 1 -- 172.21.15.59:0/1839570800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01180702f0 msgr2=0x7f01180cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.151+0000 7f0117200640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01180702f0 0x7f01180cc710 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f01080ae040 tx=0x7f010801aca0 comp rx=0 tx=0).stop 2024-05-30T16:55:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.151+0000 7f0117200640 1 -- 172.21.15.59:0/1839570800 shutdown_connections 2024-05-30T16:55:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.151+0000 7f0117200640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f00f8068c80 0x7f00f806b140 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.151+0000 7f0117200640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0118162bd0 0x7f01180cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.151+0000 7f0117200640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f011809abf0 0x7f011815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.151+0000 7f0117200640 1 --2- 172.21.15.59:0/1839570800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01180702f0 0x7f01180cc710 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.151+0000 7f0117200640 1 -- 172.21.15.59:0/1839570800 >> 172.21.15.59:0/1839570800 conn(0x7f01180b3df0 msgr2=0x7f011806d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.155+0000 7f0117200640 1 -- 172.21.15.59:0/1839570800 shutdown_connections 2024-05-30T16:55:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.155+0000 7f0117200640 1 -- 172.21.15.59:0/1839570800 wait complete. 2024-05-30T16:55:30.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone86894 2024-05-30T16:55:30.218 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:30.217+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:30.219 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:30.217+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:30.219 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:30.217+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:30.219 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:30.217+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:30.219 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:30.217+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:30.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.479+0000 7ff3f5800640 1 Processor -- start 2024-05-30T16:55:30.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.479+0000 7ff3f5800640 1 -- start start 2024-05-30T16:55:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.483+0000 7ff3f5800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3f015c390 0x7ff3f006ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.483+0000 7ff3f5800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff3f00b5e80 0x7ff3f00b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:30.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.487+0000 7ff3f5800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f015d3b0 con 0x7ff3f015c770 2024-05-30T16:55:30.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.487+0000 7ff3f5800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f015d690 con 0x7ff3f00b5e80 2024-05-30T16:55:30.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.487+0000 7ff3f5800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f006e620 con 0x7ff3f015c390 2024-05-30T16:55:30.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.487+0000 7ff3e7400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff3f00b5e80 0x7ff3f00b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.487+0000 7ff3efe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3f015c390 0x7ff3f006ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.487+0000 7ff3f4e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff3f015c770 0x7ff3f015cc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:33916/0 (socket says 172.21.15.59:33916) 2024-05-30T16:55:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.487+0000 7ff3f4e00640 1 -- 172.21.15.59:0/3022820875 learned_addr learned my addr 172.21.15.59:0/3022820875 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:55:30.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.491+0000 7ff3efe00640 1 -- 172.21.15.59:0/3022820875 >> v2:172.21.15.107:3300/0 conn(0x7ff3f00b5e80 msgr2=0x7ff3f00b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:30.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.491+0000 7ff3efe00640 1 --2- 172.21.15.59:0/3022820875 >> v2:172.21.15.107:3300/0 conn(0x7ff3f00b5e80 0x7ff3f00b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:30.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.491+0000 7ff3efe00640 1 -- 172.21.15.59:0/3022820875 >> v1:172.21.15.107:6789/0 conn(0x7ff3f015c770 legacy=0x7ff3f015cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:30.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.491+0000 7ff3efe00640 1 -- 172.21.15.59:0/3022820875 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f006e900 con 0x7ff3f015c390 2024-05-30T16:55:30.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.499+0000 7ff3efe00640 1 --2- 172.21.15.59:0/3022820875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3f015c390 0x7ff3f006ee20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00097c0 tx=0x7ff3e001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43bdc14faec6db90 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:30.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.499+0000 7ff3ef400640 1 -- 172.21.15.59:0/3022820875 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00b1070 con 0x7ff3f015c390 2024-05-30T16:55:30.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.499+0000 7ff3ef400640 1 -- 172.21.15.59:0/3022820875 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e00ac410 con 0x7ff3f015c390 2024-05-30T16:55:30.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.499+0000 7ff3ef400640 1 -- 172.21.15.59:0/3022820875 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00ac7e0 con 0x7ff3f015c390 2024-05-30T16:55:30.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.499+0000 7ff3f5800640 1 -- 172.21.15.59:0/3022820875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3f015c390 msgr2=0x7ff3f006ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:30.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.499+0000 7ff3f5800640 1 --2- 172.21.15.59:0/3022820875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3f015c390 0x7ff3f006ee20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00097c0 tx=0x7ff3e001c4a0 comp rx=0 tx=0).stop 2024-05-30T16:55:30.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.499+0000 7ff3f5800640 1 -- 172.21.15.59:0/3022820875 shutdown_connections 2024-05-30T16:55:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.499+0000 7ff3f5800640 1 --2- 172.21.15.59:0/3022820875 >> v2:172.21.15.107:3300/0 conn(0x7ff3f00b5e80 0x7ff3f00b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.499+0000 7ff3f5800640 1 --2- 172.21.15.59:0/3022820875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3f015c390 0x7ff3f006ee20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.499+0000 7ff3f5800640 1 -- 172.21.15.59:0/3022820875 >> 172.21.15.59:0/3022820875 conn(0x7ff3f006b9b0 msgr2=0x7ff3f006bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.499+0000 7ff3f5800640 1 -- 172.21.15.59:0/3022820875 shutdown_connections 2024-05-30T16:55:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.499+0000 7ff3f5800640 1 -- 172.21.15.59:0/3022820875 wait complete. 2024-05-30T16:55:30.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.503+0000 7ff3f5800640 1 Processor -- start 2024-05-30T16:55:30.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.503+0000 7ff3f5800640 1 -- start start 2024-05-30T16:55:30.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.503+0000 7ff3f5800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f00b5e80 0x7ff3f0133d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.503+0000 7ff3f5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015c390 0x7ff3f0134260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.503+0000 7ff3f5800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3f015c770 0x7ff3f01347a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.503+0000 7ff3f5800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f00cdee0 con 0x7ff3f015c390 2024-05-30T16:55:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.503+0000 7ff3f5800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f0070dc0 con 0x7ff3f00b5e80 2024-05-30T16:55:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.503+0000 7ff3f5800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f00ce060 con 0x7ff3f015c770 2024-05-30T16:55:30.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.503+0000 7ff3e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015c390 0x7ff3f0134260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:30.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.503+0000 7ff3e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015c390 0x7ff3f0134260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52058/0 (socket says 172.21.15.59:52058) 2024-05-30T16:55:30.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.503+0000 7ff3e7400640 1 -- 172.21.15.59:0/2415883452 learned_addr learned my addr 172.21.15.59:0/2415883452 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:30.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3f4e00640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3f015c770 0x7ff3f01347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:30.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3e7400640 1 -- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3f015c770 msgr2=0x7ff3f01347a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:30.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3e7400640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3f015c770 0x7ff3f01347a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:30.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3e7400640 1 -- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f00b5e80 msgr2=0x7ff3f0133d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:30.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3e7400640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f00b5e80 0x7ff3f0133d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:30.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3e7400640 1 -- 172.21.15.59:0/2415883452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f014a6a0 con 0x7ff3f015c390 2024-05-30T16:55:30.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3f4e00640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3f015c770 0x7ff3f01347a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:55:30.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3e7400640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015c390 0x7ff3f0134260 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800e870 tx=0x7ff3d800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:30.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3ecc00640 1 -- 172.21.15.59:0/2415883452 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8017070 con 0x7ff3f015c390 2024-05-30T16:55:30.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3ecc00640 1 -- 172.21.15.59:0/2415883452 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d800c940 con 0x7ff3f015c390 2024-05-30T16:55:30.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3ecc00640 1 -- 172.21.15.59:0/2415883452 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d800ccf0 con 0x7ff3f015c390 2024-05-30T16:55:30.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3f5800640 1 -- 172.21.15.59:0/2415883452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f0134fd0 con 0x7ff3f015c390 2024-05-30T16:55:30.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3f5800640 1 -- 172.21.15.59:0/2415883452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f0151210 con 0x7ff3f015c390 2024-05-30T16:55:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.507+0000 7ff3f5800640 1 -- 172.21.15.59:0/2415883452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f00691a0 con 0x7ff3f015c390 2024-05-30T16:55:30.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.511+0000 7ff3ecc00640 1 -- 172.21.15.59:0/2415883452 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 89007+0+0 (secure 0 0 0) 0x7ff3d801a070 con 0x7ff3f015c390 2024-05-30T16:55:30.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.511+0000 7ff3ecc00640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff3cc068ec0 0x7ff3cc06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:30.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.511+0000 7ff3ecc00640 1 -- 172.21.15.59:0/2415883452 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7ff3d808eb40 con 0x7ff3f015c390 2024-05-30T16:55:30.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.519+0000 7ff3ecc00640 1 -- 172.21.15.59:0/2415883452 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff3d8056a10 con 0x7ff3f015c390 2024-05-30T16:55:30.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.519+0000 7ff3efe00640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff3cc068ec0 0x7ff3cc06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:30.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.527+0000 7ff3efe00640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff3cc068ec0 0x7ff3cc06b380 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00ae000 tx=0x7ff3e0004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:30.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:30.927+0000 7ff3f5800640 1 -- 172.21.15.59:0/2415883452 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone86894", "target": ["mon-mgr", ""]}) -- 0x7ff3f006fa00 con 0x7ff3cc068ec0 2024-05-30T16:55:31.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.399+0000 7ff3ecc00640 1 -- 172.21.15.59:0/2415883452 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff3f006fa00 con 0x7ff3cc068ec0 2024-05-30T16:55:31.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.403+0000 7ff3f5800640 1 -- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff3cc068ec0 msgr2=0x7ff3cc06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:31.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.403+0000 7ff3f5800640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff3cc068ec0 0x7ff3cc06b380 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00ae000 tx=0x7ff3e0004740 comp rx=0 tx=0).stop 2024-05-30T16:55:31.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.403+0000 7ff3f5800640 1 -- 172.21.15.59:0/2415883452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015c390 msgr2=0x7ff3f0134260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:31.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.403+0000 7ff3f5800640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015c390 0x7ff3f0134260 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800e870 tx=0x7ff3d800ec70 comp rx=0 tx=0).stop 2024-05-30T16:55:31.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.403+0000 7ff3f5800640 1 -- 172.21.15.59:0/2415883452 shutdown_connections 2024-05-30T16:55:31.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.403+0000 7ff3f5800640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff3cc068ec0 0x7ff3cc06b380 secure :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00ae000 tx=0x7ff3e0004740 comp rx=0 tx=0).stop 2024-05-30T16:55:31.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.403+0000 7ff3f5800640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3f015c770 0x7ff3f01347a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:31.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.403+0000 7ff3f5800640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015c390 0x7ff3f0134260 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:31.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.403+0000 7ff3f5800640 1 --2- 172.21.15.59:0/2415883452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f00b5e80 0x7ff3f0133d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:31.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.403+0000 7ff3f5800640 1 -- 172.21.15.59:0/2415883452 >> 172.21.15.59:0/2415883452 conn(0x7ff3f006b9b0 msgr2=0x7ff3f015f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:31.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.407+0000 7ff3f5800640 1 -- 172.21.15.59:0/2415883452 shutdown_connections 2024-05-30T16:55:31.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.407+0000 7ff3f5800640 1 -- 172.21.15.59:0/2415883452 wait complete. 2024-05-30T16:55:31.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone86895 2024-05-30T16:55:31.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.747+0000 7f756ea00640 1 Processor -- start 2024-05-30T16:55:31.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.747+0000 7f756ea00640 1 -- start start 2024-05-30T16:55:31.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.747+0000 7f756ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75680d14c0 0x7f756806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:31.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.747+0000 7f756ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f75680d05b0 0x7f756809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:31.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.747+0000 7f756ea00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f756806ea20 con 0x7f756809af80 2024-05-30T16:55:31.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.747+0000 7f756ea00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f756809b3f0 con 0x7f75680d14c0 2024-05-30T16:55:31.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.747+0000 7f756ea00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7568070950 con 0x7f75680d05b0 2024-05-30T16:55:31.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.751+0000 7f7567e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75680d14c0 0x7f756806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:31.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.751+0000 7f7567e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75680d14c0 0x7f756806e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52060/0 (socket says 172.21.15.59:52060) 2024-05-30T16:55:31.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.751+0000 7f7567e00640 1 -- 172.21.15.59:0/2876573244 learned_addr learned my addr 172.21.15.59:0/2876573244 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:31.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.751+0000 7f7567e00640 1 -- 172.21.15.59:0/2876573244 >> v2:172.21.15.107:3300/0 conn(0x7f75680d05b0 msgr2=0x7f756809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:31.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.751+0000 7f7567e00640 1 --2- 172.21.15.59:0/2876573244 >> v2:172.21.15.107:3300/0 conn(0x7f75680d05b0 0x7f756809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:31.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.751+0000 7f7567e00640 1 -- 172.21.15.59:0/2876573244 >> v1:172.21.15.107:6789/0 conn(0x7f756809af80 legacy=0x7f7568162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:31.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.751+0000 7f7567e00640 1 -- 172.21.15.59:0/2876573244 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7568070c30 con 0x7f75680d14c0 2024-05-30T16:55:31.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.751+0000 7f7567e00640 1 --2- 172.21.15.59:0/2876573244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75680d14c0 0x7f756806e4e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7568072190 tx=0x7f755801c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4556bedd72419e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:31.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.755+0000 7f7566a00640 1 -- 172.21.15.59:0/2876573244 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75580b0070 con 0x7f75680d14c0 2024-05-30T16:55:31.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.755+0000 7f7566a00640 1 -- 172.21.15.59:0/2876573244 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75580ab600 con 0x7f75680d14c0 2024-05-30T16:55:31.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.755+0000 7f7566a00640 1 -- 172.21.15.59:0/2876573244 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75580ab9d0 con 0x7f75680d14c0 2024-05-30T16:55:31.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.755+0000 7f756ea00640 1 -- 172.21.15.59:0/2876573244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75680d14c0 msgr2=0x7f756806e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:31.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.755+0000 7f756ea00640 1 --2- 172.21.15.59:0/2876573244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75680d14c0 0x7f756806e4e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7568072190 tx=0x7f755801c2d0 comp rx=0 tx=0).stop 2024-05-30T16:55:31.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.755+0000 7f756ea00640 1 -- 172.21.15.59:0/2876573244 shutdown_connections 2024-05-30T16:55:31.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.755+0000 7f756ea00640 1 --2- 172.21.15.59:0/2876573244 >> v2:172.21.15.107:3300/0 conn(0x7f75680d05b0 0x7f756809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:31.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.755+0000 7f756ea00640 1 --2- 172.21.15.59:0/2876573244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75680d14c0 0x7f756806e4e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:31.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.755+0000 7f756ea00640 1 -- 172.21.15.59:0/2876573244 >> 172.21.15.59:0/2876573244 conn(0x7f75680b3f80 msgr2=0x7f75680b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:31.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.755+0000 7f756ea00640 1 -- 172.21.15.59:0/2876573244 shutdown_connections 2024-05-30T16:55:31.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.755+0000 7f756ea00640 1 -- 172.21.15.59:0/2876573244 wait complete. 2024-05-30T16:55:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.759+0000 7f756ea00640 1 Processor -- start 2024-05-30T16:55:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.759+0000 7f756ea00640 1 -- start start 2024-05-30T16:55:31.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.759+0000 7f756ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f756809af80 0x7f7568162780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:31.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.759+0000 7f756ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75680d05b0 0x7f7568161b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:31.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.759+0000 7f756ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75680d14c0 0x7f75680c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:31.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.759+0000 7f756ea00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f75680d18a0 con 0x7f756809af80 2024-05-30T16:55:31.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.759+0000 7f756ea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f75680d0a40 con 0x7f75680d14c0 2024-05-30T16:55:31.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.759+0000 7f756ea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f756806e100 con 0x7f75680d05b0 2024-05-30T16:55:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.759+0000 7f7567e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f756809af80 0x7f7568162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.759+0000 7f7567e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f756809af80 0x7f7568162780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52070/0 (socket says 172.21.15.59:52070) 2024-05-30T16:55:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.759+0000 7f7567e00640 1 -- 172.21.15.59:0/1156577551 learned_addr learned my addr 172.21.15.59:0/1156577551 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.763+0000 7f756ca00640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75680d14c0 0x7f75680c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.763+0000 7f7567e00640 1 -- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75680d05b0 msgr2=0x7f7568161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.763+0000 7f7567e00640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75680d05b0 0x7f7568161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.763+0000 7f7567e00640 1 -- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75680d14c0 msgr2=0x7f75680c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:31.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.763+0000 7f7567e00640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75680d14c0 0x7f75680c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:31.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.763+0000 7f7567e00640 1 -- 172.21.15.59:0/1156577551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75680b6160 con 0x7f756809af80 2024-05-30T16:55:31.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.763+0000 7f7567e00640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f756809af80 0x7f7568162780 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f75580ae040 tx=0x7f755801ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:31.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.763+0000 7f755fe00640 1 -- 172.21.15.59:0/1156577551 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75580b0040 con 0x7f756809af80 2024-05-30T16:55:31.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.763+0000 7f755fe00640 1 -- 172.21.15.59:0/1156577551 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75580bc070 con 0x7f756809af80 2024-05-30T16:55:31.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.763+0000 7f755fe00640 1 -- 172.21.15.59:0/1156577551 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75580b6880 con 0x7f756809af80 2024-05-30T16:55:31.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.763+0000 7f756ea00640 1 -- 172.21.15.59:0/1156577551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75680c6620 con 0x7f756809af80 2024-05-30T16:55:31.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.763+0000 7f756ea00640 1 -- 172.21.15.59:0/1156577551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75680c6be0 con 0x7f756809af80 2024-05-30T16:55:31.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.767+0000 7f756ea00640 1 -- 172.21.15.59:0/1156577551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7568068a90 con 0x7f756809af80 2024-05-30T16:55:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.767+0000 7f755fe00640 1 -- 172.21.15.59:0/1156577551 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 89007+0+0 (secure 0 0 0) 0x7f75580b6a20 con 0x7f756809af80 2024-05-30T16:55:31.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.767+0000 7f755fe00640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7548068f10 0x7f754806b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.767+0000 7f755fe00640 1 -- 172.21.15.59:0/1156577551 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f755811f7d0 con 0x7f756809af80 2024-05-30T16:55:31.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.775+0000 7f755fe00640 1 -- 172.21.15.59:0/1156577551 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f756806ea20 con 0x7f756809af80 2024-05-30T16:55:31.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.787+0000 7f7567400640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7548068f10 0x7f754806b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:31.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:31.803+0000 7f7567400640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7548068f10 0x7f754806b3d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f75680b7b60 tx=0x7f7554006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:32.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:32.071+0000 7f755fe00640 1 -- 172.21.15.59:0/1156577551 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 18) ==== 89058+0+0 (secure 0 0 0) 0x7f75580b6d10 con 0x7f756809af80 2024-05-30T16:55:32.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:32.155+0000 7f756ea00640 1 -- 172.21.15.59:0/1156577551 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone86895", "target": ["mon-mgr", ""]}) -- 0x7f75680751c0 con 0x7f7548068f10 2024-05-30T16:55:33.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.151+0000 7f755fe00640 1 -- 172.21.15.59:0/1156577551 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7554009340 con 0x7f7548068f10 2024-05-30T16:55:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.155+0000 7f756ea00640 1 -- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7548068f10 msgr2=0x7f754806b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.155+0000 7f756ea00640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7548068f10 0x7f754806b3d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f75680b7b60 tx=0x7f7554006ca0 comp rx=0 tx=0).stop 2024-05-30T16:55:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.155+0000 7f756ea00640 1 -- 172.21.15.59:0/1156577551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f756809af80 msgr2=0x7f7568162780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.155+0000 7f756ea00640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f756809af80 0x7f7568162780 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f75580ae040 tx=0x7f755801ab10 comp rx=0 tx=0).stop 2024-05-30T16:55:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.155+0000 7f756ea00640 1 -- 172.21.15.59:0/1156577551 shutdown_connections 2024-05-30T16:55:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.155+0000 7f756ea00640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7548068f10 0x7f754806b3d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.155+0000 7f756ea00640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75680d14c0 0x7f75680c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.155+0000 7f756ea00640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75680d05b0 0x7f7568161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.155+0000 7f756ea00640 1 --2- 172.21.15.59:0/1156577551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f756809af80 0x7f7568162780 secure :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f75580ae040 tx=0x7f755801ab10 comp rx=0 tx=0).stop 2024-05-30T16:55:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.155+0000 7f756ea00640 1 -- 172.21.15.59:0/1156577551 >> 172.21.15.59:0/1156577551 conn(0x7f75680b3f80 msgr2=0x7f75680af390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.155+0000 7f756ea00640 1 -- 172.21.15.59:0/1156577551 shutdown_connections 2024-05-30T16:55:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.155+0000 7f756ea00640 1 -- 172.21.15.59:0/1156577551 wait complete. 2024-05-30T16:55:33.201 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone86896 2024-05-30T16:55:33.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.483+0000 7fdffee00640 1 Processor -- start 2024-05-30T16:55:33.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.483+0000 7fdffee00640 1 -- start start 2024-05-30T16:55:33.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.487+0000 7fdffee00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdff8162780 0x7fdff8162b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:33.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.487+0000 7fdffee00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdff80d0660 0x7fdff80d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:33.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.487+0000 7fdffee00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff80b3fc0 con 0x7fdff80b32d0 2024-05-30T16:55:33.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.487+0000 7fdffee00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fdff80d1000 con 0x7fdff80d0660 2024-05-30T16:55:33.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.487+0000 7fdffee00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fdff80b42a0 con 0x7fdff8162780 2024-05-30T16:55:33.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.487+0000 7fdff7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdff80d0660 0x7fdff80d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:33.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.487+0000 7fdff7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdff80d0660 0x7fdff80d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44394/0 (socket says 172.21.15.59:44394) 2024-05-30T16:55:33.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.487+0000 7fdff7400640 1 -- 172.21.15.59:0/3299264201 learned_addr learned my addr 172.21.15.59:0/3299264201 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:33.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.491+0000 7fdff7400640 1 -- 172.21.15.59:0/3299264201 >> v2:172.21.15.107:3300/0 conn(0x7fdff8162780 msgr2=0x7fdff8162b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:33.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.491+0000 7fdff7400640 1 --2- 172.21.15.59:0/3299264201 >> v2:172.21.15.107:3300/0 conn(0x7fdff8162780 0x7fdff8162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:33.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.491+0000 7fdff7400640 1 -- 172.21.15.59:0/3299264201 >> v1:172.21.15.107:6789/0 conn(0x7fdff80b32d0 legacy=0x7fdff80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:33.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.491+0000 7fdff7400640 1 -- 172.21.15.59:0/3299264201 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff806ddb0 con 0x7fdff80d0660 2024-05-30T16:55:33.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.495+0000 7fdff7400640 1 --2- 172.21.15.59:0/3299264201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff80d0660 0x7fdff80d0ac0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fdff806fef0 tx=0x7fdfe401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1543b15b49536e6a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:33.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.495+0000 7fdff6a00640 1 -- 172.21.15.59:0/3299264201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40b0070 con 0x7fdff80d0660 2024-05-30T16:55:33.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.495+0000 7fdff6a00640 1 -- 172.21.15.59:0/3299264201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe40ab600 con 0x7fdff80d0660 2024-05-30T16:55:33.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.495+0000 7fdff6a00640 1 -- 172.21.15.59:0/3299264201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40ab9d0 con 0x7fdff80d0660 2024-05-30T16:55:33.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.499+0000 7fdffee00640 1 -- 172.21.15.59:0/3299264201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff80d0660 msgr2=0x7fdff80d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:33.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.499+0000 7fdffee00640 1 --2- 172.21.15.59:0/3299264201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff80d0660 0x7fdff80d0ac0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fdff806fef0 tx=0x7fdfe401c450 comp rx=0 tx=0).stop 2024-05-30T16:55:33.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.499+0000 7fdffee00640 1 -- 172.21.15.59:0/3299264201 shutdown_connections 2024-05-30T16:55:33.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.499+0000 7fdffee00640 1 --2- 172.21.15.59:0/3299264201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff80d0660 0x7fdff80d0ac0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:33.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.499+0000 7fdffee00640 1 --2- 172.21.15.59:0/3299264201 >> v2:172.21.15.107:3300/0 conn(0x7fdff8162780 0x7fdff8162b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:33.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.499+0000 7fdffee00640 1 -- 172.21.15.59:0/3299264201 >> 172.21.15.59:0/3299264201 conn(0x7fdff806bdb0 msgr2=0x7fdff806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:33.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.499+0000 7fdffee00640 1 -- 172.21.15.59:0/3299264201 shutdown_connections 2024-05-30T16:55:33.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.503+0000 7fdffee00640 1 -- 172.21.15.59:0/3299264201 wait complete. 2024-05-30T16:55:33.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.503+0000 7fdffee00640 1 Processor -- start 2024-05-30T16:55:33.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.503+0000 7fdffee00640 1 -- start start 2024-05-30T16:55:33.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdffee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff80b32d0 0x7fdff8163400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdffee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdff80d0660 0x7fdff8156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdffee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdff8162780 0x7fdff815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdffee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdff806f430 con 0x7fdff80b32d0 2024-05-30T16:55:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdffee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdff806f2b0 con 0x7fdff80d0660 2024-05-30T16:55:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdffee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdff806f5b0 con 0x7fdff8162780 2024-05-30T16:55:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdff7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff80b32d0 0x7fdff8163400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdff7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff80b32d0 0x7fdff8163400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44410/0 (socket says 172.21.15.59:44410) 2024-05-30T16:55:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdff7e00640 1 -- 172.21.15.59:0/2427230179 learned_addr learned my addr 172.21.15.59:0/2427230179 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:33.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdff7e00640 1 -- 172.21.15.59:0/2427230179 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdff8162780 msgr2=0x7fdff815c8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:55:33.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdff7e00640 1 --2- 172.21.15.59:0/2427230179 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdff8162780 0x7fdff815c8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:33.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdff7e00640 1 -- 172.21.15.59:0/2427230179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdff80d0660 msgr2=0x7fdff8156000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T16:55:33.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdff7e00640 1 --2- 172.21.15.59:0/2427230179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdff80d0660 0x7fdff8156000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:33.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.507+0000 7fdff7e00640 1 -- 172.21.15.59:0/2427230179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff809e3c0 con 0x7fdff80b32d0 2024-05-30T16:55:33.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.511+0000 7fdff7e00640 1 --2- 172.21.15.59:0/2427230179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff80b32d0 0x7fdff8163400 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fdff000ba50 tx=0x7fdff000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:33.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.511+0000 7fdfefe00640 1 -- 172.21.15.59:0/2427230179 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0019070 con 0x7fdff80b32d0 2024-05-30T16:55:33.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.511+0000 7fdfefe00640 1 -- 172.21.15.59:0/2427230179 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff000cc00 con 0x7fdff80b32d0 2024-05-30T16:55:33.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.511+0000 7fdfefe00640 1 -- 172.21.15.59:0/2427230179 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0014440 con 0x7fdff80b32d0 2024-05-30T16:55:33.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.511+0000 7fdffee00640 1 -- 172.21.15.59:0/2427230179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff81600d0 con 0x7fdff80b32d0 2024-05-30T16:55:33.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.511+0000 7fdffee00640 1 -- 172.21.15.59:0/2427230179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff8160370 con 0x7fdff80b32d0 2024-05-30T16:55:33.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.515+0000 7fdffee00640 1 -- 172.21.15.59:0/2427230179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff8068a90 con 0x7fdff80b32d0 2024-05-30T16:55:33.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.519+0000 7fdfefe00640 1 -- 172.21.15.59:0/2427230179 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 89058+0+0 (secure 0 0 0) 0x7fdff001c070 con 0x7fdff80b32d0 2024-05-30T16:55:33.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.519+0000 7fdfefe00640 1 --2- 172.21.15.59:0/2427230179 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfd8068f50 0x7fdfd806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:33.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.519+0000 7fdfefe00640 1 -- 172.21.15.59:0/2427230179 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fdff0085360 con 0x7fdff80b32d0 2024-05-30T16:55:33.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.523+0000 7fdff7400640 1 --2- 172.21.15.59:0/2427230179 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfd8068f50 0x7fdfd806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:33.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.535+0000 7fdff7400640 1 --2- 172.21.15.59:0/2427230179 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfd8068f50 0x7fdfd806b410 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdff80b5290 tx=0x7fdfe40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:33.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.539+0000 7fdfefe00640 1 -- 172.21.15.59:0/2427230179 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdff0057110 con 0x7fdff80b32d0 2024-05-30T16:55:33.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:33.943+0000 7fdffee00640 1 -- 172.21.15.59:0/2427230179 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone86896", "target": ["mon-mgr", ""]}) -- 0x7fdff80ae230 con 0x7fdfd8068f50 2024-05-30T16:55:34.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:55:34.400 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:55:35.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.099+0000 7fdfefe00640 1 -- 172.21.15.59:0/2427230179 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdff80ae230 con 0x7fdfd8068f50 2024-05-30T16:55:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.115+0000 7fdffee00640 1 -- 172.21.15.59:0/2427230179 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfd8068f50 msgr2=0x7fdfd806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.115+0000 7fdffee00640 1 --2- 172.21.15.59:0/2427230179 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfd8068f50 0x7fdfd806b410 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdff80b5290 tx=0x7fdfe40a6000 comp rx=0 tx=0).stop 2024-05-30T16:55:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.115+0000 7fdffee00640 1 -- 172.21.15.59:0/2427230179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff80b32d0 msgr2=0x7fdff8163400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.115+0000 7fdffee00640 1 --2- 172.21.15.59:0/2427230179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff80b32d0 0x7fdff8163400 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fdff000ba50 tx=0x7fdff000bf10 comp rx=0 tx=0).stop 2024-05-30T16:55:35.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.115+0000 7fdffee00640 1 -- 172.21.15.59:0/2427230179 shutdown_connections 2024-05-30T16:55:35.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.115+0000 7fdffee00640 1 --2- 172.21.15.59:0/2427230179 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfd8068f50 0x7fdfd806b410 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:35.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.115+0000 7fdffee00640 1 --2- 172.21.15.59:0/2427230179 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdff8162780 0x7fdff815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:35.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.115+0000 7fdffee00640 1 --2- 172.21.15.59:0/2427230179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdff80d0660 0x7fdff8156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:35.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.115+0000 7fdffee00640 1 --2- 172.21.15.59:0/2427230179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff80b32d0 0x7fdff8163400 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:35.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.115+0000 7fdffee00640 1 -- 172.21.15.59:0/2427230179 >> 172.21.15.59:0/2427230179 conn(0x7fdff806bdb0 msgr2=0x7fdff80adb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:35.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.115+0000 7fdffee00640 1 -- 172.21.15.59:0/2427230179 shutdown_connections 2024-05-30T16:55:35.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.115+0000 7fdffee00640 1 -- 172.21.15.59:0/2427230179 wait complete. 2024-05-30T16:55:35.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone86897 2024-05-30T16:55:35.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.459+0000 7f74c6a00640 1 Processor -- start 2024-05-30T16:55:35.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.459+0000 7f74c6a00640 1 -- start start 2024-05-30T16:55:35.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.463+0000 7f74c6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c015b5e0 0x7f74c006ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:35.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.463+0000 7f74c6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74c00adea0 0x7f74c00ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:35.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.463+0000 7f74c6a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c006e660 con 0x7f74c0073540 2024-05-30T16:55:35.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.463+0000 7f74c6a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f74c00ae840 con 0x7f74c00adea0 2024-05-30T16:55:35.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.463+0000 7f74c6a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f74c006fbc0 con 0x7f74c015b5e0 2024-05-30T16:55:35.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.463+0000 7f74c4a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74c00adea0 0x7f74c00ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:35.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.463+0000 7f74c4a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74c00adea0 0x7f74c00ae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44416/0 (socket says 172.21.15.59:44416) 2024-05-30T16:55:35.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.463+0000 7f74c4a00640 1 -- 172.21.15.59:0/2342770418 learned_addr learned my addr 172.21.15.59:0/2342770418 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:35.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.463+0000 7f74c4a00640 1 -- 172.21.15.59:0/2342770418 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c015b5e0 msgr2=0x7f74c006ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:35.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.463+0000 7f74c4a00640 1 --2- 172.21.15.59:0/2342770418 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c015b5e0 0x7f74c006ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:35.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.463+0000 7f74c4a00640 1 -- 172.21.15.59:0/2342770418 >> v1:172.21.15.107:6789/0 conn(0x7f74c0073540 legacy=0x7f74c015f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:35.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.463+0000 7f74c4a00640 1 -- 172.21.15.59:0/2342770418 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c015f0f0 con 0x7f74c00adea0 2024-05-30T16:55:35.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.467+0000 7f74c4a00640 1 --2- 172.21.15.59:0/2342770418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c00adea0 0x7f74c00ae300 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f74b800d150 tx=0x7f74b801e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521140618cefdb76 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:35.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.467+0000 7f74bea00640 1 -- 172.21.15.59:0/2342770418 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b800b2d0 con 0x7f74c00adea0 2024-05-30T16:55:35.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.467+0000 7f74bea00640 1 -- 172.21.15.59:0/2342770418 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b800b470 con 0x7f74c00adea0 2024-05-30T16:55:35.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.467+0000 7f74bea00640 1 -- 172.21.15.59:0/2342770418 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b80a7920 con 0x7f74c00adea0 2024-05-30T16:55:35.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.467+0000 7f74c6a00640 1 -- 172.21.15.59:0/2342770418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c00adea0 msgr2=0x7f74c00ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:35.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.467+0000 7f74c6a00640 1 --2- 172.21.15.59:0/2342770418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c00adea0 0x7f74c00ae300 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f74b800d150 tx=0x7f74b801e980 comp rx=0 tx=0).stop 2024-05-30T16:55:35.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.467+0000 7f74c6a00640 1 -- 172.21.15.59:0/2342770418 shutdown_connections 2024-05-30T16:55:35.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.467+0000 7f74c6a00640 1 --2- 172.21.15.59:0/2342770418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c00adea0 0x7f74c00ae300 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:35.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.467+0000 7f74c6a00640 1 --2- 172.21.15.59:0/2342770418 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c015b5e0 0x7f74c006ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:35.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.467+0000 7f74c6a00640 1 -- 172.21.15.59:0/2342770418 >> 172.21.15.59:0/2342770418 conn(0x7f74c006bdb0 msgr2=0x7f74c006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:35.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.467+0000 7f74c6a00640 1 -- 172.21.15.59:0/2342770418 shutdown_connections 2024-05-30T16:55:35.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.467+0000 7f74c6a00640 1 -- 172.21.15.59:0/2342770418 wait complete. 2024-05-30T16:55:35.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74c6a00640 1 Processor -- start 2024-05-30T16:55:35.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74c6a00640 1 -- start start 2024-05-30T16:55:35.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74c6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c0073540 0x7f74c0149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:35.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74c6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c00adea0 0x7f74c014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:35.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74c6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c014e760 0x7f74c0153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:35.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74c6a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f74c015fe60 con 0x7f74c0073540 2024-05-30T16:55:35.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74c6a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f74c015fce0 con 0x7f74c014e760 2024-05-30T16:55:35.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74c6a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f74c00b33d0 con 0x7f74c00adea0 2024-05-30T16:55:35.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c0073540 0x7f74c0149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c0073540 0x7f74c0149ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44428/0 (socket says 172.21.15.59:44428) 2024-05-30T16:55:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74bfe00640 1 -- 172.21.15.59:0/4173437247 learned_addr learned my addr 172.21.15.59:0/4173437247 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74bfe00640 1 -- 172.21.15.59:0/4173437247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c00adea0 msgr2=0x7f74c014e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74bfe00640 1 --2- 172.21.15.59:0/4173437247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c00adea0 0x7f74c014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74bfe00640 1 -- 172.21.15.59:0/4173437247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c014e760 msgr2=0x7f74c0153590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:55:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74bfe00640 1 --2- 172.21.15.59:0/4173437247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c014e760 0x7f74c0153590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74bfe00640 1 -- 172.21.15.59:0/4173437247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c014ece0 con 0x7f74c0073540 2024-05-30T16:55:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.471+0000 7f74bfe00640 1 --2- 172.21.15.59:0/4173437247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c0073540 0x7f74c0149ab0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00b440 tx=0x7f74ac00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.475+0000 7f74b7e00640 1 -- 172.21.15.59:0/4173437247 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac015020 con 0x7f74c0073540 2024-05-30T16:55:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.475+0000 7f74b7e00640 1 -- 172.21.15.59:0/4173437247 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ac0118b0 con 0x7f74c0073540 2024-05-30T16:55:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.475+0000 7f74c6a00640 1 -- 172.21.15.59:0/4173437247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c014efc0 con 0x7f74c0073540 2024-05-30T16:55:35.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.475+0000 7f74b7e00640 1 -- 172.21.15.59:0/4173437247 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011ca0 con 0x7f74c0073540 2024-05-30T16:55:35.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.475+0000 7f74c6a00640 1 -- 172.21.15.59:0/4173437247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c014f580 con 0x7f74c0073540 2024-05-30T16:55:35.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.475+0000 7f74c6a00640 1 -- 172.21.15.59:0/4173437247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c0068a90 con 0x7f74c0073540 2024-05-30T16:55:35.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.479+0000 7f74b7e00640 1 -- 172.21.15.59:0/4173437247 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 89058+0+0 (secure 0 0 0) 0x7f74ac018020 con 0x7f74c0073540 2024-05-30T16:55:35.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.479+0000 7f74b7e00640 1 --2- 172.21.15.59:0/4173437247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74a0068f50 0x7f74a006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:35.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.479+0000 7f74b7e00640 1 -- 172.21.15.59:0/4173437247 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f74ac0857d0 con 0x7f74c0073540 2024-05-30T16:55:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.487+0000 7f74bf400640 1 --2- 172.21.15.59:0/4173437247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74a0068f50 0x7f74a006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.491+0000 7f74bf400640 1 --2- 172.21.15.59:0/4173437247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74a0068f50 0x7f74a006b410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f74b0007fd0 tx=0x7f74b00079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.491+0000 7f74b7e00640 1 -- 172.21.15.59:0/4173437247 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f74ac01f020 con 0x7f74c0073540 2024-05-30T16:55:35.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:35.919+0000 7f74c6a00640 1 -- 172.21.15.59:0/4173437247 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone86897", "target": ["mon-mgr", ""]}) -- 0x7f74c0164740 con 0x7f74a0068f50 2024-05-30T16:55:36.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.859+0000 7f74b7e00640 1 -- 172.21.15.59:0/4173437247 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f74c0164740 con 0x7f74a0068f50 2024-05-30T16:55:36.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.867+0000 7f74c6a00640 1 -- 172.21.15.59:0/4173437247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74a0068f50 msgr2=0x7f74a006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:36.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.867+0000 7f74c6a00640 1 --2- 172.21.15.59:0/4173437247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74a0068f50 0x7f74a006b410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f74b0007fd0 tx=0x7f74b00079a0 comp rx=0 tx=0).stop 2024-05-30T16:55:36.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.867+0000 7f74c6a00640 1 -- 172.21.15.59:0/4173437247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c0073540 msgr2=0x7f74c0149ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:36.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.867+0000 7f74c6a00640 1 --2- 172.21.15.59:0/4173437247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c0073540 0x7f74c0149ab0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00b440 tx=0x7f74ac00b900 comp rx=0 tx=0).stop 2024-05-30T16:55:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.867+0000 7f74c6a00640 1 -- 172.21.15.59:0/4173437247 shutdown_connections 2024-05-30T16:55:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.867+0000 7f74c6a00640 1 --2- 172.21.15.59:0/4173437247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74a0068f50 0x7f74a006b410 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.867+0000 7f74c6a00640 1 --2- 172.21.15.59:0/4173437247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c014e760 0x7f74c0153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.867+0000 7f74c6a00640 1 --2- 172.21.15.59:0/4173437247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c00adea0 0x7f74c014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.867+0000 7f74c6a00640 1 --2- 172.21.15.59:0/4173437247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c0073540 0x7f74c0149ab0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.867+0000 7f74c6a00640 1 -- 172.21.15.59:0/4173437247 >> 172.21.15.59:0/4173437247 conn(0x7f74c006bdb0 msgr2=0x7f74c00afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.867+0000 7f74c6a00640 1 -- 172.21.15.59:0/4173437247 shutdown_connections 2024-05-30T16:55:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:36.867+0000 7f74c6a00640 1 -- 172.21.15.59:0/4173437247 wait complete. 2024-05-30T16:55:36.907 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:55:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.179+0000 7f3a84e00640 1 Processor -- start 2024-05-30T16:55:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.179+0000 7f3a84e00640 1 -- start start 2024-05-30T16:55:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a84e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a8015eae0 0x7f3a800b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a84e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a800ce330 0x7f3a800ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a84e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8015eec0 con 0x7f3a800d0510 2024-05-30T16:55:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a84e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3a800b0b30 con 0x7f3a800ce330 2024-05-30T16:55:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a84e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3a800cdbc0 con 0x7f3a8015eae0 2024-05-30T16:55:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a7e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a800ce330 0x7f3a800ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a7e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a800ce330 0x7f3a800ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44438/0 (socket says 172.21.15.59:44438) 2024-05-30T16:55:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a7e800640 1 -- 172.21.15.59:0/3950898643 learned_addr learned my addr 172.21.15.59:0/3950898643 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a7de00640 1 --2- 172.21.15.59:0/3950898643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a8015eae0 0x7f3a800b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a7e800640 1 -- 172.21.15.59:0/3950898643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a8015eae0 msgr2=0x7f3a800b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a7e800640 1 --2- 172.21.15.59:0/3950898643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a8015eae0 0x7f3a800b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a7e800640 1 -- 172.21.15.59:0/3950898643 >> v1:172.21.15.107:6789/0 conn(0x7f3a800d0510 legacy=0x7f3a800ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.183+0000 7f3a7e800640 1 -- 172.21.15.59:0/3950898643 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a800d09d0 con 0x7f3a800ce330 2024-05-30T16:55:37.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.191+0000 7f3a7e800640 1 --2- 172.21.15.59:0/3950898643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a800ce330 0x7f3a800ce7c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009e50 tx=0x7f3a7801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c7b6b48a3be2dd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:37.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.191+0000 7f3a7d400640 1 -- 172.21.15.59:0/3950898643 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780a5840 con 0x7f3a800ce330 2024-05-30T16:55:37.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.191+0000 7f3a7d400640 1 -- 172.21.15.59:0/3950898643 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a780a59e0 con 0x7f3a800ce330 2024-05-30T16:55:37.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.191+0000 7f3a7d400640 1 -- 172.21.15.59:0/3950898643 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780a5db0 con 0x7f3a800ce330 2024-05-30T16:55:37.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.191+0000 7f3a84e00640 1 -- 172.21.15.59:0/3950898643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a800ce330 msgr2=0x7f3a800ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:37.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.191+0000 7f3a84e00640 1 --2- 172.21.15.59:0/3950898643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a800ce330 0x7f3a800ce7c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009e50 tx=0x7f3a7801c9c0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.191+0000 7f3a84e00640 1 -- 172.21.15.59:0/3950898643 shutdown_connections 2024-05-30T16:55:37.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.195+0000 7f3a84e00640 1 --2- 172.21.15.59:0/3950898643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a800ce330 0x7f3a800ce7c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.195+0000 7f3a84e00640 1 --2- 172.21.15.59:0/3950898643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a8015eae0 0x7f3a800b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.195+0000 7f3a84e00640 1 -- 172.21.15.59:0/3950898643 >> 172.21.15.59:0/3950898643 conn(0x7f3a800b2f50 msgr2=0x7f3a800b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:37.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.195+0000 7f3a84e00640 1 -- 172.21.15.59:0/3950898643 shutdown_connections 2024-05-30T16:55:37.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.195+0000 7f3a84e00640 1 -- 172.21.15.59:0/3950898643 wait complete. 2024-05-30T16:55:37.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.195+0000 7f3a84e00640 1 Processor -- start 2024-05-30T16:55:37.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.195+0000 7f3a84e00640 1 -- start start 2024-05-30T16:55:37.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a84e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a800ce330 0x7f3a8015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:37.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a84e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a800d0510 0x7f3a80155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:37.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a84e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a8015eae0 0x7f3a8015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:37.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a84e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3a800ae940 con 0x7f3a800d0510 2024-05-30T16:55:37.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a84e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3a800b3c20 con 0x7f3a800ce330 2024-05-30T16:55:37.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a84e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3a80155890 con 0x7f3a8015eae0 2024-05-30T16:55:37.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a77e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a800d0510 0x7f3a80155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:37.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a77e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a800d0510 0x7f3a80155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44440/0 (socket says 172.21.15.59:44440) 2024-05-30T16:55:37.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a77e00640 1 -- 172.21.15.59:0/3148551618 learned_addr learned my addr 172.21.15.59:0/3148551618 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:37.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a7e800640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a8015eae0 0x7f3a8015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a77e00640 1 -- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a8015eae0 msgr2=0x7f3a8015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a77e00640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a8015eae0 0x7f3a8015aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a77e00640 1 -- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a800ce330 msgr2=0x7f3a8015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a77e00640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a800ce330 0x7f3a8015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a77e00640 1 -- 172.21.15.59:0/3148551618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8015b4a0 con 0x7f3a800d0510 2024-05-30T16:55:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a77e00640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a800d0510 0x7f3a80155350 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c450 tx=0x7f3a6800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a76000640 1 -- 172.21.15.59:0/3148551618 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a68012830 con 0x7f3a800d0510 2024-05-30T16:55:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a76000640 1 -- 172.21.15.59:0/3148551618 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a68017070 con 0x7f3a800d0510 2024-05-30T16:55:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a76000640 1 -- 172.21.15.59:0/3148551618 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a68012c30 con 0x7f3a800d0510 2024-05-30T16:55:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a84e00640 1 -- 172.21.15.59:0/3148551618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8015b780 con 0x7f3a800d0510 2024-05-30T16:55:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.199+0000 7f3a84e00640 1 -- 172.21.15.59:0/3148551618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8015bd40 con 0x7f3a800d0510 2024-05-30T16:55:37.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.203+0000 7f3a84e00640 1 -- 172.21.15.59:0/3148551618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a800691a0 con 0x7f3a800d0510 2024-05-30T16:55:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.207+0000 7f3a76000640 1 -- 172.21.15.59:0/3148551618 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 89058+0+0 (secure 0 0 0) 0x7f3a6801c460 con 0x7f3a800d0510 2024-05-30T16:55:37.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.207+0000 7f3a76000640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3a5c068f50 0x7f3a5c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:37.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.207+0000 7f3a76000640 1 -- 172.21.15.59:0/3148551618 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f3a68085f10 con 0x7f3a800d0510 2024-05-30T16:55:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.211+0000 7f3a7de00640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3a5c068f50 0x7f3a5c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:37.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.215+0000 7f3a76000640 1 -- 172.21.15.59:0/3148551618 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3a68057d00 con 0x7f3a800d0510 2024-05-30T16:55:37.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.223+0000 7f3a7de00640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3a5c068f50 0x7f3a5c06b410 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3a70006aa0 tx=0x7f3a70006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.603+0000 7f3a84e00640 1 -- 172.21.15.59:0/3148551618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3a80156100 con 0x7f3a800d0510 2024-05-30T16:55:37.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.603+0000 7f3a76000640 1 -- 172.21.15.59:0/3148551618 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2398 (secure 0 0 0) 0x7f3a68057600 con 0x7f3a800d0510 2024-05-30T16:55:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:55:37.609 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:55:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 417, 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:55:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1547, 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 6342902638, 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 11688087552, 2024-05-30T16:55:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 761406025728, 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 258754347, 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 267865189, 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 63, 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 73 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 35, 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4, 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 4, 2024-05-30T16:55:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5865 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:55:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 8, 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:53:19.132075+0000", 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "392479d8-0f9b-4c11-a8b5-270f230c1c28": { 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "5 ongoing+pending clones; Avg progress is 28.75% (0s)\n [========....................] ", 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.28749999403953552, 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "a9414ee5-8d1d-4667-a8df-31a15a5bc1b0": { 2024-05-30T16:55:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "4 ongoing clones; Avg progress is 22.982% (6s)\n [======......................] (remaining: 22s)", 2024-05-30T16:55:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.22981999814510345, 2024-05-30T16:55:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:55:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:37.616 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:55:37.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.607+0000 7f3a84e00640 1 -- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3a5c068f50 msgr2=0x7f3a5c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:37.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.607+0000 7f3a84e00640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3a5c068f50 0x7f3a5c06b410 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3a70006aa0 tx=0x7f3a70006a30 comp rx=0 tx=0).stop 2024-05-30T16:55:37.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.607+0000 7f3a84e00640 1 -- 172.21.15.59:0/3148551618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a800d0510 msgr2=0x7f3a80155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:37.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.607+0000 7f3a84e00640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a800d0510 0x7f3a80155350 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c450 tx=0x7f3a6800c910 comp rx=0 tx=0).stop 2024-05-30T16:55:37.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.607+0000 7f3a84e00640 1 -- 172.21.15.59:0/3148551618 shutdown_connections 2024-05-30T16:55:37.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.607+0000 7f3a84e00640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3a5c068f50 0x7f3a5c06b410 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.607+0000 7f3a84e00640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a8015eae0 0x7f3a8015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.607+0000 7f3a84e00640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a800d0510 0x7f3a80155350 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.607+0000 7f3a84e00640 1 --2- 172.21.15.59:0/3148551618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a800ce330 0x7f3a8015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.607+0000 7f3a84e00640 1 -- 172.21.15.59:0/3148551618 >> 172.21.15.59:0/3148551618 conn(0x7f3a800b2f50 msgr2=0x7f3a800aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:37.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.607+0000 7f3a84e00640 1 -- 172.21.15.59:0/3148551618 shutdown_connections 2024-05-30T16:55:37.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.607+0000 7f3a84e00640 1 -- 172.21.15.59:0/3148551618 wait complete. 2024-05-30T16:55:37.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone86891 2024-05-30T16:55:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.975+0000 7f54e9a00640 1 Processor -- start 2024-05-30T16:55:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e9a00640 1 -- start start 2024-05-30T16:55:37.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e9a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54e4159100 0x7f54e406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:37.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e9a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54e415c010 0x7f54e415c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:37.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e9a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54e40b52d0 con 0x7f54e40b44e0 2024-05-30T16:55:37.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e9a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f54e40b4a30 con 0x7f54e4159100 2024-05-30T16:55:37.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e9a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f54e40b4d10 con 0x7f54e415c010 2024-05-30T16:55:37.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54e4159100 0x7f54e406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:37.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54e4159100 0x7f54e406e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44450/0 (socket says 172.21.15.59:44450) 2024-05-30T16:55:37.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e2a00640 1 -- 172.21.15.59:0/520891075 learned_addr learned my addr 172.21.15.59:0/520891075 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:37.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e2a00640 1 -- 172.21.15.59:0/520891075 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54e415c010 msgr2=0x7f54e415c480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:55:37.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e2a00640 1 --2- 172.21.15.59:0/520891075 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54e415c010 0x7f54e415c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e2a00640 1 -- 172.21.15.59:0/520891075 >> v1:172.21.15.59:6789/0 conn(0x7f54e40b44e0 legacy=0x7f54e415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:37.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.979+0000 7f54e2a00640 1 -- 172.21.15.59:0/520891075 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e40b4ff0 con 0x7f54e4159100 2024-05-30T16:55:37.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.987+0000 7f54e2a00640 1 --2- 172.21.15.59:0/520891075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54e4159100 0x7f54e406e590 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009870 tx=0x7f54d401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38935197bd92167 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:37.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.987+0000 7f54e2000640 1 -- 172.21.15.59:0/520891075 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d40aa620 con 0x7f54e4159100 2024-05-30T16:55:37.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.987+0000 7f54e2000640 1 -- 172.21.15.59:0/520891075 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d40af070 con 0x7f54e4159100 2024-05-30T16:55:37.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.987+0000 7f54e2000640 1 -- 172.21.15.59:0/520891075 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d40aa9e0 con 0x7f54e4159100 2024-05-30T16:55:37.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.991+0000 7f54e9a00640 1 -- 172.21.15.59:0/520891075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54e4159100 msgr2=0x7f54e406e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:37.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.991+0000 7f54e9a00640 1 --2- 172.21.15.59:0/520891075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54e4159100 0x7f54e406e590 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009870 tx=0x7f54d401c4c0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.995+0000 7f54e9a00640 1 -- 172.21.15.59:0/520891075 shutdown_connections 2024-05-30T16:55:37.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.995+0000 7f54e9a00640 1 --2- 172.21.15.59:0/520891075 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54e415c010 0x7f54e415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.995+0000 7f54e9a00640 1 --2- 172.21.15.59:0/520891075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54e4159100 0x7f54e406e590 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:37.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.995+0000 7f54e9a00640 1 -- 172.21.15.59:0/520891075 >> 172.21.15.59:0/520891075 conn(0x7f54e406bdb0 msgr2=0x7f54e406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:38.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.999+0000 7f54e9a00640 1 -- 172.21.15.59:0/520891075 shutdown_connections 2024-05-30T16:55:38.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:37.999+0000 7f54e9a00640 1 -- 172.21.15.59:0/520891075 wait complete. 2024-05-30T16:55:38.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.003+0000 7f54e9a00640 1 Processor -- start 2024-05-30T16:55:38.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.007+0000 7f54e9a00640 1 -- start start 2024-05-30T16:55:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.007+0000 7f54e9a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e40b44e0 0x7f54e41fca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54e9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54e4159100 0x7f54e415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54e9a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54e415c010 0x7f54e415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54e9a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f54e41662b0 con 0x7f54e4159100 2024-05-30T16:55:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54e9a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f54e4166130 con 0x7f54e40b44e0 2024-05-30T16:55:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54e9a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f54e4166430 con 0x7f54e415c010 2024-05-30T16:55:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54da000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54e4159100 0x7f54e415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54da000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54e4159100 0x7f54e415dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44464/0 (socket says 172.21.15.59:44464) 2024-05-30T16:55:38.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54da000640 1 -- 172.21.15.59:0/1618009362 learned_addr learned my addr 172.21.15.59:0/1618009362 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:38.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54da000640 1 -- 172.21.15.59:0/1618009362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54e415c010 msgr2=0x7f54e415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:38.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54da000640 1 --2- 172.21.15.59:0/1618009362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54e415c010 0x7f54e415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:38.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54da000640 1 -- 172.21.15.59:0/1618009362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e40b44e0 msgr2=0x7f54e41fca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:38.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54da000640 1 --2- 172.21.15.59:0/1618009362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e40b44e0 0x7f54e41fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:38.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54da000640 1 -- 172.21.15.59:0/1618009362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e41529e0 con 0x7f54e4159100 2024-05-30T16:55:38.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.011+0000 7f54da000640 1 --2- 172.21.15.59:0/1618009362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54e4159100 0x7f54e415dd70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00c420 tx=0x7f54cc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:38.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.015+0000 7f54db400640 1 -- 172.21.15.59:0/1618009362 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0052d0 con 0x7f54e4159100 2024-05-30T16:55:38.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.015+0000 7f54db400640 1 -- 172.21.15.59:0/1618009362 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54cc005470 con 0x7f54e4159100 2024-05-30T16:55:38.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.015+0000 7f54db400640 1 -- 172.21.15.59:0/1618009362 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc007260 con 0x7f54e4159100 2024-05-30T16:55:38.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.015+0000 7f54e9a00640 1 -- 172.21.15.59:0/1618009362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e4152cc0 con 0x7f54e4159100 2024-05-30T16:55:38.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.015+0000 7f54e9a00640 1 -- 172.21.15.59:0/1618009362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e4153280 con 0x7f54e4159100 2024-05-30T16:55:38.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.015+0000 7f54e9a00640 1 -- 172.21.15.59:0/1618009362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54bc0052a0 con 0x7f54e4159100 2024-05-30T16:55:38.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.019+0000 7f54db400640 1 -- 172.21.15.59:0/1618009362 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 89058+0+0 (secure 0 0 0) 0x7f54cc007400 con 0x7f54e4159100 2024-05-30T16:55:38.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.019+0000 7f54db400640 1 --2- 172.21.15.59:0/1618009362 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f54c0068f50 0x7f54c006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:38.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.023+0000 7f54db400640 1 -- 172.21.15.59:0/1618009362 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f54cc084af0 con 0x7f54e4159100 2024-05-30T16:55:38.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.027+0000 7f54db400640 1 -- 172.21.15.59:0/1618009362 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f54cc056800 con 0x7f54e4159100 2024-05-30T16:55:38.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.063+0000 7f54e2a00640 1 --2- 172.21.15.59:0/1618009362 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f54c0068f50 0x7f54c006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:38.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.135+0000 7f54e2a00640 1 --2- 172.21.15.59:0/1618009362 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f54c0068f50 0x7f54c006b410 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f54d40ae000 tx=0x7f54d4004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:38.359+0000 7f54e9a00640 1 -- 172.21.15.59:0/1618009362 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone86891", "target": ["mon-mgr", ""]}) -- 0x7f54bc000bd0 con 0x7f54c0068f50 2024-05-30T16:55:38.515 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:38.512+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:38.515 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:38.512+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:38.516 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:38.512+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:38.516 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:38.512+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:38.516 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:55:38.512+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:55:39.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:39.579+0000 7f54db400640 1 -- 172.21.15.59:0/1618009362 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7f54cc052770 con 0x7f54e4159100 2024-05-30T16:55:40.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.239+0000 7f54db400640 1 -- 172.21.15.59:0/1618009362 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f54bc000bd0 con 0x7f54c0068f50 2024-05-30T16:55:40.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.247+0000 7f54e9a00640 1 -- 172.21.15.59:0/1618009362 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f54c0068f50 msgr2=0x7f54c006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:40.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.247+0000 7f54e9a00640 1 --2- 172.21.15.59:0/1618009362 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f54c0068f50 0x7f54c006b410 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f54d40ae000 tx=0x7f54d4004740 comp rx=0 tx=0).stop 2024-05-30T16:55:40.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.247+0000 7f54e9a00640 1 -- 172.21.15.59:0/1618009362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54e4159100 msgr2=0x7f54e415dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:40.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.247+0000 7f54e9a00640 1 --2- 172.21.15.59:0/1618009362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54e4159100 0x7f54e415dd70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00c420 tx=0x7f54cc00c8e0 comp rx=0 tx=0).stop 2024-05-30T16:55:40.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.247+0000 7f54e9a00640 1 -- 172.21.15.59:0/1618009362 shutdown_connections 2024-05-30T16:55:40.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.247+0000 7f54e9a00640 1 --2- 172.21.15.59:0/1618009362 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f54c0068f50 0x7f54c006b410 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:40.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.247+0000 7f54e9a00640 1 --2- 172.21.15.59:0/1618009362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54e415c010 0x7f54e415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:40.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.247+0000 7f54e9a00640 1 --2- 172.21.15.59:0/1618009362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54e4159100 0x7f54e415dd70 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:40.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.247+0000 7f54e9a00640 1 --2- 172.21.15.59:0/1618009362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e40b44e0 0x7f54e41fca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:40.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.247+0000 7f54e9a00640 1 -- 172.21.15.59:0/1618009362 >> 172.21.15.59:0/1618009362 conn(0x7f54e406bdb0 msgr2=0x7f54e4150bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:40.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.247+0000 7f54e9a00640 1 -- 172.21.15.59:0/1618009362 shutdown_connections 2024-05-30T16:55:40.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.247+0000 7f54e9a00640 1 -- 172.21.15.59:0/1618009362 wait complete. 2024-05-30T16:55:40.298 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone86892 2024-05-30T16:55:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.575+0000 7f6ff9000640 1 Processor -- start 2024-05-30T16:55:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.575+0000 7f6ff9000640 1 -- start start 2024-05-30T16:55:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff9000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ff415cfa0 0x7f6ff406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff9000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff40af900 0x7f6ff406f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff9000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff40cacd0 con 0x7f6ff40b2950 2024-05-30T16:55:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff9000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff406c780 con 0x7f6ff415cfa0 2024-05-30T16:55:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff9000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff40af530 con 0x7f6ff40af900 2024-05-30T16:55:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff3400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ff415cfa0 0x7f6ff406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff3400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ff415cfa0 0x7f6ff406f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44470/0 (socket says 172.21.15.59:44470) 2024-05-30T16:55:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff3400640 1 -- 172.21.15.59:0/2234953036 learned_addr learned my addr 172.21.15.59:0/2234953036 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:40.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff3e00640 1 --2- 172.21.15.59:0/2234953036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff40af900 0x7f6ff406f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:40.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff3400640 1 -- 172.21.15.59:0/2234953036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff40af900 msgr2=0x7f6ff406f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:40.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff3400640 1 --2- 172.21.15.59:0/2234953036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff40af900 0x7f6ff406f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:40.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff3400640 1 -- 172.21.15.59:0/2234953036 >> v1:172.21.15.107:6789/0 conn(0x7f6ff40b2950 legacy=0x7f6ff406dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:40.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.579+0000 7f6ff3400640 1 -- 172.21.15.59:0/2234953036 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff40ca9f0 con 0x7f6ff415cfa0 2024-05-30T16:55:40.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.583+0000 7f6ff3400640 1 --2- 172.21.15.59:0/2234953036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff415cfa0 0x7f6ff406f1a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009870 tx=0x7f6fe401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91c8e03beeff4b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:40.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.587+0000 7f6ff2000640 1 -- 172.21.15.59:0/2234953036 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40b0070 con 0x7f6ff415cfa0 2024-05-30T16:55:40.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.587+0000 7f6ff2000640 1 -- 172.21.15.59:0/2234953036 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe40ab600 con 0x7f6ff415cfa0 2024-05-30T16:55:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.587+0000 7f6ff2000640 1 -- 172.21.15.59:0/2234953036 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40ab9d0 con 0x7f6ff415cfa0 2024-05-30T16:55:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.587+0000 7f6ff9000640 1 -- 172.21.15.59:0/2234953036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff415cfa0 msgr2=0x7f6ff406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.587+0000 7f6ff9000640 1 --2- 172.21.15.59:0/2234953036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff415cfa0 0x7f6ff406f1a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009870 tx=0x7f6fe401c520 comp rx=0 tx=0).stop 2024-05-30T16:55:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.587+0000 7f6ff9000640 1 -- 172.21.15.59:0/2234953036 shutdown_connections 2024-05-30T16:55:40.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.587+0000 7f6ff9000640 1 --2- 172.21.15.59:0/2234953036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff40af900 0x7f6ff406f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:40.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.587+0000 7f6ff9000640 1 --2- 172.21.15.59:0/2234953036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff415cfa0 0x7f6ff406f1a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:40.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.587+0000 7f6ff9000640 1 -- 172.21.15.59:0/2234953036 >> 172.21.15.59:0/2234953036 conn(0x7f6ff40b1e60 msgr2=0x7f6ff40b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:40.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.591+0000 7f6ff9000640 1 -- 172.21.15.59:0/2234953036 shutdown_connections 2024-05-30T16:55:40.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.591+0000 7f6ff9000640 1 -- 172.21.15.59:0/2234953036 wait complete. 2024-05-30T16:55:40.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff9000640 1 Processor -- start 2024-05-30T16:55:40.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff9000640 1 -- start start 2024-05-30T16:55:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff40af900 0x7f6ff40addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff9000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff40b2950 0x7f6ff41495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff9000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff415cfa0 0x7f6ff4149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff9000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff415d500 con 0x7f6ff40af900 2024-05-30T16:55:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff9000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff415d380 con 0x7f6ff415cfa0 2024-05-30T16:55:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff9000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff41692b0 con 0x7f6ff40b2950 2024-05-30T16:55:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff40af900 0x7f6ff40addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff40af900 0x7f6ff40addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44484/0 (socket says 172.21.15.59:44484) 2024-05-30T16:55:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff3400640 1 -- 172.21.15.59:0/3745537517 learned_addr learned my addr 172.21.15.59:0/3745537517 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff3e00640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff415cfa0 0x7f6ff4149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff3400640 1 -- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff40b2950 msgr2=0x7f6ff41495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff3400640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff40b2950 0x7f6ff41495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff3400640 1 -- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff415cfa0 msgr2=0x7f6ff4149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff3400640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff415cfa0 0x7f6ff4149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff3400640 1 -- 172.21.15.59:0/3745537517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff4166ee0 con 0x7f6ff40af900 2024-05-30T16:55:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff3e00640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff415cfa0 0x7f6ff4149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:55:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.595+0000 7f6ff3400640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff40af900 0x7f6ff40addc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40ae040 tx=0x7f6fe401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.599+0000 7f6feb400640 1 -- 172.21.15.59:0/3745537517 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40b0040 con 0x7f6ff40af900 2024-05-30T16:55:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.599+0000 7f6feb400640 1 -- 172.21.15.59:0/3745537517 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe40bc070 con 0x7f6ff40af900 2024-05-30T16:55:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.599+0000 7f6ff9000640 1 -- 172.21.15.59:0/3745537517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff414a0c0 con 0x7f6ff40af900 2024-05-30T16:55:40.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.599+0000 7f6feb400640 1 -- 172.21.15.59:0/3745537517 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40b6860 con 0x7f6ff40af900 2024-05-30T16:55:40.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.599+0000 7f6ff9000640 1 -- 172.21.15.59:0/3745537517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff414aba0 con 0x7f6ff40af900 2024-05-30T16:55:40.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.599+0000 7f6ff9000640 1 -- 172.21.15.59:0/3745537517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff4068a90 con 0x7f6ff40af900 2024-05-30T16:55:40.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.599+0000 7f6feb400640 1 -- 172.21.15.59:0/3745537517 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7f6fe40ab4c0 con 0x7f6ff40af900 2024-05-30T16:55:40.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.603+0000 7f6feb400640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6fd4068fe0 0x7f6fd406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:40.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.603+0000 7f6feb400640 1 -- 172.21.15.59:0/3745537517 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f6fe411f6f0 con 0x7f6ff40af900 2024-05-30T16:55:40.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.607+0000 7f6feb400640 1 -- 172.21.15.59:0/3745537517 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6fe4016110 con 0x7f6ff40af900 2024-05-30T16:55:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.611+0000 7f6ff2a00640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6fd4068fe0 0x7f6fd406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:40.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:40.615+0000 7f6ff2a00640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6fd4068fe0 0x7f6fd406b4a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4154a60 tx=0x7f6fe0006bb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.023+0000 7f6ff9000640 1 -- 172.21.15.59:0/3745537517 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone86892", "target": ["mon-mgr", ""]}) -- 0x7f6ff406cc30 con 0x7f6fd4068fe0 2024-05-30T16:55:41.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.659+0000 7f6feb400640 1 -- 172.21.15.59:0/3745537517 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6ff406cc30 con 0x7f6fd4068fe0 2024-05-30T16:55:41.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.663+0000 7f6ff9000640 1 -- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6fd4068fe0 msgr2=0x7f6fd406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:41.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.663+0000 7f6ff9000640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6fd4068fe0 0x7f6fd406b4a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4154a60 tx=0x7f6fe0006bb0 comp rx=0 tx=0).stop 2024-05-30T16:55:41.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.663+0000 7f6ff9000640 1 -- 172.21.15.59:0/3745537517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff40af900 msgr2=0x7f6ff40addc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.663+0000 7f6ff9000640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff40af900 0x7f6ff40addc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40ae040 tx=0x7f6fe401ad60 comp rx=0 tx=0).stop 2024-05-30T16:55:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.663+0000 7f6ff9000640 1 -- 172.21.15.59:0/3745537517 shutdown_connections 2024-05-30T16:55:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.663+0000 7f6ff9000640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6fd4068fe0 0x7f6fd406b4a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.663+0000 7f6ff9000640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff415cfa0 0x7f6ff4149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.663+0000 7f6ff9000640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff40b2950 0x7f6ff41495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.663+0000 7f6ff9000640 1 --2- 172.21.15.59:0/3745537517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff40af900 0x7f6ff40addc0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.663+0000 7f6ff9000640 1 -- 172.21.15.59:0/3745537517 >> 172.21.15.59:0/3745537517 conn(0x7f6ff40b1e60 msgr2=0x7f6ff40d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.663+0000 7f6ff9000640 1 -- 172.21.15.59:0/3745537517 shutdown_connections 2024-05-30T16:55:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.663+0000 7f6ff9000640 1 -- 172.21.15.59:0/3745537517 wait complete. 2024-05-30T16:55:41.714 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone86893 2024-05-30T16:55:41.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.971+0000 7fb5f0800640 1 Processor -- start 2024-05-30T16:55:41.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.971+0000 7fb5f0800640 1 -- start start 2024-05-30T16:55:41.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.971+0000 7fb5f0800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb5e8155a10 0x7fb5e815c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:41.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.971+0000 7fb5f0800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5e806d0d0 0x7fb5e80ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:41.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.971+0000 7fb5f0800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e8073820 con 0x7fb5e80d02e0 2024-05-30T16:55:41.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.971+0000 7fb5f0800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb5e806f430 con 0x7fb5e806d0d0 2024-05-30T16:55:41.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.971+0000 7fb5f0800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb5e806f710 con 0x7fb5e8155a10 2024-05-30T16:55:41.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.975+0000 7fb5ed400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb5e80d02e0 0x7fb5e806c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42906/0 (socket says 172.21.15.59:42906) 2024-05-30T16:55:41.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.975+0000 7fb5ed400640 1 -- 172.21.15.59:0/2942695598 learned_addr learned my addr 172.21.15.59:0/2942695598 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:55:41.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.975+0000 7fb5ee800640 1 --2- 172.21.15.59:0/2942695598 >> v2:172.21.15.59:3300/0 conn(0x7fb5e806d0d0 0x7fb5e80ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:41.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.975+0000 7fb5ede00640 1 --2- 172.21.15.59:0/2942695598 >> v2:172.21.15.107:3300/0 conn(0x7fb5e8155a10 0x7fb5e815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:41.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.975+0000 7fb5eca00640 1 -- 172.21.15.59:0/2942695598 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 717140375 0 0) 0x7fb5e8073820 con 0x7fb5e80d02e0 2024-05-30T16:55:41.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.975+0000 7fb5eca00640 1 -- 172.21.15.59:0/2942695598 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5d0005740 con 0x7fb5e80d02e0 2024-05-30T16:55:41.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.975+0000 7fb5ee800640 1 -- 172.21.15.59:0/2942695598 >> v2:172.21.15.107:3300/0 conn(0x7fb5e8155a10 msgr2=0x7fb5e815c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:41.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.975+0000 7fb5ee800640 1 --2- 172.21.15.59:0/2942695598 >> v2:172.21.15.107:3300/0 conn(0x7fb5e8155a10 0x7fb5e815c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:41.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.975+0000 7fb5ee800640 1 -- 172.21.15.59:0/2942695598 >> v1:172.21.15.59:6789/0 conn(0x7fb5e80d02e0 legacy=0x7fb5e806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:41.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.975+0000 7fb5ee800640 1 -- 172.21.15.59:0/2942695598 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e806f9f0 con 0x7fb5e806d0d0 2024-05-30T16:55:41.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.979+0000 7fb5ee800640 1 --2- 172.21.15.59:0/2942695598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e806d0d0 0x7fb5e80ce740 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8071cd0 tx=0x7fb5e401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6866aa9436f8be1d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:41.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.979+0000 7fb5eca00640 1 -- 172.21.15.59:0/2942695598 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40b2070 con 0x7fb5e806d0d0 2024-05-30T16:55:41.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.979+0000 7fb5eca00640 1 -- 172.21.15.59:0/2942695598 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e40a5760 con 0x7fb5e806d0d0 2024-05-30T16:55:41.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.979+0000 7fb5eca00640 1 -- 172.21.15.59:0/2942695598 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40a5b10 con 0x7fb5e806d0d0 2024-05-30T16:55:41.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.979+0000 7fb5f0800640 1 -- 172.21.15.59:0/2942695598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e806d0d0 msgr2=0x7fb5e80ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:41.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.979+0000 7fb5f0800640 1 --2- 172.21.15.59:0/2942695598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e806d0d0 0x7fb5e80ce740 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8071cd0 tx=0x7fb5e401c8a0 comp rx=0 tx=0).stop 2024-05-30T16:55:41.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.983+0000 7fb5f0800640 1 -- 172.21.15.59:0/2942695598 shutdown_connections 2024-05-30T16:55:41.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.983+0000 7fb5f0800640 1 --2- 172.21.15.59:0/2942695598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e806d0d0 0x7fb5e80ce740 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:41.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.983+0000 7fb5f0800640 1 --2- 172.21.15.59:0/2942695598 >> v2:172.21.15.107:3300/0 conn(0x7fb5e8155a10 0x7fb5e815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:41.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.983+0000 7fb5f0800640 1 -- 172.21.15.59:0/2942695598 >> 172.21.15.59:0/2942695598 conn(0x7fb5e80725a0 msgr2=0x7fb5e80729b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:41.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.987+0000 7fb5f0800640 1 -- 172.21.15.59:0/2942695598 shutdown_connections 2024-05-30T16:55:41.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.987+0000 7fb5f0800640 1 -- 172.21.15.59:0/2942695598 wait complete. 2024-05-30T16:55:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.991+0000 7fb5f0800640 1 Processor -- start 2024-05-30T16:55:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.991+0000 7fb5f0800640 1 -- start start 2024-05-30T16:55:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.991+0000 7fb5f0800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e806d0d0 0x7fb5e814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.991+0000 7fb5f0800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e80d02e0 0x7fb5e814a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.991+0000 7fb5f0800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb5e8155a10 0x7fb5e814ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.991+0000 7fb5f0800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e80cf820 con 0x7fb5e80d02e0 2024-05-30T16:55:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.991+0000 7fb5f0800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e80cf6a0 con 0x7fb5e806d0d0 2024-05-30T16:55:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.991+0000 7fb5f0800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e80cf9a0 con 0x7fb5e8155a10 2024-05-30T16:55:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.991+0000 7fb5ed400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e80d02e0 0x7fb5e814a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5ed400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e80d02e0 0x7fb5e814a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50496/0 (socket says 172.21.15.59:50496) 2024-05-30T16:55:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5ed400640 1 -- 172.21.15.59:0/770969867 learned_addr learned my addr 172.21.15.59:0/770969867 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5ed400640 1 -- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb5e8155a10 msgr2=0x7fb5e814ae90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:55:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5ed400640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb5e8155a10 0x7fb5e814ae90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5ed400640 1 -- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e806d0d0 msgr2=0x7fb5e814e8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:55:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5ede00640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e806d0d0 0x7fb5e814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5ed400640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e806d0d0 0x7fb5e814e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5ed400640 1 -- 172.21.15.59:0/770969867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e81fc5a0 con 0x7fb5e80d02e0 2024-05-30T16:55:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5ed400640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e80d02e0 0x7fb5e814a950 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0010f0 tx=0x7fb5dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5e2000640 1 -- 172.21.15.59:0/770969867 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc017070 con 0x7fb5e80d02e0 2024-05-30T16:55:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5e2000640 1 -- 172.21.15.59:0/770969867 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5dc005d10 con 0x7fb5e80d02e0 2024-05-30T16:55:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5e2000640 1 -- 172.21.15.59:0/770969867 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc007310 con 0x7fb5e80d02e0 2024-05-30T16:55:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5f0800640 1 -- 172.21.15.59:0/770969867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e81fb7e0 con 0x7fb5e80d02e0 2024-05-30T16:55:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.995+0000 7fb5f0800640 1 -- 172.21.15.59:0/770969867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e81fbda0 con 0x7fb5e80d02e0 2024-05-30T16:55:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.999+0000 7fb5f0800640 1 -- 172.21.15.59:0/770969867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c40052a0 con 0x7fb5e80d02e0 2024-05-30T16:55:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:41.999+0000 7fb5e2000640 1 -- 172.21.15.59:0/770969867 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7fb5dc01a070 con 0x7fb5e80d02e0 2024-05-30T16:55:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:42.003+0000 7fb5e2000640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb5cc068fe0 0x7fb5cc06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:42.003+0000 7fb5e2000640 1 -- 172.21.15.59:0/770969867 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fb5dc084f70 con 0x7fb5e80d02e0 2024-05-30T16:55:42.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:42.007+0000 7fb5e2000640 1 -- 172.21.15.59:0/770969867 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb5dc021020 con 0x7fb5e80d02e0 2024-05-30T16:55:42.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:42.019+0000 7fb5ede00640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb5cc068fe0 0x7fb5cc06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:42.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:42.023+0000 7fb5ede00640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb5cc068fe0 0x7fb5cc06b4a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5e815b6a0 tx=0x7fb5d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:42.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:42.335+0000 7fb5f0800640 1 -- 172.21.15.59:0/770969867 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone86893", "target": ["mon-mgr", ""]}) -- 0x7fb5c4000bd0 con 0x7fb5cc068fe0 2024-05-30T16:55:43.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.307+0000 7fb5e2000640 1 -- 172.21.15.59:0/770969867 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb5c4000bd0 con 0x7fb5cc068fe0 2024-05-30T16:55:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.311+0000 7fb5f0800640 1 -- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb5cc068fe0 msgr2=0x7fb5cc06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.311+0000 7fb5f0800640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb5cc068fe0 0x7fb5cc06b4a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5e815b6a0 tx=0x7fb5d8008040 comp rx=0 tx=0).stop 2024-05-30T16:55:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.311+0000 7fb5f0800640 1 -- 172.21.15.59:0/770969867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e80d02e0 msgr2=0x7fb5e814a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.311+0000 7fb5f0800640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e80d02e0 0x7fb5e814a950 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0010f0 tx=0x7fb5dc00c8f0 comp rx=0 tx=0).stop 2024-05-30T16:55:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.315+0000 7fb5f0800640 1 -- 172.21.15.59:0/770969867 shutdown_connections 2024-05-30T16:55:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.315+0000 7fb5f0800640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb5cc068fe0 0x7fb5cc06b4a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.315+0000 7fb5f0800640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb5e8155a10 0x7fb5e814ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.315+0000 7fb5f0800640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e80d02e0 0x7fb5e814a950 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.315+0000 7fb5f0800640 1 --2- 172.21.15.59:0/770969867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e806d0d0 0x7fb5e814e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.315+0000 7fb5f0800640 1 -- 172.21.15.59:0/770969867 >> 172.21.15.59:0/770969867 conn(0x7fb5e80725a0 msgr2=0x7fb5e80b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.315+0000 7fb5f0800640 1 -- 172.21.15.59:0/770969867 shutdown_connections 2024-05-30T16:55:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.315+0000 7fb5f0800640 1 -- 172.21.15.59:0/770969867 wait complete. 2024-05-30T16:55:43.368 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone86894 2024-05-30T16:55:43.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.659+0000 7f8b7ee00640 1 Processor -- start 2024-05-30T16:55:43.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.659+0000 7f8b7ee00640 1 -- start start 2024-05-30T16:55:43.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.659+0000 7f8b7ee00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8b78162780 0x7f8b78162b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:43.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.659+0000 7f8b7ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b780b39e0 0x7f8b780d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:43.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.659+0000 7f8b7ee00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b780b3fc0 con 0x7f8b780d0660 2024-05-30T16:55:43.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.659+0000 7f8b7ee00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8b780d1000 con 0x7f8b78162780 2024-05-30T16:55:43.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.659+0000 7f8b7ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8b780b42a0 con 0x7f8b780b39e0 2024-05-30T16:55:43.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.663+0000 7f8b77400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8b780d0660 0x7f8b780b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42918/0 (socket says 172.21.15.59:42918) 2024-05-30T16:55:43.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.663+0000 7f8b77400640 1 -- 172.21.15.59:0/2283893866 learned_addr learned my addr 172.21.15.59:0/2283893866 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:55:43.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.663+0000 7f8b77e00640 1 --2- 172.21.15.59:0/2283893866 >> v2:172.21.15.107:3300/0 conn(0x7f8b78162780 0x7f8b78162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:43.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.663+0000 7f8b7ce00640 1 --2- 172.21.15.59:0/2283893866 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b780b39e0 0x7f8b780d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:43.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.663+0000 7f8b77e00640 1 -- 172.21.15.59:0/2283893866 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b780b39e0 msgr2=0x7f8b780d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:43.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.663+0000 7f8b77e00640 1 --2- 172.21.15.59:0/2283893866 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b780b39e0 0x7f8b780d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:43.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.663+0000 7f8b77e00640 1 -- 172.21.15.59:0/2283893866 >> v1:172.21.15.59:6789/0 conn(0x7f8b780d0660 legacy=0x7f8b780b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:43.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.663+0000 7f8b77e00640 1 -- 172.21.15.59:0/2283893866 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7806ddb0 con 0x7f8b78162780 2024-05-30T16:55:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.667+0000 7f8b77e00640 1 --2- 172.21.15.59:0/2283893866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b78162780 0x7f8b78162b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8b680097c0 tx=0x7f8b6801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8693b2237adbfe59 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:43.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.667+0000 7f8b76a00640 1 -- 172.21.15.59:0/2283893866 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680b0070 con 0x7f8b78162780 2024-05-30T16:55:43.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.671+0000 7f8b76a00640 1 -- 172.21.15.59:0/2283893866 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b680ab600 con 0x7f8b78162780 2024-05-30T16:55:43.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.671+0000 7f8b76a00640 1 -- 172.21.15.59:0/2283893866 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680ab9d0 con 0x7f8b78162780 2024-05-30T16:55:43.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.671+0000 7f8b7ee00640 1 -- 172.21.15.59:0/2283893866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b78162780 msgr2=0x7f8b78162b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:43.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.671+0000 7f8b7ee00640 1 --2- 172.21.15.59:0/2283893866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b78162780 0x7f8b78162b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8b680097c0 tx=0x7f8b6801c410 comp rx=0 tx=0).stop 2024-05-30T16:55:43.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.671+0000 7f8b7ee00640 1 -- 172.21.15.59:0/2283893866 shutdown_connections 2024-05-30T16:55:43.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.675+0000 7f8b7ee00640 1 --2- 172.21.15.59:0/2283893866 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b780b39e0 0x7f8b780d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:43.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.675+0000 7f8b7ee00640 1 --2- 172.21.15.59:0/2283893866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b78162780 0x7f8b78162b60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:43.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.675+0000 7f8b7ee00640 1 -- 172.21.15.59:0/2283893866 >> 172.21.15.59:0/2283893866 conn(0x7f8b7806bdb0 msgr2=0x7f8b7806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:43.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.675+0000 7f8b7ee00640 1 -- 172.21.15.59:0/2283893866 shutdown_connections 2024-05-30T16:55:43.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.675+0000 7f8b7ee00640 1 -- 172.21.15.59:0/2283893866 wait complete. 2024-05-30T16:55:43.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.679+0000 7f8b7ee00640 1 Processor -- start 2024-05-30T16:55:43.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.679+0000 7f8b7ee00640 1 -- start start 2024-05-30T16:55:43.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b7ee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b780b39e0 0x7f8b78164140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:43.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b7ee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b780d0660 0x7f8b7815a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:43.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b7ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b78162780 0x7f8b78159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:43.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b7ee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7806f470 con 0x7f8b780b39e0 2024-05-30T16:55:43.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b7ee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7806f2f0 con 0x7f8b780d0660 2024-05-30T16:55:43.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b7ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7806f5f0 con 0x7f8b78162780 2024-05-30T16:55:43.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b77e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b780b39e0 0x7f8b78164140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:43.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b77e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b780b39e0 0x7f8b78164140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50504/0 (socket says 172.21.15.59:50504) 2024-05-30T16:55:43.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b77e00640 1 -- 172.21.15.59:0/357623685 learned_addr learned my addr 172.21.15.59:0/357623685 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:43.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b77400640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b780d0660 0x7f8b7815a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:43.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b77e00640 1 -- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b78162780 msgr2=0x7f8b78159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b77e00640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b78162780 0x7f8b78159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b77e00640 1 -- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b780d0660 msgr2=0x7f8b7815a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b77e00640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b780d0660 0x7f8b7815a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b77e00640 1 -- 172.21.15.59:0/357623685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b781647b0 con 0x7f8b780b39e0 2024-05-30T16:55:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b77e00640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b780b39e0 0x7f8b78164140 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8b68019020 tx=0x7f8b680191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b6fe00640 1 -- 172.21.15.59:0/357623685 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680b9020 con 0x7f8b780b39e0 2024-05-30T16:55:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b6fe00640 1 -- 172.21.15.59:0/357623685 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b680b5680 con 0x7f8b780b39e0 2024-05-30T16:55:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b7ee00640 1 -- 172.21.15.59:0/357623685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b78164a90 con 0x7f8b780b39e0 2024-05-30T16:55:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b6fe00640 1 -- 172.21.15.59:0/357623685 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680b0040 con 0x7f8b780b39e0 2024-05-30T16:55:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.683+0000 7f8b7ee00640 1 -- 172.21.15.59:0/357623685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b78165050 con 0x7f8b780b39e0 2024-05-30T16:55:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.687+0000 7f8b7ee00640 1 -- 172.21.15.59:0/357623685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b78068a90 con 0x7f8b780b39e0 2024-05-30T16:55:43.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.691+0000 7f8b6fe00640 1 -- 172.21.15.59:0/357623685 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7f8b680bc020 con 0x7f8b780b39e0 2024-05-30T16:55:43.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.691+0000 7f8b6fe00640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b580690b0 0x7f8b5806b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:43.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.691+0000 7f8b6fe00640 1 -- 172.21.15.59:0/357623685 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f8b6811fe40 con 0x7f8b780b39e0 2024-05-30T16:55:43.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.695+0000 7f8b77400640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b580690b0 0x7f8b5806b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:43.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.695+0000 7f8b6fe00640 1 -- 172.21.15.59:0/357623685 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8b68016090 con 0x7f8b780b39e0 2024-05-30T16:55:43.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:43.695+0000 7f8b77400640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b580690b0 0x7f8b5806b570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b780afbe0 tx=0x7f8b64009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:44.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:44.107+0000 7f8b7ee00640 1 -- 172.21.15.59:0/357623685 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone86894", "target": ["mon-mgr", ""]}) -- 0x7f8b7815b7e0 con 0x7f8b580690b0 2024-05-30T16:55:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b6fe00640 1 -- 172.21.15.59:0/357623685 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8b7815b7e0 con 0x7f8b580690b0 2024-05-30T16:55:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b7ee00640 1 -- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b580690b0 msgr2=0x7f8b5806b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b7ee00640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b580690b0 0x7f8b5806b570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b780afbe0 tx=0x7f8b64009040 comp rx=0 tx=0).stop 2024-05-30T16:55:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b7ee00640 1 -- 172.21.15.59:0/357623685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b780b39e0 msgr2=0x7f8b78164140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b7ee00640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b780b39e0 0x7f8b78164140 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8b68019020 tx=0x7f8b680191b0 comp rx=0 tx=0).stop 2024-05-30T16:55:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b7ee00640 1 -- 172.21.15.59:0/357623685 shutdown_connections 2024-05-30T16:55:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b7ee00640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b580690b0 0x7f8b5806b570 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b7ee00640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b78162780 0x7f8b78159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b7ee00640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b780d0660 0x7f8b7815a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b7ee00640 1 --2- 172.21.15.59:0/357623685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b780b39e0 0x7f8b78164140 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b7ee00640 1 -- 172.21.15.59:0/357623685 >> 172.21.15.59:0/357623685 conn(0x7f8b7806bdb0 msgr2=0x7f8b7815bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b7ee00640 1 -- 172.21.15.59:0/357623685 shutdown_connections 2024-05-30T16:55:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.543+0000 7f8b7ee00640 1 -- 172.21.15.59:0/357623685 wait complete. 2024-05-30T16:55:45.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone86895 2024-05-30T16:55:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.859+0000 7f2239c00640 1 Processor -- start 2024-05-30T16:55:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.859+0000 7f2239c00640 1 -- start start 2024-05-30T16:55:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2239c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2234160d90 0x7f223409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2239c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f223409b780 0x7f223409af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2239c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22340d1310 con 0x7f22340711e0 2024-05-30T16:55:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2239c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f22340ced30 con 0x7f2234160d90 2024-05-30T16:55:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2239c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f223409bcf0 con 0x7f223409b780 2024-05-30T16:55:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2232000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f223409b780 0x7f223409af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2232a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2234160d90 0x7f223409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2232000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f223409b780 0x7f223409af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:44906/0 (socket says 172.21.15.59:44906) 2024-05-30T16:55:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2232000640 1 -- 172.21.15.59:0/4097360559 learned_addr learned my addr 172.21.15.59:0/4097360559 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:45.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2232000640 1 -- 172.21.15.59:0/4097360559 >> v2:172.21.15.107:3300/0 conn(0x7f2234160d90 msgr2=0x7f223409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:45.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2232000640 1 --2- 172.21.15.59:0/4097360559 >> v2:172.21.15.107:3300/0 conn(0x7f2234160d90 0x7f223409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:45.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2232000640 1 -- 172.21.15.59:0/4097360559 >> v1:172.21.15.107:6789/0 conn(0x7f22340711e0 legacy=0x7f223406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:45.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.863+0000 7f2232000640 1 -- 172.21.15.59:0/4097360559 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22340d0a70 con 0x7f223409b780 2024-05-30T16:55:45.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.871+0000 7f2232000640 1 --2- 172.21.15.59:0/4097360559 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f223409b780 0x7f223409af80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2234073010 tx=0x7f222401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da4613ddf46fc88e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:45.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.871+0000 7f2231600640 1 -- 172.21.15.59:0/4097360559 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22240b0070 con 0x7f223409b780 2024-05-30T16:55:45.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.871+0000 7f2231600640 1 -- 172.21.15.59:0/4097360559 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22240ab600 con 0x7f223409b780 2024-05-30T16:55:45.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.871+0000 7f2231600640 1 -- 172.21.15.59:0/4097360559 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22240ab9d0 con 0x7f223409b780 2024-05-30T16:55:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.871+0000 7f2239c00640 1 -- 172.21.15.59:0/4097360559 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f223409b780 msgr2=0x7f223409af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.871+0000 7f2239c00640 1 --2- 172.21.15.59:0/4097360559 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f223409b780 0x7f223409af80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2234073010 tx=0x7f222401c470 comp rx=0 tx=0).stop 2024-05-30T16:55:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.871+0000 7f2239c00640 1 -- 172.21.15.59:0/4097360559 shutdown_connections 2024-05-30T16:55:45.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.871+0000 7f2239c00640 1 --2- 172.21.15.59:0/4097360559 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f223409b780 0x7f223409af80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:45.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.871+0000 7f2239c00640 1 --2- 172.21.15.59:0/4097360559 >> v2:172.21.15.107:3300/0 conn(0x7f2234160d90 0x7f223409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:45.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.871+0000 7f2239c00640 1 -- 172.21.15.59:0/4097360559 >> 172.21.15.59:0/4097360559 conn(0x7f22340b3f80 msgr2=0x7f22340b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:45.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.871+0000 7f2239c00640 1 -- 172.21.15.59:0/4097360559 shutdown_connections 2024-05-30T16:55:45.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.871+0000 7f2239c00640 1 -- 172.21.15.59:0/4097360559 wait complete. 2024-05-30T16:55:45.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.875+0000 7f2239c00640 1 Processor -- start 2024-05-30T16:55:45.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.875+0000 7f2239c00640 1 -- start start 2024-05-30T16:55:45.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2239c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22340711e0 0x7f223415aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:45.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2239c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f223409b780 0x7f22340b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:45.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2239c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2234160d90 0x7f22340b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:45.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2239c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2234071fe0 con 0x7f2234160d90 2024-05-30T16:55:45.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2232a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22340711e0 0x7f223415aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:45.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2232a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22340711e0 0x7f223415aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:36504/0 (socket says 172.21.15.59:36504) 2024-05-30T16:55:45.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2232a00640 1 -- 172.21.15.59:0/521261494 learned_addr learned my addr 172.21.15.59:0/521261494 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:45.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2233400640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2234160d90 0x7f22340b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:45.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2239c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2234071e60 con 0x7f22340711e0 2024-05-30T16:55:45.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2239c00640 1 -- 172.21.15.59:0/521261494 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2234161170 con 0x7f223409b780 2024-05-30T16:55:45.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2232000640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f223409b780 0x7f22340b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:45.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2233400640 1 -- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f223409b780 msgr2=0x7f22340b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:45.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2233400640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f223409b780 0x7f22340b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:45.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2233400640 1 -- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22340711e0 msgr2=0x7f223415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:45.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2233400640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22340711e0 0x7f223415aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:45.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.879+0000 7f2233400640 1 -- 172.21.15.59:0/521261494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22340b6000 con 0x7f2234160d90 2024-05-30T16:55:45.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.883+0000 7f2233400640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2234160d90 0x7f22340b0260 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f222c00be50 tx=0x7f222c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:45.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.883+0000 7f222aa00640 1 -- 172.21.15.59:0/521261494 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c019070 con 0x7f2234160d90 2024-05-30T16:55:45.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.883+0000 7f222aa00640 1 -- 172.21.15.59:0/521261494 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c014440 con 0x7f2234160d90 2024-05-30T16:55:45.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.883+0000 7f222aa00640 1 -- 172.21.15.59:0/521261494 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c014830 con 0x7f2234160d90 2024-05-30T16:55:45.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.883+0000 7f2239c00640 1 -- 172.21.15.59:0/521261494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22340b62d0 con 0x7f2234160d90 2024-05-30T16:55:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.887+0000 7f2239c00640 1 -- 172.21.15.59:0/521261494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22340b6890 con 0x7f2234160d90 2024-05-30T16:55:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.887+0000 7f222aa00640 1 -- 172.21.15.59:0/521261494 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7f222c01c070 con 0x7f2234160d90 2024-05-30T16:55:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.891+0000 7f222aa00640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2214069030 0x7f221406b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.891+0000 7f222aa00640 1 -- 172.21.15.59:0/521261494 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f222c054b40 con 0x7f2234160d90 2024-05-30T16:55:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.891+0000 7f2232a00640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2214069030 0x7f221406b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.891+0000 7f2239c00640 1 -- 172.21.15.59:0/521261494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2234068a90 con 0x7f2234160d90 2024-05-30T16:55:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.891+0000 7f2232a00640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2214069030 0x7f221406b4f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2220009c20 tx=0x7f2220009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:45.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:45.907+0000 7f222aa00640 1 -- 172.21.15.59:0/521261494 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f222c056aa0 con 0x7f2234160d90 2024-05-30T16:55:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:46.363+0000 7f2239c00640 1 -- 172.21.15.59:0/521261494 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone86895", "target": ["mon-mgr", ""]}) -- 0x7f22340b4be0 con 0x7f2214069030 2024-05-30T16:55:47.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.111+0000 7f222aa00640 1 -- 172.21.15.59:0/521261494 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f22340b4be0 con 0x7f2214069030 2024-05-30T16:55:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.115+0000 7f2239c00640 1 -- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2214069030 msgr2=0x7f221406b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.115+0000 7f2239c00640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2214069030 0x7f221406b4f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2220009c20 tx=0x7f2220009190 comp rx=0 tx=0).stop 2024-05-30T16:55:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.115+0000 7f2239c00640 1 -- 172.21.15.59:0/521261494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2234160d90 msgr2=0x7f22340b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.115+0000 7f2239c00640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2234160d90 0x7f22340b0260 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f222c00be50 tx=0x7f222c00bf40 comp rx=0 tx=0).stop 2024-05-30T16:55:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.115+0000 7f2239c00640 1 -- 172.21.15.59:0/521261494 shutdown_connections 2024-05-30T16:55:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.115+0000 7f2239c00640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2214069030 0x7f221406b4f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.115+0000 7f2239c00640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2234160d90 0x7f22340b0260 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.115+0000 7f2239c00640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f223409b780 0x7f22340b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.115+0000 7f2239c00640 1 --2- 172.21.15.59:0/521261494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22340711e0 0x7f223415aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.115+0000 7f2239c00640 1 -- 172.21.15.59:0/521261494 >> 172.21.15.59:0/521261494 conn(0x7f22340b3f80 msgr2=0x7f22340ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:47.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.115+0000 7f2239c00640 1 -- 172.21.15.59:0/521261494 shutdown_connections 2024-05-30T16:55:47.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.115+0000 7f2239c00640 1 -- 172.21.15.59:0/521261494 wait complete. 2024-05-30T16:55:47.147 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone86896 2024-05-30T16:55:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.423+0000 7f9fb6c00640 1 Processor -- start 2024-05-30T16:55:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.423+0000 7f9fb6c00640 1 -- start start 2024-05-30T16:55:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.423+0000 7f9fb6c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9fb015b5e0 0x7f9fb006ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.423+0000 7f9fb6c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9fb0073540 0x7f9fb015f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.423+0000 7f9fb6c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9fb015fb10 0x7f9fb00adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.423+0000 7f9fb6c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb006e660 con 0x7f9fb0073540 2024-05-30T16:55:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.423+0000 7f9fb6c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb006fbc0 con 0x7f9fb015fb10 2024-05-30T16:55:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.423+0000 7f9fb6c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb015f0f0 con 0x7f9fb015b5e0 2024-05-30T16:55:47.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.427+0000 7f9fa7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9fb0073540 0x7f9fb015f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:47.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.427+0000 7f9fa7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9fb0073540 0x7f9fb015f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50534/0 (socket says 172.21.15.59:50534) 2024-05-30T16:55:47.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.427+0000 7f9fa7e00640 1 -- 172.21.15.59:0/450558023 learned_addr learned my addr 172.21.15.59:0/450558023 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:47.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.427+0000 7f9fafe00640 1 --2- 172.21.15.59:0/450558023 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9fb015b5e0 0x7f9fb006ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:47.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.427+0000 7f9fa7e00640 1 -- 172.21.15.59:0/450558023 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9fb015b5e0 msgr2=0x7f9fb006ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:47.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.427+0000 7f9fa7e00640 1 --2- 172.21.15.59:0/450558023 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9fb015b5e0 0x7f9fb006ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:47.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.427+0000 7f9fa7e00640 1 -- 172.21.15.59:0/450558023 >> v2:172.21.15.107:3300/0 conn(0x7f9fb015fb10 msgr2=0x7f9fb00adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:47.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.427+0000 7f9fa7e00640 1 --2- 172.21.15.59:0/450558023 >> v2:172.21.15.107:3300/0 conn(0x7f9fb015fb10 0x7f9fb00adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:47.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.427+0000 7f9fa7e00640 1 -- 172.21.15.59:0/450558023 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb00739a0 con 0x7f9fb0073540 2024-05-30T16:55:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.435+0000 7f9fa7e00640 1 --2- 172.21.15.59:0/450558023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9fb0073540 0x7f9fb015f5d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9fb015ef20 tx=0x7f9f9801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc79a4f07a9431a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:47.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.435+0000 7f9faf400640 1 -- 172.21.15.59:0/450558023 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f980b0070 con 0x7f9fb0073540 2024-05-30T16:55:47.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.435+0000 7f9faf400640 1 -- 172.21.15.59:0/450558023 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f980ab600 con 0x7f9fb0073540 2024-05-30T16:55:47.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.435+0000 7f9faf400640 1 -- 172.21.15.59:0/450558023 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f980ab9d0 con 0x7f9fb0073540 2024-05-30T16:55:47.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.435+0000 7f9fb6c00640 1 -- 172.21.15.59:0/450558023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9fb0073540 msgr2=0x7f9fb015f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.435+0000 7f9fb6c00640 1 --2- 172.21.15.59:0/450558023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9fb0073540 0x7f9fb015f5d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9fb015ef20 tx=0x7f9f9801c490 comp rx=0 tx=0).stop 2024-05-30T16:55:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.439+0000 7f9fb6c00640 1 -- 172.21.15.59:0/450558023 shutdown_connections 2024-05-30T16:55:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.439+0000 7f9fb6c00640 1 --2- 172.21.15.59:0/450558023 >> v2:172.21.15.107:3300/0 conn(0x7f9fb015fb10 0x7f9fb00adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.439+0000 7f9fb6c00640 1 --2- 172.21.15.59:0/450558023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9fb0073540 0x7f9fb015f5d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:47.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.439+0000 7f9fb6c00640 1 --2- 172.21.15.59:0/450558023 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9fb015b5e0 0x7f9fb006ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:47.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.439+0000 7f9fb6c00640 1 -- 172.21.15.59:0/450558023 >> 172.21.15.59:0/450558023 conn(0x7f9fb006bdb0 msgr2=0x7f9fb006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:47.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.439+0000 7f9fb6c00640 1 -- 172.21.15.59:0/450558023 shutdown_connections 2024-05-30T16:55:47.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.439+0000 7f9fb6c00640 1 -- 172.21.15.59:0/450558023 wait complete. 2024-05-30T16:55:47.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.443+0000 7f9fb6c00640 1 Processor -- start 2024-05-30T16:55:47.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.443+0000 7f9fb6c00640 1 -- start start 2024-05-30T16:55:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.443+0000 7f9fb6c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9fb0073540 0x7f9fb00999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.443+0000 7f9fb6c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fb015fb10 0x7f9fb01591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:47.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.443+0000 7f9fb6c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9fb015be10 0x7f9fb015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.447+0000 7f9fafe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9fb0073540 0x7f9fb00999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.447+0000 7f9fafe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9fb0073540 0x7f9fb00999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:44940/0 (socket says 172.21.15.59:44940) 2024-05-30T16:55:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.447+0000 7f9fb6c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb0166280 con 0x7f9fb015be10 2024-05-30T16:55:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.447+0000 7f9fb6c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb0166100 con 0x7f9fb015fb10 2024-05-30T16:55:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.447+0000 7f9fb6c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb0166400 con 0x7f9fb0073540 2024-05-30T16:55:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.447+0000 7f9fafe00640 1 -- 172.21.15.59:0/3393923898 learned_addr learned my addr 172.21.15.59:0/3393923898 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.447+0000 7f9fa7e00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fb015fb10 0x7f9fb01591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.443+0000 7f9fb4c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9fb015be10 0x7f9fb015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.451+0000 7f9fb4c00640 1 -- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9fb0073540 msgr2=0x7f9fb00999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.451+0000 7f9fb4c00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9fb0073540 0x7f9fb00999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.451+0000 7f9fb4c00640 1 -- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fb015fb10 msgr2=0x7f9fb01591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.451+0000 7f9fb4c00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fb015fb10 0x7f9fb01591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.451+0000 7f9fb4c00640 1 -- 172.21.15.59:0/3393923898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb01599f0 con 0x7f9fb015be10 2024-05-30T16:55:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.451+0000 7f9fb4c00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9fb015be10 0x7f9fb015c3b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800b410 tx=0x7f9fa800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:47.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.451+0000 7f9facc00640 1 -- 172.21.15.59:0/3393923898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8015020 con 0x7f9fb015be10 2024-05-30T16:55:47.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.451+0000 7f9facc00640 1 -- 172.21.15.59:0/3393923898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa8011850 con 0x7f9fb015be10 2024-05-30T16:55:47.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.451+0000 7f9facc00640 1 -- 172.21.15.59:0/3393923898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8011c40 con 0x7f9fb015be10 2024-05-30T16:55:47.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.451+0000 7f9fb6c00640 1 -- 172.21.15.59:0/3393923898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb0159cd0 con 0x7f9fb015be10 2024-05-30T16:55:47.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.451+0000 7f9fb6c00640 1 -- 172.21.15.59:0/3393923898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb015a290 con 0x7f9fb015be10 2024-05-30T16:55:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.451+0000 7f9fb6c00640 1 -- 172.21.15.59:0/3393923898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb0068a90 con 0x7f9fb015be10 2024-05-30T16:55:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.455+0000 7f9facc00640 1 -- 172.21.15.59:0/3393923898 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7f9fa8018020 con 0x7f9fb015be10 2024-05-30T16:55:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.455+0000 7f9facc00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f8c069030 0x7f9f8c06b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.455+0000 7f9facc00640 1 -- 172.21.15.59:0/3393923898 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f9fa80859f0 con 0x7f9fb015be10 2024-05-30T16:55:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.459+0000 7f9fafe00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f8c069030 0x7f9f8c06b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:47.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.459+0000 7f9facc00640 1 -- 172.21.15.59:0/3393923898 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9fa801f020 con 0x7f9fb015be10 2024-05-30T16:55:47.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.463+0000 7f9fafe00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f8c069030 0x7f9f8c06b4f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0003bd0 tx=0x7f9fa0009970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:47.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:47.842+0000 7f9fb6c00640 1 -- 172.21.15.59:0/3393923898 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone86896", "target": ["mon-mgr", ""]}) -- 0x7f9fb006c540 con 0x7f9f8c069030 2024-05-30T16:55:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.190+0000 7f9facc00640 1 -- 172.21.15.59:0/3393923898 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9fb006c540 con 0x7f9f8c069030 2024-05-30T16:55:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.194+0000 7f9fb6c00640 1 -- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f8c069030 msgr2=0x7f9f8c06b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.194+0000 7f9fb6c00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f8c069030 0x7f9f8c06b4f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0003bd0 tx=0x7f9fa0009970 comp rx=0 tx=0).stop 2024-05-30T16:55:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.194+0000 7f9fb6c00640 1 -- 172.21.15.59:0/3393923898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9fb015be10 msgr2=0x7f9fb015c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.194+0000 7f9fb6c00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9fb015be10 0x7f9fb015c3b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800b410 tx=0x7f9fa800b8d0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.194+0000 7f9fb6c00640 1 -- 172.21.15.59:0/3393923898 shutdown_connections 2024-05-30T16:55:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.194+0000 7f9fb6c00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f8c069030 0x7f9f8c06b4f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.194+0000 7f9fb6c00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9fb015be10 0x7f9fb015c3b0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.194+0000 7f9fb6c00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fb015fb10 0x7f9fb01591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.194+0000 7f9fb6c00640 1 --2- 172.21.15.59:0/3393923898 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9fb0073540 0x7f9fb00999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.194+0000 7f9fb6c00640 1 -- 172.21.15.59:0/3393923898 >> 172.21.15.59:0/3393923898 conn(0x7f9fb006bdb0 msgr2=0x7f9fb0165900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.194+0000 7f9fb6c00640 1 -- 172.21.15.59:0/3393923898 shutdown_connections 2024-05-30T16:55:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.194+0000 7f9fb6c00640 1 -- 172.21.15.59:0/3393923898 wait complete. 2024-05-30T16:55:48.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone86897 2024-05-30T16:55:48.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.450+0000 7f0a87c00640 1 Processor -- start 2024-05-30T16:55:48.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.450+0000 7f0a87c00640 1 -- start start 2024-05-30T16:55:48.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.450+0000 7f0a87c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a8015b500 0x7f0a8006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:48.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.450+0000 7f0a87c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a800d1710 0x7f0a800b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:48.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.450+0000 7f0a87c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a800b4720 con 0x7f0a800b51a0 2024-05-30T16:55:48.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.450+0000 7f0a87c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0a800aedc0 con 0x7f0a8015b500 2024-05-30T16:55:48.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.450+0000 7f0a87c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0a800b4fc0 con 0x7f0a800d1710 2024-05-30T16:55:48.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.450+0000 7f0a85200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a8015b500 0x7f0a8006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:48.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.454+0000 7f0a85c00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f0a800b51a0 0x7f0a800af510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:55372/0 (socket says 172.21.15.59:55372) 2024-05-30T16:55:48.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.454+0000 7f0a85200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a8015b500 0x7f0a8006e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:36538/0 (socket says 172.21.15.59:36538) 2024-05-30T16:55:48.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.454+0000 7f0a85c00640 1 -- 172.21.15.59:0/2442952183 learned_addr learned my addr 172.21.15.59:0/2442952183 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:55:48.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.454+0000 7f0a7fe00640 1 --2- 172.21.15.59:0/2442952183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a800d1710 0x7f0a800b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:48.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.454+0000 7f0a7f400640 1 -- 172.21.15.59:0/2442952183 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111425231 0 0) 0x7f0a800b4720 con 0x7f0a800b51a0 2024-05-30T16:55:48.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.454+0000 7f0a7f400640 1 -- 172.21.15.59:0/2442952183 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a68003530 con 0x7f0a800b51a0 2024-05-30T16:55:48.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.454+0000 7f0a7fe00640 1 -- 172.21.15.59:0/2442952183 >> v2:172.21.15.107:3300/0 conn(0x7f0a8015b500 msgr2=0x7f0a8006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:48.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.454+0000 7f0a7fe00640 1 --2- 172.21.15.59:0/2442952183 >> v2:172.21.15.107:3300/0 conn(0x7f0a8015b500 0x7f0a8006e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.454+0000 7f0a7fe00640 1 -- 172.21.15.59:0/2442952183 >> v1:172.21.15.107:6789/0 conn(0x7f0a800b51a0 legacy=0x7f0a800af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:48.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.454+0000 7f0a7fe00640 1 -- 172.21.15.59:0/2442952183 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a800b4a00 con 0x7f0a800d1710 2024-05-30T16:55:48.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.454+0000 7f0a85200640 1 --2- 172.21.15.59:0/2442952183 >> v2:172.21.15.107:3300/0 conn(0x7f0a8015b500 0x7f0a8006e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:55:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.458+0000 7f0a7fe00640 1 --2- 172.21.15.59:0/2442952183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a800d1710 0x7f0a800b3ed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0097c0 tx=0x7f0a6c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c4622db101ed1cb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.458+0000 7f0a7f400640 1 -- 172.21.15.59:0/2442952183 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0b0070 con 0x7f0a800d1710 2024-05-30T16:55:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.458+0000 7f0a7f400640 1 -- 172.21.15.59:0/2442952183 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a6c0ab600 con 0x7f0a800d1710 2024-05-30T16:55:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.458+0000 7f0a7f400640 1 -- 172.21.15.59:0/2442952183 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0ab9d0 con 0x7f0a800d1710 2024-05-30T16:55:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.458+0000 7f0a87c00640 1 -- 172.21.15.59:0/2442952183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a800d1710 msgr2=0x7f0a800b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.458+0000 7f0a87c00640 1 --2- 172.21.15.59:0/2442952183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a800d1710 0x7f0a800b3ed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0097c0 tx=0x7f0a6c01c4a0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.458+0000 7f0a87c00640 1 -- 172.21.15.59:0/2442952183 shutdown_connections 2024-05-30T16:55:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.458+0000 7f0a87c00640 1 --2- 172.21.15.59:0/2442952183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a800d1710 0x7f0a800b3ed0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.458+0000 7f0a87c00640 1 --2- 172.21.15.59:0/2442952183 >> v2:172.21.15.107:3300/0 conn(0x7f0a8015b500 0x7f0a8006e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.458+0000 7f0a87c00640 1 -- 172.21.15.59:0/2442952183 >> 172.21.15.59:0/2442952183 conn(0x7f0a800b3220 msgr2=0x7f0a800d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.458+0000 7f0a87c00640 1 -- 172.21.15.59:0/2442952183 shutdown_connections 2024-05-30T16:55:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.458+0000 7f0a87c00640 1 -- 172.21.15.59:0/2442952183 wait complete. 2024-05-30T16:55:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a87c00640 1 Processor -- start 2024-05-30T16:55:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a87c00640 1 -- start start 2024-05-30T16:55:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a87c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a800b51a0 0x7f0a8015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a87c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a800d1710 0x7f0a80149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a87c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8015b500 0x7f0a8006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a87c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0a800b59c0 con 0x7f0a8015b500 2024-05-30T16:55:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a87c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8006b9b0 con 0x7f0a800d1710 2024-05-30T16:55:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a87c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0a80152ce0 con 0x7f0a800b51a0 2024-05-30T16:55:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a85c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8015b500 0x7f0a8006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a85c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8015b500 0x7f0a8006e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50548/0 (socket says 172.21.15.59:50548) 2024-05-30T16:55:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a85c00640 1 -- 172.21.15.59:0/3885104669 learned_addr learned my addr 172.21.15.59:0/3885104669 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a7fe00640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a800d1710 0x7f0a80149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a85200640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a800b51a0 0x7f0a8015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a85c00640 1 -- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a800b51a0 msgr2=0x7f0a8015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a85c00640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a800b51a0 0x7f0a8015d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a85c00640 1 -- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a800d1710 msgr2=0x7f0a80149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a85c00640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a800d1710 0x7f0a80149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.462+0000 7f0a85c00640 1 -- 172.21.15.59:0/3885104669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8015c6d0 con 0x7f0a8015b500 2024-05-30T16:55:48.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.466+0000 7f0a85c00640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8015b500 0x7f0a8006e8d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800cb40 tx=0x7f0a7800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:48.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.466+0000 7f0a7cc00640 1 -- 172.21.15.59:0/3885104669 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78017070 con 0x7f0a8015b500 2024-05-30T16:55:48.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.466+0000 7f0a7cc00640 1 -- 172.21.15.59:0/3885104669 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7800ac40 con 0x7f0a8015b500 2024-05-30T16:55:48.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.466+0000 7f0a7cc00640 1 -- 172.21.15.59:0/3885104669 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78012400 con 0x7f0a8015b500 2024-05-30T16:55:48.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.466+0000 7f0a87c00640 1 -- 172.21.15.59:0/3885104669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8015c9b0 con 0x7f0a8015b500 2024-05-30T16:55:48.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.466+0000 7f0a87c00640 1 -- 172.21.15.59:0/3885104669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8015cf70 con 0x7f0a8015b500 2024-05-30T16:55:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.466+0000 7f0a87c00640 1 -- 172.21.15.59:0/3885104669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a5c0052a0 con 0x7f0a8015b500 2024-05-30T16:55:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.466+0000 7f0a7cc00640 1 -- 172.21.15.59:0/3885104669 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7f0a7801a070 con 0x7f0a8015b500 2024-05-30T16:55:48.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.470+0000 7f0a7cc00640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a60068fe0 0x7f0a6006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:48.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.470+0000 7f0a7cc00640 1 -- 172.21.15.59:0/3885104669 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f0a780853a0 con 0x7f0a8015b500 2024-05-30T16:55:48.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.470+0000 7f0a85200640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a60068fe0 0x7f0a6006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:48.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.478+0000 7f0a85200640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a60068fe0 0x7f0a6006b4a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009a50 tx=0x7f0a74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:48.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.478+0000 7f0a7cc00640 1 -- 172.21.15.59:0/3885104669 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a78057190 con 0x7f0a8015b500 2024-05-30T16:55:48.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.782+0000 7f0a87c00640 1 -- 172.21.15.59:0/3885104669 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone86897", "target": ["mon-mgr", ""]}) -- 0x7f0a5c000bd0 con 0x7f0a60068fe0 2024-05-30T16:55:48.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a7cc00640 1 -- 172.21.15.59:0/3885104669 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0a5c000bd0 con 0x7f0a60068fe0 2024-05-30T16:55:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a87c00640 1 -- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a60068fe0 msgr2=0x7f0a6006b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a87c00640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a60068fe0 0x7f0a6006b4a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009a50 tx=0x7f0a74008040 comp rx=0 tx=0).stop 2024-05-30T16:55:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a87c00640 1 -- 172.21.15.59:0/3885104669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8015b500 msgr2=0x7f0a8006e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a87c00640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8015b500 0x7f0a8006e8d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800cb40 tx=0x7f0a7800a060 comp rx=0 tx=0).stop 2024-05-30T16:55:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a87c00640 1 -- 172.21.15.59:0/3885104669 shutdown_connections 2024-05-30T16:55:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a87c00640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a60068fe0 0x7f0a6006b4a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a87c00640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8015b500 0x7f0a8006e8d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a87c00640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a800d1710 0x7f0a80149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a87c00640 1 --2- 172.21.15.59:0/3885104669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a800b51a0 0x7f0a8015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a87c00640 1 -- 172.21.15.59:0/3885104669 >> 172.21.15.59:0/3885104669 conn(0x7f0a800b3220 msgr2=0x7f0a8015f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a87c00640 1 -- 172.21.15.59:0/3885104669 shutdown_connections 2024-05-30T16:55:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:48.930+0000 7f0a87c00640 1 -- 172.21.15.59:0/3885104669 wait complete. 2024-05-30T16:55:48.955 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:55:49.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137f600640 1 Processor -- start 2024-05-30T16:55:49.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137f600640 1 -- start start 2024-05-30T16:55:49.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137f600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13780d05b0 0x7f137809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:49.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137f600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f137809af80 0x7f137806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:49.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137f600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1378070950 con 0x7f13780d14c0 2024-05-30T16:55:49.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137f600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1378070c30 con 0x7f137809af80 2024-05-30T16:55:49.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137f600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1378070f10 con 0x7f13780d05b0 2024-05-30T16:55:49.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137d600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f137809af80 0x7f137806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:49.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137cc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f13780d14c0 0x7f137806e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42924/0 (socket says 172.21.15.59:42924) 2024-05-30T16:55:49.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137cc00640 1 -- 172.21.15.59:0/1419996751 learned_addr learned my addr 172.21.15.59:0/1419996751 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:55:49.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f136fe00640 1 --2- 172.21.15.59:0/1419996751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13780d05b0 0x7f137809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:49.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137d600640 1 -- 172.21.15.59:0/1419996751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13780d05b0 msgr2=0x7f137809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:49.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137d600640 1 --2- 172.21.15.59:0/1419996751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13780d05b0 0x7f137809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137d600640 1 -- 172.21.15.59:0/1419996751 >> v1:172.21.15.59:6789/0 conn(0x7f13780d14c0 legacy=0x7f137806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f137d600640 1 -- 172.21.15.59:0/1419996751 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137806cbd0 con 0x7f137809af80 2024-05-30T16:55:49.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.094+0000 7f1377e00640 1 -- 172.21.15.59:0/1419996751 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103880912 0 0) 0x7f1378070950 con 0x7f13780d14c0 2024-05-30T16:55:49.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.098+0000 7f137d600640 1 --2- 172.21.15.59:0/1419996751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137809af80 0x7f137806d0f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1370009d90 tx=0x7f137001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6ae268c8c44de0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:49.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.098+0000 7f1377e00640 1 -- 172.21.15.59:0/1419996751 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13700b2070 con 0x7f137809af80 2024-05-30T16:55:49.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.098+0000 7f1377e00640 1 -- 172.21.15.59:0/1419996751 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13700a5940 con 0x7f137809af80 2024-05-30T16:55:49.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.098+0000 7f1377e00640 1 -- 172.21.15.59:0/1419996751 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13700a5d10 con 0x7f137809af80 2024-05-30T16:55:49.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.098+0000 7f137f600640 1 -- 172.21.15.59:0/1419996751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137809af80 msgr2=0x7f137806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.098+0000 7f137f600640 1 --2- 172.21.15.59:0/1419996751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137809af80 0x7f137806d0f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1370009d90 tx=0x7f137001c970 comp rx=0 tx=0).stop 2024-05-30T16:55:49.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.098+0000 7f137f600640 1 -- 172.21.15.59:0/1419996751 shutdown_connections 2024-05-30T16:55:49.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.098+0000 7f137f600640 1 --2- 172.21.15.59:0/1419996751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137809af80 0x7f137806d0f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.098+0000 7f137f600640 1 --2- 172.21.15.59:0/1419996751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13780d05b0 0x7f137809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.098+0000 7f137f600640 1 -- 172.21.15.59:0/1419996751 >> 172.21.15.59:0/1419996751 conn(0x7f13780b3f80 msgr2=0x7f13780b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:49.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.098+0000 7f137f600640 1 -- 172.21.15.59:0/1419996751 shutdown_connections 2024-05-30T16:55:49.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.098+0000 7f137f600640 1 -- 172.21.15.59:0/1419996751 wait complete. 2024-05-30T16:55:49.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137f600640 1 Processor -- start 2024-05-30T16:55:49.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137f600640 1 -- start start 2024-05-30T16:55:49.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137f600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137809af80 0x7f13780c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137f600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13780d05b0 0x7f13780c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137f600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13780d14c0 0x7f13780c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137f600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f137806dfc0 con 0x7f13780d14c0 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137f600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f137806de40 con 0x7f13780d05b0 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137f600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f137806e140 con 0x7f137809af80 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13780d14c0 0x7f13780c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13780d14c0 0x7f13780c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50566/0 (socket says 172.21.15.59:50566) 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137d600640 1 -- 172.21.15.59:0/94585336 learned_addr learned my addr 172.21.15.59:0/94585336 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f136fe00640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13780d05b0 0x7f13780c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137cc00640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137809af80 0x7f13780c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137d600640 1 -- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137809af80 msgr2=0x7f13780c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137d600640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137809af80 0x7f13780c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137d600640 1 -- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13780d05b0 msgr2=0x7f13780c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137d600640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13780d05b0 0x7f13780c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137d600640 1 -- 172.21.15.59:0/94585336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13780b73e0 con 0x7f13780d14c0 2024-05-30T16:55:49.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137cc00640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137809af80 0x7f13780c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:55:49.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137d600640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13780d14c0 0x7f13780c8660 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f13700b0040 tx=0x7f1370019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:49.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f1375600640 1 -- 172.21.15.59:0/94585336 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13700bd030 con 0x7f13780d14c0 2024-05-30T16:55:49.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f1375600640 1 -- 172.21.15.59:0/94585336 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13700b8470 con 0x7f13780d14c0 2024-05-30T16:55:49.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f1375600640 1 -- 172.21.15.59:0/94585336 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13700b2040 con 0x7f13780d14c0 2024-05-30T16:55:49.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137f600640 1 -- 172.21.15.59:0/94585336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13780b7970 con 0x7f13780d14c0 2024-05-30T16:55:49.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.102+0000 7f137f600640 1 -- 172.21.15.59:0/94585336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13780b7f30 con 0x7f13780d14c0 2024-05-30T16:55:49.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.106+0000 7f137f600640 1 -- 172.21.15.59:0/94585336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1378068a90 con 0x7f13780d14c0 2024-05-30T16:55:49.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.106+0000 7f1375600640 1 -- 172.21.15.59:0/94585336 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7f13700c0070 con 0x7f13780d14c0 2024-05-30T16:55:49.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.106+0000 7f1375600640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1354068fe0 0x7f135406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:49.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.106+0000 7f1375600640 1 -- 172.21.15.59:0/94585336 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f137011fe00 con 0x7f13780d14c0 2024-05-30T16:55:49.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.106+0000 7f137cc00640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1354068fe0 0x7f135406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:49.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.106+0000 7f137cc00640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1354068fe0 0x7f135406b4a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1368007fd0 tx=0x7f1368007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:49.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.110+0000 7f1375600640 1 -- 172.21.15.59:0/94585336 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1370016560 con 0x7f13780d14c0 2024-05-30T16:55:49.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.298+0000 7f137f600640 1 -- 172.21.15.59:0/94585336 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f13780d2270 con 0x7f1354068fe0 2024-05-30T16:55:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f1375600640 1 -- 172.21.15.59:0/94585336 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f13780d2270 con 0x7f1354068fe0 2024-05-30T16:55:49.304 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:55:49.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:55:49.304 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T16:55:49.304 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:49.305 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:55:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f137f600640 1 -- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1354068fe0 msgr2=0x7f135406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f137f600640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1354068fe0 0x7f135406b4a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1368007fd0 tx=0x7f1368007c20 comp rx=0 tx=0).stop 2024-05-30T16:55:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f137f600640 1 -- 172.21.15.59:0/94585336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13780d14c0 msgr2=0x7f13780c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f137f600640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13780d14c0 0x7f13780c8660 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f13700b0040 tx=0x7f1370019710 comp rx=0 tx=0).stop 2024-05-30T16:55:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f137f600640 1 -- 172.21.15.59:0/94585336 shutdown_connections 2024-05-30T16:55:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f137f600640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1354068fe0 0x7f135406b4a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f137f600640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13780d14c0 0x7f13780c8660 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f137f600640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13780d05b0 0x7f13780c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f137f600640 1 --2- 172.21.15.59:0/94585336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137809af80 0x7f13780c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f137f600640 1 -- 172.21.15.59:0/94585336 >> 172.21.15.59:0/94585336 conn(0x7f13780b3f80 msgr2=0x7f13780b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f137f600640 1 -- 172.21.15.59:0/94585336 shutdown_connections 2024-05-30T16:55:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.302+0000 7f137f600640 1 -- 172.21.15.59:0/94585336 wait complete. 2024-05-30T16:55:49.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:55:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.462+0000 7fac7f400640 1 Processor -- start 2024-05-30T16:55:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.462+0000 7fac7f400640 1 -- start start 2024-05-30T16:55:49.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.462+0000 7fac7f400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fac78158ef0 0x7fac780b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:49.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.462+0000 7fac7f400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac7815f050 con 0x7fac780af970 2024-05-30T16:55:49.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.462+0000 7fac7f400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac7815f330 con 0x7fac780b42e0 2024-05-30T16:55:49.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.462+0000 7fac7f400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fac7815f610 con 0x7fac78158ef0 2024-05-30T16:55:49.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.462+0000 7fac7d400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fac780af970 0x7fac780adca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42934/0 (socket says 172.21.15.59:42934) 2024-05-30T16:55:49.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.462+0000 7fac7d400640 1 -- 172.21.15.59:0/155665305 learned_addr learned my addr 172.21.15.59:0/155665305 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:55:49.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.462+0000 7fac7ca00640 1 --2- 172.21.15.59:0/155665305 >> v2:172.21.15.107:3300/0 conn(0x7fac78158ef0 0x7fac780b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:49.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.466+0000 7fac77400640 1 -- 172.21.15.59:0/155665305 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676316035 0 0) 0x7fac7815f050 con 0x7fac780af970 2024-05-30T16:55:49.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.466+0000 7fac77400640 1 -- 172.21.15.59:0/155665305 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac60003530 con 0x7fac780af970 2024-05-30T16:55:49.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.466+0000 7fac7ca00640 1 -- 172.21.15.59:0/155665305 >> v1:172.21.15.107:6789/0 conn(0x7fac780b42e0 legacy=0x7fac780af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.466+0000 7fac7ca00640 1 -- 172.21.15.59:0/155665305 >> v1:172.21.15.59:6789/0 conn(0x7fac780af970 legacy=0x7fac780adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.466+0000 7fac7ca00640 1 -- 172.21.15.59:0/155665305 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7815f8f0 con 0x7fac78158ef0 2024-05-30T16:55:49.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.466+0000 7fac7ca00640 1 --2- 172.21.15.59:0/155665305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac78158ef0 0x7fac780b3da0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0097c0 tx=0x7fac6c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd8c9c7ebebd0955 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:49.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.466+0000 7fac77400640 1 -- 172.21.15.59:0/155665305 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0b1070 con 0x7fac78158ef0 2024-05-30T16:55:49.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.466+0000 7fac77400640 1 -- 172.21.15.59:0/155665305 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6c0ac410 con 0x7fac78158ef0 2024-05-30T16:55:49.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.466+0000 7fac77400640 1 -- 172.21.15.59:0/155665305 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0ac7c0 con 0x7fac78158ef0 2024-05-30T16:55:49.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.466+0000 7fac7f400640 1 -- 172.21.15.59:0/155665305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac78158ef0 msgr2=0x7fac780b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.466+0000 7fac7f400640 1 --2- 172.21.15.59:0/155665305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac78158ef0 0x7fac780b3da0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0097c0 tx=0x7fac6c01c4a0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 -- 172.21.15.59:0/155665305 shutdown_connections 2024-05-30T16:55:49.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 --2- 172.21.15.59:0/155665305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac78158ef0 0x7fac780b3da0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 -- 172.21.15.59:0/155665305 >> 172.21.15.59:0/155665305 conn(0x7fac78067d60 msgr2=0x7fac7806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:49.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 -- 172.21.15.59:0/155665305 shutdown_connections 2024-05-30T16:55:49.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 -- 172.21.15.59:0/155665305 wait complete. 2024-05-30T16:55:49.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 Processor -- start 2024-05-30T16:55:49.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 -- start start 2024-05-30T16:55:49.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac780af970 0x7fac7813bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:49.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac780b42e0 0x7fac781593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:49.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac78158ef0 0x7fac7814f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:49.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fac780b46c0 con 0x7fac780af970 2024-05-30T16:55:49.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fac780aedd0 con 0x7fac780b42e0 2024-05-30T16:55:49.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7f400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fac7816c390 con 0x7fac78158ef0 2024-05-30T16:55:49.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac780af970 0x7fac7813bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:49.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac780af970 0x7fac7813bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50570/0 (socket says 172.21.15.59:50570) 2024-05-30T16:55:49.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7ca00640 1 -- 172.21.15.59:0/945404462 learned_addr learned my addr 172.21.15.59:0/945404462 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:49.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac77e00640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac780b42e0 0x7fac781593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:49.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7d400640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac78158ef0 0x7fac7814f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:49.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7ca00640 1 -- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac78158ef0 msgr2=0x7fac7814f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7ca00640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac78158ef0 0x7fac7814f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7ca00640 1 -- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac780b42e0 msgr2=0x7fac781593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7ca00640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac780b42e0 0x7fac781593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac7ca00640 1 -- 172.21.15.59:0/945404462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7814e130 con 0x7fac780af970 2024-05-30T16:55:49.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.470+0000 7fac77e00640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac780b42e0 0x7fac781593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:55:49.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.474+0000 7fac7ca00640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac780af970 0x7fac7813bed0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0097c0 tx=0x7fac6c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:49.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.474+0000 7fac74c00640 1 -- 172.21.15.59:0/945404462 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0bd070 con 0x7fac780af970 2024-05-30T16:55:49.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.474+0000 7fac74c00640 1 -- 172.21.15.59:0/945404462 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6c0b2040 con 0x7fac780af970 2024-05-30T16:55:49.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.474+0000 7fac74c00640 1 -- 172.21.15.59:0/945404462 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0b1050 con 0x7fac780af970 2024-05-30T16:55:49.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.474+0000 7fac7f400640 1 -- 172.21.15.59:0/945404462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7814e410 con 0x7fac780af970 2024-05-30T16:55:49.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.474+0000 7fac7f400640 1 -- 172.21.15.59:0/945404462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7814e9d0 con 0x7fac780af970 2024-05-30T16:55:49.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.474+0000 7fac7f400640 1 -- 172.21.15.59:0/945404462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac78068a90 con 0x7fac780af970 2024-05-30T16:55:49.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.474+0000 7fac74c00640 1 -- 172.21.15.59:0/945404462 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7fac6c0c0070 con 0x7fac780af970 2024-05-30T16:55:49.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.474+0000 7fac74c00640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fac58068fe0 0x7fac5806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:49.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.474+0000 7fac74c00640 1 -- 172.21.15.59:0/945404462 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fac6c11ee40 con 0x7fac780af970 2024-05-30T16:55:49.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.474+0000 7fac77e00640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fac58068fe0 0x7fac5806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:49.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.478+0000 7fac77e00640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fac58068fe0 0x7fac5806b4a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fac78153d10 tx=0x7fac64009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.478+0000 7fac74c00640 1 -- 172.21.15.59:0/945404462 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fac6c016090 con 0x7fac780af970 2024-05-30T16:55:49.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.702+0000 7fac7f400640 1 -- 172.21.15.59:0/945404462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fac7806cd50 con 0x7fac780af970 2024-05-30T16:55:49.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.702+0000 7fac74c00640 1 -- 172.21.15.59:0/945404462 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2873 (secure 0 0 0) 0x7fac6c0f0580 con 0x7fac780af970 2024-05-30T16:55:49.708 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:55:49.708 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:55:49.708 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:55:49.708 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:55:49.708 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:55:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 429, 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:55:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 3661, 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 15189234891, 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 29302730752, 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 743791382528, 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 808932850, 2024-05-30T16:55:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 805491261, 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 195, 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 210 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 35, 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4, 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 4, 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:55:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5865 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 9, 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:55:43.194442+0000", 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "c": { 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T16:55:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "392479d8-0f9b-4c11-a8b5-270f230c1c28": { 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "3 ongoing+pending clones; Avg progress is 18.229% (11s)\n [=====.......................] (remaining: 49s)", 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.18229000270366669, 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "a9414ee5-8d1d-4667-a8df-31a15a5bc1b0": { 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "3 ongoing clones; Avg progress is 17.882% (17s)\n [=====.......................] (remaining: 81s)", 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.17881999909877777, 2024-05-30T16:55:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:55:49.716 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:49.716 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:49.716 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:55:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.706+0000 7fac7f400640 1 -- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fac58068fe0 msgr2=0x7fac5806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.706+0000 7fac7f400640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fac58068fe0 0x7fac5806b4a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fac78153d10 tx=0x7fac64009040 comp rx=0 tx=0).stop 2024-05-30T16:55:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.706+0000 7fac7f400640 1 -- 172.21.15.59:0/945404462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac780af970 msgr2=0x7fac7813bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.706+0000 7fac7f400640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac780af970 0x7fac7813bed0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0097c0 tx=0x7fac6c01ace0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.706+0000 7fac7f400640 1 -- 172.21.15.59:0/945404462 shutdown_connections 2024-05-30T16:55:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.706+0000 7fac7f400640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fac58068fe0 0x7fac5806b4a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.706+0000 7fac7f400640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac78158ef0 0x7fac7814f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.706+0000 7fac7f400640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac780b42e0 0x7fac781593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.706+0000 7fac7f400640 1 --2- 172.21.15.59:0/945404462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac780af970 0x7fac7813bed0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:49.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.706+0000 7fac7f400640 1 -- 172.21.15.59:0/945404462 >> 172.21.15.59:0/945404462 conn(0x7fac78067d60 msgr2=0x7fac7806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:49.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.706+0000 7fac7f400640 1 -- 172.21.15.59:0/945404462 shutdown_connections 2024-05-30T16:55:49.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:49.706+0000 7fac7f400640 1 -- 172.21.15.59:0/945404462 wait complete. 2024-05-30T16:55:54.732 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:55:54.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.878+0000 7f000b200640 1 Processor -- start 2024-05-30T16:55:54.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.878+0000 7f000b200640 1 -- start start 2024-05-30T16:55:54.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.878+0000 7f000b200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f000c0b48b0 0x7f000c0b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:54.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.878+0000 7f000b200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f000c0d0460 0x7f000c0d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:54.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.878+0000 7f000b200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000c0cfde0 con 0x7f000c15e800 2024-05-30T16:55:54.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.878+0000 7f000b200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f000c0d0df0 con 0x7f000c0b48b0 2024-05-30T16:55:54.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.878+0000 7f000b200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f000c15ebe0 con 0x7f000c0d0460 2024-05-30T16:55:54.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.878+0000 7f0003e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f000c0b48b0 0x7f000c0b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:54.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.878+0000 7f0009e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f000c15e800 0x7f000c06dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37554/0 (socket says 172.21.15.59:37554) 2024-05-30T16:55:54.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.878+0000 7f0009e00640 1 -- 172.21.15.59:0/144708881 learned_addr learned my addr 172.21.15.59:0/144708881 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:55:54.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.878+0000 7f000a800640 1 --2- 172.21.15.59:0/144708881 >> v2:172.21.15.107:3300/0 conn(0x7f000c0d0460 0x7f000c0d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:54.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f0003e00640 1 -- 172.21.15.59:0/144708881 >> v2:172.21.15.107:3300/0 conn(0x7f000c0d0460 msgr2=0x7f000c0d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:55:54.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f0003e00640 1 --2- 172.21.15.59:0/144708881 >> v2:172.21.15.107:3300/0 conn(0x7f000c0d0460 0x7f000c0d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:54.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f0003e00640 1 -- 172.21.15.59:0/144708881 >> v1:172.21.15.59:6789/0 conn(0x7f000c15e800 legacy=0x7f000c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:54.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f0003e00640 1 -- 172.21.15.59:0/144708881 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c0b3dd0 con 0x7f000c0b48b0 2024-05-30T16:55:54.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f000a800640 1 --2- 172.21.15.59:0/144708881 >> v2:172.21.15.107:3300/0 conn(0x7f000c0d0460 0x7f000c0d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:55:54.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f0003e00640 1 --2- 172.21.15.59:0/144708881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c0b48b0 0x7f000c0b4d60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f000c071630 tx=0x7efff401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953f26d8752468b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:54.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f0009400640 1 -- 172.21.15.59:0/144708881 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff40b0070 con 0x7f000c0b48b0 2024-05-30T16:55:54.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f0009400640 1 -- 172.21.15.59:0/144708881 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff40ab600 con 0x7f000c0b48b0 2024-05-30T16:55:54.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f0009400640 1 -- 172.21.15.59:0/144708881 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff40ab9d0 con 0x7f000c0b48b0 2024-05-30T16:55:54.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f000b200640 1 -- 172.21.15.59:0/144708881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c0b48b0 msgr2=0x7f000c0b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:54.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f000b200640 1 --2- 172.21.15.59:0/144708881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c0b48b0 0x7f000c0b4d60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f000c071630 tx=0x7efff401c480 comp rx=0 tx=0).stop 2024-05-30T16:55:54.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f000b200640 1 -- 172.21.15.59:0/144708881 shutdown_connections 2024-05-30T16:55:54.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f000b200640 1 --2- 172.21.15.59:0/144708881 >> v2:172.21.15.107:3300/0 conn(0x7f000c0d0460 0x7f000c0d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:54.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f000b200640 1 --2- 172.21.15.59:0/144708881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c0b48b0 0x7f000c0b4d60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:54.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f000b200640 1 -- 172.21.15.59:0/144708881 >> 172.21.15.59:0/144708881 conn(0x7f000c06bb80 msgr2=0x7f000c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:54.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f000b200640 1 -- 172.21.15.59:0/144708881 shutdown_connections 2024-05-30T16:55:54.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.882+0000 7f000b200640 1 -- 172.21.15.59:0/144708881 wait complete. 2024-05-30T16:55:54.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000b200640 1 Processor -- start 2024-05-30T16:55:54.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000b200640 1 -- start start 2024-05-30T16:55:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000b200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c0b48b0 0x7f000c156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c0d0460 0x7f000c15d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15e800 0x7f000c0b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f000c0cf940 con 0x7f000c15e800 2024-05-30T16:55:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f000c0cf7c0 con 0x7f000c0d0460 2024-05-30T16:55:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000b200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f000c0cfac0 con 0x7f000c0b48b0 2024-05-30T16:55:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15e800 0x7f000c0b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15e800 0x7f000c0b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46656/0 (socket says 172.21.15.59:46656) 2024-05-30T16:55:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000a800640 1 -- 172.21.15.59:0/2306425818 learned_addr learned my addr 172.21.15.59:0/2306425818 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f0003e00640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c0d0460 0x7f000c15d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f0009e00640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c0b48b0 0x7f000c156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000a800640 1 -- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c0b48b0 msgr2=0x7f000c156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000a800640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c0b48b0 0x7f000c156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000a800640 1 -- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c0d0460 msgr2=0x7f000c15d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000a800640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c0d0460 0x7f000c15d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000a800640 1 -- 172.21.15.59:0/2306425818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c15b610 con 0x7f000c15e800 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000a800640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15e800 0x7f000c0b0920 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0004007ef0 tx=0x7f000400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f0002000640 1 -- 172.21.15.59:0/2306425818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000401a070 con 0x7f000c15e800 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f0002000640 1 -- 172.21.15.59:0/2306425818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0004003ba0 con 0x7f000c15e800 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000b200640 1 -- 172.21.15.59:0/2306425818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c15df10 con 0x7f000c15e800 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f0002000640 1 -- 172.21.15.59:0/2306425818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004004030 con 0x7f000c15e800 2024-05-30T16:55:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.886+0000 7f000b200640 1 -- 172.21.15.59:0/2306425818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c071f90 con 0x7f000c15e800 2024-05-30T16:55:54.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.890+0000 7f000b200640 1 -- 172.21.15.59:0/2306425818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000c068a90 con 0x7f000c15e800 2024-05-30T16:55:54.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.890+0000 7f0002000640 1 -- 172.21.15.59:0/2306425818 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7f000401d070 con 0x7f000c15e800 2024-05-30T16:55:54.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.890+0000 7f0002000640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7effe8068fe0 0x7effe806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:55:54.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.890+0000 7f0002000640 1 -- 172.21.15.59:0/2306425818 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f0004085530 con 0x7f000c15e800 2024-05-30T16:55:54.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.890+0000 7f0009e00640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7effe8068fe0 0x7effe806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:55:54.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.890+0000 7f0009e00640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7effe8068fe0 0x7effe806b4a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f000c0b1980 tx=0x7efffc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:55:54.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:54.894+0000 7f0002000640 1 -- 172.21.15.59:0/2306425818 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0004010070 con 0x7f000c15e800 2024-05-30T16:55:55.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.118+0000 7f000b200640 1 -- 172.21.15.59:0/2306425818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f000c157eb0 con 0x7f000c15e800 2024-05-30T16:55:55.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.118+0000 7f0002000640 1 -- 172.21.15.59:0/2306425818 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2379 (secure 0 0 0) 0x7f0004056ef0 con 0x7f000c15e800 2024-05-30T16:55:55.124 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:55:55.124 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:55:55.124 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:55:55.124 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:55:55.124 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:55:55.124 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:55:55.124 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:55:55.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:55.124 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:55:55.124 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:55:55.124 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 435, 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:55:55.125 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:55:55.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4367, 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 18163488015, 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 36727758848, 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 736366354432, 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 726373870, 2024-05-30T16:55:55.127 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 721203911, 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 178, 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 196 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 35, 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4, 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 4, 2024-05-30T16:55:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5865 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:55:55.129 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 10, 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:55:53.196869+0000", 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: "392479d8-0f9b-4c11-a8b5-270f230c1c28": { 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 26.0 seconds before exiting (17s)\n [============================] ", 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:55:55.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:55:55.131 INFO:teuthology.orchestra.run.smithi059.stdout: "a9414ee5-8d1d-4667-a8df-31a15a5bc1b0": { 2024-05-30T16:55:55.131 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 26.0 seconds before exiting (24s)\n [============================] ", 2024-05-30T16:55:55.131 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:55:55.131 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:55:55.131 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:55.131 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:55:55.131 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:55:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.122+0000 7f000b200640 1 -- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7effe8068fe0 msgr2=0x7effe806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.122+0000 7f000b200640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7effe8068fe0 0x7effe806b4a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f000c0b1980 tx=0x7efffc009040 comp rx=0 tx=0).stop 2024-05-30T16:55:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.122+0000 7f000b200640 1 -- 172.21.15.59:0/2306425818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15e800 msgr2=0x7f000c0b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:55:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.122+0000 7f000b200640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15e800 0x7f000c0b0920 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0004007ef0 tx=0x7f000400d4a0 comp rx=0 tx=0).stop 2024-05-30T16:55:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.122+0000 7f000b200640 1 -- 172.21.15.59:0/2306425818 shutdown_connections 2024-05-30T16:55:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.122+0000 7f000b200640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7effe8068fe0 0x7effe806b4a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.122+0000 7f000b200640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15e800 0x7f000c0b0920 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.122+0000 7f000b200640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c0d0460 0x7f000c15d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.122+0000 7f000b200640 1 --2- 172.21.15.59:0/2306425818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c0b48b0 0x7f000c156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:55:55.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.122+0000 7f000b200640 1 -- 172.21.15.59:0/2306425818 >> 172.21.15.59:0/2306425818 conn(0x7f000c06bb80 msgr2=0x7f000c15a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:55:55.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.122+0000 7f000b200640 1 -- 172.21.15.59:0/2306425818 shutdown_connections 2024-05-30T16:55:55.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:55:55.122+0000 7f000b200640 1 -- 172.21.15.59:0/2306425818 wait complete. 2024-05-30T16:56:00.146 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:56:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0014400640 1 Processor -- start 2024-05-30T16:56:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0014400640 1 -- start start 2024-05-30T16:56:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0014400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f000c1558e0 0x7f000c0b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0014400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c06f8c0 0x7f000c15ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0014400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000c06de10 con 0x7f000c15f4c0 2024-05-30T16:56:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0014400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f000c15f930 con 0x7f000c1558e0 2024-05-30T16:56:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0014400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f000c06e0f0 con 0x7f000c06f8c0 2024-05-30T16:56:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0011000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c06f8c0 0x7f000c15ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0011a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f000c1558e0 0x7f000c0b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0011a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f000c1558e0 0x7f000c0b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:41856/0 (socket says 172.21.15.59:41856) 2024-05-30T16:56:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0011a00640 1 -- 172.21.15.59:0/842224576 learned_addr learned my addr 172.21.15.59:0/842224576 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0011000640 1 --2- 172.21.15.59:0/842224576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c06f8c0 0x7f000c15ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:39278/0 (socket says 172.21.15.59:39278) 2024-05-30T16:56:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0011a00640 1 -- 172.21.15.59:0/842224576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c06f8c0 msgr2=0x7f000c15ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0011a00640 1 --2- 172.21.15.59:0/842224576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c06f8c0 0x7f000c15ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0011a00640 1 -- 172.21.15.59:0/842224576 >> v1:172.21.15.107:6789/0 conn(0x7f000c15f4c0 legacy=0x7f000c15b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f0011a00640 1 -- 172.21.15.59:0/842224576 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c06e3d0 con 0x7f000c1558e0 2024-05-30T16:56:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.286+0000 7f000be00640 1 -- 172.21.15.59:0/842224576 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 514031332 0 0) 0x7f000c06de10 con 0x7f000c15f4c0 2024-05-30T16:56:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f0011a00640 1 --2- 172.21.15.59:0/842224576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c1558e0 0x7f000c0b3e30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f000000b920 tx=0x7f000001ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf3cf1f6f77227c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f000be00640 1 -- 172.21.15.59:0/842224576 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00000b2070 con 0x7f000c1558e0 2024-05-30T16:56:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f000be00640 1 -- 172.21.15.59:0/842224576 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00000a5950 con 0x7f000c1558e0 2024-05-30T16:56:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f000be00640 1 -- 172.21.15.59:0/842224576 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00000a5d20 con 0x7f000c1558e0 2024-05-30T16:56:00.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f0014400640 1 -- 172.21.15.59:0/842224576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c1558e0 msgr2=0x7f000c0b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:00.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f0014400640 1 --2- 172.21.15.59:0/842224576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c1558e0 0x7f000c0b3e30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f000000b920 tx=0x7f000001ca00 comp rx=0 tx=0).stop 2024-05-30T16:56:00.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f0014400640 1 -- 172.21.15.59:0/842224576 shutdown_connections 2024-05-30T16:56:00.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f0014400640 1 --2- 172.21.15.59:0/842224576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c06f8c0 0x7f000c15ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:00.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f0014400640 1 --2- 172.21.15.59:0/842224576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c1558e0 0x7f000c0b3e30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:00.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f0014400640 1 -- 172.21.15.59:0/842224576 >> 172.21.15.59:0/842224576 conn(0x7f000c067d60 msgr2=0x7f000c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:00.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f0014400640 1 -- 172.21.15.59:0/842224576 shutdown_connections 2024-05-30T16:56:00.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f0014400640 1 -- 172.21.15.59:0/842224576 wait complete. 2024-05-30T16:56:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.290+0000 7f0014400640 1 Processor -- start 2024-05-30T16:56:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0014400640 1 -- start start 2024-05-30T16:56:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0014400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c06f8c0 0x7f000c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0014400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c1558e0 0x7f000c153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0014400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15f4c0 0x7f000c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0014400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f000c06fca0 con 0x7f000c15f4c0 2024-05-30T16:56:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0014400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f000c0b56c0 con 0x7f000c1558e0 2024-05-30T16:56:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0014400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f000c155cc0 con 0x7f000c06f8c0 2024-05-30T16:56:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0012400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15f4c0 0x7f000c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0012400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15f4c0 0x7f000c0cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46670/0 (socket says 172.21.15.59:46670) 2024-05-30T16:56:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0012400640 1 -- 172.21.15.59:0/3335046461 learned_addr learned my addr 172.21.15.59:0/3335046461 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0011000640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c1558e0 0x7f000c153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0011a00640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c06f8c0 0x7f000c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0012400640 1 -- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c06f8c0 msgr2=0x7f000c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0012400640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c06f8c0 0x7f000c0b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0012400640 1 -- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c1558e0 msgr2=0x7f000c153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0012400640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c1558e0 0x7f000c153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0012400640 1 -- 172.21.15.59:0/3335046461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c155100 con 0x7f000c15f4c0 2024-05-30T16:56:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0012400640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15f4c0 0x7f000c0cfaa0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f000400c780 tx=0x7f000400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0009600640 1 -- 172.21.15.59:0/3335046461 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004003db0 con 0x7f000c15f4c0 2024-05-30T16:56:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0009600640 1 -- 172.21.15.59:0/3335046461 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000400ce30 con 0x7f000c15f4c0 2024-05-30T16:56:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0009600640 1 -- 172.21.15.59:0/3335046461 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004005290 con 0x7f000c15f4c0 2024-05-30T16:56:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0014400640 1 -- 172.21.15.59:0/3335046461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c154060 con 0x7f000c15f4c0 2024-05-30T16:56:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0014400640 1 -- 172.21.15.59:0/3335046461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c154620 con 0x7f000c15f4c0 2024-05-30T16:56:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.294+0000 7f0014400640 1 -- 172.21.15.59:0/3335046461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000c068a90 con 0x7f000c15f4c0 2024-05-30T16:56:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.298+0000 7f0009600640 1 -- 172.21.15.59:0/3335046461 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7f0004005430 con 0x7f000c15f4c0 2024-05-30T16:56:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.298+0000 7f0009600640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7effec068fe0 0x7effec06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.298+0000 7f0009600640 1 -- 172.21.15.59:0/3335046461 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f0004085190 con 0x7f000c15f4c0 2024-05-30T16:56:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.298+0000 7f0011a00640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7effec068fe0 0x7effec06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.298+0000 7f0011a00640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7effec068fe0 0x7effec06b4a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f00000af000 tx=0x7f00000a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:00.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.302+0000 7f0009600640 1 -- 172.21.15.59:0/3335046461 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0004056ad0 con 0x7f000c15f4c0 2024-05-30T16:56:00.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.522+0000 7f0014400640 1 -- 172.21.15.59:0/3335046461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f000c0d1050 con 0x7f000c15f4c0 2024-05-30T16:56:00.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.522+0000 7f0009600640 1 -- 172.21.15.59:0/3335046461 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2377 (secure 0 0 0) 0x7f0004075070 con 0x7f000c15f4c0 2024-05-30T16:56:00.528 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:00.528 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:56:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:56:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:56:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:56:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 440, 2024-05-30T16:56:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:56:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:56:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:56:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:56:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:56:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4365, 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 18163534976, 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 36727832576, 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 736366280704, 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 252645954, 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 247802461, 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 63, 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 75 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 35, 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4, 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 4, 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5865 2024-05-30T16:56:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 10, 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:55:53.196869+0000", 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "392479d8-0f9b-4c11-a8b5-270f230c1c28": { 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 20.0 seconds before exiting (23s)\n [============================] ", 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "a9414ee5-8d1d-4667-a8df-31a15a5bc1b0": { 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 20.0 seconds before exiting (30s)\n [============================] ", 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:00.536 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:56:00.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.526+0000 7f0014400640 1 -- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7effec068fe0 msgr2=0x7effec06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:00.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.526+0000 7f0014400640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7effec068fe0 0x7effec06b4a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f00000af000 tx=0x7f00000a7070 comp rx=0 tx=0).stop 2024-05-30T16:56:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.526+0000 7f0014400640 1 -- 172.21.15.59:0/3335046461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15f4c0 msgr2=0x7f000c0cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.526+0000 7f0014400640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15f4c0 0x7f000c0cfaa0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f000400c780 tx=0x7f000400cc40 comp rx=0 tx=0).stop 2024-05-30T16:56:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.526+0000 7f0014400640 1 -- 172.21.15.59:0/3335046461 shutdown_connections 2024-05-30T16:56:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.526+0000 7f0014400640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7effec068fe0 0x7effec06b4a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.526+0000 7f0014400640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000c15f4c0 0x7f000c0cfaa0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.526+0000 7f0014400640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f000c1558e0 0x7f000c153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.526+0000 7f0014400640 1 --2- 172.21.15.59:0/3335046461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f000c06f8c0 0x7f000c0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.526+0000 7f0014400640 1 -- 172.21.15.59:0/3335046461 >> 172.21.15.59:0/3335046461 conn(0x7f000c067d60 msgr2=0x7f000c0b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.526+0000 7f0014400640 1 -- 172.21.15.59:0/3335046461 shutdown_connections 2024-05-30T16:56:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:00.526+0000 7f0014400640 1 -- 172.21.15.59:0/3335046461 wait complete. 2024-05-30T16:56:04.495 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:56:04.498 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:56:05.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:56:05.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.698+0000 7f436fe00640 1 Processor -- start 2024-05-30T16:56:05.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.698+0000 7f436fe00640 1 -- start start 2024-05-30T16:56:05.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f437015e890 0x7f43700b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f437009b150 0x7f43700d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436fe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f437006ddd0 con 0x7f437015ec70 2024-05-30T16:56:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436fe00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f43700b3300 con 0x7f437015e890 2024-05-30T16:56:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f43700d0560 con 0x7f437009b150 2024-05-30T16:56:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436e000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f437015ec70 0x7f437009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46210/0 (socket says 172.21.15.59:46210) 2024-05-30T16:56:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f437015e890 0x7f43700b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436e000640 1 -- 172.21.15.59:0/3117984461 learned_addr learned my addr 172.21.15.59:0/3117984461 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436f400640 1 --2- 172.21.15.59:0/3117984461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f437009b150 0x7f43700d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436d600640 1 -- 172.21.15.59:0/3117984461 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996893999 0 0) 0x7f437006ddd0 con 0x7f437015ec70 2024-05-30T16:56:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436ea00640 1 -- 172.21.15.59:0/3117984461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f437009b150 msgr2=0x7f43700d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436ea00640 1 --2- 172.21.15.59:0/3117984461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f437009b150 0x7f43700d0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:05.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436ea00640 1 -- 172.21.15.59:0/3117984461 >> v1:172.21.15.59:6789/0 conn(0x7f437015ec70 legacy=0x7f437009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:05.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.702+0000 7f436ea00640 1 -- 172.21.15.59:0/3117984461 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43700b3020 con 0x7f437015e890 2024-05-30T16:56:05.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436ea00640 1 --2- 172.21.15.59:0/3117984461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f437015e890 0x7f43700b49e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f43600097c0 tx=0x7f436001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878632fed8e54f9f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:05.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436d600640 1 -- 172.21.15.59:0/3117984461 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43600b1070 con 0x7f437015e890 2024-05-30T16:56:05.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436d600640 1 -- 172.21.15.59:0/3117984461 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43600a8050 con 0x7f437015e890 2024-05-30T16:56:05.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436d600640 1 -- 172.21.15.59:0/3117984461 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43600ac860 con 0x7f437015e890 2024-05-30T16:56:05.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 -- 172.21.15.59:0/3117984461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f437015e890 msgr2=0x7f43700b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:05.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 --2- 172.21.15.59:0/3117984461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f437015e890 0x7f43700b49e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f43600097c0 tx=0x7f436001c3e0 comp rx=0 tx=0).stop 2024-05-30T16:56:05.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 -- 172.21.15.59:0/3117984461 shutdown_connections 2024-05-30T16:56:05.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 --2- 172.21.15.59:0/3117984461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f437009b150 0x7f43700d0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:05.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 --2- 172.21.15.59:0/3117984461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f437015e890 0x7f43700b49e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:05.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 -- 172.21.15.59:0/3117984461 >> 172.21.15.59:0/3117984461 conn(0x7f43700b3ec0 msgr2=0x7f43700b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:05.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 -- 172.21.15.59:0/3117984461 shutdown_connections 2024-05-30T16:56:05.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 -- 172.21.15.59:0/3117984461 wait complete. 2024-05-30T16:56:05.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 Processor -- start 2024-05-30T16:56:05.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 -- start start 2024-05-30T16:56:05.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f437009b150 0x7f4370156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:05.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f437015e890 0x7f43700b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:05.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f437015ec70 0x7f43700b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:05.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43700d1910 con 0x7f437009b150 2024-05-30T16:56:05.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f43700d1790 con 0x7f437015e890 2024-05-30T16:56:05.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.706+0000 7f436fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f43700d1a90 con 0x7f437015ec70 2024-05-30T16:56:05.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f437009b150 0x7f4370156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:05.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f437009b150 0x7f4370156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60380/0 (socket says 172.21.15.59:60380) 2024-05-30T16:56:05.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436ea00640 1 -- 172.21.15.59:0/2069690544 learned_addr learned my addr 172.21.15.59:0/2069690544 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436e000640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f437015e890 0x7f43700b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436f400640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f437015ec70 0x7f43700b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436ea00640 1 -- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f437015ec70 msgr2=0x7f43700b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436ea00640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f437015ec70 0x7f43700b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436ea00640 1 -- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f437015e890 msgr2=0x7f43700b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436ea00640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f437015e890 0x7f43700b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436ea00640 1 -- 172.21.15.59:0/2069690544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43700b6260 con 0x7f437009b150 2024-05-30T16:56:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436ea00640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f437009b150 0x7f4370156220 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f436001a010 tx=0x7f4360019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:05.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f4366a00640 1 -- 172.21.15.59:0/2069690544 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43600b9070 con 0x7f437009b150 2024-05-30T16:56:05.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f4366a00640 1 -- 172.21.15.59:0/2069690544 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43600ace30 con 0x7f437009b150 2024-05-30T16:56:05.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436fe00640 1 -- 172.21.15.59:0/2069690544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43700b7090 con 0x7f437009b150 2024-05-30T16:56:05.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f4366a00640 1 -- 172.21.15.59:0/2069690544 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43600b1040 con 0x7f437009b150 2024-05-30T16:56:05.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436fe00640 1 -- 172.21.15.59:0/2069690544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43700b5520 con 0x7f437009b150 2024-05-30T16:56:05.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f436fe00640 1 -- 172.21.15.59:0/2069690544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4370068a90 con 0x7f437009b150 2024-05-30T16:56:05.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.710+0000 7f4366a00640 1 -- 172.21.15.59:0/2069690544 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7f43600bc070 con 0x7f437009b150 2024-05-30T16:56:05.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.714+0000 7f4366a00640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4350068fe0 0x7f435006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:05.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.714+0000 7f4366a00640 1 -- 172.21.15.59:0/2069690544 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f436011f210 con 0x7f437009b150 2024-05-30T16:56:05.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.714+0000 7f436e000640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4350068fe0 0x7f435006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:05.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.714+0000 7f436e000640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4350068fe0 0x7f435006b4a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f43700cebf0 tx=0x7f435c007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.718+0000 7f4366a00640 1 -- 172.21.15.59:0/2069690544 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4360016090 con 0x7f437009b150 2024-05-30T16:56:05.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.938+0000 7f436fe00640 1 -- 172.21.15.59:0/2069690544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f437009adc0 con 0x7f437009b150 2024-05-30T16:56:05.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.938+0000 7f4366a00640 1 -- 172.21.15.59:0/2069690544 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2363 (secure 0 0 0) 0x7f43600f1220 con 0x7f437009b150 2024-05-30T16:56:05.944 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:05.944 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:56:05.944 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:56:05.944 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:56:05.944 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:56:05.945 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 445, 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:56:05.946 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4365, 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 18163552914, 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 36727873536, 2024-05-30T16:56:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 736366239744, 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 85, 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 6142, 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 1 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 35, 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4, 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:56:05.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 4, 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5865 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:56:05.949 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 10, 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:55:53.196869+0000", 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: "392479d8-0f9b-4c11-a8b5-270f230c1c28": { 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 14.0 seconds before exiting (29s)\n [============================] ", 2024-05-30T16:56:05.950 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:56:05.951 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:56:05.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:05.951 INFO:teuthology.orchestra.run.smithi059.stdout: "a9414ee5-8d1d-4667-a8df-31a15a5bc1b0": { 2024-05-30T16:56:05.951 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 14.0 seconds before exiting (36s)\n [============================] ", 2024-05-30T16:56:05.951 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:56:05.951 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:56:05.951 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:05.951 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:05.951 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:56:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.942+0000 7f436fe00640 1 -- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4350068fe0 msgr2=0x7f435006b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.942+0000 7f436fe00640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4350068fe0 0x7f435006b4a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f43700cebf0 tx=0x7f435c007c10 comp rx=0 tx=0).stop 2024-05-30T16:56:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.942+0000 7f436fe00640 1 -- 172.21.15.59:0/2069690544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f437009b150 msgr2=0x7f4370156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.942+0000 7f436fe00640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f437009b150 0x7f4370156220 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f436001a010 tx=0x7f4360019180 comp rx=0 tx=0).stop 2024-05-30T16:56:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.942+0000 7f436fe00640 1 -- 172.21.15.59:0/2069690544 shutdown_connections 2024-05-30T16:56:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.942+0000 7f436fe00640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4350068fe0 0x7f435006b4a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.942+0000 7f436fe00640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f437015ec70 0x7f43700b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.942+0000 7f436fe00640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f437015e890 0x7f43700b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.942+0000 7f436fe00640 1 --2- 172.21.15.59:0/2069690544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f437009b150 0x7f4370156220 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.942+0000 7f436fe00640 1 -- 172.21.15.59:0/2069690544 >> 172.21.15.59:0/2069690544 conn(0x7f43700b3ec0 msgr2=0x7f43700c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.942+0000 7f436fe00640 1 -- 172.21.15.59:0/2069690544 shutdown_connections 2024-05-30T16:56:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:05.942+0000 7f436fe00640 1 -- 172.21.15.59:0/2069690544 wait complete. 2024-05-30T16:56:10.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:56:11.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.114+0000 7f3c71800640 1 Processor -- start 2024-05-30T16:56:11.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.114+0000 7f3c71800640 1 -- start start 2024-05-30T16:56:11.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c71800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3c6c0b5c70 0x7f3c6c0d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:11.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c71800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c6c15fec0 con 0x7f3c6c06f940 2024-05-30T16:56:11.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c71800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c6c0b0480 con 0x7f3c6c06fd20 2024-05-30T16:56:11.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c71800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3c6c0b3c00 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c6be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3c6c06f940 0x7f3c6c0b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46218/0 (socket says 172.21.15.59:46218) 2024-05-30T16:56:11.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c6be00640 1 -- 172.21.15.59:0/1397519950 learned_addr learned my addr 172.21.15.59:0/1397519950 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:11.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c63400640 1 --2- 172.21.15.59:0/1397519950 >> v2:172.21.15.107:3300/0 conn(0x7f3c6c0b5c70 0x7f3c6c0d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:11.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c6b400640 1 -- 172.21.15.59:0/1397519950 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017118889 0 0) 0x7f3c6c15fec0 con 0x7f3c6c06f940 2024-05-30T16:56:11.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c6b400640 1 -- 172.21.15.59:0/1397519950 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c50003530 con 0x7f3c6c06f940 2024-05-30T16:56:11.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c6b400640 1 -- 172.21.15.59:0/1397519950 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3800362192 0 0) 0x7f3c6c0b0480 con 0x7f3c6c06fd20 2024-05-30T16:56:11.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c6b400640 1 -- 172.21.15.59:0/1397519950 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c6c15fec0 con 0x7f3c6c06fd20 2024-05-30T16:56:11.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c63400640 1 -- 172.21.15.59:0/1397519950 >> v1:172.21.15.107:6789/0 conn(0x7f3c6c06fd20 legacy=0x7f3c6c15f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:11.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c63400640 1 -- 172.21.15.59:0/1397519950 >> v1:172.21.15.59:6789/0 conn(0x7f3c6c06f940 legacy=0x7f3c6c0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:11.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.118+0000 7f3c63400640 1 -- 172.21.15.59:0/1397519950 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c0ce140 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c63400640 1 --2- 172.21.15.59:0/1397519950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c6c0b5c70 0x7f3c6c0d05f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3c540097c0 tx=0x7f3c5401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ed8a2c6a5ecfef2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:11.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c6b400640 1 -- 172.21.15.59:0/1397519950 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c540b0070 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c6b400640 1 -- 172.21.15.59:0/1397519950 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c540ab600 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c6b400640 1 -- 172.21.15.59:0/1397519950 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c540ab9b0 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c71800640 1 -- 172.21.15.59:0/1397519950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c6c0b5c70 msgr2=0x7f3c6c0d05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:11.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c71800640 1 --2- 172.21.15.59:0/1397519950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c6c0b5c70 0x7f3c6c0d05f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3c540097c0 tx=0x7f3c5401c380 comp rx=0 tx=0).stop 2024-05-30T16:56:11.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c71800640 1 -- 172.21.15.59:0/1397519950 shutdown_connections 2024-05-30T16:56:11.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c71800640 1 --2- 172.21.15.59:0/1397519950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c6c0b5c70 0x7f3c6c0d05f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:11.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c71800640 1 -- 172.21.15.59:0/1397519950 >> 172.21.15.59:0/1397519950 conn(0x7f3c6c073410 msgr2=0x7f3c6c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:11.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c71800640 1 -- 172.21.15.59:0/1397519950 shutdown_connections 2024-05-30T16:56:11.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c71800640 1 -- 172.21.15.59:0/1397519950 wait complete. 2024-05-30T16:56:11.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c71800640 1 Processor -- start 2024-05-30T16:56:11.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.122+0000 7f3c71800640 1 -- start start 2024-05-30T16:56:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c71800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c6c06f940 0x7f3c6c15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c71800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c6c06fd20 0x7f3c6c14a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c71800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6c0b5c70 0x7f3c6c15c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c71800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c0b5380 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c71800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c0b5200 con 0x7f3c6c06f940 2024-05-30T16:56:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c71800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3c6c06e5d0 con 0x7f3c6c06fd20 2024-05-30T16:56:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c70e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6c0b5c70 0x7f3c6c15c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c70e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6c0b5c70 0x7f3c6c15c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60392/0 (socket says 172.21.15.59:60392) 2024-05-30T16:56:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c70e00640 1 -- 172.21.15.59:0/3350299545 learned_addr learned my addr 172.21.15.59:0/3350299545 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c6be00640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c6c06f940 0x7f3c6c15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c70e00640 1 -- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c6c06fd20 msgr2=0x7f3c6c14a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c70e00640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c6c06fd20 0x7f3c6c14a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c70e00640 1 -- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c6c06f940 msgr2=0x7f3c6c15c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c70e00640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c6c06f940 0x7f3c6c15c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c70e00640 1 -- 172.21.15.59:0/3350299545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c15c620 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c70e00640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6c0b5c70 0x7f3c6c15c9d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400c790 tx=0x7f3c6400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c68c00640 1 -- 172.21.15.59:0/3350299545 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64003b80 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c68c00640 1 -- 172.21.15.59:0/3350299545 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c64003d20 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c68c00640 1 -- 172.21.15.59:0/3350299545 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400aa50 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c71800640 1 -- 172.21.15.59:0/3350299545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c6c15a340 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c71800640 1 -- 172.21.15.59:0/3350299545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c6c15a900 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c71800640 1 -- 172.21.15.59:0/3350299545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c6c0691a0 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.126+0000 7f3c68c00640 1 -- 172.21.15.59:0/3350299545 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 89109+0+0 (secure 0 0 0) 0x7f3c6400abf0 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.130+0000 7f3c68c00640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c48069010 0x7f3c4806b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:11.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.130+0000 7f3c68c00640 1 -- 172.21.15.59:0/3350299545 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f3c64085340 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.130+0000 7f3c6be00640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c48069010 0x7f3c4806b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:11.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.130+0000 7f3c6be00640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c48069010 0x7f3c4806b4d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0011f0 tx=0x7f3c5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:11.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.134+0000 7f3c68c00640 1 -- 172.21.15.59:0/3350299545 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3c64057350 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.354+0000 7f3c71800640 1 -- 172.21.15.59:0/3350299545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3c6c0703c0 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c68c00640 1 -- 172.21.15.59:0/3350299545 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2363 (secure 0 0 0) 0x7f3c64056c50 con 0x7f3c6c0b5c70 2024-05-30T16:56:11.361 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:11.361 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:56:11.361 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:56:11.361 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:56:11.361 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:56:11.361 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:56:11.361 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:56:11.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:11.361 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:56:11.362 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:56:11.362 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:56:11.362 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:56:11.362 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:56:11.362 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:11.362 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:56:11.362 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:56:11.362 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:56:11.362 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:56:11.362 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:11.362 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 451, 2024-05-30T16:56:11.362 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:11.363 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:56:11.364 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:56:11.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:11.364 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:56:11.364 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:56:11.364 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:11.364 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:11.364 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:56:11.364 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:56:11.364 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4365, 2024-05-30T16:56:11.364 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 18163552914, 2024-05-30T16:56:11.364 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 36727873536, 2024-05-30T16:56:11.364 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 736366239744, 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 85, 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 6056, 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 1 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 35, 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4, 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:11.365 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 4, 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5865 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:56:11.366 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 10, 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:55:53.196869+0000", 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: "392479d8-0f9b-4c11-a8b5-270f230c1c28": { 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 10.0 seconds before exiting (33s)\n [============================] ", 2024-05-30T16:56:11.367 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:56:11.368 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:56:11.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:11.368 INFO:teuthology.orchestra.run.smithi059.stdout: "a9414ee5-8d1d-4667-a8df-31a15a5bc1b0": { 2024-05-30T16:56:11.368 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 10.0 seconds before exiting (40s)\n [============================] ", 2024-05-30T16:56:11.368 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:56:11.368 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:56:11.368 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:11.368 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:11.368 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:56:11.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c71800640 1 -- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c48069010 msgr2=0x7f3c4806b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:11.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c71800640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c48069010 0x7f3c4806b4d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0011f0 tx=0x7f3c5c009040 comp rx=0 tx=0).stop 2024-05-30T16:56:11.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c71800640 1 -- 172.21.15.59:0/3350299545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6c0b5c70 msgr2=0x7f3c6c15c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:11.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c71800640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6c0b5c70 0x7f3c6c15c9d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400c790 tx=0x7f3c6400cc50 comp rx=0 tx=0).stop 2024-05-30T16:56:11.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c71800640 1 -- 172.21.15.59:0/3350299545 shutdown_connections 2024-05-30T16:56:11.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c71800640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c48069010 0x7f3c4806b4d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:11.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c71800640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6c0b5c70 0x7f3c6c15c9d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:11.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c71800640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c6c06fd20 0x7f3c6c14a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c71800640 1 --2- 172.21.15.59:0/3350299545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c6c06f940 0x7f3c6c15c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c71800640 1 -- 172.21.15.59:0/3350299545 >> 172.21.15.59:0/3350299545 conn(0x7f3c6c073410 msgr2=0x7f3c6c0d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c71800640 1 -- 172.21.15.59:0/3350299545 shutdown_connections 2024-05-30T16:56:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:11.358+0000 7f3c71800640 1 -- 172.21.15.59:0/3350299545 wait complete. 2024-05-30T16:56:16.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:56:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.530+0000 7f8f93200640 1 Processor -- start 2024-05-30T16:56:16.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.530+0000 7f8f93200640 1 -- start start 2024-05-30T16:56:16.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f93200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f9415fdd0 0x7f8f940d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:16.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f93200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8f940cbd90 0x7f8f940cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:16.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f93200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f94159570 con 0x7f8f940cda30 2024-05-30T16:56:16.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f93200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f8f940cef90 con 0x7f8f9415fdd0 2024-05-30T16:56:16.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f93200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8f940cf270 con 0x7f8f940cbd90 2024-05-30T16:56:16.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f89400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f9415fdd0 0x7f8f940d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:16.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f91e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8f940cda30 0x7f8f940cde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41308/0 (socket says 172.21.15.59:41308) 2024-05-30T16:56:16.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f91e00640 1 -- 172.21.15.59:0/2777546458 learned_addr learned my addr 172.21.15.59:0/2777546458 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:16.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f92800640 1 --2- 172.21.15.59:0/2777546458 >> v2:172.21.15.107:3300/0 conn(0x7f8f940cbd90 0x7f8f940cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:16.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f89400640 1 -- 172.21.15.59:0/2777546458 >> v2:172.21.15.107:3300/0 conn(0x7f8f940cbd90 msgr2=0x7f8f940cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:16.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f89400640 1 --2- 172.21.15.59:0/2777546458 >> v2:172.21.15.107:3300/0 conn(0x7f8f940cbd90 0x7f8f940cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:16.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f89400640 1 -- 172.21.15.59:0/2777546458 >> v1:172.21.15.59:6789/0 conn(0x7f8f940cda30 legacy=0x7f8f940cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:16.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.534+0000 7f8f89400640 1 -- 172.21.15.59:0/2777546458 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f940cf550 con 0x7f8f9415fdd0 2024-05-30T16:56:16.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f89400640 1 --2- 172.21.15.59:0/2777546458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f9415fdd0 0x7f8f940d1b50 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8f940cd310 tx=0x7f8f8401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6696b1044425e8a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:16.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f91400640 1 -- 172.21.15.59:0/2777546458 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f840b0070 con 0x7f8f9415fdd0 2024-05-30T16:56:16.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f91400640 1 -- 172.21.15.59:0/2777546458 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f84004230 con 0x7f8f9415fdd0 2024-05-30T16:56:16.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f91400640 1 -- 172.21.15.59:0/2777546458 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84003620 con 0x7f8f9415fdd0 2024-05-30T16:56:16.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 -- 172.21.15.59:0/2777546458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f9415fdd0 msgr2=0x7f8f940d1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:16.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 --2- 172.21.15.59:0/2777546458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f9415fdd0 0x7f8f940d1b50 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8f940cd310 tx=0x7f8f8401c450 comp rx=0 tx=0).stop 2024-05-30T16:56:16.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 -- 172.21.15.59:0/2777546458 shutdown_connections 2024-05-30T16:56:16.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 --2- 172.21.15.59:0/2777546458 >> v2:172.21.15.107:3300/0 conn(0x7f8f940cbd90 0x7f8f940cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:16.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 --2- 172.21.15.59:0/2777546458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f9415fdd0 0x7f8f940d1b50 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:16.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 -- 172.21.15.59:0/2777546458 >> 172.21.15.59:0/2777546458 conn(0x7f8f9409aa40 msgr2=0x7f8f940d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:16.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 -- 172.21.15.59:0/2777546458 shutdown_connections 2024-05-30T16:56:16.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 -- 172.21.15.59:0/2777546458 wait complete. 2024-05-30T16:56:16.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 Processor -- start 2024-05-30T16:56:16.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 -- start start 2024-05-30T16:56:16.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f940cbd90 0x7f8f9406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:16.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f940cda30 0x7f8f9406bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:16.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f9415fdd0 0x7f8f940b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:16.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f940d2090 con 0x7f8f940cbd90 2024-05-30T16:56:16.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8f940d0240 con 0x7f8f9415fdd0 2024-05-30T16:56:16.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f93200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8f940d2210 con 0x7f8f940cda30 2024-05-30T16:56:16.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f91e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f940cbd90 0x7f8f9406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:16.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f91e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f940cbd90 0x7f8f9406b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57180/0 (socket says 172.21.15.59:57180) 2024-05-30T16:56:16.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.538+0000 7f8f91e00640 1 -- 172.21.15.59:0/1616432640 learned_addr learned my addr 172.21.15.59:0/1616432640 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:16.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f89400640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f940cda30 0x7f8f9406bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:16.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f92800640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f9415fdd0 0x7f8f940b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:16.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f91e00640 1 -- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f940cda30 msgr2=0x7f8f9406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:16.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f91e00640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f940cda30 0x7f8f9406bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:16.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f91e00640 1 -- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f9415fdd0 msgr2=0x7f8f940b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:16.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f91e00640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f9415fdd0 0x7f8f940b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:16.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f91e00640 1 -- 172.21.15.59:0/1616432640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9415af80 con 0x7f8f940cbd90 2024-05-30T16:56:16.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f91e00640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f940cbd90 0x7f8f9406b9b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00c420 tx=0x7f8f7c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:16.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f8aa00640 1 -- 172.21.15.59:0/1616432640 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c017070 con 0x7f8f940cbd90 2024-05-30T16:56:16.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f8aa00640 1 -- 172.21.15.59:0/1616432640 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f7c005cf0 con 0x7f8f940cbd90 2024-05-30T16:56:16.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f8aa00640 1 -- 172.21.15.59:0/1616432640 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0072f0 con 0x7f8f940cbd90 2024-05-30T16:56:16.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f93200640 1 -- 172.21.15.59:0/1616432640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9415b260 con 0x7f8f940cbd90 2024-05-30T16:56:16.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f93200640 1 -- 172.21.15.59:0/1616432640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9415b820 con 0x7f8f940cbd90 2024-05-30T16:56:16.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f93200640 1 -- 172.21.15.59:0/1616432640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f94068a90 con 0x7f8f940cbd90 2024-05-30T16:56:16.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f8aa00640 1 -- 172.21.15.59:0/1616432640 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7f8f7c01a070 con 0x7f8f940cbd90 2024-05-30T16:56:16.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.542+0000 7f8f8aa00640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f70068f80 0x7f8f7006b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:16.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.546+0000 7f8f8aa00640 1 -- 172.21.15.59:0/1616432640 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f8f7c0849d0 con 0x7f8f940cbd90 2024-05-30T16:56:16.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.546+0000 7f8f89400640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f70068f80 0x7f8f7006b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:16.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.546+0000 7f8f89400640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f70068f80 0x7f8f7006b440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8f840ad000 tx=0x7f8f840a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:16.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.550+0000 7f8f8aa00640 1 -- 172.21.15.59:0/1616432640 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f7c056070 con 0x7f8f940cbd90 2024-05-30T16:56:16.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 -- 172.21.15.59:0/1616432640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8f9406e860 con 0x7f8f940cbd90 2024-05-30T16:56:16.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f8aa00640 1 -- 172.21.15.59:0/1616432640 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2330 (secure 0 0 0) 0x7f8f7c05a370 con 0x7f8f940cbd90 2024-05-30T16:56:16.777 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:16.778 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:56:16.778 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:56:16.778 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:56:16.778 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:56:16.778 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:56:16.778 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:56:16.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:16.778 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:56:16.778 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:56:16.778 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:56:16.779 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:56:16.779 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:56:16.779 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:16.779 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:56:16.779 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:56:16.779 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:56:16.779 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:56:16.779 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:16.779 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 456, 2024-05-30T16:56:16.779 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:56:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:56:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:56:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:56:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:56:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T16:56:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:56:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:56:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:56:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:56:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:56:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:56:16.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:16.781 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:56:16.781 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:56:16.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:16.781 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:56:16.781 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:56:16.781 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:16.781 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:16.781 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:56:16.781 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:56:16.781 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4365, 2024-05-30T16:56:16.781 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 18163554529, 2024-05-30T16:56:16.782 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 36727873536, 2024-05-30T16:56:16.782 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 736366239744, 2024-05-30T16:56:16.782 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:56:16.782 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 255, 2024-05-30T16:56:16.782 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:56:16.782 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T16:56:16.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:16.782 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:56:16.782 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 35, 2024-05-30T16:56:16.782 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4, 2024-05-30T16:56:16.783 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:56:16.783 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:56:16.783 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:56:16.783 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:56:16.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:16.783 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 4, 2024-05-30T16:56:16.783 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:56:16.783 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:56:16.783 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:56:16.783 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5865 2024-05-30T16:56:16.783 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:16.783 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:16.784 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:56:16.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:16.784 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:56:16.784 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:56:16.784 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:56:16.784 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:56:16.784 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:56:16.784 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:56:16.784 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:56:16.784 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:16.784 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:56:16.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:16.785 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:56:16.785 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 10, 2024-05-30T16:56:16.785 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:55:53.196869+0000", 2024-05-30T16:56:16.785 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:56:16.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:16.785 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:56:16.785 INFO:teuthology.orchestra.run.smithi059.stdout: "392479d8-0f9b-4c11-a8b5-270f230c1c28": { 2024-05-30T16:56:16.785 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 4.0 seconds before exiting (39s)\n [============================] ", 2024-05-30T16:56:16.785 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:56:16.785 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:56:16.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:16.786 INFO:teuthology.orchestra.run.smithi059.stdout: "a9414ee5-8d1d-4667-a8df-31a15a5bc1b0": { 2024-05-30T16:56:16.786 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 4.0 seconds before exiting (46s)\n [============================] ", 2024-05-30T16:56:16.786 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:56:16.786 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:56:16.786 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:16.786 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:16.786 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:56:16.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 -- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f70068f80 msgr2=0x7f8f7006b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:16.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f70068f80 0x7f8f7006b440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8f840ad000 tx=0x7f8f840a6000 comp rx=0 tx=0).stop 2024-05-30T16:56:16.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 -- 172.21.15.59:0/1616432640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f940cbd90 msgr2=0x7f8f9406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:16.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f940cbd90 0x7f8f9406b9b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00c420 tx=0x7f8f7c00c8e0 comp rx=0 tx=0).stop 2024-05-30T16:56:16.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 -- 172.21.15.59:0/1616432640 shutdown_connections 2024-05-30T16:56:16.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f70068f80 0x7f8f7006b440 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:16.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f9415fdd0 0x7f8f940b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:16.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f940cda30 0x7f8f9406bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:16.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 --2- 172.21.15.59:0/1616432640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f940cbd90 0x7f8f9406b9b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:16.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 -- 172.21.15.59:0/1616432640 >> 172.21.15.59:0/1616432640 conn(0x7f8f9409aa40 msgr2=0x7f8f94153290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 -- 172.21.15.59:0/1616432640 shutdown_connections 2024-05-30T16:56:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:16.774+0000 7f8f93200640 1 -- 172.21.15.59:0/1616432640 wait complete. 2024-05-30T16:56:21.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:56:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a42600640 1 Processor -- start 2024-05-30T16:56:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a42600640 1 -- start start 2024-05-30T16:56:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a42600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a3c15bc80 0x7f0a3c06fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a42600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3c071d70 0x7f0a3c0721d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a42600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3c15f600 con 0x7f0a3c15e8d0 2024-05-30T16:56:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a42600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0a3c072710 con 0x7f0a3c15bc80 2024-05-30T16:56:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a42600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3c06f7f0 con 0x7f0a3c071d70 2024-05-30T16:56:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a3b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a3c15bc80 0x7f0a3c06fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a3be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0a3c15e8d0 0x7f0a3c15ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39740/0 (socket says 172.21.15.59:39740) 2024-05-30T16:56:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a3be00640 1 -- 172.21.15.59:0/1622790913 learned_addr learned my addr 172.21.15.59:0/1622790913 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a32a00640 1 --2- 172.21.15.59:0/1622790913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3c071d70 0x7f0a3c0721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a3b400640 1 -- 172.21.15.59:0/1622790913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3c071d70 msgr2=0x7f0a3c0721d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a3b400640 1 --2- 172.21.15.59:0/1622790913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3c071d70 0x7f0a3c0721d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a3b400640 1 -- 172.21.15.59:0/1622790913 >> v1:172.21.15.59:6789/0 conn(0x7f0a3c15e8d0 legacy=0x7f0a3c15ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a3aa00640 1 -- 172.21.15.59:0/1622790913 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1075853437 0 0) 0x7f0a3c15f600 con 0x7f0a3c15e8d0 2024-05-30T16:56:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.950+0000 7f0a3b400640 1 -- 172.21.15.59:0/1622790913 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3c06f1a0 con 0x7f0a3c15bc80 2024-05-30T16:56:21.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.954+0000 7f0a3b400640 1 --2- 172.21.15.59:0/1622790913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a3c15bc80 0x7f0a3c06fc80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0097c0 tx=0x7f0a2c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d645864b03d49ef5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:21.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.954+0000 7f0a3aa00640 1 -- 172.21.15.59:0/1622790913 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0b0070 con 0x7f0a3c15bc80 2024-05-30T16:56:21.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.954+0000 7f0a3aa00640 1 -- 172.21.15.59:0/1622790913 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c0ab600 con 0x7f0a3c15bc80 2024-05-30T16:56:21.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.954+0000 7f0a3aa00640 1 -- 172.21.15.59:0/1622790913 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0ab9d0 con 0x7f0a3c15bc80 2024-05-30T16:56:21.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.954+0000 7f0a42600640 1 -- 172.21.15.59:0/1622790913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a3c15bc80 msgr2=0x7f0a3c06fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:21.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.954+0000 7f0a42600640 1 --2- 172.21.15.59:0/1622790913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a3c15bc80 0x7f0a3c06fc80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0097c0 tx=0x7f0a2c01c4a0 comp rx=0 tx=0).stop 2024-05-30T16:56:21.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.954+0000 7f0a42600640 1 -- 172.21.15.59:0/1622790913 shutdown_connections 2024-05-30T16:56:21.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.954+0000 7f0a42600640 1 --2- 172.21.15.59:0/1622790913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3c071d70 0x7f0a3c0721d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:21.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.954+0000 7f0a42600640 1 --2- 172.21.15.59:0/1622790913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a3c15bc80 0x7f0a3c06fc80 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:21.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.954+0000 7f0a42600640 1 -- 172.21.15.59:0/1622790913 >> 172.21.15.59:0/1622790913 conn(0x7f0a3c067d60 msgr2=0x7f0a3c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:21.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.954+0000 7f0a42600640 1 -- 172.21.15.59:0/1622790913 shutdown_connections 2024-05-30T16:56:21.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.954+0000 7f0a42600640 1 -- 172.21.15.59:0/1622790913 wait complete. 2024-05-30T16:56:21.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a42600640 1 Processor -- start 2024-05-30T16:56:21.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a42600640 1 -- start start 2024-05-30T16:56:21.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a42600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c071d70 0x7f0a3c0affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:21.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a42600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3c15bc80 0x7f0a3c165050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:21.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a42600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a3c15e8d0 0x7f0a3c14dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:21.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a42600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c0b4820 con 0x7f0a3c15e8d0 2024-05-30T16:56:21.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a42600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c0b46a0 con 0x7f0a3c071d70 2024-05-30T16:56:21.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a42600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3c1fadb0 con 0x7f0a3c15bc80 2024-05-30T16:56:21.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a3be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a3c15e8d0 0x7f0a3c14dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:21.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a3be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a3c15e8d0 0x7f0a3c14dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57882/0 (socket says 172.21.15.59:57882) 2024-05-30T16:56:21.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a3be00640 1 -- 172.21.15.59:0/250147312 learned_addr learned my addr 172.21.15.59:0/250147312 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:21.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a32a00640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3c15bc80 0x7f0a3c165050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:21.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a3b400640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c071d70 0x7f0a3c0affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:21.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a3be00640 1 -- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3c15bc80 msgr2=0x7f0a3c165050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:21.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a3be00640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3c15bc80 0x7f0a3c165050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:21.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a3be00640 1 -- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c071d70 msgr2=0x7f0a3c0affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:21.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a3be00640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c071d70 0x7f0a3c0affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:21.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a3be00640 1 -- 172.21.15.59:0/250147312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3c1fb090 con 0x7f0a3c15e8d0 2024-05-30T16:56:21.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a3be00640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a3c15e8d0 0x7f0a3c14dc00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400c700 tx=0x7f0a3400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:21.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a33e00640 1 -- 172.21.15.59:0/250147312 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34018070 con 0x7f0a3c15e8d0 2024-05-30T16:56:21.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a33e00640 1 -- 172.21.15.59:0/250147312 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3400ce10 con 0x7f0a3c15e8d0 2024-05-30T16:56:21.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a42600640 1 -- 172.21.15.59:0/250147312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3c1fb370 con 0x7f0a3c15e8d0 2024-05-30T16:56:21.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a33e00640 1 -- 172.21.15.59:0/250147312 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400a860 con 0x7f0a3c15e8d0 2024-05-30T16:56:21.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.958+0000 7f0a42600640 1 -- 172.21.15.59:0/250147312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a3c0cf560 con 0x7f0a3c15e8d0 2024-05-30T16:56:21.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.962+0000 7f0a42600640 1 -- 172.21.15.59:0/250147312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a3c068a90 con 0x7f0a3c15e8d0 2024-05-30T16:56:21.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.962+0000 7f0a33e00640 1 -- 172.21.15.59:0/250147312 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7f0a3401b070 con 0x7f0a3c15e8d0 2024-05-30T16:56:21.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.962+0000 7f0a33e00640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a18068f50 0x7f0a1806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:21.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.962+0000 7f0a33e00640 1 -- 172.21.15.59:0/250147312 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f0a34084af0 con 0x7f0a3c15e8d0 2024-05-30T16:56:21.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.962+0000 7f0a3b400640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a18068f50 0x7f0a1806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:21.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.966+0000 7f0a3b400640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a18068f50 0x7f0a1806b410 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0ad000 tx=0x7f0a2c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:21.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:21.966+0000 7f0a33e00640 1 -- 172.21.15.59:0/250147312 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a34056250 con 0x7f0a3c15e8d0 2024-05-30T16:56:22.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.190+0000 7f0a42600640 1 -- 172.21.15.59:0/250147312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0a3c0d03f0 con 0x7f0a3c15e8d0 2024-05-30T16:56:22.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.190+0000 7f0a33e00640 1 -- 172.21.15.59:0/250147312 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1824 (secure 0 0 0) 0x7f0a3405a550 con 0x7f0a3c15e8d0 2024-05-30T16:56:22.196 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:22.196 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:56:22.196 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:56:22.196 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:56:22.196 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:56:22.196 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:56:22.196 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:56:22.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.196 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:56:22.196 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:56:22.196 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:56:22.196 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:56:22.197 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:56:22.197 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:22.197 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:56:22.198 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:56:22.198 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:56:22.198 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:56:22.198 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:22.198 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 462, 2024-05-30T16:56:22.198 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:56:22.198 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:56:22.198 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:56:22.198 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:56:22.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:56:22.198 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:22.199 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4365, 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 18163554670, 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 36727873536, 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 736366239744, 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 341, 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 35, 2024-05-30T16:56:22.200 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4, 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 4, 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 5865 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:22.201 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:56:22.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.202 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:56:22.202 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:56:22.202 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:56:22.202 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:56:22.202 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:56:22.202 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:56:22.202 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:56:22.202 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:56:22.202 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:56:22.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.203 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:56:22.203 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 10, 2024-05-30T16:56:22.203 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:55:53.196869+0000", 2024-05-30T16:56:22.203 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:56:22.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.203 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": {} 2024-05-30T16:56:22.203 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:56:22.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.194+0000 7f0a42600640 1 -- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a18068f50 msgr2=0x7f0a1806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.194+0000 7f0a42600640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a18068f50 0x7f0a1806b410 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0ad000 tx=0x7f0a2c0a6000 comp rx=0 tx=0).stop 2024-05-30T16:56:22.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.194+0000 7f0a42600640 1 -- 172.21.15.59:0/250147312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a3c15e8d0 msgr2=0x7f0a3c14dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.194+0000 7f0a42600640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a3c15e8d0 0x7f0a3c14dc00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400c700 tx=0x7f0a3400cbc0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.194+0000 7f0a42600640 1 -- 172.21.15.59:0/250147312 shutdown_connections 2024-05-30T16:56:22.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.194+0000 7f0a42600640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a18068f50 0x7f0a1806b410 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.194+0000 7f0a42600640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a3c15e8d0 0x7f0a3c14dc00 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.194+0000 7f0a42600640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3c15bc80 0x7f0a3c165050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.194+0000 7f0a42600640 1 --2- 172.21.15.59:0/250147312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c071d70 0x7f0a3c0affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.194+0000 7f0a42600640 1 -- 172.21.15.59:0/250147312 >> 172.21.15.59:0/250147312 conn(0x7f0a3c067d60 msgr2=0x7f0a3c153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:22.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.194+0000 7f0a42600640 1 -- 172.21.15.59:0/250147312 shutdown_connections 2024-05-30T16:56:22.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.194+0000 7f0a42600640 1 -- 172.21.15.59:0/250147312 wait complete. 2024-05-30T16:56:22.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T16:56:22.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.354+0000 7f860e200640 1 Processor -- start 2024-05-30T16:56:22.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f860e200640 1 -- start start 2024-05-30T16:56:22.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f860e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86081569e0 0x7f860815d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f860e200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f86080ad2b0 0x7f86080cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f860e200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86080ad770 con 0x7f86080d0660 2024-05-30T16:56:22.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f860e200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f860815cb40 con 0x7f86080ad2b0 2024-05-30T16:56:22.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f860e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f860815ce20 con 0x7f86081569e0 2024-05-30T16:56:22.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8607e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f86080d0660 0x7f86080b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39750/0 (socket says 172.21.15.59:39750) 2024-05-30T16:56:22.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8607e00640 1 -- 172.21.15.59:0/650347190 learned_addr learned my addr 172.21.15.59:0/650347190 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:22.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f85fea00640 1 --2- 172.21.15.59:0/650347190 >> v2:172.21.15.107:3300/0 conn(0x7f86080ad2b0 0x7f86080cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8607400640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86081569e0 0x7f860815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152849250 0 0) 0x7f86080ad770 con 0x7f86080d0660 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85ec003530 con 0x7f86080d0660 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 205343969 0 0) 0x7f85ec003530 con 0x7f86080d0660 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86081569e0 msgr2=0x7f860815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86081569e0 0x7f860815d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 >> v2:172.21.15.107:3300/0 conn(0x7f86080ad2b0 msgr2=0x7f86080cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 --2- 172.21.15.59:0/650347190 >> v2:172.21.15.107:3300/0 conn(0x7f86080ad2b0 0x7f86080cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860815d100 con 0x7f86080d0660 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f8600001a00 con 0x7f86080d0660 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 >> v1:172.21.15.59:6789/0 conn(0x7f86080d0660 legacy=0x7f86080b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0039c0 0x7f85ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ec004810 0x7f85ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86081569e0 0x7f85ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f860815cb40 con 0x7f85ec0039c0 2024-05-30T16:56:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f860815ce20 con 0x7f85ec004810 2024-05-30T16:56:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f85ec00b9d0 con 0x7f86081569e0 2024-05-30T16:56:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8607400640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0039c0 0x7f85ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f85fea00640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ec004810 0x7f85ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8607e00640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86081569e0 0x7f85ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8607400640 1 -- 172.21.15.59:0/650347190 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86081569e0 msgr2=0x7f85ec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8607400640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86081569e0 0x7f85ec0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8607400640 1 -- 172.21.15.59:0/650347190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ec004810 msgr2=0x7f85ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8607400640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85ec004810 0x7f85ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8607400640 1 -- 172.21.15.59:0/650347190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec003530 con 0x7f85ec0039c0 2024-05-30T16:56:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.358+0000 7f8607e00640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86081569e0 0x7f85ec0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:22.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.362+0000 7f8607400640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0039c0 0x7f85ec003de0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009b10 tx=0x7f85f801c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a5c9b82c2612be server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:22.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.362+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f80b1070 con 0x7f85ec0039c0 2024-05-30T16:56:22.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.362+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f80a49a0 con 0x7f85ec0039c0 2024-05-30T16:56:22.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.362+0000 7f8606a00640 1 -- 172.21.15.59:0/650347190 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f80096b0 con 0x7f85ec0039c0 2024-05-30T16:56:22.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.362+0000 7f860e200640 1 -- 172.21.15.59:0/650347190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0039c0 msgr2=0x7f85ec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.362+0000 7f860e200640 1 --2- 172.21.15.59:0/650347190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0039c0 0x7f85ec003de0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009b10 tx=0x7f85f801c750 comp rx=0 tx=0).stop 2024-05-30T16:56:22.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.362+0000 7f8607e00640 1 -- 172.21.15.59:0/650347190 reap_dead start 2024-05-30T16:56:22.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.362+0000 7f860e200640 1 -- 172.21.15.59:0/650347190 shutdown_connections 2024-05-30T16:56:22.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.362+0000 7f860e200640 1 -- 172.21.15.59:0/650347190 >> 172.21.15.59:0/650347190 conn(0x7f860806bdb0 msgr2=0x7f860806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:22.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.362+0000 7f860e200640 1 -- 172.21.15.59:0/650347190 shutdown_connections 2024-05-30T16:56:22.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.362+0000 7f860e200640 1 -- 172.21.15.59:0/650347190 wait complete. 2024-05-30T16:56:22.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f860e200640 1 Processor -- start 2024-05-30T16:56:22.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f860e200640 1 -- start start 2024-05-30T16:56:22.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f860e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0039c0 0x7f86080998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f860e200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8608155030 0x7f860815db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f860e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f860815e080 0x7f860809b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f860e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f86080d00b0 con 0x7f85ec0039c0 2024-05-30T16:56:22.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f860e200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f86080cff30 con 0x7f8608155030 2024-05-30T16:56:22.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f860e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f86081671a0 con 0x7f860815e080 2024-05-30T16:56:22.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f8607400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0039c0 0x7f86080998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f8607400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0039c0 0x7f86080998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57888/0 (socket says 172.21.15.59:57888) 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f8607400640 1 -- 172.21.15.59:0/2658878094 learned_addr learned my addr 172.21.15.59:0/2658878094 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f8607e00640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f860815e080 0x7f860809b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f85fea00640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8608155030 0x7f860815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f8607400640 1 -- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f860815e080 msgr2=0x7f860809b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f8607400640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f860815e080 0x7f860809b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f8607400640 1 -- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8608155030 msgr2=0x7f860815db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f8607400640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8608155030 0x7f860815db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f8607400640 1 -- 172.21.15.59:0/2658878094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86080b14c0 con 0x7f85ec0039c0 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f85fea00640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8608155030 0x7f860815db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f8607400640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0039c0 0x7f86080998f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009ab0 tx=0x7f85ec005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f85ffe00640 1 -- 172.21.15.59:0/2658878094 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f80be070 con 0x7f85ec0039c0 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f85ffe00640 1 -- 172.21.15.59:0/2658878094 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f8004270 con 0x7f85ec0039c0 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f85ffe00640 1 -- 172.21.15.59:0/2658878094 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f80b1040 con 0x7f85ec0039c0 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f860e200640 1 -- 172.21.15.59:0/2658878094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86080b17a0 con 0x7f85ec0039c0 2024-05-30T16:56:22.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.366+0000 7f860e200640 1 -- 172.21.15.59:0/2658878094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86080b1d60 con 0x7f85ec0039c0 2024-05-30T16:56:22.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.370+0000 7f860e200640 1 -- 172.21.15.59:0/2658878094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8608068a90 con 0x7f85ec0039c0 2024-05-30T16:56:22.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.370+0000 7f85ffe00640 1 -- 172.21.15.59:0/2658878094 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7f85f8003620 con 0x7f85ec0039c0 2024-05-30T16:56:22.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.370+0000 7f85ffe00640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f85e4068f80 0x7f85e406b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.370+0000 7f85ffe00640 1 -- 172.21.15.59:0/2658878094 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f85f811e4c0 con 0x7f85ec0039c0 2024-05-30T16:56:22.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.370+0000 7f85fea00640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f85e4068f80 0x7f85e406b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.370+0000 7f85fea00640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f85e4068f80 0x7f85e406b440 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f86081f8a60 tx=0x7f85f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:22.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.374+0000 7f85ffe00640 1 -- 172.21.15.59:0/2658878094 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f85f80167c0 con 0x7f85ec0039c0 2024-05-30T16:56:22.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.562+0000 7f860e200640 1 -- 172.21.15.59:0/2658878094 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86080b3820 con 0x7f85e4068f80 2024-05-30T16:56:22.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f85ffe00640 1 -- 172.21.15.59:0/2658878094 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+381 (secure 0 0 0) 0x7f85f0013a20 con 0x7f85e4068f80 2024-05-30T16:56:22.574 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:22.574 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:56:22.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:22.574 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sv1" 2024-05-30T16:56:22.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:22.574 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone86895" 2024-05-30T16:56:22.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:22.574 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone86891" 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone86897" 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone86896" 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone86893" 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone86892" 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:22.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:22.576 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone86894" 2024-05-30T16:56:22.576 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:22.576 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:56:22.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f860e200640 1 -- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f85e4068f80 msgr2=0x7f85e406b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f860e200640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f85e4068f80 0x7f85e406b440 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f86081f8a60 tx=0x7f85f0008040 comp rx=0 tx=0).stop 2024-05-30T16:56:22.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f860e200640 1 -- 172.21.15.59:0/2658878094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0039c0 msgr2=0x7f86080998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f860e200640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0039c0 0x7f86080998f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009ab0 tx=0x7f85ec005840 comp rx=0 tx=0).stop 2024-05-30T16:56:22.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f860e200640 1 -- 172.21.15.59:0/2658878094 shutdown_connections 2024-05-30T16:56:22.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f860e200640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f85e4068f80 0x7f85e406b440 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f860e200640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f860815e080 0x7f860809b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f860e200640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8608155030 0x7f860815db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f860e200640 1 --2- 172.21.15.59:0/2658878094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0039c0 0x7f86080998f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f860e200640 1 -- 172.21.15.59:0/2658878094 >> 172.21.15.59:0/2658878094 conn(0x7f860806bdb0 msgr2=0x7f86080cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:22.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f860e200640 1 -- 172.21.15.59:0/2658878094 shutdown_connections 2024-05-30T16:56:22.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.570+0000 7f860e200640 1 -- 172.21.15.59:0/2658878094 wait complete. 2024-05-30T16:56:22.596 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T16:56:22.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa661200640 1 Processor -- start 2024-05-30T16:56:22.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa661200640 1 -- start start 2024-05-30T16:56:22.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa661200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa65c09aa40 0x7fa65c09b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa661200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa65c0d1050 0x7fa65c09ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa661200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa65c09b360 con 0x7fa65c06ccd0 2024-05-30T16:56:22.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa661200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa65c0d1840 con 0x7fa65c09aa40 2024-05-30T16:56:22.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa661200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa65c0cca90 con 0x7fa65c0d1050 2024-05-30T16:56:22.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa65b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa65c09aa40 0x7fa65c09b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa65b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa65c09aa40 0x7fa65c09b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57904/0 (socket says 172.21.15.59:57904) 2024-05-30T16:56:22.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa65b400640 1 -- 172.21.15.59:0/373545993 learned_addr learned my addr 172.21.15.59:0/373545993 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:22.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa652a00640 1 --2- 172.21.15.59:0/373545993 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa65c0d1050 0x7fa65c09ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa65b400640 1 -- 172.21.15.59:0/373545993 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa65c0d1050 msgr2=0x7fa65c09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:22.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa65b400640 1 --2- 172.21.15.59:0/373545993 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa65c0d1050 0x7fa65c09ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa65b400640 1 -- 172.21.15.59:0/373545993 >> v1:172.21.15.107:6789/0 conn(0x7fa65c06ccd0 legacy=0x7fa65c06d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:22.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.742+0000 7fa65b400640 1 -- 172.21.15.59:0/373545993 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65c0ccd70 con 0x7fa65c09aa40 2024-05-30T16:56:22.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa65b400640 1 --2- 172.21.15.59:0/373545993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65c09aa40 0x7fa65c09b940 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009e50 tx=0x7fa64c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9132831ed1b7f6a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:22.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa65aa00640 1 -- 172.21.15.59:0/373545993 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0b4070 con 0x7fa65c09aa40 2024-05-30T16:56:22.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa65aa00640 1 -- 172.21.15.59:0/373545993 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64c0af400 con 0x7fa65c09aa40 2024-05-30T16:56:22.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa65aa00640 1 -- 172.21.15.59:0/373545993 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0af7d0 con 0x7fa65c09aa40 2024-05-30T16:56:22.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa661200640 1 -- 172.21.15.59:0/373545993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65c09aa40 msgr2=0x7fa65c09b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa661200640 1 --2- 172.21.15.59:0/373545993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65c09aa40 0x7fa65c09b940 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009e50 tx=0x7fa64c01f1e0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa661200640 1 -- 172.21.15.59:0/373545993 shutdown_connections 2024-05-30T16:56:22.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa661200640 1 --2- 172.21.15.59:0/373545993 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa65c0d1050 0x7fa65c09ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa661200640 1 --2- 172.21.15.59:0/373545993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65c09aa40 0x7fa65c09b940 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa661200640 1 -- 172.21.15.59:0/373545993 >> 172.21.15.59:0/373545993 conn(0x7fa65c0b3db0 msgr2=0x7fa65c0b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:22.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa661200640 1 -- 172.21.15.59:0/373545993 shutdown_connections 2024-05-30T16:56:22.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa661200640 1 -- 172.21.15.59:0/373545993 wait complete. 2024-05-30T16:56:22.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa661200640 1 Processor -- start 2024-05-30T16:56:22.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.746+0000 7fa661200640 1 -- start start 2024-05-30T16:56:22.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa661200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c06ccd0 0x7fa65c0c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa661200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65c09aa40 0x7fa65c1e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa661200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa65c0d1050 0x7fa65c1e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa661200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c0d15f0 con 0x7fa65c09aa40 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa661200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c0d1470 con 0x7fa65c06ccd0 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa661200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa65c0ce580 con 0x7fa65c0d1050 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa652a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65c09aa40 0x7fa65c1e8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa652a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65c09aa40 0x7fa65c1e8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57920/0 (socket says 172.21.15.59:57920) 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa652a00640 1 -- 172.21.15.59:0/3473344389 learned_addr learned my addr 172.21.15.59:0/3473344389 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa65be00640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa65c0d1050 0x7fa65c1e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa65b400640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c06ccd0 0x7fa65c0c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa652a00640 1 -- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa65c0d1050 msgr2=0x7fa65c1e92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa652a00640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa65c0d1050 0x7fa65c1e92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa652a00640 1 -- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c06ccd0 msgr2=0x7fa65c0c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa652a00640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c06ccd0 0x7fa65c0c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa652a00640 1 -- 172.21.15.59:0/3473344389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65c0c6a70 con 0x7fa65c09aa40 2024-05-30T16:56:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa65be00640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa65c0d1050 0x7fa65c1e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:22.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa65b400640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c06ccd0 0x7fa65c0c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:22.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa652a00640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65c09aa40 0x7fa65c1e8d80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa64400d800 tx=0x7fa64400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:22.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa653e00640 1 -- 172.21.15.59:0/3473344389 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64400b6c0 con 0x7fa65c09aa40 2024-05-30T16:56:22.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa653e00640 1 -- 172.21.15.59:0/3473344389 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa644019070 con 0x7fa65c09aa40 2024-05-30T16:56:22.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa653e00640 1 -- 172.21.15.59:0/3473344389 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64400ba60 con 0x7fa65c09aa40 2024-05-30T16:56:22.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa661200640 1 -- 172.21.15.59:0/3473344389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa65c0c6d50 con 0x7fa65c09aa40 2024-05-30T16:56:22.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa661200640 1 -- 172.21.15.59:0/3473344389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa65c0c7310 con 0x7fa65c09aa40 2024-05-30T16:56:22.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa661200640 1 -- 172.21.15.59:0/3473344389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa65c068a90 con 0x7fa65c09aa40 2024-05-30T16:56:22.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.750+0000 7fa653e00640 1 -- 172.21.15.59:0/3473344389 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7fa64400bc00 con 0x7fa65c09aa40 2024-05-30T16:56:22.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.754+0000 7fa653e00640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa638068f50 0x7fa63806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:22.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.754+0000 7fa653e00640 1 -- 172.21.15.59:0/3473344389 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fa644085a80 con 0x7fa65c09aa40 2024-05-30T16:56:22.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.754+0000 7fa65b400640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa638068f50 0x7fa63806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:22.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.754+0000 7fa65b400640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa638068f50 0x7fa63806b410 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0b1000 tx=0x7fa64c0aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:22.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.758+0000 7fa653e00640 1 -- 172.21.15.59:0/3473344389 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa644057830 con 0x7fa65c09aa40 2024-05-30T16:56:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.950+0000 7fa661200640 1 -- 172.21.15.59:0/3473344389 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa65c1f80a0 con 0x7fa638068f50 2024-05-30T16:56:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.966+0000 7fa653e00640 1 -- 172.21.15.59:0/3473344389 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa64c0b9440 con 0x7fa638068f50 2024-05-30T16:56:22.971 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:22.971 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:56:22.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:22.971 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ss1" 2024-05-30T16:56:22.972 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:22.972 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:56:22.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.970+0000 7fa661200640 1 -- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa638068f50 msgr2=0x7fa63806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.970+0000 7fa661200640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa638068f50 0x7fa63806b410 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0b1000 tx=0x7fa64c0aa000 comp rx=0 tx=0).stop 2024-05-30T16:56:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.970+0000 7fa661200640 1 -- 172.21.15.59:0/3473344389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65c09aa40 msgr2=0x7fa65c1e8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.970+0000 7fa661200640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65c09aa40 0x7fa65c1e8d80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa64400d800 tx=0x7fa64400dcc0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.970+0000 7fa661200640 1 -- 172.21.15.59:0/3473344389 shutdown_connections 2024-05-30T16:56:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.970+0000 7fa661200640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa638068f50 0x7fa63806b410 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.970+0000 7fa661200640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa65c0d1050 0x7fa65c1e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.970+0000 7fa661200640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65c09aa40 0x7fa65c1e8d80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.970+0000 7fa661200640 1 --2- 172.21.15.59:0/3473344389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c06ccd0 0x7fa65c0c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.970+0000 7fa661200640 1 -- 172.21.15.59:0/3473344389 >> 172.21.15.59:0/3473344389 conn(0x7fa65c0b3db0 msgr2=0x7fa65c15e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.970+0000 7fa661200640 1 -- 172.21.15.59:0/3473344389 shutdown_connections 2024-05-30T16:56:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:22.970+0000 7fa661200640 1 -- 172.21.15.59:0/3473344389 wait complete. 2024-05-30T16:56:22.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T16:56:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.134+0000 7f5126800640 1 Processor -- start 2024-05-30T16:56:23.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.134+0000 7f5126800640 1 -- start start 2024-05-30T16:56:23.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5126800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f51201569e0 0x7f512015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5126800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51200ad2b0 0x7f51200cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5126800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51200d0660 0x7f51200d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5126800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f51200d1010 con 0x7f51200ad2b0 2024-05-30T16:56:23.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5126800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f51200ad770 con 0x7f51201569e0 2024-05-30T16:56:23.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5126800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f512015cb40 con 0x7f51200d0660 2024-05-30T16:56:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5117e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51200ad2b0 0x7f51200cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5117e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51200ad2b0 0x7f51200cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57928/0 (socket says 172.21.15.59:57928) 2024-05-30T16:56:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5117e00640 1 -- 172.21.15.59:0/2756647737 learned_addr learned my addr 172.21.15.59:0/2756647737 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f511fe00640 1 --2- 172.21.15.59:0/2756647737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51200d0660 0x7f51200d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f511f400640 1 --2- 172.21.15.59:0/2756647737 >> v2:172.21.15.107:3300/0 conn(0x7f51201569e0 0x7f512015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5117e00640 1 -- 172.21.15.59:0/2756647737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51200d0660 msgr2=0x7f51200d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5117e00640 1 --2- 172.21.15.59:0/2756647737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51200d0660 0x7f51200d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5117e00640 1 -- 172.21.15.59:0/2756647737 >> v2:172.21.15.107:3300/0 conn(0x7f51201569e0 msgr2=0x7f512015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5117e00640 1 --2- 172.21.15.59:0/2756647737 >> v2:172.21.15.107:3300/0 conn(0x7f51201569e0 0x7f512015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f5117e00640 1 -- 172.21.15.59:0/2756647737 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512015ce20 con 0x7f51200ad2b0 2024-05-30T16:56:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.138+0000 7f511fe00640 1 --2- 172.21.15.59:0/2756647737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51200d0660 0x7f51200d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:23.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f5117e00640 1 --2- 172.21.15.59:0/2756647737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51200ad2b0 0x7f51200cf9f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f51200b4c40 tx=0x7f510801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed9061fd8df7cba server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f511ea00640 1 -- 172.21.15.59:0/2756647737 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51080b1070 con 0x7f51200ad2b0 2024-05-30T16:56:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f511ea00640 1 -- 172.21.15.59:0/2756647737 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51080ac410 con 0x7f51200ad2b0 2024-05-30T16:56:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f511ea00640 1 -- 172.21.15.59:0/2756647737 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51080ac7e0 con 0x7f51200ad2b0 2024-05-30T16:56:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f5126800640 1 -- 172.21.15.59:0/2756647737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51200ad2b0 msgr2=0x7f51200cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f5126800640 1 --2- 172.21.15.59:0/2756647737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51200ad2b0 0x7f51200cf9f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f51200b4c40 tx=0x7f510801c460 comp rx=0 tx=0).stop 2024-05-30T16:56:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f5126800640 1 -- 172.21.15.59:0/2756647737 shutdown_connections 2024-05-30T16:56:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f5126800640 1 --2- 172.21.15.59:0/2756647737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51200d0660 0x7f51200d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f5126800640 1 --2- 172.21.15.59:0/2756647737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51200ad2b0 0x7f51200cf9f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f5126800640 1 --2- 172.21.15.59:0/2756647737 >> v2:172.21.15.107:3300/0 conn(0x7f51201569e0 0x7f512015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f5126800640 1 -- 172.21.15.59:0/2756647737 >> 172.21.15.59:0/2756647737 conn(0x7f512006bdb0 msgr2=0x7f512006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:23.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f5126800640 1 -- 172.21.15.59:0/2756647737 shutdown_connections 2024-05-30T16:56:23.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.142+0000 7f5126800640 1 -- 172.21.15.59:0/2756647737 wait complete. 2024-05-30T16:56:23.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5126800640 1 Processor -- start 2024-05-30T16:56:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5126800640 1 -- start start 2024-05-30T16:56:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5126800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51200ad2b0 0x7f5120146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5126800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51200d0660 0x7f5120099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5126800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51201569e0 0x7f5120148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5126800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f51200d00b0 con 0x7f51200ad2b0 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5126800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f51200cff30 con 0x7f51200d0660 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5126800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f51200b3ae0 con 0x7f51201569e0 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f511f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51200ad2b0 0x7f5120146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f511f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51200ad2b0 0x7f5120146ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57938/0 (socket says 172.21.15.59:57938) 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f511f400640 1 -- 172.21.15.59:0/1072793523 learned_addr learned my addr 172.21.15.59:0/1072793523 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f511fe00640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51201569e0 0x7f5120148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5117e00640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51200d0660 0x7f5120099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f511f400640 1 -- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51201569e0 msgr2=0x7f5120148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f511f400640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51201569e0 0x7f5120148220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f511f400640 1 -- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51200d0660 msgr2=0x7f5120099a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f511f400640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51200d0660 0x7f5120099a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f511f400640 1 -- 172.21.15.59:0/1072793523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5120152610 con 0x7f51200ad2b0 2024-05-30T16:56:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f511f400640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51200ad2b0 0x7f5120146ac0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f511000d5f0 tx=0x7f511000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5117400640 1 -- 172.21.15.59:0/1072793523 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51100125f0 con 0x7f51200ad2b0 2024-05-30T16:56:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5117400640 1 -- 172.21.15.59:0/1072793523 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5110019070 con 0x7f51200ad2b0 2024-05-30T16:56:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5126800640 1 -- 172.21.15.59:0/1072793523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5120073190 con 0x7f51200ad2b0 2024-05-30T16:56:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5117400640 1 -- 172.21.15.59:0/1072793523 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51100129b0 con 0x7f51200ad2b0 2024-05-30T16:56:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.146+0000 7f5126800640 1 -- 172.21.15.59:0/1072793523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512014df20 con 0x7f51200ad2b0 2024-05-30T16:56:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.150+0000 7f5126800640 1 -- 172.21.15.59:0/1072793523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5120068a90 con 0x7f51200ad2b0 2024-05-30T16:56:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.150+0000 7f5117400640 1 -- 172.21.15.59:0/1072793523 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7f5110012b50 con 0x7f51200ad2b0 2024-05-30T16:56:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.150+0000 7f5117400640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f50fc068f50 0x7f50fc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.150+0000 7f5117400640 1 -- 172.21.15.59:0/1072793523 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f5110085820 con 0x7f51200ad2b0 2024-05-30T16:56:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.150+0000 7f5117e00640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f50fc068f50 0x7f50fc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.150+0000 7f5117e00640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f50fc068f50 0x7f50fc06b410 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f51080ae000 tx=0x7f5108009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:23.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.154+0000 7f5117400640 1 -- 172.21.15.59:0/1072793523 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5110056f80 con 0x7f51200ad2b0 2024-05-30T16:56:23.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.354+0000 7f5126800640 1 -- 172.21.15.59:0/1072793523 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51200cf2e0 con 0x7f50fc068f50 2024-05-30T16:56:23.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.382+0000 7f5117400640 1 -- 172.21.15.59:0/1072793523 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f51080ac610 con 0x7f50fc068f50 2024-05-30T16:56:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:23.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.386+0000 7f5126800640 1 -- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f50fc068f50 msgr2=0x7f50fc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.386+0000 7f5126800640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f50fc068f50 0x7f50fc06b410 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f51080ae000 tx=0x7f5108009040 comp rx=0 tx=0).stop 2024-05-30T16:56:23.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.386+0000 7f5126800640 1 -- 172.21.15.59:0/1072793523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51200ad2b0 msgr2=0x7f5120146ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.386+0000 7f5126800640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51200ad2b0 0x7f5120146ac0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f511000d5f0 tx=0x7f511000dab0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.386+0000 7f5126800640 1 -- 172.21.15.59:0/1072793523 shutdown_connections 2024-05-30T16:56:23.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.386+0000 7f5126800640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f50fc068f50 0x7f50fc06b410 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.386+0000 7f5126800640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51201569e0 0x7f5120148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.386+0000 7f5126800640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51200d0660 0x7f5120099a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.386+0000 7f5126800640 1 --2- 172.21.15.59:0/1072793523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51200ad2b0 0x7f5120146ac0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.386+0000 7f5126800640 1 -- 172.21.15.59:0/1072793523 >> 172.21.15.59:0/1072793523 conn(0x7f512006bdb0 msgr2=0x7f5120153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:23.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.386+0000 7f5126800640 1 -- 172.21.15.59:0/1072793523 shutdown_connections 2024-05-30T16:56:23.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.386+0000 7f5126800640 1 -- 172.21.15.59:0/1072793523 wait complete. 2024-05-30T16:56:23.409 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T16:56:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.546+0000 7f1c62400640 1 Processor -- start 2024-05-30T16:56:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c62400640 1 -- start start 2024-05-30T16:56:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c62400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1c5c15e730 0x7f1c5c0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c62400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5c0cc5a0 0x7f1c5c06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c62400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c5c15ecf0 con 0x7f1c5c15ad50 2024-05-30T16:56:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c62400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1c5c0cc9f0 con 0x7f1c5c15e730 2024-05-30T16:56:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c62400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1c5c15efd0 con 0x7f1c5c0cc5a0 2024-05-30T16:56:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c5b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1c5c15ad50 0x7f1c5c15bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39762/0 (socket says 172.21.15.59:39762) 2024-05-30T16:56:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c5b400640 1 -- 172.21.15.59:0/168073653 learned_addr learned my addr 172.21.15.59:0/168073653 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c5aa00640 1 --2- 172.21.15.59:0/168073653 >> v2:172.21.15.107:3300/0 conn(0x7f1c5c15e730 0x7f1c5c0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c5be00640 1 --2- 172.21.15.59:0/168073653 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5c0cc5a0 0x7f1c5c06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c5a000640 1 -- 172.21.15.59:0/168073653 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484480880 0 0) 0x7f1c5c15ecf0 con 0x7f1c5c15ad50 2024-05-30T16:56:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c5a000640 1 -- 172.21.15.59:0/168073653 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c40003530 con 0x7f1c5c15ad50 2024-05-30T16:56:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c5aa00640 1 -- 172.21.15.59:0/168073653 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5c0cc5a0 msgr2=0x7f1c5c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c5aa00640 1 --2- 172.21.15.59:0/168073653 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5c0cc5a0 0x7f1c5c06bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c5aa00640 1 -- 172.21.15.59:0/168073653 >> v1:172.21.15.59:6789/0 conn(0x7f1c5c15ad50 legacy=0x7f1c5c15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c5aa00640 1 -- 172.21.15.59:0/168073653 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5c15f2b0 con 0x7f1c5c15e730 2024-05-30T16:56:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.550+0000 7f1c5be00640 1 --2- 172.21.15.59:0/168073653 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5c0cc5a0 0x7f1c5c06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c5aa00640 1 --2- 172.21.15.59:0/168073653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c5c15e730 0x7f1c5c0cc060 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c480097f0 tx=0x7f1c4801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af963f3323c81f0a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c5a000640 1 -- 172.21.15.59:0/168073653 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c480b0070 con 0x7f1c5c15e730 2024-05-30T16:56:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c5a000640 1 -- 172.21.15.59:0/168073653 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c480ab600 con 0x7f1c5c15e730 2024-05-30T16:56:23.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c5a000640 1 -- 172.21.15.59:0/168073653 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c480ab9d0 con 0x7f1c5c15e730 2024-05-30T16:56:23.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c62400640 1 -- 172.21.15.59:0/168073653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c5c15e730 msgr2=0x7f1c5c0cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c62400640 1 --2- 172.21.15.59:0/168073653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c5c15e730 0x7f1c5c0cc060 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c480097f0 tx=0x7f1c4801c470 comp rx=0 tx=0).stop 2024-05-30T16:56:23.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c62400640 1 -- 172.21.15.59:0/168073653 shutdown_connections 2024-05-30T16:56:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c62400640 1 --2- 172.21.15.59:0/168073653 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5c0cc5a0 0x7f1c5c06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c62400640 1 --2- 172.21.15.59:0/168073653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c5c15e730 0x7f1c5c0cc060 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c62400640 1 -- 172.21.15.59:0/168073653 >> 172.21.15.59:0/168073653 conn(0x7f1c5c0cd540 msgr2=0x7f1c5c0cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c62400640 1 -- 172.21.15.59:0/168073653 shutdown_connections 2024-05-30T16:56:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c62400640 1 -- 172.21.15.59:0/168073653 wait complete. 2024-05-30T16:56:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c62400640 1 Processor -- start 2024-05-30T16:56:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.554+0000 7f1c62400640 1 -- start start 2024-05-30T16:56:23.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c62400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5c0cc5a0 0x7f1c5c0b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c62400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5c15e730 0x7f1c5c149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c62400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c5c14f3e0 0x7f1c5c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c62400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c06c7a0 con 0x7f1c5c15e730 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c62400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c06c620 con 0x7f1c5c14f3e0 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c62400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1c5c06c920 con 0x7f1c5c0cc5a0 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5c15e730 0x7f1c5c149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5c15e730 0x7f1c5c149ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57946/0 (socket says 172.21.15.59:57946) 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5aa00640 1 -- 172.21.15.59:0/2515794255 learned_addr learned my addr 172.21.15.59:0/2515794255 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5b400640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5c0cc5a0 0x7f1c5c0b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5aa00640 1 -- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5c0cc5a0 msgr2=0x7f1c5c0b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5be00640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c5c14f3e0 0x7f1c5c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5aa00640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5c0cc5a0 0x7f1c5c0b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5aa00640 1 -- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c5c14f3e0 msgr2=0x7f1c5c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5aa00640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c5c14f3e0 0x7f1c5c14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5aa00640 1 -- 172.21.15.59:0/2515794255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5c14f8a0 con 0x7f1c5c15e730 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5b400640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5c0cc5a0 0x7f1c5c0b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5be00640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c5c14f3e0 0x7f1c5c14ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:23.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c5aa00640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5c15e730 0x7f1c5c149ab0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1c480ae040 tx=0x7f1c48019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:23.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c53400640 1 -- 172.21.15.59:0/2515794255 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c480b0040 con 0x7f1c5c15e730 2024-05-30T16:56:23.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c53400640 1 -- 172.21.15.59:0/2515794255 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c480b9070 con 0x7f1c5c15e730 2024-05-30T16:56:23.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c62400640 1 -- 172.21.15.59:0/2515794255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c5c148cf0 con 0x7f1c5c15e730 2024-05-30T16:56:23.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c53400640 1 -- 172.21.15.59:0/2515794255 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c480b4670 con 0x7f1c5c15e730 2024-05-30T16:56:23.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c62400640 1 -- 172.21.15.59:0/2515794255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c5c1492b0 con 0x7f1c5c15e730 2024-05-30T16:56:23.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.558+0000 7f1c62400640 1 -- 172.21.15.59:0/2515794255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c5c068a90 con 0x7f1c5c15e730 2024-05-30T16:56:23.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.562+0000 7f1c53400640 1 -- 172.21.15.59:0/2515794255 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7f1c480b4810 con 0x7f1c5c15e730 2024-05-30T16:56:23.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.562+0000 7f1c53400640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c3c068f50 0x7f1c3c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.562+0000 7f1c53400640 1 -- 172.21.15.59:0/2515794255 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f1c4811f230 con 0x7f1c5c15e730 2024-05-30T16:56:23.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.562+0000 7f1c5b400640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c3c068f50 0x7f1c3c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.562+0000 7f1c5b400640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c3c068f50 0x7f1c3c06b410 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c005890 tx=0x7f1c4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:23.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.566+0000 7f1c53400640 1 -- 172.21.15.59:0/2515794255 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1c480abe20 con 0x7f1c5c15e730 2024-05-30T16:56:23.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.754+0000 7f1c62400640 1 -- 172.21.15.59:0/2515794255 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f1c5c0cf250 con 0x7f1c3c068f50 2024-05-30T16:56:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c53400640 1 -- 172.21.15.59:0/2515794255 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1c5c0cf250 con 0x7f1c3c068f50 2024-05-30T16:56:23.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c62400640 1 -- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c3c068f50 msgr2=0x7f1c3c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c62400640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c3c068f50 0x7f1c3c06b410 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c005890 tx=0x7f1c4c009040 comp rx=0 tx=0).stop 2024-05-30T16:56:23.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c62400640 1 -- 172.21.15.59:0/2515794255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5c15e730 msgr2=0x7f1c5c149ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c62400640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5c15e730 0x7f1c5c149ab0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1c480ae040 tx=0x7f1c48019210 comp rx=0 tx=0).stop 2024-05-30T16:56:23.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c62400640 1 -- 172.21.15.59:0/2515794255 shutdown_connections 2024-05-30T16:56:23.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c62400640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c3c068f50 0x7f1c3c06b410 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c62400640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c5c14f3e0 0x7f1c5c14ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c62400640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c5c15e730 0x7f1c5c149ab0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c62400640 1 --2- 172.21.15.59:0/2515794255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c5c0cc5a0 0x7f1c5c0b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c62400640 1 -- 172.21.15.59:0/2515794255 >> 172.21.15.59:0/2515794255 conn(0x7f1c5c0cd540 msgr2=0x7f1c5c158610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c62400640 1 -- 172.21.15.59:0/2515794255 shutdown_connections 2024-05-30T16:56:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.778+0000 7f1c62400640 1 -- 172.21.15.59:0/2515794255 wait complete. 2024-05-30T16:56:23.786 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:23.784+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:23.786 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:23.784+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:23.786 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:23.784+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:23.786 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:23.784+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:23.786 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:23.784+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:23.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone86895 2024-05-30T16:56:23.805 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:23.804+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:23.805 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:23.804+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:23.805 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:23.804+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:23.805 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:23.804+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:23.805 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:23.804+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:23.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.950+0000 7fad1be00640 1 Processor -- start 2024-05-30T16:56:23.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.950+0000 7fad1be00640 1 -- start start 2024-05-30T16:56:23.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad1c0d0e50 0x7fad1c1601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad1c1606f0 0x7fad1c06fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1be00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad1c0d0090 con 0x7fad1c15fac0 2024-05-30T16:56:23.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1be00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c160b60 con 0x7fad1c1606f0 2024-05-30T16:56:23.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1be00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c0d09c0 con 0x7fad1c0d0e50 2024-05-30T16:56:23.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad1c1606f0 0x7fad1c06fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1aa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fad1c15fac0 0x7fad1c09b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39766/0 (socket says 172.21.15.59:39766) 2024-05-30T16:56:23.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1aa00640 1 -- 172.21.15.59:0/1910792357 learned_addr learned my addr 172.21.15.59:0/1910792357 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:23.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1b400640 1 --2- 172.21.15.59:0/1910792357 >> v2:172.21.15.59:3300/0 conn(0x7fad1c1606f0 0x7fad1c06fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57962/0 (socket says 172.21.15.59:57962) 2024-05-30T16:56:23.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1a000640 1 --2- 172.21.15.59:0/1910792357 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad1c0d0e50 0x7fad1c1601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1b400640 1 -- 172.21.15.59:0/1910792357 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad1c0d0e50 msgr2=0x7fad1c1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:23.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1b400640 1 --2- 172.21.15.59:0/1910792357 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad1c0d0e50 0x7fad1c1601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1b400640 1 -- 172.21.15.59:0/1910792357 >> v1:172.21.15.59:6789/0 conn(0x7fad1c15fac0 legacy=0x7fad1c09b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1b400640 1 -- 172.21.15.59:0/1910792357 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c0d0370 con 0x7fad1c1606f0 2024-05-30T16:56:23.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad19600640 1 -- 172.21.15.59:0/1910792357 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159876393 0 0) 0x7fad1c0d0090 con 0x7fad1c15fac0 2024-05-30T16:56:23.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.954+0000 7fad1a000640 1 --2- 172.21.15.59:0/1910792357 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad1c0d0e50 0x7fad1c1601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:23.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1b400640 1 --2- 172.21.15.59:0/1910792357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c1606f0 0x7fad1c06fe00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fad14009d90 tx=0x7fad1401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179f35d84c93b3f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:23.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad19600640 1 -- 172.21.15.59:0/1910792357 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad140b2070 con 0x7fad1c1606f0 2024-05-30T16:56:23.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad19600640 1 -- 172.21.15.59:0/1910792357 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad140a5900 con 0x7fad1c1606f0 2024-05-30T16:56:23.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad19600640 1 -- 172.21.15.59:0/1910792357 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad140a5cd0 con 0x7fad1c1606f0 2024-05-30T16:56:23.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 -- 172.21.15.59:0/1910792357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c1606f0 msgr2=0x7fad1c06fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 --2- 172.21.15.59:0/1910792357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c1606f0 0x7fad1c06fe00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fad14009d90 tx=0x7fad1401c8b0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 -- 172.21.15.59:0/1910792357 shutdown_connections 2024-05-30T16:56:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 --2- 172.21.15.59:0/1910792357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c1606f0 0x7fad1c06fe00 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 --2- 172.21.15.59:0/1910792357 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad1c0d0e50 0x7fad1c1601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 -- 172.21.15.59:0/1910792357 >> 172.21.15.59:0/1910792357 conn(0x7fad1c0b3e30 msgr2=0x7fad1c0b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 -- 172.21.15.59:0/1910792357 shutdown_connections 2024-05-30T16:56:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 -- 172.21.15.59:0/1910792357 wait complete. 2024-05-30T16:56:23.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 Processor -- start 2024-05-30T16:56:23.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 -- start start 2024-05-30T16:56:23.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad1c0d0e50 0x7fad1c14a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c15fac0 0x7fad1c158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.958+0000 7fad1be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad1c1606f0 0x7fad1c159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c160ea0 con 0x7fad1c15fac0 2024-05-30T16:56:23.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1be00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c0d1230 con 0x7fad1c0d0e50 2024-05-30T16:56:23.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1be00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c161020 con 0x7fad1c1606f0 2024-05-30T16:56:23.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c15fac0 0x7fad1c158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c15fac0 0x7fad1c158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57966/0 (socket says 172.21.15.59:57966) 2024-05-30T16:56:23.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1a000640 1 -- 172.21.15.59:0/2774497317 learned_addr learned my addr 172.21.15.59:0/2774497317 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:23.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1b400640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad1c1606f0 0x7fad1c159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1aa00640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad1c0d0e50 0x7fad1c14a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1a000640 1 -- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad1c1606f0 msgr2=0x7fad1c159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1a000640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad1c1606f0 0x7fad1c159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1a000640 1 -- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad1c0d0e50 msgr2=0x7fad1c14a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:23.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1a000640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad1c0d0e50 0x7fad1c14a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:23.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1a000640 1 -- 172.21.15.59:0/2774497317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c0b4f60 con 0x7fad1c15fac0 2024-05-30T16:56:23.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1a000640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c15fac0 0x7fad1c158c00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fad0800d800 tx=0x7fad0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:23.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad12a00640 1 -- 172.21.15.59:0/2774497317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08018020 con 0x7fad1c15fac0 2024-05-30T16:56:23.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad12a00640 1 -- 172.21.15.59:0/2774497317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad080096c0 con 0x7fad1c15fac0 2024-05-30T16:56:23.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad12a00640 1 -- 172.21.15.59:0/2774497317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08009ab0 con 0x7fad1c15fac0 2024-05-30T16:56:23.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1be00640 1 -- 172.21.15.59:0/2774497317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1c14ac70 con 0x7fad1c15fac0 2024-05-30T16:56:23.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1be00640 1 -- 172.21.15.59:0/2774497317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1c0b54e0 con 0x7fad1c15fac0 2024-05-30T16:56:23.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad1be00640 1 -- 172.21.15.59:0/2774497317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1c0691a0 con 0x7fad1c15fac0 2024-05-30T16:56:23.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.962+0000 7fad12a00640 1 -- 172.21.15.59:0/2774497317 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7fad0801b020 con 0x7fad1c15fac0 2024-05-30T16:56:23.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.966+0000 7fad12a00640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7facfc068f50 0x7facfc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:23.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.966+0000 7fad12a00640 1 -- 172.21.15.59:0/2774497317 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fad08085ab0 con 0x7fad1c15fac0 2024-05-30T16:56:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.966+0000 7fad1aa00640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7facfc068f50 0x7facfc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.966+0000 7fad1aa00640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7facfc068f50 0x7facfc06b410 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fad0c007fd0 tx=0x7fad0c007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:23.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:23.970+0000 7fad12a00640 1 -- 172.21.15.59:0/2774497317 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad08022020 con 0x7fad1c15fac0 2024-05-30T16:56:24.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.158+0000 7fad1be00640 1 -- 172.21.15.59:0/2774497317 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone86895", "target": ["mon-mgr", ""]}) -- 0x7fad1c0ce750 con 0x7facfc068f50 2024-05-30T16:56:24.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.182+0000 7fad12a00640 1 -- 172.21.15.59:0/2774497317 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fad1c0ce750 con 0x7facfc068f50 2024-05-30T16:56:24.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.186+0000 7fad1be00640 1 -- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7facfc068f50 msgr2=0x7facfc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.186+0000 7fad1be00640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7facfc068f50 0x7facfc06b410 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fad0c007fd0 tx=0x7fad0c007d60 comp rx=0 tx=0).stop 2024-05-30T16:56:24.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.186+0000 7fad1be00640 1 -- 172.21.15.59:0/2774497317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c15fac0 msgr2=0x7fad1c158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.186+0000 7fad1be00640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c15fac0 0x7fad1c158c00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fad0800d800 tx=0x7fad0800dcc0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.186+0000 7fad1be00640 1 -- 172.21.15.59:0/2774497317 shutdown_connections 2024-05-30T16:56:24.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.186+0000 7fad1be00640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7facfc068f50 0x7facfc06b410 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.186+0000 7fad1be00640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad1c1606f0 0x7fad1c159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.186+0000 7fad1be00640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c15fac0 0x7fad1c158c00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.186+0000 7fad1be00640 1 --2- 172.21.15.59:0/2774497317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad1c0d0e50 0x7fad1c14a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.186+0000 7fad1be00640 1 -- 172.21.15.59:0/2774497317 >> 172.21.15.59:0/2774497317 conn(0x7fad1c0b3e30 msgr2=0x7fad1c09b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:24.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.186+0000 7fad1be00640 1 -- 172.21.15.59:0/2774497317 shutdown_connections 2024-05-30T16:56:24.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.186+0000 7fad1be00640 1 -- 172.21.15.59:0/2774497317 wait complete. 2024-05-30T16:56:24.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone86891 2024-05-30T16:56:24.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb64b000640 1 Processor -- start 2024-05-30T16:56:24.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb64b000640 1 -- start start 2024-05-30T16:56:24.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb64b000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb64415ffb0 0x7fb64409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb64b000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6440b3b20 0x7fb6440d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb64b000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6440b30c0 con 0x7fb6440b35e0 2024-05-30T16:56:24.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb64b000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb6440c5b20 con 0x7fb64415ffb0 2024-05-30T16:56:24.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb64b000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6440b2a30 con 0x7fb6440b3b20 2024-05-30T16:56:24.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb63be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb6440b35e0 0x7fb64409af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39770/0 (socket says 172.21.15.59:39770) 2024-05-30T16:56:24.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb63be00640 1 -- 172.21.15.59:0/462710574 learned_addr learned my addr 172.21.15.59:0/462710574 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:24.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb643e00640 1 --2- 172.21.15.59:0/462710574 >> v2:172.21.15.59:3300/0 conn(0x7fb64415ffb0 0x7fb64409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb649000640 1 --2- 172.21.15.59:0/462710574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6440b3b20 0x7fb6440d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb643400640 1 -- 172.21.15.59:0/462710574 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126030715 0 0) 0x7fb6440b30c0 con 0x7fb6440b35e0 2024-05-30T16:56:24.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb643400640 1 -- 172.21.15.59:0/462710574 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb628003530 con 0x7fb6440b35e0 2024-05-30T16:56:24.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.358+0000 7fb643e00640 1 -- 172.21.15.59:0/462710574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6440b3b20 msgr2=0x7fb6440d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:24.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.362+0000 7fb643e00640 1 --2- 172.21.15.59:0/462710574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6440b3b20 0x7fb6440d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.362+0000 7fb643e00640 1 -- 172.21.15.59:0/462710574 >> v1:172.21.15.59:6789/0 conn(0x7fb6440b35e0 legacy=0x7fb64409af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.362+0000 7fb643e00640 1 -- 172.21.15.59:0/462710574 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6440c5d70 con 0x7fb64415ffb0 2024-05-30T16:56:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.362+0000 7fb643e00640 1 --2- 172.21.15.59:0/462710574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64415ffb0 0x7fb64409aa40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb6340097c0 tx=0x7fb63401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4bfa7cc327e40e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.362+0000 7fb643400640 1 -- 172.21.15.59:0/462710574 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6340b0070 con 0x7fb64415ffb0 2024-05-30T16:56:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.362+0000 7fb643400640 1 -- 172.21.15.59:0/462710574 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6340ab600 con 0x7fb64415ffb0 2024-05-30T16:56:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.362+0000 7fb643400640 1 -- 172.21.15.59:0/462710574 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6340ab9d0 con 0x7fb64415ffb0 2024-05-30T16:56:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.366+0000 7fb64b000640 1 -- 172.21.15.59:0/462710574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64415ffb0 msgr2=0x7fb64409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.366+0000 7fb64b000640 1 --2- 172.21.15.59:0/462710574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64415ffb0 0x7fb64409aa40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb6340097c0 tx=0x7fb63401c4a0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.366+0000 7fb64b000640 1 -- 172.21.15.59:0/462710574 shutdown_connections 2024-05-30T16:56:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.366+0000 7fb64b000640 1 --2- 172.21.15.59:0/462710574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6440b3b20 0x7fb6440d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.366+0000 7fb64b000640 1 --2- 172.21.15.59:0/462710574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64415ffb0 0x7fb64409aa40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.366+0000 7fb64b000640 1 -- 172.21.15.59:0/462710574 >> 172.21.15.59:0/462710574 conn(0x7fb6440b3f80 msgr2=0x7fb6440b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.366+0000 7fb64b000640 1 -- 172.21.15.59:0/462710574 shutdown_connections 2024-05-30T16:56:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.366+0000 7fb64b000640 1 -- 172.21.15.59:0/462710574 wait complete. 2024-05-30T16:56:24.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.366+0000 7fb64b000640 1 Processor -- start 2024-05-30T16:56:24.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.366+0000 7fb64b000640 1 -- start start 2024-05-30T16:56:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb64b000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6440b35e0 0x7fb6440b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb64b000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6440b3b20 0x7fb6440b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb64b000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64415ffb0 0x7fb6440b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb64b000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb6440d14b0 con 0x7fb64415ffb0 2024-05-30T16:56:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb64b000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb6440d1330 con 0x7fb6440b35e0 2024-05-30T16:56:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb64b000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb64409b690 con 0x7fb6440b3b20 2024-05-30T16:56:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb649000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64415ffb0 0x7fb6440b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb649000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64415ffb0 0x7fb6440b7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57982/0 (socket says 172.21.15.59:57982) 2024-05-30T16:56:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb649000640 1 -- 172.21.15.59:0/131171552 learned_addr learned my addr 172.21.15.59:0/131171552 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb63be00640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6440b3b20 0x7fb6440b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb643e00640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6440b35e0 0x7fb6440b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb649000640 1 -- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6440b3b20 msgr2=0x7fb6440b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb649000640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6440b3b20 0x7fb6440b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb649000640 1 -- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6440b35e0 msgr2=0x7fb6440b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb649000640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6440b35e0 0x7fb6440b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb649000640 1 -- 172.21.15.59:0/131171552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6440c8050 con 0x7fb64415ffb0 2024-05-30T16:56:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb649000640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64415ffb0 0x7fb6440b7180 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00efc0 tx=0x7fb63c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb640c00640 1 -- 172.21.15.59:0/131171552 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c018020 con 0x7fb64415ffb0 2024-05-30T16:56:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb640c00640 1 -- 172.21.15.59:0/131171552 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c014480 con 0x7fb64415ffb0 2024-05-30T16:56:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb64b000640 1 -- 172.21.15.59:0/131171552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6440b7f00 con 0x7fb64415ffb0 2024-05-30T16:56:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb640c00640 1 -- 172.21.15.59:0/131171552 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c009e60 con 0x7fb64415ffb0 2024-05-30T16:56:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb64b000640 1 -- 172.21.15.59:0/131171552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6440c62c0 con 0x7fb64415ffb0 2024-05-30T16:56:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.370+0000 7fb64b000640 1 -- 172.21.15.59:0/131171552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb644068a90 con 0x7fb64415ffb0 2024-05-30T16:56:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.374+0000 7fb640c00640 1 -- 172.21.15.59:0/131171552 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7fb63c01b020 con 0x7fb64415ffb0 2024-05-30T16:56:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.374+0000 7fb640c00640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb620068f50 0x7fb62006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.374+0000 7fb640c00640 1 -- 172.21.15.59:0/131171552 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fb63c086300 con 0x7fb64415ffb0 2024-05-30T16:56:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.374+0000 7fb643e00640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb620068f50 0x7fb62006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.374+0000 7fb643e00640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb620068f50 0x7fb62006b410 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb6340ad000 tx=0x7fb634008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:24.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.378+0000 7fb640c00640 1 -- 172.21.15.59:0/131171552 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb63c022030 con 0x7fb64415ffb0 2024-05-30T16:56:24.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.566+0000 7fb64b000640 1 -- 172.21.15.59:0/131171552 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone86891", "target": ["mon-mgr", ""]}) -- 0x7fb6440d1850 con 0x7fb620068f50 2024-05-30T16:56:24.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.590+0000 7fb640c00640 1 -- 172.21.15.59:0/131171552 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb6440d1850 con 0x7fb620068f50 2024-05-30T16:56:24.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.594+0000 7fb64b000640 1 -- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb620068f50 msgr2=0x7fb62006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.594+0000 7fb64b000640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb620068f50 0x7fb62006b410 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb6340ad000 tx=0x7fb634008040 comp rx=0 tx=0).stop 2024-05-30T16:56:24.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.594+0000 7fb64b000640 1 -- 172.21.15.59:0/131171552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64415ffb0 msgr2=0x7fb6440b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.594+0000 7fb64b000640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64415ffb0 0x7fb6440b7180 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00efc0 tx=0x7fb63c00c490 comp rx=0 tx=0).stop 2024-05-30T16:56:24.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.594+0000 7fb64b000640 1 -- 172.21.15.59:0/131171552 shutdown_connections 2024-05-30T16:56:24.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.594+0000 7fb64b000640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb620068f50 0x7fb62006b410 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.594+0000 7fb64b000640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64415ffb0 0x7fb6440b7180 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.594+0000 7fb64b000640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6440b3b20 0x7fb6440b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.594+0000 7fb64b000640 1 --2- 172.21.15.59:0/131171552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6440b35e0 0x7fb6440b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.594+0000 7fb64b000640 1 -- 172.21.15.59:0/131171552 >> 172.21.15.59:0/131171552 conn(0x7fb6440b3f80 msgr2=0x7fb6440b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:24.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.594+0000 7fb64b000640 1 -- 172.21.15.59:0/131171552 shutdown_connections 2024-05-30T16:56:24.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.594+0000 7fb64b000640 1 -- 172.21.15.59:0/131171552 wait complete. 2024-05-30T16:56:24.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone86897 2024-05-30T16:56:24.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f8086000640 1 Processor -- start 2024-05-30T16:56:24.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f8086000640 1 -- start start 2024-05-30T16:56:24.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f8086000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8080156e40 0x7f808006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f8086000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f808006dc60 0x7f808015d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f8086000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80800af130 0x7f80800af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f8086000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f808015db80 con 0x7f80800af130 2024-05-30T16:56:24.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f8086000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f808006e120 con 0x7f8080156e40 2024-05-30T16:56:24.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f8086000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f808006e400 con 0x7f808006dc60 2024-05-30T16:56:24.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f807fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80800af130 0x7f80800af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f807fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80800af130 0x7f80800af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57998/0 (socket says 172.21.15.59:57998) 2024-05-30T16:56:24.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f807fe00640 1 -- 172.21.15.59:0/1075327713 learned_addr learned my addr 172.21.15.59:0/1075327713 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:24.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f807f400640 1 --2- 172.21.15.59:0/1075327713 >> v2:172.21.15.107:3300/0 conn(0x7f8080156e40 0x7f808006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f807ea00640 1 --2- 172.21.15.59:0/1075327713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f808006dc60 0x7f808015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f807fe00640 1 -- 172.21.15.59:0/1075327713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f808006dc60 msgr2=0x7f808015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:24.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f807fe00640 1 --2- 172.21.15.59:0/1075327713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f808006dc60 0x7f808015d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f807fe00640 1 -- 172.21.15.59:0/1075327713 >> v2:172.21.15.107:3300/0 conn(0x7f8080156e40 msgr2=0x7f808006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:24.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f807fe00640 1 --2- 172.21.15.59:0/1075327713 >> v2:172.21.15.107:3300/0 conn(0x7f8080156e40 0x7f808006f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.766+0000 7f807fe00640 1 -- 172.21.15.59:0/1075327713 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808006e6e0 con 0x7f80800af130 2024-05-30T16:56:24.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f807fe00640 1 --2- 172.21.15.59:0/1075327713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80800af130 0x7f80800af580 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8080073f70 tx=0x7f807801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818b5a09415cf206 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:24.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f807e000640 1 -- 172.21.15.59:0/1075327713 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80780a5760 con 0x7f80800af130 2024-05-30T16:56:24.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f807e000640 1 -- 172.21.15.59:0/1075327713 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80780a5900 con 0x7f80800af130 2024-05-30T16:56:24.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f807e000640 1 -- 172.21.15.59:0/1075327713 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80780a5cd0 con 0x7f80800af130 2024-05-30T16:56:24.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f8086000640 1 -- 172.21.15.59:0/1075327713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80800af130 msgr2=0x7f80800af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f8086000640 1 --2- 172.21.15.59:0/1075327713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80800af130 0x7f80800af580 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8080073f70 tx=0x7f807801c9f0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f8086000640 1 -- 172.21.15.59:0/1075327713 shutdown_connections 2024-05-30T16:56:24.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f8086000640 1 --2- 172.21.15.59:0/1075327713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80800af130 0x7f80800af580 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f8086000640 1 --2- 172.21.15.59:0/1075327713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f808006dc60 0x7f808015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f8086000640 1 --2- 172.21.15.59:0/1075327713 >> v2:172.21.15.107:3300/0 conn(0x7f8080156e40 0x7f808006f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f8086000640 1 -- 172.21.15.59:0/1075327713 >> 172.21.15.59:0/1075327713 conn(0x7f80800b1e60 msgr2=0x7f80800b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:24.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f8086000640 1 -- 172.21.15.59:0/1075327713 shutdown_connections 2024-05-30T16:56:24.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f8086000640 1 -- 172.21.15.59:0/1075327713 wait complete. 2024-05-30T16:56:24.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f8086000640 1 Processor -- start 2024-05-30T16:56:24.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.770+0000 7f8086000640 1 -- start start 2024-05-30T16:56:24.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f8086000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f808006dc60 0x7f808014c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f8086000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80800af130 0x7f8080155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f8086000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8080156e40 0x7f8080152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f8086000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f808015e920 con 0x7f808006dc60 2024-05-30T16:56:24.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f8086000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f808015e7a0 con 0x7f80800af130 2024-05-30T16:56:24.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f8086000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f808015eaa0 con 0x7f8080156e40 2024-05-30T16:56:24.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f807f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f808006dc60 0x7f808014c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f807f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f808006dc60 0x7f808014c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58002/0 (socket says 172.21.15.59:58002) 2024-05-30T16:56:24.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f807f400640 1 -- 172.21.15.59:0/2724269006 learned_addr learned my addr 172.21.15.59:0/2724269006 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:24.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f807fe00640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8080156e40 0x7f8080152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f807ea00640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80800af130 0x7f8080155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f807f400640 1 -- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8080156e40 msgr2=0x7f8080152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f807f400640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8080156e40 0x7f8080152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f807f400640 1 -- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80800af130 msgr2=0x7f8080155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f807f400640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80800af130 0x7f8080155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f807f400640 1 -- 172.21.15.59:0/2724269006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808014cae0 con 0x7f808006dc60 2024-05-30T16:56:24.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f807fe00640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8080156e40 0x7f8080152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:24.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f807f400640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f808006dc60 0x7f808014c5a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f807000d620 tx=0x7f807000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:24.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f8077400640 1 -- 172.21.15.59:0/2724269006 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807000b620 con 0x7f808006dc60 2024-05-30T16:56:24.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f8077400640 1 -- 172.21.15.59:0/2724269006 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8070019070 con 0x7f808006dc60 2024-05-30T16:56:24.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f8077400640 1 -- 172.21.15.59:0/2724269006 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807000b9e0 con 0x7f808006dc60 2024-05-30T16:56:24.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f8086000640 1 -- 172.21.15.59:0/2724269006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80801f8ee0 con 0x7f808006dc60 2024-05-30T16:56:24.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f8086000640 1 -- 172.21.15.59:0/2724269006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f808014e5b0 con 0x7f808006dc60 2024-05-30T16:56:24.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.774+0000 7f8086000640 1 -- 172.21.15.59:0/2724269006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8080068a90 con 0x7f808006dc60 2024-05-30T16:56:24.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.778+0000 7f8077400640 1 -- 172.21.15.59:0/2724269006 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7f807000bb80 con 0x7f808006dc60 2024-05-30T16:56:24.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.778+0000 7f8077400640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8060068f50 0x7f806006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:24.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.778+0000 7f8077400640 1 -- 172.21.15.59:0/2724269006 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f8070085a70 con 0x7f808006dc60 2024-05-30T16:56:24.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.778+0000 7f807ea00640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8060068f50 0x7f806006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:24.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.778+0000 7f807ea00640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8060068f50 0x7f806006b410 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f80801f88a0 tx=0x7f806c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:24.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.782+0000 7f8077400640 1 -- 172.21.15.59:0/2724269006 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8070057760 con 0x7f808006dc60 2024-05-30T16:56:24.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.970+0000 7f8086000640 1 -- 172.21.15.59:0/2724269006 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone86897", "target": ["mon-mgr", ""]}) -- 0x7f808006fab0 con 0x7f8060068f50 2024-05-30T16:56:24.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8077400640 1 -- 172.21.15.59:0/2724269006 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f808006fab0 con 0x7f8060068f50 2024-05-30T16:56:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8086000640 1 -- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8060068f50 msgr2=0x7f806006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8086000640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8060068f50 0x7f806006b410 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f80801f88a0 tx=0x7f806c008040 comp rx=0 tx=0).stop 2024-05-30T16:56:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8086000640 1 -- 172.21.15.59:0/2724269006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f808006dc60 msgr2=0x7f808014c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8086000640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f808006dc60 0x7f808014c5a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f807000d620 tx=0x7f807000dae0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8086000640 1 -- 172.21.15.59:0/2724269006 shutdown_connections 2024-05-30T16:56:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8086000640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8060068f50 0x7f806006b410 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8086000640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8080156e40 0x7f8080152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8086000640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80800af130 0x7f8080155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8086000640 1 --2- 172.21.15.59:0/2724269006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f808006dc60 0x7f808014c5a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8086000640 1 -- 172.21.15.59:0/2724269006 >> 172.21.15.59:0/2724269006 conn(0x7f80800b1e60 msgr2=0x7f8080160140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8086000640 1 -- 172.21.15.59:0/2724269006 shutdown_connections 2024-05-30T16:56:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:24.994+0000 7f8086000640 1 -- 172.21.15.59:0/2724269006 wait complete. 2024-05-30T16:56:25.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone86896 2024-05-30T16:56:25.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9ee3200640 1 Processor -- start 2024-05-30T16:56:25.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9ee3200640 1 -- start start 2024-05-30T16:56:25.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9ee3200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9edc162080 0x7f9edc0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9ee3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9edc0b3630 0x7f9edc0d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9ee3200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc0d2de0 con 0x7f9edc0b3f60 2024-05-30T16:56:25.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9ee3200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9edc0b5970 con 0x7f9edc162080 2024-05-30T16:56:25.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9ee3200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc0d3010 con 0x7f9edc0b3630 2024-05-30T16:56:25.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9ee1200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9edc0b3f60 0x7f9edc0b43f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39786/0 (socket says 172.21.15.59:39786) 2024-05-30T16:56:25.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9ee1200640 1 -- 172.21.15.59:0/1523034758 learned_addr learned my addr 172.21.15.59:0/1523034758 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:25.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9ed3400640 1 --2- 172.21.15.59:0/1523034758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9edc0b3630 0x7f9edc0d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9edbe00640 1 --2- 172.21.15.59:0/1523034758 >> v2:172.21.15.107:3300/0 conn(0x7f9edc162080 0x7f9edc0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9edb400640 1 -- 172.21.15.59:0/1523034758 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2161802863 0 0) 0x7f9edc0d2de0 con 0x7f9edc0b3f60 2024-05-30T16:56:25.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9edb400640 1 -- 172.21.15.59:0/1523034758 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ec0003530 con 0x7f9edc0b3f60 2024-05-30T16:56:25.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9edbe00640 1 -- 172.21.15.59:0/1523034758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9edc0b3630 msgr2=0x7f9edc0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:25.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9edbe00640 1 --2- 172.21.15.59:0/1523034758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9edc0b3630 0x7f9edc0d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9edbe00640 1 -- 172.21.15.59:0/1523034758 >> v1:172.21.15.59:6789/0 conn(0x7f9edc0b3f60 legacy=0x7f9edc0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9edbe00640 1 -- 172.21.15.59:0/1523034758 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc0b5bc0 con 0x7f9edc162080 2024-05-30T16:56:25.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.162+0000 7f9ed3400640 1 --2- 172.21.15.59:0/1523034758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9edc0b3630 0x7f9edc0d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:25.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.166+0000 7f9edbe00640 1 --2- 172.21.15.59:0/1523034758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9edc162080 0x7f9edc0d10f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0097f0 tx=0x7f9ecc01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b779fe2ff658d344 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:25.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.166+0000 7f9edb400640 1 -- 172.21.15.59:0/1523034758 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0b2070 con 0x7f9edc162080 2024-05-30T16:56:25.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.166+0000 7f9edb400640 1 -- 172.21.15.59:0/1523034758 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0ad680 con 0x7f9edc162080 2024-05-30T16:56:25.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.166+0000 7f9edb400640 1 -- 172.21.15.59:0/1523034758 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0ada50 con 0x7f9edc162080 2024-05-30T16:56:25.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.166+0000 7f9ee3200640 1 -- 172.21.15.59:0/1523034758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9edc162080 msgr2=0x7f9edc0d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.166+0000 7f9ee3200640 1 --2- 172.21.15.59:0/1523034758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9edc162080 0x7f9edc0d10f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0097f0 tx=0x7f9ecc01c470 comp rx=0 tx=0).stop 2024-05-30T16:56:25.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.166+0000 7f9ee3200640 1 -- 172.21.15.59:0/1523034758 shutdown_connections 2024-05-30T16:56:25.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.166+0000 7f9ee3200640 1 --2- 172.21.15.59:0/1523034758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9edc0b3630 0x7f9edc0d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.166+0000 7f9ee3200640 1 --2- 172.21.15.59:0/1523034758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9edc162080 0x7f9edc0d10f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.166+0000 7f9ee3200640 1 -- 172.21.15.59:0/1523034758 >> 172.21.15.59:0/1523034758 conn(0x7f9edc08bfd0 msgr2=0x7f9edc0d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:25.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.166+0000 7f9ee3200640 1 -- 172.21.15.59:0/1523034758 shutdown_connections 2024-05-30T16:56:25.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.166+0000 7f9ee3200640 1 -- 172.21.15.59:0/1523034758 wait complete. 2024-05-30T16:56:25.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ee3200640 1 Processor -- start 2024-05-30T16:56:25.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ee3200640 1 -- start start 2024-05-30T16:56:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ee3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9edc0b3630 0x7f9edc150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ee3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0b3f60 0x7f9edc15a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ee3200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9edc162080 0x7f9edc156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ee3200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc1625e0 con 0x7f9edc0b3f60 2024-05-30T16:56:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ee3200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc162460 con 0x7f9edc162080 2024-05-30T16:56:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ee3200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc0b4f10 con 0x7f9edc0b3630 2024-05-30T16:56:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ed3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0b3f60 0x7f9edc15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ed3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0b3f60 0x7f9edc15a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58006/0 (socket says 172.21.15.59:58006) 2024-05-30T16:56:25.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ed3400640 1 -- 172.21.15.59:0/975709096 learned_addr learned my addr 172.21.15.59:0/975709096 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:25.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ed3400640 1 -- 172.21.15.59:0/975709096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9edc0b3630 msgr2=0x7f9edc150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ed3400640 1 --2- 172.21.15.59:0/975709096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9edc0b3630 0x7f9edc150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ed3400640 1 -- 172.21.15.59:0/975709096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9edc162080 msgr2=0x7f9edc156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ed3400640 1 --2- 172.21.15.59:0/975709096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9edc162080 0x7f9edc156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ed3400640 1 -- 172.21.15.59:0/975709096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc0cba20 con 0x7f9edc0b3f60 2024-05-30T16:56:25.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ed3400640 1 --2- 172.21.15.59:0/975709096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0b3f60 0x7f9edc15a930 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400e980 tx=0x7f9ec400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ed8c00640 1 -- 172.21.15.59:0/975709096 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4017070 con 0x7f9edc0b3f60 2024-05-30T16:56:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ed8c00640 1 -- 172.21.15.59:0/975709096 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec400ca00 con 0x7f9edc0b3f60 2024-05-30T16:56:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ee3200640 1 -- 172.21.15.59:0/975709096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc0cbd00 con 0x7f9edc0b3f60 2024-05-30T16:56:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ed8c00640 1 -- 172.21.15.59:0/975709096 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400cdd0 con 0x7f9edc0b3f60 2024-05-30T16:56:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ee3200640 1 -- 172.21.15.59:0/975709096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc0cc2c0 con 0x7f9edc0b3f60 2024-05-30T16:56:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.170+0000 7f9ee3200640 1 -- 172.21.15.59:0/975709096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc0cb7b0 con 0x7f9edc0b3f60 2024-05-30T16:56:25.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.174+0000 7f9ed8c00640 1 -- 172.21.15.59:0/975709096 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7f9ec401a070 con 0x7f9edc0b3f60 2024-05-30T16:56:25.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.174+0000 7f9ed8c00640 1 --2- 172.21.15.59:0/975709096 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9eb8068f50 0x7f9eb806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.174+0000 7f9ed8c00640 1 -- 172.21.15.59:0/975709096 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f9ec4085840 con 0x7f9edc0b3f60 2024-05-30T16:56:25.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.174+0000 7f9edbe00640 1 --2- 172.21.15.59:0/975709096 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9eb8068f50 0x7f9eb806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.174+0000 7f9edbe00640 1 --2- 172.21.15.59:0/975709096 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9eb8068f50 0x7f9eb806b410 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0af000 tx=0x7f9ecc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:25.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.178+0000 7f9ed8c00640 1 -- 172.21.15.59:0/975709096 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9ec40575f0 con 0x7f9edc0b3f60 2024-05-30T16:56:25.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.370+0000 7f9ee3200640 1 -- 172.21.15.59:0/975709096 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone86896", "target": ["mon-mgr", ""]}) -- 0x7f9edc068a90 con 0x7f9eb8068f50 2024-05-30T16:56:25.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ed8c00640 1 -- 172.21.15.59:0/975709096 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9edc068a90 con 0x7f9eb8068f50 2024-05-30T16:56:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ee3200640 1 -- 172.21.15.59:0/975709096 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9eb8068f50 msgr2=0x7f9eb806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ee3200640 1 --2- 172.21.15.59:0/975709096 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9eb8068f50 0x7f9eb806b410 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0af000 tx=0x7f9ecc008040 comp rx=0 tx=0).stop 2024-05-30T16:56:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ee3200640 1 -- 172.21.15.59:0/975709096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0b3f60 msgr2=0x7f9edc15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ee3200640 1 --2- 172.21.15.59:0/975709096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0b3f60 0x7f9edc15a930 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400e980 tx=0x7f9ec400ee40 comp rx=0 tx=0).stop 2024-05-30T16:56:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ee3200640 1 -- 172.21.15.59:0/975709096 shutdown_connections 2024-05-30T16:56:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ee3200640 1 --2- 172.21.15.59:0/975709096 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9eb8068f50 0x7f9eb806b410 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ee3200640 1 --2- 172.21.15.59:0/975709096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9edc162080 0x7f9edc156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ee3200640 1 --2- 172.21.15.59:0/975709096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0b3f60 0x7f9edc15a930 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ee3200640 1 --2- 172.21.15.59:0/975709096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9edc0b3630 0x7f9edc150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ee3200640 1 -- 172.21.15.59:0/975709096 >> 172.21.15.59:0/975709096 conn(0x7f9edc08bfd0 msgr2=0x7f9edc0d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ee3200640 1 -- 172.21.15.59:0/975709096 shutdown_connections 2024-05-30T16:56:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.390+0000 7f9ee3200640 1 -- 172.21.15.59:0/975709096 wait complete. 2024-05-30T16:56:25.421 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone86893 2024-05-30T16:56:25.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.562+0000 7fec34200640 1 Processor -- start 2024-05-30T16:56:25.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.562+0000 7fec34200640 1 -- start start 2024-05-30T16:56:25.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec34200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fec2c09b7a0 0x7fec2c162410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec34200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec2c162950 0x7fec2c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec34200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec2c0d1020 con 0x7fec2c161ce0 2024-05-30T16:56:25.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec34200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fec2c0d1300 con 0x7fec2c09b7a0 2024-05-30T16:56:25.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec34200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fec2c0d15e0 con 0x7fec2c162950 2024-05-30T16:56:25.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec31800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fec2c161ce0 0x7fec2c0d0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39796/0 (socket says 172.21.15.59:39796) 2024-05-30T16:56:25.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec31800640 1 -- 172.21.15.59:0/2167372328 learned_addr learned my addr 172.21.15.59:0/2167372328 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:25.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec30e00640 1 --2- 172.21.15.59:0/2167372328 >> v2:172.21.15.107:3300/0 conn(0x7fec2c09b7a0 0x7fec2c162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec32200640 1 --2- 172.21.15.59:0/2167372328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec2c162950 0x7fec2c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec2be00640 1 -- 172.21.15.59:0/2167372328 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2175060701 0 0) 0x7fec2c0d1020 con 0x7fec2c161ce0 2024-05-30T16:56:25.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec2be00640 1 -- 172.21.15.59:0/2167372328 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec14003530 con 0x7fec2c161ce0 2024-05-30T16:56:25.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec2be00640 1 -- 172.21.15.59:0/2167372328 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1030564661 0 0) 0x7fec14003530 con 0x7fec2c161ce0 2024-05-30T16:56:25.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec30e00640 1 -- 172.21.15.59:0/2167372328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec2c162950 msgr2=0x7fec2c15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:25.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec30e00640 1 --2- 172.21.15.59:0/2167372328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec2c162950 0x7fec2c15e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec30e00640 1 -- 172.21.15.59:0/2167372328 >> v1:172.21.15.59:6789/0 conn(0x7fec2c161ce0 legacy=0x7fec2c0d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.566+0000 7fec30e00640 1 -- 172.21.15.59:0/2167372328 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c0d18c0 con 0x7fec2c09b7a0 2024-05-30T16:56:25.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec30e00640 1 --2- 172.21.15.59:0/2167372328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec2c09b7a0 0x7fec2c162410 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fec180097c0 tx=0x7fec1801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1154cd62e79d5b0c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:25.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec2be00640 1 -- 172.21.15.59:0/2167372328 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec180b0070 con 0x7fec2c09b7a0 2024-05-30T16:56:25.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec2be00640 1 -- 172.21.15.59:0/2167372328 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec180ab400 con 0x7fec2c09b7a0 2024-05-30T16:56:25.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec2be00640 1 -- 172.21.15.59:0/2167372328 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20001680 con 0x7fec2c09b7a0 2024-05-30T16:56:25.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec34200640 1 -- 172.21.15.59:0/2167372328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec2c09b7a0 msgr2=0x7fec2c162410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec34200640 1 --2- 172.21.15.59:0/2167372328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec2c09b7a0 0x7fec2c162410 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fec180097c0 tx=0x7fec1801c3c0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec34200640 1 -- 172.21.15.59:0/2167372328 shutdown_connections 2024-05-30T16:56:25.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec34200640 1 --2- 172.21.15.59:0/2167372328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec2c162950 0x7fec2c15e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec34200640 1 --2- 172.21.15.59:0/2167372328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec2c09b7a0 0x7fec2c162410 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec34200640 1 -- 172.21.15.59:0/2167372328 >> 172.21.15.59:0/2167372328 conn(0x7fec2c0b4000 msgr2=0x7fec2c0b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:25.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec34200640 1 -- 172.21.15.59:0/2167372328 shutdown_connections 2024-05-30T16:56:25.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec34200640 1 -- 172.21.15.59:0/2167372328 wait complete. 2024-05-30T16:56:25.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec34200640 1 Processor -- start 2024-05-30T16:56:25.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.570+0000 7fec34200640 1 -- start start 2024-05-30T16:56:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec34200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec2c09b7a0 0x7fec2c1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec34200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec2c161ce0 0x7fec2c14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec34200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec2c162950 0x7fec2c1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec34200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c15f2e0 con 0x7fec2c162950 2024-05-30T16:56:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec34200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c15f160 con 0x7fec2c161ce0 2024-05-30T16:56:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec34200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fec2c15f460 con 0x7fec2c09b7a0 2024-05-30T16:56:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec32200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec2c162950 0x7fec2c1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec32200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec2c162950 0x7fec2c1552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58012/0 (socket says 172.21.15.59:58012) 2024-05-30T16:56:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec32200640 1 -- 172.21.15.59:0/3514495992 learned_addr learned my addr 172.21.15.59:0/3514495992 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec31800640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec2c09b7a0 0x7fec2c1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec30e00640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec2c161ce0 0x7fec2c14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec32200640 1 -- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec2c09b7a0 msgr2=0x7fec2c1539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec32200640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec2c09b7a0 0x7fec2c1539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec32200640 1 -- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec2c161ce0 msgr2=0x7fec2c14fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec32200640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec2c161ce0 0x7fec2c14fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec32200640 1 -- 172.21.15.59:0/3514495992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c150540 con 0x7fec2c162950 2024-05-30T16:56:25.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec32200640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec2c162950 0x7fec2c1552e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fec24009d30 tx=0x7fec2400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:25.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec29600640 1 -- 172.21.15.59:0/3514495992 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24018020 con 0x7fec2c162950 2024-05-30T16:56:25.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec29600640 1 -- 172.21.15.59:0/3514495992 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec24014480 con 0x7fec2c162950 2024-05-30T16:56:25.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec29600640 1 -- 172.21.15.59:0/3514495992 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24014870 con 0x7fec2c162950 2024-05-30T16:56:25.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec34200640 1 -- 172.21.15.59:0/3514495992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2c150820 con 0x7fec2c162950 2024-05-30T16:56:25.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec34200640 1 -- 172.21.15.59:0/3514495992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2c150de0 con 0x7fec2c162950 2024-05-30T16:56:25.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec34200640 1 -- 172.21.15.59:0/3514495992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec2c068a90 con 0x7fec2c162950 2024-05-30T16:56:25.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.574+0000 7fec29600640 1 -- 172.21.15.59:0/3514495992 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7fec2401b020 con 0x7fec2c162950 2024-05-30T16:56:25.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.578+0000 7fec29600640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fec0c068f50 0x7fec0c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.578+0000 7fec29600640 1 -- 172.21.15.59:0/3514495992 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fec24086060 con 0x7fec2c162950 2024-05-30T16:56:25.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.578+0000 7fec31800640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fec0c068f50 0x7fec0c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.578+0000 7fec31800640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fec0c068f50 0x7fec0c06b410 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fec200013d0 tx=0x7fec20001360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:25.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.582+0000 7fec29600640 1 -- 172.21.15.59:0/3514495992 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fec24022070 con 0x7fec2c162950 2024-05-30T16:56:25.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.774+0000 7fec34200640 1 -- 172.21.15.59:0/3514495992 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone86893", "target": ["mon-mgr", ""]}) -- 0x7fec2c16a530 con 0x7fec0c068f50 2024-05-30T16:56:25.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec29600640 1 -- 172.21.15.59:0/3514495992 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fec2c16a530 con 0x7fec0c068f50 2024-05-30T16:56:25.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec34200640 1 -- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fec0c068f50 msgr2=0x7fec0c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec34200640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fec0c068f50 0x7fec0c06b410 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fec200013d0 tx=0x7fec20001360 comp rx=0 tx=0).stop 2024-05-30T16:56:25.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec34200640 1 -- 172.21.15.59:0/3514495992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec2c162950 msgr2=0x7fec2c1552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec34200640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec2c162950 0x7fec2c1552e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fec24009d30 tx=0x7fec2400c490 comp rx=0 tx=0).stop 2024-05-30T16:56:25.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec34200640 1 -- 172.21.15.59:0/3514495992 shutdown_connections 2024-05-30T16:56:25.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec34200640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fec0c068f50 0x7fec0c06b410 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec34200640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec2c162950 0x7fec2c1552e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec34200640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec2c161ce0 0x7fec2c14fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec34200640 1 --2- 172.21.15.59:0/3514495992 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec2c09b7a0 0x7fec2c1539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec34200640 1 -- 172.21.15.59:0/3514495992 >> 172.21.15.59:0/3514495992 conn(0x7fec2c0b4000 msgr2=0x7fec2c160420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:25.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec34200640 1 -- 172.21.15.59:0/3514495992 shutdown_connections 2024-05-30T16:56:25.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.790+0000 7fec34200640 1 -- 172.21.15.59:0/3514495992 wait complete. 2024-05-30T16:56:25.818 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone86892 2024-05-30T16:56:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.958+0000 7fa959000640 1 Processor -- start 2024-05-30T16:56:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.958+0000 7fa959000640 1 -- start start 2024-05-30T16:56:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa959000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa954156e40 0x7fa95406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa959000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9540af130 0x7fa9540af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa959000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa95406e120 con 0x7fa95406dc60 2024-05-30T16:56:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa959000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa95406e400 con 0x7fa954156e40 2024-05-30T16:56:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa959000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa95406e6e0 con 0x7fa9540af130 2024-05-30T16:56:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa94be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa95406dc60 0x7fa95415d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39798/0 (socket says 172.21.15.59:39798) 2024-05-30T16:56:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa94be00640 1 -- 172.21.15.59:0/1009821972 learned_addr learned my addr 172.21.15.59:0/1009821972 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa951e00640 1 --2- 172.21.15.59:0/1009821972 >> v2:172.21.15.107:3300/0 conn(0x7fa954156e40 0x7fa95406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa952800640 1 --2- 172.21.15.59:0/1009821972 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9540af130 0x7fa9540af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa951400640 1 -- 172.21.15.59:0/1009821972 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 380499889 0 0) 0x7fa95406e120 con 0x7fa95406dc60 2024-05-30T16:56:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa951400640 1 -- 172.21.15.59:0/1009821972 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa938003530 con 0x7fa95406dc60 2024-05-30T16:56:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa951e00640 1 -- 172.21.15.59:0/1009821972 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9540af130 msgr2=0x7fa9540af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa951e00640 1 --2- 172.21.15.59:0/1009821972 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9540af130 0x7fa9540af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa951e00640 1 -- 172.21.15.59:0/1009821972 >> v1:172.21.15.59:6789/0 conn(0x7fa95406dc60 legacy=0x7fa95415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.962+0000 7fa951e00640 1 -- 172.21.15.59:0/1009821972 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95406e9c0 con 0x7fa954156e40 2024-05-30T16:56:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa951e00640 1 --2- 172.21.15.59:0/1009821972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa954156e40 0x7fa95406f1c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa9440097c0 tx=0x7fa94401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1adf0935662f672e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa951400640 1 -- 172.21.15.59:0/1009821972 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440b0070 con 0x7fa954156e40 2024-05-30T16:56:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa951400640 1 -- 172.21.15.59:0/1009821972 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9440ab600 con 0x7fa954156e40 2024-05-30T16:56:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa951400640 1 -- 172.21.15.59:0/1009821972 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440ab9d0 con 0x7fa954156e40 2024-05-30T16:56:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 -- 172.21.15.59:0/1009821972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa954156e40 msgr2=0x7fa95406f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 --2- 172.21.15.59:0/1009821972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa954156e40 0x7fa95406f1c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa9440097c0 tx=0x7fa94401c4a0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 -- 172.21.15.59:0/1009821972 shutdown_connections 2024-05-30T16:56:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 --2- 172.21.15.59:0/1009821972 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9540af130 0x7fa9540af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 --2- 172.21.15.59:0/1009821972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa954156e40 0x7fa95406f1c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 -- 172.21.15.59:0/1009821972 >> 172.21.15.59:0/1009821972 conn(0x7fa9540b1e60 msgr2=0x7fa9540b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 -- 172.21.15.59:0/1009821972 shutdown_connections 2024-05-30T16:56:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 -- 172.21.15.59:0/1009821972 wait complete. 2024-05-30T16:56:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 Processor -- start 2024-05-30T16:56:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 -- start start 2024-05-30T16:56:25.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95406dc60 0x7fa9540994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9540af130 0x7fa9541459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954156e40 0x7fa954145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa95415eb30 con 0x7fa954156e40 2024-05-30T16:56:25.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa95415e9b0 con 0x7fa9540af130 2024-05-30T16:56:25.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.966+0000 7fa959000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa9540999e0 con 0x7fa95406dc60 2024-05-30T16:56:25.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa952800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954156e40 0x7fa954145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa952800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954156e40 0x7fa954145f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58016/0 (socket says 172.21.15.59:58016) 2024-05-30T16:56:25.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa952800640 1 -- 172.21.15.59:0/2675480856 learned_addr learned my addr 172.21.15.59:0/2675480856 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:25.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa94be00640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9540af130 0x7fa9541459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa951e00640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95406dc60 0x7fa9540994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa952800640 1 -- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95406dc60 msgr2=0x7fa9540994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa952800640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95406dc60 0x7fa9540994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa952800640 1 -- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9540af130 msgr2=0x7fa9541459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:25.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa952800640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9540af130 0x7fa9541459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:25.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa952800640 1 -- 172.21.15.59:0/2675480856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa954143c00 con 0x7fa954156e40 2024-05-30T16:56:25.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa952800640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954156e40 0x7fa954145f10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009d30 tx=0x7fa94c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:25.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa94a000640 1 -- 172.21.15.59:0/2675480856 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c018020 con 0x7fa954156e40 2024-05-30T16:56:25.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa94a000640 1 -- 172.21.15.59:0/2675480856 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94c014480 con 0x7fa954156e40 2024-05-30T16:56:25.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa94a000640 1 -- 172.21.15.59:0/2675480856 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c014870 con 0x7fa954156e40 2024-05-30T16:56:25.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa959000640 1 -- 172.21.15.59:0/2675480856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa954143ee0 con 0x7fa954156e40 2024-05-30T16:56:25.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa959000640 1 -- 172.21.15.59:0/2675480856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9541444a0 con 0x7fa954156e40 2024-05-30T16:56:25.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa959000640 1 -- 172.21.15.59:0/2675480856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa954068a90 con 0x7fa954156e40 2024-05-30T16:56:25.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.970+0000 7fa94a000640 1 -- 172.21.15.59:0/2675480856 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7fa94c01b020 con 0x7fa954156e40 2024-05-30T16:56:25.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.974+0000 7fa94a000640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930068f50 0x7fa93006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:25.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.974+0000 7fa94a000640 1 -- 172.21.15.59:0/2675480856 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7fa94c085ed0 con 0x7fa954156e40 2024-05-30T16:56:25.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.974+0000 7fa951e00640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930068f50 0x7fa93006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:25.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.974+0000 7fa951e00640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930068f50 0x7fa93006b410 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa9440ad000 tx=0x7fa944008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:25.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:25.978+0000 7fa94a000640 1 -- 172.21.15.59:0/2675480856 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa94c022070 con 0x7fa954156e40 2024-05-30T16:56:26.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.162+0000 7fa94a000640 1 -- 172.21.15.59:0/2675480856 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7fa94c012050 con 0x7fa954156e40 2024-05-30T16:56:26.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.170+0000 7fa959000640 1 -- 172.21.15.59:0/2675480856 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone86892", "target": ["mon-mgr", ""]}) -- 0x7fa95406fab0 con 0x7fa930068f50 2024-05-30T16:56:26.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.190+0000 7fa94a000640 1 -- 172.21.15.59:0/2675480856 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa95406fab0 con 0x7fa930068f50 2024-05-30T16:56:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.190+0000 7fa959000640 1 -- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930068f50 msgr2=0x7fa93006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.190+0000 7fa959000640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930068f50 0x7fa93006b410 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa9440ad000 tx=0x7fa944008040 comp rx=0 tx=0).stop 2024-05-30T16:56:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.190+0000 7fa959000640 1 -- 172.21.15.59:0/2675480856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954156e40 msgr2=0x7fa954145f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.190+0000 7fa959000640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954156e40 0x7fa954145f10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009d30 tx=0x7fa94c00c490 comp rx=0 tx=0).stop 2024-05-30T16:56:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.190+0000 7fa959000640 1 -- 172.21.15.59:0/2675480856 shutdown_connections 2024-05-30T16:56:26.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.190+0000 7fa959000640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930068f50 0x7fa93006b410 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.190+0000 7fa959000640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa954156e40 0x7fa954145f10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.190+0000 7fa959000640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9540af130 0x7fa9541459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.190+0000 7fa959000640 1 --2- 172.21.15.59:0/2675480856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95406dc60 0x7fa9540994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.190+0000 7fa959000640 1 -- 172.21.15.59:0/2675480856 >> 172.21.15.59:0/2675480856 conn(0x7fa9540b1e60 msgr2=0x7fa9540b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:26.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.194+0000 7fa959000640 1 -- 172.21.15.59:0/2675480856 shutdown_connections 2024-05-30T16:56:26.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.194+0000 7fa959000640 1 -- 172.21.15.59:0/2675480856 wait complete. 2024-05-30T16:56:26.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone86894 2024-05-30T16:56:26.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d86000640 1 Processor -- start 2024-05-30T16:56:26.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d86000640 1 -- start start 2024-05-30T16:56:26.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d86000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80156e40 0x7f9d8006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:26.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d86000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9d8006dc60 0x7f9d8015d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:26.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d86000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d800af130 0x7f9d800af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:26.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d86000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9d8015db80 con 0x7f9d800af130 2024-05-30T16:56:26.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d86000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9d8006e120 con 0x7f9d8006dc60 2024-05-30T16:56:26.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d86000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8006e400 con 0x7f9d80156e40 2024-05-30T16:56:26.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d7fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d800af130 0x7f9d800af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d7fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d800af130 0x7f9d800af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58032/0 (socket says 172.21.15.59:58032) 2024-05-30T16:56:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d7fe00640 1 -- 172.21.15.59:0/2544412520 learned_addr learned my addr 172.21.15.59:0/2544412520 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d77e00640 1 --2- 172.21.15.59:0/2544412520 >> v2:172.21.15.107:3300/0 conn(0x7f9d8006dc60 0x7f9d8015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d7f400640 1 --2- 172.21.15.59:0/2544412520 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80156e40 0x7f9d8006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d7fe00640 1 -- 172.21.15.59:0/2544412520 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80156e40 msgr2=0x7f9d8006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d7fe00640 1 --2- 172.21.15.59:0/2544412520 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80156e40 0x7f9d8006f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d7fe00640 1 -- 172.21.15.59:0/2544412520 >> v2:172.21.15.107:3300/0 conn(0x7f9d8006dc60 msgr2=0x7f9d8015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d7fe00640 1 --2- 172.21.15.59:0/2544412520 >> v2:172.21.15.107:3300/0 conn(0x7f9d8006dc60 0x7f9d8015d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d7fe00640 1 -- 172.21.15.59:0/2544412520 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8006e6e0 con 0x7f9d800af130 2024-05-30T16:56:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.358+0000 7f9d77e00640 1 --2- 172.21.15.59:0/2544412520 >> v2:172.21.15.107:3300/0 conn(0x7f9d8006dc60 0x7f9d8015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:26.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d7fe00640 1 --2- 172.21.15.59:0/2544412520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d800af130 0x7f9d800af580 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9d800712e0 tx=0x7f9d7801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59beb4028777e28 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:26.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d7ea00640 1 -- 172.21.15.59:0/2544412520 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d780a5760 con 0x7f9d800af130 2024-05-30T16:56:26.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d7ea00640 1 -- 172.21.15.59:0/2544412520 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d780a5900 con 0x7f9d800af130 2024-05-30T16:56:26.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d7ea00640 1 -- 172.21.15.59:0/2544412520 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d780a5cd0 con 0x7f9d800af130 2024-05-30T16:56:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d86000640 1 -- 172.21.15.59:0/2544412520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d800af130 msgr2=0x7f9d800af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d86000640 1 --2- 172.21.15.59:0/2544412520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d800af130 0x7f9d800af580 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9d800712e0 tx=0x7f9d7801c9f0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d86000640 1 -- 172.21.15.59:0/2544412520 shutdown_connections 2024-05-30T16:56:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d86000640 1 --2- 172.21.15.59:0/2544412520 >> v2:172.21.15.107:3300/0 conn(0x7f9d8006dc60 0x7f9d8015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d86000640 1 --2- 172.21.15.59:0/2544412520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d800af130 0x7f9d800af580 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d86000640 1 --2- 172.21.15.59:0/2544412520 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80156e40 0x7f9d8006f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d86000640 1 -- 172.21.15.59:0/2544412520 >> 172.21.15.59:0/2544412520 conn(0x7f9d800b1e60 msgr2=0x7f9d800b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d86000640 1 -- 172.21.15.59:0/2544412520 shutdown_connections 2024-05-30T16:56:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.362+0000 7f9d86000640 1 -- 172.21.15.59:0/2544412520 wait complete. 2024-05-30T16:56:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d86000640 1 Processor -- start 2024-05-30T16:56:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d86000640 1 -- start start 2024-05-30T16:56:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d86000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d8006dc60 0x7f9d800b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d86000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d800af130 0x7f9d8015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d86000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80156e40 0x7f9d80073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d86000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8015e920 con 0x7f9d800af130 2024-05-30T16:56:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d86000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8015e7a0 con 0x7f9d8006dc60 2024-05-30T16:56:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d86000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8015eaa0 con 0x7f9d80156e40 2024-05-30T16:56:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d77e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d800af130 0x7f9d8015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d77e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d800af130 0x7f9d8015b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58048/0 (socket says 172.21.15.59:58048) 2024-05-30T16:56:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d77e00640 1 -- 172.21.15.59:0/3516711913 learned_addr learned my addr 172.21.15.59:0/3516711913 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d7fe00640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80156e40 0x7f9d80073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d7f400640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d8006dc60 0x7f9d800b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d77e00640 1 -- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80156e40 msgr2=0x7f9d80073520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d77e00640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80156e40 0x7f9d80073520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d77e00640 1 -- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d8006dc60 msgr2=0x7f9d800b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:26.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d77e00640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d8006dc60 0x7f9d800b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d77e00640 1 -- 172.21.15.59:0/3516711913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d80148990 con 0x7f9d800af130 2024-05-30T16:56:26.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d77e00640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d800af130 0x7f9d8015b8f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800e810 tx=0x7f9d6800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:26.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d77400640 1 -- 172.21.15.59:0/3516711913 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6800f040 con 0x7f9d800af130 2024-05-30T16:56:26.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d77400640 1 -- 172.21.15.59:0/3516711913 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d68004030 con 0x7f9d800af130 2024-05-30T16:56:26.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d77400640 1 -- 172.21.15.59:0/3516711913 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68004400 con 0x7f9d800af130 2024-05-30T16:56:26.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d86000640 1 -- 172.21.15.59:0/3516711913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d80148c30 con 0x7f9d800af130 2024-05-30T16:56:26.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.366+0000 7f9d86000640 1 -- 172.21.15.59:0/3516711913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d80149640 con 0x7f9d800af130 2024-05-30T16:56:26.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.370+0000 7f9d86000640 1 -- 172.21.15.59:0/3516711913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d80068a90 con 0x7f9d800af130 2024-05-30T16:56:26.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.370+0000 7f9d77400640 1 -- 172.21.15.59:0/3516711913 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f9d6800c6d0 con 0x7f9d800af130 2024-05-30T16:56:26.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.370+0000 7f9d77400640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9d5c0690a0 0x7f9d5c06b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:26.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.370+0000 7f9d77400640 1 -- 172.21.15.59:0/3516711913 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5765+0+0 (secure 0 0 0) 0x7f9d68084f40 con 0x7f9d800af130 2024-05-30T16:56:26.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.370+0000 7f9d7f400640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9d5c0690a0 0x7f9d5c06b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:26.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.370+0000 7f9d7f400640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9d5c0690a0 0x7f9d5c06b560 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9d700079c0 tx=0x7f9d70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:26.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.374+0000 7f9d77400640 1 -- 172.21.15.59:0/3516711913 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9d68017020 con 0x7f9d800af130 2024-05-30T16:56:26.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.566+0000 7f9d86000640 1 -- 172.21.15.59:0/3516711913 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone86894", "target": ["mon-mgr", ""]}) -- 0x7f9d8006fab0 con 0x7f9d5c0690a0 2024-05-30T16:56:26.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.582+0000 7f9d77400640 1 -- 172.21.15.59:0/3516711913 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9d8006fab0 con 0x7f9d5c0690a0 2024-05-30T16:56:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.586+0000 7f9d86000640 1 -- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9d5c0690a0 msgr2=0x7f9d5c06b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.586+0000 7f9d86000640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9d5c0690a0 0x7f9d5c06b560 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9d700079c0 tx=0x7f9d70008040 comp rx=0 tx=0).stop 2024-05-30T16:56:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.586+0000 7f9d86000640 1 -- 172.21.15.59:0/3516711913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d800af130 msgr2=0x7f9d8015b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.586+0000 7f9d86000640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d800af130 0x7f9d8015b8f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800e810 tx=0x7f9d6800ecd0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.586+0000 7f9d86000640 1 -- 172.21.15.59:0/3516711913 shutdown_connections 2024-05-30T16:56:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.586+0000 7f9d86000640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9d5c0690a0 0x7f9d5c06b560 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.586+0000 7f9d86000640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80156e40 0x7f9d80073520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.586+0000 7f9d86000640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d800af130 0x7f9d8015b8f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.586+0000 7f9d86000640 1 --2- 172.21.15.59:0/3516711913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d8006dc60 0x7f9d800b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.586+0000 7f9d86000640 1 -- 172.21.15.59:0/3516711913 >> 172.21.15.59:0/3516711913 conn(0x7f9d800b1e60 msgr2=0x7f9d80149cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:26.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.586+0000 7f9d86000640 1 -- 172.21.15.59:0/3516711913 shutdown_connections 2024-05-30T16:56:26.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26.586+0000 7f9d86000640 1 -- 172.21.15.59:0/3516711913 wait complete. 2024-05-30T16:56:26.611 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T16:56:26.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:56:26.670 INFO:teuthology.orchestra.run.smithi059.stdout:2 2024-05-30T16:56:26.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:56:26.677 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:56:26.677 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:56:26.747 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:56:26.847 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:56:26.847 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:56:26.847 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:56:26.847 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:56:26.860 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:56:26.861 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:56:26.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:56:27.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.206+0000 7fbe90a00640 1 Processor -- start 2024-05-30T16:56:27.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.206+0000 7fbe90a00640 1 -- start start 2024-05-30T16:56:27.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.206+0000 7fbe90a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbe8c1535d0 0x7fbe8c15d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:27.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.206+0000 7fbe90a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe8c0cf9b0 0x7fbe8c0aef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:27.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.206+0000 7fbe90a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe8c0b4ae0 con 0x7fbe8c0af440 2024-05-30T16:56:27.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.206+0000 7fbe90a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbe8c15da40 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.206+0000 7fbe90a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbe8c1539b0 con 0x7fbe8c1535d0 2024-05-30T16:56:27.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.210+0000 7fbe89e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe8c0cf9b0 0x7fbe8c0aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:27.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.210+0000 7fbe89e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe8c0cf9b0 0x7fbe8c0aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58058/0 (socket says 172.21.15.59:58058) 2024-05-30T16:56:27.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.210+0000 7fbe89e00640 1 -- 172.21.15.59:0/2019303546 learned_addr learned my addr 172.21.15.59:0/2019303546 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:27.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.210+0000 7fbe89e00640 1 -- 172.21.15.59:0/2019303546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbe8c1535d0 msgr2=0x7fbe8c15d500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:56:27.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.210+0000 7fbe89e00640 1 --2- 172.21.15.59:0/2019303546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbe8c1535d0 0x7fbe8c15d500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:27.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.210+0000 7fbe89e00640 1 -- 172.21.15.59:0/2019303546 >> v1:172.21.15.59:6789/0 conn(0x7fbe8c0af440 legacy=0x7fbe8c1600a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:56:27.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.210+0000 7fbe89e00640 1 -- 172.21.15.59:0/2019303546 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c0ad2e0 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.214+0000 7fbe89e00640 1 --2- 172.21.15.59:0/2019303546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c0cf9b0 0x7fbe8c0aef00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009e50 tx=0x7fbe8401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e23df08d1842c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:27.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.214+0000 7fbe89400640 1 -- 172.21.15.59:0/2019303546 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe840a56a0 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.214+0000 7fbe89400640 1 -- 172.21.15.59:0/2019303546 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe840a5840 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.214+0000 7fbe89400640 1 -- 172.21.15.59:0/2019303546 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe840a5c10 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.214+0000 7fbe90a00640 1 -- 172.21.15.59:0/2019303546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c0cf9b0 msgr2=0x7fbe8c0aef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.214+0000 7fbe90a00640 1 --2- 172.21.15.59:0/2019303546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c0cf9b0 0x7fbe8c0aef00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009e50 tx=0x7fbe8401ca10 comp rx=0 tx=0).stop 2024-05-30T16:56:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.214+0000 7fbe90a00640 1 -- 172.21.15.59:0/2019303546 shutdown_connections 2024-05-30T16:56:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.214+0000 7fbe90a00640 1 --2- 172.21.15.59:0/2019303546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c0cf9b0 0x7fbe8c0aef00 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.214+0000 7fbe90a00640 1 --2- 172.21.15.59:0/2019303546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbe8c1535d0 0x7fbe8c15d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.214+0000 7fbe90a00640 1 -- 172.21.15.59:0/2019303546 >> 172.21.15.59:0/2019303546 conn(0x7fbe8c0b1fd0 msgr2=0x7fbe8c0b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.214+0000 7fbe90a00640 1 -- 172.21.15.59:0/2019303546 shutdown_connections 2024-05-30T16:56:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.218+0000 7fbe90a00640 1 -- 172.21.15.59:0/2019303546 wait complete. 2024-05-30T16:56:27.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.218+0000 7fbe90a00640 1 Processor -- start 2024-05-30T16:56:27.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.218+0000 7fbe90a00640 1 -- start start 2024-05-30T16:56:27.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe90a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c0af440 0x7fbe8c14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:27.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe90a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe8c0cf9b0 0x7fbe8c15e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:27.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe90a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbe8c1535d0 0x7fbe8c14e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:27.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe90a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c06dcd0 con 0x7fbe8c0af440 2024-05-30T16:56:27.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe90a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c0b35b0 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe90a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbe8c0af870 con 0x7fbe8c1535d0 2024-05-30T16:56:27.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe89e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe8c0cf9b0 0x7fbe8c15e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:27.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe8a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c0af440 0x7fbe8c14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:27.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe89e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe8c0cf9b0 0x7fbe8c15e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:37896/0 (socket says 172.21.15.59:37896) 2024-05-30T16:56:27.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe89e00640 1 -- 172.21.15.59:0/1994689923 learned_addr learned my addr 172.21.15.59:0/1994689923 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:27.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe89e00640 1 -- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbe8c1535d0 msgr2=0x7fbe8c14e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:27.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe89e00640 1 --2- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbe8c1535d0 0x7fbe8c14e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:27.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe89e00640 1 -- 172.21.15.59:0/1994689923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c0af440 msgr2=0x7fbe8c14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe89e00640 1 --2- 172.21.15.59:0/1994689923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c0af440 0x7fbe8c14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe89e00640 1 -- 172.21.15.59:0/1994689923 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c153c20 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe89e00640 1 --2- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe8c0cf9b0 0x7fbe8c15e910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbe840af040 tx=0x7fbe840197b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe82a00640 1 -- 172.21.15.59:0/1994689923 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe840bc020 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe82a00640 1 -- 172.21.15.59:0/1994689923 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe840b8690 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe82a00640 1 -- 172.21.15.59:0/1994689923 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe840b8a80 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe90a00640 1 -- 172.21.15.59:0/1994689923 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8c155700 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.222+0000 7fbe90a00640 1 -- 172.21.15.59:0/1994689923 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8c1559e0 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.226+0000 7fbe90a00640 1 -- 172.21.15.59:0/1994689923 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe8c068a90 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.226+0000 7fbe82a00640 1 -- 172.21.15.59:0/1994689923 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7fbe840bf020 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.226+0000 7fbe82a00640 1 --2- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbe6c0690c0 0x7fbe6c06b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.226+0000 7fbe82a00640 1 -- 172.21.15.59:0/1994689923 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5821+0+0 (secure 0 0 0) 0x7fbe841207a0 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.226+0000 7fbe8a800640 1 --2- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbe6c0690c0 0x7fbe6c06b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:27.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.230+0000 7fbe8a800640 1 --2- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbe6c0690c0 0x7fbe6c06b580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c1fa690 tx=0x7fbe78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:27.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.234+0000 7fbe82a00640 1 -- 172.21.15.59:0/1994689923 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbe840c6030 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.590+0000 7fbe90a00640 1 -- 172.21.15.59:0/1994689923 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbe8c165830 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe82a00640 1 -- 172.21.15.59:0/1994689923 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v63) ==== 80+0+0 (secure 0 0 0) 0x7fbe84016600 con 0x7fbe8c0cf9b0 2024-05-30T16:56:27.596 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T16:56:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe90a00640 1 -- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbe6c0690c0 msgr2=0x7fbe6c06b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe90a00640 1 --2- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbe6c0690c0 0x7fbe6c06b580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c1fa690 tx=0x7fbe78008040 comp rx=0 tx=0).stop 2024-05-30T16:56:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe90a00640 1 -- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe8c0cf9b0 msgr2=0x7fbe8c15e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe90a00640 1 --2- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe8c0cf9b0 0x7fbe8c15e910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbe840af040 tx=0x7fbe840197b0 comp rx=0 tx=0).stop 2024-05-30T16:56:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe90a00640 1 -- 172.21.15.59:0/1994689923 shutdown_connections 2024-05-30T16:56:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe90a00640 1 --2- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbe6c0690c0 0x7fbe6c06b580 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe90a00640 1 --2- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbe8c1535d0 0x7fbe8c14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe90a00640 1 --2- 172.21.15.59:0/1994689923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe8c0cf9b0 0x7fbe8c15e910 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe90a00640 1 --2- 172.21.15.59:0/1994689923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c0af440 0x7fbe8c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe90a00640 1 -- 172.21.15.59:0/1994689923 >> 172.21.15.59:0/1994689923 conn(0x7fbe8c0b1fd0 msgr2=0x7fbe8c0b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe90a00640 1 -- 172.21.15.59:0/1994689923 shutdown_connections 2024-05-30T16:56:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:27.594+0000 7fbe90a00640 1 -- 172.21.15.59:0/1994689923 wait complete. 2024-05-30T16:56:27.644 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2024-05-30T16:56:27.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:27.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-30T16:56:27.673 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[39997]: fuse finished with error 0 and tester_r 0 2024-05-30T16:56:27.678 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T16:56:27.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:27.678 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T16:56:27.860 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:56:27.860 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:56:27.860 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:56:27.872 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:56:27.872 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:56:27.872 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:56:27.872 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:56:27.918 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:56:27.918 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:56:27.918 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:56:27.918 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:56:27.931 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:56:27.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:56:28.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b1fc00640 1 Processor -- start 2024-05-30T16:56:28.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b1fc00640 1 -- start start 2024-05-30T16:56:28.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b1fc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b18160d90 0x7f9b1809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b1fc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b18070d60 con 0x7f9b180711e0 2024-05-30T16:56:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b1fc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b180d1310 con 0x7f9b1809b780 2024-05-30T16:56:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b1fc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9b180ced30 con 0x7f9b18160d90 2024-05-30T16:56:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b1dc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9b180711e0 0x7f9b18070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39804/0 (socket says 172.21.15.59:39804) 2024-05-30T16:56:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b1dc00640 1 -- 172.21.15.59:0/1031663036 learned_addr learned my addr 172.21.15.59:0/1031663036 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b1d200640 1 --2- 172.21.15.59:0/1031663036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b18160d90 0x7f9b1809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b1d200640 1 -- 172.21.15.59:0/1031663036 >> v1:172.21.15.107:6789/0 conn(0x7f9b1809b780 legacy=0x7f9b1806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b17e00640 1 -- 172.21.15.59:0/1031663036 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 618596703 0 0) 0x7f9b180d1310 con 0x7f9b1809b780 2024-05-30T16:56:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b1d200640 1 -- 172.21.15.59:0/1031663036 >> v1:172.21.15.59:6789/0 conn(0x7f9b180711e0 legacy=0x7f9b18070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.158+0000 7f9b1d200640 1 -- 172.21.15.59:0/1031663036 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1809bcf0 con 0x7f9b18160d90 2024-05-30T16:56:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.162+0000 7f9b1d200640 1 --2- 172.21.15.59:0/1031663036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b18160d90 0x7f9b1809aa40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b080097f0 tx=0x7f9b0801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7e79b2e2d5f775e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.162+0000 7f9b17e00640 1 -- 172.21.15.59:0/1031663036 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b080b0070 con 0x7f9b18160d90 2024-05-30T16:56:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.162+0000 7f9b17e00640 1 -- 172.21.15.59:0/1031663036 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b080ab600 con 0x7f9b18160d90 2024-05-30T16:56:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.162+0000 7f9b17e00640 1 -- 172.21.15.59:0/1031663036 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b080ab9d0 con 0x7f9b18160d90 2024-05-30T16:56:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 -- 172.21.15.59:0/1031663036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b18160d90 msgr2=0x7f9b1809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 --2- 172.21.15.59:0/1031663036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b18160d90 0x7f9b1809aa40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b080097f0 tx=0x7f9b0801c450 comp rx=0 tx=0).stop 2024-05-30T16:56:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 -- 172.21.15.59:0/1031663036 shutdown_connections 2024-05-30T16:56:28.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 --2- 172.21.15.59:0/1031663036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b18160d90 0x7f9b1809aa40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 -- 172.21.15.59:0/1031663036 >> 172.21.15.59:0/1031663036 conn(0x7f9b180b3f80 msgr2=0x7f9b180b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:28.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 -- 172.21.15.59:0/1031663036 shutdown_connections 2024-05-30T16:56:28.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 -- 172.21.15.59:0/1031663036 wait complete. 2024-05-30T16:56:28.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 Processor -- start 2024-05-30T16:56:28.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 -- start start 2024-05-30T16:56:28.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b180711e0 0x7f9b18150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:28.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b1809b780 0x7f9b18154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:28.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b18160d90 0x7f9b180ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:28.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b180af360 con 0x7f9b18160d90 2024-05-30T16:56:28.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9b180af1e0 con 0x7f9b1809b780 2024-05-30T16:56:28.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1fc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9b18071e60 con 0x7f9b180711e0 2024-05-30T16:56:28.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b18160d90 0x7f9b180ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:28.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b0fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b1809b780 0x7f9b18154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:28.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1d200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b180711e0 0x7f9b18150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:28.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b0fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b1809b780 0x7f9b18154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:37902/0 (socket says 172.21.15.59:37902) 2024-05-30T16:56:28.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b18160d90 0x7f9b180ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58082/0 (socket says 172.21.15.59:58082) 2024-05-30T16:56:28.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b0fe00640 1 -- 172.21.15.59:0/338084669 learned_addr learned my addr 172.21.15.59:0/338084669 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:28.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1d200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b180711e0 0x7f9b18150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:45444/0 (socket says 172.21.15.59:45444) 2024-05-30T16:56:28.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1dc00640 1 -- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b180711e0 msgr2=0x7f9b18150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1dc00640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b180711e0 0x7f9b18150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1dc00640 1 -- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b1809b780 msgr2=0x7f9b18154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1dc00640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b1809b780 0x7f9b18154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1dc00640 1 -- 172.21.15.59:0/338084669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b181fae20 con 0x7f9b18160d90 2024-05-30T16:56:28.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b1d200640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b180711e0 0x7f9b18150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:28.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.166+0000 7f9b0fe00640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b1809b780 0x7f9b18154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:28.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.170+0000 7f9b1dc00640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b18160d90 0x7f9b180ceec0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000caa0 tx=0x7f9b1000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:28.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.170+0000 7f9b15600640 1 -- 172.21.15.59:0/338084669 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10017070 con 0x7f9b18160d90 2024-05-30T16:56:28.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.170+0000 7f9b15600640 1 -- 172.21.15.59:0/338084669 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1000ac00 con 0x7f9b18160d90 2024-05-30T16:56:28.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.170+0000 7f9b15600640 1 -- 172.21.15.59:0/338084669 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10012400 con 0x7f9b18160d90 2024-05-30T16:56:28.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.170+0000 7f9b1fc00640 1 -- 172.21.15.59:0/338084669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b181fb100 con 0x7f9b18160d90 2024-05-30T16:56:28.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.170+0000 7f9b1fc00640 1 -- 172.21.15.59:0/338084669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b181fb6c0 con 0x7f9b18160d90 2024-05-30T16:56:28.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.170+0000 7f9b1fc00640 1 -- 172.21.15.59:0/338084669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b18068a90 con 0x7f9b18160d90 2024-05-30T16:56:28.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.170+0000 7f9b15600640 1 -- 172.21.15.59:0/338084669 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f9b1001a070 con 0x7f9b18160d90 2024-05-30T16:56:28.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.170+0000 7f9b15600640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9af4069070 0x7f9af406b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:28.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.170+0000 7f9b15600640 1 -- 172.21.15.59:0/338084669 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5821+0+0 (secure 0 0 0) 0x7f9b10084fa0 con 0x7f9b18160d90 2024-05-30T16:56:28.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.170+0000 7f9b1d200640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9af4069070 0x7f9af406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:28.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.174+0000 7f9b1d200640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9af4069070 0x7f9af406b530 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9b080ad000 tx=0x7f9b080a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:28.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.178+0000 7f9b15600640 1 -- 172.21.15.59:0/338084669 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b10056960 con 0x7f9b18160d90 2024-05-30T16:56:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.378+0000 7f9b1fc00640 1 -- 172.21.15.59:0/338084669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b1806ee60 con 0x7f9b18160d90 2024-05-30T16:56:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.378+0000 7f9b15600640 1 -- 172.21.15.59:0/338084669 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5187 (secure 0 0 0) 0x7f9b1005ac60 con 0x7f9b18160d90 2024-05-30T16:56:28.382 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:28.382 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1920809274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1920809274},{"type":"v1","addr":"172.21.15.107:6837","nonce":1920809274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5719,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/4161936082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":4161936082},{"type":"v1","addr":"172.21.15.107:6835","nonce":4161936082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4040110781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4040110781},{"type":"v1","addr":"172.21.15.59:6833","nonce":4040110781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:54:46.040632+0000","modified":"2024-05-30T16:54:49.061772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2433633874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2433633874},{"type":"v1","addr":"172.21.15.59:6835","nonce":2433633874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5865,"qdb_cluster":[5865]},"id":4}]} 2024-05-30T16:56:28.383 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 35 2024-05-30T16:56:28.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.378+0000 7f9b1fc00640 1 -- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9af4069070 msgr2=0x7f9af406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.378+0000 7f9b1fc00640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9af4069070 0x7f9af406b530 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9b080ad000 tx=0x7f9b080a6000 comp rx=0 tx=0).stop 2024-05-30T16:56:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.378+0000 7f9b1fc00640 1 -- 172.21.15.59:0/338084669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b18160d90 msgr2=0x7f9b180ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.378+0000 7f9b1fc00640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b18160d90 0x7f9b180ceec0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000caa0 tx=0x7f9b1000cf60 comp rx=0 tx=0).stop 2024-05-30T16:56:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.382+0000 7f9b1fc00640 1 -- 172.21.15.59:0/338084669 shutdown_connections 2024-05-30T16:56:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.382+0000 7f9b1fc00640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9af4069070 0x7f9af406b530 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.382+0000 7f9b1fc00640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b18160d90 0x7f9b180ceec0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.382+0000 7f9b1fc00640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b1809b780 0x7f9b18154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.382+0000 7f9b1fc00640 1 --2- 172.21.15.59:0/338084669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b180711e0 0x7f9b18150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.382+0000 7f9b1fc00640 1 -- 172.21.15.59:0/338084669 >> 172.21.15.59:0/338084669 conn(0x7f9b180b3f80 msgr2=0x7f9b18155030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.382+0000 7f9b1fc00640 1 -- 172.21.15.59:0/338084669 shutdown_connections 2024-05-30T16:56:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.382+0000 7f9b1fc00640 1 -- 172.21.15.59:0/338084669 wait complete. 2024-05-30T16:56:28.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:56:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713f200640 1 Processor -- start 2024-05-30T16:56:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713f200640 1 -- start start 2024-05-30T16:56:28.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f714015c7b0 0x7f71400d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:28.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f714009b250 0x7f71400cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:28.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f714009b900 con 0x7f71400d0d60 2024-05-30T16:56:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713f200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f71400d11c0 con 0x7f714009b250 2024-05-30T16:56:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f714009b6c0 con 0x7f714015c7b0 2024-05-30T16:56:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f7135400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f71400d0d60 0x7f714009ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39808/0 (socket says 172.21.15.59:39808) 2024-05-30T16:56:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f7135400640 1 -- 172.21.15.59:0/1917664378 learned_addr learned my addr 172.21.15.59:0/1917664378 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713e800640 1 --2- 172.21.15.59:0/1917664378 >> v2:172.21.15.107:3300/0 conn(0x7f714009b250 0x7f71400cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713de00640 1 --2- 172.21.15.59:0/1917664378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f714015c7b0 0x7f71400d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713d400640 1 -- 172.21.15.59:0/1917664378 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964336797 0 0) 0x7f714009b900 con 0x7f71400d0d60 2024-05-30T16:56:28.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713d400640 1 -- 172.21.15.59:0/1917664378 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7124003530 con 0x7f71400d0d60 2024-05-30T16:56:28.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713de00640 1 -- 172.21.15.59:0/1917664378 >> v2:172.21.15.107:3300/0 conn(0x7f714009b250 msgr2=0x7f71400cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:28.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713de00640 1 --2- 172.21.15.59:0/1917664378 >> v2:172.21.15.107:3300/0 conn(0x7f714009b250 0x7f71400cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713de00640 1 -- 172.21.15.59:0/1917664378 >> v1:172.21.15.59:6789/0 conn(0x7f71400d0d60 legacy=0x7f714009ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713de00640 1 -- 172.21.15.59:0/1917664378 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714009bbe0 con 0x7f714015c7b0 2024-05-30T16:56:28.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.542+0000 7f713e800640 1 --2- 172.21.15.59:0/1917664378 >> v2:172.21.15.107:3300/0 conn(0x7f714009b250 0x7f71400cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:28.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.546+0000 7f713de00640 1 --2- 172.21.15.59:0/1917664378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f714015c7b0 0x7f71400d0820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f71300097c0 tx=0x7f713001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6367ea4ee92c8f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:28.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.546+0000 7f713d400640 1 -- 172.21.15.59:0/1917664378 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71300b0070 con 0x7f714015c7b0 2024-05-30T16:56:28.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.546+0000 7f713d400640 1 -- 172.21.15.59:0/1917664378 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71300ab600 con 0x7f714015c7b0 2024-05-30T16:56:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.546+0000 7f713d400640 1 -- 172.21.15.59:0/1917664378 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71300ab9d0 con 0x7f714015c7b0 2024-05-30T16:56:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.546+0000 7f713f200640 1 -- 172.21.15.59:0/1917664378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f714015c7b0 msgr2=0x7f71400d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.546+0000 7f713f200640 1 --2- 172.21.15.59:0/1917664378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f714015c7b0 0x7f71400d0820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f71300097c0 tx=0x7f713001c4a0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.546+0000 7f713f200640 1 -- 172.21.15.59:0/1917664378 shutdown_connections 2024-05-30T16:56:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.546+0000 7f713f200640 1 --2- 172.21.15.59:0/1917664378 >> v2:172.21.15.107:3300/0 conn(0x7f714009b250 0x7f71400cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.546+0000 7f713f200640 1 --2- 172.21.15.59:0/1917664378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f714015c7b0 0x7f71400d0820 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.546+0000 7f713f200640 1 -- 172.21.15.59:0/1917664378 >> 172.21.15.59:0/1917664378 conn(0x7f71400b3ec0 msgr2=0x7f71400b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.546+0000 7f713f200640 1 -- 172.21.15.59:0/1917664378 shutdown_connections 2024-05-30T16:56:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.546+0000 7f713f200640 1 -- 172.21.15.59:0/1917664378 wait complete. 2024-05-30T16:56:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713f200640 1 Processor -- start 2024-05-30T16:56:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713f200640 1 -- start start 2024-05-30T16:56:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f714009b250 0x7f71400cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71400d0d60 0x7f7140150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f714015c7b0 0x7f7140071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71400cea70 con 0x7f714015c7b0 2024-05-30T16:56:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f71400ce8f0 con 0x7f714009b250 2024-05-30T16:56:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f71400cebf0 con 0x7f71400d0d60 2024-05-30T16:56:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f714015c7b0 0x7f7140071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f714015c7b0 0x7f7140071310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58098/0 (socket says 172.21.15.59:58098) 2024-05-30T16:56:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713e800640 1 -- 172.21.15.59:0/373040410 learned_addr learned my addr 172.21.15.59:0/373040410 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f7135400640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71400d0d60 0x7f7140150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713de00640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f714009b250 0x7f71400cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713e800640 1 -- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71400d0d60 msgr2=0x7f7140150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713e800640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71400d0d60 0x7f7140150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713e800640 1 -- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f714009b250 msgr2=0x7f71400cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713e800640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f714009b250 0x7f71400cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713e800640 1 -- 172.21.15.59:0/373040410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71400c5b90 con 0x7f714015c7b0 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713de00640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f714009b250 0x7f71400cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713e800640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f714015c7b0 0x7f7140071310 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7138009e60 tx=0x7f713800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f7136a00640 1 -- 172.21.15.59:0/373040410 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138018030 con 0x7f714015c7b0 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f7136a00640 1 -- 172.21.15.59:0/373040410 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713800cdf0 con 0x7f714015c7b0 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713f200640 1 -- 172.21.15.59:0/373040410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71400cbcd0 con 0x7f714015c7b0 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f7136a00640 1 -- 172.21.15.59:0/373040410 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138003bc0 con 0x7f714015c7b0 2024-05-30T16:56:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713f200640 1 -- 172.21.15.59:0/373040410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71400c5e00 con 0x7f714015c7b0 2024-05-30T16:56:28.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.550+0000 7f713f200640 1 -- 172.21.15.59:0/373040410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7140068a90 con 0x7f714015c7b0 2024-05-30T16:56:28.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.554+0000 7f7136a00640 1 -- 172.21.15.59:0/373040410 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f713801b070 con 0x7f714015c7b0 2024-05-30T16:56:28.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.554+0000 7f7136a00640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f711c069070 0x7f711c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:28.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.554+0000 7f7136a00640 1 -- 172.21.15.59:0/373040410 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5821+0+0 (secure 0 0 0) 0x7f7138086000 con 0x7f714015c7b0 2024-05-30T16:56:28.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.554+0000 7f713de00640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f711c069070 0x7f711c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:28.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.554+0000 7f713de00640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f711c069070 0x7f711c06b530 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f71300097c0 tx=0x7f71300a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:28.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.558+0000 7f7136a00640 1 -- 172.21.15.59:0/373040410 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7138022070 con 0x7f714015c7b0 2024-05-30T16:56:28.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.774+0000 7f713f200640 1 -- 172.21.15.59:0/373040410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71400d03f0 con 0x7f714015c7b0 2024-05-30T16:56:28.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.774+0000 7f7136a00640 1 -- 172.21.15.59:0/373040410 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5187 (secure 0 0 0) 0x7f7138010040 con 0x7f714015c7b0 2024-05-30T16:56:28.779 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:28.779 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1920809274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1920809274},{"type":"v1","addr":"172.21.15.107:6837","nonce":1920809274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5719,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/4161936082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":4161936082},{"type":"v1","addr":"172.21.15.107:6835","nonce":4161936082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4040110781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4040110781},{"type":"v1","addr":"172.21.15.59:6833","nonce":4040110781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:54:46.040632+0000","modified":"2024-05-30T16:54:49.061772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2433633874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2433633874},{"type":"v1","addr":"172.21.15.59:6835","nonce":2433633874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5865,"qdb_cluster":[5865]},"id":4}]} 2024-05-30T16:56:28.779 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 35 2024-05-30T16:56:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.778+0000 7f713f200640 1 -- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f711c069070 msgr2=0x7f711c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.778+0000 7f713f200640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f711c069070 0x7f711c06b530 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f71300097c0 tx=0x7f71300a6000 comp rx=0 tx=0).stop 2024-05-30T16:56:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.778+0000 7f713f200640 1 -- 172.21.15.59:0/373040410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f714015c7b0 msgr2=0x7f7140071310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.778+0000 7f713f200640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f714015c7b0 0x7f7140071310 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7138009e60 tx=0x7f713800c490 comp rx=0 tx=0).stop 2024-05-30T16:56:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.778+0000 7f713f200640 1 -- 172.21.15.59:0/373040410 shutdown_connections 2024-05-30T16:56:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.778+0000 7f713f200640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f711c069070 0x7f711c06b530 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.778+0000 7f713f200640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f714015c7b0 0x7f7140071310 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.778+0000 7f713f200640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71400d0d60 0x7f7140150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.778+0000 7f713f200640 1 --2- 172.21.15.59:0/373040410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f714009b250 0x7f71400cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.778+0000 7f713f200640 1 -- 172.21.15.59:0/373040410 >> 172.21.15.59:0/373040410 conn(0x7f71400b3ec0 msgr2=0x7f71400b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.778+0000 7f713f200640 1 -- 172.21.15.59:0/373040410 shutdown_connections 2024-05-30T16:56:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:28.782+0000 7f713f200640 1 -- 172.21.15.59:0/373040410 wait complete. 2024-05-30T16:56:28.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:56:29.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.058+0000 7f86b7400640 1 Processor -- start 2024-05-30T16:56:29.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.058+0000 7f86b7400640 1 -- start start 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.058+0000 7f86b7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86b00721f0 0x7f86b00725d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.058+0000 7f86b7400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f86b00cee40 0x7f86b00b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.058+0000 7f86b7400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86b0072b10 con 0x7f86b00ce9e0 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.058+0000 7f86b7400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f86b006f1f0 con 0x7f86b00721f0 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.058+0000 7f86b7400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f86b006ef10 con 0x7f86b00cee40 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.062+0000 7f86b4a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86b00721f0 0x7f86b00725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.062+0000 7f86b4a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86b00721f0 0x7f86b00725d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58114/0 (socket says 172.21.15.59:58114) 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.062+0000 7f86b4a00640 1 -- 172.21.15.59:0/4075206513 learned_addr learned my addr 172.21.15.59:0/4075206513 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.062+0000 7f86b5400640 1 --2- 172.21.15.59:0/4075206513 >> v2:172.21.15.107:3300/0 conn(0x7f86b00cee40 0x7f86b00b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.062+0000 7f86b4a00640 1 -- 172.21.15.59:0/4075206513 >> v2:172.21.15.107:3300/0 conn(0x7f86b00cee40 msgr2=0x7f86b00b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.062+0000 7f86b4a00640 1 --2- 172.21.15.59:0/4075206513 >> v2:172.21.15.107:3300/0 conn(0x7f86b00cee40 0x7f86b00b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.062+0000 7f86b4a00640 1 -- 172.21.15.59:0/4075206513 >> v1:172.21.15.59:6789/0 conn(0x7f86b00ce9e0 legacy=0x7f86b006e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.062+0000 7f86b4a00640 1 -- 172.21.15.59:0/4075206513 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b00b3a00 con 0x7f86b00721f0 2024-05-30T16:56:29.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.066+0000 7f86b4a00640 1 --2- 172.21.15.59:0/4075206513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86b00721f0 0x7f86b00725d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f86b015bd90 tx=0x7f86a801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af42513318bb52b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:29.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.066+0000 7f86af400640 1 -- 172.21.15.59:0/4075206513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a80a5730 con 0x7f86b00721f0 2024-05-30T16:56:29.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.066+0000 7f86af400640 1 -- 172.21.15.59:0/4075206513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a80a58d0 con 0x7f86b00721f0 2024-05-30T16:56:29.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.066+0000 7f86af400640 1 -- 172.21.15.59:0/4075206513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a80a5ce0 con 0x7f86b00721f0 2024-05-30T16:56:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.066+0000 7f86b7400640 1 -- 172.21.15.59:0/4075206513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86b00721f0 msgr2=0x7f86b00725d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.066+0000 7f86b7400640 1 --2- 172.21.15.59:0/4075206513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86b00721f0 0x7f86b00725d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f86b015bd90 tx=0x7f86a801c980 comp rx=0 tx=0).stop 2024-05-30T16:56:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.070+0000 7f86b7400640 1 -- 172.21.15.59:0/4075206513 shutdown_connections 2024-05-30T16:56:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.070+0000 7f86b7400640 1 --2- 172.21.15.59:0/4075206513 >> v2:172.21.15.107:3300/0 conn(0x7f86b00cee40 0x7f86b00b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.070+0000 7f86b7400640 1 --2- 172.21.15.59:0/4075206513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86b00721f0 0x7f86b00725d0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.070+0000 7f86b7400640 1 -- 172.21.15.59:0/4075206513 >> 172.21.15.59:0/4075206513 conn(0x7f86b00b25d0 msgr2=0x7f86b00b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:29.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.070+0000 7f86b7400640 1 -- 172.21.15.59:0/4075206513 shutdown_connections 2024-05-30T16:56:29.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.070+0000 7f86b7400640 1 -- 172.21.15.59:0/4075206513 wait complete. 2024-05-30T16:56:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b7400640 1 Processor -- start 2024-05-30T16:56:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b7400640 1 -- start start 2024-05-30T16:56:29.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86b00721f0 0x7f86b0143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b7400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86b00ce9e0 0x7f86b0143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86b00cee40 0x7f86b015c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b7400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f86b0068a90 con 0x7f86b00721f0 2024-05-30T16:56:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b7400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f86b00b4e30 con 0x7f86b00cee40 2024-05-30T16:56:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b7400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f86b0068c10 con 0x7f86b00ce9e0 2024-05-30T16:56:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b5400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86b00cee40 0x7f86b015c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b5400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86b00cee40 0x7f86b015c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:37948/0 (socket says 172.21.15.59:37948) 2024-05-30T16:56:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b5400640 1 -- 172.21.15.59:0/1791696875 learned_addr learned my addr 172.21.15.59:0/1791696875 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b4a00640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86b00721f0 0x7f86b0143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86afe00640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86b00ce9e0 0x7f86b0143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b5400640 1 -- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86b00ce9e0 msgr2=0x7f86b0143ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b5400640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86b00ce9e0 0x7f86b0143ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b5400640 1 -- 172.21.15.59:0/1791696875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86b00721f0 msgr2=0x7f86b0143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b5400640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86b00721f0 0x7f86b0143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.074+0000 7f86b5400640 1 -- 172.21.15.59:0/1791696875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b01443e0 con 0x7f86b00cee40 2024-05-30T16:56:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.078+0000 7f86b5400640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86b00cee40 0x7f86b015c7b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f86a000e7f0 tx=0x7f86a000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.078+0000 7f86acc00640 1 -- 172.21.15.59:0/1791696875 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0017070 con 0x7f86b00cee40 2024-05-30T16:56:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.078+0000 7f86acc00640 1 -- 172.21.15.59:0/1791696875 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a000c940 con 0x7f86b00cee40 2024-05-30T16:56:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.078+0000 7f86acc00640 1 -- 172.21.15.59:0/1791696875 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a000eea0 con 0x7f86b00cee40 2024-05-30T16:56:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.078+0000 7f86b7400640 1 -- 172.21.15.59:0/1791696875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b01446c0 con 0x7f86b00cee40 2024-05-30T16:56:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.078+0000 7f86b7400640 1 -- 172.21.15.59:0/1791696875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b0144c80 con 0x7f86b00cee40 2024-05-30T16:56:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.078+0000 7f86b7400640 1 -- 172.21.15.59:0/1791696875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b00691a0 con 0x7f86b00cee40 2024-05-30T16:56:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.082+0000 7f86acc00640 1 -- 172.21.15.59:0/1791696875 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f86a001a070 con 0x7f86b00cee40 2024-05-30T16:56:29.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.082+0000 7f86acc00640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f86900690f0 0x7f869006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:29.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.082+0000 7f86acc00640 1 -- 172.21.15.59:0/1791696875 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5821+0+0 (secure 0 0 0) 0x7f86a0085540 con 0x7f86b00cee40 2024-05-30T16:56:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.082+0000 7f86b4a00640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f86900690f0 0x7f869006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:29.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.086+0000 7f86b4a00640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f86900690f0 0x7f869006b5b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f86a80ae000 tx=0x7f86a80a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:29.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.086+0000 7f86acc00640 1 -- 172.21.15.59:0/1791696875 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f86a0056f40 con 0x7f86b00cee40 2024-05-30T16:56:29.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.390+0000 7f86b7400640 1 -- 172.21.15.59:0/1791696875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86b006e4a0 con 0x7f86b00cee40 2024-05-30T16:56:29.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.394+0000 7f86acc00640 1 -- 172.21.15.59:0/1791696875 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16849 (secure 0 0 0) 0x7f86a005b240 con 0x7f86b00cee40 2024-05-30T16:56:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:29.398 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":63,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:56:27.162985+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:54:43.741524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T16:54:45.005283+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":63,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:56:29.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.398+0000 7f86b7400640 1 -- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f86900690f0 msgr2=0x7f869006b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:29.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.398+0000 7f86b7400640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f86900690f0 0x7f869006b5b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f86a80ae000 tx=0x7f86a80a7070 comp rx=0 tx=0).stop 2024-05-30T16:56:29.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.398+0000 7f86b7400640 1 -- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86b00cee40 msgr2=0x7f86b015c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:29.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.398+0000 7f86b7400640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86b00cee40 0x7f86b015c7b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f86a000e7f0 tx=0x7f86a000ecb0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.398+0000 7f86b7400640 1 -- 172.21.15.59:0/1791696875 shutdown_connections 2024-05-30T16:56:29.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.398+0000 7f86b7400640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f86900690f0 0x7f869006b5b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.398+0000 7f86b7400640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86b00cee40 0x7f86b015c7b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.398+0000 7f86b7400640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86b00ce9e0 0x7f86b0143ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.398+0000 7f86b7400640 1 --2- 172.21.15.59:0/1791696875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86b00721f0 0x7f86b0143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.398+0000 7f86b7400640 1 -- 172.21.15.59:0/1791696875 >> 172.21.15.59:0/1791696875 conn(0x7f86b00b25d0 msgr2=0x7f86b00cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:29.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.398+0000 7f86b7400640 1 -- 172.21.15.59:0/1791696875 shutdown_connections 2024-05-30T16:56:29.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.398+0000 7f86b7400640 1 -- 172.21.15.59:0/1791696875 wait complete. 2024-05-30T16:56:29.433 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T16:56:29.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:56:29.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.666+0000 7f9425800640 1 Processor -- start 2024-05-30T16:56:29.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.666+0000 7f9425800640 1 -- start start 2024-05-30T16:56:29.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f9425800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94200cf950 0x7f94200d3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:29.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f9425800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94200cfd80 con 0x7f9420161e60 2024-05-30T16:56:29.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f9425800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94200d4410 con 0x7f94200d1d40 2024-05-30T16:56:29.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f9425800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9420162240 con 0x7f94200cf950 2024-05-30T16:56:29.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f941ea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9420161e60 0x7f94200d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39832/0 (socket says 172.21.15.59:39832) 2024-05-30T16:56:29.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f941ea00640 1 -- 172.21.15.59:0/3025551032 learned_addr learned my addr 172.21.15.59:0/3025551032 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:29.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f941f400640 1 --2- 172.21.15.59:0/3025551032 >> v2:172.21.15.59:3300/0 conn(0x7f94200cf950 0x7f94200d3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:29.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f941d600640 1 -- 172.21.15.59:0/3025551032 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3383170677 0 0) 0x7f9410001120 con 0x7f9420161e60 2024-05-30T16:56:29.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f941d600640 1 -- 172.21.15.59:0/3025551032 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9404003530 con 0x7f9420161e60 2024-05-30T16:56:29.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f941d600640 1 -- 172.21.15.59:0/3025551032 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655446533 0 0) 0x7f94200d4410 con 0x7f94200d1d40 2024-05-30T16:56:29.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f941d600640 1 -- 172.21.15.59:0/3025551032 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9410001120 con 0x7f94200d1d40 2024-05-30T16:56:29.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f941f400640 1 -- 172.21.15.59:0/3025551032 >> v1:172.21.15.107:6789/0 conn(0x7f94200d1d40 legacy=0x7f94200b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:29.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f941f400640 1 -- 172.21.15.59:0/3025551032 >> v1:172.21.15.59:6789/0 conn(0x7f9420161e60 legacy=0x7f94200d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:29.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.670+0000 7f941f400640 1 -- 172.21.15.59:0/3025551032 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94200d5490 con 0x7f94200cf950 2024-05-30T16:56:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.674+0000 7f941f400640 1 --2- 172.21.15.59:0/3025551032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94200cf950 0x7f94200d3c90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9418009d90 tx=0x7f941801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5b8a71564f2a88 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.674+0000 7f941d600640 1 -- 172.21.15.59:0/3025551032 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94180b4070 con 0x7f94200cf950 2024-05-30T16:56:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.674+0000 7f941d600640 1 -- 172.21.15.59:0/3025551032 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94180af600 con 0x7f94200cf950 2024-05-30T16:56:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.674+0000 7f941d600640 1 -- 172.21.15.59:0/3025551032 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94180af9d0 con 0x7f94200cf950 2024-05-30T16:56:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.674+0000 7f9425800640 1 -- 172.21.15.59:0/3025551032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94200cf950 msgr2=0x7f94200d3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.674+0000 7f9425800640 1 --2- 172.21.15.59:0/3025551032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94200cf950 0x7f94200d3c90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9418009d90 tx=0x7f941801f150 comp rx=0 tx=0).stop 2024-05-30T16:56:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.678+0000 7f9425800640 1 -- 172.21.15.59:0/3025551032 shutdown_connections 2024-05-30T16:56:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.678+0000 7f9425800640 1 --2- 172.21.15.59:0/3025551032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94200cf950 0x7f94200d3c90 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.678+0000 7f9425800640 1 -- 172.21.15.59:0/3025551032 >> 172.21.15.59:0/3025551032 conn(0x7f9420067b60 msgr2=0x7f9420067f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:29.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.678+0000 7f9425800640 1 -- 172.21.15.59:0/3025551032 shutdown_connections 2024-05-30T16:56:29.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.678+0000 7f9425800640 1 -- 172.21.15.59:0/3025551032 wait complete. 2024-05-30T16:56:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.678+0000 7f9425800640 1 Processor -- start 2024-05-30T16:56:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.682+0000 7f9425800640 1 -- start start 2024-05-30T16:56:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.682+0000 7f9425800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94200cf950 0x7f94202019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.682+0000 7f9425800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94200d1d40 0x7f9420072640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.682+0000 7f9425800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9420161e60 0x7f94200ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.682+0000 7f9425800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94200d49b0 con 0x7f94200d1d40 2024-05-30T16:56:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.682+0000 7f9425800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f94200d41d0 con 0x7f9420161e60 2024-05-30T16:56:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.682+0000 7f9425800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f94200d4c90 con 0x7f94200cf950 2024-05-30T16:56:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.686+0000 7f941f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9420161e60 0x7f94200ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.686+0000 7f941f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9420161e60 0x7f94200ab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:37950/0 (socket says 172.21.15.59:37950) 2024-05-30T16:56:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.686+0000 7f941f400640 1 -- 172.21.15.59:0/86364801 learned_addr learned my addr 172.21.15.59:0/86364801 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.686+0000 7f941e000640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94200d1d40 0x7f9420072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.686+0000 7f941ea00640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94200cf950 0x7f94202019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:29.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.686+0000 7f941f400640 1 -- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94200cf950 msgr2=0x7f94202019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:29.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.686+0000 7f941f400640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94200cf950 0x7f94202019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.686+0000 7f941f400640 1 -- 172.21.15.59:0/86364801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94200d1d40 msgr2=0x7f9420072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:29.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.686+0000 7f941f400640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94200d1d40 0x7f9420072640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:29.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.686+0000 7f941f400640 1 -- 172.21.15.59:0/86364801 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9420072b80 con 0x7f9420161e60 2024-05-30T16:56:29.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.686+0000 7f941f400640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9420161e60 0x7f94200ab0d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f94180b2040 tx=0x7f941801bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:29.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.690+0000 7f9416a00640 1 -- 172.21.15.59:0/86364801 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94180b4040 con 0x7f9420161e60 2024-05-30T16:56:29.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.690+0000 7f9416a00640 1 -- 172.21.15.59:0/86364801 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94180c1070 con 0x7f9420161e60 2024-05-30T16:56:29.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.690+0000 7f9416a00640 1 -- 172.21.15.59:0/86364801 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418009450 con 0x7f9420161e60 2024-05-30T16:56:29.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.690+0000 7f9425800640 1 -- 172.21.15.59:0/86364801 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94200ab610 con 0x7f9420161e60 2024-05-30T16:56:29.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.690+0000 7f9425800640 1 -- 172.21.15.59:0/86364801 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9420071b60 con 0x7f9420161e60 2024-05-30T16:56:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.690+0000 7f9425800640 1 -- 172.21.15.59:0/86364801 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9420068a90 con 0x7f9420161e60 2024-05-30T16:56:29.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.694+0000 7f9416a00640 1 -- 172.21.15.59:0/86364801 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f94180ba690 con 0x7f9420161e60 2024-05-30T16:56:29.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.694+0000 7f9416a00640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9400069070 0x7f940006b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:29.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.694+0000 7f9416a00640 1 -- 172.21.15.59:0/86364801 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5821+0+0 (secure 0 0 0) 0x7f9418123bb0 con 0x7f9420161e60 2024-05-30T16:56:29.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.694+0000 7f941ea00640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9400069070 0x7f940006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:29.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.694+0000 7f941ea00640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9400069070 0x7f940006b530 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f94100013c0 tx=0x7f9410007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:29.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.702+0000 7f9416a00640 1 -- 172.21.15.59:0/86364801 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9418018cb0 con 0x7f9420161e60 2024-05-30T16:56:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 -- 172.21.15.59:0/86364801 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94200b9f50 con 0x7f9420161e60 2024-05-30T16:56:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9416a00640 1 -- 172.21.15.59:0/86364801 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5187 (secure 0 0 0) 0x7f94180f54b0 con 0x7f9420161e60 2024-05-30T16:56:30.001 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:30.002 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1920809274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1920809274},{"type":"v1","addr":"172.21.15.107:6837","nonce":1920809274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5719,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/4161936082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":4161936082},{"type":"v1","addr":"172.21.15.107:6835","nonce":4161936082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4040110781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4040110781},{"type":"v1","addr":"172.21.15.59:6833","nonce":4040110781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:54:46.040632+0000","modified":"2024-05-30T16:54:49.061772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2433633874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2433633874},{"type":"v1","addr":"172.21.15.59:6835","nonce":2433633874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5865,"qdb_cluster":[5865]},"id":4}]} 2024-05-30T16:56:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 35 2024-05-30T16:56:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 -- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9400069070 msgr2=0x7f940006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9400069070 0x7f940006b530 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f94100013c0 tx=0x7f9410007d40 comp rx=0 tx=0).stop 2024-05-30T16:56:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 -- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9420161e60 msgr2=0x7f94200ab0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9420161e60 0x7f94200ab0d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f94180b2040 tx=0x7f941801bef0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 -- 172.21.15.59:0/86364801 shutdown_connections 2024-05-30T16:56:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9400069070 0x7f940006b530 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9420161e60 0x7f94200ab0d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94200d1d40 0x7f9420072640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 --2- 172.21.15.59:0/86364801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94200cf950 0x7f94202019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 -- 172.21.15.59:0/86364801 >> 172.21.15.59:0/86364801 conn(0x7f9420067b60 msgr2=0x7f94200b80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:30.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 -- 172.21.15.59:0/86364801 shutdown_connections 2024-05-30T16:56:30.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:29.998+0000 7f9425800640 1 -- 172.21.15.59:0/86364801 wait complete. 2024-05-30T16:56:30.024 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:56:30.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.158+0000 7f4b86800640 1 Processor -- start 2024-05-30T16:56:30.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b86800640 1 -- start start 2024-05-30T16:56:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b86800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b8015e860 0x7f4b800cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b86800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b800d0e80 0x7f4b800c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b86800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b800c6d80 0x7f4b8006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b86800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4b8015ec40 con 0x7f4b8015e860 2024-05-30T16:56:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b86800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4b800c8200 con 0x7f4b800c6d80 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b86800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4b800c7960 con 0x7f4b800d0e80 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b7f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b8015e860 0x7f4b800cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b7f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b8015e860 0x7f4b800cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58138/0 (socket says 172.21.15.59:58138) 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b7f400640 1 -- 172.21.15.59:0/703848751 learned_addr learned my addr 172.21.15.59:0/703848751 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b77e00640 1 --2- 172.21.15.59:0/703848751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b800d0e80 0x7f4b800c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b7fe00640 1 --2- 172.21.15.59:0/703848751 >> v2:172.21.15.107:3300/0 conn(0x7f4b800c6d80 0x7f4b8006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b7f400640 1 -- 172.21.15.59:0/703848751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b800d0e80 msgr2=0x7f4b800c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b7f400640 1 --2- 172.21.15.59:0/703848751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b800d0e80 0x7f4b800c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b7f400640 1 -- 172.21.15.59:0/703848751 >> v2:172.21.15.107:3300/0 conn(0x7f4b800c6d80 msgr2=0x7f4b8006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b7f400640 1 --2- 172.21.15.59:0/703848751 >> v2:172.21.15.107:3300/0 conn(0x7f4b800c6d80 0x7f4b8006b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b7f400640 1 -- 172.21.15.59:0/703848751 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b800c7c40 con 0x7f4b8015e860 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b77e00640 1 --2- 172.21.15.59:0/703848751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b800d0e80 0x7f4b800c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.162+0000 7f4b7fe00640 1 --2- 172.21.15.59:0/703848751 >> v2:172.21.15.107:3300/0 conn(0x7f4b800c6d80 0x7f4b8006b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b7f400640 1 --2- 172.21.15.59:0/703848751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b8015e860 0x7f4b800cef40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4b8006db50 tx=0x7f4b7001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2679ef31873c86 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b7ea00640 1 -- 172.21.15.59:0/703848751 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b700b2070 con 0x7f4b8015e860 2024-05-30T16:56:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b7ea00640 1 -- 172.21.15.59:0/703848751 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b700a9070 con 0x7f4b8015e860 2024-05-30T16:56:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b7ea00640 1 -- 172.21.15.59:0/703848751 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b700ad880 con 0x7f4b8015e860 2024-05-30T16:56:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b86800640 1 -- 172.21.15.59:0/703848751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b8015e860 msgr2=0x7f4b800cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b86800640 1 --2- 172.21.15.59:0/703848751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b8015e860 0x7f4b800cef40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4b8006db50 tx=0x7f4b7001c490 comp rx=0 tx=0).stop 2024-05-30T16:56:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b86800640 1 -- 172.21.15.59:0/703848751 shutdown_connections 2024-05-30T16:56:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b86800640 1 --2- 172.21.15.59:0/703848751 >> v2:172.21.15.107:3300/0 conn(0x7f4b800c6d80 0x7f4b8006b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b86800640 1 --2- 172.21.15.59:0/703848751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b800d0e80 0x7f4b800c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b86800640 1 --2- 172.21.15.59:0/703848751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b8015e860 0x7f4b800cef40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b86800640 1 -- 172.21.15.59:0/703848751 >> 172.21.15.59:0/703848751 conn(0x7f4b800b2fc0 msgr2=0x7f4b800b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b86800640 1 -- 172.21.15.59:0/703848751 shutdown_connections 2024-05-30T16:56:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b86800640 1 -- 172.21.15.59:0/703848751 wait complete. 2024-05-30T16:56:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b86800640 1 Processor -- start 2024-05-30T16:56:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.166+0000 7f4b86800640 1 -- start start 2024-05-30T16:56:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b86800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b800c6d80 0x7f4b80154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b86800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b800d0e80 0x7f4b8015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b86800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b8015e860 0x7f4b80151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b86800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4b800b3d40 con 0x7f4b8015e860 2024-05-30T16:56:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b86800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4b800b3bc0 con 0x7f4b800d0e80 2024-05-30T16:56:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b86800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4b800cdbf0 con 0x7f4b800c6d80 2024-05-30T16:56:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b7fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b8015e860 0x7f4b80151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b7fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b8015e860 0x7f4b80151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58146/0 (socket says 172.21.15.59:58146) 2024-05-30T16:56:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b7fe00640 1 -- 172.21.15.59:0/3789698915 learned_addr learned my addr 172.21.15.59:0/3789698915 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b77e00640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b800d0e80 0x7f4b8015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b7f400640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b800c6d80 0x7f4b80154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b7fe00640 1 -- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b800c6d80 msgr2=0x7f4b80154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b7fe00640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b800c6d80 0x7f4b80154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b7fe00640 1 -- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b800d0e80 msgr2=0x7f4b8015a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b7fe00640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b800d0e80 0x7f4b8015a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b7fe00640 1 -- 172.21.15.59:0/3789698915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b80154a50 con 0x7f4b8015e860 2024-05-30T16:56:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b7fe00640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b8015e860 0x7f4b80151b60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800cef0 tx=0x7f4b7800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b77400640 1 -- 172.21.15.59:0/3789698915 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7801a070 con 0x7f4b8015e860 2024-05-30T16:56:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b77400640 1 -- 172.21.15.59:0/3789698915 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7800d840 con 0x7f4b8015e860 2024-05-30T16:56:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b86800640 1 -- 172.21.15.59:0/3789698915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b800b40f0 con 0x7f4b8015e860 2024-05-30T16:56:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b77400640 1 -- 172.21.15.59:0/3789698915 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800dc30 con 0x7f4b8015e860 2024-05-30T16:56:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b86800640 1 -- 172.21.15.59:0/3789698915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b800b46b0 con 0x7f4b8015e860 2024-05-30T16:56:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.170+0000 7f4b86800640 1 -- 172.21.15.59:0/3789698915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b800b48b0 con 0x7f4b8015e860 2024-05-30T16:56:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.174+0000 7f4b77400640 1 -- 172.21.15.59:0/3789698915 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f4b7801d070 con 0x7f4b8015e860 2024-05-30T16:56:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.174+0000 7f4b77400640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4b5c069070 0x7f4b5c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.174+0000 7f4b7f400640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4b5c069070 0x7f4b5c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.174+0000 7f4b7f400640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4b5c069070 0x7f4b5c06b530 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4b700af000 tx=0x7f4b700a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.174+0000 7f4b77400640 1 -- 172.21.15.59:0/3789698915 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5821+0+0 (secure 0 0 0) 0x7f4b7800ddd0 con 0x7f4b8015e860 2024-05-30T16:56:30.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.182+0000 7f4b77400640 1 -- 172.21.15.59:0/3789698915 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4b800b48b0 con 0x7f4b8015e860 2024-05-30T16:56:30.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.382+0000 7f4b86800640 1 -- 172.21.15.59:0/3789698915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b800694c0 con 0x7f4b8015e860 2024-05-30T16:56:30.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.382+0000 7f4b77400640 1 -- 172.21.15.59:0/3789698915 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5187 (secure 0 0 0) 0x7f4b78057550 con 0x7f4b8015e860 2024-05-30T16:56:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:30.387 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1920809274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1920809274},{"type":"v1","addr":"172.21.15.107:6837","nonce":1920809274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5719,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/4161936082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":4161936082},{"type":"v1","addr":"172.21.15.107:6835","nonce":4161936082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4040110781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4040110781},{"type":"v1","addr":"172.21.15.59:6833","nonce":4040110781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:54:46.040632+0000","modified":"2024-05-30T16:54:49.061772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2433633874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2433633874},{"type":"v1","addr":"172.21.15.59:6835","nonce":2433633874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5865,"qdb_cluster":[5865]},"id":4}]} 2024-05-30T16:56:30.388 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 35 2024-05-30T16:56:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.386+0000 7f4b86800640 1 -- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4b5c069070 msgr2=0x7f4b5c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.386+0000 7f4b86800640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4b5c069070 0x7f4b5c06b530 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4b700af000 tx=0x7f4b700a7000 comp rx=0 tx=0).stop 2024-05-30T16:56:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.386+0000 7f4b86800640 1 -- 172.21.15.59:0/3789698915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b8015e860 msgr2=0x7f4b80151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.386+0000 7f4b86800640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b8015e860 0x7f4b80151b60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800cef0 tx=0x7f4b7800a710 comp rx=0 tx=0).stop 2024-05-30T16:56:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.386+0000 7f4b86800640 1 -- 172.21.15.59:0/3789698915 shutdown_connections 2024-05-30T16:56:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.386+0000 7f4b86800640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4b5c069070 0x7f4b5c06b530 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.386+0000 7f4b86800640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b8015e860 0x7f4b80151b60 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.386+0000 7f4b86800640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b800d0e80 0x7f4b8015a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.386+0000 7f4b86800640 1 --2- 172.21.15.59:0/3789698915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b800c6d80 0x7f4b80154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.386+0000 7f4b86800640 1 -- 172.21.15.59:0/3789698915 >> 172.21.15.59:0/3789698915 conn(0x7f4b800b2fc0 msgr2=0x7f4b80155480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.386+0000 7f4b86800640 1 -- 172.21.15.59:0/3789698915 shutdown_connections 2024-05-30T16:56:30.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.386+0000 7f4b86800640 1 -- 172.21.15.59:0/3789698915 wait complete. 2024-05-30T16:56:30.410 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:56:30.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5448800640 1 Processor -- start 2024-05-30T16:56:30.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5448800640 1 -- start start 2024-05-30T16:56:30.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5448800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54400d05b0 0x7f544009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5448800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f544009af80 0x7f544006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5448800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5440070950 con 0x7f54400d14c0 2024-05-30T16:56:30.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5448800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f544009b3f0 con 0x7f54400d05b0 2024-05-30T16:56:30.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5448800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5440070c30 con 0x7f544009af80 2024-05-30T16:56:30.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5445400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54400d05b0 0x7f544009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5445400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54400d05b0 0x7f544009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58158/0 (socket says 172.21.15.59:58158) 2024-05-30T16:56:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5445400640 1 -- 172.21.15.59:0/4294673270 learned_addr learned my addr 172.21.15.59:0/4294673270 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5446800640 1 --2- 172.21.15.59:0/4294673270 >> v2:172.21.15.107:3300/0 conn(0x7f544009af80 0x7f544006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5445400640 1 -- 172.21.15.59:0/4294673270 >> v2:172.21.15.107:3300/0 conn(0x7f544009af80 msgr2=0x7f544006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5445400640 1 --2- 172.21.15.59:0/4294673270 >> v2:172.21.15.107:3300/0 conn(0x7f544009af80 0x7f544006d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5445400640 1 -- 172.21.15.59:0/4294673270 >> v1:172.21.15.107:6789/0 conn(0x7f54400d14c0 legacy=0x7f544006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5445400640 1 -- 172.21.15.59:0/4294673270 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5440070f10 con 0x7f54400d05b0 2024-05-30T16:56:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.546+0000 7f5444a00640 1 -- 172.21.15.59:0/4294673270 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2801293768 0 0) 0x7f5440070950 con 0x7f54400d14c0 2024-05-30T16:56:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.550+0000 7f5445400640 1 --2- 172.21.15.59:0/4294673270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54400d05b0 0x7f544009aa40 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5440072eb0 tx=0x7f543001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d7d3a429b22047 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.550+0000 7f5444a00640 1 -- 172.21.15.59:0/4294673270 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54300aa610 con 0x7f54400d05b0 2024-05-30T16:56:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.550+0000 7f5444a00640 1 -- 172.21.15.59:0/4294673270 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54300af070 con 0x7f54400d05b0 2024-05-30T16:56:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.550+0000 7f5444a00640 1 -- 172.21.15.59:0/4294673270 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54300aa9d0 con 0x7f54400d05b0 2024-05-30T16:56:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.550+0000 7f5448800640 1 -- 172.21.15.59:0/4294673270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54400d05b0 msgr2=0x7f544009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.550+0000 7f5448800640 1 --2- 172.21.15.59:0/4294673270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54400d05b0 0x7f544009aa40 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5440072eb0 tx=0x7f543001c4f0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.550+0000 7f5448800640 1 -- 172.21.15.59:0/4294673270 shutdown_connections 2024-05-30T16:56:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.550+0000 7f5448800640 1 --2- 172.21.15.59:0/4294673270 >> v2:172.21.15.107:3300/0 conn(0x7f544009af80 0x7f544006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.550+0000 7f5448800640 1 --2- 172.21.15.59:0/4294673270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54400d05b0 0x7f544009aa40 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.550+0000 7f5448800640 1 -- 172.21.15.59:0/4294673270 >> 172.21.15.59:0/4294673270 conn(0x7f54400b3f80 msgr2=0x7f54400b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.550+0000 7f5448800640 1 -- 172.21.15.59:0/4294673270 shutdown_connections 2024-05-30T16:56:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.550+0000 7f5448800640 1 -- 172.21.15.59:0/4294673270 wait complete. 2024-05-30T16:56:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5448800640 1 Processor -- start 2024-05-30T16:56:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5448800640 1 -- start start 2024-05-30T16:56:30.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5448800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f544009af80 0x7f544015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5448800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54400d05b0 0x7f5440161d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5448800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54400d14c0 0x7f54400b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5448800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f544006de40 con 0x7f544009af80 2024-05-30T16:56:30.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5448800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f54400d18a0 con 0x7f54400d05b0 2024-05-30T16:56:30.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5448800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f544006dfc0 con 0x7f54400d14c0 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5445e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f544009af80 0x7f544015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5445e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f544009af80 0x7f544015b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58174/0 (socket says 172.21.15.59:58174) 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5445e00640 1 -- 172.21.15.59:0/1361356382 learned_addr learned my addr 172.21.15.59:0/1361356382 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5445400640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54400d05b0 0x7f5440161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5445e00640 1 -- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54400d14c0 msgr2=0x7f54400b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5445e00640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54400d14c0 0x7f54400b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5445e00640 1 -- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54400d05b0 msgr2=0x7f5440161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5445e00640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54400d05b0 0x7f5440161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5445e00640 1 -- 172.21.15.59:0/1361356382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544015ae50 con 0x7f544009af80 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5445400640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54400d05b0 0x7f5440161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5445e00640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f544009af80 0x7f544015b6f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5434001ec0 tx=0x7f543400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f543a000640 1 -- 172.21.15.59:0/1361356382 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5434017070 con 0x7f544009af80 2024-05-30T16:56:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f543a000640 1 -- 172.21.15.59:0/1361356382 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5434003600 con 0x7f544009af80 2024-05-30T16:56:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f543a000640 1 -- 172.21.15.59:0/1361356382 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54340039f0 con 0x7f544009af80 2024-05-30T16:56:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5448800640 1 -- 172.21.15.59:0/1361356382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f544015b130 con 0x7f544009af80 2024-05-30T16:56:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.554+0000 7f5448800640 1 -- 172.21.15.59:0/1361356382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5440162260 con 0x7f544009af80 2024-05-30T16:56:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.558+0000 7f5448800640 1 -- 172.21.15.59:0/1361356382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5440068a90 con 0x7f544009af80 2024-05-30T16:56:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.558+0000 7f543a000640 1 -- 172.21.15.59:0/1361356382 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f543401a070 con 0x7f544009af80 2024-05-30T16:56:30.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.558+0000 7f543a000640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5424069070 0x7f542406b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.558+0000 7f543a000640 1 -- 172.21.15.59:0/1361356382 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5821+0+0 (secure 0 0 0) 0x7f54340848b0 con 0x7f544009af80 2024-05-30T16:56:30.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.558+0000 7f5445400640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5424069070 0x7f542406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.558+0000 7f5445400640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5424069070 0x7f542406b530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f54300ae000 tx=0x7f5430008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:30.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.562+0000 7f543a000640 1 -- 172.21.15.59:0/1361356382 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5434056800 con 0x7f544009af80 2024-05-30T16:56:30.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 -- 172.21.15.59:0/1361356382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54400d2270 con 0x7f544009af80 2024-05-30T16:56:30.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f543a000640 1 -- 172.21.15.59:0/1361356382 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16849 (secure 0 0 0) 0x7f5434056100 con 0x7f544009af80 2024-05-30T16:56:30.738 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:30.738 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":63,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:56:27.162985+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:54:43.741524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T16:54:45.005283+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":63,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:56:30.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 -- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5424069070 msgr2=0x7f542406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5424069070 0x7f542406b530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f54300ae000 tx=0x7f5430008040 comp rx=0 tx=0).stop 2024-05-30T16:56:30.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 -- 172.21.15.59:0/1361356382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f544009af80 msgr2=0x7f544015b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f544009af80 0x7f544015b6f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5434001ec0 tx=0x7f543400c860 comp rx=0 tx=0).stop 2024-05-30T16:56:30.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 -- 172.21.15.59:0/1361356382 shutdown_connections 2024-05-30T16:56:30.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5424069070 0x7f542406b530 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54400d14c0 0x7f54400b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54400d05b0 0x7f5440161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 --2- 172.21.15.59:0/1361356382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f544009af80 0x7f544015b6f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 -- 172.21.15.59:0/1361356382 >> 172.21.15.59:0/1361356382 conn(0x7f54400b3f80 msgr2=0x7f54400b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:30.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 -- 172.21.15.59:0/1361356382 shutdown_connections 2024-05-30T16:56:30.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.734+0000 7f5448800640 1 -- 172.21.15.59:0/1361356382 wait complete. 2024-05-30T16:56:30.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T16:56:30.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.898+0000 7f8672c00640 1 Processor -- start 2024-05-30T16:56:30.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.898+0000 7f8672c00640 1 -- start start 2024-05-30T16:56:30.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f8672c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f866c15e710 0x7f866c1614e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f8672c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f866c161ea0 0x7f866c0d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f8672c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f866c1627a0 con 0x7f866c161a20 2024-05-30T16:56:30.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f8672c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f866c0d0660 con 0x7f866c161ea0 2024-05-30T16:56:30.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f8672c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f866c162a80 con 0x7f866c15e710 2024-05-30T16:56:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f8663e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f866c161a20 0x7f866c0d0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39838/0 (socket says 172.21.15.59:39838) 2024-05-30T16:56:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f8663e00640 1 -- 172.21.15.59:0/1597724050 learned_addr learned my addr 172.21.15.59:0/1597724050 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f866be00640 1 --2- 172.21.15.59:0/1597724050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f866c15e710 0x7f866c1614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f8670c00640 1 --2- 172.21.15.59:0/1597724050 >> v2:172.21.15.107:3300/0 conn(0x7f866c161ea0 0x7f866c0d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f866b400640 1 -- 172.21.15.59:0/1597724050 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4287065623 0 0) 0x7f866c1627a0 con 0x7f866c161a20 2024-05-30T16:56:30.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f866b400640 1 -- 172.21.15.59:0/1597724050 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8650003530 con 0x7f866c161a20 2024-05-30T16:56:30.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f866b400640 1 -- 172.21.15.59:0/1597724050 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2691045670 0 0) 0x7f8650003530 con 0x7f866c161a20 2024-05-30T16:56:30.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f866be00640 1 -- 172.21.15.59:0/1597724050 >> v2:172.21.15.107:3300/0 conn(0x7f866c161ea0 msgr2=0x7f866c0d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:30.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f866be00640 1 --2- 172.21.15.59:0/1597724050 >> v2:172.21.15.107:3300/0 conn(0x7f866c161ea0 0x7f866c0d11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f866be00640 1 -- 172.21.15.59:0/1597724050 >> v1:172.21.15.59:6789/0 conn(0x7f866c161a20 legacy=0x7f866c0d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.902+0000 7f866be00640 1 -- 172.21.15.59:0/1597724050 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866c162d60 con 0x7f866c15e710 2024-05-30T16:56:30.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f866be00640 1 --2- 172.21.15.59:0/1597724050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f866c15e710 0x7f866c1614e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f865c0097c0 tx=0x7f865c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=209a39e0d8334122 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:30.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f866b400640 1 -- 172.21.15.59:0/1597724050 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c0b0070 con 0x7f866c15e710 2024-05-30T16:56:30.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f866b400640 1 -- 172.21.15.59:0/1597724050 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f865c0ab400 con 0x7f866c15e710 2024-05-30T16:56:30.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f866b400640 1 -- 172.21.15.59:0/1597724050 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654001680 con 0x7f866c15e710 2024-05-30T16:56:30.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f8672c00640 1 -- 172.21.15.59:0/1597724050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f866c15e710 msgr2=0x7f866c1614e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f8672c00640 1 --2- 172.21.15.59:0/1597724050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f866c15e710 0x7f866c1614e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f865c0097c0 tx=0x7f865c01c3c0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f8672c00640 1 -- 172.21.15.59:0/1597724050 shutdown_connections 2024-05-30T16:56:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f8672c00640 1 --2- 172.21.15.59:0/1597724050 >> v2:172.21.15.107:3300/0 conn(0x7f866c161ea0 0x7f866c0d11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f8672c00640 1 --2- 172.21.15.59:0/1597724050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f866c15e710 0x7f866c1614e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f8672c00640 1 -- 172.21.15.59:0/1597724050 >> 172.21.15.59:0/1597724050 conn(0x7f866c0b3f50 msgr2=0x7f866c0b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f8672c00640 1 -- 172.21.15.59:0/1597724050 shutdown_connections 2024-05-30T16:56:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f8672c00640 1 -- 172.21.15.59:0/1597724050 wait complete. 2024-05-30T16:56:30.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f8672c00640 1 Processor -- start 2024-05-30T16:56:30.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.906+0000 7f8672c00640 1 -- start start 2024-05-30T16:56:30.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8672c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f866c15e710 0x7f866c150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8672c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f866c161a20 0x7f866c0b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8672c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c161ea0 0x7f866c0700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8672c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f866c15fc80 con 0x7f866c161ea0 2024-05-30T16:56:30.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8672c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f866c15fb00 con 0x7f866c161a20 2024-05-30T16:56:30.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8672c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f866c06d340 con 0x7f866c15e710 2024-05-30T16:56:30.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8670c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c161ea0 0x7f866c0700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8670c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c161ea0 0x7f866c0700e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58178/0 (socket says 172.21.15.59:58178) 2024-05-30T16:56:30.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8670c00640 1 -- 172.21.15.59:0/2196768746 learned_addr learned my addr 172.21.15.59:0/2196768746 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f866be00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f866c15e710 0x7f866c150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8663e00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f866c161a20 0x7f866c0b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8670c00640 1 -- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f866c15e710 msgr2=0x7f866c150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8670c00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f866c15e710 0x7f866c150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8670c00640 1 -- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f866c161a20 msgr2=0x7f866c0b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8670c00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f866c161a20 0x7f866c0b74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8670c00640 1 -- 172.21.15.59:0/2196768746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866c0d1510 con 0x7f866c161ea0 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8663e00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f866c161a20 0x7f866c0b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8670c00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c161ea0 0x7f866c0700e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f866400efc0 tx=0x7f866400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8668c00640 1 -- 172.21.15.59:0/2196768746 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664018020 con 0x7f866c161ea0 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8668c00640 1 -- 172.21.15.59:0/2196768746 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8664014480 con 0x7f866c161ea0 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8668c00640 1 -- 172.21.15.59:0/2196768746 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664014870 con 0x7f866c161ea0 2024-05-30T16:56:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8672c00640 1 -- 172.21.15.59:0/2196768746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f866c150ef0 con 0x7f866c161ea0 2024-05-30T16:56:30.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8672c00640 1 -- 172.21.15.59:0/2196768746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f866c1514b0 con 0x7f866c161ea0 2024-05-30T16:56:30.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8672c00640 1 -- 172.21.15.59:0/2196768746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f866c068a90 con 0x7f866c161ea0 2024-05-30T16:56:30.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.910+0000 7f8668c00640 1 -- 172.21.15.59:0/2196768746 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f866401b020 con 0x7f866c161ea0 2024-05-30T16:56:30.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.914+0000 7f8668c00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f86480690a0 0x7f864806b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:30.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.914+0000 7f8668c00640 1 -- 172.21.15.59:0/2196768746 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5821+0+0 (secure 0 0 0) 0x7f8664086090 con 0x7f866c161ea0 2024-05-30T16:56:30.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.914+0000 7f866be00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f86480690a0 0x7f864806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:30.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.914+0000 7f866be00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f86480690a0 0x7f864806b560 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f865c0ad000 tx=0x7f865c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:30.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:30.918+0000 7f8668c00640 1 -- 172.21.15.59:0/2196768746 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8664022070 con 0x7f866c161ea0 2024-05-30T16:56:31.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.122+0000 7f8672c00640 1 -- 172.21.15.59:0/2196768746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f866c0b4b80 con 0x7f866c161ea0 2024-05-30T16:56:31.128 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-05-30T16:56:31.122+0000 7f2f74c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T16:56:31.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.126+0000 7f8668c00640 1 -- 172.21.15.59:0/2196768746 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) ==== 161+0+0 (secure 0 0 0) 0x7f8664010040 con 0x7f866c161ea0 2024-05-30T16:56:31.130 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T16:56:31.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.130+0000 7f8672c00640 1 -- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f86480690a0 msgr2=0x7f864806b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:31.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.130+0000 7f8672c00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f86480690a0 0x7f864806b560 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f865c0ad000 tx=0x7f865c0a6000 comp rx=0 tx=0).stop 2024-05-30T16:56:31.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.130+0000 7f8672c00640 1 -- 172.21.15.59:0/2196768746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c161ea0 msgr2=0x7f866c0700e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:31.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.130+0000 7f8672c00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c161ea0 0x7f866c0700e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f866400efc0 tx=0x7f866400c490 comp rx=0 tx=0).stop 2024-05-30T16:56:31.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.130+0000 7f8672c00640 1 -- 172.21.15.59:0/2196768746 shutdown_connections 2024-05-30T16:56:31.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.130+0000 7f8672c00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f86480690a0 0x7f864806b560 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:31.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.130+0000 7f8672c00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c161ea0 0x7f866c0700e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:31.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.130+0000 7f8672c00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f866c161a20 0x7f866c0b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:31.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.130+0000 7f8672c00640 1 --2- 172.21.15.59:0/2196768746 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f866c15e710 0x7f866c150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:31.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.130+0000 7f8672c00640 1 -- 172.21.15.59:0/2196768746 >> 172.21.15.59:0/2196768746 conn(0x7f866c0b3f50 msgr2=0x7f866c1603b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:31.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.130+0000 7f8672c00640 1 -- 172.21.15.59:0/2196768746 shutdown_connections 2024-05-30T16:56:31.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.130+0000 7f8672c00640 1 -- 172.21.15.59:0/2196768746 wait complete. 2024-05-30T16:56:31.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T16:56:31.203 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T16:56:31.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6d1200640 1 Processor -- start 2024-05-30T16:56:31.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6d1200640 1 -- start start 2024-05-30T16:56:31.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6d1200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6cc0723a0 0x7fb6cc0b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:31.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6d1200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb6cc15ebf0 0x7fb6cc0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:31.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6d1200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6cc0b32d0 con 0x7fb6cc0b3ff0 2024-05-30T16:56:31.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6d1200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb6cc15f490 con 0x7fb6cc15ebf0 2024-05-30T16:56:31.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6d1200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc15f770 con 0x7fb6cc0723a0 2024-05-30T16:56:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6c3e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb6cc15ebf0 0x7fb6cc0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6c9e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6cc0723a0 0x7fb6cc0b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6c9e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6cc0723a0 0x7fb6cc0b4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:45530/0 (socket says 172.21.15.59:45530) 2024-05-30T16:56:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6c3e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb6cc15ebf0 0x7fb6cc0b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:38048/0 (socket says 172.21.15.59:38048) 2024-05-30T16:56:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6ca800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb6cc0b3ff0 0x7fb6cc06dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:39580/0 (socket says 172.21.15.59:39580) 2024-05-30T16:56:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6c9e00640 1 -- 172.21.15.59:0/4086038157 learned_addr learned my addr 172.21.15.59:0/4086038157 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6c9e00640 1 -- 172.21.15.59:0/4086038157 >> v2:172.21.15.107:3300/0 conn(0x7fb6cc15ebf0 msgr2=0x7fb6cc0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6c9e00640 1 --2- 172.21.15.59:0/4086038157 >> v2:172.21.15.107:3300/0 conn(0x7fb6cc15ebf0 0x7fb6cc0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6c9e00640 1 -- 172.21.15.59:0/4086038157 >> v1:172.21.15.107:6789/0 conn(0x7fb6cc0b3ff0 legacy=0x7fb6cc06dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6c9e00640 1 -- 172.21.15.59:0/4086038157 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc15fa50 con 0x7fb6cc0723a0 2024-05-30T16:56:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6c3e00640 1 --2- 172.21.15.59:0/4086038157 >> v2:172.21.15.107:3300/0 conn(0x7fb6cc15ebf0 0x7fb6cc0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.298+0000 7fb6c9400640 1 -- 172.21.15.59:0/4086038157 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339022270 0 0) 0x7fb6cc0b32d0 con 0x7fb6cc0b3ff0 2024-05-30T16:56:31.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.302+0000 7fb6c9e00640 1 --2- 172.21.15.59:0/4086038157 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6cc0723a0 0x7fb6cc0b4f90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009870 tx=0x7fb6bc01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dafe402a6857bce8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.302+0000 7fb6c9400640 1 -- 172.21.15.59:0/4086038157 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0a9610 con 0x7fb6cc0723a0 2024-05-30T16:56:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.302+0000 7fb6c9400640 1 -- 172.21.15.59:0/4086038157 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6cc072990 con 0x7fb6cc0723a0 2024-05-30T16:56:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.302+0000 7fb6c9400640 1 -- 172.21.15.59:0/4086038157 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0a99d0 con 0x7fb6cc0723a0 2024-05-30T16:56:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.302+0000 7fb6d1200640 1 -- 172.21.15.59:0/4086038157 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6cc0723a0 msgr2=0x7fb6cc0b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.302+0000 7fb6d1200640 1 --2- 172.21.15.59:0/4086038157 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6cc0723a0 0x7fb6cc0b4f90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009870 tx=0x7fb6bc01c530 comp rx=0 tx=0).stop 2024-05-30T16:56:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.302+0000 7fb6d1200640 1 -- 172.21.15.59:0/4086038157 shutdown_connections 2024-05-30T16:56:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.302+0000 7fb6d1200640 1 --2- 172.21.15.59:0/4086038157 >> v2:172.21.15.107:3300/0 conn(0x7fb6cc15ebf0 0x7fb6cc0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.302+0000 7fb6d1200640 1 --2- 172.21.15.59:0/4086038157 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6cc0723a0 0x7fb6cc0b4f90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.302+0000 7fb6d1200640 1 -- 172.21.15.59:0/4086038157 >> 172.21.15.59:0/4086038157 conn(0x7fb6cc06bdb0 msgr2=0x7fb6cc06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.302+0000 7fb6d1200640 1 -- 172.21.15.59:0/4086038157 shutdown_connections 2024-05-30T16:56:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.302+0000 7fb6d1200640 1 -- 172.21.15.59:0/4086038157 wait complete. 2024-05-30T16:56:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6d1200640 1 Processor -- start 2024-05-30T16:56:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6d1200640 1 -- start start 2024-05-30T16:56:31.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6d1200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6cc0723a0 0x7fb6cc154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:31.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6d1200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6cc0b3ff0 0x7fb6cc151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6d1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6cc15ebf0 0x7fb6cc155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6d1200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc15f150 con 0x7fb6cc15ebf0 2024-05-30T16:56:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6d1200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc15efd0 con 0x7fb6cc0723a0 2024-05-30T16:56:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6d1200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc06e390 con 0x7fb6cc0b3ff0 2024-05-30T16:56:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6ca800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6cc15ebf0 0x7fb6cc155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6ca800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6cc15ebf0 0x7fb6cc155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58190/0 (socket says 172.21.15.59:58190) 2024-05-30T16:56:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6ca800640 1 -- 172.21.15.59:0/1690294970 learned_addr learned my addr 172.21.15.59:0/1690294970 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6c3e00640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6cc0b3ff0 0x7fb6cc151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6c9e00640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6cc0723a0 0x7fb6cc154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6ca800640 1 -- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6cc0b3ff0 msgr2=0x7fb6cc151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6ca800640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6cc0b3ff0 0x7fb6cc151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6ca800640 1 -- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6cc0723a0 msgr2=0x7fb6cc154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6ca800640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6cc0723a0 0x7fb6cc154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6ca800640 1 -- 172.21.15.59:0/1690294970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc15d280 con 0x7fb6cc15ebf0 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6ca800640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6cc15ebf0 0x7fb6cc155440 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400c780 tx=0x7fb6c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6c2000640 1 -- 172.21.15.59:0/1690294970 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4018070 con 0x7fb6cc15ebf0 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6c2000640 1 -- 172.21.15.59:0/1690294970 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c400a640 con 0x7fb6cc15ebf0 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6c2000640 1 -- 172.21.15.59:0/1690294970 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400aa70 con 0x7fb6cc15ebf0 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6d1200640 1 -- 172.21.15.59:0/1690294970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6cc15d560 con 0x7fb6cc15ebf0 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6d1200640 1 -- 172.21.15.59:0/1690294970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6cc15db20 con 0x7fb6cc15ebf0 2024-05-30T16:56:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.306+0000 7fb6d1200640 1 -- 172.21.15.59:0/1690294970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6cc068a90 con 0x7fb6cc15ebf0 2024-05-30T16:56:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.310+0000 7fb6c2000640 1 -- 172.21.15.59:0/1690294970 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7fb6c401b070 con 0x7fb6cc15ebf0 2024-05-30T16:56:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.310+0000 7fb6c2000640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6a8069070 0x7fb6a806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.310+0000 7fb6c2000640 1 -- 172.21.15.59:0/1690294970 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5879+0+0 (secure 0 0 0) 0x7fb6c40849e0 con 0x7fb6cc15ebf0 2024-05-30T16:56:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.310+0000 7fb6c9e00640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6a8069070 0x7fb6a806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:31.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.310+0000 7fb6c9e00640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6a8069070 0x7fb6a806b530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0ae000 tx=0x7fb6bc0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:31.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.314+0000 7fb6c2000640 1 -- 172.21.15.59:0/1690294970 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6c40569f0 con 0x7fb6cc15ebf0 2024-05-30T16:56:31.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:31.514+0000 7fb6d1200640 1 -- 172.21.15.59:0/1690294970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb6cc0b3dd0 con 0x7fb6cc15ebf0 2024-05-30T16:56:32.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6c2000640 1 -- 172.21.15.59:0/1690294970 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7fb6c40562f0 con 0x7fb6cc15ebf0 2024-05-30T16:56:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6d1200640 1 -- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6a8069070 msgr2=0x7fb6a806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6d1200640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6a8069070 0x7fb6a806b530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0ae000 tx=0x7fb6bc0b3040 comp rx=0 tx=0).stop 2024-05-30T16:56:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6d1200640 1 -- 172.21.15.59:0/1690294970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6cc15ebf0 msgr2=0x7fb6cc155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6d1200640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6cc15ebf0 0x7fb6cc155440 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400c780 tx=0x7fb6c400cc40 comp rx=0 tx=0).stop 2024-05-30T16:56:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6d1200640 1 -- 172.21.15.59:0/1690294970 shutdown_connections 2024-05-30T16:56:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6d1200640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb6a8069070 0x7fb6a806b530 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6d1200640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6cc15ebf0 0x7fb6cc155440 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6d1200640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6cc0b3ff0 0x7fb6cc151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6d1200640 1 --2- 172.21.15.59:0/1690294970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6cc0723a0 0x7fb6cc154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6d1200640 1 -- 172.21.15.59:0/1690294970 >> 172.21.15.59:0/1690294970 conn(0x7fb6cc06bdb0 msgr2=0x7fb6cc161750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6d1200640 1 -- 172.21.15.59:0/1690294970 shutdown_connections 2024-05-30T16:56:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.182+0000 7fb6d1200640 1 -- 172.21.15.59:0/1690294970 wait complete. 2024-05-30T16:56:32.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T16:56:32.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b7b200640 1 Processor -- start 2024-05-30T16:56:32.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b7b200640 1 -- start start 2024-05-30T16:56:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b7b200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b740b5470 0x7f0b740ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b7b200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b740af690 con 0x7f0b740b1f80 2024-05-30T16:56:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b7b200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b740af970 con 0x7f0b7415ebf0 2024-05-30T16:56:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b7b200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7415efd0 con 0x7f0b740b5470 2024-05-30T16:56:32.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b79200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0b740b1f80 0x7f0b740aee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60046/0 (socket says 172.21.15.59:60046) 2024-05-30T16:56:32.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b79200640 1 -- 172.21.15.59:0/270215145 learned_addr learned my addr 172.21.15.59:0/270215145 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:32.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b6be00640 1 --2- 172.21.15.59:0/270215145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b740b5470 0x7f0b740ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:32.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1934187590 0 0) 0x7f0b740af690 con 0x7f0b740b1f80 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b58005740 con 0x7f0b740b1f80 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 764596359 0 0) 0x7f0b740af970 con 0x7f0b7415ebf0 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b740af690 con 0x7f0b7415ebf0 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3215731248 0 0) 0x7f0b58005740 con 0x7f0b740b1f80 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b740b5470 msgr2=0x7f0b740ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 --2- 172.21.15.59:0/270215145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b740b5470 0x7f0b740ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 >> v1:172.21.15.107:6789/0 conn(0x7f0b7415ebf0 legacy=0x7f0b740b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b740afc50 con 0x7f0b740b1f80 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f0b6c001a00 con 0x7f0b740b1f80 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 >> v1:172.21.15.59:6789/0 conn(0x7f0b740b1f80 legacy=0x7f0b740aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 --2- 172.21.15.59:0/270215145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b740b5470 0x7f0b58005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 --2- 172.21.15.59:0/270215145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b580062f0 0x7f0b58006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:32.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 --2- 172.21.15.59:0/270215145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b58006f60 0x7f0b580073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:32.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7415efd0 con 0x7f0b580062f0 2024-05-30T16:56:32.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5800dd70 con 0x7f0b58006f60 2024-05-30T16:56:32.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5800df40 con 0x7f0b740b5470 2024-05-30T16:56:32.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b6be00640 1 --2- 172.21.15.59:0/270215145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b580062f0 0x7f0b58006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:32.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b73e00640 1 --2- 172.21.15.59:0/270215145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b740b5470 0x7f0b58005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:32.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b79200640 1 --2- 172.21.15.59:0/270215145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b58006f60 0x7f0b580073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:32.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b6be00640 1 -- 172.21.15.59:0/270215145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b740b5470 msgr2=0x7f0b58005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:32.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b6be00640 1 --2- 172.21.15.59:0/270215145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b740b5470 0x7f0b58005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:32.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b6be00640 1 -- 172.21.15.59:0/270215145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b58006f60 msgr2=0x7f0b580073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:32.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b6be00640 1 --2- 172.21.15.59:0/270215145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b58006f60 0x7f0b580073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:32.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.402+0000 7f0b6be00640 1 -- 172.21.15.59:0/270215145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b58005740 con 0x7f0b580062f0 2024-05-30T16:56:32.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.406+0000 7f0b6be00640 1 --2- 172.21.15.59:0/270215145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b580062f0 0x7f0b58006a20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009ae0 tx=0x7f0b5c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f19fa9d28c326b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:32.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.406+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0096b0 con 0x7f0b580062f0 2024-05-30T16:56:32.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.406+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5c0a9450 con 0x7f0b580062f0 2024-05-30T16:56:32.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.406+0000 7f0b73400640 1 -- 172.21.15.59:0/270215145 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0a9840 con 0x7f0b580062f0 2024-05-30T16:56:32.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.406+0000 7f0b7b200640 1 -- 172.21.15.59:0/270215145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b580062f0 msgr2=0x7f0b58006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:32.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.406+0000 7f0b7b200640 1 --2- 172.21.15.59:0/270215145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b580062f0 0x7f0b58006a20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009ae0 tx=0x7f0b5c01ca70 comp rx=0 tx=0).stop 2024-05-30T16:56:32.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.406+0000 7f0b79200640 1 -- 172.21.15.59:0/270215145 reap_dead start 2024-05-30T16:56:32.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.406+0000 7f0b7b200640 1 -- 172.21.15.59:0/270215145 shutdown_connections 2024-05-30T16:56:32.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.406+0000 7f0b7b200640 1 -- 172.21.15.59:0/270215145 >> 172.21.15.59:0/270215145 conn(0x7f0b740b6770 msgr2=0x7f0b740b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:32.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.406+0000 7f0b7b200640 1 -- 172.21.15.59:0/270215145 shutdown_connections 2024-05-30T16:56:32.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.406+0000 7f0b7b200640 1 -- 172.21.15.59:0/270215145 wait complete. 2024-05-30T16:56:32.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b7b200640 1 Processor -- start 2024-05-30T16:56:32.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b7b200640 1 -- start start 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b7b200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b580062f0 0x7f0b7415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b7b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b74152a40 0x7f0b74070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b7b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b74150ff0 0x7f0b74151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b7b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7406c550 con 0x7f0b74152a40 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b7b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7406c3d0 con 0x7f0b74150ff0 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b7b200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7406c6d0 con 0x7f0b580062f0 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b6be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b74152a40 0x7f0b74070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b6be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b74152a40 0x7f0b74070120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32796/0 (socket says 172.21.15.59:32796) 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b6be00640 1 -- 172.21.15.59:0/2504117749 learned_addr learned my addr 172.21.15.59:0/2504117749 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b73e00640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b580062f0 0x7f0b7415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b79200640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b74150ff0 0x7f0b74151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b6be00640 1 -- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b580062f0 msgr2=0x7f0b7415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:32.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b6be00640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b580062f0 0x7f0b7415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b6be00640 1 -- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b74150ff0 msgr2=0x7f0b74151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b6be00640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b74150ff0 0x7f0b74151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b6be00640 1 -- 172.21.15.59:0/2504117749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7415d590 con 0x7f0b74152a40 2024-05-30T16:56:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b79200640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b74150ff0 0x7f0b74151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b6be00640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b74152a40 0x7f0b74070120 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c01c8a0 tx=0x7f0b58007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b70c00640 1 -- 172.21.15.59:0/2504117749 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0c0070 con 0x7f0b74152a40 2024-05-30T16:56:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b70c00640 1 -- 172.21.15.59:0/2504117749 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5c00f000 con 0x7f0b74152a40 2024-05-30T16:56:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b70c00640 1 -- 172.21.15.59:0/2504117749 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0a9da0 con 0x7f0b74152a40 2024-05-30T16:56:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b7b200640 1 -- 172.21.15.59:0/2504117749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7415d870 con 0x7f0b74152a40 2024-05-30T16:56:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.410+0000 7f0b7b200640 1 -- 172.21.15.59:0/2504117749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b74150ad0 con 0x7f0b74152a40 2024-05-30T16:56:32.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.414+0000 7f0b7b200640 1 -- 172.21.15.59:0/2504117749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7415dd90 con 0x7f0b74152a40 2024-05-30T16:56:32.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.414+0000 7f0b70c00640 1 -- 172.21.15.59:0/2504117749 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f0b5c0ba3f0 con 0x7f0b74152a40 2024-05-30T16:56:32.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.414+0000 7f0b70c00640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0b50069070 0x7f0b5006b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:32.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.414+0000 7f0b70c00640 1 -- 172.21.15.59:0/2504117749 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5879+0+0 (secure 0 0 0) 0x7f0b5c11eed0 con 0x7f0b74152a40 2024-05-30T16:56:32.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.414+0000 7f0b73e00640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0b50069070 0x7f0b5006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:32.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.414+0000 7f0b73e00640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0b50069070 0x7f0b5006b530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0b64007af0 tx=0x7f0b64009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:32.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.418+0000 7f0b70c00640 1 -- 172.21.15.59:0/2504117749 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b7415dd90 con 0x7f0b74152a40 2024-05-30T16:56:32.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:32.582+0000 7f0b7b200640 1 -- 172.21.15.59:0/2504117749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0b74159120 con 0x7f0b74152a40 2024-05-30T16:56:33.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.182+0000 7f0b70c00640 1 -- 172.21.15.59:0/2504117749 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v65) ==== 181+0+0 (secure 0 0 0) 0x7f0b5c0ad020 con 0x7f0b74152a40 2024-05-30T16:56:33.187 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-05-30T16:56:33.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.186+0000 7f0b7b200640 1 -- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0b50069070 msgr2=0x7f0b5006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:33.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.186+0000 7f0b7b200640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0b50069070 0x7f0b5006b530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0b64007af0 tx=0x7f0b64009040 comp rx=0 tx=0).stop 2024-05-30T16:56:33.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.186+0000 7f0b7b200640 1 -- 172.21.15.59:0/2504117749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b74152a40 msgr2=0x7f0b74070120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:33.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.186+0000 7f0b7b200640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b74152a40 0x7f0b74070120 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c01c8a0 tx=0x7f0b58007a50 comp rx=0 tx=0).stop 2024-05-30T16:56:33.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.186+0000 7f0b7b200640 1 -- 172.21.15.59:0/2504117749 shutdown_connections 2024-05-30T16:56:33.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.186+0000 7f0b7b200640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0b50069070 0x7f0b5006b530 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:33.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.186+0000 7f0b7b200640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b74150ff0 0x7f0b74151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:33.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.186+0000 7f0b7b200640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b74152a40 0x7f0b74070120 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:33.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.186+0000 7f0b7b200640 1 --2- 172.21.15.59:0/2504117749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b580062f0 0x7f0b7415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:33.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.186+0000 7f0b7b200640 1 -- 172.21.15.59:0/2504117749 >> 172.21.15.59:0/2504117749 conn(0x7f0b740b6770 msgr2=0x7f0b740b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:33.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.186+0000 7f0b7b200640 1 -- 172.21.15.59:0/2504117749 shutdown_connections 2024-05-30T16:56:33.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.186+0000 7f0b7b200640 1 -- 172.21.15.59:0/2504117749 wait complete. 2024-05-30T16:56:33.222 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T16:56:33.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.366+0000 7faf4fa00640 1 Processor -- start 2024-05-30T16:56:33.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.366+0000 7faf4fa00640 1 -- start start 2024-05-30T16:56:33.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf4fa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf4806dc60 0x7faf4806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:33.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf4fa00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf4806e120 con 0x7faf48156e40 2024-05-30T16:56:33.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf4fa00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf4806e400 con 0x7faf480af130 2024-05-30T16:56:33.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf4fa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faf4806e6e0 con 0x7faf4806dc60 2024-05-30T16:56:33.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf4d000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faf48156e40 0x7faf4815d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60050/0 (socket says 172.21.15.59:60050) 2024-05-30T16:56:33.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf4d000640 1 -- 172.21.15.59:0/1189769403 learned_addr learned my addr 172.21.15.59:0/1189769403 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:33.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 762353395 0 0) 0x7faf4806e120 con 0x7faf48156e40 2024-05-30T16:56:33.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf2c003530 con 0x7faf48156e40 2024-05-30T16:56:33.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf3fe00640 1 --2- 172.21.15.59:0/1189769403 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf4806dc60 0x7faf4806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:33.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3509033247 0 0) 0x7faf2c003530 con 0x7faf48156e40 2024-05-30T16:56:33.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf4806dc60 msgr2=0x7faf4806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:33.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 --2- 172.21.15.59:0/1189769403 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf4806dc60 0x7faf4806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:33.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 >> v1:172.21.15.107:6789/0 conn(0x7faf480af130 legacy=0x7faf480af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:33.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4806e9c0 con 0x7faf48156e40 2024-05-30T16:56:33.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7faf38001680 con 0x7faf48156e40 2024-05-30T16:56:33.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 >> v1:172.21.15.59:6789/0 conn(0x7faf48156e40 legacy=0x7faf4815d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 --2- 172.21.15.59:0/1189769403 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf4806dc60 0x7faf2c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 --2- 172.21.15.59:0/1189769403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c003f70 0x7faf2c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 --2- 172.21.15.59:0/1189769403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf2c004d50 0x7faf2c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faf4806e6e0 con 0x7faf2c003f70 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c00bab0 con 0x7faf2c004d50 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faf2c00bcb0 con 0x7faf4806dc60 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf3fe00640 1 --2- 172.21.15.59:0/1189769403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c003f70 0x7faf2c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf4d000640 1 --2- 172.21.15.59:0/1189769403 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf4806dc60 0x7faf2c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf4da00640 1 --2- 172.21.15.59:0/1189769403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf2c004d50 0x7faf2c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf3fe00640 1 -- 172.21.15.59:0/1189769403 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf4806dc60 msgr2=0x7faf2c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf3fe00640 1 --2- 172.21.15.59:0/1189769403 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf4806dc60 0x7faf2c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf3fe00640 1 -- 172.21.15.59:0/1189769403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf2c004d50 msgr2=0x7faf2c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf3fe00640 1 --2- 172.21.15.59:0/1189769403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf2c004d50 0x7faf2c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.370+0000 7faf3fe00640 1 -- 172.21.15.59:0/1189769403 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c003530 con 0x7faf2c003f70 2024-05-30T16:56:33.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf3fe00640 1 --2- 172.21.15.59:0/1189769403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c003f70 0x7faf2c004810 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7faf30009ae0 tx=0x7faf3001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6b57f8ef0fcff server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:33.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf300b2070 con 0x7faf2c003f70 2024-05-30T16:56:33.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf300a5550 con 0x7faf2c003f70 2024-05-30T16:56:33.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf47e00640 1 -- 172.21.15.59:0/1189769403 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf300096b0 con 0x7faf2c003f70 2024-05-30T16:56:33.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf4fa00640 1 -- 172.21.15.59:0/1189769403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c003f70 msgr2=0x7faf2c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:33.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf4fa00640 1 --2- 172.21.15.59:0/1189769403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c003f70 0x7faf2c004810 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7faf30009ae0 tx=0x7faf3001ca70 comp rx=0 tx=0).stop 2024-05-30T16:56:33.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf4da00640 1 -- 172.21.15.59:0/1189769403 reap_dead start 2024-05-30T16:56:33.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf4fa00640 1 -- 172.21.15.59:0/1189769403 shutdown_connections 2024-05-30T16:56:33.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf4fa00640 1 -- 172.21.15.59:0/1189769403 >> 172.21.15.59:0/1189769403 conn(0x7faf480b1e60 msgr2=0x7faf480b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:33.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf4fa00640 1 -- 172.21.15.59:0/1189769403 shutdown_connections 2024-05-30T16:56:33.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf4fa00640 1 -- 172.21.15.59:0/1189769403 wait complete. 2024-05-30T16:56:33.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf4fa00640 1 Processor -- start 2024-05-30T16:56:33.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.374+0000 7faf4fa00640 1 -- start start 2024-05-30T16:56:33.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4fa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf2c003f70 0x7faf481f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:33.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4fa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf481e5ff0 0x7faf48145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:33.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4fa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf481e6470 0x7faf48145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4fa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faf4806f340 con 0x7faf481e6470 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4fa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faf4806f1c0 con 0x7faf2c003f70 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4fa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faf4806f4c0 con 0x7faf481e5ff0 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf481e6470 0x7faf48145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf481e6470 0x7faf48145bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32818/0 (socket says 172.21.15.59:32818) 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4da00640 1 -- 172.21.15.59:0/3297577344 learned_addr learned my addr 172.21.15.59:0/3297577344 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4d000640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf2c003f70 0x7faf481f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf3fe00640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf481e5ff0 0x7faf48145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4da00640 1 -- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf481e5ff0 msgr2=0x7faf48145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4da00640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf481e5ff0 0x7faf48145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4da00640 1 -- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf2c003f70 msgr2=0x7faf481f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4da00640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf2c003f70 0x7faf481f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4da00640 1 -- 172.21.15.59:0/3297577344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4814b060 con 0x7faf481e6470 2024-05-30T16:56:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf3fe00640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf481e5ff0 0x7faf48145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:33.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4d000640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf2c003f70 0x7faf481f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:33.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4da00640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf481e6470 0x7faf48145bb0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7faf4000e780 tx=0x7faf4000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:33.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf45600640 1 -- 172.21.15.59:0/3297577344 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf40003980 con 0x7faf481e6470 2024-05-30T16:56:33.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf45600640 1 -- 172.21.15.59:0/3297577344 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf40018070 con 0x7faf481e6470 2024-05-30T16:56:33.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4fa00640 1 -- 172.21.15.59:0/3297577344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf48144eb0 con 0x7faf481e6470 2024-05-30T16:56:33.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf45600640 1 -- 172.21.15.59:0/3297577344 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf40003d60 con 0x7faf481e6470 2024-05-30T16:56:33.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4fa00640 1 -- 172.21.15.59:0/3297577344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf48149320 con 0x7faf481e6470 2024-05-30T16:56:33.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.378+0000 7faf4fa00640 1 -- 172.21.15.59:0/3297577344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf48068a90 con 0x7faf481e6470 2024-05-30T16:56:33.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.382+0000 7faf45600640 1 -- 172.21.15.59:0/3297577344 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7faf400050d0 con 0x7faf481e6470 2024-05-30T16:56:33.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.382+0000 7faf45600640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faf240690a0 0x7faf2406b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:33.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.382+0000 7faf45600640 1 -- 172.21.15.59:0/3297577344 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5441+0+0 (secure 0 0 0) 0x7faf40085340 con 0x7faf481e6470 2024-05-30T16:56:33.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.382+0000 7faf4d000640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faf240690a0 0x7faf2406b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.382+0000 7faf4d000640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faf240690a0 0x7faf2406b560 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faf38001ce0 tx=0x7faf38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.386+0000 7faf45600640 1 -- 172.21.15.59:0/3297577344 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faf400570c0 con 0x7faf481e6470 2024-05-30T16:56:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:33.550+0000 7faf4fa00640 1 -- 172.21.15.59:0/3297577344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7faf48073fe0 con 0x7faf481e6470 2024-05-30T16:56:34.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.202+0000 7faf45600640 1 -- 172.21.15.59:0/3297577344 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v66) ==== 169+0+0 (secure 0 0 0) 0x7faf400569c0 con 0x7faf481e6470 2024-05-30T16:56:34.205 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-05-30T16:56:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.202+0000 7faf4fa00640 1 -- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faf240690a0 msgr2=0x7faf2406b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.202+0000 7faf4fa00640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faf240690a0 0x7faf2406b560 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faf38001ce0 tx=0x7faf38009040 comp rx=0 tx=0).stop 2024-05-30T16:56:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.202+0000 7faf4fa00640 1 -- 172.21.15.59:0/3297577344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf481e6470 msgr2=0x7faf48145bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.202+0000 7faf4fa00640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf481e6470 0x7faf48145bb0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7faf4000e780 tx=0x7faf4000ec40 comp rx=0 tx=0).stop 2024-05-30T16:56:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.202+0000 7faf4fa00640 1 -- 172.21.15.59:0/3297577344 shutdown_connections 2024-05-30T16:56:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.202+0000 7faf4fa00640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faf240690a0 0x7faf2406b560 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.202+0000 7faf4fa00640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf481e6470 0x7faf48145bb0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.202+0000 7faf4fa00640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf481e5ff0 0x7faf48145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.202+0000 7faf4fa00640 1 --2- 172.21.15.59:0/3297577344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf2c003f70 0x7faf481f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.202+0000 7faf4fa00640 1 -- 172.21.15.59:0/3297577344 >> 172.21.15.59:0/3297577344 conn(0x7faf480b1e60 msgr2=0x7faf480b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.206+0000 7faf4fa00640 1 -- 172.21.15.59:0/3297577344 shutdown_connections 2024-05-30T16:56:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.206+0000 7faf4fa00640 1 -- 172.21.15.59:0/3297577344 wait complete. 2024-05-30T16:56:34.242 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T16:56:34.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.390+0000 7f0329e00640 1 Processor -- start 2024-05-30T16:56:34.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.390+0000 7f0329e00640 1 -- start start 2024-05-30T16:56:34.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.390+0000 7f0329e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f032415e940 0x7f032406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:34.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.390+0000 7f0329e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03240b18c0 0x7f03240d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:34.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.390+0000 7f0329e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032415ed20 con 0x7f03240d1ac0 2024-05-30T16:56:34.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.390+0000 7f0329e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f03240d10f0 con 0x7f032415e940 2024-05-30T16:56:34.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.390+0000 7f0329e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f03240b1d00 con 0x7f03240b18c0 2024-05-30T16:56:34.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.394+0000 7f0323400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f03240d1ac0 0x7f03240af230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60058/0 (socket says 172.21.15.59:60058) 2024-05-30T16:56:34.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.394+0000 7f0323400640 1 -- 172.21.15.59:0/220326382 learned_addr learned my addr 172.21.15.59:0/220326382 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:34.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.394+0000 7f031a000640 1 --2- 172.21.15.59:0/220326382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03240b18c0 0x7f03240d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:34.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.394+0000 7f0322a00640 1 --2- 172.21.15.59:0/220326382 >> v2:172.21.15.107:3300/0 conn(0x7f032415e940 0x7f032406ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:34.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.394+0000 7f0322000640 1 -- 172.21.15.59:0/220326382 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328269881 0 0) 0x7f032415ed20 con 0x7f03240d1ac0 2024-05-30T16:56:34.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.394+0000 7f0322000640 1 -- 172.21.15.59:0/220326382 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0308003530 con 0x7f03240d1ac0 2024-05-30T16:56:34.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.394+0000 7f0322a00640 1 -- 172.21.15.59:0/220326382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03240b18c0 msgr2=0x7f03240d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:34.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.394+0000 7f0322a00640 1 --2- 172.21.15.59:0/220326382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03240b18c0 0x7f03240d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.394+0000 7f0322000640 1 -- 172.21.15.59:0/220326382 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1203696158 0 0) 0x7f0308003530 con 0x7f03240d1ac0 2024-05-30T16:56:34.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.394+0000 7f0322a00640 1 -- 172.21.15.59:0/220326382 >> v1:172.21.15.59:6789/0 conn(0x7f03240d1ac0 legacy=0x7f03240af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.394+0000 7f0322a00640 1 -- 172.21.15.59:0/220326382 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03240d0830 con 0x7f032415e940 2024-05-30T16:56:34.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0322a00640 1 --2- 172.21.15.59:0/220326382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f032415e940 0x7f032406ffe0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f03140097c0 tx=0x7f031401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad53eb048b87fbc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:34.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0322000640 1 -- 172.21.15.59:0/220326382 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03140b0070 con 0x7f032415e940 2024-05-30T16:56:34.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0322000640 1 -- 172.21.15.59:0/220326382 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03140ab400 con 0x7f032415e940 2024-05-30T16:56:34.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0322000640 1 -- 172.21.15.59:0/220326382 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c001a00 con 0x7f032415e940 2024-05-30T16:56:34.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 -- 172.21.15.59:0/220326382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f032415e940 msgr2=0x7f032406ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 --2- 172.21.15.59:0/220326382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f032415e940 0x7f032406ffe0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f03140097c0 tx=0x7f031401c3c0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 -- 172.21.15.59:0/220326382 shutdown_connections 2024-05-30T16:56:34.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 --2- 172.21.15.59:0/220326382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03240b18c0 0x7f03240d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 --2- 172.21.15.59:0/220326382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f032415e940 0x7f032406ffe0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 -- 172.21.15.59:0/220326382 >> 172.21.15.59:0/220326382 conn(0x7f03240b3f70 msgr2=0x7f03240b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:34.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 -- 172.21.15.59:0/220326382 shutdown_connections 2024-05-30T16:56:34.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 -- 172.21.15.59:0/220326382 wait complete. 2024-05-30T16:56:34.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 Processor -- start 2024-05-30T16:56:34.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 -- start start 2024-05-30T16:56:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03240b18c0 0x7f0324154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03240d1ac0 0x7f03240b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032415e940 0x7f03240b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f03240afac0 con 0x7f03240b18c0 2024-05-30T16:56:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f03240af940 con 0x7f03240d1ac0 2024-05-30T16:56:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0329e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f032416b730 con 0x7f032415e940 2024-05-30T16:56:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0322a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03240b18c0 0x7f0324154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0322a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03240b18c0 0x7f0324154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32824/0 (socket says 172.21.15.59:32824) 2024-05-30T16:56:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.398+0000 7f0322a00640 1 -- 172.21.15.59:0/2798434796 learned_addr learned my addr 172.21.15.59:0/2798434796 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f0322a00640 1 -- 172.21.15.59:0/2798434796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032415e940 msgr2=0x7f03240b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f0322a00640 1 --2- 172.21.15.59:0/2798434796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032415e940 0x7f03240b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f0322a00640 1 -- 172.21.15.59:0/2798434796 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03240d1ac0 msgr2=0x7f03240b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f0322a00640 1 --2- 172.21.15.59:0/2798434796 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03240d1ac0 0x7f03240b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f0322a00640 1 -- 172.21.15.59:0/2798434796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03240b39c0 con 0x7f03240b18c0 2024-05-30T16:56:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f0322a00640 1 --2- 172.21.15.59:0/2798434796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03240b18c0 0x7f0324154b20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f031401aa70 tx=0x7f031401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:34.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f031be00640 1 -- 172.21.15.59:0/2798434796 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03140b0050 con 0x7f03240b18c0 2024-05-30T16:56:34.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f031be00640 1 -- 172.21.15.59:0/2798434796 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03140bc070 con 0x7f03240b18c0 2024-05-30T16:56:34.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f031be00640 1 -- 172.21.15.59:0/2798434796 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03140b7890 con 0x7f03240b18c0 2024-05-30T16:56:34.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f0329e00640 1 -- 172.21.15.59:0/2798434796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03240c7240 con 0x7f03240b18c0 2024-05-30T16:56:34.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f0329e00640 1 -- 172.21.15.59:0/2798434796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03240b2c40 con 0x7f03240b18c0 2024-05-30T16:56:34.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f0329e00640 1 -- 172.21.15.59:0/2798434796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0324068a90 con 0x7f03240b18c0 2024-05-30T16:56:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f031be00640 1 -- 172.21.15.59:0/2798434796 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f03140b7a30 con 0x7f03240b18c0 2024-05-30T16:56:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f031be00640 1 --2- 172.21.15.59:0/2798434796 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0300069070 0x7f030006b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f031be00640 1 -- 172.21.15.59:0/2798434796 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5027+0+0 (secure 0 0 0) 0x7f031411fa30 con 0x7f03240b18c0 2024-05-30T16:56:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.402+0000 7f031a000640 1 --2- 172.21.15.59:0/2798434796 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0300069070 0x7f030006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.406+0000 7f031a000640 1 --2- 172.21.15.59:0/2798434796 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0300069070 0x7f030006b530 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f030c006aa0 tx=0x7f030c006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.406+0000 7f031be00640 1 -- 172.21.15.59:0/2798434796 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0314015fb0 con 0x7f03240b18c0 2024-05-30T16:56:34.547 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:56:34.551 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:56:34.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.578+0000 7f0329e00640 1 -- 172.21.15.59:0/2798434796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f03240702a0 con 0x7f03240b18c0 2024-05-30T16:56:34.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f031be00640 1 -- 172.21.15.59:0/2798434796 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7f03140f1a40 con 0x7f03240b18c0 2024-05-30T16:56:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f0329e00640 1 -- 172.21.15.59:0/2798434796 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0300069070 msgr2=0x7f030006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f0329e00640 1 --2- 172.21.15.59:0/2798434796 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0300069070 0x7f030006b530 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f030c006aa0 tx=0x7f030c006a30 comp rx=0 tx=0).stop 2024-05-30T16:56:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f0329e00640 1 -- 172.21.15.59:0/2798434796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03240b18c0 msgr2=0x7f0324154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f0329e00640 1 --2- 172.21.15.59:0/2798434796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03240b18c0 0x7f0324154b20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f031401aa70 tx=0x7f031401ac00 comp rx=0 tx=0).stop 2024-05-30T16:56:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f0329e00640 1 -- 172.21.15.59:0/2798434796 shutdown_connections 2024-05-30T16:56:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f0329e00640 1 --2- 172.21.15.59:0/2798434796 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0300069070 0x7f030006b530 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f0329e00640 1 --2- 172.21.15.59:0/2798434796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032415e940 0x7f03240b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f0329e00640 1 --2- 172.21.15.59:0/2798434796 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03240d1ac0 0x7f03240b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f0329e00640 1 --2- 172.21.15.59:0/2798434796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03240b18c0 0x7f0324154b20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f0329e00640 1 -- 172.21.15.59:0/2798434796 >> 172.21.15.59:0/2798434796 conn(0x7f03240b3f70 msgr2=0x7f032406ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f0329e00640 1 -- 172.21.15.59:0/2798434796 shutdown_connections 2024-05-30T16:56:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.582+0000 7f0329e00640 1 -- 172.21.15.59:0/2798434796 wait complete. 2024-05-30T16:56:34.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_no_wait 2024-05-30T16:56:34.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.786+0000 7efeb6000640 1 Processor -- start 2024-05-30T16:56:34.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.786+0000 7efeb6000640 1 -- start start 2024-05-30T16:56:34.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efeb6000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efeb00b44e0 0x7efeb015efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:34.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efeb6000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efeb015f510 0x7efeb015c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efeb6000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb00b52d0 con 0x7efeb0159100 2024-05-30T16:56:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efeb6000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7efeb00b4a30 con 0x7efeb00b44e0 2024-05-30T16:56:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efeb6000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efeb00b4d10 con 0x7efeb015f510 2024-05-30T16:56:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efea6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efeb00b44e0 0x7efeb015efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efea6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efeb00b44e0 0x7efeb015efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32832/0 (socket says 172.21.15.59:32832) 2024-05-30T16:56:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efea6a00640 1 -- 172.21.15.59:0/2034843228 learned_addr learned my addr 172.21.15.59:0/2034843228 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efeafe00640 1 --2- 172.21.15.59:0/2034843228 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efeb015f510 0x7efeb015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efea6a00640 1 -- 172.21.15.59:0/2034843228 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efeb015f510 msgr2=0x7efeb015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efea6a00640 1 --2- 172.21.15.59:0/2034843228 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efeb015f510 0x7efeb015c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efea6a00640 1 -- 172.21.15.59:0/2034843228 >> v1:172.21.15.107:6789/0 conn(0x7efeb0159100 legacy=0x7efeb006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.790+0000 7efea6a00640 1 -- 172.21.15.59:0/2034843228 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb00b4ff0 con 0x7efeb00b44e0 2024-05-30T16:56:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efea6a00640 1 --2- 172.21.15.59:0/2034843228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb00b44e0 0x7efeb015efd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efe9800bb10 tx=0x7efe9801eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f937fd1030b26a0b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:34.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeaea00640 1 -- 172.21.15.59:0/2034843228 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe980b4070 con 0x7efeb00b44e0 2024-05-30T16:56:34.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeaea00640 1 -- 172.21.15.59:0/2034843228 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe980a7b50 con 0x7efeb00b44e0 2024-05-30T16:56:34.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeaea00640 1 -- 172.21.15.59:0/2034843228 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe980af440 con 0x7efeb00b44e0 2024-05-30T16:56:34.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeb6000640 1 -- 172.21.15.59:0/2034843228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb00b44e0 msgr2=0x7efeb015efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeb6000640 1 --2- 172.21.15.59:0/2034843228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb00b44e0 0x7efeb015efd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efe9800bb10 tx=0x7efe9801eb70 comp rx=0 tx=0).stop 2024-05-30T16:56:34.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeb6000640 1 -- 172.21.15.59:0/2034843228 shutdown_connections 2024-05-30T16:56:34.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeb6000640 1 --2- 172.21.15.59:0/2034843228 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efeb015f510 0x7efeb015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeb6000640 1 --2- 172.21.15.59:0/2034843228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb00b44e0 0x7efeb015efd0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeb6000640 1 -- 172.21.15.59:0/2034843228 >> 172.21.15.59:0/2034843228 conn(0x7efeb006bdb0 msgr2=0x7efeb006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:34.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeb6000640 1 -- 172.21.15.59:0/2034843228 shutdown_connections 2024-05-30T16:56:34.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeb6000640 1 -- 172.21.15.59:0/2034843228 wait complete. 2024-05-30T16:56:34.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeb6000640 1 Processor -- start 2024-05-30T16:56:34.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeb6000640 1 -- start start 2024-05-30T16:56:34.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeb6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb00b44e0 0x7efeb0158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:34.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.794+0000 7efeb6000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efeb0159100 0x7efeb015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:34.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeb6000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efeb015f510 0x7efeb015d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:34.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeb6000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efeb00b37c0 con 0x7efeb00b44e0 2024-05-30T16:56:34.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeb6000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efeb00b3640 con 0x7efeb0159100 2024-05-30T16:56:34.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeb6000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efeb00b3940 con 0x7efeb015f510 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeaf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb00b44e0 0x7efeb0158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeaf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb00b44e0 0x7efeb0158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32836/0 (socket says 172.21.15.59:32836) 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeaf400640 1 -- 172.21.15.59:0/3430954983 learned_addr learned my addr 172.21.15.59:0/3430954983 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efea6a00640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efeb0159100 0x7efeb015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeafe00640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efeb015f510 0x7efeb015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeaf400640 1 -- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efeb015f510 msgr2=0x7efeb015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeaf400640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efeb015f510 0x7efeb015d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeaf400640 1 -- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efeb0159100 msgr2=0x7efeb015cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeaf400640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efeb0159100 0x7efeb015cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeaf400640 1 -- 172.21.15.59:0/3430954983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb00af020 con 0x7efeb00b44e0 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeaf400640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb00b44e0 0x7efeb0158520 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efea000c420 tx=0x7efea000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efea7e00640 1 -- 172.21.15.59:0/3430954983 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea00052d0 con 0x7efeb00b44e0 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efea7e00640 1 -- 172.21.15.59:0/3430954983 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea0005470 con 0x7efeb00b44e0 2024-05-30T16:56:34.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeb6000640 1 -- 172.21.15.59:0/3430954983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb0156a90 con 0x7efeb00b44e0 2024-05-30T16:56:34.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efea7e00640 1 -- 172.21.15.59:0/3430954983 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0007260 con 0x7efeb00b44e0 2024-05-30T16:56:34.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeb6000640 1 -- 172.21.15.59:0/3430954983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb0165170 con 0x7efeb00b44e0 2024-05-30T16:56:34.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efeb6000640 1 -- 172.21.15.59:0/3430954983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb0068a90 con 0x7efeb00b44e0 2024-05-30T16:56:34.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.798+0000 7efea7e00640 1 -- 172.21.15.59:0/3430954983 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7efea0007400 con 0x7efeb00b44e0 2024-05-30T16:56:34.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.802+0000 7efea7e00640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efe8c069070 0x7efe8c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:34.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.802+0000 7efea7e00640 1 -- 172.21.15.59:0/3430954983 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5027+0+0 (secure 0 0 0) 0x7efea00848b0 con 0x7efeb00b44e0 2024-05-30T16:56:34.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.802+0000 7efea6a00640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efe8c069070 0x7efe8c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:34.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.802+0000 7efea6a00640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efe8c069070 0x7efe8c06b530 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efe980b1000 tx=0x7efe98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:34.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.806+0000 7efea7e00640 1 -- 172.21.15.59:0/3430954983 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efea0056230 con 0x7efeb00b44e0 2024-05-30T16:56:34.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.970+0000 7efeb6000640 1 -- 172.21.15.59:0/3430954983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_no_wait"} v 0) -- 0x7efeb0152330 con 0x7efeb00b44e0 2024-05-30T16:56:34.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.974+0000 7efea7e00640 1 -- 172.21.15.59:0/3430954983 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_no_wait"}]=0 v17) ==== 117+0+0 (secure 0 0 0) 0x7efea005a530 con 0x7efeb00b44e0 2024-05-30T16:56:34.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.978+0000 7efeb6000640 1 -- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efe8c069070 msgr2=0x7efe8c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.978+0000 7efeb6000640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efe8c069070 0x7efe8c06b530 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efe980b1000 tx=0x7efe98008040 comp rx=0 tx=0).stop 2024-05-30T16:56:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.978+0000 7efeb6000640 1 -- 172.21.15.59:0/3430954983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb00b44e0 msgr2=0x7efeb0158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.978+0000 7efeb6000640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb00b44e0 0x7efeb0158520 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efea000c420 tx=0x7efea000c8e0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.978+0000 7efeb6000640 1 -- 172.21.15.59:0/3430954983 shutdown_connections 2024-05-30T16:56:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.978+0000 7efeb6000640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efe8c069070 0x7efe8c06b530 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.978+0000 7efeb6000640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efeb015f510 0x7efeb015d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.978+0000 7efeb6000640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efeb0159100 0x7efeb015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.978+0000 7efeb6000640 1 --2- 172.21.15.59:0/3430954983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb00b44e0 0x7efeb0158520 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.978+0000 7efeb6000640 1 -- 172.21.15.59:0/3430954983 >> 172.21.15.59:0/3430954983 conn(0x7efeb006bdb0 msgr2=0x7efeb006f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.978+0000 7efeb6000640 1 -- 172.21.15.59:0/3430954983 shutdown_connections 2024-05-30T16:56:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:34.978+0000 7efeb6000640 1 -- 172.21.15.59:0/3430954983 wait complete. 2024-05-30T16:56:35.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones' 2024-05-30T16:56:35.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.154+0000 7f3007e00640 1 Processor -- start 2024-05-30T16:56:35.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3007e00640 1 -- start start 2024-05-30T16:56:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3007e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f30000b38e0 0x7f300015f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3007e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300006fa10 0x7f300015fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3007e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30001620d0 con 0x7f3000161cf0 2024-05-30T16:56:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3007e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3000162310 con 0x7f30000b38e0 2024-05-30T16:56:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3007e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3000162560 con 0x7f300006fa10 2024-05-30T16:56:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3004a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f30000b38e0 0x7f300015f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3005e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300006fa10 0x7f300015fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3005400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3000161cf0 0x7f30000b31d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:40910/0 (socket says 172.21.15.59:40910) 2024-05-30T16:56:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3005400640 1 -- 172.21.15.59:0/447716903 learned_addr learned my addr 172.21.15.59:0/447716903 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3004a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f30000b38e0 0x7f300015f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:48394/0 (socket says 172.21.15.59:48394) 2024-05-30T16:56:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3004a00640 1 -- 172.21.15.59:0/447716903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300006fa10 msgr2=0x7f300015fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3004a00640 1 --2- 172.21.15.59:0/447716903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300006fa10 0x7f300015fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3004a00640 1 -- 172.21.15.59:0/447716903 >> v1:172.21.15.107:6789/0 conn(0x7f3000161cf0 legacy=0x7f30000b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f2fffe00640 1 -- 172.21.15.59:0/447716903 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3137499593 0 0) 0x7f30001620d0 con 0x7f3000161cf0 2024-05-30T16:56:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.158+0000 7f3004a00640 1 -- 172.21.15.59:0/447716903 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3000162840 con 0x7f30000b38e0 2024-05-30T16:56:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.162+0000 7f3005e00640 1 --2- 172.21.15.59:0/447716903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300006fa10 0x7f300015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:35.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.162+0000 7f3004a00640 1 --2- 172.21.15.59:0/447716903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30000b38e0 0x7f300015f770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009d90 tx=0x7f2ff801c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97141d8876efc978 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:35.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f2fffe00640 1 -- 172.21.15.59:0/447716903 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80b2070 con 0x7f30000b38e0 2024-05-30T16:56:35.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f2fffe00640 1 -- 172.21.15.59:0/447716903 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff80a5970 con 0x7f30000b38e0 2024-05-30T16:56:35.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f2fffe00640 1 -- 172.21.15.59:0/447716903 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80a5d40 con 0x7f30000b38e0 2024-05-30T16:56:35.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f3007e00640 1 -- 172.21.15.59:0/447716903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30000b38e0 msgr2=0x7f300015f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:35.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f3007e00640 1 --2- 172.21.15.59:0/447716903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30000b38e0 0x7f300015f770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009d90 tx=0x7f2ff801c8b0 comp rx=0 tx=0).stop 2024-05-30T16:56:35.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f3007e00640 1 -- 172.21.15.59:0/447716903 shutdown_connections 2024-05-30T16:56:35.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f3007e00640 1 --2- 172.21.15.59:0/447716903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f300006fa10 0x7f300015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:35.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f3007e00640 1 --2- 172.21.15.59:0/447716903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30000b38e0 0x7f300015f770 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:35.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f3007e00640 1 -- 172.21.15.59:0/447716903 >> 172.21.15.59:0/447716903 conn(0x7f30000b56f0 msgr2=0x7f30000b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:35.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f3007e00640 1 -- 172.21.15.59:0/447716903 shutdown_connections 2024-05-30T16:56:35.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f3007e00640 1 -- 172.21.15.59:0/447716903 wait complete. 2024-05-30T16:56:35.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f3007e00640 1 Processor -- start 2024-05-30T16:56:35.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.166+0000 7f3007e00640 1 -- start start 2024-05-30T16:56:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3007e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f300006fa10 0x7f3000099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3007e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30000b38e0 0x7f3000150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3007e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3000161cf0 0x7f3000154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3007e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f300006ec50 con 0x7f300006fa10 2024-05-30T16:56:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3007e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f30001601f0 con 0x7f30000b38e0 2024-05-30T16:56:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3007e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f300006edd0 con 0x7f3000161cf0 2024-05-30T16:56:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3005400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f300006fa10 0x7f3000099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3005e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3000161cf0 0x7f3000154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3005400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f300006fa10 0x7f3000099850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32848/0 (socket says 172.21.15.59:32848) 2024-05-30T16:56:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3005400640 1 -- 172.21.15.59:0/486125375 learned_addr learned my addr 172.21.15.59:0/486125375 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3004a00640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30000b38e0 0x7f3000150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3005400640 1 -- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3000161cf0 msgr2=0x7f3000154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3005400640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3000161cf0 0x7f3000154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3005400640 1 -- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30000b38e0 msgr2=0x7f3000150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3005400640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30000b38e0 0x7f3000150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3005400640 1 -- 172.21.15.59:0/486125375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300014ee70 con 0x7f300006fa10 2024-05-30T16:56:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3005e00640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3000161cf0 0x7f3000154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3004a00640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30000b38e0 0x7f3000150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3005400640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f300006fa10 0x7f3000099850 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400c480 tx=0x7f2ff400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:35.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f2ffd600640 1 -- 172.21.15.59:0/486125375 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff40074e0 con 0x7f300006fa10 2024-05-30T16:56:35.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f2ffd600640 1 -- 172.21.15.59:0/486125375 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff40047f0 con 0x7f300006fa10 2024-05-30T16:56:35.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f2ffd600640 1 -- 172.21.15.59:0/486125375 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4004be0 con 0x7f300006fa10 2024-05-30T16:56:35.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3007e00640 1 -- 172.21.15.59:0/486125375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300014f150 con 0x7f300006fa10 2024-05-30T16:56:35.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.170+0000 7f3007e00640 1 -- 172.21.15.59:0/486125375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f300014f710 con 0x7f300006fa10 2024-05-30T16:56:35.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.174+0000 7f3007e00640 1 -- 172.21.15.59:0/486125375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3000068a90 con 0x7f300006fa10 2024-05-30T16:56:35.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.174+0000 7f2ffd600640 1 -- 172.21.15.59:0/486125375 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f2ff4011070 con 0x7f300006fa10 2024-05-30T16:56:35.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.174+0000 7f2ffd600640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2fe00690c0 0x7f2fe006b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:35.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.174+0000 7f2ffd600640 1 -- 172.21.15.59:0/486125375 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5027+0+0 (secure 0 0 0) 0x7f2ff4084f10 con 0x7f300006fa10 2024-05-30T16:56:35.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.174+0000 7f3004a00640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2fe00690c0 0x7f2fe006b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:35.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.178+0000 7f3004a00640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2fe00690c0 0x7f2fe006b580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80af000 tx=0x7f2ff80a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:35.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.182+0000 7f2ffd600640 1 -- 172.21.15.59:0/486125375 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2ff4056f20 con 0x7f300006fa10 2024-05-30T16:56:35.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:35.402+0000 7f3007e00640 1 -- 172.21.15.59:0/486125375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]} v 0) -- 0x7f30000692a0 con 0x7f300006fa10 2024-05-30T16:56:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.210+0000 7f2ffd600640 1 -- 172.21.15.59:0/486125375 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]}]=0 v342) ==== 162+0+0 (secure 0 0 0) 0x7f2ff4056820 con 0x7f300006fa10 2024-05-30T16:56:36.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.210+0000 7f3007e00640 1 -- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2fe00690c0 msgr2=0x7f2fe006b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.210+0000 7f3007e00640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2fe00690c0 0x7f2fe006b580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80af000 tx=0x7f2ff80a7070 comp rx=0 tx=0).stop 2024-05-30T16:56:36.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.210+0000 7f3007e00640 1 -- 172.21.15.59:0/486125375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f300006fa10 msgr2=0x7f3000099850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.210+0000 7f3007e00640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f300006fa10 0x7f3000099850 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400c480 tx=0x7f2ff400c880 comp rx=0 tx=0).stop 2024-05-30T16:56:36.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.214+0000 7f3007e00640 1 -- 172.21.15.59:0/486125375 shutdown_connections 2024-05-30T16:56:36.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.214+0000 7f3007e00640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2fe00690c0 0x7f2fe006b580 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.214+0000 7f3007e00640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3000161cf0 0x7f3000154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.214+0000 7f3007e00640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30000b38e0 0x7f3000150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.214+0000 7f3007e00640 1 --2- 172.21.15.59:0/486125375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f300006fa10 0x7f3000099850 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.214+0000 7f3007e00640 1 -- 172.21.15.59:0/486125375 >> 172.21.15.59:0/486125375 conn(0x7f30000b56f0 msgr2=0x7f3000160370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:36.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.214+0000 7f3007e00640 1 -- 172.21.15.59:0/486125375 shutdown_connections 2024-05-30T16:56:36.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.214+0000 7f3007e00640 1 -- 172.21.15.59:0/486125375 wait complete. 2024-05-30T16:56:36.240 INFO:tasks.cephfs_test_runner:Test that 2 progress bars are printed when number of clone jobs is ... ok 2024-05-30T16:56:36.240 INFO:tasks.cephfs_test_runner:Starting test: test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that progress indicated by progress bar for ongoing+pending clones 2024-05-30T16:56:36.240 INFO:tasks.cephfs_test_runner:test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:56:36.241 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:56:36.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.382+0000 7f1145a00640 1 Processor -- start 2024-05-30T16:56:36.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.382+0000 7f1145a00640 1 -- start start 2024-05-30T16:56:36.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.382+0000 7f1145a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f114015e710 0x7f11401614e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:36.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.382+0000 7f1145a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1140161a20 0x7f11400d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:36.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.382+0000 7f1145a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11401627a0 con 0x7f1140161ea0 2024-05-30T16:56:36.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.382+0000 7f1145a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f11400d0660 con 0x7f1140161a20 2024-05-30T16:56:36.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.382+0000 7f1145a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1140162a80 con 0x7f114015e710 2024-05-30T16:56:36.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.386+0000 7f1136000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1140161a20 0x7f11400d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:36.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.386+0000 7f113f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1140161ea0 0x7f11400d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60064/0 (socket says 172.21.15.59:60064) 2024-05-30T16:56:36.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.386+0000 7f113f400640 1 -- 172.21.15.59:0/3788815342 learned_addr learned my addr 172.21.15.59:0/3788815342 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:36.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.386+0000 7f113ea00640 1 --2- 172.21.15.59:0/3788815342 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f114015e710 0x7f11401614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:36.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.386+0000 7f1136000640 1 -- 172.21.15.59:0/3788815342 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f114015e710 msgr2=0x7f11401614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:36.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.386+0000 7f1136000640 1 --2- 172.21.15.59:0/3788815342 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f114015e710 0x7f11401614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.386+0000 7f1136000640 1 -- 172.21.15.59:0/3788815342 >> v1:172.21.15.59:6789/0 conn(0x7f1140161ea0 legacy=0x7f11400d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.386+0000 7f1136000640 1 -- 172.21.15.59:0/3788815342 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1140162d60 con 0x7f1140161a20 2024-05-30T16:56:36.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.386+0000 7f1136000640 1 --2- 172.21.15.59:0/3788815342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1140161a20 0x7f11400d0a90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1128009d90 tx=0x7f112801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbedb435f5f08791 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.386+0000 7f113e000640 1 -- 172.21.15.59:0/3788815342 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11280b2070 con 0x7f1140161a20 2024-05-30T16:56:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.386+0000 7f113e000640 1 -- 172.21.15.59:0/3788815342 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11280a5830 con 0x7f1140161a20 2024-05-30T16:56:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.386+0000 7f113e000640 1 -- 172.21.15.59:0/3788815342 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11280a5c00 con 0x7f1140161a20 2024-05-30T16:56:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 -- 172.21.15.59:0/3788815342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1140161a20 msgr2=0x7f11400d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 --2- 172.21.15.59:0/3788815342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1140161a20 0x7f11400d0a90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1128009d90 tx=0x7f112801c970 comp rx=0 tx=0).stop 2024-05-30T16:56:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 -- 172.21.15.59:0/3788815342 shutdown_connections 2024-05-30T16:56:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 --2- 172.21.15.59:0/3788815342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1140161a20 0x7f11400d0a90 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 --2- 172.21.15.59:0/3788815342 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f114015e710 0x7f11401614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 -- 172.21.15.59:0/3788815342 >> 172.21.15.59:0/3788815342 conn(0x7f11400b3f50 msgr2=0x7f11400b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 -- 172.21.15.59:0/3788815342 shutdown_connections 2024-05-30T16:56:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 -- 172.21.15.59:0/3788815342 wait complete. 2024-05-30T16:56:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 Processor -- start 2024-05-30T16:56:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 -- start start 2024-05-30T16:56:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114015e710 0x7f11400b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1140161a20 0x7f114015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1140161ea0 0x7f114009fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f114015fc80 con 0x7f114015e710 2024-05-30T16:56:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f114015fb00 con 0x7f1140161a20 2024-05-30T16:56:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1145a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f114006d340 con 0x7f1140161ea0 2024-05-30T16:56:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f113ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114015e710 0x7f11400b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f113ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114015e710 0x7f11400b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32866/0 (socket says 172.21.15.59:32866) 2024-05-30T16:56:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f113ea00640 1 -- 172.21.15.59:0/2591956330 learned_addr learned my addr 172.21.15.59:0/2591956330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f113f400640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1140161ea0 0x7f114009fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f1136000640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1140161a20 0x7f114015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f113ea00640 1 -- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1140161ea0 msgr2=0x7f114009fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f113ea00640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1140161ea0 0x7f114009fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f113ea00640 1 -- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1140161a20 msgr2=0x7f114015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f113ea00640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1140161a20 0x7f114015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.390+0000 7f113ea00640 1 -- 172.21.15.59:0/2591956330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11400b6530 con 0x7f114015e710 2024-05-30T16:56:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.394+0000 7f113ea00640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114015e710 0x7f11400b5ee0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f113000d830 tx=0x7f113000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.394+0000 7f1137400640 1 -- 172.21.15.59:0/2591956330 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113000b6c0 con 0x7f114015e710 2024-05-30T16:56:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.394+0000 7f1137400640 1 -- 172.21.15.59:0/2591956330 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1130019070 con 0x7f114015e710 2024-05-30T16:56:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.394+0000 7f1137400640 1 -- 172.21.15.59:0/2591956330 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113000ba60 con 0x7f114015e710 2024-05-30T16:56:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.394+0000 7f1145a00640 1 -- 172.21.15.59:0/2591956330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11400b6810 con 0x7f114015e710 2024-05-30T16:56:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.394+0000 7f1145a00640 1 -- 172.21.15.59:0/2591956330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f114015c850 con 0x7f114015e710 2024-05-30T16:56:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.394+0000 7f1145a00640 1 -- 172.21.15.59:0/2591956330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1140068a90 con 0x7f114015e710 2024-05-30T16:56:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.394+0000 7f1137400640 1 -- 172.21.15.59:0/2591956330 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f113001e460 con 0x7f114015e710 2024-05-30T16:56:36.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.394+0000 7f1137400640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f111c069070 0x7f111c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:36.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.394+0000 7f1137400640 1 -- 172.21.15.59:0/2591956330 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5027+0+0 (secure 0 0 0) 0x7f1130085c10 con 0x7f114015e710 2024-05-30T16:56:36.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.394+0000 7f1136000640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f111c069070 0x7f111c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:36.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.398+0000 7f1136000640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f111c069070 0x7f111c06b530 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f11280af000 tx=0x7f11280a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:36.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.398+0000 7f1137400640 1 -- 172.21.15.59:0/2591956330 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1130057340 con 0x7f114015e710 2024-05-30T16:56:36.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 -- 172.21.15.59:0/2591956330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11400d14c0 con 0x7f114015e710 2024-05-30T16:56:36.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1137400640 1 -- 172.21.15.59:0/2591956330 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+13139 (secure 0 0 0) 0x7f113005b640 con 0x7f114015e710 2024-05-30T16:56:36.570 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:36.570 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":66,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:56:34.198535+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/2433633874":"2024-05-31T16:56:31.129865+0000","172.21.15.59:6834/2433633874":"2024-05-31T16:56:31.129865+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:56:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 -- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f111c069070 msgr2=0x7f111c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f111c069070 0x7f111c06b530 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f11280af000 tx=0x7f11280a7070 comp rx=0 tx=0).stop 2024-05-30T16:56:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 -- 172.21.15.59:0/2591956330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114015e710 msgr2=0x7f11400b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114015e710 0x7f11400b5ee0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f113000d830 tx=0x7f113000dcf0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 -- 172.21.15.59:0/2591956330 shutdown_connections 2024-05-30T16:56:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f111c069070 0x7f111c06b530 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1140161ea0 0x7f114009fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1140161a20 0x7f114015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 --2- 172.21.15.59:0/2591956330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114015e710 0x7f11400b5ee0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 -- 172.21.15.59:0/2591956330 >> 172.21.15.59:0/2591956330 conn(0x7f11400b3f50 msgr2=0x7f114006d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 -- 172.21.15.59:0/2591956330 shutdown_connections 2024-05-30T16:56:36.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.566+0000 7f1145a00640 1 -- 172.21.15.59:0/2591956330 wait complete. 2024-05-30T16:56:36.591 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T16:48:53.098546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T16:56:36.591 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T16:56:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f1660400640 1 Processor -- start 2024-05-30T16:56:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f1660400640 1 -- start start 2024-05-30T16:56:36.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f1660400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16581569e0 0x7f165815d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:36.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f1660400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16580ad2b0 0x7f16580cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:36.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f1660400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16580ad770 con 0x7f16580d0660 2024-05-30T16:56:36.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f1660400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f165815cb40 con 0x7f16580ad2b0 2024-05-30T16:56:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f1660400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f165815ce20 con 0x7f16581569e0 2024-05-30T16:56:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f165d000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16580ad2b0 0x7f16580cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f165d000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16580ad2b0 0x7f16580cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32882/0 (socket says 172.21.15.59:32882) 2024-05-30T16:56:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f165d000640 1 -- 172.21.15.59:0/1022621172 learned_addr learned my addr 172.21.15.59:0/1022621172 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f165da00640 1 --2- 172.21.15.59:0/1022621172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16581569e0 0x7f165815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f165d000640 1 -- 172.21.15.59:0/1022621172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16581569e0 msgr2=0x7f165815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f165d000640 1 --2- 172.21.15.59:0/1022621172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16581569e0 0x7f165815d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f165d000640 1 -- 172.21.15.59:0/1022621172 >> v1:172.21.15.107:6789/0 conn(0x7f16580d0660 legacy=0x7f16580b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.730+0000 7f165d000640 1 -- 172.21.15.59:0/1022621172 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165815d100 con 0x7f16580ad2b0 2024-05-30T16:56:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.734+0000 7f165d000640 1 --2- 172.21.15.59:0/1022621172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16580ad2b0 0x7f16580cf9f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1644009870 tx=0x7f164401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2cd8538dac0fe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.734+0000 7f1657e00640 1 -- 172.21.15.59:0/1022621172 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440ab430 con 0x7f16580ad2b0 2024-05-30T16:56:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.734+0000 7f1657e00640 1 -- 172.21.15.59:0/1022621172 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16440b0070 con 0x7f16580ad2b0 2024-05-30T16:56:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.734+0000 7f1657e00640 1 -- 172.21.15.59:0/1022621172 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440ab7f0 con 0x7f16580ad2b0 2024-05-30T16:56:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.734+0000 7f1660400640 1 -- 172.21.15.59:0/1022621172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16580ad2b0 msgr2=0x7f16580cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.734+0000 7f1660400640 1 --2- 172.21.15.59:0/1022621172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16580ad2b0 0x7f16580cf9f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1644009870 tx=0x7f164401c440 comp rx=0 tx=0).stop 2024-05-30T16:56:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.734+0000 7f1660400640 1 -- 172.21.15.59:0/1022621172 shutdown_connections 2024-05-30T16:56:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.734+0000 7f1660400640 1 --2- 172.21.15.59:0/1022621172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16580ad2b0 0x7f16580cf9f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.734+0000 7f1660400640 1 --2- 172.21.15.59:0/1022621172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16581569e0 0x7f165815d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.734+0000 7f1660400640 1 -- 172.21.15.59:0/1022621172 >> 172.21.15.59:0/1022621172 conn(0x7f165806bdb0 msgr2=0x7f165806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.734+0000 7f1660400640 1 -- 172.21.15.59:0/1022621172 shutdown_connections 2024-05-30T16:56:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.734+0000 7f1660400640 1 -- 172.21.15.59:0/1022621172 wait complete. 2024-05-30T16:56:36.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1660400640 1 Processor -- start 2024-05-30T16:56:36.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1660400640 1 -- start start 2024-05-30T16:56:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1660400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16580ad2b0 0x7f16580b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1660400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16580d0660 0x7f1658149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1660400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16581569e0 0x7f165806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1660400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f16580d00b0 con 0x7f16581569e0 2024-05-30T16:56:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1660400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f16580cff30 con 0x7f16580ad2b0 2024-05-30T16:56:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1660400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f16581691b0 con 0x7f16580d0660 2024-05-30T16:56:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f165e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16581569e0 0x7f165806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f165da00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16580ad2b0 0x7f16580b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f165d000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16580d0660 0x7f1658149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f165e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16581569e0 0x7f165806e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32894/0 (socket says 172.21.15.59:32894) 2024-05-30T16:56:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f165e400640 1 -- 172.21.15.59:0/3428391661 learned_addr learned my addr 172.21.15.59:0/3428391661 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f165d000640 1 -- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16580ad2b0 msgr2=0x7f16580b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f165d000640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16580ad2b0 0x7f16580b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f165d000640 1 -- 172.21.15.59:0/3428391661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16581569e0 msgr2=0x7f165806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f165d000640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16581569e0 0x7f165806e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f165d000640 1 -- 172.21.15.59:0/3428391661 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165806ecd0 con 0x7f16580d0660 2024-05-30T16:56:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f165e400640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16581569e0 0x7f165806e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f165d000640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16580d0660 0x7f1658149cd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16440ac000 tx=0x7f16440191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1655600640 1 -- 172.21.15.59:0/3428391661 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440ba070 con 0x7f16580d0660 2024-05-30T16:56:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1655600640 1 -- 172.21.15.59:0/3428391661 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16440abdd0 con 0x7f16580d0660 2024-05-30T16:56:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1655600640 1 -- 172.21.15.59:0/3428391661 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440b4660 con 0x7f16580d0660 2024-05-30T16:56:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1660400640 1 -- 172.21.15.59:0/3428391661 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165806efb0 con 0x7f16580d0660 2024-05-30T16:56:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.738+0000 7f1660400640 1 -- 172.21.15.59:0/3428391661 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f16580b22c0 con 0x7f16580d0660 2024-05-30T16:56:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.742+0000 7f1660400640 1 -- 172.21.15.59:0/3428391661 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1658068a90 con 0x7f16580d0660 2024-05-30T16:56:36.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.742+0000 7f1655600640 1 -- 172.21.15.59:0/3428391661 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f16440bd070 con 0x7f16580d0660 2024-05-30T16:56:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.742+0000 7f1655600640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1638069070 0x7f163806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.742+0000 7f1655600640 1 -- 172.21.15.59:0/3428391661 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(66..66 src has 1..66) ==== 5027+0+0 (secure 0 0 0) 0x7f164411f810 con 0x7f16580d0660 2024-05-30T16:56:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.742+0000 7f165da00640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1638069070 0x7f163806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:36.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.742+0000 7f165da00640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1638069070 0x7f163806b530 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f164c009ac0 tx=0x7f164c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.746+0000 7f1655600640 1 -- 172.21.15.59:0/3428391661 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1644016150 con 0x7f16580d0660 2024-05-30T16:56:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.914+0000 7f1660400640 1 -- 172.21.15.59:0/3428391661 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f16580b43c0 con 0x7f16580d0660 2024-05-30T16:56:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.914+0000 7f1655600640 1 -- 172.21.15.59:0/3428391661 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) ==== 93+0+10 (secure 0 0 0) 0x7f16440f11d0 con 0x7f16580d0660 2024-05-30T16:56:36.920 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-05-30T16:56:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.918+0000 7f1660400640 1 -- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1638069070 msgr2=0x7f163806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.918+0000 7f1660400640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1638069070 0x7f163806b530 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f164c009ac0 tx=0x7f164c009190 comp rx=0 tx=0).stop 2024-05-30T16:56:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.918+0000 7f1660400640 1 -- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16580d0660 msgr2=0x7f1658149cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.918+0000 7f1660400640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16580d0660 0x7f1658149cd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16440ac000 tx=0x7f16440191e0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.918+0000 7f1660400640 1 -- 172.21.15.59:0/3428391661 shutdown_connections 2024-05-30T16:56:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.918+0000 7f1660400640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1638069070 0x7f163806b530 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.918+0000 7f1660400640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16581569e0 0x7f165806e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.918+0000 7f1660400640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16580d0660 0x7f1658149cd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.918+0000 7f1660400640 1 --2- 172.21.15.59:0/3428391661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16580ad2b0 0x7f16580b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.918+0000 7f1660400640 1 -- 172.21.15.59:0/3428391661 >> 172.21.15.59:0/3428391661 conn(0x7f165806bdb0 msgr2=0x7f1658152690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.918+0000 7f1660400640 1 -- 172.21.15.59:0/3428391661 shutdown_connections 2024-05-30T16:56:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:36.918+0000 7f1660400640 1 -- 172.21.15.59:0/3428391661 wait complete. 2024-05-30T16:56:36.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added' 2024-05-30T16:56:37.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.078+0000 7f5173000640 1 Processor -- start 2024-05-30T16:56:37.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.078+0000 7f5173000640 1 -- start start 2024-05-30T16:56:37.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f5173000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f516c0af720 0x7f516c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:37.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f5173000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f516c06e900 0x7f516c15f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:37.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f5173000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516c15f060 con 0x7f516c0d0560 2024-05-30T16:56:37.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f5173000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f516c0afb00 con 0x7f516c06e900 2024-05-30T16:56:37.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f5173000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f516c15c270 con 0x7f516c0af720 2024-05-30T16:56:37.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f5171000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f516c0d0560 0x7f516c072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60066/0 (socket says 172.21.15.59:60066) 2024-05-30T16:56:37.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f5171000640 1 -- 172.21.15.59:0/414880336 learned_addr learned my addr 172.21.15.59:0/414880336 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:37.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f5163e00640 1 --2- 172.21.15.59:0/414880336 >> v2:172.21.15.107:3300/0 conn(0x7f516c06e900 0x7f516c15f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:37.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f516be00640 1 --2- 172.21.15.59:0/414880336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f516c0af720 0x7f516c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:37.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f516b400640 1 -- 172.21.15.59:0/414880336 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4287772792 0 0) 0x7f516c15f060 con 0x7f516c0d0560 2024-05-30T16:56:37.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f516b400640 1 -- 172.21.15.59:0/414880336 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5150003530 con 0x7f516c0d0560 2024-05-30T16:56:37.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f5163e00640 1 -- 172.21.15.59:0/414880336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f516c0af720 msgr2=0x7f516c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:37.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f5163e00640 1 --2- 172.21.15.59:0/414880336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f516c0af720 0x7f516c15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f5163e00640 1 -- 172.21.15.59:0/414880336 >> v1:172.21.15.59:6789/0 conn(0x7f516c0d0560 legacy=0x7f516c072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.082+0000 7f5163e00640 1 -- 172.21.15.59:0/414880336 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c15c550 con 0x7f516c06e900 2024-05-30T16:56:37.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f5163e00640 1 --2- 172.21.15.59:0/414880336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f516c06e900 0x7f516c15f7f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f51540097c0 tx=0x7f515401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d3428b541e914fc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:37.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f516b400640 1 -- 172.21.15.59:0/414880336 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51540aa5f0 con 0x7f516c06e900 2024-05-30T16:56:37.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f516b400640 1 -- 172.21.15.59:0/414880336 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51540af070 con 0x7f516c06e900 2024-05-30T16:56:37.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f516b400640 1 -- 172.21.15.59:0/414880336 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51540aa9b0 con 0x7f516c06e900 2024-05-30T16:56:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f5173000640 1 -- 172.21.15.59:0/414880336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f516c06e900 msgr2=0x7f516c15f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f5173000640 1 --2- 172.21.15.59:0/414880336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f516c06e900 0x7f516c15f7f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f51540097c0 tx=0x7f515401c470 comp rx=0 tx=0).stop 2024-05-30T16:56:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f5173000640 1 -- 172.21.15.59:0/414880336 shutdown_connections 2024-05-30T16:56:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f5173000640 1 --2- 172.21.15.59:0/414880336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f516c06e900 0x7f516c15f7f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f5173000640 1 --2- 172.21.15.59:0/414880336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f516c0af720 0x7f516c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f5173000640 1 -- 172.21.15.59:0/414880336 >> 172.21.15.59:0/414880336 conn(0x7f516c0b22d0 msgr2=0x7f516c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f5173000640 1 -- 172.21.15.59:0/414880336 shutdown_connections 2024-05-30T16:56:37.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f5173000640 1 -- 172.21.15.59:0/414880336 wait complete. 2024-05-30T16:56:37.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f5173000640 1 Processor -- start 2024-05-30T16:56:37.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.086+0000 7f5173000640 1 -- start start 2024-05-30T16:56:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5173000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f516c06e900 0x7f516c14c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5173000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f516c0af720 0x7f516c159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5173000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c0d0560 0x7f516c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5173000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f516c15fd30 con 0x7f516c0d0560 2024-05-30T16:56:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5173000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f516c0d0da0 con 0x7f516c0af720 2024-05-30T16:56:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5173000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f516c15feb0 con 0x7f516c06e900 2024-05-30T16:56:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5171000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c0d0560 0x7f516c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5171000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c0d0560 0x7f516c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32904/0 (socket says 172.21.15.59:32904) 2024-05-30T16:56:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5171000640 1 -- 172.21.15.59:0/285173930 learned_addr learned my addr 172.21.15.59:0/285173930 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f516be00640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f516c06e900 0x7f516c14c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5163e00640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f516c0af720 0x7f516c159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5171000640 1 -- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f516c06e900 msgr2=0x7f516c14c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:37.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5171000640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f516c06e900 0x7f516c14c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:37.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5171000640 1 -- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f516c0af720 msgr2=0x7f516c159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:37.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5171000640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f516c0af720 0x7f516c159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:37.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5171000640 1 -- 172.21.15.59:0/285173930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c1f7b80 con 0x7f516c0d0560 2024-05-30T16:56:37.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5171000640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c0d0560 0x7f516c15a360 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f516400caa0 tx=0x7f516400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:37.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5168c00640 1 -- 172.21.15.59:0/285173930 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5164017070 con 0x7f516c0d0560 2024-05-30T16:56:37.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5168c00640 1 -- 172.21.15.59:0/285173930 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f516400ac00 con 0x7f516c0d0560 2024-05-30T16:56:37.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5168c00640 1 -- 172.21.15.59:0/285173930 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5164012400 con 0x7f516c0d0560 2024-05-30T16:56:37.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5173000640 1 -- 172.21.15.59:0/285173930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516c1f7e40 con 0x7f516c0d0560 2024-05-30T16:56:37.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5173000640 1 -- 172.21.15.59:0/285173930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f516c1f8400 con 0x7f516c0d0560 2024-05-30T16:56:37.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5173000640 1 -- 172.21.15.59:0/285173930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f516c068a90 con 0x7f516c0d0560 2024-05-30T16:56:37.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.090+0000 7f5168c00640 1 -- 172.21.15.59:0/285173930 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f516401a070 con 0x7f516c0d0560 2024-05-30T16:56:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.094+0000 7f5168c00640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5148069070 0x7f514806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.094+0000 7f5168c00640 1 -- 172.21.15.59:0/285173930 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5027+0+0 (secure 0 0 0) 0x7f5164085170 con 0x7f516c0d0560 2024-05-30T16:56:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.094+0000 7f516be00640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5148069070 0x7f514806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:37.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.094+0000 7f516be00640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5148069070 0x7f514806b530 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f516c15fa70 tx=0x7f515c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:37.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.098+0000 7f5168c00640 1 -- 172.21.15.59:0/285173930 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5164057180 con 0x7f516c0d0560 2024-05-30T16:56:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:37.318+0000 7f5173000640 1 -- 172.21.15.59:0/285173930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]} v 0) -- 0x7f516c09e310 con 0x7f516c0d0560 2024-05-30T16:56:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.218+0000 7f5168c00640 1 -- 172.21.15.59:0/285173930 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]}]=0 v344) ==== 177+0+0 (secure 0 0 0) 0x7f5164056a80 con 0x7f516c0d0560 2024-05-30T16:56:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.222+0000 7f5173000640 1 -- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5148069070 msgr2=0x7f514806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.222+0000 7f5173000640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5148069070 0x7f514806b530 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f516c15fa70 tx=0x7f515c008040 comp rx=0 tx=0).stop 2024-05-30T16:56:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.222+0000 7f5173000640 1 -- 172.21.15.59:0/285173930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c0d0560 msgr2=0x7f516c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.222+0000 7f5173000640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c0d0560 0x7f516c15a360 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f516400caa0 tx=0x7f516400cf60 comp rx=0 tx=0).stop 2024-05-30T16:56:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.222+0000 7f5173000640 1 -- 172.21.15.59:0/285173930 shutdown_connections 2024-05-30T16:56:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.222+0000 7f5173000640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5148069070 0x7f514806b530 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.222+0000 7f5173000640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c0d0560 0x7f516c15a360 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.222+0000 7f5173000640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f516c0af720 0x7f516c159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.222+0000 7f5173000640 1 --2- 172.21.15.59:0/285173930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f516c06e900 0x7f516c14c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.222+0000 7f5173000640 1 -- 172.21.15.59:0/285173930 >> 172.21.15.59:0/285173930 conn(0x7f516c0b22d0 msgr2=0x7f516c15cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.222+0000 7f5173000640 1 -- 172.21.15.59:0/285173930 shutdown_connections 2024-05-30T16:56:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.222+0000 7f5173000640 1 -- 172.21.15.59:0/285173930 wait complete. 2024-05-30T16:56:38.250 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:56:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.394+0000 7f704a600640 1 Processor -- start 2024-05-30T16:56:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.394+0000 7f704a600640 1 -- start start 2024-05-30T16:56:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.394+0000 7f704a600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70441569e0 0x7f704415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.394+0000 7f704a600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f70440ad2b0 0x7f70440cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.394+0000 7f704a600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70440ad770 con 0x7f70440d0660 2024-05-30T16:56:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.394+0000 7f704a600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f704415cb40 con 0x7f70441569e0 2024-05-30T16:56:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.394+0000 7f704a600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f704415ce20 con 0x7f70440ad2b0 2024-05-30T16:56:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f7043400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70441569e0 0x7f704415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f7043400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70441569e0 0x7f704415d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32908/0 (socket says 172.21.15.59:32908) 2024-05-30T16:56:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f7043400640 1 -- 172.21.15.59:0/1691372248 learned_addr learned my addr 172.21.15.59:0/1691372248 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f703aa00640 1 --2- 172.21.15.59:0/1691372248 >> v2:172.21.15.107:3300/0 conn(0x7f70440ad2b0 0x7f70440cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f7043400640 1 -- 172.21.15.59:0/1691372248 >> v2:172.21.15.107:3300/0 conn(0x7f70440ad2b0 msgr2=0x7f70440cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f7043400640 1 --2- 172.21.15.59:0/1691372248 >> v2:172.21.15.107:3300/0 conn(0x7f70440ad2b0 0x7f70440cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f7043400640 1 -- 172.21.15.59:0/1691372248 >> v1:172.21.15.107:6789/0 conn(0x7f70440d0660 legacy=0x7f70440b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f7043400640 1 -- 172.21.15.59:0/1691372248 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704415d100 con 0x7f70441569e0 2024-05-30T16:56:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f703aa00640 1 --2- 172.21.15.59:0/1691372248 >> v2:172.21.15.107:3300/0 conn(0x7f70440ad2b0 0x7f70440cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f7043400640 1 --2- 172.21.15.59:0/1691372248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70441569e0 0x7f704415d620 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f70440b4c10 tx=0x7f703401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef76b164f519bdf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f7042a00640 1 -- 172.21.15.59:0/1691372248 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70340ab5f0 con 0x7f70441569e0 2024-05-30T16:56:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f7042a00640 1 -- 172.21.15.59:0/1691372248 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70340b0070 con 0x7f70441569e0 2024-05-30T16:56:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.398+0000 7f7042a00640 1 -- 172.21.15.59:0/1691372248 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70340ab9b0 con 0x7f70441569e0 2024-05-30T16:56:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 -- 172.21.15.59:0/1691372248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70441569e0 msgr2=0x7f704415d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 --2- 172.21.15.59:0/1691372248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70441569e0 0x7f704415d620 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f70440b4c10 tx=0x7f703401c400 comp rx=0 tx=0).stop 2024-05-30T16:56:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 -- 172.21.15.59:0/1691372248 shutdown_connections 2024-05-30T16:56:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 --2- 172.21.15.59:0/1691372248 >> v2:172.21.15.107:3300/0 conn(0x7f70440ad2b0 0x7f70440cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 --2- 172.21.15.59:0/1691372248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70441569e0 0x7f704415d620 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 -- 172.21.15.59:0/1691372248 >> 172.21.15.59:0/1691372248 conn(0x7f704406bdb0 msgr2=0x7f704406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 -- 172.21.15.59:0/1691372248 shutdown_connections 2024-05-30T16:56:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 -- 172.21.15.59:0/1691372248 wait complete. 2024-05-30T16:56:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 Processor -- start 2024-05-30T16:56:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 -- start start 2024-05-30T16:56:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70440ad2b0 0x7f70440af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70440d0660 0x7f704409afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70441569e0 0x7f704409beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70440d00b0 con 0x7f70440ad2b0 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f70440cff30 con 0x7f70440d0660 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f704a600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f70441691b0 con 0x7f70441569e0 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f7043400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70440ad2b0 0x7f70440af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f7043400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70440ad2b0 0x7f70440af450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32912/0 (socket says 172.21.15.59:32912) 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f7043400640 1 -- 172.21.15.59:0/4059961723 learned_addr learned my addr 172.21.15.59:0/4059961723 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f703aa00640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70440d0660 0x7f704409afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f7043e00640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70441569e0 0x7f704409beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f7043400640 1 -- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70441569e0 msgr2=0x7f704409beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f7043400640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70441569e0 0x7f704409beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f7043400640 1 -- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70440d0660 msgr2=0x7f704409afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f7043400640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70440d0660 0x7f704409afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f7043400640 1 -- 172.21.15.59:0/4059961723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70440afb50 con 0x7f70440ad2b0 2024-05-30T16:56:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.402+0000 7f7043400640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70440ad2b0 0x7f70440af450 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f70340ad040 tx=0x7f703401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.406+0000 7f703be00640 1 -- 172.21.15.59:0/4059961723 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70340be3f0 con 0x7f70440ad2b0 2024-05-30T16:56:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.406+0000 7f703be00640 1 -- 172.21.15.59:0/4059961723 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70340be5b0 con 0x7f70440ad2b0 2024-05-30T16:56:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.406+0000 7f703be00640 1 -- 172.21.15.59:0/4059961723 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70340be9a0 con 0x7f70440ad2b0 2024-05-30T16:56:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.406+0000 7f704a600640 1 -- 172.21.15.59:0/4059961723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70440afe30 con 0x7f70440ad2b0 2024-05-30T16:56:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.406+0000 7f704a600640 1 -- 172.21.15.59:0/4059961723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70440b03f0 con 0x7f70440ad2b0 2024-05-30T16:56:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.406+0000 7f704a600640 1 -- 172.21.15.59:0/4059961723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7044068a90 con 0x7f70440ad2b0 2024-05-30T16:56:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.406+0000 7f703be00640 1 -- 172.21.15.59:0/4059961723 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f70340c7440 con 0x7f70440ad2b0 2024-05-30T16:56:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.406+0000 7f703be00640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7020069070 0x7f702006b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.406+0000 7f703be00640 1 -- 172.21.15.59:0/4059961723 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5027+0+0 (secure 0 0 0) 0x7f703411f930 con 0x7f70440ad2b0 2024-05-30T16:56:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.406+0000 7f703aa00640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7020069070 0x7f702006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:38.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.410+0000 7f703aa00640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7020069070 0x7f702006b530 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f704414ddc0 tx=0x7f702c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.410+0000 7f703be00640 1 -- 172.21.15.59:0/4059961723 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7034016110 con 0x7f70440ad2b0 2024-05-30T16:56:38.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.574+0000 7f704a600640 1 -- 172.21.15.59:0/4059961723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f70440b33d0 con 0x7f70440ad2b0 2024-05-30T16:56:38.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.578+0000 7f703be00640 1 -- 172.21.15.59:0/4059961723 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f70340f1a60 con 0x7f70440ad2b0 2024-05-30T16:56:38.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.582+0000 7f704a600640 1 -- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7020069070 msgr2=0x7f702006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:38.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.582+0000 7f704a600640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7020069070 0x7f702006b530 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f704414ddc0 tx=0x7f702c008040 comp rx=0 tx=0).stop 2024-05-30T16:56:38.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.582+0000 7f704a600640 1 -- 172.21.15.59:0/4059961723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70440ad2b0 msgr2=0x7f70440af450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:38.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.582+0000 7f704a600640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70440ad2b0 0x7f70440af450 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f70340ad040 tx=0x7f703401ac40 comp rx=0 tx=0).stop 2024-05-30T16:56:38.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.582+0000 7f704a600640 1 -- 172.21.15.59:0/4059961723 shutdown_connections 2024-05-30T16:56:38.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.582+0000 7f704a600640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7020069070 0x7f702006b530 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.582+0000 7f704a600640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70441569e0 0x7f704409beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.582+0000 7f704a600640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70440d0660 0x7f704409afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.582+0000 7f704a600640 1 --2- 172.21.15.59:0/4059961723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70440ad2b0 0x7f70440af450 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:38.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.582+0000 7f704a600640 1 -- 172.21.15.59:0/4059961723 >> 172.21.15.59:0/4059961723 conn(0x7f704406bdb0 msgr2=0x7f704414feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:38.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.582+0000 7f704a600640 1 -- 172.21.15.59:0/4059961723 shutdown_connections 2024-05-30T16:56:38.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:38.582+0000 7f704a600640 1 -- 172.21.15.59:0/4059961723 wait complete. 2024-05-30T16:56:38.605 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:56:38.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:56:38.655 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:56:38.762 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:56:38.763 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:56:38.763 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:56:38.772 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:56:38.772 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:56:38.772 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:56:38.782 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:56:38.782 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:56:38.782 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:56:38.825 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:56:38.825 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:56:38.825 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:56:38.834 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:56:38.834 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T16:56:38.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:56:39.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.006+0000 7fa55ba00640 1 Processor -- start 2024-05-30T16:56:39.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.006+0000 7fa55ba00640 1 -- start start 2024-05-30T16:56:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.006+0000 7fa55ba00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa554162f20 0x7fa5540ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.006+0000 7fa55ba00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5541591a0 con 0x7fa554162a70 2024-05-30T16:56:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.006+0000 7fa55ba00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5540b44a0 con 0x7fa554158dc0 2024-05-30T16:56:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.006+0000 7fa55ba00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa5540b4780 con 0x7fa554162f20 2024-05-30T16:56:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.006+0000 7fa54be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa554162a70 0x7fa55406e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60076/0 (socket says 172.21.15.59:60076) 2024-05-30T16:56:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.006+0000 7fa54be00640 1 -- 172.21.15.59:0/757675853 learned_addr learned my addr 172.21.15.59:0/757675853 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.006+0000 7fa559a00640 1 --2- 172.21.15.59:0/757675853 >> v2:172.21.15.59:3300/0 conn(0x7fa554162f20 0x7fa5540ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa553e00640 1 -- 172.21.15.59:0/757675853 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284776258 0 0) 0x7fa5541591a0 con 0x7fa554162a70 2024-05-30T16:56:39.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa553e00640 1 -- 172.21.15.59:0/757675853 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa538003530 con 0x7fa554162a70 2024-05-30T16:56:39.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa559a00640 1 -- 172.21.15.59:0/757675853 >> v1:172.21.15.107:6789/0 conn(0x7fa554158dc0 legacy=0x7fa554162360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:39.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa559a00640 1 -- 172.21.15.59:0/757675853 >> v1:172.21.15.59:6789/0 conn(0x7fa554162a70 legacy=0x7fa55406e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:39.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa559a00640 1 -- 172.21.15.59:0/757675853 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5540b4a60 con 0x7fa554162f20 2024-05-30T16:56:39.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa559a00640 1 --2- 172.21.15.59:0/757675853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa554162f20 0x7fa5540ccec0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009d90 tx=0x7fa54c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17e0788cc4d1273 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:39.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa553e00640 1 -- 172.21.15.59:0/757675853 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0b2070 con 0x7fa554162f20 2024-05-30T16:56:39.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa553e00640 1 -- 172.21.15.59:0/757675853 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54c0a5950 con 0x7fa554162f20 2024-05-30T16:56:39.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa553e00640 1 -- 172.21.15.59:0/757675853 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0a5d20 con 0x7fa554162f20 2024-05-30T16:56:39.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa55ba00640 1 -- 172.21.15.59:0/757675853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa554162f20 msgr2=0x7fa5540ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:39.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa55ba00640 1 --2- 172.21.15.59:0/757675853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa554162f20 0x7fa5540ccec0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009d90 tx=0x7fa54c01c870 comp rx=0 tx=0).stop 2024-05-30T16:56:39.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa55ba00640 1 -- 172.21.15.59:0/757675853 shutdown_connections 2024-05-30T16:56:39.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa55ba00640 1 --2- 172.21.15.59:0/757675853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa554162f20 0x7fa5540ccec0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:39.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.010+0000 7fa55ba00640 1 -- 172.21.15.59:0/757675853 >> 172.21.15.59:0/757675853 conn(0x7fa5540d0ad0 msgr2=0x7fa5540d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:39.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa55ba00640 1 -- 172.21.15.59:0/757675853 shutdown_connections 2024-05-30T16:56:39.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa55ba00640 1 -- 172.21.15.59:0/757675853 wait complete. 2024-05-30T16:56:39.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa55ba00640 1 Processor -- start 2024-05-30T16:56:39.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa55ba00640 1 -- start start 2024-05-30T16:56:39.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa55ba00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa554158dc0 0x7fa554153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:39.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa55ba00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa554162a70 0x7fa554157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:39.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa55ba00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa554162f20 0x7fa5541493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:39.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa55ba00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa55406f230 con 0x7fa554162a70 2024-05-30T16:56:39.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa55ba00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa55406c980 con 0x7fa554158dc0 2024-05-30T16:56:39.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa55ba00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa55406f3b0 con 0x7fa554162f20 2024-05-30T16:56:39.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa54be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa554162a70 0x7fa554157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:39.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa54be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa554162a70 0x7fa554157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32932/0 (socket says 172.21.15.59:32932) 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa54be00640 1 -- 172.21.15.59:0/2630696970 learned_addr learned my addr 172.21.15.59:0/2630696970 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa559a00640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa554162f20 0x7fa5541493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa559000640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa554158dc0 0x7fa554153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa54be00640 1 -- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa554162f20 msgr2=0x7fa5541493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa54be00640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa554162f20 0x7fa5541493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa54be00640 1 -- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa554158dc0 msgr2=0x7fa554153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa54be00640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa554158dc0 0x7fa554153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa54be00640 1 -- 172.21.15.59:0/2630696970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa554154250 con 0x7fa554162a70 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa54be00640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa554162a70 0x7fa554157670 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c450 tx=0x7fa53c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa551600640 1 -- 172.21.15.59:0/2630696970 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c017070 con 0x7fa554162a70 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa551600640 1 -- 172.21.15.59:0/2630696970 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53c005cf0 con 0x7fa554162a70 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa55ba00640 1 -- 172.21.15.59:0/2630696970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5541544f0 con 0x7fa554162a70 2024-05-30T16:56:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa551600640 1 -- 172.21.15.59:0/2630696970 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0072f0 con 0x7fa554162a70 2024-05-30T16:56:39.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.014+0000 7fa55ba00640 1 -- 172.21.15.59:0/2630696970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa554154d90 con 0x7fa554162a70 2024-05-30T16:56:39.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.018+0000 7fa55ba00640 1 -- 172.21.15.59:0/2630696970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa554068a90 con 0x7fa554162a70 2024-05-30T16:56:39.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.018+0000 7fa551600640 1 -- 172.21.15.59:0/2630696970 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7fa53c01a070 con 0x7fa554162a70 2024-05-30T16:56:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.018+0000 7fa551600640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa530069070 0x7fa53006b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.018+0000 7fa551600640 1 -- 172.21.15.59:0/2630696970 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5027+0+0 (secure 0 0 0) 0x7fa53c084930 con 0x7fa554162a70 2024-05-30T16:56:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.018+0000 7fa559000640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa530069070 0x7fa53006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.018+0000 7fa559000640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa530069070 0x7fa53006b530 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa5541518f0 tx=0x7fa544008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:39.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.022+0000 7fa551600640 1 -- 172.21.15.59:0/2630696970 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa53c056880 con 0x7fa554162a70 2024-05-30T16:56:39.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.222+0000 7fa55ba00640 1 -- 172.21.15.59:0/2630696970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa554067cd0 con 0x7fa554162a70 2024-05-30T16:56:39.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa551600640 1 -- 172.21.15.59:0/2630696970 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+3872 (secure 0 0 0) 0x7fa53c056180 con 0x7fa554162a70 2024-05-30T16:56:39.270 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:39.270 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1920809274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1920809274},{"type":"v1","addr":"172.21.15.107:6837","nonce":1920809274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5719,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/4161936082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":4161936082},{"type":"v1","addr":"172.21.15.107:6835","nonce":4161936082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4040110781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4040110781},{"type":"v1","addr":"172.21.15.59:6833","nonce":4040110781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6432,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/764106903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":764106903},{"type":"v1","addr":"172.21.15.59:6835","nonce":764106903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[]} 2024-05-30T16:56:39.271 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 37 2024-05-30T16:56:39.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa55ba00640 1 -- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa530069070 msgr2=0x7fa53006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:39.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa55ba00640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa530069070 0x7fa53006b530 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa5541518f0 tx=0x7fa544008040 comp rx=0 tx=0).stop 2024-05-30T16:56:39.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa55ba00640 1 -- 172.21.15.59:0/2630696970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa554162a70 msgr2=0x7fa554157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:39.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa55ba00640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa554162a70 0x7fa554157670 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c450 tx=0x7fa53c00c910 comp rx=0 tx=0).stop 2024-05-30T16:56:39.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa55ba00640 1 -- 172.21.15.59:0/2630696970 shutdown_connections 2024-05-30T16:56:39.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa55ba00640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa530069070 0x7fa53006b530 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:39.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa55ba00640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa554162f20 0x7fa5541493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:39.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa55ba00640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa554162a70 0x7fa554157670 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:39.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa55ba00640 1 --2- 172.21.15.59:0/2630696970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa554158dc0 0x7fa554153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:39.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa55ba00640 1 -- 172.21.15.59:0/2630696970 >> 172.21.15.59:0/2630696970 conn(0x7fa5540d0ad0 msgr2=0x7fa5540b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:39.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa55ba00640 1 -- 172.21.15.59:0/2630696970 shutdown_connections 2024-05-30T16:56:39.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.226+0000 7fa55ba00640 1 -- 172.21.15.59:0/2630696970 wait complete. 2024-05-30T16:56:39.273 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T16:56:39.273 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T16:56:39.273 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T16:56:39.273 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:56:39.273 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T16:56:39.273 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T16:56:39.274 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T16:56:39.274 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:56:39.274 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T16:56:39.274 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T16:56:39.274 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T16:56:39.274 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:56:39.275 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T16:56:39.275 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T16:56:39.275 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T16:56:39.275 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:56:39.286 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T16:56:39.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T16:56:39.287 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T16:56:39.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T16:56:39.290 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T16:56:39.290 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T16:56:39.291 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T16:56:39.291 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T16:56:39.334 INFO:tasks.ceph.mds.a:Started 2024-05-30T16:56:39.334 DEBUG:teuthology.parallel:result is None 2024-05-30T16:56:39.336 INFO:tasks.ceph.mds.c:Started 2024-05-30T16:56:39.336 DEBUG:teuthology.parallel:result is None 2024-05-30T16:56:39.340 INFO:tasks.ceph.mds.d:Started 2024-05-30T16:56:39.341 DEBUG:teuthology.parallel:result is None 2024-05-30T16:56:39.343 INFO:tasks.ceph.mds.b:Started 2024-05-30T16:56:39.343 DEBUG:teuthology.parallel:result is None 2024-05-30T16:56:39.343 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T16:56:39.422 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-05-30T16:56:39.423 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T16:56:39.433 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-30T16:56:39.433 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-30T16:56:39.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a65600640 1 Processor -- start 2024-05-30T16:56:39.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a65600640 1 -- start start 2024-05-30T16:56:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a65600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3a6015b8f0 0x7f3a600b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a65600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a600b2d40 con 0x7f3a600afb70 2024-05-30T16:56:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a65600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a600b2780 con 0x7f3a600cbd30 2024-05-30T16:56:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a65600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3a600b2a60 con 0x7f3a6015b8f0 2024-05-30T16:56:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a5ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3a6015b8f0 0x7f3a600b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a5ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3a6015b8f0 0x7f3a600b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:48500/0 (socket says 172.21.15.59:48500) 2024-05-30T16:56:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a56000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3a600cbd30 0x7f3a600cfc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:40954/0 (socket says 172.21.15.59:40954) 2024-05-30T16:56:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a5ea00640 1 -- 172.21.15.59:0/1401890719 learned_addr learned my addr 172.21.15.59:0/1401890719 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:39.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a5ea00640 1 -- 172.21.15.59:0/1401890719 >> v1:172.21.15.107:6789/0 conn(0x7f3a600cbd30 legacy=0x7f3a600cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:39.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a5ea00640 1 -- 172.21.15.59:0/1401890719 >> v1:172.21.15.59:6789/0 conn(0x7f3a600afb70 legacy=0x7f3a600b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:39.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.486+0000 7f3a5ea00640 1 -- 172.21.15.59:0/1401890719 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a600af370 con 0x7f3a6015b8f0 2024-05-30T16:56:39.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.490+0000 7f3a5ea00640 1 --2- 172.21.15.59:0/1401890719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a6015b8f0 0x7f3a600b20f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009e50 tx=0x7f3a5001ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=437a17e17b84977f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:39.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.490+0000 7f3a5e000640 1 -- 172.21.15.59:0/1401890719 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a500a57f0 con 0x7f3a6015b8f0 2024-05-30T16:56:39.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.490+0000 7f3a5e000640 1 -- 172.21.15.59:0/1401890719 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a500a5990 con 0x7f3a6015b8f0 2024-05-30T16:56:39.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.490+0000 7f3a5e000640 1 -- 172.21.15.59:0/1401890719 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a500a5d60 con 0x7f3a6015b8f0 2024-05-30T16:56:39.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.490+0000 7f3a65600640 1 -- 172.21.15.59:0/1401890719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a6015b8f0 msgr2=0x7f3a600b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:39.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.490+0000 7f3a65600640 1 --2- 172.21.15.59:0/1401890719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a6015b8f0 0x7f3a600b20f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009e50 tx=0x7f3a5001ca00 comp rx=0 tx=0).stop 2024-05-30T16:56:39.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.490+0000 7f3a65600640 1 -- 172.21.15.59:0/1401890719 shutdown_connections 2024-05-30T16:56:39.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.490+0000 7f3a65600640 1 --2- 172.21.15.59:0/1401890719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a6015b8f0 0x7f3a600b20f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:39.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.490+0000 7f3a65600640 1 -- 172.21.15.59:0/1401890719 >> 172.21.15.59:0/1401890719 conn(0x7f3a600b2f50 msgr2=0x7f3a600b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:39.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.490+0000 7f3a65600640 1 -- 172.21.15.59:0/1401890719 shutdown_connections 2024-05-30T16:56:39.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.490+0000 7f3a65600640 1 -- 172.21.15.59:0/1401890719 wait complete. 2024-05-30T16:56:39.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a65600640 1 Processor -- start 2024-05-30T16:56:39.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a65600640 1 -- start start 2024-05-30T16:56:39.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a65600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a600afb70 0x7f3a6014a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:39.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a65600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a600cbd30 0x7f3a6014d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:39.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a65600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a6015b8f0 0x7f3a6014d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:39.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a65600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3a600b0f20 con 0x7f3a600afb70 2024-05-30T16:56:39.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a65600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6015bee0 con 0x7f3a6015b8f0 2024-05-30T16:56:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a65600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3a600b10a0 con 0x7f3a600cbd30 2024-05-30T16:56:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a5ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a600afb70 0x7f3a6014a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a5ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a600afb70 0x7f3a6014a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32988/0 (socket says 172.21.15.59:32988) 2024-05-30T16:56:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a5ea00640 1 -- 172.21.15.59:0/3835446488 learned_addr learned my addr 172.21.15.59:0/3835446488 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a56000640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a600cbd30 0x7f3a6014d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a5f400640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a6015b8f0 0x7f3a6014d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a5ea00640 1 -- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a600cbd30 msgr2=0x7f3a6014d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a5ea00640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a600cbd30 0x7f3a6014d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a5ea00640 1 -- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a6015b8f0 msgr2=0x7f3a6014d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a5ea00640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a6015b8f0 0x7f3a6014d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:39.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a5ea00640 1 -- 172.21.15.59:0/3835446488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6014fef0 con 0x7f3a600afb70 2024-05-30T16:56:39.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a56000640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a600cbd30 0x7f3a6014d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:39.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a5ea00640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a600afb70 0x7f3a6014a970 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3a50019610 tx=0x7f3a500197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:39.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a57400640 1 -- 172.21.15.59:0/3835446488 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a500b8880 con 0x7f3a600afb70 2024-05-30T16:56:39.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a57400640 1 -- 172.21.15.59:0/3835446488 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a500be070 con 0x7f3a600afb70 2024-05-30T16:56:39.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a57400640 1 -- 172.21.15.59:0/3835446488 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a500b8c80 con 0x7f3a600afb70 2024-05-30T16:56:39.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a65600640 1 -- 172.21.15.59:0/3835446488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a601501d0 con 0x7f3a600afb70 2024-05-30T16:56:39.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.494+0000 7f3a65600640 1 -- 172.21.15.59:0/3835446488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6014f200 con 0x7f3a600afb70 2024-05-30T16:56:39.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.498+0000 7f3a65600640 1 -- 172.21.15.59:0/3835446488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a60068a90 con 0x7f3a600afb70 2024-05-30T16:56:39.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.498+0000 7f3a57400640 1 -- 172.21.15.59:0/3835446488 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f3a500c3460 con 0x7f3a600afb70 2024-05-30T16:56:39.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.498+0000 7f3a57400640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3a3c069070 0x7f3a3c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:39.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.498+0000 7f3a57400640 1 -- 172.21.15.59:0/3835446488 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5027+0+0 (secure 0 0 0) 0x7f3a501208f0 con 0x7f3a600afb70 2024-05-30T16:56:39.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.498+0000 7f3a56000640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3a3c069070 0x7f3a3c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:39.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.498+0000 7f3a56000640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3a3c069070 0x7f3a3c06b530 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3a60153040 tx=0x7f3a48007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:39.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.502+0000 7f3a57400640 1 -- 172.21.15.59:0/3835446488 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3a50016620 con 0x7f3a600afb70 2024-05-30T16:56:39.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:39.682+0000 7f3a65600640 1 -- 172.21.15.59:0/3835446488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f3a600d1af0 con 0x7f3a600afb70 2024-05-30T16:56:40.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.606+0000 7f3a57400640 1 -- 172.21.15.59:0/3835446488 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v71) ==== 97+0+0 (secure 0 0 0) 0x7f3a500f2140 con 0x7f3a600afb70 2024-05-30T16:56:40.611 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-05-30T16:56:40.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.610+0000 7f3a65600640 1 -- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3a3c069070 msgr2=0x7f3a3c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:40.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.610+0000 7f3a65600640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3a3c069070 0x7f3a3c06b530 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3a60153040 tx=0x7f3a48007e50 comp rx=0 tx=0).stop 2024-05-30T16:56:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.610+0000 7f3a65600640 1 -- 172.21.15.59:0/3835446488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a600afb70 msgr2=0x7f3a6014a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.610+0000 7f3a65600640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a600afb70 0x7f3a6014a970 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3a50019610 tx=0x7f3a500197a0 comp rx=0 tx=0).stop 2024-05-30T16:56:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.610+0000 7f3a65600640 1 -- 172.21.15.59:0/3835446488 shutdown_connections 2024-05-30T16:56:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.610+0000 7f3a65600640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3a3c069070 0x7f3a3c06b530 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.610+0000 7f3a65600640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a6015b8f0 0x7f3a6014d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.610+0000 7f3a65600640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a600cbd30 0x7f3a6014d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.610+0000 7f3a65600640 1 --2- 172.21.15.59:0/3835446488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a600afb70 0x7f3a6014a970 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.610+0000 7f3a65600640 1 -- 172.21.15.59:0/3835446488 >> 172.21.15.59:0/3835446488 conn(0x7f3a600b2f50 msgr2=0x7f3a600cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.610+0000 7f3a65600640 1 -- 172.21.15.59:0/3835446488 shutdown_connections 2024-05-30T16:56:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.610+0000 7f3a65600640 1 -- 172.21.15.59:0/3835446488 wait complete. 2024-05-30T16:56:40.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T16:56:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.778+0000 7fe8c7e00640 1 Processor -- start 2024-05-30T16:56:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.778+0000 7fe8c7e00640 1 -- start start 2024-05-30T16:56:40.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.778+0000 7fe8c7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8c809b150 0x7fe8c81670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:40.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.778+0000 7fe8c7e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c815cea0 con 0x7fe8c815c9a0 2024-05-30T16:56:40.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.778+0000 7fe8c7e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c815d180 con 0x7fe8c815a100 2024-05-30T16:56:40.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.778+0000 7fe8c7e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c80b5950 con 0x7fe8c809b150 2024-05-30T16:56:40.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.782+0000 7fe8c7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8c809b150 0x7fe8c81670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:40.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.782+0000 7fe8c7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8c809b150 0x7fe8c81670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32994/0 (socket says 172.21.15.59:32994) 2024-05-30T16:56:40.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.782+0000 7fe8c7400640 1 -- 172.21.15.59:0/2634924156 learned_addr learned my addr 172.21.15.59:0/2634924156 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.782+0000 7fe8c7400640 1 -- 172.21.15.59:0/2634924156 >> v1:172.21.15.107:6789/0 conn(0x7fe8c815a100 legacy=0x7fe8c80b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.782+0000 7fe8c7400640 1 -- 172.21.15.59:0/2634924156 >> v1:172.21.15.59:6789/0 conn(0x7fe8c815c9a0 legacy=0x7fe8c809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.782+0000 7fe8c7400640 1 -- 172.21.15.59:0/2634924156 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c815d460 con 0x7fe8c809b150 2024-05-30T16:56:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.782+0000 7fe8c6000640 1 -- 172.21.15.59:0/2634924156 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 954581129 0 0) 0x7fe8c815cea0 con 0x7fe8c815c9a0 2024-05-30T16:56:40.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.782+0000 7fe8c7400640 1 --2- 172.21.15.59:0/2634924156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8c809b150 0x7fe8c81670f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009e50 tx=0x7fe8c001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3ee1c621b843b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:40.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.782+0000 7fe8c6000640 1 -- 172.21.15.59:0/2634924156 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00a58a0 con 0x7fe8c809b150 2024-05-30T16:56:40.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.782+0000 7fe8c6000640 1 -- 172.21.15.59:0/2634924156 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c00a5a40 con 0x7fe8c809b150 2024-05-30T16:56:40.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.782+0000 7fe8c6000640 1 -- 172.21.15.59:0/2634924156 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00a5e10 con 0x7fe8c809b150 2024-05-30T16:56:40.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 -- 172.21.15.59:0/2634924156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8c809b150 msgr2=0x7fe8c81670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:40.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 --2- 172.21.15.59:0/2634924156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8c809b150 0x7fe8c81670f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009e50 tx=0x7fe8c001c9c0 comp rx=0 tx=0).stop 2024-05-30T16:56:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 -- 172.21.15.59:0/2634924156 shutdown_connections 2024-05-30T16:56:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 --2- 172.21.15.59:0/2634924156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8c809b150 0x7fe8c81670f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 -- 172.21.15.59:0/2634924156 >> 172.21.15.59:0/2634924156 conn(0x7fe8c80b3ed0 msgr2=0x7fe8c80b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 -- 172.21.15.59:0/2634924156 shutdown_connections 2024-05-30T16:56:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 -- 172.21.15.59:0/2634924156 wait complete. 2024-05-30T16:56:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 Processor -- start 2024-05-30T16:56:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 -- start start 2024-05-30T16:56:40.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8c809b150 0x7fe8c8157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:40.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8c815a100 0x7fe8c815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:40.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8c815c9a0 0x7fe8c815aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c816a1e0 con 0x7fe8c815a100 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c816a060 con 0x7fe8c815c9a0 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c816a360 con 0x7fe8c809b150 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8be000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8c815a100 0x7fe8c815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8be000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8c815a100 0x7fe8c815a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33004/0 (socket says 172.21.15.59:33004) 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8be000640 1 -- 172.21.15.59:0/3408142507 learned_addr learned my addr 172.21.15.59:0/3408142507 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c6a00640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8c809b150 0x7fe8c8157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8c7400640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8c815c9a0 0x7fe8c815aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8be000640 1 -- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8c809b150 msgr2=0x7fe8c8157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8be000640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8c809b150 0x7fe8c8157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8be000640 1 -- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8c815c9a0 msgr2=0x7fe8c815aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8be000640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8c815c9a0 0x7fe8c815aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.786+0000 7fe8be000640 1 -- 172.21.15.59:0/3408142507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c80afc50 con 0x7fe8c815a100 2024-05-30T16:56:40.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.790+0000 7fe8be000640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8c815a100 0x7fe8c815a4e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c520 tx=0x7fe8b000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:40.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.790+0000 7fe8bf400640 1 -- 172.21.15.59:0/3408142507 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0017070 con 0x7fe8c815a100 2024-05-30T16:56:40.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.790+0000 7fe8bf400640 1 -- 172.21.15.59:0/3408142507 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b0003600 con 0x7fe8c815a100 2024-05-30T16:56:40.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.790+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3408142507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c8151740 con 0x7fe8c815a100 2024-05-30T16:56:40.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.790+0000 7fe8bf400640 1 -- 172.21.15.59:0/3408142507 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00039f0 con 0x7fe8c815a100 2024-05-30T16:56:40.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.790+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3408142507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c815b700 con 0x7fe8c815a100 2024-05-30T16:56:40.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.790+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3408142507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c8068a90 con 0x7fe8c815a100 2024-05-30T16:56:40.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.790+0000 7fe8bf400640 1 -- 172.21.15.59:0/3408142507 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7fe8b001a070 con 0x7fe8c815a100 2024-05-30T16:56:40.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.790+0000 7fe8bf400640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe8a40690a0 0x7fe8a406b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:40.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.790+0000 7fe8bf400640 1 -- 172.21.15.59:0/3408142507 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4941+0+0 (secure 0 0 0) 0x7fe8b00846d0 con 0x7fe8c815a100 2024-05-30T16:56:40.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.790+0000 7fe8c6a00640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe8a40690a0 0x7fe8a406b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:40.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.794+0000 7fe8c6a00640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe8a40690a0 0x7fe8a406b560 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8007fd0 tx=0x7fe8b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:40.794+0000 7fe8bf400640 1 -- 172.21.15.59:0/3408142507 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe8b0056090 con 0x7fe8c815a100 2024-05-30T16:56:41.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3408142507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe8c8071dd0 con 0x7fe8c815a100 2024-05-30T16:56:41.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8bf400640 1 -- 172.21.15.59:0/3408142507 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fe8b005a390 con 0x7fe8c815a100 2024-05-30T16:56:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:41.021 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:56:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-05-30T16:56:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-05-30T16:56:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmAAjIJhAA5/FZHJtfSZuYcD6bEfCGDA==", 2024-05-30T16:56:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:56:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:56:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:56:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmELVkMxAA/vOsM3Z0z4YEmUqoPtrPBQ==", 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmD2pGLhAAWmDw/02mc8T7upvRXnj1yw==", 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:56:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmYLbYOhAAxggGfPZU/ryu+8vciSXjUw==", 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDJrVhmU0fpBhAA2tKWGJF24DlEjG+iuO4djg==", 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDMrVhmxE2HERAA4N9Bsb0fxl5GERpgyKCl6Q==", 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.025 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDPrVhm6v7AGhAAqOQCN90pL0AmnXYIPIb48A==", 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSrVhm3BEDJxAA4SOWC/qF90R9ivrCvN92ZA==", 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDYrVhmFzmDHhAAQtbXd6haolYB98wfEbpvTQ==", 2024-05-30T16:56:41.027 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDbrVhmHqkEKRAAKfFPdTqaVhBNnc5lKeEFpg==", 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDerVhm72bzMBAA+FfnxIOnkESuTervY23ruw==", 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDhrVhmXGv/OhAAr2k7IXDA9VDi9ZJwrQ+u6A==", 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.029 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA==", 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmncPjDBAAWEJOkxm9xfRjonO6U1hO6A==", 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmvlFFCRAAZCq7ijfrVqy8Ukh7jKZESQ==", 2024-05-30T16:56:41.031 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmcpjuEhAA0q+PfNy0IWhqQSiIZuyBlg==", 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:56:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmnikpCxAA6Q4udmvjQXBmC4f1irI2Xg==", 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.033 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmWZq9IhAAFuEZeFiLGCitIiNARjoDTA==", 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhm0UKsHhAAimqtE18XjW/1vA7uMsJmEw==", 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:56:41.034 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T16:56:41.035 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:56:41.035 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.035 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.035 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-05-30T16:56:41.035 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:56:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe8a40690a0 msgr2=0x7fe8a406b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe8a40690a0 0x7fe8a406b560 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8007fd0 tx=0x7fe8b8009040 comp rx=0 tx=0).stop 2024-05-30T16:56:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3408142507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8c815a100 msgr2=0x7fe8c815a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8c815a100 0x7fe8c815a4e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c520 tx=0x7fe8b000c9e0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3408142507 shutdown_connections 2024-05-30T16:56:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe8a40690a0 0x7fe8a406b560 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8c815c9a0 0x7fe8c815aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8c815a100 0x7fe8c815a4e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 --2- 172.21.15.59:0/3408142507 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8c809b150 0x7fe8c8157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3408142507 >> 172.21.15.59:0/3408142507 conn(0x7fe8c80b3ed0 msgr2=0x7fe8c815eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3408142507 shutdown_connections 2024-05-30T16:56:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.018+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3408142507 wait complete. 2024-05-30T16:56:41.044 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T16:56:41.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.178+0000 7fbdc3600640 1 Processor -- start 2024-05-30T16:56:41.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.182+0000 7fbdc3600640 1 -- start start 2024-05-30T16:56:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.182+0000 7fbdc3600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbdbc0ae330 0x7fbdbc0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.182+0000 7fbdc3600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdbc0b66f0 con 0x7fbdbc0d13a0 2024-05-30T16:56:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.182+0000 7fbdc3600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdbc0ae790 con 0x7fbdbc147670 2024-05-30T16:56:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.182+0000 7fbdc3600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbdbc070e30 con 0x7fbdbc0ae330 2024-05-30T16:56:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.182+0000 7fbdbbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbdbc0ae330 0x7fbdbc0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.182+0000 7fbdc1600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbdbc0d13a0 0x7fbdbc06f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60112/0 (socket says 172.21.15.59:60112) 2024-05-30T16:56:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.182+0000 7fbdc1600640 1 -- 172.21.15.59:0/2609515671 learned_addr learned my addr 172.21.15.59:0/2609515671 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.182+0000 7fbdbbe00640 1 -- 172.21.15.59:0/2609515671 >> v1:172.21.15.107:6789/0 conn(0x7fbdbc147670 legacy=0x7fbdbc0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.182+0000 7fbdbbe00640 1 -- 172.21.15.59:0/2609515671 >> v1:172.21.15.59:6789/0 conn(0x7fbdbc0d13a0 legacy=0x7fbdbc06f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.182+0000 7fbdbbe00640 1 -- 172.21.15.59:0/2609515671 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdbc0b6130 con 0x7fbdbc0ae330 2024-05-30T16:56:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.182+0000 7fbdbb400640 1 -- 172.21.15.59:0/2609515671 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1513141799 0 0) 0x7fbdbc0b66f0 con 0x7fbdbc0d13a0 2024-05-30T16:56:41.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdbbe00640 1 --2- 172.21.15.59:0/2609515671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0ae330 0x7fbdbc0708f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fbda80097c0 tx=0x7fbda801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3116fb4df33e4433 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:41.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdbb400640 1 -- 172.21.15.59:0/2609515671 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda80b0070 con 0x7fbdbc0ae330 2024-05-30T16:56:41.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdbb400640 1 -- 172.21.15.59:0/2609515671 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda8004230 con 0x7fbdbc0ae330 2024-05-30T16:56:41.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdbb400640 1 -- 172.21.15.59:0/2609515671 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8003620 con 0x7fbdbc0ae330 2024-05-30T16:56:41.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdc3600640 1 -- 172.21.15.59:0/2609515671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0ae330 msgr2=0x7fbdbc0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdc3600640 1 --2- 172.21.15.59:0/2609515671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0ae330 0x7fbdbc0708f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fbda80097c0 tx=0x7fbda801c4a0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdc3600640 1 -- 172.21.15.59:0/2609515671 shutdown_connections 2024-05-30T16:56:41.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdc3600640 1 --2- 172.21.15.59:0/2609515671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0ae330 0x7fbdbc0708f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdc3600640 1 -- 172.21.15.59:0/2609515671 >> 172.21.15.59:0/2609515671 conn(0x7fbdbc09aa40 msgr2=0x7fbdbc0b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:41.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdc3600640 1 -- 172.21.15.59:0/2609515671 shutdown_connections 2024-05-30T16:56:41.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdc3600640 1 -- 172.21.15.59:0/2609515671 wait complete. 2024-05-30T16:56:41.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdc3600640 1 Processor -- start 2024-05-30T16:56:41.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.186+0000 7fbdc3600640 1 -- start start 2024-05-30T16:56:41.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc3600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0ae330 0x7fbdbc15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:41.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc3600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdbc0d13a0 0x7fbdbc1364c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:41.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc3600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdbc147670 0x7fbdbc160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:41.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc3600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc070180 con 0x7fbdbc0ae330 2024-05-30T16:56:41.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc3600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc070000 con 0x7fbdbc147670 2024-05-30T16:56:41.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc3600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbdbc16cd10 con 0x7fbdbc0d13a0 2024-05-30T16:56:41.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0ae330 0x7fbdbc15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:41.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0ae330 0x7fbdbc15b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33034/0 (socket says 172.21.15.59:33034) 2024-05-30T16:56:41.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc0c00640 1 -- 172.21.15.59:0/347878307 learned_addr learned my addr 172.21.15.59:0/347878307 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:41.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc1600640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdbc147670 0x7fbdbc160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:41.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdbbe00640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdbc0d13a0 0x7fbdbc1364c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:41.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc0c00640 1 -- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdbc0d13a0 msgr2=0x7fbdbc1364c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc0c00640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdbc0d13a0 0x7fbdbc1364c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc0c00640 1 -- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdbc147670 msgr2=0x7fbdbc160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc0c00640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdbc147670 0x7fbdbc160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc0c00640 1 -- 172.21.15.59:0/347878307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdbc137330 con 0x7fbdbc0ae330 2024-05-30T16:56:41.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc0c00640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0ae330 0x7fbdbc15b7a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c3c0 tx=0x7fbdb000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:41.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdb8c00640 1 -- 172.21.15.59:0/347878307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0017070 con 0x7fbdbc0ae330 2024-05-30T16:56:41.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdb8c00640 1 -- 172.21.15.59:0/347878307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb00052d0 con 0x7fbdbc0ae330 2024-05-30T16:56:41.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdb8c00640 1 -- 172.21.15.59:0/347878307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0003840 con 0x7fbdbc0ae330 2024-05-30T16:56:41.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc3600640 1 -- 172.21.15.59:0/347878307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdbc137610 con 0x7fbdbc0ae330 2024-05-30T16:56:41.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc3600640 1 -- 172.21.15.59:0/347878307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdbc137bd0 con 0x7fbdbc0ae330 2024-05-30T16:56:41.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdc3600640 1 -- 172.21.15.59:0/347878307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdbc068a90 con 0x7fbdbc0ae330 2024-05-30T16:56:41.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.190+0000 7fbdb8c00640 1 -- 172.21.15.59:0/347878307 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7fbdb001a070 con 0x7fbdbc0ae330 2024-05-30T16:56:41.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.194+0000 7fbdb8c00640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbd9c069070 0x7fbd9c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:41.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.194+0000 7fbdb8c00640 1 -- 172.21.15.59:0/347878307 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4941+0+0 (secure 0 0 0) 0x7fbdb0084700 con 0x7fbdbc0ae330 2024-05-30T16:56:41.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.194+0000 7fbdbbe00640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbd9c069070 0x7fbd9c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:41.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.194+0000 7fbdbbe00640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbd9c069070 0x7fbd9c06b530 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbda80ad000 tx=0x7fbda8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:41.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.198+0000 7fbdb8c00640 1 -- 172.21.15.59:0/347878307 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbdbc0ae790 con 0x7fbdbc0ae330 2024-05-30T16:56:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.362+0000 7fbdc3600640 1 -- 172.21.15.59:0/347878307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbdbc15e850 con 0x7fbdbc0ae330 2024-05-30T16:56:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdb8c00640 1 -- 172.21.15.59:0/347878307 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7fbdb0005480 con 0x7fbdbc0ae330 2024-05-30T16:56:41.371 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:41.371 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:56:41.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:41.371 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-05-30T16:56:41.371 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-05-30T16:56:41.371 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:41.371 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:56:41.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdc3600640 1 -- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbd9c069070 msgr2=0x7fbd9c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdc3600640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbd9c069070 0x7fbd9c06b530 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbda80ad000 tx=0x7fbda8008040 comp rx=0 tx=0).stop 2024-05-30T16:56:41.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdc3600640 1 -- 172.21.15.59:0/347878307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0ae330 msgr2=0x7fbdbc15b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdc3600640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0ae330 0x7fbdbc15b7a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c3c0 tx=0x7fbdb000c880 comp rx=0 tx=0).stop 2024-05-30T16:56:41.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdc3600640 1 -- 172.21.15.59:0/347878307 shutdown_connections 2024-05-30T16:56:41.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdc3600640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbd9c069070 0x7fbd9c06b530 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdc3600640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdbc147670 0x7fbdbc160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdc3600640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdbc0d13a0 0x7fbdbc1364c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdc3600640 1 --2- 172.21.15.59:0/347878307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0ae330 0x7fbdbc15b7a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdc3600640 1 -- 172.21.15.59:0/347878307 >> 172.21.15.59:0/347878307 conn(0x7fbdbc09aa40 msgr2=0x7fbdbc13c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:41.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdc3600640 1 -- 172.21.15.59:0/347878307 shutdown_connections 2024-05-30T16:56:41.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.366+0000 7fbdc3600640 1 -- 172.21.15.59:0/347878307 wait complete. 2024-05-30T16:56:41.391 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T16:56:41.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T16:56:41.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.530+0000 7fbaafe00640 1 Processor -- start 2024-05-30T16:56:41.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.530+0000 7fbaafe00640 1 -- start start 2024-05-30T16:56:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaafe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbaa815e830 0x7fbaa80b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaafe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbaa80af570 0x7fbaa80afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaafe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa80b42f0 con 0x7fbaa80b2a50 2024-05-30T16:56:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaafe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa80b45d0 con 0x7fbaa815e830 2024-05-30T16:56:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaafe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa80aed70 con 0x7fbaa80af570 2024-05-30T16:56:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaaca00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbaa80b2a50 0x7fbaa80b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60120/0 (socket says 172.21.15.59:60120) 2024-05-30T16:56:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaaca00640 1 -- 172.21.15.59:0/1642448720 learned_addr learned my addr 172.21.15.59:0/1642448720 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaade00640 1 --2- 172.21.15.59:0/1642448720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbaa80af570 0x7fbaa80afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaad400640 1 --2- 172.21.15.59:0/1642448720 >> v2:172.21.15.107:3300/0 conn(0x7fbaa815e830 0x7fbaa80b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaa7e00640 1 -- 172.21.15.59:0/1642448720 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220921397 0 0) 0x7fbaa80b42f0 con 0x7fbaa80b2a50 2024-05-30T16:56:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaa7e00640 1 -- 172.21.15.59:0/1642448720 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba90003530 con 0x7fbaa80b2a50 2024-05-30T16:56:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaade00640 1 -- 172.21.15.59:0/1642448720 >> v2:172.21.15.107:3300/0 conn(0x7fbaa815e830 msgr2=0x7fbaa80b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaade00640 1 --2- 172.21.15.59:0/1642448720 >> v2:172.21.15.107:3300/0 conn(0x7fbaa815e830 0x7fbaa80b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaade00640 1 -- 172.21.15.59:0/1642448720 >> v1:172.21.15.59:6789/0 conn(0x7fbaa80b2a50 legacy=0x7fbaa80b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.534+0000 7fbaade00640 1 -- 172.21.15.59:0/1642448720 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa80af050 con 0x7fbaa80af570 2024-05-30T16:56:41.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.538+0000 7fbaade00640 1 --2- 172.21.15.59:0/1642448720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbaa80af570 0x7fbaa80afa00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009d90 tx=0x7fbaa001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4948853fcb27549f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:41.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.538+0000 7fbaa7e00640 1 -- 172.21.15.59:0/1642448720 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00b2070 con 0x7fbaa80af570 2024-05-30T16:56:41.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.538+0000 7fbaa7e00640 1 -- 172.21.15.59:0/1642448720 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa00a58b0 con 0x7fbaa80af570 2024-05-30T16:56:41.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.538+0000 7fbaa7e00640 1 -- 172.21.15.59:0/1642448720 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00a5c80 con 0x7fbaa80af570 2024-05-30T16:56:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.538+0000 7fbaafe00640 1 -- 172.21.15.59:0/1642448720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbaa80af570 msgr2=0x7fbaa80afa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.538+0000 7fbaafe00640 1 --2- 172.21.15.59:0/1642448720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbaa80af570 0x7fbaa80afa00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009d90 tx=0x7fbaa001c8e0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.538+0000 7fbaafe00640 1 -- 172.21.15.59:0/1642448720 shutdown_connections 2024-05-30T16:56:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.538+0000 7fbaafe00640 1 --2- 172.21.15.59:0/1642448720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbaa80af570 0x7fbaa80afa00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.538+0000 7fbaafe00640 1 --2- 172.21.15.59:0/1642448720 >> v2:172.21.15.107:3300/0 conn(0x7fbaa815e830 0x7fbaa80b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.538+0000 7fbaafe00640 1 -- 172.21.15.59:0/1642448720 >> 172.21.15.59:0/1642448720 conn(0x7fbaa80b6770 msgr2=0x7fbaa80b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.538+0000 7fbaafe00640 1 -- 172.21.15.59:0/1642448720 shutdown_connections 2024-05-30T16:56:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.538+0000 7fbaafe00640 1 -- 172.21.15.59:0/1642448720 wait complete. 2024-05-30T16:56:41.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaafe00640 1 Processor -- start 2024-05-30T16:56:41.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaafe00640 1 -- start start 2024-05-30T16:56:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaafe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbaa80af570 0x7fbaa8150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaafe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbaa80b2a50 0x7fbaa814e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaafe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa815e830 0x7fbaa8070140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaafe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa80b6490 con 0x7fbaa815e830 2024-05-30T16:56:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaafe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa80b6310 con 0x7fbaa80af570 2024-05-30T16:56:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaafe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa816b420 con 0x7fbaa80b2a50 2024-05-30T16:56:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaade00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa815e830 0x7fbaa8070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaade00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa815e830 0x7fbaa8070140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33050/0 (socket says 172.21.15.59:33050) 2024-05-30T16:56:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaade00640 1 -- 172.21.15.59:0/2046039472 learned_addr learned my addr 172.21.15.59:0/2046039472 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaad400640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbaa80af570 0x7fbaa8150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaaca00640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbaa80b2a50 0x7fbaa814e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaade00640 1 -- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbaa80b2a50 msgr2=0x7fbaa814e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaade00640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbaa80b2a50 0x7fbaa814e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaade00640 1 -- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbaa80af570 msgr2=0x7fbaa8150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaade00640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbaa80af570 0x7fbaa8150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaade00640 1 -- 172.21.15.59:0/2046039472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa81501b0 con 0x7fbaa815e830 2024-05-30T16:56:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaade00640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa815e830 0x7fbaa8070140 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbaa001af90 tx=0x7fbaa0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaa5600640 1 -- 172.21.15.59:0/2046039472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00b2050 con 0x7fbaa815e830 2024-05-30T16:56:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaa5600640 1 -- 172.21.15.59:0/2046039472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa00be070 con 0x7fbaa815e830 2024-05-30T16:56:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaa5600640 1 -- 172.21.15.59:0/2046039472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00ad850 con 0x7fbaa815e830 2024-05-30T16:56:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaafe00640 1 -- 172.21.15.59:0/2046039472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa8150490 con 0x7fbaa815e830 2024-05-30T16:56:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaafe00640 1 -- 172.21.15.59:0/2046039472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa8150a50 con 0x7fbaa815e830 2024-05-30T16:56:41.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.542+0000 7fbaafe00640 1 -- 172.21.15.59:0/2046039472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa8068a90 con 0x7fbaa815e830 2024-05-30T16:56:41.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.546+0000 7fbaa5600640 1 -- 172.21.15.59:0/2046039472 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7fbaa00ad9f0 con 0x7fbaa815e830 2024-05-30T16:56:41.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.546+0000 7fbaa5600640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fba88069070 0x7fba8806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:41.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.546+0000 7fbaa5600640 1 -- 172.21.15.59:0/2046039472 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4941+0+0 (secure 0 0 0) 0x7fbaa0120200 con 0x7fbaa815e830 2024-05-30T16:56:41.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.546+0000 7fbaad400640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fba88069070 0x7fba8806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:41.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.546+0000 7fbaad400640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fba88069070 0x7fba8806b530 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009b60 tx=0x7fba9c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:41.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.550+0000 7fbaa5600640 1 -- 172.21.15.59:0/2046039472 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbaa0016560 con 0x7fbaa815e830 2024-05-30T16:56:41.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:41.714+0000 7fbaafe00640 1 -- 172.21.15.59:0/2046039472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbaa806ddf0 con 0x7fbaa815e830 2024-05-30T16:56:42.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.610+0000 7fbaa5600640 1 -- 172.21.15.59:0/2046039472 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7fbaa00f1bc0 con 0x7fbaa815e830 2024-05-30T16:56:42.615 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-05-30T16:56:42.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.614+0000 7fbaafe00640 1 -- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fba88069070 msgr2=0x7fba8806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:42.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.614+0000 7fbaafe00640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fba88069070 0x7fba8806b530 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009b60 tx=0x7fba9c009190 comp rx=0 tx=0).stop 2024-05-30T16:56:42.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.614+0000 7fbaafe00640 1 -- 172.21.15.59:0/2046039472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa815e830 msgr2=0x7fbaa8070140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:42.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.614+0000 7fbaafe00640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa815e830 0x7fbaa8070140 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbaa001af90 tx=0x7fbaa0019680 comp rx=0 tx=0).stop 2024-05-30T16:56:42.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.614+0000 7fbaafe00640 1 -- 172.21.15.59:0/2046039472 shutdown_connections 2024-05-30T16:56:42.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.614+0000 7fbaafe00640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fba88069070 0x7fba8806b530 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:42.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.614+0000 7fbaafe00640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa815e830 0x7fbaa8070140 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:42.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.614+0000 7fbaafe00640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbaa80b2a50 0x7fbaa814e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:42.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.614+0000 7fbaafe00640 1 --2- 172.21.15.59:0/2046039472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbaa80af570 0x7fbaa8150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:42.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.614+0000 7fbaafe00640 1 -- 172.21.15.59:0/2046039472 >> 172.21.15.59:0/2046039472 conn(0x7fbaa80b6770 msgr2=0x7fbaa806ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:42.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.614+0000 7fbaafe00640 1 -- 172.21.15.59:0/2046039472 shutdown_connections 2024-05-30T16:56:42.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.614+0000 7fbaafe00640 1 -- 172.21.15.59:0/2046039472 wait complete. 2024-05-30T16:56:42.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T16:56:42.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.794+0000 7f8985000640 1 Processor -- start 2024-05-30T16:56:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.794+0000 7f8985000640 1 -- start start 2024-05-30T16:56:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f8985000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898015c7f0 0x7f89800ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:42.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f8985000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f89800b19f0 0x7f89800b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:42.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f8985000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89800d1cf0 con 0x7f89800b0e50 2024-05-30T16:56:42.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f8985000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f89800b7450 con 0x7f89800b19f0 2024-05-30T16:56:42.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f8985000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f89800d1fd0 con 0x7f898015c7f0 2024-05-30T16:56:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f897f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898015c7f0 0x7f89800ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f8976a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f89800b19f0 0x7f89800b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f897f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898015c7f0 0x7f89800ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:43630/0 (socket says 172.21.15.59:43630) 2024-05-30T16:56:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f897f400640 1 -- 172.21.15.59:0/4154520673 learned_addr learned my addr 172.21.15.59:0/4154520673 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f897f400640 1 -- 172.21.15.59:0/4154520673 >> v2:172.21.15.107:3300/0 conn(0x7f89800b19f0 msgr2=0x7f89800b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f897f400640 1 --2- 172.21.15.59:0/4154520673 >> v2:172.21.15.107:3300/0 conn(0x7f89800b19f0 0x7f89800b6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f897f400640 1 -- 172.21.15.59:0/4154520673 >> v1:172.21.15.107:6789/0 conn(0x7f89800b0e50 legacy=0x7f89800d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f897ea00640 1 -- 172.21.15.59:0/4154520673 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280578439 0 0) 0x7f89800d1cf0 con 0x7f89800b0e50 2024-05-30T16:56:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f897f400640 1 -- 172.21.15.59:0/4154520673 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89800cf870 con 0x7f898015c7f0 2024-05-30T16:56:42.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.798+0000 7f8976a00640 1 --2- 172.21.15.59:0/4154520673 >> v2:172.21.15.107:3300/0 conn(0x7f89800b19f0 0x7f89800b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f897f400640 1 --2- 172.21.15.59:0/4154520673 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898015c7f0 0x7f89800ae2c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8970009870 tx=0x7f897001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d14b01f3e1bc98f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f897ea00640 1 -- 172.21.15.59:0/4154520673 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700b5070 con 0x7f898015c7f0 2024-05-30T16:56:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f897ea00640 1 -- 172.21.15.59:0/4154520673 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89700a8a50 con 0x7f898015c7f0 2024-05-30T16:56:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f897ea00640 1 -- 172.21.15.59:0/4154520673 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700a8e20 con 0x7f898015c7f0 2024-05-30T16:56:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f8985000640 1 -- 172.21.15.59:0/4154520673 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898015c7f0 msgr2=0x7f89800ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f8985000640 1 --2- 172.21.15.59:0/4154520673 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898015c7f0 0x7f89800ae2c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8970009870 tx=0x7f897001ed50 comp rx=0 tx=0).stop 2024-05-30T16:56:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f8985000640 1 -- 172.21.15.59:0/4154520673 shutdown_connections 2024-05-30T16:56:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f8985000640 1 --2- 172.21.15.59:0/4154520673 >> v2:172.21.15.107:3300/0 conn(0x7f89800b19f0 0x7f89800b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f8985000640 1 --2- 172.21.15.59:0/4154520673 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898015c7f0 0x7f89800ae2c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f8985000640 1 -- 172.21.15.59:0/4154520673 >> 172.21.15.59:0/4154520673 conn(0x7f898009aa40 msgr2=0x7f89800b6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f8985000640 1 -- 172.21.15.59:0/4154520673 shutdown_connections 2024-05-30T16:56:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f8985000640 1 -- 172.21.15.59:0/4154520673 wait complete. 2024-05-30T16:56:42.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f8985000640 1 Processor -- start 2024-05-30T16:56:42.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.802+0000 7f8985000640 1 -- start start 2024-05-30T16:56:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8985000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89800b0e50 0x7f898014db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8985000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89800b19f0 0x7f898015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8985000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898015c7f0 0x7f89801f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8985000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89800cf580 con 0x7f89800b19f0 2024-05-30T16:56:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8985000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f89800cf400 con 0x7f89800b0e50 2024-05-30T16:56:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8985000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f89800b12e0 con 0x7f898015c7f0 2024-05-30T16:56:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8976a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89800b19f0 0x7f898015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f897f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89800b0e50 0x7f898014db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8976a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89800b19f0 0x7f898015b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59074/0 (socket says 172.21.15.59:59074) 2024-05-30T16:56:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f897fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898015c7f0 0x7f89801f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8976a00640 1 -- 172.21.15.59:0/760233803 learned_addr learned my addr 172.21.15.59:0/760233803 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f897f400640 1 -- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898015c7f0 msgr2=0x7f89801f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f897f400640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898015c7f0 0x7f89801f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f897f400640 1 -- 172.21.15.59:0/760233803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89800b19f0 msgr2=0x7f898015b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f897f400640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89800b19f0 0x7f898015b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f897f400640 1 -- 172.21.15.59:0/760233803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898015cc70 con 0x7f89800b0e50 2024-05-30T16:56:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8976a00640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89800b19f0 0x7f898015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f897f400640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89800b0e50 0x7f898014db90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f89700af000 tx=0x7f897001baf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8977e00640 1 -- 172.21.15.59:0/760233803 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700c0070 con 0x7f89800b0e50 2024-05-30T16:56:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8977e00640 1 -- 172.21.15.59:0/760233803 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89700b08c0 con 0x7f89800b0e50 2024-05-30T16:56:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8977e00640 1 -- 172.21.15.59:0/760233803 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700b5040 con 0x7f89800b0e50 2024-05-30T16:56:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8985000640 1 -- 172.21.15.59:0/760233803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898015cf50 con 0x7f89800b0e50 2024-05-30T16:56:42.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8985000640 1 -- 172.21.15.59:0/760233803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f898015d510 con 0x7f89800b0e50 2024-05-30T16:56:42.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.806+0000 7f8985000640 1 -- 172.21.15.59:0/760233803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8980068a90 con 0x7f89800b0e50 2024-05-30T16:56:42.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.810+0000 7f8977e00640 1 -- 172.21.15.59:0/760233803 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f89700c3070 con 0x7f89800b0e50 2024-05-30T16:56:42.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.810+0000 7f8977e00640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f895c0690a0 0x7f895c06b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:42.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.810+0000 7f8977e00640 1 -- 172.21.15.59:0/760233803 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5311+0+0 (secure 0 0 0) 0x7f8970122550 con 0x7f89800b0e50 2024-05-30T16:56:42.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.810+0000 7f8976a00640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f895c0690a0 0x7f895c06b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:42.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.810+0000 7f8976a00640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f895c0690a0 0x7f895c06b560 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8980067be0 tx=0x7f8968009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.814+0000 7f8977e00640 1 -- 172.21.15.59:0/760233803 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f89700188b0 con 0x7f89800b0e50 2024-05-30T16:56:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:42.978+0000 7f8985000640 1 -- 172.21.15.59:0/760233803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f898015d8f0 con 0x7f89800b0e50 2024-05-30T16:56:43.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.626+0000 7f8977e00640 1 -- 172.21.15.59:0/760233803 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f89700f3f10 con 0x7f89800b0e50 2024-05-30T16:56:43.633 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-05-30T16:56:43.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.630+0000 7f8985000640 1 -- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f895c0690a0 msgr2=0x7f895c06b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:43.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.630+0000 7f8985000640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f895c0690a0 0x7f895c06b560 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8980067be0 tx=0x7f8968009190 comp rx=0 tx=0).stop 2024-05-30T16:56:43.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.630+0000 7f8985000640 1 -- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89800b0e50 msgr2=0x7f898014db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:43.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.630+0000 7f8985000640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89800b0e50 0x7f898014db90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f89700af000 tx=0x7f897001baf0 comp rx=0 tx=0).stop 2024-05-30T16:56:43.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.638+0000 7f8985000640 1 -- 172.21.15.59:0/760233803 shutdown_connections 2024-05-30T16:56:43.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.638+0000 7f8985000640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f895c0690a0 0x7f895c06b560 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:43.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.638+0000 7f8985000640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898015c7f0 0x7f89801f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:43.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.638+0000 7f8985000640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89800b19f0 0x7f898015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:43.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.638+0000 7f8985000640 1 --2- 172.21.15.59:0/760233803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89800b0e50 0x7f898014db90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:43.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.638+0000 7f8985000640 1 -- 172.21.15.59:0/760233803 >> 172.21.15.59:0/760233803 conn(0x7f898009aa40 msgr2=0x7f898006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:43.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.638+0000 7f8985000640 1 -- 172.21.15.59:0/760233803 shutdown_connections 2024-05-30T16:56:43.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.638+0000 7f8985000640 1 -- 172.21.15.59:0/760233803 wait complete. 2024-05-30T16:56:43.672 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T16:56:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.814+0000 7f1d7fe00640 1 Processor -- start 2024-05-30T16:56:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.814+0000 7f1d7fe00640 1 -- start start 2024-05-30T16:56:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.814+0000 7f1d7fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d800b19c0 0x7f1d80160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.814+0000 7f1d7fe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d800d20c0 con 0x7f1d8015a270 2024-05-30T16:56:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.814+0000 7f1d7fe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d8009ae20 con 0x7f1d80160680 2024-05-30T16:56:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.814+0000 7f1d7fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1d80160f90 con 0x7f1d800b19c0 2024-05-30T16:56:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.814+0000 7f1d7ea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1d8015a270 0x7f1d800d19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58916/0 (socket says 172.21.15.59:58916) 2024-05-30T16:56:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.814+0000 7f1d7ea00640 1 -- 172.21.15.59:0/2617745047 learned_addr learned my addr 172.21.15.59:0/2617745047 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.818+0000 7f1d76000640 1 --2- 172.21.15.59:0/2617745047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d800b19c0 0x7f1d80160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.818+0000 7f1d7e000640 1 -- 172.21.15.59:0/2617745047 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2096280234 0 0) 0x7f1d800d20c0 con 0x7f1d8015a270 2024-05-30T16:56:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.818+0000 7f1d7e000640 1 -- 172.21.15.59:0/2617745047 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d64003530 con 0x7f1d8015a270 2024-05-30T16:56:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.818+0000 7f1d7e000640 1 -- 172.21.15.59:0/2617745047 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239505880 0 0) 0x7f1d8009ae20 con 0x7f1d80160680 2024-05-30T16:56:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.818+0000 7f1d7e000640 1 -- 172.21.15.59:0/2617745047 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d800d20c0 con 0x7f1d80160680 2024-05-30T16:56:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.818+0000 7f1d7e000640 1 -- 172.21.15.59:0/2617745047 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 812929357 0 0) 0x7f1d64003530 con 0x7f1d8015a270 2024-05-30T16:56:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.818+0000 7f1d76000640 1 -- 172.21.15.59:0/2617745047 >> v1:172.21.15.107:6789/0 conn(0x7f1d80160680 legacy=0x7f1d800cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.818+0000 7f1d76000640 1 -- 172.21.15.59:0/2617745047 >> v1:172.21.15.59:6789/0 conn(0x7f1d8015a270 legacy=0x7f1d800d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.818+0000 7f1d76000640 1 -- 172.21.15.59:0/2617745047 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8009b100 con 0x7f1d800b19c0 2024-05-30T16:56:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.818+0000 7f1d76000640 1 --2- 172.21.15.59:0/2617745047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d800b19c0 0x7f1d80160140 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009820 tx=0x7f1d6801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebc2adebc5498c8a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7e000640 1 -- 172.21.15.59:0/2617745047 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d680b2070 con 0x7f1d800b19c0 2024-05-30T16:56:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7e000640 1 -- 172.21.15.59:0/2617745047 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d680ad440 con 0x7f1d800b19c0 2024-05-30T16:56:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7e000640 1 -- 172.21.15.59:0/2617745047 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d70001680 con 0x7f1d800b19c0 2024-05-30T16:56:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2617745047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d800b19c0 msgr2=0x7f1d80160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 --2- 172.21.15.59:0/2617745047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d800b19c0 0x7f1d80160140 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009820 tx=0x7f1d6801c3b0 comp rx=0 tx=0).stop 2024-05-30T16:56:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2617745047 shutdown_connections 2024-05-30T16:56:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 --2- 172.21.15.59:0/2617745047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d800b19c0 0x7f1d80160140 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:43.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2617745047 >> 172.21.15.59:0/2617745047 conn(0x7f1d800b3ed0 msgr2=0x7f1d800b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:43.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2617745047 shutdown_connections 2024-05-30T16:56:43.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2617745047 wait complete. 2024-05-30T16:56:43.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 Processor -- start 2024-05-30T16:56:43.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 -- start start 2024-05-30T16:56:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d800b19c0 0x7f1d8006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d8015a270 0x7f1d801553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d80160680 0x7f1d801558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8009aa40 con 0x7f1d800b19c0 2024-05-30T16:56:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1d80160a90 con 0x7f1d8015a270 2024-05-30T16:56:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1d8009abc0 con 0x7f1d80160680 2024-05-30T16:56:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d800b19c0 0x7f1d8006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d800b19c0 0x7f1d8006dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59080/0 (socket says 172.21.15.59:59080) 2024-05-30T16:56:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d7ea00640 1 -- 172.21.15.59:0/2425057648 learned_addr learned my addr 172.21.15.59:0/2425057648 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.822+0000 7f1d76000640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d8015a270 0x7f1d801553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d7f400640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d80160680 0x7f1d801558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d7ea00640 1 -- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d80160680 msgr2=0x7f1d801558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d7ea00640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d80160680 0x7f1d801558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d7ea00640 1 -- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d8015a270 msgr2=0x7f1d801553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d7ea00640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d8015a270 0x7f1d801553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d7ea00640 1 -- 172.21.15.59:0/2425057648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d80158b80 con 0x7f1d800b19c0 2024-05-30T16:56:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d76000640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d8015a270 0x7f1d801553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d7ea00640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d800b19c0 0x7f1d8006dea0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000c750 tx=0x7f1d7000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d77e00640 1 -- 172.21.15.59:0/2425057648 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d70005af0 con 0x7f1d800b19c0 2024-05-30T16:56:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d77e00640 1 -- 172.21.15.59:0/2425057648 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d70005c90 con 0x7f1d800b19c0 2024-05-30T16:56:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d77e00640 1 -- 172.21.15.59:0/2425057648 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d700072b0 con 0x7f1d800b19c0 2024-05-30T16:56:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2425057648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d80158e60 con 0x7f1d800b19c0 2024-05-30T16:56:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2425057648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d80159420 con 0x7f1d800b19c0 2024-05-30T16:56:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2425057648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d80068a90 con 0x7f1d800b19c0 2024-05-30T16:56:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.826+0000 7f1d77e00640 1 -- 172.21.15.59:0/2425057648 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f1d70007450 con 0x7f1d800b19c0 2024-05-30T16:56:43.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.830+0000 7f1d77e00640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1d5c069070 0x7f1d5c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.830+0000 7f1d77e00640 1 -- 172.21.15.59:0/2425057648 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5693+0+0 (secure 0 0 0) 0x7f1d70085160 con 0x7f1d800b19c0 2024-05-30T16:56:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.830+0000 7f1d76000640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1d5c069070 0x7f1d5c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.830+0000 7f1d76000640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1d5c069070 0x7f1d5c06b530 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1d680af000 tx=0x7f1d680a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:43.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:43.834+0000 7f1d77e00640 1 -- 172.21.15.59:0/2425057648 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1d7008d020 con 0x7f1d800b19c0 2024-05-30T16:56:44.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.030+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2425057648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1d8009bc00 con 0x7f1d800b19c0 2024-05-30T16:56:44.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d77e00640 1 -- 172.21.15.59:0/2425057648 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v39) ==== 174+0+0 (secure 0 0 0) 0x7f1d70056be0 con 0x7f1d800b19c0 2024-05-30T16:56:44.626 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 10 and data pool 11 2024-05-30T16:56:44.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1d5c069070 msgr2=0x7f1d5c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d7fe00640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1d5c069070 0x7f1d5c06b530 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1d680af000 tx=0x7f1d680a7070 comp rx=0 tx=0).stop 2024-05-30T16:56:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2425057648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d800b19c0 msgr2=0x7f1d8006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d7fe00640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d800b19c0 0x7f1d8006dea0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000c750 tx=0x7f1d7000cc10 comp rx=0 tx=0).stop 2024-05-30T16:56:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2425057648 shutdown_connections 2024-05-30T16:56:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d7fe00640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1d5c069070 0x7f1d5c06b530 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d7fe00640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d80160680 0x7f1d801558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d7fe00640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d8015a270 0x7f1d801553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:44.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d7fe00640 1 --2- 172.21.15.59:0/2425057648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d800b19c0 0x7f1d8006dea0 secure :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000c750 tx=0x7f1d7000cc10 comp rx=0 tx=0).stop 2024-05-30T16:56:44.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2425057648 >> 172.21.15.59:0/2425057648 conn(0x7f1d800b3ed0 msgr2=0x7f1d800cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:44.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2425057648 shutdown_connections 2024-05-30T16:56:44.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.626+0000 7f1d7fe00640 1 -- 172.21.15.59:0/2425057648 wait complete. 2024-05-30T16:56:44.676 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:56:44.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.814+0000 7f812c400640 1 Processor -- start 2024-05-30T16:56:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.814+0000 7f812c400640 1 -- start start 2024-05-30T16:56:44.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.814+0000 7f812c400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8124159df0 0x7f81240ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:44.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.814+0000 7f812c400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81240b3e50 0x7f81240ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:44.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.814+0000 7f812c400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812415d730 con 0x7f812415a1d0 2024-05-30T16:56:44.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.814+0000 7f812c400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f81240b3370 con 0x7f8124159df0 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.814+0000 7f812c400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f81240b3650 con 0x7f81240b3e50 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8129000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f812415a1d0 0x7f812415ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58932/0 (socket says 172.21.15.59:58932) 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8129000640 1 -- 172.21.15.59:0/679585744 learned_addr learned my addr 172.21.15.59:0/679585744 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f812a400640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81240b3e50 0x7f81240ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8129a00640 1 --2- 172.21.15.59:0/679585744 >> v2:172.21.15.107:3300/0 conn(0x7f8124159df0 0x7f81240ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3976705267 0 0) 0x7f812415d730 con 0x7f812415a1d0 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f810c003530 con 0x7f812415a1d0 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 597657394 0 0) 0x7f810c003530 con 0x7f812415a1d0 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81240b3e50 msgr2=0x7f81240ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81240b3e50 0x7f81240ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 >> v2:172.21.15.107:3300/0 conn(0x7f8124159df0 msgr2=0x7f81240ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 --2- 172.21.15.59:0/679585744 >> v2:172.21.15.107:3300/0 conn(0x7f8124159df0 0x7f81240ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81240b3930 con 0x7f812415a1d0 2024-05-30T16:56:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f8110001680 con 0x7f812415a1d0 2024-05-30T16:56:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 >> v1:172.21.15.59:6789/0 conn(0x7f812415a1d0 legacy=0x7f812415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81240b3e50 0x7f810c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f810c003f40 0x7f810c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810c004d50 0x7f810c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f81240b3370 con 0x7f810c004d50 2024-05-30T16:56:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f81240b3650 con 0x7f810c003f40 2024-05-30T16:56:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f810c00b9d0 con 0x7f81240b3e50 2024-05-30T16:56:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f812a400640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810c004d50 0x7f810c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8129a00640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81240b3e50 0x7f810c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8129000640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f810c003f40 0x7f810c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f812a400640 1 -- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81240b3e50 msgr2=0x7f810c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f812a400640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81240b3e50 0x7f810c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f812a400640 1 -- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f810c003f40 msgr2=0x7f810c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f812a400640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f810c003f40 0x7f810c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f812a400640 1 -- 172.21.15.59:0/679585744 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c003530 con 0x7f810c004d50 2024-05-30T16:56:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8129a00640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81240b3e50 0x7f810c0039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.818+0000 7f8129000640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f810c003f40 0x7f810c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f812a400640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810c004d50 0x7f810c0051d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f811c009fc0 tx=0x7f811c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751b91b2f588771c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c0b2070 con 0x7f810c004d50 2024-05-30T16:56:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f811c0a5c90 con 0x7f810c004d50 2024-05-30T16:56:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f8123e00640 1 -- 172.21.15.59:0/679585744 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c009c10 con 0x7f810c004d50 2024-05-30T16:56:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f812c400640 1 -- 172.21.15.59:0/679585744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810c004d50 msgr2=0x7f810c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f812c400640 1 --2- 172.21.15.59:0/679585744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810c004d50 0x7f810c0051d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f811c009fc0 tx=0x7f811c01cc20 comp rx=0 tx=0).stop 2024-05-30T16:56:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f812a400640 1 -- 172.21.15.59:0/679585744 reap_dead start 2024-05-30T16:56:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f812c400640 1 -- 172.21.15.59:0/679585744 shutdown_connections 2024-05-30T16:56:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f812c400640 1 -- 172.21.15.59:0/679585744 >> 172.21.15.59:0/679585744 conn(0x7f81240b22d0 msgr2=0x7f81240b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f812c400640 1 -- 172.21.15.59:0/679585744 shutdown_connections 2024-05-30T16:56:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f812c400640 1 -- 172.21.15.59:0/679585744 wait complete. 2024-05-30T16:56:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f812c400640 1 Processor -- start 2024-05-30T16:56:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.822+0000 7f812c400640 1 -- start start 2024-05-30T16:56:44.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f812c400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f810c004d50 0x7f81241465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f812c400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81241519b0 0x7f8124156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f812c400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81241499a0 0x7f81241569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f812c400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f812415d510 con 0x7f81241519b0 2024-05-30T16:56:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f812c400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f812415d390 con 0x7f81241499a0 2024-05-30T16:56:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f812c400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f81240ad6f0 con 0x7f810c004d50 2024-05-30T16:56:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8129000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81241519b0 0x7f8124156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8129000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81241519b0 0x7f8124156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59084/0 (socket says 172.21.15.59:59084) 2024-05-30T16:56:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8129000640 1 -- 172.21.15.59:0/496932399 learned_addr learned my addr 172.21.15.59:0/496932399 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8129a00640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f810c004d50 0x7f81241465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f812a400640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81241499a0 0x7f81241569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8129000640 1 -- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f810c004d50 msgr2=0x7f81241465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8129000640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f810c004d50 0x7f81241465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8129000640 1 -- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81241499a0 msgr2=0x7f81241569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8129000640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81241499a0 0x7f81241569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8129000640 1 -- 172.21.15.59:0/496932399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8124146e60 con 0x7f81241519b0 2024-05-30T16:56:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8129000640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81241519b0 0x7f8124156470 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f81100072f0 tx=0x7f81100076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8121600640 1 -- 172.21.15.59:0/496932399 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811001a070 con 0x7f81241519b0 2024-05-30T16:56:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8121600640 1 -- 172.21.15.59:0/496932399 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f811000fa20 con 0x7f81241519b0 2024-05-30T16:56:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8121600640 1 -- 172.21.15.59:0/496932399 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811000fdd0 con 0x7f81241519b0 2024-05-30T16:56:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f812c400640 1 -- 172.21.15.59:0/496932399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8124147140 con 0x7f81241519b0 2024-05-30T16:56:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f812c400640 1 -- 172.21.15.59:0/496932399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8124147700 con 0x7f81241519b0 2024-05-30T16:56:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f812c400640 1 -- 172.21.15.59:0/496932399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8124068a90 con 0x7f81241519b0 2024-05-30T16:56:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.826+0000 7f8121600640 1 -- 172.21.15.59:0/496932399 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f811001d360 con 0x7f81241519b0 2024-05-30T16:56:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.830+0000 7f8121600640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8104069070 0x7f810406b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.830+0000 7f8121600640 1 -- 172.21.15.59:0/496932399 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5793+0+0 (secure 0 0 0) 0x7f8110085130 con 0x7f81241519b0 2024-05-30T16:56:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.830+0000 7f8129a00640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8104069070 0x7f810406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.830+0000 7f8129a00640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8104069070 0x7f810406b530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8118009e00 tx=0x7f8118009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:44.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.834+0000 7f8121600640 1 -- 172.21.15.59:0/496932399 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8110056860 con 0x7f81241519b0 2024-05-30T16:56:45.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.998+0000 7f812c400640 1 -- 172.21.15.59:0/496932399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81240b4ef0 con 0x7f81241519b0 2024-05-30T16:56:45.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:44.998+0000 7f8121600640 1 -- 172.21.15.59:0/496932399 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16800 (secure 0 0 0) 0x7f811005d080 con 0x7f81241519b0 2024-05-30T16:56:45.003 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:45.004 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":74,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:56:44.038002+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:56:41.730533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T16:56:42.994525+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:56:45.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.002+0000 7f812c400640 1 -- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8104069070 msgr2=0x7f810406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:45.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.002+0000 7f812c400640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8104069070 0x7f810406b530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8118009e00 tx=0x7f8118009190 comp rx=0 tx=0).stop 2024-05-30T16:56:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.002+0000 7f812c400640 1 -- 172.21.15.59:0/496932399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81241519b0 msgr2=0x7f8124156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.002+0000 7f812c400640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81241519b0 0x7f8124156470 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f81100072f0 tx=0x7f81100076f0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.002+0000 7f812c400640 1 -- 172.21.15.59:0/496932399 shutdown_connections 2024-05-30T16:56:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.002+0000 7f812c400640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8104069070 0x7f810406b530 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.002+0000 7f812c400640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81241499a0 0x7f81241569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.002+0000 7f812c400640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81241519b0 0x7f8124156470 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.002+0000 7f812c400640 1 --2- 172.21.15.59:0/496932399 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f810c004d50 0x7f81241465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.002+0000 7f812c400640 1 -- 172.21.15.59:0/496932399 >> 172.21.15.59:0/496932399 conn(0x7f81240b22d0 msgr2=0x7f81240af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.002+0000 7f812c400640 1 -- 172.21.15.59:0/496932399 shutdown_connections 2024-05-30T16:56:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.002+0000 7f812c400640 1 -- 172.21.15.59:0/496932399 wait complete. 2024-05-30T16:56:45.025 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:56:45.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6b0e200640 1 Processor -- start 2024-05-30T16:56:45.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6b0e200640 1 -- start start 2024-05-30T16:56:45.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6b0e200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6b080ce2e0 0x7f6b080708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6b0e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b080ce6c0 0x7f6b08070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6b0e200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b0806df90 0x7f6b080d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6b0e200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6b0809b7c0 con 0x7f6b0806df90 2024-05-30T16:56:45.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6b0e200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6b0809baa0 con 0x7f6b080ce2e0 2024-05-30T16:56:45.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6b0e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0809bd80 con 0x7f6b080ce6c0 2024-05-30T16:56:45.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6b07e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b0806df90 0x7f6b080d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6b07e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b0806df90 0x7f6b080d0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59096/0 (socket says 172.21.15.59:59096) 2024-05-30T16:56:45.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6b07e00640 1 -- 172.21.15.59:0/469231895 learned_addr learned my addr 172.21.15.59:0/469231895 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:45.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6b07400640 1 --2- 172.21.15.59:0/469231895 >> v2:172.21.15.107:3300/0 conn(0x7f6b080ce2e0 0x7f6b080708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.162+0000 7f6afea00640 1 --2- 172.21.15.59:0/469231895 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b080ce6c0 0x7f6b08070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.166+0000 7f6b07e00640 1 -- 172.21.15.59:0/469231895 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b080ce6c0 msgr2=0x7f6b08070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:45.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.166+0000 7f6b07e00640 1 --2- 172.21.15.59:0/469231895 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b080ce6c0 0x7f6b08070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.166+0000 7f6b07e00640 1 -- 172.21.15.59:0/469231895 >> v2:172.21.15.107:3300/0 conn(0x7f6b080ce2e0 msgr2=0x7f6b080708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:45.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.166+0000 7f6b07e00640 1 --2- 172.21.15.59:0/469231895 >> v2:172.21.15.107:3300/0 conn(0x7f6b080ce2e0 0x7f6b080708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.166+0000 7f6b07e00640 1 -- 172.21.15.59:0/469231895 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b080d0980 con 0x7f6b0806df90 2024-05-30T16:56:45.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.166+0000 7f6b07400640 1 --2- 172.21.15.59:0/469231895 >> v2:172.21.15.107:3300/0 conn(0x7f6b080ce2e0 0x7f6b080708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:45.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.166+0000 7f6b07e00640 1 --2- 172.21.15.59:0/469231895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0806df90 0x7f6b080d0ea0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6b08073360 tx=0x7f6b0001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bea19df7d1fa55 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:45.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.166+0000 7f6b06a00640 1 -- 172.21.15.59:0/469231895 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b000a5740 con 0x7f6b0806df90 2024-05-30T16:56:45.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.166+0000 7f6b06a00640 1 -- 172.21.15.59:0/469231895 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b000a58e0 con 0x7f6b0806df90 2024-05-30T16:56:45.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.166+0000 7f6b06a00640 1 -- 172.21.15.59:0/469231895 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b000a5cb0 con 0x7f6b0806df90 2024-05-30T16:56:45.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.166+0000 7f6b0e200640 1 -- 172.21.15.59:0/469231895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0806df90 msgr2=0x7f6b080d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:45.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.166+0000 7f6b0e200640 1 --2- 172.21.15.59:0/469231895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0806df90 0x7f6b080d0ea0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6b08073360 tx=0x7f6b0001c8a0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 -- 172.21.15.59:0/469231895 shutdown_connections 2024-05-30T16:56:45.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 --2- 172.21.15.59:0/469231895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0806df90 0x7f6b080d0ea0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 --2- 172.21.15.59:0/469231895 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b080ce6c0 0x7f6b08070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 --2- 172.21.15.59:0/469231895 >> v2:172.21.15.107:3300/0 conn(0x7f6b080ce2e0 0x7f6b080708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 -- 172.21.15.59:0/469231895 >> 172.21.15.59:0/469231895 conn(0x7f6b080b3f70 msgr2=0x7f6b080b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:45.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 -- 172.21.15.59:0/469231895 shutdown_connections 2024-05-30T16:56:45.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 -- 172.21.15.59:0/469231895 wait complete. 2024-05-30T16:56:45.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 Processor -- start 2024-05-30T16:56:45.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 -- start start 2024-05-30T16:56:45.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0806df90 0x7f6b080b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b080ce2e0 0x7f6b080b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b080ce6c0 0x7f6b08157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6b080d1f80 con 0x7f6b080ce2e0 2024-05-30T16:56:45.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6b080d1e00 con 0x7f6b080ce6c0 2024-05-30T16:56:45.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6b080d2100 con 0x7f6b0806df90 2024-05-30T16:56:45.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6afea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b080ce2e0 0x7f6b080b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6afea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b080ce2e0 0x7f6b080b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59106/0 (socket says 172.21.15.59:59106) 2024-05-30T16:56:45.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6afea00640 1 -- 172.21.15.59:0/3065821513 learned_addr learned my addr 172.21.15.59:0/3065821513 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:45.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b07400640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0806df90 0x7f6b080b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b07e00640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b080ce6c0 0x7f6b08157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6afea00640 1 -- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0806df90 msgr2=0x7f6b080b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:45.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6afea00640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0806df90 0x7f6b080b7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6afea00640 1 -- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b080ce6c0 msgr2=0x7f6b08157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:45.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6afea00640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b080ce6c0 0x7f6b08157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6afea00640 1 -- 172.21.15.59:0/3065821513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b080b7640 con 0x7f6b080ce2e0 2024-05-30T16:56:45.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6afea00640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b080ce2e0 0x7f6b080b1090 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6af000e900 tx=0x7f6af000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6affe00640 1 -- 172.21.15.59:0/3065821513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0017070 con 0x7f6b080ce2e0 2024-05-30T16:56:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6affe00640 1 -- 172.21.15.59:0/3065821513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af000ca00 con 0x7f6b080ce2e0 2024-05-30T16:56:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6affe00640 1 -- 172.21.15.59:0/3065821513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af000cdf0 con 0x7f6b080ce2e0 2024-05-30T16:56:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.170+0000 7f6b0e200640 1 -- 172.21.15.59:0/3065821513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b080b7920 con 0x7f6b080ce2e0 2024-05-30T16:56:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.174+0000 7f6b0e200640 1 -- 172.21.15.59:0/3065821513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b080b7ee0 con 0x7f6b080ce2e0 2024-05-30T16:56:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.174+0000 7f6b0e200640 1 -- 172.21.15.59:0/3065821513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b08068a90 con 0x7f6b080ce2e0 2024-05-30T16:56:45.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.174+0000 7f6affe00640 1 -- 172.21.15.59:0/3065821513 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f6af001a070 con 0x7f6b080ce2e0 2024-05-30T16:56:45.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.174+0000 7f6affe00640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6ae4069070 0x7f6ae406b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.174+0000 7f6affe00640 1 -- 172.21.15.59:0/3065821513 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5793+0+0 (secure 0 0 0) 0x7f6af0085870 con 0x7f6b080ce2e0 2024-05-30T16:56:45.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.174+0000 7f6b07400640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6ae4069070 0x7f6ae406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.178+0000 7f6b07400640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6ae4069070 0x7f6ae406b530 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6af800b990 tx=0x7f6af8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:45.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.178+0000 7f6affe00640 1 -- 172.21.15.59:0/3065821513 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6af00577c0 con 0x7f6b080ce2e0 2024-05-30T16:56:45.239 INFO:tasks.ceph.mds.b.smithi107.stderr:2024-05-30T16:56:45.240+0000 7f04f0e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:56:45.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.346+0000 7f6b0e200640 1 -- 172.21.15.59:0/3065821513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b080704c0 con 0x7f6b080ce2e0 2024-05-30T16:56:45.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.346+0000 7f6affe00640 1 -- 172.21.15.59:0/3065821513 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16800 (secure 0 0 0) 0x7f6af00570c0 con 0x7f6b080ce2e0 2024-05-30T16:56:45.352 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:45.352 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":74,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:56:44.038002+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:56:41.730533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T16:56:42.994525+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:56:45.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.350+0000 7f6b0e200640 1 -- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6ae4069070 msgr2=0x7f6ae406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:45.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.350+0000 7f6b0e200640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6ae4069070 0x7f6ae406b530 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6af800b990 tx=0x7f6af8008040 comp rx=0 tx=0).stop 2024-05-30T16:56:45.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.350+0000 7f6b0e200640 1 -- 172.21.15.59:0/3065821513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b080ce2e0 msgr2=0x7f6b080b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:45.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.350+0000 7f6b0e200640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b080ce2e0 0x7f6b080b1090 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6af000e900 tx=0x7f6af000edc0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.350+0000 7f6b0e200640 1 -- 172.21.15.59:0/3065821513 shutdown_connections 2024-05-30T16:56:45.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.350+0000 7f6b0e200640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6ae4069070 0x7f6ae406b530 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.350+0000 7f6b0e200640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b080ce6c0 0x7f6b08157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.350+0000 7f6b0e200640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b080ce2e0 0x7f6b080b1090 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.350+0000 7f6b0e200640 1 --2- 172.21.15.59:0/3065821513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0806df90 0x7f6b080b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.350+0000 7f6b0e200640 1 -- 172.21.15.59:0/3065821513 >> 172.21.15.59:0/3065821513 conn(0x7f6b080b3f70 msgr2=0x7f6b080b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:45.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.350+0000 7f6b0e200640 1 -- 172.21.15.59:0/3065821513 shutdown_connections 2024-05-30T16:56:45.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.350+0000 7f6b0e200640 1 -- 172.21.15.59:0/3065821513 wait complete. 2024-05-30T16:56:45.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T16:56:45.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.514+0000 7ff2f5200640 1 Processor -- start 2024-05-30T16:56:45.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.514+0000 7ff2f5200640 1 -- start start 2024-05-30T16:56:45.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.514+0000 7ff2f5200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2f01569e0 0x7ff2f015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.514+0000 7ff2f5200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff2f00d0660 0x7ff2f00d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.514+0000 7ff2f5200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f00ad770 con 0x7ff2f00ad2b0 2024-05-30T16:56:45.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.514+0000 7ff2f5200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f00d1010 con 0x7ff2f01569e0 2024-05-30T16:56:45.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.514+0000 7ff2f5200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f015cb40 con 0x7ff2f00d0660 2024-05-30T16:56:45.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.514+0000 7ff2ede00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2f01569e0 0x7ff2f015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.514+0000 7ff2ede00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2f01569e0 0x7ff2f015d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59120/0 (socket says 172.21.15.59:59120) 2024-05-30T16:56:45.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.514+0000 7ff2ede00640 1 -- 172.21.15.59:0/1091605082 learned_addr learned my addr 172.21.15.59:0/1091605082 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:45.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.514+0000 7ff2e7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff2f00ad2b0 0x7ff2f00cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58944/0 (socket says 172.21.15.59:58944) 2024-05-30T16:56:45.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.518+0000 7ff2ee800640 1 --2- 172.21.15.59:0/1091605082 >> v2:172.21.15.107:3300/0 conn(0x7ff2f00d0660 0x7ff2f00d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.518+0000 7ff2ede00640 1 -- 172.21.15.59:0/1091605082 >> v2:172.21.15.107:3300/0 conn(0x7ff2f00d0660 msgr2=0x7ff2f00d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:45.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.518+0000 7ff2ede00640 1 --2- 172.21.15.59:0/1091605082 >> v2:172.21.15.107:3300/0 conn(0x7ff2f00d0660 0x7ff2f00d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.518+0000 7ff2ede00640 1 -- 172.21.15.59:0/1091605082 >> v1:172.21.15.59:6789/0 conn(0x7ff2f00ad2b0 legacy=0x7ff2f00cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:45.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.518+0000 7ff2ede00640 1 -- 172.21.15.59:0/1091605082 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f015ce20 con 0x7ff2f01569e0 2024-05-30T16:56:45.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.518+0000 7ff2ede00640 1 --2- 172.21.15.59:0/1091605082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2f01569e0 0x7ff2f015d620 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00ae820 tx=0x7ff2e001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48915e38dd3d76dd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:45.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.518+0000 7ff2ed400640 1 -- 172.21.15.59:0/1091605082 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00b1070 con 0x7ff2f01569e0 2024-05-30T16:56:45.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.518+0000 7ff2ed400640 1 -- 172.21.15.59:0/1091605082 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e00ac640 con 0x7ff2f01569e0 2024-05-30T16:56:45.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.518+0000 7ff2ed400640 1 -- 172.21.15.59:0/1091605082 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00aca10 con 0x7ff2f01569e0 2024-05-30T16:56:45.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.518+0000 7ff2f5200640 1 -- 172.21.15.59:0/1091605082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2f01569e0 msgr2=0x7ff2f015d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:45.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.518+0000 7ff2f5200640 1 --2- 172.21.15.59:0/1091605082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2f01569e0 0x7ff2f015d620 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00ae820 tx=0x7ff2e001c490 comp rx=0 tx=0).stop 2024-05-30T16:56:45.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 -- 172.21.15.59:0/1091605082 shutdown_connections 2024-05-30T16:56:45.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 --2- 172.21.15.59:0/1091605082 >> v2:172.21.15.107:3300/0 conn(0x7ff2f00d0660 0x7ff2f00d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 --2- 172.21.15.59:0/1091605082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2f01569e0 0x7ff2f015d620 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 -- 172.21.15.59:0/1091605082 >> 172.21.15.59:0/1091605082 conn(0x7ff2f006bdb0 msgr2=0x7ff2f006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:45.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 -- 172.21.15.59:0/1091605082 shutdown_connections 2024-05-30T16:56:45.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 -- 172.21.15.59:0/1091605082 wait complete. 2024-05-30T16:56:45.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 Processor -- start 2024-05-30T16:56:45.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 -- start start 2024-05-30T16:56:45.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2f00ad2b0 0x7ff2f009a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2f00d0660 0x7ff2f0153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2f01569e0 0x7ff2f00994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00b3c60 con 0x7ff2f01569e0 2024-05-30T16:56:45.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00b3ae0 con 0x7ff2f00d0660 2024-05-30T16:56:45.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2f5200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f00b3de0 con 0x7ff2f00ad2b0 2024-05-30T16:56:45.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2ee800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2f01569e0 0x7ff2f00994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2ee800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2f01569e0 0x7ff2f00994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59122/0 (socket says 172.21.15.59:59122) 2024-05-30T16:56:45.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2ee800640 1 -- 172.21.15.59:0/869963693 learned_addr learned my addr 172.21.15.59:0/869963693 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:45.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2ede00640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2f00ad2b0 0x7ff2f009a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2e7e00640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2f00d0660 0x7ff2f0153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2ee800640 1 -- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2f00ad2b0 msgr2=0x7ff2f009a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:45.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2ee800640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2f00ad2b0 0x7ff2f009a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2ee800640 1 -- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2f00d0660 msgr2=0x7ff2f0153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:45.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2ee800640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2f00d0660 0x7ff2f0153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:45.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2ee800640 1 -- 172.21.15.59:0/869963693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f014da50 con 0x7ff2f01569e0 2024-05-30T16:56:45.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.522+0000 7ff2ee800640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2f01569e0 0x7ff2f00994f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8007e40 tx=0x7ff2e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:45.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.526+0000 7ff2e6000640 1 -- 172.21.15.59:0/869963693 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8014620 con 0x7ff2f01569e0 2024-05-30T16:56:45.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.526+0000 7ff2e6000640 1 -- 172.21.15.59:0/869963693 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e8019070 con 0x7ff2f01569e0 2024-05-30T16:56:45.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.526+0000 7ff2e6000640 1 -- 172.21.15.59:0/869963693 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8014a20 con 0x7ff2f01569e0 2024-05-30T16:56:45.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.526+0000 7ff2f5200640 1 -- 172.21.15.59:0/869963693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f015c060 con 0x7ff2f01569e0 2024-05-30T16:56:45.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.526+0000 7ff2f5200640 1 -- 172.21.15.59:0/869963693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f00b1280 con 0x7ff2f01569e0 2024-05-30T16:56:45.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.526+0000 7ff2f5200640 1 -- 172.21.15.59:0/869963693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f0068a90 con 0x7ff2f01569e0 2024-05-30T16:56:45.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.526+0000 7ff2e6000640 1 -- 172.21.15.59:0/869963693 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7ff2e8014bc0 con 0x7ff2f01569e0 2024-05-30T16:56:45.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.526+0000 7ff2e6000640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff2cc0690c0 0x7ff2cc06b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:45.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.526+0000 7ff2e6000640 1 -- 172.21.15.59:0/869963693 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5793+0+0 (secure 0 0 0) 0x7ff2e8085be0 con 0x7ff2f01569e0 2024-05-30T16:56:45.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.526+0000 7ff2ede00640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff2cc0690c0 0x7ff2cc06b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.530+0000 7ff2ede00640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff2cc0690c0 0x7ff2cc06b580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00ae000 tx=0x7ff2e00a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.530+0000 7ff2e6000640 1 -- 172.21.15.59:0/869963693 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff2e80575a0 con 0x7ff2f01569e0 2024-05-30T16:56:45.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:45.742+0000 7ff2f5200640 1 -- 172.21.15.59:0/869963693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff2f015c230 con 0x7ff2f01569e0 2024-05-30T16:56:46.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.646+0000 7ff2e6000640 1 -- 172.21.15.59:0/869963693 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) ==== 118+0+0 (secure 0 0 0) 0x7ff2e805b8a0 con 0x7ff2f01569e0 2024-05-30T16:56:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.646+0000 7ff2f5200640 1 -- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff2cc0690c0 msgr2=0x7ff2cc06b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.646+0000 7ff2f5200640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff2cc0690c0 0x7ff2cc06b580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00ae000 tx=0x7ff2e00a6070 comp rx=0 tx=0).stop 2024-05-30T16:56:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.646+0000 7ff2f5200640 1 -- 172.21.15.59:0/869963693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2f01569e0 msgr2=0x7ff2f00994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.646+0000 7ff2f5200640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2f01569e0 0x7ff2f00994f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8007e40 tx=0x7ff2e800e4b0 comp rx=0 tx=0).stop 2024-05-30T16:56:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.646+0000 7ff2f5200640 1 -- 172.21.15.59:0/869963693 shutdown_connections 2024-05-30T16:56:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.646+0000 7ff2f5200640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff2cc0690c0 0x7ff2cc06b580 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.646+0000 7ff2f5200640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2f01569e0 0x7ff2f00994f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.646+0000 7ff2f5200640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2f00d0660 0x7ff2f0153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.646+0000 7ff2f5200640 1 --2- 172.21.15.59:0/869963693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2f00ad2b0 0x7ff2f009a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.646+0000 7ff2f5200640 1 -- 172.21.15.59:0/869963693 >> 172.21.15.59:0/869963693 conn(0x7ff2f006bdb0 msgr2=0x7ff2f0151440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.650+0000 7ff2f5200640 1 -- 172.21.15.59:0/869963693 shutdown_connections 2024-05-30T16:56:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.650+0000 7ff2f5200640 1 -- 172.21.15.59:0/869963693 wait complete. 2024-05-30T16:56:46.676 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T16:56:46.677 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T16:56:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.822+0000 7fe652c00640 1 Processor -- start 2024-05-30T16:56:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.822+0000 7fe652c00640 1 -- start start 2024-05-30T16:56:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.822+0000 7fe652c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe64c1569e0 0x7fe64c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.822+0000 7fe652c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe64c0ad2b0 0x7fe64c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.822+0000 7fe652c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe64c0ad770 con 0x7fe64c0d0660 2024-05-30T16:56:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.822+0000 7fe652c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe64c15cb40 con 0x7fe64c0ad2b0 2024-05-30T16:56:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.822+0000 7fe652c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe64c15ce20 con 0x7fe64c1569e0 2024-05-30T16:56:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.826+0000 7fe650c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe64c0d0660 0x7fe64c0b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58958/0 (socket says 172.21.15.59:58958) 2024-05-30T16:56:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.826+0000 7fe650c00640 1 -- 172.21.15.59:0/418816377 learned_addr learned my addr 172.21.15.59:0/418816377 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.826+0000 7fe643e00640 1 --2- 172.21.15.59:0/418816377 >> v2:172.21.15.107:3300/0 conn(0x7fe64c0ad2b0 0x7fe64c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.826+0000 7fe64be00640 1 --2- 172.21.15.59:0/418816377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe64c1569e0 0x7fe64c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.826+0000 7fe64b400640 1 -- 172.21.15.59:0/418816377 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3414575790 0 0) 0x7fe64c0ad770 con 0x7fe64c0d0660 2024-05-30T16:56:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.826+0000 7fe64b400640 1 -- 172.21.15.59:0/418816377 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe630003530 con 0x7fe64c0d0660 2024-05-30T16:56:46.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.826+0000 7fe64be00640 1 -- 172.21.15.59:0/418816377 >> v2:172.21.15.107:3300/0 conn(0x7fe64c0ad2b0 msgr2=0x7fe64c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:46.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.826+0000 7fe64be00640 1 --2- 172.21.15.59:0/418816377 >> v2:172.21.15.107:3300/0 conn(0x7fe64c0ad2b0 0x7fe64c0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:46.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.826+0000 7fe64be00640 1 -- 172.21.15.59:0/418816377 >> v1:172.21.15.59:6789/0 conn(0x7fe64c0d0660 legacy=0x7fe64c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:46.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.826+0000 7fe64be00640 1 -- 172.21.15.59:0/418816377 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c15d100 con 0x7fe64c1569e0 2024-05-30T16:56:46.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.826+0000 7fe643e00640 1 --2- 172.21.15.59:0/418816377 >> v2:172.21.15.107:3300/0 conn(0x7fe64c0ad2b0 0x7fe64c0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:46.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.826+0000 7fe64be00640 1 --2- 172.21.15.59:0/418816377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe64c1569e0 0x7fe64c15d620 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0097c0 tx=0x7fe63c01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb8430f659481ee2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:46.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe64b400640 1 -- 172.21.15.59:0/418816377 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0b0070 con 0x7fe64c1569e0 2024-05-30T16:56:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe64b400640 1 -- 172.21.15.59:0/418816377 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63c0ab600 con 0x7fe64c1569e0 2024-05-30T16:56:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe64b400640 1 -- 172.21.15.59:0/418816377 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0ab9d0 con 0x7fe64c1569e0 2024-05-30T16:56:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 -- 172.21.15.59:0/418816377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe64c1569e0 msgr2=0x7fe64c15d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 --2- 172.21.15.59:0/418816377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe64c1569e0 0x7fe64c15d620 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0097c0 tx=0x7fe63c01c380 comp rx=0 tx=0).stop 2024-05-30T16:56:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 -- 172.21.15.59:0/418816377 shutdown_connections 2024-05-30T16:56:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 --2- 172.21.15.59:0/418816377 >> v2:172.21.15.107:3300/0 conn(0x7fe64c0ad2b0 0x7fe64c0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 --2- 172.21.15.59:0/418816377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe64c1569e0 0x7fe64c15d620 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 -- 172.21.15.59:0/418816377 >> 172.21.15.59:0/418816377 conn(0x7fe64c06bdb0 msgr2=0x7fe64c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 -- 172.21.15.59:0/418816377 shutdown_connections 2024-05-30T16:56:46.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 -- 172.21.15.59:0/418816377 wait complete. 2024-05-30T16:56:46.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 Processor -- start 2024-05-30T16:56:46.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 -- start start 2024-05-30T16:56:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64c0ad2b0 0x7fe64c0995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe64c0d0660 0x7fe64c149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c1569e0 0x7fe64c14a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c0d00b0 con 0x7fe64c1569e0 2024-05-30T16:56:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c0cff30 con 0x7fe64c0ad2b0 2024-05-30T16:56:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe652c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe64c1691b0 con 0x7fe64c0d0660 2024-05-30T16:56:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe650c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c1569e0 0x7fe64c14a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe650c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c1569e0 0x7fe64c14a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59126/0 (socket says 172.21.15.59:59126) 2024-05-30T16:56:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe650c00640 1 -- 172.21.15.59:0/3347845109 learned_addr learned my addr 172.21.15.59:0/3347845109 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe643e00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe64c0d0660 0x7fe64c149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.830+0000 7fe64be00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64c0ad2b0 0x7fe64c0995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe650c00640 1 -- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe64c0d0660 msgr2=0x7fe64c149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe650c00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe64c0d0660 0x7fe64c149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe650c00640 1 -- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64c0ad2b0 msgr2=0x7fe64c0995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe650c00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64c0ad2b0 0x7fe64c0995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe650c00640 1 -- 172.21.15.59:0/3347845109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c14e250 con 0x7fe64c1569e0 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe64be00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64c0ad2b0 0x7fe64c0995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe650c00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c1569e0 0x7fe64c14a320 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe64400cb70 tx=0x7fe64400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe648c00640 1 -- 172.21.15.59:0/3347845109 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644017070 con 0x7fe64c1569e0 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe648c00640 1 -- 172.21.15.59:0/3347845109 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe64400ad40 con 0x7fe64c1569e0 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe652c00640 1 -- 172.21.15.59:0/3347845109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64c14e530 con 0x7fe64c1569e0 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe648c00640 1 -- 172.21.15.59:0/3347845109 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644012620 con 0x7fe64c1569e0 2024-05-30T16:56:46.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe652c00640 1 -- 172.21.15.59:0/3347845109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe64c14eaf0 con 0x7fe64c1569e0 2024-05-30T16:56:46.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe652c00640 1 -- 172.21.15.59:0/3347845109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe64c068a90 con 0x7fe64c1569e0 2024-05-30T16:56:46.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe648c00640 1 -- 172.21.15.59:0/3347845109 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7fe64401a070 con 0x7fe64c1569e0 2024-05-30T16:56:46.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe648c00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe628069070 0x7fe62806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:46.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.834+0000 7fe648c00640 1 -- 172.21.15.59:0/3347845109 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7fe644085190 con 0x7fe64c1569e0 2024-05-30T16:56:46.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.838+0000 7fe64be00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe628069070 0x7fe62806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:46.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.838+0000 7fe64be00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe628069070 0x7fe62806b530 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0ad000 tx=0x7fe63c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:46.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:46.838+0000 7fe648c00640 1 -- 172.21.15.59:0/3347845109 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe644056b50 con 0x7fe64c1569e0 2024-05-30T16:56:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.038+0000 7fe652c00640 1 -- 172.21.15.59:0/3347845109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe64c099b00 con 0x7fe64c1569e0 2024-05-30T16:56:47.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.654+0000 7fe648c00640 1 -- 172.21.15.59:0/3347845109 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7fe64405ae50 con 0x7fe64c1569e0 2024-05-30T16:56:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.658+0000 7fe652c00640 1 -- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe628069070 msgr2=0x7fe62806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.658+0000 7fe652c00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe628069070 0x7fe62806b530 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0ad000 tx=0x7fe63c0a6000 comp rx=0 tx=0).stop 2024-05-30T16:56:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.658+0000 7fe652c00640 1 -- 172.21.15.59:0/3347845109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c1569e0 msgr2=0x7fe64c14a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.658+0000 7fe652c00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c1569e0 0x7fe64c14a320 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe64400cb70 tx=0x7fe64400a430 comp rx=0 tx=0).stop 2024-05-30T16:56:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.658+0000 7fe652c00640 1 -- 172.21.15.59:0/3347845109 shutdown_connections 2024-05-30T16:56:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.658+0000 7fe652c00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe628069070 0x7fe62806b530 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.658+0000 7fe652c00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c1569e0 0x7fe64c14a320 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.658+0000 7fe652c00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe64c0d0660 0x7fe64c149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.658+0000 7fe652c00640 1 --2- 172.21.15.59:0/3347845109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64c0ad2b0 0x7fe64c0995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.658+0000 7fe652c00640 1 -- 172.21.15.59:0/3347845109 >> 172.21.15.59:0/3347845109 conn(0x7fe64c06bdb0 msgr2=0x7fe64c0b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.658+0000 7fe652c00640 1 -- 172.21.15.59:0/3347845109 shutdown_connections 2024-05-30T16:56:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.658+0000 7fe652c00640 1 -- 172.21.15.59:0/3347845109 wait complete. 2024-05-30T16:56:47.687 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T16:56:47.688 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:56:47.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efe06e00640 1 Processor -- start 2024-05-30T16:56:47.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efe06e00640 1 -- start start 2024-05-30T16:56:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efe06e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0015b5f0 0x7efe000ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efe06e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe0006fc20 0x7efe000cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efe06e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe000c74d0 con 0x7efe000c7f70 2024-05-30T16:56:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efe06e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7efe000c7d30 con 0x7efe0006fc20 2024-05-30T16:56:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efe06e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efe000cec00 con 0x7efe0015b5f0 2024-05-30T16:56:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efe04e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe0006fc20 0x7efe000cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efdf7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efe000c7f70 0x7efe0006f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58964/0 (socket says 172.21.15.59:58964) 2024-05-30T16:56:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efdf7e00640 1 -- 172.21.15.59:0/3035709417 learned_addr learned my addr 172.21.15.59:0/3035709417 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efdffe00640 1 --2- 172.21.15.59:0/3035709417 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0015b5f0 0x7efe000ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efe04e00640 1 -- 172.21.15.59:0/3035709417 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0015b5f0 msgr2=0x7efe000ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:47.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efe04e00640 1 --2- 172.21.15.59:0/3035709417 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0015b5f0 0x7efe000ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:47.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efe04e00640 1 -- 172.21.15.59:0/3035709417 >> v1:172.21.15.59:6789/0 conn(0x7efe000c7f70 legacy=0x7efe0006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:47.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.830+0000 7efe04e00640 1 -- 172.21.15.59:0/3035709417 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe000c7770 con 0x7efe0006fc20 2024-05-30T16:56:47.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.834+0000 7efe04e00640 1 --2- 172.21.15.59:0/3035709417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0006fc20 0x7efe000cf870 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009d90 tx=0x7efdf801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b96020a5c6af57 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:47.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.834+0000 7efdff400640 1 -- 172.21.15.59:0/3035709417 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf80b2070 con 0x7efe0006fc20 2024-05-30T16:56:47.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.834+0000 7efdff400640 1 -- 172.21.15.59:0/3035709417 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf80a5990 con 0x7efe0006fc20 2024-05-30T16:56:47.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.834+0000 7efdff400640 1 -- 172.21.15.59:0/3035709417 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf80a5d60 con 0x7efe0006fc20 2024-05-30T16:56:47.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.834+0000 7efe06e00640 1 -- 172.21.15.59:0/3035709417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0006fc20 msgr2=0x7efe000cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:47.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.834+0000 7efe06e00640 1 --2- 172.21.15.59:0/3035709417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0006fc20 0x7efe000cf870 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009d90 tx=0x7efdf801c8b0 comp rx=0 tx=0).stop 2024-05-30T16:56:47.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.834+0000 7efe06e00640 1 -- 172.21.15.59:0/3035709417 shutdown_connections 2024-05-30T16:56:47.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.834+0000 7efe06e00640 1 --2- 172.21.15.59:0/3035709417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0006fc20 0x7efe000cf870 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:47.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.834+0000 7efe06e00640 1 --2- 172.21.15.59:0/3035709417 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0015b5f0 0x7efe000ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:47.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.834+0000 7efe06e00640 1 -- 172.21.15.59:0/3035709417 >> 172.21.15.59:0/3035709417 conn(0x7efe000b2fc0 msgr2=0x7efe000b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:47.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.834+0000 7efe06e00640 1 -- 172.21.15.59:0/3035709417 shutdown_connections 2024-05-30T16:56:47.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.834+0000 7efe06e00640 1 -- 172.21.15.59:0/3035709417 wait complete. 2024-05-30T16:56:47.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe06e00640 1 Processor -- start 2024-05-30T16:56:47.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe06e00640 1 -- start start 2024-05-30T16:56:47.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe06e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0006fc20 0x7efe001479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:47.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe06e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000c7f70 0x7efe00146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:47.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe06e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0015b5f0 0x7efe000b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe06e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efe000d0950 con 0x7efe0015b5f0 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe06e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efe000d07d0 con 0x7efe000c7f70 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe06e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efe000d0ad0 con 0x7efe0006fc20 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe04e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0015b5f0 0x7efe000b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe04e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0015b5f0 0x7efe000b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59136/0 (socket says 172.21.15.59:59136) 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe04e00640 1 -- 172.21.15.59:0/2218557474 learned_addr learned my addr 172.21.15.59:0/2218557474 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efdffe00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0006fc20 0x7efe001479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efdf7e00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000c7f70 0x7efe00146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe04e00640 1 -- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0006fc20 msgr2=0x7efe001479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe04e00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0006fc20 0x7efe001479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe04e00640 1 -- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000c7f70 msgr2=0x7efe00146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe04e00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000c7f70 0x7efe00146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe04e00640 1 -- 172.21.15.59:0/2218557474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe000b27b0 con 0x7efe0015b5f0 2024-05-30T16:56:47.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe04e00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0015b5f0 0x7efe000b2270 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7efdf801af60 tx=0x7efdf8019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:47.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efdfcc00640 1 -- 172.21.15.59:0/2218557474 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf80b2050 con 0x7efe0015b5f0 2024-05-30T16:56:47.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efdfcc00640 1 -- 172.21.15.59:0/2218557474 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf80be070 con 0x7efe0015b5f0 2024-05-30T16:56:47.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe06e00640 1 -- 172.21.15.59:0/2218557474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe00147fe0 con 0x7efe0015b5f0 2024-05-30T16:56:47.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efdfcc00640 1 -- 172.21.15.59:0/2218557474 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf80ada50 con 0x7efe0015b5f0 2024-05-30T16:56:47.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe06e00640 1 -- 172.21.15.59:0/2218557474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe001496e0 con 0x7efe0015b5f0 2024-05-30T16:56:47.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.838+0000 7efe06e00640 1 -- 172.21.15.59:0/2218557474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe00068a90 con 0x7efe0015b5f0 2024-05-30T16:56:47.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.842+0000 7efdfcc00640 1 -- 172.21.15.59:0/2218557474 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7efdf80adbf0 con 0x7efe0015b5f0 2024-05-30T16:56:47.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.842+0000 7efdfcc00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efddc069070 0x7efddc06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:47.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.842+0000 7efdfcc00640 1 -- 172.21.15.59:0/2218557474 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7efdf8120720 con 0x7efe0015b5f0 2024-05-30T16:56:47.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.842+0000 7efdffe00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efddc069070 0x7efddc06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:47.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.842+0000 7efdffe00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efddc069070 0x7efddc06b530 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efdf00079c0 tx=0x7efdf0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:47.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:47.846+0000 7efdfcc00640 1 -- 172.21.15.59:0/2218557474 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe00147fe0 con 0x7efe0015b5f0 2024-05-30T16:56:48.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.046+0000 7efe06e00640 1 -- 172.21.15.59:0/2218557474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe000cfa90 con 0x7efe0015b5f0 2024-05-30T16:56:48.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.046+0000 7efdfcc00640 1 -- 172.21.15.59:0/2218557474 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5189 (secure 0 0 0) 0x7efdf8016560 con 0x7efe0015b5f0 2024-05-30T16:56:48.051 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:48.051 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1624622774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1624622774},{"type":"v1","addr":"172.21.15.59:6835","nonce":1624622774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2200377252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2200377252},{"type":"v1","addr":"172.21.15.59:6834","nonce":2200377252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1151212671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1151212671},{"type":"v1","addr":"172.21.15.107:6836","nonce":1151212671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:56:44.037966+0000","modified":"2024-05-30T16:56:47.045160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/1073059560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1073059560},{"type":"v1","addr":"172.21.15.107:6837","nonce":1073059560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6528,"qdb_cluster":[6528]},"id":5}]} 2024-05-30T16:56:48.052 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 42 2024-05-30T16:56:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.050+0000 7efe06e00640 1 -- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efddc069070 msgr2=0x7efddc06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.050+0000 7efe06e00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efddc069070 0x7efddc06b530 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efdf00079c0 tx=0x7efdf0008040 comp rx=0 tx=0).stop 2024-05-30T16:56:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.050+0000 7efe06e00640 1 -- 172.21.15.59:0/2218557474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0015b5f0 msgr2=0x7efe000b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.050+0000 7efe06e00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0015b5f0 0x7efe000b2270 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7efdf801af60 tx=0x7efdf8019650 comp rx=0 tx=0).stop 2024-05-30T16:56:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.050+0000 7efe06e00640 1 -- 172.21.15.59:0/2218557474 shutdown_connections 2024-05-30T16:56:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.050+0000 7efe06e00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efddc069070 0x7efddc06b530 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.050+0000 7efe06e00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0015b5f0 0x7efe000b2270 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.050+0000 7efe06e00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000c7f70 0x7efe00146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.050+0000 7efe06e00640 1 --2- 172.21.15.59:0/2218557474 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe0006fc20 0x7efe001479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.050+0000 7efe06e00640 1 -- 172.21.15.59:0/2218557474 >> 172.21.15.59:0/2218557474 conn(0x7efe000b2fc0 msgr2=0x7efe0006ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.050+0000 7efe06e00640 1 -- 172.21.15.59:0/2218557474 shutdown_connections 2024-05-30T16:56:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.050+0000 7efe06e00640 1 -- 172.21.15.59:0/2218557474 wait complete. 2024-05-30T16:56:48.073 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:56:48.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.210+0000 7f3454e00640 1 Processor -- start 2024-05-30T16:56:48.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.210+0000 7f3454e00640 1 -- start start 2024-05-30T16:56:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f3454e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f345015e860 0x7f34500cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f3454e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f34500d0e80 0x7f34500c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f3454e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345015ec40 con 0x7f34500c6d80 2024-05-30T16:56:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f3454e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f34500c8200 con 0x7f345015e860 2024-05-30T16:56:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f3454e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f34500c7960 con 0x7f34500d0e80 2024-05-30T16:56:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f344de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f345015e860 0x7f34500cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f344e800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f34500c6d80 0x7f345006b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58966/0 (socket says 172.21.15.59:58966) 2024-05-30T16:56:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f344e800640 1 -- 172.21.15.59:0/215714183 learned_addr learned my addr 172.21.15.59:0/215714183 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f3447e00640 1 --2- 172.21.15.59:0/215714183 >> v2:172.21.15.107:3300/0 conn(0x7f34500d0e80 0x7f34500c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f344d400640 1 -- 172.21.15.59:0/215714183 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2779976739 0 0) 0x7f345015ec40 con 0x7f34500c6d80 2024-05-30T16:56:48.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f344d400640 1 -- 172.21.15.59:0/215714183 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3434003530 con 0x7f34500c6d80 2024-05-30T16:56:48.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f344de00640 1 -- 172.21.15.59:0/215714183 >> v2:172.21.15.107:3300/0 conn(0x7f34500d0e80 msgr2=0x7f34500c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:48.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f344de00640 1 --2- 172.21.15.59:0/215714183 >> v2:172.21.15.107:3300/0 conn(0x7f34500d0e80 0x7f34500c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f344de00640 1 -- 172.21.15.59:0/215714183 >> v1:172.21.15.59:6789/0 conn(0x7f34500c6d80 legacy=0x7f345006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.214+0000 7f344de00640 1 -- 172.21.15.59:0/215714183 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34500c7c40 con 0x7f345015e860 2024-05-30T16:56:48.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f344de00640 1 --2- 172.21.15.59:0/215714183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015e860 0x7f34500cef40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f34500710f0 tx=0x7f344001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353118dbffea7d74 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:48.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f344d400640 1 -- 172.21.15.59:0/215714183 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400b0070 con 0x7f345015e860 2024-05-30T16:56:48.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f344d400640 1 -- 172.21.15.59:0/215714183 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34400ab600 con 0x7f345015e860 2024-05-30T16:56:48.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f344d400640 1 -- 172.21.15.59:0/215714183 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400ab9d0 con 0x7f345015e860 2024-05-30T16:56:48.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 -- 172.21.15.59:0/215714183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015e860 msgr2=0x7f34500cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 --2- 172.21.15.59:0/215714183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015e860 0x7f34500cef40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f34500710f0 tx=0x7f344001c3f0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 -- 172.21.15.59:0/215714183 shutdown_connections 2024-05-30T16:56:48.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 --2- 172.21.15.59:0/215714183 >> v2:172.21.15.107:3300/0 conn(0x7f34500d0e80 0x7f34500c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 --2- 172.21.15.59:0/215714183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015e860 0x7f34500cef40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 -- 172.21.15.59:0/215714183 >> 172.21.15.59:0/215714183 conn(0x7f34500b2fc0 msgr2=0x7f34500b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:48.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 -- 172.21.15.59:0/215714183 shutdown_connections 2024-05-30T16:56:48.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 -- 172.21.15.59:0/215714183 wait complete. 2024-05-30T16:56:48.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 Processor -- start 2024-05-30T16:56:48.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 -- start start 2024-05-30T16:56:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34500c6d80 0x7f34501541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34500d0e80 0x7f34500b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f345015e860 0x7f34500ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f34500b3d40 con 0x7f34500d0e80 2024-05-30T16:56:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f34500b3bc0 con 0x7f34500c6d80 2024-05-30T16:56:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.218+0000 7f3454e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f345016b3a0 con 0x7f345015e860 2024-05-30T16:56:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3447e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34500d0e80 0x7f34500b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3447e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34500d0e80 0x7f34500b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59158/0 (socket says 172.21.15.59:59158) 2024-05-30T16:56:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3447e00640 1 -- 172.21.15.59:0/2775905660 learned_addr learned my addr 172.21.15.59:0/2775905660 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f344de00640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34500c6d80 0x7f34501541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f344e800640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f345015e860 0x7f34500ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3447e00640 1 -- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f345015e860 msgr2=0x7f34500ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3447e00640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f345015e860 0x7f34500ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3447e00640 1 -- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34500c6d80 msgr2=0x7f34501541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3447e00640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34500c6d80 0x7f34501541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3447e00640 1 -- 172.21.15.59:0/2775905660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34500af260 con 0x7f34500d0e80 2024-05-30T16:56:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3447e00640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34500d0e80 0x7f34500b0590 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f343800e870 tx=0x7f343800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3446000640 1 -- 172.21.15.59:0/2775905660 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3438017070 con 0x7f34500d0e80 2024-05-30T16:56:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3446000640 1 -- 172.21.15.59:0/2775905660 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f343800c940 con 0x7f34500d0e80 2024-05-30T16:56:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3446000640 1 -- 172.21.15.59:0/2775905660 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343800ccf0 con 0x7f34500d0e80 2024-05-30T16:56:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3454e00640 1 -- 172.21.15.59:0/2775905660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34500af540 con 0x7f34500d0e80 2024-05-30T16:56:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3454e00640 1 -- 172.21.15.59:0/2775905660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34501595d0 con 0x7f34500d0e80 2024-05-30T16:56:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3454e00640 1 -- 172.21.15.59:0/2775905660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3450068a90 con 0x7f34500d0e80 2024-05-30T16:56:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.222+0000 7f3446000640 1 -- 172.21.15.59:0/2775905660 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f343801a070 con 0x7f34500d0e80 2024-05-30T16:56:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.226+0000 7f3446000640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f342c0690a0 0x7f342c06b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.226+0000 7f3446000640 1 -- 172.21.15.59:0/2775905660 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f34380855d0 con 0x7f34500d0e80 2024-05-30T16:56:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.226+0000 7f344de00640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f342c0690a0 0x7f342c06b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.226+0000 7f344de00640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f342c0690a0 0x7f342c06b560 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f34400ad000 tx=0x7f34400a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.226+0000 7f3446000640 1 -- 172.21.15.59:0/2775905660 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3438056f90 con 0x7f34500d0e80 2024-05-30T16:56:48.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.394+0000 7f3454e00640 1 -- 172.21.15.59:0/2775905660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3450158330 con 0x7f34500d0e80 2024-05-30T16:56:48.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.394+0000 7f3446000640 1 -- 172.21.15.59:0/2775905660 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16787 (secure 0 0 0) 0x7f343805b290 con 0x7f34500d0e80 2024-05-30T16:56:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:48.399 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":75,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:56:45.642545+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:56:41.730533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T16:56:42.994525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:56:48.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.398+0000 7f3454e00640 1 -- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f342c0690a0 msgr2=0x7f342c06b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.398+0000 7f3454e00640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f342c0690a0 0x7f342c06b560 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f34400ad000 tx=0x7f34400a4f90 comp rx=0 tx=0).stop 2024-05-30T16:56:48.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.398+0000 7f3454e00640 1 -- 172.21.15.59:0/2775905660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34500d0e80 msgr2=0x7f34500b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.398+0000 7f3454e00640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34500d0e80 0x7f34500b0590 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f343800e870 tx=0x7f343800ec70 comp rx=0 tx=0).stop 2024-05-30T16:56:48.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.398+0000 7f3454e00640 1 -- 172.21.15.59:0/2775905660 shutdown_connections 2024-05-30T16:56:48.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.398+0000 7f3454e00640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f342c0690a0 0x7f342c06b560 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.398+0000 7f3454e00640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f345015e860 0x7f34500ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.398+0000 7f3454e00640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34500d0e80 0x7f34500b0590 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.398+0000 7f3454e00640 1 --2- 172.21.15.59:0/2775905660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34500c6d80 0x7f34501541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.398+0000 7f3454e00640 1 -- 172.21.15.59:0/2775905660 >> 172.21.15.59:0/2775905660 conn(0x7f34500b2fc0 msgr2=0x7f345015b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:48.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.398+0000 7f3454e00640 1 -- 172.21.15.59:0/2775905660 shutdown_connections 2024-05-30T16:56:48.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.398+0000 7f3454e00640 1 -- 172.21.15.59:0/2775905660 wait complete. 2024-05-30T16:56:48.421 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:56:48.421 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:56:48.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.558+0000 7f9c98200640 1 Processor -- start 2024-05-30T16:56:48.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.558+0000 7f9c98200640 1 -- start start 2024-05-30T16:56:48.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.558+0000 7f9c98200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c900ad8c0 0x7f9c9015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.558+0000 7f9c98200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9c9015a1d0 0x7f9c9015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.558+0000 7f9c98200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c9015d730 con 0x7f9c90159df0 2024-05-30T16:56:48.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.558+0000 7f9c98200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9c9015d4f0 con 0x7f9c9015a1d0 2024-05-30T16:56:48.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.558+0000 7f9c98200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c900b3370 con 0x7f9c900ad8c0 2024-05-30T16:56:48.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.558+0000 7f9c95800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9c90159df0 0x7f9c900ad1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58980/0 (socket says 172.21.15.59:58980) 2024-05-30T16:56:48.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.558+0000 7f9c95800640 1 -- 172.21.15.59:0/1794272086 learned_addr learned my addr 172.21.15.59:0/1794272086 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:48.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c96200640 1 --2- 172.21.15.59:0/1794272086 >> v2:172.21.15.107:3300/0 conn(0x7f9c9015a1d0 0x7f9c9015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c94e00640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c900ad8c0 0x7f9c9015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2390567547 0 0) 0x7f9c9015d730 con 0x7f9c90159df0 2024-05-30T16:56:48.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c78003530 con 0x7f9c90159df0 2024-05-30T16:56:48.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3757905794 0 0) 0x7f9c78003530 con 0x7f9c90159df0 2024-05-30T16:56:48.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c900ad8c0 msgr2=0x7f9c9015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:48.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c900ad8c0 0x7f9c9015ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 >> v2:172.21.15.107:3300/0 conn(0x7f9c9015a1d0 msgr2=0x7f9c9015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:48.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 --2- 172.21.15.59:0/1794272086 >> v2:172.21.15.107:3300/0 conn(0x7f9c9015a1d0 0x7f9c9015cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c900b3650 con 0x7f9c90159df0 2024-05-30T16:56:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f9c84001680 con 0x7f9c90159df0 2024-05-30T16:56:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 >> v1:172.21.15.59:6789/0 conn(0x7f9c90159df0 legacy=0x7f9c900ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c780039c0 0x7f9c78003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c78004810 0x7f9c78004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c900ad8c0 0x7f9c780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9015d4f0 con 0x7f9c780039c0 2024-05-30T16:56:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c900b3370 con 0x7f9c78004810 2024-05-30T16:56:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c7800b9d0 con 0x7f9c900ad8c0 2024-05-30T16:56:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c96200640 1 --2- 172.21.15.59:0/1794272086 >> v2:172.21.15.107:3300/0 conn(0x7f9c9015a1d0 0x7f9c9015cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c95800640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c780039c0 0x7f9c78003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c94e00640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c78004810 0x7f9c78004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c95800640 1 -- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c900ad8c0 msgr2=0x7f9c780051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c96200640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c900ad8c0 0x7f9c780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c95800640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c900ad8c0 0x7f9c780051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c95800640 1 -- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c78004810 msgr2=0x7f9c78004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c95800640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c78004810 0x7f9c78004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c95800640 1 -- 172.21.15.59:0/1794272086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c78003530 con 0x7f9c780039c0 2024-05-30T16:56:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c96200640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c900ad8c0 0x7f9c780051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.562+0000 7f9c94e00640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c78004810 0x7f9c78004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:48.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c95800640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c780039c0 0x7f9c78003de0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400c240 tx=0x7f9c8401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139f10d111962531 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:48.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c84007d40 con 0x7f9c780039c0 2024-05-30T16:56:48.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c840a9020 con 0x7f9c780039c0 2024-05-30T16:56:48.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c8fe00640 1 -- 172.21.15.59:0/1794272086 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c84005ae0 con 0x7f9c780039c0 2024-05-30T16:56:48.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 -- 172.21.15.59:0/1794272086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c780039c0 msgr2=0x7f9c78003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 --2- 172.21.15.59:0/1794272086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c780039c0 0x7f9c78003de0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400c240 tx=0x7f9c8401cca0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c96200640 1 -- 172.21.15.59:0/1794272086 reap_dead start 2024-05-30T16:56:48.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 -- 172.21.15.59:0/1794272086 shutdown_connections 2024-05-30T16:56:48.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 -- 172.21.15.59:0/1794272086 >> 172.21.15.59:0/1794272086 conn(0x7f9c900b22d0 msgr2=0x7f9c900b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:48.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 -- 172.21.15.59:0/1794272086 shutdown_connections 2024-05-30T16:56:48.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 -- 172.21.15.59:0/1794272086 wait complete. 2024-05-30T16:56:48.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 Processor -- start 2024-05-30T16:56:48.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 -- start start 2024-05-30T16:56:48.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c780039c0 0x7f9c9015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c9014f3c0 0x7f9c90153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90150160 0x7f9c90161a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9015e720 con 0x7f9c90150160 2024-05-30T16:56:48.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9015e5a0 con 0x7f9c780039c0 2024-05-30T16:56:48.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c98200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9015e8a0 con 0x7f9c9014f3c0 2024-05-30T16:56:48.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.566+0000 7f9c96200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90150160 0x7f9c90161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c96200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90150160 0x7f9c90161a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59180/0 (socket says 172.21.15.59:59180) 2024-05-30T16:56:48.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c96200640 1 -- 172.21.15.59:0/148412290 learned_addr learned my addr 172.21.15.59:0/148412290 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:48.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c95800640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c780039c0 0x7f9c9015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c94e00640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c9014f3c0 0x7f9c90153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c96200640 1 -- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c9014f3c0 msgr2=0x7f9c90153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c96200640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c9014f3c0 0x7f9c90153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c96200640 1 -- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c780039c0 msgr2=0x7f9c9015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c96200640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c780039c0 0x7f9c9015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c96200640 1 -- 172.21.15.59:0/148412290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9014f840 con 0x7f9c90150160 2024-05-30T16:56:48.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c94e00640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c9014f3c0 0x7f9c90153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:48.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c96200640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90150160 0x7f9c90161a30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9c900ae880 tx=0x7f9c8800f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:48.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c8d600640 1 -- 172.21.15.59:0/148412290 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88016620 con 0x7f9c90150160 2024-05-30T16:56:48.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c8d600640 1 -- 172.21.15.59:0/148412290 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8801b070 con 0x7f9c90150160 2024-05-30T16:56:48.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c98200640 1 -- 172.21.15.59:0/148412290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9015f1a0 con 0x7f9c90150160 2024-05-30T16:56:48.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c8d600640 1 -- 172.21.15.59:0/148412290 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c880169e0 con 0x7f9c90150160 2024-05-30T16:56:48.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c98200640 1 -- 172.21.15.59:0/148412290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c9015f760 con 0x7f9c90150160 2024-05-30T16:56:48.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c98200640 1 -- 172.21.15.59:0/148412290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c90068a90 con 0x7f9c90150160 2024-05-30T16:56:48.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c8d600640 1 -- 172.21.15.59:0/148412290 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f9c88016b80 con 0x7f9c90150160 2024-05-30T16:56:48.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.570+0000 7f9c8d600640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c700690a0 0x7f9c7006b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.574+0000 7f9c8d600640 1 -- 172.21.15.59:0/148412290 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f9c88086470 con 0x7f9c90150160 2024-05-30T16:56:48.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.574+0000 7f9c95800640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c700690a0 0x7f9c7006b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.574+0000 7f9c95800640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c700690a0 0x7f9c7006b560 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9c840aa000 tx=0x7f9c840b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:48.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.578+0000 7f9c8d600640 1 -- 172.21.15.59:0/148412290 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c88025020 con 0x7f9c90150160 2024-05-30T16:56:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.742+0000 7f9c98200640 1 -- 172.21.15.59:0/148412290 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c900b4ef0 con 0x7f9c700690a0 2024-05-30T16:56:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.750+0000 7f9c8d600640 1 -- 172.21.15.59:0/148412290 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242706 (secure 0 0 0) 0x7f9c900b4ef0 con 0x7f9c700690a0 2024-05-30T16:56:48.756 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:56:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.754+0000 7f9c98200640 1 -- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c700690a0 msgr2=0x7f9c7006b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.754+0000 7f9c98200640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c700690a0 0x7f9c7006b560 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9c840aa000 tx=0x7f9c840b1040 comp rx=0 tx=0).stop 2024-05-30T16:56:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.754+0000 7f9c98200640 1 -- 172.21.15.59:0/148412290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90150160 msgr2=0x7f9c90161a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.754+0000 7f9c98200640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90150160 0x7f9c90161a30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9c900ae880 tx=0x7f9c8800f810 comp rx=0 tx=0).stop 2024-05-30T16:56:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.754+0000 7f9c98200640 1 -- 172.21.15.59:0/148412290 shutdown_connections 2024-05-30T16:56:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.754+0000 7f9c98200640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c700690a0 0x7f9c7006b560 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.754+0000 7f9c98200640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90150160 0x7f9c90161a30 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.754+0000 7f9c98200640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c9014f3c0 0x7f9c90153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.754+0000 7f9c98200640 1 --2- 172.21.15.59:0/148412290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c780039c0 0x7f9c9015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.754+0000 7f9c98200640 1 -- 172.21.15.59:0/148412290 >> 172.21.15.59:0/148412290 conn(0x7f9c900b22d0 msgr2=0x7f9c90071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.754+0000 7f9c98200640 1 -- 172.21.15.59:0/148412290 shutdown_connections 2024-05-30T16:56:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.754+0000 7f9c98200640 1 -- 172.21.15.59:0/148412290 wait complete. 2024-05-30T16:56:48.776 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-05-30T16:56:47.210040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591040,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":430980,"kb_used_data":8008,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754543740,"statfs":{"total":773094113280,"available":772652789760,"internally_reserved":0,"allocated":8200192,"data_stored":4114777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.590411"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548612+0000","last_change":"2024-05-30T16:56:44.668865+0000","last_active":"2024-05-30T16:56:46.548612+0000","last_peered":"2024-05-30T16:56:46.548612+0000","last_clean":"2024-05-30T16:56:46.548612+0000","last_became_active":"2024-05-30T16:56:44.668040+0000","last_became_peered":"2024-05-30T16:56:44.668040+0000","last_unstale":"2024-05-30T16:56:46.548612+0000","last_undegraded":"2024-05-30T16:56:46.548612+0000","last_fullsized":"2024-05-30T16:56:46.548612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:56.908682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.661199+0000","last_change":"2024-05-30T16:56:44.649217+0000","last_active":"2024-05-30T16:56:44.661199+0000","last_peered":"2024-05-30T16:56:44.661199+0000","last_clean":"2024-05-30T16:56:44.661199+0000","last_became_active":"2024-05-30T16:56:44.648928+0000","last_became_peered":"2024-05-30T16:56:44.648928+0000","last_unstale":"2024-05-30T16:56:44.661199+0000","last_undegraded":"2024-05-30T16:56:44.661199+0000","last_fullsized":"2024-05-30T16:56:44.661199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:00:34.724863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651793+0000","last_change":"2024-05-30T16:56:44.662425+0000","last_active":"2024-05-30T16:56:45.651793+0000","last_peered":"2024-05-30T16:56:45.651793+0000","last_clean":"2024-05-30T16:56:45.651793+0000","last_became_active":"2024-05-30T16:56:44.662074+0000","last_became_peered":"2024-05-30T16:56:44.662074+0000","last_unstale":"2024-05-30T16:56:45.651793+0000","last_undegraded":"2024-05-30T16:56:45.651793+0000","last_fullsized":"2024-05-30T16:56:45.651793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:50.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652160+0000","last_change":"2024-05-30T16:56:44.652304+0000","last_active":"2024-05-30T16:56:45.652160+0000","last_peered":"2024-05-30T16:56:45.652160+0000","last_clean":"2024-05-30T16:56:45.652160+0000","last_became_active":"2024-05-30T16:56:44.651824+0000","last_became_peered":"2024-05-30T16:56:44.651824+0000","last_unstale":"2024-05-30T16:56:45.652160+0000","last_undegraded":"2024-05-30T16:56:45.652160+0000","last_fullsized":"2024-05-30T16:56:45.652160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:53.257788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548464+0000","last_change":"2024-05-30T16:56:44.663730+0000","last_active":"2024-05-30T16:56:46.548464+0000","last_peered":"2024-05-30T16:56:46.548464+0000","last_clean":"2024-05-30T16:56:46.548464+0000","last_became_active":"2024-05-30T16:56:44.663105+0000","last_became_peered":"2024-05-30T16:56:44.663105+0000","last_unstale":"2024-05-30T16:56:46.548464+0000","last_undegraded":"2024-05-30T16:56:46.548464+0000","last_fullsized":"2024-05-30T16:56:46.548464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:08:06.277998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651812+0000","last_change":"2024-05-30T16:56:44.658635+0000","last_active":"2024-05-30T16:56:45.651812+0000","last_peered":"2024-05-30T16:56:45.651812+0000","last_clean":"2024-05-30T16:56:45.651812+0000","last_became_active":"2024-05-30T16:56:44.658374+0000","last_became_peered":"2024-05-30T16:56:44.658374+0000","last_unstale":"2024-05-30T16:56:45.651812+0000","last_undegraded":"2024-05-30T16:56:45.651812+0000","last_fullsized":"2024-05-30T16:56:45.651812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:03:27.939224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652173+0000","last_change":"2024-05-30T16:56:44.649373+0000","last_active":"2024-05-30T16:56:45.652173+0000","last_peered":"2024-05-30T16:56:45.652173+0000","last_clean":"2024-05-30T16:56:45.652173+0000","last_became_active":"2024-05-30T16:56:44.649085+0000","last_became_peered":"2024-05-30T16:56:44.649085+0000","last_unstale":"2024-05-30T16:56:45.652173+0000","last_undegraded":"2024-05-30T16:56:45.652173+0000","last_fullsized":"2024-05-30T16:56:45.652173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:38.575100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548147+0000","last_change":"2024-05-30T16:56:44.662385+0000","last_active":"2024-05-30T16:56:46.548147+0000","last_peered":"2024-05-30T16:56:46.548147+0000","last_clean":"2024-05-30T16:56:46.548147+0000","last_became_active":"2024-05-30T16:56:44.662083+0000","last_became_peered":"2024-05-30T16:56:44.662083+0000","last_unstale":"2024-05-30T16:56:46.548147+0000","last_undegraded":"2024-05-30T16:56:46.548147+0000","last_fullsized":"2024-05-30T16:56:46.548147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:16:01.303332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548254+0000","last_change":"2024-05-30T16:56:44.670256+0000","last_active":"2024-05-30T16:56:46.548254+0000","last_peered":"2024-05-30T16:56:46.548254+0000","last_clean":"2024-05-30T16:56:46.548254+0000","last_became_active":"2024-05-30T16:56:44.669963+0000","last_became_peered":"2024-05-30T16:56:44.669963+0000","last_unstale":"2024-05-30T16:56:46.548254+0000","last_undegraded":"2024-05-30T16:56:46.548254+0000","last_fullsized":"2024-05-30T16:56:46.548254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:01:10.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.661222+0000","last_change":"2024-05-30T16:56:44.651182+0000","last_active":"2024-05-30T16:56:44.661222+0000","last_peered":"2024-05-30T16:56:44.661222+0000","last_clean":"2024-05-30T16:56:44.661222+0000","last_became_active":"2024-05-30T16:56:44.650908+0000","last_became_peered":"2024-05-30T16:56:44.650908+0000","last_unstale":"2024-05-30T16:56:44.661222+0000","last_undegraded":"2024-05-30T16:56:44.661222+0000","last_fullsized":"2024-05-30T16:56:44.661222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:49:02.259652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659298+0000","last_change":"2024-05-30T16:56:44.650936+0000","last_active":"2024-05-30T16:56:44.659298+0000","last_peered":"2024-05-30T16:56:44.659298+0000","last_clean":"2024-05-30T16:56:44.659298+0000","last_became_active":"2024-05-30T16:56:44.650397+0000","last_became_peered":"2024-05-30T16:56:44.650397+0000","last_unstale":"2024-05-30T16:56:44.659298+0000","last_undegraded":"2024-05-30T16:56:44.659298+0000","last_fullsized":"2024-05-30T16:56:44.659298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:52.457119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548620+0000","last_change":"2024-05-30T16:56:44.669763+0000","last_active":"2024-05-30T16:56:46.548620+0000","last_peered":"2024-05-30T16:56:46.548620+0000","last_clean":"2024-05-30T16:56:46.548620+0000","last_became_active":"2024-05-30T16:56:44.669357+0000","last_became_peered":"2024-05-30T16:56:44.669357+0000","last_unstale":"2024-05-30T16:56:46.548620+0000","last_undegraded":"2024-05-30T16:56:46.548620+0000","last_fullsized":"2024-05-30T16:56:46.548620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:03.908739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548770+0000","last_change":"2024-05-30T16:56:43.652722+0000","last_active":"2024-05-30T16:56:46.548770+0000","last_peered":"2024-05-30T16:56:46.548770+0000","last_clean":"2024-05-30T16:56:46.548770+0000","last_became_active":"2024-05-30T16:56:43.652368+0000","last_became_peered":"2024-05-30T16:56:43.652368+0000","last_unstale":"2024-05-30T16:56:46.548770+0000","last_undegraded":"2024-05-30T16:56:46.548770+0000","last_fullsized":"2024-05-30T16:56:46.548770+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:41:02.005724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652233+0000","last_change":"2024-05-30T16:56:44.652087+0000","last_active":"2024-05-30T16:56:45.652233+0000","last_peered":"2024-05-30T16:56:45.652233+0000","last_clean":"2024-05-30T16:56:45.652233+0000","last_became_active":"2024-05-30T16:56:44.651426+0000","last_became_peered":"2024-05-30T16:56:44.651426+0000","last_unstale":"2024-05-30T16:56:45.652233+0000","last_undegraded":"2024-05-30T16:56:45.652233+0000","last_fullsized":"2024-05-30T16:56:45.652233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:56.981440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548563+0000","last_change":"2024-05-30T16:56:44.665209+0000","last_active":"2024-05-30T16:56:46.548563+0000","last_peered":"2024-05-30T16:56:46.548563+0000","last_clean":"2024-05-30T16:56:46.548563+0000","last_became_active":"2024-05-30T16:56:44.664880+0000","last_became_peered":"2024-05-30T16:56:44.664880+0000","last_unstale":"2024-05-30T16:56:46.548563+0000","last_undegraded":"2024-05-30T16:56:46.548563+0000","last_fullsized":"2024-05-30T16:56:46.548563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:30.146195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.662926+0000","last_change":"2024-05-30T16:56:43.650135+0000","last_active":"2024-05-30T16:56:44.662926+0000","last_peered":"2024-05-30T16:56:44.662926+0000","last_clean":"2024-05-30T16:56:44.662926+0000","last_became_active":"2024-05-30T16:56:43.649731+0000","last_became_peered":"2024-05-30T16:56:43.649731+0000","last_unstale":"2024-05-30T16:56:44.662926+0000","last_undegraded":"2024-05-30T16:56:44.662926+0000","last_fullsized":"2024-05-30T16:56:44.662926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:05:58.221402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650764+0000","last_change":"2024-05-30T16:56:44.655108+0000","last_active":"2024-05-30T16:56:45.650764+0000","last_peered":"2024-05-30T16:56:45.650764+0000","last_clean":"2024-05-30T16:56:45.650764+0000","last_became_active":"2024-05-30T16:56:44.654831+0000","last_became_peered":"2024-05-30T16:56:44.654831+0000","last_unstale":"2024-05-30T16:56:45.650764+0000","last_undegraded":"2024-05-30T16:56:45.650764+0000","last_fullsized":"2024-05-30T16:56:45.650764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:13:38.307444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650776+0000","last_change":"2024-05-30T16:56:43.641994+0000","last_active":"2024-05-30T16:56:45.650776+0000","last_peered":"2024-05-30T16:56:45.650776+0000","last_clean":"2024-05-30T16:56:45.650776+0000","last_became_active":"2024-05-30T16:56:43.641712+0000","last_became_peered":"2024-05-30T16:56:43.641712+0000","last_unstale":"2024-05-30T16:56:45.650776+0000","last_undegraded":"2024-05-30T16:56:45.650776+0000","last_fullsized":"2024-05-30T16:56:45.650776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:08:06.965045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548707+0000","last_change":"2024-05-30T16:56:44.671239+0000","last_active":"2024-05-30T16:56:46.548707+0000","last_peered":"2024-05-30T16:56:46.548707+0000","last_clean":"2024-05-30T16:56:46.548707+0000","last_became_active":"2024-05-30T16:56:44.670215+0000","last_became_peered":"2024-05-30T16:56:44.670215+0000","last_unstale":"2024-05-30T16:56:46.548707+0000","last_undegraded":"2024-05-30T16:56:46.548707+0000","last_fullsized":"2024-05-30T16:56:46.548707+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:50.550356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.667305+0000","last_change":"2024-05-30T16:56:43.648080+0000","last_active":"2024-05-30T16:56:44.667305+0000","last_peered":"2024-05-30T16:56:44.667305+0000","last_clean":"2024-05-30T16:56:44.667305+0000","last_became_active":"2024-05-30T16:56:43.647224+0000","last_became_peered":"2024-05-30T16:56:43.647224+0000","last_unstale":"2024-05-30T16:56:44.667305+0000","last_undegraded":"2024-05-30T16:56:44.667305+0000","last_fullsized":"2024-05-30T16:56:44.667305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:24:13.264974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651928+0000","last_change":"2024-05-30T16:56:44.650308+0000","last_active":"2024-05-30T16:56:45.651928+0000","last_peered":"2024-05-30T16:56:45.651928+0000","last_clean":"2024-05-30T16:56:45.651928+0000","last_became_active":"2024-05-30T16:56:44.649980+0000","last_became_peered":"2024-05-30T16:56:44.649980+0000","last_unstale":"2024-05-30T16:56:45.651928+0000","last_undegraded":"2024-05-30T16:56:45.651928+0000","last_fullsized":"2024-05-30T16:56:45.651928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:45:58.041826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548319+0000","last_change":"2024-05-30T16:56:44.666817+0000","last_active":"2024-05-30T16:56:46.548319+0000","last_peered":"2024-05-30T16:56:46.548319+0000","last_clean":"2024-05-30T16:56:46.548319+0000","last_became_active":"2024-05-30T16:56:44.666556+0000","last_became_peered":"2024-05-30T16:56:44.666556+0000","last_unstale":"2024-05-30T16:56:46.548319+0000","last_undegraded":"2024-05-30T16:56:46.548319+0000","last_fullsized":"2024-05-30T16:56:46.548319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:25:09.747489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651353+0000","last_change":"2024-05-30T16:56:44.652605+0000","last_active":"2024-05-30T16:56:45.651353+0000","last_peered":"2024-05-30T16:56:45.651353+0000","last_clean":"2024-05-30T16:56:45.651353+0000","last_became_active":"2024-05-30T16:56:44.650499+0000","last_became_peered":"2024-05-30T16:56:44.650499+0000","last_unstale":"2024-05-30T16:56:45.651353+0000","last_undegraded":"2024-05-30T16:56:45.651353+0000","last_fullsized":"2024-05-30T16:56:45.651353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:31.289587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548789+0000","last_change":"2024-05-30T16:56:44.666380+0000","last_active":"2024-05-30T16:56:46.548789+0000","last_peered":"2024-05-30T16:56:46.548789+0000","last_clean":"2024-05-30T16:56:46.548789+0000","last_became_active":"2024-05-30T16:56:44.665935+0000","last_became_peered":"2024-05-30T16:56:44.665935+0000","last_unstale":"2024-05-30T16:56:46.548789+0000","last_undegraded":"2024-05-30T16:56:46.548789+0000","last_fullsized":"2024-05-30T16:56:46.548789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:15.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652099+0000","last_change":"2024-05-30T16:56:44.654757+0000","last_active":"2024-05-30T16:56:45.652099+0000","last_peered":"2024-05-30T16:56:45.652099+0000","last_clean":"2024-05-30T16:56:45.652099+0000","last_became_active":"2024-05-30T16:56:44.654467+0000","last_became_peered":"2024-05-30T16:56:44.654467+0000","last_unstale":"2024-05-30T16:56:45.652099+0000","last_undegraded":"2024-05-30T16:56:45.652099+0000","last_fullsized":"2024-05-30T16:56:45.652099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:09.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548368+0000","last_change":"2024-05-30T16:56:43.651621+0000","last_active":"2024-05-30T16:56:46.548368+0000","last_peered":"2024-05-30T16:56:46.548368+0000","last_clean":"2024-05-30T16:56:46.548368+0000","last_became_active":"2024-05-30T16:56:43.651020+0000","last_became_peered":"2024-05-30T16:56:43.651020+0000","last_unstale":"2024-05-30T16:56:46.548368+0000","last_undegraded":"2024-05-30T16:56:46.548368+0000","last_fullsized":"2024-05-30T16:56:46.548368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:32:07.975415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659275+0000","last_change":"2024-05-30T16:56:44.650720+0000","last_active":"2024-05-30T16:56:44.659275+0000","last_peered":"2024-05-30T16:56:44.659275+0000","last_clean":"2024-05-30T16:56:44.659275+0000","last_became_active":"2024-05-30T16:56:44.649933+0000","last_became_peered":"2024-05-30T16:56:44.649933+0000","last_unstale":"2024-05-30T16:56:44.659275+0000","last_undegraded":"2024-05-30T16:56:44.659275+0000","last_fullsized":"2024-05-30T16:56:44.659275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:24:16.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659097+0000","last_change":"2024-05-30T16:56:44.646838+0000","last_active":"2024-05-30T16:56:44.659097+0000","last_peered":"2024-05-30T16:56:44.659097+0000","last_clean":"2024-05-30T16:56:44.659097+0000","last_became_active":"2024-05-30T16:56:44.646587+0000","last_became_peered":"2024-05-30T16:56:44.646587+0000","last_unstale":"2024-05-30T16:56:44.659097+0000","last_undegraded":"2024-05-30T16:56:44.659097+0000","last_fullsized":"2024-05-30T16:56:44.659097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:30.610228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.658847+0000","last_change":"2024-05-30T16:56:44.646527+0000","last_active":"2024-05-30T16:56:44.658847+0000","last_peered":"2024-05-30T16:56:44.658847+0000","last_clean":"2024-05-30T16:56:44.658847+0000","last_became_active":"2024-05-30T16:56:44.646233+0000","last_became_peered":"2024-05-30T16:56:44.646233+0000","last_unstale":"2024-05-30T16:56:44.658847+0000","last_undegraded":"2024-05-30T16:56:44.658847+0000","last_fullsized":"2024-05-30T16:56:44.658847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:51:47.821639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548416+0000","last_change":"2024-05-30T16:56:44.669877+0000","last_active":"2024-05-30T16:56:46.548416+0000","last_peered":"2024-05-30T16:56:46.548416+0000","last_clean":"2024-05-30T16:56:46.548416+0000","last_became_active":"2024-05-30T16:56:44.669562+0000","last_became_peered":"2024-05-30T16:56:44.669562+0000","last_unstale":"2024-05-30T16:56:46.548416+0000","last_undegraded":"2024-05-30T16:56:46.548416+0000","last_fullsized":"2024-05-30T16:56:46.548416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:59:28.731114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652045+0000","last_change":"2024-05-30T16:56:43.648834+0000","last_active":"2024-05-30T16:56:45.652045+0000","last_peered":"2024-05-30T16:56:45.652045+0000","last_clean":"2024-05-30T16:56:45.652045+0000","last_became_active":"2024-05-30T16:56:43.648569+0000","last_became_peered":"2024-05-30T16:56:43.648569+0000","last_unstale":"2024-05-30T16:56:45.652045+0000","last_undegraded":"2024-05-30T16:56:45.652045+0000","last_fullsized":"2024-05-30T16:56:45.652045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:43.464267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548587+0000","last_change":"2024-05-30T16:56:44.662124+0000","last_active":"2024-05-30T16:56:46.548587+0000","last_peered":"2024-05-30T16:56:46.548587+0000","last_clean":"2024-05-30T16:56:46.548587+0000","last_became_active":"2024-05-30T16:56:44.661807+0000","last_became_peered":"2024-05-30T16:56:44.661807+0000","last_unstale":"2024-05-30T16:56:46.548587+0000","last_undegraded":"2024-05-30T16:56:46.548587+0000","last_fullsized":"2024-05-30T16:56:46.548587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:05.799103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651904+0000","last_change":"2024-05-30T16:56:44.653977+0000","last_active":"2024-05-30T16:56:45.651904+0000","last_peered":"2024-05-30T16:56:45.651904+0000","last_clean":"2024-05-30T16:56:45.651904+0000","last_became_active":"2024-05-30T16:56:44.653708+0000","last_became_peered":"2024-05-30T16:56:44.653708+0000","last_unstale":"2024-05-30T16:56:45.651904+0000","last_undegraded":"2024-05-30T16:56:45.651904+0000","last_fullsized":"2024-05-30T16:56:45.651904+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:13:35.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651897+0000","last_change":"2024-05-30T16:56:43.645417+0000","last_active":"2024-05-30T16:56:45.651897+0000","last_peered":"2024-05-30T16:56:45.651897+0000","last_clean":"2024-05-30T16:56:45.651897+0000","last_became_active":"2024-05-30T16:56:43.645163+0000","last_became_peered":"2024-05-30T16:56:43.645163+0000","last_unstale":"2024-05-30T16:56:45.651897+0000","last_undegraded":"2024-05-30T16:56:45.651897+0000","last_fullsized":"2024-05-30T16:56:45.651897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:24.915924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659176+0000","last_change":"2024-05-30T16:56:44.648063+0000","last_active":"2024-05-30T16:56:44.659176+0000","last_peered":"2024-05-30T16:56:44.659176+0000","last_clean":"2024-05-30T16:56:44.659176+0000","last_became_active":"2024-05-30T16:56:44.645752+0000","last_became_peered":"2024-05-30T16:56:44.645752+0000","last_unstale":"2024-05-30T16:56:44.659176+0000","last_undegraded":"2024-05-30T16:56:44.659176+0000","last_fullsized":"2024-05-30T16:56:44.659176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:48.843356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":271,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548075+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:56:46.548075+0000","last_peered":"2024-05-30T16:56:46.548075+0000","last_clean":"2024-05-30T16:56:46.548075+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:56:46.548075+0000","last_undegraded":"2024-05-30T16:56:46.548075+0000","last_fullsized":"2024-05-30T16:56:46.548075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":14,"acting":14,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54860,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316980,"statfs":{"total":96636764160,"available":96580587520,"internally_reserved":0,"allocated":1507328,"data_stored":974184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54224,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":856064,"data_stored":357697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50064,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321776,"statfs":{"total":96636764160,"available":96585498624,"internally_reserved":0,"allocated":856064,"data_stored":357697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54236,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317604,"statfs":{"total":96636764160,"available":96581226496,"internally_reserved":0,"allocated":856064,"data_stored":357697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509538,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50124,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321716,"statfs":{"total":96636764160,"available":96585437184,"internally_reserved":0,"allocated":917504,"data_stored":384812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54224,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":856064,"data_stored":357697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54812,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317028,"statfs":{"total":96636764160,"available":96580636672,"internally_reserved":0,"allocated":1449984,"data_stored":948065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542242,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58436,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313404,"statfs":{"total":96636764160,"available":96576925696,"internally_reserved":0,"allocated":901120,"data_stored":376928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:56:48.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:56:48.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.954+0000 7f24fc800640 1 Processor -- start 2024-05-30T16:56:48.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.954+0000 7f24fc800640 1 -- start start 2024-05-30T16:56:48.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24fc800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24f406e900 0x7f24f415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24fc800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24f40d0560 0x7f24f40d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24fc800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f415f060 con 0x7f24f40af720 2024-05-30T16:56:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24fc800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f24f40afb00 con 0x7f24f40d0560 2024-05-30T16:56:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24fc800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f24f415c270 con 0x7f24f406e900 2024-05-30T16:56:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24f9e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f24f40af720 0x7f24f415b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58986/0 (socket says 172.21.15.59:58986) 2024-05-30T16:56:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24f9e00640 1 -- 172.21.15.59:0/2126211946 learned_addr learned my addr 172.21.15.59:0/2126211946 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24fa800640 1 --2- 172.21.15.59:0/2126211946 >> v2:172.21.15.59:3300/0 conn(0x7f24f40d0560 0x7f24f40d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24f9400640 1 --2- 172.21.15.59:0/2126211946 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24f406e900 0x7f24f415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24fa800640 1 -- 172.21.15.59:0/2126211946 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24f406e900 msgr2=0x7f24f415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24fa800640 1 --2- 172.21.15.59:0/2126211946 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24f406e900 0x7f24f415f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24fa800640 1 -- 172.21.15.59:0/2126211946 >> v1:172.21.15.59:6789/0 conn(0x7f24f40af720 legacy=0x7f24f415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24f8a00640 1 -- 172.21.15.59:0/2126211946 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51714115 0 0) 0x7f24f415f060 con 0x7f24f40af720 2024-05-30T16:56:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.958+0000 7f24fa800640 1 -- 172.21.15.59:0/2126211946 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f415c550 con 0x7f24f40d0560 2024-05-30T16:56:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24fa800640 1 --2- 172.21.15.59:0/2126211946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f40d0560 0x7f24f40d0a10 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009d90 tx=0x7f24f001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879833b89478b376 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24f8a00640 1 -- 172.21.15.59:0/2126211946 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f00b2070 con 0x7f24f40d0560 2024-05-30T16:56:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24f8a00640 1 -- 172.21.15.59:0/2126211946 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f00a5880 con 0x7f24f40d0560 2024-05-30T16:56:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24f8a00640 1 -- 172.21.15.59:0/2126211946 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f00a5c50 con 0x7f24f40d0560 2024-05-30T16:56:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24fc800640 1 -- 172.21.15.59:0/2126211946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f40d0560 msgr2=0x7f24f40d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24fc800640 1 --2- 172.21.15.59:0/2126211946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f40d0560 0x7f24f40d0a10 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009d90 tx=0x7f24f001c970 comp rx=0 tx=0).stop 2024-05-30T16:56:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24fc800640 1 -- 172.21.15.59:0/2126211946 shutdown_connections 2024-05-30T16:56:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24fc800640 1 --2- 172.21.15.59:0/2126211946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f40d0560 0x7f24f40d0a10 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24fc800640 1 --2- 172.21.15.59:0/2126211946 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24f406e900 0x7f24f415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24fc800640 1 -- 172.21.15.59:0/2126211946 >> 172.21.15.59:0/2126211946 conn(0x7f24f40b22d0 msgr2=0x7f24f40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24fc800640 1 -- 172.21.15.59:0/2126211946 shutdown_connections 2024-05-30T16:56:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24fc800640 1 -- 172.21.15.59:0/2126211946 wait complete. 2024-05-30T16:56:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24fc800640 1 Processor -- start 2024-05-30T16:56:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.962+0000 7f24fc800640 1 -- start start 2024-05-30T16:56:48.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24fc800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f406e900 0x7f24f406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24fc800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24f40af720 0x7f24f406bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24fc800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24f40d0560 0x7f24f4158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24fc800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24f4073150 con 0x7f24f406e900 2024-05-30T16:56:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24fc800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f24f40732d0 con 0x7f24f40af720 2024-05-30T16:56:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24fc800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f24f41585c0 con 0x7f24f40d0560 2024-05-30T16:56:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24f9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f406e900 0x7f24f406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24f9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f406e900 0x7f24f406b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59198/0 (socket says 172.21.15.59:59198) 2024-05-30T16:56:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24f9e00640 1 -- 172.21.15.59:0/2250447 learned_addr learned my addr 172.21.15.59:0/2250447 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24fa800640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24f40d0560 0x7f24f4158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24f9400640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24f40af720 0x7f24f406bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24f9e00640 1 -- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24f40d0560 msgr2=0x7f24f4158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24f9e00640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24f40d0560 0x7f24f4158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24f9e00640 1 -- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24f40af720 msgr2=0x7f24f406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24f9e00640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24f40af720 0x7f24f406bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24f9e00640 1 -- 172.21.15.59:0/2250447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f41f7310 con 0x7f24f406e900 2024-05-30T16:56:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24fa800640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24f40d0560 0x7f24f4158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24f9400640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24f40af720 0x7f24f406bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24f9e00640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f406e900 0x7f24f406b9b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f24e80011f0 tx=0x7f24e800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24ee000640 1 -- 172.21.15.59:0/2250447 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e8018070 con 0x7f24f406e900 2024-05-30T16:56:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24ee000640 1 -- 172.21.15.59:0/2250447 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e80074e0 con 0x7f24f406e900 2024-05-30T16:56:48.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24fc800640 1 -- 172.21.15.59:0/2250447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f41f75f0 con 0x7f24f406e900 2024-05-30T16:56:48.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24ee000640 1 -- 172.21.15.59:0/2250447 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e8004a10 con 0x7f24f406e900 2024-05-30T16:56:48.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24fc800640 1 -- 172.21.15.59:0/2250447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f41f7bb0 con 0x7f24f406e900 2024-05-30T16:56:48.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24fc800640 1 -- 172.21.15.59:0/2250447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f4068a90 con 0x7f24f406e900 2024-05-30T16:56:48.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.966+0000 7f24ee000640 1 -- 172.21.15.59:0/2250447 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f24e801b070 con 0x7f24f406e900 2024-05-30T16:56:48.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.970+0000 7f24ee000640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f24d8069070 0x7f24d806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:48.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.970+0000 7f24ee000640 1 -- 172.21.15.59:0/2250447 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f24e8084780 con 0x7f24f406e900 2024-05-30T16:56:48.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.970+0000 7f24f9400640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f24d8069070 0x7f24d806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:48.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.970+0000 7f24f9400640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f24d8069070 0x7f24d806b530 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f24f4158590 tx=0x7f24e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:48.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:48.974+0000 7f24ee000640 1 -- 172.21.15.59:0/2250447 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f24e8056790 con 0x7f24f406e900 2024-05-30T16:56:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.138+0000 7f24fc800640 1 -- 172.21.15.59:0/2250447 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24f41f70c0 con 0x7f24d8069070 2024-05-30T16:56:49.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24ee000640 1 -- 172.21.15.59:0/2250447 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242706 (secure 0 0 0) 0x7f24f41f70c0 con 0x7f24d8069070 2024-05-30T16:56:49.150 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:49.152 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:56:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24fc800640 1 -- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f24d8069070 msgr2=0x7f24d806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24fc800640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f24d8069070 0x7f24d806b530 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f24f4158590 tx=0x7f24e4008040 comp rx=0 tx=0).stop 2024-05-30T16:56:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24fc800640 1 -- 172.21.15.59:0/2250447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f406e900 msgr2=0x7f24f406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24fc800640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f406e900 0x7f24f406b9b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f24e80011f0 tx=0x7f24e800c9b0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24fc800640 1 -- 172.21.15.59:0/2250447 shutdown_connections 2024-05-30T16:56:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24fc800640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f24d8069070 0x7f24d806b530 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24fc800640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24f40d0560 0x7f24f4158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24fc800640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24f40af720 0x7f24f406bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24fc800640 1 --2- 172.21.15.59:0/2250447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f406e900 0x7f24f406b9b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24fc800640 1 -- 172.21.15.59:0/2250447 >> 172.21.15.59:0/2250447 conn(0x7f24f40b22d0 msgr2=0x7f24f4073660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:49.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24fc800640 1 -- 172.21.15.59:0/2250447 shutdown_connections 2024-05-30T16:56:49.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.146+0000 7f24fc800640 1 -- 172.21.15.59:0/2250447 wait complete. 2024-05-30T16:56:49.170 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-05-30T16:56:47.210040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591040,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":430980,"kb_used_data":8008,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754543740,"statfs":{"total":773094113280,"available":772652789760,"internally_reserved":0,"allocated":8200192,"data_stored":4114777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.590411"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548612+0000","last_change":"2024-05-30T16:56:44.668865+0000","last_active":"2024-05-30T16:56:46.548612+0000","last_peered":"2024-05-30T16:56:46.548612+0000","last_clean":"2024-05-30T16:56:46.548612+0000","last_became_active":"2024-05-30T16:56:44.668040+0000","last_became_peered":"2024-05-30T16:56:44.668040+0000","last_unstale":"2024-05-30T16:56:46.548612+0000","last_undegraded":"2024-05-30T16:56:46.548612+0000","last_fullsized":"2024-05-30T16:56:46.548612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:56.908682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.661199+0000","last_change":"2024-05-30T16:56:44.649217+0000","last_active":"2024-05-30T16:56:44.661199+0000","last_peered":"2024-05-30T16:56:44.661199+0000","last_clean":"2024-05-30T16:56:44.661199+0000","last_became_active":"2024-05-30T16:56:44.648928+0000","last_became_peered":"2024-05-30T16:56:44.648928+0000","last_unstale":"2024-05-30T16:56:44.661199+0000","last_undegraded":"2024-05-30T16:56:44.661199+0000","last_fullsized":"2024-05-30T16:56:44.661199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:00:34.724863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651793+0000","last_change":"2024-05-30T16:56:44.662425+0000","last_active":"2024-05-30T16:56:45.651793+0000","last_peered":"2024-05-30T16:56:45.651793+0000","last_clean":"2024-05-30T16:56:45.651793+0000","last_became_active":"2024-05-30T16:56:44.662074+0000","last_became_peered":"2024-05-30T16:56:44.662074+0000","last_unstale":"2024-05-30T16:56:45.651793+0000","last_undegraded":"2024-05-30T16:56:45.651793+0000","last_fullsized":"2024-05-30T16:56:45.651793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:50.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652160+0000","last_change":"2024-05-30T16:56:44.652304+0000","last_active":"2024-05-30T16:56:45.652160+0000","last_peered":"2024-05-30T16:56:45.652160+0000","last_clean":"2024-05-30T16:56:45.652160+0000","last_became_active":"2024-05-30T16:56:44.651824+0000","last_became_peered":"2024-05-30T16:56:44.651824+0000","last_unstale":"2024-05-30T16:56:45.652160+0000","last_undegraded":"2024-05-30T16:56:45.652160+0000","last_fullsized":"2024-05-30T16:56:45.652160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:53.257788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548464+0000","last_change":"2024-05-30T16:56:44.663730+0000","last_active":"2024-05-30T16:56:46.548464+0000","last_peered":"2024-05-30T16:56:46.548464+0000","last_clean":"2024-05-30T16:56:46.548464+0000","last_became_active":"2024-05-30T16:56:44.663105+0000","last_became_peered":"2024-05-30T16:56:44.663105+0000","last_unstale":"2024-05-30T16:56:46.548464+0000","last_undegraded":"2024-05-30T16:56:46.548464+0000","last_fullsized":"2024-05-30T16:56:46.548464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:08:06.277998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651812+0000","last_change":"2024-05-30T16:56:44.658635+0000","last_active":"2024-05-30T16:56:45.651812+0000","last_peered":"2024-05-30T16:56:45.651812+0000","last_clean":"2024-05-30T16:56:45.651812+0000","last_became_active":"2024-05-30T16:56:44.658374+0000","last_became_peered":"2024-05-30T16:56:44.658374+0000","last_unstale":"2024-05-30T16:56:45.651812+0000","last_undegraded":"2024-05-30T16:56:45.651812+0000","last_fullsized":"2024-05-30T16:56:45.651812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:03:27.939224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652173+0000","last_change":"2024-05-30T16:56:44.649373+0000","last_active":"2024-05-30T16:56:45.652173+0000","last_peered":"2024-05-30T16:56:45.652173+0000","last_clean":"2024-05-30T16:56:45.652173+0000","last_became_active":"2024-05-30T16:56:44.649085+0000","last_became_peered":"2024-05-30T16:56:44.649085+0000","last_unstale":"2024-05-30T16:56:45.652173+0000","last_undegraded":"2024-05-30T16:56:45.652173+0000","last_fullsized":"2024-05-30T16:56:45.652173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:38.575100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548147+0000","last_change":"2024-05-30T16:56:44.662385+0000","last_active":"2024-05-30T16:56:46.548147+0000","last_peered":"2024-05-30T16:56:46.548147+0000","last_clean":"2024-05-30T16:56:46.548147+0000","last_became_active":"2024-05-30T16:56:44.662083+0000","last_became_peered":"2024-05-30T16:56:44.662083+0000","last_unstale":"2024-05-30T16:56:46.548147+0000","last_undegraded":"2024-05-30T16:56:46.548147+0000","last_fullsized":"2024-05-30T16:56:46.548147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:16:01.303332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548254+0000","last_change":"2024-05-30T16:56:44.670256+0000","last_active":"2024-05-30T16:56:46.548254+0000","last_peered":"2024-05-30T16:56:46.548254+0000","last_clean":"2024-05-30T16:56:46.548254+0000","last_became_active":"2024-05-30T16:56:44.669963+0000","last_became_peered":"2024-05-30T16:56:44.669963+0000","last_unstale":"2024-05-30T16:56:46.548254+0000","last_undegraded":"2024-05-30T16:56:46.548254+0000","last_fullsized":"2024-05-30T16:56:46.548254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:01:10.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.661222+0000","last_change":"2024-05-30T16:56:44.651182+0000","last_active":"2024-05-30T16:56:44.661222+0000","last_peered":"2024-05-30T16:56:44.661222+0000","last_clean":"2024-05-30T16:56:44.661222+0000","last_became_active":"2024-05-30T16:56:44.650908+0000","last_became_peered":"2024-05-30T16:56:44.650908+0000","last_unstale":"2024-05-30T16:56:44.661222+0000","last_undegraded":"2024-05-30T16:56:44.661222+0000","last_fullsized":"2024-05-30T16:56:44.661222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:49:02.259652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659298+0000","last_change":"2024-05-30T16:56:44.650936+0000","last_active":"2024-05-30T16:56:44.659298+0000","last_peered":"2024-05-30T16:56:44.659298+0000","last_clean":"2024-05-30T16:56:44.659298+0000","last_became_active":"2024-05-30T16:56:44.650397+0000","last_became_peered":"2024-05-30T16:56:44.650397+0000","last_unstale":"2024-05-30T16:56:44.659298+0000","last_undegraded":"2024-05-30T16:56:44.659298+0000","last_fullsized":"2024-05-30T16:56:44.659298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:52.457119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548620+0000","last_change":"2024-05-30T16:56:44.669763+0000","last_active":"2024-05-30T16:56:46.548620+0000","last_peered":"2024-05-30T16:56:46.548620+0000","last_clean":"2024-05-30T16:56:46.548620+0000","last_became_active":"2024-05-30T16:56:44.669357+0000","last_became_peered":"2024-05-30T16:56:44.669357+0000","last_unstale":"2024-05-30T16:56:46.548620+0000","last_undegraded":"2024-05-30T16:56:46.548620+0000","last_fullsized":"2024-05-30T16:56:46.548620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:03.908739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548770+0000","last_change":"2024-05-30T16:56:43.652722+0000","last_active":"2024-05-30T16:56:46.548770+0000","last_peered":"2024-05-30T16:56:46.548770+0000","last_clean":"2024-05-30T16:56:46.548770+0000","last_became_active":"2024-05-30T16:56:43.652368+0000","last_became_peered":"2024-05-30T16:56:43.652368+0000","last_unstale":"2024-05-30T16:56:46.548770+0000","last_undegraded":"2024-05-30T16:56:46.548770+0000","last_fullsized":"2024-05-30T16:56:46.548770+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:41:02.005724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652233+0000","last_change":"2024-05-30T16:56:44.652087+0000","last_active":"2024-05-30T16:56:45.652233+0000","last_peered":"2024-05-30T16:56:45.652233+0000","last_clean":"2024-05-30T16:56:45.652233+0000","last_became_active":"2024-05-30T16:56:44.651426+0000","last_became_peered":"2024-05-30T16:56:44.651426+0000","last_unstale":"2024-05-30T16:56:45.652233+0000","last_undegraded":"2024-05-30T16:56:45.652233+0000","last_fullsized":"2024-05-30T16:56:45.652233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:56.981440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548563+0000","last_change":"2024-05-30T16:56:44.665209+0000","last_active":"2024-05-30T16:56:46.548563+0000","last_peered":"2024-05-30T16:56:46.548563+0000","last_clean":"2024-05-30T16:56:46.548563+0000","last_became_active":"2024-05-30T16:56:44.664880+0000","last_became_peered":"2024-05-30T16:56:44.664880+0000","last_unstale":"2024-05-30T16:56:46.548563+0000","last_undegraded":"2024-05-30T16:56:46.548563+0000","last_fullsized":"2024-05-30T16:56:46.548563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:30.146195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.662926+0000","last_change":"2024-05-30T16:56:43.650135+0000","last_active":"2024-05-30T16:56:44.662926+0000","last_peered":"2024-05-30T16:56:44.662926+0000","last_clean":"2024-05-30T16:56:44.662926+0000","last_became_active":"2024-05-30T16:56:43.649731+0000","last_became_peered":"2024-05-30T16:56:43.649731+0000","last_unstale":"2024-05-30T16:56:44.662926+0000","last_undegraded":"2024-05-30T16:56:44.662926+0000","last_fullsized":"2024-05-30T16:56:44.662926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:05:58.221402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650764+0000","last_change":"2024-05-30T16:56:44.655108+0000","last_active":"2024-05-30T16:56:45.650764+0000","last_peered":"2024-05-30T16:56:45.650764+0000","last_clean":"2024-05-30T16:56:45.650764+0000","last_became_active":"2024-05-30T16:56:44.654831+0000","last_became_peered":"2024-05-30T16:56:44.654831+0000","last_unstale":"2024-05-30T16:56:45.650764+0000","last_undegraded":"2024-05-30T16:56:45.650764+0000","last_fullsized":"2024-05-30T16:56:45.650764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:13:38.307444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650776+0000","last_change":"2024-05-30T16:56:43.641994+0000","last_active":"2024-05-30T16:56:45.650776+0000","last_peered":"2024-05-30T16:56:45.650776+0000","last_clean":"2024-05-30T16:56:45.650776+0000","last_became_active":"2024-05-30T16:56:43.641712+0000","last_became_peered":"2024-05-30T16:56:43.641712+0000","last_unstale":"2024-05-30T16:56:45.650776+0000","last_undegraded":"2024-05-30T16:56:45.650776+0000","last_fullsized":"2024-05-30T16:56:45.650776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:08:06.965045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548707+0000","last_change":"2024-05-30T16:56:44.671239+0000","last_active":"2024-05-30T16:56:46.548707+0000","last_peered":"2024-05-30T16:56:46.548707+0000","last_clean":"2024-05-30T16:56:46.548707+0000","last_became_active":"2024-05-30T16:56:44.670215+0000","last_became_peered":"2024-05-30T16:56:44.670215+0000","last_unstale":"2024-05-30T16:56:46.548707+0000","last_undegraded":"2024-05-30T16:56:46.548707+0000","last_fullsized":"2024-05-30T16:56:46.548707+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:50.550356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.667305+0000","last_change":"2024-05-30T16:56:43.648080+0000","last_active":"2024-05-30T16:56:44.667305+0000","last_peered":"2024-05-30T16:56:44.667305+0000","last_clean":"2024-05-30T16:56:44.667305+0000","last_became_active":"2024-05-30T16:56:43.647224+0000","last_became_peered":"2024-05-30T16:56:43.647224+0000","last_unstale":"2024-05-30T16:56:44.667305+0000","last_undegraded":"2024-05-30T16:56:44.667305+0000","last_fullsized":"2024-05-30T16:56:44.667305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:24:13.264974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651928+0000","last_change":"2024-05-30T16:56:44.650308+0000","last_active":"2024-05-30T16:56:45.651928+0000","last_peered":"2024-05-30T16:56:45.651928+0000","last_clean":"2024-05-30T16:56:45.651928+0000","last_became_active":"2024-05-30T16:56:44.649980+0000","last_became_peered":"2024-05-30T16:56:44.649980+0000","last_unstale":"2024-05-30T16:56:45.651928+0000","last_undegraded":"2024-05-30T16:56:45.651928+0000","last_fullsized":"2024-05-30T16:56:45.651928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:45:58.041826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548319+0000","last_change":"2024-05-30T16:56:44.666817+0000","last_active":"2024-05-30T16:56:46.548319+0000","last_peered":"2024-05-30T16:56:46.548319+0000","last_clean":"2024-05-30T16:56:46.548319+0000","last_became_active":"2024-05-30T16:56:44.666556+0000","last_became_peered":"2024-05-30T16:56:44.666556+0000","last_unstale":"2024-05-30T16:56:46.548319+0000","last_undegraded":"2024-05-30T16:56:46.548319+0000","last_fullsized":"2024-05-30T16:56:46.548319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:25:09.747489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651353+0000","last_change":"2024-05-30T16:56:44.652605+0000","last_active":"2024-05-30T16:56:45.651353+0000","last_peered":"2024-05-30T16:56:45.651353+0000","last_clean":"2024-05-30T16:56:45.651353+0000","last_became_active":"2024-05-30T16:56:44.650499+0000","last_became_peered":"2024-05-30T16:56:44.650499+0000","last_unstale":"2024-05-30T16:56:45.651353+0000","last_undegraded":"2024-05-30T16:56:45.651353+0000","last_fullsized":"2024-05-30T16:56:45.651353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:31.289587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548789+0000","last_change":"2024-05-30T16:56:44.666380+0000","last_active":"2024-05-30T16:56:46.548789+0000","last_peered":"2024-05-30T16:56:46.548789+0000","last_clean":"2024-05-30T16:56:46.548789+0000","last_became_active":"2024-05-30T16:56:44.665935+0000","last_became_peered":"2024-05-30T16:56:44.665935+0000","last_unstale":"2024-05-30T16:56:46.548789+0000","last_undegraded":"2024-05-30T16:56:46.548789+0000","last_fullsized":"2024-05-30T16:56:46.548789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:15.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652099+0000","last_change":"2024-05-30T16:56:44.654757+0000","last_active":"2024-05-30T16:56:45.652099+0000","last_peered":"2024-05-30T16:56:45.652099+0000","last_clean":"2024-05-30T16:56:45.652099+0000","last_became_active":"2024-05-30T16:56:44.654467+0000","last_became_peered":"2024-05-30T16:56:44.654467+0000","last_unstale":"2024-05-30T16:56:45.652099+0000","last_undegraded":"2024-05-30T16:56:45.652099+0000","last_fullsized":"2024-05-30T16:56:45.652099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:09.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548368+0000","last_change":"2024-05-30T16:56:43.651621+0000","last_active":"2024-05-30T16:56:46.548368+0000","last_peered":"2024-05-30T16:56:46.548368+0000","last_clean":"2024-05-30T16:56:46.548368+0000","last_became_active":"2024-05-30T16:56:43.651020+0000","last_became_peered":"2024-05-30T16:56:43.651020+0000","last_unstale":"2024-05-30T16:56:46.548368+0000","last_undegraded":"2024-05-30T16:56:46.548368+0000","last_fullsized":"2024-05-30T16:56:46.548368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:32:07.975415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659275+0000","last_change":"2024-05-30T16:56:44.650720+0000","last_active":"2024-05-30T16:56:44.659275+0000","last_peered":"2024-05-30T16:56:44.659275+0000","last_clean":"2024-05-30T16:56:44.659275+0000","last_became_active":"2024-05-30T16:56:44.649933+0000","last_became_peered":"2024-05-30T16:56:44.649933+0000","last_unstale":"2024-05-30T16:56:44.659275+0000","last_undegraded":"2024-05-30T16:56:44.659275+0000","last_fullsized":"2024-05-30T16:56:44.659275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:24:16.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659097+0000","last_change":"2024-05-30T16:56:44.646838+0000","last_active":"2024-05-30T16:56:44.659097+0000","last_peered":"2024-05-30T16:56:44.659097+0000","last_clean":"2024-05-30T16:56:44.659097+0000","last_became_active":"2024-05-30T16:56:44.646587+0000","last_became_peered":"2024-05-30T16:56:44.646587+0000","last_unstale":"2024-05-30T16:56:44.659097+0000","last_undegraded":"2024-05-30T16:56:44.659097+0000","last_fullsized":"2024-05-30T16:56:44.659097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:30.610228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.658847+0000","last_change":"2024-05-30T16:56:44.646527+0000","last_active":"2024-05-30T16:56:44.658847+0000","last_peered":"2024-05-30T16:56:44.658847+0000","last_clean":"2024-05-30T16:56:44.658847+0000","last_became_active":"2024-05-30T16:56:44.646233+0000","last_became_peered":"2024-05-30T16:56:44.646233+0000","last_unstale":"2024-05-30T16:56:44.658847+0000","last_undegraded":"2024-05-30T16:56:44.658847+0000","last_fullsized":"2024-05-30T16:56:44.658847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:51:47.821639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548416+0000","last_change":"2024-05-30T16:56:44.669877+0000","last_active":"2024-05-30T16:56:46.548416+0000","last_peered":"2024-05-30T16:56:46.548416+0000","last_clean":"2024-05-30T16:56:46.548416+0000","last_became_active":"2024-05-30T16:56:44.669562+0000","last_became_peered":"2024-05-30T16:56:44.669562+0000","last_unstale":"2024-05-30T16:56:46.548416+0000","last_undegraded":"2024-05-30T16:56:46.548416+0000","last_fullsized":"2024-05-30T16:56:46.548416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:59:28.731114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652045+0000","last_change":"2024-05-30T16:56:43.648834+0000","last_active":"2024-05-30T16:56:45.652045+0000","last_peered":"2024-05-30T16:56:45.652045+0000","last_clean":"2024-05-30T16:56:45.652045+0000","last_became_active":"2024-05-30T16:56:43.648569+0000","last_became_peered":"2024-05-30T16:56:43.648569+0000","last_unstale":"2024-05-30T16:56:45.652045+0000","last_undegraded":"2024-05-30T16:56:45.652045+0000","last_fullsized":"2024-05-30T16:56:45.652045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:43.464267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548587+0000","last_change":"2024-05-30T16:56:44.662124+0000","last_active":"2024-05-30T16:56:46.548587+0000","last_peered":"2024-05-30T16:56:46.548587+0000","last_clean":"2024-05-30T16:56:46.548587+0000","last_became_active":"2024-05-30T16:56:44.661807+0000","last_became_peered":"2024-05-30T16:56:44.661807+0000","last_unstale":"2024-05-30T16:56:46.548587+0000","last_undegraded":"2024-05-30T16:56:46.548587+0000","last_fullsized":"2024-05-30T16:56:46.548587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:05.799103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651904+0000","last_change":"2024-05-30T16:56:44.653977+0000","last_active":"2024-05-30T16:56:45.651904+0000","last_peered":"2024-05-30T16:56:45.651904+0000","last_clean":"2024-05-30T16:56:45.651904+0000","last_became_active":"2024-05-30T16:56:44.653708+0000","last_became_peered":"2024-05-30T16:56:44.653708+0000","last_unstale":"2024-05-30T16:56:45.651904+0000","last_undegraded":"2024-05-30T16:56:45.651904+0000","last_fullsized":"2024-05-30T16:56:45.651904+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:13:35.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651897+0000","last_change":"2024-05-30T16:56:43.645417+0000","last_active":"2024-05-30T16:56:45.651897+0000","last_peered":"2024-05-30T16:56:45.651897+0000","last_clean":"2024-05-30T16:56:45.651897+0000","last_became_active":"2024-05-30T16:56:43.645163+0000","last_became_peered":"2024-05-30T16:56:43.645163+0000","last_unstale":"2024-05-30T16:56:45.651897+0000","last_undegraded":"2024-05-30T16:56:45.651897+0000","last_fullsized":"2024-05-30T16:56:45.651897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:24.915924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:43.617601+0000","last_change":"2024-05-30T16:56:43.617601+0000","last_active":"2024-05-30T16:56:43.617601+0000","last_peered":"2024-05-30T16:56:43.617601+0000","last_clean":"2024-05-30T16:56:43.617601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:43.617601+0000","last_undegraded":"2024-05-30T16:56:43.617601+0000","last_fullsized":"2024-05-30T16:56:43.617601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659176+0000","last_change":"2024-05-30T16:56:44.648063+0000","last_active":"2024-05-30T16:56:44.659176+0000","last_peered":"2024-05-30T16:56:44.659176+0000","last_clean":"2024-05-30T16:56:44.659176+0000","last_became_active":"2024-05-30T16:56:44.645752+0000","last_became_peered":"2024-05-30T16:56:44.645752+0000","last_unstale":"2024-05-30T16:56:44.659176+0000","last_undegraded":"2024-05-30T16:56:44.659176+0000","last_fullsized":"2024-05-30T16:56:44.659176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:48.843356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T16:56:42.614146+0000","last_change":"2024-05-30T16:56:42.614146+0000","last_active":"2024-05-30T16:56:42.614146+0000","last_peered":"2024-05-30T16:56:42.614146+0000","last_clean":"2024-05-30T16:56:42.614146+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:56:42.614146+0000","last_undegraded":"2024-05-30T16:56:42.614146+0000","last_fullsized":"2024-05-30T16:56:42.614146+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":271,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548075+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:56:46.548075+0000","last_peered":"2024-05-30T16:56:46.548075+0000","last_clean":"2024-05-30T16:56:46.548075+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:56:46.548075+0000","last_undegraded":"2024-05-30T16:56:46.548075+0000","last_fullsized":"2024-05-30T16:56:46.548075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":14,"acting":14,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54860,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316980,"statfs":{"total":96636764160,"available":96580587520,"internally_reserved":0,"allocated":1507328,"data_stored":974184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54224,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":856064,"data_stored":357697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50064,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321776,"statfs":{"total":96636764160,"available":96585498624,"internally_reserved":0,"allocated":856064,"data_stored":357697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54236,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317604,"statfs":{"total":96636764160,"available":96581226496,"internally_reserved":0,"allocated":856064,"data_stored":357697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509538,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50124,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321716,"statfs":{"total":96636764160,"available":96585437184,"internally_reserved":0,"allocated":917504,"data_stored":384812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54224,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":856064,"data_stored":357697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54812,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317028,"statfs":{"total":96636764160,"available":96580636672,"internally_reserved":0,"allocated":1449984,"data_stored":948065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542242,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58436,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313404,"statfs":{"total":96636764160,"available":96576925696,"internally_reserved":0,"allocated":901120,"data_stored":376928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:56:49.174 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:56:49.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce25e00640 1 Processor -- start 2024-05-30T16:56:49.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce25e00640 1 -- start start 2024-05-30T16:56:49.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce25e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce200ce420 0x7fce200b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:49.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce25e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce2006d600 0x7fce200d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:49.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce25e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce200ce800 con 0x7fce200b39b0 2024-05-30T16:56:49.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce25e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fce200cc9c0 con 0x7fce2006d600 2024-05-30T16:56:49.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce25e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fce2009b450 con 0x7fce200ce420 2024-05-30T16:56:49.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce25400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce2006d600 0x7fce200d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:49.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce17e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fce200b39b0 0x7fce2006cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58988/0 (socket says 172.21.15.59:58988) 2024-05-30T16:56:49.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce17e00640 1 -- 172.21.15.59:0/2514653829 learned_addr learned my addr 172.21.15.59:0/2514653829 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:49.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce24a00640 1 --2- 172.21.15.59:0/2514653829 >> v2:172.21.15.107:3300/0 conn(0x7fce200ce420 0x7fce200b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:49.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce25400640 1 -- 172.21.15.59:0/2514653829 >> v2:172.21.15.107:3300/0 conn(0x7fce200ce420 msgr2=0x7fce200b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:49.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce25400640 1 --2- 172.21.15.59:0/2514653829 >> v2:172.21.15.107:3300/0 conn(0x7fce200ce420 0x7fce200b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce25400640 1 -- 172.21.15.59:0/2514653829 >> v1:172.21.15.59:6789/0 conn(0x7fce200b39b0 legacy=0x7fce2006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:49.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce25400640 1 -- 172.21.15.59:0/2514653829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2009b730 con 0x7fce2006d600 2024-05-30T16:56:49.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.354+0000 7fce24a00640 1 --2- 172.21.15.59:0/2514653829 >> v2:172.21.15.107:3300/0 conn(0x7fce200ce420 0x7fce200b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce25400640 1 --2- 172.21.15.59:0/2514653829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce2006d600 0x7fce200d0990 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fce2006c990 tx=0x7fce1801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992dde06bfe4fde server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce1fe00640 1 -- 172.21.15.59:0/2514653829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce180b2070 con 0x7fce2006d600 2024-05-30T16:56:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce1fe00640 1 -- 172.21.15.59:0/2514653829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce180a58e0 con 0x7fce2006d600 2024-05-30T16:56:49.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce1fe00640 1 -- 172.21.15.59:0/2514653829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce180a5cb0 con 0x7fce2006d600 2024-05-30T16:56:49.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce25e00640 1 -- 172.21.15.59:0/2514653829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce2006d600 msgr2=0x7fce200d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:49.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce25e00640 1 --2- 172.21.15.59:0/2514653829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce2006d600 0x7fce200d0990 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fce2006c990 tx=0x7fce1801c930 comp rx=0 tx=0).stop 2024-05-30T16:56:49.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce25e00640 1 -- 172.21.15.59:0/2514653829 shutdown_connections 2024-05-30T16:56:49.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce25e00640 1 --2- 172.21.15.59:0/2514653829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce2006d600 0x7fce200d0990 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce25e00640 1 --2- 172.21.15.59:0/2514653829 >> v2:172.21.15.107:3300/0 conn(0x7fce200ce420 0x7fce200b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce25e00640 1 -- 172.21.15.59:0/2514653829 >> 172.21.15.59:0/2514653829 conn(0x7fce200d2370 msgr2=0x7fce200d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:49.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce25e00640 1 -- 172.21.15.59:0/2514653829 shutdown_connections 2024-05-30T16:56:49.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce25e00640 1 -- 172.21.15.59:0/2514653829 wait complete. 2024-05-30T16:56:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.358+0000 7fce25e00640 1 Processor -- start 2024-05-30T16:56:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25e00640 1 -- start start 2024-05-30T16:56:49.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce2006d600 0x7fce20152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:49.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce200b39b0 0x7fce200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce200ce420 0x7fce20156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fce200d1860 con 0x7fce200ce420 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fce200d16e0 con 0x7fce200b39b0 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fce200d19e0 con 0x7fce2006d600 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce200ce420 0x7fce20156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce200ce420 0x7fce20156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59214/0 (socket says 172.21.15.59:59214) 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25400640 1 -- 172.21.15.59:0/818796295 learned_addr learned my addr 172.21.15.59:0/818796295 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce17e00640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce200b39b0 0x7fce200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce24a00640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce2006d600 0x7fce20152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25400640 1 -- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce2006d600 msgr2=0x7fce20152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25400640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce2006d600 0x7fce20152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25400640 1 -- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce200b39b0 msgr2=0x7fce200709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25400640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce200b39b0 0x7fce200709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25400640 1 -- 172.21.15.59:0/818796295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce20071430 con 0x7fce200ce420 2024-05-30T16:56:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25400640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce200ce420 0x7fce20156950 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fce180b0040 tx=0x7fce180196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce1d600640 1 -- 172.21.15.59:0/818796295 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce180b2050 con 0x7fce200ce420 2024-05-30T16:56:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce1d600640 1 -- 172.21.15.59:0/818796295 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce180be070 con 0x7fce200ce420 2024-05-30T16:56:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce1d600640 1 -- 172.21.15.59:0/818796295 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce180adad0 con 0x7fce200ce420 2024-05-30T16:56:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25e00640 1 -- 172.21.15.59:0/818796295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2015e7f0 con 0x7fce200ce420 2024-05-30T16:56:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25e00640 1 -- 172.21.15.59:0/818796295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce2015edb0 con 0x7fce200ce420 2024-05-30T16:56:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.362+0000 7fce25e00640 1 -- 172.21.15.59:0/818796295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce200691a0 con 0x7fce200ce420 2024-05-30T16:56:49.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.366+0000 7fce1d600640 1 -- 172.21.15.59:0/818796295 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7fce180adc70 con 0x7fce200ce420 2024-05-30T16:56:49.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.366+0000 7fce1d600640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcdfc069070 0x7fcdfc06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:49.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.366+0000 7fce1d600640 1 -- 172.21.15.59:0/818796295 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7fce18120490 con 0x7fce200ce420 2024-05-30T16:56:49.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.366+0000 7fce24a00640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcdfc069070 0x7fcdfc06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:49.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.366+0000 7fce24a00640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcdfc069070 0x7fcdfc06b530 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fce10006e90 tx=0x7fce10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.370+0000 7fce1d600640 1 -- 172.21.15.59:0/818796295 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fce18016520 con 0x7fce200ce420 2024-05-30T16:56:49.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.534+0000 7fce25e00640 1 -- 172.21.15.59:0/818796295 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce200d0a20 con 0x7fcdfc069070 2024-05-30T16:56:49.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.542+0000 7fce1d600640 1 -- 172.21.15.59:0/818796295 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252062 (secure 0 0 0) 0x7fce200d0a20 con 0x7fcdfc069070 2024-05-30T16:56:49.547 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:49.549 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:56:49.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.542+0000 7fce25e00640 1 -- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcdfc069070 msgr2=0x7fcdfc06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:49.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.542+0000 7fce25e00640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcdfc069070 0x7fcdfc06b530 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fce10006e90 tx=0x7fce10008040 comp rx=0 tx=0).stop 2024-05-30T16:56:49.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.542+0000 7fce25e00640 1 -- 172.21.15.59:0/818796295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce200ce420 msgr2=0x7fce20156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:49.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.542+0000 7fce25e00640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce200ce420 0x7fce20156950 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fce180b0040 tx=0x7fce180196d0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.546+0000 7fce25e00640 1 -- 172.21.15.59:0/818796295 shutdown_connections 2024-05-30T16:56:49.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.546+0000 7fce25e00640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcdfc069070 0x7fcdfc06b530 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.546+0000 7fce25e00640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce200ce420 0x7fce20156950 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.546+0000 7fce25e00640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce200b39b0 0x7fce200709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.546+0000 7fce25e00640 1 --2- 172.21.15.59:0/818796295 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce2006d600 0x7fce20152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.546+0000 7fce25e00640 1 -- 172.21.15.59:0/818796295 >> 172.21.15.59:0/818796295 conn(0x7fce200d2370 msgr2=0x7fce2015bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:49.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.546+0000 7fce25e00640 1 -- 172.21.15.59:0/818796295 shutdown_connections 2024-05-30T16:56:49.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.546+0000 7fce25e00640 1 -- 172.21.15.59:0/818796295 wait complete. 2024-05-30T16:56:49.568 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-05-30T16:56:49.210530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431264,"kb_used_data":8284,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754543456,"statfs":{"total":773094113280,"available":772652498944,"internally_reserved":0,"allocated":8482816,"data_stored":4244772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001233"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548612+0000","last_change":"2024-05-30T16:56:44.668865+0000","last_active":"2024-05-30T16:56:46.548612+0000","last_peered":"2024-05-30T16:56:46.548612+0000","last_clean":"2024-05-30T16:56:46.548612+0000","last_became_active":"2024-05-30T16:56:44.668040+0000","last_became_peered":"2024-05-30T16:56:44.668040+0000","last_unstale":"2024-05-30T16:56:46.548612+0000","last_undegraded":"2024-05-30T16:56:46.548612+0000","last_fullsized":"2024-05-30T16:56:46.548612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:56.908682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317318+0000","last_change":"2024-05-30T16:56:44.661763+0000","last_active":"2024-05-30T16:56:46.317318+0000","last_peered":"2024-05-30T16:56:46.317318+0000","last_clean":"2024-05-30T16:56:46.317318+0000","last_became_active":"2024-05-30T16:56:44.658746+0000","last_became_peered":"2024-05-30T16:56:44.658746+0000","last_unstale":"2024-05-30T16:56:46.317318+0000","last_undegraded":"2024-05-30T16:56:46.317318+0000","last_fullsized":"2024-05-30T16:56:46.317318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:22:17.380165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.661199+0000","last_change":"2024-05-30T16:56:44.649217+0000","last_active":"2024-05-30T16:56:44.661199+0000","last_peered":"2024-05-30T16:56:44.661199+0000","last_clean":"2024-05-30T16:56:44.661199+0000","last_became_active":"2024-05-30T16:56:44.648928+0000","last_became_peered":"2024-05-30T16:56:44.648928+0000","last_unstale":"2024-05-30T16:56:44.661199+0000","last_undegraded":"2024-05-30T16:56:44.661199+0000","last_fullsized":"2024-05-30T16:56:44.661199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:00:34.724863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108660+0000","last_change":"2024-05-30T16:56:44.642320+0000","last_active":"2024-05-30T16:56:46.108660+0000","last_peered":"2024-05-30T16:56:46.108660+0000","last_clean":"2024-05-30T16:56:46.108660+0000","last_became_active":"2024-05-30T16:56:44.641997+0000","last_became_peered":"2024-05-30T16:56:44.641997+0000","last_unstale":"2024-05-30T16:56:46.108660+0000","last_undegraded":"2024-05-30T16:56:46.108660+0000","last_fullsized":"2024-05-30T16:56:46.108660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:54.005648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651793+0000","last_change":"2024-05-30T16:56:44.662425+0000","last_active":"2024-05-30T16:56:45.651793+0000","last_peered":"2024-05-30T16:56:45.651793+0000","last_clean":"2024-05-30T16:56:45.651793+0000","last_became_active":"2024-05-30T16:56:44.662074+0000","last_became_peered":"2024-05-30T16:56:44.662074+0000","last_unstale":"2024-05-30T16:56:45.651793+0000","last_undegraded":"2024-05-30T16:56:45.651793+0000","last_fullsized":"2024-05-30T16:56:45.651793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:50.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316759+0000","last_change":"2024-05-30T16:56:44.651788+0000","last_active":"2024-05-30T16:56:46.316759+0000","last_peered":"2024-05-30T16:56:46.316759+0000","last_clean":"2024-05-30T16:56:46.316759+0000","last_became_active":"2024-05-30T16:56:44.651285+0000","last_became_peered":"2024-05-30T16:56:44.651285+0000","last_unstale":"2024-05-30T16:56:46.316759+0000","last_undegraded":"2024-05-30T16:56:46.316759+0000","last_fullsized":"2024-05-30T16:56:46.316759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:24.866601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652823+0000","last_change":"2024-05-30T16:56:44.645072+0000","last_active":"2024-05-30T16:56:45.652823+0000","last_peered":"2024-05-30T16:56:45.652823+0000","last_clean":"2024-05-30T16:56:45.652823+0000","last_became_active":"2024-05-30T16:56:44.644787+0000","last_became_peered":"2024-05-30T16:56:44.644787+0000","last_unstale":"2024-05-30T16:56:45.652823+0000","last_undegraded":"2024-05-30T16:56:45.652823+0000","last_fullsized":"2024-05-30T16:56:45.652823+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:41:03.009179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316880+0000","last_change":"2024-05-30T16:56:44.642515+0000","last_active":"2024-05-30T16:56:46.316880+0000","last_peered":"2024-05-30T16:56:46.316880+0000","last_clean":"2024-05-30T16:56:46.316880+0000","last_became_active":"2024-05-30T16:56:44.641722+0000","last_became_peered":"2024-05-30T16:56:44.641722+0000","last_unstale":"2024-05-30T16:56:46.316880+0000","last_undegraded":"2024-05-30T16:56:46.316880+0000","last_fullsized":"2024-05-30T16:56:46.316880+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:40:11.045382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652160+0000","last_change":"2024-05-30T16:56:44.652304+0000","last_active":"2024-05-30T16:56:45.652160+0000","last_peered":"2024-05-30T16:56:45.652160+0000","last_clean":"2024-05-30T16:56:45.652160+0000","last_became_active":"2024-05-30T16:56:44.651824+0000","last_became_peered":"2024-05-30T16:56:44.651824+0000","last_unstale":"2024-05-30T16:56:45.652160+0000","last_undegraded":"2024-05-30T16:56:45.652160+0000","last_fullsized":"2024-05-30T16:56:45.652160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:53.257788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653994+0000","last_change":"2024-05-30T16:56:44.656226+0000","last_active":"2024-05-30T16:56:45.653994+0000","last_peered":"2024-05-30T16:56:45.653994+0000","last_clean":"2024-05-30T16:56:45.653994+0000","last_became_active":"2024-05-30T16:56:44.653473+0000","last_became_peered":"2024-05-30T16:56:44.653473+0000","last_unstale":"2024-05-30T16:56:45.653994+0000","last_undegraded":"2024-05-30T16:56:45.653994+0000","last_fullsized":"2024-05-30T16:56:45.653994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:41:03.009179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548464+0000","last_change":"2024-05-30T16:56:44.663730+0000","last_active":"2024-05-30T16:56:46.548464+0000","last_peered":"2024-05-30T16:56:46.548464+0000","last_clean":"2024-05-30T16:56:46.548464+0000","last_became_active":"2024-05-30T16:56:44.663105+0000","last_became_peered":"2024-05-30T16:56:44.663105+0000","last_unstale":"2024-05-30T16:56:46.548464+0000","last_undegraded":"2024-05-30T16:56:46.548464+0000","last_fullsized":"2024-05-30T16:56:46.548464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:08:06.277998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108702+0000","last_change":"2024-05-30T16:56:44.660270+0000","last_active":"2024-05-30T16:56:46.108702+0000","last_peered":"2024-05-30T16:56:46.108702+0000","last_clean":"2024-05-30T16:56:46.108702+0000","last_became_active":"2024-05-30T16:56:44.656543+0000","last_became_peered":"2024-05-30T16:56:44.656543+0000","last_unstale":"2024-05-30T16:56:46.108702+0000","last_undegraded":"2024-05-30T16:56:46.108702+0000","last_fullsized":"2024-05-30T16:56:46.108702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:00:02.004468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651329+0000","last_change":"2024-05-30T16:56:44.642746+0000","last_active":"2024-05-30T16:56:45.651329+0000","last_peered":"2024-05-30T16:56:45.651329+0000","last_clean":"2024-05-30T16:56:45.651329+0000","last_became_active":"2024-05-30T16:56:44.642473+0000","last_became_peered":"2024-05-30T16:56:44.642473+0000","last_unstale":"2024-05-30T16:56:45.651329+0000","last_undegraded":"2024-05-30T16:56:45.651329+0000","last_fullsized":"2024-05-30T16:56:45.651329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:06:54.613794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651812+0000","last_change":"2024-05-30T16:56:44.658635+0000","last_active":"2024-05-30T16:56:45.651812+0000","last_peered":"2024-05-30T16:56:45.651812+0000","last_clean":"2024-05-30T16:56:45.651812+0000","last_became_active":"2024-05-30T16:56:44.658374+0000","last_became_peered":"2024-05-30T16:56:44.658374+0000","last_unstale":"2024-05-30T16:56:45.651812+0000","last_undegraded":"2024-05-30T16:56:45.651812+0000","last_fullsized":"2024-05-30T16:56:45.651812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:03:27.939224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650895+0000","last_change":"2024-05-30T16:56:44.652408+0000","last_active":"2024-05-30T16:56:45.650895+0000","last_peered":"2024-05-30T16:56:45.650895+0000","last_clean":"2024-05-30T16:56:45.650895+0000","last_became_active":"2024-05-30T16:56:44.652139+0000","last_became_peered":"2024-05-30T16:56:44.652139+0000","last_unstale":"2024-05-30T16:56:45.650895+0000","last_undegraded":"2024-05-30T16:56:45.650895+0000","last_fullsized":"2024-05-30T16:56:45.650895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:38:16.555934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652763+0000","last_change":"2024-05-30T16:56:44.664085+0000","last_active":"2024-05-30T16:56:45.652763+0000","last_peered":"2024-05-30T16:56:45.652763+0000","last_clean":"2024-05-30T16:56:45.652763+0000","last_became_active":"2024-05-30T16:56:44.663813+0000","last_became_peered":"2024-05-30T16:56:44.663813+0000","last_unstale":"2024-05-30T16:56:45.652763+0000","last_undegraded":"2024-05-30T16:56:45.652763+0000","last_fullsized":"2024-05-30T16:56:45.652763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:48.530977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652173+0000","last_change":"2024-05-30T16:56:44.649373+0000","last_active":"2024-05-30T16:56:45.652173+0000","last_peered":"2024-05-30T16:56:45.652173+0000","last_clean":"2024-05-30T16:56:45.652173+0000","last_became_active":"2024-05-30T16:56:44.649085+0000","last_became_peered":"2024-05-30T16:56:44.649085+0000","last_unstale":"2024-05-30T16:56:45.652173+0000","last_undegraded":"2024-05-30T16:56:45.652173+0000","last_fullsized":"2024-05-30T16:56:45.652173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:38.575100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108768+0000","last_change":"2024-05-30T16:56:44.644524+0000","last_active":"2024-05-30T16:56:46.108768+0000","last_peered":"2024-05-30T16:56:46.108768+0000","last_clean":"2024-05-30T16:56:46.108768+0000","last_became_active":"2024-05-30T16:56:44.643377+0000","last_became_peered":"2024-05-30T16:56:44.643377+0000","last_unstale":"2024-05-30T16:56:46.108768+0000","last_undegraded":"2024-05-30T16:56:46.108768+0000","last_fullsized":"2024-05-30T16:56:46.108768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:16:01.798245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317074+0000","last_change":"2024-05-30T16:56:44.649026+0000","last_active":"2024-05-30T16:56:46.317074+0000","last_peered":"2024-05-30T16:56:46.317074+0000","last_clean":"2024-05-30T16:56:46.317074+0000","last_became_active":"2024-05-30T16:56:44.648420+0000","last_became_peered":"2024-05-30T16:56:44.648420+0000","last_unstale":"2024-05-30T16:56:46.317074+0000","last_undegraded":"2024-05-30T16:56:46.317074+0000","last_fullsized":"2024-05-30T16:56:46.317074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:09:04.016326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651285+0000","last_change":"2024-05-30T16:56:44.646135+0000","last_active":"2024-05-30T16:56:45.651285+0000","last_peered":"2024-05-30T16:56:45.651285+0000","last_clean":"2024-05-30T16:56:45.651285+0000","last_became_active":"2024-05-30T16:56:44.645002+0000","last_became_peered":"2024-05-30T16:56:44.645002+0000","last_unstale":"2024-05-30T16:56:45.651285+0000","last_undegraded":"2024-05-30T16:56:45.651285+0000","last_fullsized":"2024-05-30T16:56:45.651285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:18:37.099872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653598+0000","last_change":"2024-05-30T16:56:44.652466+0000","last_active":"2024-05-30T16:56:45.653598+0000","last_peered":"2024-05-30T16:56:45.653598+0000","last_clean":"2024-05-30T16:56:45.653598+0000","last_became_active":"2024-05-30T16:56:44.652159+0000","last_became_peered":"2024-05-30T16:56:44.652159+0000","last_unstale":"2024-05-30T16:56:45.653598+0000","last_undegraded":"2024-05-30T16:56:45.653598+0000","last_fullsized":"2024-05-30T16:56:45.653598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:58.919044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653237+0000","last_change":"2024-05-30T16:56:44.651849+0000","last_active":"2024-05-30T16:56:45.653237+0000","last_peered":"2024-05-30T16:56:45.653237+0000","last_clean":"2024-05-30T16:56:45.653237+0000","last_became_active":"2024-05-30T16:56:44.651587+0000","last_became_peered":"2024-05-30T16:56:44.651587+0000","last_unstale":"2024-05-30T16:56:45.653237+0000","last_undegraded":"2024-05-30T16:56:45.653237+0000","last_fullsized":"2024-05-30T16:56:45.653237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:28:50.592002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548147+0000","last_change":"2024-05-30T16:56:44.662385+0000","last_active":"2024-05-30T16:56:46.548147+0000","last_peered":"2024-05-30T16:56:46.548147+0000","last_clean":"2024-05-30T16:56:46.548147+0000","last_became_active":"2024-05-30T16:56:44.662083+0000","last_became_peered":"2024-05-30T16:56:44.662083+0000","last_unstale":"2024-05-30T16:56:46.548147+0000","last_undegraded":"2024-05-30T16:56:46.548147+0000","last_fullsized":"2024-05-30T16:56:46.548147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:16:01.303332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548254+0000","last_change":"2024-05-30T16:56:44.670256+0000","last_active":"2024-05-30T16:56:46.548254+0000","last_peered":"2024-05-30T16:56:46.548254+0000","last_clean":"2024-05-30T16:56:46.548254+0000","last_became_active":"2024-05-30T16:56:44.669963+0000","last_became_peered":"2024-05-30T16:56:44.669963+0000","last_unstale":"2024-05-30T16:56:46.548254+0000","last_undegraded":"2024-05-30T16:56:46.548254+0000","last_fullsized":"2024-05-30T16:56:46.548254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:01:10.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654066+0000","last_change":"2024-05-30T16:56:44.653100+0000","last_active":"2024-05-30T16:56:45.654066+0000","last_peered":"2024-05-30T16:56:45.654066+0000","last_clean":"2024-05-30T16:56:45.654066+0000","last_became_active":"2024-05-30T16:56:44.652785+0000","last_became_peered":"2024-05-30T16:56:44.652785+0000","last_unstale":"2024-05-30T16:56:45.654066+0000","last_undegraded":"2024-05-30T16:56:45.654066+0000","last_fullsized":"2024-05-30T16:56:45.654066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:24:18.478717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653867+0000","last_change":"2024-05-30T16:56:44.642985+0000","last_active":"2024-05-30T16:56:45.653867+0000","last_peered":"2024-05-30T16:56:45.653867+0000","last_clean":"2024-05-30T16:56:45.653867+0000","last_became_active":"2024-05-30T16:56:44.642676+0000","last_became_peered":"2024-05-30T16:56:44.642676+0000","last_unstale":"2024-05-30T16:56:45.653867+0000","last_undegraded":"2024-05-30T16:56:45.653867+0000","last_fullsized":"2024-05-30T16:56:45.653867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:36.158094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.661222+0000","last_change":"2024-05-30T16:56:44.651182+0000","last_active":"2024-05-30T16:56:44.661222+0000","last_peered":"2024-05-30T16:56:44.661222+0000","last_clean":"2024-05-30T16:56:44.661222+0000","last_became_active":"2024-05-30T16:56:44.650908+0000","last_became_peered":"2024-05-30T16:56:44.650908+0000","last_unstale":"2024-05-30T16:56:44.661222+0000","last_undegraded":"2024-05-30T16:56:44.661222+0000","last_fullsized":"2024-05-30T16:56:44.661222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:49:02.259652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653508+0000","last_change":"2024-05-30T16:56:44.654286+0000","last_active":"2024-05-30T16:56:45.653508+0000","last_peered":"2024-05-30T16:56:45.653508+0000","last_clean":"2024-05-30T16:56:45.653508+0000","last_became_active":"2024-05-30T16:56:44.653927+0000","last_became_peered":"2024-05-30T16:56:44.653927+0000","last_unstale":"2024-05-30T16:56:45.653508+0000","last_undegraded":"2024-05-30T16:56:45.653508+0000","last_fullsized":"2024-05-30T16:56:45.653508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:44.828514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659298+0000","last_change":"2024-05-30T16:56:44.650936+0000","last_active":"2024-05-30T16:56:44.659298+0000","last_peered":"2024-05-30T16:56:44.659298+0000","last_clean":"2024-05-30T16:56:44.659298+0000","last_became_active":"2024-05-30T16:56:44.650397+0000","last_became_peered":"2024-05-30T16:56:44.650397+0000","last_unstale":"2024-05-30T16:56:44.659298+0000","last_undegraded":"2024-05-30T16:56:44.659298+0000","last_fullsized":"2024-05-30T16:56:44.659298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:52.457119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652885+0000","last_change":"2024-05-30T16:56:44.643854+0000","last_active":"2024-05-30T16:56:45.652885+0000","last_peered":"2024-05-30T16:56:45.652885+0000","last_clean":"2024-05-30T16:56:45.652885+0000","last_became_active":"2024-05-30T16:56:44.643513+0000","last_became_peered":"2024-05-30T16:56:44.643513+0000","last_unstale":"2024-05-30T16:56:45.652885+0000","last_undegraded":"2024-05-30T16:56:45.652885+0000","last_fullsized":"2024-05-30T16:56:45.652885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:45:54.673385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653096+0000","last_change":"2024-05-30T16:56:44.650198+0000","last_active":"2024-05-30T16:56:45.653096+0000","last_peered":"2024-05-30T16:56:45.653096+0000","last_clean":"2024-05-30T16:56:45.653096+0000","last_became_active":"2024-05-30T16:56:44.649852+0000","last_became_peered":"2024-05-30T16:56:44.649852+0000","last_unstale":"2024-05-30T16:56:45.653096+0000","last_undegraded":"2024-05-30T16:56:45.653096+0000","last_fullsized":"2024-05-30T16:56:45.653096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:24:18.478717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317162+0000","last_change":"2024-05-30T16:56:44.646102+0000","last_active":"2024-05-30T16:56:46.317162+0000","last_peered":"2024-05-30T16:56:46.317162+0000","last_clean":"2024-05-30T16:56:46.317162+0000","last_became_active":"2024-05-30T16:56:44.645809+0000","last_became_peered":"2024-05-30T16:56:44.645809+0000","last_unstale":"2024-05-30T16:56:46.317162+0000","last_undegraded":"2024-05-30T16:56:46.317162+0000","last_fullsized":"2024-05-30T16:56:46.317162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:01:20.685589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548620+0000","last_change":"2024-05-30T16:56:44.669763+0000","last_active":"2024-05-30T16:56:46.548620+0000","last_peered":"2024-05-30T16:56:46.548620+0000","last_clean":"2024-05-30T16:56:46.548620+0000","last_became_active":"2024-05-30T16:56:44.669357+0000","last_became_peered":"2024-05-30T16:56:44.669357+0000","last_unstale":"2024-05-30T16:56:46.548620+0000","last_undegraded":"2024-05-30T16:56:46.548620+0000","last_fullsized":"2024-05-30T16:56:46.548620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:03.908739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548770+0000","last_change":"2024-05-30T16:56:43.652722+0000","last_active":"2024-05-30T16:56:46.548770+0000","last_peered":"2024-05-30T16:56:46.548770+0000","last_clean":"2024-05-30T16:56:46.548770+0000","last_became_active":"2024-05-30T16:56:43.652368+0000","last_became_peered":"2024-05-30T16:56:43.652368+0000","last_unstale":"2024-05-30T16:56:46.548770+0000","last_undegraded":"2024-05-30T16:56:46.548770+0000","last_fullsized":"2024-05-30T16:56:46.548770+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:41:02.005724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652233+0000","last_change":"2024-05-30T16:56:44.652087+0000","last_active":"2024-05-30T16:56:45.652233+0000","last_peered":"2024-05-30T16:56:45.652233+0000","last_clean":"2024-05-30T16:56:45.652233+0000","last_became_active":"2024-05-30T16:56:44.651426+0000","last_became_peered":"2024-05-30T16:56:44.651426+0000","last_unstale":"2024-05-30T16:56:45.652233+0000","last_undegraded":"2024-05-30T16:56:45.652233+0000","last_fullsized":"2024-05-30T16:56:45.652233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:56.981440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651747+0000","last_change":"2024-05-30T16:56:43.652242+0000","last_active":"2024-05-30T16:56:45.651747+0000","last_peered":"2024-05-30T16:56:45.651747+0000","last_clean":"2024-05-30T16:56:45.651747+0000","last_became_active":"2024-05-30T16:56:43.651954+0000","last_became_peered":"2024-05-30T16:56:43.651954+0000","last_unstale":"2024-05-30T16:56:45.651747+0000","last_undegraded":"2024-05-30T16:56:45.651747+0000","last_fullsized":"2024-05-30T16:56:45.651747+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:43.825060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317283+0000","last_change":"2024-05-30T16:56:44.658539+0000","last_active":"2024-05-30T16:56:46.317283+0000","last_peered":"2024-05-30T16:56:46.317283+0000","last_clean":"2024-05-30T16:56:46.317283+0000","last_became_active":"2024-05-30T16:56:44.658254+0000","last_became_peered":"2024-05-30T16:56:44.658254+0000","last_unstale":"2024-05-30T16:56:46.317283+0000","last_undegraded":"2024-05-30T16:56:46.317283+0000","last_fullsized":"2024-05-30T16:56:46.317283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:46:34.248305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653628+0000","last_change":"2024-05-30T16:56:43.643351+0000","last_active":"2024-05-30T16:56:45.653628+0000","last_peered":"2024-05-30T16:56:45.653628+0000","last_clean":"2024-05-30T16:56:45.653628+0000","last_became_active":"2024-05-30T16:56:43.643086+0000","last_became_peered":"2024-05-30T16:56:43.643086+0000","last_unstale":"2024-05-30T16:56:45.653628+0000","last_undegraded":"2024-05-30T16:56:45.653628+0000","last_fullsized":"2024-05-30T16:56:45.653628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:23.863146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548563+0000","last_change":"2024-05-30T16:56:44.665209+0000","last_active":"2024-05-30T16:56:46.548563+0000","last_peered":"2024-05-30T16:56:46.548563+0000","last_clean":"2024-05-30T16:56:46.548563+0000","last_became_active":"2024-05-30T16:56:44.664880+0000","last_became_peered":"2024-05-30T16:56:44.664880+0000","last_unstale":"2024-05-30T16:56:46.548563+0000","last_undegraded":"2024-05-30T16:56:46.548563+0000","last_fullsized":"2024-05-30T16:56:46.548563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:30.146195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317153+0000","last_change":"2024-05-30T16:56:43.652649+0000","last_active":"2024-05-30T16:56:46.317153+0000","last_peered":"2024-05-30T16:56:46.317153+0000","last_clean":"2024-05-30T16:56:46.317153+0000","last_became_active":"2024-05-30T16:56:43.652332+0000","last_became_peered":"2024-05-30T16:56:43.652332+0000","last_unstale":"2024-05-30T16:56:46.317153+0000","last_undegraded":"2024-05-30T16:56:46.317153+0000","last_fullsized":"2024-05-30T16:56:46.317153+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:16:00.794791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653299+0000","last_change":"2024-05-30T16:56:44.651028+0000","last_active":"2024-05-30T16:56:45.653299+0000","last_peered":"2024-05-30T16:56:45.653299+0000","last_clean":"2024-05-30T16:56:45.653299+0000","last_became_active":"2024-05-30T16:56:44.650717+0000","last_became_peered":"2024-05-30T16:56:44.650717+0000","last_unstale":"2024-05-30T16:56:45.653299+0000","last_undegraded":"2024-05-30T16:56:45.653299+0000","last_fullsized":"2024-05-30T16:56:45.653299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:27.192232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.662926+0000","last_change":"2024-05-30T16:56:43.650135+0000","last_active":"2024-05-30T16:56:44.662926+0000","last_peered":"2024-05-30T16:56:44.662926+0000","last_clean":"2024-05-30T16:56:44.662926+0000","last_became_active":"2024-05-30T16:56:43.649731+0000","last_became_peered":"2024-05-30T16:56:43.649731+0000","last_unstale":"2024-05-30T16:56:44.662926+0000","last_undegraded":"2024-05-30T16:56:44.662926+0000","last_fullsized":"2024-05-30T16:56:44.662926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:05:58.221402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653764+0000","last_change":"2024-05-30T16:56:44.660137+0000","last_active":"2024-05-30T16:56:45.653764+0000","last_peered":"2024-05-30T16:56:45.653764+0000","last_clean":"2024-05-30T16:56:45.653764+0000","last_became_active":"2024-05-30T16:56:44.659826+0000","last_became_peered":"2024-05-30T16:56:44.659826+0000","last_unstale":"2024-05-30T16:56:45.653764+0000","last_undegraded":"2024-05-30T16:56:45.653764+0000","last_fullsized":"2024-05-30T16:56:45.653764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:32:08.978869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316739+0000","last_change":"2024-05-30T16:56:43.649636+0000","last_active":"2024-05-30T16:56:46.316739+0000","last_peered":"2024-05-30T16:56:46.316739+0000","last_clean":"2024-05-30T16:56:46.316739+0000","last_became_active":"2024-05-30T16:56:43.648216+0000","last_became_peered":"2024-05-30T16:56:43.648216+0000","last_unstale":"2024-05-30T16:56:46.316739+0000","last_undegraded":"2024-05-30T16:56:46.316739+0000","last_fullsized":"2024-05-30T16:56:46.316739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:41.743303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650764+0000","last_change":"2024-05-30T16:56:44.655108+0000","last_active":"2024-05-30T16:56:45.650764+0000","last_peered":"2024-05-30T16:56:45.650764+0000","last_clean":"2024-05-30T16:56:45.650764+0000","last_became_active":"2024-05-30T16:56:44.654831+0000","last_became_peered":"2024-05-30T16:56:44.654831+0000","last_unstale":"2024-05-30T16:56:45.650764+0000","last_undegraded":"2024-05-30T16:56:45.650764+0000","last_fullsized":"2024-05-30T16:56:45.650764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:13:38.307444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108376+0000","last_change":"2024-05-30T16:56:43.640552+0000","last_active":"2024-05-30T16:56:46.108376+0000","last_peered":"2024-05-30T16:56:46.108376+0000","last_clean":"2024-05-30T16:56:46.108376+0000","last_became_active":"2024-05-30T16:56:43.640314+0000","last_became_peered":"2024-05-30T16:56:43.640314+0000","last_unstale":"2024-05-30T16:56:46.108376+0000","last_undegraded":"2024-05-30T16:56:46.108376+0000","last_fullsized":"2024-05-30T16:56:46.108376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:08.666126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651001+0000","last_change":"2024-05-30T16:56:44.660810+0000","last_active":"2024-05-30T16:56:45.651001+0000","last_peered":"2024-05-30T16:56:45.651001+0000","last_clean":"2024-05-30T16:56:45.651001+0000","last_became_active":"2024-05-30T16:56:44.660477+0000","last_became_peered":"2024-05-30T16:56:44.660477+0000","last_unstale":"2024-05-30T16:56:45.651001+0000","last_undegraded":"2024-05-30T16:56:45.651001+0000","last_fullsized":"2024-05-30T16:56:45.651001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:25:50.040344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650776+0000","last_change":"2024-05-30T16:56:43.641994+0000","last_active":"2024-05-30T16:56:45.650776+0000","last_peered":"2024-05-30T16:56:45.650776+0000","last_clean":"2024-05-30T16:56:45.650776+0000","last_became_active":"2024-05-30T16:56:43.641712+0000","last_became_peered":"2024-05-30T16:56:43.641712+0000","last_unstale":"2024-05-30T16:56:45.650776+0000","last_undegraded":"2024-05-30T16:56:45.650776+0000","last_fullsized":"2024-05-30T16:56:45.650776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:08:06.965045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654000+0000","last_change":"2024-05-30T16:56:44.658680+0000","last_active":"2024-05-30T16:56:45.654000+0000","last_peered":"2024-05-30T16:56:45.654000+0000","last_clean":"2024-05-30T16:56:45.654000+0000","last_became_active":"2024-05-30T16:56:44.658405+0000","last_became_peered":"2024-05-30T16:56:44.658405+0000","last_unstale":"2024-05-30T16:56:45.654000+0000","last_undegraded":"2024-05-30T16:56:45.654000+0000","last_fullsized":"2024-05-30T16:56:45.654000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:25:50.040344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654147+0000","last_change":"2024-05-30T16:56:43.646805+0000","last_active":"2024-05-30T16:56:45.654147+0000","last_peered":"2024-05-30T16:56:45.654147+0000","last_clean":"2024-05-30T16:56:45.654147+0000","last_became_active":"2024-05-30T16:56:43.646509+0000","last_became_peered":"2024-05-30T16:56:43.646509+0000","last_unstale":"2024-05-30T16:56:45.654147+0000","last_undegraded":"2024-05-30T16:56:45.654147+0000","last_fullsized":"2024-05-30T16:56:45.654147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:40:10.041928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548707+0000","last_change":"2024-05-30T16:56:44.671239+0000","last_active":"2024-05-30T16:56:46.548707+0000","last_peered":"2024-05-30T16:56:46.548707+0000","last_clean":"2024-05-30T16:56:46.548707+0000","last_became_active":"2024-05-30T16:56:44.670215+0000","last_became_peered":"2024-05-30T16:56:44.670215+0000","last_unstale":"2024-05-30T16:56:46.548707+0000","last_undegraded":"2024-05-30T16:56:46.548707+0000","last_fullsized":"2024-05-30T16:56:46.548707+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:50.550356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317387+0000","last_change":"2024-05-30T16:56:43.648959+0000","last_active":"2024-05-30T16:56:46.317387+0000","last_peered":"2024-05-30T16:56:46.317387+0000","last_clean":"2024-05-30T16:56:46.317387+0000","last_became_active":"2024-05-30T16:56:43.648675+0000","last_became_peered":"2024-05-30T16:56:43.648675+0000","last_unstale":"2024-05-30T16:56:46.317387+0000","last_undegraded":"2024-05-30T16:56:46.317387+0000","last_fullsized":"2024-05-30T16:56:46.317387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:52.114014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316987+0000","last_change":"2024-05-30T16:56:44.651009+0000","last_active":"2024-05-30T16:56:46.316987+0000","last_peered":"2024-05-30T16:56:46.316987+0000","last_clean":"2024-05-30T16:56:46.316987+0000","last_became_active":"2024-05-30T16:56:44.650709+0000","last_became_peered":"2024-05-30T16:56:44.650709+0000","last_unstale":"2024-05-30T16:56:46.316987+0000","last_undegraded":"2024-05-30T16:56:46.316987+0000","last_fullsized":"2024-05-30T16:56:46.316987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:03:39.290806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.667305+0000","last_change":"2024-05-30T16:56:43.648080+0000","last_active":"2024-05-30T16:56:44.667305+0000","last_peered":"2024-05-30T16:56:44.667305+0000","last_clean":"2024-05-30T16:56:44.667305+0000","last_became_active":"2024-05-30T16:56:43.647224+0000","last_became_peered":"2024-05-30T16:56:43.647224+0000","last_unstale":"2024-05-30T16:56:44.667305+0000","last_undegraded":"2024-05-30T16:56:44.667305+0000","last_fullsized":"2024-05-30T16:56:44.667305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:24:13.264974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651928+0000","last_change":"2024-05-30T16:56:44.650308+0000","last_active":"2024-05-30T16:56:45.651928+0000","last_peered":"2024-05-30T16:56:45.651928+0000","last_clean":"2024-05-30T16:56:45.651928+0000","last_became_active":"2024-05-30T16:56:44.649980+0000","last_became_peered":"2024-05-30T16:56:44.649980+0000","last_unstale":"2024-05-30T16:56:45.651928+0000","last_undegraded":"2024-05-30T16:56:45.651928+0000","last_fullsized":"2024-05-30T16:56:45.651928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:45:58.041826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"74'6","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108800+0000","last_change":"2024-05-30T16:56:43.646796+0000","last_active":"2024-05-30T16:56:46.108800+0000","last_peered":"2024-05-30T16:56:46.108800+0000","last_clean":"2024-05-30T16:56:46.108800+0000","last_became_active":"2024-05-30T16:56:43.646100+0000","last_became_peered":"2024-05-30T16:56:43.646100+0000","last_unstale":"2024-05-30T16:56:46.108800+0000","last_undegraded":"2024-05-30T16:56:46.108800+0000","last_fullsized":"2024-05-30T16:56:46.108800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:55.977985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548319+0000","last_change":"2024-05-30T16:56:44.666817+0000","last_active":"2024-05-30T16:56:46.548319+0000","last_peered":"2024-05-30T16:56:46.548319+0000","last_clean":"2024-05-30T16:56:46.548319+0000","last_became_active":"2024-05-30T16:56:44.666556+0000","last_became_peered":"2024-05-30T16:56:44.666556+0000","last_unstale":"2024-05-30T16:56:46.548319+0000","last_undegraded":"2024-05-30T16:56:46.548319+0000","last_fullsized":"2024-05-30T16:56:46.548319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:25:09.747489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108561+0000","last_change":"2024-05-30T16:56:43.646330+0000","last_active":"2024-05-30T16:56:46.108561+0000","last_peered":"2024-05-30T16:56:46.108561+0000","last_clean":"2024-05-30T16:56:46.108561+0000","last_became_active":"2024-05-30T16:56:43.645135+0000","last_became_peered":"2024-05-30T16:56:43.645135+0000","last_unstale":"2024-05-30T16:56:46.108561+0000","last_undegraded":"2024-05-30T16:56:46.108561+0000","last_fullsized":"2024-05-30T16:56:46.108561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:37.571645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654213+0000","last_change":"2024-05-30T16:56:44.652909+0000","last_active":"2024-05-30T16:56:45.654213+0000","last_peered":"2024-05-30T16:56:45.654213+0000","last_clean":"2024-05-30T16:56:45.654213+0000","last_became_active":"2024-05-30T16:56:44.652639+0000","last_became_peered":"2024-05-30T16:56:44.652639+0000","last_unstale":"2024-05-30T16:56:45.654213+0000","last_undegraded":"2024-05-30T16:56:45.654213+0000","last_fullsized":"2024-05-30T16:56:45.654213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:18:37.099872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316955+0000","last_change":"2024-05-30T16:56:43.648535+0000","last_active":"2024-05-30T16:56:46.316955+0000","last_peered":"2024-05-30T16:56:46.316955+0000","last_clean":"2024-05-30T16:56:46.316955+0000","last_became_active":"2024-05-30T16:56:43.648206+0000","last_became_peered":"2024-05-30T16:56:43.648206+0000","last_unstale":"2024-05-30T16:56:46.316955+0000","last_undegraded":"2024-05-30T16:56:46.316955+0000","last_fullsized":"2024-05-30T16:56:46.316955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:55:28.651316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650979+0000","last_change":"2024-05-30T16:56:44.645994+0000","last_active":"2024-05-30T16:56:45.650979+0000","last_peered":"2024-05-30T16:56:45.650979+0000","last_clean":"2024-05-30T16:56:45.650979+0000","last_became_active":"2024-05-30T16:56:44.645720+0000","last_became_peered":"2024-05-30T16:56:44.645720+0000","last_unstale":"2024-05-30T16:56:45.650979+0000","last_undegraded":"2024-05-30T16:56:45.650979+0000","last_fullsized":"2024-05-30T16:56:45.650979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:36.158094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652937+0000","last_change":"2024-05-30T16:56:43.646206+0000","last_active":"2024-05-30T16:56:45.652937+0000","last_peered":"2024-05-30T16:56:45.652937+0000","last_clean":"2024-05-30T16:56:45.652937+0000","last_became_active":"2024-05-30T16:56:43.645673+0000","last_became_peered":"2024-05-30T16:56:43.645673+0000","last_unstale":"2024-05-30T16:56:45.652937+0000","last_undegraded":"2024-05-30T16:56:45.652937+0000","last_fullsized":"2024-05-30T16:56:45.652937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:22:16.376711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651353+0000","last_change":"2024-05-30T16:56:44.652605+0000","last_active":"2024-05-30T16:56:45.651353+0000","last_peered":"2024-05-30T16:56:45.651353+0000","last_clean":"2024-05-30T16:56:45.651353+0000","last_became_active":"2024-05-30T16:56:44.650499+0000","last_became_peered":"2024-05-30T16:56:44.650499+0000","last_unstale":"2024-05-30T16:56:45.651353+0000","last_undegraded":"2024-05-30T16:56:45.651353+0000","last_fullsized":"2024-05-30T16:56:45.651353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:31.289587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653299+0000","last_change":"2024-05-30T16:56:43.647263+0000","last_active":"2024-05-30T16:56:45.653299+0000","last_peered":"2024-05-30T16:56:45.653299+0000","last_clean":"2024-05-30T16:56:45.653299+0000","last_became_active":"2024-05-30T16:56:43.645925+0000","last_became_peered":"2024-05-30T16:56:43.645925+0000","last_unstale":"2024-05-30T16:56:45.653299+0000","last_undegraded":"2024-05-30T16:56:45.653299+0000","last_fullsized":"2024-05-30T16:56:45.653299+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:39:52.639268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654061+0000","last_change":"2024-05-30T16:56:44.654596+0000","last_active":"2024-05-30T16:56:45.654061+0000","last_peered":"2024-05-30T16:56:45.654061+0000","last_clean":"2024-05-30T16:56:45.654061+0000","last_became_active":"2024-05-30T16:56:44.650982+0000","last_became_peered":"2024-05-30T16:56:44.650982+0000","last_unstale":"2024-05-30T16:56:45.654061+0000","last_undegraded":"2024-05-30T16:56:45.654061+0000","last_fullsized":"2024-05-30T16:56:45.654061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:45:54.673385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317415+0000","last_change":"2024-05-30T16:56:43.649341+0000","last_active":"2024-05-30T16:56:46.317415+0000","last_peered":"2024-05-30T16:56:46.317415+0000","last_clean":"2024-05-30T16:56:46.317415+0000","last_became_active":"2024-05-30T16:56:43.649011+0000","last_became_peered":"2024-05-30T16:56:43.649011+0000","last_unstale":"2024-05-30T16:56:46.317415+0000","last_undegraded":"2024-05-30T16:56:46.317415+0000","last_fullsized":"2024-05-30T16:56:46.317415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:00:01.001014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548789+0000","last_change":"2024-05-30T16:56:44.666380+0000","last_active":"2024-05-30T16:56:46.548789+0000","last_peered":"2024-05-30T16:56:46.548789+0000","last_clean":"2024-05-30T16:56:46.548789+0000","last_became_active":"2024-05-30T16:56:44.665935+0000","last_became_peered":"2024-05-30T16:56:44.665935+0000","last_unstale":"2024-05-30T16:56:46.548789+0000","last_undegraded":"2024-05-30T16:56:46.548789+0000","last_fullsized":"2024-05-30T16:56:46.548789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:15.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654099+0000","last_change":"2024-05-30T16:56:43.642066+0000","last_active":"2024-05-30T16:56:45.654099+0000","last_peered":"2024-05-30T16:56:45.654099+0000","last_clean":"2024-05-30T16:56:45.654099+0000","last_became_active":"2024-05-30T16:56:43.641208+0000","last_became_peered":"2024-05-30T16:56:43.641208+0000","last_unstale":"2024-05-30T16:56:45.654099+0000","last_undegraded":"2024-05-30T16:56:45.654099+0000","last_fullsized":"2024-05-30T16:56:45.654099+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:46:36.960891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108805+0000","last_change":"2024-05-30T16:56:44.656373+0000","last_active":"2024-05-30T16:56:46.108805+0000","last_peered":"2024-05-30T16:56:46.108805+0000","last_clean":"2024-05-30T16:56:46.108805+0000","last_became_active":"2024-05-30T16:56:44.653318+0000","last_became_peered":"2024-05-30T16:56:44.653318+0000","last_unstale":"2024-05-30T16:56:46.108805+0000","last_undegraded":"2024-05-30T16:56:46.108805+0000","last_fullsized":"2024-05-30T16:56:46.108805+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:39.371941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317208+0000","last_change":"2024-05-30T16:56:43.647018+0000","last_active":"2024-05-30T16:56:46.317208+0000","last_peered":"2024-05-30T16:56:46.317208+0000","last_clean":"2024-05-30T16:56:46.317208+0000","last_became_active":"2024-05-30T16:56:43.646734+0000","last_became_peered":"2024-05-30T16:56:43.646734+0000","last_unstale":"2024-05-30T16:56:46.317208+0000","last_undegraded":"2024-05-30T16:56:46.317208+0000","last_fullsized":"2024-05-30T16:56:46.317208+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:55:18.699236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652099+0000","last_change":"2024-05-30T16:56:44.654757+0000","last_active":"2024-05-30T16:56:45.652099+0000","last_peered":"2024-05-30T16:56:45.652099+0000","last_clean":"2024-05-30T16:56:45.652099+0000","last_became_active":"2024-05-30T16:56:44.654467+0000","last_became_peered":"2024-05-30T16:56:44.654467+0000","last_unstale":"2024-05-30T16:56:45.652099+0000","last_undegraded":"2024-05-30T16:56:45.652099+0000","last_fullsized":"2024-05-30T16:56:45.652099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:09.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548368+0000","last_change":"2024-05-30T16:56:43.651621+0000","last_active":"2024-05-30T16:56:46.548368+0000","last_peered":"2024-05-30T16:56:46.548368+0000","last_clean":"2024-05-30T16:56:46.548368+0000","last_became_active":"2024-05-30T16:56:43.651020+0000","last_became_peered":"2024-05-30T16:56:43.651020+0000","last_unstale":"2024-05-30T16:56:46.548368+0000","last_undegraded":"2024-05-30T16:56:46.548368+0000","last_fullsized":"2024-05-30T16:56:46.548368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:32:07.975415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659275+0000","last_change":"2024-05-30T16:56:44.650720+0000","last_active":"2024-05-30T16:56:44.659275+0000","last_peered":"2024-05-30T16:56:44.659275+0000","last_clean":"2024-05-30T16:56:44.659275+0000","last_became_active":"2024-05-30T16:56:44.649933+0000","last_became_peered":"2024-05-30T16:56:44.649933+0000","last_unstale":"2024-05-30T16:56:44.659275+0000","last_undegraded":"2024-05-30T16:56:44.659275+0000","last_fullsized":"2024-05-30T16:56:44.659275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:24:16.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316958+0000","last_change":"2024-05-30T16:56:43.648500+0000","last_active":"2024-05-30T16:56:46.316958+0000","last_peered":"2024-05-30T16:56:46.316958+0000","last_clean":"2024-05-30T16:56:46.316958+0000","last_became_active":"2024-05-30T16:56:43.647772+0000","last_became_peered":"2024-05-30T16:56:43.647772+0000","last_unstale":"2024-05-30T16:56:46.316958+0000","last_undegraded":"2024-05-30T16:56:46.316958+0000","last_fullsized":"2024-05-30T16:56:46.316958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:59.944690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659097+0000","last_change":"2024-05-30T16:56:44.646838+0000","last_active":"2024-05-30T16:56:44.659097+0000","last_peered":"2024-05-30T16:56:44.659097+0000","last_clean":"2024-05-30T16:56:44.659097+0000","last_became_active":"2024-05-30T16:56:44.646587+0000","last_became_peered":"2024-05-30T16:56:44.646587+0000","last_unstale":"2024-05-30T16:56:44.659097+0000","last_undegraded":"2024-05-30T16:56:44.659097+0000","last_fullsized":"2024-05-30T16:56:44.659097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:30.610228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653189+0000","last_change":"2024-05-30T16:56:43.643553+0000","last_active":"2024-05-30T16:56:45.653189+0000","last_peered":"2024-05-30T16:56:45.653189+0000","last_clean":"2024-05-30T16:56:45.653189+0000","last_became_active":"2024-05-30T16:56:43.642497+0000","last_became_peered":"2024-05-30T16:56:43.642497+0000","last_unstale":"2024-05-30T16:56:45.653189+0000","last_undegraded":"2024-05-30T16:56:45.653189+0000","last_fullsized":"2024-05-30T16:56:45.653189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:46:33.244850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.658847+0000","last_change":"2024-05-30T16:56:44.646527+0000","last_active":"2024-05-30T16:56:44.658847+0000","last_peered":"2024-05-30T16:56:44.658847+0000","last_clean":"2024-05-30T16:56:44.658847+0000","last_became_active":"2024-05-30T16:56:44.646233+0000","last_became_peered":"2024-05-30T16:56:44.646233+0000","last_unstale":"2024-05-30T16:56:44.658847+0000","last_undegraded":"2024-05-30T16:56:44.658847+0000","last_fullsized":"2024-05-30T16:56:44.658847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:51:47.821639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650833+0000","last_change":"2024-05-30T16:56:43.651846+0000","last_active":"2024-05-30T16:56:45.650833+0000","last_peered":"2024-05-30T16:56:45.650833+0000","last_clean":"2024-05-30T16:56:45.650833+0000","last_became_active":"2024-05-30T16:56:43.651253+0000","last_became_peered":"2024-05-30T16:56:43.651253+0000","last_unstale":"2024-05-30T16:56:45.650833+0000","last_undegraded":"2024-05-30T16:56:45.650833+0000","last_fullsized":"2024-05-30T16:56:45.650833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:47.527522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651601+0000","last_change":"2024-05-30T16:56:44.651868+0000","last_active":"2024-05-30T16:56:45.651601+0000","last_peered":"2024-05-30T16:56:45.651601+0000","last_clean":"2024-05-30T16:56:45.651601+0000","last_became_active":"2024-05-30T16:56:44.651600+0000","last_became_peered":"2024-05-30T16:56:44.651600+0000","last_unstale":"2024-05-30T16:56:45.651601+0000","last_undegraded":"2024-05-30T16:56:45.651601+0000","last_fullsized":"2024-05-30T16:56:45.651601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:52:05.375623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317479+0000","last_change":"2024-05-30T16:56:43.647155+0000","last_active":"2024-05-30T16:56:46.317479+0000","last_peered":"2024-05-30T16:56:46.317479+0000","last_clean":"2024-05-30T16:56:46.317479+0000","last_became_active":"2024-05-30T16:56:43.646879+0000","last_became_peered":"2024-05-30T16:56:43.646879+0000","last_unstale":"2024-05-30T16:56:46.317479+0000","last_undegraded":"2024-05-30T16:56:46.317479+0000","last_fullsized":"2024-05-30T16:56:46.317479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:53.002194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653701+0000","last_change":"2024-05-30T16:56:44.643180+0000","last_active":"2024-05-30T16:56:45.653701+0000","last_peered":"2024-05-30T16:56:45.653701+0000","last_clean":"2024-05-30T16:56:45.653701+0000","last_became_active":"2024-05-30T16:56:44.642880+0000","last_became_peered":"2024-05-30T16:56:44.642880+0000","last_unstale":"2024-05-30T16:56:45.653701+0000","last_undegraded":"2024-05-30T16:56:45.653701+0000","last_fullsized":"2024-05-30T16:56:45.653701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:38:16.555934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653975+0000","last_change":"2024-05-30T16:56:43.646647+0000","last_active":"2024-05-30T16:56:45.653975+0000","last_peered":"2024-05-30T16:56:45.653975+0000","last_clean":"2024-05-30T16:56:45.653975+0000","last_became_active":"2024-05-30T16:56:43.646200+0000","last_became_peered":"2024-05-30T16:56:43.646200+0000","last_unstale":"2024-05-30T16:56:45.653975+0000","last_undegraded":"2024-05-30T16:56:45.653975+0000","last_fullsized":"2024-05-30T16:56:45.653975+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:27.365379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548416+0000","last_change":"2024-05-30T16:56:44.669877+0000","last_active":"2024-05-30T16:56:46.548416+0000","last_peered":"2024-05-30T16:56:46.548416+0000","last_clean":"2024-05-30T16:56:46.548416+0000","last_became_active":"2024-05-30T16:56:44.669562+0000","last_became_peered":"2024-05-30T16:56:44.669562+0000","last_unstale":"2024-05-30T16:56:46.548416+0000","last_undegraded":"2024-05-30T16:56:46.548416+0000","last_fullsized":"2024-05-30T16:56:46.548416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:59:28.731114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652045+0000","last_change":"2024-05-30T16:56:43.648834+0000","last_active":"2024-05-30T16:56:45.652045+0000","last_peered":"2024-05-30T16:56:45.652045+0000","last_clean":"2024-05-30T16:56:45.652045+0000","last_became_active":"2024-05-30T16:56:43.648569+0000","last_became_peered":"2024-05-30T16:56:43.648569+0000","last_unstale":"2024-05-30T16:56:45.652045+0000","last_undegraded":"2024-05-30T16:56:45.652045+0000","last_fullsized":"2024-05-30T16:56:45.652045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:43.464267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548587+0000","last_change":"2024-05-30T16:56:44.662124+0000","last_active":"2024-05-30T16:56:46.548587+0000","last_peered":"2024-05-30T16:56:46.548587+0000","last_clean":"2024-05-30T16:56:46.548587+0000","last_became_active":"2024-05-30T16:56:44.661807+0000","last_became_peered":"2024-05-30T16:56:44.661807+0000","last_unstale":"2024-05-30T16:56:46.548587+0000","last_undegraded":"2024-05-30T16:56:46.548587+0000","last_fullsized":"2024-05-30T16:56:46.548587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:05.799103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651433+0000","last_change":"2024-05-30T16:56:43.648503+0000","last_active":"2024-05-30T16:56:45.651433+0000","last_peered":"2024-05-30T16:56:45.651433+0000","last_clean":"2024-05-30T16:56:45.651433+0000","last_became_active":"2024-05-30T16:56:43.648229+0000","last_became_peered":"2024-05-30T16:56:43.648229+0000","last_unstale":"2024-05-30T16:56:45.651433+0000","last_undegraded":"2024-05-30T16:56:45.651433+0000","last_fullsized":"2024-05-30T16:56:45.651433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:28:49.588547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651904+0000","last_change":"2024-05-30T16:56:44.653977+0000","last_active":"2024-05-30T16:56:45.651904+0000","last_peered":"2024-05-30T16:56:45.651904+0000","last_clean":"2024-05-30T16:56:45.651904+0000","last_became_active":"2024-05-30T16:56:44.653708+0000","last_became_peered":"2024-05-30T16:56:44.653708+0000","last_unstale":"2024-05-30T16:56:45.651904+0000","last_undegraded":"2024-05-30T16:56:45.651904+0000","last_fullsized":"2024-05-30T16:56:45.651904+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:13:35.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651897+0000","last_change":"2024-05-30T16:56:43.645417+0000","last_active":"2024-05-30T16:56:45.651897+0000","last_peered":"2024-05-30T16:56:45.651897+0000","last_clean":"2024-05-30T16:56:45.651897+0000","last_became_active":"2024-05-30T16:56:43.645163+0000","last_became_peered":"2024-05-30T16:56:43.645163+0000","last_unstale":"2024-05-30T16:56:45.651897+0000","last_undegraded":"2024-05-30T16:56:45.651897+0000","last_fullsized":"2024-05-30T16:56:45.651897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:24.915924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316854+0000","last_change":"2024-05-30T16:56:44.664261+0000","last_active":"2024-05-30T16:56:46.316854+0000","last_peered":"2024-05-30T16:56:46.316854+0000","last_clean":"2024-05-30T16:56:46.316854+0000","last_became_active":"2024-05-30T16:56:44.658602+0000","last_became_peered":"2024-05-30T16:56:44.658602+0000","last_unstale":"2024-05-30T16:56:46.316854+0000","last_undegraded":"2024-05-30T16:56:46.316854+0000","last_fullsized":"2024-05-30T16:56:46.316854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:46:37.964346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108360+0000","last_change":"2024-05-30T16:56:43.641165+0000","last_active":"2024-05-30T16:56:46.108360+0000","last_peered":"2024-05-30T16:56:46.108360+0000","last_clean":"2024-05-30T16:56:46.108360+0000","last_became_active":"2024-05-30T16:56:43.640904+0000","last_became_peered":"2024-05-30T16:56:43.640904+0000","last_unstale":"2024-05-30T16:56:46.108360+0000","last_undegraded":"2024-05-30T16:56:46.108360+0000","last_fullsized":"2024-05-30T16:56:46.108360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:52.254333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108541+0000","last_change":"2024-05-30T16:56:44.644193+0000","last_active":"2024-05-30T16:56:46.108541+0000","last_peered":"2024-05-30T16:56:46.108541+0000","last_clean":"2024-05-30T16:56:46.108541+0000","last_became_active":"2024-05-30T16:56:44.643801+0000","last_became_peered":"2024-05-30T16:56:44.643801+0000","last_unstale":"2024-05-30T16:56:46.108541+0000","last_undegraded":"2024-05-30T16:56:46.108541+0000","last_fullsized":"2024-05-30T16:56:46.108541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:00.948144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653835+0000","last_change":"2024-05-30T16:56:43.646795+0000","last_active":"2024-05-30T16:56:45.653835+0000","last_peered":"2024-05-30T16:56:45.653835+0000","last_clean":"2024-05-30T16:56:45.653835+0000","last_became_active":"2024-05-30T16:56:43.646434+0000","last_became_peered":"2024-05-30T16:56:43.646434+0000","last_unstale":"2024-05-30T16:56:45.653835+0000","last_undegraded":"2024-05-30T16:56:45.653835+0000","last_fullsized":"2024-05-30T16:56:45.653835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:18.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316609+0000","last_change":"2024-05-30T16:56:44.659417+0000","last_active":"2024-05-30T16:56:46.316609+0000","last_peered":"2024-05-30T16:56:46.316609+0000","last_clean":"2024-05-30T16:56:46.316609+0000","last_became_active":"2024-05-30T16:56:44.659050+0000","last_became_peered":"2024-05-30T16:56:44.659050+0000","last_unstale":"2024-05-30T16:56:46.316609+0000","last_undegraded":"2024-05-30T16:56:46.316609+0000","last_fullsized":"2024-05-30T16:56:46.316609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:19.555324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317192+0000","last_change":"2024-05-30T16:56:43.649787+0000","last_active":"2024-05-30T16:56:46.317192+0000","last_peered":"2024-05-30T16:56:46.317192+0000","last_clean":"2024-05-30T16:56:46.317192+0000","last_became_active":"2024-05-30T16:56:43.649499+0000","last_became_peered":"2024-05-30T16:56:43.649499+0000","last_unstale":"2024-05-30T16:56:46.317192+0000","last_undegraded":"2024-05-30T16:56:46.317192+0000","last_fullsized":"2024-05-30T16:56:46.317192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:04:39.740914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659176+0000","last_change":"2024-05-30T16:56:44.648063+0000","last_active":"2024-05-30T16:56:44.659176+0000","last_peered":"2024-05-30T16:56:44.659176+0000","last_clean":"2024-05-30T16:56:44.659176+0000","last_became_active":"2024-05-30T16:56:44.645752+0000","last_became_peered":"2024-05-30T16:56:44.645752+0000","last_unstale":"2024-05-30T16:56:44.659176+0000","last_undegraded":"2024-05-30T16:56:44.659176+0000","last_fullsized":"2024-05-30T16:56:44.659176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:48.843356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316917+0000","last_change":"2024-05-30T16:56:43.652356+0000","last_active":"2024-05-30T16:56:46.316917+0000","last_peered":"2024-05-30T16:56:46.316917+0000","last_clean":"2024-05-30T16:56:46.316917+0000","last_became_active":"2024-05-30T16:56:43.652065+0000","last_became_peered":"2024-05-30T16:56:43.652065+0000","last_unstale":"2024-05-30T16:56:46.316917+0000","last_undegraded":"2024-05-30T16:56:46.316917+0000","last_fullsized":"2024-05-30T16:56:46.316917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:38.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":271,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548075+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:56:46.548075+0000","last_peered":"2024-05-30T16:56:46.548075+0000","last_clean":"2024-05-30T16:56:46.548075+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:56:46.548075+0000","last_undegraded":"2024-05-30T16:56:46.548075+0000","last_fullsized":"2024-05-30T16:56:46.548075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54860,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316980,"statfs":{"total":96636764160,"available":96580587520,"internally_reserved":0,"allocated":1507328,"data_stored":974184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509538,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54288,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317552,"statfs":{"total":96636764160,"available":96581173248,"internally_reserved":0,"allocated":913408,"data_stored":383292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509538,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50124,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321716,"statfs":{"total":96636764160,"available":96585437184,"internally_reserved":0,"allocated":909312,"data_stored":383290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54280,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317560,"statfs":{"total":96636764160,"available":96581181440,"internally_reserved":0,"allocated":909312,"data_stored":383270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509538,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50124,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321716,"statfs":{"total":96636764160,"available":96585437184,"internally_reserved":0,"allocated":917504,"data_stored":384812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509538,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54296,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317544,"statfs":{"total":96636764160,"available":96581165056,"internally_reserved":0,"allocated":925696,"data_stored":385428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509538,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54856,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316984,"statfs":{"total":96636764160,"available":96580591616,"internally_reserved":0,"allocated":1499136,"data_stored":973568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542242,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58436,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313404,"statfs":{"total":96636764160,"available":96576925696,"internally_reserved":0,"allocated":901120,"data_stored":376928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:56:49.618 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T16:56:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.754+0000 7fe003200640 1 Processor -- start 2024-05-30T16:56:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.754+0000 7fe003200640 1 -- start start 2024-05-30T16:56:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fe003200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00415fcc0 0x7fe0040d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fe003200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe0040b3770 0x7fe00409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fe003200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0041600a0 con 0x7fe00409af80 2024-05-30T16:56:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fe003200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe00409ba80 con 0x7fe0040b3770 2024-05-30T16:56:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fe003200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe0040b4b80 con 0x7fe00415fcc0 2024-05-30T16:56:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fdff9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe0040b3770 0x7fe00409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fdff9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe0040b3770 0x7fe00409aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59216/0 (socket says 172.21.15.59:59216) 2024-05-30T16:56:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fdff9400640 1 -- 172.21.15.59:0/397846062 learned_addr learned my addr 172.21.15.59:0/397846062 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fe001e00640 1 --2- 172.21.15.59:0/397846062 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00415fcc0 0x7fe0040d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:49.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fdff9400640 1 -- 172.21.15.59:0/397846062 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00415fcc0 msgr2=0x7fe0040d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:49.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fdff9400640 1 --2- 172.21.15.59:0/397846062 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00415fcc0 0x7fe0040d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fdff9400640 1 -- 172.21.15.59:0/397846062 >> v1:172.21.15.107:6789/0 conn(0x7fe00409af80 legacy=0x7fe0040cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:49.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fdff9400640 1 -- 172.21.15.59:0/397846062 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00409b710 con 0x7fe0040b3770 2024-05-30T16:56:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fdff9400640 1 --2- 172.21.15.59:0/397846062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0040b3770 0x7fe00409aa40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009870 tx=0x7fdfec01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b7a4091609c258 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.758+0000 7fe001400640 1 -- 172.21.15.59:0/397846062 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0b2070 con 0x7fe0040b3770 2024-05-30T16:56:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe001400640 1 -- 172.21.15.59:0/397846062 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfec0a9070 con 0x7fe0040b3770 2024-05-30T16:56:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe001400640 1 -- 172.21.15.59:0/397846062 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0ad880 con 0x7fe0040b3770 2024-05-30T16:56:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 -- 172.21.15.59:0/397846062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0040b3770 msgr2=0x7fe00409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 --2- 172.21.15.59:0/397846062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0040b3770 0x7fe00409aa40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009870 tx=0x7fdfec01c560 comp rx=0 tx=0).stop 2024-05-30T16:56:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 -- 172.21.15.59:0/397846062 shutdown_connections 2024-05-30T16:56:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 --2- 172.21.15.59:0/397846062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0040b3770 0x7fe00409aa40 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 --2- 172.21.15.59:0/397846062 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00415fcc0 0x7fe0040d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 -- 172.21.15.59:0/397846062 >> 172.21.15.59:0/397846062 conn(0x7fe0040b3ec0 msgr2=0x7fe0040b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 -- 172.21.15.59:0/397846062 shutdown_connections 2024-05-30T16:56:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 -- 172.21.15.59:0/397846062 wait complete. 2024-05-30T16:56:49.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 Processor -- start 2024-05-30T16:56:49.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 -- start start 2024-05-30T16:56:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00409af80 0x7fe00415b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0040b3770 0x7fe00415e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00415fcc0 0x7fe004158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0040b32d0 con 0x7fe0040b3770 2024-05-30T16:56:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe0040b3150 con 0x7fe00409af80 2024-05-30T16:56:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe003200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe004169b40 con 0x7fe00415fcc0 2024-05-30T16:56:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fdff9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0040b3770 0x7fe00415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fdff9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0040b3770 0x7fe00415e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59228/0 (socket says 172.21.15.59:59228) 2024-05-30T16:56:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fdff9400640 1 -- 172.21.15.59:0/2513516174 learned_addr learned my addr 172.21.15.59:0/2513516174 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe001e00640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00409af80 0x7fe00415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe002800640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00415fcc0 0x7fe004158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fdff9400640 1 -- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00415fcc0 msgr2=0x7fe004158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fdff9400640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00415fcc0 0x7fe004158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fdff9400640 1 -- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00409af80 msgr2=0x7fe00415b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fdff9400640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00409af80 0x7fe00415b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fdff9400640 1 -- 172.21.15.59:0/2513516174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00415ea40 con 0x7fe0040b3770 2024-05-30T16:56:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.762+0000 7fe002800640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00415fcc0 0x7fe004158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.766+0000 7fdff9400640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0040b3770 0x7fe00415e500 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdfec01a190 tx=0x7fdfec019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.766+0000 7fdffaa00640 1 -- 172.21.15.59:0/2513516174 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0bb070 con 0x7fe0040b3770 2024-05-30T16:56:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.766+0000 7fdffaa00640 1 -- 172.21.15.59:0/2513516174 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfec0addb0 con 0x7fe0040b3770 2024-05-30T16:56:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.766+0000 7fdffaa00640 1 -- 172.21.15.59:0/2513516174 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0b2040 con 0x7fe0040b3770 2024-05-30T16:56:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.766+0000 7fe003200640 1 -- 172.21.15.59:0/2513516174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00415bdf0 con 0x7fe0040b3770 2024-05-30T16:56:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.766+0000 7fe003200640 1 -- 172.21.15.59:0/2513516174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00415c3b0 con 0x7fe0040b3770 2024-05-30T16:56:49.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.766+0000 7fe003200640 1 -- 172.21.15.59:0/2513516174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe004068a90 con 0x7fe0040b3770 2024-05-30T16:56:49.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.766+0000 7fdffaa00640 1 -- 172.21.15.59:0/2513516174 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7fdfec0ab070 con 0x7fe0040b3770 2024-05-30T16:56:49.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.766+0000 7fdffaa00640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfe0069070 0x7fdfe006b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:49.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.766+0000 7fdffaa00640 1 -- 172.21.15.59:0/2513516174 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7fdfec11e4a0 con 0x7fe0040b3770 2024-05-30T16:56:49.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.766+0000 7fe001e00640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfe0069070 0x7fdfe006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:49.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.770+0000 7fe001e00640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfe0069070 0x7fdfe006b530 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdff40079c0 tx=0x7fdff4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:49.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.770+0000 7fdffaa00640 1 -- 172.21.15.59:0/2513516174 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdfec016150 con 0x7fe0040b3770 2024-05-30T16:56:50.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.998+0000 7fe003200640 1 -- 172.21.15.59:0/2513516174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe00415a360 con 0x7fe0040b3770 2024-05-30T16:56:50.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:49.998+0000 7fdffaa00640 1 -- 172.21.15.59:0/2513516174 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1014 (secure 0 0 0) 0x7fdfec0efbd0 con 0x7fe0040b3770 2024-05-30T16:56:50.004 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:50.004 INFO:teuthology.orchestra.run.smithi059.stdout:{"fsid":"97857630-028c-48a2-897f-bf5f996be133","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":489,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":75,"num_osds":8,"num_up_osds":8,"osd_up_since":1717087732,"num_in_osds":8,"osd_in_since":1717087722,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":441614336,"bytes_avail":772652498944,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":42,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":6528}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-05-30T16:55:53.196869+0000","services":{}},"progress_events":{}} 2024-05-30T16:56:50.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.002+0000 7fe003200640 1 -- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfe0069070 msgr2=0x7fdfe006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:50.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.002+0000 7fe003200640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfe0069070 0x7fdfe006b530 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdff40079c0 tx=0x7fdff4008040 comp rx=0 tx=0).stop 2024-05-30T16:56:50.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.002+0000 7fe003200640 1 -- 172.21.15.59:0/2513516174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0040b3770 msgr2=0x7fe00415e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:50.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.002+0000 7fe003200640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0040b3770 0x7fe00415e500 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdfec01a190 tx=0x7fdfec019300 comp rx=0 tx=0).stop 2024-05-30T16:56:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.002+0000 7fe003200640 1 -- 172.21.15.59:0/2513516174 shutdown_connections 2024-05-30T16:56:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.002+0000 7fe003200640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfe0069070 0x7fdfe006b530 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.002+0000 7fe003200640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00415fcc0 0x7fe004158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.002+0000 7fe003200640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0040b3770 0x7fe00415e500 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.002+0000 7fe003200640 1 --2- 172.21.15.59:0/2513516174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00409af80 0x7fe00415b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.002+0000 7fe003200640 1 -- 172.21.15.59:0/2513516174 >> 172.21.15.59:0/2513516174 conn(0x7fe0040b3ec0 msgr2=0x7fe004159490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.002+0000 7fe003200640 1 -- 172.21.15.59:0/2513516174 shutdown_connections 2024-05-30T16:56:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.002+0000 7fe003200640 1 -- 172.21.15.59:0/2513516174 wait complete. 2024-05-30T16:56:50.026 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-30T16:56:50.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:56:50.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f94aee00640 1 Processor -- start 2024-05-30T16:56:50.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f94aee00640 1 -- start start 2024-05-30T16:56:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f94aee00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f94a80af720 0x7f94a815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f94aee00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94a806e900 0x7f94a815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f94aee00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94a815f060 con 0x7f94a80d0560 2024-05-30T16:56:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f94aee00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f94a80afb00 con 0x7f94a806e900 2024-05-30T16:56:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f94aee00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f94a815c270 con 0x7f94a80af720 2024-05-30T16:56:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f949fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94a806e900 0x7f94a815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f949fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94a806e900 0x7f94a815f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59242/0 (socket says 172.21.15.59:59242) 2024-05-30T16:56:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f949fe00640 1 -- 172.21.15.59:0/999986571 learned_addr learned my addr 172.21.15.59:0/999986571 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:50.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f94a7e00640 1 --2- 172.21.15.59:0/999986571 >> v2:172.21.15.107:3300/0 conn(0x7f94a80af720 0x7f94a815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:50.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f949fe00640 1 -- 172.21.15.59:0/999986571 >> v2:172.21.15.107:3300/0 conn(0x7f94a80af720 msgr2=0x7f94a815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:50.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f949fe00640 1 --2- 172.21.15.59:0/999986571 >> v2:172.21.15.107:3300/0 conn(0x7f94a80af720 0x7f94a815b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f949fe00640 1 -- 172.21.15.59:0/999986571 >> v1:172.21.15.107:6789/0 conn(0x7f94a80d0560 legacy=0x7f94a8072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:50.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.162+0000 7f949fe00640 1 -- 172.21.15.59:0/999986571 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a815c550 con 0x7f94a806e900 2024-05-30T16:56:50.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f94a7e00640 1 --2- 172.21.15.59:0/999986571 >> v2:172.21.15.107:3300/0 conn(0x7f94a80af720 0x7f94a815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:50.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f949fe00640 1 --2- 172.21.15.59:0/999986571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a806e900 0x7f94a815f7f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f94a80d04b0 tx=0x7f949001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d166ffc2bcaa1ea7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:50.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f94a7400640 1 -- 172.21.15.59:0/999986571 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94900aa430 con 0x7f94a806e900 2024-05-30T16:56:50.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f94a7400640 1 -- 172.21.15.59:0/999986571 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94900af070 con 0x7f94a806e900 2024-05-30T16:56:50.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f94a7400640 1 -- 172.21.15.59:0/999986571 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94900aa7f0 con 0x7f94a806e900 2024-05-30T16:56:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f94aee00640 1 -- 172.21.15.59:0/999986571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a806e900 msgr2=0x7f94a815f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f94aee00640 1 --2- 172.21.15.59:0/999986571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a806e900 0x7f94a815f7f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f94a80d04b0 tx=0x7f949001c4b0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f94aee00640 1 -- 172.21.15.59:0/999986571 shutdown_connections 2024-05-30T16:56:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f94aee00640 1 --2- 172.21.15.59:0/999986571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a806e900 0x7f94a815f7f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f94aee00640 1 --2- 172.21.15.59:0/999986571 >> v2:172.21.15.107:3300/0 conn(0x7f94a80af720 0x7f94a815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f94aee00640 1 -- 172.21.15.59:0/999986571 >> 172.21.15.59:0/999986571 conn(0x7f94a80b22d0 msgr2=0x7f94a80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f94aee00640 1 -- 172.21.15.59:0/999986571 shutdown_connections 2024-05-30T16:56:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.166+0000 7f94aee00640 1 -- 172.21.15.59:0/999986571 wait complete. 2024-05-30T16:56:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94aee00640 1 Processor -- start 2024-05-30T16:56:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94aee00640 1 -- start start 2024-05-30T16:56:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94aee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a806e900 0x7f94a80cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94aee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94a80af720 0x7f94a814e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94aee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a80d0560 0x7f94a80cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94aee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94a815fd30 con 0x7f94a80d0560 2024-05-30T16:56:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94aee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f94a815c830 con 0x7f94a806e900 2024-05-30T16:56:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94aee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f94a815feb0 con 0x7f94a80af720 2024-05-30T16:56:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94ace00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a80d0560 0x7f94a80cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94ace00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a80d0560 0x7f94a80cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59252/0 (socket says 172.21.15.59:59252) 2024-05-30T16:56:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94ace00640 1 -- 172.21.15.59:0/2754440490 learned_addr learned my addr 172.21.15.59:0/2754440490 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94ace00640 1 -- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94a80af720 msgr2=0x7f94a814e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94a7e00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a806e900 0x7f94a80cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f949fe00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94a80af720 0x7f94a814e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94ace00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94a80af720 0x7f94a814e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94ace00640 1 -- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a806e900 msgr2=0x7f94a80cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94ace00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a806e900 0x7f94a80cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94ace00640 1 -- 172.21.15.59:0/2754440490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a80ce100 con 0x7f94a80d0560 2024-05-30T16:56:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f949fe00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94a80af720 0x7f94a814e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94a7e00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a806e900 0x7f94a80cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94ace00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a80d0560 0x7f94a80cf1a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f94a000b9c0 tx=0x7f94a000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94a4c00640 1 -- 172.21.15.59:0/2754440490 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a0019070 con 0x7f94a80d0560 2024-05-30T16:56:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94a4c00640 1 -- 172.21.15.59:0/2754440490 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a000cba0 con 0x7f94a80d0560 2024-05-30T16:56:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94a4c00640 1 -- 172.21.15.59:0/2754440490 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a0014440 con 0x7f94a80d0560 2024-05-30T16:56:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94aee00640 1 -- 172.21.15.59:0/2754440490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a80ce3e0 con 0x7f94a80d0560 2024-05-30T16:56:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.170+0000 7f94aee00640 1 -- 172.21.15.59:0/2754440490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a80ce9a0 con 0x7f94a80d0560 2024-05-30T16:56:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.174+0000 7f94aee00640 1 -- 172.21.15.59:0/2754440490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94a8068a90 con 0x7f94a80d0560 2024-05-30T16:56:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.174+0000 7f94a4c00640 1 -- 172.21.15.59:0/2754440490 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f94a001c070 con 0x7f94a80d0560 2024-05-30T16:56:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.174+0000 7f94a4c00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9484069070 0x7f948406b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.174+0000 7f94a4c00640 1 -- 172.21.15.59:0/2754440490 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f94a00850d0 con 0x7f94a80d0560 2024-05-30T16:56:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.174+0000 7f94a7e00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9484069070 0x7f948406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.174+0000 7f94a7e00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9484069070 0x7f948406b530 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9498008930 tx=0x7f9498008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.178+0000 7f94a4c00640 1 -- 172.21.15.59:0/2754440490 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f94a0057140 con 0x7f94a80d0560 2024-05-30T16:56:50.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.338+0000 7f94aee00640 1 -- 172.21.15.59:0/2754440490 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94a806e6e0 con 0x7f9484069070 2024-05-30T16:56:50.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94a4c00640 1 -- 172.21.15.59:0/2754440490 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252062 (secure 0 0 0) 0x7f94a806e6e0 con 0x7f9484069070 2024-05-30T16:56:50.353 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:50.355 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:56:50.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94aee00640 1 -- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9484069070 msgr2=0x7f948406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:50.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94aee00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9484069070 0x7f948406b530 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9498008930 tx=0x7f9498008040 comp rx=0 tx=0).stop 2024-05-30T16:56:50.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94aee00640 1 -- 172.21.15.59:0/2754440490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a80d0560 msgr2=0x7f94a80cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:50.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94aee00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a80d0560 0x7f94a80cf1a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f94a000b9c0 tx=0x7f94a000be80 comp rx=0 tx=0).stop 2024-05-30T16:56:50.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94aee00640 1 -- 172.21.15.59:0/2754440490 shutdown_connections 2024-05-30T16:56:50.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94aee00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9484069070 0x7f948406b530 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94aee00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a80d0560 0x7f94a80cf1a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94aee00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94a80af720 0x7f94a814e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94aee00640 1 --2- 172.21.15.59:0/2754440490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a806e900 0x7f94a80cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:50.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94aee00640 1 -- 172.21.15.59:0/2754440490 >> 172.21.15.59:0/2754440490 conn(0x7f94a80b22d0 msgr2=0x7f94a80b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:50.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94aee00640 1 -- 172.21.15.59:0/2754440490 shutdown_connections 2024-05-30T16:56:50.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:50.350+0000 7f94aee00640 1 -- 172.21.15.59:0/2754440490 wait complete. 2024-05-30T16:56:50.374 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-05-30T16:56:49.210530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431264,"kb_used_data":8284,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754543456,"statfs":{"total":773094113280,"available":772652498944,"internally_reserved":0,"allocated":8482816,"data_stored":4244772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001233"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548612+0000","last_change":"2024-05-30T16:56:44.668865+0000","last_active":"2024-05-30T16:56:46.548612+0000","last_peered":"2024-05-30T16:56:46.548612+0000","last_clean":"2024-05-30T16:56:46.548612+0000","last_became_active":"2024-05-30T16:56:44.668040+0000","last_became_peered":"2024-05-30T16:56:44.668040+0000","last_unstale":"2024-05-30T16:56:46.548612+0000","last_undegraded":"2024-05-30T16:56:46.548612+0000","last_fullsized":"2024-05-30T16:56:46.548612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:56.908682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317318+0000","last_change":"2024-05-30T16:56:44.661763+0000","last_active":"2024-05-30T16:56:46.317318+0000","last_peered":"2024-05-30T16:56:46.317318+0000","last_clean":"2024-05-30T16:56:46.317318+0000","last_became_active":"2024-05-30T16:56:44.658746+0000","last_became_peered":"2024-05-30T16:56:44.658746+0000","last_unstale":"2024-05-30T16:56:46.317318+0000","last_undegraded":"2024-05-30T16:56:46.317318+0000","last_fullsized":"2024-05-30T16:56:46.317318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:22:17.380165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.661199+0000","last_change":"2024-05-30T16:56:44.649217+0000","last_active":"2024-05-30T16:56:44.661199+0000","last_peered":"2024-05-30T16:56:44.661199+0000","last_clean":"2024-05-30T16:56:44.661199+0000","last_became_active":"2024-05-30T16:56:44.648928+0000","last_became_peered":"2024-05-30T16:56:44.648928+0000","last_unstale":"2024-05-30T16:56:44.661199+0000","last_undegraded":"2024-05-30T16:56:44.661199+0000","last_fullsized":"2024-05-30T16:56:44.661199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:00:34.724863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108660+0000","last_change":"2024-05-30T16:56:44.642320+0000","last_active":"2024-05-30T16:56:46.108660+0000","last_peered":"2024-05-30T16:56:46.108660+0000","last_clean":"2024-05-30T16:56:46.108660+0000","last_became_active":"2024-05-30T16:56:44.641997+0000","last_became_peered":"2024-05-30T16:56:44.641997+0000","last_unstale":"2024-05-30T16:56:46.108660+0000","last_undegraded":"2024-05-30T16:56:46.108660+0000","last_fullsized":"2024-05-30T16:56:46.108660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:54.005648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651793+0000","last_change":"2024-05-30T16:56:44.662425+0000","last_active":"2024-05-30T16:56:45.651793+0000","last_peered":"2024-05-30T16:56:45.651793+0000","last_clean":"2024-05-30T16:56:45.651793+0000","last_became_active":"2024-05-30T16:56:44.662074+0000","last_became_peered":"2024-05-30T16:56:44.662074+0000","last_unstale":"2024-05-30T16:56:45.651793+0000","last_undegraded":"2024-05-30T16:56:45.651793+0000","last_fullsized":"2024-05-30T16:56:45.651793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:50.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316759+0000","last_change":"2024-05-30T16:56:44.651788+0000","last_active":"2024-05-30T16:56:46.316759+0000","last_peered":"2024-05-30T16:56:46.316759+0000","last_clean":"2024-05-30T16:56:46.316759+0000","last_became_active":"2024-05-30T16:56:44.651285+0000","last_became_peered":"2024-05-30T16:56:44.651285+0000","last_unstale":"2024-05-30T16:56:46.316759+0000","last_undegraded":"2024-05-30T16:56:46.316759+0000","last_fullsized":"2024-05-30T16:56:46.316759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:24.866601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652823+0000","last_change":"2024-05-30T16:56:44.645072+0000","last_active":"2024-05-30T16:56:45.652823+0000","last_peered":"2024-05-30T16:56:45.652823+0000","last_clean":"2024-05-30T16:56:45.652823+0000","last_became_active":"2024-05-30T16:56:44.644787+0000","last_became_peered":"2024-05-30T16:56:44.644787+0000","last_unstale":"2024-05-30T16:56:45.652823+0000","last_undegraded":"2024-05-30T16:56:45.652823+0000","last_fullsized":"2024-05-30T16:56:45.652823+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:41:03.009179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316880+0000","last_change":"2024-05-30T16:56:44.642515+0000","last_active":"2024-05-30T16:56:46.316880+0000","last_peered":"2024-05-30T16:56:46.316880+0000","last_clean":"2024-05-30T16:56:46.316880+0000","last_became_active":"2024-05-30T16:56:44.641722+0000","last_became_peered":"2024-05-30T16:56:44.641722+0000","last_unstale":"2024-05-30T16:56:46.316880+0000","last_undegraded":"2024-05-30T16:56:46.316880+0000","last_fullsized":"2024-05-30T16:56:46.316880+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:40:11.045382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652160+0000","last_change":"2024-05-30T16:56:44.652304+0000","last_active":"2024-05-30T16:56:45.652160+0000","last_peered":"2024-05-30T16:56:45.652160+0000","last_clean":"2024-05-30T16:56:45.652160+0000","last_became_active":"2024-05-30T16:56:44.651824+0000","last_became_peered":"2024-05-30T16:56:44.651824+0000","last_unstale":"2024-05-30T16:56:45.652160+0000","last_undegraded":"2024-05-30T16:56:45.652160+0000","last_fullsized":"2024-05-30T16:56:45.652160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:53.257788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653994+0000","last_change":"2024-05-30T16:56:44.656226+0000","last_active":"2024-05-30T16:56:45.653994+0000","last_peered":"2024-05-30T16:56:45.653994+0000","last_clean":"2024-05-30T16:56:45.653994+0000","last_became_active":"2024-05-30T16:56:44.653473+0000","last_became_peered":"2024-05-30T16:56:44.653473+0000","last_unstale":"2024-05-30T16:56:45.653994+0000","last_undegraded":"2024-05-30T16:56:45.653994+0000","last_fullsized":"2024-05-30T16:56:45.653994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:41:03.009179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548464+0000","last_change":"2024-05-30T16:56:44.663730+0000","last_active":"2024-05-30T16:56:46.548464+0000","last_peered":"2024-05-30T16:56:46.548464+0000","last_clean":"2024-05-30T16:56:46.548464+0000","last_became_active":"2024-05-30T16:56:44.663105+0000","last_became_peered":"2024-05-30T16:56:44.663105+0000","last_unstale":"2024-05-30T16:56:46.548464+0000","last_undegraded":"2024-05-30T16:56:46.548464+0000","last_fullsized":"2024-05-30T16:56:46.548464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:08:06.277998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108702+0000","last_change":"2024-05-30T16:56:44.660270+0000","last_active":"2024-05-30T16:56:46.108702+0000","last_peered":"2024-05-30T16:56:46.108702+0000","last_clean":"2024-05-30T16:56:46.108702+0000","last_became_active":"2024-05-30T16:56:44.656543+0000","last_became_peered":"2024-05-30T16:56:44.656543+0000","last_unstale":"2024-05-30T16:56:46.108702+0000","last_undegraded":"2024-05-30T16:56:46.108702+0000","last_fullsized":"2024-05-30T16:56:46.108702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:00:02.004468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651329+0000","last_change":"2024-05-30T16:56:44.642746+0000","last_active":"2024-05-30T16:56:45.651329+0000","last_peered":"2024-05-30T16:56:45.651329+0000","last_clean":"2024-05-30T16:56:45.651329+0000","last_became_active":"2024-05-30T16:56:44.642473+0000","last_became_peered":"2024-05-30T16:56:44.642473+0000","last_unstale":"2024-05-30T16:56:45.651329+0000","last_undegraded":"2024-05-30T16:56:45.651329+0000","last_fullsized":"2024-05-30T16:56:45.651329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:06:54.613794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651812+0000","last_change":"2024-05-30T16:56:44.658635+0000","last_active":"2024-05-30T16:56:45.651812+0000","last_peered":"2024-05-30T16:56:45.651812+0000","last_clean":"2024-05-30T16:56:45.651812+0000","last_became_active":"2024-05-30T16:56:44.658374+0000","last_became_peered":"2024-05-30T16:56:44.658374+0000","last_unstale":"2024-05-30T16:56:45.651812+0000","last_undegraded":"2024-05-30T16:56:45.651812+0000","last_fullsized":"2024-05-30T16:56:45.651812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:03:27.939224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650895+0000","last_change":"2024-05-30T16:56:44.652408+0000","last_active":"2024-05-30T16:56:45.650895+0000","last_peered":"2024-05-30T16:56:45.650895+0000","last_clean":"2024-05-30T16:56:45.650895+0000","last_became_active":"2024-05-30T16:56:44.652139+0000","last_became_peered":"2024-05-30T16:56:44.652139+0000","last_unstale":"2024-05-30T16:56:45.650895+0000","last_undegraded":"2024-05-30T16:56:45.650895+0000","last_fullsized":"2024-05-30T16:56:45.650895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:38:16.555934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652763+0000","last_change":"2024-05-30T16:56:44.664085+0000","last_active":"2024-05-30T16:56:45.652763+0000","last_peered":"2024-05-30T16:56:45.652763+0000","last_clean":"2024-05-30T16:56:45.652763+0000","last_became_active":"2024-05-30T16:56:44.663813+0000","last_became_peered":"2024-05-30T16:56:44.663813+0000","last_unstale":"2024-05-30T16:56:45.652763+0000","last_undegraded":"2024-05-30T16:56:45.652763+0000","last_fullsized":"2024-05-30T16:56:45.652763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:48.530977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652173+0000","last_change":"2024-05-30T16:56:44.649373+0000","last_active":"2024-05-30T16:56:45.652173+0000","last_peered":"2024-05-30T16:56:45.652173+0000","last_clean":"2024-05-30T16:56:45.652173+0000","last_became_active":"2024-05-30T16:56:44.649085+0000","last_became_peered":"2024-05-30T16:56:44.649085+0000","last_unstale":"2024-05-30T16:56:45.652173+0000","last_undegraded":"2024-05-30T16:56:45.652173+0000","last_fullsized":"2024-05-30T16:56:45.652173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:38.575100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108768+0000","last_change":"2024-05-30T16:56:44.644524+0000","last_active":"2024-05-30T16:56:46.108768+0000","last_peered":"2024-05-30T16:56:46.108768+0000","last_clean":"2024-05-30T16:56:46.108768+0000","last_became_active":"2024-05-30T16:56:44.643377+0000","last_became_peered":"2024-05-30T16:56:44.643377+0000","last_unstale":"2024-05-30T16:56:46.108768+0000","last_undegraded":"2024-05-30T16:56:46.108768+0000","last_fullsized":"2024-05-30T16:56:46.108768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:16:01.798245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317074+0000","last_change":"2024-05-30T16:56:44.649026+0000","last_active":"2024-05-30T16:56:46.317074+0000","last_peered":"2024-05-30T16:56:46.317074+0000","last_clean":"2024-05-30T16:56:46.317074+0000","last_became_active":"2024-05-30T16:56:44.648420+0000","last_became_peered":"2024-05-30T16:56:44.648420+0000","last_unstale":"2024-05-30T16:56:46.317074+0000","last_undegraded":"2024-05-30T16:56:46.317074+0000","last_fullsized":"2024-05-30T16:56:46.317074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:09:04.016326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651285+0000","last_change":"2024-05-30T16:56:44.646135+0000","last_active":"2024-05-30T16:56:45.651285+0000","last_peered":"2024-05-30T16:56:45.651285+0000","last_clean":"2024-05-30T16:56:45.651285+0000","last_became_active":"2024-05-30T16:56:44.645002+0000","last_became_peered":"2024-05-30T16:56:44.645002+0000","last_unstale":"2024-05-30T16:56:45.651285+0000","last_undegraded":"2024-05-30T16:56:45.651285+0000","last_fullsized":"2024-05-30T16:56:45.651285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:18:37.099872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653598+0000","last_change":"2024-05-30T16:56:44.652466+0000","last_active":"2024-05-30T16:56:45.653598+0000","last_peered":"2024-05-30T16:56:45.653598+0000","last_clean":"2024-05-30T16:56:45.653598+0000","last_became_active":"2024-05-30T16:56:44.652159+0000","last_became_peered":"2024-05-30T16:56:44.652159+0000","last_unstale":"2024-05-30T16:56:45.653598+0000","last_undegraded":"2024-05-30T16:56:45.653598+0000","last_fullsized":"2024-05-30T16:56:45.653598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:58.919044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653237+0000","last_change":"2024-05-30T16:56:44.651849+0000","last_active":"2024-05-30T16:56:45.653237+0000","last_peered":"2024-05-30T16:56:45.653237+0000","last_clean":"2024-05-30T16:56:45.653237+0000","last_became_active":"2024-05-30T16:56:44.651587+0000","last_became_peered":"2024-05-30T16:56:44.651587+0000","last_unstale":"2024-05-30T16:56:45.653237+0000","last_undegraded":"2024-05-30T16:56:45.653237+0000","last_fullsized":"2024-05-30T16:56:45.653237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:28:50.592002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548147+0000","last_change":"2024-05-30T16:56:44.662385+0000","last_active":"2024-05-30T16:56:46.548147+0000","last_peered":"2024-05-30T16:56:46.548147+0000","last_clean":"2024-05-30T16:56:46.548147+0000","last_became_active":"2024-05-30T16:56:44.662083+0000","last_became_peered":"2024-05-30T16:56:44.662083+0000","last_unstale":"2024-05-30T16:56:46.548147+0000","last_undegraded":"2024-05-30T16:56:46.548147+0000","last_fullsized":"2024-05-30T16:56:46.548147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:16:01.303332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548254+0000","last_change":"2024-05-30T16:56:44.670256+0000","last_active":"2024-05-30T16:56:46.548254+0000","last_peered":"2024-05-30T16:56:46.548254+0000","last_clean":"2024-05-30T16:56:46.548254+0000","last_became_active":"2024-05-30T16:56:44.669963+0000","last_became_peered":"2024-05-30T16:56:44.669963+0000","last_unstale":"2024-05-30T16:56:46.548254+0000","last_undegraded":"2024-05-30T16:56:46.548254+0000","last_fullsized":"2024-05-30T16:56:46.548254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:01:10.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654066+0000","last_change":"2024-05-30T16:56:44.653100+0000","last_active":"2024-05-30T16:56:45.654066+0000","last_peered":"2024-05-30T16:56:45.654066+0000","last_clean":"2024-05-30T16:56:45.654066+0000","last_became_active":"2024-05-30T16:56:44.652785+0000","last_became_peered":"2024-05-30T16:56:44.652785+0000","last_unstale":"2024-05-30T16:56:45.654066+0000","last_undegraded":"2024-05-30T16:56:45.654066+0000","last_fullsized":"2024-05-30T16:56:45.654066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:24:18.478717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653867+0000","last_change":"2024-05-30T16:56:44.642985+0000","last_active":"2024-05-30T16:56:45.653867+0000","last_peered":"2024-05-30T16:56:45.653867+0000","last_clean":"2024-05-30T16:56:45.653867+0000","last_became_active":"2024-05-30T16:56:44.642676+0000","last_became_peered":"2024-05-30T16:56:44.642676+0000","last_unstale":"2024-05-30T16:56:45.653867+0000","last_undegraded":"2024-05-30T16:56:45.653867+0000","last_fullsized":"2024-05-30T16:56:45.653867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:36.158094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.661222+0000","last_change":"2024-05-30T16:56:44.651182+0000","last_active":"2024-05-30T16:56:44.661222+0000","last_peered":"2024-05-30T16:56:44.661222+0000","last_clean":"2024-05-30T16:56:44.661222+0000","last_became_active":"2024-05-30T16:56:44.650908+0000","last_became_peered":"2024-05-30T16:56:44.650908+0000","last_unstale":"2024-05-30T16:56:44.661222+0000","last_undegraded":"2024-05-30T16:56:44.661222+0000","last_fullsized":"2024-05-30T16:56:44.661222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:49:02.259652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653508+0000","last_change":"2024-05-30T16:56:44.654286+0000","last_active":"2024-05-30T16:56:45.653508+0000","last_peered":"2024-05-30T16:56:45.653508+0000","last_clean":"2024-05-30T16:56:45.653508+0000","last_became_active":"2024-05-30T16:56:44.653927+0000","last_became_peered":"2024-05-30T16:56:44.653927+0000","last_unstale":"2024-05-30T16:56:45.653508+0000","last_undegraded":"2024-05-30T16:56:45.653508+0000","last_fullsized":"2024-05-30T16:56:45.653508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:44.828514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659298+0000","last_change":"2024-05-30T16:56:44.650936+0000","last_active":"2024-05-30T16:56:44.659298+0000","last_peered":"2024-05-30T16:56:44.659298+0000","last_clean":"2024-05-30T16:56:44.659298+0000","last_became_active":"2024-05-30T16:56:44.650397+0000","last_became_peered":"2024-05-30T16:56:44.650397+0000","last_unstale":"2024-05-30T16:56:44.659298+0000","last_undegraded":"2024-05-30T16:56:44.659298+0000","last_fullsized":"2024-05-30T16:56:44.659298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:52.457119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652885+0000","last_change":"2024-05-30T16:56:44.643854+0000","last_active":"2024-05-30T16:56:45.652885+0000","last_peered":"2024-05-30T16:56:45.652885+0000","last_clean":"2024-05-30T16:56:45.652885+0000","last_became_active":"2024-05-30T16:56:44.643513+0000","last_became_peered":"2024-05-30T16:56:44.643513+0000","last_unstale":"2024-05-30T16:56:45.652885+0000","last_undegraded":"2024-05-30T16:56:45.652885+0000","last_fullsized":"2024-05-30T16:56:45.652885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:45:54.673385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653096+0000","last_change":"2024-05-30T16:56:44.650198+0000","last_active":"2024-05-30T16:56:45.653096+0000","last_peered":"2024-05-30T16:56:45.653096+0000","last_clean":"2024-05-30T16:56:45.653096+0000","last_became_active":"2024-05-30T16:56:44.649852+0000","last_became_peered":"2024-05-30T16:56:44.649852+0000","last_unstale":"2024-05-30T16:56:45.653096+0000","last_undegraded":"2024-05-30T16:56:45.653096+0000","last_fullsized":"2024-05-30T16:56:45.653096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:24:18.478717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317162+0000","last_change":"2024-05-30T16:56:44.646102+0000","last_active":"2024-05-30T16:56:46.317162+0000","last_peered":"2024-05-30T16:56:46.317162+0000","last_clean":"2024-05-30T16:56:46.317162+0000","last_became_active":"2024-05-30T16:56:44.645809+0000","last_became_peered":"2024-05-30T16:56:44.645809+0000","last_unstale":"2024-05-30T16:56:46.317162+0000","last_undegraded":"2024-05-30T16:56:46.317162+0000","last_fullsized":"2024-05-30T16:56:46.317162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:01:20.685589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548620+0000","last_change":"2024-05-30T16:56:44.669763+0000","last_active":"2024-05-30T16:56:46.548620+0000","last_peered":"2024-05-30T16:56:46.548620+0000","last_clean":"2024-05-30T16:56:46.548620+0000","last_became_active":"2024-05-30T16:56:44.669357+0000","last_became_peered":"2024-05-30T16:56:44.669357+0000","last_unstale":"2024-05-30T16:56:46.548620+0000","last_undegraded":"2024-05-30T16:56:46.548620+0000","last_fullsized":"2024-05-30T16:56:46.548620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:03.908739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548770+0000","last_change":"2024-05-30T16:56:43.652722+0000","last_active":"2024-05-30T16:56:46.548770+0000","last_peered":"2024-05-30T16:56:46.548770+0000","last_clean":"2024-05-30T16:56:46.548770+0000","last_became_active":"2024-05-30T16:56:43.652368+0000","last_became_peered":"2024-05-30T16:56:43.652368+0000","last_unstale":"2024-05-30T16:56:46.548770+0000","last_undegraded":"2024-05-30T16:56:46.548770+0000","last_fullsized":"2024-05-30T16:56:46.548770+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:41:02.005724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652233+0000","last_change":"2024-05-30T16:56:44.652087+0000","last_active":"2024-05-30T16:56:45.652233+0000","last_peered":"2024-05-30T16:56:45.652233+0000","last_clean":"2024-05-30T16:56:45.652233+0000","last_became_active":"2024-05-30T16:56:44.651426+0000","last_became_peered":"2024-05-30T16:56:44.651426+0000","last_unstale":"2024-05-30T16:56:45.652233+0000","last_undegraded":"2024-05-30T16:56:45.652233+0000","last_fullsized":"2024-05-30T16:56:45.652233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:56.981440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651747+0000","last_change":"2024-05-30T16:56:43.652242+0000","last_active":"2024-05-30T16:56:45.651747+0000","last_peered":"2024-05-30T16:56:45.651747+0000","last_clean":"2024-05-30T16:56:45.651747+0000","last_became_active":"2024-05-30T16:56:43.651954+0000","last_became_peered":"2024-05-30T16:56:43.651954+0000","last_unstale":"2024-05-30T16:56:45.651747+0000","last_undegraded":"2024-05-30T16:56:45.651747+0000","last_fullsized":"2024-05-30T16:56:45.651747+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:43.825060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317283+0000","last_change":"2024-05-30T16:56:44.658539+0000","last_active":"2024-05-30T16:56:46.317283+0000","last_peered":"2024-05-30T16:56:46.317283+0000","last_clean":"2024-05-30T16:56:46.317283+0000","last_became_active":"2024-05-30T16:56:44.658254+0000","last_became_peered":"2024-05-30T16:56:44.658254+0000","last_unstale":"2024-05-30T16:56:46.317283+0000","last_undegraded":"2024-05-30T16:56:46.317283+0000","last_fullsized":"2024-05-30T16:56:46.317283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:46:34.248305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653628+0000","last_change":"2024-05-30T16:56:43.643351+0000","last_active":"2024-05-30T16:56:45.653628+0000","last_peered":"2024-05-30T16:56:45.653628+0000","last_clean":"2024-05-30T16:56:45.653628+0000","last_became_active":"2024-05-30T16:56:43.643086+0000","last_became_peered":"2024-05-30T16:56:43.643086+0000","last_unstale":"2024-05-30T16:56:45.653628+0000","last_undegraded":"2024-05-30T16:56:45.653628+0000","last_fullsized":"2024-05-30T16:56:45.653628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:23.863146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548563+0000","last_change":"2024-05-30T16:56:44.665209+0000","last_active":"2024-05-30T16:56:46.548563+0000","last_peered":"2024-05-30T16:56:46.548563+0000","last_clean":"2024-05-30T16:56:46.548563+0000","last_became_active":"2024-05-30T16:56:44.664880+0000","last_became_peered":"2024-05-30T16:56:44.664880+0000","last_unstale":"2024-05-30T16:56:46.548563+0000","last_undegraded":"2024-05-30T16:56:46.548563+0000","last_fullsized":"2024-05-30T16:56:46.548563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:30.146195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317153+0000","last_change":"2024-05-30T16:56:43.652649+0000","last_active":"2024-05-30T16:56:46.317153+0000","last_peered":"2024-05-30T16:56:46.317153+0000","last_clean":"2024-05-30T16:56:46.317153+0000","last_became_active":"2024-05-30T16:56:43.652332+0000","last_became_peered":"2024-05-30T16:56:43.652332+0000","last_unstale":"2024-05-30T16:56:46.317153+0000","last_undegraded":"2024-05-30T16:56:46.317153+0000","last_fullsized":"2024-05-30T16:56:46.317153+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:16:00.794791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653299+0000","last_change":"2024-05-30T16:56:44.651028+0000","last_active":"2024-05-30T16:56:45.653299+0000","last_peered":"2024-05-30T16:56:45.653299+0000","last_clean":"2024-05-30T16:56:45.653299+0000","last_became_active":"2024-05-30T16:56:44.650717+0000","last_became_peered":"2024-05-30T16:56:44.650717+0000","last_unstale":"2024-05-30T16:56:45.653299+0000","last_undegraded":"2024-05-30T16:56:45.653299+0000","last_fullsized":"2024-05-30T16:56:45.653299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:27.192232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.662926+0000","last_change":"2024-05-30T16:56:43.650135+0000","last_active":"2024-05-30T16:56:44.662926+0000","last_peered":"2024-05-30T16:56:44.662926+0000","last_clean":"2024-05-30T16:56:44.662926+0000","last_became_active":"2024-05-30T16:56:43.649731+0000","last_became_peered":"2024-05-30T16:56:43.649731+0000","last_unstale":"2024-05-30T16:56:44.662926+0000","last_undegraded":"2024-05-30T16:56:44.662926+0000","last_fullsized":"2024-05-30T16:56:44.662926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:05:58.221402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653764+0000","last_change":"2024-05-30T16:56:44.660137+0000","last_active":"2024-05-30T16:56:45.653764+0000","last_peered":"2024-05-30T16:56:45.653764+0000","last_clean":"2024-05-30T16:56:45.653764+0000","last_became_active":"2024-05-30T16:56:44.659826+0000","last_became_peered":"2024-05-30T16:56:44.659826+0000","last_unstale":"2024-05-30T16:56:45.653764+0000","last_undegraded":"2024-05-30T16:56:45.653764+0000","last_fullsized":"2024-05-30T16:56:45.653764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:32:08.978869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316739+0000","last_change":"2024-05-30T16:56:43.649636+0000","last_active":"2024-05-30T16:56:46.316739+0000","last_peered":"2024-05-30T16:56:46.316739+0000","last_clean":"2024-05-30T16:56:46.316739+0000","last_became_active":"2024-05-30T16:56:43.648216+0000","last_became_peered":"2024-05-30T16:56:43.648216+0000","last_unstale":"2024-05-30T16:56:46.316739+0000","last_undegraded":"2024-05-30T16:56:46.316739+0000","last_fullsized":"2024-05-30T16:56:46.316739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:41.743303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650764+0000","last_change":"2024-05-30T16:56:44.655108+0000","last_active":"2024-05-30T16:56:45.650764+0000","last_peered":"2024-05-30T16:56:45.650764+0000","last_clean":"2024-05-30T16:56:45.650764+0000","last_became_active":"2024-05-30T16:56:44.654831+0000","last_became_peered":"2024-05-30T16:56:44.654831+0000","last_unstale":"2024-05-30T16:56:45.650764+0000","last_undegraded":"2024-05-30T16:56:45.650764+0000","last_fullsized":"2024-05-30T16:56:45.650764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:13:38.307444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108376+0000","last_change":"2024-05-30T16:56:43.640552+0000","last_active":"2024-05-30T16:56:46.108376+0000","last_peered":"2024-05-30T16:56:46.108376+0000","last_clean":"2024-05-30T16:56:46.108376+0000","last_became_active":"2024-05-30T16:56:43.640314+0000","last_became_peered":"2024-05-30T16:56:43.640314+0000","last_unstale":"2024-05-30T16:56:46.108376+0000","last_undegraded":"2024-05-30T16:56:46.108376+0000","last_fullsized":"2024-05-30T16:56:46.108376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:08.666126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651001+0000","last_change":"2024-05-30T16:56:44.660810+0000","last_active":"2024-05-30T16:56:45.651001+0000","last_peered":"2024-05-30T16:56:45.651001+0000","last_clean":"2024-05-30T16:56:45.651001+0000","last_became_active":"2024-05-30T16:56:44.660477+0000","last_became_peered":"2024-05-30T16:56:44.660477+0000","last_unstale":"2024-05-30T16:56:45.651001+0000","last_undegraded":"2024-05-30T16:56:45.651001+0000","last_fullsized":"2024-05-30T16:56:45.651001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:25:50.040344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650776+0000","last_change":"2024-05-30T16:56:43.641994+0000","last_active":"2024-05-30T16:56:45.650776+0000","last_peered":"2024-05-30T16:56:45.650776+0000","last_clean":"2024-05-30T16:56:45.650776+0000","last_became_active":"2024-05-30T16:56:43.641712+0000","last_became_peered":"2024-05-30T16:56:43.641712+0000","last_unstale":"2024-05-30T16:56:45.650776+0000","last_undegraded":"2024-05-30T16:56:45.650776+0000","last_fullsized":"2024-05-30T16:56:45.650776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:08:06.965045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654000+0000","last_change":"2024-05-30T16:56:44.658680+0000","last_active":"2024-05-30T16:56:45.654000+0000","last_peered":"2024-05-30T16:56:45.654000+0000","last_clean":"2024-05-30T16:56:45.654000+0000","last_became_active":"2024-05-30T16:56:44.658405+0000","last_became_peered":"2024-05-30T16:56:44.658405+0000","last_unstale":"2024-05-30T16:56:45.654000+0000","last_undegraded":"2024-05-30T16:56:45.654000+0000","last_fullsized":"2024-05-30T16:56:45.654000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:25:50.040344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654147+0000","last_change":"2024-05-30T16:56:43.646805+0000","last_active":"2024-05-30T16:56:45.654147+0000","last_peered":"2024-05-30T16:56:45.654147+0000","last_clean":"2024-05-30T16:56:45.654147+0000","last_became_active":"2024-05-30T16:56:43.646509+0000","last_became_peered":"2024-05-30T16:56:43.646509+0000","last_unstale":"2024-05-30T16:56:45.654147+0000","last_undegraded":"2024-05-30T16:56:45.654147+0000","last_fullsized":"2024-05-30T16:56:45.654147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:40:10.041928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548707+0000","last_change":"2024-05-30T16:56:44.671239+0000","last_active":"2024-05-30T16:56:46.548707+0000","last_peered":"2024-05-30T16:56:46.548707+0000","last_clean":"2024-05-30T16:56:46.548707+0000","last_became_active":"2024-05-30T16:56:44.670215+0000","last_became_peered":"2024-05-30T16:56:44.670215+0000","last_unstale":"2024-05-30T16:56:46.548707+0000","last_undegraded":"2024-05-30T16:56:46.548707+0000","last_fullsized":"2024-05-30T16:56:46.548707+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:50.550356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317387+0000","last_change":"2024-05-30T16:56:43.648959+0000","last_active":"2024-05-30T16:56:46.317387+0000","last_peered":"2024-05-30T16:56:46.317387+0000","last_clean":"2024-05-30T16:56:46.317387+0000","last_became_active":"2024-05-30T16:56:43.648675+0000","last_became_peered":"2024-05-30T16:56:43.648675+0000","last_unstale":"2024-05-30T16:56:46.317387+0000","last_undegraded":"2024-05-30T16:56:46.317387+0000","last_fullsized":"2024-05-30T16:56:46.317387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:52.114014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316987+0000","last_change":"2024-05-30T16:56:44.651009+0000","last_active":"2024-05-30T16:56:46.316987+0000","last_peered":"2024-05-30T16:56:46.316987+0000","last_clean":"2024-05-30T16:56:46.316987+0000","last_became_active":"2024-05-30T16:56:44.650709+0000","last_became_peered":"2024-05-30T16:56:44.650709+0000","last_unstale":"2024-05-30T16:56:46.316987+0000","last_undegraded":"2024-05-30T16:56:46.316987+0000","last_fullsized":"2024-05-30T16:56:46.316987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:03:39.290806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.667305+0000","last_change":"2024-05-30T16:56:43.648080+0000","last_active":"2024-05-30T16:56:44.667305+0000","last_peered":"2024-05-30T16:56:44.667305+0000","last_clean":"2024-05-30T16:56:44.667305+0000","last_became_active":"2024-05-30T16:56:43.647224+0000","last_became_peered":"2024-05-30T16:56:43.647224+0000","last_unstale":"2024-05-30T16:56:44.667305+0000","last_undegraded":"2024-05-30T16:56:44.667305+0000","last_fullsized":"2024-05-30T16:56:44.667305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:24:13.264974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651928+0000","last_change":"2024-05-30T16:56:44.650308+0000","last_active":"2024-05-30T16:56:45.651928+0000","last_peered":"2024-05-30T16:56:45.651928+0000","last_clean":"2024-05-30T16:56:45.651928+0000","last_became_active":"2024-05-30T16:56:44.649980+0000","last_became_peered":"2024-05-30T16:56:44.649980+0000","last_unstale":"2024-05-30T16:56:45.651928+0000","last_undegraded":"2024-05-30T16:56:45.651928+0000","last_fullsized":"2024-05-30T16:56:45.651928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:45:58.041826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"74'6","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108800+0000","last_change":"2024-05-30T16:56:43.646796+0000","last_active":"2024-05-30T16:56:46.108800+0000","last_peered":"2024-05-30T16:56:46.108800+0000","last_clean":"2024-05-30T16:56:46.108800+0000","last_became_active":"2024-05-30T16:56:43.646100+0000","last_became_peered":"2024-05-30T16:56:43.646100+0000","last_unstale":"2024-05-30T16:56:46.108800+0000","last_undegraded":"2024-05-30T16:56:46.108800+0000","last_fullsized":"2024-05-30T16:56:46.108800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:55.977985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548319+0000","last_change":"2024-05-30T16:56:44.666817+0000","last_active":"2024-05-30T16:56:46.548319+0000","last_peered":"2024-05-30T16:56:46.548319+0000","last_clean":"2024-05-30T16:56:46.548319+0000","last_became_active":"2024-05-30T16:56:44.666556+0000","last_became_peered":"2024-05-30T16:56:44.666556+0000","last_unstale":"2024-05-30T16:56:46.548319+0000","last_undegraded":"2024-05-30T16:56:46.548319+0000","last_fullsized":"2024-05-30T16:56:46.548319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:25:09.747489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108561+0000","last_change":"2024-05-30T16:56:43.646330+0000","last_active":"2024-05-30T16:56:46.108561+0000","last_peered":"2024-05-30T16:56:46.108561+0000","last_clean":"2024-05-30T16:56:46.108561+0000","last_became_active":"2024-05-30T16:56:43.645135+0000","last_became_peered":"2024-05-30T16:56:43.645135+0000","last_unstale":"2024-05-30T16:56:46.108561+0000","last_undegraded":"2024-05-30T16:56:46.108561+0000","last_fullsized":"2024-05-30T16:56:46.108561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:37.571645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654213+0000","last_change":"2024-05-30T16:56:44.652909+0000","last_active":"2024-05-30T16:56:45.654213+0000","last_peered":"2024-05-30T16:56:45.654213+0000","last_clean":"2024-05-30T16:56:45.654213+0000","last_became_active":"2024-05-30T16:56:44.652639+0000","last_became_peered":"2024-05-30T16:56:44.652639+0000","last_unstale":"2024-05-30T16:56:45.654213+0000","last_undegraded":"2024-05-30T16:56:45.654213+0000","last_fullsized":"2024-05-30T16:56:45.654213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:18:37.099872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316955+0000","last_change":"2024-05-30T16:56:43.648535+0000","last_active":"2024-05-30T16:56:46.316955+0000","last_peered":"2024-05-30T16:56:46.316955+0000","last_clean":"2024-05-30T16:56:46.316955+0000","last_became_active":"2024-05-30T16:56:43.648206+0000","last_became_peered":"2024-05-30T16:56:43.648206+0000","last_unstale":"2024-05-30T16:56:46.316955+0000","last_undegraded":"2024-05-30T16:56:46.316955+0000","last_fullsized":"2024-05-30T16:56:46.316955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:55:28.651316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650979+0000","last_change":"2024-05-30T16:56:44.645994+0000","last_active":"2024-05-30T16:56:45.650979+0000","last_peered":"2024-05-30T16:56:45.650979+0000","last_clean":"2024-05-30T16:56:45.650979+0000","last_became_active":"2024-05-30T16:56:44.645720+0000","last_became_peered":"2024-05-30T16:56:44.645720+0000","last_unstale":"2024-05-30T16:56:45.650979+0000","last_undegraded":"2024-05-30T16:56:45.650979+0000","last_fullsized":"2024-05-30T16:56:45.650979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:36.158094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652937+0000","last_change":"2024-05-30T16:56:43.646206+0000","last_active":"2024-05-30T16:56:45.652937+0000","last_peered":"2024-05-30T16:56:45.652937+0000","last_clean":"2024-05-30T16:56:45.652937+0000","last_became_active":"2024-05-30T16:56:43.645673+0000","last_became_peered":"2024-05-30T16:56:43.645673+0000","last_unstale":"2024-05-30T16:56:45.652937+0000","last_undegraded":"2024-05-30T16:56:45.652937+0000","last_fullsized":"2024-05-30T16:56:45.652937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:22:16.376711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651353+0000","last_change":"2024-05-30T16:56:44.652605+0000","last_active":"2024-05-30T16:56:45.651353+0000","last_peered":"2024-05-30T16:56:45.651353+0000","last_clean":"2024-05-30T16:56:45.651353+0000","last_became_active":"2024-05-30T16:56:44.650499+0000","last_became_peered":"2024-05-30T16:56:44.650499+0000","last_unstale":"2024-05-30T16:56:45.651353+0000","last_undegraded":"2024-05-30T16:56:45.651353+0000","last_fullsized":"2024-05-30T16:56:45.651353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:31.289587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653299+0000","last_change":"2024-05-30T16:56:43.647263+0000","last_active":"2024-05-30T16:56:45.653299+0000","last_peered":"2024-05-30T16:56:45.653299+0000","last_clean":"2024-05-30T16:56:45.653299+0000","last_became_active":"2024-05-30T16:56:43.645925+0000","last_became_peered":"2024-05-30T16:56:43.645925+0000","last_unstale":"2024-05-30T16:56:45.653299+0000","last_undegraded":"2024-05-30T16:56:45.653299+0000","last_fullsized":"2024-05-30T16:56:45.653299+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:39:52.639268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654061+0000","last_change":"2024-05-30T16:56:44.654596+0000","last_active":"2024-05-30T16:56:45.654061+0000","last_peered":"2024-05-30T16:56:45.654061+0000","last_clean":"2024-05-30T16:56:45.654061+0000","last_became_active":"2024-05-30T16:56:44.650982+0000","last_became_peered":"2024-05-30T16:56:44.650982+0000","last_unstale":"2024-05-30T16:56:45.654061+0000","last_undegraded":"2024-05-30T16:56:45.654061+0000","last_fullsized":"2024-05-30T16:56:45.654061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:45:54.673385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317415+0000","last_change":"2024-05-30T16:56:43.649341+0000","last_active":"2024-05-30T16:56:46.317415+0000","last_peered":"2024-05-30T16:56:46.317415+0000","last_clean":"2024-05-30T16:56:46.317415+0000","last_became_active":"2024-05-30T16:56:43.649011+0000","last_became_peered":"2024-05-30T16:56:43.649011+0000","last_unstale":"2024-05-30T16:56:46.317415+0000","last_undegraded":"2024-05-30T16:56:46.317415+0000","last_fullsized":"2024-05-30T16:56:46.317415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:00:01.001014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548789+0000","last_change":"2024-05-30T16:56:44.666380+0000","last_active":"2024-05-30T16:56:46.548789+0000","last_peered":"2024-05-30T16:56:46.548789+0000","last_clean":"2024-05-30T16:56:46.548789+0000","last_became_active":"2024-05-30T16:56:44.665935+0000","last_became_peered":"2024-05-30T16:56:44.665935+0000","last_unstale":"2024-05-30T16:56:46.548789+0000","last_undegraded":"2024-05-30T16:56:46.548789+0000","last_fullsized":"2024-05-30T16:56:46.548789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:15.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654099+0000","last_change":"2024-05-30T16:56:43.642066+0000","last_active":"2024-05-30T16:56:45.654099+0000","last_peered":"2024-05-30T16:56:45.654099+0000","last_clean":"2024-05-30T16:56:45.654099+0000","last_became_active":"2024-05-30T16:56:43.641208+0000","last_became_peered":"2024-05-30T16:56:43.641208+0000","last_unstale":"2024-05-30T16:56:45.654099+0000","last_undegraded":"2024-05-30T16:56:45.654099+0000","last_fullsized":"2024-05-30T16:56:45.654099+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:46:36.960891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108805+0000","last_change":"2024-05-30T16:56:44.656373+0000","last_active":"2024-05-30T16:56:46.108805+0000","last_peered":"2024-05-30T16:56:46.108805+0000","last_clean":"2024-05-30T16:56:46.108805+0000","last_became_active":"2024-05-30T16:56:44.653318+0000","last_became_peered":"2024-05-30T16:56:44.653318+0000","last_unstale":"2024-05-30T16:56:46.108805+0000","last_undegraded":"2024-05-30T16:56:46.108805+0000","last_fullsized":"2024-05-30T16:56:46.108805+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:39.371941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317208+0000","last_change":"2024-05-30T16:56:43.647018+0000","last_active":"2024-05-30T16:56:46.317208+0000","last_peered":"2024-05-30T16:56:46.317208+0000","last_clean":"2024-05-30T16:56:46.317208+0000","last_became_active":"2024-05-30T16:56:43.646734+0000","last_became_peered":"2024-05-30T16:56:43.646734+0000","last_unstale":"2024-05-30T16:56:46.317208+0000","last_undegraded":"2024-05-30T16:56:46.317208+0000","last_fullsized":"2024-05-30T16:56:46.317208+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:55:18.699236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652099+0000","last_change":"2024-05-30T16:56:44.654757+0000","last_active":"2024-05-30T16:56:45.652099+0000","last_peered":"2024-05-30T16:56:45.652099+0000","last_clean":"2024-05-30T16:56:45.652099+0000","last_became_active":"2024-05-30T16:56:44.654467+0000","last_became_peered":"2024-05-30T16:56:44.654467+0000","last_unstale":"2024-05-30T16:56:45.652099+0000","last_undegraded":"2024-05-30T16:56:45.652099+0000","last_fullsized":"2024-05-30T16:56:45.652099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:09.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548368+0000","last_change":"2024-05-30T16:56:43.651621+0000","last_active":"2024-05-30T16:56:46.548368+0000","last_peered":"2024-05-30T16:56:46.548368+0000","last_clean":"2024-05-30T16:56:46.548368+0000","last_became_active":"2024-05-30T16:56:43.651020+0000","last_became_peered":"2024-05-30T16:56:43.651020+0000","last_unstale":"2024-05-30T16:56:46.548368+0000","last_undegraded":"2024-05-30T16:56:46.548368+0000","last_fullsized":"2024-05-30T16:56:46.548368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:32:07.975415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659275+0000","last_change":"2024-05-30T16:56:44.650720+0000","last_active":"2024-05-30T16:56:44.659275+0000","last_peered":"2024-05-30T16:56:44.659275+0000","last_clean":"2024-05-30T16:56:44.659275+0000","last_became_active":"2024-05-30T16:56:44.649933+0000","last_became_peered":"2024-05-30T16:56:44.649933+0000","last_unstale":"2024-05-30T16:56:44.659275+0000","last_undegraded":"2024-05-30T16:56:44.659275+0000","last_fullsized":"2024-05-30T16:56:44.659275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:24:16.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316958+0000","last_change":"2024-05-30T16:56:43.648500+0000","last_active":"2024-05-30T16:56:46.316958+0000","last_peered":"2024-05-30T16:56:46.316958+0000","last_clean":"2024-05-30T16:56:46.316958+0000","last_became_active":"2024-05-30T16:56:43.647772+0000","last_became_peered":"2024-05-30T16:56:43.647772+0000","last_unstale":"2024-05-30T16:56:46.316958+0000","last_undegraded":"2024-05-30T16:56:46.316958+0000","last_fullsized":"2024-05-30T16:56:46.316958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:59.944690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659097+0000","last_change":"2024-05-30T16:56:44.646838+0000","last_active":"2024-05-30T16:56:44.659097+0000","last_peered":"2024-05-30T16:56:44.659097+0000","last_clean":"2024-05-30T16:56:44.659097+0000","last_became_active":"2024-05-30T16:56:44.646587+0000","last_became_peered":"2024-05-30T16:56:44.646587+0000","last_unstale":"2024-05-30T16:56:44.659097+0000","last_undegraded":"2024-05-30T16:56:44.659097+0000","last_fullsized":"2024-05-30T16:56:44.659097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:30.610228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653189+0000","last_change":"2024-05-30T16:56:43.643553+0000","last_active":"2024-05-30T16:56:45.653189+0000","last_peered":"2024-05-30T16:56:45.653189+0000","last_clean":"2024-05-30T16:56:45.653189+0000","last_became_active":"2024-05-30T16:56:43.642497+0000","last_became_peered":"2024-05-30T16:56:43.642497+0000","last_unstale":"2024-05-30T16:56:45.653189+0000","last_undegraded":"2024-05-30T16:56:45.653189+0000","last_fullsized":"2024-05-30T16:56:45.653189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:46:33.244850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.658847+0000","last_change":"2024-05-30T16:56:44.646527+0000","last_active":"2024-05-30T16:56:44.658847+0000","last_peered":"2024-05-30T16:56:44.658847+0000","last_clean":"2024-05-30T16:56:44.658847+0000","last_became_active":"2024-05-30T16:56:44.646233+0000","last_became_peered":"2024-05-30T16:56:44.646233+0000","last_unstale":"2024-05-30T16:56:44.658847+0000","last_undegraded":"2024-05-30T16:56:44.658847+0000","last_fullsized":"2024-05-30T16:56:44.658847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:51:47.821639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650833+0000","last_change":"2024-05-30T16:56:43.651846+0000","last_active":"2024-05-30T16:56:45.650833+0000","last_peered":"2024-05-30T16:56:45.650833+0000","last_clean":"2024-05-30T16:56:45.650833+0000","last_became_active":"2024-05-30T16:56:43.651253+0000","last_became_peered":"2024-05-30T16:56:43.651253+0000","last_unstale":"2024-05-30T16:56:45.650833+0000","last_undegraded":"2024-05-30T16:56:45.650833+0000","last_fullsized":"2024-05-30T16:56:45.650833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:47.527522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651601+0000","last_change":"2024-05-30T16:56:44.651868+0000","last_active":"2024-05-30T16:56:45.651601+0000","last_peered":"2024-05-30T16:56:45.651601+0000","last_clean":"2024-05-30T16:56:45.651601+0000","last_became_active":"2024-05-30T16:56:44.651600+0000","last_became_peered":"2024-05-30T16:56:44.651600+0000","last_unstale":"2024-05-30T16:56:45.651601+0000","last_undegraded":"2024-05-30T16:56:45.651601+0000","last_fullsized":"2024-05-30T16:56:45.651601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:52:05.375623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317479+0000","last_change":"2024-05-30T16:56:43.647155+0000","last_active":"2024-05-30T16:56:46.317479+0000","last_peered":"2024-05-30T16:56:46.317479+0000","last_clean":"2024-05-30T16:56:46.317479+0000","last_became_active":"2024-05-30T16:56:43.646879+0000","last_became_peered":"2024-05-30T16:56:43.646879+0000","last_unstale":"2024-05-30T16:56:46.317479+0000","last_undegraded":"2024-05-30T16:56:46.317479+0000","last_fullsized":"2024-05-30T16:56:46.317479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:53.002194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653701+0000","last_change":"2024-05-30T16:56:44.643180+0000","last_active":"2024-05-30T16:56:45.653701+0000","last_peered":"2024-05-30T16:56:45.653701+0000","last_clean":"2024-05-30T16:56:45.653701+0000","last_became_active":"2024-05-30T16:56:44.642880+0000","last_became_peered":"2024-05-30T16:56:44.642880+0000","last_unstale":"2024-05-30T16:56:45.653701+0000","last_undegraded":"2024-05-30T16:56:45.653701+0000","last_fullsized":"2024-05-30T16:56:45.653701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:38:16.555934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653975+0000","last_change":"2024-05-30T16:56:43.646647+0000","last_active":"2024-05-30T16:56:45.653975+0000","last_peered":"2024-05-30T16:56:45.653975+0000","last_clean":"2024-05-30T16:56:45.653975+0000","last_became_active":"2024-05-30T16:56:43.646200+0000","last_became_peered":"2024-05-30T16:56:43.646200+0000","last_unstale":"2024-05-30T16:56:45.653975+0000","last_undegraded":"2024-05-30T16:56:45.653975+0000","last_fullsized":"2024-05-30T16:56:45.653975+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:27.365379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548416+0000","last_change":"2024-05-30T16:56:44.669877+0000","last_active":"2024-05-30T16:56:46.548416+0000","last_peered":"2024-05-30T16:56:46.548416+0000","last_clean":"2024-05-30T16:56:46.548416+0000","last_became_active":"2024-05-30T16:56:44.669562+0000","last_became_peered":"2024-05-30T16:56:44.669562+0000","last_unstale":"2024-05-30T16:56:46.548416+0000","last_undegraded":"2024-05-30T16:56:46.548416+0000","last_fullsized":"2024-05-30T16:56:46.548416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:59:28.731114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652045+0000","last_change":"2024-05-30T16:56:43.648834+0000","last_active":"2024-05-30T16:56:45.652045+0000","last_peered":"2024-05-30T16:56:45.652045+0000","last_clean":"2024-05-30T16:56:45.652045+0000","last_became_active":"2024-05-30T16:56:43.648569+0000","last_became_peered":"2024-05-30T16:56:43.648569+0000","last_unstale":"2024-05-30T16:56:45.652045+0000","last_undegraded":"2024-05-30T16:56:45.652045+0000","last_fullsized":"2024-05-30T16:56:45.652045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:43.464267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548587+0000","last_change":"2024-05-30T16:56:44.662124+0000","last_active":"2024-05-30T16:56:46.548587+0000","last_peered":"2024-05-30T16:56:46.548587+0000","last_clean":"2024-05-30T16:56:46.548587+0000","last_became_active":"2024-05-30T16:56:44.661807+0000","last_became_peered":"2024-05-30T16:56:44.661807+0000","last_unstale":"2024-05-30T16:56:46.548587+0000","last_undegraded":"2024-05-30T16:56:46.548587+0000","last_fullsized":"2024-05-30T16:56:46.548587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:05.799103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651433+0000","last_change":"2024-05-30T16:56:43.648503+0000","last_active":"2024-05-30T16:56:45.651433+0000","last_peered":"2024-05-30T16:56:45.651433+0000","last_clean":"2024-05-30T16:56:45.651433+0000","last_became_active":"2024-05-30T16:56:43.648229+0000","last_became_peered":"2024-05-30T16:56:43.648229+0000","last_unstale":"2024-05-30T16:56:45.651433+0000","last_undegraded":"2024-05-30T16:56:45.651433+0000","last_fullsized":"2024-05-30T16:56:45.651433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:28:49.588547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651904+0000","last_change":"2024-05-30T16:56:44.653977+0000","last_active":"2024-05-30T16:56:45.651904+0000","last_peered":"2024-05-30T16:56:45.651904+0000","last_clean":"2024-05-30T16:56:45.651904+0000","last_became_active":"2024-05-30T16:56:44.653708+0000","last_became_peered":"2024-05-30T16:56:44.653708+0000","last_unstale":"2024-05-30T16:56:45.651904+0000","last_undegraded":"2024-05-30T16:56:45.651904+0000","last_fullsized":"2024-05-30T16:56:45.651904+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:13:35.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651897+0000","last_change":"2024-05-30T16:56:43.645417+0000","last_active":"2024-05-30T16:56:45.651897+0000","last_peered":"2024-05-30T16:56:45.651897+0000","last_clean":"2024-05-30T16:56:45.651897+0000","last_became_active":"2024-05-30T16:56:43.645163+0000","last_became_peered":"2024-05-30T16:56:43.645163+0000","last_unstale":"2024-05-30T16:56:45.651897+0000","last_undegraded":"2024-05-30T16:56:45.651897+0000","last_fullsized":"2024-05-30T16:56:45.651897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:24.915924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316854+0000","last_change":"2024-05-30T16:56:44.664261+0000","last_active":"2024-05-30T16:56:46.316854+0000","last_peered":"2024-05-30T16:56:46.316854+0000","last_clean":"2024-05-30T16:56:46.316854+0000","last_became_active":"2024-05-30T16:56:44.658602+0000","last_became_peered":"2024-05-30T16:56:44.658602+0000","last_unstale":"2024-05-30T16:56:46.316854+0000","last_undegraded":"2024-05-30T16:56:46.316854+0000","last_fullsized":"2024-05-30T16:56:46.316854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:46:37.964346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108360+0000","last_change":"2024-05-30T16:56:43.641165+0000","last_active":"2024-05-30T16:56:46.108360+0000","last_peered":"2024-05-30T16:56:46.108360+0000","last_clean":"2024-05-30T16:56:46.108360+0000","last_became_active":"2024-05-30T16:56:43.640904+0000","last_became_peered":"2024-05-30T16:56:43.640904+0000","last_unstale":"2024-05-30T16:56:46.108360+0000","last_undegraded":"2024-05-30T16:56:46.108360+0000","last_fullsized":"2024-05-30T16:56:46.108360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:52.254333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108541+0000","last_change":"2024-05-30T16:56:44.644193+0000","last_active":"2024-05-30T16:56:46.108541+0000","last_peered":"2024-05-30T16:56:46.108541+0000","last_clean":"2024-05-30T16:56:46.108541+0000","last_became_active":"2024-05-30T16:56:44.643801+0000","last_became_peered":"2024-05-30T16:56:44.643801+0000","last_unstale":"2024-05-30T16:56:46.108541+0000","last_undegraded":"2024-05-30T16:56:46.108541+0000","last_fullsized":"2024-05-30T16:56:46.108541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:00.948144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653835+0000","last_change":"2024-05-30T16:56:43.646795+0000","last_active":"2024-05-30T16:56:45.653835+0000","last_peered":"2024-05-30T16:56:45.653835+0000","last_clean":"2024-05-30T16:56:45.653835+0000","last_became_active":"2024-05-30T16:56:43.646434+0000","last_became_peered":"2024-05-30T16:56:43.646434+0000","last_unstale":"2024-05-30T16:56:45.653835+0000","last_undegraded":"2024-05-30T16:56:45.653835+0000","last_fullsized":"2024-05-30T16:56:45.653835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:18.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316609+0000","last_change":"2024-05-30T16:56:44.659417+0000","last_active":"2024-05-30T16:56:46.316609+0000","last_peered":"2024-05-30T16:56:46.316609+0000","last_clean":"2024-05-30T16:56:46.316609+0000","last_became_active":"2024-05-30T16:56:44.659050+0000","last_became_peered":"2024-05-30T16:56:44.659050+0000","last_unstale":"2024-05-30T16:56:46.316609+0000","last_undegraded":"2024-05-30T16:56:46.316609+0000","last_fullsized":"2024-05-30T16:56:46.316609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:19.555324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317192+0000","last_change":"2024-05-30T16:56:43.649787+0000","last_active":"2024-05-30T16:56:46.317192+0000","last_peered":"2024-05-30T16:56:46.317192+0000","last_clean":"2024-05-30T16:56:46.317192+0000","last_became_active":"2024-05-30T16:56:43.649499+0000","last_became_peered":"2024-05-30T16:56:43.649499+0000","last_unstale":"2024-05-30T16:56:46.317192+0000","last_undegraded":"2024-05-30T16:56:46.317192+0000","last_fullsized":"2024-05-30T16:56:46.317192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:04:39.740914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:56:44.659176+0000","last_change":"2024-05-30T16:56:44.648063+0000","last_active":"2024-05-30T16:56:44.659176+0000","last_peered":"2024-05-30T16:56:44.659176+0000","last_clean":"2024-05-30T16:56:44.659176+0000","last_became_active":"2024-05-30T16:56:44.645752+0000","last_became_peered":"2024-05-30T16:56:44.645752+0000","last_unstale":"2024-05-30T16:56:44.659176+0000","last_undegraded":"2024-05-30T16:56:44.659176+0000","last_fullsized":"2024-05-30T16:56:44.659176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:48.843356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316917+0000","last_change":"2024-05-30T16:56:43.652356+0000","last_active":"2024-05-30T16:56:46.316917+0000","last_peered":"2024-05-30T16:56:46.316917+0000","last_clean":"2024-05-30T16:56:46.316917+0000","last_became_active":"2024-05-30T16:56:43.652065+0000","last_became_peered":"2024-05-30T16:56:43.652065+0000","last_unstale":"2024-05-30T16:56:46.316917+0000","last_undegraded":"2024-05-30T16:56:46.316917+0000","last_fullsized":"2024-05-30T16:56:46.316917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:38.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":271,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548075+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:56:46.548075+0000","last_peered":"2024-05-30T16:56:46.548075+0000","last_clean":"2024-05-30T16:56:46.548075+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:56:46.548075+0000","last_undegraded":"2024-05-30T16:56:46.548075+0000","last_fullsized":"2024-05-30T16:56:46.548075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54860,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316980,"statfs":{"total":96636764160,"available":96580587520,"internally_reserved":0,"allocated":1507328,"data_stored":974184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509538,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54288,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317552,"statfs":{"total":96636764160,"available":96581173248,"internally_reserved":0,"allocated":913408,"data_stored":383292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509538,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50124,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321716,"statfs":{"total":96636764160,"available":96585437184,"internally_reserved":0,"allocated":909312,"data_stored":383290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54280,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317560,"statfs":{"total":96636764160,"available":96581181440,"internally_reserved":0,"allocated":909312,"data_stored":383270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509538,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50124,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321716,"statfs":{"total":96636764160,"available":96585437184,"internally_reserved":0,"allocated":917504,"data_stored":384812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509538,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54296,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317544,"statfs":{"total":96636764160,"available":96581165056,"internally_reserved":0,"allocated":925696,"data_stored":385428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509538,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54856,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316984,"statfs":{"total":96636764160,"available":96580591616,"internally_reserved":0,"allocated":1499136,"data_stored":973568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542242,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58436,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313404,"statfs":{"total":96636764160,"available":96576925696,"internally_reserved":0,"allocated":901120,"data_stored":376928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:56:53.379 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:56:53.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faeeb800640 1 Processor -- start 2024-05-30T16:56:53.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faeeb800640 1 -- start start 2024-05-30T16:56:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faeeb800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faee4159df0 0x7faee40ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faeeb800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faee40b3e50 0x7faee40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faeeb800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faee415d730 con 0x7faee415a1d0 2024-05-30T16:56:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faeeb800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7faee40b3370 con 0x7faee4159df0 2024-05-30T16:56:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faeeb800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faee40b3650 con 0x7faee40b3e50 2024-05-30T16:56:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faee8e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faee4159df0 0x7faee40ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faee9800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faee40b3e50 0x7faee40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faee8e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faee4159df0 0x7faee40ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:56972/0 (socket says 172.21.15.59:56972) 2024-05-30T16:56:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faee8e00640 1 -- 172.21.15.59:0/293707419 learned_addr learned my addr 172.21.15.59:0/293707419 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faee3e00640 1 --1- 172.21.15.59:0/293707419 >> v1:172.21.15.107:6789/0 conn(0x7faee415a1d0 0x7faee415ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:38340/0 (socket says 172.21.15.59:38340) 2024-05-30T16:56:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faee8e00640 1 -- 172.21.15.59:0/293707419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faee40b3e50 msgr2=0x7faee40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faee8e00640 1 --2- 172.21.15.59:0/293707419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faee40b3e50 0x7faee40ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faee8e00640 1 -- 172.21.15.59:0/293707419 >> v1:172.21.15.107:6789/0 conn(0x7faee415a1d0 legacy=0x7faee415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faee8e00640 1 -- 172.21.15.59:0/293707419 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee40b3930 con 0x7faee4159df0 2024-05-30T16:56:53.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faee3400640 1 -- 172.21.15.59:0/293707419 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709978139 0 0) 0x7faee415d730 con 0x7faee415a1d0 2024-05-30T16:56:53.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.530+0000 7faee9800640 1 --2- 172.21.15.59:0/293707419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faee40b3e50 0x7faee40ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:53.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.534+0000 7faee8e00640 1 --2- 172.21.15.59:0/293707419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faee4159df0 0x7faee40ad1b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faed8009870 tx=0x7faed801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97716bd9d0fc21e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.534+0000 7faee3400640 1 -- 172.21.15.59:0/293707419 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed80b0070 con 0x7faee4159df0 2024-05-30T16:56:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.534+0000 7faee3400640 1 -- 172.21.15.59:0/293707419 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed80ab600 con 0x7faee4159df0 2024-05-30T16:56:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.534+0000 7faee3400640 1 -- 172.21.15.59:0/293707419 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed80ab9d0 con 0x7faee4159df0 2024-05-30T16:56:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.534+0000 7faeeb800640 1 -- 172.21.15.59:0/293707419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faee4159df0 msgr2=0x7faee40ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.534+0000 7faeeb800640 1 --2- 172.21.15.59:0/293707419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faee4159df0 0x7faee40ad1b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faed8009870 tx=0x7faed801c560 comp rx=0 tx=0).stop 2024-05-30T16:56:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.534+0000 7faeeb800640 1 -- 172.21.15.59:0/293707419 shutdown_connections 2024-05-30T16:56:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.534+0000 7faeeb800640 1 --2- 172.21.15.59:0/293707419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faee40b3e50 0x7faee40ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.534+0000 7faeeb800640 1 --2- 172.21.15.59:0/293707419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faee4159df0 0x7faee40ad1b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.534+0000 7faeeb800640 1 -- 172.21.15.59:0/293707419 >> 172.21.15.59:0/293707419 conn(0x7faee40b22d0 msgr2=0x7faee40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.534+0000 7faeeb800640 1 -- 172.21.15.59:0/293707419 shutdown_connections 2024-05-30T16:56:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.534+0000 7faeeb800640 1 -- 172.21.15.59:0/293707419 wait complete. 2024-05-30T16:56:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faeeb800640 1 Processor -- start 2024-05-30T16:56:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faeeb800640 1 -- start start 2024-05-30T16:56:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faeeb800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faee40b3e50 0x7faee4148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faeeb800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4159df0 0x7faee414c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faeeb800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faee415a1d0 0x7faee40aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faeeb800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faee415e720 con 0x7faee4159df0 2024-05-30T16:56:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faeeb800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faee415e5a0 con 0x7faee415a1d0 2024-05-30T16:56:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faeeb800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faee415e8a0 con 0x7faee40b3e50 2024-05-30T16:56:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4159df0 0x7faee414c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee8e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faee40b3e50 0x7faee4148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4159df0 0x7faee414c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40540/0 (socket says 172.21.15.59:40540) 2024-05-30T16:56:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee3e00640 1 -- 172.21.15.59:0/3024759509 learned_addr learned my addr 172.21.15.59:0/3024759509 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee9800640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faee415a1d0 0x7faee40aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee8e00640 1 -- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faee415a1d0 msgr2=0x7faee40aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee8e00640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faee415a1d0 0x7faee40aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee8e00640 1 -- 172.21.15.59:0/3024759509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4159df0 msgr2=0x7faee414c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee8e00640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4159df0 0x7faee414c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee8e00640 1 -- 172.21.15.59:0/3024759509 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee4150820 con 0x7faee40b3e50 2024-05-30T16:56:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee3e00640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4159df0 0x7faee414c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee8e00640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faee40b3e50 0x7faee4148b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faee40d0ff0 tx=0x7faed801ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee0c00640 1 -- 172.21.15.59:0/3024759509 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed80b0040 con 0x7faee40b3e50 2024-05-30T16:56:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee0c00640 1 -- 172.21.15.59:0/3024759509 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed80bc070 con 0x7faee40b3e50 2024-05-30T16:56:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faee0c00640 1 -- 172.21.15.59:0/3024759509 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed80aa990 con 0x7faee40b3e50 2024-05-30T16:56:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.538+0000 7faeeb800640 1 -- 172.21.15.59:0/3024759509 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee4150b00 con 0x7faee40b3e50 2024-05-30T16:56:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.542+0000 7faeeb800640 1 -- 172.21.15.59:0/3024759509 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faee41510c0 con 0x7faee40b3e50 2024-05-30T16:56:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.542+0000 7faeeb800640 1 -- 172.21.15.59:0/3024759509 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee4068a90 con 0x7faee40b3e50 2024-05-30T16:56:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.542+0000 7faee0c00640 1 -- 172.21.15.59:0/3024759509 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7faed80aab30 con 0x7faee40b3e50 2024-05-30T16:56:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.542+0000 7faee0c00640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faec4069070 0x7faec406b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.542+0000 7faee0c00640 1 -- 172.21.15.59:0/3024759509 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7faed81202c0 con 0x7faee40b3e50 2024-05-30T16:56:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.542+0000 7faee3e00640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faec4069070 0x7faec406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.546+0000 7faee3e00640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faec4069070 0x7faec406b530 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faee4159020 tx=0x7faed0007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.546+0000 7faee0c00640 1 -- 172.21.15.59:0/3024759509 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faed8016150 con 0x7faee40b3e50 2024-05-30T16:56:53.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.710+0000 7faeeb800640 1 -- 172.21.15.59:0/3024759509 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faee40ada10 con 0x7faec4069070 2024-05-30T16:56:53.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.714+0000 7faee0c00640 1 -- 172.21.15.59:0/3024759509 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251957 (secure 0 0 0) 0x7faee40ada10 con 0x7faec4069070 2024-05-30T16:56:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:53.724 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:56:53.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.718+0000 7faeeb800640 1 -- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faec4069070 msgr2=0x7faec406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:53.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.718+0000 7faeeb800640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faec4069070 0x7faec406b530 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faee4159020 tx=0x7faed0007e80 comp rx=0 tx=0).stop 2024-05-30T16:56:53.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.718+0000 7faeeb800640 1 -- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faee40b3e50 msgr2=0x7faee4148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:53.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.718+0000 7faeeb800640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faee40b3e50 0x7faee4148b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faee40d0ff0 tx=0x7faed801ada0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.718+0000 7faeeb800640 1 -- 172.21.15.59:0/3024759509 shutdown_connections 2024-05-30T16:56:53.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.718+0000 7faeeb800640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faec4069070 0x7faec406b530 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.718+0000 7faeeb800640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faee415a1d0 0x7faee40aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.718+0000 7faeeb800640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4159df0 0x7faee414c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.718+0000 7faeeb800640 1 --2- 172.21.15.59:0/3024759509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faee40b3e50 0x7faee4148b10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.718+0000 7faeeb800640 1 -- 172.21.15.59:0/3024759509 >> 172.21.15.59:0/3024759509 conn(0x7faee40b22d0 msgr2=0x7faee415ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:53.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.718+0000 7faeeb800640 1 -- 172.21.15.59:0/3024759509 shutdown_connections 2024-05-30T16:56:53.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.718+0000 7faeeb800640 1 -- 172.21.15.59:0/3024759509 wait complete. 2024-05-30T16:56:53.743 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-05-30T16:56:53.211560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431268,"kb_used_data":8296,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754543452,"statfs":{"total":773094113280,"available":772652494848,"internally_reserved":0,"allocated":8495104,"data_stored":4251156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.582046"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548612+0000","last_change":"2024-05-30T16:56:44.668865+0000","last_active":"2024-05-30T16:56:46.548612+0000","last_peered":"2024-05-30T16:56:46.548612+0000","last_clean":"2024-05-30T16:56:46.548612+0000","last_became_active":"2024-05-30T16:56:44.668040+0000","last_became_peered":"2024-05-30T16:56:44.668040+0000","last_unstale":"2024-05-30T16:56:46.548612+0000","last_undegraded":"2024-05-30T16:56:46.548612+0000","last_fullsized":"2024-05-30T16:56:46.548612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:56.908682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317318+0000","last_change":"2024-05-30T16:56:44.661763+0000","last_active":"2024-05-30T16:56:46.317318+0000","last_peered":"2024-05-30T16:56:46.317318+0000","last_clean":"2024-05-30T16:56:46.317318+0000","last_became_active":"2024-05-30T16:56:44.658746+0000","last_became_peered":"2024-05-30T16:56:44.658746+0000","last_unstale":"2024-05-30T16:56:46.317318+0000","last_undegraded":"2024-05-30T16:56:46.317318+0000","last_fullsized":"2024-05-30T16:56:46.317318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:22:17.380165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.816591+0000","last_change":"2024-05-30T16:56:44.649217+0000","last_active":"2024-05-30T16:56:46.816591+0000","last_peered":"2024-05-30T16:56:46.816591+0000","last_clean":"2024-05-30T16:56:46.816591+0000","last_became_active":"2024-05-30T16:56:44.648928+0000","last_became_peered":"2024-05-30T16:56:44.648928+0000","last_unstale":"2024-05-30T16:56:46.816591+0000","last_undegraded":"2024-05-30T16:56:46.816591+0000","last_fullsized":"2024-05-30T16:56:46.816591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:21:31.704010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108660+0000","last_change":"2024-05-30T16:56:44.642320+0000","last_active":"2024-05-30T16:56:46.108660+0000","last_peered":"2024-05-30T16:56:46.108660+0000","last_clean":"2024-05-30T16:56:46.108660+0000","last_became_active":"2024-05-30T16:56:44.641997+0000","last_became_peered":"2024-05-30T16:56:44.641997+0000","last_unstale":"2024-05-30T16:56:46.108660+0000","last_undegraded":"2024-05-30T16:56:46.108660+0000","last_fullsized":"2024-05-30T16:56:46.108660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:54.005648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651793+0000","last_change":"2024-05-30T16:56:44.662425+0000","last_active":"2024-05-30T16:56:45.651793+0000","last_peered":"2024-05-30T16:56:45.651793+0000","last_clean":"2024-05-30T16:56:45.651793+0000","last_became_active":"2024-05-30T16:56:44.662074+0000","last_became_peered":"2024-05-30T16:56:44.662074+0000","last_unstale":"2024-05-30T16:56:45.651793+0000","last_undegraded":"2024-05-30T16:56:45.651793+0000","last_fullsized":"2024-05-30T16:56:45.651793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:50.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316759+0000","last_change":"2024-05-30T16:56:44.651788+0000","last_active":"2024-05-30T16:56:46.316759+0000","last_peered":"2024-05-30T16:56:46.316759+0000","last_clean":"2024-05-30T16:56:46.316759+0000","last_became_active":"2024-05-30T16:56:44.651285+0000","last_became_peered":"2024-05-30T16:56:44.651285+0000","last_unstale":"2024-05-30T16:56:46.316759+0000","last_undegraded":"2024-05-30T16:56:46.316759+0000","last_fullsized":"2024-05-30T16:56:46.316759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:24.866601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652823+0000","last_change":"2024-05-30T16:56:44.645072+0000","last_active":"2024-05-30T16:56:45.652823+0000","last_peered":"2024-05-30T16:56:45.652823+0000","last_clean":"2024-05-30T16:56:45.652823+0000","last_became_active":"2024-05-30T16:56:44.644787+0000","last_became_peered":"2024-05-30T16:56:44.644787+0000","last_unstale":"2024-05-30T16:56:45.652823+0000","last_undegraded":"2024-05-30T16:56:45.652823+0000","last_fullsized":"2024-05-30T16:56:45.652823+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:41:03.009179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316880+0000","last_change":"2024-05-30T16:56:44.642515+0000","last_active":"2024-05-30T16:56:46.316880+0000","last_peered":"2024-05-30T16:56:46.316880+0000","last_clean":"2024-05-30T16:56:46.316880+0000","last_became_active":"2024-05-30T16:56:44.641722+0000","last_became_peered":"2024-05-30T16:56:44.641722+0000","last_unstale":"2024-05-30T16:56:46.316880+0000","last_undegraded":"2024-05-30T16:56:46.316880+0000","last_fullsized":"2024-05-30T16:56:46.316880+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:40:11.045382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652160+0000","last_change":"2024-05-30T16:56:44.652304+0000","last_active":"2024-05-30T16:56:45.652160+0000","last_peered":"2024-05-30T16:56:45.652160+0000","last_clean":"2024-05-30T16:56:45.652160+0000","last_became_active":"2024-05-30T16:56:44.651824+0000","last_became_peered":"2024-05-30T16:56:44.651824+0000","last_unstale":"2024-05-30T16:56:45.652160+0000","last_undegraded":"2024-05-30T16:56:45.652160+0000","last_fullsized":"2024-05-30T16:56:45.652160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:53.257788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653994+0000","last_change":"2024-05-30T16:56:44.656226+0000","last_active":"2024-05-30T16:56:45.653994+0000","last_peered":"2024-05-30T16:56:45.653994+0000","last_clean":"2024-05-30T16:56:45.653994+0000","last_became_active":"2024-05-30T16:56:44.653473+0000","last_became_peered":"2024-05-30T16:56:44.653473+0000","last_unstale":"2024-05-30T16:56:45.653994+0000","last_undegraded":"2024-05-30T16:56:45.653994+0000","last_fullsized":"2024-05-30T16:56:45.653994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:41:03.009179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548464+0000","last_change":"2024-05-30T16:56:44.663730+0000","last_active":"2024-05-30T16:56:46.548464+0000","last_peered":"2024-05-30T16:56:46.548464+0000","last_clean":"2024-05-30T16:56:46.548464+0000","last_became_active":"2024-05-30T16:56:44.663105+0000","last_became_peered":"2024-05-30T16:56:44.663105+0000","last_unstale":"2024-05-30T16:56:46.548464+0000","last_undegraded":"2024-05-30T16:56:46.548464+0000","last_fullsized":"2024-05-30T16:56:46.548464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:08:06.277998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108702+0000","last_change":"2024-05-30T16:56:44.660270+0000","last_active":"2024-05-30T16:56:46.108702+0000","last_peered":"2024-05-30T16:56:46.108702+0000","last_clean":"2024-05-30T16:56:46.108702+0000","last_became_active":"2024-05-30T16:56:44.656543+0000","last_became_peered":"2024-05-30T16:56:44.656543+0000","last_unstale":"2024-05-30T16:56:46.108702+0000","last_undegraded":"2024-05-30T16:56:46.108702+0000","last_fullsized":"2024-05-30T16:56:46.108702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:00:02.004468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651329+0000","last_change":"2024-05-30T16:56:44.642746+0000","last_active":"2024-05-30T16:56:45.651329+0000","last_peered":"2024-05-30T16:56:45.651329+0000","last_clean":"2024-05-30T16:56:45.651329+0000","last_became_active":"2024-05-30T16:56:44.642473+0000","last_became_peered":"2024-05-30T16:56:44.642473+0000","last_unstale":"2024-05-30T16:56:45.651329+0000","last_undegraded":"2024-05-30T16:56:45.651329+0000","last_fullsized":"2024-05-30T16:56:45.651329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:06:54.613794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651812+0000","last_change":"2024-05-30T16:56:44.658635+0000","last_active":"2024-05-30T16:56:45.651812+0000","last_peered":"2024-05-30T16:56:45.651812+0000","last_clean":"2024-05-30T16:56:45.651812+0000","last_became_active":"2024-05-30T16:56:44.658374+0000","last_became_peered":"2024-05-30T16:56:44.658374+0000","last_unstale":"2024-05-30T16:56:45.651812+0000","last_undegraded":"2024-05-30T16:56:45.651812+0000","last_fullsized":"2024-05-30T16:56:45.651812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:03:27.939224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650895+0000","last_change":"2024-05-30T16:56:44.652408+0000","last_active":"2024-05-30T16:56:45.650895+0000","last_peered":"2024-05-30T16:56:45.650895+0000","last_clean":"2024-05-30T16:56:45.650895+0000","last_became_active":"2024-05-30T16:56:44.652139+0000","last_became_peered":"2024-05-30T16:56:44.652139+0000","last_unstale":"2024-05-30T16:56:45.650895+0000","last_undegraded":"2024-05-30T16:56:45.650895+0000","last_fullsized":"2024-05-30T16:56:45.650895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:38:16.555934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652763+0000","last_change":"2024-05-30T16:56:44.664085+0000","last_active":"2024-05-30T16:56:45.652763+0000","last_peered":"2024-05-30T16:56:45.652763+0000","last_clean":"2024-05-30T16:56:45.652763+0000","last_became_active":"2024-05-30T16:56:44.663813+0000","last_became_peered":"2024-05-30T16:56:44.663813+0000","last_unstale":"2024-05-30T16:56:45.652763+0000","last_undegraded":"2024-05-30T16:56:45.652763+0000","last_fullsized":"2024-05-30T16:56:45.652763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:48.530977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652173+0000","last_change":"2024-05-30T16:56:44.649373+0000","last_active":"2024-05-30T16:56:45.652173+0000","last_peered":"2024-05-30T16:56:45.652173+0000","last_clean":"2024-05-30T16:56:45.652173+0000","last_became_active":"2024-05-30T16:56:44.649085+0000","last_became_peered":"2024-05-30T16:56:44.649085+0000","last_unstale":"2024-05-30T16:56:45.652173+0000","last_undegraded":"2024-05-30T16:56:45.652173+0000","last_fullsized":"2024-05-30T16:56:45.652173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:38.575100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108768+0000","last_change":"2024-05-30T16:56:44.644524+0000","last_active":"2024-05-30T16:56:46.108768+0000","last_peered":"2024-05-30T16:56:46.108768+0000","last_clean":"2024-05-30T16:56:46.108768+0000","last_became_active":"2024-05-30T16:56:44.643377+0000","last_became_peered":"2024-05-30T16:56:44.643377+0000","last_unstale":"2024-05-30T16:56:46.108768+0000","last_undegraded":"2024-05-30T16:56:46.108768+0000","last_fullsized":"2024-05-30T16:56:46.108768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:16:01.798245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317074+0000","last_change":"2024-05-30T16:56:44.649026+0000","last_active":"2024-05-30T16:56:46.317074+0000","last_peered":"2024-05-30T16:56:46.317074+0000","last_clean":"2024-05-30T16:56:46.317074+0000","last_became_active":"2024-05-30T16:56:44.648420+0000","last_became_peered":"2024-05-30T16:56:44.648420+0000","last_unstale":"2024-05-30T16:56:46.317074+0000","last_undegraded":"2024-05-30T16:56:46.317074+0000","last_fullsized":"2024-05-30T16:56:46.317074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:09:04.016326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651285+0000","last_change":"2024-05-30T16:56:44.646135+0000","last_active":"2024-05-30T16:56:45.651285+0000","last_peered":"2024-05-30T16:56:45.651285+0000","last_clean":"2024-05-30T16:56:45.651285+0000","last_became_active":"2024-05-30T16:56:44.645002+0000","last_became_peered":"2024-05-30T16:56:44.645002+0000","last_unstale":"2024-05-30T16:56:45.651285+0000","last_undegraded":"2024-05-30T16:56:45.651285+0000","last_fullsized":"2024-05-30T16:56:45.651285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:18:37.099872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653598+0000","last_change":"2024-05-30T16:56:44.652466+0000","last_active":"2024-05-30T16:56:45.653598+0000","last_peered":"2024-05-30T16:56:45.653598+0000","last_clean":"2024-05-30T16:56:45.653598+0000","last_became_active":"2024-05-30T16:56:44.652159+0000","last_became_peered":"2024-05-30T16:56:44.652159+0000","last_unstale":"2024-05-30T16:56:45.653598+0000","last_undegraded":"2024-05-30T16:56:45.653598+0000","last_fullsized":"2024-05-30T16:56:45.653598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:58.919044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653237+0000","last_change":"2024-05-30T16:56:44.651849+0000","last_active":"2024-05-30T16:56:45.653237+0000","last_peered":"2024-05-30T16:56:45.653237+0000","last_clean":"2024-05-30T16:56:45.653237+0000","last_became_active":"2024-05-30T16:56:44.651587+0000","last_became_peered":"2024-05-30T16:56:44.651587+0000","last_unstale":"2024-05-30T16:56:45.653237+0000","last_undegraded":"2024-05-30T16:56:45.653237+0000","last_fullsized":"2024-05-30T16:56:45.653237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:28:50.592002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548147+0000","last_change":"2024-05-30T16:56:44.662385+0000","last_active":"2024-05-30T16:56:46.548147+0000","last_peered":"2024-05-30T16:56:46.548147+0000","last_clean":"2024-05-30T16:56:46.548147+0000","last_became_active":"2024-05-30T16:56:44.662083+0000","last_became_peered":"2024-05-30T16:56:44.662083+0000","last_unstale":"2024-05-30T16:56:46.548147+0000","last_undegraded":"2024-05-30T16:56:46.548147+0000","last_fullsized":"2024-05-30T16:56:46.548147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:16:01.303332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548254+0000","last_change":"2024-05-30T16:56:44.670256+0000","last_active":"2024-05-30T16:56:46.548254+0000","last_peered":"2024-05-30T16:56:46.548254+0000","last_clean":"2024-05-30T16:56:46.548254+0000","last_became_active":"2024-05-30T16:56:44.669963+0000","last_became_peered":"2024-05-30T16:56:44.669963+0000","last_unstale":"2024-05-30T16:56:46.548254+0000","last_undegraded":"2024-05-30T16:56:46.548254+0000","last_fullsized":"2024-05-30T16:56:46.548254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:01:10.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654066+0000","last_change":"2024-05-30T16:56:44.653100+0000","last_active":"2024-05-30T16:56:45.654066+0000","last_peered":"2024-05-30T16:56:45.654066+0000","last_clean":"2024-05-30T16:56:45.654066+0000","last_became_active":"2024-05-30T16:56:44.652785+0000","last_became_peered":"2024-05-30T16:56:44.652785+0000","last_unstale":"2024-05-30T16:56:45.654066+0000","last_undegraded":"2024-05-30T16:56:45.654066+0000","last_fullsized":"2024-05-30T16:56:45.654066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:24:18.478717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653867+0000","last_change":"2024-05-30T16:56:44.642985+0000","last_active":"2024-05-30T16:56:45.653867+0000","last_peered":"2024-05-30T16:56:45.653867+0000","last_clean":"2024-05-30T16:56:45.653867+0000","last_became_active":"2024-05-30T16:56:44.642676+0000","last_became_peered":"2024-05-30T16:56:44.642676+0000","last_unstale":"2024-05-30T16:56:45.653867+0000","last_undegraded":"2024-05-30T16:56:45.653867+0000","last_fullsized":"2024-05-30T16:56:45.653867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:36.158094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.816635+0000","last_change":"2024-05-30T16:56:44.651182+0000","last_active":"2024-05-30T16:56:46.816635+0000","last_peered":"2024-05-30T16:56:46.816635+0000","last_clean":"2024-05-30T16:56:46.816635+0000","last_became_active":"2024-05-30T16:56:44.650908+0000","last_became_peered":"2024-05-30T16:56:44.650908+0000","last_unstale":"2024-05-30T16:56:46.816635+0000","last_undegraded":"2024-05-30T16:56:46.816635+0000","last_fullsized":"2024-05-30T16:56:46.816635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:18.473217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653508+0000","last_change":"2024-05-30T16:56:44.654286+0000","last_active":"2024-05-30T16:56:45.653508+0000","last_peered":"2024-05-30T16:56:45.653508+0000","last_clean":"2024-05-30T16:56:45.653508+0000","last_became_active":"2024-05-30T16:56:44.653927+0000","last_became_peered":"2024-05-30T16:56:44.653927+0000","last_unstale":"2024-05-30T16:56:45.653508+0000","last_undegraded":"2024-05-30T16:56:45.653508+0000","last_fullsized":"2024-05-30T16:56:45.653508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:44.828514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.816582+0000","last_change":"2024-05-30T16:56:44.650936+0000","last_active":"2024-05-30T16:56:46.816582+0000","last_peered":"2024-05-30T16:56:46.816582+0000","last_clean":"2024-05-30T16:56:46.816582+0000","last_became_active":"2024-05-30T16:56:44.650397+0000","last_became_peered":"2024-05-30T16:56:44.650397+0000","last_unstale":"2024-05-30T16:56:46.816582+0000","last_undegraded":"2024-05-30T16:56:46.816582+0000","last_fullsized":"2024-05-30T16:56:46.816582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:37.002566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652885+0000","last_change":"2024-05-30T16:56:44.643854+0000","last_active":"2024-05-30T16:56:45.652885+0000","last_peered":"2024-05-30T16:56:45.652885+0000","last_clean":"2024-05-30T16:56:45.652885+0000","last_became_active":"2024-05-30T16:56:44.643513+0000","last_became_peered":"2024-05-30T16:56:44.643513+0000","last_unstale":"2024-05-30T16:56:45.652885+0000","last_undegraded":"2024-05-30T16:56:45.652885+0000","last_fullsized":"2024-05-30T16:56:45.652885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:45:54.673385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653096+0000","last_change":"2024-05-30T16:56:44.650198+0000","last_active":"2024-05-30T16:56:45.653096+0000","last_peered":"2024-05-30T16:56:45.653096+0000","last_clean":"2024-05-30T16:56:45.653096+0000","last_became_active":"2024-05-30T16:56:44.649852+0000","last_became_peered":"2024-05-30T16:56:44.649852+0000","last_unstale":"2024-05-30T16:56:45.653096+0000","last_undegraded":"2024-05-30T16:56:45.653096+0000","last_fullsized":"2024-05-30T16:56:45.653096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:24:18.478717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317162+0000","last_change":"2024-05-30T16:56:44.646102+0000","last_active":"2024-05-30T16:56:46.317162+0000","last_peered":"2024-05-30T16:56:46.317162+0000","last_clean":"2024-05-30T16:56:46.317162+0000","last_became_active":"2024-05-30T16:56:44.645809+0000","last_became_peered":"2024-05-30T16:56:44.645809+0000","last_unstale":"2024-05-30T16:56:46.317162+0000","last_undegraded":"2024-05-30T16:56:46.317162+0000","last_fullsized":"2024-05-30T16:56:46.317162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:01:20.685589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548620+0000","last_change":"2024-05-30T16:56:44.669763+0000","last_active":"2024-05-30T16:56:46.548620+0000","last_peered":"2024-05-30T16:56:46.548620+0000","last_clean":"2024-05-30T16:56:46.548620+0000","last_became_active":"2024-05-30T16:56:44.669357+0000","last_became_peered":"2024-05-30T16:56:44.669357+0000","last_unstale":"2024-05-30T16:56:46.548620+0000","last_undegraded":"2024-05-30T16:56:46.548620+0000","last_fullsized":"2024-05-30T16:56:46.548620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:03.908739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548770+0000","last_change":"2024-05-30T16:56:43.652722+0000","last_active":"2024-05-30T16:56:46.548770+0000","last_peered":"2024-05-30T16:56:46.548770+0000","last_clean":"2024-05-30T16:56:46.548770+0000","last_became_active":"2024-05-30T16:56:43.652368+0000","last_became_peered":"2024-05-30T16:56:43.652368+0000","last_unstale":"2024-05-30T16:56:46.548770+0000","last_undegraded":"2024-05-30T16:56:46.548770+0000","last_fullsized":"2024-05-30T16:56:46.548770+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:41:02.005724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652233+0000","last_change":"2024-05-30T16:56:44.652087+0000","last_active":"2024-05-30T16:56:45.652233+0000","last_peered":"2024-05-30T16:56:45.652233+0000","last_clean":"2024-05-30T16:56:45.652233+0000","last_became_active":"2024-05-30T16:56:44.651426+0000","last_became_peered":"2024-05-30T16:56:44.651426+0000","last_unstale":"2024-05-30T16:56:45.652233+0000","last_undegraded":"2024-05-30T16:56:45.652233+0000","last_fullsized":"2024-05-30T16:56:45.652233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:56.981440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651747+0000","last_change":"2024-05-30T16:56:43.652242+0000","last_active":"2024-05-30T16:56:45.651747+0000","last_peered":"2024-05-30T16:56:45.651747+0000","last_clean":"2024-05-30T16:56:45.651747+0000","last_became_active":"2024-05-30T16:56:43.651954+0000","last_became_peered":"2024-05-30T16:56:43.651954+0000","last_unstale":"2024-05-30T16:56:45.651747+0000","last_undegraded":"2024-05-30T16:56:45.651747+0000","last_fullsized":"2024-05-30T16:56:45.651747+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:43.825060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317283+0000","last_change":"2024-05-30T16:56:44.658539+0000","last_active":"2024-05-30T16:56:46.317283+0000","last_peered":"2024-05-30T16:56:46.317283+0000","last_clean":"2024-05-30T16:56:46.317283+0000","last_became_active":"2024-05-30T16:56:44.658254+0000","last_became_peered":"2024-05-30T16:56:44.658254+0000","last_unstale":"2024-05-30T16:56:46.317283+0000","last_undegraded":"2024-05-30T16:56:46.317283+0000","last_fullsized":"2024-05-30T16:56:46.317283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:46:34.248305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653628+0000","last_change":"2024-05-30T16:56:43.643351+0000","last_active":"2024-05-30T16:56:45.653628+0000","last_peered":"2024-05-30T16:56:45.653628+0000","last_clean":"2024-05-30T16:56:45.653628+0000","last_became_active":"2024-05-30T16:56:43.643086+0000","last_became_peered":"2024-05-30T16:56:43.643086+0000","last_unstale":"2024-05-30T16:56:45.653628+0000","last_undegraded":"2024-05-30T16:56:45.653628+0000","last_fullsized":"2024-05-30T16:56:45.653628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:14:23.863146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548563+0000","last_change":"2024-05-30T16:56:44.665209+0000","last_active":"2024-05-30T16:56:46.548563+0000","last_peered":"2024-05-30T16:56:46.548563+0000","last_clean":"2024-05-30T16:56:46.548563+0000","last_became_active":"2024-05-30T16:56:44.664880+0000","last_became_peered":"2024-05-30T16:56:44.664880+0000","last_unstale":"2024-05-30T16:56:46.548563+0000","last_undegraded":"2024-05-30T16:56:46.548563+0000","last_fullsized":"2024-05-30T16:56:46.548563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:37:30.146195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317153+0000","last_change":"2024-05-30T16:56:43.652649+0000","last_active":"2024-05-30T16:56:46.317153+0000","last_peered":"2024-05-30T16:56:46.317153+0000","last_clean":"2024-05-30T16:56:46.317153+0000","last_became_active":"2024-05-30T16:56:43.652332+0000","last_became_peered":"2024-05-30T16:56:43.652332+0000","last_unstale":"2024-05-30T16:56:46.317153+0000","last_undegraded":"2024-05-30T16:56:46.317153+0000","last_fullsized":"2024-05-30T16:56:46.317153+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:16:00.794791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653299+0000","last_change":"2024-05-30T16:56:44.651028+0000","last_active":"2024-05-30T16:56:45.653299+0000","last_peered":"2024-05-30T16:56:45.653299+0000","last_clean":"2024-05-30T16:56:45.653299+0000","last_became_active":"2024-05-30T16:56:44.650717+0000","last_became_peered":"2024-05-30T16:56:44.650717+0000","last_unstale":"2024-05-30T16:56:45.653299+0000","last_undegraded":"2024-05-30T16:56:45.653299+0000","last_fullsized":"2024-05-30T16:56:45.653299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:27.192232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.816686+0000","last_change":"2024-05-30T16:56:43.650135+0000","last_active":"2024-05-30T16:56:46.816686+0000","last_peered":"2024-05-30T16:56:46.816686+0000","last_clean":"2024-05-30T16:56:46.816686+0000","last_became_active":"2024-05-30T16:56:43.649731+0000","last_became_peered":"2024-05-30T16:56:43.649731+0000","last_unstale":"2024-05-30T16:56:46.816686+0000","last_undegraded":"2024-05-30T16:56:46.816686+0000","last_fullsized":"2024-05-30T16:56:46.816686+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:05:58.221402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653764+0000","last_change":"2024-05-30T16:56:44.660137+0000","last_active":"2024-05-30T16:56:45.653764+0000","last_peered":"2024-05-30T16:56:45.653764+0000","last_clean":"2024-05-30T16:56:45.653764+0000","last_became_active":"2024-05-30T16:56:44.659826+0000","last_became_peered":"2024-05-30T16:56:44.659826+0000","last_unstale":"2024-05-30T16:56:45.653764+0000","last_undegraded":"2024-05-30T16:56:45.653764+0000","last_fullsized":"2024-05-30T16:56:45.653764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:32:08.978869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316739+0000","last_change":"2024-05-30T16:56:43.649636+0000","last_active":"2024-05-30T16:56:46.316739+0000","last_peered":"2024-05-30T16:56:46.316739+0000","last_clean":"2024-05-30T16:56:46.316739+0000","last_became_active":"2024-05-30T16:56:43.648216+0000","last_became_peered":"2024-05-30T16:56:43.648216+0000","last_unstale":"2024-05-30T16:56:46.316739+0000","last_undegraded":"2024-05-30T16:56:46.316739+0000","last_fullsized":"2024-05-30T16:56:46.316739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:41.743303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650764+0000","last_change":"2024-05-30T16:56:44.655108+0000","last_active":"2024-05-30T16:56:45.650764+0000","last_peered":"2024-05-30T16:56:45.650764+0000","last_clean":"2024-05-30T16:56:45.650764+0000","last_became_active":"2024-05-30T16:56:44.654831+0000","last_became_peered":"2024-05-30T16:56:44.654831+0000","last_unstale":"2024-05-30T16:56:45.650764+0000","last_undegraded":"2024-05-30T16:56:45.650764+0000","last_fullsized":"2024-05-30T16:56:45.650764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:13:38.307444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108376+0000","last_change":"2024-05-30T16:56:43.640552+0000","last_active":"2024-05-30T16:56:46.108376+0000","last_peered":"2024-05-30T16:56:46.108376+0000","last_clean":"2024-05-30T16:56:46.108376+0000","last_became_active":"2024-05-30T16:56:43.640314+0000","last_became_peered":"2024-05-30T16:56:43.640314+0000","last_unstale":"2024-05-30T16:56:46.108376+0000","last_undegraded":"2024-05-30T16:56:46.108376+0000","last_fullsized":"2024-05-30T16:56:46.108376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:08.666126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651001+0000","last_change":"2024-05-30T16:56:44.660810+0000","last_active":"2024-05-30T16:56:45.651001+0000","last_peered":"2024-05-30T16:56:45.651001+0000","last_clean":"2024-05-30T16:56:45.651001+0000","last_became_active":"2024-05-30T16:56:44.660477+0000","last_became_peered":"2024-05-30T16:56:44.660477+0000","last_unstale":"2024-05-30T16:56:45.651001+0000","last_undegraded":"2024-05-30T16:56:45.651001+0000","last_fullsized":"2024-05-30T16:56:45.651001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:25:50.040344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650776+0000","last_change":"2024-05-30T16:56:43.641994+0000","last_active":"2024-05-30T16:56:45.650776+0000","last_peered":"2024-05-30T16:56:45.650776+0000","last_clean":"2024-05-30T16:56:45.650776+0000","last_became_active":"2024-05-30T16:56:43.641712+0000","last_became_peered":"2024-05-30T16:56:43.641712+0000","last_unstale":"2024-05-30T16:56:45.650776+0000","last_undegraded":"2024-05-30T16:56:45.650776+0000","last_fullsized":"2024-05-30T16:56:45.650776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:08:06.965045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654000+0000","last_change":"2024-05-30T16:56:44.658680+0000","last_active":"2024-05-30T16:56:45.654000+0000","last_peered":"2024-05-30T16:56:45.654000+0000","last_clean":"2024-05-30T16:56:45.654000+0000","last_became_active":"2024-05-30T16:56:44.658405+0000","last_became_peered":"2024-05-30T16:56:44.658405+0000","last_unstale":"2024-05-30T16:56:45.654000+0000","last_undegraded":"2024-05-30T16:56:45.654000+0000","last_fullsized":"2024-05-30T16:56:45.654000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:25:50.040344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654147+0000","last_change":"2024-05-30T16:56:43.646805+0000","last_active":"2024-05-30T16:56:45.654147+0000","last_peered":"2024-05-30T16:56:45.654147+0000","last_clean":"2024-05-30T16:56:45.654147+0000","last_became_active":"2024-05-30T16:56:43.646509+0000","last_became_peered":"2024-05-30T16:56:43.646509+0000","last_unstale":"2024-05-30T16:56:45.654147+0000","last_undegraded":"2024-05-30T16:56:45.654147+0000","last_fullsized":"2024-05-30T16:56:45.654147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:40:10.041928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548707+0000","last_change":"2024-05-30T16:56:44.671239+0000","last_active":"2024-05-30T16:56:46.548707+0000","last_peered":"2024-05-30T16:56:46.548707+0000","last_clean":"2024-05-30T16:56:46.548707+0000","last_became_active":"2024-05-30T16:56:44.670215+0000","last_became_peered":"2024-05-30T16:56:44.670215+0000","last_unstale":"2024-05-30T16:56:46.548707+0000","last_undegraded":"2024-05-30T16:56:46.548707+0000","last_fullsized":"2024-05-30T16:56:46.548707+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:50.550356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317387+0000","last_change":"2024-05-30T16:56:43.648959+0000","last_active":"2024-05-30T16:56:46.317387+0000","last_peered":"2024-05-30T16:56:46.317387+0000","last_clean":"2024-05-30T16:56:46.317387+0000","last_became_active":"2024-05-30T16:56:43.648675+0000","last_became_peered":"2024-05-30T16:56:43.648675+0000","last_unstale":"2024-05-30T16:56:46.317387+0000","last_undegraded":"2024-05-30T16:56:46.317387+0000","last_fullsized":"2024-05-30T16:56:46.317387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:52.114014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316987+0000","last_change":"2024-05-30T16:56:44.651009+0000","last_active":"2024-05-30T16:56:46.316987+0000","last_peered":"2024-05-30T16:56:46.316987+0000","last_clean":"2024-05-30T16:56:46.316987+0000","last_became_active":"2024-05-30T16:56:44.650709+0000","last_became_peered":"2024-05-30T16:56:44.650709+0000","last_unstale":"2024-05-30T16:56:46.316987+0000","last_undegraded":"2024-05-30T16:56:46.316987+0000","last_fullsized":"2024-05-30T16:56:46.316987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:03:39.290806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.816694+0000","last_change":"2024-05-30T16:56:43.648080+0000","last_active":"2024-05-30T16:56:46.816694+0000","last_peered":"2024-05-30T16:56:46.816694+0000","last_clean":"2024-05-30T16:56:46.816694+0000","last_became_active":"2024-05-30T16:56:43.647224+0000","last_became_peered":"2024-05-30T16:56:43.647224+0000","last_unstale":"2024-05-30T16:56:46.816694+0000","last_undegraded":"2024-05-30T16:56:46.816694+0000","last_fullsized":"2024-05-30T16:56:46.816694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:24:13.264974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651928+0000","last_change":"2024-05-30T16:56:44.650308+0000","last_active":"2024-05-30T16:56:45.651928+0000","last_peered":"2024-05-30T16:56:45.651928+0000","last_clean":"2024-05-30T16:56:45.651928+0000","last_became_active":"2024-05-30T16:56:44.649980+0000","last_became_peered":"2024-05-30T16:56:44.649980+0000","last_unstale":"2024-05-30T16:56:45.651928+0000","last_undegraded":"2024-05-30T16:56:45.651928+0000","last_fullsized":"2024-05-30T16:56:45.651928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:45:58.041826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"74'6","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108800+0000","last_change":"2024-05-30T16:56:43.646796+0000","last_active":"2024-05-30T16:56:46.108800+0000","last_peered":"2024-05-30T16:56:46.108800+0000","last_clean":"2024-05-30T16:56:46.108800+0000","last_became_active":"2024-05-30T16:56:43.646100+0000","last_became_peered":"2024-05-30T16:56:43.646100+0000","last_unstale":"2024-05-30T16:56:46.108800+0000","last_undegraded":"2024-05-30T16:56:46.108800+0000","last_fullsized":"2024-05-30T16:56:46.108800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:55.977985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548319+0000","last_change":"2024-05-30T16:56:44.666817+0000","last_active":"2024-05-30T16:56:46.548319+0000","last_peered":"2024-05-30T16:56:46.548319+0000","last_clean":"2024-05-30T16:56:46.548319+0000","last_became_active":"2024-05-30T16:56:44.666556+0000","last_became_peered":"2024-05-30T16:56:44.666556+0000","last_unstale":"2024-05-30T16:56:46.548319+0000","last_undegraded":"2024-05-30T16:56:46.548319+0000","last_fullsized":"2024-05-30T16:56:46.548319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:25:09.747489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108561+0000","last_change":"2024-05-30T16:56:43.646330+0000","last_active":"2024-05-30T16:56:46.108561+0000","last_peered":"2024-05-30T16:56:46.108561+0000","last_clean":"2024-05-30T16:56:46.108561+0000","last_became_active":"2024-05-30T16:56:43.645135+0000","last_became_peered":"2024-05-30T16:56:43.645135+0000","last_unstale":"2024-05-30T16:56:46.108561+0000","last_undegraded":"2024-05-30T16:56:46.108561+0000","last_fullsized":"2024-05-30T16:56:46.108561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:37.571645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654213+0000","last_change":"2024-05-30T16:56:44.652909+0000","last_active":"2024-05-30T16:56:45.654213+0000","last_peered":"2024-05-30T16:56:45.654213+0000","last_clean":"2024-05-30T16:56:45.654213+0000","last_became_active":"2024-05-30T16:56:44.652639+0000","last_became_peered":"2024-05-30T16:56:44.652639+0000","last_unstale":"2024-05-30T16:56:45.654213+0000","last_undegraded":"2024-05-30T16:56:45.654213+0000","last_fullsized":"2024-05-30T16:56:45.654213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:18:37.099872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316955+0000","last_change":"2024-05-30T16:56:43.648535+0000","last_active":"2024-05-30T16:56:46.316955+0000","last_peered":"2024-05-30T16:56:46.316955+0000","last_clean":"2024-05-30T16:56:46.316955+0000","last_became_active":"2024-05-30T16:56:43.648206+0000","last_became_peered":"2024-05-30T16:56:43.648206+0000","last_unstale":"2024-05-30T16:56:46.316955+0000","last_undegraded":"2024-05-30T16:56:46.316955+0000","last_fullsized":"2024-05-30T16:56:46.316955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:55:28.651316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650979+0000","last_change":"2024-05-30T16:56:44.645994+0000","last_active":"2024-05-30T16:56:45.650979+0000","last_peered":"2024-05-30T16:56:45.650979+0000","last_clean":"2024-05-30T16:56:45.650979+0000","last_became_active":"2024-05-30T16:56:44.645720+0000","last_became_peered":"2024-05-30T16:56:44.645720+0000","last_unstale":"2024-05-30T16:56:45.650979+0000","last_undegraded":"2024-05-30T16:56:45.650979+0000","last_fullsized":"2024-05-30T16:56:45.650979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:36.158094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652937+0000","last_change":"2024-05-30T16:56:43.646206+0000","last_active":"2024-05-30T16:56:45.652937+0000","last_peered":"2024-05-30T16:56:45.652937+0000","last_clean":"2024-05-30T16:56:45.652937+0000","last_became_active":"2024-05-30T16:56:43.645673+0000","last_became_peered":"2024-05-30T16:56:43.645673+0000","last_unstale":"2024-05-30T16:56:45.652937+0000","last_undegraded":"2024-05-30T16:56:45.652937+0000","last_fullsized":"2024-05-30T16:56:45.652937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:22:16.376711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651353+0000","last_change":"2024-05-30T16:56:44.652605+0000","last_active":"2024-05-30T16:56:45.651353+0000","last_peered":"2024-05-30T16:56:45.651353+0000","last_clean":"2024-05-30T16:56:45.651353+0000","last_became_active":"2024-05-30T16:56:44.650499+0000","last_became_peered":"2024-05-30T16:56:44.650499+0000","last_unstale":"2024-05-30T16:56:45.651353+0000","last_undegraded":"2024-05-30T16:56:45.651353+0000","last_fullsized":"2024-05-30T16:56:45.651353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:31.289587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653299+0000","last_change":"2024-05-30T16:56:43.647263+0000","last_active":"2024-05-30T16:56:45.653299+0000","last_peered":"2024-05-30T16:56:45.653299+0000","last_clean":"2024-05-30T16:56:45.653299+0000","last_became_active":"2024-05-30T16:56:43.645925+0000","last_became_peered":"2024-05-30T16:56:43.645925+0000","last_unstale":"2024-05-30T16:56:45.653299+0000","last_undegraded":"2024-05-30T16:56:45.653299+0000","last_fullsized":"2024-05-30T16:56:45.653299+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:39:52.639268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654061+0000","last_change":"2024-05-30T16:56:44.654596+0000","last_active":"2024-05-30T16:56:45.654061+0000","last_peered":"2024-05-30T16:56:45.654061+0000","last_clean":"2024-05-30T16:56:45.654061+0000","last_became_active":"2024-05-30T16:56:44.650982+0000","last_became_peered":"2024-05-30T16:56:44.650982+0000","last_unstale":"2024-05-30T16:56:45.654061+0000","last_undegraded":"2024-05-30T16:56:45.654061+0000","last_fullsized":"2024-05-30T16:56:45.654061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:45:54.673385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317415+0000","last_change":"2024-05-30T16:56:43.649341+0000","last_active":"2024-05-30T16:56:46.317415+0000","last_peered":"2024-05-30T16:56:46.317415+0000","last_clean":"2024-05-30T16:56:46.317415+0000","last_became_active":"2024-05-30T16:56:43.649011+0000","last_became_peered":"2024-05-30T16:56:43.649011+0000","last_unstale":"2024-05-30T16:56:46.317415+0000","last_undegraded":"2024-05-30T16:56:46.317415+0000","last_fullsized":"2024-05-30T16:56:46.317415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:00:01.001014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548789+0000","last_change":"2024-05-30T16:56:44.666380+0000","last_active":"2024-05-30T16:56:46.548789+0000","last_peered":"2024-05-30T16:56:46.548789+0000","last_clean":"2024-05-30T16:56:46.548789+0000","last_became_active":"2024-05-30T16:56:44.665935+0000","last_became_peered":"2024-05-30T16:56:44.665935+0000","last_unstale":"2024-05-30T16:56:46.548789+0000","last_undegraded":"2024-05-30T16:56:46.548789+0000","last_fullsized":"2024-05-30T16:56:46.548789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:15.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.654099+0000","last_change":"2024-05-30T16:56:43.642066+0000","last_active":"2024-05-30T16:56:45.654099+0000","last_peered":"2024-05-30T16:56:45.654099+0000","last_clean":"2024-05-30T16:56:45.654099+0000","last_became_active":"2024-05-30T16:56:43.641208+0000","last_became_peered":"2024-05-30T16:56:43.641208+0000","last_unstale":"2024-05-30T16:56:45.654099+0000","last_undegraded":"2024-05-30T16:56:45.654099+0000","last_fullsized":"2024-05-30T16:56:45.654099+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:46:36.960891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108805+0000","last_change":"2024-05-30T16:56:44.656373+0000","last_active":"2024-05-30T16:56:46.108805+0000","last_peered":"2024-05-30T16:56:46.108805+0000","last_clean":"2024-05-30T16:56:46.108805+0000","last_became_active":"2024-05-30T16:56:44.653318+0000","last_became_peered":"2024-05-30T16:56:44.653318+0000","last_unstale":"2024-05-30T16:56:46.108805+0000","last_undegraded":"2024-05-30T16:56:46.108805+0000","last_fullsized":"2024-05-30T16:56:46.108805+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:39.371941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317208+0000","last_change":"2024-05-30T16:56:43.647018+0000","last_active":"2024-05-30T16:56:46.317208+0000","last_peered":"2024-05-30T16:56:46.317208+0000","last_clean":"2024-05-30T16:56:46.317208+0000","last_became_active":"2024-05-30T16:56:43.646734+0000","last_became_peered":"2024-05-30T16:56:43.646734+0000","last_unstale":"2024-05-30T16:56:46.317208+0000","last_undegraded":"2024-05-30T16:56:46.317208+0000","last_fullsized":"2024-05-30T16:56:46.317208+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:55:18.699236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652099+0000","last_change":"2024-05-30T16:56:44.654757+0000","last_active":"2024-05-30T16:56:45.652099+0000","last_peered":"2024-05-30T16:56:45.652099+0000","last_clean":"2024-05-30T16:56:45.652099+0000","last_became_active":"2024-05-30T16:56:44.654467+0000","last_became_peered":"2024-05-30T16:56:44.654467+0000","last_unstale":"2024-05-30T16:56:45.652099+0000","last_undegraded":"2024-05-30T16:56:45.652099+0000","last_fullsized":"2024-05-30T16:56:45.652099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:09.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548368+0000","last_change":"2024-05-30T16:56:43.651621+0000","last_active":"2024-05-30T16:56:46.548368+0000","last_peered":"2024-05-30T16:56:46.548368+0000","last_clean":"2024-05-30T16:56:46.548368+0000","last_became_active":"2024-05-30T16:56:43.651020+0000","last_became_peered":"2024-05-30T16:56:43.651020+0000","last_unstale":"2024-05-30T16:56:46.548368+0000","last_undegraded":"2024-05-30T16:56:46.548368+0000","last_fullsized":"2024-05-30T16:56:46.548368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:32:07.975415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.816607+0000","last_change":"2024-05-30T16:56:44.650720+0000","last_active":"2024-05-30T16:56:46.816607+0000","last_peered":"2024-05-30T16:56:46.816607+0000","last_clean":"2024-05-30T16:56:46.816607+0000","last_became_active":"2024-05-30T16:56:44.649933+0000","last_became_peered":"2024-05-30T16:56:44.649933+0000","last_unstale":"2024-05-30T16:56:46.816607+0000","last_undegraded":"2024-05-30T16:56:46.816607+0000","last_fullsized":"2024-05-30T16:56:46.816607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:30:41.663140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316958+0000","last_change":"2024-05-30T16:56:43.648500+0000","last_active":"2024-05-30T16:56:46.316958+0000","last_peered":"2024-05-30T16:56:46.316958+0000","last_clean":"2024-05-30T16:56:46.316958+0000","last_became_active":"2024-05-30T16:56:43.647772+0000","last_became_peered":"2024-05-30T16:56:43.647772+0000","last_unstale":"2024-05-30T16:56:46.316958+0000","last_undegraded":"2024-05-30T16:56:46.316958+0000","last_fullsized":"2024-05-30T16:56:46.316958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:59.944690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.816397+0000","last_change":"2024-05-30T16:56:44.646838+0000","last_active":"2024-05-30T16:56:46.816397+0000","last_peered":"2024-05-30T16:56:46.816397+0000","last_clean":"2024-05-30T16:56:46.816397+0000","last_became_active":"2024-05-30T16:56:44.646587+0000","last_became_peered":"2024-05-30T16:56:44.646587+0000","last_unstale":"2024-05-30T16:56:46.816397+0000","last_undegraded":"2024-05-30T16:56:46.816397+0000","last_fullsized":"2024-05-30T16:56:46.816397+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:10:10.022467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653189+0000","last_change":"2024-05-30T16:56:43.643553+0000","last_active":"2024-05-30T16:56:45.653189+0000","last_peered":"2024-05-30T16:56:45.653189+0000","last_clean":"2024-05-30T16:56:45.653189+0000","last_became_active":"2024-05-30T16:56:43.642497+0000","last_became_peered":"2024-05-30T16:56:43.642497+0000","last_unstale":"2024-05-30T16:56:45.653189+0000","last_undegraded":"2024-05-30T16:56:45.653189+0000","last_fullsized":"2024-05-30T16:56:45.653189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:46:33.244850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.816519+0000","last_change":"2024-05-30T16:56:44.646527+0000","last_active":"2024-05-30T16:56:46.816519+0000","last_peered":"2024-05-30T16:56:46.816519+0000","last_clean":"2024-05-30T16:56:46.816519+0000","last_became_active":"2024-05-30T16:56:44.646233+0000","last_became_peered":"2024-05-30T16:56:44.646233+0000","last_unstale":"2024-05-30T16:56:46.816519+0000","last_undegraded":"2024-05-30T16:56:46.816519+0000","last_fullsized":"2024-05-30T16:56:46.816519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:43:51.280076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.650833+0000","last_change":"2024-05-30T16:56:43.651846+0000","last_active":"2024-05-30T16:56:45.650833+0000","last_peered":"2024-05-30T16:56:45.650833+0000","last_clean":"2024-05-30T16:56:45.650833+0000","last_became_active":"2024-05-30T16:56:43.651253+0000","last_became_peered":"2024-05-30T16:56:43.651253+0000","last_unstale":"2024-05-30T16:56:45.650833+0000","last_undegraded":"2024-05-30T16:56:45.650833+0000","last_fullsized":"2024-05-30T16:56:45.650833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:47.527522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651601+0000","last_change":"2024-05-30T16:56:44.651868+0000","last_active":"2024-05-30T16:56:45.651601+0000","last_peered":"2024-05-30T16:56:45.651601+0000","last_clean":"2024-05-30T16:56:45.651601+0000","last_became_active":"2024-05-30T16:56:44.651600+0000","last_became_peered":"2024-05-30T16:56:44.651600+0000","last_unstale":"2024-05-30T16:56:45.651601+0000","last_undegraded":"2024-05-30T16:56:45.651601+0000","last_fullsized":"2024-05-30T16:56:45.651601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:52:05.375623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317479+0000","last_change":"2024-05-30T16:56:43.647155+0000","last_active":"2024-05-30T16:56:46.317479+0000","last_peered":"2024-05-30T16:56:46.317479+0000","last_clean":"2024-05-30T16:56:46.317479+0000","last_became_active":"2024-05-30T16:56:43.646879+0000","last_became_peered":"2024-05-30T16:56:43.646879+0000","last_unstale":"2024-05-30T16:56:46.317479+0000","last_undegraded":"2024-05-30T16:56:46.317479+0000","last_fullsized":"2024-05-30T16:56:46.317479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:53.002194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653701+0000","last_change":"2024-05-30T16:56:44.643180+0000","last_active":"2024-05-30T16:56:45.653701+0000","last_peered":"2024-05-30T16:56:45.653701+0000","last_clean":"2024-05-30T16:56:45.653701+0000","last_became_active":"2024-05-30T16:56:44.642880+0000","last_became_peered":"2024-05-30T16:56:44.642880+0000","last_unstale":"2024-05-30T16:56:45.653701+0000","last_undegraded":"2024-05-30T16:56:45.653701+0000","last_fullsized":"2024-05-30T16:56:45.653701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:38:16.555934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653975+0000","last_change":"2024-05-30T16:56:43.646647+0000","last_active":"2024-05-30T16:56:45.653975+0000","last_peered":"2024-05-30T16:56:45.653975+0000","last_clean":"2024-05-30T16:56:45.653975+0000","last_became_active":"2024-05-30T16:56:43.646200+0000","last_became_peered":"2024-05-30T16:56:43.646200+0000","last_unstale":"2024-05-30T16:56:45.653975+0000","last_undegraded":"2024-05-30T16:56:45.653975+0000","last_fullsized":"2024-05-30T16:56:45.653975+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:27.365379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548416+0000","last_change":"2024-05-30T16:56:44.669877+0000","last_active":"2024-05-30T16:56:46.548416+0000","last_peered":"2024-05-30T16:56:46.548416+0000","last_clean":"2024-05-30T16:56:46.548416+0000","last_became_active":"2024-05-30T16:56:44.669562+0000","last_became_peered":"2024-05-30T16:56:44.669562+0000","last_unstale":"2024-05-30T16:56:46.548416+0000","last_undegraded":"2024-05-30T16:56:46.548416+0000","last_fullsized":"2024-05-30T16:56:46.548416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:59:28.731114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.652045+0000","last_change":"2024-05-30T16:56:43.648834+0000","last_active":"2024-05-30T16:56:45.652045+0000","last_peered":"2024-05-30T16:56:45.652045+0000","last_clean":"2024-05-30T16:56:45.652045+0000","last_became_active":"2024-05-30T16:56:43.648569+0000","last_became_peered":"2024-05-30T16:56:43.648569+0000","last_unstale":"2024-05-30T16:56:45.652045+0000","last_undegraded":"2024-05-30T16:56:45.652045+0000","last_fullsized":"2024-05-30T16:56:45.652045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:43.464267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548587+0000","last_change":"2024-05-30T16:56:44.662124+0000","last_active":"2024-05-30T16:56:46.548587+0000","last_peered":"2024-05-30T16:56:46.548587+0000","last_clean":"2024-05-30T16:56:46.548587+0000","last_became_active":"2024-05-30T16:56:44.661807+0000","last_became_peered":"2024-05-30T16:56:44.661807+0000","last_unstale":"2024-05-30T16:56:46.548587+0000","last_undegraded":"2024-05-30T16:56:46.548587+0000","last_fullsized":"2024-05-30T16:56:46.548587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:05.799103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651433+0000","last_change":"2024-05-30T16:56:43.648503+0000","last_active":"2024-05-30T16:56:45.651433+0000","last_peered":"2024-05-30T16:56:45.651433+0000","last_clean":"2024-05-30T16:56:45.651433+0000","last_became_active":"2024-05-30T16:56:43.648229+0000","last_became_peered":"2024-05-30T16:56:43.648229+0000","last_unstale":"2024-05-30T16:56:45.651433+0000","last_undegraded":"2024-05-30T16:56:45.651433+0000","last_fullsized":"2024-05-30T16:56:45.651433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:28:49.588547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651904+0000","last_change":"2024-05-30T16:56:44.653977+0000","last_active":"2024-05-30T16:56:45.651904+0000","last_peered":"2024-05-30T16:56:45.651904+0000","last_clean":"2024-05-30T16:56:45.651904+0000","last_became_active":"2024-05-30T16:56:44.653708+0000","last_became_peered":"2024-05-30T16:56:44.653708+0000","last_unstale":"2024-05-30T16:56:45.651904+0000","last_undegraded":"2024-05-30T16:56:45.651904+0000","last_fullsized":"2024-05-30T16:56:45.651904+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:13:35.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.651897+0000","last_change":"2024-05-30T16:56:43.645417+0000","last_active":"2024-05-30T16:56:45.651897+0000","last_peered":"2024-05-30T16:56:45.651897+0000","last_clean":"2024-05-30T16:56:45.651897+0000","last_became_active":"2024-05-30T16:56:43.645163+0000","last_became_peered":"2024-05-30T16:56:43.645163+0000","last_unstale":"2024-05-30T16:56:45.651897+0000","last_undegraded":"2024-05-30T16:56:45.651897+0000","last_fullsized":"2024-05-30T16:56:45.651897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:24.915924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316854+0000","last_change":"2024-05-30T16:56:44.664261+0000","last_active":"2024-05-30T16:56:46.316854+0000","last_peered":"2024-05-30T16:56:46.316854+0000","last_clean":"2024-05-30T16:56:46.316854+0000","last_became_active":"2024-05-30T16:56:44.658602+0000","last_became_peered":"2024-05-30T16:56:44.658602+0000","last_unstale":"2024-05-30T16:56:46.316854+0000","last_undegraded":"2024-05-30T16:56:46.316854+0000","last_fullsized":"2024-05-30T16:56:46.316854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:46:37.964346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108360+0000","last_change":"2024-05-30T16:56:43.641165+0000","last_active":"2024-05-30T16:56:46.108360+0000","last_peered":"2024-05-30T16:56:46.108360+0000","last_clean":"2024-05-30T16:56:46.108360+0000","last_became_active":"2024-05-30T16:56:43.640904+0000","last_became_peered":"2024-05-30T16:56:43.640904+0000","last_unstale":"2024-05-30T16:56:46.108360+0000","last_undegraded":"2024-05-30T16:56:46.108360+0000","last_fullsized":"2024-05-30T16:56:46.108360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:52.254333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.108541+0000","last_change":"2024-05-30T16:56:44.644193+0000","last_active":"2024-05-30T16:56:46.108541+0000","last_peered":"2024-05-30T16:56:46.108541+0000","last_clean":"2024-05-30T16:56:46.108541+0000","last_became_active":"2024-05-30T16:56:44.643801+0000","last_became_peered":"2024-05-30T16:56:44.643801+0000","last_unstale":"2024-05-30T16:56:46.108541+0000","last_undegraded":"2024-05-30T16:56:46.108541+0000","last_fullsized":"2024-05-30T16:56:46.108541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:00.948144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:45.653835+0000","last_change":"2024-05-30T16:56:43.646795+0000","last_active":"2024-05-30T16:56:45.653835+0000","last_peered":"2024-05-30T16:56:45.653835+0000","last_clean":"2024-05-30T16:56:45.653835+0000","last_became_active":"2024-05-30T16:56:43.646434+0000","last_became_peered":"2024-05-30T16:56:43.646434+0000","last_unstale":"2024-05-30T16:56:45.653835+0000","last_undegraded":"2024-05-30T16:56:45.653835+0000","last_fullsized":"2024-05-30T16:56:45.653835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:18.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316609+0000","last_change":"2024-05-30T16:56:44.659417+0000","last_active":"2024-05-30T16:56:46.316609+0000","last_peered":"2024-05-30T16:56:46.316609+0000","last_clean":"2024-05-30T16:56:46.316609+0000","last_became_active":"2024-05-30T16:56:44.659050+0000","last_became_peered":"2024-05-30T16:56:44.659050+0000","last_unstale":"2024-05-30T16:56:46.316609+0000","last_undegraded":"2024-05-30T16:56:46.316609+0000","last_fullsized":"2024-05-30T16:56:46.316609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:19.555324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.317192+0000","last_change":"2024-05-30T16:56:43.649787+0000","last_active":"2024-05-30T16:56:46.317192+0000","last_peered":"2024-05-30T16:56:46.317192+0000","last_clean":"2024-05-30T16:56:46.317192+0000","last_became_active":"2024-05-30T16:56:43.649499+0000","last_became_peered":"2024-05-30T16:56:43.649499+0000","last_unstale":"2024-05-30T16:56:46.317192+0000","last_undegraded":"2024-05-30T16:56:46.317192+0000","last_fullsized":"2024-05-30T16:56:46.317192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:04:39.740914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.816478+0000","last_change":"2024-05-30T16:56:44.648063+0000","last_active":"2024-05-30T16:56:46.816478+0000","last_peered":"2024-05-30T16:56:46.816478+0000","last_clean":"2024-05-30T16:56:46.816478+0000","last_became_active":"2024-05-30T16:56:44.645752+0000","last_became_peered":"2024-05-30T16:56:44.645752+0000","last_unstale":"2024-05-30T16:56:46.816478+0000","last_undegraded":"2024-05-30T16:56:46.816478+0000","last_fullsized":"2024-05-30T16:56:46.816478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:43.617601+0000","last_clean_scrub_stamp":"2024-05-30T16:56:43.617601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:43:14.342299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.316917+0000","last_change":"2024-05-30T16:56:43.652356+0000","last_active":"2024-05-30T16:56:46.316917+0000","last_peered":"2024-05-30T16:56:46.316917+0000","last_clean":"2024-05-30T16:56:46.316917+0000","last_became_active":"2024-05-30T16:56:43.652065+0000","last_became_peered":"2024-05-30T16:56:43.652065+0000","last_unstale":"2024-05-30T16:56:46.316917+0000","last_undegraded":"2024-05-30T16:56:46.316917+0000","last_fullsized":"2024-05-30T16:56:46.316917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:56:42.614146+0000","last_clean_scrub_stamp":"2024-05-30T16:56:42.614146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:38.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":271,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-30T16:56:46.548075+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:56:46.548075+0000","last_peered":"2024-05-30T16:56:46.548075+0000","last_clean":"2024-05-30T16:56:46.548075+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:56:46.548075+0000","last_undegraded":"2024-05-30T16:56:46.548075+0000","last_fullsized":"2024-05-30T16:56:46.548075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509538,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54860,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316980,"statfs":{"total":96636764160,"available":96580587520,"internally_reserved":0,"allocated":1507328,"data_stored":974184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509539,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54288,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317552,"statfs":{"total":96636764160,"available":96581173248,"internally_reserved":0,"allocated":913408,"data_stored":383292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509539,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50124,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321716,"statfs":{"total":96636764160,"available":96585437184,"internally_reserved":0,"allocated":909312,"data_stored":383290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509540,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54280,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317560,"statfs":{"total":96636764160,"available":96581181440,"internally_reserved":0,"allocated":909312,"data_stored":383270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509539,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50124,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321716,"statfs":{"total":96636764160,"available":96585437184,"internally_reserved":0,"allocated":917504,"data_stored":384812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509539,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54296,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317544,"statfs":{"total":96636764160,"available":96581165056,"internally_reserved":0,"allocated":925696,"data_stored":385428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509539,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54856,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316984,"statfs":{"total":96636764160,"available":96580591616,"internally_reserved":0,"allocated":1499136,"data_stored":973568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542243,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58440,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313400,"statfs":{"total":96636764160,"available":96576921600,"internally_reserved":0,"allocated":913408,"data_stored":383312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:56:53.748 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:56:53.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T16:56:53.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.930+0000 7f9f31a00640 1 Processor -- start 2024-05-30T16:56:53.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.930+0000 7f9f31a00640 1 -- start start 2024-05-30T16:56:53.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f31a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f2c0ad2b0 0x7f9f2c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:53.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f31a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9f2c0d0660 0x7f9f2c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:53.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f31a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2c0ad770 con 0x7f9f2c1569e0 2024-05-30T16:56:53.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f31a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2c15cb40 con 0x7f9f2c0d0660 2024-05-30T16:56:53.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f31a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2c15ce20 con 0x7f9f2c0ad2b0 2024-05-30T16:56:53.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f23e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f2c0ad2b0 0x7f9f2c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:53.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f2b400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9f2c0d0660 0x7f9f2c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:53.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f23e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f2c0ad2b0 0x7f9f2c15d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:52986/0 (socket says 172.21.15.59:52986) 2024-05-30T16:56:53.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f2aa00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9f2c1569e0 0x7f9f2c0cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:38348/0 (socket says 172.21.15.59:38348) 2024-05-30T16:56:53.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f23e00640 1 -- 172.21.15.59:0/1508752579 learned_addr learned my addr 172.21.15.59:0/1508752579 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:53.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f2b400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9f2c0d0660 0x7f9f2c0d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:56990/0 (socket says 172.21.15.59:56990) 2024-05-30T16:56:53.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f2b400640 1 -- 172.21.15.59:0/1508752579 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f2c0ad2b0 msgr2=0x7f9f2c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:53.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f2b400640 1 --2- 172.21.15.59:0/1508752579 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f2c0ad2b0 0x7f9f2c15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f2b400640 1 -- 172.21.15.59:0/1508752579 >> v1:172.21.15.107:6789/0 conn(0x7f9f2c1569e0 legacy=0x7f9f2c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:53.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f2b400640 1 -- 172.21.15.59:0/1508752579 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c15d100 con 0x7f9f2c0d0660 2024-05-30T16:56:53.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.934+0000 7f9f23e00640 1 --2- 172.21.15.59:0/1508752579 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f2c0ad2b0 0x7f9f2c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:56:53.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f2b400640 1 --2- 172.21.15.59:0/1508752579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f2c0d0660 0x7f9f2c0d0af0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009d90 tx=0x7f9f2401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12f873999ef94bfb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:53.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f2a000640 1 -- 172.21.15.59:0/1508752579 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f240b2070 con 0x7f9f2c0d0660 2024-05-30T16:56:53.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f2a000640 1 -- 172.21.15.59:0/1508752579 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f240a57a0 con 0x7f9f2c0d0660 2024-05-30T16:56:53.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f2a000640 1 -- 172.21.15.59:0/1508752579 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f240a5b70 con 0x7f9f2c0d0660 2024-05-30T16:56:53.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f31a00640 1 -- 172.21.15.59:0/1508752579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f2c0d0660 msgr2=0x7f9f2c0d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:53.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f31a00640 1 --2- 172.21.15.59:0/1508752579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f2c0d0660 0x7f9f2c0d0af0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009d90 tx=0x7f9f2401c8e0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f31a00640 1 -- 172.21.15.59:0/1508752579 shutdown_connections 2024-05-30T16:56:53.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f31a00640 1 --2- 172.21.15.59:0/1508752579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f2c0d0660 0x7f9f2c0d0af0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f31a00640 1 --2- 172.21.15.59:0/1508752579 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f2c0ad2b0 0x7f9f2c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f31a00640 1 -- 172.21.15.59:0/1508752579 >> 172.21.15.59:0/1508752579 conn(0x7f9f2c06bdb0 msgr2=0x7f9f2c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:53.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f31a00640 1 -- 172.21.15.59:0/1508752579 shutdown_connections 2024-05-30T16:56:53.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f31a00640 1 -- 172.21.15.59:0/1508752579 wait complete. 2024-05-30T16:56:53.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f31a00640 1 Processor -- start 2024-05-30T16:56:53.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.938+0000 7f9f31a00640 1 -- start start 2024-05-30T16:56:53.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f31a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f2c0ad2b0 0x7f9f2c13c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:53.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f31a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f2c0d0660 0x7f9f2c0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:53.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f31a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2c1569e0 0x7f9f2c0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:53.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f31a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c0b3e70 con 0x7f9f2c1569e0 2024-05-30T16:56:53.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f31a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c0b3cf0 con 0x7f9f2c0d0660 2024-05-30T16:56:53.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f31a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2c0b3ff0 con 0x7f9f2c0ad2b0 2024-05-30T16:56:53.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f2b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2c1569e0 0x7f9f2c0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f2b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2c1569e0 0x7f9f2c0b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40546/0 (socket says 172.21.15.59:40546) 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f2b400640 1 -- 172.21.15.59:0/550236384 learned_addr learned my addr 172.21.15.59:0/550236384 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f2aa00640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f2c0ad2b0 0x7f9f2c13c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f23e00640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f2c0d0660 0x7f9f2c0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f2b400640 1 -- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f2c0ad2b0 msgr2=0x7f9f2c13c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f2b400640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f2c0ad2b0 0x7f9f2c13c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f2b400640 1 -- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f2c0d0660 msgr2=0x7f9f2c0afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f2b400640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f2c0d0660 0x7f9f2c0afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f2b400640 1 -- 172.21.15.59:0/550236384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c14e140 con 0x7f9f2c1569e0 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f2b400640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2c1569e0 0x7f9f2c0b0320 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9f2401af90 tx=0x7f9f24019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f22a00640 1 -- 172.21.15.59:0/550236384 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f240b2050 con 0x7f9f2c1569e0 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f22a00640 1 -- 172.21.15.59:0/550236384 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f240be070 con 0x7f9f2c1569e0 2024-05-30T16:56:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f22a00640 1 -- 172.21.15.59:0/550236384 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f240ad850 con 0x7f9f2c1569e0 2024-05-30T16:56:53.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f31a00640 1 -- 172.21.15.59:0/550236384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2c0b0950 con 0x7f9f2c1569e0 2024-05-30T16:56:53.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f31a00640 1 -- 172.21.15.59:0/550236384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2c0b0f10 con 0x7f9f2c1569e0 2024-05-30T16:56:53.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f31a00640 1 -- 172.21.15.59:0/550236384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f2c068a90 con 0x7f9f2c1569e0 2024-05-30T16:56:53.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.942+0000 7f9f22a00640 1 -- 172.21.15.59:0/550236384 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f9f240ad9f0 con 0x7f9f2c1569e0 2024-05-30T16:56:53.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.946+0000 7f9f22a00640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f080690a0 0x7f9f0806b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:53.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.946+0000 7f9f22a00640 1 -- 172.21.15.59:0/550236384 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f9f241200f0 con 0x7f9f2c1569e0 2024-05-30T16:56:53.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.946+0000 7f9f2aa00640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f080690a0 0x7f9f0806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:53.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.946+0000 7f9f2aa00640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f080690a0 0x7f9f0806b560 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c000f70 tx=0x7f9f1c007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:53.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:53.950+0000 7f9f22a00640 1 -- 172.21.15.59:0/550236384 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f24016560 con 0x7f9f2c1569e0 2024-05-30T16:56:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.170+0000 7f9f31a00640 1 -- 172.21.15.59:0/550236384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9f2c0cfb10 con 0x7f9f2c1569e0 2024-05-30T16:56:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.170+0000 7f9f22a00640 1 -- 172.21.15.59:0/550236384 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f9f240f2220 con 0x7f9f2c1569e0 2024-05-30T16:56:54.176 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-05-30T16:56:54.176 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA== 2024-05-30T16:56:54.176 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-05-30T16:56:54.176 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-05-30T16:56:54.176 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T16:56:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-05-30T16:56:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.174+0000 7f9f31a00640 1 -- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f080690a0 msgr2=0x7f9f0806b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.174+0000 7f9f31a00640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f080690a0 0x7f9f0806b560 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c000f70 tx=0x7f9f1c007cd0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.174+0000 7f9f31a00640 1 -- 172.21.15.59:0/550236384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2c1569e0 msgr2=0x7f9f2c0b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.174+0000 7f9f31a00640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2c1569e0 0x7f9f2c0b0320 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9f2401af90 tx=0x7f9f24019680 comp rx=0 tx=0).stop 2024-05-30T16:56:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.174+0000 7f9f31a00640 1 -- 172.21.15.59:0/550236384 shutdown_connections 2024-05-30T16:56:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.174+0000 7f9f31a00640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f080690a0 0x7f9f0806b560 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.174+0000 7f9f31a00640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2c1569e0 0x7f9f2c0b0320 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.174+0000 7f9f31a00640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f2c0d0660 0x7f9f2c0afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.174+0000 7f9f31a00640 1 --2- 172.21.15.59:0/550236384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f2c0ad2b0 0x7f9f2c13c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.174+0000 7f9f31a00640 1 -- 172.21.15.59:0/550236384 >> 172.21.15.59:0/550236384 conn(0x7f9f2c06bdb0 msgr2=0x7f9f2c06da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.174+0000 7f9f31a00640 1 -- 172.21.15.59:0/550236384 shutdown_connections 2024-05-30T16:56:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.174+0000 7f9f31a00640 1 -- 172.21.15.59:0/550236384 wait complete. 2024-05-30T16:56:54.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:56:54.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.334+0000 7ff314800640 1 Processor -- start 2024-05-30T16:56:54.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.334+0000 7ff314800640 1 -- start start 2024-05-30T16:56:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff314800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff30c0cfe20 0x7ff30c15ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff314800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff30c073bb0 0x7ff30c072060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff314800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30c15f3b0 con 0x7ff30c0cfa40 2024-05-30T16:56:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff314800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff30c15f690 con 0x7ff30c0cfe20 2024-05-30T16:56:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff314800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff30c15f970 con 0x7ff30c073bb0 2024-05-30T16:56:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff311400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff30c0cfe20 0x7ff30c15ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff311400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff30c0cfe20 0x7ff30c15ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40550/0 (socket says 172.21.15.59:40550) 2024-05-30T16:56:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff311400640 1 -- 172.21.15.59:0/3657396666 learned_addr learned my addr 172.21.15.59:0/3657396666 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff312800640 1 --2- 172.21.15.59:0/3657396666 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff30c073bb0 0x7ff30c072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:54.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff311400640 1 -- 172.21.15.59:0/3657396666 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff30c073bb0 msgr2=0x7ff30c072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:54.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff311400640 1 --2- 172.21.15.59:0/3657396666 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff30c073bb0 0x7ff30c072060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff311400640 1 -- 172.21.15.59:0/3657396666 >> v1:172.21.15.107:6789/0 conn(0x7ff30c0cfa40 legacy=0x7ff30c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:54.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff311400640 1 -- 172.21.15.59:0/3657396666 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c0b3370 con 0x7ff30c0cfe20 2024-05-30T16:56:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.338+0000 7ff311400640 1 --2- 172.21.15.59:0/3657396666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c0cfe20 0x7ff30c15ecb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009870 tx=0x7ff2fc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e1a74669d42b86 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff310a00640 1 -- 172.21.15.59:0/3657396666 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0a7070 con 0x7ff30c0cfe20 2024-05-30T16:56:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff310a00640 1 -- 172.21.15.59:0/3657396666 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2fc0b0070 con 0x7ff30c0cfe20 2024-05-30T16:56:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff310a00640 1 -- 172.21.15.59:0/3657396666 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0ab890 con 0x7ff30c0cfe20 2024-05-30T16:56:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 -- 172.21.15.59:0/3657396666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c0cfe20 msgr2=0x7ff30c15ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 --2- 172.21.15.59:0/3657396666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c0cfe20 0x7ff30c15ecb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009870 tx=0x7ff2fc01c560 comp rx=0 tx=0).stop 2024-05-30T16:56:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 -- 172.21.15.59:0/3657396666 shutdown_connections 2024-05-30T16:56:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 --2- 172.21.15.59:0/3657396666 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff30c073bb0 0x7ff30c072060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 --2- 172.21.15.59:0/3657396666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c0cfe20 0x7ff30c15ecb0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 -- 172.21.15.59:0/3657396666 >> 172.21.15.59:0/3657396666 conn(0x7ff30c0b22d0 msgr2=0x7ff30c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 -- 172.21.15.59:0/3657396666 shutdown_connections 2024-05-30T16:56:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 -- 172.21.15.59:0/3657396666 wait complete. 2024-05-30T16:56:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 Processor -- start 2024-05-30T16:56:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 -- start start 2024-05-30T16:56:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff30c073bb0 0x7ff30c099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff30c0cfa40 0x7ff30c1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c0cfe20 0x7ff30c152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c155210 con 0x7ff30c0cfe20 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c155090 con 0x7ff30c0cfa40 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff314800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff30c155390 con 0x7ff30c073bb0 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff312800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c0cfe20 0x7ff30c152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff312800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c0cfe20 0x7ff30c152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40564/0 (socket says 172.21.15.59:40564) 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff312800640 1 -- 172.21.15.59:0/2545947182 learned_addr learned my addr 172.21.15.59:0/2545947182 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff311400640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff30c0cfa40 0x7ff30c1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.342+0000 7ff311e00640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff30c073bb0 0x7ff30c099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff312800640 1 -- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff30c073bb0 msgr2=0x7ff30c099850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff312800640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff30c073bb0 0x7ff30c099850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff312800640 1 -- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff30c0cfa40 msgr2=0x7ff30c1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff312800640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff30c0cfa40 0x7ff30c1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff312800640 1 -- 172.21.15.59:0/2545947182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c09e170 con 0x7ff30c0cfe20 2024-05-30T16:56:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff312800640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c0cfe20 0x7ff30c152c20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff308007e70 tx=0x7ff30800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff306000640 1 -- 172.21.15.59:0/2545947182 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff308014620 con 0x7ff30c0cfe20 2024-05-30T16:56:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff306000640 1 -- 172.21.15.59:0/2545947182 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff308019070 con 0x7ff30c0cfe20 2024-05-30T16:56:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff306000640 1 -- 172.21.15.59:0/2545947182 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff308014a20 con 0x7ff30c0cfe20 2024-05-30T16:56:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff314800640 1 -- 172.21.15.59:0/2545947182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c09dbb0 con 0x7ff30c0cfe20 2024-05-30T16:56:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff314800640 1 -- 172.21.15.59:0/2545947182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c0ad420 con 0x7ff30c0cfe20 2024-05-30T16:56:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff314800640 1 -- 172.21.15.59:0/2545947182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30c068a90 con 0x7ff30c0cfe20 2024-05-30T16:56:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff306000640 1 -- 172.21.15.59:0/2545947182 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7ff308014bc0 con 0x7ff30c0cfe20 2024-05-30T16:56:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff306000640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff2f00690a0 0x7ff2f006b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff306000640 1 -- 172.21.15.59:0/2545947182 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7ff308085c60 con 0x7ff30c0cfe20 2024-05-30T16:56:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.346+0000 7ff311e00640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff2f00690a0 0x7ff2f006b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.350+0000 7ff311e00640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff2f00690a0 0x7ff2f006b560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff300001650 tx=0x7ff300009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:54.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.350+0000 7ff306000640 1 -- 172.21.15.59:0/2545947182 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff308057c70 con 0x7ff30c0cfe20 2024-05-30T16:56:54.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 -- 172.21.15.59:0/2545947182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff30c0b01e0 con 0x7ff30c0cfe20 2024-05-30T16:56:54.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff306000640 1 -- 172.21.15.59:0/2545947182 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5189 (secure 0 0 0) 0x7ff308057570 con 0x7ff30c0cfe20 2024-05-30T16:56:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:56:54.554 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1624622774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1624622774},{"type":"v1","addr":"172.21.15.59:6835","nonce":1624622774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2200377252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2200377252},{"type":"v1","addr":"172.21.15.59:6834","nonce":2200377252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1151212671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1151212671},{"type":"v1","addr":"172.21.15.107:6836","nonce":1151212671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:56:44.037966+0000","modified":"2024-05-30T16:56:47.045160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/1073059560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1073059560},{"type":"v1","addr":"172.21.15.107:6837","nonce":1073059560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6528,"qdb_cluster":[6528]},"id":5}]} 2024-05-30T16:56:54.554 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 42 2024-05-30T16:56:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 -- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff2f00690a0 msgr2=0x7ff2f006b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff2f00690a0 0x7ff2f006b560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff300001650 tx=0x7ff300009040 comp rx=0 tx=0).stop 2024-05-30T16:56:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 -- 172.21.15.59:0/2545947182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c0cfe20 msgr2=0x7ff30c152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c0cfe20 0x7ff30c152c20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff308007e70 tx=0x7ff30800e4b0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 -- 172.21.15.59:0/2545947182 shutdown_connections 2024-05-30T16:56:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff2f00690a0 0x7ff2f006b560 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c0cfe20 0x7ff30c152c20 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff30c0cfa40 0x7ff30c1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 --2- 172.21.15.59:0/2545947182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff30c073bb0 0x7ff30c099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 -- 172.21.15.59:0/2545947182 >> 172.21.15.59:0/2545947182 conn(0x7ff30c0b22d0 msgr2=0x7ff30c162230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 -- 172.21.15.59:0/2545947182 shutdown_connections 2024-05-30T16:56:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:54.550+0000 7ff314800640 1 -- 172.21.15.59:0/2545947182 wait complete. 2024-05-30T16:56:54.978 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T16:56:44.037966+0000', 'modified': '2024-05-30T16:56:47.045160+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6528}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6528': {'gid': 6528, 'name': 'b', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.107:6837/1073059560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6835', 'nonce': 1073059560}, {'type': 'v1', 'addr': '172.21.15.107:6837', 'nonce': 1073059560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6528, 'qdb_cluster': [6528]} 2024-05-30T16:56:54.978 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T16:56:54.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-30T16:56:55.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f4400640 1 Processor -- start 2024-05-30T16:56:55.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f4400640 1 -- start start 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f4400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f24ec0af720 0x7f24ec15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f4400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24ec0d0560 0x7f24ec0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f4400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24ec15f060 con 0x7f24ec06e900 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f4400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f24ec0afb00 con 0x7f24ec0af720 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f4400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f24ec15c270 con 0x7f24ec0d0560 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f1000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f24ec06e900 0x7f24ec15f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34264/0 (socket says 172.21.15.59:34264) 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f1000640 1 -- 172.21.15.59:0/3992929140 learned_addr learned my addr 172.21.15.59:0/3992929140 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f1a00640 1 --2- 172.21.15.59:0/3992929140 >> v2:172.21.15.107:3300/0 conn(0x7f24ec0af720 0x7f24ec15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f2400640 1 --2- 172.21.15.59:0/3992929140 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24ec0d0560 0x7f24ec0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24ebe00640 1 -- 172.21.15.59:0/3992929140 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3794490862 0 0) 0x7f24ec15f060 con 0x7f24ec06e900 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24ebe00640 1 -- 172.21.15.59:0/3992929140 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24d4003530 con 0x7f24ec06e900 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f1a00640 1 -- 172.21.15.59:0/3992929140 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24ec0d0560 msgr2=0x7f24ec0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f1a00640 1 --2- 172.21.15.59:0/3992929140 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24ec0d0560 0x7f24ec0d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f1a00640 1 -- 172.21.15.59:0/3992929140 >> v1:172.21.15.59:6789/0 conn(0x7f24ec06e900 legacy=0x7f24ec15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.122+0000 7f24f1a00640 1 -- 172.21.15.59:0/3992929140 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ec15ff00 con 0x7f24ec0af720 2024-05-30T16:56:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.126+0000 7f24f1a00640 1 --2- 172.21.15.59:0/3992929140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24ec0af720 0x7f24ec15b9d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f24e00097c0 tx=0x7f24e001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db9d57b8ff62783c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.126+0000 7f24ebe00640 1 -- 172.21.15.59:0/3992929140 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e00b2070 con 0x7f24ec0af720 2024-05-30T16:56:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.126+0000 7f24ebe00640 1 -- 172.21.15.59:0/3992929140 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e00ad640 con 0x7f24ec0af720 2024-05-30T16:56:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.126+0000 7f24ebe00640 1 -- 172.21.15.59:0/3992929140 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e00ad9f0 con 0x7f24ec0af720 2024-05-30T16:56:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.126+0000 7f24f4400640 1 -- 172.21.15.59:0/3992929140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24ec0af720 msgr2=0x7f24ec15b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.126+0000 7f24f4400640 1 --2- 172.21.15.59:0/3992929140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24ec0af720 0x7f24ec15b9d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f24e00097c0 tx=0x7f24e001c4a0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 -- 172.21.15.59:0/3992929140 shutdown_connections 2024-05-30T16:56:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 --2- 172.21.15.59:0/3992929140 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24ec0d0560 0x7f24ec0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 --2- 172.21.15.59:0/3992929140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24ec0af720 0x7f24ec15b9d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 -- 172.21.15.59:0/3992929140 >> 172.21.15.59:0/3992929140 conn(0x7f24ec0b22d0 msgr2=0x7f24ec0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:55.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 -- 172.21.15.59:0/3992929140 shutdown_connections 2024-05-30T16:56:55.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 -- 172.21.15.59:0/3992929140 wait complete. 2024-05-30T16:56:55.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 Processor -- start 2024-05-30T16:56:55.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 -- start start 2024-05-30T16:56:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24ec06e900 0x7f24ec155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec0af720 0x7f24ec148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24ec0d0560 0x7f24ec154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec073150 con 0x7f24ec0af720 2024-05-30T16:56:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec15c830 con 0x7f24ec06e900 2024-05-30T16:56:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f4400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f24ec0732d0 con 0x7f24ec0d0560 2024-05-30T16:56:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec0af720 0x7f24ec148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec0af720 0x7f24ec148c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40566/0 (socket says 172.21.15.59:40566) 2024-05-30T16:56:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f1000640 1 -- 172.21.15.59:0/615886201 learned_addr learned my addr 172.21.15.59:0/615886201 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f1a00640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24ec06e900 0x7f24ec155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f2400640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24ec0d0560 0x7f24ec154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f1000640 1 -- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24ec0d0560 msgr2=0x7f24ec154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f1000640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24ec0d0560 0x7f24ec154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f1000640 1 -- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24ec06e900 msgr2=0x7f24ec155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f1000640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24ec06e900 0x7f24ec155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f1000640 1 -- 172.21.15.59:0/615886201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ec1540d0 con 0x7f24ec0af720 2024-05-30T16:56:55.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.130+0000 7f24f1000640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec0af720 0x7f24ec148c30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f24d800c390 tx=0x7f24d800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:55.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.134+0000 7f24e9600640 1 -- 172.21.15.59:0/615886201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8017070 con 0x7f24ec0af720 2024-05-30T16:56:55.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.134+0000 7f24e9600640 1 -- 172.21.15.59:0/615886201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d8005d10 con 0x7f24ec0af720 2024-05-30T16:56:55.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.134+0000 7f24e9600640 1 -- 172.21.15.59:0/615886201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8007310 con 0x7f24ec0af720 2024-05-30T16:56:55.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.134+0000 7f24f4400640 1 -- 172.21.15.59:0/615886201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ec1543b0 con 0x7f24ec0af720 2024-05-30T16:56:55.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.134+0000 7f24f4400640 1 -- 172.21.15.59:0/615886201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ec149170 con 0x7f24ec0af720 2024-05-30T16:56:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.134+0000 7f24e9600640 1 -- 172.21.15.59:0/615886201 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f24d801a070 con 0x7f24ec0af720 2024-05-30T16:56:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.134+0000 7f24e9600640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f24cc069070 0x7f24cc06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.134+0000 7f24e9600640 1 -- 172.21.15.59:0/615886201 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f24d8084700 con 0x7f24ec0af720 2024-05-30T16:56:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 Processor -- start 2024-05-30T16:56:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f1a00640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f24cc069070 0x7f24cc06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 -- start start 2024-05-30T16:56:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f1a00640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f24cc069070 0x7f24cc06b530 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f24e00af000 tx=0x7f24e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c70b0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 0x5565c7063110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 0x5565c7063a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5565c6eb4420 con 0x5565c70b0a40 2024-05-30T16:56:55.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5565c6e4ebf0 con 0x5565c7063650 2024-05-30T16:56:55.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5565c6eb03e0 con 0x5565c70b0120 2024-05-30T16:56:55.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 0x5565c7063110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 0x5565c7063110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40568/0 (socket says 172.21.15.59:40568) 2024-05-30T16:56:55.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f1000640 1 -- 172.21.15.59:0/3314297541 learned_addr learned my addr 172.21.15.59:0/3314297541 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:55.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f1a00640 1 --2- 172.21.15.59:0/3314297541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c70b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f2400640 1 --2- 172.21.15.59:0/3314297541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 0x5565c7063a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f1000640 1 -- 172.21.15.59:0/3314297541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 msgr2=0x5565c70b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:55.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f1000640 1 --2- 172.21.15.59:0/3314297541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c70b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f1000640 1 -- 172.21.15.59:0/3314297541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 msgr2=0x5565c7063a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f1000640 1 --2- 172.21.15.59:0/3314297541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 0x5565c7063a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f1000640 1 -- 172.21.15.59:0/3314297541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565c6f5c450 con 0x5565c70b0a40 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f1000640 1 --2- 172.21.15.59:0/3314297541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 0x5565c7063110 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f24d8052640 tx=0x7f24d805a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f57c47db8ec0ab2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24de000640 1 -- 172.21.15.59:0/3314297541 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d805a170 con 0x5565c70b0a40 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24de000640 1 -- 172.21.15.59:0/3314297541 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d8052850 con 0x5565c70b0a40 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24de000640 1 -- 172.21.15.59:0/3314297541 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d80076d0 con 0x5565c70b0a40 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 -- 172.21.15.59:0/3314297541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 msgr2=0x5565c7063110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 --2- 172.21.15.59:0/3314297541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 0x5565c7063110 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f24d8052640 tx=0x7f24d805a4e0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 -- 172.21.15.59:0/3314297541 shutdown_connections 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 --2- 172.21.15.59:0/3314297541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 0x5565c7063a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 --2- 172.21.15.59:0/3314297541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 0x5565c7063110 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 --2- 172.21.15.59:0/3314297541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c70b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 -- 172.21.15.59:0/3314297541 >> 172.21.15.59:0/3314297541 conn(0x5565c7090ec0 msgr2=0x5565c70932b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:55.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 -- 172.21.15.59:0/3314297541 shutdown_connections 2024-05-30T16:56:55.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 -- 172.21.15.59:0/3314297541 wait complete. 2024-05-30T16:56:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.138+0000 7f24f798c000 1 -- start start 2024-05-30T16:56:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 1 Processor -- start 2024-05-30T16:56:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c7063650 0x5565c7068b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c7069080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c70b0a40 0x5565c70695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5565c6e54ec0 con 0x5565c7063650 2024-05-30T16:56:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5565c6f35120 con 0x5565c70b0a40 2024-05-30T16:56:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5565c6ebf350 con 0x5565c70b0120 2024-05-30T16:56:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 10 client.0 _ll_register_callbacks cb 0x5565c6e914d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:56:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c7063650 0x5565c7068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c7063650 0x5565c7068b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40584/0 (socket says 172.21.15.59:40584) 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f1a00640 1 -- 172.21.15.59:0/2636736680 learned_addr learned my addr 172.21.15.59:0/2636736680 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f2400640 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c70b0a40 0x5565c70695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f1000640 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c7069080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f1a00640 1 -- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 msgr2=0x5565c7069080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f1a00640 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c7069080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f1a00640 1 -- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c70b0a40 msgr2=0x5565c70695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f1a00640 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c70b0a40 0x5565c70695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f1a00640 1 -- 172.21.15.59:0/2636736680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565c6ef9f80 con 0x5565c7063650 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f1000640 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c7069080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f1a00640 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c7063650 0x5565c7068b40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f24e00b0040 tx=0x7f24e001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb6b0771d200074 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24d2a00640 1 -- 172.21.15.59:0/2636736680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e00c9020 con 0x5565c7063650 2024-05-30T16:56:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24d2a00640 1 -- 172.21.15.59:0/2636736680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f24e00b87c0 con 0x5565c7063650 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 1 -- 172.21.15.59:0/2636736680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24d8052850 con 0x5565c7063650 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24d2a00640 1 -- 172.21.15.59:0/2636736680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f24e00d3050 con 0x5565c7063650 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 10 client.6672 fetch_fsmap learned FSMap version 42 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 1 -- 172.21.15.59:0/2636736680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5565c6e8df00 con 0x5565c7063650 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24d2a00640 1 -- 172.21.15.59:0/2636736680 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d8052850 con 0x5565c7063650 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24d2a00640 1 -- 172.21.15.59:0/2636736680 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 42) ==== 3494+0+0 (secure 0 0 0) 0x7f24e00d6020 con 0x5565c7063650 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 10 client.6672 fetch_fsmap finished waiting for FSMap version 42 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 10 client.6672 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 20 client.6672 populate_metadata read hostname 'smithi059' 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:6835/1073059560,v1:172.21.15.107:6837/1073059560] conn(0x5565c706a270 0x5565c70c13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 4 client.6672 mds_command: new command op to 6528 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f798c000 1 -- 172.21.15.59:0/2636736680 --> [v2:172.21.15.107:6835/1073059560,v1:172.21.15.107:6837/1073059560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565c6e4dbc0 con 0x5565c706a270 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.142+0000 7f24f1000640 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:6835/1073059560,v1:172.21.15.107:6837/1073059560] conn(0x5565c706a270 0x5565c70c13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f1000640 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:6835/1073059560,v1:172.21.15.107:6837/1073059560] conn(0x5565c706a270 0x5565c70c13d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6216cc4785215007 server_cookie=9e9dd3181ca6fcd4 in_seq=0 out_seq=0 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24d2a00640 10 client.6672 ms_handle_connect on v2:172.21.15.107:6835/1073059560 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24d2a00640 1 -- 172.21.15.59:0/2636736680 <== mds.0 v2:172.21.15.107:6835/1073059560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5565c6e4dbc0 con 0x5565c706a270 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24d2a00640 10 client.6672 handle_command_reply: tid=0 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f798c000 1 client.6672 shutdown 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f798c000 1 -- 172.21.15.59:0/2636736680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c7063650 msgr2=0x5565c7068b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f798c000 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c7063650 0x5565c7068b40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f24e00b0040 tx=0x7f24e001ace0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f798c000 1 -- 172.21.15.59:0/2636736680 shutdown_connections 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f798c000 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:6835/1073059560,v1:172.21.15.107:6837/1073059560] conn(0x5565c706a270 0x5565c70c13d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f798c000 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c70b0a40 0x5565c70695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f798c000 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c7069080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f798c000 1 --2- 172.21.15.59:0/2636736680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c7063650 0x5565c7068b40 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24d2a00640 0 client.6672 ms_handle_reset on v2:172.21.15.107:6835/1073059560 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f798c000 1 -- 172.21.15.59:0/2636736680 >> 172.21.15.59:0/2636736680 conn(0x5565c7090ec0 msgr2=0x5565c70932b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f798c000 1 -- 172.21.15.59:0/2636736680 shutdown_connections 2024-05-30T16:56:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f798c000 1 -- 172.21.15.59:0/2636736680 wait complete. 2024-05-30T16:56:55.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.146+0000 7f24f798c000 20 client.6672 trim_cache size 0 max 16384 2024-05-30T16:56:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.162+0000 7f24f798c000 1 Processor -- start 2024-05-30T16:56:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.162+0000 7f24f798c000 1 -- start start 2024-05-30T16:56:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 0x5565c70af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c70af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 0x5565c70c13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec202a40 con 0x5565c70b0a40 2024-05-30T16:56:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec164eb0 con 0x5565c7063650 2024-05-30T16:56:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f24ec168ef0 con 0x5565c70b0120 2024-05-30T16:56:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 0x5565c70c13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 0x5565c70c13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40596/0 (socket says 172.21.15.59:40596) 2024-05-30T16:56:55.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f2400640 1 -- 172.21.15.59:0/694074619 learned_addr learned my addr 172.21.15.59:0/694074619 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:55.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f1a00640 1 --2- 172.21.15.59:0/694074619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 0x5565c70af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f1000640 1 --2- 172.21.15.59:0/694074619 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c70af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f2400640 1 -- 172.21.15.59:0/694074619 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 msgr2=0x5565c70af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f2400640 1 --2- 172.21.15.59:0/694074619 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c70af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f2400640 1 -- 172.21.15.59:0/694074619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 msgr2=0x5565c70af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f2400640 1 --2- 172.21.15.59:0/694074619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 0x5565c70af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f2400640 1 -- 172.21.15.59:0/694074619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565c6e3ae80 con 0x5565c70b0a40 2024-05-30T16:56:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f2400640 1 --2- 172.21.15.59:0/694074619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 0x5565c70c13d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f24e4007220 tx=0x7f24e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f60608363689a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24dd600640 1 -- 172.21.15.59:0/694074619 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4003ba0 con 0x5565c70b0a40 2024-05-30T16:56:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24dd600640 1 -- 172.21.15.59:0/694074619 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e4003d40 con 0x5565c70b0a40 2024-05-30T16:56:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24dd600640 1 -- 172.21.15.59:0/694074619 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4015ab0 con 0x5565c70b0a40 2024-05-30T16:56:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 -- 172.21.15.59:0/694074619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 msgr2=0x5565c70c13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 --2- 172.21.15.59:0/694074619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 0x5565c70c13d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f24e4007220 tx=0x7f24e4009750 comp rx=0 tx=0).stop 2024-05-30T16:56:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 -- 172.21.15.59:0/694074619 shutdown_connections 2024-05-30T16:56:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 --2- 172.21.15.59:0/694074619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0a40 0x5565c70c13d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 --2- 172.21.15.59:0/694074619 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0120 0x5565c70af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 --2- 172.21.15.59:0/694074619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 0x5565c70af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 -- 172.21.15.59:0/694074619 >> 172.21.15.59:0/694074619 conn(0x5565c7090ec0 msgr2=0x5565c7062100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 -- 172.21.15.59:0/694074619 shutdown_connections 2024-05-30T16:56:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 -- 172.21.15.59:0/694074619 wait complete. 2024-05-30T16:56:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 -- start start 2024-05-30T16:56:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.166+0000 7f24f798c000 1 Processor -- start 2024-05-30T16:56:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 0x5565c70c4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0120 0x5565c70daf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0a40 0x5565c70db4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5565c6eb3730 con 0x5565c70b0120 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5565c6e809e0 con 0x5565c7063650 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5565c6eb8a50 con 0x5565c70b0a40 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 10 client.0 _ll_register_callbacks cb 0x7f24e40095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0120 0x5565c70daf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0120 0x5565c70daf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40606/0 (socket says 172.21.15.59:40606) 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f1000640 1 -- 172.21.15.59:0/3448170017 learned_addr learned my addr 172.21.15.59:0/3448170017 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f2400640 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0a40 0x5565c70db4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f1a00640 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 0x5565c70c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f1000640 1 -- 172.21.15.59:0/3448170017 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0a40 msgr2=0x5565c70db4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f1000640 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0a40 0x5565c70db4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f1000640 1 -- 172.21.15.59:0/3448170017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 msgr2=0x5565c70c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f1000640 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 0x5565c70c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f1000640 1 -- 172.21.15.59:0/3448170017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565c6e7cb30 con 0x5565c70b0120 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f1000640 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0120 0x5565c70daf60 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f24d8052640 tx=0x7f24d8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab392067ba1b113d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24d2a00640 1 -- 172.21.15.59:0/3448170017 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8052850 con 0x5565c70b0120 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24d2a00640 1 -- 172.21.15.59:0/3448170017 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f24d805a170 con 0x5565c70b0120 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 -- 172.21.15.59:0/3448170017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24e4003d40 con 0x5565c70b0120 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24d2a00640 1 -- 172.21.15.59:0/3448170017 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f24d80074b0 con 0x5565c70b0120 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 10 client.6678 fetch_fsmap learned FSMap version 42 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 -- 172.21.15.59:0/3448170017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5565c6f355b0 con 0x5565c70b0120 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24d2a00640 1 -- 172.21.15.59:0/3448170017 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e4003d40 con 0x5565c70b0120 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24d2a00640 1 -- 172.21.15.59:0/3448170017 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 42) ==== 3494+0+0 (secure 0 0 0) 0x7f24d8055630 con 0x5565c70b0120 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 10 client.6678 fetch_fsmap finished waiting for FSMap version 42 2024-05-30T16:56:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 10 client.6678 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 20 client.6678 populate_metadata read hostname 'smithi059' 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.107:6835/1073059560,v1:172.21.15.107:6837/1073059560] conn(0x5565c70db9e0 0x5565c711eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 4 client.6678 mds_command: new command op to 6528 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 -- 172.21.15.59:0/3448170017 --> [v2:172.21.15.107:6835/1073059560,v1:172.21.15.107:6837/1073059560] -- command(tid 0: {"prefix": "status"}) -- 0x5565c6ec1e40 con 0x5565c70db9e0 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f1a00640 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.107:6835/1073059560,v1:172.21.15.107:6837/1073059560] conn(0x5565c70db9e0 0x5565c711eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f1a00640 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.107:6835/1073059560,v1:172.21.15.107:6837/1073059560] conn(0x5565c70db9e0 0x5565c711eff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eafe8d302feffc6 server_cookie=9e7cbce1a4b8ad71 in_seq=0 out_seq=0 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24d2a00640 10 client.6678 ms_handle_connect on v2:172.21.15.107:6835/1073059560 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24d2a00640 1 -- 172.21.15.59:0/3448170017 <== mds.0 v2:172.21.15.107:6835/1073059560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5565c6ec1e40 con 0x5565c70db9e0 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24d2a00640 10 client.6678 handle_command_reply: tid=0 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 client.6678 shutdown 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 -- 172.21.15.59:0/3448170017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0120 msgr2=0x5565c70daf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0120 0x5565c70daf60 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f24d8052640 tx=0x7f24d8014040 comp rx=0 tx=0).stop 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 -- 172.21.15.59:0/3448170017 shutdown_connections 2024-05-30T16:56:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.107:6835/1073059560,v1:172.21.15.107:6837/1073059560] conn(0x5565c70db9e0 0x5565c711eff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5565c70b0a40 0x5565c70db4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565c70b0120 0x5565c70daf60 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 --2- 172.21.15.59:0/3448170017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5565c7063650 0x5565c70c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24d2a00640 0 client.6678 ms_handle_reset on v2:172.21.15.107:6835/1073059560 2024-05-30T16:56:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 -- 172.21.15.59:0/3448170017 >> 172.21.15.59:0/3448170017 conn(0x5565c7090ec0 msgr2=0x5565c7062100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.170+0000 7f24f798c000 1 -- 172.21.15.59:0/3448170017 shutdown_connections 2024-05-30T16:56:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f798c000 1 -- 172.21.15.59:0/3448170017 wait complete. 2024-05-30T16:56:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f798c000 20 client.6678 trim_cache size 0 max 16384 2024-05-30T16:56:55.180 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:56:55.180 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:56:55.181 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-05-30T16:56:55.181 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6528, 2024-05-30T16:56:55.181 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-05-30T16:56:55.181 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-05-30T16:56:55.181 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-05-30T16:56:55.181 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 10.549276551, 2024-05-30T16:56:55.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 42, 2024-05-30T16:56:55.181 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 75, 2024-05-30T16:56:55.181 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 75, 2024-05-30T16:56:55.181 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 15.738605761000001 2024-05-30T16:56:55.181 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:56:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f4400640 1 -- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f24cc069070 msgr2=0x7f24cc06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f4400640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f24cc069070 0x7f24cc06b530 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f24e00af000 tx=0x7f24e0008040 comp rx=0 tx=0).stop 2024-05-30T16:56:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f4400640 1 -- 172.21.15.59:0/615886201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec0af720 msgr2=0x7f24ec148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f4400640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec0af720 0x7f24ec148c30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f24d800c390 tx=0x7f24d800c850 comp rx=0 tx=0).stop 2024-05-30T16:56:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f4400640 1 -- 172.21.15.59:0/615886201 shutdown_connections 2024-05-30T16:56:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f4400640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f24cc069070 0x7f24cc06b530 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f4400640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24ec0d0560 0x7f24ec154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f4400640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec0af720 0x7f24ec148c30 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f4400640 1 --2- 172.21.15.59:0/615886201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24ec06e900 0x7f24ec155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f4400640 1 -- 172.21.15.59:0/615886201 >> 172.21.15.59:0/615886201 conn(0x7f24ec0b22d0 msgr2=0x7f24ec06f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f4400640 1 -- 172.21.15.59:0/615886201 shutdown_connections 2024-05-30T16:56:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.174+0000 7f24f4400640 1 -- 172.21.15.59:0/615886201 wait complete. 2024-05-30T16:56:55.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:56:55.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f514d600640 1 Processor -- start 2024-05-30T16:56:55.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f514d600640 1 -- start start 2024-05-30T16:56:55.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f514d600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51480d05b0 0x7f514809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f514d600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5148070950 con 0x7f514809af80 2024-05-30T16:56:55.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f514d600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5148070c30 con 0x7f51480d14c0 2024-05-30T16:56:55.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f514d600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f514809b3f0 con 0x7f51480d05b0 2024-05-30T16:56:55.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f5146000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51480d05b0 0x7f514809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f5147400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f514809af80 0x7f514806d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34272/0 (socket says 172.21.15.59:34272) 2024-05-30T16:56:55.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f5147400640 1 -- 172.21.15.59:0/714956822 learned_addr learned my addr 172.21.15.59:0/714956822 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f5146000640 1 -- 172.21.15.59:0/714956822 >> v1:172.21.15.107:6789/0 conn(0x7f51480d14c0 legacy=0x7f514806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f5146000640 1 -- 172.21.15.59:0/714956822 >> v1:172.21.15.59:6789/0 conn(0x7f514809af80 legacy=0x7f514806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f5145600640 1 -- 172.21.15.59:0/714956822 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232862985 0 0) 0x7f5148070950 con 0x7f514809af80 2024-05-30T16:56:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.334+0000 7f5146000640 1 -- 172.21.15.59:0/714956822 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5148070f10 con 0x7f51480d05b0 2024-05-30T16:56:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f5146000640 1 --2- 172.21.15.59:0/714956822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51480d05b0 0x7f514809aa40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f51340097c0 tx=0x7f513401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd18851135313ab7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f5145600640 1 -- 172.21.15.59:0/714956822 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51340ab5f0 con 0x7f51480d05b0 2024-05-30T16:56:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f5145600640 1 -- 172.21.15.59:0/714956822 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51340b0070 con 0x7f51480d05b0 2024-05-30T16:56:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f5145600640 1 -- 172.21.15.59:0/714956822 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51340ab9b0 con 0x7f51480d05b0 2024-05-30T16:56:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f514d600640 1 -- 172.21.15.59:0/714956822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51480d05b0 msgr2=0x7f514809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f514d600640 1 --2- 172.21.15.59:0/714956822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51480d05b0 0x7f514809aa40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f51340097c0 tx=0x7f513401c430 comp rx=0 tx=0).stop 2024-05-30T16:56:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f514d600640 1 -- 172.21.15.59:0/714956822 shutdown_connections 2024-05-30T16:56:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f514d600640 1 --2- 172.21.15.59:0/714956822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51480d05b0 0x7f514809aa40 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f514d600640 1 -- 172.21.15.59:0/714956822 >> 172.21.15.59:0/714956822 conn(0x7f51480b3f80 msgr2=0x7f51480b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f514d600640 1 -- 172.21.15.59:0/714956822 shutdown_connections 2024-05-30T16:56:55.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f514d600640 1 -- 172.21.15.59:0/714956822 wait complete. 2024-05-30T16:56:55.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f514d600640 1 Processor -- start 2024-05-30T16:56:55.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.338+0000 7f514d600640 1 -- start start 2024-05-30T16:56:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f514d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f514809af80 0x7f51481572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f514d600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51480d05b0 0x7f51480c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f514d600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51480d14c0 0x7f51480c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f514d600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f514806e010 con 0x7f514809af80 2024-05-30T16:56:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f514d600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f51480d18a0 con 0x7f51480d14c0 2024-05-30T16:56:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f514d600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f514806e190 con 0x7f51480d05b0 2024-05-30T16:56:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f5146a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f514809af80 0x7f51481572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f5146a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f514809af80 0x7f51481572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40630/0 (socket says 172.21.15.59:40630) 2024-05-30T16:56:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f5146a00640 1 -- 172.21.15.59:0/2859667345 learned_addr learned my addr 172.21.15.59:0/2859667345 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f5147400640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51480d14c0 0x7f51480c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f5146000640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51480d05b0 0x7f51480c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f5146a00640 1 -- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51480d05b0 msgr2=0x7f51480c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f5146a00640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51480d05b0 0x7f51480c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f5146a00640 1 -- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51480d14c0 msgr2=0x7f51480c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f5146a00640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51480d14c0 0x7f51480c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f5146a00640 1 -- 172.21.15.59:0/2859667345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51480c8d60 con 0x7f514809af80 2024-05-30T16:56:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f5146a00640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f514809af80 0x7f51481572d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f513800c480 tx=0x7f513800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f513ea00640 1 -- 172.21.15.59:0/2859667345 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138012830 con 0x7f514809af80 2024-05-30T16:56:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f513ea00640 1 -- 172.21.15.59:0/2859667345 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5138017070 con 0x7f514809af80 2024-05-30T16:56:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f513ea00640 1 -- 172.21.15.59:0/2859667345 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138012c30 con 0x7f514809af80 2024-05-30T16:56:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f514d600640 1 -- 172.21.15.59:0/2859667345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51480c8a80 con 0x7f514809af80 2024-05-30T16:56:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f514d600640 1 -- 172.21.15.59:0/2859667345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51480c9970 con 0x7f514809af80 2024-05-30T16:56:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f514d600640 1 -- 172.21.15.59:0/2859667345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5148068a90 con 0x7f514809af80 2024-05-30T16:56:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.342+0000 7f513ea00640 1 -- 172.21.15.59:0/2859667345 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f513801c460 con 0x7f514809af80 2024-05-30T16:56:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.346+0000 7f513ea00640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5128069070 0x7f512806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.346+0000 7f513ea00640 1 -- 172.21.15.59:0/2859667345 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f51380851c0 con 0x7f514809af80 2024-05-30T16:56:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.346+0000 7f5146000640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5128069070 0x7f512806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.346+0000 7f5146000640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5128069070 0x7f512806b530 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f51340af000 tx=0x7f51340a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.350+0000 7f513ea00640 1 -- 172.21.15.59:0/2859667345 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f51380571d0 con 0x7f514809af80 2024-05-30T16:56:55.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.550+0000 7f514d600640 1 -- 172.21.15.59:0/2859667345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f51480d2270 con 0x7f514809af80 2024-05-30T16:56:55.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.550+0000 7f513ea00640 1 -- 172.21.15.59:0/2859667345 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) ==== 53+0+73 (secure 0 0 0) 0x7f5138056ad0 con 0x7f514809af80 2024-05-30T16:56:55.556 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:56:55.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.554+0000 7f514d600640 1 -- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5128069070 msgr2=0x7f512806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.554+0000 7f514d600640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5128069070 0x7f512806b530 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f51340af000 tx=0x7f51340a7000 comp rx=0 tx=0).stop 2024-05-30T16:56:55.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.554+0000 7f514d600640 1 -- 172.21.15.59:0/2859667345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f514809af80 msgr2=0x7f51481572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:55.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.554+0000 7f514d600640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f514809af80 0x7f51481572d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f513800c480 tx=0x7f513800c940 comp rx=0 tx=0).stop 2024-05-30T16:56:55.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.554+0000 7f514d600640 1 -- 172.21.15.59:0/2859667345 shutdown_connections 2024-05-30T16:56:55.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.554+0000 7f514d600640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5128069070 0x7f512806b530 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.554+0000 7f514d600640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51480d14c0 0x7f51480c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.554+0000 7f514d600640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51480d05b0 0x7f51480c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.554+0000 7f514d600640 1 --2- 172.21.15.59:0/2859667345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f514809af80 0x7f51481572d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:55.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.554+0000 7f514d600640 1 -- 172.21.15.59:0/2859667345 >> 172.21.15.59:0/2859667345 conn(0x7f51480b3f80 msgr2=0x7f514815e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:55.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.554+0000 7f514d600640 1 -- 172.21.15.59:0/2859667345 shutdown_connections 2024-05-30T16:56:55.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55.554+0000 7f514d600640 1 -- 172.21.15.59:0/2859667345 wait complete. 2024-05-30T16:56:55.577 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:56:55.578 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:56:55.578 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-05-30T16:56:55.578 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T16:56:55.578 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:56:55.578 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:56:55.578 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:56:55.578 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:56:55.578 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:56:55.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:55.578 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-05-30T16:56:55.588 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:56:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:56:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:56:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:56:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-05-30T16:56:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:56:55.588 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:56:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-05-30T16:56:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-05-30T16:56:55.588 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:56:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-05-30T16:56:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41974sec preferred_lft 41974sec 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:46:82:05:9a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T16:56:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:56:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T16:56:55.591 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:56:55.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:55.592 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:56:55.653 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-05-30T16:56:55.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:55.656 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-05-30T16:56:55.709 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-05-30T16:56:55.709 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:56:55.709 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T16:56:55.709 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T16:56:55.709 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T16:56:55.709 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:56:55.710 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:56:55.710 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:56:55.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T16:56:55.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T16:56:55.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T16:56:55.710 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:56:55.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:56:55.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:56:55.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:55.847 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-05-30T16:56:55.901 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T16:56:55.901 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T16:56:55.901 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:56:55.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:55.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-05-30T16:56:55.963 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-30T16:56:55.964 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:56:55.964 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T16:56:56.020 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:56:56.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:56:56.020 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:56:56.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:56:56.136 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:56:56.193 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:56:56.193 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:56:56.193 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:56:56.193 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:56:56.193 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:56:56.193 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:56:56.193 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:56:56.193 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:56:56.194 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:56:56.195 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:56:56.195 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:56:56.195 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:56:56.195 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:56:56.195 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:56:56.195 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:56:56.195 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:56:56.195 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:56:56.195 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:56:56.195 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:56:56.195 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:56:56.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:56.196 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:56:56.251 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-30T16:56:56.251 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-30T16:56:56.294 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:56:56.316 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:56:56.369 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:56:56.369 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:56:56.369 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:56:56.369 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:56:56.369 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:56:56.369 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:56:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:56:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:56:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:56:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:56:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:56:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:56:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:56:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:56:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:56:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:56:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:56:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:56:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:56:56.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:56.372 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:56:56.391 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:2024-05-30T16:56:56.386+0000 7fafddbc6580 -1 init, newargv = 0x5646dd918cc0 newargc=15 2024-05-30T16:56:56.392 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[42475]: starting ceph client 2024-05-30T16:56:56.399 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[42475]: starting fuse 2024-05-30T16:56:56.401 INFO:teuthology.orchestra.run.smithi059.stdout:44 2024-05-30T16:56:56.401 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-30T16:56:56.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> import re 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2024-05-30T16:56:56.402 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> return f 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.0")) 2024-05-30T16:56:56.403 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-05-30T16:56:56.530 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.0.42475.asok 2024-05-30T16:56:56.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:56:56.541 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42475.asok 2024-05-30T16:56:56.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:56.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42475.asok status 2024-05-30T16:56:56.720 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:56:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2024-05-30T16:56:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "9ed025fbf4406fb54980a0647506b15895b6d863", 2024-05-30T16:56:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-3154-g9ed025fb (9ed025fbf4406fb54980a0647506b15895b6d863) squid (dev)", 2024-05-30T16:56:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "0", 2024-05-30T16:56:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2024-05-30T16:56:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "42475", 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6693, 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 6693 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:56:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 970448327 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 970448327 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.6693 192.168.0.1:0/970448327", 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/970448327", 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2024-05-30T16:56:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 42, 2024-05-30T16:56:56.723 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 75, 2024-05-30T16:56:56.723 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2024-05-30T16:56:56.723 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2024-05-30T16:56:56.723 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2024-05-30T16:56:56.723 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:56:56.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:56.735 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2024-05-30T16:56:56.735 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-30T16:56:56.744 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2024-05-30T16:56:56.745 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-30T16:56:56.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:56.745 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:56:56.808 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T16:56:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.990+0000 7fed01e00640 1 Processor -- start 2024-05-30T16:56:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.990+0000 7fed01e00640 1 -- start start 2024-05-30T16:56:56.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fed01e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fecfc156e40 0x7fecfc06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:56.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fed01e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecfc06e120 con 0x7fecfc0af130 2024-05-30T16:56:56.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fed01e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecfc06e400 con 0x7fecfc06dc60 2024-05-30T16:56:56.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fed01e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fecfc06e6e0 con 0x7fecfc156e40 2024-05-30T16:56:56.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fecfb400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fecfc0af130 0x7fecfc0af550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34280/0 (socket says 172.21.15.59:34280) 2024-05-30T16:56:56.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fecfb400640 1 -- 172.21.15.59:0/1219899252 learned_addr learned my addr 172.21.15.59:0/1219899252 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:56.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fecfaa00640 1 --2- 172.21.15.59:0/1219899252 >> v2:172.21.15.107:3300/0 conn(0x7fecfc156e40 0x7fecfc06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:56.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fecfa000640 1 -- 172.21.15.59:0/1219899252 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237555391 0 0) 0x7fecfc06e120 con 0x7fecfc0af130 2024-05-30T16:56:56.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fecfa000640 1 -- 172.21.15.59:0/1219899252 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fece0003530 con 0x7fecfc0af130 2024-05-30T16:56:56.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fecfa000640 1 -- 172.21.15.59:0/1219899252 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2826550526 0 0) 0x7fece0003530 con 0x7fecfc0af130 2024-05-30T16:56:56.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fecfaa00640 1 -- 172.21.15.59:0/1219899252 >> v1:172.21.15.107:6789/0 conn(0x7fecfc06dc60 legacy=0x7fecfc15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:56.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fecfaa00640 1 -- 172.21.15.59:0/1219899252 >> v1:172.21.15.59:6789/0 conn(0x7fecfc0af130 legacy=0x7fecfc0af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:56.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.994+0000 7fecfaa00640 1 -- 172.21.15.59:0/1219899252 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc06e9c0 con 0x7fecfc156e40 2024-05-30T16:56:57.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fecfaa00640 1 --2- 172.21.15.59:0/1219899252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecfc156e40 0x7fecfc06f1c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fecec0097c0 tx=0x7fecec01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa687eb43b0d7804 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fecfa000640 1 -- 172.21.15.59:0/1219899252 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec0b0070 con 0x7fecfc156e40 2024-05-30T16:56:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fecfa000640 1 -- 172.21.15.59:0/1219899252 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecec0ab400 con 0x7fecfc156e40 2024-05-30T16:56:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fecfa000640 1 -- 172.21.15.59:0/1219899252 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4001a00 con 0x7fecfc156e40 2024-05-30T16:56:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fed01e00640 1 -- 172.21.15.59:0/1219899252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecfc156e40 msgr2=0x7fecfc06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:57.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fed01e00640 1 --2- 172.21.15.59:0/1219899252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecfc156e40 0x7fecfc06f1c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fecec0097c0 tx=0x7fecec01c3c0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fed01e00640 1 -- 172.21.15.59:0/1219899252 shutdown_connections 2024-05-30T16:56:57.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fed01e00640 1 --2- 172.21.15.59:0/1219899252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecfc156e40 0x7fecfc06f1c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fed01e00640 1 -- 172.21.15.59:0/1219899252 >> 172.21.15.59:0/1219899252 conn(0x7fecfc0b1e60 msgr2=0x7fecfc0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:57.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fed01e00640 1 -- 172.21.15.59:0/1219899252 shutdown_connections 2024-05-30T16:56:57.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fed01e00640 1 -- 172.21.15.59:0/1219899252 wait complete. 2024-05-30T16:56:57.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fed01e00640 1 Processor -- start 2024-05-30T16:56:57.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:56.998+0000 7fed01e00640 1 -- start start 2024-05-30T16:56:57.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fed01e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecfc06dc60 0x7fecfc14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:57.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fed01e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecfc0af130 0x7fecfc14b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:57.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fed01e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecfc156e40 0x7fecfc14d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:57.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fed01e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc15eb70 con 0x7fecfc0af130 2024-05-30T16:56:57.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fed01e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc15e9f0 con 0x7fecfc06dc60 2024-05-30T16:56:57.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fed01e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fecfc16a560 con 0x7fecfc156e40 2024-05-30T16:56:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecfc0af130 0x7fecfc14b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecfc0af130 0x7fecfc14b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40636/0 (socket says 172.21.15.59:40636) 2024-05-30T16:56:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3e00640 1 -- 172.21.15.59:0/3810635695 learned_addr learned my addr 172.21.15.59:0/3810635695 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3e00640 1 -- 172.21.15.59:0/3810635695 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecfc156e40 msgr2=0x7fecfc14d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3e00640 1 --2- 172.21.15.59:0/3810635695 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecfc156e40 0x7fecfc14d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3e00640 1 -- 172.21.15.59:0/3810635695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecfc06dc60 msgr2=0x7fecfc14fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3e00640 1 --2- 172.21.15.59:0/3810635695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecfc06dc60 0x7fecfc14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3e00640 1 -- 172.21.15.59:0/3810635695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc14bcb0 con 0x7fecfc0af130 2024-05-30T16:56:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3e00640 1 --2- 172.21.15.59:0/3810635695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecfc0af130 0x7fecfc14b770 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fece400c390 tx=0x7fece400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3400640 1 -- 172.21.15.59:0/3810635695 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4017070 con 0x7fecfc0af130 2024-05-30T16:56:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3400640 1 -- 172.21.15.59:0/3810635695 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece40052d0 con 0x7fecfc0af130 2024-05-30T16:56:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3400640 1 -- 172.21.15.59:0/3810635695 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4003820 con 0x7fecfc0af130 2024-05-30T16:56:57.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fed01e00640 1 -- 172.21.15.59:0/3810635695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecfc14f110 con 0x7fecfc0af130 2024-05-30T16:56:57.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fed01e00640 1 -- 172.21.15.59:0/3810635695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecfc14f6d0 con 0x7fecfc0af130 2024-05-30T16:56:57.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fed01e00640 1 -- 172.21.15.59:0/3810635695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecfc068a90 con 0x7fecfc0af130 2024-05-30T16:56:57.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.002+0000 7fecf3400640 1 -- 172.21.15.59:0/3810635695 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7fece401a070 con 0x7fecfc0af130 2024-05-30T16:56:57.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.006+0000 7fecf3400640 1 --2- 172.21.15.59:0/3810635695 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fecd80690a0 0x7fecd806b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:57.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.006+0000 7fecf3400640 1 -- 172.21.15.59:0/3810635695 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7fece4084700 con 0x7fecfc0af130 2024-05-30T16:56:57.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.006+0000 7fecfaa00640 1 --2- 172.21.15.59:0/3810635695 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fecd80690a0 0x7fecd806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:57.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.006+0000 7fecfaa00640 1 --2- 172.21.15.59:0/3810635695 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fecd80690a0 0x7fecd806b560 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fecec0ad000 tx=0x7fecec004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:57.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.010+0000 7fecf3400640 1 -- 172.21.15.59:0/3810635695 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fece4005480 con 0x7fecfc0af130 2024-05-30T16:56:57.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.210+0000 7fed01e00640 1 -- 172.21.15.59:0/3810635695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fecfc06fab0 con 0x7fecfc0af130 2024-05-30T16:56:57.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.694+0000 7fecf3400640 1 -- 172.21.15.59:0/3810635695 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v43) ==== 136+0+0 (secure 0 0 0) 0x7fece4056710 con 0x7fecfc0af130 2024-05-30T16:56:57.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.698+0000 7fed01e00640 1 -- 172.21.15.59:0/3810635695 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fecd80690a0 msgr2=0x7fecd806b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:57.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.698+0000 7fed01e00640 1 --2- 172.21.15.59:0/3810635695 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fecd80690a0 0x7fecd806b560 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fecec0ad000 tx=0x7fecec004740 comp rx=0 tx=0).stop 2024-05-30T16:56:57.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.698+0000 7fed01e00640 1 -- 172.21.15.59:0/3810635695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecfc0af130 msgr2=0x7fecfc14b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:57.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.698+0000 7fed01e00640 1 --2- 172.21.15.59:0/3810635695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecfc0af130 0x7fecfc14b770 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fece400c390 tx=0x7fece400c850 comp rx=0 tx=0).stop 2024-05-30T16:56:57.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.698+0000 7fed01e00640 1 -- 172.21.15.59:0/3810635695 shutdown_connections 2024-05-30T16:56:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.698+0000 7fed01e00640 1 --2- 172.21.15.59:0/3810635695 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fecd80690a0 0x7fecd806b560 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.698+0000 7fed01e00640 1 --2- 172.21.15.59:0/3810635695 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecfc156e40 0x7fecfc14d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.698+0000 7fed01e00640 1 --2- 172.21.15.59:0/3810635695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecfc0af130 0x7fecfc14b770 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.698+0000 7fed01e00640 1 --2- 172.21.15.59:0/3810635695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecfc06dc60 0x7fecfc14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.698+0000 7fed01e00640 1 -- 172.21.15.59:0/3810635695 >> 172.21.15.59:0/3810635695 conn(0x7fecfc0b1e60 msgr2=0x7fecfc15ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.698+0000 7fed01e00640 1 -- 172.21.15.59:0/3810635695 shutdown_connections 2024-05-30T16:56:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.698+0000 7fed01e00640 1 -- 172.21.15.59:0/3810635695 wait complete. 2024-05-30T16:56:57.722 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:56:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f25a2c00640 1 Processor -- start 2024-05-30T16:56:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f25a2c00640 1 -- start start 2024-05-30T16:56:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f25a2c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f259c161e60 0x7f259c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f25a2c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f259c0d4410 con 0x7f259c0d1d40 2024-05-30T16:56:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f25a2c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f259c0d5490 con 0x7f259c0d3c90 2024-05-30T16:56:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f25a2c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f259c162240 con 0x7f259c161e60 2024-05-30T16:56:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f25a0c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f259c0d1d40 0x7f259c0b7770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34282/0 (socket says 172.21.15.59:34282) 2024-05-30T16:56:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f25a0c00640 1 -- 172.21.15.59:0/2167527272 learned_addr learned my addr 172.21.15.59:0/2167527272 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:56:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259be00640 1 --2- 172.21.15.59:0/2167527272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f259c161e60 0x7f259c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743387494 0 0) 0x7f259c0d4410 con 0x7f259c0d1d40 2024-05-30T16:56:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2580003530 con 0x7f259c0d1d40 2024-05-30T16:56:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4254670863 0 0) 0x7f2580003530 con 0x7f259c0d1d40 2024-05-30T16:56:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f259c161e60 msgr2=0x7f259c0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 --2- 172.21.15.59:0/2167527272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f259c161e60 0x7f259c0cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 >> v1:172.21.15.107:6789/0 conn(0x7f259c0d3c90 legacy=0x7f259c0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259c0d46d0 con 0x7f259c0d1d40 2024-05-30T16:56:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f2594001a00 con 0x7f259c0d1d40 2024-05-30T16:56:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 >> v1:172.21.15.59:6789/0 conn(0x7f259c0d1d40 legacy=0x7f259c0b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 --2- 172.21.15.59:0/2167527272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25800039f0 0x7f2580003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 --2- 172.21.15.59:0/2167527272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f259c161e60 0x7f2580004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 --2- 172.21.15.59:0/2167527272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2580004d50 0x7f25800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f259c162240 con 0x7f2580004d50 2024-05-30T16:56:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f258000b9d0 con 0x7f25800039f0 2024-05-30T16:56:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.862+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f258000bbd0 con 0x7f259c161e60 2024-05-30T16:56:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.866+0000 7f25a0c00640 1 --2- 172.21.15.59:0/2167527272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2580004d50 0x7f25800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.866+0000 7f259be00640 1 --2- 172.21.15.59:0/2167527272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25800039f0 0x7f2580003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.866+0000 7f2593400640 1 --2- 172.21.15.59:0/2167527272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f259c161e60 0x7f2580004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.866+0000 7f25a0c00640 1 -- 172.21.15.59:0/2167527272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f259c161e60 msgr2=0x7f2580004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.866+0000 7f25a0c00640 1 --2- 172.21.15.59:0/2167527272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f259c161e60 0x7f2580004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.866+0000 7f25a0c00640 1 -- 172.21.15.59:0/2167527272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25800039f0 msgr2=0x7f2580003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.866+0000 7f25a0c00640 1 --2- 172.21.15.59:0/2167527272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25800039f0 0x7f2580003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.866+0000 7f25a0c00640 1 -- 172.21.15.59:0/2167527272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2580003530 con 0x7f2580004d50 2024-05-30T16:56:57.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.866+0000 7f25a0c00640 1 --2- 172.21.15.59:0/2167527272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2580004d50 0x7f25800051d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f259400a880 tx=0x7f259401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a0b1bdc96956b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.866+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259400a4a0 con 0x7f2580004d50 2024-05-30T16:56:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.866+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25940ad650 con 0x7f2580004d50 2024-05-30T16:56:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.866+0000 7f259b400640 1 -- 172.21.15.59:0/2167527272 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25940ada40 con 0x7f2580004d50 2024-05-30T16:56:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 -- 172.21.15.59:0/2167527272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2580004d50 msgr2=0x7f25800051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 --2- 172.21.15.59:0/2167527272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2580004d50 0x7f25800051d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f259400a880 tx=0x7f259401d380 comp rx=0 tx=0).stop 2024-05-30T16:56:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a0c00640 1 -- 172.21.15.59:0/2167527272 reap_dead start 2024-05-30T16:56:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 -- 172.21.15.59:0/2167527272 shutdown_connections 2024-05-30T16:56:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 -- 172.21.15.59:0/2167527272 >> 172.21.15.59:0/2167527272 conn(0x7f259c067b60 msgr2=0x7f259c067f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 -- 172.21.15.59:0/2167527272 shutdown_connections 2024-05-30T16:56:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 -- 172.21.15.59:0/2167527272 wait complete. 2024-05-30T16:56:57.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 Processor -- start 2024-05-30T16:56:57.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 -- start start 2024-05-30T16:56:57.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2580004d50 0x7f259c0b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:57.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f259c1f4450 0x7f259c15df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:57.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f259c1609a0 0x7f259c160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f259c0d4f70 con 0x7f259c1f4450 2024-05-30T16:56:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f259c0d4c90 con 0x7f259c1609a0 2024-05-30T16:56:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a2c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f259c0d40f0 con 0x7f2580004d50 2024-05-30T16:56:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f2593400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f259c1f4450 0x7f259c15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f2593400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f259c1f4450 0x7f259c15df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40658/0 (socket says 172.21.15.59:40658) 2024-05-30T16:56:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f2593400640 1 -- 172.21.15.59:0/2989300659 learned_addr learned my addr 172.21.15.59:0/2989300659 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f259be00640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2580004d50 0x7f259c0b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f25a0c00640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f259c1609a0 0x7f259c160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f2593400640 1 -- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2580004d50 msgr2=0x7f259c0b80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f2593400640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2580004d50 0x7f259c0b80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f2593400640 1 -- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f259c1609a0 msgr2=0x7f259c160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f2593400640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f259c1609a0 0x7f259c160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f2593400640 1 -- 172.21.15.59:0/2989300659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259c1f4c30 con 0x7f259c1f4450 2024-05-30T16:56:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f259be00640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2580004d50 0x7f259c0b80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:56:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.870+0000 7f2593400640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f259c1f4450 0x7f259c15df20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f258400f7f0 tx=0x7f258400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.874+0000 7f2598c00640 1 -- 172.21.15.59:0/2989300659 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840050d0 con 0x7f259c1f4450 2024-05-30T16:56:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.874+0000 7f2598c00640 1 -- 172.21.15.59:0/2989300659 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2584018070 con 0x7f259c1f4450 2024-05-30T16:56:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.874+0000 7f2598c00640 1 -- 172.21.15.59:0/2989300659 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258400d730 con 0x7f259c1f4450 2024-05-30T16:56:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.874+0000 7f25a2c00640 1 -- 172.21.15.59:0/2989300659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f259c1f4f10 con 0x7f259c1f4450 2024-05-30T16:56:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.874+0000 7f25a2c00640 1 -- 172.21.15.59:0/2989300659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f259c0cc980 con 0x7f259c1f4450 2024-05-30T16:56:57.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.874+0000 7f25a2c00640 1 -- 172.21.15.59:0/2989300659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f259c161360 con 0x7f259c1f4450 2024-05-30T16:56:57.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.874+0000 7f2598c00640 1 -- 172.21.15.59:0/2989300659 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f258400d8d0 con 0x7f259c1f4450 2024-05-30T16:56:57.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.874+0000 7f2598c00640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f25780690a0 0x7f257806b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:57.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.874+0000 7f2598c00640 1 -- 172.21.15.59:0/2989300659 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f25840854e0 con 0x7f259c1f4450 2024-05-30T16:56:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.878+0000 7f259be00640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f25780690a0 0x7f257806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.878+0000 7f259be00640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f25780690a0 0x7f257806b560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f258c009be0 tx=0x7f258c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:57.878+0000 7f2598c00640 1 -- 172.21.15.59:0/2989300659 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f25840572c0 con 0x7f259c1f4450 2024-05-30T16:56:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.066+0000 7f25a2c00640 1 -- 172.21.15.59:0/2989300659 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f259c1f5430 con 0x7f25780690a0 2024-05-30T16:56:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f2598c00640 1 -- 172.21.15.59:0/2989300659 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f258c014bb0 con 0x7f25780690a0 2024-05-30T16:56:58.072 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:56:58.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:56:58.073 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T16:56:58.073 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:56:58.073 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:56:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f25a2c00640 1 -- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f25780690a0 msgr2=0x7f257806b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f25a2c00640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f25780690a0 0x7f257806b560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f258c009be0 tx=0x7f258c008040 comp rx=0 tx=0).stop 2024-05-30T16:56:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f25a2c00640 1 -- 172.21.15.59:0/2989300659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f259c1f4450 msgr2=0x7f259c15df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f25a2c00640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f259c1f4450 0x7f259c15df20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f258400f7f0 tx=0x7f258400fcb0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f25a2c00640 1 -- 172.21.15.59:0/2989300659 shutdown_connections 2024-05-30T16:56:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f25a2c00640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f25780690a0 0x7f257806b560 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f25a2c00640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f259c1609a0 0x7f259c160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f25a2c00640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f259c1f4450 0x7f259c15df20 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f25a2c00640 1 --2- 172.21.15.59:0/2989300659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2580004d50 0x7f259c0b80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f25a2c00640 1 -- 172.21.15.59:0/2989300659 >> 172.21.15.59:0/2989300659 conn(0x7f259c067b60 msgr2=0x7f259c0cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f25a2c00640 1 -- 172.21.15.59:0/2989300659 shutdown_connections 2024-05-30T16:56:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.074+0000 7f25a2c00640 1 -- 172.21.15.59:0/2989300659 wait complete. 2024-05-30T16:56:58.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:56:58.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.234+0000 7f305f200640 1 Processor -- start 2024-05-30T16:56:58.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.234+0000 7f305f200640 1 -- start start 2024-05-30T16:56:58.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.234+0000 7f305f200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f306015c480 0x7f30600cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.234+0000 7f305f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3060160b80 0x7f306006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.234+0000 7f305f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f306015c860 con 0x7f306006ef30 2024-05-30T16:56:58.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.234+0000 7f305f200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f30600b43b0 con 0x7f306015c480 2024-05-30T16:56:58.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.234+0000 7f305f200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f30600cc4a0 con 0x7f3060160b80 2024-05-30T16:56:58.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.234+0000 7f305de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f306015c480 0x7f30600cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.234+0000 7f305de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f306015c480 0x7f30600cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40670/0 (socket says 172.21.15.59:40670) 2024-05-30T16:56:58.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.234+0000 7f305de00640 1 -- 172.21.15.59:0/1681857991 learned_addr learned my addr 172.21.15.59:0/1681857991 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:58.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.238+0000 7f3057e00640 1 --2- 172.21.15.59:0/1681857991 >> v2:172.21.15.107:3300/0 conn(0x7f3060160b80 0x7f306006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.238+0000 7f305de00640 1 -- 172.21.15.59:0/1681857991 >> v2:172.21.15.107:3300/0 conn(0x7f3060160b80 msgr2=0x7f306006e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:58.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.238+0000 7f305de00640 1 --2- 172.21.15.59:0/1681857991 >> v2:172.21.15.107:3300/0 conn(0x7f3060160b80 0x7f306006e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.238+0000 7f305de00640 1 -- 172.21.15.59:0/1681857991 >> v1:172.21.15.59:6789/0 conn(0x7f306006ef30 legacy=0x7f30600ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.238+0000 7f305de00640 1 -- 172.21.15.59:0/1681857991 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30600cbee0 con 0x7f306015c480 2024-05-30T16:56:58.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.238+0000 7f305de00640 1 --2- 172.21.15.59:0/1681857991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f306015c480 0x7f30600cb6b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f306006c930 tx=0x7f305001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e8316df26ae00d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:58.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.238+0000 7f305d400640 1 -- 172.21.15.59:0/1681857991 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30500ab430 con 0x7f306015c480 2024-05-30T16:56:58.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.238+0000 7f305d400640 1 -- 172.21.15.59:0/1681857991 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30500b0070 con 0x7f306015c480 2024-05-30T16:56:58.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.238+0000 7f305d400640 1 -- 172.21.15.59:0/1681857991 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30500ab7f0 con 0x7f306015c480 2024-05-30T16:56:58.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.238+0000 7f305f200640 1 -- 172.21.15.59:0/1681857991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f306015c480 msgr2=0x7f30600cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.238+0000 7f305f200640 1 --2- 172.21.15.59:0/1681857991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f306015c480 0x7f30600cb6b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f306006c930 tx=0x7f305001c520 comp rx=0 tx=0).stop 2024-05-30T16:56:58.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.238+0000 7f305f200640 1 -- 172.21.15.59:0/1681857991 shutdown_connections 2024-05-30T16:56:58.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 --2- 172.21.15.59:0/1681857991 >> v2:172.21.15.107:3300/0 conn(0x7f3060160b80 0x7f306006e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 --2- 172.21.15.59:0/1681857991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f306015c480 0x7f30600cb6b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 -- 172.21.15.59:0/1681857991 >> 172.21.15.59:0/1681857991 conn(0x7f306006b9b0 msgr2=0x7f306006bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:58.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 -- 172.21.15.59:0/1681857991 shutdown_connections 2024-05-30T16:56:58.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 -- 172.21.15.59:0/1681857991 wait complete. 2024-05-30T16:56:58.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 Processor -- start 2024-05-30T16:56:58.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 -- start start 2024-05-30T16:56:58.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f306006ef30 0x7f306015de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f306015c480 0x7f306015e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3060160b80 0x7f30600b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f30600b51d0 con 0x7f306006ef30 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f30600b5050 con 0x7f3060160b80 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f30600cd2b0 con 0x7f306015c480 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f306006ef30 0x7f306015de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f306006ef30 0x7f306015de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40674/0 (socket says 172.21.15.59:40674) 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305de00640 1 -- 172.21.15.59:0/1282846142 learned_addr learned my addr 172.21.15.59:0/1282846142 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f3057e00640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f306015c480 0x7f306015e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305e800640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3060160b80 0x7f30600b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305de00640 1 -- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f306015c480 msgr2=0x7f306015e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305de00640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f306015c480 0x7f306015e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305de00640 1 -- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3060160b80 msgr2=0x7f30600b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305de00640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3060160b80 0x7f30600b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305de00640 1 -- 172.21.15.59:0/1282846142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306015e360 con 0x7f306006ef30 2024-05-30T16:56:58.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f305de00640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f306006ef30 0x7f306015de20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f30500ad040 tx=0x7f305001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:58.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.242+0000 7f3056000640 1 -- 172.21.15.59:0/1282846142 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30500be5f0 con 0x7f306006ef30 2024-05-30T16:56:58.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.246+0000 7f3056000640 1 -- 172.21.15.59:0/1282846142 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30500be7b0 con 0x7f306006ef30 2024-05-30T16:56:58.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.246+0000 7f3056000640 1 -- 172.21.15.59:0/1282846142 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30500beba0 con 0x7f306006ef30 2024-05-30T16:56:58.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.246+0000 7f305f200640 1 -- 172.21.15.59:0/1282846142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306015cd80 con 0x7f306006ef30 2024-05-30T16:56:58.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.246+0000 7f305f200640 1 -- 172.21.15.59:0/1282846142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306015d340 con 0x7f306006ef30 2024-05-30T16:56:58.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.246+0000 7f305f200640 1 -- 172.21.15.59:0/1282846142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3060068a90 con 0x7f306006ef30 2024-05-30T16:56:58.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.246+0000 7f3056000640 1 -- 172.21.15.59:0/1282846142 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f30500b43f0 con 0x7f306006ef30 2024-05-30T16:56:58.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.246+0000 7f3056000640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f303c069070 0x7f303c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.246+0000 7f3056000640 1 -- 172.21.15.59:0/1282846142 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f30500a8070 con 0x7f306006ef30 2024-05-30T16:56:58.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.246+0000 7f3057e00640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f303c069070 0x7f303c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.246+0000 7f3057e00640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f303c069070 0x7f303c06b530 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f306015f1e0 tx=0x7f3048008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:58.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.250+0000 7f3056000640 1 -- 172.21.15.59:0/1282846142 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3050016110 con 0x7f306006ef30 2024-05-30T16:56:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.418+0000 7f305f200640 1 -- 172.21.15.59:0/1282846142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f30600b3c40 con 0x7f306006ef30 2024-05-30T16:56:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.418+0000 7f3056000640 1 -- 172.21.15.59:0/1282846142 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f30500f1770 con 0x7f306006ef30 2024-05-30T16:56:58.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.422+0000 7f305f200640 1 -- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f303c069070 msgr2=0x7f303c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.422+0000 7f305f200640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f303c069070 0x7f303c06b530 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f306015f1e0 tx=0x7f3048008040 comp rx=0 tx=0).stop 2024-05-30T16:56:58.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.422+0000 7f305f200640 1 -- 172.21.15.59:0/1282846142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f306006ef30 msgr2=0x7f306015de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.422+0000 7f305f200640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f306006ef30 0x7f306015de20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f30500ad040 tx=0x7f305001ad60 comp rx=0 tx=0).stop 2024-05-30T16:56:58.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.422+0000 7f305f200640 1 -- 172.21.15.59:0/1282846142 shutdown_connections 2024-05-30T16:56:58.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.422+0000 7f305f200640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f303c069070 0x7f303c06b530 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.422+0000 7f305f200640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3060160b80 0x7f30600b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.422+0000 7f305f200640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f306015c480 0x7f306015e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.422+0000 7f305f200640 1 --2- 172.21.15.59:0/1282846142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f306006ef30 0x7f306015de20 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.422+0000 7f305f200640 1 -- 172.21.15.59:0/1282846142 >> 172.21.15.59:0/1282846142 conn(0x7f306006b9b0 msgr2=0x7f30601578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:58.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.422+0000 7f305f200640 1 -- 172.21.15.59:0/1282846142 shutdown_connections 2024-05-30T16:56:58.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.422+0000 7f305f200640 1 -- 172.21.15.59:0/1282846142 wait complete. 2024-05-30T16:56:58.444 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait false 2024-05-30T16:56:58.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.582+0000 7f5876600640 1 Processor -- start 2024-05-30T16:56:58.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.582+0000 7f5876600640 1 -- start start 2024-05-30T16:56:58.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f5876600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f58701447c0 0x7f58700b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f5876600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5870072df0 0x7f587006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f5876600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58700b39d0 con 0x7f58700b4a70 2024-05-30T16:56:58.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f5876600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f58700b3cb0 con 0x7f58701447c0 2024-05-30T16:56:58.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f5876600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f58700b3f90 con 0x7f5870072df0 2024-05-30T16:56:58.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f586fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5870072df0 0x7f587006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f586fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5870072df0 0x7f587006f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:53148/0 (socket says 172.21.15.59:53148) 2024-05-30T16:56:58.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f586fe00640 1 -- 172.21.15.59:0/4214680115 learned_addr learned my addr 172.21.15.59:0/4214680115 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:58.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f586f400640 1 --2- 172.21.15.59:0/4214680115 >> v2:172.21.15.107:3300/0 conn(0x7f58701447c0 0x7f58700b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f586fe00640 1 -- 172.21.15.59:0/4214680115 >> v2:172.21.15.107:3300/0 conn(0x7f58701447c0 msgr2=0x7f58700b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:58.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f586fe00640 1 --2- 172.21.15.59:0/4214680115 >> v2:172.21.15.107:3300/0 conn(0x7f58701447c0 0x7f58700b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f586fe00640 1 -- 172.21.15.59:0/4214680115 >> v1:172.21.15.107:6789/0 conn(0x7f58700b4a70 legacy=0x7f58700726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.586+0000 7f586fe00640 1 -- 172.21.15.59:0/4214680115 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58700b4270 con 0x7f5870072df0 2024-05-30T16:56:58.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f586fe00640 1 --2- 172.21.15.59:0/4214680115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5870072df0 0x7f587006f6b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5868009870 tx=0x7f586801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40575bb64d2fed34 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:58.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f586ea00640 1 -- 172.21.15.59:0/4214680115 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58680ab5f0 con 0x7f5870072df0 2024-05-30T16:56:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f586ea00640 1 -- 172.21.15.59:0/4214680115 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58680b0070 con 0x7f5870072df0 2024-05-30T16:56:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f586ea00640 1 -- 172.21.15.59:0/4214680115 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58680ab9b0 con 0x7f5870072df0 2024-05-30T16:56:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f5876600640 1 -- 172.21.15.59:0/4214680115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5870072df0 msgr2=0x7f587006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f5876600640 1 --2- 172.21.15.59:0/4214680115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5870072df0 0x7f587006f6b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5868009870 tx=0x7f586801c560 comp rx=0 tx=0).stop 2024-05-30T16:56:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f5876600640 1 -- 172.21.15.59:0/4214680115 shutdown_connections 2024-05-30T16:56:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f5876600640 1 --2- 172.21.15.59:0/4214680115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5870072df0 0x7f587006f6b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f5876600640 1 --2- 172.21.15.59:0/4214680115 >> v2:172.21.15.107:3300/0 conn(0x7f58701447c0 0x7f58700b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f5876600640 1 -- 172.21.15.59:0/4214680115 >> 172.21.15.59:0/4214680115 conn(0x7f587006bdb0 msgr2=0x7f587006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f5876600640 1 -- 172.21.15.59:0/4214680115 shutdown_connections 2024-05-30T16:56:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f5876600640 1 -- 172.21.15.59:0/4214680115 wait complete. 2024-05-30T16:56:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f5876600640 1 Processor -- start 2024-05-30T16:56:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.590+0000 7f5876600640 1 -- start start 2024-05-30T16:56:58.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5876600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5870072df0 0x7f58700996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5876600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58700b4a70 0x7f58701f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5876600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58701447c0 0x7f58701f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5876600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58700ae260 con 0x7f58700b4a70 2024-05-30T16:56:58.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5876600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f58700ae0e0 con 0x7f5870072df0 2024-05-30T16:56:58.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5876600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f58700ae3e0 con 0x7f58701447c0 2024-05-30T16:56:58.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5866a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58700b4a70 0x7f58701f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5866a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58700b4a70 0x7f58701f5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40688/0 (socket says 172.21.15.59:40688) 2024-05-30T16:56:58.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5866a00640 1 -- 172.21.15.59:0/2622406984 learned_addr learned my addr 172.21.15.59:0/2622406984 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:58.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f586f400640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5870072df0 0x7f58700996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f586fe00640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58701447c0 0x7f58701f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5866a00640 1 -- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58701447c0 msgr2=0x7f58701f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5866a00640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58701447c0 0x7f58701f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5866a00640 1 -- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5870072df0 msgr2=0x7f58700996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5866a00640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5870072df0 0x7f58700996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5866a00640 1 -- 172.21.15.59:0/2622406984 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587014f460 con 0x7f58700b4a70 2024-05-30T16:56:58.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5866a00640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58700b4a70 0x7f58701f5fd0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f585800c450 tx=0x7f585800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:58.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5867e00640 1 -- 172.21.15.59:0/2622406984 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858016020 con 0x7f58700b4a70 2024-05-30T16:56:58.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5867e00640 1 -- 172.21.15.59:0/2622406984 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58580052d0 con 0x7f58700b4a70 2024-05-30T16:56:58.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5876600640 1 -- 172.21.15.59:0/2622406984 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587014f740 con 0x7f58700b4a70 2024-05-30T16:56:58.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5867e00640 1 -- 172.21.15.59:0/2622406984 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858007260 con 0x7f58700b4a70 2024-05-30T16:56:58.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5876600640 1 -- 172.21.15.59:0/2622406984 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587014fd00 con 0x7f58700b4a70 2024-05-30T16:56:58.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5876600640 1 -- 172.21.15.59:0/2622406984 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5870068a90 con 0x7f58700b4a70 2024-05-30T16:56:58.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.594+0000 7f5867e00640 1 -- 172.21.15.59:0/2622406984 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f5858007400 con 0x7f58700b4a70 2024-05-30T16:56:58.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.598+0000 7f5867e00640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f584c069070 0x7f584c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.598+0000 7f5867e00640 1 -- 172.21.15.59:0/2622406984 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f5858084e60 con 0x7f58700b4a70 2024-05-30T16:56:58.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.598+0000 7f586f400640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f584c069070 0x7f584c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.598+0000 7f586f400640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f584c069070 0x7f584c06b530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f58600074a0 tx=0x7f586000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.602+0000 7f5867e00640 1 -- 172.21.15.59:0/2622406984 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5858089e20 con 0x7f58700b4a70 2024-05-30T16:56:58.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.766+0000 7f5876600640 1 -- 172.21.15.59:0/2622406984 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}] v 0) -- 0x7f587006ddf0 con 0x7f58700b4a70 2024-05-30T16:56:58.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.770+0000 7f5867e00640 1 -- 172.21.15.59:0/2622406984 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}]=0 v19)=0 v19) ==== 136+0+0 (secure 0 0 0) 0x7f5858020020 con 0x7f58700b4a70 2024-05-30T16:56:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.774+0000 7f5876600640 1 -- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f584c069070 msgr2=0x7f584c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.774+0000 7f5876600640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f584c069070 0x7f584c06b530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f58600074a0 tx=0x7f586000b040 comp rx=0 tx=0).stop 2024-05-30T16:56:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.774+0000 7f5876600640 1 -- 172.21.15.59:0/2622406984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58700b4a70 msgr2=0x7f58701f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.774+0000 7f5876600640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58700b4a70 0x7f58701f5fd0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f585800c450 tx=0x7f585800c910 comp rx=0 tx=0).stop 2024-05-30T16:56:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.774+0000 7f5876600640 1 -- 172.21.15.59:0/2622406984 shutdown_connections 2024-05-30T16:56:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.774+0000 7f5876600640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f584c069070 0x7f584c06b530 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.774+0000 7f5876600640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58701447c0 0x7f58701f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.774+0000 7f5876600640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58700b4a70 0x7f58701f5fd0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.774+0000 7f5876600640 1 --2- 172.21.15.59:0/2622406984 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5870072df0 0x7f58700996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.774+0000 7f5876600640 1 -- 172.21.15.59:0/2622406984 >> 172.21.15.59:0/2622406984 conn(0x7f587006bdb0 msgr2=0x7f587006ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.774+0000 7f5876600640 1 -- 172.21.15.59:0/2622406984 shutdown_connections 2024-05-30T16:56:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.774+0000 7f5876600640 1 -- 172.21.15.59:0/2622406984 wait complete. 2024-05-30T16:56:58.796 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:58.795+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:58.796 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:58.795+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:58.796 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:58.795+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:58.796 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:58.795+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:58.796 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:58.795+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:58.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T16:56:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f237a800640 1 Processor -- start 2024-05-30T16:56:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f237a800640 1 -- start start 2024-05-30T16:56:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f237a800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2374156e40 0x7f237406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f237a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23740af130 0x7f23740af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f237a800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f237406e120 con 0x7f237406dc60 2024-05-30T16:56:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f237a800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f237406e400 con 0x7f23740af130 2024-05-30T16:56:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f237a800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f237406e6e0 con 0x7f2374156e40 2024-05-30T16:56:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f2373e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23740af130 0x7f23740af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f2373e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23740af130 0x7f23740af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40702/0 (socket says 172.21.15.59:40702) 2024-05-30T16:56:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f2373e00640 1 -- 172.21.15.59:0/676625581 learned_addr learned my addr 172.21.15.59:0/676625581 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f2373e00640 1 -- 172.21.15.59:0/676625581 >> v2:172.21.15.107:3300/0 conn(0x7f2374156e40 msgr2=0x7f237406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f2373e00640 1 --2- 172.21.15.59:0/676625581 >> v2:172.21.15.107:3300/0 conn(0x7f2374156e40 0x7f237406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f2373e00640 1 -- 172.21.15.59:0/676625581 >> v1:172.21.15.107:6789/0 conn(0x7f237406dc60 legacy=0x7f237415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.938+0000 7f2373e00640 1 -- 172.21.15.59:0/676625581 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237406e9c0 con 0x7f23740af130 2024-05-30T16:56:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.942+0000 7f2373e00640 1 --2- 172.21.15.59:0/676625581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23740af130 0x7f23740af550 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f2374073f70 tx=0x7f236c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dbdb2aa6b72537 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.942+0000 7f2372a00640 1 -- 172.21.15.59:0/676625581 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c0a56c0 con 0x7f23740af130 2024-05-30T16:56:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.942+0000 7f2372a00640 1 -- 172.21.15.59:0/676625581 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f236c0a5860 con 0x7f23740af130 2024-05-30T16:56:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.942+0000 7f2372a00640 1 -- 172.21.15.59:0/676625581 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c0a5c30 con 0x7f23740af130 2024-05-30T16:56:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.942+0000 7f237a800640 1 -- 172.21.15.59:0/676625581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23740af130 msgr2=0x7f23740af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.942+0000 7f237a800640 1 --2- 172.21.15.59:0/676625581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23740af130 0x7f23740af550 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f2374073f70 tx=0x7f236c01c9b0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.942+0000 7f237a800640 1 -- 172.21.15.59:0/676625581 shutdown_connections 2024-05-30T16:56:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.942+0000 7f237a800640 1 --2- 172.21.15.59:0/676625581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23740af130 0x7f23740af550 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.942+0000 7f237a800640 1 --2- 172.21.15.59:0/676625581 >> v2:172.21.15.107:3300/0 conn(0x7f2374156e40 0x7f237406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.942+0000 7f237a800640 1 -- 172.21.15.59:0/676625581 >> 172.21.15.59:0/676625581 conn(0x7f23740b1e60 msgr2=0x7f23740b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.942+0000 7f237a800640 1 -- 172.21.15.59:0/676625581 shutdown_connections 2024-05-30T16:56:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.942+0000 7f237a800640 1 -- 172.21.15.59:0/676625581 wait complete. 2024-05-30T16:56:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f237a800640 1 Processor -- start 2024-05-30T16:56:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f237a800640 1 -- start start 2024-05-30T16:56:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f237a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f237406dc60 0x7f23741506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f237a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23740af130 0x7f2374155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f237a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2374156e40 0x7f2374147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f237a800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f237415eb30 con 0x7f237406dc60 2024-05-30T16:56:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f237a800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f237415e9b0 con 0x7f23740af130 2024-05-30T16:56:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f237a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2374150c10 con 0x7f2374156e40 2024-05-30T16:56:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f2373400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f237406dc60 0x7f23741506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f2373400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f237406dc60 0x7f23741506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40706/0 (socket says 172.21.15.59:40706) 2024-05-30T16:56:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f2373400640 1 -- 172.21.15.59:0/2966321812 learned_addr learned my addr 172.21.15.59:0/2966321812 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f2373400640 1 -- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2374156e40 msgr2=0x7f2374147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f2373400640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2374156e40 0x7f2374147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f2373400640 1 -- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23740af130 msgr2=0x7f2374155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f236be00640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23740af130 0x7f2374155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f2373400640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23740af130 0x7f2374155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f2373400640 1 -- 172.21.15.59:0/2966321812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2374148950 con 0x7f237406dc60 2024-05-30T16:56:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f236be00640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23740af130 0x7f2374155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:56:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f2373400640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f237406dc60 0x7f23741506d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f236400b440 tx=0x7f236400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f236b400640 1 -- 172.21.15.59:0/2966321812 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364015020 con 0x7f237406dc60 2024-05-30T16:56:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f236b400640 1 -- 172.21.15.59:0/2966321812 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2364011850 con 0x7f237406dc60 2024-05-30T16:56:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f236b400640 1 -- 172.21.15.59:0/2966321812 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364011c40 con 0x7f237406dc60 2024-05-30T16:56:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f237a800640 1 -- 172.21.15.59:0/2966321812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237414f950 con 0x7f237406dc60 2024-05-30T16:56:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.946+0000 7f237a800640 1 -- 172.21.15.59:0/2966321812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237414fed0 con 0x7f237406dc60 2024-05-30T16:56:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.950+0000 7f237a800640 1 -- 172.21.15.59:0/2966321812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2374068a90 con 0x7f237406dc60 2024-05-30T16:56:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.950+0000 7f236b400640 1 -- 172.21.15.59:0/2966321812 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f2364018020 con 0x7f237406dc60 2024-05-30T16:56:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.950+0000 7f236b400640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2350069070 0x7f235006b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.950+0000 7f236b400640 1 -- 172.21.15.59:0/2966321812 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f2364085310 con 0x7f237406dc60 2024-05-30T16:56:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.950+0000 7f236be00640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2350069070 0x7f235006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.950+0000 7f236be00640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2350069070 0x7f235006b530 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f237414c070 tx=0x7f235c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:58.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:58.954+0000 7f236b400640 1 -- 172.21.15.59:0/2966321812 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f236401f020 con 0x7f237406dc60 2024-05-30T16:56:59.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.146+0000 7f237a800640 1 -- 172.21.15.59:0/2966321812 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f23740750b0 con 0x7f2350069070 2024-05-30T16:56:59.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:59.159+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:59.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:59.159+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:59.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:59.159+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:59.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:59.159+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:59.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:56:59.159+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:56:59.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.186+0000 7f236b400640 1 -- 172.21.15.59:0/2966321812 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f23740750b0 con 0x7f2350069070 2024-05-30T16:56:59.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.190+0000 7f237a800640 1 -- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2350069070 msgr2=0x7f235006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:59.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.190+0000 7f237a800640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2350069070 0x7f235006b530 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f237414c070 tx=0x7f235c009040 comp rx=0 tx=0).stop 2024-05-30T16:56:59.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.190+0000 7f237a800640 1 -- 172.21.15.59:0/2966321812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f237406dc60 msgr2=0x7f23741506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:59.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.190+0000 7f237a800640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f237406dc60 0x7f23741506d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f236400b440 tx=0x7f236400b900 comp rx=0 tx=0).stop 2024-05-30T16:56:59.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.190+0000 7f237a800640 1 -- 172.21.15.59:0/2966321812 shutdown_connections 2024-05-30T16:56:59.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.190+0000 7f237a800640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2350069070 0x7f235006b530 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.190+0000 7f237a800640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2374156e40 0x7f2374147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.190+0000 7f237a800640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23740af130 0x7f2374155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.190+0000 7f237a800640 1 --2- 172.21.15.59:0/2966321812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f237406dc60 0x7f23741506d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.190+0000 7f237a800640 1 -- 172.21.15.59:0/2966321812 >> 172.21.15.59:0/2966321812 conn(0x7f23740b1e60 msgr2=0x7f23740b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:59.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.190+0000 7f237a800640 1 -- 172.21.15.59:0/2966321812 shutdown_connections 2024-05-30T16:56:59.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.190+0000 7f237a800640 1 -- 172.21.15.59:0/2966321812 wait complete. 2024-05-30T16:56:59.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:56:59.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c2a00640 1 Processor -- start 2024-05-30T16:56:59.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c2a00640 1 -- start start 2024-05-30T16:56:59.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19bc15c7b0 0x7f19bc0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:59.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c2a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f19bc0d0d60 0x7f19bc09ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:59.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c2a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19bc09b900 con 0x7f19bc09b080 2024-05-30T16:56:59.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c2a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f19bc15cb90 con 0x7f19bc15c7b0 2024-05-30T16:56:59.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c2a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f19bc0cd4c0 con 0x7f19bc0d0d60 2024-05-30T16:56:59.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c1600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19bc15c7b0 0x7f19bc0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:59.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c1600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19bc15c7b0 0x7f19bc0d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40722/0 (socket says 172.21.15.59:40722) 2024-05-30T16:56:59.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c1600640 1 -- 172.21.15.59:0/414181304 learned_addr learned my addr 172.21.15.59:0/414181304 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:59.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c1600640 1 -- 172.21.15.59:0/414181304 >> v2:172.21.15.107:3300/0 conn(0x7f19bc0d0d60 msgr2=0x7f19bc09ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:56:59.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c1600640 1 --2- 172.21.15.59:0/414181304 >> v2:172.21.15.107:3300/0 conn(0x7f19bc0d0d60 0x7f19bc09ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c1600640 1 -- 172.21.15.59:0/414181304 >> v1:172.21.15.59:6789/0 conn(0x7f19bc09b080 legacy=0x7f19bc160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:59.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.354+0000 7f19c1600640 1 -- 172.21.15.59:0/414181304 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19bc09bbe0 con 0x7f19bc15c7b0 2024-05-30T16:56:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.358+0000 7f19c1600640 1 --2- 172.21.15.59:0/414181304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19bc15c7b0 0x7f19bc0d0820 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f19bc06fdd0 tx=0x7f19b001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe0a925ad82cd1e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.358+0000 7f19bbe00640 1 -- 172.21.15.59:0/414181304 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b00a57d0 con 0x7f19bc15c7b0 2024-05-30T16:56:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.358+0000 7f19bbe00640 1 -- 172.21.15.59:0/414181304 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b00a5970 con 0x7f19bc15c7b0 2024-05-30T16:56:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.358+0000 7f19bbe00640 1 -- 172.21.15.59:0/414181304 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b00a5d40 con 0x7f19bc15c7b0 2024-05-30T16:56:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.358+0000 7f19c2a00640 1 -- 172.21.15.59:0/414181304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19bc15c7b0 msgr2=0x7f19bc0d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.358+0000 7f19c2a00640 1 --2- 172.21.15.59:0/414181304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19bc15c7b0 0x7f19bc0d0820 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f19bc06fdd0 tx=0x7f19b001c9f0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.358+0000 7f19c2a00640 1 -- 172.21.15.59:0/414181304 shutdown_connections 2024-05-30T16:56:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.358+0000 7f19c2a00640 1 --2- 172.21.15.59:0/414181304 >> v2:172.21.15.107:3300/0 conn(0x7f19bc0d0d60 0x7f19bc09ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.358+0000 7f19c2a00640 1 --2- 172.21.15.59:0/414181304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19bc15c7b0 0x7f19bc0d0820 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.358+0000 7f19c2a00640 1 -- 172.21.15.59:0/414181304 >> 172.21.15.59:0/414181304 conn(0x7f19bc0b3ec0 msgr2=0x7f19bc0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.358+0000 7f19c2a00640 1 -- 172.21.15.59:0/414181304 shutdown_connections 2024-05-30T16:56:59.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.358+0000 7f19c2a00640 1 -- 172.21.15.59:0/414181304 wait complete. 2024-05-30T16:56:59.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2a00640 1 Processor -- start 2024-05-30T16:56:59.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2a00640 1 -- start start 2024-05-30T16:56:59.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19bc09b080 0x7f19bc0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:59.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19bc0d0d60 0x7f19bc0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:59.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19bc15c7b0 0x7f19bc0cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:59.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc169580 con 0x7f19bc15c7b0 2024-05-30T16:56:59.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc09b6e0 con 0x7f19bc0d0d60 2024-05-30T16:56:59.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f19bc169700 con 0x7f19bc09b080 2024-05-30T16:56:59.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19bc15c7b0 0x7f19bc0cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:59.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19bc15c7b0 0x7f19bc0cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40728/0 (socket says 172.21.15.59:40728) 2024-05-30T16:56:59.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2000640 1 -- 172.21.15.59:0/2563828646 learned_addr learned my addr 172.21.15.59:0/2563828646 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:56:59.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c0c00640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19bc0d0d60 0x7f19bc0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:59.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c1600640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19bc09b080 0x7f19bc0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:59.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2000640 1 -- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19bc09b080 msgr2=0x7f19bc0c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:59.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2000640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19bc09b080 0x7f19bc0c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2000640 1 -- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19bc0d0d60 msgr2=0x7f19bc0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2000640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19bc0d0d60 0x7f19bc0c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2000640 1 -- 172.21.15.59:0/2563828646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19bc0c8830 con 0x7f19bc15c7b0 2024-05-30T16:56:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2000640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19bc15c7b0 0x7f19bc0cb700 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f19b400c340 tx=0x7f19b400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19b9600640 1 -- 172.21.15.59:0/2563828646 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4005220 con 0x7f19bc15c7b0 2024-05-30T16:56:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19b9600640 1 -- 172.21.15.59:0/2563828646 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b40053c0 con 0x7f19bc15c7b0 2024-05-30T16:56:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19b9600640 1 -- 172.21.15.59:0/2563828646 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4007270 con 0x7f19bc15c7b0 2024-05-30T16:56:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2a00640 1 -- 172.21.15.59:0/2563828646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19bc0c9cf0 con 0x7f19bc15c7b0 2024-05-30T16:56:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.362+0000 7f19c2a00640 1 -- 172.21.15.59:0/2563828646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19bc06cc40 con 0x7f19bc15c7b0 2024-05-30T16:56:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.366+0000 7f19c2a00640 1 -- 172.21.15.59:0/2563828646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19bc068a90 con 0x7f19bc15c7b0 2024-05-30T16:56:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.366+0000 7f19b9600640 1 -- 172.21.15.59:0/2563828646 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 89160+0+0 (secure 0 0 0) 0x7f19b4019020 con 0x7f19bc15c7b0 2024-05-30T16:56:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.366+0000 7f19b9600640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f199c0690a0 0x7f199c06b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:56:59.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.366+0000 7f19b9600640 1 -- 172.21.15.59:0/2563828646 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f19b4084460 con 0x7f19bc15c7b0 2024-05-30T16:56:59.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.366+0000 7f19c1600640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f199c0690a0 0x7f199c06b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:56:59.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.366+0000 7f19c1600640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f199c0690a0 0x7f199c06b560 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f19b00ae000 tx=0x7f19b00a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:56:59.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.370+0000 7f19b9600640 1 -- 172.21.15.59:0/2563828646 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f19b4055e20 con 0x7f19bc15c7b0 2024-05-30T16:56:59.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.566+0000 7f19c2a00640 1 -- 172.21.15.59:0/2563828646 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f19bc0b4b20 con 0x7f199c0690a0 2024-05-30T16:56:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.570+0000 7f19b9600640 1 -- 172.21.15.59:0/2563828646 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f19bc0b4b20 con 0x7f199c0690a0 2024-05-30T16:56:59.574 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/c4e43638-0dce-488c-8596-73de11286b1f 2024-05-30T16:56:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.574+0000 7f19c2a00640 1 -- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f199c0690a0 msgr2=0x7f199c06b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.574+0000 7f19c2a00640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f199c0690a0 0x7f199c06b560 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f19b00ae000 tx=0x7f19b00a7070 comp rx=0 tx=0).stop 2024-05-30T16:56:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.574+0000 7f19c2a00640 1 -- 172.21.15.59:0/2563828646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19bc15c7b0 msgr2=0x7f19bc0cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:56:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.574+0000 7f19c2a00640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19bc15c7b0 0x7f19bc0cb700 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f19b400c340 tx=0x7f19b400c800 comp rx=0 tx=0).stop 2024-05-30T16:56:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.574+0000 7f19c2a00640 1 -- 172.21.15.59:0/2563828646 shutdown_connections 2024-05-30T16:56:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.574+0000 7f19c2a00640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f199c0690a0 0x7f199c06b560 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.574+0000 7f19c2a00640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19bc15c7b0 0x7f19bc0cb700 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.574+0000 7f19c2a00640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19bc0d0d60 0x7f19bc0c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.574+0000 7f19c2a00640 1 --2- 172.21.15.59:0/2563828646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19bc09b080 0x7f19bc0c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:56:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.574+0000 7f19c2a00640 1 -- 172.21.15.59:0/2563828646 >> 172.21.15.59:0/2563828646 conn(0x7f19bc0b3ec0 msgr2=0x7f19bc071810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:56:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.574+0000 7f19c2a00640 1 -- 172.21.15.59:0/2563828646 shutdown_connections 2024-05-30T16:56:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:56:59.574+0000 7f19c2a00640 1 -- 172.21.15.59:0/2563828646 wait complete. 2024-05-30T16:56:59.596 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/c4e43638-0dce-488c-8596-73de11286b1f 2024-05-30T16:56:59.596 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:56:59.596 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:56:59.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:56:59.605 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/c4e43638-0dce-488c-8596-73de11286b1f/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:57:04.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:57:04.632 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:57:06.732 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:57:06.733 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:57:06.733 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.06545 s, 152 MB/s 2024-05-30T16:57:06.734 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:57:06.734 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:57:06.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:57:06.743 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/c4e43638-0dce-488c-8596-73de11286b1f/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:57:13.631 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:57:13.631 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:57:13.631 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.83576 s, 157 MB/s 2024-05-30T16:57:13.632 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:57:13.632 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:57:13.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:57:13.641 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/c4e43638-0dce-488c-8596-73de11286b1f/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:57:20.482 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:57:20.482 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:57:20.482 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.78448 s, 158 MB/s 2024-05-30T16:57:20.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T16:57:20.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f3e00640 1 Processor -- start 2024-05-30T16:57:20.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f3e00640 1 -- start start 2024-05-30T16:57:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc5f415fa40 0x7fc5f409b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f3e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc5f40d0880 0x7fc5f40d0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f3e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f415fe20 con 0x7fc5f40cced0 2024-05-30T16:57:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f3e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f40d02e0 con 0x7fc5f415fa40 2024-05-30T16:57:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f3e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f40d05c0 con 0x7fc5f40d0880 2024-05-30T16:57:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc5f415fa40 0x7fc5f409b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc5f415fa40 0x7fc5f409b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59052/0 (socket says 172.21.15.59:59052) 2024-05-30T16:57:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f2a00640 1 -- 172.21.15.59:0/3368212145 learned_addr learned my addr 172.21.15.59:0/3368212145 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f2000640 1 --2- 172.21.15.59:0/3368212145 >> v2:172.21.15.107:3300/0 conn(0x7fc5f40d0880 0x7fc5f40d0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:20.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f2a00640 1 -- 172.21.15.59:0/3368212145 >> v2:172.21.15.107:3300/0 conn(0x7fc5f40d0880 msgr2=0x7fc5f40d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:20.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f2a00640 1 --2- 172.21.15.59:0/3368212145 >> v2:172.21.15.107:3300/0 conn(0x7fc5f40d0880 0x7fc5f40d0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:20.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f2a00640 1 -- 172.21.15.59:0/3368212145 >> v1:172.21.15.59:6789/0 conn(0x7fc5f40cced0 legacy=0x7fc5f40cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:20.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.630+0000 7fc5f2a00640 1 -- 172.21.15.59:0/3368212145 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f40b51b0 con 0x7fc5f415fa40 2024-05-30T16:57:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.634+0000 7fc5f2a00640 1 --2- 172.21.15.59:0/3368212145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f415fa40 0x7fc5f409b420 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40b3d50 tx=0x7fc5e401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c4f6eaa14c97d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.634+0000 7fc5f1600640 1 -- 172.21.15.59:0/3368212145 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e40a5730 con 0x7fc5f415fa40 2024-05-30T16:57:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.634+0000 7fc5f1600640 1 -- 172.21.15.59:0/3368212145 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e40a58d0 con 0x7fc5f415fa40 2024-05-30T16:57:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.634+0000 7fc5f1600640 1 -- 172.21.15.59:0/3368212145 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e40a5ca0 con 0x7fc5f415fa40 2024-05-30T16:57:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.634+0000 7fc5f3e00640 1 -- 172.21.15.59:0/3368212145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f415fa40 msgr2=0x7fc5f409b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.634+0000 7fc5f3e00640 1 --2- 172.21.15.59:0/3368212145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f415fa40 0x7fc5f409b420 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40b3d50 tx=0x7fc5e401c960 comp rx=0 tx=0).stop 2024-05-30T16:57:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.634+0000 7fc5f3e00640 1 -- 172.21.15.59:0/3368212145 shutdown_connections 2024-05-30T16:57:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.634+0000 7fc5f3e00640 1 --2- 172.21.15.59:0/3368212145 >> v2:172.21.15.107:3300/0 conn(0x7fc5f40d0880 0x7fc5f40d0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.634+0000 7fc5f3e00640 1 --2- 172.21.15.59:0/3368212145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f415fa40 0x7fc5f409b420 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:20.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.634+0000 7fc5f3e00640 1 -- 172.21.15.59:0/3368212145 >> 172.21.15.59:0/3368212145 conn(0x7fc5f40b3db0 msgr2=0x7fc5f40b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:20.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.634+0000 7fc5f3e00640 1 -- 172.21.15.59:0/3368212145 shutdown_connections 2024-05-30T16:57:20.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.634+0000 7fc5f3e00640 1 -- 172.21.15.59:0/3368212145 wait complete. 2024-05-30T16:57:20.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3e00640 1 Processor -- start 2024-05-30T16:57:20.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3e00640 1 -- start start 2024-05-30T16:57:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f40cced0 0x7fc5f4157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5f40d0880 0x7fc5f41656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc5f415fa40 0x7fc5f415b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f4169a80 con 0x7fc5f40cced0 2024-05-30T16:57:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f4169900 con 0x7fc5f40d0880 2024-05-30T16:57:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f4169c00 con 0x7fc5f415fa40 2024-05-30T16:57:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f40cced0 0x7fc5f4157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f40cced0 0x7fc5f4157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59068/0 (socket says 172.21.15.59:59068) 2024-05-30T16:57:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f2a00640 1 -- 172.21.15.59:0/1572581726 learned_addr learned my addr 172.21.15.59:0/1572581726 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f2000640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5f40d0880 0x7fc5f41656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3400640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc5f415fa40 0x7fc5f415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f2a00640 1 -- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc5f415fa40 msgr2=0x7fc5f415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f2a00640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc5f415fa40 0x7fc5f415b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f2a00640 1 -- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5f40d0880 msgr2=0x7fc5f41656f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f2a00640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5f40d0880 0x7fc5f41656f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f2a00640 1 -- 172.21.15.59:0/1572581726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f40b4340 con 0x7fc5f40cced0 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3400640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc5f415fa40 0x7fc5f415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f2a00640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f40cced0 0x7fc5f4157710 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40af040 tx=0x7fc5e4019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5eb400640 1 -- 172.21.15.59:0/1572581726 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e40bc020 con 0x7fc5f40cced0 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5eb400640 1 -- 172.21.15.59:0/1572581726 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e40b8670 con 0x7fc5f40cced0 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3e00640 1 -- 172.21.15.59:0/1572581726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f406e070 con 0x7fc5f40cced0 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5eb400640 1 -- 172.21.15.59:0/1572581726 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e40b8a60 con 0x7fc5f40cced0 2024-05-30T16:57:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3e00640 1 -- 172.21.15.59:0/1572581726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f406e910 con 0x7fc5f40cced0 2024-05-30T16:57:20.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.638+0000 7fc5f3e00640 1 -- 172.21.15.59:0/1572581726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f406e460 con 0x7fc5f40cced0 2024-05-30T16:57:20.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.642+0000 7fc5eb400640 1 -- 172.21.15.59:0/1572581726 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) ==== 89262+0+0 (secure 0 0 0) 0x7fc5e40bf020 con 0x7fc5f40cced0 2024-05-30T16:57:20.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.642+0000 7fc5eb400640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc5d4069190 0x7fc5d406b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:20.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.642+0000 7fc5eb400640 1 -- 172.21.15.59:0/1572581726 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7fc5e4120430 con 0x7fc5f40cced0 2024-05-30T16:57:20.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.642+0000 7fc5f2000640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc5d4069190 0x7fc5d406b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:20.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.642+0000 7fc5f2000640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc5d4069190 0x7fc5d406b650 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc5f41649b0 tx=0x7fc5e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:20.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.646+0000 7fc5eb400640 1 -- 172.21.15.59:0/1572581726 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc5e40c6030 con 0x7fc5f40cced0 2024-05-30T16:57:20.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.842+0000 7fc5f3e00640 1 -- 172.21.15.59:0/1572581726 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7fc5f4068a90 con 0x7fc5d4069190 2024-05-30T16:57:20.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.854+0000 7fc5eb400640 1 -- 172.21.15.59:0/1572581726 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc5f4068a90 con 0x7fc5d4069190 2024-05-30T16:57:20.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.858+0000 7fc5f3e00640 1 -- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc5d4069190 msgr2=0x7fc5d406b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:20.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.858+0000 7fc5f3e00640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc5d4069190 0x7fc5d406b650 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc5f41649b0 tx=0x7fc5e0008040 comp rx=0 tx=0).stop 2024-05-30T16:57:20.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.858+0000 7fc5f3e00640 1 -- 172.21.15.59:0/1572581726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f40cced0 msgr2=0x7fc5f4157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:20.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.858+0000 7fc5f3e00640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f40cced0 0x7fc5f4157710 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40af040 tx=0x7fc5e4019700 comp rx=0 tx=0).stop 2024-05-30T16:57:20.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.858+0000 7fc5f3e00640 1 -- 172.21.15.59:0/1572581726 shutdown_connections 2024-05-30T16:57:20.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.858+0000 7fc5f3e00640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc5d4069190 0x7fc5d406b650 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:20.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.858+0000 7fc5f3e00640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc5f415fa40 0x7fc5f415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:20.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.858+0000 7fc5f3e00640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5f40d0880 0x7fc5f41656f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:20.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.858+0000 7fc5f3e00640 1 --2- 172.21.15.59:0/1572581726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f40cced0 0x7fc5f4157710 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:20.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.858+0000 7fc5f3e00640 1 -- 172.21.15.59:0/1572581726 >> 172.21.15.59:0/1572581726 conn(0x7fc5f40b3db0 msgr2=0x7fc5f409aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:20.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.858+0000 7fc5f3e00640 1 -- 172.21.15.59:0/1572581726 shutdown_connections 2024-05-30T16:57:20.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:20.858+0000 7fc5f3e00640 1 -- 172.21.15.59:0/1572581726 wait complete. 2024-05-30T16:57:20.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:57:21.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f1896600640 1 Processor -- start 2024-05-30T16:57:21.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f1896600640 1 -- start start 2024-05-30T16:57:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f1896600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18900d14c0 0x7f189006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f1896600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18900d05b0 0x7f189009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f1896600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f189006ea20 con 0x7f189009af80 2024-05-30T16:57:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f1896600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1890070950 con 0x7f18900d05b0 2024-05-30T16:57:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f1896600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1890070c30 con 0x7f18900d14c0 2024-05-30T16:57:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f188f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18900d14c0 0x7f189006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f188f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18900d14c0 0x7f189006e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:44954/0 (socket says 172.21.15.59:44954) 2024-05-30T16:57:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f188f400640 1 -- 172.21.15.59:0/3340695377 learned_addr learned my addr 172.21.15.59:0/3340695377 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f1886a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18900d05b0 0x7f189009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f188fe00640 1 --1- 172.21.15.59:0/3340695377 >> v1:172.21.15.107:6789/0 conn(0x7f189009af80 0x7f1890162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:41388/0 (socket says 172.21.15.59:41388) 2024-05-30T16:57:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f1886a00640 1 -- 172.21.15.59:0/3340695377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18900d14c0 msgr2=0x7f189006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f1886a00640 1 --2- 172.21.15.59:0/3340695377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18900d14c0 0x7f189006e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f1886a00640 1 -- 172.21.15.59:0/3340695377 >> v1:172.21.15.107:6789/0 conn(0x7f189009af80 legacy=0x7f1890162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f188ea00640 1 -- 172.21.15.59:0/3340695377 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124782651 0 0) 0x7f1888001120 con 0x7f189009af80 2024-05-30T16:57:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f1886a00640 1 -- 172.21.15.59:0/3340695377 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1890070f10 con 0x7f18900d05b0 2024-05-30T16:57:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.022+0000 7f188f400640 1 --2- 172.21.15.59:0/3340695377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18900d14c0 0x7f189006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:57:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.026+0000 7f1886a00640 1 --2- 172.21.15.59:0/3340695377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900d05b0 0x7f189009aa40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f18780097c0 tx=0x7f187801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e5b3e7e775d3a0b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.026+0000 7f188ea00640 1 -- 172.21.15.59:0/3340695377 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18780b0070 con 0x7f18900d05b0 2024-05-30T16:57:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.026+0000 7f188ea00640 1 -- 172.21.15.59:0/3340695377 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18780ab600 con 0x7f18900d05b0 2024-05-30T16:57:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.026+0000 7f188ea00640 1 -- 172.21.15.59:0/3340695377 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18780ab9d0 con 0x7f18900d05b0 2024-05-30T16:57:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 -- 172.21.15.59:0/3340695377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900d05b0 msgr2=0x7f189009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 --2- 172.21.15.59:0/3340695377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900d05b0 0x7f189009aa40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f18780097c0 tx=0x7f187801c4a0 comp rx=0 tx=0).stop 2024-05-30T16:57:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 -- 172.21.15.59:0/3340695377 shutdown_connections 2024-05-30T16:57:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 --2- 172.21.15.59:0/3340695377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900d05b0 0x7f189009aa40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 --2- 172.21.15.59:0/3340695377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18900d14c0 0x7f189006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 -- 172.21.15.59:0/3340695377 >> 172.21.15.59:0/3340695377 conn(0x7f18900b3f80 msgr2=0x7f18900b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:21.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 -- 172.21.15.59:0/3340695377 shutdown_connections 2024-05-30T16:57:21.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 -- 172.21.15.59:0/3340695377 wait complete. 2024-05-30T16:57:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 Processor -- start 2024-05-30T16:57:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 -- start start 2024-05-30T16:57:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f189009af80 0x7f18900c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18900d05b0 0x7f18900c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900d14c0 0x7f18900c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f189006e100 con 0x7f18900d05b0 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f18900d0a30 con 0x7f18900d14c0 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1896600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f189006e280 con 0x7f189009af80 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1886a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18900d05b0 0x7f18900c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1886a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18900d05b0 0x7f18900c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59070/0 (socket says 172.21.15.59:59070) 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1886a00640 1 -- 172.21.15.59:0/666846288 learned_addr learned my addr 172.21.15.59:0/666846288 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f188f400640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f189009af80 0x7f18900c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f188fe00640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900d14c0 0x7f18900c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1886a00640 1 -- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f189009af80 msgr2=0x7f18900c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1886a00640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f189009af80 0x7f18900c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1886a00640 1 -- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900d14c0 msgr2=0x7f18900c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1886a00640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900d14c0 0x7f18900c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.030+0000 7f1886a00640 1 -- 172.21.15.59:0/666846288 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18900b6790 con 0x7f18900d05b0 2024-05-30T16:57:21.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.034+0000 7f1886a00640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18900d05b0 0x7f18900c67f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f18780097c0 tx=0x7f187801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:21.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.034+0000 7f1887e00640 1 -- 172.21.15.59:0/666846288 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18780b0050 con 0x7f18900d05b0 2024-05-30T16:57:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.034+0000 7f1887e00640 1 -- 172.21.15.59:0/666846288 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18780bc070 con 0x7f18900d05b0 2024-05-30T16:57:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.034+0000 7f1896600640 1 -- 172.21.15.59:0/666846288 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18900c87a0 con 0x7f18900d05b0 2024-05-30T16:57:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.034+0000 7f1887e00640 1 -- 172.21.15.59:0/666846288 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18780b5830 con 0x7f18900d05b0 2024-05-30T16:57:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.034+0000 7f1896600640 1 -- 172.21.15.59:0/666846288 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18900c8d20 con 0x7f18900d05b0 2024-05-30T16:57:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.034+0000 7f1896600640 1 -- 172.21.15.59:0/666846288 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18900c65e0 con 0x7f18900d05b0 2024-05-30T16:57:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.034+0000 7f1887e00640 1 -- 172.21.15.59:0/666846288 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) ==== 89262+0+0 (secure 0 0 0) 0x7f18780b59d0 con 0x7f18900d05b0 2024-05-30T16:57:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.034+0000 7f1887e00640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f186c0691c0 0x7f186c06b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.034+0000 7f1887e00640 1 -- 172.21.15.59:0/666846288 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f187811fbe0 con 0x7f18900d05b0 2024-05-30T16:57:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.034+0000 7f188f400640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f186c0691c0 0x7f186c06b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.038+0000 7f188f400640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f186c0691c0 0x7f186c06b680 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1880009240 tx=0x7f188000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.038+0000 7f1887e00640 1 -- 172.21.15.59:0/666846288 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f18900b6790 con 0x7f18900d05b0 2024-05-30T16:57:21.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.230+0000 7f1896600640 1 -- 172.21.15.59:0/666846288 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f18900d2270 con 0x7f186c0691c0 2024-05-30T16:57:21.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.234+0000 7f1887e00640 1 -- 172.21.15.59:0/666846288 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f18900d2270 con 0x7f186c0691c0 2024-05-30T16:57:21.235 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/c4e43638-0dce-488c-8596-73de11286b1f 2024-05-30T16:57:21.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.238+0000 7f1896600640 1 -- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f186c0691c0 msgr2=0x7f186c06b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:21.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.238+0000 7f1896600640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f186c0691c0 0x7f186c06b680 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1880009240 tx=0x7f188000b040 comp rx=0 tx=0).stop 2024-05-30T16:57:21.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.238+0000 7f1896600640 1 -- 172.21.15.59:0/666846288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18900d05b0 msgr2=0x7f18900c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:21.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.238+0000 7f1896600640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18900d05b0 0x7f18900c67f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f18780097c0 tx=0x7f187801ace0 comp rx=0 tx=0).stop 2024-05-30T16:57:21.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.238+0000 7f1896600640 1 -- 172.21.15.59:0/666846288 shutdown_connections 2024-05-30T16:57:21.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.238+0000 7f1896600640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f186c0691c0 0x7f186c06b680 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:21.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.238+0000 7f1896600640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900d14c0 0x7f18900c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:21.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.238+0000 7f1896600640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18900d05b0 0x7f18900c67f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:21.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.238+0000 7f1896600640 1 --2- 172.21.15.59:0/666846288 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f189009af80 0x7f18900c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:21.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.238+0000 7f1896600640 1 -- 172.21.15.59:0/666846288 >> 172.21.15.59:0/666846288 conn(0x7f18900b3f80 msgr2=0x7f189006ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:21.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.238+0000 7f1896600640 1 -- 172.21.15.59:0/666846288 shutdown_connections 2024-05-30T16:57:21.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:21.238+0000 7f1896600640 1 -- 172.21.15.59:0/666846288 wait complete. 2024-05-30T16:57:21.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:57:21.256 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/c4e43638-0dce-488c-8596-73de11286b1f 2024-05-30T16:57:21.256 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T16:57:21.270 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/c4e43638-0dce-488c-8596-73de11286b1f 2024-05-30T16:57:21.270 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3138256896" 2024-05-30T16:57:21.270 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:57:21.271 INFO:tasks.cephfs.test_volumes:r_size = 3138256896 exp_size = 3221225472 2024-05-30T16:57:23.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:57:23.272 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/c4e43638-0dce-488c-8596-73de11286b1f 2024-05-30T16:57:23.272 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T16:57:23.287 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/c4e43638-0dce-488c-8596-73de11286b1f 2024-05-30T16:57:23.287 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3138256896" 2024-05-30T16:57:23.287 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:57:23.288 INFO:tasks.cephfs.test_volumes:r_size = 3138256896 exp_size = 3221225472 2024-05-30T16:57:25.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:57:25.289 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/c4e43638-0dce-488c-8596-73de11286b1f 2024-05-30T16:57:25.289 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T16:57:25.305 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/c4e43638-0dce-488c-8596-73de11286b1f 2024-05-30T16:57:25.305 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T16:57:25.305 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:57:25.306 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T16:57:25.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69881 2024-05-30T16:57:25.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdb4a00640 1 Processor -- start 2024-05-30T16:57:25.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdb4a00640 1 -- start start 2024-05-30T16:57:25.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdb4a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efdb01569e0 0x7efdb015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:25.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdb4a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb00ad2b0 0x7efdb00cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdb4a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb00ad770 con 0x7efdb00d0660 2024-05-30T16:57:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdb4a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7efdb015cb40 con 0x7efdb01569e0 2024-05-30T16:57:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdb4a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efdb015ce20 con 0x7efdb00ad2b0 2024-05-30T16:57:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdad400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb00ad2b0 0x7efdb00cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdade00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efdb01569e0 0x7efdb015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdae800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7efdb00d0660 0x7efdb00b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:52878/0 (socket says 172.21.15.59:52878) 2024-05-30T16:57:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdae800640 1 -- 172.21.15.59:0/2268919999 learned_addr learned my addr 172.21.15.59:0/2268919999 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdad400640 1 --2- 172.21.15.59:0/2268919999 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb00ad2b0 0x7efdb00cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:57198/0 (socket says 172.21.15.59:57198) 2024-05-30T16:57:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdad400640 1 -- 172.21.15.59:0/2268919999 >> v2:172.21.15.107:3300/0 conn(0x7efdb01569e0 msgr2=0x7efdb015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdad400640 1 --2- 172.21.15.59:0/2268919999 >> v2:172.21.15.107:3300/0 conn(0x7efdb01569e0 0x7efdb015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdad400640 1 -- 172.21.15.59:0/2268919999 >> v1:172.21.15.107:6789/0 conn(0x7efdb00d0660 legacy=0x7efdb00b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.506+0000 7efdad400640 1 -- 172.21.15.59:0/2268919999 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb015d100 con 0x7efdb00ad2b0 2024-05-30T16:57:25.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.510+0000 7efdad400640 1 --2- 172.21.15.59:0/2268919999 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb00ad2b0 0x7efdb00cf9f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0097c0 tx=0x7efd9c01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b606291344cfa20a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.510+0000 7efdaca00640 1 -- 172.21.15.59:0/2268919999 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0b0070 con 0x7efdb00ad2b0 2024-05-30T16:57:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.510+0000 7efdaca00640 1 -- 172.21.15.59:0/2268919999 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd9c0ab400 con 0x7efdb00ad2b0 2024-05-30T16:57:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.510+0000 7efdaca00640 1 -- 172.21.15.59:0/2268919999 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0ab7d0 con 0x7efdb00ad2b0 2024-05-30T16:57:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.510+0000 7efdb4a00640 1 -- 172.21.15.59:0/2268919999 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb00ad2b0 msgr2=0x7efdb00cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.510+0000 7efdb4a00640 1 --2- 172.21.15.59:0/2268919999 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb00ad2b0 0x7efdb00cf9f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0097c0 tx=0x7efd9c01c380 comp rx=0 tx=0).stop 2024-05-30T16:57:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.510+0000 7efdb4a00640 1 -- 172.21.15.59:0/2268919999 shutdown_connections 2024-05-30T16:57:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.510+0000 7efdb4a00640 1 --2- 172.21.15.59:0/2268919999 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb00ad2b0 0x7efdb00cf9f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.510+0000 7efdb4a00640 1 --2- 172.21.15.59:0/2268919999 >> v2:172.21.15.107:3300/0 conn(0x7efdb01569e0 0x7efdb015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.510+0000 7efdb4a00640 1 -- 172.21.15.59:0/2268919999 >> 172.21.15.59:0/2268919999 conn(0x7efdb006bdb0 msgr2=0x7efdb006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.510+0000 7efdb4a00640 1 -- 172.21.15.59:0/2268919999 shutdown_connections 2024-05-30T16:57:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.510+0000 7efdb4a00640 1 -- 172.21.15.59:0/2268919999 wait complete. 2024-05-30T16:57:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdb4a00640 1 Processor -- start 2024-05-30T16:57:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdb4a00640 1 -- start start 2024-05-30T16:57:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdb4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb00ad2b0 0x7efdb015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdb4a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00d0660 0x7efdb00b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdb4a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb01569e0 0x7efdb009c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdb4a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efdb00d00b0 con 0x7efdb00ad2b0 2024-05-30T16:57:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdb4a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efdb00cff30 con 0x7efdb00d0660 2024-05-30T16:57:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdb4a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efdb01671a0 con 0x7efdb01569e0 2024-05-30T16:57:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdade00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb00ad2b0 0x7efdb015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdade00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb00ad2b0 0x7efdb015baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44310/0 (socket says 172.21.15.59:44310) 2024-05-30T16:57:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdade00640 1 -- 172.21.15.59:0/1314976186 learned_addr learned my addr 172.21.15.59:0/1314976186 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdad400640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00d0660 0x7efdb00b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdae800640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb01569e0 0x7efdb009c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdade00640 1 -- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb01569e0 msgr2=0x7efdb009c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdade00640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb01569e0 0x7efdb009c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdade00640 1 -- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00d0660 msgr2=0x7efdb00b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdade00640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00d0660 0x7efdb00b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdade00640 1 -- 172.21.15.59:0/1314976186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb009a3c0 con 0x7efdb00ad2b0 2024-05-30T16:57:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdad400640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00d0660 0x7efdb00b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:57:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdade00640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb00ad2b0 0x7efdb015baf0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7efda0012b00 tx=0x7efda00100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efda6000640 1 -- 172.21.15.59:0/1314976186 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda0010af0 con 0x7efdb00ad2b0 2024-05-30T16:57:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efda6000640 1 -- 172.21.15.59:0/1314976186 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda001d070 con 0x7efdb00ad2b0 2024-05-30T16:57:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdb4a00640 1 -- 172.21.15.59:0/1314976186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb00b2180 con 0x7efdb00ad2b0 2024-05-30T16:57:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efda6000640 1 -- 172.21.15.59:0/1314976186 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda0010e90 con 0x7efdb00ad2b0 2024-05-30T16:57:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdb4a00640 1 -- 172.21.15.59:0/1314976186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb00b2740 con 0x7efdb00ad2b0 2024-05-30T16:57:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.514+0000 7efdb4a00640 1 -- 172.21.15.59:0/1314976186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb0068a90 con 0x7efdb00ad2b0 2024-05-30T16:57:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.518+0000 7efda6000640 1 -- 172.21.15.59:0/1314976186 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) ==== 89262+0+0 (secure 0 0 0) 0x7efda0016050 con 0x7efdb00ad2b0 2024-05-30T16:57:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.518+0000 7efda6000640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd90069360 0x7efd9006b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.518+0000 7efda6000640 1 -- 172.21.15.59:0/1314976186 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7efda0089440 con 0x7efdb00ad2b0 2024-05-30T16:57:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.518+0000 7efdad400640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd90069360 0x7efd9006b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.518+0000 7efdad400640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd90069360 0x7efd9006b820 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0ad000 tx=0x7efd9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:25.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.522+0000 7efda6000640 1 -- 172.21.15.59:0/1314976186 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efda0026020 con 0x7efdb00ad2b0 2024-05-30T16:57:25.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.722+0000 7efdb4a00640 1 -- 172.21.15.59:0/1314976186 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69881", "target": ["mon-mgr", ""]}) -- 0x7efdb006c630 con 0x7efd90069360 2024-05-30T16:57:25.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efda6000640 1 -- 172.21.15.59:0/1314976186 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efdb006c630 con 0x7efd90069360 2024-05-30T16:57:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efdb4a00640 1 -- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd90069360 msgr2=0x7efd9006b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efdb4a00640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd90069360 0x7efd9006b820 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0ad000 tx=0x7efd9c008040 comp rx=0 tx=0).stop 2024-05-30T16:57:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efdb4a00640 1 -- 172.21.15.59:0/1314976186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb00ad2b0 msgr2=0x7efdb015baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efdb4a00640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb00ad2b0 0x7efdb015baf0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7efda0012b00 tx=0x7efda00100c0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efdb4a00640 1 -- 172.21.15.59:0/1314976186 shutdown_connections 2024-05-30T16:57:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efdb4a00640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd90069360 0x7efd9006b820 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efdb4a00640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb01569e0 0x7efdb009c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efdb4a00640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00d0660 0x7efdb00b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efdb4a00640 1 --2- 172.21.15.59:0/1314976186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb00ad2b0 0x7efdb015baf0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efdb4a00640 1 -- 172.21.15.59:0/1314976186 >> 172.21.15.59:0/1314976186 conn(0x7efdb006bdb0 msgr2=0x7efdb0071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:25.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efdb4a00640 1 -- 172.21.15.59:0/1314976186 shutdown_connections 2024-05-30T16:57:25.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.782+0000 7efdb4a00640 1 -- 172.21.15.59:0/1314976186 wait complete. 2024-05-30T16:57:25.784 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:25.783+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:25.784 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:25.783+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:25.784 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:25.783+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:25.784 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:25.783+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:25.784 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:25.783+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:25.800 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:25.799+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:25.800 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:25.799+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:25.800 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:25.799+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:25.800 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:25.799+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:25.800 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:25.799+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:25.803 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69882 2024-05-30T16:57:25.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.950+0000 7f2ba8400640 1 Processor -- start 2024-05-30T16:57:25.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.950+0000 7f2ba8400640 1 -- start start 2024-05-30T16:57:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba8400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba00ad2b0 0x7f2ba015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba8400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba00d0660 0x7f2ba00d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba8400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ba00ad770 con 0x7f2ba01569e0 2024-05-30T16:57:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba8400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f2ba00d1010 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba8400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba015cb40 con 0x7f2ba00d0660 2024-05-30T16:57:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba5000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba00ad2b0 0x7f2ba015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba5a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2ba01569e0 0x7f2ba00cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33990/0 (socket says 172.21.15.59:33990) 2024-05-30T16:57:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba5000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba00ad2b0 0x7f2ba015d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44320/0 (socket says 172.21.15.59:44320) 2024-05-30T16:57:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba5a00640 1 -- 172.21.15.59:0/4234231528 learned_addr learned my addr 172.21.15.59:0/4234231528 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba6400640 1 --2- 172.21.15.59:0/4234231528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba00d0660 0x7f2ba00d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba5000640 1 -- 172.21.15.59:0/4234231528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba00d0660 msgr2=0x7f2ba00d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba5000640 1 --2- 172.21.15.59:0/4234231528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba00d0660 0x7f2ba00d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba5000640 1 -- 172.21.15.59:0/4234231528 >> v1:172.21.15.59:6789/0 conn(0x7f2ba01569e0 legacy=0x7f2ba00cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba5000640 1 -- 172.21.15.59:0/4234231528 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba015ce20 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.954+0000 7f2ba6400640 1 --2- 172.21.15.59:0/4234231528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba00d0660 0x7f2ba00d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:57:25.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba5000640 1 --2- 172.21.15.59:0/4234231528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba00ad2b0 0x7f2ba015d620 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0097c0 tx=0x7f2b8c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c742ddc6d0d40bc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:25.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2b9fe00640 1 -- 172.21.15.59:0/4234231528 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0b0070 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2b9fe00640 1 -- 172.21.15.59:0/4234231528 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0ab600 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2b9fe00640 1 -- 172.21.15.59:0/4234231528 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0ab9d0 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 -- 172.21.15.59:0/4234231528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba00ad2b0 msgr2=0x7f2ba015d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 --2- 172.21.15.59:0/4234231528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba00ad2b0 0x7f2ba015d620 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0097c0 tx=0x7f2b8c01c410 comp rx=0 tx=0).stop 2024-05-30T16:57:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 -- 172.21.15.59:0/4234231528 shutdown_connections 2024-05-30T16:57:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 --2- 172.21.15.59:0/4234231528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba00d0660 0x7f2ba00d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 --2- 172.21.15.59:0/4234231528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba00ad2b0 0x7f2ba015d620 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 -- 172.21.15.59:0/4234231528 >> 172.21.15.59:0/4234231528 conn(0x7f2ba006bdb0 msgr2=0x7f2ba006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:25.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 -- 172.21.15.59:0/4234231528 shutdown_connections 2024-05-30T16:57:25.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 -- 172.21.15.59:0/4234231528 wait complete. 2024-05-30T16:57:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 Processor -- start 2024-05-30T16:57:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 -- start start 2024-05-30T16:57:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba00ad2b0 0x7f2ba0151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba00d0660 0x7f2ba00999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba01569e0 0x7f2ba01503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba00b3c60 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba00b3ae0 con 0x7f2ba00d0660 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.958+0000 7f2ba8400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba00b3de0 con 0x7f2ba01569e0 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba5a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba00ad2b0 0x7f2ba0151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba5a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba00ad2b0 0x7f2ba0151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44322/0 (socket says 172.21.15.59:44322) 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba5a00640 1 -- 172.21.15.59:0/3497666801 learned_addr learned my addr 172.21.15.59:0/3497666801 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba5000640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba00d0660 0x7f2ba00999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba6400640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba01569e0 0x7f2ba01503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba5a00640 1 -- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba01569e0 msgr2=0x7f2ba01503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba5a00640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba01569e0 0x7f2ba01503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba5a00640 1 -- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba00d0660 msgr2=0x7f2ba00999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba5a00640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba00d0660 0x7f2ba00999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba5a00640 1 -- 172.21.15.59:0/3497666801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba0155ff0 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba5a00640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba00ad2b0 0x7f2ba0151eb0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c420 tx=0x7f2b9400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2b9d600640 1 -- 172.21.15.59:0/3497666801 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94017070 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2b9d600640 1 -- 172.21.15.59:0/3497666801 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b94005cf0 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba8400640 1 -- 172.21.15.59:0/3497666801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba00b0f60 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2b9d600640 1 -- 172.21.15.59:0/3497666801 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b940072f0 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba8400640 1 -- 172.21.15.59:0/3497666801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba006e150 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2ba8400640 1 -- 172.21.15.59:0/3497666801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba0148ef0 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.962+0000 7f2b9d600640 1 -- 172.21.15.59:0/3497666801 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) ==== 89262+0+0 (secure 0 0 0) 0x7f2b9401a070 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.966+0000 7f2b9d600640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b800691c0 0x7f2b8006b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.966+0000 7f2b9d600640 1 -- 172.21.15.59:0/3497666801 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f2b94084a30 con 0x7f2ba00ad2b0 2024-05-30T16:57:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.966+0000 7f2ba5000640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b800691c0 0x7f2b8006b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.966+0000 7f2ba5000640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b800691c0 0x7f2b8006b680 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ad000 tx=0x7f2b8c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:25.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:25.970+0000 7f2b9d600640 1 -- 172.21.15.59:0/3497666801 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2b94056130 con 0x7f2ba00ad2b0 2024-05-30T16:57:26.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.162+0000 7f2ba8400640 1 -- 172.21.15.59:0/3497666801 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69882", "target": ["mon-mgr", ""]}) -- 0x7f2ba0155da0 con 0x7f2b800691c0 2024-05-30T16:57:26.786 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:26.783+0000 7efd29800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:26.786 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:26.783+0000 7efd29800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:26.786 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:26.783+0000 7efd29800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:26.786 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:26.783+0000 7efd29800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:26.786 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:26.783+0000 7efd29800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:26.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.874+0000 7f2b9d600640 1 -- 172.21.15.59:0/3497666801 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2ba0155da0 con 0x7f2b800691c0 2024-05-30T16:57:26.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.878+0000 7f2ba8400640 1 -- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b800691c0 msgr2=0x7f2b8006b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:26.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.878+0000 7f2ba8400640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b800691c0 0x7f2b8006b680 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ad000 tx=0x7f2b8c008040 comp rx=0 tx=0).stop 2024-05-30T16:57:26.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.878+0000 7f2ba8400640 1 -- 172.21.15.59:0/3497666801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba00ad2b0 msgr2=0x7f2ba0151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.878+0000 7f2ba8400640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba00ad2b0 0x7f2ba0151eb0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c420 tx=0x7f2b9400c8e0 comp rx=0 tx=0).stop 2024-05-30T16:57:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.878+0000 7f2ba8400640 1 -- 172.21.15.59:0/3497666801 shutdown_connections 2024-05-30T16:57:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.878+0000 7f2ba8400640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b800691c0 0x7f2b8006b680 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.878+0000 7f2ba8400640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba01569e0 0x7f2ba01503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.878+0000 7f2ba8400640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba00d0660 0x7f2ba00999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.878+0000 7f2ba8400640 1 --2- 172.21.15.59:0/3497666801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba00ad2b0 0x7f2ba0151eb0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:26.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.878+0000 7f2ba8400640 1 -- 172.21.15.59:0/3497666801 >> 172.21.15.59:0/3497666801 conn(0x7f2ba006bdb0 msgr2=0x7f2ba00cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:26.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.878+0000 7f2ba8400640 1 -- 172.21.15.59:0/3497666801 shutdown_connections 2024-05-30T16:57:26.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:26.878+0000 7f2ba8400640 1 -- 172.21.15.59:0/3497666801 wait complete. 2024-05-30T16:57:26.896 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:26.895+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:26.896 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:26.895+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:26.896 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:26.895+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:26.896 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:26.895+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:26.896 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:26.895+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:26.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69883 2024-05-30T16:57:27.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.142+0000 7fe747600640 1 Processor -- start 2024-05-30T16:57:27.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.142+0000 7fe747600640 1 -- start start 2024-05-30T16:57:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe747600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe74015e7a0 0x7fe7400ae310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe747600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe7400ca6b0 0x7fe7400caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe747600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7400b3f50 con 0x7fe7400d08b0 2024-05-30T16:57:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe747600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe7400b3740 con 0x7fe74015e7a0 2024-05-30T16:57:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe747600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe7400cb000 con 0x7fe7400ca6b0 2024-05-30T16:57:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe744c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe74015e7a0 0x7fe7400ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe73fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe7400d08b0 0x7fe7400b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34000/0 (socket says 172.21.15.59:34000) 2024-05-30T16:57:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe73fe00640 1 -- 172.21.15.59:0/2413703982 learned_addr learned my addr 172.21.15.59:0/2413703982 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:27.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe73f400640 1 -- 172.21.15.59:0/2413703982 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 175723343 0 0) 0x7fe7400b3f50 con 0x7fe7400d08b0 2024-05-30T16:57:27.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe73f400640 1 -- 172.21.15.59:0/2413703982 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe728003530 con 0x7fe7400d08b0 2024-05-30T16:57:27.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe745600640 1 --2- 172.21.15.59:0/2413703982 >> v2:172.21.15.107:3300/0 conn(0x7fe7400ca6b0 0x7fe7400caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:27.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe744c00640 1 -- 172.21.15.59:0/2413703982 >> v2:172.21.15.107:3300/0 conn(0x7fe7400ca6b0 msgr2=0x7fe7400caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:27.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe744c00640 1 --2- 172.21.15.59:0/2413703982 >> v2:172.21.15.107:3300/0 conn(0x7fe7400ca6b0 0x7fe7400caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:27.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe744c00640 1 -- 172.21.15.59:0/2413703982 >> v1:172.21.15.59:6789/0 conn(0x7fe7400d08b0 legacy=0x7fe7400b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:27.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.150+0000 7fe744c00640 1 -- 172.21.15.59:0/2413703982 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7400cf040 con 0x7fe74015e7a0 2024-05-30T16:57:27.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.154+0000 7fe744c00640 1 --2- 172.21.15.59:0/2413703982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe74015e7a0 0x7fe7400ae310 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe74006e880 tx=0x7fe72c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab296491a8a7e91 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:27.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.158+0000 7fe73f400640 1 -- 172.21.15.59:0/2413703982 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0ab680 con 0x7fe74015e7a0 2024-05-30T16:57:27.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.158+0000 7fe73f400640 1 -- 172.21.15.59:0/2413703982 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72c0b0070 con 0x7fe74015e7a0 2024-05-30T16:57:27.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.158+0000 7fe73f400640 1 -- 172.21.15.59:0/2413703982 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0aba20 con 0x7fe74015e7a0 2024-05-30T16:57:27.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.158+0000 7fe747600640 1 -- 172.21.15.59:0/2413703982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe74015e7a0 msgr2=0x7fe7400ae310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:27.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.158+0000 7fe747600640 1 --2- 172.21.15.59:0/2413703982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe74015e7a0 0x7fe7400ae310 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe74006e880 tx=0x7fe72c01c480 comp rx=0 tx=0).stop 2024-05-30T16:57:27.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.158+0000 7fe747600640 1 -- 172.21.15.59:0/2413703982 shutdown_connections 2024-05-30T16:57:27.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.158+0000 7fe747600640 1 --2- 172.21.15.59:0/2413703982 >> v2:172.21.15.107:3300/0 conn(0x7fe7400ca6b0 0x7fe7400caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:27.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.158+0000 7fe747600640 1 --2- 172.21.15.59:0/2413703982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe74015e7a0 0x7fe7400ae310 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:27.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.158+0000 7fe747600640 1 -- 172.21.15.59:0/2413703982 >> 172.21.15.59:0/2413703982 conn(0x7fe74009aa40 msgr2=0x7fe7400b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:27.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.158+0000 7fe747600640 1 -- 172.21.15.59:0/2413703982 shutdown_connections 2024-05-30T16:57:27.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.158+0000 7fe747600640 1 -- 172.21.15.59:0/2413703982 wait complete. 2024-05-30T16:57:27.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.162+0000 7fe747600640 1 Processor -- start 2024-05-30T16:57:27.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.162+0000 7fe747600640 1 -- start start 2024-05-30T16:57:27.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.162+0000 7fe747600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7400ca6b0 0x7fe7400b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:27.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.162+0000 7fe747600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7400d08b0 0x7fe7400b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:27.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.162+0000 7fe747600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe74015e7a0 0x7fe74014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:27.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.162+0000 7fe747600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe74015ed00 con 0x7fe74015e7a0 2024-05-30T16:57:27.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.162+0000 7fe747600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe74015eb80 con 0x7fe7400ca6b0 2024-05-30T16:57:27.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.162+0000 7fe747600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe7400d0010 con 0x7fe7400d08b0 2024-05-30T16:57:27.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe745600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe74015e7a0 0x7fe74014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:27.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe745600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe74015e7a0 0x7fe74014dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44354/0 (socket says 172.21.15.59:44354) 2024-05-30T16:57:27.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe745600640 1 -- 172.21.15.59:0/1203562823 learned_addr learned my addr 172.21.15.59:0/1203562823 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:27.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe745600640 1 -- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7400d08b0 msgr2=0x7fe7400b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:27.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe745600640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7400d08b0 0x7fe7400b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:27.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe744c00640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7400ca6b0 0x7fe7400b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:27.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe745600640 1 -- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7400ca6b0 msgr2=0x7fe7400b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:27.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe745600640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7400ca6b0 0x7fe7400b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:27.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe745600640 1 -- 172.21.15.59:0/1203562823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7400b5ce0 con 0x7fe74015e7a0 2024-05-30T16:57:27.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe744c00640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7400ca6b0 0x7fe7400b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:57:27.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe745600640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe74015e7a0 0x7fe74014dec0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe738007e40 tx=0x7fe73800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:27.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe73cc00640 1 -- 172.21.15.59:0/1203562823 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738014620 con 0x7fe74015e7a0 2024-05-30T16:57:27.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe73cc00640 1 -- 172.21.15.59:0/1203562823 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe738019070 con 0x7fe74015e7a0 2024-05-30T16:57:27.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe73cc00640 1 -- 172.21.15.59:0/1203562823 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738014a20 con 0x7fe74015e7a0 2024-05-30T16:57:27.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe747600640 1 -- 172.21.15.59:0/1203562823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7400b4700 con 0x7fe74015e7a0 2024-05-30T16:57:27.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe747600640 1 -- 172.21.15.59:0/1203562823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7400b4fa0 con 0x7fe74015e7a0 2024-05-30T16:57:27.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.166+0000 7fe747600640 1 -- 172.21.15.59:0/1203562823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7400691a0 con 0x7fe74015e7a0 2024-05-30T16:57:27.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.170+0000 7fe73cc00640 1 -- 172.21.15.59:0/1203562823 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) ==== 89262+0+0 (secure 0 0 0) 0x7fe738014bc0 con 0x7fe74015e7a0 2024-05-30T16:57:27.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.170+0000 7fe73cc00640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe720069190 0x7fe72006b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:27.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.170+0000 7fe73cc00640 1 -- 172.21.15.59:0/1203562823 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7fe738085fc0 con 0x7fe74015e7a0 2024-05-30T16:57:27.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.178+0000 7fe744c00640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe720069190 0x7fe72006b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:27.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.178+0000 7fe73cc00640 1 -- 172.21.15.59:0/1203562823 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe73808c030 con 0x7fe74015e7a0 2024-05-30T16:57:27.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.190+0000 7fe744c00640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe720069190 0x7fe72006b650 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0af000 tx=0x7fe72c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:27.510+0000 7fe747600640 1 -- 172.21.15.59:0/1203562823 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69883", "target": ["mon-mgr", ""]}) -- 0x7fe7400b33b0 con 0x7fe720069190 2024-05-30T16:57:28.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.046+0000 7fe73cc00640 1 -- 172.21.15.59:0/1203562823 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 23) ==== 89466+0+0 (secure 0 0 0) 0x7fe738053ce0 con 0x7fe74015e7a0 2024-05-30T16:57:28.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe73cc00640 1 -- 172.21.15.59:0/1203562823 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe7400b33b0 con 0x7fe720069190 2024-05-30T16:57:28.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe747600640 1 -- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe720069190 msgr2=0x7fe72006b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe747600640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe720069190 0x7fe72006b650 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0af000 tx=0x7fe72c0a7000 comp rx=0 tx=0).stop 2024-05-30T16:57:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe747600640 1 -- 172.21.15.59:0/1203562823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe74015e7a0 msgr2=0x7fe74014dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe747600640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe74015e7a0 0x7fe74014dec0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe738007e40 tx=0x7fe73800e4b0 comp rx=0 tx=0).stop 2024-05-30T16:57:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe747600640 1 -- 172.21.15.59:0/1203562823 shutdown_connections 2024-05-30T16:57:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe747600640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe720069190 0x7fe72006b650 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe747600640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe74015e7a0 0x7fe74014dec0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe747600640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7400d08b0 0x7fe7400b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe747600640 1 --2- 172.21.15.59:0/1203562823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7400ca6b0 0x7fe7400b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe747600640 1 -- 172.21.15.59:0/1203562823 >> 172.21.15.59:0/1203562823 conn(0x7fe74009aa40 msgr2=0x7fe740070870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe747600640 1 -- 172.21.15.59:0/1203562823 shutdown_connections 2024-05-30T16:57:28.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.126+0000 7fe747600640 1 -- 172.21.15.59:0/1203562823 wait complete. 2024-05-30T16:57:28.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69884 2024-05-30T16:57:28.191 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:28.187+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:28.191 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:28.187+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:28.192 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:28.187+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:28.192 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:28.187+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:28.192 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:57:28.187+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:57:28.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.358+0000 7f7912a00640 1 Processor -- start 2024-05-30T16:57:28.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.358+0000 7f7912a00640 1 -- start start 2024-05-30T16:57:28.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.362+0000 7f7912a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f790c0b4f90 0x7f790c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:28.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.362+0000 7f7912a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790c0b32d0 con 0x7f790c0723a0 2024-05-30T16:57:28.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.362+0000 7f7912a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790c15f490 con 0x7f790c0b3ff0 2024-05-30T16:57:28.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.362+0000 7f7912a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f790c15f770 con 0x7f790c0b4f90 2024-05-30T16:57:28.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.362+0000 7f790b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f790c0b4f90 0x7f790c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:28.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.362+0000 7f790be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f790c0723a0 0x7f790c15ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34006/0 (socket says 172.21.15.59:34006) 2024-05-30T16:57:28.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.362+0000 7f790be00640 1 -- 172.21.15.59:0/1470950238 learned_addr learned my addr 172.21.15.59:0/1470950238 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:28.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.362+0000 7f790b400640 1 -- 172.21.15.59:0/1470950238 >> v1:172.21.15.107:6789/0 conn(0x7f790c0b3ff0 legacy=0x7f790c06dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:28.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.362+0000 7f790b400640 1 -- 172.21.15.59:0/1470950238 >> v1:172.21.15.59:6789/0 conn(0x7f790c0723a0 legacy=0x7f790c15ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:28.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.362+0000 7f790b400640 1 -- 172.21.15.59:0/1470950238 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c15fa50 con 0x7f790c0b4f90 2024-05-30T16:57:28.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.370+0000 7f790b400640 1 --2- 172.21.15.59:0/1470950238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f790c0b4f90 0x7f790c0b3ab0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f78f80097c0 tx=0x7f78f801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0a5060f821467 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:28.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.374+0000 7f790aa00640 1 -- 172.21.15.59:0/1470950238 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f80b0070 con 0x7f790c0b4f90 2024-05-30T16:57:28.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.374+0000 7f790aa00640 1 -- 172.21.15.59:0/1470950238 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790c072990 con 0x7f790c0b4f90 2024-05-30T16:57:28.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.374+0000 7f790aa00640 1 -- 172.21.15.59:0/1470950238 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f80ab820 con 0x7f790c0b4f90 2024-05-30T16:57:28.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.374+0000 7f7912a00640 1 -- 172.21.15.59:0/1470950238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f790c0b4f90 msgr2=0x7f790c0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:28.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.374+0000 7f7912a00640 1 --2- 172.21.15.59:0/1470950238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f790c0b4f90 0x7f790c0b3ab0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f78f80097c0 tx=0x7f78f801c460 comp rx=0 tx=0).stop 2024-05-30T16:57:28.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.374+0000 7f7912a00640 1 -- 172.21.15.59:0/1470950238 shutdown_connections 2024-05-30T16:57:28.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.374+0000 7f7912a00640 1 --2- 172.21.15.59:0/1470950238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f790c0b4f90 0x7f790c0b3ab0 secure :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f78f80097c0 tx=0x7f78f801c460 comp rx=0 tx=0).stop 2024-05-30T16:57:28.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.374+0000 7f7912a00640 1 -- 172.21.15.59:0/1470950238 >> 172.21.15.59:0/1470950238 conn(0x7f790c06bdb0 msgr2=0x7f790c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:28.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.378+0000 7f7912a00640 1 -- 172.21.15.59:0/1470950238 shutdown_connections 2024-05-30T16:57:28.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.378+0000 7f7912a00640 1 -- 172.21.15.59:0/1470950238 wait complete. 2024-05-30T16:57:28.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.378+0000 7f7912a00640 1 Processor -- start 2024-05-30T16:57:28.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.378+0000 7f7912a00640 1 -- start start 2024-05-30T16:57:28.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f7912a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f790c0723a0 0x7f790c207f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f7912a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f790c0b3ff0 0x7f790c203900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f7912a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f790c0b0ec0 0x7f790c1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f7912a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f790c06e510 con 0x7f790c0b3ff0 2024-05-30T16:57:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f7912a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f790c06e390 con 0x7f790c0723a0 2024-05-30T16:57:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f7912a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f790c154e60 con 0x7f790c0b0ec0 2024-05-30T16:57:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f790b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f790c0b3ff0 0x7f790c203900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f790b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f790c0b3ff0 0x7f790c203900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44380/0 (socket says 172.21.15.59:44380) 2024-05-30T16:57:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f790b400640 1 -- 172.21.15.59:0/2684429383 learned_addr learned my addr 172.21.15.59:0/2684429383 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:28.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f790b400640 1 -- 172.21.15.59:0/2684429383 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f790c0b0ec0 msgr2=0x7f790c1573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:28.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f790b400640 1 --2- 172.21.15.59:0/2684429383 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f790c0b0ec0 0x7f790c1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:28.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f790b400640 1 -- 172.21.15.59:0/2684429383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f790c0723a0 msgr2=0x7f790c207f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:28.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f790b400640 1 --2- 172.21.15.59:0/2684429383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f790c0723a0 0x7f790c207f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:28.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f790b400640 1 -- 172.21.15.59:0/2684429383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c0b1360 con 0x7f790c0b3ff0 2024-05-30T16:57:28.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.382+0000 7f790b400640 1 --2- 172.21.15.59:0/2684429383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f790c0b3ff0 0x7f790c203900 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f78f80ae040 tx=0x7f78f801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:28.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.386+0000 7f7903e00640 1 -- 172.21.15.59:0/2684429383 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f80bc070 con 0x7f790c0b3ff0 2024-05-30T16:57:28.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.386+0000 7f7912a00640 1 -- 172.21.15.59:0/2684429383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790c0b1640 con 0x7f790c0b3ff0 2024-05-30T16:57:28.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.386+0000 7f7903e00640 1 -- 172.21.15.59:0/2684429383 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f80b1040 con 0x7f790c0b3ff0 2024-05-30T16:57:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.386+0000 7f7903e00640 1 -- 172.21.15.59:0/2684429383 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f80b0050 con 0x7f790c0b3ff0 2024-05-30T16:57:28.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.386+0000 7f7912a00640 1 -- 172.21.15.59:0/2684429383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790c207a20 con 0x7f790c0b3ff0 2024-05-30T16:57:28.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.386+0000 7f7912a00640 1 -- 172.21.15.59:0/2684429383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790c207c20 con 0x7f790c0b3ff0 2024-05-30T16:57:28.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.390+0000 7f7903e00640 1 -- 172.21.15.59:0/2684429383 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 23) ==== 89466+0+0 (secure 0 0 0) 0x7f78f80bf070 con 0x7f790c0b3ff0 2024-05-30T16:57:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.390+0000 7f7903e00640 1 --2- 172.21.15.59:0/2684429383 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f78ec0693d0 0x7f78ec06b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.390+0000 7f7903e00640 1 -- 172.21.15.59:0/2684429383 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f78f811f7f0 con 0x7f790c0b3ff0 2024-05-30T16:57:28.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.394+0000 7f790be00640 1 --2- 172.21.15.59:0/2684429383 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f78ec0693d0 0x7f78ec06b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:28.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.394+0000 7f7903e00640 1 -- 172.21.15.59:0/2684429383 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f790c207c20 con 0x7f790c0b3ff0 2024-05-30T16:57:28.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.442+0000 7f790be00640 1 --2- 172.21.15.59:0/2684429383 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f78ec0693d0 0x7f78ec06b890 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f78fc001600 tx=0x7f78fc007a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:28.730+0000 7f7912a00640 1 -- 172.21.15.59:0/2684429383 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69884", "target": ["mon-mgr", ""]}) -- 0x7f790c072990 con 0x7f78ec0693d0 2024-05-30T16:57:29.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.514+0000 7f7903e00640 1 -- 172.21.15.59:0/2684429383 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f790c072990 con 0x7f78ec0693d0 2024-05-30T16:57:29.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.518+0000 7f7912a00640 1 -- 172.21.15.59:0/2684429383 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f78ec0693d0 msgr2=0x7f78ec06b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:29.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.518+0000 7f7912a00640 1 --2- 172.21.15.59:0/2684429383 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f78ec0693d0 0x7f78ec06b890 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f78fc001600 tx=0x7f78fc007a50 comp rx=0 tx=0).stop 2024-05-30T16:57:29.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.518+0000 7f7912a00640 1 -- 172.21.15.59:0/2684429383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f790c0b3ff0 msgr2=0x7f790c203900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:29.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.518+0000 7f7912a00640 1 --2- 172.21.15.59:0/2684429383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f790c0b3ff0 0x7f790c203900 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f78f80ae040 tx=0x7f78f801aca0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.518+0000 7f7912a00640 1 -- 172.21.15.59:0/2684429383 shutdown_connections 2024-05-30T16:57:29.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.518+0000 7f7912a00640 1 --2- 172.21.15.59:0/2684429383 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f78ec0693d0 0x7f78ec06b890 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.518+0000 7f7912a00640 1 --2- 172.21.15.59:0/2684429383 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f790c0b0ec0 0x7f790c1573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.518+0000 7f7912a00640 1 --2- 172.21.15.59:0/2684429383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f790c0b3ff0 0x7f790c203900 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.518+0000 7f7912a00640 1 --2- 172.21.15.59:0/2684429383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f790c0723a0 0x7f790c207f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.518+0000 7f7912a00640 1 -- 172.21.15.59:0/2684429383 >> 172.21.15.59:0/2684429383 conn(0x7f790c06bdb0 msgr2=0x7f790c074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:29.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.518+0000 7f7912a00640 1 -- 172.21.15.59:0/2684429383 shutdown_connections 2024-05-30T16:57:29.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.518+0000 7f7912a00640 1 -- 172.21.15.59:0/2684429383 wait complete. 2024-05-30T16:57:29.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69885 2024-05-30T16:57:29.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.754+0000 7f4ad1400640 1 Processor -- start 2024-05-30T16:57:29.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.754+0000 7f4ad1400640 1 -- start start 2024-05-30T16:57:29.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4ad1400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4acc1447c0 0x7f4acc0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:29.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4ad1400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4acc0b4a70 0x7f4acc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:29.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4ad1400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4acc0726e0 0x7f4acc072b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:29.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4ad1400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4acc0b39d0 con 0x7f4acc0726e0 2024-05-30T16:57:29.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4ad1400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4acc0b3cb0 con 0x7f4acc1447c0 2024-05-30T16:57:29.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4ad1400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4acc0b3f90 con 0x7f4acc0b4a70 2024-05-30T16:57:29.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4acb200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4acc0726e0 0x7f4acc072b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:29.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4acb200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4acc0726e0 0x7f4acc072b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44382/0 (socket says 172.21.15.59:44382) 2024-05-30T16:57:29.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4acb200640 1 -- 172.21.15.59:0/2121126048 learned_addr learned my addr 172.21.15.59:0/2121126048 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:29.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4ac3e00640 1 --2- 172.21.15.59:0/2121126048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4acc0b4a70 0x7f4acc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:29.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4acb200640 1 -- 172.21.15.59:0/2121126048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4acc0b4a70 msgr2=0x7f4acc06f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:29.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4acb200640 1 --2- 172.21.15.59:0/2121126048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4acc0b4a70 0x7f4acc06f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4acb200640 1 -- 172.21.15.59:0/2121126048 >> v2:172.21.15.107:3300/0 conn(0x7f4acc1447c0 msgr2=0x7f4acc0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:29.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4acb200640 1 --2- 172.21.15.59:0/2121126048 >> v2:172.21.15.107:3300/0 conn(0x7f4acc1447c0 0x7f4acc0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.758+0000 7f4acb200640 1 -- 172.21.15.59:0/2121126048 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4acc0b4270 con 0x7f4acc0726e0 2024-05-30T16:57:29.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.762+0000 7f4acb200640 1 --2- 172.21.15.59:0/2121126048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4acc0726e0 0x7f4acc072b70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0b6590 tx=0x7f4ac401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9696f3b2c65a35c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:29.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.762+0000 7f4ac9e00640 1 -- 172.21.15.59:0/2121126048 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40a5700 con 0x7f4acc0726e0 2024-05-30T16:57:29.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.762+0000 7f4ac9e00640 1 -- 172.21.15.59:0/2121126048 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac40a58a0 con 0x7f4acc0726e0 2024-05-30T16:57:29.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.762+0000 7f4ac9e00640 1 -- 172.21.15.59:0/2121126048 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40a5c70 con 0x7f4acc0726e0 2024-05-30T16:57:29.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.766+0000 7f4ad1400640 1 -- 172.21.15.59:0/2121126048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4acc0726e0 msgr2=0x7f4acc072b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:29.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.766+0000 7f4ad1400640 1 --2- 172.21.15.59:0/2121126048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4acc0726e0 0x7f4acc072b70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0b6590 tx=0x7f4ac401c9f0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.766+0000 7f4ad1400640 1 -- 172.21.15.59:0/2121126048 shutdown_connections 2024-05-30T16:57:29.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.766+0000 7f4ad1400640 1 --2- 172.21.15.59:0/2121126048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4acc0726e0 0x7f4acc072b70 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.766+0000 7f4ad1400640 1 --2- 172.21.15.59:0/2121126048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4acc0b4a70 0x7f4acc06f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.766+0000 7f4ad1400640 1 --2- 172.21.15.59:0/2121126048 >> v2:172.21.15.107:3300/0 conn(0x7f4acc1447c0 0x7f4acc0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.766+0000 7f4ad1400640 1 -- 172.21.15.59:0/2121126048 >> 172.21.15.59:0/2121126048 conn(0x7f4acc06bdb0 msgr2=0x7f4acc06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.766+0000 7f4ad1400640 1 -- 172.21.15.59:0/2121126048 shutdown_connections 2024-05-30T16:57:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.766+0000 7f4ad1400640 1 -- 172.21.15.59:0/2121126048 wait complete. 2024-05-30T16:57:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.766+0000 7f4ad1400640 1 Processor -- start 2024-05-30T16:57:29.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.766+0000 7f4ad1400640 1 -- start start 2024-05-30T16:57:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ad1400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4acc0726e0 0x7f4acc158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ad1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4acc0b4a70 0x7f4acc0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ad1400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4acc1447c0 0x7f4acc158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ad1400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4acc15f350 con 0x7f4acc0b4a70 2024-05-30T16:57:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ad1400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4acc15f1d0 con 0x7f4acc0726e0 2024-05-30T16:57:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ad1400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4acc15f4d0 con 0x7f4acc1447c0 2024-05-30T16:57:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4acc0b4a70 0x7f4acc0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4acc0b4a70 0x7f4acc0aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44394/0 (socket says 172.21.15.59:44394) 2024-05-30T16:57:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ac3e00640 1 -- 172.21.15.59:0/723364856 learned_addr learned my addr 172.21.15.59:0/723364856 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:29.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ac3e00640 1 -- 172.21.15.59:0/723364856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4acc1447c0 msgr2=0x7f4acc158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:29.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ac3e00640 1 --2- 172.21.15.59:0/723364856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4acc1447c0 0x7f4acc158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ac3e00640 1 -- 172.21.15.59:0/723364856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4acc0726e0 msgr2=0x7f4acc158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:29.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ac3e00640 1 --2- 172.21.15.59:0/723364856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4acc0726e0 0x7f4acc158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:29.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ac3e00640 1 -- 172.21.15.59:0/723364856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4acc0adb10 con 0x7f4acc0b4a70 2024-05-30T16:57:29.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ac3e00640 1 --2- 172.21.15.59:0/723364856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4acc0b4a70 0x7f4acc0aebb0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400d6d0 tx=0x7f4ab400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:29.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ac2a00640 1 -- 172.21.15.59:0/723364856 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4015070 con 0x7f4acc0b4a70 2024-05-30T16:57:29.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ad1400640 1 -- 172.21.15.59:0/723364856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4acc0addf0 con 0x7f4acc0b4a70 2024-05-30T16:57:29.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ac2a00640 1 -- 172.21.15.59:0/723364856 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab4007900 con 0x7f4acc0b4a70 2024-05-30T16:57:29.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ac2a00640 1 -- 172.21.15.59:0/723364856 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab400b040 con 0x7f4acc0b4a70 2024-05-30T16:57:29.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.770+0000 7f4ad1400640 1 -- 172.21.15.59:0/723364856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4acc0ae3b0 con 0x7f4acc0b4a70 2024-05-30T16:57:29.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.774+0000 7f4ad1400640 1 -- 172.21.15.59:0/723364856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4acc068a90 con 0x7f4acc0b4a70 2024-05-30T16:57:29.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.774+0000 7f4ac2a00640 1 -- 172.21.15.59:0/723364856 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 23) ==== 89466+0+0 (secure 0 0 0) 0x7f4ab4018070 con 0x7f4acc0b4a70 2024-05-30T16:57:29.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.774+0000 7f4ac2a00640 1 --2- 172.21.15.59:0/723364856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4aa80693d0 0x7f4aa806b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:29.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.774+0000 7f4ac2a00640 1 -- 172.21.15.59:0/723364856 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f4ab40858a0 con 0x7f4acc0b4a70 2024-05-30T16:57:29.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.782+0000 7f4ac2a00640 1 -- 172.21.15.59:0/723364856 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ab408e020 con 0x7f4acc0b4a70 2024-05-30T16:57:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.806+0000 7f4aca800640 1 --2- 172.21.15.59:0/723364856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4aa80693d0 0x7f4aa806b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:29.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:29.830+0000 7f4aca800640 1 --2- 172.21.15.59:0/723364856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4aa80693d0 0x7f4aa806b890 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0ad960 tx=0x7f4abc006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:30.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.102+0000 7f4ad1400640 1 -- 172.21.15.59:0/723364856 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69885", "target": ["mon-mgr", ""]}) -- 0x7f4acc06ddf0 con 0x7f4aa80693d0 2024-05-30T16:57:30.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.190+0000 7f4ac2a00640 1 -- 172.21.15.59:0/723364856 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f4ab4007cd0 con 0x7f4acc0b4a70 2024-05-30T16:57:30.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ac2a00640 1 -- 172.21.15.59:0/723364856 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4acc06ddf0 con 0x7f4aa80693d0 2024-05-30T16:57:30.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ad1400640 1 -- 172.21.15.59:0/723364856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4aa80693d0 msgr2=0x7f4aa806b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:30.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ad1400640 1 --2- 172.21.15.59:0/723364856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4aa80693d0 0x7f4aa806b890 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0ad960 tx=0x7f4abc006ca0 comp rx=0 tx=0).stop 2024-05-30T16:57:30.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ad1400640 1 -- 172.21.15.59:0/723364856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4acc0b4a70 msgr2=0x7f4acc0aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:30.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ad1400640 1 --2- 172.21.15.59:0/723364856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4acc0b4a70 0x7f4acc0aebb0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400d6d0 tx=0x7f4ab400db90 comp rx=0 tx=0).stop 2024-05-30T16:57:30.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ad1400640 1 -- 172.21.15.59:0/723364856 shutdown_connections 2024-05-30T16:57:30.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ad1400640 1 --2- 172.21.15.59:0/723364856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4aa80693d0 0x7f4aa806b890 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:30.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ad1400640 1 --2- 172.21.15.59:0/723364856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4acc1447c0 0x7f4acc158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:30.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ad1400640 1 --2- 172.21.15.59:0/723364856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4acc0b4a70 0x7f4acc0aebb0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:30.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ad1400640 1 --2- 172.21.15.59:0/723364856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4acc0726e0 0x7f4acc158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:30.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ad1400640 1 -- 172.21.15.59:0/723364856 >> 172.21.15.59:0/723364856 conn(0x7f4acc06bdb0 msgr2=0x7f4acc15b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:30.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ad1400640 1 -- 172.21.15.59:0/723364856 shutdown_connections 2024-05-30T16:57:30.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.710+0000 7f4ad1400640 1 -- 172.21.15.59:0/723364856 wait complete. 2024-05-30T16:57:30.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:57:30.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.950+0000 7f5d5f000640 1 Processor -- start 2024-05-30T16:57:30.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.950+0000 7f5d5f000640 1 -- start start 2024-05-30T16:57:30.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5f000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d5815fcf0 0x7f5d580af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:30.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5f000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d581600d0 0x7f5d580d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:30.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5f000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5d5809b450 0x7f5d580d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:30.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5f000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f5d5809b950 con 0x7f5d5815fcf0 2024-05-30T16:57:30.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5f000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5d5809bc30 con 0x7f5d5809b450 2024-05-30T16:57:30.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5f000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5d580cd300 con 0x7f5d581600d0 2024-05-30T16:57:30.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d5815fcf0 0x7f5d580af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:30.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d5815fcf0 0x7f5d580af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44400/0 (socket says 172.21.15.59:44400) 2024-05-30T16:57:30.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5dc00640 1 -- 172.21.15.59:0/946435931 learned_addr learned my addr 172.21.15.59:0/946435931 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:30.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5e600640 1 --2- 172.21.15.59:0/946435931 >> v2:172.21.15.107:3300/0 conn(0x7f5d5809b450 0x7f5d580d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:30.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5dc00640 1 -- 172.21.15.59:0/946435931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d581600d0 msgr2=0x7f5d580d06a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:57:30.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5dc00640 1 --2- 172.21.15.59:0/946435931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d581600d0 0x7f5d580d06a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:30.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5dc00640 1 -- 172.21.15.59:0/946435931 >> v2:172.21.15.107:3300/0 conn(0x7f5d5809b450 msgr2=0x7f5d580d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:30.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5dc00640 1 --2- 172.21.15.59:0/946435931 >> v2:172.21.15.107:3300/0 conn(0x7f5d5809b450 0x7f5d580d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:30.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5dc00640 1 -- 172.21.15.59:0/946435931 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d580cd5e0 con 0x7f5d5815fcf0 2024-05-30T16:57:30.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.954+0000 7f5d5e600640 1 --2- 172.21.15.59:0/946435931 >> v2:172.21.15.107:3300/0 conn(0x7f5d5809b450 0x7f5d580d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:57:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.958+0000 7f5d5dc00640 1 --2- 172.21.15.59:0/946435931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d5815fcf0 0x7f5d580af1b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5d5806fe20 tx=0x7f5d5001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759c3c95f22c063e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:30.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.962+0000 7f5d57e00640 1 -- 172.21.15.59:0/946435931 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d500b5070 con 0x7f5d5815fcf0 2024-05-30T16:57:30.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.962+0000 7f5d57e00640 1 -- 172.21.15.59:0/946435931 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d500a89f0 con 0x7f5d5815fcf0 2024-05-30T16:57:30.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.962+0000 7f5d57e00640 1 -- 172.21.15.59:0/946435931 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d500a8dc0 con 0x7f5d5815fcf0 2024-05-30T16:57:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.962+0000 7f5d5f000640 1 -- 172.21.15.59:0/946435931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d5815fcf0 msgr2=0x7f5d580af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.962+0000 7f5d5f000640 1 --2- 172.21.15.59:0/946435931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d5815fcf0 0x7f5d580af1b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5d5806fe20 tx=0x7f5d5001ed30 comp rx=0 tx=0).stop 2024-05-30T16:57:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.962+0000 7f5d5f000640 1 -- 172.21.15.59:0/946435931 shutdown_connections 2024-05-30T16:57:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.962+0000 7f5d5f000640 1 --2- 172.21.15.59:0/946435931 >> v2:172.21.15.107:3300/0 conn(0x7f5d5809b450 0x7f5d580d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.962+0000 7f5d5f000640 1 --2- 172.21.15.59:0/946435931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d581600d0 0x7f5d580d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.962+0000 7f5d5f000640 1 --2- 172.21.15.59:0/946435931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d5815fcf0 0x7f5d580af1b0 secure :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5d5806fe20 tx=0x7f5d5001ed30 comp rx=0 tx=0).stop 2024-05-30T16:57:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.962+0000 7f5d5f000640 1 -- 172.21.15.59:0/946435931 >> 172.21.15.59:0/946435931 conn(0x7f5d580b3ed0 msgr2=0x7f5d580b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:30.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.970+0000 7f5d5f000640 1 -- 172.21.15.59:0/946435931 shutdown_connections 2024-05-30T16:57:30.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.970+0000 7f5d5f000640 1 -- 172.21.15.59:0/946435931 wait complete. 2024-05-30T16:57:30.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.974+0000 7f5d5f000640 1 Processor -- start 2024-05-30T16:57:30.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.974+0000 7f5d5f000640 1 -- start start 2024-05-30T16:57:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5f000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d5809b450 0x7f5d5806e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5f000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d581600d0 0x7f5d580cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5f000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d581569b0 0x7f5d580c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5f000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5d580b4c70 con 0x7f5d581569b0 2024-05-30T16:57:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5f000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5d580af6f0 con 0x7f5d5809b450 2024-05-30T16:57:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5f000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5d580b4df0 con 0x7f5d581600d0 2024-05-30T16:57:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5e600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d581569b0 0x7f5d580c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5e600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d581569b0 0x7f5d580c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44410/0 (socket says 172.21.15.59:44410) 2024-05-30T16:57:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5e600640 1 -- 172.21.15.59:0/3773863325 learned_addr learned my addr 172.21.15.59:0/3773863325 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5e600640 1 -- 172.21.15.59:0/3773863325 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d581600d0 msgr2=0x7f5d580cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5e600640 1 --2- 172.21.15.59:0/3773863325 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d581600d0 0x7f5d580cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5e600640 1 -- 172.21.15.59:0/3773863325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d5809b450 msgr2=0x7f5d5806e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5e600640 1 --2- 172.21.15.59:0/3773863325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d5809b450 0x7f5d5806e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5e600640 1 -- 172.21.15.59:0/3773863325 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d58156e30 con 0x7f5d581569b0 2024-05-30T16:57:30.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d5e600640 1 --2- 172.21.15.59:0/3773863325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d581569b0 0x7f5d580c9ec0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800ce40 tx=0x7f5d4800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:30.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.978+0000 7f5d55600640 1 -- 172.21.15.59:0/3773863325 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48003ba0 con 0x7f5d581569b0 2024-05-30T16:57:30.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.982+0000 7f5d55600640 1 -- 172.21.15.59:0/3773863325 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d48003d60 con 0x7f5d581569b0 2024-05-30T16:57:30.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.982+0000 7f5d5f000640 1 -- 172.21.15.59:0/3773863325 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d580cac20 con 0x7f5d581569b0 2024-05-30T16:57:30.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.982+0000 7f5d55600640 1 -- 172.21.15.59:0/3773863325 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800d880 con 0x7f5d581569b0 2024-05-30T16:57:30.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.982+0000 7f5d5f000640 1 -- 172.21.15.59:0/3773863325 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d580cb1e0 con 0x7f5d581569b0 2024-05-30T16:57:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.982+0000 7f5d5f000640 1 -- 172.21.15.59:0/3773863325 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d58068a90 con 0x7f5d581569b0 2024-05-30T16:57:30.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.982+0000 7f5d55600640 1 -- 172.21.15.59:0/3773863325 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f5d4800da20 con 0x7f5d581569b0 2024-05-30T16:57:30.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.986+0000 7f5d55600640 1 --2- 172.21.15.59:0/3773863325 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5d38069490 0x7f5d3806b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:30.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.986+0000 7f5d55600640 1 -- 172.21.15.59:0/3773863325 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f5d48085db0 con 0x7f5d581569b0 2024-05-30T16:57:30.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.990+0000 7f5d5dc00640 1 --2- 172.21.15.59:0/3773863325 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5d38069490 0x7f5d3806b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:30.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.994+0000 7f5d55600640 1 -- 172.21.15.59:0/3773863325 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5d48057e20 con 0x7f5d581569b0 2024-05-30T16:57:30.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:30.998+0000 7f5d5dc00640 1 --2- 172.21.15.59:0/3773863325 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5d38069490 0x7f5d3806b950 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5d500b2000 tx=0x7f5d50004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:31.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.357+0000 7f5d5f000640 1 -- 172.21.15.59:0/3773863325 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5d580cc910 con 0x7f5d581569b0 2024-05-30T16:57:31.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.357+0000 7f5d55600640 1 -- 172.21.15.59:0/3773863325 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2135 (secure 0 0 0) 0x7f5d48057720 con 0x7f5d581569b0 2024-05-30T16:57:31.360 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:57:31.360 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:57:31.360 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:57:31.360 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:57:31.360 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:57:31.360 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:57:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 531, 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 75, 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:57:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 832, 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 3364753654, 2024-05-30T16:57:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 6981214208, 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 766112899072, 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 19216447, 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 80373940, 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 4, 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 23 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 43, 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5, 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:57:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 5, 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "b", 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 6528 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:57:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 10, 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:55:53.196869+0000", 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:57:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:57:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: "a2307bae-c24f-47e3-a595-961c250f4339": { 2024-05-30T16:57:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "2 ongoing clones; Avg progress is 12.369% (1s)\n [===.........................] (remaining: 11s)", 2024-05-30T16:57:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.12369000166654587, 2024-05-30T16:57:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:57:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:57:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:57:31.367 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:57:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.361+0000 7f5d5f000640 1 -- 172.21.15.59:0/3773863325 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5d38069490 msgr2=0x7f5d3806b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.361+0000 7f5d5f000640 1 --2- 172.21.15.59:0/3773863325 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5d38069490 0x7f5d3806b950 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5d500b2000 tx=0x7f5d50004740 comp rx=0 tx=0).stop 2024-05-30T16:57:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.361+0000 7f5d5f000640 1 -- 172.21.15.59:0/3773863325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d581569b0 msgr2=0x7f5d580c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.361+0000 7f5d5f000640 1 --2- 172.21.15.59:0/3773863325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d581569b0 0x7f5d580c9ec0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800ce40 tx=0x7f5d4800a710 comp rx=0 tx=0).stop 2024-05-30T16:57:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.365+0000 7f5d5f000640 1 -- 172.21.15.59:0/3773863325 shutdown_connections 2024-05-30T16:57:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.365+0000 7f5d5f000640 1 --2- 172.21.15.59:0/3773863325 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5d38069490 0x7f5d3806b950 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.365+0000 7f5d5f000640 1 --2- 172.21.15.59:0/3773863325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d581569b0 0x7f5d580c9ec0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.365+0000 7f5d5f000640 1 --2- 172.21.15.59:0/3773863325 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d581600d0 0x7f5d580cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:31.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.365+0000 7f5d5f000640 1 --2- 172.21.15.59:0/3773863325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d5809b450 0x7f5d5806e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:31.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.365+0000 7f5d5f000640 1 -- 172.21.15.59:0/3773863325 >> 172.21.15.59:0/3773863325 conn(0x7f5d580b3ed0 msgr2=0x7f5d580cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:31.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.365+0000 7f5d5f000640 1 -- 172.21.15.59:0/3773863325 shutdown_connections 2024-05-30T16:57:31.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:31.365+0000 7f5d5f000640 1 -- 172.21.15.59:0/3773863325 wait complete. 2024-05-30T16:57:32.414 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:57:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.653+0000 7f4a40000640 1 Processor -- start 2024-05-30T16:57:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.653+0000 7f4a40000640 1 -- start start 2024-05-30T16:57:32.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a40000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4a3815ad70 0x7f4a3806f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:32.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a40000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a380b41d0 0x7f4a3815ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:32.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a40000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3806f830 con 0x7f4a3815f3b0 2024-05-30T16:57:32.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a40000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4a380700d0 con 0x7f4a380b41d0 2024-05-30T16:57:32.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a40000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4a3806fb10 con 0x7f4a3815ad70 2024-05-30T16:57:32.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a3cc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a380b41d0 0x7f4a3815ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:32.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a3cc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a380b41d0 0x7f4a3815ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37988/0 (socket says 172.21.15.59:37988) 2024-05-30T16:57:32.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a3cc00640 1 -- 172.21.15.59:0/3125697106 learned_addr learned my addr 172.21.15.59:0/3125697106 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:32.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a3d600640 1 --2- 172.21.15.59:0/3125697106 >> v2:172.21.15.107:3300/0 conn(0x7f4a3815ad70 0x7f4a3806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:32.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a3cc00640 1 -- 172.21.15.59:0/3125697106 >> v2:172.21.15.107:3300/0 conn(0x7f4a3815ad70 msgr2=0x7f4a3806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:32.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a3cc00640 1 --2- 172.21.15.59:0/3125697106 >> v2:172.21.15.107:3300/0 conn(0x7f4a3815ad70 0x7f4a3806f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:32.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a3cc00640 1 -- 172.21.15.59:0/3125697106 >> v1:172.21.15.107:6789/0 conn(0x7f4a3815f3b0 legacy=0x7f4a380cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:32.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.657+0000 7f4a3cc00640 1 -- 172.21.15.59:0/3125697106 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3806fdf0 con 0x7f4a380b41d0 2024-05-30T16:57:32.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.665+0000 7f4a3cc00640 1 --2- 172.21.15.59:0/3125697106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a380b41d0 0x7f4a3815ee70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4a3806c5f0 tx=0x7f4a2401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d60d9722d59251 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:32.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.669+0000 7f4a37e00640 1 -- 172.21.15.59:0/3125697106 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a240b0070 con 0x7f4a380b41d0 2024-05-30T16:57:32.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.669+0000 7f4a37e00640 1 -- 172.21.15.59:0/3125697106 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a240ab600 con 0x7f4a380b41d0 2024-05-30T16:57:32.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.669+0000 7f4a37e00640 1 -- 172.21.15.59:0/3125697106 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a240ab9d0 con 0x7f4a380b41d0 2024-05-30T16:57:32.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.669+0000 7f4a40000640 1 -- 172.21.15.59:0/3125697106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a380b41d0 msgr2=0x7f4a3815ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:32.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.669+0000 7f4a40000640 1 --2- 172.21.15.59:0/3125697106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a380b41d0 0x7f4a3815ee70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4a3806c5f0 tx=0x7f4a2401c450 comp rx=0 tx=0).stop 2024-05-30T16:57:32.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.669+0000 7f4a40000640 1 -- 172.21.15.59:0/3125697106 shutdown_connections 2024-05-30T16:57:32.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.669+0000 7f4a40000640 1 --2- 172.21.15.59:0/3125697106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a380b41d0 0x7f4a3815ee70 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:32.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.669+0000 7f4a40000640 1 --2- 172.21.15.59:0/3125697106 >> v2:172.21.15.107:3300/0 conn(0x7f4a3815ad70 0x7f4a3806f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:32.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.669+0000 7f4a40000640 1 -- 172.21.15.59:0/3125697106 >> 172.21.15.59:0/3125697106 conn(0x7f4a38067d60 msgr2=0x7f4a3806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:32.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.669+0000 7f4a40000640 1 -- 172.21.15.59:0/3125697106 shutdown_connections 2024-05-30T16:57:32.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.669+0000 7f4a40000640 1 -- 172.21.15.59:0/3125697106 wait complete. 2024-05-30T16:57:32.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.673+0000 7f4a40000640 1 Processor -- start 2024-05-30T16:57:32.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.673+0000 7f4a40000640 1 -- start start 2024-05-30T16:57:32.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.677+0000 7f4a40000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a380b41d0 0x7f4a38147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:32.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.677+0000 7f4a40000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a3815ad70 0x7f4a38158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:32.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.677+0000 7f4a40000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3815f3b0 0x7f4a3806dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:32.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.677+0000 7f4a40000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4a38072100 con 0x7f4a3815f3b0 2024-05-30T16:57:32.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.677+0000 7f4a40000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4a38071f80 con 0x7f4a380b41d0 2024-05-30T16:57:32.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.677+0000 7f4a40000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4a38072280 con 0x7f4a3815ad70 2024-05-30T16:57:32.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.677+0000 7f4a3d600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a380b41d0 0x7f4a38147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:32.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.677+0000 7f4a3d600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a380b41d0 0x7f4a38147e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:51512/0 (socket says 172.21.15.59:51512) 2024-05-30T16:57:32.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.677+0000 7f4a3d600640 1 -- 172.21.15.59:0/1232603379 learned_addr learned my addr 172.21.15.59:0/1232603379 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:32.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.677+0000 7f4a3cc00640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a3815ad70 0x7f4a38158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:32.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.677+0000 7f4a3e000640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3815f3b0 0x7f4a3806dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:32.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.681+0000 7f4a3e000640 1 -- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a3815ad70 msgr2=0x7f4a38158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:32.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.681+0000 7f4a3e000640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a3815ad70 0x7f4a38158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:32.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.681+0000 7f4a3e000640 1 -- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a380b41d0 msgr2=0x7f4a38147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:32.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.681+0000 7f4a3e000640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a380b41d0 0x7f4a38147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:32.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.681+0000 7f4a3e000640 1 -- 172.21.15.59:0/1232603379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a38154cd0 con 0x7f4a3815f3b0 2024-05-30T16:57:32.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.681+0000 7f4a3e000640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3815f3b0 0x7f4a3806dd70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000be50 tx=0x7f4a3000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:32.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.681+0000 7f4a35600640 1 -- 172.21.15.59:0/1232603379 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30019070 con 0x7f4a3815f3b0 2024-05-30T16:57:32.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.681+0000 7f4a40000640 1 -- 172.21.15.59:0/1232603379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a38154fb0 con 0x7f4a3815f3b0 2024-05-30T16:57:32.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.681+0000 7f4a35600640 1 -- 172.21.15.59:0/1232603379 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a30014440 con 0x7f4a3815f3b0 2024-05-30T16:57:32.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.681+0000 7f4a40000640 1 -- 172.21.15.59:0/1232603379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a38155570 con 0x7f4a3815f3b0 2024-05-30T16:57:32.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.681+0000 7f4a35600640 1 -- 172.21.15.59:0/1232603379 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30014830 con 0x7f4a3815f3b0 2024-05-30T16:57:32.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.685+0000 7f4a35600640 1 -- 172.21.15.59:0/1232603379 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f4a3001c070 con 0x7f4a3815f3b0 2024-05-30T16:57:32.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.685+0000 7f4a40000640 1 -- 172.21.15.59:0/1232603379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a38068a90 con 0x7f4a3815f3b0 2024-05-30T16:57:32.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.685+0000 7f4a35600640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a18069460 0x7f4a1806b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:32.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.685+0000 7f4a35600640 1 -- 172.21.15.59:0/1232603379 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f4a300857f0 con 0x7f4a3815f3b0 2024-05-30T16:57:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.693+0000 7f4a3d600640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a18069460 0x7f4a1806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:32.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.705+0000 7f4a35600640 1 -- 172.21.15.59:0/1232603379 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4a30056e50 con 0x7f4a3815f3b0 2024-05-30T16:57:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:32.709+0000 7f4a3d600640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a18069460 0x7f4a1806b920 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c007b10 tx=0x7f4a2c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:33.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 -- 172.21.15.59:0/1232603379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4a380cd9f0 con 0x7f4a3815f3b0 2024-05-30T16:57:33.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a35600640 1 -- 172.21.15.59:0/1232603379 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2135 (secure 0 0 0) 0x7f4a3005b150 con 0x7f4a3815f3b0 2024-05-30T16:57:33.000 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:57:33.001 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:57:33.001 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:57:33.001 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:57:33.001 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:57:33.001 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:57:33.001 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:57:33.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:33.001 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:57:33.001 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:57:33.001 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:57:33.001 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:57:33.001 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 532, 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:33.002 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 75, 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:57:33.003 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 832, 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 3364753654, 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 6981214208, 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 766112899072, 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 19213801, 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 56258823, 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 4, 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 17 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 43, 2024-05-30T16:57:33.004 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5, 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 5, 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "b", 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 6528 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:57:33.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 10, 2024-05-30T16:57:33.006 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:55:53.196869+0000", 2024-05-30T16:57:33.007 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:57:33.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:33.007 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:57:33.007 INFO:teuthology.orchestra.run.smithi059.stdout: "a2307bae-c24f-47e3-a595-961c250f4339": { 2024-05-30T16:57:33.007 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "4 ongoing clones; Avg progress is 17.773% (3s)\n [====........................] (remaining: 16s)", 2024-05-30T16:57:33.007 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.17772999405860901, 2024-05-30T16:57:33.007 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:57:33.007 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:57:33.007 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:57:33.007 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:57:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 -- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a18069460 msgr2=0x7f4a1806b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a18069460 0x7f4a1806b920 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c007b10 tx=0x7f4a2c008040 comp rx=0 tx=0).stop 2024-05-30T16:57:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 -- 172.21.15.59:0/1232603379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3815f3b0 msgr2=0x7f4a3806dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3815f3b0 0x7f4a3806dd70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000be50 tx=0x7f4a3000bf40 comp rx=0 tx=0).stop 2024-05-30T16:57:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 -- 172.21.15.59:0/1232603379 shutdown_connections 2024-05-30T16:57:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a18069460 0x7f4a1806b920 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3815f3b0 0x7f4a3806dd70 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a3815ad70 0x7f4a38158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 --2- 172.21.15.59:0/1232603379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a380b41d0 0x7f4a38147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 -- 172.21.15.59:0/1232603379 >> 172.21.15.59:0/1232603379 conn(0x7f4a38067d60 msgr2=0x7f4a380af710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 -- 172.21.15.59:0/1232603379 shutdown_connections 2024-05-30T16:57:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:33.001+0000 7f4a40000640 1 -- 172.21.15.59:0/1232603379 wait complete. 2024-05-30T16:57:34.034 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:57:34.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.277+0000 7f6b7a800640 1 Processor -- start 2024-05-30T16:57:34.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.277+0000 7f6b7a800640 1 -- start start 2024-05-30T16:57:34.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b7a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b741558e0 0x7f6b740b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b7a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b7406f8c0 0x7f6b7415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b7a800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b7406de10 con 0x7f6b7415f4c0 2024-05-30T16:57:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b7a800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6b7415f930 con 0x7f6b741558e0 2024-05-30T16:57:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b7a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6b7406e0f0 con 0x7f6b7406f8c0 2024-05-30T16:57:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b73400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b741558e0 0x7f6b740b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b73e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6b7415f4c0 0x7f6b7415b990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56920/0 (socket says 172.21.15.59:56920) 2024-05-30T16:57:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b73400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b741558e0 0x7f6b740b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38006/0 (socket says 172.21.15.59:38006) 2024-05-30T16:57:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b73e00640 1 -- 172.21.15.59:0/844844598 learned_addr learned my addr 172.21.15.59:0/844844598 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:34.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b73400640 1 -- 172.21.15.59:0/844844598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b7406f8c0 msgr2=0x7f6b7415ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:34.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b73400640 1 --2- 172.21.15.59:0/844844598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b7406f8c0 0x7f6b7415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b73400640 1 -- 172.21.15.59:0/844844598 >> v1:172.21.15.59:6789/0 conn(0x7f6b7415f4c0 legacy=0x7f6b7415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:34.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b73400640 1 -- 172.21.15.59:0/844844598 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7406e3d0 con 0x7f6b741558e0 2024-05-30T16:57:34.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.281+0000 7f6b72000640 1 -- 172.21.15.59:0/844844598 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1165849121 0 0) 0x7f6b7406de10 con 0x7f6b7415f4c0 2024-05-30T16:57:34.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.285+0000 7f6b73400640 1 --2- 172.21.15.59:0/844844598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b741558e0 0x7f6b740b3e30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6b640097c0 tx=0x7f6b6401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85c523fa8c9a2dd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:34.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.285+0000 7f6b72000640 1 -- 172.21.15.59:0/844844598 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b640b0070 con 0x7f6b741558e0 2024-05-30T16:57:34.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.285+0000 7f6b72000640 1 -- 172.21.15.59:0/844844598 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b64004230 con 0x7f6b741558e0 2024-05-30T16:57:34.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.285+0000 7f6b72000640 1 -- 172.21.15.59:0/844844598 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64003620 con 0x7f6b741558e0 2024-05-30T16:57:34.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.285+0000 7f6b7a800640 1 -- 172.21.15.59:0/844844598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b741558e0 msgr2=0x7f6b740b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:34.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.285+0000 7f6b7a800640 1 --2- 172.21.15.59:0/844844598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b741558e0 0x7f6b740b3e30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6b640097c0 tx=0x7f6b6401c4a0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.285+0000 7f6b7a800640 1 -- 172.21.15.59:0/844844598 shutdown_connections 2024-05-30T16:57:34.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.285+0000 7f6b7a800640 1 --2- 172.21.15.59:0/844844598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b7406f8c0 0x7f6b7415ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.285+0000 7f6b7a800640 1 --2- 172.21.15.59:0/844844598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b741558e0 0x7f6b740b3e30 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.285+0000 7f6b7a800640 1 -- 172.21.15.59:0/844844598 >> 172.21.15.59:0/844844598 conn(0x7f6b74067d60 msgr2=0x7f6b7406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:34.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.285+0000 7f6b7a800640 1 -- 172.21.15.59:0/844844598 shutdown_connections 2024-05-30T16:57:34.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.285+0000 7f6b7a800640 1 -- 172.21.15.59:0/844844598 wait complete. 2024-05-30T16:57:34.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.289+0000 7f6b7a800640 1 Processor -- start 2024-05-30T16:57:34.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.289+0000 7f6b7a800640 1 -- start start 2024-05-30T16:57:34.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.289+0000 7f6b7a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b7406f8c0 0x7f6b74145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.289+0000 7f6b7a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b741558e0 0x7f6b740cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.289+0000 7f6b7a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b7415f4c0 0x7f6b7414f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.289+0000 7f6b7a800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6b740b56c0 con 0x7f6b7406f8c0 2024-05-30T16:57:34.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.289+0000 7f6b7a800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6b74070010 con 0x7f6b741558e0 2024-05-30T16:57:34.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.289+0000 7f6b7a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6b74155cc0 con 0x7f6b7415f4c0 2024-05-30T16:57:34.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.289+0000 7f6b73400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b7406f8c0 0x7f6b74145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:34.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.289+0000 7f6b73400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b7406f8c0 0x7f6b74145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38018/0 (socket says 172.21.15.59:38018) 2024-05-30T16:57:34.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.289+0000 7f6b73400640 1 -- 172.21.15.59:0/2454340587 learned_addr learned my addr 172.21.15.59:0/2454340587 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b73400640 1 -- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b7415f4c0 msgr2=0x7f6b7414f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b73e00640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b7415f4c0 0x7f6b7414f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b73400640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b7415f4c0 0x7f6b7414f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b73400640 1 -- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b741558e0 msgr2=0x7f6b740cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b73400640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b741558e0 0x7f6b740cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b73400640 1 -- 172.21.15.59:0/2454340587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b740d03b0 con 0x7f6b7406f8c0 2024-05-30T16:57:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b73e00640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b7415f4c0 0x7f6b7414f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:57:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b73400640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b7406f8c0 0x7f6b74145ec0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6b6401a0d0 tx=0x7f6b64019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b6b400640 1 -- 172.21.15.59:0/2454340587 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b640b0040 con 0x7f6b7406f8c0 2024-05-30T16:57:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b6b400640 1 -- 172.21.15.59:0/2454340587 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b640bc070 con 0x7f6b7406f8c0 2024-05-30T16:57:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b7a800640 1 -- 172.21.15.59:0/2454340587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b740d0690 con 0x7f6b7406f8c0 2024-05-30T16:57:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b6b400640 1 -- 172.21.15.59:0/2454340587 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b640b5480 con 0x7f6b7406f8c0 2024-05-30T16:57:34.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b7a800640 1 -- 172.21.15.59:0/2454340587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b740d0c50 con 0x7f6b7406f8c0 2024-05-30T16:57:34.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b7a800640 1 -- 172.21.15.59:0/2454340587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b74068a90 con 0x7f6b7406f8c0 2024-05-30T16:57:34.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.293+0000 7f6b6b400640 1 -- 172.21.15.59:0/2454340587 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f6b640b3070 con 0x7f6b7406f8c0 2024-05-30T16:57:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.297+0000 7f6b6b400640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b540694b0 0x7f6b5406b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.297+0000 7f6b6b400640 1 -- 172.21.15.59:0/2454340587 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f6b6411f4e0 con 0x7f6b7406f8c0 2024-05-30T16:57:34.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.301+0000 7f6b6b400640 1 -- 172.21.15.59:0/2454340587 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b64124e20 con 0x7f6b7406f8c0 2024-05-30T16:57:34.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.357+0000 7f6b72a00640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b540694b0 0x7f6b5406b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.405+0000 7f6b72a00640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b540694b0 0x7f6b5406b970 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6b74150630 tx=0x7f6b60006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.685+0000 7f6b7a800640 1 -- 172.21.15.59:0/2454340587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6b7406bbc0 con 0x7f6b7406f8c0 2024-05-30T16:57:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.685+0000 7f6b6b400640 1 -- 172.21.15.59:0/2454340587 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2401 (secure 0 0 0) 0x7f6b64016090 con 0x7f6b7406f8c0 2024-05-30T16:57:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:57:34.687 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:57:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:57:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:57:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:57:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:57:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:57:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 534, 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:57:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 75, 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:57:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:57:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:57:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:57:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:57:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:57:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:57:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1726, 2024-05-30T16:57:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 7093767409, 2024-05-30T16:57:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 14104014848, 2024-05-30T16:57:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 758990098432, 2024-05-30T16:57:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:57:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 331840383, 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 366812530, 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 81, 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 101 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 43, 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5, 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 5, 2024-05-30T16:57:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "b", 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 6528 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:57:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 10, 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:55:53.196869+0000", 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "328dea24-359f-412d-91f5-463eae2a6988": { 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "5 ongoing+pending clones; Avg progress is 23.385% (0s)\n [======......................] ", 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.23385000228881836, 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:57:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:57:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: "a2307bae-c24f-47e3-a595-961c250f4339": { 2024-05-30T16:57:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "4 ongoing clones; Avg progress is 26.627% (5s)\n [=======.....................] (remaining: 16s)", 2024-05-30T16:57:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.26627001166343689, 2024-05-30T16:57:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:57:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:57:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:57:34.694 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:57:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.689+0000 7f6b7a800640 1 -- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b540694b0 msgr2=0x7f6b5406b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.689+0000 7f6b7a800640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b540694b0 0x7f6b5406b970 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6b74150630 tx=0x7f6b60006ca0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.689+0000 7f6b7a800640 1 -- 172.21.15.59:0/2454340587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b7406f8c0 msgr2=0x7f6b74145ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.689+0000 7f6b7a800640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b7406f8c0 0x7f6b74145ec0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6b6401a0d0 tx=0x7f6b64019240 comp rx=0 tx=0).stop 2024-05-30T16:57:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.689+0000 7f6b7a800640 1 -- 172.21.15.59:0/2454340587 shutdown_connections 2024-05-30T16:57:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.689+0000 7f6b7a800640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b540694b0 0x7f6b5406b970 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.689+0000 7f6b7a800640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b7415f4c0 0x7f6b7414f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.689+0000 7f6b7a800640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b741558e0 0x7f6b740cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.689+0000 7f6b7a800640 1 --2- 172.21.15.59:0/2454340587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b7406f8c0 0x7f6b74145ec0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.689+0000 7f6b7a800640 1 -- 172.21.15.59:0/2454340587 >> 172.21.15.59:0/2454340587 conn(0x7f6b74067d60 msgr2=0x7f6b7415ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.689+0000 7f6b7a800640 1 -- 172.21.15.59:0/2454340587 shutdown_connections 2024-05-30T16:57:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.689+0000 7f6b7a800640 1 -- 172.21.15.59:0/2454340587 wait complete. 2024-05-30T16:57:34.729 INFO:tasks.cephfs.test_volumes:pevs - {'328dea24-359f-412d-91f5-463eae2a6988': {'message': '5 ongoing+pending clones; Avg progress is 23.385% (0s)\n [======......................] ', 'progress': 0.23385000228881836, 'add_to_ceph_s': True}, 'a2307bae-c24f-47e3-a595-961c250f4339': {'message': '4 ongoing clones; Avg progress is 26.627% (5s)\n [=======.....................] (remaining: 16s)', 'progress': 0.2662700116634369, 'add_to_ceph_s': True}} 2024-05-30T16:57:34.729 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69886 2024-05-30T16:57:34.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:57:34.743 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:57:34.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.965+0000 7f14f7200640 1 Processor -- start 2024-05-30T16:57:34.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.965+0000 7f14f7200640 1 -- start start 2024-05-30T16:57:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14f8145fb0 0x7f14f80d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f7200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f80d20b0 con 0x7f14f806c0c0 2024-05-30T16:57:34.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f7200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f80b26b0 con 0x7f14f806c630 2024-05-30T16:57:34.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f14f80b2990 con 0x7f14f8145fb0 2024-05-30T16:57:34.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f6800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14f806c0c0 0x7f14f80b0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56928/0 (socket says 172.21.15.59:56928) 2024-05-30T16:57:34.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f6800640 1 -- 172.21.15.59:0/3119626406 learned_addr learned my addr 172.21.15.59:0/3119626406 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:34.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3281428402 0 0) 0x7f14f80d20b0 con 0x7f14f806c0c0 2024-05-30T16:57:34.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14dc003530 con 0x7f14f806c0c0 2024-05-30T16:57:34.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3163566781 0 0) 0x7f14dc003530 con 0x7f14f806c0c0 2024-05-30T16:57:34.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14f8145fb0 msgr2=0x7f14f80d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:34.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 --2- 172.21.15.59:0/3119626406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14f8145fb0 0x7f14f80d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 >> v1:172.21.15.107:6789/0 conn(0x7f14f806c630 legacy=0x7f14f806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:34.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f80b2c70 con 0x7f14f806c0c0 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f14f0001a00 con 0x7f14f806c0c0 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 >> v1:172.21.15.59:6789/0 conn(0x7f14f806c0c0 legacy=0x7f14f80b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 --2- 172.21.15.59:0/3119626406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14f8145fb0 0x7f14dc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 --2- 172.21.15.59:0/3119626406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14dc0040e0 0x7f14dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 --2- 172.21.15.59:0/3119626406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14dc004dc0 0x7f14dc005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80b2990 con 0x7f14dc004dc0 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc00bc30 con 0x7f14dc0040e0 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f14dc00be30 con 0x7f14f8145fb0 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f6800640 1 --2- 172.21.15.59:0/3119626406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14dc004dc0 0x7f14dc005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f5e00640 1 --2- 172.21.15.59:0/3119626406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14f8145fb0 0x7f14dc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f6800640 1 -- 172.21.15.59:0/3119626406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14f8145fb0 msgr2=0x7f14dc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f6800640 1 --2- 172.21.15.59:0/3119626406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14f8145fb0 0x7f14dc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f5400640 1 --2- 172.21.15.59:0/3119626406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14dc0040e0 0x7f14dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f6800640 1 -- 172.21.15.59:0/3119626406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14dc0040e0 msgr2=0x7f14dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f6800640 1 --2- 172.21.15.59:0/3119626406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14dc0040e0 0x7f14dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f6800640 1 -- 172.21.15.59:0/3119626406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc003530 con 0x7f14dc004dc0 2024-05-30T16:57:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.969+0000 7f14f5400640 1 --2- 172.21.15.59:0/3119626406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14dc0040e0 0x7f14dc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:57:34.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.973+0000 7f14f6800640 1 --2- 172.21.15.59:0/3119626406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14dc004dc0 0x7f14dc005240 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f14f000a860 tx=0x7f14f001d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0e1ccf7ed3d81e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:34.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.973+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f000a480 con 0x7f14dc004dc0 2024-05-30T16:57:34.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.973+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f00ad630 con 0x7f14dc004dc0 2024-05-30T16:57:34.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.973+0000 7f14f4a00640 1 -- 172.21.15.59:0/3119626406 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f00ada80 con 0x7f14dc004dc0 2024-05-30T16:57:34.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 -- 172.21.15.59:0/3119626406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14dc004dc0 msgr2=0x7f14dc005240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:34.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 --2- 172.21.15.59:0/3119626406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14dc004dc0 0x7f14dc005240 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f14f000a860 tx=0x7f14f001d2a0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f6800640 1 -- 172.21.15.59:0/3119626406 reap_dead start 2024-05-30T16:57:34.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 -- 172.21.15.59:0/3119626406 shutdown_connections 2024-05-30T16:57:34.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 -- 172.21.15.59:0/3119626406 >> 172.21.15.59:0/3119626406 conn(0x7f14f80b6700 msgr2=0x7f14f80b6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:34.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 -- 172.21.15.59:0/3119626406 shutdown_connections 2024-05-30T16:57:34.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 -- 172.21.15.59:0/3119626406 wait complete. 2024-05-30T16:57:34.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 Processor -- start 2024-05-30T16:57:34.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 -- start start 2024-05-30T16:57:34.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14dc004dc0 0x7f14f80ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14f815b710 0x7f14f815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f809d350 0x7f14f809d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80d1b70 con 0x7f14f809d350 2024-05-30T16:57:34.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80afe20 con 0x7f14dc004dc0 2024-05-30T16:57:34.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.977+0000 7f14f7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f14f80d1cf0 con 0x7f14f815b710 2024-05-30T16:57:34.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f809d350 0x7f14f809d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:34.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f809d350 0x7f14f809d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38034/0 (socket says 172.21.15.59:38034) 2024-05-30T16:57:34.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f6800640 1 -- 172.21.15.59:0/739864567 learned_addr learned my addr 172.21.15.59:0/739864567 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f5e00640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14dc004dc0 0x7f14f80ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f5400640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14f815b710 0x7f14f815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f6800640 1 -- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14f815b710 msgr2=0x7f14f815bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f6800640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14f815b710 0x7f14f815bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f6800640 1 -- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14dc004dc0 msgr2=0x7f14f80ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f6800640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14dc004dc0 0x7f14f80ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f6800640 1 -- 172.21.15.59:0/739864567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f809e080 con 0x7f14f809d350 2024-05-30T16:57:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f6800640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f809d350 0x7f14f809d7d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f14f001d0d0 tx=0x7f14dc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14ee000640 1 -- 172.21.15.59:0/739864567 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f00bb070 con 0x7f14f809d350 2024-05-30T16:57:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14ee000640 1 -- 172.21.15.59:0/739864567 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f00ad430 con 0x7f14f809d350 2024-05-30T16:57:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14ee000640 1 -- 172.21.15.59:0/739864567 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f000a480 con 0x7f14f809d350 2024-05-30T16:57:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f7200640 1 -- 172.21.15.59:0/739864567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f809e360 con 0x7f14f809d350 2024-05-30T16:57:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f7200640 1 -- 172.21.15.59:0/739864567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f809e920 con 0x7f14f809d350 2024-05-30T16:57:34.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.981+0000 7f14f7200640 1 -- 172.21.15.59:0/739864567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f80691a0 con 0x7f14f809d350 2024-05-30T16:57:34.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.985+0000 7f14ee000640 1 -- 172.21.15.59:0/739864567 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f14f00b5070 con 0x7f14f809d350 2024-05-30T16:57:34.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.985+0000 7f14ee000640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f14d8069490 0x7f14d806b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:34.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.985+0000 7f14ee000640 1 -- 172.21.15.59:0/739864567 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f14f011eda0 con 0x7f14f809d350 2024-05-30T16:57:34.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.989+0000 7f14ee000640 1 -- 172.21.15.59:0/739864567 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f14f0016fb0 con 0x7f14f809d350 2024-05-30T16:57:34.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:34.993+0000 7f14f5e00640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f14d8069490 0x7f14d806b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:35.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:35.001+0000 7f14f5e00640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f14d8069490 0x7f14d806b950 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f14e8006fd0 tx=0x7f14e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:35.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:35.301+0000 7f14f7200640 1 -- 172.21.15.59:0/739864567 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69886", "target": ["mon-mgr", ""]}) -- 0x7f14f815c0d0 con 0x7f14d8069490 2024-05-30T16:57:36.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.437+0000 7f14ee000640 1 -- 172.21.15.59:0/739864567 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f14f815c0d0 con 0x7f14d8069490 2024-05-30T16:57:36.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.441+0000 7f14f7200640 1 -- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f14d8069490 msgr2=0x7f14d806b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:36.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.441+0000 7f14f7200640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f14d8069490 0x7f14d806b950 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f14e8006fd0 tx=0x7f14e8008040 comp rx=0 tx=0).stop 2024-05-30T16:57:36.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.441+0000 7f14f7200640 1 -- 172.21.15.59:0/739864567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f809d350 msgr2=0x7f14f809d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:36.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.441+0000 7f14f7200640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f809d350 0x7f14f809d7d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f14f001d0d0 tx=0x7f14dc005840 comp rx=0 tx=0).stop 2024-05-30T16:57:36.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.441+0000 7f14f7200640 1 -- 172.21.15.59:0/739864567 shutdown_connections 2024-05-30T16:57:36.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.441+0000 7f14f7200640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f14d8069490 0x7f14d806b950 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:36.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.441+0000 7f14f7200640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f809d350 0x7f14f809d7d0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:36.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.441+0000 7f14f7200640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14f815b710 0x7f14f815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:36.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.441+0000 7f14f7200640 1 --2- 172.21.15.59:0/739864567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14dc004dc0 0x7f14f80ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:36.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.441+0000 7f14f7200640 1 -- 172.21.15.59:0/739864567 >> 172.21.15.59:0/739864567 conn(0x7f14f80b6700 msgr2=0x7f14f8140dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:36.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.441+0000 7f14f7200640 1 -- 172.21.15.59:0/739864567 shutdown_connections 2024-05-30T16:57:36.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.441+0000 7f14f7200640 1 -- 172.21.15.59:0/739864567 wait complete. 2024-05-30T16:57:36.489 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69887 2024-05-30T16:57:36.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.729+0000 7f25ff800640 1 Processor -- start 2024-05-30T16:57:36.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.729+0000 7f25ff800640 1 -- start start 2024-05-30T16:57:36.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25ff800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f25f8159100 0x7f25f806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:36.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25ff800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25f80b44e0 0x7f25f815efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:36.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25ff800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25f80b52d0 con 0x7f25f815f510 2024-05-30T16:57:36.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25ff800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f25f80b4a30 con 0x7f25f80b44e0 2024-05-30T16:57:36.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25ff800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f25f80b4d10 con 0x7f25f8159100 2024-05-30T16:57:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25efe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25f80b44e0 0x7f25f815efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25fd800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f25f815f510 0x7f25f815c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56942/0 (socket says 172.21.15.59:56942) 2024-05-30T16:57:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25fd800640 1 -- 172.21.15.59:0/3952790246 learned_addr learned my addr 172.21.15.59:0/3952790246 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25efe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25f80b44e0 0x7f25f815efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38048/0 (socket says 172.21.15.59:38048) 2024-05-30T16:57:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25fce00640 1 --2- 172.21.15.59:0/3952790246 >> v2:172.21.15.107:3300/0 conn(0x7f25f8159100 0x7f25f806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:36.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25efe00640 1 -- 172.21.15.59:0/3952790246 >> v2:172.21.15.107:3300/0 conn(0x7f25f8159100 msgr2=0x7f25f806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:36.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25efe00640 1 --2- 172.21.15.59:0/3952790246 >> v2:172.21.15.107:3300/0 conn(0x7f25f8159100 0x7f25f806e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:36.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25efe00640 1 -- 172.21.15.59:0/3952790246 >> v1:172.21.15.59:6789/0 conn(0x7f25f815f510 legacy=0x7f25f815c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:36.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.733+0000 7f25efe00640 1 -- 172.21.15.59:0/3952790246 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f80b4ff0 con 0x7f25f80b44e0 2024-05-30T16:57:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.737+0000 7f25efe00640 1 --2- 172.21.15.59:0/3952790246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f80b44e0 0x7f25f815efd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f25f806c8f0 tx=0x7f25e001e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83795897196b330d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.741+0000 7f25f7e00640 1 -- 172.21.15.59:0/3952790246 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e00b2600 con 0x7f25f80b44e0 2024-05-30T16:57:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.741+0000 7f25f7e00640 1 -- 172.21.15.59:0/3952790246 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e00b27a0 con 0x7f25f80b44e0 2024-05-30T16:57:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.741+0000 7f25f7e00640 1 -- 172.21.15.59:0/3952790246 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e00b2b70 con 0x7f25f80b44e0 2024-05-30T16:57:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.741+0000 7f25ff800640 1 -- 172.21.15.59:0/3952790246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f80b44e0 msgr2=0x7f25f815efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.741+0000 7f25ff800640 1 --2- 172.21.15.59:0/3952790246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f80b44e0 0x7f25f815efd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f25f806c8f0 tx=0x7f25e001e5d0 comp rx=0 tx=0).stop 2024-05-30T16:57:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.741+0000 7f25ff800640 1 -- 172.21.15.59:0/3952790246 shutdown_connections 2024-05-30T16:57:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.741+0000 7f25ff800640 1 --2- 172.21.15.59:0/3952790246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f80b44e0 0x7f25f815efd0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.741+0000 7f25ff800640 1 --2- 172.21.15.59:0/3952790246 >> v2:172.21.15.107:3300/0 conn(0x7f25f8159100 0x7f25f806e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.741+0000 7f25ff800640 1 -- 172.21.15.59:0/3952790246 >> 172.21.15.59:0/3952790246 conn(0x7f25f806bdb0 msgr2=0x7f25f806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.741+0000 7f25ff800640 1 -- 172.21.15.59:0/3952790246 shutdown_connections 2024-05-30T16:57:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.741+0000 7f25ff800640 1 -- 172.21.15.59:0/3952790246 wait complete. 2024-05-30T16:57:36.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.745+0000 7f25ff800640 1 Processor -- start 2024-05-30T16:57:36.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.745+0000 7f25ff800640 1 -- start start 2024-05-30T16:57:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25ff800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f80b44e0 0x7f25f80b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25ff800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f25f8159100 0x7f25f80b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25ff800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25f815f510 0x7f25f814a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25ff800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f25f80b3530 con 0x7f25f80b44e0 2024-05-30T16:57:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25ff800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f25f80b33b0 con 0x7f25f815f510 2024-05-30T16:57:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25ff800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f25f80b36b0 con 0x7f25f8159100 2024-05-30T16:57:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25fce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f80b44e0 0x7f25f80b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25fce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f80b44e0 0x7f25f80b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38052/0 (socket says 172.21.15.59:38052) 2024-05-30T16:57:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25fce00640 1 -- 172.21.15.59:0/2954493748 learned_addr learned my addr 172.21.15.59:0/2954493748 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25fce00640 1 -- 172.21.15.59:0/2954493748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f25f8159100 msgr2=0x7f25f80b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25fce00640 1 --2- 172.21.15.59:0/2954493748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f25f8159100 0x7f25f80b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25fce00640 1 -- 172.21.15.59:0/2954493748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25f815f510 msgr2=0x7f25f814a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25fce00640 1 --2- 172.21.15.59:0/2954493748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25f815f510 0x7f25f814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25fce00640 1 -- 172.21.15.59:0/2954493748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f80b0f30 con 0x7f25f80b44e0 2024-05-30T16:57:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25fce00640 1 --2- 172.21.15.59:0/2954493748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f80b44e0 0x7f25f80b0950 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f25e800d830 tx=0x7f25e800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.749+0000 7f25f5600640 1 -- 172.21.15.59:0/2954493748 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e800b6c0 con 0x7f25f80b44e0 2024-05-30T16:57:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.753+0000 7f25f5600640 1 -- 172.21.15.59:0/2954493748 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e8019070 con 0x7f25f80b44e0 2024-05-30T16:57:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.753+0000 7f25f5600640 1 -- 172.21.15.59:0/2954493748 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e800bae0 con 0x7f25f80b44e0 2024-05-30T16:57:36.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.753+0000 7f25ff800640 1 -- 172.21.15.59:0/2954493748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f80b1210 con 0x7f25f80b44e0 2024-05-30T16:57:36.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.753+0000 7f25ff800640 1 -- 172.21.15.59:0/2954493748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f80b17d0 con 0x7f25f80b44e0 2024-05-30T16:57:36.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.753+0000 7f25ff800640 1 -- 172.21.15.59:0/2954493748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f8068a90 con 0x7f25f80b44e0 2024-05-30T16:57:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.757+0000 7f25f5600640 1 -- 172.21.15.59:0/2954493748 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f25e800bc80 con 0x7f25f80b44e0 2024-05-30T16:57:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.757+0000 7f25f5600640 1 --2- 172.21.15.59:0/2954493748 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f25d4069460 0x7f25d406b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.757+0000 7f25f5600640 1 -- 172.21.15.59:0/2954493748 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f25e8085a80 con 0x7f25f80b44e0 2024-05-30T16:57:36.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.765+0000 7f25f5600640 1 -- 172.21.15.59:0/2954493748 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f25e8057a90 con 0x7f25f80b44e0 2024-05-30T16:57:36.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.829+0000 7f25efe00640 1 --2- 172.21.15.59:0/2954493748 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f25d4069460 0x7f25d406b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:36.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:36.881+0000 7f25efe00640 1 --2- 172.21.15.59:0/2954493748 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f25d4069460 0x7f25d406b920 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f25e00b1000 tx=0x7f25e0004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:37.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:37.081+0000 7f25ff800640 1 -- 172.21.15.59:0/2954493748 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69887", "target": ["mon-mgr", ""]}) -- 0x7f25f815fc60 con 0x7f25d4069460 2024-05-30T16:57:38.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25f5600640 1 -- 172.21.15.59:0/2954493748 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f25f815fc60 con 0x7f25d4069460 2024-05-30T16:57:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25ff800640 1 -- 172.21.15.59:0/2954493748 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f25d4069460 msgr2=0x7f25d406b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25ff800640 1 --2- 172.21.15.59:0/2954493748 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f25d4069460 0x7f25d406b920 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f25e00b1000 tx=0x7f25e0004740 comp rx=0 tx=0).stop 2024-05-30T16:57:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25ff800640 1 -- 172.21.15.59:0/2954493748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f80b44e0 msgr2=0x7f25f80b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25ff800640 1 --2- 172.21.15.59:0/2954493748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f80b44e0 0x7f25f80b0950 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f25e800d830 tx=0x7f25e800dcf0 comp rx=0 tx=0).stop 2024-05-30T16:57:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25ff800640 1 -- 172.21.15.59:0/2954493748 shutdown_connections 2024-05-30T16:57:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25ff800640 1 --2- 172.21.15.59:0/2954493748 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f25d4069460 0x7f25d406b920 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25ff800640 1 --2- 172.21.15.59:0/2954493748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25f815f510 0x7f25f814a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25ff800640 1 --2- 172.21.15.59:0/2954493748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f25f8159100 0x7f25f80b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25ff800640 1 --2- 172.21.15.59:0/2954493748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f80b44e0 0x7f25f80b0950 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25ff800640 1 -- 172.21.15.59:0/2954493748 >> 172.21.15.59:0/2954493748 conn(0x7f25f806bdb0 msgr2=0x7f25f815de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25ff800640 1 -- 172.21.15.59:0/2954493748 shutdown_connections 2024-05-30T16:57:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:38.737+0000 7f25ff800640 1 -- 172.21.15.59:0/2954493748 wait complete. 2024-05-30T16:57:38.762 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69888 2024-05-30T16:57:39.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.009+0000 7f4d38200640 1 Processor -- start 2024-05-30T16:57:39.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.009+0000 7f4d38200640 1 -- start start 2024-05-30T16:57:39.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.009+0000 7f4d38200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4d3015c800 0x7f4d3015d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:39.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.009+0000 7f4d38200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d3006c0c0 0x7f4d3015de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:39.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.009+0000 7f4d38200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d300cd4e0 con 0x7f4d3015da80 2024-05-30T16:57:39.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.009+0000 7f4d38200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4d300cd7c0 con 0x7f4d3015c800 2024-05-30T16:57:39.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.009+0000 7f4d38200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4d300cdaa0 con 0x7f4d3006c0c0 2024-05-30T16:57:39.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.009+0000 7f4d36200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d3006c0c0 0x7f4d3015de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:39.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.009+0000 7f4d36200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d3006c0c0 0x7f4d3015de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:56304/0 (socket says 172.21.15.59:56304) 2024-05-30T16:57:39.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.009+0000 7f4d36200640 1 -- 172.21.15.59:0/1644284663 learned_addr learned my addr 172.21.15.59:0/1644284663 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:39.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.009+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 181323235 0 0) 0x7f4d300cd4e0 con 0x7f4d3015da80 2024-05-30T16:57:39.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.009+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d18003530 con 0x7f4d3015da80 2024-05-30T16:57:39.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3417521071 0 0) 0x7f4d18003530 con 0x7f4d3015da80 2024-05-30T16:57:39.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d3006c0c0 msgr2=0x7f4d3015de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:39.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 --2- 172.21.15.59:0/1644284663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d3006c0c0 0x7f4d3015de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:39.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 >> v2:172.21.15.107:3300/0 conn(0x7f4d3015c800 msgr2=0x7f4d3015d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 --2- 172.21.15.59:0/1644284663 >> v2:172.21.15.107:3300/0 conn(0x7f4d3015c800 0x7f4d3015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3015d020 con 0x7f4d3015da80 2024-05-30T16:57:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f4d1c001680 con 0x7f4d3015da80 2024-05-30T16:57:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 >> v1:172.21.15.107:6789/0 conn(0x7f4d3015da80 legacy=0x7f4d3006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 --2- 172.21.15.59:0/1644284663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d180039c0 0x7f4d18003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 --2- 172.21.15.59:0/1644284663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d18004810 0x7f4d18004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 --2- 172.21.15.59:0/1644284663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d3006c0c0 0x7f4d180051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300cd7c0 con 0x7f4d18004810 2024-05-30T16:57:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300cdaa0 con 0x7f4d180039c0 2024-05-30T16:57:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1800bb90 con 0x7f4d3006c0c0 2024-05-30T16:57:39.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d34e00640 1 --2- 172.21.15.59:0/1644284663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d18004810 0x7f4d18004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:39.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d35800640 1 --2- 172.21.15.59:0/1644284663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d180039c0 0x7f4d18003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:39.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d34e00640 1 -- 172.21.15.59:0/1644284663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d3006c0c0 msgr2=0x7f4d180051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:39.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d34e00640 1 --2- 172.21.15.59:0/1644284663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d3006c0c0 0x7f4d180051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:39.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d34e00640 1 -- 172.21.15.59:0/1644284663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d180039c0 msgr2=0x7f4d18003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:39.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d34e00640 1 --2- 172.21.15.59:0/1644284663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d180039c0 0x7f4d18003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:39.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d34e00640 1 -- 172.21.15.59:0/1644284663 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d18003530 con 0x7f4d18004810 2024-05-30T16:57:39.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.013+0000 7f4d35800640 1 --2- 172.21.15.59:0/1644284663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d180039c0 0x7f4d18003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:57:39.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.017+0000 7f4d34e00640 1 --2- 172.21.15.59:0/1644284663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d18004810 0x7f4d18004c90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00c190 tx=0x7f4d1c01f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d947061426c29be server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:39.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.017+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0b4070 con 0x7f4d18004810 2024-05-30T16:57:39.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.017+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0af600 con 0x7f4d18004810 2024-05-30T16:57:39.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.017+0000 7f4d2fe00640 1 -- 172.21.15.59:0/1644284663 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c007c70 con 0x7f4d18004810 2024-05-30T16:57:39.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.017+0000 7f4d38200640 1 -- 172.21.15.59:0/1644284663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d18004810 msgr2=0x7f4d18004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:39.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.017+0000 7f4d38200640 1 --2- 172.21.15.59:0/1644284663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d18004810 0x7f4d18004c90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00c190 tx=0x7f4d1c01f330 comp rx=0 tx=0).stop 2024-05-30T16:57:39.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.017+0000 7f4d36200640 1 -- 172.21.15.59:0/1644284663 reap_dead start 2024-05-30T16:57:39.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.017+0000 7f4d38200640 1 -- 172.21.15.59:0/1644284663 shutdown_connections 2024-05-30T16:57:39.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.017+0000 7f4d38200640 1 -- 172.21.15.59:0/1644284663 >> 172.21.15.59:0/1644284663 conn(0x7f4d300b2f50 msgr2=0x7f4d300b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:39.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.017+0000 7f4d38200640 1 -- 172.21.15.59:0/1644284663 shutdown_connections 2024-05-30T16:57:39.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.017+0000 7f4d38200640 1 -- 172.21.15.59:0/1644284663 wait complete. 2024-05-30T16:57:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d38200640 1 Processor -- start 2024-05-30T16:57:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d38200640 1 -- start start 2024-05-30T16:57:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d38200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d18004810 0x7f4d30155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d38200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d301e93a0 0x7f4d300b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d38200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d300c7030 0x7f4d300c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d38200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300b3a70 con 0x7f4d18004810 2024-05-30T16:57:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d38200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300b3bf0 con 0x7f4d300c7030 2024-05-30T16:57:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d38200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4d300c4a50 con 0x7f4d301e93a0 2024-05-30T16:57:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d35800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d18004810 0x7f4d30155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d35800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d18004810 0x7f4d30155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38072/0 (socket says 172.21.15.59:38072) 2024-05-30T16:57:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d35800640 1 -- 172.21.15.59:0/2266144988 learned_addr learned my addr 172.21.15.59:0/2266144988 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d36200640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d300c7030 0x7f4d300c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d35800640 1 -- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d301e93a0 msgr2=0x7f4d300b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d35800640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d301e93a0 0x7f4d300b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d35800640 1 -- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d300c7030 msgr2=0x7f4d300c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d35800640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d300c7030 0x7f4d300c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d35800640 1 -- 172.21.15.59:0/2266144988 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d300b5e20 con 0x7f4d18004810 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.021+0000 7f4d36200640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d300c7030 0x7f4d300c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.025+0000 7f4d35800640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d18004810 0x7f4d30155440 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c820 tx=0x7f4d2400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.025+0000 7f4d2d600640 1 -- 172.21.15.59:0/2266144988 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24004230 con 0x7f4d18004810 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.025+0000 7f4d2d600640 1 -- 172.21.15.59:0/2266144988 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d240043d0 con 0x7f4d18004810 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.025+0000 7f4d2d600640 1 -- 172.21.15.59:0/2266144988 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24007a10 con 0x7f4d18004810 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.025+0000 7f4d38200640 1 -- 172.21.15.59:0/2266144988 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d300b6100 con 0x7f4d18004810 2024-05-30T16:57:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.025+0000 7f4d38200640 1 -- 172.21.15.59:0/2266144988 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d300b66c0 con 0x7f4d18004810 2024-05-30T16:57:39.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.025+0000 7f4d38200640 1 -- 172.21.15.59:0/2266144988 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d30068a90 con 0x7f4d18004810 2024-05-30T16:57:39.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.029+0000 7f4d2d600640 1 -- 172.21.15.59:0/2266144988 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f4d24007bb0 con 0x7f4d18004810 2024-05-30T16:57:39.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.029+0000 7f4d2d600640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d10069490 0x7f4d1006b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:39.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.029+0000 7f4d2d600640 1 -- 172.21.15.59:0/2266144988 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f4d24085860 con 0x7f4d18004810 2024-05-30T16:57:39.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.033+0000 7f4d2d600640 1 -- 172.21.15.59:0/2266144988 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d24015020 con 0x7f4d18004810 2024-05-30T16:57:39.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.085+0000 7f4d34e00640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d10069490 0x7f4d1006b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:39.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.133+0000 7f4d34e00640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d10069490 0x7f4d1006b950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0b1000 tx=0x7f4d3015d1f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:39.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:39.405+0000 7f4d38200640 1 -- 172.21.15.59:0/2266144988 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69888", "target": ["mon-mgr", ""]}) -- 0x7f4d300d0f60 con 0x7f4d10069490 2024-05-30T16:57:40.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.585+0000 7f4d2d600640 1 -- 172.21.15.59:0/2266144988 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4d300d0f60 con 0x7f4d10069490 2024-05-30T16:57:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.589+0000 7f4d38200640 1 -- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d10069490 msgr2=0x7f4d1006b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.589+0000 7f4d38200640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d10069490 0x7f4d1006b950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0b1000 tx=0x7f4d3015d1f0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.589+0000 7f4d38200640 1 -- 172.21.15.59:0/2266144988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d18004810 msgr2=0x7f4d30155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.589+0000 7f4d38200640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d18004810 0x7f4d30155440 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c820 tx=0x7f4d2400cce0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.589+0000 7f4d38200640 1 -- 172.21.15.59:0/2266144988 shutdown_connections 2024-05-30T16:57:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.589+0000 7f4d38200640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d10069490 0x7f4d1006b950 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.589+0000 7f4d38200640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d300c7030 0x7f4d300c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.589+0000 7f4d38200640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d301e93a0 0x7f4d300b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.589+0000 7f4d38200640 1 --2- 172.21.15.59:0/2266144988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d18004810 0x7f4d30155440 secure :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c820 tx=0x7f4d2400cce0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.589+0000 7f4d38200640 1 -- 172.21.15.59:0/2266144988 >> 172.21.15.59:0/2266144988 conn(0x7f4d300b2f50 msgr2=0x7f4d300b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.589+0000 7f4d38200640 1 -- 172.21.15.59:0/2266144988 shutdown_connections 2024-05-30T16:57:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.589+0000 7f4d38200640 1 -- 172.21.15.59:0/2266144988 wait complete. 2024-05-30T16:57:40.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone69889 2024-05-30T16:57:40.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c91c00640 1 Processor -- start 2024-05-30T16:57:40.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c91c00640 1 -- start start 2024-05-30T16:57:40.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c91c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c8c1447c0 0x7f0c8c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:40.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c91c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0c8c072df0 0x7f0c8c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:40.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c91c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8c0b39d0 con 0x7f0c8c0b4a70 2024-05-30T16:57:40.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c91c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0c8c0b3cb0 con 0x7f0c8c072df0 2024-05-30T16:57:40.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c91c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0c8c0b3f90 con 0x7f0c8c1447c0 2024-05-30T16:57:40.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c8a000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0c8c0b4a70 0x7f0c8c0726e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56954/0 (socket says 172.21.15.59:56954) 2024-05-30T16:57:40.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c8a000640 1 -- 172.21.15.59:0/608793396 learned_addr learned my addr 172.21.15.59:0/608793396 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:40.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756914645 0 0) 0x7f0c8c0b39d0 con 0x7f0c8c0b4a70 2024-05-30T16:57:40.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c8b400640 1 --2- 172.21.15.59:0/608793396 >> v2:172.21.15.107:3300/0 conn(0x7f0c8c072df0 0x7f0c8c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:40.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c70003530 con 0x7f0c8c0b4a70 2024-05-30T16:57:40.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c8aa00640 1 --2- 172.21.15.59:0/608793396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c8c1447c0 0x7f0c8c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2772745345 0 0) 0x7f0c70003530 con 0x7f0c8c0b4a70 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c8c1447c0 msgr2=0x7f0c8c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 --2- 172.21.15.59:0/608793396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c8c1447c0 0x7f0c8c0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 >> v2:172.21.15.107:3300/0 conn(0x7f0c8c072df0 msgr2=0x7f0c8c06f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 --2- 172.21.15.59:0/608793396 >> v2:172.21.15.107:3300/0 conn(0x7f0c8c072df0 0x7f0c8c06f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c0b4270 con 0x7f0c8c0b4a70 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f0c78001680 con 0x7f0c8c0b4a70 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 >> v1:172.21.15.59:6789/0 conn(0x7f0c8c0b4a70 legacy=0x7f0c8c0726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 --2- 172.21.15.59:0/608793396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c700039c0 0x7f0c70003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 --2- 172.21.15.59:0/608793396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c8c1447c0 0x7f0c70004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 --2- 172.21.15.59:0/608793396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c70004d50 0x7f0c700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c0b3cb0 con 0x7f0c700039c0 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c0b3f90 con 0x7f0c70004d50 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.877+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7000ba50 con 0x7f0c8c1447c0 2024-05-30T16:57:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.881+0000 7f0c8aa00640 1 --2- 172.21.15.59:0/608793396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c700039c0 0x7f0c70003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:40.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.881+0000 7f0c8aa00640 1 -- 172.21.15.59:0/608793396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c8c1447c0 msgr2=0x7f0c70004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:40.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.881+0000 7f0c8aa00640 1 --2- 172.21.15.59:0/608793396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c8c1447c0 0x7f0c70004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.881+0000 7f0c8aa00640 1 -- 172.21.15.59:0/608793396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c70004d50 msgr2=0x7f0c700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:40.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.881+0000 7f0c8aa00640 1 --2- 172.21.15.59:0/608793396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c70004d50 0x7f0c700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.881+0000 7f0c8aa00640 1 -- 172.21.15.59:0/608793396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c0b4270 con 0x7f0c700039c0 2024-05-30T16:57:40.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.885+0000 7f0c8aa00640 1 --2- 172.21.15.59:0/608793396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c700039c0 0x7f0c70003de0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00ba00 tx=0x7f0c7c01c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6118ea03d0f6220 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:40.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.885+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0b3070 con 0x7f0c700039c0 2024-05-30T16:57:40.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.885+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7c0ae680 con 0x7f0c700039c0 2024-05-30T16:57:40.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.885+0000 7f0c89600640 1 -- 172.21.15.59:0/608793396 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00b600 con 0x7f0c700039c0 2024-05-30T16:57:40.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.889+0000 7f0c91c00640 1 -- 172.21.15.59:0/608793396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c700039c0 msgr2=0x7f0c70003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:40.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.889+0000 7f0c91c00640 1 --2- 172.21.15.59:0/608793396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c700039c0 0x7f0c70003de0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00ba00 tx=0x7f0c7c01c6a0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.889+0000 7f0c8b400640 1 -- 172.21.15.59:0/608793396 reap_dead start 2024-05-30T16:57:40.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.889+0000 7f0c91c00640 1 -- 172.21.15.59:0/608793396 shutdown_connections 2024-05-30T16:57:40.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.889+0000 7f0c91c00640 1 -- 172.21.15.59:0/608793396 >> 172.21.15.59:0/608793396 conn(0x7f0c8c06bdb0 msgr2=0x7f0c8c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:40.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.889+0000 7f0c91c00640 1 -- 172.21.15.59:0/608793396 shutdown_connections 2024-05-30T16:57:40.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.889+0000 7f0c91c00640 1 -- 172.21.15.59:0/608793396 wait complete. 2024-05-30T16:57:40.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.889+0000 7f0c91c00640 1 Processor -- start 2024-05-30T16:57:40.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.889+0000 7f0c91c00640 1 -- start start 2024-05-30T16:57:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c91c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c700039c0 0x7f0c8c1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c91c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c8c15ae70 0x7f0c8c1f7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c91c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c8c153a30 0x7f0c8c165ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c91c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c0ad9d0 con 0x7f0c8c15ae70 2024-05-30T16:57:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c91c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c0ad850 con 0x7f0c700039c0 2024-05-30T16:57:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c91c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0c8c0adb50 con 0x7f0c8c153a30 2024-05-30T16:57:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c8a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c8c15ae70 0x7f0c8c1f7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c8a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c8c15ae70 0x7f0c8c1f7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38096/0 (socket says 172.21.15.59:38096) 2024-05-30T16:57:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c8a000640 1 -- 172.21.15.59:0/2913623878 learned_addr learned my addr 172.21.15.59:0/2913623878 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:40.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c8a000640 1 -- 172.21.15.59:0/2913623878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c8c153a30 msgr2=0x7f0c8c165ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:40.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c8a000640 1 --2- 172.21.15.59:0/2913623878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c8c153a30 0x7f0c8c165ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c8a000640 1 -- 172.21.15.59:0/2913623878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c700039c0 msgr2=0x7f0c8c1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:40.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c8a000640 1 --2- 172.21.15.59:0/2913623878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c700039c0 0x7f0c8c1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:40.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c8a000640 1 -- 172.21.15.59:0/2913623878 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c15b300 con 0x7f0c8c15ae70 2024-05-30T16:57:40.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c8a000640 1 --2- 172.21.15.59:0/2913623878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c8c15ae70 0x7f0c8c1f7060 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800c8c0 tx=0x7f0c7800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:40.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c82a00640 1 -- 172.21.15.59:0/2913623878 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c78018070 con 0x7f0c8c15ae70 2024-05-30T16:57:40.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c82a00640 1 -- 172.21.15.59:0/2913623878 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c78007520 con 0x7f0c8c15ae70 2024-05-30T16:57:40.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c82a00640 1 -- 172.21.15.59:0/2913623878 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c78004a30 con 0x7f0c8c15ae70 2024-05-30T16:57:40.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c91c00640 1 -- 172.21.15.59:0/2913623878 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8c15b5e0 con 0x7f0c8c15ae70 2024-05-30T16:57:40.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.893+0000 7f0c91c00640 1 -- 172.21.15.59:0/2913623878 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8c15bba0 con 0x7f0c8c15ae70 2024-05-30T16:57:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.897+0000 7f0c91c00640 1 -- 172.21.15.59:0/2913623878 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c8c068a90 con 0x7f0c8c15ae70 2024-05-30T16:57:40.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.901+0000 7f0c82a00640 1 -- 172.21.15.59:0/2913623878 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f0c7801b070 con 0x7f0c8c15ae70 2024-05-30T16:57:40.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.901+0000 7f0c82a00640 1 --2- 172.21.15.59:0/2913623878 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c6c0694b0 0x7f0c6c06b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:40.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.901+0000 7f0c82a00640 1 -- 172.21.15.59:0/2913623878 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f0c780858d0 con 0x7f0c8c15ae70 2024-05-30T16:57:40.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.901+0000 7f0c8aa00640 1 --2- 172.21.15.59:0/2913623878 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c6c0694b0 0x7f0c6c06b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:40.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.905+0000 7f0c8aa00640 1 --2- 172.21.15.59:0/2913623878 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c6c0694b0 0x7f0c6c06b970 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0b0000 tx=0x7f0c7c004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:40.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:40.905+0000 7f0c82a00640 1 -- 172.21.15.59:0/2913623878 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0c78056f90 con 0x7f0c8c15ae70 2024-05-30T16:57:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:41.213+0000 7f0c91c00640 1 -- 172.21.15.59:0/2913623878 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone69889", "target": ["mon-mgr", ""]}) -- 0x7f0c8c06ddf0 con 0x7f0c6c0694b0 2024-05-30T16:57:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.157+0000 7f0c82a00640 1 -- 172.21.15.59:0/2913623878 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0c8c06ddf0 con 0x7f0c6c0694b0 2024-05-30T16:57:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.161+0000 7f0c91c00640 1 -- 172.21.15.59:0/2913623878 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c6c0694b0 msgr2=0x7f0c6c06b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.161+0000 7f0c91c00640 1 --2- 172.21.15.59:0/2913623878 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c6c0694b0 0x7f0c6c06b970 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0b0000 tx=0x7f0c7c004740 comp rx=0 tx=0).stop 2024-05-30T16:57:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.161+0000 7f0c91c00640 1 -- 172.21.15.59:0/2913623878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c8c15ae70 msgr2=0x7f0c8c1f7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.161+0000 7f0c91c00640 1 --2- 172.21.15.59:0/2913623878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c8c15ae70 0x7f0c8c1f7060 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800c8c0 tx=0x7f0c7800cd80 comp rx=0 tx=0).stop 2024-05-30T16:57:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.161+0000 7f0c91c00640 1 -- 172.21.15.59:0/2913623878 shutdown_connections 2024-05-30T16:57:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.161+0000 7f0c91c00640 1 --2- 172.21.15.59:0/2913623878 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c6c0694b0 0x7f0c6c06b970 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.161+0000 7f0c91c00640 1 --2- 172.21.15.59:0/2913623878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c8c153a30 0x7f0c8c165ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.161+0000 7f0c91c00640 1 --2- 172.21.15.59:0/2913623878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c8c15ae70 0x7f0c8c1f7060 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.161+0000 7f0c91c00640 1 --2- 172.21.15.59:0/2913623878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c700039c0 0x7f0c8c1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.161+0000 7f0c91c00640 1 -- 172.21.15.59:0/2913623878 >> 172.21.15.59:0/2913623878 conn(0x7f0c8c06bdb0 msgr2=0x7f0c8c0ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.161+0000 7f0c91c00640 1 -- 172.21.15.59:0/2913623878 shutdown_connections 2024-05-30T16:57:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.161+0000 7f0c91c00640 1 -- 172.21.15.59:0/2913623878 wait complete. 2024-05-30T16:57:42.199 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone698810 2024-05-30T16:57:42.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.413+0000 7fa0f3000640 1 Processor -- start 2024-05-30T16:57:42.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0f3000640 1 -- start start 2024-05-30T16:57:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0f3000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec09b890 0x7fa0ec06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0f3000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa0ec162340 0x7fa0ec1627d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0f3000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0ec0d0fb0 con 0x7fa0ec09b4b0 2024-05-30T16:57:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0f3000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa0ec06fef0 con 0x7fa0ec162340 2024-05-30T16:57:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0f3000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa0ec0d1290 con 0x7fa0ec09b890 2024-05-30T16:57:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0f1c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa0ec09b4b0 0x7fa0ec0d0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60666/0 (socket says 172.21.15.59:60666) 2024-05-30T16:57:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0f1c00640 1 -- 172.21.15.59:0/3308689094 learned_addr learned my addr 172.21.15.59:0/3308689094 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0f1200640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec09b890 0x7fa0ec06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0f2600640 1 --2- 172.21.15.59:0/3308689094 >> v2:172.21.15.107:3300/0 conn(0x7fa0ec162340 0x7fa0ec1627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063684919 0 0) 0x7fa0ec0d0fb0 con 0x7fa0ec09b4b0 2024-05-30T16:57:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0d4003530 con 0x7fa0ec09b4b0 2024-05-30T16:57:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4037339139 0 0) 0x7fa0d4003530 con 0x7fa0ec09b4b0 2024-05-30T16:57:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec09b890 msgr2=0x7fa0ec06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec09b890 0x7fa0ec06cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 >> v2:172.21.15.107:3300/0 conn(0x7fa0ec162340 msgr2=0x7fa0ec1627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 --2- 172.21.15.59:0/3308689094 >> v2:172.21.15.107:3300/0 conn(0x7fa0ec162340 0x7fa0ec1627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ec0d1570 con 0x7fa0ec09b4b0 2024-05-30T16:57:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fa0e0001680 con 0x7fa0ec09b4b0 2024-05-30T16:57:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 >> v1:172.21.15.59:6789/0 conn(0x7fa0ec09b4b0 legacy=0x7fa0ec0d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d40039c0 0x7fa0d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0d4004810 0x7fa0d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0d40051d0 0x7fa0d400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ec06fef0 con 0x7fa0d40039c0 2024-05-30T16:57:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ec0d1290 con 0x7fa0d40051d0 2024-05-30T16:57:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.417+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d400bf60 con 0x7fa0d4004810 2024-05-30T16:57:42.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.421+0000 7fa0f1c00640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d40039c0 0x7fa0d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:42.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.421+0000 7fa0f1200640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0d4004810 0x7fa0d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:42.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.421+0000 7fa0f1c00640 1 -- 172.21.15.59:0/3308689094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0d4004810 msgr2=0x7fa0d4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:42.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.421+0000 7fa0f1c00640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0d4004810 0x7fa0d4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:42.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.421+0000 7fa0f1c00640 1 -- 172.21.15.59:0/3308689094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0d40051d0 msgr2=0x7fa0d400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:42.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.421+0000 7fa0f2600640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0d40051d0 0x7fa0d400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:42.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.421+0000 7fa0f1c00640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0d40051d0 0x7fa0d400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:42.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.421+0000 7fa0f1c00640 1 -- 172.21.15.59:0/3308689094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d4003530 con 0x7fa0d40039c0 2024-05-30T16:57:42.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.421+0000 7fa0f2600640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0d40051d0 0x7fa0d400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:57:42.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.425+0000 7fa0f1c00640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d40039c0 0x7fa0d4003de0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000c270 tx=0x7fa0e001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e8d5e810c6e788 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:42.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.425+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0007d60 con 0x7fa0d40039c0 2024-05-30T16:57:42.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.425+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e00a9020 con 0x7fa0d40039c0 2024-05-30T16:57:42.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.425+0000 7fa0ebe00640 1 -- 172.21.15.59:0/3308689094 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0005ae0 con 0x7fa0d40039c0 2024-05-30T16:57:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.425+0000 7fa0f3000640 1 -- 172.21.15.59:0/3308689094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d40039c0 msgr2=0x7fa0d4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.425+0000 7fa0f3000640 1 --2- 172.21.15.59:0/3308689094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d40039c0 0x7fa0d4003de0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000c270 tx=0x7fa0e001ccc0 comp rx=0 tx=0).stop 2024-05-30T16:57:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.425+0000 7fa0f2600640 1 -- 172.21.15.59:0/3308689094 reap_dead start 2024-05-30T16:57:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.425+0000 7fa0f3000640 1 -- 172.21.15.59:0/3308689094 shutdown_connections 2024-05-30T16:57:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.425+0000 7fa0f3000640 1 -- 172.21.15.59:0/3308689094 >> 172.21.15.59:0/3308689094 conn(0x7fa0ec0b3ec0 msgr2=0x7fa0ec0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.425+0000 7fa0f3000640 1 -- 172.21.15.59:0/3308689094 shutdown_connections 2024-05-30T16:57:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.425+0000 7fa0f3000640 1 -- 172.21.15.59:0/3308689094 wait complete. 2024-05-30T16:57:42.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.429+0000 7fa0f3000640 1 Processor -- start 2024-05-30T16:57:42.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.429+0000 7fa0f3000640 1 -- start start 2024-05-30T16:57:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.429+0000 7fa0f3000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec15c660 0x7fa0ec0b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.429+0000 7fa0f3000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec0b5d40 0x7fa0ec0b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f3000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec0b7140 0x7fa0ec15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f3000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ec15fbf0 con 0x7fa0ec0b5d40 2024-05-30T16:57:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f3000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ec15fa70 con 0x7fa0ec15c660 2024-05-30T16:57:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f3000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa0ec070360 con 0x7fa0ec0b7140 2024-05-30T16:57:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec0b5d40 0x7fa0ec0b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:42.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec0b5d40 0x7fa0ec0b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49842/0 (socket says 172.21.15.59:49842) 2024-05-30T16:57:42.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f1200640 1 -- 172.21.15.59:0/4064416226 learned_addr learned my addr 172.21.15.59:0/4064416226 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f1c00640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec15c660 0x7fa0ec0b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f2600640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec0b7140 0x7fa0ec15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f1200640 1 -- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec0b7140 msgr2=0x7fa0ec15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f1200640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec0b7140 0x7fa0ec15ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f1200640 1 -- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec15c660 msgr2=0x7fa0ec0b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f1200640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec15c660 0x7fa0ec0b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f1200640 1 -- 172.21.15.59:0/4064416226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ec0b6370 con 0x7fa0ec0b5d40 2024-05-30T16:57:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f1c00640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec15c660 0x7fa0ec0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:57:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f1200640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec0b5d40 0x7fa0ec0b6c00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8011630 tx=0x7fa0d8011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0e9600640 1 -- 172.21.15.59:0/4064416226 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d800f8c0 con 0x7fa0ec0b5d40 2024-05-30T16:57:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0e9600640 1 -- 172.21.15.59:0/4064416226 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d800fa60 con 0x7fa0ec0b5d40 2024-05-30T16:57:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f3000640 1 -- 172.21.15.59:0/4064416226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0ec0b6650 con 0x7fa0ec0b5d40 2024-05-30T16:57:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0e9600640 1 -- 172.21.15.59:0/4064416226 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d800fe50 con 0x7fa0ec0b5d40 2024-05-30T16:57:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f3000640 1 -- 172.21.15.59:0/4064416226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0ec15ca40 con 0x7fa0ec0b5d40 2024-05-30T16:57:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0f3000640 1 -- 172.21.15.59:0/4064416226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0ec068a90 con 0x7fa0ec0b5d40 2024-05-30T16:57:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.433+0000 7fa0e9600640 1 -- 172.21.15.59:0/4064416226 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7fa0d8015460 con 0x7fa0ec0b5d40 2024-05-30T16:57:42.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.437+0000 7fa0e9600640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0cc069490 0x7fa0cc06b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:42.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.437+0000 7fa0e9600640 1 -- 172.21.15.59:0/4064416226 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7fa0d80861e0 con 0x7fa0ec0b5d40 2024-05-30T16:57:42.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.437+0000 7fa0f1c00640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0cc069490 0x7fa0cc06b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:42.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.441+0000 7fa0f1c00640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0cc069490 0x7fa0cc06b950 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00aa000 tx=0x7fa0e0001ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:42.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.441+0000 7fa0e9600640 1 -- 172.21.15.59:0/4064416226 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa0d8019030 con 0x7fa0ec0b5d40 2024-05-30T16:57:42.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:42.753+0000 7fa0f3000640 1 -- 172.21.15.59:0/4064416226 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone698810", "target": ["mon-mgr", ""]}) -- 0x7fa0ec0b7520 con 0x7fa0cc069490 2024-05-30T16:57:43.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.709+0000 7fa0e9600640 1 -- 172.21.15.59:0/4064416226 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa0ec0b7520 con 0x7fa0cc069490 2024-05-30T16:57:43.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.713+0000 7fa0f3000640 1 -- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0cc069490 msgr2=0x7fa0cc06b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:43.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.713+0000 7fa0f3000640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0cc069490 0x7fa0cc06b950 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00aa000 tx=0x7fa0e0001ac0 comp rx=0 tx=0).stop 2024-05-30T16:57:43.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.713+0000 7fa0f3000640 1 -- 172.21.15.59:0/4064416226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec0b5d40 msgr2=0x7fa0ec0b6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:43.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.713+0000 7fa0f3000640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec0b5d40 0x7fa0ec0b6c00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8011630 tx=0x7fa0d8011af0 comp rx=0 tx=0).stop 2024-05-30T16:57:43.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.713+0000 7fa0f3000640 1 -- 172.21.15.59:0/4064416226 shutdown_connections 2024-05-30T16:57:43.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.713+0000 7fa0f3000640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa0cc069490 0x7fa0cc06b950 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:43.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.713+0000 7fa0f3000640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0ec0b7140 0x7fa0ec15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:43.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.713+0000 7fa0f3000640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0ec0b5d40 0x7fa0ec0b6c00 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:43.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.713+0000 7fa0f3000640 1 --2- 172.21.15.59:0/4064416226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0ec15c660 0x7fa0ec0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:43.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.713+0000 7fa0f3000640 1 -- 172.21.15.59:0/4064416226 >> 172.21.15.59:0/4064416226 conn(0x7fa0ec0b3ec0 msgr2=0x7fa0ec15e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:43.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.713+0000 7fa0f3000640 1 -- 172.21.15.59:0/4064416226 shutdown_connections 2024-05-30T16:57:43.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.713+0000 7fa0f3000640 1 -- 172.21.15.59:0/4064416226 wait complete. 2024-05-30T16:57:43.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone698811 2024-05-30T16:57:43.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b13000640 1 Processor -- start 2024-05-30T16:57:43.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b13000640 1 -- start start 2024-05-30T16:57:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b13000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b0c1569e0 0x7f1b0c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b13000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b0c0ad2b0 0x7f1b0c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b13000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b0c0ad770 con 0x7f1b0c0d0660 2024-05-30T16:57:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b13000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0c15cb40 con 0x7f1b0c0ad2b0 2024-05-30T16:57:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b13000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0c15ce20 con 0x7f1b0c1569e0 2024-05-30T16:57:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b0b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b0c0ad2b0 0x7f1b0c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b11000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1b0c0d0660 0x7f1b0c0b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60678/0 (socket says 172.21.15.59:60678) 2024-05-30T16:57:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b11000640 1 -- 172.21.15.59:0/3135723161 learned_addr learned my addr 172.21.15.59:0/3135723161 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b0b400640 1 -- 172.21.15.59:0/3135723161 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b0c1569e0 msgr2=0x7f1b0c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b0b400640 1 --2- 172.21.15.59:0/3135723161 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b0c1569e0 0x7f1b0c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b0b400640 1 -- 172.21.15.59:0/3135723161 >> v1:172.21.15.59:6789/0 conn(0x7f1b0c0d0660 legacy=0x7f1b0c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:43.993+0000 7f1b0b400640 1 -- 172.21.15.59:0/3135723161 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c15d100 con 0x7f1b0c0ad2b0 2024-05-30T16:57:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.001+0000 7f1b0b400640 1 --2- 172.21.15.59:0/3135723161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c0ad2b0 0x7f1b0c0cf9f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f1af80097c0 tx=0x7f1af801c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2214558141a2608b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.001+0000 7f1b0aa00640 1 -- 172.21.15.59:0/3135723161 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af80b0070 con 0x7f1b0c0ad2b0 2024-05-30T16:57:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.001+0000 7f1b0aa00640 1 -- 172.21.15.59:0/3135723161 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af80ab600 con 0x7f1b0c0ad2b0 2024-05-30T16:57:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.001+0000 7f1b0aa00640 1 -- 172.21.15.59:0/3135723161 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af80ab9d0 con 0x7f1b0c0ad2b0 2024-05-30T16:57:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.001+0000 7f1b13000640 1 -- 172.21.15.59:0/3135723161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c0ad2b0 msgr2=0x7f1b0c0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.001+0000 7f1b13000640 1 --2- 172.21.15.59:0/3135723161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c0ad2b0 0x7f1b0c0cf9f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f1af80097c0 tx=0x7f1af801c2a0 comp rx=0 tx=0).stop 2024-05-30T16:57:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.001+0000 7f1b13000640 1 -- 172.21.15.59:0/3135723161 shutdown_connections 2024-05-30T16:57:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.001+0000 7f1b13000640 1 --2- 172.21.15.59:0/3135723161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c0ad2b0 0x7f1b0c0cf9f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.001+0000 7f1b13000640 1 --2- 172.21.15.59:0/3135723161 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b0c1569e0 0x7f1b0c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.001+0000 7f1b13000640 1 -- 172.21.15.59:0/3135723161 >> 172.21.15.59:0/3135723161 conn(0x7f1b0c06bdb0 msgr2=0x7f1b0c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.001+0000 7f1b13000640 1 -- 172.21.15.59:0/3135723161 shutdown_connections 2024-05-30T16:57:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.001+0000 7f1b13000640 1 -- 172.21.15.59:0/3135723161 wait complete. 2024-05-30T16:57:44.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.005+0000 7f1b13000640 1 Processor -- start 2024-05-30T16:57:44.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.005+0000 7f1b13000640 1 -- start start 2024-05-30T16:57:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b13000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b0c0ad2b0 0x7f1b0c15f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b13000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b0c0d0660 0x7f1b0c14b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b13000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c1569e0 0x7f1b0c1504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b13000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c0cff30 con 0x7f1b0c1569e0 2024-05-30T16:57:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b13000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c0ada50 con 0x7f1b0c0d0660 2024-05-30T16:57:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b13000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0c0d00b0 con 0x7f1b0c0ad2b0 2024-05-30T16:57:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b11000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c1569e0 0x7f1b0c1504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b11000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c1569e0 0x7f1b0c1504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49854/0 (socket says 172.21.15.59:49854) 2024-05-30T16:57:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b11000640 1 -- 172.21.15.59:0/150698617 learned_addr learned my addr 172.21.15.59:0/150698617 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b11000640 1 -- 172.21.15.59:0/150698617 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b0c0ad2b0 msgr2=0x7f1b0c15f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:44.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b11000640 1 --2- 172.21.15.59:0/150698617 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b0c0ad2b0 0x7f1b0c15f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:44.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b11000640 1 -- 172.21.15.59:0/150698617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b0c0d0660 msgr2=0x7f1b0c14b680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:57:44.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b11000640 1 --2- 172.21.15.59:0/150698617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b0c0d0660 0x7f1b0c14b680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:44.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b11000640 1 -- 172.21.15.59:0/150698617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c0b0350 con 0x7f1b0c1569e0 2024-05-30T16:57:44.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b11000640 1 --2- 172.21.15.59:0/150698617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c1569e0 0x7f1b0c1504c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400e780 tx=0x7f1b0400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:44.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b03e00640 1 -- 172.21.15.59:0/150698617 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400f930 con 0x7f1b0c1569e0 2024-05-30T16:57:44.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b03e00640 1 -- 172.21.15.59:0/150698617 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b04013070 con 0x7f1b0c1569e0 2024-05-30T16:57:44.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b03e00640 1 -- 172.21.15.59:0/150698617 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400fd30 con 0x7f1b0c1569e0 2024-05-30T16:57:44.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b13000640 1 -- 172.21.15.59:0/150698617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0c0b0630 con 0x7f1b0c1569e0 2024-05-30T16:57:44.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.009+0000 7f1b13000640 1 -- 172.21.15.59:0/150698617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0c0b0bf0 con 0x7f1b0c1569e0 2024-05-30T16:57:44.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.013+0000 7f1b13000640 1 -- 172.21.15.59:0/150698617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0c068a90 con 0x7f1b0c1569e0 2024-05-30T16:57:44.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.013+0000 7f1b03e00640 1 -- 172.21.15.59:0/150698617 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f1b040090d0 con 0x7f1b0c1569e0 2024-05-30T16:57:44.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.013+0000 7f1b03e00640 1 --2- 172.21.15.59:0/150698617 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aec069490 0x7f1aec06b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:44.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.013+0000 7f1b03e00640 1 -- 172.21.15.59:0/150698617 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f1b040883f0 con 0x7f1b0c1569e0 2024-05-30T16:57:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.017+0000 7f1b0be00640 1 --2- 172.21.15.59:0/150698617 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aec069490 0x7f1aec06b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.017+0000 7f1b03e00640 1 -- 172.21.15.59:0/150698617 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1b0405a120 con 0x7f1b0c1569e0 2024-05-30T16:57:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.045+0000 7f1b0be00640 1 --2- 172.21.15.59:0/150698617 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aec069490 0x7f1aec06b950 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009690 tx=0x7f1afc006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:44.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:44.317+0000 7f1b13000640 1 -- 172.21.15.59:0/150698617 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone698811", "target": ["mon-mgr", ""]}) -- 0x7f1b0c06ccd0 con 0x7f1aec069490 2024-05-30T16:57:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.297+0000 7f1b03e00640 1 -- 172.21.15.59:0/150698617 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1b0c06ccd0 con 0x7f1aec069490 2024-05-30T16:57:45.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.301+0000 7f1b13000640 1 -- 172.21.15.59:0/150698617 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aec069490 msgr2=0x7f1aec06b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.301+0000 7f1b13000640 1 --2- 172.21.15.59:0/150698617 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aec069490 0x7f1aec06b950 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009690 tx=0x7f1afc006c00 comp rx=0 tx=0).stop 2024-05-30T16:57:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.301+0000 7f1b13000640 1 -- 172.21.15.59:0/150698617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c1569e0 msgr2=0x7f1b0c1504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.301+0000 7f1b13000640 1 --2- 172.21.15.59:0/150698617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c1569e0 0x7f1b0c1504c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400e780 tx=0x7f1b0400ec40 comp rx=0 tx=0).stop 2024-05-30T16:57:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.301+0000 7f1b13000640 1 -- 172.21.15.59:0/150698617 shutdown_connections 2024-05-30T16:57:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.301+0000 7f1b13000640 1 --2- 172.21.15.59:0/150698617 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1aec069490 0x7f1aec06b950 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.301+0000 7f1b13000640 1 --2- 172.21.15.59:0/150698617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c1569e0 0x7f1b0c1504c0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.301+0000 7f1b13000640 1 --2- 172.21.15.59:0/150698617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b0c0d0660 0x7f1b0c14b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.301+0000 7f1b13000640 1 --2- 172.21.15.59:0/150698617 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b0c0ad2b0 0x7f1b0c15f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.301+0000 7f1b13000640 1 -- 172.21.15.59:0/150698617 >> 172.21.15.59:0/150698617 conn(0x7f1b0c06bdb0 msgr2=0x7f1b0c0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.301+0000 7f1b13000640 1 -- 172.21.15.59:0/150698617 shutdown_connections 2024-05-30T16:57:45.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.301+0000 7f1b13000640 1 -- 172.21.15.59:0/150698617 wait complete. 2024-05-30T16:57:45.321 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone698812 2024-05-30T16:57:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.533+0000 7f1c0d800640 1 Processor -- start 2024-05-30T16:57:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.533+0000 7f1c0d800640 1 -- start start 2024-05-30T16:57:45.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1c0d800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c08159100 0x7f1c0806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:45.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1c0d800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c0815c010 0x7f1c0815c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:45.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1c0d800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c080b52d0 con 0x7f1c080b44e0 2024-05-30T16:57:45.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1c0d800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1c080b4a30 con 0x7f1c0815c010 2024-05-30T16:57:45.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1c0d800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1c080b4d10 con 0x7f1c08159100 2024-05-30T16:57:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1c07400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c0815c010 0x7f1c0815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1c06a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1c080b44e0 0x7f1c0815efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60684/0 (socket says 172.21.15.59:60684) 2024-05-30T16:57:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1c06a00640 1 -- 172.21.15.59:0/3706297705 learned_addr learned my addr 172.21.15.59:0/3706297705 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1bfea00640 1 --2- 172.21.15.59:0/3706297705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c08159100 0x7f1c0806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1c07400640 1 -- 172.21.15.59:0/3706297705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c08159100 msgr2=0x7f1c0806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1c07400640 1 --2- 172.21.15.59:0/3706297705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c08159100 0x7f1c0806e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1c07400640 1 -- 172.21.15.59:0/3706297705 >> v1:172.21.15.59:6789/0 conn(0x7f1c080b44e0 legacy=0x7f1c0815efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.537+0000 7f1c07400640 1 -- 172.21.15.59:0/3706297705 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c080b4ff0 con 0x7f1c0815c010 2024-05-30T16:57:45.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.541+0000 7f1c07400640 1 --2- 172.21.15.59:0/3706297705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c0815c010 0x7f1c0815c480 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009d90 tx=0x7f1c0001c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6f76b7c1fcf27 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.541+0000 7f1c06000640 1 -- 172.21.15.59:0/3706297705 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c000b2070 con 0x7f1c0815c010 2024-05-30T16:57:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.541+0000 7f1c06000640 1 -- 172.21.15.59:0/3706297705 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c000a58e0 con 0x7f1c0815c010 2024-05-30T16:57:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.541+0000 7f1c06000640 1 -- 172.21.15.59:0/3706297705 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c000a5cb0 con 0x7f1c0815c010 2024-05-30T16:57:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.541+0000 7f1c0d800640 1 -- 172.21.15.59:0/3706297705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c0815c010 msgr2=0x7f1c0815c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.541+0000 7f1c0d800640 1 --2- 172.21.15.59:0/3706297705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c0815c010 0x7f1c0815c480 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009d90 tx=0x7f1c0001c820 comp rx=0 tx=0).stop 2024-05-30T16:57:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.545+0000 7f1c0d800640 1 -- 172.21.15.59:0/3706297705 shutdown_connections 2024-05-30T16:57:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.545+0000 7f1c0d800640 1 --2- 172.21.15.59:0/3706297705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c0815c010 0x7f1c0815c480 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.545+0000 7f1c0d800640 1 --2- 172.21.15.59:0/3706297705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c08159100 0x7f1c0806e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.545+0000 7f1c0d800640 1 -- 172.21.15.59:0/3706297705 >> 172.21.15.59:0/3706297705 conn(0x7f1c0806bdb0 msgr2=0x7f1c0806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.545+0000 7f1c0d800640 1 -- 172.21.15.59:0/3706297705 shutdown_connections 2024-05-30T16:57:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.545+0000 7f1c0d800640 1 -- 172.21.15.59:0/3706297705 wait complete. 2024-05-30T16:57:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.545+0000 7f1c0d800640 1 Processor -- start 2024-05-30T16:57:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.545+0000 7f1c0d800640 1 -- start start 2024-05-30T16:57:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c0d800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c080b44e0 0x7f1c080999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c0d800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c08159100 0x7f1c081484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c0d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c0815c010 0x7f1c0815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c0d800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1c081662b0 con 0x7f1c0815c010 2024-05-30T16:57:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c0d800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1c08166130 con 0x7f1c08159100 2024-05-30T16:57:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c0d800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1c08166430 con 0x7f1c080b44e0 2024-05-30T16:57:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c07400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c0815c010 0x7f1c0815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c07400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c0815c010 0x7f1c0815ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49864/0 (socket says 172.21.15.59:49864) 2024-05-30T16:57:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c07400640 1 -- 172.21.15.59:0/2680059502 learned_addr learned my addr 172.21.15.59:0/2680059502 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c07400640 1 -- 172.21.15.59:0/2680059502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c080b44e0 msgr2=0x7f1c080999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c07400640 1 --2- 172.21.15.59:0/2680059502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c080b44e0 0x7f1c080999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c07400640 1 -- 172.21.15.59:0/2680059502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c08159100 msgr2=0x7f1c081484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c07400640 1 --2- 172.21.15.59:0/2680059502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c08159100 0x7f1c081484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c07400640 1 -- 172.21.15.59:0/2680059502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c08148d40 con 0x7f1c0815c010 2024-05-30T16:57:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c07400640 1 --2- 172.21.15.59:0/2680059502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c0815c010 0x7f1c0815ab60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1c000b0040 tx=0x7f1c000195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1bff400640 1 -- 172.21.15.59:0/2680059502 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c000b2050 con 0x7f1c0815c010 2024-05-30T16:57:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1bff400640 1 -- 172.21.15.59:0/2680059502 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c000be070 con 0x7f1c0815c010 2024-05-30T16:57:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1bff400640 1 -- 172.21.15.59:0/2680059502 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c000ada90 con 0x7f1c0815c010 2024-05-30T16:57:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c0d800640 1 -- 172.21.15.59:0/2680059502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c081443d0 con 0x7f1c0815c010 2024-05-30T16:57:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c0d800640 1 -- 172.21.15.59:0/2680059502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c081489e0 con 0x7f1c0815c010 2024-05-30T16:57:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.549+0000 7f1c0d800640 1 -- 172.21.15.59:0/2680059502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c08068a90 con 0x7f1c0815c010 2024-05-30T16:57:45.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.553+0000 7f1bff400640 1 -- 172.21.15.59:0/2680059502 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f1c000adc30 con 0x7f1c0815c010 2024-05-30T16:57:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.553+0000 7f1bff400640 1 --2- 172.21.15.59:0/2680059502 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1be4069460 0x7f1be406b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.553+0000 7f1bff400640 1 -- 172.21.15.59:0/2680059502 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5793+0+0 (secure 0 0 0) 0x7f1c001206b0 con 0x7f1c0815c010 2024-05-30T16:57:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.557+0000 7f1bfea00640 1 --2- 172.21.15.59:0/2680059502 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1be4069460 0x7f1be406b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.561+0000 7f1bfea00640 1 --2- 172.21.15.59:0/2680059502 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1be4069460 0x7f1be406b920 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80098f0 tx=0x7f1bf8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.561+0000 7f1bff400640 1 -- 172.21.15.59:0/2680059502 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1c00016560 con 0x7f1c0815c010 2024-05-30T16:57:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:45.849+0000 7f1c0d800640 1 -- 172.21.15.59:0/2680059502 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone698812", "target": ["mon-mgr", ""]}) -- 0x7f1c08149020 con 0x7f1be4069460 2024-05-30T16:57:46.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.945+0000 7f1bff400640 1 -- 172.21.15.59:0/2680059502 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1c08149020 con 0x7f1be4069460 2024-05-30T16:57:46.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.949+0000 7f1c0d800640 1 -- 172.21.15.59:0/2680059502 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1be4069460 msgr2=0x7f1be406b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:46.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.949+0000 7f1c0d800640 1 --2- 172.21.15.59:0/2680059502 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1be4069460 0x7f1be406b920 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80098f0 tx=0x7f1bf8008040 comp rx=0 tx=0).stop 2024-05-30T16:57:46.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.949+0000 7f1c0d800640 1 -- 172.21.15.59:0/2680059502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c0815c010 msgr2=0x7f1c0815ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.949+0000 7f1c0d800640 1 --2- 172.21.15.59:0/2680059502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c0815c010 0x7f1c0815ab60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1c000b0040 tx=0x7f1c000195c0 comp rx=0 tx=0).stop 2024-05-30T16:57:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.949+0000 7f1c0d800640 1 -- 172.21.15.59:0/2680059502 shutdown_connections 2024-05-30T16:57:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.949+0000 7f1c0d800640 1 --2- 172.21.15.59:0/2680059502 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1be4069460 0x7f1be406b920 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.949+0000 7f1c0d800640 1 --2- 172.21.15.59:0/2680059502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c0815c010 0x7f1c0815ab60 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.949+0000 7f1c0d800640 1 --2- 172.21.15.59:0/2680059502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c08159100 0x7f1c081484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.949+0000 7f1c0d800640 1 --2- 172.21.15.59:0/2680059502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c080b44e0 0x7f1c080999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.949+0000 7f1c0d800640 1 -- 172.21.15.59:0/2680059502 >> 172.21.15.59:0/2680059502 conn(0x7f1c0806bdb0 msgr2=0x7f1c081502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.949+0000 7f1c0d800640 1 -- 172.21.15.59:0/2680059502 shutdown_connections 2024-05-30T16:57:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:46.949+0000 7f1c0d800640 1 -- 172.21.15.59:0/2680059502 wait complete. 2024-05-30T16:57:46.977 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone698813 2024-05-30T16:57:47.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.209+0000 7f93e2c00640 1 Processor -- start 2024-05-30T16:57:47.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.209+0000 7f93e2c00640 1 -- start start 2024-05-30T16:57:47.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.213+0000 7f93e2c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f93dc0d0f30 0x7f93dc09ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:47.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.213+0000 7f93e2c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93dc09b080 0x7f93dc0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:47.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.213+0000 7f93e2c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93dc09b900 con 0x7f93dc15c7b0 2024-05-30T16:57:47.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.213+0000 7f93e2c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f93dc15cb90 con 0x7f93dc09b080 2024-05-30T16:57:47.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.213+0000 7f93e2c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f93dc0cd4c0 con 0x7f93dc0d0f30 2024-05-30T16:57:47.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.213+0000 7f93e2200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93dc09b080 0x7f93dc0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:47.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.213+0000 7f93e2200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93dc09b080 0x7f93dc0cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49870/0 (socket says 172.21.15.59:49870) 2024-05-30T16:57:47.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.213+0000 7f93e2200640 1 -- 172.21.15.59:0/3718696023 learned_addr learned my addr 172.21.15.59:0/3718696023 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:47.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.213+0000 7f93e2200640 1 -- 172.21.15.59:0/3718696023 >> v2:172.21.15.107:3300/0 conn(0x7f93dc0d0f30 msgr2=0x7f93dc09ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:47.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.213+0000 7f93e2200640 1 --2- 172.21.15.59:0/3718696023 >> v2:172.21.15.107:3300/0 conn(0x7f93dc0d0f30 0x7f93dc09ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:47.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.213+0000 7f93e2200640 1 -- 172.21.15.59:0/3718696023 >> v1:172.21.15.107:6789/0 conn(0x7f93dc15c7b0 legacy=0x7f93dc0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:47.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.213+0000 7f93e2200640 1 -- 172.21.15.59:0/3718696023 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93dc09bbe0 con 0x7f93dc09b080 2024-05-30T16:57:47.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.217+0000 7f93e2200640 1 --2- 172.21.15.59:0/3718696023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93dc09b080 0x7f93dc0cd950 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f93dc072010 tx=0x7f93d401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366ab764d6b26d50 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:47.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.217+0000 7f93dbe00640 1 -- 172.21.15.59:0/3718696023 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d40a5860 con 0x7f93dc09b080 2024-05-30T16:57:47.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.217+0000 7f93dbe00640 1 -- 172.21.15.59:0/3718696023 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d40a5a00 con 0x7f93dc09b080 2024-05-30T16:57:47.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.217+0000 7f93dbe00640 1 -- 172.21.15.59:0/3718696023 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d40a5dd0 con 0x7f93dc09b080 2024-05-30T16:57:47.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.217+0000 7f93e2c00640 1 -- 172.21.15.59:0/3718696023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93dc09b080 msgr2=0x7f93dc0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:47.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.217+0000 7f93e2c00640 1 --2- 172.21.15.59:0/3718696023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93dc09b080 0x7f93dc0cd950 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f93dc072010 tx=0x7f93d401c980 comp rx=0 tx=0).stop 2024-05-30T16:57:47.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.217+0000 7f93e2c00640 1 -- 172.21.15.59:0/3718696023 shutdown_connections 2024-05-30T16:57:47.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.217+0000 7f93e2c00640 1 --2- 172.21.15.59:0/3718696023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93dc09b080 0x7f93dc0cd950 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:47.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.217+0000 7f93e2c00640 1 --2- 172.21.15.59:0/3718696023 >> v2:172.21.15.107:3300/0 conn(0x7f93dc0d0f30 0x7f93dc09ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:47.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.217+0000 7f93e2c00640 1 -- 172.21.15.59:0/3718696023 >> 172.21.15.59:0/3718696023 conn(0x7f93dc0b3ec0 msgr2=0x7f93dc0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:47.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.217+0000 7f93e2c00640 1 -- 172.21.15.59:0/3718696023 shutdown_connections 2024-05-30T16:57:47.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.217+0000 7f93e2c00640 1 -- 172.21.15.59:0/3718696023 wait complete. 2024-05-30T16:57:47.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.221+0000 7f93e2c00640 1 Processor -- start 2024-05-30T16:57:47.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.221+0000 7f93e2c00640 1 -- start start 2024-05-30T16:57:47.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.221+0000 7f93e2c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93dc09b080 0x7f93dc154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:47.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.221+0000 7f93e2c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93dc0d0f30 0x7f93dc0cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:47.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.221+0000 7f93e2c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93dc15c7b0 0x7f93dc0cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:47.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.221+0000 7f93e2c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc0ce6a0 con 0x7f93dc09b080 2024-05-30T16:57:47.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.221+0000 7f93e2c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc09b6a0 con 0x7f93dc0d0f30 2024-05-30T16:57:47.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.221+0000 7f93e2c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f93dc0ce820 con 0x7f93dc15c7b0 2024-05-30T16:57:47.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93e1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93dc09b080 0x7f93dc154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:47.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93e1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93dc09b080 0x7f93dc154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49882/0 (socket says 172.21.15.59:49882) 2024-05-30T16:57:47.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93e1800640 1 -- 172.21.15.59:0/2299250106 learned_addr learned my addr 172.21.15.59:0/2299250106 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:47.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93e2200640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93dc15c7b0 0x7f93dc0cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:47.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93e0e00640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93dc0d0f30 0x7f93dc0cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:47.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93e1800640 1 -- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93dc15c7b0 msgr2=0x7f93dc0cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:47.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93e1800640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93dc15c7b0 0x7f93dc0cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:47.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93e1800640 1 -- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93dc0d0f30 msgr2=0x7f93dc0cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:47.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93e1800640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93dc0d0f30 0x7f93dc0cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:47.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93e1800640 1 -- 172.21.15.59:0/2299250106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93dc0c6990 con 0x7f93dc09b080 2024-05-30T16:57:47.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93e2200640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93dc15c7b0 0x7f93dc0cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:57:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93e1800640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93dc09b080 0x7f93dc154200 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f93d000b3e0 tx=0x7f93d000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93d9600640 1 -- 172.21.15.59:0/2299250106 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0015020 con 0x7f93dc09b080 2024-05-30T16:57:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93d9600640 1 -- 172.21.15.59:0/2299250106 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d0011850 con 0x7f93dc09b080 2024-05-30T16:57:47.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.225+0000 7f93d9600640 1 -- 172.21.15.59:0/2299250106 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0011c40 con 0x7f93dc09b080 2024-05-30T16:57:47.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.229+0000 7f93e2c00640 1 -- 172.21.15.59:0/2299250106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93dc0c6c70 con 0x7f93dc09b080 2024-05-30T16:57:47.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.229+0000 7f93e2c00640 1 -- 172.21.15.59:0/2299250106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93dc0c7230 con 0x7f93dc09b080 2024-05-30T16:57:47.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.229+0000 7f93e2c00640 1 -- 172.21.15.59:0/2299250106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93dc068a90 con 0x7f93dc09b080 2024-05-30T16:57:47.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.233+0000 7f93d9600640 1 -- 172.21.15.59:0/2299250106 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f93d0018020 con 0x7f93dc09b080 2024-05-30T16:57:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.233+0000 7f93d9600640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93bc0694b0 0x7f93bc06b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.233+0000 7f93d9600640 1 -- 172.21.15.59:0/2299250106 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f93d0085a30 con 0x7f93dc09b080 2024-05-30T16:57:47.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.237+0000 7f93d9600640 1 -- 172.21.15.59:0/2299250106 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f93d001f020 con 0x7f93dc09b080 2024-05-30T16:57:47.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.253+0000 7f93e0e00640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93bc0694b0 0x7f93bc06b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:47.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.277+0000 7f93e0e00640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93bc0694b0 0x7f93bc06b970 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006fd0 tx=0x7f93c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:47.545+0000 7f93e2c00640 1 -- 172.21.15.59:0/2299250106 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone698813", "target": ["mon-mgr", ""]}) -- 0x7f93dc0d03f0 con 0x7f93bc0694b0 2024-05-30T16:57:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.225+0000 7f93d9600640 1 -- 172.21.15.59:0/2299250106 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f93dc0d03f0 con 0x7f93bc0694b0 2024-05-30T16:57:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.229+0000 7f93e2c00640 1 -- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93bc0694b0 msgr2=0x7f93bc06b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.229+0000 7f93e2c00640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93bc0694b0 0x7f93bc06b970 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006fd0 tx=0x7f93c8008040 comp rx=0 tx=0).stop 2024-05-30T16:57:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.229+0000 7f93e2c00640 1 -- 172.21.15.59:0/2299250106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93dc09b080 msgr2=0x7f93dc154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.229+0000 7f93e2c00640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93dc09b080 0x7f93dc154200 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f93d000b3e0 tx=0x7f93d000b8a0 comp rx=0 tx=0).stop 2024-05-30T16:57:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.229+0000 7f93e2c00640 1 -- 172.21.15.59:0/2299250106 shutdown_connections 2024-05-30T16:57:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.229+0000 7f93e2c00640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93bc0694b0 0x7f93bc06b970 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.229+0000 7f93e2c00640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93dc15c7b0 0x7f93dc0cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.229+0000 7f93e2c00640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93dc0d0f30 0x7f93dc0cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.229+0000 7f93e2c00640 1 --2- 172.21.15.59:0/2299250106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93dc09b080 0x7f93dc154200 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.229+0000 7f93e2c00640 1 -- 172.21.15.59:0/2299250106 >> 172.21.15.59:0/2299250106 conn(0x7f93dc0b3ec0 msgr2=0x7f93dc0b6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.229+0000 7f93e2c00640 1 -- 172.21.15.59:0/2299250106 shutdown_connections 2024-05-30T16:57:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.229+0000 7f93e2c00640 1 -- 172.21.15.59:0/2299250106 wait complete. 2024-05-30T16:57:48.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone698814 2024-05-30T16:57:48.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.509+0000 7f1c8f800640 1 Processor -- start 2024-05-30T16:57:48.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.509+0000 7f1c8f800640 1 -- start start 2024-05-30T16:57:48.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.509+0000 7f1c8f800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c880d08b0 0x7f1c880ae310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:48.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.513+0000 7f1c8f800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1c880ca6b0 0x7f1c880caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:48.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.513+0000 7f1c8f800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c880b3f50 con 0x7f1c8815e7a0 2024-05-30T16:57:48.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.513+0000 7f1c8f800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1c880b3740 con 0x7f1c880d08b0 2024-05-30T16:57:48.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.513+0000 7f1c8f800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1c880cb000 con 0x7f1c880ca6b0 2024-05-30T16:57:48.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.513+0000 7f1c87e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c880d08b0 0x7f1c880ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:48.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.513+0000 7f1c87e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c880d08b0 0x7f1c880ae310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49888/0 (socket says 172.21.15.59:49888) 2024-05-30T16:57:48.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.513+0000 7f1c87e00640 1 -- 172.21.15.59:0/10313139 learned_addr learned my addr 172.21.15.59:0/10313139 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:48.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.513+0000 7f1c8d800640 1 --2- 172.21.15.59:0/10313139 >> v2:172.21.15.107:3300/0 conn(0x7f1c880ca6b0 0x7f1c880caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:48.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.513+0000 7f1c87e00640 1 -- 172.21.15.59:0/10313139 >> v2:172.21.15.107:3300/0 conn(0x7f1c880ca6b0 msgr2=0x7f1c880caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:48.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.513+0000 7f1c87e00640 1 --2- 172.21.15.59:0/10313139 >> v2:172.21.15.107:3300/0 conn(0x7f1c880ca6b0 0x7f1c880caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:48.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.513+0000 7f1c87e00640 1 -- 172.21.15.59:0/10313139 >> v1:172.21.15.59:6789/0 conn(0x7f1c8815e7a0 legacy=0x7f1c880b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:48.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.513+0000 7f1c87e00640 1 -- 172.21.15.59:0/10313139 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c880cf040 con 0x7f1c880d08b0 2024-05-30T16:57:48.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.517+0000 7f1c87e00640 1 --2- 172.21.15.59:0/10313139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c880d08b0 0x7f1c880ae310 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1c8806e880 tx=0x7f1c7401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fdacbc4cb8b91f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:48.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.517+0000 7f1c87400640 1 -- 172.21.15.59:0/10313139 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c740aa680 con 0x7f1c880d08b0 2024-05-30T16:57:48.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.517+0000 7f1c87400640 1 -- 172.21.15.59:0/10313139 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c740af070 con 0x7f1c880d08b0 2024-05-30T16:57:48.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.517+0000 7f1c87400640 1 -- 172.21.15.59:0/10313139 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c740aaa40 con 0x7f1c880d08b0 2024-05-30T16:57:48.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.517+0000 7f1c8f800640 1 -- 172.21.15.59:0/10313139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c880d08b0 msgr2=0x7f1c880ae310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:48.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.517+0000 7f1c8f800640 1 --2- 172.21.15.59:0/10313139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c880d08b0 0x7f1c880ae310 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1c8806e880 tx=0x7f1c7401c520 comp rx=0 tx=0).stop 2024-05-30T16:57:48.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.521+0000 7f1c8f800640 1 -- 172.21.15.59:0/10313139 shutdown_connections 2024-05-30T16:57:48.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.521+0000 7f1c8f800640 1 --2- 172.21.15.59:0/10313139 >> v2:172.21.15.107:3300/0 conn(0x7f1c880ca6b0 0x7f1c880caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:48.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.521+0000 7f1c8f800640 1 --2- 172.21.15.59:0/10313139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c880d08b0 0x7f1c880ae310 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:48.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.521+0000 7f1c8f800640 1 -- 172.21.15.59:0/10313139 >> 172.21.15.59:0/10313139 conn(0x7f1c8809aa40 msgr2=0x7f1c880b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:48.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.521+0000 7f1c8f800640 1 -- 172.21.15.59:0/10313139 shutdown_connections 2024-05-30T16:57:48.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.521+0000 7f1c8f800640 1 -- 172.21.15.59:0/10313139 wait complete. 2024-05-30T16:57:48.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.521+0000 7f1c8f800640 1 Processor -- start 2024-05-30T16:57:48.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.521+0000 7f1c8f800640 1 -- start start 2024-05-30T16:57:48.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8f800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c880ca6b0 0x7f1c88147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:48.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8f800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c880d08b0 0x7f1c88158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:48.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8f800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c8815e7a0 0x7f1c8815b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:48.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8f800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8815ed00 con 0x7f1c8815e7a0 2024-05-30T16:57:48.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8f800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8815eb80 con 0x7f1c880ca6b0 2024-05-30T16:57:48.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8f800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1c880d0010 con 0x7f1c880d08b0 2024-05-30T16:57:48.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c8815e7a0 0x7f1c8815b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:48.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c8815e7a0 0x7f1c8815b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49898/0 (socket says 172.21.15.59:49898) 2024-05-30T16:57:48.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8d800640 1 -- 172.21.15.59:0/2064444414 learned_addr learned my addr 172.21.15.59:0/2064444414 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:48.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8d800640 1 -- 172.21.15.59:0/2064444414 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c880d08b0 msgr2=0x7f1c88158930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T16:57:48.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8d800640 1 --2- 172.21.15.59:0/2064444414 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c880d08b0 0x7f1c88158930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:48.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8d800640 1 -- 172.21.15.59:0/2064444414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c880ca6b0 msgr2=0x7f1c88147750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T16:57:48.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8d800640 1 --2- 172.21.15.59:0/2064444414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c880ca6b0 0x7f1c88147750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:48.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8d800640 1 -- 172.21.15.59:0/2064444414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c880b4490 con 0x7f1c8815e7a0 2024-05-30T16:57:48.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.525+0000 7f1c8d800640 1 --2- 172.21.15.59:0/2064444414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c8815e7a0 0x7f1c8815b850 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1c80007e70 tx=0x7f1c8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:48.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.529+0000 7f1c84c00640 1 -- 172.21.15.59:0/2064444414 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c80014420 con 0x7f1c8815e7a0 2024-05-30T16:57:48.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.529+0000 7f1c84c00640 1 -- 172.21.15.59:0/2064444414 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c80019070 con 0x7f1c8815e7a0 2024-05-30T16:57:48.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.529+0000 7f1c84c00640 1 -- 172.21.15.59:0/2064444414 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c80014800 con 0x7f1c8815e7a0 2024-05-30T16:57:48.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.529+0000 7f1c8f800640 1 -- 172.21.15.59:0/2064444414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c880b4770 con 0x7f1c8815e7a0 2024-05-30T16:57:48.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.529+0000 7f1c8f800640 1 -- 172.21.15.59:0/2064444414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c880b4d30 con 0x7f1c8815e7a0 2024-05-30T16:57:48.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.529+0000 7f1c8f800640 1 -- 172.21.15.59:0/2064444414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c880691a0 con 0x7f1c8815e7a0 2024-05-30T16:57:48.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.533+0000 7f1c84c00640 1 -- 172.21.15.59:0/2064444414 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f1c800149a0 con 0x7f1c8815e7a0 2024-05-30T16:57:48.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.537+0000 7f1c84c00640 1 --2- 172.21.15.59:0/2064444414 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c680694b0 0x7f1c6806b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:48.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.537+0000 7f1c84c00640 1 -- 172.21.15.59:0/2064444414 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f1c80085dc0 con 0x7f1c8815e7a0 2024-05-30T16:57:48.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.545+0000 7f1c84c00640 1 -- 172.21.15.59:0/2064444414 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1c80057e10 con 0x7f1c8815e7a0 2024-05-30T16:57:48.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.565+0000 7f1c8ce00640 1 --2- 172.21.15.59:0/2064444414 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c680694b0 0x7f1c6806b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:48.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.601+0000 7f1c8ce00640 1 --2- 172.21.15.59:0/2064444414 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c680694b0 0x7f1c6806b970 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c001470 tx=0x7f1c7c0079e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:48.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:48.909+0000 7f1c8f800640 1 -- 172.21.15.59:0/2064444414 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone698814", "target": ["mon-mgr", ""]}) -- 0x7f1c88161fd0 con 0x7f1c680694b0 2024-05-30T16:57:49.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.953+0000 7f1c84c00640 1 -- 172.21.15.59:0/2064444414 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1c88161fd0 con 0x7f1c680694b0 2024-05-30T16:57:49.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.953+0000 7f1c8f800640 1 -- 172.21.15.59:0/2064444414 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c680694b0 msgr2=0x7f1c6806b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:49.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.953+0000 7f1c8f800640 1 --2- 172.21.15.59:0/2064444414 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c680694b0 0x7f1c6806b970 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c001470 tx=0x7f1c7c0079e0 comp rx=0 tx=0).stop 2024-05-30T16:57:49.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.953+0000 7f1c8f800640 1 -- 172.21.15.59:0/2064444414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c8815e7a0 msgr2=0x7f1c8815b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:49.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.953+0000 7f1c8f800640 1 --2- 172.21.15.59:0/2064444414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c8815e7a0 0x7f1c8815b850 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1c80007e70 tx=0x7f1c8000e4b0 comp rx=0 tx=0).stop 2024-05-30T16:57:49.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.957+0000 7f1c8f800640 1 -- 172.21.15.59:0/2064444414 shutdown_connections 2024-05-30T16:57:49.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.957+0000 7f1c8f800640 1 --2- 172.21.15.59:0/2064444414 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c680694b0 0x7f1c6806b970 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:49.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.957+0000 7f1c8f800640 1 --2- 172.21.15.59:0/2064444414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c8815e7a0 0x7f1c8815b850 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:49.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.957+0000 7f1c8f800640 1 --2- 172.21.15.59:0/2064444414 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c880d08b0 0x7f1c88158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:49.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.957+0000 7f1c8f800640 1 --2- 172.21.15.59:0/2064444414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c880ca6b0 0x7f1c88147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:49.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.957+0000 7f1c8f800640 1 -- 172.21.15.59:0/2064444414 >> 172.21.15.59:0/2064444414 conn(0x7f1c8809aa40 msgr2=0x7f1c880d1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:49.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.957+0000 7f1c8f800640 1 -- 172.21.15.59:0/2064444414 shutdown_connections 2024-05-30T16:57:49.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:49.957+0000 7f1c8f800640 1 -- 172.21.15.59:0/2064444414 wait complete. 2024-05-30T16:57:49.997 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone698815 2024-05-30T16:57:50.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.229+0000 7fe917200640 1 Processor -- start 2024-05-30T16:57:50.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.229+0000 7fe917200640 1 -- start start 2024-05-30T16:57:50.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.233+0000 7fe917200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9180b3880 0x7fe918072060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:50.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.233+0000 7fe917200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9180725a0 0x7fe9180aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:50.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.233+0000 7fe917200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9180b4c20 con 0x7fe918141770 2024-05-30T16:57:50.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.233+0000 7fe917200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe9180b4f00 con 0x7fe9180725a0 2024-05-30T16:57:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.233+0000 7fe917200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe9180b51e0 con 0x7fe9180b3880 2024-05-30T16:57:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.237+0000 7fe915e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe918141770 0x7fe9180b4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60696/0 (socket says 172.21.15.59:60696) 2024-05-30T16:57:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.237+0000 7fe915e00640 1 -- 172.21.15.59:0/2039587628 learned_addr learned my addr 172.21.15.59:0/2039587628 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.237+0000 7fe916800640 1 --2- 172.21.15.59:0/2039587628 >> v2:172.21.15.59:3300/0 conn(0x7fe9180725a0 0x7fe9180aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.237+0000 7fe916800640 1 -- 172.21.15.59:0/2039587628 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9180b3880 msgr2=0x7fe918072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.237+0000 7fe915400640 1 --2- 172.21.15.59:0/2039587628 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9180b3880 0x7fe918072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.237+0000 7fe916800640 1 --2- 172.21.15.59:0/2039587628 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9180b3880 0x7fe918072060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.237+0000 7fe916800640 1 -- 172.21.15.59:0/2039587628 >> v1:172.21.15.59:6789/0 conn(0x7fe918141770 legacy=0x7fe9180b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.237+0000 7fe916800640 1 -- 172.21.15.59:0/2039587628 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9180b54c0 con 0x7fe9180725a0 2024-05-30T16:57:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.237+0000 7fe915400640 1 --2- 172.21.15.59:0/2039587628 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9180b3880 0x7fe918072060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:57:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.257+0000 7fe916800640 1 --2- 172.21.15.59:0/2039587628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9180725a0 0x7fe9180aeb80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe910009d90 tx=0x7fe91001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b127b008848ffedd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:50.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.261+0000 7fe914a00640 1 -- 172.21.15.59:0/2039587628 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9100b2070 con 0x7fe9180725a0 2024-05-30T16:57:50.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.265+0000 7fe914a00640 1 -- 172.21.15.59:0/2039587628 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9100a57a0 con 0x7fe9180725a0 2024-05-30T16:57:50.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.265+0000 7fe917200640 1 -- 172.21.15.59:0/2039587628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9180725a0 msgr2=0x7fe9180aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:50.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.265+0000 7fe917200640 1 --2- 172.21.15.59:0/2039587628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9180725a0 0x7fe9180aeb80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe910009d90 tx=0x7fe91001c8e0 comp rx=0 tx=0).stop 2024-05-30T16:57:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.265+0000 7fe917200640 1 -- 172.21.15.59:0/2039587628 shutdown_connections 2024-05-30T16:57:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.265+0000 7fe917200640 1 --2- 172.21.15.59:0/2039587628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9180725a0 0x7fe9180aeb80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.265+0000 7fe917200640 1 --2- 172.21.15.59:0/2039587628 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9180b3880 0x7fe918072060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.265+0000 7fe917200640 1 -- 172.21.15.59:0/2039587628 >> 172.21.15.59:0/2039587628 conn(0x7fe91806b9b0 msgr2=0x7fe91806bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.265+0000 7fe917200640 1 -- 172.21.15.59:0/2039587628 shutdown_connections 2024-05-30T16:57:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.265+0000 7fe917200640 1 -- 172.21.15.59:0/2039587628 wait complete. 2024-05-30T16:57:50.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.269+0000 7fe917200640 1 Processor -- start 2024-05-30T16:57:50.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.269+0000 7fe917200640 1 -- start start 2024-05-30T16:57:50.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.269+0000 7fe917200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9180725a0 0x7fe918138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:50.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.269+0000 7fe917200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe918141770 0x7fe918158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:50.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.269+0000 7fe917200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe918143140 0x7fe9181435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:50.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.269+0000 7fe917200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe9180afc60 con 0x7fe9180725a0 2024-05-30T16:57:50.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.269+0000 7fe917200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe9180afae0 con 0x7fe918141770 2024-05-30T16:57:50.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.269+0000 7fe917200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe9180afde0 con 0x7fe918143140 2024-05-30T16:57:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.273+0000 7fe916800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe918143140 0x7fe9181435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.273+0000 7fe915400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe918141770 0x7fe918158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.273+0000 7fe916800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe918143140 0x7fe9181435f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:34794/0 (socket says 172.21.15.59:34794) 2024-05-30T16:57:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.273+0000 7fe916800640 1 -- 172.21.15.59:0/3196067776 learned_addr learned my addr 172.21.15.59:0/3196067776 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.273+0000 7fe916800640 1 -- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe918141770 msgr2=0x7fe918158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.273+0000 7fe915e00640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9180725a0 0x7fe918138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.273+0000 7fe916800640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe918141770 0x7fe918158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.277+0000 7fe916800640 1 -- 172.21.15.59:0/3196067776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9180725a0 msgr2=0x7fe918138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.277+0000 7fe916800640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9180725a0 0x7fe918138ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.277+0000 7fe916800640 1 -- 172.21.15.59:0/3196067776 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9181f8400 con 0x7fe918143140 2024-05-30T16:57:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.277+0000 7fe915e00640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9180725a0 0x7fe918138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:57:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.277+0000 7fe916800640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe918143140 0x7fe9181435f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe91001cdc0 tx=0x7fe910019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.281+0000 7fe90e000640 1 -- 172.21.15.59:0/3196067776 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9100bd020 con 0x7fe918143140 2024-05-30T16:57:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.285+0000 7fe917200640 1 -- 172.21.15.59:0/3196067776 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9181f8120 con 0x7fe918143140 2024-05-30T16:57:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.285+0000 7fe90e000640 1 -- 172.21.15.59:0/3196067776 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9100b8670 con 0x7fe918143140 2024-05-30T16:57:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.285+0000 7fe917200640 1 -- 172.21.15.59:0/3196067776 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91813ed20 con 0x7fe918143140 2024-05-30T16:57:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.285+0000 7fe90e000640 1 -- 172.21.15.59:0/3196067776 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9100b2040 con 0x7fe918143140 2024-05-30T16:57:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.285+0000 7fe917200640 1 -- 172.21.15.59:0/3196067776 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f00052a0 con 0x7fe918143140 2024-05-30T16:57:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.293+0000 7fe90e000640 1 -- 172.21.15.59:0/3196067776 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7fe9100c0020 con 0x7fe918143140 2024-05-30T16:57:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.293+0000 7fe90e000640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe8f8069460 0x7fe8f806b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.293+0000 7fe90e000640 1 -- 172.21.15.59:0/3196067776 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fe910120dd0 con 0x7fe918143140 2024-05-30T16:57:50.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.297+0000 7fe915e00640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe8f8069460 0x7fe8f806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:50.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.305+0000 7fe90e000640 1 -- 172.21.15.59:0/3196067776 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe9100c8020 con 0x7fe918143140 2024-05-30T16:57:50.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.309+0000 7fe915e00640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe8f8069460 0x7fe8f806b920 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe918161240 tx=0x7fe908009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:50.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:50.733+0000 7fe917200640 1 -- 172.21.15.59:0/3196067776 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone698815", "target": ["mon-mgr", ""]}) -- 0x7fe8f0000c90 con 0x7fe8f8069460 2024-05-30T16:57:51.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.993+0000 7fe90e000640 1 -- 172.21.15.59:0/3196067776 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe8f0000c90 con 0x7fe8f8069460 2024-05-30T16:57:51.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.997+0000 7fe917200640 1 -- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe8f8069460 msgr2=0x7fe8f806b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:51.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.997+0000 7fe917200640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe8f8069460 0x7fe8f806b920 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe918161240 tx=0x7fe908009040 comp rx=0 tx=0).stop 2024-05-30T16:57:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.997+0000 7fe917200640 1 -- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe918143140 msgr2=0x7fe9181435f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.997+0000 7fe917200640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe918143140 0x7fe9181435f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe91001cdc0 tx=0x7fe910019680 comp rx=0 tx=0).stop 2024-05-30T16:57:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.997+0000 7fe917200640 1 -- 172.21.15.59:0/3196067776 shutdown_connections 2024-05-30T16:57:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.997+0000 7fe917200640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe8f8069460 0x7fe8f806b920 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.997+0000 7fe917200640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe918143140 0x7fe9181435f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.997+0000 7fe917200640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe918141770 0x7fe918158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.997+0000 7fe917200640 1 --2- 172.21.15.59:0/3196067776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9180725a0 0x7fe918138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.997+0000 7fe917200640 1 -- 172.21.15.59:0/3196067776 >> 172.21.15.59:0/3196067776 conn(0x7fe91806b9b0 msgr2=0x7fe9180b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.997+0000 7fe917200640 1 -- 172.21.15.59:0/3196067776 shutdown_connections 2024-05-30T16:57:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:51.997+0000 7fe917200640 1 -- 172.21.15.59:0/3196067776 wait complete. 2024-05-30T16:57:52.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone698816 2024-05-30T16:57:52.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.249+0000 7f377d600640 1 Processor -- start 2024-05-30T16:57:52.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.249+0000 7f377d600640 1 -- start start 2024-05-30T16:57:52.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f377d600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37780b2c40 0x7f37780d2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:52.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f377d600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f37780b32f0 0x7f377809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:52.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f377d600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f377809af80 0x7f37780d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:52.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f377d600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f377809b3f0 con 0x7f37780b2c40 2024-05-30T16:57:52.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f377d600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f377806e1c0 con 0x7f37780b32f0 2024-05-30T16:57:52.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f377d600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f377806e650 con 0x7f377809af80 2024-05-30T16:57:52.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f3776a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37780b2c40 0x7f37780d2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:52.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f3776a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37780b2c40 0x7f37780d2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54186/0 (socket says 172.21.15.59:54186) 2024-05-30T16:57:52.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f3776a00640 1 -- 172.21.15.59:0/1201840316 learned_addr learned my addr 172.21.15.59:0/1201840316 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:52.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f3776a00640 1 -- 172.21.15.59:0/1201840316 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f377809af80 msgr2=0x7f37780d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:52.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f3776a00640 1 --2- 172.21.15.59:0/1201840316 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f377809af80 0x7f37780d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:52.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f3776a00640 1 -- 172.21.15.59:0/1201840316 >> v2:172.21.15.107:3300/0 conn(0x7f37780b32f0 msgr2=0x7f377809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:52.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f3776a00640 1 --2- 172.21.15.59:0/1201840316 >> v2:172.21.15.107:3300/0 conn(0x7f37780b32f0 0x7f377809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:52.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.253+0000 7f3776a00640 1 -- 172.21.15.59:0/1201840316 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377809b870 con 0x7f37780b2c40 2024-05-30T16:57:52.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f3776a00640 1 --2- 172.21.15.59:0/1201840316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37780b2c40 0x7f37780d2fe0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3778073970 tx=0x7f376801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437b5ec2a328378a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:52.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f3776000640 1 -- 172.21.15.59:0/1201840316 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37680b0070 con 0x7f37780b2c40 2024-05-30T16:57:52.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f3776000640 1 -- 172.21.15.59:0/1201840316 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37680ab600 con 0x7f37780b2c40 2024-05-30T16:57:52.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f3776000640 1 -- 172.21.15.59:0/1201840316 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37680ab9d0 con 0x7f37780b2c40 2024-05-30T16:57:52.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f377d600640 1 -- 172.21.15.59:0/1201840316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37780b2c40 msgr2=0x7f37780d2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:52.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f377d600640 1 --2- 172.21.15.59:0/1201840316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37780b2c40 0x7f37780d2fe0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3778073970 tx=0x7f376801c260 comp rx=0 tx=0).stop 2024-05-30T16:57:52.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f377d600640 1 -- 172.21.15.59:0/1201840316 shutdown_connections 2024-05-30T16:57:52.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f377d600640 1 --2- 172.21.15.59:0/1201840316 >> v2:172.21.15.107:3300/0 conn(0x7f37780b32f0 0x7f377809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:52.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f377d600640 1 --2- 172.21.15.59:0/1201840316 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f377809af80 0x7f37780d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:52.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f377d600640 1 --2- 172.21.15.59:0/1201840316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37780b2c40 0x7f37780d2fe0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:52.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f377d600640 1 -- 172.21.15.59:0/1201840316 >> 172.21.15.59:0/1201840316 conn(0x7f37780d24c0 msgr2=0x7f37780d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:52.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f377d600640 1 -- 172.21.15.59:0/1201840316 shutdown_connections 2024-05-30T16:57:52.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f377d600640 1 -- 172.21.15.59:0/1201840316 wait complete. 2024-05-30T16:57:52.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f377d600640 1 Processor -- start 2024-05-30T16:57:52.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.257+0000 7f377d600640 1 -- start start 2024-05-30T16:57:52.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f377d600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f377809af80 0x7f37780c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:52.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f377d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37780b2c40 0x7f3778157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:52.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f377d600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37780b32f0 0x7f37781607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:52.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f377d600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f37780ccb10 con 0x7f37780b2c40 2024-05-30T16:57:52.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f377d600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f37780b3020 con 0x7f37780b32f0 2024-05-30T16:57:52.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f377d600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f37780ccc90 con 0x7f377809af80 2024-05-30T16:57:52.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f376e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37780b2c40 0x7f3778157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:52.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f376e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37780b2c40 0x7f3778157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54190/0 (socket says 172.21.15.59:54190) 2024-05-30T16:57:52.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f376e000640 1 -- 172.21.15.59:0/3622697334 learned_addr learned my addr 172.21.15.59:0/3622697334 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f376e000640 1 -- 172.21.15.59:0/3622697334 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f377809af80 msgr2=0x7f37780c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f376e000640 1 --2- 172.21.15.59:0/3622697334 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f377809af80 0x7f37780c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f376e000640 1 -- 172.21.15.59:0/3622697334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37780b32f0 msgr2=0x7f37781607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f376e000640 1 --2- 172.21.15.59:0/3622697334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37780b32f0 0x7f37781607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f376e000640 1 -- 172.21.15.59:0/3622697334 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3778160d00 con 0x7f37780b2c40 2024-05-30T16:57:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f376e000640 1 --2- 172.21.15.59:0/3622697334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37780b2c40 0x7f3778157bb0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f376000b440 tx=0x7f376000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f376f400640 1 -- 172.21.15.59:0/3622697334 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760015020 con 0x7f37780b2c40 2024-05-30T16:57:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f376f400640 1 -- 172.21.15.59:0/3622697334 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37600118b0 con 0x7f37780b2c40 2024-05-30T16:57:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f376f400640 1 -- 172.21.15.59:0/3622697334 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760011ca0 con 0x7f37780b2c40 2024-05-30T16:57:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f377d600640 1 -- 172.21.15.59:0/3622697334 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37780c6640 con 0x7f37780b2c40 2024-05-30T16:57:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f377d600640 1 -- 172.21.15.59:0/3622697334 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37780c6c00 con 0x7f37780b2c40 2024-05-30T16:57:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.261+0000 7f377d600640 1 -- 172.21.15.59:0/3622697334 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3778068a90 con 0x7f37780b2c40 2024-05-30T16:57:52.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.265+0000 7f376f400640 1 -- 172.21.15.59:0/3622697334 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f3760018020 con 0x7f37780b2c40 2024-05-30T16:57:52.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.265+0000 7f376f400640 1 --2- 172.21.15.59:0/3622697334 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3754069460 0x7f375406b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:52.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.265+0000 7f376f400640 1 -- 172.21.15.59:0/3622697334 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f3760085680 con 0x7f37780b2c40 2024-05-30T16:57:52.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.273+0000 7f376f400640 1 -- 172.21.15.59:0/3622697334 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f376001f020 con 0x7f37780b2c40 2024-05-30T16:57:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.309+0000 7f3776a00640 1 --2- 172.21.15.59:0/3622697334 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3754069460 0x7f375406b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:52.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.357+0000 7f3776a00640 1 --2- 172.21.15.59:0/3622697334 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3754069460 0x7f375406b920 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f37680ad000 tx=0x7f3768008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:52.621+0000 7f377d600640 1 -- 172.21.15.59:0/3622697334 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone698816", "target": ["mon-mgr", ""]}) -- 0x7f3778158890 con 0x7f3754069460 2024-05-30T16:57:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.537+0000 7f376f400640 1 -- 172.21.15.59:0/3622697334 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3778158890 con 0x7f3754069460 2024-05-30T16:57:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.541+0000 7f377d600640 1 -- 172.21.15.59:0/3622697334 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3754069460 msgr2=0x7f375406b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.541+0000 7f377d600640 1 --2- 172.21.15.59:0/3622697334 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3754069460 0x7f375406b920 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f37680ad000 tx=0x7f3768008040 comp rx=0 tx=0).stop 2024-05-30T16:57:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.541+0000 7f377d600640 1 -- 172.21.15.59:0/3622697334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37780b2c40 msgr2=0x7f3778157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.541+0000 7f377d600640 1 --2- 172.21.15.59:0/3622697334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37780b2c40 0x7f3778157bb0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f376000b440 tx=0x7f376000b900 comp rx=0 tx=0).stop 2024-05-30T16:57:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.541+0000 7f377d600640 1 -- 172.21.15.59:0/3622697334 shutdown_connections 2024-05-30T16:57:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.541+0000 7f377d600640 1 --2- 172.21.15.59:0/3622697334 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3754069460 0x7f375406b920 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.541+0000 7f377d600640 1 --2- 172.21.15.59:0/3622697334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37780b32f0 0x7f37781607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.541+0000 7f377d600640 1 --2- 172.21.15.59:0/3622697334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37780b2c40 0x7f3778157bb0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.541+0000 7f377d600640 1 --2- 172.21.15.59:0/3622697334 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f377809af80 0x7f37780c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.541+0000 7f377d600640 1 -- 172.21.15.59:0/3622697334 >> 172.21.15.59:0/3622697334 conn(0x7f37780d24c0 msgr2=0x7f37780d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.541+0000 7f377d600640 1 -- 172.21.15.59:0/3622697334 shutdown_connections 2024-05-30T16:57:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.541+0000 7f377d600640 1 -- 172.21.15.59:0/3622697334 wait complete. 2024-05-30T16:57:53.577 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone698817 2024-05-30T16:57:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.781+0000 7fd002e00640 1 Processor -- start 2024-05-30T16:57:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.781+0000 7fd002e00640 1 -- start start 2024-05-30T16:57:53.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.785+0000 7fd002e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcffc15c800 0x7fcffc15d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:53.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.785+0000 7fd002e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcffc15da80 0x7fcffc06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.785+0000 7fd002e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcffc0cd4e0 con 0x7fcffc0b3a70 2024-05-30T16:57:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.785+0000 7fd002e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fcffc0cd7c0 con 0x7fcffc15da80 2024-05-30T16:57:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.785+0000 7fd002e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcffc0cdaa0 con 0x7fcffc15c800 2024-05-30T16:57:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.785+0000 7fd000e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcffc0b3a70 0x7fcffc15de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42654/0 (socket says 172.21.15.59:42654) 2024-05-30T16:57:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.785+0000 7fd000e00640 1 -- 172.21.15.59:0/3937044610 learned_addr learned my addr 172.21.15.59:0/3937044610 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.785+0000 7fcffb400640 1 --2- 172.21.15.59:0/3937044610 >> v2:172.21.15.59:3300/0 conn(0x7fcffc15da80 0x7fcffc06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.785+0000 7fcffb400640 1 -- 172.21.15.59:0/3937044610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcffc15c800 msgr2=0x7fcffc15d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.785+0000 7fcffb400640 1 --2- 172.21.15.59:0/3937044610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcffc15c800 0x7fcffc15d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.785+0000 7fcffb400640 1 -- 172.21.15.59:0/3937044610 >> v1:172.21.15.59:6789/0 conn(0x7fcffc0b3a70 legacy=0x7fcffc15de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.785+0000 7fcffb400640 1 -- 172.21.15.59:0/3937044610 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc15d020 con 0x7fcffc15da80 2024-05-30T16:57:53.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.793+0000 7fcffb400640 1 --2- 172.21.15.59:0/3937044610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcffc15da80 0x7fcffc06b9b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80097c0 tx=0x7fcfe801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d06b52cb2bed00 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:53.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.793+0000 7fcffaa00640 1 -- 172.21.15.59:0/3937044610 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80aa620 con 0x7fcffc15da80 2024-05-30T16:57:53.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.793+0000 7fcffaa00640 1 -- 172.21.15.59:0/3937044610 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe80af070 con 0x7fcffc15da80 2024-05-30T16:57:53.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.793+0000 7fcffaa00640 1 -- 172.21.15.59:0/3937044610 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80aa9e0 con 0x7fcffc15da80 2024-05-30T16:57:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.797+0000 7fd002e00640 1 -- 172.21.15.59:0/3937044610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcffc15da80 msgr2=0x7fcffc06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.797+0000 7fd002e00640 1 --2- 172.21.15.59:0/3937044610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcffc15da80 0x7fcffc06b9b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80097c0 tx=0x7fcfe801c4c0 comp rx=0 tx=0).stop 2024-05-30T16:57:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.797+0000 7fd002e00640 1 -- 172.21.15.59:0/3937044610 shutdown_connections 2024-05-30T16:57:53.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.797+0000 7fd002e00640 1 --2- 172.21.15.59:0/3937044610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcffc15da80 0x7fcffc06b9b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:53.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.797+0000 7fd002e00640 1 --2- 172.21.15.59:0/3937044610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcffc15c800 0x7fcffc15d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:53.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.797+0000 7fd002e00640 1 -- 172.21.15.59:0/3937044610 >> 172.21.15.59:0/3937044610 conn(0x7fcffc0b2f50 msgr2=0x7fcffc0b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:53.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.797+0000 7fd002e00640 1 -- 172.21.15.59:0/3937044610 shutdown_connections 2024-05-30T16:57:53.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.805+0000 7fd002e00640 1 -- 172.21.15.59:0/3937044610 wait complete. 2024-05-30T16:57:53.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.809+0000 7fd002e00640 1 Processor -- start 2024-05-30T16:57:53.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.809+0000 7fd002e00640 1 -- start start 2024-05-30T16:57:53.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.813+0000 7fd002e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcffc0b3a70 0x7fcffc148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:53.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.813+0000 7fd002e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcffc15c800 0x7fcffc14b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:53.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.813+0000 7fd002e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcffc0afbb0 0x7fcffc0b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:53.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.813+0000 7fd002e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc06c280 con 0x7fcffc0afbb0 2024-05-30T16:57:53.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.813+0000 7fd002e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc06c100 con 0x7fcffc0b3a70 2024-05-30T16:57:53.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.813+0000 7fd002e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcffc169b20 con 0x7fcffc15c800 2024-05-30T16:57:53.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.813+0000 7fcffb400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcffc15c800 0x7fcffc14b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:53.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.813+0000 7fcffb400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcffc15c800 0x7fcffc14b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:41002/0 (socket says 172.21.15.59:41002) 2024-05-30T16:57:53.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.813+0000 7fcffb400640 1 -- 172.21.15.59:0/3128442220 learned_addr learned my addr 172.21.15.59:0/3128442220 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:53.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.813+0000 7fd000e00640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcffc0afbb0 0x7fcffc0b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:53.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.817+0000 7fcffb400640 1 -- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcffc0b3a70 msgr2=0x7fcffc148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:53.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.817+0000 7fcffb400640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcffc0b3a70 0x7fcffc148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:53.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.817+0000 7fcffb400640 1 -- 172.21.15.59:0/3128442220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcffc0afbb0 msgr2=0x7fcffc0b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:53.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.817+0000 7fcffb400640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcffc0afbb0 0x7fcffc0b61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:53.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.817+0000 7fcffb400640 1 -- 172.21.15.59:0/3128442220 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc14bb10 con 0x7fcffc15c800 2024-05-30T16:57:53.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.817+0000 7fd000e00640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcffc0afbb0 0x7fcffc0b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:57:53.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.817+0000 7fcffb400640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcffc15c800 0x7fcffc14b5d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcfe801ab70 tx=0x7fcfe8019260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:53.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.817+0000 7fcff3e00640 1 -- 172.21.15.59:0/3128442220 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80be450 con 0x7fcffc15c800 2024-05-30T16:57:53.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.817+0000 7fcff3e00640 1 -- 172.21.15.59:0/3128442220 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe80be5f0 con 0x7fcffc15c800 2024-05-30T16:57:53.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.817+0000 7fd002e00640 1 -- 172.21.15.59:0/3128442220 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcffc0c5140 con 0x7fcffc15c800 2024-05-30T16:57:53.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.821+0000 7fcff3e00640 1 -- 172.21.15.59:0/3128442220 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80be9e0 con 0x7fcffc15c800 2024-05-30T16:57:53.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.821+0000 7fd002e00640 1 -- 172.21.15.59:0/3128442220 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcffc0c5700 con 0x7fcffc15c800 2024-05-30T16:57:53.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.821+0000 7fd002e00640 1 -- 172.21.15.59:0/3128442220 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcffc068a90 con 0x7fcffc15c800 2024-05-30T16:57:53.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.833+0000 7fcff3e00640 1 -- 172.21.15.59:0/3128442220 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7fcfe80beb80 con 0x7fcffc15c800 2024-05-30T16:57:53.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.833+0000 7fcff3e00640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcfdc069490 0x7fcfdc06b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:53.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.837+0000 7fcff3e00640 1 -- 172.21.15.59:0/3128442220 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fcfe8120600 con 0x7fcffc15c800 2024-05-30T16:57:53.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.837+0000 7fcff3e00640 1 -- 172.21.15.59:0/3128442220 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcfe80cc080 con 0x7fcffc15c800 2024-05-30T16:57:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.841+0000 7fcffbe00640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcfdc069490 0x7fcfdc06b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:53.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:53.897+0000 7fcffbe00640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcfdc069490 0x7fcfdc06b950 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcffc15c2a0 tx=0x7fcfec006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:54.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:54.193+0000 7fd002e00640 1 -- 172.21.15.59:0/3128442220 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone698817", "target": ["mon-mgr", ""]}) -- 0x7fcffc0c4ef0 con 0x7fcfdc069490 2024-05-30T16:57:55.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.021+0000 7fcff3e00640 1 -- 172.21.15.59:0/3128442220 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcffc0c4ef0 con 0x7fcfdc069490 2024-05-30T16:57:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.025+0000 7fd002e00640 1 -- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcfdc069490 msgr2=0x7fcfdc06b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.025+0000 7fd002e00640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcfdc069490 0x7fcfdc06b950 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcffc15c2a0 tx=0x7fcfec006ca0 comp rx=0 tx=0).stop 2024-05-30T16:57:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.025+0000 7fd002e00640 1 -- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcffc15c800 msgr2=0x7fcffc14b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.025+0000 7fd002e00640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcffc15c800 0x7fcffc14b5d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcfe801ab70 tx=0x7fcfe8019260 comp rx=0 tx=0).stop 2024-05-30T16:57:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.025+0000 7fd002e00640 1 -- 172.21.15.59:0/3128442220 shutdown_connections 2024-05-30T16:57:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.025+0000 7fd002e00640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcfdc069490 0x7fcfdc06b950 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.025+0000 7fd002e00640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcffc0afbb0 0x7fcffc0b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.025+0000 7fd002e00640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcffc15c800 0x7fcffc14b5d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.025+0000 7fd002e00640 1 --2- 172.21.15.59:0/3128442220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcffc0b3a70 0x7fcffc148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.025+0000 7fd002e00640 1 -- 172.21.15.59:0/3128442220 >> 172.21.15.59:0/3128442220 conn(0x7fcffc0b2f50 msgr2=0x7fcffc15de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.025+0000 7fd002e00640 1 -- 172.21.15.59:0/3128442220 shutdown_connections 2024-05-30T16:57:55.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.025+0000 7fd002e00640 1 -- 172.21.15.59:0/3128442220 wait complete. 2024-05-30T16:57:55.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone698818 2024-05-30T16:57:55.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.273+0000 7f22e4000640 1 Processor -- start 2024-05-30T16:57:55.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.273+0000 7f22e4000640 1 -- start start 2024-05-30T16:57:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e4000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f22dc159100 0x7f22dc06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e4000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22dc0b44e0 0x7f22dc15efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e4000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22dc0b52d0 con 0x7f22dc15f510 2024-05-30T16:57:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e4000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f22dc0b4a30 con 0x7f22dc0b44e0 2024-05-30T16:57:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e4000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f22dc0b4d10 con 0x7f22dc159100 2024-05-30T16:57:55.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e0c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22dc0b44e0 0x7f22dc15efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:55.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e0c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22dc0b44e0 0x7f22dc15efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54210/0 (socket says 172.21.15.59:54210) 2024-05-30T16:57:55.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e0c00640 1 -- 172.21.15.59:0/500774379 learned_addr learned my addr 172.21.15.59:0/500774379 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:55.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e1600640 1 --2- 172.21.15.59:0/500774379 >> v2:172.21.15.107:3300/0 conn(0x7f22dc159100 0x7f22dc06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:55.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e0c00640 1 -- 172.21.15.59:0/500774379 >> v2:172.21.15.107:3300/0 conn(0x7f22dc159100 msgr2=0x7f22dc06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:55.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e0c00640 1 --2- 172.21.15.59:0/500774379 >> v2:172.21.15.107:3300/0 conn(0x7f22dc159100 0x7f22dc06e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:55.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e0c00640 1 -- 172.21.15.59:0/500774379 >> v1:172.21.15.59:6789/0 conn(0x7f22dc15f510 legacy=0x7f22dc15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:55.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.277+0000 7f22e0c00640 1 -- 172.21.15.59:0/500774379 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc0b4ff0 con 0x7f22dc0b44e0 2024-05-30T16:57:55.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.281+0000 7f22e0c00640 1 --2- 172.21.15.59:0/500774379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22dc0b44e0 0x7f22dc15efd0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f22dc06c8f0 tx=0x7f22c801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947950f47f80e804 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:55.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.281+0000 7f22dbe00640 1 -- 172.21.15.59:0/500774379 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c80ab660 con 0x7f22dc0b44e0 2024-05-30T16:57:55.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.281+0000 7f22dbe00640 1 -- 172.21.15.59:0/500774379 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c80b0070 con 0x7f22dc0b44e0 2024-05-30T16:57:55.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.281+0000 7f22dbe00640 1 -- 172.21.15.59:0/500774379 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c80aba20 con 0x7f22dc0b44e0 2024-05-30T16:57:55.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.281+0000 7f22e4000640 1 -- 172.21.15.59:0/500774379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22dc0b44e0 msgr2=0x7f22dc15efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:55.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.281+0000 7f22e4000640 1 --2- 172.21.15.59:0/500774379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22dc0b44e0 0x7f22dc15efd0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f22dc06c8f0 tx=0x7f22c801c460 comp rx=0 tx=0).stop 2024-05-30T16:57:55.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.281+0000 7f22e4000640 1 -- 172.21.15.59:0/500774379 shutdown_connections 2024-05-30T16:57:55.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.281+0000 7f22e4000640 1 --2- 172.21.15.59:0/500774379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22dc0b44e0 0x7f22dc15efd0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:55.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.281+0000 7f22e4000640 1 --2- 172.21.15.59:0/500774379 >> v2:172.21.15.107:3300/0 conn(0x7f22dc159100 0x7f22dc06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:55.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.281+0000 7f22e4000640 1 -- 172.21.15.59:0/500774379 >> 172.21.15.59:0/500774379 conn(0x7f22dc06bdb0 msgr2=0x7f22dc06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:55.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.281+0000 7f22e4000640 1 -- 172.21.15.59:0/500774379 shutdown_connections 2024-05-30T16:57:55.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.281+0000 7f22e4000640 1 -- 172.21.15.59:0/500774379 wait complete. 2024-05-30T16:57:55.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e4000640 1 Processor -- start 2024-05-30T16:57:55.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e4000640 1 -- start start 2024-05-30T16:57:55.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e4000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22dc0b44e0 0x7f22dc151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:55.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e4000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22dc159100 0x7f22dc1fa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:55.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e4000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22dc15f510 0x7f22dc0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:55.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e4000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc1682c0 con 0x7f22dc0b44e0 2024-05-30T16:57:55.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e4000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc168140 con 0x7f22dc15f510 2024-05-30T16:57:55.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e4000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f22dc168440 con 0x7f22dc159100 2024-05-30T16:57:55.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e1600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22dc0b44e0 0x7f22dc151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:55.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e1600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22dc0b44e0 0x7f22dc151440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54216/0 (socket says 172.21.15.59:54216) 2024-05-30T16:57:55.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e1600640 1 -- 172.21.15.59:0/2605511998 learned_addr learned my addr 172.21.15.59:0/2605511998 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e1600640 1 -- 172.21.15.59:0/2605511998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22dc159100 msgr2=0x7f22dc1fa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e1600640 1 --2- 172.21.15.59:0/2605511998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22dc159100 0x7f22dc1fa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e1600640 1 -- 172.21.15.59:0/2605511998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22dc15f510 msgr2=0x7f22dc0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e1600640 1 --2- 172.21.15.59:0/2605511998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22dc15f510 0x7f22dc0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.285+0000 7f22e1600640 1 -- 172.21.15.59:0/2605511998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc1faea0 con 0x7f22dc0b44e0 2024-05-30T16:57:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.289+0000 7f22e1600640 1 --2- 172.21.15.59:0/2605511998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22dc0b44e0 0x7f22dc151440 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f22d000d800 tx=0x7f22d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.289+0000 7f22d9600640 1 -- 172.21.15.59:0/2605511998 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d000b6c0 con 0x7f22dc0b44e0 2024-05-30T16:57:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.289+0000 7f22d9600640 1 -- 172.21.15.59:0/2605511998 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d0019070 con 0x7f22dc0b44e0 2024-05-30T16:57:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.289+0000 7f22d9600640 1 -- 172.21.15.59:0/2605511998 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d000bae0 con 0x7f22dc0b44e0 2024-05-30T16:57:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.289+0000 7f22e4000640 1 -- 172.21.15.59:0/2605511998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22dc151ad0 con 0x7f22dc0b44e0 2024-05-30T16:57:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.289+0000 7f22e4000640 1 -- 172.21.15.59:0/2605511998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22dc152310 con 0x7f22dc0b44e0 2024-05-30T16:57:55.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.289+0000 7f22e4000640 1 -- 172.21.15.59:0/2605511998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22dc068a90 con 0x7f22dc0b44e0 2024-05-30T16:57:55.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.289+0000 7f22d9600640 1 -- 172.21.15.59:0/2605511998 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f22d000bc80 con 0x7f22dc0b44e0 2024-05-30T16:57:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.289+0000 7f22d9600640 1 --2- 172.21.15.59:0/2605511998 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f22bc069460 0x7f22bc06b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.289+0000 7f22d9600640 1 -- 172.21.15.59:0/2605511998 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f22d0085aa0 con 0x7f22dc0b44e0 2024-05-30T16:57:55.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.297+0000 7f22d9600640 1 -- 172.21.15.59:0/2605511998 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f22dc151ad0 con 0x7f22dc0b44e0 2024-05-30T16:57:55.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.313+0000 7f22e0c00640 1 --2- 172.21.15.59:0/2605511998 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f22bc069460 0x7f22bc06b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:55.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.325+0000 7f22e0c00640 1 --2- 172.21.15.59:0/2605511998 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f22bc069460 0x7f22bc06b920 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f22c80af000 tx=0x7f22c8004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:55.589+0000 7f22e4000640 1 -- 172.21.15.59:0/2605511998 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone698818", "target": ["mon-mgr", ""]}) -- 0x7f22dc073030 con 0x7f22bc069460 2024-05-30T16:57:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.585+0000 7f22d9600640 1 -- 172.21.15.59:0/2605511998 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f22dc073030 con 0x7f22bc069460 2024-05-30T16:57:56.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.589+0000 7f22e4000640 1 -- 172.21.15.59:0/2605511998 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f22bc069460 msgr2=0x7f22bc06b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:56.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.589+0000 7f22e4000640 1 --2- 172.21.15.59:0/2605511998 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f22bc069460 0x7f22bc06b920 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f22c80af000 tx=0x7f22c8004740 comp rx=0 tx=0).stop 2024-05-30T16:57:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.589+0000 7f22e4000640 1 -- 172.21.15.59:0/2605511998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22dc0b44e0 msgr2=0x7f22dc151440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.589+0000 7f22e4000640 1 --2- 172.21.15.59:0/2605511998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22dc0b44e0 0x7f22dc151440 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f22d000d800 tx=0x7f22d000dcc0 comp rx=0 tx=0).stop 2024-05-30T16:57:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.589+0000 7f22e4000640 1 -- 172.21.15.59:0/2605511998 shutdown_connections 2024-05-30T16:57:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.589+0000 7f22e4000640 1 --2- 172.21.15.59:0/2605511998 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f22bc069460 0x7f22bc06b920 secure :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f22c80af000 tx=0x7f22c8004740 comp rx=0 tx=0).stop 2024-05-30T16:57:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.589+0000 7f22e4000640 1 --2- 172.21.15.59:0/2605511998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22dc15f510 0x7f22dc0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.589+0000 7f22e4000640 1 --2- 172.21.15.59:0/2605511998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22dc159100 0x7f22dc1fa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.589+0000 7f22e4000640 1 --2- 172.21.15.59:0/2605511998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22dc0b44e0 0x7f22dc151440 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.589+0000 7f22e4000640 1 -- 172.21.15.59:0/2605511998 >> 172.21.15.59:0/2605511998 conn(0x7f22dc06bdb0 msgr2=0x7f22dc06e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.593+0000 7f22e4000640 1 -- 172.21.15.59:0/2605511998 shutdown_connections 2024-05-30T16:57:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.593+0000 7f22e4000640 1 -- 172.21.15.59:0/2605511998 wait complete. 2024-05-30T16:57:56.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone698819 2024-05-30T16:57:56.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.913+0000 7fdfa6a00640 1 Processor -- start 2024-05-30T16:57:56.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.913+0000 7fdfa6a00640 1 -- start start 2024-05-30T16:57:56.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.913+0000 7fdfa6a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdfa00ad2b0 0x7fdfa015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:56.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.913+0000 7fdfa6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfa00d0660 0x7fdfa00d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:56.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.913+0000 7fdfa6a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfa00ad770 con 0x7fdfa01569e0 2024-05-30T16:57:56.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.913+0000 7fdfa6a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa00d1010 con 0x7fdfa00d0660 2024-05-30T16:57:56.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.913+0000 7fdfa6a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa015cb40 con 0x7fdfa00ad2b0 2024-05-30T16:57:56.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.913+0000 7fdfa4a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfa00d0660 0x7fdfa00d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:56.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.913+0000 7fdfa4a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfa00d0660 0x7fdfa00d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54220/0 (socket says 172.21.15.59:54220) 2024-05-30T16:57:56.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.913+0000 7fdfa4a00640 1 -- 172.21.15.59:0/1964970839 learned_addr learned my addr 172.21.15.59:0/1964970839 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.917+0000 7fdfa4a00640 1 -- 172.21.15.59:0/1964970839 >> v2:172.21.15.107:3300/0 conn(0x7fdfa00ad2b0 msgr2=0x7fdfa015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.917+0000 7fdfa4a00640 1 --2- 172.21.15.59:0/1964970839 >> v2:172.21.15.107:3300/0 conn(0x7fdfa00ad2b0 0x7fdfa015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.917+0000 7fdfa4a00640 1 -- 172.21.15.59:0/1964970839 >> v1:172.21.15.107:6789/0 conn(0x7fdfa01569e0 legacy=0x7fdfa00cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.917+0000 7fdfa4a00640 1 -- 172.21.15.59:0/1964970839 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa015ce20 con 0x7fdfa00d0660 2024-05-30T16:57:56.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.921+0000 7fdfa4a00640 1 --2- 172.21.15.59:0/1964970839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfa00d0660 0x7fdfa00d0ad0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00b4c10 tx=0x7fdf9801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb5222fa6dd93b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:56.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.921+0000 7fdf9ea00640 1 -- 172.21.15.59:0/1964970839 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf980a5660 con 0x7fdfa00d0660 2024-05-30T16:57:56.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.921+0000 7fdf9ea00640 1 -- 172.21.15.59:0/1964970839 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf980a5800 con 0x7fdfa00d0660 2024-05-30T16:57:56.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.921+0000 7fdf9ea00640 1 -- 172.21.15.59:0/1964970839 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf980a5bd0 con 0x7fdfa00d0660 2024-05-30T16:57:56.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.925+0000 7fdfa6a00640 1 -- 172.21.15.59:0/1964970839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfa00d0660 msgr2=0x7fdfa00d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:56.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.925+0000 7fdfa6a00640 1 --2- 172.21.15.59:0/1964970839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfa00d0660 0x7fdfa00d0ad0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00b4c10 tx=0x7fdf9801c920 comp rx=0 tx=0).stop 2024-05-30T16:57:56.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.925+0000 7fdfa6a00640 1 -- 172.21.15.59:0/1964970839 shutdown_connections 2024-05-30T16:57:56.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.925+0000 7fdfa6a00640 1 --2- 172.21.15.59:0/1964970839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfa00d0660 0x7fdfa00d0ad0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:56.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.925+0000 7fdfa6a00640 1 --2- 172.21.15.59:0/1964970839 >> v2:172.21.15.107:3300/0 conn(0x7fdfa00ad2b0 0x7fdfa015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:56.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.925+0000 7fdfa6a00640 1 -- 172.21.15.59:0/1964970839 >> 172.21.15.59:0/1964970839 conn(0x7fdfa006bdb0 msgr2=0x7fdfa006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:56.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.925+0000 7fdfa6a00640 1 -- 172.21.15.59:0/1964970839 shutdown_connections 2024-05-30T16:57:56.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.925+0000 7fdfa6a00640 1 -- 172.21.15.59:0/1964970839 wait complete. 2024-05-30T16:57:56.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.925+0000 7fdfa6a00640 1 Processor -- start 2024-05-30T16:57:56.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.925+0000 7fdfa6a00640 1 -- start start 2024-05-30T16:57:56.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdfa00ad2b0 0x7fdfa014c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:56.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfa00d0660 0x7fdfa0151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfa01569e0 0x7fdfa006ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa6a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa00b3c60 con 0x7fdfa01569e0 2024-05-30T16:57:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa6a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa00b3ae0 con 0x7fdfa00d0660 2024-05-30T16:57:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa6a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa00b3de0 con 0x7fdfa00ad2b0 2024-05-30T16:57:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfa01569e0 0x7fdfa006ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfa01569e0 0x7fdfa006ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54224/0 (socket says 172.21.15.59:54224) 2024-05-30T16:57:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa4a00640 1 -- 172.21.15.59:0/3521065294 learned_addr learned my addr 172.21.15.59:0/3521065294 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa4a00640 1 -- 172.21.15.59:0/3521065294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdfa00ad2b0 msgr2=0x7fdfa014c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa4a00640 1 --2- 172.21.15.59:0/3521065294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdfa00ad2b0 0x7fdfa014c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa4a00640 1 -- 172.21.15.59:0/3521065294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfa00d0660 msgr2=0x7fdfa0151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa4a00640 1 --2- 172.21.15.59:0/3521065294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfa00d0660 0x7fdfa0151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa4a00640 1 -- 172.21.15.59:0/3521065294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa0150d20 con 0x7fdfa01569e0 2024-05-30T16:57:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdfa4a00640 1 --2- 172.21.15.59:0/3521065294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfa01569e0 0x7fdfa006ed90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fdf9801a550 tx=0x7fdf980196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:56.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdf97e00640 1 -- 172.21.15.59:0/3521065294 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf980bc020 con 0x7fdfa01569e0 2024-05-30T16:57:56.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdf97e00640 1 -- 172.21.15.59:0/3521065294 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf980b8690 con 0x7fdfa01569e0 2024-05-30T16:57:56.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.929+0000 7fdf97e00640 1 -- 172.21.15.59:0/3521065294 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf980b8a80 con 0x7fdfa01569e0 2024-05-30T16:57:56.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.933+0000 7fdfa6a00640 1 -- 172.21.15.59:0/3521065294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa0151000 con 0x7fdfa01569e0 2024-05-30T16:57:56.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.933+0000 7fdfa6a00640 1 -- 172.21.15.59:0/3521065294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa01515c0 con 0x7fdfa01569e0 2024-05-30T16:57:56.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.933+0000 7fdfa6a00640 1 -- 172.21.15.59:0/3521065294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa0152080 con 0x7fdfa01569e0 2024-05-30T16:57:56.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.933+0000 7fdf97e00640 1 -- 172.21.15.59:0/3521065294 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7fdf980bf020 con 0x7fdfa01569e0 2024-05-30T16:57:56.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.937+0000 7fdf97e00640 1 --2- 172.21.15.59:0/3521065294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdf80069530 0x7fdf8006b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:56.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.937+0000 7fdf97e00640 1 -- 172.21.15.59:0/3521065294 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fdf981205d0 con 0x7fdfa01569e0 2024-05-30T16:57:56.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.941+0000 7fdf9fe00640 1 --2- 172.21.15.59:0/3521065294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdf80069530 0x7fdf8006b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:56.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.945+0000 7fdf9fe00640 1 --2- 172.21.15.59:0/3521065294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdf80069530 0x7fdf8006b9f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdf90009650 tx=0x7fdf90006bb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:56.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:56.945+0000 7fdf97e00640 1 -- 172.21.15.59:0/3521065294 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdf980c6030 con 0x7fdfa01569e0 2024-05-30T16:57:57.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:57.321+0000 7fdfa6a00640 1 -- 172.21.15.59:0/3521065294 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone698819", "target": ["mon-mgr", ""]}) -- 0x7fdfa0068a90 con 0x7fdf80069530 2024-05-30T16:57:58.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.277+0000 7fdf97e00640 1 -- 172.21.15.59:0/3521065294 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdfa0068a90 con 0x7fdf80069530 2024-05-30T16:57:58.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.281+0000 7fdfa6a00640 1 -- 172.21.15.59:0/3521065294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdf80069530 msgr2=0x7fdf8006b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:58.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.281+0000 7fdfa6a00640 1 --2- 172.21.15.59:0/3521065294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdf80069530 0x7fdf8006b9f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdf90009650 tx=0x7fdf90006bb0 comp rx=0 tx=0).stop 2024-05-30T16:57:58.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.281+0000 7fdfa6a00640 1 -- 172.21.15.59:0/3521065294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfa01569e0 msgr2=0x7fdfa006ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:58.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.281+0000 7fdfa6a00640 1 --2- 172.21.15.59:0/3521065294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfa01569e0 0x7fdfa006ed90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fdf9801a550 tx=0x7fdf980196c0 comp rx=0 tx=0).stop 2024-05-30T16:57:58.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.281+0000 7fdfa6a00640 1 -- 172.21.15.59:0/3521065294 shutdown_connections 2024-05-30T16:57:58.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.281+0000 7fdfa6a00640 1 --2- 172.21.15.59:0/3521065294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdf80069530 0x7fdf8006b9f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:58.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.281+0000 7fdfa6a00640 1 --2- 172.21.15.59:0/3521065294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfa01569e0 0x7fdfa006ed90 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:58.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.281+0000 7fdfa6a00640 1 --2- 172.21.15.59:0/3521065294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfa00d0660 0x7fdfa0151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:58.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.281+0000 7fdfa6a00640 1 --2- 172.21.15.59:0/3521065294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdfa00ad2b0 0x7fdfa014c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:58.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.281+0000 7fdfa6a00640 1 -- 172.21.15.59:0/3521065294 >> 172.21.15.59:0/3521065294 conn(0x7fdfa006bdb0 msgr2=0x7fdfa0155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:58.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.281+0000 7fdfa6a00640 1 -- 172.21.15.59:0/3521065294 shutdown_connections 2024-05-30T16:57:58.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.281+0000 7fdfa6a00640 1 -- 172.21.15.59:0/3521065294 wait complete. 2024-05-30T16:57:58.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone698820 2024-05-30T16:57:58.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.505+0000 7fa253c00640 1 Processor -- start 2024-05-30T16:57:58.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.505+0000 7fa253c00640 1 -- start start 2024-05-30T16:57:58.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa253c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa24c161c70 0x7fa24c0cca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:58.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa253c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa24c09b150 0x7fa24c09b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa253c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa24c0d07c0 con 0x7fa24c162050 2024-05-30T16:57:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa253c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa24c06de10 con 0x7fa24c161c70 2024-05-30T16:57:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa253c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa24c06d570 con 0x7fa24c09b150 2024-05-30T16:57:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa251200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa24c161c70 0x7fa24c0cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa24be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa24c162050 0x7fa24c09aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42658/0 (socket says 172.21.15.59:42658) 2024-05-30T16:57:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa24be00640 1 -- 172.21.15.59:0/103754980 learned_addr learned my addr 172.21.15.59:0/103754980 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:57:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa251c00640 1 --2- 172.21.15.59:0/103754980 >> v2:172.21.15.107:3300/0 conn(0x7fa24c09b150 0x7fa24c09b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa251200640 1 -- 172.21.15.59:0/103754980 >> v2:172.21.15.107:3300/0 conn(0x7fa24c09b150 msgr2=0x7fa24c09b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:57:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa251200640 1 --2- 172.21.15.59:0/103754980 >> v2:172.21.15.107:3300/0 conn(0x7fa24c09b150 0x7fa24c09b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa251200640 1 -- 172.21.15.59:0/103754980 >> v1:172.21.15.59:6789/0 conn(0x7fa24c162050 legacy=0x7fa24c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa251200640 1 -- 172.21.15.59:0/103754980 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24c06d850 con 0x7fa24c161c70 2024-05-30T16:57:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.509+0000 7fa251c00640 1 --2- 172.21.15.59:0/103754980 >> v2:172.21.15.107:3300/0 conn(0x7fa24c09b150 0x7fa24c09b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:57:58.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.513+0000 7fa251200640 1 --2- 172.21.15.59:0/103754980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa24c161c70 0x7fa24c0cca90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fa24c073a80 tx=0x7fa24001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77a807f592d7ed0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:58.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.513+0000 7fa24b400640 1 -- 172.21.15.59:0/103754980 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2400b1070 con 0x7fa24c161c70 2024-05-30T16:57:58.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.513+0000 7fa24b400640 1 -- 172.21.15.59:0/103754980 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2400ac5f0 con 0x7fa24c161c70 2024-05-30T16:57:58.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.513+0000 7fa24b400640 1 -- 172.21.15.59:0/103754980 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2400ac9c0 con 0x7fa24c161c70 2024-05-30T16:57:58.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.513+0000 7fa253c00640 1 -- 172.21.15.59:0/103754980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa24c161c70 msgr2=0x7fa24c0cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:58.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.513+0000 7fa253c00640 1 --2- 172.21.15.59:0/103754980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa24c161c70 0x7fa24c0cca90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fa24c073a80 tx=0x7fa24001c480 comp rx=0 tx=0).stop 2024-05-30T16:57:58.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.513+0000 7fa253c00640 1 -- 172.21.15.59:0/103754980 shutdown_connections 2024-05-30T16:57:58.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.513+0000 7fa253c00640 1 --2- 172.21.15.59:0/103754980 >> v2:172.21.15.107:3300/0 conn(0x7fa24c09b150 0x7fa24c09b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:58.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.513+0000 7fa253c00640 1 --2- 172.21.15.59:0/103754980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa24c161c70 0x7fa24c0cca90 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:58.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.513+0000 7fa253c00640 1 -- 172.21.15.59:0/103754980 >> 172.21.15.59:0/103754980 conn(0x7fa24c0d2440 msgr2=0x7fa24c0d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:57:58.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.513+0000 7fa253c00640 1 -- 172.21.15.59:0/103754980 shutdown_connections 2024-05-30T16:57:58.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.513+0000 7fa253c00640 1 -- 172.21.15.59:0/103754980 wait complete. 2024-05-30T16:57:58.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa253c00640 1 Processor -- start 2024-05-30T16:57:58.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa253c00640 1 -- start start 2024-05-30T16:57:58.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa253c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa24c09b150 0x7fa24c151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:58.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa253c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa24c161c70 0x7fa24c0c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:58.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa253c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa24c162050 0x7fa24c0b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:58.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa253c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c0d1840 con 0x7fa24c162050 2024-05-30T16:57:58.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa253c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c0d16c0 con 0x7fa24c161c70 2024-05-30T16:57:58.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa253c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa24c0d19c0 con 0x7fa24c09b150 2024-05-30T16:57:58.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa251c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa24c162050 0x7fa24c0b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:58.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa251c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa24c162050 0x7fa24c0b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54242/0 (socket says 172.21.15.59:54242) 2024-05-30T16:57:58.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa251c00640 1 -- 172.21.15.59:0/1103301345 learned_addr learned my addr 172.21.15.59:0/1103301345 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:57:58.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa251c00640 1 -- 172.21.15.59:0/1103301345 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa24c09b150 msgr2=0x7fa24c151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:58.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa251c00640 1 --2- 172.21.15.59:0/1103301345 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa24c09b150 0x7fa24c151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:58.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa251c00640 1 -- 172.21.15.59:0/1103301345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa24c161c70 msgr2=0x7fa24c0c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:57:58.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa251c00640 1 --2- 172.21.15.59:0/1103301345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa24c161c70 0x7fa24c0c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:57:58.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.517+0000 7fa251c00640 1 -- 172.21.15.59:0/1103301345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24c151ca0 con 0x7fa24c162050 2024-05-30T16:57:58.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.521+0000 7fa251c00640 1 --2- 172.21.15.59:0/1103301345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa24c162050 0x7fa24c0b54a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa244007e70 tx=0x7fa24400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:58.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.521+0000 7fa248c00640 1 -- 172.21.15.59:0/1103301345 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24401a070 con 0x7fa24c162050 2024-05-30T16:57:58.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.521+0000 7fa248c00640 1 -- 172.21.15.59:0/1103301345 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa244003bc0 con 0x7fa24c162050 2024-05-30T16:57:58.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.521+0000 7fa248c00640 1 -- 172.21.15.59:0/1103301345 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24400de20 con 0x7fa24c162050 2024-05-30T16:57:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.521+0000 7fa253c00640 1 -- 172.21.15.59:0/1103301345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24c0c9f60 con 0x7fa24c162050 2024-05-30T16:57:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.521+0000 7fa253c00640 1 -- 172.21.15.59:0/1103301345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa24c151f40 con 0x7fa24c162050 2024-05-30T16:57:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.521+0000 7fa253c00640 1 -- 172.21.15.59:0/1103301345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa24c068a90 con 0x7fa24c162050 2024-05-30T16:57:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.521+0000 7fa248c00640 1 -- 172.21.15.59:0/1103301345 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7fa24401d070 con 0x7fa24c162050 2024-05-30T16:57:58.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.521+0000 7fa248c00640 1 --2- 172.21.15.59:0/1103301345 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa22c069460 0x7fa22c06b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:57:58.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.521+0000 7fa248c00640 1 -- 172.21.15.59:0/1103301345 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fa244085a70 con 0x7fa24c162050 2024-05-30T16:57:58.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.525+0000 7fa248c00640 1 -- 172.21.15.59:0/1103301345 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa244010070 con 0x7fa24c162050 2024-05-30T16:57:58.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.537+0000 7fa251200640 1 --2- 172.21.15.59:0/1103301345 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa22c069460 0x7fa22c06b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:57:58.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.577+0000 7fa251200640 1 --2- 172.21.15.59:0/1103301345 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa22c069460 0x7fa22c06b920 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa2400ae000 tx=0x7fa240004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:57:58.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:57:58.833+0000 7fa253c00640 1 -- 172.21.15.59:0/1103301345 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone698820", "target": ["mon-mgr", ""]}) -- 0x7fa24c0b83c0 con 0x7fa22c069460 2024-05-30T16:58:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.249+0000 7fa248c00640 1 -- 172.21.15.59:0/1103301345 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa24c0b83c0 con 0x7fa22c069460 2024-05-30T16:58:00.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.253+0000 7fa253c00640 1 -- 172.21.15.59:0/1103301345 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa22c069460 msgr2=0x7fa22c06b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:00.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.253+0000 7fa253c00640 1 --2- 172.21.15.59:0/1103301345 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa22c069460 0x7fa22c06b920 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa2400ae000 tx=0x7fa240004740 comp rx=0 tx=0).stop 2024-05-30T16:58:00.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.253+0000 7fa253c00640 1 -- 172.21.15.59:0/1103301345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa24c162050 msgr2=0x7fa24c0b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:00.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.253+0000 7fa253c00640 1 --2- 172.21.15.59:0/1103301345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa24c162050 0x7fa24c0b54a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa244007e70 tx=0x7fa24400d4a0 comp rx=0 tx=0).stop 2024-05-30T16:58:00.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.253+0000 7fa253c00640 1 -- 172.21.15.59:0/1103301345 shutdown_connections 2024-05-30T16:58:00.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.253+0000 7fa253c00640 1 --2- 172.21.15.59:0/1103301345 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa22c069460 0x7fa22c06b920 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:00.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.253+0000 7fa253c00640 1 --2- 172.21.15.59:0/1103301345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa24c162050 0x7fa24c0b54a0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:00.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.253+0000 7fa253c00640 1 --2- 172.21.15.59:0/1103301345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa24c161c70 0x7fa24c0c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:00.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.253+0000 7fa253c00640 1 --2- 172.21.15.59:0/1103301345 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa24c09b150 0x7fa24c151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:00.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.253+0000 7fa253c00640 1 -- 172.21.15.59:0/1103301345 >> 172.21.15.59:0/1103301345 conn(0x7fa24c0d2440 msgr2=0x7fa24c070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:00.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.253+0000 7fa253c00640 1 -- 172.21.15.59:0/1103301345 shutdown_connections 2024-05-30T16:58:00.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:00.253+0000 7fa253c00640 1 -- 172.21.15.59:0/1103301345 wait complete. 2024-05-30T16:58:02.294 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:58:02.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.489+0000 7f2132c00640 1 Processor -- start 2024-05-30T16:58:02.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.489+0000 7f2132c00640 1 -- start start 2024-05-30T16:58:02.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.489+0000 7f2132c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f212c0b1700 0x7f212c0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:02.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.489+0000 7f2132c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f212c0b22e0 0x7f212c09b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:02.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f2132c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212c09bd30 con 0x7f212c09b900 2024-05-30T16:58:02.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f2132c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f212c0b1ae0 con 0x7f212c0b22e0 2024-05-30T16:58:02.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f2132c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f212c0ce220 con 0x7f212c0b1700 2024-05-30T16:58:02.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f212b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f212c0b22e0 0x7f212c09b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:02.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f212b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f212c0b22e0 0x7f212c09b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32980/0 (socket says 172.21.15.59:32980) 2024-05-30T16:58:02.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f212b400640 1 -- 172.21.15.59:0/3197630559 learned_addr learned my addr 172.21.15.59:0/3197630559 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:02.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f2130c00640 1 --1- 172.21.15.59:0/3197630559 >> v1:172.21.15.59:6789/0 conn(0x7f212c09b900 0x7f212c1624e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40674/0 (socket says 172.21.15.59:40674) 2024-05-30T16:58:02.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f212be00640 1 --2- 172.21.15.59:0/3197630559 >> v2:172.21.15.107:3300/0 conn(0x7f212c0b1700 0x7f212c0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:02.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f212b400640 1 -- 172.21.15.59:0/3197630559 >> v2:172.21.15.107:3300/0 conn(0x7f212c0b1700 msgr2=0x7f212c0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:02.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f212b400640 1 --2- 172.21.15.59:0/3197630559 >> v2:172.21.15.107:3300/0 conn(0x7f212c0b1700 0x7f212c0b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:02.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f212b400640 1 -- 172.21.15.59:0/3197630559 >> v1:172.21.15.59:6789/0 conn(0x7f212c09b900 legacy=0x7f212c1624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:02.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f212b400640 1 -- 172.21.15.59:0/3197630559 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212c0ce500 con 0x7f212c0b22e0 2024-05-30T16:58:02.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f212aa00640 1 -- 172.21.15.59:0/3197630559 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327684105 0 0) 0x7f212c09bd30 con 0x7f212c09b900 2024-05-30T16:58:02.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.493+0000 7f212b400640 1 --2- 172.21.15.59:0/3197630559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212c0b22e0 0x7f212c09b3c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f212c06f8c0 tx=0x7f211801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfc2ea722c79e77 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:02.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f212aa00640 1 -- 172.21.15.59:0/3197630559 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21180b1070 con 0x7f212c0b22e0 2024-05-30T16:58:02.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f212aa00640 1 -- 172.21.15.59:0/3197630559 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21180ac600 con 0x7f212c0b22e0 2024-05-30T16:58:02.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f212aa00640 1 -- 172.21.15.59:0/3197630559 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21180ac9d0 con 0x7f212c0b22e0 2024-05-30T16:58:02.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f2132c00640 1 -- 172.21.15.59:0/3197630559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212c0b22e0 msgr2=0x7f212c09b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:02.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f2132c00640 1 --2- 172.21.15.59:0/3197630559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212c0b22e0 0x7f212c09b3c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f212c06f8c0 tx=0x7f211801c490 comp rx=0 tx=0).stop 2024-05-30T16:58:02.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f2132c00640 1 -- 172.21.15.59:0/3197630559 shutdown_connections 2024-05-30T16:58:02.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f2132c00640 1 --2- 172.21.15.59:0/3197630559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212c0b22e0 0x7f212c09b3c0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:02.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f2132c00640 1 --2- 172.21.15.59:0/3197630559 >> v2:172.21.15.107:3300/0 conn(0x7f212c0b1700 0x7f212c0b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:02.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f2132c00640 1 -- 172.21.15.59:0/3197630559 >> 172.21.15.59:0/3197630559 conn(0x7f212c0b3f30 msgr2=0x7f212c0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:02.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f2132c00640 1 -- 172.21.15.59:0/3197630559 shutdown_connections 2024-05-30T16:58:02.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f2132c00640 1 -- 172.21.15.59:0/3197630559 wait complete. 2024-05-30T16:58:02.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f2132c00640 1 Processor -- start 2024-05-30T16:58:02.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.497+0000 7f2132c00640 1 -- start start 2024-05-30T16:58:02.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2132c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212c09b900 0x7f212c1579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:02.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2132c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f212c0b1700 0x7f212c161610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:02.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2132c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f212c0b22e0 0x7f212c161b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:02.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2132c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f212c16bbb0 con 0x7f212c09b900 2024-05-30T16:58:02.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2132c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f212c16ba30 con 0x7f212c0b1700 2024-05-30T16:58:02.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2132c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f212c16bd30 con 0x7f212c0b22e0 2024-05-30T16:58:02.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f212be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212c09b900 0x7f212c1579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:02.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f212be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212c09b900 0x7f212c1579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32990/0 (socket says 172.21.15.59:32990) 2024-05-30T16:58:02.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f212be00640 1 -- 172.21.15.59:0/3279343344 learned_addr learned my addr 172.21.15.59:0/3279343344 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:02.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2130c00640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f212c0b22e0 0x7f212c161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f212be00640 1 -- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f212c0b22e0 msgr2=0x7f212c161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f212be00640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f212c0b22e0 0x7f212c161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f212be00640 1 -- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f212c0b1700 msgr2=0x7f212c161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f212be00640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f212c0b1700 0x7f212c161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f212be00640 1 -- 172.21.15.59:0/3279343344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212c0ca240 con 0x7f212c09b900 2024-05-30T16:58:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2130c00640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f212c0b22e0 0x7f212c161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:58:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f212be00640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212c09b900 0x7f212c1579b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2124007ef0 tx=0x7f212400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2123e00640 1 -- 172.21.15.59:0/3279343344 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2124014620 con 0x7f212c09b900 2024-05-30T16:58:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2123e00640 1 -- 172.21.15.59:0/3279343344 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2124019070 con 0x7f212c09b900 2024-05-30T16:58:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2123e00640 1 -- 172.21.15.59:0/3279343344 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2124014a00 con 0x7f212c09b900 2024-05-30T16:58:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2132c00640 1 -- 172.21.15.59:0/3279343344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f212c0ca520 con 0x7f212c09b900 2024-05-30T16:58:02.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2132c00640 1 -- 172.21.15.59:0/3279343344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f212c0caae0 con 0x7f212c09b900 2024-05-30T16:58:02.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.501+0000 7f2132c00640 1 -- 172.21.15.59:0/3279343344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f212c068a90 con 0x7f212c09b900 2024-05-30T16:58:02.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.505+0000 7f2123e00640 1 -- 172.21.15.59:0/3279343344 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f2124014ba0 con 0x7f212c09b900 2024-05-30T16:58:02.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.505+0000 7f2123e00640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f210c069460 0x7f210c06b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:02.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.505+0000 7f2123e00640 1 -- 172.21.15.59:0/3279343344 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f2124085e90 con 0x7f212c09b900 2024-05-30T16:58:02.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.505+0000 7f212b400640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f210c069460 0x7f210c06b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:02.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.509+0000 7f212b400640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f210c069460 0x7f210c06b920 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f21180ae000 tx=0x7f2118008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:02.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.517+0000 7f2123e00640 1 -- 172.21.15.59:0/3279343344 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2124057e70 con 0x7f212c09b900 2024-05-30T16:58:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.849+0000 7f2132c00640 1 -- 172.21.15.59:0/3279343344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f212c06e130 con 0x7f212c09b900 2024-05-30T16:58:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.849+0000 7f2123e00640 1 -- 172.21.15.59:0/3279343344 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+3081 (secure 0 0 0) 0x7f2124057770 con 0x7f212c09b900 2024-05-30T16:58:02.852 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:58:02.852 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:58:02.852 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:58:02.852 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:58:02.852 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:58:02.852 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:02.853 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 562, 2024-05-30T16:58:02.854 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:58:02.854 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:58:02.854 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:58:02.854 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:58:02.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:02.854 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:58:02.854 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 77, 2024-05-30T16:58:02.854 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:58:02.854 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:58:02.854 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:58:02.854 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:58:02.854 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 96 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+recovering", 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 1 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:02.855 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 5991, 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 24929362688, 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 49979760640, 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 723114352640, 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "misplaced_objects": 22, 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "misplaced_total": 11982, 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "misplaced_ratio": 0.0018360874645301285, 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_objects_per_sec": 10, 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_bytes_per_sec": 42939188, 2024-05-30T16:58:02.856 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_keys_per_sec": 0, 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects_recovered": 123, 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: "num_bytes_recovered": 515899392, 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: "num_keys_recovered": 0, 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 562400857, 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 568037239, 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 136, 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 151 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 43, 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5, 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:58:02.857 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:58:02.858 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:58:02.858 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:58:02.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:02.858 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 5, 2024-05-30T16:58:02.858 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:58:02.858 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "b", 2024-05-30T16:58:02.858 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:58:02.858 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 6528 2024-05-30T16:58:02.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:02.858 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:02.858 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 12, 2024-05-30T16:58:02.859 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:57:51.243602+0000", 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: "328dea24-359f-412d-91f5-463eae2a6988": { 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "11 ongoing+pending clones; Avg progress is 21.757% (22s)\n [======......................] (remaining: 82s)", 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.21757000684738159, 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: "69dc2fee-d1a2-4373-983d-d34ae135c500": { 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "Global Recovery Event (10s)\n [===========================.] ", 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.98969072103500366, 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:02.861 INFO:teuthology.orchestra.run.smithi059.stdout: "a2307bae-c24f-47e3-a595-961c250f4339": { 2024-05-30T16:58:02.861 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "4 ongoing clones; Avg progress is 0.0% (28s)\n [............................] ", 2024-05-30T16:58:02.861 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0, 2024-05-30T16:58:02.861 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:02.861 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:02.861 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:02.861 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:58:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.853+0000 7f2132c00640 1 -- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f210c069460 msgr2=0x7f210c06b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.853+0000 7f2132c00640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f210c069460 0x7f210c06b920 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f21180ae000 tx=0x7f2118008040 comp rx=0 tx=0).stop 2024-05-30T16:58:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.853+0000 7f2132c00640 1 -- 172.21.15.59:0/3279343344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212c09b900 msgr2=0x7f212c1579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.853+0000 7f2132c00640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212c09b900 0x7f212c1579b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2124007ef0 tx=0x7f212400e4b0 comp rx=0 tx=0).stop 2024-05-30T16:58:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.853+0000 7f2132c00640 1 -- 172.21.15.59:0/3279343344 shutdown_connections 2024-05-30T16:58:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.853+0000 7f2132c00640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f210c069460 0x7f210c06b920 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.853+0000 7f2132c00640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f212c0b22e0 0x7f212c161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.853+0000 7f2132c00640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f212c0b1700 0x7f212c161610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.853+0000 7f2132c00640 1 --2- 172.21.15.59:0/3279343344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212c09b900 0x7f212c1579b0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.853+0000 7f2132c00640 1 -- 172.21.15.59:0/3279343344 >> 172.21.15.59:0/3279343344 conn(0x7f212c0b3f30 msgr2=0x7f212c0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.853+0000 7f2132c00640 1 -- 172.21.15.59:0/3279343344 shutdown_connections 2024-05-30T16:58:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:02.853+0000 7f2132c00640 1 -- 172.21.15.59:0/3279343344 wait complete. 2024-05-30T16:58:02.880 INFO:tasks.cephfs.test_volumes:pevs - {'328dea24-359f-412d-91f5-463eae2a6988': {'message': '11 ongoing+pending clones; Avg progress is 21.757% (22s)\n [======......................] (remaining: 82s)', 'progress': 0.2175700068473816, 'add_to_ceph_s': True}, 'a2307bae-c24f-47e3-a595-961c250f4339': {'message': '4 ongoing clones; Avg progress is 0.0% (28s)\n [............................] ', 'progress': 0, 'add_to_ceph_s': True}} 2024-05-30T16:58:02.880 INFO:tasks.cephfs.test_volumes:new_onpen_p is less than onpen_p. 2024-05-30T16:58:02.880 INFO:tasks.cephfs.test_volumes:new_onpen_p = 0.2175700068473816; onpen_p = 0.23385000228881836 2024-05-30T16:58:02.880 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69881 2024-05-30T16:58:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.089+0000 7f2b75200640 1 Processor -- start 2024-05-30T16:58:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.089+0000 7f2b75200640 1 -- start start 2024-05-30T16:58:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b75200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2b7015c890 0x7f2b700cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b75200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b700b3a70 0x7f2b7006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b75200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2b7006bef0 0x7f2b70160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b75200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f2b700c4cf0 con 0x7f2b7015c890 2024-05-30T16:58:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b75200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2b700ce160 con 0x7f2b7006bef0 2024-05-30T16:58:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b75200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2b700ce440 con 0x7f2b700b3a70 2024-05-30T16:58:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b6de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2b7015c890 0x7f2b700cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b6de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2b7015c890 0x7f2b700cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32994/0 (socket says 172.21.15.59:32994) 2024-05-30T16:58:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b6de00640 1 -- 172.21.15.59:0/2044304441 learned_addr learned my addr 172.21.15.59:0/2044304441 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b6d400640 1 --2- 172.21.15.59:0/2044304441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b700b3a70 0x7f2b7006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b6de00640 1 -- 172.21.15.59:0/2044304441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b700b3a70 msgr2=0x7f2b7006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b6de00640 1 --2- 172.21.15.59:0/2044304441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b700b3a70 0x7f2b7006b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b6de00640 1 -- 172.21.15.59:0/2044304441 >> v2:172.21.15.107:3300/0 conn(0x7f2b7006bef0 msgr2=0x7f2b70160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b6de00640 1 --2- 172.21.15.59:0/2044304441 >> v2:172.21.15.107:3300/0 conn(0x7f2b7006bef0 0x7f2b70160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.093+0000 7f2b6de00640 1 -- 172.21.15.59:0/2044304441 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b700ce720 con 0x7f2b7015c890 2024-05-30T16:58:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.101+0000 7f2b6de00640 1 --2- 172.21.15.59:0/2044304441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7015c890 0x7f2b700cda60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2b700b2f20 tx=0x7f2b60020690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37444d55ed7eb7b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.101+0000 7f2b6ca00640 1 -- 172.21.15.59:0/2044304441 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600ad610 con 0x7f2b7015c890 2024-05-30T16:58:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.101+0000 7f2b6ca00640 1 -- 172.21.15.59:0/2044304441 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b600ad7b0 con 0x7f2b7015c890 2024-05-30T16:58:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.101+0000 7f2b6ca00640 1 -- 172.21.15.59:0/2044304441 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600adb80 con 0x7f2b7015c890 2024-05-30T16:58:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.101+0000 7f2b75200640 1 -- 172.21.15.59:0/2044304441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7015c890 msgr2=0x7f2b700cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.101+0000 7f2b75200640 1 --2- 172.21.15.59:0/2044304441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7015c890 0x7f2b700cda60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2b700b2f20 tx=0x7f2b60020690 comp rx=0 tx=0).stop 2024-05-30T16:58:03.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.105+0000 7f2b75200640 1 -- 172.21.15.59:0/2044304441 shutdown_connections 2024-05-30T16:58:03.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.105+0000 7f2b75200640 1 --2- 172.21.15.59:0/2044304441 >> v2:172.21.15.107:3300/0 conn(0x7f2b7006bef0 0x7f2b70160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:03.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.105+0000 7f2b75200640 1 --2- 172.21.15.59:0/2044304441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b700b3a70 0x7f2b7006b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:03.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.105+0000 7f2b75200640 1 --2- 172.21.15.59:0/2044304441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7015c890 0x7f2b700cda60 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:03.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.105+0000 7f2b75200640 1 -- 172.21.15.59:0/2044304441 >> 172.21.15.59:0/2044304441 conn(0x7f2b700b2f50 msgr2=0x7f2b700b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:03.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.105+0000 7f2b75200640 1 -- 172.21.15.59:0/2044304441 shutdown_connections 2024-05-30T16:58:03.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.105+0000 7f2b75200640 1 -- 172.21.15.59:0/2044304441 wait complete. 2024-05-30T16:58:03.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b75200640 1 Processor -- start 2024-05-30T16:58:03.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b75200640 1 -- start start 2024-05-30T16:58:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b75200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7006bef0 0x7f2b7014a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b6de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7006bef0 0x7f2b7014a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b75200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b700b3a70 0x7f2b700ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:03.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b75200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b7015c890 0x7f2b700ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:03.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b6de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7006bef0 0x7f2b7014a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33006/0 (socket says 172.21.15.59:33006) 2024-05-30T16:58:03.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b75200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2b700b18a0 con 0x7f2b7006bef0 2024-05-30T16:58:03.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b6de00640 1 -- 172.21.15.59:0/2433800160 learned_addr learned my addr 172.21.15.59:0/2433800160 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:03.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b75200640 1 -- 172.21.15.59:0/2433800160 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7006c360 con 0x7f2b7015c890 2024-05-30T16:58:03.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b75200640 1 -- 172.21.15.59:0/2433800160 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2b700b1a20 con 0x7f2b700b3a70 2024-05-30T16:58:03.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b6de00640 1 -- 172.21.15.59:0/2433800160 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b700b3a70 msgr2=0x7f2b700ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:03.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b6de00640 1 --2- 172.21.15.59:0/2433800160 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b700b3a70 0x7f2b700ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b6de00640 1 -- 172.21.15.59:0/2433800160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b7015c890 msgr2=0x7f2b700ca9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:58:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b6de00640 1 --2- 172.21.15.59:0/2433800160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b7015c890 0x7f2b700ca9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b6de00640 1 -- 172.21.15.59:0/2433800160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b700705c0 con 0x7f2b7006bef0 2024-05-30T16:58:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b6de00640 1 --2- 172.21.15.59:0/2433800160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7006bef0 0x7f2b7014a770 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2b600097c0 tx=0x7f2b6001d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b66000640 1 -- 172.21.15.59:0/2433800160 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600b5800 con 0x7f2b7006bef0 2024-05-30T16:58:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b66000640 1 -- 172.21.15.59:0/2433800160 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b600b59c0 con 0x7f2b7006bef0 2024-05-30T16:58:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b75200640 1 -- 172.21.15.59:0/2433800160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b700b6c30 con 0x7f2b7006bef0 2024-05-30T16:58:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.109+0000 7f2b66000640 1 -- 172.21.15.59:0/2433800160 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600b5db0 con 0x7f2b7006bef0 2024-05-30T16:58:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.113+0000 7f2b75200640 1 -- 172.21.15.59:0/2433800160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7015cd10 con 0x7f2b7006bef0 2024-05-30T16:58:03.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.113+0000 7f2b75200640 1 -- 172.21.15.59:0/2433800160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b70068a90 con 0x7f2b7006bef0 2024-05-30T16:58:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.113+0000 7f2b66000640 1 -- 172.21.15.59:0/2433800160 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7f2b600ad650 con 0x7f2b7006bef0 2024-05-30T16:58:03.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.117+0000 7f2b66000640 1 --2- 172.21.15.59:0/2433800160 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b50069460 0x7f2b5006b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:03.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.117+0000 7f2b66000640 1 -- 172.21.15.59:0/2433800160 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f2b60123f20 con 0x7f2b7006bef0 2024-05-30T16:58:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.117+0000 7f2b6d400640 1 --2- 172.21.15.59:0/2433800160 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b50069460 0x7f2b5006b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:03.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.121+0000 7f2b66000640 1 -- 172.21.15.59:0/2433800160 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2b600bb070 con 0x7f2b7006bef0 2024-05-30T16:58:03.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.125+0000 7f2b6d400640 1 --2- 172.21.15.59:0/2433800160 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b50069460 0x7f2b5006b920 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2b7009f580 tx=0x7f2b5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:03.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:03.473+0000 7f2b75200640 1 -- 172.21.15.59:0/2433800160 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69881", "target": ["mon-mgr", ""]}) -- 0x7f2b7014acb0 con 0x7f2b50069460 2024-05-30T16:58:03.602 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:03.599+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:58:03.602 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:03.599+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:58:03.602 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:03.599+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:58:03.602 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:03.599+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:58:03.602 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:03.599+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:58:04.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.213+0000 7f2b66000640 1 -- 172.21.15.59:0/2433800160 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f2b7014acb0 con 0x7f2b50069460 2024-05-30T16:58:04.213 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:04.211+0000 7efd6da00640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:04.214 INFO:teuthology.orchestra.run.smithi059.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:04.232 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:58:04.233 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69882 2024-05-30T16:58:04.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.469+0000 7ff4a7600640 1 Processor -- start 2024-05-30T16:58:04.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.469+0000 7ff4a7600640 1 -- start start 2024-05-30T16:58:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.473+0000 7ff4a7600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4a015e980 0x7ff4a00d4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.473+0000 7ff4a7600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff4a00b6810 0x7ff4a00d29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.473+0000 7ff4a7600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a00d30a0 con 0x7ff4a00ba1a0 2024-05-30T16:58:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.473+0000 7ff4a7600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a015ed60 con 0x7ff4a00b6810 2024-05-30T16:58:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.473+0000 7ff4a7600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a00ba600 con 0x7ff4a015e980 2024-05-30T16:58:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.473+0000 7ff4a5600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff4a00b6810 0x7ff4a00d29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.473+0000 7ff4a5600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff4a00b6810 0x7ff4a00d29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33022/0 (socket says 172.21.15.59:33022) 2024-05-30T16:58:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.473+0000 7ff4a5600640 1 -- 172.21.15.59:0/3562899804 learned_addr learned my addr 172.21.15.59:0/3562899804 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:04.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.473+0000 7ff4a5600640 1 -- 172.21.15.59:0/3562899804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4a015e980 msgr2=0x7ff4a00d4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:04.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.473+0000 7ff4a5600640 1 --2- 172.21.15.59:0/3562899804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4a015e980 0x7ff4a00d4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:04.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.473+0000 7ff4a5600640 1 -- 172.21.15.59:0/3562899804 >> v1:172.21.15.59:6789/0 conn(0x7ff4a00ba1a0 legacy=0x7ff4a00b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:04.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.473+0000 7ff4a5600640 1 -- 172.21.15.59:0/3562899804 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a00d3380 con 0x7ff4a00b6810 2024-05-30T16:58:04.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.477+0000 7ff4a5600640 1 --2- 172.21.15.59:0/3562899804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a00b6810 0x7ff4a00d29a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7ff498009e50 tx=0x7ff49801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50889c61af8471e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:04.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.481+0000 7ff49f400640 1 -- 172.21.15.59:0/3562899804 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4980b4070 con 0x7ff4a00b6810 2024-05-30T16:58:04.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.481+0000 7ff49f400640 1 -- 172.21.15.59:0/3562899804 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4980af400 con 0x7ff4a00b6810 2024-05-30T16:58:04.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.481+0000 7ff49f400640 1 -- 172.21.15.59:0/3562899804 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4980af7d0 con 0x7ff4a00b6810 2024-05-30T16:58:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.481+0000 7ff4a7600640 1 -- 172.21.15.59:0/3562899804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a00b6810 msgr2=0x7ff4a00d29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.481+0000 7ff4a7600640 1 --2- 172.21.15.59:0/3562899804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a00b6810 0x7ff4a00d29a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7ff498009e50 tx=0x7ff49801f210 comp rx=0 tx=0).stop 2024-05-30T16:58:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.481+0000 7ff4a7600640 1 -- 172.21.15.59:0/3562899804 shutdown_connections 2024-05-30T16:58:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.481+0000 7ff4a7600640 1 --2- 172.21.15.59:0/3562899804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a00b6810 0x7ff4a00d29a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.481+0000 7ff4a7600640 1 --2- 172.21.15.59:0/3562899804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4a015e980 0x7ff4a00d4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.481+0000 7ff4a7600640 1 -- 172.21.15.59:0/3562899804 >> 172.21.15.59:0/3562899804 conn(0x7ff4a00d1100 msgr2=0x7ff4a00d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:04.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.485+0000 7ff4a7600640 1 -- 172.21.15.59:0/3562899804 shutdown_connections 2024-05-30T16:58:04.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.485+0000 7ff4a7600640 1 -- 172.21.15.59:0/3562899804 wait complete. 2024-05-30T16:58:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.485+0000 7ff4a7600640 1 Processor -- start 2024-05-30T16:58:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.485+0000 7ff4a7600640 1 -- start start 2024-05-30T16:58:04.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff4a7600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4a00b6810 0x7ff4a0155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:04.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff4a7600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a00ba1a0 0x7ff4a015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:04.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff4a7600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4a015e980 0x7ff4a015f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:04.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff4a7600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a00d3c20 con 0x7ff4a00ba1a0 2024-05-30T16:58:04.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff4a7600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a00d3940 con 0x7ff4a00b6810 2024-05-30T16:58:04.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff4a7600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a00b76f0 con 0x7ff4a015e980 2024-05-30T16:58:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff49fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a00ba1a0 0x7ff4a015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff49fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a00ba1a0 0x7ff4a015cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33028/0 (socket says 172.21.15.59:33028) 2024-05-30T16:58:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff49fe00640 1 -- 172.21.15.59:0/2802891710 learned_addr learned my addr 172.21.15.59:0/2802891710 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff4a5600640 1 --2- 172.21.15.59:0/2802891710 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4a015e980 0x7ff4a015f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff49fe00640 1 -- 172.21.15.59:0/2802891710 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4a015e980 msgr2=0x7ff4a015f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff49fe00640 1 --2- 172.21.15.59:0/2802891710 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4a015e980 0x7ff4a015f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff49fe00640 1 -- 172.21.15.59:0/2802891710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4a00b6810 msgr2=0x7ff4a0155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff49fe00640 1 --2- 172.21.15.59:0/2802891710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4a00b6810 0x7ff4a0155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff49fe00640 1 -- 172.21.15.59:0/2802891710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a00cc160 con 0x7ff4a00ba1a0 2024-05-30T16:58:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff49fe00640 1 --2- 172.21.15.59:0/2802891710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a00ba1a0 0x7ff4a015cd30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c450 tx=0x7ff48c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:04.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff49cc00640 1 -- 172.21.15.59:0/2802891710 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c016020 con 0x7ff4a00ba1a0 2024-05-30T16:58:04.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff49cc00640 1 -- 172.21.15.59:0/2802891710 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48c0052d0 con 0x7ff4a00ba1a0 2024-05-30T16:58:04.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff49cc00640 1 -- 172.21.15.59:0/2802891710 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c007220 con 0x7ff4a00ba1a0 2024-05-30T16:58:04.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.489+0000 7ff4a7600640 1 -- 172.21.15.59:0/2802891710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a015c920 con 0x7ff4a00ba1a0 2024-05-30T16:58:04.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.493+0000 7ff4a7600640 1 -- 172.21.15.59:0/2802891710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a00cc6e0 con 0x7ff4a00ba1a0 2024-05-30T16:58:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.493+0000 7ff4a7600640 1 -- 172.21.15.59:0/2802891710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a0068a90 con 0x7ff4a00ba1a0 2024-05-30T16:58:04.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.497+0000 7ff49cc00640 1 -- 172.21.15.59:0/2802891710 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 89517+0+0 (secure 0 0 0) 0x7ff48c0073c0 con 0x7ff4a00ba1a0 2024-05-30T16:58:04.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.501+0000 7ff49cc00640 1 --2- 172.21.15.59:0/2802891710 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff480069530 0x7ff48006b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:04.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.501+0000 7ff49cc00640 1 -- 172.21.15.59:0/2802891710 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7ff48c085c90 con 0x7ff4a00ba1a0 2024-05-30T16:58:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.505+0000 7ff49cc00640 1 -- 172.21.15.59:0/2802891710 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff48c020020 con 0x7ff4a00ba1a0 2024-05-30T16:58:04.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.521+0000 7ff4a4c00640 1 --2- 172.21.15.59:0/2802891710 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff480069530 0x7ff48006b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:04.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.561+0000 7ff4a4c00640 1 --2- 172.21.15.59:0/2802891710 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff480069530 0x7ff48006b9f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff494009690 tx=0x7ff494006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:04.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:58:04.832 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:58:04.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:04.853+0000 7ff4a7600640 1 -- 172.21.15.59:0/2802891710 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69882", "target": ["mon-mgr", ""]}) -- 0x7ff4a00d16f0 con 0x7ff480069530 2024-05-30T16:58:05.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:05.689+0000 7ff49cc00640 1 -- 172.21.15.59:0/2802891710 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 25) ==== 89568+0+0 (secure 0 0 0) 0x7ff48c053c10 con 0x7ff4a00ba1a0 2024-05-30T16:58:06.380 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:06.379+0000 7efd6da00640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:06.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.381+0000 7ff49cc00640 1 -- 172.21.15.59:0/2802891710 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7ff4a00d16f0 con 0x7ff480069530 2024-05-30T16:58:06.381 INFO:teuthology.orchestra.run.smithi059.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:06.392 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:58:06.393 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69883 2024-05-30T16:58:06.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.653+0000 7f9ab3800640 1 Processor -- start 2024-05-30T16:58:06.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.653+0000 7f9ab3800640 1 -- start start 2024-05-30T16:58:06.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.657+0000 7f9ab3800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9aac0b39e0 0x7f9aac162b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:06.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.657+0000 7f9ab3800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aac0b3fc0 con 0x7f9aac0d0d70 2024-05-30T16:58:06.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.657+0000 7f9ab3800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aac06ddb0 con 0x7f9aac162780 2024-05-30T16:58:06.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.657+0000 7f9ab3800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9aac0b42a0 con 0x7f9aac0b39e0 2024-05-30T16:58:06.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.657+0000 7f9ab1800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9aac0b39e0 0x7f9aac162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:06.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.657+0000 7f9ab1800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9aac0b39e0 0x7f9aac162b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33038/0 (socket says 172.21.15.59:33038) 2024-05-30T16:58:06.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.657+0000 7f9ab1800640 1 -- 172.21.15.59:0/3643689776 learned_addr learned my addr 172.21.15.59:0/3643689776 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:06.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.657+0000 7f9ab1800640 1 -- 172.21.15.59:0/3643689776 >> v1:172.21.15.107:6789/0 conn(0x7f9aac162780 legacy=0x7f9aac0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:06.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.657+0000 7f9ab1800640 1 -- 172.21.15.59:0/3643689776 >> v1:172.21.15.59:6789/0 conn(0x7f9aac0d0d70 legacy=0x7f9aac0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:06.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.657+0000 7f9ab1800640 1 -- 172.21.15.59:0/3643689776 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac06e090 con 0x7f9aac0b39e0 2024-05-30T16:58:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.661+0000 7f9ab1800640 1 --2- 172.21.15.59:0/3643689776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aac0b39e0 0x7f9aac162b60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009870 tx=0x7f9a9801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c85157e1879ba0a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.661+0000 7f9aab400640 1 -- 172.21.15.59:0/3643689776 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a980b2070 con 0x7f9aac0b39e0 2024-05-30T16:58:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.661+0000 7f9aab400640 1 -- 172.21.15.59:0/3643689776 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a980a9070 con 0x7f9aac0b39e0 2024-05-30T16:58:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.661+0000 7f9aab400640 1 -- 172.21.15.59:0/3643689776 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a980ad880 con 0x7f9aac0b39e0 2024-05-30T16:58:06.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.665+0000 7f9ab3800640 1 -- 172.21.15.59:0/3643689776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aac0b39e0 msgr2=0x7f9aac162b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:06.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.665+0000 7f9ab3800640 1 --2- 172.21.15.59:0/3643689776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aac0b39e0 0x7f9aac162b60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009870 tx=0x7f9a9801c450 comp rx=0 tx=0).stop 2024-05-30T16:58:06.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.665+0000 7f9ab3800640 1 -- 172.21.15.59:0/3643689776 shutdown_connections 2024-05-30T16:58:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.665+0000 7f9ab3800640 1 --2- 172.21.15.59:0/3643689776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aac0b39e0 0x7f9aac162b60 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.665+0000 7f9ab3800640 1 -- 172.21.15.59:0/3643689776 >> 172.21.15.59:0/3643689776 conn(0x7f9aac06bdb0 msgr2=0x7f9aac06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.665+0000 7f9ab3800640 1 -- 172.21.15.59:0/3643689776 shutdown_connections 2024-05-30T16:58:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.665+0000 7f9ab3800640 1 -- 172.21.15.59:0/3643689776 wait complete. 2024-05-30T16:58:06.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.665+0000 7f9ab3800640 1 Processor -- start 2024-05-30T16:58:06.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.665+0000 7f9ab3800640 1 -- start start 2024-05-30T16:58:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.669+0000 7f9ab3800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9aac0b39e0 0x7f9aac15b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.669+0000 7f9ab3800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9aac0d0d70 0x7f9aac203fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.669+0000 7f9ab3800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aac162780 0x7f9aac204520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.669+0000 7f9ab3800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac170330 con 0x7f9aac162780 2024-05-30T16:58:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.669+0000 7f9ab3800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac1701b0 con 0x7f9aac0b39e0 2024-05-30T16:58:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.669+0000 7f9ab3800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9aac1704b0 con 0x7f9aac0d0d70 2024-05-30T16:58:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.669+0000 7f9ab1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aac162780 0x7f9aac204520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.669+0000 7f9ab1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aac162780 0x7f9aac204520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33044/0 (socket says 172.21.15.59:33044) 2024-05-30T16:58:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.669+0000 7f9ab1800640 1 -- 172.21.15.59:0/1469625694 learned_addr learned my addr 172.21.15.59:0/1469625694 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.669+0000 7f9ab0e00640 1 --2- 172.21.15.59:0/1469625694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9aac0b39e0 0x7f9aac15b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.669+0000 7f9aabe00640 1 --2- 172.21.15.59:0/1469625694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9aac0d0d70 0x7f9aac203fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:06.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.669+0000 7f9ab1800640 1 -- 172.21.15.59:0/1469625694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9aac0d0d70 msgr2=0x7f9aac203fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.673+0000 7f9ab1800640 1 --2- 172.21.15.59:0/1469625694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9aac0d0d70 0x7f9aac203fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.673+0000 7f9ab1800640 1 -- 172.21.15.59:0/1469625694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9aac0b39e0 msgr2=0x7f9aac15b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.673+0000 7f9ab1800640 1 --2- 172.21.15.59:0/1469625694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9aac0b39e0 0x7f9aac15b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.673+0000 7f9ab1800640 1 -- 172.21.15.59:0/1469625694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac1659d0 con 0x7f9aac162780 2024-05-30T16:58:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.673+0000 7f9aabe00640 1 --2- 172.21.15.59:0/1469625694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9aac0d0d70 0x7f9aac203fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:58:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.673+0000 7f9ab1800640 1 --2- 172.21.15.59:0/1469625694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aac162780 0x7f9aac204520 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9a9801a080 tx=0x7f9a9801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:06.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.673+0000 7f9aa8c00640 1 -- 172.21.15.59:0/1469625694 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a980bc020 con 0x7f9aac162780 2024-05-30T16:58:06.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.673+0000 7f9aa8c00640 1 -- 172.21.15.59:0/1469625694 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a980b8420 con 0x7f9aac162780 2024-05-30T16:58:06.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.673+0000 7f9aa8c00640 1 -- 172.21.15.59:0/1469625694 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a980b2040 con 0x7f9aac162780 2024-05-30T16:58:06.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.673+0000 7f9ab3800640 1 -- 172.21.15.59:0/1469625694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aac204ba0 con 0x7f9aac162780 2024-05-30T16:58:06.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.677+0000 7f9ab3800640 1 -- 172.21.15.59:0/1469625694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aac205180 con 0x7f9aac162780 2024-05-30T16:58:06.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.677+0000 7f9aa2000640 1 -- 172.21.15.59:0/1469625694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a800052a0 con 0x7f9aac162780 2024-05-30T16:58:06.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.681+0000 7f9aa8c00640 1 -- 172.21.15.59:0/1469625694 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 89568+0+0 (secure 0 0 0) 0x7f9a980bf020 con 0x7f9aac162780 2024-05-30T16:58:06.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.681+0000 7f9aa8c00640 1 --2- 172.21.15.59:0/1469625694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9a8c0694f0 0x7f9a8c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:06.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.681+0000 7f9aa8c00640 1 -- 172.21.15.59:0/1469625694 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f9a9811ffa0 con 0x7f9aac162780 2024-05-30T16:58:06.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.685+0000 7f9aa8c00640 1 -- 172.21.15.59:0/1469625694 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9a980c6030 con 0x7f9aac162780 2024-05-30T16:58:06.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.697+0000 7f9ab0e00640 1 --2- 172.21.15.59:0/1469625694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9a8c0694f0 0x7f9a8c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:06.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:06.701+0000 7f9ab0e00640 1 --2- 172.21.15.59:0/1469625694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9a8c0694f0 0x7f9a8c06b9b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009fd0 tx=0x7f9aa400d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:07.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.041+0000 7f9aa2000640 1 -- 172.21.15.59:0/1469625694 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69883", "target": ["mon-mgr", ""]}) -- 0x7f9a80000bd0 con 0x7f9a8c0694f0 2024-05-30T16:58:07.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.533+0000 7f9aa8c00640 1 -- 172.21.15.59:0/1469625694 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f9a80000bd0 con 0x7f9a8c0694f0 2024-05-30T16:58:07.536 INFO:teuthology.orchestra.run.smithi059.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:07.536 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:07.535+0000 7efd6da00640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:07.556 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:58:07.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69884 2024-05-30T16:58:07.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.785+0000 7fa7b6200640 1 Processor -- start 2024-05-30T16:58:07.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.785+0000 7fa7b6200640 1 -- start start 2024-05-30T16:58:07.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.789+0000 7fa7b6200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7b0162780 0x7fa7b0162b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:07.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.789+0000 7fa7b6200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7b00d0660 0x7fa7b00d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:07.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.789+0000 7fa7b6200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b00b3fc0 con 0x7fa7b00b32d0 2024-05-30T16:58:07.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.789+0000 7fa7b6200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b00d1000 con 0x7fa7b00d0660 2024-05-30T16:58:07.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.789+0000 7fa7b6200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b00b42a0 con 0x7fa7b0162780 2024-05-30T16:58:07.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.789+0000 7fa7aea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7b00d0660 0x7fa7b00d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:07.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.789+0000 7fa7aea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7b00d0660 0x7fa7b00d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33050/0 (socket says 172.21.15.59:33050) 2024-05-30T16:58:07.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.789+0000 7fa7aea00640 1 -- 172.21.15.59:0/81100282 learned_addr learned my addr 172.21.15.59:0/81100282 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:07.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.789+0000 7fa7aea00640 1 -- 172.21.15.59:0/81100282 >> v2:172.21.15.107:3300/0 conn(0x7fa7b0162780 msgr2=0x7fa7b0162b60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:58:07.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.789+0000 7fa7aea00640 1 --2- 172.21.15.59:0/81100282 >> v2:172.21.15.107:3300/0 conn(0x7fa7b0162780 0x7fa7b0162b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:07.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.789+0000 7fa7aea00640 1 -- 172.21.15.59:0/81100282 >> v1:172.21.15.59:6789/0 conn(0x7fa7b00b32d0 legacy=0x7fa7b00b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:07.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.789+0000 7fa7aea00640 1 -- 172.21.15.59:0/81100282 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b006ddb0 con 0x7fa7b00d0660 2024-05-30T16:58:07.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.797+0000 7fa7aea00640 1 --2- 172.21.15.59:0/81100282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7b00d0660 0x7fa7b00d0ac0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa7b006fef0 tx=0x7fa79c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527478696f4c751 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:07.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.797+0000 7fa7ae000640 1 -- 172.21.15.59:0/81100282 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0b2070 con 0x7fa7b00d0660 2024-05-30T16:58:07.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.797+0000 7fa7ae000640 1 -- 172.21.15.59:0/81100282 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79c0a9070 con 0x7fa7b00d0660 2024-05-30T16:58:07.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.797+0000 7fa7ae000640 1 -- 172.21.15.59:0/81100282 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0ad880 con 0x7fa7b00d0660 2024-05-30T16:58:07.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.797+0000 7fa7b6200640 1 -- 172.21.15.59:0/81100282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7b00d0660 msgr2=0x7fa7b00d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:07.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.801+0000 7fa7b6200640 1 --2- 172.21.15.59:0/81100282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7b00d0660 0x7fa7b00d0ac0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa7b006fef0 tx=0x7fa79c01c470 comp rx=0 tx=0).stop 2024-05-30T16:58:07.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.801+0000 7fa7b6200640 1 -- 172.21.15.59:0/81100282 shutdown_connections 2024-05-30T16:58:07.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.801+0000 7fa7b6200640 1 --2- 172.21.15.59:0/81100282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7b00d0660 0x7fa7b00d0ac0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:07.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.801+0000 7fa7b6200640 1 --2- 172.21.15.59:0/81100282 >> v2:172.21.15.107:3300/0 conn(0x7fa7b0162780 0x7fa7b0162b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:07.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.801+0000 7fa7b6200640 1 -- 172.21.15.59:0/81100282 >> 172.21.15.59:0/81100282 conn(0x7fa7b006bdb0 msgr2=0x7fa7b006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:07.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.801+0000 7fa7b6200640 1 -- 172.21.15.59:0/81100282 shutdown_connections 2024-05-30T16:58:07.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.801+0000 7fa7b6200640 1 -- 172.21.15.59:0/81100282 wait complete. 2024-05-30T16:58:07.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.805+0000 7fa7b6200640 1 Processor -- start 2024-05-30T16:58:07.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.805+0000 7fa7b6200640 1 -- start start 2024-05-30T16:58:07.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7b6200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7b00b32d0 0x7fa7b01474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:07.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7b6200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7b00d0660 0x7fa7b015fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:07.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7b6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7b0162780 0x7fa7b0158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:07.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7b6200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b006f430 con 0x7fa7b00b32d0 2024-05-30T16:58:07.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7b6200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b006f2b0 con 0x7fa7b00d0660 2024-05-30T16:58:07.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7b6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b006f5b0 con 0x7fa7b0162780 2024-05-30T16:58:07.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7af400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7b00b32d0 0x7fa7b01474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:07.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7aea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7b00d0660 0x7fa7b015fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:07.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7af400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7b00b32d0 0x7fa7b01474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33056/0 (socket says 172.21.15.59:33056) 2024-05-30T16:58:07.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7af400640 1 -- 172.21.15.59:0/332140202 learned_addr learned my addr 172.21.15.59:0/332140202 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:07.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7af400640 1 -- 172.21.15.59:0/332140202 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7b0162780 msgr2=0x7fa7b0158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:07.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7af400640 1 --2- 172.21.15.59:0/332140202 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7b0162780 0x7fa7b0158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:07.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7af400640 1 -- 172.21.15.59:0/332140202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7b00d0660 msgr2=0x7fa7b015fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:07.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7af400640 1 --2- 172.21.15.59:0/332140202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7b00d0660 0x7fa7b015fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:07.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7af400640 1 -- 172.21.15.59:0/332140202 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b0161120 con 0x7fa7b00b32d0 2024-05-30T16:58:07.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7af400640 1 --2- 172.21.15.59:0/332140202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7b00b32d0 0x7fa7b01474a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000b3e0 tx=0x7fa7a000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:07.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7a7400640 1 -- 172.21.15.59:0/332140202 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0015020 con 0x7fa7b00b32d0 2024-05-30T16:58:07.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7a7400640 1 -- 172.21.15.59:0/332140202 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a0011850 con 0x7fa7b00b32d0 2024-05-30T16:58:07.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.809+0000 7fa7a7400640 1 -- 172.21.15.59:0/332140202 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0011c40 con 0x7fa7b00b32d0 2024-05-30T16:58:07.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.813+0000 7fa7b6200640 1 -- 172.21.15.59:0/332140202 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b01605a0 con 0x7fa7b00b32d0 2024-05-30T16:58:07.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.813+0000 7fa7b6200640 1 -- 172.21.15.59:0/332140202 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b0160b60 con 0x7fa7b00b32d0 2024-05-30T16:58:07.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.813+0000 7fa7b6200640 1 -- 172.21.15.59:0/332140202 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b0068a90 con 0x7fa7b00b32d0 2024-05-30T16:58:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.813+0000 7fa7a7400640 1 -- 172.21.15.59:0/332140202 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 89568+0+0 (secure 0 0 0) 0x7fa7a0018020 con 0x7fa7b00b32d0 2024-05-30T16:58:07.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.817+0000 7fa7a7400640 1 --2- 172.21.15.59:0/332140202 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa790069570 0x7fa79006ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:07.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.817+0000 7fa7a7400640 1 -- 172.21.15.59:0/332140202 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fa7a00857c0 con 0x7fa7b00b32d0 2024-05-30T16:58:07.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.825+0000 7fa7aea00640 1 --2- 172.21.15.59:0/332140202 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa790069570 0x7fa79006ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:07.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.833+0000 7fa7a7400640 1 -- 172.21.15.59:0/332140202 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa7a001f020 con 0x7fa7b00b32d0 2024-05-30T16:58:07.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:07.845+0000 7fa7aea00640 1 --2- 172.21.15.59:0/332140202 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa790069570 0x7fa79006ba30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0af000 tx=0x7fa79c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:08.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.173+0000 7fa7b6200640 1 -- 172.21.15.59:0/332140202 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69884", "target": ["mon-mgr", ""]}) -- 0x7fa7b015f8f0 con 0x7fa790069570 2024-05-30T16:58:08.286 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:08.283+0000 7efd6da00640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.289+0000 7fa7a7400640 1 -- 172.21.15.59:0/332140202 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fa7b015f8f0 con 0x7fa790069570 2024-05-30T16:58:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:08.303 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:58:08.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69885 2024-05-30T16:58:08.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.549+0000 7f22c1000640 1 Processor -- start 2024-05-30T16:58:08.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.549+0000 7f22c1000640 1 -- start start 2024-05-30T16:58:08.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22c1000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22bc1460f0 0x7f22bc0733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:08.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22c1000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22bc0b2780 0x7f22bc06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:08.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22c1000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22bc15cba0 con 0x7f22bc06bef0 2024-05-30T16:58:08.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22c1000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f22bc0b2d40 con 0x7f22bc0b2780 2024-05-30T16:58:08.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22c1000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc0b0860 con 0x7f22bc1460f0 2024-05-30T16:58:08.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22b9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22bc0b2780 0x7f22bc06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22ba800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f22bc06bef0 0x7f22bc160160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40704/0 (socket says 172.21.15.59:40704) 2024-05-30T16:58:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22ba800640 1 -- 172.21.15.59:0/882903154 learned_addr learned my addr 172.21.15.59:0/882903154 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:58:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22b9e00640 1 --2- 172.21.15.59:0/882903154 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22bc1460f0 0x7f22bc0733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22b9400640 1 -- 172.21.15.59:0/882903154 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22bc1460f0 msgr2=0x7f22bc0733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22b9400640 1 --2- 172.21.15.59:0/882903154 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22bc1460f0 0x7f22bc0733e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22b9400640 1 -- 172.21.15.59:0/882903154 >> v1:172.21.15.59:6789/0 conn(0x7f22bc06bef0 legacy=0x7f22bc160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:08.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.553+0000 7f22b9400640 1 -- 172.21.15.59:0/882903154 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc0b0b40 con 0x7f22bc0b2780 2024-05-30T16:58:08.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22b9400640 1 --2- 172.21.15.59:0/882903154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc0b2780 0x7f22bc06b9b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f22a80097c0 tx=0x7f22a801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7699518cbd451ad server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:08.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22b8a00640 1 -- 172.21.15.59:0/882903154 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a80b0070 con 0x7f22bc0b2780 2024-05-30T16:58:08.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22b8a00640 1 -- 172.21.15.59:0/882903154 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a80ab600 con 0x7f22bc0b2780 2024-05-30T16:58:08.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22b8a00640 1 -- 172.21.15.59:0/882903154 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a80ab9d0 con 0x7f22bc0b2780 2024-05-30T16:58:08.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22c1000640 1 -- 172.21.15.59:0/882903154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc0b2780 msgr2=0x7f22bc06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:08.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22c1000640 1 --2- 172.21.15.59:0/882903154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc0b2780 0x7f22bc06b9b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f22a80097c0 tx=0x7f22a801c410 comp rx=0 tx=0).stop 2024-05-30T16:58:08.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22c1000640 1 -- 172.21.15.59:0/882903154 shutdown_connections 2024-05-30T16:58:08.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22c1000640 1 --2- 172.21.15.59:0/882903154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc0b2780 0x7f22bc06b9b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:08.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22c1000640 1 --2- 172.21.15.59:0/882903154 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22bc1460f0 0x7f22bc0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:08.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22c1000640 1 -- 172.21.15.59:0/882903154 >> 172.21.15.59:0/882903154 conn(0x7f22bc0b6b70 msgr2=0x7f22bc09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:08.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22c1000640 1 -- 172.21.15.59:0/882903154 shutdown_connections 2024-05-30T16:58:08.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22c1000640 1 -- 172.21.15.59:0/882903154 wait complete. 2024-05-30T16:58:08.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22c1000640 1 Processor -- start 2024-05-30T16:58:08.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.557+0000 7f22c1000640 1 -- start start 2024-05-30T16:58:08.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22c1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc06bef0 0x7f22bc15bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:08.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22c1000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22bc0b2780 0x7f22bc0b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:08.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22c1000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22bc1460f0 0x7f22bc15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22c1000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1692d0 con 0x7f22bc06bef0 2024-05-30T16:58:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22c1000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc06c300 con 0x7f22bc1460f0 2024-05-30T16:58:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22c1000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc169450 con 0x7f22bc0b2780 2024-05-30T16:58:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22b9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc06bef0 0x7f22bc15bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22b9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc06bef0 0x7f22bc15bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33082/0 (socket says 172.21.15.59:33082) 2024-05-30T16:58:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22b9e00640 1 -- 172.21.15.59:0/1559725469 learned_addr learned my addr 172.21.15.59:0/1559725469 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:08.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22b9e00640 1 -- 172.21.15.59:0/1559725469 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22bc0b2780 msgr2=0x7f22bc0b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:08.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22b9e00640 1 --2- 172.21.15.59:0/1559725469 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22bc0b2780 0x7f22bc0b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:08.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22b9e00640 1 -- 172.21.15.59:0/1559725469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22bc1460f0 msgr2=0x7f22bc15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:08.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22b9e00640 1 --2- 172.21.15.59:0/1559725469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22bc1460f0 0x7f22bc15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:08.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22b9e00640 1 -- 172.21.15.59:0/1559725469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc09b770 con 0x7f22bc06bef0 2024-05-30T16:58:08.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22b9e00640 1 --2- 172.21.15.59:0/1559725469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc06bef0 0x7f22bc15bfa0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00d800 tx=0x7f22ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:08.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22b2000640 1 -- 172.21.15.59:0/1559725469 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00b6c0 con 0x7f22bc06bef0 2024-05-30T16:58:08.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22b2000640 1 -- 172.21.15.59:0/1559725469 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ac019070 con 0x7f22bc06bef0 2024-05-30T16:58:08.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22b2000640 1 -- 172.21.15.59:0/1559725469 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00ba60 con 0x7f22bc06bef0 2024-05-30T16:58:08.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22c1000640 1 -- 172.21.15.59:0/1559725469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc09ba50 con 0x7f22bc06bef0 2024-05-30T16:58:08.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22c1000640 1 -- 172.21.15.59:0/1559725469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc09c010 con 0x7f22bc06bef0 2024-05-30T16:58:08.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.561+0000 7f22c1000640 1 -- 172.21.15.59:0/1559725469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22bc068a90 con 0x7f22bc06bef0 2024-05-30T16:58:08.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.565+0000 7f22b2000640 1 -- 172.21.15.59:0/1559725469 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 89568+0+0 (secure 0 0 0) 0x7f22ac00bc00 con 0x7f22bc06bef0 2024-05-30T16:58:08.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.565+0000 7f22b2000640 1 --2- 172.21.15.59:0/1559725469 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f229c0694f0 0x7f229c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:08.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.565+0000 7f22b2000640 1 -- 172.21.15.59:0/1559725469 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f22ac085d00 con 0x7f22bc06bef0 2024-05-30T16:58:08.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.573+0000 7f22b2000640 1 -- 172.21.15.59:0/1559725469 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f22ac057a20 con 0x7f22bc06bef0 2024-05-30T16:58:08.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.585+0000 7f22b9400640 1 --2- 172.21.15.59:0/1559725469 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f229c0694f0 0x7f229c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.633+0000 7f22b9400640 1 --2- 172.21.15.59:0/1559725469 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f229c0694f0 0x7f229c06b9b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f22a80ad000 tx=0x7f22a8004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:08.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:08.957+0000 7f22c1000640 1 -- 172.21.15.59:0/1559725469 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69885", "target": ["mon-mgr", ""]}) -- 0x7f22bc09c380 con 0x7f229c0694f0 2024-05-30T16:58:09.147 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:09.143+0000 7efd6da00640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:09.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.149+0000 7f22b2000640 1 -- 172.21.15.59:0/1559725469 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f22bc09c380 con 0x7f229c0694f0 2024-05-30T16:58:09.152 INFO:teuthology.orchestra.run.smithi059.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:09.161 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:58:09.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69886 2024-05-30T16:58:09.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.345+0000 7f7537600640 1 Processor -- start 2024-05-30T16:58:09.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.345+0000 7f7537600640 1 -- start start 2024-05-30T16:58:09.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.345+0000 7f7537600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f753006ffe0 0x7f75300b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.345+0000 7f7537600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753015ed20 con 0x7f75300af230 2024-05-30T16:58:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.345+0000 7f7537600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75300d0830 con 0x7f753015e940 2024-05-30T16:58:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.345+0000 7f7537600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f75300d10f0 con 0x7f753006ffe0 2024-05-30T16:58:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.345+0000 7f752fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f753006ffe0 0x7f75300b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.345+0000 7f7535600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f75300af230 0x7f753009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40720/0 (socket says 172.21.15.59:40720) 2024-05-30T16:58:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.345+0000 7f7535600640 1 -- 172.21.15.59:0/2863268674 learned_addr learned my addr 172.21.15.59:0/2863268674 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:58:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.345+0000 7f752fe00640 1 -- 172.21.15.59:0/2863268674 >> v1:172.21.15.107:6789/0 conn(0x7f753015e940 legacy=0x7f75300d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.345+0000 7f752fe00640 1 -- 172.21.15.59:0/2863268674 >> v1:172.21.15.59:6789/0 conn(0x7f75300af230 legacy=0x7f753009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.345+0000 7f752fe00640 1 -- 172.21.15.59:0/2863268674 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7530070670 con 0x7f753006ffe0 2024-05-30T16:58:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.349+0000 7f752fe00640 1 --2- 172.21.15.59:0/2863268674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f753006ffe0 0x7f75300b18c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f751c0097c0 tx=0x7f751c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9709035d455637ff server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.349+0000 7f752f400640 1 -- 172.21.15.59:0/2863268674 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0b5070 con 0x7f753006ffe0 2024-05-30T16:58:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.349+0000 7f752f400640 1 -- 172.21.15.59:0/2863268674 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f751c0a8950 con 0x7f753006ffe0 2024-05-30T16:58:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.349+0000 7f752f400640 1 -- 172.21.15.59:0/2863268674 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0a8d20 con 0x7f753006ffe0 2024-05-30T16:58:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.349+0000 7f7537600640 1 -- 172.21.15.59:0/2863268674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f753006ffe0 msgr2=0x7f75300b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.349+0000 7f7537600640 1 --2- 172.21.15.59:0/2863268674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f753006ffe0 0x7f75300b18c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f751c0097c0 tx=0x7f751c01ec50 comp rx=0 tx=0).stop 2024-05-30T16:58:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.349+0000 7f7537600640 1 -- 172.21.15.59:0/2863268674 shutdown_connections 2024-05-30T16:58:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.349+0000 7f7537600640 1 --2- 172.21.15.59:0/2863268674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f753006ffe0 0x7f75300b18c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.349+0000 7f7537600640 1 -- 172.21.15.59:0/2863268674 >> 172.21.15.59:0/2863268674 conn(0x7f75300b3f70 msgr2=0x7f75300b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.349+0000 7f7537600640 1 -- 172.21.15.59:0/2863268674 shutdown_connections 2024-05-30T16:58:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.349+0000 7f7537600640 1 -- 172.21.15.59:0/2863268674 wait complete. 2024-05-30T16:58:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.353+0000 7f7537600640 1 Processor -- start 2024-05-30T16:58:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.353+0000 7f7537600640 1 -- start start 2024-05-30T16:58:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.353+0000 7f7537600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f753006ffe0 0x7f753009f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.353+0000 7f7537600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75300af230 0x7f75300b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.353+0000 7f7537600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f753015e940 0x7f75300b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.353+0000 7f7537600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f75300d0d80 con 0x7f753006ffe0 2024-05-30T16:58:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.353+0000 7f7537600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7530070420 con 0x7f75300af230 2024-05-30T16:58:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.353+0000 7f7537600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f75300d1c90 con 0x7f753015e940 2024-05-30T16:58:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.353+0000 7f7534c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f753006ffe0 0x7f753009f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.353+0000 7f7534c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f753006ffe0 0x7f753009f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33096/0 (socket says 172.21.15.59:33096) 2024-05-30T16:58:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f7534c00640 1 -- 172.21.15.59:0/3611851872 learned_addr learned my addr 172.21.15.59:0/3611851872 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:09.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f752fe00640 1 --2- 172.21.15.59:0/3611851872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75300af230 0x7f75300b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:09.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f7534c00640 1 -- 172.21.15.59:0/3611851872 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f753015e940 msgr2=0x7f75300b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:09.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f7534c00640 1 --2- 172.21.15.59:0/3611851872 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f753015e940 0x7f75300b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:09.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f7534c00640 1 -- 172.21.15.59:0/3611851872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75300af230 msgr2=0x7f75300b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:09.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f7534c00640 1 --2- 172.21.15.59:0/3611851872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75300af230 0x7f75300b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:09.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f7534c00640 1 -- 172.21.15.59:0/3611851872 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7530160c00 con 0x7f753006ffe0 2024-05-30T16:58:09.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f752fe00640 1 --2- 172.21.15.59:0/3611851872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75300af230 0x7f75300b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:58:09.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f7534c00640 1 --2- 172.21.15.59:0/3611851872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f753006ffe0 0x7f753009f890 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f752400c490 tx=0x7f7524001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:09.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f752cc00640 1 -- 172.21.15.59:0/3611851872 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524017070 con 0x7f753006ffe0 2024-05-30T16:58:09.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f752cc00640 1 -- 172.21.15.59:0/3611851872 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524003600 con 0x7f753006ffe0 2024-05-30T16:58:09.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f752cc00640 1 -- 172.21.15.59:0/3611851872 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524003a30 con 0x7f753006ffe0 2024-05-30T16:58:09.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f7537600640 1 -- 172.21.15.59:0/3611851872 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7530160ee0 con 0x7f753006ffe0 2024-05-30T16:58:09.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f7537600640 1 -- 172.21.15.59:0/3611851872 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75301614a0 con 0x7f753006ffe0 2024-05-30T16:58:09.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f7537600640 1 -- 172.21.15.59:0/3611851872 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7530068a90 con 0x7f753006ffe0 2024-05-30T16:58:09.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.357+0000 7f752cc00640 1 -- 172.21.15.59:0/3611851872 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 89568+0+0 (secure 0 0 0) 0x7f752401a070 con 0x7f753006ffe0 2024-05-30T16:58:09.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.361+0000 7f752cc00640 1 --2- 172.21.15.59:0/3611851872 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7510069520 0x7f751006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:09.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.361+0000 7f752cc00640 1 -- 172.21.15.59:0/3611851872 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f7524084c70 con 0x7f753006ffe0 2024-05-30T16:58:09.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.365+0000 7f752cc00640 1 -- 172.21.15.59:0/3611851872 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7524056990 con 0x7f753006ffe0 2024-05-30T16:58:09.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.405+0000 7f752fe00640 1 --2- 172.21.15.59:0/3611851872 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7510069520 0x7f751006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.413+0000 7f752fe00640 1 --2- 172.21.15.59:0/3611851872 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7510069520 0x7f751006b9e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f751c0b2000 tx=0x7f751c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:09.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:09.657+0000 7f7537600640 1 -- 172.21.15.59:0/3611851872 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69886", "target": ["mon-mgr", ""]}) -- 0x7f75300d19d0 con 0x7f7510069520 2024-05-30T16:58:10.127 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:10.127+0000 7efd6da00640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.125+0000 7f752cc00640 1 -- 172.21.15.59:0/3611851872 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f75300d19d0 con 0x7f7510069520 2024-05-30T16:58:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:10.144 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:58:10.144 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69887 2024-05-30T16:58:10.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.401+0000 7f2f31600640 1 Processor -- start 2024-05-30T16:58:10.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.401+0000 7f2f31600640 1 -- start start 2024-05-30T16:58:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.401+0000 7f2f31600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2c0b44e0 0x7f2f2c15efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.401+0000 7f2f31600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2f2c15f510 0x7f2f2c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.401+0000 7f2f31600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2c0b52d0 con 0x7f2f2c159100 2024-05-30T16:58:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.401+0000 7f2f31600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2f2c0b4a30 con 0x7f2f2c15f510 2024-05-30T16:58:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.401+0000 7f2f31600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2f2c0b4d10 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.405+0000 7f2f2a000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2c0b44e0 0x7f2f2c15efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:10.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.405+0000 7f2f2a000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2c0b44e0 0x7f2f2c15efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:33004/0 (socket says 172.21.15.59:33004) 2024-05-30T16:58:10.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.405+0000 7f2f2a000640 1 -- 172.21.15.59:0/2388956380 learned_addr learned my addr 172.21.15.59:0/2388956380 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.417+0000 7f2f2a000640 1 -- 172.21.15.59:0/2388956380 >> v2:172.21.15.107:3300/0 conn(0x7f2f2c15f510 msgr2=0x7f2f2c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.417+0000 7f2f2a000640 1 --2- 172.21.15.59:0/2388956380 >> v2:172.21.15.107:3300/0 conn(0x7f2f2c15f510 0x7f2f2c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.417+0000 7f2f2a000640 1 -- 172.21.15.59:0/2388956380 >> v1:172.21.15.107:6789/0 conn(0x7f2f2c159100 legacy=0x7f2f2c06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.417+0000 7f2f2a000640 1 -- 172.21.15.59:0/2388956380 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2c0b4ff0 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.421+0000 7f2f2a000640 1 --2- 172.21.15.59:0/2388956380 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2c0b44e0 0x7f2f2c15efd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009870 tx=0x7f2f1801c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa696c78d4ff18f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:10.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.421+0000 7f2f29600640 1 -- 172.21.15.59:0/2388956380 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f180b0070 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.421+0000 7f2f29600640 1 -- 172.21.15.59:0/2388956380 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f180ab600 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.421+0000 7f2f29600640 1 -- 172.21.15.59:0/2388956380 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f180ab9d0 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.425+0000 7f2f31600640 1 -- 172.21.15.59:0/2388956380 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2c0b44e0 msgr2=0x7f2f2c15efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.425+0000 7f2f31600640 1 --2- 172.21.15.59:0/2388956380 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2c0b44e0 0x7f2f2c15efd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009870 tx=0x7f2f1801c3d0 comp rx=0 tx=0).stop 2024-05-30T16:58:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.425+0000 7f2f31600640 1 -- 172.21.15.59:0/2388956380 shutdown_connections 2024-05-30T16:58:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.425+0000 7f2f31600640 1 --2- 172.21.15.59:0/2388956380 >> v2:172.21.15.107:3300/0 conn(0x7f2f2c15f510 0x7f2f2c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.425+0000 7f2f31600640 1 --2- 172.21.15.59:0/2388956380 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2c0b44e0 0x7f2f2c15efd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.425+0000 7f2f31600640 1 -- 172.21.15.59:0/2388956380 >> 172.21.15.59:0/2388956380 conn(0x7f2f2c06bdb0 msgr2=0x7f2f2c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.425+0000 7f2f31600640 1 -- 172.21.15.59:0/2388956380 shutdown_connections 2024-05-30T16:58:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.425+0000 7f2f31600640 1 -- 172.21.15.59:0/2388956380 wait complete. 2024-05-30T16:58:10.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.425+0000 7f2f31600640 1 Processor -- start 2024-05-30T16:58:10.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.425+0000 7f2f31600640 1 -- start start 2024-05-30T16:58:10.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f31600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f2c0b44e0 0x7f2f2c150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:10.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f31600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2c159100 0x7f2f2c15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:10.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f31600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f2c15f510 0x7f2f2c15ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:10.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f31600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c1684d0 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f31600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c168350 con 0x7f2f2c15f510 2024-05-30T16:58:10.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f31600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2f2c168650 con 0x7f2f2c159100 2024-05-30T16:58:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f2aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f2c0b44e0 0x7f2f2c150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f2aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f2c0b44e0 0x7f2f2c150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33104/0 (socket says 172.21.15.59:33104) 2024-05-30T16:58:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f2aa00640 1 -- 172.21.15.59:0/3524677205 learned_addr learned my addr 172.21.15.59:0/3524677205 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f2aa00640 1 -- 172.21.15.59:0/3524677205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2c159100 msgr2=0x7f2f2c15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f2aa00640 1 --2- 172.21.15.59:0/3524677205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f2c159100 0x7f2f2c15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f2aa00640 1 -- 172.21.15.59:0/3524677205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f2c15f510 msgr2=0x7f2f2c15ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f2aa00640 1 --2- 172.21.15.59:0/3524677205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f2c15f510 0x7f2f2c15ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f2aa00640 1 -- 172.21.15.59:0/3524677205 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2c15b330 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f2aa00640 1 --2- 172.21.15.59:0/3524677205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f2c0b44e0 0x7f2f2c150410 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00c490 tx=0x7f2f1c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f22a00640 1 -- 172.21.15.59:0/3524677205 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c017070 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f22a00640 1 -- 172.21.15.59:0/3524677205 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1c003600 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f31600640 1 -- 172.21.15.59:0/3524677205 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2c0b26c0 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f22a00640 1 -- 172.21.15.59:0/3524677205 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0039f0 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.429+0000 7f2f31600640 1 -- 172.21.15.59:0/3524677205 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f2c0b2c80 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.433+0000 7f2f31600640 1 -- 172.21.15.59:0/3524677205 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f2c068a90 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.433+0000 7f2f22a00640 1 -- 172.21.15.59:0/3524677205 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 89568+0+0 (secure 0 0 0) 0x7f2f1c01a070 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.437+0000 7f2f22a00640 1 --2- 172.21.15.59:0/3524677205 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f0c0694f0 0x7f2f0c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:10.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.437+0000 7f2f22a00640 1 -- 172.21.15.59:0/3524677205 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f2f1c084d40 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.449+0000 7f2f22a00640 1 -- 172.21.15.59:0/3524677205 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2f1c056a00 con 0x7f2f2c0b44e0 2024-05-30T16:58:10.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.453+0000 7f2f2a000640 1 --2- 172.21.15.59:0/3524677205 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f0c0694f0 0x7f2f0c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:10.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.465+0000 7f2f2a000640 1 --2- 172.21.15.59:0/3524677205 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f0c0694f0 0x7f2f0c06b9b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2f180ad000 tx=0x7f2f18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:10.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:10.737+0000 7f2f31600640 1 -- 172.21.15.59:0/3524677205 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69887", "target": ["mon-mgr", ""]}) -- 0x7f2f2c06f3e0 con 0x7f2f0c0694f0 2024-05-30T16:58:11.219 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:11.219+0000 7efd6da00640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.221+0000 7f2f22a00640 1 -- 172.21.15.59:0/3524677205 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f2f2c06f3e0 con 0x7f2f0c0694f0 2024-05-30T16:58:11.226 INFO:teuthology.orchestra.run.smithi059.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:11.245 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:58:11.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69888 2024-05-30T16:58:11.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.461+0000 7f8886a00640 1 Processor -- start 2024-05-30T16:58:11.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.461+0000 7f8886a00640 1 -- start start 2024-05-30T16:58:11.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f8886a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888009b150 0x7f88800cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:11.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f8886a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f888009b780 0x7f88800ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:11.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f8886a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88800d1310 con 0x7f8880160d90 2024-05-30T16:58:11.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f8886a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f888009bcf0 con 0x7f888009b780 2024-05-30T16:58:11.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f8886a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f88800d0a70 con 0x7f888009b150 2024-05-30T16:58:11.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f8884a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f888009b780 0x7f88800ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:11.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f8884a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f888009b780 0x7f88800ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33118/0 (socket says 172.21.15.59:33118) 2024-05-30T16:58:11.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f8884a00640 1 -- 172.21.15.59:0/835244092 learned_addr learned my addr 172.21.15.59:0/835244092 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:11.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f887f400640 1 --2- 172.21.15.59:0/835244092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888009b150 0x7f88800cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:11.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f8884a00640 1 -- 172.21.15.59:0/835244092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888009b150 msgr2=0x7f88800cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:11.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f8884a00640 1 --2- 172.21.15.59:0/835244092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888009b150 0x7f88800cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:11.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f8884a00640 1 -- 172.21.15.59:0/835244092 >> v1:172.21.15.107:6789/0 conn(0x7f8880160d90 legacy=0x7f888009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:11.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.465+0000 7f8884a00640 1 -- 172.21.15.59:0/835244092 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88800d0d50 con 0x7f888009b780 2024-05-30T16:58:11.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.473+0000 7f8884a00640 1 --2- 172.21.15.59:0/835244092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009b780 0x7f88800ce260 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8870009870 tx=0x7f887001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1550f5c69b1dd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:11.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.473+0000 7f887ea00640 1 -- 172.21.15.59:0/835244092 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700b2070 con 0x7f888009b780 2024-05-30T16:58:11.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.473+0000 7f887ea00640 1 -- 172.21.15.59:0/835244092 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88700a9070 con 0x7f888009b780 2024-05-30T16:58:11.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.473+0000 7f887ea00640 1 -- 172.21.15.59:0/835244092 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700ad880 con 0x7f888009b780 2024-05-30T16:58:11.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.473+0000 7f8886a00640 1 -- 172.21.15.59:0/835244092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009b780 msgr2=0x7f88800ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:11.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.473+0000 7f8886a00640 1 --2- 172.21.15.59:0/835244092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009b780 0x7f88800ce260 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8870009870 tx=0x7f887001c490 comp rx=0 tx=0).stop 2024-05-30T16:58:11.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.473+0000 7f8886a00640 1 -- 172.21.15.59:0/835244092 shutdown_connections 2024-05-30T16:58:11.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.473+0000 7f8886a00640 1 --2- 172.21.15.59:0/835244092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009b780 0x7f88800ce260 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:11.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.473+0000 7f8886a00640 1 --2- 172.21.15.59:0/835244092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888009b150 0x7f88800cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:11.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.473+0000 7f8886a00640 1 -- 172.21.15.59:0/835244092 >> 172.21.15.59:0/835244092 conn(0x7f88800b3f80 msgr2=0x7f88800b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:11.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.473+0000 7f8886a00640 1 -- 172.21.15.59:0/835244092 shutdown_connections 2024-05-30T16:58:11.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.473+0000 7f8886a00640 1 -- 172.21.15.59:0/835244092 wait complete. 2024-05-30T16:58:11.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.477+0000 7f8886a00640 1 Processor -- start 2024-05-30T16:58:11.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.477+0000 7f8886a00640 1 -- start start 2024-05-30T16:58:11.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.477+0000 7f8886a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888009b150 0x7f8880157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:11.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.477+0000 7f8886a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009b780 0x7f88800b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:11.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.477+0000 7f8886a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8880160d90 0x7f888006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:11.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.477+0000 7f8886a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8880071fe0 con 0x7f888009b780 2024-05-30T16:58:11.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.477+0000 7f8886a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8880071e60 con 0x7f8880160d90 2024-05-30T16:58:11.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.477+0000 7f8886a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8880161170 con 0x7f888009b150 2024-05-30T16:58:11.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.481+0000 7f8884a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8880160d90 0x7f888006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:11.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.481+0000 7f8884a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8880160d90 0x7f888006dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:34656/0 (socket says 172.21.15.59:34656) 2024-05-30T16:58:11.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.481+0000 7f8884a00640 1 -- 172.21.15.59:0/3679769165 learned_addr learned my addr 172.21.15.59:0/3679769165 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:11.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.481+0000 7f887fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888009b150 0x7f8880157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:11.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.481+0000 7f8884a00640 1 -- 172.21.15.59:0/3679769165 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888009b150 msgr2=0x7f8880157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:11.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.481+0000 7f8884a00640 1 --2- 172.21.15.59:0/3679769165 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888009b150 0x7f8880157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:11.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.481+0000 7f8884a00640 1 -- 172.21.15.59:0/3679769165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009b780 msgr2=0x7f88800b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:11.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.481+0000 7f8884a00640 1 --2- 172.21.15.59:0/3679769165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009b780 0x7f88800b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:11.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.481+0000 7f8884a00640 1 -- 172.21.15.59:0/3679769165 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88800c74d0 con 0x7f8880160d90 2024-05-30T16:58:11.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.485+0000 7f8884a00640 1 --2- 172.21.15.59:0/3679769165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8880160d90 0x7f888006dbd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f88700b0040 tx=0x7f887001acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.489+0000 7f8877e00640 1 -- 172.21.15.59:0/3679769165 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700bc020 con 0x7f8880160d90 2024-05-30T16:58:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.489+0000 7f8877e00640 1 -- 172.21.15.59:0/3679769165 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88700b8420 con 0x7f8880160d90 2024-05-30T16:58:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.489+0000 7f8877e00640 1 -- 172.21.15.59:0/3679769165 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700b2040 con 0x7f8880160d90 2024-05-30T16:58:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.493+0000 7f8886a00640 1 -- 172.21.15.59:0/3679769165 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88800c77b0 con 0x7f8880160d90 2024-05-30T16:58:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.493+0000 7f8886a00640 1 -- 172.21.15.59:0/3679769165 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88800c7d70 con 0x7f8880160d90 2024-05-30T16:58:11.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.493+0000 7f8886a00640 1 -- 172.21.15.59:0/3679769165 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8880068a90 con 0x7f8880160d90 2024-05-30T16:58:11.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.497+0000 7f8877e00640 1 -- 172.21.15.59:0/3679769165 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) ==== 89568+0+0 (secure 0 0 0) 0x7f88700bf020 con 0x7f8880160d90 2024-05-30T16:58:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.497+0000 7f8877e00640 1 --2- 172.21.15.59:0/3679769165 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8860069540 0x7f886006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.501+0000 7f8877e00640 1 -- 172.21.15.59:0/3679769165 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f887011fd10 con 0x7f8880160d90 2024-05-30T16:58:11.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.509+0000 7f8877e00640 1 -- 172.21.15.59:0/3679769165 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f88700c6030 con 0x7f8880160d90 2024-05-30T16:58:11.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.517+0000 7f887fe00640 1 --2- 172.21.15.59:0/3679769165 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8860069540 0x7f886006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:11.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.525+0000 7f887fe00640 1 --2- 172.21.15.59:0/3679769165 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8860069540 0x7f886006ba00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f88780098e0 tx=0x7f8878009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:11.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:11.909+0000 7f8886a00640 1 -- 172.21.15.59:0/3679769165 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69888", "target": ["mon-mgr", ""]}) -- 0x7f88800b4be0 con 0x7f8860069540 2024-05-30T16:58:12.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.353+0000 7f8877e00640 1 -- 172.21.15.59:0/3679769165 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f88800b4be0 con 0x7f8860069540 2024-05-30T16:58:12.355 INFO:teuthology.orchestra.run.smithi059.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:12.357 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:58:12.351+0000 7efd6da00640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:58:12.366 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:58:12.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone69889 2024-05-30T16:58:12.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.629+0000 7f049c600640 1 Processor -- start 2024-05-30T16:58:12.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.629+0000 7f049c600640 1 -- start start 2024-05-30T16:58:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f049c600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0494160d90 0x7f049409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f0499c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0494160d90 0x7f049409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f0499c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0494160d90 0x7f049409aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59060/0 (socket says 172.21.15.59:59060) 2024-05-30T16:58:12.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f0499c00640 1 -- 172.21.15.59:0/753101505 learned_addr learned my addr 172.21.15.59:0/753101505 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f049c600640 1 --2- 172.21.15.59:0/753101505 >> v2:172.21.15.107:3300/0 conn(0x7f049409b780 0x7f049409af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f049c600640 1 --2- 172.21.15.59:0/753101505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04940711e0 0x7f049406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f049c600640 1 -- 172.21.15.59:0/753101505 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f04940d1310 con 0x7f0494160d90 2024-05-30T16:58:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f049c600640 1 -- 172.21.15.59:0/753101505 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f049409bcf0 con 0x7f049409b780 2024-05-30T16:58:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f049c600640 1 -- 172.21.15.59:0/753101505 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f04940d0a70 con 0x7f04940711e0 2024-05-30T16:58:12.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f049a600640 1 --2- 172.21.15.59:0/753101505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04940711e0 0x7f049406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:12.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f0499c00640 1 -- 172.21.15.59:0/753101505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04940711e0 msgr2=0x7f049406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:12.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f0499c00640 1 --2- 172.21.15.59:0/753101505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04940711e0 0x7f049406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:12.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.633+0000 7f0499c00640 1 -- 172.21.15.59:0/753101505 >> v2:172.21.15.107:3300/0 conn(0x7f049409b780 msgr2=0x7f049409af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:12.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.637+0000 7f0499c00640 1 --2- 172.21.15.59:0/753101505 >> v2:172.21.15.107:3300/0 conn(0x7f049409b780 0x7f049409af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:12.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.637+0000 7f0499c00640 1 -- 172.21.15.59:0/753101505 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04940d0d50 con 0x7f0494160d90 2024-05-30T16:58:12.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.641+0000 7f0499c00640 1 --2- 172.21.15.59:0/753101505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494160d90 0x7f049409aa40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0494073b70 tx=0x7f0488020550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edaa5a00df504d36 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:12.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.645+0000 7f0493e00640 1 -- 172.21.15.59:0/753101505 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04880b4070 con 0x7f0494160d90 2024-05-30T16:58:12.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.645+0000 7f0493e00640 1 -- 172.21.15.59:0/753101505 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04880af600 con 0x7f0494160d90 2024-05-30T16:58:12.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.645+0000 7f0493e00640 1 -- 172.21.15.59:0/753101505 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04880af9d0 con 0x7f0494160d90 2024-05-30T16:58:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.645+0000 7f049c600640 1 -- 172.21.15.59:0/753101505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494160d90 msgr2=0x7f049409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.645+0000 7f049c600640 1 --2- 172.21.15.59:0/753101505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494160d90 0x7f049409aa40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0494073b70 tx=0x7f0488020550 comp rx=0 tx=0).stop 2024-05-30T16:58:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.645+0000 7f049c600640 1 -- 172.21.15.59:0/753101505 shutdown_connections 2024-05-30T16:58:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.645+0000 7f049c600640 1 --2- 172.21.15.59:0/753101505 >> v2:172.21.15.107:3300/0 conn(0x7f049409b780 0x7f049409af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.645+0000 7f049c600640 1 --2- 172.21.15.59:0/753101505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04940711e0 0x7f049406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.645+0000 7f049c600640 1 --2- 172.21.15.59:0/753101505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494160d90 0x7f049409aa40 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.645+0000 7f049c600640 1 -- 172.21.15.59:0/753101505 >> 172.21.15.59:0/753101505 conn(0x7f04940b3f80 msgr2=0x7f04940b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.645+0000 7f049c600640 1 -- 172.21.15.59:0/753101505 shutdown_connections 2024-05-30T16:58:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.645+0000 7f049c600640 1 -- 172.21.15.59:0/753101505 wait complete. 2024-05-30T16:58:12.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049c600640 1 Processor -- start 2024-05-30T16:58:12.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049c600640 1 -- start start 2024-05-30T16:58:12.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04940711e0 0x7f04941527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049c600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f049409b780 0x7f049415eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049c600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494160d90 0x7f04940b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049c600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f04941612f0 con 0x7f0494160d90 2024-05-30T16:58:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049c600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0494161170 con 0x7f049409b780 2024-05-30T16:58:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f04940cdd20 con 0x7f04940711e0 2024-05-30T16:58:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494160d90 0x7f04940b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494160d90 0x7f04940b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59072/0 (socket says 172.21.15.59:59072) 2024-05-30T16:58:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049a600640 1 -- 172.21.15.59:0/1712526932 learned_addr learned my addr 172.21.15.59:0/1712526932 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f0499200640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f049409b780 0x7f049415eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049a600640 1 -- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04940711e0 msgr2=0x7f04941527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049a600640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04940711e0 0x7f04941527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049a600640 1 -- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f049409b780 msgr2=0x7f049415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049a600640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f049409b780 0x7f049415eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049a600640 1 -- 172.21.15.59:0/1712526932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049415fa90 con 0x7f0494160d90 2024-05-30T16:58:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.649+0000 7f049a600640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494160d90 0x7f04940b5ac0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f048c007e40 tx=0x7f048c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.653+0000 7f0491600640 1 -- 172.21.15.59:0/1712526932 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c014620 con 0x7f0494160d90 2024-05-30T16:58:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.653+0000 7f0491600640 1 -- 172.21.15.59:0/1712526932 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c019070 con 0x7f0494160d90 2024-05-30T16:58:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.653+0000 7f049c600640 1 -- 172.21.15.59:0/1712526932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049415fd70 con 0x7f0494160d90 2024-05-30T16:58:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.653+0000 7f0491600640 1 -- 172.21.15.59:0/1712526932 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c014a20 con 0x7f0494160d90 2024-05-30T16:58:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.653+0000 7f049c600640 1 -- 172.21.15.59:0/1712526932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04940b52c0 con 0x7f0494160d90 2024-05-30T16:58:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.653+0000 7f049c600640 1 -- 172.21.15.59:0/1712526932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0494068a90 con 0x7f0494160d90 2024-05-30T16:58:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.657+0000 7f0491600640 1 -- 172.21.15.59:0/1712526932 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 89568+0+0 (secure 0 0 0) 0x7f048c014bc0 con 0x7f0494160d90 2024-05-30T16:58:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.657+0000 7f0491600640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0474069540 0x7f047406ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.657+0000 7f0491600640 1 -- 172.21.15.59:0/1712526932 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f048c087000 con 0x7f0494160d90 2024-05-30T16:58:12.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.661+0000 7f0499c00640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0474069540 0x7f047406ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:12.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.661+0000 7f0491600640 1 -- 172.21.15.59:0/1712526932 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f048c058d00 con 0x7f0494160d90 2024-05-30T16:58:12.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.673+0000 7f0499c00640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0474069540 0x7f047406ba00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f04880b1000 tx=0x7f0488008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:12.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:12.997+0000 7f049c600640 1 -- 172.21.15.59:0/1712526932 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone69889", "target": ["mon-mgr", ""]}) -- 0x7f0494074c50 con 0x7f0474069540 2024-05-30T16:58:13.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.917+0000 7f0491600640 1 -- 172.21.15.59:0/1712526932 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0494074c50 con 0x7f0474069540 2024-05-30T16:58:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.921+0000 7f049c600640 1 -- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0474069540 msgr2=0x7f047406ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.921+0000 7f049c600640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0474069540 0x7f047406ba00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f04880b1000 tx=0x7f0488008040 comp rx=0 tx=0).stop 2024-05-30T16:58:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.921+0000 7f049c600640 1 -- 172.21.15.59:0/1712526932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494160d90 msgr2=0x7f04940b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.921+0000 7f049c600640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494160d90 0x7f04940b5ac0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f048c007e40 tx=0x7f048c00e4b0 comp rx=0 tx=0).stop 2024-05-30T16:58:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.921+0000 7f049c600640 1 -- 172.21.15.59:0/1712526932 shutdown_connections 2024-05-30T16:58:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.921+0000 7f049c600640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0474069540 0x7f047406ba00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.921+0000 7f049c600640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494160d90 0x7f04940b5ac0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.921+0000 7f049c600640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f049409b780 0x7f049415eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.921+0000 7f049c600640 1 --2- 172.21.15.59:0/1712526932 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04940711e0 0x7f04941527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.921+0000 7f049c600640 1 -- 172.21.15.59:0/1712526932 >> 172.21.15.59:0/1712526932 conn(0x7f04940b3f80 msgr2=0x7f04940ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.921+0000 7f049c600640 1 -- 172.21.15.59:0/1712526932 shutdown_connections 2024-05-30T16:58:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:13.921+0000 7f049c600640 1 -- 172.21.15.59:0/1712526932 wait complete. 2024-05-30T16:58:13.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone698810 2024-05-30T16:58:14.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.177+0000 7fd058800640 1 Processor -- start 2024-05-30T16:58:14.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.177+0000 7fd058800640 1 -- start start 2024-05-30T16:58:14.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.177+0000 7fd058800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0501569e0 0x7fd05015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:14.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.177+0000 7fd058800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd0500ad2b0 0x7fd0500cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:14.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd058800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0500d0660 0x7fd0500d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:14.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd058800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd0500ad770 con 0x7fd0500d0660 2024-05-30T16:58:14.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd058800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd05015cb40 con 0x7fd0500ad2b0 2024-05-30T16:58:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd058800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd05015ce20 con 0x7fd0501569e0 2024-05-30T16:58:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd056800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0500d0660 0x7fd0500d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd056800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0500d0660 0x7fd0500d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59074/0 (socket says 172.21.15.59:59074) 2024-05-30T16:58:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd056800640 1 -- 172.21.15.59:0/598081176 learned_addr learned my addr 172.21.15.59:0/598081176 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd055400640 1 --2- 172.21.15.59:0/598081176 >> v2:172.21.15.107:3300/0 conn(0x7fd0500ad2b0 0x7fd0500cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd055e00640 1 --2- 172.21.15.59:0/598081176 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0501569e0 0x7fd05015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd056800640 1 -- 172.21.15.59:0/598081176 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0501569e0 msgr2=0x7fd05015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd056800640 1 --2- 172.21.15.59:0/598081176 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0501569e0 0x7fd05015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd056800640 1 -- 172.21.15.59:0/598081176 >> v2:172.21.15.107:3300/0 conn(0x7fd0500ad2b0 msgr2=0x7fd0500cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd056800640 1 --2- 172.21.15.59:0/598081176 >> v2:172.21.15.107:3300/0 conn(0x7fd0500ad2b0 0x7fd0500cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.181+0000 7fd056800640 1 -- 172.21.15.59:0/598081176 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05015d100 con 0x7fd0500d0660 2024-05-30T16:58:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.185+0000 7fd056800640 1 --2- 172.21.15.59:0/598081176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0500d0660 0x7fd0500d0af0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd05006c970 tx=0x7fd04c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563e834a6b427219 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.185+0000 7fd054a00640 1 -- 172.21.15.59:0/598081176 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0a56f0 con 0x7fd0500d0660 2024-05-30T16:58:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.185+0000 7fd054a00640 1 -- 172.21.15.59:0/598081176 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c0a5890 con 0x7fd0500d0660 2024-05-30T16:58:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.185+0000 7fd054a00640 1 -- 172.21.15.59:0/598081176 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0a5c60 con 0x7fd0500d0660 2024-05-30T16:58:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.185+0000 7fd058800640 1 -- 172.21.15.59:0/598081176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0500d0660 msgr2=0x7fd0500d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.185+0000 7fd058800640 1 --2- 172.21.15.59:0/598081176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0500d0660 0x7fd0500d0af0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd05006c970 tx=0x7fd04c01c960 comp rx=0 tx=0).stop 2024-05-30T16:58:14.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.185+0000 7fd058800640 1 -- 172.21.15.59:0/598081176 shutdown_connections 2024-05-30T16:58:14.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.185+0000 7fd058800640 1 --2- 172.21.15.59:0/598081176 >> v2:172.21.15.107:3300/0 conn(0x7fd0500ad2b0 0x7fd0500cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:14.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.185+0000 7fd058800640 1 --2- 172.21.15.59:0/598081176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0500d0660 0x7fd0500d0af0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:14.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.185+0000 7fd058800640 1 --2- 172.21.15.59:0/598081176 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0501569e0 0x7fd05015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:14.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.185+0000 7fd058800640 1 -- 172.21.15.59:0/598081176 >> 172.21.15.59:0/598081176 conn(0x7fd05006bdb0 msgr2=0x7fd05006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.189+0000 7fd058800640 1 -- 172.21.15.59:0/598081176 shutdown_connections 2024-05-30T16:58:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.189+0000 7fd058800640 1 -- 172.21.15.59:0/598081176 wait complete. 2024-05-30T16:58:14.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.189+0000 7fd058800640 1 Processor -- start 2024-05-30T16:58:14.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.193+0000 7fd058800640 1 -- start start 2024-05-30T16:58:14.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.193+0000 7fd058800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0500ad2b0 0x7fd050147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:14.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.193+0000 7fd058800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0500d0660 0x7fd050099650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:14.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.193+0000 7fd058800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0501569e0 0x7fd050148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:14.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.193+0000 7fd058800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd0500b3c60 con 0x7fd0501569e0 2024-05-30T16:58:14.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.193+0000 7fd058800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd0500b3ae0 con 0x7fd0500ad2b0 2024-05-30T16:58:14.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.193+0000 7fd058800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd0500b3de0 con 0x7fd0500d0660 2024-05-30T16:58:14.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.193+0000 7fd055400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0500d0660 0x7fd050099650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:14.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.193+0000 7fd055400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0500d0660 0x7fd050099650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:50076/0 (socket says 172.21.15.59:50076) 2024-05-30T16:58:14.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.193+0000 7fd055400640 1 -- 172.21.15.59:0/336365611 learned_addr learned my addr 172.21.15.59:0/336365611 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:14.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.197+0000 7fd056800640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0501569e0 0x7fd050148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:14.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.197+0000 7fd055e00640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0500ad2b0 0x7fd050147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:14.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.197+0000 7fd056800640 1 -- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0500d0660 msgr2=0x7fd050099650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:14.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.197+0000 7fd056800640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0500d0660 0x7fd050099650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:14.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.197+0000 7fd056800640 1 -- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0500ad2b0 msgr2=0x7fd050147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:14.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.197+0000 7fd056800640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0500ad2b0 0x7fd050147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:14.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.197+0000 7fd056800640 1 -- 172.21.15.59:0/336365611 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05006da70 con 0x7fd0501569e0 2024-05-30T16:58:14.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.197+0000 7fd056800640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0501569e0 0x7fd050148d70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0ab000 tx=0x7fd04c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:14.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.201+0000 7fd04a000640 1 -- 172.21.15.59:0/336365611 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0bc020 con 0x7fd0501569e0 2024-05-30T16:58:14.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.201+0000 7fd04a000640 1 -- 172.21.15.59:0/336365611 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c0b8670 con 0x7fd0501569e0 2024-05-30T16:58:14.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.201+0000 7fd04a000640 1 -- 172.21.15.59:0/336365611 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c009510 con 0x7fd0501569e0 2024-05-30T16:58:14.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.201+0000 7fd058800640 1 -- 172.21.15.59:0/336365611 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05006dd10 con 0x7fd0501569e0 2024-05-30T16:58:14.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.201+0000 7fd058800640 1 -- 172.21.15.59:0/336365611 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05006e2d0 con 0x7fd0501569e0 2024-05-30T16:58:14.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.201+0000 7fd03f400640 1 -- 172.21.15.59:0/336365611 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd050068a90 con 0x7fd0501569e0 2024-05-30T16:58:14.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.209+0000 7fd04a000640 1 -- 172.21.15.59:0/336365611 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 89568+0+0 (secure 0 0 0) 0x7fd04c0bf020 con 0x7fd0501569e0 2024-05-30T16:58:14.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.209+0000 7fd04a000640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd034069540 0x7fd03406ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:14.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.209+0000 7fd04a000640 1 -- 172.21.15.59:0/336365611 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fd04c1209f0 con 0x7fd0501569e0 2024-05-30T16:58:14.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.213+0000 7fd04a000640 1 -- 172.21.15.59:0/336365611 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd04c0c6030 con 0x7fd0501569e0 2024-05-30T16:58:14.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.225+0000 7fd055e00640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd034069540 0x7fd03406ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:14.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.253+0000 7fd055e00640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd034069540 0x7fd03406ba00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd050147ac0 tx=0x7fd044009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:14.545+0000 7fd03f400640 1 -- 172.21.15.59:0/336365611 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone698810", "target": ["mon-mgr", ""]}) -- 0x7fd0501527b0 con 0x7fd034069540 2024-05-30T16:58:15.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.397+0000 7fd04a000640 1 -- 172.21.15.59:0/336365611 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7fd04c120c40 con 0x7fd0501569e0 2024-05-30T16:58:15.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.793+0000 7fd04a000640 1 -- 172.21.15.59:0/336365611 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd0501527b0 con 0x7fd034069540 2024-05-30T16:58:15.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.797+0000 7fd03f400640 1 -- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd034069540 msgr2=0x7fd03406ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:15.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.797+0000 7fd03f400640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd034069540 0x7fd03406ba00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd050147ac0 tx=0x7fd044009190 comp rx=0 tx=0).stop 2024-05-30T16:58:15.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.797+0000 7fd03f400640 1 -- 172.21.15.59:0/336365611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0501569e0 msgr2=0x7fd050148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:15.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.797+0000 7fd03f400640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0501569e0 0x7fd050148d70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0ab000 tx=0x7fd04c019700 comp rx=0 tx=0).stop 2024-05-30T16:58:15.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.797+0000 7fd03f400640 1 -- 172.21.15.59:0/336365611 shutdown_connections 2024-05-30T16:58:15.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.797+0000 7fd03f400640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd034069540 0x7fd03406ba00 secure :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd050147ac0 tx=0x7fd044009190 comp rx=0 tx=0).stop 2024-05-30T16:58:15.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.797+0000 7fd03f400640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0501569e0 0x7fd050148d70 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:15.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.797+0000 7fd03f400640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0500d0660 0x7fd050099650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:15.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.797+0000 7fd03f400640 1 --2- 172.21.15.59:0/336365611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0500ad2b0 0x7fd050147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:15.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.797+0000 7fd03f400640 1 -- 172.21.15.59:0/336365611 >> 172.21.15.59:0/336365611 conn(0x7fd05006bdb0 msgr2=0x7fd0501559f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:15.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.797+0000 7fd03f400640 1 -- 172.21.15.59:0/336365611 shutdown_connections 2024-05-30T16:58:15.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:15.797+0000 7fd03f400640 1 -- 172.21.15.59:0/336365611 wait complete. 2024-05-30T16:58:15.824 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone698811 2024-05-30T16:58:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.037+0000 7f8d4b200640 1 Processor -- start 2024-05-30T16:58:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.037+0000 7f8d4b200640 1 -- start start 2024-05-30T16:58:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.037+0000 7f8d4b200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d441569e0 0x7f8d4415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.037+0000 7f8d4b200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d440ad2b0 0x7f8d440cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.037+0000 7f8d4b200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d440ad770 con 0x7f8d440d0660 2024-05-30T16:58:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.037+0000 7f8d4b200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f8d4415cb40 con 0x7f8d440ad2b0 2024-05-30T16:58:16.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.037+0000 7f8d4b200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8d4415ce20 con 0x7f8d441569e0 2024-05-30T16:58:16.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.037+0000 7f8d3be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d440ad2b0 0x7f8d440cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:16.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.037+0000 7f8d49200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8d440d0660 0x7f8d440b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34378/0 (socket says 172.21.15.59:34378) 2024-05-30T16:58:16.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.037+0000 7f8d49200640 1 -- 172.21.15.59:0/2037674001 learned_addr learned my addr 172.21.15.59:0/2037674001 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:58:16.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.041+0000 7f8d3be00640 1 -- 172.21.15.59:0/2037674001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d441569e0 msgr2=0x7f8d4415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.041+0000 7f8d3be00640 1 --2- 172.21.15.59:0/2037674001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d441569e0 0x7f8d4415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.041+0000 7f8d3be00640 1 -- 172.21.15.59:0/2037674001 >> v1:172.21.15.59:6789/0 conn(0x7f8d440d0660 legacy=0x7f8d440b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.041+0000 7f8d43400640 1 -- 172.21.15.59:0/2037674001 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812868544 0 0) 0x7f8d440ad770 con 0x7f8d440d0660 2024-05-30T16:58:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.041+0000 7f8d3be00640 1 -- 172.21.15.59:0/2037674001 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4415d100 con 0x7f8d440ad2b0 2024-05-30T16:58:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.045+0000 7f8d3be00640 1 --2- 172.21.15.59:0/2037674001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d440ad2b0 0x7f8d440cf9f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0097c0 tx=0x7f8d2c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b6cc5293690209 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.045+0000 7f8d43400640 1 -- 172.21.15.59:0/2037674001 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c0b0070 con 0x7f8d440ad2b0 2024-05-30T16:58:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.045+0000 7f8d43400640 1 -- 172.21.15.59:0/2037674001 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2c0ab600 con 0x7f8d440ad2b0 2024-05-30T16:58:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.045+0000 7f8d43400640 1 -- 172.21.15.59:0/2037674001 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c0ab9d0 con 0x7f8d440ad2b0 2024-05-30T16:58:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.045+0000 7f8d4b200640 1 -- 172.21.15.59:0/2037674001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d440ad2b0 msgr2=0x7f8d440cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.045+0000 7f8d4b200640 1 --2- 172.21.15.59:0/2037674001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d440ad2b0 0x7f8d440cf9f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0097c0 tx=0x7f8d2c01c380 comp rx=0 tx=0).stop 2024-05-30T16:58:16.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.045+0000 7f8d4b200640 1 -- 172.21.15.59:0/2037674001 shutdown_connections 2024-05-30T16:58:16.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.045+0000 7f8d4b200640 1 --2- 172.21.15.59:0/2037674001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d440ad2b0 0x7f8d440cf9f0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:16.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.045+0000 7f8d4b200640 1 --2- 172.21.15.59:0/2037674001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d441569e0 0x7f8d4415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:16.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.045+0000 7f8d4b200640 1 -- 172.21.15.59:0/2037674001 >> 172.21.15.59:0/2037674001 conn(0x7f8d4406bdb0 msgr2=0x7f8d4406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.045+0000 7f8d4b200640 1 -- 172.21.15.59:0/2037674001 shutdown_connections 2024-05-30T16:58:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.045+0000 7f8d4b200640 1 -- 172.21.15.59:0/2037674001 wait complete. 2024-05-30T16:58:16.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d4b200640 1 Processor -- start 2024-05-30T16:58:16.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d4b200640 1 -- start start 2024-05-30T16:58:16.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d4b200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d440ad2b0 0x7f8d4414b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:16.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d4b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d440d0660 0x7f8d4406f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:16.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d4b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d441569e0 0x7f8d441ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:16.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d4b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440d00b0 con 0x7f8d441569e0 2024-05-30T16:58:16.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d4b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440cff30 con 0x7f8d440d0660 2024-05-30T16:58:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d4b200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8d441691b0 con 0x7f8d440ad2b0 2024-05-30T16:58:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d49200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d441569e0 0x7f8d441ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d49200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d441569e0 0x7f8d441ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59108/0 (socket says 172.21.15.59:59108) 2024-05-30T16:58:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d49200640 1 -- 172.21.15.59:0/1117583840 learned_addr learned my addr 172.21.15.59:0/1117583840 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d43e00640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d440ad2b0 0x7f8d4414b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d49200640 1 -- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d440ad2b0 msgr2=0x7f8d4414b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d49200640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d440ad2b0 0x7f8d4414b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d49200640 1 -- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d440d0660 msgr2=0x7f8d4406f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d49200640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d440d0660 0x7f8d4406f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d49200640 1 -- 172.21.15.59:0/1117583840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d44166bf0 con 0x7f8d441569e0 2024-05-30T16:58:16.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d49200640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d441569e0 0x7f8d441ff670 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00c7a0 tx=0x7f8d3c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:16.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d40c00640 1 -- 172.21.15.59:0/1117583840 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c018070 con 0x7f8d441569e0 2024-05-30T16:58:16.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d40c00640 1 -- 172.21.15.59:0/1117583840 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d3c00a640 con 0x7f8d441569e0 2024-05-30T16:58:16.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d40c00640 1 -- 172.21.15.59:0/1117583840 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c00aab0 con 0x7f8d441569e0 2024-05-30T16:58:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.049+0000 7f8d4b200640 1 -- 172.21.15.59:0/1117583840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4406e5b0 con 0x7f8d441569e0 2024-05-30T16:58:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.053+0000 7f8d4b200640 1 -- 172.21.15.59:0/1117583840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d4406e850 con 0x7f8d441569e0 2024-05-30T16:58:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.053+0000 7f8d4b200640 1 -- 172.21.15.59:0/1117583840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d44068a90 con 0x7f8d441569e0 2024-05-30T16:58:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.053+0000 7f8d40c00640 1 -- 172.21.15.59:0/1117583840 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f8d3c00ac50 con 0x7f8d441569e0 2024-05-30T16:58:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.053+0000 7f8d40c00640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8d20069460 0x7f8d2006b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:16.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.053+0000 7f8d40c00640 1 -- 172.21.15.59:0/1117583840 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f8d3c084ba0 con 0x7f8d441569e0 2024-05-30T16:58:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.061+0000 7f8d40c00640 1 -- 172.21.15.59:0/1117583840 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8d3c056bb0 con 0x7f8d441569e0 2024-05-30T16:58:16.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.061+0000 7f8d43e00640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8d20069460 0x7f8d2006b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.081+0000 7f8d43e00640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8d20069460 0x7f8d2006b920 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8d34006fd0 tx=0x7f8d34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:16.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:16.381+0000 7f8d4b200640 1 -- 172.21.15.59:0/1117583840 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone698811", "target": ["mon-mgr", ""]}) -- 0x7f8d4415c690 con 0x7f8d20069460 2024-05-30T16:58:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.369+0000 7f8d40c00640 1 -- 172.21.15.59:0/1117583840 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8d4415c690 con 0x7f8d20069460 2024-05-30T16:58:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.373+0000 7f8d4b200640 1 -- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8d20069460 msgr2=0x7f8d2006b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.373+0000 7f8d4b200640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8d20069460 0x7f8d2006b920 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8d34006fd0 tx=0x7f8d34008040 comp rx=0 tx=0).stop 2024-05-30T16:58:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.373+0000 7f8d4b200640 1 -- 172.21.15.59:0/1117583840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d441569e0 msgr2=0x7f8d441ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.373+0000 7f8d4b200640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d441569e0 0x7f8d441ff670 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00c7a0 tx=0x7f8d3c00cc60 comp rx=0 tx=0).stop 2024-05-30T16:58:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.373+0000 7f8d4b200640 1 -- 172.21.15.59:0/1117583840 shutdown_connections 2024-05-30T16:58:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.373+0000 7f8d4b200640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8d20069460 0x7f8d2006b920 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.373+0000 7f8d4b200640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d441569e0 0x7f8d441ff670 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.373+0000 7f8d4b200640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d440d0660 0x7f8d4406f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.373+0000 7f8d4b200640 1 --2- 172.21.15.59:0/1117583840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d440ad2b0 0x7f8d4414b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.373+0000 7f8d4b200640 1 -- 172.21.15.59:0/1117583840 >> 172.21.15.59:0/1117583840 conn(0x7f8d4406bdb0 msgr2=0x7f8d44155060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.373+0000 7f8d4b200640 1 -- 172.21.15.59:0/1117583840 shutdown_connections 2024-05-30T16:58:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.373+0000 7f8d4b200640 1 -- 172.21.15.59:0/1117583840 wait complete. 2024-05-30T16:58:17.417 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone698812 2024-05-30T16:58:17.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.633+0000 7f9cf3e00640 1 Processor -- start 2024-05-30T16:58:17.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.633+0000 7f9cf3e00640 1 -- start start 2024-05-30T16:58:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cf3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9cec159100 0x7f9cec06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cf3e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9cec15efd0 0x7f9cec15f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:17.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cf3e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cec162110 con 0x7f9cec15c010 2024-05-30T16:58:17.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cf3e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9cec0b52d0 con 0x7f9cec159100 2024-05-30T16:58:17.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cf3e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9cec0b4a30 con 0x7f9cec15efd0 2024-05-30T16:58:17.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cf1400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9cec159100 0x7f9cec06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:17.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cf1400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9cec159100 0x7f9cec06e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59116/0 (socket says 172.21.15.59:59116) 2024-05-30T16:58:17.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cf1400640 1 -- 172.21.15.59:0/2498225709 learned_addr learned my addr 172.21.15.59:0/2498225709 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cebe00640 1 -- 172.21.15.59:0/2498225709 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 987986995 0 0) 0x7f9cec162110 con 0x7f9cec15c010 2024-05-30T16:58:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cebe00640 1 -- 172.21.15.59:0/2498225709 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cd4003530 con 0x7f9cec15c010 2024-05-30T16:58:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cf1400640 1 -- 172.21.15.59:0/2498225709 >> v2:172.21.15.107:3300/0 conn(0x7f9cec15efd0 msgr2=0x7f9cec15f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cf1400640 1 --2- 172.21.15.59:0/2498225709 >> v2:172.21.15.107:3300/0 conn(0x7f9cec15efd0 0x7f9cec15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cf1400640 1 -- 172.21.15.59:0/2498225709 >> v1:172.21.15.59:6789/0 conn(0x7f9cec15c010 legacy=0x7f9cec0d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.637+0000 7f9cf1400640 1 -- 172.21.15.59:0/2498225709 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec0b4d10 con 0x7f9cec159100 2024-05-30T16:58:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.641+0000 7f9cf1400640 1 --2- 172.21.15.59:0/2498225709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cec159100 0x7f9cec06e590 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0b3060 tx=0x7f9ce001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f520602cec96a195 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.641+0000 7f9cebe00640 1 -- 172.21.15.59:0/2498225709 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00b1070 con 0x7f9cec159100 2024-05-30T16:58:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.641+0000 7f9cebe00640 1 -- 172.21.15.59:0/2498225709 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce00ac630 con 0x7f9cec159100 2024-05-30T16:58:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.641+0000 7f9cebe00640 1 -- 172.21.15.59:0/2498225709 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00a8050 con 0x7f9cec159100 2024-05-30T16:58:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.641+0000 7f9cf3e00640 1 -- 172.21.15.59:0/2498225709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cec159100 msgr2=0x7f9cec06e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.641+0000 7f9cf3e00640 1 --2- 172.21.15.59:0/2498225709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cec159100 0x7f9cec06e590 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0b3060 tx=0x7f9ce001c3d0 comp rx=0 tx=0).stop 2024-05-30T16:58:17.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.641+0000 7f9cf3e00640 1 -- 172.21.15.59:0/2498225709 shutdown_connections 2024-05-30T16:58:17.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.641+0000 7f9cf3e00640 1 --2- 172.21.15.59:0/2498225709 >> v2:172.21.15.107:3300/0 conn(0x7f9cec15efd0 0x7f9cec15f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:17.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.641+0000 7f9cf3e00640 1 --2- 172.21.15.59:0/2498225709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cec159100 0x7f9cec06e590 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:17.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.641+0000 7f9cf3e00640 1 -- 172.21.15.59:0/2498225709 >> 172.21.15.59:0/2498225709 conn(0x7f9cec06bdb0 msgr2=0x7f9cec06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:17.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.641+0000 7f9cf3e00640 1 -- 172.21.15.59:0/2498225709 shutdown_connections 2024-05-30T16:58:17.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.641+0000 7f9cf3e00640 1 -- 172.21.15.59:0/2498225709 wait complete. 2024-05-30T16:58:17.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf3e00640 1 Processor -- start 2024-05-30T16:58:17.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf3e00640 1 -- start start 2024-05-30T16:58:17.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cec159100 0x7f9cec0af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:17.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cec15c010 0x7f9cec0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:17.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cec15efd0 0x7f9cec156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:17.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf3e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec0d1020 con 0x7f9cec15efd0 2024-05-30T16:58:17.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf3e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec0d0ea0 con 0x7f9cec15c010 2024-05-30T16:58:17.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9cec15c3f0 con 0x7f9cec159100 2024-05-30T16:58:17.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cec15efd0 0x7f9cec156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:17.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cec15efd0 0x7f9cec156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59130/0 (socket says 172.21.15.59:59130) 2024-05-30T16:58:17.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf1e00640 1 -- 172.21.15.59:0/448409839 learned_addr learned my addr 172.21.15.59:0/448409839 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:17.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf0a00640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cec15c010 0x7f9cec0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:17.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf1e00640 1 -- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cec159100 msgr2=0x7f9cec0af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:17.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf1e00640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cec159100 0x7f9cec0af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:17.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf1e00640 1 -- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cec15c010 msgr2=0x7f9cec0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:17.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf1e00640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cec15c010 0x7f9cec0cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:17.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf1e00640 1 -- 172.21.15.59:0/448409839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec157290 con 0x7f9cec15efd0 2024-05-30T16:58:17.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9cf1e00640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cec15efd0 0x7f9cec156560 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c780 tx=0x7f9ce400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:17.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.645+0000 7f9ce9600640 1 -- 172.21.15.59:0/448409839 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4003b80 con 0x7f9cec15efd0 2024-05-30T16:58:17.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.649+0000 7f9ce9600640 1 -- 172.21.15.59:0/448409839 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce4003d40 con 0x7f9cec15efd0 2024-05-30T16:58:17.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.649+0000 7f9ce9600640 1 -- 172.21.15.59:0/448409839 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce400aa90 con 0x7f9cec15efd0 2024-05-30T16:58:17.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.649+0000 7f9cf3e00640 1 -- 172.21.15.59:0/448409839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cec157570 con 0x7f9cec15efd0 2024-05-30T16:58:17.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.649+0000 7f9cf3e00640 1 -- 172.21.15.59:0/448409839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cec157e10 con 0x7f9cec15efd0 2024-05-30T16:58:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.649+0000 7f9ce9600640 1 -- 172.21.15.59:0/448409839 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f9ce400ac30 con 0x7f9cec15efd0 2024-05-30T16:58:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.649+0000 7f9cf3e00640 1 -- 172.21.15.59:0/448409839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cec157740 con 0x7f9cec15efd0 2024-05-30T16:58:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.649+0000 7f9ce9600640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9ccc069460 0x7f9ccc06b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.649+0000 7f9ce9600640 1 -- 172.21.15.59:0/448409839 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f9ce4085080 con 0x7f9cec15efd0 2024-05-30T16:58:17.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.653+0000 7f9cf1400640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9ccc069460 0x7f9ccc06b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.661+0000 7f9ce9600640 1 -- 172.21.15.59:0/448409839 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9ce4090070 con 0x7f9cec15efd0 2024-05-30T16:58:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.661+0000 7f9cf1400640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9ccc069460 0x7f9ccc06b920 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00ae000 tx=0x7f9ce0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:17.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:17.985+0000 7f9cf3e00640 1 -- 172.21.15.59:0/448409839 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone698812", "target": ["mon-mgr", ""]}) -- 0x7f9cec068a90 con 0x7f9ccc069460 2024-05-30T16:58:19.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.101+0000 7f9ce9600640 1 -- 172.21.15.59:0/448409839 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9cec068a90 con 0x7f9ccc069460 2024-05-30T16:58:19.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.105+0000 7f9cf3e00640 1 -- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9ccc069460 msgr2=0x7f9ccc06b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.105+0000 7f9cf3e00640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9ccc069460 0x7f9ccc06b920 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00ae000 tx=0x7f9ce0008040 comp rx=0 tx=0).stop 2024-05-30T16:58:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.105+0000 7f9cf3e00640 1 -- 172.21.15.59:0/448409839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cec15efd0 msgr2=0x7f9cec156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.105+0000 7f9cf3e00640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cec15efd0 0x7f9cec156560 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c780 tx=0x7f9ce400cc40 comp rx=0 tx=0).stop 2024-05-30T16:58:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.105+0000 7f9cf3e00640 1 -- 172.21.15.59:0/448409839 shutdown_connections 2024-05-30T16:58:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.105+0000 7f9cf3e00640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9ccc069460 0x7f9ccc06b920 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.105+0000 7f9cf3e00640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cec15efd0 0x7f9cec156560 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.105+0000 7f9cf3e00640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cec15c010 0x7f9cec0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.105+0000 7f9cf3e00640 1 --2- 172.21.15.59:0/448409839 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cec159100 0x7f9cec0af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.105+0000 7f9cf3e00640 1 -- 172.21.15.59:0/448409839 >> 172.21.15.59:0/448409839 conn(0x7f9cec06bdb0 msgr2=0x7f9cec165bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.105+0000 7f9cf3e00640 1 -- 172.21.15.59:0/448409839 shutdown_connections 2024-05-30T16:58:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.105+0000 7f9cf3e00640 1 -- 172.21.15.59:0/448409839 wait complete. 2024-05-30T16:58:19.147 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone698813 2024-05-30T16:58:19.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.361+0000 7f9b8b400640 1 Processor -- start 2024-05-30T16:58:19.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.361+0000 7f9b8b400640 1 -- start start 2024-05-30T16:58:19.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.361+0000 7f9b8b400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9b8406d080 0x7f9b8409b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:19.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.361+0000 7f9b8b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b8406cac0 0x7f9b840d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:19.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.361+0000 7f9b8b400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b8409ba30 con 0x7f9b8406d460 2024-05-30T16:58:19.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.361+0000 7f9b8b400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9b840d0840 con 0x7f9b8406d080 2024-05-30T16:58:19.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.361+0000 7f9b8b400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9b840d0b20 con 0x7f9b8406cac0 2024-05-30T16:58:19.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b88a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9b8406d080 0x7f9b8409b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:19.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b89400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9b8406d460 0x7f9b840b1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:55116/0 (socket says 172.21.15.59:55116) 2024-05-30T16:58:19.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b89400640 1 -- 172.21.15.59:0/3450703510 learned_addr learned my addr 172.21.15.59:0/3450703510 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:58:19.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157214714 0 0) 0x7f9b8409ba30 con 0x7f9b8406d460 2024-05-30T16:58:19.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b6c003530 con 0x7f9b8406d460 2024-05-30T16:58:19.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 805452622 0 0) 0x7f9b6c003530 con 0x7f9b8406d460 2024-05-30T16:58:19.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b8406cac0 msgr2=0x7f9b840d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 --2- 172.21.15.59:0/3450703510 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b8406cac0 0x7f9b840d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 >> v2:172.21.15.107:3300/0 conn(0x7f9b8406d080 msgr2=0x7f9b8409b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 --2- 172.21.15.59:0/3450703510 >> v2:172.21.15.107:3300/0 conn(0x7f9b8406d080 0x7f9b8409b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b840d0e00 con 0x7f9b8406d460 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f9b7c001a00 con 0x7f9b8406d460 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 >> v1:172.21.15.107:6789/0 conn(0x7f9b8406d460 legacy=0x7f9b840b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 --2- 172.21.15.59:0/3450703510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b6c0039c0 0x7f9b6c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 --2- 172.21.15.59:0/3450703510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b6c004810 0x7f9b6c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 --2- 172.21.15.59:0/3450703510 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b8406cac0 0x7f9b6c005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b840d0840 con 0x7f9b6c004810 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9b840d0b20 con 0x7f9b6c0039c0 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9b6c00bc10 con 0x7f9b8406cac0 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83e00640 1 --2- 172.21.15.59:0/3450703510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b6c004810 0x7f9b6c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b88a00640 1 --2- 172.21.15.59:0/3450703510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b6c0039c0 0x7f9b6c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:19.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b89400640 1 --2- 172.21.15.59:0/3450703510 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b8406cac0 0x7f9b6c005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:19.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83e00640 1 -- 172.21.15.59:0/3450703510 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b8406cac0 msgr2=0x7f9b6c005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:19.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83e00640 1 --2- 172.21.15.59:0/3450703510 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b8406cac0 0x7f9b6c005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:19.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83e00640 1 -- 172.21.15.59:0/3450703510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b6c0039c0 msgr2=0x7f9b6c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:19.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83e00640 1 --2- 172.21.15.59:0/3450703510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b6c0039c0 0x7f9b6c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:19.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.365+0000 7f9b83e00640 1 -- 172.21.15.59:0/3450703510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6c003530 con 0x7f9b6c004810 2024-05-30T16:58:19.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.369+0000 7f9b83e00640 1 --2- 172.21.15.59:0/3450703510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b6c004810 0x7f9b6c004c90 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009890 tx=0x7f9b7001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa61805ec4e38b6d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:19.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.369+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b700b0070 con 0x7f9b6c004810 2024-05-30T16:58:19.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.369+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b700ab620 con 0x7f9b6c004810 2024-05-30T16:58:19.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.369+0000 7f9b83400640 1 -- 172.21.15.59:0/3450703510 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70009460 con 0x7f9b6c004810 2024-05-30T16:58:19.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.369+0000 7f9b8b400640 1 -- 172.21.15.59:0/3450703510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b6c004810 msgr2=0x7f9b6c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:19.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.369+0000 7f9b8b400640 1 --2- 172.21.15.59:0/3450703510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b6c004810 0x7f9b6c004c90 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009890 tx=0x7f9b7001c380 comp rx=0 tx=0).stop 2024-05-30T16:58:19.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.369+0000 7f9b89400640 1 -- 172.21.15.59:0/3450703510 reap_dead start 2024-05-30T16:58:19.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.369+0000 7f9b8b400640 1 -- 172.21.15.59:0/3450703510 shutdown_connections 2024-05-30T16:58:19.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.369+0000 7f9b8b400640 1 -- 172.21.15.59:0/3450703510 >> 172.21.15.59:0/3450703510 conn(0x7f9b840b3f90 msgr2=0x7f9b840b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:19.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.369+0000 7f9b8b400640 1 -- 172.21.15.59:0/3450703510 shutdown_connections 2024-05-30T16:58:19.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.369+0000 7f9b8b400640 1 -- 172.21.15.59:0/3450703510 wait complete. 2024-05-30T16:58:19.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.373+0000 7f9b8b400640 1 Processor -- start 2024-05-30T16:58:19.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.373+0000 7f9b8b400640 1 -- start start 2024-05-30T16:58:19.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.373+0000 7f9b8b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b6c004810 0x7f9b8414a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:19.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.373+0000 7f9b8b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b840b1480 0x7f9b840b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:19.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.373+0000 7f9b8b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b840b5d50 0x7f9b840af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:19.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.373+0000 7f9b8b400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8415ed00 con 0x7f9b6c004810 2024-05-30T16:58:19.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.373+0000 7f9b8b400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8415eb80 con 0x7f9b840b1480 2024-05-30T16:58:19.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.373+0000 7f9b8b400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9b8406d870 con 0x7f9b840b5d50 2024-05-30T16:58:19.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.373+0000 7f9b88a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b6c004810 0x7f9b8414a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:19.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.373+0000 7f9b88a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b6c004810 0x7f9b8414a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59140/0 (socket says 172.21.15.59:59140) 2024-05-30T16:58:19.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.373+0000 7f9b88a00640 1 -- 172.21.15.59:0/2970822244 learned_addr learned my addr 172.21.15.59:0/2970822244 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:19.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.377+0000 7f9b88a00640 1 -- 172.21.15.59:0/2970822244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b840b5d50 msgr2=0x7f9b840af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:19.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.377+0000 7f9b88a00640 1 --2- 172.21.15.59:0/2970822244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b840b5d50 0x7f9b840af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:19.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.377+0000 7f9b88a00640 1 -- 172.21.15.59:0/2970822244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b840b1480 msgr2=0x7f9b840b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:19.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.377+0000 7f9b88a00640 1 --2- 172.21.15.59:0/2970822244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b840b1480 0x7f9b840b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:19.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.377+0000 7f9b88a00640 1 -- 172.21.15.59:0/2970822244 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b840b03e0 con 0x7f9b6c004810 2024-05-30T16:58:19.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.377+0000 7f9b88a00640 1 --2- 172.21.15.59:0/2970822244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b6c004810 0x7f9b8414a780 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800f630 tx=0x7f9b7800faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:19.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.377+0000 7f9b80c00640 1 -- 172.21.15.59:0/2970822244 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b78019020 con 0x7f9b6c004810 2024-05-30T16:58:19.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.377+0000 7f9b80c00640 1 -- 172.21.15.59:0/2970822244 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b78014870 con 0x7f9b6c004810 2024-05-30T16:58:19.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.377+0000 7f9b8b400640 1 -- 172.21.15.59:0/2970822244 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b840b06c0 con 0x7f9b6c004810 2024-05-30T16:58:19.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.377+0000 7f9b80c00640 1 -- 172.21.15.59:0/2970822244 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b78014c60 con 0x7f9b6c004810 2024-05-30T16:58:19.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.377+0000 7f9b8b400640 1 -- 172.21.15.59:0/2970822244 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b840b0c80 con 0x7f9b6c004810 2024-05-30T16:58:19.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.377+0000 7f9b8b400640 1 -- 172.21.15.59:0/2970822244 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b84068a90 con 0x7f9b6c004810 2024-05-30T16:58:19.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.381+0000 7f9b80c00640 1 -- 172.21.15.59:0/2970822244 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f9b7801c020 con 0x7f9b6c004810 2024-05-30T16:58:19.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.381+0000 7f9b80c00640 1 --2- 172.21.15.59:0/2970822244 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9b64069490 0x7f9b6406b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:19.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.381+0000 7f9b80c00640 1 -- 172.21.15.59:0/2970822244 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f9b78085dc0 con 0x7f9b6c004810 2024-05-30T16:58:19.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.385+0000 7f9b80c00640 1 -- 172.21.15.59:0/2970822244 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b78023020 con 0x7f9b6c004810 2024-05-30T16:58:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.393+0000 7f9b83e00640 1 --2- 172.21.15.59:0/2970822244 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9b64069490 0x7f9b6406b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:19.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.413+0000 7f9b83e00640 1 --2- 172.21.15.59:0/2970822244 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9b64069490 0x7f9b6406b950 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9b700ad000 tx=0x7f9b700047e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:19.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:19.701+0000 7f9b8b400640 1 -- 172.21.15.59:0/2970822244 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone698813", "target": ["mon-mgr", ""]}) -- 0x7f9b840b8420 con 0x7f9b64069490 2024-05-30T16:58:21.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.201+0000 7f9b80c00640 1 -- 172.21.15.59:0/2970822244 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9b840b8420 con 0x7f9b64069490 2024-05-30T16:58:21.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.209+0000 7f9b8b400640 1 -- 172.21.15.59:0/2970822244 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9b64069490 msgr2=0x7f9b6406b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:21.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.209+0000 7f9b8b400640 1 --2- 172.21.15.59:0/2970822244 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9b64069490 0x7f9b6406b950 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9b700ad000 tx=0x7f9b700047e0 comp rx=0 tx=0).stop 2024-05-30T16:58:21.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.209+0000 7f9b8b400640 1 -- 172.21.15.59:0/2970822244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b6c004810 msgr2=0x7f9b8414a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:21.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.209+0000 7f9b8b400640 1 --2- 172.21.15.59:0/2970822244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b6c004810 0x7f9b8414a780 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800f630 tx=0x7f9b7800faf0 comp rx=0 tx=0).stop 2024-05-30T16:58:21.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.209+0000 7f9b8b400640 1 -- 172.21.15.59:0/2970822244 shutdown_connections 2024-05-30T16:58:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.209+0000 7f9b8b400640 1 --2- 172.21.15.59:0/2970822244 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9b64069490 0x7f9b6406b950 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.209+0000 7f9b8b400640 1 --2- 172.21.15.59:0/2970822244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b840b5d50 0x7f9b840af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.209+0000 7f9b8b400640 1 --2- 172.21.15.59:0/2970822244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b840b1480 0x7f9b840b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.209+0000 7f9b8b400640 1 --2- 172.21.15.59:0/2970822244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b6c004810 0x7f9b8414a780 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.209+0000 7f9b8b400640 1 -- 172.21.15.59:0/2970822244 >> 172.21.15.59:0/2970822244 conn(0x7f9b840b3f90 msgr2=0x7f9b840b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.209+0000 7f9b8b400640 1 -- 172.21.15.59:0/2970822244 shutdown_connections 2024-05-30T16:58:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.209+0000 7f9b8b400640 1 -- 172.21.15.59:0/2970822244 wait complete. 2024-05-30T16:58:21.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone698814 2024-05-30T16:58:21.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.477+0000 7f2cd6a00640 1 Processor -- start 2024-05-30T16:58:21.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.477+0000 7f2cd6a00640 1 -- start start 2024-05-30T16:58:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.477+0000 7f2cd6a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2cd01447c0 0x7f2cd00b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.477+0000 7f2cd6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2cd00b4a70 0x7f2cd006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.477+0000 7f2cd6a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cd00b39d0 con 0x7f2cd00726e0 2024-05-30T16:58:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.477+0000 7f2cd6a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f2cd00b3cb0 con 0x7f2cd00b4a70 2024-05-30T16:58:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.477+0000 7f2cd6a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2cd00b3f90 con 0x7f2cd01447c0 2024-05-30T16:58:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.477+0000 7f2ccf400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2cd00b4a70 0x7f2cd006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.477+0000 7f2cd4a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2cd00726e0 0x7f2cd015e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34410/0 (socket says 172.21.15.59:34410) 2024-05-30T16:58:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.477+0000 7f2cd4a00640 1 -- 172.21.15.59:0/1541329180 learned_addr learned my addr 172.21.15.59:0/1541329180 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:58:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.481+0000 7f2ccf400640 1 -- 172.21.15.59:0/1541329180 >> v2:172.21.15.107:3300/0 conn(0x7f2cd01447c0 msgr2=0x7f2cd00b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.481+0000 7f2ccf400640 1 --2- 172.21.15.59:0/1541329180 >> v2:172.21.15.107:3300/0 conn(0x7f2cd01447c0 0x7f2cd00b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.481+0000 7f2ccf400640 1 -- 172.21.15.59:0/1541329180 >> v1:172.21.15.59:6789/0 conn(0x7f2cd00726e0 legacy=0x7f2cd015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.481+0000 7f2ccf400640 1 -- 172.21.15.59:0/1541329180 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd00b4270 con 0x7f2cd00b4a70 2024-05-30T16:58:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.485+0000 7f2ccf400640 1 --2- 172.21.15.59:0/1541329180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd00b4a70 0x7f2cd006f6b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00b6590 tx=0x7f2cbc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b77164e60d90934 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:21.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.493+0000 7f2ccea00640 1 -- 172.21.15.59:0/1541329180 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc0b1070 con 0x7f2cd00b4a70 2024-05-30T16:58:21.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.493+0000 7f2ccea00640 1 -- 172.21.15.59:0/1541329180 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cbc0ac640 con 0x7f2cd00b4a70 2024-05-30T16:58:21.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.493+0000 7f2ccea00640 1 -- 172.21.15.59:0/1541329180 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc0aca10 con 0x7f2cd00b4a70 2024-05-30T16:58:21.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.493+0000 7f2cd6a00640 1 -- 172.21.15.59:0/1541329180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd00b4a70 msgr2=0x7f2cd006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:21.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.493+0000 7f2cd6a00640 1 --2- 172.21.15.59:0/1541329180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd00b4a70 0x7f2cd006f6b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00b6590 tx=0x7f2cbc01c480 comp rx=0 tx=0).stop 2024-05-30T16:58:21.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.493+0000 7f2cd6a00640 1 -- 172.21.15.59:0/1541329180 shutdown_connections 2024-05-30T16:58:21.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.493+0000 7f2cd6a00640 1 --2- 172.21.15.59:0/1541329180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd00b4a70 0x7f2cd006f6b0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:21.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.493+0000 7f2cd6a00640 1 --2- 172.21.15.59:0/1541329180 >> v2:172.21.15.107:3300/0 conn(0x7f2cd01447c0 0x7f2cd00b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:21.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.493+0000 7f2cd6a00640 1 -- 172.21.15.59:0/1541329180 >> 172.21.15.59:0/1541329180 conn(0x7f2cd006bdb0 msgr2=0x7f2cd006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:21.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.493+0000 7f2cd6a00640 1 -- 172.21.15.59:0/1541329180 shutdown_connections 2024-05-30T16:58:21.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.493+0000 7f2cd6a00640 1 -- 172.21.15.59:0/1541329180 wait complete. 2024-05-30T16:58:21.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd6a00640 1 Processor -- start 2024-05-30T16:58:21.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd6a00640 1 -- start start 2024-05-30T16:58:21.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2cd00726e0 0x7f2cd015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:21.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cd00b4a70 0x7f2cd0156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:21.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd01447c0 0x7f2cd0098cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:21.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd6a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd015f250 con 0x7f2cd01447c0 2024-05-30T16:58:21.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd6a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd015f0d0 con 0x7f2cd00b4a70 2024-05-30T16:58:21.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd6a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd015f3d0 con 0x7f2cd00726e0 2024-05-30T16:58:21.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd01447c0 0x7f2cd0098cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:21.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd01447c0 0x7f2cd0098cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59166/0 (socket says 172.21.15.59:59166) 2024-05-30T16:58:21.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd4a00640 1 -- 172.21.15.59:0/3950590762 learned_addr learned my addr 172.21.15.59:0/3950590762 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:21.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2ccfe00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2cd00726e0 0x7f2cd015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:21.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd4a00640 1 -- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2cd00726e0 msgr2=0x7f2cd015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd4a00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2cd00726e0 0x7f2cd015af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd4a00640 1 -- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cd00b4a70 msgr2=0x7f2cd0156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd4a00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cd00b4a70 0x7f2cd0156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd4a00640 1 -- 172.21.15.59:0/3950590762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd0156e00 con 0x7f2cd01447c0 2024-05-30T16:58:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd4a00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd01447c0 0x7f2cd0098cd0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800caa0 tx=0x7f2cc800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cc7e00640 1 -- 172.21.15.59:0/3950590762 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8017070 con 0x7f2cd01447c0 2024-05-30T16:58:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cc7e00640 1 -- 172.21.15.59:0/3950590762 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc800a730 con 0x7f2cd01447c0 2024-05-30T16:58:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cc7e00640 1 -- 172.21.15.59:0/3950590762 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc800ab00 con 0x7f2cd01447c0 2024-05-30T16:58:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd6a00640 1 -- 172.21.15.59:0/3950590762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd0099b40 con 0x7f2cd01447c0 2024-05-30T16:58:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.497+0000 7f2cd6a00640 1 -- 172.21.15.59:0/3950590762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd015b4d0 con 0x7f2cd01447c0 2024-05-30T16:58:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.501+0000 7f2cd6a00640 1 -- 172.21.15.59:0/3950590762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd0068a90 con 0x7f2cd01447c0 2024-05-30T16:58:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.501+0000 7f2cc7e00640 1 -- 172.21.15.59:0/3950590762 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f2cc801a070 con 0x7f2cd01447c0 2024-05-30T16:58:21.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.501+0000 7f2cc7e00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2cb0069460 0x7f2cb006b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:21.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.501+0000 7f2cc7e00640 1 -- 172.21.15.59:0/3950590762 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f2cc80850c0 con 0x7f2cd01447c0 2024-05-30T16:58:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.505+0000 7f2ccfe00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2cb0069460 0x7f2cb006b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:21.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.505+0000 7f2ccfe00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2cb0069460 0x7f2cb006b920 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0006fd0 tx=0x7f2cc0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:21.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.509+0000 7f2cc7e00640 1 -- 172.21.15.59:0/3950590762 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2cc8056df0 con 0x7f2cd01447c0 2024-05-30T16:58:21.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:21.777+0000 7f2cd6a00640 1 -- 172.21.15.59:0/3950590762 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone698814", "target": ["mon-mgr", ""]}) -- 0x7f2cd006ddf0 con 0x7f2cb0069460 2024-05-30T16:58:22.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.741+0000 7f2cc7e00640 1 -- 172.21.15.59:0/3950590762 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2cd006ddf0 con 0x7f2cb0069460 2024-05-30T16:58:22.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.745+0000 7f2cd6a00640 1 -- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2cb0069460 msgr2=0x7f2cb006b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:22.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.745+0000 7f2cd6a00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2cb0069460 0x7f2cb006b920 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0006fd0 tx=0x7f2cc0008040 comp rx=0 tx=0).stop 2024-05-30T16:58:22.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.745+0000 7f2cd6a00640 1 -- 172.21.15.59:0/3950590762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd01447c0 msgr2=0x7f2cd0098cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:22.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.745+0000 7f2cd6a00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd01447c0 0x7f2cd0098cd0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800caa0 tx=0x7f2cc800cf60 comp rx=0 tx=0).stop 2024-05-30T16:58:22.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.745+0000 7f2cd6a00640 1 -- 172.21.15.59:0/3950590762 shutdown_connections 2024-05-30T16:58:22.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.745+0000 7f2cd6a00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2cb0069460 0x7f2cb006b920 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:22.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.745+0000 7f2cd6a00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd01447c0 0x7f2cd0098cd0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:22.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.745+0000 7f2cd6a00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cd00b4a70 0x7f2cd0156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:22.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.745+0000 7f2cd6a00640 1 --2- 172.21.15.59:0/3950590762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2cd00726e0 0x7f2cd015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:22.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.745+0000 7f2cd6a00640 1 -- 172.21.15.59:0/3950590762 >> 172.21.15.59:0/3950590762 conn(0x7f2cd006bdb0 msgr2=0x7f2cd00ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:22.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.745+0000 7f2cd6a00640 1 -- 172.21.15.59:0/3950590762 shutdown_connections 2024-05-30T16:58:22.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:22.745+0000 7f2cd6a00640 1 -- 172.21.15.59:0/3950590762 wait complete. 2024-05-30T16:58:22.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone698815 2024-05-30T16:58:23.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.001+0000 7f23ce400640 1 Processor -- start 2024-05-30T16:58:23.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.001+0000 7f23ce400640 1 -- start start 2024-05-30T16:58:23.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.005+0000 7f23ce400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23c806ebb0 0x7f23c80b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:23.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.005+0000 7f23ce400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f23c806fda0 0x7f23c80aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:23.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.005+0000 7f23ce400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c806f280 con 0x7f23c815e5c0 2024-05-30T16:58:23.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.005+0000 7f23ce400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f23c80aefe0 con 0x7f23c806ebb0 2024-05-30T16:58:23.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.005+0000 7f23ce400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f23c80afe20 con 0x7f23c806fda0 2024-05-30T16:58:23.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.005+0000 7f23c7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23c806ebb0 0x7f23c80b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:23.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.005+0000 7f23c7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23c806ebb0 0x7f23c80b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49404/0 (socket says 172.21.15.59:49404) 2024-05-30T16:58:23.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.005+0000 7f23c7e00640 1 -- 172.21.15.59:0/1712318041 learned_addr learned my addr 172.21.15.59:0/1712318041 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:23.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.005+0000 7f23c7e00640 1 -- 172.21.15.59:0/1712318041 >> v2:172.21.15.107:3300/0 conn(0x7f23c806fda0 msgr2=0x7f23c80aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:23.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.005+0000 7f23c7e00640 1 --2- 172.21.15.59:0/1712318041 >> v2:172.21.15.107:3300/0 conn(0x7f23c806fda0 0x7f23c80aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:23.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.005+0000 7f23c7e00640 1 -- 172.21.15.59:0/1712318041 >> v1:172.21.15.107:6789/0 conn(0x7f23c815e5c0 legacy=0x7f23c806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:23.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.005+0000 7f23c7e00640 1 -- 172.21.15.59:0/1712318041 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c80af210 con 0x7f23c806ebb0 2024-05-30T16:58:23.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.009+0000 7f23c7e00640 1 --2- 172.21.15.59:0/1712318041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c806ebb0 0x7f23c80b02b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f23c80b5e40 tx=0x7f23b001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8720671aa7c617 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:23.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.009+0000 7f23c7400640 1 -- 172.21.15.59:0/1712318041 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b00aa610 con 0x7f23c806ebb0 2024-05-30T16:58:23.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.009+0000 7f23c7400640 1 -- 172.21.15.59:0/1712318041 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b00af070 con 0x7f23c806ebb0 2024-05-30T16:58:23.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.009+0000 7f23c7400640 1 -- 172.21.15.59:0/1712318041 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b00aa9d0 con 0x7f23c806ebb0 2024-05-30T16:58:23.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.009+0000 7f23ce400640 1 -- 172.21.15.59:0/1712318041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c806ebb0 msgr2=0x7f23c80b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:23.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.009+0000 7f23ce400640 1 --2- 172.21.15.59:0/1712318041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c806ebb0 0x7f23c80b02b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f23c80b5e40 tx=0x7f23b001c4b0 comp rx=0 tx=0).stop 2024-05-30T16:58:23.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.009+0000 7f23ce400640 1 -- 172.21.15.59:0/1712318041 shutdown_connections 2024-05-30T16:58:23.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.009+0000 7f23ce400640 1 --2- 172.21.15.59:0/1712318041 >> v2:172.21.15.107:3300/0 conn(0x7f23c806fda0 0x7f23c80aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:23.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.009+0000 7f23ce400640 1 --2- 172.21.15.59:0/1712318041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c806ebb0 0x7f23c80b02b0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:23.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.009+0000 7f23ce400640 1 -- 172.21.15.59:0/1712318041 >> 172.21.15.59:0/1712318041 conn(0x7f23c8073320 msgr2=0x7f23c806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:23.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.009+0000 7f23ce400640 1 -- 172.21.15.59:0/1712318041 shutdown_connections 2024-05-30T16:58:23.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.009+0000 7f23ce400640 1 -- 172.21.15.59:0/1712318041 wait complete. 2024-05-30T16:58:23.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.013+0000 7f23ce400640 1 Processor -- start 2024-05-30T16:58:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.013+0000 7f23ce400640 1 -- start start 2024-05-30T16:58:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23ce400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c806ebb0 0x7f23c81fa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23ce400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23c806fda0 0x7f23c8160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23ce400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23c815e5c0 0x7f23c81613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23ce400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f23c815eb20 con 0x7f23c806ebb0 2024-05-30T16:58:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23ce400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f23c815e9a0 con 0x7f23c806fda0 2024-05-30T16:58:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23ce400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f23c80b43f0 con 0x7f23c815e5c0 2024-05-30T16:58:23.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23cda00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23c815e5c0 0x7f23c81613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:23.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23cda00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23c815e5c0 0x7f23c81613b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:35930/0 (socket says 172.21.15.59:35930) 2024-05-30T16:58:23.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23cda00640 1 -- 172.21.15.59:0/1725196343 learned_addr learned my addr 172.21.15.59:0/1725196343 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23cd000640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c806ebb0 0x7f23c81fa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23c7e00640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23c806fda0 0x7f23c8160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23cda00640 1 -- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23c806fda0 msgr2=0x7f23c8160e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23cda00640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23c806fda0 0x7f23c8160e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23cda00640 1 -- 172.21.15.59:0/1725196343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c806ebb0 msgr2=0x7f23c81fa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:23.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23cda00640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c806ebb0 0x7f23c81fa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:23.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.017+0000 7f23cda00640 1 -- 172.21.15.59:0/1725196343 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c814abc0 con 0x7f23c815e5c0 2024-05-30T16:58:23.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.021+0000 7f23cda00640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23c815e5c0 0x7f23c81613b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f23b800b460 tx=0x7f23b800b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:23.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.021+0000 7f23c4c00640 1 -- 172.21.15.59:0/1725196343 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8015020 con 0x7f23c815e5c0 2024-05-30T16:58:23.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.021+0000 7f23ce400640 1 -- 172.21.15.59:0/1725196343 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c814aea0 con 0x7f23c815e5c0 2024-05-30T16:58:23.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.021+0000 7f23ce400640 1 -- 172.21.15.59:0/1725196343 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c814b460 con 0x7f23c815e5c0 2024-05-30T16:58:23.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.021+0000 7f23ce400640 1 -- 172.21.15.59:0/1725196343 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c80691a0 con 0x7f23c815e5c0 2024-05-30T16:58:23.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.025+0000 7f23c4c00640 1 -- 172.21.15.59:0/1725196343 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b8011890 con 0x7f23c815e5c0 2024-05-30T16:58:23.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.025+0000 7f23c4c00640 1 -- 172.21.15.59:0/1725196343 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8011c60 con 0x7f23c815e5c0 2024-05-30T16:58:23.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.033+0000 7f23c4c00640 1 -- 172.21.15.59:0/1725196343 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f23b8018020 con 0x7f23c815e5c0 2024-05-30T16:58:23.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.033+0000 7f23c4c00640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f23a4069460 0x7f23a406b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:23.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.033+0000 7f23c4c00640 1 -- 172.21.15.59:0/1725196343 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f23b8085d00 con 0x7f23c815e5c0 2024-05-30T16:58:23.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.033+0000 7f23cd000640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f23a4069460 0x7f23a406b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:23.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.037+0000 7f23cd000640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f23a4069460 0x7f23a406b920 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009f60 tx=0x7f23c00094f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:23.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.045+0000 7f23c4c00640 1 -- 172.21.15.59:0/1725196343 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f23b801f020 con 0x7f23c815e5c0 2024-05-30T16:58:23.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:23.385+0000 7f23ce400640 1 -- 172.21.15.59:0/1725196343 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone698815", "target": ["mon-mgr", ""]}) -- 0x7f23c81facc0 con 0x7f23a4069460 2024-05-30T16:58:24.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.545+0000 7f23c4c00640 1 -- 172.21.15.59:0/1725196343 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f23c81facc0 con 0x7f23a4069460 2024-05-30T16:58:24.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.553+0000 7f23ce400640 1 -- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f23a4069460 msgr2=0x7f23a406b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.553+0000 7f23ce400640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f23a4069460 0x7f23a406b920 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009f60 tx=0x7f23c00094f0 comp rx=0 tx=0).stop 2024-05-30T16:58:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.553+0000 7f23ce400640 1 -- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23c815e5c0 msgr2=0x7f23c81613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.553+0000 7f23ce400640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23c815e5c0 0x7f23c81613b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f23b800b460 tx=0x7f23b800b920 comp rx=0 tx=0).stop 2024-05-30T16:58:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.553+0000 7f23ce400640 1 -- 172.21.15.59:0/1725196343 shutdown_connections 2024-05-30T16:58:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.553+0000 7f23ce400640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f23a4069460 0x7f23a406b920 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.553+0000 7f23ce400640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23c815e5c0 0x7f23c81613b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.553+0000 7f23ce400640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23c806fda0 0x7f23c8160e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.553+0000 7f23ce400640 1 --2- 172.21.15.59:0/1725196343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c806ebb0 0x7f23c81fa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.553+0000 7f23ce400640 1 -- 172.21.15.59:0/1725196343 >> 172.21.15.59:0/1725196343 conn(0x7f23c8073320 msgr2=0x7f23c80b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:24.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.553+0000 7f23ce400640 1 -- 172.21.15.59:0/1725196343 shutdown_connections 2024-05-30T16:58:24.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.553+0000 7f23ce400640 1 -- 172.21.15.59:0/1725196343 wait complete. 2024-05-30T16:58:24.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone698816 2024-05-30T16:58:24.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.793+0000 7feb0c400640 1 Processor -- start 2024-05-30T16:58:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0c400640 1 -- start start 2024-05-30T16:58:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0c400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feb0415eea0 0x7feb040b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0c400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feb0406f5a0 0x7feb040cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0c400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb040cf9e0 con 0x7feb040701c0 2024-05-30T16:58:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0c400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7feb040cbbc0 con 0x7feb0406f5a0 2024-05-30T16:58:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0c400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7feb040cfcc0 con 0x7feb0415eea0 2024-05-30T16:58:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0a400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feb0406f5a0 0x7feb040cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0a400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feb0406f5a0 0x7feb040cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49426/0 (socket says 172.21.15.59:49426) 2024-05-30T16:58:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0a400640 1 -- 172.21.15.59:0/2652033451 learned_addr learned my addr 172.21.15.59:0/2652033451 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb09a00640 1 --2- 172.21.15.59:0/2652033451 >> v2:172.21.15.107:3300/0 conn(0x7feb0415eea0 0x7feb040b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0a400640 1 -- 172.21.15.59:0/2652033451 >> v2:172.21.15.107:3300/0 conn(0x7feb0415eea0 msgr2=0x7feb040b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0a400640 1 --2- 172.21.15.59:0/2652033451 >> v2:172.21.15.107:3300/0 conn(0x7feb0415eea0 0x7feb040b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0a400640 1 -- 172.21.15.59:0/2652033451 >> v1:172.21.15.107:6789/0 conn(0x7feb040701c0 legacy=0x7feb0406ee90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:58:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.797+0000 7feb0a400640 1 -- 172.21.15.59:0/2652033451 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb040cc800 con 0x7feb0406f5a0 2024-05-30T16:58:24.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.801+0000 7feb0a400640 1 --2- 172.21.15.59:0/2652033451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb0406f5a0 0x7feb040cdd30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7feb040710e0 tx=0x7feafc01ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f269b1bc2b04b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:24.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.805+0000 7feb03e00640 1 -- 172.21.15.59:0/2652033451 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc0b4070 con 0x7feb0406f5a0 2024-05-30T16:58:24.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.805+0000 7feb03e00640 1 -- 172.21.15.59:0/2652033451 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feafc0a7aa0 con 0x7feb0406f5a0 2024-05-30T16:58:24.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.805+0000 7feb03e00640 1 -- 172.21.15.59:0/2652033451 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc0af440 con 0x7feb0406f5a0 2024-05-30T16:58:24.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.805+0000 7feb0c400640 1 -- 172.21.15.59:0/2652033451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb0406f5a0 msgr2=0x7feb040cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:24.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.805+0000 7feb0c400640 1 --2- 172.21.15.59:0/2652033451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb0406f5a0 0x7feb040cdd30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7feb040710e0 tx=0x7feafc01ebb0 comp rx=0 tx=0).stop 2024-05-30T16:58:24.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.805+0000 7feb0c400640 1 -- 172.21.15.59:0/2652033451 shutdown_connections 2024-05-30T16:58:24.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.805+0000 7feb0c400640 1 --2- 172.21.15.59:0/2652033451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb0406f5a0 0x7feb040cdd30 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:24.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.805+0000 7feb0c400640 1 --2- 172.21.15.59:0/2652033451 >> v2:172.21.15.107:3300/0 conn(0x7feb0415eea0 0x7feb040b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:24.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.805+0000 7feb0c400640 1 -- 172.21.15.59:0/2652033451 >> 172.21.15.59:0/2652033451 conn(0x7feb040b2f50 msgr2=0x7feb040b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:24.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.805+0000 7feb0c400640 1 -- 172.21.15.59:0/2652033451 shutdown_connections 2024-05-30T16:58:24.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.805+0000 7feb0c400640 1 -- 172.21.15.59:0/2652033451 wait complete. 2024-05-30T16:58:24.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.809+0000 7feb0c400640 1 Processor -- start 2024-05-30T16:58:24.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.809+0000 7feb0c400640 1 -- start start 2024-05-30T16:58:24.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.809+0000 7feb0c400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb0406f5a0 0x7feb040c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:24.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.809+0000 7feb0c400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb040701c0 0x7feb04156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:24.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.809+0000 7feb0c400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb0415eea0 0x7feb04156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:24.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.809+0000 7feb0c400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feb040d0120 con 0x7feb0406f5a0 2024-05-30T16:58:24.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.809+0000 7feb0c400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7feb040cffa0 con 0x7feb040701c0 2024-05-30T16:58:24.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.809+0000 7feb0c400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7feb040ae230 con 0x7feb0415eea0 2024-05-30T16:58:24.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.809+0000 7feb09000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb040701c0 0x7feb04156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:24.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.809+0000 7feb09a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb0406f5a0 0x7feb040c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:24.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.809+0000 7feb09000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb040701c0 0x7feb04156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:51868/0 (socket says 172.21.15.59:51868) 2024-05-30T16:58:24.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.809+0000 7feb09000640 1 -- 172.21.15.59:0/3610411648 learned_addr learned my addr 172.21.15.59:0/3610411648 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:24.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.813+0000 7feb09a00640 1 -- 172.21.15.59:0/3610411648 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb0415eea0 msgr2=0x7feb04156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:24.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.813+0000 7feb09a00640 1 --2- 172.21.15.59:0/3610411648 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb0415eea0 0x7feb04156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:24.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.813+0000 7feb09a00640 1 -- 172.21.15.59:0/3610411648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb040701c0 msgr2=0x7feb04156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:24.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.813+0000 7feb09a00640 1 --2- 172.21.15.59:0/3610411648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb040701c0 0x7feb04156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:24.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.813+0000 7feb09a00640 1 -- 172.21.15.59:0/3610411648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb040c6da0 con 0x7feb0406f5a0 2024-05-30T16:58:24.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.813+0000 7feb09a00640 1 --2- 172.21.15.59:0/3610411648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb0406f5a0 0x7feb040c6450 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7feaf8007e90 tx=0x7feaf800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:24.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.813+0000 7feb01600640 1 -- 172.21.15.59:0/3610411648 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8014420 con 0x7feb0406f5a0 2024-05-30T16:58:24.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.813+0000 7feb01600640 1 -- 172.21.15.59:0/3610411648 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf8019070 con 0x7feb0406f5a0 2024-05-30T16:58:24.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.813+0000 7feb01600640 1 -- 172.21.15.59:0/3610411648 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf80147e0 con 0x7feb0406f5a0 2024-05-30T16:58:24.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.813+0000 7feb0c400640 1 -- 172.21.15.59:0/3610411648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb040c7080 con 0x7feb0406f5a0 2024-05-30T16:58:24.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.813+0000 7feb0c400640 1 -- 172.21.15.59:0/3610411648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb040c7640 con 0x7feb0406f5a0 2024-05-30T16:58:24.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.813+0000 7feb0c400640 1 -- 172.21.15.59:0/3610411648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb04068a90 con 0x7feb0406f5a0 2024-05-30T16:58:24.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.817+0000 7feb01600640 1 -- 172.21.15.59:0/3610411648 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7feaf8014980 con 0x7feb0406f5a0 2024-05-30T16:58:24.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.817+0000 7feb01600640 1 --2- 172.21.15.59:0/3610411648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feae4069460 0x7feae406b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:24.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.817+0000 7feb01600640 1 -- 172.21.15.59:0/3610411648 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7feaf8085d30 con 0x7feb0406f5a0 2024-05-30T16:58:24.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.821+0000 7feb01600640 1 -- 172.21.15.59:0/3610411648 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feaf8014c70 con 0x7feb0406f5a0 2024-05-30T16:58:24.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.829+0000 7feb09000640 1 --2- 172.21.15.59:0/3610411648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feae4069460 0x7feae406b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:24.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:24.845+0000 7feb09000640 1 --2- 172.21.15.59:0/3610411648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feae4069460 0x7feae406b920 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7feb040b2a10 tx=0x7feaf0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:25.145+0000 7feb0c400640 1 -- 172.21.15.59:0/3610411648 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone698816", "target": ["mon-mgr", ""]}) -- 0x7feb0406efa0 con 0x7feae4069460 2024-05-30T16:58:26.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.509+0000 7feb01600640 1 -- 172.21.15.59:0/3610411648 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7feb0406efa0 con 0x7feae4069460 2024-05-30T16:58:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.517+0000 7feb0c400640 1 -- 172.21.15.59:0/3610411648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feae4069460 msgr2=0x7feae406b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.517+0000 7feb0c400640 1 --2- 172.21.15.59:0/3610411648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feae4069460 0x7feae406b920 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7feb040b2a10 tx=0x7feaf0008040 comp rx=0 tx=0).stop 2024-05-30T16:58:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.517+0000 7feb0c400640 1 -- 172.21.15.59:0/3610411648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb0406f5a0 msgr2=0x7feb040c6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.517+0000 7feb0c400640 1 --2- 172.21.15.59:0/3610411648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb0406f5a0 0x7feb040c6450 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7feaf8007e90 tx=0x7feaf800e4b0 comp rx=0 tx=0).stop 2024-05-30T16:58:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.517+0000 7feb0c400640 1 -- 172.21.15.59:0/3610411648 shutdown_connections 2024-05-30T16:58:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.517+0000 7feb0c400640 1 --2- 172.21.15.59:0/3610411648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feae4069460 0x7feae406b920 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.517+0000 7feb0c400640 1 --2- 172.21.15.59:0/3610411648 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb0415eea0 0x7feb04156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.517+0000 7feb0c400640 1 --2- 172.21.15.59:0/3610411648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb040701c0 0x7feb04156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.517+0000 7feb0c400640 1 --2- 172.21.15.59:0/3610411648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb0406f5a0 0x7feb040c6450 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.517+0000 7feb0c400640 1 -- 172.21.15.59:0/3610411648 >> 172.21.15.59:0/3610411648 conn(0x7feb040b2f50 msgr2=0x7feb0415d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.517+0000 7feb0c400640 1 -- 172.21.15.59:0/3610411648 shutdown_connections 2024-05-30T16:58:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.517+0000 7feb0c400640 1 -- 172.21.15.59:0/3610411648 wait complete. 2024-05-30T16:58:26.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone698817 2024-05-30T16:58:26.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2f7400640 1 Processor -- start 2024-05-30T16:58:26.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2f7400640 1 -- start start 2024-05-30T16:58:26.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2f7400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2f006f580 0x7fb2f00d0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:26.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2f7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2f006f960 0x7fb2f015f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2f7400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2f00afe10 con 0x7fb2f015fd80 2024-05-30T16:58:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2f7400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb2f00cda80 con 0x7fb2f006f960 2024-05-30T16:58:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2f7400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb2f00cdd60 con 0x7fb2f006f580 2024-05-30T16:58:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2efe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2f006f960 0x7fb2f015f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2efe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2f006f960 0x7fb2f015f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49434/0 (socket says 172.21.15.59:49434) 2024-05-30T16:58:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2efe00640 1 -- 172.21.15.59:0/992151816 learned_addr learned my addr 172.21.15.59:0/992151816 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2efe00640 1 -- 172.21.15.59:0/992151816 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2f006f580 msgr2=0x7fb2f00d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2efe00640 1 --2- 172.21.15.59:0/992151816 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2f006f580 0x7fb2f00d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2efe00640 1 -- 172.21.15.59:0/992151816 >> v1:172.21.15.107:6789/0 conn(0x7fb2f015fd80 legacy=0x7fb2f00b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.781+0000 7fb2efe00640 1 -- 172.21.15.59:0/992151816 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f00ce040 con 0x7fb2f006f960 2024-05-30T16:58:26.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.785+0000 7fb2efe00640 1 --2- 172.21.15.59:0/992151816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f006f960 0x7fb2f015f840 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009870 tx=0x7fb2dc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556f73953a5e47f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:26.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.785+0000 7fb2ef400640 1 -- 172.21.15.59:0/992151816 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0b0070 con 0x7fb2f006f960 2024-05-30T16:58:26.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.785+0000 7fb2ef400640 1 -- 172.21.15.59:0/992151816 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2dc0ab600 con 0x7fb2f006f960 2024-05-30T16:58:26.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.785+0000 7fb2ef400640 1 -- 172.21.15.59:0/992151816 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0ab9d0 con 0x7fb2f006f960 2024-05-30T16:58:26.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.785+0000 7fb2f7400640 1 -- 172.21.15.59:0/992151816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f006f960 msgr2=0x7fb2f015f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:26.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.785+0000 7fb2f7400640 1 --2- 172.21.15.59:0/992151816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f006f960 0x7fb2f015f840 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009870 tx=0x7fb2dc01c490 comp rx=0 tx=0).stop 2024-05-30T16:58:26.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.785+0000 7fb2f7400640 1 -- 172.21.15.59:0/992151816 shutdown_connections 2024-05-30T16:58:26.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.785+0000 7fb2f7400640 1 --2- 172.21.15.59:0/992151816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f006f960 0x7fb2f015f840 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:26.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.785+0000 7fb2f7400640 1 --2- 172.21.15.59:0/992151816 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2f006f580 0x7fb2f00d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:26.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.785+0000 7fb2f7400640 1 -- 172.21.15.59:0/992151816 >> 172.21.15.59:0/992151816 conn(0x7fb2f00b2560 msgr2=0x7fb2f00b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:26.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.785+0000 7fb2f7400640 1 -- 172.21.15.59:0/992151816 shutdown_connections 2024-05-30T16:58:26.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.785+0000 7fb2f7400640 1 -- 172.21.15.59:0/992151816 wait complete. 2024-05-30T16:58:26.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2f7400640 1 Processor -- start 2024-05-30T16:58:26.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2f7400640 1 -- start start 2024-05-30T16:58:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2f7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f006f580 0x7fb2f0157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2f7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f006f960 0x7fb2f014d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2f7400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2f015fd80 0x7fb2f0151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2f7400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f006e5a0 con 0x7fb2f006f960 2024-05-30T16:58:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2f7400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f006e420 con 0x7fb2f006f580 2024-05-30T16:58:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2f7400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb2f006e720 con 0x7fb2f015fd80 2024-05-30T16:58:26.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f006f960 0x7fb2f014d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:26.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f006f960 0x7fb2f014d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49442/0 (socket says 172.21.15.59:49442) 2024-05-30T16:58:26.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2efe00640 1 -- 172.21.15.59:0/2756099378 learned_addr learned my addr 172.21.15.59:0/2756099378 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:26.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2efe00640 1 -- 172.21.15.59:0/2756099378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2f015fd80 msgr2=0x7fb2f0151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:26.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2efe00640 1 --2- 172.21.15.59:0/2756099378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2f015fd80 0x7fb2f0151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:26.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2efe00640 1 -- 172.21.15.59:0/2756099378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f006f580 msgr2=0x7fb2f0157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:26.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2efe00640 1 --2- 172.21.15.59:0/2756099378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f006f580 0x7fb2f0157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:26.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2efe00640 1 -- 172.21.15.59:0/2756099378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f01f73b0 con 0x7fb2f006f960 2024-05-30T16:58:26.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2efe00640 1 --2- 172.21.15.59:0/2756099378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f006f960 0x7fb2f014d880 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0ae040 tx=0x7fb2dc01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:26.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2ecc00640 1 -- 172.21.15.59:0/2756099378 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0ba020 con 0x7fb2f006f960 2024-05-30T16:58:26.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2ecc00640 1 -- 172.21.15.59:0/2756099378 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2dc0abdb0 con 0x7fb2f006f960 2024-05-30T16:58:26.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2ecc00640 1 -- 172.21.15.59:0/2756099378 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0b0040 con 0x7fb2f006f960 2024-05-30T16:58:26.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2f7400640 1 -- 172.21.15.59:0/2756099378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f01f7690 con 0x7fb2f006f960 2024-05-30T16:58:26.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.789+0000 7fb2f7400640 1 -- 172.21.15.59:0/2756099378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f01f7c50 con 0x7fb2f006f960 2024-05-30T16:58:26.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.793+0000 7fb2f7400640 1 -- 172.21.15.59:0/2756099378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f00691a0 con 0x7fb2f006f960 2024-05-30T16:58:26.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.793+0000 7fb2ecc00640 1 -- 172.21.15.59:0/2756099378 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7fb2dc0bd020 con 0x7fb2f006f960 2024-05-30T16:58:26.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.793+0000 7fb2ecc00640 1 --2- 172.21.15.59:0/2756099378 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2d0069460 0x7fb2d006b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:26.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.793+0000 7fb2ecc00640 1 -- 172.21.15.59:0/2756099378 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fb2dc11f980 con 0x7fb2f006f960 2024-05-30T16:58:26.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.797+0000 7fb2ecc00640 1 -- 172.21.15.59:0/2756099378 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb2dc0c4030 con 0x7fb2f006f960 2024-05-30T16:58:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.813+0000 7fb2f4a00640 1 --2- 172.21.15.59:0/2756099378 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2d0069460 0x7fb2d006b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:26.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:26.853+0000 7fb2f4a00640 1 --2- 172.21.15.59:0/2756099378 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2d0069460 0x7fb2d006b920 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009730 tx=0x7fb2e4006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:27.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:27.101+0000 7fb2f7400640 1 -- 172.21.15.59:0/2756099378 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone698817", "target": ["mon-mgr", ""]}) -- 0x7fb2f015e6f0 con 0x7fb2d0069460 2024-05-30T16:58:28.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.125+0000 7fb2ecc00640 1 -- 172.21.15.59:0/2756099378 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb2f015e6f0 con 0x7fb2d0069460 2024-05-30T16:58:28.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.129+0000 7fb2f7400640 1 -- 172.21.15.59:0/2756099378 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2d0069460 msgr2=0x7fb2d006b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:28.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.129+0000 7fb2f7400640 1 --2- 172.21.15.59:0/2756099378 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2d0069460 0x7fb2d006b920 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009730 tx=0x7fb2e4006ca0 comp rx=0 tx=0).stop 2024-05-30T16:58:28.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.129+0000 7fb2f7400640 1 -- 172.21.15.59:0/2756099378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f006f960 msgr2=0x7fb2f014d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:28.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.129+0000 7fb2f7400640 1 --2- 172.21.15.59:0/2756099378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f006f960 0x7fb2f014d880 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0ae040 tx=0x7fb2dc01acd0 comp rx=0 tx=0).stop 2024-05-30T16:58:28.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.129+0000 7fb2f7400640 1 -- 172.21.15.59:0/2756099378 shutdown_connections 2024-05-30T16:58:28.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.129+0000 7fb2f7400640 1 --2- 172.21.15.59:0/2756099378 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2d0069460 0x7fb2d006b920 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:28.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.129+0000 7fb2f7400640 1 --2- 172.21.15.59:0/2756099378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2f015fd80 0x7fb2f0151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:28.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.129+0000 7fb2f7400640 1 --2- 172.21.15.59:0/2756099378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f006f960 0x7fb2f014d880 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:28.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.129+0000 7fb2f7400640 1 --2- 172.21.15.59:0/2756099378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f006f580 0x7fb2f0157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:28.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.129+0000 7fb2f7400640 1 -- 172.21.15.59:0/2756099378 >> 172.21.15.59:0/2756099378 conn(0x7fb2f00b2560 msgr2=0x7fb2f015dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:28.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.129+0000 7fb2f7400640 1 -- 172.21.15.59:0/2756099378 shutdown_connections 2024-05-30T16:58:28.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.129+0000 7fb2f7400640 1 -- 172.21.15.59:0/2756099378 wait complete. 2024-05-30T16:58:28.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone698818 2024-05-30T16:58:28.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a2cc00640 1 Processor -- start 2024-05-30T16:58:28.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a2cc00640 1 -- start start 2024-05-30T16:58:28.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a2cc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a28159100 0x7f5a2806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:28.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a2cc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a2815f420 0x7f5a280d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:28.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a2cc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a280b52d0 con 0x7f5a2815efd0 2024-05-30T16:58:28.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a2cc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f5a280b4a30 con 0x7f5a28159100 2024-05-30T16:58:28.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a2cc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5a280b4d10 con 0x7f5a2815f420 2024-05-30T16:58:28.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a25400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5a2815efd0 0x7f5a2815c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60732/0 (socket says 172.21.15.59:60732) 2024-05-30T16:58:28.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a25400640 1 -- 172.21.15.59:0/3785814559 learned_addr learned my addr 172.21.15.59:0/3785814559 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:58:28.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a25e00640 1 --2- 172.21.15.59:0/3785814559 >> v2:172.21.15.59:3300/0 conn(0x7f5a28159100 0x7f5a2806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:28.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a24a00640 1 -- 172.21.15.59:0/3785814559 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2967920112 0 0) 0x7f5a280b52d0 con 0x7f5a2815efd0 2024-05-30T16:58:28.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a24a00640 1 -- 172.21.15.59:0/3785814559 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a0c003530 con 0x7f5a2815efd0 2024-05-30T16:58:28.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a25e00640 1 -- 172.21.15.59:0/3785814559 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a2815f420 msgr2=0x7f5a280d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:28.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a25e00640 1 --2- 172.21.15.59:0/3785814559 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a2815f420 0x7f5a280d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:28.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a25e00640 1 -- 172.21.15.59:0/3785814559 >> v1:172.21.15.59:6789/0 conn(0x7f5a2815efd0 legacy=0x7f5a2815c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:28.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.365+0000 7f5a25e00640 1 -- 172.21.15.59:0/3785814559 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a280b4ff0 con 0x7f5a28159100 2024-05-30T16:58:28.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.369+0000 7f5a25e00640 1 --2- 172.21.15.59:0/3785814559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a28159100 0x7f5a2806e590 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5a180097c0 tx=0x7f5a1801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bce78d111be709 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:28.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.369+0000 7f5a24a00640 1 -- 172.21.15.59:0/3785814559 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a180b0070 con 0x7f5a28159100 2024-05-30T16:58:28.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.369+0000 7f5a24a00640 1 -- 172.21.15.59:0/3785814559 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a180ab600 con 0x7f5a28159100 2024-05-30T16:58:28.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.369+0000 7f5a24a00640 1 -- 172.21.15.59:0/3785814559 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a180ab9d0 con 0x7f5a28159100 2024-05-30T16:58:28.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.369+0000 7f5a2cc00640 1 -- 172.21.15.59:0/3785814559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a28159100 msgr2=0x7f5a2806e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:28.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.369+0000 7f5a2cc00640 1 --2- 172.21.15.59:0/3785814559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a28159100 0x7f5a2806e590 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5a180097c0 tx=0x7f5a1801c410 comp rx=0 tx=0).stop 2024-05-30T16:58:28.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.369+0000 7f5a2cc00640 1 -- 172.21.15.59:0/3785814559 shutdown_connections 2024-05-30T16:58:28.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.369+0000 7f5a2cc00640 1 --2- 172.21.15.59:0/3785814559 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a2815f420 0x7f5a280d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:28.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.369+0000 7f5a2cc00640 1 --2- 172.21.15.59:0/3785814559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a28159100 0x7f5a2806e590 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:28.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.373+0000 7f5a2cc00640 1 -- 172.21.15.59:0/3785814559 >> 172.21.15.59:0/3785814559 conn(0x7f5a2806bdb0 msgr2=0x7f5a2806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:28.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.373+0000 7f5a2cc00640 1 -- 172.21.15.59:0/3785814559 shutdown_connections 2024-05-30T16:58:28.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.373+0000 7f5a2cc00640 1 -- 172.21.15.59:0/3785814559 wait complete. 2024-05-30T16:58:28.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a2cc00640 1 Processor -- start 2024-05-30T16:58:28.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a2cc00640 1 -- start start 2024-05-30T16:58:28.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a2cc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a28159100 0x7f5a2814e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:28.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a2cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2815efd0 0x7f5a2814e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:28.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a2cc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a2815f420 0x7f5a280b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:28.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a2cc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5a28164120 con 0x7f5a2815efd0 2024-05-30T16:58:28.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a2cc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5a280b3b90 con 0x7f5a28159100 2024-05-30T16:58:28.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a2cc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5a280b3d10 con 0x7f5a2815f420 2024-05-30T16:58:28.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a25400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2815efd0 0x7f5a2814e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:28.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a25400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2815efd0 0x7f5a2814e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49462/0 (socket says 172.21.15.59:49462) 2024-05-30T16:58:28.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a25400640 1 -- 172.21.15.59:0/2769744516 learned_addr learned my addr 172.21.15.59:0/2769744516 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:28.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a25400640 1 -- 172.21.15.59:0/2769744516 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a2815f420 msgr2=0x7f5a280b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:28.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a25400640 1 --2- 172.21.15.59:0/2769744516 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a2815f420 0x7f5a280b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:28.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a25400640 1 -- 172.21.15.59:0/2769744516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a28159100 msgr2=0x7f5a2814e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:28.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a25400640 1 --2- 172.21.15.59:0/2769744516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a28159100 0x7f5a2814e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:28.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a25400640 1 -- 172.21.15.59:0/2769744516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a28152e10 con 0x7f5a2815efd0 2024-05-30T16:58:28.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.377+0000 7f5a25400640 1 --2- 172.21.15.59:0/2769744516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2815efd0 0x7f5a2814e7c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5a140010f0 tx=0x7f5a1400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:28.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.381+0000 7f5a1e000640 1 -- 172.21.15.59:0/2769744516 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14017070 con 0x7f5a2815efd0 2024-05-30T16:58:28.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.381+0000 7f5a2cc00640 1 -- 172.21.15.59:0/2769744516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a281530f0 con 0x7f5a2815efd0 2024-05-30T16:58:28.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.381+0000 7f5a1e000640 1 -- 172.21.15.59:0/2769744516 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a14005d10 con 0x7f5a2815efd0 2024-05-30T16:58:28.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.381+0000 7f5a1e000640 1 -- 172.21.15.59:0/2769744516 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14007310 con 0x7f5a2815efd0 2024-05-30T16:58:28.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.381+0000 7f5a2cc00640 1 -- 172.21.15.59:0/2769744516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a281536b0 con 0x7f5a2815efd0 2024-05-30T16:58:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.381+0000 7f5a2cc00640 1 -- 172.21.15.59:0/2769744516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a28068a90 con 0x7f5a2815efd0 2024-05-30T16:58:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.381+0000 7f5a1e000640 1 -- 172.21.15.59:0/2769744516 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f5a1401a070 con 0x7f5a2815efd0 2024-05-30T16:58:28.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.385+0000 7f5a1e000640 1 --2- 172.21.15.59:0/2769744516 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5a08069560 0x7f5a0806ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:28.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.385+0000 7f5a1e000640 1 -- 172.21.15.59:0/2769744516 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f5a14084d30 con 0x7f5a2815efd0 2024-05-30T16:58:28.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.385+0000 7f5a25e00640 1 --2- 172.21.15.59:0/2769744516 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5a08069560 0x7f5a0806ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:28.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.389+0000 7f5a25e00640 1 --2- 172.21.15.59:0/2769744516 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5a08069560 0x7f5a0806ba20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5a180ad000 tx=0x7f5a18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.389+0000 7f5a1e000640 1 -- 172.21.15.59:0/2769744516 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5a14056a00 con 0x7f5a2815efd0 2024-05-30T16:58:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:28.669+0000 7f5a2cc00640 1 -- 172.21.15.59:0/2769744516 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone698818", "target": ["mon-mgr", ""]}) -- 0x7f5a280cc2b0 con 0x7f5a08069560 2024-05-30T16:58:29.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.705+0000 7f5a1e000640 1 -- 172.21.15.59:0/2769744516 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5a280cc2b0 con 0x7f5a08069560 2024-05-30T16:58:29.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.713+0000 7f5a2cc00640 1 -- 172.21.15.59:0/2769744516 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5a08069560 msgr2=0x7f5a0806ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:29.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.713+0000 7f5a2cc00640 1 --2- 172.21.15.59:0/2769744516 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5a08069560 0x7f5a0806ba20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5a180ad000 tx=0x7f5a18008040 comp rx=0 tx=0).stop 2024-05-30T16:58:29.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.713+0000 7f5a2cc00640 1 -- 172.21.15.59:0/2769744516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2815efd0 msgr2=0x7f5a2814e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:29.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.713+0000 7f5a2cc00640 1 --2- 172.21.15.59:0/2769744516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2815efd0 0x7f5a2814e7c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5a140010f0 tx=0x7f5a1400c8f0 comp rx=0 tx=0).stop 2024-05-30T16:58:29.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.713+0000 7f5a2cc00640 1 -- 172.21.15.59:0/2769744516 shutdown_connections 2024-05-30T16:58:29.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.713+0000 7f5a2cc00640 1 --2- 172.21.15.59:0/2769744516 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5a08069560 0x7f5a0806ba20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:29.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.713+0000 7f5a2cc00640 1 --2- 172.21.15.59:0/2769744516 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a2815f420 0x7f5a280b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:29.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.713+0000 7f5a2cc00640 1 --2- 172.21.15.59:0/2769744516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2815efd0 0x7f5a2814e7c0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:29.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.713+0000 7f5a2cc00640 1 --2- 172.21.15.59:0/2769744516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a28159100 0x7f5a2814e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:29.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.713+0000 7f5a2cc00640 1 -- 172.21.15.59:0/2769744516 >> 172.21.15.59:0/2769744516 conn(0x7f5a2806bdb0 msgr2=0x7f5a280aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:29.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.713+0000 7f5a2cc00640 1 -- 172.21.15.59:0/2769744516 shutdown_connections 2024-05-30T16:58:29.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:29.713+0000 7f5a2cc00640 1 -- 172.21.15.59:0/2769744516 wait complete. 2024-05-30T16:58:29.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone698819 2024-05-30T16:58:30.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.005+0000 7fe82e000640 1 Processor -- start 2024-05-30T16:58:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.005+0000 7fe82e000640 1 -- start start 2024-05-30T16:58:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe82e000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe828160d90 0x7fe82809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe82e000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe8280711e0 0x7fe82809af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe82e000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8280d1310 con 0x7fe82809b780 2024-05-30T16:58:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe82e000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe8280ced30 con 0x7fe8280711e0 2024-05-30T16:58:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe82e000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe82809bcf0 con 0x7fe828160d90 2024-05-30T16:58:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe82809b780 0x7fe82806ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:43624/0 (socket says 172.21.15.59:43624) 2024-05-30T16:58:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826a00640 1 -- 172.21.15.59:0/2425127396 learned_addr learned my addr 172.21.15.59:0/2425127396 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:58:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe827e00640 1 --2- 172.21.15.59:0/2425127396 >> v2:172.21.15.107:3300/0 conn(0x7fe8280711e0 0x7fe82809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe827400640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe828160d90 0x7fe82809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530534789 0 0) 0x7fe8280d1310 con 0x7fe82809b780 2024-05-30T16:58:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe80c003530 con 0x7fe82809b780 2024-05-30T16:58:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 199880763 0 0) 0x7fe80c003530 con 0x7fe82809b780 2024-05-30T16:58:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe828160d90 msgr2=0x7fe82809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe828160d90 0x7fe82809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 >> v2:172.21.15.107:3300/0 conn(0x7fe8280711e0 msgr2=0x7fe82809af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 --2- 172.21.15.59:0/2425127396 >> v2:172.21.15.107:3300/0 conn(0x7fe8280711e0 0x7fe82809af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8280d0a70 con 0x7fe82809b780 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fe810001a20 con 0x7fe82809b780 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 >> v1:172.21.15.107:6789/0 conn(0x7fe82809b780 legacy=0x7fe82806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe80c0039c0 0x7fe80c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c0043b0 0x7fe80c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe828160d90 0x7fe80c0050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe82809bcf0 con 0x7fe80c0043b0 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c00b9d0 con 0x7fe80c0039c0 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe80c00bba0 con 0x7fe828160d90 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.009+0000 7fe826a00640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c0043b0 0x7fe80c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.013+0000 7fe827400640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe80c0039c0 0x7fe80c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.013+0000 7fe827e00640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe828160d90 0x7fe80c0050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.013+0000 7fe826a00640 1 -- 172.21.15.59:0/2425127396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe828160d90 msgr2=0x7fe80c0050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.013+0000 7fe826a00640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe828160d90 0x7fe80c0050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.013+0000 7fe826a00640 1 -- 172.21.15.59:0/2425127396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe80c0039c0 msgr2=0x7fe80c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.013+0000 7fe826a00640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe80c0039c0 0x7fe80c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.013+0000 7fe826a00640 1 -- 172.21.15.59:0/2425127396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8280d0a70 con 0x7fe80c0043b0 2024-05-30T16:58:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.013+0000 7fe827e00640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe828160d90 0x7fe80c0050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:58:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.017+0000 7fe826a00640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c0043b0 0x7fe80c004890 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe81000a9e0 tx=0x7fe81001d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aecd0771722dd52 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:30.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.017+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81000a5e0 con 0x7fe80c0043b0 2024-05-30T16:58:30.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.017+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8100ad630 con 0x7fe80c0043b0 2024-05-30T16:58:30.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.017+0000 7fe826000640 1 -- 172.21.15.59:0/2425127396 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8100a5e60 con 0x7fe80c0043b0 2024-05-30T16:58:30.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.017+0000 7fe82e000640 1 -- 172.21.15.59:0/2425127396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c0043b0 msgr2=0x7fe80c004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:30.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.017+0000 7fe82e000640 1 --2- 172.21.15.59:0/2425127396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c0043b0 0x7fe80c004890 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe81000a9e0 tx=0x7fe81001d4a0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.017+0000 7fe827e00640 1 -- 172.21.15.59:0/2425127396 reap_dead start 2024-05-30T16:58:30.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.017+0000 7fe82e000640 1 -- 172.21.15.59:0/2425127396 shutdown_connections 2024-05-30T16:58:30.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.017+0000 7fe82e000640 1 -- 172.21.15.59:0/2425127396 >> 172.21.15.59:0/2425127396 conn(0x7fe8280b3f80 msgr2=0x7fe8280b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:30.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.017+0000 7fe82e000640 1 -- 172.21.15.59:0/2425127396 shutdown_connections 2024-05-30T16:58:30.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.017+0000 7fe82e000640 1 -- 172.21.15.59:0/2425127396 wait complete. 2024-05-30T16:58:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe82e000640 1 Processor -- start 2024-05-30T16:58:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe82e000640 1 -- start start 2024-05-30T16:58:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe82e000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe82815f350 0x7fe8281f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe82e000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe82815f730 0x7fe8280c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe82e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8280c8020 0x7fe8280b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe82e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe828071fe0 con 0x7fe8280c8020 2024-05-30T16:58:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe82e000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe828071e60 con 0x7fe82815f350 2024-05-30T16:58:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe82e000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe828161170 con 0x7fe82815f730 2024-05-30T16:58:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe827e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8280c8020 0x7fe8280b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe827e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8280c8020 0x7fe8280b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49478/0 (socket says 172.21.15.59:49478) 2024-05-30T16:58:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe827e00640 1 -- 172.21.15.59:0/3999749963 learned_addr learned my addr 172.21.15.59:0/3999749963 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe826a00640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe82815f730 0x7fe8280c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe827e00640 1 -- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe82815f730 msgr2=0x7fe8280c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe827e00640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe82815f730 0x7fe8280c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe827e00640 1 -- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe82815f350 msgr2=0x7fe8281f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe827e00640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe82815f350 0x7fe8281f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe827e00640 1 -- 172.21.15.59:0/3999749963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8280af760 con 0x7fe8280c8020 2024-05-30T16:58:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe827e00640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8280c8020 0x7fe8280b0800 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fe828073010 tx=0x7fe82000e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe81f400640 1 -- 172.21.15.59:0/3999749963 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82000f040 con 0x7fe8280c8020 2024-05-30T16:58:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe81f400640 1 -- 172.21.15.59:0/3999749963 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe820004020 con 0x7fe8280c8020 2024-05-30T16:58:30.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe82e000640 1 -- 172.21.15.59:0/3999749963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8280afa40 con 0x7fe8280c8020 2024-05-30T16:58:30.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe81f400640 1 -- 172.21.15.59:0/3999749963 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8200043f0 con 0x7fe8280c8020 2024-05-30T16:58:30.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.021+0000 7fe82e000640 1 -- 172.21.15.59:0/3999749963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8280b0000 con 0x7fe8280c8020 2024-05-30T16:58:30.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.025+0000 7fe82e000640 1 -- 172.21.15.59:0/3999749963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe828068a90 con 0x7fe8280c8020 2024-05-30T16:58:30.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.025+0000 7fe81f400640 1 -- 172.21.15.59:0/3999749963 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7fe82001b020 con 0x7fe8280c8020 2024-05-30T16:58:30.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.029+0000 7fe81f400640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe804069490 0x7fe80406b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.029+0000 7fe81f400640 1 -- 172.21.15.59:0/3999749963 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fe820084770 con 0x7fe8280c8020 2024-05-30T16:58:30.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.029+0000 7fe827400640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe804069490 0x7fe80406b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.033+0000 7fe81f400640 1 -- 172.21.15.59:0/3999749963 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe820056700 con 0x7fe8280c8020 2024-05-30T16:58:30.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.073+0000 7fe827400640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe804069490 0x7fe80406b950 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe818009850 tx=0x7fe818008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:30.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.369+0000 7fe82e000640 1 -- 172.21.15.59:0/3999749963 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone698819", "target": ["mon-mgr", ""]}) -- 0x7fe8280b4be0 con 0x7fe804069490 2024-05-30T16:58:30.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.617+0000 7fe81f400640 1 -- 172.21.15.59:0/3999749963 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe8280b4be0 con 0x7fe804069490 2024-05-30T16:58:30.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.621+0000 7fe82e000640 1 -- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe804069490 msgr2=0x7fe80406b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:30.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.621+0000 7fe82e000640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe804069490 0x7fe80406b950 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe818009850 tx=0x7fe818008040 comp rx=0 tx=0).stop 2024-05-30T16:58:30.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.621+0000 7fe82e000640 1 -- 172.21.15.59:0/3999749963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8280c8020 msgr2=0x7fe8280b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:30.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.621+0000 7fe82e000640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8280c8020 0x7fe8280b0800 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fe828073010 tx=0x7fe82000e830 comp rx=0 tx=0).stop 2024-05-30T16:58:30.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.621+0000 7fe82e000640 1 -- 172.21.15.59:0/3999749963 shutdown_connections 2024-05-30T16:58:30.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.621+0000 7fe82e000640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe804069490 0x7fe80406b950 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.621+0000 7fe82e000640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8280c8020 0x7fe8280b0800 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.621+0000 7fe82e000640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe82815f730 0x7fe8280c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.621+0000 7fe82e000640 1 --2- 172.21.15.59:0/3999749963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe82815f350 0x7fe8281f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.621+0000 7fe82e000640 1 -- 172.21.15.59:0/3999749963 >> 172.21.15.59:0/3999749963 conn(0x7fe8280b3f80 msgr2=0x7fe82806d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:30.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.621+0000 7fe82e000640 1 -- 172.21.15.59:0/3999749963 shutdown_connections 2024-05-30T16:58:30.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.621+0000 7fe82e000640 1 -- 172.21.15.59:0/3999749963 wait complete. 2024-05-30T16:58:30.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone698820 2024-05-30T16:58:30.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.877+0000 7f4495e00640 1 Processor -- start 2024-05-30T16:58:30.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.877+0000 7f4495e00640 1 -- start start 2024-05-30T16:58:30.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4495e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44900b3880 0x7f4490072060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4495e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f44900725a0 0x7f44900aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4495e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44900b4c20 con 0x7f4490141770 2024-05-30T16:58:30.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4495e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f44900b4f00 con 0x7f44900725a0 2024-05-30T16:58:30.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4495e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f44900b51e0 con 0x7f44900b3880 2024-05-30T16:58:30.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4494a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4490141770 0x7f44900b4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60742/0 (socket says 172.21.15.59:60742) 2024-05-30T16:58:30.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4494a00640 1 -- 172.21.15.59:0/4132022127 learned_addr learned my addr 172.21.15.59:0/4132022127 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:58:30.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426109076 0 0) 0x7f44900b4c20 con 0x7f4490141770 2024-05-30T16:58:30.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4478003530 con 0x7f4490141770 2024-05-30T16:58:30.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2425645948 0 0) 0x7f4478003530 con 0x7f4490141770 2024-05-30T16:58:30.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44900b3880 msgr2=0x7f4490072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:30.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 --2- 172.21.15.59:0/4132022127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44900b3880 0x7f4490072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4495400640 1 --2- 172.21.15.59:0/4132022127 >> v2:172.21.15.107:3300/0 conn(0x7f44900725a0 0x7f44900aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 >> v2:172.21.15.107:3300/0 conn(0x7f44900725a0 msgr2=0x7f44900aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:30.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 --2- 172.21.15.59:0/4132022127 >> v2:172.21.15.107:3300/0 conn(0x7f44900725a0 0x7f44900aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44900b54c0 con 0x7f4490141770 2024-05-30T16:58:30.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f4484001a00 con 0x7f4490141770 2024-05-30T16:58:30.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4495400640 1 --2- 172.21.15.59:0/4132022127 >> v2:172.21.15.107:3300/0 conn(0x7f44900725a0 0x7f44900aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:58:30.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 >> v1:172.21.15.59:6789/0 conn(0x7f4490141770 legacy=0x7f44900b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:30.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 --2- 172.21.15.59:0/4132022127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44780039c0 0x7f4478003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 --2- 172.21.15.59:0/4132022127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4478004810 0x7f4478004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 --2- 172.21.15.59:0/4132022127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44780051d0 0x7f447800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44900b4f00 con 0x7f4478004810 2024-05-30T16:58:30.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f44900b51e0 con 0x7f44780051d0 2024-05-30T16:58:30.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f447800c180 con 0x7f44780039c0 2024-05-30T16:58:30.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4494a00640 1 --2- 172.21.15.59:0/4132022127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44780039c0 0x7f4478003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4495400640 1 --2- 172.21.15.59:0/4132022127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44780051d0 0x7f447800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4494a00640 1 -- 172.21.15.59:0/4132022127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44780051d0 msgr2=0x7f447800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:30.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4494a00640 1 --2- 172.21.15.59:0/4132022127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44780051d0 0x7f447800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4494a00640 1 -- 172.21.15.59:0/4132022127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4478004810 msgr2=0x7f4478004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:30.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4494a00640 1 --2- 172.21.15.59:0/4132022127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4478004810 0x7f4478004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.881+0000 7f4494a00640 1 -- 172.21.15.59:0/4132022127 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4478003530 con 0x7f44780039c0 2024-05-30T16:58:30.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.889+0000 7f4494a00640 1 --2- 172.21.15.59:0/4132022127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44780039c0 0x7f4478003da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f448400a7a0 tx=0x7f448401d2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2d91c2acc2eea13 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:30.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.889+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448400a3f0 con 0x7f44780039c0 2024-05-30T16:58:30.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.889+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44840ad650 con 0x7f44780039c0 2024-05-30T16:58:30.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.889+0000 7f448f400640 1 -- 172.21.15.59:0/4132022127 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44840ada40 con 0x7f44780039c0 2024-05-30T16:58:30.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.889+0000 7f4495e00640 1 -- 172.21.15.59:0/4132022127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44780039c0 msgr2=0x7f4478003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:30.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.889+0000 7f4495e00640 1 --2- 172.21.15.59:0/4132022127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44780039c0 0x7f4478003da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f448400a7a0 tx=0x7f448401d2c0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.889+0000 7f4495400640 1 -- 172.21.15.59:0/4132022127 reap_dead start 2024-05-30T16:58:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.889+0000 7f4495e00640 1 -- 172.21.15.59:0/4132022127 shutdown_connections 2024-05-30T16:58:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.889+0000 7f4495e00640 1 -- 172.21.15.59:0/4132022127 >> 172.21.15.59:0/4132022127 conn(0x7f449006b9b0 msgr2=0x7f449006bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.889+0000 7f4495e00640 1 -- 172.21.15.59:0/4132022127 shutdown_connections 2024-05-30T16:58:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.889+0000 7f4495e00640 1 -- 172.21.15.59:0/4132022127 wait complete. 2024-05-30T16:58:30.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f4495e00640 1 Processor -- start 2024-05-30T16:58:30.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f4495e00640 1 -- start start 2024-05-30T16:58:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f4495e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44780039c0 0x7f4490162150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f4495e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f449013b1a0 0x7f449013bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f4495e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4490138ab0 0x7f4490152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f4495e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44900afca0 con 0x7f44780039c0 2024-05-30T16:58:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f4495e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f44900afb20 con 0x7f449013b1a0 2024-05-30T16:58:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f4495e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f44900afe20 con 0x7f4490138ab0 2024-05-30T16:58:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f4494a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44780039c0 0x7f4490162150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f4494a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44780039c0 0x7f4490162150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49490/0 (socket says 172.21.15.59:49490) 2024-05-30T16:58:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f4494a00640 1 -- 172.21.15.59:0/2742729524 learned_addr learned my addr 172.21.15.59:0/2742729524 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f448fe00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f449013b1a0 0x7f449013bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.893+0000 7f4495400640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4490138ab0 0x7f4490152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.897+0000 7f4494a00640 1 -- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4490138ab0 msgr2=0x7f4490152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:30.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.897+0000 7f4494a00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4490138ab0 0x7f4490152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.897+0000 7f4494a00640 1 -- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f449013b1a0 msgr2=0x7f449013bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:30.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.897+0000 7f4494a00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f449013b1a0 0x7f449013bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:30.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.897+0000 7f4494a00640 1 -- 172.21.15.59:0/2742729524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4490158520 con 0x7f44780039c0 2024-05-30T16:58:30.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.897+0000 7f4494a00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44780039c0 0x7f4490162150 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f448400a7a0 tx=0x7f4478005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:30.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.897+0000 7f448cc00640 1 -- 172.21.15.59:0/2742729524 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44840bd070 con 0x7f44780039c0 2024-05-30T16:58:30.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.897+0000 7f448cc00640 1 -- 172.21.15.59:0/2742729524 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4484001940 con 0x7f44780039c0 2024-05-30T16:58:30.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.897+0000 7f4495e00640 1 -- 172.21.15.59:0/2742729524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44901373e0 con 0x7f44780039c0 2024-05-30T16:58:30.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.897+0000 7f448cc00640 1 -- 172.21.15.59:0/2742729524 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44840b2040 con 0x7f44780039c0 2024-05-30T16:58:30.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.897+0000 7f4495e00640 1 -- 172.21.15.59:0/2742729524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4490157f60 con 0x7f44780039c0 2024-05-30T16:58:30.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.901+0000 7f4495e00640 1 -- 172.21.15.59:0/2742729524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449006c9b0 con 0x7f44780039c0 2024-05-30T16:58:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.901+0000 7f448cc00640 1 -- 172.21.15.59:0/2742729524 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f44840c0070 con 0x7f44780039c0 2024-05-30T16:58:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.905+0000 7f448cc00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4470069560 0x7f447006ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.905+0000 7f448cc00640 1 -- 172.21.15.59:0/2742729524 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f4484120060 con 0x7f44780039c0 2024-05-30T16:58:30.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.905+0000 7f448fe00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4470069560 0x7f447006ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:30.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.909+0000 7f448cc00640 1 -- 172.21.15.59:0/2742729524 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4484016fd0 con 0x7f44780039c0 2024-05-30T16:58:30.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:30.917+0000 7f448fe00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4470069560 0x7f447006ba20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f44901651b0 tx=0x7f447c009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.181+0000 7f4495e00640 1 -- 172.21.15.59:0/2742729524 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone698820", "target": ["mon-mgr", ""]}) -- 0x7f44900691a0 con 0x7f4470069560 2024-05-30T16:58:31.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f448cc00640 1 -- 172.21.15.59:0/2742729524 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f44900691a0 con 0x7f4470069560 2024-05-30T16:58:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f4495e00640 1 -- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4470069560 msgr2=0x7f447006ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f4495e00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4470069560 0x7f447006ba20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f44901651b0 tx=0x7f447c009110 comp rx=0 tx=0).stop 2024-05-30T16:58:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f4495e00640 1 -- 172.21.15.59:0/2742729524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44780039c0 msgr2=0x7f4490162150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f4495e00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44780039c0 0x7f4490162150 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f448400a7a0 tx=0x7f4478005840 comp rx=0 tx=0).stop 2024-05-30T16:58:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f4495e00640 1 -- 172.21.15.59:0/2742729524 shutdown_connections 2024-05-30T16:58:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f4495e00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4470069560 0x7f447006ba20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f4495e00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4490138ab0 0x7f4490152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f4495e00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f449013b1a0 0x7f449013bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f4495e00640 1 --2- 172.21.15.59:0/2742729524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44780039c0 0x7f4490162150 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f4495e00640 1 -- 172.21.15.59:0/2742729524 >> 172.21.15.59:0/2742729524 conn(0x7f449006b9b0 msgr2=0x7f449006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f4495e00640 1 -- 172.21.15.59:0/2742729524 shutdown_connections 2024-05-30T16:58:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.393+0000 7f4495e00640 1 -- 172.21.15.59:0/2742729524 wait complete. 2024-05-30T16:58:31.415 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:58:31.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e8600640 1 Processor -- start 2024-05-30T16:58:31.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e8600640 1 -- start start 2024-05-30T16:58:31.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e8600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2e00af720 0x7fd2e015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e8600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd2e006e900 0x7fd2e015f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e8600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2e00d0560 0x7fd2e00d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e8600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e015f060 con 0x7fd2e00af720 2024-05-30T16:58:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e8600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e00afb00 con 0x7fd2e006e900 2024-05-30T16:58:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e8600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e015c270 con 0x7fd2e00d0560 2024-05-30T16:58:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e5c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2e00af720 0x7fd2e015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e5c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2e00af720 0x7fd2e015b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49496/0 (socket says 172.21.15.59:49496) 2024-05-30T16:58:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e5c00640 1 -- 172.21.15.59:0/1316361363 learned_addr learned my addr 172.21.15.59:0/1316361363 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e5200640 1 --2- 172.21.15.59:0/1316361363 >> v2:172.21.15.107:3300/0 conn(0x7fd2e006e900 0x7fd2e015f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.557+0000 7fd2e6600640 1 --2- 172.21.15.59:0/1316361363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2e00d0560 0x7fd2e00d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.561+0000 7fd2e5c00640 1 -- 172.21.15.59:0/1316361363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2e00d0560 msgr2=0x7fd2e00d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.561+0000 7fd2e5c00640 1 --2- 172.21.15.59:0/1316361363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2e00d0560 0x7fd2e00d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.561+0000 7fd2e5c00640 1 -- 172.21.15.59:0/1316361363 >> v2:172.21.15.107:3300/0 conn(0x7fd2e006e900 msgr2=0x7fd2e015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.561+0000 7fd2e5c00640 1 --2- 172.21.15.59:0/1316361363 >> v2:172.21.15.107:3300/0 conn(0x7fd2e006e900 0x7fd2e015f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.561+0000 7fd2e5c00640 1 -- 172.21.15.59:0/1316361363 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e015c550 con 0x7fd2e00af720 2024-05-30T16:58:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.561+0000 7fd2e5c00640 1 --2- 172.21.15.59:0/1316361363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e00af720 0x7fd2e015b9d0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00b5410 tx=0x7fd2d401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd215f245f5890f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.561+0000 7fd2dfe00640 1 -- 172.21.15.59:0/1316361363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40b4070 con 0x7fd2e00af720 2024-05-30T16:58:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.561+0000 7fd2dfe00640 1 -- 172.21.15.59:0/1316361363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d40a7a80 con 0x7fd2e00af720 2024-05-30T16:58:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.561+0000 7fd2dfe00640 1 -- 172.21.15.59:0/1316361363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40a7e50 con 0x7fd2e00af720 2024-05-30T16:58:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 -- 172.21.15.59:0/1316361363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e00af720 msgr2=0x7fd2e015b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 --2- 172.21.15.59:0/1316361363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e00af720 0x7fd2e015b9d0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00b5410 tx=0x7fd2d401ebf0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 -- 172.21.15.59:0/1316361363 shutdown_connections 2024-05-30T16:58:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 --2- 172.21.15.59:0/1316361363 >> v2:172.21.15.107:3300/0 conn(0x7fd2e006e900 0x7fd2e015f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 --2- 172.21.15.59:0/1316361363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2e00d0560 0x7fd2e00d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 --2- 172.21.15.59:0/1316361363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e00af720 0x7fd2e015b9d0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 -- 172.21.15.59:0/1316361363 >> 172.21.15.59:0/1316361363 conn(0x7fd2e00b22d0 msgr2=0x7fd2e00b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 -- 172.21.15.59:0/1316361363 shutdown_connections 2024-05-30T16:58:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 -- 172.21.15.59:0/1316361363 wait complete. 2024-05-30T16:58:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 Processor -- start 2024-05-30T16:58:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 -- start start 2024-05-30T16:58:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2e006e900 0x7fd2e00b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e00af720 0x7fd2e0153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2e00d0560 0x7fd2e014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e015feb0 con 0x7fd2e00af720 2024-05-30T16:58:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e015fd30 con 0x7fd2e00d0560 2024-05-30T16:58:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e8600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e0073150 con 0x7fd2e006e900 2024-05-30T16:58:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e00af720 0x7fd2e0153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e00af720 0x7fd2e0153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49512/0 (socket says 172.21.15.59:49512) 2024-05-30T16:58:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e5200640 1 -- 172.21.15.59:0/555457107 learned_addr learned my addr 172.21.15.59:0/555457107 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e5c00640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2e006e900 0x7fd2e00b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e6600640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2e00d0560 0x7fd2e014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e5200640 1 -- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2e006e900 msgr2=0x7fd2e00b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e5200640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2e006e900 0x7fd2e00b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e5200640 1 -- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2e00d0560 msgr2=0x7fd2e014d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e5200640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2e00d0560 0x7fd2e014d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.565+0000 7fd2e5200640 1 -- 172.21.15.59:0/555457107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e0155fd0 con 0x7fd2e00af720 2024-05-30T16:58:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.569+0000 7fd2e5200640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e00af720 0x7fd2e0153820 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00e840 tx=0x7fd2cc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.569+0000 7fd2dd600640 1 -- 172.21.15.59:0/555457107 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc017070 con 0x7fd2e00af720 2024-05-30T16:58:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.569+0000 7fd2dd600640 1 -- 172.21.15.59:0/555457107 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc004020 con 0x7fd2e00af720 2024-05-30T16:58:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.569+0000 7fd2dd600640 1 -- 172.21.15.59:0/555457107 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc004430 con 0x7fd2e00af720 2024-05-30T16:58:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.569+0000 7fd2e8600640 1 -- 172.21.15.59:0/555457107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e015ea60 con 0x7fd2e00af720 2024-05-30T16:58:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.569+0000 7fd2e8600640 1 -- 172.21.15.59:0/555457107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e0155cf0 con 0x7fd2e00af720 2024-05-30T16:58:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.569+0000 7fd2e8600640 1 -- 172.21.15.59:0/555457107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e0068a90 con 0x7fd2e00af720 2024-05-30T16:58:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.569+0000 7fd2dd600640 1 -- 172.21.15.59:0/555457107 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7fd2cc00c730 con 0x7fd2e00af720 2024-05-30T16:58:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.569+0000 7fd2dd600640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd2c0069460 0x7fd2c006b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.569+0000 7fd2dd600640 1 -- 172.21.15.59:0/555457107 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fd2cc085290 con 0x7fd2e00af720 2024-05-30T16:58:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.569+0000 7fd2e5c00640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd2c0069460 0x7fd2c006b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.573+0000 7fd2e5c00640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd2c0069460 0x7fd2c006b920 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40b1000 tx=0x7fd2d40a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:31.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.573+0000 7fd2dd600640 1 -- 172.21.15.59:0/555457107 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd2cc056bc0 con 0x7fd2e00af720 2024-05-30T16:58:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.765+0000 7fd2e8600640 1 -- 172.21.15.59:0/555457107 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fd2e015ed40 con 0x7fd2c0069460 2024-05-30T16:58:31.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.765+0000 7fd2dd600640 1 -- 172.21.15.59:0/555457107 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fd2d40a7900 con 0x7fd2c0069460 2024-05-30T16:58:31.766 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:58:31.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:31.766 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T16:58:31.766 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:31.766 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:58:31.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.769+0000 7fd2e8600640 1 -- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd2c0069460 msgr2=0x7fd2c006b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.769+0000 7fd2e8600640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd2c0069460 0x7fd2c006b920 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40b1000 tx=0x7fd2d40a9070 comp rx=0 tx=0).stop 2024-05-30T16:58:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.769+0000 7fd2e8600640 1 -- 172.21.15.59:0/555457107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e00af720 msgr2=0x7fd2e0153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.769+0000 7fd2e8600640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e00af720 0x7fd2e0153820 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00e840 tx=0x7fd2cc00ed00 comp rx=0 tx=0).stop 2024-05-30T16:58:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.769+0000 7fd2e8600640 1 -- 172.21.15.59:0/555457107 shutdown_connections 2024-05-30T16:58:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.769+0000 7fd2e8600640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd2c0069460 0x7fd2c006b920 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.769+0000 7fd2e8600640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2e00d0560 0x7fd2e014d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.769+0000 7fd2e8600640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e00af720 0x7fd2e0153820 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.769+0000 7fd2e8600640 1 --2- 172.21.15.59:0/555457107 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2e006e900 0x7fd2e00b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.769+0000 7fd2e8600640 1 -- 172.21.15.59:0/555457107 >> 172.21.15.59:0/555457107 conn(0x7fd2e00b22d0 msgr2=0x7fd2e006f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.769+0000 7fd2e8600640 1 -- 172.21.15.59:0/555457107 shutdown_connections 2024-05-30T16:58:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.769+0000 7fd2e8600640 1 -- 172.21.15.59:0/555457107 wait complete. 2024-05-30T16:58:31.788 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:58:31.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f266d200640 1 Processor -- start 2024-05-30T16:58:31.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f266d200640 1 -- start start 2024-05-30T16:58:31.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f266d200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26680d0ea0 0x7f266806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f266d200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f26680cddf0 0x7f26680cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f266d200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f266806c830 con 0x7f266815c5f0 2024-05-30T16:58:31.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f266d200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f266806bf90 con 0x7f26680cddf0 2024-05-30T16:58:31.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f266d200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f266806c270 con 0x7f26680d0ea0 2024-05-30T16:58:31.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f2666800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f26680cddf0 0x7f26680cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f2666800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f26680cddf0 0x7f26680cce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59380/0 (socket says 172.21.15.59:59380) 2024-05-30T16:58:31.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f2665e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f266815c5f0 0x7f26680d0790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41438/0 (socket says 172.21.15.59:41438) 2024-05-30T16:58:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f2666800640 1 -- 172.21.15.59:0/2961182434 learned_addr learned my addr 172.21.15.59:0/2961182434 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f265d400640 1 --2- 172.21.15.59:0/2961182434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26680d0ea0 0x7f266806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f2666800640 1 -- 172.21.15.59:0/2961182434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26680d0ea0 msgr2=0x7f266806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f2666800640 1 --2- 172.21.15.59:0/2961182434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26680d0ea0 0x7f266806b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f2666800640 1 -- 172.21.15.59:0/2961182434 >> v1:172.21.15.59:6789/0 conn(0x7f266815c5f0 legacy=0x7f26680d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.929+0000 7f2666800640 1 -- 172.21.15.59:0/2961182434 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266806c550 con 0x7f26680cddf0 2024-05-30T16:58:31.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.933+0000 7f2666800640 1 --2- 172.21.15.59:0/2961182434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26680cddf0 0x7f26680cce50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2660009870 tx=0x7f266001cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b7dac31c19ccf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:31.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.933+0000 7f2665400640 1 -- 172.21.15.59:0/2961182434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26600a9610 con 0x7f26680cddf0 2024-05-30T16:58:31.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.933+0000 7f2665400640 1 -- 172.21.15.59:0/2961182434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26600a97b0 con 0x7f26680cddf0 2024-05-30T16:58:31.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.933+0000 7f2665400640 1 -- 172.21.15.59:0/2961182434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26600a9b80 con 0x7f26680cddf0 2024-05-30T16:58:31.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.933+0000 7f266d200640 1 -- 172.21.15.59:0/2961182434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26680cddf0 msgr2=0x7f26680cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:31.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.933+0000 7f266d200640 1 --2- 172.21.15.59:0/2961182434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26680cddf0 0x7f26680cce50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2660009870 tx=0x7f266001cf90 comp rx=0 tx=0).stop 2024-05-30T16:58:31.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.933+0000 7f266d200640 1 -- 172.21.15.59:0/2961182434 shutdown_connections 2024-05-30T16:58:31.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.933+0000 7f266d200640 1 --2- 172.21.15.59:0/2961182434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26680cddf0 0x7f26680cce50 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.933+0000 7f266d200640 1 --2- 172.21.15.59:0/2961182434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26680d0ea0 0x7f266806b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.933+0000 7f266d200640 1 -- 172.21.15.59:0/2961182434 >> 172.21.15.59:0/2961182434 conn(0x7f266809aa40 msgr2=0x7f26680b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:31.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.933+0000 7f266d200640 1 -- 172.21.15.59:0/2961182434 shutdown_connections 2024-05-30T16:58:31.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.933+0000 7f266d200640 1 -- 172.21.15.59:0/2961182434 wait complete. 2024-05-30T16:58:31.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f266d200640 1 Processor -- start 2024-05-30T16:58:31.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f266d200640 1 -- start start 2024-05-30T16:58:31.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f266d200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26680cddf0 0x7f2668153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f266d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26680d0ea0 0x7f2668152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f266d200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f266815c5f0 0x7f266806ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f266d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f266815d360 con 0x7f26680d0ea0 2024-05-30T16:58:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f266d200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f266815d1e0 con 0x7f26680cddf0 2024-05-30T16:58:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f266d200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2668169290 con 0x7f266815c5f0 2024-05-30T16:58:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f265d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26680d0ea0 0x7f2668152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f265d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26680d0ea0 0x7f2668152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59386/0 (socket says 172.21.15.59:59386) 2024-05-30T16:58:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f265d400640 1 -- 172.21.15.59:0/3016831917 learned_addr learned my addr 172.21.15.59:0/3016831917 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f2665e00640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26680cddf0 0x7f2668153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f2666800640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f266815c5f0 0x7f266806ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f265d400640 1 -- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f266815c5f0 msgr2=0x7f266806ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f265d400640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f266815c5f0 0x7f266806ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f265d400640 1 -- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26680cddf0 msgr2=0x7f2668153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:31.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f265d400640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26680cddf0 0x7f2668153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:31.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f265d400640 1 -- 172.21.15.59:0/3016831917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26681534f0 con 0x7f26680d0ea0 2024-05-30T16:58:31.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f2665e00640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26680cddf0 0x7f2668153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:58:31.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f265d400640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26680d0ea0 0x7f2668152fb0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2650007ec0 tx=0x7f265000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:31.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f265ea00640 1 -- 172.21.15.59:0/3016831917 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2650014620 con 0x7f26680d0ea0 2024-05-30T16:58:31.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f265ea00640 1 -- 172.21.15.59:0/3016831917 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2650019070 con 0x7f26680d0ea0 2024-05-30T16:58:31.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f265ea00640 1 -- 172.21.15.59:0/3016831917 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2650014a00 con 0x7f26680d0ea0 2024-05-30T16:58:31.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f266d200640 1 -- 172.21.15.59:0/3016831917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26680b4490 con 0x7f26680d0ea0 2024-05-30T16:58:31.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.937+0000 7f266d200640 1 -- 172.21.15.59:0/3016831917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26680b4a50 con 0x7f26680d0ea0 2024-05-30T16:58:31.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.941+0000 7f266d200640 1 -- 172.21.15.59:0/3016831917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2668068a90 con 0x7f26680d0ea0 2024-05-30T16:58:31.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.941+0000 7f265ea00640 1 -- 172.21.15.59:0/3016831917 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f2650014ba0 con 0x7f26680d0ea0 2024-05-30T16:58:31.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.941+0000 7f265ea00640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2644069460 0x7f264406b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:31.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.941+0000 7f265ea00640 1 -- 172.21.15.59:0/3016831917 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f2650085d30 con 0x7f26680d0ea0 2024-05-30T16:58:31.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.941+0000 7f2665e00640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2644069460 0x7f264406b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:31.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.941+0000 7f2665e00640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2644069460 0x7f264406b920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2658000f70 tx=0x7f2658007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:31.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:31.945+0000 7f265ea00640 1 -- 172.21.15.59:0/3016831917 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2650057da0 con 0x7f26680d0ea0 2024-05-30T16:58:32.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 -- 172.21.15.59:0/3016831917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2668155390 con 0x7f26680d0ea0 2024-05-30T16:58:32.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f265ea00640 1 -- 172.21.15.59:0/3016831917 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2420 (secure 0 0 0) 0x7f26500576a0 con 0x7f26680d0ea0 2024-05-30T16:58:32.173 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:58:32.173 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:58:32.173 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:58:32.173 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:58:32.173 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:58:32.173 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:58:32.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:58:32.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:32.173 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:58:32.173 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 592, 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:58:32.174 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:58:32.175 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:58:32.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:32.175 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:58:32.175 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 77, 2024-05-30T16:58:32.175 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:58:32.175 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:58:32.175 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:58:32.175 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:58:32.175 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:58:32.175 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:58:32.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:32.175 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 10852, 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 45298603060, 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 90455019520, 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 682639093760, 2024-05-30T16:58:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:58:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 561959807, 2024-05-30T16:58:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 555735192, 2024-05-30T16:58:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 138, 2024-05-30T16:58:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 152 2024-05-30T16:58:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:58:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 43, 2024-05-30T16:58:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5, 2024-05-30T16:58:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:58:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:58:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:58:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 5, 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "b", 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 6528 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:58:32.178 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 12, 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:57:51.243602+0000", 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:58:32.179 INFO:teuthology.orchestra.run.smithi059.stdout: "328dea24-359f-412d-91f5-463eae2a6988": { 2024-05-30T16:58:32.180 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "1 ongoing+pending clones; Avg progress is 23.958% (58s)\n [======......................] (remaining: 3m)", 2024-05-30T16:58:32.180 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.23958000540733337, 2024-05-30T16:58:32.180 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:32.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:32.180 INFO:teuthology.orchestra.run.smithi059.stdout: "a2307bae-c24f-47e3-a595-961c250f4339": { 2024-05-30T16:58:32.180 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "1 ongoing clones; Avg progress is 23.958% (64s)\n [======......................] (remaining: 3m)", 2024-05-30T16:58:32.180 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.23958000540733337, 2024-05-30T16:58:32.180 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:32.180 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:32.180 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:32.180 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:58:32.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 -- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2644069460 msgr2=0x7f264406b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:32.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2644069460 0x7f264406b920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2658000f70 tx=0x7f2658007d70 comp rx=0 tx=0).stop 2024-05-30T16:58:32.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 -- 172.21.15.59:0/3016831917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26680d0ea0 msgr2=0x7f2668152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:32.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26680d0ea0 0x7f2668152fb0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2650007ec0 tx=0x7f265000e4b0 comp rx=0 tx=0).stop 2024-05-30T16:58:32.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 -- 172.21.15.59:0/3016831917 shutdown_connections 2024-05-30T16:58:32.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2644069460 0x7f264406b920 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:32.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f266815c5f0 0x7f266806ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:32.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26680d0ea0 0x7f2668152fb0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:32.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 --2- 172.21.15.59:0/3016831917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26680cddf0 0x7f2668153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:32.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 -- 172.21.15.59:0/3016831917 >> 172.21.15.59:0/3016831917 conn(0x7f266809aa40 msgr2=0x7f2668157a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:32.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 -- 172.21.15.59:0/3016831917 shutdown_connections 2024-05-30T16:58:32.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:32.173+0000 7f266d200640 1 -- 172.21.15.59:0/3016831917 wait complete. 2024-05-30T16:58:34.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:58:34.918 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:58:37.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:58:37.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.345+0000 7f0790e00640 1 Processor -- start 2024-05-30T16:58:37.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.345+0000 7f0790e00640 1 -- start start 2024-05-30T16:58:37.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f0790e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f078c15e770 0x7f078c06fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:37.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f0790e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c0afe30 0x7f078c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:37.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f0790e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078c06f080 con 0x7f078c0b4140 2024-05-30T16:58:37.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f0790e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f078c06f360 con 0x7f078c15e770 2024-05-30T16:58:37.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f0790e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f078c06f640 con 0x7f078c0afe30 2024-05-30T16:58:37.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f078c0b4140 0x7f078c1622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41452/0 (socket says 172.21.15.59:41452) 2024-05-30T16:58:37.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078be00640 1 -- 172.21.15.59:0/3540187734 learned_addr learned my addr 172.21.15.59:0/3540187734 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:58:37.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078b400640 1 --2- 172.21.15.59:0/3540187734 >> v2:172.21.15.107:3300/0 conn(0x7f078c15e770 0x7f078c06fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:37.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f0783e00640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c0afe30 0x7f078c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:37.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 877573050 0 0) 0x7f078c06f080 con 0x7f078c0b4140 2024-05-30T16:58:37.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0770003530 con 0x7f078c0b4140 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 593162860 0 0) 0x7f0770003530 con 0x7f078c0b4140 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c0afe30 msgr2=0x7f078c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c0afe30 0x7f078c0b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 >> v2:172.21.15.107:3300/0 conn(0x7f078c15e770 msgr2=0x7f078c06fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 --2- 172.21.15.59:0/3540187734 >> v2:172.21.15.107:3300/0 conn(0x7f078c15e770 0x7f078c06fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c06f920 con 0x7f078c0b4140 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f0784001a00 con 0x7f078c0b4140 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 >> v1:172.21.15.59:6789/0 conn(0x7f078c0b4140 legacy=0x7f078c1622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07700039c0 0x7f0770003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0770004810 0x7f0770004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c0afe30 0x7f07700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f078c06f360 con 0x7f0770004810 2024-05-30T16:58:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f078c06f640 con 0x7f07700039c0 2024-05-30T16:58:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f077000ba00 con 0x7f078c0afe30 2024-05-30T16:58:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f0783e00640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0770004810 0x7f0770004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078b400640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07700039c0 0x7f0770003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078be00640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c0afe30 0x7f07700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f0783e00640 1 -- 172.21.15.59:0/3540187734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c0afe30 msgr2=0x7f07700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f0783e00640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c0afe30 0x7f07700051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f0783e00640 1 -- 172.21.15.59:0/3540187734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07700039c0 msgr2=0x7f0770003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f0783e00640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07700039c0 0x7f0770003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f0783e00640 1 -- 172.21.15.59:0/3540187734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0770003530 con 0x7f0770004810 2024-05-30T16:58:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.349+0000 7f078be00640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c0afe30 0x7f07700051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:58:37.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f0783e00640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0770004810 0x7f0770004c90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0774009ab0 tx=0x7f077401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7cdf08ec3c80b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:37.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07740b2070 con 0x7f0770004810 2024-05-30T16:58:37.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07740a5560 con 0x7f0770004810 2024-05-30T16:58:37.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f078aa00640 1 -- 172.21.15.59:0/3540187734 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07740096b0 con 0x7f0770004810 2024-05-30T16:58:37.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f0790e00640 1 -- 172.21.15.59:0/3540187734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0770004810 msgr2=0x7f0770004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:37.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f0790e00640 1 --2- 172.21.15.59:0/3540187734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0770004810 0x7f0770004c90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0774009ab0 tx=0x7f077401ca50 comp rx=0 tx=0).stop 2024-05-30T16:58:37.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f078be00640 1 -- 172.21.15.59:0/3540187734 reap_dead start 2024-05-30T16:58:37.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f0790e00640 1 -- 172.21.15.59:0/3540187734 shutdown_connections 2024-05-30T16:58:37.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f0790e00640 1 -- 172.21.15.59:0/3540187734 >> 172.21.15.59:0/3540187734 conn(0x7f078c073410 msgr2=0x7f078c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:37.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f0790e00640 1 -- 172.21.15.59:0/3540187734 shutdown_connections 2024-05-30T16:58:37.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f0790e00640 1 -- 172.21.15.59:0/3540187734 wait complete. 2024-05-30T16:58:37.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f0790e00640 1 Processor -- start 2024-05-30T16:58:37.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.353+0000 7f0790e00640 1 -- start start 2024-05-30T16:58:37.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0790e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0770004810 0x7f078c1f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:37.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0790e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078c144d90 0x7f078c1451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:37.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0790e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c145730 0x7f078c15c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:37.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0790e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f078c070380 con 0x7f078c144d90 2024-05-30T16:58:37.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0790e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f078c15eb50 con 0x7f0770004810 2024-05-30T16:58:37.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0790e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f078c067b40 con 0x7f078c145730 2024-05-30T16:58:37.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0783e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078c144d90 0x7f078c1451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:37.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0783e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078c144d90 0x7f078c1451f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59404/0 (socket says 172.21.15.59:59404) 2024-05-30T16:58:37.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0783e00640 1 -- 172.21.15.59:0/2294191247 learned_addr learned my addr 172.21.15.59:0/2294191247 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:37.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f078b400640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0770004810 0x7f078c1f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:37.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f078be00640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c145730 0x7f078c15c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:37.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0783e00640 1 -- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c145730 msgr2=0x7f078c15c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:37.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0783e00640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c145730 0x7f078c15c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:37.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0783e00640 1 -- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0770004810 msgr2=0x7f078c1f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:37.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0783e00640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0770004810 0x7f078c1f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:37.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0783e00640 1 -- 172.21.15.59:0/2294191247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c145ed0 con 0x7f078c144d90 2024-05-30T16:58:37.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f078b400640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0770004810 0x7f078c1f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:58:37.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0783e00640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078c144d90 0x7f078c1451f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0774009ab0 tx=0x7f0770005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:37.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0783400640 1 -- 172.21.15.59:0/2294191247 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07740be070 con 0x7f078c144d90 2024-05-30T16:58:37.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0783400640 1 -- 172.21.15.59:0/2294191247 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07740ad440 con 0x7f078c144d90 2024-05-30T16:58:37.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0783400640 1 -- 172.21.15.59:0/2294191247 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07740b2040 con 0x7f078c144d90 2024-05-30T16:58:37.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0790e00640 1 -- 172.21.15.59:0/2294191247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078c145bc0 con 0x7f078c144d90 2024-05-30T16:58:37.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0790e00640 1 -- 172.21.15.59:0/2294191247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f078c15b560 con 0x7f078c144d90 2024-05-30T16:58:37.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.357+0000 7f0790e00640 1 -- 172.21.15.59:0/2294191247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f078c0691a0 con 0x7f078c144d90 2024-05-30T16:58:37.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.361+0000 7f0783400640 1 -- 172.21.15.59:0/2294191247 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f07740c1070 con 0x7f078c144d90 2024-05-30T16:58:37.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.361+0000 7f0783400640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0768069460 0x7f076806b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:37.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.361+0000 7f0783400640 1 -- 172.21.15.59:0/2294191247 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f077411f5e0 con 0x7f078c144d90 2024-05-30T16:58:37.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.361+0000 7f078b400640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0768069460 0x7f076806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:37.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.361+0000 7f078b400640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0768069460 0x7f076806b920 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f077c009c60 tx=0x7f077c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:37.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.365+0000 7f0783400640 1 -- 172.21.15.59:0/2294191247 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0774016760 con 0x7f078c144d90 2024-05-30T16:58:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.589+0000 7f0790e00640 1 -- 172.21.15.59:0/2294191247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f078c06d280 con 0x7f078c144d90 2024-05-30T16:58:37.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.589+0000 7f0783400640 1 -- 172.21.15.59:0/2294191247 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2380 (secure 0 0 0) 0x7f07740f0ca0 con 0x7f078c144d90 2024-05-30T16:58:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:58:37.592 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:58:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:58:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:58:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:58:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:58:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:58:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:58:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:58:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:58:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:58:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:58:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:58:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:58:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:58:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:58:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 597, 2024-05-30T16:58:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:58:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:58:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:58:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:58:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:58:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 77, 2024-05-30T16:58:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:58:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:58:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:58:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:58:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:58:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:58:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:58:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:58:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:58:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:58:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:58:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 11452, 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 47811295316, 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 96067772416, 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 677026340864, 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 486443574, 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 486152429, 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 120, 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 135 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 43, 2024-05-30T16:58:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5, 2024-05-30T16:58:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:58:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:58:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:58:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:58:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 5, 2024-05-30T16:58:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:58:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "b", 2024-05-30T16:58:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:58:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 6528 2024-05-30T16:58:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 12, 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:57:51.243602+0000", 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "328dea24-359f-412d-91f5-463eae2a6988": { 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 27.0 seconds before exiting (62s)\n [============================] ", 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "a2307bae-c24f-47e3-a595-961c250f4339": { 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 27.0 seconds before exiting (68s)\n [============================] ", 2024-05-30T16:58:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:58:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:37.600 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:58:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.593+0000 7f0790e00640 1 -- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0768069460 msgr2=0x7f076806b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.593+0000 7f0790e00640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0768069460 0x7f076806b920 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f077c009c60 tx=0x7f077c008040 comp rx=0 tx=0).stop 2024-05-30T16:58:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.593+0000 7f0790e00640 1 -- 172.21.15.59:0/2294191247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078c144d90 msgr2=0x7f078c1451f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.593+0000 7f0790e00640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078c144d90 0x7f078c1451f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0774009ab0 tx=0x7f0770005840 comp rx=0 tx=0).stop 2024-05-30T16:58:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.593+0000 7f0790e00640 1 -- 172.21.15.59:0/2294191247 shutdown_connections 2024-05-30T16:58:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.593+0000 7f0790e00640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0768069460 0x7f076806b920 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.593+0000 7f0790e00640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f078c145730 0x7f078c15c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.593+0000 7f0790e00640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078c144d90 0x7f078c1451f0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.593+0000 7f0790e00640 1 --2- 172.21.15.59:0/2294191247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0770004810 0x7f078c1f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.593+0000 7f0790e00640 1 -- 172.21.15.59:0/2294191247 >> 172.21.15.59:0/2294191247 conn(0x7f078c073410 msgr2=0x7f078c161010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.593+0000 7f0790e00640 1 -- 172.21.15.59:0/2294191247 shutdown_connections 2024-05-30T16:58:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:37.593+0000 7f0790e00640 1 -- 172.21.15.59:0/2294191247 wait complete. 2024-05-30T16:58:42.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:58:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.765+0000 7f87ea400640 1 Processor -- start 2024-05-30T16:58:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.765+0000 7f87ea400640 1 -- start start 2024-05-30T16:58:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87ea400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87e41558e0 0x7f87e40b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87ea400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f87e406f8c0 0x7f87e415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87ea400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e406de10 con 0x7f87e415f4c0 2024-05-30T16:58:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87ea400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f87e415f910 con 0x7f87e41558e0 2024-05-30T16:58:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87ea400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f87e406e0f0 con 0x7f87e406f8c0 2024-05-30T16:58:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87e3400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87e41558e0 0x7f87e40b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87e3400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87e41558e0 0x7f87e40b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38256/0 (socket says 172.21.15.59:38256) 2024-05-30T16:58:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87e3400640 1 -- 172.21.15.59:0/234055487 learned_addr learned my addr 172.21.15.59:0/234055487 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:42.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87e3e00640 1 --1- 172.21.15.59:0/234055487 >> v1:172.21.15.59:6789/0 conn(0x7f87e415f4c0 0x7f87e415b990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39632/0 (socket says 172.21.15.59:39632) 2024-05-30T16:58:42.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87daa00640 1 --2- 172.21.15.59:0/234055487 >> v2:172.21.15.107:3300/0 conn(0x7f87e406f8c0 0x7f87e415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:42.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87e3400640 1 -- 172.21.15.59:0/234055487 >> v2:172.21.15.107:3300/0 conn(0x7f87e406f8c0 msgr2=0x7f87e415ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:42.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87e3400640 1 --2- 172.21.15.59:0/234055487 >> v2:172.21.15.107:3300/0 conn(0x7f87e406f8c0 0x7f87e415ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:42.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87e3400640 1 -- 172.21.15.59:0/234055487 >> v1:172.21.15.59:6789/0 conn(0x7f87e415f4c0 legacy=0x7f87e415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:42.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.769+0000 7f87e3400640 1 -- 172.21.15.59:0/234055487 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e406e3d0 con 0x7f87e41558e0 2024-05-30T16:58:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87e3400640 1 --2- 172.21.15.59:0/234055487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e41558e0 0x7f87e40b3e30 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f87e4073090 tx=0x7f87d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ffba16702656a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87e2a00640 1 -- 172.21.15.59:0/234055487 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d40b1070 con 0x7f87e41558e0 2024-05-30T16:58:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87e2a00640 1 -- 172.21.15.59:0/234055487 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d40ac600 con 0x7f87e41558e0 2024-05-30T16:58:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87e2a00640 1 -- 172.21.15.59:0/234055487 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d40ac9d0 con 0x7f87e41558e0 2024-05-30T16:58:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 -- 172.21.15.59:0/234055487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e41558e0 msgr2=0x7f87e40b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 --2- 172.21.15.59:0/234055487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e41558e0 0x7f87e40b3e30 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f87e4073090 tx=0x7f87d401c520 comp rx=0 tx=0).stop 2024-05-30T16:58:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 -- 172.21.15.59:0/234055487 shutdown_connections 2024-05-30T16:58:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 --2- 172.21.15.59:0/234055487 >> v2:172.21.15.107:3300/0 conn(0x7f87e406f8c0 0x7f87e415ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 --2- 172.21.15.59:0/234055487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e41558e0 0x7f87e40b3e30 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 -- 172.21.15.59:0/234055487 >> 172.21.15.59:0/234055487 conn(0x7f87e4067d60 msgr2=0x7f87e406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:42.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 -- 172.21.15.59:0/234055487 shutdown_connections 2024-05-30T16:58:42.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 -- 172.21.15.59:0/234055487 wait complete. 2024-05-30T16:58:42.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 Processor -- start 2024-05-30T16:58:42.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 -- start start 2024-05-30T16:58:42.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e406f8c0 0x7f87e40b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:42.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87e41558e0 0x7f87e414a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:42.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e415f4c0 0x7f87e414af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:42.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f87e406fca0 con 0x7f87e415f4c0 2024-05-30T16:58:42.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f87e40b56c0 con 0x7f87e406f8c0 2024-05-30T16:58:42.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.773+0000 7f87ea400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f87e4155cc0 con 0x7f87e41558e0 2024-05-30T16:58:42.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87e3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e415f4c0 0x7f87e414af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:42.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87e3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e415f4c0 0x7f87e414af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38264/0 (socket says 172.21.15.59:38264) 2024-05-30T16:58:42.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87e3e00640 1 -- 172.21.15.59:0/2432064918 learned_addr learned my addr 172.21.15.59:0/2432064918 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:42.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87e3400640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e406f8c0 0x7f87e40b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:42.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87daa00640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87e41558e0 0x7f87e414a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:42.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87e3e00640 1 -- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87e41558e0 msgr2=0x7f87e414a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:42.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87e3e00640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87e41558e0 0x7f87e414a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:42.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87e3e00640 1 -- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e406f8c0 msgr2=0x7f87e40b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:42.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87e3e00640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e406f8c0 0x7f87e40b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:42.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87e3e00640 1 -- 172.21.15.59:0/2432064918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e40cfad0 con 0x7f87e415f4c0 2024-05-30T16:58:42.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87e3e00640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e415f4c0 0x7f87e414af30 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00c730 tx=0x7f87dc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:42.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87dbe00640 1 -- 172.21.15.59:0/2432064918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc017070 con 0x7f87e415f4c0 2024-05-30T16:58:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87dbe00640 1 -- 172.21.15.59:0/2432064918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87dc00ce40 con 0x7f87e415f4c0 2024-05-30T16:58:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87dbe00640 1 -- 172.21.15.59:0/2432064918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc00a840 con 0x7f87e415f4c0 2024-05-30T16:58:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87ea400640 1 -- 172.21.15.59:0/2432064918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e4158c70 con 0x7f87e415f4c0 2024-05-30T16:58:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87ea400640 1 -- 172.21.15.59:0/2432064918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e40d0050 con 0x7f87e415f4c0 2024-05-30T16:58:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87ea400640 1 -- 172.21.15.59:0/2432064918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e4068a90 con 0x7f87e415f4c0 2024-05-30T16:58:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.777+0000 7f87dbe00640 1 -- 172.21.15.59:0/2432064918 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f87dc01a070 con 0x7f87e415f4c0 2024-05-30T16:58:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.781+0000 7f87dbe00640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f87c0069460 0x7f87c006b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.781+0000 7f87dbe00640 1 -- 172.21.15.59:0/2432064918 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f87dc084d60 con 0x7f87e415f4c0 2024-05-30T16:58:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.781+0000 7f87e3400640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f87c0069460 0x7f87c006b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.781+0000 7f87e3400640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f87c0069460 0x7f87c006b920 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f87d40ae000 tx=0x7f87d40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:42.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:42.785+0000 7f87dbe00640 1 -- 172.21.15.59:0/2432064918 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f87dc0563e0 con 0x7f87e415f4c0 2024-05-30T16:58:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.009+0000 7f87ea400640 1 -- 172.21.15.59:0/2432064918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f87e414bfd0 con 0x7f87e415f4c0 2024-05-30T16:58:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87dbe00640 1 -- 172.21.15.59:0/2432064918 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2378 (secure 0 0 0) 0x7f87dc05a6e0 con 0x7f87e415f4c0 2024-05-30T16:58:43.012 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:43.013 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:58:43.014 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:58:43.014 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:58:43.014 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:58:43.014 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:43.014 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 602, 2024-05-30T16:58:43.014 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:58:43.014 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:58:43.014 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:58:43.014 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:58:43.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:43.014 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 77, 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:58:43.015 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 11446, 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 47811355741, 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 96189476864, 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 676904636416, 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 201960189, 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 209331183, 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 50, 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 62 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:43.016 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 43, 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5, 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 5, 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "b", 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 6528 2024-05-30T16:58:43.017 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:43.018 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:43.018 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:58:43.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:43.018 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:58:43.018 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:58:43.018 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:58:43.018 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:58:43.018 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:58:43.018 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:58:43.018 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:58:43.018 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:43.018 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 12, 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:57:51.243602+0000", 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "328dea24-359f-412d-91f5-463eae2a6988": { 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 21.0 seconds before exiting (68s)\n [============================] ", 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "a2307bae-c24f-47e3-a595-961c250f4339": { 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 21.0 seconds before exiting (74s)\n [============================] ", 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:58:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:43.020 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:43.020 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:43.020 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:58:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87ea400640 1 -- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f87c0069460 msgr2=0x7f87c006b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87ea400640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f87c0069460 0x7f87c006b920 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f87d40ae000 tx=0x7f87d40a7000 comp rx=0 tx=0).stop 2024-05-30T16:58:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87ea400640 1 -- 172.21.15.59:0/2432064918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e415f4c0 msgr2=0x7f87e414af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87ea400640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e415f4c0 0x7f87e414af30 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00c730 tx=0x7f87dc00cbf0 comp rx=0 tx=0).stop 2024-05-30T16:58:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87ea400640 1 -- 172.21.15.59:0/2432064918 shutdown_connections 2024-05-30T16:58:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87ea400640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f87c0069460 0x7f87c006b920 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87ea400640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e415f4c0 0x7f87e414af30 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87ea400640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87e41558e0 0x7f87e414a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87ea400640 1 --2- 172.21.15.59:0/2432064918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e406f8c0 0x7f87e40b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87ea400640 1 -- 172.21.15.59:0/2432064918 >> 172.21.15.59:0/2432064918 conn(0x7f87e4067d60 msgr2=0x7f87e40b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87ea400640 1 -- 172.21.15.59:0/2432064918 shutdown_connections 2024-05-30T16:58:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:43.013+0000 7f87ea400640 1 -- 172.21.15.59:0/2432064918 wait complete. 2024-05-30T16:58:48.035 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:58:48.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.185+0000 7f806b000640 1 Processor -- start 2024-05-30T16:58:48.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.185+0000 7f806b000640 1 -- start start 2024-05-30T16:58:48.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f806b000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80640cd7a0 0x7f80640cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f806b000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f80640cdb80 0x7f806415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f806b000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f806415daf0 con 0x7f806406be40 2024-05-30T16:58:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f806b000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f806406b9b0 con 0x7f80640cdb80 2024-05-30T16:58:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f806b000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f80640cff10 con 0x7f80640cd7a0 2024-05-30T16:58:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f8069000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f806406be40 0x7f806406c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39640/0 (socket says 172.21.15.59:39640) 2024-05-30T16:58:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f8069000640 1 -- 172.21.15.59:0/2663120085 learned_addr learned my addr 172.21.15.59:0/2663120085 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:58:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f805be00640 1 --2- 172.21.15.59:0/2663120085 >> v2:172.21.15.107:3300/0 conn(0x7f80640cdb80 0x7f806415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f8063e00640 1 --2- 172.21.15.59:0/2663120085 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80640cd7a0 0x7f80640cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f8063400640 1 -- 172.21.15.59:0/2663120085 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 769155744 0 0) 0x7f805c0014a0 con 0x7f806406be40 2024-05-30T16:58:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f8063400640 1 -- 172.21.15.59:0/2663120085 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8048003530 con 0x7f806406be40 2024-05-30T16:58:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f8063e00640 1 -- 172.21.15.59:0/2663120085 >> v2:172.21.15.107:3300/0 conn(0x7f80640cdb80 msgr2=0x7f806415d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f8063e00640 1 --2- 172.21.15.59:0/2663120085 >> v2:172.21.15.107:3300/0 conn(0x7f80640cdb80 0x7f806415d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f8063400640 1 -- 172.21.15.59:0/2663120085 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1716379323 0 0) 0x7f8048003530 con 0x7f806406be40 2024-05-30T16:58:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f8063e00640 1 -- 172.21.15.59:0/2663120085 >> v1:172.21.15.59:6789/0 conn(0x7f806406be40 legacy=0x7f806406c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f8063e00640 1 -- 172.21.15.59:0/2663120085 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80640d01f0 con 0x7f80640cd7a0 2024-05-30T16:58:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.189+0000 7f805be00640 1 --2- 172.21.15.59:0/2663120085 >> v2:172.21.15.107:3300/0 conn(0x7f80640cdb80 0x7f806415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:58:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f8063e00640 1 --2- 172.21.15.59:0/2663120085 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80640cd7a0 0x7f80640cf870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f80540097c0 tx=0x7f805401c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5613172ba66153f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f8063400640 1 -- 172.21.15.59:0/2663120085 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80540b0070 con 0x7f80640cd7a0 2024-05-30T16:58:48.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f8063400640 1 -- 172.21.15.59:0/2663120085 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80540ab400 con 0x7f80640cd7a0 2024-05-30T16:58:48.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f8063400640 1 -- 172.21.15.59:0/2663120085 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c001bf0 con 0x7f80640cd7a0 2024-05-30T16:58:48.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 -- 172.21.15.59:0/2663120085 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80640cd7a0 msgr2=0x7f80640cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:48.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 --2- 172.21.15.59:0/2663120085 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80640cd7a0 0x7f80640cf870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f80540097c0 tx=0x7f805401c390 comp rx=0 tx=0).stop 2024-05-30T16:58:48.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 -- 172.21.15.59:0/2663120085 shutdown_connections 2024-05-30T16:58:48.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 --2- 172.21.15.59:0/2663120085 >> v2:172.21.15.107:3300/0 conn(0x7f80640cdb80 0x7f806415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:48.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 --2- 172.21.15.59:0/2663120085 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80640cd7a0 0x7f80640cf870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:48.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 -- 172.21.15.59:0/2663120085 >> 172.21.15.59:0/2663120085 conn(0x7f80640d0b10 msgr2=0x7f80640d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:48.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 -- 172.21.15.59:0/2663120085 shutdown_connections 2024-05-30T16:58:48.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 -- 172.21.15.59:0/2663120085 wait complete. 2024-05-30T16:58:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 Processor -- start 2024-05-30T16:58:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 -- start start 2024-05-30T16:58:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f806406be40 0x7f806414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640cd7a0 0x7f80641378b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80640cdb80 0x7f806414e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f80641692f0 con 0x7f80640cd7a0 2024-05-30T16:58:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8064169170 con 0x7f80640cdb80 2024-05-30T16:58:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.193+0000 7f806b000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8064169470 con 0x7f806406be40 2024-05-30T16:58:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f805be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640cd7a0 0x7f80641378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:48.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f805be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640cd7a0 0x7f80641378b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38272/0 (socket says 172.21.15.59:38272) 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f805be00640 1 -- 172.21.15.59:0/2774580584 learned_addr learned my addr 172.21.15.59:0/2774580584 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f8063e00640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f806406be40 0x7f806414e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f8069000640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80640cdb80 0x7f806414e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f805be00640 1 -- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f806406be40 msgr2=0x7f806414e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f805be00640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f806406be40 0x7f806414e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f805be00640 1 -- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80640cdb80 msgr2=0x7f806414e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f805be00640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80640cdb80 0x7f806414e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f805be00640 1 -- 172.21.15.59:0/2774580584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8064140be0 con 0x7f80640cd7a0 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f8069000640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80640cdb80 0x7f806414e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f805be00640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640cd7a0 0x7f80641378b0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f804c00e980 tx=0x7f804c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f8060c00640 1 -- 172.21.15.59:0/2774580584 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c017070 con 0x7f80640cd7a0 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f8060c00640 1 -- 172.21.15.59:0/2774580584 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804c00ca00 con 0x7f80640cd7a0 2024-05-30T16:58:48.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f806b000640 1 -- 172.21.15.59:0/2774580584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8064137df0 con 0x7f80640cd7a0 2024-05-30T16:58:48.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f8060c00640 1 -- 172.21.15.59:0/2774580584 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c00cdd0 con 0x7f80640cd7a0 2024-05-30T16:58:48.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f806b000640 1 -- 172.21.15.59:0/2774580584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8064152b00 con 0x7f80640cd7a0 2024-05-30T16:58:48.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f806b000640 1 -- 172.21.15.59:0/2774580584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8064068a90 con 0x7f80640cd7a0 2024-05-30T16:58:48.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.197+0000 7f8060c00640 1 -- 172.21.15.59:0/2774580584 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f804c01a070 con 0x7f80640cd7a0 2024-05-30T16:58:48.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.201+0000 7f8060c00640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8040069490 0x7f804006b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:48.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.201+0000 7f8060c00640 1 -- 172.21.15.59:0/2774580584 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f804c0856f0 con 0x7f80640cd7a0 2024-05-30T16:58:48.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.201+0000 7f8063e00640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8040069490 0x7f804006b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:48.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.201+0000 7f8063e00640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8040069490 0x7f804006b950 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f80540ad000 tx=0x7f80540a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:48.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.205+0000 7f8060c00640 1 -- 172.21.15.59:0/2774580584 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8064137df0 con 0x7f80640cd7a0 2024-05-30T16:58:48.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.425+0000 7f806b000640 1 -- 172.21.15.59:0/2774580584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f80640d0f90 con 0x7f80640cd7a0 2024-05-30T16:58:48.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f8060c00640 1 -- 172.21.15.59:0/2774580584 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2366 (secure 0 0 0) 0x7f804c056ce0 con 0x7f80640cd7a0 2024-05-30T16:58:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:58:48.429 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:58:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:58:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:58:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:58:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:58:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:58:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:58:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:58:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 608, 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:58:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 77, 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:58:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 11446, 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 47811400286, 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 96189554688, 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 676904558592, 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 426, 2024-05-30T16:58:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 10237, 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 3 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 43, 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5, 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 5, 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:58:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "b", 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 6528 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:58:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 12, 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:57:51.243602+0000", 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "328dea24-359f-412d-91f5-463eae2a6988": { 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 15.0 seconds before exiting (74s)\n [============================] ", 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: "a2307bae-c24f-47e3-a595-961c250f4339": { 2024-05-30T16:58:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 15.0 seconds before exiting (80s)\n [============================] ", 2024-05-30T16:58:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:58:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:48.436 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:58:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f806b000640 1 -- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8040069490 msgr2=0x7f804006b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f806b000640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8040069490 0x7f804006b950 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f80540ad000 tx=0x7f80540a6000 comp rx=0 tx=0).stop 2024-05-30T16:58:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f806b000640 1 -- 172.21.15.59:0/2774580584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640cd7a0 msgr2=0x7f80641378b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f806b000640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640cd7a0 0x7f80641378b0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f804c00e980 tx=0x7f804c00ee40 comp rx=0 tx=0).stop 2024-05-30T16:58:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f806b000640 1 -- 172.21.15.59:0/2774580584 shutdown_connections 2024-05-30T16:58:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f806b000640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8040069490 0x7f804006b950 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f806b000640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80640cdb80 0x7f806414e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f806b000640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640cd7a0 0x7f80641378b0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f806b000640 1 --2- 172.21.15.59:0/2774580584 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f806406be40 0x7f806414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f806b000640 1 -- 172.21.15.59:0/2774580584 >> 172.21.15.59:0/2774580584 conn(0x7f80640d0b10 msgr2=0x7f806415f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f806b000640 1 -- 172.21.15.59:0/2774580584 shutdown_connections 2024-05-30T16:58:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:48.429+0000 7f806b000640 1 -- 172.21.15.59:0/2774580584 wait complete. 2024-05-30T16:58:53.451 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:58:53.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.601+0000 7f6185400640 1 Processor -- start 2024-05-30T16:58:53.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.601+0000 7f6185400640 1 -- start start 2024-05-30T16:58:53.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.605+0000 7f6185400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61800b2870 0x7f61800b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:53.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.605+0000 7f6185400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61800b0720 con 0x7f61800b2410 2024-05-30T16:58:53.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.605+0000 7f6185400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61800ce6f0 con 0x7f6180161f40 2024-05-30T16:58:53.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.605+0000 7f6185400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f61800ce9d0 con 0x7f61800b2870 2024-05-30T16:58:53.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.605+0000 7f6175e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f61800b2410 0x7f61800b0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55816/0 (socket says 172.21.15.59:55816) 2024-05-30T16:58:53.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.605+0000 7f6175e00640 1 -- 172.21.15.59:0/2483833307 learned_addr learned my addr 172.21.15.59:0/2483833307 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:58:53.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.605+0000 7f617f200640 1 --2- 172.21.15.59:0/2483833307 >> v2:172.21.15.59:3300/0 conn(0x7f61800b2870 0x7f61800b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:53.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.605+0000 7f617f200640 1 -- 172.21.15.59:0/2483833307 >> v1:172.21.15.107:6789/0 conn(0x7f6180161f40 legacy=0x7f61800cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:53.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.605+0000 7f617f200640 1 -- 172.21.15.59:0/2483833307 >> v1:172.21.15.59:6789/0 conn(0x7f61800b2410 legacy=0x7f61800b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:53.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.605+0000 7f617f200640 1 -- 172.21.15.59:0/2483833307 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61800b09c0 con 0x7f61800b2870 2024-05-30T16:58:53.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.605+0000 7f617de00640 1 -- 172.21.15.59:0/2483833307 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3622822374 0 0) 0x7f61800b0720 con 0x7f61800b2410 2024-05-30T16:58:53.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f617f200640 1 --2- 172.21.15.59:0/2483833307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b2870 0x7f61800b15f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f61780097c0 tx=0x7f617801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c459ce61b694e694 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:53.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f617de00640 1 -- 172.21.15.59:0/2483833307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61780ab680 con 0x7f61800b2870 2024-05-30T16:58:53.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f617de00640 1 -- 172.21.15.59:0/2483833307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61780b0070 con 0x7f61800b2870 2024-05-30T16:58:53.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f617de00640 1 -- 172.21.15.59:0/2483833307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61780aba40 con 0x7f61800b2870 2024-05-30T16:58:53.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f6185400640 1 -- 172.21.15.59:0/2483833307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b2870 msgr2=0x7f61800b15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:53.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f6185400640 1 --2- 172.21.15.59:0/2483833307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b2870 0x7f61800b15f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f61780097c0 tx=0x7f617801c460 comp rx=0 tx=0).stop 2024-05-30T16:58:53.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f6185400640 1 -- 172.21.15.59:0/2483833307 shutdown_connections 2024-05-30T16:58:53.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f6185400640 1 --2- 172.21.15.59:0/2483833307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b2870 0x7f61800b15f0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:53.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f6185400640 1 -- 172.21.15.59:0/2483833307 >> 172.21.15.59:0/2483833307 conn(0x7f618009aa40 msgr2=0x7f61800b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:53.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f6185400640 1 -- 172.21.15.59:0/2483833307 shutdown_connections 2024-05-30T16:58:53.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f6185400640 1 -- 172.21.15.59:0/2483833307 wait complete. 2024-05-30T16:58:53.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f6185400640 1 Processor -- start 2024-05-30T16:58:53.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.609+0000 7f6185400640 1 -- start start 2024-05-30T16:58:53.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6185400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b2410 0x7f61800b69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6185400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61800b2870 0x7f61800b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6185400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6180161f40 0x7f61800c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6185400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f61800cd920 con 0x7f61800b2410 2024-05-30T16:58:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6185400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f61800ce360 con 0x7f61800b2870 2024-05-30T16:58:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6185400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6180154f30 con 0x7f6180161f40 2024-05-30T16:58:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f617e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b2410 0x7f61800b69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f617e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b2410 0x7f61800b69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58788/0 (socket says 172.21.15.59:58788) 2024-05-30T16:58:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f617e800640 1 -- 172.21.15.59:0/3513316258 learned_addr learned my addr 172.21.15.59:0/3513316258 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6175e00640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61800b2870 0x7f61800b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f617f200640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6180161f40 0x7f61800c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f617e800640 1 -- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6180161f40 msgr2=0x7f61800c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f617e800640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6180161f40 0x7f61800c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:53.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f617e800640 1 -- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61800b2870 msgr2=0x7f61800b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:53.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f617e800640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61800b2870 0x7f61800b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:53.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f617e800640 1 -- 172.21.15.59:0/3513316258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6180155210 con 0x7f61800b2410 2024-05-30T16:58:53.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f617e800640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b2410 0x7f61800b69d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f617000c7c0 tx=0x7f617000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:53.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6177400640 1 -- 172.21.15.59:0/3513316258 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170016020 con 0x7f61800b2410 2024-05-30T16:58:53.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6177400640 1 -- 172.21.15.59:0/3513316258 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617000aa50 con 0x7f61800b2410 2024-05-30T16:58:53.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6185400640 1 -- 172.21.15.59:0/3513316258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61801554f0 con 0x7f61800b2410 2024-05-30T16:58:53.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6177400640 1 -- 172.21.15.59:0/3513316258 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170012420 con 0x7f61800b2410 2024-05-30T16:58:53.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6185400640 1 -- 172.21.15.59:0/3513316258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6180155ab0 con 0x7f61800b2410 2024-05-30T16:58:53.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6185400640 1 -- 172.21.15.59:0/3513316258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6180155cb0 con 0x7f61800b2410 2024-05-30T16:58:53.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.613+0000 7f6177400640 1 -- 172.21.15.59:0/3513316258 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f6170019020 con 0x7f61800b2410 2024-05-30T16:58:53.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.617+0000 7f6177400640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f615c069460 0x7f615c06b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:53.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.617+0000 7f6177400640 1 -- 172.21.15.59:0/3513316258 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f6170085620 con 0x7f61800b2410 2024-05-30T16:58:53.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.617+0000 7f6175e00640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f615c069460 0x7f615c06b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:53.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.617+0000 7f6175e00640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f615c069460 0x7f615c06b920 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f618009f610 tx=0x7f6168009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.621+0000 7f6177400640 1 -- 172.21.15.59:0/3513316258 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6180155cb0 con 0x7f61800b2410 2024-05-30T16:58:53.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.849+0000 7f6185400640 1 -- 172.21.15.59:0/3513316258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6180068a90 con 0x7f61800b2410 2024-05-30T16:58:53.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.849+0000 7f6177400640 1 -- 172.21.15.59:0/3513316258 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2332 (secure 0 0 0) 0x7f6170020030 con 0x7f61800b2410 2024-05-30T16:58:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:58:53.850 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:58:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:58:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:58:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:58:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:58:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:58:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:58:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:58:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:58:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:58:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:58:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:58:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:58:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:58:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:58:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 613, 2024-05-30T16:58:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:58:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:58:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:58:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:58:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:58:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 77, 2024-05-30T16:58:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:58:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:58:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 11446, 2024-05-30T16:58:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 47811400286, 2024-05-30T16:58:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 96189562880, 2024-05-30T16:58:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 676904550400, 2024-05-30T16:58:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:58:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 4180, 2024-05-30T16:58:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:58:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T16:58:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:58:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 43, 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5, 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 5, 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "b", 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 6528 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:58:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:58:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:58:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:58:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:58:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:58:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:58:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:58:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:58:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 12, 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:57:51.243602+0000", 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "328dea24-359f-412d-91f5-463eae2a6988": { 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 9.0 seconds before exiting (80s)\n [============================] ", 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "a2307bae-c24f-47e3-a595-961c250f4339": { 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 9.0 seconds before exiting (86s)\n [============================] ", 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:53.859 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:53.859 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:58:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.849+0000 7f6185400640 1 -- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f615c069460 msgr2=0x7f615c06b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.849+0000 7f6185400640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f615c069460 0x7f615c06b920 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f618009f610 tx=0x7f6168009040 comp rx=0 tx=0).stop 2024-05-30T16:58:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.849+0000 7f6185400640 1 -- 172.21.15.59:0/3513316258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b2410 msgr2=0x7f61800b69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.849+0000 7f6185400640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b2410 0x7f61800b69d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f617000c7c0 tx=0x7f617000cc80 comp rx=0 tx=0).stop 2024-05-30T16:58:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.853+0000 7f6185400640 1 -- 172.21.15.59:0/3513316258 shutdown_connections 2024-05-30T16:58:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.853+0000 7f6185400640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f615c069460 0x7f615c06b920 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.853+0000 7f6185400640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6180161f40 0x7f61800c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.853+0000 7f6185400640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61800b2870 0x7f61800b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.853+0000 7f6185400640 1 --2- 172.21.15.59:0/3513316258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b2410 0x7f61800b69d0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.853+0000 7f6185400640 1 -- 172.21.15.59:0/3513316258 >> 172.21.15.59:0/3513316258 conn(0x7f618009aa40 msgr2=0x7f61800cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.853+0000 7f6185400640 1 -- 172.21.15.59:0/3513316258 shutdown_connections 2024-05-30T16:58:53.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:53.853+0000 7f6185400640 1 -- 172.21.15.59:0/3513316258 wait complete. 2024-05-30T16:58:58.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:58:59.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.020+0000 7fb890a00640 1 Processor -- start 2024-05-30T16:58:59.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.020+0000 7fb890a00640 1 -- start start 2024-05-30T16:58:59.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.020+0000 7fb890a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb88c163230 0x7fb88c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:59.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.020+0000 7fb890a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb88c0b36d0 0x7fb88c06bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:59.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.020+0000 7fb890a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb88c070d10 con 0x7fb88c0d0e40 2024-05-30T16:58:59.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.020+0000 7fb890a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb88c162750 con 0x7fb88c0b36d0 2024-05-30T16:58:59.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.020+0000 7fb890a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb88c162a30 con 0x7fb88c163230 2024-05-30T16:58:59.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.020+0000 7fb889e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb88c0d0e40 0x7fb88c070410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55820/0 (socket says 172.21.15.59:55820) 2024-05-30T16:58:59.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.020+0000 7fb889e00640 1 -- 172.21.15.59:0/4027901954 learned_addr learned my addr 172.21.15.59:0/4027901954 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:58:59.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.020+0000 7fb881400640 1 --2- 172.21.15.59:0/4027901954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb88c163230 0x7fb88c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:59.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.020+0000 7fb88a800640 1 --2- 172.21.15.59:0/4027901954 >> v2:172.21.15.107:3300/0 conn(0x7fb88c0b36d0 0x7fb88c06bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:59.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.020+0000 7fb889400640 1 -- 172.21.15.59:0/4027901954 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1047168607 0 0) 0x7fb88c070d10 con 0x7fb88c0d0e40 2024-05-30T16:58:59.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.024+0000 7fb889400640 1 -- 172.21.15.59:0/4027901954 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb870003530 con 0x7fb88c0d0e40 2024-05-30T16:58:59.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.024+0000 7fb881400640 1 -- 172.21.15.59:0/4027901954 >> v2:172.21.15.107:3300/0 conn(0x7fb88c0b36d0 msgr2=0x7fb88c06bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:58:59.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.024+0000 7fb881400640 1 --2- 172.21.15.59:0/4027901954 >> v2:172.21.15.107:3300/0 conn(0x7fb88c0b36d0 0x7fb88c06bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:59.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.024+0000 7fb881400640 1 -- 172.21.15.59:0/4027901954 >> v1:172.21.15.59:6789/0 conn(0x7fb88c0d0e40 legacy=0x7fb88c070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:59.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.024+0000 7fb881400640 1 -- 172.21.15.59:0/4027901954 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c162d10 con 0x7fb88c163230 2024-05-30T16:58:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.024+0000 7fb881400640 1 --2- 172.21.15.59:0/4027901954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb88c163230 0x7fb88c06b9b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb8740097c0 tx=0x7fb87401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=683639ed5f52fa4b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.024+0000 7fb889400640 1 -- 172.21.15.59:0/4027901954 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8740b5070 con 0x7fb88c163230 2024-05-30T16:58:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.024+0000 7fb889400640 1 -- 172.21.15.59:0/4027901954 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8740a8990 con 0x7fb88c163230 2024-05-30T16:58:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.024+0000 7fb889400640 1 -- 172.21.15.59:0/4027901954 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8740a8d60 con 0x7fb88c163230 2024-05-30T16:58:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 -- 172.21.15.59:0/4027901954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb88c163230 msgr2=0x7fb88c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 --2- 172.21.15.59:0/4027901954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb88c163230 0x7fb88c06b9b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb8740097c0 tx=0x7fb87401ec90 comp rx=0 tx=0).stop 2024-05-30T16:58:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 -- 172.21.15.59:0/4027901954 shutdown_connections 2024-05-30T16:58:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 --2- 172.21.15.59:0/4027901954 >> v2:172.21.15.107:3300/0 conn(0x7fb88c0b36d0 0x7fb88c06bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 --2- 172.21.15.59:0/4027901954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb88c163230 0x7fb88c06b9b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 -- 172.21.15.59:0/4027901954 >> 172.21.15.59:0/4027901954 conn(0x7fb88c09aa40 msgr2=0x7fb88c0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 -- 172.21.15.59:0/4027901954 shutdown_connections 2024-05-30T16:58:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 -- 172.21.15.59:0/4027901954 wait complete. 2024-05-30T16:58:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 Processor -- start 2024-05-30T16:58:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 -- start start 2024-05-30T16:58:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb88c0b36d0 0x7fb88c0c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb88c0d0e40 0x7fb88c0b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb88c163230 0x7fb88c1e8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c15e430 con 0x7fb88c0d0e40 2024-05-30T16:58:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c15e2b0 con 0x7fb88c163230 2024-05-30T16:58:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb890a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb88c15e5b0 con 0x7fb88c0b36d0 2024-05-30T16:58:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb881400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb88c0d0e40 0x7fb88c0b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb881400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb88c0d0e40 0x7fb88c0b6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58804/0 (socket says 172.21.15.59:58804) 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb881400640 1 -- 172.21.15.59:0/3125357384 learned_addr learned my addr 172.21.15.59:0/3125357384 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb889e00640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb88c0b36d0 0x7fb88c0c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb88a800640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb88c163230 0x7fb88c1e8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb881400640 1 -- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb88c0b36d0 msgr2=0x7fb88c0c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb881400640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb88c0b36d0 0x7fb88c0c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb881400640 1 -- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb88c163230 msgr2=0x7fb88c1e8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb881400640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb88c163230 0x7fb88c1e8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb881400640 1 -- 172.21.15.59:0/3125357384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c1e9580 con 0x7fb88c0d0e40 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb88a800640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb88c163230 0x7fb88c1e8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.028+0000 7fb881400640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb88c0d0e40 0x7fb88c0b6b20 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb8740b3040 tx=0x7fb87401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.032+0000 7fb882a00640 1 -- 172.21.15.59:0/3125357384 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8740bf070 con 0x7fb88c0d0e40 2024-05-30T16:58:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.032+0000 7fb882a00640 1 -- 172.21.15.59:0/3125357384 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8740b0660 con 0x7fb88c0d0e40 2024-05-30T16:58:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.032+0000 7fb882a00640 1 -- 172.21.15.59:0/3125357384 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8740b5040 con 0x7fb88c0d0e40 2024-05-30T16:58:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.032+0000 7fb890a00640 1 -- 172.21.15.59:0/3125357384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88c1e9860 con 0x7fb88c0d0e40 2024-05-30T16:58:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.032+0000 7fb890a00640 1 -- 172.21.15.59:0/3125357384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb88c1e9e20 con 0x7fb88c0d0e40 2024-05-30T16:58:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.032+0000 7fb890a00640 1 -- 172.21.15.59:0/3125357384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88c068a90 con 0x7fb88c0d0e40 2024-05-30T16:58:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.032+0000 7fb882a00640 1 -- 172.21.15.59:0/3125357384 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7fb8740c2070 con 0x7fb88c0d0e40 2024-05-30T16:58:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.032+0000 7fb882a00640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb868069460 0x7fb86806b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:58:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.032+0000 7fb882a00640 1 -- 172.21.15.59:0/3125357384 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fb874121de0 con 0x7fb88c0d0e40 2024-05-30T16:58:59.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.032+0000 7fb889e00640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb868069460 0x7fb86806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:58:59.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.036+0000 7fb889e00640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb868069460 0x7fb86806b920 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb87c005c10 tx=0x7fb87c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:58:59.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.040+0000 7fb882a00640 1 -- 172.21.15.59:0/3125357384 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb8740187f0 con 0x7fb88c0d0e40 2024-05-30T16:58:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.260+0000 7fb890a00640 1 -- 172.21.15.59:0/3125357384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb88c0730f0 con 0x7fb88c0d0e40 2024-05-30T16:58:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb882a00640 1 -- 172.21.15.59:0/3125357384 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2332 (secure 0 0 0) 0x7fb8740f3460 con 0x7fb88c0d0e40 2024-05-30T16:58:59.264 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:58:59.264 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:58:59.265 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:58:59.266 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:58:59.266 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:59.266 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 619, 2024-05-30T16:58:59.266 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:58:59.266 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:58:59.266 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:58:59.266 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:58:59.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:59.266 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:58:59.266 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 77, 2024-05-30T16:58:59.266 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:58:59.266 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:59.267 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 11446, 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 47811403228, 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 96189566976, 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 676904546304, 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 1109, 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 43, 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5, 2024-05-30T16:58:59.268 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:58:59.269 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:58:59.269 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:58:59.269 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:58:59.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:58:59.269 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 5, 2024-05-30T16:58:59.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:58:59.269 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "b", 2024-05-30T16:58:59.269 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:58:59.269 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 6528 2024-05-30T16:58:59.269 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:59.270 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 12, 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:57:51.243602+0000", 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: "328dea24-359f-412d-91f5-463eae2a6988": { 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 5.0 seconds before exiting (84s)\n [============================] ", 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: "a2307bae-c24f-47e3-a595-961c250f4339": { 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 5.0 seconds before exiting (90s)\n [============================] ", 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T16:58:59.271 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T16:58:59.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:59.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:58:59.272 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:58:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb890a00640 1 -- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb868069460 msgr2=0x7fb86806b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb890a00640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb868069460 0x7fb86806b920 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb87c005c10 tx=0x7fb87c009040 comp rx=0 tx=0).stop 2024-05-30T16:58:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb890a00640 1 -- 172.21.15.59:0/3125357384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb88c0d0e40 msgr2=0x7fb88c0b6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:58:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb890a00640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb88c0d0e40 0x7fb88c0b6b20 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb8740b3040 tx=0x7fb87401ba30 comp rx=0 tx=0).stop 2024-05-30T16:58:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb890a00640 1 -- 172.21.15.59:0/3125357384 shutdown_connections 2024-05-30T16:58:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb890a00640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb868069460 0x7fb86806b920 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb890a00640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb88c163230 0x7fb88c1e8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb890a00640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb88c0d0e40 0x7fb88c0b6b20 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb890a00640 1 --2- 172.21.15.59:0/3125357384 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb88c0b36d0 0x7fb88c0c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:58:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb890a00640 1 -- 172.21.15.59:0/3125357384 >> 172.21.15.59:0/3125357384 conn(0x7fb88c09aa40 msgr2=0x7fb88c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:58:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb890a00640 1 -- 172.21.15.59:0/3125357384 shutdown_connections 2024-05-30T16:58:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:58:59.264+0000 7fb890a00640 1 -- 172.21.15.59:0/3125357384 wait complete. 2024-05-30T16:59:04.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:59:04.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7461000640 1 Processor -- start 2024-05-30T16:59:04.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7461000640 1 -- start start 2024-05-30T16:59:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7461000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f745c0b1700 0x7f745c0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7461000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f745c09bad0 0x7f745c0d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7461000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f745c0b1ae0 con 0x7f745c0b22e0 2024-05-30T16:59:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7461000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f745c0ce220 con 0x7f745c0b1700 2024-05-30T16:59:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7461000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f745c0ce500 con 0x7f745c09bad0 2024-05-30T16:59:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7453e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f745c0b22e0 0x7f745c09b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59952/0 (socket says 172.21.15.59:59952) 2024-05-30T16:59:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7453e00640 1 -- 172.21.15.59:0/1206894694 learned_addr learned my addr 172.21.15.59:0/1206894694 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:04.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f745a800640 1 --2- 172.21.15.59:0/1206894694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f745c09bad0 0x7f745c0d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459e00640 1 --2- 172.21.15.59:0/1206894694 >> v2:172.21.15.107:3300/0 conn(0x7f745c0b1700 0x7f745c0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237237729 0 0) 0x7f745c0b1ae0 con 0x7f745c0b22e0 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7440003530 con 0x7f745c0b22e0 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 84059253 0 0) 0x7f7440003530 con 0x7f745c0b22e0 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f745c09bad0 msgr2=0x7f745c0d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 --2- 172.21.15.59:0/1206894694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f745c09bad0 0x7f745c0d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 >> v2:172.21.15.107:3300/0 conn(0x7f745c0b1700 msgr2=0x7f745c0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 --2- 172.21.15.59:0/1206894694 >> v2:172.21.15.107:3300/0 conn(0x7f745c0b1700 0x7f745c0b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c09abc0 con 0x7f745c0b22e0 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f7444001680 con 0x7f745c0b22e0 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 >> v1:172.21.15.59:6789/0 conn(0x7f745c0b22e0 legacy=0x7f745c09b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 --2- 172.21.15.59:0/1206894694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74400039c0 0x7f7440003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 --2- 172.21.15.59:0/1206894694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f745c09bad0 0x7f7440004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 --2- 172.21.15.59:0/1206894694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7440004d50 0x7f74400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f745c0ce220 con 0x7f7440004d50 2024-05-30T16:59:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f745c0ce500 con 0x7f74400039c0 2024-05-30T16:59:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f744000b9d0 con 0x7f745c09bad0 2024-05-30T16:59:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459e00640 1 --2- 172.21.15.59:0/1206894694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74400039c0 0x7f7440003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f745a800640 1 --2- 172.21.15.59:0/1206894694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7440004d50 0x7f74400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7453e00640 1 --2- 172.21.15.59:0/1206894694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f745c09bad0 0x7f7440004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459e00640 1 -- 172.21.15.59:0/1206894694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f745c09bad0 msgr2=0x7f7440004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459e00640 1 --2- 172.21.15.59:0/1206894694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f745c09bad0 0x7f7440004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459e00640 1 -- 172.21.15.59:0/1206894694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7440004d50 msgr2=0x7f74400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459e00640 1 --2- 172.21.15.59:0/1206894694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7440004d50 0x7f74400051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.440+0000 7f7459e00640 1 -- 172.21.15.59:0/1206894694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7440003530 con 0x7f74400039c0 2024-05-30T16:59:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.444+0000 7f7459e00640 1 --2- 172.21.15.59:0/1206894694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74400039c0 0x7f7440003de0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f744c009ac0 tx=0x7f744c01c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=848a14dd7899b406 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.444+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c009690 con 0x7f74400039c0 2024-05-30T16:59:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.444+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c0a4ac0 con 0x7f74400039c0 2024-05-30T16:59:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.444+0000 7f7459400640 1 -- 172.21.15.59:0/1206894694 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c0059a0 con 0x7f74400039c0 2024-05-30T16:59:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.444+0000 7f7461000640 1 -- 172.21.15.59:0/1206894694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74400039c0 msgr2=0x7f7440003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.444+0000 7f7461000640 1 --2- 172.21.15.59:0/1206894694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74400039c0 0x7f7440003de0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f744c009ac0 tx=0x7f744c01c770 comp rx=0 tx=0).stop 2024-05-30T16:59:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.444+0000 7f745a800640 1 -- 172.21.15.59:0/1206894694 reap_dead start 2024-05-30T16:59:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.444+0000 7f7461000640 1 -- 172.21.15.59:0/1206894694 shutdown_connections 2024-05-30T16:59:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.444+0000 7f7461000640 1 -- 172.21.15.59:0/1206894694 >> 172.21.15.59:0/1206894694 conn(0x7f745c0b3f30 msgr2=0x7f745c0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.444+0000 7f7461000640 1 -- 172.21.15.59:0/1206894694 shutdown_connections 2024-05-30T16:59:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.444+0000 7f7461000640 1 -- 172.21.15.59:0/1206894694 wait complete. 2024-05-30T16:59:04.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7461000640 1 Processor -- start 2024-05-30T16:59:04.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7461000640 1 -- start start 2024-05-30T16:59:04.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7461000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74400039c0 0x7f745c1f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7461000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f745c1f95e0 0x7f745c159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7461000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f745c15fc40 0x7f745c15a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7461000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f745c0d0e10 con 0x7f745c1f95e0 2024-05-30T16:59:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7461000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f745c0d0c90 con 0x7f745c15fc40 2024-05-30T16:59:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7461000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f745c0d0f90 con 0x7f74400039c0 2024-05-30T16:59:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7453e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f745c1f95e0 0x7f745c159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7453e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f745c1f95e0 0x7f745c159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35020/0 (socket says 172.21.15.59:35020) 2024-05-30T16:59:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7453e00640 1 -- 172.21.15.59:0/1941863912 learned_addr learned my addr 172.21.15.59:0/1941863912 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f745a800640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f745c15fc40 0x7f745c15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7459e00640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74400039c0 0x7f745c1f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7453e00640 1 -- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74400039c0 msgr2=0x7f745c1f90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7453e00640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74400039c0 0x7f745c1f90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7453e00640 1 -- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f745c15fc40 msgr2=0x7f745c15a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7453e00640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f745c15fc40 0x7f745c15a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7453e00640 1 -- 172.21.15.59:0/1941863912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c1f5bb0 con 0x7f745c1f95e0 2024-05-30T16:59:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f745a800640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f745c15fc40 0x7f745c15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7453e00640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f745c1f95e0 0x7f745c159ef0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7444012260 tx=0x7f7444012720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7452000640 1 -- 172.21.15.59:0/1941863912 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744401c070 con 0x7f745c1f95e0 2024-05-30T16:59:04.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7452000640 1 -- 172.21.15.59:0/1941863912 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7444014790 con 0x7f745c1f95e0 2024-05-30T16:59:04.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7452000640 1 -- 172.21.15.59:0/1941863912 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444014b80 con 0x7f745c1f95e0 2024-05-30T16:59:04.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7461000640 1 -- 172.21.15.59:0/1941863912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f745c1f5e90 con 0x7f745c1f95e0 2024-05-30T16:59:04.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.448+0000 7f7461000640 1 -- 172.21.15.59:0/1941863912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745c1f88a0 con 0x7f745c1f95e0 2024-05-30T16:59:04.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.452+0000 7f7461000640 1 -- 172.21.15.59:0/1941863912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745c068a90 con 0x7f745c1f95e0 2024-05-30T16:59:04.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.452+0000 7f7452000640 1 -- 172.21.15.59:0/1941863912 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7f74440153e0 con 0x7f745c1f95e0 2024-05-30T16:59:04.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.452+0000 7f7452000640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7438069490 0x7f743806b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.452+0000 7f7452000640 1 -- 172.21.15.59:0/1941863912 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f7444087ed0 con 0x7f745c1f95e0 2024-05-30T16:59:04.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.452+0000 7f7459e00640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7438069490 0x7f743806b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.452+0000 7f7459e00640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7438069490 0x7f743806b950 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f744c0ad000 tx=0x7f744c0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:04.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.456+0000 7f7452000640 1 -- 172.21.15.59:0/1941863912 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7444059f40 con 0x7f745c1f95e0 2024-05-30T16:59:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 -- 172.21.15.59:0/1941863912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f745c1603b0 con 0x7f745c1f95e0 2024-05-30T16:59:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7452000640 1 -- 172.21.15.59:0/1941863912 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1825 (secure 0 0 0) 0x7f7444059840 con 0x7f745c1f95e0 2024-05-30T16:59:04.682 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:04.682 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:59:04.682 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:59:04.682 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T16:59:04.682 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T16:59:04.682 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T16:59:04.682 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T16:59:04.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:04.682 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T16:59:04.682 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T16:59:04.682 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T16:59:04.682 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 624, 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:04.683 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 77, 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T16:59:04.684 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 11446, 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 47811403228, 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 96189571072, 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 676904542208, 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 341, 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:04.685 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 43, 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5, 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 5, 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "b", 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 6528 2024-05-30T16:59:04.686 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:59:04.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:04.688 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T16:59:04.688 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 12, 2024-05-30T16:59:04.688 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:57:51.243602+0000", 2024-05-30T16:59:04.688 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T16:59:04.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:04.688 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": {} 2024-05-30T16:59:04.688 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:59:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 -- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7438069490 msgr2=0x7f743806b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7438069490 0x7f743806b950 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f744c0ad000 tx=0x7f744c0046d0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 -- 172.21.15.59:0/1941863912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f745c1f95e0 msgr2=0x7f745c159ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f745c1f95e0 0x7f745c159ef0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7444012260 tx=0x7f7444012720 comp rx=0 tx=0).stop 2024-05-30T16:59:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 -- 172.21.15.59:0/1941863912 shutdown_connections 2024-05-30T16:59:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7438069490 0x7f743806b950 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f745c15fc40 0x7f745c15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f745c1f95e0 0x7f745c159ef0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 --2- 172.21.15.59:0/1941863912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74400039c0 0x7f745c1f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 -- 172.21.15.59:0/1941863912 >> 172.21.15.59:0/1941863912 conn(0x7f745c0b3f30 msgr2=0x7f745c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 -- 172.21.15.59:0/1941863912 shutdown_connections 2024-05-30T16:59:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.680+0000 7f7461000640 1 -- 172.21.15.59:0/1941863912 wait complete. 2024-05-30T16:59:04.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T16:59:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.844+0000 7fb7ecc00640 1 Processor -- start 2024-05-30T16:59:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.844+0000 7fb7ecc00640 1 -- start start 2024-05-30T16:59:04.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.844+0000 7fb7ecc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e815e5c0 0x7fb7e80b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.844+0000 7fb7ecc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb7e806ebb0 0x7fb7e80aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.844+0000 7fb7ecc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e806f280 con 0x7fb7e806fda0 2024-05-30T16:59:04.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.844+0000 7fb7ecc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb7e80aefe0 con 0x7fb7e806ebb0 2024-05-30T16:59:04.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.844+0000 7fb7ecc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e80afe20 con 0x7fb7e815e5c0 2024-05-30T16:59:04.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.848+0000 7fb7dea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb7e806fda0 0x7fb7e806e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59958/0 (socket says 172.21.15.59:59958) 2024-05-30T16:59:04.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.848+0000 7fb7dea00640 1 -- 172.21.15.59:0/1105923098 learned_addr learned my addr 172.21.15.59:0/1105923098 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:04.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.848+0000 7fb7e7400640 1 --2- 172.21.15.59:0/1105923098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e815e5c0 0x7fb7e80b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.848+0000 7fb7e7e00640 1 --2- 172.21.15.59:0/1105923098 >> v2:172.21.15.107:3300/0 conn(0x7fb7e806ebb0 0x7fb7e80aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.848+0000 7fb7e6a00640 1 -- 172.21.15.59:0/1105923098 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692873584 0 0) 0x7fb7e806f280 con 0x7fb7e806fda0 2024-05-30T16:59:04.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.848+0000 7fb7e6a00640 1 -- 172.21.15.59:0/1105923098 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7cc003530 con 0x7fb7e806fda0 2024-05-30T16:59:04.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.848+0000 7fb7e7400640 1 -- 172.21.15.59:0/1105923098 >> v2:172.21.15.107:3300/0 conn(0x7fb7e806ebb0 msgr2=0x7fb7e80aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:04.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.848+0000 7fb7e7400640 1 --2- 172.21.15.59:0/1105923098 >> v2:172.21.15.107:3300/0 conn(0x7fb7e806ebb0 0x7fb7e80aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.848+0000 7fb7e7400640 1 -- 172.21.15.59:0/1105923098 >> v1:172.21.15.59:6789/0 conn(0x7fb7e806fda0 legacy=0x7fb7e806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:04.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.848+0000 7fb7e7400640 1 -- 172.21.15.59:0/1105923098 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e80af210 con 0x7fb7e815e5c0 2024-05-30T16:59:04.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.848+0000 7fb7e7400640 1 --2- 172.21.15.59:0/1105923098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e815e5c0 0x7fb7e80b02b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80097c0 tx=0x7fb7d801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=127933435c44b09d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:04.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7e6a00640 1 -- 172.21.15.59:0/1105923098 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80a7070 con 0x7fb7e815e5c0 2024-05-30T16:59:04.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7e6a00640 1 -- 172.21.15.59:0/1105923098 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d80b0070 con 0x7fb7e815e5c0 2024-05-30T16:59:04.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7e6a00640 1 -- 172.21.15.59:0/1105923098 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80ab890 con 0x7fb7e815e5c0 2024-05-30T16:59:04.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 -- 172.21.15.59:0/1105923098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e815e5c0 msgr2=0x7fb7e80b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 --2- 172.21.15.59:0/1105923098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e815e5c0 0x7fb7e80b02b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80097c0 tx=0x7fb7d801c470 comp rx=0 tx=0).stop 2024-05-30T16:59:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 -- 172.21.15.59:0/1105923098 shutdown_connections 2024-05-30T16:59:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 --2- 172.21.15.59:0/1105923098 >> v2:172.21.15.107:3300/0 conn(0x7fb7e806ebb0 0x7fb7e80aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 --2- 172.21.15.59:0/1105923098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e815e5c0 0x7fb7e80b02b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 -- 172.21.15.59:0/1105923098 >> 172.21.15.59:0/1105923098 conn(0x7fb7e8073320 msgr2=0x7fb7e806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 -- 172.21.15.59:0/1105923098 shutdown_connections 2024-05-30T16:59:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 -- 172.21.15.59:0/1105923098 wait complete. 2024-05-30T16:59:04.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 Processor -- start 2024-05-30T16:59:04.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 -- start start 2024-05-30T16:59:04.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7e806ebb0 0x7fb7e81549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e806fda0 0x7fb7e80b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e815e5c0 0x7fb7e8141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e815eb20 con 0x7fb7e815e5c0 2024-05-30T16:59:04.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e815e9a0 con 0x7fb7e806ebb0 2024-05-30T16:59:04.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7ecc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e80b43f0 con 0x7fb7e806fda0 2024-05-30T16:59:04.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e815e5c0 0x7fb7e8141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e815e5c0 0x7fb7e8141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35024/0 (socket says 172.21.15.59:35024) 2024-05-30T16:59:04.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7e7e00640 1 -- 172.21.15.59:0/3265041317 learned_addr learned my addr 172.21.15.59:0/3265041317 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:04.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7dea00640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e806fda0 0x7fb7e80b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.852+0000 7fb7e7400640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7e806ebb0 0x7fb7e81549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7e7e00640 1 -- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e806fda0 msgr2=0x7fb7e80b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:04.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7e7e00640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e806fda0 0x7fb7e80b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7e7e00640 1 -- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7e806ebb0 msgr2=0x7fb7e81549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:04.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7e7e00640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7e806ebb0 0x7fb7e81549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:04.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7e7e00640 1 -- 172.21.15.59:0/3265041317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e8157a90 con 0x7fb7e815e5c0 2024-05-30T16:59:04.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7e7e00640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e815e5c0 0x7fb7e8141080 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000e850 tx=0x7fb7e000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7dfe00640 1 -- 172.21.15.59:0/3265041317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0017070 con 0x7fb7e815e5c0 2024-05-30T16:59:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7dfe00640 1 -- 172.21.15.59:0/3265041317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e000c940 con 0x7fb7e815e5c0 2024-05-30T16:59:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7dfe00640 1 -- 172.21.15.59:0/3265041317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000cd10 con 0x7fb7e815e5c0 2024-05-30T16:59:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7ecc00640 1 -- 172.21.15.59:0/3265041317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e80cd720 con 0x7fb7e815e5c0 2024-05-30T16:59:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7ecc00640 1 -- 172.21.15.59:0/3265041317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e8155860 con 0x7fb7e815e5c0 2024-05-30T16:59:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7ecc00640 1 -- 172.21.15.59:0/3265041317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e8156310 con 0x7fb7e815e5c0 2024-05-30T16:59:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7dfe00640 1 -- 172.21.15.59:0/3265041317 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7fb7e001a070 con 0x7fb7e815e5c0 2024-05-30T16:59:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7dfe00640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb7c4069460 0x7fb7c406b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.856+0000 7fb7dfe00640 1 -- 172.21.15.59:0/3265041317 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fb7e00857f0 con 0x7fb7e815e5c0 2024-05-30T16:59:04.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.860+0000 7fb7e7400640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb7c4069460 0x7fb7c406b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:04.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.860+0000 7fb7e7400640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb7c4069460 0x7fb7c406b920 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80af000 tx=0x7fb7d80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:04.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:04.860+0000 7fb7dfe00640 1 -- 172.21.15.59:0/3265041317 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb7e0056e70 con 0x7fb7e815e5c0 2024-05-30T16:59:04.965 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:59:04.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:59:05.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.052+0000 7fb7ecc00640 1 -- 172.21.15.59:0/3265041317 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7e80691a0 con 0x7fb7c4069460 2024-05-30T16:59:05.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.068+0000 7fb7dfe00640 1 -- 172.21.15.59:0/3265041317 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1029 (secure 0 0 0) 0x7fb7e80691a0 con 0x7fb7c4069460 2024-05-30T16:59:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:05.070 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:59:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone698818" 2024-05-30T16:59:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone698815" 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone698811" 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69882" 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone698813" 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.071 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone698820" 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sv1" 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone698812" 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69881" 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69888" 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone698819" 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69884" 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone698814" 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69889" 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69887" 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69885" 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone698816" 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69886" 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone698810" 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone69883" 2024-05-30T16:59:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone698817" 2024-05-30T16:59:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:05.075 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:59:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.072+0000 7fb7ecc00640 1 -- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb7c4069460 msgr2=0x7fb7c406b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.072+0000 7fb7ecc00640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb7c4069460 0x7fb7c406b920 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80af000 tx=0x7fb7d80a7000 comp rx=0 tx=0).stop 2024-05-30T16:59:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.072+0000 7fb7ecc00640 1 -- 172.21.15.59:0/3265041317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e815e5c0 msgr2=0x7fb7e8141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.072+0000 7fb7ecc00640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e815e5c0 0x7fb7e8141080 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000e850 tx=0x7fb7e000ed10 comp rx=0 tx=0).stop 2024-05-30T16:59:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.072+0000 7fb7ecc00640 1 -- 172.21.15.59:0/3265041317 shutdown_connections 2024-05-30T16:59:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.072+0000 7fb7ecc00640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb7c4069460 0x7fb7c406b920 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.072+0000 7fb7ecc00640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e815e5c0 0x7fb7e8141080 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.072+0000 7fb7ecc00640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e806fda0 0x7fb7e80b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.072+0000 7fb7ecc00640 1 --2- 172.21.15.59:0/3265041317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7e806ebb0 0x7fb7e81549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.072+0000 7fb7ecc00640 1 -- 172.21.15.59:0/3265041317 >> 172.21.15.59:0/3265041317 conn(0x7fb7e8073320 msgr2=0x7fb7e806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:05.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.072+0000 7fb7ecc00640 1 -- 172.21.15.59:0/3265041317 shutdown_connections 2024-05-30T16:59:05.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.072+0000 7fb7ecc00640 1 -- 172.21.15.59:0/3265041317 wait complete. 2024-05-30T16:59:05.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone698818 2024-05-30T16:59:05.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.232+0000 7fc847800640 1 Processor -- start 2024-05-30T16:59:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.232+0000 7fc847800640 1 -- start start 2024-05-30T16:59:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc847800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc840162b20 0x7fc84015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc847800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8400d1020 con 0x7fc840161ce0 2024-05-30T16:59:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc847800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8400d1300 con 0x7fc84009b7a0 2024-05-30T16:59:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc847800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc8400d15e0 con 0x7fc840162b20 2024-05-30T16:59:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc844e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc840161ce0 0x7fc8400d0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59962/0 (socket says 172.21.15.59:59962) 2024-05-30T16:59:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc844e00640 1 -- 172.21.15.59:0/1208206183 learned_addr learned my addr 172.21.15.59:0/1208206183 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc845800640 1 --2- 172.21.15.59:0/1208206183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc840162b20 0x7fc84015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4081339705 0 0) 0x7fc8400d1020 con 0x7fc840161ce0 2024-05-30T16:59:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc828003530 con 0x7fc840161ce0 2024-05-30T16:59:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1001348405 0 0) 0x7fc828003530 con 0x7fc840161ce0 2024-05-30T16:59:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc840162b20 msgr2=0x7fc84015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 --2- 172.21.15.59:0/1208206183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc840162b20 0x7fc84015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 >> v1:172.21.15.107:6789/0 conn(0x7fc84009b7a0 legacy=0x7fc840162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8400d18c0 con 0x7fc840161ce0 2024-05-30T16:59:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fc8340016a0 con 0x7fc840161ce0 2024-05-30T16:59:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 >> v1:172.21.15.59:6789/0 conn(0x7fc840161ce0 legacy=0x7fc8400d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 --2- 172.21.15.59:0/1208206183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8280039f0 0x7fc828003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 --2- 172.21.15.59:0/1208206183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc840162b20 0x7fc828004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 --2- 172.21.15.59:0/1208206183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc828004d50 0x7fc8280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc8400d15e0 con 0x7fc8280039f0 2024-05-30T16:59:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc82800bab0 con 0x7fc828004d50 2024-05-30T16:59:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc82800bcb0 con 0x7fc840162b20 2024-05-30T16:59:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc844e00640 1 --2- 172.21.15.59:0/1208206183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8280039f0 0x7fc828003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc83fe00640 1 --2- 172.21.15.59:0/1208206183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc840162b20 0x7fc828004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc845800640 1 --2- 172.21.15.59:0/1208206183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc828004d50 0x7fc8280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc844e00640 1 -- 172.21.15.59:0/1208206183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc840162b20 msgr2=0x7fc828004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc844e00640 1 --2- 172.21.15.59:0/1208206183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc840162b20 0x7fc828004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc844e00640 1 -- 172.21.15.59:0/1208206183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc828004d50 msgr2=0x7fc8280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc844e00640 1 --2- 172.21.15.59:0/1208206183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc828004d50 0x7fc8280051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.236+0000 7fc844e00640 1 -- 172.21.15.59:0/1208206183 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc828003530 con 0x7fc8280039f0 2024-05-30T16:59:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.240+0000 7fc844e00640 1 --2- 172.21.15.59:0/1208206183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8280039f0 0x7fc828003e10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc8400a0520 tx=0x7fc83401cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ae55b8304494e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.240+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834007d60 con 0x7fc8280039f0 2024-05-30T16:59:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.240+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8340a9070 con 0x7fc8280039f0 2024-05-30T16:59:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.240+0000 7fc83f400640 1 -- 172.21.15.59:0/1208206183 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834005d40 con 0x7fc8280039f0 2024-05-30T16:59:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.240+0000 7fc847800640 1 -- 172.21.15.59:0/1208206183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8280039f0 msgr2=0x7fc828003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.240+0000 7fc847800640 1 --2- 172.21.15.59:0/1208206183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8280039f0 0x7fc828003e10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc8400a0520 tx=0x7fc83401cce0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.240+0000 7fc845800640 1 -- 172.21.15.59:0/1208206183 reap_dead start 2024-05-30T16:59:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.240+0000 7fc847800640 1 -- 172.21.15.59:0/1208206183 shutdown_connections 2024-05-30T16:59:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.240+0000 7fc847800640 1 -- 172.21.15.59:0/1208206183 >> 172.21.15.59:0/1208206183 conn(0x7fc8400b4000 msgr2=0x7fc8400b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.240+0000 7fc847800640 1 -- 172.21.15.59:0/1208206183 shutdown_connections 2024-05-30T16:59:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.240+0000 7fc847800640 1 -- 172.21.15.59:0/1208206183 wait complete. 2024-05-30T16:59:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc847800640 1 Processor -- start 2024-05-30T16:59:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc847800640 1 -- start start 2024-05-30T16:59:05.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc847800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8280039f0 0x7fc84015d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc847800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8400cb450 0x7fc84014a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc847800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8400cdb90 0x7fc8400ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc847800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc84015fd70 con 0x7fc8400cdb90 2024-05-30T16:59:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc847800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc84015fbf0 con 0x7fc8280039f0 2024-05-30T16:59:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc847800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc8401f7be0 con 0x7fc8400cb450 2024-05-30T16:59:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc845800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8400cdb90 0x7fc8400ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc845800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8400cdb90 0x7fc8400ce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35050/0 (socket says 172.21.15.59:35050) 2024-05-30T16:59:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc845800640 1 -- 172.21.15.59:0/1396109936 learned_addr learned my addr 172.21.15.59:0/1396109936 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc83fe00640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8400cb450 0x7fc84014a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc844e00640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8280039f0 0x7fc84015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc845800640 1 -- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8400cb450 msgr2=0x7fc84014a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc845800640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8400cb450 0x7fc84014a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc845800640 1 -- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8280039f0 msgr2=0x7fc84015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc845800640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8280039f0 0x7fc84015d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc845800640 1 -- 172.21.15.59:0/1396109936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8400cbd30 con 0x7fc8400cdb90 2024-05-30T16:59:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc844e00640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8280039f0 0x7fc84015d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc845800640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8400cdb90 0x7fc8400ce040 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc8400ccb10 tx=0x7fc83800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc83cc00640 1 -- 172.21.15.59:0/1396109936 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83800fde0 con 0x7fc8400cdb90 2024-05-30T16:59:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc83cc00640 1 -- 172.21.15.59:0/1396109936 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc838015430 con 0x7fc8400cdb90 2024-05-30T16:59:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc83cc00640 1 -- 172.21.15.59:0/1396109936 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838015820 con 0x7fc8400cdb90 2024-05-30T16:59:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc847800640 1 -- 172.21.15.59:0/1396109936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8400cc010 con 0x7fc8400cdb90 2024-05-30T16:59:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc847800640 1 -- 172.21.15.59:0/1396109936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8400cc5d0 con 0x7fc8400cdb90 2024-05-30T16:59:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.244+0000 7fc847800640 1 -- 172.21.15.59:0/1396109936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc840068a90 con 0x7fc8400cdb90 2024-05-30T16:59:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.248+0000 7fc83cc00640 1 -- 172.21.15.59:0/1396109936 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7fc8380159c0 con 0x7fc8400cdb90 2024-05-30T16:59:05.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.248+0000 7fc83cc00640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc820069460 0x7fc82006b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.248+0000 7fc83cc00640 1 -- 172.21.15.59:0/1396109936 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fc838085f20 con 0x7fc8400cdb90 2024-05-30T16:59:05.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.248+0000 7fc844e00640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc820069460 0x7fc82006b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.248+0000 7fc844e00640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc820069460 0x7fc82006b920 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc8340ab000 tx=0x7fc8340b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:05.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.252+0000 7fc83cc00640 1 -- 172.21.15.59:0/1396109936 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc838024030 con 0x7fc8400cdb90 2024-05-30T16:59:05.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.444+0000 7fc847800640 1 -- 172.21.15.59:0/1396109936 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone698818", "target": ["mon-mgr", ""]}) -- 0x7fc84006be60 con 0x7fc820069460 2024-05-30T16:59:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc83cc00640 1 -- 172.21.15.59:0/1396109936 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc84006be60 con 0x7fc820069460 2024-05-30T16:59:05.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc847800640 1 -- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc820069460 msgr2=0x7fc82006b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:05.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc847800640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc820069460 0x7fc82006b920 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc8340ab000 tx=0x7fc8340b1040 comp rx=0 tx=0).stop 2024-05-30T16:59:05.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc847800640 1 -- 172.21.15.59:0/1396109936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8400cdb90 msgr2=0x7fc8400ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:05.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc847800640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8400cdb90 0x7fc8400ce040 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc8400ccb10 tx=0x7fc83800f580 comp rx=0 tx=0).stop 2024-05-30T16:59:05.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc847800640 1 -- 172.21.15.59:0/1396109936 shutdown_connections 2024-05-30T16:59:05.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc847800640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc820069460 0x7fc82006b920 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc847800640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8400cdb90 0x7fc8400ce040 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc847800640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8400cb450 0x7fc84014a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc847800640 1 --2- 172.21.15.59:0/1396109936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8280039f0 0x7fc84015d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc847800640 1 -- 172.21.15.59:0/1396109936 >> 172.21.15.59:0/1396109936 conn(0x7fc8400b4000 msgr2=0x7fc8401592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:05.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc847800640 1 -- 172.21.15.59:0/1396109936 shutdown_connections 2024-05-30T16:59:05.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.468+0000 7fc847800640 1 -- 172.21.15.59:0/1396109936 wait complete. 2024-05-30T16:59:05.474 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:05.470+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:05.474 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:05.470+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:05.474 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:05.470+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:05.474 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:05.470+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:05.474 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:05.470+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:05.492 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone698815 2024-05-30T16:59:05.493 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:05.490+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:05.493 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:05.490+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:05.493 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:05.490+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:05.493 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:05.490+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:05.494 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:05.490+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:05.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.636+0000 7fb003e00640 1 Processor -- start 2024-05-30T16:59:05.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.636+0000 7fb003e00640 1 -- start start 2024-05-30T16:59:05.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb003e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb004159210 0x7fb0040cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb003e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb0040d0b10 0x7fb0040ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb003e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb00415bc20 con 0x7fb004158e30 2024-05-30T16:59:05.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb003e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb00415b9d0 con 0x7fb004159210 2024-05-30T16:59:05.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb003e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb00415bf00 con 0x7fb0040d0b10 2024-05-30T16:59:05.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb002000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb004159210 0x7fb0040cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb002000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb004159210 0x7fb0040cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35058/0 (socket says 172.21.15.59:35058) 2024-05-30T16:59:05.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb002000640 1 -- 172.21.15.59:0/2726294994 learned_addr learned my addr 172.21.15.59:0/2726294994 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:05.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb003400640 1 --2- 172.21.15.59:0/2726294994 >> v2:172.21.15.107:3300/0 conn(0x7fb0040d0b10 0x7fb0040ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb002000640 1 -- 172.21.15.59:0/2726294994 >> v2:172.21.15.107:3300/0 conn(0x7fb0040d0b10 msgr2=0x7fb0040ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:05.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb002000640 1 --2- 172.21.15.59:0/2726294994 >> v2:172.21.15.107:3300/0 conn(0x7fb0040d0b10 0x7fb0040ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb002000640 1 -- 172.21.15.59:0/2726294994 >> v1:172.21.15.107:6789/0 conn(0x7fb004158e30 legacy=0x7fb0040d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:05.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.640+0000 7fb002000640 1 -- 172.21.15.59:0/2726294994 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00415c1e0 con 0x7fb004159210 2024-05-30T16:59:05.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb002000640 1 --2- 172.21.15.59:0/2726294994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb004159210 0x7fb0040cdf20 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb00406fbb0 tx=0x7faff001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dde6dd1d48091c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:05.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb001600640 1 -- 172.21.15.59:0/2726294994 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff00b1070 con 0x7fb004159210 2024-05-30T16:59:05.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb001600640 1 -- 172.21.15.59:0/2726294994 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff00ac410 con 0x7fb004159210 2024-05-30T16:59:05.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb001600640 1 -- 172.21.15.59:0/2726294994 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff00ac7e0 con 0x7fb004159210 2024-05-30T16:59:05.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 -- 172.21.15.59:0/2726294994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb004159210 msgr2=0x7fb0040cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:05.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 --2- 172.21.15.59:0/2726294994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb004159210 0x7fb0040cdf20 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb00406fbb0 tx=0x7faff001c4b0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 -- 172.21.15.59:0/2726294994 shutdown_connections 2024-05-30T16:59:05.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 --2- 172.21.15.59:0/2726294994 >> v2:172.21.15.107:3300/0 conn(0x7fb0040d0b10 0x7fb0040ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 --2- 172.21.15.59:0/2726294994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb004159210 0x7fb0040cdf20 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 -- 172.21.15.59:0/2726294994 >> 172.21.15.59:0/2726294994 conn(0x7fb00406bb80 msgr2=0x7fb00406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:05.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 -- 172.21.15.59:0/2726294994 shutdown_connections 2024-05-30T16:59:05.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 -- 172.21.15.59:0/2726294994 wait complete. 2024-05-30T16:59:05.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 Processor -- start 2024-05-30T16:59:05.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 -- start start 2024-05-30T16:59:05.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0040d0b10 0x7fb004153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb004158e30 0x7fb004152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb004159210 0x7fb004153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb0040cd820 con 0x7fb004159210 2024-05-30T16:59:05.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb0040cd6a0 con 0x7fb004158e30 2024-05-30T16:59:05.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.644+0000 7fb003e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb0040cd9a0 con 0x7fb0040d0b10 2024-05-30T16:59:05.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb003400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb004159210 0x7fb004153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb003400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb004159210 0x7fb004153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35066/0 (socket says 172.21.15.59:35066) 2024-05-30T16:59:05.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb003400640 1 -- 172.21.15.59:0/1276970664 learned_addr learned my addr 172.21.15.59:0/1276970664 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:05.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb002000640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb004158e30 0x7fb004152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb002a00640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0040d0b10 0x7fb004153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb003400640 1 -- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0040d0b10 msgr2=0x7fb004153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:05.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb003400640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0040d0b10 0x7fb004153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb003400640 1 -- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb004158e30 msgr2=0x7fb004152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:05.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb003400640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb004158e30 0x7fb004152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:05.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb003400640 1 -- 172.21.15.59:0/1276970664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb004156f60 con 0x7fb004159210 2024-05-30T16:59:05.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb002000640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb004158e30 0x7fb004152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:05.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb002a00640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0040d0b10 0x7fb004153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:05.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb003400640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb004159210 0x7fb004153f80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7faffc007e60 tx=0x7faffc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:05.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7faffaa00640 1 -- 172.21.15.59:0/1276970664 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc014620 con 0x7fb004159210 2024-05-30T16:59:05.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7faffaa00640 1 -- 172.21.15.59:0/1276970664 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc019070 con 0x7fb004159210 2024-05-30T16:59:05.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7faffaa00640 1 -- 172.21.15.59:0/1276970664 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc014a00 con 0x7fb004159210 2024-05-30T16:59:05.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb003e00640 1 -- 172.21.15.59:0/1276970664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb004157240 con 0x7fb004159210 2024-05-30T16:59:05.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb003e00640 1 -- 172.21.15.59:0/1276970664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb004152d50 con 0x7fb004159210 2024-05-30T16:59:05.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7fb003e00640 1 -- 172.21.15.59:0/1276970664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb004068a90 con 0x7fb004159210 2024-05-30T16:59:05.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7faffaa00640 1 -- 172.21.15.59:0/1276970664 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 89517+0+0 (secure 0 0 0) 0x7faffc014ba0 con 0x7fb004159210 2024-05-30T16:59:05.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.648+0000 7faffaa00640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fafe4069460 0x7fafe406b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:05.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.652+0000 7faffaa00640 1 -- 172.21.15.59:0/1276970664 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7faffc085e70 con 0x7fb004159210 2024-05-30T16:59:05.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.652+0000 7fb002a00640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fafe4069460 0x7fafe406b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:05.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.652+0000 7fb002a00640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fafe4069460 0x7fafe406b920 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb0040b24b0 tx=0x7faff4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:05.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.656+0000 7faffaa00640 1 -- 172.21.15.59:0/1276970664 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faffc011260 con 0x7fb004159210 2024-05-30T16:59:05.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:05.848+0000 7fb003e00640 1 -- 172.21.15.59:0/1276970664 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone698815", "target": ["mon-mgr", ""]}) -- 0x7fb00406e8e0 con 0x7fafe4069460 2024-05-30T16:59:07.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:07.856+0000 7faffaa00640 1 -- 172.21.15.59:0/1276970664 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7faffc053df0 con 0x7fb004159210 2024-05-30T16:59:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7faffaa00640 1 -- 172.21.15.59:0/1276970664 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb00406e8e0 con 0x7fafe4069460 2024-05-30T16:59:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7fb003e00640 1 -- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fafe4069460 msgr2=0x7fafe406b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7fb003e00640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fafe4069460 0x7fafe406b920 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb0040b24b0 tx=0x7faff4009040 comp rx=0 tx=0).stop 2024-05-30T16:59:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7fb003e00640 1 -- 172.21.15.59:0/1276970664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb004159210 msgr2=0x7fb004153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7fb003e00640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb004159210 0x7fb004153f80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7faffc007e60 tx=0x7faffc00e4b0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7fb003e00640 1 -- 172.21.15.59:0/1276970664 shutdown_connections 2024-05-30T16:59:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7fb003e00640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fafe4069460 0x7fafe406b920 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7fb003e00640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb004159210 0x7fb004153f80 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7fb003e00640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb004158e30 0x7fb004152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7fb003e00640 1 --2- 172.21.15.59:0/1276970664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0040d0b10 0x7fb004153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7fb003e00640 1 -- 172.21.15.59:0/1276970664 >> 172.21.15.59:0/1276970664 conn(0x7fb00406bb80 msgr2=0x7fb00415df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7fb003e00640 1 -- 172.21.15.59:0/1276970664 shutdown_connections 2024-05-30T16:59:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.472+0000 7fb003e00640 1 -- 172.21.15.59:0/1276970664 wait complete. 2024-05-30T16:59:09.501 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone698811 2024-05-30T16:59:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.648+0000 7f2723a00640 1 Processor -- start 2024-05-30T16:59:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.648+0000 7f2723a00640 1 -- start start 2024-05-30T16:59:09.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.648+0000 7f2723a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f271c15b3b0 0x7f271c0adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.648+0000 7f2723a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f271c15b790 0x7f271c0af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.648+0000 7f2723a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f271c072850 con 0x7f271c071cb0 2024-05-30T16:59:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.648+0000 7f2723a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f271c0afaf0 con 0x7f271c15b790 2024-05-30T16:59:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.648+0000 7f2723a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f271c0ae510 con 0x7f271c15b3b0 2024-05-30T16:59:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.648+0000 7f271be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f271c15b790 0x7f271c0af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.652+0000 7f271be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f271c15b790 0x7f271c0af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35072/0 (socket says 172.21.15.59:35072) 2024-05-30T16:59:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.652+0000 7f271be00640 1 -- 172.21.15.59:0/1376846856 learned_addr learned my addr 172.21.15.59:0/1376846856 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:09.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.652+0000 7f2721000640 1 --2- 172.21.15.59:0/1376846856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f271c15b3b0 0x7f271c0adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:09.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.652+0000 7f271be00640 1 -- 172.21.15.59:0/1376846856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f271c15b3b0 msgr2=0x7f271c0adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:09.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.652+0000 7f271be00640 1 --2- 172.21.15.59:0/1376846856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f271c15b3b0 0x7f271c0adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.652+0000 7f271be00640 1 -- 172.21.15.59:0/1376846856 >> v1:172.21.15.107:6789/0 conn(0x7f271c071cb0 legacy=0x7f271c072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:09.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.652+0000 7f271be00640 1 -- 172.21.15.59:0/1376846856 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c0ae7f0 con 0x7f271c15b790 2024-05-30T16:59:09.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.652+0000 7f271be00640 1 --2- 172.21.15.59:0/1376846856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c15b790 0x7f271c0af5b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2708009870 tx=0x7f270801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6f705534b40013 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:09.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.652+0000 7f271b400640 1 -- 172.21.15.59:0/1376846856 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27080aa610 con 0x7f271c15b790 2024-05-30T16:59:09.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.652+0000 7f271b400640 1 -- 172.21.15.59:0/1376846856 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27080af070 con 0x7f271c15b790 2024-05-30T16:59:09.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.652+0000 7f271b400640 1 -- 172.21.15.59:0/1376846856 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27080aa9d0 con 0x7f271c15b790 2024-05-30T16:59:09.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 -- 172.21.15.59:0/1376846856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c15b790 msgr2=0x7f271c0af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:09.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 --2- 172.21.15.59:0/1376846856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c15b790 0x7f271c0af5b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2708009870 tx=0x7f270801c4f0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 -- 172.21.15.59:0/1376846856 shutdown_connections 2024-05-30T16:59:09.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 --2- 172.21.15.59:0/1376846856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c15b790 0x7f271c0af5b0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 --2- 172.21.15.59:0/1376846856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f271c15b3b0 0x7f271c0adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 -- 172.21.15.59:0/1376846856 >> 172.21.15.59:0/1376846856 conn(0x7f271c0b1e60 msgr2=0x7f271c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:09.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 -- 172.21.15.59:0/1376846856 shutdown_connections 2024-05-30T16:59:09.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 -- 172.21.15.59:0/1376846856 wait complete. 2024-05-30T16:59:09.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 Processor -- start 2024-05-30T16:59:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 -- start start 2024-05-30T16:59:09.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c071cb0 0x7f271c137c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:09.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f271c15b3b0 0x7f271c0998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:09.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f271c15b790 0x7f271c14ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:09.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f271c0cc7d0 con 0x7f271c071cb0 2024-05-30T16:59:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f271c0cc650 con 0x7f271c15b3b0 2024-05-30T16:59:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2723a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f271c0b3970 con 0x7f271c15b790 2024-05-30T16:59:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2721000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c071cb0 0x7f271c137c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2721000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c071cb0 0x7f271c137c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35074/0 (socket says 172.21.15.59:35074) 2024-05-30T16:59:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2721000640 1 -- 172.21.15.59:0/4027123402 learned_addr learned my addr 172.21.15.59:0/4027123402 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f271be00640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f271c15b3b0 0x7f271c0998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2721a00640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f271c15b790 0x7f271c14ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2721000640 1 -- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f271c15b790 msgr2=0x7f271c14ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2721000640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f271c15b790 0x7f271c14ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2721000640 1 -- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f271c15b3b0 msgr2=0x7f271c0998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2721000640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f271c15b3b0 0x7f271c0998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2721000640 1 -- 172.21.15.59:0/4027123402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c1381c0 con 0x7f271c071cb0 2024-05-30T16:59:09.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.656+0000 7f2721000640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c071cb0 0x7f271c137c80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f271000d800 tx=0x7f271000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:09.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.660+0000 7f2718c00640 1 -- 172.21.15.59:0/4027123402 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271000b6c0 con 0x7f271c071cb0 2024-05-30T16:59:09.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.660+0000 7f2718c00640 1 -- 172.21.15.59:0/4027123402 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2710019070 con 0x7f271c071cb0 2024-05-30T16:59:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.660+0000 7f2718c00640 1 -- 172.21.15.59:0/4027123402 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271000ba60 con 0x7f271c071cb0 2024-05-30T16:59:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.660+0000 7f2723a00640 1 -- 172.21.15.59:0/4027123402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271c15a690 con 0x7f271c071cb0 2024-05-30T16:59:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.660+0000 7f2723a00640 1 -- 172.21.15.59:0/4027123402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f271c099e30 con 0x7f271c071cb0 2024-05-30T16:59:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.660+0000 7f2723a00640 1 -- 172.21.15.59:0/4027123402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f271c15abb0 con 0x7f271c071cb0 2024-05-30T16:59:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.660+0000 7f2718c00640 1 -- 172.21.15.59:0/4027123402 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7f271000bc00 con 0x7f271c071cb0 2024-05-30T16:59:09.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.660+0000 7f2718c00640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f26fc0695b0 0x7f26fc06ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:09.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.660+0000 7f2718c00640 1 -- 172.21.15.59:0/4027123402 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f27100858d0 con 0x7f271c071cb0 2024-05-30T16:59:09.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.660+0000 7f271be00640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f26fc0695b0 0x7f26fc06ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:09.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.664+0000 7f271be00640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f26fc0695b0 0x7f26fc06ba70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f27080ae000 tx=0x7f27080a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.664+0000 7f2718c00640 1 -- 172.21.15.59:0/4027123402 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f271c15abb0 con 0x7f271c071cb0 2024-05-30T16:59:09.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.856+0000 7f2723a00640 1 -- 172.21.15.59:0/4027123402 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone698811", "target": ["mon-mgr", ""]}) -- 0x7f271c068a90 con 0x7f26fc0695b0 2024-05-30T16:59:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2718c00640 1 -- 172.21.15.59:0/4027123402 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f271c068a90 con 0x7f26fc0695b0 2024-05-30T16:59:09.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2723a00640 1 -- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f26fc0695b0 msgr2=0x7f26fc06ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:09.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2723a00640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f26fc0695b0 0x7f26fc06ba70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f27080ae000 tx=0x7f27080a7000 comp rx=0 tx=0).stop 2024-05-30T16:59:09.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2723a00640 1 -- 172.21.15.59:0/4027123402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c071cb0 msgr2=0x7f271c137c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:09.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2723a00640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c071cb0 0x7f271c137c80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f271000d800 tx=0x7f271000dcc0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2723a00640 1 -- 172.21.15.59:0/4027123402 shutdown_connections 2024-05-30T16:59:09.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2723a00640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f26fc0695b0 0x7f26fc06ba70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2723a00640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f271c15b790 0x7f271c14ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2723a00640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f271c15b3b0 0x7f271c0998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2723a00640 1 --2- 172.21.15.59:0/4027123402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c071cb0 0x7f271c137c80 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:09.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2723a00640 1 -- 172.21.15.59:0/4027123402 >> 172.21.15.59:0/4027123402 conn(0x7f271c0b1e60 msgr2=0x7f271c14c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:09.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2723a00640 1 -- 172.21.15.59:0/4027123402 shutdown_connections 2024-05-30T16:59:09.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:09.880+0000 7f2723a00640 1 -- 172.21.15.59:0/4027123402 wait complete. 2024-05-30T16:59:09.903 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69882 2024-05-30T16:59:10.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9bde00640 1 Processor -- start 2024-05-30T16:59:10.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9bde00640 1 -- start start 2024-05-30T16:59:10.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9bde00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9b815ad90 0x7fd9b8071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9bde00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b806ec00 0x7fd9b80b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9bde00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9b80b3370 con 0x7fd9b806f6a0 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9bde00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b80b3650 con 0x7fd9b815ad90 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9bde00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b80b3930 con 0x7fd9b806ec00 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9b6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9b815ad90 0x7fd9b8071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9b6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9b815ad90 0x7fd9b8071cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35076/0 (socket says 172.21.15.59:35076) 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9b6a00640 1 -- 172.21.15.59:0/2549669570 learned_addr learned my addr 172.21.15.59:0/2549669570 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9b6000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd9b806f6a0 0x7fd9b806e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59968/0 (socket says 172.21.15.59:59968) 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9b7400640 1 --2- 172.21.15.59:0/2549669570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b806ec00 0x7fd9b80b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9b6a00640 1 -- 172.21.15.59:0/2549669570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b806ec00 msgr2=0x7fd9b80b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9b6a00640 1 --2- 172.21.15.59:0/2549669570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b806ec00 0x7fd9b80b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9b6a00640 1 -- 172.21.15.59:0/2549669570 >> v1:172.21.15.59:6789/0 conn(0x7fd9b806f6a0 legacy=0x7fd9b806e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.048+0000 7fd9b6a00640 1 -- 172.21.15.59:0/2549669570 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b80b3c10 con 0x7fd9b815ad90 2024-05-30T16:59:10.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.052+0000 7fd9b6a00640 1 --2- 172.21.15.59:0/2549669570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b815ad90 0x7fd9b8071cb0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009e50 tx=0x7fd9a801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bc23c898b5c0ae server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:10.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.052+0000 7fd9b5600640 1 -- 172.21.15.59:0/2549669570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80a5590 con 0x7fd9b815ad90 2024-05-30T16:59:10.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.052+0000 7fd9b5600640 1 -- 172.21.15.59:0/2549669570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a80a5730 con 0x7fd9b815ad90 2024-05-30T16:59:10.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.052+0000 7fd9b5600640 1 -- 172.21.15.59:0/2549669570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80a5b00 con 0x7fd9b815ad90 2024-05-30T16:59:10.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.052+0000 7fd9bde00640 1 -- 172.21.15.59:0/2549669570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b815ad90 msgr2=0x7fd9b8071cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.052+0000 7fd9bde00640 1 --2- 172.21.15.59:0/2549669570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b815ad90 0x7fd9b8071cb0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009e50 tx=0x7fd9a801ca30 comp rx=0 tx=0).stop 2024-05-30T16:59:10.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.052+0000 7fd9bde00640 1 -- 172.21.15.59:0/2549669570 shutdown_connections 2024-05-30T16:59:10.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.052+0000 7fd9bde00640 1 --2- 172.21.15.59:0/2549669570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b806ec00 0x7fd9b80b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.052+0000 7fd9bde00640 1 --2- 172.21.15.59:0/2549669570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b815ad90 0x7fd9b8071cb0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.052+0000 7fd9bde00640 1 -- 172.21.15.59:0/2549669570 >> 172.21.15.59:0/2549669570 conn(0x7fd9b80b1e60 msgr2=0x7fd9b80b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:10.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.052+0000 7fd9bde00640 1 -- 172.21.15.59:0/2549669570 shutdown_connections 2024-05-30T16:59:10.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.052+0000 7fd9bde00640 1 -- 172.21.15.59:0/2549669570 wait complete. 2024-05-30T16:59:10.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9bde00640 1 Processor -- start 2024-05-30T16:59:10.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9bde00640 1 -- start start 2024-05-30T16:59:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9bde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b806ec00 0x7fd9b81456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9bde00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b806f6a0 0x7fd9b8099b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9bde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b815ad90 0x7fd9b8149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9bde00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b80b47f0 con 0x7fd9b815ad90 2024-05-30T16:59:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9bde00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b80b4670 con 0x7fd9b806ec00 2024-05-30T16:59:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9bde00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b80b4970 con 0x7fd9b806f6a0 2024-05-30T16:59:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9b7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b815ad90 0x7fd9b8149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9b7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b815ad90 0x7fd9b8149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35088/0 (socket says 172.21.15.59:35088) 2024-05-30T16:59:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9b7400640 1 -- 172.21.15.59:0/2710841204 learned_addr learned my addr 172.21.15.59:0/2710841204 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9b6000640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b806f6a0 0x7fd9b8099b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9b6a00640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b806ec00 0x7fd9b81456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9b7400640 1 -- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b806f6a0 msgr2=0x7fd9b8099b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9b7400640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b806f6a0 0x7fd9b8099b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9b7400640 1 -- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b806ec00 msgr2=0x7fd9b81456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9b7400640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b806ec00 0x7fd9b81456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9b7400640 1 -- 172.21.15.59:0/2710841204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b8148190 con 0x7fd9b815ad90 2024-05-30T16:59:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9b7400640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b815ad90 0x7fd9b8149f50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000d5d0 tx=0x7fd9b000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9af400640 1 -- 172.21.15.59:0/2710841204 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00125f0 con 0x7fd9b815ad90 2024-05-30T16:59:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9af400640 1 -- 172.21.15.59:0/2710841204 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b0019070 con 0x7fd9b815ad90 2024-05-30T16:59:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9af400640 1 -- 172.21.15.59:0/2710841204 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00129d0 con 0x7fd9b815ad90 2024-05-30T16:59:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9bde00640 1 -- 172.21.15.59:0/2710841204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b80aebf0 con 0x7fd9b815ad90 2024-05-30T16:59:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9bde00640 1 -- 172.21.15.59:0/2710841204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b80aee90 con 0x7fd9b815ad90 2024-05-30T16:59:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.056+0000 7fd9bde00640 1 -- 172.21.15.59:0/2710841204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b8068a90 con 0x7fd9b815ad90 2024-05-30T16:59:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.060+0000 7fd9af400640 1 -- 172.21.15.59:0/2710841204 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7fd9b0012b70 con 0x7fd9b815ad90 2024-05-30T16:59:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.060+0000 7fd9af400640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd998069580 0x7fd99806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.060+0000 7fd9af400640 1 -- 172.21.15.59:0/2710841204 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fd9b0085870 con 0x7fd9b815ad90 2024-05-30T16:59:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.060+0000 7fd9b6a00640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd998069580 0x7fd99806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.060+0000 7fd9b6a00640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd998069580 0x7fd99806ba40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80ae000 tx=0x7fd9a80a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.064+0000 7fd9af400640 1 -- 172.21.15.59:0/2710841204 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd9b0057230 con 0x7fd9b815ad90 2024-05-30T16:59:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.256+0000 7fd9bde00640 1 -- 172.21.15.59:0/2710841204 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69882", "target": ["mon-mgr", ""]}) -- 0x7fd9b8148ac0 con 0x7fd998069580 2024-05-30T16:59:10.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.276+0000 7fd9af400640 1 -- 172.21.15.59:0/2710841204 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd9b8148ac0 con 0x7fd998069580 2024-05-30T16:59:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.280+0000 7fd9bde00640 1 -- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd998069580 msgr2=0x7fd99806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.280+0000 7fd9bde00640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd998069580 0x7fd99806ba40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80ae000 tx=0x7fd9a80a7070 comp rx=0 tx=0).stop 2024-05-30T16:59:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.280+0000 7fd9bde00640 1 -- 172.21.15.59:0/2710841204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b815ad90 msgr2=0x7fd9b8149f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.280+0000 7fd9bde00640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b815ad90 0x7fd9b8149f50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000d5d0 tx=0x7fd9b000da90 comp rx=0 tx=0).stop 2024-05-30T16:59:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.280+0000 7fd9bde00640 1 -- 172.21.15.59:0/2710841204 shutdown_connections 2024-05-30T16:59:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.280+0000 7fd9bde00640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd998069580 0x7fd99806ba40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.280+0000 7fd9bde00640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b815ad90 0x7fd9b8149f50 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.280+0000 7fd9bde00640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b806f6a0 0x7fd9b8099b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.280+0000 7fd9bde00640 1 --2- 172.21.15.59:0/2710841204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b806ec00 0x7fd9b81456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.280+0000 7fd9bde00640 1 -- 172.21.15.59:0/2710841204 >> 172.21.15.59:0/2710841204 conn(0x7fd9b80b1e60 msgr2=0x7fd9b814c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.280+0000 7fd9bde00640 1 -- 172.21.15.59:0/2710841204 shutdown_connections 2024-05-30T16:59:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.280+0000 7fd9bde00640 1 -- 172.21.15.59:0/2710841204 wait complete. 2024-05-30T16:59:10.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone698813 2024-05-30T16:59:10.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff592600640 1 Processor -- start 2024-05-30T16:59:10.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff592600640 1 -- start start 2024-05-30T16:59:10.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff592600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff58c09aa40 0x7ff58c09b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff592600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0cd570 0x7ff58c0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff592600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff58c0d1840 con 0x7ff58c0d1050 2024-05-30T16:59:10.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff592600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff58c0cca90 con 0x7ff58c09aa40 2024-05-30T16:59:10.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff592600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff58c0ccd70 con 0x7ff58c0cd570 2024-05-30T16:59:10.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff591200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff58c09aa40 0x7ff58c09b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff583e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff58c0d1050 0x7ff58c09ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59970/0 (socket says 172.21.15.59:59970) 2024-05-30T16:59:10.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff583e00640 1 -- 172.21.15.59:0/1026950351 learned_addr learned my addr 172.21.15.59:0/1026950351 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:10.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff591c00640 1 --2- 172.21.15.59:0/1026950351 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0cd570 0x7ff58c0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff591200640 1 -- 172.21.15.59:0/1026950351 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0cd570 msgr2=0x7ff58c0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:10.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff591200640 1 --2- 172.21.15.59:0/1026950351 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0cd570 0x7ff58c0cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff591200640 1 -- 172.21.15.59:0/1026950351 >> v1:172.21.15.59:6789/0 conn(0x7ff58c0d1050 legacy=0x7ff58c09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.448+0000 7ff591200640 1 -- 172.21.15.59:0/1026950351 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c0cd050 con 0x7ff58c09aa40 2024-05-30T16:59:10.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff591200640 1 --2- 172.21.15.59:0/1026950351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58c09aa40 0x7ff58c09b940 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0097f0 tx=0x7ff57c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5820499a7f00b727 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:10.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff58be00640 1 -- 172.21.15.59:0/1026950351 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0b5070 con 0x7ff58c09aa40 2024-05-30T16:59:10.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff58be00640 1 -- 172.21.15.59:0/1026950351 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c0a8990 con 0x7ff58c09aa40 2024-05-30T16:59:10.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff58be00640 1 -- 172.21.15.59:0/1026950351 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0a8d60 con 0x7ff58c09aa40 2024-05-30T16:59:10.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff592600640 1 -- 172.21.15.59:0/1026950351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58c09aa40 msgr2=0x7ff58c09b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff592600640 1 --2- 172.21.15.59:0/1026950351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58c09aa40 0x7ff58c09b940 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0097f0 tx=0x7ff57c01ec90 comp rx=0 tx=0).stop 2024-05-30T16:59:10.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff592600640 1 -- 172.21.15.59:0/1026950351 shutdown_connections 2024-05-30T16:59:10.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff592600640 1 --2- 172.21.15.59:0/1026950351 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0cd570 0x7ff58c0cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff592600640 1 --2- 172.21.15.59:0/1026950351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58c09aa40 0x7ff58c09b940 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff592600640 1 -- 172.21.15.59:0/1026950351 >> 172.21.15.59:0/1026950351 conn(0x7ff58c0b3db0 msgr2=0x7ff58c0b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:10.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff592600640 1 -- 172.21.15.59:0/1026950351 shutdown_connections 2024-05-30T16:59:10.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff592600640 1 -- 172.21.15.59:0/1026950351 wait complete. 2024-05-30T16:59:10.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff592600640 1 Processor -- start 2024-05-30T16:59:10.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.452+0000 7ff592600640 1 -- start start 2024-05-30T16:59:10.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff592600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c09aa40 0x7ff58c1f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff592600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c0cd570 0x7ff58c1f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff592600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58c0d1050 0x7ff58c0b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff592600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c0ce0c0 con 0x7ff58c0d1050 2024-05-30T16:59:10.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff592600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c0cdf40 con 0x7ff58c0cd570 2024-05-30T16:59:10.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff592600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff58c0ce240 con 0x7ff58c09aa40 2024-05-30T16:59:10.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff591c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58c0d1050 0x7ff58c0b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff591c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58c0d1050 0x7ff58c0b76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35102/0 (socket says 172.21.15.59:35102) 2024-05-30T16:59:10.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff591c00640 1 -- 172.21.15.59:0/3390536305 learned_addr learned my addr 172.21.15.59:0/3390536305 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:10.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff591200640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c09aa40 0x7ff58c1f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff583e00640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c0cd570 0x7ff58c1f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff591c00640 1 -- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c09aa40 msgr2=0x7ff58c1f7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff591c00640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c09aa40 0x7ff58c1f7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff591c00640 1 -- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c0cd570 msgr2=0x7ff58c1f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff591c00640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c0cd570 0x7ff58c1f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff591c00640 1 -- 172.21.15.59:0/3390536305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c0c6fa0 con 0x7ff58c0d1050 2024-05-30T16:59:10.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff591c00640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58c0d1050 0x7ff58c0b76b0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff584007e40 tx=0x7ff58400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:10.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff589600640 1 -- 172.21.15.59:0/3390536305 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584014620 con 0x7ff58c0d1050 2024-05-30T16:59:10.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff589600640 1 -- 172.21.15.59:0/3390536305 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff584019070 con 0x7ff58c0d1050 2024-05-30T16:59:10.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff589600640 1 -- 172.21.15.59:0/3390536305 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584014a20 con 0x7ff58c0d1050 2024-05-30T16:59:10.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff592600640 1 -- 172.21.15.59:0/3390536305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58c0c7240 con 0x7ff58c0d1050 2024-05-30T16:59:10.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff592600640 1 -- 172.21.15.59:0/3390536305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58c0c7800 con 0x7ff58c0d1050 2024-05-30T16:59:10.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.456+0000 7ff592600640 1 -- 172.21.15.59:0/3390536305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff58c068a90 con 0x7ff58c0d1050 2024-05-30T16:59:10.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.460+0000 7ff589600640 1 -- 172.21.15.59:0/3390536305 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7ff584014bc0 con 0x7ff58c0d1050 2024-05-30T16:59:10.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.460+0000 7ff589600640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff568069580 0x7ff56806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.460+0000 7ff589600640 1 -- 172.21.15.59:0/3390536305 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7ff584086060 con 0x7ff58c0d1050 2024-05-30T16:59:10.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.460+0000 7ff591200640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff568069580 0x7ff56806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.460+0000 7ff591200640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff568069580 0x7ff56806ba40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0b2000 tx=0x7ff57c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:10.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.464+0000 7ff589600640 1 -- 172.21.15.59:0/3390536305 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff5840576b0 con 0x7ff58c0d1050 2024-05-30T16:59:10.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.656+0000 7ff592600640 1 -- 172.21.15.59:0/3390536305 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone698813", "target": ["mon-mgr", ""]}) -- 0x7ff58c0c5b10 con 0x7ff568069580 2024-05-30T16:59:10.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.672+0000 7ff589600640 1 -- 172.21.15.59:0/3390536305 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff58c0c5b10 con 0x7ff568069580 2024-05-30T16:59:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.676+0000 7ff592600640 1 -- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff568069580 msgr2=0x7ff56806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.676+0000 7ff592600640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff568069580 0x7ff56806ba40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0b2000 tx=0x7ff57c008040 comp rx=0 tx=0).stop 2024-05-30T16:59:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.676+0000 7ff592600640 1 -- 172.21.15.59:0/3390536305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58c0d1050 msgr2=0x7ff58c0b76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.676+0000 7ff592600640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58c0d1050 0x7ff58c0b76b0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff584007e40 tx=0x7ff58400e4b0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.676+0000 7ff592600640 1 -- 172.21.15.59:0/3390536305 shutdown_connections 2024-05-30T16:59:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.676+0000 7ff592600640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff568069580 0x7ff56806ba40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.676+0000 7ff592600640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58c0d1050 0x7ff58c0b76b0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.676+0000 7ff592600640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c0cd570 0x7ff58c1f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.676+0000 7ff592600640 1 --2- 172.21.15.59:0/3390536305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c09aa40 0x7ff58c1f7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.676+0000 7ff592600640 1 -- 172.21.15.59:0/3390536305 >> 172.21.15.59:0/3390536305 conn(0x7ff58c0b3db0 msgr2=0x7ff58c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.676+0000 7ff592600640 1 -- 172.21.15.59:0/3390536305 shutdown_connections 2024-05-30T16:59:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.676+0000 7ff592600640 1 -- 172.21.15.59:0/3390536305 wait complete. 2024-05-30T16:59:10.697 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone698820 2024-05-30T16:59:10.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.840+0000 7f3ec9400640 1 Processor -- start 2024-05-30T16:59:10.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.840+0000 7f3ec9400640 1 -- start start 2024-05-30T16:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.844+0000 7f3ec9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3ec4161e20 0x7f3ec406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.844+0000 7f3ec9400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec4163130 con 0x7f3ec406cf00 2024-05-30T16:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.844+0000 7f3ec9400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec40b3d50 con 0x7f3ec40730e0 2024-05-30T16:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.844+0000 7f3ec9400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3ec40b4030 con 0x7f3ec4161e20 2024-05-30T16:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.844+0000 7f3ec2800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3ec4161e20 0x7f3ec406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.844+0000 7f3ec3200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3ec406cf00 0x7f3ec4162a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59986/0 (socket says 172.21.15.59:59986) 2024-05-30T16:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.844+0000 7f3ec3200640 1 -- 172.21.15.59:0/613546579 learned_addr learned my addr 172.21.15.59:0/613546579 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.844+0000 7f3ec2800640 1 -- 172.21.15.59:0/613546579 >> v1:172.21.15.107:6789/0 conn(0x7f3ec40730e0 legacy=0x7f3ec4162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.844+0000 7f3ec2800640 1 -- 172.21.15.59:0/613546579 >> v1:172.21.15.59:6789/0 conn(0x7f3ec406cf00 legacy=0x7f3ec4162a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.844+0000 7f3ec2800640 1 -- 172.21.15.59:0/613546579 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec406e7c0 con 0x7f3ec4161e20 2024-05-30T16:59:10.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec2800640 1 --2- 172.21.15.59:0/613546579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4161e20 0x7f3ec406c9c0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009d90 tx=0x7f3eb401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3adb62db477447 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:10.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec1e00640 1 -- 172.21.15.59:0/613546579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40b4070 con 0x7f3ec4161e20 2024-05-30T16:59:10.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec1e00640 1 -- 172.21.15.59:0/613546579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb40af600 con 0x7f3ec4161e20 2024-05-30T16:59:10.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec1e00640 1 -- 172.21.15.59:0/613546579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40af9d0 con 0x7f3ec4161e20 2024-05-30T16:59:10.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 -- 172.21.15.59:0/613546579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4161e20 msgr2=0x7f3ec406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 --2- 172.21.15.59:0/613546579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4161e20 0x7f3ec406c9c0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009d90 tx=0x7f3eb401f150 comp rx=0 tx=0).stop 2024-05-30T16:59:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 -- 172.21.15.59:0/613546579 shutdown_connections 2024-05-30T16:59:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 --2- 172.21.15.59:0/613546579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4161e20 0x7f3ec406c9c0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 -- 172.21.15.59:0/613546579 >> 172.21.15.59:0/613546579 conn(0x7f3ec40725c0 msgr2=0x7f3ec40729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 -- 172.21.15.59:0/613546579 shutdown_connections 2024-05-30T16:59:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 -- 172.21.15.59:0/613546579 wait complete. 2024-05-30T16:59:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 Processor -- start 2024-05-30T16:59:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 -- start start 2024-05-30T16:59:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ec406cf00 0x7f3ec4143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ec40730e0 0x7f3ec41462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4161e20 0x7f3ec41ea320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec40b3a20 con 0x7f3ec4161e20 2024-05-30T16:59:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec406ed80 con 0x7f3ec40730e0 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec9400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec40d0820 con 0x7f3ec406cf00 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4161e20 0x7f3ec41ea320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec2800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ec406cf00 0x7f3ec4143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3eb9e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ec40730e0 0x7f3ec41462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec2800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ec406cf00 0x7f3ec4143930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:41370/0 (socket says 172.21.15.59:41370) 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec2800640 1 -- 172.21.15.59:0/4189530556 learned_addr learned my addr 172.21.15.59:0/4189530556 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.848+0000 7f3ec3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4161e20 0x7f3ec41ea320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35110/0 (socket says 172.21.15.59:35110) 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ec2800640 1 -- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ec40730e0 msgr2=0x7f3ec41462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ec2800640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ec40730e0 0x7f3ec41462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ec2800640 1 -- 172.21.15.59:0/4189530556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4161e20 msgr2=0x7f3ec41ea320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ec2800640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4161e20 0x7f3ec41ea320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ec2800640 1 -- 172.21.15.59:0/4189530556 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec40d00a0 con 0x7f3ec406cf00 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ec3200640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4161e20 0x7f3ec41ea320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:59:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ec2800640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ec406cf00 0x7f3ec4143930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3eb401bd60 tx=0x7f3eb401bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ebb400640 1 -- 172.21.15.59:0/4189530556 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40b4040 con 0x7f3ec406cf00 2024-05-30T16:59:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ebb400640 1 -- 172.21.15.59:0/4189530556 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb40c1070 con 0x7f3ec406cf00 2024-05-30T16:59:10.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ebb400640 1 -- 172.21.15.59:0/4189530556 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40ba670 con 0x7f3ec406cf00 2024-05-30T16:59:10.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ec9400640 1 -- 172.21.15.59:0/4189530556 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec4146d30 con 0x7f3ec406cf00 2024-05-30T16:59:10.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ec9400640 1 -- 172.21.15.59:0/4189530556 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec4144470 con 0x7f3ec406cf00 2024-05-30T16:59:10.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ec9400640 1 -- 172.21.15.59:0/4189530556 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec4068a90 con 0x7f3ec406cf00 2024-05-30T16:59:10.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ebb400640 1 -- 172.21.15.59:0/4189530556 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7f3eb40ba810 con 0x7f3ec406cf00 2024-05-30T16:59:10.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.852+0000 7f3ebb400640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3ea0069580 0x7f3ea006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:10.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.856+0000 7f3ebb400640 1 -- 172.21.15.59:0/4189530556 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f3eb41242c0 con 0x7f3ec406cf00 2024-05-30T16:59:10.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.856+0000 7f3eb9e00640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3ea0069580 0x7f3ea006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:10.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.856+0000 7f3eb9e00640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3ea0069580 0x7f3ea006ba40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40cf3a0 tx=0x7f3eac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:10.860+0000 7f3ebb400640 1 -- 172.21.15.59:0/4189530556 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3eb4018cb0 con 0x7f3ec406cf00 2024-05-30T16:59:11.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.052+0000 7f3ec9400640 1 -- 172.21.15.59:0/4189530556 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone698820", "target": ["mon-mgr", ""]}) -- 0x7f3ec40ccca0 con 0x7f3ea0069580 2024-05-30T16:59:11.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.064+0000 7f3ebb400640 1 -- 172.21.15.59:0/4189530556 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3ec40ccca0 con 0x7f3ea0069580 2024-05-30T16:59:11.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.068+0000 7f3ec9400640 1 -- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3ea0069580 msgr2=0x7f3ea006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.068+0000 7f3ec9400640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3ea0069580 0x7f3ea006ba40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40cf3a0 tx=0x7f3eac009040 comp rx=0 tx=0).stop 2024-05-30T16:59:11.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.068+0000 7f3ec9400640 1 -- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ec406cf00 msgr2=0x7f3ec4143930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.068+0000 7f3ec9400640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ec406cf00 0x7f3ec4143930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3eb401bd60 tx=0x7f3eb401bef0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.068+0000 7f3ec9400640 1 -- 172.21.15.59:0/4189530556 shutdown_connections 2024-05-30T16:59:11.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.068+0000 7f3ec9400640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3ea0069580 0x7f3ea006ba40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.068+0000 7f3ec9400640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4161e20 0x7f3ec41ea320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.068+0000 7f3ec9400640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ec40730e0 0x7f3ec41462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.068+0000 7f3ec9400640 1 --2- 172.21.15.59:0/4189530556 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ec406cf00 0x7f3ec4143930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.068+0000 7f3ec9400640 1 -- 172.21.15.59:0/4189530556 >> 172.21.15.59:0/4189530556 conn(0x7f3ec40725c0 msgr2=0x7f3ec40cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:11.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.068+0000 7f3ec9400640 1 -- 172.21.15.59:0/4189530556 shutdown_connections 2024-05-30T16:59:11.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.068+0000 7f3ec9400640 1 -- 172.21.15.59:0/4189530556 wait complete. 2024-05-30T16:59:11.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T16:59:11.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.232+0000 7fda30200640 1 Processor -- start 2024-05-30T16:59:11.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.232+0000 7fda30200640 1 -- start start 2024-05-30T16:59:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda30200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fda2809b7a0 0x7fda28162410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda30200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fda28162950 0x7fda2815e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda30200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda280d1020 con 0x7fda28161ce0 2024-05-30T16:59:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda30200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fda280d1300 con 0x7fda28162950 2024-05-30T16:59:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda30200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fda280d15e0 con 0x7fda2809b7a0 2024-05-30T16:59:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda2d800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fda28161ce0 0x7fda280d0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59996/0 (socket says 172.21.15.59:59996) 2024-05-30T16:59:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda2d800640 1 -- 172.21.15.59:0/1640740496 learned_addr learned my addr 172.21.15.59:0/1640740496 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda2e200640 1 --2- 172.21.15.59:0/1640740496 >> v2:172.21.15.59:3300/0 conn(0x7fda28162950 0x7fda2815e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda2ce00640 1 --2- 172.21.15.59:0/1640740496 >> v2:172.21.15.107:3300/0 conn(0x7fda2809b7a0 0x7fda28162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda2e200640 1 -- 172.21.15.59:0/1640740496 >> v2:172.21.15.107:3300/0 conn(0x7fda2809b7a0 msgr2=0x7fda28162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda2e200640 1 --2- 172.21.15.59:0/1640740496 >> v2:172.21.15.107:3300/0 conn(0x7fda2809b7a0 0x7fda28162410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda2e200640 1 -- 172.21.15.59:0/1640740496 >> v1:172.21.15.59:6789/0 conn(0x7fda28161ce0 legacy=0x7fda280d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda2e200640 1 -- 172.21.15.59:0/1640740496 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda280d18c0 con 0x7fda28162950 2024-05-30T16:59:11.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda27e00640 1 -- 172.21.15.59:0/1640740496 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4176131970 0 0) 0x7fda280d1020 con 0x7fda28161ce0 2024-05-30T16:59:11.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.236+0000 7fda2e200640 1 --2- 172.21.15.59:0/1640740496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda28162950 0x7fda2815e180 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fda2806e7f0 tx=0x7fda2001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e9fc778fd7e217 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda27e00640 1 -- 172.21.15.59:0/1640740496 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda200b2070 con 0x7fda28162950 2024-05-30T16:59:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda27e00640 1 -- 172.21.15.59:0/1640740496 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda200a5900 con 0x7fda28162950 2024-05-30T16:59:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda27e00640 1 -- 172.21.15.59:0/1640740496 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda200a5cd0 con 0x7fda28162950 2024-05-30T16:59:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 -- 172.21.15.59:0/1640740496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda28162950 msgr2=0x7fda2815e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 --2- 172.21.15.59:0/1640740496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda28162950 0x7fda2815e180 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fda2806e7f0 tx=0x7fda2001c930 comp rx=0 tx=0).stop 2024-05-30T16:59:11.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 -- 172.21.15.59:0/1640740496 shutdown_connections 2024-05-30T16:59:11.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 --2- 172.21.15.59:0/1640740496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda28162950 0x7fda2815e180 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 --2- 172.21.15.59:0/1640740496 >> v2:172.21.15.107:3300/0 conn(0x7fda2809b7a0 0x7fda28162410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 -- 172.21.15.59:0/1640740496 >> 172.21.15.59:0/1640740496 conn(0x7fda280b4000 msgr2=0x7fda280b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:11.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 -- 172.21.15.59:0/1640740496 shutdown_connections 2024-05-30T16:59:11.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 -- 172.21.15.59:0/1640740496 wait complete. 2024-05-30T16:59:11.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 Processor -- start 2024-05-30T16:59:11.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 -- start start 2024-05-30T16:59:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda2809b7a0 0x7fda280b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda28161ce0 0x7fda28157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda28162950 0x7fda28153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fda2815f260 con 0x7fda28162950 2024-05-30T16:59:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fda2815f0e0 con 0x7fda28161ce0 2024-05-30T16:59:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda30200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fda2815f3e0 con 0x7fda2809b7a0 2024-05-30T16:59:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda2e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda28162950 0x7fda28153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda2e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda28162950 0x7fda28153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35122/0 (socket says 172.21.15.59:35122) 2024-05-30T16:59:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda2e200640 1 -- 172.21.15.59:0/3928351841 learned_addr learned my addr 172.21.15.59:0/3928351841 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:11.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda2ce00640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda28161ce0 0x7fda28157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.240+0000 7fda2d800640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda2809b7a0 0x7fda280b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda2e200640 1 -- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda2809b7a0 msgr2=0x7fda280b7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda2e200640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda2809b7a0 0x7fda280b7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda2e200640 1 -- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda28161ce0 msgr2=0x7fda28157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda2e200640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda28161ce0 0x7fda28157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda2e200640 1 -- 172.21.15.59:0/3928351841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda28153980 con 0x7fda28162950 2024-05-30T16:59:11.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda2e200640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda28162950 0x7fda28153440 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fda200b0040 tx=0x7fda200196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:11.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda25600640 1 -- 172.21.15.59:0/3928351841 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda200b2040 con 0x7fda28162950 2024-05-30T16:59:11.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda25600640 1 -- 172.21.15.59:0/3928351841 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda200039a0 con 0x7fda28162950 2024-05-30T16:59:11.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda25600640 1 -- 172.21.15.59:0/3928351841 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20003d90 con 0x7fda28162950 2024-05-30T16:59:11.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda30200640 1 -- 172.21.15.59:0/3928351841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda28157e80 con 0x7fda28162950 2024-05-30T16:59:11.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda30200640 1 -- 172.21.15.59:0/3928351841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda28158440 con 0x7fda28162950 2024-05-30T16:59:11.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda30200640 1 -- 172.21.15.59:0/3928351841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda28068a90 con 0x7fda28162950 2024-05-30T16:59:11.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda25600640 1 -- 172.21.15.59:0/3928351841 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7fda200c1030 con 0x7fda28162950 2024-05-30T16:59:11.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.244+0000 7fda25600640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fda080695b0 0x7fda0806ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.248+0000 7fda25600640 1 -- 172.21.15.59:0/3928351841 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fda201209c0 con 0x7fda28162950 2024-05-30T16:59:11.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.248+0000 7fda2d800640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fda080695b0 0x7fda0806ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.248+0000 7fda2d800640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fda080695b0 0x7fda0806ba70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fda1c007fd0 tx=0x7fda1c007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.248+0000 7fda25600640 1 -- 172.21.15.59:0/3928351841 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fda200c8020 con 0x7fda28162950 2024-05-30T16:59:11.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.444+0000 7fda30200640 1 -- 172.21.15.59:0/3928351841 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda280b4bb0 con 0x7fda080695b0 2024-05-30T16:59:11.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.456+0000 7fda25600640 1 -- 172.21.15.59:0/3928351841 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fda280b4bb0 con 0x7fda080695b0 2024-05-30T16:59:11.459 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:11.459 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:59:11.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:11.460 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ss1" 2024-05-30T16:59:11.460 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:11.460 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:59:11.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.460+0000 7fda30200640 1 -- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fda080695b0 msgr2=0x7fda0806ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.460+0000 7fda30200640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fda080695b0 0x7fda0806ba70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fda1c007fd0 tx=0x7fda1c007d60 comp rx=0 tx=0).stop 2024-05-30T16:59:11.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.460+0000 7fda30200640 1 -- 172.21.15.59:0/3928351841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda28162950 msgr2=0x7fda28153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.460+0000 7fda30200640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda28162950 0x7fda28153440 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fda200b0040 tx=0x7fda200196d0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.460+0000 7fda30200640 1 -- 172.21.15.59:0/3928351841 shutdown_connections 2024-05-30T16:59:11.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.460+0000 7fda30200640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fda080695b0 0x7fda0806ba70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.460+0000 7fda30200640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda28162950 0x7fda28153440 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.460+0000 7fda30200640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda28161ce0 0x7fda28157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.460+0000 7fda30200640 1 --2- 172.21.15.59:0/3928351841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda2809b7a0 0x7fda280b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.460+0000 7fda30200640 1 -- 172.21.15.59:0/3928351841 >> 172.21.15.59:0/3928351841 conn(0x7fda280b4000 msgr2=0x7fda28074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:11.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.460+0000 7fda30200640 1 -- 172.21.15.59:0/3928351841 shutdown_connections 2024-05-30T16:59:11.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.460+0000 7fda30200640 1 -- 172.21.15.59:0/3928351841 wait complete. 2024-05-30T16:59:11.481 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T16:59:11.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45e5000640 1 Processor -- start 2024-05-30T16:59:11.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45e5000640 1 -- start start 2024-05-30T16:59:11.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45e5000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00d0d70 0x7f45e015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45e5000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45e00ad770 con 0x7f45e01569e0 2024-05-30T16:59:11.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45e5000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45e015cb40 con 0x7f45e00ad2b0 2024-05-30T16:59:11.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45e5000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f45e015ce20 con 0x7f45e00d0d70 2024-05-30T16:59:11.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dde00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f45e01569e0 0x7f45e00cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60012/0 (socket says 172.21.15.59:60012) 2024-05-30T16:59:11.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dde00640 1 -- 172.21.15.59:0/601500461 learned_addr learned my addr 172.21.15.59:0/601500461 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:11.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45de800640 1 --2- 172.21.15.59:0/601500461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00d0d70 0x7f45e015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1605287007 0 0) 0x7f45e00ad770 con 0x7f45e01569e0 2024-05-30T16:59:11.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45c4003530 con 0x7f45e01569e0 2024-05-30T16:59:11.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2269566105 0 0) 0x7f45c4003530 con 0x7f45e01569e0 2024-05-30T16:59:11.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00d0d70 msgr2=0x7f45e015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:11.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 --2- 172.21.15.59:0/601500461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00d0d70 0x7f45e015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 >> v1:172.21.15.107:6789/0 conn(0x7f45e00ad2b0 legacy=0x7f45e00d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e015d100 con 0x7f45e01569e0 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f45d0001a00 con 0x7f45e01569e0 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 >> v1:172.21.15.59:6789/0 conn(0x7f45e01569e0 legacy=0x7f45e00cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 --2- 172.21.15.59:0/601500461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45c40039f0 0x7f45c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 --2- 172.21.15.59:0/601500461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40043a0 0x7f45c4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 --2- 172.21.15.59:0/601500461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00d0d70 0x7f45c4005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f45e015ce20 con 0x7f45c40043a0 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f45c400bab0 con 0x7f45c40039f0 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f45c400bcb0 con 0x7f45e00d0d70 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45d5400640 1 --2- 172.21.15.59:0/601500461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40043a0 0x7f45c4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45dde00640 1 --2- 172.21.15.59:0/601500461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45c40039f0 0x7f45c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45de800640 1 --2- 172.21.15.59:0/601500461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00d0d70 0x7f45c4005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45d5400640 1 -- 172.21.15.59:0/601500461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00d0d70 msgr2=0x7f45c4005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45d5400640 1 --2- 172.21.15.59:0/601500461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00d0d70 0x7f45c4005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45d5400640 1 -- 172.21.15.59:0/601500461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45c40039f0 msgr2=0x7f45c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45d5400640 1 --2- 172.21.15.59:0/601500461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45c40039f0 0x7f45c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.628+0000 7f45d5400640 1 -- 172.21.15.59:0/601500461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c4003530 con 0x7f45c40043a0 2024-05-30T16:59:11.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.632+0000 7f45d5400640 1 --2- 172.21.15.59:0/601500461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40043a0 0x7f45c4004870 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f45c8001860 tx=0x7f45c801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6e2e45438804f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:11.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.632+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c80b0070 con 0x7f45c40043a0 2024-05-30T16:59:11.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.632+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c80ab600 con 0x7f45c40043a0 2024-05-30T16:59:11.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.632+0000 7f45dd400640 1 -- 172.21.15.59:0/601500461 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8001460 con 0x7f45c40043a0 2024-05-30T16:59:11.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.632+0000 7f45e5000640 1 -- 172.21.15.59:0/601500461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40043a0 msgr2=0x7f45c4004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.632+0000 7f45e5000640 1 --2- 172.21.15.59:0/601500461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40043a0 0x7f45c4004870 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f45c8001860 tx=0x7f45c801c500 comp rx=0 tx=0).stop 2024-05-30T16:59:11.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.632+0000 7f45de800640 1 -- 172.21.15.59:0/601500461 reap_dead start 2024-05-30T16:59:11.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.632+0000 7f45e5000640 1 -- 172.21.15.59:0/601500461 shutdown_connections 2024-05-30T16:59:11.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.632+0000 7f45e5000640 1 -- 172.21.15.59:0/601500461 >> 172.21.15.59:0/601500461 conn(0x7f45e006bdb0 msgr2=0x7f45e006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:11.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.632+0000 7f45e5000640 1 -- 172.21.15.59:0/601500461 shutdown_connections 2024-05-30T16:59:11.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.632+0000 7f45e5000640 1 -- 172.21.15.59:0/601500461 wait complete. 2024-05-30T16:59:11.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45e5000640 1 Processor -- start 2024-05-30T16:59:11.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45e5000640 1 -- start start 2024-05-30T16:59:11.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45e5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40043a0 0x7f45e01f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45e5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45e01fa000 0x7f45e00b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45e5000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00b2a70 0x7f45e015b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45e5000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f45e00b3e70 con 0x7f45c40043a0 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45e5000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f45e00b3cf0 con 0x7f45e01fa000 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45e5000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f45e00b3ff0 con 0x7f45e00b2a70 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45dde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40043a0 0x7f45e01f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45dde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40043a0 0x7f45e01f7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35128/0 (socket says 172.21.15.59:35128) 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45dde00640 1 -- 172.21.15.59:0/24200359 learned_addr learned my addr 172.21.15.59:0/24200359 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45de800640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00b2a70 0x7f45e015b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45d5400640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45e01fa000 0x7f45e00b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45dde00640 1 -- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00b2a70 msgr2=0x7f45e015b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45dde00640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00b2a70 0x7f45e015b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45dde00640 1 -- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45e01fa000 msgr2=0x7f45e00b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45dde00640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45e01fa000 0x7f45e00b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45dde00640 1 -- 172.21.15.59:0/24200359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e014dfa0 con 0x7f45c40043a0 2024-05-30T16:59:11.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45de800640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00b2a70 0x7f45e015b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:11.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45d5400640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45e01fa000 0x7f45e00b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:11.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45dde00640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40043a0 0x7f45e01f7260 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f45d0007770 tx=0x7f45d000a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:11.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45d6a00640 1 -- 172.21.15.59:0/24200359 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d000ad40 con 0x7f45c40043a0 2024-05-30T16:59:11.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45d6a00640 1 -- 172.21.15.59:0/24200359 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d0018070 con 0x7f45c40043a0 2024-05-30T16:59:11.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45d6a00640 1 -- 172.21.15.59:0/24200359 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d0013630 con 0x7f45c40043a0 2024-05-30T16:59:11.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45e5000640 1 -- 172.21.15.59:0/24200359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e014e280 con 0x7f45c40043a0 2024-05-30T16:59:11.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.636+0000 7f45e5000640 1 -- 172.21.15.59:0/24200359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e014e840 con 0x7f45c40043a0 2024-05-30T16:59:11.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.640+0000 7f45e5000640 1 -- 172.21.15.59:0/24200359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e00b2e50 con 0x7f45c40043a0 2024-05-30T16:59:11.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.640+0000 7f45d6a00640 1 -- 172.21.15.59:0/24200359 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7f45d00137d0 con 0x7f45c40043a0 2024-05-30T16:59:11.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.640+0000 7f45d6a00640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45bc069580 0x7f45bc06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:11.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.640+0000 7f45d6a00640 1 -- 172.21.15.59:0/24200359 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f45d0086080 con 0x7f45c40043a0 2024-05-30T16:59:11.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.640+0000 7f45d5400640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45bc069580 0x7f45bc06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:11.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.640+0000 7f45d5400640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45bc069580 0x7f45bc06ba40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f45c80ad000 tx=0x7f45c80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.644+0000 7f45d6a00640 1 -- 172.21.15.59:0/24200359 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f45d0057d80 con 0x7f45c40043a0 2024-05-30T16:59:11.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.840+0000 7f45e5000640 1 -- 172.21.15.59:0/24200359 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45e0068a90 con 0x7f45bc069580 2024-05-30T16:59:11.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45d6a00640 1 -- 172.21.15.59:0/24200359 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f45e0068a90 con 0x7f45bc069580 2024-05-30T16:59:11.868 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:11.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45e5000640 1 -- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45bc069580 msgr2=0x7f45bc06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45e5000640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45bc069580 0x7f45bc06ba40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f45c80ad000 tx=0x7f45c80a6000 comp rx=0 tx=0).stop 2024-05-30T16:59:11.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45e5000640 1 -- 172.21.15.59:0/24200359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40043a0 msgr2=0x7f45e01f7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:11.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45e5000640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40043a0 0x7f45e01f7260 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f45d0007770 tx=0x7f45d000a360 comp rx=0 tx=0).stop 2024-05-30T16:59:11.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45e5000640 1 -- 172.21.15.59:0/24200359 shutdown_connections 2024-05-30T16:59:11.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45e5000640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45bc069580 0x7f45bc06ba40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45e5000640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45e00b2a70 0x7f45e015b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45e5000640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45e01fa000 0x7f45e00b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45e5000640 1 --2- 172.21.15.59:0/24200359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40043a0 0x7f45e01f7260 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:11.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45e5000640 1 -- 172.21.15.59:0/24200359 >> 172.21.15.59:0/24200359 conn(0x7f45e006bdb0 msgr2=0x7f45e0150390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:11.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45e5000640 1 -- 172.21.15.59:0/24200359 shutdown_connections 2024-05-30T16:59:11.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:11.868+0000 7f45e5000640 1 -- 172.21.15.59:0/24200359 wait complete. 2024-05-30T16:59:11.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T16:59:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.104+0000 7fe012c00640 1 Processor -- start 2024-05-30T16:59:12.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.104+0000 7fe012c00640 1 -- start start 2024-05-30T16:59:12.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.104+0000 7fe012c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe00c0cf950 0x7fe00c0d3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:12.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.104+0000 7fe012c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00c0cfd80 con 0x7fe00c0d1d40 2024-05-30T16:59:12.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.104+0000 7fe012c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00c0d4410 con 0x7fe00c161e60 2024-05-30T16:59:12.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.104+0000 7fe012c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe00c162240 con 0x7fe00c0cf950 2024-05-30T16:59:12.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.108+0000 7fe00be00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe00c161e60 0x7fe00c0d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:41272/0 (socket says 172.21.15.59:41272) 2024-05-30T16:59:12.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.108+0000 7fe010c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe00c0cf950 0x7fe00c0d3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:12.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.108+0000 7fe00be00640 1 -- 172.21.15.59:0/430534431 learned_addr learned my addr 172.21.15.59:0/430534431 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:12.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.108+0000 7fe010c00640 1 -- 172.21.15.59:0/430534431 >> v1:172.21.15.107:6789/0 conn(0x7fe00c161e60 legacy=0x7fe00c0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.108+0000 7fe00aa00640 1 -- 172.21.15.59:0/430534431 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4069974096 0 0) 0x7fe00c0d4410 con 0x7fe00c161e60 2024-05-30T16:59:12.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.108+0000 7fe010c00640 1 -- 172.21.15.59:0/430534431 >> v1:172.21.15.59:6789/0 conn(0x7fe00c0d1d40 legacy=0x7fe00c0b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:12.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.108+0000 7fe010c00640 1 -- 172.21.15.59:0/430534431 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00c0d5490 con 0x7fe00c0cf950 2024-05-30T16:59:12.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.112+0000 7fe010c00640 1 --2- 172.21.15.59:0/430534431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00c0cf950 0x7fe00c0d3c90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe004009d90 tx=0x7fe00401ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de2cb32d989fc9af server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:12.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.112+0000 7fe00aa00640 1 -- 172.21.15.59:0/430534431 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0040b5070 con 0x7fe00c0cf950 2024-05-30T16:59:12.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.112+0000 7fe00aa00640 1 -- 172.21.15.59:0/430534431 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0040a8d50 con 0x7fe00c0cf950 2024-05-30T16:59:12.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.112+0000 7fe00aa00640 1 -- 172.21.15.59:0/430534431 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0040b0660 con 0x7fe00c0cf950 2024-05-30T16:59:12.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.116+0000 7fe012c00640 1 -- 172.21.15.59:0/430534431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00c0cf950 msgr2=0x7fe00c0d3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.116+0000 7fe012c00640 1 --2- 172.21.15.59:0/430534431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00c0cf950 0x7fe00c0d3c90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe004009d90 tx=0x7fe00401ef60 comp rx=0 tx=0).stop 2024-05-30T16:59:12.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.116+0000 7fe012c00640 1 -- 172.21.15.59:0/430534431 shutdown_connections 2024-05-30T16:59:12.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.116+0000 7fe012c00640 1 --2- 172.21.15.59:0/430534431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00c0cf950 0x7fe00c0d3c90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.116+0000 7fe012c00640 1 -- 172.21.15.59:0/430534431 >> 172.21.15.59:0/430534431 conn(0x7fe00c067b60 msgr2=0x7fe00c067f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.116+0000 7fe012c00640 1 -- 172.21.15.59:0/430534431 shutdown_connections 2024-05-30T16:59:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.116+0000 7fe012c00640 1 -- 172.21.15.59:0/430534431 wait complete. 2024-05-30T16:59:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.120+0000 7fe012c00640 1 Processor -- start 2024-05-30T16:59:12.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.120+0000 7fe012c00640 1 -- start start 2024-05-30T16:59:12.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.120+0000 7fe012c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c0cf950 0x7fe00c0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.120+0000 7fe012c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00c0d1d40 0x7fe00c1f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.120+0000 7fe012c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00c161e60 0x7fe00c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.120+0000 7fe012c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c0d49b0 con 0x7fe00c0cf950 2024-05-30T16:59:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.120+0000 7fe012c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c0d41d0 con 0x7fe00c0d1d40 2024-05-30T16:59:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.120+0000 7fe012c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe00c0d4c90 con 0x7fe00c161e60 2024-05-30T16:59:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.120+0000 7fe00be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c0cf950 0x7fe00c0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.120+0000 7fe00be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c0cf950 0x7fe00c0b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50048/0 (socket says 172.21.15.59:50048) 2024-05-30T16:59:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.120+0000 7fe00be00640 1 -- 172.21.15.59:0/1971773045 learned_addr learned my addr 172.21.15.59:0/1971773045 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe010c00640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00c161e60 0x7fe00c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe00b400640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00c0d1d40 0x7fe00c1f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe00be00640 1 -- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00c161e60 msgr2=0x7fe00c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe00be00640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00c161e60 0x7fe00c15ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe00be00640 1 -- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00c0d1d40 msgr2=0x7fe00c1f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe00be00640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00c0d1d40 0x7fe00c1f4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe00be00640 1 -- 172.21.15.59:0/1971773045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00c1f51a0 con 0x7fe00c0cf950 2024-05-30T16:59:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe00be00640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c0cf950 0x7fe00c0b2d80 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00c410 tx=0x7fdffc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe003e00640 1 -- 172.21.15.59:0/1971773045 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0074e0 con 0x7fe00c0cf950 2024-05-30T16:59:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe003e00640 1 -- 172.21.15.59:0/1971773045 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdffc0047f0 con 0x7fe00c0cf950 2024-05-30T16:59:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe003e00640 1 -- 172.21.15.59:0/1971773045 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc007680 con 0x7fe00c0cf950 2024-05-30T16:59:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe012c00640 1 -- 172.21.15.59:0/1971773045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00c15a9b0 con 0x7fe00c0cf950 2024-05-30T16:59:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.124+0000 7fe012c00640 1 -- 172.21.15.59:0/1971773045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00c15af70 con 0x7fe00c0cf950 2024-05-30T16:59:12.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.128+0000 7fe012c00640 1 -- 172.21.15.59:0/1971773045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe00c068a90 con 0x7fe00c0cf950 2024-05-30T16:59:12.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.128+0000 7fe003e00640 1 -- 172.21.15.59:0/1971773045 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7fdffc011070 con 0x7fe00c0cf950 2024-05-30T16:59:12.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.128+0000 7fe003e00640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfec0695d0 0x7fdfec06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:12.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.132+0000 7fe003e00640 1 -- 172.21.15.59:0/1971773045 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fdffc085050 con 0x7fe00c0cf950 2024-05-30T16:59:12.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.132+0000 7fe00b400640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfec0695d0 0x7fdfec06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:12.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.132+0000 7fe00b400640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfec0695d0 0x7fdfec06ba90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe00c15ef80 tx=0x7fdff8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:12.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.136+0000 7fe003e00640 1 -- 172.21.15.59:0/1971773045 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdffc056a10 con 0x7fe00c0cf950 2024-05-30T16:59:12.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.484+0000 7fe012c00640 1 -- 172.21.15.59:0/1971773045 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fe00c0b4aa0 con 0x7fdfec0695d0 2024-05-30T16:59:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.524+0000 7fe003e00640 1 -- 172.21.15.59:0/1971773045 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe00c0b4aa0 con 0x7fdfec0695d0 2024-05-30T16:59:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.528+0000 7fe012c00640 1 -- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfec0695d0 msgr2=0x7fdfec06ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.528+0000 7fe012c00640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfec0695d0 0x7fdfec06ba90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe00c15ef80 tx=0x7fdff8009040 comp rx=0 tx=0).stop 2024-05-30T16:59:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.528+0000 7fe012c00640 1 -- 172.21.15.59:0/1971773045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c0cf950 msgr2=0x7fe00c0b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.528+0000 7fe012c00640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c0cf950 0x7fe00c0b2d80 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00c410 tx=0x7fdffc00c8d0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.528+0000 7fe012c00640 1 -- 172.21.15.59:0/1971773045 shutdown_connections 2024-05-30T16:59:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.528+0000 7fe012c00640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdfec0695d0 0x7fdfec06ba90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.528+0000 7fe012c00640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe00c161e60 0x7fe00c15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.528+0000 7fe012c00640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe00c0d1d40 0x7fe00c1f4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.528+0000 7fe012c00640 1 --2- 172.21.15.59:0/1971773045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c0cf950 0x7fe00c0b2d80 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.528+0000 7fe012c00640 1 -- 172.21.15.59:0/1971773045 >> 172.21.15.59:0/1971773045 conn(0x7fe00c067b60 msgr2=0x7fe00c0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.528+0000 7fe012c00640 1 -- 172.21.15.59:0/1971773045 shutdown_connections 2024-05-30T16:59:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.532+0000 7fe012c00640 1 -- 172.21.15.59:0/1971773045 wait complete. 2024-05-30T16:59:12.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone698812 2024-05-30T16:59:12.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8f5e00640 1 Processor -- start 2024-05-30T16:59:12.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8f5e00640 1 -- start start 2024-05-30T16:59:12.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8f5e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa8f00b4aa0 0x7fa8f00b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:12.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8f5e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f00d0ed0 con 0x7fa8f009b150 2024-05-30T16:59:12.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8f5e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f00d1690 con 0x7fa8f015ed00 2024-05-30T16:59:12.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8f5e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f015f0e0 con 0x7fa8f00b4aa0 2024-05-30T16:59:12.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8e7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa8f009b150 0x7fa8f00b1c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58814/0 (socket says 172.21.15.59:58814) 2024-05-30T16:59:12.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8e7e00640 1 -- 172.21.15.59:0/3713323546 learned_addr learned my addr 172.21.15.59:0/3713323546 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:12.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8ef400640 1 --2- 172.21.15.59:0/3713323546 >> v2:172.21.15.107:3300/0 conn(0x7fa8f00b4aa0 0x7fa8f00b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:12.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8ee000640 1 -- 172.21.15.59:0/3713323546 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2764724635 0 0) 0x7fa8f00d0ed0 con 0x7fa8f009b150 2024-05-30T16:59:12.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8ee000640 1 -- 172.21.15.59:0/3713323546 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8d4003530 con 0x7fa8f009b150 2024-05-30T16:59:12.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8ef400640 1 -- 172.21.15.59:0/3713323546 >> v1:172.21.15.107:6789/0 conn(0x7fa8f015ed00 legacy=0x7fa8f009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8ef400640 1 -- 172.21.15.59:0/3713323546 >> v1:172.21.15.59:6789/0 conn(0x7fa8f009b150 legacy=0x7fa8f00b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.700+0000 7fa8ef400640 1 -- 172.21.15.59:0/3713323546 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f00b3d60 con 0x7fa8f00b4aa0 2024-05-30T16:59:12.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.704+0000 7fa8ef400640 1 --2- 172.21.15.59:0/3713323546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f00b4aa0 0x7fa8f00b2360 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009d90 tx=0x7fa8e801c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f714a30ffb6c2234 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:12.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.704+0000 7fa8ee000640 1 -- 172.21.15.59:0/3713323546 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80b2070 con 0x7fa8f00b4aa0 2024-05-30T16:59:12.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.704+0000 7fa8ee000640 1 -- 172.21.15.59:0/3713323546 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e80a5820 con 0x7fa8f00b4aa0 2024-05-30T16:59:12.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.704+0000 7fa8ee000640 1 -- 172.21.15.59:0/3713323546 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80a5bf0 con 0x7fa8f00b4aa0 2024-05-30T16:59:12.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.704+0000 7fa8f5e00640 1 -- 172.21.15.59:0/3713323546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f00b4aa0 msgr2=0x7fa8f00b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.704+0000 7fa8f5e00640 1 --2- 172.21.15.59:0/3713323546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f00b4aa0 0x7fa8f00b2360 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009d90 tx=0x7fa8e801c850 comp rx=0 tx=0).stop 2024-05-30T16:59:12.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.704+0000 7fa8f5e00640 1 -- 172.21.15.59:0/3713323546 shutdown_connections 2024-05-30T16:59:12.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.704+0000 7fa8f5e00640 1 --2- 172.21.15.59:0/3713323546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f00b4aa0 0x7fa8f00b2360 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.704+0000 7fa8f5e00640 1 -- 172.21.15.59:0/3713323546 >> 172.21.15.59:0/3713323546 conn(0x7fa8f00b3f80 msgr2=0x7fa8f00b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:12.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.704+0000 7fa8f5e00640 1 -- 172.21.15.59:0/3713323546 shutdown_connections 2024-05-30T16:59:12.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.704+0000 7fa8f5e00640 1 -- 172.21.15.59:0/3713323546 wait complete. 2024-05-30T16:59:12.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8f5e00640 1 Processor -- start 2024-05-30T16:59:12.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8f5e00640 1 -- start start 2024-05-30T16:59:12.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8f5e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8f009b150 0x7fa8f014d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:12.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8f5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f00b4aa0 0x7fa8f014c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:12.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8f5e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f015ed00 0x7fa8f01548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8f5e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f016d2e0 con 0x7fa8f00b4aa0 2024-05-30T16:59:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8f5e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f00d1200 con 0x7fa8f015ed00 2024-05-30T16:59:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8f5e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f016d460 con 0x7fa8f009b150 2024-05-30T16:59:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f00b4aa0 0x7fa8f014c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8eea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8f009b150 0x7fa8f014d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f00b4aa0 0x7fa8f014c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50058/0 (socket says 172.21.15.59:50058) 2024-05-30T16:59:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8e7e00640 1 -- 172.21.15.59:0/215813593 learned_addr learned my addr 172.21.15.59:0/215813593 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8ef400640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f015ed00 0x7fa8f01548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:12.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8eea00640 1 -- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f015ed00 msgr2=0x7fa8f01548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8eea00640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f015ed00 0x7fa8f01548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8eea00640 1 -- 172.21.15.59:0/215813593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f00b4aa0 msgr2=0x7fa8f014c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8eea00640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f00b4aa0 0x7fa8f014c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8eea00640 1 -- 172.21.15.59:0/215813593 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f00b0c20 con 0x7fa8f009b150 2024-05-30T16:59:12.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8eea00640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8f009b150 0x7fa8f014d3b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000c390 tx=0x7fa8e000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:12.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8e7400640 1 -- 172.21.15.59:0/215813593 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0017070 con 0x7fa8f009b150 2024-05-30T16:59:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8e7400640 1 -- 172.21.15.59:0/215813593 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e00052d0 con 0x7fa8f009b150 2024-05-30T16:59:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8e7400640 1 -- 172.21.15.59:0/215813593 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0003840 con 0x7fa8f009b150 2024-05-30T16:59:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8f5e00640 1 -- 172.21.15.59:0/215813593 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f0155280 con 0x7fa8f009b150 2024-05-30T16:59:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.708+0000 7fa8f5e00640 1 -- 172.21.15.59:0/215813593 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f0155560 con 0x7fa8f009b150 2024-05-30T16:59:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.712+0000 7fa8f5e00640 1 -- 172.21.15.59:0/215813593 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f00b12f0 con 0x7fa8f009b150 2024-05-30T16:59:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.712+0000 7fa8e7400640 1 -- 172.21.15.59:0/215813593 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7fa8e001a070 con 0x7fa8f009b150 2024-05-30T16:59:12.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.712+0000 7fa8e7400640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa8cc069580 0x7fa8cc06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:12.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.712+0000 7fa8e7400640 1 -- 172.21.15.59:0/215813593 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7fa8e0084b60 con 0x7fa8f009b150 2024-05-30T16:59:12.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.712+0000 7fa8e7e00640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa8cc069580 0x7fa8cc06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:12.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.712+0000 7fa8e7e00640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa8cc069580 0x7fa8cc06ba40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0150230 tx=0x7fa8d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.716+0000 7fa8e7400640 1 -- 172.21.15.59:0/215813593 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa8e0005480 con 0x7fa8f009b150 2024-05-30T16:59:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.916+0000 7fa8f5e00640 1 -- 172.21.15.59:0/215813593 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone698812", "target": ["mon-mgr", ""]}) -- 0x7fa8f0068a90 con 0x7fa8cc069580 2024-05-30T16:59:12.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.956+0000 7fa8e7400640 1 -- 172.21.15.59:0/215813593 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa8f0068a90 con 0x7fa8cc069580 2024-05-30T16:59:12.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.960+0000 7fa8f5e00640 1 -- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa8cc069580 msgr2=0x7fa8cc06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.960+0000 7fa8f5e00640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa8cc069580 0x7fa8cc06ba40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0150230 tx=0x7fa8d8009040 comp rx=0 tx=0).stop 2024-05-30T16:59:12.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.960+0000 7fa8f5e00640 1 -- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8f009b150 msgr2=0x7fa8f014d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:12.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.960+0000 7fa8f5e00640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8f009b150 0x7fa8f014d3b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000c390 tx=0x7fa8e000c850 comp rx=0 tx=0).stop 2024-05-30T16:59:12.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.960+0000 7fa8f5e00640 1 -- 172.21.15.59:0/215813593 shutdown_connections 2024-05-30T16:59:12.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.960+0000 7fa8f5e00640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa8cc069580 0x7fa8cc06ba40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.960+0000 7fa8f5e00640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f015ed00 0x7fa8f01548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.960+0000 7fa8f5e00640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f00b4aa0 0x7fa8f014c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:12.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.960+0000 7fa8f5e00640 1 --2- 172.21.15.59:0/215813593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8f009b150 0x7fa8f014d3b0 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000c390 tx=0x7fa8e000c850 comp rx=0 tx=0).stop 2024-05-30T16:59:12.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.960+0000 7fa8f5e00640 1 -- 172.21.15.59:0/215813593 >> 172.21.15.59:0/215813593 conn(0x7fa8f00b3f80 msgr2=0x7fa8f00b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:12.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.960+0000 7fa8f5e00640 1 -- 172.21.15.59:0/215813593 shutdown_connections 2024-05-30T16:59:12.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:12.960+0000 7fa8f5e00640 1 -- 172.21.15.59:0/215813593 wait complete. 2024-05-30T16:59:12.999 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69881 2024-05-30T16:59:13.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.236+0000 7f76e7200640 1 Processor -- start 2024-05-30T16:59:13.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.236+0000 7f76e7200640 1 -- start start 2024-05-30T16:59:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76e7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76e00d1800 0x7f76e00cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76e7200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f76e00b3630 0x7f76e00cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76e7200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e00d2de0 con 0x7f76e0162080 2024-05-30T16:59:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76e7200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f76e00b5970 con 0x7f76e00b3630 2024-05-30T16:59:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76e7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f76e00d3010 con 0x7f76e00d1800 2024-05-30T16:59:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76dfe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f76e0162080 0x7f76e00d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:41286/0 (socket says 172.21.15.59:41286) 2024-05-30T16:59:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76dfe00640 1 -- 172.21.15.59:0/3555075605 learned_addr learned my addr 172.21.15.59:0/3555075605 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76e5200640 1 --2- 172.21.15.59:0/3555075605 >> v2:172.21.15.59:3300/0 conn(0x7f76e00b3630 0x7f76e00cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:13.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76dea00640 1 -- 172.21.15.59:0/3555075605 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2826875570 0 0) 0x7f76e00d2de0 con 0x7f76e0162080 2024-05-30T16:59:13.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76dea00640 1 -- 172.21.15.59:0/3555075605 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76c4003530 con 0x7f76e0162080 2024-05-30T16:59:13.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76e5200640 1 -- 172.21.15.59:0/3555075605 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76e00d1800 msgr2=0x7f76e00cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:13.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76e5200640 1 --2- 172.21.15.59:0/3555075605 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76e00d1800 0x7f76e00cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76e5200640 1 -- 172.21.15.59:0/3555075605 >> v1:172.21.15.107:6789/0 conn(0x7f76e0162080 legacy=0x7f76e00d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:13.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.240+0000 7f76e5200640 1 -- 172.21.15.59:0/3555075605 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e00b5bc0 con 0x7f76e00b3630 2024-05-30T16:59:13.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.244+0000 7f76e5200640 1 --2- 172.21.15.59:0/3555075605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e00b3630 0x7f76e00cf900 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009d90 tx=0x7f76d801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb4e06f19230571 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:13.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.244+0000 7f76dea00640 1 -- 172.21.15.59:0/3555075605 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d80b2070 con 0x7f76e00b3630 2024-05-30T16:59:13.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.244+0000 7f76dea00640 1 -- 172.21.15.59:0/3555075605 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d80a5a00 con 0x7f76e00b3630 2024-05-30T16:59:13.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.244+0000 7f76dea00640 1 -- 172.21.15.59:0/3555075605 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d80a5dd0 con 0x7f76e00b3630 2024-05-30T16:59:13.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.244+0000 7f76e7200640 1 -- 172.21.15.59:0/3555075605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e00b3630 msgr2=0x7f76e00cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:13.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.244+0000 7f76e7200640 1 --2- 172.21.15.59:0/3555075605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e00b3630 0x7f76e00cf900 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009d90 tx=0x7f76d801c960 comp rx=0 tx=0).stop 2024-05-30T16:59:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.244+0000 7f76e7200640 1 -- 172.21.15.59:0/3555075605 shutdown_connections 2024-05-30T16:59:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.244+0000 7f76e7200640 1 --2- 172.21.15.59:0/3555075605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e00b3630 0x7f76e00cf900 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.244+0000 7f76e7200640 1 --2- 172.21.15.59:0/3555075605 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76e00d1800 0x7f76e00cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.244+0000 7f76e7200640 1 -- 172.21.15.59:0/3555075605 >> 172.21.15.59:0/3555075605 conn(0x7f76e008bfd0 msgr2=0x7f76e00d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.248+0000 7f76e7200640 1 -- 172.21.15.59:0/3555075605 shutdown_connections 2024-05-30T16:59:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.248+0000 7f76e7200640 1 -- 172.21.15.59:0/3555075605 wait complete. 2024-05-30T16:59:13.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.248+0000 7f76e7200640 1 Processor -- start 2024-05-30T16:59:13.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76e7200640 1 -- start start 2024-05-30T16:59:13.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76e7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e00b3630 0x7f76e015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:13.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76e7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76e00d1800 0x7f76e0159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:13.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76e7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76e0162080 0x7f76e00c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:13.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76e7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76e0162460 con 0x7f76e00b3630 2024-05-30T16:59:13.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76e7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f76e00b4f70 con 0x7f76e0162080 2024-05-30T16:59:13.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76e7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f76e01625e0 con 0x7f76e00d1800 2024-05-30T16:59:13.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76dfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e00b3630 0x7f76e015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:13.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76e5200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76e0162080 0x7f76e00c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:13.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76dfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e00b3630 0x7f76e015b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50076/0 (socket says 172.21.15.59:50076) 2024-05-30T16:59:13.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76dfe00640 1 -- 172.21.15.59:0/1405507494 learned_addr learned my addr 172.21.15.59:0/1405507494 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:13.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76dfe00640 1 -- 172.21.15.59:0/1405507494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76e00d1800 msgr2=0x7f76e0159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:13.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76dfe00640 1 --2- 172.21.15.59:0/1405507494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76e00d1800 0x7f76e0159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76dfe00640 1 -- 172.21.15.59:0/1405507494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76e0162080 msgr2=0x7f76e00c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:13.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76dfe00640 1 --2- 172.21.15.59:0/1405507494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76e0162080 0x7f76e00c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76dfe00640 1 -- 172.21.15.59:0/1405507494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e0161850 con 0x7f76e00b3630 2024-05-30T16:59:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76dfe00640 1 --2- 172.21.15.59:0/1405507494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e00b3630 0x7f76e015b650 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f76d000c450 tx=0x7f76d000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76d7e00640 1 -- 172.21.15.59:0/1405507494 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d0017070 con 0x7f76e00b3630 2024-05-30T16:59:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76d7e00640 1 -- 172.21.15.59:0/1405507494 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d0005db0 con 0x7f76e00b3630 2024-05-30T16:59:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76e7200640 1 -- 172.21.15.59:0/1405507494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e00cce20 con 0x7f76e00b3630 2024-05-30T16:59:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.252+0000 7f76e7200640 1 -- 172.21.15.59:0/1405507494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e0158520 con 0x7f76e00b3630 2024-05-30T16:59:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.256+0000 7f76d7e00640 1 -- 172.21.15.59:0/1405507494 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d0007290 con 0x7f76e00b3630 2024-05-30T16:59:13.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.256+0000 7f76d7e00640 1 -- 172.21.15.59:0/1405507494 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7f76d001a070 con 0x7f76e00b3630 2024-05-30T16:59:13.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.256+0000 7f76e7200640 1 -- 172.21.15.59:0/1405507494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b80052a0 con 0x7f76e00b3630 2024-05-30T16:59:13.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.260+0000 7f76d7e00640 1 --2- 172.21.15.59:0/1405507494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76c0069580 0x7f76c006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:13.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.260+0000 7f76d7e00640 1 -- 172.21.15.59:0/1405507494 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f76d0084c20 con 0x7f76e00b3630 2024-05-30T16:59:13.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.260+0000 7f76df400640 1 --2- 172.21.15.59:0/1405507494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76c0069580 0x7f76c006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:13.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.264+0000 7f76df400640 1 --2- 172.21.15.59:0/1405507494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76c0069580 0x7f76c006ba40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f76e00c7db0 tx=0x7f76cc006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:13.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.268+0000 7f76d7e00640 1 -- 172.21.15.59:0/1405507494 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f76d00562b0 con 0x7f76e00b3630 2024-05-30T16:59:13.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.600+0000 7f76e7200640 1 -- 172.21.15.59:0/1405507494 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69881", "target": ["mon-mgr", ""]}) -- 0x7f76b8000bd0 con 0x7f76c0069580 2024-05-30T16:59:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.632+0000 7f76d7e00640 1 -- 172.21.15.59:0/1405507494 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f76b8000bd0 con 0x7f76c0069580 2024-05-30T16:59:13.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.636+0000 7f76e7200640 1 -- 172.21.15.59:0/1405507494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76c0069580 msgr2=0x7f76c006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:13.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.636+0000 7f76e7200640 1 --2- 172.21.15.59:0/1405507494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76c0069580 0x7f76c006ba40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f76e00c7db0 tx=0x7f76cc006ca0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.636+0000 7f76e7200640 1 -- 172.21.15.59:0/1405507494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e00b3630 msgr2=0x7f76e015b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.636+0000 7f76e7200640 1 --2- 172.21.15.59:0/1405507494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e00b3630 0x7f76e015b650 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f76d000c450 tx=0x7f76d000c910 comp rx=0 tx=0).stop 2024-05-30T16:59:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.640+0000 7f76e7200640 1 -- 172.21.15.59:0/1405507494 shutdown_connections 2024-05-30T16:59:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.640+0000 7f76e7200640 1 --2- 172.21.15.59:0/1405507494 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f76c0069580 0x7f76c006ba40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.640+0000 7f76e7200640 1 --2- 172.21.15.59:0/1405507494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76e0162080 0x7f76e00c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.640+0000 7f76e7200640 1 --2- 172.21.15.59:0/1405507494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76e00d1800 0x7f76e0159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.640+0000 7f76e7200640 1 --2- 172.21.15.59:0/1405507494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e00b3630 0x7f76e015b650 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.640+0000 7f76e7200640 1 -- 172.21.15.59:0/1405507494 >> 172.21.15.59:0/1405507494 conn(0x7f76e008bfd0 msgr2=0x7f76e00b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:13.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.640+0000 7f76e7200640 1 -- 172.21.15.59:0/1405507494 shutdown_connections 2024-05-30T16:59:13.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.640+0000 7f76e7200640 1 -- 172.21.15.59:0/1405507494 wait complete. 2024-05-30T16:59:13.670 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69888 2024-05-30T16:59:13.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe5cc00640 1 Processor -- start 2024-05-30T16:59:13.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe5cc00640 1 -- start start 2024-05-30T16:59:13.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe5cc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efe5815b790 0x7efe580adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:13.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe5cc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe580723c0 0x7efe580af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:13.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe5cc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe58072870 con 0x7efe5815b3b0 2024-05-30T16:59:13.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe5cc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7efe580afaf0 con 0x7efe580723c0 2024-05-30T16:59:13.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe5cc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7efe580ae510 con 0x7efe5815b790 2024-05-30T16:59:13.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe56800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe580723c0 0x7efe580af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:13.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe56800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe580723c0 0x7efe580af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50090/0 (socket says 172.21.15.59:50090) 2024-05-30T16:59:13.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe56800640 1 -- 172.21.15.59:0/3948261992 learned_addr learned my addr 172.21.15.59:0/3948261992 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:13.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe4d400640 1 --2- 172.21.15.59:0/3948261992 >> v2:172.21.15.107:3300/0 conn(0x7efe5815b790 0x7efe580adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:13.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe56800640 1 -- 172.21.15.59:0/3948261992 >> v2:172.21.15.107:3300/0 conn(0x7efe5815b790 msgr2=0x7efe580adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:13.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe56800640 1 --2- 172.21.15.59:0/3948261992 >> v2:172.21.15.107:3300/0 conn(0x7efe5815b790 0x7efe580adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe56800640 1 -- 172.21.15.59:0/3948261992 >> v1:172.21.15.107:6789/0 conn(0x7efe5815b3b0 legacy=0x7efe58071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:13.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.832+0000 7efe56800640 1 -- 172.21.15.59:0/3948261992 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe580ae7f0 con 0x7efe580723c0 2024-05-30T16:59:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.836+0000 7efe56800640 1 --2- 172.21.15.59:0/3948261992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe580723c0 0x7efe580af5b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7efe5000d150 tx=0x7efe5001eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2decff838ff0d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:13.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.836+0000 7efe55400640 1 -- 172.21.15.59:0/3948261992 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5000b2d0 con 0x7efe580723c0 2024-05-30T16:59:13.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.836+0000 7efe55400640 1 -- 172.21.15.59:0/3948261992 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe5000b470 con 0x7efe580723c0 2024-05-30T16:59:13.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.836+0000 7efe55400640 1 -- 172.21.15.59:0/3948261992 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe500a7c70 con 0x7efe580723c0 2024-05-30T16:59:13.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.836+0000 7efe5cc00640 1 -- 172.21.15.59:0/3948261992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe580723c0 msgr2=0x7efe580af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:13.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.836+0000 7efe5cc00640 1 --2- 172.21.15.59:0/3948261992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe580723c0 0x7efe580af5b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7efe5000d150 tx=0x7efe5001eb80 comp rx=0 tx=0).stop 2024-05-30T16:59:13.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.836+0000 7efe5cc00640 1 -- 172.21.15.59:0/3948261992 shutdown_connections 2024-05-30T16:59:13.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.836+0000 7efe5cc00640 1 --2- 172.21.15.59:0/3948261992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe580723c0 0x7efe580af5b0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.836+0000 7efe5cc00640 1 --2- 172.21.15.59:0/3948261992 >> v2:172.21.15.107:3300/0 conn(0x7efe5815b790 0x7efe580adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.836+0000 7efe5cc00640 1 -- 172.21.15.59:0/3948261992 >> 172.21.15.59:0/3948261992 conn(0x7efe580b1e60 msgr2=0x7efe580b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:13.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.836+0000 7efe5cc00640 1 -- 172.21.15.59:0/3948261992 shutdown_connections 2024-05-30T16:59:13.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.836+0000 7efe5cc00640 1 -- 172.21.15.59:0/3948261992 wait complete. 2024-05-30T16:59:13.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe5cc00640 1 Processor -- start 2024-05-30T16:59:13.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe5cc00640 1 -- start start 2024-05-30T16:59:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe5cc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe580723c0 0x7efe58099530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe5cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5815b3b0 0x7efe5814f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe5cc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe5815b790 0x7efe5814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe5cc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efe580cc7d0 con 0x7efe5815b3b0 2024-05-30T16:59:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe5cc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efe580cc650 con 0x7efe580723c0 2024-05-30T16:59:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe5cc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efe580b3970 con 0x7efe5815b790 2024-05-30T16:59:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe4d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5815b3b0 0x7efe5814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe4d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5815b3b0 0x7efe5814f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50094/0 (socket says 172.21.15.59:50094) 2024-05-30T16:59:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe4d400640 1 -- 172.21.15.59:0/566732012 learned_addr learned my addr 172.21.15.59:0/566732012 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe55e00640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe580723c0 0x7efe58099530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe56800640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe5815b790 0x7efe5814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe4d400640 1 -- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe5815b790 msgr2=0x7efe5814f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe4d400640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe5815b790 0x7efe5814f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe4d400640 1 -- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe580723c0 msgr2=0x7efe58099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe4d400640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe580723c0 0x7efe58099530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe4d400640 1 -- 172.21.15.59:0/566732012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe581523b0 con 0x7efe5815b3b0 2024-05-30T16:59:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe56800640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe5815b790 0x7efe5814f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe4d400640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5815b3b0 0x7efe5814f250 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7efe4000d5c0 tx=0x7efe4000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe4ea00640 1 -- 172.21.15.59:0/566732012 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe40004240 con 0x7efe5815b3b0 2024-05-30T16:59:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe4ea00640 1 -- 172.21.15.59:0/566732012 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe400043e0 con 0x7efe5815b3b0 2024-05-30T16:59:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe4ea00640 1 -- 172.21.15.59:0/566732012 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe40003840 con 0x7efe5815b3b0 2024-05-30T16:59:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe5cc00640 1 -- 172.21.15.59:0/566732012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe58152690 con 0x7efe5815b3b0 2024-05-30T16:59:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe5cc00640 1 -- 172.21.15.59:0/566732012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe58152c50 con 0x7efe5815b3b0 2024-05-30T16:59:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.840+0000 7efe5cc00640 1 -- 172.21.15.59:0/566732012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe58068a90 con 0x7efe5815b3b0 2024-05-30T16:59:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.844+0000 7efe4ea00640 1 -- 172.21.15.59:0/566732012 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7efe400039e0 con 0x7efe5815b3b0 2024-05-30T16:59:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.844+0000 7efe4ea00640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efe340695b0 0x7efe3406ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.844+0000 7efe4ea00640 1 -- 172.21.15.59:0/566732012 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7efe40085b70 con 0x7efe5815b3b0 2024-05-30T16:59:13.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.844+0000 7efe55e00640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efe340695b0 0x7efe3406ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:13.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.844+0000 7efe55e00640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efe340695b0 0x7efe3406ba70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efe580b0be0 tx=0x7efe48007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:13.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:13.848+0000 7efe4ea00640 1 -- 172.21.15.59:0/566732012 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe40057810 con 0x7efe5815b3b0 2024-05-30T16:59:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.044+0000 7efe5cc00640 1 -- 172.21.15.59:0/566732012 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69888", "target": ["mon-mgr", ""]}) -- 0x7efe5814ad50 con 0x7efe340695b0 2024-05-30T16:59:14.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.056+0000 7efe4ea00640 1 -- 172.21.15.59:0/566732012 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efe48003bf0 con 0x7efe340695b0 2024-05-30T16:59:14.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.060+0000 7efe5cc00640 1 -- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efe340695b0 msgr2=0x7efe3406ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.060+0000 7efe5cc00640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efe340695b0 0x7efe3406ba70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efe580b0be0 tx=0x7efe48007e40 comp rx=0 tx=0).stop 2024-05-30T16:59:14.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.060+0000 7efe5cc00640 1 -- 172.21.15.59:0/566732012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5815b3b0 msgr2=0x7efe5814f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.060+0000 7efe5cc00640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5815b3b0 0x7efe5814f250 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7efe4000d5c0 tx=0x7efe4000da80 comp rx=0 tx=0).stop 2024-05-30T16:59:14.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.060+0000 7efe5cc00640 1 -- 172.21.15.59:0/566732012 shutdown_connections 2024-05-30T16:59:14.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.060+0000 7efe5cc00640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efe340695b0 0x7efe3406ba70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.060+0000 7efe5cc00640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efe5815b790 0x7efe5814f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.060+0000 7efe5cc00640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5815b3b0 0x7efe5814f250 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.060+0000 7efe5cc00640 1 --2- 172.21.15.59:0/566732012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe580723c0 0x7efe58099530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.060+0000 7efe5cc00640 1 -- 172.21.15.59:0/566732012 >> 172.21.15.59:0/566732012 conn(0x7efe580b1e60 msgr2=0x7efe580b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:14.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.060+0000 7efe5cc00640 1 -- 172.21.15.59:0/566732012 shutdown_connections 2024-05-30T16:59:14.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.060+0000 7efe5cc00640 1 -- 172.21.15.59:0/566732012 wait complete. 2024-05-30T16:59:14.082 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone698819 2024-05-30T16:59:14.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.224+0000 7f3d2e800640 1 Processor -- start 2024-05-30T16:59:14.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.224+0000 7f3d2e800640 1 -- start start 2024-05-30T16:59:14.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.224+0000 7f3d2e800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3d28156e40 0x7f3d2806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.224+0000 7f3d2e800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d2806dc60 0x7f3d2815d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.224+0000 7f3d2e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d280af130 0x7f3d280af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d2e800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3d2815db80 con 0x7f3d280af130 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d2e800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3d2806e120 con 0x7f3d28156e40 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d2e800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2806e400 con 0x7f3d2806dc60 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d27e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d280af130 0x7f3d280af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d27e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d280af130 0x7f3d280af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50102/0 (socket says 172.21.15.59:50102) 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d27e00640 1 -- 172.21.15.59:0/1577280877 learned_addr learned my addr 172.21.15.59:0/1577280877 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d27e00640 1 -- 172.21.15.59:0/1577280877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d2806dc60 msgr2=0x7f3d2815d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d27400640 1 --2- 172.21.15.59:0/1577280877 >> v2:172.21.15.107:3300/0 conn(0x7f3d28156e40 0x7f3d2806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d1fe00640 1 --2- 172.21.15.59:0/1577280877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d2806dc60 0x7f3d2815d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d27e00640 1 --2- 172.21.15.59:0/1577280877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d2806dc60 0x7f3d2815d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d27e00640 1 -- 172.21.15.59:0/1577280877 >> v2:172.21.15.107:3300/0 conn(0x7f3d28156e40 msgr2=0x7f3d2806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d27e00640 1 --2- 172.21.15.59:0/1577280877 >> v2:172.21.15.107:3300/0 conn(0x7f3d28156e40 0x7f3d2806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d27e00640 1 -- 172.21.15.59:0/1577280877 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2806e6e0 con 0x7f3d280af130 2024-05-30T16:59:14.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d27400640 1 --2- 172.21.15.59:0/1577280877 >> v2:172.21.15.107:3300/0 conn(0x7f3d28156e40 0x7f3d2806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:14.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d1fe00640 1 --2- 172.21.15.59:0/1577280877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d2806dc60 0x7f3d2815d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:14.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d27e00640 1 --2- 172.21.15.59:0/1577280877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d280af130 0x7f3d280af580 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3d28073f70 tx=0x7f3d2001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7616bdd045b65125 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:14.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d26a00640 1 -- 172.21.15.59:0/1577280877 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d200a5760 con 0x7f3d280af130 2024-05-30T16:59:14.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d26a00640 1 -- 172.21.15.59:0/1577280877 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d200a5900 con 0x7f3d280af130 2024-05-30T16:59:14.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.228+0000 7f3d26a00640 1 -- 172.21.15.59:0/1577280877 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d200a5cd0 con 0x7f3d280af130 2024-05-30T16:59:14.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 -- 172.21.15.59:0/1577280877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d280af130 msgr2=0x7f3d280af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 --2- 172.21.15.59:0/1577280877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d280af130 0x7f3d280af580 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3d28073f70 tx=0x7f3d2001c9f0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 -- 172.21.15.59:0/1577280877 shutdown_connections 2024-05-30T16:59:14.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 --2- 172.21.15.59:0/1577280877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d280af130 0x7f3d280af580 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 --2- 172.21.15.59:0/1577280877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d2806dc60 0x7f3d2815d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 --2- 172.21.15.59:0/1577280877 >> v2:172.21.15.107:3300/0 conn(0x7f3d28156e40 0x7f3d2806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 -- 172.21.15.59:0/1577280877 >> 172.21.15.59:0/1577280877 conn(0x7f3d280b1e60 msgr2=0x7f3d280b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:14.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 -- 172.21.15.59:0/1577280877 shutdown_connections 2024-05-30T16:59:14.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 -- 172.21.15.59:0/1577280877 wait complete. 2024-05-30T16:59:14.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 Processor -- start 2024-05-30T16:59:14.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 -- start start 2024-05-30T16:59:14.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2806dc60 0x7f3d2814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:14.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d280af130 0x7f3d28152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:14.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d28156e40 0x7f3d28155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:14.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2815e920 con 0x7f3d2806dc60 2024-05-30T16:59:14.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2815e7a0 con 0x7f3d28156e40 2024-05-30T16:59:14.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d2e800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2815eaa0 con 0x7f3d280af130 2024-05-30T16:59:14.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d27400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2806dc60 0x7f3d2814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:14.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d27400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2806dc60 0x7f3d2814a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50108/0 (socket says 172.21.15.59:50108) 2024-05-30T16:59:14.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d27400640 1 -- 172.21.15.59:0/1506666702 learned_addr learned my addr 172.21.15.59:0/1506666702 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:14.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d1fe00640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d280af130 0x7f3d28152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:14.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.232+0000 7f3d27e00640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d28156e40 0x7f3d28155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:14.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d27400640 1 -- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d280af130 msgr2=0x7f3d28152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d27400640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d280af130 0x7f3d28152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d27400640 1 -- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d28156e40 msgr2=0x7f3d28155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d27400640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d28156e40 0x7f3d28155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d27400640 1 -- 172.21.15.59:0/1506666702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d28152f60 con 0x7f3d2806dc60 2024-05-30T16:59:14.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d27400640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2806dc60 0x7f3d2814a350 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800c7f0 tx=0x7f3d1800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:14.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d1f400640 1 -- 172.21.15.59:0/1506666702 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18015070 con 0x7f3d2806dc60 2024-05-30T16:59:14.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d1f400640 1 -- 172.21.15.59:0/1506666702 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d18007820 con 0x7f3d2806dc60 2024-05-30T16:59:14.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d2e800640 1 -- 172.21.15.59:0/1506666702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d281513c0 con 0x7f3d2806dc60 2024-05-30T16:59:14.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d1f400640 1 -- 172.21.15.59:0/1506666702 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18007c10 con 0x7f3d2806dc60 2024-05-30T16:59:14.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d2e800640 1 -- 172.21.15.59:0/1506666702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d281f83d0 con 0x7f3d2806dc60 2024-05-30T16:59:14.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d2e800640 1 -- 172.21.15.59:0/1506666702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d28068a90 con 0x7f3d2806dc60 2024-05-30T16:59:14.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d1f400640 1 -- 172.21.15.59:0/1506666702 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7f3d18018070 con 0x7f3d2806dc60 2024-05-30T16:59:14.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d1f400640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d04069580 0x7f3d0406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:14.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.236+0000 7f3d1f400640 1 -- 172.21.15.59:0/1506666702 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7f3d18085980 con 0x7f3d2806dc60 2024-05-30T16:59:14.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.240+0000 7f3d1fe00640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d04069580 0x7f3d0406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:14.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.240+0000 7f3d1fe00640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d04069580 0x7f3d0406ba40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3d281536f0 tx=0x7f3d10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:14.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.240+0000 7f3d1f400640 1 -- 172.21.15.59:0/1506666702 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d18056fd0 con 0x7f3d2806dc60 2024-05-30T16:59:14.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.436+0000 7f3d2e800640 1 -- 172.21.15.59:0/1506666702 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone698819", "target": ["mon-mgr", ""]}) -- 0x7f3d28073fe0 con 0x7f3d04069580 2024-05-30T16:59:14.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.456+0000 7f3d1f400640 1 -- 172.21.15.59:0/1506666702 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3d28073fe0 con 0x7f3d04069580 2024-05-30T16:59:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.460+0000 7f3d2e800640 1 -- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d04069580 msgr2=0x7f3d0406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.460+0000 7f3d2e800640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d04069580 0x7f3d0406ba40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3d281536f0 tx=0x7f3d10008040 comp rx=0 tx=0).stop 2024-05-30T16:59:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.460+0000 7f3d2e800640 1 -- 172.21.15.59:0/1506666702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2806dc60 msgr2=0x7f3d2814a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.460+0000 7f3d2e800640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2806dc60 0x7f3d2814a350 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800c7f0 tx=0x7f3d1800ccb0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.460+0000 7f3d2e800640 1 -- 172.21.15.59:0/1506666702 shutdown_connections 2024-05-30T16:59:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.460+0000 7f3d2e800640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d04069580 0x7f3d0406ba40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.460+0000 7f3d2e800640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d28156e40 0x7f3d28155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.460+0000 7f3d2e800640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d280af130 0x7f3d28152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.460+0000 7f3d2e800640 1 --2- 172.21.15.59:0/1506666702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2806dc60 0x7f3d2814a350 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.460+0000 7f3d2e800640 1 -- 172.21.15.59:0/1506666702 >> 172.21.15.59:0/1506666702 conn(0x7f3d280b1e60 msgr2=0x7f3d280afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:14.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.460+0000 7f3d2e800640 1 -- 172.21.15.59:0/1506666702 shutdown_connections 2024-05-30T16:59:14.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.460+0000 7f3d2e800640 1 -- 172.21.15.59:0/1506666702 wait complete. 2024-05-30T16:59:14.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69884 2024-05-30T16:59:14.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.624+0000 7ff580c00640 1 Processor -- start 2024-05-30T16:59:14.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.624+0000 7ff580c00640 1 -- start start 2024-05-30T16:59:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff580c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff57c0adf30 0x7ff57c0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff580c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff57c0ae510 con 0x7ff57c15b790 2024-05-30T16:59:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff580c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff57c0ae7f0 con 0x7ff57c15b3b0 2024-05-30T16:59:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff580c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff57c072900 con 0x7ff57c0adf30 2024-05-30T16:59:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff571400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff57c15b790 0x7ff57c0b3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58822/0 (socket says 172.21.15.59:58822) 2024-05-30T16:59:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff571400640 1 -- 172.21.15.59:0/91971659 learned_addr learned my addr 172.21.15.59:0/91971659 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff57a800640 1 --2- 172.21.15.59:0/91971659 >> v2:172.21.15.107:3300/0 conn(0x7ff57c0adf30 0x7ff57c0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff579400640 1 -- 172.21.15.59:0/91971659 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076787632 0 0) 0x7ff57c0ae510 con 0x7ff57c15b790 2024-05-30T16:59:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff579400640 1 -- 172.21.15.59:0/91971659 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff560003530 con 0x7ff57c15b790 2024-05-30T16:59:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff579400640 1 -- 172.21.15.59:0/91971659 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3423368645 0 0) 0x7ff57c0ae7f0 con 0x7ff57c15b3b0 2024-05-30T16:59:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff579400640 1 -- 172.21.15.59:0/91971659 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff57c0ae510 con 0x7ff57c15b3b0 2024-05-30T16:59:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff57a800640 1 -- 172.21.15.59:0/91971659 >> v1:172.21.15.107:6789/0 conn(0x7ff57c15b3b0 legacy=0x7ff57c071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff57a800640 1 -- 172.21.15.59:0/91971659 >> v1:172.21.15.59:6789/0 conn(0x7ff57c15b790 legacy=0x7ff57c0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff57a800640 1 -- 172.21.15.59:0/91971659 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c0aead0 con 0x7ff57c0adf30 2024-05-30T16:59:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.628+0000 7ff57a800640 1 --2- 172.21.15.59:0/91971659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c0adf30 0x7ff57c0723c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff5740097f0 tx=0x7ff57401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bc33e5c0f59cac8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff579400640 1 -- 172.21.15.59:0/91971659 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5740a7070 con 0x7ff57c0adf30 2024-05-30T16:59:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff579400640 1 -- 172.21.15.59:0/91971659 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5740b0070 con 0x7ff57c0adf30 2024-05-30T16:59:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff579400640 1 -- 172.21.15.59:0/91971659 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5740ab890 con 0x7ff57c0adf30 2024-05-30T16:59:14.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 -- 172.21.15.59:0/91971659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c0adf30 msgr2=0x7ff57c0723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 --2- 172.21.15.59:0/91971659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c0adf30 0x7ff57c0723c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff5740097f0 tx=0x7ff57401c470 comp rx=0 tx=0).stop 2024-05-30T16:59:14.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 -- 172.21.15.59:0/91971659 shutdown_connections 2024-05-30T16:59:14.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 --2- 172.21.15.59:0/91971659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c0adf30 0x7ff57c0723c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 -- 172.21.15.59:0/91971659 >> 172.21.15.59:0/91971659 conn(0x7ff57c0b1e60 msgr2=0x7ff57c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:14.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 -- 172.21.15.59:0/91971659 shutdown_connections 2024-05-30T16:59:14.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 -- 172.21.15.59:0/91971659 wait complete. 2024-05-30T16:59:14.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 Processor -- start 2024-05-30T16:59:14.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 -- start start 2024-05-30T16:59:14.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c0adf30 0x7ff57c145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff57c15b3b0 0x7ff57c15e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff57c15b790 0x7ff57c071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c0cc7d0 con 0x7ff57c15b790 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c0cc650 con 0x7ff57c0adf30 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff580c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff57c06e4f0 con 0x7ff57c15b3b0 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff57a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff57c15b790 0x7ff57c071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff579e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c0adf30 0x7ff57c145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff57a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff57c15b790 0x7ff57c071cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50116/0 (socket says 172.21.15.59:50116) 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff57a800640 1 -- 172.21.15.59:0/1331675226 learned_addr learned my addr 172.21.15.59:0/1331675226 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.632+0000 7ff571400640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff57c15b3b0 0x7ff57c15e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff579e00640 1 -- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff57c15b3b0 msgr2=0x7ff57c15e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff579e00640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff57c15b3b0 0x7ff57c15e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff579e00640 1 -- 172.21.15.59:0/1331675226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff57c15b790 msgr2=0x7ff57c071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff579e00640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff57c15b790 0x7ff57c071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff579e00640 1 -- 172.21.15.59:0/1331675226 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c15d0d0 con 0x7ff57c0adf30 2024-05-30T16:59:14.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff579e00640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c0adf30 0x7ff57c145500 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c7d0 tx=0x7ff56c00cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:14.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff572a00640 1 -- 172.21.15.59:0/1331675226 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c003b80 con 0x7ff57c0adf30 2024-05-30T16:59:14.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff572a00640 1 -- 172.21.15.59:0/1331675226 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56c003d20 con 0x7ff57c0adf30 2024-05-30T16:59:14.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff572a00640 1 -- 172.21.15.59:0/1331675226 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00aa90 con 0x7ff57c0adf30 2024-05-30T16:59:14.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff580c00640 1 -- 172.21.15.59:0/1331675226 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57c15d3b0 con 0x7ff57c0adf30 2024-05-30T16:59:14.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff580c00640 1 -- 172.21.15.59:0/1331675226 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57c15d970 con 0x7ff57c0adf30 2024-05-30T16:59:14.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff580c00640 1 -- 172.21.15.59:0/1331675226 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57c068a90 con 0x7ff57c0adf30 2024-05-30T16:59:14.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff572a00640 1 -- 172.21.15.59:0/1331675226 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7ff56c00ac30 con 0x7ff57c0adf30 2024-05-30T16:59:14.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff572a00640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff558069580 0x7ff55806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:14.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.636+0000 7ff572a00640 1 -- 172.21.15.59:0/1331675226 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5851+0+0 (secure 0 0 0) 0x7ff56c085800 con 0x7ff57c0adf30 2024-05-30T16:59:14.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.640+0000 7ff571400640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff558069580 0x7ff55806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:14.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.640+0000 7ff571400640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff558069580 0x7ff55806ba40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0af4f0 tx=0x7ff564009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:14.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.644+0000 7ff572a00640 1 -- 172.21.15.59:0/1331675226 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff56c0574a0 con 0x7ff57c0adf30 2024-05-30T16:59:14.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.832+0000 7ff580c00640 1 -- 172.21.15.59:0/1331675226 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69884", "target": ["mon-mgr", ""]}) -- 0x7ff57c0cc140 con 0x7ff558069580 2024-05-30T16:59:14.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.848+0000 7ff572a00640 1 -- 172.21.15.59:0/1331675226 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff57c0cc140 con 0x7ff558069580 2024-05-30T16:59:14.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.848+0000 7ff580c00640 1 -- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff558069580 msgr2=0x7ff55806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.848+0000 7ff580c00640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff558069580 0x7ff55806ba40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0af4f0 tx=0x7ff564009040 comp rx=0 tx=0).stop 2024-05-30T16:59:14.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.848+0000 7ff580c00640 1 -- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c0adf30 msgr2=0x7ff57c145500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:14.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.848+0000 7ff580c00640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c0adf30 0x7ff57c145500 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c7d0 tx=0x7ff56c00cc90 comp rx=0 tx=0).stop 2024-05-30T16:59:14.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.848+0000 7ff580c00640 1 -- 172.21.15.59:0/1331675226 shutdown_connections 2024-05-30T16:59:14.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.848+0000 7ff580c00640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff558069580 0x7ff55806ba40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.848+0000 7ff580c00640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff57c15b790 0x7ff57c071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.848+0000 7ff580c00640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff57c15b3b0 0x7ff57c15e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.848+0000 7ff580c00640 1 --2- 172.21.15.59:0/1331675226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c0adf30 0x7ff57c145500 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.852+0000 7ff580c00640 1 -- 172.21.15.59:0/1331675226 >> 172.21.15.59:0/1331675226 conn(0x7ff57c0b1e60 msgr2=0x7ff57c0b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.852+0000 7ff580c00640 1 -- 172.21.15.59:0/1331675226 shutdown_connections 2024-05-30T16:59:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:14.852+0000 7ff580c00640 1 -- 172.21.15.59:0/1331675226 wait complete. 2024-05-30T16:59:14.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone698814 2024-05-30T16:59:15.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.080+0000 7f1274600640 1 Processor -- start 2024-05-30T16:59:15.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.080+0000 7f1274600640 1 -- start start 2024-05-30T16:59:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.080+0000 7f1274600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f126c156e40 0x7f126c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.080+0000 7f1274600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f126c0af130 0x7f126c0af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.084+0000 7f1274600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126c06e120 con 0x7f126c06dc60 2024-05-30T16:59:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.084+0000 7f1274600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f126c06e400 con 0x7f126c156e40 2024-05-30T16:59:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.084+0000 7f1274600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f126c06e6e0 con 0x7f126c0af130 2024-05-30T16:59:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.084+0000 7f1271c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f126c156e40 0x7f126c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.084+0000 7f1271c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f126c156e40 0x7f126c06f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50120/0 (socket says 172.21.15.59:50120) 2024-05-30T16:59:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.084+0000 7f1271c00640 1 -- 172.21.15.59:0/2091788929 learned_addr learned my addr 172.21.15.59:0/2091788929 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.084+0000 7f1271c00640 1 -- 172.21.15.59:0/2091788929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f126c0af130 msgr2=0x7f126c0af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.084+0000 7f1271c00640 1 --2- 172.21.15.59:0/2091788929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f126c0af130 0x7f126c0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.084+0000 7f1271c00640 1 -- 172.21.15.59:0/2091788929 >> v1:172.21.15.107:6789/0 conn(0x7f126c06dc60 legacy=0x7f126c15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:15.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.084+0000 7f1271c00640 1 -- 172.21.15.59:0/2091788929 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c06e9c0 con 0x7f126c156e40 2024-05-30T16:59:15.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.088+0000 7f1271c00640 1 --2- 172.21.15.59:0/2091788929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f126c156e40 0x7f126c06f1c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f126c073f70 tx=0x7f126001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d1d3eb381a86b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.088+0000 7f126be00640 1 -- 172.21.15.59:0/2091788929 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12600b0070 con 0x7f126c156e40 2024-05-30T16:59:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.088+0000 7f126be00640 1 -- 172.21.15.59:0/2091788929 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12600ab600 con 0x7f126c156e40 2024-05-30T16:59:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.088+0000 7f126be00640 1 -- 172.21.15.59:0/2091788929 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12600ab9d0 con 0x7f126c156e40 2024-05-30T16:59:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.088+0000 7f1274600640 1 -- 172.21.15.59:0/2091788929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f126c156e40 msgr2=0x7f126c06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.088+0000 7f1274600640 1 --2- 172.21.15.59:0/2091788929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f126c156e40 0x7f126c06f1c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f126c073f70 tx=0x7f126001c500 comp rx=0 tx=0).stop 2024-05-30T16:59:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.088+0000 7f1274600640 1 -- 172.21.15.59:0/2091788929 shutdown_connections 2024-05-30T16:59:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.088+0000 7f1274600640 1 --2- 172.21.15.59:0/2091788929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f126c0af130 0x7f126c0af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.088+0000 7f1274600640 1 --2- 172.21.15.59:0/2091788929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f126c156e40 0x7f126c06f1c0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.088+0000 7f1274600640 1 -- 172.21.15.59:0/2091788929 >> 172.21.15.59:0/2091788929 conn(0x7f126c0b1e60 msgr2=0x7f126c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:15.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.092+0000 7f1274600640 1 -- 172.21.15.59:0/2091788929 shutdown_connections 2024-05-30T16:59:15.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.092+0000 7f1274600640 1 -- 172.21.15.59:0/2091788929 wait complete. 2024-05-30T16:59:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1274600640 1 Processor -- start 2024-05-30T16:59:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1274600640 1 -- start start 2024-05-30T16:59:15.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1274600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f126c06dc60 0x7f126c099620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1274600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f126c0af130 0x7f126c14ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1274600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f126c156e40 0x7f126c14b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1274600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f126c15eb70 con 0x7f126c156e40 2024-05-30T16:59:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1274600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f126c15e9f0 con 0x7f126c0af130 2024-05-30T16:59:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1274600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f126c167540 con 0x7f126c06dc60 2024-05-30T16:59:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1271200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f126c0af130 0x7f126c14ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1271200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f126c0af130 0x7f126c14ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:42992/0 (socket says 172.21.15.59:42992) 2024-05-30T16:59:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1271200640 1 -- 172.21.15.59:0/2849643487 learned_addr learned my addr 172.21.15.59:0/2849643487 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1272600640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f126c156e40 0x7f126c14b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.096+0000 7f1271c00640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f126c06dc60 0x7f126c099620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1271200640 1 -- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f126c06dc60 msgr2=0x7f126c099620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1271200640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f126c06dc60 0x7f126c099620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1271200640 1 -- 172.21.15.59:0/2849643487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f126c156e40 msgr2=0x7f126c14b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1271200640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f126c156e40 0x7f126c14b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1271200640 1 -- 172.21.15.59:0/2849643487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c098c80 con 0x7f126c0af130 2024-05-30T16:59:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1271200640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f126c0af130 0x7f126c14ae80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f125800c410 tx=0x7f125800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1269600640 1 -- 172.21.15.59:0/2849643487 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258017070 con 0x7f126c0af130 2024-05-30T16:59:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1269600640 1 -- 172.21.15.59:0/2849643487 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1258003600 con 0x7f126c0af130 2024-05-30T16:59:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1269600640 1 -- 172.21.15.59:0/2849643487 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12580039f0 con 0x7f126c0af130 2024-05-30T16:59:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1274600640 1 -- 172.21.15.59:0/2849643487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126c097be0 con 0x7f126c0af130 2024-05-30T16:59:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1274600640 1 -- 172.21.15.59:0/2849643487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f126c0981a0 con 0x7f126c0af130 2024-05-30T16:59:15.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1274600640 1 -- 172.21.15.59:0/2849643487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f126c068a90 con 0x7f126c0af130 2024-05-30T16:59:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.100+0000 7f1269600640 1 -- 172.21.15.59:0/2849643487 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7f1258003b90 con 0x7f126c0af130 2024-05-30T16:59:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.104+0000 7f1269600640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f124c069580 0x7f124c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.104+0000 7f1269600640 1 -- 172.21.15.59:0/2849643487 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5907+0+0 (secure 0 0 0) 0x7f1258084c50 con 0x7f126c0af130 2024-05-30T16:59:15.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.104+0000 7f1271c00640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f124c069580 0x7f124c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.104+0000 7f1271c00640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f124c069580 0x7f124c06ba40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f12600ad000 tx=0x7f12600a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.112+0000 7f1269600640 1 -- 172.21.15.59:0/2849643487 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1258056210 con 0x7f126c0af130 2024-05-30T16:59:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.448+0000 7f1274600640 1 -- 172.21.15.59:0/2849643487 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone698814", "target": ["mon-mgr", ""]}) -- 0x7f126c0b5070 con 0x7f124c069580 2024-05-30T16:59:15.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.484+0000 7f1269600640 1 -- 172.21.15.59:0/2849643487 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f126c0b5070 con 0x7f124c069580 2024-05-30T16:59:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.488+0000 7f1274600640 1 -- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f124c069580 msgr2=0x7f124c06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.488+0000 7f1274600640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f124c069580 0x7f124c06ba40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f12600ad000 tx=0x7f12600a6000 comp rx=0 tx=0).stop 2024-05-30T16:59:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.488+0000 7f1274600640 1 -- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f126c0af130 msgr2=0x7f126c14ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.488+0000 7f1274600640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f126c0af130 0x7f126c14ae80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f125800c410 tx=0x7f125800c8d0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.488+0000 7f1274600640 1 -- 172.21.15.59:0/2849643487 shutdown_connections 2024-05-30T16:59:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.488+0000 7f1274600640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f124c069580 0x7f124c06ba40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.488+0000 7f1274600640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f126c156e40 0x7f126c14b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.488+0000 7f1274600640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f126c0af130 0x7f126c14ae80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.488+0000 7f1274600640 1 --2- 172.21.15.59:0/2849643487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f126c06dc60 0x7f126c099620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.488+0000 7f1274600640 1 -- 172.21.15.59:0/2849643487 >> 172.21.15.59:0/2849643487 conn(0x7f126c0b1e60 msgr2=0x7f126c0b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:15.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.488+0000 7f1274600640 1 -- 172.21.15.59:0/2849643487 shutdown_connections 2024-05-30T16:59:15.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.488+0000 7f1274600640 1 -- 172.21.15.59:0/2849643487 wait complete. 2024-05-30T16:59:15.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69889 2024-05-30T16:59:15.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.736+0000 7fe67ea00640 1 Processor -- start 2024-05-30T16:59:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.736+0000 7fe67ea00640 1 -- start start 2024-05-30T16:59:15.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.736+0000 7fe67ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe678162080 0x7fe6780d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.736+0000 7fe67ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe6780d1630 0x7fe6780d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe67ea00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6780d2de0 con 0x7fe6780b3630 2024-05-30T16:59:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe67ea00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe6780b5970 con 0x7fe678162080 2024-05-30T16:59:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe67ea00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe6780d3010 con 0x7fe6780d1630 2024-05-30T16:59:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe677e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe678162080 0x7fe6780d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe677400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe6780b3630 0x7fe6780b3f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58824/0 (socket says 172.21.15.59:58824) 2024-05-30T16:59:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe677e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe678162080 0x7fe6780d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50134/0 (socket says 172.21.15.59:50134) 2024-05-30T16:59:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe677400640 1 -- 172.21.15.59:0/2500215437 learned_addr learned my addr 172.21.15.59:0/2500215437 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe67ca00640 1 --2- 172.21.15.59:0/2500215437 >> v2:172.21.15.107:3300/0 conn(0x7fe6780d1630 0x7fe6780d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886213558 0 0) 0x7fe6780d2de0 con 0x7fe6780b3630 2024-05-30T16:59:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe65c003530 con 0x7fe6780b3630 2024-05-30T16:59:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3053747424 0 0) 0x7fe65c003530 con 0x7fe6780b3630 2024-05-30T16:59:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 >> v2:172.21.15.107:3300/0 conn(0x7fe6780d1630 msgr2=0x7fe6780d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 --2- 172.21.15.59:0/2500215437 >> v2:172.21.15.107:3300/0 conn(0x7fe6780d1630 0x7fe6780d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 >> v2:172.21.15.59:3300/0 conn(0x7fe678162080 msgr2=0x7fe6780d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 --2- 172.21.15.59:0/2500215437 >> v2:172.21.15.59:3300/0 conn(0x7fe678162080 0x7fe6780d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6780d0910 con 0x7fe6780b3630 2024-05-30T16:59:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fe668001a00 con 0x7fe6780b3630 2024-05-30T16:59:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 >> v1:172.21.15.59:6789/0 conn(0x7fe6780b3630 legacy=0x7fe6780b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 --2- 172.21.15.59:0/2500215437 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe65c0039c0 0x7fe65c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 --2- 172.21.15.59:0/2500215437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe65c004810 0x7fe65c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 --2- 172.21.15.59:0/2500215437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe65c0051d0 0x7fe65c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780b5970 con 0x7fe65c0051d0 2024-05-30T16:59:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780d3010 con 0x7fe65c004810 2024-05-30T16:59:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe65c00c0d0 con 0x7fe65c0039c0 2024-05-30T16:59:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe677400640 1 --2- 172.21.15.59:0/2500215437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe65c004810 0x7fe65c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe677e00640 1 --2- 172.21.15.59:0/2500215437 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe65c0039c0 0x7fe65c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe67ca00640 1 --2- 172.21.15.59:0/2500215437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe65c0051d0 0x7fe65c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe677400640 1 -- 172.21.15.59:0/2500215437 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe65c0039c0 msgr2=0x7fe65c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe677400640 1 --2- 172.21.15.59:0/2500215437 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe65c0039c0 0x7fe65c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe677400640 1 -- 172.21.15.59:0/2500215437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe65c0051d0 msgr2=0x7fe65c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe677400640 1 --2- 172.21.15.59:0/2500215437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe65c0051d0 0x7fe65c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.740+0000 7fe677400640 1 -- 172.21.15.59:0/2500215437 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c003530 con 0x7fe65c004810 2024-05-30T16:59:15.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.744+0000 7fe67ca00640 1 --2- 172.21.15.59:0/2500215437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe65c0051d0 0x7fe65c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:15.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.744+0000 7fe67ca00640 1 -- 172.21.15.59:0/2500215437 reap_dead start 2024-05-30T16:59:15.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.744+0000 7fe677400640 1 --2- 172.21.15.59:0/2500215437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe65c004810 0x7fe65c004c90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe66800a8b0 tx=0x7fe66801d3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=873a9f4416742be9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:15.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.744+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66800a4d0 con 0x7fe65c004810 2024-05-30T16:59:15.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.744+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6680a9020 con 0x7fe65c004810 2024-05-30T16:59:15.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.744+0000 7fe676a00640 1 -- 172.21.15.59:0/2500215437 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6680072f0 con 0x7fe65c004810 2024-05-30T16:59:15.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.748+0000 7fe67ea00640 1 -- 172.21.15.59:0/2500215437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe65c004810 msgr2=0x7fe65c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:15.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.748+0000 7fe67ea00640 1 --2- 172.21.15.59:0/2500215437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe65c004810 0x7fe65c004c90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe66800a8b0 tx=0x7fe66801d3c0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.748+0000 7fe67ea00640 1 -- 172.21.15.59:0/2500215437 shutdown_connections 2024-05-30T16:59:15.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.748+0000 7fe67ea00640 1 --2- 172.21.15.59:0/2500215437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe65c004810 0x7fe65c004c90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.748+0000 7fe67ea00640 1 -- 172.21.15.59:0/2500215437 >> 172.21.15.59:0/2500215437 conn(0x7fe67808bfd0 msgr2=0x7fe6780d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:15.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.748+0000 7fe67ea00640 1 -- 172.21.15.59:0/2500215437 shutdown_connections 2024-05-30T16:59:15.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.748+0000 7fe67ea00640 1 -- 172.21.15.59:0/2500215437 wait complete. 2024-05-30T16:59:15.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.748+0000 7fe67ea00640 1 Processor -- start 2024-05-30T16:59:15.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.748+0000 7fe67ea00640 1 -- start start 2024-05-30T16:59:15.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe65c004810 0x7fe67815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6780b7c90 0x7fe6780b9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6780cd9a0 0x7fe6780cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ea00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780d3260 con 0x7fe6780cd9a0 2024-05-30T16:59:15.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780b5ea0 con 0x7fe65c004810 2024-05-30T16:59:15.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe6780d3780 con 0x7fe6780b7c90 2024-05-30T16:59:15.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe677e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe65c004810 0x7fe67815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe677e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe65c004810 0x7fe67815dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:43032/0 (socket says 172.21.15.59:43032) 2024-05-30T16:59:15.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe677e00640 1 -- 172.21.15.59:0/3666716031 learned_addr learned my addr 172.21.15.59:0/3666716031 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:15.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ca00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6780cd9a0 0x7fe6780cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ca00640 1 -- 172.21.15.59:0/3666716031 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6780b7c90 msgr2=0x7fe6780b9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:15.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ca00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6780b7c90 0x7fe6780b9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ca00640 1 -- 172.21.15.59:0/3666716031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe65c004810 msgr2=0x7fe67815dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:15.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ca00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe65c004810 0x7fe67815dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:15.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ca00640 1 -- 172.21.15.59:0/3666716031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6780d2a60 con 0x7fe6780cd9a0 2024-05-30T16:59:15.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ca00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6780cd9a0 0x7fe6780cde30 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe67808c970 tx=0x7fe67000f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:15.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe66fe00640 1 -- 172.21.15.59:0/3666716031 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670014660 con 0x7fe6780cd9a0 2024-05-30T16:59:15.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe66fe00640 1 -- 172.21.15.59:0/3666716031 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67001a070 con 0x7fe6780cd9a0 2024-05-30T16:59:15.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe66fe00640 1 -- 172.21.15.59:0/3666716031 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670014a40 con 0x7fe6780cd9a0 2024-05-30T16:59:15.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ea00640 1 -- 172.21.15.59:0/3666716031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6780b8130 con 0x7fe6780cd9a0 2024-05-30T16:59:15.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.752+0000 7fe67ea00640 1 -- 172.21.15.59:0/3666716031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6780b86f0 con 0x7fe6780cd9a0 2024-05-30T16:59:15.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.756+0000 7fe67ea00640 1 -- 172.21.15.59:0/3666716031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe678068a90 con 0x7fe6780cd9a0 2024-05-30T16:59:15.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.756+0000 7fe66fe00640 1 -- 172.21.15.59:0/3666716031 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 89619+0+0 (secure 0 0 0) 0x7fe670012070 con 0x7fe6780cd9a0 2024-05-30T16:59:15.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.760+0000 7fe66fe00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe654069580 0x7fe65406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:15.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.760+0000 7fe66fe00640 1 -- 172.21.15.59:0/3666716031 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5907+0+0 (secure 0 0 0) 0x7fe670085ee0 con 0x7fe6780cd9a0 2024-05-30T16:59:15.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.760+0000 7fe677e00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe654069580 0x7fe65406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:15.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.760+0000 7fe677e00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe654069580 0x7fe65406ba40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe66000bbd0 tx=0x7fe660008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:15.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.764+0000 7fe66fe00640 1 -- 172.21.15.59:0/3666716031 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe670057b80 con 0x7fe6780cd9a0 2024-05-30T16:59:15.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:15.892+0000 7fe66fe00640 1 -- 172.21.15.59:0/3666716031 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fe670053af0 con 0x7fe6780cd9a0 2024-05-30T16:59:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.000+0000 7fe67ea00640 1 -- 172.21.15.59:0/3666716031 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69889", "target": ["mon-mgr", ""]}) -- 0x7fe67815e140 con 0x7fe654069580 2024-05-30T16:59:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.040+0000 7fe66fe00640 1 -- 172.21.15.59:0/3666716031 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe67815e140 con 0x7fe654069580 2024-05-30T16:59:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.044+0000 7fe67ea00640 1 -- 172.21.15.59:0/3666716031 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe654069580 msgr2=0x7fe65406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.044+0000 7fe67ea00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe654069580 0x7fe65406ba40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe66000bbd0 tx=0x7fe660008040 comp rx=0 tx=0).stop 2024-05-30T16:59:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.044+0000 7fe67ea00640 1 -- 172.21.15.59:0/3666716031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6780cd9a0 msgr2=0x7fe6780cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.044+0000 7fe67ea00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6780cd9a0 0x7fe6780cde30 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe67808c970 tx=0x7fe67000f5b0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.044+0000 7fe67ea00640 1 -- 172.21.15.59:0/3666716031 shutdown_connections 2024-05-30T16:59:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.044+0000 7fe67ea00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe654069580 0x7fe65406ba40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.044+0000 7fe67ea00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6780cd9a0 0x7fe6780cde30 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.044+0000 7fe67ea00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6780b7c90 0x7fe6780b9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.044+0000 7fe67ea00640 1 --2- 172.21.15.59:0/3666716031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe65c004810 0x7fe67815dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.044+0000 7fe67ea00640 1 -- 172.21.15.59:0/3666716031 >> 172.21.15.59:0/3666716031 conn(0x7fe67808bfd0 msgr2=0x7fe6780b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.044+0000 7fe67ea00640 1 -- 172.21.15.59:0/3666716031 shutdown_connections 2024-05-30T16:59:16.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.044+0000 7fe67ea00640 1 -- 172.21.15.59:0/3666716031 wait complete. 2024-05-30T16:59:16.073 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69887 2024-05-30T16:59:16.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.300+0000 7f99d4a00640 1 Processor -- start 2024-05-30T16:59:16.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.300+0000 7f99d4a00640 1 -- start start 2024-05-30T16:59:16.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.300+0000 7f99d4a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99d009b150 0x7f99d00b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:16.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.300+0000 7f99d4a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99d00d0ed0 con 0x7f99d015ed00 2024-05-30T16:59:16.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.300+0000 7f99d4a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99d00d1690 con 0x7f99d00b4aa0 2024-05-30T16:59:16.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.300+0000 7f99d4a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f99d015f0e0 con 0x7f99d009b150 2024-05-30T16:59:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.300+0000 7f99ce800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f99d00b4aa0 0x7f99d00b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:41330/0 (socket says 172.21.15.59:41330) 2024-05-30T16:59:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.300+0000 7f99ce800640 1 -- 172.21.15.59:0/2690177118 learned_addr learned my addr 172.21.15.59:0/2690177118 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.300+0000 7f99cd400640 1 --2- 172.21.15.59:0/2690177118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99d009b150 0x7f99d00b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.304+0000 7f99cca00640 1 -- 172.21.15.59:0/2690177118 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2281587763 0 0) 0x7f99d00d0ed0 con 0x7f99d015ed00 2024-05-30T16:59:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.304+0000 7f99cca00640 1 -- 172.21.15.59:0/2690177118 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99b4003530 con 0x7f99d015ed00 2024-05-30T16:59:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.304+0000 7f99cd400640 1 -- 172.21.15.59:0/2690177118 >> v1:172.21.15.107:6789/0 conn(0x7f99d00b4aa0 legacy=0x7f99d00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.304+0000 7f99cca00640 1 -- 172.21.15.59:0/2690177118 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 204128184 0 0) 0x7f99d00d1690 con 0x7f99d00b4aa0 2024-05-30T16:59:16.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.304+0000 7f99cd400640 1 -- 172.21.15.59:0/2690177118 >> v1:172.21.15.59:6789/0 conn(0x7f99d015ed00 legacy=0x7f99d009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.304+0000 7f99cd400640 1 -- 172.21.15.59:0/2690177118 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d00b3d60 con 0x7f99d009b150 2024-05-30T16:59:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.308+0000 7f99cd400640 1 --2- 172.21.15.59:0/2690177118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99d009b150 0x7f99d00b1c50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009820 tx=0x7f99bc01c220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcf711bb90b61 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.308+0000 7f99cca00640 1 -- 172.21.15.59:0/2690177118 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0b0070 con 0x7f99d009b150 2024-05-30T16:59:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.308+0000 7f99cca00640 1 -- 172.21.15.59:0/2690177118 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99bc0ab400 con 0x7f99d009b150 2024-05-30T16:59:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.308+0000 7f99cca00640 1 -- 172.21.15.59:0/2690177118 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c00016a0 con 0x7f99d009b150 2024-05-30T16:59:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.308+0000 7f99d4a00640 1 -- 172.21.15.59:0/2690177118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99d009b150 msgr2=0x7f99d00b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.308+0000 7f99d4a00640 1 --2- 172.21.15.59:0/2690177118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99d009b150 0x7f99d00b1c50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009820 tx=0x7f99bc01c220 comp rx=0 tx=0).stop 2024-05-30T16:59:16.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.308+0000 7f99d4a00640 1 -- 172.21.15.59:0/2690177118 shutdown_connections 2024-05-30T16:59:16.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.308+0000 7f99d4a00640 1 --2- 172.21.15.59:0/2690177118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99d009b150 0x7f99d00b1c50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.308+0000 7f99d4a00640 1 -- 172.21.15.59:0/2690177118 >> 172.21.15.59:0/2690177118 conn(0x7f99d00b3f80 msgr2=0x7f99d00b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:16.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.308+0000 7f99d4a00640 1 -- 172.21.15.59:0/2690177118 shutdown_connections 2024-05-30T16:59:16.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.312+0000 7f99d4a00640 1 -- 172.21.15.59:0/2690177118 wait complete. 2024-05-30T16:59:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.312+0000 7f99d4a00640 1 Processor -- start 2024-05-30T16:59:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.312+0000 7f99d4a00640 1 -- start start 2024-05-30T16:59:16.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.312+0000 7f99d4a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d009b150 0x7f99d0153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:16.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.312+0000 7f99d4a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99d00b4aa0 0x7f99d0155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:16.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.312+0000 7f99d4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99d015ed00 0x7f99d014e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:16.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.312+0000 7f99d4a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f99d016d2e0 con 0x7f99d015ed00 2024-05-30T16:59:16.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.312+0000 7f99d4a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f99d00d1200 con 0x7f99d009b150 2024-05-30T16:59:16.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.312+0000 7f99d4a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f99d016d460 con 0x7f99d00b4aa0 2024-05-30T16:59:16.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.312+0000 7f99ce800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99d015ed00 0x7f99d014e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:16.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99ce800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99d015ed00 0x7f99d014e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50156/0 (socket says 172.21.15.59:50156) 2024-05-30T16:59:16.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99ce800640 1 -- 172.21.15.59:0/1495587892 learned_addr learned my addr 172.21.15.59:0/1495587892 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:16.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99cd400640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99d00b4aa0 0x7f99d0155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:16.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99cde00640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d009b150 0x7f99d0153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:16.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99ce800640 1 -- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99d00b4aa0 msgr2=0x7f99d0155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99ce800640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99d00b4aa0 0x7f99d0155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99ce800640 1 -- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d009b150 msgr2=0x7f99d0153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99ce800640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d009b150 0x7f99d0153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99ce800640 1 -- 172.21.15.59:0/1495587892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d0156750 con 0x7f99d015ed00 2024-05-30T16:59:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99ce800640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99d015ed00 0x7f99d014e490 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f99c800c7b0 tx=0x7f99c800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99c6000640 1 -- 172.21.15.59:0/1495587892 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8018070 con 0x7f99d015ed00 2024-05-30T16:59:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99c6000640 1 -- 172.21.15.59:0/1495587892 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c800a640 con 0x7f99d015ed00 2024-05-30T16:59:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99c6000640 1 -- 172.21.15.59:0/1495587892 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c800ce60 con 0x7f99d015ed00 2024-05-30T16:59:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99d4a00640 1 -- 172.21.15.59:0/1495587892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d01569c0 con 0x7f99d015ed00 2024-05-30T16:59:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99d4a00640 1 -- 172.21.15.59:0/1495587892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d0156f80 con 0x7f99d015ed00 2024-05-30T16:59:16.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.316+0000 7f99d4a00640 1 -- 172.21.15.59:0/1495587892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d0068a90 con 0x7f99d015ed00 2024-05-30T16:59:16.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.320+0000 7f99c6000640 1 -- 172.21.15.59:0/1495587892 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f99c800aa70 con 0x7f99d015ed00 2024-05-30T16:59:16.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.320+0000 7f99c6000640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f99b00694f0 0x7f99b006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:16.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.320+0000 7f99c6000640 1 -- 172.21.15.59:0/1495587892 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5907+0+0 (secure 0 0 0) 0x7f99c8084cd0 con 0x7f99d015ed00 2024-05-30T16:59:16.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.320+0000 7f99cde00640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f99b00694f0 0x7f99b006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:16.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.320+0000 7f99cde00640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f99b00694f0 0x7f99b006b9b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f99c0000f70 tx=0x7f99c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:16.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.328+0000 7f99c6000640 1 -- 172.21.15.59:0/1495587892 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f99c808c070 con 0x7f99d015ed00 2024-05-30T16:59:16.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.704+0000 7f99d4a00640 1 -- 172.21.15.59:0/1495587892 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69887", "target": ["mon-mgr", ""]}) -- 0x7f99d00b8410 con 0x7f99b00694f0 2024-05-30T16:59:16.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.744+0000 7f99c6000640 1 -- 172.21.15.59:0/1495587892 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f99d00b8410 con 0x7f99b00694f0 2024-05-30T16:59:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.744+0000 7f99d4a00640 1 -- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f99b00694f0 msgr2=0x7f99b006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.744+0000 7f99d4a00640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f99b00694f0 0x7f99b006b9b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f99c0000f70 tx=0x7f99c0009040 comp rx=0 tx=0).stop 2024-05-30T16:59:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.744+0000 7f99d4a00640 1 -- 172.21.15.59:0/1495587892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99d015ed00 msgr2=0x7f99d014e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.744+0000 7f99d4a00640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99d015ed00 0x7f99d014e490 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f99c800c7b0 tx=0x7f99c800cc70 comp rx=0 tx=0).stop 2024-05-30T16:59:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.744+0000 7f99d4a00640 1 -- 172.21.15.59:0/1495587892 shutdown_connections 2024-05-30T16:59:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.744+0000 7f99d4a00640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f99b00694f0 0x7f99b006b9b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.744+0000 7f99d4a00640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99d015ed00 0x7f99d014e490 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.744+0000 7f99d4a00640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99d00b4aa0 0x7f99d0155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.744+0000 7f99d4a00640 1 --2- 172.21.15.59:0/1495587892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d009b150 0x7f99d0153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.744+0000 7f99d4a00640 1 -- 172.21.15.59:0/1495587892 >> 172.21.15.59:0/1495587892 conn(0x7f99d00b3f80 msgr2=0x7f99d00b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:16.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.748+0000 7f99d4a00640 1 -- 172.21.15.59:0/1495587892 shutdown_connections 2024-05-30T16:59:16.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.748+0000 7f99d4a00640 1 -- 172.21.15.59:0/1495587892 wait complete. 2024-05-30T16:59:16.779 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69885 2024-05-30T16:59:16.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.956+0000 7f1c71800640 1 Processor -- start 2024-05-30T16:59:16.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.956+0000 7f1c71800640 1 -- start start 2024-05-30T16:59:16.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c71800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c6c15e950 0x7f1c6c0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:16.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c71800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1c6c0b3bf0 0x7f1c6c073500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:16.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c71800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6c15fd40 con 0x7f1c6c0730a0 2024-05-30T16:59:16.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c71800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1c6c073a40 con 0x7f1c6c0b3bf0 2024-05-30T16:59:16.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c71800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1c6c0b08c0 con 0x7f1c6c15e950 2024-05-30T16:59:16.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c6a000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1c6c0730a0 0x7f1c6c0b34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58846/0 (socket says 172.21.15.59:58846) 2024-05-30T16:59:16.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c6a000640 1 -- 172.21.15.59:0/1536987606 learned_addr learned my addr 172.21.15.59:0/1536987606 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:16.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c6b400640 1 --2- 172.21.15.59:0/1536987606 >> v2:172.21.15.107:3300/0 conn(0x7f1c6c0b3bf0 0x7f1c6c073500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:16.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c6aa00640 1 --2- 172.21.15.59:0/1536987606 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c6c15e950 0x7f1c6c0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:16.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c6aa00640 1 -- 172.21.15.59:0/1536987606 >> v2:172.21.15.107:3300/0 conn(0x7f1c6c0b3bf0 msgr2=0x7f1c6c073500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:16.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c6aa00640 1 --2- 172.21.15.59:0/1536987606 >> v2:172.21.15.107:3300/0 conn(0x7f1c6c0b3bf0 0x7f1c6c073500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c6aa00640 1 -- 172.21.15.59:0/1536987606 >> v1:172.21.15.59:6789/0 conn(0x7f1c6c0730a0 legacy=0x7f1c6c0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c6aa00640 1 -- 172.21.15.59:0/1536987606 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c0b0ba0 con 0x7f1c6c15e950 2024-05-30T16:59:16.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.960+0000 7f1c6b400640 1 --2- 172.21.15.59:0/1536987606 >> v2:172.21.15.107:3300/0 conn(0x7f1c6c0b3bf0 0x7f1c6c073500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:59:16.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.964+0000 7f1c6aa00640 1 --2- 172.21.15.59:0/1536987606 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c6c15e950 0x7f1c6c0b1680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0097c0 tx=0x7f1c5c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0404aa538cbbadb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:16.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.968+0000 7f1c69600640 1 -- 172.21.15.59:0/1536987606 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0b0070 con 0x7f1c6c15e950 2024-05-30T16:59:16.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.968+0000 7f1c69600640 1 -- 172.21.15.59:0/1536987606 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c5c0ab600 con 0x7f1c6c15e950 2024-05-30T16:59:16.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.968+0000 7f1c69600640 1 -- 172.21.15.59:0/1536987606 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0ab9d0 con 0x7f1c6c15e950 2024-05-30T16:59:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.968+0000 7f1c71800640 1 -- 172.21.15.59:0/1536987606 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c6c15e950 msgr2=0x7f1c6c0b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.968+0000 7f1c71800640 1 --2- 172.21.15.59:0/1536987606 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c6c15e950 0x7f1c6c0b1680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0097c0 tx=0x7f1c5c01c4a0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.968+0000 7f1c71800640 1 -- 172.21.15.59:0/1536987606 shutdown_connections 2024-05-30T16:59:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.968+0000 7f1c71800640 1 --2- 172.21.15.59:0/1536987606 >> v2:172.21.15.107:3300/0 conn(0x7f1c6c0b3bf0 0x7f1c6c073500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.968+0000 7f1c71800640 1 --2- 172.21.15.59:0/1536987606 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c6c15e950 0x7f1c6c0b1680 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.968+0000 7f1c71800640 1 -- 172.21.15.59:0/1536987606 >> 172.21.15.59:0/1536987606 conn(0x7f1c6c0721f0 msgr2=0x7f1c6c0b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.968+0000 7f1c71800640 1 -- 172.21.15.59:0/1536987606 shutdown_connections 2024-05-30T16:59:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.968+0000 7f1c71800640 1 -- 172.21.15.59:0/1536987606 wait complete. 2024-05-30T16:59:16.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c71800640 1 Processor -- start 2024-05-30T16:59:16.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c71800640 1 -- start start 2024-05-30T16:59:16.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c71800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c6c0730a0 0x7f1c6c0ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:16.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c71800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c6c0b3bf0 0x7f1c6c09a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:16.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c71800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c6c15e950 0x7f1c6c1fa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:16.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c71800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c16b4b0 con 0x7f1c6c0b3bf0 2024-05-30T16:59:16.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c71800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c160a50 con 0x7f1c6c15e950 2024-05-30T16:59:16.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c71800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1c6c16b630 con 0x7f1c6c0730a0 2024-05-30T16:59:16.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c6a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c6c0b3bf0 0x7f1c6c09a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:16.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c6b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c6c15e950 0x7f1c6c1fa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:16.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c6b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c6c15e950 0x7f1c6c1fa720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:43060/0 (socket says 172.21.15.59:43060) 2024-05-30T16:59:16.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c6a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c6c0b3bf0 0x7f1c6c09a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50166/0 (socket says 172.21.15.59:50166) 2024-05-30T16:59:16.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c6b400640 1 -- 172.21.15.59:0/3190725764 learned_addr learned my addr 172.21.15.59:0/3190725764 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:16.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c6b400640 1 -- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c6c0730a0 msgr2=0x7f1c6c0ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c6b400640 1 --2- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c6c0730a0 0x7f1c6c0ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c6b400640 1 -- 172.21.15.59:0/3190725764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c6c0b3bf0 msgr2=0x7f1c6c09a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:16.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c6b400640 1 --2- 172.21.15.59:0/3190725764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c6c0b3bf0 0x7f1c6c09a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:16.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c6b400640 1 -- 172.21.15.59:0/3190725764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c09ce80 con 0x7f1c6c15e950 2024-05-30T16:59:16.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c6b400640 1 --2- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c6c15e950 0x7f1c6c1fa720 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400efc0 tx=0x7f1c64009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:16.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c62a00640 1 -- 172.21.15.59:0/3190725764 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64018030 con 0x7f1c6c15e950 2024-05-30T16:59:16.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c62a00640 1 -- 172.21.15.59:0/3190725764 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c6400cde0 con 0x7f1c6c15e950 2024-05-30T16:59:16.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c62a00640 1 -- 172.21.15.59:0/3190725764 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64003bc0 con 0x7f1c6c15e950 2024-05-30T16:59:16.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.972+0000 7f1c71800640 1 -- 172.21.15.59:0/3190725764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6c09d120 con 0x7f1c6c15e950 2024-05-30T16:59:16.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.976+0000 7f1c71800640 1 -- 172.21.15.59:0/3190725764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6c09d6e0 con 0x7f1c6c15e950 2024-05-30T16:59:16.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.976+0000 7f1c71800640 1 -- 172.21.15.59:0/3190725764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c6c068a90 con 0x7f1c6c15e950 2024-05-30T16:59:16.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.976+0000 7f1c62a00640 1 -- 172.21.15.59:0/3190725764 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f1c6401b070 con 0x7f1c6c15e950 2024-05-30T16:59:16.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.980+0000 7f1c62a00640 1 --2- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c4c069540 0x7f1c4c06ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:16.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.980+0000 7f1c62a00640 1 -- 172.21.15.59:0/3190725764 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5907+0+0 (secure 0 0 0) 0x7f1c64086250 con 0x7f1c6c15e950 2024-05-30T16:59:16.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.980+0000 7f1c6aa00640 1 --2- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c4c069540 0x7f1c4c06ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.984+0000 7f1c6aa00640 1 --2- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c4c069540 0x7f1c4c06ba00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0ad000 tx=0x7f1c5c004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:16.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:16.988+0000 7f1c62a00640 1 -- 172.21.15.59:0/3190725764 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1c64022070 con 0x7f1c6c15e950 2024-05-30T16:59:17.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.348+0000 7f1c71800640 1 -- 172.21.15.59:0/3190725764 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69885", "target": ["mon-mgr", ""]}) -- 0x7f1c6c161f50 con 0x7f1c4c069540 2024-05-30T16:59:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.380+0000 7f1c62a00640 1 -- 172.21.15.59:0/3190725764 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1c6c161f50 con 0x7f1c4c069540 2024-05-30T16:59:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.380+0000 7f1c71800640 1 -- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c4c069540 msgr2=0x7f1c4c06ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.380+0000 7f1c71800640 1 --2- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c4c069540 0x7f1c4c06ba00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0ad000 tx=0x7f1c5c004740 comp rx=0 tx=0).stop 2024-05-30T16:59:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.380+0000 7f1c71800640 1 -- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c6c15e950 msgr2=0x7f1c6c1fa720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.380+0000 7f1c71800640 1 --2- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c6c15e950 0x7f1c6c1fa720 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400efc0 tx=0x7f1c64009f90 comp rx=0 tx=0).stop 2024-05-30T16:59:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.380+0000 7f1c71800640 1 -- 172.21.15.59:0/3190725764 shutdown_connections 2024-05-30T16:59:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.380+0000 7f1c71800640 1 --2- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1c4c069540 0x7f1c4c06ba00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.380+0000 7f1c71800640 1 --2- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c6c15e950 0x7f1c6c1fa720 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.380+0000 7f1c71800640 1 --2- 172.21.15.59:0/3190725764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c6c0b3bf0 0x7f1c6c09a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.380+0000 7f1c71800640 1 --2- 172.21.15.59:0/3190725764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c6c0730a0 0x7f1c6c0ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.380+0000 7f1c71800640 1 -- 172.21.15.59:0/3190725764 >> 172.21.15.59:0/3190725764 conn(0x7f1c6c0721f0 msgr2=0x7f1c6c0d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.384+0000 7f1c71800640 1 -- 172.21.15.59:0/3190725764 shutdown_connections 2024-05-30T16:59:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.384+0000 7f1c71800640 1 -- 172.21.15.59:0/3190725764 wait complete. 2024-05-30T16:59:17.413 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone698816 2024-05-30T16:59:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.580+0000 7f7459600640 1 Processor -- start 2024-05-30T16:59:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.580+0000 7f7459600640 1 -- start start 2024-05-30T16:59:17.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f7459600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f74540b2a50 0x7f74540b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:17.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f7459600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74540b0830 0x7f74540af570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:17.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f7459600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74540b42f0 con 0x7f745415e830 2024-05-30T16:59:17.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f7459600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f74540b64e0 con 0x7f74540b0830 2024-05-30T16:59:17.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f7459600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f74540b45d0 con 0x7f74540b2a50 2024-05-30T16:59:17.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f7452a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f745415e830 0x7f74540b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58854/0 (socket says 172.21.15.59:58854) 2024-05-30T16:59:17.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f7452a00640 1 -- 172.21.15.59:0/975925922 learned_addr learned my addr 172.21.15.59:0/975925922 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:17.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f7453400640 1 --2- 172.21.15.59:0/975925922 >> v2:172.21.15.59:3300/0 conn(0x7f74540b0830 0x7f74540af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:17.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f744a000640 1 --2- 172.21.15.59:0/975925922 >> v2:172.21.15.107:3300/0 conn(0x7f74540b2a50 0x7f74540b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:17.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f7452000640 1 -- 172.21.15.59:0/975925922 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918264939 0 0) 0x7f74540b42f0 con 0x7f745415e830 2024-05-30T16:59:17.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f7452000640 1 -- 172.21.15.59:0/975925922 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7438003530 con 0x7f745415e830 2024-05-30T16:59:17.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f744a000640 1 -- 172.21.15.59:0/975925922 >> v2:172.21.15.59:3300/0 conn(0x7f74540b0830 msgr2=0x7f74540af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:17.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f744a000640 1 --2- 172.21.15.59:0/975925922 >> v2:172.21.15.59:3300/0 conn(0x7f74540b0830 0x7f74540af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f744a000640 1 -- 172.21.15.59:0/975925922 >> v1:172.21.15.59:6789/0 conn(0x7f745415e830 legacy=0x7f74540b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:17.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f744a000640 1 -- 172.21.15.59:0/975925922 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74540aed70 con 0x7f74540b2a50 2024-05-30T16:59:17.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.584+0000 7f7453400640 1 --2- 172.21.15.59:0/975925922 >> v2:172.21.15.59:3300/0 conn(0x7f74540b0830 0x7f74540af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:59:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f744a000640 1 --2- 172.21.15.59:0/975925922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74540b2a50 0x7f74540b02f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f74540b3ff0 tx=0x7f743c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4c9d9078c6ca83 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7452000640 1 -- 172.21.15.59:0/975925922 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c0b0070 con 0x7f74540b2a50 2024-05-30T16:59:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7452000640 1 -- 172.21.15.59:0/975925922 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c0ab600 con 0x7f74540b2a50 2024-05-30T16:59:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7452000640 1 -- 172.21.15.59:0/975925922 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c0ab9d0 con 0x7f74540b2a50 2024-05-30T16:59:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7459600640 1 -- 172.21.15.59:0/975925922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74540b2a50 msgr2=0x7f74540b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:17.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7459600640 1 --2- 172.21.15.59:0/975925922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74540b2a50 0x7f74540b02f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f74540b3ff0 tx=0x7f743c01c3c0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7459600640 1 -- 172.21.15.59:0/975925922 shutdown_connections 2024-05-30T16:59:17.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7459600640 1 --2- 172.21.15.59:0/975925922 >> v2:172.21.15.59:3300/0 conn(0x7f74540b0830 0x7f74540af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7459600640 1 --2- 172.21.15.59:0/975925922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74540b2a50 0x7f74540b02f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7459600640 1 -- 172.21.15.59:0/975925922 >> 172.21.15.59:0/975925922 conn(0x7f74540b6770 msgr2=0x7f74540b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:17.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7459600640 1 -- 172.21.15.59:0/975925922 shutdown_connections 2024-05-30T16:59:17.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7459600640 1 -- 172.21.15.59:0/975925922 wait complete. 2024-05-30T16:59:17.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7459600640 1 Processor -- start 2024-05-30T16:59:17.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.588+0000 7f7459600640 1 -- start start 2024-05-30T16:59:17.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7459600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74540b0830 0x7f745415d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:17.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7459600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74540b2a50 0x7f7454156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:17.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7459600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f745415e830 0x7f74541407b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:17.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7459600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f745416b5a0 con 0x7f74540b0830 2024-05-30T16:59:17.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7459600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f745416b420 con 0x7f745415e830 2024-05-30T16:59:17.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7459600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f745416b720 con 0x7f74540b2a50 2024-05-30T16:59:17.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7452a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74540b0830 0x7f745415d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:17.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7452a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74540b0830 0x7f745415d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50174/0 (socket says 172.21.15.59:50174) 2024-05-30T16:59:17.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7452a00640 1 -- 172.21.15.59:0/424477921 learned_addr learned my addr 172.21.15.59:0/424477921 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:17.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7453400640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f745415e830 0x7f74541407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:17.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f744a000640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74540b2a50 0x7f7454156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:17.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7452a00640 1 -- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74540b2a50 msgr2=0x7f7454156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:17.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7452a00640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74540b2a50 0x7f7454156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7452a00640 1 -- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f745415e830 msgr2=0x7f74541407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:17.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7452a00640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f745415e830 0x7f74541407b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7452a00640 1 -- 172.21.15.59:0/424477921 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745415f220 con 0x7f74540b0830 2024-05-30T16:59:17.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7453400640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f745415e830 0x7f74541407b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:17.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f744a000640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74540b2a50 0x7f7454156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:17.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7452a00640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74540b0830 0x7f745415d0e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f744400c450 tx=0x7f744400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:17.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f744b400640 1 -- 172.21.15.59:0/424477921 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444017070 con 0x7f74540b0830 2024-05-30T16:59:17.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f744b400640 1 -- 172.21.15.59:0/424477921 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7444005cf0 con 0x7f74540b0830 2024-05-30T16:59:17.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7459600640 1 -- 172.21.15.59:0/424477921 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f745415f500 con 0x7f74540b0830 2024-05-30T16:59:17.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f744b400640 1 -- 172.21.15.59:0/424477921 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444007290 con 0x7f74540b0830 2024-05-30T16:59:17.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7459600640 1 -- 172.21.15.59:0/424477921 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745415fac0 con 0x7f74540b0830 2024-05-30T16:59:17.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f7459600640 1 -- 172.21.15.59:0/424477921 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7454068a90 con 0x7f74540b0830 2024-05-30T16:59:17.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.592+0000 7f744b400640 1 -- 172.21.15.59:0/424477921 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f744401a070 con 0x7f74540b0830 2024-05-30T16:59:17.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.596+0000 7f744b400640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74300694f0 0x7f743006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:17.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.596+0000 7f744b400640 1 -- 172.21.15.59:0/424477921 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5907+0+0 (secure 0 0 0) 0x7f7444084d00 con 0x7f74540b0830 2024-05-30T16:59:17.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.596+0000 7f744a000640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74300694f0 0x7f743006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:17.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.596+0000 7f744a000640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74300694f0 0x7f743006b9b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f743c0ad000 tx=0x7f743c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:17.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.600+0000 7f744b400640 1 -- 172.21.15.59:0/424477921 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7444056970 con 0x7f74540b0830 2024-05-30T16:59:17.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.788+0000 7f7459600640 1 -- 172.21.15.59:0/424477921 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone698816", "target": ["mon-mgr", ""]}) -- 0x7f7454155990 con 0x7f74300694f0 2024-05-30T16:59:17.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.804+0000 7f744b400640 1 -- 172.21.15.59:0/424477921 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7454155990 con 0x7f74300694f0 2024-05-30T16:59:17.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.808+0000 7f7459600640 1 -- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74300694f0 msgr2=0x7f743006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.808+0000 7f7459600640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74300694f0 0x7f743006b9b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f743c0ad000 tx=0x7f743c008040 comp rx=0 tx=0).stop 2024-05-30T16:59:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.808+0000 7f7459600640 1 -- 172.21.15.59:0/424477921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74540b0830 msgr2=0x7f745415d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.808+0000 7f7459600640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74540b0830 0x7f745415d0e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f744400c450 tx=0x7f744400c910 comp rx=0 tx=0).stop 2024-05-30T16:59:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.808+0000 7f7459600640 1 -- 172.21.15.59:0/424477921 shutdown_connections 2024-05-30T16:59:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.808+0000 7f7459600640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f74300694f0 0x7f743006b9b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.808+0000 7f7459600640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f745415e830 0x7f74541407b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.808+0000 7f7459600640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74540b2a50 0x7f7454156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.808+0000 7f7459600640 1 --2- 172.21.15.59:0/424477921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74540b0830 0x7f745415d0e0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.808+0000 7f7459600640 1 -- 172.21.15.59:0/424477921 >> 172.21.15.59:0/424477921 conn(0x7f74540b6770 msgr2=0x7f74540b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.808+0000 7f7459600640 1 -- 172.21.15.59:0/424477921 shutdown_connections 2024-05-30T16:59:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:17.808+0000 7f7459600640 1 -- 172.21.15.59:0/424477921 wait complete. 2024-05-30T16:59:17.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69886 2024-05-30T16:59:18.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.020+0000 7f8c77600640 1 Processor -- start 2024-05-30T16:59:18.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c77600640 1 -- start start 2024-05-30T16:59:18.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c77600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8c700c5b70 0x7f8c700d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c77600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c700b3880 0x7f8c7009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c77600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c700d0a00 con 0x7f8c70166460 2024-05-30T16:59:18.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c77600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f8c700b2f40 con 0x7f8c700b3880 2024-05-30T16:59:18.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c77600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8c700b2980 con 0x7f8c700c5b70 2024-05-30T16:59:18.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c75600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c700b3880 0x7f8c7009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c75600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c700b3880 0x7f8c7009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50186/0 (socket says 172.21.15.59:50186) 2024-05-30T16:59:18.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c75600640 1 -- 172.21.15.59:0/970709916 learned_addr learned my addr 172.21.15.59:0/970709916 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:18.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c6fe00640 1 --2- 172.21.15.59:0/970709916 >> v2:172.21.15.107:3300/0 conn(0x7f8c700c5b70 0x7f8c700d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c75600640 1 -- 172.21.15.59:0/970709916 >> v2:172.21.15.107:3300/0 conn(0x7f8c700c5b70 msgr2=0x7f8c700d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:18.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c75600640 1 --2- 172.21.15.59:0/970709916 >> v2:172.21.15.107:3300/0 conn(0x7f8c700c5b70 0x7f8c700d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c75600640 1 -- 172.21.15.59:0/970709916 >> v1:172.21.15.107:6789/0 conn(0x7f8c70166460 legacy=0x7f8c700c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:18.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c75600640 1 -- 172.21.15.59:0/970709916 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c700b2c60 con 0x7f8c700b3880 2024-05-30T16:59:18.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.024+0000 7f8c6fe00640 1 --2- 172.21.15.59:0/970709916 >> v2:172.21.15.107:3300/0 conn(0x7f8c700c5b70 0x7f8c700d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:18.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.028+0000 7f8c75600640 1 --2- 172.21.15.59:0/970709916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c700b3880 0x7f8c7009aa40 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f8c700b83c0 tx=0x7f8c6801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96f6a553da19aae server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:18.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.032+0000 7f8c6f400640 1 -- 172.21.15.59:0/970709916 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c680a5660 con 0x7f8c700b3880 2024-05-30T16:59:18.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.032+0000 7f8c6f400640 1 -- 172.21.15.59:0/970709916 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c680a5800 con 0x7f8c700b3880 2024-05-30T16:59:18.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.032+0000 7f8c6f400640 1 -- 172.21.15.59:0/970709916 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c680a5bd0 con 0x7f8c700b3880 2024-05-30T16:59:18.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.032+0000 7f8c77600640 1 -- 172.21.15.59:0/970709916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c700b3880 msgr2=0x7f8c7009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:18.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.032+0000 7f8c77600640 1 --2- 172.21.15.59:0/970709916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c700b3880 0x7f8c7009aa40 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f8c700b83c0 tx=0x7f8c6801c890 comp rx=0 tx=0).stop 2024-05-30T16:59:18.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.032+0000 7f8c77600640 1 -- 172.21.15.59:0/970709916 shutdown_connections 2024-05-30T16:59:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.032+0000 7f8c77600640 1 --2- 172.21.15.59:0/970709916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c700b3880 0x7f8c7009aa40 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.032+0000 7f8c77600640 1 --2- 172.21.15.59:0/970709916 >> v2:172.21.15.107:3300/0 conn(0x7f8c700c5b70 0x7f8c700d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.032+0000 7f8c77600640 1 -- 172.21.15.59:0/970709916 >> 172.21.15.59:0/970709916 conn(0x7f8c700b3f80 msgr2=0x7f8c700b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.032+0000 7f8c77600640 1 -- 172.21.15.59:0/970709916 shutdown_connections 2024-05-30T16:59:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.032+0000 7f8c77600640 1 -- 172.21.15.59:0/970709916 wait complete. 2024-05-30T16:59:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c77600640 1 Processor -- start 2024-05-30T16:59:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c77600640 1 -- start start 2024-05-30T16:59:18.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c77600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c700b3880 0x7f8c7015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c77600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c700c5b70 0x7f8c700b5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c77600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c70166460 0x7f8c700b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c77600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7009b910 con 0x7f8c70166460 2024-05-30T16:59:18.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c77600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7009b790 con 0x7f8c700b3880 2024-05-30T16:59:18.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c77600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7016fd70 con 0x7f8c700c5b70 2024-05-30T16:59:18.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c74c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c700b3880 0x7f8c7015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c75600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c70166460 0x7f8c700b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c74c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c700b3880 0x7f8c7015e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:43108/0 (socket says 172.21.15.59:43108) 2024-05-30T16:59:18.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c74c00640 1 -- 172.21.15.59:0/603529707 learned_addr learned my addr 172.21.15.59:0/603529707 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:18.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c6fe00640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c700c5b70 0x7f8c700b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c75600640 1 -- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c700c5b70 msgr2=0x7f8c700b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c75600640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c700c5b70 0x7f8c700b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c75600640 1 -- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c700b3880 msgr2=0x7f8c7015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c75600640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c700b3880 0x7f8c7015e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c75600640 1 -- 172.21.15.59:0/603529707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c700ce930 con 0x7f8c70166460 2024-05-30T16:59:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.036+0000 7f8c75600640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c70166460 0x7f8c700b5ca0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f8c680ab000 tx=0x7f8c68019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.040+0000 7f8c6cc00640 1 -- 172.21.15.59:0/603529707 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c680bc020 con 0x7f8c70166460 2024-05-30T16:59:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.040+0000 7f8c6cc00640 1 -- 172.21.15.59:0/603529707 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c680b8690 con 0x7f8c70166460 2024-05-30T16:59:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.040+0000 7f8c6cc00640 1 -- 172.21.15.59:0/603529707 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c680a5660 con 0x7f8c70166460 2024-05-30T16:59:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.040+0000 7f8c77600640 1 -- 172.21.15.59:0/603529707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c70161580 con 0x7f8c70166460 2024-05-30T16:59:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.040+0000 7f8c77600640 1 -- 172.21.15.59:0/603529707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c70161b40 con 0x7f8c70166460 2024-05-30T16:59:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.040+0000 7f8c77600640 1 -- 172.21.15.59:0/603529707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c70068a90 con 0x7f8c70166460 2024-05-30T16:59:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.044+0000 7f8c6cc00640 1 -- 172.21.15.59:0/603529707 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f8c680bf020 con 0x7f8c70166460 2024-05-30T16:59:18.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.044+0000 7f8c6cc00640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c50069540 0x7f8c5006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.044+0000 7f8c6cc00640 1 -- 172.21.15.59:0/603529707 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5907+0+0 (secure 0 0 0) 0x7f8c681207b0 con 0x7f8c70166460 2024-05-30T16:59:18.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.044+0000 7f8c74c00640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c50069540 0x7f8c5006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.044+0000 7f8c74c00640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c50069540 0x7f8c5006ba00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8c700c9340 tx=0x7f8c64009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:18.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.052+0000 7f8c6cc00640 1 -- 172.21.15.59:0/603529707 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8c680165a0 con 0x7f8c70166460 2024-05-30T16:59:18.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.376+0000 7f8c77600640 1 -- 172.21.15.59:0/603529707 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69886", "target": ["mon-mgr", ""]}) -- 0x7f8c70165bc0 con 0x7f8c50069540 2024-05-30T16:59:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.396+0000 7f8c6cc00640 1 -- 172.21.15.59:0/603529707 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8c70165bc0 con 0x7f8c50069540 2024-05-30T16:59:18.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.400+0000 7f8c77600640 1 -- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c50069540 msgr2=0x7f8c5006ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:18.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.400+0000 7f8c77600640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c50069540 0x7f8c5006ba00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8c700c9340 tx=0x7f8c64009110 comp rx=0 tx=0).stop 2024-05-30T16:59:18.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.400+0000 7f8c77600640 1 -- 172.21.15.59:0/603529707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c70166460 msgr2=0x7f8c700b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.400+0000 7f8c77600640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c70166460 0x7f8c700b5ca0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f8c680ab000 tx=0x7f8c68019630 comp rx=0 tx=0).stop 2024-05-30T16:59:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.400+0000 7f8c77600640 1 -- 172.21.15.59:0/603529707 shutdown_connections 2024-05-30T16:59:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.400+0000 7f8c77600640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c50069540 0x7f8c5006ba00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.400+0000 7f8c77600640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c70166460 0x7f8c700b5ca0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.400+0000 7f8c77600640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c700c5b70 0x7f8c700b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.400+0000 7f8c77600640 1 --2- 172.21.15.59:0/603529707 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c700b3880 0x7f8c7015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.400+0000 7f8c77600640 1 -- 172.21.15.59:0/603529707 >> 172.21.15.59:0/603529707 conn(0x7f8c700b3f80 msgr2=0x7f8c7015f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.400+0000 7f8c77600640 1 -- 172.21.15.59:0/603529707 shutdown_connections 2024-05-30T16:59:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.400+0000 7f8c77600640 1 -- 172.21.15.59:0/603529707 wait complete. 2024-05-30T16:59:18.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone698810 2024-05-30T16:59:18.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6ad000640 1 Processor -- start 2024-05-30T16:59:18.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6ad000640 1 -- start start 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6ad000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a815b3b0 0x7fd6a80adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6ad000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6a80723c0 0x7fd6a80af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6ad000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a8072850 con 0x7fd6a815b790 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6ad000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd6a80afaf0 con 0x7fd6a80723c0 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6ad000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a80ae510 con 0x7fd6a815b3b0 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6a6800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6a80723c0 0x7fd6a80af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6a6800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6a80723c0 0x7fd6a80af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50200/0 (socket says 172.21.15.59:50200) 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6a6800640 1 -- 172.21.15.59:0/313037501 learned_addr learned my addr 172.21.15.59:0/313037501 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6a5e00640 1 --2- 172.21.15.59:0/313037501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a815b3b0 0x7fd6a80adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6a6800640 1 -- 172.21.15.59:0/313037501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a815b3b0 msgr2=0x7fd6a80adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6a6800640 1 --2- 172.21.15.59:0/313037501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a815b3b0 0x7fd6a80adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6a6800640 1 -- 172.21.15.59:0/313037501 >> v1:172.21.15.107:6789/0 conn(0x7fd6a815b790 legacy=0x7fd6a8071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6a6800640 1 -- 172.21.15.59:0/313037501 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a80ae7f0 con 0x7fd6a80723c0 2024-05-30T16:59:18.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.564+0000 7fd6a5400640 1 -- 172.21.15.59:0/313037501 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671216374 0 0) 0x7fd6a8072850 con 0x7fd6a815b790 2024-05-30T16:59:18.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.568+0000 7fd6a6800640 1 --2- 172.21.15.59:0/313037501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6a80723c0 0x7fd6a80af5b0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009e80 tx=0x7fd6a001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60d77e18440da35 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:18.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.568+0000 7fd6a5400640 1 -- 172.21.15.59:0/313037501 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00a58a0 con 0x7fd6a80723c0 2024-05-30T16:59:18.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.568+0000 7fd6a5400640 1 -- 172.21.15.59:0/313037501 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a00a5a40 con 0x7fd6a80723c0 2024-05-30T16:59:18.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.568+0000 7fd6a5400640 1 -- 172.21.15.59:0/313037501 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00a5e10 con 0x7fd6a80723c0 2024-05-30T16:59:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.568+0000 7fd6ad000640 1 -- 172.21.15.59:0/313037501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6a80723c0 msgr2=0x7fd6a80af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.568+0000 7fd6ad000640 1 --2- 172.21.15.59:0/313037501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6a80723c0 0x7fd6a80af5b0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009e80 tx=0x7fd6a001c9e0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.568+0000 7fd6ad000640 1 -- 172.21.15.59:0/313037501 shutdown_connections 2024-05-30T16:59:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.568+0000 7fd6ad000640 1 --2- 172.21.15.59:0/313037501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6a80723c0 0x7fd6a80af5b0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.568+0000 7fd6ad000640 1 --2- 172.21.15.59:0/313037501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a815b3b0 0x7fd6a80adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.568+0000 7fd6ad000640 1 -- 172.21.15.59:0/313037501 >> 172.21.15.59:0/313037501 conn(0x7fd6a80b1e60 msgr2=0x7fd6a80b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.568+0000 7fd6ad000640 1 -- 172.21.15.59:0/313037501 shutdown_connections 2024-05-30T16:59:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.568+0000 7fd6ad000640 1 -- 172.21.15.59:0/313037501 wait complete. 2024-05-30T16:59:18.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6ad000640 1 Processor -- start 2024-05-30T16:59:18.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6ad000640 1 -- start start 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6ad000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a80723c0 0x7fd6a8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6ad000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6a815b3b0 0x7fd6a81f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6ad000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a815b790 0x7fd6a81f8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6ad000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a80cc7d0 con 0x7fd6a815b3b0 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6ad000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a80cc650 con 0x7fd6a815b790 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6ad000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a80b3970 con 0x7fd6a80723c0 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd69fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6a815b3b0 0x7fd6a81f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6a5e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a80723c0 0x7fd6a8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6a5e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a80723c0 0x7fd6a8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:37008/0 (socket says 172.21.15.59:37008) 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6a5e00640 1 -- 172.21.15.59:0/2628001423 learned_addr learned my addr 172.21.15.59:0/2628001423 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd69fe00640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6a815b3b0 0x7fd6a81f8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50204/0 (socket says 172.21.15.59:50204) 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6a6800640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a815b790 0x7fd6a81f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6a5e00640 1 -- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a815b790 msgr2=0x7fd6a81f8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6a5e00640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a815b790 0x7fd6a81f8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6a5e00640 1 -- 172.21.15.59:0/2628001423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6a815b3b0 msgr2=0x7fd6a81f8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6a5e00640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6a815b3b0 0x7fd6a81f8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6a5e00640 1 -- 172.21.15.59:0/2628001423 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a8157130 con 0x7fd6a80723c0 2024-05-30T16:59:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd69fe00640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6a815b3b0 0x7fd6a81f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:59:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6a5e00640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a80723c0 0x7fd6a8152f20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd69800e960 tx=0x7fd69800ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd69e000640 1 -- 172.21.15.59:0/2628001423 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698017070 con 0x7fd6a80723c0 2024-05-30T16:59:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd69e000640 1 -- 172.21.15.59:0/2628001423 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69800ca00 con 0x7fd6a80723c0 2024-05-30T16:59:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd69e000640 1 -- 172.21.15.59:0/2628001423 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69800cdb0 con 0x7fd6a80723c0 2024-05-30T16:59:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6ad000640 1 -- 172.21.15.59:0/2628001423 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a8157410 con 0x7fd6a80723c0 2024-05-30T16:59:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6ad000640 1 -- 172.21.15.59:0/2628001423 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a8158c90 con 0x7fd6a80723c0 2024-05-30T16:59:18.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.572+0000 7fd6ad000640 1 -- 172.21.15.59:0/2628001423 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a8068a90 con 0x7fd6a80723c0 2024-05-30T16:59:18.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.576+0000 7fd69e000640 1 -- 172.21.15.59:0/2628001423 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fd69801a070 con 0x7fd6a80723c0 2024-05-30T16:59:18.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.576+0000 7fd69e000640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd6840694f0 0x7fd68406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.576+0000 7fd69e000640 1 -- 172.21.15.59:0/2628001423 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(78..78 src has 1..78) ==== 5907+0+0 (secure 0 0 0) 0x7fd698085be0 con 0x7fd6a80723c0 2024-05-30T16:59:18.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.576+0000 7fd69fe00640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd6840694f0 0x7fd68406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.576+0000 7fd69fe00640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd6840694f0 0x7fd68406b9b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8154ad0 tx=0x7fd690009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:18.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.580+0000 7fd69e000640 1 -- 172.21.15.59:0/2628001423 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd698057250 con 0x7fd6a80723c0 2024-05-30T16:59:18.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.768+0000 7fd6ad000640 1 -- 172.21.15.59:0/2628001423 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone698810", "target": ["mon-mgr", ""]}) -- 0x7fd6a80cc140 con 0x7fd6840694f0 2024-05-30T16:59:18.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd69e000640 1 -- 172.21.15.59:0/2628001423 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd6a80cc140 con 0x7fd6840694f0 2024-05-30T16:59:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd6ad000640 1 -- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd6840694f0 msgr2=0x7fd68406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd6ad000640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd6840694f0 0x7fd68406b9b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8154ad0 tx=0x7fd690009040 comp rx=0 tx=0).stop 2024-05-30T16:59:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd6ad000640 1 -- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a80723c0 msgr2=0x7fd6a8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd6ad000640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a80723c0 0x7fd6a8152f20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd69800e960 tx=0x7fd69800ee20 comp rx=0 tx=0).stop 2024-05-30T16:59:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd6ad000640 1 -- 172.21.15.59:0/2628001423 shutdown_connections 2024-05-30T16:59:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd6ad000640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd6840694f0 0x7fd68406b9b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd6ad000640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a815b790 0x7fd6a81f8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd6ad000640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6a815b3b0 0x7fd6a81f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd6ad000640 1 --2- 172.21.15.59:0/2628001423 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a80723c0 0x7fd6a8152f20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd6ad000640 1 -- 172.21.15.59:0/2628001423 >> 172.21.15.59:0/2628001423 conn(0x7fd6a80b1e60 msgr2=0x7fd6a80b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:18.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd6ad000640 1 -- 172.21.15.59:0/2628001423 shutdown_connections 2024-05-30T16:59:18.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.788+0000 7fd6ad000640 1 -- 172.21.15.59:0/2628001423 wait complete. 2024-05-30T16:59:18.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone69883 2024-05-30T16:59:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.992+0000 7f1652800640 1 Processor -- start 2024-05-30T16:59:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.992+0000 7f1652800640 1 -- start start 2024-05-30T16:59:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.992+0000 7f1652800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f164c06dc60 0x7f164c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.992+0000 7f1652800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 0x7f164c0af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.992+0000 7f1652800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f164c06e120 con 0x7f164c156e40 2024-05-30T16:59:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.992+0000 7f1652800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f164c06e400 con 0x7f164c06dc60 2024-05-30T16:59:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.992+0000 7f1652800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f164c06e6e0 con 0x7f164c0af130 2024-05-30T16:59:18.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.992+0000 7f164b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f164c156e40 0x7f164c15d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58868/0 (socket says 172.21.15.59:58868) 2024-05-30T16:59:18.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.992+0000 7f164b400640 1 -- 172.21.15.59:0/2653510994 learned_addr learned my addr 172.21.15.59:0/2653510994 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:18.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.992+0000 7f164aa00640 1 --2- 172.21.15.59:0/2653510994 >> v2:172.21.15.107:3300/0 conn(0x7f164c06dc60 0x7f164c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.992+0000 7f164be00640 1 --2- 172.21.15.59:0/2653510994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 0x7f164c0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:18.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.996+0000 7f164a000640 1 -- 172.21.15.59:0/2653510994 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580819135 0 0) 0x7f164c06e120 con 0x7f164c156e40 2024-05-30T16:59:18.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.996+0000 7f164a000640 1 -- 172.21.15.59:0/2653510994 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1630003530 con 0x7f164c156e40 2024-05-30T16:59:18.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.996+0000 7f164a000640 1 -- 172.21.15.59:0/2653510994 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1247623464 0 0) 0x7f1630003530 con 0x7f164c156e40 2024-05-30T16:59:18.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.996+0000 7f164be00640 1 -- 172.21.15.59:0/2653510994 >> v2:172.21.15.107:3300/0 conn(0x7f164c06dc60 msgr2=0x7f164c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:18.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.996+0000 7f164be00640 1 --2- 172.21.15.59:0/2653510994 >> v2:172.21.15.107:3300/0 conn(0x7f164c06dc60 0x7f164c06f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:18.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.996+0000 7f164be00640 1 -- 172.21.15.59:0/2653510994 >> v1:172.21.15.59:6789/0 conn(0x7f164c156e40 legacy=0x7f164c15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:18.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:18.996+0000 7f164be00640 1 -- 172.21.15.59:0/2653510994 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c06e9c0 con 0x7f164c0af130 2024-05-30T16:59:19.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.000+0000 7f164be00640 1 --2- 172.21.15.59:0/2653510994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 0x7f164c0af550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1644009d90 tx=0x7f164401c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1582d254299ae62 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.004+0000 7f164a000640 1 -- 172.21.15.59:0/2653510994 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440ac070 con 0x7f164c0af130 2024-05-30T16:59:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.004+0000 7f164a000640 1 -- 172.21.15.59:0/2653510994 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16440a64a0 con 0x7f164c0af130 2024-05-30T16:59:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.004+0000 7f164a000640 1 -- 172.21.15.59:0/2653510994 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c0016a0 con 0x7f164c0af130 2024-05-30T16:59:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.004+0000 7f1652800640 1 -- 172.21.15.59:0/2653510994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 msgr2=0x7f164c0af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.004+0000 7f1652800640 1 --2- 172.21.15.59:0/2653510994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 0x7f164c0af550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1644009d90 tx=0x7f164401c890 comp rx=0 tx=0).stop 2024-05-30T16:59:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.004+0000 7f1652800640 1 -- 172.21.15.59:0/2653510994 shutdown_connections 2024-05-30T16:59:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.004+0000 7f1652800640 1 --2- 172.21.15.59:0/2653510994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 0x7f164c0af550 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.004+0000 7f1652800640 1 --2- 172.21.15.59:0/2653510994 >> v2:172.21.15.107:3300/0 conn(0x7f164c06dc60 0x7f164c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.004+0000 7f1652800640 1 -- 172.21.15.59:0/2653510994 >> 172.21.15.59:0/2653510994 conn(0x7f164c0b1e60 msgr2=0x7f164c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.008+0000 7f1652800640 1 -- 172.21.15.59:0/2653510994 shutdown_connections 2024-05-30T16:59:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.008+0000 7f1652800640 1 -- 172.21.15.59:0/2653510994 wait complete. 2024-05-30T16:59:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.008+0000 7f1652800640 1 Processor -- start 2024-05-30T16:59:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.008+0000 7f1652800640 1 -- start start 2024-05-30T16:59:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.008+0000 7f1652800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f164c06dc60 0x7f164c142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:19.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f1652800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 0x7f164c140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:19.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f1652800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f164c156e40 0x7f164c141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:19.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f1652800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f164c15eb30 con 0x7f164c156e40 2024-05-30T16:59:19.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f1652800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f164c15e9b0 con 0x7f164c06dc60 2024-05-30T16:59:19.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f1652800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f164c141b00 con 0x7f164c0af130 2024-05-30T16:59:19.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f164c06dc60 0x7f164c142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164aa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 0x7f164c140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164aa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 0x7f164c140fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:37038/0 (socket says 172.21.15.59:37038) 2024-05-30T16:59:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164aa00640 1 -- 172.21.15.59:0/2652900480 learned_addr learned my addr 172.21.15.59:0/2652900480 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164be00640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f164c156e40 0x7f164c141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164aa00640 1 -- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f164c06dc60 msgr2=0x7f164c142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164aa00640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f164c06dc60 0x7f164c142ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164aa00640 1 -- 172.21.15.59:0/2652900480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f164c156e40 msgr2=0x7f164c141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164aa00640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f164c156e40 0x7f164c141500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164aa00640 1 -- 172.21.15.59:0/2652900480 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c141de0 con 0x7f164c0af130 2024-05-30T16:59:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164be00640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f164c156e40 0x7f164c141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:59:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164b400640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f164c06dc60 0x7f164c142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:59:19.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f164aa00640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 0x7f164c140fc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f163800d7d0 tx=0x7f163800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:19.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f1643400640 1 -- 172.21.15.59:0/2652900480 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638004020 con 0x7f164c0af130 2024-05-30T16:59:19.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f1643400640 1 -- 172.21.15.59:0/2652900480 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16380041c0 con 0x7f164c0af130 2024-05-30T16:59:19.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.012+0000 7f1643400640 1 -- 172.21.15.59:0/2652900480 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638004390 con 0x7f164c0af130 2024-05-30T16:59:19.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.016+0000 7f1652800640 1 -- 172.21.15.59:0/2652900480 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164c1420c0 con 0x7f164c0af130 2024-05-30T16:59:19.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.016+0000 7f1652800640 1 -- 172.21.15.59:0/2652900480 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f164c1430e0 con 0x7f164c0af130 2024-05-30T16:59:19.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.016+0000 7f1652800640 1 -- 172.21.15.59:0/2652900480 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f164c068a90 con 0x7f164c0af130 2024-05-30T16:59:19.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.016+0000 7f1643400640 1 -- 172.21.15.59:0/2652900480 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f163801b020 con 0x7f164c0af130 2024-05-30T16:59:19.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.020+0000 7f1643400640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f162c0695c0 0x7f162c06ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:19.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.020+0000 7f1643400640 1 -- 172.21.15.59:0/2652900480 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(78..78 src has 1..78) ==== 5907+0+0 (secure 0 0 0) 0x7f1638086010 con 0x7f164c0af130 2024-05-30T16:59:19.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.020+0000 7f164b400640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f162c0695c0 0x7f162c06ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.024+0000 7f164b400640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f162c0695c0 0x7f162c06ba80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f163c001810 tx=0x7f163c001e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:19.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.024+0000 7f1643400640 1 -- 172.21.15.59:0/2652900480 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1638057680 con 0x7f164c0af130 2024-05-30T16:59:19.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.360+0000 7f1652800640 1 -- 172.21.15.59:0/2652900480 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone69883", "target": ["mon-mgr", ""]}) -- 0x7f164c06fab0 con 0x7f162c0695c0 2024-05-30T16:59:19.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.396+0000 7f1643400640 1 -- 172.21.15.59:0/2652900480 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f164c06fab0 con 0x7f162c0695c0 2024-05-30T16:59:19.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.400+0000 7f1652800640 1 -- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f162c0695c0 msgr2=0x7f162c06ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:19.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.400+0000 7f1652800640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f162c0695c0 0x7f162c06ba80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f163c001810 tx=0x7f163c001e30 comp rx=0 tx=0).stop 2024-05-30T16:59:19.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.400+0000 7f1652800640 1 -- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 msgr2=0x7f164c140fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:19.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.400+0000 7f1652800640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 0x7f164c140fc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f163800d7d0 tx=0x7f163800dc90 comp rx=0 tx=0).stop 2024-05-30T16:59:19.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.400+0000 7f1652800640 1 -- 172.21.15.59:0/2652900480 shutdown_connections 2024-05-30T16:59:19.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.400+0000 7f1652800640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f162c0695c0 0x7f162c06ba80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.400+0000 7f1652800640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f164c156e40 0x7f164c141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.400+0000 7f1652800640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f164c0af130 0x7f164c140fc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.400+0000 7f1652800640 1 --2- 172.21.15.59:0/2652900480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f164c06dc60 0x7f164c142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.400+0000 7f1652800640 1 -- 172.21.15.59:0/2652900480 >> 172.21.15.59:0/2652900480 conn(0x7f164c0b1e60 msgr2=0x7f164c160870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:19.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.400+0000 7f1652800640 1 -- 172.21.15.59:0/2652900480 shutdown_connections 2024-05-30T16:59:19.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.400+0000 7f1652800640 1 -- 172.21.15.59:0/2652900480 wait complete. 2024-05-30T16:59:19.436 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone698817 2024-05-30T16:59:19.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.668+0000 7fe7ab800640 1 Processor -- start 2024-05-30T16:59:19.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.668+0000 7fe7ab800640 1 -- start start 2024-05-30T16:59:19.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7ab800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe7a415e890 0x7fe7a40b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:19.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7ab800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7a40af420 0x7fe7a40af870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:19.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7ab800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a40b2910 con 0x7fe7a40b42c0 2024-05-30T16:59:19.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7ab800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a40afdb0 con 0x7fe7a415e890 2024-05-30T16:59:19.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7ab800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a415fc80 con 0x7fe7a40af420 2024-05-30T16:59:19.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7a8e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe7a415e890 0x7fe7a40b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:19.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7a8e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe7a415e890 0x7fe7a40b62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:43142/0 (socket says 172.21.15.59:43142) 2024-05-30T16:59:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7a8e00640 1 -- 172.21.15.59:0/3173802492 learned_addr learned my addr 172.21.15.59:0/3173802492 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7a3e00640 1 --1- 172.21.15.59:0/3173802492 >> v1:172.21.15.59:6789/0 conn(0x7fe7a40b42c0 0x7fe7a40b0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58882/0 (socket says 172.21.15.59:58882) 2024-05-30T16:59:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7a9800640 1 --2- 172.21.15.59:0/3173802492 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7a40af420 0x7fe7a40af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7a8e00640 1 -- 172.21.15.59:0/3173802492 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7a40af420 msgr2=0x7fe7a40af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7a8e00640 1 --2- 172.21.15.59:0/3173802492 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7a40af420 0x7fe7a40af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7a8e00640 1 -- 172.21.15.59:0/3173802492 >> v1:172.21.15.59:6789/0 conn(0x7fe7a40b42c0 legacy=0x7fe7a40b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.672+0000 7fe7a8e00640 1 -- 172.21.15.59:0/3173802492 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a40b2bf0 con 0x7fe7a415e890 2024-05-30T16:59:19.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.676+0000 7fe7a8e00640 1 --2- 172.21.15.59:0/3173802492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7a415e890 0x7fe7a40b62c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe798009870 tx=0x7fe79801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebeb703d2c816cc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:19.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.676+0000 7fe7a3400640 1 -- 172.21.15.59:0/3173802492 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7980b0070 con 0x7fe7a415e890 2024-05-30T16:59:19.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.676+0000 7fe7a3400640 1 -- 172.21.15.59:0/3173802492 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7980ab600 con 0x7fe7a415e890 2024-05-30T16:59:19.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.676+0000 7fe7a3400640 1 -- 172.21.15.59:0/3173802492 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7980ab9d0 con 0x7fe7a415e890 2024-05-30T16:59:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.680+0000 7fe7ab800640 1 -- 172.21.15.59:0/3173802492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7a415e890 msgr2=0x7fe7a40b62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.680+0000 7fe7ab800640 1 --2- 172.21.15.59:0/3173802492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7a415e890 0x7fe7a40b62c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe798009870 tx=0x7fe79801c380 comp rx=0 tx=0).stop 2024-05-30T16:59:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.680+0000 7fe7ab800640 1 -- 172.21.15.59:0/3173802492 shutdown_connections 2024-05-30T16:59:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.680+0000 7fe7ab800640 1 --2- 172.21.15.59:0/3173802492 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7a40af420 0x7fe7a40af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.680+0000 7fe7ab800640 1 --2- 172.21.15.59:0/3173802492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7a415e890 0x7fe7a40b62c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.680+0000 7fe7ab800640 1 -- 172.21.15.59:0/3173802492 >> 172.21.15.59:0/3173802492 conn(0x7fe7a409aa40 msgr2=0x7fe7a40b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.680+0000 7fe7ab800640 1 -- 172.21.15.59:0/3173802492 shutdown_connections 2024-05-30T16:59:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.680+0000 7fe7ab800640 1 -- 172.21.15.59:0/3173802492 wait complete. 2024-05-30T16:59:19.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7ab800640 1 Processor -- start 2024-05-30T16:59:19.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7ab800640 1 -- start start 2024-05-30T16:59:19.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7ab800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a40af420 0x7fe7a41582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:19.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7ab800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7a40b42c0 0x7fe7a41431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:19.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7ab800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7a415e890 0x7fe7a4143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:19.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7ab800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a416b510 con 0x7fe7a40af420 2024-05-30T16:59:19.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7ab800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a416b390 con 0x7fe7a40b42c0 2024-05-30T16:59:19.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7ab800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a416b690 con 0x7fe7a415e890 2024-05-30T16:59:19.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7a3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7a40b42c0 0x7fe7a41431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:19.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7a3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7a40b42c0 0x7fe7a41431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:43144/0 (socket says 172.21.15.59:43144) 2024-05-30T16:59:19.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7a3e00640 1 -- 172.21.15.59:0/2233058129 learned_addr learned my addr 172.21.15.59:0/2233058129 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:19.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7a3e00640 1 -- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7a415e890 msgr2=0x7fe7a4143720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T16:59:19.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7a3e00640 1 --2- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7a415e890 0x7fe7a4143720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7a3e00640 1 -- 172.21.15.59:0/2233058129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a40af420 msgr2=0x7fe7a41582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:19.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7a3e00640 1 --2- 172.21.15.59:0/2233058129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a40af420 0x7fe7a41582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.684+0000 7fe7a3e00640 1 -- 172.21.15.59:0/2233058129 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a415bb90 con 0x7fe7a40b42c0 2024-05-30T16:59:19.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.688+0000 7fe7a3e00640 1 --2- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7a40b42c0 0x7fe7a41431e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe79000c780 tx=0x7fe79000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:19.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.688+0000 7fe7a0c00640 1 -- 172.21.15.59:0/2233058129 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe790018070 con 0x7fe7a40b42c0 2024-05-30T16:59:19.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.688+0000 7fe7a0c00640 1 -- 172.21.15.59:0/2233058129 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7900072d0 con 0x7fe7a40b42c0 2024-05-30T16:59:19.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.688+0000 7fe7a0c00640 1 -- 172.21.15.59:0/2233058129 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7900047f0 con 0x7fe7a40b42c0 2024-05-30T16:59:19.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.688+0000 7fe7ab800640 1 -- 172.21.15.59:0/2233058129 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a4159760 con 0x7fe7a40b42c0 2024-05-30T16:59:19.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.688+0000 7fe7ab800640 1 -- 172.21.15.59:0/2233058129 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a4159a40 con 0x7fe7a40b42c0 2024-05-30T16:59:19.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.692+0000 7fe7ab800640 1 -- 172.21.15.59:0/2233058129 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a4068a90 con 0x7fe7a40b42c0 2024-05-30T16:59:19.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.692+0000 7fe7a0c00640 1 -- 172.21.15.59:0/2233058129 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fe790004990 con 0x7fe7a40b42c0 2024-05-30T16:59:19.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.692+0000 7fe7a0c00640 1 --2- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe784069520 0x7fe78406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:19.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.692+0000 7fe7a0c00640 1 -- 172.21.15.59:0/2233058129 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5907+0+0 (secure 0 0 0) 0x7fe790084bd0 con 0x7fe7a40b42c0 2024-05-30T16:59:19.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.692+0000 7fe7a8e00640 1 --2- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe784069520 0x7fe78406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:19.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.696+0000 7fe7a8e00640 1 --2- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe784069520 0x7fe78406b9e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe7980ad000 tx=0x7fe798008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:19.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.700+0000 7fe7a0c00640 1 -- 172.21.15.59:0/2233058129 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe790056890 con 0x7fe7a40b42c0 2024-05-30T16:59:19.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.904+0000 7fe7ab800640 1 -- 172.21.15.59:0/2233058129 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone698817", "target": ["mon-mgr", ""]}) -- 0x7fe7a406ddf0 con 0x7fe784069520 2024-05-30T16:59:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.932+0000 7fe7a0c00640 1 -- 172.21.15.59:0/2233058129 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe7a406ddf0 con 0x7fe784069520 2024-05-30T16:59:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.936+0000 7fe7ab800640 1 -- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe784069520 msgr2=0x7fe78406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.936+0000 7fe7ab800640 1 --2- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe784069520 0x7fe78406b9e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe7980ad000 tx=0x7fe798008040 comp rx=0 tx=0).stop 2024-05-30T16:59:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.936+0000 7fe7ab800640 1 -- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7a40b42c0 msgr2=0x7fe7a41431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.936+0000 7fe7ab800640 1 --2- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7a40b42c0 0x7fe7a41431e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe79000c780 tx=0x7fe79000cc40 comp rx=0 tx=0).stop 2024-05-30T16:59:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.940+0000 7fe7ab800640 1 -- 172.21.15.59:0/2233058129 shutdown_connections 2024-05-30T16:59:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.940+0000 7fe7ab800640 1 --2- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe784069520 0x7fe78406b9e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.940+0000 7fe7ab800640 1 --2- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7a415e890 0x7fe7a4143720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.940+0000 7fe7ab800640 1 --2- 172.21.15.59:0/2233058129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7a40b42c0 0x7fe7a41431e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.940+0000 7fe7ab800640 1 --2- 172.21.15.59:0/2233058129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a40af420 0x7fe7a41582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.940+0000 7fe7ab800640 1 -- 172.21.15.59:0/2233058129 >> 172.21.15.59:0/2233058129 conn(0x7fe7a409aa40 msgr2=0x7fe7a406fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.940+0000 7fe7ab800640 1 -- 172.21.15.59:0/2233058129 shutdown_connections 2024-05-30T16:59:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:19.940+0000 7fe7ab800640 1 -- 172.21.15.59:0/2233058129 wait complete. 2024-05-30T16:59:19.979 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T16:59:20.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:59:20.065 INFO:teuthology.orchestra.run.smithi059.stdout:2 2024-05-30T16:59:20.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:59:20.072 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:59:20.072 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:59:20.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:59:20.169 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:59:20.169 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:59:20.169 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:59:20.169 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:59:20.178 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:59:20.178 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:59:20.232 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:59:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.416+0000 7fe533600640 1 Processor -- start 2024-05-30T16:59:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.416+0000 7fe533600640 1 -- start start 2024-05-30T16:59:20.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.416+0000 7fe533600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe52c0af720 0x7fe52c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:20.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.416+0000 7fe533600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe52c0d0560 0x7fe52c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:20.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.416+0000 7fe533600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe52c15f060 con 0x7fe52c06e900 2024-05-30T16:59:20.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.416+0000 7fe533600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe52c0afb00 con 0x7fe52c0d0560 2024-05-30T16:59:20.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.416+0000 7fe533600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe52c15c270 con 0x7fe52c0af720 2024-05-30T16:59:20.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.416+0000 7fe52be00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe52c06e900 0x7fe52c15f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:41360/0 (socket says 172.21.15.59:41360) 2024-05-30T16:59:20.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.416+0000 7fe52be00640 1 -- 172.21.15.59:0/2385477668 learned_addr learned my addr 172.21.15.59:0/2385477668 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:20.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.416+0000 7fe530c00640 1 --2- 172.21.15.59:0/2385477668 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe52c0af720 0x7fe52c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:20.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.416+0000 7fe531600640 1 --2- 172.21.15.59:0/2385477668 >> v2:172.21.15.107:3300/0 conn(0x7fe52c0d0560 0x7fe52c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:20.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe52b400640 1 -- 172.21.15.59:0/2385477668 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062278454 0 0) 0x7fe52c15f060 con 0x7fe52c06e900 2024-05-30T16:59:20.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe52b400640 1 -- 172.21.15.59:0/2385477668 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe514003530 con 0x7fe52c06e900 2024-05-30T16:59:20.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe531600640 1 -- 172.21.15.59:0/2385477668 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe52c0af720 msgr2=0x7fe52c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:20.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe531600640 1 --2- 172.21.15.59:0/2385477668 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe52c0af720 0x7fe52c15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:20.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe531600640 1 -- 172.21.15.59:0/2385477668 >> v1:172.21.15.107:6789/0 conn(0x7fe52c06e900 legacy=0x7fe52c15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:20.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe531600640 1 -- 172.21.15.59:0/2385477668 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe52c15ff00 con 0x7fe52c0d0560 2024-05-30T16:59:20.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe530c00640 1 --2- 172.21.15.59:0/2385477668 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe52c0af720 0x7fe52c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:59:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe531600640 1 --2- 172.21.15.59:0/2385477668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe52c0d0560 0x7fe52c0d0a10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe524009d90 tx=0x7fe52401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efb8c1bfd6910988 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe52b400640 1 -- 172.21.15.59:0/2385477668 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5240b2070 con 0x7fe52c0d0560 2024-05-30T16:59:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe52b400640 1 -- 172.21.15.59:0/2385477668 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5240a5920 con 0x7fe52c0d0560 2024-05-30T16:59:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe52b400640 1 -- 172.21.15.59:0/2385477668 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5240a5cf0 con 0x7fe52c0d0560 2024-05-30T16:59:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe533600640 1 -- 172.21.15.59:0/2385477668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe52c0d0560 msgr2=0x7fe52c0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe533600640 1 --2- 172.21.15.59:0/2385477668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe52c0d0560 0x7fe52c0d0a10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe524009d90 tx=0x7fe52401c970 comp rx=0 tx=0).stop 2024-05-30T16:59:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe533600640 1 -- 172.21.15.59:0/2385477668 shutdown_connections 2024-05-30T16:59:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe533600640 1 --2- 172.21.15.59:0/2385477668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe52c0d0560 0x7fe52c0d0a10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe533600640 1 --2- 172.21.15.59:0/2385477668 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe52c0af720 0x7fe52c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.420+0000 7fe533600640 1 -- 172.21.15.59:0/2385477668 >> 172.21.15.59:0/2385477668 conn(0x7fe52c0b22d0 msgr2=0x7fe52c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe533600640 1 -- 172.21.15.59:0/2385477668 shutdown_connections 2024-05-30T16:59:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe533600640 1 -- 172.21.15.59:0/2385477668 wait complete. 2024-05-30T16:59:20.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe533600640 1 Processor -- start 2024-05-30T16:59:20.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe533600640 1 -- start start 2024-05-30T16:59:20.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe533600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe52c06e900 0x7fe52c0b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:20.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe533600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe52c0af720 0x7fe52c1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:20.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe533600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe52c0d0560 0x7fe52c156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:20.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe533600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c073150 con 0x7fe52c0af720 2024-05-30T16:59:20.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe533600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c15c830 con 0x7fe52c06e900 2024-05-30T16:59:20.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe533600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe52c0732d0 con 0x7fe52c0d0560 2024-05-30T16:59:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe52be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe52c0af720 0x7fe52c1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe52be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe52c0af720 0x7fe52c1552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50222/0 (socket says 172.21.15.59:50222) 2024-05-30T16:59:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe52be00640 1 -- 172.21.15.59:0/1302530353 learned_addr learned my addr 172.21.15.59:0/1302530353 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe530c00640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe52c06e900 0x7fe52c0b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe531600640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe52c0d0560 0x7fe52c156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe52be00640 1 -- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe52c0d0560 msgr2=0x7fe52c156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe52be00640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe52c0d0560 0x7fe52c156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe52be00640 1 -- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe52c06e900 msgr2=0x7fe52c0b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe52be00640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe52c06e900 0x7fe52c0b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe52be00640 1 -- 172.21.15.59:0/1302530353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe52c15b360 con 0x7fe52c0af720 2024-05-30T16:59:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe531600640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe52c0d0560 0x7fe52c156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe52be00640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe52c0af720 0x7fe52c1552f0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fe51800c390 tx=0x7fe51800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:20.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe528c00640 1 -- 172.21.15.59:0/1302530353 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe518017070 con 0x7fe52c0af720 2024-05-30T16:59:20.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe528c00640 1 -- 172.21.15.59:0/1302530353 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe518005d10 con 0x7fe52c0af720 2024-05-30T16:59:20.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe533600640 1 -- 172.21.15.59:0/1302530353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe52c15b640 con 0x7fe52c0af720 2024-05-30T16:59:20.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.424+0000 7fe528c00640 1 -- 172.21.15.59:0/1302530353 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe518007310 con 0x7fe52c0af720 2024-05-30T16:59:20.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.428+0000 7fe533600640 1 -- 172.21.15.59:0/1302530353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe52c1547f0 con 0x7fe52c0af720 2024-05-30T16:59:20.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.428+0000 7fe533600640 1 -- 172.21.15.59:0/1302530353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe52c068a90 con 0x7fe52c0af720 2024-05-30T16:59:20.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.428+0000 7fe528c00640 1 -- 172.21.15.59:0/1302530353 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fe51801a070 con 0x7fe52c0af720 2024-05-30T16:59:20.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.428+0000 7fe528c00640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe50c0694f0 0x7fe50c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:20.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.428+0000 7fe528c00640 1 -- 172.21.15.59:0/1302530353 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5879+0+0 (secure 0 0 0) 0x7fe518084bc0 con 0x7fe52c0af720 2024-05-30T16:59:20.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.428+0000 7fe530c00640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe50c0694f0 0x7fe50c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:20.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.432+0000 7fe530c00640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe50c0694f0 0x7fe50c06b9b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe520009580 tx=0x7fe520009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:20.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.436+0000 7fe528c00640 1 -- 172.21.15.59:0/1302530353 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe5180562f0 con 0x7fe52c0af720 2024-05-30T16:59:20.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.612+0000 7fe533600640 1 -- 172.21.15.59:0/1302530353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe52c0aeee0 con 0x7fe52c0af720 2024-05-30T16:59:20.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe528c00640 1 -- 172.21.15.59:0/1302530353 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v79) ==== 80+0+0 (secure 0 0 0) 0x7fe51805a5f0 con 0x7fe52c0af720 2024-05-30T16:59:20.616 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T16:59:20.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe533600640 1 -- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe50c0694f0 msgr2=0x7fe50c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:20.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe533600640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe50c0694f0 0x7fe50c06b9b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe520009580 tx=0x7fe520009190 comp rx=0 tx=0).stop 2024-05-30T16:59:20.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe533600640 1 -- 172.21.15.59:0/1302530353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe52c0af720 msgr2=0x7fe52c1552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:20.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe533600640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe52c0af720 0x7fe52c1552f0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fe51800c390 tx=0x7fe51800c850 comp rx=0 tx=0).stop 2024-05-30T16:59:20.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe533600640 1 -- 172.21.15.59:0/1302530353 shutdown_connections 2024-05-30T16:59:20.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe533600640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe50c0694f0 0x7fe50c06b9b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:20.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe533600640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe52c0d0560 0x7fe52c156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:20.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe533600640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe52c0af720 0x7fe52c1552f0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:20.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe533600640 1 --2- 172.21.15.59:0/1302530353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe52c06e900 0x7fe52c0b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:20.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe533600640 1 -- 172.21.15.59:0/1302530353 >> 172.21.15.59:0/1302530353 conn(0x7fe52c0b22d0 msgr2=0x7fe52c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:20.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe533600640 1 -- 172.21.15.59:0/1302530353 shutdown_connections 2024-05-30T16:59:20.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:20.616+0000 7fe533600640 1 -- 172.21.15.59:0/1302530353 wait complete. 2024-05-30T16:59:20.639 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2024-05-30T16:59:20.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:20.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-30T16:59:20.656 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[42475]: fuse finished with error 0 and tester_r 0 2024-05-30T16:59:20.659 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T16:59:20.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:20.660 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T16:59:20.793 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:59:20.793 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:59:20.793 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:59:20.802 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:59:20.802 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:59:20.802 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:59:20.802 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:59:20.811 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:59:20.811 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:59:20.811 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:59:20.811 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:59:20.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:59:20.854 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:59:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.044+0000 7fb917200640 1 Processor -- start 2024-05-30T16:59:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.044+0000 7fb917200640 1 -- start start 2024-05-30T16:59:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb917200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb910052ed0 0x7fb910050700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb917200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9100e4660 con 0x7fb9100e3470 2024-05-30T16:59:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb917200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9100e4920 con 0x7fb910052a60 2024-05-30T16:59:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb917200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb9100391c0 con 0x7fb910052ed0 2024-05-30T16:59:21.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb915400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb910052a60 0x7fb9100399c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:41366/0 (socket says 172.21.15.59:41366) 2024-05-30T16:59:21.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb915400640 1 -- 172.21.15.59:0/1723018924 learned_addr learned my addr 172.21.15.59:0/1723018924 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:21.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1622704969 0 0) 0x7fb9100e4920 con 0x7fb910052a60 2024-05-30T16:59:21.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8fc003530 con 0x7fb910052a60 2024-05-30T16:59:21.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb916800640 1 --2- 172.21.15.59:0/1723018924 >> v2:172.21.15.59:3300/0 conn(0x7fb910052ed0 0x7fb910050700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:21.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1534240444 0 0) 0x7fb8fc003530 con 0x7fb910052a60 2024-05-30T16:59:21.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 >> v2:172.21.15.59:3300/0 conn(0x7fb910052ed0 msgr2=0x7fb910050700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:21.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb914a00640 1 --2- 172.21.15.59:0/1723018924 >> v2:172.21.15.59:3300/0 conn(0x7fb910052ed0 0x7fb910050700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 >> v1:172.21.15.59:6789/0 conn(0x7fb9100e3470 legacy=0x7fb9100e3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9100394a0 con 0x7fb910052a60 2024-05-30T16:59:21.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.048+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fb904001680 con 0x7fb910052a60 2024-05-30T16:59:21.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 >> v1:172.21.15.107:6789/0 conn(0x7fb910052a60 legacy=0x7fb9100399c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb914a00640 1 --2- 172.21.15.59:0/1723018924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8fc0039c0 0x7fb8fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb914a00640 1 --2- 172.21.15.59:0/1723018924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8fc004810 0x7fb8fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb914a00640 1 --2- 172.21.15.59:0/1723018924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8fc0051d0 0x7fb8fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb9100391c0 con 0x7fb8fc0051d0 2024-05-30T16:59:21.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc0148b0 con 0x7fb8fc0039c0 2024-05-30T16:59:21.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb8fc014ab0 con 0x7fb8fc004810 2024-05-30T16:59:21.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb915400640 1 --2- 172.21.15.59:0/1723018924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8fc004810 0x7fb8fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb915e00640 1 --2- 172.21.15.59:0/1723018924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8fc0039c0 0x7fb8fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb915400640 1 -- 172.21.15.59:0/1723018924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8fc0039c0 msgr2=0x7fb8fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb916800640 1 --2- 172.21.15.59:0/1723018924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8fc0051d0 0x7fb8fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb915400640 1 --2- 172.21.15.59:0/1723018924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8fc0039c0 0x7fb8fc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb915400640 1 -- 172.21.15.59:0/1723018924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8fc0051d0 msgr2=0x7fb8fc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb915400640 1 --2- 172.21.15.59:0/1723018924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8fc0051d0 0x7fb8fc00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb915400640 1 -- 172.21.15.59:0/1723018924 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9100394a0 con 0x7fb8fc004810 2024-05-30T16:59:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb915e00640 1 --2- 172.21.15.59:0/1723018924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8fc0039c0 0x7fb8fc003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.052+0000 7fb916800640 1 -- 172.21.15.59:0/1723018924 reap_dead start 2024-05-30T16:59:21.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.060+0000 7fb915400640 1 --2- 172.21.15.59:0/1723018924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8fc004810 0x7fb8fc004c90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb904001060 tx=0x7fb90401cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=680f733afc70330a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:21.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.060+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904007d20 con 0x7fb8fc004810 2024-05-30T16:59:21.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.060+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9040a9070 con 0x7fb8fc004810 2024-05-30T16:59:21.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.060+0000 7fb914a00640 1 -- 172.21.15.59:0/1723018924 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9040a5e60 con 0x7fb8fc004810 2024-05-30T16:59:21.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.064+0000 7fb917200640 1 -- 172.21.15.59:0/1723018924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8fc004810 msgr2=0x7fb8fc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.064+0000 7fb917200640 1 --2- 172.21.15.59:0/1723018924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8fc004810 0x7fb8fc004c90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb904001060 tx=0x7fb90401cca0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.064+0000 7fb917200640 1 -- 172.21.15.59:0/1723018924 shutdown_connections 2024-05-30T16:59:21.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.064+0000 7fb917200640 1 --2- 172.21.15.59:0/1723018924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8fc004810 0x7fb8fc004c90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.064+0000 7fb917200640 1 -- 172.21.15.59:0/1723018924 >> 172.21.15.59:0/1723018924 conn(0x7fb91000a410 msgr2=0x7fb91000a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:21.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.064+0000 7fb917200640 1 -- 172.21.15.59:0/1723018924 shutdown_connections 2024-05-30T16:59:21.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.064+0000 7fb917200640 1 -- 172.21.15.59:0/1723018924 wait complete. 2024-05-30T16:59:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.068+0000 7fb917200640 1 Processor -- start 2024-05-30T16:59:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.068+0000 7fb917200640 1 -- start start 2024-05-30T16:59:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb917200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8fc004810 0x7fb910047300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb917200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb9100c73c0 0x7fb9100c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb917200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9100c8180 0x7fb9100c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb917200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb9100e3850 con 0x7fb9100c8180 2024-05-30T16:59:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb917200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb910038e70 con 0x7fb8fc004810 2024-05-30T16:59:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb917200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb9100e39d0 con 0x7fb9100c73c0 2024-05-30T16:59:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb915e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8fc004810 0x7fb910047300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb915e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8fc004810 0x7fb910047300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:43182/0 (socket says 172.21.15.59:43182) 2024-05-30T16:59:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb915e00640 1 -- 172.21.15.59:0/3663497219 learned_addr learned my addr 172.21.15.59:0/3663497219 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb915400640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb9100c73c0 0x7fb9100c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:21.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb915400640 1 -- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8fc004810 msgr2=0x7fb910047300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb915400640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8fc004810 0x7fb910047300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb915400640 1 -- 172.21.15.59:0/3663497219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9100c8180 msgr2=0x7fb9100c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb915400640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9100c8180 0x7fb9100c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb915400640 1 -- 172.21.15.59:0/3663497219 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb910047840 con 0x7fb9100c73c0 2024-05-30T16:59:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb915e00640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8fc004810 0x7fb910047300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:59:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.072+0000 7fb915400640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb9100c73c0 0x7fb9100c7840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb904009000 tx=0x7fb8fc005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.076+0000 7fb90e000640 1 -- 172.21.15.59:0/3663497219 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904007d00 con 0x7fb9100c73c0 2024-05-30T16:59:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.076+0000 7fb90e000640 1 -- 172.21.15.59:0/3663497219 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb904007180 con 0x7fb9100c73c0 2024-05-30T16:59:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.076+0000 7fb90e000640 1 -- 172.21.15.59:0/3663497219 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904007530 con 0x7fb9100c73c0 2024-05-30T16:59:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.076+0000 7fb917200640 1 -- 172.21.15.59:0/3663497219 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9100c6320 con 0x7fb9100c73c0 2024-05-30T16:59:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.076+0000 7fb917200640 1 -- 172.21.15.59:0/3663497219 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9100c68e0 con 0x7fb9100c73c0 2024-05-30T16:59:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.076+0000 7fb917200640 1 -- 172.21.15.59:0/3663497219 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb910008e30 con 0x7fb9100c73c0 2024-05-30T16:59:21.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.080+0000 7fb90e000640 1 -- 172.21.15.59:0/3663497219 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fb9040047f0 con 0x7fb9100c73c0 2024-05-30T16:59:21.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.080+0000 7fb90e000640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb8f80695c0 0x7fb8f806ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.080+0000 7fb90e000640 1 -- 172.21.15.59:0/3663497219 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 5879+0+0 (secure 0 0 0) 0x7fb90411f8d0 con 0x7fb9100c73c0 2024-05-30T16:59:21.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.080+0000 7fb915e00640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb8f80695c0 0x7fb8f806ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:21.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.084+0000 7fb915e00640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb8f80695c0 0x7fb8f806ba80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb908007fd0 tx=0x7fb908009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:21.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.088+0000 7fb90e000640 1 -- 172.21.15.59:0/3663497219 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb9040bd060 con 0x7fb9100c73c0 2024-05-30T16:59:21.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.444+0000 7fb917200640 1 -- 172.21.15.59:0/3663497219 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9100057f0 con 0x7fb9100c73c0 2024-05-30T16:59:21.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.448+0000 7fb90e000640 1 -- 172.21.15.59:0/3663497219 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5189 (secure 0 0 0) 0x7fb9040169b0 con 0x7fb9100c73c0 2024-05-30T16:59:21.452 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:21.452 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1624622774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1624622774},{"type":"v1","addr":"172.21.15.59:6835","nonce":1624622774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2200377252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2200377252},{"type":"v1","addr":"172.21.15.59:6834","nonce":2200377252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1151212671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1151212671},{"type":"v1","addr":"172.21.15.107:6836","nonce":1151212671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:56:44.037966+0000","modified":"2024-05-30T16:56:47.045160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/1073059560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1073059560},{"type":"v1","addr":"172.21.15.107:6837","nonce":1073059560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6528,"qdb_cluster":[6528]},"id":5}]} 2024-05-30T16:59:21.452 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 43 2024-05-30T16:59:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.452+0000 7fb917200640 1 -- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb8f80695c0 msgr2=0x7fb8f806ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.452+0000 7fb917200640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb8f80695c0 0x7fb8f806ba80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb908007fd0 tx=0x7fb908009040 comp rx=0 tx=0).stop 2024-05-30T16:59:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.452+0000 7fb917200640 1 -- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb9100c73c0 msgr2=0x7fb9100c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.452+0000 7fb917200640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb9100c73c0 0x7fb9100c7840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb904009000 tx=0x7fb8fc005840 comp rx=0 tx=0).stop 2024-05-30T16:59:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.452+0000 7fb917200640 1 -- 172.21.15.59:0/3663497219 shutdown_connections 2024-05-30T16:59:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.452+0000 7fb917200640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb8f80695c0 0x7fb8f806ba80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.452+0000 7fb917200640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9100c8180 0x7fb9100c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.452+0000 7fb917200640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb9100c73c0 0x7fb9100c7840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.452+0000 7fb917200640 1 --2- 172.21.15.59:0/3663497219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8fc004810 0x7fb910047300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.452+0000 7fb917200640 1 -- 172.21.15.59:0/3663497219 >> 172.21.15.59:0/3663497219 conn(0x7fb91000a410 msgr2=0x7fb91004bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.452+0000 7fb917200640 1 -- 172.21.15.59:0/3663497219 shutdown_connections 2024-05-30T16:59:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.452+0000 7fb917200640 1 -- 172.21.15.59:0/3663497219 wait complete. 2024-05-30T16:59:21.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:59:21.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.680+0000 7fbdcfe00640 1 Processor -- start 2024-05-30T16:59:21.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.684+0000 7fbdcfe00640 1 -- start start 2024-05-30T16:59:21.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.684+0000 7fbdcfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbdd00cf9b0 0x7fbdd00aef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.684+0000 7fbdcfe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd01539b0 con 0x7fbdd01535d0 2024-05-30T16:59:21.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.684+0000 7fbdcfe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd00ad2e0 con 0x7fbdd00af440 2024-05-30T16:59:21.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.684+0000 7fbdcfe00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd00ad5c0 con 0x7fbdd00cf9b0 2024-05-30T16:59:21.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.684+0000 7fbdcea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbdd01535d0 0x7fbdd015d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58900/0 (socket says 172.21.15.59:58900) 2024-05-30T16:59:21.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.684+0000 7fbdcea00640 1 -- 172.21.15.59:0/1367470917 learned_addr learned my addr 172.21.15.59:0/1367470917 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:21.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.684+0000 7fbdce000640 1 --2- 172.21.15.59:0/1367470917 >> v2:172.21.15.59:3300/0 conn(0x7fbdd00cf9b0 0x7fbdd00aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:21.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.684+0000 7fbdcd600640 1 -- 172.21.15.59:0/1367470917 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634818658 0 0) 0x7fbdd01539b0 con 0x7fbdd01535d0 2024-05-30T16:59:21.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.684+0000 7fbdce000640 1 -- 172.21.15.59:0/1367470917 >> v1:172.21.15.107:6789/0 conn(0x7fbdd00af440 legacy=0x7fbdd00b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:21.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.684+0000 7fbdce000640 1 -- 172.21.15.59:0/1367470917 >> v1:172.21.15.59:6789/0 conn(0x7fbdd01535d0 legacy=0x7fbdd015d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.684+0000 7fbdce000640 1 -- 172.21.15.59:0/1367470917 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd00ad8a0 con 0x7fbdd00cf9b0 2024-05-30T16:59:21.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdce000640 1 --2- 172.21.15.59:0/1367470917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd00cf9b0 0x7fbdd00aef00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0097c0 tx=0x7fbdbc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4ff3a7d6ccbe84 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:21.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdcd600640 1 -- 172.21.15.59:0/1367470917 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0b0070 con 0x7fbdd00cf9b0 2024-05-30T16:59:21.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdcd600640 1 -- 172.21.15.59:0/1367470917 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdbc004230 con 0x7fbdd00cf9b0 2024-05-30T16:59:21.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdcd600640 1 -- 172.21.15.59:0/1367470917 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc003620 con 0x7fbdd00cf9b0 2024-05-30T16:59:21.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdcfe00640 1 -- 172.21.15.59:0/1367470917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd00cf9b0 msgr2=0x7fbdd00aef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdcfe00640 1 --2- 172.21.15.59:0/1367470917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd00cf9b0 0x7fbdd00aef00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0097c0 tx=0x7fbdbc01c460 comp rx=0 tx=0).stop 2024-05-30T16:59:21.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdcfe00640 1 -- 172.21.15.59:0/1367470917 shutdown_connections 2024-05-30T16:59:21.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdcfe00640 1 --2- 172.21.15.59:0/1367470917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd00cf9b0 0x7fbdd00aef00 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdcfe00640 1 -- 172.21.15.59:0/1367470917 >> 172.21.15.59:0/1367470917 conn(0x7fbdd00b1fd0 msgr2=0x7fbdd00b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:21.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdcfe00640 1 -- 172.21.15.59:0/1367470917 shutdown_connections 2024-05-30T16:59:21.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdcfe00640 1 -- 172.21.15.59:0/1367470917 wait complete. 2024-05-30T16:59:21.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdcfe00640 1 Processor -- start 2024-05-30T16:59:21.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.688+0000 7fbdcfe00640 1 -- start start 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd00af440 0x7fbdd01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcfe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdd00cf9b0 0x7fbdd0151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcfe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdd01535d0 0x7fbdd014f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcfe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd016a220 con 0x7fbdd00af440 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcfe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd00af850 con 0x7fbdd01535d0 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcfe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd016a3a0 con 0x7fbdd00cf9b0 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd00af440 0x7fbdd01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd00af440 0x7fbdd01569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50274/0 (socket says 172.21.15.59:50274) 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcea00640 1 -- 172.21.15.59:0/641003706 learned_addr learned my addr 172.21.15.59:0/641003706 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdce000640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdd00cf9b0 0x7fbdd0151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcf400640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdd01535d0 0x7fbdd014f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcea00640 1 -- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdd00cf9b0 msgr2=0x7fbdd0151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcea00640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdd00cf9b0 0x7fbdd0151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcea00640 1 -- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdd01535d0 msgr2=0x7fbdd014f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcea00640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdd01535d0 0x7fbdd014f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcea00640 1 -- 172.21.15.59:0/641003706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd0151ad0 con 0x7fbdd00af440 2024-05-30T16:59:21.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcf400640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdd01535d0 0x7fbdd014f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:21.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcea00640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd00af440 0x7fbdd01569b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000c520 tx=0x7fbdc000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdc6a00640 1 -- 172.21.15.59:0/641003706 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0018070 con 0x7fbdd00af440 2024-05-30T16:59:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdc6a00640 1 -- 172.21.15.59:0/641003706 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc00074e0 con 0x7fbdd00af440 2024-05-30T16:59:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdc6a00640 1 -- 172.21.15.59:0/641003706 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc00049f0 con 0x7fbdd00af440 2024-05-30T16:59:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcfe00640 1 -- 172.21.15.59:0/641003706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd0151db0 con 0x7fbdd00af440 2024-05-30T16:59:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcfe00640 1 -- 172.21.15.59:0/641003706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd0154db0 con 0x7fbdd00af440 2024-05-30T16:59:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdcfe00640 1 -- 172.21.15.59:0/641003706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd0068a90 con 0x7fbdd00af440 2024-05-30T16:59:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.692+0000 7fbdc6a00640 1 -- 172.21.15.59:0/641003706 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fbdc0004b90 con 0x7fbdd00af440 2024-05-30T16:59:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.696+0000 7fbdc6a00640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbdb00694f0 0x7fbdb006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.696+0000 7fbdc6a00640 1 -- 172.21.15.59:0/641003706 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5879+0+0 (secure 0 0 0) 0x7fbdc0084b10 con 0x7fbdd00af440 2024-05-30T16:59:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.696+0000 7fbdce000640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbdb00694f0 0x7fbdb006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:21.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.696+0000 7fbdce000640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbdb00694f0 0x7fbdb006b9b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0ad000 tx=0x7fbdbc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:21.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.700+0000 7fbdc6a00640 1 -- 172.21.15.59:0/641003706 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbdc00561e0 con 0x7fbdd00af440 2024-05-30T16:59:21.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.896+0000 7fbdcfe00640 1 -- 172.21.15.59:0/641003706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdd00d0fe0 con 0x7fbdd00af440 2024-05-30T16:59:21.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.896+0000 7fbdc6a00640 1 -- 172.21.15.59:0/641003706 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5189 (secure 0 0 0) 0x7fbdc005a4e0 con 0x7fbdd00af440 2024-05-30T16:59:21.899 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:21.899 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1624622774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1624622774},{"type":"v1","addr":"172.21.15.59:6835","nonce":1624622774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2200377252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2200377252},{"type":"v1","addr":"172.21.15.59:6834","nonce":2200377252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1151212671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1151212671},{"type":"v1","addr":"172.21.15.107:6836","nonce":1151212671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:56:44.037966+0000","modified":"2024-05-30T16:56:47.045160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/1073059560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1073059560},{"type":"v1","addr":"172.21.15.107:6837","nonce":1073059560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6528,"qdb_cluster":[6528]},"id":5}]} 2024-05-30T16:59:21.900 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 43 2024-05-30T16:59:21.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.900+0000 7fbdcfe00640 1 -- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbdb00694f0 msgr2=0x7fbdb006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.900+0000 7fbdcfe00640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbdb00694f0 0x7fbdb006b9b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0ad000 tx=0x7fbdbc008040 comp rx=0 tx=0).stop 2024-05-30T16:59:21.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.900+0000 7fbdcfe00640 1 -- 172.21.15.59:0/641003706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd00af440 msgr2=0x7fbdd01569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:21.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.900+0000 7fbdcfe00640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd00af440 0x7fbdd01569b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000c520 tx=0x7fbdc000c9e0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.900+0000 7fbdcfe00640 1 -- 172.21.15.59:0/641003706 shutdown_connections 2024-05-30T16:59:21.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.900+0000 7fbdcfe00640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbdb00694f0 0x7fbdb006b9b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.900+0000 7fbdcfe00640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdd01535d0 0x7fbdd014f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.900+0000 7fbdcfe00640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdd00cf9b0 0x7fbdd0151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.900+0000 7fbdcfe00640 1 --2- 172.21.15.59:0/641003706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd00af440 0x7fbdd01569b0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:21.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.900+0000 7fbdcfe00640 1 -- 172.21.15.59:0/641003706 >> 172.21.15.59:0/641003706 conn(0x7fbdd00b1fd0 msgr2=0x7fbdd00b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:21.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.900+0000 7fbdcfe00640 1 -- 172.21.15.59:0/641003706 shutdown_connections 2024-05-30T16:59:21.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:21.900+0000 7fbdcfe00640 1 -- 172.21.15.59:0/641003706 wait complete. 2024-05-30T16:59:21.927 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:59:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.156+0000 7f5d1fe00640 1 Processor -- start 2024-05-30T16:59:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.156+0000 7f5d1fe00640 1 -- start start 2024-05-30T16:59:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.156+0000 7f5d1fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d18163e90 0x7f5d180ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.156+0000 7f5d1fe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d1806cac0 con 0x7f5d180c5460 2024-05-30T16:59:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.156+0000 7f5d1fe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d180b3330 con 0x7f5d1806e840 2024-05-30T16:59:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.156+0000 7f5d1fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5d180b3610 con 0x7f5d18163e90 2024-05-30T16:59:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.160+0000 7f5d1ca00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f5d1806e840 0x7f5d180cf080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:39364/0 (socket says 172.21.15.59:39364) 2024-05-30T16:59:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.160+0000 7f5d1ca00640 1 -- 172.21.15.59:0/4285449698 learned_addr learned my addr 172.21.15.59:0/4285449698 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.160+0000 7f5d1de00640 1 --2- 172.21.15.59:0/4285449698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d18163e90 0x7f5d180ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.160+0000 7f5d17e00640 1 -- 172.21.15.59:0/4285449698 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143260087 0 0) 0x7f5d1806cac0 con 0x7f5d180c5460 2024-05-30T16:59:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.160+0000 7f5d17e00640 1 -- 172.21.15.59:0/4285449698 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d00003530 con 0x7f5d180c5460 2024-05-30T16:59:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.160+0000 7f5d1de00640 1 -- 172.21.15.59:0/4285449698 >> v1:172.21.15.107:6789/0 conn(0x7f5d1806e840 legacy=0x7f5d180cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.160+0000 7f5d17e00640 1 -- 172.21.15.59:0/4285449698 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 394458055 0 0) 0x7f5d00003530 con 0x7f5d180c5460 2024-05-30T16:59:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.160+0000 7f5d1de00640 1 -- 172.21.15.59:0/4285449698 >> v1:172.21.15.59:6789/0 conn(0x7f5d180c5460 legacy=0x7f5d180c5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.160+0000 7f5d1de00640 1 -- 172.21.15.59:0/4285449698 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1806cd60 con 0x7f5d18163e90 2024-05-30T16:59:22.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.164+0000 7f5d1de00640 1 --2- 172.21.15.59:0/4285449698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d18163e90 0x7f5d180ccae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009dc0 tx=0x7f5d1001c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf41d1e397717b58 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:22.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.164+0000 7f5d17e00640 1 -- 172.21.15.59:0/4285449698 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c001680 con 0x7f5d18163e90 2024-05-30T16:59:22.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.164+0000 7f5d17e00640 1 -- 172.21.15.59:0/4285449698 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d100a8410 con 0x7f5d18163e90 2024-05-30T16:59:22.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.164+0000 7f5d17e00640 1 -- 172.21.15.59:0/4285449698 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d100a87e0 con 0x7f5d18163e90 2024-05-30T16:59:22.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.164+0000 7f5d1fe00640 1 -- 172.21.15.59:0/4285449698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d18163e90 msgr2=0x7f5d180ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.164+0000 7f5d1fe00640 1 --2- 172.21.15.59:0/4285449698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d18163e90 0x7f5d180ccae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009dc0 tx=0x7f5d1001c760 comp rx=0 tx=0).stop 2024-05-30T16:59:22.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.164+0000 7f5d1fe00640 1 -- 172.21.15.59:0/4285449698 shutdown_connections 2024-05-30T16:59:22.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.164+0000 7f5d1fe00640 1 --2- 172.21.15.59:0/4285449698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d18163e90 0x7f5d180ccae0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.164+0000 7f5d1fe00640 1 -- 172.21.15.59:0/4285449698 >> 172.21.15.59:0/4285449698 conn(0x7f5d180b3fc0 msgr2=0x7f5d180b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:22.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.168+0000 7f5d1fe00640 1 -- 172.21.15.59:0/4285449698 shutdown_connections 2024-05-30T16:59:22.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.168+0000 7f5d1fe00640 1 -- 172.21.15.59:0/4285449698 wait complete. 2024-05-30T16:59:22.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.168+0000 7f5d1fe00640 1 Processor -- start 2024-05-30T16:59:22.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.168+0000 7f5d1fe00640 1 -- start start 2024-05-30T16:59:22.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d1806e840 0x7f5d180b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:22.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d180c5460 0x7f5d180c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:22.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d18163e90 0x7f5d180c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:22.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5d18171960 con 0x7f5d180c5460 2024-05-30T16:59:22.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5d181717e0 con 0x7f5d18163e90 2024-05-30T16:59:22.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5d18171ae0 con 0x7f5d1806e840 2024-05-30T16:59:22.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d18163e90 0x7f5d180c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:22.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d180c5460 0x7f5d180c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:22.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d180c5460 0x7f5d180c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39072/0 (socket says 172.21.15.59:39072) 2024-05-30T16:59:22.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1ca00640 1 -- 172.21.15.59:0/3890886638 learned_addr learned my addr 172.21.15.59:0/3890886638 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:22.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1d400640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d1806e840 0x7f5d180b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:22.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1ca00640 1 -- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d1806e840 msgr2=0x7f5d180b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1ca00640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d1806e840 0x7f5d180b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1ca00640 1 -- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d18163e90 msgr2=0x7f5d180c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1ca00640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d18163e90 0x7f5d180c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1ca00640 1 -- 172.21.15.59:0/3890886638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d180c67f0 con 0x7f5d180c5460 2024-05-30T16:59:22.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d1ca00640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d180c5460 0x7f5d180c5d70 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400c750 tx=0x7f5d0400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:22.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.172+0000 7f5d15600640 1 -- 172.21.15.59:0/3890886638 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d04018070 con 0x7f5d180c5460 2024-05-30T16:59:22.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.176+0000 7f5d15600640 1 -- 172.21.15.59:0/3890886638 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d040072d0 con 0x7f5d180c5460 2024-05-30T16:59:22.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.176+0000 7f5d15600640 1 -- 172.21.15.59:0/3890886638 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d040047f0 con 0x7f5d180c5460 2024-05-30T16:59:22.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.176+0000 7f5d1fe00640 1 -- 172.21.15.59:0/3890886638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d180b7d60 con 0x7f5d180c5460 2024-05-30T16:59:22.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.176+0000 7f5d1fe00640 1 -- 172.21.15.59:0/3890886638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d180b5e90 con 0x7f5d180c5460 2024-05-30T16:59:22.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.176+0000 7f5d1fe00640 1 -- 172.21.15.59:0/3890886638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d180691a0 con 0x7f5d180c5460 2024-05-30T16:59:22.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.180+0000 7f5d15600640 1 -- 172.21.15.59:0/3890886638 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f5d0401b070 con 0x7f5d180c5460 2024-05-30T16:59:22.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.180+0000 7f5d15600640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5cf8069540 0x7f5cf806ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:22.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.180+0000 7f5d15600640 1 -- 172.21.15.59:0/3890886638 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5879+0+0 (secure 0 0 0) 0x7f5d04084d60 con 0x7f5d180c5460 2024-05-30T16:59:22.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.180+0000 7f5d1d400640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5cf8069540 0x7f5cf806ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:22.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.184+0000 7f5d1d400640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5cf8069540 0x7f5cf806ba00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c001ec0 tx=0x7f5d0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:22.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.188+0000 7f5d15600640 1 -- 172.21.15.59:0/3890886638 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5d04056a60 con 0x7f5d180c5460 2024-05-30T16:59:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.420+0000 7f5d1fe00640 1 -- 172.21.15.59:0/3890886638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d1809b490 con 0x7f5d180c5460 2024-05-30T16:59:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d15600640 1 -- 172.21.15.59:0/3890886638 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+16950 (secure 0 0 0) 0x7f5d04056360 con 0x7f5d180c5460 2024-05-30T16:59:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:22.425 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":79,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:59:19.941530+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:56:41.730533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T16:56:42.994525+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":78,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.28","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:59:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d1fe00640 1 -- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5cf8069540 msgr2=0x7f5cf806ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d1fe00640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5cf8069540 0x7f5cf806ba00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c001ec0 tx=0x7f5d0c009040 comp rx=0 tx=0).stop 2024-05-30T16:59:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d1fe00640 1 -- 172.21.15.59:0/3890886638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d180c5460 msgr2=0x7f5d180c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d1fe00640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d180c5460 0x7f5d180c5d70 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400c750 tx=0x7f5d0400cc10 comp rx=0 tx=0).stop 2024-05-30T16:59:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d1fe00640 1 -- 172.21.15.59:0/3890886638 shutdown_connections 2024-05-30T16:59:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d1fe00640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5cf8069540 0x7f5cf806ba00 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d1fe00640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d18163e90 0x7f5d180c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d1fe00640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d180c5460 0x7f5d180c5d70 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d1fe00640 1 --2- 172.21.15.59:0/3890886638 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d1806e840 0x7f5d180b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d1fe00640 1 -- 172.21.15.59:0/3890886638 >> 172.21.15.59:0/3890886638 conn(0x7f5d180b3fc0 msgr2=0x7f5d18165cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d1fe00640 1 -- 172.21.15.59:0/3890886638 shutdown_connections 2024-05-30T16:59:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.424+0000 7f5d1fe00640 1 -- 172.21.15.59:0/3890886638 wait complete. 2024-05-30T16:59:22.446 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T16:59:22.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:59:22.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.584+0000 7f0a2c800640 1 Processor -- start 2024-05-30T16:59:22.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.584+0000 7f0a2c800640 1 -- start start 2024-05-30T16:59:22.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a2c800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a240ce2e0 0x7f0a240708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:22.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a2c800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a2406dad0 0x7f0a24070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:22.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a2c800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a2409b7c0 con 0x7f0a240ce6c0 2024-05-30T16:59:22.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a2c800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0a2409baa0 con 0x7f0a2406dad0 2024-05-30T16:59:22.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a2c800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0a2409bd80 con 0x7f0a240ce2e0 2024-05-30T16:59:22.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a2a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a2406dad0 0x7f0a24070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:22.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a29400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0a240ce6c0 0x7f0a240d0ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54812/0 (socket says 172.21.15.59:54812) 2024-05-30T16:59:22.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a2a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a2406dad0 0x7f0a24070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39084/0 (socket says 172.21.15.59:39084) 2024-05-30T16:59:22.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a29400640 1 -- 172.21.15.59:0/2745705023 learned_addr learned my addr 172.21.15.59:0/2745705023 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:22.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a29e00640 1 --2- 172.21.15.59:0/2745705023 >> v2:172.21.15.107:3300/0 conn(0x7f0a240ce2e0 0x7f0a240708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:22.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a2a800640 1 -- 172.21.15.59:0/2745705023 >> v2:172.21.15.107:3300/0 conn(0x7f0a240ce2e0 msgr2=0x7f0a240708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:22.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a2a800640 1 --2- 172.21.15.59:0/2745705023 >> v2:172.21.15.107:3300/0 conn(0x7f0a240ce2e0 0x7f0a240708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a2a800640 1 -- 172.21.15.59:0/2745705023 >> v1:172.21.15.59:6789/0 conn(0x7f0a240ce6c0 legacy=0x7f0a240d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a2a800640 1 -- 172.21.15.59:0/2745705023 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a240d0980 con 0x7f0a2406dad0 2024-05-30T16:59:22.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.588+0000 7f0a29e00640 1 --2- 172.21.15.59:0/2745705023 >> v2:172.21.15.107:3300/0 conn(0x7f0a240ce2e0 0x7f0a240708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:22.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2a800640 1 --2- 172.21.15.59:0/2745705023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2406dad0 0x7f0a24070e30 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0a24073360 tx=0x7f0a2001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74d3b8901cd19d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:22.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a28a00640 1 -- 172.21.15.59:0/2745705023 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a200b2070 con 0x7f0a2406dad0 2024-05-30T16:59:22.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a28a00640 1 -- 172.21.15.59:0/2745705023 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a200a5950 con 0x7f0a2406dad0 2024-05-30T16:59:22.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a28a00640 1 -- 172.21.15.59:0/2745705023 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a200a5d20 con 0x7f0a2406dad0 2024-05-30T16:59:22.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 -- 172.21.15.59:0/2745705023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2406dad0 msgr2=0x7f0a24070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 --2- 172.21.15.59:0/2745705023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2406dad0 0x7f0a24070e30 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0a24073360 tx=0x7f0a2001c870 comp rx=0 tx=0).stop 2024-05-30T16:59:22.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 -- 172.21.15.59:0/2745705023 shutdown_connections 2024-05-30T16:59:22.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 --2- 172.21.15.59:0/2745705023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2406dad0 0x7f0a24070e30 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 --2- 172.21.15.59:0/2745705023 >> v2:172.21.15.107:3300/0 conn(0x7f0a240ce2e0 0x7f0a240708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 -- 172.21.15.59:0/2745705023 >> 172.21.15.59:0/2745705023 conn(0x7f0a240b3f70 msgr2=0x7f0a240b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:22.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 -- 172.21.15.59:0/2745705023 shutdown_connections 2024-05-30T16:59:22.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 -- 172.21.15.59:0/2745705023 wait complete. 2024-05-30T16:59:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 Processor -- start 2024-05-30T16:59:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 -- start start 2024-05-30T16:59:22.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a2406dad0 0x7f0a240b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:22.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a240ce2e0 0x7f0a240b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.592+0000 7f0a2c800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a240ce6c0 0x7f0a24156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a2c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0a240d2150 con 0x7f0a240ce2e0 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a2c800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0a240d1fd0 con 0x7f0a240ce6c0 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a2c800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0a2416b6c0 con 0x7f0a2406dad0 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a29400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a240ce2e0 0x7f0a240b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a29400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a240ce2e0 0x7f0a240b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39086/0 (socket says 172.21.15.59:39086) 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a29400640 1 -- 172.21.15.59:0/3837321526 learned_addr learned my addr 172.21.15.59:0/3837321526 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a29e00640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a2406dad0 0x7f0a240b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a2a800640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a240ce6c0 0x7f0a24156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a29400640 1 -- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a2406dad0 msgr2=0x7f0a240b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a29400640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a2406dad0 0x7f0a240b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a29400640 1 -- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a240ce6c0 msgr2=0x7f0a24156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a29400640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a240ce6c0 0x7f0a24156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a29400640 1 -- 172.21.15.59:0/3837321526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2415d880 con 0x7f0a240ce2e0 2024-05-30T16:59:22.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a29400640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a240ce2e0 0x7f0a240b54e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400c400 tx=0x7f0a1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:22.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a1e000640 1 -- 172.21.15.59:0/3837321526 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14017070 con 0x7f0a240ce2e0 2024-05-30T16:59:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a1e000640 1 -- 172.21.15.59:0/3837321526 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a14005cf0 con 0x7f0a240ce2e0 2024-05-30T16:59:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a1e000640 1 -- 172.21.15.59:0/3837321526 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14007310 con 0x7f0a240ce2e0 2024-05-30T16:59:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a2c800640 1 -- 172.21.15.59:0/3837321526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2415db60 con 0x7f0a240ce2e0 2024-05-30T16:59:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a2c800640 1 -- 172.21.15.59:0/3837321526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2415e120 con 0x7f0a240ce2e0 2024-05-30T16:59:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a2c800640 1 -- 172.21.15.59:0/3837321526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a24068a90 con 0x7f0a240ce2e0 2024-05-30T16:59:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.596+0000 7f0a1e000640 1 -- 172.21.15.59:0/3837321526 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f0a1401a070 con 0x7f0a240ce2e0 2024-05-30T16:59:22.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.600+0000 7f0a1e000640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a080694f0 0x7f0a0806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:22.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.600+0000 7f0a1e000640 1 -- 172.21.15.59:0/3837321526 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5879+0+0 (secure 0 0 0) 0x7f0a14084c00 con 0x7f0a240ce2e0 2024-05-30T16:59:22.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.600+0000 7f0a29e00640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a080694f0 0x7f0a0806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:22.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.600+0000 7f0a29e00640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a080694f0 0x7f0a0806b9b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0a24169410 tx=0x7f0a18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:22.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.604+0000 7f0a1e000640 1 -- 172.21.15.59:0/3837321526 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a14056270 con 0x7f0a240ce2e0 2024-05-30T16:59:22.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.800+0000 7f0a2c800640 1 -- 172.21.15.59:0/3837321526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a240704c0 con 0x7f0a240ce2e0 2024-05-30T16:59:22.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.800+0000 7f0a1e000640 1 -- 172.21.15.59:0/3837321526 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5189 (secure 0 0 0) 0x7f0a1405a570 con 0x7f0a240ce2e0 2024-05-30T16:59:22.804 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:22.804 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1624622774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1624622774},{"type":"v1","addr":"172.21.15.59:6835","nonce":1624622774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2200377252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2200377252},{"type":"v1","addr":"172.21.15.59:6834","nonce":2200377252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1151212671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1151212671},{"type":"v1","addr":"172.21.15.107:6836","nonce":1151212671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:56:44.037966+0000","modified":"2024-05-30T16:56:47.045160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/1073059560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1073059560},{"type":"v1","addr":"172.21.15.107:6837","nonce":1073059560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6528,"qdb_cluster":[6528]},"id":5}]} 2024-05-30T16:59:22.804 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 43 2024-05-30T16:59:22.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.804+0000 7f0a2c800640 1 -- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a080694f0 msgr2=0x7f0a0806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.804+0000 7f0a2c800640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a080694f0 0x7f0a0806b9b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0a24169410 tx=0x7f0a18008040 comp rx=0 tx=0).stop 2024-05-30T16:59:22.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.804+0000 7f0a2c800640 1 -- 172.21.15.59:0/3837321526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a240ce2e0 msgr2=0x7f0a240b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:22.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.804+0000 7f0a2c800640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a240ce2e0 0x7f0a240b54e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400c400 tx=0x7f0a1400c8c0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.804+0000 7f0a2c800640 1 -- 172.21.15.59:0/3837321526 shutdown_connections 2024-05-30T16:59:22.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.804+0000 7f0a2c800640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0a080694f0 0x7f0a0806b9b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.804+0000 7f0a2c800640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a240ce6c0 0x7f0a24156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.804+0000 7f0a2c800640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a240ce2e0 0x7f0a240b54e0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.804+0000 7f0a2c800640 1 --2- 172.21.15.59:0/3837321526 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a2406dad0 0x7f0a240b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:22.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.804+0000 7f0a2c800640 1 -- 172.21.15.59:0/3837321526 >> 172.21.15.59:0/3837321526 conn(0x7f0a240b3f70 msgr2=0x7f0a2414f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:22.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.804+0000 7f0a2c800640 1 -- 172.21.15.59:0/3837321526 shutdown_connections 2024-05-30T16:59:22.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.804+0000 7f0a2c800640 1 -- 172.21.15.59:0/3837321526 wait complete. 2024-05-30T16:59:22.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:59:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.996+0000 7fc7c6600640 1 Processor -- start 2024-05-30T16:59:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:22.996+0000 7fc7c6600640 1 -- start start 2024-05-30T16:59:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.000+0000 7fc7c6600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7c006fa10 0x7fc7c015fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.000+0000 7fc7c6600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7c01620d0 con 0x7fc7c0161cf0 2024-05-30T16:59:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.000+0000 7fc7c6600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7c0162560 con 0x7fc7c00b38e0 2024-05-30T16:59:23.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.000+0000 7fc7c6600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc7c0162310 con 0x7fc7c006fa10 2024-05-30T16:59:23.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.000+0000 7fc7bf400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc7c0161cf0 0x7fc7c00b31d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54820/0 (socket says 172.21.15.59:54820) 2024-05-30T16:59:23.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.000+0000 7fc7bf400640 1 -- 172.21.15.59:0/450443252 learned_addr learned my addr 172.21.15.59:0/450443252 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:23.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.000+0000 7fc7bfe00640 1 --2- 172.21.15.59:0/450443252 >> v2:172.21.15.59:3300/0 conn(0x7fc7c006fa10 0x7fc7c015fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.000+0000 7fc7bfe00640 1 -- 172.21.15.59:0/450443252 >> v1:172.21.15.107:6789/0 conn(0x7fc7c00b38e0 legacy=0x7fc7c015f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:23.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.000+0000 7fc7be000640 1 -- 172.21.15.59:0/450443252 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557172213 0 0) 0x7fc7c01620d0 con 0x7fc7c0161cf0 2024-05-30T16:59:23.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.000+0000 7fc7bfe00640 1 -- 172.21.15.59:0/450443252 >> v1:172.21.15.59:6789/0 conn(0x7fc7c0161cf0 legacy=0x7fc7c00b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.000+0000 7fc7bfe00640 1 -- 172.21.15.59:0/450443252 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c0162840 con 0x7fc7c006fa10 2024-05-30T16:59:23.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.004+0000 7fc7bfe00640 1 --2- 172.21.15.59:0/450443252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c006fa10 0x7fc7c015fe80 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009d90 tx=0x7fc7b801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923c599fa750e826 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:23.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.004+0000 7fc7be000640 1 -- 172.21.15.59:0/450443252 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80b2070 con 0x7fc7c006fa10 2024-05-30T16:59:23.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.004+0000 7fc7be000640 1 -- 172.21.15.59:0/450443252 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b80a5930 con 0x7fc7c006fa10 2024-05-30T16:59:23.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.004+0000 7fc7be000640 1 -- 172.21.15.59:0/450443252 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80a5d00 con 0x7fc7c006fa10 2024-05-30T16:59:23.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.008+0000 7fc7c6600640 1 -- 172.21.15.59:0/450443252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c006fa10 msgr2=0x7fc7c015fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.008+0000 7fc7c6600640 1 --2- 172.21.15.59:0/450443252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c006fa10 0x7fc7c015fe80 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009d90 tx=0x7fc7b801c870 comp rx=0 tx=0).stop 2024-05-30T16:59:23.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.008+0000 7fc7c6600640 1 -- 172.21.15.59:0/450443252 shutdown_connections 2024-05-30T16:59:23.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.008+0000 7fc7c6600640 1 --2- 172.21.15.59:0/450443252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c006fa10 0x7fc7c015fe80 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.008+0000 7fc7c6600640 1 -- 172.21.15.59:0/450443252 >> 172.21.15.59:0/450443252 conn(0x7fc7c00b56f0 msgr2=0x7fc7c00b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:23.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.008+0000 7fc7c6600640 1 -- 172.21.15.59:0/450443252 shutdown_connections 2024-05-30T16:59:23.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.008+0000 7fc7c6600640 1 -- 172.21.15.59:0/450443252 wait complete. 2024-05-30T16:59:23.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7c6600640 1 Processor -- start 2024-05-30T16:59:23.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7c6600640 1 -- start start 2024-05-30T16:59:23.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7c6600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7c006fa10 0x7fc7c014d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7c6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c00b38e0 0x7fc7c00afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7c6600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7c0161cf0 0x7fc7c0149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7c6600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c006edd0 con 0x7fc7c00b38e0 2024-05-30T16:59:23.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7c6600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c006ec50 con 0x7fc7c006fa10 2024-05-30T16:59:23.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7c6600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c006ef50 con 0x7fc7c0161cf0 2024-05-30T16:59:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7bf400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7c006fa10 0x7fc7c014d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7bf400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7c006fa10 0x7fc7c014d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:40414/0 (socket says 172.21.15.59:40414) 2024-05-30T16:59:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7bf400640 1 -- 172.21.15.59:0/1680170054 learned_addr learned my addr 172.21.15.59:0/1680170054 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7bfe00640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7c0161cf0 0x7fc7c0149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7bea00640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c00b38e0 0x7fc7c00afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7bfe00640 1 -- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7c006fa10 msgr2=0x7fc7c014d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7bfe00640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7c006fa10 0x7fc7c014d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7bfe00640 1 -- 172.21.15.59:0/1680170054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c00b38e0 msgr2=0x7fc7c00afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7bfe00640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c00b38e0 0x7fc7c00afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7bfe00640 1 -- 172.21.15.59:0/1680170054 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c0158df0 con 0x7fc7c0161cf0 2024-05-30T16:59:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.012+0000 7fc7bea00640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c00b38e0 0x7fc7c00afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.016+0000 7fc7bfe00640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7c0161cf0 0x7fc7c0149a80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0072ff0 tx=0x7fc7b8019610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.016+0000 7fc7b7400640 1 -- 172.21.15.59:0/1680170054 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80bd030 con 0x7fc7c0161cf0 2024-05-30T16:59:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.016+0000 7fc7b7400640 1 -- 172.21.15.59:0/1680170054 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b80ad4c0 con 0x7fc7c0161cf0 2024-05-30T16:59:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.016+0000 7fc7b7400640 1 -- 172.21.15.59:0/1680170054 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80b2040 con 0x7fc7c0161cf0 2024-05-30T16:59:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.016+0000 7fc7c6600640 1 -- 172.21.15.59:0/1680170054 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c00b1570 con 0x7fc7c0161cf0 2024-05-30T16:59:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.016+0000 7fc7c6600640 1 -- 172.21.15.59:0/1680170054 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c00b07b0 con 0x7fc7c0161cf0 2024-05-30T16:59:23.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.016+0000 7fc7c6600640 1 -- 172.21.15.59:0/1680170054 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c0068a90 con 0x7fc7c0161cf0 2024-05-30T16:59:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.016+0000 7fc7b7400640 1 -- 172.21.15.59:0/1680170054 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fc7b80c0070 con 0x7fc7c0161cf0 2024-05-30T16:59:23.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.020+0000 7fc7b7400640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc7a0069540 0x7fc7a006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.020+0000 7fc7b7400640 1 -- 172.21.15.59:0/1680170054 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 5879+0+0 (secure 0 0 0) 0x7fc7b81201a0 con 0x7fc7c0161cf0 2024-05-30T16:59:23.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.020+0000 7fc7bf400640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc7a0069540 0x7fc7a006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.020+0000 7fc7bf400640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc7a0069540 0x7fc7a006ba00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0000f70 tx=0x7fc7b0007ee0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:23.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.028+0000 7fc7b7400640 1 -- 172.21.15.59:0/1680170054 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc7b80c8020 con 0x7fc7c0161cf0 2024-05-30T16:59:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.240+0000 7fc7c6600640 1 -- 172.21.15.59:0/1680170054 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7c00d0e40 con 0x7fc7c0161cf0 2024-05-30T16:59:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.240+0000 7fc7b7400640 1 -- 172.21.15.59:0/1680170054 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5189 (secure 0 0 0) 0x7fc7b8016520 con 0x7fc7c0161cf0 2024-05-30T16:59:23.242 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:23.242 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1624622774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1624622774},{"type":"v1","addr":"172.21.15.59:6835","nonce":1624622774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2200377252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2200377252},{"type":"v1","addr":"172.21.15.59:6834","nonce":2200377252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1151212671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1151212671},{"type":"v1","addr":"172.21.15.107:6836","nonce":1151212671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:56:44.037966+0000","modified":"2024-05-30T16:56:47.045160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/1073059560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1073059560},{"type":"v1","addr":"172.21.15.107:6837","nonce":1073059560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6528,"qdb_cluster":[6528]},"id":5}]} 2024-05-30T16:59:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 43 2024-05-30T16:59:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.240+0000 7fc7c6600640 1 -- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc7a0069540 msgr2=0x7fc7a006ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.240+0000 7fc7c6600640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc7a0069540 0x7fc7a006ba00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0000f70 tx=0x7fc7b0007ee0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.240+0000 7fc7c6600640 1 -- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7c0161cf0 msgr2=0x7fc7c0149a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.240+0000 7fc7c6600640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7c0161cf0 0x7fc7c0149a80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0072ff0 tx=0x7fc7b8019610 comp rx=0 tx=0).stop 2024-05-30T16:59:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.244+0000 7fc7c6600640 1 -- 172.21.15.59:0/1680170054 shutdown_connections 2024-05-30T16:59:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.244+0000 7fc7c6600640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc7a0069540 0x7fc7a006ba00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.244+0000 7fc7c6600640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7c0161cf0 0x7fc7c0149a80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.244+0000 7fc7c6600640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c00b38e0 0x7fc7c00afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.244+0000 7fc7c6600640 1 --2- 172.21.15.59:0/1680170054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7c006fa10 0x7fc7c014d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.244+0000 7fc7c6600640 1 -- 172.21.15.59:0/1680170054 >> 172.21.15.59:0/1680170054 conn(0x7fc7c00b56f0 msgr2=0x7fc7c015de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.244+0000 7fc7c6600640 1 -- 172.21.15.59:0/1680170054 shutdown_connections 2024-05-30T16:59:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.244+0000 7fc7c6600640 1 -- 172.21.15.59:0/1680170054 wait complete. 2024-05-30T16:59:23.264 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:59:23.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.400+0000 7f16da200640 1 Processor -- start 2024-05-30T16:59:23.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16da200640 1 -- start start 2024-05-30T16:59:23.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16da200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d40d14c0 0x7f16d406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16da200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f16d409b150 0x7f16d406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16da200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16d406ea20 con 0x7f16d40d05b0 2024-05-30T16:59:23.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16da200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f16d4070950 con 0x7f16d409b150 2024-05-30T16:59:23.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16da200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f16d4070c30 con 0x7f16d40d14c0 2024-05-30T16:59:23.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16d3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d40d14c0 0x7f16d406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16d3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d40d14c0 0x7f16d406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:38230/0 (socket says 172.21.15.59:38230) 2024-05-30T16:59:23.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16d3400640 1 -- 172.21.15.59:0/2230272333 learned_addr learned my addr 172.21.15.59:0/2230272333 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:23.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16d3e00640 1 --2- 172.21.15.59:0/2230272333 >> v2:172.21.15.107:3300/0 conn(0x7f16d409b150 0x7f16d406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16cbe00640 1 --1- 172.21.15.59:0/2230272333 >> v1:172.21.15.107:6789/0 conn(0x7f16d40d05b0 0x7f16d409aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:39382/0 (socket says 172.21.15.59:39382) 2024-05-30T16:59:23.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16d3400640 1 -- 172.21.15.59:0/2230272333 >> v2:172.21.15.107:3300/0 conn(0x7f16d409b150 msgr2=0x7f16d406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:23.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16d3400640 1 --2- 172.21.15.59:0/2230272333 >> v2:172.21.15.107:3300/0 conn(0x7f16d409b150 0x7f16d406d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16d2a00640 1 -- 172.21.15.59:0/2230272333 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7453388 0 0) 0x7f16bc001120 con 0x7f16d40d05b0 2024-05-30T16:59:23.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16d3400640 1 -- 172.21.15.59:0/2230272333 >> v1:172.21.15.107:6789/0 conn(0x7f16d40d05b0 legacy=0x7f16d409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16d3400640 1 -- 172.21.15.59:0/2230272333 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d4070f10 con 0x7f16d40d14c0 2024-05-30T16:59:23.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.404+0000 7f16d3e00640 1 --2- 172.21.15.59:0/2230272333 >> v2:172.21.15.107:3300/0 conn(0x7f16d409b150 0x7f16d406d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:59:23.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16d3400640 1 --2- 172.21.15.59:0/2230272333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d40d14c0 0x7f16d406e4e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009870 tx=0x7f16c401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7a63bb946a04bc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:23.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16d2a00640 1 -- 172.21.15.59:0/2230272333 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c40aa650 con 0x7f16d40d14c0 2024-05-30T16:59:23.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16d2a00640 1 -- 172.21.15.59:0/2230272333 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16c40af070 con 0x7f16d40d14c0 2024-05-30T16:59:23.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16d2a00640 1 -- 172.21.15.59:0/2230272333 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c40aaa10 con 0x7f16d40d14c0 2024-05-30T16:59:23.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16da200640 1 -- 172.21.15.59:0/2230272333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d40d14c0 msgr2=0x7f16d406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16da200640 1 --2- 172.21.15.59:0/2230272333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d40d14c0 0x7f16d406e4e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009870 tx=0x7f16c401c530 comp rx=0 tx=0).stop 2024-05-30T16:59:23.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16da200640 1 -- 172.21.15.59:0/2230272333 shutdown_connections 2024-05-30T16:59:23.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16da200640 1 --2- 172.21.15.59:0/2230272333 >> v2:172.21.15.107:3300/0 conn(0x7f16d409b150 0x7f16d406d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16da200640 1 --2- 172.21.15.59:0/2230272333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d40d14c0 0x7f16d406e4e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16da200640 1 -- 172.21.15.59:0/2230272333 >> 172.21.15.59:0/2230272333 conn(0x7f16d40b3f80 msgr2=0x7f16d40b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:23.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16da200640 1 -- 172.21.15.59:0/2230272333 shutdown_connections 2024-05-30T16:59:23.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16da200640 1 -- 172.21.15.59:0/2230272333 wait complete. 2024-05-30T16:59:23.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16da200640 1 Processor -- start 2024-05-30T16:59:23.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.408+0000 7f16da200640 1 -- start start 2024-05-30T16:59:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16da200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d409b150 0x7f16d40b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16da200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16d40d05b0 0x7f16d4159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16da200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d40d14c0 0x7f16d40b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16da200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f16d40d0b70 con 0x7f16d40d05b0 2024-05-30T16:59:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16da200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f16d40d09f0 con 0x7f16d409b150 2024-05-30T16:59:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16da200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f16d406de40 con 0x7f16d40d14c0 2024-05-30T16:59:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16d40d05b0 0x7f16d4159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16d40d05b0 0x7f16d4159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39096/0 (socket says 172.21.15.59:39096) 2024-05-30T16:59:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cbe00640 1 -- 172.21.15.59:0/912795676 learned_addr learned my addr 172.21.15.59:0/912795676 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16d3400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d409b150 0x7f16d40b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16d3e00640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d40d14c0 0x7f16d40b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cbe00640 1 -- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d40d14c0 msgr2=0x7f16d40b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cbe00640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d40d14c0 0x7f16d40b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cbe00640 1 -- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d409b150 msgr2=0x7f16d40b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cbe00640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d409b150 0x7f16d40b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cbe00640 1 -- 172.21.15.59:0/912795676 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d415a470 con 0x7f16d40d05b0 2024-05-30T16:59:23.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cbe00640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16d40d05b0 0x7f16d4159f30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00c780 tx=0x7f16bc00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:23.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cb400640 1 -- 172.21.15.59:0/912795676 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc018070 con 0x7f16d40d05b0 2024-05-30T16:59:23.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cb400640 1 -- 172.21.15.59:0/912795676 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc0072f0 con 0x7f16d40d05b0 2024-05-30T16:59:23.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cb400640 1 -- 172.21.15.59:0/912795676 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0047f0 con 0x7f16d40d05b0 2024-05-30T16:59:23.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16da200640 1 -- 172.21.15.59:0/912795676 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d4162b90 con 0x7f16d40d05b0 2024-05-30T16:59:23.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16da200640 1 -- 172.21.15.59:0/912795676 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d40caae0 con 0x7f16d40d05b0 2024-05-30T16:59:23.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16da200640 1 -- 172.21.15.59:0/912795676 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d4068a90 con 0x7f16d40d05b0 2024-05-30T16:59:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.412+0000 7f16cb400640 1 -- 172.21.15.59:0/912795676 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f16bc01b070 con 0x7f16d40d05b0 2024-05-30T16:59:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.416+0000 7f16cb400640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f16b00694f0 0x7f16b006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.416+0000 7f16cb400640 1 -- 172.21.15.59:0/912795676 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5879+0+0 (secure 0 0 0) 0x7f16bc084b70 con 0x7f16d40d05b0 2024-05-30T16:59:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.416+0000 7f16d3400640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f16b00694f0 0x7f16b006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.416+0000 7f16d3400640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f16b00694f0 0x7f16b006b9b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f16c40ae000 tx=0x7f16c40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:23.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.420+0000 7f16cb400640 1 -- 172.21.15.59:0/912795676 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f16d406ea20 con 0x7f16d40d05b0 2024-05-30T16:59:23.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.584+0000 7f16da200640 1 -- 172.21.15.59:0/912795676 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16d40cc5a0 con 0x7f16d40d05b0 2024-05-30T16:59:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16cb400640 1 -- 172.21.15.59:0/912795676 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+16950 (secure 0 0 0) 0x7f16bc056240 con 0x7f16d40d05b0 2024-05-30T16:59:23.588 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:23.588 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":79,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:59:19.941530+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:56:41.730533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T16:56:42.994525+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":78,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.28","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:59:23.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16da200640 1 -- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f16b00694f0 msgr2=0x7f16b006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16da200640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f16b00694f0 0x7f16b006b9b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f16c40ae000 tx=0x7f16c40a7000 comp rx=0 tx=0).stop 2024-05-30T16:59:23.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16da200640 1 -- 172.21.15.59:0/912795676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16d40d05b0 msgr2=0x7f16d4159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16da200640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16d40d05b0 0x7f16d4159f30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00c780 tx=0x7f16bc00cb80 comp rx=0 tx=0).stop 2024-05-30T16:59:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16da200640 1 -- 172.21.15.59:0/912795676 shutdown_connections 2024-05-30T16:59:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16da200640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f16b00694f0 0x7f16b006b9b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16da200640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d40d14c0 0x7f16d40b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16da200640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16d40d05b0 0x7f16d4159f30 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16da200640 1 --2- 172.21.15.59:0/912795676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d409b150 0x7f16d40b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16da200640 1 -- 172.21.15.59:0/912795676 >> 172.21.15.59:0/912795676 conn(0x7f16d40b3f80 msgr2=0x7f16d40af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16da200640 1 -- 172.21.15.59:0/912795676 shutdown_connections 2024-05-30T16:59:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.588+0000 7f16da200640 1 -- 172.21.15.59:0/912795676 wait complete. 2024-05-30T16:59:23.610 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T16:59:23.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9329000640 1 Processor -- start 2024-05-30T16:59:23.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9329000640 1 -- start start 2024-05-30T16:59:23.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9329000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f93240d0f30 0x7f932409ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9329000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f932409b080 0x7f93240cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9329000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f932409b900 con 0x7f932415c7b0 2024-05-30T16:59:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9329000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f932415cb90 con 0x7f932409b080 2024-05-30T16:59:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9329000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f93240cd4c0 con 0x7f93240d0f30 2024-05-30T16:59:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9323e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f932409b080 0x7f93240cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9323e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f932409b080 0x7f93240cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39112/0 (socket says 172.21.15.59:39112) 2024-05-30T16:59:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9323e00640 1 -- 172.21.15.59:0/478424324 learned_addr learned my addr 172.21.15.59:0/478424324 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f931aa00640 1 --2- 172.21.15.59:0/478424324 >> v2:172.21.15.107:3300/0 conn(0x7f93240d0f30 0x7f932409ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9323e00640 1 -- 172.21.15.59:0/478424324 >> v2:172.21.15.107:3300/0 conn(0x7f93240d0f30 msgr2=0x7f932409ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:23.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9323e00640 1 --2- 172.21.15.59:0/478424324 >> v2:172.21.15.107:3300/0 conn(0x7f93240d0f30 0x7f932409ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9323e00640 1 -- 172.21.15.59:0/478424324 >> v1:172.21.15.107:6789/0 conn(0x7f932415c7b0 legacy=0x7f93240d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f9323e00640 1 -- 172.21.15.59:0/478424324 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932409bbe0 con 0x7f932409b080 2024-05-30T16:59:23.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.752+0000 7f931aa00640 1 --2- 172.21.15.59:0/478424324 >> v2:172.21.15.107:3300/0 conn(0x7f93240d0f30 0x7f932409ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:23.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.756+0000 7f9323e00640 1 --2- 172.21.15.59:0/478424324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409b080 0x7f93240cd950 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f9324072010 tx=0x7f931c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f79587b515d877 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:23.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.756+0000 7f9322a00640 1 -- 172.21.15.59:0/478424324 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c0a58a0 con 0x7f932409b080 2024-05-30T16:59:23.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.756+0000 7f9322a00640 1 -- 172.21.15.59:0/478424324 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931c0a5a40 con 0x7f932409b080 2024-05-30T16:59:23.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.756+0000 7f9322a00640 1 -- 172.21.15.59:0/478424324 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c0a5e10 con 0x7f932409b080 2024-05-30T16:59:23.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.756+0000 7f9329000640 1 -- 172.21.15.59:0/478424324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409b080 msgr2=0x7f93240cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.756+0000 7f9329000640 1 --2- 172.21.15.59:0/478424324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409b080 0x7f93240cd950 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f9324072010 tx=0x7f931c01c9c0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.756+0000 7f9329000640 1 -- 172.21.15.59:0/478424324 shutdown_connections 2024-05-30T16:59:23.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.756+0000 7f9329000640 1 --2- 172.21.15.59:0/478424324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409b080 0x7f93240cd950 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.756+0000 7f9329000640 1 --2- 172.21.15.59:0/478424324 >> v2:172.21.15.107:3300/0 conn(0x7f93240d0f30 0x7f932409ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.756+0000 7f9329000640 1 -- 172.21.15.59:0/478424324 >> 172.21.15.59:0/478424324 conn(0x7f93240b3ec0 msgr2=0x7f93240b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:23.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.756+0000 7f9329000640 1 -- 172.21.15.59:0/478424324 shutdown_connections 2024-05-30T16:59:23.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.756+0000 7f9329000640 1 -- 172.21.15.59:0/478424324 wait complete. 2024-05-30T16:59:23.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9329000640 1 Processor -- start 2024-05-30T16:59:23.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9329000640 1 -- start start 2024-05-30T16:59:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9329000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f932409b080 0x7f93240afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9329000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93240d0f30 0x7f9324153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9329000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932415c7b0 0x7f93240b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9329000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f93240ce6a0 con 0x7f932415c7b0 2024-05-30T16:59:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9329000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f932409b6a0 con 0x7f93240d0f30 2024-05-30T16:59:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9329000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f93240ce820 con 0x7f932409b080 2024-05-30T16:59:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9323e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932415c7b0 0x7f93240b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9323e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932415c7b0 0x7f93240b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39116/0 (socket says 172.21.15.59:39116) 2024-05-30T16:59:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9323e00640 1 -- 172.21.15.59:0/454538848 learned_addr learned my addr 172.21.15.59:0/454538848 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f931aa00640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93240d0f30 0x7f9324153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9323400640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f932409b080 0x7f93240afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9323e00640 1 -- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f932409b080 msgr2=0x7f93240afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9323e00640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f932409b080 0x7f93240afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9323e00640 1 -- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93240d0f30 msgr2=0x7f9324153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9323e00640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93240d0f30 0x7f9324153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9323e00640 1 -- 172.21.15.59:0/454538848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93240ca590 con 0x7f932415c7b0 2024-05-30T16:59:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9323e00640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932415c7b0 0x7f93240b19e0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f931c0195d0 tx=0x7f931c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f931be00640 1 -- 172.21.15.59:0/454538848 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c0a58a0 con 0x7f932415c7b0 2024-05-30T16:59:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f931be00640 1 -- 172.21.15.59:0/454538848 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931c0be070 con 0x7f932415c7b0 2024-05-30T16:59:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9329000640 1 -- 172.21.15.59:0/454538848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93240b04d0 con 0x7f932415c7b0 2024-05-30T16:59:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f931be00640 1 -- 172.21.15.59:0/454538848 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c009510 con 0x7f932415c7b0 2024-05-30T16:59:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9329000640 1 -- 172.21.15.59:0/454538848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93240b0a90 con 0x7f932415c7b0 2024-05-30T16:59:23.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.760+0000 7f9329000640 1 -- 172.21.15.59:0/454538848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9324068a90 con 0x7f932415c7b0 2024-05-30T16:59:23.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.764+0000 7f931be00640 1 -- 172.21.15.59:0/454538848 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f931c0b86b0 con 0x7f932415c7b0 2024-05-30T16:59:23.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.764+0000 7f931be00640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93000694f0 0x7f930006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:23.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.764+0000 7f931be00640 1 -- 172.21.15.59:0/454538848 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5879+0+0 (secure 0 0 0) 0x7f931c120e20 con 0x7f932415c7b0 2024-05-30T16:59:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.764+0000 7f9323400640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93000694f0 0x7f930006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.764+0000 7f9323400640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93000694f0 0x7f930006b9b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f93240b1740 tx=0x7f9314009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:23.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.768+0000 7f931be00640 1 -- 172.21.15.59:0/454538848 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f931c0165e0 con 0x7f932415c7b0 2024-05-30T16:59:23.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.968+0000 7f9329000640 1 -- 172.21.15.59:0/454538848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f93240d03f0 con 0x7f932415c7b0 2024-05-30T16:59:23.973 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-05-30T16:59:23.972+0000 7f2f74c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T16:59:23.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f931be00640 1 -- 172.21.15.59:0/454538848 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) ==== 161+0+0 (secure 0 0 0) 0x7f931c0f2490 con 0x7f932415c7b0 2024-05-30T16:59:23.977 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T16:59:23.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f9329000640 1 -- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93000694f0 msgr2=0x7f930006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f9329000640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93000694f0 0x7f930006b9b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f93240b1740 tx=0x7f9314009040 comp rx=0 tx=0).stop 2024-05-30T16:59:23.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f9329000640 1 -- 172.21.15.59:0/454538848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932415c7b0 msgr2=0x7f93240b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:23.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f9329000640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932415c7b0 0x7f93240b19e0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f931c0195d0 tx=0x7f931c019760 comp rx=0 tx=0).stop 2024-05-30T16:59:23.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f9329000640 1 -- 172.21.15.59:0/454538848 shutdown_connections 2024-05-30T16:59:23.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f9329000640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93000694f0 0x7f930006b9b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f9329000640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932415c7b0 0x7f93240b19e0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f9329000640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93240d0f30 0x7f9324153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f9329000640 1 --2- 172.21.15.59:0/454538848 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f932409b080 0x7f93240afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:23.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f9329000640 1 -- 172.21.15.59:0/454538848 >> 172.21.15.59:0/454538848 conn(0x7f93240b3ec0 msgr2=0x7f93240b67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:23.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f9329000640 1 -- 172.21.15.59:0/454538848 shutdown_connections 2024-05-30T16:59:23.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:23.976+0000 7f9329000640 1 -- 172.21.15.59:0/454538848 wait complete. 2024-05-30T16:59:24.000 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T16:59:24.049 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-30T16:59:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.140+0000 7f3c5ec00640 1 Processor -- start 2024-05-30T16:59:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.140+0000 7f3c5ec00640 1 -- start start 2024-05-30T16:59:24.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.140+0000 7f3c5ec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c580c9e10 0x7f3c58141f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:24.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.140+0000 7f3c5ec00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c58163260 con 0x7f3c5806bce0 2024-05-30T16:59:24.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c5ec00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c5806d2f0 con 0x7f3c5806ce90 2024-05-30T16:59:24.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c5ec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3c581626e0 con 0x7f3c580c9e10 2024-05-30T16:59:24.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c5cc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3c5806bce0 0x7f3c5806c150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54828/0 (socket says 172.21.15.59:54828) 2024-05-30T16:59:24.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c5cc00640 1 -- 172.21.15.59:0/497255828 learned_addr learned my addr 172.21.15.59:0/497255828 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:24.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c57e00640 1 --2- 172.21.15.59:0/497255828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c580c9e10 0x7f3c58141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:24.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c57400640 1 -- 172.21.15.59:0/497255828 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3269449100 0 0) 0x7f3c58163260 con 0x7f3c5806bce0 2024-05-30T16:59:24.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c57400640 1 -- 172.21.15.59:0/497255828 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c3c003530 con 0x7f3c5806bce0 2024-05-30T16:59:24.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c57400640 1 -- 172.21.15.59:0/497255828 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794888981 0 0) 0x7f3c5806d2f0 con 0x7f3c5806ce90 2024-05-30T16:59:24.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c57400640 1 -- 172.21.15.59:0/497255828 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c58163260 con 0x7f3c5806ce90 2024-05-30T16:59:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c57e00640 1 -- 172.21.15.59:0/497255828 >> v1:172.21.15.107:6789/0 conn(0x7f3c5806ce90 legacy=0x7f3c580ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c57e00640 1 -- 172.21.15.59:0/497255828 >> v1:172.21.15.59:6789/0 conn(0x7f3c5806bce0 legacy=0x7f3c5806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c57e00640 1 -- 172.21.15.59:0/497255828 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c581629c0 con 0x7f3c580c9e10 2024-05-30T16:59:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.144+0000 7f3c57e00640 1 --2- 172.21.15.59:0/497255828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c580c9e10 0x7f3c58141f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c480097f0 tx=0x7f3c4801c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2345638033f9ea7a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:24.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c57400640 1 -- 172.21.15.59:0/497255828 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c480b1070 con 0x7f3c580c9e10 2024-05-30T16:59:24.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c57400640 1 -- 172.21.15.59:0/497255828 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c480ac5f0 con 0x7f3c580c9e10 2024-05-30T16:59:24.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c57400640 1 -- 172.21.15.59:0/497255828 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c480ac9c0 con 0x7f3c580c9e10 2024-05-30T16:59:24.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 -- 172.21.15.59:0/497255828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c580c9e10 msgr2=0x7f3c58141f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:24.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 --2- 172.21.15.59:0/497255828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c580c9e10 0x7f3c58141f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c480097f0 tx=0x7f3c4801c390 comp rx=0 tx=0).stop 2024-05-30T16:59:24.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 -- 172.21.15.59:0/497255828 shutdown_connections 2024-05-30T16:59:24.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 --2- 172.21.15.59:0/497255828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c580c9e10 0x7f3c58141f20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:24.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 -- 172.21.15.59:0/497255828 >> 172.21.15.59:0/497255828 conn(0x7f3c580cd540 msgr2=0x7f3c580cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:24.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 -- 172.21.15.59:0/497255828 shutdown_connections 2024-05-30T16:59:24.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 -- 172.21.15.59:0/497255828 wait complete. 2024-05-30T16:59:24.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 Processor -- start 2024-05-30T16:59:24.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 -- start start 2024-05-30T16:59:24.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5806bce0 0x7f3c580b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:24.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c5806ce90 0x7f3c5806f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:24.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c580c9e10 0x7f3c5815db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:24.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58162480 con 0x7f3c5806ce90 2024-05-30T16:59:24.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58162300 con 0x7f3c580c9e10 2024-05-30T16:59:24.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5ec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3c580cd1d0 con 0x7f3c5806bce0 2024-05-30T16:59:24.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c4fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c5806ce90 0x7f3c5806f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:24.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c4fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c5806ce90 0x7f3c5806f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39130/0 (socket says 172.21.15.59:39130) 2024-05-30T16:59:24.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c4fe00640 1 -- 172.21.15.59:0/2949982629 learned_addr learned my addr 172.21.15.59:0/2949982629 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:24.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c5cc00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c580c9e10 0x7f3c5815db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:24.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.148+0000 7f3c57e00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5806bce0 0x7f3c580b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:24.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c4fe00640 1 -- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5806bce0 msgr2=0x7f3c580b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:24.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c4fe00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5806bce0 0x7f3c580b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:24.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c4fe00640 1 -- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c580c9e10 msgr2=0x7f3c5815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:24.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c4fe00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c580c9e10 0x7f3c5815db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:24.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c4fe00640 1 -- 172.21.15.59:0/2949982629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5815e0c0 con 0x7f3c5806ce90 2024-05-30T16:59:24.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c4fe00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c5806ce90 0x7f3c5806f0f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c460 tx=0x7f3c4000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:24.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c54c00640 1 -- 172.21.15.59:0/2949982629 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c40017070 con 0x7f3c5806ce90 2024-05-30T16:59:24.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c54c00640 1 -- 172.21.15.59:0/2949982629 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c400052f0 con 0x7f3c5806ce90 2024-05-30T16:59:24.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c54c00640 1 -- 172.21.15.59:0/2949982629 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c40003840 con 0x7f3c5806ce90 2024-05-30T16:59:24.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c5ec00640 1 -- 172.21.15.59:0/2949982629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5806fc20 con 0x7f3c5806ce90 2024-05-30T16:59:24.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c5ec00640 1 -- 172.21.15.59:0/2949982629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c580701e0 con 0x7f3c5806ce90 2024-05-30T16:59:24.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c5ec00640 1 -- 172.21.15.59:0/2949982629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c58068a90 con 0x7f3c5806ce90 2024-05-30T16:59:24.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c54c00640 1 -- 172.21.15.59:0/2949982629 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f3c4001a070 con 0x7f3c5806ce90 2024-05-30T16:59:24.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c54c00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c340694f0 0x7f3c3406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:24.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c54c00640 1 -- 172.21.15.59:0/2949982629 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5937+0+0 (secure 0 0 0) 0x7f3c40084b40 con 0x7f3c5806ce90 2024-05-30T16:59:24.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.152+0000 7f3c57e00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c340694f0 0x7f3c3406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:24.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.156+0000 7f3c57e00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c340694f0 0x7f3c3406b9b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3c480ae000 tx=0x7f3c480a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:24.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.156+0000 7f3c54c00640 1 -- 172.21.15.59:0/2949982629 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3c400561b0 con 0x7f3c5806ce90 2024-05-30T16:59:24.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.364+0000 7f3c5ec00640 1 -- 172.21.15.59:0/2949982629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3c5806cc70 con 0x7f3c5806ce90 2024-05-30T16:59:24.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c54c00640 1 -- 172.21.15.59:0/2949982629 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) ==== 104+0+0 (secure 0 0 0) 0x7f3c4005a4b0 con 0x7f3c5806ce90 2024-05-30T16:59:24.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c5ec00640 1 -- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c340694f0 msgr2=0x7f3c3406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:24.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c5ec00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c340694f0 0x7f3c3406b9b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3c480ae000 tx=0x7f3c480a7000 comp rx=0 tx=0).stop 2024-05-30T16:59:24.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c5ec00640 1 -- 172.21.15.59:0/2949982629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c5806ce90 msgr2=0x7f3c5806f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:24.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c5ec00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c5806ce90 0x7f3c5806f0f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c460 tx=0x7f3c4000c920 comp rx=0 tx=0).stop 2024-05-30T16:59:24.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c5ec00640 1 -- 172.21.15.59:0/2949982629 shutdown_connections 2024-05-30T16:59:24.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c5ec00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c340694f0 0x7f3c3406b9b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:24.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c5ec00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c580c9e10 0x7f3c5815db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:24.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c5ec00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c5806ce90 0x7f3c5806f0f0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:24.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c5ec00640 1 --2- 172.21.15.59:0/2949982629 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5806bce0 0x7f3c580b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:24.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c5ec00640 1 -- 172.21.15.59:0/2949982629 >> 172.21.15.59:0/2949982629 conn(0x7f3c580cd540 msgr2=0x7f3c58139720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:24.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c5ec00640 1 -- 172.21.15.59:0/2949982629 shutdown_connections 2024-05-30T16:59:24.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:24.980+0000 7f3c5ec00640 1 -- 172.21.15.59:0/2949982629 wait complete. 2024-05-30T16:59:25.006 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T16:59:25.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa881800640 1 Processor -- start 2024-05-30T16:59:25.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa881800640 1 -- start start 2024-05-30T16:59:25.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa881800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa87c15b3b0 0x7fa87c0adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:25.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa881800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa87c15b790 0x7fa87c0af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:25.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa881800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87c071cb0 0x7fa87c072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:25.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa881800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa87c0afaf0 con 0x7fa87c15b3b0 2024-05-30T16:59:25.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa881800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa87c0ae510 con 0x7fa87c15b790 2024-05-30T16:59:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa881800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa87c0ae7f0 con 0x7fa87c071cb0 2024-05-30T16:59:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa87aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa87c15b3b0 0x7fa87c0adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa87aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa87c15b3b0 0x7fa87c0adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39138/0 (socket says 172.21.15.59:39138) 2024-05-30T16:59:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa87aa00640 1 -- 172.21.15.59:0/1079992294 learned_addr learned my addr 172.21.15.59:0/1079992294 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa87b400640 1 --2- 172.21.15.59:0/1079992294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87c071cb0 0x7fa87c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa873e00640 1 --2- 172.21.15.59:0/1079992294 >> v2:172.21.15.107:3300/0 conn(0x7fa87c15b790 0x7fa87c0af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa87aa00640 1 -- 172.21.15.59:0/1079992294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87c071cb0 msgr2=0x7fa87c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa87aa00640 1 --2- 172.21.15.59:0/1079992294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87c071cb0 0x7fa87c072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa87aa00640 1 -- 172.21.15.59:0/1079992294 >> v2:172.21.15.107:3300/0 conn(0x7fa87c15b790 msgr2=0x7fa87c0af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa87aa00640 1 --2- 172.21.15.59:0/1079992294 >> v2:172.21.15.107:3300/0 conn(0x7fa87c15b790 0x7fa87c0af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa87aa00640 1 -- 172.21.15.59:0/1079992294 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87c0aead0 con 0x7fa87c15b3b0 2024-05-30T16:59:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.152+0000 7fa873e00640 1 --2- 172.21.15.59:0/1079992294 >> v2:172.21.15.107:3300/0 conn(0x7fa87c15b790 0x7fa87c0af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:25.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa87aa00640 1 --2- 172.21.15.59:0/1079992294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c15b3b0 0x7fa87c0adf30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009870 tx=0x7fa86c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e1186a6a925a24 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa87a000640 1 -- 172.21.15.59:0/1079992294 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c0aa610 con 0x7fa87c15b3b0 2024-05-30T16:59:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa87a000640 1 -- 172.21.15.59:0/1079992294 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86c0af070 con 0x7fa87c15b3b0 2024-05-30T16:59:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa87a000640 1 -- 172.21.15.59:0/1079992294 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c0aa9d0 con 0x7fa87c15b3b0 2024-05-30T16:59:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa881800640 1 -- 172.21.15.59:0/1079992294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c15b3b0 msgr2=0x7fa87c0adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa881800640 1 --2- 172.21.15.59:0/1079992294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c15b3b0 0x7fa87c0adf30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009870 tx=0x7fa86c01c4f0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa881800640 1 -- 172.21.15.59:0/1079992294 shutdown_connections 2024-05-30T16:59:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa881800640 1 --2- 172.21.15.59:0/1079992294 >> v2:172.21.15.107:3300/0 conn(0x7fa87c15b790 0x7fa87c0af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa881800640 1 --2- 172.21.15.59:0/1079992294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87c071cb0 0x7fa87c072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa881800640 1 --2- 172.21.15.59:0/1079992294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c15b3b0 0x7fa87c0adf30 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa881800640 1 -- 172.21.15.59:0/1079992294 >> 172.21.15.59:0/1079992294 conn(0x7fa87c0b1e60 msgr2=0x7fa87c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa881800640 1 -- 172.21.15.59:0/1079992294 shutdown_connections 2024-05-30T16:59:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.156+0000 7fa881800640 1 -- 172.21.15.59:0/1079992294 wait complete. 2024-05-30T16:59:25.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa881800640 1 Processor -- start 2024-05-30T16:59:25.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa881800640 1 -- start start 2024-05-30T16:59:25.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa881800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87c071cb0 0x7fa87c15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:25.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa881800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c15b3b0 0x7fa87c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:25.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa881800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c15b790 0x7fa87c159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:25.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa881800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c0726a0 con 0x7fa87c15b790 2024-05-30T16:59:25.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa881800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c0cc860 con 0x7fa87c15b3b0 2024-05-30T16:59:25.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa881800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa87c072820 con 0x7fa87c071cb0 2024-05-30T16:59:25.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa87b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c15b790 0x7fa87c159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:25.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa87b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c15b790 0x7fa87c159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39142/0 (socket says 172.21.15.59:39142) 2024-05-30T16:59:25.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa87b400640 1 -- 172.21.15.59:0/1611921396 learned_addr learned my addr 172.21.15.59:0/1611921396 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:25.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa873e00640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c15b3b0 0x7fa87c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:25.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa87aa00640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87c071cb0 0x7fa87c15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:25.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa87b400640 1 -- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87c071cb0 msgr2=0x7fa87c15a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:25.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa87b400640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87c071cb0 0x7fa87c15a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa87b400640 1 -- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c15b3b0 msgr2=0x7fa87c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:25.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa87b400640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c15b3b0 0x7fa87c15c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa87b400640 1 -- 172.21.15.59:0/1611921396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87c15cd10 con 0x7fa87c15b790 2024-05-30T16:59:25.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa87b400640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c15b790 0x7fa87c159030 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa874007d50 tx=0x7fa87400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:25.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa872a00640 1 -- 172.21.15.59:0/1611921396 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874014420 con 0x7fa87c15b790 2024-05-30T16:59:25.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa872a00640 1 -- 172.21.15.59:0/1611921396 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa874019070 con 0x7fa87c15b790 2024-05-30T16:59:25.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa881800640 1 -- 172.21.15.59:0/1611921396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87c15cff0 con 0x7fa87c15b790 2024-05-30T16:59:25.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa872a00640 1 -- 172.21.15.59:0/1611921396 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874014820 con 0x7fa87c15b790 2024-05-30T16:59:25.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.160+0000 7fa881800640 1 -- 172.21.15.59:0/1611921396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87c15d5b0 con 0x7fa87c15b790 2024-05-30T16:59:25.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.164+0000 7fa881800640 1 -- 172.21.15.59:0/1611921396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87c068a90 con 0x7fa87c15b790 2024-05-30T16:59:25.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.164+0000 7fa872a00640 1 -- 172.21.15.59:0/1611921396 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fa8740149c0 con 0x7fa87c15b790 2024-05-30T16:59:25.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.164+0000 7fa872a00640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa858069520 0x7fa85806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:25.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.164+0000 7fa872a00640 1 -- 172.21.15.59:0/1611921396 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5937+0+0 (secure 0 0 0) 0x7fa874085ee0 con 0x7fa87c15b790 2024-05-30T16:59:25.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.164+0000 7fa87aa00640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa858069520 0x7fa85806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:25.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.164+0000 7fa87aa00640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa858069520 0x7fa85806b9e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0ae000 tx=0x7fa86c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:25.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.168+0000 7fa872a00640 1 -- 172.21.15.59:0/1611921396 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa874057550 con 0x7fa87c15b790 2024-05-30T16:59:25.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.336+0000 7fa881800640 1 -- 172.21.15.59:0/1611921396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa87c0cc140 con 0x7fa87c15b790 2024-05-30T16:59:25.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.980+0000 7fa872a00640 1 -- 172.21.15.59:0/1611921396 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v81) ==== 181+0+0 (secure 0 0 0) 0x7fa87405b850 con 0x7fa87c15b790 2024-05-30T16:59:25.983 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-05-30T16:59:25.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.984+0000 7fa881800640 1 -- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa858069520 msgr2=0x7fa85806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:25.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.984+0000 7fa881800640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa858069520 0x7fa85806b9e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0ae000 tx=0x7fa86c0a7000 comp rx=0 tx=0).stop 2024-05-30T16:59:25.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.984+0000 7fa881800640 1 -- 172.21.15.59:0/1611921396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c15b790 msgr2=0x7fa87c159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:25.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.984+0000 7fa881800640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c15b790 0x7fa87c159030 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa874007d50 tx=0x7fa87400e4b0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.984+0000 7fa881800640 1 -- 172.21.15.59:0/1611921396 shutdown_connections 2024-05-30T16:59:25.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.984+0000 7fa881800640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa858069520 0x7fa85806b9e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.984+0000 7fa881800640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c15b790 0x7fa87c159030 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.984+0000 7fa881800640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c15b3b0 0x7fa87c15c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.984+0000 7fa881800640 1 --2- 172.21.15.59:0/1611921396 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87c071cb0 0x7fa87c15a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:25.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.984+0000 7fa881800640 1 -- 172.21.15.59:0/1611921396 >> 172.21.15.59:0/1611921396 conn(0x7fa87c0b1e60 msgr2=0x7fa87c15bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:25.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.984+0000 7fa881800640 1 -- 172.21.15.59:0/1611921396 shutdown_connections 2024-05-30T16:59:25.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:25.984+0000 7fa881800640 1 -- 172.21.15.59:0/1611921396 wait complete. 2024-05-30T16:59:26.014 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T16:59:26.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec08800640 1 Processor -- start 2024-05-30T16:59:26.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec08800640 1 -- start start 2024-05-30T16:59:26.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec08800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec00156e40 0x7fec0006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:26.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec08800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec0006dc60 0x7fec0015d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:26.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec08800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec0015db80 con 0x7fec000af130 2024-05-30T16:59:26.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec08800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fec0006e120 con 0x7fec0006dc60 2024-05-30T16:59:26.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec08800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fec0006e400 con 0x7fec00156e40 2024-05-30T16:59:26.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec05400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec0006dc60 0x7fec0015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:26.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec06800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fec000af130 0x7fec000af580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54836/0 (socket says 172.21.15.59:54836) 2024-05-30T16:59:26.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec06800640 1 -- 172.21.15.59:0/354073891 learned_addr learned my addr 172.21.15.59:0/354073891 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:26.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec05400640 1 -- 172.21.15.59:0/354073891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec00156e40 msgr2=0x7fec0006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:26.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec05400640 1 --2- 172.21.15.59:0/354073891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec00156e40 0x7fec0006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:26.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec05400640 1 -- 172.21.15.59:0/354073891 >> v1:172.21.15.59:6789/0 conn(0x7fec000af130 legacy=0x7fec000af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:26.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.160+0000 7fec05400640 1 -- 172.21.15.59:0/354073891 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0006e6e0 con 0x7fec0006dc60 2024-05-30T16:59:26.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.164+0000 7fec05400640 1 --2- 172.21.15.59:0/354073891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec0006dc60 0x7fec0015d640 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7febf00097c0 tx=0x7febf001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698afc0ba1287254 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:26.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.164+0000 7fec04a00640 1 -- 172.21.15.59:0/354073891 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00b2070 con 0x7fec0006dc60 2024-05-30T16:59:26.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.164+0000 7fec04a00640 1 -- 172.21.15.59:0/354073891 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf00ad640 con 0x7fec0006dc60 2024-05-30T16:59:26.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.164+0000 7fec04a00640 1 -- 172.21.15.59:0/354073891 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00ada10 con 0x7fec0006dc60 2024-05-30T16:59:26.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.164+0000 7fec08800640 1 -- 172.21.15.59:0/354073891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec0006dc60 msgr2=0x7fec0015d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:26.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.164+0000 7fec08800640 1 --2- 172.21.15.59:0/354073891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec0006dc60 0x7fec0015d640 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7febf00097c0 tx=0x7febf001c4a0 comp rx=0 tx=0).stop 2024-05-30T16:59:26.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.164+0000 7fec08800640 1 -- 172.21.15.59:0/354073891 shutdown_connections 2024-05-30T16:59:26.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.164+0000 7fec08800640 1 --2- 172.21.15.59:0/354073891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec0006dc60 0x7fec0015d640 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:26.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.164+0000 7fec08800640 1 --2- 172.21.15.59:0/354073891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec00156e40 0x7fec0006f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:26.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.164+0000 7fec08800640 1 -- 172.21.15.59:0/354073891 >> 172.21.15.59:0/354073891 conn(0x7fec000b1e60 msgr2=0x7fec000b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:26.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.164+0000 7fec08800640 1 -- 172.21.15.59:0/354073891 shutdown_connections 2024-05-30T16:59:26.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.164+0000 7fec08800640 1 -- 172.21.15.59:0/354073891 wait complete. 2024-05-30T16:59:26.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec08800640 1 Processor -- start 2024-05-30T16:59:26.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec08800640 1 -- start start 2024-05-30T16:59:26.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec08800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec0006dc60 0x7fec0014ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:26.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec08800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec000af130 0x7fec00099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:26.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec08800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec00156e40 0x7fec00148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:26.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec08800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fec0015ebb0 con 0x7fec00156e40 2024-05-30T16:59:26.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec08800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fec0015ea30 con 0x7fec000af130 2024-05-30T16:59:26.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec08800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fec00169550 con 0x7fec0006dc60 2024-05-30T16:59:26.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec06800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec00156e40 0x7fec00148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec06800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec00156e40 0x7fec00148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39172/0 (socket says 172.21.15.59:39172) 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec06800640 1 -- 172.21.15.59:0/4249211789 learned_addr learned my addr 172.21.15.59:0/4249211789 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec05e00640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec0006dc60 0x7fec0014ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec05400640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec000af130 0x7fec00099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec06800640 1 -- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec0006dc60 msgr2=0x7fec0014ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec06800640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec0006dc60 0x7fec0014ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec06800640 1 -- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec000af130 msgr2=0x7fec00099850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec06800640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec000af130 0x7fec00099850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec06800640 1 -- 172.21.15.59:0/4249211789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec001475f0 con 0x7fec00156e40 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec05e00640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec0006dc60 0x7fec0014ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec05400640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec000af130 0x7fec00099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec06800640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec00156e40 0x7fec00148f10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7febfc00cab0 tx=0x7febfc00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7febfa000640 1 -- 172.21.15.59:0/4249211789 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc017070 con 0x7fec00156e40 2024-05-30T16:59:26.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7febfa000640 1 -- 172.21.15.59:0/4249211789 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febfc00abd0 con 0x7fec00156e40 2024-05-30T16:59:26.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec08800640 1 -- 172.21.15.59:0/4249211789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0014bfc0 con 0x7fec00156e40 2024-05-30T16:59:26.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7febfa000640 1 -- 172.21.15.59:0/4249211789 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc012400 con 0x7fec00156e40 2024-05-30T16:59:26.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.168+0000 7fec08800640 1 -- 172.21.15.59:0/4249211789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec00145fd0 con 0x7fec00156e40 2024-05-30T16:59:26.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.172+0000 7fec08800640 1 -- 172.21.15.59:0/4249211789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec00147ad0 con 0x7fec00156e40 2024-05-30T16:59:26.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.172+0000 7febfa000640 1 -- 172.21.15.59:0/4249211789 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7febfc01a070 con 0x7fec00156e40 2024-05-30T16:59:26.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.172+0000 7febfa000640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7febe40694f0 0x7febe406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:26.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.172+0000 7febfa000640 1 -- 172.21.15.59:0/4249211789 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5499+0+0 (secure 0 0 0) 0x7febfc0853a0 con 0x7fec00156e40 2024-05-30T16:59:26.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.172+0000 7fec05e00640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7febe40694f0 0x7febe406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:26.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.172+0000 7fec05e00640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7febe40694f0 0x7febe406b9b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7febf4006fd0 tx=0x7febf4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:26.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.176+0000 7febfa000640 1 -- 172.21.15.59:0/4249211789 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fec0015db80 con 0x7fec00156e40 2024-05-30T16:59:26.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.344+0000 7fec08800640 1 -- 172.21.15.59:0/4249211789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fec00068a90 con 0x7fec00156e40 2024-05-30T16:59:26.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.992+0000 7febfa000640 1 -- 172.21.15.59:0/4249211789 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v82) ==== 169+0+0 (secure 0 0 0) 0x7febfc056a70 con 0x7fec00156e40 2024-05-30T16:59:26.993 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-05-30T16:59:26.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.996+0000 7fec08800640 1 -- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7febe40694f0 msgr2=0x7febe406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.996+0000 7fec08800640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7febe40694f0 0x7febe406b9b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7febf4006fd0 tx=0x7febf4008040 comp rx=0 tx=0).stop 2024-05-30T16:59:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.996+0000 7fec08800640 1 -- 172.21.15.59:0/4249211789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec00156e40 msgr2=0x7fec00148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.996+0000 7fec08800640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec00156e40 0x7fec00148f10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7febfc00cab0 tx=0x7febfc00cf70 comp rx=0 tx=0).stop 2024-05-30T16:59:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.996+0000 7fec08800640 1 -- 172.21.15.59:0/4249211789 shutdown_connections 2024-05-30T16:59:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.996+0000 7fec08800640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7febe40694f0 0x7febe406b9b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:26.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.996+0000 7fec08800640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec00156e40 0x7fec00148f10 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:26.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.996+0000 7fec08800640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec000af130 0x7fec00099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:26.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.996+0000 7fec08800640 1 --2- 172.21.15.59:0/4249211789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec0006dc60 0x7fec0014ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:26.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.996+0000 7fec08800640 1 -- 172.21.15.59:0/4249211789 >> 172.21.15.59:0/4249211789 conn(0x7fec000b1e60 msgr2=0x7fec00146e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:26.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.996+0000 7fec08800640 1 -- 172.21.15.59:0/4249211789 shutdown_connections 2024-05-30T16:59:26.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:26.996+0000 7fec08800640 1 -- 172.21.15.59:0/4249211789 wait complete. 2024-05-30T16:59:27.033 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T16:59:27.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f951c800640 1 Processor -- start 2024-05-30T16:59:27.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f951c800640 1 -- start start 2024-05-30T16:59:27.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f951c800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95140d14c0 0x7f951406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f951c800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95140d05b0 0x7f951409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f951c800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951406ea20 con 0x7f951409af80 2024-05-30T16:59:27.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f951c800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9514070950 con 0x7f95140d14c0 2024-05-30T16:59:27.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f951c800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9514070c30 con 0x7f95140d05b0 2024-05-30T16:59:27.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f9519e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95140d14c0 0x7f951406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f951a800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f951409af80 0x7f9514162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54838/0 (socket says 172.21.15.59:54838) 2024-05-30T16:59:27.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f951a800640 1 -- 172.21.15.59:0/2606508077 learned_addr learned my addr 172.21.15.59:0/2606508077 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:27.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f9519400640 1 --2- 172.21.15.59:0/2606508077 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95140d05b0 0x7f951409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f9519e00640 1 -- 172.21.15.59:0/2606508077 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95140d05b0 msgr2=0x7f951409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:27.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f9519e00640 1 --2- 172.21.15.59:0/2606508077 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95140d05b0 0x7f951409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f9519e00640 1 -- 172.21.15.59:0/2606508077 >> v1:172.21.15.59:6789/0 conn(0x7f951409af80 legacy=0x7f9514162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.192+0000 7f9519e00640 1 -- 172.21.15.59:0/2606508077 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9514070f10 con 0x7f95140d14c0 2024-05-30T16:59:27.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.196+0000 7f9519e00640 1 --2- 172.21.15.59:0/2606508077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95140d14c0 0x7f951406e4e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f95080097c0 tx=0x7f950801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5586330c64eb8570 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:27.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.196+0000 7f9518a00640 1 -- 172.21.15.59:0/2606508077 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080b0070 con 0x7f95140d14c0 2024-05-30T16:59:27.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.196+0000 7f9518a00640 1 -- 172.21.15.59:0/2606508077 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95080ab600 con 0x7f95140d14c0 2024-05-30T16:59:27.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.196+0000 7f9518a00640 1 -- 172.21.15.59:0/2606508077 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080ab9d0 con 0x7f95140d14c0 2024-05-30T16:59:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.196+0000 7f951c800640 1 -- 172.21.15.59:0/2606508077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95140d14c0 msgr2=0x7f951406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.196+0000 7f951c800640 1 --2- 172.21.15.59:0/2606508077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95140d14c0 0x7f951406e4e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f95080097c0 tx=0x7f950801c4a0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.196+0000 7f951c800640 1 -- 172.21.15.59:0/2606508077 shutdown_connections 2024-05-30T16:59:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.196+0000 7f951c800640 1 --2- 172.21.15.59:0/2606508077 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95140d05b0 0x7f951409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.196+0000 7f951c800640 1 --2- 172.21.15.59:0/2606508077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95140d14c0 0x7f951406e4e0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.196+0000 7f951c800640 1 -- 172.21.15.59:0/2606508077 >> 172.21.15.59:0/2606508077 conn(0x7f95140b3f80 msgr2=0x7f95140b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.200+0000 7f951c800640 1 -- 172.21.15.59:0/2606508077 shutdown_connections 2024-05-30T16:59:27.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.200+0000 7f951c800640 1 -- 172.21.15.59:0/2606508077 wait complete. 2024-05-30T16:59:27.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.200+0000 7f951c800640 1 Processor -- start 2024-05-30T16:59:27.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.200+0000 7f951c800640 1 -- start start 2024-05-30T16:59:27.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.200+0000 7f951c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951409af80 0x7f9514158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.200+0000 7f951c800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95140d05b0 0x7f9514158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.200+0000 7f951c800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95140d14c0 0x7f95140c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.200+0000 7f951c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95140d0b10 con 0x7f951409af80 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.200+0000 7f951c800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f95140d0990 con 0x7f95140d05b0 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.200+0000 7f951c800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f951406e100 con 0x7f95140d14c0 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f9519e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951409af80 0x7f9514158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f9519e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951409af80 0x7f9514158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39186/0 (socket says 172.21.15.59:39186) 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f9519e00640 1 -- 172.21.15.59:0/29813379 learned_addr learned my addr 172.21.15.59:0/29813379 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f951a800640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95140d14c0 0x7f95140c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f9519400640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95140d05b0 0x7f9514158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f9519e00640 1 -- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95140d14c0 msgr2=0x7f95140c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f9519e00640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95140d14c0 0x7f95140c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f9519e00640 1 -- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95140d05b0 msgr2=0x7f9514158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f9519e00640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95140d05b0 0x7f9514158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f9519e00640 1 -- 172.21.15.59:0/29813379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951406ff40 con 0x7f951409af80 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f951a800640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95140d14c0 0x7f95140c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f9519400640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95140d05b0 0x7f9514158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:27.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f9519e00640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951409af80 0x7f9514158820 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f95080097c0 tx=0x7f950801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:27.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f950e000640 1 -- 172.21.15.59:0/29813379 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080b0050 con 0x7f951409af80 2024-05-30T16:59:27.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f950e000640 1 -- 172.21.15.59:0/29813379 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95080bc070 con 0x7f951409af80 2024-05-30T16:59:27.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f950e000640 1 -- 172.21.15.59:0/29813379 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080b5850 con 0x7f951409af80 2024-05-30T16:59:27.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f951c800640 1 -- 172.21.15.59:0/29813379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95140b7110 con 0x7f951409af80 2024-05-30T16:59:27.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f951c800640 1 -- 172.21.15.59:0/29813379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95140b76d0 con 0x7f951409af80 2024-05-30T16:59:27.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f951c800640 1 -- 172.21.15.59:0/29813379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9514068a90 con 0x7f951409af80 2024-05-30T16:59:27.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.204+0000 7f950e000640 1 -- 172.21.15.59:0/29813379 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f95080b59f0 con 0x7f951409af80 2024-05-30T16:59:27.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.208+0000 7f950e000640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f94f80694f0 0x7f94f806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.208+0000 7f950e000640 1 -- 172.21.15.59:0/29813379 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5027+0+0 (secure 0 0 0) 0x7f95081200e0 con 0x7f951409af80 2024-05-30T16:59:27.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.208+0000 7f9519400640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f94f80694f0 0x7f94f806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.208+0000 7f9519400640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f94f80694f0 0x7f94f806b9b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f95140b0db0 tx=0x7f9504008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:27.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.212+0000 7f950e000640 1 -- 172.21.15.59:0/29813379 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9508016090 con 0x7f951409af80 2024-05-30T16:59:27.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.384+0000 7f951c800640 1 -- 172.21.15.59:0/29813379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f95140692a0 con 0x7f951409af80 2024-05-30T16:59:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.388+0000 7f950e000640 1 -- 172.21.15.59:0/29813379 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f95080f1da0 con 0x7f951409af80 2024-05-30T16:59:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.392+0000 7f951c800640 1 -- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f94f80694f0 msgr2=0x7f94f806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.392+0000 7f951c800640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f94f80694f0 0x7f94f806b9b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f95140b0db0 tx=0x7f9504008040 comp rx=0 tx=0).stop 2024-05-30T16:59:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.392+0000 7f951c800640 1 -- 172.21.15.59:0/29813379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951409af80 msgr2=0x7f9514158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.392+0000 7f951c800640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951409af80 0x7f9514158820 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f95080097c0 tx=0x7f950801ace0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.392+0000 7f951c800640 1 -- 172.21.15.59:0/29813379 shutdown_connections 2024-05-30T16:59:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.392+0000 7f951c800640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f94f80694f0 0x7f94f806b9b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.392+0000 7f951c800640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95140d14c0 0x7f95140c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.392+0000 7f951c800640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95140d05b0 0x7f9514158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.392+0000 7f951c800640 1 --2- 172.21.15.59:0/29813379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951409af80 0x7f9514158820 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.392+0000 7f951c800640 1 -- 172.21.15.59:0/29813379 >> 172.21.15.59:0/29813379 conn(0x7f95140b3f80 msgr2=0x7f95140ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.392+0000 7f951c800640 1 -- 172.21.15.59:0/29813379 shutdown_connections 2024-05-30T16:59:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.392+0000 7f951c800640 1 -- 172.21.15.59:0/29813379 wait complete. 2024-05-30T16:59:27.413 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_no_wait 2024-05-30T16:59:27.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.584+0000 7f30e1600640 1 Processor -- start 2024-05-30T16:59:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.584+0000 7f30e1600640 1 -- start start 2024-05-30T16:59:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30e1600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f30dc0d0d70 0x7f30dc15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30e1600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30dc0ad770 con 0x7f30dc1569e0 2024-05-30T16:59:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30e1600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30dc15cb40 con 0x7f30dc0ad2b0 2024-05-30T16:59:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30e1600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f30dc15ce20 con 0x7f30dc0d0d70 2024-05-30T16:59:27.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30daa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f30dc1569e0 0x7f30dc0cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54842/0 (socket says 172.21.15.59:54842) 2024-05-30T16:59:27.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30daa00640 1 -- 172.21.15.59:0/3410737944 learned_addr learned my addr 172.21.15.59:0/3410737944 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:27.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30db400640 1 --2- 172.21.15.59:0/3410737944 >> v2:172.21.15.107:3300/0 conn(0x7f30dc0d0d70 0x7f30dc15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30da000640 1 -- 172.21.15.59:0/3410737944 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220049960 0 0) 0x7f30dc0ad770 con 0x7f30dc1569e0 2024-05-30T16:59:27.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30da000640 1 -- 172.21.15.59:0/3410737944 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30c0003530 con 0x7f30dc1569e0 2024-05-30T16:59:27.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30da000640 1 -- 172.21.15.59:0/3410737944 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915689469 0 0) 0x7f30dc15cb40 con 0x7f30dc0ad2b0 2024-05-30T16:59:27.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30da000640 1 -- 172.21.15.59:0/3410737944 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30dc0ad770 con 0x7f30dc0ad2b0 2024-05-30T16:59:27.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30db400640 1 -- 172.21.15.59:0/3410737944 >> v1:172.21.15.107:6789/0 conn(0x7f30dc0ad2b0 legacy=0x7f30dc0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30db400640 1 -- 172.21.15.59:0/3410737944 >> v1:172.21.15.59:6789/0 conn(0x7f30dc1569e0 legacy=0x7f30dc0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.588+0000 7f30db400640 1 -- 172.21.15.59:0/3410737944 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc15d100 con 0x7f30dc0d0d70 2024-05-30T16:59:27.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30db400640 1 --2- 172.21.15.59:0/3410737944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30dc0d0d70 0x7f30dc15d620 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009d90 tx=0x7f30d401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=384086a0478bc8e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:27.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30da000640 1 -- 172.21.15.59:0/3410737944 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d40b2070 con 0x7f30dc0d0d70 2024-05-30T16:59:27.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30da000640 1 -- 172.21.15.59:0/3410737944 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d40a58b0 con 0x7f30dc0d0d70 2024-05-30T16:59:27.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30da000640 1 -- 172.21.15.59:0/3410737944 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d40a5c80 con 0x7f30dc0d0d70 2024-05-30T16:59:27.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30e1600640 1 -- 172.21.15.59:0/3410737944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30dc0d0d70 msgr2=0x7f30dc15d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30e1600640 1 --2- 172.21.15.59:0/3410737944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30dc0d0d70 0x7f30dc15d620 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009d90 tx=0x7f30d401c8e0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30e1600640 1 -- 172.21.15.59:0/3410737944 shutdown_connections 2024-05-30T16:59:27.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30e1600640 1 --2- 172.21.15.59:0/3410737944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30dc0d0d70 0x7f30dc15d620 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30e1600640 1 -- 172.21.15.59:0/3410737944 >> 172.21.15.59:0/3410737944 conn(0x7f30dc06bdb0 msgr2=0x7f30dc06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:27.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30e1600640 1 -- 172.21.15.59:0/3410737944 shutdown_connections 2024-05-30T16:59:27.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30e1600640 1 -- 172.21.15.59:0/3410737944 wait complete. 2024-05-30T16:59:27.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30e1600640 1 Processor -- start 2024-05-30T16:59:27.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.592+0000 7f30e1600640 1 -- start start 2024-05-30T16:59:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30e1600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30dc0ad2b0 0x7f30dc14ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30e1600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30dc0d0d70 0x7f30dc09a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30e1600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30dc1569e0 0x7f30dc0b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30e1600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc0b3eb0 con 0x7f30dc1569e0 2024-05-30T16:59:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30e1600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc0b3d30 con 0x7f30dc0d0d70 2024-05-30T16:59:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30e1600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f30dc0b4030 con 0x7f30dc0ad2b0 2024-05-30T16:59:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30db400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30dc1569e0 0x7f30dc0b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30db400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30dc1569e0 0x7f30dc0b0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39202/0 (socket says 172.21.15.59:39202) 2024-05-30T16:59:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30db400640 1 -- 172.21.15.59:0/1117702293 learned_addr learned my addr 172.21.15.59:0/1117702293 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30daa00640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30dc0ad2b0 0x7f30dc14ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30d2000640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30dc0d0d70 0x7f30dc09a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30db400640 1 -- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30dc0ad2b0 msgr2=0x7f30dc14ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30db400640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30dc0ad2b0 0x7f30dc14ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30db400640 1 -- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30dc0d0d70 msgr2=0x7f30dc09a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30db400640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30dc0d0d70 0x7f30dc09a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30db400640 1 -- 172.21.15.59:0/1117702293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc15f060 con 0x7f30dc1569e0 2024-05-30T16:59:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30db400640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30dc1569e0 0x7f30dc0b0660 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f30d401a510 tx=0x7f30d4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30d3400640 1 -- 172.21.15.59:0/1117702293 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d40b2050 con 0x7f30dc1569e0 2024-05-30T16:59:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30d3400640 1 -- 172.21.15.59:0/1117702293 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d40be070 con 0x7f30dc1569e0 2024-05-30T16:59:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30d3400640 1 -- 172.21.15.59:0/1117702293 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d40ad850 con 0x7f30dc1569e0 2024-05-30T16:59:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30e1600640 1 -- 172.21.15.59:0/1117702293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30dc15f340 con 0x7f30dc1569e0 2024-05-30T16:59:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30e1600640 1 -- 172.21.15.59:0/1117702293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30dc14c8c0 con 0x7f30dc1569e0 2024-05-30T16:59:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.596+0000 7f30e1600640 1 -- 172.21.15.59:0/1117702293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30dc068a90 con 0x7f30dc1569e0 2024-05-30T16:59:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.600+0000 7f30d3400640 1 -- 172.21.15.59:0/1117702293 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f30d40ad9f0 con 0x7f30dc1569e0 2024-05-30T16:59:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.600+0000 7f30d3400640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f30b80694f0 0x7f30b806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.600+0000 7f30d3400640 1 -- 172.21.15.59:0/1117702293 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5027+0+0 (secure 0 0 0) 0x7f30d4120730 con 0x7f30dc1569e0 2024-05-30T16:59:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.600+0000 7f30daa00640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f30b80694f0 0x7f30b806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.600+0000 7f30daa00640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f30b80694f0 0x7f30b806b9b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f30cc007fd0 tx=0x7f30cc007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:27.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.604+0000 7f30d3400640 1 -- 172.21.15.59:0/1117702293 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f30d4016560 con 0x7f30dc1569e0 2024-05-30T16:59:27.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.768+0000 7f30e1600640 1 -- 172.21.15.59:0/1117702293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_no_wait"} v 0) -- 0x7f30dc0b43f0 con 0x7f30dc1569e0 2024-05-30T16:59:27.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.772+0000 7f30d3400640 1 -- 172.21.15.59:0/1117702293 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_no_wait"}]=0 v21) ==== 117+0+0 (secure 0 0 0) 0x7f30d40f1f20 con 0x7f30dc1569e0 2024-05-30T16:59:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.776+0000 7f30e1600640 1 -- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f30b80694f0 msgr2=0x7f30b806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.776+0000 7f30e1600640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f30b80694f0 0x7f30b806b9b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f30cc007fd0 tx=0x7f30cc007d60 comp rx=0 tx=0).stop 2024-05-30T16:59:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.776+0000 7f30e1600640 1 -- 172.21.15.59:0/1117702293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30dc1569e0 msgr2=0x7f30dc0b0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.776+0000 7f30e1600640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30dc1569e0 0x7f30dc0b0660 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f30d401a510 tx=0x7f30d4019680 comp rx=0 tx=0).stop 2024-05-30T16:59:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.776+0000 7f30e1600640 1 -- 172.21.15.59:0/1117702293 shutdown_connections 2024-05-30T16:59:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.776+0000 7f30e1600640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f30b80694f0 0x7f30b806b9b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.776+0000 7f30e1600640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30dc1569e0 0x7f30dc0b0660 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.776+0000 7f30e1600640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30dc0d0d70 0x7f30dc09a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.776+0000 7f30e1600640 1 --2- 172.21.15.59:0/1117702293 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30dc0ad2b0 0x7f30dc14ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.776+0000 7f30e1600640 1 -- 172.21.15.59:0/1117702293 >> 172.21.15.59:0/1117702293 conn(0x7f30dc06bdb0 msgr2=0x7f30dc06e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.776+0000 7f30e1600640 1 -- 172.21.15.59:0/1117702293 shutdown_connections 2024-05-30T16:59:27.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.776+0000 7f30e1600640 1 -- 172.21.15.59:0/1117702293 wait complete. 2024-05-30T16:59:27.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added' 2024-05-30T16:59:27.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.936+0000 7f0dd4a00640 1 Processor -- start 2024-05-30T16:59:27.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.936+0000 7f0dd4a00640 1 -- start start 2024-05-30T16:59:27.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dd4a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd0159df0 0x7f0dd00ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dd4a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dd015d730 con 0x7f0dd00b3e50 2024-05-30T16:59:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dd4a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dd00b3370 con 0x7f0dd015a1d0 2024-05-30T16:59:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dd4a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd00b3650 con 0x7f0dd0159df0 2024-05-30T16:59:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dce800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0dd00b3e50 0x7f0dd015db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54856/0 (socket says 172.21.15.59:54856) 2024-05-30T16:59:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dce800640 1 -- 172.21.15.59:0/3495200711 learned_addr learned my addr 172.21.15.59:0/3495200711 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:27.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dcde00640 1 --2- 172.21.15.59:0/3495200711 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd0159df0 0x7f0dd00ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dcd400640 1 -- 172.21.15.59:0/3495200711 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4141722127 0 0) 0x7f0dd015d730 con 0x7f0dd00b3e50 2024-05-30T16:59:27.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dcd400640 1 -- 172.21.15.59:0/3495200711 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0db4003530 con 0x7f0dd00b3e50 2024-05-30T16:59:27.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dcd400640 1 -- 172.21.15.59:0/3495200711 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4090596616 0 0) 0x7f0dd00b3370 con 0x7f0dd015a1d0 2024-05-30T16:59:27.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dcd400640 1 -- 172.21.15.59:0/3495200711 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dd015d730 con 0x7f0dd015a1d0 2024-05-30T16:59:27.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dcd400640 1 -- 172.21.15.59:0/3495200711 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3599011277 0 0) 0x7f0db4003530 con 0x7f0dd00b3e50 2024-05-30T16:59:27.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dcde00640 1 -- 172.21.15.59:0/3495200711 >> v1:172.21.15.107:6789/0 conn(0x7f0dd015a1d0 legacy=0x7f0dd015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dcde00640 1 -- 172.21.15.59:0/3495200711 >> v1:172.21.15.59:6789/0 conn(0x7f0dd00b3e50 legacy=0x7f0dd015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.940+0000 7f0dcde00640 1 -- 172.21.15.59:0/3495200711 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd00b3930 con 0x7f0dd0159df0 2024-05-30T16:59:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dcde00640 1 --2- 172.21.15.59:0/3495200711 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd0159df0 0x7f0dd00ad1b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00097f0 tx=0x7f0dc001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ff7a5d8578c28 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dcd400640 1 -- 172.21.15.59:0/3495200711 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc00b0070 con 0x7f0dd0159df0 2024-05-30T16:59:27.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dcd400640 1 -- 172.21.15.59:0/3495200711 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dc00ab400 con 0x7f0dd0159df0 2024-05-30T16:59:27.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dcd400640 1 -- 172.21.15.59:0/3495200711 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8001a00 con 0x7f0dd0159df0 2024-05-30T16:59:27.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dd4a00640 1 -- 172.21.15.59:0/3495200711 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd0159df0 msgr2=0x7f0dd00ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dd4a00640 1 --2- 172.21.15.59:0/3495200711 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd0159df0 0x7f0dd00ad1b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00097f0 tx=0x7f0dc001c400 comp rx=0 tx=0).stop 2024-05-30T16:59:27.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dd4a00640 1 -- 172.21.15.59:0/3495200711 shutdown_connections 2024-05-30T16:59:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dd4a00640 1 --2- 172.21.15.59:0/3495200711 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd0159df0 0x7f0dd00ad1b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dd4a00640 1 -- 172.21.15.59:0/3495200711 >> 172.21.15.59:0/3495200711 conn(0x7f0dd00b22d0 msgr2=0x7f0dd00b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dd4a00640 1 -- 172.21.15.59:0/3495200711 shutdown_connections 2024-05-30T16:59:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dd4a00640 1 -- 172.21.15.59:0/3495200711 wait complete. 2024-05-30T16:59:27.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dd4a00640 1 Processor -- start 2024-05-30T16:59:27.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.944+0000 7f0dd4a00640 1 -- start start 2024-05-30T16:59:27.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dd4a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd00b3e50 0x7f0dd014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dd4a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd0159df0 0x7f0dd015a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dd4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd015a1d0 0x7f0dd015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dd4a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd016a7a0 con 0x7f0dd015a1d0 2024-05-30T16:59:27.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dd4a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd016a620 con 0x7f0dd00b3e50 2024-05-30T16:59:27.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dd4a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd016a920 con 0x7f0dd0159df0 2024-05-30T16:59:27.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dce800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd015a1d0 0x7f0dd015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dce800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd015a1d0 0x7f0dd015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39218/0 (socket says 172.21.15.59:39218) 2024-05-30T16:59:27.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dce800640 1 -- 172.21.15.59:0/2800748926 learned_addr learned my addr 172.21.15.59:0/2800748926 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:27.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dcde00640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd00b3e50 0x7f0dd014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dc7e00640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd0159df0 0x7f0dd015a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dce800640 1 -- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd0159df0 msgr2=0x7f0dd015a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dce800640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd0159df0 0x7f0dd015a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dce800640 1 -- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd00b3e50 msgr2=0x7f0dd014cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:27.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dce800640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd00b3e50 0x7f0dd014cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:27.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dce800640 1 -- 172.21.15.59:0/2800748926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd014db40 con 0x7f0dd015a1d0 2024-05-30T16:59:27.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dc7e00640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd0159df0 0x7f0dd015a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:27.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dce800640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd015a1d0 0x7f0dd015abd0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8001f40 tx=0x7f0dc800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:27.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dc6000640 1 -- 172.21.15.59:0/2800748926 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8017070 con 0x7f0dd015a1d0 2024-05-30T16:59:27.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dc6000640 1 -- 172.21.15.59:0/2800748926 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dc8012400 con 0x7f0dd015a1d0 2024-05-30T16:59:27.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dc6000640 1 -- 172.21.15.59:0/2800748926 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8012830 con 0x7f0dd015a1d0 2024-05-30T16:59:27.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dd4a00640 1 -- 172.21.15.59:0/2800748926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd0071ed0 con 0x7f0dd015a1d0 2024-05-30T16:59:27.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dd4a00640 1 -- 172.21.15.59:0/2800748926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd0072490 con 0x7f0dd015a1d0 2024-05-30T16:59:27.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dd4a00640 1 -- 172.21.15.59:0/2800748926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd0068a90 con 0x7f0dd015a1d0 2024-05-30T16:59:27.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.948+0000 7f0dc6000640 1 -- 172.21.15.59:0/2800748926 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f0dc801a070 con 0x7f0dd015a1d0 2024-05-30T16:59:27.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.952+0000 7f0dc6000640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0dac0694f0 0x7f0dac06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:27.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.952+0000 7f0dc6000640 1 -- 172.21.15.59:0/2800748926 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5027+0+0 (secure 0 0 0) 0x7f0dc8085830 con 0x7f0dd015a1d0 2024-05-30T16:59:27.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.952+0000 7f0dcde00640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0dac0694f0 0x7f0dac06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:27.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.952+0000 7f0dcde00640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0dac0694f0 0x7f0dac06b9b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00ad000 tx=0x7f0dc00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:27.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:27.956+0000 7f0dc6000640 1 -- 172.21.15.59:0/2800748926 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0dc8056ea0 con 0x7f0dd015a1d0 2024-05-30T16:59:28.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:28.184+0000 7f0dd4a00640 1 -- 172.21.15.59:0/2800748926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]} v 0) -- 0x7f0dd00b4ef0 con 0x7f0dd015a1d0 2024-05-30T16:59:28.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:28.996+0000 7f0dc6000640 1 -- 172.21.15.59:0/2800748926 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]}]=0 v475) ==== 174+0+0 (secure 0 0 0) 0x7f0dc805b1a0 con 0x7f0dd015a1d0 2024-05-30T16:59:29.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.000+0000 7f0dd4a00640 1 -- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0dac0694f0 msgr2=0x7f0dac06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.000+0000 7f0dd4a00640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0dac0694f0 0x7f0dac06b9b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00ad000 tx=0x7f0dc00a6000 comp rx=0 tx=0).stop 2024-05-30T16:59:29.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.000+0000 7f0dd4a00640 1 -- 172.21.15.59:0/2800748926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd015a1d0 msgr2=0x7f0dd015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.000+0000 7f0dd4a00640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd015a1d0 0x7f0dd015abd0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8001f40 tx=0x7f0dc800a430 comp rx=0 tx=0).stop 2024-05-30T16:59:29.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.000+0000 7f0dd4a00640 1 -- 172.21.15.59:0/2800748926 shutdown_connections 2024-05-30T16:59:29.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.000+0000 7f0dd4a00640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0dac0694f0 0x7f0dac06b9b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.000+0000 7f0dd4a00640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd015a1d0 0x7f0dd015abd0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.000+0000 7f0dd4a00640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dd0159df0 0x7f0dd015a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.000+0000 7f0dd4a00640 1 --2- 172.21.15.59:0/2800748926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd00b3e50 0x7f0dd014cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.000+0000 7f0dd4a00640 1 -- 172.21.15.59:0/2800748926 >> 172.21.15.59:0/2800748926 conn(0x7f0dd00b22d0 msgr2=0x7f0dd015bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:29.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.000+0000 7f0dd4a00640 1 -- 172.21.15.59:0/2800748926 shutdown_connections 2024-05-30T16:59:29.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.000+0000 7f0dd4a00640 1 -- 172.21.15.59:0/2800748926 wait complete. 2024-05-30T16:59:29.027 INFO:tasks.cephfs_test_runner:Test that progress indicated by progress bar for ongoing+pending clones ... ok 2024-05-30T16:59:29.027 INFO:tasks.cephfs_test_runner:Starting test: test_stats_are_printed (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that the command "ceph fs clone status" prints progress stats 2024-05-30T16:59:29.027 INFO:tasks.cephfs_test_runner:test_stats_are_printed (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:59:29.028 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:59:29.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.172+0000 7f0da1800640 1 Processor -- start 2024-05-30T16:59:29.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.172+0000 7f0da1800640 1 -- start start 2024-05-30T16:59:29.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.172+0000 7f0da1800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0d9c0b4510 0x7f0d9c1630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.172+0000 7f0da1800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d9c072d00 0x7f0d9c073170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.172+0000 7f0da1800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d9c15fbe0 con 0x7f0d9c0b48f0 2024-05-30T16:59:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.172+0000 7f0da1800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0d9c1635f0 con 0x7f0d9c072d00 2024-05-30T16:59:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.172+0000 7f0da1800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0d9c0736b0 con 0x7f0d9c0b4510 2024-05-30T16:59:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.172+0000 7f0d9b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d9c072d00 0x7f0d9c073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.172+0000 7f0d9b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d9c072d00 0x7f0d9c073170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39234/0 (socket says 172.21.15.59:39234) 2024-05-30T16:59:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.172+0000 7f0d9b400640 1 -- 172.21.15.59:0/3965402051 learned_addr learned my addr 172.21.15.59:0/3965402051 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.172+0000 7f0d9aa00640 1 --2- 172.21.15.59:0/3965402051 >> v2:172.21.15.107:3300/0 conn(0x7f0d9c0b4510 0x7f0d9c1630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0d9b400640 1 -- 172.21.15.59:0/3965402051 >> v2:172.21.15.107:3300/0 conn(0x7f0d9c0b4510 msgr2=0x7f0d9c1630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0d9b400640 1 --2- 172.21.15.59:0/3965402051 >> v2:172.21.15.107:3300/0 conn(0x7f0d9c0b4510 0x7f0d9c1630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0d9b400640 1 -- 172.21.15.59:0/3965402051 >> v1:172.21.15.107:6789/0 conn(0x7f0d9c0b48f0 legacy=0x7f0d9c15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0d9b400640 1 -- 172.21.15.59:0/3965402051 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c15fec0 con 0x7f0d9c072d00 2024-05-30T16:59:29.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0d9b400640 1 --2- 172.21.15.59:0/3965402051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d9c072d00 0x7f0d9c073170 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c073850 tx=0x7f0d9401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6304b52d081413d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:29.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0d9a000640 1 -- 172.21.15.59:0/3965402051 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d940a57a0 con 0x7f0d9c072d00 2024-05-30T16:59:29.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0d9a000640 1 -- 172.21.15.59:0/3965402051 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d940a5940 con 0x7f0d9c072d00 2024-05-30T16:59:29.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0d9a000640 1 -- 172.21.15.59:0/3965402051 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d940a5d10 con 0x7f0d9c072d00 2024-05-30T16:59:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0da1800640 1 -- 172.21.15.59:0/3965402051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d9c072d00 msgr2=0x7f0d9c073170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0da1800640 1 --2- 172.21.15.59:0/3965402051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d9c072d00 0x7f0d9c073170 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c073850 tx=0x7f0d9401c9f0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0da1800640 1 -- 172.21.15.59:0/3965402051 shutdown_connections 2024-05-30T16:59:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0da1800640 1 --2- 172.21.15.59:0/3965402051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d9c072d00 0x7f0d9c073170 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0da1800640 1 --2- 172.21.15.59:0/3965402051 >> v2:172.21.15.107:3300/0 conn(0x7f0d9c0b4510 0x7f0d9c1630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0da1800640 1 -- 172.21.15.59:0/3965402051 >> 172.21.15.59:0/3965402051 conn(0x7f0d9c0b3240 msgr2=0x7f0d9c0725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.176+0000 7f0da1800640 1 -- 172.21.15.59:0/3965402051 shutdown_connections 2024-05-30T16:59:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0da1800640 1 -- 172.21.15.59:0/3965402051 wait complete. 2024-05-30T16:59:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0da1800640 1 Processor -- start 2024-05-30T16:59:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0da1800640 1 -- start start 2024-05-30T16:59:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0da1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d9c072d00 0x7f0d9c15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0da1800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d9c0b4510 0x7f0d9c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0da1800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0d9c0b48f0 0x7f0d9c151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0da1800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c15f940 con 0x7f0d9c072d00 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0da1800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c15f7c0 con 0x7f0d9c0b4510 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0da1800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c06ee60 con 0x7f0d9c0b48f0 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d9aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d9c072d00 0x7f0d9c15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d9aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d9c072d00 0x7f0d9c15bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39236/0 (socket says 172.21.15.59:39236) 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d9aa00640 1 -- 172.21.15.59:0/668805254 learned_addr learned my addr 172.21.15.59:0/668805254 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d92000640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d9c0b4510 0x7f0d9c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d9b400640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0d9c0b48f0 0x7f0d9c151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d9aa00640 1 -- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0d9c0b48f0 msgr2=0x7f0d9c151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d9aa00640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0d9c0b48f0 0x7f0d9c151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d9aa00640 1 -- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d9c0b4510 msgr2=0x7f0d9c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d9aa00640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d9c0b4510 0x7f0d9c15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d9aa00640 1 -- 172.21.15.59:0/668805254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c153bd0 con 0x7f0d9c072d00 2024-05-30T16:59:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d9aa00640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d9c072d00 0x7f0d9c15bad0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00e930 tx=0x7f0d8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d93400640 1 -- 172.21.15.59:0/668805254 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c017070 con 0x7f0d9c072d00 2024-05-30T16:59:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d93400640 1 -- 172.21.15.59:0/668805254 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d8c00ca00 con 0x7f0d9c072d00 2024-05-30T16:59:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0da1800640 1 -- 172.21.15.59:0/668805254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c153eb0 con 0x7f0d9c072d00 2024-05-30T16:59:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.180+0000 7f0d93400640 1 -- 172.21.15.59:0/668805254 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00cdb0 con 0x7f0d9c072d00 2024-05-30T16:59:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.184+0000 7f0da1800640 1 -- 172.21.15.59:0/668805254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c155cd0 con 0x7f0d9c072d00 2024-05-30T16:59:29.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.184+0000 7f0da1800640 1 -- 172.21.15.59:0/668805254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9c068a90 con 0x7f0d9c072d00 2024-05-30T16:59:29.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.184+0000 7f0d93400640 1 -- 172.21.15.59:0/668805254 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f0d8c01a070 con 0x7f0d9c072d00 2024-05-30T16:59:29.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.184+0000 7f0d93400640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0d780694f0 0x7f0d7806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.184+0000 7f0d93400640 1 -- 172.21.15.59:0/668805254 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5027+0+0 (secure 0 0 0) 0x7f0d8c085c90 con 0x7f0d9c072d00 2024-05-30T16:59:29.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.184+0000 7f0d92000640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0d780694f0 0x7f0d7806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.184+0000 7f0d92000640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0d780694f0 0x7f0d7806b9b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c152f20 tx=0x7f0d84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:29.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.188+0000 7f0d93400640 1 -- 172.21.15.59:0/668805254 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0d8c057a10 con 0x7f0d9c072d00 2024-05-30T16:59:29.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.352+0000 7f0da1800640 1 -- 172.21.15.59:0/668805254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d9c06d2c0 con 0x7f0d9c072d00 2024-05-30T16:59:29.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.352+0000 7f0d93400640 1 -- 172.21.15.59:0/668805254 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+13142 (secure 0 0 0) 0x7f0d8c057310 con 0x7f0d9c072d00 2024-05-30T16:59:29.356 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:29.356 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":82,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:59:26.993306+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6837/1073059560":"2024-05-31T16:59:23.975296+0000","172.21.15.107:6835/1073059560":"2024-05-31T16:59:23.975296+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:59:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.356+0000 7f0da1800640 1 -- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0d780694f0 msgr2=0x7f0d7806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.356+0000 7f0da1800640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0d780694f0 0x7f0d7806b9b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c152f20 tx=0x7f0d84009040 comp rx=0 tx=0).stop 2024-05-30T16:59:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.356+0000 7f0da1800640 1 -- 172.21.15.59:0/668805254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d9c072d00 msgr2=0x7f0d9c15bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.356+0000 7f0da1800640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d9c072d00 0x7f0d9c15bad0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00e930 tx=0x7f0d8c00edf0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.356+0000 7f0da1800640 1 -- 172.21.15.59:0/668805254 shutdown_connections 2024-05-30T16:59:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.356+0000 7f0da1800640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0d780694f0 0x7f0d7806b9b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.356+0000 7f0da1800640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0d9c0b48f0 0x7f0d9c151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.356+0000 7f0da1800640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d9c0b4510 0x7f0d9c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.356+0000 7f0da1800640 1 --2- 172.21.15.59:0/668805254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d9c072d00 0x7f0d9c15bad0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.356+0000 7f0da1800640 1 -- 172.21.15.59:0/668805254 >> 172.21.15.59:0/668805254 conn(0x7f0d9c0b3240 msgr2=0x7f0d9c0b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:29.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.356+0000 7f0da1800640 1 -- 172.21.15.59:0/668805254 shutdown_connections 2024-05-30T16:59:29.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.356+0000 7f0da1800640 1 -- 172.21.15.59:0/668805254 wait complete. 2024-05-30T16:59:29.378 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T16:48:53.098546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T16:59:29.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T16:59:29.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.520+0000 7f6d5e000640 1 Processor -- start 2024-05-30T16:59:29.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d5e000640 1 -- start start 2024-05-30T16:59:29.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d5e000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d58141f20 0x7f6d5806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d5e000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d5806bce0 0x7f6d5806c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d5e000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d58163260 con 0x7f6d580c9e10 2024-05-30T16:59:29.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d5e000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6d581626e0 con 0x7f6d58141f20 2024-05-30T16:59:29.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d5e000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6d581629c0 con 0x7f6d5806bce0 2024-05-30T16:59:29.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d4fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d58141f20 0x7f6d5806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d4fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d58141f20 0x7f6d5806ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39248/0 (socket says 172.21.15.59:39248) 2024-05-30T16:59:29.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d4fe00640 1 -- 172.21.15.59:0/1686721733 learned_addr learned my addr 172.21.15.59:0/1686721733 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:29.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d57e00640 1 --2- 172.21.15.59:0/1686721733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d5806bce0 0x7f6d5806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d4fe00640 1 -- 172.21.15.59:0/1686721733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d5806bce0 msgr2=0x7f6d5806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:29.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d4fe00640 1 --2- 172.21.15.59:0/1686721733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d5806bce0 0x7f6d5806c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d4fe00640 1 -- 172.21.15.59:0/1686721733 >> v1:172.21.15.107:6789/0 conn(0x7f6d580c9e10 legacy=0x7f6d580ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.524+0000 7f6d4fe00640 1 -- 172.21.15.59:0/1686721733 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d58162ca0 con 0x7f6d58141f20 2024-05-30T16:59:29.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d4fe00640 1 --2- 172.21.15.59:0/1686721733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58141f20 0x7f6d5806ce90 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009870 tx=0x7f6d4001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb0dc1a95c4e4b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:29.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d56a00640 1 -- 172.21.15.59:0/1686721733 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d400b0070 con 0x7f6d58141f20 2024-05-30T16:59:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d56a00640 1 -- 172.21.15.59:0/1686721733 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d40004230 con 0x7f6d58141f20 2024-05-30T16:59:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d56a00640 1 -- 172.21.15.59:0/1686721733 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40003620 con 0x7f6d58141f20 2024-05-30T16:59:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d5e000640 1 -- 172.21.15.59:0/1686721733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58141f20 msgr2=0x7f6d5806ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d5e000640 1 --2- 172.21.15.59:0/1686721733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58141f20 0x7f6d5806ce90 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009870 tx=0x7f6d4001c440 comp rx=0 tx=0).stop 2024-05-30T16:59:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d5e000640 1 -- 172.21.15.59:0/1686721733 shutdown_connections 2024-05-30T16:59:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d5e000640 1 --2- 172.21.15.59:0/1686721733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d5806bce0 0x7f6d5806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d5e000640 1 --2- 172.21.15.59:0/1686721733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58141f20 0x7f6d5806ce90 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d5e000640 1 -- 172.21.15.59:0/1686721733 >> 172.21.15.59:0/1686721733 conn(0x7f6d580cd540 msgr2=0x7f6d580cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d5e000640 1 -- 172.21.15.59:0/1686721733 shutdown_connections 2024-05-30T16:59:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d5e000640 1 -- 172.21.15.59:0/1686721733 wait complete. 2024-05-30T16:59:29.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d5e000640 1 Processor -- start 2024-05-30T16:59:29.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.528+0000 7f6d5e000640 1 -- start start 2024-05-30T16:59:29.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d5e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d5806bce0 0x7f6d58146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d5e000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d580c9e10 0x7f6d581426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d5e000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d58141f20 0x7f6d5815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d5e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58162480 con 0x7f6d5806bce0 2024-05-30T16:59:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d5e000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58162300 con 0x7f6d58141f20 2024-05-30T16:59:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d5e000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6d580cd1d0 con 0x7f6d580c9e10 2024-05-30T16:59:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d57400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d5806bce0 0x7f6d58146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d57400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d5806bce0 0x7f6d58146ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39258/0 (socket says 172.21.15.59:39258) 2024-05-30T16:59:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d57400640 1 -- 172.21.15.59:0/2539936247 learned_addr learned my addr 172.21.15.59:0/2539936247 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d57e00640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d58141f20 0x7f6d5815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d4fe00640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d580c9e10 0x7f6d581426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d57400640 1 -- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d580c9e10 msgr2=0x7f6d581426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d57400640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d580c9e10 0x7f6d581426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d57400640 1 -- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d58141f20 msgr2=0x7f6d5815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d57400640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d58141f20 0x7f6d5815c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d57400640 1 -- 172.21.15.59:0/2539936247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5815d0e0 con 0x7f6d5806bce0 2024-05-30T16:59:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d57400640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d5806bce0 0x7f6d58146ac0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800c450 tx=0x7f6d4800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d4f400640 1 -- 172.21.15.59:0/2539936247 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48016020 con 0x7f6d5806bce0 2024-05-30T16:59:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d4f400640 1 -- 172.21.15.59:0/2539936247 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d480052d0 con 0x7f6d5806bce0 2024-05-30T16:59:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d5e000640 1 -- 172.21.15.59:0/2539936247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5815d3c0 con 0x7f6d5806bce0 2024-05-30T16:59:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d4f400640 1 -- 172.21.15.59:0/2539936247 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48007260 con 0x7f6d5806bce0 2024-05-30T16:59:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d5e000640 1 -- 172.21.15.59:0/2539936247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d5815d980 con 0x7f6d5806bce0 2024-05-30T16:59:29.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d5e000640 1 -- 172.21.15.59:0/2539936247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d58068a90 con 0x7f6d5806bce0 2024-05-30T16:59:29.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.532+0000 7f6d4f400640 1 -- 172.21.15.59:0/2539936247 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f6d48007400 con 0x7f6d5806bce0 2024-05-30T16:59:29.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.536+0000 7f6d4f400640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6d340694f0 0x7f6d3406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.536+0000 7f6d4f400640 1 -- 172.21.15.59:0/2539936247 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5027+0+0 (secure 0 0 0) 0x7f6d480852a0 con 0x7f6d5806bce0 2024-05-30T16:59:29.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.536+0000 7f6d4fe00640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6d340694f0 0x7f6d3406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.536+0000 7f6d4fe00640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6d340694f0 0x7f6d3406b9b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6d400ad000 tx=0x7f6d400a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:29.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.540+0000 7f6d4f400640 1 -- 172.21.15.59:0/2539936247 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6d48020020 con 0x7f6d5806bce0 2024-05-30T16:59:29.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 -- 172.21.15.59:0/2539936247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6d5806cc70 con 0x7f6d5806bce0 2024-05-30T16:59:29.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d4f400640 1 -- 172.21.15.59:0/2539936247 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f6d48005480 con 0x7f6d5806bce0 2024-05-30T16:59:29.710 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-05-30T16:59:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 -- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6d340694f0 msgr2=0x7f6d3406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6d340694f0 0x7f6d3406b9b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6d400ad000 tx=0x7f6d400a6000 comp rx=0 tx=0).stop 2024-05-30T16:59:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 -- 172.21.15.59:0/2539936247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d5806bce0 msgr2=0x7f6d58146ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d5806bce0 0x7f6d58146ac0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800c450 tx=0x7f6d4800c910 comp rx=0 tx=0).stop 2024-05-30T16:59:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 -- 172.21.15.59:0/2539936247 shutdown_connections 2024-05-30T16:59:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6d340694f0 0x7f6d3406b9b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d58141f20 0x7f6d5815c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d580c9e10 0x7f6d581426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 --2- 172.21.15.59:0/2539936247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d5806bce0 0x7f6d58146ac0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 -- 172.21.15.59:0/2539936247 >> 172.21.15.59:0/2539936247 conn(0x7f6d580cd540 msgr2=0x7f6d5813ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 -- 172.21.15.59:0/2539936247 shutdown_connections 2024-05-30T16:59:29.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.708+0000 7f6d5e000640 1 -- 172.21.15.59:0/2539936247 wait complete. 2024-05-30T16:59:29.732 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_stats_are_printed' 2024-05-30T16:59:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f17a7400640 1 Processor -- start 2024-05-30T16:59:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f17a7400640 1 -- start start 2024-05-30T16:59:29.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f17a7400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f17a00d14c0 0x7f17a006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f17a7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17a00d05b0 0x7f17a009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f17a7400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a006ea20 con 0x7f17a009af80 2024-05-30T16:59:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f17a7400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f17a009b3f0 con 0x7f17a00d05b0 2024-05-30T16:59:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f17a7400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f17a0070950 con 0x7f17a00d14c0 2024-05-30T16:59:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f179fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17a00d05b0 0x7f17a009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f179fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17a00d05b0 0x7f17a009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39274/0 (socket says 172.21.15.59:39274) 2024-05-30T16:59:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f179fe00640 1 -- 172.21.15.59:0/867801779 learned_addr learned my addr 172.21.15.59:0/867801779 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:29.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f17a4a00640 1 --2- 172.21.15.59:0/867801779 >> v2:172.21.15.107:3300/0 conn(0x7f17a00d14c0 0x7f17a006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f179fe00640 1 -- 172.21.15.59:0/867801779 >> v2:172.21.15.107:3300/0 conn(0x7f17a00d14c0 msgr2=0x7f17a006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:29.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f179fe00640 1 --2- 172.21.15.59:0/867801779 >> v2:172.21.15.107:3300/0 conn(0x7f17a00d14c0 0x7f17a006e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f179fe00640 1 -- 172.21.15.59:0/867801779 >> v1:172.21.15.107:6789/0 conn(0x7f17a009af80 legacy=0x7f17a0162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:29.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f179fe00640 1 -- 172.21.15.59:0/867801779 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a0070c30 con 0x7f17a00d05b0 2024-05-30T16:59:29.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.872+0000 7f17a4a00640 1 --2- 172.21.15.59:0/867801779 >> v2:172.21.15.107:3300/0 conn(0x7f17a00d14c0 0x7f17a006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:29.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f179fe00640 1 --2- 172.21.15.59:0/867801779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17a00d05b0 0x7f17a009aa40 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f17a00735d0 tx=0x7f178c01c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f665af2142069310 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:29.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f179f400640 1 -- 172.21.15.59:0/867801779 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c0b0070 con 0x7f17a00d05b0 2024-05-30T16:59:29.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f179f400640 1 -- 172.21.15.59:0/867801779 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f178c0ab600 con 0x7f17a00d05b0 2024-05-30T16:59:29.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f179f400640 1 -- 172.21.15.59:0/867801779 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c0ab9d0 con 0x7f17a00d05b0 2024-05-30T16:59:29.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f17a7400640 1 -- 172.21.15.59:0/867801779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17a00d05b0 msgr2=0x7f17a009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f17a7400640 1 --2- 172.21.15.59:0/867801779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17a00d05b0 0x7f17a009aa40 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f17a00735d0 tx=0x7f178c01c2d0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f17a7400640 1 -- 172.21.15.59:0/867801779 shutdown_connections 2024-05-30T16:59:29.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f17a7400640 1 --2- 172.21.15.59:0/867801779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17a00d05b0 0x7f17a009aa40 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f17a7400640 1 --2- 172.21.15.59:0/867801779 >> v2:172.21.15.107:3300/0 conn(0x7f17a00d14c0 0x7f17a006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f17a7400640 1 -- 172.21.15.59:0/867801779 >> 172.21.15.59:0/867801779 conn(0x7f17a00b3f80 msgr2=0x7f17a00b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:29.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f17a7400640 1 -- 172.21.15.59:0/867801779 shutdown_connections 2024-05-30T16:59:29.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f17a7400640 1 -- 172.21.15.59:0/867801779 wait complete. 2024-05-30T16:59:29.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f17a7400640 1 Processor -- start 2024-05-30T16:59:29.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.876+0000 7f17a7400640 1 -- start start 2024-05-30T16:59:29.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17a009af80 0x7f17a00ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a7400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17a00d05b0 0x7f17a009f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17a00d14c0 0x7f17a009d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a7400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f17a00d18a0 con 0x7f17a009af80 2024-05-30T16:59:29.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a7400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f17a00d0a60 con 0x7f17a00d14c0 2024-05-30T16:59:29.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a7400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f17a006e100 con 0x7f17a00d05b0 2024-05-30T16:59:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17a009af80 0x7f17a00ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17a009af80 0x7f17a00ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39278/0 (socket says 172.21.15.59:39278) 2024-05-30T16:59:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a4a00640 1 -- 172.21.15.59:0/620807654 learned_addr learned my addr 172.21.15.59:0/620807654 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a5400640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17a00d14c0 0x7f17a009d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f179fe00640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17a00d05b0 0x7f17a009f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a4a00640 1 -- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17a00d05b0 msgr2=0x7f17a009f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a4a00640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17a00d05b0 0x7f17a009f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a4a00640 1 -- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17a00d14c0 msgr2=0x7f17a009d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a4a00640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17a00d14c0 0x7f17a009d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a4a00640 1 -- 172.21.15.59:0/620807654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a015f9b0 con 0x7f17a009af80 2024-05-30T16:59:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a4a00640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17a009af80 0x7f17a00ce3f0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f179400c7c0 tx=0x7f179400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f179cc00640 1 -- 172.21.15.59:0/620807654 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17940079d0 con 0x7f17a009af80 2024-05-30T16:59:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f179cc00640 1 -- 172.21.15.59:0/620807654 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1794007b70 con 0x7f17a009af80 2024-05-30T16:59:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f179cc00640 1 -- 172.21.15.59:0/620807654 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17940113f0 con 0x7f17a009af80 2024-05-30T16:59:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a7400640 1 -- 172.21.15.59:0/620807654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a009ce10 con 0x7f17a009af80 2024-05-30T16:59:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a7400640 1 -- 172.21.15.59:0/620807654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a009d3d0 con 0x7f17a009af80 2024-05-30T16:59:29.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f17a7400640 1 -- 172.21.15.59:0/620807654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a0068a90 con 0x7f17a009af80 2024-05-30T16:59:29.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.880+0000 7f179cc00640 1 -- 172.21.15.59:0/620807654 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f1794011590 con 0x7f17a009af80 2024-05-30T16:59:29.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.884+0000 7f179cc00640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1780069520 0x7f178006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:29.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.884+0000 7f179cc00640 1 -- 172.21.15.59:0/620807654 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5027+0+0 (secure 0 0 0) 0x7f1794085a30 con 0x7f17a009af80 2024-05-30T16:59:29.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.884+0000 7f179fe00640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1780069520 0x7f178006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:29.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.884+0000 7f179fe00640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1780069520 0x7f178006b9e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f178c0ad000 tx=0x7f178c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:29.888+0000 7f179cc00640 1 -- 172.21.15.59:0/620807654 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1794015020 con 0x7f17a009af80 2024-05-30T16:59:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:30.112+0000 7f17a7400640 1 -- 172.21.15.59:0/620807654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_stats_are_printed"]} v 0) -- 0x7f17a0074a40 con 0x7f17a009af80 2024-05-30T16:59:31.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.004+0000 7f179cc00640 1 -- 172.21.15.59:0/620807654 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_stats_are_printed"]}]=0 v477) ==== 156+0+0 (secure 0 0 0) 0x7f17940576f0 con 0x7f17a009af80 2024-05-30T16:59:31.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.008+0000 7f17a7400640 1 -- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1780069520 msgr2=0x7f178006b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.008+0000 7f17a7400640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1780069520 0x7f178006b9e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f178c0ad000 tx=0x7f178c008040 comp rx=0 tx=0).stop 2024-05-30T16:59:31.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.008+0000 7f17a7400640 1 -- 172.21.15.59:0/620807654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17a009af80 msgr2=0x7f17a00ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.008+0000 7f17a7400640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17a009af80 0x7f17a00ce3f0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f179400c7c0 tx=0x7f179400cc80 comp rx=0 tx=0).stop 2024-05-30T16:59:31.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.008+0000 7f17a7400640 1 -- 172.21.15.59:0/620807654 shutdown_connections 2024-05-30T16:59:31.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.008+0000 7f17a7400640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1780069520 0x7f178006b9e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.008+0000 7f17a7400640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17a00d14c0 0x7f17a009d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.008+0000 7f17a7400640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17a00d05b0 0x7f17a009f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.008+0000 7f17a7400640 1 --2- 172.21.15.59:0/620807654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17a009af80 0x7f17a00ce3f0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.008+0000 7f17a7400640 1 -- 172.21.15.59:0/620807654 >> 172.21.15.59:0/620807654 conn(0x7f17a00b3f80 msgr2=0x7f17a00ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:31.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.008+0000 7f17a7400640 1 -- 172.21.15.59:0/620807654 shutdown_connections 2024-05-30T16:59:31.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.008+0000 7f17a7400640 1 -- 172.21.15.59:0/620807654 wait complete. 2024-05-30T16:59:31.034 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:59:31.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.180+0000 7fbbe2400640 1 Processor -- start 2024-05-30T16:59:31.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.180+0000 7fbbe2400640 1 -- start start 2024-05-30T16:59:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.180+0000 7fbbe2400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbdc15c010 0x7fbbdc15c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.180+0000 7fbbe2400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbdc0b52d0 con 0x7fbbdc159100 2024-05-30T16:59:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.180+0000 7fbbe2400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbdc0b4a30 con 0x7fbbdc0b44e0 2024-05-30T16:59:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.180+0000 7fbbe2400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbbdc0b4d10 con 0x7fbbdc15c010 2024-05-30T16:59:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.180+0000 7fbbdb400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbbdc159100 0x7fbbdc06e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54862/0 (socket says 172.21.15.59:54862) 2024-05-30T16:59:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.180+0000 7fbbdb400640 1 -- 172.21.15.59:0/1425856888 learned_addr learned my addr 172.21.15.59:0/1425856888 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.180+0000 7fbbdbe00640 1 --2- 172.21.15.59:0/1425856888 >> v2:172.21.15.59:3300/0 conn(0x7fbbdc15c010 0x7fbbdc15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbdaa00640 1 -- 172.21.15.59:0/1425856888 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150613873 0 0) 0x7fbbdc0b52d0 con 0x7fbbdc159100 2024-05-30T16:59:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbdaa00640 1 -- 172.21.15.59:0/1425856888 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbc0003530 con 0x7fbbdc159100 2024-05-30T16:59:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbdbe00640 1 -- 172.21.15.59:0/1425856888 >> v1:172.21.15.107:6789/0 conn(0x7fbbdc0b44e0 legacy=0x7fbbdc15efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbdbe00640 1 -- 172.21.15.59:0/1425856888 >> v1:172.21.15.59:6789/0 conn(0x7fbbdc159100 legacy=0x7fbbdc06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbdbe00640 1 -- 172.21.15.59:0/1425856888 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbdc0b4ff0 con 0x7fbbdc15c010 2024-05-30T16:59:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbdbe00640 1 --2- 172.21.15.59:0/1425856888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc15c010 0x7fbbdc15c440 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40097c0 tx=0x7fbbd401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97172fe90a3a7ae0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbdaa00640 1 -- 172.21.15.59:0/1425856888 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40b0070 con 0x7fbbdc15c010 2024-05-30T16:59:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbdaa00640 1 -- 172.21.15.59:0/1425856888 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd40ab600 con 0x7fbbdc15c010 2024-05-30T16:59:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbdaa00640 1 -- 172.21.15.59:0/1425856888 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40ab9d0 con 0x7fbbdc15c010 2024-05-30T16:59:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbe2400640 1 -- 172.21.15.59:0/1425856888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc15c010 msgr2=0x7fbbdc15c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbe2400640 1 --2- 172.21.15.59:0/1425856888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc15c010 0x7fbbdc15c440 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40097c0 tx=0x7fbbd401c410 comp rx=0 tx=0).stop 2024-05-30T16:59:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbe2400640 1 -- 172.21.15.59:0/1425856888 shutdown_connections 2024-05-30T16:59:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbe2400640 1 --2- 172.21.15.59:0/1425856888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc15c010 0x7fbbdc15c440 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.184+0000 7fbbe2400640 1 -- 172.21.15.59:0/1425856888 >> 172.21.15.59:0/1425856888 conn(0x7fbbdc06bdb0 msgr2=0x7fbbdc06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbe2400640 1 -- 172.21.15.59:0/1425856888 shutdown_connections 2024-05-30T16:59:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbe2400640 1 -- 172.21.15.59:0/1425856888 wait complete. 2024-05-30T16:59:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbe2400640 1 Processor -- start 2024-05-30T16:59:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbe2400640 1 -- start start 2024-05-30T16:59:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbe2400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbdc0b44e0 0x7fbbdc159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbe2400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbdc159100 0x7fbbdc0b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbe2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc15c010 0x7fbbdc1fb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbe2400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc1694e0 con 0x7fbbdc15c010 2024-05-30T16:59:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbe2400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc169360 con 0x7fbbdc0b44e0 2024-05-30T16:59:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbe2400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbbdc169660 con 0x7fbbdc159100 2024-05-30T16:59:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbdbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc15c010 0x7fbbdc1fb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbdbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc15c010 0x7fbbdc1fb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39298/0 (socket says 172.21.15.59:39298) 2024-05-30T16:59:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbdbe00640 1 -- 172.21.15.59:0/1357436315 learned_addr learned my addr 172.21.15.59:0/1357436315 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbdb400640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbdc0b44e0 0x7fbbdc159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbd2a00640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbdc159100 0x7fbbdc0b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbdbe00640 1 -- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbdc159100 msgr2=0x7fbbdc0b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbdbe00640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbdc159100 0x7fbbdc0b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbdbe00640 1 -- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbdc0b44e0 msgr2=0x7fbbdc159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbdbe00640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbdc0b44e0 0x7fbbdc159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbdbe00640 1 -- 172.21.15.59:0/1357436315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbdc15a590 con 0x7fbbdc15c010 2024-05-30T16:59:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbdbe00640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc15c010 0x7fbbdc1fb810 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4019020 tx=0x7fbbd40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.188+0000 7fbbd3e00640 1 -- 172.21.15.59:0/1357436315 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40abe60 con 0x7fbbdc15c010 2024-05-30T16:59:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.192+0000 7fbbd3e00640 1 -- 172.21.15.59:0/1357436315 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd40b9070 con 0x7fbbdc15c010 2024-05-30T16:59:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.192+0000 7fbbd3e00640 1 -- 172.21.15.59:0/1357436315 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40b0040 con 0x7fbbdc15c010 2024-05-30T16:59:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.192+0000 7fbbe2400640 1 -- 172.21.15.59:0/1357436315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbdc0b1b60 con 0x7fbbdc15c010 2024-05-30T16:59:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.192+0000 7fbbe2400640 1 -- 172.21.15.59:0/1357436315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbdc0b2120 con 0x7fbbdc15c010 2024-05-30T16:59:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.192+0000 7fbbe2400640 1 -- 172.21.15.59:0/1357436315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbdc0b1950 con 0x7fbbdc15c010 2024-05-30T16:59:31.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.192+0000 7fbbd3e00640 1 -- 172.21.15.59:0/1357436315 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fbbd40b4650 con 0x7fbbdc15c010 2024-05-30T16:59:31.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.192+0000 7fbbd3e00640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbbb8069520 0x7fbbb806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:31.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.192+0000 7fbbd3e00640 1 -- 172.21.15.59:0/1357436315 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5027+0+0 (secure 0 0 0) 0x7fbbd411f310 con 0x7fbbdc15c010 2024-05-30T16:59:31.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.192+0000 7fbbdb400640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbbb8069520 0x7fbbb806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:31.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.196+0000 7fbbdb400640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbbb8069520 0x7fbbb806b9e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc001570 tx=0x7fbbcc001aa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.196+0000 7fbbd3e00640 1 -- 172.21.15.59:0/1357436315 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbbd4016090 con 0x7fbbdc15c010 2024-05-30T16:59:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.364+0000 7fbbe2400640 1 -- 172.21.15.59:0/1357436315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbbdc068a90 con 0x7fbbdc15c010 2024-05-30T16:59:31.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.364+0000 7fbbd3e00640 1 -- 172.21.15.59:0/1357436315 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fbbd40f0980 con 0x7fbbdc15c010 2024-05-30T16:59:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.368+0000 7fbbe2400640 1 -- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbbb8069520 msgr2=0x7fbbb806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.368+0000 7fbbe2400640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbbb8069520 0x7fbbb806b9e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc001570 tx=0x7fbbcc001aa0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.368+0000 7fbbe2400640 1 -- 172.21.15.59:0/1357436315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc15c010 msgr2=0x7fbbdc1fb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.368+0000 7fbbe2400640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc15c010 0x7fbbdc1fb810 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4019020 tx=0x7fbbd40191b0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.368+0000 7fbbe2400640 1 -- 172.21.15.59:0/1357436315 shutdown_connections 2024-05-30T16:59:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.368+0000 7fbbe2400640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbbb8069520 0x7fbbb806b9e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.368+0000 7fbbe2400640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc15c010 0x7fbbdc1fb810 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.368+0000 7fbbe2400640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbdc159100 0x7fbbdc0b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.368+0000 7fbbe2400640 1 --2- 172.21.15.59:0/1357436315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbdc0b44e0 0x7fbbdc159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.368+0000 7fbbe2400640 1 -- 172.21.15.59:0/1357436315 >> 172.21.15.59:0/1357436315 conn(0x7fbbdc06bdb0 msgr2=0x7fbbdc06e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.368+0000 7fbbe2400640 1 -- 172.21.15.59:0/1357436315 shutdown_connections 2024-05-30T16:59:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.368+0000 7fbbe2400640 1 -- 172.21.15.59:0/1357436315 wait complete. 2024-05-30T16:59:31.389 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:59:31.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:59:31.474 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:59:31.552 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:59:31.552 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:59:31.553 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:59:31.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:59:31.562 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:59:31.562 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:59:31.571 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:59:31.571 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:59:31.571 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:59:31.611 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:59:31.612 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T16:59:31.612 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:59:31.621 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:59:31.621 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T16:59:31.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:59:31.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13be200640 1 Processor -- start 2024-05-30T16:59:31.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13be200640 1 -- start start 2024-05-30T16:59:31.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13be200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f13b815c590 0x7f13b80aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:31.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13be200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13b806c9c0 0x7f13b806ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:31.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13be200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13b806f3b0 con 0x7f13b806ef50 2024-05-30T16:59:31.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13be200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f13b81606a0 con 0x7f13b815c590 2024-05-30T16:59:31.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13be200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f13b80afab0 con 0x7f13b806c9c0 2024-05-30T16:59:31.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13b7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f13b815c590 0x7f13b80aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:31.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13b7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f13b815c590 0x7f13b80aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39308/0 (socket says 172.21.15.59:39308) 2024-05-30T16:59:31.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13b7400640 1 -- 172.21.15.59:0/1550168395 learned_addr learned my addr 172.21.15.59:0/1550168395 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:31.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13b7e00640 1 --2- 172.21.15.59:0/1550168395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13b806c9c0 0x7f13b806ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:31.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13b7400640 1 -- 172.21.15.59:0/1550168395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13b806c9c0 msgr2=0x7f13b806ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:31.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13b7400640 1 --2- 172.21.15.59:0/1550168395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13b806c9c0 0x7f13b806ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13b7400640 1 -- 172.21.15.59:0/1550168395 >> v1:172.21.15.107:6789/0 conn(0x7f13b806ef50 legacy=0x7f13b8160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.796+0000 7f13b7400640 1 -- 172.21.15.59:0/1550168395 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b80af4f0 con 0x7f13b815c590 2024-05-30T16:59:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.800+0000 7f13b7400640 1 --2- 172.21.15.59:0/1550168395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13b815c590 0x7f13b80aedc0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009870 tx=0x7f13a801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f14b27f33586a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:31.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.800+0000 7f13b6a00640 1 -- 172.21.15.59:0/1550168395 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a80b2070 con 0x7f13b815c590 2024-05-30T16:59:31.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.800+0000 7f13b6a00640 1 -- 172.21.15.59:0/1550168395 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13a80a9070 con 0x7f13b815c590 2024-05-30T16:59:31.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.800+0000 7f13b6a00640 1 -- 172.21.15.59:0/1550168395 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a80ad880 con 0x7f13b815c590 2024-05-30T16:59:31.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.800+0000 7f13be200640 1 -- 172.21.15.59:0/1550168395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13b815c590 msgr2=0x7f13b80aedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.800+0000 7f13be200640 1 --2- 172.21.15.59:0/1550168395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13b815c590 0x7f13b80aedc0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009870 tx=0x7f13a801c560 comp rx=0 tx=0).stop 2024-05-30T16:59:31.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.800+0000 7f13be200640 1 -- 172.21.15.59:0/1550168395 shutdown_connections 2024-05-30T16:59:31.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.800+0000 7f13be200640 1 --2- 172.21.15.59:0/1550168395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13b806c9c0 0x7f13b806ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.800+0000 7f13be200640 1 --2- 172.21.15.59:0/1550168395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13b815c590 0x7f13b80aedc0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.800+0000 7f13be200640 1 -- 172.21.15.59:0/1550168395 >> 172.21.15.59:0/1550168395 conn(0x7f13b8072610 msgr2=0x7f13b8072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:31.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.800+0000 7f13be200640 1 -- 172.21.15.59:0/1550168395 shutdown_connections 2024-05-30T16:59:31.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.800+0000 7f13be200640 1 -- 172.21.15.59:0/1550168395 wait complete. 2024-05-30T16:59:31.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13be200640 1 Processor -- start 2024-05-30T16:59:31.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13be200640 1 -- start start 2024-05-30T16:59:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13be200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13b806c9c0 0x7f13b814dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13be200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13b806ef50 0x7f13b814bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13be200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13b815c590 0x7f13b8156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13be200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f13b80ce760 con 0x7f13b806ef50 2024-05-30T16:59:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13be200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f13b80ce5e0 con 0x7f13b815c590 2024-05-30T16:59:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13be200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f13b80ce8e0 con 0x7f13b806c9c0 2024-05-30T16:59:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13b806ef50 0x7f13b814bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13b806ef50 0x7f13b814bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39324/0 (socket says 172.21.15.59:39324) 2024-05-30T16:59:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13afe00640 1 -- 172.21.15.59:0/3876051675 learned_addr learned my addr 172.21.15.59:0/3876051675 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13b7e00640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13b815c590 0x7f13b8156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13b7400640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13b806c9c0 0x7f13b814dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:31.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13afe00640 1 -- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13b806c9c0 msgr2=0x7f13b814dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13afe00640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13b806c9c0 0x7f13b814dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13afe00640 1 -- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13b815c590 msgr2=0x7f13b8156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:31.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13afe00640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13b815c590 0x7f13b8156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:31.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13afe00640 1 -- 172.21.15.59:0/3876051675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b815cc20 con 0x7f13b806ef50 2024-05-30T16:59:31.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13afe00640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13b806ef50 0x7f13b814bc90 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c370 tx=0x7f13a000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:31.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13af400640 1 -- 172.21.15.59:0/3876051675 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a00052d0 con 0x7f13b806ef50 2024-05-30T16:59:31.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13af400640 1 -- 172.21.15.59:0/3876051675 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13a0005470 con 0x7f13b806ef50 2024-05-30T16:59:31.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13af400640 1 -- 172.21.15.59:0/3876051675 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0007260 con 0x7f13b806ef50 2024-05-30T16:59:31.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13be200640 1 -- 172.21.15.59:0/3876051675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b815cf00 con 0x7f13b806ef50 2024-05-30T16:59:31.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.804+0000 7f13be200640 1 -- 172.21.15.59:0/3876051675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b815d4c0 con 0x7f13b806ef50 2024-05-30T16:59:31.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.808+0000 7f13be200640 1 -- 172.21.15.59:0/3876051675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b8068a90 con 0x7f13b806ef50 2024-05-30T16:59:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.808+0000 7f13af400640 1 -- 172.21.15.59:0/3876051675 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f13a0007400 con 0x7f13b806ef50 2024-05-30T16:59:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.808+0000 7f13af400640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13940694f0 0x7f139406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:31.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.808+0000 7f13af400640 1 -- 172.21.15.59:0/3876051675 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5027+0+0 (secure 0 0 0) 0x7f13a0084c70 con 0x7f13b806ef50 2024-05-30T16:59:31.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.808+0000 7f13b7400640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13940694f0 0x7f139406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:31.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.808+0000 7f13b7400640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13940694f0 0x7f139406b9b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f13a80af000 tx=0x7f13a80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:31.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:31.812+0000 7f13af400640 1 -- 172.21.15.59:0/3876051675 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f13a00562e0 con 0x7f13b806ef50 2024-05-30T16:59:32.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.012+0000 7f13be200640 1 -- 172.21.15.59:0/3876051675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13b80736f0 con 0x7f13b806ef50 2024-05-30T16:59:32.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.012+0000 7f13af400640 1 -- 172.21.15.59:0/3876051675 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+3872 (secure 0 0 0) 0x7f13a005a5e0 con 0x7f13b806ef50 2024-05-30T16:59:32.015 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:32.016 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/594481957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":594481957},{"type":"v1","addr":"172.21.15.107:6837","nonce":594481957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1624622774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1624622774},{"type":"v1","addr":"172.21.15.59:6835","nonce":1624622774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2200377252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2200377252},{"type":"v1","addr":"172.21.15.59:6834","nonce":2200377252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1151212671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1151212671},{"type":"v1","addr":"172.21.15.107:6836","nonce":1151212671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[]} 2024-05-30T16:59:32.016 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 45 2024-05-30T16:59:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.016+0000 7f13be200640 1 -- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13940694f0 msgr2=0x7f139406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.016+0000 7f13be200640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13940694f0 0x7f139406b9b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f13a80af000 tx=0x7f13a80a7000 comp rx=0 tx=0).stop 2024-05-30T16:59:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.016+0000 7f13be200640 1 -- 172.21.15.59:0/3876051675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13b806ef50 msgr2=0x7f13b814bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.016+0000 7f13be200640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13b806ef50 0x7f13b814bc90 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c370 tx=0x7f13a000c830 comp rx=0 tx=0).stop 2024-05-30T16:59:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.016+0000 7f13be200640 1 -- 172.21.15.59:0/3876051675 shutdown_connections 2024-05-30T16:59:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.016+0000 7f13be200640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13940694f0 0x7f139406b9b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.016+0000 7f13be200640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13b815c590 0x7f13b8156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.016+0000 7f13be200640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13b806ef50 0x7f13b814bc90 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.016+0000 7f13be200640 1 --2- 172.21.15.59:0/3876051675 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13b806c9c0 0x7f13b814dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.016+0000 7f13be200640 1 -- 172.21.15.59:0/3876051675 >> 172.21.15.59:0/3876051675 conn(0x7f13b8072610 msgr2=0x7f13b80b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:32.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.016+0000 7f13be200640 1 -- 172.21.15.59:0/3876051675 shutdown_connections 2024-05-30T16:59:32.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.016+0000 7f13be200640 1 -- 172.21.15.59:0/3876051675 wait complete. 2024-05-30T16:59:32.037 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T16:59:32.038 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T16:59:32.038 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T16:59:32.038 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:59:32.038 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T16:59:32.038 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T16:59:32.038 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T16:59:32.039 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:59:32.039 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T16:59:32.039 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T16:59:32.039 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T16:59:32.039 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:59:32.039 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T16:59:32.039 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T16:59:32.040 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T16:59:32.040 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:59:32.053 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T16:59:32.053 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T16:59:32.054 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T16:59:32.054 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T16:59:32.055 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T16:59:32.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T16:59:32.056 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T16:59:32.056 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T16:59:32.102 INFO:tasks.ceph.mds.c:Started 2024-05-30T16:59:32.103 DEBUG:teuthology.parallel:result is None 2024-05-30T16:59:32.104 INFO:tasks.ceph.mds.a:Started 2024-05-30T16:59:32.104 DEBUG:teuthology.parallel:result is None 2024-05-30T16:59:32.105 INFO:tasks.ceph.mds.b:Started 2024-05-30T16:59:32.105 DEBUG:teuthology.parallel:result is None 2024-05-30T16:59:32.106 INFO:tasks.ceph.mds.d:Started 2024-05-30T16:59:32.106 DEBUG:teuthology.parallel:result is None 2024-05-30T16:59:32.106 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T16:59:32.190 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-05-30T16:59:32.191 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T16:59:32.196 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-30T16:59:32.196 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-30T16:59:32.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.248+0000 7f375fc00640 1 Processor -- start 2024-05-30T16:59:32.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.248+0000 7f375fc00640 1 -- start start 2024-05-30T16:59:32.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f375fc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f375806e900 0x7f375815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:32.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f375fc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37580d0560 0x7f37580d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:32.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f375fc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f375815f060 con 0x7f37580af720 2024-05-30T16:59:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f375fc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f37580afb00 con 0x7f37580d0560 2024-05-30T16:59:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f375fc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f375815c270 con 0x7f375806e900 2024-05-30T16:59:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f375dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37580d0560 0x7f37580d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f375d200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f37580af720 0x7f375815b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56724/0 (socket says 172.21.15.59:56724) 2024-05-30T16:59:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f375d200640 1 -- 172.21.15.59:0/3050236241 learned_addr learned my addr 172.21.15.59:0/3050236241 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f3757e00640 1 --2- 172.21.15.59:0/3050236241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f375806e900 0x7f375815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f375dc00640 1 -- 172.21.15.59:0/3050236241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f375806e900 msgr2=0x7f375815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f375dc00640 1 --2- 172.21.15.59:0/3050236241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f375806e900 0x7f375815f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f375dc00640 1 -- 172.21.15.59:0/3050236241 >> v1:172.21.15.59:6789/0 conn(0x7f37580af720 legacy=0x7f375815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f375dc00640 1 -- 172.21.15.59:0/3050236241 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375815c550 con 0x7f37580d0560 2024-05-30T16:59:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.252+0000 7f3757400640 1 -- 172.21.15.59:0/3050236241 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819937207 0 0) 0x7f375815f060 con 0x7f37580af720 2024-05-30T16:59:32.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f375dc00640 1 --2- 172.21.15.59:0/3050236241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37580d0560 0x7f37580d0a10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f3750009d90 tx=0x7f375001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9a7a3a453459fd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:32.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f3757400640 1 -- 172.21.15.59:0/3050236241 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37500b2070 con 0x7f37580d0560 2024-05-30T16:59:32.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f3757400640 1 -- 172.21.15.59:0/3050236241 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37500a5880 con 0x7f37580d0560 2024-05-30T16:59:32.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f3757400640 1 -- 172.21.15.59:0/3050236241 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37500a5c50 con 0x7f37580d0560 2024-05-30T16:59:32.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f375fc00640 1 -- 172.21.15.59:0/3050236241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37580d0560 msgr2=0x7f37580d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:32.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f375fc00640 1 --2- 172.21.15.59:0/3050236241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37580d0560 0x7f37580d0a10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f3750009d90 tx=0x7f375001c970 comp rx=0 tx=0).stop 2024-05-30T16:59:32.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f375fc00640 1 -- 172.21.15.59:0/3050236241 shutdown_connections 2024-05-30T16:59:32.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f375fc00640 1 --2- 172.21.15.59:0/3050236241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37580d0560 0x7f37580d0a10 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:32.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f375fc00640 1 --2- 172.21.15.59:0/3050236241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f375806e900 0x7f375815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:32.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f375fc00640 1 -- 172.21.15.59:0/3050236241 >> 172.21.15.59:0/3050236241 conn(0x7f37580b22d0 msgr2=0x7f37580b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:32.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f375fc00640 1 -- 172.21.15.59:0/3050236241 shutdown_connections 2024-05-30T16:59:32.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f375fc00640 1 -- 172.21.15.59:0/3050236241 wait complete. 2024-05-30T16:59:32.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f375fc00640 1 Processor -- start 2024-05-30T16:59:32.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.256+0000 7f375fc00640 1 -- start start 2024-05-30T16:59:32.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375fc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f375806e900 0x7f375815e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:32.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375fc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37580af720 0x7f3758165060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:32.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375fc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37580d0560 0x7f3758148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:32.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375fc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3758073150 con 0x7f37580d0560 2024-05-30T16:59:32.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375fc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f37580732d0 con 0x7f375806e900 2024-05-30T16:59:32.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375fc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f37581585c0 con 0x7f37580af720 2024-05-30T16:59:32.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37580d0560 0x7f3758148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:32.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37580d0560 0x7f3758148500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37852/0 (socket says 172.21.15.59:37852) 2024-05-30T16:59:32.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375dc00640 1 -- 172.21.15.59:0/2974170491 learned_addr learned my addr 172.21.15.59:0/2974170491 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:32.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375d200640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f375806e900 0x7f375815e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:32.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f3757e00640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37580af720 0x7f3758165060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:32.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375dc00640 1 -- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37580af720 msgr2=0x7f3758165060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:32.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375dc00640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37580af720 0x7f3758165060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:32.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375dc00640 1 -- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f375806e900 msgr2=0x7f375815e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:32.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375dc00640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f375806e900 0x7f375815e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:32.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375dc00640 1 -- 172.21.15.59:0/2974170491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375815e540 con 0x7f37580d0560 2024-05-30T16:59:32.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375d200640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f375806e900 0x7f375815e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:32.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375dc00640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37580d0560 0x7f3758148500 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f37500b0040 tx=0x7f3750019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:32.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f3754c00640 1 -- 172.21.15.59:0/2974170491 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37500b2040 con 0x7f37580d0560 2024-05-30T16:59:32.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f3754c00640 1 -- 172.21.15.59:0/2974170491 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37500b8470 con 0x7f37580d0560 2024-05-30T16:59:32.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f3754c00640 1 -- 172.21.15.59:0/2974170491 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37500b8820 con 0x7f37580d0560 2024-05-30T16:59:32.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375fc00640 1 -- 172.21.15.59:0/2974170491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375815eac0 con 0x7f37580d0560 2024-05-30T16:59:32.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375fc00640 1 -- 172.21.15.59:0/2974170491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3758164580 con 0x7f37580d0560 2024-05-30T16:59:32.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f375fc00640 1 -- 172.21.15.59:0/2974170491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3758068a90 con 0x7f37580d0560 2024-05-30T16:59:32.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.260+0000 7f3754c00640 1 -- 172.21.15.59:0/2974170491 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f37500c1020 con 0x7f37580d0560 2024-05-30T16:59:32.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.264+0000 7f3754c00640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f37380694f0 0x7f373806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:32.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.264+0000 7f3754c00640 1 -- 172.21.15.59:0/2974170491 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5027+0+0 (secure 0 0 0) 0x7f37501201e0 con 0x7f37580d0560 2024-05-30T16:59:32.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.264+0000 7f375d200640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f37380694f0 0x7f373806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:32.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.264+0000 7f375d200640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f37380694f0 0x7f373806b9b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f374c007fd0 tx=0x7f374c007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:32.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.268+0000 7f3754c00640 1 -- 172.21.15.59:0/2974170491 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3750016560 con 0x7f37580d0560 2024-05-30T16:59:32.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:32.444+0000 7f375fc00640 1 -- 172.21.15.59:0/2974170491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f375815f890 con 0x7f37580d0560 2024-05-30T16:59:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.020+0000 7f3754c00640 1 -- 172.21.15.59:0/2974170491 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v84) ==== 97+0+0 (secure 0 0 0) 0x7f37500f1ea0 con 0x7f37580d0560 2024-05-30T16:59:33.024 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-05-30T16:59:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.024+0000 7f375fc00640 1 -- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f37380694f0 msgr2=0x7f373806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.024+0000 7f375fc00640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f37380694f0 0x7f373806b9b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f374c007fd0 tx=0x7f374c007c20 comp rx=0 tx=0).stop 2024-05-30T16:59:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.024+0000 7f375fc00640 1 -- 172.21.15.59:0/2974170491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37580d0560 msgr2=0x7f3758148500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.024+0000 7f375fc00640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37580d0560 0x7f3758148500 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f37500b0040 tx=0x7f3750019710 comp rx=0 tx=0).stop 2024-05-30T16:59:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.024+0000 7f375fc00640 1 -- 172.21.15.59:0/2974170491 shutdown_connections 2024-05-30T16:59:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.024+0000 7f375fc00640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f37380694f0 0x7f373806b9b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.024+0000 7f375fc00640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37580d0560 0x7f3758148500 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.024+0000 7f375fc00640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37580af720 0x7f3758165060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.024+0000 7f375fc00640 1 --2- 172.21.15.59:0/2974170491 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f375806e900 0x7f375815e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.024+0000 7f375fc00640 1 -- 172.21.15.59:0/2974170491 >> 172.21.15.59:0/2974170491 conn(0x7f37580b22d0 msgr2=0x7f37580b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.024+0000 7f375fc00640 1 -- 172.21.15.59:0/2974170491 shutdown_connections 2024-05-30T16:59:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.024+0000 7f375fc00640 1 -- 172.21.15.59:0/2974170491 wait complete. 2024-05-30T16:59:33.053 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T16:59:33.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.196+0000 7fba5ce00640 1 Processor -- start 2024-05-30T16:59:33.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.196+0000 7fba5ce00640 1 -- start start 2024-05-30T16:59:33.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba5ce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba580cfa40 0x7fba5815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba5ce00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5815f3b0 con 0x7fba58073bb0 2024-05-30T16:59:33.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba5ce00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5815f690 con 0x7fba580cfe20 2024-05-30T16:59:33.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba5ce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fba5815f970 con 0x7fba580cfa40 2024-05-30T16:59:33.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba56800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fba58073bb0 0x7fba58072060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56736/0 (socket says 172.21.15.59:56736) 2024-05-30T16:59:33.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba56800640 1 -- 172.21.15.59:0/3713496305 learned_addr learned my addr 172.21.15.59:0/3713496305 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:33.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4170596554 0 0) 0x7fba5815f3b0 con 0x7fba58073bb0 2024-05-30T16:59:33.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55e00640 1 --2- 172.21.15.59:0/3713496305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba580cfa40 0x7fba5815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba3c003530 con 0x7fba58073bb0 2024-05-30T16:59:33.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1651545846 0 0) 0x7fba3c003530 con 0x7fba58073bb0 2024-05-30T16:59:33.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba580cfa40 msgr2=0x7fba5815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:33.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 --2- 172.21.15.59:0/3713496305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba580cfa40 0x7fba5815ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 >> v1:172.21.15.107:6789/0 conn(0x7fba580cfe20 legacy=0x7fba580b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba580b3370 con 0x7fba58073bb0 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fba50001680 con 0x7fba58073bb0 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 >> v1:172.21.15.59:6789/0 conn(0x7fba58073bb0 legacy=0x7fba58072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 --2- 172.21.15.59:0/3713496305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba3c0039f0 0x7fba3c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 --2- 172.21.15.59:0/3713496305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba3c004810 0x7fba3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 --2- 172.21.15.59:0/3713496305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba580cfa40 0x7fba3c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fba5815f970 con 0x7fba3c0039f0 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c00ba80 con 0x7fba3c004810 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fba3c00bc80 con 0x7fba580cfa40 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55e00640 1 --2- 172.21.15.59:0/3713496305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba3c0039f0 0x7fba3c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba4d400640 1 --2- 172.21.15.59:0/3713496305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba3c004810 0x7fba3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba56800640 1 --2- 172.21.15.59:0/3713496305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba580cfa40 0x7fba3c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55e00640 1 -- 172.21.15.59:0/3713496305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba580cfa40 msgr2=0x7fba3c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55e00640 1 --2- 172.21.15.59:0/3713496305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba580cfa40 0x7fba3c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55e00640 1 -- 172.21.15.59:0/3713496305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba3c004810 msgr2=0x7fba3c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:33.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55e00640 1 --2- 172.21.15.59:0/3713496305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba3c004810 0x7fba3c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.200+0000 7fba55e00640 1 -- 172.21.15.59:0/3713496305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c003530 con 0x7fba3c0039f0 2024-05-30T16:59:33.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.204+0000 7fba55e00640 1 --2- 172.21.15.59:0/3713496305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba3c0039f0 0x7fba3c003e10 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fba48009ab0 tx=0x7fba4801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f887cff1575d66 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:33.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.204+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba480096b0 con 0x7fba3c0039f0 2024-05-30T16:59:33.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.204+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba480a64e0 con 0x7fba3c0039f0 2024-05-30T16:59:33.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.204+0000 7fba55400640 1 -- 172.21.15.59:0/3713496305 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba480a68d0 con 0x7fba3c0039f0 2024-05-30T16:59:33.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.204+0000 7fba5ce00640 1 -- 172.21.15.59:0/3713496305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba3c0039f0 msgr2=0x7fba3c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.204+0000 7fba5ce00640 1 --2- 172.21.15.59:0/3713496305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba3c0039f0 0x7fba3c003e10 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fba48009ab0 tx=0x7fba4801ca30 comp rx=0 tx=0).stop 2024-05-30T16:59:33.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.204+0000 7fba56800640 1 -- 172.21.15.59:0/3713496305 reap_dead start 2024-05-30T16:59:33.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.204+0000 7fba5ce00640 1 -- 172.21.15.59:0/3713496305 shutdown_connections 2024-05-30T16:59:33.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.204+0000 7fba5ce00640 1 -- 172.21.15.59:0/3713496305 >> 172.21.15.59:0/3713496305 conn(0x7fba580b22d0 msgr2=0x7fba580b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:33.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.204+0000 7fba5ce00640 1 -- 172.21.15.59:0/3713496305 shutdown_connections 2024-05-30T16:59:33.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.204+0000 7fba5ce00640 1 -- 172.21.15.59:0/3713496305 wait complete. 2024-05-30T16:59:33.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba5ce00640 1 Processor -- start 2024-05-30T16:59:33.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba5ce00640 1 -- start start 2024-05-30T16:59:33.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba5ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba3c0039f0 0x7fba58157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba5ce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba580995c0 0x7fba58072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba5ce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba58099a40 0x7fba58072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba5ce00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fba580728f0 con 0x7fba3c0039f0 2024-05-30T16:59:33.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba5ce00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fba58072770 con 0x7fba580995c0 2024-05-30T16:59:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba5ce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fba58154e40 con 0x7fba58099a40 2024-05-30T16:59:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba55e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba3c0039f0 0x7fba58157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba55e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba3c0039f0 0x7fba58157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37880/0 (socket says 172.21.15.59:37880) 2024-05-30T16:59:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba55e00640 1 -- 172.21.15.59:0/1595095905 learned_addr learned my addr 172.21.15.59:0/1595095905 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba4d400640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba580995c0 0x7fba58072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba56800640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba58099a40 0x7fba58072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba55e00640 1 -- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba58099a40 msgr2=0x7fba58072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba55e00640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba58099a40 0x7fba58072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba55e00640 1 -- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba580995c0 msgr2=0x7fba58072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba55e00640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba580995c0 0x7fba58072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba55e00640 1 -- 172.21.15.59:0/1595095905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba58156ed0 con 0x7fba3c0039f0 2024-05-30T16:59:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba55e00640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba3c0039f0 0x7fba58157c30 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fba4801c860 tx=0x7fba3c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba4ea00640 1 -- 172.21.15.59:0/1595095905 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba480a6690 con 0x7fba3c0039f0 2024-05-30T16:59:33.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba4ea00640 1 -- 172.21.15.59:0/1595095905 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba480bf070 con 0x7fba3c0039f0 2024-05-30T16:59:33.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba5ce00640 1 -- 172.21.15.59:0/1595095905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba58158170 con 0x7fba3c0039f0 2024-05-30T16:59:33.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba4ea00640 1 -- 172.21.15.59:0/1595095905 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba480a6a90 con 0x7fba3c0039f0 2024-05-30T16:59:33.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba5ce00640 1 -- 172.21.15.59:0/1595095905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba58157150 con 0x7fba3c0039f0 2024-05-30T16:59:33.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.208+0000 7fba5ce00640 1 -- 172.21.15.59:0/1595095905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba58068a90 con 0x7fba3c0039f0 2024-05-30T16:59:33.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.212+0000 7fba4ea00640 1 -- 172.21.15.59:0/1595095905 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fba480a6c30 con 0x7fba3c0039f0 2024-05-30T16:59:33.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.212+0000 7fba4ea00640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fba340694f0 0x7fba3406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.212+0000 7fba4ea00640 1 -- 172.21.15.59:0/1595095905 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 4941+0+0 (secure 0 0 0) 0x7fba48120110 con 0x7fba3c0039f0 2024-05-30T16:59:33.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.212+0000 7fba4d400640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fba340694f0 0x7fba3406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.212+0000 7fba4d400640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fba340694f0 0x7fba3406b9b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fba580735c0 tx=0x7fba40009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:33.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.216+0000 7fba4ea00640 1 -- 172.21.15.59:0/1595095905 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fba58156ed0 con 0x7fba3c0039f0 2024-05-30T16:59:33.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 -- 172.21.15.59:0/1595095905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fba5806e280 con 0x7fba3c0039f0 2024-05-30T16:59:33.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba4ea00640 1 -- 172.21.15.59:0/1595095905 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fba48016740 con 0x7fba3c0039f0 2024-05-30T16:59:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmAAjIJhAA5/FZHJtfSZuYcD6bEfCGDA==", 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-05-30T16:59:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmELVkMxAA/vOsM3Z0z4YEmUqoPtrPBQ==", 2024-05-30T16:59:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:59:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:59:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:59:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-05-30T16:59:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmD2pGLhAAWmDw/02mc8T7upvRXnj1yw==", 2024-05-30T16:59:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmYLbYOhAAxggGfPZU/ryu+8vciSXjUw==", 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:59:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDJrVhmU0fpBhAA2tKWGJF24DlEjG+iuO4djg==", 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-05-30T16:59:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDMrVhmxE2HERAA4N9Bsb0fxl5GERpgyKCl6Q==", 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDPrVhm6v7AGhAAqOQCN90pL0AmnXYIPIb48A==", 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSrVhm3BEDJxAA4SOWC/qF90R9ivrCvN92ZA==", 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDYrVhmFzmDHhAAQtbXd6haolYB98wfEbpvTQ==", 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDbrVhmHqkEKRAAKfFPdTqaVhBNnc5lKeEFpg==", 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDerVhm72bzMBAA+FfnxIOnkESuTervY23ruw==", 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDhrVhmXGv/OhAAr2k7IXDA9VDi9ZJwrQ+u6A==", 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA==", 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmncPjDBAAWEJOkxm9xfRjonO6U1hO6A==", 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:59:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmvlFFCRAAZCq7ijfrVqy8Ukh7jKZESQ==", 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmcpjuEhAA0q+PfNy0IWhqQSiIZuyBlg==", 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmnikpCxAA6Q4udmvjQXBmC4f1irI2Xg==", 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmWZq9IhAAFuEZeFiLGCitIiNARjoDTA==", 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-05-30T16:59:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhm0UKsHhAAimqtE18XjW/1vA7uMsJmEw==", 2024-05-30T16:59:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T16:59:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T16:59:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T16:59:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T16:59:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-05-30T16:59:33.453 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:59:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 -- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fba340694f0 msgr2=0x7fba3406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fba340694f0 0x7fba3406b9b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fba580735c0 tx=0x7fba40009040 comp rx=0 tx=0).stop 2024-05-30T16:59:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 -- 172.21.15.59:0/1595095905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba3c0039f0 msgr2=0x7fba58157c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba3c0039f0 0x7fba58157c30 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fba4801c860 tx=0x7fba3c005840 comp rx=0 tx=0).stop 2024-05-30T16:59:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 -- 172.21.15.59:0/1595095905 shutdown_connections 2024-05-30T16:59:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fba340694f0 0x7fba3406b9b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba58099a40 0x7fba58072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba580995c0 0x7fba58072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 --2- 172.21.15.59:0/1595095905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba3c0039f0 0x7fba58157c30 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 -- 172.21.15.59:0/1595095905 >> 172.21.15.59:0/1595095905 conn(0x7fba580b22d0 msgr2=0x7fba5815e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:33.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 -- 172.21.15.59:0/1595095905 shutdown_connections 2024-05-30T16:59:33.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.440+0000 7fba5ce00640 1 -- 172.21.15.59:0/1595095905 wait complete. 2024-05-30T16:59:33.462 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T16:59:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.600+0000 7eff02e00640 1 Processor -- start 2024-05-30T16:59:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.600+0000 7eff02e00640 1 -- start start 2024-05-30T16:59:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff02e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efefc15c7b0 0x7efefc0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff02e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efefc09b250 0x7efefc0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff02e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc09b900 con 0x7efefc0d0d60 2024-05-30T16:59:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff02e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7efefc0d11c0 con 0x7efefc09b250 2024-05-30T16:59:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff02e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efefc09b6c0 con 0x7efefc15c7b0 2024-05-30T16:59:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff01a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efefc15c7b0 0x7efefc0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff02400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efefc09b250 0x7efefc0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff02400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efefc09b250 0x7efefc0cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:34972/0 (socket says 172.21.15.59:34972) 2024-05-30T16:59:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff01000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7efefc0d0d60 0x7efefc09ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:40372/0 (socket says 172.21.15.59:40372) 2024-05-30T16:59:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff02400640 1 -- 172.21.15.59:0/2506906405 learned_addr learned my addr 172.21.15.59:0/2506906405 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff02400640 1 -- 172.21.15.59:0/2506906405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efefc15c7b0 msgr2=0x7efefc0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff02400640 1 --2- 172.21.15.59:0/2506906405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efefc15c7b0 0x7efefc0d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff02400640 1 -- 172.21.15.59:0/2506906405 >> v1:172.21.15.107:6789/0 conn(0x7efefc0d0d60 legacy=0x7efefc09ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7eff02400640 1 -- 172.21.15.59:0/2506906405 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc09bbe0 con 0x7efefc09b250 2024-05-30T16:59:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.604+0000 7efefbe00640 1 -- 172.21.15.59:0/2506906405 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2791852428 0 0) 0x7efefc09b900 con 0x7efefc0d0d60 2024-05-30T16:59:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7eff02400640 1 --2- 172.21.15.59:0/2506906405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efefc09b250 0x7efefc0cd950 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efef4009e80 tx=0x7efef401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37003198ffaef0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7efefbe00640 1 -- 172.21.15.59:0/2506906405 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef40a56e0 con 0x7efefc09b250 2024-05-30T16:59:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7efefbe00640 1 -- 172.21.15.59:0/2506906405 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef40a5880 con 0x7efefc09b250 2024-05-30T16:59:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7efefbe00640 1 -- 172.21.15.59:0/2506906405 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef40a5c50 con 0x7efefc09b250 2024-05-30T16:59:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7eff02e00640 1 -- 172.21.15.59:0/2506906405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efefc09b250 msgr2=0x7efefc0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7eff02e00640 1 --2- 172.21.15.59:0/2506906405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efefc09b250 0x7efefc0cd950 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efef4009e80 tx=0x7efef401ca10 comp rx=0 tx=0).stop 2024-05-30T16:59:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7eff02e00640 1 -- 172.21.15.59:0/2506906405 shutdown_connections 2024-05-30T16:59:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7eff02e00640 1 --2- 172.21.15.59:0/2506906405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efefc09b250 0x7efefc0cd950 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7eff02e00640 1 --2- 172.21.15.59:0/2506906405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efefc15c7b0 0x7efefc0d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7eff02e00640 1 -- 172.21.15.59:0/2506906405 >> 172.21.15.59:0/2506906405 conn(0x7efefc0b3ec0 msgr2=0x7efefc0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7eff02e00640 1 -- 172.21.15.59:0/2506906405 shutdown_connections 2024-05-30T16:59:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7eff02e00640 1 -- 172.21.15.59:0/2506906405 wait complete. 2024-05-30T16:59:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7eff02e00640 1 Processor -- start 2024-05-30T16:59:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.608+0000 7eff02e00640 1 -- start start 2024-05-30T16:59:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff02e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efefc09b250 0x7efefc153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff02e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc0d0d60 0x7efefc147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff02e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efefc15c7b0 0x7efefc15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff02e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efefc0cea30 con 0x7efefc0d0d60 2024-05-30T16:59:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff02e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efefc0ce8b0 con 0x7efefc09b250 2024-05-30T16:59:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff02e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efefc0cebb0 con 0x7efefc15c7b0 2024-05-30T16:59:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff01000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc0d0d60 0x7efefc147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff01000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc0d0d60 0x7efefc147510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37890/0 (socket says 172.21.15.59:37890) 2024-05-30T16:59:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff01000640 1 -- 172.21.15.59:0/2672373616 learned_addr learned my addr 172.21.15.59:0/2672373616 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff01a00640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efefc09b250 0x7efefc153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff02400640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efefc15c7b0 0x7efefc15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff01000640 1 -- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efefc15c7b0 msgr2=0x7efefc15cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff01000640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efefc15c7b0 0x7efefc15cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff01000640 1 -- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efefc09b250 msgr2=0x7efefc153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff01000640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efefc09b250 0x7efefc153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff01000640 1 -- 172.21.15.59:0/2672373616 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc154430 con 0x7efefc0d0d60 2024-05-30T16:59:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff01000640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc0d0d60 0x7efefc147510 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7efee800c480 tx=0x7efee800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7efef9600640 1 -- 172.21.15.59:0/2672373616 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee8018070 con 0x7efefc0d0d60 2024-05-30T16:59:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7efef9600640 1 -- 172.21.15.59:0/2672373616 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee8007500 con 0x7efefc0d0d60 2024-05-30T16:59:33.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7efef9600640 1 -- 172.21.15.59:0/2672373616 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee8004a30 con 0x7efefc0d0d60 2024-05-30T16:59:33.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff02e00640 1 -- 172.21.15.59:0/2672373616 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efefc154710 con 0x7efefc0d0d60 2024-05-30T16:59:33.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff02e00640 1 -- 172.21.15.59:0/2672373616 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efefc154cd0 con 0x7efefc0d0d60 2024-05-30T16:59:33.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7eff02e00640 1 -- 172.21.15.59:0/2672373616 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efefc14d8b0 con 0x7efefc0d0d60 2024-05-30T16:59:33.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.612+0000 7efef9600640 1 -- 172.21.15.59:0/2672373616 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7efee8004bd0 con 0x7efefc0d0d60 2024-05-30T16:59:33.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.616+0000 7efef9600640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efedc0694f0 0x7efedc06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.616+0000 7efef9600640 1 -- 172.21.15.59:0/2672373616 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 4941+0+0 (secure 0 0 0) 0x7efee8084ad0 con 0x7efefc0d0d60 2024-05-30T16:59:33.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.616+0000 7eff01a00640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efedc0694f0 0x7efedc06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.616+0000 7eff01a00640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efedc0694f0 0x7efedc06b9b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efefc1f8ca0 tx=0x7efef0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:33.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.620+0000 7efef9600640 1 -- 172.21.15.59:0/2672373616 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efee8056140 con 0x7efefc0d0d60 2024-05-30T16:59:33.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.784+0000 7eff02e00640 1 -- 172.21.15.59:0/2672373616 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7efefc0b4b20 con 0x7efefc0d0d60 2024-05-30T16:59:33.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.784+0000 7efef9600640 1 -- 172.21.15.59:0/2672373616 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v86) ==== 84+0+65 (secure 0 0 0) 0x7efee805a440 con 0x7efefc0d0d60 2024-05-30T16:59:33.787 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:33.787 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:59:33.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:33.787 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-05-30T16:59:33.787 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-05-30T16:59:33.787 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:33.787 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:59:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.788+0000 7eff02e00640 1 -- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efedc0694f0 msgr2=0x7efedc06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.788+0000 7eff02e00640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efedc0694f0 0x7efedc06b9b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efefc1f8ca0 tx=0x7efef0009190 comp rx=0 tx=0).stop 2024-05-30T16:59:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.788+0000 7eff02e00640 1 -- 172.21.15.59:0/2672373616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc0d0d60 msgr2=0x7efefc147510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.788+0000 7eff02e00640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc0d0d60 0x7efefc147510 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7efee800c480 tx=0x7efee800c940 comp rx=0 tx=0).stop 2024-05-30T16:59:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.788+0000 7eff02e00640 1 -- 172.21.15.59:0/2672373616 shutdown_connections 2024-05-30T16:59:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.788+0000 7eff02e00640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efedc0694f0 0x7efedc06b9b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.788+0000 7eff02e00640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efefc15c7b0 0x7efefc15cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.788+0000 7eff02e00640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc0d0d60 0x7efefc147510 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.788+0000 7eff02e00640 1 --2- 172.21.15.59:0/2672373616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efefc09b250 0x7efefc153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.788+0000 7eff02e00640 1 -- 172.21.15.59:0/2672373616 >> 172.21.15.59:0/2672373616 conn(0x7efefc0b3ec0 msgr2=0x7efefc0b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.788+0000 7eff02e00640 1 -- 172.21.15.59:0/2672373616 shutdown_connections 2024-05-30T16:59:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.788+0000 7eff02e00640 1 -- 172.21.15.59:0/2672373616 wait complete. 2024-05-30T16:59:33.808 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T16:59:33.808 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T16:59:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1762c00640 1 Processor -- start 2024-05-30T16:59:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1762c00640 1 -- start start 2024-05-30T16:59:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1762c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f175c162080 0x7f175c0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1762c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f175c0b3630 0x7f175c0d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1762c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f175c0d2de0 con 0x7f175c0b3f60 2024-05-30T16:59:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1762c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f175c0b5970 con 0x7f175c162080 2024-05-30T16:59:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1762c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f175c0d3010 con 0x7f175c0b3630 2024-05-30T16:59:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1760c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f175c0b3f60 0x7f175c0b43f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56738/0 (socket says 172.21.15.59:56738) 2024-05-30T16:59:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1760c00640 1 -- 172.21.15.59:0/1997559987 learned_addr learned my addr 172.21.15.59:0/1997559987 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f175be00640 1 --2- 172.21.15.59:0/1997559987 >> v2:172.21.15.107:3300/0 conn(0x7f175c162080 0x7f175c0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1753400640 1 --2- 172.21.15.59:0/1997559987 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f175c0b3630 0x7f175c0d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f175b400640 1 -- 172.21.15.59:0/1997559987 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4177289978 0 0) 0x7f175c0d2de0 con 0x7f175c0b3f60 2024-05-30T16:59:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f175b400640 1 -- 172.21.15.59:0/1997559987 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1740003530 con 0x7f175c0b3f60 2024-05-30T16:59:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1753400640 1 -- 172.21.15.59:0/1997559987 >> v2:172.21.15.107:3300/0 conn(0x7f175c162080 msgr2=0x7f175c0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1753400640 1 --2- 172.21.15.59:0/1997559987 >> v2:172.21.15.107:3300/0 conn(0x7f175c162080 0x7f175c0d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f175b400640 1 -- 172.21.15.59:0/1997559987 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2474146644 0 0) 0x7f1740003530 con 0x7f175c0b3f60 2024-05-30T16:59:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1753400640 1 -- 172.21.15.59:0/1997559987 >> v1:172.21.15.59:6789/0 conn(0x7f175c0b3f60 legacy=0x7f175c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.952+0000 7f1753400640 1 -- 172.21.15.59:0/1997559987 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175c0b5bc0 con 0x7f175c0b3630 2024-05-30T16:59:33.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.956+0000 7f1753400640 1 --2- 172.21.15.59:0/1997559987 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f175c0b3630 0x7f175c0d1630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f17440097f0 tx=0x7f174401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=257fc88eba918e74 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:33.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.956+0000 7f175b400640 1 -- 172.21.15.59:0/1997559987 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17440a7070 con 0x7f175c0b3630 2024-05-30T16:59:33.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.956+0000 7f175b400640 1 -- 172.21.15.59:0/1997559987 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17440b0070 con 0x7f175c0b3630 2024-05-30T16:59:33.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.956+0000 7f175b400640 1 -- 172.21.15.59:0/1997559987 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17440ab890 con 0x7f175c0b3630 2024-05-30T16:59:33.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 -- 172.21.15.59:0/1997559987 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f175c0b3630 msgr2=0x7f175c0d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 --2- 172.21.15.59:0/1997559987 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f175c0b3630 0x7f175c0d1630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f17440097f0 tx=0x7f174401c470 comp rx=0 tx=0).stop 2024-05-30T16:59:33.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 -- 172.21.15.59:0/1997559987 shutdown_connections 2024-05-30T16:59:33.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 --2- 172.21.15.59:0/1997559987 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f175c0b3630 0x7f175c0d1630 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 --2- 172.21.15.59:0/1997559987 >> v2:172.21.15.107:3300/0 conn(0x7f175c162080 0x7f175c0d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 -- 172.21.15.59:0/1997559987 >> 172.21.15.59:0/1997559987 conn(0x7f175c08bfd0 msgr2=0x7f175c0d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 -- 172.21.15.59:0/1997559987 shutdown_connections 2024-05-30T16:59:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 -- 172.21.15.59:0/1997559987 wait complete. 2024-05-30T16:59:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 Processor -- start 2024-05-30T16:59:33.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 -- start start 2024-05-30T16:59:33.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f175c0b3630 0x7f175c0ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f175c0b3f60 0x7f175c15a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f175c162080 0x7f175c0b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f175c1625e0 con 0x7f175c0b3f60 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f175c162460 con 0x7f175c162080 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1762c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f175c0b4f10 con 0x7f175c0b3630 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1753400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f175c0b3f60 0x7f175c15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1753400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f175c0b3f60 0x7f175c15a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37896/0 (socket says 172.21.15.59:37896) 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1753400640 1 -- 172.21.15.59:0/2677829552 learned_addr learned my addr 172.21.15.59:0/2677829552 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f175be00640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f175c0b3630 0x7f175c0ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1760c00640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f175c162080 0x7f175c0b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1753400640 1 -- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f175c0b3630 msgr2=0x7f175c0ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1753400640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f175c0b3630 0x7f175c0ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1753400640 1 -- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f175c162080 msgr2=0x7f175c0b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1753400640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f175c162080 0x7f175c0b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.960+0000 7f1753400640 1 -- 172.21.15.59:0/2677829552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175c15db70 con 0x7f175c0b3f60 2024-05-30T16:59:33.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.964+0000 7f1753400640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f175c0b3f60 0x7f175c15a410 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f174401ab20 tx=0x7f174401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:33.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.964+0000 7f1758c00640 1 -- 172.21.15.59:0/2677829552 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17440bf610 con 0x7f175c0b3f60 2024-05-30T16:59:33.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.964+0000 7f1758c00640 1 -- 172.21.15.59:0/2677829552 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17440bf7b0 con 0x7f175c0b3f60 2024-05-30T16:59:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.964+0000 7f1758c00640 1 -- 172.21.15.59:0/2677829552 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17440bfba0 con 0x7f175c0b3f60 2024-05-30T16:59:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.964+0000 7f1762c00640 1 -- 172.21.15.59:0/2677829552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175c15de50 con 0x7f175c0b3f60 2024-05-30T16:59:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.964+0000 7f1762c00640 1 -- 172.21.15.59:0/2677829552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175c15e410 con 0x7f175c0b3f60 2024-05-30T16:59:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.964+0000 7f1762c00640 1 -- 172.21.15.59:0/2677829552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f175c068a90 con 0x7f175c0b3f60 2024-05-30T16:59:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.964+0000 7f1758c00640 1 -- 172.21.15.59:0/2677829552 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f17440bd020 con 0x7f175c0b3f60 2024-05-30T16:59:33.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.964+0000 7f1758c00640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f17380694f0 0x7f173806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:33.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.964+0000 7f1758c00640 1 -- 172.21.15.59:0/2677829552 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 4941+0+0 (secure 0 0 0) 0x7f174411fcd0 con 0x7f175c0b3f60 2024-05-30T16:59:33.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.964+0000 7f175be00640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f17380694f0 0x7f173806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:33.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.968+0000 7f175be00640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f17380694f0 0x7f173806b9b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f174c009b60 tx=0x7f174c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:33.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:33.968+0000 7f1758c00640 1 -- 172.21.15.59:0/2677829552 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1744016090 con 0x7f175c0b3f60 2024-05-30T16:59:34.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:34.144+0000 7f1762c00640 1 -- 172.21.15.59:0/2677829552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f175c0d27a0 con 0x7f175c0b3f60 2024-05-30T16:59:35.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.040+0000 7f1758c00640 1 -- 172.21.15.59:0/2677829552 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v87) ==== 138+0+0 (secure 0 0 0) 0x7f17440f17b0 con 0x7f175c0b3f60 2024-05-30T16:59:35.044 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-05-30T16:59:35.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.044+0000 7f1762c00640 1 -- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f17380694f0 msgr2=0x7f173806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:35.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.044+0000 7f1762c00640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f17380694f0 0x7f173806b9b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f174c009b60 tx=0x7f174c009190 comp rx=0 tx=0).stop 2024-05-30T16:59:35.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.044+0000 7f1762c00640 1 -- 172.21.15.59:0/2677829552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f175c0b3f60 msgr2=0x7f175c15a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:35.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.044+0000 7f1762c00640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f175c0b3f60 0x7f175c15a410 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f174401ab20 tx=0x7f174401acb0 comp rx=0 tx=0).stop 2024-05-30T16:59:35.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.044+0000 7f1762c00640 1 -- 172.21.15.59:0/2677829552 shutdown_connections 2024-05-30T16:59:35.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.044+0000 7f1762c00640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f17380694f0 0x7f173806b9b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:35.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.044+0000 7f1762c00640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f175c162080 0x7f175c0b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:35.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.044+0000 7f1762c00640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f175c0b3f60 0x7f175c15a410 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:35.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.044+0000 7f1762c00640 1 --2- 172.21.15.59:0/2677829552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f175c0b3630 0x7f175c0ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:35.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.044+0000 7f1762c00640 1 -- 172.21.15.59:0/2677829552 >> 172.21.15.59:0/2677829552 conn(0x7f175c08bfd0 msgr2=0x7f175c160690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:35.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.044+0000 7f1762c00640 1 -- 172.21.15.59:0/2677829552 shutdown_connections 2024-05-30T16:59:35.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.044+0000 7f1762c00640 1 -- 172.21.15.59:0/2677829552 wait complete. 2024-05-30T16:59:35.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:59:35.073 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:59:35.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T16:59:35.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.268+0000 7f4db1000640 1 Processor -- start 2024-05-30T16:59:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.268+0000 7f4db1000640 1 -- start start 2024-05-30T16:59:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.268+0000 7f4db1000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dac161fd0 0x7f4dac0d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.268+0000 7f4db1000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4dac0cb9b0 0x7f4dac0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.268+0000 7f4db1000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4dac06b9b0 0x7f4dac06be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.268+0000 7f4db1000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4dac0d1150 con 0x7f4dac161fd0 2024-05-30T16:59:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.268+0000 7f4db1000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4dac0d0b90 con 0x7f4dac06b9b0 2024-05-30T16:59:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.268+0000 7f4db1000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4dac0d0e70 con 0x7f4dac0cb9b0 2024-05-30T16:59:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da9e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dac161fd0 0x7f4dac0d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da9e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dac161fd0 0x7f4dac0d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37910/0 (socket says 172.21.15.59:37910) 2024-05-30T16:59:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da9e00640 1 -- 172.21.15.59:0/3693536751 learned_addr learned my addr 172.21.15.59:0/3693536751 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4daa800640 1 --2- 172.21.15.59:0/3693536751 >> v2:172.21.15.107:3300/0 conn(0x7f4dac06b9b0 0x7f4dac06be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da9e00640 1 -- 172.21.15.59:0/3693536751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4dac0cb9b0 msgr2=0x7f4dac0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da3e00640 1 --2- 172.21.15.59:0/3693536751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4dac0cb9b0 0x7f4dac0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da9e00640 1 --2- 172.21.15.59:0/3693536751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4dac0cb9b0 0x7f4dac0b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da9e00640 1 -- 172.21.15.59:0/3693536751 >> v2:172.21.15.107:3300/0 conn(0x7f4dac06b9b0 msgr2=0x7f4dac06be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da9e00640 1 --2- 172.21.15.59:0/3693536751 >> v2:172.21.15.107:3300/0 conn(0x7f4dac06b9b0 0x7f4dac06be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da9e00640 1 -- 172.21.15.59:0/3693536751 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac0cd620 con 0x7f4dac161fd0 2024-05-30T16:59:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da3e00640 1 --2- 172.21.15.59:0/3693536751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4dac0cb9b0 0x7f4dac0b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:35.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da9e00640 1 --2- 172.21.15.59:0/3693536751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dac161fd0 0x7f4dac0d05b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0b7510 tx=0x7f4d9c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77aab9b4f49fd70 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:35.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da9400640 1 -- 172.21.15.59:0/3693536751 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0b0070 con 0x7f4dac161fd0 2024-05-30T16:59:35.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da9400640 1 -- 172.21.15.59:0/3693536751 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9c0ab600 con 0x7f4dac161fd0 2024-05-30T16:59:35.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.272+0000 7f4da9400640 1 -- 172.21.15.59:0/3693536751 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0ab9d0 con 0x7f4dac161fd0 2024-05-30T16:59:35.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 -- 172.21.15.59:0/3693536751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dac161fd0 msgr2=0x7f4dac0d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:35.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 --2- 172.21.15.59:0/3693536751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dac161fd0 0x7f4dac0d05b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0b7510 tx=0x7f4d9c01c490 comp rx=0 tx=0).stop 2024-05-30T16:59:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 -- 172.21.15.59:0/3693536751 shutdown_connections 2024-05-30T16:59:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 --2- 172.21.15.59:0/3693536751 >> v2:172.21.15.107:3300/0 conn(0x7f4dac06b9b0 0x7f4dac06be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 --2- 172.21.15.59:0/3693536751 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4dac0cb9b0 0x7f4dac0b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 --2- 172.21.15.59:0/3693536751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dac161fd0 0x7f4dac0d05b0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 -- 172.21.15.59:0/3693536751 >> 172.21.15.59:0/3693536751 conn(0x7f4dac0b2f50 msgr2=0x7f4dac0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 -- 172.21.15.59:0/3693536751 shutdown_connections 2024-05-30T16:59:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 -- 172.21.15.59:0/3693536751 wait complete. 2024-05-30T16:59:35.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 Processor -- start 2024-05-30T16:59:35.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 -- start start 2024-05-30T16:59:35.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4dac06b9b0 0x7f4dac15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:35.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dac0cb9b0 0x7f4dac0c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dac161fd0 0x7f4dac0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac0cea00 con 0x7f4dac0cb9b0 2024-05-30T16:59:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac0ce880 con 0x7f4dac161fd0 2024-05-30T16:59:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4db1000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4dac0ceb80 con 0x7f4dac06b9b0 2024-05-30T16:59:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4da3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dac0cb9b0 0x7f4dac0c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4da3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dac0cb9b0 0x7f4dac0c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37916/0 (socket says 172.21.15.59:37916) 2024-05-30T16:59:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4da3e00640 1 -- 172.21.15.59:0/3150128024 learned_addr learned my addr 172.21.15.59:0/3150128024 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4da9e00640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4dac06b9b0 0x7f4dac15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.276+0000 7f4daa800640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dac161fd0 0x7f4dac0c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4da3e00640 1 -- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4dac06b9b0 msgr2=0x7f4dac15e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4da3e00640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4dac06b9b0 0x7f4dac15e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4da3e00640 1 -- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dac161fd0 msgr2=0x7f4dac0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:35.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4da3e00640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dac161fd0 0x7f4dac0c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:35.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4da3e00640 1 -- 172.21.15.59:0/3150128024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac1f7c90 con 0x7f4dac0cb9b0 2024-05-30T16:59:35.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4da3e00640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dac0cb9b0 0x7f4dac0c8430 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400c7c0 tx=0x7f4d9400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:35.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4da2000640 1 -- 172.21.15.59:0/3150128024 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94007a30 con 0x7f4dac0cb9b0 2024-05-30T16:59:35.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4da2000640 1 -- 172.21.15.59:0/3150128024 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d94007bd0 con 0x7f4dac0cb9b0 2024-05-30T16:59:35.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4da2000640 1 -- 172.21.15.59:0/3150128024 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d940113f0 con 0x7f4dac0cb9b0 2024-05-30T16:59:35.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4db1000640 1 -- 172.21.15.59:0/3150128024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dac1f7110 con 0x7f4dac0cb9b0 2024-05-30T16:59:35.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4db1000640 1 -- 172.21.15.59:0/3150128024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dac1f76d0 con 0x7f4dac0cb9b0 2024-05-30T16:59:35.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4db1000640 1 -- 172.21.15.59:0/3150128024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dac068a90 con 0x7f4dac0cb9b0 2024-05-30T16:59:35.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.280+0000 7f4da2000640 1 -- 172.21.15.59:0/3150128024 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f4d94011590 con 0x7f4dac0cb9b0 2024-05-30T16:59:35.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.284+0000 7f4da2000640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d88069540 0x7f4d8806ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:35.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.284+0000 7f4da2000640 1 -- 172.21.15.59:0/3150128024 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5311+0+0 (secure 0 0 0) 0x7f4d94085da0 con 0x7f4dac0cb9b0 2024-05-30T16:59:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.284+0000 7f4da9e00640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d88069540 0x7f4d8806ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:35.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.284+0000 7f4da9e00640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d88069540 0x7f4d8806ba00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0ad000 tx=0x7f4d9c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:35.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.288+0000 7f4da2000640 1 -- 172.21.15.59:0/3150128024 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d94015020 con 0x7f4dac0cb9b0 2024-05-30T16:59:35.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:35.452+0000 7f4db1000640 1 -- 172.21.15.59:0/3150128024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4dac15c9f0 con 0x7f4dac0cb9b0 2024-05-30T16:59:36.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.048+0000 7f4da2000640 1 -- 172.21.15.59:0/3150128024 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v88) ==== 170+0+0 (secure 0 0 0) 0x7f4d94057450 con 0x7f4dac0cb9b0 2024-05-30T16:59:36.051 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-05-30T16:59:36.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.052+0000 7f4db1000640 1 -- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d88069540 msgr2=0x7f4d8806ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:36.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.052+0000 7f4db1000640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d88069540 0x7f4d8806ba00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0ad000 tx=0x7f4d9c0a6000 comp rx=0 tx=0).stop 2024-05-30T16:59:36.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.052+0000 7f4db1000640 1 -- 172.21.15.59:0/3150128024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dac0cb9b0 msgr2=0x7f4dac0c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:36.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.052+0000 7f4db1000640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dac0cb9b0 0x7f4dac0c8430 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400c7c0 tx=0x7f4d9400cc80 comp rx=0 tx=0).stop 2024-05-30T16:59:36.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.052+0000 7f4db1000640 1 -- 172.21.15.59:0/3150128024 shutdown_connections 2024-05-30T16:59:36.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.052+0000 7f4db1000640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4d88069540 0x7f4d8806ba00 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:36.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.052+0000 7f4db1000640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dac161fd0 0x7f4dac0c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:36.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.052+0000 7f4db1000640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dac0cb9b0 0x7f4dac0c8430 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:36.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.052+0000 7f4db1000640 1 --2- 172.21.15.59:0/3150128024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4dac06b9b0 0x7f4dac15e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:36.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.052+0000 7f4db1000640 1 -- 172.21.15.59:0/3150128024 >> 172.21.15.59:0/3150128024 conn(0x7f4dac0b2f50 msgr2=0x7f4dac0d1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:36.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.052+0000 7f4db1000640 1 -- 172.21.15.59:0/3150128024 shutdown_connections 2024-05-30T16:59:36.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.052+0000 7f4db1000640 1 -- 172.21.15.59:0/3150128024 wait complete. 2024-05-30T16:59:36.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T16:59:36.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.236+0000 7f0d01400640 1 Processor -- start 2024-05-30T16:59:36.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.236+0000 7f0d01400640 1 -- start start 2024-05-30T16:59:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.240+0000 7f0d01400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cfc06dc80 0x7f0cfc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.240+0000 7f0d01400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cfc0b32d0 con 0x7f0cfc0723a0 2024-05-30T16:59:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.240+0000 7f0d01400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cfc15f490 con 0x7f0cfc0b4f90 2024-05-30T16:59:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.240+0000 7f0d01400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0cfc15f770 con 0x7f0cfc06dc80 2024-05-30T16:59:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.240+0000 7f0cfa800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0cfc0723a0 0x7f0cfc15ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56742/0 (socket says 172.21.15.59:56742) 2024-05-30T16:59:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.240+0000 7f0cfa800640 1 -- 172.21.15.59:0/2139162453 learned_addr learned my addr 172.21.15.59:0/2139162453 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.240+0000 7f0cfb200640 1 --2- 172.21.15.59:0/2139162453 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cfc06dc80 0x7f0cfc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:36.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.240+0000 7f0cf9e00640 1 -- 172.21.15.59:0/2139162453 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2635405810 0 0) 0x7f0cfc0b32d0 con 0x7f0cfc0723a0 2024-05-30T16:59:36.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.240+0000 7f0cf9e00640 1 -- 172.21.15.59:0/2139162453 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ce0003530 con 0x7f0cfc0723a0 2024-05-30T16:59:36.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.240+0000 7f0cfb200640 1 -- 172.21.15.59:0/2139162453 >> v1:172.21.15.107:6789/0 conn(0x7f0cfc0b4f90 legacy=0x7f0cfc0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:36.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.240+0000 7f0cfb200640 1 -- 172.21.15.59:0/2139162453 >> v1:172.21.15.59:6789/0 conn(0x7f0cfc0723a0 legacy=0x7f0cfc15ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:36.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.240+0000 7f0cfb200640 1 -- 172.21.15.59:0/2139162453 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cfc15fa50 con 0x7f0cfc06dc80 2024-05-30T16:59:36.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0cfb200640 1 --2- 172.21.15.59:0/2139162453 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cfc06dc80 0x7f0cfc06e110 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40097f0 tx=0x7f0cf401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2768888a6216c19c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:36.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0cf9e00640 1 -- 172.21.15.59:0/2139162453 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40b0070 con 0x7f0cfc06dc80 2024-05-30T16:59:36.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0cf9e00640 1 -- 172.21.15.59:0/2139162453 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf40ab600 con 0x7f0cfc06dc80 2024-05-30T16:59:36.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0cf9e00640 1 -- 172.21.15.59:0/2139162453 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40ab9d0 con 0x7f0cfc06dc80 2024-05-30T16:59:36.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0d01400640 1 -- 172.21.15.59:0/2139162453 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cfc06dc80 msgr2=0x7f0cfc06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:36.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0d01400640 1 --2- 172.21.15.59:0/2139162453 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cfc06dc80 0x7f0cfc06e110 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40097f0 tx=0x7f0cf401c4e0 comp rx=0 tx=0).stop 2024-05-30T16:59:36.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0d01400640 1 -- 172.21.15.59:0/2139162453 shutdown_connections 2024-05-30T16:59:36.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0d01400640 1 --2- 172.21.15.59:0/2139162453 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cfc06dc80 0x7f0cfc06e110 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:36.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0d01400640 1 -- 172.21.15.59:0/2139162453 >> 172.21.15.59:0/2139162453 conn(0x7f0cfc06bdb0 msgr2=0x7f0cfc06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:36.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0d01400640 1 -- 172.21.15.59:0/2139162453 shutdown_connections 2024-05-30T16:59:36.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0d01400640 1 -- 172.21.15.59:0/2139162453 wait complete. 2024-05-30T16:59:36.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0d01400640 1 Processor -- start 2024-05-30T16:59:36.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.244+0000 7f0d01400640 1 -- start start 2024-05-30T16:59:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0d01400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cfc06dc80 0x7f0cfc15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0d01400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cfc0723a0 0x7f0cfc0b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0d01400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cfc0b4f90 0x7f0cfc0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0d01400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc154fe0 con 0x7f0cfc0b4f90 2024-05-30T16:59:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0d01400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc154e60 con 0x7f0cfc06dc80 2024-05-30T16:59:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0d01400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0cfc155160 con 0x7f0cfc0723a0 2024-05-30T16:59:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cfb200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cfc0b4f90 0x7f0cfc0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cfb200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cfc0b4f90 0x7f0cfc0b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37918/0 (socket says 172.21.15.59:37918) 2024-05-30T16:59:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cfb200640 1 -- 172.21.15.59:0/2609029593 learned_addr learned my addr 172.21.15.59:0/2609029593 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cf1e00640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cfc0723a0 0x7f0cfc0b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cfa800640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cfc06dc80 0x7f0cfc15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cfb200640 1 -- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cfc0723a0 msgr2=0x7f0cfc0b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cfb200640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cfc0723a0 0x7f0cfc0b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cfb200640 1 -- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cfc06dc80 msgr2=0x7f0cfc15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cfb200640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cfc06dc80 0x7f0cfc15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cfb200640 1 -- 172.21.15.59:0/2609029593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cfc15d4f0 con 0x7f0cfc0b4f90 2024-05-30T16:59:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cfb200640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cfc0b4f90 0x7f0cfc0b07e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40097f0 tx=0x7f0cf401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cf3400640 1 -- 172.21.15.59:0/2609029593 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40bc070 con 0x7f0cfc0b4f90 2024-05-30T16:59:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cf3400640 1 -- 172.21.15.59:0/2609029593 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf40b1040 con 0x7f0cfc0b4f90 2024-05-30T16:59:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0d01400640 1 -- 172.21.15.59:0/2609029593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cfc1581f0 con 0x7f0cfc0b4f90 2024-05-30T16:59:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cf3400640 1 -- 172.21.15.59:0/2609029593 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40b0050 con 0x7f0cfc0b4f90 2024-05-30T16:59:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0d01400640 1 -- 172.21.15.59:0/2609029593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cfc0affe0 con 0x7f0cfc0b4f90 2024-05-30T16:59:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0d01400640 1 -- 172.21.15.59:0/2609029593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cfc068a90 con 0x7f0cfc0b4f90 2024-05-30T16:59:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.248+0000 7f0cf3400640 1 -- 172.21.15.59:0/2609029593 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f0cf40bf070 con 0x7f0cfc0b4f90 2024-05-30T16:59:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.252+0000 7f0cf3400640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0cd80694f0 0x7f0cd806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:36.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.252+0000 7f0cf3400640 1 -- 172.21.15.59:0/2609029593 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5693+0+0 (secure 0 0 0) 0x7f0cf411f650 con 0x7f0cfc0b4f90 2024-05-30T16:59:36.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.252+0000 7f0cfa800640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0cd80694f0 0x7f0cd806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:36.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.252+0000 7f0cfa800640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0cd80694f0 0x7f0cd806b9b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0011f0 tx=0x7f0cec007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:36.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.256+0000 7f0cf3400640 1 -- 172.21.15.59:0/2609029593 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0cf40160d0 con 0x7f0cfc0b4f90 2024-05-30T16:59:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:36.456+0000 7f0d01400640 1 -- 172.21.15.59:0/2609029593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0cfc0afdc0 con 0x7f0cfc0b4f90 2024-05-30T16:59:37.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0cf3400640 1 -- 172.21.15.59:0/2609029593 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v48) ==== 174+0+0 (secure 0 0 0) 0x7f0cf40f0cc0 con 0x7f0cfc0b4f90 2024-05-30T16:59:37.053 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 12 and data pool 13 2024-05-30T16:59:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0d01400640 1 -- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0cd80694f0 msgr2=0x7f0cd806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0d01400640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0cd80694f0 0x7f0cd806b9b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0011f0 tx=0x7f0cec007d40 comp rx=0 tx=0).stop 2024-05-30T16:59:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0d01400640 1 -- 172.21.15.59:0/2609029593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cfc0b4f90 msgr2=0x7f0cfc0b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0d01400640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cfc0b4f90 0x7f0cfc0b07e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40097f0 tx=0x7f0cf401ad20 comp rx=0 tx=0).stop 2024-05-30T16:59:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0d01400640 1 -- 172.21.15.59:0/2609029593 shutdown_connections 2024-05-30T16:59:37.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0d01400640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0cd80694f0 0x7f0cd806b9b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0d01400640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cfc0b4f90 0x7f0cfc0b07e0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0d01400640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cfc0723a0 0x7f0cfc0b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0d01400640 1 --2- 172.21.15.59:0/2609029593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cfc06dc80 0x7f0cfc15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0d01400640 1 -- 172.21.15.59:0/2609029593 >> 172.21.15.59:0/2609029593 conn(0x7f0cfc06bdb0 msgr2=0x7f0cfc074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:37.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0d01400640 1 -- 172.21.15.59:0/2609029593 shutdown_connections 2024-05-30T16:59:37.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.052+0000 7f0d01400640 1 -- 172.21.15.59:0/2609029593 wait complete. 2024-05-30T16:59:37.098 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:59:37.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effbee00640 1 Processor -- start 2024-05-30T16:59:37.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effbee00640 1 -- start start 2024-05-30T16:59:37.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effbee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb80c7920 0x7effb80c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effbee00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb80c7ea0 con 0x7effb815c8b0 2024-05-30T16:59:37.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effbee00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb80c62d0 con 0x7effb80c72f0 2024-05-30T16:59:37.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effbee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7effb80cd2b0 con 0x7effb80c7920 2024-05-30T16:59:37.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effb7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7effb815c8b0 0x7effb80ce640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56744/0 (socket says 172.21.15.59:56744) 2024-05-30T16:59:37.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effb7e00640 1 -- 172.21.15.59:0/2645479907 learned_addr learned my addr 172.21.15.59:0/2645479907 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:37.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effaf400640 1 --2- 172.21.15.59:0/2645479907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb80c7920 0x7effb80c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effb7400640 1 -- 172.21.15.59:0/2645479907 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182405875 0 0) 0x7effb80c7ea0 con 0x7effb815c8b0 2024-05-30T16:59:37.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effb7400640 1 -- 172.21.15.59:0/2645479907 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff9c003530 con 0x7effb815c8b0 2024-05-30T16:59:37.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effb7400640 1 -- 172.21.15.59:0/2645479907 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964463329 0 0) 0x7effb80c62d0 con 0x7effb80c72f0 2024-05-30T16:59:37.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effb7400640 1 -- 172.21.15.59:0/2645479907 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb80c7ea0 con 0x7effb80c72f0 2024-05-30T16:59:37.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effaf400640 1 -- 172.21.15.59:0/2645479907 >> v1:172.21.15.107:6789/0 conn(0x7effb80c72f0 legacy=0x7effb80cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effaf400640 1 -- 172.21.15.59:0/2645479907 >> v1:172.21.15.59:6789/0 conn(0x7effb815c8b0 legacy=0x7effb80ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.240+0000 7effaf400640 1 -- 172.21.15.59:0/2645479907 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb80c65b0 con 0x7effb80c7920 2024-05-30T16:59:37.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.244+0000 7effaf400640 1 --2- 172.21.15.59:0/2645479907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb80c7920 0x7effb80c6db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7effa0009dc0 tx=0x7effa001c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aec656e803ea3c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:37.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.244+0000 7effb7400640 1 -- 172.21.15.59:0/2645479907 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00b2070 con 0x7effb80c7920 2024-05-30T16:59:37.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.244+0000 7effb7400640 1 -- 172.21.15.59:0/2645479907 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa00a59b0 con 0x7effb80c7920 2024-05-30T16:59:37.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.244+0000 7effb7400640 1 -- 172.21.15.59:0/2645479907 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00a5d80 con 0x7effb80c7920 2024-05-30T16:59:37.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.244+0000 7effbee00640 1 -- 172.21.15.59:0/2645479907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb80c7920 msgr2=0x7effb80c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.244+0000 7effbee00640 1 --2- 172.21.15.59:0/2645479907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb80c7920 0x7effb80c6db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7effa0009dc0 tx=0x7effa001c960 comp rx=0 tx=0).stop 2024-05-30T16:59:37.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.244+0000 7effbee00640 1 -- 172.21.15.59:0/2645479907 shutdown_connections 2024-05-30T16:59:37.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.244+0000 7effbee00640 1 --2- 172.21.15.59:0/2645479907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb80c7920 0x7effb80c6db0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.244+0000 7effbee00640 1 -- 172.21.15.59:0/2645479907 >> 172.21.15.59:0/2645479907 conn(0x7effb80b2fc0 msgr2=0x7effb80b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:37.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.244+0000 7effbee00640 1 -- 172.21.15.59:0/2645479907 shutdown_connections 2024-05-30T16:59:37.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.244+0000 7effbee00640 1 -- 172.21.15.59:0/2645479907 wait complete. 2024-05-30T16:59:37.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbee00640 1 Processor -- start 2024-05-30T16:59:37.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbee00640 1 -- start start 2024-05-30T16:59:37.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb80c72f0 0x7effb8150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb80c7920 0x7effb8151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effb815c8b0 0x7effb815cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7effb80d0f70 con 0x7effb80c7920 2024-05-30T16:59:37.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7effb80d0df0 con 0x7effb815c8b0 2024-05-30T16:59:37.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7effb816a260 con 0x7effb80c72f0 2024-05-30T16:59:37.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effaf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb80c7920 0x7effb8151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effaf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb80c7920 0x7effb8151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37930/0 (socket says 172.21.15.59:37930) 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effaf400640 1 -- 172.21.15.59:0/2052113052 learned_addr learned my addr 172.21.15.59:0/2052113052 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effb7e00640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb80c72f0 0x7effb8150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbce00640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effb815c8b0 0x7effb815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effaf400640 1 -- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb80c72f0 msgr2=0x7effb8150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effaf400640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb80c72f0 0x7effb8150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effaf400640 1 -- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effb815c8b0 msgr2=0x7effb815cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effaf400640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effb815c8b0 0x7effb815cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effaf400640 1 -- 172.21.15.59:0/2052113052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb8154550 con 0x7effb80c7920 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbce00640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effb815c8b0 0x7effb815cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effaf400640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb80c7920 0x7effb8151030 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7effa00b0040 tx=0x7effa0019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effb4c00640 1 -- 172.21.15.59:0/2052113052 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00b2050 con 0x7effb80c7920 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effb4c00640 1 -- 172.21.15.59:0/2052113052 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa00be070 con 0x7effb80c7920 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbee00640 1 -- 172.21.15.59:0/2052113052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb8154830 con 0x7effb80c7920 2024-05-30T16:59:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effb4c00640 1 -- 172.21.15.59:0/2052113052 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00ada90 con 0x7effb80c7920 2024-05-30T16:59:37.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbee00640 1 -- 172.21.15.59:0/2052113052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb815d830 con 0x7effb80c7920 2024-05-30T16:59:37.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.248+0000 7effbee00640 1 -- 172.21.15.59:0/2052113052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb815db20 con 0x7effb80c7920 2024-05-30T16:59:37.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.252+0000 7effb4c00640 1 -- 172.21.15.59:0/2052113052 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7effa00adc30 con 0x7effb80c7920 2024-05-30T16:59:37.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.252+0000 7effb4c00640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff940694f0 0x7eff9406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.252+0000 7effb4c00640 1 -- 172.21.15.59:0/2052113052 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5793+0+0 (secure 0 0 0) 0x7effa0121510 con 0x7effb80c7920 2024-05-30T16:59:37.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.252+0000 7effb7e00640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff940694f0 0x7eff9406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.252+0000 7effb7e00640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff940694f0 0x7eff9406b9b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7effa8000f70 tx=0x7effa8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:37.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.256+0000 7effb4c00640 1 -- 172.21.15.59:0/2052113052 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7effa0016580 con 0x7effb80c7920 2024-05-30T16:59:37.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.420+0000 7effbee00640 1 -- 172.21.15.59:0/2052113052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7effb8068a90 con 0x7effb80c7920 2024-05-30T16:59:37.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effb4c00640 1 -- 172.21.15.59:0/2052113052 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16792 (secure 0 0 0) 0x7effa00b83b0 con 0x7effb80c7920 2024-05-30T16:59:37.425 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:37.425 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":89,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:59:36.461078+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:59:34.157525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-05-30T16:59:35.464679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:59:37.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effbee00640 1 -- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff940694f0 msgr2=0x7eff9406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effbee00640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff940694f0 0x7eff9406b9b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7effa8000f70 tx=0x7effa8009040 comp rx=0 tx=0).stop 2024-05-30T16:59:37.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effbee00640 1 -- 172.21.15.59:0/2052113052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb80c7920 msgr2=0x7effb8151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effbee00640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb80c7920 0x7effb8151030 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7effa00b0040 tx=0x7effa0019700 comp rx=0 tx=0).stop 2024-05-30T16:59:37.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effbee00640 1 -- 172.21.15.59:0/2052113052 shutdown_connections 2024-05-30T16:59:37.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effbee00640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff940694f0 0x7eff9406b9b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effbee00640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effb815c8b0 0x7effb815cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effbee00640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb80c7920 0x7effb8151030 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effbee00640 1 --2- 172.21.15.59:0/2052113052 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effb80c72f0 0x7effb8150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effbee00640 1 -- 172.21.15.59:0/2052113052 >> 172.21.15.59:0/2052113052 conn(0x7effb80b2fc0 msgr2=0x7effb80b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:37.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effbee00640 1 -- 172.21.15.59:0/2052113052 shutdown_connections 2024-05-30T16:59:37.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.424+0000 7effbee00640 1 -- 172.21.15.59:0/2052113052 wait complete. 2024-05-30T16:59:37.448 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:59:37.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecdec00640 1 Processor -- start 2024-05-30T16:59:37.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecdec00640 1 -- start start 2024-05-30T16:59:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecdec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecd809b150 0x7fecd81699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecdec00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd8070950 con 0x7fecd80d14c0 2024-05-30T16:59:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecdec00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd8070c30 con 0x7fecd80d05b0 2024-05-30T16:59:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecdec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fecd8070f10 con 0x7fecd809b150 2024-05-30T16:59:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fecd80d14c0 0x7fecd806e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56756/0 (socket says 172.21.15.59:56756) 2024-05-30T16:59:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7e00640 1 -- 172.21.15.59:0/3055686781 learned_addr learned my addr 172.21.15.59:0/3055686781 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecdcc00640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecd809b150 0x7fecd81699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243033305 0 0) 0x7fecd8070950 con 0x7fecd80d14c0 2024-05-30T16:59:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecbc003530 con 0x7fecd80d14c0 2024-05-30T16:59:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714460803 0 0) 0x7fecd8070c30 con 0x7fecd80d05b0 2024-05-30T16:59:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecd8070950 con 0x7fecd80d05b0 2024-05-30T16:59:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3677617073 0 0) 0x7fecbc003530 con 0x7fecd80d14c0 2024-05-30T16:59:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecd809b150 msgr2=0x7fecd81699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecd809b150 0x7fecd81699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 >> v1:172.21.15.107:6789/0 conn(0x7fecd80d05b0 legacy=0x7fecd809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd806cbd0 con 0x7fecd80d14c0 2024-05-30T16:59:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fecc8001680 con 0x7fecd80d14c0 2024-05-30T16:59:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 >> v1:172.21.15.59:6789/0 conn(0x7fecd80d14c0 legacy=0x7fecd806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecd809b150 0x7fecbc003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecbc0040e0 0x7fecbc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecbc004d50 0x7fecbc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fecd8070f10 con 0x7fecbc0040e0 2024-05-30T16:59:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fecbc00bab0 con 0x7fecbc004d50 2024-05-30T16:59:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fecbc00bcb0 con 0x7fecd809b150 2024-05-30T16:59:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7feccfe00640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecbc0040e0 0x7fecbc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.588+0000 7fecd7e00640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecd809b150 0x7fecbc003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7fecdcc00640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecbc004d50 0x7fecbc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7feccfe00640 1 -- 172.21.15.59:0/3055686781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecd809b150 msgr2=0x7fecbc003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7feccfe00640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecd809b150 0x7fecbc003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7feccfe00640 1 -- 172.21.15.59:0/3055686781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecbc004d50 msgr2=0x7fecbc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7feccfe00640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecbc004d50 0x7fecbc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7feccfe00640 1 -- 172.21.15.59:0/3055686781 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecbc003530 con 0x7fecbc0040e0 2024-05-30T16:59:37.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7fecdcc00640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecbc004d50 0x7fecbc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:37.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7feccfe00640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecbc0040e0 0x7fecbc004810 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fecc00018d0 tx=0x7fecc001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba257908fbda5dc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:37.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0001520 con 0x7fecbc0040e0 2024-05-30T16:59:37.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc00052f0 con 0x7fecbc0040e0 2024-05-30T16:59:37.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7fecd7400640 1 -- 172.21.15.59:0/3055686781 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc00a8950 con 0x7fecbc0040e0 2024-05-30T16:59:37.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7fecdec00640 1 -- 172.21.15.59:0/3055686781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecbc0040e0 msgr2=0x7fecbc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7fecdec00640 1 --2- 172.21.15.59:0/3055686781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecbc0040e0 0x7fecbc004810 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fecc00018d0 tx=0x7fecc001ecf0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.592+0000 7fecdcc00640 1 -- 172.21.15.59:0/3055686781 reap_dead start 2024-05-30T16:59:37.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdec00640 1 -- 172.21.15.59:0/3055686781 shutdown_connections 2024-05-30T16:59:37.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdec00640 1 -- 172.21.15.59:0/3055686781 >> 172.21.15.59:0/3055686781 conn(0x7fecd80b3f80 msgr2=0x7fecd80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:37.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdec00640 1 -- 172.21.15.59:0/3055686781 shutdown_connections 2024-05-30T16:59:37.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdec00640 1 -- 172.21.15.59:0/3055686781 wait complete. 2024-05-30T16:59:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdec00640 1 Processor -- start 2024-05-30T16:59:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdec00640 1 -- start start 2024-05-30T16:59:37.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecbc0040e0 0x7fecd81e0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdec00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80c8cd0 0x7fecd80c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdec00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecd80c7760 0x7fecd80b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdec00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fecd80d18a0 con 0x7fecd80c8cd0 2024-05-30T16:59:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdec00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fecd80d0a60 con 0x7fecd80c7760 2024-05-30T16:59:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fecd806e100 con 0x7fecbc0040e0 2024-05-30T16:59:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7feccfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80c8cd0 0x7fecd80c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7feccfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80c8cd0 0x7fecd80c7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37938/0 (socket says 172.21.15.59:37938) 2024-05-30T16:59:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7feccfe00640 1 -- 172.21.15.59:0/2948388522 learned_addr learned my addr 172.21.15.59:0/2948388522 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecdcc00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecd80c7760 0x7fecd80b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecd7e00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecbc0040e0 0x7fecd81e0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7feccfe00640 1 -- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecbc0040e0 msgr2=0x7fecd81e0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7feccfe00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecbc0040e0 0x7fecd81e0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7feccfe00640 1 -- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecd80c7760 msgr2=0x7fecd80b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7feccfe00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecd80c7760 0x7fecd80b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7feccfe00640 1 -- 172.21.15.59:0/2948388522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd80c7c30 con 0x7fecd80c8cd0 2024-05-30T16:59:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7fecd7e00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecbc0040e0 0x7fecd81e0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.596+0000 7feccfe00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80c8cd0 0x7fecd80c7220 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fecc0005040 tx=0x7fecbc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.600+0000 7fecd4c00640 1 -- 172.21.15.59:0/2948388522 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc00054a0 con 0x7fecd80c8cd0 2024-05-30T16:59:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.600+0000 7fecd4c00640 1 -- 172.21.15.59:0/2948388522 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc0001500 con 0x7fecd80c8cd0 2024-05-30T16:59:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.600+0000 7fecd4c00640 1 -- 172.21.15.59:0/2948388522 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc00a8e30 con 0x7fecd80c8cd0 2024-05-30T16:59:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.600+0000 7fecdec00640 1 -- 172.21.15.59:0/2948388522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd80c7f10 con 0x7fecd80c8cd0 2024-05-30T16:59:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.600+0000 7fecdec00640 1 -- 172.21.15.59:0/2948388522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd80c84d0 con 0x7fecd80c8cd0 2024-05-30T16:59:37.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.600+0000 7fecdec00640 1 -- 172.21.15.59:0/2948388522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd8068a90 con 0x7fecd80c8cd0 2024-05-30T16:59:37.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.600+0000 7fecd4c00640 1 -- 172.21.15.59:0/2948388522 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fecc0003600 con 0x7fecd80c8cd0 2024-05-30T16:59:37.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.600+0000 7fecd4c00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fecb40694f0 0x7fecb406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.600+0000 7fecd4c00640 1 -- 172.21.15.59:0/2948388522 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5793+0+0 (secure 0 0 0) 0x7fecc0122c20 con 0x7fecd80c8cd0 2024-05-30T16:59:37.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.600+0000 7fecd7e00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fecb40694f0 0x7fecb406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.604+0000 7fecd7e00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fecb40694f0 0x7fecb406b9b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fecd81e9ad0 tx=0x7fecc8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.604+0000 7fecd4c00640 1 -- 172.21.15.59:0/2948388522 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fecc00c8020 con 0x7fecd80c8cd0 2024-05-30T16:59:37.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.768+0000 7fecdec00640 1 -- 172.21.15.59:0/2948388522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecd80b4be0 con 0x7fecd80c8cd0 2024-05-30T16:59:37.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecd4c00640 1 -- 172.21.15.59:0/2948388522 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16792 (secure 0 0 0) 0x7fecc0018a00 con 0x7fecd80c8cd0 2024-05-30T16:59:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:37.773 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":89,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:59:36.461078+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:59:34.157525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-05-30T16:59:35.464679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:59:37.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecdec00640 1 -- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fecb40694f0 msgr2=0x7fecb406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecdec00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fecb40694f0 0x7fecb406b9b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fecd81e9ad0 tx=0x7fecc8009040 comp rx=0 tx=0).stop 2024-05-30T16:59:37.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecdec00640 1 -- 172.21.15.59:0/2948388522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80c8cd0 msgr2=0x7fecd80c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecdec00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80c8cd0 0x7fecd80c7220 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fecc0005040 tx=0x7fecbc005840 comp rx=0 tx=0).stop 2024-05-30T16:59:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecdec00640 1 -- 172.21.15.59:0/2948388522 shutdown_connections 2024-05-30T16:59:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecdec00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fecb40694f0 0x7fecb406b9b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecdec00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecd80c7760 0x7fecd80b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecdec00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80c8cd0 0x7fecd80c7220 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecdec00640 1 --2- 172.21.15.59:0/2948388522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecbc0040e0 0x7fecd81e0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecdec00640 1 -- 172.21.15.59:0/2948388522 >> 172.21.15.59:0/2948388522 conn(0x7fecd80b3f80 msgr2=0x7fecd81e5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecdec00640 1 -- 172.21.15.59:0/2948388522 shutdown_connections 2024-05-30T16:59:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.772+0000 7fecdec00640 1 -- 172.21.15.59:0/2948388522 wait complete. 2024-05-30T16:59:37.796 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T16:59:37.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.936+0000 7f8c9ac00640 1 Processor -- start 2024-05-30T16:59:37.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.936+0000 7f8c9ac00640 1 -- start start 2024-05-30T16:59:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c9ac00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8c94159100 0x7f8c9406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c9ac00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c940b44e0 0x7f8c9415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c9ac00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c9415f510 0x7f8c9415c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c9ac00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f8c940b52d0 con 0x7f8c940b44e0 2024-05-30T16:59:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c9ac00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8c940b4a30 con 0x7f8c94159100 2024-05-30T16:59:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c9ac00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8c940b4d10 con 0x7f8c9415f510 2024-05-30T16:59:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c8be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c940b44e0 0x7f8c9415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c8be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c940b44e0 0x7f8c9415efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37944/0 (socket says 172.21.15.59:37944) 2024-05-30T16:59:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c8be00640 1 -- 172.21.15.59:0/1371074429 learned_addr learned my addr 172.21.15.59:0/1371074429 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:37.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c8be00640 1 -- 172.21.15.59:0/1371074429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c9415f510 msgr2=0x7f8c9415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:37.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c8be00640 1 --2- 172.21.15.59:0/1371074429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c9415f510 0x7f8c9415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c8be00640 1 -- 172.21.15.59:0/1371074429 >> v2:172.21.15.107:3300/0 conn(0x7f8c94159100 msgr2=0x7f8c9406e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:37.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c93e00640 1 --2- 172.21.15.59:0/1371074429 >> v2:172.21.15.107:3300/0 conn(0x7f8c94159100 0x7f8c9406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c8be00640 1 --2- 172.21.15.59:0/1371074429 >> v2:172.21.15.107:3300/0 conn(0x7f8c94159100 0x7f8c9406e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c8be00640 1 -- 172.21.15.59:0/1371074429 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c940b4ff0 con 0x7f8c940b44e0 2024-05-30T16:59:37.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.940+0000 7f8c93e00640 1 --2- 172.21.15.59:0/1371074429 >> v2:172.21.15.107:3300/0 conn(0x7f8c94159100 0x7f8c9406e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:37.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c8be00640 1 --2- 172.21.15.59:0/1371074429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c940b44e0 0x7f8c9415efd0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8c9406c8f0 tx=0x7f8c7c01eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b29f64bf32bcc23 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c93400640 1 -- 172.21.15.59:0/1371074429 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0b4070 con 0x7f8c940b44e0 2024-05-30T16:59:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c93400640 1 -- 172.21.15.59:0/1371074429 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c0a7ad0 con 0x7f8c940b44e0 2024-05-30T16:59:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c93400640 1 -- 172.21.15.59:0/1371074429 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0af440 con 0x7f8c940b44e0 2024-05-30T16:59:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 -- 172.21.15.59:0/1371074429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c940b44e0 msgr2=0x7f8c9415efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 --2- 172.21.15.59:0/1371074429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c940b44e0 0x7f8c9415efd0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8c9406c8f0 tx=0x7f8c7c01eb30 comp rx=0 tx=0).stop 2024-05-30T16:59:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 -- 172.21.15.59:0/1371074429 shutdown_connections 2024-05-30T16:59:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 --2- 172.21.15.59:0/1371074429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c9415f510 0x7f8c9415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 --2- 172.21.15.59:0/1371074429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c940b44e0 0x7f8c9415efd0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 --2- 172.21.15.59:0/1371074429 >> v2:172.21.15.107:3300/0 conn(0x7f8c94159100 0x7f8c9406e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 -- 172.21.15.59:0/1371074429 >> 172.21.15.59:0/1371074429 conn(0x7f8c9406bdb0 msgr2=0x7f8c9406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 -- 172.21.15.59:0/1371074429 shutdown_connections 2024-05-30T16:59:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 -- 172.21.15.59:0/1371074429 wait complete. 2024-05-30T16:59:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 Processor -- start 2024-05-30T16:59:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 -- start start 2024-05-30T16:59:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c940b44e0 0x7f8c9414b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c94159100 0x7f8c94155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9415f510 0x7f8c94156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8c940720c0 con 0x7f8c9415f510 2024-05-30T16:59:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8c94071f40 con 0x7f8c94159100 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.944+0000 7f8c9ac00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8c94072240 con 0x7f8c940b44e0 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c98c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9415f510 0x7f8c94156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c93e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c940b44e0 0x7f8c9414b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c8be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c94159100 0x7f8c94155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c98c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9415f510 0x7f8c94156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37950/0 (socket says 172.21.15.59:37950) 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c98c00640 1 -- 172.21.15.59:0/2885866653 learned_addr learned my addr 172.21.15.59:0/2885866653 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c98c00640 1 -- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c940b44e0 msgr2=0x7f8c9414b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c98c00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c940b44e0 0x7f8c9414b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c98c00640 1 -- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c94159100 msgr2=0x7f8c94155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c98c00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c94159100 0x7f8c94155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c98c00640 1 -- 172.21.15.59:0/2885866653 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c94156c60 con 0x7f8c9415f510 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c8be00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c94159100 0x7f8c94155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:59:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c98c00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9415f510 0x7f8c94156520 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00b9a0 tx=0x7f8c8c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c90c00640 1 -- 172.21.15.59:0/2885866653 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c019070 con 0x7f8c9415f510 2024-05-30T16:59:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c90c00640 1 -- 172.21.15.59:0/2885866653 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8c00cbc0 con 0x7f8c9415f510 2024-05-30T16:59:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c90c00640 1 -- 172.21.15.59:0/2885866653 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c014440 con 0x7f8c9415f510 2024-05-30T16:59:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c9ac00640 1 -- 172.21.15.59:0/2885866653 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9414f4e0 con 0x7f8c9415f510 2024-05-30T16:59:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c9ac00640 1 -- 172.21.15.59:0/2885866653 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c9414faa0 con 0x7f8c9415f510 2024-05-30T16:59:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.948+0000 7f8c9ac00640 1 -- 172.21.15.59:0/2885866653 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c94068a90 con 0x7f8c9415f510 2024-05-30T16:59:37.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.952+0000 7f8c90c00640 1 -- 172.21.15.59:0/2885866653 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f8c8c01c070 con 0x7f8c9415f510 2024-05-30T16:59:37.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.952+0000 7f8c90c00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c700694f0 0x7f8c7006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:37.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.952+0000 7f8c90c00640 1 -- 172.21.15.59:0/2885866653 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5793+0+0 (secure 0 0 0) 0x7f8c8c085530 con 0x7f8c9415f510 2024-05-30T16:59:37.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.952+0000 7f8c93e00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c700694f0 0x7f8c7006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:37.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.952+0000 7f8c93e00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c700694f0 0x7f8c7006b9b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400ab60 tx=0x7f8c84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:37.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:37.956+0000 7f8c90c00640 1 -- 172.21.15.59:0/2885866653 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8c8c056c00 con 0x7f8c9415f510 2024-05-30T16:59:38.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:38.160+0000 7f8c9ac00640 1 -- 172.21.15.59:0/2885866653 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8c9406ccd0 con 0x7f8c9415f510 2024-05-30T16:59:39.032 INFO:tasks.ceph.mds.d.smithi107.stderr:2024-05-30T16:59:39.030+0000 7f1385000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:59:39.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.076+0000 7f8c90c00640 1 -- 172.21.15.59:0/2885866653 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) ==== 118+0+0 (secure 0 0 0) 0x7f8c8c05af00 con 0x7f8c9415f510 2024-05-30T16:59:39.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.080+0000 7f8c9ac00640 1 -- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c700694f0 msgr2=0x7f8c7006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:39.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.080+0000 7f8c9ac00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c700694f0 0x7f8c7006b9b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400ab60 tx=0x7f8c84008040 comp rx=0 tx=0).stop 2024-05-30T16:59:39.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.080+0000 7f8c9ac00640 1 -- 172.21.15.59:0/2885866653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9415f510 msgr2=0x7f8c94156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:39.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.080+0000 7f8c9ac00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9415f510 0x7f8c94156520 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00b9a0 tx=0x7f8c8c00be60 comp rx=0 tx=0).stop 2024-05-30T16:59:39.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.080+0000 7f8c9ac00640 1 -- 172.21.15.59:0/2885866653 shutdown_connections 2024-05-30T16:59:39.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.080+0000 7f8c9ac00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c700694f0 0x7f8c7006b9b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:39.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.080+0000 7f8c9ac00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9415f510 0x7f8c94156520 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:39.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.080+0000 7f8c9ac00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c94159100 0x7f8c94155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:39.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.080+0000 7f8c9ac00640 1 --2- 172.21.15.59:0/2885866653 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c940b44e0 0x7f8c9414b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:39.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.080+0000 7f8c9ac00640 1 -- 172.21.15.59:0/2885866653 >> 172.21.15.59:0/2885866653 conn(0x7f8c9406bdb0 msgr2=0x7f8c94073270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:39.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.080+0000 7f8c9ac00640 1 -- 172.21.15.59:0/2885866653 shutdown_connections 2024-05-30T16:59:39.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.080+0000 7f8c9ac00640 1 -- 172.21.15.59:0/2885866653 wait complete. 2024-05-30T16:59:39.107 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T16:59:39.107 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T16:59:39.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.252+0000 7f72dde00640 1 Processor -- start 2024-05-30T16:59:39.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.252+0000 7f72dde00640 1 -- start start 2024-05-30T16:59:39.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72dde00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72d80c9e10 0x7f72d8141f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:39.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72dde00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f72d806bce0 0x7f72d806c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:39.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72dde00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d806d320 con 0x7f72d806ce90 2024-05-30T16:59:39.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72dde00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f72d8163260 con 0x7f72d80c9e10 2024-05-30T16:59:39.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72dde00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f72d81626e0 con 0x7f72d806bce0 2024-05-30T16:59:39.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72d6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72d80c9e10 0x7f72d8141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:39.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72ce000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f72d806ce90 0x7f72d80ca1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56772/0 (socket says 172.21.15.59:56772) 2024-05-30T16:59:39.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72ce000640 1 -- 172.21.15.59:0/1996042417 learned_addr learned my addr 172.21.15.59:0/1996042417 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:39.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72d6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72d80c9e10 0x7f72d8141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37958/0 (socket says 172.21.15.59:37958) 2024-05-30T16:59:39.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72d7400640 1 --2- 172.21.15.59:0/1996042417 >> v2:172.21.15.107:3300/0 conn(0x7f72d806bce0 0x7f72d806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:39.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72d6a00640 1 -- 172.21.15.59:0/1996042417 >> v2:172.21.15.107:3300/0 conn(0x7f72d806bce0 msgr2=0x7f72d806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:39.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72d6a00640 1 --2- 172.21.15.59:0/1996042417 >> v2:172.21.15.107:3300/0 conn(0x7f72d806bce0 0x7f72d806c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:39.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72d6a00640 1 -- 172.21.15.59:0/1996042417 >> v1:172.21.15.59:6789/0 conn(0x7f72d806ce90 legacy=0x7f72d80ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:39.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72d6a00640 1 -- 172.21.15.59:0/1996042417 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d81629c0 con 0x7f72d80c9e10 2024-05-30T16:59:39.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.256+0000 7f72d7400640 1 --2- 172.21.15.59:0/1996042417 >> v2:172.21.15.107:3300/0 conn(0x7f72d806bce0 0x7f72d806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:39.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72d6a00640 1 --2- 172.21.15.59:0/1996042417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d80c9e10 0x7f72d8141f20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f72d80b06d0 tx=0x7f72c801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5995dd01156ac7c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:39.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72d6000640 1 -- 172.21.15.59:0/1996042417 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c80b0070 con 0x7f72d80c9e10 2024-05-30T16:59:39.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72d6000640 1 -- 172.21.15.59:0/1996042417 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c8004230 con 0x7f72d80c9e10 2024-05-30T16:59:39.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72d6000640 1 -- 172.21.15.59:0/1996042417 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8003620 con 0x7f72d80c9e10 2024-05-30T16:59:39.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72dde00640 1 -- 172.21.15.59:0/1996042417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d80c9e10 msgr2=0x7f72d8141f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:39.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72dde00640 1 --2- 172.21.15.59:0/1996042417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d80c9e10 0x7f72d8141f20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f72d80b06d0 tx=0x7f72c801c330 comp rx=0 tx=0).stop 2024-05-30T16:59:39.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72dde00640 1 -- 172.21.15.59:0/1996042417 shutdown_connections 2024-05-30T16:59:39.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72dde00640 1 --2- 172.21.15.59:0/1996042417 >> v2:172.21.15.107:3300/0 conn(0x7f72d806bce0 0x7f72d806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:39.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72dde00640 1 --2- 172.21.15.59:0/1996042417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d80c9e10 0x7f72d8141f20 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:39.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72dde00640 1 -- 172.21.15.59:0/1996042417 >> 172.21.15.59:0/1996042417 conn(0x7f72d80cd540 msgr2=0x7f72d80cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:39.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72dde00640 1 -- 172.21.15.59:0/1996042417 shutdown_connections 2024-05-30T16:59:39.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72dde00640 1 -- 172.21.15.59:0/1996042417 wait complete. 2024-05-30T16:59:39.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72dde00640 1 Processor -- start 2024-05-30T16:59:39.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.260+0000 7f72dde00640 1 -- start start 2024-05-30T16:59:39.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72dde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72d806bce0 0x7f72d8160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:39.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72dde00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d806ce90 0x7f72d8141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:39.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72dde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d80c9e10 0x7f72d8142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:39.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72dde00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f72d81480d0 con 0x7f72d80c9e10 2024-05-30T16:59:39.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72dde00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f72d8162300 con 0x7f72d806bce0 2024-05-30T16:59:39.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72dde00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f72d80b6740 con 0x7f72d806ce90 2024-05-30T16:59:39.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72d7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d80c9e10 0x7f72d8142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:39.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72d7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d80c9e10 0x7f72d8142300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37960/0 (socket says 172.21.15.59:37960) 2024-05-30T16:59:39.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72d7400640 1 -- 172.21.15.59:0/645489184 learned_addr learned my addr 172.21.15.59:0/645489184 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:39.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72ce000640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d806ce90 0x7f72d8141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:39.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72d6a00640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72d806bce0 0x7f72d8160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72d7400640 1 -- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d806ce90 msgr2=0x7f72d8141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72d7400640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d806ce90 0x7f72d8141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72d7400640 1 -- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72d806bce0 msgr2=0x7f72d8160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72d7400640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72d806bce0 0x7f72d8160850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72d7400640 1 -- 172.21.15.59:0/645489184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d8160ee0 con 0x7f72d80c9e10 2024-05-30T16:59:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72d7400640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d80c9e10 0x7f72d8142300 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f72d0007e70 tx=0x7f72d000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:39.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72cfe00640 1 -- 172.21.15.59:0/645489184 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d001a070 con 0x7f72d80c9e10 2024-05-30T16:59:39.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72cfe00640 1 -- 172.21.15.59:0/645489184 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d0003bc0 con 0x7f72d80c9e10 2024-05-30T16:59:39.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72dde00640 1 -- 172.21.15.59:0/645489184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d81611c0 con 0x7f72d80c9e10 2024-05-30T16:59:39.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72cfe00640 1 -- 172.21.15.59:0/645489184 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0004030 con 0x7f72d80c9e10 2024-05-30T16:59:39.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72dde00640 1 -- 172.21.15.59:0/645489184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d8161780 con 0x7f72d80c9e10 2024-05-30T16:59:39.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72dde00640 1 -- 172.21.15.59:0/645489184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d8068a90 con 0x7f72d80c9e10 2024-05-30T16:59:39.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.264+0000 7f72cfe00640 1 -- 172.21.15.59:0/645489184 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f72d001d070 con 0x7f72d80c9e10 2024-05-30T16:59:39.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.268+0000 7f72cfe00640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f72b4069520 0x7f72b406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:39.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.268+0000 7f72cfe00640 1 -- 172.21.15.59:0/645489184 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5793+0+0 (secure 0 0 0) 0x7f72d0085b10 con 0x7f72d80c9e10 2024-05-30T16:59:39.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.268+0000 7f72d6a00640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f72b4069520 0x7f72b406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:39.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.268+0000 7f72d6a00640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f72b4069520 0x7f72b406b9e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f72c80ad000 tx=0x7f72c80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:39.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.272+0000 7f72cfe00640 1 -- 172.21.15.59:0/645489184 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f72d0010070 con 0x7f72d80c9e10 2024-05-30T16:59:39.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:39.476+0000 7f72dde00640 1 -- 172.21.15.59:0/645489184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f72d806cc70 con 0x7f72d80c9e10 2024-05-30T16:59:40.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.084+0000 7f72cfe00640 1 -- 172.21.15.59:0/645489184 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) ==== 122+0+0 (secure 0 0 0) 0x7f72d00577d0 con 0x7f72d80c9e10 2024-05-30T16:59:40.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.088+0000 7f72dde00640 1 -- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f72b4069520 msgr2=0x7f72b406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.088+0000 7f72dde00640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f72b4069520 0x7f72b406b9e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f72c80ad000 tx=0x7f72c80a6000 comp rx=0 tx=0).stop 2024-05-30T16:59:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.088+0000 7f72dde00640 1 -- 172.21.15.59:0/645489184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d80c9e10 msgr2=0x7f72d8142300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.088+0000 7f72dde00640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d80c9e10 0x7f72d8142300 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f72d0007e70 tx=0x7f72d000d4a0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.088+0000 7f72dde00640 1 -- 172.21.15.59:0/645489184 shutdown_connections 2024-05-30T16:59:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.088+0000 7f72dde00640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f72b4069520 0x7f72b406b9e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.088+0000 7f72dde00640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d80c9e10 0x7f72d8142300 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.088+0000 7f72dde00640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d806ce90 0x7f72d8141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.088+0000 7f72dde00640 1 --2- 172.21.15.59:0/645489184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72d806bce0 0x7f72d8160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.088+0000 7f72dde00640 1 -- 172.21.15.59:0/645489184 >> 172.21.15.59:0/645489184 conn(0x7f72d80cd540 msgr2=0x7f72d80cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.088+0000 7f72dde00640 1 -- 172.21.15.59:0/645489184 shutdown_connections 2024-05-30T16:59:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.088+0000 7f72dde00640 1 -- 172.21.15.59:0/645489184 wait complete. 2024-05-30T16:59:40.113 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T16:59:40.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:59:40.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.256+0000 7f58a5600640 1 Processor -- start 2024-05-30T16:59:40.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.256+0000 7f58a5600640 1 -- start start 2024-05-30T16:59:40.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f58a5600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58a006e900 0x7f58a015f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f58a5600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a00d0560 0x7f58a00d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f58a5600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a015f060 con 0x7f58a00af720 2024-05-30T16:59:40.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f58a5600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f58a00afb00 con 0x7f58a006e900 2024-05-30T16:59:40.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f58a5600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f58a015c270 con 0x7f58a00d0560 2024-05-30T16:59:40.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f5896000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58a006e900 0x7f58a015f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f5896000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58a006e900 0x7f58a015f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37966/0 (socket says 172.21.15.59:37966) 2024-05-30T16:59:40.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f5896000640 1 -- 172.21.15.59:0/3905181724 learned_addr learned my addr 172.21.15.59:0/3905181724 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:40.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f589f400640 1 --2- 172.21.15.59:0/3905181724 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a00d0560 0x7f58a00d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f5896000640 1 -- 172.21.15.59:0/3905181724 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a00d0560 msgr2=0x7f58a00d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:40.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f5896000640 1 --2- 172.21.15.59:0/3905181724 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a00d0560 0x7f58a00d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f5896000640 1 -- 172.21.15.59:0/3905181724 >> v1:172.21.15.107:6789/0 conn(0x7f58a00af720 legacy=0x7f58a015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f5896000640 1 -- 172.21.15.59:0/3905181724 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a015c550 con 0x7f58a006e900 2024-05-30T16:59:40.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.260+0000 7f5896000640 1 --2- 172.21.15.59:0/3905181724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a006e900 0x7f58a015f7f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5888009870 tx=0x7f588801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51ef590929ea3d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:40.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f589e000640 1 -- 172.21.15.59:0/3905181724 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58880b1070 con 0x7f58a006e900 2024-05-30T16:59:40.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f589e000640 1 -- 172.21.15.59:0/3905181724 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58880ac410 con 0x7f58a006e900 2024-05-30T16:59:40.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f589e000640 1 -- 172.21.15.59:0/3905181724 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58880ac7e0 con 0x7f58a006e900 2024-05-30T16:59:40.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 -- 172.21.15.59:0/3905181724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a006e900 msgr2=0x7f58a015f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 --2- 172.21.15.59:0/3905181724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a006e900 0x7f58a015f7f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5888009870 tx=0x7f588801c560 comp rx=0 tx=0).stop 2024-05-30T16:59:40.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 -- 172.21.15.59:0/3905181724 shutdown_connections 2024-05-30T16:59:40.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 --2- 172.21.15.59:0/3905181724 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a00d0560 0x7f58a00d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 --2- 172.21.15.59:0/3905181724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a006e900 0x7f58a015f7f0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 -- 172.21.15.59:0/3905181724 >> 172.21.15.59:0/3905181724 conn(0x7f58a00b22d0 msgr2=0x7f58a00b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:40.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 -- 172.21.15.59:0/3905181724 shutdown_connections 2024-05-30T16:59:40.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 -- 172.21.15.59:0/3905181724 wait complete. 2024-05-30T16:59:40.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 Processor -- start 2024-05-30T16:59:40.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 -- start start 2024-05-30T16:59:40.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a006e900 0x7f58a00cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58a00af720 0x7f58a00ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a00d0560 0x7f58a009d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58a00732d0 con 0x7f58a00d0560 2024-05-30T16:59:40.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0073150 con 0x7f58a00af720 2024-05-30T16:59:40.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f58a5600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f58a01585c0 con 0x7f58a006e900 2024-05-30T16:59:40.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f589f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a00d0560 0x7f58a009d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f589ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a006e900 0x7f58a00cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f5896000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58a00af720 0x7f58a00ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f589f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a00d0560 0x7f58a009d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37968/0 (socket says 172.21.15.59:37968) 2024-05-30T16:59:40.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f5896000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58a00af720 0x7f58a00ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:35102/0 (socket says 172.21.15.59:35102) 2024-05-30T16:59:40.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f589ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a006e900 0x7f58a00cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:46626/0 (socket says 172.21.15.59:46626) 2024-05-30T16:59:40.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.264+0000 7f589f400640 1 -- 172.21.15.59:0/1510733632 learned_addr learned my addr 172.21.15.59:0/1510733632 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:40.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f589f400640 1 -- 172.21.15.59:0/1510733632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a006e900 msgr2=0x7f58a00cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f589f400640 1 --2- 172.21.15.59:0/1510733632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a006e900 0x7f58a00cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f589f400640 1 -- 172.21.15.59:0/1510733632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58a00af720 msgr2=0x7f58a00ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f589f400640 1 --2- 172.21.15.59:0/1510733632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58a00af720 0x7f58a00ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f589f400640 1 -- 172.21.15.59:0/1510733632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a0165b10 con 0x7f58a00d0560 2024-05-30T16:59:40.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f589f400640 1 --2- 172.21.15.59:0/1510733632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a00d0560 0x7f58a009d930 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f5898007e60 tx=0x7f589800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:40.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f5897400640 1 -- 172.21.15.59:0/1510733632 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898014420 con 0x7f58a00d0560 2024-05-30T16:59:40.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f5897400640 1 -- 172.21.15.59:0/1510733632 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5898019070 con 0x7f58a00d0560 2024-05-30T16:59:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f5897400640 1 -- 172.21.15.59:0/1510733632 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898014820 con 0x7f58a00d0560 2024-05-30T16:59:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f58a5600640 1 -- 172.21.15.59:0/1510733632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a00cd770 con 0x7f58a00d0560 2024-05-30T16:59:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f58a5600640 1 -- 172.21.15.59:0/1510733632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a00cdd30 con 0x7f58a00d0560 2024-05-30T16:59:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f58a5600640 1 -- 172.21.15.59:0/1510733632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a0068a90 con 0x7f58a00d0560 2024-05-30T16:59:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f5897400640 1 -- 172.21.15.59:0/1510733632 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f58980149c0 con 0x7f58a00d0560 2024-05-30T16:59:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f5897400640 1 --2- 172.21.15.59:0/1510733632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f587c0694f0 0x7f587c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.268+0000 7f5897400640 1 -- 172.21.15.59:0/1510733632 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5793+0+0 (secure 0 0 0) 0x7f5898085fe0 con 0x7f58a00d0560 2024-05-30T16:59:40.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.272+0000 7f589ea00640 1 --2- 172.21.15.59:0/1510733632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f587c0694f0 0x7f587c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.272+0000 7f589ea00640 1 --2- 172.21.15.59:0/1510733632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f587c0694f0 0x7f587c06b9b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5890001810 tx=0x7f5890009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:40.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.276+0000 7f5897400640 1 -- 172.21.15.59:0/1510733632 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5898057650 con 0x7f58a00d0560 2024-05-30T16:59:40.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.472+0000 7f58a5600640 1 -- 172.21.15.59:0/1510733632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58a00ccd00 con 0x7f58a00d0560 2024-05-30T16:59:40.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.472+0000 7f5897400640 1 -- 172.21.15.59:0/1510733632 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5186 (secure 0 0 0) 0x7f589805b950 con 0x7f58a00d0560 2024-05-30T16:59:40.475 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:40.475 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2633891859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2633891859},{"type":"v1","addr":"172.21.15.59:6835","nonce":2633891859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6865,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3975520725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3975520725},{"type":"v1","addr":"172.21.15.107:6836","nonce":3975520725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/456119548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":456119548},{"type":"v1","addr":"172.21.15.59:6834","nonce":456119548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:59:36.461027+0000","modified":"2024-05-30T16:59:39.481680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7449},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7449":{"gid":7449,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/1253475085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1253475085},{"type":"v1","addr":"172.21.15.107:6837","nonce":1253475085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7449,"qdb_cluster":[7449]},"id":6}]} 2024-05-30T16:59:40.476 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 52 2024-05-30T16:59:40.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.476+0000 7f58a5600640 1 -- 172.21.15.59:0/1510733632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f587c0694f0 msgr2=0x7f587c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.476+0000 7f58a5600640 1 --2- 172.21.15.59:0/1510733632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f587c0694f0 0x7f587c06b9b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5890001810 tx=0x7f5890009040 comp rx=0 tx=0).stop 2024-05-30T16:59:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.476+0000 7f58a5600640 1 -- 172.21.15.59:0/1510733632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a00d0560 msgr2=0x7f58a009d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.476+0000 7f58a5600640 1 --2- 172.21.15.59:0/1510733632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a00d0560 0x7f58a009d930 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f5898007e60 tx=0x7f589800e4b0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.476+0000 7f58a5600640 1 -- 172.21.15.59:0/1510733632 shutdown_connections 2024-05-30T16:59:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.476+0000 7f58a5600640 1 --2- 172.21.15.59:0/1510733632 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f587c0694f0 0x7f587c06b9b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.476+0000 7f58a5600640 1 --2- 172.21.15.59:0/1510733632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a00d0560 0x7f58a009d930 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.476+0000 7f58a5600640 1 --2- 172.21.15.59:0/1510733632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58a00af720 0x7f58a00ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.476+0000 7f58a5600640 1 --2- 172.21.15.59:0/1510733632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58a006e900 0x7f58a00cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.476+0000 7f58a5600640 1 -- 172.21.15.59:0/1510733632 >> 172.21.15.59:0/1510733632 conn(0x7f58a00b22d0 msgr2=0x7f58a00b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.476+0000 7f58a5600640 1 -- 172.21.15.59:0/1510733632 shutdown_connections 2024-05-30T16:59:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.476+0000 7f58a5600640 1 -- 172.21.15.59:0/1510733632 wait complete. 2024-05-30T16:59:40.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:59:40.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9b0a00640 1 Processor -- start 2024-05-30T16:59:40.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9b0a00640 1 -- start start 2024-05-30T16:59:40.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9b0a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb9ac0cfa40 0x7fb9ac15ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9b0a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9ac0cfe20 0x7fb9ac0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9b0a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ac15f3b0 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9b0a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ac15f690 con 0x7fb9ac0cfe20 2024-05-30T16:59:40.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9b0a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ac15f970 con 0x7fb9ac0cfa40 2024-05-30T16:59:40.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9a1400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9ac0cfe20 0x7fb9ac0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9a1400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9ac0cfe20 0x7fb9ac0b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37970/0 (socket says 172.21.15.59:37970) 2024-05-30T16:59:40.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9a1400640 1 -- 172.21.15.59:0/4076159516 learned_addr learned my addr 172.21.15.59:0/4076159516 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:40.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9a9e00640 1 --2- 172.21.15.59:0/4076159516 >> v2:172.21.15.107:3300/0 conn(0x7fb9ac0cfa40 0x7fb9ac15ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9a1400640 1 -- 172.21.15.59:0/4076159516 >> v2:172.21.15.107:3300/0 conn(0x7fb9ac0cfa40 msgr2=0x7fb9ac15ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:40.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9a1400640 1 --2- 172.21.15.59:0/4076159516 >> v2:172.21.15.107:3300/0 conn(0x7fb9ac0cfa40 0x7fb9ac15ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9a1400640 1 -- 172.21.15.59:0/4076159516 >> v1:172.21.15.107:6789/0 conn(0x7fb9ac0b3dd0 legacy=0x7fb9ac072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.636+0000 7fb9a1400640 1 -- 172.21.15.59:0/4076159516 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac0b3370 con 0x7fb9ac0cfe20 2024-05-30T16:59:40.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.640+0000 7fb9a1400640 1 --2- 172.21.15.59:0/4076159516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9ac0cfe20 0x7fb9ac0b3890 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac06d820 tx=0x7fb99401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bcdc21233fef3e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:40.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.640+0000 7fb9a9400640 1 -- 172.21.15.59:0/4076159516 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9940a57d0 con 0x7fb9ac0cfe20 2024-05-30T16:59:40.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.640+0000 7fb9a9400640 1 -- 172.21.15.59:0/4076159516 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9940a5970 con 0x7fb9ac0cfe20 2024-05-30T16:59:40.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.640+0000 7fb9a9400640 1 -- 172.21.15.59:0/4076159516 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9940a5d40 con 0x7fb9ac0cfe20 2024-05-30T16:59:40.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.640+0000 7fb9b0a00640 1 -- 172.21.15.59:0/4076159516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9ac0cfe20 msgr2=0x7fb9ac0b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.640+0000 7fb9b0a00640 1 --2- 172.21.15.59:0/4076159516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9ac0cfe20 0x7fb9ac0b3890 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac06d820 tx=0x7fb99401c9f0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.640+0000 7fb9b0a00640 1 -- 172.21.15.59:0/4076159516 shutdown_connections 2024-05-30T16:59:40.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.640+0000 7fb9b0a00640 1 --2- 172.21.15.59:0/4076159516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9ac0cfe20 0x7fb9ac0b3890 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.640+0000 7fb9b0a00640 1 --2- 172.21.15.59:0/4076159516 >> v2:172.21.15.107:3300/0 conn(0x7fb9ac0cfa40 0x7fb9ac15ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.640+0000 7fb9b0a00640 1 -- 172.21.15.59:0/4076159516 >> 172.21.15.59:0/4076159516 conn(0x7fb9ac0b22d0 msgr2=0x7fb9ac0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:40.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.640+0000 7fb9b0a00640 1 -- 172.21.15.59:0/4076159516 shutdown_connections 2024-05-30T16:59:40.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.640+0000 7fb9b0a00640 1 -- 172.21.15.59:0/4076159516 wait complete. 2024-05-30T16:59:40.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9b0a00640 1 Processor -- start 2024-05-30T16:59:40.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9b0a00640 1 -- start start 2024-05-30T16:59:40.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9b0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9ac0b3dd0 0x7fb9ac151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9b0a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac0cfa40 0x7fb9ac154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9b0a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb9ac0cfe20 0x7fb9ac14dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9b0a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac155210 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9b0a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac155090 con 0x7fb9ac0cfa40 2024-05-30T16:59:40.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9b0a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb9ac155390 con 0x7fb9ac0cfe20 2024-05-30T16:59:40.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9ac0b3dd0 0x7fb9ac151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9ac0b3dd0 0x7fb9ac151870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37972/0 (socket says 172.21.15.59:37972) 2024-05-30T16:59:40.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a9e00640 1 -- 172.21.15.59:0/2290009970 learned_addr learned my addr 172.21.15.59:0/2290009970 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:40.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a1400640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac0cfa40 0x7fb9ac154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9aa800640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb9ac0cfe20 0x7fb9ac14dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a9e00640 1 -- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb9ac0cfe20 msgr2=0x7fb9ac14dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a9e00640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb9ac0cfe20 0x7fb9ac14dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a9e00640 1 -- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac0cfa40 msgr2=0x7fb9ac154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a9e00640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac0cfa40 0x7fb9ac154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a9e00640 1 -- 172.21.15.59:0/2290009970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac1578d0 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a9e00640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9ac0b3dd0 0x7fb9ac151870 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00e960 tx=0x7fb99c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:40.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a2a00640 1 -- 172.21.15.59:0/2290009970 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c017070 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a2a00640 1 -- 172.21.15.59:0/2290009970 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99c00ca00 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9b0a00640 1 -- 172.21.15.59:0/2290009970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ac157bb0 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9a2a00640 1 -- 172.21.15.59:0/2290009970 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c00cdb0 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.644+0000 7fb9b0a00640 1 -- 172.21.15.59:0/2290009970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ac158170 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.648+0000 7fb9b0a00640 1 -- 172.21.15.59:0/2290009970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ac068a90 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.648+0000 7fb9a2a00640 1 -- 172.21.15.59:0/2290009970 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fb99c01a070 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.648+0000 7fb9a2a00640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb988069520 0x7fb98806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.648+0000 7fb9a2a00640 1 -- 172.21.15.59:0/2290009970 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5793+0+0 (secure 0 0 0) 0x7fb99c085bd0 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.648+0000 7fb9a1400640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb988069520 0x7fb98806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.648+0000 7fb9a1400640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb988069520 0x7fb98806b9e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb9940ae000 tx=0x7fb9940a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:40.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.652+0000 7fb9a2a00640 1 -- 172.21.15.59:0/2290009970 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb99c057240 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.816+0000 7fb9b0a00640 1 -- 172.21.15.59:0/2290009970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9ac0b2a20 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9a2a00640 1 -- 172.21.15.59:0/2290009970 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+16779 (secure 0 0 0) 0x7fb99c05b540 con 0x7fb9ac0b3dd0 2024-05-30T16:59:40.821 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:40.821 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":90,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T16:59:38.055104+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:59:34.157525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-05-30T16:59:35.464679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:59:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9b0a00640 1 -- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb988069520 msgr2=0x7fb98806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9b0a00640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb988069520 0x7fb98806b9e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb9940ae000 tx=0x7fb9940a7070 comp rx=0 tx=0).stop 2024-05-30T16:59:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9b0a00640 1 -- 172.21.15.59:0/2290009970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9ac0b3dd0 msgr2=0x7fb9ac151870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9b0a00640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9ac0b3dd0 0x7fb9ac151870 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00e960 tx=0x7fb99c00ee20 comp rx=0 tx=0).stop 2024-05-30T16:59:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9b0a00640 1 -- 172.21.15.59:0/2290009970 shutdown_connections 2024-05-30T16:59:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9b0a00640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb988069520 0x7fb98806b9e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9b0a00640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb9ac0cfe20 0x7fb9ac14dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9b0a00640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac0cfa40 0x7fb9ac154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9b0a00640 1 --2- 172.21.15.59:0/2290009970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9ac0b3dd0 0x7fb9ac151870 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9b0a00640 1 -- 172.21.15.59:0/2290009970 >> 172.21.15.59:0/2290009970 conn(0x7fb9ac0b22d0 msgr2=0x7fb9ac072980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9b0a00640 1 -- 172.21.15.59:0/2290009970 shutdown_connections 2024-05-30T16:59:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.820+0000 7fb9b0a00640 1 -- 172.21.15.59:0/2290009970 wait complete. 2024-05-30T16:59:40.842 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:59:40.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:59:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.980+0000 7f3381c00640 1 Processor -- start 2024-05-30T16:59:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f3381c00640 1 -- start start 2024-05-30T16:59:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f3381c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f337c0d14c0 0x7f337c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f3381c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f337c0d05b0 0x7f337c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f3381c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c06ea20 con 0x7f337c09af80 2024-05-30T16:59:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f3381c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f337c070950 con 0x7f337c0d14c0 2024-05-30T16:59:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f3381c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f337c070c30 con 0x7f337c0d05b0 2024-05-30T16:59:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f337aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f337c0d14c0 0x7f337c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f337b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f337c09af80 0x7f337c162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56788/0 (socket says 172.21.15.59:56788) 2024-05-30T16:59:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f337b400640 1 -- 172.21.15.59:0/3493755300 learned_addr learned my addr 172.21.15.59:0/3493755300 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f3373e00640 1 --2- 172.21.15.59:0/3493755300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f337c0d05b0 0x7f337c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f337aa00640 1 -- 172.21.15.59:0/3493755300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f337c0d05b0 msgr2=0x7f337c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f337aa00640 1 --2- 172.21.15.59:0/3493755300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f337c0d05b0 0x7f337c09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f337aa00640 1 -- 172.21.15.59:0/3493755300 >> v1:172.21.15.59:6789/0 conn(0x7f337c09af80 legacy=0x7f337c162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f337aa00640 1 -- 172.21.15.59:0/3493755300 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c070f10 con 0x7f337c0d14c0 2024-05-30T16:59:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f3373e00640 1 --2- 172.21.15.59:0/3493755300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f337c0d05b0 0x7f337c09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.984+0000 7f337a000640 1 -- 172.21.15.59:0/3493755300 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344154002 0 0) 0x7f33740014a0 con 0x7f337c09af80 2024-05-30T16:59:40.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f337aa00640 1 --2- 172.21.15.59:0/3493755300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f337c0d14c0 0x7f337c06e4e0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f336c0097c0 tx=0x7f336c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d239e572654f886 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:40.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f337a000640 1 -- 172.21.15.59:0/3493755300 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0b0070 con 0x7f337c0d14c0 2024-05-30T16:59:40.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f337a000640 1 -- 172.21.15.59:0/3493755300 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c0ab600 con 0x7f337c0d14c0 2024-05-30T16:59:40.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f337a000640 1 -- 172.21.15.59:0/3493755300 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0ab9d0 con 0x7f337c0d14c0 2024-05-30T16:59:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f3381c00640 1 -- 172.21.15.59:0/3493755300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f337c0d14c0 msgr2=0x7f337c06e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f3381c00640 1 --2- 172.21.15.59:0/3493755300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f337c0d14c0 0x7f337c06e4e0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f336c0097c0 tx=0x7f336c01c4a0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f3381c00640 1 -- 172.21.15.59:0/3493755300 shutdown_connections 2024-05-30T16:59:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f3381c00640 1 --2- 172.21.15.59:0/3493755300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f337c0d05b0 0x7f337c09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f3381c00640 1 --2- 172.21.15.59:0/3493755300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f337c0d14c0 0x7f337c06e4e0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f3381c00640 1 -- 172.21.15.59:0/3493755300 >> 172.21.15.59:0/3493755300 conn(0x7f337c0b3f80 msgr2=0x7f337c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f3381c00640 1 -- 172.21.15.59:0/3493755300 shutdown_connections 2024-05-30T16:59:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f3381c00640 1 -- 172.21.15.59:0/3493755300 wait complete. 2024-05-30T16:59:40.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f3381c00640 1 Processor -- start 2024-05-30T16:59:40.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.988+0000 7f3381c00640 1 -- start start 2024-05-30T16:59:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3381c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f337c09af80 0x7f337c14a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3381c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f337c0d05b0 0x7f337c15ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3381c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f337c0d14c0 0x7f337c15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3381c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f337c0d0b10 con 0x7f337c09af80 2024-05-30T16:59:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3381c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f337c0d0990 con 0x7f337c0d05b0 2024-05-30T16:59:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3381c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f337c06e100 con 0x7f337c0d14c0 2024-05-30T16:59:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f337aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f337c09af80 0x7f337c14a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f337aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f337c09af80 0x7f337c14a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37992/0 (socket says 172.21.15.59:37992) 2024-05-30T16:59:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f337aa00640 1 -- 172.21.15.59:0/3325658593 learned_addr learned my addr 172.21.15.59:0/3325658593 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3373e00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f337c0d05b0 0x7f337c15ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f337b400640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f337c0d14c0 0x7f337c15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f337aa00640 1 -- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f337c0d14c0 msgr2=0x7f337c15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f337aa00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f337c0d14c0 0x7f337c15efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f337aa00640 1 -- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f337c0d05b0 msgr2=0x7f337c15ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:40.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f337aa00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f337c0d05b0 0x7f337c15ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:40.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f337aa00640 1 -- 172.21.15.59:0/3325658593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c0695f0 con 0x7f337c09af80 2024-05-30T16:59:40.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f337b400640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f337c0d14c0 0x7f337c15efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:40.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f337aa00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f337c09af80 0x7f337c14a000 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f336c01a0d0 tx=0x7f336c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3372a00640 1 -- 172.21.15.59:0/3325658593 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0b0050 con 0x7f337c09af80 2024-05-30T16:59:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3372a00640 1 -- 172.21.15.59:0/3325658593 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c0bc070 con 0x7f337c09af80 2024-05-30T16:59:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3372a00640 1 -- 172.21.15.59:0/3325658593 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0b5a30 con 0x7f337c09af80 2024-05-30T16:59:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3381c00640 1 -- 172.21.15.59:0/3325658593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337c0b6100 con 0x7f337c09af80 2024-05-30T16:59:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3381c00640 1 -- 172.21.15.59:0/3325658593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337c0cc1b0 con 0x7f337c09af80 2024-05-30T16:59:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3381c00640 1 -- 172.21.15.59:0/3325658593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f337c068a90 con 0x7f337c09af80 2024-05-30T16:59:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.992+0000 7f3372a00640 1 -- 172.21.15.59:0/3325658593 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f336c0ab4c0 con 0x7f337c09af80 2024-05-30T16:59:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.996+0000 7f3372a00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f33580694f0 0x7f335806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.996+0000 7f3372a00640 1 -- 172.21.15.59:0/3325658593 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5793+0+0 (secure 0 0 0) 0x7f336c120b30 con 0x7f337c09af80 2024-05-30T16:59:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.996+0000 7f3373e00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f33580694f0 0x7f335806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.996+0000 7f3373e00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f33580694f0 0x7f335806b9b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f337c1602f0 tx=0x7f3364008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:40.996+0000 7f3372a00640 1 -- 172.21.15.59:0/3325658593 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f336c016090 con 0x7f337c09af80 2024-05-30T16:59:41.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.160+0000 7f3381c00640 1 -- 172.21.15.59:0/3325658593 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f337c0d2270 con 0x7f33580694f0 2024-05-30T16:59:41.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3372a00640 1 -- 172.21.15.59:0/3325658593 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251774 (secure 0 0 0) 0x7f337c0d2270 con 0x7f33580694f0 2024-05-30T16:59:41.171 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:41.172 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:59:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3381c00640 1 -- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f33580694f0 msgr2=0x7f335806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3381c00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f33580694f0 0x7f335806b9b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f337c1602f0 tx=0x7f3364008040 comp rx=0 tx=0).stop 2024-05-30T16:59:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3381c00640 1 -- 172.21.15.59:0/3325658593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f337c09af80 msgr2=0x7f337c14a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3381c00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f337c09af80 0x7f337c14a000 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f336c01a0d0 tx=0x7f336c01ace0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3381c00640 1 -- 172.21.15.59:0/3325658593 shutdown_connections 2024-05-30T16:59:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3381c00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f33580694f0 0x7f335806b9b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3381c00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f337c0d14c0 0x7f337c15efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3381c00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f337c0d05b0 0x7f337c15ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3381c00640 1 --2- 172.21.15.59:0/3325658593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f337c09af80 0x7f337c14a000 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3381c00640 1 -- 172.21.15.59:0/3325658593 >> 172.21.15.59:0/3325658593 conn(0x7f337c0b3f80 msgr2=0x7f337c162450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3381c00640 1 -- 172.21.15.59:0/3325658593 shutdown_connections 2024-05-30T16:59:41.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.168+0000 7f3381c00640 1 -- 172.21.15.59:0/3325658593 wait complete. 2024-05-30T16:59:41.191 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":407,"stamp":"2024-05-30T16:59:39.307099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":750012,"kb_used_data":9592,"kb_used_omap":12,"kb_used_meta":740275,"kb_avail":754224708,"statfs":{"total":773094113280,"available":772326100992,"internally_reserved":0,"allocated":9822208,"data_stored":4874819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":758042160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.259248"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097792+0000","last_change":"2024-05-30T16:59:37.093203+0000","last_active":"2024-05-30T16:59:37.097792+0000","last_peered":"2024-05-30T16:59:37.097792+0000","last_clean":"2024-05-30T16:59:37.097792+0000","last_became_active":"2024-05-30T16:59:37.092105+0000","last_became_peered":"2024-05-30T16:59:37.092105+0000","last_unstale":"2024-05-30T16:59:37.097792+0000","last_undegraded":"2024-05-30T16:59:37.097792+0000","last_fullsized":"2024-05-30T16:59:37.097792+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:49.431377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097664+0000","last_change":"2024-05-30T16:59:37.093116+0000","last_active":"2024-05-30T16:59:37.097664+0000","last_peered":"2024-05-30T16:59:37.097664+0000","last_clean":"2024-05-30T16:59:37.097664+0000","last_became_active":"2024-05-30T16:59:37.092861+0000","last_became_peered":"2024-05-30T16:59:37.092861+0000","last_unstale":"2024-05-30T16:59:37.097664+0000","last_undegraded":"2024-05-30T16:59:37.097664+0000","last_fullsized":"2024-05-30T16:59:37.097664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:00:31.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096113+0000","last_change":"2024-05-30T16:59:37.092582+0000","last_active":"2024-05-30T16:59:37.096113+0000","last_peered":"2024-05-30T16:59:37.096113+0000","last_clean":"2024-05-30T16:59:37.096113+0000","last_became_active":"2024-05-30T16:59:37.092334+0000","last_became_peered":"2024-05-30T16:59:37.092334+0000","last_unstale":"2024-05-30T16:59:37.096113+0000","last_undegraded":"2024-05-30T16:59:37.096113+0000","last_fullsized":"2024-05-30T16:59:37.096113+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:03:20.704600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.085330+0000","last_change":"2024-05-30T16:59:37.082085+0000","last_active":"2024-05-30T16:59:37.085330+0000","last_peered":"2024-05-30T16:59:37.085330+0000","last_clean":"2024-05-30T16:59:37.085330+0000","last_became_active":"2024-05-30T16:59:37.081821+0000","last_became_peered":"2024-05-30T16:59:37.081821+0000","last_unstale":"2024-05-30T16:59:37.085330+0000","last_undegraded":"2024-05-30T16:59:37.085330+0000","last_fullsized":"2024-05-30T16:59:37.085330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:34.423495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088413+0000","last_change":"2024-05-30T16:59:37.085960+0000","last_active":"2024-05-30T16:59:37.088413+0000","last_peered":"2024-05-30T16:59:37.088413+0000","last_clean":"2024-05-30T16:59:37.088413+0000","last_became_active":"2024-05-30T16:59:37.085666+0000","last_became_peered":"2024-05-30T16:59:37.085666+0000","last_unstale":"2024-05-30T16:59:37.088413+0000","last_undegraded":"2024-05-30T16:59:37.088413+0000","last_fullsized":"2024-05-30T16:59:37.088413+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:49.431377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.074647+0000","last_change":"2024-05-30T16:59:37.072380+0000","last_active":"2024-05-30T16:59:37.074647+0000","last_peered":"2024-05-30T16:59:37.074647+0000","last_clean":"2024-05-30T16:59:37.074647+0000","last_became_active":"2024-05-30T16:59:37.072034+0000","last_became_peered":"2024-05-30T16:59:37.072034+0000","last_unstale":"2024-05-30T16:59:37.074647+0000","last_undegraded":"2024-05-30T16:59:37.074647+0000","last_fullsized":"2024-05-30T16:59:37.074647+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:49.431377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.077765+0000","last_change":"2024-05-30T16:59:37.076182+0000","last_active":"2024-05-30T16:59:37.077765+0000","last_peered":"2024-05-30T16:59:37.077765+0000","last_clean":"2024-05-30T16:59:37.077765+0000","last_became_active":"2024-05-30T16:59:37.075914+0000","last_became_peered":"2024-05-30T16:59:37.075914+0000","last_unstale":"2024-05-30T16:59:37.077765+0000","last_undegraded":"2024-05-30T16:59:37.077765+0000","last_fullsized":"2024-05-30T16:59:37.077765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:28.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.085938+0000","last_change":"2024-05-30T16:59:37.078450+0000","last_active":"2024-05-30T16:59:37.085938+0000","last_peered":"2024-05-30T16:59:37.085938+0000","last_clean":"2024-05-30T16:59:37.085938+0000","last_became_active":"2024-05-30T16:59:37.078165+0000","last_became_peered":"2024-05-30T16:59:37.078165+0000","last_unstale":"2024-05-30T16:59:37.085938+0000","last_undegraded":"2024-05-30T16:59:37.085938+0000","last_fullsized":"2024-05-30T16:59:37.085938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:09.831864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.092466+0000","last_change":"2024-05-30T16:59:37.082510+0000","last_active":"2024-05-30T16:59:37.092466+0000","last_peered":"2024-05-30T16:59:37.092466+0000","last_clean":"2024-05-30T16:59:37.092466+0000","last_became_active":"2024-05-30T16:59:37.082213+0000","last_became_peered":"2024-05-30T16:59:37.082213+0000","last_unstale":"2024-05-30T16:59:37.092466+0000","last_undegraded":"2024-05-30T16:59:37.092466+0000","last_fullsized":"2024-05-30T16:59:37.092466+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:38.192437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094915+0000","last_change":"2024-05-30T16:59:37.091906+0000","last_active":"2024-05-30T16:59:37.094915+0000","last_peered":"2024-05-30T16:59:37.094915+0000","last_clean":"2024-05-30T16:59:37.094915+0000","last_became_active":"2024-05-30T16:59:37.091488+0000","last_became_peered":"2024-05-30T16:59:37.091488+0000","last_unstale":"2024-05-30T16:59:37.094915+0000","last_undegraded":"2024-05-30T16:59:37.094915+0000","last_fullsized":"2024-05-30T16:59:37.094915+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:14:10.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093509+0000","last_change":"2024-05-30T16:59:37.081319+0000","last_active":"2024-05-30T16:59:37.093509+0000","last_peered":"2024-05-30T16:59:37.093509+0000","last_clean":"2024-05-30T16:59:37.093509+0000","last_became_active":"2024-05-30T16:59:37.078930+0000","last_became_peered":"2024-05-30T16:59:37.078930+0000","last_unstale":"2024-05-30T16:59:37.093509+0000","last_undegraded":"2024-05-30T16:59:37.093509+0000","last_fullsized":"2024-05-30T16:59:37.093509+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:31.036487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094961+0000","last_change":"2024-05-30T16:59:37.091682+0000","last_active":"2024-05-30T16:59:37.094961+0000","last_peered":"2024-05-30T16:59:37.094961+0000","last_clean":"2024-05-30T16:59:37.094961+0000","last_became_active":"2024-05-30T16:59:37.091372+0000","last_became_peered":"2024-05-30T16:59:37.091372+0000","last_unstale":"2024-05-30T16:59:37.094961+0000","last_undegraded":"2024-05-30T16:59:37.094961+0000","last_fullsized":"2024-05-30T16:59:37.094961+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:18.838783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.082590+0000","last_change":"2024-05-30T16:59:37.080801+0000","last_active":"2024-05-30T16:59:37.082590+0000","last_peered":"2024-05-30T16:59:37.082590+0000","last_clean":"2024-05-30T16:59:37.082590+0000","last_became_active":"2024-05-30T16:59:37.080526+0000","last_became_peered":"2024-05-30T16:59:37.080526+0000","last_unstale":"2024-05-30T16:59:37.082590+0000","last_undegraded":"2024-05-30T16:59:37.082590+0000","last_fullsized":"2024-05-30T16:59:37.082590+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:52:53.010477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.090436+0000","last_change":"2024-05-30T16:59:37.087845+0000","last_active":"2024-05-30T16:59:37.090436+0000","last_peered":"2024-05-30T16:59:37.090436+0000","last_clean":"2024-05-30T16:59:37.090436+0000","last_became_active":"2024-05-30T16:59:37.085959+0000","last_became_peered":"2024-05-30T16:59:37.085959+0000","last_unstale":"2024-05-30T16:59:37.090436+0000","last_undegraded":"2024-05-30T16:59:37.090436+0000","last_fullsized":"2024-05-30T16:59:37.090436+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:31.036487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2024-05-30T16:59:36.074732+0000","last_change":"2024-05-30T16:59:36.074732+0000","last_active":"2024-05-30T16:59:36.046240+0000","last_peered":"2024-05-30T16:59:36.046240+0000","last_clean":"2024-05-30T16:59:36.046240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:59:36.074732+0000","last_undegraded":"2024-05-30T16:59:36.074732+0000","last_fullsized":"2024-05-30T16:59:36.074732+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.090844+0000","last_change":"2024-05-30T16:59:37.090158+0000","last_active":"2024-05-30T16:59:37.090844+0000","last_peered":"2024-05-30T16:59:37.090844+0000","last_clean":"2024-05-30T16:59:37.090844+0000","last_became_active":"2024-05-30T16:59:37.089875+0000","last_became_peered":"2024-05-30T16:59:37.089875+0000","last_unstale":"2024-05-30T16:59:37.090844+0000","last_undegraded":"2024-05-30T16:59:37.090844+0000","last_fullsized":"2024-05-30T16:59:37.090844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:09.831864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088754+0000","last_change":"2024-05-30T16:59:37.084968+0000","last_active":"2024-05-30T16:59:37.088754+0000","last_peered":"2024-05-30T16:59:37.088754+0000","last_clean":"2024-05-30T16:59:37.088754+0000","last_became_active":"2024-05-30T16:59:37.084679+0000","last_became_peered":"2024-05-30T16:59:37.084679+0000","last_unstale":"2024-05-30T16:59:37.088754+0000","last_undegraded":"2024-05-30T16:59:37.088754+0000","last_fullsized":"2024-05-30T16:59:37.088754+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:18.838783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094819+0000","last_change":"2024-05-30T16:59:37.092473+0000","last_active":"2024-05-30T16:59:37.094819+0000","last_peered":"2024-05-30T16:59:37.094819+0000","last_clean":"2024-05-30T16:59:37.094819+0000","last_became_active":"2024-05-30T16:59:37.092195+0000","last_became_peered":"2024-05-30T16:59:37.092195+0000","last_unstale":"2024-05-30T16:59:37.094819+0000","last_undegraded":"2024-05-30T16:59:37.094819+0000","last_fullsized":"2024-05-30T16:59:37.094819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:26.963969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.090323+0000","last_change":"2024-05-30T16:59:37.086366+0000","last_active":"2024-05-30T16:59:37.090323+0000","last_peered":"2024-05-30T16:59:37.090323+0000","last_clean":"2024-05-30T16:59:37.090323+0000","last_became_active":"2024-05-30T16:59:37.086008+0000","last_became_peered":"2024-05-30T16:59:37.086008+0000","last_unstale":"2024-05-30T16:59:37.090323+0000","last_undegraded":"2024-05-30T16:59:37.090323+0000","last_fullsized":"2024-05-30T16:59:37.090323+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:01.271116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094640+0000","last_change":"2024-05-30T16:59:37.091075+0000","last_active":"2024-05-30T16:59:37.094640+0000","last_peered":"2024-05-30T16:59:37.094640+0000","last_clean":"2024-05-30T16:59:37.094640+0000","last_became_active":"2024-05-30T16:59:37.090740+0000","last_became_peered":"2024-05-30T16:59:37.090740+0000","last_unstale":"2024-05-30T16:59:37.094640+0000","last_undegraded":"2024-05-30T16:59:37.094640+0000","last_fullsized":"2024-05-30T16:59:37.094640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:12.422505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.083675+0000","last_change":"2024-05-30T16:59:37.081310+0000","last_active":"2024-05-30T16:59:37.083675+0000","last_peered":"2024-05-30T16:59:37.083675+0000","last_clean":"2024-05-30T16:59:37.083675+0000","last_became_active":"2024-05-30T16:59:37.081051+0000","last_became_peered":"2024-05-30T16:59:37.081051+0000","last_unstale":"2024-05-30T16:59:37.083675+0000","last_undegraded":"2024-05-30T16:59:37.083675+0000","last_fullsized":"2024-05-30T16:59:37.083675+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:47.461836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097459+0000","last_change":"2024-05-30T16:59:37.092092+0000","last_active":"2024-05-30T16:59:37.097459+0000","last_peered":"2024-05-30T16:59:37.097459+0000","last_clean":"2024-05-30T16:59:37.097459+0000","last_became_active":"2024-05-30T16:59:37.089929+0000","last_became_peered":"2024-05-30T16:59:37.089929+0000","last_unstale":"2024-05-30T16:59:37.097459+0000","last_undegraded":"2024-05-30T16:59:37.097459+0000","last_fullsized":"2024-05-30T16:59:37.097459+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:00:47.652785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093649+0000","last_change":"2024-05-30T16:59:37.089008+0000","last_active":"2024-05-30T16:59:37.093649+0000","last_peered":"2024-05-30T16:59:37.093649+0000","last_clean":"2024-05-30T16:59:37.093649+0000","last_became_active":"2024-05-30T16:59:37.088577+0000","last_became_peered":"2024-05-30T16:59:37.088577+0000","last_unstale":"2024-05-30T16:59:37.093649+0000","last_undegraded":"2024-05-30T16:59:37.093649+0000","last_fullsized":"2024-05-30T16:59:37.093649+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:55.662497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084673+0000","last_change":"2024-05-30T16:59:37.077530+0000","last_active":"2024-05-30T16:59:37.084673+0000","last_peered":"2024-05-30T16:59:37.084673+0000","last_clean":"2024-05-30T16:59:37.084673+0000","last_became_active":"2024-05-30T16:59:37.077272+0000","last_became_peered":"2024-05-30T16:59:37.077272+0000","last_unstale":"2024-05-30T16:59:37.084673+0000","last_undegraded":"2024-05-30T16:59:37.084673+0000","last_fullsized":"2024-05-30T16:59:37.084673+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:46:59.562379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097260+0000","last_change":"2024-05-30T16:59:37.092872+0000","last_active":"2024-05-30T16:59:37.097260+0000","last_peered":"2024-05-30T16:59:37.097260+0000","last_clean":"2024-05-30T16:59:37.097260+0000","last_became_active":"2024-05-30T16:59:37.092602+0000","last_became_peered":"2024-05-30T16:59:37.092602+0000","last_unstale":"2024-05-30T16:59:37.097260+0000","last_undegraded":"2024-05-30T16:59:37.097260+0000","last_fullsized":"2024-05-30T16:59:37.097260+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:55:23.698395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.083155+0000","last_change":"2024-05-30T16:59:37.082108+0000","last_active":"2024-05-30T16:59:37.083155+0000","last_peered":"2024-05-30T16:59:37.083155+0000","last_clean":"2024-05-30T16:59:37.083155+0000","last_became_active":"2024-05-30T16:59:37.081786+0000","last_became_peered":"2024-05-30T16:59:37.081786+0000","last_unstale":"2024-05-30T16:59:37.083155+0000","last_undegraded":"2024-05-30T16:59:37.083155+0000","last_fullsized":"2024-05-30T16:59:37.083155+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:31:42.026333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.076454+0000","last_change":"2024-05-30T16:59:37.074108+0000","last_active":"2024-05-30T16:59:37.076454+0000","last_peered":"2024-05-30T16:59:37.076454+0000","last_clean":"2024-05-30T16:59:37.076454+0000","last_became_active":"2024-05-30T16:59:37.073685+0000","last_became_peered":"2024-05-30T16:59:37.073685+0000","last_unstale":"2024-05-30T16:59:37.076454+0000","last_undegraded":"2024-05-30T16:59:37.076454+0000","last_fullsized":"2024-05-30T16:59:37.076454+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094944+0000","last_change":"2024-05-30T16:59:37.091611+0000","last_active":"2024-05-30T16:59:37.094944+0000","last_peered":"2024-05-30T16:59:37.094944+0000","last_clean":"2024-05-30T16:59:37.094944+0000","last_became_active":"2024-05-30T16:59:37.091300+0000","last_became_peered":"2024-05-30T16:59:37.091300+0000","last_unstale":"2024-05-30T16:59:37.094944+0000","last_undegraded":"2024-05-30T16:59:37.094944+0000","last_fullsized":"2024-05-30T16:59:37.094944+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:28.347373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.083386+0000","last_change":"2024-05-30T16:59:37.074729+0000","last_active":"2024-05-30T16:59:37.083386+0000","last_peered":"2024-05-30T16:59:37.083386+0000","last_clean":"2024-05-30T16:59:37.083386+0000","last_became_active":"2024-05-30T16:59:37.074457+0000","last_became_peered":"2024-05-30T16:59:37.074457+0000","last_unstale":"2024-05-30T16:59:37.083386+0000","last_undegraded":"2024-05-30T16:59:37.083386+0000","last_fullsized":"2024-05-30T16:59:37.083386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:46:59.562379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097150+0000","last_change":"2024-05-30T16:59:37.090233+0000","last_active":"2024-05-30T16:59:37.097150+0000","last_peered":"2024-05-30T16:59:37.097150+0000","last_clean":"2024-05-30T16:59:37.097150+0000","last_became_active":"2024-05-30T16:59:37.088987+0000","last_became_peered":"2024-05-30T16:59:37.088987+0000","last_unstale":"2024-05-30T16:59:37.097150+0000","last_undegraded":"2024-05-30T16:59:37.097150+0000","last_fullsized":"2024-05-30T16:59:37.097150+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:37.960162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084344+0000","last_change":"2024-05-30T16:59:37.077683+0000","last_active":"2024-05-30T16:59:37.084344+0000","last_peered":"2024-05-30T16:59:37.084344+0000","last_clean":"2024-05-30T16:59:37.084344+0000","last_became_active":"2024-05-30T16:59:37.077380+0000","last_became_peered":"2024-05-30T16:59:37.077380+0000","last_unstale":"2024-05-30T16:59:37.084344+0000","last_undegraded":"2024-05-30T16:59:37.084344+0000","last_fullsized":"2024-05-30T16:59:37.084344+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:55.662497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093602+0000","last_change":"2024-05-30T16:59:37.088784+0000","last_active":"2024-05-30T16:59:37.093602+0000","last_peered":"2024-05-30T16:59:37.093602+0000","last_clean":"2024-05-30T16:59:37.093602+0000","last_became_active":"2024-05-30T16:59:37.088500+0000","last_became_peered":"2024-05-30T16:59:37.088500+0000","last_unstale":"2024-05-30T16:59:37.093602+0000","last_undegraded":"2024-05-30T16:59:37.093602+0000","last_fullsized":"2024-05-30T16:59:37.093602+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093833+0000","last_change":"2024-05-30T16:59:37.092667+0000","last_active":"2024-05-30T16:59:37.093833+0000","last_peered":"2024-05-30T16:59:37.093833+0000","last_clean":"2024-05-30T16:59:37.093833+0000","last_became_active":"2024-05-30T16:59:37.092305+0000","last_became_peered":"2024-05-30T16:59:37.092305+0000","last_unstale":"2024-05-30T16:59:37.093833+0000","last_undegraded":"2024-05-30T16:59:37.093833+0000","last_fullsized":"2024-05-30T16:59:37.093833+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:38.192437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"89'4","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097944+0000","last_change":"2024-05-30T16:59:36.079591+0000","last_active":"2024-05-30T16:59:37.097944+0000","last_peered":"2024-05-30T16:59:37.097944+0000","last_clean":"2024-05-30T16:59:37.097944+0000","last_became_active":"2024-05-30T16:59:36.079273+0000","last_became_peered":"2024-05-30T16:59:36.079273+0000","last_unstale":"2024-05-30T16:59:37.097944+0000","last_undegraded":"2024-05-30T16:59:37.097944+0000","last_fullsized":"2024-05-30T16:59:37.097944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:07.078092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.098140+0000","last_change":"2024-05-30T16:59:37.097479+0000","last_active":"2024-05-30T16:59:37.098140+0000","last_peered":"2024-05-30T16:59:37.098140+0000","last_clean":"2024-05-30T16:59:37.098140+0000","last_became_active":"2024-05-30T16:59:37.096852+0000","last_became_peered":"2024-05-30T16:59:37.096852+0000","last_unstale":"2024-05-30T16:59:37.098140+0000","last_undegraded":"2024-05-30T16:59:37.098140+0000","last_fullsized":"2024-05-30T16:59:37.098140+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:47.601590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094316+0000","last_change":"2024-05-30T16:59:36.081492+0000","last_active":"2024-05-30T16:59:37.094316+0000","last_peered":"2024-05-30T16:59:37.094316+0000","last_clean":"2024-05-30T16:59:37.094316+0000","last_became_active":"2024-05-30T16:59:36.081071+0000","last_became_peered":"2024-05-30T16:59:36.081071+0000","last_unstale":"2024-05-30T16:59:37.094316+0000","last_undegraded":"2024-05-30T16:59:37.094316+0000","last_fullsized":"2024-05-30T16:59:37.094316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:32.389864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.098693+0000","last_change":"2024-05-30T16:59:37.098058+0000","last_active":"2024-05-30T16:59:37.098693+0000","last_peered":"2024-05-30T16:59:37.098693+0000","last_clean":"2024-05-30T16:59:37.098693+0000","last_became_active":"2024-05-30T16:59:37.097708+0000","last_became_peered":"2024-05-30T16:59:37.097708+0000","last_unstale":"2024-05-30T16:59:37.098693+0000","last_undegraded":"2024-05-30T16:59:37.098693+0000","last_fullsized":"2024-05-30T16:59:37.098693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:57.044016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.091618+0000","last_change":"2024-05-30T16:59:36.084335+0000","last_active":"2024-05-30T16:59:37.091618+0000","last_peered":"2024-05-30T16:59:37.091618+0000","last_clean":"2024-05-30T16:59:37.091618+0000","last_became_active":"2024-05-30T16:59:36.083933+0000","last_became_peered":"2024-05-30T16:59:36.083933+0000","last_unstale":"2024-05-30T16:59:37.091618+0000","last_undegraded":"2024-05-30T16:59:37.091618+0000","last_fullsized":"2024-05-30T16:59:37.091618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:27:43.028647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.087183+0000","last_change":"2024-05-30T16:59:37.084018+0000","last_active":"2024-05-30T16:59:37.087183+0000","last_peered":"2024-05-30T16:59:37.087183+0000","last_clean":"2024-05-30T16:59:37.087183+0000","last_became_active":"2024-05-30T16:59:37.083711+0000","last_became_peered":"2024-05-30T16:59:37.083711+0000","last_unstale":"2024-05-30T16:59:37.087183+0000","last_undegraded":"2024-05-30T16:59:37.087183+0000","last_fullsized":"2024-05-30T16:59:37.087183+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:48.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095023+0000","last_change":"2024-05-30T16:59:36.081241+0000","last_active":"2024-05-30T16:59:37.095023+0000","last_peered":"2024-05-30T16:59:37.095023+0000","last_clean":"2024-05-30T16:59:37.095023+0000","last_became_active":"2024-05-30T16:59:36.080949+0000","last_became_peered":"2024-05-30T16:59:36.080949+0000","last_unstale":"2024-05-30T16:59:37.095023+0000","last_undegraded":"2024-05-30T16:59:37.095023+0000","last_fullsized":"2024-05-30T16:59:37.095023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:37.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093990+0000","last_change":"2024-05-30T16:59:37.085898+0000","last_active":"2024-05-30T16:59:37.093990+0000","last_peered":"2024-05-30T16:59:37.093990+0000","last_clean":"2024-05-30T16:59:37.093990+0000","last_became_active":"2024-05-30T16:59:37.081928+0000","last_became_peered":"2024-05-30T16:59:37.081928+0000","last_unstale":"2024-05-30T16:59:37.093990+0000","last_undegraded":"2024-05-30T16:59:37.093990+0000","last_fullsized":"2024-05-30T16:59:37.093990+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:08:05.904777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095229+0000","last_change":"2024-05-30T16:59:36.086610+0000","last_active":"2024-05-30T16:59:37.095229+0000","last_peered":"2024-05-30T16:59:37.095229+0000","last_clean":"2024-05-30T16:59:37.095229+0000","last_became_active":"2024-05-30T16:59:36.086428+0000","last_became_peered":"2024-05-30T16:59:36.086428+0000","last_unstale":"2024-05-30T16:59:37.095229+0000","last_undegraded":"2024-05-30T16:59:37.095229+0000","last_fullsized":"2024-05-30T16:59:37.095229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:36:36.936609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089285+0000","last_change":"2024-05-30T16:59:37.086396+0000","last_active":"2024-05-30T16:59:37.089285+0000","last_peered":"2024-05-30T16:59:37.089285+0000","last_clean":"2024-05-30T16:59:37.089285+0000","last_became_active":"2024-05-30T16:59:37.086095+0000","last_became_peered":"2024-05-30T16:59:37.086095+0000","last_unstale":"2024-05-30T16:59:37.089285+0000","last_undegraded":"2024-05-30T16:59:37.089285+0000","last_fullsized":"2024-05-30T16:59:37.089285+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:33.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094358+0000","last_change":"2024-05-30T16:59:36.082645+0000","last_active":"2024-05-30T16:59:37.094358+0000","last_peered":"2024-05-30T16:59:37.094358+0000","last_clean":"2024-05-30T16:59:37.094358+0000","last_became_active":"2024-05-30T16:59:36.082380+0000","last_became_peered":"2024-05-30T16:59:36.082380+0000","last_unstale":"2024-05-30T16:59:37.094358+0000","last_undegraded":"2024-05-30T16:59:37.094358+0000","last_fullsized":"2024-05-30T16:59:37.094358+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:09.218872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094539+0000","last_change":"2024-05-30T16:59:37.092211+0000","last_active":"2024-05-30T16:59:37.094539+0000","last_peered":"2024-05-30T16:59:37.094539+0000","last_clean":"2024-05-30T16:59:37.094539+0000","last_became_active":"2024-05-30T16:59:37.091725+0000","last_became_peered":"2024-05-30T16:59:37.091725+0000","last_unstale":"2024-05-30T16:59:37.094539+0000","last_undegraded":"2024-05-30T16:59:37.094539+0000","last_fullsized":"2024-05-30T16:59:37.094539+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:04.577990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.070984+0000","last_change":"2024-05-30T16:59:36.072167+0000","last_active":"2024-05-30T16:59:37.070984+0000","last_peered":"2024-05-30T16:59:37.070984+0000","last_clean":"2024-05-30T16:59:37.070984+0000","last_became_active":"2024-05-30T16:59:36.071855+0000","last_became_peered":"2024-05-30T16:59:36.071855+0000","last_unstale":"2024-05-30T16:59:37.070984+0000","last_undegraded":"2024-05-30T16:59:37.070984+0000","last_fullsized":"2024-05-30T16:59:37.070984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:56.040644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2024-05-30T16:59:36.073664+0000","last_change":"2024-05-30T16:59:36.073664+0000","last_active":"2024-05-30T16:59:36.046240+0000","last_peered":"2024-05-30T16:59:36.046240+0000","last_clean":"2024-05-30T16:59:36.046240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:59:36.073664+0000","last_undegraded":"2024-05-30T16:59:36.073664+0000","last_fullsized":"2024-05-30T16:59:36.073664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.079726+0000","last_change":"2024-05-30T16:59:36.075847+0000","last_active":"2024-05-30T16:59:37.079726+0000","last_peered":"2024-05-30T16:59:37.079726+0000","last_clean":"2024-05-30T16:59:37.079726+0000","last_became_active":"2024-05-30T16:59:36.075436+0000","last_became_peered":"2024-05-30T16:59:36.075436+0000","last_unstale":"2024-05-30T16:59:37.079726+0000","last_undegraded":"2024-05-30T16:59:37.079726+0000","last_fullsized":"2024-05-30T16:59:37.079726+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:33.420123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2024-05-30T16:59:36.067175+0000","last_change":"2024-05-30T16:59:36.067175+0000","last_active":"2024-05-30T16:59:36.046240+0000","last_peered":"2024-05-30T16:59:36.046240+0000","last_clean":"2024-05-30T16:59:36.046240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:59:36.067175+0000","last_undegraded":"2024-05-30T16:59:36.067175+0000","last_fullsized":"2024-05-30T16:59:36.067175+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.075354+0000","last_change":"2024-05-30T16:59:36.084230+0000","last_active":"2024-05-30T16:59:37.075354+0000","last_peered":"2024-05-30T16:59:37.075354+0000","last_clean":"2024-05-30T16:59:37.075354+0000","last_became_active":"2024-05-30T16:59:36.083951+0000","last_became_peered":"2024-05-30T16:59:36.083951+0000","last_unstale":"2024-05-30T16:59:37.075354+0000","last_undegraded":"2024-05-30T16:59:37.075354+0000","last_fullsized":"2024-05-30T16:59:37.075354+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:05.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.074719+0000","last_change":"2024-05-30T16:59:37.072293+0000","last_active":"2024-05-30T16:59:37.074719+0000","last_peered":"2024-05-30T16:59:37.074719+0000","last_clean":"2024-05-30T16:59:37.074719+0000","last_became_active":"2024-05-30T16:59:37.068848+0000","last_became_peered":"2024-05-30T16:59:37.068848+0000","last_unstale":"2024-05-30T16:59:37.074719+0000","last_undegraded":"2024-05-30T16:59:37.074719+0000","last_fullsized":"2024-05-30T16:59:37.074719+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:14:10.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.081030+0000","last_change":"2024-05-30T16:59:36.076816+0000","last_active":"2024-05-30T16:59:37.081030+0000","last_peered":"2024-05-30T16:59:37.081030+0000","last_clean":"2024-05-30T16:59:37.081030+0000","last_became_active":"2024-05-30T16:59:36.076449+0000","last_became_peered":"2024-05-30T16:59:36.076449+0000","last_unstale":"2024-05-30T16:59:37.081030+0000","last_undegraded":"2024-05-30T16:59:37.081030+0000","last_fullsized":"2024-05-30T16:59:37.081030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:36:36.936609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096917+0000","last_change":"2024-05-30T16:59:37.094548+0000","last_active":"2024-05-30T16:59:37.096917+0000","last_peered":"2024-05-30T16:59:37.096917+0000","last_clean":"2024-05-30T16:59:37.096917+0000","last_became_active":"2024-05-30T16:59:37.094267+0000","last_became_peered":"2024-05-30T16:59:37.094267+0000","last_unstale":"2024-05-30T16:59:37.096917+0000","last_undegraded":"2024-05-30T16:59:37.096917+0000","last_fullsized":"2024-05-30T16:59:37.096917+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:54.042211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"89'3","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.099318+0000","last_change":"2024-05-30T16:59:36.083663+0000","last_active":"2024-05-30T16:59:37.099318+0000","last_peered":"2024-05-30T16:59:37.099318+0000","last_clean":"2024-05-30T16:59:37.099318+0000","last_became_active":"2024-05-30T16:59:36.083370+0000","last_became_peered":"2024-05-30T16:59:36.083370+0000","last_unstale":"2024-05-30T16:59:37.099318+0000","last_undegraded":"2024-05-30T16:59:37.099318+0000","last_fullsized":"2024-05-30T16:59:37.099318+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:47:12.815654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089450+0000","last_change":"2024-05-30T16:59:37.087703+0000","last_active":"2024-05-30T16:59:37.089450+0000","last_peered":"2024-05-30T16:59:37.089450+0000","last_clean":"2024-05-30T16:59:37.089450+0000","last_became_active":"2024-05-30T16:59:37.087368+0000","last_became_peered":"2024-05-30T16:59:37.087368+0000","last_unstale":"2024-05-30T16:59:37.089450+0000","last_undegraded":"2024-05-30T16:59:37.089450+0000","last_fullsized":"2024-05-30T16:59:37.089450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:57.044016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"89'6","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.099682+0000","last_change":"2024-05-30T16:59:36.066172+0000","last_active":"2024-05-30T16:59:37.099682+0000","last_peered":"2024-05-30T16:59:37.099682+0000","last_clean":"2024-05-30T16:59:37.099682+0000","last_became_active":"2024-05-30T16:59:36.064294+0000","last_became_peered":"2024-05-30T16:59:36.064294+0000","last_unstale":"2024-05-30T16:59:37.099682+0000","last_undegraded":"2024-05-30T16:59:37.099682+0000","last_fullsized":"2024-05-30T16:59:37.099682+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:17.835411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089850+0000","last_change":"2024-05-30T16:59:37.084517+0000","last_active":"2024-05-30T16:59:37.089850+0000","last_peered":"2024-05-30T16:59:37.089850+0000","last_clean":"2024-05-30T16:59:37.089850+0000","last_became_active":"2024-05-30T16:59:37.084243+0000","last_became_peered":"2024-05-30T16:59:37.084243+0000","last_unstale":"2024-05-30T16:59:37.089850+0000","last_undegraded":"2024-05-30T16:59:37.089850+0000","last_fullsized":"2024-05-30T16:59:37.089850+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:16:00.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.098352+0000","last_change":"2024-05-30T16:59:36.074867+0000","last_active":"2024-05-30T16:59:37.098352+0000","last_peered":"2024-05-30T16:59:37.098352+0000","last_clean":"2024-05-30T16:59:37.098352+0000","last_became_active":"2024-05-30T16:59:36.074584+0000","last_became_peered":"2024-05-30T16:59:36.074584+0000","last_unstale":"2024-05-30T16:59:37.098352+0000","last_undegraded":"2024-05-30T16:59:37.098352+0000","last_fullsized":"2024-05-30T16:59:37.098352+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:04:38.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096872+0000","last_change":"2024-05-30T16:59:37.094928+0000","last_active":"2024-05-30T16:59:37.096872+0000","last_peered":"2024-05-30T16:59:37.096872+0000","last_clean":"2024-05-30T16:59:37.096872+0000","last_became_active":"2024-05-30T16:59:37.094508+0000","last_became_peered":"2024-05-30T16:59:37.094508+0000","last_unstale":"2024-05-30T16:59:37.096872+0000","last_undegraded":"2024-05-30T16:59:37.096872+0000","last_fullsized":"2024-05-30T16:59:37.096872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:19:38.753995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T16:59:36.074268+0000","last_change":"2024-05-30T16:59:36.072195+0000","last_active":"2024-05-30T16:59:36.074268+0000","last_peered":"2024-05-30T16:59:36.074268+0000","last_clean":"2024-05-30T16:59:36.074268+0000","last_became_active":"2024-05-30T16:59:36.071318+0000","last_became_peered":"2024-05-30T16:59:36.071318+0000","last_unstale":"2024-05-30T16:59:36.074268+0000","last_undegraded":"2024-05-30T16:59:36.074268+0000","last_fullsized":"2024-05-30T16:59:36.074268+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:53:57.101832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094882+0000","last_change":"2024-05-30T16:59:37.085652+0000","last_active":"2024-05-30T16:59:37.094882+0000","last_peered":"2024-05-30T16:59:37.094882+0000","last_clean":"2024-05-30T16:59:37.094882+0000","last_became_active":"2024-05-30T16:59:37.085321+0000","last_became_peered":"2024-05-30T16:59:37.085321+0000","last_unstale":"2024-05-30T16:59:37.094882+0000","last_undegraded":"2024-05-30T16:59:37.094882+0000","last_fullsized":"2024-05-30T16:59:37.094882+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:26:37.459231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.065802+0000","last_change":"2024-05-30T16:59:36.073851+0000","last_active":"2024-05-30T16:59:37.065802+0000","last_peered":"2024-05-30T16:59:37.065802+0000","last_clean":"2024-05-30T16:59:37.065802+0000","last_became_active":"2024-05-30T16:59:36.073504+0000","last_became_peered":"2024-05-30T16:59:36.073504+0000","last_unstale":"2024-05-30T16:59:37.065802+0000","last_undegraded":"2024-05-30T16:59:37.065802+0000","last_fullsized":"2024-05-30T16:59:37.065802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:27.344000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097633+0000","last_change":"2024-05-30T16:59:37.090890+0000","last_active":"2024-05-30T16:59:37.097633+0000","last_peered":"2024-05-30T16:59:37.097633+0000","last_clean":"2024-05-30T16:59:37.097633+0000","last_became_active":"2024-05-30T16:59:37.090646+0000","last_became_peered":"2024-05-30T16:59:37.090646+0000","last_unstale":"2024-05-30T16:59:37.097633+0000","last_undegraded":"2024-05-30T16:59:37.097633+0000","last_fullsized":"2024-05-30T16:59:37.097633+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:59.217253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"89'8","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093819+0000","last_change":"2024-05-30T16:59:36.071455+0000","last_active":"2024-05-30T16:59:37.093819+0000","last_peered":"2024-05-30T16:59:37.093819+0000","last_clean":"2024-05-30T16:59:37.093819+0000","last_became_active":"2024-05-30T16:59:36.071143+0000","last_became_peered":"2024-05-30T16:59:36.071143+0000","last_unstale":"2024-05-30T16:59:37.093819+0000","last_undegraded":"2024-05-30T16:59:37.093819+0000","last_fullsized":"2024-05-30T16:59:37.093819+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:52.348518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088349+0000","last_change":"2024-05-30T16:59:37.085772+0000","last_active":"2024-05-30T16:59:37.088349+0000","last_peered":"2024-05-30T16:59:37.088349+0000","last_clean":"2024-05-30T16:59:37.088349+0000","last_became_active":"2024-05-30T16:59:37.085494+0000","last_became_peered":"2024-05-30T16:59:37.085494+0000","last_unstale":"2024-05-30T16:59:37.088349+0000","last_undegraded":"2024-05-30T16:59:37.088349+0000","last_fullsized":"2024-05-30T16:59:37.088349+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:42:21.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093379+0000","last_change":"2024-05-30T16:59:36.071418+0000","last_active":"2024-05-30T16:59:37.093379+0000","last_peered":"2024-05-30T16:59:37.093379+0000","last_clean":"2024-05-30T16:59:37.093379+0000","last_became_active":"2024-05-30T16:59:36.070404+0000","last_became_peered":"2024-05-30T16:59:36.070404+0000","last_unstale":"2024-05-30T16:59:37.093379+0000","last_undegraded":"2024-05-30T16:59:37.093379+0000","last_fullsized":"2024-05-30T16:59:37.093379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:09.218872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093476+0000","last_change":"2024-05-30T16:59:37.088772+0000","last_active":"2024-05-30T16:59:37.093476+0000","last_peered":"2024-05-30T16:59:37.093476+0000","last_clean":"2024-05-30T16:59:37.093476+0000","last_became_active":"2024-05-30T16:59:37.088489+0000","last_became_peered":"2024-05-30T16:59:37.088489+0000","last_unstale":"2024-05-30T16:59:37.093476+0000","last_undegraded":"2024-05-30T16:59:37.093476+0000","last_fullsized":"2024-05-30T16:59:37.093476+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:33.393237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096457+0000","last_change":"2024-05-30T16:59:36.077558+0000","last_active":"2024-05-30T16:59:37.096457+0000","last_peered":"2024-05-30T16:59:37.096457+0000","last_clean":"2024-05-30T16:59:37.096457+0000","last_became_active":"2024-05-30T16:59:36.076835+0000","last_became_peered":"2024-05-30T16:59:36.076835+0000","last_unstale":"2024-05-30T16:59:37.096457+0000","last_undegraded":"2024-05-30T16:59:37.096457+0000","last_fullsized":"2024-05-30T16:59:37.096457+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:59.947220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088396+0000","last_change":"2024-05-30T16:59:37.085771+0000","last_active":"2024-05-30T16:59:37.088396+0000","last_peered":"2024-05-30T16:59:37.088396+0000","last_clean":"2024-05-30T16:59:37.088396+0000","last_became_active":"2024-05-30T16:59:37.085475+0000","last_became_peered":"2024-05-30T16:59:37.085475+0000","last_unstale":"2024-05-30T16:59:37.088396+0000","last_undegraded":"2024-05-30T16:59:37.088396+0000","last_fullsized":"2024-05-30T16:59:37.088396+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:14:10.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.072496+0000","last_change":"2024-05-30T16:59:36.073081+0000","last_active":"2024-05-30T16:59:37.072496+0000","last_peered":"2024-05-30T16:59:37.072496+0000","last_clean":"2024-05-30T16:59:37.072496+0000","last_became_active":"2024-05-30T16:59:36.072483+0000","last_became_peered":"2024-05-30T16:59:36.072483+0000","last_unstale":"2024-05-30T16:59:37.072496+0000","last_undegraded":"2024-05-30T16:59:37.072496+0000","last_fullsized":"2024-05-30T16:59:37.072496+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:31:23.944400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.085095+0000","last_change":"2024-05-30T16:59:37.082050+0000","last_active":"2024-05-30T16:59:37.085095+0000","last_peered":"2024-05-30T16:59:37.085095+0000","last_clean":"2024-05-30T16:59:37.085095+0000","last_became_active":"2024-05-30T16:59:37.081747+0000","last_became_peered":"2024-05-30T16:59:37.081747+0000","last_unstale":"2024-05-30T16:59:37.085095+0000","last_undegraded":"2024-05-30T16:59:37.085095+0000","last_fullsized":"2024-05-30T16:59:37.085095+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:04:39.484172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T16:59:36.073762+0000","last_change":"2024-05-30T16:59:36.070012+0000","last_active":"2024-05-30T16:59:36.073762+0000","last_peered":"2024-05-30T16:59:36.073762+0000","last_clean":"2024-05-30T16:59:36.073762+0000","last_became_active":"2024-05-30T16:59:36.069700+0000","last_became_peered":"2024-05-30T16:59:36.069700+0000","last_unstale":"2024-05-30T16:59:36.073762+0000","last_undegraded":"2024-05-30T16:59:36.073762+0000","last_fullsized":"2024-05-30T16:59:36.073762+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:51.443117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.075876+0000","last_change":"2024-05-30T16:59:37.072799+0000","last_active":"2024-05-30T16:59:37.075876+0000","last_peered":"2024-05-30T16:59:37.075876+0000","last_clean":"2024-05-30T16:59:37.075876+0000","last_became_active":"2024-05-30T16:59:37.072459+0000","last_became_peered":"2024-05-30T16:59:37.072459+0000","last_unstale":"2024-05-30T16:59:37.075876+0000","last_undegraded":"2024-05-30T16:59:37.075876+0000","last_fullsized":"2024-05-30T16:59:37.075876+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:33.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.061601+0000","last_change":"2024-05-30T16:59:36.078703+0000","last_active":"2024-05-30T16:59:37.061601+0000","last_peered":"2024-05-30T16:59:37.061601+0000","last_clean":"2024-05-30T16:59:37.061601+0000","last_became_active":"2024-05-30T16:59:36.078388+0000","last_became_peered":"2024-05-30T16:59:36.078388+0000","last_unstale":"2024-05-30T16:59:37.061601+0000","last_undegraded":"2024-05-30T16:59:37.061601+0000","last_fullsized":"2024-05-30T16:59:37.061601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:33.197739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.067732+0000","last_change":"2024-05-30T16:59:37.065490+0000","last_active":"2024-05-30T16:59:37.067732+0000","last_peered":"2024-05-30T16:59:37.067732+0000","last_clean":"2024-05-30T16:59:37.067732+0000","last_became_active":"2024-05-30T16:59:37.065012+0000","last_became_peered":"2024-05-30T16:59:37.065012+0000","last_unstale":"2024-05-30T16:59:37.067732+0000","last_undegraded":"2024-05-30T16:59:37.067732+0000","last_fullsized":"2024-05-30T16:59:37.067732+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:28:28.070278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.059802+0000","last_change":"2024-05-30T16:59:36.073987+0000","last_active":"2024-05-30T16:59:37.059802+0000","last_peered":"2024-05-30T16:59:37.059802+0000","last_clean":"2024-05-30T16:59:37.059802+0000","last_became_active":"2024-05-30T16:59:36.073682+0000","last_became_peered":"2024-05-30T16:59:36.073682+0000","last_unstale":"2024-05-30T16:59:37.059802+0000","last_undegraded":"2024-05-30T16:59:37.059802+0000","last_fullsized":"2024-05-30T16:59:37.059802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:04:12.123572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.086046+0000","last_change":"2024-05-30T16:59:37.077255+0000","last_active":"2024-05-30T16:59:37.086046+0000","last_peered":"2024-05-30T16:59:37.086046+0000","last_clean":"2024-05-30T16:59:37.086046+0000","last_became_active":"2024-05-30T16:59:37.075699+0000","last_became_peered":"2024-05-30T16:59:37.075699+0000","last_unstale":"2024-05-30T16:59:37.086046+0000","last_undegraded":"2024-05-30T16:59:37.086046+0000","last_fullsized":"2024-05-30T16:59:37.086046+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:57.044016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T16:59:36.077906+0000","last_change":"2024-05-30T16:59:36.071359+0000","last_active":"2024-05-30T16:59:36.077906+0000","last_peered":"2024-05-30T16:59:36.077906+0000","last_clean":"2024-05-30T16:59:36.077906+0000","last_became_active":"2024-05-30T16:59:36.071068+0000","last_became_peered":"2024-05-30T16:59:36.071068+0000","last_unstale":"2024-05-30T16:59:36.077906+0000","last_undegraded":"2024-05-30T16:59:36.077906+0000","last_fullsized":"2024-05-30T16:59:36.077906+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:43:41.566821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084429+0000","last_change":"2024-05-30T16:59:37.079547+0000","last_active":"2024-05-30T16:59:37.084429+0000","last_peered":"2024-05-30T16:59:37.084429+0000","last_clean":"2024-05-30T16:59:37.084429+0000","last_became_active":"2024-05-30T16:59:37.077473+0000","last_became_peered":"2024-05-30T16:59:37.077473+0000","last_unstale":"2024-05-30T16:59:37.084429+0000","last_undegraded":"2024-05-30T16:59:37.084429+0000","last_fullsized":"2024-05-30T16:59:37.084429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:28.347373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.091656+0000","last_change":"2024-05-30T16:59:36.067314+0000","last_active":"2024-05-30T16:59:37.091656+0000","last_peered":"2024-05-30T16:59:37.091656+0000","last_clean":"2024-05-30T16:59:37.091656+0000","last_became_active":"2024-05-30T16:59:36.064171+0000","last_became_peered":"2024-05-30T16:59:36.064171+0000","last_unstale":"2024-05-30T16:59:37.091656+0000","last_undegraded":"2024-05-30T16:59:37.091656+0000","last_fullsized":"2024-05-30T16:59:37.091656+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:25.960596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095957+0000","last_change":"2024-05-30T16:59:37.093784+0000","last_active":"2024-05-30T16:59:37.095957+0000","last_peered":"2024-05-30T16:59:37.095957+0000","last_clean":"2024-05-30T16:59:37.095957+0000","last_became_active":"2024-05-30T16:59:37.093464+0000","last_became_peered":"2024-05-30T16:59:37.093464+0000","last_unstale":"2024-05-30T16:59:37.095957+0000","last_undegraded":"2024-05-30T16:59:37.095957+0000","last_fullsized":"2024-05-30T16:59:37.095957+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:51:51.208985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.082133+0000","last_change":"2024-05-30T16:59:36.075907+0000","last_active":"2024-05-30T16:59:37.082133+0000","last_peered":"2024-05-30T16:59:37.082133+0000","last_clean":"2024-05-30T16:59:37.082133+0000","last_became_active":"2024-05-30T16:59:36.075639+0000","last_became_peered":"2024-05-30T16:59:36.075639+0000","last_unstale":"2024-05-30T16:59:37.082133+0000","last_undegraded":"2024-05-30T16:59:37.082133+0000","last_fullsized":"2024-05-30T16:59:37.082133+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:11.419133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097395+0000","last_change":"2024-05-30T16:59:37.095753+0000","last_active":"2024-05-30T16:59:37.097395+0000","last_peered":"2024-05-30T16:59:37.097395+0000","last_clean":"2024-05-30T16:59:37.097395+0000","last_became_active":"2024-05-30T16:59:37.095191+0000","last_became_peered":"2024-05-30T16:59:37.095191+0000","last_unstale":"2024-05-30T16:59:37.097395+0000","last_undegraded":"2024-05-30T16:59:37.097395+0000","last_fullsized":"2024-05-30T16:59:37.097395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:33.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.068327+0000","last_change":"2024-05-30T16:59:36.079587+0000","last_active":"2024-05-30T16:59:37.068327+0000","last_peered":"2024-05-30T16:59:37.068327+0000","last_clean":"2024-05-30T16:59:37.068327+0000","last_became_active":"2024-05-30T16:59:36.079306+0000","last_became_peered":"2024-05-30T16:59:36.079306+0000","last_unstale":"2024-05-30T16:59:37.068327+0000","last_undegraded":"2024-05-30T16:59:37.068327+0000","last_fullsized":"2024-05-30T16:59:37.068327+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:41:30.701806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089429+0000","last_change":"2024-05-30T16:59:37.087073+0000","last_active":"2024-05-30T16:59:37.089429+0000","last_peered":"2024-05-30T16:59:37.089429+0000","last_clean":"2024-05-30T16:59:37.089429+0000","last_became_active":"2024-05-30T16:59:37.086784+0000","last_became_peered":"2024-05-30T16:59:37.086784+0000","last_unstale":"2024-05-30T16:59:37.089429+0000","last_undegraded":"2024-05-30T16:59:37.089429+0000","last_fullsized":"2024-05-30T16:59:37.089429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:47.601590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.073399+0000","last_change":"2024-05-30T16:59:36.078081+0000","last_active":"2024-05-30T16:59:37.073399+0000","last_peered":"2024-05-30T16:59:37.073399+0000","last_clean":"2024-05-30T16:59:37.073399+0000","last_became_active":"2024-05-30T16:59:36.077822+0000","last_became_peered":"2024-05-30T16:59:36.077822+0000","last_unstale":"2024-05-30T16:59:37.073399+0000","last_undegraded":"2024-05-30T16:59:37.073399+0000","last_fullsized":"2024-05-30T16:59:37.073399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:45:07.805901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.076430+0000","last_change":"2024-05-30T16:59:37.073176+0000","last_active":"2024-05-30T16:59:37.076430+0000","last_peered":"2024-05-30T16:59:37.076430+0000","last_clean":"2024-05-30T16:59:37.076430+0000","last_became_active":"2024-05-30T16:59:37.072705+0000","last_became_peered":"2024-05-30T16:59:37.072705+0000","last_unstale":"2024-05-30T16:59:37.076430+0000","last_undegraded":"2024-05-30T16:59:37.076430+0000","last_fullsized":"2024-05-30T16:59:37.076430+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:47.601590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.071282+0000","last_change":"2024-05-30T16:59:36.072434+0000","last_active":"2024-05-30T16:59:37.071282+0000","last_peered":"2024-05-30T16:59:37.071282+0000","last_clean":"2024-05-30T16:59:37.071282+0000","last_became_active":"2024-05-30T16:59:36.072080+0000","last_became_peered":"2024-05-30T16:59:36.072080+0000","last_unstale":"2024-05-30T16:59:37.071282+0000","last_undegraded":"2024-05-30T16:59:37.071282+0000","last_fullsized":"2024-05-30T16:59:37.071282+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:08.828492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.091200+0000","last_change":"2024-05-30T16:59:37.084414+0000","last_active":"2024-05-30T16:59:37.091200+0000","last_peered":"2024-05-30T16:59:37.091200+0000","last_clean":"2024-05-30T16:59:37.091200+0000","last_became_active":"2024-05-30T16:59:37.084136+0000","last_became_peered":"2024-05-30T16:59:37.084136+0000","last_unstale":"2024-05-30T16:59:37.091200+0000","last_undegraded":"2024-05-30T16:59:37.091200+0000","last_fullsized":"2024-05-30T16:59:37.091200+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:59:27.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.071319+0000","last_change":"2024-05-30T16:59:36.081362+0000","last_active":"2024-05-30T16:59:37.071319+0000","last_peered":"2024-05-30T16:59:37.071319+0000","last_clean":"2024-05-30T16:59:37.071319+0000","last_became_active":"2024-05-30T16:59:36.081053+0000","last_became_peered":"2024-05-30T16:59:36.081053+0000","last_unstale":"2024-05-30T16:59:37.071319+0000","last_undegraded":"2024-05-30T16:59:37.071319+0000","last_fullsized":"2024-05-30T16:59:37.071319+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:07.006990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084295+0000","last_change":"2024-05-30T16:59:37.082149+0000","last_active":"2024-05-30T16:59:37.084295+0000","last_peered":"2024-05-30T16:59:37.084295+0000","last_clean":"2024-05-30T16:59:37.084295+0000","last_became_active":"2024-05-30T16:59:37.081871+0000","last_became_peered":"2024-05-30T16:59:37.081871+0000","last_unstale":"2024-05-30T16:59:37.084295+0000","last_undegraded":"2024-05-30T16:59:37.084295+0000","last_fullsized":"2024-05-30T16:59:37.084295+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:21:31.814977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.070746+0000","last_change":"2024-05-30T16:59:36.082150+0000","last_active":"2024-05-30T16:59:37.070746+0000","last_peered":"2024-05-30T16:59:37.070746+0000","last_clean":"2024-05-30T16:59:37.070746+0000","last_became_active":"2024-05-30T16:59:36.081808+0000","last_became_peered":"2024-05-30T16:59:36.081808+0000","last_unstale":"2024-05-30T16:59:37.070746+0000","last_undegraded":"2024-05-30T16:59:37.070746+0000","last_fullsized":"2024-05-30T16:59:37.070746+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:10:14.175340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.092890+0000","last_change":"2024-05-30T16:59:37.086355+0000","last_active":"2024-05-30T16:59:37.092890+0000","last_peered":"2024-05-30T16:59:37.092890+0000","last_clean":"2024-05-30T16:59:37.092890+0000","last_became_active":"2024-05-30T16:59:37.085922+0000","last_became_peered":"2024-05-30T16:59:37.085922+0000","last_unstale":"2024-05-30T16:59:37.092890+0000","last_undegraded":"2024-05-30T16:59:37.092890+0000","last_fullsized":"2024-05-30T16:59:37.092890+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:08.010363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.070751+0000","last_change":"2024-05-30T16:59:36.078616+0000","last_active":"2024-05-30T16:59:37.070751+0000","last_peered":"2024-05-30T16:59:37.070751+0000","last_clean":"2024-05-30T16:59:37.070751+0000","last_became_active":"2024-05-30T16:59:36.078225+0000","last_became_peered":"2024-05-30T16:59:36.078225+0000","last_unstale":"2024-05-30T16:59:37.070751+0000","last_undegraded":"2024-05-30T16:59:37.070751+0000","last_fullsized":"2024-05-30T16:59:37.070751+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:05.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.081879+0000","last_change":"2024-05-30T16:59:37.077457+0000","last_active":"2024-05-30T16:59:37.081879+0000","last_peered":"2024-05-30T16:59:37.081879+0000","last_clean":"2024-05-30T16:59:37.081879+0000","last_became_active":"2024-05-30T16:59:37.077159+0000","last_became_peered":"2024-05-30T16:59:37.077159+0000","last_unstale":"2024-05-30T16:59:37.081879+0000","last_undegraded":"2024-05-30T16:59:37.081879+0000","last_fullsized":"2024-05-30T16:59:37.081879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:47.461836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095777+0000","last_change":"2024-05-30T16:59:36.075731+0000","last_active":"2024-05-30T16:59:37.095777+0000","last_peered":"2024-05-30T16:59:37.095777+0000","last_clean":"2024-05-30T16:59:37.095777+0000","last_became_active":"2024-05-30T16:59:36.075265+0000","last_became_peered":"2024-05-30T16:59:36.075265+0000","last_unstale":"2024-05-30T16:59:37.095777+0000","last_undegraded":"2024-05-30T16:59:37.095777+0000","last_fullsized":"2024-05-30T16:59:37.095777+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:53.038839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":299,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.071688+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:59:37.071688+0000","last_peered":"2024-05-30T16:59:37.071688+0000","last_clean":"2024-05-30T16:59:37.071688+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:59:37.071688+0000","last_undegraded":"2024-05-30T16:59:37.071688+0000","last_fullsized":"2024-05-30T16:59:37.071688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509571,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100800,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271040,"statfs":{"total":96636764160,"available":96533544960,"internally_reserved":0,"allocated":1683456,"data_stored":1056337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101513674},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118248,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253592,"statfs":{"total":96636764160,"available":96515678208,"internally_reserved":0,"allocated":1073152,"data_stored":459040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509572,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72424,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299416,"statfs":{"total":96636764160,"available":96562601984,"internally_reserved":0,"allocated":1073152,"data_stored":459040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509573,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76592,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295248,"statfs":{"total":96636764160,"available":96558333952,"internally_reserved":0,"allocated":1085440,"data_stored":465899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509572,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100220,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271620,"statfs":{"total":96636764160,"available":96534138880,"internally_reserved":0,"allocated":1089536,"data_stored":466481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509572,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82152,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94289688,"statfs":{"total":96636764160,"available":96552640512,"internally_reserved":0,"allocated":1073152,"data_stored":459040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509572,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77176,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294664,"statfs":{"total":96636764160,"available":96557735936,"internally_reserved":0,"allocated":1683456,"data_stored":1056301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122400,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249440,"statfs":{"total":96636764160,"available":96511426560,"internally_reserved":0,"allocated":1060864,"data_stored":452681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:59:41.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:59:41.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.372+0000 7f9214800640 1 Processor -- start 2024-05-30T16:59:41.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.372+0000 7f9214800640 1 -- start start 2024-05-30T16:59:41.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9214800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f920c15e860 0x7f920c0cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:41.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9214800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c15ec40 con 0x7f920c0d0e80 2024-05-30T16:59:41.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9214800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c0c8200 con 0x7f920c0c6f50 2024-05-30T16:59:41.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9214800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f920c0c7960 con 0x7f920c15e860 2024-05-30T16:59:41.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9211400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f920c0d0e80 0x7f920c0c6840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56796/0 (socket says 172.21.15.59:56796) 2024-05-30T16:59:41.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9211400640 1 -- 172.21.15.59:0/1070013693 learned_addr learned my addr 172.21.15.59:0/1070013693 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:41.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9211e00640 1 --2- 172.21.15.59:0/1070013693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f920c15e860 0x7f920c0cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:41.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9210a00640 1 -- 172.21.15.59:0/1070013693 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004688557 0 0) 0x7f920c15ec40 con 0x7f920c0d0e80 2024-05-30T16:59:41.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9210a00640 1 -- 172.21.15.59:0/1070013693 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91f4003530 con 0x7f920c0d0e80 2024-05-30T16:59:41.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9210a00640 1 -- 172.21.15.59:0/1070013693 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1158437130 0 0) 0x7f920c0c8200 con 0x7f920c0c6f50 2024-05-30T16:59:41.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9211e00640 1 -- 172.21.15.59:0/1070013693 >> v1:172.21.15.107:6789/0 conn(0x7f920c0c6f50 legacy=0x7f920c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9211e00640 1 -- 172.21.15.59:0/1070013693 >> v1:172.21.15.59:6789/0 conn(0x7f920c0d0e80 legacy=0x7f920c0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.376+0000 7f9211e00640 1 -- 172.21.15.59:0/1070013693 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c0c7c40 con 0x7f920c15e860 2024-05-30T16:59:41.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9211e00640 1 --2- 172.21.15.59:0/1070013693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f920c15e860 0x7f920c0cef40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f92000097f0 tx=0x7f920001c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fe6fa8f2afda76c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:41.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9210a00640 1 -- 172.21.15.59:0/1070013693 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92000b0070 con 0x7f920c15e860 2024-05-30T16:59:41.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9210a00640 1 -- 172.21.15.59:0/1070013693 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92000ab400 con 0x7f920c15e860 2024-05-30T16:59:41.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9210a00640 1 -- 172.21.15.59:0/1070013693 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc001680 con 0x7f920c15e860 2024-05-30T16:59:41.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9214800640 1 -- 172.21.15.59:0/1070013693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f920c15e860 msgr2=0x7f920c0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9214800640 1 --2- 172.21.15.59:0/1070013693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f920c15e860 0x7f920c0cef40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f92000097f0 tx=0x7f920001c290 comp rx=0 tx=0).stop 2024-05-30T16:59:41.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9214800640 1 -- 172.21.15.59:0/1070013693 shutdown_connections 2024-05-30T16:59:41.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9214800640 1 --2- 172.21.15.59:0/1070013693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f920c15e860 0x7f920c0cef40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9214800640 1 -- 172.21.15.59:0/1070013693 >> 172.21.15.59:0/1070013693 conn(0x7f920c0b2fc0 msgr2=0x7f920c0b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:41.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9214800640 1 -- 172.21.15.59:0/1070013693 shutdown_connections 2024-05-30T16:59:41.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9214800640 1 -- 172.21.15.59:0/1070013693 wait complete. 2024-05-30T16:59:41.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9214800640 1 Processor -- start 2024-05-30T16:59:41.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.380+0000 7f9214800640 1 -- start start 2024-05-30T16:59:41.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9214800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f920c0c6f50 0x7f920c1535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:41.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9214800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f920c0d0e80 0x7f920c153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:41.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9214800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c15e860 0x7f920c0ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:41.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9214800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f920c16c3b0 con 0x7f920c15e860 2024-05-30T16:59:41.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9214800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f920c0b3dd0 con 0x7f920c0d0e80 2024-05-30T16:59:41.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9214800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f920c16c530 con 0x7f920c0c6f50 2024-05-30T16:59:41.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9212800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c15e860 0x7f920c0ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:41.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9212800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c15e860 0x7f920c0ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37994/0 (socket says 172.21.15.59:37994) 2024-05-30T16:59:41.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9212800640 1 -- 172.21.15.59:0/2020146096 learned_addr learned my addr 172.21.15.59:0/2020146096 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:41.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9211400640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f920c0d0e80 0x7f920c153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:41.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9211e00640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f920c0c6f50 0x7f920c1535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:41.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9212800640 1 -- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f920c0c6f50 msgr2=0x7f920c1535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9212800640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f920c0c6f50 0x7f920c1535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9212800640 1 -- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f920c0d0e80 msgr2=0x7f920c153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9212800640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f920c0d0e80 0x7f920c153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9212800640 1 -- 172.21.15.59:0/2020146096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c09bdc0 con 0x7f920c15e860 2024-05-30T16:59:41.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9212800640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c15e860 0x7f920c0ae540 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f920800c780 tx=0x7f920800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:41.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9206000640 1 -- 172.21.15.59:0/2020146096 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208003db0 con 0x7f920c15e860 2024-05-30T16:59:41.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9206000640 1 -- 172.21.15.59:0/2020146096 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9208005070 con 0x7f920c15e860 2024-05-30T16:59:41.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9214800640 1 -- 172.21.15.59:0/2020146096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920c09c0a0 con 0x7f920c15e860 2024-05-30T16:59:41.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9206000640 1 -- 172.21.15.59:0/2020146096 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208005460 con 0x7f920c15e860 2024-05-30T16:59:41.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9214800640 1 -- 172.21.15.59:0/2020146096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f920c09c660 con 0x7f920c15e860 2024-05-30T16:59:41.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.384+0000 7f9214800640 1 -- 172.21.15.59:0/2020146096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f920c068a90 con 0x7f920c15e860 2024-05-30T16:59:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.388+0000 7f9206000640 1 -- 172.21.15.59:0/2020146096 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f9208005600 con 0x7f920c15e860 2024-05-30T16:59:41.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.388+0000 7f9206000640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f91f0069520 0x7f91f006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:41.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.388+0000 7f9206000640 1 -- 172.21.15.59:0/2020146096 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5793+0+0 (secure 0 0 0) 0x7f92080856b0 con 0x7f920c15e860 2024-05-30T16:59:41.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.388+0000 7f9211e00640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f91f0069520 0x7f91f006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:41.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.388+0000 7f9211e00640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f91f0069520 0x7f91f006b9e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f92000ad000 tx=0x7f92000a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:41.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.392+0000 7f9206000640 1 -- 172.21.15.59:0/2020146096 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9208056d60 con 0x7f920c15e860 2024-05-30T16:59:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.552+0000 7f9214800640 1 -- 172.21.15.59:0/2020146096 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f920c15df30 con 0x7f91f0069520 2024-05-30T16:59:41.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.560+0000 7f9206000640 1 -- 172.21.15.59:0/2020146096 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251774 (secure 0 0 0) 0x7f920c15df30 con 0x7f91f0069520 2024-05-30T16:59:41.564 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:59:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.564+0000 7f9214800640 1 -- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f91f0069520 msgr2=0x7f91f006b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.564+0000 7f9214800640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f91f0069520 0x7f91f006b9e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f92000ad000 tx=0x7f92000a6000 comp rx=0 tx=0).stop 2024-05-30T16:59:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.564+0000 7f9214800640 1 -- 172.21.15.59:0/2020146096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c15e860 msgr2=0x7f920c0ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.564+0000 7f9214800640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c15e860 0x7f920c0ae540 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f920800c780 tx=0x7f920800cc40 comp rx=0 tx=0).stop 2024-05-30T16:59:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.564+0000 7f9214800640 1 -- 172.21.15.59:0/2020146096 shutdown_connections 2024-05-30T16:59:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.564+0000 7f9214800640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f91f0069520 0x7f91f006b9e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.564+0000 7f9214800640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c15e860 0x7f920c0ae540 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.564+0000 7f9214800640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f920c0d0e80 0x7f920c153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.564+0000 7f9214800640 1 --2- 172.21.15.59:0/2020146096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f920c0c6f50 0x7f920c1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.564+0000 7f9214800640 1 -- 172.21.15.59:0/2020146096 >> 172.21.15.59:0/2020146096 conn(0x7f920c0b2fc0 msgr2=0x7f920c070670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.564+0000 7f9214800640 1 -- 172.21.15.59:0/2020146096 shutdown_connections 2024-05-30T16:59:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.564+0000 7f9214800640 1 -- 172.21.15.59:0/2020146096 wait complete. 2024-05-30T16:59:41.586 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2024-05-30T16:59:41.307578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":750012,"kb_used_data":9592,"kb_used_omap":12,"kb_used_meta":740275,"kb_avail":754224708,"statfs":{"total":773094113280,"available":772326100992,"internally_reserved":0,"allocated":9822208,"data_stored":4874819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":758042160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001390"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097792+0000","last_change":"2024-05-30T16:59:37.093203+0000","last_active":"2024-05-30T16:59:37.097792+0000","last_peered":"2024-05-30T16:59:37.097792+0000","last_clean":"2024-05-30T16:59:37.097792+0000","last_became_active":"2024-05-30T16:59:37.092105+0000","last_became_peered":"2024-05-30T16:59:37.092105+0000","last_unstale":"2024-05-30T16:59:37.097792+0000","last_undegraded":"2024-05-30T16:59:37.097792+0000","last_fullsized":"2024-05-30T16:59:37.097792+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:49.431377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097664+0000","last_change":"2024-05-30T16:59:37.093116+0000","last_active":"2024-05-30T16:59:37.097664+0000","last_peered":"2024-05-30T16:59:37.097664+0000","last_clean":"2024-05-30T16:59:37.097664+0000","last_became_active":"2024-05-30T16:59:37.092861+0000","last_became_peered":"2024-05-30T16:59:37.092861+0000","last_unstale":"2024-05-30T16:59:37.097664+0000","last_undegraded":"2024-05-30T16:59:37.097664+0000","last_fullsized":"2024-05-30T16:59:37.097664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:00:31.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096113+0000","last_change":"2024-05-30T16:59:37.092582+0000","last_active":"2024-05-30T16:59:37.096113+0000","last_peered":"2024-05-30T16:59:37.096113+0000","last_clean":"2024-05-30T16:59:37.096113+0000","last_became_active":"2024-05-30T16:59:37.092334+0000","last_became_peered":"2024-05-30T16:59:37.092334+0000","last_unstale":"2024-05-30T16:59:37.096113+0000","last_undegraded":"2024-05-30T16:59:37.096113+0000","last_fullsized":"2024-05-30T16:59:37.096113+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:03:20.704600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.085330+0000","last_change":"2024-05-30T16:59:37.082085+0000","last_active":"2024-05-30T16:59:37.085330+0000","last_peered":"2024-05-30T16:59:37.085330+0000","last_clean":"2024-05-30T16:59:37.085330+0000","last_became_active":"2024-05-30T16:59:37.081821+0000","last_became_peered":"2024-05-30T16:59:37.081821+0000","last_unstale":"2024-05-30T16:59:37.085330+0000","last_undegraded":"2024-05-30T16:59:37.085330+0000","last_fullsized":"2024-05-30T16:59:37.085330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:34.423495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088413+0000","last_change":"2024-05-30T16:59:37.085960+0000","last_active":"2024-05-30T16:59:37.088413+0000","last_peered":"2024-05-30T16:59:37.088413+0000","last_clean":"2024-05-30T16:59:37.088413+0000","last_became_active":"2024-05-30T16:59:37.085666+0000","last_became_peered":"2024-05-30T16:59:37.085666+0000","last_unstale":"2024-05-30T16:59:37.088413+0000","last_undegraded":"2024-05-30T16:59:37.088413+0000","last_fullsized":"2024-05-30T16:59:37.088413+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:49.431377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.074647+0000","last_change":"2024-05-30T16:59:37.072380+0000","last_active":"2024-05-30T16:59:37.074647+0000","last_peered":"2024-05-30T16:59:37.074647+0000","last_clean":"2024-05-30T16:59:37.074647+0000","last_became_active":"2024-05-30T16:59:37.072034+0000","last_became_peered":"2024-05-30T16:59:37.072034+0000","last_unstale":"2024-05-30T16:59:37.074647+0000","last_undegraded":"2024-05-30T16:59:37.074647+0000","last_fullsized":"2024-05-30T16:59:37.074647+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:49.431377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.077765+0000","last_change":"2024-05-30T16:59:37.076182+0000","last_active":"2024-05-30T16:59:37.077765+0000","last_peered":"2024-05-30T16:59:37.077765+0000","last_clean":"2024-05-30T16:59:37.077765+0000","last_became_active":"2024-05-30T16:59:37.075914+0000","last_became_peered":"2024-05-30T16:59:37.075914+0000","last_unstale":"2024-05-30T16:59:37.077765+0000","last_undegraded":"2024-05-30T16:59:37.077765+0000","last_fullsized":"2024-05-30T16:59:37.077765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:28.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.085938+0000","last_change":"2024-05-30T16:59:37.078450+0000","last_active":"2024-05-30T16:59:37.085938+0000","last_peered":"2024-05-30T16:59:37.085938+0000","last_clean":"2024-05-30T16:59:37.085938+0000","last_became_active":"2024-05-30T16:59:37.078165+0000","last_became_peered":"2024-05-30T16:59:37.078165+0000","last_unstale":"2024-05-30T16:59:37.085938+0000","last_undegraded":"2024-05-30T16:59:37.085938+0000","last_fullsized":"2024-05-30T16:59:37.085938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:09.831864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.092466+0000","last_change":"2024-05-30T16:59:37.082510+0000","last_active":"2024-05-30T16:59:37.092466+0000","last_peered":"2024-05-30T16:59:37.092466+0000","last_clean":"2024-05-30T16:59:37.092466+0000","last_became_active":"2024-05-30T16:59:37.082213+0000","last_became_peered":"2024-05-30T16:59:37.082213+0000","last_unstale":"2024-05-30T16:59:37.092466+0000","last_undegraded":"2024-05-30T16:59:37.092466+0000","last_fullsized":"2024-05-30T16:59:37.092466+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:38.192437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094915+0000","last_change":"2024-05-30T16:59:37.091906+0000","last_active":"2024-05-30T16:59:37.094915+0000","last_peered":"2024-05-30T16:59:37.094915+0000","last_clean":"2024-05-30T16:59:37.094915+0000","last_became_active":"2024-05-30T16:59:37.091488+0000","last_became_peered":"2024-05-30T16:59:37.091488+0000","last_unstale":"2024-05-30T16:59:37.094915+0000","last_undegraded":"2024-05-30T16:59:37.094915+0000","last_fullsized":"2024-05-30T16:59:37.094915+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:14:10.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093509+0000","last_change":"2024-05-30T16:59:37.081319+0000","last_active":"2024-05-30T16:59:37.093509+0000","last_peered":"2024-05-30T16:59:37.093509+0000","last_clean":"2024-05-30T16:59:37.093509+0000","last_became_active":"2024-05-30T16:59:37.078930+0000","last_became_peered":"2024-05-30T16:59:37.078930+0000","last_unstale":"2024-05-30T16:59:37.093509+0000","last_undegraded":"2024-05-30T16:59:37.093509+0000","last_fullsized":"2024-05-30T16:59:37.093509+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:31.036487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094961+0000","last_change":"2024-05-30T16:59:37.091682+0000","last_active":"2024-05-30T16:59:37.094961+0000","last_peered":"2024-05-30T16:59:37.094961+0000","last_clean":"2024-05-30T16:59:37.094961+0000","last_became_active":"2024-05-30T16:59:37.091372+0000","last_became_peered":"2024-05-30T16:59:37.091372+0000","last_unstale":"2024-05-30T16:59:37.094961+0000","last_undegraded":"2024-05-30T16:59:37.094961+0000","last_fullsized":"2024-05-30T16:59:37.094961+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:18.838783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.082590+0000","last_change":"2024-05-30T16:59:37.080801+0000","last_active":"2024-05-30T16:59:37.082590+0000","last_peered":"2024-05-30T16:59:37.082590+0000","last_clean":"2024-05-30T16:59:37.082590+0000","last_became_active":"2024-05-30T16:59:37.080526+0000","last_became_peered":"2024-05-30T16:59:37.080526+0000","last_unstale":"2024-05-30T16:59:37.082590+0000","last_undegraded":"2024-05-30T16:59:37.082590+0000","last_fullsized":"2024-05-30T16:59:37.082590+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:52:53.010477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.090436+0000","last_change":"2024-05-30T16:59:37.087845+0000","last_active":"2024-05-30T16:59:37.090436+0000","last_peered":"2024-05-30T16:59:37.090436+0000","last_clean":"2024-05-30T16:59:37.090436+0000","last_became_active":"2024-05-30T16:59:37.085959+0000","last_became_peered":"2024-05-30T16:59:37.085959+0000","last_unstale":"2024-05-30T16:59:37.090436+0000","last_undegraded":"2024-05-30T16:59:37.090436+0000","last_fullsized":"2024-05-30T16:59:37.090436+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:31.036487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2024-05-30T16:59:36.074732+0000","last_change":"2024-05-30T16:59:36.074732+0000","last_active":"2024-05-30T16:59:36.046240+0000","last_peered":"2024-05-30T16:59:36.046240+0000","last_clean":"2024-05-30T16:59:36.046240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:59:36.074732+0000","last_undegraded":"2024-05-30T16:59:36.074732+0000","last_fullsized":"2024-05-30T16:59:36.074732+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.090844+0000","last_change":"2024-05-30T16:59:37.090158+0000","last_active":"2024-05-30T16:59:37.090844+0000","last_peered":"2024-05-30T16:59:37.090844+0000","last_clean":"2024-05-30T16:59:37.090844+0000","last_became_active":"2024-05-30T16:59:37.089875+0000","last_became_peered":"2024-05-30T16:59:37.089875+0000","last_unstale":"2024-05-30T16:59:37.090844+0000","last_undegraded":"2024-05-30T16:59:37.090844+0000","last_fullsized":"2024-05-30T16:59:37.090844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:09.831864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088754+0000","last_change":"2024-05-30T16:59:37.084968+0000","last_active":"2024-05-30T16:59:37.088754+0000","last_peered":"2024-05-30T16:59:37.088754+0000","last_clean":"2024-05-30T16:59:37.088754+0000","last_became_active":"2024-05-30T16:59:37.084679+0000","last_became_peered":"2024-05-30T16:59:37.084679+0000","last_unstale":"2024-05-30T16:59:37.088754+0000","last_undegraded":"2024-05-30T16:59:37.088754+0000","last_fullsized":"2024-05-30T16:59:37.088754+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:18.838783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094819+0000","last_change":"2024-05-30T16:59:37.092473+0000","last_active":"2024-05-30T16:59:37.094819+0000","last_peered":"2024-05-30T16:59:37.094819+0000","last_clean":"2024-05-30T16:59:37.094819+0000","last_became_active":"2024-05-30T16:59:37.092195+0000","last_became_peered":"2024-05-30T16:59:37.092195+0000","last_unstale":"2024-05-30T16:59:37.094819+0000","last_undegraded":"2024-05-30T16:59:37.094819+0000","last_fullsized":"2024-05-30T16:59:37.094819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:26.963969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.090323+0000","last_change":"2024-05-30T16:59:37.086366+0000","last_active":"2024-05-30T16:59:37.090323+0000","last_peered":"2024-05-30T16:59:37.090323+0000","last_clean":"2024-05-30T16:59:37.090323+0000","last_became_active":"2024-05-30T16:59:37.086008+0000","last_became_peered":"2024-05-30T16:59:37.086008+0000","last_unstale":"2024-05-30T16:59:37.090323+0000","last_undegraded":"2024-05-30T16:59:37.090323+0000","last_fullsized":"2024-05-30T16:59:37.090323+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:01.271116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094640+0000","last_change":"2024-05-30T16:59:37.091075+0000","last_active":"2024-05-30T16:59:37.094640+0000","last_peered":"2024-05-30T16:59:37.094640+0000","last_clean":"2024-05-30T16:59:37.094640+0000","last_became_active":"2024-05-30T16:59:37.090740+0000","last_became_peered":"2024-05-30T16:59:37.090740+0000","last_unstale":"2024-05-30T16:59:37.094640+0000","last_undegraded":"2024-05-30T16:59:37.094640+0000","last_fullsized":"2024-05-30T16:59:37.094640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:12.422505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.083675+0000","last_change":"2024-05-30T16:59:37.081310+0000","last_active":"2024-05-30T16:59:37.083675+0000","last_peered":"2024-05-30T16:59:37.083675+0000","last_clean":"2024-05-30T16:59:37.083675+0000","last_became_active":"2024-05-30T16:59:37.081051+0000","last_became_peered":"2024-05-30T16:59:37.081051+0000","last_unstale":"2024-05-30T16:59:37.083675+0000","last_undegraded":"2024-05-30T16:59:37.083675+0000","last_fullsized":"2024-05-30T16:59:37.083675+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:47.461836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097459+0000","last_change":"2024-05-30T16:59:37.092092+0000","last_active":"2024-05-30T16:59:37.097459+0000","last_peered":"2024-05-30T16:59:37.097459+0000","last_clean":"2024-05-30T16:59:37.097459+0000","last_became_active":"2024-05-30T16:59:37.089929+0000","last_became_peered":"2024-05-30T16:59:37.089929+0000","last_unstale":"2024-05-30T16:59:37.097459+0000","last_undegraded":"2024-05-30T16:59:37.097459+0000","last_fullsized":"2024-05-30T16:59:37.097459+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:00:47.652785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093649+0000","last_change":"2024-05-30T16:59:37.089008+0000","last_active":"2024-05-30T16:59:37.093649+0000","last_peered":"2024-05-30T16:59:37.093649+0000","last_clean":"2024-05-30T16:59:37.093649+0000","last_became_active":"2024-05-30T16:59:37.088577+0000","last_became_peered":"2024-05-30T16:59:37.088577+0000","last_unstale":"2024-05-30T16:59:37.093649+0000","last_undegraded":"2024-05-30T16:59:37.093649+0000","last_fullsized":"2024-05-30T16:59:37.093649+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:55.662497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084673+0000","last_change":"2024-05-30T16:59:37.077530+0000","last_active":"2024-05-30T16:59:37.084673+0000","last_peered":"2024-05-30T16:59:37.084673+0000","last_clean":"2024-05-30T16:59:37.084673+0000","last_became_active":"2024-05-30T16:59:37.077272+0000","last_became_peered":"2024-05-30T16:59:37.077272+0000","last_unstale":"2024-05-30T16:59:37.084673+0000","last_undegraded":"2024-05-30T16:59:37.084673+0000","last_fullsized":"2024-05-30T16:59:37.084673+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:46:59.562379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097260+0000","last_change":"2024-05-30T16:59:37.092872+0000","last_active":"2024-05-30T16:59:37.097260+0000","last_peered":"2024-05-30T16:59:37.097260+0000","last_clean":"2024-05-30T16:59:37.097260+0000","last_became_active":"2024-05-30T16:59:37.092602+0000","last_became_peered":"2024-05-30T16:59:37.092602+0000","last_unstale":"2024-05-30T16:59:37.097260+0000","last_undegraded":"2024-05-30T16:59:37.097260+0000","last_fullsized":"2024-05-30T16:59:37.097260+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:55:23.698395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.083155+0000","last_change":"2024-05-30T16:59:37.082108+0000","last_active":"2024-05-30T16:59:37.083155+0000","last_peered":"2024-05-30T16:59:37.083155+0000","last_clean":"2024-05-30T16:59:37.083155+0000","last_became_active":"2024-05-30T16:59:37.081786+0000","last_became_peered":"2024-05-30T16:59:37.081786+0000","last_unstale":"2024-05-30T16:59:37.083155+0000","last_undegraded":"2024-05-30T16:59:37.083155+0000","last_fullsized":"2024-05-30T16:59:37.083155+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:31:42.026333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.076454+0000","last_change":"2024-05-30T16:59:37.074108+0000","last_active":"2024-05-30T16:59:37.076454+0000","last_peered":"2024-05-30T16:59:37.076454+0000","last_clean":"2024-05-30T16:59:37.076454+0000","last_became_active":"2024-05-30T16:59:37.073685+0000","last_became_peered":"2024-05-30T16:59:37.073685+0000","last_unstale":"2024-05-30T16:59:37.076454+0000","last_undegraded":"2024-05-30T16:59:37.076454+0000","last_fullsized":"2024-05-30T16:59:37.076454+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094944+0000","last_change":"2024-05-30T16:59:37.091611+0000","last_active":"2024-05-30T16:59:37.094944+0000","last_peered":"2024-05-30T16:59:37.094944+0000","last_clean":"2024-05-30T16:59:37.094944+0000","last_became_active":"2024-05-30T16:59:37.091300+0000","last_became_peered":"2024-05-30T16:59:37.091300+0000","last_unstale":"2024-05-30T16:59:37.094944+0000","last_undegraded":"2024-05-30T16:59:37.094944+0000","last_fullsized":"2024-05-30T16:59:37.094944+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:28.347373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.083386+0000","last_change":"2024-05-30T16:59:37.074729+0000","last_active":"2024-05-30T16:59:37.083386+0000","last_peered":"2024-05-30T16:59:37.083386+0000","last_clean":"2024-05-30T16:59:37.083386+0000","last_became_active":"2024-05-30T16:59:37.074457+0000","last_became_peered":"2024-05-30T16:59:37.074457+0000","last_unstale":"2024-05-30T16:59:37.083386+0000","last_undegraded":"2024-05-30T16:59:37.083386+0000","last_fullsized":"2024-05-30T16:59:37.083386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:46:59.562379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097150+0000","last_change":"2024-05-30T16:59:37.090233+0000","last_active":"2024-05-30T16:59:37.097150+0000","last_peered":"2024-05-30T16:59:37.097150+0000","last_clean":"2024-05-30T16:59:37.097150+0000","last_became_active":"2024-05-30T16:59:37.088987+0000","last_became_peered":"2024-05-30T16:59:37.088987+0000","last_unstale":"2024-05-30T16:59:37.097150+0000","last_undegraded":"2024-05-30T16:59:37.097150+0000","last_fullsized":"2024-05-30T16:59:37.097150+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:37.960162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084344+0000","last_change":"2024-05-30T16:59:37.077683+0000","last_active":"2024-05-30T16:59:37.084344+0000","last_peered":"2024-05-30T16:59:37.084344+0000","last_clean":"2024-05-30T16:59:37.084344+0000","last_became_active":"2024-05-30T16:59:37.077380+0000","last_became_peered":"2024-05-30T16:59:37.077380+0000","last_unstale":"2024-05-30T16:59:37.084344+0000","last_undegraded":"2024-05-30T16:59:37.084344+0000","last_fullsized":"2024-05-30T16:59:37.084344+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:55.662497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093602+0000","last_change":"2024-05-30T16:59:37.088784+0000","last_active":"2024-05-30T16:59:37.093602+0000","last_peered":"2024-05-30T16:59:37.093602+0000","last_clean":"2024-05-30T16:59:37.093602+0000","last_became_active":"2024-05-30T16:59:37.088500+0000","last_became_peered":"2024-05-30T16:59:37.088500+0000","last_unstale":"2024-05-30T16:59:37.093602+0000","last_undegraded":"2024-05-30T16:59:37.093602+0000","last_fullsized":"2024-05-30T16:59:37.093602+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093833+0000","last_change":"2024-05-30T16:59:37.092667+0000","last_active":"2024-05-30T16:59:37.093833+0000","last_peered":"2024-05-30T16:59:37.093833+0000","last_clean":"2024-05-30T16:59:37.093833+0000","last_became_active":"2024-05-30T16:59:37.092305+0000","last_became_peered":"2024-05-30T16:59:37.092305+0000","last_unstale":"2024-05-30T16:59:37.093833+0000","last_undegraded":"2024-05-30T16:59:37.093833+0000","last_fullsized":"2024-05-30T16:59:37.093833+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:38.192437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"89'4","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097944+0000","last_change":"2024-05-30T16:59:36.079591+0000","last_active":"2024-05-30T16:59:37.097944+0000","last_peered":"2024-05-30T16:59:37.097944+0000","last_clean":"2024-05-30T16:59:37.097944+0000","last_became_active":"2024-05-30T16:59:36.079273+0000","last_became_peered":"2024-05-30T16:59:36.079273+0000","last_unstale":"2024-05-30T16:59:37.097944+0000","last_undegraded":"2024-05-30T16:59:37.097944+0000","last_fullsized":"2024-05-30T16:59:37.097944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:07.078092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.098140+0000","last_change":"2024-05-30T16:59:37.097479+0000","last_active":"2024-05-30T16:59:37.098140+0000","last_peered":"2024-05-30T16:59:37.098140+0000","last_clean":"2024-05-30T16:59:37.098140+0000","last_became_active":"2024-05-30T16:59:37.096852+0000","last_became_peered":"2024-05-30T16:59:37.096852+0000","last_unstale":"2024-05-30T16:59:37.098140+0000","last_undegraded":"2024-05-30T16:59:37.098140+0000","last_fullsized":"2024-05-30T16:59:37.098140+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:47.601590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094316+0000","last_change":"2024-05-30T16:59:36.081492+0000","last_active":"2024-05-30T16:59:37.094316+0000","last_peered":"2024-05-30T16:59:37.094316+0000","last_clean":"2024-05-30T16:59:37.094316+0000","last_became_active":"2024-05-30T16:59:36.081071+0000","last_became_peered":"2024-05-30T16:59:36.081071+0000","last_unstale":"2024-05-30T16:59:37.094316+0000","last_undegraded":"2024-05-30T16:59:37.094316+0000","last_fullsized":"2024-05-30T16:59:37.094316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:32.389864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.098693+0000","last_change":"2024-05-30T16:59:37.098058+0000","last_active":"2024-05-30T16:59:37.098693+0000","last_peered":"2024-05-30T16:59:37.098693+0000","last_clean":"2024-05-30T16:59:37.098693+0000","last_became_active":"2024-05-30T16:59:37.097708+0000","last_became_peered":"2024-05-30T16:59:37.097708+0000","last_unstale":"2024-05-30T16:59:37.098693+0000","last_undegraded":"2024-05-30T16:59:37.098693+0000","last_fullsized":"2024-05-30T16:59:37.098693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:57.044016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.091618+0000","last_change":"2024-05-30T16:59:36.084335+0000","last_active":"2024-05-30T16:59:37.091618+0000","last_peered":"2024-05-30T16:59:37.091618+0000","last_clean":"2024-05-30T16:59:37.091618+0000","last_became_active":"2024-05-30T16:59:36.083933+0000","last_became_peered":"2024-05-30T16:59:36.083933+0000","last_unstale":"2024-05-30T16:59:37.091618+0000","last_undegraded":"2024-05-30T16:59:37.091618+0000","last_fullsized":"2024-05-30T16:59:37.091618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:27:43.028647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.087183+0000","last_change":"2024-05-30T16:59:37.084018+0000","last_active":"2024-05-30T16:59:37.087183+0000","last_peered":"2024-05-30T16:59:37.087183+0000","last_clean":"2024-05-30T16:59:37.087183+0000","last_became_active":"2024-05-30T16:59:37.083711+0000","last_became_peered":"2024-05-30T16:59:37.083711+0000","last_unstale":"2024-05-30T16:59:37.087183+0000","last_undegraded":"2024-05-30T16:59:37.087183+0000","last_fullsized":"2024-05-30T16:59:37.087183+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:48.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095023+0000","last_change":"2024-05-30T16:59:36.081241+0000","last_active":"2024-05-30T16:59:37.095023+0000","last_peered":"2024-05-30T16:59:37.095023+0000","last_clean":"2024-05-30T16:59:37.095023+0000","last_became_active":"2024-05-30T16:59:36.080949+0000","last_became_peered":"2024-05-30T16:59:36.080949+0000","last_unstale":"2024-05-30T16:59:37.095023+0000","last_undegraded":"2024-05-30T16:59:37.095023+0000","last_fullsized":"2024-05-30T16:59:37.095023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:37.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093990+0000","last_change":"2024-05-30T16:59:37.085898+0000","last_active":"2024-05-30T16:59:37.093990+0000","last_peered":"2024-05-30T16:59:37.093990+0000","last_clean":"2024-05-30T16:59:37.093990+0000","last_became_active":"2024-05-30T16:59:37.081928+0000","last_became_peered":"2024-05-30T16:59:37.081928+0000","last_unstale":"2024-05-30T16:59:37.093990+0000","last_undegraded":"2024-05-30T16:59:37.093990+0000","last_fullsized":"2024-05-30T16:59:37.093990+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:08:05.904777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095229+0000","last_change":"2024-05-30T16:59:36.086610+0000","last_active":"2024-05-30T16:59:37.095229+0000","last_peered":"2024-05-30T16:59:37.095229+0000","last_clean":"2024-05-30T16:59:37.095229+0000","last_became_active":"2024-05-30T16:59:36.086428+0000","last_became_peered":"2024-05-30T16:59:36.086428+0000","last_unstale":"2024-05-30T16:59:37.095229+0000","last_undegraded":"2024-05-30T16:59:37.095229+0000","last_fullsized":"2024-05-30T16:59:37.095229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:36:36.936609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089285+0000","last_change":"2024-05-30T16:59:37.086396+0000","last_active":"2024-05-30T16:59:37.089285+0000","last_peered":"2024-05-30T16:59:37.089285+0000","last_clean":"2024-05-30T16:59:37.089285+0000","last_became_active":"2024-05-30T16:59:37.086095+0000","last_became_peered":"2024-05-30T16:59:37.086095+0000","last_unstale":"2024-05-30T16:59:37.089285+0000","last_undegraded":"2024-05-30T16:59:37.089285+0000","last_fullsized":"2024-05-30T16:59:37.089285+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:33.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094358+0000","last_change":"2024-05-30T16:59:36.082645+0000","last_active":"2024-05-30T16:59:37.094358+0000","last_peered":"2024-05-30T16:59:37.094358+0000","last_clean":"2024-05-30T16:59:37.094358+0000","last_became_active":"2024-05-30T16:59:36.082380+0000","last_became_peered":"2024-05-30T16:59:36.082380+0000","last_unstale":"2024-05-30T16:59:37.094358+0000","last_undegraded":"2024-05-30T16:59:37.094358+0000","last_fullsized":"2024-05-30T16:59:37.094358+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:09.218872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094539+0000","last_change":"2024-05-30T16:59:37.092211+0000","last_active":"2024-05-30T16:59:37.094539+0000","last_peered":"2024-05-30T16:59:37.094539+0000","last_clean":"2024-05-30T16:59:37.094539+0000","last_became_active":"2024-05-30T16:59:37.091725+0000","last_became_peered":"2024-05-30T16:59:37.091725+0000","last_unstale":"2024-05-30T16:59:37.094539+0000","last_undegraded":"2024-05-30T16:59:37.094539+0000","last_fullsized":"2024-05-30T16:59:37.094539+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:04.577990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.070984+0000","last_change":"2024-05-30T16:59:36.072167+0000","last_active":"2024-05-30T16:59:37.070984+0000","last_peered":"2024-05-30T16:59:37.070984+0000","last_clean":"2024-05-30T16:59:37.070984+0000","last_became_active":"2024-05-30T16:59:36.071855+0000","last_became_peered":"2024-05-30T16:59:36.071855+0000","last_unstale":"2024-05-30T16:59:37.070984+0000","last_undegraded":"2024-05-30T16:59:37.070984+0000","last_fullsized":"2024-05-30T16:59:37.070984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:56.040644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2024-05-30T16:59:36.073664+0000","last_change":"2024-05-30T16:59:36.073664+0000","last_active":"2024-05-30T16:59:36.046240+0000","last_peered":"2024-05-30T16:59:36.046240+0000","last_clean":"2024-05-30T16:59:36.046240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:59:36.073664+0000","last_undegraded":"2024-05-30T16:59:36.073664+0000","last_fullsized":"2024-05-30T16:59:36.073664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.079726+0000","last_change":"2024-05-30T16:59:36.075847+0000","last_active":"2024-05-30T16:59:37.079726+0000","last_peered":"2024-05-30T16:59:37.079726+0000","last_clean":"2024-05-30T16:59:37.079726+0000","last_became_active":"2024-05-30T16:59:36.075436+0000","last_became_peered":"2024-05-30T16:59:36.075436+0000","last_unstale":"2024-05-30T16:59:37.079726+0000","last_undegraded":"2024-05-30T16:59:37.079726+0000","last_fullsized":"2024-05-30T16:59:37.079726+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:33.420123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2024-05-30T16:59:36.067175+0000","last_change":"2024-05-30T16:59:36.067175+0000","last_active":"2024-05-30T16:59:36.046240+0000","last_peered":"2024-05-30T16:59:36.046240+0000","last_clean":"2024-05-30T16:59:36.046240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:59:36.067175+0000","last_undegraded":"2024-05-30T16:59:36.067175+0000","last_fullsized":"2024-05-30T16:59:36.067175+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.075354+0000","last_change":"2024-05-30T16:59:36.084230+0000","last_active":"2024-05-30T16:59:37.075354+0000","last_peered":"2024-05-30T16:59:37.075354+0000","last_clean":"2024-05-30T16:59:37.075354+0000","last_became_active":"2024-05-30T16:59:36.083951+0000","last_became_peered":"2024-05-30T16:59:36.083951+0000","last_unstale":"2024-05-30T16:59:37.075354+0000","last_undegraded":"2024-05-30T16:59:37.075354+0000","last_fullsized":"2024-05-30T16:59:37.075354+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:05.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.074719+0000","last_change":"2024-05-30T16:59:37.072293+0000","last_active":"2024-05-30T16:59:37.074719+0000","last_peered":"2024-05-30T16:59:37.074719+0000","last_clean":"2024-05-30T16:59:37.074719+0000","last_became_active":"2024-05-30T16:59:37.068848+0000","last_became_peered":"2024-05-30T16:59:37.068848+0000","last_unstale":"2024-05-30T16:59:37.074719+0000","last_undegraded":"2024-05-30T16:59:37.074719+0000","last_fullsized":"2024-05-30T16:59:37.074719+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:14:10.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.081030+0000","last_change":"2024-05-30T16:59:36.076816+0000","last_active":"2024-05-30T16:59:37.081030+0000","last_peered":"2024-05-30T16:59:37.081030+0000","last_clean":"2024-05-30T16:59:37.081030+0000","last_became_active":"2024-05-30T16:59:36.076449+0000","last_became_peered":"2024-05-30T16:59:36.076449+0000","last_unstale":"2024-05-30T16:59:37.081030+0000","last_undegraded":"2024-05-30T16:59:37.081030+0000","last_fullsized":"2024-05-30T16:59:37.081030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:36:36.936609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096917+0000","last_change":"2024-05-30T16:59:37.094548+0000","last_active":"2024-05-30T16:59:37.096917+0000","last_peered":"2024-05-30T16:59:37.096917+0000","last_clean":"2024-05-30T16:59:37.096917+0000","last_became_active":"2024-05-30T16:59:37.094267+0000","last_became_peered":"2024-05-30T16:59:37.094267+0000","last_unstale":"2024-05-30T16:59:37.096917+0000","last_undegraded":"2024-05-30T16:59:37.096917+0000","last_fullsized":"2024-05-30T16:59:37.096917+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:54.042211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"89'3","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.099318+0000","last_change":"2024-05-30T16:59:36.083663+0000","last_active":"2024-05-30T16:59:37.099318+0000","last_peered":"2024-05-30T16:59:37.099318+0000","last_clean":"2024-05-30T16:59:37.099318+0000","last_became_active":"2024-05-30T16:59:36.083370+0000","last_became_peered":"2024-05-30T16:59:36.083370+0000","last_unstale":"2024-05-30T16:59:37.099318+0000","last_undegraded":"2024-05-30T16:59:37.099318+0000","last_fullsized":"2024-05-30T16:59:37.099318+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:47:12.815654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089450+0000","last_change":"2024-05-30T16:59:37.087703+0000","last_active":"2024-05-30T16:59:37.089450+0000","last_peered":"2024-05-30T16:59:37.089450+0000","last_clean":"2024-05-30T16:59:37.089450+0000","last_became_active":"2024-05-30T16:59:37.087368+0000","last_became_peered":"2024-05-30T16:59:37.087368+0000","last_unstale":"2024-05-30T16:59:37.089450+0000","last_undegraded":"2024-05-30T16:59:37.089450+0000","last_fullsized":"2024-05-30T16:59:37.089450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:57.044016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"89'6","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.099682+0000","last_change":"2024-05-30T16:59:36.066172+0000","last_active":"2024-05-30T16:59:37.099682+0000","last_peered":"2024-05-30T16:59:37.099682+0000","last_clean":"2024-05-30T16:59:37.099682+0000","last_became_active":"2024-05-30T16:59:36.064294+0000","last_became_peered":"2024-05-30T16:59:36.064294+0000","last_unstale":"2024-05-30T16:59:37.099682+0000","last_undegraded":"2024-05-30T16:59:37.099682+0000","last_fullsized":"2024-05-30T16:59:37.099682+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:17.835411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089850+0000","last_change":"2024-05-30T16:59:37.084517+0000","last_active":"2024-05-30T16:59:37.089850+0000","last_peered":"2024-05-30T16:59:37.089850+0000","last_clean":"2024-05-30T16:59:37.089850+0000","last_became_active":"2024-05-30T16:59:37.084243+0000","last_became_peered":"2024-05-30T16:59:37.084243+0000","last_unstale":"2024-05-30T16:59:37.089850+0000","last_undegraded":"2024-05-30T16:59:37.089850+0000","last_fullsized":"2024-05-30T16:59:37.089850+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:16:00.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.098352+0000","last_change":"2024-05-30T16:59:36.074867+0000","last_active":"2024-05-30T16:59:37.098352+0000","last_peered":"2024-05-30T16:59:37.098352+0000","last_clean":"2024-05-30T16:59:37.098352+0000","last_became_active":"2024-05-30T16:59:36.074584+0000","last_became_peered":"2024-05-30T16:59:36.074584+0000","last_unstale":"2024-05-30T16:59:37.098352+0000","last_undegraded":"2024-05-30T16:59:37.098352+0000","last_fullsized":"2024-05-30T16:59:37.098352+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:04:38.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096872+0000","last_change":"2024-05-30T16:59:37.094928+0000","last_active":"2024-05-30T16:59:37.096872+0000","last_peered":"2024-05-30T16:59:37.096872+0000","last_clean":"2024-05-30T16:59:37.096872+0000","last_became_active":"2024-05-30T16:59:37.094508+0000","last_became_peered":"2024-05-30T16:59:37.094508+0000","last_unstale":"2024-05-30T16:59:37.096872+0000","last_undegraded":"2024-05-30T16:59:37.096872+0000","last_fullsized":"2024-05-30T16:59:37.096872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:19:38.753995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T16:59:36.074268+0000","last_change":"2024-05-30T16:59:36.072195+0000","last_active":"2024-05-30T16:59:36.074268+0000","last_peered":"2024-05-30T16:59:36.074268+0000","last_clean":"2024-05-30T16:59:36.074268+0000","last_became_active":"2024-05-30T16:59:36.071318+0000","last_became_peered":"2024-05-30T16:59:36.071318+0000","last_unstale":"2024-05-30T16:59:36.074268+0000","last_undegraded":"2024-05-30T16:59:36.074268+0000","last_fullsized":"2024-05-30T16:59:36.074268+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:53:57.101832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094882+0000","last_change":"2024-05-30T16:59:37.085652+0000","last_active":"2024-05-30T16:59:37.094882+0000","last_peered":"2024-05-30T16:59:37.094882+0000","last_clean":"2024-05-30T16:59:37.094882+0000","last_became_active":"2024-05-30T16:59:37.085321+0000","last_became_peered":"2024-05-30T16:59:37.085321+0000","last_unstale":"2024-05-30T16:59:37.094882+0000","last_undegraded":"2024-05-30T16:59:37.094882+0000","last_fullsized":"2024-05-30T16:59:37.094882+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:26:37.459231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.065802+0000","last_change":"2024-05-30T16:59:36.073851+0000","last_active":"2024-05-30T16:59:37.065802+0000","last_peered":"2024-05-30T16:59:37.065802+0000","last_clean":"2024-05-30T16:59:37.065802+0000","last_became_active":"2024-05-30T16:59:36.073504+0000","last_became_peered":"2024-05-30T16:59:36.073504+0000","last_unstale":"2024-05-30T16:59:37.065802+0000","last_undegraded":"2024-05-30T16:59:37.065802+0000","last_fullsized":"2024-05-30T16:59:37.065802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:27.344000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097633+0000","last_change":"2024-05-30T16:59:37.090890+0000","last_active":"2024-05-30T16:59:37.097633+0000","last_peered":"2024-05-30T16:59:37.097633+0000","last_clean":"2024-05-30T16:59:37.097633+0000","last_became_active":"2024-05-30T16:59:37.090646+0000","last_became_peered":"2024-05-30T16:59:37.090646+0000","last_unstale":"2024-05-30T16:59:37.097633+0000","last_undegraded":"2024-05-30T16:59:37.097633+0000","last_fullsized":"2024-05-30T16:59:37.097633+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:59.217253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"89'8","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093819+0000","last_change":"2024-05-30T16:59:36.071455+0000","last_active":"2024-05-30T16:59:37.093819+0000","last_peered":"2024-05-30T16:59:37.093819+0000","last_clean":"2024-05-30T16:59:37.093819+0000","last_became_active":"2024-05-30T16:59:36.071143+0000","last_became_peered":"2024-05-30T16:59:36.071143+0000","last_unstale":"2024-05-30T16:59:37.093819+0000","last_undegraded":"2024-05-30T16:59:37.093819+0000","last_fullsized":"2024-05-30T16:59:37.093819+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:52.348518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088349+0000","last_change":"2024-05-30T16:59:37.085772+0000","last_active":"2024-05-30T16:59:37.088349+0000","last_peered":"2024-05-30T16:59:37.088349+0000","last_clean":"2024-05-30T16:59:37.088349+0000","last_became_active":"2024-05-30T16:59:37.085494+0000","last_became_peered":"2024-05-30T16:59:37.085494+0000","last_unstale":"2024-05-30T16:59:37.088349+0000","last_undegraded":"2024-05-30T16:59:37.088349+0000","last_fullsized":"2024-05-30T16:59:37.088349+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:42:21.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093379+0000","last_change":"2024-05-30T16:59:36.071418+0000","last_active":"2024-05-30T16:59:37.093379+0000","last_peered":"2024-05-30T16:59:37.093379+0000","last_clean":"2024-05-30T16:59:37.093379+0000","last_became_active":"2024-05-30T16:59:36.070404+0000","last_became_peered":"2024-05-30T16:59:36.070404+0000","last_unstale":"2024-05-30T16:59:37.093379+0000","last_undegraded":"2024-05-30T16:59:37.093379+0000","last_fullsized":"2024-05-30T16:59:37.093379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:09.218872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093476+0000","last_change":"2024-05-30T16:59:37.088772+0000","last_active":"2024-05-30T16:59:37.093476+0000","last_peered":"2024-05-30T16:59:37.093476+0000","last_clean":"2024-05-30T16:59:37.093476+0000","last_became_active":"2024-05-30T16:59:37.088489+0000","last_became_peered":"2024-05-30T16:59:37.088489+0000","last_unstale":"2024-05-30T16:59:37.093476+0000","last_undegraded":"2024-05-30T16:59:37.093476+0000","last_fullsized":"2024-05-30T16:59:37.093476+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:33.393237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096457+0000","last_change":"2024-05-30T16:59:36.077558+0000","last_active":"2024-05-30T16:59:37.096457+0000","last_peered":"2024-05-30T16:59:37.096457+0000","last_clean":"2024-05-30T16:59:37.096457+0000","last_became_active":"2024-05-30T16:59:36.076835+0000","last_became_peered":"2024-05-30T16:59:36.076835+0000","last_unstale":"2024-05-30T16:59:37.096457+0000","last_undegraded":"2024-05-30T16:59:37.096457+0000","last_fullsized":"2024-05-30T16:59:37.096457+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:59.947220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088396+0000","last_change":"2024-05-30T16:59:37.085771+0000","last_active":"2024-05-30T16:59:37.088396+0000","last_peered":"2024-05-30T16:59:37.088396+0000","last_clean":"2024-05-30T16:59:37.088396+0000","last_became_active":"2024-05-30T16:59:37.085475+0000","last_became_peered":"2024-05-30T16:59:37.085475+0000","last_unstale":"2024-05-30T16:59:37.088396+0000","last_undegraded":"2024-05-30T16:59:37.088396+0000","last_fullsized":"2024-05-30T16:59:37.088396+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:14:10.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.072496+0000","last_change":"2024-05-30T16:59:36.073081+0000","last_active":"2024-05-30T16:59:37.072496+0000","last_peered":"2024-05-30T16:59:37.072496+0000","last_clean":"2024-05-30T16:59:37.072496+0000","last_became_active":"2024-05-30T16:59:36.072483+0000","last_became_peered":"2024-05-30T16:59:36.072483+0000","last_unstale":"2024-05-30T16:59:37.072496+0000","last_undegraded":"2024-05-30T16:59:37.072496+0000","last_fullsized":"2024-05-30T16:59:37.072496+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:31:23.944400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.085095+0000","last_change":"2024-05-30T16:59:37.082050+0000","last_active":"2024-05-30T16:59:37.085095+0000","last_peered":"2024-05-30T16:59:37.085095+0000","last_clean":"2024-05-30T16:59:37.085095+0000","last_became_active":"2024-05-30T16:59:37.081747+0000","last_became_peered":"2024-05-30T16:59:37.081747+0000","last_unstale":"2024-05-30T16:59:37.085095+0000","last_undegraded":"2024-05-30T16:59:37.085095+0000","last_fullsized":"2024-05-30T16:59:37.085095+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:04:39.484172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T16:59:36.073762+0000","last_change":"2024-05-30T16:59:36.070012+0000","last_active":"2024-05-30T16:59:36.073762+0000","last_peered":"2024-05-30T16:59:36.073762+0000","last_clean":"2024-05-30T16:59:36.073762+0000","last_became_active":"2024-05-30T16:59:36.069700+0000","last_became_peered":"2024-05-30T16:59:36.069700+0000","last_unstale":"2024-05-30T16:59:36.073762+0000","last_undegraded":"2024-05-30T16:59:36.073762+0000","last_fullsized":"2024-05-30T16:59:36.073762+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:51.443117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.075876+0000","last_change":"2024-05-30T16:59:37.072799+0000","last_active":"2024-05-30T16:59:37.075876+0000","last_peered":"2024-05-30T16:59:37.075876+0000","last_clean":"2024-05-30T16:59:37.075876+0000","last_became_active":"2024-05-30T16:59:37.072459+0000","last_became_peered":"2024-05-30T16:59:37.072459+0000","last_unstale":"2024-05-30T16:59:37.075876+0000","last_undegraded":"2024-05-30T16:59:37.075876+0000","last_fullsized":"2024-05-30T16:59:37.075876+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:33.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.061601+0000","last_change":"2024-05-30T16:59:36.078703+0000","last_active":"2024-05-30T16:59:37.061601+0000","last_peered":"2024-05-30T16:59:37.061601+0000","last_clean":"2024-05-30T16:59:37.061601+0000","last_became_active":"2024-05-30T16:59:36.078388+0000","last_became_peered":"2024-05-30T16:59:36.078388+0000","last_unstale":"2024-05-30T16:59:37.061601+0000","last_undegraded":"2024-05-30T16:59:37.061601+0000","last_fullsized":"2024-05-30T16:59:37.061601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:33.197739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.067732+0000","last_change":"2024-05-30T16:59:37.065490+0000","last_active":"2024-05-30T16:59:37.067732+0000","last_peered":"2024-05-30T16:59:37.067732+0000","last_clean":"2024-05-30T16:59:37.067732+0000","last_became_active":"2024-05-30T16:59:37.065012+0000","last_became_peered":"2024-05-30T16:59:37.065012+0000","last_unstale":"2024-05-30T16:59:37.067732+0000","last_undegraded":"2024-05-30T16:59:37.067732+0000","last_fullsized":"2024-05-30T16:59:37.067732+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:28:28.070278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.059802+0000","last_change":"2024-05-30T16:59:36.073987+0000","last_active":"2024-05-30T16:59:37.059802+0000","last_peered":"2024-05-30T16:59:37.059802+0000","last_clean":"2024-05-30T16:59:37.059802+0000","last_became_active":"2024-05-30T16:59:36.073682+0000","last_became_peered":"2024-05-30T16:59:36.073682+0000","last_unstale":"2024-05-30T16:59:37.059802+0000","last_undegraded":"2024-05-30T16:59:37.059802+0000","last_fullsized":"2024-05-30T16:59:37.059802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:04:12.123572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.086046+0000","last_change":"2024-05-30T16:59:37.077255+0000","last_active":"2024-05-30T16:59:37.086046+0000","last_peered":"2024-05-30T16:59:37.086046+0000","last_clean":"2024-05-30T16:59:37.086046+0000","last_became_active":"2024-05-30T16:59:37.075699+0000","last_became_peered":"2024-05-30T16:59:37.075699+0000","last_unstale":"2024-05-30T16:59:37.086046+0000","last_undegraded":"2024-05-30T16:59:37.086046+0000","last_fullsized":"2024-05-30T16:59:37.086046+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:57.044016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T16:59:36.077906+0000","last_change":"2024-05-30T16:59:36.071359+0000","last_active":"2024-05-30T16:59:36.077906+0000","last_peered":"2024-05-30T16:59:36.077906+0000","last_clean":"2024-05-30T16:59:36.077906+0000","last_became_active":"2024-05-30T16:59:36.071068+0000","last_became_peered":"2024-05-30T16:59:36.071068+0000","last_unstale":"2024-05-30T16:59:36.077906+0000","last_undegraded":"2024-05-30T16:59:36.077906+0000","last_fullsized":"2024-05-30T16:59:36.077906+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:43:41.566821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084429+0000","last_change":"2024-05-30T16:59:37.079547+0000","last_active":"2024-05-30T16:59:37.084429+0000","last_peered":"2024-05-30T16:59:37.084429+0000","last_clean":"2024-05-30T16:59:37.084429+0000","last_became_active":"2024-05-30T16:59:37.077473+0000","last_became_peered":"2024-05-30T16:59:37.077473+0000","last_unstale":"2024-05-30T16:59:37.084429+0000","last_undegraded":"2024-05-30T16:59:37.084429+0000","last_fullsized":"2024-05-30T16:59:37.084429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:28.347373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.091656+0000","last_change":"2024-05-30T16:59:36.067314+0000","last_active":"2024-05-30T16:59:37.091656+0000","last_peered":"2024-05-30T16:59:37.091656+0000","last_clean":"2024-05-30T16:59:37.091656+0000","last_became_active":"2024-05-30T16:59:36.064171+0000","last_became_peered":"2024-05-30T16:59:36.064171+0000","last_unstale":"2024-05-30T16:59:37.091656+0000","last_undegraded":"2024-05-30T16:59:37.091656+0000","last_fullsized":"2024-05-30T16:59:37.091656+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:25.960596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095957+0000","last_change":"2024-05-30T16:59:37.093784+0000","last_active":"2024-05-30T16:59:37.095957+0000","last_peered":"2024-05-30T16:59:37.095957+0000","last_clean":"2024-05-30T16:59:37.095957+0000","last_became_active":"2024-05-30T16:59:37.093464+0000","last_became_peered":"2024-05-30T16:59:37.093464+0000","last_unstale":"2024-05-30T16:59:37.095957+0000","last_undegraded":"2024-05-30T16:59:37.095957+0000","last_fullsized":"2024-05-30T16:59:37.095957+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:51:51.208985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.082133+0000","last_change":"2024-05-30T16:59:36.075907+0000","last_active":"2024-05-30T16:59:37.082133+0000","last_peered":"2024-05-30T16:59:37.082133+0000","last_clean":"2024-05-30T16:59:37.082133+0000","last_became_active":"2024-05-30T16:59:36.075639+0000","last_became_peered":"2024-05-30T16:59:36.075639+0000","last_unstale":"2024-05-30T16:59:37.082133+0000","last_undegraded":"2024-05-30T16:59:37.082133+0000","last_fullsized":"2024-05-30T16:59:37.082133+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:11.419133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097395+0000","last_change":"2024-05-30T16:59:37.095753+0000","last_active":"2024-05-30T16:59:37.097395+0000","last_peered":"2024-05-30T16:59:37.097395+0000","last_clean":"2024-05-30T16:59:37.097395+0000","last_became_active":"2024-05-30T16:59:37.095191+0000","last_became_peered":"2024-05-30T16:59:37.095191+0000","last_unstale":"2024-05-30T16:59:37.097395+0000","last_undegraded":"2024-05-30T16:59:37.097395+0000","last_fullsized":"2024-05-30T16:59:37.097395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:33.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.068327+0000","last_change":"2024-05-30T16:59:36.079587+0000","last_active":"2024-05-30T16:59:37.068327+0000","last_peered":"2024-05-30T16:59:37.068327+0000","last_clean":"2024-05-30T16:59:37.068327+0000","last_became_active":"2024-05-30T16:59:36.079306+0000","last_became_peered":"2024-05-30T16:59:36.079306+0000","last_unstale":"2024-05-30T16:59:37.068327+0000","last_undegraded":"2024-05-30T16:59:37.068327+0000","last_fullsized":"2024-05-30T16:59:37.068327+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:41:30.701806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089429+0000","last_change":"2024-05-30T16:59:37.087073+0000","last_active":"2024-05-30T16:59:37.089429+0000","last_peered":"2024-05-30T16:59:37.089429+0000","last_clean":"2024-05-30T16:59:37.089429+0000","last_became_active":"2024-05-30T16:59:37.086784+0000","last_became_peered":"2024-05-30T16:59:37.086784+0000","last_unstale":"2024-05-30T16:59:37.089429+0000","last_undegraded":"2024-05-30T16:59:37.089429+0000","last_fullsized":"2024-05-30T16:59:37.089429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:47.601590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.073399+0000","last_change":"2024-05-30T16:59:36.078081+0000","last_active":"2024-05-30T16:59:37.073399+0000","last_peered":"2024-05-30T16:59:37.073399+0000","last_clean":"2024-05-30T16:59:37.073399+0000","last_became_active":"2024-05-30T16:59:36.077822+0000","last_became_peered":"2024-05-30T16:59:36.077822+0000","last_unstale":"2024-05-30T16:59:37.073399+0000","last_undegraded":"2024-05-30T16:59:37.073399+0000","last_fullsized":"2024-05-30T16:59:37.073399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:45:07.805901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.076430+0000","last_change":"2024-05-30T16:59:37.073176+0000","last_active":"2024-05-30T16:59:37.076430+0000","last_peered":"2024-05-30T16:59:37.076430+0000","last_clean":"2024-05-30T16:59:37.076430+0000","last_became_active":"2024-05-30T16:59:37.072705+0000","last_became_peered":"2024-05-30T16:59:37.072705+0000","last_unstale":"2024-05-30T16:59:37.076430+0000","last_undegraded":"2024-05-30T16:59:37.076430+0000","last_fullsized":"2024-05-30T16:59:37.076430+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:47.601590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.071282+0000","last_change":"2024-05-30T16:59:36.072434+0000","last_active":"2024-05-30T16:59:37.071282+0000","last_peered":"2024-05-30T16:59:37.071282+0000","last_clean":"2024-05-30T16:59:37.071282+0000","last_became_active":"2024-05-30T16:59:36.072080+0000","last_became_peered":"2024-05-30T16:59:36.072080+0000","last_unstale":"2024-05-30T16:59:37.071282+0000","last_undegraded":"2024-05-30T16:59:37.071282+0000","last_fullsized":"2024-05-30T16:59:37.071282+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:08.828492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.091200+0000","last_change":"2024-05-30T16:59:37.084414+0000","last_active":"2024-05-30T16:59:37.091200+0000","last_peered":"2024-05-30T16:59:37.091200+0000","last_clean":"2024-05-30T16:59:37.091200+0000","last_became_active":"2024-05-30T16:59:37.084136+0000","last_became_peered":"2024-05-30T16:59:37.084136+0000","last_unstale":"2024-05-30T16:59:37.091200+0000","last_undegraded":"2024-05-30T16:59:37.091200+0000","last_fullsized":"2024-05-30T16:59:37.091200+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:59:27.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.071319+0000","last_change":"2024-05-30T16:59:36.081362+0000","last_active":"2024-05-30T16:59:37.071319+0000","last_peered":"2024-05-30T16:59:37.071319+0000","last_clean":"2024-05-30T16:59:37.071319+0000","last_became_active":"2024-05-30T16:59:36.081053+0000","last_became_peered":"2024-05-30T16:59:36.081053+0000","last_unstale":"2024-05-30T16:59:37.071319+0000","last_undegraded":"2024-05-30T16:59:37.071319+0000","last_fullsized":"2024-05-30T16:59:37.071319+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:07.006990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084295+0000","last_change":"2024-05-30T16:59:37.082149+0000","last_active":"2024-05-30T16:59:37.084295+0000","last_peered":"2024-05-30T16:59:37.084295+0000","last_clean":"2024-05-30T16:59:37.084295+0000","last_became_active":"2024-05-30T16:59:37.081871+0000","last_became_peered":"2024-05-30T16:59:37.081871+0000","last_unstale":"2024-05-30T16:59:37.084295+0000","last_undegraded":"2024-05-30T16:59:37.084295+0000","last_fullsized":"2024-05-30T16:59:37.084295+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:21:31.814977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.070746+0000","last_change":"2024-05-30T16:59:36.082150+0000","last_active":"2024-05-30T16:59:37.070746+0000","last_peered":"2024-05-30T16:59:37.070746+0000","last_clean":"2024-05-30T16:59:37.070746+0000","last_became_active":"2024-05-30T16:59:36.081808+0000","last_became_peered":"2024-05-30T16:59:36.081808+0000","last_unstale":"2024-05-30T16:59:37.070746+0000","last_undegraded":"2024-05-30T16:59:37.070746+0000","last_fullsized":"2024-05-30T16:59:37.070746+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:10:14.175340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.092890+0000","last_change":"2024-05-30T16:59:37.086355+0000","last_active":"2024-05-30T16:59:37.092890+0000","last_peered":"2024-05-30T16:59:37.092890+0000","last_clean":"2024-05-30T16:59:37.092890+0000","last_became_active":"2024-05-30T16:59:37.085922+0000","last_became_peered":"2024-05-30T16:59:37.085922+0000","last_unstale":"2024-05-30T16:59:37.092890+0000","last_undegraded":"2024-05-30T16:59:37.092890+0000","last_fullsized":"2024-05-30T16:59:37.092890+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:08.010363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.070751+0000","last_change":"2024-05-30T16:59:36.078616+0000","last_active":"2024-05-30T16:59:37.070751+0000","last_peered":"2024-05-30T16:59:37.070751+0000","last_clean":"2024-05-30T16:59:37.070751+0000","last_became_active":"2024-05-30T16:59:36.078225+0000","last_became_peered":"2024-05-30T16:59:36.078225+0000","last_unstale":"2024-05-30T16:59:37.070751+0000","last_undegraded":"2024-05-30T16:59:37.070751+0000","last_fullsized":"2024-05-30T16:59:37.070751+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:05.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.081879+0000","last_change":"2024-05-30T16:59:37.077457+0000","last_active":"2024-05-30T16:59:37.081879+0000","last_peered":"2024-05-30T16:59:37.081879+0000","last_clean":"2024-05-30T16:59:37.081879+0000","last_became_active":"2024-05-30T16:59:37.077159+0000","last_became_peered":"2024-05-30T16:59:37.077159+0000","last_unstale":"2024-05-30T16:59:37.081879+0000","last_undegraded":"2024-05-30T16:59:37.081879+0000","last_fullsized":"2024-05-30T16:59:37.081879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:47.461836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095777+0000","last_change":"2024-05-30T16:59:36.075731+0000","last_active":"2024-05-30T16:59:37.095777+0000","last_peered":"2024-05-30T16:59:37.095777+0000","last_clean":"2024-05-30T16:59:37.095777+0000","last_became_active":"2024-05-30T16:59:36.075265+0000","last_became_peered":"2024-05-30T16:59:36.075265+0000","last_unstale":"2024-05-30T16:59:37.095777+0000","last_undegraded":"2024-05-30T16:59:37.095777+0000","last_fullsized":"2024-05-30T16:59:37.095777+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:53.038839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":299,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.071688+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:59:37.071688+0000","last_peered":"2024-05-30T16:59:37.071688+0000","last_clean":"2024-05-30T16:59:37.071688+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:59:37.071688+0000","last_undegraded":"2024-05-30T16:59:37.071688+0000","last_fullsized":"2024-05-30T16:59:37.071688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509571,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100800,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271040,"statfs":{"total":96636764160,"available":96533544960,"internally_reserved":0,"allocated":1683456,"data_stored":1056337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101513674},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118248,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253592,"statfs":{"total":96636764160,"available":96515678208,"internally_reserved":0,"allocated":1073152,"data_stored":459040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509572,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72424,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299416,"statfs":{"total":96636764160,"available":96562601984,"internally_reserved":0,"allocated":1073152,"data_stored":459040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509573,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76592,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295248,"statfs":{"total":96636764160,"available":96558333952,"internally_reserved":0,"allocated":1085440,"data_stored":465899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509572,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100220,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271620,"statfs":{"total":96636764160,"available":96534138880,"internally_reserved":0,"allocated":1089536,"data_stored":466481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509572,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82152,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94289688,"statfs":{"total":96636764160,"available":96552640512,"internally_reserved":0,"allocated":1073152,"data_stored":459040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509572,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77176,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294664,"statfs":{"total":96636764160,"available":96557735936,"internally_reserved":0,"allocated":1683456,"data_stored":1056301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122400,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249440,"statfs":{"total":96636764160,"available":96511426560,"internally_reserved":0,"allocated":1060864,"data_stored":452681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:59:41.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:59:41.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.764+0000 7f4998800640 1 Processor -- start 2024-05-30T16:59:41.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.764+0000 7f4998800640 1 -- start start 2024-05-30T16:59:41.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4998800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4990159df0 0x7f49900ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:41.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4998800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49900b3e50 0x7f49900ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:41.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4998800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499015d730 con 0x7f499015a1d0 2024-05-30T16:59:41.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4998800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f49900b3370 con 0x7f4990159df0 2024-05-30T16:59:41.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4998800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f49900b3650 con 0x7f49900b3e50 2024-05-30T16:59:41.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4995e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4990159df0 0x7f49900ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:41.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4996800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49900b3e50 0x7f49900ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:41.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4995400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f499015a1d0 0x7f499015ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:40432/0 (socket says 172.21.15.59:40432) 2024-05-30T16:59:41.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4995e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4990159df0 0x7f49900ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:35172/0 (socket says 172.21.15.59:35172) 2024-05-30T16:59:41.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4995400640 1 -- 172.21.15.59:0/1123246721 learned_addr learned my addr 172.21.15.59:0/1123246721 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:41.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4996800640 1 -- 172.21.15.59:0/1123246721 >> v2:172.21.15.107:3300/0 conn(0x7f4990159df0 msgr2=0x7f49900ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:41.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4996800640 1 --2- 172.21.15.59:0/1123246721 >> v2:172.21.15.107:3300/0 conn(0x7f4990159df0 0x7f49900ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4994a00640 1 -- 172.21.15.59:0/1123246721 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899443849 0 0) 0x7f499015d730 con 0x7f499015a1d0 2024-05-30T16:59:41.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4996800640 1 -- 172.21.15.59:0/1123246721 >> v1:172.21.15.107:6789/0 conn(0x7f499015a1d0 legacy=0x7f499015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.768+0000 7f4996800640 1 -- 172.21.15.59:0/1123246721 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49900b3930 con 0x7f49900b3e50 2024-05-30T16:59:41.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4996800640 1 --2- 172.21.15.59:0/1123246721 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49900b3e50 0x7f49900ad6f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f498c009d90 tx=0x7f498c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77964f097be67828 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:41.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4994a00640 1 -- 172.21.15.59:0/1123246721 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c0b2070 con 0x7f49900b3e50 2024-05-30T16:59:41.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4994a00640 1 -- 172.21.15.59:0/1123246721 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f498c0a5840 con 0x7f49900b3e50 2024-05-30T16:59:41.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4994a00640 1 -- 172.21.15.59:0/1123246721 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c0a5c10 con 0x7f49900b3e50 2024-05-30T16:59:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4998800640 1 -- 172.21.15.59:0/1123246721 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49900b3e50 msgr2=0x7f49900ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4998800640 1 --2- 172.21.15.59:0/1123246721 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49900b3e50 0x7f49900ad6f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f498c009d90 tx=0x7f498c01c970 comp rx=0 tx=0).stop 2024-05-30T16:59:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4998800640 1 -- 172.21.15.59:0/1123246721 shutdown_connections 2024-05-30T16:59:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4998800640 1 --2- 172.21.15.59:0/1123246721 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49900b3e50 0x7f49900ad6f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4998800640 1 --2- 172.21.15.59:0/1123246721 >> v2:172.21.15.107:3300/0 conn(0x7f4990159df0 0x7f49900ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4998800640 1 -- 172.21.15.59:0/1123246721 >> 172.21.15.59:0/1123246721 conn(0x7f49900b22d0 msgr2=0x7f49900b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4998800640 1 -- 172.21.15.59:0/1123246721 shutdown_connections 2024-05-30T16:59:41.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4998800640 1 -- 172.21.15.59:0/1123246721 wait complete. 2024-05-30T16:59:41.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4998800640 1 Processor -- start 2024-05-30T16:59:41.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.772+0000 7f4998800640 1 -- start start 2024-05-30T16:59:41.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4998800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49900b3e50 0x7f499014e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4998800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4990159df0 0x7f499014d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4998800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f499015a1d0 0x7f4990153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4998800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f499015e720 con 0x7f4990159df0 2024-05-30T16:59:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4998800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f499015e5a0 con 0x7f499015a1d0 2024-05-30T16:59:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4998800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f499015e8a0 con 0x7f49900b3e50 2024-05-30T16:59:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4995400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4990159df0 0x7f499014d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4995400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4990159df0 0x7f499014d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38006/0 (socket says 172.21.15.59:38006) 2024-05-30T16:59:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4995400640 1 -- 172.21.15.59:0/2559026908 learned_addr learned my addr 172.21.15.59:0/2559026908 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4995e00640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49900b3e50 0x7f499014e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4996800640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f499015a1d0 0x7f4990153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4995400640 1 -- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49900b3e50 msgr2=0x7f499014e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4995400640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49900b3e50 0x7f499014e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4995400640 1 -- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f499015a1d0 msgr2=0x7f4990153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4995400640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f499015a1d0 0x7f4990153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4995400640 1 -- 172.21.15.59:0/2559026908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4990152df0 con 0x7f4990159df0 2024-05-30T16:59:41.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4995400640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4990159df0 0x7f499014d8c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f498000c450 tx=0x7f498000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:41.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f498a000640 1 -- 172.21.15.59:0/2559026908 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980018070 con 0x7f4990159df0 2024-05-30T16:59:41.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f498a000640 1 -- 172.21.15.59:0/2559026908 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49800074e0 con 0x7f4990159df0 2024-05-30T16:59:41.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f498a000640 1 -- 172.21.15.59:0/2559026908 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49800049f0 con 0x7f4990159df0 2024-05-30T16:59:41.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4998800640 1 -- 172.21.15.59:0/2559026908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49901530d0 con 0x7f4990159df0 2024-05-30T16:59:41.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4998800640 1 -- 172.21.15.59:0/2559026908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4990153690 con 0x7f4990159df0 2024-05-30T16:59:41.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.776+0000 7f4998800640 1 -- 172.21.15.59:0/2559026908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4990068a90 con 0x7f4990159df0 2024-05-30T16:59:41.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.780+0000 7f498a000640 1 -- 172.21.15.59:0/2559026908 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f498001b070 con 0x7f4990159df0 2024-05-30T16:59:41.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.780+0000 7f498a000640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49740694f0 0x7f497406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.780+0000 7f498a000640 1 -- 172.21.15.59:0/2559026908 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5793+0+0 (secure 0 0 0) 0x7f4980084b60 con 0x7f4990159df0 2024-05-30T16:59:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.780+0000 7f4995e00640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49740694f0 0x7f497406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.780+0000 7f4995e00640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49740694f0 0x7f497406b9b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4990073ed0 tx=0x7f4984009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:41.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.784+0000 7f498a000640 1 -- 172.21.15.59:0/2559026908 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f49800561d0 con 0x7f4990159df0 2024-05-30T16:59:41.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.944+0000 7f4998800640 1 -- 172.21.15.59:0/2559026908 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49901592d0 con 0x7f49740694f0 2024-05-30T16:59:41.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.952+0000 7f498a000640 1 -- 172.21.15.59:0/2559026908 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251774 (secure 0 0 0) 0x7f49901592d0 con 0x7f49740694f0 2024-05-30T16:59:41.955 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:41.957 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:59:41.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.956+0000 7f4998800640 1 -- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49740694f0 msgr2=0x7f497406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.956+0000 7f4998800640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49740694f0 0x7f497406b9b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4990073ed0 tx=0x7f4984009190 comp rx=0 tx=0).stop 2024-05-30T16:59:41.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.956+0000 7f4998800640 1 -- 172.21.15.59:0/2559026908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4990159df0 msgr2=0x7f499014d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:41.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.956+0000 7f4998800640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4990159df0 0x7f499014d8c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f498000c450 tx=0x7f498000c910 comp rx=0 tx=0).stop 2024-05-30T16:59:41.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.956+0000 7f4998800640 1 -- 172.21.15.59:0/2559026908 shutdown_connections 2024-05-30T16:59:41.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.956+0000 7f4998800640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49740694f0 0x7f497406b9b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.956+0000 7f4998800640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f499015a1d0 0x7f4990153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.956+0000 7f4998800640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4990159df0 0x7f499014d8c0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.956+0000 7f4998800640 1 --2- 172.21.15.59:0/2559026908 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49900b3e50 0x7f499014e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:41.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.956+0000 7f4998800640 1 -- 172.21.15.59:0/2559026908 >> 172.21.15.59:0/2559026908 conn(0x7f49900b22d0 msgr2=0x7f49900aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:41.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.956+0000 7f4998800640 1 -- 172.21.15.59:0/2559026908 shutdown_connections 2024-05-30T16:59:41.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:41.956+0000 7f4998800640 1 -- 172.21.15.59:0/2559026908 wait complete. 2024-05-30T16:59:41.976 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2024-05-30T16:59:41.307578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":750012,"kb_used_data":9592,"kb_used_omap":12,"kb_used_meta":740275,"kb_avail":754224708,"statfs":{"total":773094113280,"available":772326100992,"internally_reserved":0,"allocated":9822208,"data_stored":4874819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":758042160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001390"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097792+0000","last_change":"2024-05-30T16:59:37.093203+0000","last_active":"2024-05-30T16:59:37.097792+0000","last_peered":"2024-05-30T16:59:37.097792+0000","last_clean":"2024-05-30T16:59:37.097792+0000","last_became_active":"2024-05-30T16:59:37.092105+0000","last_became_peered":"2024-05-30T16:59:37.092105+0000","last_unstale":"2024-05-30T16:59:37.097792+0000","last_undegraded":"2024-05-30T16:59:37.097792+0000","last_fullsized":"2024-05-30T16:59:37.097792+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:49.431377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097664+0000","last_change":"2024-05-30T16:59:37.093116+0000","last_active":"2024-05-30T16:59:37.097664+0000","last_peered":"2024-05-30T16:59:37.097664+0000","last_clean":"2024-05-30T16:59:37.097664+0000","last_became_active":"2024-05-30T16:59:37.092861+0000","last_became_peered":"2024-05-30T16:59:37.092861+0000","last_unstale":"2024-05-30T16:59:37.097664+0000","last_undegraded":"2024-05-30T16:59:37.097664+0000","last_fullsized":"2024-05-30T16:59:37.097664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:00:31.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096113+0000","last_change":"2024-05-30T16:59:37.092582+0000","last_active":"2024-05-30T16:59:37.096113+0000","last_peered":"2024-05-30T16:59:37.096113+0000","last_clean":"2024-05-30T16:59:37.096113+0000","last_became_active":"2024-05-30T16:59:37.092334+0000","last_became_peered":"2024-05-30T16:59:37.092334+0000","last_unstale":"2024-05-30T16:59:37.096113+0000","last_undegraded":"2024-05-30T16:59:37.096113+0000","last_fullsized":"2024-05-30T16:59:37.096113+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:03:20.704600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.085330+0000","last_change":"2024-05-30T16:59:37.082085+0000","last_active":"2024-05-30T16:59:37.085330+0000","last_peered":"2024-05-30T16:59:37.085330+0000","last_clean":"2024-05-30T16:59:37.085330+0000","last_became_active":"2024-05-30T16:59:37.081821+0000","last_became_peered":"2024-05-30T16:59:37.081821+0000","last_unstale":"2024-05-30T16:59:37.085330+0000","last_undegraded":"2024-05-30T16:59:37.085330+0000","last_fullsized":"2024-05-30T16:59:37.085330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:34.423495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088413+0000","last_change":"2024-05-30T16:59:37.085960+0000","last_active":"2024-05-30T16:59:37.088413+0000","last_peered":"2024-05-30T16:59:37.088413+0000","last_clean":"2024-05-30T16:59:37.088413+0000","last_became_active":"2024-05-30T16:59:37.085666+0000","last_became_peered":"2024-05-30T16:59:37.085666+0000","last_unstale":"2024-05-30T16:59:37.088413+0000","last_undegraded":"2024-05-30T16:59:37.088413+0000","last_fullsized":"2024-05-30T16:59:37.088413+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:49.431377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.074647+0000","last_change":"2024-05-30T16:59:37.072380+0000","last_active":"2024-05-30T16:59:37.074647+0000","last_peered":"2024-05-30T16:59:37.074647+0000","last_clean":"2024-05-30T16:59:37.074647+0000","last_became_active":"2024-05-30T16:59:37.072034+0000","last_became_peered":"2024-05-30T16:59:37.072034+0000","last_unstale":"2024-05-30T16:59:37.074647+0000","last_undegraded":"2024-05-30T16:59:37.074647+0000","last_fullsized":"2024-05-30T16:59:37.074647+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:49.431377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.077765+0000","last_change":"2024-05-30T16:59:37.076182+0000","last_active":"2024-05-30T16:59:37.077765+0000","last_peered":"2024-05-30T16:59:37.077765+0000","last_clean":"2024-05-30T16:59:37.077765+0000","last_became_active":"2024-05-30T16:59:37.075914+0000","last_became_peered":"2024-05-30T16:59:37.075914+0000","last_unstale":"2024-05-30T16:59:37.077765+0000","last_undegraded":"2024-05-30T16:59:37.077765+0000","last_fullsized":"2024-05-30T16:59:37.077765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:28.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.085938+0000","last_change":"2024-05-30T16:59:37.078450+0000","last_active":"2024-05-30T16:59:37.085938+0000","last_peered":"2024-05-30T16:59:37.085938+0000","last_clean":"2024-05-30T16:59:37.085938+0000","last_became_active":"2024-05-30T16:59:37.078165+0000","last_became_peered":"2024-05-30T16:59:37.078165+0000","last_unstale":"2024-05-30T16:59:37.085938+0000","last_undegraded":"2024-05-30T16:59:37.085938+0000","last_fullsized":"2024-05-30T16:59:37.085938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:09.831864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.092466+0000","last_change":"2024-05-30T16:59:37.082510+0000","last_active":"2024-05-30T16:59:37.092466+0000","last_peered":"2024-05-30T16:59:37.092466+0000","last_clean":"2024-05-30T16:59:37.092466+0000","last_became_active":"2024-05-30T16:59:37.082213+0000","last_became_peered":"2024-05-30T16:59:37.082213+0000","last_unstale":"2024-05-30T16:59:37.092466+0000","last_undegraded":"2024-05-30T16:59:37.092466+0000","last_fullsized":"2024-05-30T16:59:37.092466+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:38.192437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094915+0000","last_change":"2024-05-30T16:59:37.091906+0000","last_active":"2024-05-30T16:59:37.094915+0000","last_peered":"2024-05-30T16:59:37.094915+0000","last_clean":"2024-05-30T16:59:37.094915+0000","last_became_active":"2024-05-30T16:59:37.091488+0000","last_became_peered":"2024-05-30T16:59:37.091488+0000","last_unstale":"2024-05-30T16:59:37.094915+0000","last_undegraded":"2024-05-30T16:59:37.094915+0000","last_fullsized":"2024-05-30T16:59:37.094915+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:14:10.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093509+0000","last_change":"2024-05-30T16:59:37.081319+0000","last_active":"2024-05-30T16:59:37.093509+0000","last_peered":"2024-05-30T16:59:37.093509+0000","last_clean":"2024-05-30T16:59:37.093509+0000","last_became_active":"2024-05-30T16:59:37.078930+0000","last_became_peered":"2024-05-30T16:59:37.078930+0000","last_unstale":"2024-05-30T16:59:37.093509+0000","last_undegraded":"2024-05-30T16:59:37.093509+0000","last_fullsized":"2024-05-30T16:59:37.093509+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:31.036487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094961+0000","last_change":"2024-05-30T16:59:37.091682+0000","last_active":"2024-05-30T16:59:37.094961+0000","last_peered":"2024-05-30T16:59:37.094961+0000","last_clean":"2024-05-30T16:59:37.094961+0000","last_became_active":"2024-05-30T16:59:37.091372+0000","last_became_peered":"2024-05-30T16:59:37.091372+0000","last_unstale":"2024-05-30T16:59:37.094961+0000","last_undegraded":"2024-05-30T16:59:37.094961+0000","last_fullsized":"2024-05-30T16:59:37.094961+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:18.838783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.082590+0000","last_change":"2024-05-30T16:59:37.080801+0000","last_active":"2024-05-30T16:59:37.082590+0000","last_peered":"2024-05-30T16:59:37.082590+0000","last_clean":"2024-05-30T16:59:37.082590+0000","last_became_active":"2024-05-30T16:59:37.080526+0000","last_became_peered":"2024-05-30T16:59:37.080526+0000","last_unstale":"2024-05-30T16:59:37.082590+0000","last_undegraded":"2024-05-30T16:59:37.082590+0000","last_fullsized":"2024-05-30T16:59:37.082590+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:52:53.010477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.090436+0000","last_change":"2024-05-30T16:59:37.087845+0000","last_active":"2024-05-30T16:59:37.090436+0000","last_peered":"2024-05-30T16:59:37.090436+0000","last_clean":"2024-05-30T16:59:37.090436+0000","last_became_active":"2024-05-30T16:59:37.085959+0000","last_became_peered":"2024-05-30T16:59:37.085959+0000","last_unstale":"2024-05-30T16:59:37.090436+0000","last_undegraded":"2024-05-30T16:59:37.090436+0000","last_fullsized":"2024-05-30T16:59:37.090436+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:31.036487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2024-05-30T16:59:36.074732+0000","last_change":"2024-05-30T16:59:36.074732+0000","last_active":"2024-05-30T16:59:36.046240+0000","last_peered":"2024-05-30T16:59:36.046240+0000","last_clean":"2024-05-30T16:59:36.046240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:59:36.074732+0000","last_undegraded":"2024-05-30T16:59:36.074732+0000","last_fullsized":"2024-05-30T16:59:36.074732+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.090844+0000","last_change":"2024-05-30T16:59:37.090158+0000","last_active":"2024-05-30T16:59:37.090844+0000","last_peered":"2024-05-30T16:59:37.090844+0000","last_clean":"2024-05-30T16:59:37.090844+0000","last_became_active":"2024-05-30T16:59:37.089875+0000","last_became_peered":"2024-05-30T16:59:37.089875+0000","last_unstale":"2024-05-30T16:59:37.090844+0000","last_undegraded":"2024-05-30T16:59:37.090844+0000","last_fullsized":"2024-05-30T16:59:37.090844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:09.831864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088754+0000","last_change":"2024-05-30T16:59:37.084968+0000","last_active":"2024-05-30T16:59:37.088754+0000","last_peered":"2024-05-30T16:59:37.088754+0000","last_clean":"2024-05-30T16:59:37.088754+0000","last_became_active":"2024-05-30T16:59:37.084679+0000","last_became_peered":"2024-05-30T16:59:37.084679+0000","last_unstale":"2024-05-30T16:59:37.088754+0000","last_undegraded":"2024-05-30T16:59:37.088754+0000","last_fullsized":"2024-05-30T16:59:37.088754+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:18.838783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094819+0000","last_change":"2024-05-30T16:59:37.092473+0000","last_active":"2024-05-30T16:59:37.094819+0000","last_peered":"2024-05-30T16:59:37.094819+0000","last_clean":"2024-05-30T16:59:37.094819+0000","last_became_active":"2024-05-30T16:59:37.092195+0000","last_became_peered":"2024-05-30T16:59:37.092195+0000","last_unstale":"2024-05-30T16:59:37.094819+0000","last_undegraded":"2024-05-30T16:59:37.094819+0000","last_fullsized":"2024-05-30T16:59:37.094819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:26.963969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.090323+0000","last_change":"2024-05-30T16:59:37.086366+0000","last_active":"2024-05-30T16:59:37.090323+0000","last_peered":"2024-05-30T16:59:37.090323+0000","last_clean":"2024-05-30T16:59:37.090323+0000","last_became_active":"2024-05-30T16:59:37.086008+0000","last_became_peered":"2024-05-30T16:59:37.086008+0000","last_unstale":"2024-05-30T16:59:37.090323+0000","last_undegraded":"2024-05-30T16:59:37.090323+0000","last_fullsized":"2024-05-30T16:59:37.090323+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:01.271116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094640+0000","last_change":"2024-05-30T16:59:37.091075+0000","last_active":"2024-05-30T16:59:37.094640+0000","last_peered":"2024-05-30T16:59:37.094640+0000","last_clean":"2024-05-30T16:59:37.094640+0000","last_became_active":"2024-05-30T16:59:37.090740+0000","last_became_peered":"2024-05-30T16:59:37.090740+0000","last_unstale":"2024-05-30T16:59:37.094640+0000","last_undegraded":"2024-05-30T16:59:37.094640+0000","last_fullsized":"2024-05-30T16:59:37.094640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:12.422505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.083675+0000","last_change":"2024-05-30T16:59:37.081310+0000","last_active":"2024-05-30T16:59:37.083675+0000","last_peered":"2024-05-30T16:59:37.083675+0000","last_clean":"2024-05-30T16:59:37.083675+0000","last_became_active":"2024-05-30T16:59:37.081051+0000","last_became_peered":"2024-05-30T16:59:37.081051+0000","last_unstale":"2024-05-30T16:59:37.083675+0000","last_undegraded":"2024-05-30T16:59:37.083675+0000","last_fullsized":"2024-05-30T16:59:37.083675+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:47.461836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097459+0000","last_change":"2024-05-30T16:59:37.092092+0000","last_active":"2024-05-30T16:59:37.097459+0000","last_peered":"2024-05-30T16:59:37.097459+0000","last_clean":"2024-05-30T16:59:37.097459+0000","last_became_active":"2024-05-30T16:59:37.089929+0000","last_became_peered":"2024-05-30T16:59:37.089929+0000","last_unstale":"2024-05-30T16:59:37.097459+0000","last_undegraded":"2024-05-30T16:59:37.097459+0000","last_fullsized":"2024-05-30T16:59:37.097459+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:00:47.652785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093649+0000","last_change":"2024-05-30T16:59:37.089008+0000","last_active":"2024-05-30T16:59:37.093649+0000","last_peered":"2024-05-30T16:59:37.093649+0000","last_clean":"2024-05-30T16:59:37.093649+0000","last_became_active":"2024-05-30T16:59:37.088577+0000","last_became_peered":"2024-05-30T16:59:37.088577+0000","last_unstale":"2024-05-30T16:59:37.093649+0000","last_undegraded":"2024-05-30T16:59:37.093649+0000","last_fullsized":"2024-05-30T16:59:37.093649+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:55.662497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084673+0000","last_change":"2024-05-30T16:59:37.077530+0000","last_active":"2024-05-30T16:59:37.084673+0000","last_peered":"2024-05-30T16:59:37.084673+0000","last_clean":"2024-05-30T16:59:37.084673+0000","last_became_active":"2024-05-30T16:59:37.077272+0000","last_became_peered":"2024-05-30T16:59:37.077272+0000","last_unstale":"2024-05-30T16:59:37.084673+0000","last_undegraded":"2024-05-30T16:59:37.084673+0000","last_fullsized":"2024-05-30T16:59:37.084673+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:46:59.562379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097260+0000","last_change":"2024-05-30T16:59:37.092872+0000","last_active":"2024-05-30T16:59:37.097260+0000","last_peered":"2024-05-30T16:59:37.097260+0000","last_clean":"2024-05-30T16:59:37.097260+0000","last_became_active":"2024-05-30T16:59:37.092602+0000","last_became_peered":"2024-05-30T16:59:37.092602+0000","last_unstale":"2024-05-30T16:59:37.097260+0000","last_undegraded":"2024-05-30T16:59:37.097260+0000","last_fullsized":"2024-05-30T16:59:37.097260+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:55:23.698395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.083155+0000","last_change":"2024-05-30T16:59:37.082108+0000","last_active":"2024-05-30T16:59:37.083155+0000","last_peered":"2024-05-30T16:59:37.083155+0000","last_clean":"2024-05-30T16:59:37.083155+0000","last_became_active":"2024-05-30T16:59:37.081786+0000","last_became_peered":"2024-05-30T16:59:37.081786+0000","last_unstale":"2024-05-30T16:59:37.083155+0000","last_undegraded":"2024-05-30T16:59:37.083155+0000","last_fullsized":"2024-05-30T16:59:37.083155+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:31:42.026333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.076454+0000","last_change":"2024-05-30T16:59:37.074108+0000","last_active":"2024-05-30T16:59:37.076454+0000","last_peered":"2024-05-30T16:59:37.076454+0000","last_clean":"2024-05-30T16:59:37.076454+0000","last_became_active":"2024-05-30T16:59:37.073685+0000","last_became_peered":"2024-05-30T16:59:37.073685+0000","last_unstale":"2024-05-30T16:59:37.076454+0000","last_undegraded":"2024-05-30T16:59:37.076454+0000","last_fullsized":"2024-05-30T16:59:37.076454+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094944+0000","last_change":"2024-05-30T16:59:37.091611+0000","last_active":"2024-05-30T16:59:37.094944+0000","last_peered":"2024-05-30T16:59:37.094944+0000","last_clean":"2024-05-30T16:59:37.094944+0000","last_became_active":"2024-05-30T16:59:37.091300+0000","last_became_peered":"2024-05-30T16:59:37.091300+0000","last_unstale":"2024-05-30T16:59:37.094944+0000","last_undegraded":"2024-05-30T16:59:37.094944+0000","last_fullsized":"2024-05-30T16:59:37.094944+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:28.347373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.083386+0000","last_change":"2024-05-30T16:59:37.074729+0000","last_active":"2024-05-30T16:59:37.083386+0000","last_peered":"2024-05-30T16:59:37.083386+0000","last_clean":"2024-05-30T16:59:37.083386+0000","last_became_active":"2024-05-30T16:59:37.074457+0000","last_became_peered":"2024-05-30T16:59:37.074457+0000","last_unstale":"2024-05-30T16:59:37.083386+0000","last_undegraded":"2024-05-30T16:59:37.083386+0000","last_fullsized":"2024-05-30T16:59:37.083386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:46:59.562379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097150+0000","last_change":"2024-05-30T16:59:37.090233+0000","last_active":"2024-05-30T16:59:37.097150+0000","last_peered":"2024-05-30T16:59:37.097150+0000","last_clean":"2024-05-30T16:59:37.097150+0000","last_became_active":"2024-05-30T16:59:37.088987+0000","last_became_peered":"2024-05-30T16:59:37.088987+0000","last_unstale":"2024-05-30T16:59:37.097150+0000","last_undegraded":"2024-05-30T16:59:37.097150+0000","last_fullsized":"2024-05-30T16:59:37.097150+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:37.960162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084344+0000","last_change":"2024-05-30T16:59:37.077683+0000","last_active":"2024-05-30T16:59:37.084344+0000","last_peered":"2024-05-30T16:59:37.084344+0000","last_clean":"2024-05-30T16:59:37.084344+0000","last_became_active":"2024-05-30T16:59:37.077380+0000","last_became_peered":"2024-05-30T16:59:37.077380+0000","last_unstale":"2024-05-30T16:59:37.084344+0000","last_undegraded":"2024-05-30T16:59:37.084344+0000","last_fullsized":"2024-05-30T16:59:37.084344+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:55.662497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093602+0000","last_change":"2024-05-30T16:59:37.088784+0000","last_active":"2024-05-30T16:59:37.093602+0000","last_peered":"2024-05-30T16:59:37.093602+0000","last_clean":"2024-05-30T16:59:37.093602+0000","last_became_active":"2024-05-30T16:59:37.088500+0000","last_became_peered":"2024-05-30T16:59:37.088500+0000","last_unstale":"2024-05-30T16:59:37.093602+0000","last_undegraded":"2024-05-30T16:59:37.093602+0000","last_fullsized":"2024-05-30T16:59:37.093602+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093833+0000","last_change":"2024-05-30T16:59:37.092667+0000","last_active":"2024-05-30T16:59:37.093833+0000","last_peered":"2024-05-30T16:59:37.093833+0000","last_clean":"2024-05-30T16:59:37.093833+0000","last_became_active":"2024-05-30T16:59:37.092305+0000","last_became_peered":"2024-05-30T16:59:37.092305+0000","last_unstale":"2024-05-30T16:59:37.093833+0000","last_undegraded":"2024-05-30T16:59:37.093833+0000","last_fullsized":"2024-05-30T16:59:37.093833+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:38.192437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"89'4","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097944+0000","last_change":"2024-05-30T16:59:36.079591+0000","last_active":"2024-05-30T16:59:37.097944+0000","last_peered":"2024-05-30T16:59:37.097944+0000","last_clean":"2024-05-30T16:59:37.097944+0000","last_became_active":"2024-05-30T16:59:36.079273+0000","last_became_peered":"2024-05-30T16:59:36.079273+0000","last_unstale":"2024-05-30T16:59:37.097944+0000","last_undegraded":"2024-05-30T16:59:37.097944+0000","last_fullsized":"2024-05-30T16:59:37.097944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:07.078092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.098140+0000","last_change":"2024-05-30T16:59:37.097479+0000","last_active":"2024-05-30T16:59:37.098140+0000","last_peered":"2024-05-30T16:59:37.098140+0000","last_clean":"2024-05-30T16:59:37.098140+0000","last_became_active":"2024-05-30T16:59:37.096852+0000","last_became_peered":"2024-05-30T16:59:37.096852+0000","last_unstale":"2024-05-30T16:59:37.098140+0000","last_undegraded":"2024-05-30T16:59:37.098140+0000","last_fullsized":"2024-05-30T16:59:37.098140+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:47.601590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094316+0000","last_change":"2024-05-30T16:59:36.081492+0000","last_active":"2024-05-30T16:59:37.094316+0000","last_peered":"2024-05-30T16:59:37.094316+0000","last_clean":"2024-05-30T16:59:37.094316+0000","last_became_active":"2024-05-30T16:59:36.081071+0000","last_became_peered":"2024-05-30T16:59:36.081071+0000","last_unstale":"2024-05-30T16:59:37.094316+0000","last_undegraded":"2024-05-30T16:59:37.094316+0000","last_fullsized":"2024-05-30T16:59:37.094316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:32.389864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.098693+0000","last_change":"2024-05-30T16:59:37.098058+0000","last_active":"2024-05-30T16:59:37.098693+0000","last_peered":"2024-05-30T16:59:37.098693+0000","last_clean":"2024-05-30T16:59:37.098693+0000","last_became_active":"2024-05-30T16:59:37.097708+0000","last_became_peered":"2024-05-30T16:59:37.097708+0000","last_unstale":"2024-05-30T16:59:37.098693+0000","last_undegraded":"2024-05-30T16:59:37.098693+0000","last_fullsized":"2024-05-30T16:59:37.098693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:57.044016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.091618+0000","last_change":"2024-05-30T16:59:36.084335+0000","last_active":"2024-05-30T16:59:37.091618+0000","last_peered":"2024-05-30T16:59:37.091618+0000","last_clean":"2024-05-30T16:59:37.091618+0000","last_became_active":"2024-05-30T16:59:36.083933+0000","last_became_peered":"2024-05-30T16:59:36.083933+0000","last_unstale":"2024-05-30T16:59:37.091618+0000","last_undegraded":"2024-05-30T16:59:37.091618+0000","last_fullsized":"2024-05-30T16:59:37.091618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:27:43.028647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.087183+0000","last_change":"2024-05-30T16:59:37.084018+0000","last_active":"2024-05-30T16:59:37.087183+0000","last_peered":"2024-05-30T16:59:37.087183+0000","last_clean":"2024-05-30T16:59:37.087183+0000","last_became_active":"2024-05-30T16:59:37.083711+0000","last_became_peered":"2024-05-30T16:59:37.083711+0000","last_unstale":"2024-05-30T16:59:37.087183+0000","last_undegraded":"2024-05-30T16:59:37.087183+0000","last_fullsized":"2024-05-30T16:59:37.087183+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:48.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095023+0000","last_change":"2024-05-30T16:59:36.081241+0000","last_active":"2024-05-30T16:59:37.095023+0000","last_peered":"2024-05-30T16:59:37.095023+0000","last_clean":"2024-05-30T16:59:37.095023+0000","last_became_active":"2024-05-30T16:59:36.080949+0000","last_became_peered":"2024-05-30T16:59:36.080949+0000","last_unstale":"2024-05-30T16:59:37.095023+0000","last_undegraded":"2024-05-30T16:59:37.095023+0000","last_fullsized":"2024-05-30T16:59:37.095023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:37.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093990+0000","last_change":"2024-05-30T16:59:37.085898+0000","last_active":"2024-05-30T16:59:37.093990+0000","last_peered":"2024-05-30T16:59:37.093990+0000","last_clean":"2024-05-30T16:59:37.093990+0000","last_became_active":"2024-05-30T16:59:37.081928+0000","last_became_peered":"2024-05-30T16:59:37.081928+0000","last_unstale":"2024-05-30T16:59:37.093990+0000","last_undegraded":"2024-05-30T16:59:37.093990+0000","last_fullsized":"2024-05-30T16:59:37.093990+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:08:05.904777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095229+0000","last_change":"2024-05-30T16:59:36.086610+0000","last_active":"2024-05-30T16:59:37.095229+0000","last_peered":"2024-05-30T16:59:37.095229+0000","last_clean":"2024-05-30T16:59:37.095229+0000","last_became_active":"2024-05-30T16:59:36.086428+0000","last_became_peered":"2024-05-30T16:59:36.086428+0000","last_unstale":"2024-05-30T16:59:37.095229+0000","last_undegraded":"2024-05-30T16:59:37.095229+0000","last_fullsized":"2024-05-30T16:59:37.095229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:36:36.936609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089285+0000","last_change":"2024-05-30T16:59:37.086396+0000","last_active":"2024-05-30T16:59:37.089285+0000","last_peered":"2024-05-30T16:59:37.089285+0000","last_clean":"2024-05-30T16:59:37.089285+0000","last_became_active":"2024-05-30T16:59:37.086095+0000","last_became_peered":"2024-05-30T16:59:37.086095+0000","last_unstale":"2024-05-30T16:59:37.089285+0000","last_undegraded":"2024-05-30T16:59:37.089285+0000","last_fullsized":"2024-05-30T16:59:37.089285+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:33.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094358+0000","last_change":"2024-05-30T16:59:36.082645+0000","last_active":"2024-05-30T16:59:37.094358+0000","last_peered":"2024-05-30T16:59:37.094358+0000","last_clean":"2024-05-30T16:59:37.094358+0000","last_became_active":"2024-05-30T16:59:36.082380+0000","last_became_peered":"2024-05-30T16:59:36.082380+0000","last_unstale":"2024-05-30T16:59:37.094358+0000","last_undegraded":"2024-05-30T16:59:37.094358+0000","last_fullsized":"2024-05-30T16:59:37.094358+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:09.218872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094539+0000","last_change":"2024-05-30T16:59:37.092211+0000","last_active":"2024-05-30T16:59:37.094539+0000","last_peered":"2024-05-30T16:59:37.094539+0000","last_clean":"2024-05-30T16:59:37.094539+0000","last_became_active":"2024-05-30T16:59:37.091725+0000","last_became_peered":"2024-05-30T16:59:37.091725+0000","last_unstale":"2024-05-30T16:59:37.094539+0000","last_undegraded":"2024-05-30T16:59:37.094539+0000","last_fullsized":"2024-05-30T16:59:37.094539+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:04.577990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.070984+0000","last_change":"2024-05-30T16:59:36.072167+0000","last_active":"2024-05-30T16:59:37.070984+0000","last_peered":"2024-05-30T16:59:37.070984+0000","last_clean":"2024-05-30T16:59:37.070984+0000","last_became_active":"2024-05-30T16:59:36.071855+0000","last_became_peered":"2024-05-30T16:59:36.071855+0000","last_unstale":"2024-05-30T16:59:37.070984+0000","last_undegraded":"2024-05-30T16:59:37.070984+0000","last_fullsized":"2024-05-30T16:59:37.070984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:56.040644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2024-05-30T16:59:36.073664+0000","last_change":"2024-05-30T16:59:36.073664+0000","last_active":"2024-05-30T16:59:36.046240+0000","last_peered":"2024-05-30T16:59:36.046240+0000","last_clean":"2024-05-30T16:59:36.046240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:59:36.073664+0000","last_undegraded":"2024-05-30T16:59:36.073664+0000","last_fullsized":"2024-05-30T16:59:36.073664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.079726+0000","last_change":"2024-05-30T16:59:36.075847+0000","last_active":"2024-05-30T16:59:37.079726+0000","last_peered":"2024-05-30T16:59:37.079726+0000","last_clean":"2024-05-30T16:59:37.079726+0000","last_became_active":"2024-05-30T16:59:36.075436+0000","last_became_peered":"2024-05-30T16:59:36.075436+0000","last_unstale":"2024-05-30T16:59:37.079726+0000","last_undegraded":"2024-05-30T16:59:37.079726+0000","last_fullsized":"2024-05-30T16:59:37.079726+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:33.420123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2024-05-30T16:59:36.067175+0000","last_change":"2024-05-30T16:59:36.067175+0000","last_active":"2024-05-30T16:59:36.046240+0000","last_peered":"2024-05-30T16:59:36.046240+0000","last_clean":"2024-05-30T16:59:36.046240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:59:36.067175+0000","last_undegraded":"2024-05-30T16:59:36.067175+0000","last_fullsized":"2024-05-30T16:59:36.067175+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.075354+0000","last_change":"2024-05-30T16:59:36.084230+0000","last_active":"2024-05-30T16:59:37.075354+0000","last_peered":"2024-05-30T16:59:37.075354+0000","last_clean":"2024-05-30T16:59:37.075354+0000","last_became_active":"2024-05-30T16:59:36.083951+0000","last_became_peered":"2024-05-30T16:59:36.083951+0000","last_unstale":"2024-05-30T16:59:37.075354+0000","last_undegraded":"2024-05-30T16:59:37.075354+0000","last_fullsized":"2024-05-30T16:59:37.075354+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:05.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.074719+0000","last_change":"2024-05-30T16:59:37.072293+0000","last_active":"2024-05-30T16:59:37.074719+0000","last_peered":"2024-05-30T16:59:37.074719+0000","last_clean":"2024-05-30T16:59:37.074719+0000","last_became_active":"2024-05-30T16:59:37.068848+0000","last_became_peered":"2024-05-30T16:59:37.068848+0000","last_unstale":"2024-05-30T16:59:37.074719+0000","last_undegraded":"2024-05-30T16:59:37.074719+0000","last_fullsized":"2024-05-30T16:59:37.074719+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:14:10.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.081030+0000","last_change":"2024-05-30T16:59:36.076816+0000","last_active":"2024-05-30T16:59:37.081030+0000","last_peered":"2024-05-30T16:59:37.081030+0000","last_clean":"2024-05-30T16:59:37.081030+0000","last_became_active":"2024-05-30T16:59:36.076449+0000","last_became_peered":"2024-05-30T16:59:36.076449+0000","last_unstale":"2024-05-30T16:59:37.081030+0000","last_undegraded":"2024-05-30T16:59:37.081030+0000","last_fullsized":"2024-05-30T16:59:37.081030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:36:36.936609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096917+0000","last_change":"2024-05-30T16:59:37.094548+0000","last_active":"2024-05-30T16:59:37.096917+0000","last_peered":"2024-05-30T16:59:37.096917+0000","last_clean":"2024-05-30T16:59:37.096917+0000","last_became_active":"2024-05-30T16:59:37.094267+0000","last_became_peered":"2024-05-30T16:59:37.094267+0000","last_unstale":"2024-05-30T16:59:37.096917+0000","last_undegraded":"2024-05-30T16:59:37.096917+0000","last_fullsized":"2024-05-30T16:59:37.096917+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:54.042211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"89'3","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.099318+0000","last_change":"2024-05-30T16:59:36.083663+0000","last_active":"2024-05-30T16:59:37.099318+0000","last_peered":"2024-05-30T16:59:37.099318+0000","last_clean":"2024-05-30T16:59:37.099318+0000","last_became_active":"2024-05-30T16:59:36.083370+0000","last_became_peered":"2024-05-30T16:59:36.083370+0000","last_unstale":"2024-05-30T16:59:37.099318+0000","last_undegraded":"2024-05-30T16:59:37.099318+0000","last_fullsized":"2024-05-30T16:59:37.099318+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:47:12.815654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089450+0000","last_change":"2024-05-30T16:59:37.087703+0000","last_active":"2024-05-30T16:59:37.089450+0000","last_peered":"2024-05-30T16:59:37.089450+0000","last_clean":"2024-05-30T16:59:37.089450+0000","last_became_active":"2024-05-30T16:59:37.087368+0000","last_became_peered":"2024-05-30T16:59:37.087368+0000","last_unstale":"2024-05-30T16:59:37.089450+0000","last_undegraded":"2024-05-30T16:59:37.089450+0000","last_fullsized":"2024-05-30T16:59:37.089450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:57.044016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"89'6","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.099682+0000","last_change":"2024-05-30T16:59:36.066172+0000","last_active":"2024-05-30T16:59:37.099682+0000","last_peered":"2024-05-30T16:59:37.099682+0000","last_clean":"2024-05-30T16:59:37.099682+0000","last_became_active":"2024-05-30T16:59:36.064294+0000","last_became_peered":"2024-05-30T16:59:36.064294+0000","last_unstale":"2024-05-30T16:59:37.099682+0000","last_undegraded":"2024-05-30T16:59:37.099682+0000","last_fullsized":"2024-05-30T16:59:37.099682+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:17.835411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089850+0000","last_change":"2024-05-30T16:59:37.084517+0000","last_active":"2024-05-30T16:59:37.089850+0000","last_peered":"2024-05-30T16:59:37.089850+0000","last_clean":"2024-05-30T16:59:37.089850+0000","last_became_active":"2024-05-30T16:59:37.084243+0000","last_became_peered":"2024-05-30T16:59:37.084243+0000","last_unstale":"2024-05-30T16:59:37.089850+0000","last_undegraded":"2024-05-30T16:59:37.089850+0000","last_fullsized":"2024-05-30T16:59:37.089850+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:16:00.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.098352+0000","last_change":"2024-05-30T16:59:36.074867+0000","last_active":"2024-05-30T16:59:37.098352+0000","last_peered":"2024-05-30T16:59:37.098352+0000","last_clean":"2024-05-30T16:59:37.098352+0000","last_became_active":"2024-05-30T16:59:36.074584+0000","last_became_peered":"2024-05-30T16:59:36.074584+0000","last_unstale":"2024-05-30T16:59:37.098352+0000","last_undegraded":"2024-05-30T16:59:37.098352+0000","last_fullsized":"2024-05-30T16:59:37.098352+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:04:38.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096872+0000","last_change":"2024-05-30T16:59:37.094928+0000","last_active":"2024-05-30T16:59:37.096872+0000","last_peered":"2024-05-30T16:59:37.096872+0000","last_clean":"2024-05-30T16:59:37.096872+0000","last_became_active":"2024-05-30T16:59:37.094508+0000","last_became_peered":"2024-05-30T16:59:37.094508+0000","last_unstale":"2024-05-30T16:59:37.096872+0000","last_undegraded":"2024-05-30T16:59:37.096872+0000","last_fullsized":"2024-05-30T16:59:37.096872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:19:38.753995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T16:59:36.074268+0000","last_change":"2024-05-30T16:59:36.072195+0000","last_active":"2024-05-30T16:59:36.074268+0000","last_peered":"2024-05-30T16:59:36.074268+0000","last_clean":"2024-05-30T16:59:36.074268+0000","last_became_active":"2024-05-30T16:59:36.071318+0000","last_became_peered":"2024-05-30T16:59:36.071318+0000","last_unstale":"2024-05-30T16:59:36.074268+0000","last_undegraded":"2024-05-30T16:59:36.074268+0000","last_fullsized":"2024-05-30T16:59:36.074268+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:53:57.101832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094882+0000","last_change":"2024-05-30T16:59:37.085652+0000","last_active":"2024-05-30T16:59:37.094882+0000","last_peered":"2024-05-30T16:59:37.094882+0000","last_clean":"2024-05-30T16:59:37.094882+0000","last_became_active":"2024-05-30T16:59:37.085321+0000","last_became_peered":"2024-05-30T16:59:37.085321+0000","last_unstale":"2024-05-30T16:59:37.094882+0000","last_undegraded":"2024-05-30T16:59:37.094882+0000","last_fullsized":"2024-05-30T16:59:37.094882+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:26:37.459231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.065802+0000","last_change":"2024-05-30T16:59:36.073851+0000","last_active":"2024-05-30T16:59:37.065802+0000","last_peered":"2024-05-30T16:59:37.065802+0000","last_clean":"2024-05-30T16:59:37.065802+0000","last_became_active":"2024-05-30T16:59:36.073504+0000","last_became_peered":"2024-05-30T16:59:36.073504+0000","last_unstale":"2024-05-30T16:59:37.065802+0000","last_undegraded":"2024-05-30T16:59:37.065802+0000","last_fullsized":"2024-05-30T16:59:37.065802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:27.344000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097633+0000","last_change":"2024-05-30T16:59:37.090890+0000","last_active":"2024-05-30T16:59:37.097633+0000","last_peered":"2024-05-30T16:59:37.097633+0000","last_clean":"2024-05-30T16:59:37.097633+0000","last_became_active":"2024-05-30T16:59:37.090646+0000","last_became_peered":"2024-05-30T16:59:37.090646+0000","last_unstale":"2024-05-30T16:59:37.097633+0000","last_undegraded":"2024-05-30T16:59:37.097633+0000","last_fullsized":"2024-05-30T16:59:37.097633+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:59.217253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"89'8","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093819+0000","last_change":"2024-05-30T16:59:36.071455+0000","last_active":"2024-05-30T16:59:37.093819+0000","last_peered":"2024-05-30T16:59:37.093819+0000","last_clean":"2024-05-30T16:59:37.093819+0000","last_became_active":"2024-05-30T16:59:36.071143+0000","last_became_peered":"2024-05-30T16:59:36.071143+0000","last_unstale":"2024-05-30T16:59:37.093819+0000","last_undegraded":"2024-05-30T16:59:37.093819+0000","last_fullsized":"2024-05-30T16:59:37.093819+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:52.348518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088349+0000","last_change":"2024-05-30T16:59:37.085772+0000","last_active":"2024-05-30T16:59:37.088349+0000","last_peered":"2024-05-30T16:59:37.088349+0000","last_clean":"2024-05-30T16:59:37.088349+0000","last_became_active":"2024-05-30T16:59:37.085494+0000","last_became_peered":"2024-05-30T16:59:37.085494+0000","last_unstale":"2024-05-30T16:59:37.088349+0000","last_undegraded":"2024-05-30T16:59:37.088349+0000","last_fullsized":"2024-05-30T16:59:37.088349+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:42:21.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093379+0000","last_change":"2024-05-30T16:59:36.071418+0000","last_active":"2024-05-30T16:59:37.093379+0000","last_peered":"2024-05-30T16:59:37.093379+0000","last_clean":"2024-05-30T16:59:37.093379+0000","last_became_active":"2024-05-30T16:59:36.070404+0000","last_became_peered":"2024-05-30T16:59:36.070404+0000","last_unstale":"2024-05-30T16:59:37.093379+0000","last_undegraded":"2024-05-30T16:59:37.093379+0000","last_fullsized":"2024-05-30T16:59:37.093379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:09.218872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093476+0000","last_change":"2024-05-30T16:59:37.088772+0000","last_active":"2024-05-30T16:59:37.093476+0000","last_peered":"2024-05-30T16:59:37.093476+0000","last_clean":"2024-05-30T16:59:37.093476+0000","last_became_active":"2024-05-30T16:59:37.088489+0000","last_became_peered":"2024-05-30T16:59:37.088489+0000","last_unstale":"2024-05-30T16:59:37.093476+0000","last_undegraded":"2024-05-30T16:59:37.093476+0000","last_fullsized":"2024-05-30T16:59:37.093476+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:33.393237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096457+0000","last_change":"2024-05-30T16:59:36.077558+0000","last_active":"2024-05-30T16:59:37.096457+0000","last_peered":"2024-05-30T16:59:37.096457+0000","last_clean":"2024-05-30T16:59:37.096457+0000","last_became_active":"2024-05-30T16:59:36.076835+0000","last_became_peered":"2024-05-30T16:59:36.076835+0000","last_unstale":"2024-05-30T16:59:37.096457+0000","last_undegraded":"2024-05-30T16:59:37.096457+0000","last_fullsized":"2024-05-30T16:59:37.096457+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:59.947220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088396+0000","last_change":"2024-05-30T16:59:37.085771+0000","last_active":"2024-05-30T16:59:37.088396+0000","last_peered":"2024-05-30T16:59:37.088396+0000","last_clean":"2024-05-30T16:59:37.088396+0000","last_became_active":"2024-05-30T16:59:37.085475+0000","last_became_peered":"2024-05-30T16:59:37.085475+0000","last_unstale":"2024-05-30T16:59:37.088396+0000","last_undegraded":"2024-05-30T16:59:37.088396+0000","last_fullsized":"2024-05-30T16:59:37.088396+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:14:10.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.072496+0000","last_change":"2024-05-30T16:59:36.073081+0000","last_active":"2024-05-30T16:59:37.072496+0000","last_peered":"2024-05-30T16:59:37.072496+0000","last_clean":"2024-05-30T16:59:37.072496+0000","last_became_active":"2024-05-30T16:59:36.072483+0000","last_became_peered":"2024-05-30T16:59:36.072483+0000","last_unstale":"2024-05-30T16:59:37.072496+0000","last_undegraded":"2024-05-30T16:59:37.072496+0000","last_fullsized":"2024-05-30T16:59:37.072496+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:31:23.944400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.085095+0000","last_change":"2024-05-30T16:59:37.082050+0000","last_active":"2024-05-30T16:59:37.085095+0000","last_peered":"2024-05-30T16:59:37.085095+0000","last_clean":"2024-05-30T16:59:37.085095+0000","last_became_active":"2024-05-30T16:59:37.081747+0000","last_became_peered":"2024-05-30T16:59:37.081747+0000","last_unstale":"2024-05-30T16:59:37.085095+0000","last_undegraded":"2024-05-30T16:59:37.085095+0000","last_fullsized":"2024-05-30T16:59:37.085095+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:04:39.484172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T16:59:36.073762+0000","last_change":"2024-05-30T16:59:36.070012+0000","last_active":"2024-05-30T16:59:36.073762+0000","last_peered":"2024-05-30T16:59:36.073762+0000","last_clean":"2024-05-30T16:59:36.073762+0000","last_became_active":"2024-05-30T16:59:36.069700+0000","last_became_peered":"2024-05-30T16:59:36.069700+0000","last_unstale":"2024-05-30T16:59:36.073762+0000","last_undegraded":"2024-05-30T16:59:36.073762+0000","last_fullsized":"2024-05-30T16:59:36.073762+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:51.443117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.075876+0000","last_change":"2024-05-30T16:59:37.072799+0000","last_active":"2024-05-30T16:59:37.075876+0000","last_peered":"2024-05-30T16:59:37.075876+0000","last_clean":"2024-05-30T16:59:37.075876+0000","last_became_active":"2024-05-30T16:59:37.072459+0000","last_became_peered":"2024-05-30T16:59:37.072459+0000","last_unstale":"2024-05-30T16:59:37.075876+0000","last_undegraded":"2024-05-30T16:59:37.075876+0000","last_fullsized":"2024-05-30T16:59:37.075876+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:33.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.061601+0000","last_change":"2024-05-30T16:59:36.078703+0000","last_active":"2024-05-30T16:59:37.061601+0000","last_peered":"2024-05-30T16:59:37.061601+0000","last_clean":"2024-05-30T16:59:37.061601+0000","last_became_active":"2024-05-30T16:59:36.078388+0000","last_became_peered":"2024-05-30T16:59:36.078388+0000","last_unstale":"2024-05-30T16:59:37.061601+0000","last_undegraded":"2024-05-30T16:59:37.061601+0000","last_fullsized":"2024-05-30T16:59:37.061601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:33.197739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.067732+0000","last_change":"2024-05-30T16:59:37.065490+0000","last_active":"2024-05-30T16:59:37.067732+0000","last_peered":"2024-05-30T16:59:37.067732+0000","last_clean":"2024-05-30T16:59:37.067732+0000","last_became_active":"2024-05-30T16:59:37.065012+0000","last_became_peered":"2024-05-30T16:59:37.065012+0000","last_unstale":"2024-05-30T16:59:37.067732+0000","last_undegraded":"2024-05-30T16:59:37.067732+0000","last_fullsized":"2024-05-30T16:59:37.067732+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:28:28.070278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.059802+0000","last_change":"2024-05-30T16:59:36.073987+0000","last_active":"2024-05-30T16:59:37.059802+0000","last_peered":"2024-05-30T16:59:37.059802+0000","last_clean":"2024-05-30T16:59:37.059802+0000","last_became_active":"2024-05-30T16:59:36.073682+0000","last_became_peered":"2024-05-30T16:59:36.073682+0000","last_unstale":"2024-05-30T16:59:37.059802+0000","last_undegraded":"2024-05-30T16:59:37.059802+0000","last_fullsized":"2024-05-30T16:59:37.059802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:04:12.123572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.086046+0000","last_change":"2024-05-30T16:59:37.077255+0000","last_active":"2024-05-30T16:59:37.086046+0000","last_peered":"2024-05-30T16:59:37.086046+0000","last_clean":"2024-05-30T16:59:37.086046+0000","last_became_active":"2024-05-30T16:59:37.075699+0000","last_became_peered":"2024-05-30T16:59:37.075699+0000","last_unstale":"2024-05-30T16:59:37.086046+0000","last_undegraded":"2024-05-30T16:59:37.086046+0000","last_fullsized":"2024-05-30T16:59:37.086046+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:57.044016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T16:59:36.077906+0000","last_change":"2024-05-30T16:59:36.071359+0000","last_active":"2024-05-30T16:59:36.077906+0000","last_peered":"2024-05-30T16:59:36.077906+0000","last_clean":"2024-05-30T16:59:36.077906+0000","last_became_active":"2024-05-30T16:59:36.071068+0000","last_became_peered":"2024-05-30T16:59:36.071068+0000","last_unstale":"2024-05-30T16:59:36.077906+0000","last_undegraded":"2024-05-30T16:59:36.077906+0000","last_fullsized":"2024-05-30T16:59:36.077906+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:43:41.566821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084429+0000","last_change":"2024-05-30T16:59:37.079547+0000","last_active":"2024-05-30T16:59:37.084429+0000","last_peered":"2024-05-30T16:59:37.084429+0000","last_clean":"2024-05-30T16:59:37.084429+0000","last_became_active":"2024-05-30T16:59:37.077473+0000","last_became_peered":"2024-05-30T16:59:37.077473+0000","last_unstale":"2024-05-30T16:59:37.084429+0000","last_undegraded":"2024-05-30T16:59:37.084429+0000","last_fullsized":"2024-05-30T16:59:37.084429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:28.347373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.091656+0000","last_change":"2024-05-30T16:59:36.067314+0000","last_active":"2024-05-30T16:59:37.091656+0000","last_peered":"2024-05-30T16:59:37.091656+0000","last_clean":"2024-05-30T16:59:37.091656+0000","last_became_active":"2024-05-30T16:59:36.064171+0000","last_became_peered":"2024-05-30T16:59:36.064171+0000","last_unstale":"2024-05-30T16:59:37.091656+0000","last_undegraded":"2024-05-30T16:59:37.091656+0000","last_fullsized":"2024-05-30T16:59:37.091656+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:25.960596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095957+0000","last_change":"2024-05-30T16:59:37.093784+0000","last_active":"2024-05-30T16:59:37.095957+0000","last_peered":"2024-05-30T16:59:37.095957+0000","last_clean":"2024-05-30T16:59:37.095957+0000","last_became_active":"2024-05-30T16:59:37.093464+0000","last_became_peered":"2024-05-30T16:59:37.093464+0000","last_unstale":"2024-05-30T16:59:37.095957+0000","last_undegraded":"2024-05-30T16:59:37.095957+0000","last_fullsized":"2024-05-30T16:59:37.095957+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:51:51.208985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.082133+0000","last_change":"2024-05-30T16:59:36.075907+0000","last_active":"2024-05-30T16:59:37.082133+0000","last_peered":"2024-05-30T16:59:37.082133+0000","last_clean":"2024-05-30T16:59:37.082133+0000","last_became_active":"2024-05-30T16:59:36.075639+0000","last_became_peered":"2024-05-30T16:59:36.075639+0000","last_unstale":"2024-05-30T16:59:37.082133+0000","last_undegraded":"2024-05-30T16:59:37.082133+0000","last_fullsized":"2024-05-30T16:59:37.082133+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:11.419133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097395+0000","last_change":"2024-05-30T16:59:37.095753+0000","last_active":"2024-05-30T16:59:37.097395+0000","last_peered":"2024-05-30T16:59:37.097395+0000","last_clean":"2024-05-30T16:59:37.097395+0000","last_became_active":"2024-05-30T16:59:37.095191+0000","last_became_peered":"2024-05-30T16:59:37.095191+0000","last_unstale":"2024-05-30T16:59:37.097395+0000","last_undegraded":"2024-05-30T16:59:37.097395+0000","last_fullsized":"2024-05-30T16:59:37.097395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:33.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.068327+0000","last_change":"2024-05-30T16:59:36.079587+0000","last_active":"2024-05-30T16:59:37.068327+0000","last_peered":"2024-05-30T16:59:37.068327+0000","last_clean":"2024-05-30T16:59:37.068327+0000","last_became_active":"2024-05-30T16:59:36.079306+0000","last_became_peered":"2024-05-30T16:59:36.079306+0000","last_unstale":"2024-05-30T16:59:37.068327+0000","last_undegraded":"2024-05-30T16:59:37.068327+0000","last_fullsized":"2024-05-30T16:59:37.068327+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:41:30.701806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089429+0000","last_change":"2024-05-30T16:59:37.087073+0000","last_active":"2024-05-30T16:59:37.089429+0000","last_peered":"2024-05-30T16:59:37.089429+0000","last_clean":"2024-05-30T16:59:37.089429+0000","last_became_active":"2024-05-30T16:59:37.086784+0000","last_became_peered":"2024-05-30T16:59:37.086784+0000","last_unstale":"2024-05-30T16:59:37.089429+0000","last_undegraded":"2024-05-30T16:59:37.089429+0000","last_fullsized":"2024-05-30T16:59:37.089429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:47.601590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.073399+0000","last_change":"2024-05-30T16:59:36.078081+0000","last_active":"2024-05-30T16:59:37.073399+0000","last_peered":"2024-05-30T16:59:37.073399+0000","last_clean":"2024-05-30T16:59:37.073399+0000","last_became_active":"2024-05-30T16:59:36.077822+0000","last_became_peered":"2024-05-30T16:59:36.077822+0000","last_unstale":"2024-05-30T16:59:37.073399+0000","last_undegraded":"2024-05-30T16:59:37.073399+0000","last_fullsized":"2024-05-30T16:59:37.073399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:45:07.805901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.076430+0000","last_change":"2024-05-30T16:59:37.073176+0000","last_active":"2024-05-30T16:59:37.076430+0000","last_peered":"2024-05-30T16:59:37.076430+0000","last_clean":"2024-05-30T16:59:37.076430+0000","last_became_active":"2024-05-30T16:59:37.072705+0000","last_became_peered":"2024-05-30T16:59:37.072705+0000","last_unstale":"2024-05-30T16:59:37.076430+0000","last_undegraded":"2024-05-30T16:59:37.076430+0000","last_fullsized":"2024-05-30T16:59:37.076430+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:47.601590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.071282+0000","last_change":"2024-05-30T16:59:36.072434+0000","last_active":"2024-05-30T16:59:37.071282+0000","last_peered":"2024-05-30T16:59:37.071282+0000","last_clean":"2024-05-30T16:59:37.071282+0000","last_became_active":"2024-05-30T16:59:36.072080+0000","last_became_peered":"2024-05-30T16:59:36.072080+0000","last_unstale":"2024-05-30T16:59:37.071282+0000","last_undegraded":"2024-05-30T16:59:37.071282+0000","last_fullsized":"2024-05-30T16:59:37.071282+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:08.828492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.091200+0000","last_change":"2024-05-30T16:59:37.084414+0000","last_active":"2024-05-30T16:59:37.091200+0000","last_peered":"2024-05-30T16:59:37.091200+0000","last_clean":"2024-05-30T16:59:37.091200+0000","last_became_active":"2024-05-30T16:59:37.084136+0000","last_became_peered":"2024-05-30T16:59:37.084136+0000","last_unstale":"2024-05-30T16:59:37.091200+0000","last_undegraded":"2024-05-30T16:59:37.091200+0000","last_fullsized":"2024-05-30T16:59:37.091200+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:59:27.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.071319+0000","last_change":"2024-05-30T16:59:36.081362+0000","last_active":"2024-05-30T16:59:37.071319+0000","last_peered":"2024-05-30T16:59:37.071319+0000","last_clean":"2024-05-30T16:59:37.071319+0000","last_became_active":"2024-05-30T16:59:36.081053+0000","last_became_peered":"2024-05-30T16:59:36.081053+0000","last_unstale":"2024-05-30T16:59:37.071319+0000","last_undegraded":"2024-05-30T16:59:37.071319+0000","last_fullsized":"2024-05-30T16:59:37.071319+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:07.006990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084295+0000","last_change":"2024-05-30T16:59:37.082149+0000","last_active":"2024-05-30T16:59:37.084295+0000","last_peered":"2024-05-30T16:59:37.084295+0000","last_clean":"2024-05-30T16:59:37.084295+0000","last_became_active":"2024-05-30T16:59:37.081871+0000","last_became_peered":"2024-05-30T16:59:37.081871+0000","last_unstale":"2024-05-30T16:59:37.084295+0000","last_undegraded":"2024-05-30T16:59:37.084295+0000","last_fullsized":"2024-05-30T16:59:37.084295+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:21:31.814977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.070746+0000","last_change":"2024-05-30T16:59:36.082150+0000","last_active":"2024-05-30T16:59:37.070746+0000","last_peered":"2024-05-30T16:59:37.070746+0000","last_clean":"2024-05-30T16:59:37.070746+0000","last_became_active":"2024-05-30T16:59:36.081808+0000","last_became_peered":"2024-05-30T16:59:36.081808+0000","last_unstale":"2024-05-30T16:59:37.070746+0000","last_undegraded":"2024-05-30T16:59:37.070746+0000","last_fullsized":"2024-05-30T16:59:37.070746+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:10:14.175340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.092890+0000","last_change":"2024-05-30T16:59:37.086355+0000","last_active":"2024-05-30T16:59:37.092890+0000","last_peered":"2024-05-30T16:59:37.092890+0000","last_clean":"2024-05-30T16:59:37.092890+0000","last_became_active":"2024-05-30T16:59:37.085922+0000","last_became_peered":"2024-05-30T16:59:37.085922+0000","last_unstale":"2024-05-30T16:59:37.092890+0000","last_undegraded":"2024-05-30T16:59:37.092890+0000","last_fullsized":"2024-05-30T16:59:37.092890+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:08.010363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.070751+0000","last_change":"2024-05-30T16:59:36.078616+0000","last_active":"2024-05-30T16:59:37.070751+0000","last_peered":"2024-05-30T16:59:37.070751+0000","last_clean":"2024-05-30T16:59:37.070751+0000","last_became_active":"2024-05-30T16:59:36.078225+0000","last_became_peered":"2024-05-30T16:59:36.078225+0000","last_unstale":"2024-05-30T16:59:37.070751+0000","last_undegraded":"2024-05-30T16:59:37.070751+0000","last_fullsized":"2024-05-30T16:59:37.070751+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:05.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.081879+0000","last_change":"2024-05-30T16:59:37.077457+0000","last_active":"2024-05-30T16:59:37.081879+0000","last_peered":"2024-05-30T16:59:37.081879+0000","last_clean":"2024-05-30T16:59:37.081879+0000","last_became_active":"2024-05-30T16:59:37.077159+0000","last_became_peered":"2024-05-30T16:59:37.077159+0000","last_unstale":"2024-05-30T16:59:37.081879+0000","last_undegraded":"2024-05-30T16:59:37.081879+0000","last_fullsized":"2024-05-30T16:59:37.081879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:47.461836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095777+0000","last_change":"2024-05-30T16:59:36.075731+0000","last_active":"2024-05-30T16:59:37.095777+0000","last_peered":"2024-05-30T16:59:37.095777+0000","last_clean":"2024-05-30T16:59:37.095777+0000","last_became_active":"2024-05-30T16:59:36.075265+0000","last_became_peered":"2024-05-30T16:59:36.075265+0000","last_unstale":"2024-05-30T16:59:37.095777+0000","last_undegraded":"2024-05-30T16:59:37.095777+0000","last_fullsized":"2024-05-30T16:59:37.095777+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:53.038839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":299,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.071688+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:59:37.071688+0000","last_peered":"2024-05-30T16:59:37.071688+0000","last_clean":"2024-05-30T16:59:37.071688+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:59:37.071688+0000","last_undegraded":"2024-05-30T16:59:37.071688+0000","last_fullsized":"2024-05-30T16:59:37.071688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509571,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100800,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271040,"statfs":{"total":96636764160,"available":96533544960,"internally_reserved":0,"allocated":1683456,"data_stored":1056337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101513674},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118248,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253592,"statfs":{"total":96636764160,"available":96515678208,"internally_reserved":0,"allocated":1073152,"data_stored":459040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509572,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72424,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299416,"statfs":{"total":96636764160,"available":96562601984,"internally_reserved":0,"allocated":1073152,"data_stored":459040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509573,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76592,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295248,"statfs":{"total":96636764160,"available":96558333952,"internally_reserved":0,"allocated":1085440,"data_stored":465899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509572,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100220,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271620,"statfs":{"total":96636764160,"available":96534138880,"internally_reserved":0,"allocated":1089536,"data_stored":466481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509572,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82152,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94289688,"statfs":{"total":96636764160,"available":96552640512,"internally_reserved":0,"allocated":1073152,"data_stored":459040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509572,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77176,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294664,"statfs":{"total":96636764160,"available":96557735936,"internally_reserved":0,"allocated":1683456,"data_stored":1056301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122400,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249440,"statfs":{"total":96636764160,"available":96511426560,"internally_reserved":0,"allocated":1060864,"data_stored":452681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:59:41.980 INFO:tasks.ceph.ceph_manager.ceph:PG 13.31 is not active+clean 2024-05-30T16:59:41.980 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:59:36.074732+0000', 'last_change': '2024-05-30T16:59:36.074732+0000', 'last_active': '2024-05-30T16:59:36.046240+0000', 'last_peered': '2024-05-30T16:59:36.046240+0000', 'last_clean': '2024-05-30T16:59:36.046240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:59:36.074732+0000', 'last_undegraded': '2024-05-30T16:59:36.074732+0000', 'last_fullsized': '2024-05-30T16:59:36.074732+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:59:36.046240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:59:36.046240+0000', 'last_clean_scrub_stamp': '2024-05-30T16:59:36.046240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:59:41.980 INFO:tasks.ceph.ceph_manager.ceph:PG 13.19 is not active+clean 2024-05-30T16:59:41.981 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:59:36.073664+0000', 'last_change': '2024-05-30T16:59:36.073664+0000', 'last_active': '2024-05-30T16:59:36.046240+0000', 'last_peered': '2024-05-30T16:59:36.046240+0000', 'last_clean': '2024-05-30T16:59:36.046240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:59:36.073664+0000', 'last_undegraded': '2024-05-30T16:59:36.073664+0000', 'last_fullsized': '2024-05-30T16:59:36.073664+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:59:36.046240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:59:36.046240+0000', 'last_clean_scrub_stamp': '2024-05-30T16:59:36.046240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:59:41.981 INFO:tasks.ceph.ceph_manager.ceph:PG 13.16 is not active+clean 2024-05-30T16:59:41.981 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:59:36.067175+0000', 'last_change': '2024-05-30T16:59:36.067175+0000', 'last_active': '2024-05-30T16:59:36.046240+0000', 'last_peered': '2024-05-30T16:59:36.046240+0000', 'last_clean': '2024-05-30T16:59:36.046240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:59:36.067175+0000', 'last_undegraded': '2024-05-30T16:59:36.067175+0000', 'last_fullsized': '2024-05-30T16:59:36.067175+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:59:36.046240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:59:36.046240+0000', 'last_clean_scrub_stamp': '2024-05-30T16:59:36.046240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T16:59:41.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T16:59:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.156+0000 7f7e0f200640 1 Processor -- start 2024-05-30T16:59:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.156+0000 7f7e0f200640 1 -- start start 2024-05-30T16:59:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7e10162870 0x7f7e1009b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e100cdab0 con 0x7f7e10162c50 2024-05-30T16:59:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0f200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e100d0ba0 con 0x7f7e100ce5f0 2024-05-30T16:59:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0f200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7e100d17b0 con 0x7f7e10162870 2024-05-30T16:59:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e07e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7e10162c50 0x7f7e100cdee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51486/0 (socket says 172.21.15.59:51486) 2024-05-30T16:59:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e07e00640 1 -- 172.21.15.59:0/1739588472 learned_addr learned my addr 172.21.15.59:0/1739588472 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0de00640 1 --2- 172.21.15.59:0/1739588472 >> v2:172.21.15.107:3300/0 conn(0x7f7e10162870 0x7f7e1009b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0d400640 1 -- 172.21.15.59:0/1739588472 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028426976 0 0) 0x7f7e100cdab0 con 0x7f7e10162c50 2024-05-30T16:59:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0d400640 1 -- 172.21.15.59:0/1739588472 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7df4003530 con 0x7f7e10162c50 2024-05-30T16:59:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0d400640 1 -- 172.21.15.59:0/1739588472 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4069942593 0 0) 0x7f7e100d0ba0 con 0x7f7e100ce5f0 2024-05-30T16:59:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0d400640 1 -- 172.21.15.59:0/1739588472 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e100cdab0 con 0x7f7e100ce5f0 2024-05-30T16:59:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0d400640 1 -- 172.21.15.59:0/1739588472 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1202233109 0 0) 0x7f7df4003530 con 0x7f7e10162c50 2024-05-30T16:59:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0de00640 1 -- 172.21.15.59:0/1739588472 >> v1:172.21.15.107:6789/0 conn(0x7f7e100ce5f0 legacy=0x7f7e1015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0de00640 1 -- 172.21.15.59:0/1739588472 >> v1:172.21.15.59:6789/0 conn(0x7f7e10162c50 legacy=0x7f7e100cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.160+0000 7f7e0de00640 1 -- 172.21.15.59:0/1739588472 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e100d0e80 con 0x7f7e10162870 2024-05-30T16:59:42.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0de00640 1 --2- 172.21.15.59:0/1739588472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e10162870 0x7f7e1009b500 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7e000097c0 tx=0x7f7e0001c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b8fb29ddff2d65f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:42.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0d400640 1 -- 172.21.15.59:0/1739588472 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e000b0070 con 0x7f7e10162870 2024-05-30T16:59:42.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0d400640 1 -- 172.21.15.59:0/1739588472 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e000ab400 con 0x7f7e10162870 2024-05-30T16:59:42.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0d400640 1 -- 172.21.15.59:0/1739588472 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8001680 con 0x7f7e10162870 2024-05-30T16:59:42.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0f200640 1 -- 172.21.15.59:0/1739588472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e10162870 msgr2=0x7f7e1009b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0f200640 1 --2- 172.21.15.59:0/1739588472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e10162870 0x7f7e1009b500 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7e000097c0 tx=0x7f7e0001c390 comp rx=0 tx=0).stop 2024-05-30T16:59:42.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0f200640 1 -- 172.21.15.59:0/1739588472 shutdown_connections 2024-05-30T16:59:42.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0f200640 1 --2- 172.21.15.59:0/1739588472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e10162870 0x7f7e1009b500 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0f200640 1 -- 172.21.15.59:0/1739588472 >> 172.21.15.59:0/1739588472 conn(0x7f7e100b3f40 msgr2=0x7f7e100b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:42.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0f200640 1 -- 172.21.15.59:0/1739588472 shutdown_connections 2024-05-30T16:59:42.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0f200640 1 -- 172.21.15.59:0/1739588472 wait complete. 2024-05-30T16:59:42.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0f200640 1 Processor -- start 2024-05-30T16:59:42.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0f200640 1 -- start start 2024-05-30T16:59:42.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e100ce5f0 0x7f7e1015b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:42.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e10162870 0x7f7e10155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:42.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.164+0000 7f7e0f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e10162c50 0x7f7e100caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:42.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e0f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1009bbc0 con 0x7f7e10162870 2024-05-30T16:59:42.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e0f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1009ba40 con 0x7f7e100ce5f0 2024-05-30T16:59:42.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e0f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1016c960 con 0x7f7e10162c50 2024-05-30T16:59:42.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e07e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e10162870 0x7f7e10155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:42.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e07e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e10162870 0x7f7e10155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40384/0 (socket says 172.21.15.59:40384) 2024-05-30T16:59:42.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e07e00640 1 -- 172.21.15.59:0/3399656213 learned_addr learned my addr 172.21.15.59:0/3399656213 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:42.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e0de00640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e100ce5f0 0x7f7e1015b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:42.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e0e800640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e10162c50 0x7f7e100caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:42.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e07e00640 1 -- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e10162c50 msgr2=0x7f7e100caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e07e00640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e10162c50 0x7f7e100caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e07e00640 1 -- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e100ce5f0 msgr2=0x7f7e1015b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e07e00640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e100ce5f0 0x7f7e1015b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e07e00640 1 -- 172.21.15.59:0/3399656213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e100c9e70 con 0x7f7e10162870 2024-05-30T16:59:42.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e07e00640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e10162870 0x7f7e10155290 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7df800c750 tx=0x7f7df800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:42.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e06000640 1 -- 172.21.15.59:0/3399656213 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8005ae0 con 0x7f7e10162870 2024-05-30T16:59:42.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e06000640 1 -- 172.21.15.59:0/3399656213 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df8005c80 con 0x7f7e10162870 2024-05-30T16:59:42.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e06000640 1 -- 172.21.15.59:0/3399656213 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df80072b0 con 0x7f7e10162870 2024-05-30T16:59:42.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e0f200640 1 -- 172.21.15.59:0/3399656213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e100ca150 con 0x7f7e10162870 2024-05-30T16:59:42.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e0f200640 1 -- 172.21.15.59:0/3399656213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e100ca710 con 0x7f7e10162870 2024-05-30T16:59:42.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e0f200640 1 -- 172.21.15.59:0/3399656213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e100691a0 con 0x7f7e10162870 2024-05-30T16:59:42.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.168+0000 7f7e06000640 1 -- 172.21.15.59:0/3399656213 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f7df8007450 con 0x7f7e10162870 2024-05-30T16:59:42.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.172+0000 7f7e06000640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7dec0694f0 0x7f7dec06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:42.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.172+0000 7f7e06000640 1 -- 172.21.15.59:0/3399656213 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5793+0+0 (secure 0 0 0) 0x7f7df8085640 con 0x7f7e10162870 2024-05-30T16:59:42.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.172+0000 7f7e0de00640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7dec0694f0 0x7f7dec06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:42.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.172+0000 7f7e0de00640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7dec0694f0 0x7f7dec06b9b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7e000ad000 tx=0x7f7e000a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:42.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.176+0000 7f7e06000640 1 -- 172.21.15.59:0/3399656213 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7df80573c0 con 0x7f7e10162870 2024-05-30T16:59:42.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.400+0000 7f7e0f200640 1 -- 172.21.15.59:0/3399656213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7e100b4ba0 con 0x7f7e10162870 2024-05-30T16:59:42.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.400+0000 7f7e06000640 1 -- 172.21.15.59:0/3399656213 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1100 (secure 0 0 0) 0x7f7df8056cc0 con 0x7f7e10162870 2024-05-30T16:59:42.403 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:42.403 INFO:teuthology.orchestra.run.smithi059.stdout:{"fsid":"97857630-028c-48a2-897f-bf5f996be133","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":662,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":90,"num_osds":8,"num_up_osds":8,"osd_up_since":1717087732,"num_in_osds":8,"osd_in_since":1717087722,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":94},{"state_name":"creating+peering","count":3}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592778,"bytes_used":768012288,"bytes_avail":772326100992,"bytes_total":773094113280,"inactive_pgs_ratio":0.030927835032343864,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":52,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":7449}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-05-30T16:57:51.243602+0000","services":{}},"progress_events":{}} 2024-05-30T16:59:42.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.404+0000 7f7e0f200640 1 -- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7dec0694f0 msgr2=0x7f7dec06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.404+0000 7f7e0f200640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7dec0694f0 0x7f7dec06b9b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7e000ad000 tx=0x7f7e000a6000 comp rx=0 tx=0).stop 2024-05-30T16:59:42.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.404+0000 7f7e0f200640 1 -- 172.21.15.59:0/3399656213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e10162870 msgr2=0x7f7e10155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.404+0000 7f7e0f200640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e10162870 0x7f7e10155290 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7df800c750 tx=0x7f7df800cc10 comp rx=0 tx=0).stop 2024-05-30T16:59:42.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.404+0000 7f7e0f200640 1 -- 172.21.15.59:0/3399656213 shutdown_connections 2024-05-30T16:59:42.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.404+0000 7f7e0f200640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7dec0694f0 0x7f7dec06b9b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.404+0000 7f7e0f200640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e10162c50 0x7f7e100caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.404+0000 7f7e0f200640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e10162870 0x7f7e10155290 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.404+0000 7f7e0f200640 1 --2- 172.21.15.59:0/3399656213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e100ce5f0 0x7f7e1015b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.404+0000 7f7e0f200640 1 -- 172.21.15.59:0/3399656213 >> 172.21.15.59:0/3399656213 conn(0x7f7e100b3f40 msgr2=0x7f7e1006e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:42.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.404+0000 7f7e0f200640 1 -- 172.21.15.59:0/3399656213 shutdown_connections 2024-05-30T16:59:42.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.404+0000 7f7e0f200640 1 -- 172.21.15.59:0/3399656213 wait complete. 2024-05-30T16:59:42.424 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-30T16:59:42.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:59:42.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbcd1a00640 1 Processor -- start 2024-05-30T16:59:42.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbcd1a00640 1 -- start start 2024-05-30T16:59:42.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbcd1a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbccc159df0 0x7fbccc0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:42.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbcd1a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbccc0b3e50 0x7fbccc0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:42.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbcd1a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbccc15d730 con 0x7fbccc15a1d0 2024-05-30T16:59:42.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbcd1a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbccc0b3370 con 0x7fbccc159df0 2024-05-30T16:59:42.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbcd1a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbccc0b3650 con 0x7fbccc0b3e50 2024-05-30T16:59:42.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbcc2000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbccc15a1d0 0x7fbccc15ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51494/0 (socket says 172.21.15.59:51494) 2024-05-30T16:59:42.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbcc2000640 1 -- 172.21.15.59:0/4278224693 learned_addr learned my addr 172.21.15.59:0/4278224693 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:42.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbccaa00640 1 --2- 172.21.15.59:0/4278224693 >> v2:172.21.15.107:3300/0 conn(0x7fbccc159df0 0x7fbccc0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:42.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbccb400640 1 --2- 172.21.15.59:0/4278224693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbccc0b3e50 0x7fbccc0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:42.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbcca000640 1 -- 172.21.15.59:0/4278224693 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398641486 0 0) 0x7fbccc15d730 con 0x7fbccc15a1d0 2024-05-30T16:59:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbcca000640 1 -- 172.21.15.59:0/4278224693 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb0003530 con 0x7fbccc15a1d0 2024-05-30T16:59:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbccaa00640 1 -- 172.21.15.59:0/4278224693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbccc0b3e50 msgr2=0x7fbccc0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbccaa00640 1 --2- 172.21.15.59:0/4278224693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbccc0b3e50 0x7fbccc0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbccaa00640 1 -- 172.21.15.59:0/4278224693 >> v1:172.21.15.59:6789/0 conn(0x7fbccc15a1d0 legacy=0x7fbccc15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.564+0000 7fbccaa00640 1 -- 172.21.15.59:0/4278224693 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc0b3930 con 0x7fbccc159df0 2024-05-30T16:59:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.568+0000 7fbccaa00640 1 --2- 172.21.15.59:0/4278224693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbccc159df0 0x7fbccc0ad1b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0097c0 tx=0x7fbcbc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60df59134b26241a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.568+0000 7fbcca000640 1 -- 172.21.15.59:0/4278224693 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0b0070 con 0x7fbccc159df0 2024-05-30T16:59:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.568+0000 7fbcca000640 1 -- 172.21.15.59:0/4278224693 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc0ab600 con 0x7fbccc159df0 2024-05-30T16:59:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.568+0000 7fbcca000640 1 -- 172.21.15.59:0/4278224693 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0ab9d0 con 0x7fbccc159df0 2024-05-30T16:59:42.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.568+0000 7fbcd1a00640 1 -- 172.21.15.59:0/4278224693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbccc159df0 msgr2=0x7fbccc0ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.568+0000 7fbcd1a00640 1 --2- 172.21.15.59:0/4278224693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbccc159df0 0x7fbccc0ad1b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0097c0 tx=0x7fbcbc01c4a0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.568+0000 7fbcd1a00640 1 -- 172.21.15.59:0/4278224693 shutdown_connections 2024-05-30T16:59:42.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.568+0000 7fbcd1a00640 1 --2- 172.21.15.59:0/4278224693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbccc0b3e50 0x7fbccc0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.568+0000 7fbcd1a00640 1 --2- 172.21.15.59:0/4278224693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbccc159df0 0x7fbccc0ad1b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.568+0000 7fbcd1a00640 1 -- 172.21.15.59:0/4278224693 >> 172.21.15.59:0/4278224693 conn(0x7fbccc0b22d0 msgr2=0x7fbccc0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:42.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.568+0000 7fbcd1a00640 1 -- 172.21.15.59:0/4278224693 shutdown_connections 2024-05-30T16:59:42.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.568+0000 7fbcd1a00640 1 -- 172.21.15.59:0/4278224693 wait complete. 2024-05-30T16:59:42.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcd1a00640 1 Processor -- start 2024-05-30T16:59:42.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcd1a00640 1 -- start start 2024-05-30T16:59:42.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcd1a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbccc0b3e50 0x7fbccc0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:42.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcd1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbccc159df0 0x7fbccc154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:42.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcd1a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbccc15a1d0 0x7fbccc1604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:42.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcd1a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc15e720 con 0x7fbccc159df0 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcd1a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc15e5a0 con 0x7fbccc15a1d0 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcd1a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbccc15e8a0 con 0x7fbccc0b3e50 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcc2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbccc159df0 0x7fbccc154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcc2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbccc159df0 0x7fbccc154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40396/0 (socket says 172.21.15.59:40396) 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcc2000640 1 -- 172.21.15.59:0/569842466 learned_addr learned my addr 172.21.15.59:0/569842466 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbccaa00640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbccc0b3e50 0x7fbccc0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbccb400640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbccc15a1d0 0x7fbccc1604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcc2000640 1 -- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbccc0b3e50 msgr2=0x7fbccc0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcc2000640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbccc0b3e50 0x7fbccc0999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcc2000640 1 -- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbccc15a1d0 msgr2=0x7fbccc1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcc2000640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbccc15a1d0 0x7fbccc1604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcc2000640 1 -- 172.21.15.59:0/569842466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc15f400 con 0x7fbccc159df0 2024-05-30T16:59:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcc2000640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbccc159df0 0x7fbccc154940 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400c390 tx=0x7fbcb400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcc3400640 1 -- 172.21.15.59:0/569842466 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4017070 con 0x7fbccc159df0 2024-05-30T16:59:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcc3400640 1 -- 172.21.15.59:0/569842466 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb4005d10 con 0x7fbccc159df0 2024-05-30T16:59:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcd1a00640 1 -- 172.21.15.59:0/569842466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbccc15f6e0 con 0x7fbccc159df0 2024-05-30T16:59:42.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcc3400640 1 -- 172.21.15.59:0/569842466 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4007310 con 0x7fbccc159df0 2024-05-30T16:59:42.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.572+0000 7fbcd1a00640 1 -- 172.21.15.59:0/569842466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbccc15fca0 con 0x7fbccc159df0 2024-05-30T16:59:42.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.576+0000 7fbcd1a00640 1 -- 172.21.15.59:0/569842466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbccc068a90 con 0x7fbccc159df0 2024-05-30T16:59:42.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.576+0000 7fbcc3400640 1 -- 172.21.15.59:0/569842466 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fbcb401a070 con 0x7fbccc159df0 2024-05-30T16:59:42.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.576+0000 7fbcc3400640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbca80694f0 0x7fbca806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:42.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.576+0000 7fbcc3400640 1 -- 172.21.15.59:0/569842466 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5793+0+0 (secure 0 0 0) 0x7fbcb4084c70 con 0x7fbccc159df0 2024-05-30T16:59:42.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.576+0000 7fbccaa00640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbca80694f0 0x7fbca806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:42.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.576+0000 7fbccaa00640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbca80694f0 0x7fbca806b9b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0ad000 tx=0x7fbcbc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:42.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.580+0000 7fbcc3400640 1 -- 172.21.15.59:0/569842466 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbcb4056310 con 0x7fbccc159df0 2024-05-30T16:59:42.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.740+0000 7fbcd1a00640 1 -- 172.21.15.59:0/569842466 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbccc0691a0 con 0x7fbca80694f0 2024-05-30T16:59:42.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.748+0000 7fbcc3400640 1 -- 172.21.15.59:0/569842466 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251774 (secure 0 0 0) 0x7fbccc0691a0 con 0x7fbca80694f0 2024-05-30T16:59:42.753 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:59:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.752+0000 7fbcd1a00640 1 -- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbca80694f0 msgr2=0x7fbca806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.752+0000 7fbcd1a00640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbca80694f0 0x7fbca806b9b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0ad000 tx=0x7fbcbc0a6000 comp rx=0 tx=0).stop 2024-05-30T16:59:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.752+0000 7fbcd1a00640 1 -- 172.21.15.59:0/569842466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbccc159df0 msgr2=0x7fbccc154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.752+0000 7fbcd1a00640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbccc159df0 0x7fbccc154940 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400c390 tx=0x7fbcb400c850 comp rx=0 tx=0).stop 2024-05-30T16:59:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.752+0000 7fbcd1a00640 1 -- 172.21.15.59:0/569842466 shutdown_connections 2024-05-30T16:59:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.752+0000 7fbcd1a00640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbca80694f0 0x7fbca806b9b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.752+0000 7fbcd1a00640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbccc15a1d0 0x7fbccc1604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.752+0000 7fbcd1a00640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbccc159df0 0x7fbccc154940 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.752+0000 7fbcd1a00640 1 --2- 172.21.15.59:0/569842466 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbccc0b3e50 0x7fbccc0999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.752+0000 7fbcd1a00640 1 -- 172.21.15.59:0/569842466 >> 172.21.15.59:0/569842466 conn(0x7fbccc0b22d0 msgr2=0x7fbccc0ad1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.752+0000 7fbcd1a00640 1 -- 172.21.15.59:0/569842466 shutdown_connections 2024-05-30T16:59:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:42.752+0000 7fbcd1a00640 1 -- 172.21.15.59:0/569842466 wait complete. 2024-05-30T16:59:42.775 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2024-05-30T16:59:41.307578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":750012,"kb_used_data":9592,"kb_used_omap":12,"kb_used_meta":740275,"kb_avail":754224708,"statfs":{"total":773094113280,"available":772326100992,"internally_reserved":0,"allocated":9822208,"data_stored":4874819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":758042160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001390"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097792+0000","last_change":"2024-05-30T16:59:37.093203+0000","last_active":"2024-05-30T16:59:37.097792+0000","last_peered":"2024-05-30T16:59:37.097792+0000","last_clean":"2024-05-30T16:59:37.097792+0000","last_became_active":"2024-05-30T16:59:37.092105+0000","last_became_peered":"2024-05-30T16:59:37.092105+0000","last_unstale":"2024-05-30T16:59:37.097792+0000","last_undegraded":"2024-05-30T16:59:37.097792+0000","last_fullsized":"2024-05-30T16:59:37.097792+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:49.431377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097664+0000","last_change":"2024-05-30T16:59:37.093116+0000","last_active":"2024-05-30T16:59:37.097664+0000","last_peered":"2024-05-30T16:59:37.097664+0000","last_clean":"2024-05-30T16:59:37.097664+0000","last_became_active":"2024-05-30T16:59:37.092861+0000","last_became_peered":"2024-05-30T16:59:37.092861+0000","last_unstale":"2024-05-30T16:59:37.097664+0000","last_undegraded":"2024-05-30T16:59:37.097664+0000","last_fullsized":"2024-05-30T16:59:37.097664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:00:31.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096113+0000","last_change":"2024-05-30T16:59:37.092582+0000","last_active":"2024-05-30T16:59:37.096113+0000","last_peered":"2024-05-30T16:59:37.096113+0000","last_clean":"2024-05-30T16:59:37.096113+0000","last_became_active":"2024-05-30T16:59:37.092334+0000","last_became_peered":"2024-05-30T16:59:37.092334+0000","last_unstale":"2024-05-30T16:59:37.096113+0000","last_undegraded":"2024-05-30T16:59:37.096113+0000","last_fullsized":"2024-05-30T16:59:37.096113+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:03:20.704600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.085330+0000","last_change":"2024-05-30T16:59:37.082085+0000","last_active":"2024-05-30T16:59:37.085330+0000","last_peered":"2024-05-30T16:59:37.085330+0000","last_clean":"2024-05-30T16:59:37.085330+0000","last_became_active":"2024-05-30T16:59:37.081821+0000","last_became_peered":"2024-05-30T16:59:37.081821+0000","last_unstale":"2024-05-30T16:59:37.085330+0000","last_undegraded":"2024-05-30T16:59:37.085330+0000","last_fullsized":"2024-05-30T16:59:37.085330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:34.423495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088413+0000","last_change":"2024-05-30T16:59:37.085960+0000","last_active":"2024-05-30T16:59:37.088413+0000","last_peered":"2024-05-30T16:59:37.088413+0000","last_clean":"2024-05-30T16:59:37.088413+0000","last_became_active":"2024-05-30T16:59:37.085666+0000","last_became_peered":"2024-05-30T16:59:37.085666+0000","last_unstale":"2024-05-30T16:59:37.088413+0000","last_undegraded":"2024-05-30T16:59:37.088413+0000","last_fullsized":"2024-05-30T16:59:37.088413+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:49.431377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.074647+0000","last_change":"2024-05-30T16:59:37.072380+0000","last_active":"2024-05-30T16:59:37.074647+0000","last_peered":"2024-05-30T16:59:37.074647+0000","last_clean":"2024-05-30T16:59:37.074647+0000","last_became_active":"2024-05-30T16:59:37.072034+0000","last_became_peered":"2024-05-30T16:59:37.072034+0000","last_unstale":"2024-05-30T16:59:37.074647+0000","last_undegraded":"2024-05-30T16:59:37.074647+0000","last_fullsized":"2024-05-30T16:59:37.074647+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:49.431377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.077765+0000","last_change":"2024-05-30T16:59:37.076182+0000","last_active":"2024-05-30T16:59:37.077765+0000","last_peered":"2024-05-30T16:59:37.077765+0000","last_clean":"2024-05-30T16:59:37.077765+0000","last_became_active":"2024-05-30T16:59:37.075914+0000","last_became_peered":"2024-05-30T16:59:37.075914+0000","last_unstale":"2024-05-30T16:59:37.077765+0000","last_undegraded":"2024-05-30T16:59:37.077765+0000","last_fullsized":"2024-05-30T16:59:37.077765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:28.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.085938+0000","last_change":"2024-05-30T16:59:37.078450+0000","last_active":"2024-05-30T16:59:37.085938+0000","last_peered":"2024-05-30T16:59:37.085938+0000","last_clean":"2024-05-30T16:59:37.085938+0000","last_became_active":"2024-05-30T16:59:37.078165+0000","last_became_peered":"2024-05-30T16:59:37.078165+0000","last_unstale":"2024-05-30T16:59:37.085938+0000","last_undegraded":"2024-05-30T16:59:37.085938+0000","last_fullsized":"2024-05-30T16:59:37.085938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:09.831864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.092466+0000","last_change":"2024-05-30T16:59:37.082510+0000","last_active":"2024-05-30T16:59:37.092466+0000","last_peered":"2024-05-30T16:59:37.092466+0000","last_clean":"2024-05-30T16:59:37.092466+0000","last_became_active":"2024-05-30T16:59:37.082213+0000","last_became_peered":"2024-05-30T16:59:37.082213+0000","last_unstale":"2024-05-30T16:59:37.092466+0000","last_undegraded":"2024-05-30T16:59:37.092466+0000","last_fullsized":"2024-05-30T16:59:37.092466+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:38.192437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094915+0000","last_change":"2024-05-30T16:59:37.091906+0000","last_active":"2024-05-30T16:59:37.094915+0000","last_peered":"2024-05-30T16:59:37.094915+0000","last_clean":"2024-05-30T16:59:37.094915+0000","last_became_active":"2024-05-30T16:59:37.091488+0000","last_became_peered":"2024-05-30T16:59:37.091488+0000","last_unstale":"2024-05-30T16:59:37.094915+0000","last_undegraded":"2024-05-30T16:59:37.094915+0000","last_fullsized":"2024-05-30T16:59:37.094915+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:14:10.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093509+0000","last_change":"2024-05-30T16:59:37.081319+0000","last_active":"2024-05-30T16:59:37.093509+0000","last_peered":"2024-05-30T16:59:37.093509+0000","last_clean":"2024-05-30T16:59:37.093509+0000","last_became_active":"2024-05-30T16:59:37.078930+0000","last_became_peered":"2024-05-30T16:59:37.078930+0000","last_unstale":"2024-05-30T16:59:37.093509+0000","last_undegraded":"2024-05-30T16:59:37.093509+0000","last_fullsized":"2024-05-30T16:59:37.093509+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:31.036487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094961+0000","last_change":"2024-05-30T16:59:37.091682+0000","last_active":"2024-05-30T16:59:37.094961+0000","last_peered":"2024-05-30T16:59:37.094961+0000","last_clean":"2024-05-30T16:59:37.094961+0000","last_became_active":"2024-05-30T16:59:37.091372+0000","last_became_peered":"2024-05-30T16:59:37.091372+0000","last_unstale":"2024-05-30T16:59:37.094961+0000","last_undegraded":"2024-05-30T16:59:37.094961+0000","last_fullsized":"2024-05-30T16:59:37.094961+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:18.838783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.082590+0000","last_change":"2024-05-30T16:59:37.080801+0000","last_active":"2024-05-30T16:59:37.082590+0000","last_peered":"2024-05-30T16:59:37.082590+0000","last_clean":"2024-05-30T16:59:37.082590+0000","last_became_active":"2024-05-30T16:59:37.080526+0000","last_became_peered":"2024-05-30T16:59:37.080526+0000","last_unstale":"2024-05-30T16:59:37.082590+0000","last_undegraded":"2024-05-30T16:59:37.082590+0000","last_fullsized":"2024-05-30T16:59:37.082590+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:52:53.010477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.090436+0000","last_change":"2024-05-30T16:59:37.087845+0000","last_active":"2024-05-30T16:59:37.090436+0000","last_peered":"2024-05-30T16:59:37.090436+0000","last_clean":"2024-05-30T16:59:37.090436+0000","last_became_active":"2024-05-30T16:59:37.085959+0000","last_became_peered":"2024-05-30T16:59:37.085959+0000","last_unstale":"2024-05-30T16:59:37.090436+0000","last_undegraded":"2024-05-30T16:59:37.090436+0000","last_fullsized":"2024-05-30T16:59:37.090436+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:31.036487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2024-05-30T16:59:36.074732+0000","last_change":"2024-05-30T16:59:36.074732+0000","last_active":"2024-05-30T16:59:36.046240+0000","last_peered":"2024-05-30T16:59:36.046240+0000","last_clean":"2024-05-30T16:59:36.046240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:59:36.074732+0000","last_undegraded":"2024-05-30T16:59:36.074732+0000","last_fullsized":"2024-05-30T16:59:36.074732+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.090844+0000","last_change":"2024-05-30T16:59:37.090158+0000","last_active":"2024-05-30T16:59:37.090844+0000","last_peered":"2024-05-30T16:59:37.090844+0000","last_clean":"2024-05-30T16:59:37.090844+0000","last_became_active":"2024-05-30T16:59:37.089875+0000","last_became_peered":"2024-05-30T16:59:37.089875+0000","last_unstale":"2024-05-30T16:59:37.090844+0000","last_undegraded":"2024-05-30T16:59:37.090844+0000","last_fullsized":"2024-05-30T16:59:37.090844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:09.831864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088754+0000","last_change":"2024-05-30T16:59:37.084968+0000","last_active":"2024-05-30T16:59:37.088754+0000","last_peered":"2024-05-30T16:59:37.088754+0000","last_clean":"2024-05-30T16:59:37.088754+0000","last_became_active":"2024-05-30T16:59:37.084679+0000","last_became_peered":"2024-05-30T16:59:37.084679+0000","last_unstale":"2024-05-30T16:59:37.088754+0000","last_undegraded":"2024-05-30T16:59:37.088754+0000","last_fullsized":"2024-05-30T16:59:37.088754+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:18.838783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094819+0000","last_change":"2024-05-30T16:59:37.092473+0000","last_active":"2024-05-30T16:59:37.094819+0000","last_peered":"2024-05-30T16:59:37.094819+0000","last_clean":"2024-05-30T16:59:37.094819+0000","last_became_active":"2024-05-30T16:59:37.092195+0000","last_became_peered":"2024-05-30T16:59:37.092195+0000","last_unstale":"2024-05-30T16:59:37.094819+0000","last_undegraded":"2024-05-30T16:59:37.094819+0000","last_fullsized":"2024-05-30T16:59:37.094819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:26.963969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.090323+0000","last_change":"2024-05-30T16:59:37.086366+0000","last_active":"2024-05-30T16:59:37.090323+0000","last_peered":"2024-05-30T16:59:37.090323+0000","last_clean":"2024-05-30T16:59:37.090323+0000","last_became_active":"2024-05-30T16:59:37.086008+0000","last_became_peered":"2024-05-30T16:59:37.086008+0000","last_unstale":"2024-05-30T16:59:37.090323+0000","last_undegraded":"2024-05-30T16:59:37.090323+0000","last_fullsized":"2024-05-30T16:59:37.090323+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:01.271116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094640+0000","last_change":"2024-05-30T16:59:37.091075+0000","last_active":"2024-05-30T16:59:37.094640+0000","last_peered":"2024-05-30T16:59:37.094640+0000","last_clean":"2024-05-30T16:59:37.094640+0000","last_became_active":"2024-05-30T16:59:37.090740+0000","last_became_peered":"2024-05-30T16:59:37.090740+0000","last_unstale":"2024-05-30T16:59:37.094640+0000","last_undegraded":"2024-05-30T16:59:37.094640+0000","last_fullsized":"2024-05-30T16:59:37.094640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:12.422505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.083675+0000","last_change":"2024-05-30T16:59:37.081310+0000","last_active":"2024-05-30T16:59:37.083675+0000","last_peered":"2024-05-30T16:59:37.083675+0000","last_clean":"2024-05-30T16:59:37.083675+0000","last_became_active":"2024-05-30T16:59:37.081051+0000","last_became_peered":"2024-05-30T16:59:37.081051+0000","last_unstale":"2024-05-30T16:59:37.083675+0000","last_undegraded":"2024-05-30T16:59:37.083675+0000","last_fullsized":"2024-05-30T16:59:37.083675+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:47.461836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097459+0000","last_change":"2024-05-30T16:59:37.092092+0000","last_active":"2024-05-30T16:59:37.097459+0000","last_peered":"2024-05-30T16:59:37.097459+0000","last_clean":"2024-05-30T16:59:37.097459+0000","last_became_active":"2024-05-30T16:59:37.089929+0000","last_became_peered":"2024-05-30T16:59:37.089929+0000","last_unstale":"2024-05-30T16:59:37.097459+0000","last_undegraded":"2024-05-30T16:59:37.097459+0000","last_fullsized":"2024-05-30T16:59:37.097459+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:00:47.652785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093649+0000","last_change":"2024-05-30T16:59:37.089008+0000","last_active":"2024-05-30T16:59:37.093649+0000","last_peered":"2024-05-30T16:59:37.093649+0000","last_clean":"2024-05-30T16:59:37.093649+0000","last_became_active":"2024-05-30T16:59:37.088577+0000","last_became_peered":"2024-05-30T16:59:37.088577+0000","last_unstale":"2024-05-30T16:59:37.093649+0000","last_undegraded":"2024-05-30T16:59:37.093649+0000","last_fullsized":"2024-05-30T16:59:37.093649+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:55.662497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084673+0000","last_change":"2024-05-30T16:59:37.077530+0000","last_active":"2024-05-30T16:59:37.084673+0000","last_peered":"2024-05-30T16:59:37.084673+0000","last_clean":"2024-05-30T16:59:37.084673+0000","last_became_active":"2024-05-30T16:59:37.077272+0000","last_became_peered":"2024-05-30T16:59:37.077272+0000","last_unstale":"2024-05-30T16:59:37.084673+0000","last_undegraded":"2024-05-30T16:59:37.084673+0000","last_fullsized":"2024-05-30T16:59:37.084673+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:46:59.562379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097260+0000","last_change":"2024-05-30T16:59:37.092872+0000","last_active":"2024-05-30T16:59:37.097260+0000","last_peered":"2024-05-30T16:59:37.097260+0000","last_clean":"2024-05-30T16:59:37.097260+0000","last_became_active":"2024-05-30T16:59:37.092602+0000","last_became_peered":"2024-05-30T16:59:37.092602+0000","last_unstale":"2024-05-30T16:59:37.097260+0000","last_undegraded":"2024-05-30T16:59:37.097260+0000","last_fullsized":"2024-05-30T16:59:37.097260+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:55:23.698395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.083155+0000","last_change":"2024-05-30T16:59:37.082108+0000","last_active":"2024-05-30T16:59:37.083155+0000","last_peered":"2024-05-30T16:59:37.083155+0000","last_clean":"2024-05-30T16:59:37.083155+0000","last_became_active":"2024-05-30T16:59:37.081786+0000","last_became_peered":"2024-05-30T16:59:37.081786+0000","last_unstale":"2024-05-30T16:59:37.083155+0000","last_undegraded":"2024-05-30T16:59:37.083155+0000","last_fullsized":"2024-05-30T16:59:37.083155+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:31:42.026333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.076454+0000","last_change":"2024-05-30T16:59:37.074108+0000","last_active":"2024-05-30T16:59:37.076454+0000","last_peered":"2024-05-30T16:59:37.076454+0000","last_clean":"2024-05-30T16:59:37.076454+0000","last_became_active":"2024-05-30T16:59:37.073685+0000","last_became_peered":"2024-05-30T16:59:37.073685+0000","last_unstale":"2024-05-30T16:59:37.076454+0000","last_undegraded":"2024-05-30T16:59:37.076454+0000","last_fullsized":"2024-05-30T16:59:37.076454+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094944+0000","last_change":"2024-05-30T16:59:37.091611+0000","last_active":"2024-05-30T16:59:37.094944+0000","last_peered":"2024-05-30T16:59:37.094944+0000","last_clean":"2024-05-30T16:59:37.094944+0000","last_became_active":"2024-05-30T16:59:37.091300+0000","last_became_peered":"2024-05-30T16:59:37.091300+0000","last_unstale":"2024-05-30T16:59:37.094944+0000","last_undegraded":"2024-05-30T16:59:37.094944+0000","last_fullsized":"2024-05-30T16:59:37.094944+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:28.347373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.083386+0000","last_change":"2024-05-30T16:59:37.074729+0000","last_active":"2024-05-30T16:59:37.083386+0000","last_peered":"2024-05-30T16:59:37.083386+0000","last_clean":"2024-05-30T16:59:37.083386+0000","last_became_active":"2024-05-30T16:59:37.074457+0000","last_became_peered":"2024-05-30T16:59:37.074457+0000","last_unstale":"2024-05-30T16:59:37.083386+0000","last_undegraded":"2024-05-30T16:59:37.083386+0000","last_fullsized":"2024-05-30T16:59:37.083386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:46:59.562379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097150+0000","last_change":"2024-05-30T16:59:37.090233+0000","last_active":"2024-05-30T16:59:37.097150+0000","last_peered":"2024-05-30T16:59:37.097150+0000","last_clean":"2024-05-30T16:59:37.097150+0000","last_became_active":"2024-05-30T16:59:37.088987+0000","last_became_peered":"2024-05-30T16:59:37.088987+0000","last_unstale":"2024-05-30T16:59:37.097150+0000","last_undegraded":"2024-05-30T16:59:37.097150+0000","last_fullsized":"2024-05-30T16:59:37.097150+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:37.960162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084344+0000","last_change":"2024-05-30T16:59:37.077683+0000","last_active":"2024-05-30T16:59:37.084344+0000","last_peered":"2024-05-30T16:59:37.084344+0000","last_clean":"2024-05-30T16:59:37.084344+0000","last_became_active":"2024-05-30T16:59:37.077380+0000","last_became_peered":"2024-05-30T16:59:37.077380+0000","last_unstale":"2024-05-30T16:59:37.084344+0000","last_undegraded":"2024-05-30T16:59:37.084344+0000","last_fullsized":"2024-05-30T16:59:37.084344+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:55.662497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093602+0000","last_change":"2024-05-30T16:59:37.088784+0000","last_active":"2024-05-30T16:59:37.093602+0000","last_peered":"2024-05-30T16:59:37.093602+0000","last_clean":"2024-05-30T16:59:37.093602+0000","last_became_active":"2024-05-30T16:59:37.088500+0000","last_became_peered":"2024-05-30T16:59:37.088500+0000","last_unstale":"2024-05-30T16:59:37.093602+0000","last_undegraded":"2024-05-30T16:59:37.093602+0000","last_fullsized":"2024-05-30T16:59:37.093602+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093833+0000","last_change":"2024-05-30T16:59:37.092667+0000","last_active":"2024-05-30T16:59:37.093833+0000","last_peered":"2024-05-30T16:59:37.093833+0000","last_clean":"2024-05-30T16:59:37.093833+0000","last_became_active":"2024-05-30T16:59:37.092305+0000","last_became_peered":"2024-05-30T16:59:37.092305+0000","last_unstale":"2024-05-30T16:59:37.093833+0000","last_undegraded":"2024-05-30T16:59:37.093833+0000","last_fullsized":"2024-05-30T16:59:37.093833+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:38.192437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"89'4","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097944+0000","last_change":"2024-05-30T16:59:36.079591+0000","last_active":"2024-05-30T16:59:37.097944+0000","last_peered":"2024-05-30T16:59:37.097944+0000","last_clean":"2024-05-30T16:59:37.097944+0000","last_became_active":"2024-05-30T16:59:36.079273+0000","last_became_peered":"2024-05-30T16:59:36.079273+0000","last_unstale":"2024-05-30T16:59:37.097944+0000","last_undegraded":"2024-05-30T16:59:37.097944+0000","last_fullsized":"2024-05-30T16:59:37.097944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:07.078092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.098140+0000","last_change":"2024-05-30T16:59:37.097479+0000","last_active":"2024-05-30T16:59:37.098140+0000","last_peered":"2024-05-30T16:59:37.098140+0000","last_clean":"2024-05-30T16:59:37.098140+0000","last_became_active":"2024-05-30T16:59:37.096852+0000","last_became_peered":"2024-05-30T16:59:37.096852+0000","last_unstale":"2024-05-30T16:59:37.098140+0000","last_undegraded":"2024-05-30T16:59:37.098140+0000","last_fullsized":"2024-05-30T16:59:37.098140+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:47.601590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094316+0000","last_change":"2024-05-30T16:59:36.081492+0000","last_active":"2024-05-30T16:59:37.094316+0000","last_peered":"2024-05-30T16:59:37.094316+0000","last_clean":"2024-05-30T16:59:37.094316+0000","last_became_active":"2024-05-30T16:59:36.081071+0000","last_became_peered":"2024-05-30T16:59:36.081071+0000","last_unstale":"2024-05-30T16:59:37.094316+0000","last_undegraded":"2024-05-30T16:59:37.094316+0000","last_fullsized":"2024-05-30T16:59:37.094316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:32.389864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.098693+0000","last_change":"2024-05-30T16:59:37.098058+0000","last_active":"2024-05-30T16:59:37.098693+0000","last_peered":"2024-05-30T16:59:37.098693+0000","last_clean":"2024-05-30T16:59:37.098693+0000","last_became_active":"2024-05-30T16:59:37.097708+0000","last_became_peered":"2024-05-30T16:59:37.097708+0000","last_unstale":"2024-05-30T16:59:37.098693+0000","last_undegraded":"2024-05-30T16:59:37.098693+0000","last_fullsized":"2024-05-30T16:59:37.098693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:57.044016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.091618+0000","last_change":"2024-05-30T16:59:36.084335+0000","last_active":"2024-05-30T16:59:37.091618+0000","last_peered":"2024-05-30T16:59:37.091618+0000","last_clean":"2024-05-30T16:59:37.091618+0000","last_became_active":"2024-05-30T16:59:36.083933+0000","last_became_peered":"2024-05-30T16:59:36.083933+0000","last_unstale":"2024-05-30T16:59:37.091618+0000","last_undegraded":"2024-05-30T16:59:37.091618+0000","last_fullsized":"2024-05-30T16:59:37.091618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:27:43.028647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.087183+0000","last_change":"2024-05-30T16:59:37.084018+0000","last_active":"2024-05-30T16:59:37.087183+0000","last_peered":"2024-05-30T16:59:37.087183+0000","last_clean":"2024-05-30T16:59:37.087183+0000","last_became_active":"2024-05-30T16:59:37.083711+0000","last_became_peered":"2024-05-30T16:59:37.083711+0000","last_unstale":"2024-05-30T16:59:37.087183+0000","last_undegraded":"2024-05-30T16:59:37.087183+0000","last_fullsized":"2024-05-30T16:59:37.087183+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:48.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095023+0000","last_change":"2024-05-30T16:59:36.081241+0000","last_active":"2024-05-30T16:59:37.095023+0000","last_peered":"2024-05-30T16:59:37.095023+0000","last_clean":"2024-05-30T16:59:37.095023+0000","last_became_active":"2024-05-30T16:59:36.080949+0000","last_became_peered":"2024-05-30T16:59:36.080949+0000","last_unstale":"2024-05-30T16:59:37.095023+0000","last_undegraded":"2024-05-30T16:59:37.095023+0000","last_fullsized":"2024-05-30T16:59:37.095023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:37.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093990+0000","last_change":"2024-05-30T16:59:37.085898+0000","last_active":"2024-05-30T16:59:37.093990+0000","last_peered":"2024-05-30T16:59:37.093990+0000","last_clean":"2024-05-30T16:59:37.093990+0000","last_became_active":"2024-05-30T16:59:37.081928+0000","last_became_peered":"2024-05-30T16:59:37.081928+0000","last_unstale":"2024-05-30T16:59:37.093990+0000","last_undegraded":"2024-05-30T16:59:37.093990+0000","last_fullsized":"2024-05-30T16:59:37.093990+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:08:05.904777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095229+0000","last_change":"2024-05-30T16:59:36.086610+0000","last_active":"2024-05-30T16:59:37.095229+0000","last_peered":"2024-05-30T16:59:37.095229+0000","last_clean":"2024-05-30T16:59:37.095229+0000","last_became_active":"2024-05-30T16:59:36.086428+0000","last_became_peered":"2024-05-30T16:59:36.086428+0000","last_unstale":"2024-05-30T16:59:37.095229+0000","last_undegraded":"2024-05-30T16:59:37.095229+0000","last_fullsized":"2024-05-30T16:59:37.095229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:36:36.936609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089285+0000","last_change":"2024-05-30T16:59:37.086396+0000","last_active":"2024-05-30T16:59:37.089285+0000","last_peered":"2024-05-30T16:59:37.089285+0000","last_clean":"2024-05-30T16:59:37.089285+0000","last_became_active":"2024-05-30T16:59:37.086095+0000","last_became_peered":"2024-05-30T16:59:37.086095+0000","last_unstale":"2024-05-30T16:59:37.089285+0000","last_undegraded":"2024-05-30T16:59:37.089285+0000","last_fullsized":"2024-05-30T16:59:37.089285+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:33.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094358+0000","last_change":"2024-05-30T16:59:36.082645+0000","last_active":"2024-05-30T16:59:37.094358+0000","last_peered":"2024-05-30T16:59:37.094358+0000","last_clean":"2024-05-30T16:59:37.094358+0000","last_became_active":"2024-05-30T16:59:36.082380+0000","last_became_peered":"2024-05-30T16:59:36.082380+0000","last_unstale":"2024-05-30T16:59:37.094358+0000","last_undegraded":"2024-05-30T16:59:37.094358+0000","last_fullsized":"2024-05-30T16:59:37.094358+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:09.218872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094539+0000","last_change":"2024-05-30T16:59:37.092211+0000","last_active":"2024-05-30T16:59:37.094539+0000","last_peered":"2024-05-30T16:59:37.094539+0000","last_clean":"2024-05-30T16:59:37.094539+0000","last_became_active":"2024-05-30T16:59:37.091725+0000","last_became_peered":"2024-05-30T16:59:37.091725+0000","last_unstale":"2024-05-30T16:59:37.094539+0000","last_undegraded":"2024-05-30T16:59:37.094539+0000","last_fullsized":"2024-05-30T16:59:37.094539+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:04.577990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.070984+0000","last_change":"2024-05-30T16:59:36.072167+0000","last_active":"2024-05-30T16:59:37.070984+0000","last_peered":"2024-05-30T16:59:37.070984+0000","last_clean":"2024-05-30T16:59:37.070984+0000","last_became_active":"2024-05-30T16:59:36.071855+0000","last_became_peered":"2024-05-30T16:59:36.071855+0000","last_unstale":"2024-05-30T16:59:37.070984+0000","last_undegraded":"2024-05-30T16:59:37.070984+0000","last_fullsized":"2024-05-30T16:59:37.070984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:56.040644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2024-05-30T16:59:36.073664+0000","last_change":"2024-05-30T16:59:36.073664+0000","last_active":"2024-05-30T16:59:36.046240+0000","last_peered":"2024-05-30T16:59:36.046240+0000","last_clean":"2024-05-30T16:59:36.046240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:59:36.073664+0000","last_undegraded":"2024-05-30T16:59:36.073664+0000","last_fullsized":"2024-05-30T16:59:36.073664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.079726+0000","last_change":"2024-05-30T16:59:36.075847+0000","last_active":"2024-05-30T16:59:37.079726+0000","last_peered":"2024-05-30T16:59:37.079726+0000","last_clean":"2024-05-30T16:59:37.079726+0000","last_became_active":"2024-05-30T16:59:36.075436+0000","last_became_peered":"2024-05-30T16:59:36.075436+0000","last_unstale":"2024-05-30T16:59:37.079726+0000","last_undegraded":"2024-05-30T16:59:37.079726+0000","last_fullsized":"2024-05-30T16:59:37.079726+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:33.420123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2024-05-30T16:59:36.067175+0000","last_change":"2024-05-30T16:59:36.067175+0000","last_active":"2024-05-30T16:59:36.046240+0000","last_peered":"2024-05-30T16:59:36.046240+0000","last_clean":"2024-05-30T16:59:36.046240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:59:36.067175+0000","last_undegraded":"2024-05-30T16:59:36.067175+0000","last_fullsized":"2024-05-30T16:59:36.067175+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.075354+0000","last_change":"2024-05-30T16:59:36.084230+0000","last_active":"2024-05-30T16:59:37.075354+0000","last_peered":"2024-05-30T16:59:37.075354+0000","last_clean":"2024-05-30T16:59:37.075354+0000","last_became_active":"2024-05-30T16:59:36.083951+0000","last_became_peered":"2024-05-30T16:59:36.083951+0000","last_unstale":"2024-05-30T16:59:37.075354+0000","last_undegraded":"2024-05-30T16:59:37.075354+0000","last_fullsized":"2024-05-30T16:59:37.075354+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:05.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.074719+0000","last_change":"2024-05-30T16:59:37.072293+0000","last_active":"2024-05-30T16:59:37.074719+0000","last_peered":"2024-05-30T16:59:37.074719+0000","last_clean":"2024-05-30T16:59:37.074719+0000","last_became_active":"2024-05-30T16:59:37.068848+0000","last_became_peered":"2024-05-30T16:59:37.068848+0000","last_unstale":"2024-05-30T16:59:37.074719+0000","last_undegraded":"2024-05-30T16:59:37.074719+0000","last_fullsized":"2024-05-30T16:59:37.074719+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:14:10.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.081030+0000","last_change":"2024-05-30T16:59:36.076816+0000","last_active":"2024-05-30T16:59:37.081030+0000","last_peered":"2024-05-30T16:59:37.081030+0000","last_clean":"2024-05-30T16:59:37.081030+0000","last_became_active":"2024-05-30T16:59:36.076449+0000","last_became_peered":"2024-05-30T16:59:36.076449+0000","last_unstale":"2024-05-30T16:59:37.081030+0000","last_undegraded":"2024-05-30T16:59:37.081030+0000","last_fullsized":"2024-05-30T16:59:37.081030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:36:36.936609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096917+0000","last_change":"2024-05-30T16:59:37.094548+0000","last_active":"2024-05-30T16:59:37.096917+0000","last_peered":"2024-05-30T16:59:37.096917+0000","last_clean":"2024-05-30T16:59:37.096917+0000","last_became_active":"2024-05-30T16:59:37.094267+0000","last_became_peered":"2024-05-30T16:59:37.094267+0000","last_unstale":"2024-05-30T16:59:37.096917+0000","last_undegraded":"2024-05-30T16:59:37.096917+0000","last_fullsized":"2024-05-30T16:59:37.096917+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:54.042211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"89'3","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.099318+0000","last_change":"2024-05-30T16:59:36.083663+0000","last_active":"2024-05-30T16:59:37.099318+0000","last_peered":"2024-05-30T16:59:37.099318+0000","last_clean":"2024-05-30T16:59:37.099318+0000","last_became_active":"2024-05-30T16:59:36.083370+0000","last_became_peered":"2024-05-30T16:59:36.083370+0000","last_unstale":"2024-05-30T16:59:37.099318+0000","last_undegraded":"2024-05-30T16:59:37.099318+0000","last_fullsized":"2024-05-30T16:59:37.099318+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:47:12.815654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089450+0000","last_change":"2024-05-30T16:59:37.087703+0000","last_active":"2024-05-30T16:59:37.089450+0000","last_peered":"2024-05-30T16:59:37.089450+0000","last_clean":"2024-05-30T16:59:37.089450+0000","last_became_active":"2024-05-30T16:59:37.087368+0000","last_became_peered":"2024-05-30T16:59:37.087368+0000","last_unstale":"2024-05-30T16:59:37.089450+0000","last_undegraded":"2024-05-30T16:59:37.089450+0000","last_fullsized":"2024-05-30T16:59:37.089450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:57.044016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"89'6","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.099682+0000","last_change":"2024-05-30T16:59:36.066172+0000","last_active":"2024-05-30T16:59:37.099682+0000","last_peered":"2024-05-30T16:59:37.099682+0000","last_clean":"2024-05-30T16:59:37.099682+0000","last_became_active":"2024-05-30T16:59:36.064294+0000","last_became_peered":"2024-05-30T16:59:36.064294+0000","last_unstale":"2024-05-30T16:59:37.099682+0000","last_undegraded":"2024-05-30T16:59:37.099682+0000","last_fullsized":"2024-05-30T16:59:37.099682+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:17.835411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089850+0000","last_change":"2024-05-30T16:59:37.084517+0000","last_active":"2024-05-30T16:59:37.089850+0000","last_peered":"2024-05-30T16:59:37.089850+0000","last_clean":"2024-05-30T16:59:37.089850+0000","last_became_active":"2024-05-30T16:59:37.084243+0000","last_became_peered":"2024-05-30T16:59:37.084243+0000","last_unstale":"2024-05-30T16:59:37.089850+0000","last_undegraded":"2024-05-30T16:59:37.089850+0000","last_fullsized":"2024-05-30T16:59:37.089850+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:16:00.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.098352+0000","last_change":"2024-05-30T16:59:36.074867+0000","last_active":"2024-05-30T16:59:37.098352+0000","last_peered":"2024-05-30T16:59:37.098352+0000","last_clean":"2024-05-30T16:59:37.098352+0000","last_became_active":"2024-05-30T16:59:36.074584+0000","last_became_peered":"2024-05-30T16:59:36.074584+0000","last_unstale":"2024-05-30T16:59:37.098352+0000","last_undegraded":"2024-05-30T16:59:37.098352+0000","last_fullsized":"2024-05-30T16:59:37.098352+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:04:38.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096872+0000","last_change":"2024-05-30T16:59:37.094928+0000","last_active":"2024-05-30T16:59:37.096872+0000","last_peered":"2024-05-30T16:59:37.096872+0000","last_clean":"2024-05-30T16:59:37.096872+0000","last_became_active":"2024-05-30T16:59:37.094508+0000","last_became_peered":"2024-05-30T16:59:37.094508+0000","last_unstale":"2024-05-30T16:59:37.096872+0000","last_undegraded":"2024-05-30T16:59:37.096872+0000","last_fullsized":"2024-05-30T16:59:37.096872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:19:38.753995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T16:59:36.074268+0000","last_change":"2024-05-30T16:59:36.072195+0000","last_active":"2024-05-30T16:59:36.074268+0000","last_peered":"2024-05-30T16:59:36.074268+0000","last_clean":"2024-05-30T16:59:36.074268+0000","last_became_active":"2024-05-30T16:59:36.071318+0000","last_became_peered":"2024-05-30T16:59:36.071318+0000","last_unstale":"2024-05-30T16:59:36.074268+0000","last_undegraded":"2024-05-30T16:59:36.074268+0000","last_fullsized":"2024-05-30T16:59:36.074268+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:53:57.101832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.094882+0000","last_change":"2024-05-30T16:59:37.085652+0000","last_active":"2024-05-30T16:59:37.094882+0000","last_peered":"2024-05-30T16:59:37.094882+0000","last_clean":"2024-05-30T16:59:37.094882+0000","last_became_active":"2024-05-30T16:59:37.085321+0000","last_became_peered":"2024-05-30T16:59:37.085321+0000","last_unstale":"2024-05-30T16:59:37.094882+0000","last_undegraded":"2024-05-30T16:59:37.094882+0000","last_fullsized":"2024-05-30T16:59:37.094882+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:26:37.459231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.065802+0000","last_change":"2024-05-30T16:59:36.073851+0000","last_active":"2024-05-30T16:59:37.065802+0000","last_peered":"2024-05-30T16:59:37.065802+0000","last_clean":"2024-05-30T16:59:37.065802+0000","last_became_active":"2024-05-30T16:59:36.073504+0000","last_became_peered":"2024-05-30T16:59:36.073504+0000","last_unstale":"2024-05-30T16:59:37.065802+0000","last_undegraded":"2024-05-30T16:59:37.065802+0000","last_fullsized":"2024-05-30T16:59:37.065802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:27.344000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097633+0000","last_change":"2024-05-30T16:59:37.090890+0000","last_active":"2024-05-30T16:59:37.097633+0000","last_peered":"2024-05-30T16:59:37.097633+0000","last_clean":"2024-05-30T16:59:37.097633+0000","last_became_active":"2024-05-30T16:59:37.090646+0000","last_became_peered":"2024-05-30T16:59:37.090646+0000","last_unstale":"2024-05-30T16:59:37.097633+0000","last_undegraded":"2024-05-30T16:59:37.097633+0000","last_fullsized":"2024-05-30T16:59:37.097633+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:59.217253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"89'8","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093819+0000","last_change":"2024-05-30T16:59:36.071455+0000","last_active":"2024-05-30T16:59:37.093819+0000","last_peered":"2024-05-30T16:59:37.093819+0000","last_clean":"2024-05-30T16:59:37.093819+0000","last_became_active":"2024-05-30T16:59:36.071143+0000","last_became_peered":"2024-05-30T16:59:36.071143+0000","last_unstale":"2024-05-30T16:59:37.093819+0000","last_undegraded":"2024-05-30T16:59:37.093819+0000","last_fullsized":"2024-05-30T16:59:37.093819+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:52.348518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088349+0000","last_change":"2024-05-30T16:59:37.085772+0000","last_active":"2024-05-30T16:59:37.088349+0000","last_peered":"2024-05-30T16:59:37.088349+0000","last_clean":"2024-05-30T16:59:37.088349+0000","last_became_active":"2024-05-30T16:59:37.085494+0000","last_became_peered":"2024-05-30T16:59:37.085494+0000","last_unstale":"2024-05-30T16:59:37.088349+0000","last_undegraded":"2024-05-30T16:59:37.088349+0000","last_fullsized":"2024-05-30T16:59:37.088349+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:42:21.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093379+0000","last_change":"2024-05-30T16:59:36.071418+0000","last_active":"2024-05-30T16:59:37.093379+0000","last_peered":"2024-05-30T16:59:37.093379+0000","last_clean":"2024-05-30T16:59:37.093379+0000","last_became_active":"2024-05-30T16:59:36.070404+0000","last_became_peered":"2024-05-30T16:59:36.070404+0000","last_unstale":"2024-05-30T16:59:37.093379+0000","last_undegraded":"2024-05-30T16:59:37.093379+0000","last_fullsized":"2024-05-30T16:59:37.093379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:09.218872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.093476+0000","last_change":"2024-05-30T16:59:37.088772+0000","last_active":"2024-05-30T16:59:37.093476+0000","last_peered":"2024-05-30T16:59:37.093476+0000","last_clean":"2024-05-30T16:59:37.093476+0000","last_became_active":"2024-05-30T16:59:37.088489+0000","last_became_peered":"2024-05-30T16:59:37.088489+0000","last_unstale":"2024-05-30T16:59:37.093476+0000","last_undegraded":"2024-05-30T16:59:37.093476+0000","last_fullsized":"2024-05-30T16:59:37.093476+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:33.393237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.096457+0000","last_change":"2024-05-30T16:59:36.077558+0000","last_active":"2024-05-30T16:59:37.096457+0000","last_peered":"2024-05-30T16:59:37.096457+0000","last_clean":"2024-05-30T16:59:37.096457+0000","last_became_active":"2024-05-30T16:59:36.076835+0000","last_became_peered":"2024-05-30T16:59:36.076835+0000","last_unstale":"2024-05-30T16:59:37.096457+0000","last_undegraded":"2024-05-30T16:59:37.096457+0000","last_fullsized":"2024-05-30T16:59:37.096457+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:59.947220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.088396+0000","last_change":"2024-05-30T16:59:37.085771+0000","last_active":"2024-05-30T16:59:37.088396+0000","last_peered":"2024-05-30T16:59:37.088396+0000","last_clean":"2024-05-30T16:59:37.088396+0000","last_became_active":"2024-05-30T16:59:37.085475+0000","last_became_peered":"2024-05-30T16:59:37.085475+0000","last_unstale":"2024-05-30T16:59:37.088396+0000","last_undegraded":"2024-05-30T16:59:37.088396+0000","last_fullsized":"2024-05-30T16:59:37.088396+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:14:10.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.072496+0000","last_change":"2024-05-30T16:59:36.073081+0000","last_active":"2024-05-30T16:59:37.072496+0000","last_peered":"2024-05-30T16:59:37.072496+0000","last_clean":"2024-05-30T16:59:37.072496+0000","last_became_active":"2024-05-30T16:59:36.072483+0000","last_became_peered":"2024-05-30T16:59:36.072483+0000","last_unstale":"2024-05-30T16:59:37.072496+0000","last_undegraded":"2024-05-30T16:59:37.072496+0000","last_fullsized":"2024-05-30T16:59:37.072496+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:31:23.944400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.085095+0000","last_change":"2024-05-30T16:59:37.082050+0000","last_active":"2024-05-30T16:59:37.085095+0000","last_peered":"2024-05-30T16:59:37.085095+0000","last_clean":"2024-05-30T16:59:37.085095+0000","last_became_active":"2024-05-30T16:59:37.081747+0000","last_became_peered":"2024-05-30T16:59:37.081747+0000","last_unstale":"2024-05-30T16:59:37.085095+0000","last_undegraded":"2024-05-30T16:59:37.085095+0000","last_fullsized":"2024-05-30T16:59:37.085095+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:04:39.484172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T16:59:36.073762+0000","last_change":"2024-05-30T16:59:36.070012+0000","last_active":"2024-05-30T16:59:36.073762+0000","last_peered":"2024-05-30T16:59:36.073762+0000","last_clean":"2024-05-30T16:59:36.073762+0000","last_became_active":"2024-05-30T16:59:36.069700+0000","last_became_peered":"2024-05-30T16:59:36.069700+0000","last_unstale":"2024-05-30T16:59:36.073762+0000","last_undegraded":"2024-05-30T16:59:36.073762+0000","last_fullsized":"2024-05-30T16:59:36.073762+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:51.443117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.075876+0000","last_change":"2024-05-30T16:59:37.072799+0000","last_active":"2024-05-30T16:59:37.075876+0000","last_peered":"2024-05-30T16:59:37.075876+0000","last_clean":"2024-05-30T16:59:37.075876+0000","last_became_active":"2024-05-30T16:59:37.072459+0000","last_became_peered":"2024-05-30T16:59:37.072459+0000","last_unstale":"2024-05-30T16:59:37.075876+0000","last_undegraded":"2024-05-30T16:59:37.075876+0000","last_fullsized":"2024-05-30T16:59:37.075876+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:33.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.061601+0000","last_change":"2024-05-30T16:59:36.078703+0000","last_active":"2024-05-30T16:59:37.061601+0000","last_peered":"2024-05-30T16:59:37.061601+0000","last_clean":"2024-05-30T16:59:37.061601+0000","last_became_active":"2024-05-30T16:59:36.078388+0000","last_became_peered":"2024-05-30T16:59:36.078388+0000","last_unstale":"2024-05-30T16:59:37.061601+0000","last_undegraded":"2024-05-30T16:59:37.061601+0000","last_fullsized":"2024-05-30T16:59:37.061601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:33.197739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.067732+0000","last_change":"2024-05-30T16:59:37.065490+0000","last_active":"2024-05-30T16:59:37.067732+0000","last_peered":"2024-05-30T16:59:37.067732+0000","last_clean":"2024-05-30T16:59:37.067732+0000","last_became_active":"2024-05-30T16:59:37.065012+0000","last_became_peered":"2024-05-30T16:59:37.065012+0000","last_unstale":"2024-05-30T16:59:37.067732+0000","last_undegraded":"2024-05-30T16:59:37.067732+0000","last_fullsized":"2024-05-30T16:59:37.067732+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:28:28.070278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.059802+0000","last_change":"2024-05-30T16:59:36.073987+0000","last_active":"2024-05-30T16:59:37.059802+0000","last_peered":"2024-05-30T16:59:37.059802+0000","last_clean":"2024-05-30T16:59:37.059802+0000","last_became_active":"2024-05-30T16:59:36.073682+0000","last_became_peered":"2024-05-30T16:59:36.073682+0000","last_unstale":"2024-05-30T16:59:37.059802+0000","last_undegraded":"2024-05-30T16:59:37.059802+0000","last_fullsized":"2024-05-30T16:59:37.059802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:04:12.123572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.086046+0000","last_change":"2024-05-30T16:59:37.077255+0000","last_active":"2024-05-30T16:59:37.086046+0000","last_peered":"2024-05-30T16:59:37.086046+0000","last_clean":"2024-05-30T16:59:37.086046+0000","last_became_active":"2024-05-30T16:59:37.075699+0000","last_became_peered":"2024-05-30T16:59:37.075699+0000","last_unstale":"2024-05-30T16:59:37.086046+0000","last_undegraded":"2024-05-30T16:59:37.086046+0000","last_fullsized":"2024-05-30T16:59:37.086046+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:57.044016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T16:59:36.077906+0000","last_change":"2024-05-30T16:59:36.071359+0000","last_active":"2024-05-30T16:59:36.077906+0000","last_peered":"2024-05-30T16:59:36.077906+0000","last_clean":"2024-05-30T16:59:36.077906+0000","last_became_active":"2024-05-30T16:59:36.071068+0000","last_became_peered":"2024-05-30T16:59:36.071068+0000","last_unstale":"2024-05-30T16:59:36.077906+0000","last_undegraded":"2024-05-30T16:59:36.077906+0000","last_fullsized":"2024-05-30T16:59:36.077906+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:43:41.566821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084429+0000","last_change":"2024-05-30T16:59:37.079547+0000","last_active":"2024-05-30T16:59:37.084429+0000","last_peered":"2024-05-30T16:59:37.084429+0000","last_clean":"2024-05-30T16:59:37.084429+0000","last_became_active":"2024-05-30T16:59:37.077473+0000","last_became_peered":"2024-05-30T16:59:37.077473+0000","last_unstale":"2024-05-30T16:59:37.084429+0000","last_undegraded":"2024-05-30T16:59:37.084429+0000","last_fullsized":"2024-05-30T16:59:37.084429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:28.347373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"89'2","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.091656+0000","last_change":"2024-05-30T16:59:36.067314+0000","last_active":"2024-05-30T16:59:37.091656+0000","last_peered":"2024-05-30T16:59:37.091656+0000","last_clean":"2024-05-30T16:59:37.091656+0000","last_became_active":"2024-05-30T16:59:36.064171+0000","last_became_peered":"2024-05-30T16:59:36.064171+0000","last_unstale":"2024-05-30T16:59:37.091656+0000","last_undegraded":"2024-05-30T16:59:37.091656+0000","last_fullsized":"2024-05-30T16:59:37.091656+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:25.960596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095957+0000","last_change":"2024-05-30T16:59:37.093784+0000","last_active":"2024-05-30T16:59:37.095957+0000","last_peered":"2024-05-30T16:59:37.095957+0000","last_clean":"2024-05-30T16:59:37.095957+0000","last_became_active":"2024-05-30T16:59:37.093464+0000","last_became_peered":"2024-05-30T16:59:37.093464+0000","last_unstale":"2024-05-30T16:59:37.095957+0000","last_undegraded":"2024-05-30T16:59:37.095957+0000","last_fullsized":"2024-05-30T16:59:37.095957+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:51:51.208985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.082133+0000","last_change":"2024-05-30T16:59:36.075907+0000","last_active":"2024-05-30T16:59:37.082133+0000","last_peered":"2024-05-30T16:59:37.082133+0000","last_clean":"2024-05-30T16:59:37.082133+0000","last_became_active":"2024-05-30T16:59:36.075639+0000","last_became_peered":"2024-05-30T16:59:36.075639+0000","last_unstale":"2024-05-30T16:59:37.082133+0000","last_undegraded":"2024-05-30T16:59:37.082133+0000","last_fullsized":"2024-05-30T16:59:37.082133+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:11.419133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.097395+0000","last_change":"2024-05-30T16:59:37.095753+0000","last_active":"2024-05-30T16:59:37.097395+0000","last_peered":"2024-05-30T16:59:37.097395+0000","last_clean":"2024-05-30T16:59:37.097395+0000","last_became_active":"2024-05-30T16:59:37.095191+0000","last_became_peered":"2024-05-30T16:59:37.095191+0000","last_unstale":"2024-05-30T16:59:37.097395+0000","last_undegraded":"2024-05-30T16:59:37.097395+0000","last_fullsized":"2024-05-30T16:59:37.097395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:21:33.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.068327+0000","last_change":"2024-05-30T16:59:36.079587+0000","last_active":"2024-05-30T16:59:37.068327+0000","last_peered":"2024-05-30T16:59:37.068327+0000","last_clean":"2024-05-30T16:59:37.068327+0000","last_became_active":"2024-05-30T16:59:36.079306+0000","last_became_peered":"2024-05-30T16:59:36.079306+0000","last_unstale":"2024-05-30T16:59:37.068327+0000","last_undegraded":"2024-05-30T16:59:37.068327+0000","last_fullsized":"2024-05-30T16:59:37.068327+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:41:30.701806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.089429+0000","last_change":"2024-05-30T16:59:37.087073+0000","last_active":"2024-05-30T16:59:37.089429+0000","last_peered":"2024-05-30T16:59:37.089429+0000","last_clean":"2024-05-30T16:59:37.089429+0000","last_became_active":"2024-05-30T16:59:37.086784+0000","last_became_peered":"2024-05-30T16:59:37.086784+0000","last_unstale":"2024-05-30T16:59:37.089429+0000","last_undegraded":"2024-05-30T16:59:37.089429+0000","last_fullsized":"2024-05-30T16:59:37.089429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:47.601590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.073399+0000","last_change":"2024-05-30T16:59:36.078081+0000","last_active":"2024-05-30T16:59:37.073399+0000","last_peered":"2024-05-30T16:59:37.073399+0000","last_clean":"2024-05-30T16:59:37.073399+0000","last_became_active":"2024-05-30T16:59:36.077822+0000","last_became_peered":"2024-05-30T16:59:36.077822+0000","last_unstale":"2024-05-30T16:59:37.073399+0000","last_undegraded":"2024-05-30T16:59:37.073399+0000","last_fullsized":"2024-05-30T16:59:37.073399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:45:07.805901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.076430+0000","last_change":"2024-05-30T16:59:37.073176+0000","last_active":"2024-05-30T16:59:37.076430+0000","last_peered":"2024-05-30T16:59:37.076430+0000","last_clean":"2024-05-30T16:59:37.076430+0000","last_became_active":"2024-05-30T16:59:37.072705+0000","last_became_peered":"2024-05-30T16:59:37.072705+0000","last_unstale":"2024-05-30T16:59:37.076430+0000","last_undegraded":"2024-05-30T16:59:37.076430+0000","last_fullsized":"2024-05-30T16:59:37.076430+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:47.601590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.071282+0000","last_change":"2024-05-30T16:59:36.072434+0000","last_active":"2024-05-30T16:59:37.071282+0000","last_peered":"2024-05-30T16:59:37.071282+0000","last_clean":"2024-05-30T16:59:37.071282+0000","last_became_active":"2024-05-30T16:59:36.072080+0000","last_became_peered":"2024-05-30T16:59:36.072080+0000","last_unstale":"2024-05-30T16:59:37.071282+0000","last_undegraded":"2024-05-30T16:59:37.071282+0000","last_fullsized":"2024-05-30T16:59:37.071282+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:08.828492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.091200+0000","last_change":"2024-05-30T16:59:37.084414+0000","last_active":"2024-05-30T16:59:37.091200+0000","last_peered":"2024-05-30T16:59:37.091200+0000","last_clean":"2024-05-30T16:59:37.091200+0000","last_became_active":"2024-05-30T16:59:37.084136+0000","last_became_peered":"2024-05-30T16:59:37.084136+0000","last_unstale":"2024-05-30T16:59:37.091200+0000","last_undegraded":"2024-05-30T16:59:37.091200+0000","last_fullsized":"2024-05-30T16:59:37.091200+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:59:27.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.071319+0000","last_change":"2024-05-30T16:59:36.081362+0000","last_active":"2024-05-30T16:59:37.071319+0000","last_peered":"2024-05-30T16:59:37.071319+0000","last_clean":"2024-05-30T16:59:37.071319+0000","last_became_active":"2024-05-30T16:59:36.081053+0000","last_became_peered":"2024-05-30T16:59:36.081053+0000","last_unstale":"2024-05-30T16:59:37.071319+0000","last_undegraded":"2024-05-30T16:59:37.071319+0000","last_fullsized":"2024-05-30T16:59:37.071319+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:07.006990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.084295+0000","last_change":"2024-05-30T16:59:37.082149+0000","last_active":"2024-05-30T16:59:37.084295+0000","last_peered":"2024-05-30T16:59:37.084295+0000","last_clean":"2024-05-30T16:59:37.084295+0000","last_became_active":"2024-05-30T16:59:37.081871+0000","last_became_peered":"2024-05-30T16:59:37.081871+0000","last_unstale":"2024-05-30T16:59:37.084295+0000","last_undegraded":"2024-05-30T16:59:37.084295+0000","last_fullsized":"2024-05-30T16:59:37.084295+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:21:31.814977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.070746+0000","last_change":"2024-05-30T16:59:36.082150+0000","last_active":"2024-05-30T16:59:37.070746+0000","last_peered":"2024-05-30T16:59:37.070746+0000","last_clean":"2024-05-30T16:59:37.070746+0000","last_became_active":"2024-05-30T16:59:36.081808+0000","last_became_peered":"2024-05-30T16:59:36.081808+0000","last_unstale":"2024-05-30T16:59:37.070746+0000","last_undegraded":"2024-05-30T16:59:37.070746+0000","last_fullsized":"2024-05-30T16:59:37.070746+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:10:14.175340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.092890+0000","last_change":"2024-05-30T16:59:37.086355+0000","last_active":"2024-05-30T16:59:37.092890+0000","last_peered":"2024-05-30T16:59:37.092890+0000","last_clean":"2024-05-30T16:59:37.092890+0000","last_became_active":"2024-05-30T16:59:37.085922+0000","last_became_peered":"2024-05-30T16:59:37.085922+0000","last_unstale":"2024-05-30T16:59:37.092890+0000","last_undegraded":"2024-05-30T16:59:37.092890+0000","last_fullsized":"2024-05-30T16:59:37.092890+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:08.010363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.070751+0000","last_change":"2024-05-30T16:59:36.078616+0000","last_active":"2024-05-30T16:59:37.070751+0000","last_peered":"2024-05-30T16:59:37.070751+0000","last_clean":"2024-05-30T16:59:37.070751+0000","last_became_active":"2024-05-30T16:59:36.078225+0000","last_became_peered":"2024-05-30T16:59:36.078225+0000","last_unstale":"2024-05-30T16:59:37.070751+0000","last_undegraded":"2024-05-30T16:59:37.070751+0000","last_fullsized":"2024-05-30T16:59:37.070751+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:05.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.081879+0000","last_change":"2024-05-30T16:59:37.077457+0000","last_active":"2024-05-30T16:59:37.081879+0000","last_peered":"2024-05-30T16:59:37.081879+0000","last_clean":"2024-05-30T16:59:37.081879+0000","last_became_active":"2024-05-30T16:59:37.077159+0000","last_became_peered":"2024-05-30T16:59:37.077159+0000","last_unstale":"2024-05-30T16:59:37.081879+0000","last_undegraded":"2024-05-30T16:59:37.081879+0000","last_fullsized":"2024-05-30T16:59:37.081879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:47.461836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.095777+0000","last_change":"2024-05-30T16:59:36.075731+0000","last_active":"2024-05-30T16:59:37.095777+0000","last_peered":"2024-05-30T16:59:37.095777+0000","last_clean":"2024-05-30T16:59:37.095777+0000","last_became_active":"2024-05-30T16:59:36.075265+0000","last_became_peered":"2024-05-30T16:59:36.075265+0000","last_unstale":"2024-05-30T16:59:37.095777+0000","last_undegraded":"2024-05-30T16:59:37.095777+0000","last_fullsized":"2024-05-30T16:59:37.095777+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:53.038839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":299,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-30T16:59:37.071688+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:59:37.071688+0000","last_peered":"2024-05-30T16:59:37.071688+0000","last_clean":"2024-05-30T16:59:37.071688+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:59:37.071688+0000","last_undegraded":"2024-05-30T16:59:37.071688+0000","last_fullsized":"2024-05-30T16:59:37.071688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509571,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100800,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271040,"statfs":{"total":96636764160,"available":96533544960,"internally_reserved":0,"allocated":1683456,"data_stored":1056337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101513674},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118248,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253592,"statfs":{"total":96636764160,"available":96515678208,"internally_reserved":0,"allocated":1073152,"data_stored":459040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509572,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72424,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299416,"statfs":{"total":96636764160,"available":96562601984,"internally_reserved":0,"allocated":1073152,"data_stored":459040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509573,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76592,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295248,"statfs":{"total":96636764160,"available":96558333952,"internally_reserved":0,"allocated":1085440,"data_stored":465899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509572,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100220,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271620,"statfs":{"total":96636764160,"available":96534138880,"internally_reserved":0,"allocated":1089536,"data_stored":466481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509572,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82152,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94289688,"statfs":{"total":96636764160,"available":96552640512,"internally_reserved":0,"allocated":1073152,"data_stored":459040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509572,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77176,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294664,"statfs":{"total":96636764160,"available":96557735936,"internally_reserved":0,"allocated":1683456,"data_stored":1056301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122400,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249440,"statfs":{"total":96636764160,"available":96511426560,"internally_reserved":0,"allocated":1060864,"data_stored":452681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:59:45.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:59:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.932+0000 7efdbc000640 1 Processor -- start 2024-05-30T16:59:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.932+0000 7efdbc000640 1 -- start start 2024-05-30T16:59:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.932+0000 7efdbc000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efdb40ad8c0 0x7efdb415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.932+0000 7efdbc000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb415d730 con 0x7efdb415a1d0 2024-05-30T16:59:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.932+0000 7efdbc000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb40b3370 con 0x7efdb4159df0 2024-05-30T16:59:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.932+0000 7efdbc000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7efdb40b3650 con 0x7efdb40ad8c0 2024-05-30T16:59:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.936+0000 7efdba000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efdb415a1d0 0x7efdb415db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51502/0 (socket says 172.21.15.59:51502) 2024-05-30T16:59:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.936+0000 7efdba000640 1 -- 172.21.15.59:0/2349991658 learned_addr learned my addr 172.21.15.59:0/2349991658 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.936+0000 7efdb8c00640 1 --2- 172.21.15.59:0/2349991658 >> v2:172.21.15.107:3300/0 conn(0x7efdb40ad8c0 0x7efdb415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.936+0000 7efdb3e00640 1 -- 172.21.15.59:0/2349991658 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 219369354 0 0) 0x7efdb415d730 con 0x7efdb415a1d0 2024-05-30T16:59:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.936+0000 7efdb3e00640 1 -- 172.21.15.59:0/2349991658 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd9c003530 con 0x7efdb415a1d0 2024-05-30T16:59:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.936+0000 7efdb3e00640 1 -- 172.21.15.59:0/2349991658 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 371327375 0 0) 0x7efd9c003530 con 0x7efdb415a1d0 2024-05-30T16:59:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.936+0000 7efdb8c00640 1 -- 172.21.15.59:0/2349991658 >> v1:172.21.15.107:6789/0 conn(0x7efdb4159df0 legacy=0x7efdb40ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.936+0000 7efdb8c00640 1 -- 172.21.15.59:0/2349991658 >> v1:172.21.15.59:6789/0 conn(0x7efdb415a1d0 legacy=0x7efdb415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.936+0000 7efdb8c00640 1 -- 172.21.15.59:0/2349991658 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb40b3930 con 0x7efdb40ad8c0 2024-05-30T16:59:45.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.936+0000 7efdb8c00640 1 --2- 172.21.15.59:0/2349991658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb40ad8c0 0x7efdb415ca70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efda00097c0 tx=0x7efda001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f7bef6305558c66 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:45.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdb3e00640 1 -- 172.21.15.59:0/2349991658 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda00b0070 con 0x7efdb40ad8c0 2024-05-30T16:59:45.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdb3e00640 1 -- 172.21.15.59:0/2349991658 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda00ab400 con 0x7efdb40ad8c0 2024-05-30T16:59:45.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdb3e00640 1 -- 172.21.15.59:0/2349991658 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac001a00 con 0x7efdb40ad8c0 2024-05-30T16:59:45.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 -- 172.21.15.59:0/2349991658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb40ad8c0 msgr2=0x7efdb415ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:45.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 --2- 172.21.15.59:0/2349991658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb40ad8c0 0x7efdb415ca70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efda00097c0 tx=0x7efda001c3c0 comp rx=0 tx=0).stop 2024-05-30T16:59:45.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 -- 172.21.15.59:0/2349991658 shutdown_connections 2024-05-30T16:59:45.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 --2- 172.21.15.59:0/2349991658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb40ad8c0 0x7efdb415ca70 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:45.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 -- 172.21.15.59:0/2349991658 >> 172.21.15.59:0/2349991658 conn(0x7efdb40b22d0 msgr2=0x7efdb40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:45.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 -- 172.21.15.59:0/2349991658 shutdown_connections 2024-05-30T16:59:45.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 -- 172.21.15.59:0/2349991658 wait complete. 2024-05-30T16:59:45.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 Processor -- start 2024-05-30T16:59:45.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 -- start start 2024-05-30T16:59:45.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb40ad8c0 0x7efdb415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:45.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb4159df0 0x7efdb4160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:45.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb415a1d0 0x7efdb41661e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:45.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efdb416a7a0 con 0x7efdb4159df0 2024-05-30T16:59:45.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efdb416a620 con 0x7efdb415a1d0 2024-05-30T16:59:45.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdbc000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efdb416a920 con 0x7efdb40ad8c0 2024-05-30T16:59:45.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdb8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb4159df0 0x7efdb4160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:45.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdb8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb4159df0 0x7efdb4160780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40406/0 (socket says 172.21.15.59:40406) 2024-05-30T16:59:45.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdb8c00640 1 -- 172.21.15.59:0/735893499 learned_addr learned my addr 172.21.15.59:0/735893499 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:45.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdba000640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb415a1d0 0x7efdb41661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:45.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.940+0000 7efdb9600640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb40ad8c0 0x7efdb415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:45.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb8c00640 1 -- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb40ad8c0 msgr2=0x7efdb415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:45.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb8c00640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb40ad8c0 0x7efdb415eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:45.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb8c00640 1 -- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb415a1d0 msgr2=0x7efdb41661e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:45.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb8c00640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb415a1d0 0x7efdb41661e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:45.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb8c00640 1 -- 172.21.15.59:0/735893499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb415f080 con 0x7efdb4159df0 2024-05-30T16:59:45.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdba000640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb415a1d0 0x7efdb41661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:45.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb8c00640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb4159df0 0x7efdb4160780 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7efda00097c0 tx=0x7efda001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:45.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb1600640 1 -- 172.21.15.59:0/735893499 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda00bb020 con 0x7efdb4159df0 2024-05-30T16:59:45.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb1600640 1 -- 172.21.15.59:0/735893499 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda00b1040 con 0x7efdb4159df0 2024-05-30T16:59:45.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb1600640 1 -- 172.21.15.59:0/735893499 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda00b0050 con 0x7efdb4159df0 2024-05-30T16:59:45.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdbc000640 1 -- 172.21.15.59:0/735893499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb4165700 con 0x7efdb4159df0 2024-05-30T16:59:45.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdbc000640 1 -- 172.21.15.59:0/735893499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb414c820 con 0x7efdb4159df0 2024-05-30T16:59:45.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdbc000640 1 -- 172.21.15.59:0/735893499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb4068a90 con 0x7efdb4159df0 2024-05-30T16:59:45.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb1600640 1 -- 172.21.15.59:0/735893499 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7efda00be070 con 0x7efdb4159df0 2024-05-30T16:59:45.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb1600640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd94069540 0x7efd9406ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:45.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb1600640 1 -- 172.21.15.59:0/735893499 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5793+0+0 (secure 0 0 0) 0x7efda011f010 con 0x7efdb4159df0 2024-05-30T16:59:45.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.944+0000 7efdb9600640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd94069540 0x7efd9406ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:45.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.948+0000 7efdb9600640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd94069540 0x7efd9406ba00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efda8000f70 tx=0x7efda8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:45.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:45.952+0000 7efdb1600640 1 -- 172.21.15.59:0/735893499 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efda0015fb0 con 0x7efdb4159df0 2024-05-30T16:59:46.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.112+0000 7efdbc000640 1 -- 172.21.15.59:0/735893499 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efdb4166720 con 0x7efd94069540 2024-05-30T16:59:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.120+0000 7efdb1600640 1 -- 172.21.15.59:0/735893499 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252055 (secure 0 0 0) 0x7efda8001370 con 0x7efd94069540 2024-05-30T16:59:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T16:59:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.124+0000 7efdbc000640 1 -- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd94069540 msgr2=0x7efd9406ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.124+0000 7efdbc000640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd94069540 0x7efd9406ba00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efda8000f70 tx=0x7efda8009040 comp rx=0 tx=0).stop 2024-05-30T16:59:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.124+0000 7efdbc000640 1 -- 172.21.15.59:0/735893499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb4159df0 msgr2=0x7efdb4160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.124+0000 7efdbc000640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb4159df0 0x7efdb4160780 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7efda00097c0 tx=0x7efda001ac00 comp rx=0 tx=0).stop 2024-05-30T16:59:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.124+0000 7efdbc000640 1 -- 172.21.15.59:0/735893499 shutdown_connections 2024-05-30T16:59:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.124+0000 7efdbc000640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd94069540 0x7efd9406ba00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.124+0000 7efdbc000640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb415a1d0 0x7efdb41661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.124+0000 7efdbc000640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb4159df0 0x7efdb4160780 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.124+0000 7efdbc000640 1 --2- 172.21.15.59:0/735893499 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efdb40ad8c0 0x7efdb415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.124+0000 7efdbc000640 1 -- 172.21.15.59:0/735893499 >> 172.21.15.59:0/735893499 conn(0x7efdb40b22d0 msgr2=0x7efdb415ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.124+0000 7efdbc000640 1 -- 172.21.15.59:0/735893499 shutdown_connections 2024-05-30T16:59:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.124+0000 7efdbc000640 1 -- 172.21.15.59:0/735893499 wait complete. 2024-05-30T16:59:46.145 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-05-30T16:59:46.113673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":750196,"kb_used_data":9800,"kb_used_omap":12,"kb_used_meta":740275,"kb_avail":754224524,"statfs":{"total":773094113280,"available":772325912576,"internally_reserved":0,"allocated":10035200,"data_stored":4963820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":758042160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.807015"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478305+0000","last_change":"2024-05-30T16:59:37.093203+0000","last_active":"2024-05-30T16:59:38.478305+0000","last_peered":"2024-05-30T16:59:38.478305+0000","last_clean":"2024-05-30T16:59:38.478305+0000","last_became_active":"2024-05-30T16:59:37.092105+0000","last_became_peered":"2024-05-30T16:59:37.092105+0000","last_unstale":"2024-05-30T16:59:38.478305+0000","last_undegraded":"2024-05-30T16:59:38.478305+0000","last_fullsized":"2024-05-30T16:59:38.478305+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:01.271116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477996+0000","last_change":"2024-05-30T16:59:37.093116+0000","last_active":"2024-05-30T16:59:38.477996+0000","last_peered":"2024-05-30T16:59:38.477996+0000","last_clean":"2024-05-30T16:59:38.477996+0000","last_became_active":"2024-05-30T16:59:37.092861+0000","last_became_peered":"2024-05-30T16:59:37.092861+0000","last_unstale":"2024-05-30T16:59:38.477996+0000","last_undegraded":"2024-05-30T16:59:38.477996+0000","last_fullsized":"2024-05-30T16:59:38.477996+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:16:03.950017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478677+0000","last_change":"2024-05-30T16:59:37.092582+0000","last_active":"2024-05-30T16:59:38.478677+0000","last_peered":"2024-05-30T16:59:38.478677+0000","last_clean":"2024-05-30T16:59:38.478677+0000","last_became_active":"2024-05-30T16:59:37.092334+0000","last_became_peered":"2024-05-30T16:59:37.092334+0000","last_unstale":"2024-05-30T16:59:38.478677+0000","last_undegraded":"2024-05-30T16:59:38.478677+0000","last_fullsized":"2024-05-30T16:59:38.478677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:18:36.098628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477439+0000","last_change":"2024-05-30T16:59:37.082085+0000","last_active":"2024-05-30T16:59:38.477439+0000","last_peered":"2024-05-30T16:59:38.477439+0000","last_clean":"2024-05-30T16:59:38.477439+0000","last_became_active":"2024-05-30T16:59:37.081821+0000","last_became_peered":"2024-05-30T16:59:37.081821+0000","last_unstale":"2024-05-30T16:59:38.477439+0000","last_undegraded":"2024-05-30T16:59:38.477439+0000","last_fullsized":"2024-05-30T16:59:38.477439+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:00:31.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064589+0000","last_change":"2024-05-30T16:59:37.085960+0000","last_active":"2024-05-30T16:59:38.064589+0000","last_peered":"2024-05-30T16:59:38.064589+0000","last_clean":"2024-05-30T16:59:38.064589+0000","last_became_active":"2024-05-30T16:59:37.085666+0000","last_became_peered":"2024-05-30T16:59:37.085666+0000","last_unstale":"2024-05-30T16:59:38.064589+0000","last_undegraded":"2024-05-30T16:59:38.064589+0000","last_fullsized":"2024-05-30T16:59:38.064589+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:59:27.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064373+0000","last_change":"2024-05-30T16:59:37.072380+0000","last_active":"2024-05-30T16:59:38.064373+0000","last_peered":"2024-05-30T16:59:38.064373+0000","last_clean":"2024-05-30T16:59:38.064373+0000","last_became_active":"2024-05-30T16:59:37.072034+0000","last_became_peered":"2024-05-30T16:59:37.072034+0000","last_unstale":"2024-05-30T16:59:38.064373+0000","last_undegraded":"2024-05-30T16:59:38.064373+0000","last_fullsized":"2024-05-30T16:59:38.064373+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:55:00.950592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.476656+0000","last_change":"2024-05-30T16:59:37.076182+0000","last_active":"2024-05-30T16:59:38.476656+0000","last_peered":"2024-05-30T16:59:38.476656+0000","last_clean":"2024-05-30T16:59:38.476656+0000","last_became_active":"2024-05-30T16:59:37.075914+0000","last_became_peered":"2024-05-30T16:59:37.075914+0000","last_unstale":"2024-05-30T16:59:38.476656+0000","last_undegraded":"2024-05-30T16:59:38.476656+0000","last_fullsized":"2024-05-30T16:59:38.476656+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:37.960162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.063921+0000","last_change":"2024-05-30T16:59:37.078450+0000","last_active":"2024-05-30T16:59:38.063921+0000","last_peered":"2024-05-30T16:59:38.063921+0000","last_clean":"2024-05-30T16:59:38.063921+0000","last_became_active":"2024-05-30T16:59:37.078165+0000","last_became_peered":"2024-05-30T16:59:37.078165+0000","last_unstale":"2024-05-30T16:59:38.063921+0000","last_undegraded":"2024-05-30T16:59:38.063921+0000","last_fullsized":"2024-05-30T16:59:38.063921+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:31:24.947772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.065285+0000","last_change":"2024-05-30T16:59:37.082510+0000","last_active":"2024-05-30T16:59:38.065285+0000","last_peered":"2024-05-30T16:59:38.065285+0000","last_clean":"2024-05-30T16:59:38.065285+0000","last_became_active":"2024-05-30T16:59:37.082213+0000","last_became_peered":"2024-05-30T16:59:37.082213+0000","last_unstale":"2024-05-30T16:59:38.065285+0000","last_undegraded":"2024-05-30T16:59:38.065285+0000","last_fullsized":"2024-05-30T16:59:38.065285+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:16:00.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478052+0000","last_change":"2024-05-30T16:59:37.091906+0000","last_active":"2024-05-30T16:59:38.478052+0000","last_peered":"2024-05-30T16:59:38.478052+0000","last_clean":"2024-05-30T16:59:38.478052+0000","last_became_active":"2024-05-30T16:59:37.091488+0000","last_became_peered":"2024-05-30T16:59:37.091488+0000","last_unstale":"2024-05-30T16:59:38.478052+0000","last_undegraded":"2024-05-30T16:59:38.478052+0000","last_fullsized":"2024-05-30T16:59:38.478052+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:55:00.950592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477839+0000","last_change":"2024-05-30T16:59:37.081319+0000","last_active":"2024-05-30T16:59:38.477839+0000","last_peered":"2024-05-30T16:59:38.477839+0000","last_clean":"2024-05-30T16:59:38.477839+0000","last_became_active":"2024-05-30T16:59:37.078930+0000","last_became_peered":"2024-05-30T16:59:37.078930+0000","last_unstale":"2024-05-30T16:59:38.477839+0000","last_undegraded":"2024-05-30T16:59:38.477839+0000","last_fullsized":"2024-05-30T16:59:38.477839+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:30:12.633531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478027+0000","last_change":"2024-05-30T16:59:37.091682+0000","last_active":"2024-05-30T16:59:38.478027+0000","last_peered":"2024-05-30T16:59:38.478027+0000","last_clean":"2024-05-30T16:59:38.478027+0000","last_became_active":"2024-05-30T16:59:37.091372+0000","last_became_peered":"2024-05-30T16:59:37.091372+0000","last_unstale":"2024-05-30T16:59:38.478027+0000","last_undegraded":"2024-05-30T16:59:38.478027+0000","last_fullsized":"2024-05-30T16:59:38.478027+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:53.351890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478665+0000","last_change":"2024-05-30T16:59:37.080801+0000","last_active":"2024-05-30T16:59:38.478665+0000","last_peered":"2024-05-30T16:59:38.478665+0000","last_clean":"2024-05-30T16:59:38.478665+0000","last_became_active":"2024-05-30T16:59:37.080526+0000","last_became_peered":"2024-05-30T16:59:37.080526+0000","last_unstale":"2024-05-30T16:59:38.478665+0000","last_undegraded":"2024-05-30T16:59:38.478665+0000","last_fullsized":"2024-05-30T16:59:38.478665+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:54:36.100971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.476974+0000","last_change":"2024-05-30T16:59:37.087845+0000","last_active":"2024-05-30T16:59:38.476974+0000","last_peered":"2024-05-30T16:59:38.476974+0000","last_clean":"2024-05-30T16:59:38.476974+0000","last_became_active":"2024-05-30T16:59:37.085959+0000","last_became_peered":"2024-05-30T16:59:37.085959+0000","last_unstale":"2024-05-30T16:59:38.476974+0000","last_undegraded":"2024-05-30T16:59:38.476974+0000","last_fullsized":"2024-05-30T16:59:38.476974+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:59.217253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.476136+0000","last_change":"2024-05-30T16:59:37.080404+0000","last_active":"2024-05-30T16:59:38.476136+0000","last_peered":"2024-05-30T16:59:38.476136+0000","last_clean":"2024-05-30T16:59:38.476136+0000","last_became_active":"2024-05-30T16:59:37.078112+0000","last_became_peered":"2024-05-30T16:59:37.078112+0000","last_unstale":"2024-05-30T16:59:38.476136+0000","last_undegraded":"2024-05-30T16:59:38.476136+0000","last_fullsized":"2024-05-30T16:59:38.476136+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:06:31.299226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.063884+0000","last_change":"2024-05-30T16:59:37.090158+0000","last_active":"2024-05-30T16:59:38.063884+0000","last_peered":"2024-05-30T16:59:38.063884+0000","last_clean":"2024-05-30T16:59:38.063884+0000","last_became_active":"2024-05-30T16:59:37.089875+0000","last_became_peered":"2024-05-30T16:59:37.089875+0000","last_unstale":"2024-05-30T16:59:38.063884+0000","last_undegraded":"2024-05-30T16:59:38.063884+0000","last_fullsized":"2024-05-30T16:59:38.063884+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:53.351890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.065108+0000","last_change":"2024-05-30T16:59:37.084968+0000","last_active":"2024-05-30T16:59:38.065108+0000","last_peered":"2024-05-30T16:59:38.065108+0000","last_clean":"2024-05-30T16:59:38.065108+0000","last_became_active":"2024-05-30T16:59:37.084679+0000","last_became_peered":"2024-05-30T16:59:37.084679+0000","last_unstale":"2024-05-30T16:59:38.065108+0000","last_undegraded":"2024-05-30T16:59:38.065108+0000","last_fullsized":"2024-05-30T16:59:38.065108+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:21:31.814977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477619+0000","last_change":"2024-05-30T16:59:37.092473+0000","last_active":"2024-05-30T16:59:38.477619+0000","last_peered":"2024-05-30T16:59:38.477619+0000","last_clean":"2024-05-30T16:59:38.477619+0000","last_became_active":"2024-05-30T16:59:37.092195+0000","last_became_peered":"2024-05-30T16:59:37.092195+0000","last_unstale":"2024-05-30T16:59:38.477619+0000","last_undegraded":"2024-05-30T16:59:38.477619+0000","last_fullsized":"2024-05-30T16:59:38.477619+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:59:50.685587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.061959+0000","last_change":"2024-05-30T16:59:37.086366+0000","last_active":"2024-05-30T16:59:38.061959+0000","last_peered":"2024-05-30T16:59:38.061959+0000","last_clean":"2024-05-30T16:59:38.061959+0000","last_became_active":"2024-05-30T16:59:37.086008+0000","last_became_peered":"2024-05-30T16:59:37.086008+0000","last_unstale":"2024-05-30T16:59:38.061959+0000","last_undegraded":"2024-05-30T16:59:38.061959+0000","last_fullsized":"2024-05-30T16:59:38.061959+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:48.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477580+0000","last_change":"2024-05-30T16:59:37.091075+0000","last_active":"2024-05-30T16:59:38.477580+0000","last_peered":"2024-05-30T16:59:38.477580+0000","last_clean":"2024-05-30T16:59:38.477580+0000","last_became_active":"2024-05-30T16:59:37.090740+0000","last_became_peered":"2024-05-30T16:59:37.090740+0000","last_unstale":"2024-05-30T16:59:38.477580+0000","last_undegraded":"2024-05-30T16:59:38.477580+0000","last_fullsized":"2024-05-30T16:59:38.477580+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:20:05.338517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477341+0000","last_change":"2024-05-30T16:59:37.081310+0000","last_active":"2024-05-30T16:59:38.477341+0000","last_peered":"2024-05-30T16:59:38.477341+0000","last_clean":"2024-05-30T16:59:38.477341+0000","last_became_active":"2024-05-30T16:59:37.081051+0000","last_became_peered":"2024-05-30T16:59:37.081051+0000","last_unstale":"2024-05-30T16:59:38.477341+0000","last_undegraded":"2024-05-30T16:59:38.477341+0000","last_fullsized":"2024-05-30T16:59:38.477341+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:55:23.698395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477349+0000","last_change":"2024-05-30T16:59:37.092092+0000","last_active":"2024-05-30T16:59:38.477349+0000","last_peered":"2024-05-30T16:59:38.477349+0000","last_clean":"2024-05-30T16:59:38.477349+0000","last_became_active":"2024-05-30T16:59:37.089929+0000","last_became_peered":"2024-05-30T16:59:37.089929+0000","last_unstale":"2024-05-30T16:59:38.477349+0000","last_undegraded":"2024-05-30T16:59:38.477349+0000","last_fullsized":"2024-05-30T16:59:38.477349+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:28:57.130265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477681+0000","last_change":"2024-05-30T16:59:37.089008+0000","last_active":"2024-05-30T16:59:38.477681+0000","last_peered":"2024-05-30T16:59:38.477681+0000","last_clean":"2024-05-30T16:59:38.477681+0000","last_became_active":"2024-05-30T16:59:37.088577+0000","last_became_peered":"2024-05-30T16:59:37.088577+0000","last_unstale":"2024-05-30T16:59:38.477681+0000","last_undegraded":"2024-05-30T16:59:38.477681+0000","last_fullsized":"2024-05-30T16:59:38.477681+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:38.192437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.476499+0000","last_change":"2024-05-30T16:59:37.077530+0000","last_active":"2024-05-30T16:59:38.476499+0000","last_peered":"2024-05-30T16:59:38.476499+0000","last_clean":"2024-05-30T16:59:38.476499+0000","last_became_active":"2024-05-30T16:59:37.077272+0000","last_became_peered":"2024-05-30T16:59:37.077272+0000","last_unstale":"2024-05-30T16:59:38.476499+0000","last_undegraded":"2024-05-30T16:59:38.476499+0000","last_fullsized":"2024-05-30T16:59:38.476499+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:26:37.459231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478045+0000","last_change":"2024-05-30T16:59:37.092872+0000","last_active":"2024-05-30T16:59:38.478045+0000","last_peered":"2024-05-30T16:59:38.478045+0000","last_clean":"2024-05-30T16:59:38.478045+0000","last_became_active":"2024-05-30T16:59:37.092602+0000","last_became_peered":"2024-05-30T16:59:37.092602+0000","last_unstale":"2024-05-30T16:59:38.478045+0000","last_undegraded":"2024-05-30T16:59:38.478045+0000","last_fullsized":"2024-05-30T16:59:38.478045+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:01:19.566266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478944+0000","last_change":"2024-05-30T16:59:37.082108+0000","last_active":"2024-05-30T16:59:38.478944+0000","last_peered":"2024-05-30T16:59:38.478944+0000","last_clean":"2024-05-30T16:59:38.478944+0000","last_became_active":"2024-05-30T16:59:37.081786+0000","last_became_peered":"2024-05-30T16:59:37.081786+0000","last_unstale":"2024-05-30T16:59:38.478944+0000","last_undegraded":"2024-05-30T16:59:38.478944+0000","last_fullsized":"2024-05-30T16:59:38.478944+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:17:18.891171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064509+0000","last_change":"2024-05-30T16:59:37.074108+0000","last_active":"2024-05-30T16:59:38.064509+0000","last_peered":"2024-05-30T16:59:38.064509+0000","last_clean":"2024-05-30T16:59:38.064509+0000","last_became_active":"2024-05-30T16:59:37.073685+0000","last_became_peered":"2024-05-30T16:59:37.073685+0000","last_unstale":"2024-05-30T16:59:38.064509+0000","last_undegraded":"2024-05-30T16:59:38.064509+0000","last_fullsized":"2024-05-30T16:59:38.064509+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:27:44.032019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478235+0000","last_change":"2024-05-30T16:59:37.091611+0000","last_active":"2024-05-30T16:59:38.478235+0000","last_peered":"2024-05-30T16:59:38.478235+0000","last_clean":"2024-05-30T16:59:38.478235+0000","last_became_active":"2024-05-30T16:59:37.091300+0000","last_became_peered":"2024-05-30T16:59:37.091300+0000","last_unstale":"2024-05-30T16:59:38.478235+0000","last_undegraded":"2024-05-30T16:59:38.478235+0000","last_fullsized":"2024-05-30T16:59:38.478235+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:27:44.032019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477865+0000","last_change":"2024-05-30T16:59:37.074729+0000","last_active":"2024-05-30T16:59:38.477865+0000","last_peered":"2024-05-30T16:59:38.477865+0000","last_clean":"2024-05-30T16:59:38.477865+0000","last_became_active":"2024-05-30T16:59:37.074457+0000","last_became_peered":"2024-05-30T16:59:37.074457+0000","last_unstale":"2024-05-30T16:59:38.477865+0000","last_undegraded":"2024-05-30T16:59:38.477865+0000","last_fullsized":"2024-05-30T16:59:38.477865+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:12:26.637087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477510+0000","last_change":"2024-05-30T16:59:37.090233+0000","last_active":"2024-05-30T16:59:38.477510+0000","last_peered":"2024-05-30T16:59:38.477510+0000","last_clean":"2024-05-30T16:59:38.477510+0000","last_became_active":"2024-05-30T16:59:37.088987+0000","last_became_peered":"2024-05-30T16:59:37.088987+0000","last_unstale":"2024-05-30T16:59:38.477510+0000","last_undegraded":"2024-05-30T16:59:38.477510+0000","last_fullsized":"2024-05-30T16:59:38.477510+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:13.346005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064072+0000","last_change":"2024-05-30T16:59:37.077683+0000","last_active":"2024-05-30T16:59:38.064072+0000","last_peered":"2024-05-30T16:59:38.064072+0000","last_clean":"2024-05-30T16:59:38.064072+0000","last_became_active":"2024-05-30T16:59:37.077380+0000","last_became_peered":"2024-05-30T16:59:37.077380+0000","last_unstale":"2024-05-30T16:59:38.064072+0000","last_undegraded":"2024-05-30T16:59:38.064072+0000","last_fullsized":"2024-05-30T16:59:38.064072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:55:00.950592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477679+0000","last_change":"2024-05-30T16:59:37.088784+0000","last_active":"2024-05-30T16:59:38.477679+0000","last_peered":"2024-05-30T16:59:38.477679+0000","last_clean":"2024-05-30T16:59:38.477679+0000","last_became_active":"2024-05-30T16:59:37.088500+0000","last_became_peered":"2024-05-30T16:59:37.088500+0000","last_unstale":"2024-05-30T16:59:38.477679+0000","last_undegraded":"2024-05-30T16:59:38.477679+0000","last_fullsized":"2024-05-30T16:59:38.477679+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:31:24.947772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064803+0000","last_change":"2024-05-30T16:59:37.092667+0000","last_active":"2024-05-30T16:59:38.064803+0000","last_peered":"2024-05-30T16:59:38.064803+0000","last_clean":"2024-05-30T16:59:38.064803+0000","last_became_active":"2024-05-30T16:59:37.092305+0000","last_became_peered":"2024-05-30T16:59:37.092305+0000","last_unstale":"2024-05-30T16:59:38.064803+0000","last_undegraded":"2024-05-30T16:59:38.064803+0000","last_fullsized":"2024-05-30T16:59:38.064803+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:01.271116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"89'4","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478477+0000","last_change":"2024-05-30T16:59:36.079591+0000","last_active":"2024-05-30T16:59:38.478477+0000","last_peered":"2024-05-30T16:59:38.478477+0000","last_clean":"2024-05-30T16:59:38.478477+0000","last_became_active":"2024-05-30T16:59:36.079273+0000","last_became_peered":"2024-05-30T16:59:36.079273+0000","last_unstale":"2024-05-30T16:59:38.478477+0000","last_undegraded":"2024-05-30T16:59:38.478477+0000","last_fullsized":"2024-05-30T16:59:38.478477+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:07.078092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478327+0000","last_change":"2024-05-30T16:59:37.097479+0000","last_active":"2024-05-30T16:59:38.478327+0000","last_peered":"2024-05-30T16:59:38.478327+0000","last_clean":"2024-05-30T16:59:38.478327+0000","last_became_active":"2024-05-30T16:59:37.096852+0000","last_became_peered":"2024-05-30T16:59:37.096852+0000","last_unstale":"2024-05-30T16:59:38.478327+0000","last_undegraded":"2024-05-30T16:59:38.478327+0000","last_fullsized":"2024-05-30T16:59:38.478327+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:54.042211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064913+0000","last_change":"2024-05-30T16:59:36.081492+0000","last_active":"2024-05-30T16:59:38.064913+0000","last_peered":"2024-05-30T16:59:38.064913+0000","last_clean":"2024-05-30T16:59:38.064913+0000","last_became_active":"2024-05-30T16:59:36.081071+0000","last_became_peered":"2024-05-30T16:59:36.081071+0000","last_unstale":"2024-05-30T16:59:38.064913+0000","last_undegraded":"2024-05-30T16:59:38.064913+0000","last_fullsized":"2024-05-30T16:59:38.064913+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:32.389864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478248+0000","last_change":"2024-05-30T16:59:37.098058+0000","last_active":"2024-05-30T16:59:38.478248+0000","last_peered":"2024-05-30T16:59:38.478248+0000","last_clean":"2024-05-30T16:59:38.478248+0000","last_became_active":"2024-05-30T16:59:37.097708+0000","last_became_peered":"2024-05-30T16:59:37.097708+0000","last_unstale":"2024-05-30T16:59:38.478248+0000","last_undegraded":"2024-05-30T16:59:38.478248+0000","last_fullsized":"2024-05-30T16:59:38.478248+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:59:27.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"89'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.061908+0000","last_change":"2024-05-30T16:59:36.084335+0000","last_active":"2024-05-30T16:59:38.061908+0000","last_peered":"2024-05-30T16:59:38.061908+0000","last_clean":"2024-05-30T16:59:38.061908+0000","last_became_active":"2024-05-30T16:59:36.083933+0000","last_became_peered":"2024-05-30T16:59:36.083933+0000","last_unstale":"2024-05-30T16:59:38.061908+0000","last_undegraded":"2024-05-30T16:59:38.061908+0000","last_fullsized":"2024-05-30T16:59:38.061908+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:27:43.028647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478720+0000","last_change":"2024-05-30T16:59:37.084018+0000","last_active":"2024-05-30T16:59:38.478720+0000","last_peered":"2024-05-30T16:59:38.478720+0000","last_clean":"2024-05-30T16:59:38.478720+0000","last_became_active":"2024-05-30T16:59:37.083711+0000","last_became_peered":"2024-05-30T16:59:37.083711+0000","last_unstale":"2024-05-30T16:59:38.478720+0000","last_undegraded":"2024-05-30T16:59:38.478720+0000","last_fullsized":"2024-05-30T16:59:38.478720+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:30:28.402104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"89'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.061617+0000","last_change":"2024-05-30T16:59:36.081241+0000","last_active":"2024-05-30T16:59:38.061617+0000","last_peered":"2024-05-30T16:59:38.061617+0000","last_clean":"2024-05-30T16:59:38.061617+0000","last_became_active":"2024-05-30T16:59:36.080949+0000","last_became_peered":"2024-05-30T16:59:36.080949+0000","last_unstale":"2024-05-30T16:59:38.061617+0000","last_undegraded":"2024-05-30T16:59:38.061617+0000","last_fullsized":"2024-05-30T16:59:38.061617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:38:37.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477512+0000","last_change":"2024-05-30T16:59:37.085898+0000","last_active":"2024-05-30T16:59:38.477512+0000","last_peered":"2024-05-30T16:59:38.477512+0000","last_clean":"2024-05-30T16:59:38.477512+0000","last_became_active":"2024-05-30T16:59:37.081928+0000","last_became_peered":"2024-05-30T16:59:37.081928+0000","last_unstale":"2024-05-30T16:59:38.477512+0000","last_undegraded":"2024-05-30T16:59:38.477512+0000","last_fullsized":"2024-05-30T16:59:38.477512+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:22:50.452030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064861+0000","last_change":"2024-05-30T16:59:36.086610+0000","last_active":"2024-05-30T16:59:38.064861+0000","last_peered":"2024-05-30T16:59:38.064861+0000","last_clean":"2024-05-30T16:59:38.064861+0000","last_became_active":"2024-05-30T16:59:36.086428+0000","last_became_peered":"2024-05-30T16:59:36.086428+0000","last_unstale":"2024-05-30T16:59:38.064861+0000","last_undegraded":"2024-05-30T16:59:38.064861+0000","last_fullsized":"2024-05-30T16:59:38.064861+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:36:36.936609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064753+0000","last_change":"2024-05-30T16:59:37.086396+0000","last_active":"2024-05-30T16:59:38.064753+0000","last_peered":"2024-05-30T16:59:38.064753+0000","last_clean":"2024-05-30T16:59:38.064753+0000","last_became_active":"2024-05-30T16:59:37.086095+0000","last_became_peered":"2024-05-30T16:59:37.086095+0000","last_unstale":"2024-05-30T16:59:38.064753+0000","last_undegraded":"2024-05-30T16:59:38.064753+0000","last_fullsized":"2024-05-30T16:59:38.064753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:54.042211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064366+0000","last_change":"2024-05-30T16:59:36.082645+0000","last_active":"2024-05-30T16:59:38.064366+0000","last_peered":"2024-05-30T16:59:38.064366+0000","last_clean":"2024-05-30T16:59:38.064366+0000","last_became_active":"2024-05-30T16:59:36.082380+0000","last_became_peered":"2024-05-30T16:59:36.082380+0000","last_unstale":"2024-05-30T16:59:38.064366+0000","last_undegraded":"2024-05-30T16:59:38.064366+0000","last_fullsized":"2024-05-30T16:59:38.064366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:09.218872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477920+0000","last_change":"2024-05-30T16:59:37.092211+0000","last_active":"2024-05-30T16:59:38.477920+0000","last_peered":"2024-05-30T16:59:38.477920+0000","last_clean":"2024-05-30T16:59:38.477920+0000","last_became_active":"2024-05-30T16:59:37.091725+0000","last_became_peered":"2024-05-30T16:59:37.091725+0000","last_unstale":"2024-05-30T16:59:38.477920+0000","last_undegraded":"2024-05-30T16:59:38.477920+0000","last_fullsized":"2024-05-30T16:59:38.477920+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:22.598362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.061572+0000","last_change":"2024-05-30T16:59:36.072167+0000","last_active":"2024-05-30T16:59:38.061572+0000","last_peered":"2024-05-30T16:59:38.061572+0000","last_clean":"2024-05-30T16:59:38.061572+0000","last_became_active":"2024-05-30T16:59:36.071855+0000","last_became_peered":"2024-05-30T16:59:36.071855+0000","last_unstale":"2024-05-30T16:59:38.061572+0000","last_undegraded":"2024-05-30T16:59:38.061572+0000","last_fullsized":"2024-05-30T16:59:38.061572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:14:56.040644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.476579+0000","last_change":"2024-05-30T16:59:37.076720+0000","last_active":"2024-05-30T16:59:38.476579+0000","last_peered":"2024-05-30T16:59:38.476579+0000","last_clean":"2024-05-30T16:59:38.476579+0000","last_became_active":"2024-05-30T16:59:37.076407+0000","last_became_peered":"2024-05-30T16:59:37.076407+0000","last_unstale":"2024-05-30T16:59:38.476579+0000","last_undegraded":"2024-05-30T16:59:38.476579+0000","last_fullsized":"2024-05-30T16:59:38.476579+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:50:27.684364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477088+0000","last_change":"2024-05-30T16:59:36.075847+0000","last_active":"2024-05-30T16:59:38.477088+0000","last_peered":"2024-05-30T16:59:38.477088+0000","last_clean":"2024-05-30T16:59:38.477088+0000","last_became_active":"2024-05-30T16:59:36.075436+0000","last_became_peered":"2024-05-30T16:59:36.075436+0000","last_unstale":"2024-05-30T16:59:38.477088+0000","last_undegraded":"2024-05-30T16:59:38.477088+0000","last_fullsized":"2024-05-30T16:59:38.477088+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:33.420123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.476938+0000","last_change":"2024-05-30T16:59:37.083248+0000","last_active":"2024-05-30T16:59:38.476938+0000","last_peered":"2024-05-30T16:59:38.476938+0000","last_clean":"2024-05-30T16:59:38.476938+0000","last_became_active":"2024-05-30T16:59:37.082974+0000","last_became_peered":"2024-05-30T16:59:37.082974+0000","last_unstale":"2024-05-30T16:59:38.476938+0000","last_undegraded":"2024-05-30T16:59:38.476938+0000","last_fullsized":"2024-05-30T16:59:38.476938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:17:32.724666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478589+0000","last_change":"2024-05-30T16:59:36.084230+0000","last_active":"2024-05-30T16:59:38.478589+0000","last_peered":"2024-05-30T16:59:38.478589+0000","last_clean":"2024-05-30T16:59:38.478589+0000","last_became_active":"2024-05-30T16:59:36.083951+0000","last_became_peered":"2024-05-30T16:59:36.083951+0000","last_unstale":"2024-05-30T16:59:38.478589+0000","last_undegraded":"2024-05-30T16:59:38.478589+0000","last_fullsized":"2024-05-30T16:59:38.478589+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:05.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.065374+0000","last_change":"2024-05-30T16:59:37.072293+0000","last_active":"2024-05-30T16:59:38.065374+0000","last_peered":"2024-05-30T16:59:38.065374+0000","last_clean":"2024-05-30T16:59:38.065374+0000","last_became_active":"2024-05-30T16:59:37.068848+0000","last_became_peered":"2024-05-30T16:59:37.068848+0000","last_unstale":"2024-05-30T16:59:38.065374+0000","last_undegraded":"2024-05-30T16:59:38.065374+0000","last_fullsized":"2024-05-30T16:59:38.065374+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:01.271116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478019+0000","last_change":"2024-05-30T16:59:36.076816+0000","last_active":"2024-05-30T16:59:38.478019+0000","last_peered":"2024-05-30T16:59:38.478019+0000","last_clean":"2024-05-30T16:59:38.478019+0000","last_became_active":"2024-05-30T16:59:36.076449+0000","last_became_peered":"2024-05-30T16:59:36.076449+0000","last_unstale":"2024-05-30T16:59:38.478019+0000","last_undegraded":"2024-05-30T16:59:38.478019+0000","last_fullsized":"2024-05-30T16:59:38.478019+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:36:36.936609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.061801+0000","last_change":"2024-05-30T16:59:37.094548+0000","last_active":"2024-05-30T16:59:38.061801+0000","last_peered":"2024-05-30T16:59:38.061801+0000","last_clean":"2024-05-30T16:59:38.061801+0000","last_became_active":"2024-05-30T16:59:37.094267+0000","last_became_peered":"2024-05-30T16:59:37.094267+0000","last_unstale":"2024-05-30T16:59:38.061801+0000","last_undegraded":"2024-05-30T16:59:38.061801+0000","last_fullsized":"2024-05-30T16:59:38.061801+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:31:42.026333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"89'3","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477705+0000","last_change":"2024-05-30T16:59:36.083663+0000","last_active":"2024-05-30T16:59:38.477705+0000","last_peered":"2024-05-30T16:59:38.477705+0000","last_clean":"2024-05-30T16:59:38.477705+0000","last_became_active":"2024-05-30T16:59:36.083370+0000","last_became_peered":"2024-05-30T16:59:36.083370+0000","last_unstale":"2024-05-30T16:59:38.477705+0000","last_undegraded":"2024-05-30T16:59:38.477705+0000","last_fullsized":"2024-05-30T16:59:38.477705+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:47:12.815654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064938+0000","last_change":"2024-05-30T16:59:37.087703+0000","last_active":"2024-05-30T16:59:38.064938+0000","last_peered":"2024-05-30T16:59:38.064938+0000","last_clean":"2024-05-30T16:59:38.064938+0000","last_became_active":"2024-05-30T16:59:37.087368+0000","last_became_peered":"2024-05-30T16:59:37.087368+0000","last_unstale":"2024-05-30T16:59:38.064938+0000","last_undegraded":"2024-05-30T16:59:38.064938+0000","last_fullsized":"2024-05-30T16:59:38.064938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:31:42.026333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"89'6","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.065057+0000","last_change":"2024-05-30T16:59:36.066172+0000","last_active":"2024-05-30T16:59:38.065057+0000","last_peered":"2024-05-30T16:59:38.065057+0000","last_clean":"2024-05-30T16:59:38.065057+0000","last_became_active":"2024-05-30T16:59:36.064294+0000","last_became_peered":"2024-05-30T16:59:36.064294+0000","last_unstale":"2024-05-30T16:59:38.065057+0000","last_undegraded":"2024-05-30T16:59:38.065057+0000","last_fullsized":"2024-05-30T16:59:38.065057+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:58:17.835411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.061565+0000","last_change":"2024-05-30T16:59:37.084517+0000","last_active":"2024-05-30T16:59:38.061565+0000","last_peered":"2024-05-30T16:59:38.061565+0000","last_clean":"2024-05-30T16:59:38.061565+0000","last_became_active":"2024-05-30T16:59:37.084243+0000","last_became_peered":"2024-05-30T16:59:37.084243+0000","last_unstale":"2024-05-30T16:59:38.061565+0000","last_undegraded":"2024-05-30T16:59:38.061565+0000","last_fullsized":"2024-05-30T16:59:38.061565+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:52:53.010477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"89'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477627+0000","last_change":"2024-05-30T16:59:36.074867+0000","last_active":"2024-05-30T16:59:38.477627+0000","last_peered":"2024-05-30T16:59:38.477627+0000","last_clean":"2024-05-30T16:59:38.477627+0000","last_became_active":"2024-05-30T16:59:36.074584+0000","last_became_peered":"2024-05-30T16:59:36.074584+0000","last_unstale":"2024-05-30T16:59:38.477627+0000","last_undegraded":"2024-05-30T16:59:38.477627+0000","last_fullsized":"2024-05-30T16:59:38.477627+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:04:38.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478688+0000","last_change":"2024-05-30T16:59:37.094928+0000","last_active":"2024-05-30T16:59:38.478688+0000","last_peered":"2024-05-30T16:59:38.478688+0000","last_clean":"2024-05-30T16:59:38.478688+0000","last_became_active":"2024-05-30T16:59:37.094508+0000","last_became_peered":"2024-05-30T16:59:37.094508+0000","last_unstale":"2024-05-30T16:59:38.478688+0000","last_undegraded":"2024-05-30T16:59:38.478688+0000","last_fullsized":"2024-05-30T16:59:38.478688+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:24:42.789325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477001+0000","last_change":"2024-05-30T16:59:36.072195+0000","last_active":"2024-05-30T16:59:38.477001+0000","last_peered":"2024-05-30T16:59:38.477001+0000","last_clean":"2024-05-30T16:59:38.477001+0000","last_became_active":"2024-05-30T16:59:36.071318+0000","last_became_peered":"2024-05-30T16:59:36.071318+0000","last_unstale":"2024-05-30T16:59:38.477001+0000","last_undegraded":"2024-05-30T16:59:38.477001+0000","last_fullsized":"2024-05-30T16:59:38.477001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:57:35.910943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477003+0000","last_change":"2024-05-30T16:59:37.085652+0000","last_active":"2024-05-30T16:59:38.477003+0000","last_peered":"2024-05-30T16:59:38.477003+0000","last_clean":"2024-05-30T16:59:38.477003+0000","last_became_active":"2024-05-30T16:59:37.085321+0000","last_became_peered":"2024-05-30T16:59:37.085321+0000","last_unstale":"2024-05-30T16:59:38.477003+0000","last_undegraded":"2024-05-30T16:59:38.477003+0000","last_fullsized":"2024-05-30T16:59:38.477003+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:20:05.338517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064189+0000","last_change":"2024-05-30T16:59:36.073851+0000","last_active":"2024-05-30T16:59:38.064189+0000","last_peered":"2024-05-30T16:59:38.064189+0000","last_clean":"2024-05-30T16:59:38.064189+0000","last_became_active":"2024-05-30T16:59:36.073504+0000","last_became_peered":"2024-05-30T16:59:36.073504+0000","last_unstale":"2024-05-30T16:59:38.064189+0000","last_undegraded":"2024-05-30T16:59:38.064189+0000","last_fullsized":"2024-05-30T16:59:38.064189+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:27.344000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477047+0000","last_change":"2024-05-30T16:59:37.090890+0000","last_active":"2024-05-30T16:59:38.477047+0000","last_peered":"2024-05-30T16:59:38.477047+0000","last_clean":"2024-05-30T16:59:38.477047+0000","last_became_active":"2024-05-30T16:59:37.090646+0000","last_became_peered":"2024-05-30T16:59:37.090646+0000","last_unstale":"2024-05-30T16:59:38.477047+0000","last_undegraded":"2024-05-30T16:59:38.477047+0000","last_fullsized":"2024-05-30T16:59:38.477047+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:59:50.685587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"89'8","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.061474+0000","last_change":"2024-05-30T16:59:36.071455+0000","last_active":"2024-05-30T16:59:38.061474+0000","last_peered":"2024-05-30T16:59:38.061474+0000","last_clean":"2024-05-30T16:59:38.061474+0000","last_became_active":"2024-05-30T16:59:36.071143+0000","last_became_peered":"2024-05-30T16:59:36.071143+0000","last_unstale":"2024-05-30T16:59:38.061474+0000","last_undegraded":"2024-05-30T16:59:38.061474+0000","last_fullsized":"2024-05-30T16:59:38.061474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:52.348518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478966+0000","last_change":"2024-05-30T16:59:37.085772+0000","last_active":"2024-05-30T16:59:38.478966+0000","last_peered":"2024-05-30T16:59:38.478966+0000","last_clean":"2024-05-30T16:59:38.478966+0000","last_became_active":"2024-05-30T16:59:37.085494+0000","last_became_peered":"2024-05-30T16:59:37.085494+0000","last_unstale":"2024-05-30T16:59:38.478966+0000","last_undegraded":"2024-05-30T16:59:38.478966+0000","last_fullsized":"2024-05-30T16:59:38.478966+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:39:17.044930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478711+0000","last_change":"2024-05-30T16:59:36.071418+0000","last_active":"2024-05-30T16:59:38.478711+0000","last_peered":"2024-05-30T16:59:38.478711+0000","last_clean":"2024-05-30T16:59:38.478711+0000","last_became_active":"2024-05-30T16:59:36.070404+0000","last_became_peered":"2024-05-30T16:59:36.070404+0000","last_unstale":"2024-05-30T16:59:38.478711+0000","last_undegraded":"2024-05-30T16:59:38.478711+0000","last_fullsized":"2024-05-30T16:59:38.478711+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:09.218872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478518+0000","last_change":"2024-05-30T16:59:37.088772+0000","last_active":"2024-05-30T16:59:38.478518+0000","last_peered":"2024-05-30T16:59:38.478518+0000","last_clean":"2024-05-30T16:59:38.478518+0000","last_became_active":"2024-05-30T16:59:37.088489+0000","last_became_peered":"2024-05-30T16:59:37.088489+0000","last_unstale":"2024-05-30T16:59:38.478518+0000","last_undegraded":"2024-05-30T16:59:38.478518+0000","last_fullsized":"2024-05-30T16:59:38.478518+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:31:42.026333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"89'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.062070+0000","last_change":"2024-05-30T16:59:36.077558+0000","last_active":"2024-05-30T16:59:38.062070+0000","last_peered":"2024-05-30T16:59:38.062070+0000","last_clean":"2024-05-30T16:59:38.062070+0000","last_became_active":"2024-05-30T16:59:36.076835+0000","last_became_peered":"2024-05-30T16:59:36.076835+0000","last_unstale":"2024-05-30T16:59:38.062070+0000","last_undegraded":"2024-05-30T16:59:38.062070+0000","last_fullsized":"2024-05-30T16:59:38.062070+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:59.947220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064683+0000","last_change":"2024-05-30T16:59:37.085771+0000","last_active":"2024-05-30T16:59:38.064683+0000","last_peered":"2024-05-30T16:59:38.064683+0000","last_clean":"2024-05-30T16:59:38.064683+0000","last_became_active":"2024-05-30T16:59:37.085475+0000","last_became_peered":"2024-05-30T16:59:37.085475+0000","last_unstale":"2024-05-30T16:59:38.064683+0000","last_undegraded":"2024-05-30T16:59:38.064683+0000","last_fullsized":"2024-05-30T16:59:38.064683+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:16:00.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.061736+0000","last_change":"2024-05-30T16:59:36.073081+0000","last_active":"2024-05-30T16:59:38.061736+0000","last_peered":"2024-05-30T16:59:38.061736+0000","last_clean":"2024-05-30T16:59:38.061736+0000","last_became_active":"2024-05-30T16:59:36.072483+0000","last_became_peered":"2024-05-30T16:59:36.072483+0000","last_unstale":"2024-05-30T16:59:38.061736+0000","last_undegraded":"2024-05-30T16:59:38.061736+0000","last_fullsized":"2024-05-30T16:59:38.061736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:31:23.944400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477107+0000","last_change":"2024-05-30T16:59:37.082050+0000","last_active":"2024-05-30T16:59:38.477107+0000","last_peered":"2024-05-30T16:59:38.477107+0000","last_clean":"2024-05-30T16:59:38.477107+0000","last_became_active":"2024-05-30T16:59:37.081747+0000","last_became_peered":"2024-05-30T16:59:37.081747+0000","last_unstale":"2024-05-30T16:59:38.477107+0000","last_undegraded":"2024-05-30T16:59:38.477107+0000","last_fullsized":"2024-05-30T16:59:38.477107+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:00:47.652785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"89'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.476572+0000","last_change":"2024-05-30T16:59:36.070012+0000","last_active":"2024-05-30T16:59:38.476572+0000","last_peered":"2024-05-30T16:59:38.476572+0000","last_clean":"2024-05-30T16:59:38.476572+0000","last_became_active":"2024-05-30T16:59:36.069700+0000","last_became_peered":"2024-05-30T16:59:36.069700+0000","last_unstale":"2024-05-30T16:59:38.476572+0000","last_undegraded":"2024-05-30T16:59:38.476572+0000","last_fullsized":"2024-05-30T16:59:38.476572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:43:51.850365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064798+0000","last_change":"2024-05-30T16:59:37.072799+0000","last_active":"2024-05-30T16:59:38.064798+0000","last_peered":"2024-05-30T16:59:38.064798+0000","last_clean":"2024-05-30T16:59:38.064798+0000","last_became_active":"2024-05-30T16:59:37.072459+0000","last_became_peered":"2024-05-30T16:59:37.072459+0000","last_unstale":"2024-05-30T16:59:38.064798+0000","last_undegraded":"2024-05-30T16:59:38.064798+0000","last_fullsized":"2024-05-30T16:59:38.064798+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:59:27.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477176+0000","last_change":"2024-05-30T16:59:36.078703+0000","last_active":"2024-05-30T16:59:38.477176+0000","last_peered":"2024-05-30T16:59:38.477176+0000","last_clean":"2024-05-30T16:59:38.477176+0000","last_became_active":"2024-05-30T16:59:36.078388+0000","last_became_peered":"2024-05-30T16:59:36.078388+0000","last_unstale":"2024-05-30T16:59:38.477176+0000","last_undegraded":"2024-05-30T16:59:38.477176+0000","last_fullsized":"2024-05-30T16:59:38.477176+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:33.197739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.476597+0000","last_change":"2024-05-30T16:59:37.065490+0000","last_active":"2024-05-30T16:59:38.476597+0000","last_peered":"2024-05-30T16:59:38.476597+0000","last_clean":"2024-05-30T16:59:38.476597+0000","last_became_active":"2024-05-30T16:59:37.065012+0000","last_became_peered":"2024-05-30T16:59:37.065012+0000","last_unstale":"2024-05-30T16:59:38.476597+0000","last_undegraded":"2024-05-30T16:59:38.476597+0000","last_fullsized":"2024-05-30T16:59:38.476597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:08:05.904777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.476476+0000","last_change":"2024-05-30T16:59:36.073987+0000","last_active":"2024-05-30T16:59:38.476476+0000","last_peered":"2024-05-30T16:59:38.476476+0000","last_clean":"2024-05-30T16:59:38.476476+0000","last_became_active":"2024-05-30T16:59:36.073682+0000","last_became_peered":"2024-05-30T16:59:36.073682+0000","last_unstale":"2024-05-30T16:59:38.476476+0000","last_undegraded":"2024-05-30T16:59:38.476476+0000","last_fullsized":"2024-05-30T16:59:38.476476+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:04:12.123572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064022+0000","last_change":"2024-05-30T16:59:37.077255+0000","last_active":"2024-05-30T16:59:38.064022+0000","last_peered":"2024-05-30T16:59:38.064022+0000","last_clean":"2024-05-30T16:59:38.064022+0000","last_became_active":"2024-05-30T16:59:37.075699+0000","last_became_peered":"2024-05-30T16:59:37.075699+0000","last_unstale":"2024-05-30T16:59:38.064022+0000","last_undegraded":"2024-05-30T16:59:38.064022+0000","last_fullsized":"2024-05-30T16:59:38.064022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:53.351890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.476035+0000","last_change":"2024-05-30T16:59:36.071359+0000","last_active":"2024-05-30T16:59:38.476035+0000","last_peered":"2024-05-30T16:59:38.476035+0000","last_clean":"2024-05-30T16:59:38.476035+0000","last_became_active":"2024-05-30T16:59:36.071068+0000","last_became_peered":"2024-05-30T16:59:36.071068+0000","last_unstale":"2024-05-30T16:59:38.476035+0000","last_undegraded":"2024-05-30T16:59:38.476035+0000","last_fullsized":"2024-05-30T16:59:38.476035+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:36:30.023012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.065109+0000","last_change":"2024-05-30T16:59:37.079547+0000","last_active":"2024-05-30T16:59:38.065109+0000","last_peered":"2024-05-30T16:59:38.065109+0000","last_clean":"2024-05-30T16:59:38.065109+0000","last_became_active":"2024-05-30T16:59:37.077473+0000","last_became_peered":"2024-05-30T16:59:37.077473+0000","last_unstale":"2024-05-30T16:59:38.065109+0000","last_undegraded":"2024-05-30T16:59:38.065109+0000","last_fullsized":"2024-05-30T16:59:38.065109+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:48.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"89'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478026+0000","last_change":"2024-05-30T16:59:36.067314+0000","last_active":"2024-05-30T16:59:38.478026+0000","last_peered":"2024-05-30T16:59:38.478026+0000","last_clean":"2024-05-30T16:59:38.478026+0000","last_became_active":"2024-05-30T16:59:36.064171+0000","last_became_peered":"2024-05-30T16:59:36.064171+0000","last_unstale":"2024-05-30T16:59:38.478026+0000","last_undegraded":"2024-05-30T16:59:38.478026+0000","last_fullsized":"2024-05-30T16:59:38.478026+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:25.960596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.479008+0000","last_change":"2024-05-30T16:59:37.093784+0000","last_active":"2024-05-30T16:59:38.479008+0000","last_peered":"2024-05-30T16:59:38.479008+0000","last_clean":"2024-05-30T16:59:38.479008+0000","last_became_active":"2024-05-30T16:59:37.093464+0000","last_became_peered":"2024-05-30T16:59:37.093464+0000","last_unstale":"2024-05-30T16:59:38.479008+0000","last_undegraded":"2024-05-30T16:59:38.479008+0000","last_fullsized":"2024-05-30T16:59:38.479008+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:35:41.787241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"90'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478068+0000","last_change":"2024-05-30T16:59:36.075907+0000","last_active":"2024-05-30T16:59:38.478068+0000","last_peered":"2024-05-30T16:59:38.478068+0000","last_clean":"2024-05-30T16:59:38.478068+0000","last_became_active":"2024-05-30T16:59:36.075639+0000","last_became_peered":"2024-05-30T16:59:36.075639+0000","last_unstale":"2024-05-30T16:59:38.478068+0000","last_undegraded":"2024-05-30T16:59:38.478068+0000","last_fullsized":"2024-05-30T16:59:38.478068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:11.419133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478443+0000","last_change":"2024-05-30T16:59:37.095753+0000","last_active":"2024-05-30T16:59:38.478443+0000","last_peered":"2024-05-30T16:59:38.478443+0000","last_clean":"2024-05-30T16:59:38.478443+0000","last_became_active":"2024-05-30T16:59:37.095191+0000","last_became_peered":"2024-05-30T16:59:37.095191+0000","last_unstale":"2024-05-30T16:59:38.478443+0000","last_undegraded":"2024-05-30T16:59:38.478443+0000","last_fullsized":"2024-05-30T16:59:38.478443+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:52:53.010477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477898+0000","last_change":"2024-05-30T16:59:36.079587+0000","last_active":"2024-05-30T16:59:38.477898+0000","last_peered":"2024-05-30T16:59:38.477898+0000","last_clean":"2024-05-30T16:59:38.477898+0000","last_became_active":"2024-05-30T16:59:36.079306+0000","last_became_peered":"2024-05-30T16:59:36.079306+0000","last_unstale":"2024-05-30T16:59:38.477898+0000","last_undegraded":"2024-05-30T16:59:38.477898+0000","last_fullsized":"2024-05-30T16:59:38.477898+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:41:30.701806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064898+0000","last_change":"2024-05-30T16:59:37.087073+0000","last_active":"2024-05-30T16:59:38.064898+0000","last_peered":"2024-05-30T16:59:38.064898+0000","last_clean":"2024-05-30T16:59:38.064898+0000","last_became_active":"2024-05-30T16:59:37.086784+0000","last_became_peered":"2024-05-30T16:59:37.086784+0000","last_unstale":"2024-05-30T16:59:38.064898+0000","last_undegraded":"2024-05-30T16:59:38.064898+0000","last_fullsized":"2024-05-30T16:59:38.064898+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:52:53.010477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478384+0000","last_change":"2024-05-30T16:59:36.078081+0000","last_active":"2024-05-30T16:59:38.478384+0000","last_peered":"2024-05-30T16:59:38.478384+0000","last_clean":"2024-05-30T16:59:38.478384+0000","last_became_active":"2024-05-30T16:59:36.077822+0000","last_became_peered":"2024-05-30T16:59:36.077822+0000","last_unstale":"2024-05-30T16:59:38.478384+0000","last_undegraded":"2024-05-30T16:59:38.478384+0000","last_fullsized":"2024-05-30T16:59:38.478384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:45:07.805901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064585+0000","last_change":"2024-05-30T16:59:37.073176+0000","last_active":"2024-05-30T16:59:38.064585+0000","last_peered":"2024-05-30T16:59:38.064585+0000","last_clean":"2024-05-30T16:59:38.064585+0000","last_became_active":"2024-05-30T16:59:37.072705+0000","last_became_peered":"2024-05-30T16:59:37.072705+0000","last_unstale":"2024-05-30T16:59:38.064585+0000","last_undegraded":"2024-05-30T16:59:38.064585+0000","last_fullsized":"2024-05-30T16:59:38.064585+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:27:44.032019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.061983+0000","last_change":"2024-05-30T16:59:36.072434+0000","last_active":"2024-05-30T16:59:38.061983+0000","last_peered":"2024-05-30T16:59:38.061983+0000","last_clean":"2024-05-30T16:59:38.061983+0000","last_became_active":"2024-05-30T16:59:36.072080+0000","last_became_peered":"2024-05-30T16:59:36.072080+0000","last_unstale":"2024-05-30T16:59:38.061983+0000","last_undegraded":"2024-05-30T16:59:38.061983+0000","last_fullsized":"2024-05-30T16:59:38.061983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:52:08.828492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.061824+0000","last_change":"2024-05-30T16:59:37.084414+0000","last_active":"2024-05-30T16:59:38.061824+0000","last_peered":"2024-05-30T16:59:38.061824+0000","last_clean":"2024-05-30T16:59:38.061824+0000","last_became_active":"2024-05-30T16:59:37.084136+0000","last_became_peered":"2024-05-30T16:59:37.084136+0000","last_unstale":"2024-05-30T16:59:38.061824+0000","last_undegraded":"2024-05-30T16:59:38.061824+0000","last_fullsized":"2024-05-30T16:59:38.061824+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:21:31.814977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.064454+0000","last_change":"2024-05-30T16:59:36.081362+0000","last_active":"2024-05-30T16:59:38.064454+0000","last_peered":"2024-05-30T16:59:38.064454+0000","last_clean":"2024-05-30T16:59:38.064454+0000","last_became_active":"2024-05-30T16:59:36.081053+0000","last_became_peered":"2024-05-30T16:59:36.081053+0000","last_unstale":"2024-05-30T16:59:38.064454+0000","last_undegraded":"2024-05-30T16:59:38.064454+0000","last_fullsized":"2024-05-30T16:59:38.064454+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:07.006990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478050+0000","last_change":"2024-05-30T16:59:37.082149+0000","last_active":"2024-05-30T16:59:38.478050+0000","last_peered":"2024-05-30T16:59:38.478050+0000","last_clean":"2024-05-30T16:59:38.478050+0000","last_became_active":"2024-05-30T16:59:37.081871+0000","last_became_peered":"2024-05-30T16:59:37.081871+0000","last_unstale":"2024-05-30T16:59:38.478050+0000","last_undegraded":"2024-05-30T16:59:38.478050+0000","last_fullsized":"2024-05-30T16:59:38.478050+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:10:23.173088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478147+0000","last_change":"2024-05-30T16:59:36.082150+0000","last_active":"2024-05-30T16:59:38.478147+0000","last_peered":"2024-05-30T16:59:38.478147+0000","last_clean":"2024-05-30T16:59:38.478147+0000","last_became_active":"2024-05-30T16:59:36.081808+0000","last_became_peered":"2024-05-30T16:59:36.081808+0000","last_unstale":"2024-05-30T16:59:38.478147+0000","last_undegraded":"2024-05-30T16:59:38.478147+0000","last_fullsized":"2024-05-30T16:59:38.478147+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:10:14.175340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478235+0000","last_change":"2024-05-30T16:59:37.086355+0000","last_active":"2024-05-30T16:59:38.478235+0000","last_peered":"2024-05-30T16:59:38.478235+0000","last_clean":"2024-05-30T16:59:38.478235+0000","last_became_active":"2024-05-30T16:59:37.085922+0000","last_became_peered":"2024-05-30T16:59:37.085922+0000","last_unstale":"2024-05-30T16:59:38.478235+0000","last_undegraded":"2024-05-30T16:59:38.478235+0000","last_fullsized":"2024-05-30T16:59:38.478235+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:16:00.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.063842+0000","last_change":"2024-05-30T16:59:36.078616+0000","last_active":"2024-05-30T16:59:38.063842+0000","last_peered":"2024-05-30T16:59:38.063842+0000","last_clean":"2024-05-30T16:59:38.063842+0000","last_became_active":"2024-05-30T16:59:36.078225+0000","last_became_peered":"2024-05-30T16:59:36.078225+0000","last_unstale":"2024-05-30T16:59:38.063842+0000","last_undegraded":"2024-05-30T16:59:38.063842+0000","last_fullsized":"2024-05-30T16:59:38.063842+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:05.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477724+0000","last_change":"2024-05-30T16:59:37.077457+0000","last_active":"2024-05-30T16:59:38.477724+0000","last_peered":"2024-05-30T16:59:38.477724+0000","last_clean":"2024-05-30T16:59:38.477724+0000","last_became_active":"2024-05-30T16:59:37.077159+0000","last_became_peered":"2024-05-30T16:59:37.077159+0000","last_unstale":"2024-05-30T16:59:38.477724+0000","last_undegraded":"2024-05-30T16:59:38.477724+0000","last_fullsized":"2024-05-30T16:59:38.477724+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:36.046240+0000","last_clean_scrub_stamp":"2024-05-30T16:59:36.046240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:09:43.658858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.478869+0000","last_change":"2024-05-30T16:59:36.075731+0000","last_active":"2024-05-30T16:59:38.478869+0000","last_peered":"2024-05-30T16:59:38.478869+0000","last_clean":"2024-05-30T16:59:38.478869+0000","last_became_active":"2024-05-30T16:59:36.075265+0000","last_became_peered":"2024-05-30T16:59:36.075265+0000","last_unstale":"2024-05-30T16:59:38.478869+0000","last_undegraded":"2024-05-30T16:59:38.478869+0000","last_fullsized":"2024-05-30T16:59:38.478869+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:59:35.042868+0000","last_clean_scrub_stamp":"2024-05-30T16:59:35.042868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:53.038839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":301,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-30T16:59:38.477997+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T16:59:38.477997+0000","last_peered":"2024-05-30T16:59:38.477997+0000","last_clean":"2024-05-30T16:59:38.477997+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T16:59:38.477997+0000","last_undegraded":"2024-05-30T16:59:38.477997+0000","last_fullsized":"2024-05-30T16:59:38.477997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509572,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100804,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271036,"statfs":{"total":96636764160,"available":96533540864,"internally_reserved":0,"allocated":1695744,"data_stored":1062721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101513674},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509573,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118284,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253556,"statfs":{"total":96636764160,"available":96515641344,"internally_reserved":0,"allocated":1110016,"data_stored":472977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509573,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72460,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299380,"statfs":{"total":96636764160,"available":96562565120,"internally_reserved":0,"allocated":1114112,"data_stored":473917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509574,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76608,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295232,"statfs":{"total":96636764160,"available":96558317568,"internally_reserved":0,"allocated":1097728,"data_stored":472283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509573,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100224,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271616,"statfs":{"total":96636764160,"available":96534134784,"internally_reserved":0,"allocated":1101824,"data_stored":472865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509573,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82184,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94289656,"statfs":{"total":96636764160,"available":96552607744,"internally_reserved":0,"allocated":1110016,"data_stored":472477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509573,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77192,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294648,"statfs":{"total":96636764160,"available":96557719552,"internally_reserved":0,"allocated":1695744,"data_stored":1062685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542277,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122440,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249400,"statfs":{"total":96636764160,"available":96511385600,"internally_reserved":0,"allocated":1110016,"data_stored":473895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:59:46.148 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:59:46.149 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T16:59:46.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa372600640 1 Processor -- start 2024-05-30T16:59:46.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa372600640 1 -- start start 2024-05-30T16:59:46.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa372600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa36c06e520 0x7fa36c15f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:46.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa372600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa36c0ae620 0x7fa36c0aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:46.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa372600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36c15b050 con 0x7fa36c15e7e0 2024-05-30T16:59:46.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa372600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa36c06fed0 con 0x7fa36c06e520 2024-05-30T16:59:46.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa372600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa36c0ae190 con 0x7fa36c0ae620 2024-05-30T16:59:46.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa36aa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa36c06e520 0x7fa36c15f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:46.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa36be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa36c0ae620 0x7fa36c0aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:46.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa36aa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa36c06e520 0x7fa36c15f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:47110/0 (socket says 172.21.15.59:47110) 2024-05-30T16:59:46.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa36aa00640 1 -- 172.21.15.59:0/729083038 learned_addr learned my addr 172.21.15.59:0/729083038 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:46.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa36b400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa36c15e7e0 0x7fa36c15ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:46922/0 (socket says 172.21.15.59:46922) 2024-05-30T16:59:46.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa36aa00640 1 -- 172.21.15.59:0/729083038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa36c0ae620 msgr2=0x7fa36c0aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:46.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa36aa00640 1 --2- 172.21.15.59:0/729083038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa36c0ae620 0x7fa36c0aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa36aa00640 1 -- 172.21.15.59:0/729083038 >> v1:172.21.15.107:6789/0 conn(0x7fa36c15e7e0 legacy=0x7fa36c15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.340+0000 7fa36aa00640 1 -- 172.21.15.59:0/729083038 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36c070100 con 0x7fa36c06e520 2024-05-30T16:59:46.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.344+0000 7fa36aa00640 1 --2- 172.21.15.59:0/729083038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa36c06e520 0x7fa36c15f2d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa35800bb10 tx=0x7fa35801eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7680e98238eb8d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:46.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.344+0000 7fa36a000640 1 -- 172.21.15.59:0/729083038 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3580b4070 con 0x7fa36c06e520 2024-05-30T16:59:46.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.344+0000 7fa36a000640 1 -- 172.21.15.59:0/729083038 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3580a7bc0 con 0x7fa36c06e520 2024-05-30T16:59:46.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.344+0000 7fa36a000640 1 -- 172.21.15.59:0/729083038 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3580af440 con 0x7fa36c06e520 2024-05-30T16:59:46.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.344+0000 7fa372600640 1 -- 172.21.15.59:0/729083038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa36c06e520 msgr2=0x7fa36c15f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.344+0000 7fa372600640 1 --2- 172.21.15.59:0/729083038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa36c06e520 0x7fa36c15f2d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa35800bb10 tx=0x7fa35801eb70 comp rx=0 tx=0).stop 2024-05-30T16:59:46.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.344+0000 7fa372600640 1 -- 172.21.15.59:0/729083038 shutdown_connections 2024-05-30T16:59:46.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.344+0000 7fa372600640 1 --2- 172.21.15.59:0/729083038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa36c0ae620 0x7fa36c0aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.344+0000 7fa372600640 1 --2- 172.21.15.59:0/729083038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa36c06e520 0x7fa36c15f2d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.344+0000 7fa372600640 1 -- 172.21.15.59:0/729083038 >> 172.21.15.59:0/729083038 conn(0x7fa36c0cd680 msgr2=0x7fa36c0cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:46.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.344+0000 7fa372600640 1 -- 172.21.15.59:0/729083038 shutdown_connections 2024-05-30T16:59:46.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.344+0000 7fa372600640 1 -- 172.21.15.59:0/729083038 wait complete. 2024-05-30T16:59:46.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa372600640 1 Processor -- start 2024-05-30T16:59:46.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa372600640 1 -- start start 2024-05-30T16:59:46.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa372600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa36c0ae620 0x7fa36c14f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa372600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa36c15e7e0 0x7fa36c153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa372600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa36c15dba0 0x7fa36c155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa372600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c0aefe0 con 0x7fa36c15e7e0 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa372600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c0b0520 con 0x7fa36c0ae620 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa372600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa36c0af160 con 0x7fa36c15dba0 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa36aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa36c15e7e0 0x7fa36c153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa36aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa36c15e7e0 0x7fa36c153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40416/0 (socket says 172.21.15.59:40416) 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa36aa00640 1 -- 172.21.15.59:0/2173370424 learned_addr learned my addr 172.21.15.59:0/2173370424 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa36b400640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa36c0ae620 0x7fa36c14f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa36be00640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa36c15dba0 0x7fa36c155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa36aa00640 1 -- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa36c15dba0 msgr2=0x7fa36c155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa36aa00640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa36c15dba0 0x7fa36c155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa36aa00640 1 -- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa36c0ae620 msgr2=0x7fa36c14f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa36aa00640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa36c0ae620 0x7fa36c14f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa36aa00640 1 -- 172.21.15.59:0/2173370424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36c153f80 con 0x7fa36c15e7e0 2024-05-30T16:59:46.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa36aa00640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa36c15e7e0 0x7fa36c153630 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa35800b2c0 tx=0x7fa35801d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:46.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa363400640 1 -- 172.21.15.59:0/2173370424 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3580bf070 con 0x7fa36c15e7e0 2024-05-30T16:59:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa363400640 1 -- 172.21.15.59:0/2173370424 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3580ba440 con 0x7fa36c15e7e0 2024-05-30T16:59:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa363400640 1 -- 172.21.15.59:0/2173370424 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3580b4070 con 0x7fa36c15e7e0 2024-05-30T16:59:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa372600640 1 -- 172.21.15.59:0/2173370424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa36c154260 con 0x7fa36c15e7e0 2024-05-30T16:59:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.348+0000 7fa372600640 1 -- 172.21.15.59:0/2173370424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa36c154820 con 0x7fa36c15e7e0 2024-05-30T16:59:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.352+0000 7fa372600640 1 -- 172.21.15.59:0/2173370424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa36c0691a0 con 0x7fa36c15e7e0 2024-05-30T16:59:46.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.352+0000 7fa363400640 1 -- 172.21.15.59:0/2173370424 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fa3580c2070 con 0x7fa36c15e7e0 2024-05-30T16:59:46.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.352+0000 7fa363400640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa34c0694f0 0x7fa34c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:46.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.352+0000 7fa363400640 1 -- 172.21.15.59:0/2173370424 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7fa35811fe30 con 0x7fa36c15e7e0 2024-05-30T16:59:46.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.352+0000 7fa36b400640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa34c0694f0 0x7fa34c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:46.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.352+0000 7fa36b400640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa34c0694f0 0x7fa34c06b9b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa35c000f70 tx=0x7fa35c000ee0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:46.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.356+0000 7fa363400640 1 -- 172.21.15.59:0/2173370424 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa358018820 con 0x7fa36c15e7e0 2024-05-30T16:59:46.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.584+0000 7fa372600640 1 -- 172.21.15.59:0/2173370424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa36c0b0300 con 0x7fa36c15e7e0 2024-05-30T16:59:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.584+0000 7fa363400640 1 -- 172.21.15.59:0/2173370424 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7fa3580f14a0 con 0x7fa36c15e7e0 2024-05-30T16:59:46.587 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-05-30T16:59:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA== 2024-05-30T16:59:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-05-30T16:59:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-05-30T16:59:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T16:59:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-05-30T16:59:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.588+0000 7fa372600640 1 -- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa34c0694f0 msgr2=0x7fa34c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.588+0000 7fa372600640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa34c0694f0 0x7fa34c06b9b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa35c000f70 tx=0x7fa35c000ee0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.588+0000 7fa372600640 1 -- 172.21.15.59:0/2173370424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa36c15e7e0 msgr2=0x7fa36c153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.588+0000 7fa372600640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa36c15e7e0 0x7fa36c153630 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa35800b2c0 tx=0x7fa35801d3b0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.588+0000 7fa372600640 1 -- 172.21.15.59:0/2173370424 shutdown_connections 2024-05-30T16:59:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.588+0000 7fa372600640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa34c0694f0 0x7fa34c06b9b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.588+0000 7fa372600640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa36c15dba0 0x7fa36c155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.588+0000 7fa372600640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa36c15e7e0 0x7fa36c153630 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.588+0000 7fa372600640 1 --2- 172.21.15.59:0/2173370424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa36c0ae620 0x7fa36c14f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.588+0000 7fa372600640 1 -- 172.21.15.59:0/2173370424 >> 172.21.15.59:0/2173370424 conn(0x7fa36c0cd680 msgr2=0x7fa36c159000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:46.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.588+0000 7fa372600640 1 -- 172.21.15.59:0/2173370424 shutdown_connections 2024-05-30T16:59:46.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.588+0000 7fa372600640 1 -- 172.21.15.59:0/2173370424 wait complete. 2024-05-30T16:59:46.609 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:59:46.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.748+0000 7f8fd9400640 1 Processor -- start 2024-05-30T16:59:46.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.748+0000 7f8fd9400640 1 -- start start 2024-05-30T16:59:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd9400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8fd4159df0 0x7f8fd40ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8fd40b3e50 0x7f8fd40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd9400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fd415d730 con 0x7f8fd415a1d0 2024-05-30T16:59:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd9400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f8fd40b3370 con 0x7f8fd40b3e50 2024-05-30T16:59:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd9400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8fd40b3650 con 0x7f8fd4159df0 2024-05-30T16:59:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd3200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8fd40b3e50 0x7f8fd40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd3200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8fd40b3e50 0x7f8fd40ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40426/0 (socket says 172.21.15.59:40426) 2024-05-30T16:59:46.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd3200640 1 -- 172.21.15.59:0/2428084175 learned_addr learned my addr 172.21.15.59:0/2428084175 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:46.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd2800640 1 --2- 172.21.15.59:0/2428084175 >> v2:172.21.15.107:3300/0 conn(0x7f8fd4159df0 0x7f8fd40ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:46.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd3200640 1 -- 172.21.15.59:0/2428084175 >> v2:172.21.15.107:3300/0 conn(0x7f8fd4159df0 msgr2=0x7f8fd40ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:46.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd3200640 1 --2- 172.21.15.59:0/2428084175 >> v2:172.21.15.107:3300/0 conn(0x7f8fd4159df0 0x7f8fd40ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd3200640 1 -- 172.21.15.59:0/2428084175 >> v1:172.21.15.107:6789/0 conn(0x7f8fd415a1d0 legacy=0x7f8fd415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd3200640 1 -- 172.21.15.59:0/2428084175 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd40b3930 con 0x7f8fd40b3e50 2024-05-30T16:59:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd3200640 1 --2- 172.21.15.59:0/2428084175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fd40b3e50 0x7f8fd40ad6f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40b4c20 tx=0x7f8fcc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8e90da55565faa server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd1e00640 1 -- 172.21.15.59:0/2428084175 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0a56d0 con 0x7f8fd40b3e50 2024-05-30T16:59:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd1e00640 1 -- 172.21.15.59:0/2428084175 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0a5870 con 0x7f8fd40b3e50 2024-05-30T16:59:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.752+0000 7f8fd1e00640 1 -- 172.21.15.59:0/2428084175 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0a5c40 con 0x7f8fd40b3e50 2024-05-30T16:59:46.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 -- 172.21.15.59:0/2428084175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fd40b3e50 msgr2=0x7f8fd40ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 --2- 172.21.15.59:0/2428084175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fd40b3e50 0x7f8fd40ad6f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40b4c20 tx=0x7f8fcc01c9f0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 -- 172.21.15.59:0/2428084175 shutdown_connections 2024-05-30T16:59:46.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 --2- 172.21.15.59:0/2428084175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fd40b3e50 0x7f8fd40ad6f0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 --2- 172.21.15.59:0/2428084175 >> v2:172.21.15.107:3300/0 conn(0x7f8fd4159df0 0x7f8fd40ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 -- 172.21.15.59:0/2428084175 >> 172.21.15.59:0/2428084175 conn(0x7f8fd40b22d0 msgr2=0x7f8fd40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:46.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 -- 172.21.15.59:0/2428084175 shutdown_connections 2024-05-30T16:59:46.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 -- 172.21.15.59:0/2428084175 wait complete. 2024-05-30T16:59:46.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 Processor -- start 2024-05-30T16:59:46.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 -- start start 2024-05-30T16:59:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8fd40b3e50 0x7f8fd415f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fd4159df0 0x7f8fd4152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fd415a1d0 0x7f8fd4154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd415e720 con 0x7f8fd415a1d0 2024-05-30T16:59:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd415e5a0 con 0x7f8fd4159df0 2024-05-30T16:59:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd9400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd415e8a0 con 0x7f8fd40b3e50 2024-05-30T16:59:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fd415a1d0 0x7f8fd4154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fd415a1d0 0x7f8fd4154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40432/0 (socket says 172.21.15.59:40432) 2024-05-30T16:59:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd3200640 1 -- 172.21.15.59:0/1417800311 learned_addr learned my addr 172.21.15.59:0/1417800311 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fcbe00640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fd4159df0 0x7f8fd4152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd2800640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8fd40b3e50 0x7f8fd415f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd3200640 1 -- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8fd40b3e50 msgr2=0x7f8fd415f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd3200640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8fd40b3e50 0x7f8fd415f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd3200640 1 -- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fd4159df0 msgr2=0x7f8fd4152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd3200640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fd4159df0 0x7f8fd4152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.756+0000 7f8fd3200640 1 -- 172.21.15.59:0/1417800311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd4152e40 con 0x7f8fd415a1d0 2024-05-30T16:59:46.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.760+0000 7f8fd3200640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fd415a1d0 0x7f8fd4154180 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc019600 tx=0x7f8fcc019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.760+0000 7f8fcaa00640 1 -- 172.21.15.59:0/1417800311 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0a56d0 con 0x7f8fd415a1d0 2024-05-30T16:59:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.760+0000 7f8fcaa00640 1 -- 172.21.15.59:0/1417800311 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0be070 con 0x7f8fd415a1d0 2024-05-30T16:59:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.760+0000 7f8fd9400640 1 -- 172.21.15.59:0/1417800311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd41530e0 con 0x7f8fd415a1d0 2024-05-30T16:59:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.760+0000 7f8fcaa00640 1 -- 172.21.15.59:0/1417800311 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc009510 con 0x7f8fd415a1d0 2024-05-30T16:59:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.760+0000 7f8fd9400640 1 -- 172.21.15.59:0/1417800311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd41536a0 con 0x7f8fd415a1d0 2024-05-30T16:59:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.760+0000 7f8fd9400640 1 -- 172.21.15.59:0/1417800311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fd4068a90 con 0x7f8fd415a1d0 2024-05-30T16:59:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.760+0000 7f8fcaa00640 1 -- 172.21.15.59:0/1417800311 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f8fcc0b8470 con 0x7f8fd415a1d0 2024-05-30T16:59:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.760+0000 7f8fcaa00640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8fb00694f0 0x7f8fb006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.760+0000 7f8fcaa00640 1 -- 172.21.15.59:0/1417800311 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7f8fcc120b60 con 0x7f8fd415a1d0 2024-05-30T16:59:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.760+0000 7f8fd2800640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8fb00694f0 0x7f8fb006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:46.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.764+0000 7f8fd2800640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8fb00694f0 0x7f8fb006b9b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4159280 tx=0x7f8fc4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:46.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.764+0000 7f8fcaa00640 1 -- 172.21.15.59:0/1417800311 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8fcc0165e0 con 0x7f8fd415a1d0 2024-05-30T16:59:46.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 -- 172.21.15.59:0/1417800311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8fd40b4ef0 con 0x7f8fd415a1d0 2024-05-30T16:59:46.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fcaa00640 1 -- 172.21.15.59:0/1417800311 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5186 (secure 0 0 0) 0x7f8fcc0f2820 con 0x7f8fd415a1d0 2024-05-30T16:59:46.969 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T16:59:46.969 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2633891859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2633891859},{"type":"v1","addr":"172.21.15.59:6835","nonce":2633891859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6865,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3975520725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3975520725},{"type":"v1","addr":"172.21.15.107:6836","nonce":3975520725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/456119548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":456119548},{"type":"v1","addr":"172.21.15.59:6834","nonce":456119548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:59:36.461027+0000","modified":"2024-05-30T16:59:39.481680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7449},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7449":{"gid":7449,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/1253475085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1253475085},{"type":"v1","addr":"172.21.15.107:6837","nonce":1253475085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7449,"qdb_cluster":[7449]},"id":6}]} 2024-05-30T16:59:46.969 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 52 2024-05-30T16:59:46.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 -- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8fb00694f0 msgr2=0x7f8fb006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8fb00694f0 0x7f8fb006b9b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4159280 tx=0x7f8fc4008040 comp rx=0 tx=0).stop 2024-05-30T16:59:46.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 -- 172.21.15.59:0/1417800311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fd415a1d0 msgr2=0x7f8fd4154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:46.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fd415a1d0 0x7f8fd4154180 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc019600 tx=0x7f8fcc019790 comp rx=0 tx=0).stop 2024-05-30T16:59:46.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 -- 172.21.15.59:0/1417800311 shutdown_connections 2024-05-30T16:59:46.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8fb00694f0 0x7f8fb006b9b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fd415a1d0 0x7f8fd4154180 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fd4159df0 0x7f8fd4152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 --2- 172.21.15.59:0/1417800311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8fd40b3e50 0x7f8fd415f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 -- 172.21.15.59:0/1417800311 >> 172.21.15.59:0/1417800311 conn(0x7f8fd40b22d0 msgr2=0x7f8fd40b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 -- 172.21.15.59:0/1417800311 shutdown_connections 2024-05-30T16:59:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:46.968+0000 7f8fd9400640 1 -- 172.21.15.59:0/1417800311 wait complete. 2024-05-30T16:59:47.393 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T16:59:36.461027+0000', 'modified': '2024-05-30T16:59:39.481680+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7449}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7449': {'gid': 7449, 'name': 'd', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.107:6837/1253475085', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6835', 'nonce': 1253475085}, {'type': 'v1', 'addr': '172.21.15.107:6837', 'nonce': 1253475085}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7449, 'qdb_cluster': [7449]} 2024-05-30T16:59:47.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T16:59:47.394 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-30T16:59:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.536+0000 7fe319200640 1 Processor -- start 2024-05-30T16:59:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.536+0000 7fe319200640 1 -- start start 2024-05-30T16:59:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.536+0000 7fe319200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe31415e710 0x7fe3141614e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.536+0000 7fe319200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3141627a0 con 0x7fe314161a20 2024-05-30T16:59:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.536+0000 7fe319200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe314162a80 con 0x7fe314161ea0 2024-05-30T16:59:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.536+0000 7fe319200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe3140d0660 con 0x7fe31415e710 2024-05-30T16:59:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.536+0000 7fe30be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe314161a20 0x7fe3140d0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51504/0 (socket says 172.21.15.59:51504) 2024-05-30T16:59:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.536+0000 7fe30be00640 1 -- 172.21.15.59:0/918533791 learned_addr learned my addr 172.21.15.59:0/918533791 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.536+0000 7fe311e00640 1 --2- 172.21.15.59:0/918533791 >> v2:172.21.15.107:3300/0 conn(0x7fe31415e710 0x7fe3141614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.536+0000 7fe311400640 1 -- 172.21.15.59:0/918533791 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2562417472 0 0) 0x7fe3141627a0 con 0x7fe314161a20 2024-05-30T16:59:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.536+0000 7fe311400640 1 -- 172.21.15.59:0/918533791 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2f8003530 con 0x7fe314161a20 2024-05-30T16:59:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe311400640 1 -- 172.21.15.59:0/918533791 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011901062 0 0) 0x7fe314162a80 con 0x7fe314161ea0 2024-05-30T16:59:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe311400640 1 -- 172.21.15.59:0/918533791 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3141627a0 con 0x7fe314161ea0 2024-05-30T16:59:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe311e00640 1 -- 172.21.15.59:0/918533791 >> v1:172.21.15.107:6789/0 conn(0x7fe314161ea0 legacy=0x7fe3140d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe311e00640 1 -- 172.21.15.59:0/918533791 >> v1:172.21.15.59:6789/0 conn(0x7fe314161a20 legacy=0x7fe3140d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe311e00640 1 -- 172.21.15.59:0/918533791 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe314162d60 con 0x7fe31415e710 2024-05-30T16:59:47.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe311e00640 1 --2- 172.21.15.59:0/918533791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe31415e710 0x7fe3141614e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe3040097c0 tx=0x7fe30401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5b5be3e46e66545 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe311400640 1 -- 172.21.15.59:0/918533791 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3040b1070 con 0x7fe31415e710 2024-05-30T16:59:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe311400640 1 -- 172.21.15.59:0/918533791 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3040ac410 con 0x7fe31415e710 2024-05-30T16:59:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe311400640 1 -- 172.21.15.59:0/918533791 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3040ac7e0 con 0x7fe31415e710 2024-05-30T16:59:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe319200640 1 -- 172.21.15.59:0/918533791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe31415e710 msgr2=0x7fe3141614e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe319200640 1 --2- 172.21.15.59:0/918533791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe31415e710 0x7fe3141614e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe3040097c0 tx=0x7fe30401c4a0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe319200640 1 -- 172.21.15.59:0/918533791 shutdown_connections 2024-05-30T16:59:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe319200640 1 --2- 172.21.15.59:0/918533791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe31415e710 0x7fe3141614e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.540+0000 7fe319200640 1 -- 172.21.15.59:0/918533791 >> 172.21.15.59:0/918533791 conn(0x7fe3140b3f50 msgr2=0x7fe3140b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe319200640 1 -- 172.21.15.59:0/918533791 shutdown_connections 2024-05-30T16:59:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe319200640 1 -- 172.21.15.59:0/918533791 wait complete. 2024-05-30T16:59:47.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe319200640 1 Processor -- start 2024-05-30T16:59:47.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe319200640 1 -- start start 2024-05-30T16:59:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe319200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe31415e710 0x7fe314159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe319200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe314161a20 0x7fe31415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe319200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe314161ea0 0x7fe31415b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe319200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe31415fc80 con 0x7fe314161a20 2024-05-30T16:59:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe319200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe31415fb00 con 0x7fe31415e710 2024-05-30T16:59:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe319200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe3140d18b0 con 0x7fe314161ea0 2024-05-30T16:59:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe30be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe314161a20 0x7fe31415b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe30be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe314161a20 0x7fe31415b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40436/0 (socket says 172.21.15.59:40436) 2024-05-30T16:59:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe30be00640 1 -- 172.21.15.59:0/1808300422 learned_addr learned my addr 172.21.15.59:0/1808300422 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe311e00640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe31415e710 0x7fe314159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe312800640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe314161ea0 0x7fe31415b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe30be00640 1 -- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe314161ea0 msgr2=0x7fe31415b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe30be00640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe314161ea0 0x7fe31415b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe30be00640 1 -- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe31415e710 msgr2=0x7fe314159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe30be00640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe31415e710 0x7fe314159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe30be00640 1 -- 172.21.15.59:0/1808300422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3140ce900 con 0x7fe314161a20 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe30be00640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe314161a20 0x7fe31415b4a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00c4d0 tx=0x7fe2fc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe30a000640 1 -- 172.21.15.59:0/1808300422 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc017070 con 0x7fe314161a20 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe30a000640 1 -- 172.21.15.59:0/1808300422 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc005cf0 con 0x7fe314161a20 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe30a000640 1 -- 172.21.15.59:0/1808300422 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0072b0 con 0x7fe314161a20 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe319200640 1 -- 172.21.15.59:0/1808300422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31409f740 con 0x7fe314161a20 2024-05-30T16:59:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.544+0000 7fe319200640 1 -- 172.21.15.59:0/1808300422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3140b5a00 con 0x7fe314161a20 2024-05-30T16:59:47.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.548+0000 7fe30a000640 1 -- 172.21.15.59:0/1808300422 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fe2fc01a070 con 0x7fe314161a20 2024-05-30T16:59:47.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.548+0000 7fe30a000640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe2f00694f0 0x7fe2f006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.548+0000 7fe30a000640 1 -- 172.21.15.59:0/1808300422 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7fe2fc084c20 con 0x7fe314161a20 2024-05-30T16:59:47.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.548+0000 7fe31c629000 1 Processor -- start 2024-05-30T16:59:47.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe311e00640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe2f00694f0 0x7fe2f006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 -- start start 2024-05-30T16:59:47.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe311e00640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe2f00694f0 0x7fe2f006b9b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe3040ae000 tx=0x7fe304008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:47.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b7d2120 0x56439b7d2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2a40 0x56439b785110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b785650 0x56439b785a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56439b5d6420 con 0x56439b785650 2024-05-30T16:59:47.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56439b570bf0 con 0x56439b7d2a40 2024-05-30T16:59:47.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x56439b5d23e0 con 0x56439b7d2120 2024-05-30T16:59:47.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe312800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b785650 0x56439b785a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe30be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2a40 0x56439b785110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe312800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b785650 0x56439b785a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40452/0 (socket says 172.21.15.59:40452) 2024-05-30T16:59:47.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe311e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b7d2120 0x56439b7d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe312800640 1 -- 172.21.15.59:0/3756023651 learned_addr learned my addr 172.21.15.59:0/3756023651 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:47.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe312800640 1 -- 172.21.15.59:0/3756023651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b7d2120 msgr2=0x56439b7d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:47.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe312800640 1 --2- 172.21.15.59:0/3756023651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b7d2120 0x56439b7d2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe312800640 1 -- 172.21.15.59:0/3756023651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2a40 msgr2=0x56439b785110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:47.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe312800640 1 --2- 172.21.15.59:0/3756023651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2a40 0x56439b785110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe312800640 1 -- 172.21.15.59:0/3756023651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56439b67e450 con 0x56439b785650 2024-05-30T16:59:47.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe312800640 1 --2- 172.21.15.59:0/3756023651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b785650 0x56439b785a30 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe30c001ec0 tx=0x7fe30c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05cba270e3e30 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:47.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe302a00640 1 -- 172.21.15.59:0/3756023651 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0020d0 con 0x56439b785650 2024-05-30T16:59:47.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe302a00640 1 -- 172.21.15.59:0/3756023651 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c018070 con 0x56439b785650 2024-05-30T16:59:47.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe302a00640 1 -- 172.21.15.59:0/3756023651 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c003bc0 con 0x56439b785650 2024-05-30T16:59:47.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 -- 172.21.15.59:0/3756023651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b785650 msgr2=0x56439b785a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 --2- 172.21.15.59:0/3756023651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b785650 0x56439b785a30 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe30c001ec0 tx=0x7fe30c001640 comp rx=0 tx=0).stop 2024-05-30T16:59:47.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 -- 172.21.15.59:0/3756023651 shutdown_connections 2024-05-30T16:59:47.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 --2- 172.21.15.59:0/3756023651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b785650 0x56439b785a30 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 --2- 172.21.15.59:0/3756023651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2a40 0x56439b785110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 --2- 172.21.15.59:0/3756023651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b7d2120 0x56439b7d2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 -- 172.21.15.59:0/3756023651 >> 172.21.15.59:0/3756023651 conn(0x56439b7b2ec0 msgr2=0x56439b7b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:47.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 -- 172.21.15.59:0/3756023651 shutdown_connections 2024-05-30T16:59:47.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 -- 172.21.15.59:0/3756023651 wait complete. 2024-05-30T16:59:47.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.552+0000 7fe31c629000 1 -- start start 2024-05-30T16:59:47.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 1 Processor -- start 2024-05-30T16:59:47.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 0x56439b78ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2120 0x56439b78b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 0x56439b78b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56439b576ec0 con 0x56439b7d2a40 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56439b657120 con 0x56439b7d2120 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x56439b5e1350 con 0x56439b785650 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 10 client.0 _ll_register_callbacks cb 0x56439b5b34d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe312800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 0x56439b78b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe312800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 0x56439b78b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40456/0 (socket says 172.21.15.59:40456) 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe311e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 0x56439b78ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe312800640 1 -- 172.21.15.59:0/2069312555 learned_addr learned my addr 172.21.15.59:0/2069312555 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe30be00640 1 --2- 172.21.15.59:0/2069312555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2120 0x56439b78b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe312800640 1 -- 172.21.15.59:0/2069312555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 msgr2=0x56439b78ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe312800640 1 --2- 172.21.15.59:0/2069312555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 0x56439b78ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe312800640 1 -- 172.21.15.59:0/2069312555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2120 msgr2=0x56439b78b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe312800640 1 --2- 172.21.15.59:0/2069312555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2120 0x56439b78b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe312800640 1 -- 172.21.15.59:0/2069312555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56439b61bf80 con 0x56439b7d2a40 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe312800640 1 --2- 172.21.15.59:0/2069312555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 0x56439b78b5c0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fe30c001680 tx=0x7fe30c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55546a6e5cdead91 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe2f7400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe2f7400640 1 -- 172.21.15.59:0/2069312555 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0020d0 con 0x56439b7d2a40 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 1 -- 172.21.15.59:0/2069312555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe30c018070 con 0x56439b7d2a40 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe2f7400640 1 -- 172.21.15.59:0/2069312555 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7fe30c0052d0 con 0x56439b7d2a40 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe2f7400640 1 -- 172.21.15.59:0/2069312555 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fe30c005510 con 0x56439b7d2a40 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 10 client.7581 fetch_fsmap learned FSMap version 52 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 1 -- 172.21.15.59:0/2069312555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x56439b5aff00 con 0x56439b7d2a40 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe2f7400640 1 -- 172.21.15.59:0/2069312555 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c018070 con 0x56439b7d2a40 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe2f7400640 1 -- 172.21.15.59:0/2069312555 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7fe30c0056b0 con 0x56439b7d2a40 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 10 client.7581 fetch_fsmap finished waiting for FSMap version 52 2024-05-30T16:59:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 10 client.7581 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-30T16:59:47.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 20 client.7581 populate_metadata read hostname 'smithi059' 2024-05-30T16:59:47.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 1 --2- 172.21.15.59:0/2069312555 >> [v2:172.21.15.107:6835/1253475085,v1:172.21.15.107:6837/1253475085] conn(0x56439b7e13c0 0x56439b7e37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 4 client.7581 mds_command: new command op to 7449 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T16:59:47.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe31c629000 1 -- 172.21.15.59:0/2069312555 --> [v2:172.21.15.107:6835/1253475085,v1:172.21.15.107:6837/1253475085] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56439b56fbc0 con 0x56439b7e13c0 2024-05-30T16:59:47.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.556+0000 7fe311e00640 1 --2- 172.21.15.59:0/2069312555 >> [v2:172.21.15.107:6835/1253475085,v1:172.21.15.107:6837/1253475085] conn(0x56439b7e13c0 0x56439b7e37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe311e00640 1 --2- 172.21.15.59:0/2069312555 >> [v2:172.21.15.107:6835/1253475085,v1:172.21.15.107:6837/1253475085] conn(0x56439b7e13c0 0x56439b7e37b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=890988297d70f09b server_cookie=770e7f4bd5567256 in_seq=0 out_seq=0 2024-05-30T16:59:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe2f7400640 10 client.7581 ms_handle_connect on v2:172.21.15.107:6835/1253475085 2024-05-30T16:59:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe2f7400640 1 -- 172.21.15.59:0/2069312555 <== mds.0 v2:172.21.15.107:6835/1253475085 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56439b56fbc0 con 0x56439b7e13c0 2024-05-30T16:59:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe2f7400640 10 client.7581 handle_command_reply: tid=0 2024-05-30T16:59:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe31c629000 1 client.7581 shutdown 2024-05-30T16:59:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe31c629000 1 -- 172.21.15.59:0/2069312555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 msgr2=0x56439b78b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe31c629000 1 --2- 172.21.15.59:0/2069312555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 0x56439b78b5c0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fe30c001680 tx=0x7fe30c001260 comp rx=0 tx=0).stop 2024-05-30T16:59:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe31c629000 1 -- 172.21.15.59:0/2069312555 shutdown_connections 2024-05-30T16:59:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe31c629000 1 --2- 172.21.15.59:0/2069312555 >> [v2:172.21.15.107:6835/1253475085,v1:172.21.15.107:6837/1253475085] conn(0x56439b7e13c0 0x56439b7e37b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe31c629000 1 --2- 172.21.15.59:0/2069312555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 0x56439b78b5c0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe31c629000 1 --2- 172.21.15.59:0/2069312555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2120 0x56439b78b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe31c629000 1 --2- 172.21.15.59:0/2069312555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 0x56439b78ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe2f7400640 0 client.7581 ms_handle_reset on v2:172.21.15.107:6835/1253475085 2024-05-30T16:59:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe31c629000 1 -- 172.21.15.59:0/2069312555 >> 172.21.15.59:0/2069312555 conn(0x56439b7b2ec0 msgr2=0x56439b7b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe31c629000 1 -- 172.21.15.59:0/2069312555 shutdown_connections 2024-05-30T16:59:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe31c629000 1 -- 172.21.15.59:0/2069312555 wait complete. 2024-05-30T16:59:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.560+0000 7fe31c629000 20 client.7581 trim_cache size 0 max 16384 2024-05-30T16:59:47.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 Processor -- start 2024-05-30T16:59:47.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 -- start start 2024-05-30T16:59:47.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 0x56439b7d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2120 0x56439b7d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 0x56439b7e37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe314202e90 con 0x56439b7d2a40 2024-05-30T16:59:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe31409f440 con 0x56439b7d2120 2024-05-30T16:59:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe314202840 con 0x56439b785650 2024-05-30T16:59:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe312800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 0x56439b7e37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe312800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 0x56439b7e37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40464/0 (socket says 172.21.15.59:40464) 2024-05-30T16:59:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe312800640 1 -- 172.21.15.59:0/3589230660 learned_addr learned my addr 172.21.15.59:0/3589230660 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe311e00640 1 --2- 172.21.15.59:0/3589230660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 0x56439b7d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe30be00640 1 --2- 172.21.15.59:0/3589230660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2120 0x56439b7d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe312800640 1 -- 172.21.15.59:0/3589230660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 msgr2=0x56439b7d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe312800640 1 --2- 172.21.15.59:0/3589230660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 0x56439b7d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe312800640 1 -- 172.21.15.59:0/3589230660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2120 msgr2=0x56439b7d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe312800640 1 --2- 172.21.15.59:0/3589230660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2120 0x56439b7d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe312800640 1 -- 172.21.15.59:0/3589230660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56439b7d2870 con 0x56439b7d2a40 2024-05-30T16:59:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe312800640 1 --2- 172.21.15.59:0/3589230660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 0x56439b7e37b0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fe30c007fd0 tx=0x7fe30c01f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe8fdf56b50c6fe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe302000640 1 -- 172.21.15.59:0/3589230660 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c02e020 con 0x56439b7d2a40 2024-05-30T16:59:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe302000640 1 -- 172.21.15.59:0/3589230660 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c038070 con 0x56439b7d2a40 2024-05-30T16:59:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe302000640 1 -- 172.21.15.59:0/3589230660 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c005070 con 0x56439b7d2a40 2024-05-30T16:59:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 -- 172.21.15.59:0/3589230660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 msgr2=0x56439b7e37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 --2- 172.21.15.59:0/3589230660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 0x56439b7e37b0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fe30c007fd0 tx=0x7fe30c01f070 comp rx=0 tx=0).stop 2024-05-30T16:59:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 -- 172.21.15.59:0/3589230660 shutdown_connections 2024-05-30T16:59:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 --2- 172.21.15.59:0/3589230660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2a40 0x56439b7e37b0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 --2- 172.21.15.59:0/3589230660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2120 0x56439b7d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 --2- 172.21.15.59:0/3589230660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 0x56439b7d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 -- 172.21.15.59:0/3589230660 >> 172.21.15.59:0/3589230660 conn(0x56439b7b2ec0 msgr2=0x56439b784100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 -- 172.21.15.59:0/3589230660 shutdown_connections 2024-05-30T16:59:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 -- 172.21.15.59:0/3589230660 wait complete. 2024-05-30T16:59:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 -- start start 2024-05-30T16:59:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.580+0000 7fe31c629000 1 Processor -- start 2024-05-30T16:59:47.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 0x56439b7e68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2120 0x56439b7fd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2a40 0x56439b7fd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56439b5d5730 con 0x56439b7d2120 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56439b5a29e0 con 0x56439b7d2a40 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x56439b5daa50 con 0x56439b785650 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 10 client.0 _ll_register_callbacks cb 0x7fe30c007ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe30be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2120 0x56439b7fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe30be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2120 0x56439b7fd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40466/0 (socket says 172.21.15.59:40466) 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe30be00640 1 -- 172.21.15.59:0/3705565797 learned_addr learned my addr 172.21.15.59:0/3705565797 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe311e00640 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 0x56439b7e68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe312800640 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2a40 0x56439b7fd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe30be00640 1 -- 172.21.15.59:0/3705565797 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 msgr2=0x56439b7e68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe30be00640 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 0x56439b7e68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe30be00640 1 -- 172.21.15.59:0/3705565797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2a40 msgr2=0x56439b7fd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe30be00640 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2a40 0x56439b7fd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe30be00640 1 -- 172.21.15.59:0/3705565797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56439b55ce80 con 0x56439b7d2120 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe30be00640 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2120 0x56439b7fd340 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc055f90 tx=0x7fe2fc014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c044cb6cc8bfc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe2f7400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe2f7400640 1 -- 172.21.15.59:0/3705565797 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc05a0b0 con 0x56439b7d2120 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe2f7400640 1 -- 172.21.15.59:0/3705565797 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7fe2fc05a250 con 0x56439b7d2120 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 1 -- 172.21.15.59:0/3705565797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe30c038070 con 0x56439b7d2120 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe2f7400640 1 -- 172.21.15.59:0/3705565797 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fe2fc0556e0 con 0x56439b7d2120 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 10 client.7587 fetch_fsmap learned FSMap version 52 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 1 -- 172.21.15.59:0/3705565797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x56439b59eb30 con 0x56439b7d2120 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe2f7400640 1 -- 172.21.15.59:0/3705565797 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c038070 con 0x56439b7d2120 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe2f7400640 1 -- 172.21.15.59:0/3705565797 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7fe2fc055880 con 0x56439b7d2120 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 10 client.7587 fetch_fsmap finished waiting for FSMap version 52 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 10 client.7587 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-30T16:59:47.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 20 client.7587 populate_metadata read hostname 'smithi059' 2024-05-30T16:59:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.107:6835/1253475085,v1:172.21.15.107:6837/1253475085] conn(0x56439b8415e0 0x56439b8419c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 4 client.7587 mds_command: new command op to 7449 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T16:59:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe31c629000 1 -- 172.21.15.59:0/3705565797 --> [v2:172.21.15.107:6835/1253475085,v1:172.21.15.107:6837/1253475085] -- command(tid 0: {"prefix": "status"}) -- 0x56439b5e3e40 con 0x56439b8415e0 2024-05-30T16:59:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe311e00640 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.107:6835/1253475085,v1:172.21.15.107:6837/1253475085] conn(0x56439b8415e0 0x56439b8419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe311e00640 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.107:6835/1253475085,v1:172.21.15.107:6837/1253475085] conn(0x56439b8415e0 0x56439b8419c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bef69da765fb68e server_cookie=33e5de84215096b0 in_seq=0 out_seq=0 2024-05-30T16:59:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.584+0000 7fe2f7400640 10 client.7587 ms_handle_connect on v2:172.21.15.107:6835/1253475085 2024-05-30T16:59:47.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe2f7400640 1 -- 172.21.15.59:0/3705565797 <== mds.0 v2:172.21.15.107:6835/1253475085 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56439b5e3e40 con 0x56439b8415e0 2024-05-30T16:59:47.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe2f7400640 10 client.7587 handle_command_reply: tid=0 2024-05-30T16:59:47.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe31c629000 1 client.7587 shutdown 2024-05-30T16:59:47.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe31c629000 1 -- 172.21.15.59:0/3705565797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2120 msgr2=0x56439b7fd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe31c629000 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2120 0x56439b7fd340 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc055f90 tx=0x7fe2fc014040 comp rx=0 tx=0).stop 2024-05-30T16:59:47.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe31c629000 1 -- 172.21.15.59:0/3705565797 shutdown_connections 2024-05-30T16:59:47.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe31c629000 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.107:6835/1253475085,v1:172.21.15.107:6837/1253475085] conn(0x56439b8415e0 0x56439b8419c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe31c629000 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56439b7d2a40 0x56439b7fd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe31c629000 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439b7d2120 0x56439b7fd340 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe31c629000 1 --2- 172.21.15.59:0/3705565797 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56439b785650 0x56439b7e68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe2f7400640 0 client.7587 ms_handle_reset on v2:172.21.15.107:6835/1253475085 2024-05-30T16:59:47.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe31c629000 1 -- 172.21.15.59:0/3705565797 >> 172.21.15.59:0/3705565797 conn(0x56439b7b2ec0 msgr2=0x56439b784100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:47.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe31c629000 1 -- 172.21.15.59:0/3705565797 shutdown_connections 2024-05-30T16:59:47.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe31c629000 1 -- 172.21.15.59:0/3705565797 wait complete. 2024-05-30T16:59:47.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe31c629000 20 client.7587 trim_cache size 0 max 16384 2024-05-30T16:59:47.592 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:59:47.592 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T16:59:47.593 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-05-30T16:59:47.593 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7449, 2024-05-30T16:59:47.593 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-05-30T16:59:47.593 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-05-30T16:59:47.593 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-05-30T16:59:47.593 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 10.534085492999999, 2024-05-30T16:59:47.593 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 52, 2024-05-30T16:59:47.593 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 92, 2024-05-30T16:59:47.593 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 90, 2024-05-30T16:59:47.593 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 15.388317591 2024-05-30T16:59:47.593 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:59:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe319200640 1 -- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe2f00694f0 msgr2=0x7fe2f006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe319200640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe2f00694f0 0x7fe2f006b9b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe3040ae000 tx=0x7fe304008040 comp rx=0 tx=0).stop 2024-05-30T16:59:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe319200640 1 -- 172.21.15.59:0/1808300422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe314161a20 msgr2=0x7fe31415b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe319200640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe314161a20 0x7fe31415b4a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00c4d0 tx=0x7fe2fc00c990 comp rx=0 tx=0).stop 2024-05-30T16:59:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe319200640 1 -- 172.21.15.59:0/1808300422 shutdown_connections 2024-05-30T16:59:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe319200640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe2f00694f0 0x7fe2f006b9b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe319200640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe314161ea0 0x7fe31415b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe319200640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe314161a20 0x7fe31415b4a0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe319200640 1 --2- 172.21.15.59:0/1808300422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe31415e710 0x7fe314159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe319200640 1 -- 172.21.15.59:0/1808300422 >> 172.21.15.59:0/1808300422 conn(0x7fe3140b3f50 msgr2=0x7fe31409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:47.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe319200640 1 -- 172.21.15.59:0/1808300422 shutdown_connections 2024-05-30T16:59:47.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.588+0000 7fe319200640 1 -- 172.21.15.59:0/1808300422 wait complete. 2024-05-30T16:59:47.608 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:59:47.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc73200640 1 Processor -- start 2024-05-30T16:59:47.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc73200640 1 -- start start 2024-05-30T16:59:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc73200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdc7409b890 0x7fdc7406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc73200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc740d0fb0 con 0x7fdc7409b4b0 2024-05-30T16:59:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc73200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc740d1290 con 0x7fdc74162340 2024-05-30T16:59:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc73200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fdc7406fef0 con 0x7fdc7409b890 2024-05-30T16:59:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc71e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdc7409b4b0 0x7fdc740d0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51520/0 (socket says 172.21.15.59:51520) 2024-05-30T16:59:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc71e00640 1 -- 172.21.15.59:0/1419308405 learned_addr learned my addr 172.21.15.59:0/1419308405 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc71400640 1 --2- 172.21.15.59:0/1419308405 >> v2:172.21.15.107:3300/0 conn(0x7fdc7409b890 0x7fdc7406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc70a00640 1 -- 172.21.15.59:0/1419308405 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204893839 0 0) 0x7fdc740d0fb0 con 0x7fdc7409b4b0 2024-05-30T16:59:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc70a00640 1 -- 172.21.15.59:0/1419308405 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc58003530 con 0x7fdc7409b4b0 2024-05-30T16:59:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc71400640 1 -- 172.21.15.59:0/1419308405 >> v1:172.21.15.107:6789/0 conn(0x7fdc74162340 legacy=0x7fdc7415f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc71400640 1 -- 172.21.15.59:0/1419308405 >> v1:172.21.15.59:6789/0 conn(0x7fdc7409b4b0 legacy=0x7fdc740d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.748+0000 7fdc71400640 1 -- 172.21.15.59:0/1419308405 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc740d1570 con 0x7fdc7409b890 2024-05-30T16:59:47.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.752+0000 7fdc71400640 1 --2- 172.21.15.59:0/1419308405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc7409b890 0x7fdc7406cac0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdc600097c0 tx=0x7fdc6001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f2b80446536d4fc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:47.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.752+0000 7fdc70a00640 1 -- 172.21.15.59:0/1419308405 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc600b0070 con 0x7fdc7409b890 2024-05-30T16:59:47.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.752+0000 7fdc70a00640 1 -- 172.21.15.59:0/1419308405 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc600ab600 con 0x7fdc7409b890 2024-05-30T16:59:47.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.752+0000 7fdc70a00640 1 -- 172.21.15.59:0/1419308405 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc600ab9d0 con 0x7fdc7409b890 2024-05-30T16:59:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.752+0000 7fdc73200640 1 -- 172.21.15.59:0/1419308405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc7409b890 msgr2=0x7fdc7406cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.752+0000 7fdc73200640 1 --2- 172.21.15.59:0/1419308405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc7409b890 0x7fdc7406cac0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdc600097c0 tx=0x7fdc6001c3e0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.752+0000 7fdc73200640 1 -- 172.21.15.59:0/1419308405 shutdown_connections 2024-05-30T16:59:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.752+0000 7fdc73200640 1 --2- 172.21.15.59:0/1419308405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc7409b890 0x7fdc7406cac0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.752+0000 7fdc73200640 1 -- 172.21.15.59:0/1419308405 >> 172.21.15.59:0/1419308405 conn(0x7fdc740b3ec0 msgr2=0x7fdc740b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.752+0000 7fdc73200640 1 -- 172.21.15.59:0/1419308405 shutdown_connections 2024-05-30T16:59:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.752+0000 7fdc73200640 1 -- 172.21.15.59:0/1419308405 wait complete. 2024-05-30T16:59:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc73200640 1 Processor -- start 2024-05-30T16:59:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc73200640 1 -- start start 2024-05-30T16:59:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc73200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc7409b4b0 0x7fdc740ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc73200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc7409b890 0x7fdc74157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc73200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc74162340 0x7fdc740b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc73200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdc74162b60 con 0x7fdc7409b4b0 2024-05-30T16:59:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc73200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdc74070b70 con 0x7fdc7409b890 2024-05-30T16:59:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc73200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdc741fbe30 con 0x7fdc74162340 2024-05-30T16:59:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc71e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc7409b4b0 0x7fdc740ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc71e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc7409b4b0 0x7fdc740ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40468/0 (socket says 172.21.15.59:40468) 2024-05-30T16:59:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc71e00640 1 -- 172.21.15.59:0/687331944 learned_addr learned my addr 172.21.15.59:0/687331944 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc71400640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc7409b890 0x7fdc74157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc72800640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc74162340 0x7fdc740b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc71e00640 1 -- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc74162340 msgr2=0x7fdc740b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc71e00640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc74162340 0x7fdc740b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc71e00640 1 -- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc7409b890 msgr2=0x7fdc74157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc71e00640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc7409b890 0x7fdc74157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc71e00640 1 -- 172.21.15.59:0/687331944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc741fc110 con 0x7fdc7409b4b0 2024-05-30T16:59:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc71e00640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc7409b4b0 0x7fdc740ca020 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400c4d0 tx=0x7fdc6400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc6a000640 1 -- 172.21.15.59:0/687331944 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc64017070 con 0x7fdc7409b4b0 2024-05-30T16:59:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc6a000640 1 -- 172.21.15.59:0/687331944 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc64005cf0 con 0x7fdc7409b4b0 2024-05-30T16:59:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc6a000640 1 -- 172.21.15.59:0/687331944 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc64007270 con 0x7fdc7409b4b0 2024-05-30T16:59:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc73200640 1 -- 172.21.15.59:0/687331944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc741fc3f0 con 0x7fdc7409b4b0 2024-05-30T16:59:47.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.756+0000 7fdc73200640 1 -- 172.21.15.59:0/687331944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc74157e90 con 0x7fdc7409b4b0 2024-05-30T16:59:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.760+0000 7fdc73200640 1 -- 172.21.15.59:0/687331944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc74068a90 con 0x7fdc7409b4b0 2024-05-30T16:59:47.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.760+0000 7fdc6a000640 1 -- 172.21.15.59:0/687331944 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fdc6401a070 con 0x7fdc7409b4b0 2024-05-30T16:59:47.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.760+0000 7fdc6a000640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdc540694f0 0x7fdc5406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:47.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.760+0000 7fdc6a000640 1 -- 172.21.15.59:0/687331944 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7fdc64084bc0 con 0x7fdc7409b4b0 2024-05-30T16:59:47.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.760+0000 7fdc71400640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdc540694f0 0x7fdc5406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:47.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.760+0000 7fdc71400640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdc540694f0 0x7fdc5406b9b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdc600ad000 tx=0x7fdc60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:47.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.764+0000 7fdc6a000640 1 -- 172.21.15.59:0/687331944 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdc64056230 con 0x7fdc7409b4b0 2024-05-30T16:59:47.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.964+0000 7fdc73200640 1 -- 172.21.15.59:0/687331944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdc7415d1a0 con 0x7fdc7409b4b0 2024-05-30T16:59:47.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.964+0000 7fdc6a000640 1 -- 172.21.15.59:0/687331944 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) ==== 53+0+73 (secure 0 0 0) 0x7fdc6405a530 con 0x7fdc7409b4b0 2024-05-30T16:59:47.966 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:59:47.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.968+0000 7fdc73200640 1 -- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdc540694f0 msgr2=0x7fdc5406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.968+0000 7fdc73200640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdc540694f0 0x7fdc5406b9b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdc600ad000 tx=0x7fdc60008040 comp rx=0 tx=0).stop 2024-05-30T16:59:47.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.968+0000 7fdc73200640 1 -- 172.21.15.59:0/687331944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc7409b4b0 msgr2=0x7fdc740ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:47.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.968+0000 7fdc73200640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc7409b4b0 0x7fdc740ca020 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400c4d0 tx=0x7fdc6400c990 comp rx=0 tx=0).stop 2024-05-30T16:59:47.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.968+0000 7fdc73200640 1 -- 172.21.15.59:0/687331944 shutdown_connections 2024-05-30T16:59:47.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.968+0000 7fdc73200640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdc540694f0 0x7fdc5406b9b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.968+0000 7fdc73200640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc74162340 0x7fdc740b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.968+0000 7fdc73200640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc7409b890 0x7fdc74157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.968+0000 7fdc73200640 1 --2- 172.21.15.59:0/687331944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc7409b4b0 0x7fdc740ca020 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:47.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.968+0000 7fdc73200640 1 -- 172.21.15.59:0/687331944 >> 172.21.15.59:0/687331944 conn(0x7fdc740b3ec0 msgr2=0x7fdc7415ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:47.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.968+0000 7fdc73200640 1 -- 172.21.15.59:0/687331944 shutdown_connections 2024-05-30T16:59:47.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:47.968+0000 7fdc73200640 1 -- 172.21.15.59:0/687331944 wait complete. 2024-05-30T16:59:47.988 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:59:47.988 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:59:47.989 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-05-30T16:59:47.989 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T16:59:47.989 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:59:47.989 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:59:47.989 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:59:47.989 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:59:47.989 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:59:47.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:47.989 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-05-30T16:59:47.999 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:59:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:59:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:59:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:59:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-05-30T16:59:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:59:47.999 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:59:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-05-30T16:59:47.999 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41801sec preferred_lft 41801sec 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:46:82:05:9a brd ff:ff:ff:ff:ff:ff 2024-05-30T16:59:48.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:59:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T16:59:48.002 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:59:48.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:48.002 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:59:48.057 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-05-30T16:59:48.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:48.059 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-05-30T16:59:48.112 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-05-30T16:59:48.112 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:59:48.113 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T16:59:48.113 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T16:59:48.113 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T16:59:48.113 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:59:48.113 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:59:48.113 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T16:59:48.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T16:59:48.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T16:59:48.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T16:59:48.113 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T16:59:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:59:48.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:59:48.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:48.252 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-05-30T16:59:48.261 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T16:59:48.261 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T16:59:48.262 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:59:48.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:48.262 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-05-30T16:59:48.323 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-30T16:59:48.323 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:59:48.323 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T16:59:48.380 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:59:48.380 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:59:48.380 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:59:48.431 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:59:48.492 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:59:48.545 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:59:48.545 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:59:48.545 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:59:48.545 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:59:48.545 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:59:48.545 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:59:48.545 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:59:48.545 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:59:48.545 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:59:48.545 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:59:48.546 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:59:48.547 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:59:48.547 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:59:48.547 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:59:48.547 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:59:48.547 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:59:48.547 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:59:48.547 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:59:48.547 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:59:48.547 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:59:48.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:48.548 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:59:48.604 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-30T16:59:48.604 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-30T16:59:48.656 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T16:59:48.677 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T16:59:48.729 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T16:59:48.729 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T16:59:48.729 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T16:59:48.729 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T16:59:48.729 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T16:59:48.729 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T16:59:48.729 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T16:59:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:59:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:59:48.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:48.732 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T16:59:48.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:2024-05-30T16:59:48.752+0000 7fc67524e580 -1 init, newargv = 0x558ec8236f10 newargc=15 2024-05-30T16:59:48.753 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[46002]: starting ceph client 2024-05-30T16:59:48.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[46002]: starting fuse 2024-05-30T16:59:48.762 INFO:teuthology.orchestra.run.smithi059.stdout:44 2024-05-30T16:59:48.762 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-30T16:59:48.762 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2024-05-30T16:59:48.762 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> import re 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2024-05-30T16:59:48.763 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-30T16:59:48.764 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-30T16:59:48.764 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-30T16:59:48.764 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2024-05-30T16:59:48.764 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2024-05-30T16:59:48.764 DEBUG:teuthology.orchestra.run.smithi059:> return f 2024-05-30T16:59:48.764 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-30T16:59:48.764 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T16:59:48.764 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.0")) 2024-05-30T16:59:48.764 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-05-30T16:59:48.892 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.0.46002.asok 2024-05-30T16:59:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:59:48.903 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46002.asok 2024-05-30T16:59:48.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:48.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46002.asok status 2024-05-30T16:59:49.084 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T16:59:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2024-05-30T16:59:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "9ed025fbf4406fb54980a0647506b15895b6d863", 2024-05-30T16:59:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-3154-g9ed025fb (9ed025fbf4406fb54980a0647506b15895b6d863) squid (dev)", 2024-05-30T16:59:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "0", 2024-05-30T16:59:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2024-05-30T16:59:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-30T16:59:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "46002", 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7599, 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 7599 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:59:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:59:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1774563252 2024-05-30T16:59:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T16:59:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T16:59:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T16:59:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1774563252 2024-05-30T16:59:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T16:59:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.7599 192.168.0.1:0/1774563252", 2024-05-30T16:59:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/1774563252", 2024-05-30T16:59:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2024-05-30T16:59:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 52, 2024-05-30T16:59:49.087 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 92, 2024-05-30T16:59:49.087 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2024-05-30T16:59:49.087 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2024-05-30T16:59:49.087 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2024-05-30T16:59:49.087 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T16:59:49.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:49.100 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2024-05-30T16:59:49.100 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-30T16:59:49.109 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2024-05-30T16:59:49.109 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-30T16:59:49.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:49.110 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:59:49.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T16:59:49.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808ec00640 1 Processor -- start 2024-05-30T16:59:49.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808ec00640 1 -- start start 2024-05-30T16:59:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808ec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8088156b80 0x7f80880b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808ec00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8088070030 con 0x7f808809aa40 2024-05-30T16:59:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808ec00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808815d710 con 0x7f808806fb50 2024-05-30T16:59:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808ec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f80880719f0 con 0x7f8088156b80 2024-05-30T16:59:49.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808e200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f808809aa40 0x7f80880d0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51524/0 (socket says 172.21.15.59:51524) 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808e200640 1 -- 172.21.15.59:0/12651575 learned_addr learned my addr 172.21.15.59:0/12651575 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808d800640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8088156b80 0x7f80880b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926746652 0 0) 0x7f8088070030 con 0x7f808809aa40 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8070003530 con 0x7f808809aa40 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839778994 0 0) 0x7f808815d710 con 0x7f808806fb50 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8088070030 con 0x7f808806fb50 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3203569597 0 0) 0x7f8070003530 con 0x7f808809aa40 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8088156b80 msgr2=0x7f80880b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8088156b80 0x7f80880b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 >> v1:172.21.15.107:6789/0 conn(0x7f808806fb50 legacy=0x7f80880d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8088071680 con 0x7f808809aa40 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f8080001a00 con 0x7f808809aa40 2024-05-30T16:59:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808d800640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8088156b80 0x7f80880b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 >> v1:172.21.15.59:6789/0 conn(0x7f808809aa40 legacy=0x7f80880d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8070003b80 0x7f8070003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8070004810 0x7f8070004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8088156b80 0x7f80700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f80880719f0 con 0x7f8070004810 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f807000ba00 con 0x7f8070003b80 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f807000bc00 con 0x7f8088156b80 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808ce00640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8070004810 0x7f8070004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808d800640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8070003b80 0x7f8070003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808e200640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8088156b80 0x7f80700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808ce00640 1 -- 172.21.15.59:0/12651575 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8088156b80 msgr2=0x7f80700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808ce00640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8088156b80 0x7f80700051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808ce00640 1 -- 172.21.15.59:0/12651575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8070003b80 msgr2=0x7f8070003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808ce00640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8070003b80 0x7f8070003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:49.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.360+0000 7f808ce00640 1 -- 172.21.15.59:0/12651575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8070003530 con 0x7f8070004810 2024-05-30T16:59:49.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.364+0000 7f808ce00640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8070004810 0x7f8070004c90 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f8074007fd0 tx=0x7f807401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcadef358bb6b0c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:49.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.364+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8074001520 con 0x7f8070004810 2024-05-30T16:59:49.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.364+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80740052f0 con 0x7f8070004810 2024-05-30T16:59:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.364+0000 7f8087e00640 1 -- 172.21.15.59:0/12651575 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80740a8910 con 0x7f8070004810 2024-05-30T16:59:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.364+0000 7f808ec00640 1 -- 172.21.15.59:0/12651575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8070004810 msgr2=0x7f8070004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.364+0000 7f808ec00640 1 --2- 172.21.15.59:0/12651575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8070004810 0x7f8070004c90 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f8074007fd0 tx=0x7f807401ecb0 comp rx=0 tx=0).stop 2024-05-30T16:59:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.364+0000 7f808e200640 1 -- 172.21.15.59:0/12651575 reap_dead start 2024-05-30T16:59:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.364+0000 7f808ec00640 1 -- 172.21.15.59:0/12651575 shutdown_connections 2024-05-30T16:59:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.364+0000 7f808ec00640 1 -- 172.21.15.59:0/12651575 >> 172.21.15.59:0/12651575 conn(0x7f80880b3ed0 msgr2=0x7f80880b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.364+0000 7f808ec00640 1 -- 172.21.15.59:0/12651575 shutdown_connections 2024-05-30T16:59:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.364+0000 7f808ec00640 1 -- 172.21.15.59:0/12651575 wait complete. 2024-05-30T16:59:49.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808ec00640 1 Processor -- start 2024-05-30T16:59:49.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808ec00640 1 -- start start 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808ec00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8070004810 0x7f808806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808ec00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80880b0f90 0x7f80881439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808ec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80881f8010 0x7f80881f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808ec00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f808815d9f0 con 0x7f8070004810 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808ec00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8088156f60 con 0x7f80880b0f90 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808ec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f80880b1ad0 con 0x7f80881f8010 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8070004810 0x7f808806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8070004810 0x7f808806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40482/0 (socket says 172.21.15.59:40482) 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808d800640 1 -- 172.21.15.59:0/3443923242 learned_addr learned my addr 172.21.15.59:0/3443923242 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808ce00640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80880b0f90 0x7f80881439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808e200640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80881f8010 0x7f80881f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808d800640 1 -- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80881f8010 msgr2=0x7f80881f84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808d800640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80881f8010 0x7f80881f84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:49.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808d800640 1 -- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80880b0f90 msgr2=0x7f80881439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:49.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808d800640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80880b0f90 0x7f80881439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:49.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808d800640 1 -- 172.21.15.59:0/3443923242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8088143f00 con 0x7f8070004810 2024-05-30T16:59:49.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808d800640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8070004810 0x7f808806d690 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f807c011a30 tx=0x7f807c011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:49.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f8085600640 1 -- 172.21.15.59:0/3443923242 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c00fbb0 con 0x7f8070004810 2024-05-30T16:59:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f8085600640 1 -- 172.21.15.59:0/3443923242 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c00fd50 con 0x7f8070004810 2024-05-30T16:59:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f8085600640 1 -- 172.21.15.59:0/3443923242 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c004270 con 0x7f8070004810 2024-05-30T16:59:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808ec00640 1 -- 172.21.15.59:0/3443923242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f808806dc70 con 0x7f8070004810 2024-05-30T16:59:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.368+0000 7f808ec00640 1 -- 172.21.15.59:0/3443923242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f808806e230 con 0x7f8070004810 2024-05-30T16:59:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.372+0000 7f808ec00640 1 -- 172.21.15.59:0/3443923242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8088068a90 con 0x7f8070004810 2024-05-30T16:59:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.372+0000 7f8085600640 1 -- 172.21.15.59:0/3443923242 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f807c012040 con 0x7f8070004810 2024-05-30T16:59:49.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.372+0000 7f8085600640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8068069520 0x7f806806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:49.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.372+0000 7f8085600640 1 -- 172.21.15.59:0/3443923242 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f807c085b40 con 0x7f8070004810 2024-05-30T16:59:49.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.372+0000 7f808ce00640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8068069520 0x7f806806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:49.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.376+0000 7f808ce00640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8068069520 0x7f806806b9e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f80740b0000 tx=0x7f80740aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:49.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.376+0000 7f8085600640 1 -- 172.21.15.59:0/3443923242 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f807c019070 con 0x7f8070004810 2024-05-30T16:59:49.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:49.580+0000 7f808ec00640 1 -- 172.21.15.59:0/3443923242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f80880b3cb0 con 0x7f8070004810 2024-05-30T16:59:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.136+0000 7f8085600640 1 -- 172.21.15.59:0/3443923242 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v53) ==== 136+0+0 (secure 0 0 0) 0x7f807c0571b0 con 0x7f8070004810 2024-05-30T16:59:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.140+0000 7f808ec00640 1 -- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8068069520 msgr2=0x7f806806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.140+0000 7f808ec00640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8068069520 0x7f806806b9e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f80740b0000 tx=0x7f80740aa070 comp rx=0 tx=0).stop 2024-05-30T16:59:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.140+0000 7f808ec00640 1 -- 172.21.15.59:0/3443923242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8070004810 msgr2=0x7f808806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.140+0000 7f808ec00640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8070004810 0x7f808806d690 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f807c011a30 tx=0x7f807c011ef0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.140+0000 7f808ec00640 1 -- 172.21.15.59:0/3443923242 shutdown_connections 2024-05-30T16:59:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.140+0000 7f808ec00640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8068069520 0x7f806806b9e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.140+0000 7f808ec00640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80881f8010 0x7f80881f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.140+0000 7f808ec00640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80880b0f90 0x7f80881439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.140+0000 7f808ec00640 1 --2- 172.21.15.59:0/3443923242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8070004810 0x7f808806d690 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.140+0000 7f808ec00640 1 -- 172.21.15.59:0/3443923242 >> 172.21.15.59:0/3443923242 conn(0x7f80880b3ed0 msgr2=0x7f80880d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.140+0000 7f808ec00640 1 -- 172.21.15.59:0/3443923242 shutdown_connections 2024-05-30T16:59:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.140+0000 7f808ec00640 1 -- 172.21.15.59:0/3443923242 wait complete. 2024-05-30T16:59:50.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:59:50.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.304+0000 7f5856600640 1 Processor -- start 2024-05-30T16:59:50.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.304+0000 7f5856600640 1 -- start start 2024-05-30T16:59:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5856600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f585015e7e0 0x7f58500b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5856600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58500b73a0 0x7f585009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5856600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f585009af80 0x7f585006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5856600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f58500b61f0 con 0x7f58500b73a0 2024-05-30T16:59:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5856600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f585009b390 con 0x7f585015e7e0 2024-05-30T16:59:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5856600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f585015ebc0 con 0x7f585009af80 2024-05-30T16:59:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5846a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58500b73a0 0x7f585009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5846a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58500b73a0 0x7f585009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40486/0 (socket says 172.21.15.59:40486) 2024-05-30T16:59:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5846a00640 1 -- 172.21.15.59:0/703196434 learned_addr learned my addr 172.21.15.59:0/703196434 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f584fe00640 1 --2- 172.21.15.59:0/703196434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f585009af80 0x7f585006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f584f400640 1 --2- 172.21.15.59:0/703196434 >> v2:172.21.15.107:3300/0 conn(0x7f585015e7e0 0x7f58500b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5846a00640 1 -- 172.21.15.59:0/703196434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f585009af80 msgr2=0x7f585006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:50.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5846a00640 1 --2- 172.21.15.59:0/703196434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f585009af80 0x7f585006d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5846a00640 1 -- 172.21.15.59:0/703196434 >> v2:172.21.15.107:3300/0 conn(0x7f585015e7e0 msgr2=0x7f58500b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:50.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5846a00640 1 --2- 172.21.15.59:0/703196434 >> v2:172.21.15.107:3300/0 conn(0x7f585015e7e0 0x7f58500b6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5846a00640 1 -- 172.21.15.59:0/703196434 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585015ee60 con 0x7f58500b73a0 2024-05-30T16:59:50.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f584fe00640 1 --2- 172.21.15.59:0/703196434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f585009af80 0x7f585006d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f5846a00640 1 --2- 172.21.15.59:0/703196434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58500b73a0 0x7f585009aa40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5850072c20 tx=0x7f583801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629ccd81be7e5954 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:50.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.308+0000 7f584ea00640 1 -- 172.21.15.59:0/703196434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58380b0070 con 0x7f58500b73a0 2024-05-30T16:59:50.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f584ea00640 1 -- 172.21.15.59:0/703196434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58380ab600 con 0x7f58500b73a0 2024-05-30T16:59:50.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f584ea00640 1 -- 172.21.15.59:0/703196434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58380ab9d0 con 0x7f58500b73a0 2024-05-30T16:59:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 -- 172.21.15.59:0/703196434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58500b73a0 msgr2=0x7f585009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 --2- 172.21.15.59:0/703196434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58500b73a0 0x7f585009aa40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5850072c20 tx=0x7f583801c260 comp rx=0 tx=0).stop 2024-05-30T16:59:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 -- 172.21.15.59:0/703196434 shutdown_connections 2024-05-30T16:59:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 --2- 172.21.15.59:0/703196434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f585009af80 0x7f585006d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 --2- 172.21.15.59:0/703196434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58500b73a0 0x7f585009aa40 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 --2- 172.21.15.59:0/703196434 >> v2:172.21.15.107:3300/0 conn(0x7f585015e7e0 0x7f58500b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 -- 172.21.15.59:0/703196434 >> 172.21.15.59:0/703196434 conn(0x7f58500b41a0 msgr2=0x7f58500b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 -- 172.21.15.59:0/703196434 shutdown_connections 2024-05-30T16:59:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 -- 172.21.15.59:0/703196434 wait complete. 2024-05-30T16:59:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 Processor -- start 2024-05-30T16:59:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 -- start start 2024-05-30T16:59:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585009af80 0x7f5850159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58500b73a0 0x7f585014ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585015e7e0 0x7f585014f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f585015ff00 con 0x7f585015e7e0 2024-05-30T16:59:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f585015f9e0 con 0x7f585009af80 2024-05-30T16:59:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5856600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5850160080 con 0x7f58500b73a0 2024-05-30T16:59:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f584fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585015e7e0 0x7f585014f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f584fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585015e7e0 0x7f585014f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40500/0 (socket says 172.21.15.59:40500) 2024-05-30T16:59:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f584fe00640 1 -- 172.21.15.59:0/933584835 learned_addr learned my addr 172.21.15.59:0/933584835 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f584f400640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585009af80 0x7f5850159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.312+0000 7f5846a00640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58500b73a0 0x7f585014ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f584fe00640 1 -- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58500b73a0 msgr2=0x7f585014ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:50.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f584fe00640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58500b73a0 0x7f585014ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f584fe00640 1 -- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585009af80 msgr2=0x7f5850159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:50.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f584fe00640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585009af80 0x7f5850159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f584fe00640 1 -- 172.21.15.59:0/933584835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5850150650 con 0x7f585015e7e0 2024-05-30T16:59:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f584fe00640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585015e7e0 0x7f585014f3b0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f584800e840 tx=0x7f584800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f5847e00640 1 -- 172.21.15.59:0/933584835 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848017070 con 0x7f585015e7e0 2024-05-30T16:59:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f5847e00640 1 -- 172.21.15.59:0/933584835 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f584800c6d0 con 0x7f585015e7e0 2024-05-30T16:59:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f5847e00640 1 -- 172.21.15.59:0/933584835 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584800f040 con 0x7f585015e7e0 2024-05-30T16:59:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f5856600640 1 -- 172.21.15.59:0/933584835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5850150930 con 0x7f585015e7e0 2024-05-30T16:59:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f5856600640 1 -- 172.21.15.59:0/933584835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5850150ef0 con 0x7f585015e7e0 2024-05-30T16:59:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f5856600640 1 -- 172.21.15.59:0/933584835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5850068a90 con 0x7f585015e7e0 2024-05-30T16:59:50.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f5847e00640 1 -- 172.21.15.59:0/933584835 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f584801a070 con 0x7f585015e7e0 2024-05-30T16:59:50.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f5847e00640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f582c0694f0 0x7f582c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.316+0000 7f5847e00640 1 -- 172.21.15.59:0/933584835 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f58480853c0 con 0x7f585015e7e0 2024-05-30T16:59:50.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.320+0000 7f584f400640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f582c0694f0 0x7f582c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.320+0000 7f584f400640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f582c0694f0 0x7f582c06b9b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f58400039f0 tx=0x7f5840009830 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:50.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.324+0000 7f5847e00640 1 -- 172.21.15.59:0/933584835 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5848056a30 con 0x7f585015e7e0 2024-05-30T16:59:50.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.508+0000 7f5856600640 1 -- 172.21.15.59:0/933584835 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f58500d2290 con 0x7f582c0694f0 2024-05-30T16:59:50.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5847e00640 1 -- 172.21.15.59:0/933584835 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f58500d2290 con 0x7f582c0694f0 2024-05-30T16:59:50.513 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T16:59:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T16:59:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T16:59:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T16:59:50.514 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T16:59:50.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5856600640 1 -- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f582c0694f0 msgr2=0x7f582c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:50.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5856600640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f582c0694f0 0x7f582c06b9b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f58400039f0 tx=0x7f5840009830 comp rx=0 tx=0).stop 2024-05-30T16:59:50.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5856600640 1 -- 172.21.15.59:0/933584835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585015e7e0 msgr2=0x7f585014f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:50.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5856600640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585015e7e0 0x7f585014f3b0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f584800e840 tx=0x7f584800ed00 comp rx=0 tx=0).stop 2024-05-30T16:59:50.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5856600640 1 -- 172.21.15.59:0/933584835 shutdown_connections 2024-05-30T16:59:50.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5856600640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f582c0694f0 0x7f582c06b9b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5856600640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585015e7e0 0x7f585014f3b0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5856600640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58500b73a0 0x7f585014ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5856600640 1 --2- 172.21.15.59:0/933584835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585009af80 0x7f5850159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5856600640 1 -- 172.21.15.59:0/933584835 >> 172.21.15.59:0/933584835 conn(0x7f58500b41a0 msgr2=0x7f58500708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:50.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5856600640 1 -- 172.21.15.59:0/933584835 shutdown_connections 2024-05-30T16:59:50.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.512+0000 7f5856600640 1 -- 172.21.15.59:0/933584835 wait complete. 2024-05-30T16:59:50.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:59:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa500000640 1 Processor -- start 2024-05-30T16:59:50.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa500000640 1 -- start start 2024-05-30T16:59:50.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa500000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f80b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa500000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4f806dc80 0x7fa4f806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa500000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f80b32d0 con 0x7fa4f815ebf0 2024-05-30T16:59:50.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa500000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f815f490 con 0x7fa4f806dc80 2024-05-30T16:59:50.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa500000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f815f770 con 0x7fa4f80723a0 2024-05-30T16:59:50.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa4fe000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4f806dc80 0x7fa4f806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa4fe000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4f806dc80 0x7fa4f806e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40514/0 (socket says 172.21.15.59:40514) 2024-05-30T16:59:50.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa4fe000640 1 -- 172.21.15.59:0/354211847 learned_addr learned my addr 172.21.15.59:0/354211847 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:50.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa4fd600640 1 --2- 172.21.15.59:0/354211847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f80b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa4fe000640 1 -- 172.21.15.59:0/354211847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 msgr2=0x7fa4f80b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:50.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa4fe000640 1 --2- 172.21.15.59:0/354211847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f80b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa4fe000640 1 -- 172.21.15.59:0/354211847 >> v1:172.21.15.107:6789/0 conn(0x7fa4f815ebf0 legacy=0x7fa4f80b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:50.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa4fe000640 1 -- 172.21.15.59:0/354211847 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f815fa50 con 0x7fa4f806dc80 2024-05-30T16:59:50.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.676+0000 7fa4fd600640 1 --2- 172.21.15.59:0/354211847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f80b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.680+0000 7fa4fe000640 1 --2- 172.21.15.59:0/354211847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f806dc80 0x7fa4f806e110 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009e50 tx=0x7fa4f001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d0ac3878746fd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.680+0000 7fa4f7e00640 1 -- 172.21.15.59:0/354211847 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00a5700 con 0x7fa4f806dc80 2024-05-30T16:59:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.680+0000 7fa4f7e00640 1 -- 172.21.15.59:0/354211847 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f00a58a0 con 0x7fa4f806dc80 2024-05-30T16:59:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.680+0000 7fa4f7e00640 1 -- 172.21.15.59:0/354211847 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00a5c70 con 0x7fa4f806dc80 2024-05-30T16:59:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.680+0000 7fa500000640 1 -- 172.21.15.59:0/354211847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f806dc80 msgr2=0x7fa4f806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.680+0000 7fa500000640 1 --2- 172.21.15.59:0/354211847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f806dc80 0x7fa4f806e110 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009e50 tx=0x7fa4f001c9f0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.680+0000 7fa500000640 1 -- 172.21.15.59:0/354211847 shutdown_connections 2024-05-30T16:59:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.680+0000 7fa500000640 1 --2- 172.21.15.59:0/354211847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f806dc80 0x7fa4f806e110 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.680+0000 7fa500000640 1 --2- 172.21.15.59:0/354211847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f80723a0 0x7fa4f80b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.680+0000 7fa500000640 1 -- 172.21.15.59:0/354211847 >> 172.21.15.59:0/354211847 conn(0x7fa4f806bdb0 msgr2=0x7fa4f806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.680+0000 7fa500000640 1 -- 172.21.15.59:0/354211847 shutdown_connections 2024-05-30T16:59:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.680+0000 7fa500000640 1 -- 172.21.15.59:0/354211847 wait complete. 2024-05-30T16:59:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa500000640 1 Processor -- start 2024-05-30T16:59:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa500000640 1 -- start start 2024-05-30T16:59:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa500000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f806dc80 0x7fa4f809a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa500000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80723a0 0x7fa4f809cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa500000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f815ebf0 0x7fa4f80ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa500000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8072780 con 0x7fa4f80723a0 2024-05-30T16:59:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa500000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8072900 con 0x7fa4f815ebf0 2024-05-30T16:59:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa500000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f8154e60 con 0x7fa4f806dc80 2024-05-30T16:59:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4fcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80723a0 0x7fa4f809cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4fcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80723a0 0x7fa4f809cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40518/0 (socket says 172.21.15.59:40518) 2024-05-30T16:59:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4fcc00640 1 -- 172.21.15.59:0/3148370525 learned_addr learned my addr 172.21.15.59:0/3148370525 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4fe000640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f815ebf0 0x7fa4f80ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4fd600640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f806dc80 0x7fa4f809a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4fcc00640 1 -- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f806dc80 msgr2=0x7fa4f809a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4fcc00640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f806dc80 0x7fa4f809a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4fcc00640 1 -- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f815ebf0 msgr2=0x7fa4f80ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4fcc00640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f815ebf0 0x7fa4f80ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4fcc00640 1 -- 172.21.15.59:0/3148370525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f81563f0 con 0x7fa4f80723a0 2024-05-30T16:59:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4fd600640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f806dc80 0x7fa4f809a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:59:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4fcc00640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80723a0 0x7fa4f809cf80 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400b410 tx=0x7fa4e400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:50.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4f5600640 1 -- 172.21.15.59:0/3148370525 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4015030 con 0x7fa4f80723a0 2024-05-30T16:59:50.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4f5600640 1 -- 172.21.15.59:0/3148370525 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e4004020 con 0x7fa4f80723a0 2024-05-30T16:59:50.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa500000640 1 -- 172.21.15.59:0/3148370525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f809c4a0 con 0x7fa4f80723a0 2024-05-30T16:59:50.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa4f5600640 1 -- 172.21.15.59:0/3148370525 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4004450 con 0x7fa4f80723a0 2024-05-30T16:59:50.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.684+0000 7fa500000640 1 -- 172.21.15.59:0/3148370525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f809ca60 con 0x7fa4f80723a0 2024-05-30T16:59:50.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.688+0000 7fa500000640 1 -- 172.21.15.59:0/3148370525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f8068a90 con 0x7fa4f80723a0 2024-05-30T16:59:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.688+0000 7fa4f5600640 1 -- 172.21.15.59:0/3148370525 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7fa4e4018070 con 0x7fa4f80723a0 2024-05-30T16:59:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.688+0000 7fa4f5600640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa4d80694f0 0x7fa4d806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.688+0000 7fa4f5600640 1 -- 172.21.15.59:0/3148370525 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7fa4e4085420 con 0x7fa4f80723a0 2024-05-30T16:59:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.688+0000 7fa4fd600640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa4d80694f0 0x7fa4d806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.688+0000 7fa4fd600640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa4d80694f0 0x7fa4d806b9b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa4f806fbc0 tx=0x7fa4ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.692+0000 7fa4f5600640 1 -- 172.21.15.59:0/3148370525 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa4e408f080 con 0x7fa4f80723a0 2024-05-30T16:59:50.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.856+0000 7fa500000640 1 -- 172.21.15.59:0/3148370525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa4f80b2960 con 0x7fa4f80723a0 2024-05-30T16:59:50.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.856+0000 7fa4f5600640 1 -- 172.21.15.59:0/3148370525 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fa4e40570e0 con 0x7fa4f80723a0 2024-05-30T16:59:50.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.860+0000 7fa500000640 1 -- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa4d80694f0 msgr2=0x7fa4d806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:50.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.860+0000 7fa500000640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa4d80694f0 0x7fa4d806b9b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa4f806fbc0 tx=0x7fa4ec008040 comp rx=0 tx=0).stop 2024-05-30T16:59:50.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.860+0000 7fa500000640 1 -- 172.21.15.59:0/3148370525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80723a0 msgr2=0x7fa4f809cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:50.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.860+0000 7fa500000640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80723a0 0x7fa4f809cf80 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400b410 tx=0x7fa4e400b8d0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.860+0000 7fa500000640 1 -- 172.21.15.59:0/3148370525 shutdown_connections 2024-05-30T16:59:50.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.860+0000 7fa500000640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa4d80694f0 0x7fa4d806b9b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.860+0000 7fa500000640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f815ebf0 0x7fa4f80ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.860+0000 7fa500000640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80723a0 0x7fa4f809cf80 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.860+0000 7fa500000640 1 --2- 172.21.15.59:0/3148370525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4f806dc80 0x7fa4f809a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:50.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.860+0000 7fa500000640 1 -- 172.21.15.59:0/3148370525 >> 172.21.15.59:0/3148370525 conn(0x7fa4f806bdb0 msgr2=0x7fa4f80adbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:50.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.860+0000 7fa500000640 1 -- 172.21.15.59:0/3148370525 shutdown_connections 2024-05-30T16:59:50.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:50.860+0000 7fa500000640 1 -- 172.21.15.59:0/3148370525 wait complete. 2024-05-30T16:59:50.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T16:59:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81d6200640 1 Processor -- start 2024-05-30T16:59:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81d6200640 1 -- start start 2024-05-30T16:59:51.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81d6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81d006dc60 0x7f81d006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81d6200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81d00af130 0x7f81d00af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81d6200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d006e120 con 0x7f81d0156e40 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81d6200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f81d006e400 con 0x7f81d00af130 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81d6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f81d006e6e0 con 0x7f81d006dc60 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81cfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81d00af130 0x7f81d00af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81cf400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f81d0156e40 0x7f81d015d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51528/0 (socket says 172.21.15.59:51528) 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81cfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81d00af130 0x7f81d00af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40526/0 (socket says 172.21.15.59:40526) 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81cf400640 1 -- 172.21.15.59:0/2195495654 learned_addr learned my addr 172.21.15.59:0/2195495654 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81c6a00640 1 --2- 172.21.15.59:0/2195495654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81d006dc60 0x7f81d006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.024+0000 7f81cfe00640 1 -- 172.21.15.59:0/2195495654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81d006dc60 msgr2=0x7f81d006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81cfe00640 1 --2- 172.21.15.59:0/2195495654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81d006dc60 0x7f81d006f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81cfe00640 1 -- 172.21.15.59:0/2195495654 >> v1:172.21.15.59:6789/0 conn(0x7f81d0156e40 legacy=0x7f81d015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81cfe00640 1 -- 172.21.15.59:0/2195495654 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d006e9c0 con 0x7f81d00af130 2024-05-30T16:59:51.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81cfe00640 1 --2- 172.21.15.59:0/2195495654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d00af130 0x7f81d00af580 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009d90 tx=0x7f81c801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c39c11ef6ac6ba server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81cea00640 1 -- 172.21.15.59:0/2195495654 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c80b2070 con 0x7f81d00af130 2024-05-30T16:59:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81cea00640 1 -- 172.21.15.59:0/2195495654 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c80a58b0 con 0x7f81d00af130 2024-05-30T16:59:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81cea00640 1 -- 172.21.15.59:0/2195495654 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c80a5c80 con 0x7f81d00af130 2024-05-30T16:59:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81d6200640 1 -- 172.21.15.59:0/2195495654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d00af130 msgr2=0x7f81d00af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81d6200640 1 --2- 172.21.15.59:0/2195495654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d00af130 0x7f81d00af580 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009d90 tx=0x7f81c801c970 comp rx=0 tx=0).stop 2024-05-30T16:59:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81d6200640 1 -- 172.21.15.59:0/2195495654 shutdown_connections 2024-05-30T16:59:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81d6200640 1 --2- 172.21.15.59:0/2195495654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d00af130 0x7f81d00af580 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81d6200640 1 --2- 172.21.15.59:0/2195495654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81d006dc60 0x7f81d006f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81d6200640 1 -- 172.21.15.59:0/2195495654 >> 172.21.15.59:0/2195495654 conn(0x7f81d00b1e60 msgr2=0x7f81d00b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81d6200640 1 -- 172.21.15.59:0/2195495654 shutdown_connections 2024-05-30T16:59:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.028+0000 7f81d6200640 1 -- 172.21.15.59:0/2195495654 wait complete. 2024-05-30T16:59:51.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81d6200640 1 Processor -- start 2024-05-30T16:59:51.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81d6200640 1 -- start start 2024-05-30T16:59:51.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81d6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81d006dc60 0x7f81d0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:51.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81d6200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81d00af130 0x7f81d015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:51.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81d6200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d0156e40 0x7f81d015c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:51.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81d6200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f81d015eb70 con 0x7f81d0156e40 2024-05-30T16:59:51.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81d6200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f81d015e9f0 con 0x7f81d00af130 2024-05-30T16:59:51.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81d6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f81d0169550 con 0x7f81d006dc60 2024-05-30T16:59:51.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81cfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d0156e40 0x7f81d015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81cfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d0156e40 0x7f81d015c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40542/0 (socket says 172.21.15.59:40542) 2024-05-30T16:59:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81cfe00640 1 -- 172.21.15.59:0/3441628322 learned_addr learned my addr 172.21.15.59:0/3441628322 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81c6a00640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81d00af130 0x7f81d015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81cf400640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81d006dc60 0x7f81d0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81cfe00640 1 -- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81d006dc60 msgr2=0x7f81d0073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81cfe00640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81d006dc60 0x7f81d0073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81cfe00640 1 -- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81d00af130 msgr2=0x7f81d015bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81cfe00640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81d00af130 0x7f81d015bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81cfe00640 1 -- 172.21.15.59:0/3441628322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d0071f90 con 0x7f81d0156e40 2024-05-30T16:59:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81c6a00640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81d00af130 0x7f81d015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81cfe00640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d0156e40 0x7f81d015c180 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009d90 tx=0x7f81c8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81c7e00640 1 -- 172.21.15.59:0/3441628322 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c80b2050 con 0x7f81d0156e40 2024-05-30T16:59:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81c7e00640 1 -- 172.21.15.59:0/3441628322 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c80be070 con 0x7f81d0156e40 2024-05-30T16:59:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81d6200640 1 -- 172.21.15.59:0/3441628322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d0072270 con 0x7f81d0156e40 2024-05-30T16:59:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81c7e00640 1 -- 172.21.15.59:0/3441628322 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c80ad850 con 0x7f81d0156e40 2024-05-30T16:59:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.032+0000 7f81d6200640 1 -- 172.21.15.59:0/3441628322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d0072830 con 0x7f81d0156e40 2024-05-30T16:59:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.036+0000 7f81d6200640 1 -- 172.21.15.59:0/3441628322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81d0068a90 con 0x7f81d0156e40 2024-05-30T16:59:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.036+0000 7f81c7e00640 1 -- 172.21.15.59:0/3441628322 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f81c80ad9f0 con 0x7f81d0156e40 2024-05-30T16:59:51.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.036+0000 7f81c7e00640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81ac069520 0x7f81ac06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:51.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.036+0000 7f81c7e00640 1 -- 172.21.15.59:0/3441628322 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f81c81213d0 con 0x7f81d0156e40 2024-05-30T16:59:51.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.040+0000 7f81cf400640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81ac069520 0x7f81ac06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:51.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.040+0000 7f81cf400640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81ac069520 0x7f81ac06b9e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f81c0000f70 tx=0x7f81c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:51.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.040+0000 7f81c7e00640 1 -- 172.21.15.59:0/3441628322 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81c8016560 con 0x7f81d0156e40 2024-05-30T16:59:51.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.232+0000 7f81d6200640 1 -- 172.21.15.59:0/3441628322 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f81d006fab0 con 0x7f81ac069520 2024-05-30T16:59:51.243 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:51.242+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:51.243 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:51.242+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:51.244 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:51.242+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:51.244 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:51.242+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:51.244 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T16:59:51.242+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:59:51.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81c7e00640 1 -- 172.21.15.59:0/3441628322 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f81d006fab0 con 0x7f81ac069520 2024-05-30T16:59:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81d6200640 1 -- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81ac069520 msgr2=0x7f81ac06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81d6200640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81ac069520 0x7f81ac06b9e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f81c0000f70 tx=0x7f81c0009040 comp rx=0 tx=0).stop 2024-05-30T16:59:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81d6200640 1 -- 172.21.15.59:0/3441628322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d0156e40 msgr2=0x7f81d015c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81d6200640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d0156e40 0x7f81d015c180 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009d90 tx=0x7f81c8019710 comp rx=0 tx=0).stop 2024-05-30T16:59:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81d6200640 1 -- 172.21.15.59:0/3441628322 shutdown_connections 2024-05-30T16:59:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81d6200640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81ac069520 0x7f81ac06b9e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81d6200640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d0156e40 0x7f81d015c180 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81d6200640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81d00af130 0x7f81d015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81d6200640 1 --2- 172.21.15.59:0/3441628322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81d006dc60 0x7f81d0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81d6200640 1 -- 172.21.15.59:0/3441628322 >> 172.21.15.59:0/3441628322 conn(0x7f81d00b1e60 msgr2=0x7f81d00b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81d6200640 1 -- 172.21.15.59:0/3441628322 shutdown_connections 2024-05-30T16:59:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.276+0000 7f81d6200640 1 -- 172.21.15.59:0/3441628322 wait complete. 2024-05-30T16:59:51.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:59:51.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.440+0000 7f36da400640 1 Processor -- start 2024-05-30T16:59:51.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.440+0000 7f36da400640 1 -- start start 2024-05-30T16:59:51.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.440+0000 7f36da400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36d41569e0 0x7f36d415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:51.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36da400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36d40d0660 0x7f36d40d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:51.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36da400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d40ad770 con 0x7f36d40ad2b0 2024-05-30T16:59:51.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36da400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f36d415cb40 con 0x7f36d40d0660 2024-05-30T16:59:51.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36da400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f36d415ce20 con 0x7f36d41569e0 2024-05-30T16:59:51.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36d3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36d40d0660 0x7f36d40d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:51.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36d3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36d40d0660 0x7f36d40d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40544/0 (socket says 172.21.15.59:40544) 2024-05-30T16:59:51.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36d3e00640 1 -- 172.21.15.59:0/3369805834 learned_addr learned my addr 172.21.15.59:0/3369805834 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:51.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36d3400640 1 --2- 172.21.15.59:0/3369805834 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36d41569e0 0x7f36d415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:51.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36d3e00640 1 -- 172.21.15.59:0/3369805834 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36d41569e0 msgr2=0x7f36d415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:51.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36d3e00640 1 --2- 172.21.15.59:0/3369805834 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36d41569e0 0x7f36d415d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36d3e00640 1 -- 172.21.15.59:0/3369805834 >> v1:172.21.15.107:6789/0 conn(0x7f36d40ad2b0 legacy=0x7f36d40cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:59:51.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36d3e00640 1 -- 172.21.15.59:0/3369805834 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d415d100 con 0x7f36d40d0660 2024-05-30T16:59:51.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36d3e00640 1 --2- 172.21.15.59:0/3369805834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36d40d0660 0x7f36d40d0af0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009e50 tx=0x7f36cc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3062d0388d21244 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:51.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.444+0000 7f36d2a00640 1 -- 172.21.15.59:0/3369805834 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0a5660 con 0x7f36d40d0660 2024-05-30T16:59:51.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36d2a00640 1 -- 172.21.15.59:0/3369805834 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36cc0a5800 con 0x7f36d40d0660 2024-05-30T16:59:51.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36d2a00640 1 -- 172.21.15.59:0/3369805834 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0a5bd0 con 0x7f36d40d0660 2024-05-30T16:59:51.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 -- 172.21.15.59:0/3369805834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36d40d0660 msgr2=0x7f36d40d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:51.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 --2- 172.21.15.59:0/3369805834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36d40d0660 0x7f36d40d0af0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009e50 tx=0x7f36cc01c9a0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 -- 172.21.15.59:0/3369805834 shutdown_connections 2024-05-30T16:59:51.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 --2- 172.21.15.59:0/3369805834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36d40d0660 0x7f36d40d0af0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 --2- 172.21.15.59:0/3369805834 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36d41569e0 0x7f36d415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 -- 172.21.15.59:0/3369805834 >> 172.21.15.59:0/3369805834 conn(0x7f36d406bdb0 msgr2=0x7f36d406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:51.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 -- 172.21.15.59:0/3369805834 shutdown_connections 2024-05-30T16:59:51.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 -- 172.21.15.59:0/3369805834 wait complete. 2024-05-30T16:59:51.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 Processor -- start 2024-05-30T16:59:51.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 -- start start 2024-05-30T16:59:51.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d40ad2b0 0x7f36d4099910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:51.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36d40d0660 0x7f36d406f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:51.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36d41569e0 0x7f36d4155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:51.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f36d40b3e70 con 0x7f36d41569e0 2024-05-30T16:59:51.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f36d40b3cf0 con 0x7f36d40ad2b0 2024-05-30T16:59:51.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36da400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f36d40b3ff0 con 0x7f36d40d0660 2024-05-30T16:59:51.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36d41569e0 0x7f36d4155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:51.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36d41569e0 0x7f36d4155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40552/0 (socket says 172.21.15.59:40552) 2024-05-30T16:59:51.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36d3e00640 1 -- 172.21.15.59:0/2730128402 learned_addr learned my addr 172.21.15.59:0/2730128402 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T16:59:51.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36d3400640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d40ad2b0 0x7f36d4099910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:51.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36cbe00640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36d40d0660 0x7f36d406f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:51.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36d3e00640 1 -- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36d40d0660 msgr2=0x7f36d406f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:51.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36d3e00640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36d40d0660 0x7f36d406f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36d3e00640 1 -- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d40ad2b0 msgr2=0x7f36d4099910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:51.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36d3e00640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d40ad2b0 0x7f36d4099910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36d3e00640 1 -- 172.21.15.59:0/2730128402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d4150720 con 0x7f36d41569e0 2024-05-30T16:59:51.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.448+0000 7f36d3400640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d40ad2b0 0x7f36d4099910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:59:51.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.452+0000 7f36d3e00640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36d41569e0 0x7f36d4155550 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f36cc01a5d0 tx=0x7f36cc019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:51.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.452+0000 7f36cb400640 1 -- 172.21.15.59:0/2730128402 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0bc020 con 0x7f36d41569e0 2024-05-30T16:59:51.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.452+0000 7f36cb400640 1 -- 172.21.15.59:0/2730128402 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36cc0b8670 con 0x7f36d41569e0 2024-05-30T16:59:51.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.452+0000 7f36cb400640 1 -- 172.21.15.59:0/2730128402 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc009510 con 0x7f36d41569e0 2024-05-30T16:59:51.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.452+0000 7f36da400640 1 -- 172.21.15.59:0/2730128402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d4150a00 con 0x7f36d41569e0 2024-05-30T16:59:51.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.452+0000 7f36da400640 1 -- 172.21.15.59:0/2730128402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d4150fc0 con 0x7f36d41569e0 2024-05-30T16:59:51.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.452+0000 7f36da400640 1 -- 172.21.15.59:0/2730128402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36d4068a90 con 0x7f36d41569e0 2024-05-30T16:59:51.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.452+0000 7f36cb400640 1 -- 172.21.15.59:0/2730128402 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 28) ==== 89568+0+0 (secure 0 0 0) 0x7f36cc0bf020 con 0x7f36d41569e0 2024-05-30T16:59:51.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.452+0000 7f36cb400640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36b0069520 0x7f36b006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:59:51.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.452+0000 7f36cb400640 1 -- 172.21.15.59:0/2730128402 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f36cc120830 con 0x7f36d41569e0 2024-05-30T16:59:51.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.452+0000 7f36d3400640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36b0069520 0x7f36b006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:59:51.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.456+0000 7f36d3400640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36b0069520 0x7f36b006b9e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f36c4007a70 tx=0x7f36c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:59:51.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.456+0000 7f36cb400640 1 -- 172.21.15.59:0/2730128402 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f36cc12a080 con 0x7f36d41569e0 2024-05-30T16:59:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.648+0000 7f36da400640 1 -- 172.21.15.59:0/2730128402 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f36d414fc90 con 0x7f36b0069520 2024-05-30T16:59:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.652+0000 7f36cb400640 1 -- 172.21.15.59:0/2730128402 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f36d414fc90 con 0x7f36b0069520 2024-05-30T16:59:51.656 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/54fe8d6a-59e0-4796-a3c5-8acd1113ccfc 2024-05-30T16:59:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.656+0000 7f36da400640 1 -- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36b0069520 msgr2=0x7f36b006b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.656+0000 7f36da400640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36b0069520 0x7f36b006b9e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f36c4007a70 tx=0x7f36c4008040 comp rx=0 tx=0).stop 2024-05-30T16:59:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.656+0000 7f36da400640 1 -- 172.21.15.59:0/2730128402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36d41569e0 msgr2=0x7f36d4155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:59:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.656+0000 7f36da400640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36d41569e0 0x7f36d4155550 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f36cc01a5d0 tx=0x7f36cc019740 comp rx=0 tx=0).stop 2024-05-30T16:59:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.656+0000 7f36da400640 1 -- 172.21.15.59:0/2730128402 shutdown_connections 2024-05-30T16:59:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.656+0000 7f36da400640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36b0069520 0x7f36b006b9e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.656+0000 7f36da400640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36d41569e0 0x7f36d4155550 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.656+0000 7f36da400640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36d40d0660 0x7f36d406f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.656+0000 7f36da400640 1 --2- 172.21.15.59:0/2730128402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d40ad2b0 0x7f36d4099910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:59:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.656+0000 7f36da400640 1 -- 172.21.15.59:0/2730128402 >> 172.21.15.59:0/2730128402 conn(0x7f36d406bdb0 msgr2=0x7f36d415de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:59:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.656+0000 7f36da400640 1 -- 172.21.15.59:0/2730128402 shutdown_connections 2024-05-30T16:59:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T16:59:51.656+0000 7f36da400640 1 -- 172.21.15.59:0/2730128402 wait complete. 2024-05-30T16:59:51.677 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/54fe8d6a-59e0-4796-a3c5-8acd1113ccfc 2024-05-30T16:59:51.677 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:59:51.677 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:59:51.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:51.686 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/54fe8d6a-59e0-4796-a3c5-8acd1113ccfc/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:59:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T16:59:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T16:59:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.07589 s, 152 MB/s 2024-05-30T16:59:58.832 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T16:59:58.832 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:59:58.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:59:58.841 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/54fe8d6a-59e0-4796-a3c5-8acd1113ccfc/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T17:00:05.124 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:00:05.128 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:00:05.790 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T17:00:05.791 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T17:00:05.791 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.89177 s, 156 MB/s 2024-05-30T17:00:05.792 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:00:05.792 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:00:05.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:00:05.801 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/54fe8d6a-59e0-4796-a3c5-8acd1113ccfc/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T17:00:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T17:00:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T17:00:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.85663 s, 157 MB/s 2024-05-30T17:00:12.714 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T17:00:12.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.856+0000 7f7661600640 1 Processor -- start 2024-05-30T17:00:12.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.856+0000 7f7661600640 1 -- start start 2024-05-30T17:00:12.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f7661600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f765c156e40 0x7f765c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f7661600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f765c06dc60 0x7f765c15d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f7661600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f765c0af130 0x7f765c0af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f7661600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f765c15db80 con 0x7f765c0af130 2024-05-30T17:00:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f7661600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f765c06e120 con 0x7f765c156e40 2024-05-30T17:00:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f7661600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f765c06e400 con 0x7f765c06dc60 2024-05-30T17:00:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f765b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f765c0af130 0x7f765c0af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f765b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f765c0af130 0x7f765c0af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42630/0 (socket says 172.21.15.59:42630) 2024-05-30T17:00:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f765b400640 1 -- 172.21.15.59:0/1527749627 learned_addr learned my addr 172.21.15.59:0/1527749627 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f7652000640 1 --2- 172.21.15.59:0/1527749627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f765c06dc60 0x7f765c15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f765aa00640 1 --2- 172.21.15.59:0/1527749627 >> v2:172.21.15.107:3300/0 conn(0x7f765c156e40 0x7f765c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f765b400640 1 -- 172.21.15.59:0/1527749627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f765c06dc60 msgr2=0x7f765c15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f765b400640 1 --2- 172.21.15.59:0/1527749627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f765c06dc60 0x7f765c15d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:12.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f765b400640 1 -- 172.21.15.59:0/1527749627 >> v2:172.21.15.107:3300/0 conn(0x7f765c156e40 msgr2=0x7f765c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:12.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f765b400640 1 --2- 172.21.15.59:0/1527749627 >> v2:172.21.15.107:3300/0 conn(0x7f765c156e40 0x7f765c06f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:12.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.860+0000 7f765b400640 1 -- 172.21.15.59:0/1527749627 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765c06e6e0 con 0x7f765c0af130 2024-05-30T17:00:12.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f765b400640 1 --2- 172.21.15.59:0/1527749627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f765c0af130 0x7f765c0af580 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f765c073f70 tx=0x7f765401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355f295c1facc2a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:12.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f765a000640 1 -- 172.21.15.59:0/1527749627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76540a5760 con 0x7f765c0af130 2024-05-30T17:00:12.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f765a000640 1 -- 172.21.15.59:0/1527749627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76540a5900 con 0x7f765c0af130 2024-05-30T17:00:12.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f765a000640 1 -- 172.21.15.59:0/1527749627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76540a5cd0 con 0x7f765c0af130 2024-05-30T17:00:12.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f7661600640 1 -- 172.21.15.59:0/1527749627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f765c0af130 msgr2=0x7f765c0af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f7661600640 1 --2- 172.21.15.59:0/1527749627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f765c0af130 0x7f765c0af580 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f765c073f70 tx=0x7f765401c9f0 comp rx=0 tx=0).stop 2024-05-30T17:00:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f7661600640 1 -- 172.21.15.59:0/1527749627 shutdown_connections 2024-05-30T17:00:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f7661600640 1 --2- 172.21.15.59:0/1527749627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f765c0af130 0x7f765c0af580 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f7661600640 1 --2- 172.21.15.59:0/1527749627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f765c06dc60 0x7f765c15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f7661600640 1 --2- 172.21.15.59:0/1527749627 >> v2:172.21.15.107:3300/0 conn(0x7f765c156e40 0x7f765c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f7661600640 1 -- 172.21.15.59:0/1527749627 >> 172.21.15.59:0/1527749627 conn(0x7f765c0b1e60 msgr2=0x7f765c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f7661600640 1 -- 172.21.15.59:0/1527749627 shutdown_connections 2024-05-30T17:00:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f7661600640 1 -- 172.21.15.59:0/1527749627 wait complete. 2024-05-30T17:00:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f7661600640 1 Processor -- start 2024-05-30T17:00:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.864+0000 7f7661600640 1 -- start start 2024-05-30T17:00:12.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7661600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f765c06dc60 0x7f765c1432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7661600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f765c0af130 0x7f765c143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7661600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f765c156e40 0x7f765c143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7661600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f765c15e920 con 0x7f765c06dc60 2024-05-30T17:00:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7661600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f765c15e7a0 con 0x7f765c0af130 2024-05-30T17:00:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7661600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f765c15eaa0 con 0x7f765c156e40 2024-05-30T17:00:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f765aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f765c06dc60 0x7f765c1432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f765aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f765c06dc60 0x7f765c1432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42644/0 (socket says 172.21.15.59:42644) 2024-05-30T17:00:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f765aa00640 1 -- 172.21.15.59:0/3407248272 learned_addr learned my addr 172.21.15.59:0/3407248272 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7652000640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f765c0af130 0x7f765c143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f765b400640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f765c156e40 0x7f765c143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f765aa00640 1 -- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f765c156e40 msgr2=0x7f765c143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f765aa00640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f765c156e40 0x7f765c143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f765aa00640 1 -- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f765c0af130 msgr2=0x7f765c143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f765aa00640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f765c0af130 0x7f765c143800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f765aa00640 1 -- 172.21.15.59:0/3407248272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765c0b42b0 con 0x7f765c06dc60 2024-05-30T17:00:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f765aa00640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f765c06dc60 0x7f765c1432c0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f764c00d620 tx=0x7f764c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7653400640 1 -- 172.21.15.59:0/3407248272 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c00b620 con 0x7f765c06dc60 2024-05-30T17:00:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7653400640 1 -- 172.21.15.59:0/3407248272 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764c019070 con 0x7f765c06dc60 2024-05-30T17:00:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7653400640 1 -- 172.21.15.59:0/3407248272 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c00b9e0 con 0x7f765c06dc60 2024-05-30T17:00:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7661600640 1 -- 172.21.15.59:0/3407248272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765c0b4590 con 0x7f765c06dc60 2024-05-30T17:00:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7661600640 1 -- 172.21.15.59:0/3407248272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f765c0b4b50 con 0x7f765c06dc60 2024-05-30T17:00:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7661600640 1 -- 172.21.15.59:0/3407248272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765c068a90 con 0x7f765c06dc60 2024-05-30T17:00:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.868+0000 7f7653400640 1 -- 172.21.15.59:0/3407248272 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 29) ==== 89619+0+0 (secure 0 0 0) 0x7f764c00bb80 con 0x7f765c06dc60 2024-05-30T17:00:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.872+0000 7f7653400640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7638069580 0x7f763806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.872+0000 7f7653400640 1 -- 172.21.15.59:0/3407248272 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f764c085890 con 0x7f765c06dc60 2024-05-30T17:00:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.872+0000 7f7652000640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7638069580 0x7f763806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.872+0000 7f7652000640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7638069580 0x7f763806ba40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f765c0adef0 tx=0x7f7644008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:12.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:12.876+0000 7f7653400640 1 -- 172.21.15.59:0/3407248272 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f764c0572b0 con 0x7f765c06dc60 2024-05-30T17:00:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.068+0000 7f7661600640 1 -- 172.21.15.59:0/3407248272 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f765c0b0db0 con 0x7f7638069580 2024-05-30T17:00:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7653400640 1 -- 172.21.15.59:0/3407248272 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f765c0b0db0 con 0x7f7638069580 2024-05-30T17:00:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7661600640 1 -- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7638069580 msgr2=0x7f763806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7661600640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7638069580 0x7f763806ba40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f765c0adef0 tx=0x7f7644008040 comp rx=0 tx=0).stop 2024-05-30T17:00:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7661600640 1 -- 172.21.15.59:0/3407248272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f765c06dc60 msgr2=0x7f765c1432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7661600640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f765c06dc60 0x7f765c1432c0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f764c00d620 tx=0x7f764c00dae0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7661600640 1 -- 172.21.15.59:0/3407248272 shutdown_connections 2024-05-30T17:00:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7661600640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7638069580 0x7f763806ba40 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7661600640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f765c156e40 0x7f765c143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7661600640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f765c0af130 0x7f765c143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7661600640 1 --2- 172.21.15.59:0/3407248272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f765c06dc60 0x7f765c1432c0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7661600640 1 -- 172.21.15.59:0/3407248272 >> 172.21.15.59:0/3407248272 conn(0x7f765c0b1e60 msgr2=0x7f765c0ad650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7661600640 1 -- 172.21.15.59:0/3407248272 shutdown_connections 2024-05-30T17:00:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.080+0000 7f7661600640 1 -- 172.21.15.59:0/3407248272 wait complete. 2024-05-30T17:00:13.102 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T17:00:13.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1ca800640 1 Processor -- start 2024-05-30T17:00:13.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1ca800640 1 -- start start 2024-05-30T17:00:13.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1ca800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1c41569e0 0x7ff1c415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1ca800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1c40ad2b0 0x7ff1c40cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1ca800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff1c40d0660 0x7ff1c40d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1ca800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c40ad770 con 0x7ff1c41569e0 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1ca800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c415cb40 con 0x7ff1c40d0660 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1ca800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c415ce20 con 0x7ff1c40ad2b0 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1c3400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1c41569e0 0x7ff1c415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1c3400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1c41569e0 0x7ff1c415d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42648/0 (socket says 172.21.15.59:42648) 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1c3400640 1 -- 172.21.15.59:0/3821000434 learned_addr learned my addr 172.21.15.59:0/3821000434 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1baa00640 1 --2- 172.21.15.59:0/3821000434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1c40ad2b0 0x7ff1c40cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1c3e00640 1 --2- 172.21.15.59:0/3821000434 >> v2:172.21.15.107:3300/0 conn(0x7ff1c40d0660 0x7ff1c40d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1c3400640 1 -- 172.21.15.59:0/3821000434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1c40ad2b0 msgr2=0x7ff1c40cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1c3400640 1 --2- 172.21.15.59:0/3821000434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1c40ad2b0 0x7ff1c40cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1c3400640 1 -- 172.21.15.59:0/3821000434 >> v2:172.21.15.107:3300/0 conn(0x7ff1c40d0660 msgr2=0x7ff1c40d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1c3400640 1 --2- 172.21.15.59:0/3821000434 >> v2:172.21.15.107:3300/0 conn(0x7ff1c40d0660 0x7ff1c40d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1c3400640 1 -- 172.21.15.59:0/3821000434 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c415d100 con 0x7ff1c41569e0 2024-05-30T17:00:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.244+0000 7ff1baa00640 1 --2- 172.21.15.59:0/3821000434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1c40ad2b0 0x7ff1c40cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:00:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1c3400640 1 --2- 172.21.15.59:0/3821000434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c41569e0 0x7ff1c415d620 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40cf470 tx=0x7ff1b401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7593d91024d1af79 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1c2a00640 1 -- 172.21.15.59:0/3821000434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40b2070 con 0x7ff1c41569e0 2024-05-30T17:00:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1c2a00640 1 -- 172.21.15.59:0/3821000434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b40a9070 con 0x7ff1c41569e0 2024-05-30T17:00:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1c2a00640 1 -- 172.21.15.59:0/3821000434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40ad880 con 0x7ff1c41569e0 2024-05-30T17:00:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1ca800640 1 -- 172.21.15.59:0/3821000434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c41569e0 msgr2=0x7ff1c415d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1ca800640 1 --2- 172.21.15.59:0/3821000434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c41569e0 0x7ff1c415d620 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40cf470 tx=0x7ff1b401c490 comp rx=0 tx=0).stop 2024-05-30T17:00:13.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1ca800640 1 -- 172.21.15.59:0/3821000434 shutdown_connections 2024-05-30T17:00:13.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1ca800640 1 --2- 172.21.15.59:0/3821000434 >> v2:172.21.15.107:3300/0 conn(0x7ff1c40d0660 0x7ff1c40d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1ca800640 1 --2- 172.21.15.59:0/3821000434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1c40ad2b0 0x7ff1c40cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1ca800640 1 --2- 172.21.15.59:0/3821000434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c41569e0 0x7ff1c415d620 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1ca800640 1 -- 172.21.15.59:0/3821000434 >> 172.21.15.59:0/3821000434 conn(0x7ff1c406bdb0 msgr2=0x7ff1c406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:13.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1ca800640 1 -- 172.21.15.59:0/3821000434 shutdown_connections 2024-05-30T17:00:13.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.248+0000 7ff1ca800640 1 -- 172.21.15.59:0/3821000434 wait complete. 2024-05-30T17:00:13.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1ca800640 1 Processor -- start 2024-05-30T17:00:13.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1ca800640 1 -- start start 2024-05-30T17:00:13.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1ca800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1c40ad2b0 0x7ff1c4150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:13.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1ca800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c40d0660 0x7ff1c4148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:13.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1ca800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1c41569e0 0x7ff1c4154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:13.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1ca800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c40b3c60 con 0x7ff1c40d0660 2024-05-30T17:00:13.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1ca800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c40b3ae0 con 0x7ff1c41569e0 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1ca800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c40b3de0 con 0x7ff1c40ad2b0 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1baa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c40d0660 0x7ff1c4148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1baa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c40d0660 0x7ff1c4148670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42656/0 (socket says 172.21.15.59:42656) 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1baa00640 1 -- 172.21.15.59:0/1660253598 learned_addr learned my addr 172.21.15.59:0/1660253598 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1c3400640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1c40ad2b0 0x7ff1c4150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1c3e00640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1c41569e0 0x7ff1c4154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1baa00640 1 -- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1c40ad2b0 msgr2=0x7ff1c4150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1baa00640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1c40ad2b0 0x7ff1c4150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1baa00640 1 -- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1c41569e0 msgr2=0x7ff1c4154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1baa00640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1c41569e0 0x7ff1c4154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1baa00640 1 -- 172.21.15.59:0/1660253598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c4148bb0 con 0x7ff1c40d0660 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1baa00640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c40d0660 0x7ff1c4148670 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00e810 tx=0x7ff1ac00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1bbe00640 1 -- 172.21.15.59:0/1660253598 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac017070 con 0x7ff1c40d0660 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1bbe00640 1 -- 172.21.15.59:0/1660253598 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ac00c8d0 con 0x7ff1c40d0660 2024-05-30T17:00:13.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1bbe00640 1 -- 172.21.15.59:0/1660253598 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00f040 con 0x7ff1c40d0660 2024-05-30T17:00:13.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1ca800640 1 -- 172.21.15.59:0/1660253598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c4150890 con 0x7ff1c40d0660 2024-05-30T17:00:13.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.252+0000 7ff1ca800640 1 -- 172.21.15.59:0/1660253598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c4149c10 con 0x7ff1c40d0660 2024-05-30T17:00:13.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.256+0000 7ff1ca800640 1 -- 172.21.15.59:0/1660253598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c4068a90 con 0x7ff1c40d0660 2024-05-30T17:00:13.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.256+0000 7ff1bbe00640 1 -- 172.21.15.59:0/1660253598 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 29) ==== 89619+0+0 (secure 0 0 0) 0x7ff1ac01a070 con 0x7ff1c40d0660 2024-05-30T17:00:13.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.256+0000 7ff1bbe00640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff1a0069580 0x7ff1a006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:13.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.256+0000 7ff1bbe00640 1 -- 172.21.15.59:0/1660253598 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7ff1ac0854e0 con 0x7ff1c40d0660 2024-05-30T17:00:13.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.256+0000 7ff1c3400640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff1a0069580 0x7ff1a006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:13.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.256+0000 7ff1c3400640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff1a0069580 0x7ff1a006ba40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40af000 tx=0x7ff1b40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:13.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.260+0000 7ff1bbe00640 1 -- 172.21.15.59:0/1660253598 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff1ac056b30 con 0x7ff1c40d0660 2024-05-30T17:00:13.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.452+0000 7ff1ca800640 1 -- 172.21.15.59:0/1660253598 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7ff1c40b2ab0 con 0x7ff1a0069580 2024-05-30T17:00:13.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.456+0000 7ff1bbe00640 1 -- 172.21.15.59:0/1660253598 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7ff1c40b2ab0 con 0x7ff1a0069580 2024-05-30T17:00:13.458 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/54fe8d6a-59e0-4796-a3c5-8acd1113ccfc 2024-05-30T17:00:13.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.460+0000 7ff1ca800640 1 -- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff1a0069580 msgr2=0x7ff1a006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:13.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.460+0000 7ff1ca800640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff1a0069580 0x7ff1a006ba40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40af000 tx=0x7ff1b40a7000 comp rx=0 tx=0).stop 2024-05-30T17:00:13.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.460+0000 7ff1ca800640 1 -- 172.21.15.59:0/1660253598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c40d0660 msgr2=0x7ff1c4148670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:13.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.460+0000 7ff1ca800640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c40d0660 0x7ff1c4148670 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00e810 tx=0x7ff1ac00ecd0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.460+0000 7ff1ca800640 1 -- 172.21.15.59:0/1660253598 shutdown_connections 2024-05-30T17:00:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.460+0000 7ff1ca800640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff1a0069580 0x7ff1a006ba40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.460+0000 7ff1ca800640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1c41569e0 0x7ff1c4154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.460+0000 7ff1ca800640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c40d0660 0x7ff1c4148670 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.460+0000 7ff1ca800640 1 --2- 172.21.15.59:0/1660253598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1c40ad2b0 0x7ff1c4150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.460+0000 7ff1ca800640 1 -- 172.21.15.59:0/1660253598 >> 172.21.15.59:0/1660253598 conn(0x7ff1c406bdb0 msgr2=0x7ff1c40afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.460+0000 7ff1ca800640 1 -- 172.21.15.59:0/1660253598 shutdown_connections 2024-05-30T17:00:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:13.460+0000 7ff1ca800640 1 -- 172.21.15.59:0/1660253598 wait complete. 2024-05-30T17:00:13.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:00:13.479 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/54fe8d6a-59e0-4796-a3c5-8acd1113ccfc 2024-05-30T17:00:13.479 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:00:13.494 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/54fe8d6a-59e0-4796-a3c5-8acd1113ccfc 2024-05-30T17:00:13.494 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3138256896" 2024-05-30T17:00:13.494 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:00:13.495 INFO:tasks.cephfs.test_volumes:r_size = 3138256896 exp_size = 3221225472 2024-05-30T17:00:15.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:00:15.496 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/54fe8d6a-59e0-4796-a3c5-8acd1113ccfc 2024-05-30T17:00:15.496 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:00:15.511 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/54fe8d6a-59e0-4796-a3c5-8acd1113ccfc 2024-05-30T17:00:15.512 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3138256896" 2024-05-30T17:00:15.512 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:00:15.513 INFO:tasks.cephfs.test_volumes:r_size = 3138256896 exp_size = 3221225472 2024-05-30T17:00:17.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:00:17.513 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/54fe8d6a-59e0-4796-a3c5-8acd1113ccfc 2024-05-30T17:00:17.514 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:00:17.528 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/54fe8d6a-59e0-4796-a3c5-8acd1113ccfc 2024-05-30T17:00:17.528 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T17:00:17.529 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:00:17.529 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T17:00:17.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-05-30T17:00:17.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e86200640 1 Processor -- start 2024-05-30T17:00:17.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e86200640 1 -- start start 2024-05-30T17:00:17.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e86200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e801534f0 0x7f1e800ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:17.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e86200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e800d0d70 0x7f1e800b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:17.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e86200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e800d0090 con 0x7f1e800cfc10 2024-05-30T17:00:17.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e86200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1e8015ca60 con 0x7f1e801534f0 2024-05-30T17:00:17.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e86200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1e800ad920 con 0x7f1e800d0d70 2024-05-30T17:00:17.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e7f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e801534f0 0x7f1e800ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:17.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e7ea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1e800cfc10 0x7f1e800d0660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56420/0 (socket says 172.21.15.59:56420) 2024-05-30T17:00:17.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e7ea00640 1 -- 172.21.15.59:0/3515176449 learned_addr learned my addr 172.21.15.59:0/3515176449 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:17.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e7fe00640 1 --2- 172.21.15.59:0/3515176449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e800d0d70 0x7f1e800b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:17.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e7f400640 1 -- 172.21.15.59:0/3515176449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e800d0d70 msgr2=0x7f1e800b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:17.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e7f400640 1 --2- 172.21.15.59:0/3515176449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e800d0d70 0x7f1e800b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:17.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e7f400640 1 -- 172.21.15.59:0/3515176449 >> v1:172.21.15.59:6789/0 conn(0x7f1e800cfc10 legacy=0x7f1e800d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:17.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e7f400640 1 -- 172.21.15.59:0/3515176449 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8015cce0 con 0x7f1e801534f0 2024-05-30T17:00:17.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.728+0000 7f1e7e000640 1 -- 172.21.15.59:0/3515176449 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185228924 0 0) 0x7f1e800d0090 con 0x7f1e800cfc10 2024-05-30T17:00:17.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e7f400640 1 --2- 172.21.15.59:0/3515176449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e801534f0 0x7f1e800ad2b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1e700097c0 tx=0x7f1e7001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb5bd08c24813ee server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:17.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e7e000640 1 -- 172.21.15.59:0/3515176449 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e700b1070 con 0x7f1e801534f0 2024-05-30T17:00:17.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e7e000640 1 -- 172.21.15.59:0/3515176449 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e700ac440 con 0x7f1e801534f0 2024-05-30T17:00:17.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e7e000640 1 -- 172.21.15.59:0/3515176449 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e700ac810 con 0x7f1e801534f0 2024-05-30T17:00:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e86200640 1 -- 172.21.15.59:0/3515176449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e801534f0 msgr2=0x7f1e800ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e86200640 1 --2- 172.21.15.59:0/3515176449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e801534f0 0x7f1e800ad2b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1e700097c0 tx=0x7f1e7001c410 comp rx=0 tx=0).stop 2024-05-30T17:00:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e86200640 1 -- 172.21.15.59:0/3515176449 shutdown_connections 2024-05-30T17:00:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e86200640 1 --2- 172.21.15.59:0/3515176449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e800d0d70 0x7f1e800b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e86200640 1 --2- 172.21.15.59:0/3515176449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e801534f0 0x7f1e800ad2b0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e86200640 1 -- 172.21.15.59:0/3515176449 >> 172.21.15.59:0/3515176449 conn(0x7f1e8006bdb0 msgr2=0x7f1e8006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:17.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e86200640 1 -- 172.21.15.59:0/3515176449 shutdown_connections 2024-05-30T17:00:17.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e86200640 1 -- 172.21.15.59:0/3515176449 wait complete. 2024-05-30T17:00:17.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e86200640 1 Processor -- start 2024-05-30T17:00:17.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.732+0000 7f1e86200640 1 -- start start 2024-05-30T17:00:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e86200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e800cfc10 0x7f1e800998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e86200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e800d0d70 0x7f1e8006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e86200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e801534f0 0x7f1e8006f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e86200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8015d940 con 0x7f1e800cfc10 2024-05-30T17:00:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e86200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8015d7c0 con 0x7f1e800d0d70 2024-05-30T17:00:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e86200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1e801691c0 con 0x7f1e801534f0 2024-05-30T17:00:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e7f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e800cfc10 0x7f1e800998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e7f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e800cfc10 0x7f1e800998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42678/0 (socket says 172.21.15.59:42678) 2024-05-30T17:00:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e7f400640 1 -- 172.21.15.59:0/2163330449 learned_addr learned my addr 172.21.15.59:0/2163330449 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e7f400640 1 -- 172.21.15.59:0/2163330449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e801534f0 msgr2=0x7f1e8006f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e7f400640 1 --2- 172.21.15.59:0/2163330449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e801534f0 0x7f1e8006f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e7f400640 1 -- 172.21.15.59:0/2163330449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e800d0d70 msgr2=0x7f1e8006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e7f400640 1 --2- 172.21.15.59:0/2163330449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e800d0d70 0x7f1e8006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e7f400640 1 -- 172.21.15.59:0/2163330449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e801562e0 con 0x7f1e800cfc10 2024-05-30T17:00:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e7f400640 1 --2- 172.21.15.59:0/2163330449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e800cfc10 0x7f1e800998f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f1e700af040 tx=0x7f1e700191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:17.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e77400640 1 -- 172.21.15.59:0/2163330449 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e700b9070 con 0x7f1e800cfc10 2024-05-30T17:00:17.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e77400640 1 -- 172.21.15.59:0/2163330449 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e700b5630 con 0x7f1e800cfc10 2024-05-30T17:00:17.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e77400640 1 -- 172.21.15.59:0/2163330449 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e700b1040 con 0x7f1e800cfc10 2024-05-30T17:00:17.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e86200640 1 -- 172.21.15.59:0/2163330449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e8006fa40 con 0x7f1e800cfc10 2024-05-30T17:00:17.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e86200640 1 -- 172.21.15.59:0/2163330449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e80150ca0 con 0x7f1e800cfc10 2024-05-30T17:00:17.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.736+0000 7f1e86200640 1 -- 172.21.15.59:0/2163330449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e80073d70 con 0x7f1e800cfc10 2024-05-30T17:00:17.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.740+0000 7f1e77400640 1 -- 172.21.15.59:0/2163330449 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 29) ==== 89619+0+0 (secure 0 0 0) 0x7f1e700bc070 con 0x7f1e800cfc10 2024-05-30T17:00:17.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.740+0000 7f1e77400640 1 --2- 172.21.15.59:0/2163330449 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e60069580 0x7f1e6006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:17.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.740+0000 7f1e77400640 1 -- 172.21.15.59:0/2163330449 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f1e7011f340 con 0x7f1e800cfc10 2024-05-30T17:00:17.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.740+0000 7f1e7ea00640 1 --2- 172.21.15.59:0/2163330449 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e60069580 0x7f1e6006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:17.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.740+0000 7f1e7ea00640 1 --2- 172.21.15.59:0/2163330449 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e60069580 0x7f1e6006ba40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0011f0 tx=0x7f1e6c007930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:17.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.744+0000 7f1e77400640 1 -- 172.21.15.59:0/2163330449 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1e70016090 con 0x7f1e800cfc10 2024-05-30T17:00:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:17.944+0000 7f1e86200640 1 -- 172.21.15.59:0/2163330449 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f1e80068a90 con 0x7f1e60069580 2024-05-30T17:00:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.004+0000 7f1e77400640 1 -- 172.21.15.59:0/2163330449 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1e80068a90 con 0x7f1e60069580 2024-05-30T17:00:18.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.008+0000 7f1e86200640 1 -- 172.21.15.59:0/2163330449 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e60069580 msgr2=0x7f1e6006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.008+0000 7f1e86200640 1 --2- 172.21.15.59:0/2163330449 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e60069580 0x7f1e6006ba40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0011f0 tx=0x7f1e6c007930 comp rx=0 tx=0).stop 2024-05-30T17:00:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.008+0000 7f1e86200640 1 -- 172.21.15.59:0/2163330449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e800cfc10 msgr2=0x7f1e800998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.008+0000 7f1e86200640 1 --2- 172.21.15.59:0/2163330449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e800cfc10 0x7f1e800998f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f1e700af040 tx=0x7f1e700191b0 comp rx=0 tx=0).stop 2024-05-30T17:00:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.008+0000 7f1e86200640 1 -- 172.21.15.59:0/2163330449 shutdown_connections 2024-05-30T17:00:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.008+0000 7f1e86200640 1 --2- 172.21.15.59:0/2163330449 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e60069580 0x7f1e6006ba40 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.008+0000 7f1e86200640 1 --2- 172.21.15.59:0/2163330449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e801534f0 0x7f1e8006f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.008+0000 7f1e86200640 1 --2- 172.21.15.59:0/2163330449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e800d0d70 0x7f1e8006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.008+0000 7f1e86200640 1 --2- 172.21.15.59:0/2163330449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e800cfc10 0x7f1e800998f0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.008+0000 7f1e86200640 1 -- 172.21.15.59:0/2163330449 >> 172.21.15.59:0/2163330449 conn(0x7f1e8006bdb0 msgr2=0x7f1e800b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.008+0000 7f1e86200640 1 -- 172.21.15.59:0/2163330449 shutdown_connections 2024-05-30T17:00:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.008+0000 7f1e86200640 1 -- 172.21.15.59:0/2163330449 wait complete. 2024-05-30T17:00:18.010 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:18.009+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:18.010 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:18.009+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:18.010 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:18.009+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:18.010 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:18.009+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:18.010 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:18.009+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:18.025 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:18.025+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:18.026 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:18.025+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:18.026 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:18.025+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:18.026 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:18.025+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:18.026 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:18.025+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:18.029 INFO:tasks.cephfs.test_volumes:expected clone state = ('in-progress',) 2024-05-30T17:00:18.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T17:00:18.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.172+0000 7fef7d200640 1 Processor -- start 2024-05-30T17:00:18.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.172+0000 7fef7d200640 1 -- start start 2024-05-30T17:00:18.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef7d200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef7815a270 0x7fef780b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:18.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef7d200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7809ae20 con 0x7fef780d19b0 2024-05-30T17:00:18.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef7d200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7809b100 con 0x7fef78160850 2024-05-30T17:00:18.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef7d200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fef78160f90 con 0x7fef7815a270 2024-05-30T17:00:18.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef6ea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fef780d19b0 0x7fef78160140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56428/0 (socket says 172.21.15.59:56428) 2024-05-30T17:00:18.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef6ea00640 1 -- 172.21.15.59:0/531826939 learned_addr learned my addr 172.21.15.59:0/531826939 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:18.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef77400640 1 --2- 172.21.15.59:0/531826939 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef7815a270 0x7fef780b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:18.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef76a00640 1 -- 172.21.15.59:0/531826939 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990868144 0 0) 0x7fef7809ae20 con 0x7fef780d19b0 2024-05-30T17:00:18.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef76a00640 1 -- 172.21.15.59:0/531826939 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef5c003530 con 0x7fef780d19b0 2024-05-30T17:00:18.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef76a00640 1 -- 172.21.15.59:0/531826939 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239921529 0 0) 0x7fef7809b100 con 0x7fef78160850 2024-05-30T17:00:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef76a00640 1 -- 172.21.15.59:0/531826939 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef7809ae20 con 0x7fef78160850 2024-05-30T17:00:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef77400640 1 -- 172.21.15.59:0/531826939 >> v1:172.21.15.107:6789/0 conn(0x7fef78160850 legacy=0x7fef780cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef77400640 1 -- 172.21.15.59:0/531826939 >> v1:172.21.15.59:6789/0 conn(0x7fef780d19b0 legacy=0x7fef78160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef76a00640 1 -- 172.21.15.59:0/531826939 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 338079807 0 0) 0x7fef5c003530 con 0x7fef780d19b0 2024-05-30T17:00:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.176+0000 7fef77400640 1 -- 172.21.15.59:0/531826939 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7809b3e0 con 0x7fef7815a270 2024-05-30T17:00:18.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef77400640 1 --2- 172.21.15.59:0/531826939 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef7815a270 0x7fef780b19c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef68009dc0 tx=0x7fef6801c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acaa730522238cbf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:18.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef76a00640 1 -- 172.21.15.59:0/531826939 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef680b2070 con 0x7fef7815a270 2024-05-30T17:00:18.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef76a00640 1 -- 172.21.15.59:0/531826939 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef680a5650 con 0x7fef7815a270 2024-05-30T17:00:18.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef76a00640 1 -- 172.21.15.59:0/531826939 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60001680 con 0x7fef7815a270 2024-05-30T17:00:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 -- 172.21.15.59:0/531826939 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef7815a270 msgr2=0x7fef780b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 --2- 172.21.15.59:0/531826939 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef7815a270 0x7fef780b19c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef68009dc0 tx=0x7fef6801c820 comp rx=0 tx=0).stop 2024-05-30T17:00:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 -- 172.21.15.59:0/531826939 shutdown_connections 2024-05-30T17:00:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 --2- 172.21.15.59:0/531826939 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef7815a270 0x7fef780b19c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 -- 172.21.15.59:0/531826939 >> 172.21.15.59:0/531826939 conn(0x7fef780b3ed0 msgr2=0x7fef780b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 -- 172.21.15.59:0/531826939 shutdown_connections 2024-05-30T17:00:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 -- 172.21.15.59:0/531826939 wait complete. 2024-05-30T17:00:18.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 Processor -- start 2024-05-30T17:00:18.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 -- start start 2024-05-30T17:00:18.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef780d19b0 0x7fef7806dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:18.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef7815a270 0x7fef7814f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:18.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef78160850 0x7fef7814fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:18.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fef7816a670 con 0x7fef780d19b0 2024-05-30T17:00:18.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fef7816a4f0 con 0x7fef7815a270 2024-05-30T17:00:18.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.180+0000 7fef7d200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fef7816a7f0 con 0x7fef78160850 2024-05-30T17:00:18.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef77400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef780d19b0 0x7fef7806dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:18.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef77400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef780d19b0 0x7fef7806dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42688/0 (socket says 172.21.15.59:42688) 2024-05-30T17:00:18.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef77400640 1 -- 172.21.15.59:0/1706487966 learned_addr learned my addr 172.21.15.59:0/1706487966 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef6ea00640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef7815a270 0x7fef7814f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef77400640 1 -- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef78160850 msgr2=0x7fef7814fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef77e00640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef78160850 0x7fef7814fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef77400640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef78160850 0x7fef7814fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef77400640 1 -- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef7815a270 msgr2=0x7fef7814f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef77400640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef7815a270 0x7fef7814f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef77400640 1 -- 172.21.15.59:0/1706487966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7814df90 con 0x7fef780d19b0 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef77e00640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef78160850 0x7fef7814fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef6ea00640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef7815a270 0x7fef7814f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef77400640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef780d19b0 0x7fef7806dfb0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fef68000f90 tx=0x7fef680195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef6fe00640 1 -- 172.21.15.59:0/1706487966 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef680bd020 con 0x7fef780d19b0 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef6fe00640 1 -- 172.21.15.59:0/1706487966 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef680b8670 con 0x7fef780d19b0 2024-05-30T17:00:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef7d200640 1 -- 172.21.15.59:0/1706487966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7806cf10 con 0x7fef780d19b0 2024-05-30T17:00:18.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef6fe00640 1 -- 172.21.15.59:0/1706487966 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef680b2040 con 0x7fef780d19b0 2024-05-30T17:00:18.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef7d200640 1 -- 172.21.15.59:0/1706487966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7806d4d0 con 0x7fef780d19b0 2024-05-30T17:00:18.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef7d200640 1 -- 172.21.15.59:0/1706487966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef78068a90 con 0x7fef780d19b0 2024-05-30T17:00:18.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.184+0000 7fef6fe00640 1 -- 172.21.15.59:0/1706487966 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 29) ==== 89619+0+0 (secure 0 0 0) 0x7fef680c0020 con 0x7fef780d19b0 2024-05-30T17:00:18.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.188+0000 7fef6fe00640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fef54069580 0x7fef5406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:18.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.188+0000 7fef6fe00640 1 -- 172.21.15.59:0/1706487966 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7fef681203a0 con 0x7fef780d19b0 2024-05-30T17:00:18.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.188+0000 7fef6ea00640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fef54069580 0x7fef5406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:18.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.188+0000 7fef6ea00640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fef54069580 0x7fef5406ba40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fef60001350 tx=0x7fef60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:18.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.192+0000 7fef6fe00640 1 -- 172.21.15.59:0/1706487966 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fef680c7030 con 0x7fef780d19b0 2024-05-30T17:00:18.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:18.392+0000 7fef7d200640 1 -- 172.21.15.59:0/1706487966 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fef7809bc00 con 0x7fef54069580 2024-05-30T17:00:19.012 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:19.009+0000 7efd48c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:19.012 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:19.009+0000 7efd48c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:19.012 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:19.009+0000 7efd48c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:19.012 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:19.009+0000 7efd48c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:19.012 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:00:19.009+0000 7efd48c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:00:19.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.039+0000 7fef6fe00640 1 -- 172.21.15.59:0/1706487966 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+275 (secure 0 0 0) 0x7fef7809bc00 con 0x7fef54069580 2024-05-30T17:00:19.043 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: "status": { 2024-05-30T17:00:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "in-progress", 2024-05-30T17:00:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "source": { 2024-05-30T17:00:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "volume": "cephfs", 2024-05-30T17:00:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "subvolume": "sv1", 2024-05-30T17:00:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot": "ss1" 2024-05-30T17:00:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_report": { 2024-05-30T17:00:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "percentage cloned": 0.0, 2024-05-30T17:00:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "amount cloned": "184/3.0G", 2024-05-30T17:00:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "files cloned": "3/6" 2024-05-30T17:00:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:19.044 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:19.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.043+0000 7fef7d200640 1 -- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fef54069580 msgr2=0x7fef5406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:19.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.043+0000 7fef7d200640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fef54069580 0x7fef5406ba40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fef60001350 tx=0x7fef60009040 comp rx=0 tx=0).stop 2024-05-30T17:00:19.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.043+0000 7fef7d200640 1 -- 172.21.15.59:0/1706487966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef780d19b0 msgr2=0x7fef7806dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:19.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.043+0000 7fef7d200640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef780d19b0 0x7fef7806dfb0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fef68000f90 tx=0x7fef680195c0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.043+0000 7fef7d200640 1 -- 172.21.15.59:0/1706487966 shutdown_connections 2024-05-30T17:00:19.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.043+0000 7fef7d200640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fef54069580 0x7fef5406ba40 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.043+0000 7fef7d200640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef78160850 0x7fef7814fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.043+0000 7fef7d200640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef7815a270 0x7fef7814f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.043+0000 7fef7d200640 1 --2- 172.21.15.59:0/1706487966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef780d19b0 0x7fef7806dfb0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.043+0000 7fef7d200640 1 -- 172.21.15.59:0/1706487966 >> 172.21.15.59:0/1706487966 conn(0x7fef780b3ed0 msgr2=0x7fef78071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:19.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.043+0000 7fef7d200640 1 -- 172.21.15.59:0/1706487966 shutdown_connections 2024-05-30T17:00:19.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.043+0000 7fef7d200640 1 -- 172.21.15.59:0/1706487966 wait complete. 2024-05-30T17:00:19.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T17:00:19.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.263+0000 7f44a5400640 1 Processor -- start 2024-05-30T17:00:19.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.263+0000 7f44a5400640 1 -- start start 2024-05-30T17:00:19.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.263+0000 7f44a5400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44a015c600 0x7f44a00b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.263+0000 7f44a5400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44a015d490 0x7f44a009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.263+0000 7f44a5400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a00d0070 con 0x7f44a00d0740 2024-05-30T17:00:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.263+0000 7f44a5400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f44a00d0350 con 0x7f44a015d490 2024-05-30T17:00:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.263+0000 7f44a5400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f44a00cd140 con 0x7f44a015c600 2024-05-30T17:00:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.267+0000 7f44a4a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f44a00d0740 0x7f44a00cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56440/0 (socket says 172.21.15.59:56440) 2024-05-30T17:00:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.267+0000 7f44a4a00640 1 -- 172.21.15.59:0/2853540663 learned_addr learned my addr 172.21.15.59:0/2853540663 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.267+0000 7f449f400640 1 --2- 172.21.15.59:0/2853540663 >> v2:172.21.15.59:3300/0 conn(0x7f44a015d490 0x7f44a009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.267+0000 7f449fe00640 1 --2- 172.21.15.59:0/2853540663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44a015c600 0x7f44a00b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.267+0000 7f449f400640 1 -- 172.21.15.59:0/2853540663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44a015c600 msgr2=0x7f44a00b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.267+0000 7f449f400640 1 --2- 172.21.15.59:0/2853540663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44a015c600 0x7f44a00b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.267+0000 7f449f400640 1 -- 172.21.15.59:0/2853540663 >> v1:172.21.15.59:6789/0 conn(0x7f44a00d0740 legacy=0x7f44a00cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.267+0000 7f449f400640 1 -- 172.21.15.59:0/2853540663 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a009af80 con 0x7f44a015d490 2024-05-30T17:00:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.275+0000 7f449f400640 1 --2- 172.21.15.59:0/2853540663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015d490 0x7f44a009aa40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f448c0097c0 tx=0x7f448c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37030f3477aafe67 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.275+0000 7f449ea00640 1 -- 172.21.15.59:0/2853540663 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c0b2070 con 0x7f44a015d490 2024-05-30T17:00:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.275+0000 7f449ea00640 1 -- 172.21.15.59:0/2853540663 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448c0ad640 con 0x7f44a015d490 2024-05-30T17:00:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.275+0000 7f449ea00640 1 -- 172.21.15.59:0/2853540663 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c0ada10 con 0x7f44a015d490 2024-05-30T17:00:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.275+0000 7f44a5400640 1 -- 172.21.15.59:0/2853540663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015d490 msgr2=0x7f44a009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.275+0000 7f44a5400640 1 --2- 172.21.15.59:0/2853540663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015d490 0x7f44a009aa40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f448c0097c0 tx=0x7f448c01c4a0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.275+0000 7f44a5400640 1 -- 172.21.15.59:0/2853540663 shutdown_connections 2024-05-30T17:00:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.275+0000 7f44a5400640 1 --2- 172.21.15.59:0/2853540663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015d490 0x7f44a009aa40 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.275+0000 7f44a5400640 1 --2- 172.21.15.59:0/2853540663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44a015c600 0x7f44a00b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.275+0000 7f44a5400640 1 -- 172.21.15.59:0/2853540663 >> 172.21.15.59:0/2853540663 conn(0x7f44a00b3df0 msgr2=0x7f44a00b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.275+0000 7f44a5400640 1 -- 172.21.15.59:0/2853540663 shutdown_connections 2024-05-30T17:00:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.275+0000 7f44a5400640 1 -- 172.21.15.59:0/2853540663 wait complete. 2024-05-30T17:00:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.279+0000 7f44a5400640 1 Processor -- start 2024-05-30T17:00:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.279+0000 7f44a5400640 1 -- start start 2024-05-30T17:00:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.279+0000 7f44a5400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44a00d0740 0x7f44a00b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.279+0000 7f44a5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015c600 0x7f44a0156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.279+0000 7f44a5400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44a015d490 0x7f44a0157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.279+0000 7f44a5400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44a00cebb0 con 0x7f44a015c600 2024-05-30T17:00:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.279+0000 7f44a5400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f44a00cea30 con 0x7f44a015d490 2024-05-30T17:00:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.279+0000 7f44a5400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f44a006cac0 con 0x7f44a00d0740 2024-05-30T17:00:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.283+0000 7f449f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015c600 0x7f44a0156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.283+0000 7f449f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015c600 0x7f44a0156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42700/0 (socket says 172.21.15.59:42700) 2024-05-30T17:00:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.283+0000 7f449f400640 1 -- 172.21.15.59:0/2480530082 learned_addr learned my addr 172.21.15.59:0/2480530082 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.283+0000 7f44a4a00640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44a015d490 0x7f44a0157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.283+0000 7f449f400640 1 -- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44a00d0740 msgr2=0x7f44a00b27c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T17:00:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.283+0000 7f449f400640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44a00d0740 0x7f44a00b27c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.283+0000 7f449f400640 1 -- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44a015d490 msgr2=0x7f44a0157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.283+0000 7f449f400640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44a015d490 0x7f44a0157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.283+0000 7f449f400640 1 -- 172.21.15.59:0/2480530082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a0157b30 con 0x7f44a015c600 2024-05-30T17:00:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.283+0000 7f44a4a00640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44a015d490 0x7f44a0157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:00:19.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.283+0000 7f449f400640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015c600 0x7f44a0156fc0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f448c01ab50 tx=0x7f448c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:19.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.287+0000 7f4497e00640 1 -- 172.21.15.59:0/2480530082 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c0bb070 con 0x7f44a015c600 2024-05-30T17:00:19.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.287+0000 7f4497e00640 1 -- 172.21.15.59:0/2480530082 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448c0b65f0 con 0x7f44a015c600 2024-05-30T17:00:19.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.287+0000 7f4497e00640 1 -- 172.21.15.59:0/2480530082 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c0b2040 con 0x7f44a015c600 2024-05-30T17:00:19.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.287+0000 7f44a5400640 1 -- 172.21.15.59:0/2480530082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a0155cb0 con 0x7f44a015c600 2024-05-30T17:00:19.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.287+0000 7f44a5400640 1 -- 172.21.15.59:0/2480530082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a014eaf0 con 0x7f44a015c600 2024-05-30T17:00:19.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.287+0000 7f4497e00640 1 -- 172.21.15.59:0/2480530082 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 29) ==== 89619+0+0 (secure 0 0 0) 0x7f448c0ad500 con 0x7f44a015c600 2024-05-30T17:00:19.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.287+0000 7f44a5400640 1 -- 172.21.15.59:0/2480530082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a00691a0 con 0x7f44a015c600 2024-05-30T17:00:19.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.291+0000 7f4497e00640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4480069650 0x7f448006bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:19.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.291+0000 7f4497e00640 1 -- 172.21.15.59:0/2480530082 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f448c11eb80 con 0x7f44a015c600 2024-05-30T17:00:19.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.291+0000 7f449fe00640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4480069650 0x7f448006bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:19.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.295+0000 7f449fe00640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4480069650 0x7f448006bb10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f44a01f6f00 tx=0x7f4490008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:19.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.299+0000 7f4497e00640 1 -- 172.21.15.59:0/2480530082 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f448c0160b0 con 0x7f44a015c600 2024-05-30T17:00:19.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.607+0000 7f44a5400640 1 -- 172.21.15.59:0/2480530082 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f44a00b49b0 con 0x7f4480069650 2024-05-30T17:00:19.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.663+0000 7f4497e00640 1 -- 172.21.15.59:0/2480530082 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+275 (secure 0 0 0) 0x7f44a00b49b0 con 0x7f4480069650 2024-05-30T17:00:19.666 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "status": { 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "in-progress", 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "source": { 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "volume": "cephfs", 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "subvolume": "sv1", 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot": "ss1" 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_report": { 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "percentage cloned": 0.0, 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "amount cloned": "184/3.0G", 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "files cloned": "4/6" 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:19.668 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:19.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.667+0000 7f44a5400640 1 -- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4480069650 msgr2=0x7f448006bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:19.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.667+0000 7f44a5400640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4480069650 0x7f448006bb10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f44a01f6f00 tx=0x7f4490008040 comp rx=0 tx=0).stop 2024-05-30T17:00:19.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.667+0000 7f44a5400640 1 -- 172.21.15.59:0/2480530082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015c600 msgr2=0x7f44a0156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:19.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.667+0000 7f44a5400640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015c600 0x7f44a0156fc0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f448c01ab50 tx=0x7f448c019240 comp rx=0 tx=0).stop 2024-05-30T17:00:19.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.667+0000 7f44a5400640 1 -- 172.21.15.59:0/2480530082 shutdown_connections 2024-05-30T17:00:19.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.667+0000 7f44a5400640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4480069650 0x7f448006bb10 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.667+0000 7f44a5400640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44a015d490 0x7f44a0157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.667+0000 7f44a5400640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015c600 0x7f44a0156fc0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.667+0000 7f44a5400640 1 --2- 172.21.15.59:0/2480530082 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44a00d0740 0x7f44a00b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.667+0000 7f44a5400640 1 -- 172.21.15.59:0/2480530082 >> 172.21.15.59:0/2480530082 conn(0x7f44a00b3df0 msgr2=0x7f44a0074c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:19.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.667+0000 7f44a5400640 1 -- 172.21.15.59:0/2480530082 shutdown_connections 2024-05-30T17:00:19.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.667+0000 7f44a5400640 1 -- 172.21.15.59:0/2480530082 wait complete. 2024-05-30T17:00:19.711 INFO:tasks.cephfs.test_volumes:percentage cloned = 0.0 2024-05-30T17:00:19.712 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T17:00:19.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.923+0000 7fcd2b000640 1 Processor -- start 2024-05-30T17:00:19.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.923+0000 7fcd2b000640 1 -- start start 2024-05-30T17:00:19.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.927+0000 7fcd2b000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd24159100 0x7fcd2406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:19.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.927+0000 7fcd2b000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd240b52d0 con 0x7fcd240b44e0 2024-05-30T17:00:19.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.927+0000 7fcd2b000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd240b4a30 con 0x7fcd2415c010 2024-05-30T17:00:19.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.927+0000 7fcd2b000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fcd240b4d10 con 0x7fcd24159100 2024-05-30T17:00:19.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.927+0000 7fcd23400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcd240b44e0 0x7fcd2415efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56454/0 (socket says 172.21.15.59:56454) 2024-05-30T17:00:19.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.927+0000 7fcd23400640 1 -- 172.21.15.59:0/4171796508 learned_addr learned my addr 172.21.15.59:0/4171796508 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:19.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.927+0000 7fcd23e00640 1 --2- 172.21.15.59:0/4171796508 >> v2:172.21.15.59:3300/0 conn(0x7fcd24159100 0x7fcd2406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:19.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.927+0000 7fcd22a00640 1 -- 172.21.15.59:0/4171796508 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209154244 0 0) 0x7fcd240b52d0 con 0x7fcd240b44e0 2024-05-30T17:00:19.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.927+0000 7fcd22a00640 1 -- 172.21.15.59:0/4171796508 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd08003530 con 0x7fcd240b44e0 2024-05-30T17:00:19.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.927+0000 7fcd23e00640 1 -- 172.21.15.59:0/4171796508 >> v1:172.21.15.107:6789/0 conn(0x7fcd2415c010 legacy=0x7fcd240d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:19.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.927+0000 7fcd23e00640 1 -- 172.21.15.59:0/4171796508 >> v1:172.21.15.59:6789/0 conn(0x7fcd240b44e0 legacy=0x7fcd2415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:19.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.927+0000 7fcd23e00640 1 -- 172.21.15.59:0/4171796508 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd240b4ff0 con 0x7fcd24159100 2024-05-30T17:00:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.931+0000 7fcd23e00640 1 --2- 172.21.15.59:0/4171796508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd24159100 0x7fcd2406e590 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fcd140097c0 tx=0x7fcd1401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470cf12429246fe2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.931+0000 7fcd22a00640 1 -- 172.21.15.59:0/4171796508 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd140b1070 con 0x7fcd24159100 2024-05-30T17:00:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.931+0000 7fcd22a00640 1 -- 172.21.15.59:0/4171796508 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd140a8050 con 0x7fcd24159100 2024-05-30T17:00:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.931+0000 7fcd22a00640 1 -- 172.21.15.59:0/4171796508 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd140ac860 con 0x7fcd24159100 2024-05-30T17:00:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.931+0000 7fcd2b000640 1 -- 172.21.15.59:0/4171796508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd24159100 msgr2=0x7fcd2406e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.931+0000 7fcd2b000640 1 --2- 172.21.15.59:0/4171796508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd24159100 0x7fcd2406e590 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fcd140097c0 tx=0x7fcd1401c3e0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.931+0000 7fcd2b000640 1 -- 172.21.15.59:0/4171796508 shutdown_connections 2024-05-30T17:00:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.931+0000 7fcd2b000640 1 --2- 172.21.15.59:0/4171796508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd24159100 0x7fcd2406e590 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.931+0000 7fcd2b000640 1 -- 172.21.15.59:0/4171796508 >> 172.21.15.59:0/4171796508 conn(0x7fcd2406bdb0 msgr2=0x7fcd2406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.931+0000 7fcd2b000640 1 -- 172.21.15.59:0/4171796508 shutdown_connections 2024-05-30T17:00:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.935+0000 7fcd2b000640 1 -- 172.21.15.59:0/4171796508 wait complete. 2024-05-30T17:00:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.935+0000 7fcd2b000640 1 Processor -- start 2024-05-30T17:00:19.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.935+0000 7fcd2b000640 1 -- start start 2024-05-30T17:00:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd2b000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240b44e0 0x7fcd2414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd2b000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd24159100 0x7fcd241527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd2b000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd2415c010 0x7fcd240cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd2b000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcd240d1020 con 0x7fcd240b44e0 2024-05-30T17:00:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd2b000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcd240d0ea0 con 0x7fcd2415c010 2024-05-30T17:00:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd2b000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcd2415c420 con 0x7fcd24159100 2024-05-30T17:00:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd23e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240b44e0 0x7fcd2414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd23e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240b44e0 0x7fcd2414d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42718/0 (socket says 172.21.15.59:42718) 2024-05-30T17:00:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd23e00640 1 -- 172.21.15.59:0/1056971369 learned_addr learned my addr 172.21.15.59:0/1056971369 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd23e00640 1 -- 172.21.15.59:0/1056971369 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd24159100 msgr2=0x7fcd241527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd23e00640 1 --2- 172.21.15.59:0/1056971369 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd24159100 0x7fcd241527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd23e00640 1 -- 172.21.15.59:0/1056971369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd2415c010 msgr2=0x7fcd240cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd23e00640 1 --2- 172.21.15.59:0/1056971369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd2415c010 0x7fcd240cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd23e00640 1 -- 172.21.15.59:0/1056971369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd240c9650 con 0x7fcd240b44e0 2024-05-30T17:00:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd23e00640 1 --2- 172.21.15.59:0/1056971369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240b44e0 0x7fcd2414d270 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fcd1401a010 tx=0x7fcd14019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd1be00640 1 -- 172.21.15.59:0/1056971369 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd140ba020 con 0x7fcd240b44e0 2024-05-30T17:00:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd1be00640 1 -- 172.21.15.59:0/1056971369 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd140ace50 con 0x7fcd240b44e0 2024-05-30T17:00:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd1be00640 1 -- 172.21.15.59:0/1056971369 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd140b1040 con 0x7fcd240b44e0 2024-05-30T17:00:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd2b000640 1 -- 172.21.15.59:0/1056971369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd240c9930 con 0x7fcd240b44e0 2024-05-30T17:00:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd2b000640 1 -- 172.21.15.59:0/1056971369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd240c9ef0 con 0x7fcd240b44e0 2024-05-30T17:00:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.939+0000 7fcd2b000640 1 -- 172.21.15.59:0/1056971369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd24068a90 con 0x7fcd240b44e0 2024-05-30T17:00:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.943+0000 7fcd1be00640 1 -- 172.21.15.59:0/1056971369 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 29) ==== 89619+0+0 (secure 0 0 0) 0x7fcd140bd020 con 0x7fcd240b44e0 2024-05-30T17:00:19.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.943+0000 7fcd1be00640 1 --2- 172.21.15.59:0/1056971369 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcd04069580 0x7fcd0406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:19.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.943+0000 7fcd1be00640 1 -- 172.21.15.59:0/1056971369 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7fcd1411f4e0 con 0x7fcd240b44e0 2024-05-30T17:00:19.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.947+0000 7fcd1be00640 1 -- 172.21.15.59:0/1056971369 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd140c4070 con 0x7fcd240b44e0 2024-05-30T17:00:19.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.955+0000 7fcd23400640 1 --2- 172.21.15.59:0/1056971369 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcd04069580 0x7fcd0406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:19.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:19.955+0000 7fcd23400640 1 --2- 172.21.15.59:0/1056971369 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcd04069580 0x7fcd0406ba40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcd10007fd0 tx=0x7fcd10007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:20.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.243+0000 7fcd1be00640 1 -- 172.21.15.59:0/1056971369 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7fcd140b4070 con 0x7fcd240b44e0 2024-05-30T17:00:20.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.263+0000 7fcd2b000640 1 -- 172.21.15.59:0/1056971369 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fcd24166aa0 con 0x7fcd04069580 2024-05-30T17:00:20.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.323+0000 7fcd1be00640 1 -- 172.21.15.59:0/1056971369 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+275 (secure 0 0 0) 0x7fcd24166aa0 con 0x7fcd04069580 2024-05-30T17:00:20.326 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:20.326 INFO:teuthology.orchestra.run.smithi059.stdout: "status": { 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "in-progress", 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout: "source": { 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout: "volume": "cephfs", 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout: "subvolume": "sv1", 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot": "ss1" 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_report": { 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout: "percentage cloned": 0.0, 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout: "amount cloned": "184/3.0G", 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout: "files cloned": "4/6" 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:20.327 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:20.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.327+0000 7fcd2b000640 1 -- 172.21.15.59:0/1056971369 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcd04069580 msgr2=0x7fcd0406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:20.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.327+0000 7fcd2b000640 1 --2- 172.21.15.59:0/1056971369 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcd04069580 0x7fcd0406ba40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcd10007fd0 tx=0x7fcd10007900 comp rx=0 tx=0).stop 2024-05-30T17:00:20.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.327+0000 7fcd2b000640 1 -- 172.21.15.59:0/1056971369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240b44e0 msgr2=0x7fcd2414d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:20.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.327+0000 7fcd2b000640 1 --2- 172.21.15.59:0/1056971369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240b44e0 0x7fcd2414d270 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fcd1401a010 tx=0x7fcd14019180 comp rx=0 tx=0).stop 2024-05-30T17:00:20.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.327+0000 7fcd2b000640 1 -- 172.21.15.59:0/1056971369 shutdown_connections 2024-05-30T17:00:20.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.327+0000 7fcd2b000640 1 --2- 172.21.15.59:0/1056971369 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcd04069580 0x7fcd0406ba40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:20.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.327+0000 7fcd2b000640 1 --2- 172.21.15.59:0/1056971369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd2415c010 0x7fcd240cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:20.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.327+0000 7fcd2b000640 1 --2- 172.21.15.59:0/1056971369 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd24159100 0x7fcd241527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:20.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.327+0000 7fcd2b000640 1 --2- 172.21.15.59:0/1056971369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240b44e0 0x7fcd2414d270 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:20.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.327+0000 7fcd2b000640 1 -- 172.21.15.59:0/1056971369 >> 172.21.15.59:0/1056971369 conn(0x7fcd2406bdb0 msgr2=0x7fcd240aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:20.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.327+0000 7fcd2b000640 1 -- 172.21.15.59:0/1056971369 shutdown_connections 2024-05-30T17:00:20.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.327+0000 7fcd2b000640 1 -- 172.21.15.59:0/1056971369 wait complete. 2024-05-30T17:00:20.368 INFO:tasks.cephfs.test_volumes:percentage cloned = 0.0 2024-05-30T17:00:20.368 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T17:00:20.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.595+0000 7f247c200640 1 Processor -- start 2024-05-30T17:00:20.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.595+0000 7f247c200640 1 -- start start 2024-05-30T17:00:20.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.595+0000 7f247c200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f247406cc80 0x7f2474159570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:20.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.595+0000 7f247c200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2474164110 con 0x7f247406d060 2024-05-30T17:00:20.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.595+0000 7f247c200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24740d0300 con 0x7f24740b4650 2024-05-30T17:00:20.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.595+0000 7f247c200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2474163be0 con 0x7f247406cc80 2024-05-30T17:00:20.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.595+0000 7f247a200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f24740b4650 0x7f2474166820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:42302/0 (socket says 172.21.15.59:42302) 2024-05-30T17:00:20.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.595+0000 7f247a200640 1 -- 172.21.15.59:0/1404040594 learned_addr learned my addr 172.21.15.59:0/1404040594 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:20.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.595+0000 7f2479800640 1 --2- 172.21.15.59:0/1404040594 >> v2:172.21.15.107:3300/0 conn(0x7f247406cc80 0x7f2474159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:20.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.599+0000 7f2473e00640 1 -- 172.21.15.59:0/1404040594 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2447410481 0 0) 0x7f24740d0300 con 0x7f24740b4650 2024-05-30T17:00:20.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.599+0000 7f2473e00640 1 -- 172.21.15.59:0/1404040594 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f245c003530 con 0x7f24740b4650 2024-05-30T17:00:20.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.599+0000 7f2473e00640 1 -- 172.21.15.59:0/1404040594 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983906511 0 0) 0x7f2474164110 con 0x7f247406d060 2024-05-30T17:00:20.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.599+0000 7f2473e00640 1 -- 172.21.15.59:0/1404040594 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24740d0300 con 0x7f247406d060 2024-05-30T17:00:20.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.599+0000 7f2479800640 1 -- 172.21.15.59:0/1404040594 >> v1:172.21.15.107:6789/0 conn(0x7f24740b4650 legacy=0x7f2474166820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:20.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.599+0000 7f2479800640 1 -- 172.21.15.59:0/1404040594 >> v1:172.21.15.59:6789/0 conn(0x7f247406d060 legacy=0x7f2474159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:20.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.599+0000 7f2479800640 1 -- 172.21.15.59:0/1404040594 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2474163e30 con 0x7f247406cc80 2024-05-30T17:00:20.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.603+0000 7f2479800640 1 --2- 172.21.15.59:0/1404040594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247406cc80 0x7f2474159570 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2474163d60 tx=0x7f246801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a083fcdaf08d987f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:20.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.607+0000 7f2473e00640 1 -- 172.21.15.59:0/1404040594 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24680b0070 con 0x7f247406cc80 2024-05-30T17:00:20.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.607+0000 7f2473e00640 1 -- 172.21.15.59:0/1404040594 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24680ab600 con 0x7f247406cc80 2024-05-30T17:00:20.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.607+0000 7f2473e00640 1 -- 172.21.15.59:0/1404040594 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24680ab9d0 con 0x7f247406cc80 2024-05-30T17:00:20.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.607+0000 7f247c200640 1 -- 172.21.15.59:0/1404040594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247406cc80 msgr2=0x7f2474159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:20.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.607+0000 7f247c200640 1 --2- 172.21.15.59:0/1404040594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247406cc80 0x7f2474159570 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2474163d60 tx=0x7f246801c410 comp rx=0 tx=0).stop 2024-05-30T17:00:20.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.607+0000 7f247c200640 1 -- 172.21.15.59:0/1404040594 shutdown_connections 2024-05-30T17:00:20.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.607+0000 7f247c200640 1 --2- 172.21.15.59:0/1404040594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247406cc80 0x7f2474159570 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:20.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.607+0000 7f247c200640 1 -- 172.21.15.59:0/1404040594 >> 172.21.15.59:0/1404040594 conn(0x7f24740725a0 msgr2=0x7f24740729b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:20.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.607+0000 7f247c200640 1 -- 172.21.15.59:0/1404040594 shutdown_connections 2024-05-30T17:00:20.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.607+0000 7f247c200640 1 -- 172.21.15.59:0/1404040594 wait complete. 2024-05-30T17:00:20.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.607+0000 7f247c200640 1 Processor -- start 2024-05-30T17:00:20.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.611+0000 7f247c200640 1 -- start start 2024-05-30T17:00:20.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.611+0000 7f247c200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247406cc80 0x7f24741481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:20.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.611+0000 7f247c200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f247406d060 0x7f2474165570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:20.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.611+0000 7f247c200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740b4650 0x7f2474152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:20.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.611+0000 7f247c200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2474170ea0 con 0x7f247406d060 2024-05-30T17:00:20.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.611+0000 7f247c200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2474170d20 con 0x7f247406cc80 2024-05-30T17:00:20.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.611+0000 7f247c200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2474171020 con 0x7f24740b4650 2024-05-30T17:00:20.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.611+0000 7f2478e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f247406d060 0x7f2474165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:20.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.611+0000 7f2478e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f247406d060 0x7f2474165570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42732/0 (socket says 172.21.15.59:42732) 2024-05-30T17:00:20.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.611+0000 7f2478e00640 1 -- 172.21.15.59:0/3444194268 learned_addr learned my addr 172.21.15.59:0/3444194268 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:20.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.611+0000 7f2479800640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247406cc80 0x7f24741481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:20.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.611+0000 7f247a200640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740b4650 0x7f2474152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:20.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.615+0000 7f2478e00640 1 -- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740b4650 msgr2=0x7f2474152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:20.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.615+0000 7f2478e00640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740b4650 0x7f2474152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:20.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.615+0000 7f2478e00640 1 -- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247406cc80 msgr2=0x7f24741481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:20.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.615+0000 7f2478e00640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247406cc80 0x7f24741481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:20.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.615+0000 7f2478e00640 1 -- 172.21.15.59:0/3444194268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2474166000 con 0x7f247406d060 2024-05-30T17:00:20.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.615+0000 7f2478e00640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f247406d060 0x7f2474165570 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f246000c490 tx=0x7f246000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:20.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.615+0000 7f2471600640 1 -- 172.21.15.59:0/3444194268 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24600052d0 con 0x7f247406d060 2024-05-30T17:00:20.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.615+0000 7f2471600640 1 -- 172.21.15.59:0/3444194268 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2460005470 con 0x7f247406d060 2024-05-30T17:00:20.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.615+0000 7f2471600640 1 -- 172.21.15.59:0/3444194268 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2460012870 con 0x7f247406d060 2024-05-30T17:00:20.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.615+0000 7f247c200640 1 -- 172.21.15.59:0/3444194268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24741662e0 con 0x7f247406d060 2024-05-30T17:00:20.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.615+0000 7f247c200640 1 -- 172.21.15.59:0/3444194268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247415b020 con 0x7f247406d060 2024-05-30T17:00:20.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.619+0000 7f247c200640 1 -- 172.21.15.59:0/3444194268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f247415b220 con 0x7f247406d060 2024-05-30T17:00:20.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.619+0000 7f2471600640 1 -- 172.21.15.59:0/3444194268 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f2460012a10 con 0x7f247406d060 2024-05-30T17:00:20.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.619+0000 7f2471600640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2454069800 0x7f245406bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:20.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.619+0000 7f2471600640 1 -- 172.21.15.59:0/3444194268 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f2460085190 con 0x7f247406d060 2024-05-30T17:00:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.623+0000 7f2471600640 1 -- 172.21.15.59:0/3444194268 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f247415b220 con 0x7f247406d060 2024-05-30T17:00:20.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.627+0000 7f2479800640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2454069800 0x7f245406bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:20.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.631+0000 7f2479800640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2454069800 0x7f245406bcc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f24680ad000 tx=0x7f24680a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:20.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.919+0000 7f247c200640 1 -- 172.21.15.59:0/3444194268 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f2474067c60 con 0x7f2454069800 2024-05-30T17:00:20.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.959+0000 7f2471600640 1 -- 172.21.15.59:0/3444194268 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+279 (secure 0 0 0) 0x7f2474067c60 con 0x7f2454069800 2024-05-30T17:00:20.961 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:20.962 INFO:teuthology.orchestra.run.smithi059.stdout: "status": { 2024-05-30T17:00:20.962 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "in-progress", 2024-05-30T17:00:20.962 INFO:teuthology.orchestra.run.smithi059.stdout: "source": { 2024-05-30T17:00:20.962 INFO:teuthology.orchestra.run.smithi059.stdout: "volume": "cephfs", 2024-05-30T17:00:20.962 INFO:teuthology.orchestra.run.smithi059.stdout: "subvolume": "sv1", 2024-05-30T17:00:20.962 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot": "ss1" 2024-05-30T17:00:20.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:20.962 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_report": { 2024-05-30T17:00:20.962 INFO:teuthology.orchestra.run.smithi059.stdout: "percentage cloned": 23.958, 2024-05-30T17:00:20.962 INFO:teuthology.orchestra.run.smithi059.stdout: "amount cloned": "736M/3.0G", 2024-05-30T17:00:20.962 INFO:teuthology.orchestra.run.smithi059.stdout: "files cloned": "4/6" 2024-05-30T17:00:20.962 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:20.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:20.963 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.963+0000 7f247c200640 1 -- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2454069800 msgr2=0x7f245406bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.963+0000 7f247c200640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2454069800 0x7f245406bcc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f24680ad000 tx=0x7f24680a6000 comp rx=0 tx=0).stop 2024-05-30T17:00:20.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.963+0000 7f247c200640 1 -- 172.21.15.59:0/3444194268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f247406d060 msgr2=0x7f2474165570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:20.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.963+0000 7f247c200640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f247406d060 0x7f2474165570 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f246000c490 tx=0x7f246000c950 comp rx=0 tx=0).stop 2024-05-30T17:00:20.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.963+0000 7f247c200640 1 -- 172.21.15.59:0/3444194268 shutdown_connections 2024-05-30T17:00:20.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.963+0000 7f247c200640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2454069800 0x7f245406bcc0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:20.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.963+0000 7f247c200640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740b4650 0x7f2474152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:20.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.963+0000 7f247c200640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f247406d060 0x7f2474165570 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:20.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.963+0000 7f247c200640 1 --2- 172.21.15.59:0/3444194268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247406cc80 0x7f24741481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:20.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.963+0000 7f247c200640 1 -- 172.21.15.59:0/3444194268 >> 172.21.15.59:0/3444194268 conn(0x7f24740725a0 msgr2=0x7f2474074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:20.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.963+0000 7f247c200640 1 -- 172.21.15.59:0/3444194268 shutdown_connections 2024-05-30T17:00:20.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:20.963+0000 7f247c200640 1 -- 172.21.15.59:0/3444194268 wait complete. 2024-05-30T17:00:21.002 INFO:tasks.cephfs.test_volumes:percentage cloned = 23.958 2024-05-30T17:00:21.002 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T17:00:21.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675a00640 1 Processor -- start 2024-05-30T17:00:21.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675a00640 1 -- start start 2024-05-30T17:00:21.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9670163020 0x7f96700b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96700d1d90 0x7f967006be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9670163400 con 0x7f967006b9b0 2024-05-30T17:00:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f967006c350 con 0x7f96700d1d90 2024-05-30T17:00:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f96700b17a0 con 0x7f9670163020 2024-05-30T17:00:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96700d1d90 0x7f967006be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f966f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f967006b9b0 0x7f96700b42e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56476/0 (socket says 172.21.15.59:56476) 2024-05-30T17:00:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96700d1d90 0x7f967006be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42740/0 (socket says 172.21.15.59:42740) 2024-05-30T17:00:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f966f400640 1 -- 172.21.15.59:0/1858021413 learned_addr learned my addr 172.21.15.59:0/1858021413 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675000640 1 -- 172.21.15.59:0/1858021413 >> v2:172.21.15.107:3300/0 conn(0x7f9670163020 msgr2=0x7f96700b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675000640 1 --2- 172.21.15.59:0/1858021413 >> v2:172.21.15.107:3300/0 conn(0x7f9670163020 0x7f96700b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675000640 1 -- 172.21.15.59:0/1858021413 >> v1:172.21.15.59:6789/0 conn(0x7f967006b9b0 legacy=0x7f96700b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f966ea00640 1 -- 172.21.15.59:0/1858021413 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4005009079 0 0) 0x7f9670163400 con 0x7f967006b9b0 2024-05-30T17:00:21.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.211+0000 7f9675000640 1 -- 172.21.15.59:0/1858021413 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96700b1a00 con 0x7f96700d1d90 2024-05-30T17:00:21.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.215+0000 7f9675000640 1 --2- 172.21.15.59:0/1858021413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96700d1d90 0x7f967006be10 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9670072160 tx=0x7f966801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1fe8a65549d580 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:21.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f966ea00640 1 -- 172.21.15.59:0/1858021413 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680b2070 con 0x7f96700d1d90 2024-05-30T17:00:21.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f966ea00640 1 -- 172.21.15.59:0/1858021413 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96680a5850 con 0x7f96700d1d90 2024-05-30T17:00:21.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f966ea00640 1 -- 172.21.15.59:0/1858021413 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680a5c20 con 0x7f96700d1d90 2024-05-30T17:00:21.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f9675a00640 1 -- 172.21.15.59:0/1858021413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96700d1d90 msgr2=0x7f967006be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:21.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f9675a00640 1 --2- 172.21.15.59:0/1858021413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96700d1d90 0x7f967006be10 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9670072160 tx=0x7f966801c8a0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f9675a00640 1 -- 172.21.15.59:0/1858021413 shutdown_connections 2024-05-30T17:00:21.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f9675a00640 1 --2- 172.21.15.59:0/1858021413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96700d1d90 0x7f967006be10 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f9675a00640 1 --2- 172.21.15.59:0/1858021413 >> v2:172.21.15.107:3300/0 conn(0x7f9670163020 0x7f96700b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f9675a00640 1 -- 172.21.15.59:0/1858021413 >> 172.21.15.59:0/1858021413 conn(0x7f967009aa40 msgr2=0x7f96700b6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:21.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f9675a00640 1 -- 172.21.15.59:0/1858021413 shutdown_connections 2024-05-30T17:00:21.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f9675a00640 1 -- 172.21.15.59:0/1858021413 wait complete. 2024-05-30T17:00:21.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f9675a00640 1 Processor -- start 2024-05-30T17:00:21.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.219+0000 7f9675a00640 1 -- start start 2024-05-30T17:00:21.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f9675a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f967006b9b0 0x7f9670154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:21.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f9675a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96700d1d90 0x7f9670158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:21.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f9675a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9670163020 0x7f96700ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f9675a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f967016fb60 con 0x7f967006b9b0 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f9675a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f96700d0af0 con 0x7f96700d1d90 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f9675a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f967016fce0 con 0x7f9670163020 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f966fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f967006b9b0 0x7f9670154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f966fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f967006b9b0 0x7f9670154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42750/0 (socket says 172.21.15.59:42750) 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f966fe00640 1 -- 172.21.15.59:0/3992349660 learned_addr learned my addr 172.21.15.59:0/3992349660 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f966f400640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96700d1d90 0x7f9670158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f966fe00640 1 -- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9670163020 msgr2=0x7f96700ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f966fe00640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9670163020 0x7f96700ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f966fe00640 1 -- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96700d1d90 msgr2=0x7f9670158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f966fe00640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96700d1d90 0x7f9670158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f966fe00640 1 -- 172.21.15.59:0/3992349660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96700cd000 con 0x7f967006b9b0 2024-05-30T17:00:21.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f966f400640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96700d1d90 0x7f9670158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:00:21.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f966fe00640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f967006b9b0 0x7f9670154eb0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f966000b410 tx=0x7f966000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:21.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f9667e00640 1 -- 172.21.15.59:0/3992349660 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660015020 con 0x7f967006b9b0 2024-05-30T17:00:21.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f9667e00640 1 -- 172.21.15.59:0/3992349660 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9660011830 con 0x7f967006b9b0 2024-05-30T17:00:21.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f9675a00640 1 -- 172.21.15.59:0/3992349660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96700cd2e0 con 0x7f967006b9b0 2024-05-30T17:00:21.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f9667e00640 1 -- 172.21.15.59:0/3992349660 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660011c20 con 0x7f967006b9b0 2024-05-30T17:00:21.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f9675a00640 1 -- 172.21.15.59:0/3992349660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96700cdb80 con 0x7f967006b9b0 2024-05-30T17:00:21.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.223+0000 7f9675a00640 1 -- 172.21.15.59:0/3992349660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9670068a90 con 0x7f967006b9b0 2024-05-30T17:00:21.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.227+0000 7f9667e00640 1 -- 172.21.15.59:0/3992349660 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f9660018020 con 0x7f967006b9b0 2024-05-30T17:00:21.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.227+0000 7f9667e00640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9650069730 0x7f965006bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:21.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.227+0000 7f9667e00640 1 -- 172.21.15.59:0/3992349660 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f9660085580 con 0x7f967006b9b0 2024-05-30T17:00:21.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.231+0000 7f9667e00640 1 -- 172.21.15.59:0/3992349660 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f966001f020 con 0x7f967006b9b0 2024-05-30T17:00:21.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.235+0000 7f966f400640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9650069730 0x7f965006bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:21.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.255+0000 7f966f400640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9650069730 0x7f965006bbf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f967006c220 tx=0x7f965c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:21.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.551+0000 7f9675a00640 1 -- 172.21.15.59:0/3992349660 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f96700ceed0 con 0x7f9650069730 2024-05-30T17:00:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.611+0000 7f9667e00640 1 -- 172.21.15.59:0/3992349660 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+279 (secure 0 0 0) 0x7f96700ceed0 con 0x7f9650069730 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: "status": { 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "in-progress", 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: "source": { 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: "volume": "cephfs", 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: "subvolume": "sv1", 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot": "ss1" 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_report": { 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: "percentage cloned": 46.875, 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: "amount cloned": "1.4G/3.0G", 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: "files cloned": "4/6" 2024-05-30T17:00:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:21.617 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:21.617 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:21.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.619+0000 7f9675a00640 1 -- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9650069730 msgr2=0x7f965006bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:21.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.619+0000 7f9675a00640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9650069730 0x7f965006bbf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f967006c220 tx=0x7f965c009040 comp rx=0 tx=0).stop 2024-05-30T17:00:21.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.619+0000 7f9675a00640 1 -- 172.21.15.59:0/3992349660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f967006b9b0 msgr2=0x7f9670154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:21.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.619+0000 7f9675a00640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f967006b9b0 0x7f9670154eb0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f966000b410 tx=0x7f966000b8d0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.619+0000 7f9675a00640 1 -- 172.21.15.59:0/3992349660 shutdown_connections 2024-05-30T17:00:21.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.619+0000 7f9675a00640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9650069730 0x7f965006bbf0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.619+0000 7f9675a00640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9670163020 0x7f96700ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.619+0000 7f9675a00640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96700d1d90 0x7f9670158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.619+0000 7f9675a00640 1 --2- 172.21.15.59:0/3992349660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f967006b9b0 0x7f9670154eb0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.619+0000 7f9675a00640 1 -- 172.21.15.59:0/3992349660 >> 172.21.15.59:0/3992349660 conn(0x7f967009aa40 msgr2=0x7f96700cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:21.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.619+0000 7f9675a00640 1 -- 172.21.15.59:0/3992349660 shutdown_connections 2024-05-30T17:00:21.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.619+0000 7f9675a00640 1 -- 172.21.15.59:0/3992349660 wait complete. 2024-05-30T17:00:21.674 INFO:tasks.cephfs.test_volumes:percentage cloned = 46.875 2024-05-30T17:00:21.674 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T17:00:21.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac9c00640 1 Processor -- start 2024-05-30T17:00:21.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac9c00640 1 -- start start 2024-05-30T17:00:21.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac9c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faac415eb60 0x7faac40730e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:21.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac9c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac40ad2b0 0x7faac40ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:21.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac9c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac40b0e50 con 0x7faac40afe00 2024-05-30T17:00:21.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac9c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7faac40b1130 con 0x7faac415eb60 2024-05-30T17:00:21.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac9c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faac40b1410 con 0x7faac40ad2b0 2024-05-30T17:00:21.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac2000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faac40afe00 0x7faac4073620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56482/0 (socket says 172.21.15.59:56482) 2024-05-30T17:00:21.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac2000640 1 -- 172.21.15.59:0/79843478 learned_addr learned my addr 172.21.15.59:0/79843478 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:21.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac2a00640 1 --2- 172.21.15.59:0/79843478 >> v2:172.21.15.107:3300/0 conn(0x7faac415eb60 0x7faac40730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:21.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac3400640 1 --2- 172.21.15.59:0/79843478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac40ad2b0 0x7faac40ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:21.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac1600640 1 -- 172.21.15.59:0/79843478 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3810492475 0 0) 0x7faac40b0e50 con 0x7faac40afe00 2024-05-30T17:00:21.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac1600640 1 -- 172.21.15.59:0/79843478 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaa8003530 con 0x7faac40afe00 2024-05-30T17:00:21.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac2a00640 1 -- 172.21.15.59:0/79843478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac40ad2b0 msgr2=0x7faac40ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:21.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac2a00640 1 --2- 172.21.15.59:0/79843478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac40ad2b0 0x7faac40ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac2a00640 1 -- 172.21.15.59:0/79843478 >> v1:172.21.15.59:6789/0 conn(0x7faac40afe00 legacy=0x7faac4073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:21.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.903+0000 7faac2a00640 1 -- 172.21.15.59:0/79843478 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac40b16f0 con 0x7faac415eb60 2024-05-30T17:00:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.911+0000 7faac2a00640 1 --2- 172.21.15.59:0/79843478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac415eb60 0x7faac40730e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faabc009d90 tx=0x7faabc01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a022a0768221b734 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.911+0000 7faac1600640 1 -- 172.21.15.59:0/79843478 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc0b2070 con 0x7faac415eb60 2024-05-30T17:00:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.911+0000 7faac1600640 1 -- 172.21.15.59:0/79843478 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc0a5a20 con 0x7faac415eb60 2024-05-30T17:00:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.911+0000 7faac1600640 1 -- 172.21.15.59:0/79843478 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc0a5dd0 con 0x7faac415eb60 2024-05-30T17:00:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.911+0000 7faac9c00640 1 -- 172.21.15.59:0/79843478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac415eb60 msgr2=0x7faac40730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.911+0000 7faac9c00640 1 --2- 172.21.15.59:0/79843478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac415eb60 0x7faac40730e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faabc009d90 tx=0x7faabc01c940 comp rx=0 tx=0).stop 2024-05-30T17:00:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.911+0000 7faac9c00640 1 -- 172.21.15.59:0/79843478 shutdown_connections 2024-05-30T17:00:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.911+0000 7faac9c00640 1 --2- 172.21.15.59:0/79843478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac40ad2b0 0x7faac40ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.911+0000 7faac9c00640 1 --2- 172.21.15.59:0/79843478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac415eb60 0x7faac40730e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.911+0000 7faac9c00640 1 -- 172.21.15.59:0/79843478 >> 172.21.15.59:0/79843478 conn(0x7faac40b1fd0 msgr2=0x7faac40b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.915+0000 7faac9c00640 1 -- 172.21.15.59:0/79843478 shutdown_connections 2024-05-30T17:00:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.915+0000 7faac9c00640 1 -- 172.21.15.59:0/79843478 wait complete. 2024-05-30T17:00:21.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac9c00640 1 Processor -- start 2024-05-30T17:00:21.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac9c00640 1 -- start start 2024-05-30T17:00:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac9c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac40ad2b0 0x7faac41529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac9c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac40afe00 0x7faac414e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac9c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac415eb60 0x7faac4155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac9c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faac416b680 con 0x7faac40afe00 2024-05-30T17:00:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac9c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faac416b500 con 0x7faac40ad2b0 2024-05-30T17:00:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac9c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faac416b800 con 0x7faac415eb60 2024-05-30T17:00:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac40afe00 0x7faac414e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac40afe00 0x7faac414e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58642/0 (socket says 172.21.15.59:58642) 2024-05-30T17:00:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac2000640 1 -- 172.21.15.59:0/732050415 learned_addr learned my addr 172.21.15.59:0/732050415 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac2a00640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac40ad2b0 0x7faac41529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.919+0000 7faac3400640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac415eb60 0x7faac4155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.923+0000 7faac3400640 1 -- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac40ad2b0 msgr2=0x7faac41529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.923+0000 7faac3400640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac40ad2b0 0x7faac41529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.923+0000 7faac3400640 1 -- 172.21.15.59:0/732050415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac40afe00 msgr2=0x7faac414e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.923+0000 7faac3400640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac40afe00 0x7faac414e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.923+0000 7faac3400640 1 -- 172.21.15.59:0/732050415 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac4161a30 con 0x7faac415eb60 2024-05-30T17:00:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.923+0000 7faac2a00640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac40ad2b0 0x7faac41529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:00:21.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.923+0000 7faac3400640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac415eb60 0x7faac4155070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faab400e7f0 tx=0x7faab400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.923+0000 7faabaa00640 1 -- 172.21.15.59:0/732050415 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4017070 con 0x7faac415eb60 2024-05-30T17:00:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.923+0000 7faabaa00640 1 -- 172.21.15.59:0/732050415 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab400c730 con 0x7faac415eb60 2024-05-30T17:00:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.923+0000 7faabaa00640 1 -- 172.21.15.59:0/732050415 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab400cb00 con 0x7faac415eb60 2024-05-30T17:00:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.923+0000 7faac9c00640 1 -- 172.21.15.59:0/732050415 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac4161d10 con 0x7faac415eb60 2024-05-30T17:00:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.923+0000 7faac9c00640 1 -- 172.21.15.59:0/732050415 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faac415fcd0 con 0x7faac415eb60 2024-05-30T17:00:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.927+0000 7faac9c00640 1 -- 172.21.15.59:0/732050415 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac41600d0 con 0x7faac415eb60 2024-05-30T17:00:21.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.927+0000 7faabaa00640 1 -- 172.21.15.59:0/732050415 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7faab401a070 con 0x7faac415eb60 2024-05-30T17:00:21.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.927+0000 7faabaa00640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faaa4069780 0x7faaa406bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:21.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.927+0000 7faabaa00640 1 -- 172.21.15.59:0/732050415 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7faab4085770 con 0x7faac415eb60 2024-05-30T17:00:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.935+0000 7faabaa00640 1 -- 172.21.15.59:0/732050415 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faab4056dc0 con 0x7faac415eb60 2024-05-30T17:00:21.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.939+0000 7faac2a00640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faaa4069780 0x7faaa406bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:21.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:21.947+0000 7faac2a00640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faaa4069780 0x7faaa406bc40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7faabc0af000 tx=0x7faabc0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:22.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.239+0000 7faac9c00640 1 -- 172.21.15.59:0/732050415 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7faac4158f00 con 0x7faaa4069780 2024-05-30T17:00:22.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.271+0000 7faabaa00640 1 -- 172.21.15.59:0/732050415 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+279 (secure 0 0 0) 0x7faac4158f00 con 0x7faaa4069780 2024-05-30T17:00:22.273 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:22.273 INFO:teuthology.orchestra.run.smithi059.stdout: "status": { 2024-05-30T17:00:22.273 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "in-progress", 2024-05-30T17:00:22.273 INFO:teuthology.orchestra.run.smithi059.stdout: "source": { 2024-05-30T17:00:22.273 INFO:teuthology.orchestra.run.smithi059.stdout: "volume": "cephfs", 2024-05-30T17:00:22.273 INFO:teuthology.orchestra.run.smithi059.stdout: "subvolume": "sv1", 2024-05-30T17:00:22.273 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot": "ss1" 2024-05-30T17:00:22.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:22.273 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_report": { 2024-05-30T17:00:22.273 INFO:teuthology.orchestra.run.smithi059.stdout: "percentage cloned": 46.875, 2024-05-30T17:00:22.273 INFO:teuthology.orchestra.run.smithi059.stdout: "amount cloned": "1.4G/3.0G", 2024-05-30T17:00:22.274 INFO:teuthology.orchestra.run.smithi059.stdout: "files cloned": "5/6" 2024-05-30T17:00:22.274 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:22.274 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:22.274 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:22.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.275+0000 7faac9c00640 1 -- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faaa4069780 msgr2=0x7faaa406bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:22.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.275+0000 7faac9c00640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faaa4069780 0x7faaa406bc40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7faabc0af000 tx=0x7faabc0a7070 comp rx=0 tx=0).stop 2024-05-30T17:00:22.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.275+0000 7faac9c00640 1 -- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac415eb60 msgr2=0x7faac4155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:22.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.275+0000 7faac9c00640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac415eb60 0x7faac4155070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faab400e7f0 tx=0x7faab400ecb0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.275+0000 7faac9c00640 1 -- 172.21.15.59:0/732050415 shutdown_connections 2024-05-30T17:00:22.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.275+0000 7faac9c00640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faaa4069780 0x7faaa406bc40 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.275+0000 7faac9c00640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac415eb60 0x7faac4155070 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.275+0000 7faac9c00640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac40afe00 0x7faac414e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.275+0000 7faac9c00640 1 --2- 172.21.15.59:0/732050415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac40ad2b0 0x7faac41529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.275+0000 7faac9c00640 1 -- 172.21.15.59:0/732050415 >> 172.21.15.59:0/732050415 conn(0x7faac40b1fd0 msgr2=0x7faac40af680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:22.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.275+0000 7faac9c00640 1 -- 172.21.15.59:0/732050415 shutdown_connections 2024-05-30T17:00:22.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.275+0000 7faac9c00640 1 -- 172.21.15.59:0/732050415 wait complete. 2024-05-30T17:00:22.308 INFO:tasks.cephfs.test_volumes:percentage cloned = 46.875 2024-05-30T17:00:22.309 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T17:00:22.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.531+0000 7f3d54e00640 1 Processor -- start 2024-05-30T17:00:22.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.531+0000 7f3d54e00640 1 -- start start 2024-05-30T17:00:22.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.531+0000 7f3d54e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d500afe40 0x7f3d500ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:22.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.531+0000 7f3d54e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d500b02d0 con 0x7f3d500b2af0 2024-05-30T17:00:22.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.531+0000 7f3d54e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d500b05b0 con 0x7f3d5015c890 2024-05-30T17:00:22.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.531+0000 7f3d54e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5015cc70 con 0x7f3d500afe40 2024-05-30T17:00:22.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.531+0000 7f3d4de00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3d5015c890 0x7f3d500cccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:59326/0 (socket says 172.21.15.59:59326) 2024-05-30T17:00:22.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.531+0000 7f3d4de00640 1 -- 172.21.15.59:0/3299715032 learned_addr learned my addr 172.21.15.59:0/3299715032 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:22.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.531+0000 7f3d4d400640 1 --2- 172.21.15.59:0/3299715032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d500afe40 0x7f3d500ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:22.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.531+0000 7f3d4d400640 1 -- 172.21.15.59:0/3299715032 >> v1:172.21.15.107:6789/0 conn(0x7f3d5015c890 legacy=0x7f3d500cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:22.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.535+0000 7f3d4d400640 1 -- 172.21.15.59:0/3299715032 >> v1:172.21.15.59:6789/0 conn(0x7f3d500b2af0 legacy=0x7f3d500b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:22.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.535+0000 7f3d4d400640 1 -- 172.21.15.59:0/3299715032 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d500b0890 con 0x7f3d500afe40 2024-05-30T17:00:22.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.539+0000 7f3d4d400640 1 --2- 172.21.15.59:0/3299715032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d500afe40 0x7f3d500ad2b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0097f0 tx=0x7f3d3c01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f6bfd38b7cc73e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.543+0000 7f3d4ca00640 1 -- 172.21.15.59:0/3299715032 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c0b0070 con 0x7f3d500afe40 2024-05-30T17:00:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.543+0000 7f3d4ca00640 1 -- 172.21.15.59:0/3299715032 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3c0ab400 con 0x7f3d500afe40 2024-05-30T17:00:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.543+0000 7f3d4ca00640 1 -- 172.21.15.59:0/3299715032 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c0ab7d0 con 0x7f3d500afe40 2024-05-30T17:00:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.543+0000 7f3d54e00640 1 -- 172.21.15.59:0/3299715032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d500afe40 msgr2=0x7f3d500ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.543+0000 7f3d54e00640 1 --2- 172.21.15.59:0/3299715032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d500afe40 0x7f3d500ad2b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0097f0 tx=0x7f3d3c01c3d0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.543+0000 7f3d54e00640 1 -- 172.21.15.59:0/3299715032 shutdown_connections 2024-05-30T17:00:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.543+0000 7f3d54e00640 1 --2- 172.21.15.59:0/3299715032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d500afe40 0x7f3d500ad2b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.543+0000 7f3d54e00640 1 -- 172.21.15.59:0/3299715032 >> 172.21.15.59:0/3299715032 conn(0x7f3d500b1fd0 msgr2=0x7f3d500b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.543+0000 7f3d54e00640 1 -- 172.21.15.59:0/3299715032 shutdown_connections 2024-05-30T17:00:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.543+0000 7f3d54e00640 1 -- 172.21.15.59:0/3299715032 wait complete. 2024-05-30T17:00:22.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d54e00640 1 Processor -- start 2024-05-30T17:00:22.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d54e00640 1 -- start start 2024-05-30T17:00:22.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d54e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d500b2af0 0x7f3d5014adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:22.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d54e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d5015c890 0x7f3d50148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d54e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d5015e440 0x7f3d5015d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d54e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3d500adc00 con 0x7f3d500b2af0 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d54e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3d500b0ee0 con 0x7f3d5015c890 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d54e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3d50168d60 con 0x7f3d5015e440 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d4de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d500b2af0 0x7f3d5014adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d4de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d500b2af0 0x7f3d5014adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58658/0 (socket says 172.21.15.59:58658) 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d4de00640 1 -- 172.21.15.59:0/1849653004 learned_addr learned my addr 172.21.15.59:0/1849653004 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d4de00640 1 -- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d5015e440 msgr2=0x7f3d5015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d4e800640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d5015e440 0x7f3d5015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d4de00640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d5015e440 0x7f3d5015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d4de00640 1 -- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d5015c890 msgr2=0x7f3d50148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d4de00640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d5015c890 0x7f3d50148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d4de00640 1 -- 172.21.15.59:0/1849653004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d50068380 con 0x7f3d500b2af0 2024-05-30T17:00:22.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d4e800640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d5015e440 0x7f3d5015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:00:22.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d4de00640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d500b2af0 0x7f3d5014adf0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000fe20 tx=0x7f3d4000ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:22.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d46000640 1 -- 172.21.15.59:0/1849653004 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4001d070 con 0x7f3d500b2af0 2024-05-30T17:00:22.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d46000640 1 -- 172.21.15.59:0/1849653004 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d40018440 con 0x7f3d500b2af0 2024-05-30T17:00:22.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d46000640 1 -- 172.21.15.59:0/1849653004 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40018830 con 0x7f3d500b2af0 2024-05-30T17:00:22.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d54e00640 1 -- 172.21.15.59:0/1849653004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5014cfc0 con 0x7f3d500b2af0 2024-05-30T17:00:22.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.547+0000 7f3d54e00640 1 -- 172.21.15.59:0/1849653004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d5014d560 con 0x7f3d500b2af0 2024-05-30T17:00:22.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.551+0000 7f3d54e00640 1 -- 172.21.15.59:0/1849653004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d50068a90 con 0x7f3d500b2af0 2024-05-30T17:00:22.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.551+0000 7f3d46000640 1 -- 172.21.15.59:0/1849653004 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f3d40020070 con 0x7f3d500b2af0 2024-05-30T17:00:22.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.551+0000 7f3d46000640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d30069760 0x7f3d3006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:22.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.551+0000 7f3d46000640 1 -- 172.21.15.59:0/1849653004 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f3d40089a60 con 0x7f3d500b2af0 2024-05-30T17:00:22.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.555+0000 7f3d46000640 1 -- 172.21.15.59:0/1849653004 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d4005b6c0 con 0x7f3d500b2af0 2024-05-30T17:00:22.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.559+0000 7f3d4d400640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d30069760 0x7f3d3006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:22.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.559+0000 7f3d4d400640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d30069760 0x7f3d3006bc20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0ad000 tx=0x7f3d3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:22.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.867+0000 7f3d54e00640 1 -- 172.21.15.59:0/1849653004 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f3d500cfa70 con 0x7f3d30069760 2024-05-30T17:00:22.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.891+0000 7f3d46000640 1 -- 172.21.15.59:0/1849653004 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+279 (secure 0 0 0) 0x7f3d500cfa70 con 0x7f3d30069760 2024-05-30T17:00:22.895 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:22.895 INFO:teuthology.orchestra.run.smithi059.stdout: "status": { 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "in-progress", 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout: "source": { 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout: "volume": "cephfs", 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout: "subvolume": "sv1", 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot": "ss1" 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_report": { 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout: "percentage cloned": 66.667, 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout: "amount cloned": "2.0G/3.0G", 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout: "files cloned": "5/6" 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:22.896 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:22.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.895+0000 7f3d54e00640 1 -- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d30069760 msgr2=0x7f3d3006bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.895+0000 7f3d54e00640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d30069760 0x7f3d3006bc20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0ad000 tx=0x7f3d3c008040 comp rx=0 tx=0).stop 2024-05-30T17:00:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.895+0000 7f3d54e00640 1 -- 172.21.15.59:0/1849653004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d500b2af0 msgr2=0x7f3d5014adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.895+0000 7f3d54e00640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d500b2af0 0x7f3d5014adf0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000fe20 tx=0x7f3d4000ff10 comp rx=0 tx=0).stop 2024-05-30T17:00:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.895+0000 7f3d54e00640 1 -- 172.21.15.59:0/1849653004 shutdown_connections 2024-05-30T17:00:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.895+0000 7f3d54e00640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d30069760 0x7f3d3006bc20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.895+0000 7f3d54e00640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d5015e440 0x7f3d5015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.895+0000 7f3d54e00640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d5015c890 0x7f3d50148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.895+0000 7f3d54e00640 1 --2- 172.21.15.59:0/1849653004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d500b2af0 0x7f3d5014adf0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.895+0000 7f3d54e00640 1 -- 172.21.15.59:0/1849653004 >> 172.21.15.59:0/1849653004 conn(0x7f3d500b1fd0 msgr2=0x7f3d500cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.895+0000 7f3d54e00640 1 -- 172.21.15.59:0/1849653004 shutdown_connections 2024-05-30T17:00:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:22.895+0000 7f3d54e00640 1 -- 172.21.15.59:0/1849653004 wait complete. 2024-05-30T17:00:22.923 INFO:tasks.cephfs.test_volumes:percentage cloned = 66.667 2024-05-30T17:00:22.924 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T17:00:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.151+0000 7fa6b6000640 1 Processor -- start 2024-05-30T17:00:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.151+0000 7fa6b6000640 1 -- start start 2024-05-30T17:00:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.151+0000 7fa6b6000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa6b00d0050 0x7fa6b00cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.151+0000 7fa6b6000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6b00d0a60 0x7fa6b00d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.151+0000 7fa6b6000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6b00cd130 con 0x7fa6b015fb70 2024-05-30T17:00:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.151+0000 7fa6b6000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa6b00ce3c0 con 0x7fa6b00d0050 2024-05-30T17:00:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.151+0000 7fa6b6000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b015ff50 con 0x7fa6b00d0a60 2024-05-30T17:00:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.155+0000 7fa6aea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa6b00d0050 0x7fa6b00cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.155+0000 7fa6aea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa6b00d0050 0x7fa6b00cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58670/0 (socket says 172.21.15.59:58670) 2024-05-30T17:00:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.155+0000 7fa6aea00640 1 -- 172.21.15.59:0/2614909005 learned_addr learned my addr 172.21.15.59:0/2614909005 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:23.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.155+0000 7fa6aea00640 1 -- 172.21.15.59:0/2614909005 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6b00d0a60 msgr2=0x7fa6b00d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:23.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.155+0000 7fa6aea00640 1 --2- 172.21.15.59:0/2614909005 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6b00d0a60 0x7fa6b00d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.155+0000 7fa6aea00640 1 -- 172.21.15.59:0/2614909005 >> v1:172.21.15.107:6789/0 conn(0x7fa6b015fb70 legacy=0x7fa6b009b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:23.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.155+0000 7fa6aea00640 1 -- 172.21.15.59:0/2614909005 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b00cd3a0 con 0x7fa6b00d0050 2024-05-30T17:00:23.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.163+0000 7fa6aea00640 1 --2- 172.21.15.59:0/2614909005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6b00d0050 0x7fa6b00cde80 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0098a0 tx=0x7fa69c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba9c384be22b332 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:23.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.163+0000 7fa6ae000640 1 -- 172.21.15.59:0/2614909005 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c0b0070 con 0x7fa6b00d0050 2024-05-30T17:00:23.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.163+0000 7fa6ae000640 1 -- 172.21.15.59:0/2614909005 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69c0ab600 con 0x7fa6b00d0050 2024-05-30T17:00:23.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.163+0000 7fa6ae000640 1 -- 172.21.15.59:0/2614909005 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c0ab9d0 con 0x7fa6b00d0050 2024-05-30T17:00:23.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.163+0000 7fa6b6000640 1 -- 172.21.15.59:0/2614909005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6b00d0050 msgr2=0x7fa6b00cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:23.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.163+0000 7fa6b6000640 1 --2- 172.21.15.59:0/2614909005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6b00d0050 0x7fa6b00cde80 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0098a0 tx=0x7fa69c01c470 comp rx=0 tx=0).stop 2024-05-30T17:00:23.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.163+0000 7fa6b6000640 1 -- 172.21.15.59:0/2614909005 shutdown_connections 2024-05-30T17:00:23.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.163+0000 7fa6b6000640 1 --2- 172.21.15.59:0/2614909005 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6b00d0a60 0x7fa6b00d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.163+0000 7fa6b6000640 1 --2- 172.21.15.59:0/2614909005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6b00d0050 0x7fa6b00cde80 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.163+0000 7fa6b6000640 1 -- 172.21.15.59:0/2614909005 >> 172.21.15.59:0/2614909005 conn(0x7fa6b00b3f70 msgr2=0x7fa6b00b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:23.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.163+0000 7fa6b6000640 1 -- 172.21.15.59:0/2614909005 shutdown_connections 2024-05-30T17:00:23.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.163+0000 7fa6b6000640 1 -- 172.21.15.59:0/2614909005 wait complete. 2024-05-30T17:00:23.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6b6000640 1 Processor -- start 2024-05-30T17:00:23.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6b6000640 1 -- start start 2024-05-30T17:00:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6b6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6b00d0050 0x7fa6b00c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6b6000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6b00d0a60 0x7fa6b00b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6b6000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6b015fb70 0x7fa6b01590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6b6000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b0070970 con 0x7fa6b00d0050 2024-05-30T17:00:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6b6000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b00707f0 con 0x7fa6b015fb70 2024-05-30T17:00:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6b6000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b0070af0 con 0x7fa6b00d0a60 2024-05-30T17:00:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6af400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6b00d0050 0x7fa6b00c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6af400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6b00d0050 0x7fa6b00c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58676/0 (socket says 172.21.15.59:58676) 2024-05-30T17:00:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6af400640 1 -- 172.21.15.59:0/309309808 learned_addr learned my addr 172.21.15.59:0/309309808 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:23.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6aea00640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6b00d0a60 0x7fa6b00b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:23.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6af400640 1 -- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6b00d0a60 msgr2=0x7fa6b00b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:23.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6af400640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6b00d0a60 0x7fa6b00b7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6af400640 1 -- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6b015fb70 msgr2=0x7fa6b01590b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T17:00:23.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6af400640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6b015fb70 0x7fa6b01590b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6af400640 1 -- 172.21.15.59:0/309309808 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b01428f0 con 0x7fa6b00d0050 2024-05-30T17:00:23.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6af400640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6b00d0050 0x7fa6b00c7f80 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000c490 tx=0x7fa6a0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:23.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6a7400640 1 -- 172.21.15.59:0/309309808 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0017070 con 0x7fa6b00d0050 2024-05-30T17:00:23.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6a7400640 1 -- 172.21.15.59:0/309309808 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a0003600 con 0x7fa6b00d0050 2024-05-30T17:00:23.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6a7400640 1 -- 172.21.15.59:0/309309808 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0003a30 con 0x7fa6b00d0050 2024-05-30T17:00:23.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6b6000640 1 -- 172.21.15.59:0/309309808 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b0142bd0 con 0x7fa6b00d0050 2024-05-30T17:00:23.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.167+0000 7fa6b6000640 1 -- 172.21.15.59:0/309309808 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6b0143190 con 0x7fa6b00d0050 2024-05-30T17:00:23.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.171+0000 7fa6b6000640 1 -- 172.21.15.59:0/309309808 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6b0068a90 con 0x7fa6b00d0050 2024-05-30T17:00:23.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.171+0000 7fa6a7400640 1 -- 172.21.15.59:0/309309808 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7fa6a0003bd0 con 0x7fa6b00d0050 2024-05-30T17:00:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.171+0000 7fa6a7400640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa690069730 0x7fa69006bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.171+0000 7fa6a7400640 1 -- 172.21.15.59:0/309309808 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7fa6a0084cc0 con 0x7fa6b00d0050 2024-05-30T17:00:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.171+0000 7fa6aea00640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa690069730 0x7fa69006bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.175+0000 7fa6aea00640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa690069730 0x7fa69006bbf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0ad000 tx=0x7fa69c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.175+0000 7fa6a7400640 1 -- 172.21.15.59:0/309309808 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa6a0056980 con 0x7fa6b00d0050 2024-05-30T17:00:23.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.475+0000 7fa6b6000640 1 -- 172.21.15.59:0/309309808 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fa6b00cc8b0 con 0x7fa690069730 2024-05-30T17:00:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.511+0000 7fa6a7400640 1 -- 172.21.15.59:0/309309808 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+279 (secure 0 0 0) 0x7fa6b00cc8b0 con 0x7fa690069730 2024-05-30T17:00:23.515 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:23.515 INFO:teuthology.orchestra.run.smithi059.stdout: "status": { 2024-05-30T17:00:23.515 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "in-progress", 2024-05-30T17:00:23.515 INFO:teuthology.orchestra.run.smithi059.stdout: "source": { 2024-05-30T17:00:23.516 INFO:teuthology.orchestra.run.smithi059.stdout: "volume": "cephfs", 2024-05-30T17:00:23.516 INFO:teuthology.orchestra.run.smithi059.stdout: "subvolume": "sv1", 2024-05-30T17:00:23.516 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot": "ss1" 2024-05-30T17:00:23.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:23.516 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_report": { 2024-05-30T17:00:23.516 INFO:teuthology.orchestra.run.smithi059.stdout: "percentage cloned": 66.667, 2024-05-30T17:00:23.516 INFO:teuthology.orchestra.run.smithi059.stdout: "amount cloned": "2.0G/3.0G", 2024-05-30T17:00:23.516 INFO:teuthology.orchestra.run.smithi059.stdout: "files cloned": "5/6" 2024-05-30T17:00:23.516 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:23.516 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:23.516 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.515+0000 7fa6b6000640 1 -- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa690069730 msgr2=0x7fa69006bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.515+0000 7fa6b6000640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa690069730 0x7fa69006bbf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0ad000 tx=0x7fa69c0a6000 comp rx=0 tx=0).stop 2024-05-30T17:00:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.515+0000 7fa6b6000640 1 -- 172.21.15.59:0/309309808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6b00d0050 msgr2=0x7fa6b00c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.515+0000 7fa6b6000640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6b00d0050 0x7fa6b00c7f80 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000c490 tx=0x7fa6a0001e80 comp rx=0 tx=0).stop 2024-05-30T17:00:23.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.515+0000 7fa6b6000640 1 -- 172.21.15.59:0/309309808 shutdown_connections 2024-05-30T17:00:23.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.515+0000 7fa6b6000640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa690069730 0x7fa69006bbf0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.515+0000 7fa6b6000640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6b015fb70 0x7fa6b01590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.515+0000 7fa6b6000640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6b00d0a60 0x7fa6b00b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.515+0000 7fa6b6000640 1 --2- 172.21.15.59:0/309309808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6b00d0050 0x7fa6b00c7f80 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.515+0000 7fa6b6000640 1 -- 172.21.15.59:0/309309808 >> 172.21.15.59:0/309309808 conn(0x7fa6b00b3f70 msgr2=0x7fa6b00b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:23.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.515+0000 7fa6b6000640 1 -- 172.21.15.59:0/309309808 shutdown_connections 2024-05-30T17:00:23.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.515+0000 7fa6b6000640 1 -- 172.21.15.59:0/309309808 wait complete. 2024-05-30T17:00:23.549 INFO:tasks.cephfs.test_volumes:percentage cloned = 66.667 2024-05-30T17:00:23.549 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T17:00:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.759+0000 7f402d200640 1 Processor -- start 2024-05-30T17:00:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.763+0000 7f402d200640 1 -- start start 2024-05-30T17:00:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.763+0000 7f402d200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f402806d060 0x7f4028159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.763+0000 7f402d200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4028164110 con 0x7f402806cc80 2024-05-30T17:00:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.763+0000 7f402d200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40280d0300 con 0x7f40280b4650 2024-05-30T17:00:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.763+0000 7f402d200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4028163be0 con 0x7f402806d060 2024-05-30T17:00:23.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.763+0000 7f4025e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f402806cc80 0x7f4028159570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38130/0 (socket says 172.21.15.59:38130) 2024-05-30T17:00:23.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.763+0000 7f4025e00640 1 -- 172.21.15.59:0/878246805 learned_addr learned my addr 172.21.15.59:0/878246805 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:23.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.763+0000 7f4025400640 1 --2- 172.21.15.59:0/878246805 >> v2:172.21.15.107:3300/0 conn(0x7f402806d060 0x7f4028159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:23.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.763+0000 7f4024a00640 1 -- 172.21.15.59:0/878246805 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433276811 0 0) 0x7f4028164110 con 0x7f402806cc80 2024-05-30T17:00:23.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.763+0000 7f4024a00640 1 -- 172.21.15.59:0/878246805 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f400c003530 con 0x7f402806cc80 2024-05-30T17:00:23.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.767+0000 7f4025400640 1 -- 172.21.15.59:0/878246805 >> v1:172.21.15.107:6789/0 conn(0x7f40280b4650 legacy=0x7f4028166820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:23.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.767+0000 7f4025400640 1 -- 172.21.15.59:0/878246805 >> v1:172.21.15.59:6789/0 conn(0x7f402806cc80 legacy=0x7f4028159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:23.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.767+0000 7f4025400640 1 -- 172.21.15.59:0/878246805 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4028163e30 con 0x7f402806d060 2024-05-30T17:00:23.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.767+0000 7f4025400640 1 --2- 172.21.15.59:0/878246805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f402806d060 0x7f4028159c80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4028163d60 tx=0x7f401401c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46766f82794d5219 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:23.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.771+0000 7f4024a00640 1 -- 172.21.15.59:0/878246805 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40140b0070 con 0x7f402806d060 2024-05-30T17:00:23.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.771+0000 7f4024a00640 1 -- 172.21.15.59:0/878246805 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40140ab600 con 0x7f402806d060 2024-05-30T17:00:23.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.771+0000 7f4024a00640 1 -- 172.21.15.59:0/878246805 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40140ab9d0 con 0x7f402806d060 2024-05-30T17:00:23.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.771+0000 7f402d200640 1 -- 172.21.15.59:0/878246805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f402806d060 msgr2=0x7f4028159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:23.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.771+0000 7f402d200640 1 --2- 172.21.15.59:0/878246805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f402806d060 0x7f4028159c80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4028163d60 tx=0x7f401401c3d0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.771+0000 7f402d200640 1 -- 172.21.15.59:0/878246805 shutdown_connections 2024-05-30T17:00:23.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.771+0000 7f402d200640 1 --2- 172.21.15.59:0/878246805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f402806d060 0x7f4028159c80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.771+0000 7f402d200640 1 -- 172.21.15.59:0/878246805 >> 172.21.15.59:0/878246805 conn(0x7f40280725a0 msgr2=0x7f40280729b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:23.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.771+0000 7f402d200640 1 -- 172.21.15.59:0/878246805 shutdown_connections 2024-05-30T17:00:23.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.771+0000 7f402d200640 1 -- 172.21.15.59:0/878246805 wait complete. 2024-05-30T17:00:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.771+0000 7f402d200640 1 Processor -- start 2024-05-30T17:00:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f402d200640 1 -- start start 2024-05-30T17:00:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f402d200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f402806cc80 0x7f4028154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f402d200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f402806d060 0x7f4028140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f402d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40280b4650 0x7f4028165f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f402d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4028170ea0 con 0x7f40280b4650 2024-05-30T17:00:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f402d200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4028170d20 con 0x7f402806d060 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f402d200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4028171020 con 0x7f402806cc80 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f4026800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40280b4650 0x7f4028165f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f4026800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40280b4650 0x7f4028165f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58688/0 (socket says 172.21.15.59:58688) 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f4026800640 1 -- 172.21.15.59:0/1175903804 learned_addr learned my addr 172.21.15.59:0/1175903804 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f4025e00640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f402806cc80 0x7f4028154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f4026800640 1 -- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f402806cc80 msgr2=0x7f4028154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f4026800640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f402806cc80 0x7f4028154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f4026800640 1 -- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f402806d060 msgr2=0x7f4028140450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f4026800640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f402806d060 0x7f4028140450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f4026800640 1 -- 172.21.15.59:0/1175903804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4028140d50 con 0x7f40280b4650 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f4026800640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40280b4650 0x7f4028165f30 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f402000b9c0 tx=0x7f402000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f401e000640 1 -- 172.21.15.59:0/1175903804 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020019070 con 0x7f40280b4650 2024-05-30T17:00:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f401e000640 1 -- 172.21.15.59:0/1175903804 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402000cba0 con 0x7f40280b4650 2024-05-30T17:00:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f401e000640 1 -- 172.21.15.59:0/1175903804 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020014440 con 0x7f40280b4650 2024-05-30T17:00:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f402d200640 1 -- 172.21.15.59:0/1175903804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4028141030 con 0x7f40280b4650 2024-05-30T17:00:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.775+0000 7f402d200640 1 -- 172.21.15.59:0/1175903804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f402815a300 con 0x7f40280b4650 2024-05-30T17:00:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.779+0000 7f402d200640 1 -- 172.21.15.59:0/1175903804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40280691a0 con 0x7f40280b4650 2024-05-30T17:00:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.779+0000 7f401e000640 1 -- 172.21.15.59:0/1175903804 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f402001c070 con 0x7f40280b4650 2024-05-30T17:00:23.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.779+0000 7f401e000640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4008069730 0x7f400806bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.779+0000 7f401e000640 1 -- 172.21.15.59:0/1175903804 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f4020085670 con 0x7f40280b4650 2024-05-30T17:00:23.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.787+0000 7f401e000640 1 -- 172.21.15.59:0/1175903804 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4020056ce0 con 0x7f40280b4650 2024-05-30T17:00:23.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.787+0000 7f4025e00640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4008069730 0x7f400806bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:23.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:23.795+0000 7f4025e00640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4008069730 0x7f400806bbf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f40180011f0 tx=0x7f4018009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:24.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.123+0000 7f402d200640 1 -- 172.21.15.59:0/1175903804 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f40280b40b0 con 0x7f4008069730 2024-05-30T17:00:24.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.147+0000 7f401e000640 1 -- 172.21.15.59:0/1175903804 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+279 (secure 0 0 0) 0x7f40280b40b0 con 0x7f4008069730 2024-05-30T17:00:24.152 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:24.152 INFO:teuthology.orchestra.run.smithi059.stdout: "status": { 2024-05-30T17:00:24.152 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "in-progress", 2024-05-30T17:00:24.152 INFO:teuthology.orchestra.run.smithi059.stdout: "source": { 2024-05-30T17:00:24.152 INFO:teuthology.orchestra.run.smithi059.stdout: "volume": "cephfs", 2024-05-30T17:00:24.152 INFO:teuthology.orchestra.run.smithi059.stdout: "subvolume": "sv1", 2024-05-30T17:00:24.152 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot": "ss1" 2024-05-30T17:00:24.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:24.152 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_report": { 2024-05-30T17:00:24.152 INFO:teuthology.orchestra.run.smithi059.stdout: "percentage cloned": 85.156, 2024-05-30T17:00:24.152 INFO:teuthology.orchestra.run.smithi059.stdout: "amount cloned": "2.5G/3.0G", 2024-05-30T17:00:24.152 INFO:teuthology.orchestra.run.smithi059.stdout: "files cloned": "6/6" 2024-05-30T17:00:24.153 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:24.153 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:24.153 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:24.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.155+0000 7f402d200640 1 -- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4008069730 msgr2=0x7f400806bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:24.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.155+0000 7f402d200640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4008069730 0x7f400806bbf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f40180011f0 tx=0x7f4018009040 comp rx=0 tx=0).stop 2024-05-30T17:00:24.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.155+0000 7f402d200640 1 -- 172.21.15.59:0/1175903804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40280b4650 msgr2=0x7f4028165f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:24.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.155+0000 7f402d200640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40280b4650 0x7f4028165f30 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f402000b9c0 tx=0x7f402000be80 comp rx=0 tx=0).stop 2024-05-30T17:00:24.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.155+0000 7f402d200640 1 -- 172.21.15.59:0/1175903804 shutdown_connections 2024-05-30T17:00:24.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.155+0000 7f402d200640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4008069730 0x7f400806bbf0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:24.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.155+0000 7f402d200640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40280b4650 0x7f4028165f30 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:24.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.155+0000 7f402d200640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f402806d060 0x7f4028140450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:24.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.155+0000 7f402d200640 1 --2- 172.21.15.59:0/1175903804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f402806cc80 0x7f4028154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:24.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.155+0000 7f402d200640 1 -- 172.21.15.59:0/1175903804 >> 172.21.15.59:0/1175903804 conn(0x7f40280725a0 msgr2=0x7f402806e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:24.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.155+0000 7f402d200640 1 -- 172.21.15.59:0/1175903804 shutdown_connections 2024-05-30T17:00:24.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.155+0000 7f402d200640 1 -- 172.21.15.59:0/1175903804 wait complete. 2024-05-30T17:00:24.200 INFO:tasks.cephfs.test_volumes:percentage cloned = 85.156 2024-05-30T17:00:24.200 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T17:00:24.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5daf000640 1 Processor -- start 2024-05-30T17:00:24.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5daf000640 1 -- start start 2024-05-30T17:00:24.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5daf000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5da81569e0 0x7f5da815d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:24.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5daf000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5da80d0660 0x7f5da80d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:24.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5daf000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da80ad770 con 0x7f5da80ad2b0 2024-05-30T17:00:24.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5daf000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5da80d1010 con 0x7f5da81569e0 2024-05-30T17:00:24.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5daf000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5da815cb40 con 0x7f5da80d0660 2024-05-30T17:00:24.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5da7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5da80ad2b0 0x7f5da80cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38146/0 (socket says 172.21.15.59:38146) 2024-05-30T17:00:24.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5da7400640 1 -- 172.21.15.59:0/4235100949 learned_addr learned my addr 172.21.15.59:0/4235100949 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:24.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5da7e00640 1 --2- 172.21.15.59:0/4235100949 >> v2:172.21.15.107:3300/0 conn(0x7f5da81569e0 0x7f5da815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:24.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5dad000640 1 --2- 172.21.15.59:0/4235100949 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5da80d0660 0x7f5da80d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:24.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5da6a00640 1 -- 172.21.15.59:0/4235100949 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971628023 0 0) 0x7f5da80ad770 con 0x7f5da80ad2b0 2024-05-30T17:00:24.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5da6a00640 1 -- 172.21.15.59:0/4235100949 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d8c003530 con 0x7f5da80ad2b0 2024-05-30T17:00:24.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5da7e00640 1 -- 172.21.15.59:0/4235100949 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5da80d0660 msgr2=0x7f5da80d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:24.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5da7e00640 1 --2- 172.21.15.59:0/4235100949 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5da80d0660 0x7f5da80d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:24.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5da7e00640 1 -- 172.21.15.59:0/4235100949 >> v1:172.21.15.59:6789/0 conn(0x7f5da80ad2b0 legacy=0x7f5da80cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:24.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.387+0000 7f5da7e00640 1 -- 172.21.15.59:0/4235100949 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da815ce20 con 0x7f5da81569e0 2024-05-30T17:00:24.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.391+0000 7f5da7e00640 1 --2- 172.21.15.59:0/4235100949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da81569e0 0x7f5da815d620 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009d90 tx=0x7f5d9801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a67ad3e6f9f32dbb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:24.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.391+0000 7f5da6a00640 1 -- 172.21.15.59:0/4235100949 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d980b2070 con 0x7f5da81569e0 2024-05-30T17:00:24.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.391+0000 7f5da6a00640 1 -- 172.21.15.59:0/4235100949 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d980a5820 con 0x7f5da81569e0 2024-05-30T17:00:24.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.391+0000 7f5da6a00640 1 -- 172.21.15.59:0/4235100949 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d980a5bf0 con 0x7f5da81569e0 2024-05-30T17:00:24.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.391+0000 7f5daf000640 1 -- 172.21.15.59:0/4235100949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da81569e0 msgr2=0x7f5da815d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:24.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.391+0000 7f5daf000640 1 --2- 172.21.15.59:0/4235100949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da81569e0 0x7f5da815d620 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009d90 tx=0x7f5d9801c8e0 comp rx=0 tx=0).stop 2024-05-30T17:00:24.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.391+0000 7f5daf000640 1 -- 172.21.15.59:0/4235100949 shutdown_connections 2024-05-30T17:00:24.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.391+0000 7f5daf000640 1 --2- 172.21.15.59:0/4235100949 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5da80d0660 0x7f5da80d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:24.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.391+0000 7f5daf000640 1 --2- 172.21.15.59:0/4235100949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da81569e0 0x7f5da815d620 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:24.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.391+0000 7f5daf000640 1 -- 172.21.15.59:0/4235100949 >> 172.21.15.59:0/4235100949 conn(0x7f5da806bdb0 msgr2=0x7f5da806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:24.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.391+0000 7f5daf000640 1 -- 172.21.15.59:0/4235100949 shutdown_connections 2024-05-30T17:00:24.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.391+0000 7f5daf000640 1 -- 172.21.15.59:0/4235100949 wait complete. 2024-05-30T17:00:24.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5daf000640 1 Processor -- start 2024-05-30T17:00:24.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5daf000640 1 -- start start 2024-05-30T17:00:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5daf000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da80ad2b0 0x7f5da814a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5daf000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5da80d0660 0x7f5da814aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5daf000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da81569e0 0x7f5da8098c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5daf000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5da80b3c60 con 0x7f5da81569e0 2024-05-30T17:00:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5daf000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5da80b3ae0 con 0x7f5da80ad2b0 2024-05-30T17:00:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5daf000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5da80b3de0 con 0x7f5da80d0660 2024-05-30T17:00:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5dad000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da81569e0 0x7f5da8098c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5dad000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da81569e0 0x7f5da8098c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58692/0 (socket says 172.21.15.59:58692) 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5dad000640 1 -- 172.21.15.59:0/3787208010 learned_addr learned my addr 172.21.15.59:0/3787208010 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5da7e00640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da80ad2b0 0x7f5da814a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5da7400640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5da80d0660 0x7f5da814aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5dad000640 1 -- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5da80d0660 msgr2=0x7f5da814aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5dad000640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5da80d0660 0x7f5da814aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5dad000640 1 -- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da80ad2b0 msgr2=0x7f5da814a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5dad000640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da80ad2b0 0x7f5da814a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5dad000640 1 -- 172.21.15.59:0/3787208010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da814ccf0 con 0x7f5da81569e0 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5dad000640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da81569e0 0x7f5da8098c00 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f5da000e7f0 tx=0x7f5da000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5d9fe00640 1 -- 172.21.15.59:0/3787208010 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0017070 con 0x7f5da81569e0 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5d9fe00640 1 -- 172.21.15.59:0/3787208010 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5da000c940 con 0x7f5da81569e0 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5d9fe00640 1 -- 172.21.15.59:0/3787208010 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da000eea0 con 0x7f5da81569e0 2024-05-30T17:00:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5daf000640 1 -- 172.21.15.59:0/3787208010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da80adff0 con 0x7f5da81569e0 2024-05-30T17:00:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.395+0000 7f5daf000640 1 -- 172.21.15.59:0/3787208010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da80b1160 con 0x7f5da81569e0 2024-05-30T17:00:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.399+0000 7f5daf000640 1 -- 172.21.15.59:0/3787208010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da8068a90 con 0x7f5da81569e0 2024-05-30T17:00:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.399+0000 7f5d9fe00640 1 -- 172.21.15.59:0/3787208010 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f5da001a070 con 0x7f5da81569e0 2024-05-30T17:00:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.399+0000 7f5d9fe00640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5d88069760 0x7f5d8806bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.399+0000 7f5d9fe00640 1 -- 172.21.15.59:0/3787208010 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f5da00857d0 con 0x7f5da81569e0 2024-05-30T17:00:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.399+0000 7f5da7e00640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5d88069760 0x7f5d8806bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:24.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.399+0000 7f5da7e00640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5d88069760 0x7f5d8806bc20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5d980af000 tx=0x7f5d980a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:24.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.403+0000 7f5d9fe00640 1 -- 172.21.15.59:0/3787208010 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5da0056e20 con 0x7f5da81569e0 2024-05-30T17:00:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:24.603+0000 7f5daf000640 1 -- 172.21.15.59:0/3787208010 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f5da8143a10 con 0x7f5d88069760 2024-05-30T17:00:27.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.211+0000 7f5d9fe00640 1 -- 172.21.15.59:0/3787208010 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f5da8143a10 con 0x7f5d88069760 2024-05-30T17:00:27.214 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:27.214 INFO:teuthology.orchestra.run.smithi059.stdout: "status": { 2024-05-30T17:00:27.214 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "complete" 2024-05-30T17:00:27.214 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:27.215 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:27.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.215+0000 7f5daf000640 1 -- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5d88069760 msgr2=0x7f5d8806bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.215+0000 7f5daf000640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5d88069760 0x7f5d8806bc20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5d980af000 tx=0x7f5d980a7070 comp rx=0 tx=0).stop 2024-05-30T17:00:27.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.215+0000 7f5daf000640 1 -- 172.21.15.59:0/3787208010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da81569e0 msgr2=0x7f5da8098c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.215+0000 7f5daf000640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da81569e0 0x7f5da8098c00 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f5da000e7f0 tx=0x7f5da000ecb0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.215+0000 7f5daf000640 1 -- 172.21.15.59:0/3787208010 shutdown_connections 2024-05-30T17:00:27.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.215+0000 7f5daf000640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5d88069760 0x7f5d8806bc20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.215+0000 7f5daf000640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da81569e0 0x7f5da8098c00 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.215+0000 7f5daf000640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5da80d0660 0x7f5da814aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.215+0000 7f5daf000640 1 --2- 172.21.15.59:0/3787208010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da80ad2b0 0x7f5da814a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.215+0000 7f5daf000640 1 -- 172.21.15.59:0/3787208010 >> 172.21.15.59:0/3787208010 conn(0x7f5da806bdb0 msgr2=0x7f5da8155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:27.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.215+0000 7f5daf000640 1 -- 172.21.15.59:0/3787208010 shutdown_connections 2024-05-30T17:00:27.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.215+0000 7f5daf000640 1 -- 172.21.15.59:0/3787208010 wait complete. 2024-05-30T17:00:27.240 INFO:tasks.cephfs.test_volumes:expected clone state = ('complete',) 2024-05-30T17:00:27.240 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T17:00:27.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b21000640 1 Processor -- start 2024-05-30T17:00:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b21000640 1 -- start start 2024-05-30T17:00:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b21000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b1c0b44e0 0x7f9b1c15efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b21000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b1c15f510 0x7f9b1c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b21000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b1c0b52d0 con 0x7f9b1c159100 2024-05-30T17:00:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b21000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9b1c0b4a30 con 0x7f9b1c15f510 2024-05-30T17:00:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b21000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9b1c0b4d10 con 0x7f9b1c0b44e0 2024-05-30T17:00:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b1a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b1c15f510 0x7f9b1c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b1a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b1c15f510 0x7f9b1c15c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58706/0 (socket says 172.21.15.59:58706) 2024-05-30T17:00:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b19e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9b1c159100 0x7f9b1c06e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38148/0 (socket says 172.21.15.59:38148) 2024-05-30T17:00:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b1a800640 1 -- 172.21.15.59:0/1155986433 learned_addr learned my addr 172.21.15.59:0/1155986433 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b11400640 1 --2- 172.21.15.59:0/1155986433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b1c0b44e0 0x7f9b1c15efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b1a800640 1 -- 172.21.15.59:0/1155986433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b1c0b44e0 msgr2=0x7f9b1c15efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b1a800640 1 --2- 172.21.15.59:0/1155986433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b1c0b44e0 0x7f9b1c15efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b1a800640 1 -- 172.21.15.59:0/1155986433 >> v1:172.21.15.59:6789/0 conn(0x7f9b1c159100 legacy=0x7f9b1c06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.387+0000 7f9b1a800640 1 -- 172.21.15.59:0/1155986433 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c0b4ff0 con 0x7f9b1c15f510 2024-05-30T17:00:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.391+0000 7f9b1a800640 1 --2- 172.21.15.59:0/1155986433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c15f510 0x7f9b1c15c010 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400d150 tx=0x7f9b1401eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6c52c945ad79f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.391+0000 7f9b19400640 1 -- 172.21.15.59:0/1155986433 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400b2d0 con 0x7f9b1c15f510 2024-05-30T17:00:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.391+0000 7f9b19400640 1 -- 172.21.15.59:0/1155986433 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1400b470 con 0x7f9b1c15f510 2024-05-30T17:00:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.391+0000 7f9b19400640 1 -- 172.21.15.59:0/1155986433 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b140a7ae0 con 0x7f9b1c15f510 2024-05-30T17:00:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.391+0000 7f9b21000640 1 -- 172.21.15.59:0/1155986433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c15f510 msgr2=0x7f9b1c15c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.391+0000 7f9b21000640 1 --2- 172.21.15.59:0/1155986433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c15f510 0x7f9b1c15c010 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400d150 tx=0x7f9b1401eae0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.391+0000 7f9b21000640 1 -- 172.21.15.59:0/1155986433 shutdown_connections 2024-05-30T17:00:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.391+0000 7f9b21000640 1 --2- 172.21.15.59:0/1155986433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c15f510 0x7f9b1c15c010 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.391+0000 7f9b21000640 1 --2- 172.21.15.59:0/1155986433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b1c0b44e0 0x7f9b1c15efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.391+0000 7f9b21000640 1 -- 172.21.15.59:0/1155986433 >> 172.21.15.59:0/1155986433 conn(0x7f9b1c06bdb0 msgr2=0x7f9b1c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.391+0000 7f9b21000640 1 -- 172.21.15.59:0/1155986433 shutdown_connections 2024-05-30T17:00:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.391+0000 7f9b21000640 1 -- 172.21.15.59:0/1155986433 wait complete. 2024-05-30T17:00:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b21000640 1 Processor -- start 2024-05-30T17:00:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b21000640 1 -- start start 2024-05-30T17:00:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b21000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b1c0b44e0 0x7f9b1c15e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b21000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b1c159100 0x7f9b1c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b21000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c15f510 0x7f9b1c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b21000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c0b3760 con 0x7f9b1c15f510 2024-05-30T17:00:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b21000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c0b35e0 con 0x7f9b1c0b44e0 2024-05-30T17:00:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b21000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9b1c0b38e0 con 0x7f9b1c159100 2024-05-30T17:00:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b1a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c15f510 0x7f9b1c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b19e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b1c0b44e0 0x7f9b1c15e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b1a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c15f510 0x7f9b1c0cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58716/0 (socket says 172.21.15.59:58716) 2024-05-30T17:00:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b1a800640 1 -- 172.21.15.59:0/426821459 learned_addr learned my addr 172.21.15.59:0/426821459 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b11400640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b1c159100 0x7f9b1c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b1a800640 1 -- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b1c159100 msgr2=0x7f9b1c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b1a800640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b1c159100 0x7f9b1c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b1a800640 1 -- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b1c0b44e0 msgr2=0x7f9b1c15e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b1a800640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b1c0b44e0 0x7f9b1c15e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b1a800640 1 -- 172.21.15.59:0/426821459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c14f4e0 con 0x7f9b1c15f510 2024-05-30T17:00:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b1a800640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c15f510 0x7f9b1c0cf5b0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f9b140b1040 tx=0x7f9b1401b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b12a00640 1 -- 172.21.15.59:0/426821459 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400b720 con 0x7f9b1c15f510 2024-05-30T17:00:27.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b12a00640 1 -- 172.21.15.59:0/426821459 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b140be070 con 0x7f9b1c15f510 2024-05-30T17:00:27.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b12a00640 1 -- 172.21.15.59:0/426821459 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14009c70 con 0x7f9b1c15f510 2024-05-30T17:00:27.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b21000640 1 -- 172.21.15.59:0/426821459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1c14f7c0 con 0x7f9b1c15f510 2024-05-30T17:00:27.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.395+0000 7f9b21000640 1 -- 172.21.15.59:0/426821459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b1c14fd80 con 0x7f9b1c15f510 2024-05-30T17:00:27.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.399+0000 7f9b21000640 1 -- 172.21.15.59:0/426821459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b1c068a90 con 0x7f9b1c15f510 2024-05-30T17:00:27.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.399+0000 7f9b12a00640 1 -- 172.21.15.59:0/426821459 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f9b140b6070 con 0x7f9b1c15f510 2024-05-30T17:00:27.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.399+0000 7f9b12a00640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9af8069730 0x7f9af806bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:27.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.399+0000 7f9b12a00640 1 -- 172.21.15.59:0/426821459 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f9b14120960 con 0x7f9b1c15f510 2024-05-30T17:00:27.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.399+0000 7f9b19e00640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9af8069730 0x7f9af806bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:27.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.399+0000 7f9b19e00640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9af8069730 0x7f9af806bbf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c1fad60 tx=0x7f9b0c007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:27.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.403+0000 7f9b12a00640 1 -- 172.21.15.59:0/426821459 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b14018820 con 0x7f9b1c15f510 2024-05-30T17:00:27.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.603+0000 7f9b21000640 1 -- 172.21.15.59:0/426821459 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f9b1c14ffc0 con 0x7f9af8069730 2024-05-30T17:00:27.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.607+0000 7f9b12a00640 1 -- 172.21.15.59:0/426821459 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f9b0c0074f0 con 0x7f9af8069730 2024-05-30T17:00:27.611 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "status": { 2024-05-30T17:00:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "complete" 2024-05-30T17:00:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:27.612 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:27.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.611+0000 7f9b21000640 1 -- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9af8069730 msgr2=0x7f9af806bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.611+0000 7f9b21000640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9af8069730 0x7f9af806bbf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c1fad60 tx=0x7f9b0c007e90 comp rx=0 tx=0).stop 2024-05-30T17:00:27.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.611+0000 7f9b21000640 1 -- 172.21.15.59:0/426821459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c15f510 msgr2=0x7f9b1c0cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.611+0000 7f9b21000640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c15f510 0x7f9b1c0cf5b0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f9b140b1040 tx=0x7f9b1401b880 comp rx=0 tx=0).stop 2024-05-30T17:00:27.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.611+0000 7f9b21000640 1 -- 172.21.15.59:0/426821459 shutdown_connections 2024-05-30T17:00:27.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.611+0000 7f9b21000640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9af8069730 0x7f9af806bbf0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.611+0000 7f9b21000640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c15f510 0x7f9b1c0cf5b0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.611+0000 7f9b21000640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9b1c159100 0x7f9b1c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.611+0000 7f9b21000640 1 --2- 172.21.15.59:0/426821459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b1c0b44e0 0x7f9b1c15e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.611+0000 7f9b21000640 1 -- 172.21.15.59:0/426821459 >> 172.21.15.59:0/426821459 conn(0x7f9b1c06bdb0 msgr2=0x7f9b1c074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.611+0000 7f9b21000640 1 -- 172.21.15.59:0/426821459 shutdown_connections 2024-05-30T17:00:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.611+0000 7f9b21000640 1 -- 172.21.15.59:0/426821459 wait complete. 2024-05-30T17:00:27.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T17:00:27.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.771+0000 7ff34ca00640 1 Processor -- start 2024-05-30T17:00:27.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.771+0000 7ff34ca00640 1 -- start start 2024-05-30T17:00:27.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.771+0000 7ff34ca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff3480d0e80 0x7ff3480c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:27.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.771+0000 7ff34ca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3480c6d80 0x7ff34806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:27.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.771+0000 7ff34ca00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34815ec40 con 0x7ff34815e860 2024-05-30T17:00:27.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.771+0000 7ff34ca00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff3480cf650 con 0x7ff3480c6d80 2024-05-30T17:00:27.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.771+0000 7ff34ca00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff3480c8200 con 0x7ff3480d0e80 2024-05-30T17:00:27.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.771+0000 7ff346800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3480c6d80 0x7ff34806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:27.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.771+0000 7ff345e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff34815e860 0x7ff3480cef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38160/0 (socket says 172.21.15.59:38160) 2024-05-30T17:00:27.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.771+0000 7ff345e00640 1 -- 172.21.15.59:0/3437249663 learned_addr learned my addr 172.21.15.59:0/3437249663 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:27.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.775+0000 7ff33fe00640 1 --2- 172.21.15.59:0/3437249663 >> v2:172.21.15.107:3300/0 conn(0x7ff3480d0e80 0x7ff3480c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:27.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.775+0000 7ff346800640 1 -- 172.21.15.59:0/3437249663 >> v2:172.21.15.107:3300/0 conn(0x7ff3480d0e80 msgr2=0x7ff3480c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:27.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.775+0000 7ff346800640 1 --2- 172.21.15.59:0/3437249663 >> v2:172.21.15.107:3300/0 conn(0x7ff3480d0e80 0x7ff3480c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.775+0000 7ff346800640 1 -- 172.21.15.59:0/3437249663 >> v1:172.21.15.59:6789/0 conn(0x7ff34815e860 legacy=0x7ff3480cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.775+0000 7ff346800640 1 -- 172.21.15.59:0/3437249663 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3480c7960 con 0x7ff3480c6d80 2024-05-30T17:00:27.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.775+0000 7ff345400640 1 -- 172.21.15.59:0/3437249663 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2499822992 0 0) 0x7ff34815ec40 con 0x7ff34815e860 2024-05-30T17:00:27.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.775+0000 7ff346800640 1 --2- 172.21.15.59:0/3437249663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3480c6d80 0x7ff34806b9b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff3480710f0 tx=0x7ff34001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d330dd378d56c1a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:27.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.775+0000 7ff345400640 1 -- 172.21.15.59:0/3437249663 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3400b2070 con 0x7ff3480c6d80 2024-05-30T17:00:27.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.775+0000 7ff345400640 1 -- 172.21.15.59:0/3437249663 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3400a5850 con 0x7ff3480c6d80 2024-05-30T17:00:27.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.775+0000 7ff345400640 1 -- 172.21.15.59:0/3437249663 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3400a5c20 con 0x7ff3480c6d80 2024-05-30T17:00:27.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.775+0000 7ff34ca00640 1 -- 172.21.15.59:0/3437249663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3480c6d80 msgr2=0x7ff34806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.775+0000 7ff34ca00640 1 --2- 172.21.15.59:0/3437249663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3480c6d80 0x7ff34806b9b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff3480710f0 tx=0x7ff34001c8a0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 -- 172.21.15.59:0/3437249663 shutdown_connections 2024-05-30T17:00:27.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 --2- 172.21.15.59:0/3437249663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3480c6d80 0x7ff34806b9b0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 --2- 172.21.15.59:0/3437249663 >> v2:172.21.15.107:3300/0 conn(0x7ff3480d0e80 0x7ff3480c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 -- 172.21.15.59:0/3437249663 >> 172.21.15.59:0/3437249663 conn(0x7ff3480b2fc0 msgr2=0x7ff3480b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:27.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 -- 172.21.15.59:0/3437249663 shutdown_connections 2024-05-30T17:00:27.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 -- 172.21.15.59:0/3437249663 wait complete. 2024-05-30T17:00:27.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 Processor -- start 2024-05-30T17:00:27.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 -- start start 2024-05-30T17:00:27.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3480c6d80 0x7ff3480afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:27.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3480d0e80 0x7ff348157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:27.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff34815e860 0x7ff3480b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:27.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff3480b3d40 con 0x7ff3480d0e80 2024-05-30T17:00:27.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff3480b3bc0 con 0x7ff3480c6d80 2024-05-30T17:00:27.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff34ca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff34816b3a0 con 0x7ff34815e860 2024-05-30T17:00:27.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff33fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3480d0e80 0x7ff348157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:27.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff33fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3480d0e80 0x7ff348157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58724/0 (socket says 172.21.15.59:58724) 2024-05-30T17:00:27.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff33fe00640 1 -- 172.21.15.59:0/1593013137 learned_addr learned my addr 172.21.15.59:0/1593013137 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:27.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff345e00640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3480c6d80 0x7ff3480afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:27.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff346800640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff34815e860 0x7ff3480b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:27.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff33fe00640 1 -- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff34815e860 msgr2=0x7ff3480b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff33fe00640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff34815e860 0x7ff3480b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff33fe00640 1 -- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3480c6d80 msgr2=0x7ff3480afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff33fe00640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3480c6d80 0x7ff3480afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff33fe00640 1 -- 172.21.15.59:0/1593013137 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3480b05f0 con 0x7ff3480d0e80 2024-05-30T17:00:27.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff33fe00640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3480d0e80 0x7ff348157650 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ff33000e960 tx=0x7ff33000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:27.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.779+0000 7ff33e000640 1 -- 172.21.15.59:0/1593013137 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330017070 con 0x7ff3480d0e80 2024-05-30T17:00:27.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.783+0000 7ff33e000640 1 -- 172.21.15.59:0/1593013137 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff33000ca00 con 0x7ff3480d0e80 2024-05-30T17:00:27.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.783+0000 7ff34ca00640 1 -- 172.21.15.59:0/1593013137 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3480b0310 con 0x7ff3480d0e80 2024-05-30T17:00:27.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.783+0000 7ff33e000640 1 -- 172.21.15.59:0/1593013137 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33000cdb0 con 0x7ff3480d0e80 2024-05-30T17:00:27.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.783+0000 7ff34ca00640 1 -- 172.21.15.59:0/1593013137 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3480b4360 con 0x7ff3480d0e80 2024-05-30T17:00:27.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.783+0000 7ff34ca00640 1 -- 172.21.15.59:0/1593013137 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff348068a90 con 0x7ff3480d0e80 2024-05-30T17:00:27.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.783+0000 7ff33e000640 1 -- 172.21.15.59:0/1593013137 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7ff33001a070 con 0x7ff3480d0e80 2024-05-30T17:00:27.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.783+0000 7ff33e000640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff324069730 0x7ff32406bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:27.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.783+0000 7ff33e000640 1 -- 172.21.15.59:0/1593013137 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7ff330085a10 con 0x7ff3480d0e80 2024-05-30T17:00:27.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.783+0000 7ff345e00640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff324069730 0x7ff32406bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:27.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.783+0000 7ff345e00640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff324069730 0x7ff32406bbf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff338000f70 tx=0x7ff338007b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:27.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.787+0000 7ff33e000640 1 -- 172.21.15.59:0/1593013137 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff330057670 con 0x7ff3480d0e80 2024-05-30T17:00:27.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.975+0000 7ff34ca00640 1 -- 172.21.15.59:0/1593013137 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7ff3480b13b0 con 0x7ff324069730 2024-05-30T17:00:27.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff33e000640 1 -- 172.21.15.59:0/1593013137 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7ff3480b13b0 con 0x7ff324069730 2024-05-30T17:00:27.981 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:00:27.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:27.981 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T17:00:27.981 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:27.981 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:00:27.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff34ca00640 1 -- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff324069730 msgr2=0x7ff32406bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff34ca00640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff324069730 0x7ff32406bbf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff338000f70 tx=0x7ff338007b80 comp rx=0 tx=0).stop 2024-05-30T17:00:27.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff34ca00640 1 -- 172.21.15.59:0/1593013137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3480d0e80 msgr2=0x7ff348157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:27.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff34ca00640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3480d0e80 0x7ff348157650 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ff33000e960 tx=0x7ff33000ee20 comp rx=0 tx=0).stop 2024-05-30T17:00:27.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff34ca00640 1 -- 172.21.15.59:0/1593013137 shutdown_connections 2024-05-30T17:00:27.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff34ca00640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff324069730 0x7ff32406bbf0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff34ca00640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff34815e860 0x7ff3480b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff34ca00640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3480d0e80 0x7ff348157650 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff34ca00640 1 --2- 172.21.15.59:0/1593013137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3480c6d80 0x7ff3480afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:27.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff34ca00640 1 -- 172.21.15.59:0/1593013137 >> 172.21.15.59:0/1593013137 conn(0x7ff3480b2fc0 msgr2=0x7ff34815b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:27.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff34ca00640 1 -- 172.21.15.59:0/1593013137 shutdown_connections 2024-05-30T17:00:27.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:27.979+0000 7ff34ca00640 1 -- 172.21.15.59:0/1593013137 wait complete. 2024-05-30T17:00:28.002 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:00:28.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cbc200640 1 Processor -- start 2024-05-30T17:00:28.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cbc200640 1 -- start start 2024-05-30T17:00:28.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cbc200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5cb4146000 0x7f5cb41600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:28.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cbc200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5cb40b4df0 0x7f5cb40cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:28.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cbc200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cb40b3c20 con 0x7f5cb4160610 2024-05-30T17:00:28.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cbc200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5cb415ce50 con 0x7f5cb40b4df0 2024-05-30T17:00:28.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cbc200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb4160c40 con 0x7f5cb4146000 2024-05-30T17:00:28.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cb8e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5cb4160610 0x7f5cb40b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38174/0 (socket says 172.21.15.59:38174) 2024-05-30T17:00:28.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cb8e00640 1 -- 172.21.15.59:0/423912640 learned_addr learned my addr 172.21.15.59:0/423912640 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:28.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cba200640 1 --2- 172.21.15.59:0/423912640 >> v2:172.21.15.107:3300/0 conn(0x7f5cb40b4df0 0x7f5cb40cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cb9800640 1 --2- 172.21.15.59:0/423912640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5cb4146000 0x7f5cb41600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432456363 0 0) 0x7f5cb40b3c20 con 0x7f5cb4160610 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.139+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c9c003530 con 0x7f5cb4160610 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3252660864 0 0) 0x7f5c9c003530 con 0x7f5cb4160610 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5cb4146000 msgr2=0x7f5cb41600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 --2- 172.21.15.59:0/423912640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5cb4146000 0x7f5cb41600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 >> v2:172.21.15.107:3300/0 conn(0x7f5cb40b4df0 msgr2=0x7f5cb40cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 --2- 172.21.15.59:0/423912640 >> v2:172.21.15.107:3300/0 conn(0x7f5cb40b4df0 0x7f5cb40cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb4160f20 con 0x7f5cb4160610 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f5ca0001680 con 0x7f5cb4160610 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 >> v1:172.21.15.59:6789/0 conn(0x7f5cb4160610 legacy=0x7f5cb40b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 --2- 172.21.15.59:0/423912640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c0039c0 0x7f5c9c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 --2- 172.21.15.59:0/423912640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c9c004810 0x7f5c9c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:28.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 --2- 172.21.15.59:0/423912640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c9c0051d0 0x7f5c9c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:28.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb4160c40 con 0x7f5c9c0039c0 2024-05-30T17:00:28.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9c00bf10 con 0x7f5c9c004810 2024-05-30T17:00:28.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9c00c090 con 0x7f5c9c0051d0 2024-05-30T17:00:28.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb9800640 1 --2- 172.21.15.59:0/423912640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c0039c0 0x7f5c9c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:28.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cba200640 1 --2- 172.21.15.59:0/423912640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c9c0051d0 0x7f5c9c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:28.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb8e00640 1 --2- 172.21.15.59:0/423912640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c9c004810 0x7f5c9c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:28.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb9800640 1 -- 172.21.15.59:0/423912640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c9c0051d0 msgr2=0x7f5c9c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:28.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb9800640 1 --2- 172.21.15.59:0/423912640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c9c0051d0 0x7f5c9c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:28.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb9800640 1 -- 172.21.15.59:0/423912640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c9c004810 msgr2=0x7f5c9c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:28.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb9800640 1 --2- 172.21.15.59:0/423912640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c9c004810 0x7f5c9c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:28.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb9800640 1 -- 172.21.15.59:0/423912640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9c003530 con 0x7f5c9c0039c0 2024-05-30T17:00:28.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb9800640 1 --2- 172.21.15.59:0/423912640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c0039c0 0x7f5c9c003de0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80099a0 tx=0x7f5ca801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531d4a7f83982335 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:28.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.143+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8009670 con 0x7f5c9c0039c0 2024-05-30T17:00:28.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca80a9410 con 0x7f5c9c0039c0 2024-05-30T17:00:28.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cb3e00640 1 -- 172.21.15.59:0/423912640 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80a97c0 con 0x7f5c9c0039c0 2024-05-30T17:00:28.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 -- 172.21.15.59:0/423912640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c0039c0 msgr2=0x7f5c9c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 --2- 172.21.15.59:0/423912640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c0039c0 0x7f5c9c003de0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80099a0 tx=0x7f5ca801c930 comp rx=0 tx=0).stop 2024-05-30T17:00:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cba200640 1 -- 172.21.15.59:0/423912640 reap_dead start 2024-05-30T17:00:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 -- 172.21.15.59:0/423912640 shutdown_connections 2024-05-30T17:00:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 -- 172.21.15.59:0/423912640 >> 172.21.15.59:0/423912640 conn(0x7f5cb4067d60 msgr2=0x7f5cb406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 -- 172.21.15.59:0/423912640 shutdown_connections 2024-05-30T17:00:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 -- 172.21.15.59:0/423912640 wait complete. 2024-05-30T17:00:28.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 Processor -- start 2024-05-30T17:00:28.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 -- start start 2024-05-30T17:00:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c0039c0 0x7f5cb40adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5cb4163800 0x7f5cb415bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5cb4166910 0x7f5cb4163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb4167460 con 0x7f5c9c0039c0 2024-05-30T17:00:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb40cfa20 con 0x7f5cb4163800 2024-05-30T17:00:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cbc200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb41675e0 con 0x7f5cb4166910 2024-05-30T17:00:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cb9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c0039c0 0x7f5cb40adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cb9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c0039c0 0x7f5cb40adc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58752/0 (socket says 172.21.15.59:58752) 2024-05-30T17:00:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cb9800640 1 -- 172.21.15.59:0/373966694 learned_addr learned my addr 172.21.15.59:0/373966694 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cb8e00640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5cb4163800 0x7f5cb415bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.147+0000 7f5cba200640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5cb4166910 0x7f5cb4163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb9800640 1 -- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5cb4166910 msgr2=0x7f5cb4163dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb9800640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5cb4166910 0x7f5cb4163dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb9800640 1 -- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5cb4163800 msgr2=0x7f5cb415bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb9800640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5cb4163800 0x7f5cb415bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb9800640 1 -- 172.21.15.59:0/373966694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb41671f0 con 0x7f5c9c0039c0 2024-05-30T17:00:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb8e00640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5cb4163800 0x7f5cb415bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:00:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb9800640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c0039c0 0x7f5cb40adc30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80ab040 tx=0x7f5c9c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb1600640 1 -- 172.21.15.59:0/373966694 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80c1070 con 0x7f5c9c0039c0 2024-05-30T17:00:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb1600640 1 -- 172.21.15.59:0/373966694 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca800f000 con 0x7f5c9c0039c0 2024-05-30T17:00:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb1600640 1 -- 172.21.15.59:0/373966694 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8003860 con 0x7f5c9c0039c0 2024-05-30T17:00:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cbc200640 1 -- 172.21.15.59:0/373966694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb41ec510 con 0x7f5c9c0039c0 2024-05-30T17:00:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cbc200640 1 -- 172.21.15.59:0/373966694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb41ecad0 con 0x7f5c9c0039c0 2024-05-30T17:00:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cbc200640 1 -- 172.21.15.59:0/373966694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb4068a90 con 0x7f5c9c0039c0 2024-05-30T17:00:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb1600640 1 -- 172.21.15.59:0/373966694 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f5ca80c4070 con 0x7f5c9c0039c0 2024-05-30T17:00:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb1600640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5c94069760 0x7f5c9406bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb1600640 1 -- 172.21.15.59:0/373966694 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f5ca811f970 con 0x7f5c9c0039c0 2024-05-30T17:00:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.151+0000 7f5cb8e00640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5c94069760 0x7f5c9406bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:28.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.155+0000 7f5cb8e00640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5c94069760 0x7f5c9406bc20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40afc60 tx=0x7f5ca0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.155+0000 7f5cb1600640 1 -- 172.21.15.59:0/373966694 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ca80ad020 con 0x7f5c9c0039c0 2024-05-30T17:00:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.379+0000 7f5cbc200640 1 -- 172.21.15.59:0/373966694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5cb40b3490 con 0x7f5c9c0039c0 2024-05-30T17:00:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.379+0000 7f5cb1600640 1 -- 172.21.15.59:0/373966694 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2122 (secure 0 0 0) 0x7f5ca8016680 con 0x7f5c9c0039c0 2024-05-30T17:00:28.382 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:00:28.383 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:28.383 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:00:28.383 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:00:28.383 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:00:28.383 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:00:28.383 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:00:28.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:28.383 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:00:28.383 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:00:28.383 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:00:28.383 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:00:28.383 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 708, 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 92, 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:28.385 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1403, 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 5759816515, 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 12210499584, 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 760883613696, 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 214556048, 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 216676653, 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 51, 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 59 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:28.386 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 53, 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6, 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 6, 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "d", 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7449 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:28.387 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 12, 2024-05-30T17:00:28.388 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T16:57:51.243602+0000", 2024-05-30T17:00:28.389 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:00:28.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:28.389 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:00:28.389 INFO:teuthology.orchestra.run.smithi059.stdout: "268d3c7c-fadb-4b56-9b25-b29e80cf3ac6": { 2024-05-30T17:00:28.389 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 29.0 seconds before exiting (7s)\n [============================] ", 2024-05-30T17:00:28.389 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:00:28.389 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:00:28.389 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:28.389 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:28.389 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.383+0000 7f5cbc200640 1 -- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5c94069760 msgr2=0x7f5c9406bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.383+0000 7f5cbc200640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5c94069760 0x7f5c9406bc20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40afc60 tx=0x7f5ca0009040 comp rx=0 tx=0).stop 2024-05-30T17:00:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.383+0000 7f5cbc200640 1 -- 172.21.15.59:0/373966694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c0039c0 msgr2=0x7f5cb40adc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.383+0000 7f5cbc200640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c0039c0 0x7f5cb40adc30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80ab040 tx=0x7f5c9c005840 comp rx=0 tx=0).stop 2024-05-30T17:00:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.383+0000 7f5cbc200640 1 -- 172.21.15.59:0/373966694 shutdown_connections 2024-05-30T17:00:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.383+0000 7f5cbc200640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5c94069760 0x7f5c9406bc20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.383+0000 7f5cbc200640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5cb4166910 0x7f5cb4163dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.383+0000 7f5cbc200640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5cb4163800 0x7f5cb415bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:28.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.383+0000 7f5cbc200640 1 --2- 172.21.15.59:0/373966694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c0039c0 0x7f5cb40adc30 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:28.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.383+0000 7f5cbc200640 1 -- 172.21.15.59:0/373966694 >> 172.21.15.59:0/373966694 conn(0x7f5cb4067d60 msgr2=0x7f5cb406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:28.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.383+0000 7f5cbc200640 1 -- 172.21.15.59:0/373966694 shutdown_connections 2024-05-30T17:00:28.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:28.383+0000 7f5cbc200640 1 -- 172.21.15.59:0/373966694 wait complete. 2024-05-30T17:00:33.404 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:00:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9749c00640 1 Processor -- start 2024-05-30T17:00:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9749c00640 1 -- start start 2024-05-30T17:00:33.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9749c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9744145de0 0x7f97440cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:33.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9749c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f974406c0c0 0x7f97440af880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:33.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9749c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97440cf4d0 con 0x7f97440b3970 2024-05-30T17:00:33.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9749c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f97441461c0 con 0x7f974406c0c0 2024-05-30T17:00:33.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9749c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f97440d00e0 con 0x7f9744145de0 2024-05-30T17:00:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9743e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9744145de0 0x7f97440cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9743e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9744145de0 0x7f97440cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:43112/0 (socket says 172.21.15.59:43112) 2024-05-30T17:00:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9743e00640 1 -- 172.21.15.59:0/3950537471 learned_addr learned my addr 172.21.15.59:0/3950537471 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9749200640 1 --2- 172.21.15.59:0/3950537471 >> v2:172.21.15.107:3300/0 conn(0x7f974406c0c0 0x7f97440af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9743e00640 1 -- 172.21.15.59:0/3950537471 >> v2:172.21.15.107:3300/0 conn(0x7f974406c0c0 msgr2=0x7f97440af880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9743e00640 1 --2- 172.21.15.59:0/3950537471 >> v2:172.21.15.107:3300/0 conn(0x7f974406c0c0 0x7f97440af880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9743e00640 1 -- 172.21.15.59:0/3950537471 >> v1:172.21.15.107:6789/0 conn(0x7f97440b3970 legacy=0x7f974406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.555+0000 7f9743e00640 1 -- 172.21.15.59:0/3950537471 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97440cf7b0 con 0x7f9744145de0 2024-05-30T17:00:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.559+0000 7f9743e00640 1 --2- 172.21.15.59:0/3950537471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9744145de0 0x7f97440cee80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9734009870 tx=0x7f973401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6c869f0a4281dd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.559+0000 7f9742a00640 1 -- 172.21.15.59:0/3950537471 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97340a95f0 con 0x7f9744145de0 2024-05-30T17:00:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.559+0000 7f9742a00640 1 -- 172.21.15.59:0/3950537471 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97340a9790 con 0x7f9744145de0 2024-05-30T17:00:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.559+0000 7f9742a00640 1 -- 172.21.15.59:0/3950537471 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97340a9b60 con 0x7f9744145de0 2024-05-30T17:00:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.559+0000 7f9749c00640 1 -- 172.21.15.59:0/3950537471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9744145de0 msgr2=0x7f97440cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.559+0000 7f9749c00640 1 --2- 172.21.15.59:0/3950537471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9744145de0 0x7f97440cee80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9734009870 tx=0x7f973401c530 comp rx=0 tx=0).stop 2024-05-30T17:00:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.559+0000 7f9749c00640 1 -- 172.21.15.59:0/3950537471 shutdown_connections 2024-05-30T17:00:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.559+0000 7f9749c00640 1 --2- 172.21.15.59:0/3950537471 >> v2:172.21.15.107:3300/0 conn(0x7f974406c0c0 0x7f97440af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.559+0000 7f9749c00640 1 --2- 172.21.15.59:0/3950537471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9744145de0 0x7f97440cee80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.559+0000 7f9749c00640 1 -- 172.21.15.59:0/3950537471 >> 172.21.15.59:0/3950537471 conn(0x7f974409aa40 msgr2=0x7f97440b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.559+0000 7f9749c00640 1 -- 172.21.15.59:0/3950537471 shutdown_connections 2024-05-30T17:00:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.559+0000 7f9749c00640 1 -- 172.21.15.59:0/3950537471 wait complete. 2024-05-30T17:00:33.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9749c00640 1 Processor -- start 2024-05-30T17:00:33.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9749c00640 1 -- start start 2024-05-30T17:00:33.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9749c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f974406c0c0 0x7f974415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:33.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9749c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97440b3970 0x7f974415b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:33.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9749c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9744145de0 0x7f97441444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:33.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9749c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f97440b0750 con 0x7f974406c0c0 2024-05-30T17:00:33.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9749c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f97440b05d0 con 0x7f97440b3970 2024-05-30T17:00:33.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9749c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f97440b08d0 con 0x7f9744145de0 2024-05-30T17:00:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9743e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f974406c0c0 0x7f974415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9743e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f974406c0c0 0x7f974415bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45876/0 (socket says 172.21.15.59:45876) 2024-05-30T17:00:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9743e00640 1 -- 172.21.15.59:0/3427567409 learned_addr learned my addr 172.21.15.59:0/3427567409 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9743400640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97440b3970 0x7f974415b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9749200640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9744145de0 0x7f97441444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9743e00640 1 -- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9744145de0 msgr2=0x7f97441444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9743e00640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9744145de0 0x7f97441444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9743e00640 1 -- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97440b3970 msgr2=0x7f974415b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9743e00640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97440b3970 0x7f974415b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9743e00640 1 -- 172.21.15.59:0/3427567409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974415c2c0 con 0x7f974406c0c0 2024-05-30T17:00:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9743e00640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f974406c0c0 0x7f974415bd80 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f973401abe0 tx=0x7f97340192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:33.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f973be00640 1 -- 172.21.15.59:0/3427567409 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97340a95f0 con 0x7f974406c0c0 2024-05-30T17:00:33.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f973be00640 1 -- 172.21.15.59:0/3427567409 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97340b1820 con 0x7f974406c0c0 2024-05-30T17:00:33.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f973be00640 1 -- 172.21.15.59:0/3427567409 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97340b1c10 con 0x7f974406c0c0 2024-05-30T17:00:33.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9749c00640 1 -- 172.21.15.59:0/3427567409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974415bae0 con 0x7f974406c0c0 2024-05-30T17:00:33.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.563+0000 7f9749c00640 1 -- 172.21.15.59:0/3427567409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97440cccc0 con 0x7f974406c0c0 2024-05-30T17:00:33.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.567+0000 7f9749c00640 1 -- 172.21.15.59:0/3427567409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97440691a0 con 0x7f974406c0c0 2024-05-30T17:00:33.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.567+0000 7f973be00640 1 -- 172.21.15.59:0/3427567409 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f97340bb3f0 con 0x7f974406c0c0 2024-05-30T17:00:33.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.567+0000 7f973be00640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9724069730 0x7f972406bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:33.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.567+0000 7f973be00640 1 -- 172.21.15.59:0/3427567409 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f973411fd30 con 0x7f974406c0c0 2024-05-30T17:00:33.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.567+0000 7f9743400640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9724069730 0x7f972406bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:33.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.567+0000 7f9743400640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9724069730 0x7f972406bbf0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f974415c770 tx=0x7f9730009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:33.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.571+0000 7f973be00640 1 -- 172.21.15.59:0/3427567409 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f97340c2030 con 0x7f974406c0c0 2024-05-30T17:00:33.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.799+0000 7f9749c00640 1 -- 172.21.15.59:0/3427567409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9744140140 con 0x7f974406c0c0 2024-05-30T17:00:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f973be00640 1 -- 172.21.15.59:0/3427567409 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+3232 (secure 0 0 0) 0x7f974415c2c0 con 0x7f974406c0c0 2024-05-30T17:00:33.804 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:00:33.804 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:33.804 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:00:33.804 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:00:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:00:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 713, 2024-05-30T17:00:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:00:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:00:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:00:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:00:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:00:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 92, 2024-05-30T17:00:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:00:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:00:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:00:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1565, 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 6443505169, 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 13695393792, 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 759398719488, 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 268368009, 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 268392237, 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 64, 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 72 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 53, 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6, 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:00:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 6, 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "d", 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7449 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 13, 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:00:33.320552+0000", 2024-05-30T17:00:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: "b": { 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: "c": { 2024-05-30T17:00:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: "d": { 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:00:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:00:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: "268d3c7c-fadb-4b56-9b25-b29e80cf3ac6": { 2024-05-30T17:00:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 23.0 seconds before exiting (13s)\n [============================] ", 2024-05-30T17:00:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:00:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:00:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:33.813 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f9749c00640 1 -- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9724069730 msgr2=0x7f972406bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f9749c00640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9724069730 0x7f972406bbf0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f974415c770 tx=0x7f9730009040 comp rx=0 tx=0).stop 2024-05-30T17:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f9749c00640 1 -- 172.21.15.59:0/3427567409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f974406c0c0 msgr2=0x7f974415bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f9749c00640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f974406c0c0 0x7f974415bd80 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f973401abe0 tx=0x7f97340192d0 comp rx=0 tx=0).stop 2024-05-30T17:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f9749c00640 1 -- 172.21.15.59:0/3427567409 shutdown_connections 2024-05-30T17:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f9749c00640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9724069730 0x7f972406bbf0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f9749c00640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9744145de0 0x7f97441444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f9749c00640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97440b3970 0x7f974415b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f9749c00640 1 --2- 172.21.15.59:0/3427567409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f974406c0c0 0x7f974415bd80 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f9749c00640 1 -- 172.21.15.59:0/3427567409 >> 172.21.15.59:0/3427567409 conn(0x7f974409aa40 msgr2=0x7f97440b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f9749c00640 1 -- 172.21.15.59:0/3427567409 shutdown_connections 2024-05-30T17:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:33.803+0000 7f9749c00640 1 -- 172.21.15.59:0/3427567409 wait complete. 2024-05-30T17:00:35.181 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:00:35.186 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:00:38.827 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:00:38.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc29a400640 1 Processor -- start 2024-05-30T17:00:38.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc29a400640 1 -- start start 2024-05-30T17:00:38.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc29a400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc294146000 0x7fc2941600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:38.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc29a400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2940b3c20 con 0x7fc294160610 2024-05-30T17:00:38.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc29a400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc294160c40 con 0x7fc2940b4df0 2024-05-30T17:00:38.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc29a400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc29415ce50 con 0x7fc294146000 2024-05-30T17:00:38.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc292a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc294160610 0x7fc2940b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37492/0 (socket says 172.21.15.59:37492) 2024-05-30T17:00:38.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc292a00640 1 -- 172.21.15.59:0/2703743767 learned_addr learned my addr 172.21.15.59:0/2703743767 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:38.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc293400640 1 --2- 172.21.15.59:0/2703743767 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc294146000 0x7fc2941600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:38.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc292000640 1 -- 172.21.15.59:0/2703743767 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333359508 0 0) 0x7fc2940b3c20 con 0x7fc294160610 2024-05-30T17:00:38.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc292000640 1 -- 172.21.15.59:0/2703743767 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc278003530 con 0x7fc294160610 2024-05-30T17:00:38.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc292000640 1 -- 172.21.15.59:0/2703743767 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2171101934 0 0) 0x7fc294160c40 con 0x7fc2940b4df0 2024-05-30T17:00:38.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc292000640 1 -- 172.21.15.59:0/2703743767 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2940b3c20 con 0x7fc2940b4df0 2024-05-30T17:00:38.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc293400640 1 -- 172.21.15.59:0/2703743767 >> v1:172.21.15.107:6789/0 conn(0x7fc2940b4df0 legacy=0x7fc2940cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:38.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc293400640 1 -- 172.21.15.59:0/2703743767 >> v1:172.21.15.59:6789/0 conn(0x7fc294160610 legacy=0x7fc2940b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:38.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.979+0000 7fc293400640 1 -- 172.21.15.59:0/2703743767 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc294160f20 con 0x7fc294146000 2024-05-30T17:00:38.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.983+0000 7fc293400640 1 --2- 172.21.15.59:0/2703743767 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc294146000 0x7fc2941600d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc2840097f0 tx=0x7fc28401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53396cd7f14d5a67 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:38.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.983+0000 7fc292000640 1 -- 172.21.15.59:0/2703743767 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840b1070 con 0x7fc294146000 2024-05-30T17:00:38.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.983+0000 7fc292000640 1 -- 172.21.15.59:0/2703743767 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2840ac630 con 0x7fc294146000 2024-05-30T17:00:38.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.983+0000 7fc292000640 1 -- 172.21.15.59:0/2703743767 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840a8050 con 0x7fc294146000 2024-05-30T17:00:38.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.983+0000 7fc29a400640 1 -- 172.21.15.59:0/2703743767 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc294146000 msgr2=0x7fc2941600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:38.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.983+0000 7fc29a400640 1 --2- 172.21.15.59:0/2703743767 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc294146000 0x7fc2941600d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc2840097f0 tx=0x7fc28401c4e0 comp rx=0 tx=0).stop 2024-05-30T17:00:38.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.983+0000 7fc29a400640 1 -- 172.21.15.59:0/2703743767 shutdown_connections 2024-05-30T17:00:38.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.983+0000 7fc29a400640 1 --2- 172.21.15.59:0/2703743767 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc294146000 0x7fc2941600d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:38.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.983+0000 7fc29a400640 1 -- 172.21.15.59:0/2703743767 >> 172.21.15.59:0/2703743767 conn(0x7fc294067d60 msgr2=0x7fc29406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:38.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.983+0000 7fc29a400640 1 -- 172.21.15.59:0/2703743767 shutdown_connections 2024-05-30T17:00:38.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.983+0000 7fc29a400640 1 -- 172.21.15.59:0/2703743767 wait complete. 2024-05-30T17:00:38.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc29a400640 1 Processor -- start 2024-05-30T17:00:38.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc29a400640 1 -- start start 2024-05-30T17:00:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc29a400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc294146000 0x7fc294159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc29a400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc294160610 0x7fc29406e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc29a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29406eb30 0x7fc29413d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc29a400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc29416a810 con 0x7fc29406eb30 2024-05-30T17:00:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc29a400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc29416a690 con 0x7fc294160610 2024-05-30T17:00:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc29a400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc29416a990 con 0x7fc294146000 2024-05-30T17:00:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc293e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29406eb30 0x7fc29413d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc293e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29406eb30 0x7fc29413d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45886/0 (socket says 172.21.15.59:45886) 2024-05-30T17:00:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc293e00640 1 -- 172.21.15.59:0/3619878342 learned_addr learned my addr 172.21.15.59:0/3619878342 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:38.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc293400640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc294146000 0x7fc294159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:38.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc292a00640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc294160610 0x7fc29406e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:38.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc293e00640 1 -- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc294146000 msgr2=0x7fc294159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:38.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc293e00640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc294146000 0x7fc294159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:38.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc293e00640 1 -- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc294160610 msgr2=0x7fc29406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:38.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc293e00640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc294160610 0x7fc29406e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:38.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc293e00640 1 -- 172.21.15.59:0/3619878342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29415ca70 con 0x7fc29406eb30 2024-05-30T17:00:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc293e00640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29406eb30 0x7fc29413d920 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00c790 tx=0x7fc28c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc28b400640 1 -- 172.21.15.59:0/3619878342 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c003b80 con 0x7fc29406eb30 2024-05-30T17:00:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc28b400640 1 -- 172.21.15.59:0/3619878342 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28c003d20 con 0x7fc29406eb30 2024-05-30T17:00:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc28b400640 1 -- 172.21.15.59:0/3619878342 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c00aa50 con 0x7fc29406eb30 2024-05-30T17:00:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc29a400640 1 -- 172.21.15.59:0/3619878342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29415c5b0 con 0x7fc29406eb30 2024-05-30T17:00:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc29a400640 1 -- 172.21.15.59:0/3619878342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29415b830 con 0x7fc29406eb30 2024-05-30T17:00:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.987+0000 7fc29a400640 1 -- 172.21.15.59:0/3619878342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc294068a90 con 0x7fc29406eb30 2024-05-30T17:00:38.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.991+0000 7fc28b400640 1 -- 172.21.15.59:0/3619878342 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7fc28c00abf0 con 0x7fc29406eb30 2024-05-30T17:00:38.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.991+0000 7fc28b400640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc274069780 0x7fc27406bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:38.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.991+0000 7fc28b400640 1 -- 172.21.15.59:0/3619878342 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7fc28c085610 con 0x7fc29406eb30 2024-05-30T17:00:38.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.991+0000 7fc293400640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc274069780 0x7fc27406bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:38.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.991+0000 7fc293400640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc274069780 0x7fc27406bc40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc2840ae000 tx=0x7fc284008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:38.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:38.995+0000 7fc28b400640 1 -- 172.21.15.59:0/3619878342 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc28c057620 con 0x7fc29406eb30 2024-05-30T17:00:39.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.219+0000 7fc29a400640 1 -- 172.21.15.59:0/3619878342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc2940b3490 con 0x7fc29406eb30 2024-05-30T17:00:39.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.219+0000 7fc28b400640 1 -- 172.21.15.59:0/3619878342 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2575 (secure 0 0 0) 0x7fc28c056f20 con 0x7fc29406eb30 2024-05-30T17:00:39.224 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:00:39.224 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:39.224 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:00:39.224 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:00:39.226 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:00:39.226 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:00:39.226 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:00:39.226 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:39.226 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 719, 2024-05-30T17:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 92, 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1565, 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 6443505169, 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 13695426560, 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 759398686720, 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 94696971, 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 101348235, 2024-05-30T17:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 23, 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 28 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 53, 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6, 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 6, 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "d", 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7449 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 14, 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:00:35.321003+0000", 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "d": { 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "268d3c7c-fadb-4b56-9b25-b29e80cf3ac6": { 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 19.0 seconds before exiting (17s)\n [============================] ", 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:39.234 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:39.234 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.223+0000 7fc29a400640 1 -- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc274069780 msgr2=0x7fc27406bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.223+0000 7fc29a400640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc274069780 0x7fc27406bc40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc2840ae000 tx=0x7fc284008040 comp rx=0 tx=0).stop 2024-05-30T17:00:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.223+0000 7fc29a400640 1 -- 172.21.15.59:0/3619878342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29406eb30 msgr2=0x7fc29413d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.223+0000 7fc29a400640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29406eb30 0x7fc29413d920 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00c790 tx=0x7fc28c00cc50 comp rx=0 tx=0).stop 2024-05-30T17:00:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.223+0000 7fc29a400640 1 -- 172.21.15.59:0/3619878342 shutdown_connections 2024-05-30T17:00:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.223+0000 7fc29a400640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc274069780 0x7fc27406bc40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.223+0000 7fc29a400640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29406eb30 0x7fc29413d920 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.223+0000 7fc29a400640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc294160610 0x7fc29406e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.223+0000 7fc29a400640 1 --2- 172.21.15.59:0/3619878342 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc294146000 0x7fc294159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.223+0000 7fc29a400640 1 -- 172.21.15.59:0/3619878342 >> 172.21.15.59:0/3619878342 conn(0x7fc294067d60 msgr2=0x7fc2940b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.223+0000 7fc29a400640 1 -- 172.21.15.59:0/3619878342 shutdown_connections 2024-05-30T17:00:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:39.223+0000 7fc29a400640 1 -- 172.21.15.59:0/3619878342 wait complete. 2024-05-30T17:00:44.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:00:44.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.395+0000 7f5125e00640 1 Processor -- start 2024-05-30T17:00:44.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.395+0000 7f5125e00640 1 -- start start 2024-05-30T17:00:44.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.395+0000 7f5125e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51201558e0 0x7f51200b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:44.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.395+0000 7f5125e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512006de10 con 0x7f512006f8c0 2024-05-30T17:00:44.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.395+0000 7f5125e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512006e0f0 con 0x7f512015f690 2024-05-30T17:00:44.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.395+0000 7f5125e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f512006e3d0 con 0x7f51201558e0 2024-05-30T17:00:44.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.395+0000 7f5116000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f512006f8c0 0x7f512015ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52240/0 (socket says 172.21.15.59:52240) 2024-05-30T17:00:44.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.395+0000 7f5116000640 1 -- 172.21.15.59:0/1769717197 learned_addr learned my addr 172.21.15.59:0/1769717197 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:00:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.399+0000 7f511ea00640 1 --2- 172.21.15.59:0/1769717197 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51201558e0 0x7f51200b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.399+0000 7f511e000640 1 -- 172.21.15.59:0/1769717197 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537722412 0 0) 0x7f512006de10 con 0x7f512006f8c0 2024-05-30T17:00:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.399+0000 7f511e000640 1 -- 172.21.15.59:0/1769717197 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5104003530 con 0x7f512006f8c0 2024-05-30T17:00:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.399+0000 7f511e000640 1 -- 172.21.15.59:0/1769717197 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549930575 0 0) 0x7f512006e0f0 con 0x7f512015f690 2024-05-30T17:00:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.399+0000 7f511e000640 1 -- 172.21.15.59:0/1769717197 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f512006de10 con 0x7f512015f690 2024-05-30T17:00:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.399+0000 7f511ea00640 1 -- 172.21.15.59:0/1769717197 >> v1:172.21.15.107:6789/0 conn(0x7f512015f690 legacy=0x7f51200b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.399+0000 7f511ea00640 1 -- 172.21.15.59:0/1769717197 >> v1:172.21.15.59:6789/0 conn(0x7f512006f8c0 legacy=0x7f512015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.399+0000 7f511ea00640 1 -- 172.21.15.59:0/1769717197 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512006e6b0 con 0x7f51201558e0 2024-05-30T17:00:44.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.399+0000 7f511ea00640 1 --2- 172.21.15.59:0/1769717197 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51201558e0 0x7f51200b3e30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f51100097f0 tx=0x7f511001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611a24df726e714e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:44.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.399+0000 7f511e000640 1 -- 172.21.15.59:0/1769717197 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51100b2070 con 0x7f51201558e0 2024-05-30T17:00:44.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.399+0000 7f511e000640 1 -- 172.21.15.59:0/1769717197 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51100a9070 con 0x7f51201558e0 2024-05-30T17:00:44.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.399+0000 7f511e000640 1 -- 172.21.15.59:0/1769717197 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51100ad880 con 0x7f51201558e0 2024-05-30T17:00:44.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 -- 172.21.15.59:0/1769717197 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51201558e0 msgr2=0x7f51200b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:44.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 --2- 172.21.15.59:0/1769717197 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51201558e0 0x7f51200b3e30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f51100097f0 tx=0x7f511001c4e0 comp rx=0 tx=0).stop 2024-05-30T17:00:44.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 -- 172.21.15.59:0/1769717197 shutdown_connections 2024-05-30T17:00:44.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 --2- 172.21.15.59:0/1769717197 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51201558e0 0x7f51200b3e30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:44.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 -- 172.21.15.59:0/1769717197 >> 172.21.15.59:0/1769717197 conn(0x7f5120067d60 msgr2=0x7f512006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:44.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 -- 172.21.15.59:0/1769717197 shutdown_connections 2024-05-30T17:00:44.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 -- 172.21.15.59:0/1769717197 wait complete. 2024-05-30T17:00:44.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 Processor -- start 2024-05-30T17:00:44.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 -- start start 2024-05-30T17:00:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f512006f8c0 0x7f51200ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51201558e0 0x7f5120153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f512015f690 0x7f5120153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5120155e40 con 0x7f51201558e0 2024-05-30T17:00:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5120155cc0 con 0x7f512015f690 2024-05-30T17:00:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5125e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5120071d70 con 0x7f512006f8c0 2024-05-30T17:00:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5116000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51201558e0 0x7f5120153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5116000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51201558e0 0x7f5120153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36406/0 (socket says 172.21.15.59:36406) 2024-05-30T17:00:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5116000640 1 -- 172.21.15.59:0/3363947515 learned_addr learned my addr 172.21.15.59:0/3363947515 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f511f400640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f512015f690 0x7f5120153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f511ea00640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f512006f8c0 0x7f51200ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5116000640 1 -- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f512006f8c0 msgr2=0x7f51200ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:44.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5116000640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f512006f8c0 0x7f51200ac7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:44.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5116000640 1 -- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f512015f690 msgr2=0x7f5120153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:44.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5116000640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f512015f690 0x7f5120153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:44.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f5116000640 1 -- 172.21.15.59:0/3363947515 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5120154810 con 0x7f51201558e0 2024-05-30T17:00:44.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f511ea00640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f512006f8c0 0x7f51200ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:00:44.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.403+0000 7f511f400640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f512015f690 0x7f5120153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:00:44.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.407+0000 7f5116000640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51201558e0 0x7f5120153a50 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f510800c500 tx=0x7f510800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:44.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.407+0000 7f5117e00640 1 -- 172.21.15.59:0/3363947515 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108017070 con 0x7f51201558e0 2024-05-30T17:00:44.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.407+0000 7f5117e00640 1 -- 172.21.15.59:0/3363947515 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5108005cf0 con 0x7f51201558e0 2024-05-30T17:00:44.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.407+0000 7f5117e00640 1 -- 172.21.15.59:0/3363947515 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108007330 con 0x7f51201558e0 2024-05-30T17:00:44.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.407+0000 7f5125e00640 1 -- 172.21.15.59:0/3363947515 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5120154af0 con 0x7f51201558e0 2024-05-30T17:00:44.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.407+0000 7f5125e00640 1 -- 172.21.15.59:0/3363947515 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51200cf210 con 0x7f51201558e0 2024-05-30T17:00:44.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.407+0000 7f5125e00640 1 -- 172.21.15.59:0/3363947515 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5120068a90 con 0x7f51201558e0 2024-05-30T17:00:44.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.407+0000 7f5117e00640 1 -- 172.21.15.59:0/3363947515 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f510801a070 con 0x7f51201558e0 2024-05-30T17:00:44.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.407+0000 7f5117e00640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f50fc069730 0x7f50fc06bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:44.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.407+0000 7f5117e00640 1 -- 172.21.15.59:0/3363947515 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f5108084e80 con 0x7f51201558e0 2024-05-30T17:00:44.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.407+0000 7f511ea00640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f50fc069730 0x7f50fc06bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:44.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.411+0000 7f511ea00640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f50fc069730 0x7f50fc06bbf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f51100af000 tx=0x7f5110008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:44.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.411+0000 7f5117e00640 1 -- 172.21.15.59:0/3363947515 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5108056ae0 con 0x7f51201558e0 2024-05-30T17:00:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.635+0000 7f5125e00640 1 -- 172.21.15.59:0/3363947515 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f51200720e0 con 0x7f51201558e0 2024-05-30T17:00:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.635+0000 7f5117e00640 1 -- 172.21.15.59:0/3363947515 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2532 (secure 0 0 0) 0x7f51080563e0 con 0x7f51201558e0 2024-05-30T17:00:44.639 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:00:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 724, 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 92, 2024-05-30T17:00:44.641 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:44.642 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1565, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 6443505169, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 13695426560, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 759398686720, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 1620, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 53, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:00:44.643 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 6, 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "d", 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7449 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:44.644 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 14, 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:00:35.321003+0000", 2024-05-30T17:00:44.645 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: "d": { 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:44.646 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:44.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:44.647 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:00:44.647 INFO:teuthology.orchestra.run.smithi059.stdout: "268d3c7c-fadb-4b56-9b25-b29e80cf3ac6": { 2024-05-30T17:00:44.647 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 13.0 seconds before exiting (23s)\n [============================] ", 2024-05-30T17:00:44.647 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:00:44.647 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:00:44.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:44.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:44.647 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.639+0000 7f5125e00640 1 -- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f50fc069730 msgr2=0x7f50fc06bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.639+0000 7f5125e00640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f50fc069730 0x7f50fc06bbf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f51100af000 tx=0x7f5110008040 comp rx=0 tx=0).stop 2024-05-30T17:00:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.639+0000 7f5125e00640 1 -- 172.21.15.59:0/3363947515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51201558e0 msgr2=0x7f5120153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.639+0000 7f5125e00640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51201558e0 0x7f5120153a50 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f510800c500 tx=0x7f510800c9c0 comp rx=0 tx=0).stop 2024-05-30T17:00:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.639+0000 7f5125e00640 1 -- 172.21.15.59:0/3363947515 shutdown_connections 2024-05-30T17:00:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.639+0000 7f5125e00640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f50fc069730 0x7f50fc06bbf0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.639+0000 7f5125e00640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f512015f690 0x7f5120153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.639+0000 7f5125e00640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51201558e0 0x7f5120153a50 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.639+0000 7f5125e00640 1 --2- 172.21.15.59:0/3363947515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f512006f8c0 0x7f51200ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.639+0000 7f5125e00640 1 -- 172.21.15.59:0/3363947515 >> 172.21.15.59:0/3363947515 conn(0x7f5120067d60 msgr2=0x7f51200b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.639+0000 7f5125e00640 1 -- 172.21.15.59:0/3363947515 shutdown_connections 2024-05-30T17:00:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:44.639+0000 7f5125e00640 1 -- 172.21.15.59:0/3363947515 wait complete. 2024-05-30T17:00:49.662 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:00:49.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.811+0000 7fde24a00640 1 Processor -- start 2024-05-30T17:00:49.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.811+0000 7fde24a00640 1 -- start start 2024-05-30T17:00:49.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde24a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde2015c4a0 0x7fde200d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde24a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fde200d0230 0x7fde200d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde24a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde201610d0 con 0x7fde2015c880 2024-05-30T17:00:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde24a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fde2006c8c0 con 0x7fde2015c4a0 2024-05-30T17:00:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde24a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fde20160c40 con 0x7fde200d0230 2024-05-30T17:00:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde1f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde2015c4a0 0x7fde200d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde1f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde2015c4a0 0x7fde200d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36418/0 (socket says 172.21.15.59:36418) 2024-05-30T17:00:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde1f400640 1 -- 172.21.15.59:0/1647720535 learned_addr learned my addr 172.21.15.59:0/1647720535 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde17e00640 1 --2- 172.21.15.59:0/1647720535 >> v2:172.21.15.107:3300/0 conn(0x7fde200d0230 0x7fde200d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde1f400640 1 -- 172.21.15.59:0/1647720535 >> v2:172.21.15.107:3300/0 conn(0x7fde200d0230 msgr2=0x7fde200d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde1f400640 1 --2- 172.21.15.59:0/1647720535 >> v2:172.21.15.107:3300/0 conn(0x7fde200d0230 0x7fde200d0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde1f400640 1 -- 172.21.15.59:0/1647720535 >> v1:172.21.15.107:6789/0 conn(0x7fde2015c880 legacy=0x7fde200ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.815+0000 7fde1f400640 1 -- 172.21.15.59:0/1647720535 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde20160310 con 0x7fde2015c4a0 2024-05-30T17:00:49.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde1f400640 1 --2- 172.21.15.59:0/1647720535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde2015c4a0 0x7fde200d0730 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fde20160140 tx=0x7fde1001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7764e5732758f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:49.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde1ea00640 1 -- 172.21.15.59:0/1647720535 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde100b1070 con 0x7fde2015c4a0 2024-05-30T17:00:49.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde1ea00640 1 -- 172.21.15.59:0/1647720535 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde100ac630 con 0x7fde2015c4a0 2024-05-30T17:00:49.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde1ea00640 1 -- 172.21.15.59:0/1647720535 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde100a8050 con 0x7fde2015c4a0 2024-05-30T17:00:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 -- 172.21.15.59:0/1647720535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde2015c4a0 msgr2=0x7fde200d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 --2- 172.21.15.59:0/1647720535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde2015c4a0 0x7fde200d0730 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fde20160140 tx=0x7fde1001c3d0 comp rx=0 tx=0).stop 2024-05-30T17:00:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 -- 172.21.15.59:0/1647720535 shutdown_connections 2024-05-30T17:00:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 --2- 172.21.15.59:0/1647720535 >> v2:172.21.15.107:3300/0 conn(0x7fde200d0230 0x7fde200d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 --2- 172.21.15.59:0/1647720535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde2015c4a0 0x7fde200d0730 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 -- 172.21.15.59:0/1647720535 >> 172.21.15.59:0/1647720535 conn(0x7fde2009aa40 msgr2=0x7fde200d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 -- 172.21.15.59:0/1647720535 shutdown_connections 2024-05-30T17:00:49.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 -- 172.21.15.59:0/1647720535 wait complete. 2024-05-30T17:00:49.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 Processor -- start 2024-05-30T17:00:49.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 -- start start 2024-05-30T17:00:49.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde200d0230 0x7fde2006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde2015c4a0 0x7fde20158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2015c880 0x7fde20153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fde20169580 con 0x7fde200d0230 2024-05-30T17:00:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fde200ce170 con 0x7fde2015c4a0 2024-05-30T17:00:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde24a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fde20169700 con 0x7fde2015c880 2024-05-30T17:00:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde1f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde200d0230 0x7fde2006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde1f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde200d0230 0x7fde2006fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36422/0 (socket says 172.21.15.59:36422) 2024-05-30T17:00:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.819+0000 7fde1f400640 1 -- 172.21.15.59:0/3010702700 learned_addr learned my addr 172.21.15.59:0/3010702700 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde17e00640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde2015c4a0 0x7fde20158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde1fe00640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2015c880 0x7fde20153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde1f400640 1 -- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2015c880 msgr2=0x7fde20153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde1f400640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2015c880 0x7fde20153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:49.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde1f400640 1 -- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde2015c4a0 msgr2=0x7fde20158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:49.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde1f400640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde2015c4a0 0x7fde20158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:49.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde1f400640 1 -- 172.21.15.59:0/3010702700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde20153c80 con 0x7fde200d0230 2024-05-30T17:00:49.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde17e00640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde2015c4a0 0x7fde20158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:00:49.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde1f400640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde200d0230 0x7fde2006fde0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fde100af040 tx=0x7fde1001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:49.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde17400640 1 -- 172.21.15.59:0/3010702700 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde100bb020 con 0x7fde200d0230 2024-05-30T17:00:49.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde17400640 1 -- 172.21.15.59:0/3010702700 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde100b7420 con 0x7fde200d0230 2024-05-30T17:00:49.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde17400640 1 -- 172.21.15.59:0/3010702700 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde100b1040 con 0x7fde200d0230 2024-05-30T17:00:49.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde24a00640 1 -- 172.21.15.59:0/3010702700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde20153f60 con 0x7fde200d0230 2024-05-30T17:00:49.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde24a00640 1 -- 172.21.15.59:0/3010702700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde20154520 con 0x7fde200d0230 2024-05-30T17:00:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde24a00640 1 -- 172.21.15.59:0/3010702700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde20068a90 con 0x7fde200d0230 2024-05-30T17:00:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.823+0000 7fde17400640 1 -- 172.21.15.59:0/3010702700 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7fde100be020 con 0x7fde200d0230 2024-05-30T17:00:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.827+0000 7fde17400640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddfc069730 0x7fddfc06bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.827+0000 7fde17400640 1 -- 172.21.15.59:0/3010702700 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7fde1011f860 con 0x7fde200d0230 2024-05-30T17:00:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.827+0000 7fde17e00640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddfc069730 0x7fddfc06bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:49.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.827+0000 7fde17e00640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddfc069730 0x7fddfc06bbf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fde201596f0 tx=0x7fde08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:49.831+0000 7fde17400640 1 -- 172.21.15.59:0/3010702700 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fde10016110 con 0x7fde200d0230 2024-05-30T17:00:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.055+0000 7fde24a00640 1 -- 172.21.15.59:0/3010702700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fde200b72a0 con 0x7fde200d0230 2024-05-30T17:00:50.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde17400640 1 -- 172.21.15.59:0/3010702700 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1984 (secure 0 0 0) 0x7fde100f1870 con 0x7fde200d0230 2024-05-30T17:00:50.060 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:00:50.060 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:50.060 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:00:50.060 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:00:50.060 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:50.061 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 730, 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 92, 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:00:50.062 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1565, 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 6443505169, 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 13695426560, 2024-05-30T17:00:50.063 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 759398686720, 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 53, 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6, 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 6, 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "d", 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:00:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7449 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:50.065 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 15, 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:00:45.324121+0000", 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: "268d3c7c-fadb-4b56-9b25-b29e80cf3ac6": { 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 7.0 seconds before exiting (29s)\n [============================] ", 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:50.067 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde24a00640 1 -- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddfc069730 msgr2=0x7fddfc06bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde24a00640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddfc069730 0x7fddfc06bbf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fde201596f0 tx=0x7fde08008040 comp rx=0 tx=0).stop 2024-05-30T17:00:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde24a00640 1 -- 172.21.15.59:0/3010702700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde200d0230 msgr2=0x7fde2006fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde24a00640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde200d0230 0x7fde2006fde0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fde100af040 tx=0x7fde1001ac10 comp rx=0 tx=0).stop 2024-05-30T17:00:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde24a00640 1 -- 172.21.15.59:0/3010702700 shutdown_connections 2024-05-30T17:00:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde24a00640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddfc069730 0x7fddfc06bbf0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde24a00640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2015c880 0x7fde20153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde24a00640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde2015c4a0 0x7fde20158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde24a00640 1 --2- 172.21.15.59:0/3010702700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde200d0230 0x7fde2006fde0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde24a00640 1 -- 172.21.15.59:0/3010702700 >> 172.21.15.59:0/3010702700 conn(0x7fde2009aa40 msgr2=0x7fde200d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde24a00640 1 -- 172.21.15.59:0/3010702700 shutdown_connections 2024-05-30T17:00:50.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:50.059+0000 7fde24a00640 1 -- 172.21.15.59:0/3010702700 wait complete. 2024-05-30T17:00:55.083 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:00:55.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa66e00640 1 Processor -- start 2024-05-30T17:00:55.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa66e00640 1 -- start start 2024-05-30T17:00:55.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa66e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa600b0080 0x7faa6006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:55.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa66e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faa60162a30 0x7faa6006e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:55.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa66e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6006c200 con 0x7faa600b3ce0 2024-05-30T17:00:55.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa66e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7faa6006c4e0 con 0x7faa60162a30 2024-05-30T17:00:55.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa66e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa6006c7c0 con 0x7faa600b0080 2024-05-30T17:00:55.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa5fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa600b0080 0x7faa6006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:55.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa64e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faa60162a30 0x7faa6006e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:55.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa64e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faa60162a30 0x7faa6006e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:53526/0 (socket says 172.21.15.59:53526) 2024-05-30T17:00:55.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa64e00640 1 -- 172.21.15.59:0/707092485 learned_addr learned my addr 172.21.15.59:0/707092485 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:55.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa64e00640 1 -- 172.21.15.59:0/707092485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa600b0080 msgr2=0x7faa6006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:00:55.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa64e00640 1 --2- 172.21.15.59:0/707092485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa600b0080 0x7faa6006b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:55.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa64e00640 1 -- 172.21.15.59:0/707092485 >> v1:172.21.15.107:6789/0 conn(0x7faa600b3ce0 legacy=0x7faa60162320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:55.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.231+0000 7faa64e00640 1 -- 172.21.15.59:0/707092485 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6006caa0 con 0x7faa60162a30 2024-05-30T17:00:55.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.235+0000 7faa64e00640 1 --2- 172.21.15.59:0/707092485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa60162a30 0x7faa6006e820 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faa58009e80 tx=0x7faa5801f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d0bec085f3be996 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:55.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.235+0000 7faa5ea00640 1 -- 172.21.15.59:0/707092485 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa580b4070 con 0x7faa60162a30 2024-05-30T17:00:55.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.235+0000 7faa5ea00640 1 -- 172.21.15.59:0/707092485 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa580af400 con 0x7faa60162a30 2024-05-30T17:00:55.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.235+0000 7faa5ea00640 1 -- 172.21.15.59:0/707092485 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa580af7d0 con 0x7faa60162a30 2024-05-30T17:00:55.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.235+0000 7faa66e00640 1 -- 172.21.15.59:0/707092485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa60162a30 msgr2=0x7faa6006e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:55.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.235+0000 7faa66e00640 1 --2- 172.21.15.59:0/707092485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa60162a30 0x7faa6006e820 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faa58009e80 tx=0x7faa5801f200 comp rx=0 tx=0).stop 2024-05-30T17:00:55.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.235+0000 7faa66e00640 1 -- 172.21.15.59:0/707092485 shutdown_connections 2024-05-30T17:00:55.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.235+0000 7faa66e00640 1 --2- 172.21.15.59:0/707092485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa60162a30 0x7faa6006e820 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:55.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.235+0000 7faa66e00640 1 --2- 172.21.15.59:0/707092485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa600b0080 0x7faa6006b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:55.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.235+0000 7faa66e00640 1 -- 172.21.15.59:0/707092485 >> 172.21.15.59:0/707092485 conn(0x7faa600d0b10 msgr2=0x7faa600d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:55.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.235+0000 7faa66e00640 1 -- 172.21.15.59:0/707092485 shutdown_connections 2024-05-30T17:00:55.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.235+0000 7faa66e00640 1 -- 172.21.15.59:0/707092485 wait complete. 2024-05-30T17:00:55.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa66e00640 1 Processor -- start 2024-05-30T17:00:55.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa66e00640 1 -- start start 2024-05-30T17:00:55.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa66e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa600b0080 0x7faa601f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:55.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa66e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa600b3ce0 0x7faa60155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa66e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa60162a30 0x7faa601573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa66e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faa6006bef0 con 0x7faa600b3ce0 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa66e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faa6006d2a0 con 0x7faa600b0080 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa66e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa600b0460 con 0x7faa60162a30 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa5f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa600b3ce0 0x7faa60155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa5f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa600b3ce0 0x7faa60155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44306/0 (socket says 172.21.15.59:44306) 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa5f400640 1 -- 172.21.15.59:0/2517033564 learned_addr learned my addr 172.21.15.59:0/2517033564 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa5fe00640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa600b0080 0x7faa601f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa64e00640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa60162a30 0x7faa601573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa5f400640 1 -- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa60162a30 msgr2=0x7faa601573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa5f400640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa60162a30 0x7faa601573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa5f400640 1 -- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa600b0080 msgr2=0x7faa601f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:55.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa5f400640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa600b0080 0x7faa601f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:55.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa5f400640 1 -- 172.21.15.59:0/2517033564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa60159500 con 0x7faa600b3ce0 2024-05-30T17:00:55.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa5f400640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa600b3ce0 0x7faa60155ad0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00c420 tx=0x7faa4c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:55.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa57e00640 1 -- 172.21.15.59:0/2517033564 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c0052d0 con 0x7faa600b3ce0 2024-05-30T17:00:55.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa57e00640 1 -- 172.21.15.59:0/2517033564 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4c005470 con 0x7faa600b3ce0 2024-05-30T17:00:55.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa57e00640 1 -- 172.21.15.59:0/2517033564 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c007260 con 0x7faa600b3ce0 2024-05-30T17:00:55.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa66e00640 1 -- 172.21.15.59:0/2517033564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa601f55e0 con 0x7faa600b3ce0 2024-05-30T17:00:55.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa66e00640 1 -- 172.21.15.59:0/2517033564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa60156010 con 0x7faa600b3ce0 2024-05-30T17:00:55.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.239+0000 7faa66e00640 1 -- 172.21.15.59:0/2517033564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa60068a90 con 0x7faa600b3ce0 2024-05-30T17:00:55.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.243+0000 7faa57e00640 1 -- 172.21.15.59:0/2517033564 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7faa4c007400 con 0x7faa600b3ce0 2024-05-30T17:00:55.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.243+0000 7faa57e00640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faa40069760 0x7faa4006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:00:55.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.243+0000 7faa57e00640 1 -- 172.21.15.59:0/2517033564 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7faa4c084a70 con 0x7faa600b3ce0 2024-05-30T17:00:55.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.243+0000 7faa5fe00640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faa40069760 0x7faa4006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:00:55.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.243+0000 7faa5fe00640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faa40069760 0x7faa4006bc20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faa50009b60 tx=0x7faa50009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:00:55.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.247+0000 7faa57e00640 1 -- 172.21.15.59:0/2517033564 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faa4c056430 con 0x7faa600b3ce0 2024-05-30T17:00:55.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.471+0000 7faa66e00640 1 -- 172.21.15.59:0/2517033564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7faa6006e3d0 con 0x7faa600b3ce0 2024-05-30T17:00:55.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.471+0000 7faa57e00640 1 -- 172.21.15.59:0/2517033564 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1984 (secure 0 0 0) 0x7faa4c05a730 con 0x7faa600b3ce0 2024-05-30T17:00:55.474 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:00:55.474 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:00:55.474 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:00:55.474 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:00:55.474 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:00:55.474 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:00:55.474 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:00:55.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:55.475 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:00:55.475 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:00:55.475 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:00:55.475 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:00:55.475 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:00:55.475 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:55.475 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:00:55.475 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:00:55.475 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:00:55.475 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:00:55.475 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:55.475 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 735, 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 92, 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:00:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1565, 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 6443505169, 2024-05-30T17:00:55.477 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 13695426560, 2024-05-30T17:00:55.478 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 759398686720, 2024-05-30T17:00:55.478 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280 2024-05-30T17:00:55.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:55.478 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:00:55.478 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 53, 2024-05-30T17:00:55.478 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6, 2024-05-30T17:00:55.478 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:00:55.478 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:00:55.478 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:00:55.478 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:00:55.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:00:55.478 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 6, 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "d", 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7449 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:00:55.479 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 15, 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:00:45.324121+0000", 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: "268d3c7c-fadb-4b56-9b25-b29e80cf3ac6": { 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 3.0 seconds before exiting (33s)\n [============================] ", 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:00:55.481 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:55.481 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:00:55.481 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:00:55.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.471+0000 7faa66e00640 1 -- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faa40069760 msgr2=0x7faa4006bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:55.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.471+0000 7faa66e00640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faa40069760 0x7faa4006bc20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faa50009b60 tx=0x7faa50009190 comp rx=0 tx=0).stop 2024-05-30T17:00:55.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.471+0000 7faa66e00640 1 -- 172.21.15.59:0/2517033564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa600b3ce0 msgr2=0x7faa60155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:00:55.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.471+0000 7faa66e00640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa600b3ce0 0x7faa60155ad0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00c420 tx=0x7faa4c00c8e0 comp rx=0 tx=0).stop 2024-05-30T17:00:55.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.471+0000 7faa66e00640 1 -- 172.21.15.59:0/2517033564 shutdown_connections 2024-05-30T17:00:55.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.471+0000 7faa66e00640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faa40069760 0x7faa4006bc20 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:55.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.471+0000 7faa66e00640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa60162a30 0x7faa601573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:55.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.471+0000 7faa66e00640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa600b3ce0 0x7faa60155ad0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:55.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.471+0000 7faa66e00640 1 --2- 172.21.15.59:0/2517033564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa600b0080 0x7faa601f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:00:55.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.475+0000 7faa66e00640 1 -- 172.21.15.59:0/2517033564 >> 172.21.15.59:0/2517033564 conn(0x7faa600d0b10 msgr2=0x7faa600d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:00:55.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.475+0000 7faa66e00640 1 -- 172.21.15.59:0/2517033564 shutdown_connections 2024-05-30T17:00:55.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:00:55.475+0000 7faa66e00640 1 -- 172.21.15.59:0/2517033564 wait complete. 2024-05-30T17:01:00.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:01:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.635+0000 7fb150800640 1 Processor -- start 2024-05-30T17:01:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.635+0000 7fb150800640 1 -- start start 2024-05-30T17:01:00.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.635+0000 7fb150800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb148146000 0x7fb1481600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:00.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.635+0000 7fb150800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb148160610 0x7fb1480b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:00.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.635+0000 7fb150800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1480b3c20 con 0x7fb1480b4c20 2024-05-30T17:01:00.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.635+0000 7fb150800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb14815ce50 con 0x7fb148146000 2024-05-30T17:01:00.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.635+0000 7fb150800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb148160c40 con 0x7fb148160610 2024-05-30T17:01:00.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.635+0000 7fb14de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb148146000 0x7fb1481600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:00.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.635+0000 7fb14de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb148146000 0x7fb1481600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:53554/0 (socket says 172.21.15.59:53554) 2024-05-30T17:01:00.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.635+0000 7fb14d400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb148160610 0x7fb1480b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:00.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.635+0000 7fb14de00640 1 -- 172.21.15.59:0/1824783586 learned_addr learned my addr 172.21.15.59:0/1824783586 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:00.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.639+0000 7fb14de00640 1 -- 172.21.15.59:0/1824783586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb148160610 msgr2=0x7fb1480b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:00.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.639+0000 7fb14de00640 1 --2- 172.21.15.59:0/1824783586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb148160610 0x7fb1480b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:00.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.639+0000 7fb14de00640 1 -- 172.21.15.59:0/1824783586 >> v1:172.21.15.107:6789/0 conn(0x7fb1480b4c20 legacy=0x7fb1480cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:00.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.639+0000 7fb14de00640 1 -- 172.21.15.59:0/1824783586 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb148160f20 con 0x7fb148146000 2024-05-30T17:01:00.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.639+0000 7fb14d400640 1 --2- 172.21.15.59:0/1824783586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb148160610 0x7fb1480b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:01:00.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.639+0000 7fb14de00640 1 --2- 172.21.15.59:0/1824783586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb148146000 0x7fb1481600d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009870 tx=0x7fb13c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67e17fdaeb9db91b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:00.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.639+0000 7fb14ca00640 1 -- 172.21.15.59:0/1824783586 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0b2070 con 0x7fb148146000 2024-05-30T17:01:00.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.639+0000 7fb14ca00640 1 -- 172.21.15.59:0/1824783586 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13c0a9070 con 0x7fb148146000 2024-05-30T17:01:00.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.639+0000 7fb14ca00640 1 -- 172.21.15.59:0/1824783586 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0ad880 con 0x7fb148146000 2024-05-30T17:01:00.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.639+0000 7fb150800640 1 -- 172.21.15.59:0/1824783586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb148146000 msgr2=0x7fb1481600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:00.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.639+0000 7fb150800640 1 --2- 172.21.15.59:0/1824783586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb148146000 0x7fb1481600d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009870 tx=0x7fb13c01c560 comp rx=0 tx=0).stop 2024-05-30T17:01:00.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 -- 172.21.15.59:0/1824783586 shutdown_connections 2024-05-30T17:01:00.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 --2- 172.21.15.59:0/1824783586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb148160610 0x7fb1480b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:00.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 --2- 172.21.15.59:0/1824783586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb148146000 0x7fb1481600d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:00.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 -- 172.21.15.59:0/1824783586 >> 172.21.15.59:0/1824783586 conn(0x7fb148067d60 msgr2=0x7fb14806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:00.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 -- 172.21.15.59:0/1824783586 shutdown_connections 2024-05-30T17:01:00.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 -- 172.21.15.59:0/1824783586 wait complete. 2024-05-30T17:01:00.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 Processor -- start 2024-05-30T17:01:00.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 -- start start 2024-05-30T17:01:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1480b4c20 0x7fb1480ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb148146000 0x7fb14812eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb148160610 0x7fb1480aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb148169800 con 0x7fb1480b4c20 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb148169680 con 0x7fb148160610 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb150800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb148169980 con 0x7fb148146000 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb14de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1480b4c20 0x7fb1480ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb14de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1480b4c20 0x7fb1480ac180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44312/0 (socket says 172.21.15.59:44312) 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb14de00640 1 -- 172.21.15.59:0/4132891294 learned_addr learned my addr 172.21.15.59:0/4132891294 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb14d400640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb148146000 0x7fb14812eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb14e800640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb148160610 0x7fb1480aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb14de00640 1 -- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb148146000 msgr2=0x7fb14812eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb14de00640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb148146000 0x7fb14812eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb14de00640 1 -- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb148160610 msgr2=0x7fb1480aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb14de00640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb148160610 0x7fb1480aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb14de00640 1 -- 172.21.15.59:0/4132891294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14806f520 con 0x7fb1480b4c20 2024-05-30T17:01:00.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.643+0000 7fb14de00640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1480b4c20 0x7fb1480ac180 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0b0040 tx=0x7fb13c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:00.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.647+0000 7fb142000640 1 -- 172.21.15.59:0/4132891294 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0b2040 con 0x7fb1480b4c20 2024-05-30T17:01:00.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.647+0000 7fb142000640 1 -- 172.21.15.59:0/4132891294 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13c0adae0 con 0x7fb1480b4c20 2024-05-30T17:01:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.647+0000 7fb142000640 1 -- 172.21.15.59:0/4132891294 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0b6440 con 0x7fb1480b4c20 2024-05-30T17:01:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.647+0000 7fb150800640 1 -- 172.21.15.59:0/4132891294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1480ae030 con 0x7fb1480b4c20 2024-05-30T17:01:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.647+0000 7fb150800640 1 -- 172.21.15.59:0/4132891294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1480ae5f0 con 0x7fb1480b4c20 2024-05-30T17:01:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.647+0000 7fb150800640 1 -- 172.21.15.59:0/4132891294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb148068a90 con 0x7fb1480b4c20 2024-05-30T17:01:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.647+0000 7fb142000640 1 -- 172.21.15.59:0/4132891294 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7fb13c0bd020 con 0x7fb1480b4c20 2024-05-30T17:01:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.647+0000 7fb142000640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb12c069730 0x7fb12c06bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.647+0000 7fb142000640 1 -- 172.21.15.59:0/4132891294 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7fb13c11ec80 con 0x7fb1480b4c20 2024-05-30T17:01:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.647+0000 7fb14d400640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb12c069730 0x7fb12c06bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.651+0000 7fb14d400640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb12c069730 0x7fb12c06bbf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb138009580 tx=0x7fb138009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:00.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.651+0000 7fb142000640 1 -- 172.21.15.59:0/4132891294 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb13c0c4020 con 0x7fb1480b4c20 2024-05-30T17:01:00.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.875+0000 7fb150800640 1 -- 172.21.15.59:0/4132891294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb1480b3490 con 0x7fb1480b4c20 2024-05-30T17:01:00.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.875+0000 7fb142000640 1 -- 172.21.15.59:0/4132891294 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1730 (secure 0 0 0) 0x7fb13c016150 con 0x7fb1480b4c20 2024-05-30T17:01:00.879 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:00.879 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:01:00.879 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:01:00.879 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:01:00.879 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:01:00.879 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:01:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 740, 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 92, 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:01:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1565, 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 6443505169, 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 13695426560, 2024-05-30T17:01:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 759398686720, 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 53, 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6, 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 6, 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "d", 2024-05-30T17:01:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7449 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:01:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:01:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 15, 2024-05-30T17:01:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:00:45.324121+0000", 2024-05-30T17:01:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:01:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": {} 2024-05-30T17:01:00.885 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:01:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.879+0000 7fb150800640 1 -- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb12c069730 msgr2=0x7fb12c06bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.879+0000 7fb150800640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb12c069730 0x7fb12c06bbf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb138009580 tx=0x7fb138009190 comp rx=0 tx=0).stop 2024-05-30T17:01:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.879+0000 7fb150800640 1 -- 172.21.15.59:0/4132891294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1480b4c20 msgr2=0x7fb1480ac180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.879+0000 7fb150800640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1480b4c20 0x7fb1480ac180 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0b0040 tx=0x7fb13c019300 comp rx=0 tx=0).stop 2024-05-30T17:01:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.879+0000 7fb150800640 1 -- 172.21.15.59:0/4132891294 shutdown_connections 2024-05-30T17:01:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.879+0000 7fb150800640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb12c069730 0x7fb12c06bbf0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.879+0000 7fb150800640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb148160610 0x7fb1480aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.879+0000 7fb150800640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb148146000 0x7fb14812eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.879+0000 7fb150800640 1 --2- 172.21.15.59:0/4132891294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1480b4c20 0x7fb1480ac180 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.879+0000 7fb150800640 1 -- 172.21.15.59:0/4132891294 >> 172.21.15.59:0/4132891294 conn(0x7fb148067d60 msgr2=0x7fb1480cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.879+0000 7fb150800640 1 -- 172.21.15.59:0/4132891294 shutdown_connections 2024-05-30T17:01:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:00.879+0000 7fb150800640 1 -- 172.21.15.59:0/4132891294 wait complete. 2024-05-30T17:01:00.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T17:01:01.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa572e00640 1 Processor -- start 2024-05-30T17:01:01.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa572e00640 1 -- start start 2024-05-30T17:01:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa572e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa56c141f20 0x7fa56c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa572e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa56c06bce0 0x7fa56c06c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa572e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56c163260 con 0x7fa56c0c9e10 2024-05-30T17:01:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa572e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa56c1626e0 con 0x7fa56c06bce0 2024-05-30T17:01:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa572e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa56c1629c0 con 0x7fa56c141f20 2024-05-30T17:01:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa570e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa56c06bce0 0x7fa56c06c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa570e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa56c06bce0 0x7fa56c06c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44328/0 (socket says 172.21.15.59:44328) 2024-05-30T17:01:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa570e00640 1 -- 172.21.15.59:0/4128216748 learned_addr learned my addr 172.21.15.59:0/4128216748 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa563e00640 1 --2- 172.21.15.59:0/4128216748 >> v2:172.21.15.107:3300/0 conn(0x7fa56c141f20 0x7fa56c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa570e00640 1 -- 172.21.15.59:0/4128216748 >> v2:172.21.15.107:3300/0 conn(0x7fa56c141f20 msgr2=0x7fa56c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa570e00640 1 --2- 172.21.15.59:0/4128216748 >> v2:172.21.15.107:3300/0 conn(0x7fa56c141f20 0x7fa56c06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa570e00640 1 -- 172.21.15.59:0/4128216748 >> v1:172.21.15.107:6789/0 conn(0x7fa56c0c9e10 legacy=0x7fa56c0ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.043+0000 7fa570e00640 1 -- 172.21.15.59:0/4128216748 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c162ca0 con 0x7fa56c06bce0 2024-05-30T17:01:01.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.047+0000 7fa570e00640 1 --2- 172.21.15.59:0/4128216748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa56c06bce0 0x7fa56c06c110 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0cb0a0 tx=0x7fa56401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faebf88dc86a5691 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.047+0000 7fa56b400640 1 -- 172.21.15.59:0/4128216748 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5640a5590 con 0x7fa56c06bce0 2024-05-30T17:01:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.047+0000 7fa56b400640 1 -- 172.21.15.59:0/4128216748 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5640a5730 con 0x7fa56c06bce0 2024-05-30T17:01:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.047+0000 7fa56b400640 1 -- 172.21.15.59:0/4128216748 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5640a5b00 con 0x7fa56c06bce0 2024-05-30T17:01:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.047+0000 7fa572e00640 1 -- 172.21.15.59:0/4128216748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa56c06bce0 msgr2=0x7fa56c06c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.047+0000 7fa572e00640 1 --2- 172.21.15.59:0/4128216748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa56c06bce0 0x7fa56c06c110 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0cb0a0 tx=0x7fa56401c8d0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.047+0000 7fa572e00640 1 -- 172.21.15.59:0/4128216748 shutdown_connections 2024-05-30T17:01:01.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.047+0000 7fa572e00640 1 --2- 172.21.15.59:0/4128216748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa56c06bce0 0x7fa56c06c110 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.047+0000 7fa572e00640 1 --2- 172.21.15.59:0/4128216748 >> v2:172.21.15.107:3300/0 conn(0x7fa56c141f20 0x7fa56c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.047+0000 7fa572e00640 1 -- 172.21.15.59:0/4128216748 >> 172.21.15.59:0/4128216748 conn(0x7fa56c0cd540 msgr2=0x7fa56c0cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:01.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.047+0000 7fa572e00640 1 -- 172.21.15.59:0/4128216748 shutdown_connections 2024-05-30T17:01:01.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.047+0000 7fa572e00640 1 -- 172.21.15.59:0/4128216748 wait complete. 2024-05-30T17:01:01.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa572e00640 1 Processor -- start 2024-05-30T17:01:01.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa572e00640 1 -- start start 2024-05-30T17:01:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa572e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa56c06bce0 0x7fa56c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa572e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa56c0c9e10 0x7fa56c15ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa572e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa56c141f20 0x7fa56c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa572e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c162480 con 0x7fa56c06bce0 2024-05-30T17:01:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa572e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c162300 con 0x7fa56c141f20 2024-05-30T17:01:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa572e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa56c0cd1d0 con 0x7fa56c0c9e10 2024-05-30T17:01:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa56be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa56c06bce0 0x7fa56c0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa56be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa56c06bce0 0x7fa56c0b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44342/0 (socket says 172.21.15.59:44342) 2024-05-30T17:01:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa56be00640 1 -- 172.21.15.59:0/3643541725 learned_addr learned my addr 172.21.15.59:0/3643541725 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa570e00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa56c141f20 0x7fa56c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa563e00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa56c0c9e10 0x7fa56c15ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa56be00640 1 -- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa56c0c9e10 msgr2=0x7fa56c15ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa56be00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa56c0c9e10 0x7fa56c15ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa56be00640 1 -- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa56c141f20 msgr2=0x7fa56c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa56be00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa56c141f20 0x7fa56c15f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa56be00640 1 -- 172.21.15.59:0/3643541725 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c15e4e0 con 0x7fa56c06bce0 2024-05-30T17:01:01.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa56be00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa56c06bce0 0x7fa56c0b1980 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00c370 tx=0x7fa55c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:01.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa568c00640 1 -- 172.21.15.59:0/3643541725 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0052d0 con 0x7fa56c06bce0 2024-05-30T17:01:01.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa568c00640 1 -- 172.21.15.59:0/3643541725 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55c005470 con 0x7fa56c06bce0 2024-05-30T17:01:01.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa568c00640 1 -- 172.21.15.59:0/3643541725 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c007260 con 0x7fa56c06bce0 2024-05-30T17:01:01.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa572e00640 1 -- 172.21.15.59:0/3643541725 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56c15f790 con 0x7fa56c06bce0 2024-05-30T17:01:01.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa572e00640 1 -- 172.21.15.59:0/3643541725 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56c15fd50 con 0x7fa56c06bce0 2024-05-30T17:01:01.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.051+0000 7fa572e00640 1 -- 172.21.15.59:0/3643541725 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa56c068a90 con 0x7fa56c06bce0 2024-05-30T17:01:01.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.055+0000 7fa568c00640 1 -- 172.21.15.59:0/3643541725 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7fa55c007400 con 0x7fa56c06bce0 2024-05-30T17:01:01.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.055+0000 7fa568c00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa548069730 0x7fa54806bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.055+0000 7fa568c00640 1 -- 172.21.15.59:0/3643541725 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7fa55c084a50 con 0x7fa56c06bce0 2024-05-30T17:01:01.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.055+0000 7fa563e00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa548069730 0x7fa54806bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.055+0000 7fa563e00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa548069730 0x7fa54806bbf0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa56c1fb270 tx=0x7fa554008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:01.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.059+0000 7fa568c00640 1 -- 172.21.15.59:0/3643541725 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa56c15e4e0 con 0x7fa56c06bce0 2024-05-30T17:01:01.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.251+0000 7fa572e00640 1 -- 172.21.15.59:0/3643541725 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa56c069210 con 0x7fa548069730 2024-05-30T17:01:01.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.255+0000 7fa568c00640 1 -- 172.21.15.59:0/3643541725 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+79 (secure 0 0 0) 0x7fa56c069210 con 0x7fa548069730 2024-05-30T17:01:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:01.259 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:01:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sv1" 2024-05-30T17:01:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ss1clone1" 2024-05-30T17:01:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:01.259 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:01:01.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.259+0000 7fa572e00640 1 -- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa548069730 msgr2=0x7fa54806bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.259+0000 7fa572e00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa548069730 0x7fa54806bbf0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa56c1fb270 tx=0x7fa554008040 comp rx=0 tx=0).stop 2024-05-30T17:01:01.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.259+0000 7fa572e00640 1 -- 172.21.15.59:0/3643541725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa56c06bce0 msgr2=0x7fa56c0b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.259+0000 7fa572e00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa56c06bce0 0x7fa56c0b1980 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00c370 tx=0x7fa55c00c830 comp rx=0 tx=0).stop 2024-05-30T17:01:01.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.259+0000 7fa572e00640 1 -- 172.21.15.59:0/3643541725 shutdown_connections 2024-05-30T17:01:01.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.259+0000 7fa572e00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa548069730 0x7fa54806bbf0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.259+0000 7fa572e00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa56c141f20 0x7fa56c15f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.259+0000 7fa572e00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa56c0c9e10 0x7fa56c15ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.259+0000 7fa572e00640 1 --2- 172.21.15.59:0/3643541725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa56c06bce0 0x7fa56c0b1980 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.259+0000 7fa572e00640 1 -- 172.21.15.59:0/3643541725 >> 172.21.15.59:0/3643541725 conn(0x7fa56c0cd540 msgr2=0x7fa56c142440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:01.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.259+0000 7fa572e00640 1 -- 172.21.15.59:0/3643541725 shutdown_connections 2024-05-30T17:01:01.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.259+0000 7fa572e00640 1 -- 172.21.15.59:0/3643541725 wait complete. 2024-05-30T17:01:01.281 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T17:01:01.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.423+0000 7f0043600640 1 Processor -- start 2024-05-30T17:01:01.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.423+0000 7f0043600640 1 -- start start 2024-05-30T17:01:01.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.423+0000 7f0043600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c161e20 0x7f003c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0043600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f003c06cf00 0x7f003c162a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0043600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f003c0b3d50 con 0x7f003c0730e0 2024-05-30T17:01:01.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0043600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f003c0b4030 con 0x7f003c06cf00 2024-05-30T17:01:01.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0043600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f003c06e7c0 con 0x7f003c161e20 2024-05-30T17:01:01.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0033e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f003c0730e0 0x7f003c162310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45216/0 (socket says 172.21.15.59:45216) 2024-05-30T17:01:01.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0033e00640 1 -- 172.21.15.59:0/1990503636 learned_addr learned my addr 172.21.15.59:0/1990503636 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:01.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0041600640 1 --2- 172.21.15.59:0/1990503636 >> v2:172.21.15.107:3300/0 conn(0x7f003c06cf00 0x7f003c162a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0040c00640 1 --2- 172.21.15.59:0/1990503636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c161e20 0x7f003c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f003be00640 1 -- 172.21.15.59:0/1990503636 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142175892 0 0) 0x7f003c0b3d50 con 0x7f003c0730e0 2024-05-30T17:01:01.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f003be00640 1 -- 172.21.15.59:0/1990503636 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0020003530 con 0x7f003c0730e0 2024-05-30T17:01:01.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0040c00640 1 -- 172.21.15.59:0/1990503636 >> v2:172.21.15.107:3300/0 conn(0x7f003c06cf00 msgr2=0x7f003c162a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:01.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0040c00640 1 --2- 172.21.15.59:0/1990503636 >> v2:172.21.15.107:3300/0 conn(0x7f003c06cf00 0x7f003c162a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0040c00640 1 -- 172.21.15.59:0/1990503636 >> v1:172.21.15.59:6789/0 conn(0x7f003c0730e0 legacy=0x7f003c162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0040c00640 1 -- 172.21.15.59:0/1990503636 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c06eaa0 con 0x7f003c161e20 2024-05-30T17:01:01.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0041600640 1 --2- 172.21.15.59:0/1990503636 >> v2:172.21.15.107:3300/0 conn(0x7f003c06cf00 0x7f003c162a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:01:01.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.427+0000 7f0040c00640 1 --2- 172.21.15.59:0/1990503636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c161e20 0x7f003c06c9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f002c0097c0 tx=0x7f002c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3f64c518e4289d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f003be00640 1 -- 172.21.15.59:0/1990503636 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c0b5070 con 0x7f003c161e20 2024-05-30T17:01:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f003be00640 1 -- 172.21.15.59:0/1990503636 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002c0a8990 con 0x7f003c161e20 2024-05-30T17:01:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f003be00640 1 -- 172.21.15.59:0/1990503636 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c0a8d60 con 0x7f003c161e20 2024-05-30T17:01:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 -- 172.21.15.59:0/1990503636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c161e20 msgr2=0x7f003c06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 --2- 172.21.15.59:0/1990503636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c161e20 0x7f003c06c9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f002c0097c0 tx=0x7f002c01ec90 comp rx=0 tx=0).stop 2024-05-30T17:01:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 -- 172.21.15.59:0/1990503636 shutdown_connections 2024-05-30T17:01:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 --2- 172.21.15.59:0/1990503636 >> v2:172.21.15.107:3300/0 conn(0x7f003c06cf00 0x7f003c162a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 --2- 172.21.15.59:0/1990503636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c161e20 0x7f003c06c9c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 -- 172.21.15.59:0/1990503636 >> 172.21.15.59:0/1990503636 conn(0x7f003c0725c0 msgr2=0x7f003c0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 -- 172.21.15.59:0/1990503636 shutdown_connections 2024-05-30T17:01:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 -- 172.21.15.59:0/1990503636 wait complete. 2024-05-30T17:01:01.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 Processor -- start 2024-05-30T17:01:01.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 -- start start 2024-05-30T17:01:01.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c06cf00 0x7f003c0ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f003c0730e0 0x7f003c147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c161e20 0x7f003c154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0d0820 con 0x7f003c06cf00 2024-05-30T17:01:01.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0b3a20 con 0x7f003c0730e0 2024-05-30T17:01:01.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0043600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f003c0cd0d0 con 0x7f003c161e20 2024-05-30T17:01:01.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0040c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c06cf00 0x7f003c0ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0040c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c06cf00 0x7f003c0ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44350/0 (socket says 172.21.15.59:44350) 2024-05-30T17:01:01.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.431+0000 7f0040c00640 1 -- 172.21.15.59:0/311521688 learned_addr learned my addr 172.21.15.59:0/311521688 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:01.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0033e00640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f003c0730e0 0x7f003c147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0041600640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c161e20 0x7f003c154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0040c00640 1 -- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c161e20 msgr2=0x7f003c154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0040c00640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c161e20 0x7f003c154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0040c00640 1 -- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f003c0730e0 msgr2=0x7f003c147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0040c00640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f003c0730e0 0x7f003c147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0040c00640 1 -- 172.21.15.59:0/311521688 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c0af110 con 0x7f003c06cf00 2024-05-30T17:01:01.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0041600640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c161e20 0x7f003c154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:01.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0040c00640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c06cf00 0x7f003c0ae4d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f002c01d340 tx=0x7f002c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:01.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0039600640 1 -- 172.21.15.59:0/311521688 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c0b5040 con 0x7f003c06cf00 2024-05-30T17:01:01.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0039600640 1 -- 172.21.15.59:0/311521688 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002c0c2070 con 0x7f003c06cf00 2024-05-30T17:01:01.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0039600640 1 -- 172.21.15.59:0/311521688 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c0b0860 con 0x7f003c06cf00 2024-05-30T17:01:01.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0043600640 1 -- 172.21.15.59:0/311521688 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003c0af3f0 con 0x7f003c06cf00 2024-05-30T17:01:01.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0043600640 1 -- 172.21.15.59:0/311521688 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f003c0af9b0 con 0x7f003c06cf00 2024-05-30T17:01:01.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0043600640 1 -- 172.21.15.59:0/311521688 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f003c068a90 con 0x7f003c06cf00 2024-05-30T17:01:01.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.435+0000 7f0039600640 1 -- 172.21.15.59:0/311521688 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f002c0b8070 con 0x7f003c06cf00 2024-05-30T17:01:01.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.439+0000 7f0039600640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0018069760 0x7f001806bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.439+0000 7f0039600640 1 -- 172.21.15.59:0/311521688 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f002c1231f0 con 0x7f003c06cf00 2024-05-30T17:01:01.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.439+0000 7f0033e00640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0018069760 0x7f001806bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.439+0000 7f0033e00640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0018069760 0x7f001806bc20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f003c1f7750 tx=0x7f0024009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:01.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.443+0000 7f0039600640 1 -- 172.21.15.59:0/311521688 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f002c0187f0 con 0x7f003c06cf00 2024-05-30T17:01:01.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.639+0000 7f0043600640 1 -- 172.21.15.59:0/311521688 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f003c0678a0 con 0x7f0018069760 2024-05-30T17:01:01.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0039600640 1 -- 172.21.15.59:0/311521688 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f003c0678a0 con 0x7f0018069760 2024-05-30T17:01:01.651 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:01.652 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:01:01.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:01.652 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ss1" 2024-05-30T17:01:01.652 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:01.652 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:01:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0043600640 1 -- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0018069760 msgr2=0x7f001806bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0043600640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0018069760 0x7f001806bc20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f003c1f7750 tx=0x7f0024009040 comp rx=0 tx=0).stop 2024-05-30T17:01:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0043600640 1 -- 172.21.15.59:0/311521688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c06cf00 msgr2=0x7f003c0ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0043600640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c06cf00 0x7f003c0ae4d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f002c01d340 tx=0x7f002c01ba30 comp rx=0 tx=0).stop 2024-05-30T17:01:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0043600640 1 -- 172.21.15.59:0/311521688 shutdown_connections 2024-05-30T17:01:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0043600640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0018069760 0x7f001806bc20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0043600640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c161e20 0x7f003c154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0043600640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f003c0730e0 0x7f003c147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0043600640 1 --2- 172.21.15.59:0/311521688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c06cf00 0x7f003c0ae4d0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0043600640 1 -- 172.21.15.59:0/311521688 >> 172.21.15.59:0/311521688 conn(0x7f003c0725c0 msgr2=0x7f003c06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0043600640 1 -- 172.21.15.59:0/311521688 shutdown_connections 2024-05-30T17:01:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.651+0000 7f0043600640 1 -- 172.21.15.59:0/311521688 wait complete. 2024-05-30T17:01:01.673 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:01:01.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.815+0000 7f8338a00640 1 Processor -- start 2024-05-30T17:01:01.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.815+0000 7f8338a00640 1 -- start start 2024-05-30T17:01:01.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8338a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8334161fd0 0x7f83340d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8338a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 0x7f83340b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8338a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83340d1150 con 0x7f83340cb9b0 2024-05-30T17:01:01.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8338a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f83340d0b90 con 0x7f8334161fd0 2024-05-30T17:01:01.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8338a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f83340d0e70 con 0x7f833406c0c0 2024-05-30T17:01:01.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8332800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 0x7f83340b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8331e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8334161fd0 0x7f83340d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8329400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f83340cb9b0 0x7f833406b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:50596/0 (socket says 172.21.15.59:50596) 2024-05-30T17:01:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8332800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 0x7f83340b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:46820/0 (socket says 172.21.15.59:46820) 2024-05-30T17:01:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8329400640 1 -- 172.21.15.59:0/734234795 learned_addr learned my addr 172.21.15.59:0/734234795 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8332800640 1 -- 172.21.15.59:0/734234795 >> v2:172.21.15.107:3300/0 conn(0x7f8334161fd0 msgr2=0x7f83340d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8331400640 1 -- 172.21.15.59:0/734234795 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2963442264 0 0) 0x7f83340d1150 con 0x7f83340cb9b0 2024-05-30T17:01:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8332800640 1 --2- 172.21.15.59:0/734234795 >> v2:172.21.15.107:3300/0 conn(0x7f8334161fd0 0x7f83340d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8332800640 1 -- 172.21.15.59:0/734234795 >> v1:172.21.15.107:6789/0 conn(0x7f83340cb9b0 legacy=0x7f833406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.819+0000 7f8332800640 1 -- 172.21.15.59:0/734234795 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83340cd620 con 0x7f833406c0c0 2024-05-30T17:01:01.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8332800640 1 --2- 172.21.15.59:0/734234795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 0x7f83340b3a40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f832c009d90 tx=0x7f832c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3c3da7c2f6d616d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:01.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8331400640 1 -- 172.21.15.59:0/734234795 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c0b2070 con 0x7f833406c0c0 2024-05-30T17:01:01.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8331400640 1 -- 172.21.15.59:0/734234795 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832c0a57a0 con 0x7f833406c0c0 2024-05-30T17:01:01.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8331400640 1 -- 172.21.15.59:0/734234795 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c0a5b70 con 0x7f833406c0c0 2024-05-30T17:01:01.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8338a00640 1 -- 172.21.15.59:0/734234795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 msgr2=0x7f83340b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8338a00640 1 --2- 172.21.15.59:0/734234795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 0x7f83340b3a40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f832c009d90 tx=0x7f832c01c8e0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8338a00640 1 -- 172.21.15.59:0/734234795 shutdown_connections 2024-05-30T17:01:01.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8338a00640 1 --2- 172.21.15.59:0/734234795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 0x7f83340b3a40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8338a00640 1 --2- 172.21.15.59:0/734234795 >> v2:172.21.15.107:3300/0 conn(0x7f8334161fd0 0x7f83340d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8338a00640 1 -- 172.21.15.59:0/734234795 >> 172.21.15.59:0/734234795 conn(0x7f83340b2f50 msgr2=0x7f83340b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:01.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8338a00640 1 -- 172.21.15.59:0/734234795 shutdown_connections 2024-05-30T17:01:01.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8338a00640 1 -- 172.21.15.59:0/734234795 wait complete. 2024-05-30T17:01:01.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8338a00640 1 Processor -- start 2024-05-30T17:01:01.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.823+0000 7f8338a00640 1 -- start start 2024-05-30T17:01:01.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8338a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 0x7f83341559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8338a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83340cb9b0 0x7f833415c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8338a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8334161fd0 0x7f833415c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8338a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f83340ce9c0 con 0x7f83340cb9b0 2024-05-30T17:01:01.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8338a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f83340ce840 con 0x7f8334161fd0 2024-05-30T17:01:01.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8338a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f83340ceb40 con 0x7f833406c0c0 2024-05-30T17:01:01.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8329400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83340cb9b0 0x7f833415c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8331e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 0x7f83341559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8331e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 0x7f83341559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:46832/0 (socket says 172.21.15.59:46832) 2024-05-30T17:01:01.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8329400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83340cb9b0 0x7f833415c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44354/0 (socket says 172.21.15.59:44354) 2024-05-30T17:01:01.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8331e00640 1 -- 172.21.15.59:0/567589943 learned_addr learned my addr 172.21.15.59:0/567589943 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:01.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8332800640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8334161fd0 0x7f833415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8331e00640 1 -- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8334161fd0 msgr2=0x7f833415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8331e00640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8334161fd0 0x7f833415c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8331e00640 1 -- 172.21.15.59:0/567589943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83340cb9b0 msgr2=0x7f833415c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:01.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8331e00640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83340cb9b0 0x7f833415c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:01.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8331e00640 1 -- 172.21.15.59:0/567589943 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83341564f0 con 0x7f833406c0c0 2024-05-30T17:01:01.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8331e00640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 0x7f83341559c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f832400e960 tx=0x7f832400ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:01.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f832aa00640 1 -- 172.21.15.59:0/567589943 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324017070 con 0x7f833406c0c0 2024-05-30T17:01:01.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f832aa00640 1 -- 172.21.15.59:0/567589943 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832400ca00 con 0x7f833406c0c0 2024-05-30T17:01:01.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f832aa00640 1 -- 172.21.15.59:0/567589943 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832400cdb0 con 0x7f833406c0c0 2024-05-30T17:01:01.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8338a00640 1 -- 172.21.15.59:0/567589943 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83340afa60 con 0x7f833406c0c0 2024-05-30T17:01:01.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8338a00640 1 -- 172.21.15.59:0/567589943 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f83340affe0 con 0x7f833406c0c0 2024-05-30T17:01:01.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f8338a00640 1 -- 172.21.15.59:0/567589943 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8334068a90 con 0x7f833406c0c0 2024-05-30T17:01:01.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.827+0000 7f832aa00640 1 -- 172.21.15.59:0/567589943 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f832401a070 con 0x7f833406c0c0 2024-05-30T17:01:01.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.831+0000 7f832aa00640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8310069730 0x7f831006bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:01.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.831+0000 7f832aa00640 1 -- 172.21.15.59:0/567589943 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f8324085fe0 con 0x7f833406c0c0 2024-05-30T17:01:01.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.831+0000 7f8329400640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8310069730 0x7f831006bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:01.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.831+0000 7f8329400640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8310069730 0x7f831006bbf0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f833415fe00 tx=0x7f831c007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:01.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:01.835+0000 7f832aa00640 1 -- 172.21.15.59:0/567589943 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f83240575f0 con 0x7f833406c0c0 2024-05-30T17:01:02.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.031+0000 7f8338a00640 1 -- 172.21.15.59:0/567589943 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83341601d0 con 0x7f8310069730 2024-05-30T17:01:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f832aa00640 1 -- 172.21.15.59:0/567589943 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f83341601d0 con 0x7f8310069730 2024-05-30T17:01:02.057 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f8338a00640 1 -- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8310069730 msgr2=0x7f831006bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f8338a00640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8310069730 0x7f831006bbf0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f833415fe00 tx=0x7f831c007d60 comp rx=0 tx=0).stop 2024-05-30T17:01:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f8338a00640 1 -- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 msgr2=0x7f83341559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f8338a00640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 0x7f83341559c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f832400e960 tx=0x7f832400ee20 comp rx=0 tx=0).stop 2024-05-30T17:01:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f8338a00640 1 -- 172.21.15.59:0/567589943 shutdown_connections 2024-05-30T17:01:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f8338a00640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8310069730 0x7f831006bbf0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f8338a00640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8334161fd0 0x7f833415c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f8338a00640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83340cb9b0 0x7f833415c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f8338a00640 1 --2- 172.21.15.59:0/567589943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f833406c0c0 0x7f83341559c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f8338a00640 1 -- 172.21.15.59:0/567589943 >> 172.21.15.59:0/567589943 conn(0x7f83340b2f50 msgr2=0x7f83340b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:02.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f8338a00640 1 -- 172.21.15.59:0/567589943 shutdown_connections 2024-05-30T17:01:02.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.055+0000 7f8338a00640 1 -- 172.21.15.59:0/567589943 wait complete. 2024-05-30T17:01:02.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T17:01:02.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b4c800640 1 Processor -- start 2024-05-30T17:01:02.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b4c800640 1 -- start start 2024-05-30T17:01:02.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b4c800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b440ad2b0 0x7f8b4415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:02.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b4c800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b440ad770 con 0x7f8b440d0660 2024-05-30T17:01:02.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b4c800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b4415cb40 con 0x7f8b441569e0 2024-05-30T17:01:02.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b4c800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f8b4415ce20 con 0x7f8b440ad2b0 2024-05-30T17:01:02.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b49400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b440ad2b0 0x7f8b4415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:02.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b49400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b440ad2b0 0x7f8b4415d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45546/0 (socket says 172.21.15.59:45546) 2024-05-30T17:01:02.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b4a800640 1 --1- 172.21.15.59:0/3204574970 >> v1:172.21.15.59:6789/0 conn(0x7f8b440d0660 0x7f8b440b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43364/0 (socket says 172.21.15.59:43364) 2024-05-30T17:01:02.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b49400640 1 -- 172.21.15.59:0/3204574970 learned_addr learned my addr 172.21.15.59:0/3204574970 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:02.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b49400640 1 -- 172.21.15.59:0/3204574970 >> v1:172.21.15.107:6789/0 conn(0x7f8b441569e0 legacy=0x7f8b440cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b49400640 1 -- 172.21.15.59:0/3204574970 >> v1:172.21.15.59:6789/0 conn(0x7f8b440d0660 legacy=0x7f8b440b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b48a00640 1 -- 172.21.15.59:0/3204574970 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1798207303 0 0) 0x7f8b440ad770 con 0x7f8b440d0660 2024-05-30T17:01:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.223+0000 7f8b49400640 1 -- 172.21.15.59:0/3204574970 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4415d100 con 0x7f8b440ad2b0 2024-05-30T17:01:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.227+0000 7f8b49400640 1 --2- 172.21.15.59:0/3204574970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b440ad2b0 0x7f8b4415d620 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009870 tx=0x7f8b3401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681943de0509eb32 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.227+0000 7f8b48a00640 1 -- 172.21.15.59:0/3204574970 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b340b1070 con 0x7f8b440ad2b0 2024-05-30T17:01:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.227+0000 7f8b48a00640 1 -- 172.21.15.59:0/3204574970 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b340ac410 con 0x7f8b440ad2b0 2024-05-30T17:01:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.227+0000 7f8b48a00640 1 -- 172.21.15.59:0/3204574970 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b340ac7e0 con 0x7f8b440ad2b0 2024-05-30T17:01:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.227+0000 7f8b4c800640 1 -- 172.21.15.59:0/3204574970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b440ad2b0 msgr2=0x7f8b4415d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.227+0000 7f8b4c800640 1 --2- 172.21.15.59:0/3204574970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b440ad2b0 0x7f8b4415d620 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009870 tx=0x7f8b3401c4d0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.227+0000 7f8b4c800640 1 -- 172.21.15.59:0/3204574970 shutdown_connections 2024-05-30T17:01:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.227+0000 7f8b4c800640 1 --2- 172.21.15.59:0/3204574970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b440ad2b0 0x7f8b4415d620 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.227+0000 7f8b4c800640 1 -- 172.21.15.59:0/3204574970 >> 172.21.15.59:0/3204574970 conn(0x7f8b4406bdb0 msgr2=0x7f8b4406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.227+0000 7f8b4c800640 1 -- 172.21.15.59:0/3204574970 shutdown_connections 2024-05-30T17:01:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.227+0000 7f8b4c800640 1 -- 172.21.15.59:0/3204574970 wait complete. 2024-05-30T17:01:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.227+0000 7f8b4c800640 1 Processor -- start 2024-05-30T17:01:02.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4c800640 1 -- start start 2024-05-30T17:01:02.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4c800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b440ad2b0 0x7f8b44155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:02.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4c800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b440d0660 0x7f8b4415d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b441569e0 0x7f8b440b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4416a340 con 0x7f8b441569e0 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4c800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4416a1c0 con 0x7f8b440d0660 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4c800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4416a4c0 con 0x7f8b440ad2b0 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b441569e0 0x7f8b440b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b49400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b440d0660 0x7f8b4415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b49e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b440ad2b0 0x7f8b44155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b441569e0 0x7f8b440b07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45550/0 (socket says 172.21.15.59:45550) 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4a800640 1 -- 172.21.15.59:0/3040303590 learned_addr learned my addr 172.21.15.59:0/3040303590 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4a800640 1 -- 172.21.15.59:0/3040303590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b440ad2b0 msgr2=0x7f8b44155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4a800640 1 --2- 172.21.15.59:0/3040303590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b440ad2b0 0x7f8b44155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4a800640 1 -- 172.21.15.59:0/3040303590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b440d0660 msgr2=0x7f8b4415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4a800640 1 --2- 172.21.15.59:0/3040303590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b440d0660 0x7f8b4415d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4a800640 1 -- 172.21.15.59:0/3040303590 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4415de70 con 0x7f8b441569e0 2024-05-30T17:01:02.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4a800640 1 --2- 172.21.15.59:0/3040303590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b441569e0 0x7f8b440b07d0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000c7a0 tx=0x7f8b4000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:02.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b3e000640 1 -- 172.21.15.59:0/3040303590 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40018070 con 0x7f8b441569e0 2024-05-30T17:01:02.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b3e000640 1 -- 172.21.15.59:0/3040303590 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b4000a640 con 0x7f8b441569e0 2024-05-30T17:01:02.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4c800640 1 -- 172.21.15.59:0/3040303590 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b4415e150 con 0x7f8b441569e0 2024-05-30T17:01:02.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b3e000640 1 -- 172.21.15.59:0/3040303590 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000aab0 con 0x7f8b441569e0 2024-05-30T17:01:02.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4c800640 1 -- 172.21.15.59:0/3040303590 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b4415e710 con 0x7f8b441569e0 2024-05-30T17:01:02.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.231+0000 7f8b4c800640 1 -- 172.21.15.59:0/3040303590 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b44068a90 con 0x7f8b441569e0 2024-05-30T17:01:02.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.235+0000 7f8b3e000640 1 -- 172.21.15.59:0/3040303590 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f8b4001b070 con 0x7f8b441569e0 2024-05-30T17:01:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.235+0000 7f8b3e000640 1 --2- 172.21.15.59:0/3040303590 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b28069730 0x7f8b2806bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.235+0000 7f8b3e000640 1 -- 172.21.15.59:0/3040303590 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f8b40084f50 con 0x7f8b441569e0 2024-05-30T17:01:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.235+0000 7f8b49e00640 1 --2- 172.21.15.59:0/3040303590 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b28069730 0x7f8b2806bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:02.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.235+0000 7f8b49e00640 1 --2- 172.21.15.59:0/3040303590 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b28069730 0x7f8b2806bbf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8b44152870 tx=0x7f8b38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.239+0000 7f8b3e000640 1 -- 172.21.15.59:0/3040303590 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8b400565c0 con 0x7f8b441569e0 2024-05-30T17:01:02.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.431+0000 7f8b4c800640 1 -- 172.21.15.59:0/3040303590 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f8b440af9a0 con 0x7f8b28069730 2024-05-30T17:01:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.447+0000 7f8b3e000640 1 -- 172.21.15.59:0/3040303590 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8b440af9a0 con 0x7f8b28069730 2024-05-30T17:01:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.451+0000 7f8b4c800640 1 -- 172.21.15.59:0/3040303590 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b28069730 msgr2=0x7f8b2806bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.451+0000 7f8b4c800640 1 --2- 172.21.15.59:0/3040303590 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b28069730 0x7f8b2806bbf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8b44152870 tx=0x7f8b38009040 comp rx=0 tx=0).stop 2024-05-30T17:01:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.451+0000 7f8b4c800640 1 -- 172.21.15.59:0/3040303590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b441569e0 msgr2=0x7f8b440b07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.451+0000 7f8b4c800640 1 --2- 172.21.15.59:0/3040303590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b441569e0 0x7f8b440b07d0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000c7a0 tx=0x7f8b4000cc60 comp rx=0 tx=0).stop 2024-05-30T17:01:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.451+0000 7f8b4c800640 1 -- 172.21.15.59:0/3040303590 shutdown_connections 2024-05-30T17:01:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.451+0000 7f8b4c800640 1 --2- 172.21.15.59:0/3040303590 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b28069730 0x7f8b2806bbf0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.451+0000 7f8b4c800640 1 --2- 172.21.15.59:0/3040303590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b441569e0 0x7f8b440b07d0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.451+0000 7f8b4c800640 1 --2- 172.21.15.59:0/3040303590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b440d0660 0x7f8b4415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.451+0000 7f8b4c800640 1 --2- 172.21.15.59:0/3040303590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b440ad2b0 0x7f8b44155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.451+0000 7f8b4c800640 1 -- 172.21.15.59:0/3040303590 >> 172.21.15.59:0/3040303590 conn(0x7f8b4406bdb0 msgr2=0x7f8b4406e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.451+0000 7f8b4c800640 1 -- 172.21.15.59:0/3040303590 shutdown_connections 2024-05-30T17:01:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.451+0000 7f8b4c800640 1 -- 172.21.15.59:0/3040303590 wait complete. 2024-05-30T17:01:02.455 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:02.457+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:02.455 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:02.457+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:02.455 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:02.457+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:02.455 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:02.457+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:02.455 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:02.457+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:02.471 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:02.473+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:02.471 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:02.473+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:02.471 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:02.473+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:02.472 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:02.473+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:02.472 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:02.473+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:02.473 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-05-30T17:01:02.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.615+0000 7f14c6600640 1 Processor -- start 2024-05-30T17:01:02.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.615+0000 7f14c6600640 1 -- start start 2024-05-30T17:01:02.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14c6600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14c006c0c0 0x7f14c0167210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:02.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14c6600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14c00b0340 con 0x7f14c00b7010 2024-05-30T17:01:02.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14c6600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14c00b0620 con 0x7f14c0145470 2024-05-30T17:01:02.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14c6600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f14c00b7470 con 0x7f14c006c0c0 2024-05-30T17:01:02.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14b6a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14c00b7010 0x7f14c006b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43376/0 (socket says 172.21.15.59:43376) 2024-05-30T17:01:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14b6a00640 1 -- 172.21.15.59:0/275104652 learned_addr learned my addr 172.21.15.59:0/275104652 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14bfe00640 1 --2- 172.21.15.59:0/275104652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14c006c0c0 0x7f14c0167210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14bea00640 1 -- 172.21.15.59:0/275104652 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627609868 0 0) 0x7f14c00b0340 con 0x7f14c00b7010 2024-05-30T17:01:02.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14bea00640 1 -- 172.21.15.59:0/275104652 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14a4003530 con 0x7f14c00b7010 2024-05-30T17:01:02.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14bea00640 1 -- 172.21.15.59:0/275104652 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3984928603 0 0) 0x7f14c00b0620 con 0x7f14c0145470 2024-05-30T17:01:02.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14bea00640 1 -- 172.21.15.59:0/275104652 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14c00b0340 con 0x7f14c0145470 2024-05-30T17:01:02.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14bfe00640 1 -- 172.21.15.59:0/275104652 >> v1:172.21.15.107:6789/0 conn(0x7f14c0145470 legacy=0x7f14c00afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14bfe00640 1 -- 172.21.15.59:0/275104652 >> v1:172.21.15.59:6789/0 conn(0x7f14c00b7010 legacy=0x7f14c006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.619+0000 7f14bfe00640 1 -- 172.21.15.59:0/275104652 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c00b0900 con 0x7f14c006c0c0 2024-05-30T17:01:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14bfe00640 1 --2- 172.21.15.59:0/275104652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14c006c0c0 0x7f14c0167210 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009dc0 tx=0x7f14b801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e8a8283b4d5b453 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14bea00640 1 -- 172.21.15.59:0/275104652 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b80b2070 con 0x7f14c006c0c0 2024-05-30T17:01:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14bea00640 1 -- 172.21.15.59:0/275104652 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b80a5850 con 0x7f14c006c0c0 2024-05-30T17:01:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14bea00640 1 -- 172.21.15.59:0/275104652 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b80a5c20 con 0x7f14c006c0c0 2024-05-30T17:01:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14c6600640 1 -- 172.21.15.59:0/275104652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14c006c0c0 msgr2=0x7f14c0167210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14c6600640 1 --2- 172.21.15.59:0/275104652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14c006c0c0 0x7f14c0167210 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009dc0 tx=0x7f14b801c990 comp rx=0 tx=0).stop 2024-05-30T17:01:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14c6600640 1 -- 172.21.15.59:0/275104652 shutdown_connections 2024-05-30T17:01:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14c6600640 1 --2- 172.21.15.59:0/275104652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14c006c0c0 0x7f14c0167210 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14c6600640 1 -- 172.21.15.59:0/275104652 >> 172.21.15.59:0/275104652 conn(0x7f14c009aa40 msgr2=0x7f14c00b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14c6600640 1 -- 172.21.15.59:0/275104652 shutdown_connections 2024-05-30T17:01:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14c6600640 1 -- 172.21.15.59:0/275104652 wait complete. 2024-05-30T17:01:02.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14c6600640 1 Processor -- start 2024-05-30T17:01:02.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.623+0000 7f14c6600640 1 -- start start 2024-05-30T17:01:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14c6600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c006c0c0 0x7f14c0070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14c6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c00b7010 0x7f14c015cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14c6600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14c0145470 0x7f14c015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14c6600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f14c016a300 con 0x7f14c00b7010 2024-05-30T17:01:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14c6600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f14c016a180 con 0x7f14c006c0c0 2024-05-30T17:01:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14c6600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f14c016a480 con 0x7f14c0145470 2024-05-30T17:01:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14b6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c00b7010 0x7f14c015cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14bf400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c006c0c0 0x7f14c0070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14bfe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14c0145470 0x7f14c015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14bf400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c006c0c0 0x7f14c0070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:53060/0 (socket says 172.21.15.59:53060) 2024-05-30T17:01:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14bf400640 1 -- 172.21.15.59:0/4176848240 learned_addr learned my addr 172.21.15.59:0/4176848240 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14b6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c00b7010 0x7f14c015cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45562/0 (socket says 172.21.15.59:45562) 2024-05-30T17:01:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14bf400640 1 -- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14c0145470 msgr2=0x7f14c015b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14bf400640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14c0145470 0x7f14c015b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14bf400640 1 -- 172.21.15.59:0/4176848240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c00b7010 msgr2=0x7f14c015cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14bf400640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c00b7010 0x7f14c015cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14bf400640 1 -- 172.21.15.59:0/4176848240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c015ed50 con 0x7f14c006c0c0 2024-05-30T17:01:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14b6a00640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c00b7010 0x7f14c015cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:01:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14bf400640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c006c0c0 0x7f14c0070180 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f14b000c490 tx=0x7f14b000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14b7e00640 1 -- 172.21.15.59:0/4176848240 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b00052d0 con 0x7f14c006c0c0 2024-05-30T17:01:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14b7e00640 1 -- 172.21.15.59:0/4176848240 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b0005470 con 0x7f14c006c0c0 2024-05-30T17:01:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14b7e00640 1 -- 172.21.15.59:0/4176848240 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0012870 con 0x7f14c006c0c0 2024-05-30T17:01:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14c6600640 1 -- 172.21.15.59:0/4176848240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c015f030 con 0x7f14c006c0c0 2024-05-30T17:01:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14c6600640 1 -- 172.21.15.59:0/4176848240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c015f5f0 con 0x7f14c006c0c0 2024-05-30T17:01:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.627+0000 7f14c6600640 1 -- 172.21.15.59:0/4176848240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c0068a90 con 0x7f14c006c0c0 2024-05-30T17:01:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.631+0000 7f14b7e00640 1 -- 172.21.15.59:0/4176848240 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7f14b0012a10 con 0x7f14c006c0c0 2024-05-30T17:01:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.631+0000 7f14b7e00640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f149c069730 0x7f149c06bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.631+0000 7f14b7e00640 1 -- 172.21.15.59:0/4176848240 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5822+0+0 (secure 0 0 0) 0x7f14b0085190 con 0x7f14c006c0c0 2024-05-30T17:01:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.631+0000 7f14b6a00640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f149c069730 0x7f149c06bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.631+0000 7f14b6a00640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f149c069730 0x7f149c06bbf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f14c01671a0 tx=0x7f14a8007d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:02.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.635+0000 7f14b7e00640 1 -- 172.21.15.59:0/4176848240 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f14b0056b50 con 0x7f14c006c0c0 2024-05-30T17:01:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.827+0000 7f14c6600640 1 -- 172.21.15.59:0/4176848240 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f14c00b6ae0 con 0x7f149c069730 2024-05-30T17:01:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.843+0000 7f14b7e00640 1 -- 172.21.15.59:0/4176848240 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f14c00b6ae0 con 0x7f149c069730 2024-05-30T17:01:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.847+0000 7f14c6600640 1 -- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f149c069730 msgr2=0x7f149c06bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.847+0000 7f14c6600640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f149c069730 0x7f149c06bbf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f14c01671a0 tx=0x7f14a8007d80 comp rx=0 tx=0).stop 2024-05-30T17:01:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.847+0000 7f14c6600640 1 -- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c006c0c0 msgr2=0x7f14c0070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.847+0000 7f14c6600640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c006c0c0 0x7f14c0070180 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f14b000c490 tx=0x7f14b000c950 comp rx=0 tx=0).stop 2024-05-30T17:01:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.847+0000 7f14c6600640 1 -- 172.21.15.59:0/4176848240 shutdown_connections 2024-05-30T17:01:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.847+0000 7f14c6600640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f149c069730 0x7f149c06bbf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.847+0000 7f14c6600640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14c0145470 0x7f14c015b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.847+0000 7f14c6600640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c00b7010 0x7f14c015cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.847+0000 7f14c6600640 1 --2- 172.21.15.59:0/4176848240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c006c0c0 0x7f14c0070180 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.847+0000 7f14c6600640 1 -- 172.21.15.59:0/4176848240 >> 172.21.15.59:0/4176848240 conn(0x7f14c009aa40 msgr2=0x7f14c00d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.847+0000 7f14c6600640 1 -- 172.21.15.59:0/4176848240 shutdown_connections 2024-05-30T17:01:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02.847+0000 7f14c6600640 1 -- 172.21.15.59:0/4176848240 wait complete. 2024-05-30T17:01:02.869 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T17:01:02.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T17:01:02.928 INFO:teuthology.orchestra.run.smithi059.stdout:2 2024-05-30T17:01:02.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T17:01:02.935 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T17:01:02.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T17:01:03.010 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T17:01:03.100 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T17:01:03.100 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T17:01:03.100 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:01:03.100 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:01:03.109 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:01:03.109 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:01:03.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T17:01:03.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa49400640 1 Processor -- start 2024-05-30T17:01:03.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa49400640 1 -- start start 2024-05-30T17:01:03.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa49400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa440af720 0x7ffa4415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:03.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa49400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa440d0560 0x7ffa440d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:03.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa49400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa4415f060 con 0x7ffa4406e900 2024-05-30T17:01:03.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa49400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ffa440afb00 con 0x7ffa440af720 2024-05-30T17:01:03.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa49400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4415c270 con 0x7ffa440d0560 2024-05-30T17:01:03.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa43200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa440d0560 0x7ffa440d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:03.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa42800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa440af720 0x7ffa4415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:03.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa39e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ffa4406e900 0x7ffa4415f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:41292/0 (socket says 172.21.15.59:41292) 2024-05-30T17:01:03.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa43200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa440d0560 0x7ffa440d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36178/0 (socket says 172.21.15.59:36178) 2024-05-30T17:01:03.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa39e00640 1 -- 172.21.15.59:0/3436507604 learned_addr learned my addr 172.21.15.59:0/3436507604 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:03.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa43200640 1 -- 172.21.15.59:0/3436507604 >> v2:172.21.15.107:3300/0 conn(0x7ffa440af720 msgr2=0x7ffa4415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:03.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa43200640 1 --2- 172.21.15.59:0/3436507604 >> v2:172.21.15.107:3300/0 conn(0x7ffa440af720 0x7ffa4415b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:03.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa43200640 1 -- 172.21.15.59:0/3436507604 >> v1:172.21.15.107:6789/0 conn(0x7ffa4406e900 legacy=0x7ffa4415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:03.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa43200640 1 -- 172.21.15.59:0/3436507604 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4415ff00 con 0x7ffa440d0560 2024-05-30T17:01:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.343+0000 7ffa42800640 1 --2- 172.21.15.59:0/3436507604 >> v2:172.21.15.107:3300/0 conn(0x7ffa440af720 0x7ffa4415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:01:03.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.347+0000 7ffa43200640 1 --2- 172.21.15.59:0/3436507604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa440d0560 0x7ffa440d0a10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009d90 tx=0x7ffa3c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3eb7c7d52c62c7d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:03.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.347+0000 7ffa41e00640 1 -- 172.21.15.59:0/3436507604 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0b2070 con 0x7ffa440d0560 2024-05-30T17:01:03.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.347+0000 7ffa41e00640 1 -- 172.21.15.59:0/3436507604 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa3c0a5920 con 0x7ffa440d0560 2024-05-30T17:01:03.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.347+0000 7ffa41e00640 1 -- 172.21.15.59:0/3436507604 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0a5cf0 con 0x7ffa440d0560 2024-05-30T17:01:03.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.347+0000 7ffa49400640 1 -- 172.21.15.59:0/3436507604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa440d0560 msgr2=0x7ffa440d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:03.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.347+0000 7ffa49400640 1 --2- 172.21.15.59:0/3436507604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa440d0560 0x7ffa440d0a10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009d90 tx=0x7ffa3c01c970 comp rx=0 tx=0).stop 2024-05-30T17:01:03.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.347+0000 7ffa49400640 1 -- 172.21.15.59:0/3436507604 shutdown_connections 2024-05-30T17:01:03.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.347+0000 7ffa49400640 1 --2- 172.21.15.59:0/3436507604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa440d0560 0x7ffa440d0a10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:03.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.347+0000 7ffa49400640 1 --2- 172.21.15.59:0/3436507604 >> v2:172.21.15.107:3300/0 conn(0x7ffa440af720 0x7ffa4415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:03.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.347+0000 7ffa49400640 1 -- 172.21.15.59:0/3436507604 >> 172.21.15.59:0/3436507604 conn(0x7ffa440b22d0 msgr2=0x7ffa440b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:03.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.347+0000 7ffa49400640 1 -- 172.21.15.59:0/3436507604 shutdown_connections 2024-05-30T17:01:03.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.347+0000 7ffa49400640 1 -- 172.21.15.59:0/3436507604 wait complete. 2024-05-30T17:01:03.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa49400640 1 Processor -- start 2024-05-30T17:01:03.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa49400640 1 -- start start 2024-05-30T17:01:03.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa49400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4406e900 0x7ffa4414c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:03.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa49400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa440af720 0x7ffa44150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:03.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa49400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa440d0560 0x7ffa441509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:03.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa49400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa44073150 con 0x7ffa4406e900 2024-05-30T17:01:03.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa49400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4415c830 con 0x7ffa440af720 2024-05-30T17:01:03.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa49400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffa440732d0 con 0x7ffa440d0560 2024-05-30T17:01:03.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa42800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4406e900 0x7ffa4414c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa42800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4406e900 0x7ffa4414c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45574/0 (socket says 172.21.15.59:45574) 2024-05-30T17:01:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa42800640 1 -- 172.21.15.59:0/646948954 learned_addr learned my addr 172.21.15.59:0/646948954 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa39e00640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa440af720 0x7ffa44150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa43200640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa440d0560 0x7ffa441509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa42800640 1 -- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa440d0560 msgr2=0x7ffa441509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa42800640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa440d0560 0x7ffa441509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa42800640 1 -- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa440af720 msgr2=0x7ffa44150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa42800640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa440af720 0x7ffa44150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa42800640 1 -- 172.21.15.59:0/646948954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa44150210 con 0x7ffa4406e900 2024-05-30T17:01:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa42800640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4406e900 0x7ffa4414c240 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400ec10 tx=0x7ffa3400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:03.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa3b400640 1 -- 172.21.15.59:0/646948954 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34017070 con 0x7ffa4406e900 2024-05-30T17:01:03.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa3b400640 1 -- 172.21.15.59:0/646948954 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa3400cc30 con 0x7ffa4406e900 2024-05-30T17:01:03.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa3b400640 1 -- 172.21.15.59:0/646948954 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34013470 con 0x7ffa4406e900 2024-05-30T17:01:03.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa49400640 1 -- 172.21.15.59:0/646948954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa44151510 con 0x7ffa4406e900 2024-05-30T17:01:03.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa49400640 1 -- 172.21.15.59:0/646948954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa44151ad0 con 0x7ffa4406e900 2024-05-30T17:01:03.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.351+0000 7ffa49400640 1 -- 172.21.15.59:0/646948954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa44068a90 con 0x7ffa4406e900 2024-05-30T17:01:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.355+0000 7ffa3b400640 1 -- 172.21.15.59:0/646948954 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7ffa3401a070 con 0x7ffa4406e900 2024-05-30T17:01:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.355+0000 7ffa3b400640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa20069760 0x7ffa2006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.355+0000 7ffa3b400640 1 -- 172.21.15.59:0/646948954 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5878+0+0 (secure 0 0 0) 0x7ffa34085820 con 0x7ffa4406e900 2024-05-30T17:01:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.355+0000 7ffa39e00640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa20069760 0x7ffa2006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.355+0000 7ffa39e00640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa20069760 0x7ffa2006bc20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ffa441fa630 tx=0x7ffa2c007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.359+0000 7ffa3b400640 1 -- 172.21.15.59:0/646948954 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa34056e90 con 0x7ffa4406e900 2024-05-30T17:01:03.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.535+0000 7ffa49400640 1 -- 172.21.15.59:0/646948954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffa440ad810 con 0x7ffa4406e900 2024-05-30T17:01:03.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa3b400640 1 -- 172.21.15.59:0/646948954 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v93) ==== 80+0+0 (secure 0 0 0) 0x7ffa3405b190 con 0x7ffa4406e900 2024-05-30T17:01:03.540 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T17:01:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa49400640 1 -- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa20069760 msgr2=0x7ffa2006bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa49400640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa20069760 0x7ffa2006bc20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ffa441fa630 tx=0x7ffa2c007e90 comp rx=0 tx=0).stop 2024-05-30T17:01:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa49400640 1 -- 172.21.15.59:0/646948954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4406e900 msgr2=0x7ffa4414c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa49400640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4406e900 0x7ffa4414c240 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400ec10 tx=0x7ffa3400c520 comp rx=0 tx=0).stop 2024-05-30T17:01:03.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa49400640 1 -- 172.21.15.59:0/646948954 shutdown_connections 2024-05-30T17:01:03.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa49400640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa20069760 0x7ffa2006bc20 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:03.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa49400640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa440d0560 0x7ffa441509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:03.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa49400640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa440af720 0x7ffa44150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:03.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa49400640 1 --2- 172.21.15.59:0/646948954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4406e900 0x7ffa4414c240 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:03.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa49400640 1 -- 172.21.15.59:0/646948954 >> 172.21.15.59:0/646948954 conn(0x7ffa440b22d0 msgr2=0x7ffa440aded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:03.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa49400640 1 -- 172.21.15.59:0/646948954 shutdown_connections 2024-05-30T17:01:03.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.539+0000 7ffa49400640 1 -- 172.21.15.59:0/646948954 wait complete. 2024-05-30T17:01:03.561 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2024-05-30T17:01:03.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:03.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-30T17:01:03.579 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[46002]: fuse finished with error 0 and tester_r 0 2024-05-30T17:01:03.582 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T17:01:03.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:03.583 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T17:01:03.747 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T17:01:03.747 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:01:03.747 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:01:03.756 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:01:03.756 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T17:01:03.756 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:01:03.756 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:01:03.796 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T17:01:03.796 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T17:01:03.796 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:01:03.796 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:01:03.804 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:01:03.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:01:03.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.979+0000 7fcf13e00640 1 Processor -- start 2024-05-30T17:01:03.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.979+0000 7fcf13e00640 1 -- start start 2024-05-30T17:01:03.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.983+0000 7fcf13e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf0c0b4510 0x7fcf0c1630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:03.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.983+0000 7fcf13e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf0c15fbe0 con 0x7fcf0c072d00 2024-05-30T17:01:03.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.983+0000 7fcf13e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf0c15fec0 con 0x7fcf0c0b48f0 2024-05-30T17:01:03.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.983+0000 7fcf13e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fcf0c1635f0 con 0x7fcf0c0b4510 2024-05-30T17:01:03.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.983+0000 7fcf11400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf0c0b4510 0x7fcf0c1630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:03.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.983+0000 7fcf11e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcf0c072d00 0x7fcf0c06e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43380/0 (socket says 172.21.15.59:43380) 2024-05-30T17:01:03.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.983+0000 7fcf11e00640 1 -- 172.21.15.59:0/3777029165 learned_addr learned my addr 172.21.15.59:0/3777029165 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:03.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.983+0000 7fcf0be00640 1 -- 172.21.15.59:0/3777029165 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279127873 0 0) 0x7fcf0c15fbe0 con 0x7fcf0c072d00 2024-05-30T17:01:03.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.983+0000 7fcf0be00640 1 -- 172.21.15.59:0/3777029165 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcef4003530 con 0x7fcf0c072d00 2024-05-30T17:01:03.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.983+0000 7fcf11400640 1 -- 172.21.15.59:0/3777029165 >> v1:172.21.15.107:6789/0 conn(0x7fcf0c0b48f0 legacy=0x7fcf0c15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:03.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.983+0000 7fcf11400640 1 -- 172.21.15.59:0/3777029165 >> v1:172.21.15.59:6789/0 conn(0x7fcf0c072d00 legacy=0x7fcf0c06e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:03.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.983+0000 7fcf11400640 1 -- 172.21.15.59:0/3777029165 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0c1628b0 con 0x7fcf0c0b4510 2024-05-30T17:01:03.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf11400640 1 --2- 172.21.15.59:0/3777029165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf0c0b4510 0x7fcf0c1630b0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fcf000097c0 tx=0x7fcf0001cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa512bae44d36630 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:03.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf0be00640 1 -- 172.21.15.59:0/3777029165 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf000b1070 con 0x7fcf0c0b4510 2024-05-30T17:01:03.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf0be00640 1 -- 172.21.15.59:0/3777029165 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf000ac410 con 0x7fcf0c0b4510 2024-05-30T17:01:03.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf0be00640 1 -- 172.21.15.59:0/3777029165 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf000ac7e0 con 0x7fcf0c0b4510 2024-05-30T17:01:03.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 -- 172.21.15.59:0/3777029165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf0c0b4510 msgr2=0x7fcf0c1630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:03.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 --2- 172.21.15.59:0/3777029165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf0c0b4510 0x7fcf0c1630b0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fcf000097c0 tx=0x7fcf0001cf00 comp rx=0 tx=0).stop 2024-05-30T17:01:03.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 -- 172.21.15.59:0/3777029165 shutdown_connections 2024-05-30T17:01:03.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 --2- 172.21.15.59:0/3777029165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf0c0b4510 0x7fcf0c1630b0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:03.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 -- 172.21.15.59:0/3777029165 >> 172.21.15.59:0/3777029165 conn(0x7fcf0c0b3240 msgr2=0x7fcf0c0725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 -- 172.21.15.59:0/3777029165 shutdown_connections 2024-05-30T17:01:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 -- 172.21.15.59:0/3777029165 wait complete. 2024-05-30T17:01:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 Processor -- start 2024-05-30T17:01:03.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 -- start start 2024-05-30T17:01:03.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c072d00 0x7fcf0c140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:03.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf0c0b4510 0x7fcf0c153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:03.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf0c0b48f0 0x7fcf0c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:03.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.987+0000 7fcf13e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0c073520 con 0x7fcf0c0b4510 2024-05-30T17:01:03.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf13e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0c15f7c0 con 0x7fcf0c072d00 2024-05-30T17:01:03.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf13e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcf0c1408a0 con 0x7fcf0c0b48f0 2024-05-30T17:01:03.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf10a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf0c0b4510 0x7fcf0c153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf11400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c072d00 0x7fcf0c140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf11400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c072d00 0x7fcf0c140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:53094/0 (socket says 172.21.15.59:53094) 2024-05-30T17:01:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf11400640 1 -- 172.21.15.59:0/3920838036 learned_addr learned my addr 172.21.15.59:0/3920838036 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf11e00640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf0c0b48f0 0x7fcf0c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf10a00640 1 -- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf0c0b48f0 msgr2=0x7fcf0c153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf10a00640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf0c0b48f0 0x7fcf0c153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf10a00640 1 -- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c072d00 msgr2=0x7fcf0c140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf10a00640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c072d00 0x7fcf0c140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf10a00640 1 -- 172.21.15.59:0/3920838036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0c157bf0 con 0x7fcf0c0b4510 2024-05-30T17:01:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf11400640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c072d00 0x7fcf0c140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:01:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf11e00640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf0c0b48f0 0x7fcf0c153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf10a00640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf0c0b4510 0x7fcf0c153a90 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fcef800c390 tx=0x7fcef800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf09600640 1 -- 172.21.15.59:0/3920838036 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef80052d0 con 0x7fcf0c0b4510 2024-05-30T17:01:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf09600640 1 -- 172.21.15.59:0/3920838036 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef8005470 con 0x7fcf0c0b4510 2024-05-30T17:01:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf09600640 1 -- 172.21.15.59:0/3920838036 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef8007260 con 0x7fcf0c0b4510 2024-05-30T17:01:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf13e00640 1 -- 172.21.15.59:0/3920838036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf0c157ed0 con 0x7fcf0c0b4510 2024-05-30T17:01:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf13e00640 1 -- 172.21.15.59:0/3920838036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf0c158490 con 0x7fcf0c0b4510 2024-05-30T17:01:03.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf13e00640 1 -- 172.21.15.59:0/3920838036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf0c068a90 con 0x7fcf0c0b4510 2024-05-30T17:01:03.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.991+0000 7fcf09600640 1 -- 172.21.15.59:0/3920838036 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 30) ==== 89772+0+0 (secure 0 0 0) 0x7fcef8007400 con 0x7fcf0c0b4510 2024-05-30T17:01:03.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.995+0000 7fcf09600640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fceec069760 0x7fceec06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:03.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.995+0000 7fcf09600640 1 -- 172.21.15.59:0/3920838036 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5878+0+0 (secure 0 0 0) 0x7fcef80848c0 con 0x7fcf0c0b4510 2024-05-30T17:01:03.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.995+0000 7fcf11400640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fceec069760 0x7fceec06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:03.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.995+0000 7fcf11400640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fceec069760 0x7fceec06bc20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcf000097c0 tx=0x7fcf00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:04.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:03.999+0000 7fcf09600640 1 -- 172.21.15.59:0/3920838036 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcef8056280 con 0x7fcf0c0b4510 2024-05-30T17:01:04.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.011+0000 7fcf09600640 1 -- 172.21.15.59:0/3920838036 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fcef80528f0 con 0x7fcf0c0b4510 2024-05-30T17:01:04.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 -- 172.21.15.59:0/3920838036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf0c06d2c0 con 0x7fcf0c0b4510 2024-05-30T17:01:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf09600640 1 -- 172.21.15.59:0/3920838036 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5186 (secure 0 0 0) 0x7fcef808a910 con 0x7fcf0c0b4510 2024-05-30T17:01:04.205 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:04.205 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2633891859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2633891859},{"type":"v1","addr":"172.21.15.59:6835","nonce":2633891859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6865,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3975520725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3975520725},{"type":"v1","addr":"172.21.15.107:6836","nonce":3975520725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/456119548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":456119548},{"type":"v1","addr":"172.21.15.59:6834","nonce":456119548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:59:36.461027+0000","modified":"2024-05-30T16:59:39.481680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7449},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7449":{"gid":7449,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/1253475085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1253475085},{"type":"v1","addr":"172.21.15.107:6837","nonce":1253475085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7449,"qdb_cluster":[7449]},"id":6}]} 2024-05-30T17:01:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 53 2024-05-30T17:01:04.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 -- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fceec069760 msgr2=0x7fceec06bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fceec069760 0x7fceec06bc20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcf000097c0 tx=0x7fcf00008040 comp rx=0 tx=0).stop 2024-05-30T17:01:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 -- 172.21.15.59:0/3920838036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf0c0b4510 msgr2=0x7fcf0c153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf0c0b4510 0x7fcf0c153a90 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fcef800c390 tx=0x7fcef800c850 comp rx=0 tx=0).stop 2024-05-30T17:01:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 -- 172.21.15.59:0/3920838036 shutdown_connections 2024-05-30T17:01:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fceec069760 0x7fceec06bc20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf0c0b48f0 0x7fcf0c153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf0c0b4510 0x7fcf0c153a90 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 --2- 172.21.15.59:0/3920838036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c072d00 0x7fcf0c140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 -- 172.21.15.59:0/3920838036 >> 172.21.15.59:0/3920838036 conn(0x7fcf0c0b3240 msgr2=0x7fcf0c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 -- 172.21.15.59:0/3920838036 shutdown_connections 2024-05-30T17:01:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.203+0000 7fcf13e00640 1 -- 172.21.15.59:0/3920838036 wait complete. 2024-05-30T17:01:04.227 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:01:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.363+0000 7fcdb8c00640 1 Processor -- start 2024-05-30T17:01:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.363+0000 7fcdb8c00640 1 -- start start 2024-05-30T17:01:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.367+0000 7fcdb8c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdb415e710 0x7fcdb41614e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.367+0000 7fcdb8c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdb41627a0 con 0x7fcdb4161a20 2024-05-30T17:01:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.367+0000 7fcdb8c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdb4162a80 con 0x7fcdb4161ea0 2024-05-30T17:01:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.367+0000 7fcdb8c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb40d0660 con 0x7fcdb415e710 2024-05-30T17:01:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.367+0000 7fcdabe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcdb4161a20 0x7fcdb40d0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43392/0 (socket says 172.21.15.59:43392) 2024-05-30T17:01:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.367+0000 7fcdabe00640 1 -- 172.21.15.59:0/3678529859 learned_addr learned my addr 172.21.15.59:0/3678529859 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.367+0000 7fcdb1e00640 1 --2- 172.21.15.59:0/3678529859 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdb415e710 0x7fcdb41614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.367+0000 7fcdb1400640 1 -- 172.21.15.59:0/3678529859 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833064522 0 0) 0x7fcdb41627a0 con 0x7fcdb4161a20 2024-05-30T17:01:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.367+0000 7fcdb1400640 1 -- 172.21.15.59:0/3678529859 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd98003530 con 0x7fcdb4161a20 2024-05-30T17:01:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.367+0000 7fcdb1e00640 1 -- 172.21.15.59:0/3678529859 >> v1:172.21.15.107:6789/0 conn(0x7fcdb4161ea0 legacy=0x7fcdb40d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.367+0000 7fcdb1e00640 1 -- 172.21.15.59:0/3678529859 >> v1:172.21.15.59:6789/0 conn(0x7fcdb4161a20 legacy=0x7fcdb40d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.367+0000 7fcdb1e00640 1 -- 172.21.15.59:0/3678529859 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb4162d60 con 0x7fcdb415e710 2024-05-30T17:01:04.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb1e00640 1 --2- 172.21.15.59:0/3678529859 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdb415e710 0x7fcdb41614e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcda40097f0 tx=0x7fcda401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bbcd133a3a27323 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:04.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb1400640 1 -- 172.21.15.59:0/3678529859 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda40ab5f0 con 0x7fcdb415e710 2024-05-30T17:01:04.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb1400640 1 -- 172.21.15.59:0/3678529859 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda40b0070 con 0x7fcdb415e710 2024-05-30T17:01:04.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb1400640 1 -- 172.21.15.59:0/3678529859 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda40ab990 con 0x7fcdb415e710 2024-05-30T17:01:04.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb8c00640 1 -- 172.21.15.59:0/3678529859 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdb415e710 msgr2=0x7fcdb41614e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb8c00640 1 --2- 172.21.15.59:0/3678529859 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdb415e710 0x7fcdb41614e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcda40097f0 tx=0x7fcda401c4e0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb8c00640 1 -- 172.21.15.59:0/3678529859 shutdown_connections 2024-05-30T17:01:04.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb8c00640 1 --2- 172.21.15.59:0/3678529859 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdb415e710 0x7fcdb41614e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb8c00640 1 -- 172.21.15.59:0/3678529859 >> 172.21.15.59:0/3678529859 conn(0x7fcdb40b3f50 msgr2=0x7fcdb40b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:04.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb8c00640 1 -- 172.21.15.59:0/3678529859 shutdown_connections 2024-05-30T17:01:04.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb8c00640 1 -- 172.21.15.59:0/3678529859 wait complete. 2024-05-30T17:01:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb8c00640 1 Processor -- start 2024-05-30T17:01:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.371+0000 7fcdb8c00640 1 -- start start 2024-05-30T17:01:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdb8c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdb415e710 0x7fcdb4159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdb8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb4161a20 0x7fcdb40b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdb8c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdb4161ea0 0x7fcdb40b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdb8c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb415fc80 con 0x7fcdb4161a20 2024-05-30T17:01:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdb8c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb415fb00 con 0x7fcdb4161ea0 2024-05-30T17:01:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdb8c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb40d18b0 con 0x7fcdb415e710 2024-05-30T17:01:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdabe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb4161a20 0x7fcdb40b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdabe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb4161a20 0x7fcdb40b70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45606/0 (socket says 172.21.15.59:45606) 2024-05-30T17:01:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdabe00640 1 -- 172.21.15.59:0/577463886 learned_addr learned my addr 172.21.15.59:0/577463886 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdb1e00640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdb415e710 0x7fcdb4159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdb2800640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdb4161ea0 0x7fcdb40b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdabe00640 1 -- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdb415e710 msgr2=0x7fcdb4159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdabe00640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdb415e710 0x7fcdb4159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdabe00640 1 -- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdb4161ea0 msgr2=0x7fcdb40b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdabe00640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdb4161ea0 0x7fcdb40b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdabe00640 1 -- 172.21.15.59:0/577463886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb415c9d0 con 0x7fcdb4161a20 2024-05-30T17:01:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdabe00640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb4161a20 0x7fcdb40b70a0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00c450 tx=0x7fcd9c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdaa000640 1 -- 172.21.15.59:0/577463886 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c017070 con 0x7fcdb4161a20 2024-05-30T17:01:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdaa000640 1 -- 172.21.15.59:0/577463886 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd9c005cf0 con 0x7fcdb4161a20 2024-05-30T17:01:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdaa000640 1 -- 172.21.15.59:0/577463886 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c007270 con 0x7fcdb4161a20 2024-05-30T17:01:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdb8c00640 1 -- 172.21.15.59:0/577463886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb415ccb0 con 0x7fcdb4161a20 2024-05-30T17:01:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdb8c00640 1 -- 172.21.15.59:0/577463886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb415d270 con 0x7fcdb4161a20 2024-05-30T17:01:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdb8c00640 1 -- 172.21.15.59:0/577463886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb4068a90 con 0x7fcdb4161a20 2024-05-30T17:01:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.375+0000 7fcdaa000640 1 -- 172.21.15.59:0/577463886 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fcd9c01a070 con 0x7fcdb4161a20 2024-05-30T17:01:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.379+0000 7fcdaa000640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcd90069850 0x7fcd9006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.379+0000 7fcdaa000640 1 -- 172.21.15.59:0/577463886 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5878+0+0 (secure 0 0 0) 0x7fcd9c084880 con 0x7fcdb4161a20 2024-05-30T17:01:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.379+0000 7fcdb1e00640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcd90069850 0x7fcd9006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.379+0000 7fcdb1e00640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcd90069850 0x7fcd9006bd10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcda40af000 tx=0x7fcda40b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.383+0000 7fcdaa000640 1 -- 172.21.15.59:0/577463886 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd9c0562a0 con 0x7fcdb4161a20 2024-05-30T17:01:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.579+0000 7fcdb8c00640 1 -- 172.21.15.59:0/577463886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcdb415f890 con 0x7fcdb4161a20 2024-05-30T17:01:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.579+0000 7fcdaa000640 1 -- 172.21.15.59:0/577463886 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5186 (secure 0 0 0) 0x7fcd9c05a5a0 con 0x7fcdb4161a20 2024-05-30T17:01:04.584 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:04.584 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2633891859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2633891859},{"type":"v1","addr":"172.21.15.59:6835","nonce":2633891859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6865,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3975520725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3975520725},{"type":"v1","addr":"172.21.15.107:6836","nonce":3975520725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/456119548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":456119548},{"type":"v1","addr":"172.21.15.59:6834","nonce":456119548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:59:36.461027+0000","modified":"2024-05-30T16:59:39.481680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7449},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7449":{"gid":7449,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/1253475085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1253475085},{"type":"v1","addr":"172.21.15.107:6837","nonce":1253475085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7449,"qdb_cluster":[7449]},"id":6}]} 2024-05-30T17:01:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 53 2024-05-30T17:01:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.583+0000 7fcdb8c00640 1 -- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcd90069850 msgr2=0x7fcd9006bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.583+0000 7fcdb8c00640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcd90069850 0x7fcd9006bd10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcda40af000 tx=0x7fcda40b6040 comp rx=0 tx=0).stop 2024-05-30T17:01:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.583+0000 7fcdb8c00640 1 -- 172.21.15.59:0/577463886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb4161a20 msgr2=0x7fcdb40b70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.583+0000 7fcdb8c00640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb4161a20 0x7fcdb40b70a0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00c450 tx=0x7fcd9c00c910 comp rx=0 tx=0).stop 2024-05-30T17:01:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.583+0000 7fcdb8c00640 1 -- 172.21.15.59:0/577463886 shutdown_connections 2024-05-30T17:01:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.583+0000 7fcdb8c00640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcd90069850 0x7fcd9006bd10 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.583+0000 7fcdb8c00640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdb4161ea0 0x7fcdb40b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.583+0000 7fcdb8c00640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb4161a20 0x7fcdb40b70a0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.583+0000 7fcdb8c00640 1 --2- 172.21.15.59:0/577463886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdb415e710 0x7fcdb4159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.583+0000 7fcdb8c00640 1 -- 172.21.15.59:0/577463886 >> 172.21.15.59:0/577463886 conn(0x7fcdb40b3f50 msgr2=0x7fcdb406ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.583+0000 7fcdb8c00640 1 -- 172.21.15.59:0/577463886 shutdown_connections 2024-05-30T17:01:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.583+0000 7fcdb8c00640 1 -- 172.21.15.59:0/577463886 wait complete. 2024-05-30T17:01:04.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:01:04.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.743+0000 7fc4b8000640 1 Processor -- start 2024-05-30T17:01:04.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.743+0000 7fc4b8000640 1 -- start start 2024-05-30T17:01:04.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b8000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4b0159df0 0x7fc4b00ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:04.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b8000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc4b015a1d0 0x7fc4b00ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:04.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b8000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b015d730 con 0x7fc4b00b3e50 2024-05-30T17:01:04.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b8000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b00b3370 con 0x7fc4b015a1d0 2024-05-30T17:01:04.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b8000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b00b3650 con 0x7fc4b0159df0 2024-05-30T17:01:04.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b6000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc4b00b3e50 0x7fc4b015ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43394/0 (socket says 172.21.15.59:43394) 2024-05-30T17:01:04.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b6000640 1 -- 172.21.15.59:0/792990504 learned_addr learned my addr 172.21.15.59:0/792990504 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:04.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b5600640 1 --2- 172.21.15.59:0/792990504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4b0159df0 0x7fc4b00ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:04.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b4c00640 1 --2- 172.21.15.59:0/792990504 >> v2:172.21.15.107:3300/0 conn(0x7fc4b015a1d0 0x7fc4b00ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:04.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4afe00640 1 -- 172.21.15.59:0/792990504 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217055862 0 0) 0x7fc4b015d730 con 0x7fc4b00b3e50 2024-05-30T17:01:04.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4afe00640 1 -- 172.21.15.59:0/792990504 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc498003530 con 0x7fc4b00b3e50 2024-05-30T17:01:04.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b5600640 1 -- 172.21.15.59:0/792990504 >> v2:172.21.15.107:3300/0 conn(0x7fc4b015a1d0 msgr2=0x7fc4b00ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:04.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b5600640 1 --2- 172.21.15.59:0/792990504 >> v2:172.21.15.107:3300/0 conn(0x7fc4b015a1d0 0x7fc4b00ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b5600640 1 -- 172.21.15.59:0/792990504 >> v1:172.21.15.59:6789/0 conn(0x7fc4b00b3e50 legacy=0x7fc4b015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.747+0000 7fc4b5600640 1 -- 172.21.15.59:0/792990504 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b00b3930 con 0x7fc4b0159df0 2024-05-30T17:01:04.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b5600640 1 --2- 172.21.15.59:0/792990504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4b0159df0 0x7fc4b00ad1b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40097c0 tx=0x7fc4a401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bedb3e755ca009 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:04.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4afe00640 1 -- 172.21.15.59:0/792990504 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40b0070 con 0x7fc4b0159df0 2024-05-30T17:01:04.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4afe00640 1 -- 172.21.15.59:0/792990504 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a40ab600 con 0x7fc4b0159df0 2024-05-30T17:01:04.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4afe00640 1 -- 172.21.15.59:0/792990504 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40ab9b0 con 0x7fc4b0159df0 2024-05-30T17:01:04.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 -- 172.21.15.59:0/792990504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4b0159df0 msgr2=0x7fc4b00ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 --2- 172.21.15.59:0/792990504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4b0159df0 0x7fc4b00ad1b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40097c0 tx=0x7fc4a401c4a0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 -- 172.21.15.59:0/792990504 shutdown_connections 2024-05-30T17:01:04.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 --2- 172.21.15.59:0/792990504 >> v2:172.21.15.107:3300/0 conn(0x7fc4b015a1d0 0x7fc4b00ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 --2- 172.21.15.59:0/792990504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4b0159df0 0x7fc4b00ad1b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 -- 172.21.15.59:0/792990504 >> 172.21.15.59:0/792990504 conn(0x7fc4b00b22d0 msgr2=0x7fc4b00b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 -- 172.21.15.59:0/792990504 shutdown_connections 2024-05-30T17:01:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 -- 172.21.15.59:0/792990504 wait complete. 2024-05-30T17:01:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 Processor -- start 2024-05-30T17:01:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 -- start start 2024-05-30T17:01:04.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4b00b3e50 0x7fc4b01466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:04.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4b0159df0 0x7fc4b015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:04.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b015a1d0 0x7fc4b0157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b015e720 con 0x7fc4b015a1d0 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b015e5a0 con 0x7fc4b0159df0 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.751+0000 7fc4b8000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b015e8a0 con 0x7fc4b00b3e50 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b015a1d0 0x7fc4b0157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b015a1d0 0x7fc4b0157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45622/0 (socket says 172.21.15.59:45622) 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b6000640 1 -- 172.21.15.59:0/3161254603 learned_addr learned my addr 172.21.15.59:0/3161254603 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b5600640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4b00b3e50 0x7fc4b01466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b4c00640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4b0159df0 0x7fc4b015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b6000640 1 -- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4b00b3e50 msgr2=0x7fc4b01466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b6000640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4b00b3e50 0x7fc4b01466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b6000640 1 -- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4b0159df0 msgr2=0x7fc4b015ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b6000640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4b0159df0 0x7fc4b015ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b6000640 1 -- 172.21.15.59:0/3161254603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b0149b90 con 0x7fc4b015a1d0 2024-05-30T17:01:04.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b4c00640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4b0159df0 0x7fc4b015ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:04.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b6000640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b015a1d0 0x7fc4b0157b70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800cad0 tx=0x7fc4a800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:04.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4ad600640 1 -- 172.21.15.59:0/3161254603 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8017070 con 0x7fc4b015a1d0 2024-05-30T17:01:04.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4ad600640 1 -- 172.21.15.59:0/3161254603 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a800ac30 con 0x7fc4b015a1d0 2024-05-30T17:01:04.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4ad600640 1 -- 172.21.15.59:0/3161254603 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8012400 con 0x7fc4b015a1d0 2024-05-30T17:01:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b8000640 1 -- 172.21.15.59:0/3161254603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b0149e70 con 0x7fc4b015a1d0 2024-05-30T17:01:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b8000640 1 -- 172.21.15.59:0/3161254603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b0157370 con 0x7fc4b015a1d0 2024-05-30T17:01:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4b8000640 1 -- 172.21.15.59:0/3161254603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b0068a90 con 0x7fc4b015a1d0 2024-05-30T17:01:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.755+0000 7fc4ad600640 1 -- 172.21.15.59:0/3161254603 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fc4a801a070 con 0x7fc4b015a1d0 2024-05-30T17:01:04.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.759+0000 7fc4ad600640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc490069850 0x7fc49006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:04.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.759+0000 7fc4ad600640 1 -- 172.21.15.59:0/3161254603 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5878+0+0 (secure 0 0 0) 0x7fc4a80854a0 con 0x7fc4b015a1d0 2024-05-30T17:01:04.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.759+0000 7fc4b5600640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc490069850 0x7fc49006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:04.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.759+0000 7fc4b5600640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc490069850 0x7fc49006bd10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40ad000 tx=0x7fc4a40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:04.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.763+0000 7fc4ad600640 1 -- 172.21.15.59:0/3161254603 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc4a80574b0 con 0x7fc4b015a1d0 2024-05-30T17:01:04.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.927+0000 7fc4b8000640 1 -- 172.21.15.59:0/3161254603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4b00b4ef0 con 0x7fc4b015a1d0 2024-05-30T17:01:04.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4ad600640 1 -- 172.21.15.59:0/3161254603 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+16940 (secure 0 0 0) 0x7fc4a8056db0 con 0x7fc4b015a1d0 2024-05-30T17:01:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:04.932 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":93,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:01:02.996754+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:59:34.157525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-05-30T16:59:35.464679+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.22","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:01:04.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4b8000640 1 -- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc490069850 msgr2=0x7fc49006bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4b8000640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc490069850 0x7fc49006bd10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40ad000 tx=0x7fc4a40a6000 comp rx=0 tx=0).stop 2024-05-30T17:01:04.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4b8000640 1 -- 172.21.15.59:0/3161254603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b015a1d0 msgr2=0x7fc4b0157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:04.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4b8000640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b015a1d0 0x7fc4b0157b70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800cad0 tx=0x7fc4a800cf90 comp rx=0 tx=0).stop 2024-05-30T17:01:04.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4b8000640 1 -- 172.21.15.59:0/3161254603 shutdown_connections 2024-05-30T17:01:04.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4b8000640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc490069850 0x7fc49006bd10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4b8000640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b015a1d0 0x7fc4b0157b70 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4b8000640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4b0159df0 0x7fc4b015ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4b8000640 1 --2- 172.21.15.59:0/3161254603 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc4b00b3e50 0x7fc4b01466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:04.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4b8000640 1 -- 172.21.15.59:0/3161254603 >> 172.21.15.59:0/3161254603 conn(0x7fc4b00b22d0 msgr2=0x7fc4b00ad1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:04.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4b8000640 1 -- 172.21.15.59:0/3161254603 shutdown_connections 2024-05-30T17:01:04.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:04.931+0000 7fc4b8000640 1 -- 172.21.15.59:0/3161254603 wait complete. 2024-05-30T17:01:04.955 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T17:01:04.955 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:01:05.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2d5800640 1 Processor -- start 2024-05-30T17:01:05.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2d5800640 1 -- start start 2024-05-30T17:01:05.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2d5800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2d0160d90 0x7fb2d009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2d5800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2d009b780 0x7fb2d009af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2d5800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d00d1310 con 0x7fb2d00711e0 2024-05-30T17:01:05.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2d5800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d00ced30 con 0x7fb2d0160d90 2024-05-30T17:01:05.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2d5800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d009bcf0 con 0x7fb2d009b780 2024-05-30T17:01:05.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2cea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2d0160d90 0x7fb2d009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2cea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2d0160d90 0x7fb2d009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45628/0 (socket says 172.21.15.59:45628) 2024-05-30T17:01:05.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2cf400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb2d00711e0 0x7fb2d006ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43398/0 (socket says 172.21.15.59:43398) 2024-05-30T17:01:05.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2cea00640 1 -- 172.21.15.59:0/3980822200 learned_addr learned my addr 172.21.15.59:0/3980822200 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:05.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2c6000640 1 --2- 172.21.15.59:0/3980822200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2d009b780 0x7fb2d009af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2cea00640 1 -- 172.21.15.59:0/3980822200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2d009b780 msgr2=0x7fb2d009af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:05.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2cea00640 1 --2- 172.21.15.59:0/3980822200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2d009b780 0x7fb2d009af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2cea00640 1 -- 172.21.15.59:0/3980822200 >> v1:172.21.15.59:6789/0 conn(0x7fb2d00711e0 legacy=0x7fb2d006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:05.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2cea00640 1 -- 172.21.15.59:0/3980822200 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d00d0a70 con 0x7fb2d0160d90 2024-05-30T17:01:05.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2ce000640 1 -- 172.21.15.59:0/3980822200 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405084999 0 0) 0x7fb2d00d1310 con 0x7fb2d00711e0 2024-05-30T17:01:05.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.099+0000 7fb2c6000640 1 --2- 172.21.15.59:0/3980822200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2d009b780 0x7fb2d009af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:05.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.103+0000 7fb2cea00640 1 --2- 172.21.15.59:0/3980822200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d0160d90 0x7fb2d009aa40 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009870 tx=0x7fb2c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3162d40659115356 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:05.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.103+0000 7fb2ce000640 1 -- 172.21.15.59:0/3980822200 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00b0070 con 0x7fb2d0160d90 2024-05-30T17:01:05.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.103+0000 7fb2ce000640 1 -- 172.21.15.59:0/3980822200 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c00ab600 con 0x7fb2d0160d90 2024-05-30T17:01:05.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.103+0000 7fb2ce000640 1 -- 172.21.15.59:0/3980822200 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00ab9d0 con 0x7fb2d0160d90 2024-05-30T17:01:05.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.103+0000 7fb2d5800640 1 -- 172.21.15.59:0/3980822200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d0160d90 msgr2=0x7fb2d009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:05.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.103+0000 7fb2d5800640 1 --2- 172.21.15.59:0/3980822200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d0160d90 0x7fb2d009aa40 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009870 tx=0x7fb2c001c4d0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.103+0000 7fb2d5800640 1 -- 172.21.15.59:0/3980822200 shutdown_connections 2024-05-30T17:01:05.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.103+0000 7fb2d5800640 1 --2- 172.21.15.59:0/3980822200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2d009b780 0x7fb2d009af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.103+0000 7fb2d5800640 1 --2- 172.21.15.59:0/3980822200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d0160d90 0x7fb2d009aa40 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.103+0000 7fb2d5800640 1 -- 172.21.15.59:0/3980822200 >> 172.21.15.59:0/3980822200 conn(0x7fb2d00b3f80 msgr2=0x7fb2d00b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:05.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.103+0000 7fb2d5800640 1 -- 172.21.15.59:0/3980822200 shutdown_connections 2024-05-30T17:01:05.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.103+0000 7fb2d5800640 1 -- 172.21.15.59:0/3980822200 wait complete. 2024-05-30T17:01:05.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2d5800640 1 Processor -- start 2024-05-30T17:01:05.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2d5800640 1 -- start start 2024-05-30T17:01:05.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2d5800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2d00711e0 0x7fb2d0151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2d5800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2d009b780 0x7fb2d006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2d5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d0160d90 0x7fb2d00b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2d5800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d0071fe0 con 0x7fb2d0160d90 2024-05-30T17:01:05.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2d5800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d0071e60 con 0x7fb2d00711e0 2024-05-30T17:01:05.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2d5800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d0161170 con 0x7fb2d009b780 2024-05-30T17:01:05.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2cf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d0160d90 0x7fb2d00b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2cf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d0160d90 0x7fb2d00b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45630/0 (socket says 172.21.15.59:45630) 2024-05-30T17:01:05.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2cf400640 1 -- 172.21.15.59:0/3121725018 learned_addr learned my addr 172.21.15.59:0/3121725018 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:05.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2cea00640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2d00711e0 0x7fb2d0151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2c6000640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2d009b780 0x7fb2d006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2cf400640 1 -- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2d009b780 msgr2=0x7fb2d006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:05.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2cf400640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2d009b780 0x7fb2d006cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2cf400640 1 -- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2d00711e0 msgr2=0x7fb2d0151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:05.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2cf400640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2d00711e0 0x7fb2d0151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2cf400640 1 -- 172.21.15.59:0/3121725018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d0165b20 con 0x7fb2d0160d90 2024-05-30T17:01:05.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2cf400640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d0160d90 0x7fb2d00b50b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800c780 tx=0x7fb2c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:05.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2c7400640 1 -- 172.21.15.59:0/3121725018 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800ce30 con 0x7fb2d0160d90 2024-05-30T17:01:05.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2c7400640 1 -- 172.21.15.59:0/3121725018 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c800a640 con 0x7fb2d0160d90 2024-05-30T17:01:05.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2c7400640 1 -- 172.21.15.59:0/3121725018 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800aa70 con 0x7fb2d0160d90 2024-05-30T17:01:05.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2d5800640 1 -- 172.21.15.59:0/3121725018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d0165e00 con 0x7fb2d0160d90 2024-05-30T17:01:05.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.107+0000 7fb2d5800640 1 -- 172.21.15.59:0/3121725018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d0151a90 con 0x7fb2d0160d90 2024-05-30T17:01:05.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.111+0000 7fb2d5800640 1 -- 172.21.15.59:0/3121725018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d0068a90 con 0x7fb2d0160d90 2024-05-30T17:01:05.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.111+0000 7fb2c7400640 1 -- 172.21.15.59:0/3121725018 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fb2c800ac10 con 0x7fb2d0160d90 2024-05-30T17:01:05.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.111+0000 7fb2c7400640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2ac069850 0x7fb2ac06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.111+0000 7fb2c7400640 1 -- 172.21.15.59:0/3121725018 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5878+0+0 (secure 0 0 0) 0x7fb2c8085890 con 0x7fb2d0160d90 2024-05-30T17:01:05.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.111+0000 7fb2cea00640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2ac069850 0x7fb2ac06bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.111+0000 7fb2cea00640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2ac069850 0x7fb2ac06bd10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00ad000 tx=0x7fb2c00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:05.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.115+0000 7fb2c7400640 1 -- 172.21.15.59:0/3121725018 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb2c8056e70 con 0x7fb2d0160d90 2024-05-30T17:01:05.316 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:01:05.321 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:01:05.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.487+0000 7fb2d5800640 1 -- 172.21.15.59:0/3121725018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2d00b4be0 con 0x7fb2d0160d90 2024-05-30T17:01:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.491+0000 7fb2c7400640 1 -- 172.21.15.59:0/3121725018 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5186 (secure 0 0 0) 0x7fb2c805b170 con 0x7fb2d0160d90 2024-05-30T17:01:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:05.493 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2633891859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2633891859},{"type":"v1","addr":"172.21.15.59:6835","nonce":2633891859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6865,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3975520725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3975520725},{"type":"v1","addr":"172.21.15.107:6836","nonce":3975520725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/456119548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":456119548},{"type":"v1","addr":"172.21.15.59:6834","nonce":456119548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:59:36.461027+0000","modified":"2024-05-30T16:59:39.481680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7449},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7449":{"gid":7449,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/1253475085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1253475085},{"type":"v1","addr":"172.21.15.107:6837","nonce":1253475085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7449,"qdb_cluster":[7449]},"id":6}]} 2024-05-30T17:01:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 53 2024-05-30T17:01:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.495+0000 7fb2d5800640 1 -- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2ac069850 msgr2=0x7fb2ac06bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.495+0000 7fb2d5800640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2ac069850 0x7fb2ac06bd10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00ad000 tx=0x7fb2c00a6000 comp rx=0 tx=0).stop 2024-05-30T17:01:05.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.495+0000 7fb2d5800640 1 -- 172.21.15.59:0/3121725018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d0160d90 msgr2=0x7fb2d00b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:05.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.495+0000 7fb2d5800640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d0160d90 0x7fb2d00b50b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800c780 tx=0x7fb2c800cc40 comp rx=0 tx=0).stop 2024-05-30T17:01:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.499+0000 7fb2d5800640 1 -- 172.21.15.59:0/3121725018 shutdown_connections 2024-05-30T17:01:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.499+0000 7fb2d5800640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2ac069850 0x7fb2ac06bd10 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.499+0000 7fb2d5800640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d0160d90 0x7fb2d00b50b0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.499+0000 7fb2d5800640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2d009b780 0x7fb2d006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.499+0000 7fb2d5800640 1 --2- 172.21.15.59:0/3121725018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2d00711e0 0x7fb2d0151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.499+0000 7fb2d5800640 1 -- 172.21.15.59:0/3121725018 >> 172.21.15.59:0/3121725018 conn(0x7fb2d00b3f80 msgr2=0x7fb2d006ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:05.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.499+0000 7fb2d5800640 1 -- 172.21.15.59:0/3121725018 shutdown_connections 2024-05-30T17:01:05.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.499+0000 7fb2d5800640 1 -- 172.21.15.59:0/3121725018 wait complete. 2024-05-30T17:01:05.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:01:05.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.775+0000 7fc7a6800640 1 Processor -- start 2024-05-30T17:01:05.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.775+0000 7fc7a6800640 1 -- start start 2024-05-30T17:01:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc7a6800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc7a00b20f0 0x7fc7a00cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc7a6800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a00b2d40 con 0x7fc7a00afb70 2024-05-30T17:01:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc7a6800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a00b2780 con 0x7fc7a015b8f0 2024-05-30T17:01:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc7a6800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a00b2530 con 0x7fc7a00b20f0 2024-05-30T17:01:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79f400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc7a015b8f0 0x7fc7a00cfc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:41328/0 (socket says 172.21.15.59:41328) 2024-05-30T17:01:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79f400640 1 -- 172.21.15.59:0/4061349519 learned_addr learned my addr 172.21.15.59:0/4061349519 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 12731053 0 0) 0x7fc7a00b2780 con 0x7fc7a015b8f0 2024-05-30T17:01:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc784003530 con 0x7fc7a015b8f0 2024-05-30T17:01:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79ea00640 1 --2- 172.21.15.59:0/4061349519 >> v2:172.21.15.107:3300/0 conn(0x7fc7a00b20f0 0x7fc7a00cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3376161943 0 0) 0x7fc7a00b2d40 con 0x7fc7a00afb70 2024-05-30T17:01:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a00b2780 con 0x7fc7a00afb70 2024-05-30T17:01:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1837903604 0 0) 0x7fc784003530 con 0x7fc7a015b8f0 2024-05-30T17:01:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 >> v2:172.21.15.107:3300/0 conn(0x7fc7a00b20f0 msgr2=0x7fc7a00cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 --2- 172.21.15.59:0/4061349519 >> v2:172.21.15.107:3300/0 conn(0x7fc7a00b20f0 0x7fc7a00cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 >> v1:172.21.15.59:6789/0 conn(0x7fc7a00afb70 legacy=0x7fc7a00b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a00b2a60 con 0x7fc7a015b8f0 2024-05-30T17:01:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fc78c001600 con 0x7fc7a015b8f0 2024-05-30T17:01:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 >> v1:172.21.15.107:6789/0 conn(0x7fc7a015b8f0 legacy=0x7fc7a00cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 --2- 172.21.15.59:0/4061349519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc784003b50 0x7fc784003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 --2- 172.21.15.59:0/4061349519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc784004810 0x7fc784004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 --2- 172.21.15.59:0/4061349519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7840051d0 0x7fc78400fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a00b2530 con 0x7fc784004810 2024-05-30T17:01:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc784010460 con 0x7fc7840051d0 2024-05-30T17:01:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc784010660 con 0x7fc784003b50 2024-05-30T17:01:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.779+0000 7fc79f400640 1 --2- 172.21.15.59:0/4061349519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc784003b50 0x7fc784003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.783+0000 7fc79ea00640 1 --2- 172.21.15.59:0/4061349519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc784004810 0x7fc784004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.783+0000 7fc79fe00640 1 --2- 172.21.15.59:0/4061349519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7840051d0 0x7fc78400fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.783+0000 7fc79ea00640 1 -- 172.21.15.59:0/4061349519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc784003b50 msgr2=0x7fc784003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.783+0000 7fc79ea00640 1 --2- 172.21.15.59:0/4061349519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc784003b50 0x7fc784003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.783+0000 7fc79ea00640 1 -- 172.21.15.59:0/4061349519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7840051d0 msgr2=0x7fc78400fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.783+0000 7fc79ea00640 1 --2- 172.21.15.59:0/4061349519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7840051d0 0x7fc78400fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.783+0000 7fc79ea00640 1 -- 172.21.15.59:0/4061349519 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a00b2a60 con 0x7fc784004810 2024-05-30T17:01:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.783+0000 7fc79fe00640 1 -- 172.21.15.59:0/4061349519 reap_dead start 2024-05-30T17:01:05.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.787+0000 7fc79ea00640 1 --2- 172.21.15.59:0/4061349519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc784004810 0x7fc784004c90 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc790009ae0 tx=0x7fc79001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c648fc10aac22c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:05.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.787+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7900b2070 con 0x7fc784004810 2024-05-30T17:01:05.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.787+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7900a5660 con 0x7fc784004810 2024-05-30T17:01:05.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.787+0000 7fc79e000640 1 -- 172.21.15.59:0/4061349519 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7900096b0 con 0x7fc784004810 2024-05-30T17:01:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.787+0000 7fc7a6800640 1 -- 172.21.15.59:0/4061349519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc784004810 msgr2=0x7fc784004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.787+0000 7fc7a6800640 1 --2- 172.21.15.59:0/4061349519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc784004810 0x7fc784004c90 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc790009ae0 tx=0x7fc79001ca70 comp rx=0 tx=0).stop 2024-05-30T17:01:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.787+0000 7fc7a6800640 1 -- 172.21.15.59:0/4061349519 shutdown_connections 2024-05-30T17:01:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.787+0000 7fc7a6800640 1 --2- 172.21.15.59:0/4061349519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc784004810 0x7fc784004c90 secure :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc790009ae0 tx=0x7fc79001ca70 comp rx=0 tx=0).stop 2024-05-30T17:01:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.787+0000 7fc7a6800640 1 -- 172.21.15.59:0/4061349519 >> 172.21.15.59:0/4061349519 conn(0x7fc7a00b2f50 msgr2=0x7fc7a00b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.791+0000 7fc7a6800640 1 -- 172.21.15.59:0/4061349519 shutdown_connections 2024-05-30T17:01:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.791+0000 7fc7a6800640 1 -- 172.21.15.59:0/4061349519 wait complete. 2024-05-30T17:01:05.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.791+0000 7fc7a6800640 1 Processor -- start 2024-05-30T17:01:05.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.791+0000 7fc7a6800640 1 -- start start 2024-05-30T17:01:05.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc7a6800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7a00c9600 0x7fc7a00cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc7a6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a00c99e0 0x7fc7a00b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc7a6800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7a00c8490 0x7fc7a00b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc79f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7a00c9600 0x7fc7a00cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc7a6800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a015bcd0 con 0x7fc7a00c99e0 2024-05-30T17:01:05.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc7a6800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a00af650 con 0x7fc7a00c8490 2024-05-30T17:01:05.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc7a6800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a015be50 con 0x7fc7a00c9600 2024-05-30T17:01:05.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc79f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7a00c9600 0x7fc7a00cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:36248/0 (socket says 172.21.15.59:36248) 2024-05-30T17:01:05.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc79f400640 1 -- 172.21.15.59:0/3401232407 learned_addr learned my addr 172.21.15.59:0/3401232407 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:05.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc79ea00640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a00c99e0 0x7fc7a00b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc79f400640 1 -- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7a00c8490 msgr2=0x7fc7a00b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:05.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc79f400640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7a00c8490 0x7fc7a00b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc79f400640 1 -- 172.21.15.59:0/3401232407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a00c99e0 msgr2=0x7fc7a00b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:05.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc79f400640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a00c99e0 0x7fc7a00b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:05.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc79f400640 1 -- 172.21.15.59:0/3401232407 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a00cb910 con 0x7fc7a00c9600 2024-05-30T17:01:05.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc79f400640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7a00c9600 0x7fc7a00cb3d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0072c0 tx=0x7fc78c007780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:05.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc797400640 1 -- 172.21.15.59:0/3401232407 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c00f940 con 0x7fc7a00c9600 2024-05-30T17:01:05.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.795+0000 7fc797400640 1 -- 172.21.15.59:0/3401232407 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc78c018070 con 0x7fc7a00c9600 2024-05-30T17:01:05.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.799+0000 7fc797400640 1 -- 172.21.15.59:0/3401232407 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c00fce0 con 0x7fc7a00c9600 2024-05-30T17:01:05.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.799+0000 7fc7a6800640 1 -- 172.21.15.59:0/3401232407 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a00c8a50 con 0x7fc7a00c9600 2024-05-30T17:01:05.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.799+0000 7fc7a6800640 1 -- 172.21.15.59:0/3401232407 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a01f1720 con 0x7fc7a00c9600 2024-05-30T17:01:05.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.799+0000 7fc7a6800640 1 -- 172.21.15.59:0/3401232407 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a0068a90 con 0x7fc7a00c9600 2024-05-30T17:01:05.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.803+0000 7fc797400640 1 -- 172.21.15.59:0/3401232407 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fc78c01d460 con 0x7fc7a00c9600 2024-05-30T17:01:05.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.803+0000 7fc797400640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc780069880 0x7fc78006bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:05.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.803+0000 7fc797400640 1 -- 172.21.15.59:0/3401232407 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(93..93 src has 1..93) ==== 5878+0+0 (secure 0 0 0) 0x7fc78c0862c0 con 0x7fc7a00c9600 2024-05-30T17:01:05.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.803+0000 7fc79ea00640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc780069880 0x7fc78006bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:05.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.803+0000 7fc79ea00640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc780069880 0x7fc78006bd40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc7900af000 tx=0x7fc7900046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:05.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:05.811+0000 7fc797400640 1 -- 172.21.15.59:0/3401232407 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc7a00cb910 con 0x7fc7a00c9600 2024-05-30T17:01:06.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.075+0000 7fc7a6800640 1 -- 172.21.15.59:0/3401232407 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7a00b2d30 con 0x7fc7a00c9600 2024-05-30T17:01:06.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc797400640 1 -- 172.21.15.59:0/3401232407 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5186 (secure 0 0 0) 0x7fc78c0582d0 con 0x7fc7a00c9600 2024-05-30T17:01:06.081 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:06.081 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2633891859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2633891859},{"type":"v1","addr":"172.21.15.59:6835","nonce":2633891859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6865,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3975520725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3975520725},{"type":"v1","addr":"172.21.15.107:6836","nonce":3975520725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/456119548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":456119548},{"type":"v1","addr":"172.21.15.59:6834","nonce":456119548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:59:36.461027+0000","modified":"2024-05-30T16:59:39.481680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7449},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7449":{"gid":7449,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/1253475085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1253475085},{"type":"v1","addr":"172.21.15.107:6837","nonce":1253475085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7449,"qdb_cluster":[7449]},"id":6}]} 2024-05-30T17:01:06.081 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 53 2024-05-30T17:01:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc7a6800640 1 -- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc780069880 msgr2=0x7fc78006bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc7a6800640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc780069880 0x7fc78006bd40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc7900af000 tx=0x7fc7900046d0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc7a6800640 1 -- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7a00c9600 msgr2=0x7fc7a00cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc7a6800640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7a00c9600 0x7fc7a00cb3d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0072c0 tx=0x7fc78c007780 comp rx=0 tx=0).stop 2024-05-30T17:01:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc7a6800640 1 -- 172.21.15.59:0/3401232407 shutdown_connections 2024-05-30T17:01:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc7a6800640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc780069880 0x7fc78006bd40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc7a6800640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7a00c8490 0x7fc7a00b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc7a6800640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a00c99e0 0x7fc7a00b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc7a6800640 1 --2- 172.21.15.59:0/3401232407 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7a00c9600 0x7fc7a00cb3d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc7a6800640 1 -- 172.21.15.59:0/3401232407 >> 172.21.15.59:0/3401232407 conn(0x7fc7a00b2f50 msgr2=0x7fc7a0159e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc7a6800640 1 -- 172.21.15.59:0/3401232407 shutdown_connections 2024-05-30T17:01:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.079+0000 7fc7a6800640 1 -- 172.21.15.59:0/3401232407 wait complete. 2024-05-30T17:01:06.103 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:01:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa6a3e00640 1 Processor -- start 2024-05-30T17:01:06.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa6a3e00640 1 -- start start 2024-05-30T17:01:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa6a3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa69c159df0 0x7fa69c0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa6a3e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c15d730 con 0x7fa69c0b3e50 2024-05-30T17:01:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa6a3e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c0b3370 con 0x7fa69c15a1d0 2024-05-30T17:01:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa6a3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa69c0b3650 con 0x7fa69c159df0 2024-05-30T17:01:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa6a1e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa69c0b3e50 0x7fa69c15db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43416/0 (socket says 172.21.15.59:43416) 2024-05-30T17:01:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa6a1e00640 1 -- 172.21.15.59:0/698528171 learned_addr learned my addr 172.21.15.59:0/698528171 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa6a1400640 1 --2- 172.21.15.59:0/698528171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa69c159df0 0x7fa69c0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa69be00640 1 -- 172.21.15.59:0/698528171 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742486387 0 0) 0x7fa69c15d730 con 0x7fa69c0b3e50 2024-05-30T17:01:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa69be00640 1 -- 172.21.15.59:0/698528171 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa684003530 con 0x7fa69c0b3e50 2024-05-30T17:01:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa69be00640 1 -- 172.21.15.59:0/698528171 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3131694603 0 0) 0x7fa69c0b3370 con 0x7fa69c15a1d0 2024-05-30T17:01:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa69be00640 1 -- 172.21.15.59:0/698528171 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa69c15d730 con 0x7fa69c15a1d0 2024-05-30T17:01:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa6a1400640 1 -- 172.21.15.59:0/698528171 >> v1:172.21.15.107:6789/0 conn(0x7fa69c15a1d0 legacy=0x7fa69c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa6a1400640 1 -- 172.21.15.59:0/698528171 >> v1:172.21.15.59:6789/0 conn(0x7fa69c0b3e50 legacy=0x7fa69c15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.243+0000 7fa6a1400640 1 -- 172.21.15.59:0/698528171 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c0b3930 con 0x7fa69c159df0 2024-05-30T17:01:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.247+0000 7fa6a1400640 1 --2- 172.21.15.59:0/698528171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa69c159df0 0x7fa69c0ad1b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa6900097f0 tx=0x7fa69001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f87a31bb5ac923b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.247+0000 7fa69be00640 1 -- 172.21.15.59:0/698528171 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6900b0070 con 0x7fa69c159df0 2024-05-30T17:01:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.247+0000 7fa69be00640 1 -- 172.21.15.59:0/698528171 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6900ab600 con 0x7fa69c159df0 2024-05-30T17:01:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.247+0000 7fa69be00640 1 -- 172.21.15.59:0/698528171 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6900ab9d0 con 0x7fa69c159df0 2024-05-30T17:01:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.247+0000 7fa6a3e00640 1 -- 172.21.15.59:0/698528171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa69c159df0 msgr2=0x7fa69c0ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.247+0000 7fa6a3e00640 1 --2- 172.21.15.59:0/698528171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa69c159df0 0x7fa69c0ad1b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa6900097f0 tx=0x7fa69001c4e0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.247+0000 7fa6a3e00640 1 -- 172.21.15.59:0/698528171 shutdown_connections 2024-05-30T17:01:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.247+0000 7fa6a3e00640 1 --2- 172.21.15.59:0/698528171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa69c159df0 0x7fa69c0ad1b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.247+0000 7fa6a3e00640 1 -- 172.21.15.59:0/698528171 >> 172.21.15.59:0/698528171 conn(0x7fa69c0b22d0 msgr2=0x7fa69c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.247+0000 7fa6a3e00640 1 -- 172.21.15.59:0/698528171 shutdown_connections 2024-05-30T17:01:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.247+0000 7fa6a3e00640 1 -- 172.21.15.59:0/698528171 wait complete. 2024-05-30T17:01:06.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a3e00640 1 Processor -- start 2024-05-30T17:01:06.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a3e00640 1 -- start start 2024-05-30T17:01:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69c0b3e50 0x7fa69c148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa69c159df0 0x7fa69c147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa69c15a1d0 0x7fa69c147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a3e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c16a7a0 con 0x7fa69c159df0 2024-05-30T17:01:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a3e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c16a620 con 0x7fa69c0b3e50 2024-05-30T17:01:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa69c16a920 con 0x7fa69c15a1d0 2024-05-30T17:01:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa69c159df0 0x7fa69c147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a1400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69c0b3e50 0x7fa69c148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a1e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa69c15a1d0 0x7fa69c147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa69c159df0 0x7fa69c147fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45656/0 (socket says 172.21.15.59:45656) 2024-05-30T17:01:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a0a00640 1 -- 172.21.15.59:0/3004552369 learned_addr learned my addr 172.21.15.59:0/3004552369 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a1e00640 1 -- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69c0b3e50 msgr2=0x7fa69c148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a1e00640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69c0b3e50 0x7fa69c148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a1e00640 1 -- 172.21.15.59:0/3004552369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa69c159df0 msgr2=0x7fa69c147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a1e00640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa69c159df0 0x7fa69c147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a1e00640 1 -- 172.21.15.59:0/3004552369 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c166510 con 0x7fa69c15a1d0 2024-05-30T17:01:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a0a00640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa69c159df0 0x7fa69c147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:01:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a1e00640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa69c15a1d0 0x7fa69c147480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa69400ca70 tx=0x7fa69400cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:06.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa699600640 1 -- 172.21.15.59:0/3004552369 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694017070 con 0x7fa69c15a1d0 2024-05-30T17:01:06.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa699600640 1 -- 172.21.15.59:0/3004552369 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69400abd0 con 0x7fa69c15a1d0 2024-05-30T17:01:06.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a3e00640 1 -- 172.21.15.59:0/3004552369 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69c1667f0 con 0x7fa69c15a1d0 2024-05-30T17:01:06.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa699600640 1 -- 172.21.15.59:0/3004552369 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694012400 con 0x7fa69c15a1d0 2024-05-30T17:01:06.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a3e00640 1 -- 172.21.15.59:0/3004552369 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa69c1661a0 con 0x7fa69c15a1d0 2024-05-30T17:01:06.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.251+0000 7fa6a3e00640 1 -- 172.21.15.59:0/3004552369 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa69c068a90 con 0x7fa69c15a1d0 2024-05-30T17:01:06.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.255+0000 7fa699600640 1 -- 172.21.15.59:0/3004552369 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fa69401a070 con 0x7fa69c15a1d0 2024-05-30T17:01:06.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.255+0000 7fa699600640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa67c069850 0x7fa67c06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.255+0000 7fa699600640 1 -- 172.21.15.59:0/3004552369 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(93..93 src has 1..93) ==== 5878+0+0 (secure 0 0 0) 0x7fa694085800 con 0x7fa69c15a1d0 2024-05-30T17:01:06.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.255+0000 7fa6a1400640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa67c069850 0x7fa67c06bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.255+0000 7fa6a1400640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa67c069850 0x7fa67c06bd10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa6900ad000 tx=0x7fa6900a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:06.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.259+0000 7fa699600640 1 -- 172.21.15.59:0/3004552369 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa6940571c0 con 0x7fa69c15a1d0 2024-05-30T17:01:06.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.423+0000 7fa6a3e00640 1 -- 172.21.15.59:0/3004552369 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa69c15dd20 con 0x7fa69c15a1d0 2024-05-30T17:01:06.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.423+0000 7fa699600640 1 -- 172.21.15.59:0/3004552369 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+16940 (secure 0 0 0) 0x7fa69405b4c0 con 0x7fa69c15a1d0 2024-05-30T17:01:06.427 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:06.427 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":93,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:01:02.996754+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:59:34.157525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-05-30T16:59:35.464679+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.22","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:01:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.427+0000 7fa6a3e00640 1 -- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa67c069850 msgr2=0x7fa67c06bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.427+0000 7fa6a3e00640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa67c069850 0x7fa67c06bd10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa6900ad000 tx=0x7fa6900a6000 comp rx=0 tx=0).stop 2024-05-30T17:01:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.427+0000 7fa6a3e00640 1 -- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa69c15a1d0 msgr2=0x7fa69c147480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.427+0000 7fa6a3e00640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa69c15a1d0 0x7fa69c147480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa69400ca70 tx=0x7fa69400cf30 comp rx=0 tx=0).stop 2024-05-30T17:01:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.427+0000 7fa6a3e00640 1 -- 172.21.15.59:0/3004552369 shutdown_connections 2024-05-30T17:01:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.427+0000 7fa6a3e00640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa67c069850 0x7fa67c06bd10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.427+0000 7fa6a3e00640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa69c15a1d0 0x7fa69c147480 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.427+0000 7fa6a3e00640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa69c159df0 0x7fa69c147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.427+0000 7fa6a3e00640 1 --2- 172.21.15.59:0/3004552369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa69c0b3e50 0x7fa69c148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.427+0000 7fa6a3e00640 1 -- 172.21.15.59:0/3004552369 >> 172.21.15.59:0/3004552369 conn(0x7fa69c0b22d0 msgr2=0x7fa69c15c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.427+0000 7fa6a3e00640 1 -- 172.21.15.59:0/3004552369 shutdown_connections 2024-05-30T17:01:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.427+0000 7fa6a3e00640 1 -- 172.21.15.59:0/3004552369 wait complete. 2024-05-30T17:01:06.449 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T17:01:06.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.587+0000 7fbb48800640 1 Processor -- start 2024-05-30T17:01:06.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.587+0000 7fbb48800640 1 -- start start 2024-05-30T17:01:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb48800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb40159df0 0x7fbb400ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb48800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb4015a1d0 0x7fbb400ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb48800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb4015d730 con 0x7fbb400b3e50 2024-05-30T17:01:06.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb48800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbb400b3370 con 0x7fbb40159df0 2024-05-30T17:01:06.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb48800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbb400b3650 con 0x7fbb4015a1d0 2024-05-30T17:01:06.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb45e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb40159df0 0x7fbb400ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb46800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbb400b3e50 0x7fbb4015ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43430/0 (socket says 172.21.15.59:43430) 2024-05-30T17:01:06.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb46800640 1 -- 172.21.15.59:0/812586157 learned_addr learned my addr 172.21.15.59:0/812586157 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:06.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb45400640 1 --2- 172.21.15.59:0/812586157 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb4015a1d0 0x7fbb400ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb45e00640 1 -- 172.21.15.59:0/812586157 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb4015a1d0 msgr2=0x7fbb400ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:06.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb45e00640 1 --2- 172.21.15.59:0/812586157 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb4015a1d0 0x7fbb400ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb45e00640 1 -- 172.21.15.59:0/812586157 >> v1:172.21.15.59:6789/0 conn(0x7fbb400b3e50 legacy=0x7fbb4015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb45e00640 1 -- 172.21.15.59:0/812586157 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb400b3930 con 0x7fbb40159df0 2024-05-30T17:01:06.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.591+0000 7fbb44a00640 1 -- 172.21.15.59:0/812586157 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858874377 0 0) 0x7fbb4015d730 con 0x7fbb400b3e50 2024-05-30T17:01:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb45e00640 1 --2- 172.21.15.59:0/812586157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb40159df0 0x7fbb400ad1b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fbb340097c0 tx=0x7fbb3401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd31d71a317d8c6b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb44a00640 1 -- 172.21.15.59:0/812586157 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340b0070 con 0x7fbb40159df0 2024-05-30T17:01:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb44a00640 1 -- 172.21.15.59:0/812586157 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb340ab600 con 0x7fbb40159df0 2024-05-30T17:01:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb44a00640 1 -- 172.21.15.59:0/812586157 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340ab9d0 con 0x7fbb40159df0 2024-05-30T17:01:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 -- 172.21.15.59:0/812586157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb40159df0 msgr2=0x7fbb400ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 --2- 172.21.15.59:0/812586157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb40159df0 0x7fbb400ad1b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fbb340097c0 tx=0x7fbb3401c4a0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 -- 172.21.15.59:0/812586157 shutdown_connections 2024-05-30T17:01:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 --2- 172.21.15.59:0/812586157 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb4015a1d0 0x7fbb400ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 --2- 172.21.15.59:0/812586157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb40159df0 0x7fbb400ad1b0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 -- 172.21.15.59:0/812586157 >> 172.21.15.59:0/812586157 conn(0x7fbb400b22d0 msgr2=0x7fbb400b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 -- 172.21.15.59:0/812586157 shutdown_connections 2024-05-30T17:01:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 -- 172.21.15.59:0/812586157 wait complete. 2024-05-30T17:01:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 Processor -- start 2024-05-30T17:01:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 -- start start 2024-05-30T17:01:06.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb400b3e50 0x7fbb4015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb40159df0 0x7fbb4006e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb4015a1d0 0x7fbb40153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4015e720 con 0x7fbb400b3e50 2024-05-30T17:01:06.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4015e5a0 con 0x7fbb40159df0 2024-05-30T17:01:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb48800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbb4015e8a0 con 0x7fbb4015a1d0 2024-05-30T17:01:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb45e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb400b3e50 0x7fbb4015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb45e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb400b3e50 0x7fbb4015ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45666/0 (socket says 172.21.15.59:45666) 2024-05-30T17:01:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.595+0000 7fbb45e00640 1 -- 172.21.15.59:0/1495913141 learned_addr learned my addr 172.21.15.59:0/1495913141 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb45400640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb40159df0 0x7fbb4006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb46800640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb4015a1d0 0x7fbb40153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb45e00640 1 -- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb4015a1d0 msgr2=0x7fbb40153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb45e00640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb4015a1d0 0x7fbb40153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb45e00640 1 -- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb40159df0 msgr2=0x7fbb4006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb45e00640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb40159df0 0x7fbb4006e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb45e00640 1 -- 172.21.15.59:0/1495913141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb40152a90 con 0x7fbb400b3e50 2024-05-30T17:01:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb45e00640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb400b3e50 0x7fbb4015ae00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fbb340097c0 tx=0x7fbb3401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:06.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb3a000640 1 -- 172.21.15.59:0/1495913141 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340b0040 con 0x7fbb400b3e50 2024-05-30T17:01:06.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb3a000640 1 -- 172.21.15.59:0/1495913141 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb34004030 con 0x7fbb400b3e50 2024-05-30T17:01:06.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb3a000640 1 -- 172.21.15.59:0/1495913141 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34006e20 con 0x7fbb400b3e50 2024-05-30T17:01:06.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb48800640 1 -- 172.21.15.59:0/1495913141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb40152dd0 con 0x7fbb400b3e50 2024-05-30T17:01:06.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb48800640 1 -- 172.21.15.59:0/1495913141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb40153610 con 0x7fbb400b3e50 2024-05-30T17:01:06.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb48800640 1 -- 172.21.15.59:0/1495913141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb40068a90 con 0x7fbb400b3e50 2024-05-30T17:01:06.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.599+0000 7fbb3a000640 1 -- 172.21.15.59:0/1495913141 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fbb340aa7d0 con 0x7fbb400b3e50 2024-05-30T17:01:06.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.603+0000 7fbb3a000640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbb24069850 0x7fbb2406bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.603+0000 7fbb3a000640 1 -- 172.21.15.59:0/1495913141 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5878+0+0 (secure 0 0 0) 0x7fbb341201c0 con 0x7fbb400b3e50 2024-05-30T17:01:06.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.603+0000 7fbb45400640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbb24069850 0x7fbb2406bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.603+0000 7fbb45400640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbb24069850 0x7fbb2406bd10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbb4014ee90 tx=0x7fbb30009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:06.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.607+0000 7fbb3a000640 1 -- 172.21.15.59:0/1495913141 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbb40152dd0 con 0x7fbb400b3e50 2024-05-30T17:01:06.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.807+0000 7fbb48800640 1 -- 172.21.15.59:0/1495913141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbb400b4ef0 con 0x7fbb400b3e50 2024-05-30T17:01:06.809 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-05-30T17:01:06.807+0000 7f2f74c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T17:01:06.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.807+0000 7fbb3a000640 1 -- 172.21.15.59:0/1495913141 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) ==== 161+0+0 (secure 0 0 0) 0x7fbb34016090 con 0x7fbb400b3e50 2024-05-30T17:01:06.811 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T17:01:06.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.811+0000 7fbb48800640 1 -- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbb24069850 msgr2=0x7fbb2406bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.811+0000 7fbb48800640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbb24069850 0x7fbb2406bd10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbb4014ee90 tx=0x7fbb30009190 comp rx=0 tx=0).stop 2024-05-30T17:01:06.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.811+0000 7fbb48800640 1 -- 172.21.15.59:0/1495913141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb400b3e50 msgr2=0x7fbb4015ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.811+0000 7fbb48800640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb400b3e50 0x7fbb4015ae00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fbb340097c0 tx=0x7fbb3401ace0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.811+0000 7fbb48800640 1 -- 172.21.15.59:0/1495913141 shutdown_connections 2024-05-30T17:01:06.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.811+0000 7fbb48800640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbb24069850 0x7fbb2406bd10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.811+0000 7fbb48800640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb4015a1d0 0x7fbb40153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.811+0000 7fbb48800640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb40159df0 0x7fbb4006e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.811+0000 7fbb48800640 1 --2- 172.21.15.59:0/1495913141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb400b3e50 0x7fbb4015ae00 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.811+0000 7fbb48800640 1 -- 172.21.15.59:0/1495913141 >> 172.21.15.59:0/1495913141 conn(0x7fbb400b22d0 msgr2=0x7fbb400b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:06.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.811+0000 7fbb48800640 1 -- 172.21.15.59:0/1495913141 shutdown_connections 2024-05-30T17:01:06.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.811+0000 7fbb48800640 1 -- 172.21.15.59:0/1495913141 wait complete. 2024-05-30T17:01:06.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T17:01:06.881 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-30T17:01:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.975+0000 7f3dae400640 1 Processor -- start 2024-05-30T17:01:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.975+0000 7f3dae400640 1 -- start start 2024-05-30T17:01:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.975+0000 7f3dae400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3da806ffe0 0x7f3da80b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.975+0000 7f3dae400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da815ed20 con 0x7f3da815e940 2024-05-30T17:01:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.975+0000 7f3dae400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da80d0830 con 0x7f3da80af230 2024-05-30T17:01:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.975+0000 7f3dae400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3da80d10f0 con 0x7f3da806ffe0 2024-05-30T17:01:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.979+0000 7f3d9ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3da806ffe0 0x7f3da80b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.979+0000 7f3da7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3da815e940 0x7f3da80d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43442/0 (socket says 172.21.15.59:43442) 2024-05-30T17:01:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.979+0000 7f3da7400640 1 -- 172.21.15.59:0/3400784135 learned_addr learned my addr 172.21.15.59:0/3400784135 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:06.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.979+0000 7f3d9ea00640 1 -- 172.21.15.59:0/3400784135 >> v1:172.21.15.107:6789/0 conn(0x7f3da80af230 legacy=0x7f3da809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.979+0000 7f3d9ea00640 1 -- 172.21.15.59:0/3400784135 >> v1:172.21.15.59:6789/0 conn(0x7f3da815e940 legacy=0x7f3da80d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.979+0000 7f3d9ea00640 1 -- 172.21.15.59:0/3400784135 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da8070670 con 0x7f3da806ffe0 2024-05-30T17:01:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.979+0000 7f3d9ea00640 1 --2- 172.21.15.59:0/3400784135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da806ffe0 0x7f3da80b18c0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f3d900097c0 tx=0x7f3d9001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f823a366f6eec170 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.979+0000 7f3da6a00640 1 -- 172.21.15.59:0/3400784135 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d900b5070 con 0x7f3da806ffe0 2024-05-30T17:01:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.979+0000 7f3da6a00640 1 -- 172.21.15.59:0/3400784135 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d900a8990 con 0x7f3da806ffe0 2024-05-30T17:01:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.979+0000 7f3da6a00640 1 -- 172.21.15.59:0/3400784135 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d900a8d60 con 0x7f3da806ffe0 2024-05-30T17:01:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 -- 172.21.15.59:0/3400784135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da806ffe0 msgr2=0x7f3da80b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 --2- 172.21.15.59:0/3400784135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da806ffe0 0x7f3da80b18c0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f3d900097c0 tx=0x7f3d9001ec90 comp rx=0 tx=0).stop 2024-05-30T17:01:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 -- 172.21.15.59:0/3400784135 shutdown_connections 2024-05-30T17:01:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 --2- 172.21.15.59:0/3400784135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da806ffe0 0x7f3da80b18c0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 -- 172.21.15.59:0/3400784135 >> 172.21.15.59:0/3400784135 conn(0x7f3da80b3f70 msgr2=0x7f3da80b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:06.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 -- 172.21.15.59:0/3400784135 shutdown_connections 2024-05-30T17:01:06.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 -- 172.21.15.59:0/3400784135 wait complete. 2024-05-30T17:01:06.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 Processor -- start 2024-05-30T17:01:06.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 -- start start 2024-05-30T17:01:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da806ffe0 0x7f3da81517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3da80af230 0x7f3da8161400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3da815e940 0x7f3da8161940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3da80d0d80 con 0x7f3da806ffe0 2024-05-30T17:01:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3da8070420 con 0x7f3da815e940 2024-05-30T17:01:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3dae400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3da80d1c90 con 0x7f3da80af230 2024-05-30T17:01:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3da7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da806ffe0 0x7f3da81517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3da7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da806ffe0 0x7f3da81517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45678/0 (socket says 172.21.15.59:45678) 2024-05-30T17:01:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3da7400640 1 -- 172.21.15.59:0/1569324854 learned_addr learned my addr 172.21.15.59:0/1569324854 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3d9ea00640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3da80af230 0x7f3da8161400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3da7e00640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3da815e940 0x7f3da8161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3da7400640 1 -- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3da80af230 msgr2=0x7f3da8161400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3da7400640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3da80af230 0x7f3da8161400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3da7400640 1 -- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3da815e940 msgr2=0x7f3da8161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3da7400640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3da815e940 0x7f3da8161940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3da7400640 1 -- 172.21.15.59:0/1569324854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da80b76f0 con 0x7f3da806ffe0 2024-05-30T17:01:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3d9ea00640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3da80af230 0x7f3da8161400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3da7e00640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3da815e940 0x7f3da8161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.983+0000 7f3da7400640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da806ffe0 0x7f3da81517d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800c530 tx=0x7f3d9800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.987+0000 7f3d9fe00640 1 -- 172.21.15.59:0/1569324854 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98017070 con 0x7f3da806ffe0 2024-05-30T17:01:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.987+0000 7f3d9fe00640 1 -- 172.21.15.59:0/1569324854 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d98005cf0 con 0x7f3da806ffe0 2024-05-30T17:01:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.987+0000 7f3d9fe00640 1 -- 172.21.15.59:0/1569324854 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98007270 con 0x7f3da806ffe0 2024-05-30T17:01:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.987+0000 7f3dae400640 1 -- 172.21.15.59:0/1569324854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da80b79d0 con 0x7f3da806ffe0 2024-05-30T17:01:06.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.987+0000 7f3dae400640 1 -- 172.21.15.59:0/1569324854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da80b7f90 con 0x7f3da806ffe0 2024-05-30T17:01:06.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.987+0000 7f3dae400640 1 -- 172.21.15.59:0/1569324854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da8068a90 con 0x7f3da806ffe0 2024-05-30T17:01:06.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.987+0000 7f3d9fe00640 1 -- 172.21.15.59:0/1569324854 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f3d9801a070 con 0x7f3da806ffe0 2024-05-30T17:01:06.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.987+0000 7f3d9fe00640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d84069850 0x7f3d8406bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:06.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.987+0000 7f3d9fe00640 1 -- 172.21.15.59:0/1569324854 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5936+0+0 (secure 0 0 0) 0x7f3d98084e10 con 0x7f3da806ffe0 2024-05-30T17:01:06.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.987+0000 7f3d9ea00640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d84069850 0x7f3d8406bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:06.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.991+0000 7f3d9ea00640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d84069850 0x7f3d8406bd10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3d900b2000 tx=0x7f3d90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:06.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:06.991+0000 7f3d9fe00640 1 -- 172.21.15.59:0/1569324854 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d980567f0 con 0x7f3da806ffe0 2024-05-30T17:01:07.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.191+0000 7f3dae400640 1 -- 172.21.15.59:0/1569324854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3da80b4da0 con 0x7f3da806ffe0 2024-05-30T17:01:07.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.811+0000 7f3d9fe00640 1 -- 172.21.15.59:0/1569324854 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) ==== 104+0+0 (secure 0 0 0) 0x7f3d9805aaf0 con 0x7f3da806ffe0 2024-05-30T17:01:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.811+0000 7f3dae400640 1 -- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d84069850 msgr2=0x7f3d8406bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.811+0000 7f3dae400640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d84069850 0x7f3d8406bd10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3d900b2000 tx=0x7f3d90008040 comp rx=0 tx=0).stop 2024-05-30T17:01:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.815+0000 7f3dae400640 1 -- 172.21.15.59:0/1569324854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da806ffe0 msgr2=0x7f3da81517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.815+0000 7f3dae400640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da806ffe0 0x7f3da81517d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800c530 tx=0x7f3d9800c9f0 comp rx=0 tx=0).stop 2024-05-30T17:01:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.815+0000 7f3dae400640 1 -- 172.21.15.59:0/1569324854 shutdown_connections 2024-05-30T17:01:07.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.815+0000 7f3dae400640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d84069850 0x7f3d8406bd10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:07.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.815+0000 7f3dae400640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3da815e940 0x7f3da8161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:07.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.815+0000 7f3dae400640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3da80af230 0x7f3da8161400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:07.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.815+0000 7f3dae400640 1 --2- 172.21.15.59:0/1569324854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da806ffe0 0x7f3da81517d0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:07.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.815+0000 7f3dae400640 1 -- 172.21.15.59:0/1569324854 >> 172.21.15.59:0/1569324854 conn(0x7f3da80b3f70 msgr2=0x7f3da806e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:07.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.815+0000 7f3dae400640 1 -- 172.21.15.59:0/1569324854 shutdown_connections 2024-05-30T17:01:07.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.815+0000 7f3dae400640 1 -- 172.21.15.59:0/1569324854 wait complete. 2024-05-30T17:01:07.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T17:01:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca7e00640 1 Processor -- start 2024-05-30T17:01:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca7e00640 1 -- start start 2024-05-30T17:01:07.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ca006f6a0 0x7f8ca006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:07.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8ca006ea30 0x7f8ca00b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:07.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca7e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca00b3370 con 0x7f8ca015ad90 2024-05-30T17:01:07.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca7e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca00b3650 con 0x7f8ca006f6a0 2024-05-30T17:01:07.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca7e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca00b3930 con 0x7f8ca006ea30 2024-05-30T17:01:07.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca4a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ca006f6a0 0x7f8ca006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:07.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca5400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8ca015ad90 0x7f8ca0071cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43452/0 (socket says 172.21.15.59:43452) 2024-05-30T17:01:07.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca5400640 1 -- 172.21.15.59:0/1316173119 learned_addr learned my addr 172.21.15.59:0/1316173119 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca5e00640 1 --2- 172.21.15.59:0/1316173119 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8ca006ea30 0x7f8ca00b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca4a00640 1 -- 172.21.15.59:0/1316173119 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8ca006ea30 msgr2=0x7f8ca00b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca4a00640 1 --2- 172.21.15.59:0/1316173119 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8ca006ea30 0x7f8ca00b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca4a00640 1 -- 172.21.15.59:0/1316173119 >> v1:172.21.15.59:6789/0 conn(0x7f8ca015ad90 legacy=0x7f8ca0071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca4a00640 1 -- 172.21.15.59:0/1316173119 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca00b3c10 con 0x7f8ca006f6a0 2024-05-30T17:01:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.983+0000 7f8ca5e00640 1 --2- 172.21.15.59:0/1316173119 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8ca006ea30 0x7f8ca00b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.987+0000 7f8ca4a00640 1 --2- 172.21.15.59:0/1316173119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca006f6a0 0x7f8ca006e4f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c0097c0 tx=0x7f8c8c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16970d29d39071b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.987+0000 7f8c9fe00640 1 -- 172.21.15.59:0/1316173119 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0b0070 con 0x7f8ca006f6a0 2024-05-30T17:01:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.987+0000 7f8c9fe00640 1 -- 172.21.15.59:0/1316173119 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8c0ab600 con 0x7f8ca006f6a0 2024-05-30T17:01:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.987+0000 7f8c9fe00640 1 -- 172.21.15.59:0/1316173119 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0ab9d0 con 0x7f8ca006f6a0 2024-05-30T17:01:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.987+0000 7f8ca7e00640 1 -- 172.21.15.59:0/1316173119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca006f6a0 msgr2=0x7f8ca006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.987+0000 7f8ca7e00640 1 --2- 172.21.15.59:0/1316173119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca006f6a0 0x7f8ca006e4f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c0097c0 tx=0x7f8c8c01c4a0 comp rx=0 tx=0).stop 2024-05-30T17:01:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.987+0000 7f8ca7e00640 1 -- 172.21.15.59:0/1316173119 shutdown_connections 2024-05-30T17:01:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.987+0000 7f8ca7e00640 1 --2- 172.21.15.59:0/1316173119 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8ca006ea30 0x7f8ca00b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.987+0000 7f8ca7e00640 1 --2- 172.21.15.59:0/1316173119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca006f6a0 0x7f8ca006e4f0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.987+0000 7f8ca7e00640 1 -- 172.21.15.59:0/1316173119 >> 172.21.15.59:0/1316173119 conn(0x7f8ca00b1e60 msgr2=0x7f8ca00b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.987+0000 7f8ca7e00640 1 -- 172.21.15.59:0/1316173119 shutdown_connections 2024-05-30T17:01:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.987+0000 7f8ca7e00640 1 -- 172.21.15.59:0/1316173119 wait complete. 2024-05-30T17:01:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca7e00640 1 Processor -- start 2024-05-30T17:01:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca7e00640 1 -- start start 2024-05-30T17:01:07.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca006ea30 0x7f8ca00ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:07.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8ca006f6a0 0x7f8ca0154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:07.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ca015ad90 0x7f8ca0149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:07.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca7e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00b4a80 con 0x7f8ca006ea30 2024-05-30T17:01:07.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca7e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00b4900 con 0x7f8ca015ad90 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca7e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca00b4c00 con 0x7f8ca006f6a0 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca006ea30 0x7f8ca00ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca006ea30 0x7f8ca00ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45702/0 (socket says 172.21.15.59:45702) 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca5400640 1 -- 172.21.15.59:0/718930856 learned_addr learned my addr 172.21.15.59:0/718930856 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca5400640 1 -- 172.21.15.59:0/718930856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8ca006f6a0 msgr2=0x7f8ca0154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca5400640 1 --2- 172.21.15.59:0/718930856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8ca006f6a0 0x7f8ca0154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca5400640 1 -- 172.21.15.59:0/718930856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ca015ad90 msgr2=0x7f8ca0149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca5400640 1 --2- 172.21.15.59:0/718930856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ca015ad90 0x7f8ca0149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca5400640 1 -- 172.21.15.59:0/718930856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca01488e0 con 0x7f8ca006ea30 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca5400640 1 --2- 172.21.15.59:0/718930856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca006ea30 0x7f8ca00ccc60 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400ca70 tx=0x7f8c9400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8c9d600640 1 -- 172.21.15.59:0/718930856 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94017070 con 0x7f8ca006ea30 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8c9d600640 1 -- 172.21.15.59:0/718930856 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9400abd0 con 0x7f8ca006ea30 2024-05-30T17:01:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca7e00640 1 -- 172.21.15.59:0/718930856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca014a4e0 con 0x7f8ca006ea30 2024-05-30T17:01:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8c9d600640 1 -- 172.21.15.59:0/718930856 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94012400 con 0x7f8ca006ea30 2024-05-30T17:01:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.991+0000 7f8ca7e00640 1 -- 172.21.15.59:0/718930856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca014aaa0 con 0x7f8ca006ea30 2024-05-30T17:01:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.995+0000 7f8ca7e00640 1 -- 172.21.15.59:0/718930856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca0068a90 con 0x7f8ca006ea30 2024-05-30T17:01:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.995+0000 7f8c9d600640 1 -- 172.21.15.59:0/718930856 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f8c9401a070 con 0x7f8ca006ea30 2024-05-30T17:01:07.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.995+0000 7f8c9d600640 1 --2- 172.21.15.59:0/718930856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c80069850 0x7f8c8006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:07.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.995+0000 7f8c9d600640 1 -- 172.21.15.59:0/718930856 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5936+0+0 (secure 0 0 0) 0x7f8c940853c0 con 0x7f8ca006ea30 2024-05-30T17:01:07.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.995+0000 7f8ca4a00640 1 --2- 172.21.15.59:0/718930856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c80069850 0x7f8c8006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.995+0000 7f8ca4a00640 1 --2- 172.21.15.59:0/718930856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c80069850 0x7f8c8006bd10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c0ad000 tx=0x7f8c8c004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:08.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:07.999+0000 7f8c9d600640 1 -- 172.21.15.59:0/718930856 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8ca01488e0 con 0x7f8ca006ea30 2024-05-30T17:01:08.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:08.167+0000 7f8ca7e00640 1 -- 172.21.15.59:0/718930856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8ca006e810 con 0x7f8ca006ea30 2024-05-30T17:01:09.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.035+0000 7f8c9d600640 1 -- 172.21.15.59:0/718930856 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) ==== 181+0+0 (secure 0 0 0) 0x7f8c940573f0 con 0x7f8ca006ea30 2024-05-30T17:01:09.037 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-05-30T17:01:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.039+0000 7f8ca7e00640 1 -- 172.21.15.59:0/718930856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c80069850 msgr2=0x7f8c8006bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.039+0000 7f8ca7e00640 1 --2- 172.21.15.59:0/718930856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c80069850 0x7f8c8006bd10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c0ad000 tx=0x7f8c8c004740 comp rx=0 tx=0).stop 2024-05-30T17:01:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.039+0000 7f8ca7e00640 1 -- 172.21.15.59:0/718930856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca006ea30 msgr2=0x7f8ca00ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.039+0000 7f8ca7e00640 1 --2- 172.21.15.59:0/718930856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca006ea30 0x7f8ca00ccc60 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400ca70 tx=0x7f8c9400cf30 comp rx=0 tx=0).stop 2024-05-30T17:01:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.039+0000 7f8ca7e00640 1 -- 172.21.15.59:0/718930856 shutdown_connections 2024-05-30T17:01:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.039+0000 7f8ca7e00640 1 --2- 172.21.15.59:0/718930856 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8c80069850 0x7f8c8006bd10 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.039+0000 7f8ca7e00640 1 --2- 172.21.15.59:0/718930856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ca015ad90 0x7f8ca0149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.039+0000 7f8ca7e00640 1 --2- 172.21.15.59:0/718930856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8ca006f6a0 0x7f8ca0154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.039+0000 7f8ca7e00640 1 --2- 172.21.15.59:0/718930856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca006ea30 0x7f8ca00ccc60 secure :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400ca70 tx=0x7f8c9400cf30 comp rx=0 tx=0).stop 2024-05-30T17:01:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.039+0000 7f8ca7e00640 1 -- 172.21.15.59:0/718930856 >> 172.21.15.59:0/718930856 conn(0x7f8ca00b1e60 msgr2=0x7f8ca00aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.039+0000 7f8ca7e00640 1 -- 172.21.15.59:0/718930856 shutdown_connections 2024-05-30T17:01:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.039+0000 7f8ca7e00640 1 -- 172.21.15.59:0/718930856 wait complete. 2024-05-30T17:01:09.069 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T17:01:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.215+0000 7fafc2600640 1 Processor -- start 2024-05-30T17:01:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.215+0000 7fafc2600640 1 -- start start 2024-05-30T17:01:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafc2600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc161e20 0x7fafbc06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafc2600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafbc163130 con 0x7fafbc06cf00 2024-05-30T17:01:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafc2600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafbc0b3d50 con 0x7fafbc0730e0 2024-05-30T17:01:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafc2600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fafbc0b4030 con 0x7fafbc161e20 2024-05-30T17:01:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbbe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fafbc06cf00 0x7fafbc162a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43466/0 (socket says 172.21.15.59:43466) 2024-05-30T17:01:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbbe00640 1 -- 172.21.15.59:0/88422965 learned_addr learned my addr 172.21.15.59:0/88422965 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbb400640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc161e20 0x7fafbc06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809831826 0 0) 0x7fafbc163130 con 0x7fafbc06cf00 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafa0003530 con 0x7fafbc06cf00 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598629080 0 0) 0x7fafbc0b3d50 con 0x7fafbc0730e0 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafbc163130 con 0x7fafbc0730e0 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 230223158 0 0) 0x7fafa0003530 con 0x7fafbc06cf00 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc161e20 msgr2=0x7fafbc06c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc161e20 0x7fafbc06c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 >> v1:172.21.15.107:6789/0 conn(0x7fafbc0730e0 legacy=0x7fafbc162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafbc06e7c0 con 0x7fafbc06cf00 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fafb4001a00 con 0x7fafbc06cf00 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbb400640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc161e20 0x7fafbc06c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 >> v1:172.21.15.59:6789/0 conn(0x7fafbc06cf00 legacy=0x7fafbc162a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa0003b80 0x7fafa0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc161e20 0x7fafa0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafa0004d50 0x7fafa00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fafa000ba80 con 0x7fafa0003b80 2024-05-30T17:01:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fafa000bc00 con 0x7fafa0004d50 2024-05-30T17:01:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fafa000bd80 con 0x7fafbc161e20 2024-05-30T17:01:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbb400640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa0003b80 0x7fafa0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafb3e00640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc161e20 0x7fafa0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbbe00640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafa0004d50 0x7fafa00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbb400640 1 -- 172.21.15.59:0/88422965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc161e20 msgr2=0x7fafa0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbb400640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc161e20 0x7fafa0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbb400640 1 -- 172.21.15.59:0/88422965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafa0004d50 msgr2=0x7fafa00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbb400640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafa0004d50 0x7fafa00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.219+0000 7fafbb400640 1 -- 172.21.15.59:0/88422965 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa0003530 con 0x7fafa0003b80 2024-05-30T17:01:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.223+0000 7fafbb400640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa0003b80 0x7fafa0003f80 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fafac009ce0 tx=0x7fafac01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5a87d10fac394b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.223+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac0b2070 con 0x7fafa0003b80 2024-05-30T17:01:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.223+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafac0a58b0 con 0x7fafa0003b80 2024-05-30T17:01:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.223+0000 7fafbaa00640 1 -- 172.21.15.59:0/88422965 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac009880 con 0x7fafa0003b80 2024-05-30T17:01:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.223+0000 7fafc2600640 1 -- 172.21.15.59:0/88422965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa0003b80 msgr2=0x7fafa0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.223+0000 7fafc2600640 1 --2- 172.21.15.59:0/88422965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa0003b80 0x7fafa0003f80 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fafac009ce0 tx=0x7fafac01cbf0 comp rx=0 tx=0).stop 2024-05-30T17:01:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.223+0000 7fafbbe00640 1 -- 172.21.15.59:0/88422965 reap_dead start 2024-05-30T17:01:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.223+0000 7fafc2600640 1 -- 172.21.15.59:0/88422965 shutdown_connections 2024-05-30T17:01:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.223+0000 7fafc2600640 1 -- 172.21.15.59:0/88422965 >> 172.21.15.59:0/88422965 conn(0x7fafbc0725c0 msgr2=0x7fafbc0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.223+0000 7fafc2600640 1 -- 172.21.15.59:0/88422965 shutdown_connections 2024-05-30T17:01:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.223+0000 7fafc2600640 1 -- 172.21.15.59:0/88422965 wait complete. 2024-05-30T17:01:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafc2600640 1 Processor -- start 2024-05-30T17:01:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafc2600640 1 -- start start 2024-05-30T17:01:09.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafc2600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa0003b80 0x7fafbc15b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:09.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafc2600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafbc148780 0x7fafbc148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:09.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafc2600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc14a740 0x7fafbc0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:09.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafc2600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc0b3a20 con 0x7fafa0003b80 2024-05-30T17:01:09.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafc2600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc06ed80 con 0x7fafbc148780 2024-05-30T17:01:09.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafc2600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fafbc0d0820 con 0x7fafbc14a740 2024-05-30T17:01:09.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafbb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa0003b80 0x7fafbc15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:09.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafbb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa0003b80 0x7fafbc15b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45718/0 (socket says 172.21.15.59:45718) 2024-05-30T17:01:09.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafbb400640 1 -- 172.21.15.59:0/435208659 learned_addr learned my addr 172.21.15.59:0/435208659 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:09.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafb3e00640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafbc148780 0x7fafbc148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:09.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafbbe00640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc14a740 0x7fafbc0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:09.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafbb400640 1 -- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc14a740 msgr2=0x7fafbc0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:09.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafbb400640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc14a740 0x7fafbc0b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:09.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafbb400640 1 -- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafbc148780 msgr2=0x7fafbc148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:09.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafbb400640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafbc148780 0x7fafbc148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:09.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafbb400640 1 -- 172.21.15.59:0/435208659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafbc149400 con 0x7fafa0003b80 2024-05-30T17:01:09.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafbb400640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa0003b80 0x7fafbc15b710 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fafac01c660 tx=0x7fafa0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafb3400640 1 -- 172.21.15.59:0/435208659 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac0b2040 con 0x7fafa0003b80 2024-05-30T17:01:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafb3400640 1 -- 172.21.15.59:0/435208659 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafac009400 con 0x7fafa0003b80 2024-05-30T17:01:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafb3400640 1 -- 172.21.15.59:0/435208659 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac004280 con 0x7fafa0003b80 2024-05-30T17:01:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafc2600640 1 -- 172.21.15.59:0/435208659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafbc1496a0 con 0x7fafa0003b80 2024-05-30T17:01:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafc2600640 1 -- 172.21.15.59:0/435208659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafbc149c60 con 0x7fafa0003b80 2024-05-30T17:01:09.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.227+0000 7fafc2600640 1 -- 172.21.15.59:0/435208659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafbc068a90 con 0x7fafa0003b80 2024-05-30T17:01:09.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.231+0000 7fafb3400640 1 -- 172.21.15.59:0/435208659 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fafac0c0060 con 0x7fafa0003b80 2024-05-30T17:01:09.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.231+0000 7fafb3400640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faf98069880 0x7faf9806bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:09.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.231+0000 7fafb3400640 1 -- 172.21.15.59:0/435208659 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5498+0+0 (secure 0 0 0) 0x7fafac11f170 con 0x7fafa0003b80 2024-05-30T17:01:09.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.231+0000 7fafb3e00640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faf98069880 0x7faf9806bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:09.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.231+0000 7fafb3e00640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faf98069880 0x7faf9806bd40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fafa4005630 tx=0x7fafa4007200 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:09.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.235+0000 7fafb3400640 1 -- 172.21.15.59:0/435208659 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fafac016940 con 0x7fafa0003b80 2024-05-30T17:01:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:09.411+0000 7fafc2600640 1 -- 172.21.15.59:0/435208659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fafbc0678a0 con 0x7fafa0003b80 2024-05-30T17:01:10.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.039+0000 7fafb3400640 1 -- 172.21.15.59:0/435208659 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) ==== 169+0+0 (secure 0 0 0) 0x7fafac0f0b30 con 0x7fafa0003b80 2024-05-30T17:01:10.043 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-05-30T17:01:10.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.043+0000 7fafc2600640 1 -- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faf98069880 msgr2=0x7faf9806bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:10.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.043+0000 7fafc2600640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faf98069880 0x7faf9806bd40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fafa4005630 tx=0x7fafa4007200 comp rx=0 tx=0).stop 2024-05-30T17:01:10.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.043+0000 7fafc2600640 1 -- 172.21.15.59:0/435208659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa0003b80 msgr2=0x7fafbc15b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:10.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.043+0000 7fafc2600640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa0003b80 0x7fafbc15b710 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fafac01c660 tx=0x7fafa0005840 comp rx=0 tx=0).stop 2024-05-30T17:01:10.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.043+0000 7fafc2600640 1 -- 172.21.15.59:0/435208659 shutdown_connections 2024-05-30T17:01:10.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.043+0000 7fafc2600640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7faf98069880 0x7faf9806bd40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.043+0000 7fafc2600640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafbc14a740 0x7fafbc0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.043+0000 7fafc2600640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafbc148780 0x7fafbc148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.043+0000 7fafc2600640 1 --2- 172.21.15.59:0/435208659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa0003b80 0x7fafbc15b710 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.043+0000 7fafc2600640 1 -- 172.21.15.59:0/435208659 >> 172.21.15.59:0/435208659 conn(0x7fafbc0725c0 msgr2=0x7fafbc15c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:10.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.043+0000 7fafc2600640 1 -- 172.21.15.59:0/435208659 shutdown_connections 2024-05-30T17:01:10.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.043+0000 7fafc2600640 1 -- 172.21.15.59:0/435208659 wait complete. 2024-05-30T17:01:10.072 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T17:01:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f89a1200640 1 Processor -- start 2024-05-30T17:01:10.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f89a1200640 1 -- start start 2024-05-30T17:01:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f89a1200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f899c161fd0 0x7f899c0d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f89a1200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f899c06c0c0 0x7f899c0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f89a1200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f899c0d1150 con 0x7f899c0cb9b0 2024-05-30T17:01:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f89a1200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f899c0d0b90 con 0x7f899c161fd0 2024-05-30T17:01:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f89a1200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f899c0d0e70 con 0x7f899c06c0c0 2024-05-30T17:01:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f8999e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f899c161fd0 0x7f899c0d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f8999e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f899c161fd0 0x7f899c0d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45728/0 (socket says 172.21.15.59:45728) 2024-05-30T17:01:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f8999e00640 1 -- 172.21.15.59:0/613985226 learned_addr learned my addr 172.21.15.59:0/613985226 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f899a800640 1 --2- 172.21.15.59:0/613985226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f899c06c0c0 0x7f899c0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f8999e00640 1 -- 172.21.15.59:0/613985226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f899c06c0c0 msgr2=0x7f899c0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f8999e00640 1 --2- 172.21.15.59:0/613985226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f899c06c0c0 0x7f899c0b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f8999e00640 1 -- 172.21.15.59:0/613985226 >> v1:172.21.15.107:6789/0 conn(0x7f899c0cb9b0 legacy=0x7f899c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f8999e00640 1 -- 172.21.15.59:0/613985226 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c0cd620 con 0x7f899c161fd0 2024-05-30T17:01:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.215+0000 7f899a800640 1 --2- 172.21.15.59:0/613985226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f899c06c0c0 0x7f899c0b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.219+0000 7f8999e00640 1 --2- 172.21.15.59:0/613985226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899c161fd0 0x7f899c0d05b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f898c009870 tx=0x7f898c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77f5e0697f240f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.219+0000 7f8999400640 1 -- 172.21.15.59:0/613985226 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0b2070 con 0x7f899c161fd0 2024-05-30T17:01:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.219+0000 7f8999400640 1 -- 172.21.15.59:0/613985226 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f898c0a9070 con 0x7f899c161fd0 2024-05-30T17:01:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.219+0000 7f8999400640 1 -- 172.21.15.59:0/613985226 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0ad880 con 0x7f899c161fd0 2024-05-30T17:01:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.219+0000 7f89a1200640 1 -- 172.21.15.59:0/613985226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899c161fd0 msgr2=0x7f899c0d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.219+0000 7f89a1200640 1 --2- 172.21.15.59:0/613985226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899c161fd0 0x7f899c0d05b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f898c009870 tx=0x7f898c01c490 comp rx=0 tx=0).stop 2024-05-30T17:01:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.219+0000 7f89a1200640 1 -- 172.21.15.59:0/613985226 shutdown_connections 2024-05-30T17:01:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.219+0000 7f89a1200640 1 --2- 172.21.15.59:0/613985226 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f899c06c0c0 0x7f899c0b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.219+0000 7f89a1200640 1 --2- 172.21.15.59:0/613985226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899c161fd0 0x7f899c0d05b0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.219+0000 7f89a1200640 1 -- 172.21.15.59:0/613985226 >> 172.21.15.59:0/613985226 conn(0x7f899c0b2f50 msgr2=0x7f899c0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:10.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.219+0000 7f89a1200640 1 -- 172.21.15.59:0/613985226 shutdown_connections 2024-05-30T17:01:10.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.219+0000 7f89a1200640 1 -- 172.21.15.59:0/613985226 wait complete. 2024-05-30T17:01:10.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f89a1200640 1 Processor -- start 2024-05-30T17:01:10.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f89a1200640 1 -- start start 2024-05-30T17:01:10.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f89a1200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f899c06c0c0 0x7f899c0cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:10.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f89a1200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f899c0cb9b0 0x7f899c0b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f89a1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899c161fd0 0x7f899c0c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f89a1200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f899c0ce9c0 con 0x7f899c161fd0 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f89a1200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f899c0ce840 con 0x7f899c0cb9b0 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f89a1200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f899c0ceb40 con 0x7f899c06c0c0 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f899a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899c161fd0 0x7f899c0c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f899a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899c161fd0 0x7f899c0c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45742/0 (socket says 172.21.15.59:45742) 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f899a800640 1 -- 172.21.15.59:0/2155020573 learned_addr learned my addr 172.21.15.59:0/2155020573 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f8999e00640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f899c06c0c0 0x7f899c0cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f8993e00640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f899c0cb9b0 0x7f899c0b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f899a800640 1 -- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f899c06c0c0 msgr2=0x7f899c0cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f899a800640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f899c06c0c0 0x7f899c0cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f899a800640 1 -- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f899c0cb9b0 msgr2=0x7f899c0b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f899a800640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f899c0cb9b0 0x7f899c0b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f899a800640 1 -- 172.21.15.59:0/2155020573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c0b4f00 con 0x7f899c161fd0 2024-05-30T17:01:10.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f8993e00640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f899c0cb9b0 0x7f899c0b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:10.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f899a800640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899c161fd0 0x7f899c0c8cd0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f899400cd50 tx=0x7f899400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:10.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f8992000640 1 -- 172.21.15.59:0/2155020573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899400f680 con 0x7f899c161fd0 2024-05-30T17:01:10.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f8992000640 1 -- 172.21.15.59:0/2155020573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899400f840 con 0x7f899c161fd0 2024-05-30T17:01:10.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f8992000640 1 -- 172.21.15.59:0/2155020573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899400fc30 con 0x7f899c161fd0 2024-05-30T17:01:10.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f89a1200640 1 -- 172.21.15.59:0/2155020573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c0b51e0 con 0x7f899c161fd0 2024-05-30T17:01:10.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.223+0000 7f89a1200640 1 -- 172.21.15.59:0/2155020573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c0c84d0 con 0x7f899c161fd0 2024-05-30T17:01:10.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.227+0000 7f89a1200640 1 -- 172.21.15.59:0/2155020573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c068a90 con 0x7f899c161fd0 2024-05-30T17:01:10.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.227+0000 7f8992000640 1 -- 172.21.15.59:0/2155020573 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f89940213f0 con 0x7f899c161fd0 2024-05-30T17:01:10.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.227+0000 7f8992000640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8978069850 0x7f897806bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:10.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.227+0000 7f8992000640 1 -- 172.21.15.59:0/2155020573 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5055+0+0 (secure 0 0 0) 0x7f8994086730 con 0x7f899c161fd0 2024-05-30T17:01:10.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.227+0000 7f8999e00640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8978069850 0x7f897806bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:10.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.227+0000 7f8999e00640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8978069850 0x7f897806bd10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f898c0af000 tx=0x7f898c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:10.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.231+0000 7f8992000640 1 -- 172.21.15.59:0/2155020573 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8994014030 con 0x7f899c161fd0 2024-05-30T17:01:10.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.399+0000 7f89a1200640 1 -- 172.21.15.59:0/2155020573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f899c158f80 con 0x7f899c161fd0 2024-05-30T17:01:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f8992000640 1 -- 172.21.15.59:0/2155020573 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f89940583c0 con 0x7f899c161fd0 2024-05-30T17:01:10.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f89a1200640 1 -- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8978069850 msgr2=0x7f897806bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:10.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f89a1200640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8978069850 0x7f897806bd10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f898c0af000 tx=0x7f898c0a7000 comp rx=0 tx=0).stop 2024-05-30T17:01:10.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f89a1200640 1 -- 172.21.15.59:0/2155020573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899c161fd0 msgr2=0x7f899c0c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:10.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f89a1200640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899c161fd0 0x7f899c0c8cd0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f899400cd50 tx=0x7f899400a650 comp rx=0 tx=0).stop 2024-05-30T17:01:10.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f89a1200640 1 -- 172.21.15.59:0/2155020573 shutdown_connections 2024-05-30T17:01:10.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f89a1200640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8978069850 0x7f897806bd10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f89a1200640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899c161fd0 0x7f899c0c8cd0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f89a1200640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f899c0cb9b0 0x7f899c0b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f89a1200640 1 --2- 172.21.15.59:0/2155020573 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f899c06c0c0 0x7f899c0cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f89a1200640 1 -- 172.21.15.59:0/2155020573 >> 172.21.15.59:0/2155020573 conn(0x7f899c0b2f50 msgr2=0x7f899c06ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f89a1200640 1 -- 172.21.15.59:0/2155020573 shutdown_connections 2024-05-30T17:01:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.407+0000 7f89a1200640 1 -- 172.21.15.59:0/2155020573 wait complete. 2024-05-30T17:01:10.430 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_stats_are_printed' 2024-05-30T17:01:10.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.567+0000 7f1419a00640 1 Processor -- start 2024-05-30T17:01:10.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.567+0000 7f1419a00640 1 -- start start 2024-05-30T17:01:10.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1419a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14140d0560 0x7f14140d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:10.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1419a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141415f060 con 0x7f14140af720 2024-05-30T17:01:10.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1419a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141415ff00 con 0x7f141406e900 2024-05-30T17:01:10.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1419a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f14140afb00 con 0x7f14140d0560 2024-05-30T17:01:10.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1412a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14140af720 0x7f141415b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43472/0 (socket says 172.21.15.59:43472) 2024-05-30T17:01:10.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1412a00640 1 -- 172.21.15.59:0/1501251321 learned_addr learned my addr 172.21.15.59:0/1501251321 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:10.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1413400640 1 --2- 172.21.15.59:0/1501251321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14140d0560 0x7f14140d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1412000640 1 -- 172.21.15.59:0/1501251321 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400235490 0 0) 0x7f141415f060 con 0x7f14140af720 2024-05-30T17:01:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1412000640 1 -- 172.21.15.59:0/1501251321 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13f8005740 con 0x7f14140af720 2024-05-30T17:01:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1412000640 1 -- 172.21.15.59:0/1501251321 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1735578941 0 0) 0x7f141415ff00 con 0x7f141406e900 2024-05-30T17:01:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1413400640 1 -- 172.21.15.59:0/1501251321 >> v1:172.21.15.107:6789/0 conn(0x7f141406e900 legacy=0x7f141415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1413400640 1 -- 172.21.15.59:0/1501251321 >> v1:172.21.15.59:6789/0 conn(0x7f14140af720 legacy=0x7f141415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:10.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.571+0000 7f1413400640 1 -- 172.21.15.59:0/1501251321 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141415c270 con 0x7f14140d0560 2024-05-30T17:01:10.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1413400640 1 --2- 172.21.15.59:0/1501251321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14140d0560 0x7f14140d0a10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f140c009dc0 tx=0x7f140c01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a76154573060991 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:10.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1412000640 1 -- 172.21.15.59:0/1501251321 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c0b2070 con 0x7f14140d0560 2024-05-30T17:01:10.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1412000640 1 -- 172.21.15.59:0/1501251321 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140c0a5940 con 0x7f14140d0560 2024-05-30T17:01:10.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1412000640 1 -- 172.21.15.59:0/1501251321 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c0a5d10 con 0x7f14140d0560 2024-05-30T17:01:10.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1419a00640 1 -- 172.21.15.59:0/1501251321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14140d0560 msgr2=0x7f14140d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1419a00640 1 --2- 172.21.15.59:0/1501251321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14140d0560 0x7f14140d0a10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f140c009dc0 tx=0x7f140c01c990 comp rx=0 tx=0).stop 2024-05-30T17:01:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1419a00640 1 -- 172.21.15.59:0/1501251321 shutdown_connections 2024-05-30T17:01:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1419a00640 1 --2- 172.21.15.59:0/1501251321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14140d0560 0x7f14140d0a10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1419a00640 1 -- 172.21.15.59:0/1501251321 >> 172.21.15.59:0/1501251321 conn(0x7f14140b22d0 msgr2=0x7f14140b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1419a00640 1 -- 172.21.15.59:0/1501251321 shutdown_connections 2024-05-30T17:01:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1419a00640 1 -- 172.21.15.59:0/1501251321 wait complete. 2024-05-30T17:01:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1419a00640 1 Processor -- start 2024-05-30T17:01:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.575+0000 7f1419a00640 1 -- start start 2024-05-30T17:01:10.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f1419a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141406e900 0x7f14140b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:10.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f1419a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14140af720 0x7f1414156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:10.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f1419a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14140d0560 0x7f14141fa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:10.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f1419a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f14140732d0 con 0x7f14140af720 2024-05-30T17:01:10.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f1419a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1414073150 con 0x7f14140d0560 2024-05-30T17:01:10.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f1419a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f14141585c0 con 0x7f141406e900 2024-05-30T17:01:10.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14140af720 0x7f1414156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:10.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14140af720 0x7f1414156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45750/0 (socket says 172.21.15.59:45750) 2024-05-30T17:01:10.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140be00640 1 -- 172.21.15.59:0/1644638368 learned_addr learned my addr 172.21.15.59:0/1644638368 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:10.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f1413400640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14140d0560 0x7f14141fa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:10.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f1412a00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141406e900 0x7f14140b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:10.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140be00640 1 -- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141406e900 msgr2=0x7f14140b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:10.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140be00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141406e900 0x7f14140b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140be00640 1 -- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14140d0560 msgr2=0x7f14141fa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:10.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140be00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14140d0560 0x7f14141fa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:10.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140be00640 1 -- 172.21.15.59:0/1644638368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14140b4020 con 0x7f14140af720 2024-05-30T17:01:10.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f1412a00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141406e900 0x7f14140b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:10.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140be00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14140af720 0x7f1414156fb0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c520 tx=0x7f13fc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:10.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140aa00640 1 -- 172.21.15.59:0/1644638368 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc017070 con 0x7f14140af720 2024-05-30T17:01:10.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140aa00640 1 -- 172.21.15.59:0/1644638368 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc003600 con 0x7f14140af720 2024-05-30T17:01:10.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140aa00640 1 -- 172.21.15.59:0/1644638368 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0039f0 con 0x7f14140af720 2024-05-30T17:01:10.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f1419a00640 1 -- 172.21.15.59:0/1644638368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14140b4300 con 0x7f14140af720 2024-05-30T17:01:10.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f1419a00640 1 -- 172.21.15.59:0/1644638368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14140b3c60 con 0x7f14140af720 2024-05-30T17:01:10.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f1419a00640 1 -- 172.21.15.59:0/1644638368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1414068a90 con 0x7f14140af720 2024-05-30T17:01:10.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.579+0000 7f140aa00640 1 -- 172.21.15.59:0/1644638368 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f13fc01a070 con 0x7f14140af720 2024-05-30T17:01:10.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.583+0000 7f140aa00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13f0069850 0x7f13f006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:10.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.583+0000 7f140aa00640 1 -- 172.21.15.59:0/1644638368 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5055+0+0 (secure 0 0 0) 0x7f13fc084a60 con 0x7f14140af720 2024-05-30T17:01:10.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.583+0000 7f1412a00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13f0069850 0x7f13f006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:10.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.583+0000 7f1412a00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13f0069850 0x7f13f006bd10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1404005890 tx=0x7f1404009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:10.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.587+0000 7f140aa00640 1 -- 172.21.15.59:0/1644638368 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f13fc056420 con 0x7f14140af720 2024-05-30T17:01:10.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:10.823+0000 7f1419a00640 1 -- 172.21.15.59:0/1644638368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_stats_are_printed"]} v 0) -- 0x7f14140b44d0 con 0x7f14140af720 2024-05-30T17:01:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f140aa00640 1 -- 172.21.15.59:0/1644638368 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_stats_are_printed"]}]=0 v551) ==== 153+0+0 (secure 0 0 0) 0x7f13fc05a720 con 0x7f14140af720 2024-05-30T17:01:11.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f1419a00640 1 -- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13f0069850 msgr2=0x7f13f006bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f1419a00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13f0069850 0x7f13f006bd10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1404005890 tx=0x7f1404009040 comp rx=0 tx=0).stop 2024-05-30T17:01:11.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f1419a00640 1 -- 172.21.15.59:0/1644638368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14140af720 msgr2=0x7f1414156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f1419a00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14140af720 0x7f1414156fb0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c520 tx=0x7f13fc00c9e0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f1419a00640 1 -- 172.21.15.59:0/1644638368 shutdown_connections 2024-05-30T17:01:11.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f1419a00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f13f0069850 0x7f13f006bd10 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f1419a00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14140d0560 0x7f14141fa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f1419a00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14140af720 0x7f1414156fb0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f1419a00640 1 --2- 172.21.15.59:0/1644638368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141406e900 0x7f14140b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f1419a00640 1 -- 172.21.15.59:0/1644638368 >> 172.21.15.59:0/1644638368 conn(0x7f14140b22d0 msgr2=0x7f1414157c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:11.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f1419a00640 1 -- 172.21.15.59:0/1644638368 shutdown_connections 2024-05-30T17:01:11.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.043+0000 7f1419a00640 1 -- 172.21.15.59:0/1644638368 wait complete. 2024-05-30T17:01:11.068 INFO:tasks.cephfs_test_runner:Test that the command "ceph fs clone status" prints progress stats ... ok 2024-05-30T17:01:11.069 INFO:tasks.cephfs_test_runner:Starting test: test_when_1_clone_is_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that the progress bar, that is printed for 1 ongoing clone job, is 2024-05-30T17:01:11.069 INFO:tasks.cephfs_test_runner:test_when_1_clone_is_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T17:01:11.069 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:01:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.207+0000 7fd758200640 1 Processor -- start 2024-05-30T17:01:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.207+0000 7fd758200640 1 -- start start 2024-05-30T17:01:11.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.207+0000 7fd758200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7500d0560 0x7fd7500d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.207+0000 7fd758200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75015f060 con 0x7fd7500af720 2024-05-30T17:01:11.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.207+0000 7fd758200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75015ff00 con 0x7fd75006e900 2024-05-30T17:01:11.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.207+0000 7fd758200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd7500afb00 con 0x7fd7500d0560 2024-05-30T17:01:11.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.207+0000 7fd755800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd7500af720 0x7fd75015b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43476/0 (socket says 172.21.15.59:43476) 2024-05-30T17:01:11.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.207+0000 7fd755800640 1 -- 172.21.15.59:0/2408938382 learned_addr learned my addr 172.21.15.59:0/2408938382 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.207+0000 7fd756200640 1 --2- 172.21.15.59:0/2408938382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7500d0560 0x7fd7500d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.207+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2757406539 0 0) 0x7fd75015f060 con 0x7fd7500af720 2024-05-30T17:01:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.207+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd738005740 con 0x7fd7500af720 2024-05-30T17:01:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3683406776 0 0) 0x7fd738005740 con 0x7fd7500af720 2024-05-30T17:01:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7500d0560 msgr2=0x7fd7500d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 --2- 172.21.15.59:0/2408938382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7500d0560 0x7fd7500d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 >> v1:172.21.15.107:6789/0 conn(0x7fd75006e900 legacy=0x7fd75015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75015c270 con 0x7fd7500af720 2024-05-30T17:01:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fd744001680 con 0x7fd7500af720 2024-05-30T17:01:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 >> v1:172.21.15.59:6789/0 conn(0x7fd7500af720 legacy=0x7fd75015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 --2- 172.21.15.59:0/2408938382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7500d0560 0x7fd738005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 --2- 172.21.15.59:0/2408938382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd738006180 0x7fd738006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 --2- 172.21.15.59:0/2408938382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd738006f60 0x7fd7380073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7500afb00 con 0x7fd738006180 2024-05-30T17:01:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd73800dcc0 con 0x7fd738006f60 2024-05-30T17:01:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd73800dec0 con 0x7fd7500d0560 2024-05-30T17:01:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd754e00640 1 --2- 172.21.15.59:0/2408938382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd738006180 0x7fd738006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd755800640 1 --2- 172.21.15.59:0/2408938382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7500d0560 0x7fd738005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd756200640 1 --2- 172.21.15.59:0/2408938382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd738006f60 0x7fd7380073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd754e00640 1 -- 172.21.15.59:0/2408938382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7500d0560 msgr2=0x7fd738005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd754e00640 1 --2- 172.21.15.59:0/2408938382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7500d0560 0x7fd738005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd754e00640 1 -- 172.21.15.59:0/2408938382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd738006f60 msgr2=0x7fd7380073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:11.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd754e00640 1 --2- 172.21.15.59:0/2408938382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd738006f60 0x7fd7380073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd754e00640 1 -- 172.21.15.59:0/2408938382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd738005740 con 0x7fd738006180 2024-05-30T17:01:11.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.211+0000 7fd754e00640 1 --2- 172.21.15.59:0/2408938382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd738006180 0x7fd738006a20 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fd73c001750 tx=0x7fd73c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70eea5b7c3cacb46 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:11.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0013a0 con 0x7fd738006180 2024-05-30T17:01:11.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73c0052f0 con 0x7fd738006180 2024-05-30T17:01:11.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd74fe00640 1 -- 172.21.15.59:0/2408938382 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c003840 con 0x7fd738006180 2024-05-30T17:01:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 -- 172.21.15.59:0/2408938382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd738006180 msgr2=0x7fd738006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 --2- 172.21.15.59:0/2408938382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd738006180 0x7fd738006a20 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fd73c001750 tx=0x7fd73c01c3e0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd756200640 1 -- 172.21.15.59:0/2408938382 reap_dead start 2024-05-30T17:01:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 -- 172.21.15.59:0/2408938382 shutdown_connections 2024-05-30T17:01:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 -- 172.21.15.59:0/2408938382 >> 172.21.15.59:0/2408938382 conn(0x7fd7500b22d0 msgr2=0x7fd7500b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 -- 172.21.15.59:0/2408938382 shutdown_connections 2024-05-30T17:01:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 -- 172.21.15.59:0/2408938382 wait complete. 2024-05-30T17:01:11.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 Processor -- start 2024-05-30T17:01:11.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 -- start start 2024-05-30T17:01:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd738006180 0x7fd7500cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750145cc0 0x7fd750143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7501f3ed0 0x7fd750159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd75015c830 con 0x7fd750145cc0 2024-05-30T17:01:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd75015f2d0 con 0x7fd7501f3ed0 2024-05-30T17:01:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd758200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd7500d0a10 con 0x7fd738006180 2024-05-30T17:01:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd754e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750145cc0 0x7fd750143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd754e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750145cc0 0x7fd750143220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45776/0 (socket says 172.21.15.59:45776) 2024-05-30T17:01:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd754e00640 1 -- 172.21.15.59:0/1552714032 learned_addr learned my addr 172.21.15.59:0/1552714032 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:11.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd756200640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7501f3ed0 0x7fd750159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.215+0000 7fd755800640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd738006180 0x7fd7500cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd754e00640 1 -- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd738006180 msgr2=0x7fd7500cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd754e00640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd738006180 0x7fd7500cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd754e00640 1 -- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7501f3ed0 msgr2=0x7fd750159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd754e00640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7501f3ed0 0x7fd750159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd754e00640 1 -- 172.21.15.59:0/1552714032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7500cbc80 con 0x7fd750145cc0 2024-05-30T17:01:11.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd756200640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7501f3ed0 0x7fd750159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:11.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd755800640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd738006180 0x7fd7500cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:11.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd754e00640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750145cc0 0x7fd750143220 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fd73c005040 tx=0x7fd738007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:11.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd74d600640 1 -- 172.21.15.59:0/1552714032 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0ba020 con 0x7fd750145cc0 2024-05-30T17:01:11.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd74d600640 1 -- 172.21.15.59:0/1552714032 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73c000ee0 con 0x7fd750145cc0 2024-05-30T17:01:11.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd74d600640 1 -- 172.21.15.59:0/1552714032 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c007a40 con 0x7fd750145cc0 2024-05-30T17:01:11.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd758200640 1 -- 172.21.15.59:0/1552714032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7500ce4e0 con 0x7fd750145cc0 2024-05-30T17:01:11.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd758200640 1 -- 172.21.15.59:0/1552714032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7500ce7a0 con 0x7fd750145cc0 2024-05-30T17:01:11.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd758200640 1 -- 172.21.15.59:0/1552714032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd750068a90 con 0x7fd750145cc0 2024-05-30T17:01:11.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.219+0000 7fd74d600640 1 -- 172.21.15.59:0/1552714032 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fd73c0bd020 con 0x7fd750145cc0 2024-05-30T17:01:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.223+0000 7fd74d600640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd730069880 0x7fd73006bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.223+0000 7fd74d600640 1 -- 172.21.15.59:0/1552714032 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5055+0+0 (secure 0 0 0) 0x7fd73c11f840 con 0x7fd750145cc0 2024-05-30T17:01:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.223+0000 7fd755800640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd730069880 0x7fd73006bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.223+0000 7fd755800640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd730069880 0x7fd73006bd40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd744001ce0 tx=0x7fd744009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:11.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.227+0000 7fd74d600640 1 -- 172.21.15.59:0/1552714032 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd73c0c4030 con 0x7fd750145cc0 2024-05-30T17:01:11.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.391+0000 7fd758200640 1 -- 172.21.15.59:0/1552714032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7500b26e0 con 0x7fd750145cc0 2024-05-30T17:01:11.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.391+0000 7fd74d600640 1 -- 172.21.15.59:0/1552714032 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+13187 (secure 0 0 0) 0x7fd7500cbc80 con 0x7fd750145cc0 2024-05-30T17:01:11.396 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:11.396 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":96,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:01:10.039661+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6837/1253475085":"2024-05-31T17:01:06.811202+0000","172.21.15.107:6835/1253475085":"2024-05-31T17:01:06.811202+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:01:11.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.395+0000 7fd758200640 1 -- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd730069880 msgr2=0x7fd73006bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.395+0000 7fd758200640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd730069880 0x7fd73006bd40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd744001ce0 tx=0x7fd744009040 comp rx=0 tx=0).stop 2024-05-30T17:01:11.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.395+0000 7fd758200640 1 -- 172.21.15.59:0/1552714032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750145cc0 msgr2=0x7fd750143220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.395+0000 7fd758200640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750145cc0 0x7fd750143220 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fd73c005040 tx=0x7fd738007a50 comp rx=0 tx=0).stop 2024-05-30T17:01:11.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.395+0000 7fd758200640 1 -- 172.21.15.59:0/1552714032 shutdown_connections 2024-05-30T17:01:11.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.395+0000 7fd758200640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd730069880 0x7fd73006bd40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.395+0000 7fd758200640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7501f3ed0 0x7fd750159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.395+0000 7fd758200640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750145cc0 0x7fd750143220 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.395+0000 7fd758200640 1 --2- 172.21.15.59:0/1552714032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd738006180 0x7fd7500cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.395+0000 7fd758200640 1 -- 172.21.15.59:0/1552714032 >> 172.21.15.59:0/1552714032 conn(0x7fd7500b22d0 msgr2=0x7fd750073510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:11.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.395+0000 7fd758200640 1 -- 172.21.15.59:0/1552714032 shutdown_connections 2024-05-30T17:01:11.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.395+0000 7fd758200640 1 -- 172.21.15.59:0/1552714032 wait complete. 2024-05-30T17:01:11.418 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T16:48:53.098546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T17:01:11.418 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T17:01:11.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.559+0000 7f90d3a00640 1 Processor -- start 2024-05-30T17:01:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.559+0000 7f90d3a00640 1 -- start start 2024-05-30T17:01:11.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.559+0000 7f90d3a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90cc161fd0 0x7f90cc0d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d3a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90cc0cb9b0 0x7f90cc0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d3a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90cc0d1150 con 0x7f90cc06b9b0 2024-05-30T17:01:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d3a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f90cc0d0b90 con 0x7f90cc161fd0 2024-05-30T17:01:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d3a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f90cc0d0e70 con 0x7f90cc0cb9b0 2024-05-30T17:01:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d1000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90cc161fd0 0x7f90cc0d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d1000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90cc161fd0 0x7f90cc0d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45780/0 (socket says 172.21.15.59:45780) 2024-05-30T17:01:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d1000640 1 -- 172.21.15.59:0/28990331 learned_addr learned my addr 172.21.15.59:0/28990331 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d1a00640 1 --1- 172.21.15.59:0/28990331 >> v1:172.21.15.59:6789/0 conn(0x7f90cc06b9b0 0x7f90cc0cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43478/0 (socket says 172.21.15.59:43478) 2024-05-30T17:01:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90c3e00640 1 --2- 172.21.15.59:0/28990331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90cc0cb9b0 0x7f90cc0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d1000640 1 -- 172.21.15.59:0/28990331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90cc0cb9b0 msgr2=0x7f90cc0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d1000640 1 --2- 172.21.15.59:0/28990331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90cc0cb9b0 0x7f90cc0b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d1000640 1 -- 172.21.15.59:0/28990331 >> v1:172.21.15.59:6789/0 conn(0x7f90cc06b9b0 legacy=0x7f90cc0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d1000640 1 -- 172.21.15.59:0/28990331 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc0cd620 con 0x7f90cc161fd0 2024-05-30T17:01:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90cbe00640 1 -- 172.21.15.59:0/28990331 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 645767942 0 0) 0x7f90cc0d1150 con 0x7f90cc06b9b0 2024-05-30T17:01:11.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90d1000640 1 --2- 172.21.15.59:0/28990331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc161fd0 0x7f90cc0d05b0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009870 tx=0x7f90bc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5079601bdf45753d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:11.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.563+0000 7f90cbe00640 1 -- 172.21.15.59:0/28990331 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0b0070 con 0x7f90cc161fd0 2024-05-30T17:01:11.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90cbe00640 1 -- 172.21.15.59:0/28990331 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc0ab600 con 0x7f90cc161fd0 2024-05-30T17:01:11.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90cbe00640 1 -- 172.21.15.59:0/28990331 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0ab9d0 con 0x7f90cc161fd0 2024-05-30T17:01:11.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 -- 172.21.15.59:0/28990331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc161fd0 msgr2=0x7f90cc0d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 --2- 172.21.15.59:0/28990331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc161fd0 0x7f90cc0d05b0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009870 tx=0x7f90bc01c4d0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 -- 172.21.15.59:0/28990331 shutdown_connections 2024-05-30T17:01:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 --2- 172.21.15.59:0/28990331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90cc0cb9b0 0x7f90cc0b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 --2- 172.21.15.59:0/28990331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc161fd0 0x7f90cc0d05b0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 -- 172.21.15.59:0/28990331 >> 172.21.15.59:0/28990331 conn(0x7f90cc0b2f50 msgr2=0x7f90cc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 -- 172.21.15.59:0/28990331 shutdown_connections 2024-05-30T17:01:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 -- 172.21.15.59:0/28990331 wait complete. 2024-05-30T17:01:11.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 Processor -- start 2024-05-30T17:01:11.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 -- start start 2024-05-30T17:01:11.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc06b9b0 0x7f90cc14ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90cc0cb9b0 0x7f90cc0afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90cc161fd0 0x7f90cc15a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc16b700 con 0x7f90cc06b9b0 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc16b580 con 0x7f90cc161fd0 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d3a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f90cc16b880 con 0x7f90cc0cb9b0 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc06b9b0 0x7f90cc14ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc06b9b0 0x7f90cc14ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45782/0 (socket says 172.21.15.59:45782) 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d1000640 1 -- 172.21.15.59:0/3998966162 learned_addr learned my addr 172.21.15.59:0/3998966162 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d1a00640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90cc161fd0 0x7f90cc15a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90c3e00640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90cc0cb9b0 0x7f90cc0afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d1000640 1 -- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90cc0cb9b0 msgr2=0x7f90cc0afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d1000640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90cc0cb9b0 0x7f90cc0afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d1000640 1 -- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90cc161fd0 msgr2=0x7f90cc15a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d1000640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90cc161fd0 0x7f90cc15a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.567+0000 7f90d1000640 1 -- 172.21.15.59:0/3998966162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc0c84d0 con 0x7f90cc06b9b0 2024-05-30T17:01:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.571+0000 7f90d1000640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc06b9b0 0x7f90cc14ced0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f90bc01a100 tx=0x7f90bc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:11.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.571+0000 7f90c9600640 1 -- 172.21.15.59:0/3998966162 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0ba020 con 0x7f90cc06b9b0 2024-05-30T17:01:11.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.571+0000 7f90c9600640 1 -- 172.21.15.59:0/3998966162 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc0b6420 con 0x7f90cc06b9b0 2024-05-30T17:01:11.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.571+0000 7f90d3a00640 1 -- 172.21.15.59:0/3998966162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90cc0c8770 con 0x7f90cc06b9b0 2024-05-30T17:01:11.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.571+0000 7f90c9600640 1 -- 172.21.15.59:0/3998966162 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0b0040 con 0x7f90cc06b9b0 2024-05-30T17:01:11.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.571+0000 7f90d3a00640 1 -- 172.21.15.59:0/3998966162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90cc0c8d30 con 0x7f90cc06b9b0 2024-05-30T17:01:11.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.571+0000 7f90d3a00640 1 -- 172.21.15.59:0/3998966162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90cc068a90 con 0x7f90cc06b9b0 2024-05-30T17:01:11.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.571+0000 7f90c9600640 1 -- 172.21.15.59:0/3998966162 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f90bc0bd020 con 0x7f90cc06b9b0 2024-05-30T17:01:11.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.571+0000 7f90c9600640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f90a8069850 0x7f90a806bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.571+0000 7f90c9600640 1 -- 172.21.15.59:0/3998966162 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5055+0+0 (secure 0 0 0) 0x7f90bc11f8e0 con 0x7f90cc06b9b0 2024-05-30T17:01:11.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.575+0000 7f90c3e00640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f90a8069850 0x7f90a806bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.575+0000 7f90c3e00640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f90a8069850 0x7f90a806bd10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0b1da0 tx=0x7f90b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:11.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.579+0000 7f90c9600640 1 -- 172.21.15.59:0/3998966162 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f90bc0c4030 con 0x7f90cc06b9b0 2024-05-30T17:01:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.743+0000 7f90d3a00640 1 -- 172.21.15.59:0/3998966162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f90cc1587f0 con 0x7f90cc06b9b0 2024-05-30T17:01:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.743+0000 7f90c9600640 1 -- 172.21.15.59:0/3998966162 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) ==== 93+0+10 (secure 0 0 0) 0x7f90bc016150 con 0x7f90cc06b9b0 2024-05-30T17:01:11.748 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-05-30T17:01:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.747+0000 7f90d3a00640 1 -- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f90a8069850 msgr2=0x7f90a806bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.747+0000 7f90d3a00640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f90a8069850 0x7f90a806bd10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0b1da0 tx=0x7f90b4008040 comp rx=0 tx=0).stop 2024-05-30T17:01:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.747+0000 7f90d3a00640 1 -- 172.21.15.59:0/3998966162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc06b9b0 msgr2=0x7f90cc14ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.747+0000 7f90d3a00640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc06b9b0 0x7f90cc14ced0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f90bc01a100 tx=0x7f90bc01ad10 comp rx=0 tx=0).stop 2024-05-30T17:01:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.747+0000 7f90d3a00640 1 -- 172.21.15.59:0/3998966162 shutdown_connections 2024-05-30T17:01:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.747+0000 7f90d3a00640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f90a8069850 0x7f90a806bd10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.747+0000 7f90d3a00640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90cc161fd0 0x7f90cc15a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.747+0000 7f90d3a00640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90cc0cb9b0 0x7f90cc0afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.747+0000 7f90d3a00640 1 --2- 172.21.15.59:0/3998966162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc06b9b0 0x7f90cc14ced0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.747+0000 7f90d3a00640 1 -- 172.21.15.59:0/3998966162 >> 172.21.15.59:0/3998966162 conn(0x7f90cc0b2f50 msgr2=0x7f90cc0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.747+0000 7f90d3a00640 1 -- 172.21.15.59:0/3998966162 shutdown_connections 2024-05-30T17:01:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.747+0000 7f90d3a00640 1 -- 172.21.15.59:0/3998966162 wait complete. 2024-05-30T17:01:11.768 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_1_clone_is_cancelled' 2024-05-30T17:01:11.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f9403200640 1 Processor -- start 2024-05-30T17:01:11.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f9403200640 1 -- start start 2024-05-30T17:01:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f9403200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93fc15a980 0x7f93fc0731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f9403200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f93fc06ede0 0x7f93fc0b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f9403200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93fc0b31d0 con 0x7f93fc15ad60 2024-05-30T17:01:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f9403200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f93fc073c30 con 0x7f93fc06ede0 2024-05-30T17:01:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f9403200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f93fc073f10 con 0x7f93fc15a980 2024-05-30T17:01:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f93f3400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f93fc15ad60 0x7f93fc06e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43492/0 (socket says 172.21.15.59:43492) 2024-05-30T17:01:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f93f3400640 1 -- 172.21.15.59:0/2169951221 learned_addr learned my addr 172.21.15.59:0/2169951221 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f93fbe00640 1 --2- 172.21.15.59:0/2169951221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93fc15a980 0x7f93fc0731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f9401200640 1 --2- 172.21.15.59:0/2169951221 >> v2:172.21.15.107:3300/0 conn(0x7f93fc06ede0 0x7f93fc0b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f93fb400640 1 -- 172.21.15.59:0/2169951221 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 208392650 0 0) 0x7f93fc0b31d0 con 0x7f93fc15ad60 2024-05-30T17:01:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.907+0000 7f93fb400640 1 -- 172.21.15.59:0/2169951221 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93e0003530 con 0x7f93fc15ad60 2024-05-30T17:01:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f93fbe00640 1 -- 172.21.15.59:0/2169951221 >> v2:172.21.15.107:3300/0 conn(0x7f93fc06ede0 msgr2=0x7f93fc0b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f93fbe00640 1 --2- 172.21.15.59:0/2169951221 >> v2:172.21.15.107:3300/0 conn(0x7f93fc06ede0 0x7f93fc0b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f93fbe00640 1 -- 172.21.15.59:0/2169951221 >> v1:172.21.15.59:6789/0 conn(0x7f93fc15ad60 legacy=0x7f93fc06e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f93fb400640 1 -- 172.21.15.59:0/2169951221 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3204686686 0 0) 0x7f93e0003530 con 0x7f93fc15ad60 2024-05-30T17:01:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f93fbe00640 1 -- 172.21.15.59:0/2169951221 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc0b3470 con 0x7f93fc15a980 2024-05-30T17:01:11.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f93fbe00640 1 --2- 172.21.15.59:0/2169951221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93fc15a980 0x7f93fc0731f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0097c0 tx=0x7f93ec01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52879e9c415f49fe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:11.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f93fb400640 1 -- 172.21.15.59:0/2169951221 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0b2070 con 0x7f93fc15a980 2024-05-30T17:01:11.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f93fb400640 1 -- 172.21.15.59:0/2169951221 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93ec0ad680 con 0x7f93fc15a980 2024-05-30T17:01:11.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f93fb400640 1 -- 172.21.15.59:0/2169951221 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0ada30 con 0x7f93fc15a980 2024-05-30T17:01:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f9403200640 1 -- 172.21.15.59:0/2169951221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93fc15a980 msgr2=0x7f93fc0731f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f9403200640 1 --2- 172.21.15.59:0/2169951221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93fc15a980 0x7f93fc0731f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0097c0 tx=0x7f93ec01c470 comp rx=0 tx=0).stop 2024-05-30T17:01:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f9403200640 1 -- 172.21.15.59:0/2169951221 shutdown_connections 2024-05-30T17:01:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f9403200640 1 --2- 172.21.15.59:0/2169951221 >> v2:172.21.15.107:3300/0 conn(0x7f93fc06ede0 0x7f93fc0b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f9403200640 1 --2- 172.21.15.59:0/2169951221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93fc15a980 0x7f93fc0731f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.911+0000 7f9403200640 1 -- 172.21.15.59:0/2169951221 >> 172.21.15.59:0/2169951221 conn(0x7f93fc0b22d0 msgr2=0x7f93fc0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f9403200640 1 -- 172.21.15.59:0/2169951221 shutdown_connections 2024-05-30T17:01:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f9403200640 1 -- 172.21.15.59:0/2169951221 wait complete. 2024-05-30T17:01:11.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f9403200640 1 Processor -- start 2024-05-30T17:01:11.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f9403200640 1 -- start start 2024-05-30T17:01:11.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f9403200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93fc06ede0 0x7f93fc158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f9403200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93fc15a980 0x7f93fc14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f9403200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93fc0b0e90 0x7f93fc0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f9403200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc0b4540 con 0x7f93fc15a980 2024-05-30T17:01:11.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f9403200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc0b43c0 con 0x7f93fc06ede0 2024-05-30T17:01:11.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f9403200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f93fc0b46c0 con 0x7f93fc0b0e90 2024-05-30T17:01:11.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f93f3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93fc15a980 0x7f93fc14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f93f3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93fc15a980 0x7f93fc14b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55614/0 (socket says 172.21.15.59:55614) 2024-05-30T17:01:11.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f93f3400640 1 -- 172.21.15.59:0/729768468 learned_addr learned my addr 172.21.15.59:0/729768468 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:11.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f93fbe00640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93fc06ede0 0x7f93fc158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f9401200640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93fc0b0e90 0x7f93fc0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f93f3400640 1 -- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93fc0b0e90 msgr2=0x7f93fc0b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f93f3400640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93fc0b0e90 0x7f93fc0b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f93f3400640 1 -- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93fc06ede0 msgr2=0x7f93fc158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f93f3400640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93fc06ede0 0x7f93fc158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f93f3400640 1 -- 172.21.15.59:0/729768468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc157e40 con 0x7f93fc15a980 2024-05-30T17:01:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f93f3400640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93fc15a980 0x7f93fc14b230 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f93e400cb20 tx=0x7f93e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.915+0000 7f93f8c00640 1 -- 172.21.15.59:0/729768468 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e400aca0 con 0x7f93fc15a980 2024-05-30T17:01:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.919+0000 7f93f8c00640 1 -- 172.21.15.59:0/729768468 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e400ae40 con 0x7f93fc15a980 2024-05-30T17:01:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.919+0000 7f9403200640 1 -- 172.21.15.59:0/729768468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93fc158120 con 0x7f93fc15a980 2024-05-30T17:01:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.919+0000 7f93f8c00640 1 -- 172.21.15.59:0/729768468 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4012640 con 0x7f93fc15a980 2024-05-30T17:01:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.919+0000 7f9403200640 1 -- 172.21.15.59:0/729768468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93fc1586e0 con 0x7f93fc15a980 2024-05-30T17:01:11.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.919+0000 7f9403200640 1 -- 172.21.15.59:0/729768468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93fc068a90 con 0x7f93fc15a980 2024-05-30T17:01:11.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.919+0000 7f93f8c00640 1 -- 172.21.15.59:0/729768468 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f93e40127e0 con 0x7f93fc15a980 2024-05-30T17:01:11.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.919+0000 7f93f8c00640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93d80698d0 0x7f93d806bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:11.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.919+0000 7f93f8c00640 1 -- 172.21.15.59:0/729768468 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5055+0+0 (secure 0 0 0) 0x7f93e4086160 con 0x7f93fc15a980 2024-05-30T17:01:11.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.919+0000 7f93fbe00640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93d80698d0 0x7f93d806bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:11.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.923+0000 7f93fbe00640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93d80698d0 0x7f93d806bd90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0af000 tx=0x7f93ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:11.923+0000 7f93f8c00640 1 -- 172.21.15.59:0/729768468 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f93e4057d90 con 0x7f93fc15a980 2024-05-30T17:01:12.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:12.147+0000 7f9403200640 1 -- 172.21.15.59:0/729768468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_1_clone_is_cancelled"]} v 0) -- 0x7f93fc072360 con 0x7f93fc15a980 2024-05-30T17:01:13.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.051+0000 7f93f8c00640 1 -- 172.21.15.59:0/729768468 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_1_clone_is_cancelled"]}]=0 v553) ==== 164+0+0 (secure 0 0 0) 0x7f93e4057690 con 0x7f93fc15a980 2024-05-30T17:01:13.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.055+0000 7f9403200640 1 -- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93d80698d0 msgr2=0x7f93d806bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:13.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.055+0000 7f9403200640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93d80698d0 0x7f93d806bd90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0af000 tx=0x7f93ec008040 comp rx=0 tx=0).stop 2024-05-30T17:01:13.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.055+0000 7f9403200640 1 -- 172.21.15.59:0/729768468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93fc15a980 msgr2=0x7f93fc14b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:13.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.055+0000 7f9403200640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93fc15a980 0x7f93fc14b230 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f93e400cb20 tx=0x7f93e400a060 comp rx=0 tx=0).stop 2024-05-30T17:01:13.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.055+0000 7f9403200640 1 -- 172.21.15.59:0/729768468 shutdown_connections 2024-05-30T17:01:13.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.055+0000 7f9403200640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f93d80698d0 0x7f93d806bd90 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.055+0000 7f9403200640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f93fc0b0e90 0x7f93fc0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.055+0000 7f9403200640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93fc15a980 0x7f93fc14b230 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.055+0000 7f9403200640 1 --2- 172.21.15.59:0/729768468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93fc06ede0 0x7f93fc158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.055+0000 7f9403200640 1 -- 172.21.15.59:0/729768468 >> 172.21.15.59:0/729768468 conn(0x7f93fc0b22d0 msgr2=0x7f93fc1522d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:13.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.055+0000 7f9403200640 1 -- 172.21.15.59:0/729768468 shutdown_connections 2024-05-30T17:01:13.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.055+0000 7f9403200640 1 -- 172.21.15.59:0/729768468 wait complete. 2024-05-30T17:01:13.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T17:01:13.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.227+0000 7f7cac200640 1 Processor -- start 2024-05-30T17:01:13.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.227+0000 7f7cac200640 1 -- start start 2024-05-30T17:01:13.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.227+0000 7f7cac200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7ca4141f20 0x7f7ca406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:13.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.227+0000 7f7cac200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca4163260 con 0x7f7ca406bce0 2024-05-30T17:01:13.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.227+0000 7f7cac200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca41626e0 con 0x7f7ca40c9e10 2024-05-30T17:01:13.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.227+0000 7f7cac200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7ca41629c0 con 0x7f7ca4141f20 2024-05-30T17:01:13.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.227+0000 7f7caa200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7ca406bce0 0x7f7ca406c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58830/0 (socket says 172.21.15.59:58830) 2024-05-30T17:01:13.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.227+0000 7f7caa200640 1 -- 172.21.15.59:0/3928308933 learned_addr learned my addr 172.21.15.59:0/3928308933 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:13.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.227+0000 7f7ca8e00640 1 --2- 172.21.15.59:0/3928308933 >> v2:172.21.15.107:3300/0 conn(0x7f7ca4141f20 0x7f7ca406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:13.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.231+0000 7f7ca3e00640 1 -- 172.21.15.59:0/3928308933 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 939619569 0 0) 0x7f7ca4163260 con 0x7f7ca406bce0 2024-05-30T17:01:13.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.231+0000 7f7ca3e00640 1 -- 172.21.15.59:0/3928308933 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c8c003530 con 0x7f7ca406bce0 2024-05-30T17:01:13.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.231+0000 7f7ca8e00640 1 -- 172.21.15.59:0/3928308933 >> v1:172.21.15.107:6789/0 conn(0x7f7ca40c9e10 legacy=0x7f7ca40ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.231+0000 7f7ca3e00640 1 -- 172.21.15.59:0/3928308933 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4036057458 0 0) 0x7f7c8c003530 con 0x7f7ca406bce0 2024-05-30T17:01:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.231+0000 7f7ca8e00640 1 -- 172.21.15.59:0/3928308933 >> v1:172.21.15.59:6789/0 conn(0x7f7ca406bce0 legacy=0x7f7ca406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.231+0000 7f7ca8e00640 1 -- 172.21.15.59:0/3928308933 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca4162ca0 con 0x7f7ca4141f20 2024-05-30T17:01:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.231+0000 7f7ca8e00640 1 --2- 172.21.15.59:0/3928308933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ca4141f20 0x7f7ca406ce90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7c900097c0 tx=0x7f7c9001c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1a4468dc9998065 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:13.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.231+0000 7f7ca3e00640 1 -- 172.21.15.59:0/3928308933 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900b0070 con 0x7f7ca4141f20 2024-05-30T17:01:13.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.231+0000 7f7ca3e00640 1 -- 172.21.15.59:0/3928308933 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c900ab400 con 0x7f7ca4141f20 2024-05-30T17:01:13.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.231+0000 7f7ca3e00640 1 -- 172.21.15.59:0/3928308933 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c001a00 con 0x7f7ca4141f20 2024-05-30T17:01:13.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 -- 172.21.15.59:0/3928308933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ca4141f20 msgr2=0x7f7ca406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 --2- 172.21.15.59:0/3928308933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ca4141f20 0x7f7ca406ce90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7c900097c0 tx=0x7f7c9001c2a0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 -- 172.21.15.59:0/3928308933 shutdown_connections 2024-05-30T17:01:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 --2- 172.21.15.59:0/3928308933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ca4141f20 0x7f7ca406ce90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 -- 172.21.15.59:0/3928308933 >> 172.21.15.59:0/3928308933 conn(0x7f7ca40cd540 msgr2=0x7f7ca40cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 -- 172.21.15.59:0/3928308933 shutdown_connections 2024-05-30T17:01:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 -- 172.21.15.59:0/3928308933 wait complete. 2024-05-30T17:01:13.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 Processor -- start 2024-05-30T17:01:13.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 -- start start 2024-05-30T17:01:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ca406bce0 0x7f7ca413c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ca40c9e10 0x7f7ca40b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ca4141f20 0x7f7ca40b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca40cd350 con 0x7f7ca40c9e10 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca40cd1d0 con 0x7f7ca4141f20 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7cac200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca416cec0 con 0x7f7ca406bce0 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7ca8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ca40c9e10 0x7f7ca40b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7ca8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ca40c9e10 0x7f7ca40b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55624/0 (socket says 172.21.15.59:55624) 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7ca8e00640 1 -- 172.21.15.59:0/2309654193 learned_addr learned my addr 172.21.15.59:0/2309654193 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7caa200640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ca4141f20 0x7f7ca40b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7ca9800640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ca406bce0 0x7f7ca413c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7ca8e00640 1 -- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ca406bce0 msgr2=0x7f7ca413c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7ca8e00640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ca406bce0 0x7f7ca413c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7ca8e00640 1 -- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ca4141f20 msgr2=0x7f7ca40b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7ca8e00640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ca4141f20 0x7f7ca40b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7ca8e00640 1 -- 172.21.15.59:0/2309654193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca413ff50 con 0x7f7ca40c9e10 2024-05-30T17:01:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.235+0000 7f7ca9800640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ca406bce0 0x7f7ca413c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:13.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.239+0000 7f7ca8e00640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ca40c9e10 0x7f7ca40b5a50 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f7c90018eb0 tx=0x7f7c90019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:13.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.239+0000 7f7ca1600640 1 -- 172.21.15.59:0/2309654193 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900b8020 con 0x7f7ca40c9e10 2024-05-30T17:01:13.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.239+0000 7f7ca1600640 1 -- 172.21.15.59:0/2309654193 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c900b4410 con 0x7f7ca40c9e10 2024-05-30T17:01:13.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.239+0000 7f7ca1600640 1 -- 172.21.15.59:0/2309654193 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900b0040 con 0x7f7ca40c9e10 2024-05-30T17:01:13.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.239+0000 7f7cac200640 1 -- 172.21.15.59:0/2309654193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca41fb6e0 con 0x7f7ca40c9e10 2024-05-30T17:01:13.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.239+0000 7f7cac200640 1 -- 172.21.15.59:0/2309654193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca41404d0 con 0x7f7ca40c9e10 2024-05-30T17:01:13.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.239+0000 7f7cac200640 1 -- 172.21.15.59:0/2309654193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca4068a90 con 0x7f7ca40c9e10 2024-05-30T17:01:13.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.239+0000 7f7ca1600640 1 -- 172.21.15.59:0/2309654193 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f7c900bb020 con 0x7f7ca40c9e10 2024-05-30T17:01:13.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.239+0000 7f7ca1600640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7c84069880 0x7f7c8406bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:13.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.243+0000 7f7ca1600640 1 -- 172.21.15.59:0/2309654193 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5055+0+0 (secure 0 0 0) 0x7f7c9011f000 con 0x7f7ca40c9e10 2024-05-30T17:01:13.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.243+0000 7f7ca9800640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7c84069880 0x7f7c8406bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:13.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.243+0000 7f7ca9800640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7c84069880 0x7f7c8406bd40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7c98000f70 tx=0x7f7c98009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.247+0000 7f7ca1600640 1 -- 172.21.15.59:0/2309654193 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7c900c2070 con 0x7f7ca40c9e10 2024-05-30T17:01:13.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.411+0000 7f7cac200640 1 -- 172.21.15.59:0/2309654193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7ca413db20 con 0x7f7ca40c9e10 2024-05-30T17:01:13.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7ca1600640 1 -- 172.21.15.59:0/2309654193 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f7c90015fb0 con 0x7f7ca40c9e10 2024-05-30T17:01:13.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7cac200640 1 -- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7c84069880 msgr2=0x7f7c8406bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:13.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7cac200640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7c84069880 0x7f7c8406bd40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7c98000f70 tx=0x7f7c98009040 comp rx=0 tx=0).stop 2024-05-30T17:01:13.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7cac200640 1 -- 172.21.15.59:0/2309654193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ca40c9e10 msgr2=0x7f7ca40b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:13.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7cac200640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ca40c9e10 0x7f7ca40b5a50 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f7c90018eb0 tx=0x7f7c90019040 comp rx=0 tx=0).stop 2024-05-30T17:01:13.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7cac200640 1 -- 172.21.15.59:0/2309654193 shutdown_connections 2024-05-30T17:01:13.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7cac200640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7c84069880 0x7f7c8406bd40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7cac200640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ca4141f20 0x7f7ca40b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7cac200640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ca40c9e10 0x7f7ca40b5a50 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7cac200640 1 --2- 172.21.15.59:0/2309654193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ca406bce0 0x7f7ca413c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7cac200640 1 -- 172.21.15.59:0/2309654193 >> 172.21.15.59:0/2309654193 conn(0x7f7ca40cd540 msgr2=0x7f7ca40ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:13.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7cac200640 1 -- 172.21.15.59:0/2309654193 shutdown_connections 2024-05-30T17:01:13.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.415+0000 7f7cac200640 1 -- 172.21.15.59:0/2309654193 wait complete. 2024-05-30T17:01:13.440 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T17:01:13.440 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T17:01:13.526 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T17:01:13.616 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T17:01:13.616 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:01:13.616 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:01:13.625 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T17:01:13.625 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:01:13.625 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:01:13.634 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:01:13.634 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:01:13.634 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:01:13.675 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T17:01:13.676 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:01:13.676 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:01:13.685 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:01:13.685 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T17:01:13.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:01:13.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.855+0000 7fa958c00640 1 Processor -- start 2024-05-30T17:01:13.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.855+0000 7fa958c00640 1 -- start start 2024-05-30T17:01:13.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa958c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa95406fc20 0x7fa9540ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:13.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa958c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9540c7f70 0x7fa9540cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:13.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa958c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9540c74d0 con 0x7fa95415b5f0 2024-05-30T17:01:13.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa958c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa9540c7d30 con 0x7fa9540c7f70 2024-05-30T17:01:13.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa958c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa9540cec00 con 0x7fa95406fc20 2024-05-30T17:01:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa952800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9540c7f70 0x7fa9540cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa952800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9540c7f70 0x7fa9540cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55626/0 (socket says 172.21.15.59:55626) 2024-05-30T17:01:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa952800640 1 -- 172.21.15.59:0/635423566 learned_addr learned my addr 172.21.15.59:0/635423566 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa94be00640 1 --2- 172.21.15.59:0/635423566 >> v2:172.21.15.107:3300/0 conn(0x7fa95406fc20 0x7fa9540ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa952800640 1 -- 172.21.15.59:0/635423566 >> v2:172.21.15.107:3300/0 conn(0x7fa95406fc20 msgr2=0x7fa9540ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa952800640 1 --2- 172.21.15.59:0/635423566 >> v2:172.21.15.107:3300/0 conn(0x7fa95406fc20 0x7fa9540ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa952800640 1 -- 172.21.15.59:0/635423566 >> v1:172.21.15.107:6789/0 conn(0x7fa95415b5f0 legacy=0x7fa95406f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa952800640 1 -- 172.21.15.59:0/635423566 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9540c7770 con 0x7fa9540c7f70 2024-05-30T17:01:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa94be00640 1 --2- 172.21.15.59:0/635423566 >> v2:172.21.15.107:3300/0 conn(0x7fa95406fc20 0x7fa9540ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:13.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.859+0000 7fa952800640 1 --2- 172.21.15.59:0/635423566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9540c7f70 0x7fa9540cf870 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fa9540729d0 tx=0x7fa94c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3a6cafba8239e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa951400640 1 -- 172.21.15.59:0/635423566 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c0a57d0 con 0x7fa9540c7f70 2024-05-30T17:01:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa951400640 1 -- 172.21.15.59:0/635423566 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94c0a5970 con 0x7fa9540c7f70 2024-05-30T17:01:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa951400640 1 -- 172.21.15.59:0/635423566 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c0a5d40 con 0x7fa9540c7f70 2024-05-30T17:01:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 -- 172.21.15.59:0/635423566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9540c7f70 msgr2=0x7fa9540cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 --2- 172.21.15.59:0/635423566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9540c7f70 0x7fa9540cf870 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fa9540729d0 tx=0x7fa94c01c8f0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 -- 172.21.15.59:0/635423566 shutdown_connections 2024-05-30T17:01:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 --2- 172.21.15.59:0/635423566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9540c7f70 0x7fa9540cf870 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 --2- 172.21.15.59:0/635423566 >> v2:172.21.15.107:3300/0 conn(0x7fa95406fc20 0x7fa9540ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 -- 172.21.15.59:0/635423566 >> 172.21.15.59:0/635423566 conn(0x7fa9540b2fc0 msgr2=0x7fa9540b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 -- 172.21.15.59:0/635423566 shutdown_connections 2024-05-30T17:01:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 -- 172.21.15.59:0/635423566 wait complete. 2024-05-30T17:01:13.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 Processor -- start 2024-05-30T17:01:13.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 -- start start 2024-05-30T17:01:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa95406fc20 0x7fa9541474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9540c7f70 0x7fa9540b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95415b5f0 0x7fa9540b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa9540d0950 con 0x7fa9540c7f70 2024-05-30T17:01:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa9540d07d0 con 0x7fa95406fc20 2024-05-30T17:01:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa958c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa9540d0ad0 con 0x7fa95415b5f0 2024-05-30T17:01:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa94be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9540c7f70 0x7fa9540b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa94be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9540c7f70 0x7fa9540b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55640/0 (socket says 172.21.15.59:55640) 2024-05-30T17:01:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa94be00640 1 -- 172.21.15.59:0/3210225582 learned_addr learned my addr 172.21.15.59:0/3210225582 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.863+0000 7fa951e00640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa95406fc20 0x7fa9541474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa952800640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95415b5f0 0x7fa9540b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa94be00640 1 -- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95415b5f0 msgr2=0x7fa9540b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:13.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa94be00640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95415b5f0 0x7fa9540b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa94be00640 1 -- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa95406fc20 msgr2=0x7fa9541474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:13.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa94be00640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa95406fc20 0x7fa9541474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:13.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa94be00640 1 -- 172.21.15.59:0/3210225582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9541479f0 con 0x7fa9540c7f70 2024-05-30T17:01:13.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa94be00640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9540c7f70 0x7fa9540b2850 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00c820 tx=0x7fa93c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:13.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa94a000640 1 -- 172.21.15.59:0/3210225582 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c015070 con 0x7fa9540c7f70 2024-05-30T17:01:13.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa94a000640 1 -- 172.21.15.59:0/3210225582 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa93c007a30 con 0x7fa9540c7f70 2024-05-30T17:01:13.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa94a000640 1 -- 172.21.15.59:0/3210225582 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c007e40 con 0x7fa9540c7f70 2024-05-30T17:01:13.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa958c00640 1 -- 172.21.15.59:0/3210225582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9540b2d90 con 0x7fa9540c7f70 2024-05-30T17:01:13.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa958c00640 1 -- 172.21.15.59:0/3210225582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9540b1a90 con 0x7fa9540c7f70 2024-05-30T17:01:13.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa958c00640 1 -- 172.21.15.59:0/3210225582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa954068a90 con 0x7fa9540c7f70 2024-05-30T17:01:13.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.867+0000 7fa94a000640 1 -- 172.21.15.59:0/3210225582 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fa93c018070 con 0x7fa9540c7f70 2024-05-30T17:01:13.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.871+0000 7fa94a000640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930069880 0x7fa93006bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:13.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.871+0000 7fa94a000640 1 -- 172.21.15.59:0/3210225582 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5055+0+0 (secure 0 0 0) 0x7fa93c085490 con 0x7fa9540c7f70 2024-05-30T17:01:13.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.871+0000 7fa951e00640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930069880 0x7fa93006bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:13.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.871+0000 7fa951e00640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930069880 0x7fa93006bd40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa9440098e0 tx=0x7fa944009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:13.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:13.875+0000 7fa94a000640 1 -- 172.21.15.59:0/3210225582 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa93c056e50 con 0x7fa9540c7f70 2024-05-30T17:01:14.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.071+0000 7fa958c00640 1 -- 172.21.15.59:0/3210225582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9541547a0 con 0x7fa9540c7f70 2024-05-30T17:01:14.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.071+0000 7fa94a000640 1 -- 172.21.15.59:0/3210225582 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+3872 (secure 0 0 0) 0x7fa93c05b150 con 0x7fa9540c7f70 2024-05-30T17:01:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:14.076 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2633891859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2633891859},{"type":"v1","addr":"172.21.15.59:6835","nonce":2633891859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6587,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3154468709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3154468709},{"type":"v1","addr":"172.21.15.107:6837","nonce":3154468709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6865,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3975520725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3975520725},{"type":"v1","addr":"172.21.15.107:6836","nonce":3975520725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/456119548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":456119548},{"type":"v1","addr":"172.21.15.59:6834","nonce":456119548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[]} 2024-05-30T17:01:14.076 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 55 2024-05-30T17:01:14.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.075+0000 7fa958c00640 1 -- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930069880 msgr2=0x7fa93006bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:14.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.075+0000 7fa958c00640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930069880 0x7fa93006bd40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa9440098e0 tx=0x7fa944009060 comp rx=0 tx=0).stop 2024-05-30T17:01:14.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.075+0000 7fa958c00640 1 -- 172.21.15.59:0/3210225582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9540c7f70 msgr2=0x7fa9540b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:14.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.075+0000 7fa958c00640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9540c7f70 0x7fa9540b2850 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00c820 tx=0x7fa93c00cce0 comp rx=0 tx=0).stop 2024-05-30T17:01:14.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.075+0000 7fa958c00640 1 -- 172.21.15.59:0/3210225582 shutdown_connections 2024-05-30T17:01:14.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.075+0000 7fa958c00640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa930069880 0x7fa93006bd40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:14.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.075+0000 7fa958c00640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa95415b5f0 0x7fa9540b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:14.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.075+0000 7fa958c00640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9540c7f70 0x7fa9540b2850 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:14.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.075+0000 7fa958c00640 1 --2- 172.21.15.59:0/3210225582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa95406fc20 0x7fa9541474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:14.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.075+0000 7fa958c00640 1 -- 172.21.15.59:0/3210225582 >> 172.21.15.59:0/3210225582 conn(0x7fa9540b2fc0 msgr2=0x7fa9540c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:14.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.075+0000 7fa958c00640 1 -- 172.21.15.59:0/3210225582 shutdown_connections 2024-05-30T17:01:14.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.075+0000 7fa958c00640 1 -- 172.21.15.59:0/3210225582 wait complete. 2024-05-30T17:01:14.098 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T17:01:14.098 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T17:01:14.099 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T17:01:14.099 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:01:14.099 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T17:01:14.099 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T17:01:14.099 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T17:01:14.099 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:01:14.099 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T17:01:14.100 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T17:01:14.100 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T17:01:14.100 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:01:14.100 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T17:01:14.100 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T17:01:14.100 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T17:01:14.100 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:01:14.113 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T17:01:14.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T17:01:14.114 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T17:01:14.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T17:01:14.117 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T17:01:14.117 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T17:01:14.118 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T17:01:14.118 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T17:01:14.162 INFO:tasks.ceph.mds.c:Started 2024-05-30T17:01:14.163 DEBUG:teuthology.parallel:result is None 2024-05-30T17:01:14.164 INFO:tasks.ceph.mds.a:Started 2024-05-30T17:01:14.164 DEBUG:teuthology.parallel:result is None 2024-05-30T17:01:14.167 INFO:tasks.ceph.mds.b:Started 2024-05-30T17:01:14.168 DEBUG:teuthology.parallel:result is None 2024-05-30T17:01:14.169 INFO:tasks.ceph.mds.d:Started 2024-05-30T17:01:14.169 DEBUG:teuthology.parallel:result is None 2024-05-30T17:01:14.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T17:01:14.249 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-05-30T17:01:14.249 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T17:01:14.259 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-30T17:01:14.259 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-30T17:01:14.261 INFO:tasks.ceph.mds.b.smithi107.stderr:2024-05-30T17:01:14.261+0000 7fcafa200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-30T17:01:14.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.311+0000 7fa324600640 1 Processor -- start 2024-05-30T17:01:14.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa324600640 1 -- start start 2024-05-30T17:01:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa324600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa31c0d0560 0x7fa31c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa324600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa31c15f060 con 0x7fa31c0af720 2024-05-30T17:01:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa324600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa31c15ff00 con 0x7fa31c06e900 2024-05-30T17:01:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa324600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa31c0afb00 con 0x7fa31c0d0560 2024-05-30T17:01:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa321c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa31c0af720 0x7fa31c15b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58856/0 (socket says 172.21.15.59:58856) 2024-05-30T17:01:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa321c00640 1 -- 172.21.15.59:0/3455266923 learned_addr learned my addr 172.21.15.59:0/3455266923 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa322600640 1 --2- 172.21.15.59:0/3455266923 >> v2:172.21.15.59:3300/0 conn(0x7fa31c0d0560 0x7fa31c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa31be00640 1 -- 172.21.15.59:0/3455266923 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112228604 0 0) 0x7fa31c15f060 con 0x7fa31c0af720 2024-05-30T17:01:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa31be00640 1 -- 172.21.15.59:0/3455266923 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa304003530 con 0x7fa31c0af720 2024-05-30T17:01:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa322600640 1 -- 172.21.15.59:0/3455266923 >> v1:172.21.15.107:6789/0 conn(0x7fa31c06e900 legacy=0x7fa31c15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:14.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa322600640 1 -- 172.21.15.59:0/3455266923 >> v1:172.21.15.59:6789/0 conn(0x7fa31c0af720 legacy=0x7fa31c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:14.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.315+0000 7fa322600640 1 -- 172.21.15.59:0/3455266923 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31c15c270 con 0x7fa31c0d0560 2024-05-30T17:01:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa322600640 1 --2- 172.21.15.59:0/3455266923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31c0d0560 0x7fa31c0d0a10 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fa314009d90 tx=0x7fa31401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7dd8ca94508d369 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa31be00640 1 -- 172.21.15.59:0/3455266923 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3140b2070 con 0x7fa31c0d0560 2024-05-30T17:01:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa31be00640 1 -- 172.21.15.59:0/3455266923 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3140a5920 con 0x7fa31c0d0560 2024-05-30T17:01:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa31be00640 1 -- 172.21.15.59:0/3455266923 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3140a5cf0 con 0x7fa31c0d0560 2024-05-30T17:01:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa324600640 1 -- 172.21.15.59:0/3455266923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31c0d0560 msgr2=0x7fa31c0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa324600640 1 --2- 172.21.15.59:0/3455266923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31c0d0560 0x7fa31c0d0a10 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fa314009d90 tx=0x7fa31401c970 comp rx=0 tx=0).stop 2024-05-30T17:01:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa324600640 1 -- 172.21.15.59:0/3455266923 shutdown_connections 2024-05-30T17:01:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa324600640 1 --2- 172.21.15.59:0/3455266923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31c0d0560 0x7fa31c0d0a10 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa324600640 1 -- 172.21.15.59:0/3455266923 >> 172.21.15.59:0/3455266923 conn(0x7fa31c0b22d0 msgr2=0x7fa31c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa324600640 1 -- 172.21.15.59:0/3455266923 shutdown_connections 2024-05-30T17:01:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa324600640 1 -- 172.21.15.59:0/3455266923 wait complete. 2024-05-30T17:01:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa324600640 1 Processor -- start 2024-05-30T17:01:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.319+0000 7fa324600640 1 -- start start 2024-05-30T17:01:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa324600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa31c06e900 0x7fa31c1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa324600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa31c0af720 0x7fa31c145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa324600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31c0d0560 0x7fa31c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa324600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c0732d0 con 0x7fa31c0d0560 2024-05-30T17:01:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa324600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c073150 con 0x7fa31c0af720 2024-05-30T17:01:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa324600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa31c1585c0 con 0x7fa31c06e900 2024-05-30T17:01:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa322600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31c0d0560 0x7fa31c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa321c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa31c06e900 0x7fa31c1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa321200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa31c0af720 0x7fa31c145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa322600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31c0d0560 0x7fa31c156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55684/0 (socket says 172.21.15.59:55684) 2024-05-30T17:01:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa322600640 1 -- 172.21.15.59:0/621001231 learned_addr learned my addr 172.21.15.59:0/621001231 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa322600640 1 -- 172.21.15.59:0/621001231 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa31c06e900 msgr2=0x7fa31c1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa322600640 1 --2- 172.21.15.59:0/621001231 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa31c06e900 0x7fa31c1561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa322600640 1 -- 172.21.15.59:0/621001231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa31c0af720 msgr2=0x7fa31c145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa322600640 1 --2- 172.21.15.59:0/621001231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa31c0af720 0x7fa31c145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa322600640 1 -- 172.21.15.59:0/621001231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31c1572a0 con 0x7fa31c0d0560 2024-05-30T17:01:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa322600640 1 --2- 172.21.15.59:0/621001231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31c0d0560 0x7fa31c156d60 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fa314009d90 tx=0x7fa314019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa319600640 1 -- 172.21.15.59:0/621001231 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3140b2050 con 0x7fa31c0d0560 2024-05-30T17:01:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa319600640 1 -- 172.21.15.59:0/621001231 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3140be070 con 0x7fa31c0d0560 2024-05-30T17:01:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa319600640 1 -- 172.21.15.59:0/621001231 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3140ada90 con 0x7fa31c0d0560 2024-05-30T17:01:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa324600640 1 -- 172.21.15.59:0/621001231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31c155430 con 0x7fa31c0d0560 2024-05-30T17:01:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa324600640 1 -- 172.21.15.59:0/621001231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31c1559f0 con 0x7fa31c0d0560 2024-05-30T17:01:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa324600640 1 -- 172.21.15.59:0/621001231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa31c068a90 con 0x7fa31c0d0560 2024-05-30T17:01:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.323+0000 7fa319600640 1 -- 172.21.15.59:0/621001231 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fa3140adc30 con 0x7fa31c0d0560 2024-05-30T17:01:14.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.327+0000 7fa319600640 1 --2- 172.21.15.59:0/621001231 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa2fc069880 0x7fa2fc06bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:14.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.327+0000 7fa319600640 1 -- 172.21.15.59:0/621001231 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5055+0+0 (secure 0 0 0) 0x7fa3141207e0 con 0x7fa31c0d0560 2024-05-30T17:01:14.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.327+0000 7fa321c00640 1 --2- 172.21.15.59:0/621001231 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa2fc069880 0x7fa2fc06bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.327+0000 7fa321c00640 1 --2- 172.21.15.59:0/621001231 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa2fc069880 0x7fa2fc06bd40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa3100011f0 tx=0x7fa310007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:14.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.331+0000 7fa319600640 1 -- 172.21.15.59:0/621001231 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa314016560 con 0x7fa31c0d0560 2024-05-30T17:01:14.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:14.503+0000 7fa324600640 1 -- 172.21.15.59:0/621001231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa31c0b3160 con 0x7fa31c0d0560 2024-05-30T17:01:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.071+0000 7fa319600640 1 -- 172.21.15.59:0/621001231 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v98) ==== 97+0+0 (secure 0 0 0) 0x7fa3140f2230 con 0x7fa31c0d0560 2024-05-30T17:01:15.074 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-05-30T17:01:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.075+0000 7fa324600640 1 -- 172.21.15.59:0/621001231 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa2fc069880 msgr2=0x7fa2fc06bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.075+0000 7fa324600640 1 --2- 172.21.15.59:0/621001231 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa2fc069880 0x7fa2fc06bd40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa3100011f0 tx=0x7fa310007d40 comp rx=0 tx=0).stop 2024-05-30T17:01:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.075+0000 7fa324600640 1 -- 172.21.15.59:0/621001231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31c0d0560 msgr2=0x7fa31c156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.075+0000 7fa324600640 1 --2- 172.21.15.59:0/621001231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31c0d0560 0x7fa31c156d60 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fa314009d90 tx=0x7fa314019710 comp rx=0 tx=0).stop 2024-05-30T17:01:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.075+0000 7fa324600640 1 -- 172.21.15.59:0/621001231 shutdown_connections 2024-05-30T17:01:15.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.075+0000 7fa324600640 1 --2- 172.21.15.59:0/621001231 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa2fc069880 0x7fa2fc06bd40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.075+0000 7fa324600640 1 --2- 172.21.15.59:0/621001231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31c0d0560 0x7fa31c156d60 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.075+0000 7fa324600640 1 --2- 172.21.15.59:0/621001231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa31c0af720 0x7fa31c145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.075+0000 7fa324600640 1 --2- 172.21.15.59:0/621001231 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa31c06e900 0x7fa31c1561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.075+0000 7fa324600640 1 -- 172.21.15.59:0/621001231 >> 172.21.15.59:0/621001231 conn(0x7fa31c0b22d0 msgr2=0x7fa31c0b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:15.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.075+0000 7fa324600640 1 -- 172.21.15.59:0/621001231 shutdown_connections 2024-05-30T17:01:15.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.075+0000 7fa324600640 1 -- 172.21.15.59:0/621001231 wait complete. 2024-05-30T17:01:15.100 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T17:01:15.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.239+0000 7f9804800640 1 Processor -- start 2024-05-30T17:01:15.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.239+0000 7f9804800640 1 -- start start 2024-05-30T17:01:15.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9804800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f97fc159df0 0x7f97fc0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9804800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97fc0b3e50 0x7f97fc0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9804800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97fc15d730 con 0x7f97fc15a1d0 2024-05-30T17:01:15.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9804800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc0b3370 con 0x7f97fc159df0 2024-05-30T17:01:15.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9804800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc0b3650 con 0x7f97fc0b3e50 2024-05-30T17:01:15.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9801400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f97fc15a1d0 0x7f97fc15ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58866/0 (socket says 172.21.15.59:58866) 2024-05-30T17:01:15.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9801400640 1 -- 172.21.15.59:0/3533291915 learned_addr learned my addr 172.21.15.59:0/3533291915 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:15.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9802800640 1 --2- 172.21.15.59:0/3533291915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97fc0b3e50 0x7f97fc0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9801e00640 1 --2- 172.21.15.59:0/3533291915 >> v2:172.21.15.107:3300/0 conn(0x7f97fc159df0 0x7f97fc0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350250341 0 0) 0x7f97fc15d730 con 0x7f97fc15a1d0 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97e4003530 con 0x7f97fc15a1d0 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 776414595 0 0) 0x7f97e4003530 con 0x7f97fc15a1d0 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97fc0b3e50 msgr2=0x7f97fc0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 --2- 172.21.15.59:0/3533291915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97fc0b3e50 0x7f97fc0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 >> v2:172.21.15.107:3300/0 conn(0x7f97fc159df0 msgr2=0x7f97fc0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 --2- 172.21.15.59:0/3533291915 >> v2:172.21.15.107:3300/0 conn(0x7f97fc159df0 0x7f97fc0ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc0b3930 con 0x7f97fc15a1d0 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f97ec001680 con 0x7f97fc15a1d0 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 >> v1:172.21.15.59:6789/0 conn(0x7f97fc15a1d0 legacy=0x7f97fc15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 --2- 172.21.15.59:0/3533291915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97e40039c0 0x7f97e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 --2- 172.21.15.59:0/3533291915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97e4004810 0x7f97e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 --2- 172.21.15.59:0/3533291915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97fc0b3e50 0x7f97e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0b3370 con 0x7f97e40039c0 2024-05-30T17:01:15.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0b3650 con 0x7f97e4004810 2024-05-30T17:01:15.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f97e400b9d0 con 0x7f97fc0b3e50 2024-05-30T17:01:15.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9801e00640 1 --2- 172.21.15.59:0/3533291915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97e40039c0 0x7f97e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9802800640 1 --2- 172.21.15.59:0/3533291915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97fc0b3e50 0x7f97e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9801400640 1 --2- 172.21.15.59:0/3533291915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97e4004810 0x7f97e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9801e00640 1 -- 172.21.15.59:0/3533291915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97fc0b3e50 msgr2=0x7f97e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:15.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9801e00640 1 --2- 172.21.15.59:0/3533291915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97fc0b3e50 0x7f97e40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9801e00640 1 -- 172.21.15.59:0/3533291915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97e4004810 msgr2=0x7f97e4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:15.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9801e00640 1 --2- 172.21.15.59:0/3533291915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97e4004810 0x7f97e4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.243+0000 7f9801e00640 1 -- 172.21.15.59:0/3533291915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e4003530 con 0x7f97e40039c0 2024-05-30T17:01:15.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.247+0000 7f9801e00640 1 --2- 172.21.15.59:0/3533291915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97e40039c0 0x7f97e4003de0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009ae0 tx=0x7f97f001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470bb9a50964682b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:15.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.247+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f00096b0 con 0x7f97e40039c0 2024-05-30T17:01:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.247+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f00a8420 con 0x7f97e40039c0 2024-05-30T17:01:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.247+0000 7f9800a00640 1 -- 172.21.15.59:0/3533291915 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f00a8810 con 0x7f97e40039c0 2024-05-30T17:01:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.247+0000 7f9804800640 1 -- 172.21.15.59:0/3533291915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97e40039c0 msgr2=0x7f97e4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.247+0000 7f9804800640 1 --2- 172.21.15.59:0/3533291915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97e40039c0 0x7f97e4003de0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009ae0 tx=0x7f97f001cab0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.247+0000 7f9802800640 1 -- 172.21.15.59:0/3533291915 reap_dead start 2024-05-30T17:01:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.247+0000 7f9804800640 1 -- 172.21.15.59:0/3533291915 shutdown_connections 2024-05-30T17:01:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.247+0000 7f9804800640 1 -- 172.21.15.59:0/3533291915 >> 172.21.15.59:0/3533291915 conn(0x7f97fc0b22d0 msgr2=0x7f97fc0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.247+0000 7f9804800640 1 -- 172.21.15.59:0/3533291915 shutdown_connections 2024-05-30T17:01:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.247+0000 7f9804800640 1 -- 172.21.15.59:0/3533291915 wait complete. 2024-05-30T17:01:15.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9804800640 1 Processor -- start 2024-05-30T17:01:15.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9804800640 1 -- start start 2024-05-30T17:01:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9804800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97e40039c0 0x7f97fc1fb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9804800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc154af0 0x7f97fc0735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9804800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97fc073af0 0x7f97fc0724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9804800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc15e720 con 0x7f97fc073af0 2024-05-30T17:01:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9804800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc15e5a0 con 0x7f97fc154af0 2024-05-30T17:01:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9804800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc15e8a0 con 0x7f97e40039c0 2024-05-30T17:01:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9802800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97fc073af0 0x7f97fc0724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9802800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97fc073af0 0x7f97fc0724a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55704/0 (socket says 172.21.15.59:55704) 2024-05-30T17:01:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9802800640 1 -- 172.21.15.59:0/3812679178 learned_addr learned my addr 172.21.15.59:0/3812679178 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9801400640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc154af0 0x7f97fc0735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9801e00640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97e40039c0 0x7f97fc1fb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9802800640 1 -- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97e40039c0 msgr2=0x7f97fc1fb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9802800640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97e40039c0 0x7f97fc1fb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9802800640 1 -- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc154af0 msgr2=0x7f97fc0735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9802800640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc154af0 0x7f97fc0735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9802800640 1 -- 172.21.15.59:0/3812679178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc152c70 con 0x7f97fc073af0 2024-05-30T17:01:15.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9801e00640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97e40039c0 0x7f97fc1fb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:15.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9802800640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97fc073af0 0x7f97fc0724a0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0b4bc0 tx=0x7f97f80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:15.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f97f6000640 1 -- 172.21.15.59:0/3812679178 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f8011e10 con 0x7f97fc073af0 2024-05-30T17:01:15.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f97f6000640 1 -- 172.21.15.59:0/3812679178 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f801b070 con 0x7f97fc073af0 2024-05-30T17:01:15.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9804800640 1 -- 172.21.15.59:0/3812679178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc152f50 con 0x7f97fc073af0 2024-05-30T17:01:15.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f97f6000640 1 -- 172.21.15.59:0/3812679178 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f80039a0 con 0x7f97fc073af0 2024-05-30T17:01:15.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9804800640 1 -- 172.21.15.59:0/3812679178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc0729e0 con 0x7f97fc073af0 2024-05-30T17:01:15.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.251+0000 7f9804800640 1 -- 172.21.15.59:0/3812679178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc068a90 con 0x7f97fc073af0 2024-05-30T17:01:15.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.255+0000 7f97f6000640 1 -- 172.21.15.59:0/3812679178 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f97f8003b60 con 0x7f97fc073af0 2024-05-30T17:01:15.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.255+0000 7f97f6000640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f97e0069850 0x7f97e006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.255+0000 7f97f6000640 1 -- 172.21.15.59:0/3812679178 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4969+0+0 (secure 0 0 0) 0x7f97f8085fc0 con 0x7f97fc073af0 2024-05-30T17:01:15.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.255+0000 7f9801e00640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f97e0069850 0x7f97e006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.255+0000 7f9801e00640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f97e0069850 0x7f97e006bd10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f97f00af000 tx=0x7f97f00b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:15.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.259+0000 7f97f6000640 1 -- 172.21.15.59:0/3812679178 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f97f8025020 con 0x7f97fc073af0 2024-05-30T17:01:15.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.483+0000 7f9804800640 1 -- 172.21.15.59:0/3812679178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f97fc15cf10 con 0x7f97fc073af0 2024-05-30T17:01:15.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.483+0000 7f97f6000640 1 -- 172.21.15.59:0/3812679178 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7f97f8057fd0 con 0x7f97fc073af0 2024-05-30T17:01:15.486 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:15.486 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:01:15.486 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-05-30T17:01:15.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.486 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-05-30T17:01:15.486 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmAAjIJhAA5/FZHJtfSZuYcD6bEfCGDA==", 2024-05-30T17:01:15.486 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.486 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:01:15.486 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmELVkMxAA/vOsM3Z0z4YEmUqoPtrPBQ==", 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmD2pGLhAAWmDw/02mc8T7upvRXnj1yw==", 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmYLbYOhAAxggGfPZU/ryu+8vciSXjUw==", 2024-05-30T17:01:15.488 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDJrVhmU0fpBhAA2tKWGJF24DlEjG+iuO4djg==", 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDMrVhmxE2HERAA4N9Bsb0fxl5GERpgyKCl6Q==", 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDPrVhm6v7AGhAAqOQCN90pL0AmnXYIPIb48A==", 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:01:15.490 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSrVhm3BEDJxAA4SOWC/qF90R9ivrCvN92ZA==", 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-05-30T17:01:15.491 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDYrVhmFzmDHhAAQtbXd6haolYB98wfEbpvTQ==", 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDbrVhmHqkEKRAAKfFPdTqaVhBNnc5lKeEFpg==", 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDerVhm72bzMBAA+FfnxIOnkESuTervY23ruw==", 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDhrVhmXGv/OhAAr2k7IXDA9VDi9ZJwrQ+u6A==", 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:01:15.493 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA==", 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-05-30T17:01:15.494 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmncPjDBAAWEJOkxm9xfRjonO6U1hO6A==", 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmvlFFCRAAZCq7ijfrVqy8Ukh7jKZESQ==", 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:01:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T17:01:15.496 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T17:01:15.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T17:01:15.496 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.496 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-05-30T17:01:15.496 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmcpjuEhAA0q+PfNy0IWhqQSiIZuyBlg==", 2024-05-30T17:01:15.496 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.496 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:01:15.496 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmnikpCxAA6Q4udmvjQXBmC4f1irI2Xg==", 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmWZq9IhAAFuEZeFiLGCitIiNARjoDTA==", 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhm0UKsHhAAimqtE18XjW/1vA7uMsJmEw==", 2024-05-30T17:01:15.498 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:01:15.499 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T17:01:15.499 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T17:01:15.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:01:15.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.499 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-05-30T17:01:15.499 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.483+0000 7f9804800640 1 -- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f97e0069850 msgr2=0x7f97e006bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.487+0000 7f9804800640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f97e0069850 0x7f97e006bd10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f97f00af000 tx=0x7f97f00b2040 comp rx=0 tx=0).stop 2024-05-30T17:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.487+0000 7f9804800640 1 -- 172.21.15.59:0/3812679178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97fc073af0 msgr2=0x7f97fc0724a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.487+0000 7f9804800640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97fc073af0 0x7f97fc0724a0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0b4bc0 tx=0x7f97f80115a0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.487+0000 7f9804800640 1 -- 172.21.15.59:0/3812679178 shutdown_connections 2024-05-30T17:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.487+0000 7f9804800640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f97e0069850 0x7f97e006bd10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.487+0000 7f9804800640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97fc073af0 0x7f97fc0724a0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.487+0000 7f9804800640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc154af0 0x7f97fc0735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.487+0000 7f9804800640 1 --2- 172.21.15.59:0/3812679178 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97e40039c0 0x7f97fc1fb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.487+0000 7f9804800640 1 -- 172.21.15.59:0/3812679178 >> 172.21.15.59:0/3812679178 conn(0x7f97fc0b22d0 msgr2=0x7f97fc14b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.487+0000 7f9804800640 1 -- 172.21.15.59:0/3812679178 shutdown_connections 2024-05-30T17:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.487+0000 7f9804800640 1 -- 172.21.15.59:0/3812679178 wait complete. 2024-05-30T17:01:15.508 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T17:01:15.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.647+0000 7f6950600640 1 Processor -- start 2024-05-30T17:01:15.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.647+0000 7f6950600640 1 -- start start 2024-05-30T17:01:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.647+0000 7f6950600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f694815e7e0 0x7f69480b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.647+0000 7f6950600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69480b61f0 con 0x7f69480b73a0 2024-05-30T17:01:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.647+0000 7f6950600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694815ebc0 con 0x7f694809b150 2024-05-30T17:01:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.647+0000 7f6950600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f694815ee60 con 0x7f694815e7e0 2024-05-30T17:01:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.647+0000 7f694d200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f69480b73a0 0x7f694809aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58882/0 (socket says 172.21.15.59:58882) 2024-05-30T17:01:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.647+0000 7f694d200640 1 -- 172.21.15.59:0/3181956367 learned_addr learned my addr 172.21.15.59:0/3181956367 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:15.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.647+0000 7f694dc00640 1 --2- 172.21.15.59:0/3181956367 >> v2:172.21.15.107:3300/0 conn(0x7f694815e7e0 0x7f69480b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.647+0000 7f6947e00640 1 -- 172.21.15.59:0/3181956367 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4014830406 0 0) 0x7f6934001120 con 0x7f69480b73a0 2024-05-30T17:01:15.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.647+0000 7f6947e00640 1 -- 172.21.15.59:0/3181956367 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6930003530 con 0x7f69480b73a0 2024-05-30T17:01:15.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.651+0000 7f6947e00640 1 -- 172.21.15.59:0/3181956367 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3563093421 0 0) 0x7f6930003530 con 0x7f69480b73a0 2024-05-30T17:01:15.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.651+0000 7f694dc00640 1 -- 172.21.15.59:0/3181956367 >> v1:172.21.15.107:6789/0 conn(0x7f694809b150 legacy=0x7f694815ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.651+0000 7f694dc00640 1 -- 172.21.15.59:0/3181956367 >> v1:172.21.15.59:6789/0 conn(0x7f69480b73a0 legacy=0x7f694809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.651+0000 7f694dc00640 1 -- 172.21.15.59:0/3181956367 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694815f140 con 0x7f694815e7e0 2024-05-30T17:01:15.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.651+0000 7f694dc00640 1 --2- 172.21.15.59:0/3181956367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f694815e7e0 0x7f69480b6e60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f693c0097c0 tx=0x7f693c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43b878edf9360adc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:15.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.651+0000 7f6947e00640 1 -- 172.21.15.59:0/3181956367 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c0b0070 con 0x7f694815e7e0 2024-05-30T17:01:15.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.651+0000 7f6947e00640 1 -- 172.21.15.59:0/3181956367 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c0ab400 con 0x7f694815e7e0 2024-05-30T17:01:15.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.651+0000 7f6947e00640 1 -- 172.21.15.59:0/3181956367 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934001850 con 0x7f694815e7e0 2024-05-30T17:01:15.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 -- 172.21.15.59:0/3181956367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f694815e7e0 msgr2=0x7f69480b6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 --2- 172.21.15.59:0/3181956367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f694815e7e0 0x7f69480b6e60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f693c0097c0 tx=0x7f693c01c3c0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 -- 172.21.15.59:0/3181956367 shutdown_connections 2024-05-30T17:01:15.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 --2- 172.21.15.59:0/3181956367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f694815e7e0 0x7f69480b6e60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 -- 172.21.15.59:0/3181956367 >> 172.21.15.59:0/3181956367 conn(0x7f69480b41a0 msgr2=0x7f69480b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:15.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 -- 172.21.15.59:0/3181956367 shutdown_connections 2024-05-30T17:01:15.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 -- 172.21.15.59:0/3181956367 wait complete. 2024-05-30T17:01:15.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 Processor -- start 2024-05-30T17:01:15.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 -- start start 2024-05-30T17:01:15.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f694809b150 0x7f69480a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69480b73a0 0x7f6948152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f694815e7e0 0x7f694809e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6948160fa0 con 0x7f69480b73a0 2024-05-30T17:01:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6948160e20 con 0x7f694815e7e0 2024-05-30T17:01:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f6950600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6948161120 con 0x7f694809b150 2024-05-30T17:01:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f694d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69480b73a0 0x7f6948152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f694d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69480b73a0 0x7f6948152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55720/0 (socket says 172.21.15.59:55720) 2024-05-30T17:01:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f694d200640 1 -- 172.21.15.59:0/3405724059 learned_addr learned my addr 172.21.15.59:0/3405724059 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f694dc00640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f694809b150 0x7f69480a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f694e600640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f694815e7e0 0x7f694809e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f694d200640 1 -- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f694809b150 msgr2=0x7f69480a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f694d200640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f694809b150 0x7f69480a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f694d200640 1 -- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f694815e7e0 msgr2=0x7f694809e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f694d200640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f694815e7e0 0x7f694809e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.655+0000 7f694d200640 1 -- 172.21.15.59:0/3405724059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69480b3e80 con 0x7f69480b73a0 2024-05-30T17:01:15.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.659+0000 7f694d200640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69480b73a0 0x7f6948152500 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f693400c750 tx=0x7f693400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:15.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.659+0000 7f6945600640 1 -- 172.21.15.59:0/3405724059 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934017070 con 0x7f69480b73a0 2024-05-30T17:01:15.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.659+0000 7f6945600640 1 -- 172.21.15.59:0/3405724059 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6934005b00 con 0x7f69480b73a0 2024-05-30T17:01:15.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.659+0000 7f6950600640 1 -- 172.21.15.59:0/3405724059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69481fbab0 con 0x7f69480b73a0 2024-05-30T17:01:15.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.659+0000 7f6945600640 1 -- 172.21.15.59:0/3405724059 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934007070 con 0x7f69480b73a0 2024-05-30T17:01:15.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.659+0000 7f6950600640 1 -- 172.21.15.59:0/3405724059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f694815d5c0 con 0x7f69480b73a0 2024-05-30T17:01:15.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.659+0000 7f6950600640 1 -- 172.21.15.59:0/3405724059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6948068a90 con 0x7f69480b73a0 2024-05-30T17:01:15.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.659+0000 7f6945600640 1 -- 172.21.15.59:0/3405724059 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f693401a070 con 0x7f69480b73a0 2024-05-30T17:01:15.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.659+0000 7f6945600640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6928069850 0x7f692806bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:15.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.659+0000 7f6945600640 1 -- 172.21.15.59:0/3405724059 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4969+0+0 (secure 0 0 0) 0x7f6934084b50 con 0x7f69480b73a0 2024-05-30T17:01:15.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.659+0000 7f694dc00640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6928069850 0x7f692806bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:15.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.663+0000 7f694dc00640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6928069850 0x7f692806bd10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f693c0ad000 tx=0x7f693c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:15.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.663+0000 7f6945600640 1 -- 172.21.15.59:0/3405724059 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f69480b61f0 con 0x7f69480b73a0 2024-05-30T17:01:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.831+0000 7f6950600640 1 -- 172.21.15.59:0/3405724059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f69480d2290 con 0x7f69480b73a0 2024-05-30T17:01:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.831+0000 7f6945600640 1 -- 172.21.15.59:0/3405724059 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v100) ==== 84+0+65 (secure 0 0 0) 0x7f6934056510 con 0x7f69480b73a0 2024-05-30T17:01:15.835 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:15.835 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:01:15.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:15.835 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-05-30T17:01:15.835 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-05-30T17:01:15.835 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:15.835 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:01:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.835+0000 7f6950600640 1 -- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6928069850 msgr2=0x7f692806bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.835+0000 7f6950600640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6928069850 0x7f692806bd10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f693c0ad000 tx=0x7f693c0a6000 comp rx=0 tx=0).stop 2024-05-30T17:01:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.835+0000 7f6950600640 1 -- 172.21.15.59:0/3405724059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69480b73a0 msgr2=0x7f6948152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.835+0000 7f6950600640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69480b73a0 0x7f6948152500 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f693400c750 tx=0x7f693400cc10 comp rx=0 tx=0).stop 2024-05-30T17:01:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.835+0000 7f6950600640 1 -- 172.21.15.59:0/3405724059 shutdown_connections 2024-05-30T17:01:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.835+0000 7f6950600640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6928069850 0x7f692806bd10 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.835+0000 7f6950600640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f694815e7e0 0x7f694809e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.835+0000 7f6950600640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69480b73a0 0x7f6948152500 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.835+0000 7f6950600640 1 --2- 172.21.15.59:0/3405724059 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f694809b150 0x7f69480a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.835+0000 7f6950600640 1 -- 172.21.15.59:0/3405724059 >> 172.21.15.59:0/3405724059 conn(0x7f69480b41a0 msgr2=0x7f6948157b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.835+0000 7f6950600640 1 -- 172.21.15.59:0/3405724059 shutdown_connections 2024-05-30T17:01:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.835+0000 7f6950600640 1 -- 172.21.15.59:0/3405724059 wait complete. 2024-05-30T17:01:15.856 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T17:01:15.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T17:01:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efcd1a00640 1 Processor -- start 2024-05-30T17:01:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efcd1a00640 1 -- start start 2024-05-30T17:01:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efcd1a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efccc162b20 0x7efccc15f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efcd1a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efccc0d1020 con 0x7efccc09b7a0 2024-05-30T17:01:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efcd1a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efccc0d1300 con 0x7efccc161ce0 2024-05-30T17:01:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efcd1a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efccc0d15e0 con 0x7efccc162b20 2024-05-30T17:01:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efcc3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efccc09b7a0 0x7efccc162410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58884/0 (socket says 172.21.15.59:58884) 2024-05-30T17:01:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efcc3e00640 1 -- 172.21.15.59:0/1382353099 learned_addr learned my addr 172.21.15.59:0/1382353099 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efccb400640 1 --2- 172.21.15.59:0/1382353099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efccc162b20 0x7efccc15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efcca000640 1 -- 172.21.15.59:0/1382353099 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3446272148 0 0) 0x7efccc0d1020 con 0x7efccc09b7a0 2024-05-30T17:01:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efcca000640 1 -- 172.21.15.59:0/1382353099 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcb0003530 con 0x7efccc09b7a0 2024-05-30T17:01:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efcca000640 1 -- 172.21.15.59:0/1382353099 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124031949 0 0) 0x7efccc0d1300 con 0x7efccc161ce0 2024-05-30T17:01:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efcca000640 1 -- 172.21.15.59:0/1382353099 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efccc0d1020 con 0x7efccc161ce0 2024-05-30T17:01:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efccb400640 1 -- 172.21.15.59:0/1382353099 >> v1:172.21.15.107:6789/0 conn(0x7efccc161ce0 legacy=0x7efccc0d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efccb400640 1 -- 172.21.15.59:0/1382353099 >> v1:172.21.15.59:6789/0 conn(0x7efccc09b7a0 legacy=0x7efccc162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:15.999+0000 7efccb400640 1 -- 172.21.15.59:0/1382353099 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc0d18c0 con 0x7efccc162b20 2024-05-30T17:01:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.003+0000 7efccb400640 1 --2- 172.21.15.59:0/1382353099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efccc162b20 0x7efccc15f190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009dc0 tx=0x7efcc401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f8fa5ab214e0eb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.003+0000 7efcca000640 1 -- 172.21.15.59:0/1382353099 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc40b2070 con 0x7efccc162b20 2024-05-30T17:01:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.003+0000 7efcca000640 1 -- 172.21.15.59:0/1382353099 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc40a5920 con 0x7efccc162b20 2024-05-30T17:01:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.003+0000 7efcca000640 1 -- 172.21.15.59:0/1382353099 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc40a5cd0 con 0x7efccc162b20 2024-05-30T17:01:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.003+0000 7efcd1a00640 1 -- 172.21.15.59:0/1382353099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efccc162b20 msgr2=0x7efccc15f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.003+0000 7efcd1a00640 1 --2- 172.21.15.59:0/1382353099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efccc162b20 0x7efccc15f190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009dc0 tx=0x7efcc401c950 comp rx=0 tx=0).stop 2024-05-30T17:01:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.003+0000 7efcd1a00640 1 -- 172.21.15.59:0/1382353099 shutdown_connections 2024-05-30T17:01:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.003+0000 7efcd1a00640 1 --2- 172.21.15.59:0/1382353099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efccc162b20 0x7efccc15f190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.003+0000 7efcd1a00640 1 -- 172.21.15.59:0/1382353099 >> 172.21.15.59:0/1382353099 conn(0x7efccc0b4000 msgr2=0x7efccc0b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.003+0000 7efcd1a00640 1 -- 172.21.15.59:0/1382353099 shutdown_connections 2024-05-30T17:01:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.003+0000 7efcd1a00640 1 -- 172.21.15.59:0/1382353099 wait complete. 2024-05-30T17:01:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcd1a00640 1 Processor -- start 2024-05-30T17:01:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcd1a00640 1 -- start start 2024-05-30T17:01:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcd1a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efccc09b7a0 0x7efccc15ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcd1a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efccc161ce0 0x7efccc0ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcd1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efccc162b20 0x7efccc0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcd1a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efccc16c970 con 0x7efccc162b20 2024-05-30T17:01:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcd1a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efccc16caf0 con 0x7efccc161ce0 2024-05-30T17:01:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcd1a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efccc16cc70 con 0x7efccc09b7a0 2024-05-30T17:01:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efccb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efccc162b20 0x7efccc0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efccb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efccc162b20 0x7efccc0c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55730/0 (socket says 172.21.15.59:55730) 2024-05-30T17:01:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efccb400640 1 -- 172.21.15.59:0/2579438054 learned_addr learned my addr 172.21.15.59:0/2579438054 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcc3e00640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efccc161ce0 0x7efccc0ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efccaa00640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efccc09b7a0 0x7efccc15ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efccb400640 1 -- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efccc09b7a0 msgr2=0x7efccc15ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efccb400640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efccc09b7a0 0x7efccc15ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efccb400640 1 -- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efccc161ce0 msgr2=0x7efccc0ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efccb400640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efccc161ce0 0x7efccc0ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efccb400640 1 -- 172.21.15.59:0/2579438054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc0d1eb0 con 0x7efccc162b20 2024-05-30T17:01:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efccaa00640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efccc09b7a0 0x7efccc15ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efccb400640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efccc162b20 0x7efccc0c95e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7efcc40b0040 tx=0x7efcc40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcc2a00640 1 -- 172.21.15.59:0/2579438054 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc40bd020 con 0x7efccc162b20 2024-05-30T17:01:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcc2a00640 1 -- 172.21.15.59:0/2579438054 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc40b8470 con 0x7efccc162b20 2024-05-30T17:01:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcc2a00640 1 -- 172.21.15.59:0/2579438054 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc40b2040 con 0x7efccc162b20 2024-05-30T17:01:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcd1a00640 1 -- 172.21.15.59:0/2579438054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efccc0cb3d0 con 0x7efccc162b20 2024-05-30T17:01:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcd1a00640 1 -- 172.21.15.59:0/2579438054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efccc0cb990 con 0x7efccc162b20 2024-05-30T17:01:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.007+0000 7efcd1a00640 1 -- 172.21.15.59:0/2579438054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efccc068a90 con 0x7efccc162b20 2024-05-30T17:01:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.011+0000 7efcc2a00640 1 -- 172.21.15.59:0/2579438054 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7efcc40c0020 con 0x7efccc162b20 2024-05-30T17:01:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.011+0000 7efcc2a00640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efca8069850 0x7efca806bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.011+0000 7efcc2a00640 1 -- 172.21.15.59:0/2579438054 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4969+0+0 (secure 0 0 0) 0x7efcc4120470 con 0x7efccc162b20 2024-05-30T17:01:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.011+0000 7efccaa00640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efca8069850 0x7efca806bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.011+0000 7efccaa00640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efca8069850 0x7efca806bd10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efcbc001740 tx=0x7efcbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.015+0000 7efcc2a00640 1 -- 172.21.15.59:0/2579438054 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efcc40c7030 con 0x7efccc162b20 2024-05-30T17:01:16.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:16.183+0000 7efcd1a00640 1 -- 172.21.15.59:0/2579438054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7efccc0b4bb0 con 0x7efccc162b20 2024-05-30T17:01:17.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.083+0000 7efcc2a00640 1 -- 172.21.15.59:0/2579438054 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v101) ==== 138+0+0 (secure 0 0 0) 0x7efcc4016540 con 0x7efccc162b20 2024-05-30T17:01:17.086 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-05-30T17:01:17.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.087+0000 7efcd1a00640 1 -- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efca8069850 msgr2=0x7efca806bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:17.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.087+0000 7efcd1a00640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efca8069850 0x7efca806bd10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efcbc001740 tx=0x7efcbc009040 comp rx=0 tx=0).stop 2024-05-30T17:01:17.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.087+0000 7efcd1a00640 1 -- 172.21.15.59:0/2579438054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efccc162b20 msgr2=0x7efccc0c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:17.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.087+0000 7efcd1a00640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efccc162b20 0x7efccc0c95e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7efcc40b0040 tx=0x7efcc40196f0 comp rx=0 tx=0).stop 2024-05-30T17:01:17.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.087+0000 7efcd1a00640 1 -- 172.21.15.59:0/2579438054 shutdown_connections 2024-05-30T17:01:17.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.087+0000 7efcd1a00640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efca8069850 0x7efca806bd10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:17.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.087+0000 7efcd1a00640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efccc162b20 0x7efccc0c95e0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:17.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.087+0000 7efcd1a00640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efccc161ce0 0x7efccc0ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:17.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.087+0000 7efcd1a00640 1 --2- 172.21.15.59:0/2579438054 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efccc09b7a0 0x7efccc15ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:17.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.087+0000 7efcd1a00640 1 -- 172.21.15.59:0/2579438054 >> 172.21.15.59:0/2579438054 conn(0x7efccc0b4000 msgr2=0x7efccc09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:17.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.087+0000 7efcd1a00640 1 -- 172.21.15.59:0/2579438054 shutdown_connections 2024-05-30T17:01:17.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.087+0000 7efcd1a00640 1 -- 172.21.15.59:0/2579438054 wait complete. 2024-05-30T17:01:17.119 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T17:01:17.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6bab000640 1 Processor -- start 2024-05-30T17:01:17.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6bab000640 1 -- start start 2024-05-30T17:01:17.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6bab000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6ba4162a50 0x7f6ba406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:17.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6bab000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ba40d0fb0 con 0x7f6ba409b890 2024-05-30T17:01:17.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6bab000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ba40d1290 con 0x7f6ba409b4b0 2024-05-30T17:01:17.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6bab000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6ba406fef0 con 0x7f6ba4162a50 2024-05-30T17:01:17.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba9200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6ba409b890 0x7f6ba4162340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58886/0 (socket says 172.21.15.59:58886) 2024-05-30T17:01:17.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba9200640 1 -- 172.21.15.59:0/3976068850 learned_addr learned my addr 172.21.15.59:0/3976068850 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:17.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6baa600640 1 --2- 172.21.15.59:0/3976068850 >> v2:172.21.15.107:3300/0 conn(0x7f6ba4162a50 0x7f6ba406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:17.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687169512 0 0) 0x7f6ba40d0fb0 con 0x7f6ba409b890 2024-05-30T17:01:17.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b8c003530 con 0x7f6ba409b890 2024-05-30T17:01:17.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 702104050 0 0) 0x7f6b8c003530 con 0x7f6ba409b890 2024-05-30T17:01:17.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 >> v2:172.21.15.107:3300/0 conn(0x7f6ba4162a50 msgr2=0x7f6ba406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:17.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 --2- 172.21.15.59:0/3976068850 >> v2:172.21.15.107:3300/0 conn(0x7f6ba4162a50 0x7f6ba406cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:17.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 >> v1:172.21.15.107:6789/0 conn(0x7f6ba409b4b0 legacy=0x7f6ba40d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:17.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba40d1570 con 0x7f6ba409b890 2024-05-30T17:01:17.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f6b90001680 con 0x7f6ba409b890 2024-05-30T17:01:17.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 >> v1:172.21.15.59:6789/0 conn(0x7f6ba409b890 legacy=0x7f6ba4162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:17.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 --2- 172.21.15.59:0/3976068850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b8c0039c0 0x7f6b8c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 --2- 172.21.15.59:0/3976068850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8c004810 0x7f6b8c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 --2- 172.21.15.59:0/3976068850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b8c0051d0 0x7f6b8c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba406fef0 con 0x7f6b8c004810 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c00c170 con 0x7f6b8c0039c0 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6b8c00c370 con 0x7f6b8c0051d0 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba9200640 1 --2- 172.21.15.59:0/3976068850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8c004810 0x7f6b8c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba9c00640 1 --2- 172.21.15.59:0/3976068850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b8c0039c0 0x7f6b8c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6baa600640 1 --2- 172.21.15.59:0/3976068850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b8c0051d0 0x7f6b8c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba9200640 1 -- 172.21.15.59:0/3976068850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b8c0051d0 msgr2=0x7f6b8c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba9200640 1 --2- 172.21.15.59:0/3976068850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b8c0051d0 0x7f6b8c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba9200640 1 -- 172.21.15.59:0/3976068850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b8c0039c0 msgr2=0x7f6b8c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba9200640 1 --2- 172.21.15.59:0/3976068850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b8c0039c0 0x7f6b8c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6ba9200640 1 -- 172.21.15.59:0/3976068850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8c003530 con 0x7f6b8c004810 2024-05-30T17:01:17.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.271+0000 7f6baa600640 1 -- 172.21.15.59:0/3976068850 reap_dead start 2024-05-30T17:01:17.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.275+0000 7f6ba9200640 1 --2- 172.21.15.59:0/3976068850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8c004810 0x7f6b8c004c90 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000c210 tx=0x7f6b9001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c46a7f83462d11e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:17.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.275+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b90007d40 con 0x7f6b8c004810 2024-05-30T17:01:17.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.275+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b900a9070 con 0x7f6b8c004810 2024-05-30T17:01:17.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.275+0000 7f6ba3e00640 1 -- 172.21.15.59:0/3976068850 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b90005d80 con 0x7f6b8c004810 2024-05-30T17:01:17.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.275+0000 7f6bab000640 1 -- 172.21.15.59:0/3976068850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8c004810 msgr2=0x7f6b8c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:17.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.275+0000 7f6bab000640 1 --2- 172.21.15.59:0/3976068850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8c004810 0x7f6b8c004c90 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000c210 tx=0x7f6b9001cbf0 comp rx=0 tx=0).stop 2024-05-30T17:01:17.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.275+0000 7f6bab000640 1 -- 172.21.15.59:0/3976068850 shutdown_connections 2024-05-30T17:01:17.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.275+0000 7f6bab000640 1 --2- 172.21.15.59:0/3976068850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8c004810 0x7f6b8c004c90 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:17.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.275+0000 7f6bab000640 1 -- 172.21.15.59:0/3976068850 >> 172.21.15.59:0/3976068850 conn(0x7f6ba40b3ec0 msgr2=0x7f6ba40b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:17.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.275+0000 7f6bab000640 1 -- 172.21.15.59:0/3976068850 shutdown_connections 2024-05-30T17:01:17.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.275+0000 7f6bab000640 1 -- 172.21.15.59:0/3976068850 wait complete. 2024-05-30T17:01:17.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6bab000640 1 Processor -- start 2024-05-30T17:01:17.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6bab000640 1 -- start start 2024-05-30T17:01:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6bab000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b8c004810 0x7f6ba40c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6bab000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba4153fa0 0x7f6ba41fbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6bab000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4157c00 0x7f6ba40b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6bab000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba40706f0 con 0x7f6ba4157c00 2024-05-30T17:01:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6bab000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4070570 con 0x7f6b8c004810 2024-05-30T17:01:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6bab000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba4070870 con 0x7f6ba4153fa0 2024-05-30T17:01:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6baa600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4157c00 0x7f6ba40b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6baa600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4157c00 0x7f6ba40b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55736/0 (socket says 172.21.15.59:55736) 2024-05-30T17:01:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6baa600640 1 -- 172.21.15.59:0/300229838 learned_addr learned my addr 172.21.15.59:0/300229838 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6ba9c00640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b8c004810 0x7f6ba40c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6ba9200640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba4153fa0 0x7f6ba41fbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6baa600640 1 -- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba4153fa0 msgr2=0x7f6ba41fbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6baa600640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba4153fa0 0x7f6ba41fbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6baa600640 1 -- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b8c004810 msgr2=0x7f6ba40c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6baa600640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b8c004810 0x7f6ba40c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6baa600640 1 -- 172.21.15.59:0/300229838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba41fc220 con 0x7f6ba4157c00 2024-05-30T17:01:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6baa600640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4157c00 0x7f6ba40b1080 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40b4e10 tx=0x7f6b9c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6ba1600640 1 -- 172.21.15.59:0/300229838 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c00fdb0 con 0x7f6ba4157c00 2024-05-30T17:01:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6ba1600640 1 -- 172.21.15.59:0/300229838 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b9c01d070 con 0x7f6ba4157c00 2024-05-30T17:01:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6bab000640 1 -- 172.21.15.59:0/300229838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba40ca870 con 0x7f6ba4157c00 2024-05-30T17:01:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6ba1600640 1 -- 172.21.15.59:0/300229838 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c015670 con 0x7f6ba4157c00 2024-05-30T17:01:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.279+0000 7f6bab000640 1 -- 172.21.15.59:0/300229838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba40c9da0 con 0x7f6ba4157c00 2024-05-30T17:01:17.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.283+0000 7f6bab000640 1 -- 172.21.15.59:0/300229838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba4075450 con 0x7f6ba4157c00 2024-05-30T17:01:17.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.283+0000 7f6ba1600640 1 -- 172.21.15.59:0/300229838 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f6b9c015810 con 0x7f6ba4157c00 2024-05-30T17:01:17.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.283+0000 7f6ba1600640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b84069880 0x7f6b8406bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:17.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.283+0000 7f6ba1600640 1 -- 172.21.15.59:0/300229838 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5339+0+0 (secure 0 0 0) 0x7f6b9c086b50 con 0x7f6ba4157c00 2024-05-30T17:01:17.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.283+0000 7f6ba9c00640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b84069880 0x7f6b8406bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:17.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.283+0000 7f6ba9c00640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b84069880 0x7f6b8406bd40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6b98007fd0 tx=0x7f6b98009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.287+0000 7f6ba1600640 1 -- 172.21.15.59:0/300229838 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b9c010040 con 0x7f6ba4157c00 2024-05-30T17:01:17.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:17.455+0000 7f6bab000640 1 -- 172.21.15.59:0/300229838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6ba4068a90 con 0x7f6ba4157c00 2024-05-30T17:01:18.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.091+0000 7f6ba1600640 1 -- 172.21.15.59:0/300229838 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v102) ==== 170+0+0 (secure 0 0 0) 0x7f6b9c058b60 con 0x7f6ba4157c00 2024-05-30T17:01:18.093 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-05-30T17:01:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.095+0000 7f6bab000640 1 -- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b84069880 msgr2=0x7f6b8406bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.095+0000 7f6bab000640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b84069880 0x7f6b8406bd40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6b98007fd0 tx=0x7f6b98009040 comp rx=0 tx=0).stop 2024-05-30T17:01:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.095+0000 7f6bab000640 1 -- 172.21.15.59:0/300229838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4157c00 msgr2=0x7f6ba40b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.095+0000 7f6bab000640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4157c00 0x7f6ba40b1080 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40b4e10 tx=0x7f6b9c00f580 comp rx=0 tx=0).stop 2024-05-30T17:01:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.095+0000 7f6bab000640 1 -- 172.21.15.59:0/300229838 shutdown_connections 2024-05-30T17:01:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.095+0000 7f6bab000640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b84069880 0x7f6b8406bd40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.095+0000 7f6bab000640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4157c00 0x7f6ba40b1080 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.095+0000 7f6bab000640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba4153fa0 0x7f6ba41fbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.095+0000 7f6bab000640 1 --2- 172.21.15.59:0/300229838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b8c004810 0x7f6ba40c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.095+0000 7f6bab000640 1 -- 172.21.15.59:0/300229838 >> 172.21.15.59:0/300229838 conn(0x7f6ba40b3ec0 msgr2=0x7f6ba40b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.095+0000 7f6bab000640 1 -- 172.21.15.59:0/300229838 shutdown_connections 2024-05-30T17:01:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.095+0000 7f6bab000640 1 -- 172.21.15.59:0/300229838 wait complete. 2024-05-30T17:01:18.140 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T17:01:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.283+0000 7f701a800640 1 Processor -- start 2024-05-30T17:01:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f701a800640 1 -- start start 2024-05-30T17:01:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f701a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7014159100 0x7f701406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f701a800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f70140b44e0 0x7f701415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f701a800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70140b52d0 con 0x7f701415f510 2024-05-30T17:01:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f701a800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f70140b4a30 con 0x7f7014159100 2024-05-30T17:01:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f701a800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f70140b4d10 con 0x7f70140b44e0 2024-05-30T17:01:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f7013400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7014159100 0x7f701406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f7013400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7014159100 0x7f701406e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55738/0 (socket says 172.21.15.59:55738) 2024-05-30T17:01:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f7013400640 1 -- 172.21.15.59:0/3868047482 learned_addr learned my addr 172.21.15.59:0/3868047482 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f700aa00640 1 --2- 172.21.15.59:0/3868047482 >> v2:172.21.15.107:3300/0 conn(0x7f70140b44e0 0x7f701415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f7013400640 1 -- 172.21.15.59:0/3868047482 >> v2:172.21.15.107:3300/0 conn(0x7f70140b44e0 msgr2=0x7f701415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f7013400640 1 --2- 172.21.15.59:0/3868047482 >> v2:172.21.15.107:3300/0 conn(0x7f70140b44e0 0x7f701415efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f7013400640 1 -- 172.21.15.59:0/3868047482 >> v1:172.21.15.107:6789/0 conn(0x7f701415f510 legacy=0x7f701415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:18.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.287+0000 7f7013400640 1 -- 172.21.15.59:0/3868047482 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70140b4ff0 con 0x7f7014159100 2024-05-30T17:01:18.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f7013400640 1 --2- 172.21.15.59:0/3868047482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7014159100 0x7f701406e590 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f70140b3060 tx=0x7f6ffc01eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70159d68f5cdf691 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f7012a00640 1 -- 172.21.15.59:0/3868047482 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc0b4070 con 0x7f7014159100 2024-05-30T17:01:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f7012a00640 1 -- 172.21.15.59:0/3868047482 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ffc0a7c00 con 0x7f7014159100 2024-05-30T17:01:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f7012a00640 1 -- 172.21.15.59:0/3868047482 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc0af440 con 0x7f7014159100 2024-05-30T17:01:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f701a800640 1 -- 172.21.15.59:0/3868047482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7014159100 msgr2=0x7f701406e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f701a800640 1 --2- 172.21.15.59:0/3868047482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7014159100 0x7f701406e590 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f70140b3060 tx=0x7f6ffc01eb30 comp rx=0 tx=0).stop 2024-05-30T17:01:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f701a800640 1 -- 172.21.15.59:0/3868047482 shutdown_connections 2024-05-30T17:01:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f701a800640 1 --2- 172.21.15.59:0/3868047482 >> v2:172.21.15.107:3300/0 conn(0x7f70140b44e0 0x7f701415efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f701a800640 1 --2- 172.21.15.59:0/3868047482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7014159100 0x7f701406e590 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f701a800640 1 -- 172.21.15.59:0/3868047482 >> 172.21.15.59:0/3868047482 conn(0x7f701406bdb0 msgr2=0x7f701406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f701a800640 1 -- 172.21.15.59:0/3868047482 shutdown_connections 2024-05-30T17:01:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f701a800640 1 -- 172.21.15.59:0/3868047482 wait complete. 2024-05-30T17:01:18.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f701a800640 1 Processor -- start 2024-05-30T17:01:18.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.291+0000 7f701a800640 1 -- start start 2024-05-30T17:01:18.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f701a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70140b44e0 0x7f701414c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:18.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f701a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7014159100 0x7f70141533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:18.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f701a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f701415f510 0x7f7014154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:18.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f701a800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70140b33b0 con 0x7f7014159100 2024-05-30T17:01:18.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f701a800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f70140b3530 con 0x7f70140b44e0 2024-05-30T17:01:18.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f701a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f70140b36b0 con 0x7f701415f510 2024-05-30T17:01:18.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f700aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7014159100 0x7f70141533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:18.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f700aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7014159100 0x7f70141533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55748/0 (socket says 172.21.15.59:55748) 2024-05-30T17:01:18.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f700aa00640 1 -- 172.21.15.59:0/4037002336 learned_addr learned my addr 172.21.15.59:0/4037002336 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:18.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f7013400640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70140b44e0 0x7f701414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:18.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f7013e00640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f701415f510 0x7f7014154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:18.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f700aa00640 1 -- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f701415f510 msgr2=0x7f7014154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:18.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f700aa00640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f701415f510 0x7f7014154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:18.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f700aa00640 1 -- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70140b44e0 msgr2=0x7f701414c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:18.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f700aa00640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70140b44e0 0x7f701414c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:18.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f700aa00640 1 -- 172.21.15.59:0/4037002336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7014154bf0 con 0x7f7014159100 2024-05-30T17:01:18.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f700aa00640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7014159100 0x7f70141533e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f700400d830 tx=0x7f700400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:18.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f700be00640 1 -- 172.21.15.59:0/4037002336 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700400b6c0 con 0x7f7014159100 2024-05-30T17:01:18.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f700be00640 1 -- 172.21.15.59:0/4037002336 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7004019070 con 0x7f7014159100 2024-05-30T17:01:18.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f700be00640 1 -- 172.21.15.59:0/4037002336 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700400ba60 con 0x7f7014159100 2024-05-30T17:01:18.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f701a800640 1 -- 172.21.15.59:0/4037002336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7014154ed0 con 0x7f7014159100 2024-05-30T17:01:18.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f701a800640 1 -- 172.21.15.59:0/4037002336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7014152be0 con 0x7f7014159100 2024-05-30T17:01:18.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.295+0000 7f701a800640 1 -- 172.21.15.59:0/4037002336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7014068a90 con 0x7f7014159100 2024-05-30T17:01:18.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.299+0000 7f700be00640 1 -- 172.21.15.59:0/4037002336 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f700401e460 con 0x7f7014159100 2024-05-30T17:01:18.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.299+0000 7f700be00640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6ff0069850 0x7f6ff006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:18.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.299+0000 7f700be00640 1 -- 172.21.15.59:0/4037002336 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5721+0+0 (secure 0 0 0) 0x7f7004086bb0 con 0x7f7014159100 2024-05-30T17:01:18.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.299+0000 7f7013400640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6ff0069850 0x7f6ff006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:18.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.299+0000 7f7013400640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6ff0069850 0x7f6ff006bd10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0b1000 tx=0x7f6ffc0a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:18.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.303+0000 7f700be00640 1 -- 172.21.15.59:0/4037002336 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7004058190 con 0x7f7014159100 2024-05-30T17:01:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:18.503+0000 7f701a800640 1 -- 172.21.15.59:0/4037002336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7014152fe0 con 0x7f7014159100 2024-05-30T17:01:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f700be00640 1 -- 172.21.15.59:0/4037002336 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v58) ==== 174+0+0 (secure 0 0 0) 0x7f700405c490 con 0x7f7014159100 2024-05-30T17:01:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 14 and data pool 15 2024-05-30T17:01:19.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f701a800640 1 -- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6ff0069850 msgr2=0x7f6ff006bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f701a800640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6ff0069850 0x7f6ff006bd10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0b1000 tx=0x7f6ffc0a9070 comp rx=0 tx=0).stop 2024-05-30T17:01:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f701a800640 1 -- 172.21.15.59:0/4037002336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7014159100 msgr2=0x7f70141533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f701a800640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7014159100 0x7f70141533e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f700400d830 tx=0x7f700400dcf0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f701a800640 1 -- 172.21.15.59:0/4037002336 shutdown_connections 2024-05-30T17:01:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f701a800640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6ff0069850 0x7f6ff006bd10 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f701a800640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f701415f510 0x7f7014154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f701a800640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7014159100 0x7f70141533e0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f701a800640 1 --2- 172.21.15.59:0/4037002336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70140b44e0 0x7f701414c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f701a800640 1 -- 172.21.15.59:0/4037002336 >> 172.21.15.59:0/4037002336 conn(0x7f701406bdb0 msgr2=0x7f70140aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f701a800640 1 -- 172.21.15.59:0/4037002336 shutdown_connections 2024-05-30T17:01:19.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.095+0000 7f701a800640 1 -- 172.21.15.59:0/4037002336 wait complete. 2024-05-30T17:01:19.147 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:01:19.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.287+0000 7fefa6a00640 1 Processor -- start 2024-05-30T17:01:19.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.287+0000 7fefa6a00640 1 -- start start 2024-05-30T17:01:19.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.287+0000 7fefa6a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fefa0159df0 0x7fefa00ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.287+0000 7fefa6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefa015a1d0 0x7fefa00ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.287+0000 7fefa6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa00b3e50 0x7fefa015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.287+0000 7fefa6a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fefa015d730 con 0x7fefa015a1d0 2024-05-30T17:01:19.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.287+0000 7fefa6a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fefa00b3370 con 0x7fefa0159df0 2024-05-30T17:01:19.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.287+0000 7fefa6a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fefa00b3650 con 0x7fefa00b3e50 2024-05-30T17:01:19.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.287+0000 7fef97e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefa015a1d0 0x7fefa00ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef97e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefa015a1d0 0x7fefa00ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55764/0 (socket says 172.21.15.59:55764) 2024-05-30T17:01:19.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef97e00640 1 -- 172.21.15.59:0/3314811733 learned_addr learned my addr 172.21.15.59:0/3314811733 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:19.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef97e00640 1 -- 172.21.15.59:0/3314811733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa00b3e50 msgr2=0x7fefa015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:19.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef9fe00640 1 --2- 172.21.15.59:0/3314811733 >> v2:172.21.15.107:3300/0 conn(0x7fefa0159df0 0x7fefa00ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fefa4a00640 1 --2- 172.21.15.59:0/3314811733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa00b3e50 0x7fefa015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef97e00640 1 --2- 172.21.15.59:0/3314811733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa00b3e50 0x7fefa015ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef97e00640 1 -- 172.21.15.59:0/3314811733 >> v2:172.21.15.107:3300/0 conn(0x7fefa0159df0 msgr2=0x7fefa00ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:19.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef97e00640 1 --2- 172.21.15.59:0/3314811733 >> v2:172.21.15.107:3300/0 conn(0x7fefa0159df0 0x7fefa00ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef97e00640 1 -- 172.21.15.59:0/3314811733 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa00b3930 con 0x7fefa015a1d0 2024-05-30T17:01:19.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef9fe00640 1 --2- 172.21.15.59:0/3314811733 >> v2:172.21.15.107:3300/0 conn(0x7fefa0159df0 0x7fefa00ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:19.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fefa4a00640 1 --2- 172.21.15.59:0/3314811733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa00b3e50 0x7fefa015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:19.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef97e00640 1 --2- 172.21.15.59:0/3314811733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa015a1d0 0x7fefa00ad6f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fefa00b4c20 tx=0x7fef8801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e090d7ac083f1434 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:19.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef9f400640 1 -- 172.21.15.59:0/3314811733 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef880ab5f0 con 0x7fefa015a1d0 2024-05-30T17:01:19.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef9f400640 1 -- 172.21.15.59:0/3314811733 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef880b0070 con 0x7fefa015a1d0 2024-05-30T17:01:19.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.291+0000 7fef9f400640 1 -- 172.21.15.59:0/3314811733 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef880ab9b0 con 0x7fefa015a1d0 2024-05-30T17:01:19.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 -- 172.21.15.59:0/3314811733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa015a1d0 msgr2=0x7fefa00ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 --2- 172.21.15.59:0/3314811733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa015a1d0 0x7fefa00ad6f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fefa00b4c20 tx=0x7fef8801c520 comp rx=0 tx=0).stop 2024-05-30T17:01:19.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 -- 172.21.15.59:0/3314811733 shutdown_connections 2024-05-30T17:01:19.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 --2- 172.21.15.59:0/3314811733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa00b3e50 0x7fefa015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 --2- 172.21.15.59:0/3314811733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa015a1d0 0x7fefa00ad6f0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 --2- 172.21.15.59:0/3314811733 >> v2:172.21.15.107:3300/0 conn(0x7fefa0159df0 0x7fefa00ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 -- 172.21.15.59:0/3314811733 >> 172.21.15.59:0/3314811733 conn(0x7fefa00b22d0 msgr2=0x7fefa00b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:19.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 -- 172.21.15.59:0/3314811733 shutdown_connections 2024-05-30T17:01:19.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 -- 172.21.15.59:0/3314811733 wait complete. 2024-05-30T17:01:19.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 Processor -- start 2024-05-30T17:01:19.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 -- start start 2024-05-30T17:01:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefa00b3e50 0x7fefa014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa0159df0 0x7fefa006f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa015a1d0 0x7fefa015ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fefa015e720 con 0x7fefa015a1d0 2024-05-30T17:01:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fefa015e5a0 con 0x7fefa00b3e50 2024-05-30T17:01:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa6a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fefa015e8a0 con 0x7fefa0159df0 2024-05-30T17:01:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa015a1d0 0x7fefa015ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa015a1d0 0x7fefa015ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55780/0 (socket says 172.21.15.59:55780) 2024-05-30T17:01:19.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa4a00640 1 -- 172.21.15.59:0/1088602775 learned_addr learned my addr 172.21.15.59:0/1088602775 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:19.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fef97e00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa0159df0 0x7fefa006f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fef9fe00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefa00b3e50 0x7fefa014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa4a00640 1 -- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa0159df0 msgr2=0x7fefa006f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa4a00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa0159df0 0x7fefa006f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa4a00640 1 -- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefa00b3e50 msgr2=0x7fefa014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa4a00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefa00b3e50 0x7fefa014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.295+0000 7fefa4a00640 1 -- 172.21.15.59:0/1088602775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa006f760 con 0x7fefa015a1d0 2024-05-30T17:01:19.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.299+0000 7fefa4a00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa015a1d0 0x7fefa015ec20 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fef9800cd50 tx=0x7fef9800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:19.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.299+0000 7fef9cc00640 1 -- 172.21.15.59:0/1088602775 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9800f680 con 0x7fefa015a1d0 2024-05-30T17:01:19.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.299+0000 7fef9cc00640 1 -- 172.21.15.59:0/1088602775 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9800f840 con 0x7fefa015a1d0 2024-05-30T17:01:19.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.299+0000 7fefa6a00640 1 -- 172.21.15.59:0/1088602775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa015f440 con 0x7fefa015a1d0 2024-05-30T17:01:19.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.299+0000 7fef9cc00640 1 -- 172.21.15.59:0/1088602775 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9800fc30 con 0x7fefa015a1d0 2024-05-30T17:01:19.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.299+0000 7fefa6a00640 1 -- 172.21.15.59:0/1088602775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa015fa00 con 0x7fefa015a1d0 2024-05-30T17:01:19.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.299+0000 7fefa6a00640 1 -- 172.21.15.59:0/1088602775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa0068a90 con 0x7fefa015a1d0 2024-05-30T17:01:19.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.299+0000 7fef9cc00640 1 -- 172.21.15.59:0/1088602775 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fef980213f0 con 0x7fefa015a1d0 2024-05-30T17:01:19.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.299+0000 7fef9cc00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fef7c069880 0x7fef7c06bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.299+0000 7fef9cc00640 1 -- 172.21.15.59:0/1088602775 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5821+0+0 (secure 0 0 0) 0x7fef98086670 con 0x7fefa015a1d0 2024-05-30T17:01:19.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.299+0000 7fef9fe00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fef7c069880 0x7fef7c06bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.303+0000 7fef9fe00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fef7c069880 0x7fef7c06bd40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fef90006fd0 tx=0x7fef90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:19.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.303+0000 7fef9cc00640 1 -- 172.21.15.59:0/1088602775 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fefa006f760 con 0x7fefa015a1d0 2024-05-30T17:01:19.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.471+0000 7fefa6a00640 1 -- 172.21.15.59:0/1088602775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fefa00b4ef0 con 0x7fefa015a1d0 2024-05-30T17:01:19.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.471+0000 7fef9cc00640 1 -- 172.21.15.59:0/1088602775 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16796 (secure 0 0 0) 0x7fef98014030 con 0x7fefa015a1d0 2024-05-30T17:01:19.475 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:19.475 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":103,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:01:18.507104+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:01:16.196498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-05-30T17:01:17.468393+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:01:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.475+0000 7fefa6a00640 1 -- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fef7c069880 msgr2=0x7fef7c06bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.475+0000 7fefa6a00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fef7c069880 0x7fef7c06bd40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fef90006fd0 tx=0x7fef90008040 comp rx=0 tx=0).stop 2024-05-30T17:01:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.475+0000 7fefa6a00640 1 -- 172.21.15.59:0/1088602775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa015a1d0 msgr2=0x7fefa015ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.475+0000 7fefa6a00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa015a1d0 0x7fefa015ec20 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fef9800cd50 tx=0x7fef9800a650 comp rx=0 tx=0).stop 2024-05-30T17:01:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.475+0000 7fefa6a00640 1 -- 172.21.15.59:0/1088602775 shutdown_connections 2024-05-30T17:01:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.475+0000 7fefa6a00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fef7c069880 0x7fef7c06bd40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.475+0000 7fefa6a00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa015a1d0 0x7fefa015ec20 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.475+0000 7fefa6a00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa0159df0 0x7fefa006f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.475+0000 7fefa6a00640 1 --2- 172.21.15.59:0/1088602775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefa00b3e50 0x7fefa014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.475+0000 7fefa6a00640 1 -- 172.21.15.59:0/1088602775 >> 172.21.15.59:0/1088602775 conn(0x7fefa00b22d0 msgr2=0x7fefa00afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:19.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.475+0000 7fefa6a00640 1 -- 172.21.15.59:0/1088602775 shutdown_connections 2024-05-30T17:01:19.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.475+0000 7fefa6a00640 1 -- 172.21.15.59:0/1088602775 wait complete. 2024-05-30T17:01:19.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:01:19.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.635+0000 7f8792200640 1 Processor -- start 2024-05-30T17:01:19.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.635+0000 7f8792200640 1 -- start start 2024-05-30T17:01:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.635+0000 7f8792200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c0af720 0x7f878c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.635+0000 7f8792200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f878c06e900 0x7f878c15f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.635+0000 7f8792200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f878c15f060 con 0x7f878c0d0560 2024-05-30T17:01:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.635+0000 7f8792200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f878c0afb00 con 0x7f878c06e900 2024-05-30T17:01:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.635+0000 7f8792200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f878c15c270 con 0x7f878c0af720 2024-05-30T17:01:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.635+0000 7f8782a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f878c06e900 0x7f878c15f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.639+0000 7f8782a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f878c06e900 0x7f878c15f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55782/0 (socket says 172.21.15.59:55782) 2024-05-30T17:01:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.639+0000 7f8782a00640 1 -- 172.21.15.59:0/841351604 learned_addr learned my addr 172.21.15.59:0/841351604 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.639+0000 7f878b400640 1 --2- 172.21.15.59:0/841351604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c0af720 0x7f878c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.639+0000 7f8782a00640 1 -- 172.21.15.59:0/841351604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c0af720 msgr2=0x7f878c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.639+0000 7f8782a00640 1 --2- 172.21.15.59:0/841351604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c0af720 0x7f878c15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.639+0000 7f8782a00640 1 -- 172.21.15.59:0/841351604 >> v1:172.21.15.107:6789/0 conn(0x7f878c0d0560 legacy=0x7f878c072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.639+0000 7f8782a00640 1 -- 172.21.15.59:0/841351604 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878c15c550 con 0x7f878c06e900 2024-05-30T17:01:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.639+0000 7f878b400640 1 --2- 172.21.15.59:0/841351604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c0af720 0x7f878c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.639+0000 7f8782a00640 1 --2- 172.21.15.59:0/841351604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878c06e900 0x7f878c15f7f0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f877400bb10 tx=0x7f877401ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e72abb91b06016b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.639+0000 7f878aa00640 1 -- 172.21.15.59:0/841351604 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87740b4070 con 0x7f878c06e900 2024-05-30T17:01:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.639+0000 7f878aa00640 1 -- 172.21.15.59:0/841351604 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87740a7cf0 con 0x7f878c06e900 2024-05-30T17:01:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.639+0000 7f878aa00640 1 -- 172.21.15.59:0/841351604 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87740af660 con 0x7f878c06e900 2024-05-30T17:01:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 -- 172.21.15.59:0/841351604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878c06e900 msgr2=0x7f878c15f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 --2- 172.21.15.59:0/841351604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878c06e900 0x7f878c15f7f0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f877400bb10 tx=0x7f877401ec00 comp rx=0 tx=0).stop 2024-05-30T17:01:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 -- 172.21.15.59:0/841351604 shutdown_connections 2024-05-30T17:01:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 --2- 172.21.15.59:0/841351604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878c06e900 0x7f878c15f7f0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 --2- 172.21.15.59:0/841351604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c0af720 0x7f878c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 -- 172.21.15.59:0/841351604 >> 172.21.15.59:0/841351604 conn(0x7f878c0b22d0 msgr2=0x7f878c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 -- 172.21.15.59:0/841351604 shutdown_connections 2024-05-30T17:01:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 -- 172.21.15.59:0/841351604 wait complete. 2024-05-30T17:01:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 Processor -- start 2024-05-30T17:01:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 -- start start 2024-05-30T17:01:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f878c06e900 0x7f878c150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878c0af720 0x7f878c1f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c0d0560 0x7f878c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f878c15fd30 con 0x7f878c0af720 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f878c0d0da0 con 0x7f878c06e900 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8792200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f878c15feb0 con 0x7f878c0d0560 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8782a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878c0af720 0x7f878c1f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8782a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878c0af720 0x7f878c1f7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55798/0 (socket says 172.21.15.59:55798) 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8782a00640 1 -- 172.21.15.59:0/1402301859 learned_addr learned my addr 172.21.15.59:0/1402301859 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f878b400640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f878c06e900 0x7f878c150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f878be00640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c0d0560 0x7f878c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8782a00640 1 -- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c0d0560 msgr2=0x7f878c15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8782a00640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c0d0560 0x7f878c15dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8782a00640 1 -- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f878c06e900 msgr2=0x7f878c150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8782a00640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f878c06e900 0x7f878c150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8782a00640 1 -- 172.21.15.59:0/1402301859 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878c158f70 con 0x7f878c0af720 2024-05-30T17:01:19.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.643+0000 7f8782a00640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878c0af720 0x7f878c1f7500 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f877400b2c0 tx=0x7f877401b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:19.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.647+0000 7f8783e00640 1 -- 172.21.15.59:0/1402301859 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87740b4030 con 0x7f878c0af720 2024-05-30T17:01:19.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.647+0000 7f8783e00640 1 -- 172.21.15.59:0/1402301859 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87740b6070 con 0x7f878c0af720 2024-05-30T17:01:19.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.647+0000 7f8783e00640 1 -- 172.21.15.59:0/1402301859 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87740ad7b0 con 0x7f878c0af720 2024-05-30T17:01:19.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.647+0000 7f8792200640 1 -- 172.21.15.59:0/1402301859 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f878c159210 con 0x7f878c0af720 2024-05-30T17:01:19.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.647+0000 7f8792200640 1 -- 172.21.15.59:0/1402301859 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f878c1597d0 con 0x7f878c0af720 2024-05-30T17:01:19.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.647+0000 7f8792200640 1 -- 172.21.15.59:0/1402301859 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f878c068a90 con 0x7f878c0af720 2024-05-30T17:01:19.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.647+0000 7f8783e00640 1 -- 172.21.15.59:0/1402301859 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f87740c1060 con 0x7f878c0af720 2024-05-30T17:01:19.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.647+0000 7f8783e00640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8768069880 0x7f876806bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.647+0000 7f8783e00640 1 -- 172.21.15.59:0/1402301859 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5821+0+0 (secure 0 0 0) 0x7f877411f990 con 0x7f878c0af720 2024-05-30T17:01:19.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.647+0000 7f878b400640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8768069880 0x7f876806bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.651+0000 7f878b400640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8768069880 0x7f876806bd40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c900 tx=0x7f877c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:19.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.651+0000 7f8783e00640 1 -- 172.21.15.59:0/1402301859 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8774018820 con 0x7f878c0af720 2024-05-30T17:01:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.819+0000 7f8792200640 1 -- 172.21.15.59:0/1402301859 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f878c166ef0 con 0x7f878c0af720 2024-05-30T17:01:19.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.819+0000 7f8783e00640 1 -- 172.21.15.59:0/1402301859 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16796 (secure 0 0 0) 0x7f87740f1ac0 con 0x7f878c0af720 2024-05-30T17:01:19.824 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:19.824 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":103,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:01:18.507104+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:01:16.196498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-05-30T17:01:17.468393+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:01:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.823+0000 7f8792200640 1 -- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8768069880 msgr2=0x7f876806bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.823+0000 7f8792200640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8768069880 0x7f876806bd40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c900 tx=0x7f877c008040 comp rx=0 tx=0).stop 2024-05-30T17:01:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.823+0000 7f8792200640 1 -- 172.21.15.59:0/1402301859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878c0af720 msgr2=0x7f878c1f7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.823+0000 7f8792200640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878c0af720 0x7f878c1f7500 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f877400b2c0 tx=0x7f877401b9a0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.823+0000 7f8792200640 1 -- 172.21.15.59:0/1402301859 shutdown_connections 2024-05-30T17:01:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.823+0000 7f8792200640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8768069880 0x7f876806bd40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.823+0000 7f8792200640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c0d0560 0x7f878c15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.823+0000 7f8792200640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878c0af720 0x7f878c1f7500 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.823+0000 7f8792200640 1 --2- 172.21.15.59:0/1402301859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f878c06e900 0x7f878c150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.823+0000 7f8792200640 1 -- 172.21.15.59:0/1402301859 >> 172.21.15.59:0/1402301859 conn(0x7f878c0b22d0 msgr2=0x7f878c06f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.823+0000 7f8792200640 1 -- 172.21.15.59:0/1402301859 shutdown_connections 2024-05-30T17:01:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.823+0000 7f8792200640 1 -- 172.21.15.59:0/1402301859 wait complete. 2024-05-30T17:01:19.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T17:01:19.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.987+0000 7efd62800640 1 Processor -- start 2024-05-30T17:01:19.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.987+0000 7efd62800640 1 -- start start 2024-05-30T17:01:19.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.987+0000 7efd62800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efd5c15a100 0x7efd5c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.987+0000 7efd62800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd5c0c6230 0x7efd5c0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:19.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.987+0000 7efd62800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5c0d0a50 con 0x7efd5c0d0520 2024-05-30T17:01:19.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.987+0000 7efd62800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7efd5c06b9b0 con 0x7efd5c0c6230 2024-05-30T17:01:19.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.987+0000 7efd62800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7efd5c0d0d30 con 0x7efd5c15a100 2024-05-30T17:01:19.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.991+0000 7efd5be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd5c0c6230 0x7efd5c0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.991+0000 7efd5be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd5c0c6230 0x7efd5c0c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55804/0 (socket says 172.21.15.59:55804) 2024-05-30T17:01:19.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.991+0000 7efd5be00640 1 -- 172.21.15.59:0/2478823337 learned_addr learned my addr 172.21.15.59:0/2478823337 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:19.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.991+0000 7efd5b400640 1 --2- 172.21.15.59:0/2478823337 >> v2:172.21.15.107:3300/0 conn(0x7efd5c15a100 0x7efd5c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:19.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.991+0000 7efd5be00640 1 -- 172.21.15.59:0/2478823337 >> v2:172.21.15.107:3300/0 conn(0x7efd5c15a100 msgr2=0x7efd5c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:19.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.991+0000 7efd5be00640 1 --2- 172.21.15.59:0/2478823337 >> v2:172.21.15.107:3300/0 conn(0x7efd5c15a100 0x7efd5c15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.991+0000 7efd5be00640 1 -- 172.21.15.59:0/2478823337 >> v1:172.21.15.107:6789/0 conn(0x7efd5c0d0520 legacy=0x7efd5c06c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:19.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.991+0000 7efd5be00640 1 -- 172.21.15.59:0/2478823337 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c0d1010 con 0x7efd5c0c6230 2024-05-30T17:01:19.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.991+0000 7efd5be00640 1 --2- 172.21.15.59:0/2478823337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd5c0c6230 0x7efd5c0c66c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0d2470 tx=0x7efd5401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b006ea986c32408 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:19.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.991+0000 7efd5aa00640 1 -- 172.21.15.59:0/2478823337 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540a5670 con 0x7efd5c0c6230 2024-05-30T17:01:19.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.991+0000 7efd5aa00640 1 -- 172.21.15.59:0/2478823337 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd540a5810 con 0x7efd5c0c6230 2024-05-30T17:01:19.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.991+0000 7efd5aa00640 1 -- 172.21.15.59:0/2478823337 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540a5be0 con 0x7efd5c0c6230 2024-05-30T17:01:19.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 -- 172.21.15.59:0/2478823337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd5c0c6230 msgr2=0x7efd5c0c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 --2- 172.21.15.59:0/2478823337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd5c0c6230 0x7efd5c0c66c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0d2470 tx=0x7efd5401c9b0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 -- 172.21.15.59:0/2478823337 shutdown_connections 2024-05-30T17:01:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 --2- 172.21.15.59:0/2478823337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd5c0c6230 0x7efd5c0c66c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 --2- 172.21.15.59:0/2478823337 >> v2:172.21.15.107:3300/0 conn(0x7efd5c15a100 0x7efd5c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 -- 172.21.15.59:0/2478823337 >> 172.21.15.59:0/2478823337 conn(0x7efd5c09aa40 msgr2=0x7efd5c0b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 -- 172.21.15.59:0/2478823337 shutdown_connections 2024-05-30T17:01:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 -- 172.21.15.59:0/2478823337 wait complete. 2024-05-30T17:01:19.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 Processor -- start 2024-05-30T17:01:19.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 -- start start 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5c0c6230 0x7efd5c15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd5c0d0520 0x7efd5c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd5c15a100 0x7efd5c070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c169350 con 0x7efd5c15a100 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c0b3880 con 0x7efd5c0c6230 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd62800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efd5c1694d0 con 0x7efd5c0d0520 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd5be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd5c15a100 0x7efd5c070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd5be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd5c15a100 0x7efd5c070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55812/0 (socket says 172.21.15.59:55812) 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd5be00640 1 -- 172.21.15.59:0/2340115363 learned_addr learned my addr 172.21.15.59:0/2340115363 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd5b400640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5c0c6230 0x7efd5c15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.995+0000 7efd53e00640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd5c0d0520 0x7efd5c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd5be00640 1 -- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd5c0d0520 msgr2=0x7efd5c070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:20.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd5be00640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd5c0d0520 0x7efd5c070410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd5be00640 1 -- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5c0c6230 msgr2=0x7efd5c15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd5be00640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5c0c6230 0x7efd5c15bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd5be00640 1 -- 172.21.15.59:0/2340115363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c15c1a0 con 0x7efd5c15a100 2024-05-30T17:01:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd5b400640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5c0c6230 0x7efd5c15bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd53e00640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd5c0d0520 0x7efd5c070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd5be00640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd5c15a100 0x7efd5c070950 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7efd540af040 tx=0x7efd54019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd53400640 1 -- 172.21.15.59:0/2340115363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540b8470 con 0x7efd5c15a100 2024-05-30T17:01:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd53400640 1 -- 172.21.15.59:0/2340115363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd540b8630 con 0x7efd5c15a100 2024-05-30T17:01:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd62800640 1 -- 172.21.15.59:0/2340115363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c1646f0 con 0x7efd5c15a100 2024-05-30T17:01:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd53400640 1 -- 172.21.15.59:0/2340115363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540b8a20 con 0x7efd5c15a100 2024-05-30T17:01:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd62800640 1 -- 172.21.15.59:0/2340115363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c164cb0 con 0x7efd5c15a100 2024-05-30T17:01:20.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd62800640 1 -- 172.21.15.59:0/2340115363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd5c068a90 con 0x7efd5c15a100 2024-05-30T17:01:20.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd53400640 1 -- 172.21.15.59:0/2340115363 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7efd540c0030 con 0x7efd5c15a100 2024-05-30T17:01:20.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd53400640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd38069850 0x7efd3806bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:20.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:19.999+0000 7efd53400640 1 -- 172.21.15.59:0/2340115363 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5821+0+0 (secure 0 0 0) 0x7efd54120660 con 0x7efd5c15a100 2024-05-30T17:01:20.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:20.003+0000 7efd5b400640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd38069850 0x7efd3806bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:20.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:20.003+0000 7efd5b400640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd38069850 0x7efd3806bd10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00b9f0 tx=0x7efd4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:20.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:20.007+0000 7efd53400640 1 -- 172.21.15.59:0/2340115363 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd540c7020 con 0x7efd5c15a100 2024-05-30T17:01:20.077 INFO:tasks.ceph.mds.c.smithi059.stderr:2024-05-30T17:01:20.075+0000 7ff8f1000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T17:01:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:20.211+0000 7efd62800640 1 -- 172.21.15.59:0/2340115363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7efd5c15c3d0 con 0x7efd5c15a100 2024-05-30T17:01:21.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd53400640 1 -- 172.21.15.59:0/2340115363 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v60) ==== 118+0+0 (secure 0 0 0) 0x7efd540165a0 con 0x7efd5c15a100 2024-05-30T17:01:21.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd62800640 1 -- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd38069850 msgr2=0x7efd3806bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:21.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd62800640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd38069850 0x7efd3806bd10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00b9f0 tx=0x7efd4c008040 comp rx=0 tx=0).stop 2024-05-30T17:01:21.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd62800640 1 -- 172.21.15.59:0/2340115363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd5c15a100 msgr2=0x7efd5c070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:21.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd62800640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd5c15a100 0x7efd5c070950 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7efd540af040 tx=0x7efd54019750 comp rx=0 tx=0).stop 2024-05-30T17:01:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd62800640 1 -- 172.21.15.59:0/2340115363 shutdown_connections 2024-05-30T17:01:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd62800640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd38069850 0x7efd3806bd10 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd62800640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd5c15a100 0x7efd5c070950 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd62800640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd5c0d0520 0x7efd5c070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd62800640 1 --2- 172.21.15.59:0/2340115363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5c0c6230 0x7efd5c15bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd62800640 1 -- 172.21.15.59:0/2340115363 >> 172.21.15.59:0/2340115363 conn(0x7efd5c09aa40 msgr2=0x7efd5c15e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd62800640 1 -- 172.21.15.59:0/2340115363 shutdown_connections 2024-05-30T17:01:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.123+0000 7efd62800640 1 -- 172.21.15.59:0/2340115363 wait complete. 2024-05-30T17:01:21.150 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T17:01:21.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T17:01:21.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b9c00640 1 Processor -- start 2024-05-30T17:01:21.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b9c00640 1 -- start start 2024-05-30T17:01:21.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b9c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b41569e0 0x7fc7b415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:21.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b9c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc7b40d0660 0x7fc7b40d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:21.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b9c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7b40ad770 con 0x7fc7b40ad2b0 2024-05-30T17:01:21.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b9c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc7b415cb40 con 0x7fc7b40d0660 2024-05-30T17:01:21.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b9c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b415ce20 con 0x7fc7b41569e0 2024-05-30T17:01:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b41569e0 0x7fc7b415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b3400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc7b40d0660 0x7fc7b40d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b41569e0 0x7fc7b415d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:43920/0 (socket says 172.21.15.59:43920) 2024-05-30T17:01:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b2a00640 1 -- 172.21.15.59:0/2626066051 learned_addr learned my addr 172.21.15.59:0/2626066051 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b3400640 1 -- 172.21.15.59:0/2626066051 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b41569e0 msgr2=0x7fc7b415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b3400640 1 --2- 172.21.15.59:0/2626066051 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b41569e0 0x7fc7b415d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b3400640 1 -- 172.21.15.59:0/2626066051 >> v1:172.21.15.107:6789/0 conn(0x7fc7b40ad2b0 legacy=0x7fc7b40cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.299+0000 7fc7b3400640 1 -- 172.21.15.59:0/2626066051 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b415d100 con 0x7fc7b40d0660 2024-05-30T17:01:21.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.303+0000 7fc7b3400640 1 --2- 172.21.15.59:0/2626066051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b40d0660 0x7fc7b40d0af0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009d90 tx=0x7fc7ac01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=359d7d329697c264 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.303+0000 7fc7b2000640 1 -- 172.21.15.59:0/2626066051 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0b2070 con 0x7fc7b40d0660 2024-05-30T17:01:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.303+0000 7fc7b2000640 1 -- 172.21.15.59:0/2626066051 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac0a57a0 con 0x7fc7b40d0660 2024-05-30T17:01:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.303+0000 7fc7b2000640 1 -- 172.21.15.59:0/2626066051 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0a5b70 con 0x7fc7b40d0660 2024-05-30T17:01:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.303+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2626066051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b40d0660 msgr2=0x7fc7b40d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.303+0000 7fc7b9c00640 1 --2- 172.21.15.59:0/2626066051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b40d0660 0x7fc7b40d0af0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009d90 tx=0x7fc7ac01c8e0 comp rx=0 tx=0).stop 2024-05-30T17:01:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.303+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2626066051 shutdown_connections 2024-05-30T17:01:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.303+0000 7fc7b9c00640 1 --2- 172.21.15.59:0/2626066051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b40d0660 0x7fc7b40d0af0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.303+0000 7fc7b9c00640 1 --2- 172.21.15.59:0/2626066051 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b41569e0 0x7fc7b415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.303+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2626066051 >> 172.21.15.59:0/2626066051 conn(0x7fc7b406bdb0 msgr2=0x7fc7b406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.303+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2626066051 shutdown_connections 2024-05-30T17:01:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.303+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2626066051 wait complete. 2024-05-30T17:01:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b9c00640 1 Processor -- start 2024-05-30T17:01:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b9c00640 1 -- start start 2024-05-30T17:01:21.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b9c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b40ad2b0 0x7fc7b40afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:21.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b9c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7b40d0660 0x7fc7b409dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:21.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b9c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b41569e0 0x7fc7b414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:21.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b9c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b40b3e70 con 0x7fc7b40d0660 2024-05-30T17:01:21.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b9c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b40b3cf0 con 0x7fc7b40ad2b0 2024-05-30T17:01:21.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b9c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b40b3ff0 con 0x7fc7b41569e0 2024-05-30T17:01:21.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7abe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7b40d0660 0x7fc7b409dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:21.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7abe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7b40d0660 0x7fc7b409dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55820/0 (socket says 172.21.15.59:55820) 2024-05-30T17:01:21.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7abe00640 1 -- 172.21.15.59:0/2801344313 learned_addr learned my addr 172.21.15.59:0/2801344313 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:21.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b2a00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b40ad2b0 0x7fc7b40afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:21.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b3400640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b41569e0 0x7fc7b414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:21.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7abe00640 1 -- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b41569e0 msgr2=0x7fc7b414b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:21.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7abe00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b41569e0 0x7fc7b414b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:21.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7abe00640 1 -- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b40ad2b0 msgr2=0x7fc7b40afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:21.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7abe00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b40ad2b0 0x7fc7b40afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:21.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7abe00640 1 -- 172.21.15.59:0/2801344313 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b409dff0 con 0x7fc7b40d0660 2024-05-30T17:01:21.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7abe00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7b40d0660 0x7fc7b409dab0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c3a0 tx=0x7fc79c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:21.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7aaa00640 1 -- 172.21.15.59:0/2801344313 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0052d0 con 0x7fc7b40d0660 2024-05-30T17:01:21.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7aaa00640 1 -- 172.21.15.59:0/2801344313 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c005470 con 0x7fc7b40d0660 2024-05-30T17:01:21.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7aaa00640 1 -- 172.21.15.59:0/2801344313 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c007260 con 0x7fc7b40d0660 2024-05-30T17:01:21.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2801344313 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b40b0450 con 0x7fc7b40d0660 2024-05-30T17:01:21.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2801344313 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b40b0a10 con 0x7fc7b40d0660 2024-05-30T17:01:21.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.307+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2801344313 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b4068a90 con 0x7fc7b40d0660 2024-05-30T17:01:21.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.311+0000 7fc7aaa00640 1 -- 172.21.15.59:0/2801344313 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fc79c007400 con 0x7fc7b40d0660 2024-05-30T17:01:21.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.311+0000 7fc7aaa00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc790069850 0x7fc79006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:21.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.311+0000 7fc7aaa00640 1 -- 172.21.15.59:0/2801344313 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7fc79c084e00 con 0x7fc7b40d0660 2024-05-30T17:01:21.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.311+0000 7fc7b2a00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc790069850 0x7fc79006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:21.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.311+0000 7fc7b2a00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc790069850 0x7fc79006bd10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009b50 tx=0x7fc7a4009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:21.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.315+0000 7fc7aaa00640 1 -- 172.21.15.59:0/2801344313 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc79c056440 con 0x7fc7b40d0660 2024-05-30T17:01:21.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:21.515+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2801344313 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc7b4072ac0 con 0x7fc7b40d0660 2024-05-30T17:01:22.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.127+0000 7fc7aaa00640 1 -- 172.21.15.59:0/2801344313 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v61) ==== 122+0+0 (secure 0 0 0) 0x7fc79c05a740 con 0x7fc7b40d0660 2024-05-30T17:01:22.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.131+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc790069850 msgr2=0x7fc79006bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.131+0000 7fc7b9c00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc790069850 0x7fc79006bd10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009b50 tx=0x7fc7a4009240 comp rx=0 tx=0).stop 2024-05-30T17:01:22.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.131+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2801344313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7b40d0660 msgr2=0x7fc7b409dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.131+0000 7fc7b9c00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7b40d0660 0x7fc7b409dab0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c3a0 tx=0x7fc79c00c860 comp rx=0 tx=0).stop 2024-05-30T17:01:22.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.131+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2801344313 shutdown_connections 2024-05-30T17:01:22.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.131+0000 7fc7b9c00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc790069850 0x7fc79006bd10 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.131+0000 7fc7b9c00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b41569e0 0x7fc7b414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.131+0000 7fc7b9c00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7b40d0660 0x7fc7b409dab0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.131+0000 7fc7b9c00640 1 --2- 172.21.15.59:0/2801344313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b40ad2b0 0x7fc7b40afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.131+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2801344313 >> 172.21.15.59:0/2801344313 conn(0x7fc7b406bdb0 msgr2=0x7fc7b414c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:22.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.131+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2801344313 shutdown_connections 2024-05-30T17:01:22.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.131+0000 7fc7b9c00640 1 -- 172.21.15.59:0/2801344313 wait complete. 2024-05-30T17:01:22.157 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T17:01:22.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:01:22.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.299+0000 7f8211600640 1 Processor -- start 2024-05-30T17:01:22.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.299+0000 7f8211600640 1 -- start start 2024-05-30T17:01:22.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f8211600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f820c0af720 0x7f820c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:22.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f8211600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f820c06e900 0x7f820c15f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:22.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f8211600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f820c15f060 con 0x7f820c0d0560 2024-05-30T17:01:22.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f8211600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f820c0afb00 con 0x7f820c0af720 2024-05-30T17:01:22.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f8211600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f820c15c270 con 0x7f820c06e900 2024-05-30T17:01:22.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f820aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f820c0af720 0x7f820c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:22.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f820aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f820c0af720 0x7f820c15b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37938/0 (socket says 172.21.15.59:37938) 2024-05-30T17:01:22.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f820aa00640 1 -- 172.21.15.59:0/2064775416 learned_addr learned my addr 172.21.15.59:0/2064775416 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:22.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f8202000640 1 --2- 172.21.15.59:0/2064775416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f820c06e900 0x7f820c15f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:22.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f820aa00640 1 -- 172.21.15.59:0/2064775416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f820c06e900 msgr2=0x7f820c15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:22.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f820aa00640 1 --2- 172.21.15.59:0/2064775416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f820c06e900 0x7f820c15f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f820aa00640 1 -- 172.21.15.59:0/2064775416 >> v1:172.21.15.107:6789/0 conn(0x7f820c0d0560 legacy=0x7f820c072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:22.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.303+0000 7f820aa00640 1 -- 172.21.15.59:0/2064775416 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c15c550 con 0x7f820c0af720 2024-05-30T17:01:22.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f820aa00640 1 --2- 172.21.15.59:0/2064775416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820c0af720 0x7f820c15b9d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009870 tx=0x7f81fc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f7e4c21fb7bc36 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f820a000640 1 -- 172.21.15.59:0/2064775416 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0a9610 con 0x7f820c0af720 2024-05-30T17:01:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f820a000640 1 -- 172.21.15.59:0/2064775416 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc0a97b0 con 0x7f820c0af720 2024-05-30T17:01:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f820a000640 1 -- 172.21.15.59:0/2064775416 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0a9b80 con 0x7f820c0af720 2024-05-30T17:01:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f8211600640 1 -- 172.21.15.59:0/2064775416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820c0af720 msgr2=0x7f820c15b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f8211600640 1 --2- 172.21.15.59:0/2064775416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820c0af720 0x7f820c15b9d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009870 tx=0x7f81fc01c530 comp rx=0 tx=0).stop 2024-05-30T17:01:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f8211600640 1 -- 172.21.15.59:0/2064775416 shutdown_connections 2024-05-30T17:01:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f8211600640 1 --2- 172.21.15.59:0/2064775416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f820c06e900 0x7f820c15f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f8211600640 1 --2- 172.21.15.59:0/2064775416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820c0af720 0x7f820c15b9d0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f8211600640 1 -- 172.21.15.59:0/2064775416 >> 172.21.15.59:0/2064775416 conn(0x7f820c0b22d0 msgr2=0x7f820c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f8211600640 1 -- 172.21.15.59:0/2064775416 shutdown_connections 2024-05-30T17:01:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f8211600640 1 -- 172.21.15.59:0/2064775416 wait complete. 2024-05-30T17:01:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f8211600640 1 Processor -- start 2024-05-30T17:01:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f8211600640 1 -- start start 2024-05-30T17:01:22.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.307+0000 7f8211600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f820c06e900 0x7f820c14cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:22.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8211600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f820c0af720 0x7f820c15a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:22.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8211600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820c0d0560 0x7f820c15aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8211600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f820c15fd30 con 0x7f820c0d0560 2024-05-30T17:01:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8211600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f820c0d0da0 con 0x7f820c06e900 2024-05-30T17:01:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8211600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f820c15feb0 con 0x7f820c0af720 2024-05-30T17:01:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f820b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820c0d0560 0x7f820c15aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f820b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820c0d0560 0x7f820c15aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37950/0 (socket says 172.21.15.59:37950) 2024-05-30T17:01:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f820b400640 1 -- 172.21.15.59:0/574181097 learned_addr learned my addr 172.21.15.59:0/574181097 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f820aa00640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f820c06e900 0x7f820c14cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8202000640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f820c0af720 0x7f820c15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f820b400640 1 -- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f820c0af720 msgr2=0x7f820c15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f820b400640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f820c0af720 0x7f820c15a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f820b400640 1 -- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f820c06e900 msgr2=0x7f820c14cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f820b400640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f820c06e900 0x7f820c14cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f820b400640 1 -- 172.21.15.59:0/574181097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c153200 con 0x7f820c0d0560 2024-05-30T17:01:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f820b400640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820c0d0560 0x7f820c15aaf0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f820400c770 tx=0x7f820400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8203400640 1 -- 172.21.15.59:0/574181097 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204003b80 con 0x7f820c0d0560 2024-05-30T17:01:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8203400640 1 -- 172.21.15.59:0/574181097 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8204003d20 con 0x7f820c0d0560 2024-05-30T17:01:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8211600640 1 -- 172.21.15.59:0/574181097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820c15ecf0 con 0x7f820c0d0560 2024-05-30T17:01:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8203400640 1 -- 172.21.15.59:0/574181097 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820400aa90 con 0x7f820c0d0560 2024-05-30T17:01:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8211600640 1 -- 172.21.15.59:0/574181097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820c15ea10 con 0x7f820c0d0560 2024-05-30T17:01:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8211600640 1 -- 172.21.15.59:0/574181097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f820c068a90 con 0x7f820c0d0560 2024-05-30T17:01:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.311+0000 7f8203400640 1 -- 172.21.15.59:0/574181097 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f820400ac30 con 0x7f820c0d0560 2024-05-30T17:01:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.315+0000 7f8203400640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81e8069850 0x7f81e806bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.315+0000 7f8203400640 1 -- 172.21.15.59:0/574181097 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f8204085860 con 0x7f820c0d0560 2024-05-30T17:01:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.315+0000 7f820aa00640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81e8069850 0x7f81e806bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.315+0000 7f820aa00640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81e8069850 0x7f81e806bd10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0ae000 tx=0x7f81fc0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:22.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.319+0000 7f8203400640 1 -- 172.21.15.59:0/574181097 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f820c153200 con 0x7f820c0d0560 2024-05-30T17:01:22.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.515+0000 7f8211600640 1 -- 172.21.15.59:0/574181097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f820c074b40 con 0x7f820c0d0560 2024-05-30T17:01:22.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.515+0000 7f8203400640 1 -- 172.21.15.59:0/574181097 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5189 (secure 0 0 0) 0x7f8204056e40 con 0x7f820c0d0560 2024-05-30T17:01:22.519 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:22.520 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2410188205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2410188205},{"type":"v1","addr":"172.21.15.107:6836","nonce":2410188205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7342,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1749998079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1749998079},{"type":"v1","addr":"172.21.15.59:6834","nonce":1749998079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3865215628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3865215628},{"type":"v1","addr":"172.21.15.107:6837","nonce":3865215628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:01:18.507070+0000","modified":"2024-05-30T17:01:21.519897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/1525464146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1525464146},{"type":"v1","addr":"172.21.15.59:6835","nonce":1525464146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7986,"qdb_cluster":[7986]},"id":7}]} 2024-05-30T17:01:22.520 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 61 2024-05-30T17:01:22.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.519+0000 7f8211600640 1 -- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81e8069850 msgr2=0x7f81e806bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.519+0000 7f8211600640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81e8069850 0x7f81e806bd10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0ae000 tx=0x7f81fc0b3040 comp rx=0 tx=0).stop 2024-05-30T17:01:22.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.519+0000 7f8211600640 1 -- 172.21.15.59:0/574181097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820c0d0560 msgr2=0x7f820c15aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.519+0000 7f8211600640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820c0d0560 0x7f820c15aaf0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f820400c770 tx=0x7f820400cc30 comp rx=0 tx=0).stop 2024-05-30T17:01:22.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.519+0000 7f8211600640 1 -- 172.21.15.59:0/574181097 shutdown_connections 2024-05-30T17:01:22.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.519+0000 7f8211600640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81e8069850 0x7f81e806bd10 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.519+0000 7f8211600640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820c0d0560 0x7f820c15aaf0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.519+0000 7f8211600640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f820c0af720 0x7f820c15a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.519+0000 7f8211600640 1 --2- 172.21.15.59:0/574181097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f820c06e900 0x7f820c14cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.519+0000 7f8211600640 1 -- 172.21.15.59:0/574181097 >> 172.21.15.59:0/574181097 conn(0x7f820c0b22d0 msgr2=0x7f820c155850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:22.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.519+0000 7f8211600640 1 -- 172.21.15.59:0/574181097 shutdown_connections 2024-05-30T17:01:22.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.519+0000 7f8211600640 1 -- 172.21.15.59:0/574181097 wait complete. 2024-05-30T17:01:22.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:01:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.679+0000 7f6047000640 1 Processor -- start 2024-05-30T17:01:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.679+0000 7f6047000640 1 -- start start 2024-05-30T17:01:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.679+0000 7f6047000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f604009aa40 0x7f604015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.679+0000 7f6047000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f60400b34b0 0x7f604009ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.679+0000 7f6047000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60400cce40 con 0x7f604009b360 2024-05-30T17:01:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.679+0000 7f6047000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f60400d0260 con 0x7f60400b34b0 2024-05-30T17:01:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.679+0000 7f6047000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f60400b3ba0 con 0x7f604009aa40 2024-05-30T17:01:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.683+0000 7f6045000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f604009b360 0x7f60400cd5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45570/0 (socket says 172.21.15.59:45570) 2024-05-30T17:01:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.683+0000 7f6045000640 1 -- 172.21.15.59:0/3717857955 learned_addr learned my addr 172.21.15.59:0/3717857955 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.683+0000 7f6037e00640 1 --2- 172.21.15.59:0/3717857955 >> v2:172.21.15.107:3300/0 conn(0x7f60400b34b0 0x7f604009ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.683+0000 7f603fe00640 1 --2- 172.21.15.59:0/3717857955 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f604009aa40 0x7f604015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.683+0000 7f603f400640 1 -- 172.21.15.59:0/3717857955 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619945707 0 0) 0x7f60380014a0 con 0x7f604009b360 2024-05-30T17:01:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.683+0000 7f603f400640 1 -- 172.21.15.59:0/3717857955 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6024003530 con 0x7f604009b360 2024-05-30T17:01:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.683+0000 7f6037e00640 1 -- 172.21.15.59:0/3717857955 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f604009aa40 msgr2=0x7f604015e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.683+0000 7f6037e00640 1 --2- 172.21.15.59:0/3717857955 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f604009aa40 0x7f604015e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.683+0000 7f603f400640 1 -- 172.21.15.59:0/3717857955 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 81512880 0 0) 0x7f6024003530 con 0x7f604009b360 2024-05-30T17:01:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.683+0000 7f6037e00640 1 -- 172.21.15.59:0/3717857955 >> v1:172.21.15.59:6789/0 conn(0x7f604009b360 legacy=0x7f60400cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.683+0000 7f6037e00640 1 -- 172.21.15.59:0/3717857955 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60400ceac0 con 0x7f60400b34b0 2024-05-30T17:01:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.683+0000 7f6037e00640 1 --2- 172.21.15.59:0/3717857955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60400b34b0 0x7f604009ae20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f60280097c0 tx=0x7f602801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb34d614c6d5c05a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f603f400640 1 -- 172.21.15.59:0/3717857955 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60280b0070 con 0x7f60400b34b0 2024-05-30T17:01:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f603f400640 1 -- 172.21.15.59:0/3717857955 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60280ab400 con 0x7f60400b34b0 2024-05-30T17:01:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f603f400640 1 -- 172.21.15.59:0/3717857955 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6038001bd0 con 0x7f60400b34b0 2024-05-30T17:01:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 -- 172.21.15.59:0/3717857955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60400b34b0 msgr2=0x7f604009ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 --2- 172.21.15.59:0/3717857955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60400b34b0 0x7f604009ae20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f60280097c0 tx=0x7f602801c330 comp rx=0 tx=0).stop 2024-05-30T17:01:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 -- 172.21.15.59:0/3717857955 shutdown_connections 2024-05-30T17:01:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 --2- 172.21.15.59:0/3717857955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60400b34b0 0x7f604009ae20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 --2- 172.21.15.59:0/3717857955 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f604009aa40 0x7f604015e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 -- 172.21.15.59:0/3717857955 >> 172.21.15.59:0/3717857955 conn(0x7f60400b3f50 msgr2=0x7f60400b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 -- 172.21.15.59:0/3717857955 shutdown_connections 2024-05-30T17:01:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 -- 172.21.15.59:0/3717857955 wait complete. 2024-05-30T17:01:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 Processor -- start 2024-05-30T17:01:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 -- start start 2024-05-30T17:01:22.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009aa40 0x7f604014c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:22.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f604009b360 0x7f60400c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60400b34b0 0x7f6040151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f604015deb0 con 0x7f604009aa40 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f604015dd30 con 0x7f60400b34b0 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6047000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6040169ec0 con 0x7f604009b360 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f603fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009aa40 0x7f604014c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f603fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009aa40 0x7f604014c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37952/0 (socket says 172.21.15.59:37952) 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f603fe00640 1 -- 172.21.15.59:0/922366588 learned_addr learned my addr 172.21.15.59:0/922366588 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6045000640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60400b34b0 0x7f6040151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f6037e00640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f604009b360 0x7f60400c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f603fe00640 1 -- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f604009b360 msgr2=0x7f60400c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.687+0000 7f603fe00640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f604009b360 0x7f60400c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f603fe00640 1 -- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60400b34b0 msgr2=0x7f6040151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f603fe00640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60400b34b0 0x7f6040151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f603fe00640 1 -- 172.21.15.59:0/922366588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6040154d10 con 0x7f604009aa40 2024-05-30T17:01:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f603fe00640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009aa40 0x7f604014c390 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f603000e8a0 tx=0x7f603000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f603cc00640 1 -- 172.21.15.59:0/922366588 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6030017070 con 0x7f604009aa40 2024-05-30T17:01:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f603cc00640 1 -- 172.21.15.59:0/922366588 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f603000c940 con 0x7f604009aa40 2024-05-30T17:01:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f6047000640 1 -- 172.21.15.59:0/922366588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6040154a30 con 0x7f604009aa40 2024-05-30T17:01:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f603cc00640 1 -- 172.21.15.59:0/922366588 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603000ccf0 con 0x7f604009aa40 2024-05-30T17:01:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f6047000640 1 -- 172.21.15.59:0/922366588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60401517b0 con 0x7f604009aa40 2024-05-30T17:01:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f6047000640 1 -- 172.21.15.59:0/922366588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6040068a90 con 0x7f604009aa40 2024-05-30T17:01:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f603cc00640 1 -- 172.21.15.59:0/922366588 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f603001a070 con 0x7f604009aa40 2024-05-30T17:01:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f603cc00640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f601c069850 0x7f601c06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:22.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f603cc00640 1 -- 172.21.15.59:0/922366588 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f60300855b0 con 0x7f604009aa40 2024-05-30T17:01:22.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.691+0000 7f6037e00640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f601c069850 0x7f601c06bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:22.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.695+0000 7f6037e00640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f601c069850 0x7f601c06bd10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f60280ad000 tx=0x7f60280a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:22.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.695+0000 7f603cc00640 1 -- 172.21.15.59:0/922366588 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f60300575c0 con 0x7f604009aa40 2024-05-30T17:01:22.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.871+0000 7f6047000640 1 -- 172.21.15.59:0/922366588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60400b3270 con 0x7f604009aa40 2024-05-30T17:01:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.871+0000 7f603cc00640 1 -- 172.21.15.59:0/922366588 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16783 (secure 0 0 0) 0x7f6030056ec0 con 0x7f604009aa40 2024-05-30T17:01:22.874 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:22.874 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":104,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:01:20.114424+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:01:16.196498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-05-30T17:01:17.468393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:01:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.871+0000 7f6047000640 1 -- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f601c069850 msgr2=0x7f601c06bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.875+0000 7f6047000640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f601c069850 0x7f601c06bd10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f60280ad000 tx=0x7f60280a6000 comp rx=0 tx=0).stop 2024-05-30T17:01:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.875+0000 7f6047000640 1 -- 172.21.15.59:0/922366588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009aa40 msgr2=0x7f604014c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.875+0000 7f6047000640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009aa40 0x7f604014c390 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f603000e8a0 tx=0x7f603000eca0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.875+0000 7f6047000640 1 -- 172.21.15.59:0/922366588 shutdown_connections 2024-05-30T17:01:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.875+0000 7f6047000640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f601c069850 0x7f601c06bd10 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.875+0000 7f6047000640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60400b34b0 0x7f6040151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.875+0000 7f6047000640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f604009b360 0x7f60400c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.875+0000 7f6047000640 1 --2- 172.21.15.59:0/922366588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009aa40 0x7f604014c390 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.875+0000 7f6047000640 1 -- 172.21.15.59:0/922366588 >> 172.21.15.59:0/922366588 conn(0x7f60400b3f50 msgr2=0x7f60400cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.875+0000 7f6047000640 1 -- 172.21.15.59:0/922366588 shutdown_connections 2024-05-30T17:01:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:22.875+0000 7f6047000640 1 -- 172.21.15.59:0/922366588 wait complete. 2024-05-30T17:01:22.896 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T17:01:22.896 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:01:23.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73bb000640 1 Processor -- start 2024-05-30T17:01:23.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73bb000640 1 -- start start 2024-05-30T17:01:23.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73bb000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f73b4070680 0x7f73b406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73bb000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73b4070b10 con 0x7f73b409aa40 2024-05-30T17:01:23.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73bb000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73b415a4c0 con 0x7f73b415a0e0 2024-05-30T17:01:23.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73bb000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f73b4070d80 con 0x7f73b4070680 2024-05-30T17:01:23.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73ba600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f73b409aa40 0x7f73b409ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45582/0 (socket says 172.21.15.59:45582) 2024-05-30T17:01:23.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73ba600640 1 -- 172.21.15.59:0/1811452108 learned_addr learned my addr 172.21.15.59:0/1811452108 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:23.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73b9200640 1 --2- 172.21.15.59:0/1811452108 >> v2:172.21.15.107:3300/0 conn(0x7f73b4070680 0x7f73b406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73b3e00640 1 -- 172.21.15.59:0/1811452108 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3918166129 0 0) 0x7f73b4070b10 con 0x7f73b409aa40 2024-05-30T17:01:23.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73b3e00640 1 -- 172.21.15.59:0/1811452108 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f739c003530 con 0x7f73b409aa40 2024-05-30T17:01:23.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73b9200640 1 -- 172.21.15.59:0/1811452108 >> v1:172.21.15.107:6789/0 conn(0x7f73b415a0e0 legacy=0x7f73b415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73b9200640 1 -- 172.21.15.59:0/1811452108 >> v1:172.21.15.59:6789/0 conn(0x7f73b409aa40 legacy=0x7f73b409ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.035+0000 7f73b9200640 1 -- 172.21.15.59:0/1811452108 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b4071060 con 0x7f73b4070680 2024-05-30T17:01:23.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.039+0000 7f73b9200640 1 --2- 172.21.15.59:0/1811452108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b4070680 0x7f73b406ff70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f73a00097c0 tx=0x7f73a001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fe31218a9e6cb0f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:23.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.039+0000 7f73b3e00640 1 -- 172.21.15.59:0/1811452108 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a00b1070 con 0x7f73b4070680 2024-05-30T17:01:23.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.039+0000 7f73b3e00640 1 -- 172.21.15.59:0/1811452108 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a00ac5f0 con 0x7f73b4070680 2024-05-30T17:01:23.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.039+0000 7f73b3e00640 1 -- 172.21.15.59:0/1811452108 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a00ac9c0 con 0x7f73b4070680 2024-05-30T17:01:23.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.039+0000 7f73bb000640 1 -- 172.21.15.59:0/1811452108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b4070680 msgr2=0x7f73b406ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.039+0000 7f73bb000640 1 --2- 172.21.15.59:0/1811452108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b4070680 0x7f73b406ff70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f73a00097c0 tx=0x7f73a001c4a0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.039+0000 7f73bb000640 1 -- 172.21.15.59:0/1811452108 shutdown_connections 2024-05-30T17:01:23.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.039+0000 7f73bb000640 1 --2- 172.21.15.59:0/1811452108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b4070680 0x7f73b406ff70 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.039+0000 7f73bb000640 1 -- 172.21.15.59:0/1811452108 >> 172.21.15.59:0/1811452108 conn(0x7f73b40b3ed0 msgr2=0x7f73b40b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:23.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.039+0000 7f73bb000640 1 -- 172.21.15.59:0/1811452108 shutdown_connections 2024-05-30T17:01:23.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.039+0000 7f73bb000640 1 -- 172.21.15.59:0/1811452108 wait complete. 2024-05-30T17:01:23.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73bb000640 1 Processor -- start 2024-05-30T17:01:23.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73bb000640 1 -- start start 2024-05-30T17:01:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73bb000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b4070680 0x7f73b40b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73bb000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73b409aa40 0x7f73b4158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73bb000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b415a0e0 0x7f73b4158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73bb000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40b0200 con 0x7f73b415a0e0 2024-05-30T17:01:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73bb000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40b0080 con 0x7f73b4070680 2024-05-30T17:01:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73bb000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f73b40b0380 con 0x7f73b409aa40 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73ba600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b415a0e0 0x7f73b4158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73ba600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b415a0e0 0x7f73b4158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37964/0 (socket says 172.21.15.59:37964) 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73ba600640 1 -- 172.21.15.59:0/3918876513 learned_addr learned my addr 172.21.15.59:0/3918876513 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73b9c00640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b4070680 0x7f73b40b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73b9200640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73b409aa40 0x7f73b4158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73ba600640 1 -- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73b409aa40 msgr2=0x7f73b4158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73ba600640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73b409aa40 0x7f73b4158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73ba600640 1 -- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b4070680 msgr2=0x7f73b40b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73ba600640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b4070680 0x7f73b40b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73ba600640 1 -- 172.21.15.59:0/3918876513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b40b5c70 con 0x7f73b415a0e0 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73b9c00640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b4070680 0x7f73b40b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73b9200640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73b409aa40 0x7f73b4158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73ba600640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b415a0e0 0x7f73b4158c70 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00cb40 tx=0x7f73ac00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73b1600640 1 -- 172.21.15.59:0/3918876513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac017070 con 0x7f73b415a0e0 2024-05-30T17:01:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73b1600640 1 -- 172.21.15.59:0/3918876513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac00aca0 con 0x7f73b415a0e0 2024-05-30T17:01:23.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73b1600640 1 -- 172.21.15.59:0/3918876513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac012620 con 0x7f73b415a0e0 2024-05-30T17:01:23.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73bb000640 1 -- 172.21.15.59:0/3918876513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b40b5ee0 con 0x7f73b415a0e0 2024-05-30T17:01:23.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.043+0000 7f73bb000640 1 -- 172.21.15.59:0/3918876513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b40cea30 con 0x7f73b415a0e0 2024-05-30T17:01:23.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.047+0000 7f73bb000640 1 -- 172.21.15.59:0/3918876513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b40691a0 con 0x7f73b415a0e0 2024-05-30T17:01:23.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.047+0000 7f73b1600640 1 -- 172.21.15.59:0/3918876513 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f73ac01a070 con 0x7f73b415a0e0 2024-05-30T17:01:23.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.047+0000 7f73b1600640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7394069880 0x7f739406bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.047+0000 7f73b1600640 1 -- 172.21.15.59:0/3918876513 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f73ac0854d0 con 0x7f73b415a0e0 2024-05-30T17:01:23.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.047+0000 7f73b9c00640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7394069880 0x7f739406bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.047+0000 7f73b9c00640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7394069880 0x7f739406bd40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f73a80016f0 tx=0x7f73a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:23.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.051+0000 7f73b1600640 1 -- 172.21.15.59:0/3918876513 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f73ac0574b0 con 0x7f73b415a0e0 2024-05-30T17:01:23.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.215+0000 7f73bb000640 1 -- 172.21.15.59:0/3918876513 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f73b4075270 con 0x7f7394069880 2024-05-30T17:01:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.223+0000 7f73b1600640 1 -- 172.21.15.59:0/3918876513 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240000 (secure 0 0 0) 0x7f73b4075270 con 0x7f7394069880 2024-05-30T17:01:23.228 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:01:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.227+0000 7f73bb000640 1 -- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7394069880 msgr2=0x7f739406bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.227+0000 7f73bb000640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7394069880 0x7f739406bd40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f73a80016f0 tx=0x7f73a8009040 comp rx=0 tx=0).stop 2024-05-30T17:01:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.227+0000 7f73bb000640 1 -- 172.21.15.59:0/3918876513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b415a0e0 msgr2=0x7f73b4158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.227+0000 7f73bb000640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b415a0e0 0x7f73b4158c70 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00cb40 tx=0x7f73ac00a060 comp rx=0 tx=0).stop 2024-05-30T17:01:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.227+0000 7f73bb000640 1 -- 172.21.15.59:0/3918876513 shutdown_connections 2024-05-30T17:01:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.227+0000 7f73bb000640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7394069880 0x7f739406bd40 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.227+0000 7f73bb000640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b415a0e0 0x7f73b4158c70 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.227+0000 7f73bb000640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73b409aa40 0x7f73b4158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.227+0000 7f73bb000640 1 --2- 172.21.15.59:0/3918876513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b4070680 0x7f73b40b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.227+0000 7f73bb000640 1 -- 172.21.15.59:0/3918876513 >> 172.21.15.59:0/3918876513 conn(0x7f73b40b3ed0 msgr2=0x7f73b406dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:23.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.227+0000 7f73bb000640 1 -- 172.21.15.59:0/3918876513 shutdown_connections 2024-05-30T17:01:23.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.227+0000 7f73bb000640 1 -- 172.21.15.59:0/3918876513 wait complete. 2024-05-30T17:01:23.249 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":472,"stamp":"2024-05-30T17:01:21.332611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":62,"acting":62,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":831728,"kb_used_data":10796,"kb_used_omap":12,"kb_used_meta":820787,"kb_avail":754142992,"statfs":{"total":773094113280,"available":772242423808,"internally_reserved":0,"allocated":11055104,"data_stored":5436547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":840486448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.241371"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.101336+0000","last_change":"2024-05-30T17:01:17.101336+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.101336+0000","last_undegraded":"2024-05-30T17:01:17.101336+0000","last_fullsized":"2024-05-30T17:01:17.101336+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.098924+0000","last_change":"2024-05-30T17:01:17.098924+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.098924+0000","last_undegraded":"2024-05-30T17:01:17.098924+0000","last_fullsized":"2024-05-30T17:01:17.098924+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.101501+0000","last_change":"2024-05-30T17:01:17.101501+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.101501+0000","last_undegraded":"2024-05-30T17:01:17.101501+0000","last_fullsized":"2024-05-30T17:01:17.101501+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.101215+0000","last_change":"2024-05-30T17:01:17.101215+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.101215+0000","last_undegraded":"2024-05-30T17:01:17.101215+0000","last_fullsized":"2024-05-30T17:01:17.101215+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.094010+0000","last_change":"2024-05-30T17:01:17.094010+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.094010+0000","last_undegraded":"2024-05-30T17:01:17.094010+0000","last_fullsized":"2024-05-30T17:01:17.094010+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.100517+0000","last_change":"2024-05-30T17:01:17.100517+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.100517+0000","last_undegraded":"2024-05-30T17:01:17.100517+0000","last_fullsized":"2024-05-30T17:01:17.100517+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.095895+0000","last_change":"2024-05-30T17:01:17.095895+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.095895+0000","last_undegraded":"2024-05-30T17:01:17.095895+0000","last_fullsized":"2024-05-30T17:01:17.095895+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.095407+0000","last_change":"2024-05-30T17:01:17.095407+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.095407+0000","last_undegraded":"2024-05-30T17:01:17.095407+0000","last_fullsized":"2024-05-30T17:01:17.095407+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.093884+0000","last_change":"2024-05-30T17:01:17.093884+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.093884+0000","last_undegraded":"2024-05-30T17:01:17.093884+0000","last_fullsized":"2024-05-30T17:01:17.093884+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:17.085922+0000","last_change":"2024-05-30T17:01:17.085922+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.085922+0000","last_undegraded":"2024-05-30T17:01:17.085922+0000","last_fullsized":"2024-05-30T17:01:17.085922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.098950+0000","last_change":"2024-05-30T17:01:17.098950+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.098950+0000","last_undegraded":"2024-05-30T17:01:17.098950+0000","last_fullsized":"2024-05-30T17:01:17.098950+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.093693+0000","last_change":"2024-05-30T17:01:17.093693+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.093693+0000","last_undegraded":"2024-05-30T17:01:17.093693+0000","last_fullsized":"2024-05-30T17:01:17.093693+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.092161+0000","last_change":"2024-05-30T17:01:17.092161+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.092161+0000","last_undegraded":"2024-05-30T17:01:17.092161+0000","last_fullsized":"2024-05-30T17:01:17.092161+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.092050+0000","last_change":"2024-05-30T17:01:17.092050+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.092050+0000","last_undegraded":"2024-05-30T17:01:17.092050+0000","last_fullsized":"2024-05-30T17:01:17.092050+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.093313+0000","last_change":"2024-05-30T17:01:17.093313+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.093313+0000","last_undegraded":"2024-05-30T17:01:17.093313+0000","last_fullsized":"2024-05-30T17:01:17.093313+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.094073+0000","last_change":"2024-05-30T17:01:17.094073+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.094073+0000","last_undegraded":"2024-05-30T17:01:17.094073+0000","last_fullsized":"2024-05-30T17:01:17.094073+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.093633+0000","last_change":"2024-05-30T17:01:17.093633+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.093633+0000","last_undegraded":"2024-05-30T17:01:17.093633+0000","last_fullsized":"2024-05-30T17:01:17.093633+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.095920+0000","last_change":"2024-05-30T17:01:17.095920+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.095920+0000","last_undegraded":"2024-05-30T17:01:17.095920+0000","last_fullsized":"2024-05-30T17:01:17.095920+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.100242+0000","last_change":"2024-05-30T17:01:17.100242+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.100242+0000","last_undegraded":"2024-05-30T17:01:17.100242+0000","last_fullsized":"2024-05-30T17:01:17.100242+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.100581+0000","last_change":"2024-05-30T17:01:17.100581+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.100581+0000","last_undegraded":"2024-05-30T17:01:17.100581+0000","last_fullsized":"2024-05-30T17:01:17.100581+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.093150+0000","last_change":"2024-05-30T17:01:17.093150+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.093150+0000","last_undegraded":"2024-05-30T17:01:17.093150+0000","last_fullsized":"2024-05-30T17:01:17.093150+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.093150+0000","last_change":"2024-05-30T17:01:17.093150+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.093150+0000","last_undegraded":"2024-05-30T17:01:17.093150+0000","last_fullsized":"2024-05-30T17:01:17.093150+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.100181+0000","last_change":"2024-05-30T17:01:17.100181+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.100181+0000","last_undegraded":"2024-05-30T17:01:17.100181+0000","last_fullsized":"2024-05-30T17:01:17.100181+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.093611+0000","last_change":"2024-05-30T17:01:17.093611+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.093611+0000","last_undegraded":"2024-05-30T17:01:17.093611+0000","last_fullsized":"2024-05-30T17:01:17.093611+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.100346+0000","last_change":"2024-05-30T17:01:17.100346+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.100346+0000","last_undegraded":"2024-05-30T17:01:17.100346+0000","last_fullsized":"2024-05-30T17:01:17.100346+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.100171+0000","last_change":"2024-05-30T17:01:17.100171+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.100171+0000","last_undegraded":"2024-05-30T17:01:17.100171+0000","last_fullsized":"2024-05-30T17:01:17.100171+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.095998+0000","last_change":"2024-05-30T17:01:17.095998+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.095998+0000","last_undegraded":"2024-05-30T17:01:17.095998+0000","last_fullsized":"2024-05-30T17:01:17.095998+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.096693+0000","last_change":"2024-05-30T17:01:17.096693+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.096693+0000","last_undegraded":"2024-05-30T17:01:17.096693+0000","last_fullsized":"2024-05-30T17:01:17.096693+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.095851+0000","last_change":"2024-05-30T17:01:17.095851+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.095851+0000","last_undegraded":"2024-05-30T17:01:17.095851+0000","last_fullsized":"2024-05-30T17:01:17.095851+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:17.085922+0000","last_change":"2024-05-30T17:01:17.085922+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.085922+0000","last_undegraded":"2024-05-30T17:01:17.085922+0000","last_fullsized":"2024-05-30T17:01:17.085922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.092007+0000","last_change":"2024-05-30T17:01:17.092007+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.092007+0000","last_undegraded":"2024-05-30T17:01:17.092007+0000","last_fullsized":"2024-05-30T17:01:17.092007+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T17:01:18.088977+0000","last_change":"2024-05-30T17:01:18.088977+0000","last_active":"2024-05-30T17:01:18.088977+0000","last_peered":"2024-05-30T17:01:18.088977+0000","last_clean":"2024-05-30T17:01:18.088977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:18.088977+0000","last_undegraded":"2024-05-30T17:01:18.088977+0000","last_fullsized":"2024-05-30T17:01:18.088977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-05-30T17:01:17.099284+0000","last_change":"2024-05-30T17:01:17.099284+0000","last_active":"2024-05-30T17:01:17.085922+0000","last_peered":"2024-05-30T17:01:17.085922+0000","last_clean":"2024-05-30T17:01:17.085922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:01:17.099284+0000","last_undegraded":"2024-05-30T17:01:17.099284+0000","last_fullsized":"2024-05-30T17:01:17.099284+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":321,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-30T17:01:17.099764+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:01:17.099764+0000","last_peered":"2024-05-30T17:01:17.099764+0000","last_clean":"2024-05-30T17:01:17.099764+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:01:17.099764+0000","last_undegraded":"2024-05-30T17:01:17.099764+0000","last_fullsized":"2024-05-30T17:01:17.099764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509591,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123148,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248692,"statfs":{"total":96636764160,"available":96510660608,"internally_reserved":0,"allocated":1835008,"data_stored":1126050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122568,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249272,"statfs":{"total":96636764160,"available":96511254528,"internally_reserved":0,"allocated":1241088,"data_stored":535682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72584,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299256,"statfs":{"total":96636764160,"available":96562438144,"internally_reserved":0,"allocated":1228800,"data_stored":529753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64264,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94307576,"statfs":{"total":96636764160,"available":96570957824,"internally_reserved":0,"allocated":1228800,"data_stored":529753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140616,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231224,"statfs":{"total":96636764160,"available":96492773376,"internally_reserved":0,"allocated":1241088,"data_stored":535682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104508,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267332,"statfs":{"total":96636764160,"available":96529747968,"internally_reserved":0,"allocated":1228800,"data_stored":529753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509592,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81480,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94290360,"statfs":{"total":96636764160,"available":96553328640,"internally_reserved":0,"allocated":1822720,"data_stored":1120121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81590725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542296,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122560,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249280,"statfs":{"total":96636764160,"available":96511262720,"internally_reserved":0,"allocated":1228800,"data_stored":529753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:01:23.254 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:01:23.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56e3e00640 1 Processor -- start 2024-05-30T17:01:23.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56e3e00640 1 -- start start 2024-05-30T17:01:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56e3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56dc09b150 0x7f56dc0cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56e3e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56dc0d1310 con 0x7f56dc160d90 2024-05-30T17:01:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56e3e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56dc09bcf0 con 0x7f56dc09b780 2024-05-30T17:01:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56e3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f56dc0d0a70 con 0x7f56dc09b150 2024-05-30T17:01:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56e1400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f56dc160d90 0x7f56dc09aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45584/0 (socket says 172.21.15.59:45584) 2024-05-30T17:01:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56e1400640 1 -- 172.21.15.59:0/2781987763 learned_addr learned my addr 172.21.15.59:0/2781987763 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56e0a00640 1 --2- 172.21.15.59:0/2781987763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56dc09b150 0x7f56dc0cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56dbe00640 1 -- 172.21.15.59:0/2781987763 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173574239 0 0) 0x7f56dc0d1310 con 0x7f56dc160d90 2024-05-30T17:01:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56dbe00640 1 -- 172.21.15.59:0/2781987763 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56c4003530 con 0x7f56dc160d90 2024-05-30T17:01:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56dbe00640 1 -- 172.21.15.59:0/2781987763 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686816775 0 0) 0x7f56dc09bcf0 con 0x7f56dc09b780 2024-05-30T17:01:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56dbe00640 1 -- 172.21.15.59:0/2781987763 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56dc0d1310 con 0x7f56dc09b780 2024-05-30T17:01:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56dbe00640 1 -- 172.21.15.59:0/2781987763 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3886580218 0 0) 0x7f56c4003530 con 0x7f56dc160d90 2024-05-30T17:01:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56e0a00640 1 -- 172.21.15.59:0/2781987763 >> v1:172.21.15.107:6789/0 conn(0x7f56dc09b780 legacy=0x7f56dc0ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56e0a00640 1 -- 172.21.15.59:0/2781987763 >> v1:172.21.15.59:6789/0 conn(0x7f56dc160d90 legacy=0x7f56dc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.431+0000 7f56e0a00640 1 -- 172.21.15.59:0/2781987763 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56dc0d0d50 con 0x7f56dc09b150 2024-05-30T17:01:23.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.435+0000 7f56e0a00640 1 --2- 172.21.15.59:0/2781987763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56dc09b150 0x7f56dc0cdd20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f56c80097f0 tx=0x7f56c801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2854ef4a1f00b60f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.435+0000 7f56dbe00640 1 -- 172.21.15.59:0/2781987763 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c80b0070 con 0x7f56dc09b150 2024-05-30T17:01:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.435+0000 7f56dbe00640 1 -- 172.21.15.59:0/2781987763 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c80ab400 con 0x7f56dc09b150 2024-05-30T17:01:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.435+0000 7f56dbe00640 1 -- 172.21.15.59:0/2781987763 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0001680 con 0x7f56dc09b150 2024-05-30T17:01:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.435+0000 7f56e3e00640 1 -- 172.21.15.59:0/2781987763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56dc09b150 msgr2=0x7f56dc0cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.435+0000 7f56e3e00640 1 --2- 172.21.15.59:0/2781987763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56dc09b150 0x7f56dc0cdd20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f56c80097f0 tx=0x7f56c801c370 comp rx=0 tx=0).stop 2024-05-30T17:01:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.435+0000 7f56e3e00640 1 -- 172.21.15.59:0/2781987763 shutdown_connections 2024-05-30T17:01:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.435+0000 7f56e3e00640 1 --2- 172.21.15.59:0/2781987763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56dc09b150 0x7f56dc0cdd20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.435+0000 7f56e3e00640 1 -- 172.21.15.59:0/2781987763 >> 172.21.15.59:0/2781987763 conn(0x7f56dc0b3f80 msgr2=0x7f56dc0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.435+0000 7f56e3e00640 1 -- 172.21.15.59:0/2781987763 shutdown_connections 2024-05-30T17:01:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.435+0000 7f56e3e00640 1 -- 172.21.15.59:0/2781987763 wait complete. 2024-05-30T17:01:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e3e00640 1 Processor -- start 2024-05-30T17:01:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e3e00640 1 -- start start 2024-05-30T17:01:23.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56dc09b150 0x7f56dc0b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56dc09b780 0x7f56dc156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc160d90 0x7f56dc1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e3e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc1612f0 con 0x7f56dc160d90 2024-05-30T17:01:23.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e3e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc161170 con 0x7f56dc09b150 2024-05-30T17:01:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f56dc16af90 con 0x7f56dc09b780 2024-05-30T17:01:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc160d90 0x7f56dc1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc160d90 0x7f56dc1567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37968/0 (socket says 172.21.15.59:37968) 2024-05-30T17:01:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e1e00640 1 -- 172.21.15.59:0/1439189659 learned_addr learned my addr 172.21.15.59:0/1439189659 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e1400640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56dc09b150 0x7f56dc0b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e0a00640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56dc09b780 0x7f56dc156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e1e00640 1 -- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56dc09b780 msgr2=0x7f56dc156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e1e00640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56dc09b780 0x7f56dc156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e1e00640 1 -- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56dc09b150 msgr2=0x7f56dc0b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e1e00640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56dc09b150 0x7f56dc0b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e1e00640 1 -- 172.21.15.59:0/1439189659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56dc158230 con 0x7f56dc160d90 2024-05-30T17:01:23.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e1e00640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc160d90 0x7f56dc1567d0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f56d400c790 tx=0x7f56d400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:23.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56d9600640 1 -- 172.21.15.59:0/1439189659 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4003b80 con 0x7f56dc160d90 2024-05-30T17:01:23.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56d9600640 1 -- 172.21.15.59:0/1439189659 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d4003d20 con 0x7f56dc160d90 2024-05-30T17:01:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56d9600640 1 -- 172.21.15.59:0/1439189659 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d400aa50 con 0x7f56dc160d90 2024-05-30T17:01:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e3e00640 1 -- 172.21.15.59:0/1439189659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56dc158510 con 0x7f56dc160d90 2024-05-30T17:01:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.439+0000 7f56e3e00640 1 -- 172.21.15.59:0/1439189659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56dc158ad0 con 0x7f56dc160d90 2024-05-30T17:01:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.443+0000 7f56e3e00640 1 -- 172.21.15.59:0/1439189659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56dc068a90 con 0x7f56dc160d90 2024-05-30T17:01:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.443+0000 7f56d9600640 1 -- 172.21.15.59:0/1439189659 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f56d400abf0 con 0x7f56dc160d90 2024-05-30T17:01:23.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.443+0000 7f56d9600640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f56bc069850 0x7f56bc06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.443+0000 7f56d9600640 1 -- 172.21.15.59:0/1439189659 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f56d40858f0 con 0x7f56dc160d90 2024-05-30T17:01:23.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.443+0000 7f56e1400640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f56bc069850 0x7f56bc06bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.443+0000 7f56e1400640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f56bc069850 0x7f56bc06bd10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f56d00011f0 tx=0x7f56d00016a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.447+0000 7f56d9600640 1 -- 172.21.15.59:0/1439189659 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f56d4056ed0 con 0x7f56dc160d90 2024-05-30T17:01:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.611+0000 7f56e3e00640 1 -- 172.21.15.59:0/1439189659 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56dc15fe80 con 0x7f56bc069850 2024-05-30T17:01:23.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.615+0000 7f56d9600640 1 -- 172.21.15.59:0/1439189659 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252501 (secure 0 0 0) 0x7f56dc15fe80 con 0x7f56bc069850 2024-05-30T17:01:23.624 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:23.625 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:01:23.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.619+0000 7f56e3e00640 1 -- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f56bc069850 msgr2=0x7f56bc06bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.619+0000 7f56e3e00640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f56bc069850 0x7f56bc06bd10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f56d00011f0 tx=0x7f56d00016a0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.619+0000 7f56e3e00640 1 -- 172.21.15.59:0/1439189659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc160d90 msgr2=0x7f56dc1567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.619+0000 7f56e3e00640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc160d90 0x7f56dc1567d0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f56d400c790 tx=0x7f56d400cc50 comp rx=0 tx=0).stop 2024-05-30T17:01:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.619+0000 7f56e3e00640 1 -- 172.21.15.59:0/1439189659 shutdown_connections 2024-05-30T17:01:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.619+0000 7f56e3e00640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f56bc069850 0x7f56bc06bd10 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.619+0000 7f56e3e00640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc160d90 0x7f56dc1567d0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.619+0000 7f56e3e00640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56dc09b780 0x7f56dc156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.619+0000 7f56e3e00640 1 --2- 172.21.15.59:0/1439189659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56dc09b150 0x7f56dc0b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.619+0000 7f56e3e00640 1 -- 172.21.15.59:0/1439189659 >> 172.21.15.59:0/1439189659 conn(0x7f56dc0b3f80 msgr2=0x7f56dc15e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.619+0000 7f56e3e00640 1 -- 172.21.15.59:0/1439189659 shutdown_connections 2024-05-30T17:01:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.619+0000 7f56e3e00640 1 -- 172.21.15.59:0/1439189659 wait complete. 2024-05-30T17:01:23.643 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":473,"stamp":"2024-05-30T17:01:23.333196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":832108,"kb_used_data":11196,"kb_used_omap":12,"kb_used_meta":820787,"kb_avail":754142612,"statfs":{"total":773094113280,"available":772242034688,"internally_reserved":0,"allocated":11464704,"data_stored":5622088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":840486448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001646"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.253447+0000","last_change":"2024-05-30T17:01:19.116125+0000","last_active":"2024-05-30T17:01:20.253447+0000","last_peered":"2024-05-30T17:01:20.253447+0000","last_clean":"2024-05-30T17:01:20.253447+0000","last_became_active":"2024-05-30T17:01:19.115849+0000","last_became_peered":"2024-05-30T17:01:19.115849+0000","last_unstale":"2024-05-30T17:01:20.253447+0000","last_undegraded":"2024-05-30T17:01:20.253447+0000","last_fullsized":"2024-05-30T17:01:20.253447+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:02.436737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122425+0000","last_change":"2024-05-30T17:01:19.114000+0000","last_active":"2024-05-30T17:01:20.122425+0000","last_peered":"2024-05-30T17:01:20.122425+0000","last_clean":"2024-05-30T17:01:20.122425+0000","last_became_active":"2024-05-30T17:01:19.112048+0000","last_became_peered":"2024-05-30T17:01:19.112048+0000","last_unstale":"2024-05-30T17:01:20.122425+0000","last_undegraded":"2024-05-30T17:01:20.122425+0000","last_fullsized":"2024-05-30T17:01:20.122425+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:30:30.988053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.253300+0000","last_change":"2024-05-30T17:01:19.119688+0000","last_active":"2024-05-30T17:01:20.253300+0000","last_peered":"2024-05-30T17:01:20.253300+0000","last_clean":"2024-05-30T17:01:20.253300+0000","last_became_active":"2024-05-30T17:01:19.119436+0000","last_became_peered":"2024-05-30T17:01:19.119436+0000","last_unstale":"2024-05-30T17:01:20.253300+0000","last_undegraded":"2024-05-30T17:01:20.253300+0000","last_fullsized":"2024-05-30T17:01:20.253300+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:41:37.693546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.054759+0000","last_change":"2024-05-30T17:01:19.141118+0000","last_active":"2024-05-30T17:01:21.054759+0000","last_peered":"2024-05-30T17:01:21.054759+0000","last_clean":"2024-05-30T17:01:21.054759+0000","last_became_active":"2024-05-30T17:01:19.140843+0000","last_became_peered":"2024-05-30T17:01:19.140843+0000","last_unstale":"2024-05-30T17:01:21.054759+0000","last_undegraded":"2024-05-30T17:01:21.054759+0000","last_fullsized":"2024-05-30T17:01:21.054759+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:30.814554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057055+0000","last_change":"2024-05-30T17:01:19.132982+0000","last_active":"2024-05-30T17:01:21.057055+0000","last_peered":"2024-05-30T17:01:21.057055+0000","last_clean":"2024-05-30T17:01:21.057055+0000","last_became_active":"2024-05-30T17:01:19.132676+0000","last_became_peered":"2024-05-30T17:01:19.132676+0000","last_unstale":"2024-05-30T17:01:21.057055+0000","last_undegraded":"2024-05-30T17:01:21.057055+0000","last_fullsized":"2024-05-30T17:01:21.057055+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:44:48.754937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.056609+0000","last_change":"2024-05-30T17:01:19.118044+0000","last_active":"2024-05-30T17:01:21.056609+0000","last_peered":"2024-05-30T17:01:21.056609+0000","last_clean":"2024-05-30T17:01:21.056609+0000","last_became_active":"2024-05-30T17:01:19.117734+0000","last_became_peered":"2024-05-30T17:01:19.117734+0000","last_unstale":"2024-05-30T17:01:21.056609+0000","last_undegraded":"2024-05-30T17:01:21.056609+0000","last_fullsized":"2024-05-30T17:01:21.056609+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:21:11.898525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.056516+0000","last_change":"2024-05-30T17:01:19.118366+0000","last_active":"2024-05-30T17:01:21.056516+0000","last_peered":"2024-05-30T17:01:21.056516+0000","last_clean":"2024-05-30T17:01:21.056516+0000","last_became_active":"2024-05-30T17:01:19.118052+0000","last_became_peered":"2024-05-30T17:01:19.118052+0000","last_unstale":"2024-05-30T17:01:21.056516+0000","last_undegraded":"2024-05-30T17:01:21.056516+0000","last_fullsized":"2024-05-30T17:01:21.056516+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:13:38.256719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122605+0000","last_change":"2024-05-30T17:01:19.115521+0000","last_active":"2024-05-30T17:01:20.122605+0000","last_peered":"2024-05-30T17:01:20.122605+0000","last_clean":"2024-05-30T17:01:20.122605+0000","last_became_active":"2024-05-30T17:01:19.115197+0000","last_became_peered":"2024-05-30T17:01:19.115197+0000","last_unstale":"2024-05-30T17:01:20.122605+0000","last_undegraded":"2024-05-30T17:01:20.122605+0000","last_fullsized":"2024-05-30T17:01:20.122605+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:37:12.086635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.126968+0000","last_change":"2024-05-30T17:01:19.137734+0000","last_active":"2024-05-30T17:01:20.126968+0000","last_peered":"2024-05-30T17:01:20.126968+0000","last_clean":"2024-05-30T17:01:20.126968+0000","last_became_active":"2024-05-30T17:01:19.137341+0000","last_became_peered":"2024-05-30T17:01:19.137341+0000","last_unstale":"2024-05-30T17:01:20.126968+0000","last_undegraded":"2024-05-30T17:01:20.126968+0000","last_fullsized":"2024-05-30T17:01:20.126968+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:44:48.754937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.056717+0000","last_change":"2024-05-30T17:01:19.131822+0000","last_active":"2024-05-30T17:01:21.056717+0000","last_peered":"2024-05-30T17:01:21.056717+0000","last_clean":"2024-05-30T17:01:21.056717+0000","last_became_active":"2024-05-30T17:01:19.131530+0000","last_became_peered":"2024-05-30T17:01:19.131530+0000","last_unstale":"2024-05-30T17:01:21.056717+0000","last_undegraded":"2024-05-30T17:01:21.056717+0000","last_fullsized":"2024-05-30T17:01:21.056717+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:34:54.517608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057355+0000","last_change":"2024-05-30T17:01:19.121576+0000","last_active":"2024-05-30T17:01:21.057355+0000","last_peered":"2024-05-30T17:01:21.057355+0000","last_clean":"2024-05-30T17:01:21.057355+0000","last_became_active":"2024-05-30T17:01:19.121248+0000","last_became_peered":"2024-05-30T17:01:19.121248+0000","last_unstale":"2024-05-30T17:01:21.057355+0000","last_undegraded":"2024-05-30T17:01:21.057355+0000","last_fullsized":"2024-05-30T17:01:21.057355+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:37:12.086635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.126744+0000","last_change":"2024-05-30T17:01:19.116071+0000","last_active":"2024-05-30T17:01:20.126744+0000","last_peered":"2024-05-30T17:01:20.126744+0000","last_clean":"2024-05-30T17:01:20.126744+0000","last_became_active":"2024-05-30T17:01:19.115666+0000","last_became_peered":"2024-05-30T17:01:19.115666+0000","last_unstale":"2024-05-30T17:01:20.126744+0000","last_undegraded":"2024-05-30T17:01:20.126744+0000","last_fullsized":"2024-05-30T17:01:20.126744+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:53.648650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.054526+0000","last_change":"2024-05-30T17:01:19.135172+0000","last_active":"2024-05-30T17:01:21.054526+0000","last_peered":"2024-05-30T17:01:21.054526+0000","last_clean":"2024-05-30T17:01:21.054526+0000","last_became_active":"2024-05-30T17:01:19.134887+0000","last_became_peered":"2024-05-30T17:01:19.134887+0000","last_unstale":"2024-05-30T17:01:21.054526+0000","last_undegraded":"2024-05-30T17:01:21.054526+0000","last_fullsized":"2024-05-30T17:01:21.054526+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:16:50.227105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.553038+0000","last_change":"2024-05-30T17:01:19.121522+0000","last_active":"2024-05-30T17:01:20.553038+0000","last_peered":"2024-05-30T17:01:20.553038+0000","last_clean":"2024-05-30T17:01:20.553038+0000","last_became_active":"2024-05-30T17:01:19.121211+0000","last_became_peered":"2024-05-30T17:01:19.121211+0000","last_unstale":"2024-05-30T17:01:20.553038+0000","last_undegraded":"2024-05-30T17:01:20.553038+0000","last_fullsized":"2024-05-30T17:01:20.553038+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:10.642997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.054234+0000","last_change":"2024-05-30T17:01:19.133527+0000","last_active":"2024-05-30T17:01:21.054234+0000","last_peered":"2024-05-30T17:01:21.054234+0000","last_clean":"2024-05-30T17:01:21.054234+0000","last_became_active":"2024-05-30T17:01:19.132968+0000","last_became_peered":"2024-05-30T17:01:19.132968+0000","last_unstale":"2024-05-30T17:01:21.054234+0000","last_undegraded":"2024-05-30T17:01:21.054234+0000","last_fullsized":"2024-05-30T17:01:21.054234+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:15:56.616905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.056574+0000","last_change":"2024-05-30T17:01:19.126107+0000","last_active":"2024-05-30T17:01:21.056574+0000","last_peered":"2024-05-30T17:01:21.056574+0000","last_clean":"2024-05-30T17:01:21.056574+0000","last_became_active":"2024-05-30T17:01:19.124032+0000","last_became_peered":"2024-05-30T17:01:19.124032+0000","last_unstale":"2024-05-30T17:01:21.056574+0000","last_undegraded":"2024-05-30T17:01:21.056574+0000","last_fullsized":"2024-05-30T17:01:21.056574+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:30:30.988053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122504+0000","last_change":"2024-05-30T17:01:19.132710+0000","last_active":"2024-05-30T17:01:20.122504+0000","last_peered":"2024-05-30T17:01:20.122504+0000","last_clean":"2024-05-30T17:01:20.122504+0000","last_became_active":"2024-05-30T17:01:19.132449+0000","last_became_peered":"2024-05-30T17:01:19.132449+0000","last_unstale":"2024-05-30T17:01:20.122504+0000","last_undegraded":"2024-05-30T17:01:20.122504+0000","last_fullsized":"2024-05-30T17:01:20.122504+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:42:23.454723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.054764+0000","last_change":"2024-05-30T17:01:19.135782+0000","last_active":"2024-05-30T17:01:21.054764+0000","last_peered":"2024-05-30T17:01:21.054764+0000","last_clean":"2024-05-30T17:01:21.054764+0000","last_became_active":"2024-05-30T17:01:19.135522+0000","last_became_peered":"2024-05-30T17:01:19.135522+0000","last_unstale":"2024-05-30T17:01:21.054764+0000","last_undegraded":"2024-05-30T17:01:21.054764+0000","last_fullsized":"2024-05-30T17:01:21.054764+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:33:13.749996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.553447+0000","last_change":"2024-05-30T17:01:19.127956+0000","last_active":"2024-05-30T17:01:20.553447+0000","last_peered":"2024-05-30T17:01:20.553447+0000","last_clean":"2024-05-30T17:01:20.553447+0000","last_became_active":"2024-05-30T17:01:19.116691+0000","last_became_peered":"2024-05-30T17:01:19.116691+0000","last_unstale":"2024-05-30T17:01:20.553447+0000","last_undegraded":"2024-05-30T17:01:20.553447+0000","last_fullsized":"2024-05-30T17:01:20.553447+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:27:49.223496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.126798+0000","last_change":"2024-05-30T17:01:19.137721+0000","last_active":"2024-05-30T17:01:20.126798+0000","last_peered":"2024-05-30T17:01:20.126798+0000","last_clean":"2024-05-30T17:01:20.126798+0000","last_became_active":"2024-05-30T17:01:19.137237+0000","last_became_peered":"2024-05-30T17:01:19.137237+0000","last_unstale":"2024-05-30T17:01:20.126798+0000","last_undegraded":"2024-05-30T17:01:20.126798+0000","last_fullsized":"2024-05-30T17:01:20.126798+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:03:53.111103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.553316+0000","last_change":"2024-05-30T17:01:19.122196+0000","last_active":"2024-05-30T17:01:20.553316+0000","last_peered":"2024-05-30T17:01:20.553316+0000","last_clean":"2024-05-30T17:01:20.553316+0000","last_became_active":"2024-05-30T17:01:19.115427+0000","last_became_peered":"2024-05-30T17:01:19.115427+0000","last_unstale":"2024-05-30T17:01:20.553316+0000","last_undegraded":"2024-05-30T17:01:20.553316+0000","last_fullsized":"2024-05-30T17:01:20.553316+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:24:33.729267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122327+0000","last_change":"2024-05-30T17:01:19.111708+0000","last_active":"2024-05-30T17:01:20.122327+0000","last_peered":"2024-05-30T17:01:20.122327+0000","last_clean":"2024-05-30T17:01:20.122327+0000","last_became_active":"2024-05-30T17:01:19.111056+0000","last_became_peered":"2024-05-30T17:01:19.111056+0000","last_unstale":"2024-05-30T17:01:20.122327+0000","last_undegraded":"2024-05-30T17:01:20.122327+0000","last_fullsized":"2024-05-30T17:01:20.122327+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:36:04.066299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122325+0000","last_change":"2024-05-30T17:01:19.111678+0000","last_active":"2024-05-30T17:01:20.122325+0000","last_peered":"2024-05-30T17:01:20.122325+0000","last_clean":"2024-05-30T17:01:20.122325+0000","last_became_active":"2024-05-30T17:01:19.110757+0000","last_became_peered":"2024-05-30T17:01:19.110757+0000","last_unstale":"2024-05-30T17:01:20.122325+0000","last_undegraded":"2024-05-30T17:01:20.122325+0000","last_fullsized":"2024-05-30T17:01:20.122325+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:44:48.754937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.056788+0000","last_change":"2024-05-30T17:01:19.115501+0000","last_active":"2024-05-30T17:01:21.056788+0000","last_peered":"2024-05-30T17:01:21.056788+0000","last_clean":"2024-05-30T17:01:21.056788+0000","last_became_active":"2024-05-30T17:01:19.115204+0000","last_became_peered":"2024-05-30T17:01:19.115204+0000","last_unstale":"2024-05-30T17:01:21.056788+0000","last_undegraded":"2024-05-30T17:01:21.056788+0000","last_fullsized":"2024-05-30T17:01:21.056788+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:42:23.454723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057250+0000","last_change":"2024-05-30T17:01:19.131959+0000","last_active":"2024-05-30T17:01:21.057250+0000","last_peered":"2024-05-30T17:01:21.057250+0000","last_clean":"2024-05-30T17:01:21.057250+0000","last_became_active":"2024-05-30T17:01:19.131542+0000","last_became_peered":"2024-05-30T17:01:19.131542+0000","last_unstale":"2024-05-30T17:01:21.057250+0000","last_undegraded":"2024-05-30T17:01:21.057250+0000","last_fullsized":"2024-05-30T17:01:21.057250+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:30:30.988053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122484+0000","last_change":"2024-05-30T17:01:19.116146+0000","last_active":"2024-05-30T17:01:20.122484+0000","last_peered":"2024-05-30T17:01:20.122484+0000","last_clean":"2024-05-30T17:01:20.122484+0000","last_became_active":"2024-05-30T17:01:19.111625+0000","last_became_peered":"2024-05-30T17:01:19.111625+0000","last_unstale":"2024-05-30T17:01:20.122484+0000","last_undegraded":"2024-05-30T17:01:20.122484+0000","last_fullsized":"2024-05-30T17:01:20.122484+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:21:11.898525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057516+0000","last_change":"2024-05-30T17:01:19.130830+0000","last_active":"2024-05-30T17:01:21.057516+0000","last_peered":"2024-05-30T17:01:21.057516+0000","last_clean":"2024-05-30T17:01:21.057516+0000","last_became_active":"2024-05-30T17:01:19.130523+0000","last_became_peered":"2024-05-30T17:01:19.130523+0000","last_unstale":"2024-05-30T17:01:21.057516+0000","last_undegraded":"2024-05-30T17:01:21.057516+0000","last_fullsized":"2024-05-30T17:01:21.057516+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:28:51.497638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.056815+0000","last_change":"2024-05-30T17:01:19.134671+0000","last_active":"2024-05-30T17:01:21.056815+0000","last_peered":"2024-05-30T17:01:21.056815+0000","last_clean":"2024-05-30T17:01:21.056815+0000","last_became_active":"2024-05-30T17:01:19.134373+0000","last_became_peered":"2024-05-30T17:01:19.134373+0000","last_unstale":"2024-05-30T17:01:21.056815+0000","last_undegraded":"2024-05-30T17:01:21.056815+0000","last_fullsized":"2024-05-30T17:01:21.056815+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:53.648650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122411+0000","last_change":"2024-05-30T17:01:19.115880+0000","last_active":"2024-05-30T17:01:20.122411+0000","last_peered":"2024-05-30T17:01:20.122411+0000","last_clean":"2024-05-30T17:01:20.122411+0000","last_became_active":"2024-05-30T17:01:19.112413+0000","last_became_peered":"2024-05-30T17:01:19.112413+0000","last_unstale":"2024-05-30T17:01:20.122411+0000","last_undegraded":"2024-05-30T17:01:20.122411+0000","last_fullsized":"2024-05-30T17:01:20.122411+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:13:38.256719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.553031+0000","last_change":"2024-05-30T17:01:19.119731+0000","last_active":"2024-05-30T17:01:20.553031+0000","last_peered":"2024-05-30T17:01:20.553031+0000","last_clean":"2024-05-30T17:01:20.553031+0000","last_became_active":"2024-05-30T17:01:19.113573+0000","last_became_peered":"2024-05-30T17:01:19.113573+0000","last_unstale":"2024-05-30T17:01:20.553031+0000","last_undegraded":"2024-05-30T17:01:20.553031+0000","last_fullsized":"2024-05-30T17:01:20.553031+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:40:58.132241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.054376+0000","last_change":"2024-05-30T17:01:19.133306+0000","last_active":"2024-05-30T17:01:21.054376+0000","last_peered":"2024-05-30T17:01:21.054376+0000","last_clean":"2024-05-30T17:01:21.054376+0000","last_became_active":"2024-05-30T17:01:19.131411+0000","last_became_peered":"2024-05-30T17:01:19.131411+0000","last_unstale":"2024-05-30T17:01:21.054376+0000","last_undegraded":"2024-05-30T17:01:21.054376+0000","last_fullsized":"2024-05-30T17:01:21.054376+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:04:10.295741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.253051+0000","last_change":"2024-05-30T17:01:19.120648+0000","last_active":"2024-05-30T17:01:20.253051+0000","last_peered":"2024-05-30T17:01:20.253051+0000","last_clean":"2024-05-30T17:01:20.253051+0000","last_became_active":"2024-05-30T17:01:19.119202+0000","last_became_peered":"2024-05-30T17:01:19.119202+0000","last_unstale":"2024-05-30T17:01:20.253051+0000","last_undegraded":"2024-05-30T17:01:20.253051+0000","last_fullsized":"2024-05-30T17:01:20.253051+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:12.789195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.553567+0000","last_change":"2024-05-30T17:01:19.117950+0000","last_active":"2024-05-30T17:01:20.553567+0000","last_peered":"2024-05-30T17:01:20.553567+0000","last_clean":"2024-05-30T17:01:20.553567+0000","last_became_active":"2024-05-30T17:01:19.117676+0000","last_became_peered":"2024-05-30T17:01:19.117676+0000","last_unstale":"2024-05-30T17:01:20.553567+0000","last_undegraded":"2024-05-30T17:01:20.553567+0000","last_fullsized":"2024-05-30T17:01:20.553567+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:52:41.715026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"103'4","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122555+0000","last_change":"2024-05-30T17:01:18.117520+0000","last_active":"2024-05-30T17:01:20.122555+0000","last_peered":"2024-05-30T17:01:20.122555+0000","last_clean":"2024-05-30T17:01:20.122555+0000","last_became_active":"2024-05-30T17:01:18.117197+0000","last_became_peered":"2024-05-30T17:01:18.117197+0000","last_unstale":"2024-05-30T17:01:20.122555+0000","last_undegraded":"2024-05-30T17:01:20.122555+0000","last_fullsized":"2024-05-30T17:01:20.122555+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:29.020129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.054907+0000","last_change":"2024-05-30T17:01:19.130951+0000","last_active":"2024-05-30T17:01:21.054907+0000","last_peered":"2024-05-30T17:01:21.054907+0000","last_clean":"2024-05-30T17:01:21.054907+0000","last_became_active":"2024-05-30T17:01:19.130629+0000","last_became_peered":"2024-05-30T17:01:19.130629+0000","last_unstale":"2024-05-30T17:01:21.054907+0000","last_undegraded":"2024-05-30T17:01:21.054907+0000","last_fullsized":"2024-05-30T17:01:21.054907+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:01:03.182005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057424+0000","last_change":"2024-05-30T17:01:18.113109+0000","last_active":"2024-05-30T17:01:21.057424+0000","last_peered":"2024-05-30T17:01:21.057424+0000","last_clean":"2024-05-30T17:01:21.057424+0000","last_became_active":"2024-05-30T17:01:18.112794+0000","last_became_peered":"2024-05-30T17:01:18.112794+0000","last_unstale":"2024-05-30T17:01:21.057424+0000","last_undegraded":"2024-05-30T17:01:21.057424+0000","last_fullsized":"2024-05-30T17:01:21.057424+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:19:38.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.253249+0000","last_change":"2024-05-30T17:01:19.116939+0000","last_active":"2024-05-30T17:01:20.253249+0000","last_peered":"2024-05-30T17:01:20.253249+0000","last_clean":"2024-05-30T17:01:20.253249+0000","last_became_active":"2024-05-30T17:01:19.116643+0000","last_became_peered":"2024-05-30T17:01:19.116643+0000","last_unstale":"2024-05-30T17:01:20.253249+0000","last_undegraded":"2024-05-30T17:01:20.253249+0000","last_fullsized":"2024-05-30T17:01:20.253249+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:27:49.223496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122790+0000","last_change":"2024-05-30T17:01:18.119103+0000","last_active":"2024-05-30T17:01:20.122790+0000","last_peered":"2024-05-30T17:01:20.122790+0000","last_clean":"2024-05-30T17:01:20.122790+0000","last_became_active":"2024-05-30T17:01:18.118807+0000","last_became_peered":"2024-05-30T17:01:18.118807+0000","last_unstale":"2024-05-30T17:01:20.122790+0000","last_undegraded":"2024-05-30T17:01:20.122790+0000","last_fullsized":"2024-05-30T17:01:20.122790+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:08:05.394081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.127740+0000","last_change":"2024-05-30T17:01:19.121441+0000","last_active":"2024-05-30T17:01:20.127740+0000","last_peered":"2024-05-30T17:01:20.127740+0000","last_clean":"2024-05-30T17:01:20.127740+0000","last_became_active":"2024-05-30T17:01:19.121177+0000","last_became_peered":"2024-05-30T17:01:19.121177+0000","last_unstale":"2024-05-30T17:01:20.127740+0000","last_undegraded":"2024-05-30T17:01:20.127740+0000","last_fullsized":"2024-05-30T17:01:20.127740+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:36:04.066299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122790+0000","last_change":"2024-05-30T17:01:18.115324+0000","last_active":"2024-05-30T17:01:20.122790+0000","last_peered":"2024-05-30T17:01:20.122790+0000","last_clean":"2024-05-30T17:01:20.122790+0000","last_became_active":"2024-05-30T17:01:18.115053+0000","last_became_peered":"2024-05-30T17:01:18.115053+0000","last_unstale":"2024-05-30T17:01:20.122790+0000","last_undegraded":"2024-05-30T17:01:20.122790+0000","last_fullsized":"2024-05-30T17:01:20.122790+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:59:39.000969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.127483+0000","last_change":"2024-05-30T17:01:19.119025+0000","last_active":"2024-05-30T17:01:20.127483+0000","last_peered":"2024-05-30T17:01:20.127483+0000","last_clean":"2024-05-30T17:01:20.127483+0000","last_became_active":"2024-05-30T17:01:19.118748+0000","last_became_peered":"2024-05-30T17:01:19.118748+0000","last_unstale":"2024-05-30T17:01:20.127483+0000","last_undegraded":"2024-05-30T17:01:20.127483+0000","last_fullsized":"2024-05-30T17:01:20.127483+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:27:26.175156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.253122+0000","last_change":"2024-05-30T17:01:18.117555+0000","last_active":"2024-05-30T17:01:20.253122+0000","last_peered":"2024-05-30T17:01:20.253122+0000","last_clean":"2024-05-30T17:01:20.253122+0000","last_became_active":"2024-05-30T17:01:18.117231+0000","last_became_peered":"2024-05-30T17:01:18.117231+0000","last_unstale":"2024-05-30T17:01:20.253122+0000","last_undegraded":"2024-05-30T17:01:20.253122+0000","last_fullsized":"2024-05-30T17:01:20.253122+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:20:17.138310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.056807+0000","last_change":"2024-05-30T17:01:19.129513+0000","last_active":"2024-05-30T17:01:21.056807+0000","last_peered":"2024-05-30T17:01:21.056807+0000","last_clean":"2024-05-30T17:01:21.056807+0000","last_became_active":"2024-05-30T17:01:19.129212+0000","last_became_peered":"2024-05-30T17:01:19.129212+0000","last_unstale":"2024-05-30T17:01:21.056807+0000","last_undegraded":"2024-05-30T17:01:21.056807+0000","last_fullsized":"2024-05-30T17:01:21.056807+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:41:19.964294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122389+0000","last_change":"2024-05-30T17:01:18.123113+0000","last_active":"2024-05-30T17:01:20.122389+0000","last_peered":"2024-05-30T17:01:20.122389+0000","last_clean":"2024-05-30T17:01:20.122389+0000","last_became_active":"2024-05-30T17:01:18.122597+0000","last_became_peered":"2024-05-30T17:01:18.122597+0000","last_unstale":"2024-05-30T17:01:20.122389+0000","last_undegraded":"2024-05-30T17:01:20.122389+0000","last_fullsized":"2024-05-30T17:01:20.122389+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:49.753791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.054376+0000","last_change":"2024-05-30T17:01:19.129240+0000","last_active":"2024-05-30T17:01:21.054376+0000","last_peered":"2024-05-30T17:01:21.054376+0000","last_clean":"2024-05-30T17:01:21.054376+0000","last_became_active":"2024-05-30T17:01:19.128856+0000","last_became_peered":"2024-05-30T17:01:19.128856+0000","last_unstale":"2024-05-30T17:01:21.054376+0000","last_undegraded":"2024-05-30T17:01:21.054376+0000","last_fullsized":"2024-05-30T17:01:21.054376+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:02:31.921464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057235+0000","last_change":"2024-05-30T17:01:18.122976+0000","last_active":"2024-05-30T17:01:21.057235+0000","last_peered":"2024-05-30T17:01:21.057235+0000","last_clean":"2024-05-30T17:01:21.057235+0000","last_became_active":"2024-05-30T17:01:18.122751+0000","last_became_peered":"2024-05-30T17:01:18.122751+0000","last_unstale":"2024-05-30T17:01:21.057235+0000","last_undegraded":"2024-05-30T17:01:21.057235+0000","last_fullsized":"2024-05-30T17:01:21.057235+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:49.753791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.126766+0000","last_change":"2024-05-30T17:01:19.114901+0000","last_active":"2024-05-30T17:01:20.126766+0000","last_peered":"2024-05-30T17:01:20.126766+0000","last_clean":"2024-05-30T17:01:20.126766+0000","last_became_active":"2024-05-30T17:01:19.114414+0000","last_became_peered":"2024-05-30T17:01:19.114414+0000","last_unstale":"2024-05-30T17:01:20.126766+0000","last_undegraded":"2024-05-30T17:01:20.126766+0000","last_fullsized":"2024-05-30T17:01:20.126766+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:56.288805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.252986+0000","last_change":"2024-05-30T17:01:18.114995+0000","last_active":"2024-05-30T17:01:20.252986+0000","last_peered":"2024-05-30T17:01:20.252986+0000","last_clean":"2024-05-30T17:01:20.252986+0000","last_became_active":"2024-05-30T17:01:18.114717+0000","last_became_peered":"2024-05-30T17:01:18.114717+0000","last_unstale":"2024-05-30T17:01:20.252986+0000","last_undegraded":"2024-05-30T17:01:20.252986+0000","last_fullsized":"2024-05-30T17:01:20.252986+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:12:04.212770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122590+0000","last_change":"2024-05-30T17:01:19.116733+0000","last_active":"2024-05-30T17:01:20.122590+0000","last_peered":"2024-05-30T17:01:20.122590+0000","last_clean":"2024-05-30T17:01:20.122590+0000","last_became_active":"2024-05-30T17:01:19.116457+0000","last_became_peered":"2024-05-30T17:01:19.116457+0000","last_unstale":"2024-05-30T17:01:20.122590+0000","last_undegraded":"2024-05-30T17:01:20.122590+0000","last_fullsized":"2024-05-30T17:01:20.122590+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:41:19.964294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.253440+0000","last_change":"2024-05-30T17:01:18.114803+0000","last_active":"2024-05-30T17:01:20.253440+0000","last_peered":"2024-05-30T17:01:20.253440+0000","last_clean":"2024-05-30T17:01:20.253440+0000","last_became_active":"2024-05-30T17:01:18.110897+0000","last_became_peered":"2024-05-30T17:01:18.110897+0000","last_unstale":"2024-05-30T17:01:20.253440+0000","last_undegraded":"2024-05-30T17:01:20.253440+0000","last_fullsized":"2024-05-30T17:01:20.253440+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:26:23.829007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.126567+0000","last_change":"2024-05-30T17:01:19.120415+0000","last_active":"2024-05-30T17:01:20.126567+0000","last_peered":"2024-05-30T17:01:20.126567+0000","last_clean":"2024-05-30T17:01:20.126567+0000","last_became_active":"2024-05-30T17:01:19.120141+0000","last_became_peered":"2024-05-30T17:01:19.120141+0000","last_unstale":"2024-05-30T17:01:20.126567+0000","last_undegraded":"2024-05-30T17:01:20.126567+0000","last_fullsized":"2024-05-30T17:01:20.126567+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:34:54.517608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.054802+0000","last_change":"2024-05-30T17:01:18.121444+0000","last_active":"2024-05-30T17:01:21.054802+0000","last_peered":"2024-05-30T17:01:21.054802+0000","last_clean":"2024-05-30T17:01:21.054802+0000","last_became_active":"2024-05-30T17:01:18.121073+0000","last_became_peered":"2024-05-30T17:01:18.121073+0000","last_unstale":"2024-05-30T17:01:21.054802+0000","last_undegraded":"2024-05-30T17:01:21.054802+0000","last_fullsized":"2024-05-30T17:01:21.054802+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:26.265952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057013+0000","last_change":"2024-05-30T17:01:19.129261+0000","last_active":"2024-05-30T17:01:21.057013+0000","last_peered":"2024-05-30T17:01:21.057013+0000","last_clean":"2024-05-30T17:01:21.057013+0000","last_became_active":"2024-05-30T17:01:19.128910+0000","last_became_peered":"2024-05-30T17:01:19.128910+0000","last_unstale":"2024-05-30T17:01:21.057013+0000","last_undegraded":"2024-05-30T17:01:21.057013+0000","last_fullsized":"2024-05-30T17:01:21.057013+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:03:53.111103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"103'3","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057690+0000","last_change":"2024-05-30T17:01:18.118375+0000","last_active":"2024-05-30T17:01:21.057690+0000","last_peered":"2024-05-30T17:01:21.057690+0000","last_clean":"2024-05-30T17:01:21.057690+0000","last_became_active":"2024-05-30T17:01:18.118070+0000","last_became_peered":"2024-05-30T17:01:18.118070+0000","last_unstale":"2024-05-30T17:01:21.057690+0000","last_undegraded":"2024-05-30T17:01:21.057690+0000","last_fullsized":"2024-05-30T17:01:21.057690+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:53:13.678001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057628+0000","last_change":"2024-05-30T17:01:19.124769+0000","last_active":"2024-05-30T17:01:21.057628+0000","last_peered":"2024-05-30T17:01:21.057628+0000","last_clean":"2024-05-30T17:01:21.057628+0000","last_became_active":"2024-05-30T17:01:19.124483+0000","last_became_peered":"2024-05-30T17:01:19.124483+0000","last_unstale":"2024-05-30T17:01:21.057628+0000","last_undegraded":"2024-05-30T17:01:21.057628+0000","last_fullsized":"2024-05-30T17:01:21.057628+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:31:49.939206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"103'6","reported_seq":20,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.126812+0000","last_change":"2024-05-30T17:01:18.116907+0000","last_active":"2024-05-30T17:01:20.126812+0000","last_peered":"2024-05-30T17:01:20.126812+0000","last_clean":"2024-05-30T17:01:20.126812+0000","last_became_active":"2024-05-30T17:01:18.116634+0000","last_became_peered":"2024-05-30T17:01:18.116634+0000","last_unstale":"2024-05-30T17:01:20.126812+0000","last_undegraded":"2024-05-30T17:01:20.126812+0000","last_fullsized":"2024-05-30T17:01:20.126812+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:59:39.000969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.054336+0000","last_change":"2024-05-30T17:01:19.129571+0000","last_active":"2024-05-30T17:01:21.054336+0000","last_peered":"2024-05-30T17:01:21.054336+0000","last_clean":"2024-05-30T17:01:21.054336+0000","last_became_active":"2024-05-30T17:01:19.128882+0000","last_became_peered":"2024-05-30T17:01:19.128882+0000","last_unstale":"2024-05-30T17:01:21.054336+0000","last_undegraded":"2024-05-30T17:01:21.054336+0000","last_fullsized":"2024-05-30T17:01:21.054336+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:26:59.331169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.553341+0000","last_change":"2024-05-30T17:01:18.115602+0000","last_active":"2024-05-30T17:01:20.553341+0000","last_peered":"2024-05-30T17:01:20.553341+0000","last_clean":"2024-05-30T17:01:20.553341+0000","last_became_active":"2024-05-30T17:01:18.114570+0000","last_became_peered":"2024-05-30T17:01:18.114570+0000","last_unstale":"2024-05-30T17:01:20.553341+0000","last_undegraded":"2024-05-30T17:01:20.553341+0000","last_fullsized":"2024-05-30T17:01:20.553341+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:34.050159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.253222+0000","last_change":"2024-05-30T17:01:19.117744+0000","last_active":"2024-05-30T17:01:20.253222+0000","last_peered":"2024-05-30T17:01:20.253222+0000","last_clean":"2024-05-30T17:01:20.253222+0000","last_became_active":"2024-05-30T17:01:19.117453+0000","last_became_peered":"2024-05-30T17:01:19.117453+0000","last_unstale":"2024-05-30T17:01:20.253222+0000","last_undegraded":"2024-05-30T17:01:20.253222+0000","last_fullsized":"2024-05-30T17:01:20.253222+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:24:33.729267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.553288+0000","last_change":"2024-05-30T17:01:18.118014+0000","last_active":"2024-05-30T17:01:20.553288+0000","last_peered":"2024-05-30T17:01:20.553288+0000","last_clean":"2024-05-30T17:01:20.553288+0000","last_became_active":"2024-05-30T17:01:18.117732+0000","last_became_peered":"2024-05-30T17:01:18.117732+0000","last_unstale":"2024-05-30T17:01:20.553288+0000","last_undegraded":"2024-05-30T17:01:20.553288+0000","last_fullsized":"2024-05-30T17:01:20.553288+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:33:23.066014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.126227+0000","last_change":"2024-05-30T17:01:19.114766+0000","last_active":"2024-05-30T17:01:20.126227+0000","last_peered":"2024-05-30T17:01:20.126227+0000","last_clean":"2024-05-30T17:01:20.126227+0000","last_became_active":"2024-05-30T17:01:19.114148+0000","last_became_peered":"2024-05-30T17:01:19.114148+0000","last_unstale":"2024-05-30T17:01:20.126227+0000","last_undegraded":"2024-05-30T17:01:20.126227+0000","last_fullsized":"2024-05-30T17:01:20.126227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:27:13.705087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.126184+0000","last_change":"2024-05-30T17:01:18.115966+0000","last_active":"2024-05-30T17:01:20.126184+0000","last_peered":"2024-05-30T17:01:20.126184+0000","last_clean":"2024-05-30T17:01:20.126184+0000","last_became_active":"2024-05-30T17:01:18.115705+0000","last_became_peered":"2024-05-30T17:01:18.115705+0000","last_unstale":"2024-05-30T17:01:20.126184+0000","last_undegraded":"2024-05-30T17:01:20.126184+0000","last_fullsized":"2024-05-30T17:01:20.126184+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:49.753791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.552997+0000","last_change":"2024-05-30T17:01:19.124467+0000","last_active":"2024-05-30T17:01:20.552997+0000","last_peered":"2024-05-30T17:01:20.552997+0000","last_clean":"2024-05-30T17:01:20.552997+0000","last_became_active":"2024-05-30T17:01:19.124170+0000","last_became_peered":"2024-05-30T17:01:19.124170+0000","last_unstale":"2024-05-30T17:01:20.552997+0000","last_undegraded":"2024-05-30T17:01:20.552997+0000","last_fullsized":"2024-05-30T17:01:20.552997+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:37:23.829978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"103'8","reported_seq":22,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.253109+0000","last_change":"2024-05-30T17:01:18.113400+0000","last_active":"2024-05-30T17:01:20.253109+0000","last_peered":"2024-05-30T17:01:20.253109+0000","last_clean":"2024-05-30T17:01:20.253109+0000","last_became_active":"2024-05-30T17:01:18.111962+0000","last_became_peered":"2024-05-30T17:01:18.111962+0000","last_unstale":"2024-05-30T17:01:20.253109+0000","last_undegraded":"2024-05-30T17:01:20.253109+0000","last_fullsized":"2024-05-30T17:01:20.253109+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:56:17.140653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057402+0000","last_change":"2024-05-30T17:01:19.128264+0000","last_active":"2024-05-30T17:01:21.057402+0000","last_peered":"2024-05-30T17:01:21.057402+0000","last_clean":"2024-05-30T17:01:21.057402+0000","last_became_active":"2024-05-30T17:01:19.127957+0000","last_became_peered":"2024-05-30T17:01:19.127957+0000","last_unstale":"2024-05-30T17:01:21.057402+0000","last_undegraded":"2024-05-30T17:01:21.057402+0000","last_fullsized":"2024-05-30T17:01:21.057402+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:21:11.898525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.126462+0000","last_change":"2024-05-30T17:01:18.118208+0000","last_active":"2024-05-30T17:01:20.126462+0000","last_peered":"2024-05-30T17:01:20.126462+0000","last_clean":"2024-05-30T17:01:20.126462+0000","last_became_active":"2024-05-30T17:01:18.117516+0000","last_became_peered":"2024-05-30T17:01:18.117516+0000","last_unstale":"2024-05-30T17:01:20.126462+0000","last_undegraded":"2024-05-30T17:01:20.126462+0000","last_fullsized":"2024-05-30T17:01:20.126462+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:42:34.315091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.127367+0000","last_change":"2024-05-30T17:01:19.124054+0000","last_active":"2024-05-30T17:01:20.127367+0000","last_peered":"2024-05-30T17:01:20.127367+0000","last_clean":"2024-05-30T17:01:20.127367+0000","last_became_active":"2024-05-30T17:01:19.123407+0000","last_became_peered":"2024-05-30T17:01:19.123407+0000","last_unstale":"2024-05-30T17:01:20.127367+0000","last_undegraded":"2024-05-30T17:01:20.127367+0000","last_fullsized":"2024-05-30T17:01:20.127367+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:53:24.018089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.056883+0000","last_change":"2024-05-30T17:01:18.117947+0000","last_active":"2024-05-30T17:01:21.056883+0000","last_peered":"2024-05-30T17:01:21.056883+0000","last_clean":"2024-05-30T17:01:21.056883+0000","last_became_active":"2024-05-30T17:01:18.117667+0000","last_became_peered":"2024-05-30T17:01:18.117667+0000","last_unstale":"2024-05-30T17:01:21.056883+0000","last_undegraded":"2024-05-30T17:01:21.056883+0000","last_fullsized":"2024-05-30T17:01:21.056883+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:42:34.315091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057691+0000","last_change":"2024-05-30T17:01:19.123280+0000","last_active":"2024-05-30T17:01:21.057691+0000","last_peered":"2024-05-30T17:01:21.057691+0000","last_clean":"2024-05-30T17:01:21.057691+0000","last_became_active":"2024-05-30T17:01:19.120980+0000","last_became_peered":"2024-05-30T17:01:19.120980+0000","last_unstale":"2024-05-30T17:01:21.057691+0000","last_undegraded":"2024-05-30T17:01:21.057691+0000","last_fullsized":"2024-05-30T17:01:21.057691+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:29:18.015727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122900+0000","last_change":"2024-05-30T17:01:18.117866+0000","last_active":"2024-05-30T17:01:20.122900+0000","last_peered":"2024-05-30T17:01:20.122900+0000","last_clean":"2024-05-30T17:01:20.122900+0000","last_became_active":"2024-05-30T17:01:18.116498+0000","last_became_peered":"2024-05-30T17:01:18.116498+0000","last_unstale":"2024-05-30T17:01:20.122900+0000","last_undegraded":"2024-05-30T17:01:20.122900+0000","last_fullsized":"2024-05-30T17:01:20.122900+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:26:10.135468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.553197+0000","last_change":"2024-05-30T17:01:19.131918+0000","last_active":"2024-05-30T17:01:20.553197+0000","last_peered":"2024-05-30T17:01:20.553197+0000","last_clean":"2024-05-30T17:01:20.553197+0000","last_became_active":"2024-05-30T17:01:19.131646+0000","last_became_peered":"2024-05-30T17:01:19.131646+0000","last_unstale":"2024-05-30T17:01:20.553197+0000","last_undegraded":"2024-05-30T17:01:20.553197+0000","last_fullsized":"2024-05-30T17:01:20.553197+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:52:44.827734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122479+0000","last_change":"2024-05-30T17:01:18.121619+0000","last_active":"2024-05-30T17:01:20.122479+0000","last_peered":"2024-05-30T17:01:20.122479+0000","last_clean":"2024-05-30T17:01:20.122479+0000","last_became_active":"2024-05-30T17:01:18.121283+0000","last_became_peered":"2024-05-30T17:01:18.121283+0000","last_unstale":"2024-05-30T17:01:20.122479+0000","last_undegraded":"2024-05-30T17:01:20.122479+0000","last_fullsized":"2024-05-30T17:01:20.122479+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:39.614874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.553281+0000","last_change":"2024-05-30T17:01:19.123058+0000","last_active":"2024-05-30T17:01:20.553281+0000","last_peered":"2024-05-30T17:01:20.553281+0000","last_clean":"2024-05-30T17:01:20.553281+0000","last_became_active":"2024-05-30T17:01:19.122779+0000","last_became_peered":"2024-05-30T17:01:19.122779+0000","last_unstale":"2024-05-30T17:01:20.553281+0000","last_undegraded":"2024-05-30T17:01:20.553281+0000","last_fullsized":"2024-05-30T17:01:20.553281+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:12.789195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.127546+0000","last_change":"2024-05-30T17:01:18.113560+0000","last_active":"2024-05-30T17:01:20.127546+0000","last_peered":"2024-05-30T17:01:20.127546+0000","last_clean":"2024-05-30T17:01:20.127546+0000","last_became_active":"2024-05-30T17:01:18.113241+0000","last_became_peered":"2024-05-30T17:01:18.113241+0000","last_unstale":"2024-05-30T17:01:20.127546+0000","last_undegraded":"2024-05-30T17:01:20.127546+0000","last_fullsized":"2024-05-30T17:01:20.127546+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:12:06.062163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.552961+0000","last_change":"2024-05-30T17:01:19.131184+0000","last_active":"2024-05-30T17:01:20.552961+0000","last_peered":"2024-05-30T17:01:20.552961+0000","last_clean":"2024-05-30T17:01:20.552961+0000","last_became_active":"2024-05-30T17:01:19.130903+0000","last_became_peered":"2024-05-30T17:01:19.130903+0000","last_unstale":"2024-05-30T17:01:20.552961+0000","last_undegraded":"2024-05-30T17:01:20.552961+0000","last_fullsized":"2024-05-30T17:01:20.552961+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:19:00.933908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.127142+0000","last_change":"2024-05-30T17:01:18.113996+0000","last_active":"2024-05-30T17:01:20.127142+0000","last_peered":"2024-05-30T17:01:20.127142+0000","last_clean":"2024-05-30T17:01:20.127142+0000","last_became_active":"2024-05-30T17:01:18.112931+0000","last_became_peered":"2024-05-30T17:01:18.112931+0000","last_unstale":"2024-05-30T17:01:20.127142+0000","last_undegraded":"2024-05-30T17:01:20.127142+0000","last_fullsized":"2024-05-30T17:01:20.127142+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:02.283926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057004+0000","last_change":"2024-05-30T17:01:19.128375+0000","last_active":"2024-05-30T17:01:21.057004+0000","last_peered":"2024-05-30T17:01:21.057004+0000","last_clean":"2024-05-30T17:01:21.057004+0000","last_became_active":"2024-05-30T17:01:19.128067+0000","last_became_peered":"2024-05-30T17:01:19.128067+0000","last_unstale":"2024-05-30T17:01:21.057004+0000","last_undegraded":"2024-05-30T17:01:21.057004+0000","last_fullsized":"2024-05-30T17:01:21.057004+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:56.288805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122203+0000","last_change":"2024-05-30T17:01:18.123623+0000","last_active":"2024-05-30T17:01:20.122203+0000","last_peered":"2024-05-30T17:01:20.122203+0000","last_clean":"2024-05-30T17:01:20.122203+0000","last_became_active":"2024-05-30T17:01:18.123352+0000","last_became_peered":"2024-05-30T17:01:18.123352+0000","last_unstale":"2024-05-30T17:01:20.122203+0000","last_undegraded":"2024-05-30T17:01:20.122203+0000","last_fullsized":"2024-05-30T17:01:20.122203+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:27:25.172101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122636+0000","last_change":"2024-05-30T17:01:19.120513+0000","last_active":"2024-05-30T17:01:20.122636+0000","last_peered":"2024-05-30T17:01:20.122636+0000","last_clean":"2024-05-30T17:01:20.122636+0000","last_became_active":"2024-05-30T17:01:19.120189+0000","last_became_peered":"2024-05-30T17:01:19.120189+0000","last_unstale":"2024-05-30T17:01:20.122636+0000","last_undegraded":"2024-05-30T17:01:20.122636+0000","last_fullsized":"2024-05-30T17:01:20.122636+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:28:51.497638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.127670+0000","last_change":"2024-05-30T17:01:18.115784+0000","last_active":"2024-05-30T17:01:20.127670+0000","last_peered":"2024-05-30T17:01:20.127670+0000","last_clean":"2024-05-30T17:01:20.127670+0000","last_became_active":"2024-05-30T17:01:18.115526+0000","last_became_peered":"2024-05-30T17:01:18.115526+0000","last_unstale":"2024-05-30T17:01:20.127670+0000","last_undegraded":"2024-05-30T17:01:20.127670+0000","last_fullsized":"2024-05-30T17:01:20.127670+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:17:17.274012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.253411+0000","last_change":"2024-05-30T17:01:19.118897+0000","last_active":"2024-05-30T17:01:20.253411+0000","last_peered":"2024-05-30T17:01:20.253411+0000","last_clean":"2024-05-30T17:01:20.253411+0000","last_became_active":"2024-05-30T17:01:19.118553+0000","last_became_peered":"2024-05-30T17:01:19.118553+0000","last_unstale":"2024-05-30T17:01:20.253411+0000","last_undegraded":"2024-05-30T17:01:20.253411+0000","last_fullsized":"2024-05-30T17:01:20.253411+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:40.862277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122705+0000","last_change":"2024-05-30T17:01:18.124361+0000","last_active":"2024-05-30T17:01:20.122705+0000","last_peered":"2024-05-30T17:01:20.122705+0000","last_clean":"2024-05-30T17:01:20.122705+0000","last_became_active":"2024-05-30T17:01:18.123957+0000","last_became_peered":"2024-05-30T17:01:18.123957+0000","last_unstale":"2024-05-30T17:01:20.122705+0000","last_undegraded":"2024-05-30T17:01:20.122705+0000","last_fullsized":"2024-05-30T17:01:20.122705+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:32.908749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.253314+0000","last_change":"2024-05-30T17:01:19.123689+0000","last_active":"2024-05-30T17:01:20.253314+0000","last_peered":"2024-05-30T17:01:20.253314+0000","last_clean":"2024-05-30T17:01:20.253314+0000","last_became_active":"2024-05-30T17:01:19.123425+0000","last_became_peered":"2024-05-30T17:01:19.123425+0000","last_unstale":"2024-05-30T17:01:20.253314+0000","last_undegraded":"2024-05-30T17:01:20.253314+0000","last_fullsized":"2024-05-30T17:01:20.253314+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:52:41.715026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122833+0000","last_change":"2024-05-30T17:01:18.118424+0000","last_active":"2024-05-30T17:01:20.122833+0000","last_peered":"2024-05-30T17:01:20.122833+0000","last_clean":"2024-05-30T17:01:20.122833+0000","last_became_active":"2024-05-30T17:01:18.115795+0000","last_became_peered":"2024-05-30T17:01:18.115795+0000","last_unstale":"2024-05-30T17:01:20.122833+0000","last_undegraded":"2024-05-30T17:01:20.122833+0000","last_fullsized":"2024-05-30T17:01:20.122833+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:22:53.919641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057090+0000","last_change":"2024-05-30T17:01:19.134705+0000","last_active":"2024-05-30T17:01:21.057090+0000","last_peered":"2024-05-30T17:01:21.057090+0000","last_clean":"2024-05-30T17:01:21.057090+0000","last_became_active":"2024-05-30T17:01:19.134403+0000","last_became_peered":"2024-05-30T17:01:19.134403+0000","last_unstale":"2024-05-30T17:01:21.057090+0000","last_undegraded":"2024-05-30T17:01:21.057090+0000","last_fullsized":"2024-05-30T17:01:21.057090+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:36:04.066299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057062+0000","last_change":"2024-05-30T17:01:18.114218+0000","last_active":"2024-05-30T17:01:21.057062+0000","last_peered":"2024-05-30T17:01:21.057062+0000","last_clean":"2024-05-30T17:01:21.057062+0000","last_became_active":"2024-05-30T17:01:18.113561+0000","last_became_peered":"2024-05-30T17:01:18.113561+0000","last_unstale":"2024-05-30T17:01:21.057062+0000","last_undegraded":"2024-05-30T17:01:21.057062+0000","last_fullsized":"2024-05-30T17:01:21.057062+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:08:05.394081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.553211+0000","last_change":"2024-05-30T17:01:19.123486+0000","last_active":"2024-05-30T17:01:20.553211+0000","last_peered":"2024-05-30T17:01:20.553211+0000","last_clean":"2024-05-30T17:01:20.553211+0000","last_became_active":"2024-05-30T17:01:19.123222+0000","last_became_peered":"2024-05-30T17:01:19.123222+0000","last_unstale":"2024-05-30T17:01:20.553211+0000","last_undegraded":"2024-05-30T17:01:20.553211+0000","last_fullsized":"2024-05-30T17:01:20.553211+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:33:31.917845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.122588+0000","last_change":"2024-05-30T17:01:18.123092+0000","last_active":"2024-05-30T17:01:20.122588+0000","last_peered":"2024-05-30T17:01:20.122588+0000","last_clean":"2024-05-30T17:01:20.122588+0000","last_became_active":"2024-05-30T17:01:18.122826+0000","last_became_peered":"2024-05-30T17:01:18.122826+0000","last_unstale":"2024-05-30T17:01:20.122588+0000","last_undegraded":"2024-05-30T17:01:20.122588+0000","last_fullsized":"2024-05-30T17:01:20.122588+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:42:34.315091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.126566+0000","last_change":"2024-05-30T17:01:19.129997+0000","last_active":"2024-05-30T17:01:20.126566+0000","last_peered":"2024-05-30T17:01:20.126566+0000","last_clean":"2024-05-30T17:01:20.126566+0000","last_became_active":"2024-05-30T17:01:19.129708+0000","last_became_peered":"2024-05-30T17:01:19.129708+0000","last_unstale":"2024-05-30T17:01:20.126566+0000","last_undegraded":"2024-05-30T17:01:20.126566+0000","last_fullsized":"2024-05-30T17:01:20.126566+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:51.219045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.056597+0000","last_change":"2024-05-30T17:01:18.123695+0000","last_active":"2024-05-30T17:01:21.056597+0000","last_peered":"2024-05-30T17:01:21.056597+0000","last_clean":"2024-05-30T17:01:21.056597+0000","last_became_active":"2024-05-30T17:01:18.123375+0000","last_became_peered":"2024-05-30T17:01:18.123375+0000","last_unstale":"2024-05-30T17:01:21.056597+0000","last_undegraded":"2024-05-30T17:01:21.056597+0000","last_fullsized":"2024-05-30T17:01:21.056597+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:59:39.000969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.552968+0000","last_change":"2024-05-30T17:01:19.124056+0000","last_active":"2024-05-30T17:01:20.552968+0000","last_peered":"2024-05-30T17:01:20.552968+0000","last_clean":"2024-05-30T17:01:20.552968+0000","last_became_active":"2024-05-30T17:01:19.116325+0000","last_became_peered":"2024-05-30T17:01:19.116325+0000","last_unstale":"2024-05-30T17:01:20.552968+0000","last_undegraded":"2024-05-30T17:01:20.552968+0000","last_fullsized":"2024-05-30T17:01:20.552968+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:59.087667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.054503+0000","last_change":"2024-05-30T17:01:18.113981+0000","last_active":"2024-05-30T17:01:21.054503+0000","last_peered":"2024-05-30T17:01:21.054503+0000","last_clean":"2024-05-30T17:01:21.054503+0000","last_became_active":"2024-05-30T17:01:18.113682+0000","last_became_peered":"2024-05-30T17:01:18.113682+0000","last_unstale":"2024-05-30T17:01:21.054503+0000","last_undegraded":"2024-05-30T17:01:21.054503+0000","last_fullsized":"2024-05-30T17:01:21.054503+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:26:50.596502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057176+0000","last_change":"2024-05-30T17:01:19.142447+0000","last_active":"2024-05-30T17:01:21.057176+0000","last_peered":"2024-05-30T17:01:21.057176+0000","last_clean":"2024-05-30T17:01:21.057176+0000","last_became_active":"2024-05-30T17:01:19.142110+0000","last_became_peered":"2024-05-30T17:01:19.142110+0000","last_unstale":"2024-05-30T17:01:21.057176+0000","last_undegraded":"2024-05-30T17:01:21.057176+0000","last_fullsized":"2024-05-30T17:01:21.057176+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:13:38.256719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.553035+0000","last_change":"2024-05-30T17:01:18.122542+0000","last_active":"2024-05-30T17:01:20.553035+0000","last_peered":"2024-05-30T17:01:20.553035+0000","last_clean":"2024-05-30T17:01:20.553035+0000","last_became_active":"2024-05-30T17:01:18.122124+0000","last_became_peered":"2024-05-30T17:01:18.122124+0000","last_unstale":"2024-05-30T17:01:20.553035+0000","last_undegraded":"2024-05-30T17:01:20.553035+0000","last_fullsized":"2024-05-30T17:01:20.553035+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:35.081893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:20.553556+0000","last_change":"2024-05-30T17:01:19.137588+0000","last_active":"2024-05-30T17:01:20.553556+0000","last_peered":"2024-05-30T17:01:20.553556+0000","last_clean":"2024-05-30T17:01:20.553556+0000","last_became_active":"2024-05-30T17:01:19.136870+0000","last_became_peered":"2024-05-30T17:01:19.136870+0000","last_unstale":"2024-05-30T17:01:20.553556+0000","last_undegraded":"2024-05-30T17:01:20.553556+0000","last_fullsized":"2024-05-30T17:01:20.553556+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:18.088977+0000","last_clean_scrub_stamp":"2024-05-30T17:01:18.088977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:41:37.693546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.057341+0000","last_change":"2024-05-30T17:01:18.123771+0000","last_active":"2024-05-30T17:01:21.057341+0000","last_peered":"2024-05-30T17:01:21.057341+0000","last_clean":"2024-05-30T17:01:21.057341+0000","last_became_active":"2024-05-30T17:01:18.123423+0000","last_became_peered":"2024-05-30T17:01:18.123423+0000","last_unstale":"2024-05-30T17:01:21.057341+0000","last_undegraded":"2024-05-30T17:01:21.057341+0000","last_fullsized":"2024-05-30T17:01:21.057341+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:01:17.085922+0000","last_clean_scrub_stamp":"2024-05-30T17:01:17.085922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:27:17.871054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":327,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-05-30T17:01:21.056637+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:01:21.056637+0000","last_peered":"2024-05-30T17:01:21.056637+0000","last_clean":"2024-05-30T17:01:21.056637+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:01:21.056637+0000","last_undegraded":"2024-05-30T17:01:21.056637+0000","last_fullsized":"2024-05-30T17:01:21.056637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509592,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123192,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248648,"statfs":{"total":96636764160,"available":96510615552,"internally_reserved":0,"allocated":1880064,"data_stored":1145848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509593,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122612,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249228,"statfs":{"total":96636764160,"available":96511209472,"internally_reserved":0,"allocated":1286144,"data_stored":556020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509593,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72632,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299208,"statfs":{"total":96636764160,"available":96562388992,"internally_reserved":0,"allocated":1282048,"data_stored":555438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509594,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64320,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94307520,"statfs":{"total":96636764160,"available":96570900480,"internally_reserved":0,"allocated":1298432,"data_stored":557104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509593,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140656,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231184,"statfs":{"total":96636764160,"available":96492732416,"internally_reserved":0,"allocated":1282048,"data_stored":555402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509593,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104556,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267284,"statfs":{"total":96636764160,"available":96529698816,"internally_reserved":0,"allocated":1277952,"data_stored":555368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509593,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81528,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94290312,"statfs":{"total":96636764160,"available":96553279488,"internally_reserved":0,"allocated":1875968,"data_stored":1146318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81590725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542297,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122612,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249228,"statfs":{"total":96636764160,"available":96511209472,"internally_reserved":0,"allocated":1282048,"data_stored":550590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:01:23.647 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T17:01:23.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T17:01:23.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.831+0000 7f38e4000640 1 Processor -- start 2024-05-30T17:01:23.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.831+0000 7f38e4000640 1 -- start start 2024-05-30T17:01:23.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38e4000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f38dc15c010 0x7f38dc15c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38e4000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38dc0b52d0 con 0x7f38dc0b44e0 2024-05-30T17:01:23.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38e4000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38dc0b4a30 con 0x7f38dc159100 2024-05-30T17:01:23.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38e4000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f38dc0b4d10 con 0x7f38dc15c010 2024-05-30T17:01:23.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38e0c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f38dc0b44e0 0x7f38dc15efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45588/0 (socket says 172.21.15.59:45588) 2024-05-30T17:01:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38e0c00640 1 -- 172.21.15.59:0/1224931924 learned_addr learned my addr 172.21.15.59:0/1224931924 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38e2000640 1 --2- 172.21.15.59:0/1224931924 >> v2:172.21.15.107:3300/0 conn(0x7f38dc15c010 0x7f38dc15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38dbe00640 1 -- 172.21.15.59:0/1224931924 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1964997574 0 0) 0x7f38dc0b52d0 con 0x7f38dc0b44e0 2024-05-30T17:01:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38dbe00640 1 -- 172.21.15.59:0/1224931924 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38c4003530 con 0x7f38dc0b44e0 2024-05-30T17:01:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38dbe00640 1 -- 172.21.15.59:0/1224931924 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364184836 0 0) 0x7f38dc0b4a30 con 0x7f38dc159100 2024-05-30T17:01:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38dbe00640 1 -- 172.21.15.59:0/1224931924 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38dc0b52d0 con 0x7f38dc159100 2024-05-30T17:01:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38e2000640 1 -- 172.21.15.59:0/1224931924 >> v1:172.21.15.107:6789/0 conn(0x7f38dc159100 legacy=0x7f38dc06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38e2000640 1 -- 172.21.15.59:0/1224931924 >> v1:172.21.15.59:6789/0 conn(0x7f38dc0b44e0 legacy=0x7f38dc15efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.835+0000 7f38e2000640 1 -- 172.21.15.59:0/1224931924 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38dc0b4ff0 con 0x7f38dc15c010 2024-05-30T17:01:23.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38e2000640 1 --2- 172.21.15.59:0/1224931924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38dc15c010 0x7f38dc15c440 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009d90 tx=0x7f38d401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11437b0085732301 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:23.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38dbe00640 1 -- 172.21.15.59:0/1224931924 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d40b2070 con 0x7f38dc15c010 2024-05-30T17:01:23.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38dbe00640 1 -- 172.21.15.59:0/1224931924 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d40a57b0 con 0x7f38dc15c010 2024-05-30T17:01:23.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38dbe00640 1 -- 172.21.15.59:0/1224931924 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d40a5b80 con 0x7f38dc15c010 2024-05-30T17:01:23.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38e4000640 1 -- 172.21.15.59:0/1224931924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38dc15c010 msgr2=0x7f38dc15c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38e4000640 1 --2- 172.21.15.59:0/1224931924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38dc15c010 0x7f38dc15c440 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009d90 tx=0x7f38d401c8e0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38e4000640 1 -- 172.21.15.59:0/1224931924 shutdown_connections 2024-05-30T17:01:23.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38e4000640 1 --2- 172.21.15.59:0/1224931924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38dc15c010 0x7f38dc15c440 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38e4000640 1 -- 172.21.15.59:0/1224931924 >> 172.21.15.59:0/1224931924 conn(0x7f38dc06bdb0 msgr2=0x7f38dc06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:23.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38e4000640 1 -- 172.21.15.59:0/1224931924 shutdown_connections 2024-05-30T17:01:23.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38e4000640 1 -- 172.21.15.59:0/1224931924 wait complete. 2024-05-30T17:01:23.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38e4000640 1 Processor -- start 2024-05-30T17:01:23.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.839+0000 7f38e4000640 1 -- start start 2024-05-30T17:01:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e4000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc0b44e0 0x7f38dc153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e4000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f38dc159100 0x7f38dc0cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e4000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38dc15c010 0x7f38dc154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e4000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc0b3550 con 0x7f38dc0b44e0 2024-05-30T17:01:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e4000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc0b33d0 con 0x7f38dc15c010 2024-05-30T17:01:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e4000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f38dc0b36d0 con 0x7f38dc159100 2024-05-30T17:01:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e1600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc0b44e0 0x7f38dc153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e1600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc0b44e0 0x7f38dc153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37974/0 (socket says 172.21.15.59:37974) 2024-05-30T17:01:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e1600640 1 -- 172.21.15.59:0/1646952728 learned_addr learned my addr 172.21.15.59:0/1646952728 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e0c00640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f38dc159100 0x7f38dc0cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e2000640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38dc15c010 0x7f38dc154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e1600640 1 -- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f38dc159100 msgr2=0x7f38dc0cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e1600640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f38dc159100 0x7f38dc0cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e1600640 1 -- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38dc15c010 msgr2=0x7f38dc154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e1600640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38dc15c010 0x7f38dc154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e1600640 1 -- 172.21.15.59:0/1646952728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38dc0ccc90 con 0x7f38dc0b44e0 2024-05-30T17:01:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e2000640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38dc15c010 0x7f38dc154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e0c00640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f38dc159100 0x7f38dc0cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e1600640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc0b44e0 0x7f38dc153580 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f38d000c500 tx=0x7f38d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38d9600640 1 -- 172.21.15.59:0/1646952728 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d00052d0 con 0x7f38dc0b44e0 2024-05-30T17:01:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38d9600640 1 -- 172.21.15.59:0/1646952728 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d0005490 con 0x7f38dc0b44e0 2024-05-30T17:01:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e4000640 1 -- 172.21.15.59:0/1646952728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38dc0cdd10 con 0x7f38dc0b44e0 2024-05-30T17:01:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38d9600640 1 -- 172.21.15.59:0/1646952728 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0012850 con 0x7f38dc0b44e0 2024-05-30T17:01:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e4000640 1 -- 172.21.15.59:0/1646952728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38dc0cd230 con 0x7f38dc0b44e0 2024-05-30T17:01:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38e4000640 1 -- 172.21.15.59:0/1646952728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38dc068a90 con 0x7f38dc0b44e0 2024-05-30T17:01:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.843+0000 7f38d9600640 1 -- 172.21.15.59:0/1646952728 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f38d00129f0 con 0x7f38dc0b44e0 2024-05-30T17:01:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.847+0000 7f38d9600640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f38bc069850 0x7f38bc06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.847+0000 7f38d9600640 1 -- 172.21.15.59:0/1646952728 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f38d0085880 con 0x7f38dc0b44e0 2024-05-30T17:01:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.847+0000 7f38e0c00640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f38bc069850 0x7f38bc06bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.847+0000 7f38e0c00640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f38bc069850 0x7f38bc06bd10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f38dc1faf70 tx=0x7f38c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:23.851+0000 7f38d9600640 1 -- 172.21.15.59:0/1646952728 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f38d0057430 con 0x7f38dc0b44e0 2024-05-30T17:01:24.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.071+0000 7f38e4000640 1 -- 172.21.15.59:0/1646952728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f38dc157b80 con 0x7f38dc0b44e0 2024-05-30T17:01:24.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.075+0000 7f38d9600640 1 -- 172.21.15.59:0/1646952728 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7f38d0056d30 con 0x7f38dc0b44e0 2024-05-30T17:01:24.078 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-05-30T17:01:24.079 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA== 2024-05-30T17:01:24.079 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-05-30T17:01:24.079 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-05-30T17:01:24.079 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T17:01:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-05-30T17:01:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.079+0000 7f38e4000640 1 -- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f38bc069850 msgr2=0x7f38bc06bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.079+0000 7f38e4000640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f38bc069850 0x7f38bc06bd10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f38dc1faf70 tx=0x7f38c8009040 comp rx=0 tx=0).stop 2024-05-30T17:01:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.079+0000 7f38e4000640 1 -- 172.21.15.59:0/1646952728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc0b44e0 msgr2=0x7f38dc153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.079+0000 7f38e4000640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc0b44e0 0x7f38dc153580 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f38d000c500 tx=0x7f38d000c9c0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.079+0000 7f38e4000640 1 -- 172.21.15.59:0/1646952728 shutdown_connections 2024-05-30T17:01:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.079+0000 7f38e4000640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f38bc069850 0x7f38bc06bd10 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.079+0000 7f38e4000640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38dc15c010 0x7f38dc154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.079+0000 7f38e4000640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f38dc159100 0x7f38dc0cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.079+0000 7f38e4000640 1 --2- 172.21.15.59:0/1646952728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc0b44e0 0x7f38dc153580 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.079+0000 7f38e4000640 1 -- 172.21.15.59:0/1646952728 >> 172.21.15.59:0/1646952728 conn(0x7f38dc06bdb0 msgr2=0x7f38dc1580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.079+0000 7f38e4000640 1 -- 172.21.15.59:0/1646952728 shutdown_connections 2024-05-30T17:01:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.079+0000 7f38e4000640 1 -- 172.21.15.59:0/1646952728 wait complete. 2024-05-30T17:01:24.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:01:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.239+0000 7f0064600640 1 Processor -- start 2024-05-30T17:01:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.239+0000 7f0064600640 1 -- start start 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0064600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f005c0cf5e0 0x7f005c06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0064600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f005c072180 0x7f005c072610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0064600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f005c06eaa0 con 0x7f005c15c500 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0064600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f005c06ed80 con 0x7f005c0cf5e0 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0064600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f005c06f060 con 0x7f005c072180 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0061200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f005c0cf5e0 0x7f005c06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0061200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f005c0cf5e0 0x7f005c06fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37990/0 (socket says 172.21.15.59:37990) 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0061200640 1 -- 172.21.15.59:0/493166009 learned_addr learned my addr 172.21.15.59:0/493166009 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0062600640 1 --2- 172.21.15.59:0/493166009 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f005c072180 0x7f005c072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0061200640 1 -- 172.21.15.59:0/493166009 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f005c072180 msgr2=0x7f005c072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0061200640 1 --2- 172.21.15.59:0/493166009 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f005c072180 0x7f005c072610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0061200640 1 -- 172.21.15.59:0/493166009 >> v1:172.21.15.107:6789/0 conn(0x7f005c15c500 legacy=0x7f005c06e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0061200640 1 -- 172.21.15.59:0/493166009 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005c06f340 con 0x7f005c0cf5e0 2024-05-30T17:01:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.243+0000 7f0061200640 1 --2- 172.21.15.59:0/493166009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005c0cf5e0 0x7f005c06fb40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f0048009870 tx=0x7f004801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b1ffaaf149b57e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:24.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f005be00640 1 -- 172.21.15.59:0/493166009 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00480b0070 con 0x7f005c0cf5e0 2024-05-30T17:01:24.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f005be00640 1 -- 172.21.15.59:0/493166009 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00480ab600 con 0x7f005c0cf5e0 2024-05-30T17:01:24.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f005be00640 1 -- 172.21.15.59:0/493166009 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00480ab9d0 con 0x7f005c0cf5e0 2024-05-30T17:01:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 -- 172.21.15.59:0/493166009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005c0cf5e0 msgr2=0x7f005c06fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 --2- 172.21.15.59:0/493166009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005c0cf5e0 0x7f005c06fb40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f0048009870 tx=0x7f004801c520 comp rx=0 tx=0).stop 2024-05-30T17:01:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 -- 172.21.15.59:0/493166009 shutdown_connections 2024-05-30T17:01:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 --2- 172.21.15.59:0/493166009 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f005c072180 0x7f005c072610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 --2- 172.21.15.59:0/493166009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005c0cf5e0 0x7f005c06fb40 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 -- 172.21.15.59:0/493166009 >> 172.21.15.59:0/493166009 conn(0x7f005c0b2a60 msgr2=0x7f005c0d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 -- 172.21.15.59:0/493166009 shutdown_connections 2024-05-30T17:01:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 -- 172.21.15.59:0/493166009 wait complete. 2024-05-30T17:01:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 Processor -- start 2024-05-30T17:01:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 -- start start 2024-05-30T17:01:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f005c072180 0x7f005c15b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005c0cf5e0 0x7f005c1401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f005c15c500 0x7f005c155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f005c15d480 con 0x7f005c0cf5e0 2024-05-30T17:01:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f005c15d300 con 0x7f005c072180 2024-05-30T17:01:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0064600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f005c15d600 con 0x7f005c15c500 2024-05-30T17:01:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0061200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005c0cf5e0 0x7f005c1401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0061200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005c0cf5e0 0x7f005c1401b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38000/0 (socket says 172.21.15.59:38000) 2024-05-30T17:01:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0061200640 1 -- 172.21.15.59:0/589572099 learned_addr learned my addr 172.21.15.59:0/589572099 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0061c00640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f005c072180 0x7f005c15b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0062600640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f005c15c500 0x7f005c155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0061200640 1 -- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f005c15c500 msgr2=0x7f005c155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:24.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0061200640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f005c15c500 0x7f005c155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0061200640 1 -- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f005c072180 msgr2=0x7f005c15b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:24.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0061200640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f005c072180 0x7f005c15b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0061200640 1 -- 172.21.15.59:0/589572099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005c1544e0 con 0x7f005c0cf5e0 2024-05-30T17:01:24.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.247+0000 7f0061c00640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f005c072180 0x7f005c15b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:24.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.251+0000 7f0061200640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005c0cf5e0 0x7f005c1401b0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f00480ae040 tx=0x7f004801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:24.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.251+0000 7f0059600640 1 -- 172.21.15.59:0/589572099 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00480ba020 con 0x7f005c0cf5e0 2024-05-30T17:01:24.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.251+0000 7f0059600640 1 -- 172.21.15.59:0/589572099 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00480b6640 con 0x7f005c0cf5e0 2024-05-30T17:01:24.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.251+0000 7f0059600640 1 -- 172.21.15.59:0/589572099 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00480b0040 con 0x7f005c0cf5e0 2024-05-30T17:01:24.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.251+0000 7f0064600640 1 -- 172.21.15.59:0/589572099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005c1547c0 con 0x7f005c0cf5e0 2024-05-30T17:01:24.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.251+0000 7f0064600640 1 -- 172.21.15.59:0/589572099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f005c154d80 con 0x7f005c0cf5e0 2024-05-30T17:01:24.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.251+0000 7f0064600640 1 -- 172.21.15.59:0/589572099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f005c068a90 con 0x7f005c0cf5e0 2024-05-30T17:01:24.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.251+0000 7f0059600640 1 -- 172.21.15.59:0/589572099 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f00480bd020 con 0x7f005c0cf5e0 2024-05-30T17:01:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.251+0000 7f0059600640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f003c069850 0x7f003c06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.251+0000 7f0059600640 1 -- 172.21.15.59:0/589572099 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f004811fb00 con 0x7f005c0cf5e0 2024-05-30T17:01:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.255+0000 7f0061c00640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f003c069850 0x7f003c06bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.255+0000 7f0061c00640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f003c069850 0x7f003c06bd10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f00500098b0 tx=0x7f0050008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.255+0000 7f0059600640 1 -- 172.21.15.59:0/589572099 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f00480c4030 con 0x7f005c0cf5e0 2024-05-30T17:01:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.455+0000 7f0064600640 1 -- 172.21.15.59:0/589572099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f005c0694c0 con 0x7f005c0cf5e0 2024-05-30T17:01:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.455+0000 7f0059600640 1 -- 172.21.15.59:0/589572099 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5189 (secure 0 0 0) 0x7f0048016110 con 0x7f005c0cf5e0 2024-05-30T17:01:24.459 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:24.459 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2410188205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2410188205},{"type":"v1","addr":"172.21.15.107:6836","nonce":2410188205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7342,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1749998079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1749998079},{"type":"v1","addr":"172.21.15.59:6834","nonce":1749998079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3865215628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3865215628},{"type":"v1","addr":"172.21.15.107:6837","nonce":3865215628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:01:18.507070+0000","modified":"2024-05-30T17:01:21.519897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/1525464146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1525464146},{"type":"v1","addr":"172.21.15.59:6835","nonce":1525464146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7986,"qdb_cluster":[7986]},"id":7}]} 2024-05-30T17:01:24.460 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 61 2024-05-30T17:01:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.459+0000 7f0064600640 1 -- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f003c069850 msgr2=0x7f003c06bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.459+0000 7f0064600640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f003c069850 0x7f003c06bd10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f00500098b0 tx=0x7f0050008040 comp rx=0 tx=0).stop 2024-05-30T17:01:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.459+0000 7f0064600640 1 -- 172.21.15.59:0/589572099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005c0cf5e0 msgr2=0x7f005c1401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.459+0000 7f0064600640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005c0cf5e0 0x7f005c1401b0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f00480ae040 tx=0x7f004801ad60 comp rx=0 tx=0).stop 2024-05-30T17:01:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.459+0000 7f0064600640 1 -- 172.21.15.59:0/589572099 shutdown_connections 2024-05-30T17:01:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.459+0000 7f0064600640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f003c069850 0x7f003c06bd10 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.459+0000 7f0064600640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f005c15c500 0x7f005c155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.459+0000 7f0064600640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005c0cf5e0 0x7f005c1401b0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.459+0000 7f0064600640 1 --2- 172.21.15.59:0/589572099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f005c072180 0x7f005c15b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.459+0000 7f0064600640 1 -- 172.21.15.59:0/589572099 >> 172.21.15.59:0/589572099 conn(0x7f005c0b2a60 msgr2=0x7f005c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.459+0000 7f0064600640 1 -- 172.21.15.59:0/589572099 shutdown_connections 2024-05-30T17:01:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:24.459+0000 7f0064600640 1 -- 172.21.15.59:0/589572099 wait complete. 2024-05-30T17:01:24.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T17:01:18.507070+0000', 'modified': '2024-05-30T17:01:21.519897+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7986}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7986': {'gid': 7986, 'name': 'c', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/1525464146', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 1525464146}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 1525464146}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7986, 'qdb_cluster': [7986]} 2024-05-30T17:01:24.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T17:01:24.884 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-30T17:01:25.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.023+0000 7f65ed400640 1 Processor -- start 2024-05-30T17:01:25.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.023+0000 7f65ed400640 1 -- start start 2024-05-30T17:01:25.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65ed400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65e80b4510 0x7f65e81630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65ed400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f65e80b48f0 0x7f65e815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65ed400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e815fbe0 con 0x7f65e815f5f0 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65ed400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f65e81635f0 con 0x7f65e80b48f0 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65ed400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f65e815fec0 con 0x7f65e80b4510 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65e7200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f65e815f5f0 0x7f65e8072d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45600/0 (socket says 172.21.15.59:45600) 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65e7200640 1 -- 172.21.15.59:0/201688558 learned_addr learned my addr 172.21.15.59:0/201688558 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65dde00640 1 --2- 172.21.15.59:0/201688558 >> v2:172.21.15.107:3300/0 conn(0x7f65e80b48f0 0x7f65e815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65e6800640 1 --2- 172.21.15.59:0/201688558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65e80b4510 0x7f65e81630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65e5e00640 1 -- 172.21.15.59:0/201688558 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 916134462 0 0) 0x7f65e815fbe0 con 0x7f65e815f5f0 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65e5e00640 1 -- 172.21.15.59:0/201688558 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65cc003530 con 0x7f65e815f5f0 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65dde00640 1 -- 172.21.15.59:0/201688558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65e80b4510 msgr2=0x7f65e81630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65dde00640 1 --2- 172.21.15.59:0/201688558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65e80b4510 0x7f65e81630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65e5e00640 1 -- 172.21.15.59:0/201688558 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1812990782 0 0) 0x7f65cc003530 con 0x7f65e815f5f0 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65dde00640 1 -- 172.21.15.59:0/201688558 >> v1:172.21.15.59:6789/0 conn(0x7f65e815f5f0 legacy=0x7f65e8072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.027+0000 7f65dde00640 1 -- 172.21.15.59:0/201688558 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e81628b0 con 0x7f65e80b48f0 2024-05-30T17:01:25.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65dde00640 1 --2- 172.21.15.59:0/201688558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e80b48f0 0x7f65e815f0b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f65d00097c0 tx=0x7f65d001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4e6bd4f9d95d25a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:25.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65e5e00640 1 -- 172.21.15.59:0/201688558 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d00b0070 con 0x7f65e80b48f0 2024-05-30T17:01:25.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65e5e00640 1 -- 172.21.15.59:0/201688558 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d00ab400 con 0x7f65e80b48f0 2024-05-30T17:01:25.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65e5e00640 1 -- 172.21.15.59:0/201688558 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0001a00 con 0x7f65e80b48f0 2024-05-30T17:01:25.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65ed400640 1 -- 172.21.15.59:0/201688558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e80b48f0 msgr2=0x7f65e815f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65ed400640 1 --2- 172.21.15.59:0/201688558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e80b48f0 0x7f65e815f0b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f65d00097c0 tx=0x7f65d001c3c0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65ed400640 1 -- 172.21.15.59:0/201688558 shutdown_connections 2024-05-30T17:01:25.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65ed400640 1 --2- 172.21.15.59:0/201688558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e80b48f0 0x7f65e815f0b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65ed400640 1 --2- 172.21.15.59:0/201688558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65e80b4510 0x7f65e81630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65ed400640 1 -- 172.21.15.59:0/201688558 >> 172.21.15.59:0/201688558 conn(0x7f65e80b3240 msgr2=0x7f65e80725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:25.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65ed400640 1 -- 172.21.15.59:0/201688558 shutdown_connections 2024-05-30T17:01:25.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65ed400640 1 -- 172.21.15.59:0/201688558 wait complete. 2024-05-30T17:01:25.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65ed400640 1 Processor -- start 2024-05-30T17:01:25.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.031+0000 7f65ed400640 1 -- start start 2024-05-30T17:01:25.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65ed400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e80b4510 0x7f65e8155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65ed400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e80b48f0 0x7f65e8158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65ed400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65e815f5f0 0x7f65e813fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65ed400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f65e806ee60 con 0x7f65e80b4510 2024-05-30T17:01:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65ed400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f65e806efe0 con 0x7f65e80b48f0 2024-05-30T17:01:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65ed400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f65e806f160 con 0x7f65e815f5f0 2024-05-30T17:01:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65e6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e80b4510 0x7f65e8155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65e6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e80b4510 0x7f65e8155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38006/0 (socket says 172.21.15.59:38006) 2024-05-30T17:01:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65e6800640 1 -- 172.21.15.59:0/2303423258 learned_addr learned my addr 172.21.15.59:0/2303423258 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65dde00640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e80b48f0 0x7f65e8158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65e7200640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65e815f5f0 0x7f65e813fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65e6800640 1 -- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65e815f5f0 msgr2=0x7f65e813fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65e6800640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65e815f5f0 0x7f65e813fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65e6800640 1 -- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e80b48f0 msgr2=0x7f65e8158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65e6800640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e80b48f0 0x7f65e8158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65e6800640 1 -- 172.21.15.59:0/2303423258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e8158d30 con 0x7f65e80b4510 2024-05-30T17:01:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65e7200640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65e815f5f0 0x7f65e813fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65e6800640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e80b4510 0x7f65e8155ad0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f65d800e870 tx=0x7f65d800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65df400640 1 -- 172.21.15.59:0/2303423258 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8017070 con 0x7f65e80b4510 2024-05-30T17:01:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65df400640 1 -- 172.21.15.59:0/2303423258 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d800c940 con 0x7f65e80b4510 2024-05-30T17:01:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65df400640 1 -- 172.21.15.59:0/2303423258 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d800cd10 con 0x7f65e80b4510 2024-05-30T17:01:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65ed400640 1 -- 172.21.15.59:0/2303423258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e81534e0 con 0x7f65e80b4510 2024-05-30T17:01:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.035+0000 7f65ed400640 1 -- 172.21.15.59:0/2303423258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e81f7d90 con 0x7f65e80b4510 2024-05-30T17:01:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65df400640 1 -- 172.21.15.59:0/2303423258 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f65d801a070 con 0x7f65e80b4510 2024-05-30T17:01:25.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65df400640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f65c4069850 0x7f65c406bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65df400640 1 -- 172.21.15.59:0/2303423258 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f65d80858d0 con 0x7f65e80b4510 2024-05-30T17:01:25.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65dde00640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f65c4069850 0x7f65c406bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65f0877000 1 Processor -- start 2024-05-30T17:01:25.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65f0877000 1 -- start start 2024-05-30T17:01:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65dde00640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f65c4069850 0x7f65c406bd10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f65d00ad000 tx=0x7f65d00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65f0877000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba282120 0x5585ba282500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65f0877000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba282a40 0x5585ba235110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65f0877000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 0x5585ba235a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65f0877000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5585ba086420 con 0x5585ba235650 2024-05-30T17:01:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65f0877000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5585ba020bf0 con 0x5585ba282a40 2024-05-30T17:01:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65f0877000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5585ba0823e0 con 0x5585ba282120 2024-05-30T17:01:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65e7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 0x5585ba235a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65e7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 0x5585ba235a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38010/0 (socket says 172.21.15.59:38010) 2024-05-30T17:01:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65e7200640 1 -- 172.21.15.59:0/11077709 learned_addr learned my addr 172.21.15.59:0/11077709 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65dde00640 1 --2- 172.21.15.59:0/11077709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba282a40 0x5585ba235110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65e6800640 1 --2- 172.21.15.59:0/11077709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba282120 0x5585ba282500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65e7200640 1 -- 172.21.15.59:0/11077709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba282120 msgr2=0x5585ba282500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65e7200640 1 --2- 172.21.15.59:0/11077709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba282120 0x5585ba282500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65e7200640 1 -- 172.21.15.59:0/11077709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba282a40 msgr2=0x5585ba235110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65e7200640 1 --2- 172.21.15.59:0/11077709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba282a40 0x5585ba235110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65e7200640 1 -- 172.21.15.59:0/11077709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585ba12e450 con 0x5585ba235650 2024-05-30T17:01:25.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.039+0000 7f65e7200640 1 --2- 172.21.15.59:0/11077709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 0x5585ba235a30 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f65e000e210 tx=0x7f65e0001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2382729a07ac6e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:25.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65d7400640 1 -- 172.21.15.59:0/11077709 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0019070 con 0x5585ba235650 2024-05-30T17:01:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65d7400640 1 -- 172.21.15.59:0/11077709 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e00072e0 con 0x5585ba235650 2024-05-30T17:01:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65d7400640 1 -- 172.21.15.59:0/11077709 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0007690 con 0x5585ba235650 2024-05-30T17:01:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 -- 172.21.15.59:0/11077709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 msgr2=0x5585ba235a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 --2- 172.21.15.59:0/11077709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 0x5585ba235a30 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f65e000e210 tx=0x7f65e0001b30 comp rx=0 tx=0).stop 2024-05-30T17:01:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 -- 172.21.15.59:0/11077709 shutdown_connections 2024-05-30T17:01:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 --2- 172.21.15.59:0/11077709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 0x5585ba235a30 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 --2- 172.21.15.59:0/11077709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba282a40 0x5585ba235110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 --2- 172.21.15.59:0/11077709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba282120 0x5585ba282500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 -- 172.21.15.59:0/11077709 >> 172.21.15.59:0/11077709 conn(0x5585ba262ec0 msgr2=0x5585ba2652b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 -- 172.21.15.59:0/11077709 shutdown_connections 2024-05-30T17:01:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 -- 172.21.15.59:0/11077709 wait complete. 2024-05-30T17:01:25.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 -- start start 2024-05-30T17:01:25.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 Processor -- start 2024-05-30T17:01:25.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba235650 0x5585ba23ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 0x5585ba23b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba282a40 0x5585ba23b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5585ba026ec0 con 0x5585ba282120 2024-05-30T17:01:25.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5585ba107120 con 0x5585ba235650 2024-05-30T17:01:25.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5585ba091350 con 0x5585ba282a40 2024-05-30T17:01:25.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65f0877000 10 client.0 _ll_register_callbacks cb 0x5585ba0634d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65dde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 0x5585ba23b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65dde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 0x5585ba23b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38014/0 (socket says 172.21.15.59:38014) 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65dde00640 1 -- 172.21.15.59:0/481428261 learned_addr learned my addr 172.21.15.59:0/481428261 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65e6800640 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba235650 0x5585ba23ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65e7200640 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba282a40 0x5585ba23b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65dde00640 1 -- 172.21.15.59:0/481428261 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba282a40 msgr2=0x5585ba23b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65dde00640 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba282a40 0x5585ba23b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65dde00640 1 -- 172.21.15.59:0/481428261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba235650 msgr2=0x5585ba23ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65dde00640 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba235650 0x5585ba23ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65dde00640 1 -- 172.21.15.59:0/481428261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585ba0cbf80 con 0x5585ba282120 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65dde00640 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 0x5585ba23b080 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f65d001c8a0 tx=0x7f65d001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f180488874369ad0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T17:01:25.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.043+0000 7f65cbe00640 1 -- 172.21.15.59:0/481428261 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d00b0040 con 0x5585ba282120 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 -- 172.21.15.59:0/481428261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65e00072e0 con 0x5585ba282120 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65cbe00640 1 -- 172.21.15.59:0/481428261 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f65d0003db0 con 0x5585ba282120 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65cbe00640 1 -- 172.21.15.59:0/481428261 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f65d00cf050 con 0x5585ba282120 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 10 client.8100 fetch_fsmap learned FSMap version 61 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 -- 172.21.15.59:0/481428261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x5585ba05ff00 con 0x5585ba282120 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65cbe00640 1 -- 172.21.15.59:0/481428261 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e00072e0 con 0x5585ba282120 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65cbe00640 1 -- 172.21.15.59:0/481428261 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f65d00d2020 con 0x5585ba282120 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 10 client.8100 fetch_fsmap finished waiting for FSMap version 61 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 10 client.8100 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 20 client.8100 populate_metadata read hostname 'smithi059' 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.59:6833/1525464146,v1:172.21.15.59:6835/1525464146] conn(0x5585ba2913c0 0x5585ba2937b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 4 client.8100 mds_command: new command op to 7986 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 -- 172.21.15.59:0/481428261 --> [v2:172.21.15.59:6833/1525464146,v1:172.21.15.59:6835/1525464146] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585ba01fbc0 con 0x5585ba2913c0 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65e6800640 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.59:6833/1525464146,v1:172.21.15.59:6835/1525464146] conn(0x5585ba2913c0 0x5585ba2937b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65e6800640 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.59:6833/1525464146,v1:172.21.15.59:6835/1525464146] conn(0x5585ba2913c0 0x5585ba2937b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4787c525274eda8 server_cookie=4ed490da0f92c479 in_seq=0 out_seq=0 2024-05-30T17:01:25.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65cbe00640 10 client.8100 ms_handle_connect on v2:172.21.15.59:6833/1525464146 2024-05-30T17:01:25.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65cbe00640 1 -- 172.21.15.59:0/481428261 <== mds.0 v2:172.21.15.59:6833/1525464146 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5585ba01fbc0 con 0x5585ba2913c0 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65cbe00640 10 client.8100 handle_command_reply: tid=0 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 client.8100 shutdown 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 -- 172.21.15.59:0/481428261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 msgr2=0x5585ba23b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 0x5585ba23b080 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f65d001c8a0 tx=0x7f65d001ac00 comp rx=0 tx=0).stop 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 -- 172.21.15.59:0/481428261 shutdown_connections 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba282a40 0x5585ba23b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.59:6833/1525464146,v1:172.21.15.59:6835/1525464146] conn(0x5585ba2913c0 0x5585ba2937b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 0x5585ba23b080 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 --2- 172.21.15.59:0/481428261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba235650 0x5585ba23ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65cbe00640 0 client.8100 ms_handle_reset on v2:172.21.15.59:6833/1525464146 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 -- 172.21.15.59:0/481428261 >> 172.21.15.59:0/481428261 conn(0x5585ba262ec0 msgr2=0x5585ba2652b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 -- 172.21.15.59:0/481428261 shutdown_connections 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 1 -- 172.21.15.59:0/481428261 wait complete. 2024-05-30T17:01:25.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.047+0000 7f65f0877000 20 client.8100 trim_cache size 0 max 16384 2024-05-30T17:01:25.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 Processor -- start 2024-05-30T17:01:25.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 -- start start 2024-05-30T17:01:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba262ec0 0x5585ba234770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 0x5585ba234cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba282120 0x5585ba2937b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f65e8202bc0 con 0x5585ba235650 2024-05-30T17:01:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f65e8154d00 con 0x5585ba282120 2024-05-30T17:01:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f65e82025d0 con 0x5585ba262ec0 2024-05-30T17:01:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65dde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 0x5585ba234cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65dde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 0x5585ba234cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38020/0 (socket says 172.21.15.59:38020) 2024-05-30T17:01:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65dde00640 1 -- 172.21.15.59:0/3673585025 learned_addr learned my addr 172.21.15.59:0/3673585025 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65e6800640 1 --2- 172.21.15.59:0/3673585025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba262ec0 0x5585ba234770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65e7200640 1 --2- 172.21.15.59:0/3673585025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba282120 0x5585ba2937b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65dde00640 1 -- 172.21.15.59:0/3673585025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba262ec0 msgr2=0x5585ba234770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65dde00640 1 --2- 172.21.15.59:0/3673585025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba262ec0 0x5585ba234770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65dde00640 1 -- 172.21.15.59:0/3673585025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba282120 msgr2=0x5585ba2937b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65dde00640 1 --2- 172.21.15.59:0/3673585025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba282120 0x5585ba2937b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65dde00640 1 -- 172.21.15.59:0/3673585025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585ba282870 con 0x5585ba235650 2024-05-30T17:01:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65dde00640 1 --2- 172.21.15.59:0/3673585025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 0x5585ba234cb0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f65d001c680 tx=0x7f65d00b9070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3699940462911a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65d6a00640 1 -- 172.21.15.59:0/3673585025 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d00b0070 con 0x5585ba235650 2024-05-30T17:01:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65d6a00640 1 -- 172.21.15.59:0/3673585025 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d00c7070 con 0x5585ba235650 2024-05-30T17:01:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65d6a00640 1 -- 172.21.15.59:0/3673585025 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d00c27a0 con 0x5585ba235650 2024-05-30T17:01:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 -- 172.21.15.59:0/3673585025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 msgr2=0x5585ba234cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 --2- 172.21.15.59:0/3673585025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 0x5585ba234cb0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f65d001c680 tx=0x7f65d00b9070 comp rx=0 tx=0).stop 2024-05-30T17:01:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 -- 172.21.15.59:0/3673585025 shutdown_connections 2024-05-30T17:01:25.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 --2- 172.21.15.59:0/3673585025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba282120 0x5585ba2937b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 --2- 172.21.15.59:0/3673585025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba235650 0x5585ba234cb0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 --2- 172.21.15.59:0/3673585025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba262ec0 0x5585ba234770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 -- 172.21.15.59:0/3673585025 >> 172.21.15.59:0/3673585025 conn(0x5585ba23d540 msgr2=0x5585ba296a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:25.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 -- 172.21.15.59:0/3673585025 shutdown_connections 2024-05-30T17:01:25.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 -- 172.21.15.59:0/3673585025 wait complete. 2024-05-30T17:01:25.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.067+0000 7f65f0877000 1 -- start start 2024-05-30T17:01:25.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 Processor -- start 2024-05-30T17:01:25.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba235650 0x5585ba296970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba262ec0 0x5585ba2ad340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 0x5585ba2ad880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5585ba085730 con 0x5585ba282120 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5585ba0529e0 con 0x5585ba235650 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5585ba08aa50 con 0x5585ba262ec0 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 10 client.0 _ll_register_callbacks cb 0x7f65cc003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65e7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 0x5585ba2ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65e6800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba235650 0x5585ba296970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65e7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 0x5585ba2ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38028/0 (socket says 172.21.15.59:38028) 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65e7200640 1 -- 172.21.15.59:0/2807888544 learned_addr learned my addr 172.21.15.59:0/2807888544 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65dde00640 1 --2- 172.21.15.59:0/2807888544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba262ec0 0x5585ba2ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65e7200640 1 -- 172.21.15.59:0/2807888544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba262ec0 msgr2=0x5585ba2ad340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65e7200640 1 --2- 172.21.15.59:0/2807888544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba262ec0 0x5585ba2ad340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65e7200640 1 -- 172.21.15.59:0/2807888544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba235650 msgr2=0x5585ba296970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65e7200640 1 --2- 172.21.15.59:0/2807888544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba235650 0x5585ba296970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65e7200640 1 -- 172.21.15.59:0/2807888544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585ba00ce80 con 0x5585ba282120 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65e7200640 1 --2- 172.21.15.59:0/2807888544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 0x5585ba2ad880 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f65e0001d00 tx=0x7f65e0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f9a3783ad24ca3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65cbe00640 1 -- 172.21.15.59:0/2807888544 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0026020 con 0x5585ba282120 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65cbe00640 1 -- 172.21.15.59:0/2807888544 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f65e0004d80 con 0x5585ba282120 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 -- 172.21.15.59:0/2807888544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65d00c7070 con 0x5585ba282120 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65cbe00640 1 -- 172.21.15.59:0/2807888544 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f65e0030050 con 0x5585ba282120 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 10 client.8106 fetch_fsmap learned FSMap version 61 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 -- 172.21.15.59:0/2807888544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x5585ba04eb30 con 0x5585ba282120 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65cbe00640 1 -- 172.21.15.59:0/2807888544 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d00c7070 con 0x5585ba282120 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65cbe00640 1 -- 172.21.15.59:0/2807888544 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f65e0033020 con 0x5585ba282120 2024-05-30T17:01:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 10 client.8106 fetch_fsmap finished waiting for FSMap version 61 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 10 client.8106 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 20 client.8106 populate_metadata read hostname 'smithi059' 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 --2- 172.21.15.59:0/2807888544 >> [v2:172.21.15.59:6833/1525464146,v1:172.21.15.59:6835/1525464146] conn(0x5585ba282a40 0x5585ba2addc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 4 client.8106 mds_command: new command op to 7986 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 -- 172.21.15.59:0/2807888544 --> [v2:172.21.15.59:6833/1525464146,v1:172.21.15.59:6835/1525464146] -- command(tid 0: {"prefix": "status"}) -- 0x5585ba093e40 con 0x5585ba282a40 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65e6800640 1 --2- 172.21.15.59:0/2807888544 >> [v2:172.21.15.59:6833/1525464146,v1:172.21.15.59:6835/1525464146] conn(0x5585ba282a40 0x5585ba2addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65e6800640 1 --2- 172.21.15.59:0/2807888544 >> [v2:172.21.15.59:6833/1525464146,v1:172.21.15.59:6835/1525464146] conn(0x5585ba282a40 0x5585ba2addc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a0fbf0a37510bed server_cookie=2c57257a695f35b1 in_seq=0 out_seq=0 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65cbe00640 10 client.8106 ms_handle_connect on v2:172.21.15.59:6833/1525464146 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65cbe00640 1 -- 172.21.15.59:0/2807888544 <== mds.0 v2:172.21.15.59:6833/1525464146 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5585ba093e40 con 0x5585ba282a40 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65cbe00640 10 client.8106 handle_command_reply: tid=0 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 client.8106 shutdown 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 -- 172.21.15.59:0/2807888544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 msgr2=0x5585ba2ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 --2- 172.21.15.59:0/2807888544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 0x5585ba2ad880 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f65e0001d00 tx=0x7f65e0001e90 comp rx=0 tx=0).stop 2024-05-30T17:01:25.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 -- 172.21.15.59:0/2807888544 shutdown_connections 2024-05-30T17:01:25.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 --2- 172.21.15.59:0/2807888544 >> [v2:172.21.15.59:6833/1525464146,v1:172.21.15.59:6835/1525464146] conn(0x5585ba282a40 0x5585ba2addc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 --2- 172.21.15.59:0/2807888544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585ba282120 0x5585ba2ad880 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 --2- 172.21.15.59:0/2807888544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5585ba262ec0 0x5585ba2ad340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 --2- 172.21.15.59:0/2807888544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5585ba235650 0x5585ba296970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65cbe00640 0 client.8106 ms_handle_reset on v2:172.21.15.59:6833/1525464146 2024-05-30T17:01:25.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.071+0000 7f65f0877000 1 -- 172.21.15.59:0/2807888544 >> 172.21.15.59:0/2807888544 conn(0x5585ba23d540 msgr2=0x5585ba2801d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:25.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65f0877000 1 -- 172.21.15.59:0/2807888544 shutdown_connections 2024-05-30T17:01:25.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65f0877000 1 -- 172.21.15.59:0/2807888544 wait complete. 2024-05-30T17:01:25.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65f0877000 20 client.8106 trim_cache size 0 max 16384 2024-05-30T17:01:25.081 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:01:25.081 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:01:25.081 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-05-30T17:01:25.081 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7986, 2024-05-30T17:01:25.081 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-05-30T17:01:25.081 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-05-30T17:01:25.081 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-05-30T17:01:25.081 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 5.9787360449999998, 2024-05-30T17:01:25.081 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 61, 2024-05-30T17:01:25.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 104, 2024-05-30T17:01:25.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 104, 2024-05-30T17:01:25.082 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 10.821594709999999 2024-05-30T17:01:25.082 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:01:25.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65ed400640 1 -- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f65c4069850 msgr2=0x7f65c406bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65ed400640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f65c4069850 0x7f65c406bd10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f65d00ad000 tx=0x7f65d00a6000 comp rx=0 tx=0).stop 2024-05-30T17:01:25.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65ed400640 1 -- 172.21.15.59:0/2303423258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e80b4510 msgr2=0x7f65e8155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65ed400640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e80b4510 0x7f65e8155ad0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f65d800e870 tx=0x7f65d800ed30 comp rx=0 tx=0).stop 2024-05-30T17:01:25.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65ed400640 1 -- 172.21.15.59:0/2303423258 shutdown_connections 2024-05-30T17:01:25.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65ed400640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f65c4069850 0x7f65c406bd10 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65ed400640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65e815f5f0 0x7f65e813fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65ed400640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e80b48f0 0x7f65e8158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65ed400640 1 --2- 172.21.15.59:0/2303423258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e80b4510 0x7f65e8155ad0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65ed400640 1 -- 172.21.15.59:0/2303423258 >> 172.21.15.59:0/2303423258 conn(0x7f65e80b3240 msgr2=0x7f65e80b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:25.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65ed400640 1 -- 172.21.15.59:0/2303423258 shutdown_connections 2024-05-30T17:01:25.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.075+0000 7f65ed400640 1 -- 172.21.15.59:0/2303423258 wait complete. 2024-05-30T17:01:25.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T17:01:25.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9ea00640 1 Processor -- start 2024-05-30T17:01:25.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9ea00640 1 -- start start 2024-05-30T17:01:25.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3f9815c7f0 0x7f3f980ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f980b19f0 0x7f3f980b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f980b0e50 0x7f3f980b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9ea00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3f980b7450 con 0x7f3f980b0e50 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9ea00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3f980d1cf0 con 0x7f3f9815c7f0 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9ea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3f980d1fd0 con 0x7f3f980b19f0 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9e000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f980b0e50 0x7f3f980b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9e000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f980b0e50 0x7f3f980b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38042/0 (socket says 172.21.15.59:38042) 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9e000640 1 -- 172.21.15.59:0/2714535958 learned_addr learned my addr 172.21.15.59:0/2714535958 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9d600640 1 --2- 172.21.15.59:0/2714535958 >> v2:172.21.15.107:3300/0 conn(0x7f3f9815c7f0 0x7f3f980ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9cc00640 1 --2- 172.21.15.59:0/2714535958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f980b19f0 0x7f3f980b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9e000640 1 -- 172.21.15.59:0/2714535958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f980b19f0 msgr2=0x7f3f980b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9e000640 1 --2- 172.21.15.59:0/2714535958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f980b19f0 0x7f3f980b6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9e000640 1 -- 172.21.15.59:0/2714535958 >> v2:172.21.15.107:3300/0 conn(0x7f3f9815c7f0 msgr2=0x7f3f980ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9e000640 1 --2- 172.21.15.59:0/2714535958 >> v2:172.21.15.107:3300/0 conn(0x7f3f9815c7f0 0x7f3f980ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9e000640 1 -- 172.21.15.59:0/2714535958 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f980cf870 con 0x7f3f980b0e50 2024-05-30T17:01:25.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.235+0000 7f3f9d600640 1 --2- 172.21.15.59:0/2714535958 >> v2:172.21.15.107:3300/0 conn(0x7f3f9815c7f0 0x7f3f980ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:25.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f9e000640 1 --2- 172.21.15.59:0/2714535958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f980b0e50 0x7f3f980b12e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f3f9806a520 tx=0x7f3f9001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b389810fc2cd43fa server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:25.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f97e00640 1 -- 172.21.15.59:0/2714535958 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f900b4070 con 0x7f3f980b0e50 2024-05-30T17:01:25.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f97e00640 1 -- 172.21.15.59:0/2714535958 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f900af400 con 0x7f3f980b0e50 2024-05-30T17:01:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f97e00640 1 -- 172.21.15.59:0/2714535958 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f900af7d0 con 0x7f3f980b0e50 2024-05-30T17:01:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f9ea00640 1 -- 172.21.15.59:0/2714535958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f980b0e50 msgr2=0x7f3f980b12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f9ea00640 1 --2- 172.21.15.59:0/2714535958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f980b0e50 0x7f3f980b12e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f3f9806a520 tx=0x7f3f9001f1e0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f9ea00640 1 -- 172.21.15.59:0/2714535958 shutdown_connections 2024-05-30T17:01:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f9ea00640 1 --2- 172.21.15.59:0/2714535958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f980b0e50 0x7f3f980b12e0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f9ea00640 1 --2- 172.21.15.59:0/2714535958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f980b19f0 0x7f3f980b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f9ea00640 1 --2- 172.21.15.59:0/2714535958 >> v2:172.21.15.107:3300/0 conn(0x7f3f9815c7f0 0x7f3f980ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f9ea00640 1 -- 172.21.15.59:0/2714535958 >> 172.21.15.59:0/2714535958 conn(0x7f3f9809aa40 msgr2=0x7f3f980b6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f9ea00640 1 -- 172.21.15.59:0/2714535958 shutdown_connections 2024-05-30T17:01:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.239+0000 7f3f9ea00640 1 -- 172.21.15.59:0/2714535958 wait complete. 2024-05-30T17:01:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9ea00640 1 Processor -- start 2024-05-30T17:01:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9ea00640 1 -- start start 2024-05-30T17:01:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f980b0e50 0x7f3f980cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f980b19f0 0x7f3f980cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9815c7f0 0x7f3f980b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9ea00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3f980cf580 con 0x7f3f9815c7f0 2024-05-30T17:01:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9ea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3f980cf400 con 0x7f3f980b0e50 2024-05-30T17:01:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9ea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3f980d0070 con 0x7f3f980b19f0 2024-05-30T17:01:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9815c7f0 0x7f3f980b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9815c7f0 0x7f3f980b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38050/0 (socket says 172.21.15.59:38050) 2024-05-30T17:01:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9e000640 1 -- 172.21.15.59:0/1762039015 learned_addr learned my addr 172.21.15.59:0/1762039015 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9cc00640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f980b19f0 0x7f3f980cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9d600640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f980b0e50 0x7f3f980cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9e000640 1 -- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f980b19f0 msgr2=0x7f3f980cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9e000640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f980b19f0 0x7f3f980cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9e000640 1 -- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f980b0e50 msgr2=0x7f3f980cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9e000640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f980b0e50 0x7f3f980cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9e000640 1 -- 172.21.15.59:0/1762039015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f981493e0 con 0x7f3f9815c7f0 2024-05-30T17:01:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f9e000640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9815c7f0 0x7f3f980b5100 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b2040 tx=0x7f3f9001bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:25.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.243+0000 7f3f95600640 1 -- 172.21.15.59:0/1762039015 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f900b4040 con 0x7f3f9815c7f0 2024-05-30T17:01:25.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.247+0000 7f3f95600640 1 -- 172.21.15.59:0/1762039015 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f900c0070 con 0x7f3f9815c7f0 2024-05-30T17:01:25.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.247+0000 7f3f95600640 1 -- 172.21.15.59:0/1762039015 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90009510 con 0x7f3f9815c7f0 2024-05-30T17:01:25.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.247+0000 7f3f9ea00640 1 -- 172.21.15.59:0/1762039015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9815be20 con 0x7f3f9815c7f0 2024-05-30T17:01:25.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.247+0000 7f3f9ea00640 1 -- 172.21.15.59:0/1762039015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f980cc0f0 con 0x7f3f9815c7f0 2024-05-30T17:01:25.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.247+0000 7f3f9ea00640 1 -- 172.21.15.59:0/1762039015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f98068a90 con 0x7f3f9815c7f0 2024-05-30T17:01:25.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.247+0000 7f3f95600640 1 -- 172.21.15.59:0/1762039015 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f3f900c5460 con 0x7f3f9815c7f0 2024-05-30T17:01:25.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.247+0000 7f3f95600640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3f78069850 0x7f3f7806bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:25.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.247+0000 7f3f95600640 1 -- 172.21.15.59:0/1762039015 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f3f90123a70 con 0x7f3f9815c7f0 2024-05-30T17:01:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.247+0000 7f3f9d600640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3f78069850 0x7f3f7806bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:25.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.251+0000 7f3f9d600640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3f78069850 0x7f3f7806bd10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0045f0 tx=0x7f3f8c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.251+0000 7f3f95600640 1 -- 172.21.15.59:0/1762039015 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f900ca020 con 0x7f3f9815c7f0 2024-05-30T17:01:25.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.455+0000 7f3f9ea00640 1 -- 172.21.15.59:0/1762039015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3f980cb2c0 con 0x7f3f9815c7f0 2024-05-30T17:01:25.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.455+0000 7f3f95600640 1 -- 172.21.15.59:0/1762039015 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) ==== 53+0+73 (secure 0 0 0) 0x7f3f981493e0 con 0x7f3f9815c7f0 2024-05-30T17:01:25.458 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T17:01:25.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.459+0000 7f3f9ea00640 1 -- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3f78069850 msgr2=0x7f3f7806bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.459+0000 7f3f9ea00640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3f78069850 0x7f3f7806bd10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0045f0 tx=0x7f3f8c008040 comp rx=0 tx=0).stop 2024-05-30T17:01:25.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.459+0000 7f3f9ea00640 1 -- 172.21.15.59:0/1762039015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9815c7f0 msgr2=0x7f3f980b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:25.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.459+0000 7f3f9ea00640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9815c7f0 0x7f3f980b5100 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b2040 tx=0x7f3f9001bf80 comp rx=0 tx=0).stop 2024-05-30T17:01:25.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.459+0000 7f3f9ea00640 1 -- 172.21.15.59:0/1762039015 shutdown_connections 2024-05-30T17:01:25.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.459+0000 7f3f9ea00640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3f78069850 0x7f3f7806bd10 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.459+0000 7f3f9ea00640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9815c7f0 0x7f3f980b5100 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.459+0000 7f3f9ea00640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f980b19f0 0x7f3f980cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.459+0000 7f3f9ea00640 1 --2- 172.21.15.59:0/1762039015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f980b0e50 0x7f3f980cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:25.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.459+0000 7f3f9ea00640 1 -- 172.21.15.59:0/1762039015 >> 172.21.15.59:0/1762039015 conn(0x7f3f9809aa40 msgr2=0x7f3f980b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:25.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.459+0000 7f3f9ea00640 1 -- 172.21.15.59:0/1762039015 shutdown_connections 2024-05-30T17:01:25.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25.459+0000 7f3f9ea00640 1 -- 172.21.15.59:0/1762039015 wait complete. 2024-05-30T17:01:25.479 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T17:01:25.479 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T17:01:25.479 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-05-30T17:01:25.480 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T17:01:25.480 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T17:01:25.480 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T17:01:25.480 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T17:01:25.480 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T17:01:25.480 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T17:01:25.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:25.480 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-05-30T17:01:25.489 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T17:01:25.489 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-05-30T17:01:25.490 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41704sec preferred_lft 41704sec 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:46:82:05:9a brd ff:ff:ff:ff:ff:ff 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T17:01:25.491 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T17:01:25.492 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T17:01:25.492 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:01:25.492 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T17:01:25.492 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:01:25.492 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T17:01:25.492 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:01:25.492 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T17:01:25.492 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:01:25.492 INFO:teuthology.orchestra.run.smithi059.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T17:01:25.492 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:01:25.492 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T17:01:25.492 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:01:25.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:25.493 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T17:01:25.553 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-05-30T17:01:25.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:25.555 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-05-30T17:01:25.612 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-05-30T17:01:25.613 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T17:01:25.613 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T17:01:25.613 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T17:01:25.613 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T17:01:25.613 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T17:01:25.613 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T17:01:25.613 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T17:01:25.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T17:01:25.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T17:01:25.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T17:01:25.613 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T17:01:25.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T17:01:25.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T17:01:25.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:25.753 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-05-30T17:01:25.762 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T17:01:25.762 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T17:01:25.763 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T17:01:25.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:25.763 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-05-30T17:01:25.823 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-30T17:01:25.824 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T17:01:25.824 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T17:01:25.876 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T17:01:25.876 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T17:01:25.876 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T17:01:25.927 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T17:01:25.988 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T17:01:26.045 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T17:01:26.045 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T17:01:26.045 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T17:01:26.045 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T17:01:26.045 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T17:01:26.045 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T17:01:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:01:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:01:26.048 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:01:26.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:26.048 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T17:01:26.099 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-30T17:01:26.099 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-30T17:01:26.150 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T17:01:26.170 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T17:01:26.221 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T17:01:26.221 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T17:01:26.221 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T17:01:26.221 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T17:01:26.221 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T17:01:26.221 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T17:01:26.222 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T17:01:26.222 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T17:01:26.222 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T17:01:26.222 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T17:01:26.222 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T17:01:26.222 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T17:01:26.222 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T17:01:26.222 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T17:01:26.222 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T17:01:26.222 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T17:01:26.222 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:01:26.223 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:01:26.224 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:01:26.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:26.225 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T17:01:26.245 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:2024-05-30T17:01:26.243+0000 7f4934c21580 -1 init, newargv = 0x5570b31d5ec0 newargc=15 2024-05-30T17:01:26.245 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[47983]: starting ceph client 2024-05-30T17:01:26.253 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[47983]: starting fuse 2024-05-30T17:01:26.254 INFO:teuthology.orchestra.run.smithi059.stdout:44 2024-05-30T17:01:26.254 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-30T17:01:26.254 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2024-05-30T17:01:26.254 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2024-05-30T17:01:26.254 DEBUG:teuthology.orchestra.run.smithi059:> import re 2024-05-30T17:01:26.254 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-05-30T17:01:26.254 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2024-05-30T17:01:26.254 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T17:01:26.254 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2024-05-30T17:01:26.254 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> return f 2024-05-30T17:01:26.255 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-30T17:01:26.256 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T17:01:26.256 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.0")) 2024-05-30T17:01:26.256 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-05-30T17:01:26.383 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.0.47983.asok 2024-05-30T17:01:26.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T17:01:26.394 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47983.asok 2024-05-30T17:01:26.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:26.395 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47983.asok status 2024-05-30T17:01:26.571 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:01:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2024-05-30T17:01:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "9ed025fbf4406fb54980a0647506b15895b6d863", 2024-05-30T17:01:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-3154-g9ed025fb (9ed025fbf4406fb54980a0647506b15895b6d863) squid (dev)", 2024-05-30T17:01:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "0", 2024-05-30T17:01:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2024-05-30T17:01:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-30T17:01:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "47983", 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8121, 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 8121 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T17:01:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 124912227 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 124912227 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.8121 192.168.0.1:0/124912227", 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/124912227", 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 61, 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 104, 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2024-05-30T17:01:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2024-05-30T17:01:26.574 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:01:26.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:26.587 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2024-05-30T17:01:26.587 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-30T17:01:26.596 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2024-05-30T17:01:26.596 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-30T17:01:26.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:26.596 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T17:01:26.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T17:01:26.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.843+0000 7f8385800640 1 Processor -- start 2024-05-30T17:01:26.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.843+0000 7f8385800640 1 -- start start 2024-05-30T17:01:26.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f8385800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f838006d0d0 0x7f838006f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:26.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f8385800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83800730e0 0x7f838006f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:26.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f8385800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83800b3d50 con 0x7f8380161e20 2024-05-30T17:01:26.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f8385800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f83800b4030 con 0x7f83800730e0 2024-05-30T17:01:26.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f8385800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f838006e7c0 con 0x7f838006d0d0 2024-05-30T17:01:26.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f837f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83800730e0 0x7f838006f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:26.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f837f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83800730e0 0x7f838006f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38066/0 (socket says 172.21.15.59:38066) 2024-05-30T17:01:26.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f837f400640 1 -- 172.21.15.59:0/3295945829 learned_addr learned my addr 172.21.15.59:0/3295945829 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:26.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f8377e00640 1 --2- 172.21.15.59:0/3295945829 >> v2:172.21.15.107:3300/0 conn(0x7f838006d0d0 0x7f838006f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:26.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f837f400640 1 -- 172.21.15.59:0/3295945829 >> v2:172.21.15.107:3300/0 conn(0x7f838006d0d0 msgr2=0x7f838006f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:26.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f837f400640 1 --2- 172.21.15.59:0/3295945829 >> v2:172.21.15.107:3300/0 conn(0x7f838006d0d0 0x7f838006f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:26.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f837f400640 1 -- 172.21.15.59:0/3295945829 >> v1:172.21.15.107:6789/0 conn(0x7f8380161e20 legacy=0x7f838006c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:26.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.847+0000 7f837f400640 1 -- 172.21.15.59:0/3295945829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838006eaa0 con 0x7f83800730e0 2024-05-30T17:01:26.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f837f400640 1 --2- 172.21.15.59:0/3295945829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83800730e0 0x7f838006f7e0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f83800721a0 tx=0x7f837801f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741b34487b9ff5cc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:26.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f837e000640 1 -- 172.21.15.59:0/3295945829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83780b4070 con 0x7f83800730e0 2024-05-30T17:01:26.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f837e000640 1 -- 172.21.15.59:0/3295945829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83780af400 con 0x7f83800730e0 2024-05-30T17:01:26.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f837e000640 1 -- 172.21.15.59:0/3295945829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83780af7d0 con 0x7f83800730e0 2024-05-30T17:01:26.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 -- 172.21.15.59:0/3295945829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83800730e0 msgr2=0x7f838006f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:26.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 --2- 172.21.15.59:0/3295945829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83800730e0 0x7f838006f7e0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f83800721a0 tx=0x7f837801f1a0 comp rx=0 tx=0).stop 2024-05-30T17:01:26.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 -- 172.21.15.59:0/3295945829 shutdown_connections 2024-05-30T17:01:26.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 --2- 172.21.15.59:0/3295945829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83800730e0 0x7f838006f7e0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:26.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 --2- 172.21.15.59:0/3295945829 >> v2:172.21.15.107:3300/0 conn(0x7f838006d0d0 0x7f838006f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:26.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 -- 172.21.15.59:0/3295945829 >> 172.21.15.59:0/3295945829 conn(0x7f83800725c0 msgr2=0x7f83800729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:26.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 -- 172.21.15.59:0/3295945829 shutdown_connections 2024-05-30T17:01:26.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 -- 172.21.15.59:0/3295945829 wait complete. 2024-05-30T17:01:26.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 Processor -- start 2024-05-30T17:01:26.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 -- start start 2024-05-30T17:01:26.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838006d0d0 0x7f83800cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:26.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83800730e0 0x7f83801543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:26.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8380161e20 0x7f8380157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:26.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f83800d0820 con 0x7f838006d0d0 2024-05-30T17:01:26.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f83800b3a20 con 0x7f83800730e0 2024-05-30T17:01:26.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.851+0000 7f8385800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f83800cd0d0 con 0x7f8380161e20 2024-05-30T17:01:26.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f837ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838006d0d0 0x7f83800cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:26.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f8377e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83800730e0 0x7f83801543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:26.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f837ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838006d0d0 0x7f83800cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38076/0 (socket says 172.21.15.59:38076) 2024-05-30T17:01:26.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f837ea00640 1 -- 172.21.15.59:0/1556584318 learned_addr learned my addr 172.21.15.59:0/1556584318 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:26.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f837f400640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8380161e20 0x7f8380157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:26.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f837ea00640 1 -- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8380161e20 msgr2=0x7f8380157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:26.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f837ea00640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8380161e20 0x7f8380157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:26.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f837ea00640 1 -- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83800730e0 msgr2=0x7f83801543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:26.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f837ea00640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83800730e0 0x7f83801543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:26.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f837ea00640 1 -- 172.21.15.59:0/1556584318 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83801f79f0 con 0x7f838006d0d0 2024-05-30T17:01:26.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f837ea00640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838006d0d0 0x7f83800cfc00 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f837000b440 tx=0x7f837000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:26.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f8376a00640 1 -- 172.21.15.59:0/1556584318 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370015020 con 0x7f838006d0d0 2024-05-30T17:01:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f8376a00640 1 -- 172.21.15.59:0/1556584318 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8370011890 con 0x7f838006d0d0 2024-05-30T17:01:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f8376a00640 1 -- 172.21.15.59:0/1556584318 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370011c80 con 0x7f838006d0d0 2024-05-30T17:01:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f8385800640 1 -- 172.21.15.59:0/1556584318 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83801f7cd0 con 0x7f838006d0d0 2024-05-30T17:01:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f8385800640 1 -- 172.21.15.59:0/1556584318 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83801f8290 con 0x7f838006d0d0 2024-05-30T17:01:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f8385800640 1 -- 172.21.15.59:0/1556584318 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8380068a90 con 0x7f838006d0d0 2024-05-30T17:01:26.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.855+0000 7f8376a00640 1 -- 172.21.15.59:0/1556584318 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f8370018020 con 0x7f838006d0d0 2024-05-30T17:01:26.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.859+0000 7f8376a00640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f835c069850 0x7f835c06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:26.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.859+0000 7f8376a00640 1 -- 172.21.15.59:0/1556584318 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f83700853f0 con 0x7f838006d0d0 2024-05-30T17:01:26.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.859+0000 7f8377e00640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f835c069850 0x7f835c06bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:26.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.859+0000 7f8377e00640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f835c069850 0x7f835c06bd10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8380157f00 tx=0x7f8368008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:26.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:26.863+0000 7f8376a00640 1 -- 172.21.15.59:0/1556584318 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f837001f030 con 0x7f838006d0d0 2024-05-30T17:01:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.063+0000 7f8385800640 1 -- 172.21.15.59:0/1556584318 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f83800b1b20 con 0x7f838006d0d0 2024-05-30T17:01:27.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.143+0000 7f8376a00640 1 -- 172.21.15.59:0/1556584318 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v62) ==== 136+0+0 (secure 0 0 0) 0x7f837000d040 con 0x7f838006d0d0 2024-05-30T17:01:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.147+0000 7f8385800640 1 -- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f835c069850 msgr2=0x7f835c06bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.147+0000 7f8385800640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f835c069850 0x7f835c06bd10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8380157f00 tx=0x7f8368008040 comp rx=0 tx=0).stop 2024-05-30T17:01:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.147+0000 7f8385800640 1 -- 172.21.15.59:0/1556584318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838006d0d0 msgr2=0x7f83800cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.147+0000 7f8385800640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838006d0d0 0x7f83800cfc00 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f837000b440 tx=0x7f837000b900 comp rx=0 tx=0).stop 2024-05-30T17:01:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.147+0000 7f8385800640 1 -- 172.21.15.59:0/1556584318 shutdown_connections 2024-05-30T17:01:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.147+0000 7f8385800640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f835c069850 0x7f835c06bd10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.147+0000 7f8385800640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8380161e20 0x7f8380157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.147+0000 7f8385800640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83800730e0 0x7f83801543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.147+0000 7f8385800640 1 --2- 172.21.15.59:0/1556584318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838006d0d0 0x7f83800cfc00 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.147+0000 7f8385800640 1 -- 172.21.15.59:0/1556584318 >> 172.21.15.59:0/1556584318 conn(0x7f83800725c0 msgr2=0x7f83800729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.147+0000 7f8385800640 1 -- 172.21.15.59:0/1556584318 shutdown_connections 2024-05-30T17:01:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.147+0000 7f8385800640 1 -- 172.21.15.59:0/1556584318 wait complete. 2024-05-30T17:01:27.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T17:01:27.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.307+0000 7fc504a00640 1 Processor -- start 2024-05-30T17:01:27.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.311+0000 7fc504a00640 1 -- start start 2024-05-30T17:01:27.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.311+0000 7fc504a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc5000ad8c0 0x7fc50015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:27.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.311+0000 7fc504a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50015d730 con 0x7fc500159df0 2024-05-30T17:01:27.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.311+0000 7fc504a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5000b3370 con 0x7fc50015a1d0 2024-05-30T17:01:27.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.311+0000 7fc504a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc5000b3650 con 0x7fc5000ad8c0 2024-05-30T17:01:27.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.311+0000 7fc4fd400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc5000ad8c0 0x7fc50015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:27.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.311+0000 7fc4fde00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc500159df0 0x7fc5000ad1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45614/0 (socket says 172.21.15.59:45614) 2024-05-30T17:01:27.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.311+0000 7fc4fde00640 1 -- 172.21.15.59:0/696100118 learned_addr learned my addr 172.21.15.59:0/696100118 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:27.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.311+0000 7fc4fd400640 1 -- 172.21.15.59:0/696100118 >> v1:172.21.15.107:6789/0 conn(0x7fc50015a1d0 legacy=0x7fc50015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.311+0000 7fc4fd400640 1 -- 172.21.15.59:0/696100118 >> v1:172.21.15.59:6789/0 conn(0x7fc500159df0 legacy=0x7fc5000ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.311+0000 7fc4fd400640 1 -- 172.21.15.59:0/696100118 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5000b3930 con 0x7fc5000ad8c0 2024-05-30T17:01:27.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc4fd400640 1 --2- 172.21.15.59:0/696100118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5000ad8c0 0x7fc50015ca70 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0097c0 tx=0x7fc4ec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72c04c7d92e30d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:27.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc4fca00640 1 -- 172.21.15.59:0/696100118 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0b0070 con 0x7fc5000ad8c0 2024-05-30T17:01:27.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc4fca00640 1 -- 172.21.15.59:0/696100118 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4ec0ab600 con 0x7fc5000ad8c0 2024-05-30T17:01:27.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc4fca00640 1 -- 172.21.15.59:0/696100118 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0ab9d0 con 0x7fc5000ad8c0 2024-05-30T17:01:27.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc504a00640 1 -- 172.21.15.59:0/696100118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5000ad8c0 msgr2=0x7fc50015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc504a00640 1 --2- 172.21.15.59:0/696100118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5000ad8c0 0x7fc50015ca70 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0097c0 tx=0x7fc4ec01c4a0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc504a00640 1 -- 172.21.15.59:0/696100118 shutdown_connections 2024-05-30T17:01:27.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc504a00640 1 --2- 172.21.15.59:0/696100118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5000ad8c0 0x7fc50015ca70 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc504a00640 1 -- 172.21.15.59:0/696100118 >> 172.21.15.59:0/696100118 conn(0x7fc5000b22d0 msgr2=0x7fc5000b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:27.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc504a00640 1 -- 172.21.15.59:0/696100118 shutdown_connections 2024-05-30T17:01:27.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc504a00640 1 -- 172.21.15.59:0/696100118 wait complete. 2024-05-30T17:01:27.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc504a00640 1 Processor -- start 2024-05-30T17:01:27.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.315+0000 7fc504a00640 1 -- start start 2024-05-30T17:01:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc504a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc5000ad8c0 0x7fc500167650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc504a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc500159df0 0x7fc5000735f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc504a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc50015a1d0 0x7fc5000994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc504a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc50016a7a0 con 0x7fc500159df0 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc504a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc50016a620 con 0x7fc50015a1d0 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc504a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc50016a920 con 0x7fc5000ad8c0 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4fd400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc500159df0 0x7fc5000735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4fd400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc500159df0 0x7fc5000735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38082/0 (socket says 172.21.15.59:38082) 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4fd400640 1 -- 172.21.15.59:0/923804527 learned_addr learned my addr 172.21.15.59:0/923804527 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4fe800640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc50015a1d0 0x7fc5000994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4fde00640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc5000ad8c0 0x7fc500167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4fd400640 1 -- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc5000ad8c0 msgr2=0x7fc500167650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4fd400640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc5000ad8c0 0x7fc500167650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4fd400640 1 -- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc50015a1d0 msgr2=0x7fc5000994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4fd400640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc50015a1d0 0x7fc5000994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4fd400640 1 -- 172.21.15.59:0/923804527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50014dbc0 con 0x7fc500159df0 2024-05-30T17:01:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4fd400640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc500159df0 0x7fc5000735f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0190b0 tx=0x7fc4ec01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4f6000640 1 -- 172.21.15.59:0/923804527 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0b0050 con 0x7fc500159df0 2024-05-30T17:01:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4f6000640 1 -- 172.21.15.59:0/923804527 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4ec0bc070 con 0x7fc500159df0 2024-05-30T17:01:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4f6000640 1 -- 172.21.15.59:0/923804527 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0aae40 con 0x7fc500159df0 2024-05-30T17:01:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc504a00640 1 -- 172.21.15.59:0/923804527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50014dea0 con 0x7fc500159df0 2024-05-30T17:01:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc504a00640 1 -- 172.21.15.59:0/923804527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50014e460 con 0x7fc500159df0 2024-05-30T17:01:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc504a00640 1 -- 172.21.15.59:0/923804527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc500068a90 con 0x7fc500159df0 2024-05-30T17:01:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.319+0000 7fc4f6000640 1 -- 172.21.15.59:0/923804527 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fc4ec0ab420 con 0x7fc500159df0 2024-05-30T17:01:27.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.323+0000 7fc4f6000640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc4e0069880 0x7fc4e006bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:27.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.323+0000 7fc4f6000640 1 -- 172.21.15.59:0/923804527 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7fc4ec120200 con 0x7fc500159df0 2024-05-30T17:01:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.323+0000 7fc4fde00640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc4e0069880 0x7fc4e006bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.323+0000 7fc4fde00640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc4e0069880 0x7fc4e006bd40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0005890 tx=0x7fc4f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.327+0000 7fc4f6000640 1 -- 172.21.15.59:0/923804527 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc4ec016090 con 0x7fc500159df0 2024-05-30T17:01:27.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.511+0000 7fc504a00640 1 -- 172.21.15.59:0/923804527 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fc5000b4ef0 con 0x7fc4e0069880 2024-05-30T17:01:27.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc4f6000640 1 -- 172.21.15.59:0/923804527 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fc5000b4ef0 con 0x7fc4e0069880 2024-05-30T17:01:27.517 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:01:27.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:01:27.517 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T17:01:27.518 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:01:27.518 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:01:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc504a00640 1 -- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc4e0069880 msgr2=0x7fc4e006bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc504a00640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc4e0069880 0x7fc4e006bd40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0005890 tx=0x7fc4f0009040 comp rx=0 tx=0).stop 2024-05-30T17:01:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc504a00640 1 -- 172.21.15.59:0/923804527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc500159df0 msgr2=0x7fc5000735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc504a00640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc500159df0 0x7fc5000735f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0190b0 tx=0x7fc4ec01ace0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc504a00640 1 -- 172.21.15.59:0/923804527 shutdown_connections 2024-05-30T17:01:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc504a00640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc4e0069880 0x7fc4e006bd40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc504a00640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc50015a1d0 0x7fc5000994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc504a00640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc500159df0 0x7fc5000735f0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc504a00640 1 --2- 172.21.15.59:0/923804527 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc5000ad8c0 0x7fc500167650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc504a00640 1 -- 172.21.15.59:0/923804527 >> 172.21.15.59:0/923804527 conn(0x7fc5000b22d0 msgr2=0x7fc500151910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc504a00640 1 -- 172.21.15.59:0/923804527 shutdown_connections 2024-05-30T17:01:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.515+0000 7fc504a00640 1 -- 172.21.15.59:0/923804527 wait complete. 2024-05-30T17:01:27.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T17:01:27.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.679+0000 7fb40a800640 1 Processor -- start 2024-05-30T17:01:27.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.679+0000 7fb40a800640 1 -- start start 2024-05-30T17:01:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.683+0000 7fb40a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4041569e0 0x7fb40415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.683+0000 7fb40a800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4040ad770 con 0x7fb4040d0660 2024-05-30T17:01:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.683+0000 7fb40a800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb40415cb40 con 0x7fb4040ad2b0 2024-05-30T17:01:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.683+0000 7fb40a800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb40415ce20 con 0x7fb4041569e0 2024-05-30T17:01:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.683+0000 7fb403400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4041569e0 0x7fb40415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.683+0000 7fb403e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb4040d0660 0x7fb4040b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45620/0 (socket says 172.21.15.59:45620) 2024-05-30T17:01:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.683+0000 7fb403e00640 1 -- 172.21.15.59:0/861981477 learned_addr learned my addr 172.21.15.59:0/861981477 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:27.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.683+0000 7fb403400640 1 -- 172.21.15.59:0/861981477 >> v1:172.21.15.107:6789/0 conn(0x7fb4040ad2b0 legacy=0x7fb4040cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:27.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.683+0000 7fb403400640 1 -- 172.21.15.59:0/861981477 >> v1:172.21.15.59:6789/0 conn(0x7fb4040d0660 legacy=0x7fb4040b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.683+0000 7fb403400640 1 -- 172.21.15.59:0/861981477 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40415d100 con 0x7fb4041569e0 2024-05-30T17:01:27.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.683+0000 7fb402a00640 1 -- 172.21.15.59:0/861981477 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3339371642 0 0) 0x7fb4040ad770 con 0x7fb4040d0660 2024-05-30T17:01:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb403400640 1 --2- 172.21.15.59:0/861981477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4041569e0 0x7fb40415d620 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40097c0 tx=0x7fb3f401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899b3c77b6d2f9bc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb402a00640 1 -- 172.21.15.59:0/861981477 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40b0070 con 0x7fb4041569e0 2024-05-30T17:01:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb402a00640 1 -- 172.21.15.59:0/861981477 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f40ab600 con 0x7fb4041569e0 2024-05-30T17:01:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb402a00640 1 -- 172.21.15.59:0/861981477 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40ab9d0 con 0x7fb4041569e0 2024-05-30T17:01:27.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb40a800640 1 -- 172.21.15.59:0/861981477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4041569e0 msgr2=0x7fb40415d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb40a800640 1 --2- 172.21.15.59:0/861981477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4041569e0 0x7fb40415d620 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40097c0 tx=0x7fb3f401c3d0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb40a800640 1 -- 172.21.15.59:0/861981477 shutdown_connections 2024-05-30T17:01:27.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb40a800640 1 --2- 172.21.15.59:0/861981477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4041569e0 0x7fb40415d620 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb40a800640 1 -- 172.21.15.59:0/861981477 >> 172.21.15.59:0/861981477 conn(0x7fb40406bdb0 msgr2=0x7fb40406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:27.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb40a800640 1 -- 172.21.15.59:0/861981477 shutdown_connections 2024-05-30T17:01:27.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb40a800640 1 -- 172.21.15.59:0/861981477 wait complete. 2024-05-30T17:01:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb40a800640 1 Processor -- start 2024-05-30T17:01:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb40a800640 1 -- start start 2024-05-30T17:01:27.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.687+0000 7fb40a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4040ad2b0 0x7fb4041f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:27.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb40a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4040d0660 0x7fb40414a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb40a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4041569e0 0x7fb40409c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb40a800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb40416a340 con 0x7fb4040ad2b0 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb40a800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb40416a1c0 con 0x7fb4040d0660 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb40a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb40416a4c0 con 0x7fb4041569e0 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb403400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4040ad2b0 0x7fb4041f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb403400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4040ad2b0 0x7fb4041f86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38100/0 (socket says 172.21.15.59:38100) 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb403400640 1 -- 172.21.15.59:0/163769501 learned_addr learned my addr 172.21.15.59:0/163769501 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb3faa00640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4040d0660 0x7fb40414a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb403e00640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4041569e0 0x7fb40409c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb403400640 1 -- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4041569e0 msgr2=0x7fb40409c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb403400640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4041569e0 0x7fb40409c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb403400640 1 -- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4040d0660 msgr2=0x7fb40414a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb403400640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4040d0660 0x7fb40414a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb403400640 1 -- 172.21.15.59:0/163769501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb404149390 con 0x7fb4040ad2b0 2024-05-30T17:01:27.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb403400640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4040ad2b0 0x7fb4041f86c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40097c0 tx=0x7fb3f401ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:27.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb3fbe00640 1 -- 172.21.15.59:0/163769501 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40bd070 con 0x7fb4040ad2b0 2024-05-30T17:01:27.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb3fbe00640 1 -- 172.21.15.59:0/163769501 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f4004030 con 0x7fb4040ad2b0 2024-05-30T17:01:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb3fbe00640 1 -- 172.21.15.59:0/163769501 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40b0040 con 0x7fb4040ad2b0 2024-05-30T17:01:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb40a800640 1 -- 172.21.15.59:0/163769501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb404149670 con 0x7fb4040ad2b0 2024-05-30T17:01:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb40a800640 1 -- 172.21.15.59:0/163769501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb404149c30 con 0x7fb4040ad2b0 2024-05-30T17:01:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb40a800640 1 -- 172.21.15.59:0/163769501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb404149f60 con 0x7fb4040ad2b0 2024-05-30T17:01:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.691+0000 7fb3fbe00640 1 -- 172.21.15.59:0/163769501 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fb3f4003620 con 0x7fb4040ad2b0 2024-05-30T17:01:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.695+0000 7fb3fbe00640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb3e0069880 0x7fb3e006bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.695+0000 7fb3fbe00640 1 -- 172.21.15.59:0/163769501 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7fb3f411f630 con 0x7fb4040ad2b0 2024-05-30T17:01:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.695+0000 7fb3faa00640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb3e0069880 0x7fb3e006bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:27.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.695+0000 7fb3faa00640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb3e0069880 0x7fb3e006bd40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb40415c0a0 tx=0x7fb3ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:27.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.699+0000 7fb3fbe00640 1 -- 172.21.15.59:0/163769501 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb3f4016050 con 0x7fb4040ad2b0 2024-05-30T17:01:27.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.863+0000 7fb40a800640 1 -- 172.21.15.59:0/163769501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb404068a90 con 0x7fb4040ad2b0 2024-05-30T17:01:27.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb3fbe00640 1 -- 172.21.15.59:0/163769501 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7fb3f40f11d0 con 0x7fb4040ad2b0 2024-05-30T17:01:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb40a800640 1 -- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb3e0069880 msgr2=0x7fb3e006bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb40a800640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb3e0069880 0x7fb3e006bd40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb40415c0a0 tx=0x7fb3ec009040 comp rx=0 tx=0).stop 2024-05-30T17:01:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb40a800640 1 -- 172.21.15.59:0/163769501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4040ad2b0 msgr2=0x7fb4041f86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb40a800640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4040ad2b0 0x7fb4041f86c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40097c0 tx=0x7fb3f401ac10 comp rx=0 tx=0).stop 2024-05-30T17:01:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb40a800640 1 -- 172.21.15.59:0/163769501 shutdown_connections 2024-05-30T17:01:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb40a800640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb3e0069880 0x7fb3e006bd40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb40a800640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4041569e0 0x7fb40409c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb40a800640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4040d0660 0x7fb40414a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb40a800640 1 --2- 172.21.15.59:0/163769501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4040ad2b0 0x7fb4041f86c0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:27.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb40a800640 1 -- 172.21.15.59:0/163769501 >> 172.21.15.59:0/163769501 conn(0x7fb40406bdb0 msgr2=0x7fb4040cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:27.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb40a800640 1 -- 172.21.15.59:0/163769501 shutdown_connections 2024-05-30T17:01:27.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:27.867+0000 7fb40a800640 1 -- 172.21.15.59:0/163769501 wait complete. 2024-05-30T17:01:27.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T17:01:28.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.031+0000 7f7381000640 1 Processor -- start 2024-05-30T17:01:28.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.031+0000 7f7381000640 1 -- start start 2024-05-30T17:01:28.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7381000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f737c156e40 0x7f737c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7381000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f737c06dc60 0x7f737c15d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7381000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f737c0af130 0x7f737c0af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7381000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f737c15db80 con 0x7f737c06dc60 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7381000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f737c06e120 con 0x7f737c156e40 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7381000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f737c06e400 con 0x7f737c0af130 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7371400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f737c06dc60 0x7f737c15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7371400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f737c06dc60 0x7f737c15d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38108/0 (socket says 172.21.15.59:38108) 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7371400640 1 -- 172.21.15.59:0/2932410785 learned_addr learned my addr 172.21.15.59:0/2932410785 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7371400640 1 -- 172.21.15.59:0/2932410785 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f737c0af130 msgr2=0x7f737c0af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7371400640 1 --2- 172.21.15.59:0/2932410785 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f737c0af130 0x7f737c0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7371400640 1 -- 172.21.15.59:0/2932410785 >> v2:172.21.15.107:3300/0 conn(0x7f737c156e40 msgr2=0x7f737c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7371400640 1 --2- 172.21.15.59:0/2932410785 >> v2:172.21.15.107:3300/0 conn(0x7f737c156e40 0x7f737c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7371400640 1 -- 172.21.15.59:0/2932410785 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c06e6e0 con 0x7f737c06dc60 2024-05-30T17:01:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.035+0000 7f7371400640 1 --2- 172.21.15.59:0/2932410785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f737c06dc60 0x7f737c15d640 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f737c073f70 tx=0x7f736401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc05dc5e197980ff server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7379400640 1 -- 172.21.15.59:0/2932410785 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73640b1070 con 0x7f737c06dc60 2024-05-30T17:01:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7379400640 1 -- 172.21.15.59:0/2932410785 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73640ac630 con 0x7f737c06dc60 2024-05-30T17:01:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7379400640 1 -- 172.21.15.59:0/2932410785 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73640a8050 con 0x7f737c06dc60 2024-05-30T17:01:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 -- 172.21.15.59:0/2932410785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f737c06dc60 msgr2=0x7f737c15d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 --2- 172.21.15.59:0/2932410785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f737c06dc60 0x7f737c15d640 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f737c073f70 tx=0x7f736401c520 comp rx=0 tx=0).stop 2024-05-30T17:01:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 -- 172.21.15.59:0/2932410785 shutdown_connections 2024-05-30T17:01:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 --2- 172.21.15.59:0/2932410785 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f737c0af130 0x7f737c0af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 --2- 172.21.15.59:0/2932410785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f737c06dc60 0x7f737c15d640 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 --2- 172.21.15.59:0/2932410785 >> v2:172.21.15.107:3300/0 conn(0x7f737c156e40 0x7f737c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 -- 172.21.15.59:0/2932410785 >> 172.21.15.59:0/2932410785 conn(0x7f737c0b1e60 msgr2=0x7f737c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 -- 172.21.15.59:0/2932410785 shutdown_connections 2024-05-30T17:01:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 -- 172.21.15.59:0/2932410785 wait complete. 2024-05-30T17:01:28.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 Processor -- start 2024-05-30T17:01:28.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 -- start start 2024-05-30T17:01:28.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f737c06dc60 0x7f737c071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c0af130 0x7f737c1fa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f737c156e40 0x7f737c1faa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f737c15e920 con 0x7f737c06dc60 2024-05-30T17:01:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f737c15e7a0 con 0x7f737c0af130 2024-05-30T17:01:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7381000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f737c15eaa0 con 0x7f737c156e40 2024-05-30T17:01:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7379e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f737c06dc60 0x7f737c071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7379e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f737c06dc60 0x7f737c071cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38110/0 (socket says 172.21.15.59:38110) 2024-05-30T17:01:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.039+0000 7f7379e00640 1 -- 172.21.15.59:0/1447480177 learned_addr learned my addr 172.21.15.59:0/1447480177 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:28.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7371400640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c0af130 0x7f737c1fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7379e00640 1 -- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f737c156e40 msgr2=0x7f737c1faa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f737a800640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f737c156e40 0x7f737c1faa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7379e00640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f737c156e40 0x7f737c1faa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7379e00640 1 -- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c0af130 msgr2=0x7f737c1fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7379e00640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c0af130 0x7f737c1fa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7379e00640 1 -- 172.21.15.59:0/1447480177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c1f8c30 con 0x7f737c06dc60 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7371400640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c0af130 0x7f737c1fa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f737a800640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f737c156e40 0x7f737c1faa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7379e00640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f737c06dc60 0x7f737c071cb0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f736c00ba80 tx=0x7f736c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7372a00640 1 -- 172.21.15.59:0/1447480177 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c019070 con 0x7f737c06dc60 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7372a00640 1 -- 172.21.15.59:0/1447480177 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f736c00cc20 con 0x7f737c06dc60 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7381000640 1 -- 172.21.15.59:0/1447480177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737c14b4f0 con 0x7f737c06dc60 2024-05-30T17:01:28.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7372a00640 1 -- 172.21.15.59:0/1447480177 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c014440 con 0x7f737c06dc60 2024-05-30T17:01:28.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7381000640 1 -- 172.21.15.59:0/1447480177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737c14bab0 con 0x7f737c06dc60 2024-05-30T17:01:28.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7381000640 1 -- 172.21.15.59:0/1447480177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f737c068a90 con 0x7f737c06dc60 2024-05-30T17:01:28.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.043+0000 7f7372a00640 1 -- 172.21.15.59:0/1447480177 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f736c01c070 con 0x7f737c06dc60 2024-05-30T17:01:28.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.047+0000 7f7372a00640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7358069850 0x7f735806bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.047+0000 7f7372a00640 1 -- 172.21.15.59:0/1447480177 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f736c085330 con 0x7f737c06dc60 2024-05-30T17:01:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.047+0000 7f7371400640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7358069850 0x7f735806bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.047+0000 7f7371400640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7358069850 0x7f735806bd10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f73640ae000 tx=0x7f7364008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:28.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.051+0000 7f7372a00640 1 -- 172.21.15.59:0/1447480177 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f736c056cf0 con 0x7f737c06dc60 2024-05-30T17:01:28.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.243+0000 7f7381000640 1 -- 172.21.15.59:0/1447480177 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f737c06fab0 con 0x7f7358069850 2024-05-30T17:01:28.257 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:28.261+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:28.257 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:28.261+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:28.257 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:28.261+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:28.257 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:28.261+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:28.257 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:28.261+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:28.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.291+0000 7f7372a00640 1 -- 172.21.15.59:0/1447480177 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f737c06fab0 con 0x7f7358069850 2024-05-30T17:01:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.295+0000 7f7381000640 1 -- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7358069850 msgr2=0x7f735806bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.295+0000 7f7381000640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7358069850 0x7f735806bd10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f73640ae000 tx=0x7f7364008040 comp rx=0 tx=0).stop 2024-05-30T17:01:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.295+0000 7f7381000640 1 -- 172.21.15.59:0/1447480177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f737c06dc60 msgr2=0x7f737c071cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.295+0000 7f7381000640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f737c06dc60 0x7f737c071cb0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f736c00ba80 tx=0x7f736c00bf40 comp rx=0 tx=0).stop 2024-05-30T17:01:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.295+0000 7f7381000640 1 -- 172.21.15.59:0/1447480177 shutdown_connections 2024-05-30T17:01:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.295+0000 7f7381000640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7358069850 0x7f735806bd10 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.295+0000 7f7381000640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f737c156e40 0x7f737c1faa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.295+0000 7f7381000640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c0af130 0x7f737c1fa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.295+0000 7f7381000640 1 --2- 172.21.15.59:0/1447480177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f737c06dc60 0x7f737c071cb0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.295+0000 7f7381000640 1 -- 172.21.15.59:0/1447480177 >> 172.21.15.59:0/1447480177 conn(0x7f737c0b1e60 msgr2=0x7f737c0d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.295+0000 7f7381000640 1 -- 172.21.15.59:0/1447480177 shutdown_connections 2024-05-30T17:01:28.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.295+0000 7f7381000640 1 -- 172.21.15.59:0/1447480177 wait complete. 2024-05-30T17:01:28.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T17:01:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc39a400640 1 Processor -- start 2024-05-30T17:01:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc39a400640 1 -- start start 2024-05-30T17:01:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc39a400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc394161fd0 0x7fc3940d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc39a400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3940cb9b0 0x7fc3940b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc39a400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc39406b9b0 0x7fc39406be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc39a400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc3940d1150 con 0x7fc394161fd0 2024-05-30T17:01:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc39a400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc3940d0b90 con 0x7fc39406b9b0 2024-05-30T17:01:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc39a400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc3940d0e70 con 0x7fc3940cb9b0 2024-05-30T17:01:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc393400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc394161fd0 0x7fc3940d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc393400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc394161fd0 0x7fc3940d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38114/0 (socket says 172.21.15.59:38114) 2024-05-30T17:01:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc393400640 1 -- 172.21.15.59:0/3993223249 learned_addr learned my addr 172.21.15.59:0/3993223249 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc38be00640 1 --2- 172.21.15.59:0/3993223249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3940cb9b0 0x7fc3940b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.459+0000 7fc393e00640 1 --2- 172.21.15.59:0/3993223249 >> v2:172.21.15.107:3300/0 conn(0x7fc39406b9b0 0x7fc39406be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc393400640 1 -- 172.21.15.59:0/3993223249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3940cb9b0 msgr2=0x7fc3940b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc393400640 1 --2- 172.21.15.59:0/3993223249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3940cb9b0 0x7fc3940b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc393400640 1 -- 172.21.15.59:0/3993223249 >> v2:172.21.15.107:3300/0 conn(0x7fc39406b9b0 msgr2=0x7fc39406be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc393400640 1 --2- 172.21.15.59:0/3993223249 >> v2:172.21.15.107:3300/0 conn(0x7fc39406b9b0 0x7fc39406be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc393400640 1 -- 172.21.15.59:0/3993223249 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3940cd620 con 0x7fc394161fd0 2024-05-30T17:01:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc393e00640 1 --2- 172.21.15.59:0/3993223249 >> v2:172.21.15.107:3300/0 conn(0x7fc39406b9b0 0x7fc39406be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc393400640 1 --2- 172.21.15.59:0/3993223249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc394161fd0 0x7fc3940d05b0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc3940b7510 tx=0x7fc38401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72d28442eabcc73 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc392a00640 1 -- 172.21.15.59:0/3993223249 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3840b0070 con 0x7fc394161fd0 2024-05-30T17:01:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc392a00640 1 -- 172.21.15.59:0/3993223249 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3840ab600 con 0x7fc394161fd0 2024-05-30T17:01:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc392a00640 1 -- 172.21.15.59:0/3993223249 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3840ab9d0 con 0x7fc394161fd0 2024-05-30T17:01:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc39a400640 1 -- 172.21.15.59:0/3993223249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc394161fd0 msgr2=0x7fc3940d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc39a400640 1 --2- 172.21.15.59:0/3993223249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc394161fd0 0x7fc3940d05b0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc3940b7510 tx=0x7fc38401c490 comp rx=0 tx=0).stop 2024-05-30T17:01:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc39a400640 1 -- 172.21.15.59:0/3993223249 shutdown_connections 2024-05-30T17:01:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc39a400640 1 --2- 172.21.15.59:0/3993223249 >> v2:172.21.15.107:3300/0 conn(0x7fc39406b9b0 0x7fc39406be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc39a400640 1 --2- 172.21.15.59:0/3993223249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3940cb9b0 0x7fc3940b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc39a400640 1 --2- 172.21.15.59:0/3993223249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc394161fd0 0x7fc3940d05b0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc39a400640 1 -- 172.21.15.59:0/3993223249 >> 172.21.15.59:0/3993223249 conn(0x7fc3940b2f50 msgr2=0x7fc3940b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc39a400640 1 -- 172.21.15.59:0/3993223249 shutdown_connections 2024-05-30T17:01:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.463+0000 7fc39a400640 1 -- 172.21.15.59:0/3993223249 wait complete. 2024-05-30T17:01:28.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc39a400640 1 Processor -- start 2024-05-30T17:01:28.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc39a400640 1 -- start start 2024-05-30T17:01:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc39a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39406b9b0 0x7fc3940b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc39a400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3940cb9b0 0x7fc394156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc39a400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc394161fd0 0x7fc394158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc39a400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc3940cea00 con 0x7fc39406b9b0 2024-05-30T17:01:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc39a400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc3940ce880 con 0x7fc3940cb9b0 2024-05-30T17:01:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc39a400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc3940ceb80 con 0x7fc394161fd0 2024-05-30T17:01:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc393400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39406b9b0 0x7fc3940b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc393400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39406b9b0 0x7fc3940b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38130/0 (socket says 172.21.15.59:38130) 2024-05-30T17:01:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc393400640 1 -- 172.21.15.59:0/694201069 learned_addr learned my addr 172.21.15.59:0/694201069 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc38be00640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3940cb9b0 0x7fc394156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc393e00640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc394161fd0 0x7fc394158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc393400640 1 -- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc394161fd0 msgr2=0x7fc394158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc393400640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc394161fd0 0x7fc394158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc393400640 1 -- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3940cb9b0 msgr2=0x7fc394156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc393400640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3940cb9b0 0x7fc394156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc393400640 1 -- 172.21.15.59:0/694201069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3940b1610 con 0x7fc39406b9b0 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc393e00640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc394161fd0 0x7fc394158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc393400640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39406b9b0 0x7fc3940b2080 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc3840ae040 tx=0x7fc38401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc38b400640 1 -- 172.21.15.59:0/694201069 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3840ba020 con 0x7fc39406b9b0 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc38b400640 1 -- 172.21.15.59:0/694201069 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3840b6420 con 0x7fc39406b9b0 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc39a400640 1 -- 172.21.15.59:0/694201069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc394158aa0 con 0x7fc39406b9b0 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc38b400640 1 -- 172.21.15.59:0/694201069 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3840b0040 con 0x7fc39406b9b0 2024-05-30T17:01:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.467+0000 7fc39a400640 1 -- 172.21.15.59:0/694201069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3940b1880 con 0x7fc39406b9b0 2024-05-30T17:01:28.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.471+0000 7fc39a400640 1 -- 172.21.15.59:0/694201069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc394068a90 con 0x7fc39406b9b0 2024-05-30T17:01:28.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.471+0000 7fc38b400640 1 -- 172.21.15.59:0/694201069 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7fc3840bd020 con 0x7fc39406b9b0 2024-05-30T17:01:28.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.471+0000 7fc38b400640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc370069850 0x7fc37006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.471+0000 7fc38b400640 1 -- 172.21.15.59:0/694201069 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7fc38411f6a0 con 0x7fc39406b9b0 2024-05-30T17:01:28.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.471+0000 7fc38be00640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc370069850 0x7fc37006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.471+0000 7fc38be00640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc370069850 0x7fc37006bd10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc39415ccc0 tx=0x7fc37c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:28.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.475+0000 7fc38b400640 1 -- 172.21.15.59:0/694201069 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc3840c4030 con 0x7fc39406b9b0 2024-05-30T17:01:28.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.667+0000 7fc39a400640 1 -- 172.21.15.59:0/694201069 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fc3940cc960 con 0x7fc370069850 2024-05-30T17:01:28.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc38b400640 1 -- 172.21.15.59:0/694201069 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fc3940cc960 con 0x7fc370069850 2024-05-30T17:01:28.677 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b 2024-05-30T17:01:28.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc39a400640 1 -- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc370069850 msgr2=0x7fc37006bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc39a400640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc370069850 0x7fc37006bd10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc39415ccc0 tx=0x7fc37c009190 comp rx=0 tx=0).stop 2024-05-30T17:01:28.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc39a400640 1 -- 172.21.15.59:0/694201069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39406b9b0 msgr2=0x7fc3940b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc39a400640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39406b9b0 0x7fc3940b2080 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc3840ae040 tx=0x7fc38401acd0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc39a400640 1 -- 172.21.15.59:0/694201069 shutdown_connections 2024-05-30T17:01:28.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc39a400640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc370069850 0x7fc37006bd10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc39a400640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc394161fd0 0x7fc394158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc39a400640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3940cb9b0 0x7fc394156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc39a400640 1 --2- 172.21.15.59:0/694201069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39406b9b0 0x7fc3940b2080 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc39a400640 1 -- 172.21.15.59:0/694201069 >> 172.21.15.59:0/694201069 conn(0x7fc3940b2f50 msgr2=0x7fc39415b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:28.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc39a400640 1 -- 172.21.15.59:0/694201069 shutdown_connections 2024-05-30T17:01:28.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.675+0000 7fc39a400640 1 -- 172.21.15.59:0/694201069 wait complete. 2024-05-30T17:01:28.699 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T17:01:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f268ba00640 1 Processor -- start 2024-05-30T17:01:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f268ba00640 1 -- start start 2024-05-30T17:01:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f268ba00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2684159100 0x7f268406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f268ba00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f26840b44e0 0x7f268415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f268ba00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f268415f510 0x7f268415c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f268ba00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f26840b52d0 con 0x7f26840b44e0 2024-05-30T17:01:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f268ba00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f26840b4a30 con 0x7f268415f510 2024-05-30T17:01:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f268ba00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f26840b4d10 con 0x7f2684159100 2024-05-30T17:01:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f2683e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f26840b44e0 0x7f268415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f2683e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f26840b44e0 0x7f268415efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38142/0 (socket says 172.21.15.59:38142) 2024-05-30T17:01:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f2683e00640 1 -- 172.21.15.59:0/2939396010 learned_addr learned my addr 172.21.15.59:0/2939396010 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f2689000640 1 --2- 172.21.15.59:0/2939396010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2684159100 0x7f268406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f2689a00640 1 --2- 172.21.15.59:0/2939396010 >> v2:172.21.15.107:3300/0 conn(0x7f268415f510 0x7f268415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f2683e00640 1 -- 172.21.15.59:0/2939396010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2684159100 msgr2=0x7f268406e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f2683e00640 1 --2- 172.21.15.59:0/2939396010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2684159100 0x7f268406e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f2683e00640 1 -- 172.21.15.59:0/2939396010 >> v2:172.21.15.107:3300/0 conn(0x7f268415f510 msgr2=0x7f268415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f2683e00640 1 --2- 172.21.15.59:0/2939396010 >> v2:172.21.15.107:3300/0 conn(0x7f268415f510 0x7f268415c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f2683e00640 1 -- 172.21.15.59:0/2939396010 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26840b4ff0 con 0x7f26840b44e0 2024-05-30T17:01:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.839+0000 7f2689a00640 1 --2- 172.21.15.59:0/2939396010 >> v2:172.21.15.107:3300/0 conn(0x7f268415f510 0x7f268415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:28.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f2683e00640 1 --2- 172.21.15.59:0/2939396010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26840b44e0 0x7f268415efd0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f26840b3380 tx=0x7f267001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a260d3c87c5f8535 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f2683400640 1 -- 172.21.15.59:0/2939396010 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26700b0070 con 0x7f26840b44e0 2024-05-30T17:01:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f2683400640 1 -- 172.21.15.59:0/2939396010 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26700ab600 con 0x7f26840b44e0 2024-05-30T17:01:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f2683400640 1 -- 172.21.15.59:0/2939396010 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26700ab9d0 con 0x7f26840b44e0 2024-05-30T17:01:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f268ba00640 1 -- 172.21.15.59:0/2939396010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26840b44e0 msgr2=0x7f268415efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f268ba00640 1 --2- 172.21.15.59:0/2939396010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26840b44e0 0x7f268415efd0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f26840b3380 tx=0x7f267001c3d0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f268ba00640 1 -- 172.21.15.59:0/2939396010 shutdown_connections 2024-05-30T17:01:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f268ba00640 1 --2- 172.21.15.59:0/2939396010 >> v2:172.21.15.107:3300/0 conn(0x7f268415f510 0x7f268415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f268ba00640 1 --2- 172.21.15.59:0/2939396010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26840b44e0 0x7f268415efd0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f268ba00640 1 --2- 172.21.15.59:0/2939396010 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2684159100 0x7f268406e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f268ba00640 1 -- 172.21.15.59:0/2939396010 >> 172.21.15.59:0/2939396010 conn(0x7f268406bdb0 msgr2=0x7f268406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f268ba00640 1 -- 172.21.15.59:0/2939396010 shutdown_connections 2024-05-30T17:01:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.843+0000 7f268ba00640 1 -- 172.21.15.59:0/2939396010 wait complete. 2024-05-30T17:01:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f268ba00640 1 Processor -- start 2024-05-30T17:01:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f268ba00640 1 -- start start 2024-05-30T17:01:28.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f268ba00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26840b44e0 0x7f268415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f268ba00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2684159100 0x7f26840b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f268ba00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f268415f510 0x7f268414d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f268ba00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2684072080 con 0x7f2684159100 2024-05-30T17:01:28.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f268ba00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2684071f00 con 0x7f268415f510 2024-05-30T17:01:28.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f268ba00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2684072200 con 0x7f26840b44e0 2024-05-30T17:01:28.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2683e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2684159100 0x7f26840b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2683e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2684159100 0x7f26840b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38148/0 (socket says 172.21.15.59:38148) 2024-05-30T17:01:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2683e00640 1 -- 172.21.15.59:0/3519278791 learned_addr learned my addr 172.21.15.59:0/3519278791 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2689000640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26840b44e0 0x7f268415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2689a00640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f268415f510 0x7f268414d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2683e00640 1 -- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26840b44e0 msgr2=0x7f268415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2683e00640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26840b44e0 0x7f268415aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2683e00640 1 -- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f268415f510 msgr2=0x7f268414d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2683e00640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f268415f510 0x7f268414d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2683e00640 1 -- 172.21.15.59:0/3519278791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26840cf4f0 con 0x7f2684159100 2024-05-30T17:01:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2689a00640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f268415f510 0x7f268414d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2683e00640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2684159100 0x7f26840b08e0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f26700ae040 tx=0x7f2670019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2680c00640 1 -- 172.21.15.59:0/3519278791 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26700b0040 con 0x7f2684159100 2024-05-30T17:01:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2680c00640 1 -- 172.21.15.59:0/3519278791 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26700b9070 con 0x7f2684159100 2024-05-30T17:01:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f268ba00640 1 -- 172.21.15.59:0/3519278791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26840cf790 con 0x7f2684159100 2024-05-30T17:01:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f2680c00640 1 -- 172.21.15.59:0/3519278791 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26700b4680 con 0x7f2684159100 2024-05-30T17:01:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f268ba00640 1 -- 172.21.15.59:0/3519278791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26840b00e0 con 0x7f2684159100 2024-05-30T17:01:28.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.847+0000 7f268ba00640 1 -- 172.21.15.59:0/3519278791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26840cfcb0 con 0x7f2684159100 2024-05-30T17:01:28.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.851+0000 7f2680c00640 1 -- 172.21.15.59:0/3519278791 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 31) ==== 89874+0+0 (secure 0 0 0) 0x7f26700b4820 con 0x7f2684159100 2024-05-30T17:01:28.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.851+0000 7f2680c00640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2664069880 0x7f266406bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:28.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.851+0000 7f2680c00640 1 -- 172.21.15.59:0/3519278791 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f267011f650 con 0x7f2684159100 2024-05-30T17:01:28.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.851+0000 7f2689000640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2664069880 0x7f266406bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:28.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.851+0000 7f2689000640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2664069880 0x7f266406bd40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f267800b240 tx=0x7f267800b3a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:28.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:28.855+0000 7f2680c00640 1 -- 172.21.15.59:0/3519278791 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f26840cfcb0 con 0x7f2684159100 2024-05-30T17:01:29.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.043+0000 7f268ba00640 1 -- 172.21.15.59:0/3519278791 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f2684068a90 con 0x7f2664069880 2024-05-30T17:01:29.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f2680c00640 1 -- 172.21.15.59:0/3519278791 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f2684068a90 con 0x7f2664069880 2024-05-30T17:01:29.052 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b 2024-05-30T17:01:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f268ba00640 1 -- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2664069880 msgr2=0x7f266406bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f268ba00640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2664069880 0x7f266406bd40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f267800b240 tx=0x7f267800b3a0 comp rx=0 tx=0).stop 2024-05-30T17:01:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f268ba00640 1 -- 172.21.15.59:0/3519278791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2684159100 msgr2=0x7f26840b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:29.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f268ba00640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2684159100 0x7f26840b08e0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f26700ae040 tx=0x7f2670019170 comp rx=0 tx=0).stop 2024-05-30T17:01:29.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f268ba00640 1 -- 172.21.15.59:0/3519278791 shutdown_connections 2024-05-30T17:01:29.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f268ba00640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2664069880 0x7f266406bd40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:29.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f268ba00640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f268415f510 0x7f268414d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:29.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f268ba00640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2684159100 0x7f26840b08e0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:29.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f268ba00640 1 --2- 172.21.15.59:0/3519278791 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26840b44e0 0x7f268415aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:29.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f268ba00640 1 -- 172.21.15.59:0/3519278791 >> 172.21.15.59:0/3519278791 conn(0x7f268406bdb0 msgr2=0x7f2684164cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:29.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f268ba00640 1 -- 172.21.15.59:0/3519278791 shutdown_connections 2024-05-30T17:01:29.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:29.051+0000 7f268ba00640 1 -- 172.21.15.59:0/3519278791 wait complete. 2024-05-30T17:01:29.074 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b 2024-05-30T17:01:29.074 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:01:29.074 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:01:29.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:29.083 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T17:01:35.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:01:35.393 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:01:36.194 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T17:01:36.194 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T17:01:36.194 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.04003 s, 153 MB/s 2024-05-30T17:01:36.195 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:01:36.195 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:01:36.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:36.204 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T17:01:43.031 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T17:01:43.031 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T17:01:43.032 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.77329 s, 159 MB/s 2024-05-30T17:01:43.033 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:01:43.033 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:01:43.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:43.041 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T17:01:49.862 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T17:01:49.862 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T17:01:49.862 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.76698 s, 159 MB/s 2024-05-30T17:01:49.864 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T17:01:50.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.006+0000 7f39fb000640 1 Processor -- start 2024-05-30T17:01:50.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.006+0000 7f39fb000640 1 -- start start 2024-05-30T17:01:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.010+0000 7f39fb000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39f40cfbb0 0x7f39f415ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.010+0000 7f39fb000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f40b3cf0 con 0x7f39f40723c0 2024-05-30T17:01:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.010+0000 7f39fb000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f40b3fd0 con 0x7f39f40b3730 2024-05-30T17:01:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.010+0000 7f39fb000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f39f40b42b0 con 0x7f39f40cfbb0 2024-05-30T17:01:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.010+0000 7f39f3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39f40cfbb0 0x7f39f415ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:50.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.010+0000 7f39f9000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f39f40723c0 0x7f39f406e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52120/0 (socket says 172.21.15.59:52120) 2024-05-30T17:01:50.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.010+0000 7f39f9000640 1 -- 172.21.15.59:0/247501590 learned_addr learned my addr 172.21.15.59:0/247501590 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:50.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.010+0000 7f39f3e00640 1 -- 172.21.15.59:0/247501590 >> v1:172.21.15.107:6789/0 conn(0x7f39f40b3730 legacy=0x7f39f4071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.010+0000 7f39f3e00640 1 -- 172.21.15.59:0/247501590 >> v1:172.21.15.59:6789/0 conn(0x7f39f40723c0 legacy=0x7f39f406e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.010+0000 7f39f3e00640 1 -- 172.21.15.59:0/247501590 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f40b4590 con 0x7f39f40cfbb0 2024-05-30T17:01:50.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.010+0000 7f39f3e00640 1 --2- 172.21.15.59:0/247501590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f40cfbb0 0x7f39f415ee70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f39e40097c0 tx=0x7f39e401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f798b156b4fef4e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:50.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39f3400640 1 -- 172.21.15.59:0/247501590 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e40b1070 con 0x7f39f40cfbb0 2024-05-30T17:01:50.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39f3400640 1 -- 172.21.15.59:0/247501590 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e40ac410 con 0x7f39f40cfbb0 2024-05-30T17:01:50.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39f3400640 1 -- 172.21.15.59:0/247501590 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e40ac7e0 con 0x7f39f40cfbb0 2024-05-30T17:01:50.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 -- 172.21.15.59:0/247501590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f40cfbb0 msgr2=0x7f39f415ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 --2- 172.21.15.59:0/247501590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f40cfbb0 0x7f39f415ee70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f39e40097c0 tx=0x7f39e401c4a0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 -- 172.21.15.59:0/247501590 shutdown_connections 2024-05-30T17:01:50.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 --2- 172.21.15.59:0/247501590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f40cfbb0 0x7f39f415ee70 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 -- 172.21.15.59:0/247501590 >> 172.21.15.59:0/247501590 conn(0x7f39f40b1e60 msgr2=0x7f39f40b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:50.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 -- 172.21.15.59:0/247501590 shutdown_connections 2024-05-30T17:01:50.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 -- 172.21.15.59:0/247501590 wait complete. 2024-05-30T17:01:50.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 Processor -- start 2024-05-30T17:01:50.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 -- start start 2024-05-30T17:01:50.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39f40723c0 0x7f39f414a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:50.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f40b3730 0x7f39f415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39f40cfbb0 0x7f39f4152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39f406f4b0 con 0x7f39f40b3730 2024-05-30T17:01:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f39f406f330 con 0x7f39f40723c0 2024-05-30T17:01:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39fb000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f39f416c810 con 0x7f39f40cfbb0 2024-05-30T17:01:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39ebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f40b3730 0x7f39f415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39ebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f40b3730 0x7f39f415a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41374/0 (socket says 172.21.15.59:41374) 2024-05-30T17:01:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39ebe00640 1 -- 172.21.15.59:0/835193001 learned_addr learned my addr 172.21.15.59:0/835193001 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39f3e00640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39f40723c0 0x7f39f414a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.014+0000 7f39f9000640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39f40cfbb0 0x7f39f4152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39ebe00640 1 -- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39f40cfbb0 msgr2=0x7f39f4152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39ebe00640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39f40cfbb0 0x7f39f4152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39ebe00640 1 -- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39f40723c0 msgr2=0x7f39f414a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39ebe00640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39f40723c0 0x7f39f414a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39ebe00640 1 -- 172.21.15.59:0/835193001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f415b360 con 0x7f39f40b3730 2024-05-30T17:01:50.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39ebe00640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f40b3730 0x7f39f415a9f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00c420 tx=0x7f39dc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:50.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39f0c00640 1 -- 172.21.15.59:0/835193001 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc0052d0 con 0x7f39f40b3730 2024-05-30T17:01:50.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39f0c00640 1 -- 172.21.15.59:0/835193001 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc005470 con 0x7f39f40b3730 2024-05-30T17:01:50.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39f0c00640 1 -- 172.21.15.59:0/835193001 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc007260 con 0x7f39f40b3730 2024-05-30T17:01:50.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39fb000640 1 -- 172.21.15.59:0/835193001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f415b640 con 0x7f39f40b3730 2024-05-30T17:01:50.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39fb000640 1 -- 172.21.15.59:0/835193001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f415bc00 con 0x7f39f40b3730 2024-05-30T17:01:50.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39fb000640 1 -- 172.21.15.59:0/835193001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f4068a90 con 0x7f39f40b3730 2024-05-30T17:01:50.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39f0c00640 1 -- 172.21.15.59:0/835193001 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 32) ==== 89925+0+0 (secure 0 0 0) 0x7f39dc007400 con 0x7f39f40b3730 2024-05-30T17:01:50.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39f0c00640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f39d00698e0 0x7f39d006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:50.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39f0c00640 1 -- 172.21.15.59:0/835193001 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f39dc084f70 con 0x7f39f40b3730 2024-05-30T17:01:50.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.018+0000 7f39f3e00640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f39d00698e0 0x7f39d006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:50.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.022+0000 7f39f3e00640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f39d00698e0 0x7f39d006bda0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f39e40ae000 tx=0x7f39e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:50.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.026+0000 7f39f0c00640 1 -- 172.21.15.59:0/835193001 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39dc056530 con 0x7f39f40b3730 2024-05-30T17:01:50.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.222+0000 7f39fb000640 1 -- 172.21.15.59:0/835193001 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f39f415c0a0 con 0x7f39d00698e0 2024-05-30T17:01:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.234+0000 7f39f0c00640 1 -- 172.21.15.59:0/835193001 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f39f415c0a0 con 0x7f39d00698e0 2024-05-30T17:01:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.238+0000 7f39fb000640 1 -- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f39d00698e0 msgr2=0x7f39d006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.238+0000 7f39fb000640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f39d00698e0 0x7f39d006bda0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f39e40ae000 tx=0x7f39e4008040 comp rx=0 tx=0).stop 2024-05-30T17:01:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.238+0000 7f39fb000640 1 -- 172.21.15.59:0/835193001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f40b3730 msgr2=0x7f39f415a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.238+0000 7f39fb000640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f40b3730 0x7f39f415a9f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00c420 tx=0x7f39dc00c8e0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.238+0000 7f39fb000640 1 -- 172.21.15.59:0/835193001 shutdown_connections 2024-05-30T17:01:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.238+0000 7f39fb000640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f39d00698e0 0x7f39d006bda0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.238+0000 7f39fb000640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39f40cfbb0 0x7f39f4152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.238+0000 7f39fb000640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f40b3730 0x7f39f415a9f0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.238+0000 7f39fb000640 1 --2- 172.21.15.59:0/835193001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39f40723c0 0x7f39f414a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.238+0000 7f39fb000640 1 -- 172.21.15.59:0/835193001 >> 172.21.15.59:0/835193001 conn(0x7f39f40b1e60 msgr2=0x7f39f415ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.238+0000 7f39fb000640 1 -- 172.21.15.59:0/835193001 shutdown_connections 2024-05-30T17:01:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.238+0000 7f39fb000640 1 -- 172.21.15.59:0/835193001 wait complete. 2024-05-30T17:01:50.261 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T17:01:50.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa94800640 1 Processor -- start 2024-05-30T17:01:50.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa94800640 1 -- start start 2024-05-30T17:01:50.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa94800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa8c06ce90 0x7ffa8c06c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:50.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa94800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa8c163260 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa94800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa8c1626e0 con 0x7ffa8c141f20 2024-05-30T17:01:50.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa94800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ffa8c1629c0 con 0x7ffa8c06ce90 2024-05-30T17:01:50.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa91e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffa8c0c9e10 0x7ffa8c0ca1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52136/0 (socket says 172.21.15.59:52136) 2024-05-30T17:01:50.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa91e00640 1 -- 172.21.15.59:0/1721068507 learned_addr learned my addr 172.21.15.59:0/1721068507 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:50.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa92800640 1 --2- 172.21.15.59:0/1721068507 >> v2:172.21.15.107:3300/0 conn(0x7ffa8c06ce90 0x7ffa8c06c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:50.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa90a00640 1 -- 172.21.15.59:0/1721068507 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2227952063 0 0) 0x7ffa8c163260 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa90a00640 1 -- 172.21.15.59:0/1721068507 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa74003530 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa90a00640 1 -- 172.21.15.59:0/1721068507 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444486792 0 0) 0x7ffa8c1626e0 con 0x7ffa8c141f20 2024-05-30T17:01:50.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa90a00640 1 -- 172.21.15.59:0/1721068507 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa8c163260 con 0x7ffa8c141f20 2024-05-30T17:01:50.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa92800640 1 -- 172.21.15.59:0/1721068507 >> v1:172.21.15.107:6789/0 conn(0x7ffa8c141f20 legacy=0x7ffa8c06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa92800640 1 -- 172.21.15.59:0/1721068507 >> v1:172.21.15.59:6789/0 conn(0x7ffa8c0c9e10 legacy=0x7ffa8c0ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.402+0000 7ffa92800640 1 -- 172.21.15.59:0/1721068507 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8c162ca0 con 0x7ffa8c06ce90 2024-05-30T17:01:50.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.406+0000 7ffa92800640 1 --2- 172.21.15.59:0/1721068507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c06ce90 0x7ffa8c06c3f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009d90 tx=0x7ffa8801c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a913b1637379ebe2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:50.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.406+0000 7ffa90a00640 1 -- 172.21.15.59:0/1721068507 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa880b2070 con 0x7ffa8c06ce90 2024-05-30T17:01:50.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.406+0000 7ffa90a00640 1 -- 172.21.15.59:0/1721068507 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa880a57f0 con 0x7ffa8c06ce90 2024-05-30T17:01:50.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.406+0000 7ffa90a00640 1 -- 172.21.15.59:0/1721068507 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa880a5bc0 con 0x7ffa8c06ce90 2024-05-30T17:01:50.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.406+0000 7ffa94800640 1 -- 172.21.15.59:0/1721068507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c06ce90 msgr2=0x7ffa8c06c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.406+0000 7ffa94800640 1 --2- 172.21.15.59:0/1721068507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c06ce90 0x7ffa8c06c3f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009d90 tx=0x7ffa8801c820 comp rx=0 tx=0).stop 2024-05-30T17:01:50.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.406+0000 7ffa94800640 1 -- 172.21.15.59:0/1721068507 shutdown_connections 2024-05-30T17:01:50.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.406+0000 7ffa94800640 1 --2- 172.21.15.59:0/1721068507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c06ce90 0x7ffa8c06c3f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.406+0000 7ffa94800640 1 -- 172.21.15.59:0/1721068507 >> 172.21.15.59:0/1721068507 conn(0x7ffa8c0cd540 msgr2=0x7ffa8c0cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:50.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.406+0000 7ffa94800640 1 -- 172.21.15.59:0/1721068507 shutdown_connections 2024-05-30T17:01:50.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.406+0000 7ffa94800640 1 -- 172.21.15.59:0/1721068507 wait complete. 2024-05-30T17:01:50.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.406+0000 7ffa94800640 1 Processor -- start 2024-05-30T17:01:50.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa94800640 1 -- start start 2024-05-30T17:01:50.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa94800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa8c06ce90 0x7ffa8c15fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:50.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa94800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0c9e10 0x7ffa8c1614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:50.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa94800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa8c141f20 0x7ffa8c161a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:50.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa94800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c162480 con 0x7ffa8c141f20 2024-05-30T17:01:50.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa94800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c162300 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa94800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffa8c06c930 con 0x7ffa8c06ce90 2024-05-30T17:01:50.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa92800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa8c141f20 0x7ffa8c161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:50.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa91400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0c9e10 0x7ffa8c1614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:50.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa91400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0c9e10 0x7ffa8c1614e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:56392/0 (socket says 172.21.15.59:56392) 2024-05-30T17:01:50.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa91400640 1 -- 172.21.15.59:0/3140099007 learned_addr learned my addr 172.21.15.59:0/3140099007 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:50.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa91e00640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa8c06ce90 0x7ffa8c15fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:50.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa91400640 1 -- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa8c06ce90 msgr2=0x7ffa8c15fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa91400640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa8c06ce90 0x7ffa8c15fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa91400640 1 -- 172.21.15.59:0/3140099007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa8c141f20 msgr2=0x7ffa8c161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa91400640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa8c141f20 0x7ffa8c161a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa91400640 1 -- 172.21.15.59:0/3140099007 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8c160670 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa91400640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0c9e10 0x7ffa8c1614e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00c500 tx=0x7ffa7c00c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:50.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa86000640 1 -- 172.21.15.59:0/3140099007 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0052d0 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa86000640 1 -- 172.21.15.59:0/3140099007 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7c005490 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa86000640 1 -- 172.21.15.59:0/3140099007 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c012850 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa94800640 1 -- 172.21.15.59:0/3140099007 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8c160950 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa94800640 1 -- 172.21.15.59:0/3140099007 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa8c160f10 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.410+0000 7ffa94800640 1 -- 172.21.15.59:0/3140099007 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa8c068a90 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.414+0000 7ffa86000640 1 -- 172.21.15.59:0/3140099007 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) ==== 89925+0+0 (secure 0 0 0) 0x7ffa7c0129f0 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.414+0000 7ffa86000640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa70069910 0x7ffa7006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.414+0000 7ffa86000640 1 -- 172.21.15.59:0/3140099007 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7ffa7c0856a0 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.414+0000 7ffa91e00640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa70069910 0x7ffa7006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.414+0000 7ffa91e00640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa70069910 0x7ffa7006bdd0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ffa80000f70 tx=0x7ffa80007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.418+0000 7ffa86000640 1 -- 172.21.15.59:0/3140099007 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa7c056c40 con 0x7ffa8c0c9e10 2024-05-30T17:01:50.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.606+0000 7ffa94800640 1 -- 172.21.15.59:0/3140099007 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7ffa8c06cc70 con 0x7ffa70069910 2024-05-30T17:01:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.610+0000 7ffa86000640 1 -- 172.21.15.59:0/3140099007 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7ffa8c06cc70 con 0x7ffa70069910 2024-05-30T17:01:50.615 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b 2024-05-30T17:01:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.614+0000 7ffa94800640 1 -- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa70069910 msgr2=0x7ffa7006bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.614+0000 7ffa94800640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa70069910 0x7ffa7006bdd0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ffa80000f70 tx=0x7ffa80007d40 comp rx=0 tx=0).stop 2024-05-30T17:01:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.614+0000 7ffa94800640 1 -- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0c9e10 msgr2=0x7ffa8c1614e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.614+0000 7ffa94800640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0c9e10 0x7ffa8c1614e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00c500 tx=0x7ffa7c00c9c0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.614+0000 7ffa94800640 1 -- 172.21.15.59:0/3140099007 shutdown_connections 2024-05-30T17:01:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.614+0000 7ffa94800640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa70069910 0x7ffa7006bdd0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.614+0000 7ffa94800640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa8c141f20 0x7ffa8c161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.614+0000 7ffa94800640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0c9e10 0x7ffa8c1614e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.614+0000 7ffa94800640 1 --2- 172.21.15.59:0/3140099007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa8c06ce90 0x7ffa8c15fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.614+0000 7ffa94800640 1 -- 172.21.15.59:0/3140099007 >> 172.21.15.59:0/3140099007 conn(0x7ffa8c0cd540 msgr2=0x7ffa8c141340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.614+0000 7ffa94800640 1 -- 172.21.15.59:0/3140099007 shutdown_connections 2024-05-30T17:01:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:50.614+0000 7ffa94800640 1 -- 172.21.15.59:0/3140099007 wait complete. 2024-05-30T17:01:50.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:50.636 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b 2024-05-30T17:01:50.636 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:01:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b 2024-05-30T17:01:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3138256896" 2024-05-30T17:01:50.649 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:50.650 INFO:tasks.cephfs.test_volumes:r_size = 3138256896 exp_size = 3221225472 2024-05-30T17:01:52.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:52.651 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b 2024-05-30T17:01:52.651 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:01:52.665 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b 2024-05-30T17:01:52.665 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3138256896" 2024-05-30T17:01:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:52.666 INFO:tasks.cephfs.test_volumes:r_size = 3138256896 exp_size = 3221225472 2024-05-30T17:01:54.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:01:54.668 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b 2024-05-30T17:01:54.668 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:01:54.683 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/a38e0def-69c8-487a-adca-b9c7c14ec69b 2024-05-30T17:01:54.683 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T17:01:54.683 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:01:54.684 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T17:01:54.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-05-30T17:01:54.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.882+0000 7f8215c00640 1 Processor -- start 2024-05-30T17:01:54.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.882+0000 7f8215c00640 1 -- start start 2024-05-30T17:01:54.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.882+0000 7f8215c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8210159100 0x7f821006e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:54.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.882+0000 7f8215c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82100b52d0 con 0x7f82100b44e0 2024-05-30T17:01:54.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.882+0000 7f8215c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82100b4a30 con 0x7f821015c010 2024-05-30T17:01:54.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.882+0000 7f8215c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f82100b4d10 con 0x7f8210159100 2024-05-30T17:01:54.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.882+0000 7f8206000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f82100b44e0 0x7f821015efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40128/0 (socket says 172.21.15.59:40128) 2024-05-30T17:01:54.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.882+0000 7f8206000640 1 -- 172.21.15.59:0/3770458342 learned_addr learned my addr 172.21.15.59:0/3770458342 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:01:54.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.882+0000 7f820ea00640 1 --2- 172.21.15.59:0/3770458342 >> v2:172.21.15.107:3300/0 conn(0x7f8210159100 0x7f821006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.882+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1538193306 0 0) 0x7f82100b52d0 con 0x7f82100b44e0 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.882+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81f4003530 con 0x7f82100b44e0 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.882+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3505217699 0 0) 0x7f82100b4a30 con 0x7f821015c010 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82100b52d0 con 0x7f821015c010 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3688697367 0 0) 0x7f81f4003530 con 0x7f82100b44e0 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 >> v2:172.21.15.107:3300/0 conn(0x7f8210159100 msgr2=0x7f821006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 --2- 172.21.15.59:0/3770458342 >> v2:172.21.15.107:3300/0 conn(0x7f8210159100 0x7f821006e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 >> v1:172.21.15.107:6789/0 conn(0x7f821015c010 legacy=0x7f82100d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82100b4ff0 con 0x7f82100b44e0 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f81f8001680 con 0x7f82100b44e0 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 >> v1:172.21.15.59:6789/0 conn(0x7f82100b44e0 legacy=0x7f821015efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 --2- 172.21.15.59:0/3770458342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 0x7f81f4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:54.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 --2- 172.21.15.59:0/3770458342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81f4004810 0x7f81f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:54.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 --2- 172.21.15.59:0/3770458342 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81f40051d0 0x7f81f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:54.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f82100b4d10 con 0x7f81f4003b50 2024-05-30T17:01:54.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f81f400c100 con 0x7f81f4004810 2024-05-30T17:01:54.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f81f400c300 con 0x7f81f40051d0 2024-05-30T17:01:54.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820ea00640 1 --2- 172.21.15.59:0/3770458342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 0x7f81f4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f8206000640 1 --2- 172.21.15.59:0/3770458342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81f4004810 0x7f81f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820f400640 1 --2- 172.21.15.59:0/3770458342 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81f40051d0 0x7f81f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820ea00640 1 -- 172.21.15.59:0/3770458342 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81f40051d0 msgr2=0x7f81f400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820ea00640 1 --2- 172.21.15.59:0/3770458342 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81f40051d0 0x7f81f400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820ea00640 1 -- 172.21.15.59:0/3770458342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81f4004810 msgr2=0x7f81f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:54.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820ea00640 1 --2- 172.21.15.59:0/3770458342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81f4004810 0x7f81f4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820ea00640 1 -- 172.21.15.59:0/3770458342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f4003530 con 0x7f81f4003b50 2024-05-30T17:01:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820f400640 1 -- 172.21.15.59:0/3770458342 reap_dead start 2024-05-30T17:01:54.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f8206000640 1 --2- 172.21.15.59:0/3770458342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81f4004810 0x7f81f4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:54.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820ea00640 1 --2- 172.21.15.59:0/3770458342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 0x7f81f4003f50 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f8200009fc0 tx=0x7f820001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41cfeb9c6be4a3e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:54.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.886+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82000b2070 con 0x7f81f4003b50 2024-05-30T17:01:54.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82000a5be0 con 0x7f81f4003b50 2024-05-30T17:01:54.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f820e000640 1 -- 172.21.15.59:0/3770458342 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200009c10 con 0x7f81f4003b50 2024-05-30T17:01:54.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 -- 172.21.15.59:0/3770458342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 msgr2=0x7f81f4003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:54.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 --2- 172.21.15.59:0/3770458342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 0x7f81f4003f50 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f8200009fc0 tx=0x7f820001cc50 comp rx=0 tx=0).stop 2024-05-30T17:01:54.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 -- 172.21.15.59:0/3770458342 shutdown_connections 2024-05-30T17:01:54.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 --2- 172.21.15.59:0/3770458342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 0x7f81f4003f50 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:54.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 -- 172.21.15.59:0/3770458342 >> 172.21.15.59:0/3770458342 conn(0x7f821006bdb0 msgr2=0x7f821006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:54.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 -- 172.21.15.59:0/3770458342 shutdown_connections 2024-05-30T17:01:54.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 -- 172.21.15.59:0/3770458342 wait complete. 2024-05-30T17:01:54.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 Processor -- start 2024-05-30T17:01:54.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 -- start start 2024-05-30T17:01:54.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 0x7f82101510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:54.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8210154770 0x7f821014ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:54.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8210153aa0 0x7f8210153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:54.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f821006eb20 con 0x7f81f4003b50 2024-05-30T17:01:54.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f821006e9a0 con 0x7f8210154770 2024-05-30T17:01:54.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f8215c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f82100d0790 con 0x7f8210153aa0 2024-05-30T17:01:54.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f820ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 0x7f82101510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:54.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f820ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 0x7f82101510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35568/0 (socket says 172.21.15.59:35568) 2024-05-30T17:01:54.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f820ea00640 1 -- 172.21.15.59:0/2807704934 learned_addr learned my addr 172.21.15.59:0/2807704934 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:54.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f820ea00640 1 -- 172.21.15.59:0/2807704934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8210153aa0 msgr2=0x7f8210153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:54.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f820ea00640 1 --2- 172.21.15.59:0/2807704934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8210153aa0 0x7f8210153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:54.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f820ea00640 1 -- 172.21.15.59:0/2807704934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8210154770 msgr2=0x7f821014ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:54.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f820ea00640 1 --2- 172.21.15.59:0/2807704934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8210154770 0x7f821014ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:54.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.890+0000 7f820ea00640 1 -- 172.21.15.59:0/2807704934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8210154c00 con 0x7f81f4003b50 2024-05-30T17:01:54.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.894+0000 7f820ea00640 1 --2- 172.21.15.59:0/2807704934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 0x7f82101510c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f82000b0040 tx=0x7f8200009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:54.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.894+0000 7f8207400640 1 -- 172.21.15.59:0/2807704934 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82000b2040 con 0x7f81f4003b50 2024-05-30T17:01:54.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.894+0000 7f8207400640 1 -- 172.21.15.59:0/2807704934 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82000a59e0 con 0x7f81f4003b50 2024-05-30T17:01:54.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.894+0000 7f8207400640 1 -- 172.21.15.59:0/2807704934 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82000add00 con 0x7f81f4003b50 2024-05-30T17:01:54.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.894+0000 7f8215c00640 1 -- 172.21.15.59:0/2807704934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8210154ee0 con 0x7f81f4003b50 2024-05-30T17:01:54.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.894+0000 7f8215c00640 1 -- 172.21.15.59:0/2807704934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f821014f220 con 0x7f81f4003b50 2024-05-30T17:01:54.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.894+0000 7f8215c00640 1 -- 172.21.15.59:0/2807704934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8210068a90 con 0x7f81f4003b50 2024-05-30T17:01:54.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.894+0000 7f8207400640 1 -- 172.21.15.59:0/2807704934 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 32) ==== 89925+0+0 (secure 0 0 0) 0x7f82000bf030 con 0x7f81f4003b50 2024-05-30T17:01:54.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.894+0000 7f8207400640 1 --2- 172.21.15.59:0/2807704934 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81ec069910 0x7f81ec06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:54.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.898+0000 7f8207400640 1 -- 172.21.15.59:0/2807704934 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f820011ff50 con 0x7f81f4003b50 2024-05-30T17:01:54.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.898+0000 7f8206000640 1 --2- 172.21.15.59:0/2807704934 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81ec069910 0x7f81ec06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:54.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.898+0000 7f8206000640 1 --2- 172.21.15.59:0/2807704934 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81ec069910 0x7f81ec06bdd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f81f8001410 tx=0x7f81f8001380 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:54.902+0000 7f8207400640 1 -- 172.21.15.59:0/2807704934 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f82000c6060 con 0x7f81f4003b50 2024-05-30T17:01:55.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.094+0000 7f8215c00640 1 -- 172.21.15.59:0/2807704934 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f8210153420 con 0x7f81ec069910 2024-05-30T17:01:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8207400640 1 -- 172.21.15.59:0/2807704934 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8210153420 con 0x7f81ec069910 2024-05-30T17:01:55.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8215c00640 1 -- 172.21.15.59:0/2807704934 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81ec069910 msgr2=0x7f81ec06bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:55.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8215c00640 1 --2- 172.21.15.59:0/2807704934 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81ec069910 0x7f81ec06bdd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f81f8001410 tx=0x7f81f8001380 comp rx=0 tx=0).stop 2024-05-30T17:01:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8215c00640 1 -- 172.21.15.59:0/2807704934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 msgr2=0x7f82101510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8215c00640 1 --2- 172.21.15.59:0/2807704934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 0x7f82101510c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f82000b0040 tx=0x7f8200009750 comp rx=0 tx=0).stop 2024-05-30T17:01:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8215c00640 1 -- 172.21.15.59:0/2807704934 shutdown_connections 2024-05-30T17:01:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8215c00640 1 --2- 172.21.15.59:0/2807704934 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f81ec069910 0x7f81ec06bdd0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8215c00640 1 --2- 172.21.15.59:0/2807704934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8210153aa0 0x7f8210153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8215c00640 1 --2- 172.21.15.59:0/2807704934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8210154770 0x7f821014ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8215c00640 1 --2- 172.21.15.59:0/2807704934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f4003b50 0x7f82101510c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8215c00640 1 -- 172.21.15.59:0/2807704934 >> 172.21.15.59:0/2807704934 conn(0x7f821006bdb0 msgr2=0x7f8210074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8215c00640 1 -- 172.21.15.59:0/2807704934 shutdown_connections 2024-05-30T17:01:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:55.170+0000 7f8215c00640 1 -- 172.21.15.59:0/2807704934 wait complete. 2024-05-30T17:01:55.177 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:55.176+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:55.177 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:55.176+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:55.177 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:55.176+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:55.177 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:55.176+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:55.177 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:55.176+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:55.195 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:55.196+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:55.195 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:55.196+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:55.195 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:55.196+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:55.195 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:55.196+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:55.195 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:01:55.196+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:01:56.197 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs ss1clone1 2024-05-30T17:01:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.350+0000 7fe95e400640 1 Processor -- start 2024-05-30T17:01:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.350+0000 7fe95e400640 1 -- start start 2024-05-30T17:01:56.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe95e400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe958160d90 0x7fe95809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:56.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe95e400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe95809b780 0x7fe95809af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:56.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe95e400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9580d1310 con 0x7fe9580711e0 2024-05-30T17:01:56.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe95e400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe9580ced30 con 0x7fe95809b780 2024-05-30T17:01:56.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe95e400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe95809bcf0 con 0x7fe958160d90 2024-05-30T17:01:56.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe94ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe95809b780 0x7fe95809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:56.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe94ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe95809b780 0x7fe95809af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35578/0 (socket says 172.21.15.59:35578) 2024-05-30T17:01:56.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe94ea00640 1 -- 172.21.15.59:0/3493390852 learned_addr learned my addr 172.21.15.59:0/3493390852 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:56.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe957400640 1 --2- 172.21.15.59:0/3493390852 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe958160d90 0x7fe95809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:56.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe94ea00640 1 -- 172.21.15.59:0/3493390852 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe958160d90 msgr2=0x7fe95809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:56.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe94ea00640 1 --2- 172.21.15.59:0/3493390852 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe958160d90 0x7fe95809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:56.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe94ea00640 1 -- 172.21.15.59:0/3493390852 >> v1:172.21.15.107:6789/0 conn(0x7fe9580711e0 legacy=0x7fe95806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:01:56.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.354+0000 7fe94ea00640 1 -- 172.21.15.59:0/3493390852 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9580d0a70 con 0x7fe95809b780 2024-05-30T17:01:56.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe94ea00640 1 --2- 172.21.15.59:0/3493390852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95809b780 0x7fe95809af80 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fe958072e30 tx=0x7fe94001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c484ad1fb2f483ac server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:56.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe956a00640 1 -- 172.21.15.59:0/3493390852 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400b0070 con 0x7fe95809b780 2024-05-30T17:01:56.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe956a00640 1 -- 172.21.15.59:0/3493390852 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9400ab600 con 0x7fe95809b780 2024-05-30T17:01:56.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe956a00640 1 -- 172.21.15.59:0/3493390852 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400ab9d0 con 0x7fe95809b780 2024-05-30T17:01:56.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe95e400640 1 -- 172.21.15.59:0/3493390852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95809b780 msgr2=0x7fe95809af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:56.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe95e400640 1 --2- 172.21.15.59:0/3493390852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95809b780 0x7fe95809af80 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fe958072e30 tx=0x7fe94001c450 comp rx=0 tx=0).stop 2024-05-30T17:01:56.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe95e400640 1 -- 172.21.15.59:0/3493390852 shutdown_connections 2024-05-30T17:01:56.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe95e400640 1 --2- 172.21.15.59:0/3493390852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95809b780 0x7fe95809af80 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:56.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe95e400640 1 --2- 172.21.15.59:0/3493390852 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe958160d90 0x7fe95809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:56.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe95e400640 1 -- 172.21.15.59:0/3493390852 >> 172.21.15.59:0/3493390852 conn(0x7fe9580b3f80 msgr2=0x7fe9580b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:56.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe95e400640 1 -- 172.21.15.59:0/3493390852 shutdown_connections 2024-05-30T17:01:56.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe95e400640 1 -- 172.21.15.59:0/3493390852 wait complete. 2024-05-30T17:01:56.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe95e400640 1 Processor -- start 2024-05-30T17:01:56.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.358+0000 7fe95e400640 1 -- start start 2024-05-30T17:01:56.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe95e400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9580711e0 0x7fe958166de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:56.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe95e400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe95809b780 0x7fe9580af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:56.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe95e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe958160d90 0x7fe9580b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:56.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe95e400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe958071fe0 con 0x7fe958160d90 2024-05-30T17:01:56.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe95e400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe958071e60 con 0x7fe95809b780 2024-05-30T17:01:56.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe95e400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe958161170 con 0x7fe9580711e0 2024-05-30T17:01:56.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe957e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe958160d90 0x7fe9580b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:56.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe957e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe958160d90 0x7fe9580b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35586/0 (socket says 172.21.15.59:35586) 2024-05-30T17:01:56.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe957e00640 1 -- 172.21.15.59:0/2076580379 learned_addr learned my addr 172.21.15.59:0/2076580379 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:01:56.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe94ea00640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe95809b780 0x7fe9580af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:56.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe957400640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9580711e0 0x7fe958166de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:56.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe957e00640 1 -- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9580711e0 msgr2=0x7fe958166de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:56.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe957e00640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9580711e0 0x7fe958166de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:56.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe957e00640 1 -- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe95809b780 msgr2=0x7fe9580af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:56.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe957e00640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe95809b780 0x7fe9580af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:56.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe957e00640 1 -- 172.21.15.59:0/2076580379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9580afb60 con 0x7fe958160d90 2024-05-30T17:01:56.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe94ea00640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe95809b780 0x7fe9580af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:01:56.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe957e00640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe958160d90 0x7fe9580b0c00 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe95000b9a0 tx=0x7fe95000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:56.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe94fe00640 1 -- 172.21.15.59:0/2076580379 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950019070 con 0x7fe958160d90 2024-05-30T17:01:56.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe94fe00640 1 -- 172.21.15.59:0/2076580379 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe95000cba0 con 0x7fe958160d90 2024-05-30T17:01:56.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe94fe00640 1 -- 172.21.15.59:0/2076580379 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950014440 con 0x7fe958160d90 2024-05-30T17:01:56.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe95e400640 1 -- 172.21.15.59:0/2076580379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9580afe40 con 0x7fe958160d90 2024-05-30T17:01:56.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe95e400640 1 -- 172.21.15.59:0/2076580379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9580b0400 con 0x7fe958160d90 2024-05-30T17:01:56.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe95e400640 1 -- 172.21.15.59:0/2076580379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe958068a90 con 0x7fe958160d90 2024-05-30T17:01:56.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.362+0000 7fe94fe00640 1 -- 172.21.15.59:0/2076580379 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7fe95001c070 con 0x7fe958160d90 2024-05-30T17:01:56.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.366+0000 7fe94fe00640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe934069a30 0x7fe93406bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:01:56.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.366+0000 7fe94fe00640 1 -- 172.21.15.59:0/2076580379 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7fe950085300 con 0x7fe958160d90 2024-05-30T17:01:56.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.366+0000 7fe957400640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe934069a30 0x7fe93406bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:01:56.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.366+0000 7fe957400640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe934069a30 0x7fe93406bef0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe948007a60 tx=0x7fe948008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:01:56.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.370+0000 7fe94fe00640 1 -- 172.21.15.59:0/2076580379 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe950056cd0 con 0x7fe958160d90 2024-05-30T17:01:56.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:56.566+0000 7fe95e400640 1 -- 172.21.15.59:0/2076580379 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fe9580b4be0 con 0x7fe934069a30 2024-05-30T17:01:59.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.362+0000 7fe94fe00640 1 -- 172.21.15.59:0/2076580379 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe9580b4be0 con 0x7fe934069a30 2024-05-30T17:01:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.366+0000 7fe95e400640 1 -- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe934069a30 msgr2=0x7fe93406bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.366+0000 7fe95e400640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe934069a30 0x7fe93406bef0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe948007a60 tx=0x7fe948008040 comp rx=0 tx=0).stop 2024-05-30T17:01:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.366+0000 7fe95e400640 1 -- 172.21.15.59:0/2076580379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe958160d90 msgr2=0x7fe9580b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:01:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.366+0000 7fe95e400640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe958160d90 0x7fe9580b0c00 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe95000b9a0 tx=0x7fe95000be60 comp rx=0 tx=0).stop 2024-05-30T17:01:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.366+0000 7fe95e400640 1 -- 172.21.15.59:0/2076580379 shutdown_connections 2024-05-30T17:01:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.366+0000 7fe95e400640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe934069a30 0x7fe93406bef0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.366+0000 7fe95e400640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe958160d90 0x7fe9580b0c00 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.366+0000 7fe95e400640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe95809b780 0x7fe9580af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.366+0000 7fe95e400640 1 --2- 172.21.15.59:0/2076580379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe9580711e0 0x7fe958166de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:01:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.366+0000 7fe95e400640 1 -- 172.21.15.59:0/2076580379 >> 172.21.15.59:0/2076580379 conn(0x7fe9580b3f80 msgr2=0x7fe95815ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:01:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.366+0000 7fe95e400640 1 -- 172.21.15.59:0/2076580379 shutdown_connections 2024-05-30T17:01:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:01:59.366+0000 7fe95e400640 1 -- 172.21.15.59:0/2076580379 wait complete. 2024-05-30T17:02:04.392 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:02:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.538+0000 7f6365000640 1 Processor -- start 2024-05-30T17:02:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.538+0000 7f6365000640 1 -- start start 2024-05-30T17:02:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f6365000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f63600b37a0 0x7f63600d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f6365000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f636009b150 0x7f63600cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f6365000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63600d0260 con 0x7f63600cdb60 2024-05-30T17:02:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f6365000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f63600d0010 con 0x7f63600b37a0 2024-05-30T17:02:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f6365000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f63600d0540 con 0x7f636009b150 2024-05-30T17:02:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f6357e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f63600cdb60 0x7f636009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58790/0 (socket says 172.21.15.59:58790) 2024-05-30T17:02:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f6357e00640 1 -- 172.21.15.59:0/2057340504 learned_addr learned my addr 172.21.15.59:0/2057340504 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635de00640 1 --2- 172.21.15.59:0/2057340504 >> v2:172.21.15.107:3300/0 conn(0x7f63600b37a0 0x7f63600d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635e800640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f636009b150 0x7f63600cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768293178 0 0) 0x7f63600d0260 con 0x7f63600cdb60 2024-05-30T17:02:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6344003530 con 0x7f63600cdb60 2024-05-30T17:02:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 33640368 0 0) 0x7f6344003530 con 0x7f63600cdb60 2024-05-30T17:02:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f636009b150 msgr2=0x7f63600cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f636009b150 0x7f63600cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 >> v2:172.21.15.107:3300/0 conn(0x7f63600b37a0 msgr2=0x7f63600d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 --2- 172.21.15.59:0/2057340504 >> v2:172.21.15.107:3300/0 conn(0x7f63600b37a0 0x7f63600d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63600d0820 con 0x7f63600cdb60 2024-05-30T17:02:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f6348001680 con 0x7f63600cdb60 2024-05-30T17:02:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 >> v1:172.21.15.59:6789/0 conn(0x7f63600cdb60 legacy=0x7f636009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63440039c0 0x7f6344003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63440043b0 0x7f6344004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6344005050 0x7f634400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f63600d0010 con 0x7f6344005050 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f63600d0540 con 0x7f63440043b0 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f634400bff0 con 0x7f63440039c0 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635e800640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f636009b150 0x7f63600cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635e800640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6344005050 0x7f634400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f6357e00640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63440043b0 0x7f6344004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635de00640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63440039c0 0x7f6344003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635e800640 1 -- 172.21.15.59:0/2057340504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63440039c0 msgr2=0x7f6344003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635e800640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63440039c0 0x7f6344003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635e800640 1 -- 172.21.15.59:0/2057340504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63440043b0 msgr2=0x7f6344004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635e800640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63440043b0 0x7f6344004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:04.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.542+0000 7f635e800640 1 -- 172.21.15.59:0/2057340504 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6344003530 con 0x7f6344005050 2024-05-30T17:02:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.546+0000 7f635e800640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6344005050 0x7f634400b9d0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f63600b4fe0 tx=0x7f635801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27244df2e495d67 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.546+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63580aa070 con 0x7f6344005050 2024-05-30T17:02:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.546+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63580a8070 con 0x7f6344005050 2024-05-30T17:02:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.546+0000 7f635d400640 1 -- 172.21.15.59:0/2057340504 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358009b50 con 0x7f6344005050 2024-05-30T17:02:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.546+0000 7f6365000640 1 -- 172.21.15.59:0/2057340504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6344005050 msgr2=0x7f634400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.546+0000 7f6365000640 1 --2- 172.21.15.59:0/2057340504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6344005050 0x7f634400b9d0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f63600b4fe0 tx=0x7f635801c970 comp rx=0 tx=0).stop 2024-05-30T17:02:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.546+0000 7f635e800640 1 -- 172.21.15.59:0/2057340504 reap_dead start 2024-05-30T17:02:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.546+0000 7f6365000640 1 -- 172.21.15.59:0/2057340504 shutdown_connections 2024-05-30T17:02:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.546+0000 7f6365000640 1 -- 172.21.15.59:0/2057340504 >> 172.21.15.59:0/2057340504 conn(0x7f63600b3f30 msgr2=0x7f63600b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.546+0000 7f6365000640 1 -- 172.21.15.59:0/2057340504 shutdown_connections 2024-05-30T17:02:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.546+0000 7f6365000640 1 -- 172.21.15.59:0/2057340504 wait complete. 2024-05-30T17:02:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6365000640 1 Processor -- start 2024-05-30T17:02:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6365000640 1 -- start start 2024-05-30T17:02:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6365000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6344005050 0x7f63601549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6365000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63600c8400 0x7f63600c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6365000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f636006daf0 0x7f636006df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6365000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f63600b2540 con 0x7f636006daf0 2024-05-30T17:02:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6365000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f63600b23c0 con 0x7f6344005050 2024-05-30T17:02:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6365000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f63600b26c0 con 0x7f63600c8400 2024-05-30T17:02:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f635e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f636006daf0 0x7f636006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f635de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6344005050 0x7f63601549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f635e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f636006daf0 0x7f636006df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41618/0 (socket says 172.21.15.59:41618) 2024-05-30T17:02:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f635e800640 1 -- 172.21.15.59:0/1590708405 learned_addr learned my addr 172.21.15.59:0/1590708405 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6357e00640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63600c8400 0x7f63600c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f635e800640 1 -- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63600c8400 msgr2=0x7f63600c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f635e800640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63600c8400 0x7f63600c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f635e800640 1 -- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6344005050 msgr2=0x7f63601549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f635e800640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6344005050 0x7f63601549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f635e800640 1 -- 172.21.15.59:0/1590708405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6360154f30 con 0x7f636006daf0 2024-05-30T17:02:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f635e800640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f636006daf0 0x7f636006df70 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f635801ce50 tx=0x7f6344005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6356000640 1 -- 172.21.15.59:0/1590708405 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63580b5070 con 0x7f636006daf0 2024-05-30T17:02:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6356000640 1 -- 172.21.15.59:0/1590708405 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63580b3070 con 0x7f636006daf0 2024-05-30T17:02:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6356000640 1 -- 172.21.15.59:0/1590708405 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63580aa040 con 0x7f636006daf0 2024-05-30T17:02:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6365000640 1 -- 172.21.15.59:0/1590708405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63600c6760 con 0x7f636006daf0 2024-05-30T17:02:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.550+0000 7f6365000640 1 -- 172.21.15.59:0/1590708405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63600c6d20 con 0x7f636006daf0 2024-05-30T17:02:04.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.554+0000 7f6365000640 1 -- 172.21.15.59:0/1590708405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6360068a90 con 0x7f636006daf0 2024-05-30T17:02:04.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.554+0000 7f6356000640 1 -- 172.21.15.59:0/1590708405 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7f6358004470 con 0x7f636006daf0 2024-05-30T17:02:04.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.554+0000 7f6356000640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f633c069a00 0x7f633c06bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:04.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.554+0000 7f6356000640 1 -- 172.21.15.59:0/1590708405 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f635811e720 con 0x7f636006daf0 2024-05-30T17:02:04.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.554+0000 7f635de00640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f633c069a00 0x7f633c06bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:04.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.554+0000 7f635de00640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f633c069a00 0x7f633c06bec0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6350009bc0 tx=0x7f6350006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:04.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.558+0000 7f6356000640 1 -- 172.21.15.59:0/1590708405 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63580c1030 con 0x7f636006daf0 2024-05-30T17:02:04.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.782+0000 7f6365000640 1 -- 172.21.15.59:0/1590708405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f63600ce950 con 0x7f636006daf0 2024-05-30T17:02:04.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.782+0000 7f6356000640 1 -- 172.21.15.59:0/1590708405 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2113 (secure 0 0 0) 0x7f63580169a0 con 0x7f636006daf0 2024-05-30T17:02:04.786 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:04.786 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:02:04.786 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:02:04.786 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:02:04.786 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:02:04.787 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:02:04.787 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:02:04.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:04.787 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:02:04.787 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:02:04.787 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:02:04.787 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:02:04.787 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:02:04.787 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:04.787 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:02:04.787 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:02:04.787 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 804, 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 104, 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:02:04.788 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:02:04.789 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 799, 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 3222127309, 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 7305121792, 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 765788991488, 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 511, 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 34259692, 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 12 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7, 2024-05-30T17:02:04.790 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 7, 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7986 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:04.791 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 15, 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:00:45.324121+0000", 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:04.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:04.793 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:02:04.793 INFO:teuthology.orchestra.run.smithi059.stdout: "04da8471-75f4-4cdc-b7fd-7d14ee491cef": { 2024-05-30T17:02:04.793 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 27.0 seconds before exiting (4s)\n [============================] ", 2024-05-30T17:02:04.793 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:02:04.793 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:02:04.793 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:04.793 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:04.793 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:02:04.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.786+0000 7f6365000640 1 -- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f633c069a00 msgr2=0x7f633c06bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:04.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.786+0000 7f6365000640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f633c069a00 0x7f633c06bec0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6350009bc0 tx=0x7f6350006f90 comp rx=0 tx=0).stop 2024-05-30T17:02:04.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.786+0000 7f6365000640 1 -- 172.21.15.59:0/1590708405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f636006daf0 msgr2=0x7f636006df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:04.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.786+0000 7f6365000640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f636006daf0 0x7f636006df70 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f635801ce50 tx=0x7f6344005840 comp rx=0 tx=0).stop 2024-05-30T17:02:04.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.786+0000 7f6365000640 1 -- 172.21.15.59:0/1590708405 shutdown_connections 2024-05-30T17:02:04.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.786+0000 7f6365000640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f633c069a00 0x7f633c06bec0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:04.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.786+0000 7f6365000640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f636006daf0 0x7f636006df70 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:04.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.786+0000 7f6365000640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63600c8400 0x7f63600c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:04.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.786+0000 7f6365000640 1 --2- 172.21.15.59:0/1590708405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6344005050 0x7f63601549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:04.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.786+0000 7f6365000640 1 -- 172.21.15.59:0/1590708405 >> 172.21.15.59:0/1590708405 conn(0x7f63600b3f30 msgr2=0x7f6360160130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:04.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.786+0000 7f6365000640 1 -- 172.21.15.59:0/1590708405 shutdown_connections 2024-05-30T17:02:04.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:04.786+0000 7f6365000640 1 -- 172.21.15.59:0/1590708405 wait complete. 2024-05-30T17:02:04.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:04.808 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -lh volumes/_nogroup/ss1clone1/a38e0def-69c8-487a-adca-b9c7c14ec69b 2024-05-30T17:02:04.808 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:02:04.822 INFO:teuthology.orchestra.run.smithi059.stderr:ls: cannot access 'volumes/_nogroup/ss1clone1/a38e0def-69c8-487a-adca-b9c7c14ec69b': No such file or directory 2024-05-30T17:02:04.822 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-30T17:02:04.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T17:02:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa977e00640 1 Processor -- start 2024-05-30T17:02:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa977e00640 1 -- start start 2024-05-30T17:02:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa977e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa97006e900 0x7fa97015f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa977e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97015f060 con 0x7fa9700d0560 2024-05-30T17:02:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa977e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9700afb00 con 0x7fa9700af720 2024-05-30T17:02:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa977e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa97015c270 con 0x7fa97006e900 2024-05-30T17:02:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa974a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa97006e900 0x7fa97015f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa975e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa9700d0560 0x7fa970072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58804/0 (socket says 172.21.15.59:58804) 2024-05-30T17:02:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa975e00640 1 -- 172.21.15.59:0/3132863444 learned_addr learned my addr 172.21.15.59:0/3132863444 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa974a00640 1 -- 172.21.15.59:0/3132863444 >> v1:172.21.15.107:6789/0 conn(0x7fa9700af720 legacy=0x7fa97015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa974a00640 1 -- 172.21.15.59:0/3132863444 >> v1:172.21.15.59:6789/0 conn(0x7fa9700d0560 legacy=0x7fa970072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa974a00640 1 -- 172.21.15.59:0/3132863444 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97015c550 con 0x7fa97006e900 2024-05-30T17:02:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.006+0000 7fa96fe00640 1 -- 172.21.15.59:0/3132863444 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1373200577 0 0) 0x7fa97015f060 con 0x7fa9700d0560 2024-05-30T17:02:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.010+0000 7fa974a00640 1 --2- 172.21.15.59:0/3132863444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa97006e900 0x7fa97015f7f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0097c0 tx=0x7fa95c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9713b33ec45f91 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.010+0000 7fa96fe00640 1 -- 172.21.15.59:0/3132863444 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0ab650 con 0x7fa97006e900 2024-05-30T17:02:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.010+0000 7fa96fe00640 1 -- 172.21.15.59:0/3132863444 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c0b0070 con 0x7fa97006e900 2024-05-30T17:02:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.010+0000 7fa96fe00640 1 -- 172.21.15.59:0/3132863444 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0aba10 con 0x7fa97006e900 2024-05-30T17:02:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.010+0000 7fa977e00640 1 -- 172.21.15.59:0/3132863444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa97006e900 msgr2=0x7fa97015f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.010+0000 7fa977e00640 1 --2- 172.21.15.59:0/3132863444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa97006e900 0x7fa97015f7f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0097c0 tx=0x7fa95c01c430 comp rx=0 tx=0).stop 2024-05-30T17:02:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.010+0000 7fa977e00640 1 -- 172.21.15.59:0/3132863444 shutdown_connections 2024-05-30T17:02:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.010+0000 7fa977e00640 1 --2- 172.21.15.59:0/3132863444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa97006e900 0x7fa97015f7f0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.010+0000 7fa977e00640 1 -- 172.21.15.59:0/3132863444 >> 172.21.15.59:0/3132863444 conn(0x7fa9700b22d0 msgr2=0x7fa9700b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:05.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.010+0000 7fa977e00640 1 -- 172.21.15.59:0/3132863444 shutdown_connections 2024-05-30T17:02:05.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.010+0000 7fa977e00640 1 -- 172.21.15.59:0/3132863444 wait complete. 2024-05-30T17:02:05.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa977e00640 1 Processor -- start 2024-05-30T17:02:05.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa977e00640 1 -- start start 2024-05-30T17:02:05.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa977e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa97006e900 0x7fa97014f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:05.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa977e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9700af720 0x7fa970152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:05.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa977e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9700d0560 0x7fa97014d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:05.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa977e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa97015feb0 con 0x7fa9700af720 2024-05-30T17:02:05.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa977e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa97015fd30 con 0x7fa97006e900 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa977e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa970158dd0 con 0x7fa9700d0560 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa974a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9700af720 0x7fa970152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa974a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9700af720 0x7fa970152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41632/0 (socket says 172.21.15.59:41632) 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa974a00640 1 -- 172.21.15.59:0/1042497646 learned_addr learned my addr 172.21.15.59:0/1042497646 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa975400640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa97006e900 0x7fa97014f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa975e00640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9700d0560 0x7fa97014d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa974a00640 1 -- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9700d0560 msgr2=0x7fa97014d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa974a00640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9700d0560 0x7fa97014d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa974a00640 1 -- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa97006e900 msgr2=0x7fa97014f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa974a00640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa97006e900 0x7fa97014f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa974a00640 1 -- 172.21.15.59:0/1042497646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97014c4c0 con 0x7fa9700af720 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa974a00640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9700af720 0x7fa970152c00 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0097c0 tx=0x7fa95c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa96d600640 1 -- 172.21.15.59:0/1042497646 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c004230 con 0x7fa9700af720 2024-05-30T17:02:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa96d600640 1 -- 172.21.15.59:0/1042497646 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c0043d0 con 0x7fa9700af720 2024-05-30T17:02:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa96d600640 1 -- 172.21.15.59:0/1042497646 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c003820 con 0x7fa9700af720 2024-05-30T17:02:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa977e00640 1 -- 172.21.15.59:0/1042497646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97014c760 con 0x7fa9700af720 2024-05-30T17:02:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa977e00640 1 -- 172.21.15.59:0/1042497646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa97014cd20 con 0x7fa9700af720 2024-05-30T17:02:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.014+0000 7fa977e00640 1 -- 172.21.15.59:0/1042497646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa970068a90 con 0x7fa9700af720 2024-05-30T17:02:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.018+0000 7fa96d600640 1 -- 172.21.15.59:0/1042497646 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7fa95c0039c0 con 0x7fa9700af720 2024-05-30T17:02:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.018+0000 7fa96d600640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa950069a00 0x7fa95006bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.018+0000 7fa96d600640 1 -- 172.21.15.59:0/1042497646 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7fa95c11fd20 con 0x7fa9700af720 2024-05-30T17:02:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.018+0000 7fa975400640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa950069a00 0x7fa95006bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.018+0000 7fa975400640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa950069a00 0x7fa95006bec0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa964007fd0 tx=0x7fa964007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.022+0000 7fa96d600640 1 -- 172.21.15.59:0/1042497646 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa95c0c6070 con 0x7fa9700af720 2024-05-30T17:02:05.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.210+0000 7fa977e00640 1 -- 172.21.15.59:0/1042497646 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fa9700691a0 con 0x7fa950069a00 2024-05-30T17:02:05.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.210+0000 7fa96d600640 1 -- 172.21.15.59:0/1042497646 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fa9700691a0 con 0x7fa950069a00 2024-05-30T17:02:05.215 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:02:05.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:05.215 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T17:02:05.215 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:05.215 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:02:05.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.214+0000 7fa977e00640 1 -- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa950069a00 msgr2=0x7fa95006bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:05.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.214+0000 7fa977e00640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa950069a00 0x7fa95006bec0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa964007fd0 tx=0x7fa964007e40 comp rx=0 tx=0).stop 2024-05-30T17:02:05.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.214+0000 7fa977e00640 1 -- 172.21.15.59:0/1042497646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9700af720 msgr2=0x7fa970152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:05.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.214+0000 7fa977e00640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9700af720 0x7fa970152c00 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0097c0 tx=0x7fa95c01ac70 comp rx=0 tx=0).stop 2024-05-30T17:02:05.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.214+0000 7fa977e00640 1 -- 172.21.15.59:0/1042497646 shutdown_connections 2024-05-30T17:02:05.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.214+0000 7fa977e00640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa950069a00 0x7fa95006bec0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.214+0000 7fa977e00640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9700d0560 0x7fa97014d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.214+0000 7fa977e00640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9700af720 0x7fa970152c00 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.214+0000 7fa977e00640 1 --2- 172.21.15.59:0/1042497646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa97006e900 0x7fa97014f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.214+0000 7fa977e00640 1 -- 172.21.15.59:0/1042497646 >> 172.21.15.59:0/1042497646 conn(0x7fa9700b22d0 msgr2=0x7fa97006f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:05.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.214+0000 7fa977e00640 1 -- 172.21.15.59:0/1042497646 shutdown_connections 2024-05-30T17:02:05.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.214+0000 7fa977e00640 1 -- 172.21.15.59:0/1042497646 wait complete. 2024-05-30T17:02:05.236 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:02:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f4007200640 1 Processor -- start 2024-05-30T17:02:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f4007200640 1 -- start start 2024-05-30T17:02:05.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f4007200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400015c5f0 0x7f400006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:05.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f4007200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40000d0ea0 0x7f40000cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:05.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f4007200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f400006c830 con 0x7f40000cddf0 2024-05-30T17:02:05.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f4007200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f400006bf90 con 0x7f40000d0ea0 2024-05-30T17:02:05.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f4007200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f400006c270 con 0x7f400015c5f0 2024-05-30T17:02:05.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f4005200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40000d0ea0 0x7f40000cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:05.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f3ff7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f40000cddf0 0x7f40000d0790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58806/0 (socket says 172.21.15.59:58806) 2024-05-30T17:02:05.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f3ff7e00640 1 -- 172.21.15.59:0/2639888747 learned_addr learned my addr 172.21.15.59:0/2639888747 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:05.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f3fffe00640 1 --2- 172.21.15.59:0/2639888747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400015c5f0 0x7f400006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:05.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f3fff400640 1 -- 172.21.15.59:0/2639888747 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772470543 0 0) 0x7f400006c830 con 0x7f40000cddf0 2024-05-30T17:02:05.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f3fff400640 1 -- 172.21.15.59:0/2639888747 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fe4003530 con 0x7f40000cddf0 2024-05-30T17:02:05.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f4005200640 1 -- 172.21.15.59:0/2639888747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400015c5f0 msgr2=0x7f400006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:05.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f4005200640 1 --2- 172.21.15.59:0/2639888747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400015c5f0 0x7f400006b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f4005200640 1 -- 172.21.15.59:0/2639888747 >> v1:172.21.15.59:6789/0 conn(0x7f40000cddf0 legacy=0x7f40000d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:05.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f4005200640 1 -- 172.21.15.59:0/2639888747 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400006c550 con 0x7f40000d0ea0 2024-05-30T17:02:05.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.374+0000 7f3fffe00640 1 --2- 172.21.15.59:0/2639888747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400015c5f0 0x7f400006b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:05.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.378+0000 7f4005200640 1 --2- 172.21.15.59:0/2639888747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40000d0ea0 0x7f40000cce50 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009d90 tx=0x7f3ff801d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef65c334467d275 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:05.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.378+0000 7f3fff400640 1 -- 172.21.15.59:0/2639888747 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80b2070 con 0x7f40000d0ea0 2024-05-30T17:02:05.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.378+0000 7f3fff400640 1 -- 172.21.15.59:0/2639888747 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff80a5a20 con 0x7f40000d0ea0 2024-05-30T17:02:05.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.378+0000 7f3fff400640 1 -- 172.21.15.59:0/2639888747 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80a5df0 con 0x7f40000d0ea0 2024-05-30T17:02:05.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.378+0000 7f4007200640 1 -- 172.21.15.59:0/2639888747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40000d0ea0 msgr2=0x7f40000cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:05.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.378+0000 7f4007200640 1 --2- 172.21.15.59:0/2639888747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40000d0ea0 0x7f40000cce50 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009d90 tx=0x7f3ff801d3a0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.378+0000 7f4007200640 1 -- 172.21.15.59:0/2639888747 shutdown_connections 2024-05-30T17:02:05.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.378+0000 7f4007200640 1 --2- 172.21.15.59:0/2639888747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40000d0ea0 0x7f40000cce50 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.378+0000 7f4007200640 1 --2- 172.21.15.59:0/2639888747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400015c5f0 0x7f400006b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.378+0000 7f4007200640 1 -- 172.21.15.59:0/2639888747 >> 172.21.15.59:0/2639888747 conn(0x7f400009aa40 msgr2=0x7f40000b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:05.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.378+0000 7f4007200640 1 -- 172.21.15.59:0/2639888747 shutdown_connections 2024-05-30T17:02:05.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.378+0000 7f4007200640 1 -- 172.21.15.59:0/2639888747 wait complete. 2024-05-30T17:02:05.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f4007200640 1 Processor -- start 2024-05-30T17:02:05.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f4007200640 1 -- start start 2024-05-30T17:02:05.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f4007200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40000cddf0 0x7f40000b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:05.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f4007200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40000d0ea0 0x7f40000cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:05.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f4007200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400015c5f0 0x7f4000155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:05.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f4007200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f400015d360 con 0x7f40000d0ea0 2024-05-30T17:02:05.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f4007200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f400015d1e0 con 0x7f40000cddf0 2024-05-30T17:02:05.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f4007200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4000169290 con 0x7f400015c5f0 2024-05-30T17:02:05.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3ff7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40000d0ea0 0x7f40000cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:05.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3ff7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40000d0ea0 0x7f40000cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41646/0 (socket says 172.21.15.59:41646) 2024-05-30T17:02:05.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f4005200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400015c5f0 0x7f4000155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:05.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3fffe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40000cddf0 0x7f40000b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:05.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3ff7e00640 1 -- 172.21.15.59:0/2461644188 learned_addr learned my addr 172.21.15.59:0/2461644188 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:05.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3ff7e00640 1 -- 172.21.15.59:0/2461644188 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400015c5f0 msgr2=0x7f4000155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:05.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3ff7e00640 1 --2- 172.21.15.59:0/2461644188 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400015c5f0 0x7f4000155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3ff7e00640 1 -- 172.21.15.59:0/2461644188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40000cddf0 msgr2=0x7f40000b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:05.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3ff7e00640 1 --2- 172.21.15.59:0/2461644188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40000cddf0 0x7f40000b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3ff7e00640 1 -- 172.21.15.59:0/2461644188 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40000b5fb0 con 0x7f40000d0ea0 2024-05-30T17:02:05.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3ff7e00640 1 --2- 172.21.15.59:0/2461644188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40000d0ea0 0x7f40000cb000 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800c450 tx=0x7f3fe800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:05.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3ffcc00640 1 -- 172.21.15.59:0/2461644188 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8017070 con 0x7f40000d0ea0 2024-05-30T17:02:05.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3ffcc00640 1 -- 172.21.15.59:0/2461644188 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe8005cf0 con 0x7f40000d0ea0 2024-05-30T17:02:05.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f3ffcc00640 1 -- 172.21.15.59:0/2461644188 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8007290 con 0x7f40000d0ea0 2024-05-30T17:02:05.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f4007200640 1 -- 172.21.15.59:0/2461644188 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40000b6290 con 0x7f40000d0ea0 2024-05-30T17:02:05.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.382+0000 7f4007200640 1 -- 172.21.15.59:0/2461644188 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40000b6850 con 0x7f40000d0ea0 2024-05-30T17:02:05.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.386+0000 7f4007200640 1 -- 172.21.15.59:0/2461644188 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4000068a90 con 0x7f40000d0ea0 2024-05-30T17:02:05.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.386+0000 7f3ffcc00640 1 -- 172.21.15.59:0/2461644188 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7f3fe801a070 con 0x7f40000d0ea0 2024-05-30T17:02:05.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.386+0000 7f3ffcc00640 1 --2- 172.21.15.59:0/2461644188 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3fdc069a00 0x7f3fdc06bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:05.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.386+0000 7f3ffcc00640 1 -- 172.21.15.59:0/2461644188 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f3fe80849d0 con 0x7f40000d0ea0 2024-05-30T17:02:05.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.386+0000 7f3fffe00640 1 --2- 172.21.15.59:0/2461644188 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3fdc069a00 0x7f3fdc06bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:05.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.386+0000 7f3fffe00640 1 --2- 172.21.15.59:0/2461644188 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3fdc069a00 0x7f3fdc06bec0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f40000b1350 tx=0x7f3ff0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:05.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.390+0000 7f3ffcc00640 1 -- 172.21.15.59:0/2461644188 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3fe8056440 con 0x7f40000d0ea0 2024-05-30T17:02:05.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:02:05.460 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:02:05.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 -- 172.21.15.59:0/2461644188 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f40000b0020 con 0x7f40000d0ea0 2024-05-30T17:02:05.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f3ffcc00640 1 -- 172.21.15.59:0/2461644188 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2113 (secure 0 0 0) 0x7f3fe805a740 con 0x7f40000d0ea0 2024-05-30T17:02:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:05.621 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:02:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:02:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:02:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:02:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:02:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:02:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:02:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:02:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:02:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:02:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:02:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:02:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:02:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:02:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:02:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 805, 2024-05-30T17:02:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 104, 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:02:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 799, 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 3222127309, 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 7305121792, 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 765788991488, 2024-05-30T17:02:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 511, 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 34259692, 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 12 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7, 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 7, 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7986 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:02:05.626 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 15, 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:00:45.324121+0000", 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: "04da8471-75f4-4cdc-b7fd-7d14ee491cef": { 2024-05-30T17:02:05.627 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 27.0 seconds before exiting (4s)\n [============================] ", 2024-05-30T17:02:05.628 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:02:05.628 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:02:05.628 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:05.628 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:05.628 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:02:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 -- 172.21.15.59:0/2461644188 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3fdc069a00 msgr2=0x7f3fdc06bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 --2- 172.21.15.59:0/2461644188 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3fdc069a00 0x7f3fdc06bec0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f40000b1350 tx=0x7f3ff0008040 comp rx=0 tx=0).stop 2024-05-30T17:02:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 -- 172.21.15.59:0/2461644188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40000d0ea0 msgr2=0x7f40000cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 --2- 172.21.15.59:0/2461644188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40000d0ea0 0x7f40000cb000 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800c450 tx=0x7f3fe800c910 comp rx=0 tx=0).stop 2024-05-30T17:02:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 -- 172.21.15.59:0/2461644188 shutdown_connections 2024-05-30T17:02:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 --2- 172.21.15.59:0/2461644188 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3fdc069a00 0x7f3fdc06bec0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 --2- 172.21.15.59:0/2461644188 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400015c5f0 0x7f4000155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 --2- 172.21.15.59:0/2461644188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40000d0ea0 0x7f40000cb000 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 --2- 172.21.15.59:0/2461644188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40000cddf0 0x7f40000b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 -- 172.21.15.59:0/2461644188 >> 172.21.15.59:0/2461644188 conn(0x7f400009aa40 msgr2=0x7f40000ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 -- 172.21.15.59:0/2461644188 shutdown_connections 2024-05-30T17:02:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:05.618+0000 7f4007200640 1 -- 172.21.15.59:0/2461644188 wait complete. 2024-05-30T17:02:10.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:02:10.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf6c800640 1 Processor -- start 2024-05-30T17:02:10.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf6c800640 1 -- start start 2024-05-30T17:02:10.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf6c800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf64162020 0x7fcf640d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:10.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf6c800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcf640b1f50 0x7fcf640cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:10.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf6c800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf640b1050 con 0x7fcf640b05f0 2024-05-30T17:02:10.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf6c800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fcf640cdeb0 con 0x7fcf64162020 2024-05-30T17:02:10.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf6c800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fcf640cea30 con 0x7fcf640b1f50 2024-05-30T17:02:10.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf69e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf64162020 0x7fcf640d1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:10.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf69400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcf640b05f0 0x7fcf640b1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58814/0 (socket says 172.21.15.59:58814) 2024-05-30T17:02:10.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf69400640 1 -- 172.21.15.59:0/1382174036 learned_addr learned my addr 172.21.15.59:0/1382174036 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:10.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf6a800640 1 --2- 172.21.15.59:0/1382174036 >> v2:172.21.15.107:3300/0 conn(0x7fcf640b1f50 0x7fcf640cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:10.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf69e00640 1 -- 172.21.15.59:0/1382174036 >> v2:172.21.15.107:3300/0 conn(0x7fcf640b1f50 msgr2=0x7fcf640cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:10.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf69e00640 1 --2- 172.21.15.59:0/1382174036 >> v2:172.21.15.107:3300/0 conn(0x7fcf640b1f50 0x7fcf640cfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:10.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf69e00640 1 -- 172.21.15.59:0/1382174036 >> v1:172.21.15.59:6789/0 conn(0x7fcf640b05f0 legacy=0x7fcf640b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:10.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf69e00640 1 -- 172.21.15.59:0/1382174036 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf640ce100 con 0x7fcf64162020 2024-05-30T17:02:10.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.794+0000 7fcf68a00640 1 -- 172.21.15.59:0/1382174036 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835359986 0 0) 0x7fcf640b1050 con 0x7fcf640b05f0 2024-05-30T17:02:10.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.798+0000 7fcf69e00640 1 --2- 172.21.15.59:0/1382174036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf64162020 0x7fcf640d1d50 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fcf640d2410 tx=0x7fcf5801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0aca40cc9dc831d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:10.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.798+0000 7fcf68a00640 1 -- 172.21.15.59:0/1382174036 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf580b0070 con 0x7fcf64162020 2024-05-30T17:02:10.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.798+0000 7fcf68a00640 1 -- 172.21.15.59:0/1382174036 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf580ab600 con 0x7fcf64162020 2024-05-30T17:02:10.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.798+0000 7fcf68a00640 1 -- 172.21.15.59:0/1382174036 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf580ab9d0 con 0x7fcf64162020 2024-05-30T17:02:10.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.798+0000 7fcf6c800640 1 -- 172.21.15.59:0/1382174036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf64162020 msgr2=0x7fcf640d1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:10.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.798+0000 7fcf6c800640 1 --2- 172.21.15.59:0/1382174036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf64162020 0x7fcf640d1d50 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fcf640d2410 tx=0x7fcf5801c480 comp rx=0 tx=0).stop 2024-05-30T17:02:10.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.798+0000 7fcf6c800640 1 -- 172.21.15.59:0/1382174036 shutdown_connections 2024-05-30T17:02:10.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.798+0000 7fcf6c800640 1 --2- 172.21.15.59:0/1382174036 >> v2:172.21.15.107:3300/0 conn(0x7fcf640b1f50 0x7fcf640cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:10.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.798+0000 7fcf6c800640 1 --2- 172.21.15.59:0/1382174036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf64162020 0x7fcf640d1d50 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:10.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.798+0000 7fcf6c800640 1 -- 172.21.15.59:0/1382174036 >> 172.21.15.59:0/1382174036 conn(0x7fcf640b6870 msgr2=0x7fcf640b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:10.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.798+0000 7fcf6c800640 1 -- 172.21.15.59:0/1382174036 shutdown_connections 2024-05-30T17:02:10.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.798+0000 7fcf6c800640 1 -- 172.21.15.59:0/1382174036 wait complete. 2024-05-30T17:02:10.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6c800640 1 Processor -- start 2024-05-30T17:02:10.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6c800640 1 -- start start 2024-05-30T17:02:10.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6c800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf640b05f0 0x7fcf6415a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6c800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf640b1f50 0x7fcf64156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf64162020 0x7fcf64156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf640cf040 con 0x7fcf64162020 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6c800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcf640ceec0 con 0x7fcf640b1f50 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6c800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcf640d08e0 con 0x7fcf640b05f0 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf64162020 0x7fcf64156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf64162020 0x7fcf64156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41664/0 (socket says 172.21.15.59:41664) 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6a800640 1 -- 172.21.15.59:0/478706207 learned_addr learned my addr 172.21.15.59:0/478706207 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf69400640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf640b1f50 0x7fcf64156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf69e00640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf640b05f0 0x7fcf6415a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6a800640 1 -- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf640b05f0 msgr2=0x7fcf6415a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6a800640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf640b05f0 0x7fcf6415a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:10.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6a800640 1 -- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf640b1f50 msgr2=0x7fcf64156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:10.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6a800640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf640b1f50 0x7fcf64156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:10.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6a800640 1 -- 172.21.15.59:0/478706207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6406fd70 con 0x7fcf64162020 2024-05-30T17:02:10.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6a800640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf64162020 0x7fcf64156fb0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000efc0 tx=0x7fcf6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:10.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf5e000640 1 -- 172.21.15.59:0/478706207 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60018020 con 0x7fcf64162020 2024-05-30T17:02:10.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf5e000640 1 -- 172.21.15.59:0/478706207 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf60014480 con 0x7fcf64162020 2024-05-30T17:02:10.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf5e000640 1 -- 172.21.15.59:0/478706207 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60014870 con 0x7fcf64162020 2024-05-30T17:02:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6c800640 1 -- 172.21.15.59:0/478706207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf64070050 con 0x7fcf64162020 2024-05-30T17:02:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6c800640 1 -- 172.21.15.59:0/478706207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf64070610 con 0x7fcf64162020 2024-05-30T17:02:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.802+0000 7fcf6c800640 1 -- 172.21.15.59:0/478706207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf64068a90 con 0x7fcf64162020 2024-05-30T17:02:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.806+0000 7fcf5e000640 1 -- 172.21.15.59:0/478706207 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7fcf6001b020 con 0x7fcf64162020 2024-05-30T17:02:10.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.806+0000 7fcf5e000640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcf48069a00 0x7fcf4806bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:10.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.806+0000 7fcf5e000640 1 -- 172.21.15.59:0/478706207 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7fcf600865e0 con 0x7fcf64162020 2024-05-30T17:02:10.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.806+0000 7fcf69e00640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcf48069a00 0x7fcf4806bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:10.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.806+0000 7fcf69e00640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcf48069a00 0x7fcf4806bec0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcf580ad000 tx=0x7fcf580a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:10.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:10.810+0000 7fcf5e000640 1 -- 172.21.15.59:0/478706207 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcf60022030 con 0x7fcf64162020 2024-05-30T17:02:11.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.030+0000 7fcf6c800640 1 -- 172.21.15.59:0/478706207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcf640cdc70 con 0x7fcf64162020 2024-05-30T17:02:11.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.030+0000 7fcf5e000640 1 -- 172.21.15.59:0/478706207 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2110 (secure 0 0 0) 0x7fcf60010040 con 0x7fcf64162020 2024-05-30T17:02:11.035 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:11.035 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:02:11.035 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:02:11.035 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:02:11.035 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:02:11.035 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:11.036 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 811, 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 104, 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:02:11.037 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 797, 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 3222158873, 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 7305170944, 2024-05-30T17:02:11.038 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 765788942336, 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 597, 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 15612, 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 5 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7, 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:02:11.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 7, 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7986 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:02:11.040 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 15, 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:00:45.324121+0000", 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: "04da8471-75f4-4cdc-b7fd-7d14ee491cef": { 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 21.0 seconds before exiting (10s)\n [============================] ", 2024-05-30T17:02:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:02:11.042 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:02:11.042 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:11.042 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:11.042 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:02:11.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.034+0000 7fcf6c800640 1 -- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcf48069a00 msgr2=0x7fcf4806bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:11.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.034+0000 7fcf6c800640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcf48069a00 0x7fcf4806bec0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcf580ad000 tx=0x7fcf580a6000 comp rx=0 tx=0).stop 2024-05-30T17:02:11.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.034+0000 7fcf6c800640 1 -- 172.21.15.59:0/478706207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf64162020 msgr2=0x7fcf64156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:11.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.034+0000 7fcf6c800640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf64162020 0x7fcf64156fb0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000efc0 tx=0x7fcf6000c490 comp rx=0 tx=0).stop 2024-05-30T17:02:11.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.034+0000 7fcf6c800640 1 -- 172.21.15.59:0/478706207 shutdown_connections 2024-05-30T17:02:11.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.034+0000 7fcf6c800640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcf48069a00 0x7fcf4806bec0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:11.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.034+0000 7fcf6c800640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf64162020 0x7fcf64156fb0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:11.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.034+0000 7fcf6c800640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf640b1f50 0x7fcf64156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:11.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.034+0000 7fcf6c800640 1 --2- 172.21.15.59:0/478706207 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf640b05f0 0x7fcf6415a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.034+0000 7fcf6c800640 1 -- 172.21.15.59:0/478706207 >> 172.21.15.59:0/478706207 conn(0x7fcf640b6870 msgr2=0x7fcf640ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.034+0000 7fcf6c800640 1 -- 172.21.15.59:0/478706207 shutdown_connections 2024-05-30T17:02:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:11.034+0000 7fcf6c800640 1 -- 172.21.15.59:0/478706207 wait complete. 2024-05-30T17:02:16.058 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:02:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.206+0000 7f238b200640 1 Processor -- start 2024-05-30T17:02:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.206+0000 7f238b200640 1 -- start start 2024-05-30T17:02:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.206+0000 7f238b200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23840b37a0 0x7f23840d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.206+0000 7f238b200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23840d0260 con 0x7f238409b150 2024-05-30T17:02:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.206+0000 7f238b200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23840d0540 con 0x7f23840cdb60 2024-05-30T17:02:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.206+0000 7f238b200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f23840d0010 con 0x7f23840b37a0 2024-05-30T17:02:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.206+0000 7f2383e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23840b37a0 0x7f23840d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.206+0000 7f2389200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f238409b150 0x7f23840b1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37070/0 (socket says 172.21.15.59:37070) 2024-05-30T17:02:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.206+0000 7f2389200640 1 -- 172.21.15.59:0/1487576884 learned_addr learned my addr 172.21.15.59:0/1487576884 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.210+0000 7f2383e00640 1 -- 172.21.15.59:0/1487576884 >> v1:172.21.15.107:6789/0 conn(0x7f23840cdb60 legacy=0x7f238409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.210+0000 7f2383e00640 1 -- 172.21.15.59:0/1487576884 >> v1:172.21.15.59:6789/0 conn(0x7f238409b150 legacy=0x7f23840b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.210+0000 7f2383e00640 1 -- 172.21.15.59:0/1487576884 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23840d0820 con 0x7f23840b37a0 2024-05-30T17:02:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.210+0000 7f2383400640 1 -- 172.21.15.59:0/1487576884 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3173500033 0 0) 0x7f23840d0260 con 0x7f238409b150 2024-05-30T17:02:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.210+0000 7f2383e00640 1 --2- 172.21.15.59:0/1487576884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23840b37a0 0x7f23840d1020 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f236c0097a0 tx=0x7f236c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e342a5cad0024a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.210+0000 7f2383400640 1 -- 172.21.15.59:0/1487576884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c0b0070 con 0x7f23840b37a0 2024-05-30T17:02:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.210+0000 7f2383400640 1 -- 172.21.15.59:0/1487576884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f236c0ab600 con 0x7f23840b37a0 2024-05-30T17:02:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.210+0000 7f2383400640 1 -- 172.21.15.59:0/1487576884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c0ab9d0 con 0x7f23840b37a0 2024-05-30T17:02:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.210+0000 7f238b200640 1 -- 172.21.15.59:0/1487576884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23840b37a0 msgr2=0x7f23840d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:16.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.210+0000 7f238b200640 1 --2- 172.21.15.59:0/1487576884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23840b37a0 0x7f23840d1020 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f236c0097a0 tx=0x7f236c01c3f0 comp rx=0 tx=0).stop 2024-05-30T17:02:16.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 -- 172.21.15.59:0/1487576884 shutdown_connections 2024-05-30T17:02:16.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 --2- 172.21.15.59:0/1487576884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23840b37a0 0x7f23840d1020 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:16.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 -- 172.21.15.59:0/1487576884 >> 172.21.15.59:0/1487576884 conn(0x7f23840b3f30 msgr2=0x7f23840b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:16.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 -- 172.21.15.59:0/1487576884 shutdown_connections 2024-05-30T17:02:16.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 -- 172.21.15.59:0/1487576884 wait complete. 2024-05-30T17:02:16.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 Processor -- start 2024-05-30T17:02:16.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 -- start start 2024-05-30T17:02:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f238409b150 0x7f2384158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23840b37a0 0x7f2384159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23840cdb60 0x7f238406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f238416aa30 con 0x7f238409b150 2024-05-30T17:02:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f238416a8b0 con 0x7f23840cdb60 2024-05-30T17:02:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f238b200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f238416abb0 con 0x7f23840b37a0 2024-05-30T17:02:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f2383e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f238409b150 0x7f2384158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f2383e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f238409b150 0x7f2384158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53830/0 (socket says 172.21.15.59:53830) 2024-05-30T17:02:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f2383e00640 1 -- 172.21.15.59:0/983306147 learned_addr learned my addr 172.21.15.59:0/983306147 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f2389200640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23840cdb60 0x7f238406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f237b400640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23840b37a0 0x7f2384159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f2383e00640 1 -- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23840b37a0 msgr2=0x7f2384159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f2383e00640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23840b37a0 0x7f2384159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f2383e00640 1 -- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23840cdb60 msgr2=0x7f238406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f2383e00640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23840cdb60 0x7f238406dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f2383e00640 1 -- 172.21.15.59:0/983306147 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238415d550 con 0x7f238409b150 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f237b400640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23840b37a0 0x7f2384159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f2389200640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23840cdb60 0x7f238406dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.214+0000 7f2383e00640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f238409b150 0x7f2384158690 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f236c0ae040 tx=0x7f236c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.218+0000 7f2380c00640 1 -- 172.21.15.59:0/983306147 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c0bb020 con 0x7f238409b150 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.218+0000 7f2380c00640 1 -- 172.21.15.59:0/983306147 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f236c0b1040 con 0x7f238409b150 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.218+0000 7f2380c00640 1 -- 172.21.15.59:0/983306147 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c0b0050 con 0x7f238409b150 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.218+0000 7f238b200640 1 -- 172.21.15.59:0/983306147 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238415d830 con 0x7f238409b150 2024-05-30T17:02:16.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.218+0000 7f238b200640 1 -- 172.21.15.59:0/983306147 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238415ddf0 con 0x7f238409b150 2024-05-30T17:02:16.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.218+0000 7f238b200640 1 -- 172.21.15.59:0/983306147 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2384068a90 con 0x7f238409b150 2024-05-30T17:02:16.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.218+0000 7f2380c00640 1 -- 172.21.15.59:0/983306147 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7f236c0be070 con 0x7f238409b150 2024-05-30T17:02:16.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.218+0000 7f2380c00640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2360069a30 0x7f236006bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:16.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.218+0000 7f2380c00640 1 -- 172.21.15.59:0/983306147 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f236c11f010 con 0x7f238409b150 2024-05-30T17:02:16.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.218+0000 7f237b400640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2360069a30 0x7f236006bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:16.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.222+0000 7f237b400640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2360069a30 0x7f236006bef0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f238415b840 tx=0x7f2374009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:16.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.222+0000 7f2380c00640 1 -- 172.21.15.59:0/983306147 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f236c016070 con 0x7f238409b150 2024-05-30T17:02:16.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.446+0000 7f238b200640 1 -- 172.21.15.59:0/983306147 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2384167aa0 con 0x7f238409b150 2024-05-30T17:02:16.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.446+0000 7f2380c00640 1 -- 172.21.15.59:0/983306147 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2109 (secure 0 0 0) 0x7f236c0b3300 con 0x7f238409b150 2024-05-30T17:02:16.452 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:16.452 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:02:16.452 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:02:16.452 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:02:16.452 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:02:16.452 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:02:16.452 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:02:16.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:16.452 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:02:16.452 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:02:16.452 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:02:16.452 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 816, 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:16.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 104, 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:02:16.454 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 797, 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 3222165272, 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 7305175040, 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 765788938240, 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 255, 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 4094, 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 1 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:16.455 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7, 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 7, 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7986 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:02:16.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 15, 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:00:45.324121+0000", 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:16.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:16.458 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:02:16.458 INFO:teuthology.orchestra.run.smithi059.stdout: "04da8471-75f4-4cdc-b7fd-7d14ee491cef": { 2024-05-30T17:02:16.458 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 16.0 seconds before exiting (15s)\n [============================] ", 2024-05-30T17:02:16.458 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:02:16.458 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:02:16.458 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:16.458 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:16.458 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:02:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.450+0000 7f238b200640 1 -- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2360069a30 msgr2=0x7f236006bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.450+0000 7f238b200640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2360069a30 0x7f236006bef0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f238415b840 tx=0x7f2374009040 comp rx=0 tx=0).stop 2024-05-30T17:02:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.450+0000 7f238b200640 1 -- 172.21.15.59:0/983306147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f238409b150 msgr2=0x7f2384158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.450+0000 7f238b200640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f238409b150 0x7f2384158690 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f236c0ae040 tx=0x7f236c01ac30 comp rx=0 tx=0).stop 2024-05-30T17:02:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.450+0000 7f238b200640 1 -- 172.21.15.59:0/983306147 shutdown_connections 2024-05-30T17:02:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.450+0000 7f238b200640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2360069a30 0x7f236006bef0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.450+0000 7f238b200640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23840cdb60 0x7f238406dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.450+0000 7f238b200640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23840b37a0 0x7f2384159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:16.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.450+0000 7f238b200640 1 --2- 172.21.15.59:0/983306147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f238409b150 0x7f2384158690 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:16.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.450+0000 7f238b200640 1 -- 172.21.15.59:0/983306147 >> 172.21.15.59:0/983306147 conn(0x7f23840b3f30 msgr2=0x7f2384167e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:16.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.450+0000 7f238b200640 1 -- 172.21.15.59:0/983306147 shutdown_connections 2024-05-30T17:02:16.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:16.450+0000 7f238b200640 1 -- 172.21.15.59:0/983306147 wait complete. 2024-05-30T17:02:21.473 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:02:21.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe47ec00640 1 Processor -- start 2024-05-30T17:02:21.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe47ec00640 1 -- start start 2024-05-30T17:02:21.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe47ec00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe4780b37a0 0x7fe4780d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:21.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe47ec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe47809b150 0x7fe4780cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:21.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe47ec00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4780d0260 con 0x7fe4780cdb60 2024-05-30T17:02:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe47ec00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe4780d0010 con 0x7fe4780b37a0 2024-05-30T17:02:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe47ec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe4780d0540 con 0x7fe47809b150 2024-05-30T17:02:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe46fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe4780cdb60 0x7fe47809aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37080/0 (socket says 172.21.15.59:37080) 2024-05-30T17:02:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe46fe00640 1 -- 172.21.15.59:0/3021459308 learned_addr learned my addr 172.21.15.59:0/3021459308 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe477e00640 1 --2- 172.21.15.59:0/3021459308 >> v2:172.21.15.107:3300/0 conn(0x7fe4780b37a0 0x7fe4780d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe47cc00640 1 --2- 172.21.15.59:0/3021459308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe47809b150 0x7fe4780cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe477400640 1 -- 172.21.15.59:0/3021459308 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4107816217 0 0) 0x7fe4780d0260 con 0x7fe4780cdb60 2024-05-30T17:02:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe477400640 1 -- 172.21.15.59:0/3021459308 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe45c003530 con 0x7fe4780cdb60 2024-05-30T17:02:21.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe47cc00640 1 -- 172.21.15.59:0/3021459308 >> v2:172.21.15.107:3300/0 conn(0x7fe4780b37a0 msgr2=0x7fe4780d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:21.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe47cc00640 1 --2- 172.21.15.59:0/3021459308 >> v2:172.21.15.107:3300/0 conn(0x7fe4780b37a0 0x7fe4780d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:21.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe47cc00640 1 -- 172.21.15.59:0/3021459308 >> v1:172.21.15.59:6789/0 conn(0x7fe4780cdb60 legacy=0x7fe47809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:21.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe477400640 1 -- 172.21.15.59:0/3021459308 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2234322521 0 0) 0x7fe45c003530 con 0x7fe4780cdb60 2024-05-30T17:02:21.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe47cc00640 1 -- 172.21.15.59:0/3021459308 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4780d0820 con 0x7fe47809b150 2024-05-30T17:02:21.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.622+0000 7fe477e00640 1 --2- 172.21.15.59:0/3021459308 >> v2:172.21.15.107:3300/0 conn(0x7fe4780b37a0 0x7fe4780d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:02:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.626+0000 7fe47cc00640 1 --2- 172.21.15.59:0/3021459308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe47809b150 0x7fe4780cdfc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe470009d90 tx=0x7fe47001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc67150d5595608f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.626+0000 7fe477400640 1 -- 172.21.15.59:0/3021459308 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4700b2070 con 0x7fe47809b150 2024-05-30T17:02:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.626+0000 7fe477400640 1 -- 172.21.15.59:0/3021459308 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4700a5510 con 0x7fe47809b150 2024-05-30T17:02:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.626+0000 7fe477400640 1 -- 172.21.15.59:0/3021459308 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe460001680 con 0x7fe47809b150 2024-05-30T17:02:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.626+0000 7fe47ec00640 1 -- 172.21.15.59:0/3021459308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe47809b150 msgr2=0x7fe4780cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.626+0000 7fe47ec00640 1 --2- 172.21.15.59:0/3021459308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe47809b150 0x7fe4780cdfc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe470009d90 tx=0x7fe47001c800 comp rx=0 tx=0).stop 2024-05-30T17:02:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.626+0000 7fe47ec00640 1 -- 172.21.15.59:0/3021459308 shutdown_connections 2024-05-30T17:02:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.626+0000 7fe47ec00640 1 --2- 172.21.15.59:0/3021459308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe47809b150 0x7fe4780cdfc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.626+0000 7fe47ec00640 1 --2- 172.21.15.59:0/3021459308 >> v2:172.21.15.107:3300/0 conn(0x7fe4780b37a0 0x7fe4780d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.626+0000 7fe47ec00640 1 -- 172.21.15.59:0/3021459308 >> 172.21.15.59:0/3021459308 conn(0x7fe4780b3f30 msgr2=0x7fe4780b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.626+0000 7fe47ec00640 1 -- 172.21.15.59:0/3021459308 shutdown_connections 2024-05-30T17:02:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.626+0000 7fe47ec00640 1 -- 172.21.15.59:0/3021459308 wait complete. 2024-05-30T17:02:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47ec00640 1 Processor -- start 2024-05-30T17:02:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47ec00640 1 -- start start 2024-05-30T17:02:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47ec00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe47809b150 0x7fe478158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47ec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4780b37a0 0x7fe478157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47ec00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4780cdb60 0x7fe4780c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47ec00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe4780b29c0 con 0x7fe4780cdb60 2024-05-30T17:02:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47ec00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe4780b2840 con 0x7fe47809b150 2024-05-30T17:02:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47ec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe4780b2b40 con 0x7fe4780b37a0 2024-05-30T17:02:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4780cdb60 0x7fe4780c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4780cdb60 0x7fe4780c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53844/0 (socket says 172.21.15.59:53844) 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47cc00640 1 -- 172.21.15.59:0/1832358191 learned_addr learned my addr 172.21.15.59:0/1832358191 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe477e00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe47809b150 0x7fe478158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe46fe00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4780b37a0 0x7fe478157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47cc00640 1 -- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4780b37a0 msgr2=0x7fe478157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47cc00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4780b37a0 0x7fe478157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47cc00640 1 -- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe47809b150 msgr2=0x7fe478158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47cc00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe47809b150 0x7fe478158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47cc00640 1 -- 172.21.15.59:0/1832358191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4780ca850 con 0x7fe4780cdb60 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe477e00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe47809b150 0x7fe478158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47cc00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4780cdb60 0x7fe4780c8000 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fe47001d0a0 tx=0x7fe4700195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe474c00640 1 -- 172.21.15.59:0/1832358191 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4700b2050 con 0x7fe4780cdb60 2024-05-30T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe474c00640 1 -- 172.21.15.59:0/1832358191 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4700be070 con 0x7fe4780cdb60 2024-05-30T17:02:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47ec00640 1 -- 172.21.15.59:0/1832358191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47806cc60 con 0x7fe4780cdb60 2024-05-30T17:02:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe474c00640 1 -- 172.21.15.59:0/1832358191 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470009450 con 0x7fe4780cdb60 2024-05-30T17:02:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.630+0000 7fe47ec00640 1 -- 172.21.15.59:0/1832358191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe47806d220 con 0x7fe4780cdb60 2024-05-30T17:02:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.634+0000 7fe47ec00640 1 -- 172.21.15.59:0/1832358191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe478068a90 con 0x7fe4780cdb60 2024-05-30T17:02:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.634+0000 7fe474c00640 1 -- 172.21.15.59:0/1832358191 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7fe4700b9870 con 0x7fe4780cdb60 2024-05-30T17:02:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.634+0000 7fe474c00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe454069a00 0x7fe45406bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.634+0000 7fe474c00640 1 -- 172.21.15.59:0/1832358191 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7fe470120670 con 0x7fe4780cdb60 2024-05-30T17:02:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.634+0000 7fe477e00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe454069a00 0x7fe45406bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.634+0000 7fe477e00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe454069a00 0x7fe45406bec0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe468009ba0 tx=0x7fe468008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.638+0000 7fe474c00640 1 -- 172.21.15.59:0/1832358191 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe470016480 con 0x7fe4780cdb60 2024-05-30T17:02:21.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 -- 172.21.15.59:0/1832358191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe4780ce950 con 0x7fe4780cdb60 2024-05-30T17:02:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe474c00640 1 -- 172.21.15.59:0/1832358191 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2561 (secure 0 0 0) 0x7fe4700f27b0 con 0x7fe4780cdb60 2024-05-30T17:02:21.865 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:21.865 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:02:21.865 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:02:21.865 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:02:21.865 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:02:21.865 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:02:21.865 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:02:21.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:21.866 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:02:21.866 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:02:21.866 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:02:21.866 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:02:21.866 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:02:21.866 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:21.866 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:02:21.866 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:02:21.866 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:02:21.866 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:02:21.866 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:21.866 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 821, 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 104, 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:02:21.867 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:02:21.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:21.868 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:02:21.868 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:02:21.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:21.868 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:02:21.868 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:02:21.868 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:21.868 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:21.868 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:02:21.868 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:02:21.868 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 797, 2024-05-30T17:02:21.868 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 3222171373, 2024-05-30T17:02:21.869 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 7305191424, 2024-05-30T17:02:21.869 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 765788921856, 2024-05-30T17:02:21.869 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:02:21.869 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 85, 2024-05-30T17:02:21.869 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 1279, 2024-05-30T17:02:21.869 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:02:21.869 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T17:02:21.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:21.869 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:02:21.869 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T17:02:21.869 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7, 2024-05-30T17:02:21.869 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 7, 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7986 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:02:21.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 16, 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:02:17.345706+0000", 2024-05-30T17:02:21.871 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: "c": { 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:21.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:21.873 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:02:21.873 INFO:teuthology.orchestra.run.smithi059.stdout: "04da8471-75f4-4cdc-b7fd-7d14ee491cef": { 2024-05-30T17:02:21.873 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 10.0 seconds before exiting (21s)\n [============================] ", 2024-05-30T17:02:21.873 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:02:21.873 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:02:21.873 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:21.873 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:21.873 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:02:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 -- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe454069a00 msgr2=0x7fe45406bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe454069a00 0x7fe45406bec0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe468009ba0 tx=0x7fe468008040 comp rx=0 tx=0).stop 2024-05-30T17:02:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 -- 172.21.15.59:0/1832358191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4780cdb60 msgr2=0x7fe4780c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4780cdb60 0x7fe4780c8000 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fe47001d0a0 tx=0x7fe4700195a0 comp rx=0 tx=0).stop 2024-05-30T17:02:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 -- 172.21.15.59:0/1832358191 shutdown_connections 2024-05-30T17:02:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe454069a00 0x7fe45406bec0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4780cdb60 0x7fe4780c8000 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:21.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4780b37a0 0x7fe478157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:21.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 --2- 172.21.15.59:0/1832358191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe47809b150 0x7fe478158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:21.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 -- 172.21.15.59:0/1832358191 >> 172.21.15.59:0/1832358191 conn(0x7fe4780b3f30 msgr2=0x7fe47815f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:21.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 -- 172.21.15.59:0/1832358191 shutdown_connections 2024-05-30T17:02:21.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:21.862+0000 7fe47ec00640 1 -- 172.21.15.59:0/1832358191 wait complete. 2024-05-30T17:02:26.887 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:02:27.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.034+0000 7f4162400640 1 Processor -- start 2024-05-30T17:02:27.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.034+0000 7f4162400640 1 -- start start 2024-05-30T17:02:27.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.034+0000 7f4162400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f415c09b8c0 0x7f415c06e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:27.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.034+0000 7f4162400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415c06e770 con 0x7f415c09b150 2024-05-30T17:02:27.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.034+0000 7f4162400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415c0ccb90 con 0x7f415c0b8120 2024-05-30T17:02:27.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.034+0000 7f4162400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f415c0ce960 con 0x7f415c09b8c0 2024-05-30T17:02:27.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.034+0000 7f415aa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f415c09b150 0x7f415c15e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58834/0 (socket says 172.21.15.59:58834) 2024-05-30T17:02:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.034+0000 7f415be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f415c09b8c0 0x7f415c06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.034+0000 7f415aa00640 1 -- 172.21.15.59:0/3244650843 learned_addr learned my addr 172.21.15.59:0/3244650843 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f415be00640 1 -- 172.21.15.59:0/3244650843 >> v1:172.21.15.107:6789/0 conn(0x7f415c0b8120 legacy=0x7f415c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f415be00640 1 -- 172.21.15.59:0/3244650843 >> v1:172.21.15.59:6789/0 conn(0x7f415c09b150 legacy=0x7f415c15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f415be00640 1 -- 172.21.15.59:0/3244650843 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415c0cce70 con 0x7f415c09b8c0 2024-05-30T17:02:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f415a000640 1 -- 172.21.15.59:0/3244650843 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738304684 0 0) 0x7f415c06e770 con 0x7f415c09b150 2024-05-30T17:02:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f415be00640 1 --2- 172.21.15.59:0/3244650843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f415c09b8c0 0x7f415c06e230 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f41540097c0 tx=0x7f415401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcb5bb60cb7fb01 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f415a000640 1 -- 172.21.15.59:0/3244650843 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41540b1070 con 0x7f415c09b8c0 2024-05-30T17:02:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f415a000640 1 -- 172.21.15.59:0/3244650843 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41540ac410 con 0x7f415c09b8c0 2024-05-30T17:02:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f415a000640 1 -- 172.21.15.59:0/3244650843 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41540ac7e0 con 0x7f415c09b8c0 2024-05-30T17:02:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f4162400640 1 -- 172.21.15.59:0/3244650843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f415c09b8c0 msgr2=0x7f415c06e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f4162400640 1 --2- 172.21.15.59:0/3244650843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f415c09b8c0 0x7f415c06e230 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f41540097c0 tx=0x7f415401c3b0 comp rx=0 tx=0).stop 2024-05-30T17:02:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f4162400640 1 -- 172.21.15.59:0/3244650843 shutdown_connections 2024-05-30T17:02:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f4162400640 1 --2- 172.21.15.59:0/3244650843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f415c09b8c0 0x7f415c06e230 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.038+0000 7f4162400640 1 -- 172.21.15.59:0/3244650843 >> 172.21.15.59:0/3244650843 conn(0x7f415c0b3f90 msgr2=0x7f415c0b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4162400640 1 -- 172.21.15.59:0/3244650843 shutdown_connections 2024-05-30T17:02:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4162400640 1 -- 172.21.15.59:0/3244650843 wait complete. 2024-05-30T17:02:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4162400640 1 Processor -- start 2024-05-30T17:02:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4162400640 1 -- start start 2024-05-30T17:02:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4162400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f415c09b150 0x7f415c14bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4162400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f415c09b8c0 0x7f415c14c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4162400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f415c0b8120 0x7f415c0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4162400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f415c0b52f0 con 0x7f415c0b8120 2024-05-30T17:02:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4162400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f415c06ea30 con 0x7f415c09b150 2024-05-30T17:02:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4162400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f415c14cd30 con 0x7f415c09b8c0 2024-05-30T17:02:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f415c0b8120 0x7f415c0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f415c0b8120 0x7f415c0cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55592/0 (socket says 172.21.15.59:55592) 2024-05-30T17:02:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415be00640 1 -- 172.21.15.59:0/1427010681 learned_addr learned my addr 172.21.15.59:0/1427010681 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415aa00640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f415c09b8c0 0x7f415c14c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415b400640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f415c09b150 0x7f415c14bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415be00640 1 -- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f415c09b8c0 msgr2=0x7f415c14c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415be00640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f415c09b8c0 0x7f415c14c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415be00640 1 -- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f415c09b150 msgr2=0x7f415c14bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415be00640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f415c09b150 0x7f415c14bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415be00640 1 -- 172.21.15.59:0/1427010681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415c15f190 con 0x7f415c0b8120 2024-05-30T17:02:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415aa00640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f415c09b8c0 0x7f415c14c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415b400640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f415c09b150 0x7f415c14bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f415be00640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f415c0b8120 0x7f415c0cb430 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f41540af040 tx=0x7f4154019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4153400640 1 -- 172.21.15.59:0/1427010681 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41540b1040 con 0x7f415c0b8120 2024-05-30T17:02:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4153400640 1 -- 172.21.15.59:0/1427010681 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41540bb070 con 0x7f415c0b8120 2024-05-30T17:02:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4153400640 1 -- 172.21.15.59:0/1427010681 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41540b5410 con 0x7f415c0b8120 2024-05-30T17:02:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.042+0000 7f4162400640 1 -- 172.21.15.59:0/1427010681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f415c15f470 con 0x7f415c0b8120 2024-05-30T17:02:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.046+0000 7f4162400640 1 -- 172.21.15.59:0/1427010681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f415c15fa30 con 0x7f415c0b8120 2024-05-30T17:02:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.046+0000 7f4162400640 1 -- 172.21.15.59:0/1427010681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f415c068a90 con 0x7f415c0b8120 2024-05-30T17:02:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.046+0000 7f4153400640 1 -- 172.21.15.59:0/1427010681 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7f41540b55d0 con 0x7f415c0b8120 2024-05-30T17:02:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.046+0000 7f4153400640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f413c069a00 0x7f413c06bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.046+0000 7f4153400640 1 -- 172.21.15.59:0/1427010681 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f415411f390 con 0x7f415c0b8120 2024-05-30T17:02:27.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.046+0000 7f415b400640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f413c069a00 0x7f413c06bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:27.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.046+0000 7f415b400640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f413c069a00 0x7f413c06bec0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f415c0b3560 tx=0x7f414c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:27.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.050+0000 7f4153400640 1 -- 172.21.15.59:0/1427010681 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4154016090 con 0x7f415c0b8120 2024-05-30T17:02:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.274+0000 7f4162400640 1 -- 172.21.15.59:0/1427010681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f415c1563a0 con 0x7f415c0b8120 2024-05-30T17:02:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.274+0000 7f4153400640 1 -- 172.21.15.59:0/1427010681 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2076 (secure 0 0 0) 0x7f41540f13b0 con 0x7f415c0b8120 2024-05-30T17:02:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:02:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:02:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:02:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:02:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:02:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:02:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:02:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:02:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:02:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:02:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:02:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:02:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:02:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:02:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:02:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 827, 2024-05-30T17:02:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:02:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:02:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:02:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 104, 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:02:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 797, 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 3222171373, 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 7305191424, 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 765788921856, 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 597, 2024-05-30T17:02:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7, 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 7, 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:02:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7986 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:02:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:02:25.347963+0000", 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "04da8471-75f4-4cdc-b7fd-7d14ee491cef": { 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 6.0 seconds before exiting (25s)\n [============================] ", 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:02:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:27.286 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:27.286 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:02:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.278+0000 7f4162400640 1 -- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f413c069a00 msgr2=0x7f413c06bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.278+0000 7f4162400640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f413c069a00 0x7f413c06bec0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f415c0b3560 tx=0x7f414c009040 comp rx=0 tx=0).stop 2024-05-30T17:02:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.278+0000 7f4162400640 1 -- 172.21.15.59:0/1427010681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f415c0b8120 msgr2=0x7f415c0cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.278+0000 7f4162400640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f415c0b8120 0x7f415c0cb430 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f41540af040 tx=0x7f4154019150 comp rx=0 tx=0).stop 2024-05-30T17:02:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.278+0000 7f4162400640 1 -- 172.21.15.59:0/1427010681 shutdown_connections 2024-05-30T17:02:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.278+0000 7f4162400640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f413c069a00 0x7f413c06bec0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.278+0000 7f4162400640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f415c0b8120 0x7f415c0cb430 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.278+0000 7f4162400640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f415c09b8c0 0x7f415c14c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.278+0000 7f4162400640 1 --2- 172.21.15.59:0/1427010681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f415c09b150 0x7f415c14bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.278+0000 7f4162400640 1 -- 172.21.15.59:0/1427010681 >> 172.21.15.59:0/1427010681 conn(0x7f415c0b3f90 msgr2=0x7f415c06db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.278+0000 7f4162400640 1 -- 172.21.15.59:0/1427010681 shutdown_connections 2024-05-30T17:02:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:27.278+0000 7f4162400640 1 -- 172.21.15.59:0/1427010681 wait complete. 2024-05-30T17:02:32.301 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:02:32.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.450+0000 7fc226600640 1 Processor -- start 2024-05-30T17:02:32.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.450+0000 7fc226600640 1 -- start start 2024-05-30T17:02:32.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc226600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2200d0460 0x7fc2200d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:32.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc226600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2200b41e0 con 0x7fc22015b410 2024-05-30T17:02:32.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc226600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2200b3c20 con 0x7fc22015b7f0 2024-05-30T17:02:32.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc226600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc2200c56f0 con 0x7fc2200d0460 2024-05-30T17:02:32.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc225200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc22015b410 0x7fc2200ca880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39080/0 (socket says 172.21.15.59:39080) 2024-05-30T17:02:32.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc225200640 1 -- 172.21.15.59:0/671500779 learned_addr learned my addr 172.21.15.59:0/671500779 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:32.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc225c00640 1 --2- 172.21.15.59:0/671500779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2200d0460 0x7fc2200d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:32.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc21fe00640 1 -- 172.21.15.59:0/671500779 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190478909 0 0) 0x7fc2200b41e0 con 0x7fc22015b410 2024-05-30T17:02:32.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc21fe00640 1 -- 172.21.15.59:0/671500779 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc204003530 con 0x7fc22015b410 2024-05-30T17:02:32.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc21fe00640 1 -- 172.21.15.59:0/671500779 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188822776 0 0) 0x7fc2200b3c20 con 0x7fc22015b7f0 2024-05-30T17:02:32.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc21fe00640 1 -- 172.21.15.59:0/671500779 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2200b41e0 con 0x7fc22015b7f0 2024-05-30T17:02:32.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc225c00640 1 -- 172.21.15.59:0/671500779 >> v1:172.21.15.107:6789/0 conn(0x7fc22015b7f0 legacy=0x7fc2200b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:32.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc225c00640 1 -- 172.21.15.59:0/671500779 >> v1:172.21.15.59:6789/0 conn(0x7fc22015b410 legacy=0x7fc2200ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:32.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.454+0000 7fc225c00640 1 -- 172.21.15.59:0/671500779 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2200b3f00 con 0x7fc2200d0460 2024-05-30T17:02:32.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc225c00640 1 --2- 172.21.15.59:0/671500779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2200d0460 0x7fc2200d08f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc218009dc0 tx=0x7fc21801d3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46b92dbcb3effd21 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:32.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc21fe00640 1 -- 172.21.15.59:0/671500779 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2180b2070 con 0x7fc2200d0460 2024-05-30T17:02:32.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc21fe00640 1 -- 172.21.15.59:0/671500779 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2180a5960 con 0x7fc2200d0460 2024-05-30T17:02:32.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc21fe00640 1 -- 172.21.15.59:0/671500779 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2180a5d30 con 0x7fc2200d0460 2024-05-30T17:02:32.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc226600640 1 -- 172.21.15.59:0/671500779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2200d0460 msgr2=0x7fc2200d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:32.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc226600640 1 --2- 172.21.15.59:0/671500779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2200d0460 0x7fc2200d08f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc218009dc0 tx=0x7fc21801d3f0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc226600640 1 -- 172.21.15.59:0/671500779 shutdown_connections 2024-05-30T17:02:32.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc226600640 1 --2- 172.21.15.59:0/671500779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2200d0460 0x7fc2200d08f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc226600640 1 -- 172.21.15.59:0/671500779 >> 172.21.15.59:0/671500779 conn(0x7fc22006bb80 msgr2=0x7fc22006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:32.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc226600640 1 -- 172.21.15.59:0/671500779 shutdown_connections 2024-05-30T17:02:32.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc226600640 1 -- 172.21.15.59:0/671500779 wait complete. 2024-05-30T17:02:32.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc226600640 1 Processor -- start 2024-05-30T17:02:32.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.458+0000 7fc226600640 1 -- start start 2024-05-30T17:02:32.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc226600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2200d0460 0x7fc22015a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:32.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc226600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc22015b410 0x7fc220159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:32.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc226600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc22015b7f0 0x7fc22015c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:32.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc226600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc2200b3870 con 0x7fc22015b7f0 2024-05-30T17:02:32.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc226600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc2200cccb0 con 0x7fc2200d0460 2024-05-30T17:02:32.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc226600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc2200ce040 con 0x7fc22015b410 2024-05-30T17:02:32.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc225c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc22015b7f0 0x7fc22015c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:32.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc225c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc22015b7f0 0x7fc22015c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51712/0 (socket says 172.21.15.59:51712) 2024-05-30T17:02:32.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc225c00640 1 -- 172.21.15.59:0/3586432787 learned_addr learned my addr 172.21.15.59:0/3586432787 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:32.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc225200640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2200d0460 0x7fc22015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:32.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc217e00640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc22015b410 0x7fc220159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:32.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc225c00640 1 -- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc22015b410 msgr2=0x7fc220159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:32.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc225c00640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc22015b410 0x7fc220159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc225c00640 1 -- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2200d0460 msgr2=0x7fc22015a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:32.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc225c00640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2200d0460 0x7fc22015a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc225c00640 1 -- 172.21.15.59:0/3586432787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22015eaf0 con 0x7fc22015b7f0 2024-05-30T17:02:32.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc225c00640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc22015b7f0 0x7fc22015c260 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc21801ce70 tx=0x7fc218019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:32.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc21d600640 1 -- 172.21.15.59:0/3586432787 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2180bd020 con 0x7fc22015b7f0 2024-05-30T17:02:32.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc21d600640 1 -- 172.21.15.59:0/3586432787 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2180b8690 con 0x7fc22015b7f0 2024-05-30T17:02:32.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc21d600640 1 -- 172.21.15.59:0/3586432787 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2180b2040 con 0x7fc22015b7f0 2024-05-30T17:02:32.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc226600640 1 -- 172.21.15.59:0/3586432787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22015a280 con 0x7fc22015b7f0 2024-05-30T17:02:32.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc226600640 1 -- 172.21.15.59:0/3586432787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc220159e80 con 0x7fc22015b7f0 2024-05-30T17:02:32.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc226600640 1 -- 172.21.15.59:0/3586432787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2200cdb50 con 0x7fc22015b7f0 2024-05-30T17:02:32.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.462+0000 7fc21d600640 1 -- 172.21.15.59:0/3586432787 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7fc2180c0020 con 0x7fc22015b7f0 2024-05-30T17:02:32.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.466+0000 7fc21d600640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc1fc069a00 0x7fc1fc06bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:32.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.466+0000 7fc21d600640 1 -- 172.21.15.59:0/3586432787 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7fc218002020 con 0x7fc22015b7f0 2024-05-30T17:02:32.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.466+0000 7fc225200640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc1fc069a00 0x7fc1fc06bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:32.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.466+0000 7fc225200640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc1fc069a00 0x7fc1fc06bec0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc210000f70 tx=0x7fc210009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:32.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.470+0000 7fc21d600640 1 -- 172.21.15.59:0/3586432787 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc218016580 con 0x7fc22015b7f0 2024-05-30T17:02:32.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 -- 172.21.15.59:0/3586432787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc220068a90 con 0x7fc22015b7f0 2024-05-30T17:02:32.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc21d600640 1 -- 172.21.15.59:0/3586432787 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1729 (secure 0 0 0) 0x7fc2180f2360 con 0x7fc22015b7f0 2024-05-30T17:02:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:32.697 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:02:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:02:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:02:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:02:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:02:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:02:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:02:32.698 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:02:32.698 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:02:32.698 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:02:32.698 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:02:32.698 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:32.698 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:02:32.698 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:02:32.698 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:02:32.698 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:02:32.698 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:32.698 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 832, 2024-05-30T17:02:32.698 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 104, 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:32.699 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 797, 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 3222171373, 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 7305191424, 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 765788921856, 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:32.700 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 62, 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7, 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 7, 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "c", 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 7986 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:32.701 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:02:32.702 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T17:02:32.703 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:02:25.347963+0000", 2024-05-30T17:02:32.703 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:02:32.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:32.703 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": {} 2024-05-30T17:02:32.703 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:02:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 -- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc1fc069a00 msgr2=0x7fc1fc06bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc1fc069a00 0x7fc1fc06bec0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc210000f70 tx=0x7fc210009040 comp rx=0 tx=0).stop 2024-05-30T17:02:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 -- 172.21.15.59:0/3586432787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc22015b7f0 msgr2=0x7fc22015c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc22015b7f0 0x7fc22015c260 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc21801ce70 tx=0x7fc218019730 comp rx=0 tx=0).stop 2024-05-30T17:02:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 -- 172.21.15.59:0/3586432787 shutdown_connections 2024-05-30T17:02:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc1fc069a00 0x7fc1fc06bec0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc22015b7f0 0x7fc22015c260 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc22015b410 0x7fc220159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 --2- 172.21.15.59:0/3586432787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2200d0460 0x7fc22015a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 -- 172.21.15.59:0/3586432787 >> 172.21.15.59:0/3586432787 conn(0x7fc22006bb80 msgr2=0x7fc2200addb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 -- 172.21.15.59:0/3586432787 shutdown_connections 2024-05-30T17:02:32.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.694+0000 7fc226600640 1 -- 172.21.15.59:0/3586432787 wait complete. 2024-05-30T17:02:32.719 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T17:02:32.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed38600640 1 Processor -- start 2024-05-30T17:02:32.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed38600640 1 -- start start 2024-05-30T17:02:32.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed38600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fed300d14c0 0x7fed3006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:32.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed38600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d05b0 0x7fed3009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:32.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed38600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3006ea20 con 0x7fed3009af80 2024-05-30T17:02:32.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed38600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fed30070950 con 0x7fed300d14c0 2024-05-30T17:02:32.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed38600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fed30070c30 con 0x7fed300d05b0 2024-05-30T17:02:32.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed35200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d05b0 0x7fed3009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:32.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed35c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fed300d14c0 0x7fed3006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:32.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed35c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fed300d14c0 0x7fed3006e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:38220/0 (socket says 172.21.15.59:38220) 2024-05-30T17:02:32.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed35200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d05b0 0x7fed3009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:51722/0 (socket says 172.21.15.59:51722) 2024-05-30T17:02:32.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed36600640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fed3009af80 0x7fed30162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:59706/0 (socket says 172.21.15.59:59706) 2024-05-30T17:02:32.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.858+0000 7fed35c00640 1 -- 172.21.15.59:0/1672788432 learned_addr learned my addr 172.21.15.59:0/1672788432 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:32.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed35200640 1 -- 172.21.15.59:0/1672788432 >> v2:172.21.15.107:3300/0 conn(0x7fed300d14c0 msgr2=0x7fed3006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:32.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed35200640 1 --2- 172.21.15.59:0/1672788432 >> v2:172.21.15.107:3300/0 conn(0x7fed300d14c0 0x7fed3006e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed35200640 1 -- 172.21.15.59:0/1672788432 >> v1:172.21.15.107:6789/0 conn(0x7fed3009af80 legacy=0x7fed30162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:32.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed35200640 1 -- 172.21.15.59:0/1672788432 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed30070f10 con 0x7fed300d05b0 2024-05-30T17:02:32.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed35c00640 1 --2- 172.21.15.59:0/1672788432 >> v2:172.21.15.107:3300/0 conn(0x7fed300d14c0 0x7fed3006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:02:32.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed35200640 1 --2- 172.21.15.59:0/1672788432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d05b0 0x7fed3009aa40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0097c0 tx=0x7fed1c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16140e2ba50cb35f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:32.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed2fe00640 1 -- 172.21.15.59:0/1672788432 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c0b0070 con 0x7fed300d05b0 2024-05-30T17:02:32.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed2fe00640 1 -- 172.21.15.59:0/1672788432 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1c0ab600 con 0x7fed300d05b0 2024-05-30T17:02:32.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed2fe00640 1 -- 172.21.15.59:0/1672788432 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c0ab9d0 con 0x7fed300d05b0 2024-05-30T17:02:32.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed38600640 1 -- 172.21.15.59:0/1672788432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d05b0 msgr2=0x7fed3009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:32.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed38600640 1 --2- 172.21.15.59:0/1672788432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d05b0 0x7fed3009aa40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0097c0 tx=0x7fed1c01c4a0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed38600640 1 -- 172.21.15.59:0/1672788432 shutdown_connections 2024-05-30T17:02:32.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed38600640 1 --2- 172.21.15.59:0/1672788432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d05b0 0x7fed3009aa40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed38600640 1 --2- 172.21.15.59:0/1672788432 >> v2:172.21.15.107:3300/0 conn(0x7fed300d14c0 0x7fed3006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.862+0000 7fed38600640 1 -- 172.21.15.59:0/1672788432 >> 172.21.15.59:0/1672788432 conn(0x7fed300b3f80 msgr2=0x7fed300b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:32.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed38600640 1 -- 172.21.15.59:0/1672788432 shutdown_connections 2024-05-30T17:02:32.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed38600640 1 -- 172.21.15.59:0/1672788432 wait complete. 2024-05-30T17:02:32.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed38600640 1 Processor -- start 2024-05-30T17:02:32.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed38600640 1 -- start start 2024-05-30T17:02:32.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed38600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed3009af80 0x7fed300c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:32.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed38600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d05b0 0x7fed3015b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:32.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed38600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300d14c0 0x7fed3015bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:32.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed38600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fed3006e100 con 0x7fed300d14c0 2024-05-30T17:02:32.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed38600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fed300d0a30 con 0x7fed300d05b0 2024-05-30T17:02:32.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed38600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fed3006e280 con 0x7fed3009af80 2024-05-30T17:02:32.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed36600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300d14c0 0x7fed3015bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:32.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed35200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d05b0 0x7fed3015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:32.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed35c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed3009af80 0x7fed300c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:32.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed36600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300d14c0 0x7fed3015bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51724/0 (socket says 172.21.15.59:51724) 2024-05-30T17:02:32.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed36600640 1 -- 172.21.15.59:0/2929171813 learned_addr learned my addr 172.21.15.59:0/2929171813 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:32.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed36600640 1 -- 172.21.15.59:0/2929171813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed3009af80 msgr2=0x7fed300c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:32.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed36600640 1 --2- 172.21.15.59:0/2929171813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed3009af80 0x7fed300c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed36600640 1 -- 172.21.15.59:0/2929171813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d05b0 msgr2=0x7fed3015b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:32.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed36600640 1 --2- 172.21.15.59:0/2929171813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d05b0 0x7fed3015b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:32.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed36600640 1 -- 172.21.15.59:0/2929171813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed300c5f80 con 0x7fed300d14c0 2024-05-30T17:02:32.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed36600640 1 --2- 172.21.15.59:0/2929171813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300d14c0 0x7fed3015bb70 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fed2800c700 tx=0x7fed2800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:32.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed2d600640 1 -- 172.21.15.59:0/2929171813 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28017070 con 0x7fed300d14c0 2024-05-30T17:02:32.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed2d600640 1 -- 172.21.15.59:0/2929171813 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2800ce10 con 0x7fed300d14c0 2024-05-30T17:02:32.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed38600640 1 -- 172.21.15.59:0/2929171813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed300c6240 con 0x7fed300d14c0 2024-05-30T17:02:32.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.866+0000 7fed2d600640 1 -- 172.21.15.59:0/2929171813 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2800a7e0 con 0x7fed300d14c0 2024-05-30T17:02:32.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.870+0000 7fed38600640 1 -- 172.21.15.59:0/2929171813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed300c8900 con 0x7fed300d14c0 2024-05-30T17:02:32.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.870+0000 7fed38600640 1 -- 172.21.15.59:0/2929171813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed300c8440 con 0x7fed300d14c0 2024-05-30T17:02:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.870+0000 7fed2d600640 1 -- 172.21.15.59:0/2929171813 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7fed2801a070 con 0x7fed300d14c0 2024-05-30T17:02:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.870+0000 7fed2d600640 1 --2- 172.21.15.59:0/2929171813 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed10069a00 0x7fed1006bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.870+0000 7fed2d600640 1 -- 172.21.15.59:0/2929171813 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7fed28084b60 con 0x7fed300d14c0 2024-05-30T17:02:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.870+0000 7fed35c00640 1 --2- 172.21.15.59:0/2929171813 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed10069a00 0x7fed1006bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.870+0000 7fed35c00640 1 --2- 172.21.15.59:0/2929171813 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed10069a00 0x7fed1006bec0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fed24006cb0 tx=0x7fed24009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:32.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:32.874+0000 7fed2d600640 1 -- 172.21.15.59:0/2929171813 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed300c8440 con 0x7fed300d14c0 2024-05-30T17:02:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.062+0000 7fed38600640 1 -- 172.21.15.59:0/2929171813 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed300d2270 con 0x7fed10069a00 2024-05-30T17:02:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.066+0000 7fed2d600640 1 -- 172.21.15.59:0/2929171813 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+79 (secure 0 0 0) 0x7fed300d2270 con 0x7fed10069a00 2024-05-30T17:02:33.071 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:33.072 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:02:33.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:33.072 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sv1" 2024-05-30T17:02:33.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:33.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:33.072 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ss1clone1" 2024-05-30T17:02:33.072 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:33.072 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:02:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.070+0000 7fed38600640 1 -- 172.21.15.59:0/2929171813 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed10069a00 msgr2=0x7fed1006bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.070+0000 7fed38600640 1 --2- 172.21.15.59:0/2929171813 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed10069a00 0x7fed1006bec0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fed24006cb0 tx=0x7fed24009240 comp rx=0 tx=0).stop 2024-05-30T17:02:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.070+0000 7fed38600640 1 -- 172.21.15.59:0/2929171813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300d14c0 msgr2=0x7fed3015bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.070+0000 7fed38600640 1 --2- 172.21.15.59:0/2929171813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300d14c0 0x7fed3015bb70 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fed2800c700 tx=0x7fed2800cbc0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.070+0000 7fed38600640 1 -- 172.21.15.59:0/2929171813 shutdown_connections 2024-05-30T17:02:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.070+0000 7fed38600640 1 --2- 172.21.15.59:0/2929171813 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed10069a00 0x7fed1006bec0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.070+0000 7fed38600640 1 --2- 172.21.15.59:0/2929171813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300d14c0 0x7fed3015bb70 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.070+0000 7fed38600640 1 --2- 172.21.15.59:0/2929171813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d05b0 0x7fed3015b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.070+0000 7fed38600640 1 --2- 172.21.15.59:0/2929171813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed3009af80 0x7fed300c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.070+0000 7fed38600640 1 -- 172.21.15.59:0/2929171813 >> 172.21.15.59:0/2929171813 conn(0x7fed300b3f80 msgr2=0x7fed300ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.070+0000 7fed38600640 1 -- 172.21.15.59:0/2929171813 shutdown_connections 2024-05-30T17:02:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.070+0000 7fed38600640 1 -- 172.21.15.59:0/2929171813 wait complete. 2024-05-30T17:02:33.093 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T17:02:33.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1eb0e00640 1 Processor -- start 2024-05-30T17:02:33.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1eb0e00640 1 -- start start 2024-05-30T17:02:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1eb0e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1eac06d0d0 0x7f1eac06f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1eb0e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1eac0730e0 0x7f1eac06f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1eb0e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eac0b3d50 con 0x7f1eac161e20 2024-05-30T17:02:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1eb0e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1eac0b4030 con 0x7f1eac0730e0 2024-05-30T17:02:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1eb0e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1eac06e7c0 con 0x7f1eac06d0d0 2024-05-30T17:02:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1eaa800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1eac0730e0 0x7f1eac06f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1ea9e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1eac161e20 0x7f1eac06c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39084/0 (socket says 172.21.15.59:39084) 2024-05-30T17:02:33.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1ea9e00640 1 -- 172.21.15.59:0/1255991085 learned_addr learned my addr 172.21.15.59:0/1255991085 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:33.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1ea3e00640 1 --2- 172.21.15.59:0/1255991085 >> v2:172.21.15.107:3300/0 conn(0x7f1eac06d0d0 0x7f1eac06f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:33.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1eaa800640 1 -- 172.21.15.59:0/1255991085 >> v2:172.21.15.107:3300/0 conn(0x7f1eac06d0d0 msgr2=0x7f1eac06f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:33.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1eaa800640 1 --2- 172.21.15.59:0/1255991085 >> v2:172.21.15.107:3300/0 conn(0x7f1eac06d0d0 0x7f1eac06f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1eaa800640 1 -- 172.21.15.59:0/1255991085 >> v1:172.21.15.59:6789/0 conn(0x7f1eac161e20 legacy=0x7f1eac06c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1eaa800640 1 -- 172.21.15.59:0/1255991085 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eac06eaa0 con 0x7f1eac0730e0 2024-05-30T17:02:33.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.234+0000 7f1ea3e00640 1 --2- 172.21.15.59:0/1255991085 >> v2:172.21.15.107:3300/0 conn(0x7f1eac06d0d0 0x7f1eac06f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.238+0000 7f1eaa800640 1 --2- 172.21.15.59:0/1255991085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eac0730e0 0x7f1eac06f7e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0721a0 tx=0x7f1ea401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7a7152ed661122 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.238+0000 7f1ea9400640 1 -- 172.21.15.59:0/1255991085 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea40b4070 con 0x7f1eac0730e0 2024-05-30T17:02:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.238+0000 7f1ea9400640 1 -- 172.21.15.59:0/1255991085 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea40af600 con 0x7f1eac0730e0 2024-05-30T17:02:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.238+0000 7f1ea9400640 1 -- 172.21.15.59:0/1255991085 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea40af9d0 con 0x7f1eac0730e0 2024-05-30T17:02:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.238+0000 7f1eb0e00640 1 -- 172.21.15.59:0/1255991085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eac0730e0 msgr2=0x7f1eac06f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.238+0000 7f1eb0e00640 1 --2- 172.21.15.59:0/1255991085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eac0730e0 0x7f1eac06f7e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0721a0 tx=0x7f1ea401f110 comp rx=0 tx=0).stop 2024-05-30T17:02:33.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.238+0000 7f1eb0e00640 1 -- 172.21.15.59:0/1255991085 shutdown_connections 2024-05-30T17:02:33.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.238+0000 7f1eb0e00640 1 --2- 172.21.15.59:0/1255991085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eac0730e0 0x7f1eac06f7e0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.238+0000 7f1eb0e00640 1 --2- 172.21.15.59:0/1255991085 >> v2:172.21.15.107:3300/0 conn(0x7f1eac06d0d0 0x7f1eac06f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.238+0000 7f1eb0e00640 1 -- 172.21.15.59:0/1255991085 >> 172.21.15.59:0/1255991085 conn(0x7f1eac0725c0 msgr2=0x7f1eac0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:33.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.238+0000 7f1eb0e00640 1 -- 172.21.15.59:0/1255991085 shutdown_connections 2024-05-30T17:02:33.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.238+0000 7f1eb0e00640 1 -- 172.21.15.59:0/1255991085 wait complete. 2024-05-30T17:02:33.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1eb0e00640 1 Processor -- start 2024-05-30T17:02:33.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1eb0e00640 1 -- start start 2024-05-30T17:02:33.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1eb0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eac06d0d0 0x7f1eac15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:33.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1eb0e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eac0730e0 0x7f1eac15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:33.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1eb0e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1eac161e20 0x7f1eac1e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:33.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1eb0e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac0d0820 con 0x7f1eac06d0d0 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1eb0e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac0b3a20 con 0x7f1eac0730e0 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1eb0e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1eac0cd0d0 con 0x7f1eac161e20 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eac06d0d0 0x7f1eac15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eac06d0d0 0x7f1eac15cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51736/0 (socket says 172.21.15.59:51736) 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea9e00640 1 -- 172.21.15.59:0/2552710378 learned_addr learned my addr 172.21.15.59:0/2552710378 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea3e00640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eac0730e0 0x7f1eac15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1eaa800640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1eac161e20 0x7f1eac1e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea9e00640 1 -- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1eac161e20 msgr2=0x7f1eac1e8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea9e00640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1eac161e20 0x7f1eac1e8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea9e00640 1 -- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eac0730e0 msgr2=0x7f1eac15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea9e00640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eac0730e0 0x7f1eac15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea9e00640 1 -- 172.21.15.59:0/2552710378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eac0cd530 con 0x7f1eac06d0d0 2024-05-30T17:02:33.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea9e00640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eac06d0d0 0x7f1eac15cef0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00c370 tx=0x7f1e9c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:33.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea2000640 1 -- 172.21.15.59:0/2552710378 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c017070 con 0x7f1eac06d0d0 2024-05-30T17:02:33.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea2000640 1 -- 172.21.15.59:0/2552710378 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9c005cf0 con 0x7f1eac06d0d0 2024-05-30T17:02:33.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1ea2000640 1 -- 172.21.15.59:0/2552710378 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c0072f0 con 0x7f1eac06d0d0 2024-05-30T17:02:33.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1eb0e00640 1 -- 172.21.15.59:0/2552710378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eac0cd810 con 0x7f1eac06d0d0 2024-05-30T17:02:33.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.242+0000 7f1eb0e00640 1 -- 172.21.15.59:0/2552710378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eac0ce050 con 0x7f1eac06d0d0 2024-05-30T17:02:33.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.246+0000 7f1eb0e00640 1 -- 172.21.15.59:0/2552710378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eac15a680 con 0x7f1eac06d0d0 2024-05-30T17:02:33.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.246+0000 7f1ea2000640 1 -- 172.21.15.59:0/2552710378 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7f1e9c01a070 con 0x7f1eac06d0d0 2024-05-30T17:02:33.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.246+0000 7f1ea2000640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e88069a00 0x7f1e8806bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:33.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.246+0000 7f1ea2000640 1 -- 172.21.15.59:0/2552710378 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f1e9c084ae0 con 0x7f1eac06d0d0 2024-05-30T17:02:33.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.246+0000 7f1ea3e00640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e88069a00 0x7f1e8806bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:33.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.246+0000 7f1ea3e00640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e88069a00 0x7f1e8806bec0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1eac072e60 tx=0x7f1e94008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:33.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.250+0000 7f1ea2000640 1 -- 172.21.15.59:0/2552710378 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1eac0cd810 con 0x7f1eac06d0d0 2024-05-30T17:02:33.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.442+0000 7f1eb0e00640 1 -- 172.21.15.59:0/2552710378 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1eac0678a0 con 0x7f1e88069a00 2024-05-30T17:02:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.454+0000 7f1ea2000640 1 -- 172.21.15.59:0/2552710378 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1eac0678a0 con 0x7f1e88069a00 2024-05-30T17:02:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:33.460 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:02:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ss1" 2024-05-30T17:02:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:33.460 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:02:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.458+0000 7f1eb0e00640 1 -- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e88069a00 msgr2=0x7f1e8806bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.458+0000 7f1eb0e00640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e88069a00 0x7f1e8806bec0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1eac072e60 tx=0x7f1e94008040 comp rx=0 tx=0).stop 2024-05-30T17:02:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.458+0000 7f1eb0e00640 1 -- 172.21.15.59:0/2552710378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eac06d0d0 msgr2=0x7f1eac15cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.458+0000 7f1eb0e00640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eac06d0d0 0x7f1eac15cef0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00c370 tx=0x7f1e9c00c830 comp rx=0 tx=0).stop 2024-05-30T17:02:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.458+0000 7f1eb0e00640 1 -- 172.21.15.59:0/2552710378 shutdown_connections 2024-05-30T17:02:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.458+0000 7f1eb0e00640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e88069a00 0x7f1e8806bec0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.458+0000 7f1eb0e00640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1eac161e20 0x7f1eac1e8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.458+0000 7f1eb0e00640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eac0730e0 0x7f1eac15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.458+0000 7f1eb0e00640 1 --2- 172.21.15.59:0/2552710378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eac06d0d0 0x7f1eac15cef0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.458+0000 7f1eb0e00640 1 -- 172.21.15.59:0/2552710378 >> 172.21.15.59:0/2552710378 conn(0x7f1eac0725c0 msgr2=0x7f1eac1605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.458+0000 7f1eb0e00640 1 -- 172.21.15.59:0/2552710378 shutdown_connections 2024-05-30T17:02:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.458+0000 7f1eb0e00640 1 -- 172.21.15.59:0/2552710378 wait complete. 2024-05-30T17:02:33.481 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:02:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff374800640 1 Processor -- start 2024-05-30T17:02:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff374800640 1 -- start start 2024-05-30T17:02:33.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff374800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff36c0d0d70 0x7ff36c0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:33.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff374800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36c0ad920 con 0x7ff36c0ad2b0 2024-05-30T17:02:33.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff374800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36c15cd90 con 0x7ff36c1535f0 2024-05-30T17:02:33.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff374800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff36c0b4f70 con 0x7ff36c0d0d70 2024-05-30T17:02:33.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff372800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff36c0ad2b0 0x7ff36c0b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39100/0 (socket says 172.21.15.59:39100) 2024-05-30T17:02:33.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff372800640 1 -- 172.21.15.59:0/3821238772 learned_addr learned my addr 172.21.15.59:0/3821238772 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff371400640 1 --2- 172.21.15.59:0/3821238772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff36c0d0d70 0x7ff36c0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff370a00640 1 -- 172.21.15.59:0/3821238772 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352880069 0 0) 0x7ff36c0ad920 con 0x7ff36c0ad2b0 2024-05-30T17:02:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff370a00640 1 -- 172.21.15.59:0/3821238772 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff354003530 con 0x7ff36c0ad2b0 2024-05-30T17:02:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff370a00640 1 -- 172.21.15.59:0/3821238772 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443999149 0 0) 0x7ff36c15cd90 con 0x7ff36c1535f0 2024-05-30T17:02:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff370a00640 1 -- 172.21.15.59:0/3821238772 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff36c0ad920 con 0x7ff36c1535f0 2024-05-30T17:02:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff370a00640 1 -- 172.21.15.59:0/3821238772 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 779975833 0 0) 0x7ff354003530 con 0x7ff36c0ad2b0 2024-05-30T17:02:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff371400640 1 -- 172.21.15.59:0/3821238772 >> v1:172.21.15.107:6789/0 conn(0x7ff36c1535f0 legacy=0x7ff36c0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff371400640 1 -- 172.21.15.59:0/3821238772 >> v1:172.21.15.59:6789/0 conn(0x7ff36c0ad2b0 legacy=0x7ff36c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.626+0000 7ff371400640 1 -- 172.21.15.59:0/3821238772 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36c15d070 con 0x7ff36c0d0d70 2024-05-30T17:02:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.630+0000 7ff371400640 1 --2- 172.21.15.59:0/3821238772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff36c0d0d70 0x7ff36c0cfca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0097f0 tx=0x7ff35c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b91dddc94b2303d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.630+0000 7ff370a00640 1 -- 172.21.15.59:0/3821238772 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0b0070 con 0x7ff36c0d0d70 2024-05-30T17:02:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.630+0000 7ff370a00640 1 -- 172.21.15.59:0/3821238772 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35c0ab400 con 0x7ff36c0d0d70 2024-05-30T17:02:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.630+0000 7ff370a00640 1 -- 172.21.15.59:0/3821238772 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368001a00 con 0x7ff36c0d0d70 2024-05-30T17:02:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.630+0000 7ff374800640 1 -- 172.21.15.59:0/3821238772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff36c0d0d70 msgr2=0x7ff36c0cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.630+0000 7ff374800640 1 --2- 172.21.15.59:0/3821238772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff36c0d0d70 0x7ff36c0cfca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0097f0 tx=0x7ff35c01c400 comp rx=0 tx=0).stop 2024-05-30T17:02:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.630+0000 7ff374800640 1 -- 172.21.15.59:0/3821238772 shutdown_connections 2024-05-30T17:02:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.630+0000 7ff374800640 1 --2- 172.21.15.59:0/3821238772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff36c0d0d70 0x7ff36c0cfca0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.630+0000 7ff374800640 1 -- 172.21.15.59:0/3821238772 >> 172.21.15.59:0/3821238772 conn(0x7ff36c06bdb0 msgr2=0x7ff36c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.630+0000 7ff374800640 1 -- 172.21.15.59:0/3821238772 shutdown_connections 2024-05-30T17:02:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.630+0000 7ff374800640 1 -- 172.21.15.59:0/3821238772 wait complete. 2024-05-30T17:02:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff374800640 1 Processor -- start 2024-05-30T17:02:33.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff374800640 1 -- start start 2024-05-30T17:02:33.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff374800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff36c0ad2b0 0x7ff36c099b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:33.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff374800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36c0d0d70 0x7ff36c15e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:33.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff374800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff36c1535f0 0x7ff36c15de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff374800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c16a470 con 0x7ff36c0d0d70 2024-05-30T17:02:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff374800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c0ad700 con 0x7ff36c1535f0 2024-05-30T17:02:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff374800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff36c16a5f0 con 0x7ff36c0ad2b0 2024-05-30T17:02:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff371400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36c0d0d70 0x7ff36c15e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff371400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36c0d0d70 0x7ff36c15e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51742/0 (socket says 172.21.15.59:51742) 2024-05-30T17:02:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff371400640 1 -- 172.21.15.59:0/4129049715 learned_addr learned my addr 172.21.15.59:0/4129049715 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff371e00640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff36c0ad2b0 0x7ff36c099b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff372800640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff36c1535f0 0x7ff36c15de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff371400640 1 -- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff36c0ad2b0 msgr2=0x7ff36c099b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff371400640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff36c0ad2b0 0x7ff36c099b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff371400640 1 -- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff36c1535f0 msgr2=0x7ff36c15de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff371400640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff36c1535f0 0x7ff36c15de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff371400640 1 -- 172.21.15.59:0/4129049715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36c15f100 con 0x7ff36c0d0d70 2024-05-30T17:02:33.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff372800640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff36c1535f0 0x7ff36c15de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:33.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff371400640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36c0d0d70 0x7ff36c15e7b0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0ae040 tx=0x7ff35c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:33.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff366000640 1 -- 172.21.15.59:0/4129049715 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0b0040 con 0x7ff36c0d0d70 2024-05-30T17:02:33.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff366000640 1 -- 172.21.15.59:0/4129049715 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35c004030 con 0x7ff36c0d0d70 2024-05-30T17:02:33.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff366000640 1 -- 172.21.15.59:0/4129049715 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c004400 con 0x7ff36c0d0d70 2024-05-30T17:02:33.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff374800640 1 -- 172.21.15.59:0/4129049715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36c15ee20 con 0x7ff36c0d0d70 2024-05-30T17:02:33.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff374800640 1 -- 172.21.15.59:0/4129049715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff36c14c370 con 0x7ff36c0d0d70 2024-05-30T17:02:33.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.634+0000 7ff374800640 1 -- 172.21.15.59:0/4129049715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff36c068a90 con 0x7ff36c0d0d70 2024-05-30T17:02:33.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.638+0000 7ff366000640 1 -- 172.21.15.59:0/4129049715 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7ff35c003620 con 0x7ff36c0d0d70 2024-05-30T17:02:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.638+0000 7ff366000640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff350069a30 0x7ff35006bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.638+0000 7ff366000640 1 -- 172.21.15.59:0/4129049715 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7ff35c11f3b0 con 0x7ff36c0d0d70 2024-05-30T17:02:33.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.638+0000 7ff371e00640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff350069a30 0x7ff35006bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:33.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.638+0000 7ff371e00640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff350069a30 0x7ff35006bef0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff3600011f0 tx=0x7ff360009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.642+0000 7ff366000640 1 -- 172.21.15.59:0/4129049715 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff35c0b8020 con 0x7ff36c0d0d70 2024-05-30T17:02:33.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.838+0000 7ff374800640 1 -- 172.21.15.59:0/4129049715 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff36c073bb0 con 0x7ff350069a30 2024-05-30T17:02:33.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff366000640 1 -- 172.21.15.59:0/4129049715 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff36c073bb0 con 0x7ff350069a30 2024-05-30T17:02:33.869 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff374800640 1 -- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff350069a30 msgr2=0x7ff35006bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff374800640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff350069a30 0x7ff35006bef0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff3600011f0 tx=0x7ff360009040 comp rx=0 tx=0).stop 2024-05-30T17:02:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff374800640 1 -- 172.21.15.59:0/4129049715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36c0d0d70 msgr2=0x7ff36c15e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff374800640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36c0d0d70 0x7ff36c15e7b0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0ae040 tx=0x7ff35c0191a0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff374800640 1 -- 172.21.15.59:0/4129049715 shutdown_connections 2024-05-30T17:02:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff374800640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff350069a30 0x7ff35006bef0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff374800640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff36c1535f0 0x7ff36c15de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff374800640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36c0d0d70 0x7ff36c15e7b0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff374800640 1 --2- 172.21.15.59:0/4129049715 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff36c0ad2b0 0x7ff36c099b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff374800640 1 -- 172.21.15.59:0/4129049715 >> 172.21.15.59:0/4129049715 conn(0x7ff36c06bdb0 msgr2=0x7ff36c0b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff374800640 1 -- 172.21.15.59:0/4129049715 shutdown_connections 2024-05-30T17:02:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:33.866+0000 7ff374800640 1 -- 172.21.15.59:0/4129049715 wait complete. 2024-05-30T17:02:33.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T17:02:34.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.030+0000 7ff4c0600640 1 Processor -- start 2024-05-30T17:02:34.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.030+0000 7ff4c0600640 1 -- start start 2024-05-30T17:02:34.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.030+0000 7ff4c0600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4b80b44e0 0x7ff4b815efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:34.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.030+0000 7ff4c0600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff4b815f510 0x7ff4b815c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:34.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.030+0000 7ff4c0600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b80b52d0 con 0x7ff4b8159100 2024-05-30T17:02:34.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.030+0000 7ff4c0600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff4b80b4a30 con 0x7ff4b815f510 2024-05-30T17:02:34.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.030+0000 7ff4c0600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b80b4d10 con 0x7ff4b80b44e0 2024-05-30T17:02:34.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.034+0000 7ff4bdc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff4b8159100 0x7ff4b806e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39102/0 (socket says 172.21.15.59:39102) 2024-05-30T17:02:34.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.034+0000 7ff4bdc00640 1 -- 172.21.15.59:0/1112323449 learned_addr learned my addr 172.21.15.59:0/1112323449 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:34.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.034+0000 7ff4be600640 1 --2- 172.21.15.59:0/1112323449 >> v2:172.21.15.107:3300/0 conn(0x7ff4b815f510 0x7ff4b815c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:34.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.034+0000 7ff4bd200640 1 --2- 172.21.15.59:0/1112323449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4b80b44e0 0x7ff4b815efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:34.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.034+0000 7ff4b7e00640 1 -- 172.21.15.59:0/1112323449 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3391242176 0 0) 0x7ff4b80b52d0 con 0x7ff4b8159100 2024-05-30T17:02:34.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.034+0000 7ff4b7e00640 1 -- 172.21.15.59:0/1112323449 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4a0003530 con 0x7ff4b8159100 2024-05-30T17:02:34.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.034+0000 7ff4be600640 1 -- 172.21.15.59:0/1112323449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4b80b44e0 msgr2=0x7ff4b815efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:34.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.034+0000 7ff4be600640 1 --2- 172.21.15.59:0/1112323449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4b80b44e0 0x7ff4b815efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.034+0000 7ff4be600640 1 -- 172.21.15.59:0/1112323449 >> v1:172.21.15.59:6789/0 conn(0x7ff4b8159100 legacy=0x7ff4b806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.034+0000 7ff4be600640 1 -- 172.21.15.59:0/1112323449 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b80b4ff0 con 0x7ff4b815f510 2024-05-30T17:02:34.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.034+0000 7ff4be600640 1 --2- 172.21.15.59:0/1112323449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4b815f510 0x7ff4b815c010 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009d90 tx=0x7ff4b001c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef6f90624d25ebb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:34.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4b7e00640 1 -- 172.21.15.59:0/1112323449 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00b2070 con 0x7ff4b815f510 2024-05-30T17:02:34.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4b7e00640 1 -- 172.21.15.59:0/1112323449 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b00a57f0 con 0x7ff4b815f510 2024-05-30T17:02:34.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4b7e00640 1 -- 172.21.15.59:0/1112323449 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00a5bc0 con 0x7ff4b815f510 2024-05-30T17:02:34.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 -- 172.21.15.59:0/1112323449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4b815f510 msgr2=0x7ff4b815c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 --2- 172.21.15.59:0/1112323449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4b815f510 0x7ff4b815c010 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009d90 tx=0x7ff4b001c820 comp rx=0 tx=0).stop 2024-05-30T17:02:34.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 -- 172.21.15.59:0/1112323449 shutdown_connections 2024-05-30T17:02:34.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 --2- 172.21.15.59:0/1112323449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4b815f510 0x7ff4b815c010 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 --2- 172.21.15.59:0/1112323449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4b80b44e0 0x7ff4b815efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 -- 172.21.15.59:0/1112323449 >> 172.21.15.59:0/1112323449 conn(0x7ff4b806bdb0 msgr2=0x7ff4b806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:34.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 -- 172.21.15.59:0/1112323449 shutdown_connections 2024-05-30T17:02:34.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 -- 172.21.15.59:0/1112323449 wait complete. 2024-05-30T17:02:34.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 Processor -- start 2024-05-30T17:02:34.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 -- start start 2024-05-30T17:02:34.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4b80b44e0 0x7ff4b814e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:34.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4b8159100 0x7ff4b8150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4b815f510 0x7ff4b8150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b81684d0 con 0x7ff4b8159100 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b8168350 con 0x7ff4b815f510 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4c0600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b8168650 con 0x7ff4b80b44e0 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4bd200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4b8159100 0x7ff4b8150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4bd200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4b8159100 0x7ff4b8150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51756/0 (socket says 172.21.15.59:51756) 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4bd200640 1 -- 172.21.15.59:0/791712186 learned_addr learned my addr 172.21.15.59:0/791712186 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.038+0000 7ff4bdc00640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4b80b44e0 0x7ff4b814e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4be600640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4b815f510 0x7ff4b8150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4bd200640 1 -- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4b80b44e0 msgr2=0x7ff4b814e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4bd200640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4b80b44e0 0x7ff4b814e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4bd200640 1 -- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4b815f510 msgr2=0x7ff4b8150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4bd200640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4b815f510 0x7ff4b8150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4bd200640 1 -- 172.21.15.59:0/791712186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b8157b50 con 0x7ff4b8159100 2024-05-30T17:02:34.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4bd200640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4b8159100 0x7ff4b8150820 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400e960 tx=0x7ff4a400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:34.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4b5600640 1 -- 172.21.15.59:0/791712186 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4017070 con 0x7ff4b8159100 2024-05-30T17:02:34.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4b5600640 1 -- 172.21.15.59:0/791712186 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a400ca00 con 0x7ff4b8159100 2024-05-30T17:02:34.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4b5600640 1 -- 172.21.15.59:0/791712186 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400cdb0 con 0x7ff4b8159100 2024-05-30T17:02:34.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4c0600640 1 -- 172.21.15.59:0/791712186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b80b0b50 con 0x7ff4b8159100 2024-05-30T17:02:34.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4c0600640 1 -- 172.21.15.59:0/791712186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b8156730 con 0x7ff4b8159100 2024-05-30T17:02:34.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4c0600640 1 -- 172.21.15.59:0/791712186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b8068a90 con 0x7ff4b8159100 2024-05-30T17:02:34.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4b5600640 1 -- 172.21.15.59:0/791712186 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7ff4a401a070 con 0x7ff4b8159100 2024-05-30T17:02:34.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4b5600640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff498069a00 0x7ff49806bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:34.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.042+0000 7ff4b5600640 1 -- 172.21.15.59:0/791712186 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7ff4a4085830 con 0x7ff4b8159100 2024-05-30T17:02:34.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.046+0000 7ff4bdc00640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff498069a00 0x7ff49806bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:34.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.046+0000 7ff4bdc00640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff498069a00 0x7ff49806bec0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac005890 tx=0x7ff4ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:34.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.046+0000 7ff4b5600640 1 -- 172.21.15.59:0/791712186 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff4b8157b50 con 0x7ff4b8159100 2024-05-30T17:02:34.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.238+0000 7ff4c0600640 1 -- 172.21.15.59:0/791712186 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7ff4b80b3c70 con 0x7ff498069a00 2024-05-30T17:02:34.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4b5600640 1 -- 172.21.15.59:0/791712186 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff4b80b3c70 con 0x7ff498069a00 2024-05-30T17:02:34.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4c0600640 1 -- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff498069a00 msgr2=0x7ff49806bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4c0600640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff498069a00 0x7ff49806bec0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac005890 tx=0x7ff4ac009040 comp rx=0 tx=0).stop 2024-05-30T17:02:34.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4c0600640 1 -- 172.21.15.59:0/791712186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4b8159100 msgr2=0x7ff4b8150820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4c0600640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4b8159100 0x7ff4b8150820 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400e960 tx=0x7ff4a400ee20 comp rx=0 tx=0).stop 2024-05-30T17:02:34.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4c0600640 1 -- 172.21.15.59:0/791712186 shutdown_connections 2024-05-30T17:02:34.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4c0600640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff498069a00 0x7ff49806bec0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4c0600640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4b815f510 0x7ff4b8150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4c0600640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4b8159100 0x7ff4b8150820 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4c0600640 1 --2- 172.21.15.59:0/791712186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4b80b44e0 0x7ff4b814e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4c0600640 1 -- 172.21.15.59:0/791712186 >> 172.21.15.59:0/791712186 conn(0x7ff4b806bdb0 msgr2=0x7ff4b806f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:34.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4c0600640 1 -- 172.21.15.59:0/791712186 shutdown_connections 2024-05-30T17:02:34.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.258+0000 7ff4c0600640 1 -- 172.21.15.59:0/791712186 wait complete. 2024-05-30T17:02:34.266 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:34.267+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:34.266 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:34.267+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:34.266 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:34.267+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:34.266 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:34.267+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:34.266 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:34.267+0000 7efd70c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:34.283 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:34.283+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:34.284 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:34.283+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:34.284 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:34.283+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:34.284 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:34.283+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:34.284 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:34.283+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:34.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-05-30T17:02:34.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45dc200640 1 Processor -- start 2024-05-30T17:02:34.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45dc200640 1 -- start start 2024-05-30T17:02:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45dc200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45d40d1800 0x7f45d40cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45dc200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d40d2de0 con 0x7f45d40b3630 2024-05-30T17:02:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45dc200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d40b5bc0 con 0x7f45d4162080 2024-05-30T17:02:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45dc200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f45d40b5970 con 0x7f45d40d1800 2024-05-30T17:02:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45da200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f45d40b3630 0x7f45d40cf900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39106/0 (socket says 172.21.15.59:39106) 2024-05-30T17:02:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45da200640 1 -- 172.21.15.59:0/3163004463 learned_addr learned my addr 172.21.15.59:0/3163004463 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:34.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45d8e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45d40d1800 0x7f45d40cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:34.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45d3e00640 1 -- 172.21.15.59:0/3163004463 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1660484408 0 0) 0x7f45d40d2de0 con 0x7f45d40b3630 2024-05-30T17:02:34.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45d3e00640 1 -- 172.21.15.59:0/3163004463 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45bc003530 con 0x7f45d40b3630 2024-05-30T17:02:34.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45d8e00640 1 -- 172.21.15.59:0/3163004463 >> v1:172.21.15.107:6789/0 conn(0x7f45d4162080 legacy=0x7f45d40d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45d8e00640 1 -- 172.21.15.59:0/3163004463 >> v1:172.21.15.59:6789/0 conn(0x7f45d40b3630 legacy=0x7f45d40cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.434+0000 7f45d8e00640 1 -- 172.21.15.59:0/3163004463 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d40b5ea0 con 0x7f45d40d1800 2024-05-30T17:02:34.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.438+0000 7f45d8e00640 1 --2- 172.21.15.59:0/3163004463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d40d1800 0x7f45d40cf3c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f45c00097c0 tx=0x7f45c001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc9809e8d114fc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:34.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.438+0000 7f45d3e00640 1 -- 172.21.15.59:0/3163004463 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b1070 con 0x7f45d40d1800 2024-05-30T17:02:34.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.438+0000 7f45d3e00640 1 -- 172.21.15.59:0/3163004463 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c00ac410 con 0x7f45d40d1800 2024-05-30T17:02:34.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.438+0000 7f45d3e00640 1 -- 172.21.15.59:0/3163004463 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00ac7c0 con 0x7f45d40d1800 2024-05-30T17:02:34.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.438+0000 7f45dc200640 1 -- 172.21.15.59:0/3163004463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d40d1800 msgr2=0x7f45d40cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.438+0000 7f45dc200640 1 --2- 172.21.15.59:0/3163004463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d40d1800 0x7f45d40cf3c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f45c00097c0 tx=0x7f45c001c4a0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.438+0000 7f45dc200640 1 -- 172.21.15.59:0/3163004463 shutdown_connections 2024-05-30T17:02:34.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.438+0000 7f45dc200640 1 --2- 172.21.15.59:0/3163004463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d40d1800 0x7f45d40cf3c0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.438+0000 7f45dc200640 1 -- 172.21.15.59:0/3163004463 >> 172.21.15.59:0/3163004463 conn(0x7f45d408bfd0 msgr2=0x7f45d40d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:34.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.438+0000 7f45dc200640 1 -- 172.21.15.59:0/3163004463 shutdown_connections 2024-05-30T17:02:34.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.438+0000 7f45dc200640 1 -- 172.21.15.59:0/3163004463 wait complete. 2024-05-30T17:02:34.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45dc200640 1 Processor -- start 2024-05-30T17:02:34.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45dc200640 1 -- start start 2024-05-30T17:02:34.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45dc200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d40b3630 0x7f45d40b9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45dc200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45d40d1800 0x7f45d415e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45dc200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45d4162080 0x7f45d4156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45dc200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f45d41625e0 con 0x7f45d40b3630 2024-05-30T17:02:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45dc200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f45d4162460 con 0x7f45d4162080 2024-05-30T17:02:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45dc200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f45d416c850 con 0x7f45d40d1800 2024-05-30T17:02:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d40b3630 0x7f45d40b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d40b3630 0x7f45d40b9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51774/0 (socket says 172.21.15.59:51774) 2024-05-30T17:02:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d9800640 1 -- 172.21.15.59:0/2748259162 learned_addr learned my addr 172.21.15.59:0/2748259162 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d8e00640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45d40d1800 0x7f45d415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45da200640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45d4162080 0x7f45d4156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d9800640 1 -- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45d40d1800 msgr2=0x7f45d415e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d9800640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45d40d1800 0x7f45d415e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d9800640 1 -- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45d4162080 msgr2=0x7f45d4156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d9800640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45d4162080 0x7f45d4156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d9800640 1 -- 172.21.15.59:0/2748259162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d4157220 con 0x7f45d40b3630 2024-05-30T17:02:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45da200640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45d4162080 0x7f45d4156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d9800640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d40b3630 0x7f45d40b9620 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f45c800c500 tx=0x7f45c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d1600640 1 -- 172.21.15.59:0/2748259162 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8016020 con 0x7f45d40b3630 2024-05-30T17:02:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45dc200640 1 -- 172.21.15.59:0/2748259162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d40b9ce0 con 0x7f45d40b3630 2024-05-30T17:02:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45dc200640 1 -- 172.21.15.59:0/2748259162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d415c9e0 con 0x7f45d40b3630 2024-05-30T17:02:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d1600640 1 -- 172.21.15.59:0/2748259162 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c8005220 con 0x7f45d40b3630 2024-05-30T17:02:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.442+0000 7f45d1600640 1 -- 172.21.15.59:0/2748259162 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8021060 con 0x7f45d40b3630 2024-05-30T17:02:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.446+0000 7f45dc200640 1 -- 172.21.15.59:0/2748259162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b00052a0 con 0x7f45d40b3630 2024-05-30T17:02:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.446+0000 7f45d1600640 1 -- 172.21.15.59:0/2748259162 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7f45c8007030 con 0x7f45d40b3630 2024-05-30T17:02:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.446+0000 7f45d1600640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45b4069a00 0x7f45b406bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.446+0000 7f45d1600640 1 -- 172.21.15.59:0/2748259162 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5821+0+0 (secure 0 0 0) 0x7f45c8084b50 con 0x7f45d40b3630 2024-05-30T17:02:34.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.446+0000 7f45d8e00640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45b4069a00 0x7f45b406bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:34.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.450+0000 7f45d8e00640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45b4069a00 0x7f45b406bec0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f45c00ae000 tx=0x7f45c00a6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.454+0000 7f45d1600640 1 -- 172.21.15.59:0/2748259162 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f45c80564a0 con 0x7f45d40b3630 2024-05-30T17:02:34.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.650+0000 7f45dc200640 1 -- 172.21.15.59:0/2748259162 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f45b0000bd0 con 0x7f45b4069a00 2024-05-30T17:02:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.670+0000 7f45d1600640 1 -- 172.21.15.59:0/2748259162 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f45b0000bd0 con 0x7f45b4069a00 2024-05-30T17:02:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.674+0000 7f45dc200640 1 -- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45b4069a00 msgr2=0x7f45b406bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.674+0000 7f45dc200640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45b4069a00 0x7f45b406bec0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f45c00ae000 tx=0x7f45c00a6040 comp rx=0 tx=0).stop 2024-05-30T17:02:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.674+0000 7f45dc200640 1 -- 172.21.15.59:0/2748259162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d40b3630 msgr2=0x7f45d40b9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.674+0000 7f45dc200640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d40b3630 0x7f45d40b9620 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f45c800c500 tx=0x7f45c800c9c0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.674+0000 7f45dc200640 1 -- 172.21.15.59:0/2748259162 shutdown_connections 2024-05-30T17:02:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.674+0000 7f45dc200640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f45b4069a00 0x7f45b406bec0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.674+0000 7f45dc200640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45d4162080 0x7f45d4156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.674+0000 7f45dc200640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45d40d1800 0x7f45d415e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.674+0000 7f45dc200640 1 --2- 172.21.15.59:0/2748259162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d40b3630 0x7f45d40b9620 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.674+0000 7f45dc200640 1 -- 172.21.15.59:0/2748259162 >> 172.21.15.59:0/2748259162 conn(0x7f45d408bfd0 msgr2=0x7f45d406cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.674+0000 7f45dc200640 1 -- 172.21.15.59:0/2748259162 shutdown_connections 2024-05-30T17:02:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34.674+0000 7f45dc200640 1 -- 172.21.15.59:0/2748259162 wait complete. 2024-05-30T17:02:34.702 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T17:02:34.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T17:02:34.762 INFO:teuthology.orchestra.run.smithi059.stdout:2 2024-05-30T17:02:34.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T17:02:34.769 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T17:02:34.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T17:02:34.890 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T17:02:34.976 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T17:02:34.976 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T17:02:34.976 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:02:34.976 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:02:34.985 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:02:34.985 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:02:35.035 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T17:02:35.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.218+0000 7fe7b8e00640 1 Processor -- start 2024-05-30T17:02:35.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.218+0000 7fe7b8e00640 1 -- start start 2024-05-30T17:02:35.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.218+0000 7fe7b8e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe7b4070710 0x7fe7b409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:35.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.218+0000 7fe7b8e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b40cde00 con 0x7fe7b415ff30 2024-05-30T17:02:35.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.218+0000 7fe7b8e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b4070bd0 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.218+0000 7fe7b8e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe7b4070e70 con 0x7fe7b4070710 2024-05-30T17:02:35.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.222+0000 7fe7b1e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe7b415ff30 0x7fe7b4070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39122/0 (socket says 172.21.15.59:39122) 2024-05-30T17:02:35.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.222+0000 7fe7b1e00640 1 -- 172.21.15.59:0/2139956389 learned_addr learned my addr 172.21.15.59:0/2139956389 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:35.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.222+0000 7fe7a9400640 1 --2- 172.21.15.59:0/2139956389 >> v2:172.21.15.59:3300/0 conn(0x7fe7b4070710 0x7fe7b409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:35.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.222+0000 7fe7a9400640 1 -- 172.21.15.59:0/2139956389 >> v1:172.21.15.107:6789/0 conn(0x7fe7b40b1ac0 legacy=0x7fe7b409af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:35.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.222+0000 7fe7b1400640 1 -- 172.21.15.59:0/2139956389 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9633577 0 0) 0x7fe7b40cde00 con 0x7fe7b415ff30 2024-05-30T17:02:35.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.222+0000 7fe7a9400640 1 -- 172.21.15.59:0/2139956389 >> v1:172.21.15.59:6789/0 conn(0x7fe7b415ff30 legacy=0x7fe7b4070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:35.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.222+0000 7fe7a9400640 1 -- 172.21.15.59:0/2139956389 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b4072020 con 0x7fe7b4070710 2024-05-30T17:02:35.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.222+0000 7fe7a9400640 1 --2- 172.21.15.59:0/2139956389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b4070710 0x7fe7b409aa40 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0097c0 tx=0x7fe79c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e107f6e71fa94cbc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:35.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.222+0000 7fe7b1400640 1 -- 172.21.15.59:0/2139956389 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0b0070 con 0x7fe7b4070710 2024-05-30T17:02:35.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.222+0000 7fe7b1400640 1 -- 172.21.15.59:0/2139956389 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79c0ab600 con 0x7fe7b4070710 2024-05-30T17:02:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.222+0000 7fe7b1400640 1 -- 172.21.15.59:0/2139956389 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0ab9d0 con 0x7fe7b4070710 2024-05-30T17:02:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2139956389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b4070710 msgr2=0x7fe7b409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 --2- 172.21.15.59:0/2139956389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b4070710 0x7fe7b409aa40 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0097c0 tx=0x7fe79c01c410 comp rx=0 tx=0).stop 2024-05-30T17:02:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2139956389 shutdown_connections 2024-05-30T17:02:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 --2- 172.21.15.59:0/2139956389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b4070710 0x7fe7b409aa40 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2139956389 >> 172.21.15.59:0/2139956389 conn(0x7fe7b40b3f70 msgr2=0x7fe7b40b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:35.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2139956389 shutdown_connections 2024-05-30T17:02:35.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2139956389 wait complete. 2024-05-30T17:02:35.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 Processor -- start 2024-05-30T17:02:35.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 -- start start 2024-05-30T17:02:35.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7b4070710 0x7fe7b414ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:35.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b40b1ac0 0x7fe7b4167dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:35.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7b415ff30 0x7fe7b40b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:35.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b416ad00 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b409bcf0 con 0x7fe7b4070710 2024-05-30T17:02:35.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b8e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b416ae80 con 0x7fe7b415ff30 2024-05-30T17:02:35.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7a9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b40b1ac0 0x7fe7b4167dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:35.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7a9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b40b1ac0 0x7fe7b4167dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51804/0 (socket says 172.21.15.59:51804) 2024-05-30T17:02:35.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7a9400640 1 -- 172.21.15.59:0/2754049467 learned_addr learned my addr 172.21.15.59:0/2754049467 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b1e00640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7b4070710 0x7fe7b414ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b2800640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7b415ff30 0x7fe7b40b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7a9400640 1 -- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7b415ff30 msgr2=0x7fe7b40b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7a9400640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7b415ff30 0x7fe7b40b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7a9400640 1 -- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7b4070710 msgr2=0x7fe7b414ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7a9400640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7b4070710 0x7fe7b414ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7a9400640 1 -- 172.21.15.59:0/2754049467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b40af2d0 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.226+0000 7fe7b1e00640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7b4070710 0x7fe7b414ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.230+0000 7fe7a9400640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b40b1ac0 0x7fe7b4167dc0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fe79c019020 tx=0x7fe79c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.230+0000 7fe7aaa00640 1 -- 172.21.15.59:0/2754049467 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0b8020 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.230+0000 7fe7aaa00640 1 -- 172.21.15.59:0/2754049467 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79c0b4610 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.230+0000 7fe7aaa00640 1 -- 172.21.15.59:0/2754049467 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0b0040 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.230+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2754049467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b40af5b0 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.230+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2754049467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b40afb70 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.230+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2754049467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7b4068a90 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.230+0000 7fe7aaa00640 1 -- 172.21.15.59:0/2754049467 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7fe79c0bb020 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.230+0000 7fe7aaa00640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe790069a00 0x7fe79006bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:35.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.230+0000 7fe7aaa00640 1 -- 172.21.15.59:0/2754049467 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5877+0+0 (secure 0 0 0) 0x7fe79c11f420 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.234+0000 7fe7b1e00640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe790069a00 0x7fe79006bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:35.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.234+0000 7fe7b1e00640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe790069a00 0x7fe79006bec0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4000f70 tx=0x7fe7a4007c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.238+0000 7fe7aaa00640 1 -- 172.21.15.59:0/2754049467 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe79c0c2030 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.410+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2754049467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe7b409b470 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7aaa00640 1 -- 172.21.15.59:0/2754049467 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v105) ==== 80+0+0 (secure 0 0 0) 0x7fe79c016090 con 0x7fe7b40b1ac0 2024-05-30T17:02:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T17:02:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe790069a00 msgr2=0x7fe79006bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7b8e00640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe790069a00 0x7fe79006bec0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4000f70 tx=0x7fe7a4007c60 comp rx=0 tx=0).stop 2024-05-30T17:02:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2754049467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b40b1ac0 msgr2=0x7fe7b4167dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7b8e00640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b40b1ac0 0x7fe7b4167dc0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fe79c019020 tx=0x7fe79c0191b0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2754049467 shutdown_connections 2024-05-30T17:02:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7b8e00640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe790069a00 0x7fe79006bec0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7b8e00640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7b415ff30 0x7fe7b40b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7b8e00640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b40b1ac0 0x7fe7b4167dc0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7b8e00640 1 --2- 172.21.15.59:0/2754049467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7b4070710 0x7fe7b414ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2754049467 >> 172.21.15.59:0/2754049467 conn(0x7fe7b40b3f70 msgr2=0x7fe7b40b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2754049467 shutdown_connections 2024-05-30T17:02:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.414+0000 7fe7b8e00640 1 -- 172.21.15.59:0/2754049467 wait complete. 2024-05-30T17:02:35.438 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2024-05-30T17:02:35.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:35.438 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-30T17:02:35.456 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[47983]: fuse finished with error 0 and tester_r 0 2024-05-30T17:02:35.459 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T17:02:35.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:35.459 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T17:02:35.552 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:02:35.570 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:02:35.632 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T17:02:35.632 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:02:35.632 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:02:35.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:02:35.641 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T17:02:35.641 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:02:35.641 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:02:35.683 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T17:02:35.683 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T17:02:35.684 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:02:35.684 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:02:35.693 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:02:35.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:02:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.866+0000 7f0c4b000640 1 Processor -- start 2024-05-30T17:02:35.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.866+0000 7f0c4b000640 1 -- start start 2024-05-30T17:02:35.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c4b000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c440af720 0x7f0c4415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:35.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c4b000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0c440d0560 0x7f0c440d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:35.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c4b000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c4415f060 con 0x7f0c4406e900 2024-05-30T17:02:35.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c4b000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0c440afb00 con 0x7f0c440af720 2024-05-30T17:02:35.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c4b000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0c4415c270 con 0x7f0c440d0560 2024-05-30T17:02:35.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c43e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c440af720 0x7f0c4415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:35.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c43e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c440af720 0x7f0c4415b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51806/0 (socket says 172.21.15.59:51806) 2024-05-30T17:02:35.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c43e00640 1 -- 172.21.15.59:0/1684067209 learned_addr learned my addr 172.21.15.59:0/1684067209 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:35.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c49000640 1 --2- 172.21.15.59:0/1684067209 >> v2:172.21.15.107:3300/0 conn(0x7f0c440d0560 0x7f0c440d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:35.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c43e00640 1 -- 172.21.15.59:0/1684067209 >> v2:172.21.15.107:3300/0 conn(0x7f0c440d0560 msgr2=0x7f0c440d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:35.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c43e00640 1 --2- 172.21.15.59:0/1684067209 >> v2:172.21.15.107:3300/0 conn(0x7f0c440d0560 0x7f0c440d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c43e00640 1 -- 172.21.15.59:0/1684067209 >> v1:172.21.15.107:6789/0 conn(0x7f0c4406e900 legacy=0x7f0c4415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:35.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c43e00640 1 -- 172.21.15.59:0/1684067209 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4415ff00 con 0x7f0c440af720 2024-05-30T17:02:35.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c43e00640 1 --2- 172.21.15.59:0/1684067209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c440af720 0x7f0c4415b9d0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f0c4415ef00 tx=0x7f0c2c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a581452cfdc6bcf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:35.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.870+0000 7f0c43400640 1 -- 172.21.15.59:0/1684067209 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0ab610 con 0x7f0c440af720 2024-05-30T17:02:35.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c43400640 1 -- 172.21.15.59:0/1684067209 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c0b0070 con 0x7f0c440af720 2024-05-30T17:02:35.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c43400640 1 -- 172.21.15.59:0/1684067209 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0ab9d0 con 0x7f0c440af720 2024-05-30T17:02:35.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 -- 172.21.15.59:0/1684067209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c440af720 msgr2=0x7f0c4415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:35.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 --2- 172.21.15.59:0/1684067209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c440af720 0x7f0c4415b9d0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f0c4415ef00 tx=0x7f0c2c01c520 comp rx=0 tx=0).stop 2024-05-30T17:02:35.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 -- 172.21.15.59:0/1684067209 shutdown_connections 2024-05-30T17:02:35.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 --2- 172.21.15.59:0/1684067209 >> v2:172.21.15.107:3300/0 conn(0x7f0c440d0560 0x7f0c440d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 --2- 172.21.15.59:0/1684067209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c440af720 0x7f0c4415b9d0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 -- 172.21.15.59:0/1684067209 >> 172.21.15.59:0/1684067209 conn(0x7f0c440b22d0 msgr2=0x7f0c440b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:35.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 -- 172.21.15.59:0/1684067209 shutdown_connections 2024-05-30T17:02:35.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 -- 172.21.15.59:0/1684067209 wait complete. 2024-05-30T17:02:35.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 Processor -- start 2024-05-30T17:02:35.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 -- start start 2024-05-30T17:02:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c4406e900 0x7f0c441faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c440af720 0x7f0c4409da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c440d0560 0x7f0c4409bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0c44073150 con 0x7f0c440d0560 2024-05-30T17:02:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4415c830 con 0x7f0c440af720 2024-05-30T17:02:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c4b000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0c440732d0 con 0x7f0c4406e900 2024-05-30T17:02:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c49000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c440d0560 0x7f0c4409bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c49000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c440d0560 0x7f0c4409bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51814/0 (socket says 172.21.15.59:51814) 2024-05-30T17:02:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c49000640 1 -- 172.21.15.59:0/3742799470 learned_addr learned my addr 172.21.15.59:0/3742799470 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c43e00640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c4406e900 0x7f0c441faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.874+0000 7f0c3b400640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c440af720 0x7f0c4409da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c49000640 1 -- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c4406e900 msgr2=0x7f0c441faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c49000640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c4406e900 0x7f0c441faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c49000640 1 -- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c440af720 msgr2=0x7f0c4409da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c49000640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c440af720 0x7f0c4409da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c49000640 1 -- 172.21.15.59:0/3742799470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c44158ad0 con 0x7f0c440d0560 2024-05-30T17:02:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c49000640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c440d0560 0x7f0c4409bb50 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00efc0 tx=0x7f0c3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c40c00640 1 -- 172.21.15.59:0/3742799470 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c018020 con 0x7f0c440d0560 2024-05-30T17:02:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c40c00640 1 -- 172.21.15.59:0/3742799470 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c014480 con 0x7f0c440d0560 2024-05-30T17:02:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c4b000640 1 -- 172.21.15.59:0/3742799470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c44158db0 con 0x7f0c440d0560 2024-05-30T17:02:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c40c00640 1 -- 172.21.15.59:0/3742799470 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c014870 con 0x7f0c440d0560 2024-05-30T17:02:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c4b000640 1 -- 172.21.15.59:0/3742799470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c44159370 con 0x7f0c440d0560 2024-05-30T17:02:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c4b000640 1 -- 172.21.15.59:0/3742799470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c44068a90 con 0x7f0c440d0560 2024-05-30T17:02:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.878+0000 7f0c40c00640 1 -- 172.21.15.59:0/3742799470 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7f0c3c01b020 con 0x7f0c440d0560 2024-05-30T17:02:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.882+0000 7f0c40c00640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c20069a00 0x7f0c2006bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.882+0000 7f0c40c00640 1 -- 172.21.15.59:0/3742799470 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5877+0+0 (secure 0 0 0) 0x7f0c3c0861f0 con 0x7f0c440d0560 2024-05-30T17:02:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.882+0000 7f0c43e00640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c20069a00 0x7f0c2006bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.882+0000 7f0c43e00640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c20069a00 0x7f0c2006bec0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0af000 tx=0x7f0c2c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:35.886+0000 7f0c40c00640 1 -- 172.21.15.59:0/3742799470 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0c3c022070 con 0x7f0c440d0560 2024-05-30T17:02:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.082+0000 7f0c4b000640 1 -- 172.21.15.59:0/3742799470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c44073a00 con 0x7f0c440d0560 2024-05-30T17:02:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.082+0000 7f0c40c00640 1 -- 172.21.15.59:0/3742799470 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5189 (secure 0 0 0) 0x7f0c3c010040 con 0x7f0c440d0560 2024-05-30T17:02:36.087 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:36.087 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2410188205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2410188205},{"type":"v1","addr":"172.21.15.107:6836","nonce":2410188205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7342,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1749998079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1749998079},{"type":"v1","addr":"172.21.15.59:6834","nonce":1749998079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3865215628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3865215628},{"type":"v1","addr":"172.21.15.107:6837","nonce":3865215628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:01:18.507070+0000","modified":"2024-05-30T17:01:21.519897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/1525464146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1525464146},{"type":"v1","addr":"172.21.15.59:6835","nonce":1525464146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7986,"qdb_cluster":[7986]},"id":7}]} 2024-05-30T17:02:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 62 2024-05-30T17:02:36.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.086+0000 7f0c4b000640 1 -- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c20069a00 msgr2=0x7f0c2006bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.086+0000 7f0c4b000640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c20069a00 0x7f0c2006bec0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0af000 tx=0x7f0c2c0a7000 comp rx=0 tx=0).stop 2024-05-30T17:02:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.086+0000 7f0c4b000640 1 -- 172.21.15.59:0/3742799470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c440d0560 msgr2=0x7f0c4409bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.086+0000 7f0c4b000640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c440d0560 0x7f0c4409bb50 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00efc0 tx=0x7f0c3c00c490 comp rx=0 tx=0).stop 2024-05-30T17:02:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.086+0000 7f0c4b000640 1 -- 172.21.15.59:0/3742799470 shutdown_connections 2024-05-30T17:02:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.086+0000 7f0c4b000640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0c20069a00 0x7f0c2006bec0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.086+0000 7f0c4b000640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c440d0560 0x7f0c4409bb50 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.086+0000 7f0c4b000640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c440af720 0x7f0c4409da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.086+0000 7f0c4b000640 1 --2- 172.21.15.59:0/3742799470 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c4406e900 0x7f0c441faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.086+0000 7f0c4b000640 1 -- 172.21.15.59:0/3742799470 >> 172.21.15.59:0/3742799470 conn(0x7f0c440b22d0 msgr2=0x7f0c440afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.086+0000 7f0c4b000640 1 -- 172.21.15.59:0/3742799470 shutdown_connections 2024-05-30T17:02:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.086+0000 7f0c4b000640 1 -- 172.21.15.59:0/3742799470 wait complete. 2024-05-30T17:02:36.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:02:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.246+0000 7f0e2c800640 1 Processor -- start 2024-05-30T17:02:36.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.246+0000 7f0e2c800640 1 -- start start 2024-05-30T17:02:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.246+0000 7f0e2c800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e240ad8c0 0x7f0e2415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.246+0000 7f0e2c800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e2415d730 con 0x7f0e24159df0 2024-05-30T17:02:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.246+0000 7f0e2c800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e240b3370 con 0x7f0e2415a1d0 2024-05-30T17:02:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.246+0000 7f0e2c800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0e240b3650 con 0x7f0e240ad8c0 2024-05-30T17:02:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.246+0000 7f0e29400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e240ad8c0 0x7f0e2415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.246+0000 7f0e29e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0e24159df0 0x7f0e240ad1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39128/0 (socket says 172.21.15.59:39128) 2024-05-30T17:02:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.246+0000 7f0e29400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e240ad8c0 0x7f0e2415ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51826/0 (socket says 172.21.15.59:51826) 2024-05-30T17:02:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.246+0000 7f0e29e00640 1 -- 172.21.15.59:0/1931819963 learned_addr learned my addr 172.21.15.59:0/1931819963 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e29400640 1 -- 172.21.15.59:0/1931819963 >> v1:172.21.15.107:6789/0 conn(0x7f0e2415a1d0 legacy=0x7f0e2415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e29400640 1 -- 172.21.15.59:0/1931819963 >> v1:172.21.15.59:6789/0 conn(0x7f0e24159df0 legacy=0x7f0e240ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e28a00640 1 -- 172.21.15.59:0/1931819963 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3688854526 0 0) 0x7f0e2415d730 con 0x7f0e24159df0 2024-05-30T17:02:36.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e29400640 1 -- 172.21.15.59:0/1931819963 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e240b3930 con 0x7f0e240ad8c0 2024-05-30T17:02:36.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e29400640 1 --2- 172.21.15.59:0/1931819963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e240ad8c0 0x7f0e2415ca70 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f0e140097c0 tx=0x7f0e1401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d2aa03efe6f44f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:36.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e28a00640 1 -- 172.21.15.59:0/1931819963 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e140b0070 con 0x7f0e240ad8c0 2024-05-30T17:02:36.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e28a00640 1 -- 172.21.15.59:0/1931819963 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e140ab600 con 0x7f0e240ad8c0 2024-05-30T17:02:36.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e28a00640 1 -- 172.21.15.59:0/1931819963 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e140ab9d0 con 0x7f0e240ad8c0 2024-05-30T17:02:36.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e2c800640 1 -- 172.21.15.59:0/1931819963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e240ad8c0 msgr2=0x7f0e2415ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e2c800640 1 --2- 172.21.15.59:0/1931819963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e240ad8c0 0x7f0e2415ca70 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f0e140097c0 tx=0x7f0e1401c4a0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e2c800640 1 -- 172.21.15.59:0/1931819963 shutdown_connections 2024-05-30T17:02:36.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e2c800640 1 --2- 172.21.15.59:0/1931819963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e240ad8c0 0x7f0e2415ca70 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.250+0000 7f0e2c800640 1 -- 172.21.15.59:0/1931819963 >> 172.21.15.59:0/1931819963 conn(0x7f0e240b22d0 msgr2=0x7f0e240b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:36.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e2c800640 1 -- 172.21.15.59:0/1931819963 shutdown_connections 2024-05-30T17:02:36.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e2c800640 1 -- 172.21.15.59:0/1931819963 wait complete. 2024-05-30T17:02:36.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e2c800640 1 Processor -- start 2024-05-30T17:02:36.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e2c800640 1 -- start start 2024-05-30T17:02:36.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e2c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e240ad8c0 0x7f0e24099300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e2c800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e24159df0 0x7f0e2415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e2c800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2415a1d0 0x7f0e24166f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e2c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2416a7a0 con 0x7f0e240ad8c0 2024-05-30T17:02:36.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e2c800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2416a620 con 0x7f0e24159df0 2024-05-30T17:02:36.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e2c800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0e2416a920 con 0x7f0e2415a1d0 2024-05-30T17:02:36.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e29e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e240ad8c0 0x7f0e24099300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e29e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e240ad8c0 0x7f0e24099300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51838/0 (socket says 172.21.15.59:51838) 2024-05-30T17:02:36.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e29e00640 1 -- 172.21.15.59:0/2215731184 learned_addr learned my addr 172.21.15.59:0/2215731184 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:36.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e29400640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e24159df0 0x7f0e2415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e2a800640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2415a1d0 0x7f0e24166f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e29e00640 1 -- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2415a1d0 msgr2=0x7f0e24166f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e29e00640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2415a1d0 0x7f0e24166f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e29e00640 1 -- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e24159df0 msgr2=0x7f0e2415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e29e00640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e24159df0 0x7f0e2415eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e29e00640 1 -- 172.21.15.59:0/2215731184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e24071f40 con 0x7f0e240ad8c0 2024-05-30T17:02:36.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e29e00640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e240ad8c0 0x7f0e24099300 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800c4a0 tx=0x7f0e1800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:36.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.254+0000 7f0e1e000640 1 -- 172.21.15.59:0/2215731184 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18018070 con 0x7f0e240ad8c0 2024-05-30T17:02:36.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.258+0000 7f0e1e000640 1 -- 172.21.15.59:0/2215731184 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e180074e0 con 0x7f0e240ad8c0 2024-05-30T17:02:36.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.258+0000 7f0e1e000640 1 -- 172.21.15.59:0/2215731184 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18004a30 con 0x7f0e240ad8c0 2024-05-30T17:02:36.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.258+0000 7f0e2c800640 1 -- 172.21.15.59:0/2215731184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e24072220 con 0x7f0e240ad8c0 2024-05-30T17:02:36.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.258+0000 7f0e2c800640 1 -- 172.21.15.59:0/2215731184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e24072500 con 0x7f0e240ad8c0 2024-05-30T17:02:36.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.258+0000 7f0e2c800640 1 -- 172.21.15.59:0/2215731184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e24068a90 con 0x7f0e240ad8c0 2024-05-30T17:02:36.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.258+0000 7f0e1e000640 1 -- 172.21.15.59:0/2215731184 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 33) ==== 90027+0+0 (secure 0 0 0) 0x7f0e1801b070 con 0x7f0e240ad8c0 2024-05-30T17:02:36.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.258+0000 7f0e1e000640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0e08069a00 0x7f0e0806bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.258+0000 7f0e1e000640 1 -- 172.21.15.59:0/2215731184 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5877+0+0 (secure 0 0 0) 0x7f0e180849b0 con 0x7f0e240ad8c0 2024-05-30T17:02:36.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.258+0000 7f0e29400640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0e08069a00 0x7f0e0806bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.258+0000 7f0e29400640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0e08069a00 0x7f0e0806bec0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0e140ad000 tx=0x7f0e140a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:36.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.262+0000 7f0e1e000640 1 -- 172.21.15.59:0/2215731184 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e18056380 con 0x7f0e240ad8c0 2024-05-30T17:02:36.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.278+0000 7f0e1e000640 1 -- 172.21.15.59:0/2215731184 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f0e1808e020 con 0x7f0e240ad8c0 2024-05-30T17:02:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.462+0000 7f0e2c800640 1 -- 172.21.15.59:0/2215731184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e24166d00 con 0x7f0e240ad8c0 2024-05-30T17:02:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e1e000640 1 -- 172.21.15.59:0/2215731184 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5189 (secure 0 0 0) 0x7f0e18056a80 con 0x7f0e240ad8c0 2024-05-30T17:02:36.468 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:36.468 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2410188205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2410188205},{"type":"v1","addr":"172.21.15.107:6836","nonce":2410188205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7342,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1749998079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1749998079},{"type":"v1","addr":"172.21.15.59:6834","nonce":1749998079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3865215628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3865215628},{"type":"v1","addr":"172.21.15.107:6837","nonce":3865215628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:01:18.507070+0000","modified":"2024-05-30T17:01:21.519897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/1525464146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1525464146},{"type":"v1","addr":"172.21.15.59:6835","nonce":1525464146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7986,"qdb_cluster":[7986]},"id":7}]} 2024-05-30T17:02:36.468 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 62 2024-05-30T17:02:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e2c800640 1 -- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0e08069a00 msgr2=0x7f0e0806bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e2c800640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0e08069a00 0x7f0e0806bec0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0e140ad000 tx=0x7f0e140a6000 comp rx=0 tx=0).stop 2024-05-30T17:02:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e2c800640 1 -- 172.21.15.59:0/2215731184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e240ad8c0 msgr2=0x7f0e24099300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e2c800640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e240ad8c0 0x7f0e24099300 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800c4a0 tx=0x7f0e1800c960 comp rx=0 tx=0).stop 2024-05-30T17:02:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e2c800640 1 -- 172.21.15.59:0/2215731184 shutdown_connections 2024-05-30T17:02:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e2c800640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0e08069a00 0x7f0e0806bec0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e2c800640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2415a1d0 0x7f0e24166f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e2c800640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e24159df0 0x7f0e2415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e2c800640 1 --2- 172.21.15.59:0/2215731184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e240ad8c0 0x7f0e24099300 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e2c800640 1 -- 172.21.15.59:0/2215731184 >> 172.21.15.59:0/2215731184 conn(0x7f0e240b22d0 msgr2=0x7f0e2415b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e2c800640 1 -- 172.21.15.59:0/2215731184 shutdown_connections 2024-05-30T17:02:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.466+0000 7f0e2c800640 1 -- 172.21.15.59:0/2215731184 wait complete. 2024-05-30T17:02:36.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:02:36.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.626+0000 7fca53200640 1 Processor -- start 2024-05-30T17:02:36.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca53200640 1 -- start start 2024-05-30T17:02:36.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca53200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fca5415d600 0x7fca54160a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca53200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca5415cb60 con 0x7fca5415a0e0 2024-05-30T17:02:36.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca53200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca54067ab0 con 0x7fca540cef10 2024-05-30T17:02:36.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca53200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fca54160f60 con 0x7fca5415d600 2024-05-30T17:02:36.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca51e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fca5415a0e0 0x7fca540ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39136/0 (socket says 172.21.15.59:39136) 2024-05-30T17:02:36.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca51e00640 1 -- 172.21.15.59:0/3211219588 learned_addr learned my addr 172.21.15.59:0/3211219588 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:36.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca52800640 1 --2- 172.21.15.59:0/3211219588 >> v2:172.21.15.107:3300/0 conn(0x7fca5415d600 0x7fca54160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca51400640 1 -- 172.21.15.59:0/3211219588 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707710783 0 0) 0x7fca5415cb60 con 0x7fca5415a0e0 2024-05-30T17:02:36.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca51400640 1 -- 172.21.15.59:0/3211219588 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca38003530 con 0x7fca5415a0e0 2024-05-30T17:02:36.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca52800640 1 -- 172.21.15.59:0/3211219588 >> v1:172.21.15.107:6789/0 conn(0x7fca540cef10 legacy=0x7fca5406e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca52800640 1 -- 172.21.15.59:0/3211219588 >> v1:172.21.15.59:6789/0 conn(0x7fca5415a0e0 legacy=0x7fca540ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca51400640 1 -- 172.21.15.59:0/3211219588 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3130578924 0 0) 0x7fca38003530 con 0x7fca5415a0e0 2024-05-30T17:02:36.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.630+0000 7fca52800640 1 -- 172.21.15.59:0/3211219588 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5415ce00 con 0x7fca5415d600 2024-05-30T17:02:36.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.634+0000 7fca52800640 1 --2- 172.21.15.59:0/3211219588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca5415d600 0x7fca54160a20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009d90 tx=0x7fca4c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f901195d8c1b06 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:36.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.634+0000 7fca51400640 1 -- 172.21.15.59:0/3211219588 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c0b2070 con 0x7fca5415d600 2024-05-30T17:02:36.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.634+0000 7fca51400640 1 -- 172.21.15.59:0/3211219588 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4c0a55e0 con 0x7fca5415d600 2024-05-30T17:02:36.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.634+0000 7fca51400640 1 -- 172.21.15.59:0/3211219588 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca440016a0 con 0x7fca5415d600 2024-05-30T17:02:36.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.634+0000 7fca53200640 1 -- 172.21.15.59:0/3211219588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca5415d600 msgr2=0x7fca54160a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.634+0000 7fca53200640 1 --2- 172.21.15.59:0/3211219588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca5415d600 0x7fca54160a20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009d90 tx=0x7fca4c01c890 comp rx=0 tx=0).stop 2024-05-30T17:02:36.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.634+0000 7fca53200640 1 -- 172.21.15.59:0/3211219588 shutdown_connections 2024-05-30T17:02:36.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.634+0000 7fca53200640 1 --2- 172.21.15.59:0/3211219588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca5415d600 0x7fca54160a20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.634+0000 7fca53200640 1 -- 172.21.15.59:0/3211219588 >> 172.21.15.59:0/3211219588 conn(0x7fca540733a0 msgr2=0x7fca5406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:36.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.634+0000 7fca53200640 1 -- 172.21.15.59:0/3211219588 shutdown_connections 2024-05-30T17:02:36.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.634+0000 7fca53200640 1 -- 172.21.15.59:0/3211219588 wait complete. 2024-05-30T17:02:36.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.634+0000 7fca53200640 1 Processor -- start 2024-05-30T17:02:36.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca53200640 1 -- start start 2024-05-30T17:02:36.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca53200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca540cef10 0x7fca540ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca53200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca5415a0e0 0x7fca541451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca53200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca5415d600 0x7fca5415ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca53200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fca540b04e0 con 0x7fca540cef10 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca53200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fca540b0360 con 0x7fca5415d600 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca53200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fca5416a3f0 con 0x7fca5415a0e0 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca51e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca540cef10 0x7fca540ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca51e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca540cef10 0x7fca540ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51846/0 (socket says 172.21.15.59:51846) 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca51e00640 1 -- 172.21.15.59:0/1972530761 learned_addr learned my addr 172.21.15.59:0/1972530761 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca4be00640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca5415a0e0 0x7fca541451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca52800640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca5415d600 0x7fca5415ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca51e00640 1 -- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca5415a0e0 msgr2=0x7fca541451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca51e00640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca5415a0e0 0x7fca541451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca51e00640 1 -- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca5415d600 msgr2=0x7fca5415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca51e00640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca5415d600 0x7fca5415ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca51e00640 1 -- 172.21.15.59:0/1972530761 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca541593d0 con 0x7fca540cef10 2024-05-30T17:02:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca51e00640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca540cef10 0x7fca540ad8b0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c730 tx=0x7fca4400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:36.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca4a000640 1 -- 172.21.15.59:0/1972530761 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44018070 con 0x7fca540cef10 2024-05-30T17:02:36.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca4a000640 1 -- 172.21.15.59:0/1972530761 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca440072f0 con 0x7fca540cef10 2024-05-30T17:02:36.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca53200640 1 -- 172.21.15.59:0/1972530761 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca54159670 con 0x7fca540cef10 2024-05-30T17:02:36.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca4a000640 1 -- 172.21.15.59:0/1972530761 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca440047f0 con 0x7fca540cef10 2024-05-30T17:02:36.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca53200640 1 -- 172.21.15.59:0/1972530761 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca540b57a0 con 0x7fca540cef10 2024-05-30T17:02:36.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.638+0000 7fca53200640 1 -- 172.21.15.59:0/1972530761 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca541576c0 con 0x7fca540cef10 2024-05-30T17:02:36.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.642+0000 7fca4a000640 1 -- 172.21.15.59:0/1972530761 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fca4401b070 con 0x7fca540cef10 2024-05-30T17:02:36.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.642+0000 7fca4a000640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fca30069b20 0x7fca3006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.642+0000 7fca4a000640 1 -- 172.21.15.59:0/1972530761 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5877+0+0 (secure 0 0 0) 0x7fca44084c00 con 0x7fca540cef10 2024-05-30T17:02:36.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.642+0000 7fca4be00640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fca30069b20 0x7fca3006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.642+0000 7fca4be00640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fca30069b20 0x7fca3006bfe0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fca54152d70 tx=0x7fca3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:36.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.646+0000 7fca4a000640 1 -- 172.21.15.59:0/1972530761 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fca541576c0 con 0x7fca540cef10 2024-05-30T17:02:36.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.810+0000 7fca53200640 1 -- 172.21.15.59:0/1972530761 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca540691a0 con 0x7fca540cef10 2024-05-30T17:02:36.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca4a000640 1 -- 172.21.15.59:0/1972530761 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+16895 (secure 0 0 0) 0x7fca44056c20 con 0x7fca540cef10 2024-05-30T17:02:36.817 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:36.817 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":105,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:02:34.449180+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:01:16.196498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-05-30T17:01:17.468393+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:02:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca53200640 1 -- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fca30069b20 msgr2=0x7fca3006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca53200640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fca30069b20 0x7fca3006bfe0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fca54152d70 tx=0x7fca3c009040 comp rx=0 tx=0).stop 2024-05-30T17:02:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca53200640 1 -- 172.21.15.59:0/1972530761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca540cef10 msgr2=0x7fca540ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca53200640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca540cef10 0x7fca540ad8b0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c730 tx=0x7fca4400cbf0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca53200640 1 -- 172.21.15.59:0/1972530761 shutdown_connections 2024-05-30T17:02:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca53200640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fca30069b20 0x7fca3006bfe0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca53200640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca5415d600 0x7fca5415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca53200640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca5415a0e0 0x7fca541451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca53200640 1 --2- 172.21.15.59:0/1972530761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca540cef10 0x7fca540ad8b0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca53200640 1 -- 172.21.15.59:0/1972530761 >> 172.21.15.59:0/1972530761 conn(0x7fca540733a0 msgr2=0x7fca5415b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca53200640 1 -- 172.21.15.59:0/1972530761 shutdown_connections 2024-05-30T17:02:36.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.814+0000 7fca53200640 1 -- 172.21.15.59:0/1972530761 wait complete. 2024-05-30T17:02:36.838 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T17:02:36.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:02:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.974+0000 7f274ee00640 1 Processor -- start 2024-05-30T17:02:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.978+0000 7f274ee00640 1 -- start start 2024-05-30T17:02:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.978+0000 7f274ee00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2748162a50 0x7f274806cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.978+0000 7f274ee00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27480d0fb0 con 0x7f274809b4b0 2024-05-30T17:02:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.978+0000 7f274ee00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27480d1290 con 0x7f274809b890 2024-05-30T17:02:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.978+0000 7f274ee00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f274806fef0 con 0x7f2748162a50 2024-05-30T17:02:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.978+0000 7f274e400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2748162a50 0x7f274806cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.978+0000 7f274da00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f274809b4b0 0x7f27480d0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39140/0 (socket says 172.21.15.59:39140) 2024-05-30T17:02:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.978+0000 7f274da00640 1 -- 172.21.15.59:0/2024007520 learned_addr learned my addr 172.21.15.59:0/2024007520 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.978+0000 7f274e400640 1 -- 172.21.15.59:0/2024007520 >> v1:172.21.15.107:6789/0 conn(0x7f274809b890 legacy=0x7f2748162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.978+0000 7f274e400640 1 -- 172.21.15.59:0/2024007520 >> v1:172.21.15.59:6789/0 conn(0x7f274809b4b0 legacy=0x7f27480d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.978+0000 7f2747e00640 1 -- 172.21.15.59:0/2024007520 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 982171414 0 0) 0x7f27480d0fb0 con 0x7f274809b4b0 2024-05-30T17:02:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.978+0000 7f274e400640 1 -- 172.21.15.59:0/2024007520 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27480d1570 con 0x7f2748162a50 2024-05-30T17:02:36.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f274e400640 1 --2- 172.21.15.59:0/2024007520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2748162a50 0x7f274806cac0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f2740009d90 tx=0x7f274001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7285c07d8e87c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f2747e00640 1 -- 172.21.15.59:0/2024007520 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27400b2070 con 0x7f2748162a50 2024-05-30T17:02:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f2747e00640 1 -- 172.21.15.59:0/2024007520 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27400a58c0 con 0x7f2748162a50 2024-05-30T17:02:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f2747e00640 1 -- 172.21.15.59:0/2024007520 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27400a5c90 con 0x7f2748162a50 2024-05-30T17:02:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f274ee00640 1 -- 172.21.15.59:0/2024007520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2748162a50 msgr2=0x7f274806cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f274ee00640 1 --2- 172.21.15.59:0/2024007520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2748162a50 0x7f274806cac0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f2740009d90 tx=0x7f274001c870 comp rx=0 tx=0).stop 2024-05-30T17:02:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f274ee00640 1 -- 172.21.15.59:0/2024007520 shutdown_connections 2024-05-30T17:02:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f274ee00640 1 --2- 172.21.15.59:0/2024007520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2748162a50 0x7f274806cac0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f274ee00640 1 -- 172.21.15.59:0/2024007520 >> 172.21.15.59:0/2024007520 conn(0x7f27480b3ec0 msgr2=0x7f27480b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f274ee00640 1 -- 172.21.15.59:0/2024007520 shutdown_connections 2024-05-30T17:02:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f274ee00640 1 -- 172.21.15.59:0/2024007520 wait complete. 2024-05-30T17:02:36.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f274ee00640 1 Processor -- start 2024-05-30T17:02:36.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.982+0000 7f274ee00640 1 -- start start 2024-05-30T17:02:36.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274ee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f274809b4b0 0x7f2748156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f274809b890 0x7f274806dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274ee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2748162a50 0x7f274806e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274ee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f274815fbf0 con 0x7f2748162a50 2024-05-30T17:02:36.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274ee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f274815fa70 con 0x7f274809b4b0 2024-05-30T17:02:36.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2748070380 con 0x7f274809b890 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2748162a50 0x7f274806e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2748162a50 0x7f274806e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51858/0 (socket says 172.21.15.59:51858) 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274e400640 1 -- 172.21.15.59:0/153365201 learned_addr learned my addr 172.21.15.59:0/153365201 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274da00640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f274809b4b0 0x7f2748156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274d000640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f274809b890 0x7f274806dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274e400640 1 -- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f274809b890 msgr2=0x7f274806dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274e400640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f274809b890 0x7f274806dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274e400640 1 -- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f274809b4b0 msgr2=0x7f2748156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274e400640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f274809b4b0 0x7f2748156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274e400640 1 -- 172.21.15.59:0/153365201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27481422f0 con 0x7f2748162a50 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274e400640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2748162a50 0x7f274806e220 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f274001a4a0 tx=0x7f2740019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f2745600640 1 -- 172.21.15.59:0/153365201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27400b2050 con 0x7f2748162a50 2024-05-30T17:02:36.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f2745600640 1 -- 172.21.15.59:0/153365201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27400be070 con 0x7f2748162a50 2024-05-30T17:02:36.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f2745600640 1 -- 172.21.15.59:0/153365201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27400ada50 con 0x7f2748162a50 2024-05-30T17:02:36.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274ee00640 1 -- 172.21.15.59:0/153365201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f274815e150 con 0x7f2748162a50 2024-05-30T17:02:36.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274ee00640 1 -- 172.21.15.59:0/153365201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f274815e710 con 0x7f2748162a50 2024-05-30T17:02:36.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f274ee00640 1 -- 172.21.15.59:0/153365201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2748068a90 con 0x7f2748162a50 2024-05-30T17:02:36.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.986+0000 7f2745600640 1 -- 172.21.15.59:0/153365201 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f27400adbf0 con 0x7f2748162a50 2024-05-30T17:02:36.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.990+0000 7f2745600640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2728069b50 0x7f272806c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:36.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.990+0000 7f2745600640 1 -- 172.21.15.59:0/153365201 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5877+0+0 (secure 0 0 0) 0x7f2740120340 con 0x7f2748162a50 2024-05-30T17:02:36.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.990+0000 7f274da00640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2728069b50 0x7f272806c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:36.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.990+0000 7f274da00640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2728069b50 0x7f272806c010 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f273c007fd0 tx=0x7f273c007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:36.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:36.994+0000 7f2745600640 1 -- 172.21.15.59:0/153365201 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f27400c7020 con 0x7f2748162a50 2024-05-30T17:02:37.236 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:37.236 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2410188205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2410188205},{"type":"v1","addr":"172.21.15.107:6836","nonce":2410188205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7342,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1749998079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1749998079},{"type":"v1","addr":"172.21.15.59:6834","nonce":1749998079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3865215628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3865215628},{"type":"v1","addr":"172.21.15.107:6837","nonce":3865215628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:01:18.507070+0000","modified":"2024-05-30T17:01:21.519897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/1525464146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1525464146},{"type":"v1","addr":"172.21.15.59:6835","nonce":1525464146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7986,"qdb_cluster":[7986]},"id":7}]} 2024-05-30T17:02:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 62 2024-05-30T17:02:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.230+0000 7f274ee00640 1 -- 172.21.15.59:0/153365201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f274815e8e0 con 0x7f2748162a50 2024-05-30T17:02:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.230+0000 7f2745600640 1 -- 172.21.15.59:0/153365201 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5189 (secure 0 0 0) 0x7f2740016520 con 0x7f2748162a50 2024-05-30T17:02:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.234+0000 7f274ee00640 1 -- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2728069b50 msgr2=0x7f272806c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.234+0000 7f274ee00640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2728069b50 0x7f272806c010 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f273c007fd0 tx=0x7f273c007d60 comp rx=0 tx=0).stop 2024-05-30T17:02:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.234+0000 7f274ee00640 1 -- 172.21.15.59:0/153365201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2748162a50 msgr2=0x7f274806e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.234+0000 7f274ee00640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2748162a50 0x7f274806e220 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f274001a4a0 tx=0x7f2740019610 comp rx=0 tx=0).stop 2024-05-30T17:02:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.234+0000 7f274ee00640 1 -- 172.21.15.59:0/153365201 shutdown_connections 2024-05-30T17:02:37.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.234+0000 7f274ee00640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2728069b50 0x7f272806c010 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.234+0000 7f274ee00640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2748162a50 0x7f274806e220 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.234+0000 7f274ee00640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f274809b890 0x7f274806dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.234+0000 7f274ee00640 1 --2- 172.21.15.59:0/153365201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f274809b4b0 0x7f2748156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.234+0000 7f274ee00640 1 -- 172.21.15.59:0/153365201 >> 172.21.15.59:0/153365201 conn(0x7f27480b3ec0 msgr2=0x7f27480cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:37.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.234+0000 7f274ee00640 1 -- 172.21.15.59:0/153365201 shutdown_connections 2024-05-30T17:02:37.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.234+0000 7f274ee00640 1 -- 172.21.15.59:0/153365201 wait complete. 2024-05-30T17:02:37.277 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.522+0000 7fa306800640 1 Processor -- start 2024-05-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.522+0000 7fa306800640 1 -- start start 2024-05-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.522+0000 7fa306800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa3000b38e0 0x7fa30015f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.522+0000 7fa306800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa30006fa10 0x7fa30015fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.522+0000 7fa306800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3001620d0 con 0x7fa300161cf0 2024-05-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.522+0000 7fa306800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa300162310 con 0x7fa30006fa10 2024-05-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.522+0000 7fa306800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa300162560 con 0x7fa3000b38e0 2024-05-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.522+0000 7fa2fea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa3000b38e0 0x7fa30015f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.522+0000 7fa2fea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa3000b38e0 0x7fa30015f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:38352/0 (socket says 172.21.15.59:38352) 2024-05-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.522+0000 7fa2fea00640 1 -- 172.21.15.59:0/168918466 learned_addr learned my addr 172.21.15.59:0/168918466 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.526+0000 7fa2ffe00640 1 --2- 172.21.15.59:0/168918466 >> v2:172.21.15.59:3300/0 conn(0x7fa30006fa10 0x7fa30015fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.526+0000 7fa2fea00640 1 -- 172.21.15.59:0/168918466 >> v2:172.21.15.59:3300/0 conn(0x7fa30006fa10 msgr2=0x7fa30015fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.526+0000 7fa2fea00640 1 --2- 172.21.15.59:0/168918466 >> v2:172.21.15.59:3300/0 conn(0x7fa30006fa10 0x7fa30015fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.526+0000 7fa2fea00640 1 -- 172.21.15.59:0/168918466 >> v1:172.21.15.107:6789/0 conn(0x7fa300161cf0 legacy=0x7fa3000b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.526+0000 7fa2fea00640 1 -- 172.21.15.59:0/168918466 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa300162840 con 0x7fa3000b38e0 2024-05-30T17:02:37.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.530+0000 7fa2fea00640 1 --2- 172.21.15.59:0/168918466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3000b38e0 0x7fa30015f770 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa300072170 tx=0x7fa2f001c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98d93f2cda22b256 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.530+0000 7fa2fe000640 1 -- 172.21.15.59:0/168918466 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00ab620 con 0x7fa3000b38e0 2024-05-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.530+0000 7fa2fe000640 1 -- 172.21.15.59:0/168918466 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f00b0070 con 0x7fa3000b38e0 2024-05-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.530+0000 7fa2fe000640 1 -- 172.21.15.59:0/168918466 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00ab9e0 con 0x7fa3000b38e0 2024-05-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.530+0000 7fa306800640 1 -- 172.21.15.59:0/168918466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3000b38e0 msgr2=0x7fa30015f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.530+0000 7fa306800640 1 --2- 172.21.15.59:0/168918466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3000b38e0 0x7fa30015f770 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa300072170 tx=0x7fa2f001c420 comp rx=0 tx=0).stop 2024-05-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.530+0000 7fa306800640 1 -- 172.21.15.59:0/168918466 shutdown_connections 2024-05-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.530+0000 7fa306800640 1 --2- 172.21.15.59:0/168918466 >> v2:172.21.15.59:3300/0 conn(0x7fa30006fa10 0x7fa30015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.530+0000 7fa306800640 1 --2- 172.21.15.59:0/168918466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3000b38e0 0x7fa30015f770 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.530+0000 7fa306800640 1 -- 172.21.15.59:0/168918466 >> 172.21.15.59:0/168918466 conn(0x7fa3000b56f0 msgr2=0x7fa3000b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.530+0000 7fa306800640 1 -- 172.21.15.59:0/168918466 shutdown_connections 2024-05-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.530+0000 7fa306800640 1 -- 172.21.15.59:0/168918466 wait complete. 2024-05-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.534+0000 7fa306800640 1 Processor -- start 2024-05-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.534+0000 7fa306800640 1 -- start start 2024-05-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa306800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30006fa10 0x7fa3001502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa306800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa3000b38e0 0x7fa30009b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa306800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa300161cf0 0x7fa30009b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa306800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa30006ec50 con 0x7fa300161cf0 2024-05-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa306800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001601f0 con 0x7fa30006fa10 2024-05-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa306800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa30006edd0 con 0x7fa3000b38e0 2024-05-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2fea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa3000b38e0 0x7fa30009b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2ffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa300161cf0 0x7fa30009b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2fea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa3000b38e0 0x7fa30009b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:51808/0 (socket says 172.21.15.59:51808) 2024-05-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2fea00640 1 -- 172.21.15.59:0/2943271395 learned_addr learned my addr 172.21.15.59:0/2943271395 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2ff400640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30006fa10 0x7fa3001502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2fea00640 1 -- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30006fa10 msgr2=0x7fa3001502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2fea00640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30006fa10 0x7fa3001502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2fea00640 1 -- 172.21.15.59:0/2943271395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa300161cf0 msgr2=0x7fa30009b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2fea00640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa300161cf0 0x7fa30009b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2fea00640 1 -- 172.21.15.59:0/2943271395 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa300150810 con 0x7fa3000b38e0 2024-05-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2fea00640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa3000b38e0 0x7fa30009b390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa2f001aad0 tx=0x7fa2f001ac60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2f7400640 1 -- 172.21.15.59:0/2943271395 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00abd20 con 0x7fa3000b38e0 2024-05-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2f7400640 1 -- 172.21.15.59:0/2943271395 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f00be3f0 con 0x7fa3000b38e0 2024-05-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa2f7400640 1 -- 172.21.15.59:0/2943271395 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00be7e0 con 0x7fa3000b38e0 2024-05-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa306800640 1 -- 172.21.15.59:0/2943271395 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3001568e0 con 0x7fa3000b38e0 2024-05-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.538+0000 7fa306800640 1 -- 172.21.15.59:0/2943271395 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa300156ea0 con 0x7fa3000b38e0 2024-05-30T17:02:37.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.542+0000 7fa306800640 1 -- 172.21.15.59:0/2943271395 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa300068a90 con 0x7fa3000b38e0 2024-05-30T17:02:37.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.542+0000 7fa2f7400640 1 -- 172.21.15.59:0/2943271395 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fa2f00c7430 con 0x7fa3000b38e0 2024-05-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.546+0000 7fa2f7400640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa2e0069bf0 0x7fa2e006c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.546+0000 7fa2f7400640 1 -- 172.21.15.59:0/2943271395 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(105..105 src has 1..105) ==== 5877+0+0 (secure 0 0 0) 0x7fa2f011fdc0 con 0x7fa3000b38e0 2024-05-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.546+0000 7fa2ff400640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa2e0069bf0 0x7fa2e006c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:37.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.546+0000 7fa2ff400640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa2e0069bf0 0x7fa2e006c0b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0098e0 tx=0x7fa2ec009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:37.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.554+0000 7fa2f7400640 1 -- 172.21.15.59:0/2943271395 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa300150810 con 0x7fa3000b38e0 2024-05-30T17:02:37.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.754+0000 7fa306800640 1 -- 172.21.15.59:0/2943271395 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3000b5e50 con 0x7fa3000b38e0 2024-05-30T17:02:37.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.754+0000 7fa2f7400640 1 -- 172.21.15.59:0/2943271395 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5189 (secure 0 0 0) 0x7fa2f00160d0 con 0x7fa3000b38e0 2024-05-30T17:02:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:37.760 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2410188205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2410188205},{"type":"v1","addr":"172.21.15.107:6836","nonce":2410188205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7342,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1749998079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1749998079},{"type":"v1","addr":"172.21.15.59:6834","nonce":1749998079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3865215628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3865215628},{"type":"v1","addr":"172.21.15.107:6837","nonce":3865215628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:01:18.507070+0000","modified":"2024-05-30T17:01:21.519897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/1525464146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1525464146},{"type":"v1","addr":"172.21.15.59:6835","nonce":1525464146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7986,"qdb_cluster":[7986]},"id":7}]} 2024-05-30T17:02:37.760 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 62 2024-05-30T17:02:37.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.758+0000 7fa306800640 1 -- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa2e0069bf0 msgr2=0x7fa2e006c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:37.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.758+0000 7fa306800640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa2e0069bf0 0x7fa2e006c0b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0098e0 tx=0x7fa2ec009060 comp rx=0 tx=0).stop 2024-05-30T17:02:37.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.758+0000 7fa306800640 1 -- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa3000b38e0 msgr2=0x7fa30009b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:37.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.758+0000 7fa306800640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa3000b38e0 0x7fa30009b390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa2f001aad0 tx=0x7fa2f001ac60 comp rx=0 tx=0).stop 2024-05-30T17:02:37.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.758+0000 7fa306800640 1 -- 172.21.15.59:0/2943271395 shutdown_connections 2024-05-30T17:02:37.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.758+0000 7fa306800640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa2e0069bf0 0x7fa2e006c0b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.758+0000 7fa306800640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa300161cf0 0x7fa30009b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.758+0000 7fa306800640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa3000b38e0 0x7fa30009b390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.758+0000 7fa306800640 1 --2- 172.21.15.59:0/2943271395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30006fa10 0x7fa3001502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.758+0000 7fa306800640 1 -- 172.21.15.59:0/2943271395 >> 172.21.15.59:0/2943271395 conn(0x7fa3000b56f0 msgr2=0x7fa300160370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:37.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.758+0000 7fa306800640 1 -- 172.21.15.59:0/2943271395 shutdown_connections 2024-05-30T17:02:37.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.758+0000 7fa306800640 1 -- 172.21.15.59:0/2943271395 wait complete. 2024-05-30T17:02:37.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:02:37.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5be000640 1 Processor -- start 2024-05-30T17:02:37.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5be000640 1 -- start start 2024-05-30T17:02:37.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5be000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe5b815e940 0x7fe5b80d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:37.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5be000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5b80d1880 0x7fe5b80b7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:37.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5be000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5b80d31e0 con 0x7fe5b80d4280 2024-05-30T17:02:37.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5be000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe5b80d3df0 con 0x7fe5b815e940 2024-05-30T17:02:37.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5be000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b80d34c0 con 0x7fe5b80d1880 2024-05-30T17:02:37.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5b7400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe5b815e940 0x7fe5b80d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:37.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5b7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5b80d1880 0x7fe5b80b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:37.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5aea00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe5b80d4280 0x7fe5b80d1170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:59800/0 (socket says 172.21.15.59:59800) 2024-05-30T17:02:37.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5aea00640 1 -- 172.21.15.59:0/2685474225 learned_addr learned my addr 172.21.15.59:0/2685474225 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:37.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5b7400640 1 -- 172.21.15.59:0/2685474225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5b80d1880 msgr2=0x7fe5b80b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:37.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5b7400640 1 --2- 172.21.15.59:0/2685474225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5b80d1880 0x7fe5b80b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5b7400640 1 -- 172.21.15.59:0/2685474225 >> v1:172.21.15.107:6789/0 conn(0x7fe5b80d4280 legacy=0x7fe5b80d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:37.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.918+0000 7fe5b7400640 1 -- 172.21.15.59:0/2685474225 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b80d37a0 con 0x7fe5b815e940 2024-05-30T17:02:37.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.922+0000 7fe5b7400640 1 --2- 172.21.15.59:0/2685474225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5b815e940 0x7fe5b80d2870 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80097c0 tx=0x7fe5a801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7f5b350e7cc18e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:37.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.922+0000 7fe5b6a00640 1 -- 172.21.15.59:0/2685474225 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80b0070 con 0x7fe5b815e940 2024-05-30T17:02:37.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.922+0000 7fe5b6a00640 1 -- 172.21.15.59:0/2685474225 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a80ab600 con 0x7fe5b815e940 2024-05-30T17:02:37.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.922+0000 7fe5b6a00640 1 -- 172.21.15.59:0/2685474225 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80ab9d0 con 0x7fe5b815e940 2024-05-30T17:02:37.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.922+0000 7fe5be000640 1 -- 172.21.15.59:0/2685474225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5b815e940 msgr2=0x7fe5b80d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:37.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.922+0000 7fe5be000640 1 --2- 172.21.15.59:0/2685474225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5b815e940 0x7fe5b80d2870 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80097c0 tx=0x7fe5a801c330 comp rx=0 tx=0).stop 2024-05-30T17:02:37.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.922+0000 7fe5be000640 1 -- 172.21.15.59:0/2685474225 shutdown_connections 2024-05-30T17:02:37.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.922+0000 7fe5be000640 1 --2- 172.21.15.59:0/2685474225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5b80d1880 0x7fe5b80b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.922+0000 7fe5be000640 1 --2- 172.21.15.59:0/2685474225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5b815e940 0x7fe5b80d2870 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.922+0000 7fe5be000640 1 -- 172.21.15.59:0/2685474225 >> 172.21.15.59:0/2685474225 conn(0x7fe5b8067760 msgr2=0x7fe5b8067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:37.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.922+0000 7fe5be000640 1 -- 172.21.15.59:0/2685474225 shutdown_connections 2024-05-30T17:02:37.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.922+0000 7fe5be000640 1 -- 172.21.15.59:0/2685474225 wait complete. 2024-05-30T17:02:37.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5be000640 1 Processor -- start 2024-05-30T17:02:37.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5be000640 1 -- start start 2024-05-30T17:02:37.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5be000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5b80d1880 0x7fe5b815af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5be000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b80d4280 0x7fe5b80ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5be000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5b815e940 0x7fe5b80cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5be000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b80ba670 con 0x7fe5b80d4280 2024-05-30T17:02:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5be000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b80ba4f0 con 0x7fe5b80d1880 2024-05-30T17:02:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5be000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b80d2db0 con 0x7fe5b815e940 2024-05-30T17:02:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5aea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b80d4280 0x7fe5b80ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5aea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b80d4280 0x7fe5b80ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51884/0 (socket says 172.21.15.59:51884) 2024-05-30T17:02:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5aea00640 1 -- 172.21.15.59:0/3636768544 learned_addr learned my addr 172.21.15.59:0/3636768544 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5b7400640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5b80d1880 0x7fe5b815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5b7e00640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5b815e940 0x7fe5b80cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5aea00640 1 -- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5b815e940 msgr2=0x7fe5b80cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5aea00640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5b815e940 0x7fe5b80cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5aea00640 1 -- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5b80d1880 msgr2=0x7fe5b815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:37.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5aea00640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5b80d1880 0x7fe5b815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:37.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5aea00640 1 -- 172.21.15.59:0/3636768544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b80cbb50 con 0x7fe5b80d4280 2024-05-30T17:02:37.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5aea00640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b80d4280 0x7fe5b80ce260 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000ee70 tx=0x7fe5a000c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:37.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5afe00640 1 -- 172.21.15.59:0/3636768544 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0019070 con 0x7fe5b80d4280 2024-05-30T17:02:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5afe00640 1 -- 172.21.15.59:0/3636768544 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a0007b10 con 0x7fe5b80d4280 2024-05-30T17:02:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5afe00640 1 -- 172.21.15.59:0/3636768544 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000ce10 con 0x7fe5b80d4280 2024-05-30T17:02:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5be000640 1 -- 172.21.15.59:0/3636768544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b815ed20 con 0x7fe5b80d4280 2024-05-30T17:02:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.926+0000 7fe5be000640 1 -- 172.21.15.59:0/3636768544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b815f2e0 con 0x7fe5b80d4280 2024-05-30T17:02:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.930+0000 7fe5be000640 1 -- 172.21.15.59:0/3636768544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5b8068a90 con 0x7fe5b80d4280 2024-05-30T17:02:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.930+0000 7fe5afe00640 1 -- 172.21.15.59:0/3636768544 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fe5a001c070 con 0x7fe5b80d4280 2024-05-30T17:02:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.930+0000 7fe5afe00640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe594069b50 0x7fe59406c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.930+0000 7fe5afe00640 1 -- 172.21.15.59:0/3636768544 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5877+0+0 (secure 0 0 0) 0x7fe5a00873a0 con 0x7fe5b80d4280 2024-05-30T17:02:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.930+0000 7fe5b7400640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe594069b50 0x7fe59406c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:37.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.930+0000 7fe5b7400640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe594069b50 0x7fe59406c010 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80ad000 tx=0x7fe5a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:37.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:37.934+0000 7fe5afe00640 1 -- 172.21.15.59:0/3636768544 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe5a0058d70 con 0x7fe5b80d4280 2024-05-30T17:02:38.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.098+0000 7fe5be000640 1 -- 172.21.15.59:0/3636768544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5b806bc60 con 0x7fe5b80d4280 2024-05-30T17:02:38.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.098+0000 7fe5afe00640 1 -- 172.21.15.59:0/3636768544 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+16895 (secure 0 0 0) 0x7fe5a005d070 con 0x7fe5b80d4280 2024-05-30T17:02:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:38.103 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":105,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:02:34.449180+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:01:16.196498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-05-30T17:01:17.468393+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:02:38.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.102+0000 7fe5be000640 1 -- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe594069b50 msgr2=0x7fe59406c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.102+0000 7fe5be000640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe594069b50 0x7fe59406c010 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80ad000 tx=0x7fe5a8008040 comp rx=0 tx=0).stop 2024-05-30T17:02:38.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.102+0000 7fe5be000640 1 -- 172.21.15.59:0/3636768544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b80d4280 msgr2=0x7fe5b80ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.102+0000 7fe5be000640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b80d4280 0x7fe5b80ce260 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000ee70 tx=0x7fe5a000c430 comp rx=0 tx=0).stop 2024-05-30T17:02:38.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.102+0000 7fe5be000640 1 -- 172.21.15.59:0/3636768544 shutdown_connections 2024-05-30T17:02:38.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.102+0000 7fe5be000640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe594069b50 0x7fe59406c010 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.102+0000 7fe5be000640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5b815e940 0x7fe5b80cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.102+0000 7fe5be000640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b80d4280 0x7fe5b80ce260 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.102+0000 7fe5be000640 1 --2- 172.21.15.59:0/3636768544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5b80d1880 0x7fe5b815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.102+0000 7fe5be000640 1 -- 172.21.15.59:0/3636768544 >> 172.21.15.59:0/3636768544 conn(0x7fe5b8067760 msgr2=0x7fe5b80b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:38.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.102+0000 7fe5be000640 1 -- 172.21.15.59:0/3636768544 shutdown_connections 2024-05-30T17:02:38.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.102+0000 7fe5be000640 1 -- 172.21.15.59:0/3636768544 wait complete. 2024-05-30T17:02:38.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ceca00640 1 Processor -- start 2024-05-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ceca00640 1 -- start start 2024-05-30T17:02:38.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ceca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ce80d0f30 0x7f6ce809ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:38.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ceca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6ce809b080 0x7f6ce80cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:38.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ceca00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ce809b900 con 0x7f6ce815c7b0 2024-05-30T17:02:38.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ceca00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce815cb90 con 0x7f6ce809b080 2024-05-30T17:02:38.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ceca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce80cd4c0 con 0x7f6ce80d0f30 2024-05-30T17:02:38.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ce7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6ce815c7b0 0x7f6ce80d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39156/0 (socket says 172.21.15.59:39156) 2024-05-30T17:02:38.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ce7400640 1 -- 172.21.15.59:0/2015432539 learned_addr learned my addr 172.21.15.59:0/2015432539 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:38.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ce7e00640 1 --2- 172.21.15.59:0/2015432539 >> v2:172.21.15.107:3300/0 conn(0x7f6ce809b080 0x7f6ce80cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:38.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6cdfe00640 1 --2- 172.21.15.59:0/2015432539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ce80d0f30 0x7f6ce809ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:38.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ce6a00640 1 -- 172.21.15.59:0/2015432539 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840634541 0 0) 0x7f6ce809b900 con 0x7f6ce815c7b0 2024-05-30T17:02:38.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ce6a00640 1 -- 172.21.15.59:0/2015432539 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ccc003530 con 0x7f6ce815c7b0 2024-05-30T17:02:38.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ce7e00640 1 -- 172.21.15.59:0/2015432539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ce80d0f30 msgr2=0x7f6ce809ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:38.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ce7e00640 1 --2- 172.21.15.59:0/2015432539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ce80d0f30 0x7f6ce809ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ce7e00640 1 -- 172.21.15.59:0/2015432539 >> v1:172.21.15.59:6789/0 conn(0x7f6ce815c7b0 legacy=0x7f6ce80d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6ce7e00640 1 -- 172.21.15.59:0/2015432539 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce809bbe0 con 0x7f6ce809b080 2024-05-30T17:02:38.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.266+0000 7f6cdfe00640 1 --2- 172.21.15.59:0/2015432539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ce80d0f30 0x7f6ce809ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:02:38.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.270+0000 7f6ce7e00640 1 --2- 172.21.15.59:0/2015432539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce809b080 0x7f6ce80cd950 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009d90 tx=0x7f6ce001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f3724f27dd989bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:38.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.270+0000 7f6ce6a00640 1 -- 172.21.15.59:0/2015432539 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00b2070 con 0x7f6ce809b080 2024-05-30T17:02:38.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.270+0000 7f6ce6a00640 1 -- 172.21.15.59:0/2015432539 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce00a5a20 con 0x7f6ce809b080 2024-05-30T17:02:38.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.270+0000 7f6ce6a00640 1 -- 172.21.15.59:0/2015432539 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00a5df0 con 0x7f6ce809b080 2024-05-30T17:02:38.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.270+0000 7f6ceca00640 1 -- 172.21.15.59:0/2015432539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce809b080 msgr2=0x7f6ce80cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.270+0000 7f6ceca00640 1 --2- 172.21.15.59:0/2015432539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce809b080 0x7f6ce80cd950 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009d90 tx=0x7f6ce001c940 comp rx=0 tx=0).stop 2024-05-30T17:02:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.270+0000 7f6ceca00640 1 -- 172.21.15.59:0/2015432539 shutdown_connections 2024-05-30T17:02:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.270+0000 7f6ceca00640 1 --2- 172.21.15.59:0/2015432539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce809b080 0x7f6ce80cd950 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.270+0000 7f6ceca00640 1 --2- 172.21.15.59:0/2015432539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ce80d0f30 0x7f6ce809ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.270+0000 7f6ceca00640 1 -- 172.21.15.59:0/2015432539 >> 172.21.15.59:0/2015432539 conn(0x7f6ce80b3ec0 msgr2=0x7f6ce80b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.270+0000 7f6ceca00640 1 -- 172.21.15.59:0/2015432539 shutdown_connections 2024-05-30T17:02:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.270+0000 7f6ceca00640 1 -- 172.21.15.59:0/2015432539 wait complete. 2024-05-30T17:02:38.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6ceca00640 1 Processor -- start 2024-05-30T17:02:38.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6ceca00640 1 -- start start 2024-05-30T17:02:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6ceca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce809b080 0x7f6ce806de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6ceca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce80d0f30 0x7f6ce8070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6ceca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ce815c7b0 0x7f6ce81f8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6ceca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce80ce6a0 con 0x7f6ce80d0f30 2024-05-30T17:02:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6ceca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce809b6e0 con 0x7f6ce809b080 2024-05-30T17:02:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6ceca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce80ce820 con 0x7f6ce815c7b0 2024-05-30T17:02:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6cdfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce80d0f30 0x7f6ce8070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6cdfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce80d0f30 0x7f6ce8070aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51890/0 (socket says 172.21.15.59:51890) 2024-05-30T17:02:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6cdfe00640 1 -- 172.21.15.59:0/1415984230 learned_addr learned my addr 172.21.15.59:0/1415984230 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6ce7400640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce809b080 0x7f6ce806de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6ce7e00640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ce815c7b0 0x7f6ce81f8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6cdfe00640 1 -- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ce815c7b0 msgr2=0x7f6ce81f8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6cdfe00640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ce815c7b0 0x7f6ce81f8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6cdfe00640 1 -- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce809b080 msgr2=0x7f6ce806de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6cdfe00640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce809b080 0x7f6ce806de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6cdfe00640 1 -- 172.21.15.59:0/1415984230 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce814b410 con 0x7f6ce80d0f30 2024-05-30T17:02:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6cdfe00640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce80d0f30 0x7f6ce8070aa0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000ec10 tx=0x7f6cd000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6cdf400640 1 -- 172.21.15.59:0/1415984230 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0017070 con 0x7f6ce80d0f30 2024-05-30T17:02:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6cdf400640 1 -- 172.21.15.59:0/1415984230 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd000cc30 con 0x7f6ce80d0f30 2024-05-30T17:02:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6ceca00640 1 -- 172.21.15.59:0/1415984230 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce806d670 con 0x7f6ce80d0f30 2024-05-30T17:02:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6cdf400640 1 -- 172.21.15.59:0/1415984230 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0013470 con 0x7f6ce80d0f30 2024-05-30T17:02:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.274+0000 7f6ceca00640 1 -- 172.21.15.59:0/1415984230 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce8071bb0 con 0x7f6ce80d0f30 2024-05-30T17:02:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.278+0000 7f6ceca00640 1 -- 172.21.15.59:0/1415984230 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ce8068a90 con 0x7f6ce80d0f30 2024-05-30T17:02:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.278+0000 7f6cdf400640 1 -- 172.21.15.59:0/1415984230 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f6cd001a070 con 0x7f6ce80d0f30 2024-05-30T17:02:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.278+0000 7f6cdf400640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6cc4069b20 0x7f6cc406bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.278+0000 7f6cdf400640 1 -- 172.21.15.59:0/1415984230 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5877+0+0 (secure 0 0 0) 0x7f6cd0085700 con 0x7f6ce80d0f30 2024-05-30T17:02:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.278+0000 7f6ce7400640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6cc4069b20 0x7f6cc406bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.282+0000 7f6ce7400640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6cc4069b20 0x7f6cc406bfe0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8007fd0 tx=0x7f6cd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:38.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.282+0000 7f6cdf400640 1 -- 172.21.15.59:0/1415984230 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6ce814b410 con 0x7f6ce80d0f30 2024-05-30T17:02:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.482+0000 7f6ceca00640 1 -- 172.21.15.59:0/1415984230 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6ce8071df0 con 0x7f6ce80d0f30 2024-05-30T17:02:38.489 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-05-30T17:02:38.486+0000 7f2f74c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T17:02:38.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.490+0000 7f6cdf400640 1 -- 172.21.15.59:0/1415984230 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) ==== 161+0+0 (secure 0 0 0) 0x7f6cd0057050 con 0x7f6ce80d0f30 2024-05-30T17:02:38.492 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T17:02:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.490+0000 7f6ceca00640 1 -- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6cc4069b20 msgr2=0x7f6cc406bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.490+0000 7f6ceca00640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6cc4069b20 0x7f6cc406bfe0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8007fd0 tx=0x7f6cd8009040 comp rx=0 tx=0).stop 2024-05-30T17:02:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.490+0000 7f6ceca00640 1 -- 172.21.15.59:0/1415984230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce80d0f30 msgr2=0x7f6ce8070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.490+0000 7f6ceca00640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce80d0f30 0x7f6ce8070aa0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000ec10 tx=0x7f6cd000c520 comp rx=0 tx=0).stop 2024-05-30T17:02:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.490+0000 7f6ceca00640 1 -- 172.21.15.59:0/1415984230 shutdown_connections 2024-05-30T17:02:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.490+0000 7f6ceca00640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6cc4069b20 0x7f6cc406bfe0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.490+0000 7f6ceca00640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ce815c7b0 0x7f6ce81f8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.490+0000 7f6ceca00640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce80d0f30 0x7f6ce8070aa0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.490+0000 7f6ceca00640 1 --2- 172.21.15.59:0/1415984230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce809b080 0x7f6ce806de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.490+0000 7f6ceca00640 1 -- 172.21.15.59:0/1415984230 >> 172.21.15.59:0/1415984230 conn(0x7f6ce80b3ec0 msgr2=0x7f6ce815cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:38.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.494+0000 7f6ceca00640 1 -- 172.21.15.59:0/1415984230 shutdown_connections 2024-05-30T17:02:38.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.494+0000 7f6ceca00640 1 -- 172.21.15.59:0/1415984230 wait complete. 2024-05-30T17:02:38.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T17:02:38.563 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T17:02:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.658+0000 7f5197c00640 1 Processor -- start 2024-05-30T17:02:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.658+0000 7f5197c00640 1 -- start start 2024-05-30T17:02:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.662+0000 7f5197c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f51900ad2b0 0x7f519015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.662+0000 7f5197c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51900ad770 con 0x7f51901569e0 2024-05-30T17:02:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.662+0000 7f5197c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f519015cb40 con 0x7f51900d0660 2024-05-30T17:02:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.662+0000 7f5197c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f519015ce20 con 0x7f51900ad2b0 2024-05-30T17:02:38.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.662+0000 7f5195200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f51901569e0 0x7f51900cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39178/0 (socket says 172.21.15.59:39178) 2024-05-30T17:02:38.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.662+0000 7f5195200640 1 -- 172.21.15.59:0/2760718091 learned_addr learned my addr 172.21.15.59:0/2760718091 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:38.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.662+0000 7f518fe00640 1 --2- 172.21.15.59:0/2760718091 >> v2:172.21.15.107:3300/0 conn(0x7f51900ad2b0 0x7f519015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:38.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.662+0000 7f518f400640 1 -- 172.21.15.59:0/2760718091 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224828795 0 0) 0x7f51900ad770 con 0x7f51901569e0 2024-05-30T17:02:38.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.662+0000 7f518f400640 1 -- 172.21.15.59:0/2760718091 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5178003530 con 0x7f51901569e0 2024-05-30T17:02:38.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.662+0000 7f518fe00640 1 -- 172.21.15.59:0/2760718091 >> v1:172.21.15.107:6789/0 conn(0x7f51900d0660 legacy=0x7f51900b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.662+0000 7f518fe00640 1 -- 172.21.15.59:0/2760718091 >> v1:172.21.15.59:6789/0 conn(0x7f51901569e0 legacy=0x7f51900cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.662+0000 7f518fe00640 1 -- 172.21.15.59:0/2760718091 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f519015d100 con 0x7f51900ad2b0 2024-05-30T17:02:38.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f518fe00640 1 --2- 172.21.15.59:0/2760718091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51900ad2b0 0x7f519015d620 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f517c0097c0 tx=0x7f517c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe26324202c623e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f518f400640 1 -- 172.21.15.59:0/2760718091 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c0b0070 con 0x7f51900ad2b0 2024-05-30T17:02:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f518f400640 1 -- 172.21.15.59:0/2760718091 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c0ab600 con 0x7f51900ad2b0 2024-05-30T17:02:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f518f400640 1 -- 172.21.15.59:0/2760718091 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c0ab9d0 con 0x7f51900ad2b0 2024-05-30T17:02:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f5197c00640 1 -- 172.21.15.59:0/2760718091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51900ad2b0 msgr2=0x7f519015d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f5197c00640 1 --2- 172.21.15.59:0/2760718091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51900ad2b0 0x7f519015d620 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f517c0097c0 tx=0x7f517c01c410 comp rx=0 tx=0).stop 2024-05-30T17:02:38.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f5197c00640 1 -- 172.21.15.59:0/2760718091 shutdown_connections 2024-05-30T17:02:38.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f5197c00640 1 --2- 172.21.15.59:0/2760718091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51900ad2b0 0x7f519015d620 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f5197c00640 1 -- 172.21.15.59:0/2760718091 >> 172.21.15.59:0/2760718091 conn(0x7f519006bdb0 msgr2=0x7f519006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:38.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f5197c00640 1 -- 172.21.15.59:0/2760718091 shutdown_connections 2024-05-30T17:02:38.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f5197c00640 1 -- 172.21.15.59:0/2760718091 wait complete. 2024-05-30T17:02:38.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f5197c00640 1 Processor -- start 2024-05-30T17:02:38.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.666+0000 7f5197c00640 1 -- start start 2024-05-30T17:02:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5197c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51900ad2b0 0x7f51901482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5197c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51900d0660 0x7f51900b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5197c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51901569e0 0x7f519014a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5197c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f519016a340 con 0x7f51901569e0 2024-05-30T17:02:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5197c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f519016a1c0 con 0x7f51900d0660 2024-05-30T17:02:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5197c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f519016a4c0 con 0x7f51900ad2b0 2024-05-30T17:02:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5195c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51901569e0 0x7f519014a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5195c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51901569e0 0x7f519014a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51918/0 (socket says 172.21.15.59:51918) 2024-05-30T17:02:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5195c00640 1 -- 172.21.15.59:0/131506643 learned_addr learned my addr 172.21.15.59:0/131506643 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5195200640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51900ad2b0 0x7f51901482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f518fe00640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51900d0660 0x7f51900b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5195c00640 1 -- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51900ad2b0 msgr2=0x7f51901482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5195c00640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51900ad2b0 0x7f51901482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5195c00640 1 -- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51900d0660 msgr2=0x7f51900b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5195c00640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51900d0660 0x7f51900b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5195c00640 1 -- 172.21.15.59:0/131506643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51900b1060 con 0x7f51901569e0 2024-05-30T17:02:38.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5195c00640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51901569e0 0x7f519014a410 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f518800c770 tx=0x7f518800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:38.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f518cc00640 1 -- 172.21.15.59:0/131506643 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5188003b80 con 0x7f51901569e0 2024-05-30T17:02:38.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f518cc00640 1 -- 172.21.15.59:0/131506643 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5188003d20 con 0x7f51901569e0 2024-05-30T17:02:38.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f518cc00640 1 -- 172.21.15.59:0/131506643 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518800aa90 con 0x7f51901569e0 2024-05-30T17:02:38.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5197c00640 1 -- 172.21.15.59:0/131506643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51900b1300 con 0x7f51901569e0 2024-05-30T17:02:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5197c00640 1 -- 172.21.15.59:0/131506643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51900b18c0 con 0x7f51901569e0 2024-05-30T17:02:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f5197c00640 1 -- 172.21.15.59:0/131506643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5190068a90 con 0x7f51901569e0 2024-05-30T17:02:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.670+0000 7f518cc00640 1 -- 172.21.15.59:0/131506643 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f518800ac30 con 0x7f51901569e0 2024-05-30T17:02:38.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.674+0000 7f518cc00640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5170069b20 0x7f517006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:38.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.674+0000 7f518cc00640 1 -- 172.21.15.59:0/131506643 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5935+0+0 (secure 0 0 0) 0x7f5188086020 con 0x7f51901569e0 2024-05-30T17:02:38.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.674+0000 7f5195200640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5170069b20 0x7f517006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:38.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.674+0000 7f5195200640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5170069b20 0x7f517006bfe0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f51840011f0 tx=0x7f5184007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.678+0000 7f518cc00640 1 -- 172.21.15.59:0/131506643 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5188057a70 con 0x7f51901569e0 2024-05-30T17:02:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:38.874+0000 7f5197c00640 1 -- 172.21.15.59:0/131506643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f51901557c0 con 0x7f51901569e0 2024-05-30T17:02:39.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.490+0000 7f518cc00640 1 -- 172.21.15.59:0/131506643 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) ==== 104+0+0 (secure 0 0 0) 0x7f518805bd70 con 0x7f51901569e0 2024-05-30T17:02:39.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.494+0000 7f5197c00640 1 -- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5170069b20 msgr2=0x7f517006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:39.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.494+0000 7f5197c00640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5170069b20 0x7f517006bfe0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f51840011f0 tx=0x7f5184007d40 comp rx=0 tx=0).stop 2024-05-30T17:02:39.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.494+0000 7f5197c00640 1 -- 172.21.15.59:0/131506643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51901569e0 msgr2=0x7f519014a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:39.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.494+0000 7f5197c00640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51901569e0 0x7f519014a410 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f518800c770 tx=0x7f518800cc30 comp rx=0 tx=0).stop 2024-05-30T17:02:39.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.494+0000 7f5197c00640 1 -- 172.21.15.59:0/131506643 shutdown_connections 2024-05-30T17:02:39.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.494+0000 7f5197c00640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5170069b20 0x7f517006bfe0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.494+0000 7f5197c00640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51901569e0 0x7f519014a410 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.494+0000 7f5197c00640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51900d0660 0x7f51900b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.494+0000 7f5197c00640 1 --2- 172.21.15.59:0/131506643 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51900ad2b0 0x7f51901482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.494+0000 7f5197c00640 1 -- 172.21.15.59:0/131506643 >> 172.21.15.59:0/131506643 conn(0x7f519006bdb0 msgr2=0x7f51900b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:39.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.494+0000 7f5197c00640 1 -- 172.21.15.59:0/131506643 shutdown_connections 2024-05-30T17:02:39.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.494+0000 7f5197c00640 1 -- 172.21.15.59:0/131506643 wait complete. 2024-05-30T17:02:39.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T17:02:39.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4fb800640 1 Processor -- start 2024-05-30T17:02:39.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4fb800640 1 -- start start 2024-05-30T17:02:39.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4fb800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe4f406d0d0 0x7fe4f406f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:39.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4fb800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4f40730e0 0x7fe4f406f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:39.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4fb800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f40b3d50 con 0x7fe4f4161e20 2024-05-30T17:02:39.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4fb800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f40b4030 con 0x7fe4f40730e0 2024-05-30T17:02:39.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4fb800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f406e7c0 con 0x7fe4f406d0d0 2024-05-30T17:02:39.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4f9800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4f40730e0 0x7fe4f406f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:39.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4f8e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe4f4161e20 0x7fe4f406c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39188/0 (socket says 172.21.15.59:39188) 2024-05-30T17:02:39.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4f8e00640 1 -- 172.21.15.59:0/1764679405 learned_addr learned my addr 172.21.15.59:0/1764679405 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:39.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4ebe00640 1 --2- 172.21.15.59:0/1764679405 >> v2:172.21.15.107:3300/0 conn(0x7fe4f406d0d0 0x7fe4f406f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:39.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4f9800640 1 -- 172.21.15.59:0/1764679405 >> v2:172.21.15.107:3300/0 conn(0x7fe4f406d0d0 msgr2=0x7fe4f406f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:39.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4f9800640 1 --2- 172.21.15.59:0/1764679405 >> v2:172.21.15.107:3300/0 conn(0x7fe4f406d0d0 0x7fe4f406f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4f9800640 1 -- 172.21.15.59:0/1764679405 >> v1:172.21.15.59:6789/0 conn(0x7fe4f4161e20 legacy=0x7fe4f406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:39.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.710+0000 7fe4f9800640 1 -- 172.21.15.59:0/1764679405 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f406eaa0 con 0x7fe4f40730e0 2024-05-30T17:02:39.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.714+0000 7fe4f9800640 1 --2- 172.21.15.59:0/1764679405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f40730e0 0x7fe4f406f7e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40721a0 tx=0x7fe4ec01f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e4590e5996ef68 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:39.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.714+0000 7fe4f3e00640 1 -- 172.21.15.59:0/1764679405 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0b4070 con 0x7fe4f40730e0 2024-05-30T17:02:39.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.714+0000 7fe4f3e00640 1 -- 172.21.15.59:0/1764679405 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4ec0af600 con 0x7fe4f40730e0 2024-05-30T17:02:39.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.714+0000 7fe4f3e00640 1 -- 172.21.15.59:0/1764679405 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0af9d0 con 0x7fe4f40730e0 2024-05-30T17:02:39.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.714+0000 7fe4fb800640 1 -- 172.21.15.59:0/1764679405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f40730e0 msgr2=0x7fe4f406f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:39.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.714+0000 7fe4fb800640 1 --2- 172.21.15.59:0/1764679405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f40730e0 0x7fe4f406f7e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40721a0 tx=0x7fe4ec01f110 comp rx=0 tx=0).stop 2024-05-30T17:02:39.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.714+0000 7fe4fb800640 1 -- 172.21.15.59:0/1764679405 shutdown_connections 2024-05-30T17:02:39.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.714+0000 7fe4fb800640 1 --2- 172.21.15.59:0/1764679405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f40730e0 0x7fe4f406f7e0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.714+0000 7fe4fb800640 1 --2- 172.21.15.59:0/1764679405 >> v2:172.21.15.107:3300/0 conn(0x7fe4f406d0d0 0x7fe4f406f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.714+0000 7fe4fb800640 1 -- 172.21.15.59:0/1764679405 >> 172.21.15.59:0/1764679405 conn(0x7fe4f40725c0 msgr2=0x7fe4f40729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:39.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.714+0000 7fe4fb800640 1 -- 172.21.15.59:0/1764679405 shutdown_connections 2024-05-30T17:02:39.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.714+0000 7fe4fb800640 1 -- 172.21.15.59:0/1764679405 wait complete. 2024-05-30T17:02:39.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4fb800640 1 Processor -- start 2024-05-30T17:02:39.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4fb800640 1 -- start start 2024-05-30T17:02:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4fb800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f406d0d0 0x7fe4f4157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4fb800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f40730e0 0x7fe4f4154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4fb800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4161e20 0x7fe4f4155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4fb800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f40d0820 con 0x7fe4f4161e20 2024-05-30T17:02:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4fb800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f40b3a20 con 0x7fe4f406d0d0 2024-05-30T17:02:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4fb800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f40cd0d0 con 0x7fe4f40730e0 2024-05-30T17:02:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4161e20 0x7fe4f4155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4161e20 0x7fe4f4155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51944/0 (socket says 172.21.15.59:51944) 2024-05-30T17:02:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f9800640 1 -- 172.21.15.59:0/3501169739 learned_addr learned my addr 172.21.15.59:0/3501169739 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4ebe00640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f40730e0 0x7fe4f4154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f8e00640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f406d0d0 0x7fe4f4157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f9800640 1 -- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f40730e0 msgr2=0x7fe4f4154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f9800640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f40730e0 0x7fe4f4154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f9800640 1 -- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f406d0d0 msgr2=0x7fe4f4157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:39.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f9800640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f406d0d0 0x7fe4f4157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f9800640 1 -- 172.21.15.59:0/3501169739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f41562f0 con 0x7fe4f4161e20 2024-05-30T17:02:39.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4ebe00640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f40730e0 0x7fe4f4154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:39.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f8e00640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f406d0d0 0x7fe4f4157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:39.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f9800640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4161e20 0x7fe4f4155db0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0b2040 tx=0x7fe4ec01beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:39.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f1600640 1 -- 172.21.15.59:0/3501169739 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0b4040 con 0x7fe4f4161e20 2024-05-30T17:02:39.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f1600640 1 -- 172.21.15.59:0/3501169739 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4ec0c1070 con 0x7fe4f4161e20 2024-05-30T17:02:39.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4fb800640 1 -- 172.21.15.59:0/3501169739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f4156590 con 0x7fe4f4161e20 2024-05-30T17:02:39.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4f1600640 1 -- 172.21.15.59:0/3501169739 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec009450 con 0x7fe4f4161e20 2024-05-30T17:02:39.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.718+0000 7fe4fb800640 1 -- 172.21.15.59:0/3501169739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f4156b50 con 0x7fe4f4161e20 2024-05-30T17:02:39.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.722+0000 7fe4fb800640 1 -- 172.21.15.59:0/3501169739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f4068a90 con 0x7fe4f4161e20 2024-05-30T17:02:39.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.722+0000 7fe4f1600640 1 -- 172.21.15.59:0/3501169739 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fe4ec0ba6b0 con 0x7fe4f4161e20 2024-05-30T17:02:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.722+0000 7fe4f1600640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe4d0069b20 0x7fe4d006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.722+0000 7fe4f1600640 1 -- 172.21.15.59:0/3501169739 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5935+0+0 (secure 0 0 0) 0x7fe4ec1241f0 con 0x7fe4f4161e20 2024-05-30T17:02:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.722+0000 7fe4f8e00640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe4d0069b20 0x7fe4d006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.722+0000 7fe4f8e00640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe4d0069b20 0x7fe4d006bfe0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4000f70 tx=0x7fe4e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:39.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.726+0000 7fe4f1600640 1 -- 172.21.15.59:0/3501169739 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4ec018c70 con 0x7fe4f4161e20 2024-05-30T17:02:39.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.894+0000 7fe4fb800640 1 -- 172.21.15.59:0/3501169739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe4f40678a0 con 0x7fe4f4161e20 2024-05-30T17:02:39.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.974+0000 7fe4f1600640 1 -- 172.21.15.59:0/3501169739 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v107) ==== 181+0+0 (secure 0 0 0) 0x7fe4ec0f6210 con 0x7fe4f4161e20 2024-05-30T17:02:39.978 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-05-30T17:02:39.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.978+0000 7fe4fb800640 1 -- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe4d0069b20 msgr2=0x7fe4d006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:39.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.978+0000 7fe4fb800640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe4d0069b20 0x7fe4d006bfe0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4000f70 tx=0x7fe4e4009040 comp rx=0 tx=0).stop 2024-05-30T17:02:39.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.978+0000 7fe4fb800640 1 -- 172.21.15.59:0/3501169739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4161e20 msgr2=0x7fe4f4155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:39.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.978+0000 7fe4fb800640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4161e20 0x7fe4f4155db0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0b2040 tx=0x7fe4ec01beb0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.978+0000 7fe4fb800640 1 -- 172.21.15.59:0/3501169739 shutdown_connections 2024-05-30T17:02:39.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.978+0000 7fe4fb800640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe4d0069b20 0x7fe4d006bfe0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.978+0000 7fe4fb800640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4161e20 0x7fe4f4155db0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.978+0000 7fe4fb800640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f40730e0 0x7fe4f4154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.978+0000 7fe4fb800640 1 --2- 172.21.15.59:0/3501169739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f406d0d0 0x7fe4f4157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:39.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.978+0000 7fe4fb800640 1 -- 172.21.15.59:0/3501169739 >> 172.21.15.59:0/3501169739 conn(0x7fe4f40725c0 msgr2=0x7fe4f40729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:39.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.978+0000 7fe4fb800640 1 -- 172.21.15.59:0/3501169739 shutdown_connections 2024-05-30T17:02:39.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:39.978+0000 7fe4fb800640 1 -- 172.21.15.59:0/3501169739 wait complete. 2024-05-30T17:02:40.002 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T17:02:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.142+0000 7f1662800640 1 Processor -- start 2024-05-30T17:02:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.142+0000 7f1662800640 1 -- start start 2024-05-30T17:02:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f1662800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f165c0af570 0x7f165c0afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f1662800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165c0b42f0 con 0x7f165c15e830 2024-05-30T17:02:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f1662800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165c0b45d0 con 0x7f165c0b2a50 2024-05-30T17:02:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f1662800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f165c0b64e0 con 0x7f165c0af570 2024-05-30T17:02:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f165b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f165c15e830 0x7f165c0b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39192/0 (socket says 172.21.15.59:39192) 2024-05-30T17:02:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f165b400640 1 -- 172.21.15.59:0/3799167555 learned_addr learned my addr 172.21.15.59:0/3799167555 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f165be00640 1 --2- 172.21.15.59:0/3799167555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f165c0af570 0x7f165c0afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f165aa00640 1 -- 172.21.15.59:0/3799167555 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 477434449 0 0) 0x7f165c0b42f0 con 0x7f165c15e830 2024-05-30T17:02:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f165aa00640 1 -- 172.21.15.59:0/3799167555 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1640003530 con 0x7f165c15e830 2024-05-30T17:02:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f165aa00640 1 -- 172.21.15.59:0/3799167555 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1373892938 0 0) 0x7f165c0b45d0 con 0x7f165c0b2a50 2024-05-30T17:02:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f165aa00640 1 -- 172.21.15.59:0/3799167555 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f165c0b42f0 con 0x7f165c0b2a50 2024-05-30T17:02:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f165be00640 1 -- 172.21.15.59:0/3799167555 >> v1:172.21.15.107:6789/0 conn(0x7f165c0b2a50 legacy=0x7f165c0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:40.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f165be00640 1 -- 172.21.15.59:0/3799167555 >> v1:172.21.15.59:6789/0 conn(0x7f165c15e830 legacy=0x7f165c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:40.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f165aa00640 1 -- 172.21.15.59:0/3799167555 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1287101286 0 0) 0x7f1640003530 con 0x7f165c15e830 2024-05-30T17:02:40.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.146+0000 7f165be00640 1 -- 172.21.15.59:0/3799167555 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c0aed70 con 0x7f165c0af570 2024-05-30T17:02:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f165be00640 1 --2- 172.21.15.59:0/3799167555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f165c0af570 0x7f165c0afa00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1654009dc0 tx=0x7f165401c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc3e35117f26bdf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f165aa00640 1 -- 172.21.15.59:0/3799167555 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540b2070 con 0x7f165c0af570 2024-05-30T17:02:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f165aa00640 1 -- 172.21.15.59:0/3799167555 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16540a5570 con 0x7f165c0af570 2024-05-30T17:02:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f165aa00640 1 -- 172.21.15.59:0/3799167555 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c001680 con 0x7f165c0af570 2024-05-30T17:02:40.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f1662800640 1 -- 172.21.15.59:0/3799167555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f165c0af570 msgr2=0x7f165c0afa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:40.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f1662800640 1 --2- 172.21.15.59:0/3799167555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f165c0af570 0x7f165c0afa00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1654009dc0 tx=0x7f165401c820 comp rx=0 tx=0).stop 2024-05-30T17:02:40.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f1662800640 1 -- 172.21.15.59:0/3799167555 shutdown_connections 2024-05-30T17:02:40.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f1662800640 1 --2- 172.21.15.59:0/3799167555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f165c0af570 0x7f165c0afa00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:40.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f1662800640 1 -- 172.21.15.59:0/3799167555 >> 172.21.15.59:0/3799167555 conn(0x7f165c0b6770 msgr2=0x7f165c0b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:40.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f1662800640 1 -- 172.21.15.59:0/3799167555 shutdown_connections 2024-05-30T17:02:40.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f1662800640 1 -- 172.21.15.59:0/3799167555 wait complete. 2024-05-30T17:02:40.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f1662800640 1 Processor -- start 2024-05-30T17:02:40.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.150+0000 7f1662800640 1 -- start start 2024-05-30T17:02:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1662800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f165c0af570 0x7f165c160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1662800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f165c0b2a50 0x7f165c070550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1662800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f165c15e830 0x7f165c13f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1662800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f165c16c430 con 0x7f165c15e830 2024-05-30T17:02:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1662800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f165c15ec10 con 0x7f165c0af570 2024-05-30T17:02:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1662800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f165c16c5b0 con 0x7f165c0b2a50 2024-05-30T17:02:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f165be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f165c15e830 0x7f165c13f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f165be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f165c15e830 0x7f165c13f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51954/0 (socket says 172.21.15.59:51954) 2024-05-30T17:02:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f165be00640 1 -- 172.21.15.59:0/2961393842 learned_addr learned my addr 172.21.15.59:0/2961393842 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1653e00640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f165c0b2a50 0x7f165c070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f165b400640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f165c0af570 0x7f165c160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f165be00640 1 -- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f165c0b2a50 msgr2=0x7f165c070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f165be00640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f165c0b2a50 0x7f165c070550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f165be00640 1 -- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f165c0af570 msgr2=0x7f165c160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f165be00640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f165c0af570 0x7f165c160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f165be00640 1 -- 172.21.15.59:0/2961393842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c159460 con 0x7f165c15e830 2024-05-30T17:02:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f165b400640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f165c0af570 0x7f165c160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f165be00640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f165c15e830 0x7f165c13f950 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f165401a450 tx=0x7f16540195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1653400640 1 -- 172.21.15.59:0/2961393842 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540bd020 con 0x7f165c15e830 2024-05-30T17:02:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1653400640 1 -- 172.21.15.59:0/2961393842 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16540b8470 con 0x7f165c15e830 2024-05-30T17:02:40.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1653400640 1 -- 172.21.15.59:0/2961393842 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540b2040 con 0x7f165c15e830 2024-05-30T17:02:40.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1662800640 1 -- 172.21.15.59:0/2961393842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165c159740 con 0x7f165c15e830 2024-05-30T17:02:40.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1662800640 1 -- 172.21.15.59:0/2961393842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f165c159d00 con 0x7f165c15e830 2024-05-30T17:02:40.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.154+0000 7f1662800640 1 -- 172.21.15.59:0/2961393842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165c068a90 con 0x7f165c15e830 2024-05-30T17:02:40.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.158+0000 7f1653400640 1 -- 172.21.15.59:0/2961393842 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f16540c0020 con 0x7f165c15e830 2024-05-30T17:02:40.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.158+0000 7f1653400640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1638069b50 0x7f163806c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:40.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.158+0000 7f1653400640 1 -- 172.21.15.59:0/2961393842 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5497+0+0 (secure 0 0 0) 0x7f1654120000 con 0x7f165c15e830 2024-05-30T17:02:40.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.158+0000 7f165b400640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1638069b50 0x7f163806c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:40.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.158+0000 7f165b400640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1638069b50 0x7f163806c010 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f164c001000 tx=0x7f164c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:40.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.162+0000 7f1653400640 1 -- 172.21.15.59:0/2961393842 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f16540c7070 con 0x7f165c15e830 2024-05-30T17:02:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.330+0000 7f1662800640 1 -- 172.21.15.59:0/2961393842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f165c0b0350 con 0x7f165c15e830 2024-05-30T17:02:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.978+0000 7f1653400640 1 -- 172.21.15.59:0/2961393842 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v108) ==== 169+0+0 (secure 0 0 0) 0x7f16540164a0 con 0x7f165c15e830 2024-05-30T17:02:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-05-30T17:02:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.982+0000 7f1662800640 1 -- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1638069b50 msgr2=0x7f163806c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.982+0000 7f1662800640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1638069b50 0x7f163806c010 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f164c001000 tx=0x7f164c009040 comp rx=0 tx=0).stop 2024-05-30T17:02:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.982+0000 7f1662800640 1 -- 172.21.15.59:0/2961393842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f165c15e830 msgr2=0x7f165c13f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.982+0000 7f1662800640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f165c15e830 0x7f165c13f950 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f165401a450 tx=0x7f16540195c0 comp rx=0 tx=0).stop 2024-05-30T17:02:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.982+0000 7f1662800640 1 -- 172.21.15.59:0/2961393842 shutdown_connections 2024-05-30T17:02:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.982+0000 7f1662800640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1638069b50 0x7f163806c010 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.982+0000 7f1662800640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f165c15e830 0x7f165c13f950 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.982+0000 7f1662800640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f165c0b2a50 0x7f165c070550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.982+0000 7f1662800640 1 --2- 172.21.15.59:0/2961393842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f165c0af570 0x7f165c160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.982+0000 7f1662800640 1 -- 172.21.15.59:0/2961393842 >> 172.21.15.59:0/2961393842 conn(0x7f165c0b6770 msgr2=0x7f165c06f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.982+0000 7f1662800640 1 -- 172.21.15.59:0/2961393842 shutdown_connections 2024-05-30T17:02:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:40.982+0000 7f1662800640 1 -- 172.21.15.59:0/2961393842 wait complete. 2024-05-30T17:02:41.018 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T17:02:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5994800640 1 Processor -- start 2024-05-30T17:02:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5994800640 1 -- start start 2024-05-30T17:02:41.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5994800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f598c0ad2b0 0x7f598c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:41.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5994800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f598c0d0660 0x7f598c0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:41.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5994800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f598c0ad770 con 0x7f598c1569e0 2024-05-30T17:02:41.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5994800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f598c0d1010 con 0x7f598c0ad2b0 2024-05-30T17:02:41.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5994800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f598c15cb40 con 0x7f598c0d0660 2024-05-30T17:02:41.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5991400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f598c0ad2b0 0x7f598c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:41.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5991e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f598c1569e0 0x7f598c0cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39196/0 (socket says 172.21.15.59:39196) 2024-05-30T17:02:41.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5991e00640 1 -- 172.21.15.59:0/2964496365 learned_addr learned my addr 172.21.15.59:0/2964496365 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:41.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5992800640 1 --2- 172.21.15.59:0/2964496365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f598c0d0660 0x7f598c0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5991400640 1 -- 172.21.15.59:0/2964496365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f598c0d0660 msgr2=0x7f598c0d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5991400640 1 --2- 172.21.15.59:0/2964496365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f598c0d0660 0x7f598c0d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5991400640 1 -- 172.21.15.59:0/2964496365 >> v1:172.21.15.59:6789/0 conn(0x7f598c1569e0 legacy=0x7f598c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5991400640 1 -- 172.21.15.59:0/2964496365 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598c15ce20 con 0x7f598c0ad2b0 2024-05-30T17:02:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5992800640 1 --2- 172.21.15.59:0/2964496365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f598c0d0660 0x7f598c0d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.174+0000 7f5990a00640 1 -- 172.21.15.59:0/2964496365 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134486775 0 0) 0x7f598c0ad770 con 0x7f598c1569e0 2024-05-30T17:02:41.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.178+0000 7f5991400640 1 --2- 172.21.15.59:0/2964496365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f598c0ad2b0 0x7f598c15d620 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f597c0097c0 tx=0x7f597c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e7b857fc50ab9c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:41.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.178+0000 7f5990a00640 1 -- 172.21.15.59:0/2964496365 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c0b0070 con 0x7f598c0ad2b0 2024-05-30T17:02:41.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.178+0000 7f5990a00640 1 -- 172.21.15.59:0/2964496365 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597c0ab600 con 0x7f598c0ad2b0 2024-05-30T17:02:41.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.178+0000 7f5990a00640 1 -- 172.21.15.59:0/2964496365 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c0ab9d0 con 0x7f598c0ad2b0 2024-05-30T17:02:41.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.178+0000 7f5994800640 1 -- 172.21.15.59:0/2964496365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f598c0ad2b0 msgr2=0x7f598c15d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:41.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.178+0000 7f5994800640 1 --2- 172.21.15.59:0/2964496365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f598c0ad2b0 0x7f598c15d620 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f597c0097c0 tx=0x7f597c01c410 comp rx=0 tx=0).stop 2024-05-30T17:02:41.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.178+0000 7f5994800640 1 -- 172.21.15.59:0/2964496365 shutdown_connections 2024-05-30T17:02:41.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.178+0000 7f5994800640 1 --2- 172.21.15.59:0/2964496365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f598c0d0660 0x7f598c0d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.178+0000 7f5994800640 1 --2- 172.21.15.59:0/2964496365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f598c0ad2b0 0x7f598c15d620 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.178+0000 7f5994800640 1 -- 172.21.15.59:0/2964496365 >> 172.21.15.59:0/2964496365 conn(0x7f598c06bdb0 msgr2=0x7f598c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:41.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.178+0000 7f5994800640 1 -- 172.21.15.59:0/2964496365 shutdown_connections 2024-05-30T17:02:41.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.178+0000 7f5994800640 1 -- 172.21.15.59:0/2964496365 wait complete. 2024-05-30T17:02:41.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5994800640 1 Processor -- start 2024-05-30T17:02:41.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5994800640 1 -- start start 2024-05-30T17:02:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5994800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f598c0ad2b0 0x7f598c099830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5994800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f598c0d0660 0x7f598c1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5994800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f598c1569e0 0x7f598c151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5994800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f598c0b3c60 con 0x7f598c0d0660 2024-05-30T17:02:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5994800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f598c0b3ae0 con 0x7f598c0ad2b0 2024-05-30T17:02:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5994800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f598c0b3de0 con 0x7f598c1569e0 2024-05-30T17:02:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5991400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f598c0d0660 0x7f598c1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5991400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f598c0d0660 0x7f598c1514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51976/0 (socket says 172.21.15.59:51976) 2024-05-30T17:02:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5991400640 1 -- 172.21.15.59:0/2098064144 learned_addr learned my addr 172.21.15.59:0/2098064144 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5992800640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f598c1569e0 0x7f598c151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5991e00640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f598c0ad2b0 0x7f598c099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5991400640 1 -- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f598c1569e0 msgr2=0x7f598c151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5991400640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f598c1569e0 0x7f598c151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5991400640 1 -- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f598c0ad2b0 msgr2=0x7f598c099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5991400640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f598c0ad2b0 0x7f598c099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5991400640 1 -- 172.21.15.59:0/2098064144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598c09d900 con 0x7f598c0d0660 2024-05-30T17:02:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5991400640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f598c0d0660 0x7f598c1514d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f597c01a040 tx=0x7f597c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:41.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5986000640 1 -- 172.21.15.59:0/2098064144 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c0b0050 con 0x7f598c0d0660 2024-05-30T17:02:41.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5986000640 1 -- 172.21.15.59:0/2098064144 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597c0bc070 con 0x7f598c0d0660 2024-05-30T17:02:41.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5986000640 1 -- 172.21.15.59:0/2098064144 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c0b5850 con 0x7f598c0d0660 2024-05-30T17:02:41.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5994800640 1 -- 172.21.15.59:0/2098064144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f598c09dbe0 con 0x7f598c0d0660 2024-05-30T17:02:41.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.182+0000 7f5994800640 1 -- 172.21.15.59:0/2098064144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f598c09e1a0 con 0x7f598c0d0660 2024-05-30T17:02:41.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.186+0000 7f5994800640 1 -- 172.21.15.59:0/2098064144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f598c068a90 con 0x7f598c0d0660 2024-05-30T17:02:41.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.186+0000 7f5986000640 1 -- 172.21.15.59:0/2098064144 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f597c0b59f0 con 0x7f598c0d0660 2024-05-30T17:02:41.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.186+0000 7f5986000640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5970069b20 0x7f597006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:41.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.186+0000 7f5986000640 1 -- 172.21.15.59:0/2098064144 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5055+0+0 (secure 0 0 0) 0x7f597c11ff60 con 0x7f598c0d0660 2024-05-30T17:02:41.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.186+0000 7f5991e00640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5970069b20 0x7f597006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:41.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.186+0000 7f5991e00640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5970069b20 0x7f597006bfe0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5980007fd0 tx=0x7f5980007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:41.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.190+0000 7f5986000640 1 -- 172.21.15.59:0/2098064144 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f597c016090 con 0x7f598c0d0660 2024-05-30T17:02:41.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.358+0000 7f5994800640 1 -- 172.21.15.59:0/2098064144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f598c155710 con 0x7f598c0d0660 2024-05-30T17:02:41.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.362+0000 7f5986000640 1 -- 172.21.15.59:0/2098064144 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7f597c0f1a50 con 0x7f598c0d0660 2024-05-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.366+0000 7f5994800640 1 -- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5970069b20 msgr2=0x7f597006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.366+0000 7f5994800640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5970069b20 0x7f597006bfe0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5980007fd0 tx=0x7f5980007d60 comp rx=0 tx=0).stop 2024-05-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.366+0000 7f5994800640 1 -- 172.21.15.59:0/2098064144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f598c0d0660 msgr2=0x7f598c1514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.366+0000 7f5994800640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f598c0d0660 0x7f598c1514d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f597c01a040 tx=0x7f597c01ac50 comp rx=0 tx=0).stop 2024-05-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.366+0000 7f5994800640 1 -- 172.21.15.59:0/2098064144 shutdown_connections 2024-05-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.366+0000 7f5994800640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5970069b20 0x7f597006bfe0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.366+0000 7f5994800640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f598c1569e0 0x7f598c151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.366+0000 7f5994800640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f598c0d0660 0x7f598c1514d0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.366+0000 7f5994800640 1 --2- 172.21.15.59:0/2098064144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f598c0ad2b0 0x7f598c099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.366+0000 7f5994800640 1 -- 172.21.15.59:0/2098064144 >> 172.21.15.59:0/2098064144 conn(0x7f598c06bdb0 msgr2=0x7f598c15b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.366+0000 7f5994800640 1 -- 172.21.15.59:0/2098064144 shutdown_connections 2024-05-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.366+0000 7f5994800640 1 -- 172.21.15.59:0/2098064144 wait complete. 2024-05-30T17:02:41.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_1_clone_is_cancelled' 2024-05-30T17:02:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f7200640 1 Processor -- start 2024-05-30T17:02:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f7200640 1 -- start start 2024-05-30T17:02:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f7200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4f815b5c0 0x7fe4f80709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f80d0a70 0x7fe4f80b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f7200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f8070ee0 con 0x7fe4f80732e0 2024-05-30T17:02:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f7200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f80b4c60 con 0x7fe4f815b5c0 2024-05-30T17:02:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f806f050 con 0x7fe4f80d0a70 2024-05-30T17:02:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f5e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4f815b5c0 0x7fe4f80709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f5e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4f815b5c0 0x7fe4f80709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51986/0 (socket says 172.21.15.59:51986) 2024-05-30T17:02:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f5e00640 1 -- 172.21.15.59:0/3907085175 learned_addr learned my addr 172.21.15.59:0/3907085175 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:41.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f5e00640 1 -- 172.21.15.59:0/3907085175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f80d0a70 msgr2=0x7fe4f80b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:41.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f5e00640 1 --2- 172.21.15.59:0/3907085175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f80d0a70 0x7fe4f80b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f5e00640 1 -- 172.21.15.59:0/3907085175 >> v1:172.21.15.107:6789/0 conn(0x7fe4f80732e0 legacy=0x7fe4f80d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:41.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.526+0000 7fe4f5e00640 1 -- 172.21.15.59:0/3907085175 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f806f330 con 0x7fe4f815b5c0 2024-05-30T17:02:41.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f5e00640 1 --2- 172.21.15.59:0/3907085175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f815b5c0 0x7fe4f80709a0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800bb10 tx=0x7fe4e801ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e284abbf5f6747 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f4a00640 1 -- 172.21.15.59:0/3907085175 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80b4070 con 0x7fe4f815b5c0 2024-05-30T17:02:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f4a00640 1 -- 172.21.15.59:0/3907085175 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e80a78a0 con 0x7fe4f815b5c0 2024-05-30T17:02:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f4a00640 1 -- 172.21.15.59:0/3907085175 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80a7c70 con 0x7fe4f815b5c0 2024-05-30T17:02:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f7200640 1 -- 172.21.15.59:0/3907085175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f815b5c0 msgr2=0x7fe4f80709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f7200640 1 --2- 172.21.15.59:0/3907085175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f815b5c0 0x7fe4f80709a0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800bb10 tx=0x7fe4e801ea10 comp rx=0 tx=0).stop 2024-05-30T17:02:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f7200640 1 -- 172.21.15.59:0/3907085175 shutdown_connections 2024-05-30T17:02:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f7200640 1 --2- 172.21.15.59:0/3907085175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f80d0a70 0x7fe4f80b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f7200640 1 --2- 172.21.15.59:0/3907085175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f815b5c0 0x7fe4f80709a0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f7200640 1 -- 172.21.15.59:0/3907085175 >> 172.21.15.59:0/3907085175 conn(0x7fe4f80b6990 msgr2=0x7fe4f80b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f7200640 1 -- 172.21.15.59:0/3907085175 shutdown_connections 2024-05-30T17:02:41.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f7200640 1 -- 172.21.15.59:0/3907085175 wait complete. 2024-05-30T17:02:41.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f7200640 1 Processor -- start 2024-05-30T17:02:41.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.530+0000 7fe4f7200640 1 -- start start 2024-05-30T17:02:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f80732e0 0x7fe4f80b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f80d0a70 0x7fe4f815bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f815b5c0 0x7fe4f81584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f815bb20 con 0x7fe4f80732e0 2024-05-30T17:02:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f815b9a0 con 0x7fe4f815b5c0 2024-05-30T17:02:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f80b6400 con 0x7fe4f80d0a70 2024-05-30T17:02:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f80732e0 0x7fe4f80b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f80732e0 0x7fe4f80b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51996/0 (socket says 172.21.15.59:51996) 2024-05-30T17:02:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f5e00640 1 -- 172.21.15.59:0/1624901734 learned_addr learned my addr 172.21.15.59:0/1624901734 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f5e00640 1 -- 172.21.15.59:0/1624901734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f80d0a70 msgr2=0x7fe4f815bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f5e00640 1 --2- 172.21.15.59:0/1624901734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f80d0a70 0x7fe4f815bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f5e00640 1 -- 172.21.15.59:0/1624901734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f815b5c0 msgr2=0x7fe4f81584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f5e00640 1 --2- 172.21.15.59:0/1624901734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f815b5c0 0x7fe4f81584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f5e00640 1 -- 172.21.15.59:0/1624901734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f80ae860 con 0x7fe4f80732e0 2024-05-30T17:02:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f5e00640 1 --2- 172.21.15.59:0/1624901734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f80732e0 0x7fe4f80b0510 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800b2c0 tx=0x7fe4e801b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4ee000640 1 -- 172.21.15.59:0/1624901734 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80b4040 con 0x7fe4f80732e0 2024-05-30T17:02:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4ee000640 1 -- 172.21.15.59:0/1624901734 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e80c1070 con 0x7fe4f80732e0 2024-05-30T17:02:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4ee000640 1 -- 172.21.15.59:0/1624901734 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80af940 con 0x7fe4f80732e0 2024-05-30T17:02:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f7200640 1 -- 172.21.15.59:0/1624901734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f815cb70 con 0x7fe4f80732e0 2024-05-30T17:02:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f7200640 1 -- 172.21.15.59:0/1624901734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f815c5b0 con 0x7fe4f80732e0 2024-05-30T17:02:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.534+0000 7fe4f7200640 1 -- 172.21.15.59:0/1624901734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f80aea30 con 0x7fe4f80732e0 2024-05-30T17:02:41.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.538+0000 7fe4ee000640 1 -- 172.21.15.59:0/1624901734 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fe4e80b7070 con 0x7fe4f80732e0 2024-05-30T17:02:41.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.538+0000 7fe4ee000640 1 --2- 172.21.15.59:0/1624901734 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe4d8069b20 0x7fe4d806bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:41.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.538+0000 7fe4ee000640 1 -- 172.21.15.59:0/1624901734 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5055+0+0 (secure 0 0 0) 0x7fe4e81222c0 con 0x7fe4f80732e0 2024-05-30T17:02:41.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.538+0000 7fe4f5400640 1 --2- 172.21.15.59:0/1624901734 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe4d8069b20 0x7fe4d806bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:41.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.538+0000 7fe4f5400640 1 --2- 172.21.15.59:0/1624901734 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe4d8069b20 0x7fe4d806bfe0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4007fd0 tx=0x7fe4e40079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.542+0000 7fe4ee000640 1 -- 172.21.15.59:0/1624901734 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4f8070ee0 con 0x7fe4f80732e0 2024-05-30T17:02:41.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.766+0000 7fe4f7200640 1 -- 172.21.15.59:0/1624901734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_1_clone_is_cancelled"]} v 0) -- 0x7fe4f80691a0 con 0x7fe4f80732e0 2024-05-30T17:02:41.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.982+0000 7fe4ee000640 1 -- 172.21.15.59:0/1624901734 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_1_clone_is_cancelled"]}]=0 v618) ==== 161+0+0 (secure 0 0 0) 0x7fe4e80f4400 con 0x7fe4f80732e0 2024-05-30T17:02:41.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.986+0000 7fe4f7200640 1 -- 172.21.15.59:0/1624901734 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe4d8069b20 msgr2=0x7fe4d806bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:41.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.986+0000 7fe4f7200640 1 --2- 172.21.15.59:0/1624901734 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe4d8069b20 0x7fe4d806bfe0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4007fd0 tx=0x7fe4e40079a0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.986+0000 7fe4f7200640 1 -- 172.21.15.59:0/1624901734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f80732e0 msgr2=0x7fe4f80b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.986+0000 7fe4f7200640 1 --2- 172.21.15.59:0/1624901734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f80732e0 0x7fe4f80b0510 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800b2c0 tx=0x7fe4e801b7b0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.986+0000 7fe4f7200640 1 -- 172.21.15.59:0/1624901734 shutdown_connections 2024-05-30T17:02:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.986+0000 7fe4f7200640 1 --2- 172.21.15.59:0/1624901734 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe4d8069b20 0x7fe4d806bfe0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.986+0000 7fe4f7200640 1 --2- 172.21.15.59:0/1624901734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f815b5c0 0x7fe4f81584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.986+0000 7fe4f7200640 1 --2- 172.21.15.59:0/1624901734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4f80d0a70 0x7fe4f815bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.986+0000 7fe4f7200640 1 --2- 172.21.15.59:0/1624901734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f80732e0 0x7fe4f80b0510 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.986+0000 7fe4f7200640 1 -- 172.21.15.59:0/1624901734 >> 172.21.15.59:0/1624901734 conn(0x7fe4f80b6990 msgr2=0x7fe4f815a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.986+0000 7fe4f7200640 1 -- 172.21.15.59:0/1624901734 shutdown_connections 2024-05-30T17:02:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:41.986+0000 7fe4f7200640 1 -- 172.21.15.59:0/1624901734 wait complete. 2024-05-30T17:02:42.009 INFO:tasks.cephfs_test_runner:Test that the progress bar, that is printed for 1 ongoing clone job, is ... ok 2024-05-30T17:02:42.010 INFO:tasks.cephfs_test_runner:Starting test: test_when_3_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that progress bars, that printed for 3 ongoing clone jobs, are 2024-05-30T17:02:42.010 INFO:tasks.cephfs_test_runner:test_when_3_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T17:02:42.010 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:02:42.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.146+0000 7f849a600640 1 Processor -- start 2024-05-30T17:02:42.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.146+0000 7f849a600640 1 -- start start 2024-05-30T17:02:42.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.150+0000 7f849a600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8494073bb0 0x7f849415ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.150+0000 7f849a600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f849415f3b0 con 0x7f84940cfe20 2024-05-30T17:02:42.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.150+0000 7f849a600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f849415f690 con 0x7f84940cfa40 2024-05-30T17:02:42.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.150+0000 7f849a600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f849415f970 con 0x7f8494073bb0 2024-05-30T17:02:42.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.150+0000 7f848be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f84940cfe20 0x7f8494072060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43642/0 (socket says 172.21.15.59:43642) 2024-05-30T17:02:42.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.150+0000 7f848be00640 1 -- 172.21.15.59:0/1106163153 learned_addr learned my addr 172.21.15.59:0/1106163153 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:42.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.150+0000 7f8493e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8494073bb0 0x7f849415ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.150+0000 7f8493e00640 1 -- 172.21.15.59:0/1106163153 >> v1:172.21.15.107:6789/0 conn(0x7f84940cfa40 legacy=0x7f84940b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:42.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.150+0000 7f8493e00640 1 -- 172.21.15.59:0/1106163153 >> v1:172.21.15.59:6789/0 conn(0x7f84940cfe20 legacy=0x7f8494072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.150+0000 7f8493e00640 1 -- 172.21.15.59:0/1106163153 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84940b3370 con 0x7f8494073bb0 2024-05-30T17:02:42.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.150+0000 7f8492a00640 1 -- 172.21.15.59:0/1106163153 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94261195 0 0) 0x7f849415f3b0 con 0x7f84940cfe20 2024-05-30T17:02:42.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f8493e00640 1 --2- 172.21.15.59:0/1106163153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8494073bb0 0x7f849415ecb0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f848c009d90 tx=0x7f848c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b9d3191cc1354 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:42.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f8492a00640 1 -- 172.21.15.59:0/1106163153 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0b2070 con 0x7f8494073bb0 2024-05-30T17:02:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f8492a00640 1 -- 172.21.15.59:0/1106163153 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848c0a5900 con 0x7f8494073bb0 2024-05-30T17:02:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f8492a00640 1 -- 172.21.15.59:0/1106163153 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0a5cd0 con 0x7f8494073bb0 2024-05-30T17:02:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 -- 172.21.15.59:0/1106163153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8494073bb0 msgr2=0x7f849415ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 --2- 172.21.15.59:0/1106163153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8494073bb0 0x7f849415ecb0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f848c009d90 tx=0x7f848c01c930 comp rx=0 tx=0).stop 2024-05-30T17:02:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 -- 172.21.15.59:0/1106163153 shutdown_connections 2024-05-30T17:02:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 --2- 172.21.15.59:0/1106163153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8494073bb0 0x7f849415ecb0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 -- 172.21.15.59:0/1106163153 >> 172.21.15.59:0/1106163153 conn(0x7f84940b22d0 msgr2=0x7f84940b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 -- 172.21.15.59:0/1106163153 shutdown_connections 2024-05-30T17:02:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 -- 172.21.15.59:0/1106163153 wait complete. 2024-05-30T17:02:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 Processor -- start 2024-05-30T17:02:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 -- start start 2024-05-30T17:02:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8494073bb0 0x7f849414b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84940cfa40 0x7f8494146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84940cfe20 0x7f8494147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8494154fc0 con 0x7f84940cfe20 2024-05-30T17:02:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8494154e40 con 0x7f8494073bb0 2024-05-30T17:02:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f849a600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8494155140 con 0x7f84940cfa40 2024-05-30T17:02:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f8493e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84940cfe20 0x7f8494147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f8493e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84940cfe20 0x7f8494147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38184/0 (socket says 172.21.15.59:38184) 2024-05-30T17:02:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.154+0000 7f8493e00640 1 -- 172.21.15.59:0/4009853446 learned_addr learned my addr 172.21.15.59:0/4009853446 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f8493400640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8494073bb0 0x7f849414b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f848be00640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84940cfa40 0x7f8494146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f8493e00640 1 -- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84940cfa40 msgr2=0x7f8494146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f8493e00640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84940cfa40 0x7f8494146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f8493e00640 1 -- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8494073bb0 msgr2=0x7f849414b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f8493e00640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8494073bb0 0x7f849414b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f8493e00640 1 -- 172.21.15.59:0/4009853446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849414a600 con 0x7f84940cfe20 2024-05-30T17:02:42.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f8493e00640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84940cfe20 0x7f8494147180 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f848c0b0040 tx=0x7f848c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f848b400640 1 -- 172.21.15.59:0/4009853446 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0b2040 con 0x7f84940cfe20 2024-05-30T17:02:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f848b400640 1 -- 172.21.15.59:0/4009853446 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848c0bf070 con 0x7f84940cfe20 2024-05-30T17:02:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f848b400640 1 -- 172.21.15.59:0/4009853446 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0ad900 con 0x7f84940cfe20 2024-05-30T17:02:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f849a600640 1 -- 172.21.15.59:0/4009853446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849414a8e0 con 0x7f84940cfe20 2024-05-30T17:02:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f849a600640 1 -- 172.21.15.59:0/4009853446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849414aea0 con 0x7f84940cfe20 2024-05-30T17:02:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f849a600640 1 -- 172.21.15.59:0/4009853446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8494068a90 con 0x7f84940cfe20 2024-05-30T17:02:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.158+0000 7f848b400640 1 -- 172.21.15.59:0/4009853446 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f848c0adaa0 con 0x7f84940cfe20 2024-05-30T17:02:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.162+0000 7f848b400640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8470069b20 0x7f847006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.162+0000 7f848b400640 1 -- 172.21.15.59:0/4009853446 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5055+0+0 (secure 0 0 0) 0x7f848c120760 con 0x7f84940cfe20 2024-05-30T17:02:42.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.162+0000 7f8493400640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8470069b20 0x7f847006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.162+0000 7f8493400640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8470069b20 0x7f847006bfe0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f849414cdb0 tx=0x7f8484007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:42.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.166+0000 7f848b400640 1 -- 172.21.15.59:0/4009853446 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f848c016520 con 0x7f84940cfe20 2024-05-30T17:02:42.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.330+0000 7f849a600640 1 -- 172.21.15.59:0/4009853446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84940b5140 con 0x7f84940cfe20 2024-05-30T17:02:42.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.330+0000 7f848b400640 1 -- 172.21.15.59:0/4009853446 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+13194 (secure 0 0 0) 0x7f848c0a58d0 con 0x7f84940cfe20 2024-05-30T17:02:42.335 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:42.335 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":108,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:02:40.980418+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/1525464146":"2024-05-31T17:02:38.492036+0000","172.21.15.59:6833/1525464146":"2024-05-31T17:02:38.492036+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:02:42.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.334+0000 7f849a600640 1 -- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8470069b20 msgr2=0x7f847006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.334+0000 7f849a600640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8470069b20 0x7f847006bfe0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f849414cdb0 tx=0x7f8484007e40 comp rx=0 tx=0).stop 2024-05-30T17:02:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.334+0000 7f849a600640 1 -- 172.21.15.59:0/4009853446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84940cfe20 msgr2=0x7f8494147180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.334+0000 7f849a600640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84940cfe20 0x7f8494147180 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f848c0b0040 tx=0x7f848c0196d0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.334+0000 7f849a600640 1 -- 172.21.15.59:0/4009853446 shutdown_connections 2024-05-30T17:02:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.334+0000 7f849a600640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8470069b20 0x7f847006bfe0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.334+0000 7f849a600640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84940cfe20 0x7f8494147180 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.334+0000 7f849a600640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84940cfa40 0x7f8494146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.334+0000 7f849a600640 1 --2- 172.21.15.59:0/4009853446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8494073bb0 0x7f849414b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.334+0000 7f849a600640 1 -- 172.21.15.59:0/4009853446 >> 172.21.15.59:0/4009853446 conn(0x7f84940b22d0 msgr2=0x7f849414c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.334+0000 7f849a600640 1 -- 172.21.15.59:0/4009853446 shutdown_connections 2024-05-30T17:02:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.334+0000 7f849a600640 1 -- 172.21.15.59:0/4009853446 wait complete. 2024-05-30T17:02:42.357 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T16:48:53.098546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T17:02:42.357 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe992600640 1 Processor -- start 2024-05-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe992600640 1 -- start start 2024-05-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe992600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe98c0b4f90 0x7fe98c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe992600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe98c0b3ff0 0x7fe98c06dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe992600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe98c0b32d0 con 0x7fe98c0723a0 2024-05-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe992600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe98c15f490 con 0x7fe98c0b4f90 2024-05-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe992600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe98c15f770 con 0x7fe98c0b3ff0 2024-05-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe982a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe98c0b4f90 0x7fe98c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe98be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe98c0b3ff0 0x7fe98c06dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe98b400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe98c0723a0 0x7fe98c15ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:38878/0 (socket says 172.21.15.59:38878) 2024-05-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe98b400640 1 -- 172.21.15.59:0/2289029799 learned_addr learned my addr 172.21.15.59:0/2289029799 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe982a00640 1 -- 172.21.15.59:0/2289029799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe98c0b3ff0 msgr2=0x7fe98c06dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe982a00640 1 --2- 172.21.15.59:0/2289029799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe98c0b3ff0 0x7fe98c06dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe982a00640 1 -- 172.21.15.59:0/2289029799 >> v1:172.21.15.107:6789/0 conn(0x7fe98c0723a0 legacy=0x7fe98c15ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe982a00640 1 -- 172.21.15.59:0/2289029799 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c15fa50 con 0x7fe98c0b4f90 2024-05-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.498+0000 7fe98aa00640 1 -- 172.21.15.59:0/2289029799 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841657619 0 0) 0x7fe98c0b32d0 con 0x7fe98c0723a0 2024-05-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.502+0000 7fe982a00640 1 --2- 172.21.15.59:0/2289029799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe98c0b4f90 0x7fe98c0b3ab0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe9740097c0 tx=0x7fe97401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7be3d9d6685782d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.502+0000 7fe98aa00640 1 -- 172.21.15.59:0/2289029799 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9740b0070 con 0x7fe98c0b4f90 2024-05-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.502+0000 7fe98aa00640 1 -- 172.21.15.59:0/2289029799 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9740ab600 con 0x7fe98c0b4f90 2024-05-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.502+0000 7fe98aa00640 1 -- 172.21.15.59:0/2289029799 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9740ab9d0 con 0x7fe98c0b4f90 2024-05-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.502+0000 7fe992600640 1 -- 172.21.15.59:0/2289029799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe98c0b4f90 msgr2=0x7fe98c0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.502+0000 7fe992600640 1 --2- 172.21.15.59:0/2289029799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe98c0b4f90 0x7fe98c0b3ab0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe9740097c0 tx=0x7fe97401c4a0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.502+0000 7fe992600640 1 -- 172.21.15.59:0/2289029799 shutdown_connections 2024-05-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.502+0000 7fe992600640 1 --2- 172.21.15.59:0/2289029799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe98c0b3ff0 0x7fe98c06dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.502+0000 7fe992600640 1 --2- 172.21.15.59:0/2289029799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe98c0b4f90 0x7fe98c0b3ab0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.502+0000 7fe992600640 1 -- 172.21.15.59:0/2289029799 >> 172.21.15.59:0/2289029799 conn(0x7fe98c06bdb0 msgr2=0x7fe98c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.502+0000 7fe992600640 1 -- 172.21.15.59:0/2289029799 shutdown_connections 2024-05-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.502+0000 7fe992600640 1 -- 172.21.15.59:0/2289029799 wait complete. 2024-05-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe992600640 1 Processor -- start 2024-05-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe992600640 1 -- start start 2024-05-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe992600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe98c0723a0 0x7fe98c0992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe992600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe98c0b3ff0 0x7fe98c0b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe992600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c0b4f90 0x7fe98c0b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe992600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c1551f0 con 0x7fe98c0b4f90 2024-05-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe992600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c155070 con 0x7fe98c0723a0 2024-05-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe992600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe98c155370 con 0x7fe98c0b3ff0 2024-05-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe98be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c0b4f90 0x7fe98c0b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe98be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c0b4f90 0x7fe98c0b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38186/0 (socket says 172.21.15.59:38186) 2024-05-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe98be00640 1 -- 172.21.15.59:0/2692504725 learned_addr learned my addr 172.21.15.59:0/2692504725 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe98b400640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe98c0723a0 0x7fe98c0992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe982a00640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe98c0b3ff0 0x7fe98c0b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe98be00640 1 -- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe98c0b3ff0 msgr2=0x7fe98c0b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe98be00640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe98c0b3ff0 0x7fe98c0b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe98be00640 1 -- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe98c0723a0 msgr2=0x7fe98c0992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe98be00640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe98c0723a0 0x7fe98c0992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe98be00640 1 -- 172.21.15.59:0/2692504725 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c13c190 con 0x7fe98c0b4f90 2024-05-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe98be00640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c0b4f90 0x7fe98c0b13d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fe98400ef90 tx=0x7fe98400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe983e00640 1 -- 172.21.15.59:0/2692504725 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984018020 con 0x7fe98c0b4f90 2024-05-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe983e00640 1 -- 172.21.15.59:0/2692504725 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe984014480 con 0x7fe98c0b4f90 2024-05-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe983e00640 1 -- 172.21.15.59:0/2692504725 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984014870 con 0x7fe98c0b4f90 2024-05-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe992600640 1 -- 172.21.15.59:0/2692504725 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98c13c470 con 0x7fe98c0b4f90 2024-05-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.506+0000 7fe992600640 1 -- 172.21.15.59:0/2692504725 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98c13ca30 con 0x7fe98c0b4f90 2024-05-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.510+0000 7fe992600640 1 -- 172.21.15.59:0/2692504725 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe98c068a90 con 0x7fe98c0b4f90 2024-05-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.510+0000 7fe983e00640 1 -- 172.21.15.59:0/2692504725 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fe98401b020 con 0x7fe98c0b4f90 2024-05-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.510+0000 7fe983e00640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe968069b50 0x7fe96806c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.510+0000 7fe983e00640 1 -- 172.21.15.59:0/2692504725 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5055+0+0 (secure 0 0 0) 0x7fe9840864c0 con 0x7fe98c0b4f90 2024-05-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.510+0000 7fe98b400640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe968069b50 0x7fe96806c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.510+0000 7fe98b400640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe968069b50 0x7fe96806c010 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe97c007fd0 tx=0x7fe97c007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.514+0000 7fe983e00640 1 -- 172.21.15.59:0/2692504725 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe984022030 con 0x7fe98c0b4f90 2024-05-30T17:02:42.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.678+0000 7fe992600640 1 -- 172.21.15.59:0/2692504725 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe98c169d60 con 0x7fe98c0b4f90 2024-05-30T17:02:42.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.678+0000 7fe983e00640 1 -- 172.21.15.59:0/2692504725 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) ==== 93+0+10 (secure 0 0 0) 0x7fe984010040 con 0x7fe98c0b4f90 2024-05-30T17:02:42.683 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-05-30T17:02:42.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.682+0000 7fe992600640 1 -- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe968069b50 msgr2=0x7fe96806c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.682+0000 7fe992600640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe968069b50 0x7fe96806c010 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe97c007fd0 tx=0x7fe97c007d60 comp rx=0 tx=0).stop 2024-05-30T17:02:42.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.682+0000 7fe992600640 1 -- 172.21.15.59:0/2692504725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c0b4f90 msgr2=0x7fe98c0b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.682+0000 7fe992600640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c0b4f90 0x7fe98c0b13d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fe98400ef90 tx=0x7fe98400c490 comp rx=0 tx=0).stop 2024-05-30T17:02:42.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.682+0000 7fe992600640 1 -- 172.21.15.59:0/2692504725 shutdown_connections 2024-05-30T17:02:42.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.682+0000 7fe992600640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe968069b50 0x7fe96806c010 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.682+0000 7fe992600640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c0b4f90 0x7fe98c0b13d0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.682+0000 7fe992600640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe98c0b3ff0 0x7fe98c0b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.682+0000 7fe992600640 1 --2- 172.21.15.59:0/2692504725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe98c0723a0 0x7fe98c0992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.682+0000 7fe992600640 1 -- 172.21.15.59:0/2692504725 >> 172.21.15.59:0/2692504725 conn(0x7fe98c06bdb0 msgr2=0x7fe98c15ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:42.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.682+0000 7fe992600640 1 -- 172.21.15.59:0/2692504725 shutdown_connections 2024-05-30T17:02:42.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.682+0000 7fe992600640 1 -- 172.21.15.59:0/2692504725 wait complete. 2024-05-30T17:02:42.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_3_clones_are_cancelled' 2024-05-30T17:02:42.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.842+0000 7f7da2e00640 1 Processor -- start 2024-05-30T17:02:42.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.842+0000 7f7da2e00640 1 -- start start 2024-05-30T17:02:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.842+0000 7f7da2e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d9c15e860 0x7f7d9c0cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.842+0000 7f7da2e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9c15ec40 con 0x7f7d9c0c6f50 2024-05-30T17:02:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.842+0000 7f7da2e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9c0c8200 con 0x7f7d9c0d0e80 2024-05-30T17:02:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.842+0000 7f7da2e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f7d9c0c7960 con 0x7f7d9c15e860 2024-05-30T17:02:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.842+0000 7f7d9be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d9c15e860 0x7f7d9c0cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.842+0000 7f7da0e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7d9c0c6f50 0x7f7d9c06b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43650/0 (socket says 172.21.15.59:43650) 2024-05-30T17:02:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.842+0000 7f7d9be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d9c15e860 0x7f7d9c0cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38202/0 (socket says 172.21.15.59:38202) 2024-05-30T17:02:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.842+0000 7f7da0e00640 1 -- 172.21.15.59:0/2674128851 learned_addr learned my addr 172.21.15.59:0/2674128851 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.842+0000 7f7d9be00640 1 -- 172.21.15.59:0/2674128851 >> v1:172.21.15.107:6789/0 conn(0x7f7d9c0d0e80 legacy=0x7f7d9c0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.842+0000 7f7d9be00640 1 -- 172.21.15.59:0/2674128851 >> v1:172.21.15.59:6789/0 conn(0x7f7d9c0c6f50 legacy=0x7f7d9c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.846+0000 7f7d9be00640 1 -- 172.21.15.59:0/2674128851 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9c0c7c40 con 0x7f7d9c15e860 2024-05-30T17:02:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.846+0000 7f7d9be00640 1 --2- 172.21.15.59:0/2674128851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d9c15e860 0x7f7d9c0cef40 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0097c0 tx=0x7f7d8c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1875f49b6e44a231 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.846+0000 7f7d9aa00640 1 -- 172.21.15.59:0/2674128851 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c0b0070 con 0x7f7d9c15e860 2024-05-30T17:02:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.846+0000 7f7d9aa00640 1 -- 172.21.15.59:0/2674128851 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8c0ab600 con 0x7f7d9c15e860 2024-05-30T17:02:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.846+0000 7f7d9aa00640 1 -- 172.21.15.59:0/2674128851 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c0a4e60 con 0x7f7d9c15e860 2024-05-30T17:02:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.846+0000 7f7da2e00640 1 -- 172.21.15.59:0/2674128851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d9c15e860 msgr2=0x7f7d9c0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.846+0000 7f7da2e00640 1 --2- 172.21.15.59:0/2674128851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d9c15e860 0x7f7d9c0cef40 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0097c0 tx=0x7f7d8c01c3d0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.846+0000 7f7da2e00640 1 -- 172.21.15.59:0/2674128851 shutdown_connections 2024-05-30T17:02:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.846+0000 7f7da2e00640 1 --2- 172.21.15.59:0/2674128851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d9c15e860 0x7f7d9c0cef40 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.846+0000 7f7da2e00640 1 -- 172.21.15.59:0/2674128851 >> 172.21.15.59:0/2674128851 conn(0x7f7d9c0b2fc0 msgr2=0x7f7d9c0b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.846+0000 7f7da2e00640 1 -- 172.21.15.59:0/2674128851 shutdown_connections 2024-05-30T17:02:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.846+0000 7f7da2e00640 1 -- 172.21.15.59:0/2674128851 wait complete. 2024-05-30T17:02:42.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7da2e00640 1 Processor -- start 2024-05-30T17:02:42.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7da2e00640 1 -- start start 2024-05-30T17:02:42.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7da2e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d9c0c6f50 0x7f7d9c142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7da2e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d9c0d0e80 0x7f7d9c0cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7da2e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d9c15e860 0x7f7d9c0cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7da2e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c16c530 con 0x7f7d9c0c6f50 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7da2e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c16c3b0 con 0x7f7d9c0d0e80 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7da2e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9c16c6b0 con 0x7f7d9c15e860 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7d9be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d9c0c6f50 0x7f7d9c142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7d9be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d9c0c6f50 0x7f7d9c142fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38212/0 (socket says 172.21.15.59:38212) 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7d9be00640 1 -- 172.21.15.59:0/3771043446 learned_addr learned my addr 172.21.15.59:0/3771043446 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7d9be00640 1 -- 172.21.15.59:0/3771043446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d9c15e860 msgr2=0x7f7d9c0cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7d9be00640 1 --2- 172.21.15.59:0/3771043446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d9c15e860 0x7f7d9c0cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7d9be00640 1 -- 172.21.15.59:0/3771043446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d9c0d0e80 msgr2=0x7f7d9c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7d9be00640 1 --2- 172.21.15.59:0/3771043446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d9c0d0e80 0x7f7d9c0cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7d9be00640 1 -- 172.21.15.59:0/3771043446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9c0b40c0 con 0x7f7d9c0c6f50 2024-05-30T17:02:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7d9be00640 1 --2- 172.21.15.59:0/3771043446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d9c0c6f50 0x7f7d9c142fa0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c01a000 tx=0x7f7d8c019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7d93e00640 1 -- 172.21.15.59:0/3771043446 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c0b8070 con 0x7f7d9c0c6f50 2024-05-30T17:02:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7d93e00640 1 -- 172.21.15.59:0/3771043446 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8c0b4410 con 0x7f7d9c0c6f50 2024-05-30T17:02:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7d93e00640 1 -- 172.21.15.59:0/3771043446 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c0b0040 con 0x7f7d9c0c6f50 2024-05-30T17:02:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7da2e00640 1 -- 172.21.15.59:0/3771043446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d9c0b43a0 con 0x7f7d9c0c6f50 2024-05-30T17:02:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.850+0000 7f7da2e00640 1 -- 172.21.15.59:0/3771043446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d9c0b4960 con 0x7f7d9c0c6f50 2024-05-30T17:02:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.854+0000 7f7da2e00640 1 -- 172.21.15.59:0/3771043446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d9c068a90 con 0x7f7d9c0c6f50 2024-05-30T17:02:42.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.854+0000 7f7d93e00640 1 -- 172.21.15.59:0/3771043446 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f7d8c0bb070 con 0x7f7d9c0c6f50 2024-05-30T17:02:42.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.854+0000 7f7d93e00640 1 --2- 172.21.15.59:0/3771043446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d7c069b20 0x7f7d7c06bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:42.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.854+0000 7f7d93e00640 1 -- 172.21.15.59:0/3771043446 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5055+0+0 (secure 0 0 0) 0x7f7d8c11f840 con 0x7f7d9c0c6f50 2024-05-30T17:02:42.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.854+0000 7f7d9b400640 1 --2- 172.21.15.59:0/3771043446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d7c069b20 0x7f7d7c06bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.854+0000 7f7d9b400640 1 --2- 172.21.15.59:0/3771043446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d7c069b20 0x7f7d7c06bfe0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c153a60 tx=0x7f7d88006bd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:42.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:42.858+0000 7f7d93e00640 1 -- 172.21.15.59:0/3771043446 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7d8c016050 con 0x7f7d9c0c6f50 2024-05-30T17:02:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.082+0000 7f7da2e00640 1 -- 172.21.15.59:0/3771043446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_3_clones_are_cancelled"]} v 0) -- 0x7f7d9c0b2bc0 con 0x7f7d9c0c6f50 2024-05-30T17:02:43.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.990+0000 7f7d93e00640 1 -- 172.21.15.59:0/3771043446 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_3_clones_are_cancelled"]}]=0 v620) ==== 166+0+0 (secure 0 0 0) 0x7f7d8c0f1860 con 0x7f7d9c0c6f50 2024-05-30T17:02:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.994+0000 7f7da2e00640 1 -- 172.21.15.59:0/3771043446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d7c069b20 msgr2=0x7f7d7c06bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.994+0000 7f7da2e00640 1 --2- 172.21.15.59:0/3771043446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d7c069b20 0x7f7d7c06bfe0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c153a60 tx=0x7f7d88006bd0 comp rx=0 tx=0).stop 2024-05-30T17:02:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.994+0000 7f7da2e00640 1 -- 172.21.15.59:0/3771043446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d9c0c6f50 msgr2=0x7f7d9c142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.994+0000 7f7da2e00640 1 --2- 172.21.15.59:0/3771043446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d9c0c6f50 0x7f7d9c142fa0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c01a000 tx=0x7f7d8c019170 comp rx=0 tx=0).stop 2024-05-30T17:02:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.994+0000 7f7da2e00640 1 -- 172.21.15.59:0/3771043446 shutdown_connections 2024-05-30T17:02:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.994+0000 7f7da2e00640 1 --2- 172.21.15.59:0/3771043446 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d7c069b20 0x7f7d7c06bfe0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.994+0000 7f7da2e00640 1 --2- 172.21.15.59:0/3771043446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d9c15e860 0x7f7d9c0cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.994+0000 7f7da2e00640 1 --2- 172.21.15.59:0/3771043446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d9c0d0e80 0x7f7d9c0cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.994+0000 7f7da2e00640 1 --2- 172.21.15.59:0/3771043446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d9c0c6f50 0x7f7d9c142fa0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.994+0000 7f7da2e00640 1 -- 172.21.15.59:0/3771043446 >> 172.21.15.59:0/3771043446 conn(0x7f7d9c0b2fc0 msgr2=0x7f7d9c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.994+0000 7f7da2e00640 1 -- 172.21.15.59:0/3771043446 shutdown_connections 2024-05-30T17:02:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:43.994+0000 7f7da2e00640 1 -- 172.21.15.59:0/3771043446 wait complete. 2024-05-30T17:02:44.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T17:02:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6df0600640 1 Processor -- start 2024-05-30T17:02:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6df0600640 1 -- start start 2024-05-30T17:02:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6df0600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6de81569e0 0x7f6de815d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6df0600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6de80ad2b0 0x7f6de80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6df0600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de80ad770 con 0x7f6de80d0660 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6df0600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6de815cb40 con 0x7f6de81569e0 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6df0600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6de815ce20 con 0x7f6de80ad2b0 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6dedc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6de81569e0 0x7f6de815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6dedc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6de81569e0 0x7f6de815d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38216/0 (socket says 172.21.15.59:38216) 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6dedc00640 1 -- 172.21.15.59:0/3350823892 learned_addr learned my addr 172.21.15.59:0/3350823892 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6ded200640 1 --2- 172.21.15.59:0/3350823892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6de80ad2b0 0x7f6de80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6dedc00640 1 -- 172.21.15.59:0/3350823892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6de80ad2b0 msgr2=0x7f6de80cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6dedc00640 1 --2- 172.21.15.59:0/3350823892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6de80ad2b0 0x7f6de80cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6dedc00640 1 -- 172.21.15.59:0/3350823892 >> v1:172.21.15.107:6789/0 conn(0x7f6de80d0660 legacy=0x7f6de80b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6dedc00640 1 -- 172.21.15.59:0/3350823892 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de815d100 con 0x7f6de81569e0 2024-05-30T17:02:44.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.170+0000 7f6ded200640 1 --2- 172.21.15.59:0/3350823892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6de80ad2b0 0x7f6de80cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:44.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.174+0000 7f6dedc00640 1 --2- 172.21.15.59:0/3350823892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6de81569e0 0x7f6de815d620 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc009870 tx=0x7f6ddc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4720a310430cb72 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:44.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.174+0000 7f6de7e00640 1 -- 172.21.15.59:0/3350823892 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0ab430 con 0x7f6de81569e0 2024-05-30T17:02:44.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.174+0000 7f6de7e00640 1 -- 172.21.15.59:0/3350823892 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ddc0b0070 con 0x7f6de81569e0 2024-05-30T17:02:44.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.174+0000 7f6de7e00640 1 -- 172.21.15.59:0/3350823892 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0ab7f0 con 0x7f6de81569e0 2024-05-30T17:02:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.174+0000 7f6df0600640 1 -- 172.21.15.59:0/3350823892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6de81569e0 msgr2=0x7f6de815d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.174+0000 7f6df0600640 1 --2- 172.21.15.59:0/3350823892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6de81569e0 0x7f6de815d620 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc009870 tx=0x7f6ddc01c440 comp rx=0 tx=0).stop 2024-05-30T17:02:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.174+0000 7f6df0600640 1 -- 172.21.15.59:0/3350823892 shutdown_connections 2024-05-30T17:02:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.174+0000 7f6df0600640 1 --2- 172.21.15.59:0/3350823892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6de80ad2b0 0x7f6de80cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.174+0000 7f6df0600640 1 --2- 172.21.15.59:0/3350823892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6de81569e0 0x7f6de815d620 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.174+0000 7f6df0600640 1 -- 172.21.15.59:0/3350823892 >> 172.21.15.59:0/3350823892 conn(0x7f6de806bdb0 msgr2=0x7f6de806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.174+0000 7f6df0600640 1 -- 172.21.15.59:0/3350823892 shutdown_connections 2024-05-30T17:02:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.174+0000 7f6df0600640 1 -- 172.21.15.59:0/3350823892 wait complete. 2024-05-30T17:02:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6df0600640 1 Processor -- start 2024-05-30T17:02:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6df0600640 1 -- start start 2024-05-30T17:02:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6df0600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6de80ad2b0 0x7f6de814ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6df0600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6de80d0660 0x7f6de809afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6df0600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6de81569e0 0x7f6de814b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6df0600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6de80d00b0 con 0x7f6de80ad2b0 2024-05-30T17:02:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6df0600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6de80cff30 con 0x7f6de80d0660 2024-05-30T17:02:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6df0600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6de81691b0 con 0x7f6de81569e0 2024-05-30T17:02:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6dedc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6de80ad2b0 0x7f6de814ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6dedc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6de80ad2b0 0x7f6de814ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38226/0 (socket says 172.21.15.59:38226) 2024-05-30T17:02:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6dedc00640 1 -- 172.21.15.59:0/953031911 learned_addr learned my addr 172.21.15.59:0/953031911 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6dee600640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6de81569e0 0x7f6de814b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6ded200640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6de80d0660 0x7f6de809afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6dedc00640 1 -- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6de81569e0 msgr2=0x7f6de814b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6dedc00640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6de81569e0 0x7f6de814b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6dedc00640 1 -- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6de80d0660 msgr2=0x7f6de809afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6dedc00640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6de80d0660 0x7f6de809afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6dedc00640 1 -- 172.21.15.59:0/953031911 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de815da60 con 0x7f6de80ad2b0 2024-05-30T17:02:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6dedc00640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6de80ad2b0 0x7f6de814ad70 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc01a070 tx=0x7f6ddc0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6de5600640 1 -- 172.21.15.59:0/953031911 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0b9020 con 0x7f6de80ad2b0 2024-05-30T17:02:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6de5600640 1 -- 172.21.15.59:0/953031911 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ddc0abe40 con 0x7f6de80ad2b0 2024-05-30T17:02:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6df0600640 1 -- 172.21.15.59:0/953031911 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de815de20 con 0x7f6de80ad2b0 2024-05-30T17:02:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6de5600640 1 -- 172.21.15.59:0/953031911 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0b4660 con 0x7f6de80ad2b0 2024-05-30T17:02:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6df0600640 1 -- 172.21.15.59:0/953031911 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de809a7d0 con 0x7f6de80ad2b0 2024-05-30T17:02:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.178+0000 7f6df0600640 1 -- 172.21.15.59:0/953031911 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de8068a90 con 0x7f6de80ad2b0 2024-05-30T17:02:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.182+0000 7f6de5600640 1 -- 172.21.15.59:0/953031911 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f6ddc0bc020 con 0x7f6de80ad2b0 2024-05-30T17:02:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.182+0000 7f6de5600640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6dc8069b20 0x7f6dc806bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.182+0000 7f6de5600640 1 -- 172.21.15.59:0/953031911 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5055+0+0 (secure 0 0 0) 0x7f6ddc11f3e0 con 0x7f6de80ad2b0 2024-05-30T17:02:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.182+0000 7f6ded200640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6dc8069b20 0x7f6dc806bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.182+0000 7f6ded200640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6dc8069b20 0x7f6dc806bfe0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6de80b0ac0 tx=0x7f6dd4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.186+0000 7f6de5600640 1 -- 172.21.15.59:0/953031911 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6ddc0c3070 con 0x7f6de80ad2b0 2024-05-30T17:02:44.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.350+0000 7f6df0600640 1 -- 172.21.15.59:0/953031911 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6de814c450 con 0x7f6de80ad2b0 2024-05-30T17:02:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.354+0000 7f6de5600640 1 -- 172.21.15.59:0/953031911 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f6ddc016150 con 0x7f6de80ad2b0 2024-05-30T17:02:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.358+0000 7f6df0600640 1 -- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6dc8069b20 msgr2=0x7f6dc806bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.358+0000 7f6df0600640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6dc8069b20 0x7f6dc806bfe0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6de80b0ac0 tx=0x7f6dd4008040 comp rx=0 tx=0).stop 2024-05-30T17:02:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.358+0000 7f6df0600640 1 -- 172.21.15.59:0/953031911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6de80ad2b0 msgr2=0x7f6de814ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.358+0000 7f6df0600640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6de80ad2b0 0x7f6de814ad70 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc01a070 tx=0x7f6ddc0191e0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.358+0000 7f6df0600640 1 -- 172.21.15.59:0/953031911 shutdown_connections 2024-05-30T17:02:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.358+0000 7f6df0600640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6dc8069b20 0x7f6dc806bfe0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.358+0000 7f6df0600640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6de81569e0 0x7f6de814b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.358+0000 7f6df0600640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6de80d0660 0x7f6de809afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.358+0000 7f6df0600640 1 --2- 172.21.15.59:0/953031911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6de80ad2b0 0x7f6de814ad70 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.358+0000 7f6df0600640 1 -- 172.21.15.59:0/953031911 >> 172.21.15.59:0/953031911 conn(0x7f6de806bdb0 msgr2=0x7f6de814c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:44.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.358+0000 7f6df0600640 1 -- 172.21.15.59:0/953031911 shutdown_connections 2024-05-30T17:02:44.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.358+0000 7f6df0600640 1 -- 172.21.15.59:0/953031911 wait complete. 2024-05-30T17:02:44.381 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T17:02:44.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T17:02:44.498 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T17:02:44.544 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T17:02:44.544 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:02:44.544 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:02:44.553 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T17:02:44.553 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:02:44.553 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:02:44.593 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:02:44.593 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:02:44.593 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:02:44.607 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T17:02:44.607 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:02:44.607 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:02:44.645 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:02:44.645 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T17:02:44.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:02:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.790+0000 7f115a200640 1 Processor -- start 2024-05-30T17:02:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.790+0000 7f115a200640 1 -- start start 2024-05-30T17:02:44.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.790+0000 7f115a200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11540af720 0x7f115415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:44.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.790+0000 7f115a200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f115406e900 0x7f115415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:44.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.790+0000 7f115a200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115415f060 con 0x7f11540d0560 2024-05-30T17:02:44.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.790+0000 7f115a200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f11540afb00 con 0x7f115406e900 2024-05-30T17:02:44.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.790+0000 7f115a200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f115415c270 con 0x7f11540af720 2024-05-30T17:02:44.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.790+0000 7f1153e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f11540d0560 0x7f1154072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43660/0 (socket says 172.21.15.59:43660) 2024-05-30T17:02:44.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.790+0000 7f1153e00640 1 -- 172.21.15.59:0/1163062841 learned_addr learned my addr 172.21.15.59:0/1163062841 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:44.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f114aa00640 1 --2- 172.21.15.59:0/1163062841 >> v2:172.21.15.107:3300/0 conn(0x7f115406e900 0x7f115415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.790+0000 7f1153400640 1 --2- 172.21.15.59:0/1163062841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11540af720 0x7f115415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f1152a00640 1 -- 172.21.15.59:0/1163062841 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576931268 0 0) 0x7f115415f060 con 0x7f11540d0560 2024-05-30T17:02:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f1152a00640 1 -- 172.21.15.59:0/1163062841 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1138003530 con 0x7f11540d0560 2024-05-30T17:02:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f1153400640 1 -- 172.21.15.59:0/1163062841 >> v2:172.21.15.107:3300/0 conn(0x7f115406e900 msgr2=0x7f115415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f1153400640 1 --2- 172.21.15.59:0/1163062841 >> v2:172.21.15.107:3300/0 conn(0x7f115406e900 0x7f115415f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f1153400640 1 -- 172.21.15.59:0/1163062841 >> v1:172.21.15.59:6789/0 conn(0x7f11540d0560 legacy=0x7f1154072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f1152a00640 1 -- 172.21.15.59:0/1163062841 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 85730895 0 0) 0x7f1138003530 con 0x7f11540d0560 2024-05-30T17:02:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f1153400640 1 -- 172.21.15.59:0/1163062841 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115415c550 con 0x7f11540af720 2024-05-30T17:02:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f114aa00640 1 --2- 172.21.15.59:0/1163062841 >> v2:172.21.15.107:3300/0 conn(0x7f115406e900 0x7f115415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:02:44.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f1153400640 1 --2- 172.21.15.59:0/1163062841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11540af720 0x7f115415b9d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f11440097c0 tx=0x7f114401c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=243030e61ef47ce7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:44.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f1152a00640 1 -- 172.21.15.59:0/1163062841 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11440b0070 con 0x7f11540af720 2024-05-30T17:02:44.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f1152a00640 1 -- 172.21.15.59:0/1163062841 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11440ab400 con 0x7f11540af720 2024-05-30T17:02:44.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.794+0000 7f1152a00640 1 -- 172.21.15.59:0/1163062841 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c001a00 con 0x7f11540af720 2024-05-30T17:02:44.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 -- 172.21.15.59:0/1163062841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11540af720 msgr2=0x7f115415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:44.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 --2- 172.21.15.59:0/1163062841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11540af720 0x7f115415b9d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f11440097c0 tx=0x7f114401c390 comp rx=0 tx=0).stop 2024-05-30T17:02:44.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 -- 172.21.15.59:0/1163062841 shutdown_connections 2024-05-30T17:02:44.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 --2- 172.21.15.59:0/1163062841 >> v2:172.21.15.107:3300/0 conn(0x7f115406e900 0x7f115415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 --2- 172.21.15.59:0/1163062841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11540af720 0x7f115415b9d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 -- 172.21.15.59:0/1163062841 >> 172.21.15.59:0/1163062841 conn(0x7f11540b22d0 msgr2=0x7f11540b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:44.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 -- 172.21.15.59:0/1163062841 shutdown_connections 2024-05-30T17:02:44.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 -- 172.21.15.59:0/1163062841 wait complete. 2024-05-30T17:02:44.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 Processor -- start 2024-05-30T17:02:44.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 -- start start 2024-05-30T17:02:44.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f115406e900 0x7f1154099910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:44.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11540af720 0x7f11540b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:44.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11540d0560 0x7f11540b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:44.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f115415fd30 con 0x7f11540af720 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f115415c830 con 0x7f115406e900 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f115a200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f115415feb0 con 0x7f11540d0560 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f114aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11540af720 0x7f11540b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f114aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11540af720 0x7f11540b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38232/0 (socket says 172.21.15.59:38232) 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f114aa00640 1 -- 172.21.15.59:0/848722391 learned_addr learned my addr 172.21.15.59:0/848722391 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f1153400640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f115406e900 0x7f1154099910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.798+0000 7f1153e00640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11540d0560 0x7f11540b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f114aa00640 1 -- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11540d0560 msgr2=0x7f11540b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f114aa00640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11540d0560 0x7f11540b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f114aa00640 1 -- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f115406e900 msgr2=0x7f1154099910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f114aa00640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f115406e900 0x7f1154099910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f114aa00640 1 -- 172.21.15.59:0/848722391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11541f7ab0 con 0x7f11540af720 2024-05-30T17:02:44.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f114aa00640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11540af720 0x7f11540b3fd0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f113c00e930 tx=0x7f113c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:44.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f114be00640 1 -- 172.21.15.59:0/848722391 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c017070 con 0x7f11540af720 2024-05-30T17:02:44.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f114be00640 1 -- 172.21.15.59:0/848722391 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113c00ca00 con 0x7f11540af720 2024-05-30T17:02:44.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f114be00640 1 -- 172.21.15.59:0/848722391 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c00cdd0 con 0x7f11540af720 2024-05-30T17:02:44.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f115a200640 1 -- 172.21.15.59:0/848722391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11541f7d30 con 0x7f11540af720 2024-05-30T17:02:44.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f115a200640 1 -- 172.21.15.59:0/848722391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11541f82f0 con 0x7f11540af720 2024-05-30T17:02:44.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f115a200640 1 -- 172.21.15.59:0/848722391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1154068a90 con 0x7f11540af720 2024-05-30T17:02:44.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.802+0000 7f114be00640 1 -- 172.21.15.59:0/848722391 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f113c01a070 con 0x7f11540af720 2024-05-30T17:02:44.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.806+0000 7f114be00640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1130069b20 0x7f113006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:44.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.806+0000 7f114be00640 1 -- 172.21.15.59:0/848722391 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5055+0+0 (secure 0 0 0) 0x7f113c085580 con 0x7f11540af720 2024-05-30T17:02:44.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.806+0000 7f1153400640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1130069b20 0x7f113006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:44.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.806+0000 7f1153400640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1130069b20 0x7f113006bfe0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f11440ad000 tx=0x7f11440a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:44.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:44.810+0000 7f114be00640 1 -- 172.21.15.59:0/848722391 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f11541f7ab0 con 0x7f11540af720 2024-05-30T17:02:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.010+0000 7f115a200640 1 -- 172.21.15.59:0/848722391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f115415b220 con 0x7f11540af720 2024-05-30T17:02:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.010+0000 7f114be00640 1 -- 172.21.15.59:0/848722391 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+3875 (secure 0 0 0) 0x7f113c056f50 con 0x7f11540af720 2024-05-30T17:02:45.015 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:45.015 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6641,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2410188205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2410188205},{"type":"v1","addr":"172.21.15.107:6836","nonce":2410188205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7342,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1749998079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1749998079},{"type":"v1","addr":"172.21.15.59:6834","nonce":1749998079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3865215628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3865215628},{"type":"v1","addr":"172.21.15.107:6837","nonce":3865215628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":8379,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2453583275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2453583275},{"type":"v1","addr":"172.21.15.59:6835","nonce":2453583275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[]} 2024-05-30T17:02:45.015 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 64 2024-05-30T17:02:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.014+0000 7f115a200640 1 -- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1130069b20 msgr2=0x7f113006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.014+0000 7f115a200640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1130069b20 0x7f113006bfe0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f11440ad000 tx=0x7f11440a6000 comp rx=0 tx=0).stop 2024-05-30T17:02:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.014+0000 7f115a200640 1 -- 172.21.15.59:0/848722391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11540af720 msgr2=0x7f11540b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.014+0000 7f115a200640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11540af720 0x7f11540b3fd0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f113c00e930 tx=0x7f113c00edf0 comp rx=0 tx=0).stop 2024-05-30T17:02:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.014+0000 7f115a200640 1 -- 172.21.15.59:0/848722391 shutdown_connections 2024-05-30T17:02:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.014+0000 7f115a200640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1130069b20 0x7f113006bfe0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.014+0000 7f115a200640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11540d0560 0x7f11540b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.014+0000 7f115a200640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11540af720 0x7f11540b3fd0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.014+0000 7f115a200640 1 --2- 172.21.15.59:0/848722391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f115406e900 0x7f1154099910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.014+0000 7f115a200640 1 -- 172.21.15.59:0/848722391 >> 172.21.15.59:0/848722391 conn(0x7f11540b22d0 msgr2=0x7f11540b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.014+0000 7f115a200640 1 -- 172.21.15.59:0/848722391 shutdown_connections 2024-05-30T17:02:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.014+0000 7f115a200640 1 -- 172.21.15.59:0/848722391 wait complete. 2024-05-30T17:02:45.037 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T17:02:45.037 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T17:02:45.038 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T17:02:45.038 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:02:45.038 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T17:02:45.038 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T17:02:45.038 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T17:02:45.038 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:02:45.038 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T17:02:45.039 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T17:02:45.039 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T17:02:45.039 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:02:45.039 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T17:02:45.039 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T17:02:45.039 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T17:02:45.039 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:02:45.049 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T17:02:45.049 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T17:02:45.051 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T17:02:45.051 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T17:02:45.056 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T17:02:45.056 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T17:02:45.057 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T17:02:45.057 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T17:02:45.093 INFO:tasks.ceph.mds.a:Started 2024-05-30T17:02:45.094 DEBUG:teuthology.parallel:result is None 2024-05-30T17:02:45.095 INFO:tasks.ceph.mds.c:Started 2024-05-30T17:02:45.096 DEBUG:teuthology.parallel:result is None 2024-05-30T17:02:45.104 INFO:tasks.ceph.mds.d:Started 2024-05-30T17:02:45.104 DEBUG:teuthology.parallel:result is None 2024-05-30T17:02:45.106 INFO:tasks.ceph.mds.b:Started 2024-05-30T17:02:45.106 DEBUG:teuthology.parallel:result is None 2024-05-30T17:02:45.106 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T17:02:45.181 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T17:02:45.181 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-05-30T17:02:45.198 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-30T17:02:45.198 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-30T17:02:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.250+0000 7f68ba200640 1 Processor -- start 2024-05-30T17:02:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.250+0000 7f68ba200640 1 -- start start 2024-05-30T17:02:45.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.250+0000 7f68ba200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68b406e900 0x7f68b415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:45.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.250+0000 7f68ba200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68b40d0560 0x7f68b40d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:45.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.250+0000 7f68ba200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b415f060 con 0x7f68b40af720 2024-05-30T17:02:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.250+0000 7f68ba200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f68b40afb00 con 0x7f68b40d0560 2024-05-30T17:02:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.250+0000 7f68ba200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f68b415c270 con 0x7f68b406e900 2024-05-30T17:02:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68b40d0560 0x7f68b40d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68b40d0560 0x7f68b40d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38286/0 (socket says 172.21.15.59:38286) 2024-05-30T17:02:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b3400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f68b40af720 0x7f68b415b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43682/0 (socket says 172.21.15.59:43682) 2024-05-30T17:02:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b3e00640 1 -- 172.21.15.59:0/2213706257 learned_addr learned my addr 172.21.15.59:0/2213706257 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68aaa00640 1 --2- 172.21.15.59:0/2213706257 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68b406e900 0x7f68b415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b3e00640 1 -- 172.21.15.59:0/2213706257 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68b406e900 msgr2=0x7f68b415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b3e00640 1 --2- 172.21.15.59:0/2213706257 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68b406e900 0x7f68b415f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b3e00640 1 -- 172.21.15.59:0/2213706257 >> v1:172.21.15.59:6789/0 conn(0x7f68b40af720 legacy=0x7f68b415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b3e00640 1 -- 172.21.15.59:0/2213706257 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b415c550 con 0x7f68b40d0560 2024-05-30T17:02:45.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b2a00640 1 -- 172.21.15.59:0/2213706257 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 501618305 0 0) 0x7f68b415f060 con 0x7f68b40af720 2024-05-30T17:02:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b3e00640 1 --2- 172.21.15.59:0/2213706257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40d0560 0x7f68b40d0a10 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009e50 tx=0x7f68ac01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7d7ef2fe3dcd9d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b2a00640 1 -- 172.21.15.59:0/2213706257 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0a5750 con 0x7f68b40d0560 2024-05-30T17:02:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b2a00640 1 -- 172.21.15.59:0/2213706257 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ac0a58f0 con 0x7f68b40d0560 2024-05-30T17:02:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.254+0000 7f68b2a00640 1 -- 172.21.15.59:0/2213706257 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0a5cc0 con 0x7f68b40d0560 2024-05-30T17:02:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 -- 172.21.15.59:0/2213706257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40d0560 msgr2=0x7f68b40d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 --2- 172.21.15.59:0/2213706257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40d0560 0x7f68b40d0a10 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009e50 tx=0x7f68ac01ca30 comp rx=0 tx=0).stop 2024-05-30T17:02:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 -- 172.21.15.59:0/2213706257 shutdown_connections 2024-05-30T17:02:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 --2- 172.21.15.59:0/2213706257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40d0560 0x7f68b40d0a10 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:45.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 --2- 172.21.15.59:0/2213706257 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68b406e900 0x7f68b415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:45.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 -- 172.21.15.59:0/2213706257 >> 172.21.15.59:0/2213706257 conn(0x7f68b40b22d0 msgr2=0x7f68b40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:45.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 -- 172.21.15.59:0/2213706257 shutdown_connections 2024-05-30T17:02:45.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 -- 172.21.15.59:0/2213706257 wait complete. 2024-05-30T17:02:45.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 Processor -- start 2024-05-30T17:02:45.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 -- start start 2024-05-30T17:02:45.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68b406e900 0x7f68b4153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:45.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40af720 0x7f68b4156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:45.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68b40d0560 0x7f68b4154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:45.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f68b4073150 con 0x7f68b40af720 2024-05-30T17:02:45.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f68b40732d0 con 0x7f68b406e900 2024-05-30T17:02:45.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68ba200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f68b41585c0 con 0x7f68b40d0560 2024-05-30T17:02:45.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68aaa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40af720 0x7f68b4156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:45.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68aaa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40af720 0x7f68b4156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38296/0 (socket says 172.21.15.59:38296) 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68aaa00640 1 -- 172.21.15.59:0/2692917621 learned_addr learned my addr 172.21.15.59:0/2692917621 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68b3e00640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68b40d0560 0x7f68b4154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68b3400640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68b406e900 0x7f68b4153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68aaa00640 1 -- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68b40d0560 msgr2=0x7f68b4154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68aaa00640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68b40d0560 0x7f68b4154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68aaa00640 1 -- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68b406e900 msgr2=0x7f68b4153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68aaa00640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68b406e900 0x7f68b4153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.258+0000 7f68aaa00640 1 -- 172.21.15.59:0/2692917621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b4158de0 con 0x7f68b40af720 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.262+0000 7f68aaa00640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40af720 0x7f68b4156ac0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f689c00e900 tx=0x7f689c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.262+0000 7f68abe00640 1 -- 172.21.15.59:0/2692917621 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c017070 con 0x7f68b40af720 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.262+0000 7f68abe00640 1 -- 172.21.15.59:0/2692917621 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c00ca00 con 0x7f68b40af720 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.262+0000 7f68ba200640 1 -- 172.21.15.59:0/2692917621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b41590c0 con 0x7f68b40af720 2024-05-30T17:02:45.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.262+0000 7f68abe00640 1 -- 172.21.15.59:0/2692917621 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c00cdd0 con 0x7f68b40af720 2024-05-30T17:02:45.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.262+0000 7f68ba200640 1 -- 172.21.15.59:0/2692917621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b4159680 con 0x7f68b40af720 2024-05-30T17:02:45.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.262+0000 7f68ba200640 1 -- 172.21.15.59:0/2692917621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b4068a90 con 0x7f68b40af720 2024-05-30T17:02:45.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.262+0000 7f68abe00640 1 -- 172.21.15.59:0/2692917621 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f689c01a070 con 0x7f68b40af720 2024-05-30T17:02:45.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.262+0000 7f68abe00640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6890069b20 0x7f689006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:45.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.262+0000 7f68abe00640 1 -- 172.21.15.59:0/2692917621 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5055+0+0 (secure 0 0 0) 0x7f689c085f90 con 0x7f68b40af720 2024-05-30T17:02:45.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.262+0000 7f68b3400640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6890069b20 0x7f689006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:45.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.266+0000 7f68b3400640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6890069b20 0x7f689006bfe0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f68a4000f70 tx=0x7f68a4007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:45.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.266+0000 7f68abe00640 1 -- 172.21.15.59:0/2692917621 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f689c058030 con 0x7f68b40af720 2024-05-30T17:02:45.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:45.446+0000 7f68ba200640 1 -- 172.21.15.59:0/2692917621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f68b40b01c0 con 0x7f68b40af720 2024-05-30T17:02:46.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.002+0000 7f68abe00640 1 -- 172.21.15.59:0/2692917621 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v110) ==== 97+0+0 (secure 0 0 0) 0x7f689c057930 con 0x7f68b40af720 2024-05-30T17:02:46.007 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-05-30T17:02:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.006+0000 7f68ba200640 1 -- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6890069b20 msgr2=0x7f689006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.006+0000 7f68ba200640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6890069b20 0x7f689006bfe0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f68a4000f70 tx=0x7f68a4007b60 comp rx=0 tx=0).stop 2024-05-30T17:02:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.006+0000 7f68ba200640 1 -- 172.21.15.59:0/2692917621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40af720 msgr2=0x7f68b4156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.006+0000 7f68ba200640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40af720 0x7f68b4156ac0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f689c00e900 tx=0x7f689c00edc0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.006+0000 7f68ba200640 1 -- 172.21.15.59:0/2692917621 shutdown_connections 2024-05-30T17:02:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.006+0000 7f68ba200640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6890069b20 0x7f689006bfe0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.006+0000 7f68ba200640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68b40d0560 0x7f68b4154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.006+0000 7f68ba200640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40af720 0x7f68b4156ac0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.006+0000 7f68ba200640 1 --2- 172.21.15.59:0/2692917621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68b406e900 0x7f68b4153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.006+0000 7f68ba200640 1 -- 172.21.15.59:0/2692917621 >> 172.21.15.59:0/2692917621 conn(0x7f68b40b22d0 msgr2=0x7f68b4073660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.006+0000 7f68ba200640 1 -- 172.21.15.59:0/2692917621 shutdown_connections 2024-05-30T17:02:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.006+0000 7f68ba200640 1 -- 172.21.15.59:0/2692917621 wait complete. 2024-05-30T17:02:46.033 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T17:02:46.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea53e00640 1 Processor -- start 2024-05-30T17:02:46.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea53e00640 1 -- start start 2024-05-30T17:02:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea53e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fea540ce420 0x7fea540b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea53e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea540b39b0 0x7fea5406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea53e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea5406dab0 0x7fea5406d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea53e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fea540cc9c0 con 0x7fea540b39b0 2024-05-30T17:02:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea53e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fea540ce800 con 0x7fea540ce420 2024-05-30T17:02:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea53e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fea5409b450 con 0x7fea5406dab0 2024-05-30T17:02:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea4be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea540b39b0 0x7fea5406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea4be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea540b39b0 0x7fea5406cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38308/0 (socket says 172.21.15.59:38308) 2024-05-30T17:02:46.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea4be00640 1 -- 172.21.15.59:0/1629749292 learned_addr learned my addr 172.21.15.59:0/1629749292 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:46.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea52a00640 1 --2- 172.21.15.59:0/1629749292 >> v2:172.21.15.107:3300/0 conn(0x7fea540ce420 0x7fea540b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea53400640 1 --2- 172.21.15.59:0/1629749292 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea5406dab0 0x7fea5406d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea4be00640 1 -- 172.21.15.59:0/1629749292 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea5406dab0 msgr2=0x7fea5406d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:46.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea4be00640 1 --2- 172.21.15.59:0/1629749292 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea5406dab0 0x7fea5406d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea4be00640 1 -- 172.21.15.59:0/1629749292 >> v2:172.21.15.107:3300/0 conn(0x7fea540ce420 msgr2=0x7fea540b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:46.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea4be00640 1 --2- 172.21.15.59:0/1629749292 >> v2:172.21.15.107:3300/0 conn(0x7fea540ce420 0x7fea540b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea4be00640 1 -- 172.21.15.59:0/1629749292 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5409b730 con 0x7fea540b39b0 2024-05-30T17:02:46.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.174+0000 7fea53400640 1 --2- 172.21.15.59:0/1629749292 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea5406dab0 0x7fea5406d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:46.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea4be00640 1 --2- 172.21.15.59:0/1629749292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea540b39b0 0x7fea5406cef0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fea5406c990 tx=0x7fea3c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eca3e13643a4d5f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:46.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea52000640 1 -- 172.21.15.59:0/1629749292 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0b1070 con 0x7fea540b39b0 2024-05-30T17:02:46.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea52000640 1 -- 172.21.15.59:0/1629749292 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c0ac630 con 0x7fea540b39b0 2024-05-30T17:02:46.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea52000640 1 -- 172.21.15.59:0/1629749292 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0a8050 con 0x7fea540b39b0 2024-05-30T17:02:46.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea53e00640 1 -- 172.21.15.59:0/1629749292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea540b39b0 msgr2=0x7fea5406cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea53e00640 1 --2- 172.21.15.59:0/1629749292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea540b39b0 0x7fea5406cef0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fea5406c990 tx=0x7fea3c01c520 comp rx=0 tx=0).stop 2024-05-30T17:02:46.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea53e00640 1 -- 172.21.15.59:0/1629749292 shutdown_connections 2024-05-30T17:02:46.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea53e00640 1 --2- 172.21.15.59:0/1629749292 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea5406dab0 0x7fea5406d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea53e00640 1 --2- 172.21.15.59:0/1629749292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea540b39b0 0x7fea5406cef0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea53e00640 1 --2- 172.21.15.59:0/1629749292 >> v2:172.21.15.107:3300/0 conn(0x7fea540ce420 0x7fea540b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea53e00640 1 -- 172.21.15.59:0/1629749292 >> 172.21.15.59:0/1629749292 conn(0x7fea540d2370 msgr2=0x7fea540d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:46.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea53e00640 1 -- 172.21.15.59:0/1629749292 shutdown_connections 2024-05-30T17:02:46.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea53e00640 1 -- 172.21.15.59:0/1629749292 wait complete. 2024-05-30T17:02:46.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea53e00640 1 Processor -- start 2024-05-30T17:02:46.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.178+0000 7fea53e00640 1 -- start start 2024-05-30T17:02:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea53e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea5406dab0 0x7fea54158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea53e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea540b39b0 0x7fea54160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea53e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea540ce420 0x7fea54154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea53e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fea540b26e0 con 0x7fea5406dab0 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea53e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fea540b2560 con 0x7fea540ce420 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea53e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fea540b2860 con 0x7fea540b39b0 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea52a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea5406dab0 0x7fea54158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea52a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea5406dab0 0x7fea54158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38310/0 (socket says 172.21.15.59:38310) 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea52a00640 1 -- 172.21.15.59:0/2888699142 learned_addr learned my addr 172.21.15.59:0/2888699142 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea53400640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea540ce420 0x7fea54154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea4be00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea540b39b0 0x7fea54160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea52a00640 1 -- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea540b39b0 msgr2=0x7fea54160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea52a00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea540b39b0 0x7fea54160150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea52a00640 1 -- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea540ce420 msgr2=0x7fea54154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea52a00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea540ce420 0x7fea54154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea52a00640 1 -- 172.21.15.59:0/2888699142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea54158ee0 con 0x7fea5406dab0 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea52a00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea5406dab0 0x7fea54158900 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fea4400d620 tx=0x7fea4400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea4aa00640 1 -- 172.21.15.59:0/2888699142 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4400b620 con 0x7fea5406dab0 2024-05-30T17:02:46.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea4aa00640 1 -- 172.21.15.59:0/2888699142 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea44019070 con 0x7fea5406dab0 2024-05-30T17:02:46.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea53e00640 1 -- 172.21.15.59:0/2888699142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea541591c0 con 0x7fea5406dab0 2024-05-30T17:02:46.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea4aa00640 1 -- 172.21.15.59:0/2888699142 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4400b9e0 con 0x7fea5406dab0 2024-05-30T17:02:46.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea53e00640 1 -- 172.21.15.59:0/2888699142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea541550f0 con 0x7fea5406dab0 2024-05-30T17:02:46.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea53e00640 1 -- 172.21.15.59:0/2888699142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea540691a0 con 0x7fea5406dab0 2024-05-30T17:02:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.182+0000 7fea4aa00640 1 -- 172.21.15.59:0/2888699142 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fea4400bb80 con 0x7fea5406dab0 2024-05-30T17:02:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.186+0000 7fea4aa00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fea30069b50 0x7fea3006c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.186+0000 7fea4aa00640 1 -- 172.21.15.59:0/2888699142 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4969+0+0 (secure 0 0 0) 0x7fea44085990 con 0x7fea5406dab0 2024-05-30T17:02:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.186+0000 7fea4be00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fea30069b50 0x7fea3006c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.186+0000 7fea4be00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fea30069b50 0x7fea3006c010 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0ae000 tx=0x7fea3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:46.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.190+0000 7fea4aa00640 1 -- 172.21.15.59:0/2888699142 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fea44057360 con 0x7fea5406dab0 2024-05-30T17:02:46.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 -- 172.21.15.59:0/2888699142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fea5406ff50 con 0x7fea5406dab0 2024-05-30T17:02:46.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea4aa00640 1 -- 172.21.15.59:0/2888699142 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7fea4405b660 con 0x7fea5406dab0 2024-05-30T17:02:46.413 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmAAjIJhAA5/FZHJtfSZuYcD6bEfCGDA==", 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmELVkMxAA/vOsM3Z0z4YEmUqoPtrPBQ==", 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmD2pGLhAAWmDw/02mc8T7upvRXnj1yw==", 2024-05-30T17:02:46.415 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmYLbYOhAAxggGfPZU/ryu+8vciSXjUw==", 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:02:46.416 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDJrVhmU0fpBhAA2tKWGJF24DlEjG+iuO4djg==", 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDMrVhmxE2HERAA4N9Bsb0fxl5GERpgyKCl6Q==", 2024-05-30T17:02:46.417 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDPrVhm6v7AGhAAqOQCN90pL0AmnXYIPIb48A==", 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.418 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSrVhm3BEDJxAA4SOWC/qF90R9ivrCvN92ZA==", 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDYrVhmFzmDHhAAQtbXd6haolYB98wfEbpvTQ==", 2024-05-30T17:02:46.419 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDbrVhmHqkEKRAAKfFPdTqaVhBNnc5lKeEFpg==", 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDerVhm72bzMBAA+FfnxIOnkESuTervY23ruw==", 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDhrVhmXGv/OhAAr2k7IXDA9VDi9ZJwrQ+u6A==", 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA==", 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmncPjDBAAWEJOkxm9xfRjonO6U1hO6A==", 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmvlFFCRAAZCq7ijfrVqy8Ukh7jKZESQ==", 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:02:46.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmcpjuEhAA0q+PfNy0IWhqQSiIZuyBlg==", 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T17:02:46.424 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmnikpCxAA6Q4udmvjQXBmC4f1irI2Xg==", 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-05-30T17:02:46.425 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmWZq9IhAAFuEZeFiLGCitIiNARjoDTA==", 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhm0UKsHhAAimqtE18XjW/1vA7uMsJmEw==", 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T17:02:46.426 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:02:46.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.427 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-05-30T17:02:46.427 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:02:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 -- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fea30069b50 msgr2=0x7fea3006c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fea30069b50 0x7fea3006c010 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0ae000 tx=0x7fea3c009040 comp rx=0 tx=0).stop 2024-05-30T17:02:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 -- 172.21.15.59:0/2888699142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea5406dab0 msgr2=0x7fea54158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea5406dab0 0x7fea54158900 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fea4400d620 tx=0x7fea4400dae0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 -- 172.21.15.59:0/2888699142 shutdown_connections 2024-05-30T17:02:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fea30069b50 0x7fea3006c010 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea540ce420 0x7fea54154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea540b39b0 0x7fea54160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 --2- 172.21.15.59:0/2888699142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea5406dab0 0x7fea54158900 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 -- 172.21.15.59:0/2888699142 >> 172.21.15.59:0/2888699142 conn(0x7fea540d2370 msgr2=0x7fea540715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 -- 172.21.15.59:0/2888699142 shutdown_connections 2024-05-30T17:02:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.410+0000 7fea53e00640 1 -- 172.21.15.59:0/2888699142 wait complete. 2024-05-30T17:02:46.435 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T17:02:46.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0f7200640 1 Processor -- start 2024-05-30T17:02:46.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0f7200640 1 -- start start 2024-05-30T17:02:46.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0f7200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0f006c0c0 0x7ff0f00cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0f7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0f00b3a70 0x7ff0f00b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0f7200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f00c4cf0 con 0x7ff0f015c890 2024-05-30T17:02:46.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0f7200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f00ce160 con 0x7ff0f006c0c0 2024-05-30T17:02:46.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0f7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f00ce440 con 0x7ff0f00b3a70 2024-05-30T17:02:46.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0efe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff0f015c890 0x7ff0f006b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43690/0 (socket says 172.21.15.59:43690) 2024-05-30T17:02:46.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0efe00640 1 -- 172.21.15.59:0/461885221 learned_addr learned my addr 172.21.15.59:0/461885221 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:46.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0ef400640 1 --2- 172.21.15.59:0/461885221 >> v2:172.21.15.59:3300/0 conn(0x7ff0f006c0c0 0x7ff0f00cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0f5200640 1 --2- 172.21.15.59:0/461885221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0f00b3a70 0x7ff0f00b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0eea00640 1 -- 172.21.15.59:0/461885221 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648564167 0 0) 0x7ff0f00c4cf0 con 0x7ff0f015c890 2024-05-30T17:02:46.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0eea00640 1 -- 172.21.15.59:0/461885221 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0d4003530 con 0x7ff0f015c890 2024-05-30T17:02:46.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0ef400640 1 -- 172.21.15.59:0/461885221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0f00b3a70 msgr2=0x7ff0f00b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:46.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0ef400640 1 --2- 172.21.15.59:0/461885221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0f00b3a70 0x7ff0f00b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0ef400640 1 -- 172.21.15.59:0/461885221 >> v1:172.21.15.59:6789/0 conn(0x7ff0f015c890 legacy=0x7ff0f006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.574+0000 7ff0ef400640 1 -- 172.21.15.59:0/461885221 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f00ce720 con 0x7ff0f006c0c0 2024-05-30T17:02:46.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0ef400640 1 --2- 172.21.15.59:0/461885221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f006c0c0 0x7ff0f00cda60 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0097c0 tx=0x7ff0dc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d1236fff9a5a9b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:46.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0eea00640 1 -- 172.21.15.59:0/461885221 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0b1070 con 0x7ff0f006c0c0 2024-05-30T17:02:46.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0eea00640 1 -- 172.21.15.59:0/461885221 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc0ac410 con 0x7ff0f006c0c0 2024-05-30T17:02:46.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0eea00640 1 -- 172.21.15.59:0/461885221 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0ac7e0 con 0x7ff0f006c0c0 2024-05-30T17:02:46.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0f7200640 1 -- 172.21.15.59:0/461885221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f006c0c0 msgr2=0x7ff0f00cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0f7200640 1 --2- 172.21.15.59:0/461885221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f006c0c0 0x7ff0f00cda60 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0097c0 tx=0x7ff0dc01c4a0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0f7200640 1 -- 172.21.15.59:0/461885221 shutdown_connections 2024-05-30T17:02:46.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0f7200640 1 --2- 172.21.15.59:0/461885221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0f00b3a70 0x7ff0f00b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0f7200640 1 --2- 172.21.15.59:0/461885221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f006c0c0 0x7ff0f00cda60 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0f7200640 1 -- 172.21.15.59:0/461885221 >> 172.21.15.59:0/461885221 conn(0x7ff0f00b2f50 msgr2=0x7ff0f00b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:46.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0f7200640 1 -- 172.21.15.59:0/461885221 shutdown_connections 2024-05-30T17:02:46.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0f7200640 1 -- 172.21.15.59:0/461885221 wait complete. 2024-05-30T17:02:46.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0f7200640 1 Processor -- start 2024-05-30T17:02:46.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.578+0000 7ff0f7200640 1 -- start start 2024-05-30T17:02:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0f006c0c0 0x7ff0f015da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0f00b3a70 0x7ff0f0158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f015c890 0x7ff0f0159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f00b1f20 con 0x7ff0f015c890 2024-05-30T17:02:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f00b1da0 con 0x7ff0f00b3a70 2024-05-30T17:02:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f00b20a0 con 0x7ff0f006c0c0 2024-05-30T17:02:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f015c890 0x7ff0f0159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f015c890 0x7ff0f0159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38332/0 (socket says 172.21.15.59:38332) 2024-05-30T17:02:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f5200640 1 -- 172.21.15.59:0/3023570951 learned_addr learned my addr 172.21.15.59:0/3023570951 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0ef400640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0f00b3a70 0x7ff0f0158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0efe00640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0f006c0c0 0x7ff0f015da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f5200640 1 -- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0f006c0c0 msgr2=0x7ff0f015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f5200640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0f006c0c0 0x7ff0f015da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f5200640 1 -- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0f00b3a70 msgr2=0x7ff0f0158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f5200640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0f00b3a70 0x7ff0f0158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f5200640 1 -- 172.21.15.59:0/3023570951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f0160320 con 0x7ff0f015c890 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0ef400640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0f00b3a70 0x7ff0f0158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f5200640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f015c890 0x7ff0f0159100 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800efc0 tx=0x7ff0e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0e7e00640 1 -- 172.21.15.59:0/3023570951 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8018020 con 0x7ff0f015c890 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0e7e00640 1 -- 172.21.15.59:0/3023570951 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e8014480 con 0x7ff0f015c890 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0e7e00640 1 -- 172.21.15.59:0/3023570951 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8014870 con 0x7ff0f015c890 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f7200640 1 -- 172.21.15.59:0/3023570951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f0160600 con 0x7ff0f015c890 2024-05-30T17:02:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f7200640 1 -- 172.21.15.59:0/3023570951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f0160bc0 con 0x7ff0f015c890 2024-05-30T17:02:46.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.582+0000 7ff0f7200640 1 -- 172.21.15.59:0/3023570951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f0068a90 con 0x7ff0f015c890 2024-05-30T17:02:46.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.586+0000 7ff0e7e00640 1 -- 172.21.15.59:0/3023570951 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7ff0e801b020 con 0x7ff0f015c890 2024-05-30T17:02:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.586+0000 7ff0e7e00640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff0d0069b20 0x7ff0d006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.586+0000 7ff0e7e00640 1 -- 172.21.15.59:0/3023570951 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4969+0+0 (secure 0 0 0) 0x7ff0e8086bc0 con 0x7ff0f015c890 2024-05-30T17:02:46.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.586+0000 7ff0efe00640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff0d0069b20 0x7ff0d006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.586+0000 7ff0efe00640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff0d0069b20 0x7ff0d006bfe0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0005890 tx=0x7ff0e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:46.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.590+0000 7ff0e7e00640 1 -- 172.21.15.59:0/3023570951 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff0e8022030 con 0x7ff0f015c890 2024-05-30T17:02:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.754+0000 7ff0f7200640 1 -- 172.21.15.59:0/3023570951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff0f00b36b0 con 0x7ff0f015c890 2024-05-30T17:02:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.754+0000 7ff0e7e00640 1 -- 172.21.15.59:0/3023570951 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v112) ==== 84+0+65 (secure 0 0 0) 0x7ff0e8010040 con 0x7ff0f015c890 2024-05-30T17:02:46.760 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:46.760 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:02:46.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:46.760 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-05-30T17:02:46.760 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-05-30T17:02:46.760 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:46.760 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.758+0000 7ff0f7200640 1 -- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff0d0069b20 msgr2=0x7ff0d006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.758+0000 7ff0f7200640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff0d0069b20 0x7ff0d006bfe0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0005890 tx=0x7ff0e0009040 comp rx=0 tx=0).stop 2024-05-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.758+0000 7ff0f7200640 1 -- 172.21.15.59:0/3023570951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f015c890 msgr2=0x7ff0f0159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.758+0000 7ff0f7200640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f015c890 0x7ff0f0159100 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800efc0 tx=0x7ff0e800c490 comp rx=0 tx=0).stop 2024-05-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.758+0000 7ff0f7200640 1 -- 172.21.15.59:0/3023570951 shutdown_connections 2024-05-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.758+0000 7ff0f7200640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff0d0069b20 0x7ff0d006bfe0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.758+0000 7ff0f7200640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f015c890 0x7ff0f0159100 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.758+0000 7ff0f7200640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0f00b3a70 0x7ff0f0158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.758+0000 7ff0f7200640 1 --2- 172.21.15.59:0/3023570951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0f006c0c0 0x7ff0f015da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.758+0000 7ff0f7200640 1 -- 172.21.15.59:0/3023570951 >> 172.21.15.59:0/3023570951 conn(0x7ff0f00b2f50 msgr2=0x7ff0f0070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.758+0000 7ff0f7200640 1 -- 172.21.15.59:0/3023570951 shutdown_connections 2024-05-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.758+0000 7ff0f7200640 1 -- 172.21.15.59:0/3023570951 wait complete. 2024-05-30T17:02:46.781 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T17:02:46.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T17:02:46.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f6a000640 1 Processor -- start 2024-05-30T17:02:46.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f6a000640 1 -- start start 2024-05-30T17:02:46.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f6a000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1f64156e40 0x7f1f6406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f6a000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1f6406dc60 0x7f1f6415d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f6a000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f640af130 0x7f1f640af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f6a000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1f6415db80 con 0x7f1f640af130 2024-05-30T17:02:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f6a000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1f6406e120 con 0x7f1f64156e40 2024-05-30T17:02:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f6a000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6406e400 con 0x7f1f6406dc60 2024-05-30T17:02:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f63e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f640af130 0x7f1f640af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f63e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f640af130 0x7f1f640af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38340/0 (socket says 172.21.15.59:38340) 2024-05-30T17:02:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f63e00640 1 -- 172.21.15.59:0/2157584127 learned_addr learned my addr 172.21.15.59:0/2157584127 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f63400640 1 --2- 172.21.15.59:0/2157584127 >> v2:172.21.15.107:3300/0 conn(0x7f1f64156e40 0x7f1f6406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f5aa00640 1 --2- 172.21.15.59:0/2157584127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1f6406dc60 0x7f1f6415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f63e00640 1 -- 172.21.15.59:0/2157584127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1f6406dc60 msgr2=0x7f1f6415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f63e00640 1 --2- 172.21.15.59:0/2157584127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1f6406dc60 0x7f1f6415d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f63e00640 1 -- 172.21.15.59:0/2157584127 >> v2:172.21.15.107:3300/0 conn(0x7f1f64156e40 msgr2=0x7f1f6406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:46.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f63e00640 1 --2- 172.21.15.59:0/2157584127 >> v2:172.21.15.107:3300/0 conn(0x7f1f64156e40 0x7f1f6406f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.922+0000 7f1f63e00640 1 -- 172.21.15.59:0/2157584127 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6406e6e0 con 0x7f1f640af130 2024-05-30T17:02:46.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f63e00640 1 --2- 172.21.15.59:0/2157584127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f640af130 0x7f1f640af580 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f1f64073f70 tx=0x7f1f5c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1498ccb226dace server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:46.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f62a00640 1 -- 172.21.15.59:0/2157584127 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0a5760 con 0x7f1f640af130 2024-05-30T17:02:46.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f62a00640 1 -- 172.21.15.59:0/2157584127 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5c0a5900 con 0x7f1f640af130 2024-05-30T17:02:46.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f62a00640 1 -- 172.21.15.59:0/2157584127 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0a5cd0 con 0x7f1f640af130 2024-05-30T17:02:46.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f6a000640 1 -- 172.21.15.59:0/2157584127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f640af130 msgr2=0x7f1f640af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f6a000640 1 --2- 172.21.15.59:0/2157584127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f640af130 0x7f1f640af580 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f1f64073f70 tx=0x7f1f5c01c9f0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f6a000640 1 -- 172.21.15.59:0/2157584127 shutdown_connections 2024-05-30T17:02:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f6a000640 1 --2- 172.21.15.59:0/2157584127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f640af130 0x7f1f640af580 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f6a000640 1 --2- 172.21.15.59:0/2157584127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1f6406dc60 0x7f1f6415d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f6a000640 1 --2- 172.21.15.59:0/2157584127 >> v2:172.21.15.107:3300/0 conn(0x7f1f64156e40 0x7f1f6406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f6a000640 1 -- 172.21.15.59:0/2157584127 >> 172.21.15.59:0/2157584127 conn(0x7f1f640b1e60 msgr2=0x7f1f640b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f6a000640 1 -- 172.21.15.59:0/2157584127 shutdown_connections 2024-05-30T17:02:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.926+0000 7f1f6a000640 1 -- 172.21.15.59:0/2157584127 wait complete. 2024-05-30T17:02:46.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f6a000640 1 Processor -- start 2024-05-30T17:02:46.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f6a000640 1 -- start start 2024-05-30T17:02:46.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f6a000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6406dc60 0x7f1f64071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f6a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f640af130 0x7f1f64154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f6a000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1f64156e40 0x7f1f64152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f6a000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6415e920 con 0x7f1f640af130 2024-05-30T17:02:46.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f6a000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6415e7a0 con 0x7f1f6406dc60 2024-05-30T17:02:46.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f6a000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6415eaa0 con 0x7f1f64156e40 2024-05-30T17:02:46.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f5aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f640af130 0x7f1f64154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f5aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f640af130 0x7f1f64154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38352/0 (socket says 172.21.15.59:38352) 2024-05-30T17:02:46.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f5aa00640 1 -- 172.21.15.59:0/489272283 learned_addr learned my addr 172.21.15.59:0/489272283 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:46.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f5aa00640 1 -- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1f64156e40 msgr2=0x7f1f64152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f63400640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6406dc60 0x7f1f64071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f63e00640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1f64156e40 0x7f1f64152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f5aa00640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1f64156e40 0x7f1f64152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f5aa00640 1 -- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6406dc60 msgr2=0x7f1f64071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:46.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f5aa00640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6406dc60 0x7f1f64071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:46.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f5aa00640 1 -- 172.21.15.59:0/489272283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f64072340 con 0x7f1f640af130 2024-05-30T17:02:46.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f63400640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6406dc60 0x7f1f64071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:46.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f63e00640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1f64156e40 0x7f1f64152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:46.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f5aa00640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f640af130 0x7f1f64154e50 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00d800 tx=0x7f1f4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:46.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f5be00640 1 -- 172.21.15.59:0/489272283 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c018020 con 0x7f1f640af130 2024-05-30T17:02:46.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f5be00640 1 -- 172.21.15.59:0/489272283 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4c0096a0 con 0x7f1f640af130 2024-05-30T17:02:46.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f5be00640 1 -- 172.21.15.59:0/489272283 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c009a50 con 0x7f1f640af130 2024-05-30T17:02:46.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f6a000640 1 -- 172.21.15.59:0/489272283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f64072620 con 0x7f1f640af130 2024-05-30T17:02:46.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.930+0000 7f1f6a000640 1 -- 172.21.15.59:0/489272283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f64072be0 con 0x7f1f640af130 2024-05-30T17:02:46.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.934+0000 7f1f6a000640 1 -- 172.21.15.59:0/489272283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f64068a90 con 0x7f1f640af130 2024-05-30T17:02:46.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.934+0000 7f1f5be00640 1 -- 172.21.15.59:0/489272283 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f1f4c01b020 con 0x7f1f640af130 2024-05-30T17:02:46.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.934+0000 7f1f5be00640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1f40069b50 0x7f1f4006c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:46.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.934+0000 7f1f5be00640 1 -- 172.21.15.59:0/489272283 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4969+0+0 (secure 0 0 0) 0x7f1f4c085d00 con 0x7f1f640af130 2024-05-30T17:02:46.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.934+0000 7f1f63400640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1f40069b50 0x7f1f4006c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:46.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.934+0000 7f1f63400640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1f40069b50 0x7f1f4006c010 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1f64152ab0 tx=0x7f1f54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:46.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:46.938+0000 7f1f5be00640 1 -- 172.21.15.59:0/489272283 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f4c022020 con 0x7f1f640af130 2024-05-30T17:02:47.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:47.106+0000 7f1f6a000640 1 -- 172.21.15.59:0/489272283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1f6406fab0 con 0x7f1f640af130 2024-05-30T17:02:48.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.014+0000 7f1f5be00640 1 -- 172.21.15.59:0/489272283 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v113) ==== 138+0+0 (secure 0 0 0) 0x7f1f4c057d20 con 0x7f1f640af130 2024-05-30T17:02:48.019 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-05-30T17:02:48.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.018+0000 7f1f6a000640 1 -- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1f40069b50 msgr2=0x7f1f4006c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:48.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.018+0000 7f1f6a000640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1f40069b50 0x7f1f4006c010 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1f64152ab0 tx=0x7f1f54008040 comp rx=0 tx=0).stop 2024-05-30T17:02:48.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.018+0000 7f1f6a000640 1 -- 172.21.15.59:0/489272283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f640af130 msgr2=0x7f1f64154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:48.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.018+0000 7f1f6a000640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f640af130 0x7f1f64154e50 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00d800 tx=0x7f1f4c00dcc0 comp rx=0 tx=0).stop 2024-05-30T17:02:48.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.018+0000 7f1f6a000640 1 -- 172.21.15.59:0/489272283 shutdown_connections 2024-05-30T17:02:48.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.018+0000 7f1f6a000640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1f40069b50 0x7f1f4006c010 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:48.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.018+0000 7f1f6a000640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1f64156e40 0x7f1f64152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:48.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.018+0000 7f1f6a000640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f640af130 0x7f1f64154e50 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:48.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.018+0000 7f1f6a000640 1 --2- 172.21.15.59:0/489272283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6406dc60 0x7f1f64071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:48.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.018+0000 7f1f6a000640 1 -- 172.21.15.59:0/489272283 >> 172.21.15.59:0/489272283 conn(0x7f1f640b1e60 msgr2=0x7f1f64160140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:48.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.018+0000 7f1f6a000640 1 -- 172.21.15.59:0/489272283 shutdown_connections 2024-05-30T17:02:48.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.018+0000 7f1f6a000640 1 -- 172.21.15.59:0/489272283 wait complete. 2024-05-30T17:02:48.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T17:02:48.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f198a800640 1 Processor -- start 2024-05-30T17:02:48.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f198a800640 1 -- start start 2024-05-30T17:02:48.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f198a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1984161c70 0x7f19840cca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:48.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f198a800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f198409b150 0x7f198409b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:48.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f198a800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19840d07c0 con 0x7f1984162050 2024-05-30T17:02:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f198a800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f198406de10 con 0x7f198409b150 2024-05-30T17:02:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f198a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f198406d570 con 0x7f1984161c70 2024-05-30T17:02:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f197aa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1984162050 0x7f198409aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43694/0 (socket says 172.21.15.59:43694) 2024-05-30T17:02:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f197aa00640 1 -- 172.21.15.59:0/1776236635 learned_addr learned my addr 172.21.15.59:0/1776236635 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f1983400640 1 --2- 172.21.15.59:0/1776236635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1984161c70 0x7f19840cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f1983e00640 1 --2- 172.21.15.59:0/1776236635 >> v2:172.21.15.107:3300/0 conn(0x7f198409b150 0x7f198409b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f1982a00640 1 -- 172.21.15.59:0/1776236635 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861057727 0 0) 0x7f19840d07c0 con 0x7f1984162050 2024-05-30T17:02:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f1982a00640 1 -- 172.21.15.59:0/1776236635 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1968003530 con 0x7f1984162050 2024-05-30T17:02:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f1983400640 1 -- 172.21.15.59:0/1776236635 >> v2:172.21.15.107:3300/0 conn(0x7f198409b150 msgr2=0x7f198409b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f1983400640 1 --2- 172.21.15.59:0/1776236635 >> v2:172.21.15.107:3300/0 conn(0x7f198409b150 0x7f198409b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f1983400640 1 -- 172.21.15.59:0/1776236635 >> v1:172.21.15.59:6789/0 conn(0x7f1984162050 legacy=0x7f198409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.202+0000 7f1983400640 1 -- 172.21.15.59:0/1776236635 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198406d850 con 0x7f1984161c70 2024-05-30T17:02:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.206+0000 7f1983400640 1 --2- 172.21.15.59:0/1776236635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1984161c70 0x7f19840cca90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f19740097c0 tx=0x7f197401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40e635138fb59b4e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.206+0000 7f1982a00640 1 -- 172.21.15.59:0/1776236635 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19740b1070 con 0x7f1984161c70 2024-05-30T17:02:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.206+0000 7f1982a00640 1 -- 172.21.15.59:0/1776236635 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19740ac410 con 0x7f1984161c70 2024-05-30T17:02:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.206+0000 7f1982a00640 1 -- 172.21.15.59:0/1776236635 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19740ac7c0 con 0x7f1984161c70 2024-05-30T17:02:48.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.206+0000 7f198a800640 1 -- 172.21.15.59:0/1776236635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1984161c70 msgr2=0x7f19840cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:48.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.206+0000 7f198a800640 1 --2- 172.21.15.59:0/1776236635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1984161c70 0x7f19840cca90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f19740097c0 tx=0x7f197401c4a0 comp rx=0 tx=0).stop 2024-05-30T17:02:48.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.206+0000 7f198a800640 1 -- 172.21.15.59:0/1776236635 shutdown_connections 2024-05-30T17:02:48.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.206+0000 7f198a800640 1 --2- 172.21.15.59:0/1776236635 >> v2:172.21.15.107:3300/0 conn(0x7f198409b150 0x7f198409b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:48.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.206+0000 7f198a800640 1 --2- 172.21.15.59:0/1776236635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1984161c70 0x7f19840cca90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:48.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.206+0000 7f198a800640 1 -- 172.21.15.59:0/1776236635 >> 172.21.15.59:0/1776236635 conn(0x7f19840d2440 msgr2=0x7f19840d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:48.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.206+0000 7f198a800640 1 -- 172.21.15.59:0/1776236635 shutdown_connections 2024-05-30T17:02:48.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.206+0000 7f198a800640 1 -- 172.21.15.59:0/1776236635 wait complete. 2024-05-30T17:02:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f198a800640 1 Processor -- start 2024-05-30T17:02:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f198a800640 1 -- start start 2024-05-30T17:02:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f198a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f198409b150 0x7f19841489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f198a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1984161c70 0x7f19840affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f198a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1984162050 0x7f198415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f198a800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f19840d1840 con 0x7f1984162050 2024-05-30T17:02:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f198a800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f19840d16c0 con 0x7f198409b150 2024-05-30T17:02:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f198a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f19840d19c0 con 0x7f1984161c70 2024-05-30T17:02:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f1983e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1984162050 0x7f198415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f1983e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1984162050 0x7f198415adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38362/0 (socket says 172.21.15.59:38362) 2024-05-30T17:02:48.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f1983e00640 1 -- 172.21.15.59:0/275288750 learned_addr learned my addr 172.21.15.59:0/275288750 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:48.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f197aa00640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1984161c70 0x7f19840affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:48.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f1983400640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f198409b150 0x7f19841489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:48.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f1983e00640 1 -- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1984161c70 msgr2=0x7f19840affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:48.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f1983e00640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1984161c70 0x7f19840affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:48.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f1983e00640 1 -- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f198409b150 msgr2=0x7f19841489f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:48.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f1983e00640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f198409b150 0x7f19841489f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:48.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f1983e00640 1 -- 172.21.15.59:0/275288750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19840b04f0 con 0x7f1984162050 2024-05-30T17:02:48.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f197aa00640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1984161c70 0x7f19840affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:48.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f1983e00640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1984162050 0x7f198415adb0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f197c00ef90 tx=0x7f197c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:48.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f197be00640 1 -- 172.21.15.59:0/275288750 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c018020 con 0x7f1984162050 2024-05-30T17:02:48.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f197be00640 1 -- 172.21.15.59:0/275288750 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f197c014480 con 0x7f1984162050 2024-05-30T17:02:48.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f197be00640 1 -- 172.21.15.59:0/275288750 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c009e60 con 0x7f1984162050 2024-05-30T17:02:48.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f198a800640 1 -- 172.21.15.59:0/275288750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19840b07b0 con 0x7f1984162050 2024-05-30T17:02:48.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.210+0000 7f198a800640 1 -- 172.21.15.59:0/275288750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19840b0d70 con 0x7f1984162050 2024-05-30T17:02:48.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.214+0000 7f198a800640 1 -- 172.21.15.59:0/275288750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1984068a90 con 0x7f1984162050 2024-05-30T17:02:48.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.214+0000 7f197be00640 1 -- 172.21.15.59:0/275288750 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f197c01b020 con 0x7f1984162050 2024-05-30T17:02:48.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.214+0000 7f197be00640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1960069b20 0x7f196006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:48.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.214+0000 7f197be00640 1 -- 172.21.15.59:0/275288750 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5339+0+0 (secure 0 0 0) 0x7f197c0863a0 con 0x7f1984162050 2024-05-30T17:02:48.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.214+0000 7f1983400640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1960069b20 0x7f196006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:48.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.214+0000 7f1983400640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1960069b20 0x7f196006bfe0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f19740ae000 tx=0x7f19740a6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:48.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.218+0000 7f197be00640 1 -- 172.21.15.59:0/275288750 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f197c022030 con 0x7f1984162050 2024-05-30T17:02:48.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:48.382+0000 7f198a800640 1 -- 172.21.15.59:0/275288750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f19840b83c0 con 0x7f1984162050 2024-05-30T17:02:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.018+0000 7f197be00640 1 -- 172.21.15.59:0/275288750 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v114) ==== 170+0+0 (secure 0 0 0) 0x7f197c010040 con 0x7f1984162050 2024-05-30T17:02:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-05-30T17:02:49.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.022+0000 7f198a800640 1 -- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1960069b20 msgr2=0x7f196006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:49.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.022+0000 7f198a800640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1960069b20 0x7f196006bfe0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f19740ae000 tx=0x7f19740a6040 comp rx=0 tx=0).stop 2024-05-30T17:02:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.022+0000 7f198a800640 1 -- 172.21.15.59:0/275288750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1984162050 msgr2=0x7f198415adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.022+0000 7f198a800640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1984162050 0x7f198415adb0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f197c00ef90 tx=0x7f197c00c490 comp rx=0 tx=0).stop 2024-05-30T17:02:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.022+0000 7f198a800640 1 -- 172.21.15.59:0/275288750 shutdown_connections 2024-05-30T17:02:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.022+0000 7f198a800640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1960069b20 0x7f196006bfe0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.022+0000 7f198a800640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1984162050 0x7f198415adb0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.022+0000 7f198a800640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1984161c70 0x7f19840affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.022+0000 7f198a800640 1 --2- 172.21.15.59:0/275288750 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f198409b150 0x7f19841489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.022+0000 7f198a800640 1 -- 172.21.15.59:0/275288750 >> 172.21.15.59:0/275288750 conn(0x7f19840d2440 msgr2=0x7f19840b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.022+0000 7f198a800640 1 -- 172.21.15.59:0/275288750 shutdown_connections 2024-05-30T17:02:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.022+0000 7f198a800640 1 -- 172.21.15.59:0/275288750 wait complete. 2024-05-30T17:02:49.067 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T17:02:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb327800640 1 Processor -- start 2024-05-30T17:02:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb327800640 1 -- start start 2024-05-30T17:02:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb327800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3200d1d40 0x7fb3200cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb327800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3200d3c90 0x7fb3200b7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb327800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3200d4410 con 0x7fb320161e60 2024-05-30T17:02:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb327800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb320162240 con 0x7fb3200d1d40 2024-05-30T17:02:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb327800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb3200d5490 con 0x7fb3200d3c90 2024-05-30T17:02:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb317e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3200d1d40 0x7fb3200cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb324e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb320161e60 0x7fb3200d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43702/0 (socket says 172.21.15.59:43702) 2024-05-30T17:02:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb324e00640 1 -- 172.21.15.59:0/1523627441 learned_addr learned my addr 172.21.15.59:0/1523627441 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb325800640 1 --2- 172.21.15.59:0/1523627441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3200d3c90 0x7fb3200b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:49.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb317e00640 1 -- 172.21.15.59:0/1523627441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3200d3c90 msgr2=0x7fb3200b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:49.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb317e00640 1 --2- 172.21.15.59:0/1523627441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3200d3c90 0x7fb3200b7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:49.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb317e00640 1 -- 172.21.15.59:0/1523627441 >> v1:172.21.15.59:6789/0 conn(0x7fb320161e60 legacy=0x7fb3200d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:49.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb317e00640 1 -- 172.21.15.59:0/1523627441 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3200d46d0 con 0x7fb3200d1d40 2024-05-30T17:02:49.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.210+0000 7fb31fe00640 1 -- 172.21.15.59:0/1523627441 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887408045 0 0) 0x7fb3200d4410 con 0x7fb320161e60 2024-05-30T17:02:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.214+0000 7fb317e00640 1 --2- 172.21.15.59:0/1523627441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3200d1d40 0x7fb3200cf950 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fb3080097c0 tx=0x7fb30801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26e292eb2ee1b47 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.214+0000 7fb31fe00640 1 -- 172.21.15.59:0/1523627441 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3080b5070 con 0x7fb3200d1d40 2024-05-30T17:02:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.214+0000 7fb31fe00640 1 -- 172.21.15.59:0/1523627441 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3080a8990 con 0x7fb3200d1d40 2024-05-30T17:02:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.214+0000 7fb31fe00640 1 -- 172.21.15.59:0/1523627441 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3080a8d60 con 0x7fb3200d1d40 2024-05-30T17:02:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.214+0000 7fb327800640 1 -- 172.21.15.59:0/1523627441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3200d1d40 msgr2=0x7fb3200cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.214+0000 7fb327800640 1 --2- 172.21.15.59:0/1523627441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3200d1d40 0x7fb3200cf950 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fb3080097c0 tx=0x7fb30801ec90 comp rx=0 tx=0).stop 2024-05-30T17:02:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.214+0000 7fb327800640 1 -- 172.21.15.59:0/1523627441 shutdown_connections 2024-05-30T17:02:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.214+0000 7fb327800640 1 --2- 172.21.15.59:0/1523627441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3200d3c90 0x7fb3200b7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:49.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.214+0000 7fb327800640 1 --2- 172.21.15.59:0/1523627441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3200d1d40 0x7fb3200cf950 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:49.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.214+0000 7fb327800640 1 -- 172.21.15.59:0/1523627441 >> 172.21.15.59:0/1523627441 conn(0x7fb320067b60 msgr2=0x7fb320067f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:49.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.214+0000 7fb327800640 1 -- 172.21.15.59:0/1523627441 shutdown_connections 2024-05-30T17:02:49.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.214+0000 7fb327800640 1 -- 172.21.15.59:0/1523627441 wait complete. 2024-05-30T17:02:49.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb327800640 1 Processor -- start 2024-05-30T17:02:49.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb327800640 1 -- start start 2024-05-30T17:02:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb327800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3200d1d40 0x7fb3200cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb327800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3200d3c90 0x7fb320159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb327800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb320161e60 0x7fb320155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb327800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb3200d4f70 con 0x7fb3200d1d40 2024-05-30T17:02:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb327800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb3200d4c90 con 0x7fb320161e60 2024-05-30T17:02:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb327800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb3200d4100 con 0x7fb3200d3c90 2024-05-30T17:02:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb324e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3200d1d40 0x7fb3200cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb324e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3200d1d40 0x7fb3200cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38382/0 (socket says 172.21.15.59:38382) 2024-05-30T17:02:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb324e00640 1 -- 172.21.15.59:0/1945503708 learned_addr learned my addr 172.21.15.59:0/1945503708 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb317e00640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3200d3c90 0x7fb320159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb325800640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb320161e60 0x7fb320155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb324e00640 1 -- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3200d3c90 msgr2=0x7fb320159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb324e00640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3200d3c90 0x7fb320159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb324e00640 1 -- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb320161e60 msgr2=0x7fb320155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb324e00640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb320161e60 0x7fb320155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb324e00640 1 -- 172.21.15.59:0/1945503708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32015a230 con 0x7fb3200d1d40 2024-05-30T17:02:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb325800640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb320161e60 0x7fb320155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb324e00640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3200d1d40 0x7fb3200cdc40 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c480 tx=0x7fb31000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb31d600640 1 -- 172.21.15.59:0/1945503708 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310018070 con 0x7fb3200d1d40 2024-05-30T17:02:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb31d600640 1 -- 172.21.15.59:0/1945503708 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb310007500 con 0x7fb3200d1d40 2024-05-30T17:02:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb31d600640 1 -- 172.21.15.59:0/1945503708 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310004a30 con 0x7fb3200d1d40 2024-05-30T17:02:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb327800640 1 -- 172.21.15.59:0/1945503708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3200ccba0 con 0x7fb3200d1d40 2024-05-30T17:02:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.218+0000 7fb327800640 1 -- 172.21.15.59:0/1945503708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3200cd160 con 0x7fb3200d1d40 2024-05-30T17:02:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.222+0000 7fb327800640 1 -- 172.21.15.59:0/1945503708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb320068a90 con 0x7fb3200d1d40 2024-05-30T17:02:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.222+0000 7fb31d600640 1 -- 172.21.15.59:0/1945503708 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fb310004bd0 con 0x7fb3200d1d40 2024-05-30T17:02:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.222+0000 7fb31d600640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2fc069b20 0x7fb2fc06bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.222+0000 7fb31d600640 1 -- 172.21.15.59:0/1945503708 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5721+0+0 (secure 0 0 0) 0x7fb3100848d0 con 0x7fb3200d1d40 2024-05-30T17:02:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.222+0000 7fb317e00640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2fc069b20 0x7fb2fc06bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.222+0000 7fb317e00640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2fc069b20 0x7fb2fc06bfe0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb3080b2000 tx=0x7fb3080aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.226+0000 7fb31d600640 1 -- 172.21.15.59:0/1945503708 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb310056340 con 0x7fb3200d1d40 2024-05-30T17:02:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:49.430+0000 7fb327800640 1 -- 172.21.15.59:0/1945503708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb32015fed0 con 0x7fb3200d1d40 2024-05-30T17:02:50.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.050+0000 7fb31d600640 1 -- 172.21.15.59:0/1945503708 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v67) ==== 174+0+0 (secure 0 0 0) 0x7fb31005a640 con 0x7fb3200d1d40 2024-05-30T17:02:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 16 and data pool 17 2024-05-30T17:02:50.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.062+0000 7fb327800640 1 -- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2fc069b20 msgr2=0x7fb2fc06bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.062+0000 7fb327800640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2fc069b20 0x7fb2fc06bfe0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb3080b2000 tx=0x7fb3080aa070 comp rx=0 tx=0).stop 2024-05-30T17:02:50.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.062+0000 7fb327800640 1 -- 172.21.15.59:0/1945503708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3200d1d40 msgr2=0x7fb3200cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.062+0000 7fb327800640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3200d1d40 0x7fb3200cdc40 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c480 tx=0x7fb31000c940 comp rx=0 tx=0).stop 2024-05-30T17:02:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.062+0000 7fb327800640 1 -- 172.21.15.59:0/1945503708 shutdown_connections 2024-05-30T17:02:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.062+0000 7fb327800640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb2fc069b20 0x7fb2fc06bfe0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.062+0000 7fb327800640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb320161e60 0x7fb320155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.062+0000 7fb327800640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3200d3c90 0x7fb320159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.062+0000 7fb327800640 1 --2- 172.21.15.59:0/1945503708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3200d1d40 0x7fb3200cdc40 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.062+0000 7fb327800640 1 -- 172.21.15.59:0/1945503708 >> 172.21.15.59:0/1945503708 conn(0x7fb320067b60 msgr2=0x7fb320067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:50.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.066+0000 7fb327800640 1 -- 172.21.15.59:0/1945503708 shutdown_connections 2024-05-30T17:02:50.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.066+0000 7fb327800640 1 -- 172.21.15.59:0/1945503708 wait complete. 2024-05-30T17:02:50.102 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:02:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f226bc00640 1 Processor -- start 2024-05-30T17:02:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f226bc00640 1 -- start start 2024-05-30T17:02:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f226bc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f22640d14c0 0x7f226406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f226bc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f226409b150 0x7f226406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f226bc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f226406ea20 con 0x7f22640d05b0 2024-05-30T17:02:50.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f226bc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2264070950 con 0x7f22640d14c0 2024-05-30T17:02:50.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f226bc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2264070c30 con 0x7f226409b150 2024-05-30T17:02:50.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f225be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f22640d05b0 0x7f226409aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43710/0 (socket says 172.21.15.59:43710) 2024-05-30T17:02:50.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f225be00640 1 -- 172.21.15.59:0/2817822382 learned_addr learned my addr 172.21.15.59:0/2817822382 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2269c00640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f226409b150 0x7f226406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2269200640 1 --2- 172.21.15.59:0/2817822382 >> v2:172.21.15.107:3300/0 conn(0x7f22640d14c0 0x7f226406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154191083 0 0) 0x7f224c001120 con 0x7f22640d05b0 2024-05-30T17:02:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2248003530 con 0x7f22640d05b0 2024-05-30T17:02:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1321267870 0 0) 0x7f2248003530 con 0x7f22640d05b0 2024-05-30T17:02:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f226409b150 msgr2=0x7f226406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2263e00640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f226409b150 0x7f226406d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 >> v2:172.21.15.107:3300/0 conn(0x7f22640d14c0 msgr2=0x7f226406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2263e00640 1 --2- 172.21.15.59:0/2817822382 >> v2:172.21.15.107:3300/0 conn(0x7f22640d14c0 0x7f226406e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2264070f10 con 0x7f22640d05b0 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f224c001850 con 0x7f22640d05b0 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 >> v1:172.21.15.59:6789/0 conn(0x7f22640d05b0 legacy=0x7f226409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2263e00640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f226409b150 0x7f22480039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.242+0000 7f2263e00640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2248003f40 0x7f2248004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f2263e00640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2248004d50 0x7f22480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2264070950 con 0x7f2248003f40 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2264070c30 con 0x7f2248004d50 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f224800b9d0 con 0x7f226409b150 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f225be00640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2248003f40 0x7f2248004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f2269200640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f226409b150 0x7f22480039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f2269c00640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2248004d50 0x7f22480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f225be00640 1 -- 172.21.15.59:0/2817822382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f226409b150 msgr2=0x7f22480039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f225be00640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f226409b150 0x7f22480039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f225be00640 1 -- 172.21.15.59:0/2817822382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2248004d50 msgr2=0x7f22480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f225be00640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2248004d50 0x7f22480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f225be00640 1 -- 172.21.15.59:0/2817822382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2248003530 con 0x7f2248003f40 2024-05-30T17:02:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f2269200640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f226409b150 0x7f22480039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f225be00640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2248003f40 0x7f2248004810 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f224c00c4c0 tx=0x7f224c01f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f9855a095df235 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c00c0e0 con 0x7f2248003f40 2024-05-30T17:02:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c005b00 con 0x7f2248003f40 2024-05-30T17:02:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.246+0000 7f2263e00640 1 -- 172.21.15.59:0/2817822382 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c007070 con 0x7f2248003f40 2024-05-30T17:02:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 -- 172.21.15.59:0/2817822382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2248003f40 msgr2=0x7f2248004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 --2- 172.21.15.59:0/2817822382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2248003f40 0x7f2248004810 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f224c00c4c0 tx=0x7f224c01f3e0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f2269c00640 1 -- 172.21.15.59:0/2817822382 reap_dead start 2024-05-30T17:02:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 -- 172.21.15.59:0/2817822382 shutdown_connections 2024-05-30T17:02:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 -- 172.21.15.59:0/2817822382 >> 172.21.15.59:0/2817822382 conn(0x7f22640b3f80 msgr2=0x7f22640b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 -- 172.21.15.59:0/2817822382 shutdown_connections 2024-05-30T17:02:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 -- 172.21.15.59:0/2817822382 wait complete. 2024-05-30T17:02:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 Processor -- start 2024-05-30T17:02:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 -- start start 2024-05-30T17:02:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2248003f40 0x7f22640b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22640b6250 0x7f22640c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f226415bab0 0x7f22640c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f22640d0a60 con 0x7f226415bab0 2024-05-30T17:02:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f22640711f0 con 0x7f22640b6250 2024-05-30T17:02:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f226bc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f22640d18a0 con 0x7f2248003f40 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f2269c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f226415bab0 0x7f22640c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f2269c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f226415bab0 0x7f22640c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38394/0 (socket says 172.21.15.59:38394) 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f2269c00640 1 -- 172.21.15.59:0/3329133837 learned_addr learned my addr 172.21.15.59:0/3329133837 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f2269200640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2248003f40 0x7f22640b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f225be00640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22640b6250 0x7f22640c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f2269c00640 1 -- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2248003f40 msgr2=0x7f22640b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f2269c00640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2248003f40 0x7f22640b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f2269c00640 1 -- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22640b6250 msgr2=0x7f22640c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f2269c00640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22640b6250 0x7f22640c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f2269c00640 1 -- 172.21.15.59:0/3329133837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22640b6760 con 0x7f226415bab0 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.250+0000 7f2269c00640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f226415bab0 0x7f22640c8690 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f22640a0530 tx=0x7f225c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.254+0000 7f2261600640 1 -- 172.21.15.59:0/3329133837 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c011e10 con 0x7f226415bab0 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.254+0000 7f2261600640 1 -- 172.21.15.59:0/3329133837 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f225c01b070 con 0x7f226415bab0 2024-05-30T17:02:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.254+0000 7f226bc00640 1 -- 172.21.15.59:0/3329133837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22640b6a40 con 0x7f226415bab0 2024-05-30T17:02:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.254+0000 7f2261600640 1 -- 172.21.15.59:0/3329133837 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c0039a0 con 0x7f226415bab0 2024-05-30T17:02:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.254+0000 7f226bc00640 1 -- 172.21.15.59:0/3329133837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22640b7000 con 0x7f226415bab0 2024-05-30T17:02:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.254+0000 7f226bc00640 1 -- 172.21.15.59:0/3329133837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2264068a90 con 0x7f226415bab0 2024-05-30T17:02:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.254+0000 7f2261600640 1 -- 172.21.15.59:0/3329133837 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f225c003b60 con 0x7f226415bab0 2024-05-30T17:02:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.254+0000 7f2261600640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2240069b50 0x7f224006c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.254+0000 7f2261600640 1 -- 172.21.15.59:0/3329133837 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5821+0+0 (secure 0 0 0) 0x7f225c085fc0 con 0x7f226415bab0 2024-05-30T17:02:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.254+0000 7f2269200640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2240069b50 0x7f224006c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.258+0000 7f2269200640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2240069b50 0x7f224006c010 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f22640c8e80 tx=0x7f2254008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:50.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.258+0000 7f2261600640 1 -- 172.21.15.59:0/3329133837 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f225c025020 con 0x7f226415bab0 2024-05-30T17:02:50.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.426+0000 7f226bc00640 1 -- 172.21.15.59:0/3329133837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f226415bf30 con 0x7f226415bab0 2024-05-30T17:02:50.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f2261600640 1 -- 172.21.15.59:0/3329133837 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16804 (secure 0 0 0) 0x7f225c05ce20 con 0x7f226415bab0 2024-05-30T17:02:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:50.433 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":115,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:02:49.435912+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:02:47.120546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-05-30T17:02:48.398347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:02:50.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f226bc00640 1 -- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2240069b50 msgr2=0x7f224006c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f226bc00640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2240069b50 0x7f224006c010 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f22640c8e80 tx=0x7f2254008040 comp rx=0 tx=0).stop 2024-05-30T17:02:50.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f226bc00640 1 -- 172.21.15.59:0/3329133837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f226415bab0 msgr2=0x7f22640c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f226bc00640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f226415bab0 0x7f22640c8690 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f22640a0530 tx=0x7f225c0115a0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f226bc00640 1 -- 172.21.15.59:0/3329133837 shutdown_connections 2024-05-30T17:02:50.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f226bc00640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2240069b50 0x7f224006c010 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f226bc00640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f226415bab0 0x7f22640c8690 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f226bc00640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22640b6250 0x7f22640c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f226bc00640 1 --2- 172.21.15.59:0/3329133837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2248003f40 0x7f22640b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f226bc00640 1 -- 172.21.15.59:0/3329133837 >> 172.21.15.59:0/3329133837 conn(0x7f22640b3f80 msgr2=0x7f226409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:50.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f226bc00640 1 -- 172.21.15.59:0/3329133837 shutdown_connections 2024-05-30T17:02:50.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.430+0000 7f226bc00640 1 -- 172.21.15.59:0/3329133837 wait complete. 2024-05-30T17:02:50.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:02:50.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.590+0000 7f8f7f800640 1 Processor -- start 2024-05-30T17:02:50.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.590+0000 7f8f7f800640 1 -- start start 2024-05-30T17:02:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f7f800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f7815e860 0x7f8f780cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f7f800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8f780d0e80 0x7f8f780c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f7f800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f7815ec40 con 0x7f8f780c6d80 2024-05-30T17:02:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f7f800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8f780c8200 con 0x7f8f780d0e80 2024-05-30T17:02:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f7f800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8f780c7960 con 0x7f8f7815e860 2024-05-30T17:02:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f7d800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8f780c6d80 0x7f8f7806b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43716/0 (socket says 172.21.15.59:43716) 2024-05-30T17:02:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f7d800640 1 -- 172.21.15.59:0/496275637 learned_addr learned my addr 172.21.15.59:0/496275637 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:50.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f6fe00640 1 --2- 172.21.15.59:0/496275637 >> v2:172.21.15.107:3300/0 conn(0x7f8f780d0e80 0x7f8f780c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f7ce00640 1 --2- 172.21.15.59:0/496275637 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f7815e860 0x7f8f780cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f77e00640 1 -- 172.21.15.59:0/496275637 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 913370589 0 0) 0x7f8f7815ec40 con 0x7f8f780c6d80 2024-05-30T17:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f77e00640 1 -- 172.21.15.59:0/496275637 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f5c003530 con 0x7f8f780c6d80 2024-05-30T17:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f77e00640 1 -- 172.21.15.59:0/496275637 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1582431081 0 0) 0x7f8f5c003530 con 0x7f8f780c6d80 2024-05-30T17:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f7ce00640 1 -- 172.21.15.59:0/496275637 >> v2:172.21.15.107:3300/0 conn(0x7f8f780d0e80 msgr2=0x7f8f780c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f7ce00640 1 --2- 172.21.15.59:0/496275637 >> v2:172.21.15.107:3300/0 conn(0x7f8f780d0e80 0x7f8f780c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f7ce00640 1 -- 172.21.15.59:0/496275637 >> v1:172.21.15.59:6789/0 conn(0x7f8f780c6d80 legacy=0x7f8f7806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f7ce00640 1 -- 172.21.15.59:0/496275637 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f780c7c40 con 0x7f8f7815e860 2024-05-30T17:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.594+0000 7f8f6fe00640 1 --2- 172.21.15.59:0/496275637 >> v2:172.21.15.107:3300/0 conn(0x7f8f780d0e80 0x7f8f780c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:02:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.598+0000 7f8f7ce00640 1 --2- 172.21.15.59:0/496275637 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f7815e860 0x7f8f780cef40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8f680097c0 tx=0x7f8f6801c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb50ca4e1ce3c596 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.598+0000 7f8f77e00640 1 -- 172.21.15.59:0/496275637 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f680b0070 con 0x7f8f7815e860 2024-05-30T17:02:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.598+0000 7f8f77e00640 1 -- 172.21.15.59:0/496275637 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f680ab400 con 0x7f8f7815e860 2024-05-30T17:02:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.598+0000 7f8f77e00640 1 -- 172.21.15.59:0/496275637 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70001a00 con 0x7f8f7815e860 2024-05-30T17:02:50.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.598+0000 7f8f7f800640 1 -- 172.21.15.59:0/496275637 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f7815e860 msgr2=0x7f8f780cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.598+0000 7f8f7f800640 1 --2- 172.21.15.59:0/496275637 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f7815e860 0x7f8f780cef40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8f680097c0 tx=0x7f8f6801c330 comp rx=0 tx=0).stop 2024-05-30T17:02:50.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.598+0000 7f8f7f800640 1 -- 172.21.15.59:0/496275637 shutdown_connections 2024-05-30T17:02:50.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.598+0000 7f8f7f800640 1 --2- 172.21.15.59:0/496275637 >> v2:172.21.15.107:3300/0 conn(0x7f8f780d0e80 0x7f8f780c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.598+0000 7f8f7f800640 1 --2- 172.21.15.59:0/496275637 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f7815e860 0x7f8f780cef40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.598+0000 7f8f7f800640 1 -- 172.21.15.59:0/496275637 >> 172.21.15.59:0/496275637 conn(0x7f8f780b2fc0 msgr2=0x7f8f780b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:50.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.598+0000 7f8f7f800640 1 -- 172.21.15.59:0/496275637 shutdown_connections 2024-05-30T17:02:50.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.598+0000 7f8f7f800640 1 -- 172.21.15.59:0/496275637 wait complete. 2024-05-30T17:02:50.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7f800640 1 Processor -- start 2024-05-30T17:02:50.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7f800640 1 -- start start 2024-05-30T17:02:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7f800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f780c6d80 0x7f8f780b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7f800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f780d0e80 0x7f8f7814cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7f800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f7815e860 0x7f8f7814d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7f800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f780b3d40 con 0x7f8f7815e860 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7f800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8f780b3bc0 con 0x7f8f780d0e80 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7f800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8f7816b3a0 con 0x7f8f780c6d80 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f7815e860 0x7f8f7814d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f7815e860 0x7f8f7814d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38400/0 (socket says 172.21.15.59:38400) 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7ce00640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f780c6d80 0x7f8f780b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7d800640 1 -- 172.21.15.59:0/127342397 learned_addr learned my addr 172.21.15.59:0/127342397 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f6fe00640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f780d0e80 0x7f8f7814cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7d800640 1 -- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f780c6d80 msgr2=0x7f8f780b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7d800640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f780c6d80 0x7f8f780b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7d800640 1 -- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f780d0e80 msgr2=0x7f8f7814cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7d800640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f780d0e80 0x7f8f7814cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7d800640 1 -- 172.21.15.59:0/127342397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f780b43e0 con 0x7f8f7815e860 2024-05-30T17:02:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7d800640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f7815e860 0x7f8f7814d0d0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000cc90 tx=0x7f8f7000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f75600640 1 -- 172.21.15.59:0/127342397 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7000ce40 con 0x7f8f7815e860 2024-05-30T17:02:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f75600640 1 -- 172.21.15.59:0/127342397 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f70012400 con 0x7f8f7815e860 2024-05-30T17:02:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f75600640 1 -- 172.21.15.59:0/127342397 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f700127f0 con 0x7f8f7815e860 2024-05-30T17:02:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7f800640 1 -- 172.21.15.59:0/127342397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f780b46c0 con 0x7f8f7815e860 2024-05-30T17:02:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7f800640 1 -- 172.21.15.59:0/127342397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f780b4c80 con 0x7f8f7815e860 2024-05-30T17:02:50.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.602+0000 7f8f7f800640 1 -- 172.21.15.59:0/127342397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f78068a90 con 0x7f8f7815e860 2024-05-30T17:02:50.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.606+0000 7f8f75600640 1 -- 172.21.15.59:0/127342397 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f8f70012990 con 0x7f8f7815e860 2024-05-30T17:02:50.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.606+0000 7f8f75600640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f54069b20 0x7f8f5406bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.606+0000 7f8f75600640 1 -- 172.21.15.59:0/127342397 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5821+0+0 (secure 0 0 0) 0x7f8f70085ec0 con 0x7f8f7815e860 2024-05-30T17:02:50.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.606+0000 7f8f7ce00640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f54069b20 0x7f8f5406bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.606+0000 7f8f7ce00640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f54069b20 0x7f8f5406bfe0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8f680ad000 tx=0x7f8f680a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:50.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.610+0000 7f8f75600640 1 -- 172.21.15.59:0/127342397 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f70057890 con 0x7f8f7815e860 2024-05-30T17:02:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.774+0000 7f8f7f800640 1 -- 172.21.15.59:0/127342397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f780691a0 con 0x7f8f7815e860 2024-05-30T17:02:50.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.774+0000 7f8f75600640 1 -- 172.21.15.59:0/127342397 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16804 (secure 0 0 0) 0x7f8f7005bb90 con 0x7f8f7815e860 2024-05-30T17:02:50.779 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:50.779 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":115,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:02:49.435912+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:02:47.120546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-05-30T17:02:48.398347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:02:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.778+0000 7f8f7f800640 1 -- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f54069b20 msgr2=0x7f8f5406bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.778+0000 7f8f7f800640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f54069b20 0x7f8f5406bfe0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8f680ad000 tx=0x7f8f680a6000 comp rx=0 tx=0).stop 2024-05-30T17:02:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.778+0000 7f8f7f800640 1 -- 172.21.15.59:0/127342397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f7815e860 msgr2=0x7f8f7814d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.778+0000 7f8f7f800640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f7815e860 0x7f8f7814d0d0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000cc90 tx=0x7f8f7000a430 comp rx=0 tx=0).stop 2024-05-30T17:02:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.778+0000 7f8f7f800640 1 -- 172.21.15.59:0/127342397 shutdown_connections 2024-05-30T17:02:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.778+0000 7f8f7f800640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8f54069b20 0x7f8f5406bfe0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.778+0000 7f8f7f800640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f7815e860 0x7f8f7814d0d0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.778+0000 7f8f7f800640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f780d0e80 0x7f8f7814cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.778+0000 7f8f7f800640 1 --2- 172.21.15.59:0/127342397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8f780c6d80 0x7f8f780b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.778+0000 7f8f7f800640 1 -- 172.21.15.59:0/127342397 >> 172.21.15.59:0/127342397 conn(0x7f8f780b2fc0 msgr2=0x7f8f780d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:50.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.778+0000 7f8f7f800640 1 -- 172.21.15.59:0/127342397 shutdown_connections 2024-05-30T17:02:50.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.778+0000 7f8f7f800640 1 -- 172.21.15.59:0/127342397 wait complete. 2024-05-30T17:02:50.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T17:02:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.942+0000 7f975f200640 1 Processor -- start 2024-05-30T17:02:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.942+0000 7f975f200640 1 -- start start 2024-05-30T17:02:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.942+0000 7f975f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581569e0 0x7f975815d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.942+0000 7f975f200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97580ad2b0 0x7f97580cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.942+0000 7f975f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97580ad770 con 0x7f97580d0660 2024-05-30T17:02:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.942+0000 7f975f200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f975815cb40 con 0x7f97580ad2b0 2024-05-30T17:02:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.942+0000 7f975f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f975815ce20 con 0x7f97581569e0 2024-05-30T17:02:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.942+0000 7f974f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97580ad2b0 0x7f97580cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.942+0000 7f9757e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581569e0 0x7f975815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.942+0000 7f974f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97580ad2b0 0x7f97580cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38416/0 (socket says 172.21.15.59:38416) 2024-05-30T17:02:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.946+0000 7f974f400640 1 -- 172.21.15.59:0/2843373816 learned_addr learned my addr 172.21.15.59:0/2843373816 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.946+0000 7f974f400640 1 -- 172.21.15.59:0/2843373816 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581569e0 msgr2=0x7f975815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.946+0000 7f974f400640 1 --2- 172.21.15.59:0/2843373816 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581569e0 0x7f975815d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.946+0000 7f974f400640 1 -- 172.21.15.59:0/2843373816 >> v1:172.21.15.59:6789/0 conn(0x7f97580d0660 legacy=0x7f97580b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.946+0000 7f974f400640 1 -- 172.21.15.59:0/2843373816 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975815d100 con 0x7f97580ad2b0 2024-05-30T17:02:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.946+0000 7f974f400640 1 --2- 172.21.15.59:0/2843373816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97580ad2b0 0x7f97580cf9f0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9740009870 tx=0x7f974001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf14bb4df7da7373 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.946+0000 7f9757400640 1 -- 172.21.15.59:0/2843373816 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97400ab430 con 0x7f97580ad2b0 2024-05-30T17:02:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.946+0000 7f9757400640 1 -- 172.21.15.59:0/2843373816 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97400b0070 con 0x7f97580ad2b0 2024-05-30T17:02:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.946+0000 7f9757400640 1 -- 172.21.15.59:0/2843373816 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97400ab7f0 con 0x7f97580ad2b0 2024-05-30T17:02:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.946+0000 7f975f200640 1 -- 172.21.15.59:0/2843373816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97580ad2b0 msgr2=0x7f97580cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.946+0000 7f975f200640 1 --2- 172.21.15.59:0/2843373816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97580ad2b0 0x7f97580cf9f0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9740009870 tx=0x7f974001c440 comp rx=0 tx=0).stop 2024-05-30T17:02:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.946+0000 7f975f200640 1 -- 172.21.15.59:0/2843373816 shutdown_connections 2024-05-30T17:02:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 --2- 172.21.15.59:0/2843373816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97580ad2b0 0x7f97580cf9f0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 --2- 172.21.15.59:0/2843373816 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581569e0 0x7f975815d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 -- 172.21.15.59:0/2843373816 >> 172.21.15.59:0/2843373816 conn(0x7f975806bdb0 msgr2=0x7f975806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 -- 172.21.15.59:0/2843373816 shutdown_connections 2024-05-30T17:02:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 -- 172.21.15.59:0/2843373816 wait complete. 2024-05-30T17:02:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 Processor -- start 2024-05-30T17:02:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 -- start start 2024-05-30T17:02:50.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97580ad2b0 0x7f97580997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97580d0660 0x7f97580b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581569e0 0x7f9758147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f97580d00b0 con 0x7f97580ad2b0 2024-05-30T17:02:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f97580cff30 con 0x7f97580d0660 2024-05-30T17:02:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f97581691b0 con 0x7f97581569e0 2024-05-30T17:02:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f9757e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97580ad2b0 0x7f97580997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f9757e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97580ad2b0 0x7f97580997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38424/0 (socket says 172.21.15.59:38424) 2024-05-30T17:02:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f9757e00640 1 -- 172.21.15.59:0/2202290204 learned_addr learned my addr 172.21.15.59:0/2202290204 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f974f400640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97580d0660 0x7f97580b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975d200640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581569e0 0x7f9758147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f9757e00640 1 -- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581569e0 msgr2=0x7f9758147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f9757e00640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581569e0 0x7f9758147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f9757e00640 1 -- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97580d0660 msgr2=0x7f97580b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f9757e00640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97580d0660 0x7f97580b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f9757e00640 1 -- 172.21.15.59:0/2202290204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9758151730 con 0x7f97580ad2b0 2024-05-30T17:02:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f974f400640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97580d0660 0x7f97580b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975d200640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581569e0 0x7f9758147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f9757e00640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97580ad2b0 0x7f97580997c0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f974800e8a0 tx=0x7f974800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f9754c00640 1 -- 172.21.15.59:0/2202290204 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748017070 con 0x7f97580ad2b0 2024-05-30T17:02:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f9754c00640 1 -- 172.21.15.59:0/2202290204 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974800c940 con 0x7f97580ad2b0 2024-05-30T17:02:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f9754c00640 1 -- 172.21.15.59:0/2202290204 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974800ccf0 con 0x7f97580ad2b0 2024-05-30T17:02:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.950+0000 7f975f200640 1 -- 172.21.15.59:0/2202290204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9758151a10 con 0x7f97580ad2b0 2024-05-30T17:02:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.954+0000 7f975f200640 1 -- 172.21.15.59:0/2202290204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9758151fd0 con 0x7f97580ad2b0 2024-05-30T17:02:50.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.954+0000 7f975f200640 1 -- 172.21.15.59:0/2202290204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9758068a90 con 0x7f97580ad2b0 2024-05-30T17:02:50.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.954+0000 7f9754c00640 1 -- 172.21.15.59:0/2202290204 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f974801a070 con 0x7f97580ad2b0 2024-05-30T17:02:50.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.954+0000 7f9754c00640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9734069b20 0x7f973406bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:50.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.954+0000 7f9754c00640 1 -- 172.21.15.59:0/2202290204 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5821+0+0 (secure 0 0 0) 0x7f9748085a30 con 0x7f97580ad2b0 2024-05-30T17:02:50.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.954+0000 7f974f400640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9734069b20 0x7f973406bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:50.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.954+0000 7f974f400640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9734069b20 0x7f973406bfe0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f97400af000 tx=0x7f97400a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:50.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:50.958+0000 7f9754c00640 1 -- 172.21.15.59:0/2202290204 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9748057a50 con 0x7f97580ad2b0 2024-05-30T17:02:51.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:51.162+0000 7f975f200640 1 -- 172.21.15.59:0/2202290204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9758071e90 con 0x7f97580ad2b0 2024-05-30T17:02:52.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f9754c00640 1 -- 172.21.15.59:0/2202290204 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v70) ==== 118+0+0 (secure 0 0 0) 0x7f9748057350 con 0x7f97580ad2b0 2024-05-30T17:02:52.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f975f200640 1 -- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9734069b20 msgr2=0x7f973406bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:52.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f975f200640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9734069b20 0x7f973406bfe0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f97400af000 tx=0x7f97400a7000 comp rx=0 tx=0).stop 2024-05-30T17:02:52.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f975f200640 1 -- 172.21.15.59:0/2202290204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97580ad2b0 msgr2=0x7f97580997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:52.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f975f200640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97580ad2b0 0x7f97580997c0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f974800e8a0 tx=0x7f974800eca0 comp rx=0 tx=0).stop 2024-05-30T17:02:52.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f975f200640 1 -- 172.21.15.59:0/2202290204 shutdown_connections 2024-05-30T17:02:52.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f975f200640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9734069b20 0x7f973406bfe0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:52.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f975f200640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581569e0 0x7f9758147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:52.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f975f200640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97580d0660 0x7f97580b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:52.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f975f200640 1 --2- 172.21.15.59:0/2202290204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97580ad2b0 0x7f97580997c0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:52.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f975f200640 1 -- 172.21.15.59:0/2202290204 >> 172.21.15.59:0/2202290204 conn(0x7f975806bdb0 msgr2=0x7f9758153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:52.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f975f200640 1 -- 172.21.15.59:0/2202290204 shutdown_connections 2024-05-30T17:02:52.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.054+0000 7f975f200640 1 -- 172.21.15.59:0/2202290204 wait complete. 2024-05-30T17:02:52.085 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T17:02:52.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T17:02:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.230+0000 7fa035e00640 1 Processor -- start 2024-05-30T17:02:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.230+0000 7fa035e00640 1 -- start start 2024-05-30T17:02:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa035e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0300723a0 0x7fa0300b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa035e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa03015ebf0 0x7fa0300b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa035e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0300b32d0 con 0x7fa0300b3ff0 2024-05-30T17:02:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa035e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa03015f490 con 0x7fa0300723a0 2024-05-30T17:02:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa035e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa03015f770 con 0x7fa03015ebf0 2024-05-30T17:02:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa02ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0300723a0 0x7fa0300b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:52.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa02f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa0300b3ff0 0x7fa03006dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41572/0 (socket says 172.21.15.59:41572) 2024-05-30T17:02:52.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa02f400640 1 -- 172.21.15.59:0/4035126282 learned_addr learned my addr 172.21.15.59:0/4035126282 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:52.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa027e00640 1 --2- 172.21.15.59:0/4035126282 >> v2:172.21.15.107:3300/0 conn(0x7fa03015ebf0 0x7fa0300b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:52.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa02ea00640 1 -- 172.21.15.59:0/4035126282 >> v2:172.21.15.107:3300/0 conn(0x7fa03015ebf0 msgr2=0x7fa0300b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa02ea00640 1 --2- 172.21.15.59:0/4035126282 >> v2:172.21.15.107:3300/0 conn(0x7fa03015ebf0 0x7fa0300b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa02ea00640 1 -- 172.21.15.59:0/4035126282 >> v1:172.21.15.59:6789/0 conn(0x7fa0300b3ff0 legacy=0x7fa03006dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa02e000640 1 -- 172.21.15.59:0/4035126282 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017489139 0 0) 0x7fa0300b32d0 con 0x7fa0300b3ff0 2024-05-30T17:02:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa02ea00640 1 -- 172.21.15.59:0/4035126282 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03015fa50 con 0x7fa0300723a0 2024-05-30T17:02:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.234+0000 7fa027e00640 1 --2- 172.21.15.59:0/4035126282 >> v2:172.21.15.107:3300/0 conn(0x7fa03015ebf0 0x7fa0300b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:52.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa02ea00640 1 --2- 172.21.15.59:0/4035126282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0300723a0 0x7fa0300b4f90 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fa030073b30 tx=0x7fa02001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64f94c56c25e061 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:52.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa02e000640 1 -- 172.21.15.59:0/4035126282 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0200a7070 con 0x7fa0300723a0 2024-05-30T17:02:52.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa02e000640 1 -- 172.21.15.59:0/4035126282 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0200b0070 con 0x7fa0300723a0 2024-05-30T17:02:52.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa02e000640 1 -- 172.21.15.59:0/4035126282 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0200ab890 con 0x7fa0300723a0 2024-05-30T17:02:52.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 -- 172.21.15.59:0/4035126282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0300723a0 msgr2=0x7fa0300b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:52.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 --2- 172.21.15.59:0/4035126282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0300723a0 0x7fa0300b4f90 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fa030073b30 tx=0x7fa02001c450 comp rx=0 tx=0).stop 2024-05-30T17:02:52.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 -- 172.21.15.59:0/4035126282 shutdown_connections 2024-05-30T17:02:52.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 --2- 172.21.15.59:0/4035126282 >> v2:172.21.15.107:3300/0 conn(0x7fa03015ebf0 0x7fa0300b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:52.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 --2- 172.21.15.59:0/4035126282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0300723a0 0x7fa0300b4f90 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:52.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 -- 172.21.15.59:0/4035126282 >> 172.21.15.59:0/4035126282 conn(0x7fa03006bdb0 msgr2=0x7fa03006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:52.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 -- 172.21.15.59:0/4035126282 shutdown_connections 2024-05-30T17:02:52.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 -- 172.21.15.59:0/4035126282 wait complete. 2024-05-30T17:02:52.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 Processor -- start 2024-05-30T17:02:52.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 -- start start 2024-05-30T17:02:52.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0300723a0 0x7fa030151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:52.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0300b3ff0 0x7fa030149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa03015ebf0 0x7fa0300b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa03015f150 con 0x7fa0300723a0 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa03015efd0 con 0x7fa03015ebf0 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa035e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa03006e390 con 0x7fa0300b3ff0 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa02ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0300723a0 0x7fa030151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa02ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0300723a0 0x7fa030151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34118/0 (socket says 172.21.15.59:34118) 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa02ea00640 1 -- 172.21.15.59:0/2731762372 learned_addr learned my addr 172.21.15.59:0/2731762372 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.238+0000 7fa02f400640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa03015ebf0 0x7fa0300b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa027e00640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0300b3ff0 0x7fa030149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa02ea00640 1 -- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0300b3ff0 msgr2=0x7fa030149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa02ea00640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0300b3ff0 0x7fa030149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa02ea00640 1 -- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa03015ebf0 msgr2=0x7fa0300b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:52.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa02ea00640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa03015ebf0 0x7fa0300b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:52.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa02ea00640 1 -- 172.21.15.59:0/2731762372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0300ae010 con 0x7fa0300723a0 2024-05-30T17:02:52.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa02ea00640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0300723a0 0x7fa030151540 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fa0200ad040 tx=0x7fa02001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:52.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa027400640 1 -- 172.21.15.59:0/2731762372 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0200bf610 con 0x7fa0300723a0 2024-05-30T17:02:52.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa027400640 1 -- 172.21.15.59:0/2731762372 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa030072990 con 0x7fa0300723a0 2024-05-30T17:02:52.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa027400640 1 -- 172.21.15.59:0/2731762372 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0200bfa10 con 0x7fa0300723a0 2024-05-30T17:02:52.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa035e00640 1 -- 172.21.15.59:0/2731762372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0300ae2f0 con 0x7fa0300723a0 2024-05-30T17:02:52.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa035e00640 1 -- 172.21.15.59:0/2731762372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0300ae8b0 con 0x7fa0300723a0 2024-05-30T17:02:52.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa035e00640 1 -- 172.21.15.59:0/2731762372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa030068a90 con 0x7fa0300723a0 2024-05-30T17:02:52.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa027400640 1 -- 172.21.15.59:0/2731762372 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fa0200bd020 con 0x7fa0300723a0 2024-05-30T17:02:52.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa027400640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa00c069b20 0x7fa00c06bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:52.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa027400640 1 -- 172.21.15.59:0/2731762372 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7fa02011fb60 con 0x7fa0300723a0 2024-05-30T17:02:52.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.242+0000 7fa027e00640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa00c069b20 0x7fa00c06bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:52.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.246+0000 7fa027e00640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa00c069b20 0x7fa00c06bfe0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa018006fd0 tx=0x7fa018008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:52.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.246+0000 7fa027400640 1 -- 172.21.15.59:0/2731762372 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa0200c6030 con 0x7fa0300723a0 2024-05-30T17:02:52.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:52.450+0000 7fa035e00640 1 -- 172.21.15.59:0/2731762372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa0300cfb70 con 0x7fa0300723a0 2024-05-30T17:02:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa027400640 1 -- 172.21.15.59:0/2731762372 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v71) ==== 122+0+0 (secure 0 0 0) 0x7fa020016070 con 0x7fa0300723a0 2024-05-30T17:02:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa035e00640 1 -- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa00c069b20 msgr2=0x7fa00c06bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa035e00640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa00c069b20 0x7fa00c06bfe0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa018006fd0 tx=0x7fa018008040 comp rx=0 tx=0).stop 2024-05-30T17:02:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa035e00640 1 -- 172.21.15.59:0/2731762372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0300723a0 msgr2=0x7fa030151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa035e00640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0300723a0 0x7fa030151540 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fa0200ad040 tx=0x7fa02001ac90 comp rx=0 tx=0).stop 2024-05-30T17:02:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa035e00640 1 -- 172.21.15.59:0/2731762372 shutdown_connections 2024-05-30T17:02:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa035e00640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa00c069b20 0x7fa00c06bfe0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa035e00640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa03015ebf0 0x7fa0300b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa035e00640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0300b3ff0 0x7fa030149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa035e00640 1 --2- 172.21.15.59:0/2731762372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0300723a0 0x7fa030151540 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa035e00640 1 -- 172.21.15.59:0/2731762372 >> 172.21.15.59:0/2731762372 conn(0x7fa03006bdb0 msgr2=0x7fa03006dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa035e00640 1 -- 172.21.15.59:0/2731762372 shutdown_connections 2024-05-30T17:02:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.066+0000 7fa035e00640 1 -- 172.21.15.59:0/2731762372 wait complete. 2024-05-30T17:02:53.096 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T17:02:53.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:02:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.238+0000 7f3038000640 1 Processor -- start 2024-05-30T17:02:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.238+0000 7f3038000640 1 -- start start 2024-05-30T17:02:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3038000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f303006e900 0x7f303015f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3038000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30300d0560 0x7f30300d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3038000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f303015f060 con 0x7f30300af720 2024-05-30T17:02:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3038000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f30300afb00 con 0x7f30300d0560 2024-05-30T17:02:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3038000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f303015c270 con 0x7f303006e900 2024-05-30T17:02:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3036000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30300d0560 0x7f30300d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3036000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30300d0560 0x7f30300d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34130/0 (socket says 172.21.15.59:34130) 2024-05-30T17:02:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3036000640 1 -- 172.21.15.59:0/4107815778 learned_addr learned my addr 172.21.15.59:0/4107815778 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3034c00640 1 --2- 172.21.15.59:0/4107815778 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f303006e900 0x7f303015f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3036000640 1 -- 172.21.15.59:0/4107815778 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f303006e900 msgr2=0x7f303015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3036000640 1 --2- 172.21.15.59:0/4107815778 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f303006e900 0x7f303015f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3036000640 1 -- 172.21.15.59:0/4107815778 >> v1:172.21.15.107:6789/0 conn(0x7f30300af720 legacy=0x7f303015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.242+0000 7f3036000640 1 -- 172.21.15.59:0/4107815778 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303015c550 con 0x7f30300d0560 2024-05-30T17:02:53.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3036000640 1 --2- 172.21.15.59:0/4107815778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30300d0560 0x7f30300d0a10 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f302800d150 tx=0x7f302801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5af1fb32207292 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:53.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f302fe00640 1 -- 172.21.15.59:0/4107815778 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302800b2d0 con 0x7f30300d0560 2024-05-30T17:02:53.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f302fe00640 1 -- 172.21.15.59:0/4107815778 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302800b470 con 0x7f30300d0560 2024-05-30T17:02:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f302fe00640 1 -- 172.21.15.59:0/4107815778 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30280a7b70 con 0x7f30300d0560 2024-05-30T17:02:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 -- 172.21.15.59:0/4107815778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30300d0560 msgr2=0x7f30300d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 --2- 172.21.15.59:0/4107815778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30300d0560 0x7f30300d0a10 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f302800d150 tx=0x7f302801ec30 comp rx=0 tx=0).stop 2024-05-30T17:02:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 -- 172.21.15.59:0/4107815778 shutdown_connections 2024-05-30T17:02:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 --2- 172.21.15.59:0/4107815778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30300d0560 0x7f30300d0a10 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 --2- 172.21.15.59:0/4107815778 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f303006e900 0x7f303015f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 -- 172.21.15.59:0/4107815778 >> 172.21.15.59:0/4107815778 conn(0x7f30300b22d0 msgr2=0x7f30300b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 -- 172.21.15.59:0/4107815778 shutdown_connections 2024-05-30T17:02:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 -- 172.21.15.59:0/4107815778 wait complete. 2024-05-30T17:02:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 Processor -- start 2024-05-30T17:02:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 -- start start 2024-05-30T17:02:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f303006e900 0x7f3030155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30300af720 0x7f303009acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30300d0560 0x7f303009b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3030073150 con 0x7f303006e900 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f30300732d0 con 0x7f30300af720 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3038000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f30301585c0 con 0x7f30300d0560 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3035600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f303006e900 0x7f3030155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3035600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f303006e900 0x7f3030155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34140/0 (socket says 172.21.15.59:34140) 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3035600640 1 -- 172.21.15.59:0/2500301963 learned_addr learned my addr 172.21.15.59:0/2500301963 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.246+0000 7f3034c00640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30300af720 0x7f303009acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f3036000640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30300d0560 0x7f303009b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f3035600640 1 -- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30300d0560 msgr2=0x7f303009b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f3035600640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30300d0560 0x7f303009b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f3035600640 1 -- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30300af720 msgr2=0x7f303009acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f3035600640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30300af720 0x7f303009acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f3035600640 1 -- 172.21.15.59:0/2500301963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303009a2c0 con 0x7f303006e900 2024-05-30T17:02:53.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f3035600640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f303006e900 0x7f3030155970 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f302400c500 tx=0x7f302400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:53.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f302d600640 1 -- 172.21.15.59:0/2500301963 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024016020 con 0x7f303006e900 2024-05-30T17:02:53.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f302d600640 1 -- 172.21.15.59:0/2500301963 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3024005220 con 0x7f303006e900 2024-05-30T17:02:53.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f3038000640 1 -- 172.21.15.59:0/2500301963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f303009a5a0 con 0x7f303006e900 2024-05-30T17:02:53.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f302d600640 1 -- 172.21.15.59:0/2500301963 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024007030 con 0x7f303006e900 2024-05-30T17:02:53.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f3038000640 1 -- 172.21.15.59:0/2500301963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30301588f0 con 0x7f303006e900 2024-05-30T17:02:53.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f3038000640 1 -- 172.21.15.59:0/2500301963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3030068a90 con 0x7f303006e900 2024-05-30T17:02:53.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f302d600640 1 -- 172.21.15.59:0/2500301963 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f30240071f0 con 0x7f303006e900 2024-05-30T17:02:53.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f302d600640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3010069b20 0x7f301006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.250+0000 7f302d600640 1 -- 172.21.15.59:0/2500301963 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f3024085160 con 0x7f303006e900 2024-05-30T17:02:53.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.254+0000 7f3034c00640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3010069b20 0x7f301006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.254+0000 7f3034c00640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3010069b20 0x7f301006bfe0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f303006e3d0 tx=0x7f301c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:53.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.258+0000 7f302d600640 1 -- 172.21.15.59:0/2500301963 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3024020020 con 0x7f303006e900 2024-05-30T17:02:53.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 -- 172.21.15.59:0/2500301963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3030166cf0 con 0x7f303006e900 2024-05-30T17:02:53.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f302d600640 1 -- 172.21.15.59:0/2500301963 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5186 (secure 0 0 0) 0x7f3024056ab0 con 0x7f303006e900 2024-05-30T17:02:53.461 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:53.461 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":71,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3022278523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3022278523},{"type":"v1","addr":"172.21.15.59:6835","nonce":3022278523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2843818914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2843818914},{"type":"v1","addr":"172.21.15.107:6837","nonce":2843818914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7750,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3415278570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3415278570},{"type":"v1","addr":"172.21.15.107:6836","nonce":3415278570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:02:49.435879+0000","modified":"2024-05-30T17:02:52.455412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8460":{"gid":8460,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/871678202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":871678202},{"type":"v1","addr":"172.21.15.59:6834","nonce":871678202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8460,"qdb_cluster":[8460]},"id":8}]} 2024-05-30T17:02:53.461 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 71 2024-05-30T17:02:53.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 -- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3010069b20 msgr2=0x7f301006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3010069b20 0x7f301006bfe0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f303006e3d0 tx=0x7f301c008040 comp rx=0 tx=0).stop 2024-05-30T17:02:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 -- 172.21.15.59:0/2500301963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f303006e900 msgr2=0x7f3030155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f303006e900 0x7f3030155970 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f302400c500 tx=0x7f302400c9c0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 -- 172.21.15.59:0/2500301963 shutdown_connections 2024-05-30T17:02:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3010069b20 0x7f301006bfe0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30300d0560 0x7f303009b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30300af720 0x7f303009acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 --2- 172.21.15.59:0/2500301963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f303006e900 0x7f3030155970 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 -- 172.21.15.59:0/2500301963 >> 172.21.15.59:0/2500301963 conn(0x7f30300b22d0 msgr2=0x7f30300b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 -- 172.21.15.59:0/2500301963 shutdown_connections 2024-05-30T17:02:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.458+0000 7f3038000640 1 -- 172.21.15.59:0/2500301963 wait complete. 2024-05-30T17:02:53.481 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:02:53.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.618+0000 7f2160e00640 1 Processor -- start 2024-05-30T17:02:53.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.618+0000 7f2160e00640 1 -- start start 2024-05-30T17:02:53.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.618+0000 7f2160e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f215c06e900 0x7f215c15f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.618+0000 7f2160e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c15f060 con 0x7f215c0af720 2024-05-30T17:02:53.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.618+0000 7f2160e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c0afb00 con 0x7f215c0d0560 2024-05-30T17:02:53.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.618+0000 7f2160e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f215c15c270 con 0x7f215c06e900 2024-05-30T17:02:53.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.618+0000 7f2151400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f215c06e900 0x7f215c15f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.618+0000 7f2159e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f215c0af720 0x7f215c15b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41582/0 (socket says 172.21.15.59:41582) 2024-05-30T17:02:53.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.618+0000 7f2159e00640 1 -- 172.21.15.59:0/4204736080 learned_addr learned my addr 172.21.15.59:0/4204736080 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:53.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.622+0000 7f2151400640 1 -- 172.21.15.59:0/4204736080 >> v1:172.21.15.107:6789/0 conn(0x7f215c0d0560 legacy=0x7f215c072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.622+0000 7f2151400640 1 -- 172.21.15.59:0/4204736080 >> v1:172.21.15.59:6789/0 conn(0x7f215c0af720 legacy=0x7f215c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.622+0000 7f2159400640 1 -- 172.21.15.59:0/4204736080 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149245309 0 0) 0x7f215c15f060 con 0x7f215c0af720 2024-05-30T17:02:53.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.622+0000 7f2151400640 1 -- 172.21.15.59:0/4204736080 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c15c550 con 0x7f215c06e900 2024-05-30T17:02:53.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.622+0000 7f2151400640 1 --2- 172.21.15.59:0/4204736080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f215c06e900 0x7f215c15f7f0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f21440097c0 tx=0x7f214401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567456c28607fb00 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.622+0000 7f2159400640 1 -- 172.21.15.59:0/4204736080 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440aa5f0 con 0x7f215c06e900 2024-05-30T17:02:53.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.622+0000 7f2159400640 1 -- 172.21.15.59:0/4204736080 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21440af070 con 0x7f215c06e900 2024-05-30T17:02:53.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.622+0000 7f2159400640 1 -- 172.21.15.59:0/4204736080 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440aa9b0 con 0x7f215c06e900 2024-05-30T17:02:53.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.622+0000 7f2160e00640 1 -- 172.21.15.59:0/4204736080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f215c06e900 msgr2=0x7f215c15f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.622+0000 7f2160e00640 1 --2- 172.21.15.59:0/4204736080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f215c06e900 0x7f215c15f7f0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f21440097c0 tx=0x7f214401c470 comp rx=0 tx=0).stop 2024-05-30T17:02:53.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 -- 172.21.15.59:0/4204736080 shutdown_connections 2024-05-30T17:02:53.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 --2- 172.21.15.59:0/4204736080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f215c06e900 0x7f215c15f7f0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 -- 172.21.15.59:0/4204736080 >> 172.21.15.59:0/4204736080 conn(0x7f215c0b22d0 msgr2=0x7f215c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:53.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 -- 172.21.15.59:0/4204736080 shutdown_connections 2024-05-30T17:02:53.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 -- 172.21.15.59:0/4204736080 wait complete. 2024-05-30T17:02:53.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 Processor -- start 2024-05-30T17:02:53.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 -- start start 2024-05-30T17:02:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f215c06e900 0x7f215c153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f215c0af720 0x7f215c1f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f215c0d0560 0x7f215c1f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f215c15feb0 con 0x7f215c0d0560 2024-05-30T17:02:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f215c15fd30 con 0x7f215c0af720 2024-05-30T17:02:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2160e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f215c158dd0 con 0x7f215c06e900 2024-05-30T17:02:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f215a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f215c0d0560 0x7f215c1f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2151400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f215c0af720 0x7f215c1f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2159e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f215c06e900 0x7f215c153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f215a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f215c0d0560 0x7f215c1f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34150/0 (socket says 172.21.15.59:34150) 2024-05-30T17:02:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f215a800640 1 -- 172.21.15.59:0/872344673 learned_addr learned my addr 172.21.15.59:0/872344673 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f215a800640 1 -- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f215c06e900 msgr2=0x7f215c153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f215a800640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f215c06e900 0x7f215c153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f215a800640 1 -- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f215c0af720 msgr2=0x7f215c1f7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f215a800640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f215c0af720 0x7f215c1f7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f215a800640 1 -- 172.21.15.59:0/872344673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c153770 con 0x7f215c0d0560 2024-05-30T17:02:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.626+0000 7f2151400640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f215c0af720 0x7f215c1f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:02:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.630+0000 7f215a800640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f215c0d0560 0x7f215c1f7650 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f215400c340 tx=0x7f215400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.630+0000 7f2152a00640 1 -- 172.21.15.59:0/872344673 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154005220 con 0x7f215c0d0560 2024-05-30T17:02:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.630+0000 7f2152a00640 1 -- 172.21.15.59:0/872344673 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21540053c0 con 0x7f215c0d0560 2024-05-30T17:02:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.630+0000 7f2160e00640 1 -- 172.21.15.59:0/872344673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c15ce60 con 0x7f215c0d0560 2024-05-30T17:02:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.630+0000 7f2152a00640 1 -- 172.21.15.59:0/872344673 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154007270 con 0x7f215c0d0560 2024-05-30T17:02:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.630+0000 7f2160e00640 1 -- 172.21.15.59:0/872344673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c15d420 con 0x7f215c0d0560 2024-05-30T17:02:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.630+0000 7f2160e00640 1 -- 172.21.15.59:0/872344673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215c068a90 con 0x7f215c0d0560 2024-05-30T17:02:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.630+0000 7f2152a00640 1 -- 172.21.15.59:0/872344673 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f2154019020 con 0x7f215c0d0560 2024-05-30T17:02:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.630+0000 7f2152a00640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2138069b50 0x7f213806c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.630+0000 7f2152a00640 1 -- 172.21.15.59:0/872344673 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f21540848a0 con 0x7f215c0d0560 2024-05-30T17:02:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.630+0000 7f2159e00640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2138069b50 0x7f213806c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.634+0000 7f2159e00640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2138069b50 0x7f213806c010 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f214c001950 tx=0x7f214c0018e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:53.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.634+0000 7f2152a00640 1 -- 172.21.15.59:0/872344673 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2154056830 con 0x7f215c0d0560 2024-05-30T17:02:53.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.802+0000 7f2160e00640 1 -- 172.21.15.59:0/872344673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f215c0cf3a0 con 0x7f215c0d0560 2024-05-30T17:02:53.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.802+0000 7f2152a00640 1 -- 172.21.15.59:0/872344673 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16791 (secure 0 0 0) 0x7f2154056130 con 0x7f215c0d0560 2024-05-30T17:02:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:53.806 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":116,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:02:51.050923+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:02:47.120546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-05-30T17:02:48.398347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:02:53.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.806+0000 7f2160e00640 1 -- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2138069b50 msgr2=0x7f213806c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.806+0000 7f2160e00640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2138069b50 0x7f213806c010 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f214c001950 tx=0x7f214c0018e0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.806+0000 7f2160e00640 1 -- 172.21.15.59:0/872344673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f215c0d0560 msgr2=0x7f215c1f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.806+0000 7f2160e00640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f215c0d0560 0x7f215c1f7650 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f215400c340 tx=0x7f215400c740 comp rx=0 tx=0).stop 2024-05-30T17:02:53.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.806+0000 7f2160e00640 1 -- 172.21.15.59:0/872344673 shutdown_connections 2024-05-30T17:02:53.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.806+0000 7f2160e00640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2138069b50 0x7f213806c010 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.806+0000 7f2160e00640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f215c0d0560 0x7f215c1f7650 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.806+0000 7f2160e00640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f215c0af720 0x7f215c1f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.806+0000 7f2160e00640 1 --2- 172.21.15.59:0/872344673 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f215c06e900 0x7f215c153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.806+0000 7f2160e00640 1 -- 172.21.15.59:0/872344673 >> 172.21.15.59:0/872344673 conn(0x7f215c0b22d0 msgr2=0x7f215c0afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:53.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.806+0000 7f2160e00640 1 -- 172.21.15.59:0/872344673 shutdown_connections 2024-05-30T17:02:53.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.806+0000 7f2160e00640 1 -- 172.21.15.59:0/872344673 wait complete. 2024-05-30T17:02:53.828 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T17:02:53.828 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:02:53.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d73200640 1 Processor -- start 2024-05-30T17:02:53.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d73200640 1 -- start start 2024-05-30T17:02:53.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d73200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d6c0af720 0x7f7d6c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d73200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d6c06e900 0x7f7d6c15f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d73200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7d6c0d0560 0x7f7d6c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d73200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f7d6c15f060 con 0x7f7d6c0af720 2024-05-30T17:02:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d73200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7d6c0afb00 con 0x7f7d6c0d0560 2024-05-30T17:02:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d73200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7d6c15c270 con 0x7f7d6c06e900 2024-05-30T17:02:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d6be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d6c0af720 0x7f7d6c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d6be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d6c0af720 0x7f7d6c15b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34152/0 (socket says 172.21.15.59:34152) 2024-05-30T17:02:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d6be00640 1 -- 172.21.15.59:0/2404488892 learned_addr learned my addr 172.21.15.59:0/2404488892 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d63400640 1 --2- 172.21.15.59:0/2404488892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d6c06e900 0x7f7d6c15f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d71200640 1 --2- 172.21.15.59:0/2404488892 >> v2:172.21.15.107:3300/0 conn(0x7f7d6c0d0560 0x7f7d6c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d6be00640 1 -- 172.21.15.59:0/2404488892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d6c06e900 msgr2=0x7f7d6c15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d6be00640 1 --2- 172.21.15.59:0/2404488892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d6c06e900 0x7f7d6c15f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d6be00640 1 -- 172.21.15.59:0/2404488892 >> v2:172.21.15.107:3300/0 conn(0x7f7d6c0d0560 msgr2=0x7f7d6c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d6be00640 1 --2- 172.21.15.59:0/2404488892 >> v2:172.21.15.107:3300/0 conn(0x7f7d6c0d0560 0x7f7d6c0d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d6be00640 1 -- 172.21.15.59:0/2404488892 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6c15c550 con 0x7f7d6c0af720 2024-05-30T17:02:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d63400640 1 --2- 172.21.15.59:0/2404488892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d6c06e900 0x7f7d6c15f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.966+0000 7f7d71200640 1 --2- 172.21.15.59:0/2404488892 >> v2:172.21.15.107:3300/0 conn(0x7f7d6c0d0560 0x7f7d6c0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:53.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d6be00640 1 --2- 172.21.15.59:0/2404488892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c0af720 0x7f7d6c15b9d0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c06d830 tx=0x7f7d5c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4e2fc9ef0f8656 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:53.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d6b400640 1 -- 172.21.15.59:0/2404488892 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c0ab5f0 con 0x7f7d6c0af720 2024-05-30T17:02:53.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d6b400640 1 -- 172.21.15.59:0/2404488892 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5c0b0070 con 0x7f7d6c0af720 2024-05-30T17:02:53.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d6b400640 1 -- 172.21.15.59:0/2404488892 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c0ab9b0 con 0x7f7d6c0af720 2024-05-30T17:02:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d73200640 1 -- 172.21.15.59:0/2404488892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c0af720 msgr2=0x7f7d6c15b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d73200640 1 --2- 172.21.15.59:0/2404488892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c0af720 0x7f7d6c15b9d0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c06d830 tx=0x7f7d5c01c520 comp rx=0 tx=0).stop 2024-05-30T17:02:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d73200640 1 -- 172.21.15.59:0/2404488892 shutdown_connections 2024-05-30T17:02:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d73200640 1 --2- 172.21.15.59:0/2404488892 >> v2:172.21.15.107:3300/0 conn(0x7f7d6c0d0560 0x7f7d6c0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d73200640 1 --2- 172.21.15.59:0/2404488892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d6c06e900 0x7f7d6c15f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d73200640 1 --2- 172.21.15.59:0/2404488892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c0af720 0x7f7d6c15b9d0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d73200640 1 -- 172.21.15.59:0/2404488892 >> 172.21.15.59:0/2404488892 conn(0x7f7d6c0b22d0 msgr2=0x7f7d6c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d73200640 1 -- 172.21.15.59:0/2404488892 shutdown_connections 2024-05-30T17:02:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.970+0000 7f7d73200640 1 -- 172.21.15.59:0/2404488892 wait complete. 2024-05-30T17:02:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d73200640 1 Processor -- start 2024-05-30T17:02:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d73200640 1 -- start start 2024-05-30T17:02:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d73200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d6c06e900 0x7f7d6c145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d73200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d6c0af720 0x7f7d6c0973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d73200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c0d0560 0x7f7d6c152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d73200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c15feb0 con 0x7f7d6c0d0560 2024-05-30T17:02:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d73200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c15fd30 con 0x7f7d6c06e900 2024-05-30T17:02:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d73200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7d6c073150 con 0x7f7d6c0af720 2024-05-30T17:02:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d71200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c0d0560 0x7f7d6c152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d71200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c0d0560 0x7f7d6c152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34166/0 (socket says 172.21.15.59:34166) 2024-05-30T17:02:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d71200640 1 -- 172.21.15.59:0/806517425 learned_addr learned my addr 172.21.15.59:0/806517425 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d6be00640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d6c06e900 0x7f7d6c145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d63400640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d6c0af720 0x7f7d6c0973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d71200640 1 -- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d6c0af720 msgr2=0x7f7d6c0973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d71200640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d6c0af720 0x7f7d6c0973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d71200640 1 -- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d6c06e900 msgr2=0x7f7d6c145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d71200640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d6c06e900 0x7f7d6c145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d71200640 1 -- 172.21.15.59:0/806517425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6c151660 con 0x7f7d6c0d0560 2024-05-30T17:02:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d63400640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d6c0af720 0x7f7d6c0973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d71200640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c0d0560 0x7f7d6c152700 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400cd80 tx=0x7f7d6400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d68c00640 1 -- 172.21.15.59:0/806517425 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400f680 con 0x7f7d6c0d0560 2024-05-30T17:02:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d68c00640 1 -- 172.21.15.59:0/806517425 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d6400f840 con 0x7f7d6c0d0560 2024-05-30T17:02:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d68c00640 1 -- 172.21.15.59:0/806517425 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400fc30 con 0x7f7d6c0d0560 2024-05-30T17:02:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d73200640 1 -- 172.21.15.59:0/806517425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d6c151940 con 0x7f7d6c0d0560 2024-05-30T17:02:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.974+0000 7f7d73200640 1 -- 172.21.15.59:0/806517425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d6c151f00 con 0x7f7d6c0d0560 2024-05-30T17:02:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.978+0000 7f7d73200640 1 -- 172.21.15.59:0/806517425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d6c068a90 con 0x7f7d6c0d0560 2024-05-30T17:02:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.978+0000 7f7d68c00640 1 -- 172.21.15.59:0/806517425 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f7d6400e3e0 con 0x7f7d6c0d0560 2024-05-30T17:02:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.978+0000 7f7d68c00640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d48069b50 0x7f7d4806c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.978+0000 7f7d68c00640 1 -- 172.21.15.59:0/806517425 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f7d64086460 con 0x7f7d6c0d0560 2024-05-30T17:02:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.978+0000 7f7d6be00640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d48069b50 0x7f7d4806c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.978+0000 7f7d6be00640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d48069b50 0x7f7d4806c010 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0af000 tx=0x7f7d5c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:53.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:53.982+0000 7f7d68c00640 1 -- 172.21.15.59:0/806517425 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7d64014030 con 0x7f7d6c0d0560 2024-05-30T17:02:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.146+0000 7f7d73200640 1 -- 172.21.15.59:0/806517425 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d6c06c720 con 0x7f7d48069b50 2024-05-30T17:02:54.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d68c00640 1 -- 172.21.15.59:0/806517425 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252489 (secure 0 0 0) 0x7f7d6c06c720 con 0x7f7d48069b50 2024-05-30T17:02:54.159 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:54.161 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:02:54.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d73200640 1 -- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d48069b50 msgr2=0x7f7d4806c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d73200640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d48069b50 0x7f7d4806c010 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0af000 tx=0x7f7d5c0a7000 comp rx=0 tx=0).stop 2024-05-30T17:02:54.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d73200640 1 -- 172.21.15.59:0/806517425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c0d0560 msgr2=0x7f7d6c152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d73200640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c0d0560 0x7f7d6c152700 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400cd80 tx=0x7f7d6400a650 comp rx=0 tx=0).stop 2024-05-30T17:02:54.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d73200640 1 -- 172.21.15.59:0/806517425 shutdown_connections 2024-05-30T17:02:54.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d73200640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7d48069b50 0x7f7d4806c010 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d73200640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c0d0560 0x7f7d6c152700 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d73200640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d6c0af720 0x7f7d6c0973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d73200640 1 --2- 172.21.15.59:0/806517425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d6c06e900 0x7f7d6c145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d73200640 1 -- 172.21.15.59:0/806517425 >> 172.21.15.59:0/806517425 conn(0x7f7d6c0b22d0 msgr2=0x7f7d6c15ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:54.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d73200640 1 -- 172.21.15.59:0/806517425 shutdown_connections 2024-05-30T17:02:54.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.158+0000 7f7d73200640 1 -- 172.21.15.59:0/806517425 wait complete. 2024-05-30T17:02:54.179 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":530,"stamp":"2024-05-30T17:02:53.354093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":851364,"kb_used_data":12400,"kb_used_omap":12,"kb_used_meta":838835,"kb_avail":754123356,"statfs":{"total":773094113280,"available":772222316544,"internally_reserved":0,"allocated":12697600,"data_stored":6183772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":858967600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.327190"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003993+0000","last_change":"2024-05-30T17:02:50.065397+0000","last_active":"2024-05-30T17:02:52.003993+0000","last_peered":"2024-05-30T17:02:52.003993+0000","last_clean":"2024-05-30T17:02:52.003993+0000","last_became_active":"2024-05-30T17:02:50.065072+0000","last_became_peered":"2024-05-30T17:02:50.065072+0000","last_unstale":"2024-05-30T17:02:52.003993+0000","last_undegraded":"2024-05-30T17:02:52.003993+0000","last_fullsized":"2024-05-30T17:02:52.003993+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:27:25.348067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061972+0000","last_change":"2024-05-30T17:02:50.054425+0000","last_active":"2024-05-30T17:02:51.061972+0000","last_peered":"2024-05-30T17:02:51.061972+0000","last_clean":"2024-05-30T17:02:51.061972+0000","last_became_active":"2024-05-30T17:02:50.054140+0000","last_became_peered":"2024-05-30T17:02:50.054140+0000","last_unstale":"2024-05-30T17:02:51.061972+0000","last_undegraded":"2024-05-30T17:02:51.061972+0000","last_fullsized":"2024-05-30T17:02:51.061972+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:36:15.163023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004550+0000","last_change":"2024-05-30T17:02:50.061104+0000","last_active":"2024-05-30T17:02:52.004550+0000","last_peered":"2024-05-30T17:02:52.004550+0000","last_clean":"2024-05-30T17:02:52.004550+0000","last_became_active":"2024-05-30T17:02:50.059069+0000","last_became_peered":"2024-05-30T17:02:50.059069+0000","last_unstale":"2024-05-30T17:02:52.004550+0000","last_undegraded":"2024-05-30T17:02:52.004550+0000","last_fullsized":"2024-05-30T17:02:52.004550+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:27:58.744625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003085+0000","last_change":"2024-05-30T17:02:50.066012+0000","last_active":"2024-05-30T17:02:52.003085+0000","last_peered":"2024-05-30T17:02:52.003085+0000","last_clean":"2024-05-30T17:02:52.003085+0000","last_became_active":"2024-05-30T17:02:50.065719+0000","last_became_peered":"2024-05-30T17:02:50.065719+0000","last_unstale":"2024-05-30T17:02:52.003085+0000","last_undegraded":"2024-05-30T17:02:52.003085+0000","last_fullsized":"2024-05-30T17:02:52.003085+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:08:26.189129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058868+0000","last_change":"2024-05-30T17:02:50.071281+0000","last_active":"2024-05-30T17:02:51.058868+0000","last_peered":"2024-05-30T17:02:51.058868+0000","last_clean":"2024-05-30T17:02:51.058868+0000","last_became_active":"2024-05-30T17:02:50.069901+0000","last_became_peered":"2024-05-30T17:02:50.069901+0000","last_unstale":"2024-05-30T17:02:51.058868+0000","last_undegraded":"2024-05-30T17:02:51.058868+0000","last_fullsized":"2024-05-30T17:02:51.058868+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:45.480962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003058+0000","last_change":"2024-05-30T17:02:50.071097+0000","last_active":"2024-05-30T17:02:52.003058+0000","last_peered":"2024-05-30T17:02:52.003058+0000","last_clean":"2024-05-30T17:02:52.003058+0000","last_became_active":"2024-05-30T17:02:50.070628+0000","last_became_peered":"2024-05-30T17:02:50.070628+0000","last_unstale":"2024-05-30T17:02:52.003058+0000","last_undegraded":"2024-05-30T17:02:52.003058+0000","last_fullsized":"2024-05-30T17:02:52.003058+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:30:48.948317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061573+0000","last_change":"2024-05-30T17:02:50.061030+0000","last_active":"2024-05-30T17:02:51.061573+0000","last_peered":"2024-05-30T17:02:51.061573+0000","last_clean":"2024-05-30T17:02:51.061573+0000","last_became_active":"2024-05-30T17:02:50.060413+0000","last_became_peered":"2024-05-30T17:02:50.060413+0000","last_unstale":"2024-05-30T17:02:51.061573+0000","last_undegraded":"2024-05-30T17:02:51.061573+0000","last_fullsized":"2024-05-30T17:02:51.061573+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:21.138555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004229+0000","last_change":"2024-05-30T17:02:50.058520+0000","last_active":"2024-05-30T17:02:52.004229+0000","last_peered":"2024-05-30T17:02:52.004229+0000","last_clean":"2024-05-30T17:02:52.004229+0000","last_became_active":"2024-05-30T17:02:50.058231+0000","last_became_peered":"2024-05-30T17:02:50.058231+0000","last_unstale":"2024-05-30T17:02:52.004229+0000","last_undegraded":"2024-05-30T17:02:52.004229+0000","last_fullsized":"2024-05-30T17:02:52.004229+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:46:52.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003944+0000","last_change":"2024-05-30T17:02:50.068837+0000","last_active":"2024-05-30T17:02:52.003944+0000","last_peered":"2024-05-30T17:02:52.003944+0000","last_clean":"2024-05-30T17:02:52.003944+0000","last_became_active":"2024-05-30T17:02:50.066965+0000","last_became_peered":"2024-05-30T17:02:50.066965+0000","last_unstale":"2024-05-30T17:02:52.003944+0000","last_undegraded":"2024-05-30T17:02:52.003944+0000","last_fullsized":"2024-05-30T17:02:52.003944+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:32:38.254244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003462+0000","last_change":"2024-05-30T17:02:50.062097+0000","last_active":"2024-05-30T17:02:52.003462+0000","last_peered":"2024-05-30T17:02:52.003462+0000","last_clean":"2024-05-30T17:02:52.003462+0000","last_became_active":"2024-05-30T17:02:50.061761+0000","last_became_peered":"2024-05-30T17:02:50.061761+0000","last_unstale":"2024-05-30T17:02:52.003462+0000","last_undegraded":"2024-05-30T17:02:52.003462+0000","last_fullsized":"2024-05-30T17:02:52.003462+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:13:11.219532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061989+0000","last_change":"2024-05-30T17:02:50.061053+0000","last_active":"2024-05-30T17:02:51.061989+0000","last_peered":"2024-05-30T17:02:51.061989+0000","last_clean":"2024-05-30T17:02:51.061989+0000","last_became_active":"2024-05-30T17:02:50.060736+0000","last_became_peered":"2024-05-30T17:02:50.060736+0000","last_unstale":"2024-05-30T17:02:51.061989+0000","last_undegraded":"2024-05-30T17:02:51.061989+0000","last_fullsized":"2024-05-30T17:02:51.061989+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:29:42.893385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003259+0000","last_change":"2024-05-30T17:02:50.071281+0000","last_active":"2024-05-30T17:02:52.003259+0000","last_peered":"2024-05-30T17:02:52.003259+0000","last_clean":"2024-05-30T17:02:52.003259+0000","last_became_active":"2024-05-30T17:02:50.070989+0000","last_became_peered":"2024-05-30T17:02:50.070989+0000","last_unstale":"2024-05-30T17:02:52.003259+0000","last_undegraded":"2024-05-30T17:02:52.003259+0000","last_fullsized":"2024-05-30T17:02:52.003259+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:20.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004725+0000","last_change":"2024-05-30T17:02:50.073425+0000","last_active":"2024-05-30T17:02:52.004725+0000","last_peered":"2024-05-30T17:02:52.004725+0000","last_clean":"2024-05-30T17:02:52.004725+0000","last_became_active":"2024-05-30T17:02:50.073195+0000","last_became_peered":"2024-05-30T17:02:50.073195+0000","last_unstale":"2024-05-30T17:02:52.004725+0000","last_undegraded":"2024-05-30T17:02:52.004725+0000","last_fullsized":"2024-05-30T17:02:52.004725+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:07:26.159149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004259+0000","last_change":"2024-05-30T17:02:50.067520+0000","last_active":"2024-05-30T17:02:52.004259+0000","last_peered":"2024-05-30T17:02:52.004259+0000","last_clean":"2024-05-30T17:02:52.004259+0000","last_became_active":"2024-05-30T17:02:50.067248+0000","last_became_peered":"2024-05-30T17:02:50.067248+0000","last_unstale":"2024-05-30T17:02:52.004259+0000","last_undegraded":"2024-05-30T17:02:52.004259+0000","last_fullsized":"2024-05-30T17:02:52.004259+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:35:30.994271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002618+0000","last_change":"2024-05-30T17:02:50.063564+0000","last_active":"2024-05-30T17:02:52.002618+0000","last_peered":"2024-05-30T17:02:52.002618+0000","last_clean":"2024-05-30T17:02:52.002618+0000","last_became_active":"2024-05-30T17:02:50.063253+0000","last_became_peered":"2024-05-30T17:02:50.063253+0000","last_unstale":"2024-05-30T17:02:52.002618+0000","last_undegraded":"2024-05-30T17:02:52.002618+0000","last_fullsized":"2024-05-30T17:02:52.002618+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:30:22.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003598+0000","last_change":"2024-05-30T17:02:50.064792+0000","last_active":"2024-05-30T17:02:52.003598+0000","last_peered":"2024-05-30T17:02:52.003598+0000","last_clean":"2024-05-30T17:02:52.003598+0000","last_became_active":"2024-05-30T17:02:50.064328+0000","last_became_peered":"2024-05-30T17:02:50.064328+0000","last_unstale":"2024-05-30T17:02:52.003598+0000","last_undegraded":"2024-05-30T17:02:52.003598+0000","last_fullsized":"2024-05-30T17:02:52.003598+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:18.544003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062244+0000","last_change":"2024-05-30T17:02:50.067822+0000","last_active":"2024-05-30T17:02:51.062244+0000","last_peered":"2024-05-30T17:02:51.062244+0000","last_clean":"2024-05-30T17:02:51.062244+0000","last_became_active":"2024-05-30T17:02:50.067307+0000","last_became_peered":"2024-05-30T17:02:50.067307+0000","last_unstale":"2024-05-30T17:02:51.062244+0000","last_undegraded":"2024-05-30T17:02:51.062244+0000","last_fullsized":"2024-05-30T17:02:51.062244+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:32:47.280031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.076019+0000","last_change":"2024-05-30T17:02:50.064566+0000","last_active":"2024-05-30T17:02:51.076019+0000","last_peered":"2024-05-30T17:02:51.076019+0000","last_clean":"2024-05-30T17:02:51.076019+0000","last_became_active":"2024-05-30T17:02:50.064280+0000","last_became_peered":"2024-05-30T17:02:50.064280+0000","last_unstale":"2024-05-30T17:02:51.076019+0000","last_undegraded":"2024-05-30T17:02:51.076019+0000","last_fullsized":"2024-05-30T17:02:51.076019+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:32:47.280031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004532+0000","last_change":"2024-05-30T17:02:50.073074+0000","last_active":"2024-05-30T17:02:52.004532+0000","last_peered":"2024-05-30T17:02:52.004532+0000","last_clean":"2024-05-30T17:02:52.004532+0000","last_became_active":"2024-05-30T17:02:50.072675+0000","last_became_peered":"2024-05-30T17:02:50.072675+0000","last_unstale":"2024-05-30T17:02:52.004532+0000","last_undegraded":"2024-05-30T17:02:52.004532+0000","last_fullsized":"2024-05-30T17:02:52.004532+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:53.082675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062504+0000","last_change":"2024-05-30T17:02:50.062093+0000","last_active":"2024-05-30T17:02:51.062504+0000","last_peered":"2024-05-30T17:02:51.062504+0000","last_clean":"2024-05-30T17:02:51.062504+0000","last_became_active":"2024-05-30T17:02:50.061753+0000","last_became_peered":"2024-05-30T17:02:50.061753+0000","last_unstale":"2024-05-30T17:02:51.062504+0000","last_undegraded":"2024-05-30T17:02:51.062504+0000","last_fullsized":"2024-05-30T17:02:51.062504+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:02:55.825631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062020+0000","last_change":"2024-05-30T17:02:50.071743+0000","last_active":"2024-05-30T17:02:51.062020+0000","last_peered":"2024-05-30T17:02:51.062020+0000","last_clean":"2024-05-30T17:02:51.062020+0000","last_became_active":"2024-05-30T17:02:50.071463+0000","last_became_peered":"2024-05-30T17:02:50.071463+0000","last_unstale":"2024-05-30T17:02:51.062020+0000","last_undegraded":"2024-05-30T17:02:51.062020+0000","last_fullsized":"2024-05-30T17:02:51.062020+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:07:34.051950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.074536+0000","last_change":"2024-05-30T17:02:50.072110+0000","last_active":"2024-05-30T17:02:50.074536+0000","last_peered":"2024-05-30T17:02:50.074536+0000","last_clean":"2024-05-30T17:02:50.074536+0000","last_became_active":"2024-05-30T17:02:50.071643+0000","last_became_peered":"2024-05-30T17:02:50.071643+0000","last_unstale":"2024-05-30T17:02:50.074536+0000","last_undegraded":"2024-05-30T17:02:50.074536+0000","last_fullsized":"2024-05-30T17:02:50.074536+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:58:59.481653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061231+0000","last_change":"2024-05-30T17:02:50.062222+0000","last_active":"2024-05-30T17:02:51.061231+0000","last_peered":"2024-05-30T17:02:51.061231+0000","last_clean":"2024-05-30T17:02:51.061231+0000","last_became_active":"2024-05-30T17:02:50.061871+0000","last_became_peered":"2024-05-30T17:02:50.061871+0000","last_unstale":"2024-05-30T17:02:51.061231+0000","last_undegraded":"2024-05-30T17:02:51.061231+0000","last_fullsized":"2024-05-30T17:02:51.061231+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:59:12.895466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.067088+0000","last_change":"2024-05-30T17:02:50.065810+0000","last_active":"2024-05-30T17:02:50.067088+0000","last_peered":"2024-05-30T17:02:50.067088+0000","last_clean":"2024-05-30T17:02:50.067088+0000","last_became_active":"2024-05-30T17:02:50.062696+0000","last_became_peered":"2024-05-30T17:02:50.062696+0000","last_unstale":"2024-05-30T17:02:50.067088+0000","last_undegraded":"2024-05-30T17:02:50.067088+0000","last_fullsized":"2024-05-30T17:02:50.067088+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:37.194545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062282+0000","last_change":"2024-05-30T17:02:50.067648+0000","last_active":"2024-05-30T17:02:51.062282+0000","last_peered":"2024-05-30T17:02:51.062282+0000","last_clean":"2024-05-30T17:02:51.062282+0000","last_became_active":"2024-05-30T17:02:50.066934+0000","last_became_peered":"2024-05-30T17:02:50.066934+0000","last_unstale":"2024-05-30T17:02:51.062282+0000","last_undegraded":"2024-05-30T17:02:51.062282+0000","last_fullsized":"2024-05-30T17:02:51.062282+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:22:16.056299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003736+0000","last_change":"2024-05-30T17:02:50.059087+0000","last_active":"2024-05-30T17:02:52.003736+0000","last_peered":"2024-05-30T17:02:52.003736+0000","last_clean":"2024-05-30T17:02:52.003736+0000","last_became_active":"2024-05-30T17:02:50.058821+0000","last_became_peered":"2024-05-30T17:02:50.058821+0000","last_unstale":"2024-05-30T17:02:52.003736+0000","last_undegraded":"2024-05-30T17:02:52.003736+0000","last_fullsized":"2024-05-30T17:02:52.003736+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:21.491376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003171+0000","last_change":"2024-05-30T17:02:50.055168+0000","last_active":"2024-05-30T17:02:52.003171+0000","last_peered":"2024-05-30T17:02:52.003171+0000","last_clean":"2024-05-30T17:02:52.003171+0000","last_became_active":"2024-05-30T17:02:50.054927+0000","last_became_peered":"2024-05-30T17:02:50.054927+0000","last_unstale":"2024-05-30T17:02:52.003171+0000","last_undegraded":"2024-05-30T17:02:52.003171+0000","last_fullsized":"2024-05-30T17:02:52.003171+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:30.516388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.077055+0000","last_change":"2024-05-30T17:02:50.068173+0000","last_active":"2024-05-30T17:02:50.077055+0000","last_peered":"2024-05-30T17:02:50.077055+0000","last_clean":"2024-05-30T17:02:50.077055+0000","last_became_active":"2024-05-30T17:02:50.067894+0000","last_became_peered":"2024-05-30T17:02:50.067894+0000","last_unstale":"2024-05-30T17:02:50.077055+0000","last_undegraded":"2024-05-30T17:02:50.077055+0000","last_fullsized":"2024-05-30T17:02:50.077055+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:11.551858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061681+0000","last_change":"2024-05-30T17:02:50.052154+0000","last_active":"2024-05-30T17:02:51.061681+0000","last_peered":"2024-05-30T17:02:51.061681+0000","last_clean":"2024-05-30T17:02:51.061681+0000","last_became_active":"2024-05-30T17:02:50.051848+0000","last_became_peered":"2024-05-30T17:02:50.051848+0000","last_unstale":"2024-05-30T17:02:51.061681+0000","last_undegraded":"2024-05-30T17:02:51.061681+0000","last_fullsized":"2024-05-30T17:02:51.061681+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:47:09.271306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062058+0000","last_change":"2024-05-30T17:02:50.066562+0000","last_active":"2024-05-30T17:02:51.062058+0000","last_peered":"2024-05-30T17:02:51.062058+0000","last_clean":"2024-05-30T17:02:51.062058+0000","last_became_active":"2024-05-30T17:02:50.066264+0000","last_became_peered":"2024-05-30T17:02:50.066264+0000","last_unstale":"2024-05-30T17:02:51.062058+0000","last_undegraded":"2024-05-30T17:02:51.062058+0000","last_fullsized":"2024-05-30T17:02:51.062058+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:11:18.259756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002452+0000","last_change":"2024-05-30T17:02:50.060061+0000","last_active":"2024-05-30T17:02:52.002452+0000","last_peered":"2024-05-30T17:02:52.002452+0000","last_clean":"2024-05-30T17:02:52.002452+0000","last_became_active":"2024-05-30T17:02:50.059734+0000","last_became_peered":"2024-05-30T17:02:50.059734+0000","last_unstale":"2024-05-30T17:02:52.002452+0000","last_undegraded":"2024-05-30T17:02:52.002452+0000","last_fullsized":"2024-05-30T17:02:52.002452+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:38:37.626136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002667+0000","last_change":"2024-05-30T17:02:50.063573+0000","last_active":"2024-05-30T17:02:52.002667+0000","last_peered":"2024-05-30T17:02:52.002667+0000","last_clean":"2024-05-30T17:02:52.002667+0000","last_became_active":"2024-05-30T17:02:50.063295+0000","last_became_peered":"2024-05-30T17:02:50.063295+0000","last_unstale":"2024-05-30T17:02:52.002667+0000","last_undegraded":"2024-05-30T17:02:52.002667+0000","last_fullsized":"2024-05-30T17:02:52.002667+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:33:20.871796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003290+0000","last_change":"2024-05-30T17:02:50.061602+0000","last_active":"2024-05-30T17:02:52.003290+0000","last_peered":"2024-05-30T17:02:52.003290+0000","last_clean":"2024-05-30T17:02:52.003290+0000","last_became_active":"2024-05-30T17:02:50.061298+0000","last_became_peered":"2024-05-30T17:02:50.061298+0000","last_unstale":"2024-05-30T17:02:52.003290+0000","last_undegraded":"2024-05-30T17:02:52.003290+0000","last_fullsized":"2024-05-30T17:02:52.003290+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:29:43.400748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"115'4","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062697+0000","last_change":"2024-05-30T17:02:49.050328+0000","last_active":"2024-05-30T17:02:51.062697+0000","last_peered":"2024-05-30T17:02:51.062697+0000","last_clean":"2024-05-30T17:02:51.062697+0000","last_became_active":"2024-05-30T17:02:49.049558+0000","last_became_peered":"2024-05-30T17:02:49.049558+0000","last_unstale":"2024-05-30T17:02:51.062697+0000","last_undegraded":"2024-05-30T17:02:51.062697+0000","last_fullsized":"2024-05-30T17:02:51.062697+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:32:36.454517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.076212+0000","last_change":"2024-05-30T17:02:50.067383+0000","last_active":"2024-05-30T17:02:51.076212+0000","last_peered":"2024-05-30T17:02:51.076212+0000","last_clean":"2024-05-30T17:02:51.076212+0000","last_became_active":"2024-05-30T17:02:50.067037+0000","last_became_peered":"2024-05-30T17:02:50.067037+0000","last_unstale":"2024-05-30T17:02:51.076212+0000","last_undegraded":"2024-05-30T17:02:51.076212+0000","last_fullsized":"2024-05-30T17:02:51.076212+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:02:55.825631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004382+0000","last_change":"2024-05-30T17:02:49.052729+0000","last_active":"2024-05-30T17:02:52.004382+0000","last_peered":"2024-05-30T17:02:52.004382+0000","last_clean":"2024-05-30T17:02:52.004382+0000","last_became_active":"2024-05-30T17:02:49.051810+0000","last_became_peered":"2024-05-30T17:02:49.051810+0000","last_unstale":"2024-05-30T17:02:52.004382+0000","last_undegraded":"2024-05-30T17:02:52.004382+0000","last_fullsized":"2024-05-30T17:02:52.004382+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:29:41.884285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003678+0000","last_change":"2024-05-30T17:02:50.074502+0000","last_active":"2024-05-30T17:02:52.003678+0000","last_peered":"2024-05-30T17:02:52.003678+0000","last_clean":"2024-05-30T17:02:52.003678+0000","last_became_active":"2024-05-30T17:02:50.074153+0000","last_became_peered":"2024-05-30T17:02:50.074153+0000","last_unstale":"2024-05-30T17:02:52.003678+0000","last_undegraded":"2024-05-30T17:02:52.003678+0000","last_fullsized":"2024-05-30T17:02:52.003678+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:54:52.431416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058809+0000","last_change":"2024-05-30T17:02:49.047460+0000","last_active":"2024-05-30T17:02:51.058809+0000","last_peered":"2024-05-30T17:02:51.058809+0000","last_clean":"2024-05-30T17:02:51.058809+0000","last_became_active":"2024-05-30T17:02:49.047088+0000","last_became_peered":"2024-05-30T17:02:49.047088+0000","last_unstale":"2024-05-30T17:02:51.058809+0000","last_undegraded":"2024-05-30T17:02:51.058809+0000","last_fullsized":"2024-05-30T17:02:51.058809+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:38:42.010125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004680+0000","last_change":"2024-05-30T17:02:50.073704+0000","last_active":"2024-05-30T17:02:52.004680+0000","last_peered":"2024-05-30T17:02:52.004680+0000","last_clean":"2024-05-30T17:02:52.004680+0000","last_became_active":"2024-05-30T17:02:50.073329+0000","last_became_peered":"2024-05-30T17:02:50.073329+0000","last_unstale":"2024-05-30T17:02:52.004680+0000","last_undegraded":"2024-05-30T17:02:52.004680+0000","last_fullsized":"2024-05-30T17:02:52.004680+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:23:09.550240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058617+0000","last_change":"2024-05-30T17:02:49.047318+0000","last_active":"2024-05-30T17:02:51.058617+0000","last_peered":"2024-05-30T17:02:51.058617+0000","last_clean":"2024-05-30T17:02:51.058617+0000","last_became_active":"2024-05-30T17:02:49.046979+0000","last_became_peered":"2024-05-30T17:02:49.046979+0000","last_unstale":"2024-05-30T17:02:51.058617+0000","last_undegraded":"2024-05-30T17:02:51.058617+0000","last_fullsized":"2024-05-30T17:02:51.058617+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:30:21.421128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002603+0000","last_change":"2024-05-30T17:02:50.067660+0000","last_active":"2024-05-30T17:02:52.002603+0000","last_peered":"2024-05-30T17:02:52.002603+0000","last_clean":"2024-05-30T17:02:52.002603+0000","last_became_active":"2024-05-30T17:02:50.067354+0000","last_became_peered":"2024-05-30T17:02:50.067354+0000","last_unstale":"2024-05-30T17:02:52.002603+0000","last_undegraded":"2024-05-30T17:02:52.002603+0000","last_fullsized":"2024-05-30T17:02:52.002603+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:44.259833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061830+0000","last_change":"2024-05-30T17:02:49.050155+0000","last_active":"2024-05-30T17:02:51.061830+0000","last_peered":"2024-05-30T17:02:51.061830+0000","last_clean":"2024-05-30T17:02:51.061830+0000","last_became_active":"2024-05-30T17:02:49.049851+0000","last_became_peered":"2024-05-30T17:02:49.049851+0000","last_unstale":"2024-05-30T17:02:51.061830+0000","last_undegraded":"2024-05-30T17:02:51.061830+0000","last_fullsized":"2024-05-30T17:02:51.061830+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:54:51.422315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061865+0000","last_change":"2024-05-30T17:02:50.053420+0000","last_active":"2024-05-30T17:02:51.061865+0000","last_peered":"2024-05-30T17:02:51.061865+0000","last_clean":"2024-05-30T17:02:51.061865+0000","last_became_active":"2024-05-30T17:02:50.053151+0000","last_became_peered":"2024-05-30T17:02:50.053151+0000","last_unstale":"2024-05-30T17:02:51.061865+0000","last_undegraded":"2024-05-30T17:02:51.061865+0000","last_fullsized":"2024-05-30T17:02:51.061865+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:25.177668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"115'1","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.080548+0000","last_change":"2024-05-30T17:02:49.043396+0000","last_active":"2024-05-30T17:02:50.080548+0000","last_peered":"2024-05-30T17:02:50.080548+0000","last_clean":"2024-05-30T17:02:50.080548+0000","last_became_active":"2024-05-30T17:02:49.043082+0000","last_became_peered":"2024-05-30T17:02:49.043082+0000","last_unstale":"2024-05-30T17:02:50.080548+0000","last_undegraded":"2024-05-30T17:02:50.080548+0000","last_fullsized":"2024-05-30T17:02:50.080548+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:40.020701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002797+0000","last_change":"2024-05-30T17:02:50.056831+0000","last_active":"2024-05-30T17:02:52.002797+0000","last_peered":"2024-05-30T17:02:52.002797+0000","last_clean":"2024-05-30T17:02:52.002797+0000","last_became_active":"2024-05-30T17:02:50.056554+0000","last_became_peered":"2024-05-30T17:02:50.056554+0000","last_unstale":"2024-05-30T17:02:52.002797+0000","last_undegraded":"2024-05-30T17:02:52.002797+0000","last_fullsized":"2024-05-30T17:02:52.002797+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:23:54.144083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061405+0000","last_change":"2024-05-30T17:02:49.047411+0000","last_active":"2024-05-30T17:02:51.061405+0000","last_peered":"2024-05-30T17:02:51.061405+0000","last_clean":"2024-05-30T17:02:51.061405+0000","last_became_active":"2024-05-30T17:02:49.047155+0000","last_became_peered":"2024-05-30T17:02:49.047155+0000","last_unstale":"2024-05-30T17:02:51.061405+0000","last_undegraded":"2024-05-30T17:02:51.061405+0000","last_fullsized":"2024-05-30T17:02:51.061405+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:32:36.375345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062393+0000","last_change":"2024-05-30T17:02:50.061253+0000","last_active":"2024-05-30T17:02:51.062393+0000","last_peered":"2024-05-30T17:02:51.062393+0000","last_clean":"2024-05-30T17:02:51.062393+0000","last_became_active":"2024-05-30T17:02:50.060770+0000","last_became_peered":"2024-05-30T17:02:50.060770+0000","last_unstale":"2024-05-30T17:02:51.062393+0000","last_undegraded":"2024-05-30T17:02:51.062393+0000","last_fullsized":"2024-05-30T17:02:51.062393+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:31.025916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003012+0000","last_change":"2024-05-30T17:02:49.053596+0000","last_active":"2024-05-30T17:02:52.003012+0000","last_peered":"2024-05-30T17:02:52.003012+0000","last_clean":"2024-05-30T17:02:52.003012+0000","last_became_active":"2024-05-30T17:02:49.053312+0000","last_became_peered":"2024-05-30T17:02:49.053312+0000","last_unstale":"2024-05-30T17:02:52.003012+0000","last_undegraded":"2024-05-30T17:02:52.003012+0000","last_fullsized":"2024-05-30T17:02:52.003012+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:22:15.047199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062749+0000","last_change":"2024-05-30T17:02:50.053052+0000","last_active":"2024-05-30T17:02:51.062749+0000","last_peered":"2024-05-30T17:02:51.062749+0000","last_clean":"2024-05-30T17:02:51.062749+0000","last_became_active":"2024-05-30T17:02:50.052771+0000","last_became_peered":"2024-05-30T17:02:50.052771+0000","last_unstale":"2024-05-30T17:02:51.062749+0000","last_undegraded":"2024-05-30T17:02:51.062749+0000","last_fullsized":"2024-05-30T17:02:51.062749+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:53.819409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058680+0000","last_change":"2024-05-30T17:02:49.048397+0000","last_active":"2024-05-30T17:02:51.058680+0000","last_peered":"2024-05-30T17:02:51.058680+0000","last_clean":"2024-05-30T17:02:51.058680+0000","last_became_active":"2024-05-30T17:02:49.047617+0000","last_became_peered":"2024-05-30T17:02:49.047617+0000","last_unstale":"2024-05-30T17:02:51.058680+0000","last_undegraded":"2024-05-30T17:02:51.058680+0000","last_fullsized":"2024-05-30T17:02:51.058680+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:33:19.862696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.076181+0000","last_change":"2024-05-30T17:02:50.070198+0000","last_active":"2024-05-30T17:02:51.076181+0000","last_peered":"2024-05-30T17:02:51.076181+0000","last_clean":"2024-05-30T17:02:51.076181+0000","last_became_active":"2024-05-30T17:02:50.069713+0000","last_became_peered":"2024-05-30T17:02:50.069713+0000","last_unstale":"2024-05-30T17:02:51.076181+0000","last_undegraded":"2024-05-30T17:02:51.076181+0000","last_fullsized":"2024-05-30T17:02:51.076181+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:22:16.056299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.052843+0000","last_change":"2024-05-30T17:02:49.042341+0000","last_active":"2024-05-30T17:02:50.052843+0000","last_peered":"2024-05-30T17:02:50.052843+0000","last_clean":"2024-05-30T17:02:50.052843+0000","last_became_active":"2024-05-30T17:02:49.042025+0000","last_became_peered":"2024-05-30T17:02:49.042025+0000","last_unstale":"2024-05-30T17:02:50.052843+0000","last_undegraded":"2024-05-30T17:02:50.052843+0000","last_fullsized":"2024-05-30T17:02:50.052843+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:37.210722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.077079+0000","last_change":"2024-05-30T17:02:50.069202+0000","last_active":"2024-05-30T17:02:50.077079+0000","last_peered":"2024-05-30T17:02:50.077079+0000","last_clean":"2024-05-30T17:02:50.077079+0000","last_became_active":"2024-05-30T17:02:50.068263+0000","last_became_peered":"2024-05-30T17:02:50.068263+0000","last_unstale":"2024-05-30T17:02:50.077079+0000","last_undegraded":"2024-05-30T17:02:50.077079+0000","last_fullsized":"2024-05-30T17:02:50.077079+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:56:54.358891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"115'3","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003434+0000","last_change":"2024-05-30T17:02:49.054039+0000","last_active":"2024-05-30T17:02:52.003434+0000","last_peered":"2024-05-30T17:02:52.003434+0000","last_clean":"2024-05-30T17:02:52.003434+0000","last_became_active":"2024-05-30T17:02:49.053777+0000","last_became_peered":"2024-05-30T17:02:49.053777+0000","last_unstale":"2024-05-30T17:02:52.003434+0000","last_undegraded":"2024-05-30T17:02:52.003434+0000","last_fullsized":"2024-05-30T17:02:52.003434+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:38:11.122473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062418+0000","last_change":"2024-05-30T17:02:50.059659+0000","last_active":"2024-05-30T17:02:51.062418+0000","last_peered":"2024-05-30T17:02:51.062418+0000","last_clean":"2024-05-30T17:02:51.062418+0000","last_became_active":"2024-05-30T17:02:50.059383+0000","last_became_peered":"2024-05-30T17:02:50.059383+0000","last_unstale":"2024-05-30T17:02:51.062418+0000","last_undegraded":"2024-05-30T17:02:51.062418+0000","last_fullsized":"2024-05-30T17:02:51.062418+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:32:57.567186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"115'6","reported_seq":20,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003512+0000","last_change":"2024-05-30T17:02:49.049366+0000","last_active":"2024-05-30T17:02:52.003512+0000","last_peered":"2024-05-30T17:02:52.003512+0000","last_clean":"2024-05-30T17:02:52.003512+0000","last_became_active":"2024-05-30T17:02:49.049067+0000","last_became_peered":"2024-05-30T17:02:49.049067+0000","last_unstale":"2024-05-30T17:02:52.003512+0000","last_undegraded":"2024-05-30T17:02:52.003512+0000","last_fullsized":"2024-05-30T17:02:52.003512+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:55:51.384117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.074510+0000","last_change":"2024-05-30T17:02:50.071898+0000","last_active":"2024-05-30T17:02:50.074510+0000","last_peered":"2024-05-30T17:02:50.074510+0000","last_clean":"2024-05-30T17:02:50.074510+0000","last_became_active":"2024-05-30T17:02:50.071267+0000","last_became_peered":"2024-05-30T17:02:50.071267+0000","last_unstale":"2024-05-30T17:02:50.074510+0000","last_undegraded":"2024-05-30T17:02:50.074510+0000","last_fullsized":"2024-05-30T17:02:50.074510+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:04.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003131+0000","last_change":"2024-05-30T17:02:49.051925+0000","last_active":"2024-05-30T17:02:52.003131+0000","last_peered":"2024-05-30T17:02:52.003131+0000","last_clean":"2024-05-30T17:02:52.003131+0000","last_became_active":"2024-05-30T17:02:49.051180+0000","last_became_peered":"2024-05-30T17:02:49.051180+0000","last_unstale":"2024-05-30T17:02:52.003131+0000","last_undegraded":"2024-05-30T17:02:52.003131+0000","last_fullsized":"2024-05-30T17:02:52.003131+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:26.212295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.074311+0000","last_change":"2024-05-30T17:02:50.068030+0000","last_active":"2024-05-30T17:02:50.074311+0000","last_peered":"2024-05-30T17:02:50.074311+0000","last_clean":"2024-05-30T17:02:50.074311+0000","last_became_active":"2024-05-30T17:02:50.067752+0000","last_became_peered":"2024-05-30T17:02:50.067752+0000","last_unstale":"2024-05-30T17:02:50.074311+0000","last_undegraded":"2024-05-30T17:02:50.074311+0000","last_fullsized":"2024-05-30T17:02:50.074311+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:16.732633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.076003+0000","last_change":"2024-05-30T17:02:49.056583+0000","last_active":"2024-05-30T17:02:51.076003+0000","last_peered":"2024-05-30T17:02:51.076003+0000","last_clean":"2024-05-30T17:02:51.076003+0000","last_became_active":"2024-05-30T17:02:49.056333+0000","last_became_peered":"2024-05-30T17:02:49.056333+0000","last_unstale":"2024-05-30T17:02:51.076003+0000","last_undegraded":"2024-05-30T17:02:51.076003+0000","last_fullsized":"2024-05-30T17:02:51.076003+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:42:15.426991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.074557+0000","last_change":"2024-05-30T17:02:50.068376+0000","last_active":"2024-05-30T17:02:50.074557+0000","last_peered":"2024-05-30T17:02:50.074557+0000","last_clean":"2024-05-30T17:02:50.074557+0000","last_became_active":"2024-05-30T17:02:50.068102+0000","last_became_peered":"2024-05-30T17:02:50.068102+0000","last_unstale":"2024-05-30T17:02:50.074557+0000","last_undegraded":"2024-05-30T17:02:50.074557+0000","last_fullsized":"2024-05-30T17:02:50.074557+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:07:01.582819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"115'8","reported_seq":22,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058384+0000","last_change":"2024-05-30T17:02:49.054959+0000","last_active":"2024-05-30T17:02:51.058384+0000","last_peered":"2024-05-30T17:02:51.058384+0000","last_clean":"2024-05-30T17:02:51.058384+0000","last_became_active":"2024-05-30T17:02:49.054601+0000","last_became_peered":"2024-05-30T17:02:49.054601+0000","last_unstale":"2024-05-30T17:02:51.058384+0000","last_undegraded":"2024-05-30T17:02:51.058384+0000","last_fullsized":"2024-05-30T17:02:51.058384+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:49.887784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058838+0000","last_change":"2024-05-30T17:02:50.060581+0000","last_active":"2024-05-30T17:02:51.058838+0000","last_peered":"2024-05-30T17:02:51.058838+0000","last_clean":"2024-05-30T17:02:51.058838+0000","last_became_active":"2024-05-30T17:02:50.060319+0000","last_became_peered":"2024-05-30T17:02:50.060319+0000","last_unstale":"2024-05-30T17:02:51.058838+0000","last_undegraded":"2024-05-30T17:02:51.058838+0000","last_fullsized":"2024-05-30T17:02:51.058838+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:21:09.924325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004096+0000","last_change":"2024-05-30T17:02:49.053408+0000","last_active":"2024-05-30T17:02:52.004096+0000","last_peered":"2024-05-30T17:02:52.004096+0000","last_clean":"2024-05-30T17:02:52.004096+0000","last_became_active":"2024-05-30T17:02:49.052298+0000","last_became_peered":"2024-05-30T17:02:49.052298+0000","last_unstale":"2024-05-30T17:02:52.004096+0000","last_undegraded":"2024-05-30T17:02:52.004096+0000","last_fullsized":"2024-05-30T17:02:52.004096+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:41.423863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003530+0000","last_change":"2024-05-30T17:02:50.057785+0000","last_active":"2024-05-30T17:02:52.003530+0000","last_peered":"2024-05-30T17:02:52.003530+0000","last_clean":"2024-05-30T17:02:52.003530+0000","last_became_active":"2024-05-30T17:02:50.057514+0000","last_became_peered":"2024-05-30T17:02:50.057514+0000","last_unstale":"2024-05-30T17:02:52.003530+0000","last_undegraded":"2024-05-30T17:02:52.003530+0000","last_fullsized":"2024-05-30T17:02:52.003530+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:14:21.616166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058841+0000","last_change":"2024-05-30T17:02:49.037250+0000","last_active":"2024-05-30T17:02:51.058841+0000","last_peered":"2024-05-30T17:02:51.058841+0000","last_clean":"2024-05-30T17:02:51.058841+0000","last_became_active":"2024-05-30T17:02:49.036918+0000","last_became_peered":"2024-05-30T17:02:49.036918+0000","last_unstale":"2024-05-30T17:02:51.058841+0000","last_undegraded":"2024-05-30T17:02:51.058841+0000","last_fullsized":"2024-05-30T17:02:51.058841+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:29:42.391648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004546+0000","last_change":"2024-05-30T17:02:50.069932+0000","last_active":"2024-05-30T17:02:52.004546+0000","last_peered":"2024-05-30T17:02:52.004546+0000","last_clean":"2024-05-30T17:02:52.004546+0000","last_became_active":"2024-05-30T17:02:50.069617+0000","last_became_peered":"2024-05-30T17:02:50.069617+0000","last_unstale":"2024-05-30T17:02:52.004546+0000","last_undegraded":"2024-05-30T17:02:52.004546+0000","last_fullsized":"2024-05-30T17:02:52.004546+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:30.337045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.076112+0000","last_change":"2024-05-30T17:02:49.049919+0000","last_active":"2024-05-30T17:02:51.076112+0000","last_peered":"2024-05-30T17:02:51.076112+0000","last_clean":"2024-05-30T17:02:51.076112+0000","last_became_active":"2024-05-30T17:02:49.049472+0000","last_became_peered":"2024-05-30T17:02:49.049472+0000","last_unstale":"2024-05-30T17:02:51.076112+0000","last_undegraded":"2024-05-30T17:02:51.076112+0000","last_fullsized":"2024-05-30T17:02:51.076112+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:16.088363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004710+0000","last_change":"2024-05-30T17:02:50.065408+0000","last_active":"2024-05-30T17:02:52.004710+0000","last_peered":"2024-05-30T17:02:52.004710+0000","last_clean":"2024-05-30T17:02:52.004710+0000","last_became_active":"2024-05-30T17:02:50.064704+0000","last_became_peered":"2024-05-30T17:02:50.064704+0000","last_unstale":"2024-05-30T17:02:52.004710+0000","last_undegraded":"2024-05-30T17:02:52.004710+0000","last_fullsized":"2024-05-30T17:02:52.004710+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:56.847080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062085+0000","last_change":"2024-05-30T17:02:49.052470+0000","last_active":"2024-05-30T17:02:51.062085+0000","last_peered":"2024-05-30T17:02:51.062085+0000","last_clean":"2024-05-30T17:02:51.062085+0000","last_became_active":"2024-05-30T17:02:49.052162+0000","last_became_peered":"2024-05-30T17:02:49.052162+0000","last_unstale":"2024-05-30T17:02:51.062085+0000","last_undegraded":"2024-05-30T17:02:51.062085+0000","last_fullsized":"2024-05-30T17:02:51.062085+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:44.471862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004302+0000","last_change":"2024-05-30T17:02:50.070243+0000","last_active":"2024-05-30T17:02:52.004302+0000","last_peered":"2024-05-30T17:02:52.004302+0000","last_clean":"2024-05-30T17:02:52.004302+0000","last_became_active":"2024-05-30T17:02:50.069914+0000","last_became_peered":"2024-05-30T17:02:50.069914+0000","last_unstale":"2024-05-30T17:02:52.004302+0000","last_undegraded":"2024-05-30T17:02:52.004302+0000","last_fullsized":"2024-05-30T17:02:52.004302+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:36.421629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003274+0000","last_change":"2024-05-30T17:02:49.047104+0000","last_active":"2024-05-30T17:02:52.003274+0000","last_peered":"2024-05-30T17:02:52.003274+0000","last_clean":"2024-05-30T17:02:52.003274+0000","last_became_active":"2024-05-30T17:02:49.046809+0000","last_became_peered":"2024-05-30T17:02:49.046809+0000","last_unstale":"2024-05-30T17:02:52.003274+0000","last_undegraded":"2024-05-30T17:02:52.003274+0000","last_fullsized":"2024-05-30T17:02:52.003274+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:05:23.034593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002833+0000","last_change":"2024-05-30T17:02:50.062357+0000","last_active":"2024-05-30T17:02:52.002833+0000","last_peered":"2024-05-30T17:02:52.002833+0000","last_clean":"2024-05-30T17:02:52.002833+0000","last_became_active":"2024-05-30T17:02:50.062062+0000","last_became_peered":"2024-05-30T17:02:50.062062+0000","last_unstale":"2024-05-30T17:02:52.002833+0000","last_undegraded":"2024-05-30T17:02:52.002833+0000","last_fullsized":"2024-05-30T17:02:52.002833+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:39:04.509572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058400+0000","last_change":"2024-05-30T17:02:49.047661+0000","last_active":"2024-05-30T17:02:51.058400+0000","last_peered":"2024-05-30T17:02:51.058400+0000","last_clean":"2024-05-30T17:02:51.058400+0000","last_became_active":"2024-05-30T17:02:49.047275+0000","last_became_peered":"2024-05-30T17:02:49.047275+0000","last_unstale":"2024-05-30T17:02:51.058400+0000","last_undegraded":"2024-05-30T17:02:51.058400+0000","last_fullsized":"2024-05-30T17:02:51.058400+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:29.507288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004336+0000","last_change":"2024-05-30T17:02:50.063727+0000","last_active":"2024-05-30T17:02:52.004336+0000","last_peered":"2024-05-30T17:02:52.004336+0000","last_clean":"2024-05-30T17:02:52.004336+0000","last_became_active":"2024-05-30T17:02:50.063308+0000","last_became_peered":"2024-05-30T17:02:50.063308+0000","last_unstale":"2024-05-30T17:02:52.004336+0000","last_undegraded":"2024-05-30T17:02:52.004336+0000","last_fullsized":"2024-05-30T17:02:52.004336+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:42.432963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002797+0000","last_change":"2024-05-30T17:02:49.047931+0000","last_active":"2024-05-30T17:02:52.002797+0000","last_peered":"2024-05-30T17:02:52.002797+0000","last_clean":"2024-05-30T17:02:52.002797+0000","last_became_active":"2024-05-30T17:02:49.047652+0000","last_became_peered":"2024-05-30T17:02:49.047652+0000","last_unstale":"2024-05-30T17:02:52.002797+0000","last_undegraded":"2024-05-30T17:02:52.002797+0000","last_fullsized":"2024-05-30T17:02:52.002797+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:23.572140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.074597+0000","last_change":"2024-05-30T17:02:50.073141+0000","last_active":"2024-05-30T17:02:50.074597+0000","last_peered":"2024-05-30T17:02:50.074597+0000","last_clean":"2024-05-30T17:02:50.074597+0000","last_became_active":"2024-05-30T17:02:50.072879+0000","last_became_peered":"2024-05-30T17:02:50.072879+0000","last_unstale":"2024-05-30T17:02:50.074597+0000","last_undegraded":"2024-05-30T17:02:50.074597+0000","last_fullsized":"2024-05-30T17:02:50.074597+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:32:11.425539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003119+0000","last_change":"2024-05-30T17:02:49.055582+0000","last_active":"2024-05-30T17:02:52.003119+0000","last_peered":"2024-05-30T17:02:52.003119+0000","last_clean":"2024-05-30T17:02:52.003119+0000","last_became_active":"2024-05-30T17:02:49.055320+0000","last_became_peered":"2024-05-30T17:02:49.055320+0000","last_unstale":"2024-05-30T17:02:52.003119+0000","last_undegraded":"2024-05-30T17:02:52.003119+0000","last_fullsized":"2024-05-30T17:02:52.003119+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:02:54.816530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.075998+0000","last_change":"2024-05-30T17:02:50.069184+0000","last_active":"2024-05-30T17:02:51.075998+0000","last_peered":"2024-05-30T17:02:51.075998+0000","last_clean":"2024-05-30T17:02:51.075998+0000","last_became_active":"2024-05-30T17:02:50.068889+0000","last_became_peered":"2024-05-30T17:02:50.068889+0000","last_unstale":"2024-05-30T17:02:51.075998+0000","last_undegraded":"2024-05-30T17:02:51.075998+0000","last_fullsized":"2024-05-30T17:02:51.075998+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:07:34.051950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.082037+0000","last_change":"2024-05-30T17:02:49.049986+0000","last_active":"2024-05-30T17:02:50.082037+0000","last_peered":"2024-05-30T17:02:50.082037+0000","last_clean":"2024-05-30T17:02:50.082037+0000","last_became_active":"2024-05-30T17:02:49.049719+0000","last_became_peered":"2024-05-30T17:02:49.049719+0000","last_unstale":"2024-05-30T17:02:50.082037+0000","last_undegraded":"2024-05-30T17:02:50.082037+0000","last_fullsized":"2024-05-30T17:02:50.082037+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:51:08.728886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004031+0000","last_change":"2024-05-30T17:02:50.065832+0000","last_active":"2024-05-30T17:02:52.004031+0000","last_peered":"2024-05-30T17:02:52.004031+0000","last_clean":"2024-05-30T17:02:52.004031+0000","last_became_active":"2024-05-30T17:02:50.065552+0000","last_became_peered":"2024-05-30T17:02:50.065552+0000","last_unstale":"2024-05-30T17:02:52.004031+0000","last_undegraded":"2024-05-30T17:02:52.004031+0000","last_fullsized":"2024-05-30T17:02:52.004031+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:33:49.399244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"116'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.077608+0000","last_change":"2024-05-30T17:02:49.045620+0000","last_active":"2024-05-30T17:02:51.077608+0000","last_peered":"2024-05-30T17:02:51.077608+0000","last_clean":"2024-05-30T17:02:51.077608+0000","last_became_active":"2024-05-30T17:02:49.044750+0000","last_became_peered":"2024-05-30T17:02:49.044750+0000","last_unstale":"2024-05-30T17:02:51.077608+0000","last_undegraded":"2024-05-30T17:02:51.077608+0000","last_fullsized":"2024-05-30T17:02:51.077608+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:59:11.886366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003377+0000","last_change":"2024-05-30T17:02:50.059508+0000","last_active":"2024-05-30T17:02:52.003377+0000","last_peered":"2024-05-30T17:02:52.003377+0000","last_clean":"2024-05-30T17:02:52.003377+0000","last_became_active":"2024-05-30T17:02:50.059256+0000","last_became_peered":"2024-05-30T17:02:50.059256+0000","last_unstale":"2024-05-30T17:02:52.003377+0000","last_undegraded":"2024-05-30T17:02:52.003377+0000","last_fullsized":"2024-05-30T17:02:52.003377+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:05:58.381369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003567+0000","last_change":"2024-05-30T17:02:49.055536+0000","last_active":"2024-05-30T17:02:52.003567+0000","last_peered":"2024-05-30T17:02:52.003567+0000","last_clean":"2024-05-30T17:02:52.003567+0000","last_became_active":"2024-05-30T17:02:49.055302+0000","last_became_peered":"2024-05-30T17:02:49.055302+0000","last_unstale":"2024-05-30T17:02:52.003567+0000","last_undegraded":"2024-05-30T17:02:52.003567+0000","last_fullsized":"2024-05-30T17:02:52.003567+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:55:41.432835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.076147+0000","last_change":"2024-05-30T17:02:50.062095+0000","last_active":"2024-05-30T17:02:51.076147+0000","last_peered":"2024-05-30T17:02:51.076147+0000","last_clean":"2024-05-30T17:02:51.076147+0000","last_became_active":"2024-05-30T17:02:50.061785+0000","last_became_peered":"2024-05-30T17:02:50.061785+0000","last_unstale":"2024-05-30T17:02:51.076147+0000","last_undegraded":"2024-05-30T17:02:51.076147+0000","last_fullsized":"2024-05-30T17:02:51.076147+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:38:12.131574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.058423+0000","last_change":"2024-05-30T17:02:49.055543+0000","last_active":"2024-05-30T17:02:50.058423+0000","last_peered":"2024-05-30T17:02:50.058423+0000","last_clean":"2024-05-30T17:02:50.058423+0000","last_became_active":"2024-05-30T17:02:49.055244+0000","last_became_peered":"2024-05-30T17:02:49.055244+0000","last_unstale":"2024-05-30T17:02:50.058423+0000","last_undegraded":"2024-05-30T17:02:50.058423+0000","last_fullsized":"2024-05-30T17:02:50.058423+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:26:08.740743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061577+0000","last_change":"2024-05-30T17:02:50.051046+0000","last_active":"2024-05-30T17:02:51.061577+0000","last_peered":"2024-05-30T17:02:51.061577+0000","last_clean":"2024-05-30T17:02:51.061577+0000","last_became_active":"2024-05-30T17:02:50.050738+0000","last_became_peered":"2024-05-30T17:02:50.050738+0000","last_unstale":"2024-05-30T17:02:51.061577+0000","last_undegraded":"2024-05-30T17:02:51.061577+0000","last_fullsized":"2024-05-30T17:02:51.061577+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:48:05.539513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061939+0000","last_change":"2024-05-30T17:02:49.043264+0000","last_active":"2024-05-30T17:02:51.061939+0000","last_peered":"2024-05-30T17:02:51.061939+0000","last_clean":"2024-05-30T17:02:51.061939+0000","last_became_active":"2024-05-30T17:02:49.042929+0000","last_became_peered":"2024-05-30T17:02:49.042929+0000","last_unstale":"2024-05-30T17:02:51.061939+0000","last_undegraded":"2024-05-30T17:02:51.061939+0000","last_fullsized":"2024-05-30T17:02:51.061939+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:21:08.915225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062256+0000","last_change":"2024-05-30T17:02:50.049931+0000","last_active":"2024-05-30T17:02:51.062256+0000","last_peered":"2024-05-30T17:02:51.062256+0000","last_clean":"2024-05-30T17:02:51.062256+0000","last_became_active":"2024-05-30T17:02:50.049632+0000","last_became_peered":"2024-05-30T17:02:50.049632+0000","last_unstale":"2024-05-30T17:02:51.062256+0000","last_undegraded":"2024-05-30T17:02:51.062256+0000","last_fullsized":"2024-05-30T17:02:51.062256+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:38:12.131574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061684+0000","last_change":"2024-05-30T17:02:49.050314+0000","last_active":"2024-05-30T17:02:51.061684+0000","last_peered":"2024-05-30T17:02:51.061684+0000","last_clean":"2024-05-30T17:02:51.061684+0000","last_became_active":"2024-05-30T17:02:49.050014+0000","last_became_peered":"2024-05-30T17:02:49.050014+0000","last_unstale":"2024-05-30T17:02:51.061684+0000","last_undegraded":"2024-05-30T17:02:51.061684+0000","last_fullsized":"2024-05-30T17:02:51.061684+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:56:48.003494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004438+0000","last_change":"2024-05-30T17:02:50.063650+0000","last_active":"2024-05-30T17:02:52.004438+0000","last_peered":"2024-05-30T17:02:52.004438+0000","last_clean":"2024-05-30T17:02:52.004438+0000","last_became_active":"2024-05-30T17:02:50.062909+0000","last_became_peered":"2024-05-30T17:02:50.062909+0000","last_unstale":"2024-05-30T17:02:52.004438+0000","last_undegraded":"2024-05-30T17:02:52.004438+0000","last_fullsized":"2024-05-30T17:02:52.004438+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:34.739950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058429+0000","last_change":"2024-05-30T17:02:49.047491+0000","last_active":"2024-05-30T17:02:51.058429+0000","last_peered":"2024-05-30T17:02:51.058429+0000","last_clean":"2024-05-30T17:02:51.058429+0000","last_became_active":"2024-05-30T17:02:49.047171+0000","last_became_peered":"2024-05-30T17:02:49.047171+0000","last_unstale":"2024-05-30T17:02:51.058429+0000","last_undegraded":"2024-05-30T17:02:51.058429+0000","last_fullsized":"2024-05-30T17:02:51.058429+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:30:47.939217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002668+0000","last_change":"2024-05-30T17:02:50.056219+0000","last_active":"2024-05-30T17:02:52.002668+0000","last_peered":"2024-05-30T17:02:52.002668+0000","last_clean":"2024-05-30T17:02:52.002668+0000","last_became_active":"2024-05-30T17:02:50.055827+0000","last_became_peered":"2024-05-30T17:02:50.055827+0000","last_unstale":"2024-05-30T17:02:52.002668+0000","last_undegraded":"2024-05-30T17:02:52.002668+0000","last_fullsized":"2024-05-30T17:02:52.002668+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:50.033048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003227+0000","last_change":"2024-05-30T17:02:49.056197+0000","last_active":"2024-05-30T17:02:52.003227+0000","last_peered":"2024-05-30T17:02:52.003227+0000","last_clean":"2024-05-30T17:02:52.003227+0000","last_became_active":"2024-05-30T17:02:49.055622+0000","last_became_peered":"2024-05-30T17:02:49.055622+0000","last_unstale":"2024-05-30T17:02:52.003227+0000","last_undegraded":"2024-05-30T17:02:52.003227+0000","last_fullsized":"2024-05-30T17:02:52.003227+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:55:15.920315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.066100+0000","last_change":"2024-05-30T17:02:50.063097+0000","last_active":"2024-05-30T17:02:50.066100+0000","last_peered":"2024-05-30T17:02:50.066100+0000","last_clean":"2024-05-30T17:02:50.066100+0000","last_became_active":"2024-05-30T17:02:50.062805+0000","last_became_peered":"2024-05-30T17:02:50.062805+0000","last_unstale":"2024-05-30T17:02:50.066100+0000","last_undegraded":"2024-05-30T17:02:50.066100+0000","last_fullsized":"2024-05-30T17:02:50.066100+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:36.054917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061684+0000","last_change":"2024-05-30T17:02:49.052819+0000","last_active":"2024-05-30T17:02:51.061684+0000","last_peered":"2024-05-30T17:02:51.061684+0000","last_clean":"2024-05-30T17:02:51.061684+0000","last_became_active":"2024-05-30T17:02:49.052069+0000","last_became_peered":"2024-05-30T17:02:49.052069+0000","last_unstale":"2024-05-30T17:02:51.061684+0000","last_undegraded":"2024-05-30T17:02:51.061684+0000","last_fullsized":"2024-05-30T17:02:51.061684+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:10:59.620798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":349,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004511+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:02:52.004511+0000","last_peered":"2024-05-30T17:02:52.004511+0000","last_clean":"2024-05-30T17:02:52.004511+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:02:52.004511+0000","last_undegraded":"2024-05-30T17:02:52.004511+0000","last_fullsized":"2024-05-30T17:02:52.004511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509610,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123348,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248492,"statfs":{"total":96636764160,"available":96510455808,"internally_reserved":0,"allocated":2035712,"data_stored":1217364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509611,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122764,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249076,"statfs":{"total":96636764160,"available":96511053824,"internally_reserved":0,"allocated":1437696,"data_stored":626450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509611,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76940,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294900,"statfs":{"total":96636764160,"available":96557977600,"internally_reserved":0,"allocated":1441792,"data_stored":626984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509612,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86664,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94285176,"statfs":{"total":96636764160,"available":96548020224,"internally_reserved":0,"allocated":1433600,"data_stored":626380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509611,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144964,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226876,"statfs":{"total":96636764160,"available":96488321024,"internally_reserved":0,"allocated":1433600,"data_stored":626380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509611,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104712,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267128,"statfs":{"total":96636764160,"available":96529539072,"internally_reserved":0,"allocated":1429504,"data_stored":620092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509611,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65056,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306784,"statfs":{"total":96636764160,"available":96570146816,"internally_reserved":0,"allocated":2048000,"data_stored":1218472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542315,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126916,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244924,"statfs":{"total":96636764160,"available":96506802176,"internally_reserved":0,"allocated":1437696,"data_stored":621650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:02:54.184 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:02:54.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bd2c00640 1 Processor -- start 2024-05-30T17:02:54.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bd2c00640 1 -- start start 2024-05-30T17:02:54.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bd2c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bcc15e860 0x7f1bcc0cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:54.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bd2c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bcc15ec40 con 0x7f1bcc0c6f50 2024-05-30T17:02:54.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bd2c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bcc0c8200 con 0x7f1bcc0d0e80 2024-05-30T17:02:54.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bd2c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1bcc0c7960 con 0x7f1bcc15e860 2024-05-30T17:02:54.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bd0c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1bcc0c6f50 0x7f1bcc06b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41588/0 (socket says 172.21.15.59:41588) 2024-05-30T17:02:54.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bd0c00640 1 -- 172.21.15.59:0/3864085742 learned_addr learned my addr 172.21.15.59:0/3864085742 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bcbe00640 1 --2- 172.21.15.59:0/3864085742 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bcc15e860 0x7f1bcc0cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bcaa00640 1 -- 172.21.15.59:0/3864085742 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1746303729 0 0) 0x7f1bcc15ec40 con 0x7f1bcc0c6f50 2024-05-30T17:02:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bcaa00640 1 -- 172.21.15.59:0/3864085742 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bb0003530 con 0x7f1bcc0c6f50 2024-05-30T17:02:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bcaa00640 1 -- 172.21.15.59:0/3864085742 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2916854015 0 0) 0x7f1bcc0c8200 con 0x7f1bcc0d0e80 2024-05-30T17:02:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bcbe00640 1 -- 172.21.15.59:0/3864085742 >> v1:172.21.15.107:6789/0 conn(0x7f1bcc0d0e80 legacy=0x7f1bcc0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bcbe00640 1 -- 172.21.15.59:0/3864085742 >> v1:172.21.15.59:6789/0 conn(0x7f1bcc0c6f50 legacy=0x7f1bcc06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.366+0000 7f1bcbe00640 1 -- 172.21.15.59:0/3864085742 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc0c7c40 con 0x7f1bcc15e860 2024-05-30T17:02:54.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.370+0000 7f1bcbe00640 1 --2- 172.21.15.59:0/3864085742 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bcc15e860 0x7f1bcc0cef40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0097f0 tx=0x7f1bbc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee97fecb3f554e8d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:54.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.370+0000 7f1bcaa00640 1 -- 172.21.15.59:0/3864085742 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0b0070 con 0x7f1bcc15e860 2024-05-30T17:02:54.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.370+0000 7f1bcaa00640 1 -- 172.21.15.59:0/3864085742 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0ab600 con 0x7f1bcc15e860 2024-05-30T17:02:54.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.370+0000 7f1bcaa00640 1 -- 172.21.15.59:0/3864085742 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0ab9d0 con 0x7f1bcc15e860 2024-05-30T17:02:54.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.370+0000 7f1bd2c00640 1 -- 172.21.15.59:0/3864085742 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bcc15e860 msgr2=0x7f1bcc0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.370+0000 7f1bd2c00640 1 --2- 172.21.15.59:0/3864085742 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bcc15e860 0x7f1bcc0cef40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0097f0 tx=0x7f1bbc01c450 comp rx=0 tx=0).stop 2024-05-30T17:02:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.370+0000 7f1bd2c00640 1 -- 172.21.15.59:0/3864085742 shutdown_connections 2024-05-30T17:02:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.370+0000 7f1bd2c00640 1 --2- 172.21.15.59:0/3864085742 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bcc15e860 0x7f1bcc0cef40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.370+0000 7f1bd2c00640 1 -- 172.21.15.59:0/3864085742 >> 172.21.15.59:0/3864085742 conn(0x7f1bcc0b2fc0 msgr2=0x7f1bcc0b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.370+0000 7f1bd2c00640 1 -- 172.21.15.59:0/3864085742 shutdown_connections 2024-05-30T17:02:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.370+0000 7f1bd2c00640 1 -- 172.21.15.59:0/3864085742 wait complete. 2024-05-30T17:02:54.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd2c00640 1 Processor -- start 2024-05-30T17:02:54.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd2c00640 1 -- start start 2024-05-30T17:02:54.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd2c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bcc0c6f50 0x7f1bcc14c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:54.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd2c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bcc0d0e80 0x7f1bcc14cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:54.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd2c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bcc15e860 0x7f1bcc143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:54.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd2c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc16c3b0 con 0x7f1bcc15e860 2024-05-30T17:02:54.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd2c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc0b3dd0 con 0x7f1bcc0c6f50 2024-05-30T17:02:54.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd2c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1bcc16c530 con 0x7f1bcc0d0e80 2024-05-30T17:02:54.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bcc15e860 0x7f1bcc143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bcc15e860 0x7f1bcc143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34172/0 (socket says 172.21.15.59:34172) 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd0c00640 1 -- 172.21.15.59:0/2160111231 learned_addr learned my addr 172.21.15.59:0/2160111231 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bcbe00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bcc0c6f50 0x7f1bcc14c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bcb400640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bcc0d0e80 0x7f1bcc14cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd0c00640 1 -- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bcc0d0e80 msgr2=0x7f1bcc14cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd0c00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bcc0d0e80 0x7f1bcc14cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd0c00640 1 -- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bcc0c6f50 msgr2=0x7f1bcc14c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd0c00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bcc0c6f50 0x7f1bcc14c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd0c00640 1 -- 172.21.15.59:0/2160111231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc14da20 con 0x7f1bcc15e860 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd0c00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bcc15e860 0x7f1bcc143620 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400cad0 tx=0x7f1bc400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bc3e00640 1 -- 172.21.15.59:0/2160111231 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4017070 con 0x7f1bcc15e860 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bc3e00640 1 -- 172.21.15.59:0/2160111231 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc400ac30 con 0x7f1bcc15e860 2024-05-30T17:02:54.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd2c00640 1 -- 172.21.15.59:0/2160111231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bcc14d460 con 0x7f1bcc15e860 2024-05-30T17:02:54.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bc3e00640 1 -- 172.21.15.59:0/2160111231 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4012400 con 0x7f1bcc15e860 2024-05-30T17:02:54.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd2c00640 1 -- 172.21.15.59:0/2160111231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bcc14b900 con 0x7f1bcc15e860 2024-05-30T17:02:54.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.374+0000 7f1bd2c00640 1 -- 172.21.15.59:0/2160111231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bcc068a90 con 0x7f1bcc15e860 2024-05-30T17:02:54.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.378+0000 7f1bc3e00640 1 -- 172.21.15.59:0/2160111231 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f1bc401a070 con 0x7f1bcc15e860 2024-05-30T17:02:54.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.378+0000 7f1bc3e00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1bac069b20 0x7f1bac06bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:54.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.378+0000 7f1bc3e00640 1 -- 172.21.15.59:0/2160111231 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f1bc40854e0 con 0x7f1bcc15e860 2024-05-30T17:02:54.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.378+0000 7f1bcbe00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1bac069b20 0x7f1bac06bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:54.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.378+0000 7f1bcbe00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1bac069b20 0x7f1bac06bfe0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0ad000 tx=0x7f1bbc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:54.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.382+0000 7f1bc3e00640 1 -- 172.21.15.59:0/2160111231 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1bc4056eb0 con 0x7f1bcc15e860 2024-05-30T17:02:54.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.542+0000 7f1bd2c00640 1 -- 172.21.15.59:0/2160111231 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1bcc15dcb0 con 0x7f1bac069b20 2024-05-30T17:02:54.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bc3e00640 1 -- 172.21.15.59:0/2160111231 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252489 (secure 0 0 0) 0x7f1bcc15dcb0 con 0x7f1bac069b20 2024-05-30T17:02:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:02:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bd2c00640 1 -- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1bac069b20 msgr2=0x7f1bac06bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bd2c00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1bac069b20 0x7f1bac06bfe0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0ad000 tx=0x7f1bbc0a6000 comp rx=0 tx=0).stop 2024-05-30T17:02:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bd2c00640 1 -- 172.21.15.59:0/2160111231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bcc15e860 msgr2=0x7f1bcc143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bd2c00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bcc15e860 0x7f1bcc143620 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400cad0 tx=0x7f1bc400cf90 comp rx=0 tx=0).stop 2024-05-30T17:02:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bd2c00640 1 -- 172.21.15.59:0/2160111231 shutdown_connections 2024-05-30T17:02:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bd2c00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1bac069b20 0x7f1bac06bfe0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bd2c00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bcc15e860 0x7f1bcc143620 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bd2c00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bcc0d0e80 0x7f1bcc14cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bd2c00640 1 --2- 172.21.15.59:0/2160111231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bcc0c6f50 0x7f1bcc14c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bd2c00640 1 -- 172.21.15.59:0/2160111231 >> 172.21.15.59:0/2160111231 conn(0x7f1bcc0b2fc0 msgr2=0x7f1bcc070670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:54.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bd2c00640 1 -- 172.21.15.59:0/2160111231 shutdown_connections 2024-05-30T17:02:54.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.554+0000 7f1bd2c00640 1 -- 172.21.15.59:0/2160111231 wait complete. 2024-05-30T17:02:54.577 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":530,"stamp":"2024-05-30T17:02:53.354093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":851364,"kb_used_data":12400,"kb_used_omap":12,"kb_used_meta":838835,"kb_avail":754123356,"statfs":{"total":773094113280,"available":772222316544,"internally_reserved":0,"allocated":12697600,"data_stored":6183772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":858967600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.327190"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003993+0000","last_change":"2024-05-30T17:02:50.065397+0000","last_active":"2024-05-30T17:02:52.003993+0000","last_peered":"2024-05-30T17:02:52.003993+0000","last_clean":"2024-05-30T17:02:52.003993+0000","last_became_active":"2024-05-30T17:02:50.065072+0000","last_became_peered":"2024-05-30T17:02:50.065072+0000","last_unstale":"2024-05-30T17:02:52.003993+0000","last_undegraded":"2024-05-30T17:02:52.003993+0000","last_fullsized":"2024-05-30T17:02:52.003993+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:27:25.348067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061972+0000","last_change":"2024-05-30T17:02:50.054425+0000","last_active":"2024-05-30T17:02:51.061972+0000","last_peered":"2024-05-30T17:02:51.061972+0000","last_clean":"2024-05-30T17:02:51.061972+0000","last_became_active":"2024-05-30T17:02:50.054140+0000","last_became_peered":"2024-05-30T17:02:50.054140+0000","last_unstale":"2024-05-30T17:02:51.061972+0000","last_undegraded":"2024-05-30T17:02:51.061972+0000","last_fullsized":"2024-05-30T17:02:51.061972+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:36:15.163023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004550+0000","last_change":"2024-05-30T17:02:50.061104+0000","last_active":"2024-05-30T17:02:52.004550+0000","last_peered":"2024-05-30T17:02:52.004550+0000","last_clean":"2024-05-30T17:02:52.004550+0000","last_became_active":"2024-05-30T17:02:50.059069+0000","last_became_peered":"2024-05-30T17:02:50.059069+0000","last_unstale":"2024-05-30T17:02:52.004550+0000","last_undegraded":"2024-05-30T17:02:52.004550+0000","last_fullsized":"2024-05-30T17:02:52.004550+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:27:58.744625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003085+0000","last_change":"2024-05-30T17:02:50.066012+0000","last_active":"2024-05-30T17:02:52.003085+0000","last_peered":"2024-05-30T17:02:52.003085+0000","last_clean":"2024-05-30T17:02:52.003085+0000","last_became_active":"2024-05-30T17:02:50.065719+0000","last_became_peered":"2024-05-30T17:02:50.065719+0000","last_unstale":"2024-05-30T17:02:52.003085+0000","last_undegraded":"2024-05-30T17:02:52.003085+0000","last_fullsized":"2024-05-30T17:02:52.003085+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:08:26.189129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058868+0000","last_change":"2024-05-30T17:02:50.071281+0000","last_active":"2024-05-30T17:02:51.058868+0000","last_peered":"2024-05-30T17:02:51.058868+0000","last_clean":"2024-05-30T17:02:51.058868+0000","last_became_active":"2024-05-30T17:02:50.069901+0000","last_became_peered":"2024-05-30T17:02:50.069901+0000","last_unstale":"2024-05-30T17:02:51.058868+0000","last_undegraded":"2024-05-30T17:02:51.058868+0000","last_fullsized":"2024-05-30T17:02:51.058868+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:45.480962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003058+0000","last_change":"2024-05-30T17:02:50.071097+0000","last_active":"2024-05-30T17:02:52.003058+0000","last_peered":"2024-05-30T17:02:52.003058+0000","last_clean":"2024-05-30T17:02:52.003058+0000","last_became_active":"2024-05-30T17:02:50.070628+0000","last_became_peered":"2024-05-30T17:02:50.070628+0000","last_unstale":"2024-05-30T17:02:52.003058+0000","last_undegraded":"2024-05-30T17:02:52.003058+0000","last_fullsized":"2024-05-30T17:02:52.003058+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:30:48.948317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061573+0000","last_change":"2024-05-30T17:02:50.061030+0000","last_active":"2024-05-30T17:02:51.061573+0000","last_peered":"2024-05-30T17:02:51.061573+0000","last_clean":"2024-05-30T17:02:51.061573+0000","last_became_active":"2024-05-30T17:02:50.060413+0000","last_became_peered":"2024-05-30T17:02:50.060413+0000","last_unstale":"2024-05-30T17:02:51.061573+0000","last_undegraded":"2024-05-30T17:02:51.061573+0000","last_fullsized":"2024-05-30T17:02:51.061573+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:21.138555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004229+0000","last_change":"2024-05-30T17:02:50.058520+0000","last_active":"2024-05-30T17:02:52.004229+0000","last_peered":"2024-05-30T17:02:52.004229+0000","last_clean":"2024-05-30T17:02:52.004229+0000","last_became_active":"2024-05-30T17:02:50.058231+0000","last_became_peered":"2024-05-30T17:02:50.058231+0000","last_unstale":"2024-05-30T17:02:52.004229+0000","last_undegraded":"2024-05-30T17:02:52.004229+0000","last_fullsized":"2024-05-30T17:02:52.004229+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:46:52.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003944+0000","last_change":"2024-05-30T17:02:50.068837+0000","last_active":"2024-05-30T17:02:52.003944+0000","last_peered":"2024-05-30T17:02:52.003944+0000","last_clean":"2024-05-30T17:02:52.003944+0000","last_became_active":"2024-05-30T17:02:50.066965+0000","last_became_peered":"2024-05-30T17:02:50.066965+0000","last_unstale":"2024-05-30T17:02:52.003944+0000","last_undegraded":"2024-05-30T17:02:52.003944+0000","last_fullsized":"2024-05-30T17:02:52.003944+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:32:38.254244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003462+0000","last_change":"2024-05-30T17:02:50.062097+0000","last_active":"2024-05-30T17:02:52.003462+0000","last_peered":"2024-05-30T17:02:52.003462+0000","last_clean":"2024-05-30T17:02:52.003462+0000","last_became_active":"2024-05-30T17:02:50.061761+0000","last_became_peered":"2024-05-30T17:02:50.061761+0000","last_unstale":"2024-05-30T17:02:52.003462+0000","last_undegraded":"2024-05-30T17:02:52.003462+0000","last_fullsized":"2024-05-30T17:02:52.003462+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:13:11.219532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061989+0000","last_change":"2024-05-30T17:02:50.061053+0000","last_active":"2024-05-30T17:02:51.061989+0000","last_peered":"2024-05-30T17:02:51.061989+0000","last_clean":"2024-05-30T17:02:51.061989+0000","last_became_active":"2024-05-30T17:02:50.060736+0000","last_became_peered":"2024-05-30T17:02:50.060736+0000","last_unstale":"2024-05-30T17:02:51.061989+0000","last_undegraded":"2024-05-30T17:02:51.061989+0000","last_fullsized":"2024-05-30T17:02:51.061989+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:29:42.893385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003259+0000","last_change":"2024-05-30T17:02:50.071281+0000","last_active":"2024-05-30T17:02:52.003259+0000","last_peered":"2024-05-30T17:02:52.003259+0000","last_clean":"2024-05-30T17:02:52.003259+0000","last_became_active":"2024-05-30T17:02:50.070989+0000","last_became_peered":"2024-05-30T17:02:50.070989+0000","last_unstale":"2024-05-30T17:02:52.003259+0000","last_undegraded":"2024-05-30T17:02:52.003259+0000","last_fullsized":"2024-05-30T17:02:52.003259+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:20.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004725+0000","last_change":"2024-05-30T17:02:50.073425+0000","last_active":"2024-05-30T17:02:52.004725+0000","last_peered":"2024-05-30T17:02:52.004725+0000","last_clean":"2024-05-30T17:02:52.004725+0000","last_became_active":"2024-05-30T17:02:50.073195+0000","last_became_peered":"2024-05-30T17:02:50.073195+0000","last_unstale":"2024-05-30T17:02:52.004725+0000","last_undegraded":"2024-05-30T17:02:52.004725+0000","last_fullsized":"2024-05-30T17:02:52.004725+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:07:26.159149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004259+0000","last_change":"2024-05-30T17:02:50.067520+0000","last_active":"2024-05-30T17:02:52.004259+0000","last_peered":"2024-05-30T17:02:52.004259+0000","last_clean":"2024-05-30T17:02:52.004259+0000","last_became_active":"2024-05-30T17:02:50.067248+0000","last_became_peered":"2024-05-30T17:02:50.067248+0000","last_unstale":"2024-05-30T17:02:52.004259+0000","last_undegraded":"2024-05-30T17:02:52.004259+0000","last_fullsized":"2024-05-30T17:02:52.004259+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:35:30.994271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002618+0000","last_change":"2024-05-30T17:02:50.063564+0000","last_active":"2024-05-30T17:02:52.002618+0000","last_peered":"2024-05-30T17:02:52.002618+0000","last_clean":"2024-05-30T17:02:52.002618+0000","last_became_active":"2024-05-30T17:02:50.063253+0000","last_became_peered":"2024-05-30T17:02:50.063253+0000","last_unstale":"2024-05-30T17:02:52.002618+0000","last_undegraded":"2024-05-30T17:02:52.002618+0000","last_fullsized":"2024-05-30T17:02:52.002618+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:30:22.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003598+0000","last_change":"2024-05-30T17:02:50.064792+0000","last_active":"2024-05-30T17:02:52.003598+0000","last_peered":"2024-05-30T17:02:52.003598+0000","last_clean":"2024-05-30T17:02:52.003598+0000","last_became_active":"2024-05-30T17:02:50.064328+0000","last_became_peered":"2024-05-30T17:02:50.064328+0000","last_unstale":"2024-05-30T17:02:52.003598+0000","last_undegraded":"2024-05-30T17:02:52.003598+0000","last_fullsized":"2024-05-30T17:02:52.003598+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:18.544003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062244+0000","last_change":"2024-05-30T17:02:50.067822+0000","last_active":"2024-05-30T17:02:51.062244+0000","last_peered":"2024-05-30T17:02:51.062244+0000","last_clean":"2024-05-30T17:02:51.062244+0000","last_became_active":"2024-05-30T17:02:50.067307+0000","last_became_peered":"2024-05-30T17:02:50.067307+0000","last_unstale":"2024-05-30T17:02:51.062244+0000","last_undegraded":"2024-05-30T17:02:51.062244+0000","last_fullsized":"2024-05-30T17:02:51.062244+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:32:47.280031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.076019+0000","last_change":"2024-05-30T17:02:50.064566+0000","last_active":"2024-05-30T17:02:51.076019+0000","last_peered":"2024-05-30T17:02:51.076019+0000","last_clean":"2024-05-30T17:02:51.076019+0000","last_became_active":"2024-05-30T17:02:50.064280+0000","last_became_peered":"2024-05-30T17:02:50.064280+0000","last_unstale":"2024-05-30T17:02:51.076019+0000","last_undegraded":"2024-05-30T17:02:51.076019+0000","last_fullsized":"2024-05-30T17:02:51.076019+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:32:47.280031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004532+0000","last_change":"2024-05-30T17:02:50.073074+0000","last_active":"2024-05-30T17:02:52.004532+0000","last_peered":"2024-05-30T17:02:52.004532+0000","last_clean":"2024-05-30T17:02:52.004532+0000","last_became_active":"2024-05-30T17:02:50.072675+0000","last_became_peered":"2024-05-30T17:02:50.072675+0000","last_unstale":"2024-05-30T17:02:52.004532+0000","last_undegraded":"2024-05-30T17:02:52.004532+0000","last_fullsized":"2024-05-30T17:02:52.004532+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:15:53.082675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062504+0000","last_change":"2024-05-30T17:02:50.062093+0000","last_active":"2024-05-30T17:02:51.062504+0000","last_peered":"2024-05-30T17:02:51.062504+0000","last_clean":"2024-05-30T17:02:51.062504+0000","last_became_active":"2024-05-30T17:02:50.061753+0000","last_became_peered":"2024-05-30T17:02:50.061753+0000","last_unstale":"2024-05-30T17:02:51.062504+0000","last_undegraded":"2024-05-30T17:02:51.062504+0000","last_fullsized":"2024-05-30T17:02:51.062504+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:02:55.825631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062020+0000","last_change":"2024-05-30T17:02:50.071743+0000","last_active":"2024-05-30T17:02:51.062020+0000","last_peered":"2024-05-30T17:02:51.062020+0000","last_clean":"2024-05-30T17:02:51.062020+0000","last_became_active":"2024-05-30T17:02:50.071463+0000","last_became_peered":"2024-05-30T17:02:50.071463+0000","last_unstale":"2024-05-30T17:02:51.062020+0000","last_undegraded":"2024-05-30T17:02:51.062020+0000","last_fullsized":"2024-05-30T17:02:51.062020+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:07:34.051950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.074536+0000","last_change":"2024-05-30T17:02:50.072110+0000","last_active":"2024-05-30T17:02:50.074536+0000","last_peered":"2024-05-30T17:02:50.074536+0000","last_clean":"2024-05-30T17:02:50.074536+0000","last_became_active":"2024-05-30T17:02:50.071643+0000","last_became_peered":"2024-05-30T17:02:50.071643+0000","last_unstale":"2024-05-30T17:02:50.074536+0000","last_undegraded":"2024-05-30T17:02:50.074536+0000","last_fullsized":"2024-05-30T17:02:50.074536+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:58:59.481653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061231+0000","last_change":"2024-05-30T17:02:50.062222+0000","last_active":"2024-05-30T17:02:51.061231+0000","last_peered":"2024-05-30T17:02:51.061231+0000","last_clean":"2024-05-30T17:02:51.061231+0000","last_became_active":"2024-05-30T17:02:50.061871+0000","last_became_peered":"2024-05-30T17:02:50.061871+0000","last_unstale":"2024-05-30T17:02:51.061231+0000","last_undegraded":"2024-05-30T17:02:51.061231+0000","last_fullsized":"2024-05-30T17:02:51.061231+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:59:12.895466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.067088+0000","last_change":"2024-05-30T17:02:50.065810+0000","last_active":"2024-05-30T17:02:50.067088+0000","last_peered":"2024-05-30T17:02:50.067088+0000","last_clean":"2024-05-30T17:02:50.067088+0000","last_became_active":"2024-05-30T17:02:50.062696+0000","last_became_peered":"2024-05-30T17:02:50.062696+0000","last_unstale":"2024-05-30T17:02:50.067088+0000","last_undegraded":"2024-05-30T17:02:50.067088+0000","last_fullsized":"2024-05-30T17:02:50.067088+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:37.194545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062282+0000","last_change":"2024-05-30T17:02:50.067648+0000","last_active":"2024-05-30T17:02:51.062282+0000","last_peered":"2024-05-30T17:02:51.062282+0000","last_clean":"2024-05-30T17:02:51.062282+0000","last_became_active":"2024-05-30T17:02:50.066934+0000","last_became_peered":"2024-05-30T17:02:50.066934+0000","last_unstale":"2024-05-30T17:02:51.062282+0000","last_undegraded":"2024-05-30T17:02:51.062282+0000","last_fullsized":"2024-05-30T17:02:51.062282+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:22:16.056299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003736+0000","last_change":"2024-05-30T17:02:50.059087+0000","last_active":"2024-05-30T17:02:52.003736+0000","last_peered":"2024-05-30T17:02:52.003736+0000","last_clean":"2024-05-30T17:02:52.003736+0000","last_became_active":"2024-05-30T17:02:50.058821+0000","last_became_peered":"2024-05-30T17:02:50.058821+0000","last_unstale":"2024-05-30T17:02:52.003736+0000","last_undegraded":"2024-05-30T17:02:52.003736+0000","last_fullsized":"2024-05-30T17:02:52.003736+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:41:21.491376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003171+0000","last_change":"2024-05-30T17:02:50.055168+0000","last_active":"2024-05-30T17:02:52.003171+0000","last_peered":"2024-05-30T17:02:52.003171+0000","last_clean":"2024-05-30T17:02:52.003171+0000","last_became_active":"2024-05-30T17:02:50.054927+0000","last_became_peered":"2024-05-30T17:02:50.054927+0000","last_unstale":"2024-05-30T17:02:52.003171+0000","last_undegraded":"2024-05-30T17:02:52.003171+0000","last_fullsized":"2024-05-30T17:02:52.003171+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:30.516388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.077055+0000","last_change":"2024-05-30T17:02:50.068173+0000","last_active":"2024-05-30T17:02:50.077055+0000","last_peered":"2024-05-30T17:02:50.077055+0000","last_clean":"2024-05-30T17:02:50.077055+0000","last_became_active":"2024-05-30T17:02:50.067894+0000","last_became_peered":"2024-05-30T17:02:50.067894+0000","last_unstale":"2024-05-30T17:02:50.077055+0000","last_undegraded":"2024-05-30T17:02:50.077055+0000","last_fullsized":"2024-05-30T17:02:50.077055+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:11.551858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061681+0000","last_change":"2024-05-30T17:02:50.052154+0000","last_active":"2024-05-30T17:02:51.061681+0000","last_peered":"2024-05-30T17:02:51.061681+0000","last_clean":"2024-05-30T17:02:51.061681+0000","last_became_active":"2024-05-30T17:02:50.051848+0000","last_became_peered":"2024-05-30T17:02:50.051848+0000","last_unstale":"2024-05-30T17:02:51.061681+0000","last_undegraded":"2024-05-30T17:02:51.061681+0000","last_fullsized":"2024-05-30T17:02:51.061681+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:47:09.271306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062058+0000","last_change":"2024-05-30T17:02:50.066562+0000","last_active":"2024-05-30T17:02:51.062058+0000","last_peered":"2024-05-30T17:02:51.062058+0000","last_clean":"2024-05-30T17:02:51.062058+0000","last_became_active":"2024-05-30T17:02:50.066264+0000","last_became_peered":"2024-05-30T17:02:50.066264+0000","last_unstale":"2024-05-30T17:02:51.062058+0000","last_undegraded":"2024-05-30T17:02:51.062058+0000","last_fullsized":"2024-05-30T17:02:51.062058+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:11:18.259756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002452+0000","last_change":"2024-05-30T17:02:50.060061+0000","last_active":"2024-05-30T17:02:52.002452+0000","last_peered":"2024-05-30T17:02:52.002452+0000","last_clean":"2024-05-30T17:02:52.002452+0000","last_became_active":"2024-05-30T17:02:50.059734+0000","last_became_peered":"2024-05-30T17:02:50.059734+0000","last_unstale":"2024-05-30T17:02:52.002452+0000","last_undegraded":"2024-05-30T17:02:52.002452+0000","last_fullsized":"2024-05-30T17:02:52.002452+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:38:37.626136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002667+0000","last_change":"2024-05-30T17:02:50.063573+0000","last_active":"2024-05-30T17:02:52.002667+0000","last_peered":"2024-05-30T17:02:52.002667+0000","last_clean":"2024-05-30T17:02:52.002667+0000","last_became_active":"2024-05-30T17:02:50.063295+0000","last_became_peered":"2024-05-30T17:02:50.063295+0000","last_unstale":"2024-05-30T17:02:52.002667+0000","last_undegraded":"2024-05-30T17:02:52.002667+0000","last_fullsized":"2024-05-30T17:02:52.002667+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:33:20.871796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003290+0000","last_change":"2024-05-30T17:02:50.061602+0000","last_active":"2024-05-30T17:02:52.003290+0000","last_peered":"2024-05-30T17:02:52.003290+0000","last_clean":"2024-05-30T17:02:52.003290+0000","last_became_active":"2024-05-30T17:02:50.061298+0000","last_became_peered":"2024-05-30T17:02:50.061298+0000","last_unstale":"2024-05-30T17:02:52.003290+0000","last_undegraded":"2024-05-30T17:02:52.003290+0000","last_fullsized":"2024-05-30T17:02:52.003290+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:29:43.400748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"115'4","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062697+0000","last_change":"2024-05-30T17:02:49.050328+0000","last_active":"2024-05-30T17:02:51.062697+0000","last_peered":"2024-05-30T17:02:51.062697+0000","last_clean":"2024-05-30T17:02:51.062697+0000","last_became_active":"2024-05-30T17:02:49.049558+0000","last_became_peered":"2024-05-30T17:02:49.049558+0000","last_unstale":"2024-05-30T17:02:51.062697+0000","last_undegraded":"2024-05-30T17:02:51.062697+0000","last_fullsized":"2024-05-30T17:02:51.062697+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:32:36.454517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.076212+0000","last_change":"2024-05-30T17:02:50.067383+0000","last_active":"2024-05-30T17:02:51.076212+0000","last_peered":"2024-05-30T17:02:51.076212+0000","last_clean":"2024-05-30T17:02:51.076212+0000","last_became_active":"2024-05-30T17:02:50.067037+0000","last_became_peered":"2024-05-30T17:02:50.067037+0000","last_unstale":"2024-05-30T17:02:51.076212+0000","last_undegraded":"2024-05-30T17:02:51.076212+0000","last_fullsized":"2024-05-30T17:02:51.076212+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:02:55.825631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004382+0000","last_change":"2024-05-30T17:02:49.052729+0000","last_active":"2024-05-30T17:02:52.004382+0000","last_peered":"2024-05-30T17:02:52.004382+0000","last_clean":"2024-05-30T17:02:52.004382+0000","last_became_active":"2024-05-30T17:02:49.051810+0000","last_became_peered":"2024-05-30T17:02:49.051810+0000","last_unstale":"2024-05-30T17:02:52.004382+0000","last_undegraded":"2024-05-30T17:02:52.004382+0000","last_fullsized":"2024-05-30T17:02:52.004382+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:29:41.884285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003678+0000","last_change":"2024-05-30T17:02:50.074502+0000","last_active":"2024-05-30T17:02:52.003678+0000","last_peered":"2024-05-30T17:02:52.003678+0000","last_clean":"2024-05-30T17:02:52.003678+0000","last_became_active":"2024-05-30T17:02:50.074153+0000","last_became_peered":"2024-05-30T17:02:50.074153+0000","last_unstale":"2024-05-30T17:02:52.003678+0000","last_undegraded":"2024-05-30T17:02:52.003678+0000","last_fullsized":"2024-05-30T17:02:52.003678+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:54:52.431416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058809+0000","last_change":"2024-05-30T17:02:49.047460+0000","last_active":"2024-05-30T17:02:51.058809+0000","last_peered":"2024-05-30T17:02:51.058809+0000","last_clean":"2024-05-30T17:02:51.058809+0000","last_became_active":"2024-05-30T17:02:49.047088+0000","last_became_peered":"2024-05-30T17:02:49.047088+0000","last_unstale":"2024-05-30T17:02:51.058809+0000","last_undegraded":"2024-05-30T17:02:51.058809+0000","last_fullsized":"2024-05-30T17:02:51.058809+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:38:42.010125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004680+0000","last_change":"2024-05-30T17:02:50.073704+0000","last_active":"2024-05-30T17:02:52.004680+0000","last_peered":"2024-05-30T17:02:52.004680+0000","last_clean":"2024-05-30T17:02:52.004680+0000","last_became_active":"2024-05-30T17:02:50.073329+0000","last_became_peered":"2024-05-30T17:02:50.073329+0000","last_unstale":"2024-05-30T17:02:52.004680+0000","last_undegraded":"2024-05-30T17:02:52.004680+0000","last_fullsized":"2024-05-30T17:02:52.004680+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:23:09.550240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058617+0000","last_change":"2024-05-30T17:02:49.047318+0000","last_active":"2024-05-30T17:02:51.058617+0000","last_peered":"2024-05-30T17:02:51.058617+0000","last_clean":"2024-05-30T17:02:51.058617+0000","last_became_active":"2024-05-30T17:02:49.046979+0000","last_became_peered":"2024-05-30T17:02:49.046979+0000","last_unstale":"2024-05-30T17:02:51.058617+0000","last_undegraded":"2024-05-30T17:02:51.058617+0000","last_fullsized":"2024-05-30T17:02:51.058617+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:30:21.421128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002603+0000","last_change":"2024-05-30T17:02:50.067660+0000","last_active":"2024-05-30T17:02:52.002603+0000","last_peered":"2024-05-30T17:02:52.002603+0000","last_clean":"2024-05-30T17:02:52.002603+0000","last_became_active":"2024-05-30T17:02:50.067354+0000","last_became_peered":"2024-05-30T17:02:50.067354+0000","last_unstale":"2024-05-30T17:02:52.002603+0000","last_undegraded":"2024-05-30T17:02:52.002603+0000","last_fullsized":"2024-05-30T17:02:52.002603+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:44.259833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061830+0000","last_change":"2024-05-30T17:02:49.050155+0000","last_active":"2024-05-30T17:02:51.061830+0000","last_peered":"2024-05-30T17:02:51.061830+0000","last_clean":"2024-05-30T17:02:51.061830+0000","last_became_active":"2024-05-30T17:02:49.049851+0000","last_became_peered":"2024-05-30T17:02:49.049851+0000","last_unstale":"2024-05-30T17:02:51.061830+0000","last_undegraded":"2024-05-30T17:02:51.061830+0000","last_fullsized":"2024-05-30T17:02:51.061830+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:54:51.422315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061865+0000","last_change":"2024-05-30T17:02:50.053420+0000","last_active":"2024-05-30T17:02:51.061865+0000","last_peered":"2024-05-30T17:02:51.061865+0000","last_clean":"2024-05-30T17:02:51.061865+0000","last_became_active":"2024-05-30T17:02:50.053151+0000","last_became_peered":"2024-05-30T17:02:50.053151+0000","last_unstale":"2024-05-30T17:02:51.061865+0000","last_undegraded":"2024-05-30T17:02:51.061865+0000","last_fullsized":"2024-05-30T17:02:51.061865+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:25.177668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"115'1","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.080548+0000","last_change":"2024-05-30T17:02:49.043396+0000","last_active":"2024-05-30T17:02:50.080548+0000","last_peered":"2024-05-30T17:02:50.080548+0000","last_clean":"2024-05-30T17:02:50.080548+0000","last_became_active":"2024-05-30T17:02:49.043082+0000","last_became_peered":"2024-05-30T17:02:49.043082+0000","last_unstale":"2024-05-30T17:02:50.080548+0000","last_undegraded":"2024-05-30T17:02:50.080548+0000","last_fullsized":"2024-05-30T17:02:50.080548+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:40.020701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002797+0000","last_change":"2024-05-30T17:02:50.056831+0000","last_active":"2024-05-30T17:02:52.002797+0000","last_peered":"2024-05-30T17:02:52.002797+0000","last_clean":"2024-05-30T17:02:52.002797+0000","last_became_active":"2024-05-30T17:02:50.056554+0000","last_became_peered":"2024-05-30T17:02:50.056554+0000","last_unstale":"2024-05-30T17:02:52.002797+0000","last_undegraded":"2024-05-30T17:02:52.002797+0000","last_fullsized":"2024-05-30T17:02:52.002797+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:23:54.144083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061405+0000","last_change":"2024-05-30T17:02:49.047411+0000","last_active":"2024-05-30T17:02:51.061405+0000","last_peered":"2024-05-30T17:02:51.061405+0000","last_clean":"2024-05-30T17:02:51.061405+0000","last_became_active":"2024-05-30T17:02:49.047155+0000","last_became_peered":"2024-05-30T17:02:49.047155+0000","last_unstale":"2024-05-30T17:02:51.061405+0000","last_undegraded":"2024-05-30T17:02:51.061405+0000","last_fullsized":"2024-05-30T17:02:51.061405+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:32:36.375345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062393+0000","last_change":"2024-05-30T17:02:50.061253+0000","last_active":"2024-05-30T17:02:51.062393+0000","last_peered":"2024-05-30T17:02:51.062393+0000","last_clean":"2024-05-30T17:02:51.062393+0000","last_became_active":"2024-05-30T17:02:50.060770+0000","last_became_peered":"2024-05-30T17:02:50.060770+0000","last_unstale":"2024-05-30T17:02:51.062393+0000","last_undegraded":"2024-05-30T17:02:51.062393+0000","last_fullsized":"2024-05-30T17:02:51.062393+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:31.025916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003012+0000","last_change":"2024-05-30T17:02:49.053596+0000","last_active":"2024-05-30T17:02:52.003012+0000","last_peered":"2024-05-30T17:02:52.003012+0000","last_clean":"2024-05-30T17:02:52.003012+0000","last_became_active":"2024-05-30T17:02:49.053312+0000","last_became_peered":"2024-05-30T17:02:49.053312+0000","last_unstale":"2024-05-30T17:02:52.003012+0000","last_undegraded":"2024-05-30T17:02:52.003012+0000","last_fullsized":"2024-05-30T17:02:52.003012+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:22:15.047199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062749+0000","last_change":"2024-05-30T17:02:50.053052+0000","last_active":"2024-05-30T17:02:51.062749+0000","last_peered":"2024-05-30T17:02:51.062749+0000","last_clean":"2024-05-30T17:02:51.062749+0000","last_became_active":"2024-05-30T17:02:50.052771+0000","last_became_peered":"2024-05-30T17:02:50.052771+0000","last_unstale":"2024-05-30T17:02:51.062749+0000","last_undegraded":"2024-05-30T17:02:51.062749+0000","last_fullsized":"2024-05-30T17:02:51.062749+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:53.819409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058680+0000","last_change":"2024-05-30T17:02:49.048397+0000","last_active":"2024-05-30T17:02:51.058680+0000","last_peered":"2024-05-30T17:02:51.058680+0000","last_clean":"2024-05-30T17:02:51.058680+0000","last_became_active":"2024-05-30T17:02:49.047617+0000","last_became_peered":"2024-05-30T17:02:49.047617+0000","last_unstale":"2024-05-30T17:02:51.058680+0000","last_undegraded":"2024-05-30T17:02:51.058680+0000","last_fullsized":"2024-05-30T17:02:51.058680+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:33:19.862696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.076181+0000","last_change":"2024-05-30T17:02:50.070198+0000","last_active":"2024-05-30T17:02:51.076181+0000","last_peered":"2024-05-30T17:02:51.076181+0000","last_clean":"2024-05-30T17:02:51.076181+0000","last_became_active":"2024-05-30T17:02:50.069713+0000","last_became_peered":"2024-05-30T17:02:50.069713+0000","last_unstale":"2024-05-30T17:02:51.076181+0000","last_undegraded":"2024-05-30T17:02:51.076181+0000","last_fullsized":"2024-05-30T17:02:51.076181+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:22:16.056299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.052843+0000","last_change":"2024-05-30T17:02:49.042341+0000","last_active":"2024-05-30T17:02:50.052843+0000","last_peered":"2024-05-30T17:02:50.052843+0000","last_clean":"2024-05-30T17:02:50.052843+0000","last_became_active":"2024-05-30T17:02:49.042025+0000","last_became_peered":"2024-05-30T17:02:49.042025+0000","last_unstale":"2024-05-30T17:02:50.052843+0000","last_undegraded":"2024-05-30T17:02:50.052843+0000","last_fullsized":"2024-05-30T17:02:50.052843+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:37.210722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.077079+0000","last_change":"2024-05-30T17:02:50.069202+0000","last_active":"2024-05-30T17:02:50.077079+0000","last_peered":"2024-05-30T17:02:50.077079+0000","last_clean":"2024-05-30T17:02:50.077079+0000","last_became_active":"2024-05-30T17:02:50.068263+0000","last_became_peered":"2024-05-30T17:02:50.068263+0000","last_unstale":"2024-05-30T17:02:50.077079+0000","last_undegraded":"2024-05-30T17:02:50.077079+0000","last_fullsized":"2024-05-30T17:02:50.077079+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:56:54.358891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"115'3","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003434+0000","last_change":"2024-05-30T17:02:49.054039+0000","last_active":"2024-05-30T17:02:52.003434+0000","last_peered":"2024-05-30T17:02:52.003434+0000","last_clean":"2024-05-30T17:02:52.003434+0000","last_became_active":"2024-05-30T17:02:49.053777+0000","last_became_peered":"2024-05-30T17:02:49.053777+0000","last_unstale":"2024-05-30T17:02:52.003434+0000","last_undegraded":"2024-05-30T17:02:52.003434+0000","last_fullsized":"2024-05-30T17:02:52.003434+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:38:11.122473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062418+0000","last_change":"2024-05-30T17:02:50.059659+0000","last_active":"2024-05-30T17:02:51.062418+0000","last_peered":"2024-05-30T17:02:51.062418+0000","last_clean":"2024-05-30T17:02:51.062418+0000","last_became_active":"2024-05-30T17:02:50.059383+0000","last_became_peered":"2024-05-30T17:02:50.059383+0000","last_unstale":"2024-05-30T17:02:51.062418+0000","last_undegraded":"2024-05-30T17:02:51.062418+0000","last_fullsized":"2024-05-30T17:02:51.062418+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:32:57.567186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"115'6","reported_seq":20,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003512+0000","last_change":"2024-05-30T17:02:49.049366+0000","last_active":"2024-05-30T17:02:52.003512+0000","last_peered":"2024-05-30T17:02:52.003512+0000","last_clean":"2024-05-30T17:02:52.003512+0000","last_became_active":"2024-05-30T17:02:49.049067+0000","last_became_peered":"2024-05-30T17:02:49.049067+0000","last_unstale":"2024-05-30T17:02:52.003512+0000","last_undegraded":"2024-05-30T17:02:52.003512+0000","last_fullsized":"2024-05-30T17:02:52.003512+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:55:51.384117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.074510+0000","last_change":"2024-05-30T17:02:50.071898+0000","last_active":"2024-05-30T17:02:50.074510+0000","last_peered":"2024-05-30T17:02:50.074510+0000","last_clean":"2024-05-30T17:02:50.074510+0000","last_became_active":"2024-05-30T17:02:50.071267+0000","last_became_peered":"2024-05-30T17:02:50.071267+0000","last_unstale":"2024-05-30T17:02:50.074510+0000","last_undegraded":"2024-05-30T17:02:50.074510+0000","last_fullsized":"2024-05-30T17:02:50.074510+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:04.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003131+0000","last_change":"2024-05-30T17:02:49.051925+0000","last_active":"2024-05-30T17:02:52.003131+0000","last_peered":"2024-05-30T17:02:52.003131+0000","last_clean":"2024-05-30T17:02:52.003131+0000","last_became_active":"2024-05-30T17:02:49.051180+0000","last_became_peered":"2024-05-30T17:02:49.051180+0000","last_unstale":"2024-05-30T17:02:52.003131+0000","last_undegraded":"2024-05-30T17:02:52.003131+0000","last_fullsized":"2024-05-30T17:02:52.003131+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:26.212295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.074311+0000","last_change":"2024-05-30T17:02:50.068030+0000","last_active":"2024-05-30T17:02:50.074311+0000","last_peered":"2024-05-30T17:02:50.074311+0000","last_clean":"2024-05-30T17:02:50.074311+0000","last_became_active":"2024-05-30T17:02:50.067752+0000","last_became_peered":"2024-05-30T17:02:50.067752+0000","last_unstale":"2024-05-30T17:02:50.074311+0000","last_undegraded":"2024-05-30T17:02:50.074311+0000","last_fullsized":"2024-05-30T17:02:50.074311+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:16.732633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.076003+0000","last_change":"2024-05-30T17:02:49.056583+0000","last_active":"2024-05-30T17:02:51.076003+0000","last_peered":"2024-05-30T17:02:51.076003+0000","last_clean":"2024-05-30T17:02:51.076003+0000","last_became_active":"2024-05-30T17:02:49.056333+0000","last_became_peered":"2024-05-30T17:02:49.056333+0000","last_unstale":"2024-05-30T17:02:51.076003+0000","last_undegraded":"2024-05-30T17:02:51.076003+0000","last_fullsized":"2024-05-30T17:02:51.076003+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:42:15.426991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.074557+0000","last_change":"2024-05-30T17:02:50.068376+0000","last_active":"2024-05-30T17:02:50.074557+0000","last_peered":"2024-05-30T17:02:50.074557+0000","last_clean":"2024-05-30T17:02:50.074557+0000","last_became_active":"2024-05-30T17:02:50.068102+0000","last_became_peered":"2024-05-30T17:02:50.068102+0000","last_unstale":"2024-05-30T17:02:50.074557+0000","last_undegraded":"2024-05-30T17:02:50.074557+0000","last_fullsized":"2024-05-30T17:02:50.074557+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:07:01.582819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"115'8","reported_seq":22,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058384+0000","last_change":"2024-05-30T17:02:49.054959+0000","last_active":"2024-05-30T17:02:51.058384+0000","last_peered":"2024-05-30T17:02:51.058384+0000","last_clean":"2024-05-30T17:02:51.058384+0000","last_became_active":"2024-05-30T17:02:49.054601+0000","last_became_peered":"2024-05-30T17:02:49.054601+0000","last_unstale":"2024-05-30T17:02:51.058384+0000","last_undegraded":"2024-05-30T17:02:51.058384+0000","last_fullsized":"2024-05-30T17:02:51.058384+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:42:49.887784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058838+0000","last_change":"2024-05-30T17:02:50.060581+0000","last_active":"2024-05-30T17:02:51.058838+0000","last_peered":"2024-05-30T17:02:51.058838+0000","last_clean":"2024-05-30T17:02:51.058838+0000","last_became_active":"2024-05-30T17:02:50.060319+0000","last_became_peered":"2024-05-30T17:02:50.060319+0000","last_unstale":"2024-05-30T17:02:51.058838+0000","last_undegraded":"2024-05-30T17:02:51.058838+0000","last_fullsized":"2024-05-30T17:02:51.058838+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:21:09.924325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004096+0000","last_change":"2024-05-30T17:02:49.053408+0000","last_active":"2024-05-30T17:02:52.004096+0000","last_peered":"2024-05-30T17:02:52.004096+0000","last_clean":"2024-05-30T17:02:52.004096+0000","last_became_active":"2024-05-30T17:02:49.052298+0000","last_became_peered":"2024-05-30T17:02:49.052298+0000","last_unstale":"2024-05-30T17:02:52.004096+0000","last_undegraded":"2024-05-30T17:02:52.004096+0000","last_fullsized":"2024-05-30T17:02:52.004096+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:41.423863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003530+0000","last_change":"2024-05-30T17:02:50.057785+0000","last_active":"2024-05-30T17:02:52.003530+0000","last_peered":"2024-05-30T17:02:52.003530+0000","last_clean":"2024-05-30T17:02:52.003530+0000","last_became_active":"2024-05-30T17:02:50.057514+0000","last_became_peered":"2024-05-30T17:02:50.057514+0000","last_unstale":"2024-05-30T17:02:52.003530+0000","last_undegraded":"2024-05-30T17:02:52.003530+0000","last_fullsized":"2024-05-30T17:02:52.003530+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:14:21.616166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058841+0000","last_change":"2024-05-30T17:02:49.037250+0000","last_active":"2024-05-30T17:02:51.058841+0000","last_peered":"2024-05-30T17:02:51.058841+0000","last_clean":"2024-05-30T17:02:51.058841+0000","last_became_active":"2024-05-30T17:02:49.036918+0000","last_became_peered":"2024-05-30T17:02:49.036918+0000","last_unstale":"2024-05-30T17:02:51.058841+0000","last_undegraded":"2024-05-30T17:02:51.058841+0000","last_fullsized":"2024-05-30T17:02:51.058841+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:29:42.391648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004546+0000","last_change":"2024-05-30T17:02:50.069932+0000","last_active":"2024-05-30T17:02:52.004546+0000","last_peered":"2024-05-30T17:02:52.004546+0000","last_clean":"2024-05-30T17:02:52.004546+0000","last_became_active":"2024-05-30T17:02:50.069617+0000","last_became_peered":"2024-05-30T17:02:50.069617+0000","last_unstale":"2024-05-30T17:02:52.004546+0000","last_undegraded":"2024-05-30T17:02:52.004546+0000","last_fullsized":"2024-05-30T17:02:52.004546+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:30.337045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.076112+0000","last_change":"2024-05-30T17:02:49.049919+0000","last_active":"2024-05-30T17:02:51.076112+0000","last_peered":"2024-05-30T17:02:51.076112+0000","last_clean":"2024-05-30T17:02:51.076112+0000","last_became_active":"2024-05-30T17:02:49.049472+0000","last_became_peered":"2024-05-30T17:02:49.049472+0000","last_unstale":"2024-05-30T17:02:51.076112+0000","last_undegraded":"2024-05-30T17:02:51.076112+0000","last_fullsized":"2024-05-30T17:02:51.076112+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:16.088363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004710+0000","last_change":"2024-05-30T17:02:50.065408+0000","last_active":"2024-05-30T17:02:52.004710+0000","last_peered":"2024-05-30T17:02:52.004710+0000","last_clean":"2024-05-30T17:02:52.004710+0000","last_became_active":"2024-05-30T17:02:50.064704+0000","last_became_peered":"2024-05-30T17:02:50.064704+0000","last_unstale":"2024-05-30T17:02:52.004710+0000","last_undegraded":"2024-05-30T17:02:52.004710+0000","last_fullsized":"2024-05-30T17:02:52.004710+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:56.847080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062085+0000","last_change":"2024-05-30T17:02:49.052470+0000","last_active":"2024-05-30T17:02:51.062085+0000","last_peered":"2024-05-30T17:02:51.062085+0000","last_clean":"2024-05-30T17:02:51.062085+0000","last_became_active":"2024-05-30T17:02:49.052162+0000","last_became_peered":"2024-05-30T17:02:49.052162+0000","last_unstale":"2024-05-30T17:02:51.062085+0000","last_undegraded":"2024-05-30T17:02:51.062085+0000","last_fullsized":"2024-05-30T17:02:51.062085+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:44.471862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004302+0000","last_change":"2024-05-30T17:02:50.070243+0000","last_active":"2024-05-30T17:02:52.004302+0000","last_peered":"2024-05-30T17:02:52.004302+0000","last_clean":"2024-05-30T17:02:52.004302+0000","last_became_active":"2024-05-30T17:02:50.069914+0000","last_became_peered":"2024-05-30T17:02:50.069914+0000","last_unstale":"2024-05-30T17:02:52.004302+0000","last_undegraded":"2024-05-30T17:02:52.004302+0000","last_fullsized":"2024-05-30T17:02:52.004302+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:36.421629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003274+0000","last_change":"2024-05-30T17:02:49.047104+0000","last_active":"2024-05-30T17:02:52.003274+0000","last_peered":"2024-05-30T17:02:52.003274+0000","last_clean":"2024-05-30T17:02:52.003274+0000","last_became_active":"2024-05-30T17:02:49.046809+0000","last_became_peered":"2024-05-30T17:02:49.046809+0000","last_unstale":"2024-05-30T17:02:52.003274+0000","last_undegraded":"2024-05-30T17:02:52.003274+0000","last_fullsized":"2024-05-30T17:02:52.003274+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:05:23.034593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002833+0000","last_change":"2024-05-30T17:02:50.062357+0000","last_active":"2024-05-30T17:02:52.002833+0000","last_peered":"2024-05-30T17:02:52.002833+0000","last_clean":"2024-05-30T17:02:52.002833+0000","last_became_active":"2024-05-30T17:02:50.062062+0000","last_became_peered":"2024-05-30T17:02:50.062062+0000","last_unstale":"2024-05-30T17:02:52.002833+0000","last_undegraded":"2024-05-30T17:02:52.002833+0000","last_fullsized":"2024-05-30T17:02:52.002833+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:39:04.509572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058400+0000","last_change":"2024-05-30T17:02:49.047661+0000","last_active":"2024-05-30T17:02:51.058400+0000","last_peered":"2024-05-30T17:02:51.058400+0000","last_clean":"2024-05-30T17:02:51.058400+0000","last_became_active":"2024-05-30T17:02:49.047275+0000","last_became_peered":"2024-05-30T17:02:49.047275+0000","last_unstale":"2024-05-30T17:02:51.058400+0000","last_undegraded":"2024-05-30T17:02:51.058400+0000","last_fullsized":"2024-05-30T17:02:51.058400+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:29.507288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004336+0000","last_change":"2024-05-30T17:02:50.063727+0000","last_active":"2024-05-30T17:02:52.004336+0000","last_peered":"2024-05-30T17:02:52.004336+0000","last_clean":"2024-05-30T17:02:52.004336+0000","last_became_active":"2024-05-30T17:02:50.063308+0000","last_became_peered":"2024-05-30T17:02:50.063308+0000","last_unstale":"2024-05-30T17:02:52.004336+0000","last_undegraded":"2024-05-30T17:02:52.004336+0000","last_fullsized":"2024-05-30T17:02:52.004336+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:42.432963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002797+0000","last_change":"2024-05-30T17:02:49.047931+0000","last_active":"2024-05-30T17:02:52.002797+0000","last_peered":"2024-05-30T17:02:52.002797+0000","last_clean":"2024-05-30T17:02:52.002797+0000","last_became_active":"2024-05-30T17:02:49.047652+0000","last_became_peered":"2024-05-30T17:02:49.047652+0000","last_unstale":"2024-05-30T17:02:52.002797+0000","last_undegraded":"2024-05-30T17:02:52.002797+0000","last_fullsized":"2024-05-30T17:02:52.002797+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:23.572140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.074597+0000","last_change":"2024-05-30T17:02:50.073141+0000","last_active":"2024-05-30T17:02:50.074597+0000","last_peered":"2024-05-30T17:02:50.074597+0000","last_clean":"2024-05-30T17:02:50.074597+0000","last_became_active":"2024-05-30T17:02:50.072879+0000","last_became_peered":"2024-05-30T17:02:50.072879+0000","last_unstale":"2024-05-30T17:02:50.074597+0000","last_undegraded":"2024-05-30T17:02:50.074597+0000","last_fullsized":"2024-05-30T17:02:50.074597+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:32:11.425539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003119+0000","last_change":"2024-05-30T17:02:49.055582+0000","last_active":"2024-05-30T17:02:52.003119+0000","last_peered":"2024-05-30T17:02:52.003119+0000","last_clean":"2024-05-30T17:02:52.003119+0000","last_became_active":"2024-05-30T17:02:49.055320+0000","last_became_peered":"2024-05-30T17:02:49.055320+0000","last_unstale":"2024-05-30T17:02:52.003119+0000","last_undegraded":"2024-05-30T17:02:52.003119+0000","last_fullsized":"2024-05-30T17:02:52.003119+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:02:54.816530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.075998+0000","last_change":"2024-05-30T17:02:50.069184+0000","last_active":"2024-05-30T17:02:51.075998+0000","last_peered":"2024-05-30T17:02:51.075998+0000","last_clean":"2024-05-30T17:02:51.075998+0000","last_became_active":"2024-05-30T17:02:50.068889+0000","last_became_peered":"2024-05-30T17:02:50.068889+0000","last_unstale":"2024-05-30T17:02:51.075998+0000","last_undegraded":"2024-05-30T17:02:51.075998+0000","last_fullsized":"2024-05-30T17:02:51.075998+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:07:34.051950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.082037+0000","last_change":"2024-05-30T17:02:49.049986+0000","last_active":"2024-05-30T17:02:50.082037+0000","last_peered":"2024-05-30T17:02:50.082037+0000","last_clean":"2024-05-30T17:02:50.082037+0000","last_became_active":"2024-05-30T17:02:49.049719+0000","last_became_peered":"2024-05-30T17:02:49.049719+0000","last_unstale":"2024-05-30T17:02:50.082037+0000","last_undegraded":"2024-05-30T17:02:50.082037+0000","last_fullsized":"2024-05-30T17:02:50.082037+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:51:08.728886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004031+0000","last_change":"2024-05-30T17:02:50.065832+0000","last_active":"2024-05-30T17:02:52.004031+0000","last_peered":"2024-05-30T17:02:52.004031+0000","last_clean":"2024-05-30T17:02:52.004031+0000","last_became_active":"2024-05-30T17:02:50.065552+0000","last_became_peered":"2024-05-30T17:02:50.065552+0000","last_unstale":"2024-05-30T17:02:52.004031+0000","last_undegraded":"2024-05-30T17:02:52.004031+0000","last_fullsized":"2024-05-30T17:02:52.004031+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:33:49.399244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"116'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.077608+0000","last_change":"2024-05-30T17:02:49.045620+0000","last_active":"2024-05-30T17:02:51.077608+0000","last_peered":"2024-05-30T17:02:51.077608+0000","last_clean":"2024-05-30T17:02:51.077608+0000","last_became_active":"2024-05-30T17:02:49.044750+0000","last_became_peered":"2024-05-30T17:02:49.044750+0000","last_unstale":"2024-05-30T17:02:51.077608+0000","last_undegraded":"2024-05-30T17:02:51.077608+0000","last_fullsized":"2024-05-30T17:02:51.077608+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:59:11.886366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003377+0000","last_change":"2024-05-30T17:02:50.059508+0000","last_active":"2024-05-30T17:02:52.003377+0000","last_peered":"2024-05-30T17:02:52.003377+0000","last_clean":"2024-05-30T17:02:52.003377+0000","last_became_active":"2024-05-30T17:02:50.059256+0000","last_became_peered":"2024-05-30T17:02:50.059256+0000","last_unstale":"2024-05-30T17:02:52.003377+0000","last_undegraded":"2024-05-30T17:02:52.003377+0000","last_fullsized":"2024-05-30T17:02:52.003377+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:05:58.381369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003567+0000","last_change":"2024-05-30T17:02:49.055536+0000","last_active":"2024-05-30T17:02:52.003567+0000","last_peered":"2024-05-30T17:02:52.003567+0000","last_clean":"2024-05-30T17:02:52.003567+0000","last_became_active":"2024-05-30T17:02:49.055302+0000","last_became_peered":"2024-05-30T17:02:49.055302+0000","last_unstale":"2024-05-30T17:02:52.003567+0000","last_undegraded":"2024-05-30T17:02:52.003567+0000","last_fullsized":"2024-05-30T17:02:52.003567+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:55:41.432835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.076147+0000","last_change":"2024-05-30T17:02:50.062095+0000","last_active":"2024-05-30T17:02:51.076147+0000","last_peered":"2024-05-30T17:02:51.076147+0000","last_clean":"2024-05-30T17:02:51.076147+0000","last_became_active":"2024-05-30T17:02:50.061785+0000","last_became_peered":"2024-05-30T17:02:50.061785+0000","last_unstale":"2024-05-30T17:02:51.076147+0000","last_undegraded":"2024-05-30T17:02:51.076147+0000","last_fullsized":"2024-05-30T17:02:51.076147+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:38:12.131574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.058423+0000","last_change":"2024-05-30T17:02:49.055543+0000","last_active":"2024-05-30T17:02:50.058423+0000","last_peered":"2024-05-30T17:02:50.058423+0000","last_clean":"2024-05-30T17:02:50.058423+0000","last_became_active":"2024-05-30T17:02:49.055244+0000","last_became_peered":"2024-05-30T17:02:49.055244+0000","last_unstale":"2024-05-30T17:02:50.058423+0000","last_undegraded":"2024-05-30T17:02:50.058423+0000","last_fullsized":"2024-05-30T17:02:50.058423+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:26:08.740743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061577+0000","last_change":"2024-05-30T17:02:50.051046+0000","last_active":"2024-05-30T17:02:51.061577+0000","last_peered":"2024-05-30T17:02:51.061577+0000","last_clean":"2024-05-30T17:02:51.061577+0000","last_became_active":"2024-05-30T17:02:50.050738+0000","last_became_peered":"2024-05-30T17:02:50.050738+0000","last_unstale":"2024-05-30T17:02:51.061577+0000","last_undegraded":"2024-05-30T17:02:51.061577+0000","last_fullsized":"2024-05-30T17:02:51.061577+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:48:05.539513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061939+0000","last_change":"2024-05-30T17:02:49.043264+0000","last_active":"2024-05-30T17:02:51.061939+0000","last_peered":"2024-05-30T17:02:51.061939+0000","last_clean":"2024-05-30T17:02:51.061939+0000","last_became_active":"2024-05-30T17:02:49.042929+0000","last_became_peered":"2024-05-30T17:02:49.042929+0000","last_unstale":"2024-05-30T17:02:51.061939+0000","last_undegraded":"2024-05-30T17:02:51.061939+0000","last_fullsized":"2024-05-30T17:02:51.061939+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:21:08.915225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.062256+0000","last_change":"2024-05-30T17:02:50.049931+0000","last_active":"2024-05-30T17:02:51.062256+0000","last_peered":"2024-05-30T17:02:51.062256+0000","last_clean":"2024-05-30T17:02:51.062256+0000","last_became_active":"2024-05-30T17:02:50.049632+0000","last_became_peered":"2024-05-30T17:02:50.049632+0000","last_unstale":"2024-05-30T17:02:51.062256+0000","last_undegraded":"2024-05-30T17:02:51.062256+0000","last_fullsized":"2024-05-30T17:02:51.062256+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:38:12.131574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061684+0000","last_change":"2024-05-30T17:02:49.050314+0000","last_active":"2024-05-30T17:02:51.061684+0000","last_peered":"2024-05-30T17:02:51.061684+0000","last_clean":"2024-05-30T17:02:51.061684+0000","last_became_active":"2024-05-30T17:02:49.050014+0000","last_became_peered":"2024-05-30T17:02:49.050014+0000","last_unstale":"2024-05-30T17:02:51.061684+0000","last_undegraded":"2024-05-30T17:02:51.061684+0000","last_fullsized":"2024-05-30T17:02:51.061684+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:56:48.003494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004438+0000","last_change":"2024-05-30T17:02:50.063650+0000","last_active":"2024-05-30T17:02:52.004438+0000","last_peered":"2024-05-30T17:02:52.004438+0000","last_clean":"2024-05-30T17:02:52.004438+0000","last_became_active":"2024-05-30T17:02:50.062909+0000","last_became_peered":"2024-05-30T17:02:50.062909+0000","last_unstale":"2024-05-30T17:02:52.004438+0000","last_undegraded":"2024-05-30T17:02:52.004438+0000","last_fullsized":"2024-05-30T17:02:52.004438+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:40:34.739950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.058429+0000","last_change":"2024-05-30T17:02:49.047491+0000","last_active":"2024-05-30T17:02:51.058429+0000","last_peered":"2024-05-30T17:02:51.058429+0000","last_clean":"2024-05-30T17:02:51.058429+0000","last_became_active":"2024-05-30T17:02:49.047171+0000","last_became_peered":"2024-05-30T17:02:49.047171+0000","last_unstale":"2024-05-30T17:02:51.058429+0000","last_undegraded":"2024-05-30T17:02:51.058429+0000","last_fullsized":"2024-05-30T17:02:51.058429+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:30:47.939217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.002668+0000","last_change":"2024-05-30T17:02:50.056219+0000","last_active":"2024-05-30T17:02:52.002668+0000","last_peered":"2024-05-30T17:02:52.002668+0000","last_clean":"2024-05-30T17:02:52.002668+0000","last_became_active":"2024-05-30T17:02:50.055827+0000","last_became_peered":"2024-05-30T17:02:50.055827+0000","last_unstale":"2024-05-30T17:02:52.002668+0000","last_undegraded":"2024-05-30T17:02:52.002668+0000","last_fullsized":"2024-05-30T17:02:52.002668+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:50.033048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.003227+0000","last_change":"2024-05-30T17:02:49.056197+0000","last_active":"2024-05-30T17:02:52.003227+0000","last_peered":"2024-05-30T17:02:52.003227+0000","last_clean":"2024-05-30T17:02:52.003227+0000","last_became_active":"2024-05-30T17:02:49.055622+0000","last_became_peered":"2024-05-30T17:02:49.055622+0000","last_unstale":"2024-05-30T17:02:52.003227+0000","last_undegraded":"2024-05-30T17:02:52.003227+0000","last_fullsized":"2024-05-30T17:02:52.003227+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:55:15.920315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-30T17:02:50.066100+0000","last_change":"2024-05-30T17:02:50.063097+0000","last_active":"2024-05-30T17:02:50.066100+0000","last_peered":"2024-05-30T17:02:50.066100+0000","last_clean":"2024-05-30T17:02:50.066100+0000","last_became_active":"2024-05-30T17:02:50.062805+0000","last_became_peered":"2024-05-30T17:02:50.062805+0000","last_unstale":"2024-05-30T17:02:50.066100+0000","last_undegraded":"2024-05-30T17:02:50.066100+0000","last_fullsized":"2024-05-30T17:02:50.066100+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:49.021567+0000","last_clean_scrub_stamp":"2024-05-30T17:02:49.021567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:36.054917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:51.061684+0000","last_change":"2024-05-30T17:02:49.052819+0000","last_active":"2024-05-30T17:02:51.061684+0000","last_peered":"2024-05-30T17:02:51.061684+0000","last_clean":"2024-05-30T17:02:51.061684+0000","last_became_active":"2024-05-30T17:02:49.052069+0000","last_became_peered":"2024-05-30T17:02:49.052069+0000","last_unstale":"2024-05-30T17:02:51.061684+0000","last_undegraded":"2024-05-30T17:02:51.061684+0000","last_fullsized":"2024-05-30T17:02:51.061684+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:02:48.012467+0000","last_clean_scrub_stamp":"2024-05-30T17:02:48.012467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:10:59.620798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":349,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-30T17:02:52.004511+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:02:52.004511+0000","last_peered":"2024-05-30T17:02:52.004511+0000","last_clean":"2024-05-30T17:02:52.004511+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:02:52.004511+0000","last_undegraded":"2024-05-30T17:02:52.004511+0000","last_fullsized":"2024-05-30T17:02:52.004511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509610,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123348,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248492,"statfs":{"total":96636764160,"available":96510455808,"internally_reserved":0,"allocated":2035712,"data_stored":1217364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509611,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122764,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249076,"statfs":{"total":96636764160,"available":96511053824,"internally_reserved":0,"allocated":1437696,"data_stored":626450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509611,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76940,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294900,"statfs":{"total":96636764160,"available":96557977600,"internally_reserved":0,"allocated":1441792,"data_stored":626984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509612,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86664,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94285176,"statfs":{"total":96636764160,"available":96548020224,"internally_reserved":0,"allocated":1433600,"data_stored":626380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509611,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144964,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226876,"statfs":{"total":96636764160,"available":96488321024,"internally_reserved":0,"allocated":1433600,"data_stored":626380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509611,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104712,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267128,"statfs":{"total":96636764160,"available":96529539072,"internally_reserved":0,"allocated":1429504,"data_stored":620092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509611,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65056,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306784,"statfs":{"total":96636764160,"available":96570146816,"internally_reserved":0,"allocated":2048000,"data_stored":1218472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542315,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126916,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244924,"statfs":{"total":96636764160,"available":96506802176,"internally_reserved":0,"allocated":1437696,"data_stored":621650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:02:54.584 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T17:02:54.584 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T17:02:54.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.762+0000 7f0330a00640 1 Processor -- start 2024-05-30T17:02:54.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.762+0000 7f0330a00640 1 -- start start 2024-05-30T17:02:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f0330a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f032c09b4b0 0x7f032c06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f0330a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032c162340 0x7f032c1627d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f0330a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032c0d0fb0 con 0x7f032c09b890 2024-05-30T17:02:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f0330a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f032c06fef0 con 0x7f032c09b4b0 2024-05-30T17:02:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f0330a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f032c0d1290 con 0x7f032c162340 2024-05-30T17:02:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f032b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f032c09b4b0 0x7f032c06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f0323e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f032c09b890 0x7f032c0d0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41594/0 (socket says 172.21.15.59:41594) 2024-05-30T17:02:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f0323e00640 1 -- 172.21.15.59:0/1563053236 learned_addr learned my addr 172.21.15.59:0/1563053236 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f032b400640 1 -- 172.21.15.59:0/1563053236 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032c162340 msgr2=0x7f032c1627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f032be00640 1 --2- 172.21.15.59:0/1563053236 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032c162340 0x7f032c1627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f032b400640 1 --2- 172.21.15.59:0/1563053236 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032c162340 0x7f032c1627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f032b400640 1 -- 172.21.15.59:0/1563053236 >> v1:172.21.15.59:6789/0 conn(0x7f032c09b890 legacy=0x7f032c0d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f032b400640 1 -- 172.21.15.59:0/1563053236 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032c0d1570 con 0x7f032c09b4b0 2024-05-30T17:02:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f032aa00640 1 -- 172.21.15.59:0/1563053236 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702470916 0 0) 0x7f032c0d0fb0 con 0x7f032c09b890 2024-05-30T17:02:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f032be00640 1 --2- 172.21.15.59:0/1563053236 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032c162340 0x7f032c1627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:54.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f032b400640 1 --2- 172.21.15.59:0/1563053236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f032c09b4b0 0x7f032c06cac0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f031c0097c0 tx=0x7f031c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd822ccde49233b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:54.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.766+0000 7f032aa00640 1 -- 172.21.15.59:0/1563053236 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c0b0070 con 0x7f032c09b4b0 2024-05-30T17:02:54.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f032aa00640 1 -- 172.21.15.59:0/1563053236 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031c0ab600 con 0x7f032c09b4b0 2024-05-30T17:02:54.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f032aa00640 1 -- 172.21.15.59:0/1563053236 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c0ab9d0 con 0x7f032c09b4b0 2024-05-30T17:02:54.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 -- 172.21.15.59:0/1563053236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f032c09b4b0 msgr2=0x7f032c06cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 --2- 172.21.15.59:0/1563053236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f032c09b4b0 0x7f032c06cac0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f031c0097c0 tx=0x7f031c01c410 comp rx=0 tx=0).stop 2024-05-30T17:02:54.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 -- 172.21.15.59:0/1563053236 shutdown_connections 2024-05-30T17:02:54.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 --2- 172.21.15.59:0/1563053236 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032c162340 0x7f032c1627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 --2- 172.21.15.59:0/1563053236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f032c09b4b0 0x7f032c06cac0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 -- 172.21.15.59:0/1563053236 >> 172.21.15.59:0/1563053236 conn(0x7f032c0b3ec0 msgr2=0x7f032c0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:54.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 -- 172.21.15.59:0/1563053236 shutdown_connections 2024-05-30T17:02:54.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 -- 172.21.15.59:0/1563053236 wait complete. 2024-05-30T17:02:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 Processor -- start 2024-05-30T17:02:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 -- start start 2024-05-30T17:02:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032c09b4b0 0x7f032c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f032c09b890 0x7f032c0c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f032c162340 0x7f032c15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f032c15fbf0 con 0x7f032c162340 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f032c15fa70 con 0x7f032c09b890 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0330a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f032c070380 con 0x7f032c09b4b0 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f032be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f032c162340 0x7f032c15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f032be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f032c162340 0x7f032c15b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34188/0 (socket says 172.21.15.59:34188) 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f032be00640 1 -- 172.21.15.59:0/2663231896 learned_addr learned my addr 172.21.15.59:0/2663231896 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f032b400640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032c09b4b0 0x7f032c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0323e00640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f032c09b890 0x7f032c0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f032be00640 1 -- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032c09b4b0 msgr2=0x7f032c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f032be00640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032c09b4b0 0x7f032c15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f032be00640 1 -- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f032c09b890 msgr2=0x7f032c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f032be00640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f032c09b890 0x7f032c0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f032be00640 1 -- 172.21.15.59:0/2663231896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032c0c7360 con 0x7f032c162340 2024-05-30T17:02:54.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.770+0000 7f0323e00640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f032c09b890 0x7f032c0c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:54.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.774+0000 7f032be00640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f032c162340 0x7f032c15b340 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f032400cd50 tx=0x7f032400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:54.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.774+0000 7f0323400640 1 -- 172.21.15.59:0/2663231896 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032400f680 con 0x7f032c162340 2024-05-30T17:02:54.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.774+0000 7f0323400640 1 -- 172.21.15.59:0/2663231896 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032400f840 con 0x7f032c162340 2024-05-30T17:02:54.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.774+0000 7f0323400640 1 -- 172.21.15.59:0/2663231896 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032400fc30 con 0x7f032c162340 2024-05-30T17:02:54.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.774+0000 7f0330a00640 1 -- 172.21.15.59:0/2663231896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032c0c7640 con 0x7f032c162340 2024-05-30T17:02:54.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.774+0000 7f0330a00640 1 -- 172.21.15.59:0/2663231896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f032c0c7c00 con 0x7f032c162340 2024-05-30T17:02:54.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.774+0000 7f0330a00640 1 -- 172.21.15.59:0/2663231896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f032c068a90 con 0x7f032c162340 2024-05-30T17:02:54.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.774+0000 7f0323400640 1 -- 172.21.15.59:0/2663231896 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f032400e3e0 con 0x7f032c162340 2024-05-30T17:02:54.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.774+0000 7f0323400640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0308069b20 0x7f030806bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:54.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.774+0000 7f0323400640 1 -- 172.21.15.59:0/2663231896 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f03240864e0 con 0x7f032c162340 2024-05-30T17:02:54.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.774+0000 7f032b400640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0308069b20 0x7f030806bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:54.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.778+0000 7f032b400640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0308069b20 0x7f030806bfe0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f031c0ad000 tx=0x7f031c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:54.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:54.778+0000 7f0323400640 1 -- 172.21.15.59:0/2663231896 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0324014030 con 0x7f032c162340 2024-05-30T17:02:55.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.002+0000 7f0330a00640 1 -- 172.21.15.59:0/2663231896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f032c0cc780 con 0x7f032c162340 2024-05-30T17:02:55.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.002+0000 7f0323400640 1 -- 172.21.15.59:0/2663231896 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f03240585a0 con 0x7f032c162340 2024-05-30T17:02:55.007 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-05-30T17:02:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA== 2024-05-30T17:02:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-05-30T17:02:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-05-30T17:02:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T17:02:55.008 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-05-30T17:02:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.006+0000 7f0330a00640 1 -- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0308069b20 msgr2=0x7f030806bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.006+0000 7f0330a00640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0308069b20 0x7f030806bfe0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f031c0ad000 tx=0x7f031c0a6000 comp rx=0 tx=0).stop 2024-05-30T17:02:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.006+0000 7f0330a00640 1 -- 172.21.15.59:0/2663231896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f032c162340 msgr2=0x7f032c15b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.006+0000 7f0330a00640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f032c162340 0x7f032c15b340 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f032400cd50 tx=0x7f032400a650 comp rx=0 tx=0).stop 2024-05-30T17:02:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.006+0000 7f0330a00640 1 -- 172.21.15.59:0/2663231896 shutdown_connections 2024-05-30T17:02:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.006+0000 7f0330a00640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0308069b20 0x7f030806bfe0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.006+0000 7f0330a00640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f032c162340 0x7f032c15b340 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.006+0000 7f0330a00640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f032c09b890 0x7f032c0c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.006+0000 7f0330a00640 1 --2- 172.21.15.59:0/2663231896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f032c09b4b0 0x7f032c15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.006+0000 7f0330a00640 1 -- 172.21.15.59:0/2663231896 >> 172.21.15.59:0/2663231896 conn(0x7f032c0b3ec0 msgr2=0x7f032c06e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.006+0000 7f0330a00640 1 -- 172.21.15.59:0/2663231896 shutdown_connections 2024-05-30T17:02:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.006+0000 7f0330a00640 1 -- 172.21.15.59:0/2663231896 wait complete. 2024-05-30T17:02:55.028 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:02:55.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.166+0000 7fa5bcc00640 1 Processor -- start 2024-05-30T17:02:55.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.166+0000 7fa5bcc00640 1 -- start start 2024-05-30T17:02:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5bcc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa5b8159df0 0x7fa5b80ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5bcc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5b815a1d0 0x7fa5b80ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5bcc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b815d730 con 0x7fa5b80b3e50 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5bcc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa5b80b3370 con 0x7fa5b8159df0 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5bcc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b80b3650 con 0x7fa5b815a1d0 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5b5e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa5b8159df0 0x7fa5b80ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5b5e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa5b8159df0 0x7fa5b80ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34196/0 (socket says 172.21.15.59:34196) 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5b5e00640 1 -- 172.21.15.59:0/3928275359 learned_addr learned my addr 172.21.15.59:0/3928275359 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5b6800640 1 --1- 172.21.15.59:0/3928275359 >> v1:172.21.15.59:6789/0 conn(0x7fa5b80b3e50 0x7fa5b815ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41604/0 (socket says 172.21.15.59:41604) 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5ad400640 1 --2- 172.21.15.59:0/3928275359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5b815a1d0 0x7fa5b80ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5b5e00640 1 -- 172.21.15.59:0/3928275359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5b815a1d0 msgr2=0x7fa5b80ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5b5e00640 1 --2- 172.21.15.59:0/3928275359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5b815a1d0 0x7fa5b80ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5b5e00640 1 -- 172.21.15.59:0/3928275359 >> v1:172.21.15.59:6789/0 conn(0x7fa5b80b3e50 legacy=0x7fa5b815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5b5e00640 1 -- 172.21.15.59:0/3928275359 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b80b3930 con 0x7fa5b8159df0 2024-05-30T17:02:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5ad400640 1 --2- 172.21.15.59:0/3928275359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5b815a1d0 0x7fa5b80ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:55.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.170+0000 7fa5b5e00640 1 --2- 172.21.15.59:0/3928275359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b8159df0 0x7fa5b80ad1b0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009870 tx=0x7fa5a801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4a32d5197914a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5b5400640 1 -- 172.21.15.59:0/3928275359 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80b0070 con 0x7fa5b8159df0 2024-05-30T17:02:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5b5400640 1 -- 172.21.15.59:0/3928275359 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a80ab600 con 0x7fa5b8159df0 2024-05-30T17:02:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5b5400640 1 -- 172.21.15.59:0/3928275359 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80ab9d0 con 0x7fa5b8159df0 2024-05-30T17:02:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 -- 172.21.15.59:0/3928275359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b8159df0 msgr2=0x7fa5b80ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 --2- 172.21.15.59:0/3928275359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b8159df0 0x7fa5b80ad1b0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009870 tx=0x7fa5a801c560 comp rx=0 tx=0).stop 2024-05-30T17:02:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 -- 172.21.15.59:0/3928275359 shutdown_connections 2024-05-30T17:02:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 --2- 172.21.15.59:0/3928275359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5b815a1d0 0x7fa5b80ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 --2- 172.21.15.59:0/3928275359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b8159df0 0x7fa5b80ad1b0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 -- 172.21.15.59:0/3928275359 >> 172.21.15.59:0/3928275359 conn(0x7fa5b80b22d0 msgr2=0x7fa5b80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 -- 172.21.15.59:0/3928275359 shutdown_connections 2024-05-30T17:02:55.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 -- 172.21.15.59:0/3928275359 wait complete. 2024-05-30T17:02:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 Processor -- start 2024-05-30T17:02:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 -- start start 2024-05-30T17:02:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5b80b3e50 0x7fa5b81487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b8159df0 0x7fa5b8152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5b815a1d0 0x7fa5b8153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b815e720 con 0x7fa5b8159df0 2024-05-30T17:02:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b815e5a0 con 0x7fa5b80b3e50 2024-05-30T17:02:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5bcc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b815e8a0 con 0x7fa5b815a1d0 2024-05-30T17:02:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b8159df0 0x7fa5b8152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b8159df0 0x7fa5b8152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34200/0 (socket says 172.21.15.59:34200) 2024-05-30T17:02:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5ad400640 1 -- 172.21.15.59:0/4238971635 learned_addr learned my addr 172.21.15.59:0/4238971635 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5b6800640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5b815a1d0 0x7fa5b8153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.174+0000 7fa5b5e00640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5b80b3e50 0x7fa5b81487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5ad400640 1 -- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5b815a1d0 msgr2=0x7fa5b8153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5ad400640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5b815a1d0 0x7fa5b8153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5ad400640 1 -- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5b80b3e50 msgr2=0x7fa5b81487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5ad400640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5b80b3e50 0x7fa5b81487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5ad400640 1 -- 172.21.15.59:0/4238971635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b80730b0 con 0x7fa5b8159df0 2024-05-30T17:02:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5ad400640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b8159df0 0x7fa5b8152d30 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000c820 tx=0x7fa5a000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5aea00640 1 -- 172.21.15.59:0/4238971635 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0015070 con 0x7fa5b8159df0 2024-05-30T17:02:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5aea00640 1 -- 172.21.15.59:0/4238971635 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a0007a30 con 0x7fa5b8159df0 2024-05-30T17:02:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5aea00640 1 -- 172.21.15.59:0/4238971635 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0007e00 con 0x7fa5b8159df0 2024-05-30T17:02:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5bcc00640 1 -- 172.21.15.59:0/4238971635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b8158c30 con 0x7fa5b8159df0 2024-05-30T17:02:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5bcc00640 1 -- 172.21.15.59:0/4238971635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b81591f0 con 0x7fa5b8159df0 2024-05-30T17:02:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5bcc00640 1 -- 172.21.15.59:0/4238971635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5b8068a90 con 0x7fa5b8159df0 2024-05-30T17:02:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5aea00640 1 -- 172.21.15.59:0/4238971635 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fa5a0018070 con 0x7fa5b8159df0 2024-05-30T17:02:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.178+0000 7fa5aea00640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa594069b70 0x7fa59406c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.182+0000 7fa5aea00640 1 -- 172.21.15.59:0/4238971635 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7fa5a0085540 con 0x7fa5b8159df0 2024-05-30T17:02:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.182+0000 7fa5b5e00640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa594069b70 0x7fa59406c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.182+0000 7fa5b5e00640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa594069b70 0x7fa59406c030 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80ad000 tx=0x7fa5a80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.186+0000 7fa5aea00640 1 -- 172.21.15.59:0/4238971635 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa5a008e070 con 0x7fa5b8159df0 2024-05-30T17:02:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.386+0000 7fa5bcc00640 1 -- 172.21.15.59:0/4238971635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5b80b4ef0 con 0x7fa5b8159df0 2024-05-30T17:02:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.386+0000 7fa5aea00640 1 -- 172.21.15.59:0/4238971635 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5186 (secure 0 0 0) 0x7fa5a0057090 con 0x7fa5b8159df0 2024-05-30T17:02:55.390 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:02:55.390 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":71,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3022278523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3022278523},{"type":"v1","addr":"172.21.15.59:6835","nonce":3022278523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2843818914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2843818914},{"type":"v1","addr":"172.21.15.107:6837","nonce":2843818914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7750,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3415278570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3415278570},{"type":"v1","addr":"172.21.15.107:6836","nonce":3415278570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:02:49.435879+0000","modified":"2024-05-30T17:02:52.455412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8460":{"gid":8460,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/871678202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":871678202},{"type":"v1","addr":"172.21.15.59:6834","nonce":871678202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8460,"qdb_cluster":[8460]},"id":8}]} 2024-05-30T17:02:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 71 2024-05-30T17:02:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.386+0000 7fa5bcc00640 1 -- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa594069b70 msgr2=0x7fa59406c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.386+0000 7fa5bcc00640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa594069b70 0x7fa59406c030 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80ad000 tx=0x7fa5a80a6000 comp rx=0 tx=0).stop 2024-05-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.386+0000 7fa5bcc00640 1 -- 172.21.15.59:0/4238971635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b8159df0 msgr2=0x7fa5b8152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.386+0000 7fa5bcc00640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b8159df0 0x7fa5b8152d30 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000c820 tx=0x7fa5a000cce0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.386+0000 7fa5bcc00640 1 -- 172.21.15.59:0/4238971635 shutdown_connections 2024-05-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.386+0000 7fa5bcc00640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa594069b70 0x7fa59406c030 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.386+0000 7fa5bcc00640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa5b815a1d0 0x7fa5b8153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.386+0000 7fa5bcc00640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b8159df0 0x7fa5b8152d30 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.386+0000 7fa5bcc00640 1 --2- 172.21.15.59:0/4238971635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5b80b3e50 0x7fa5b81487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.386+0000 7fa5bcc00640 1 -- 172.21.15.59:0/4238971635 >> 172.21.15.59:0/4238971635 conn(0x7fa5b80b22d0 msgr2=0x7fa5b815ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.390+0000 7fa5bcc00640 1 -- 172.21.15.59:0/4238971635 shutdown_connections 2024-05-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.390+0000 7fa5bcc00640 1 -- 172.21.15.59:0/4238971635 wait complete. 2024-05-30T17:02:55.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T17:02:49.435879+0000', 'modified': '2024-05-30T17:02:52.455412+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8460}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8460': {'gid': 8460, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6834/871678202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 871678202}, {'type': 'v1', 'addr': '172.21.15.59:6834', 'nonce': 871678202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8460, 'qdb_cluster': [8460]} 2024-05-30T17:02:55.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T17:02:55.813 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-30T17:02:55.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.954+0000 7fd16aa00640 1 Processor -- start 2024-05-30T17:02:55.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.954+0000 7fd16aa00640 1 -- start start 2024-05-30T17:02:55.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd16aa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd164161bf0 0x7fd16415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd16aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd16415f030 0x7fd16415f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd16aa00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1641627a0 con 0x7fd16415e710 2024-05-30T17:02:55.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd16aa00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd1640d0660 con 0x7fd16415f030 2024-05-30T17:02:55.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd16aa00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd1640d1aa0 con 0x7fd164161bf0 2024-05-30T17:02:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd163e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd16415e710 0x7fd1641614e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41606/0 (socket says 172.21.15.59:41606) 2024-05-30T17:02:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd163e00640 1 -- 172.21.15.59:0/4277094043 learned_addr learned my addr 172.21.15.59:0/4277094043 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd168a00640 1 --2- 172.21.15.59:0/4277094043 >> v2:172.21.15.59:3300/0 conn(0x7fd16415f030 0x7fd16415f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd15be00640 1 --2- 172.21.15.59:0/4277094043 >> v2:172.21.15.107:3300/0 conn(0x7fd164161bf0 0x7fd16415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd168a00640 1 -- 172.21.15.59:0/4277094043 >> v2:172.21.15.107:3300/0 conn(0x7fd164161bf0 msgr2=0x7fd16415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd168a00640 1 --2- 172.21.15.59:0/4277094043 >> v2:172.21.15.107:3300/0 conn(0x7fd164161bf0 0x7fd16415eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd168a00640 1 -- 172.21.15.59:0/4277094043 >> v1:172.21.15.59:6789/0 conn(0x7fd16415e710 legacy=0x7fd1641614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd163400640 1 -- 172.21.15.59:0/4277094043 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728679414 0 0) 0x7fd1641627a0 con 0x7fd16415e710 2024-05-30T17:02:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd168a00640 1 -- 172.21.15.59:0/4277094043 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd164162a80 con 0x7fd16415f030 2024-05-30T17:02:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd168a00640 1 --2- 172.21.15.59:0/4277094043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd16415f030 0x7fd16415f480 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009d90 tx=0x7fd15c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff16eee0f8e207d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.958+0000 7fd163400640 1 -- 172.21.15.59:0/4277094043 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0b2070 con 0x7fd16415f030 2024-05-30T17:02:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd163400640 1 -- 172.21.15.59:0/4277094043 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15c0a58e0 con 0x7fd16415f030 2024-05-30T17:02:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd163400640 1 -- 172.21.15.59:0/4277094043 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0a5cb0 con 0x7fd16415f030 2024-05-30T17:02:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 -- 172.21.15.59:0/4277094043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd16415f030 msgr2=0x7fd16415f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 --2- 172.21.15.59:0/4277094043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd16415f030 0x7fd16415f480 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009d90 tx=0x7fd15c01c930 comp rx=0 tx=0).stop 2024-05-30T17:02:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 -- 172.21.15.59:0/4277094043 shutdown_connections 2024-05-30T17:02:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 --2- 172.21.15.59:0/4277094043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd16415f030 0x7fd16415f480 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 --2- 172.21.15.59:0/4277094043 >> v2:172.21.15.107:3300/0 conn(0x7fd164161bf0 0x7fd16415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 -- 172.21.15.59:0/4277094043 >> 172.21.15.59:0/4277094043 conn(0x7fd1640b3f50 msgr2=0x7fd1640b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 -- 172.21.15.59:0/4277094043 shutdown_connections 2024-05-30T17:02:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 -- 172.21.15.59:0/4277094043 wait complete. 2024-05-30T17:02:55.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 Processor -- start 2024-05-30T17:02:55.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 -- start start 2024-05-30T17:02:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd16415e710 0x7fd16415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd16415f030 0x7fd164154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd164161bf0 0x7fd1641fb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd164162540 con 0x7fd16415e710 2024-05-30T17:02:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd1641623c0 con 0x7fd16415f030 2024-05-30T17:02:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd16aa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd164161fd0 con 0x7fd164161bf0 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd163e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd16415e710 0x7fd16415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd163e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd16415e710 0x7fd16415abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34210/0 (socket says 172.21.15.59:34210) 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd163e00640 1 -- 172.21.15.59:0/231528280 learned_addr learned my addr 172.21.15.59:0/231528280 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd15be00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd16415f030 0x7fd164154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd168a00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd164161bf0 0x7fd1641fb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd163e00640 1 -- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd164161bf0 msgr2=0x7fd1641fb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd163e00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd164161bf0 0x7fd1641fb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd163e00640 1 -- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd16415f030 msgr2=0x7fd164154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd163e00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd16415f030 0x7fd164154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd163e00640 1 -- 172.21.15.59:0/231528280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1640c7540 con 0x7fd16415e710 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.962+0000 7fd168a00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd164161bf0 0x7fd1641fb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.966+0000 7fd163e00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd16415e710 0x7fd16415abe0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd15400c480 tx=0x7fd15400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.966+0000 7fd160c00640 1 -- 172.21.15.59:0/231528280 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154018070 con 0x7fd16415e710 2024-05-30T17:02:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.966+0000 7fd160c00640 1 -- 172.21.15.59:0/231528280 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd154007500 con 0x7fd16415e710 2024-05-30T17:02:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.966+0000 7fd16aa00640 1 -- 172.21.15.59:0/231528280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1641fb960 con 0x7fd16415e710 2024-05-30T17:02:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.966+0000 7fd160c00640 1 -- 172.21.15.59:0/231528280 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154004a30 con 0x7fd16415e710 2024-05-30T17:02:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.966+0000 7fd16aa00640 1 -- 172.21.15.59:0/231528280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1641fbf20 con 0x7fd16415e710 2024-05-30T17:02:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.966+0000 7fd160c00640 1 -- 172.21.15.59:0/231528280 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fd15401b070 con 0x7fd16415e710 2024-05-30T17:02:55.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.966+0000 7fd160c00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd140069b20 0x7fd14006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.966+0000 7fd160c00640 1 -- 172.21.15.59:0/231528280 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7fd1540849d0 con 0x7fd16415e710 2024-05-30T17:02:55.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.966+0000 7fd16ddfe000 1 Processor -- start 2024-05-30T17:02:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.966+0000 7fd15be00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd140069b20 0x7fd14006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 -- start start 2024-05-30T17:02:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd15be00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd140069b20 0x7fd14006bfe0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd16415a9d0 tx=0x7fd14c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b218216500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216a40 0x55b2181c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b2181c9650 0x55b2181c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b21801a420 con 0x55b218216a40 2024-05-30T17:02:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b217fb4bf0 con 0x55b218216120 2024-05-30T17:02:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55b2180163e0 con 0x55b2181c9650 2024-05-30T17:02:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd15be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216a40 0x55b2181c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd163e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b218216500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd168a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b2181c9650 0x55b2181c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd15be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216a40 0x55b2181c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34222/0 (socket says 172.21.15.59:34222) 2024-05-30T17:02:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd163e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b218216500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:38692/0 (socket says 172.21.15.59:38692) 2024-05-30T17:02:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd15be00640 1 -- 172.21.15.59:0/1013132980 learned_addr learned my addr 172.21.15.59:0/1013132980 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd15be00640 1 -- 172.21.15.59:0/1013132980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b2181c9650 msgr2=0x55b2181c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd15be00640 1 --2- 172.21.15.59:0/1013132980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b2181c9650 0x55b2181c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd15be00640 1 -- 172.21.15.59:0/1013132980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 msgr2=0x55b218216500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd15be00640 1 --2- 172.21.15.59:0/1013132980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b218216500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd15be00640 1 -- 172.21.15.59:0/1013132980 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2180c2450 con 0x55b218216a40 2024-05-30T17:02:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd15be00640 1 --2- 172.21.15.59:0/1013132980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216a40 0x55b2181c9110 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd14c011dd0 tx=0x7fd14c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed89edcebe932efb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd158c00640 1 -- 172.21.15.59:0/1013132980 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c01b070 con 0x55b218216a40 2024-05-30T17:02:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd158c00640 1 -- 172.21.15.59:0/1013132980 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c027070 con 0x55b218216a40 2024-05-30T17:02:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd158c00640 1 -- 172.21.15.59:0/1013132980 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c003a30 con 0x55b218216a40 2024-05-30T17:02:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 -- 172.21.15.59:0/1013132980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216a40 msgr2=0x55b2181c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/1013132980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216a40 0x55b2181c9110 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd14c011dd0 tx=0x7fd14c014000 comp rx=0 tx=0).stop 2024-05-30T17:02:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 -- 172.21.15.59:0/1013132980 shutdown_connections 2024-05-30T17:02:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/1013132980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b2181c9650 0x55b2181c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/1013132980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216a40 0x55b2181c9110 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/1013132980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b218216500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 -- 172.21.15.59:0/1013132980 >> 172.21.15.59:0/1013132980 conn(0x55b2181f6ec0 msgr2=0x55b2181f92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 -- 172.21.15.59:0/1013132980 shutdown_connections 2024-05-30T17:02:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 -- 172.21.15.59:0/1013132980 wait complete. 2024-05-30T17:02:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.970+0000 7fd16ddfe000 1 -- start start 2024-05-30T17:02:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 1 Processor -- start 2024-05-30T17:02:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 0x55b2181ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b2181cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b218216a40 0x55b2181cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b217fbaec0 con 0x55b2181c9650 2024-05-30T17:02:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b21809b120 con 0x55b218216120 2024-05-30T17:02:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55b218025350 con 0x55b218216a40 2024-05-30T17:02:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 10 client.0 _ll_register_callbacks cb 0x55b217ff74d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T17:02:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd163e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 0x55b2181ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd163e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 0x55b2181ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34236/0 (socket says 172.21.15.59:34236) 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd163e00640 1 -- 172.21.15.59:0/2198397979 learned_addr learned my addr 172.21.15.59:0/2198397979 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd15be00640 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b2181cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd168a00640 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b218216a40 0x55b2181cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd163e00640 1 -- 172.21.15.59:0/2198397979 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b218216a40 msgr2=0x55b2181cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd163e00640 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b218216a40 0x55b2181cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd163e00640 1 -- 172.21.15.59:0/2198397979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 msgr2=0x55b2181cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd163e00640 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b2181cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd163e00640 1 -- 172.21.15.59:0/2198397979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b21805ff80 con 0x55b2181c9650 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd163e00640 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 0x55b2181ceb40 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fd15400ce40 tx=0x7fd15405a820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=badcffd09accb248 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd151600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd151600640 1 -- 172.21.15.59:0/2198397979 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154054760 con 0x55b2181c9650 2024-05-30T17:02:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd151600640 1 -- 172.21.15.59:0/2198397979 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7fd1540557f0 con 0x55b2181c9650 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 1 -- 172.21.15.59:0/2198397979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd14c027070 con 0x55b2181c9650 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd151600640 1 -- 172.21.15.59:0/2198397979 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fd1540559f0 con 0x55b2181c9650 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 10 client.8607 fetch_fsmap learned FSMap version 71 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 1 -- 172.21.15.59:0/2198397979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x55b217ff3f00 con 0x55b2181c9650 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd151600640 1 -- 172.21.15.59:0/2198397979 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c027070 con 0x55b2181c9650 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd151600640 1 -- 172.21.15.59:0/2198397979 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 71) ==== 3494+0+0 (secure 0 0 0) 0x7fd1540520f0 con 0x55b2181c9650 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 10 client.8607 fetch_fsmap finished waiting for FSMap version 71 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 10 client.8607 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 20 client.8607 populate_metadata read hostname 'smithi059' 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.59:6833/871678202,v1:172.21.15.59:6834/871678202] conn(0x55b2182253c0 0x55b2182277b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 4 client.8607 mds_command: new command op to 8460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd16ddfe000 1 -- 172.21.15.59:0/2198397979 --> [v2:172.21.15.59:6833/871678202,v1:172.21.15.59:6834/871678202] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b217fb3bc0 con 0x55b2182253c0 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd15be00640 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.59:6833/871678202,v1:172.21.15.59:6834/871678202] conn(0x55b2182253c0 0x55b2182277b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd15be00640 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.59:6833/871678202,v1:172.21.15.59:6834/871678202] conn(0x55b2182253c0 0x55b2182277b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f433a1c302d2c86 server_cookie=b93a50a66226210 in_seq=0 out_seq=0 2024-05-30T17:02:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.974+0000 7fd151600640 10 client.8607 ms_handle_connect on v2:172.21.15.59:6833/871678202 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd151600640 1 -- 172.21.15.59:0/2198397979 <== mds.0 v2:172.21.15.59:6833/871678202 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b217fb3bc0 con 0x55b2182253c0 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd151600640 10 client.8607 handle_command_reply: tid=0 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd16ddfe000 1 client.8607 shutdown 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd16ddfe000 1 -- 172.21.15.59:0/2198397979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 msgr2=0x55b2181ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 0x55b2181ceb40 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fd15400ce40 tx=0x7fd15405a820 comp rx=0 tx=0).stop 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd16ddfe000 1 -- 172.21.15.59:0/2198397979 shutdown_connections 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.59:6833/871678202,v1:172.21.15.59:6834/871678202] conn(0x55b2182253c0 0x55b2182277b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b218216a40 0x55b2181cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b2181cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/2198397979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 0x55b2181ceb40 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd151600640 0 client.8607 ms_handle_reset on v2:172.21.15.59:6833/871678202 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd16ddfe000 1 -- 172.21.15.59:0/2198397979 >> 172.21.15.59:0/2198397979 conn(0x55b2181f6ec0 msgr2=0x55b2181f92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd16ddfe000 1 -- 172.21.15.59:0/2198397979 shutdown_connections 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd16ddfe000 1 -- 172.21.15.59:0/2198397979 wait complete. 2024-05-30T17:02:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.978+0000 7fd16ddfe000 20 client.8607 trim_cache size 0 max 16384 2024-05-30T17:02:55.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.994+0000 7fd16ddfe000 1 Processor -- start 2024-05-30T17:02:55.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.994+0000 7fd16ddfe000 1 -- start start 2024-05-30T17:02:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.994+0000 7fd16ddfe000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b2181c9650 0x55b2181c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.994+0000 7fd16ddfe000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216120 0x55b2181c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.994+0000 7fd16ddfe000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216a40 0x55b2182277b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.994+0000 7fd16ddfe000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd1640c89a0 con 0x55b218216120 2024-05-30T17:02:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.994+0000 7fd16ddfe000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd1640c7d00 con 0x55b218216a40 2024-05-30T17:02:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.994+0000 7fd16ddfe000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd1640c8350 con 0x55b2181c9650 2024-05-30T17:02:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd15be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216120 0x55b2181c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd15be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216120 0x55b2181c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34244/0 (socket says 172.21.15.59:34244) 2024-05-30T17:02:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd15be00640 1 -- 172.21.15.59:0/1554765806 learned_addr learned my addr 172.21.15.59:0/1554765806 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd163e00640 1 --2- 172.21.15.59:0/1554765806 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b2181c9650 0x55b2181c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd168a00640 1 --2- 172.21.15.59:0/1554765806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216a40 0x55b2182277b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd15be00640 1 -- 172.21.15.59:0/1554765806 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b2181c9650 msgr2=0x55b2181c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd15be00640 1 --2- 172.21.15.59:0/1554765806 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b2181c9650 0x55b2181c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd15be00640 1 -- 172.21.15.59:0/1554765806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216a40 msgr2=0x55b2182277b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd15be00640 1 --2- 172.21.15.59:0/1554765806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216a40 0x55b2182277b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd15be00640 1 -- 172.21.15.59:0/1554765806 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b218216870 con 0x55b218216120 2024-05-30T17:02:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd168a00640 1 --2- 172.21.15.59:0/1554765806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216a40 0x55b2182277b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd163e00640 1 --2- 172.21.15.59:0/1554765806 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b2181c9650 0x55b2181c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd15be00640 1 --2- 172.21.15.59:0/1554765806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216120 0x55b2181c8d50 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fd14c023000 tx=0x7fd14c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489b539878ae84a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd153e00640 1 -- 172.21.15.59:0/1554765806 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c03e070 con 0x55b218216120 2024-05-30T17:02:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd153e00640 1 -- 172.21.15.59:0/1554765806 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c027040 con 0x55b218216120 2024-05-30T17:02:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd153e00640 1 -- 172.21.15.59:0/1554765806 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c01b040 con 0x55b218216120 2024-05-30T17:02:56.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 -- 172.21.15.59:0/1554765806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216120 msgr2=0x55b2181c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:56.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/1554765806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216120 0x55b2181c8d50 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fd14c023000 tx=0x7fd14c016000 comp rx=0 tx=0).stop 2024-05-30T17:02:56.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 -- 172.21.15.59:0/1554765806 shutdown_connections 2024-05-30T17:02:56.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/1554765806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216a40 0x55b2182277b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/1554765806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b218216120 0x55b2181c8d50 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/1554765806 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b2181c9650 0x55b2181c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 -- 172.21.15.59:0/1554765806 >> 172.21.15.59:0/1554765806 conn(0x55b2181f6ec0 msgr2=0x55b2181c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 -- 172.21.15.59:0/1554765806 shutdown_connections 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 -- 172.21.15.59:0/1554765806 wait complete. 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 -- start start 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 Processor -- start 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 0x55b21822a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b218241340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b218216a40 0x55b218241880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b218019730 con 0x55b2181c9650 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b217fe69e0 con 0x55b218216120 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55b21801ea50 con 0x55b218216a40 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd16ddfe000 10 client.0 _ll_register_callbacks cb 0x7fd154007770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd163e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 0x55b21822a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd163e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 0x55b21822a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34246/0 (socket says 172.21.15.59:34246) 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:55.998+0000 7fd163e00640 1 -- 172.21.15.59:0/578188241 learned_addr learned my addr 172.21.15.59:0/578188241 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd15be00640 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b218241340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd168a00640 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b218216a40 0x55b218241880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd163e00640 1 -- 172.21.15.59:0/578188241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b218216a40 msgr2=0x55b218241880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd163e00640 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b218216a40 0x55b218241880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd163e00640 1 -- 172.21.15.59:0/578188241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 msgr2=0x55b218241340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd163e00640 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b218241340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd163e00640 1 -- 172.21.15.59:0/578188241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b217fa0e80 con 0x55b2181c9650 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd168a00640 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b218216a40 0x55b218241880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd163e00640 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 0x55b21822a650 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fd154055e70 tx=0x7fd1540562a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626b9a1c02f88d4b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd151600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd151600640 1 -- 172.21.15.59:0/578188241 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154054760 con 0x55b2181c9650 2024-05-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 -- 172.21.15.59:0/578188241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd14c027040 con 0x55b2181c9650 2024-05-30T17:02:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd151600640 1 -- 172.21.15.59:0/578188241 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7fd154058d40 con 0x55b2181c9650 2024-05-30T17:02:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd151600640 1 -- 172.21.15.59:0/578188241 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fd154055470 con 0x55b2181c9650 2024-05-30T17:02:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 10 client.8613 fetch_fsmap learned FSMap version 71 2024-05-30T17:02:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 -- 172.21.15.59:0/578188241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x55b217fe2b30 con 0x55b2181c9650 2024-05-30T17:02:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd151600640 1 -- 172.21.15.59:0/578188241 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c027040 con 0x55b2181c9650 2024-05-30T17:02:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd151600640 1 -- 172.21.15.59:0/578188241 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 71) ==== 3494+0+0 (secure 0 0 0) 0x7fd15406eba0 con 0x55b2181c9650 2024-05-30T17:02:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 10 client.8613 fetch_fsmap finished waiting for FSMap version 71 2024-05-30T17:02:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 10 client.8613 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-30T17:02:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 20 client.8613 populate_metadata read hostname 'smithi059' 2024-05-30T17:02:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.59:6833/871678202,v1:172.21.15.59:6834/871678202] conn(0x55b218241dc0 0x55b218284fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 4 client.8613 mds_command: new command op to 8460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T17:02:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 -- 172.21.15.59:0/578188241 --> [v2:172.21.15.59:6833/871678202,v1:172.21.15.59:6834/871678202] -- command(tid 0: {"prefix": "status"}) -- 0x55b218027e40 con 0x55b218241dc0 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd15be00640 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.59:6833/871678202,v1:172.21.15.59:6834/871678202] conn(0x55b218241dc0 0x55b218284fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd15be00640 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.59:6833/871678202,v1:172.21.15.59:6834/871678202] conn(0x55b218241dc0 0x55b218284fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a0fbf5cb77b5b46 server_cookie=26a6a2d1f17d31a6 in_seq=0 out_seq=0 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd151600640 10 client.8613 ms_handle_connect on v2:172.21.15.59:6833/871678202 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd151600640 1 -- 172.21.15.59:0/578188241 <== mds.0 v2:172.21.15.59:6833/871678202 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55b218027e40 con 0x55b218241dc0 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd151600640 10 client.8613 handle_command_reply: tid=0 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 client.8613 shutdown 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 -- 172.21.15.59:0/578188241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 msgr2=0x55b21822a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 0x55b21822a650 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fd154055e70 tx=0x7fd1540562a0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 -- 172.21.15.59:0/578188241 shutdown_connections 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.59:6833/871678202,v1:172.21.15.59:6834/871678202] conn(0x55b218241dc0 0x55b218284fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b218216a40 0x55b218241880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b218216120 0x55b218241340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 --2- 172.21.15.59:0/578188241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2181c9650 0x55b21822a650 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 -- 172.21.15.59:0/578188241 >> 172.21.15.59:0/578188241 conn(0x55b2181f6ec0 msgr2=0x55b2181c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:56.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd151600640 0 client.8613 ms_handle_reset on v2:172.21.15.59:6833/871678202 2024-05-30T17:02:56.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 -- 172.21.15.59:0/578188241 shutdown_connections 2024-05-30T17:02:56.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 1 -- 172.21.15.59:0/578188241 wait complete. 2024-05-30T17:02:56.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16ddfe000 20 client.8613 trim_cache size 0 max 16384 2024-05-30T17:02:56.014 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:02:56.014 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:02:56.014 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-05-30T17:02:56.014 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8460, 2024-05-30T17:02:56.014 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-05-30T17:02:56.014 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-05-30T17:02:56.014 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-05-30T17:02:56.014 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 5.9565119119999999, 2024-05-30T17:02:56.014 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 71, 2024-05-30T17:02:56.014 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 116, 2024-05-30T17:02:56.014 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 116, 2024-05-30T17:02:56.015 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 10.821662894999999 2024-05-30T17:02:56.015 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:02:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16aa00640 1 -- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd140069b20 msgr2=0x7fd14006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16aa00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd140069b20 0x7fd14006bfe0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd16415a9d0 tx=0x7fd14c009190 comp rx=0 tx=0).stop 2024-05-30T17:02:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16aa00640 1 -- 172.21.15.59:0/231528280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd16415e710 msgr2=0x7fd16415abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16aa00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd16415e710 0x7fd16415abe0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd15400c480 tx=0x7fd15400c940 comp rx=0 tx=0).stop 2024-05-30T17:02:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16aa00640 1 -- 172.21.15.59:0/231528280 shutdown_connections 2024-05-30T17:02:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16aa00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd140069b20 0x7fd14006bfe0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16aa00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd164161bf0 0x7fd1641fb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16aa00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd16415f030 0x7fd164154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16aa00640 1 --2- 172.21.15.59:0/231528280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd16415e710 0x7fd16415abe0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16aa00640 1 -- 172.21.15.59:0/231528280 >> 172.21.15.59:0/231528280 conn(0x7fd1640b3f50 msgr2=0x7fd1640b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16aa00640 1 -- 172.21.15.59:0/231528280 shutdown_connections 2024-05-30T17:02:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.002+0000 7fd16aa00640 1 -- 172.21.15.59:0/231528280 wait complete. 2024-05-30T17:02:56.017 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-05-30T17:02:56.010+0000 7f54a2a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T17:02:56.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T17:02:56.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f0637400640 1 Processor -- start 2024-05-30T17:02:56.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f0637400640 1 -- start start 2024-05-30T17:02:56.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f0637400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06300d05b0 0x7f063009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:56.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f0637400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0630070950 con 0x7f06300d14c0 2024-05-30T17:02:56.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f0637400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0630070c30 con 0x7f063009af80 2024-05-30T17:02:56.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f0637400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f063009b3f0 con 0x7f06300d05b0 2024-05-30T17:02:56.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f0634a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f06300d14c0 0x7f063006e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41616/0 (socket says 172.21.15.59:41616) 2024-05-30T17:02:56.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f0634a00640 1 -- 172.21.15.59:0/611801711 learned_addr learned my addr 172.21.15.59:0/611801711 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:56.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f062fe00640 1 --2- 172.21.15.59:0/611801711 >> v2:172.21.15.59:3300/0 conn(0x7f06300d05b0 0x7f063009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f062f400640 1 -- 172.21.15.59:0/611801711 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045975899 0 0) 0x7f0630070950 con 0x7f06300d14c0 2024-05-30T17:02:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f062f400640 1 -- 172.21.15.59:0/611801711 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0618003530 con 0x7f06300d14c0 2024-05-30T17:02:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f062fe00640 1 -- 172.21.15.59:0/611801711 >> v1:172.21.15.107:6789/0 conn(0x7f063009af80 legacy=0x7f063006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f062fe00640 1 -- 172.21.15.59:0/611801711 >> v1:172.21.15.59:6789/0 conn(0x7f06300d14c0 legacy=0x7f063006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.166+0000 7f062fe00640 1 -- 172.21.15.59:0/611801711 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0630070f10 con 0x7f06300d05b0 2024-05-30T17:02:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.170+0000 7f062fe00640 1 --2- 172.21.15.59:0/611801711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06300d05b0 0x7f063009aa40 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f061c0097c0 tx=0x7f061c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f10fd440c8a3f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.170+0000 7f062f400640 1 -- 172.21.15.59:0/611801711 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c0ab430 con 0x7f06300d05b0 2024-05-30T17:02:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.170+0000 7f062f400640 1 -- 172.21.15.59:0/611801711 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f061c0b0070 con 0x7f06300d05b0 2024-05-30T17:02:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.170+0000 7f062f400640 1 -- 172.21.15.59:0/611801711 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c0ab7f0 con 0x7f06300d05b0 2024-05-30T17:02:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.170+0000 7f0637400640 1 -- 172.21.15.59:0/611801711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06300d05b0 msgr2=0x7f063009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.170+0000 7f0637400640 1 --2- 172.21.15.59:0/611801711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06300d05b0 0x7f063009aa40 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f061c0097c0 tx=0x7f061c01c470 comp rx=0 tx=0).stop 2024-05-30T17:02:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.170+0000 7f0637400640 1 -- 172.21.15.59:0/611801711 shutdown_connections 2024-05-30T17:02:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.170+0000 7f0637400640 1 --2- 172.21.15.59:0/611801711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06300d05b0 0x7f063009aa40 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.170+0000 7f0637400640 1 -- 172.21.15.59:0/611801711 >> 172.21.15.59:0/611801711 conn(0x7f06300b3f80 msgr2=0x7f06300b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:56.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.170+0000 7f0637400640 1 -- 172.21.15.59:0/611801711 shutdown_connections 2024-05-30T17:02:56.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.170+0000 7f0637400640 1 -- 172.21.15.59:0/611801711 wait complete. 2024-05-30T17:02:56.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.170+0000 7f0637400640 1 Processor -- start 2024-05-30T17:02:56.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0637400640 1 -- start start 2024-05-30T17:02:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0637400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f063009af80 0x7f0630158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0637400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06300d05b0 0x7f06300c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0637400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06300d14c0 0x7f06300cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0637400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f063006e010 con 0x7f06300d05b0 2024-05-30T17:02:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0637400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f06300d18a0 con 0x7f06300d14c0 2024-05-30T17:02:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0637400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f063006e190 con 0x7f063009af80 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f062fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06300d05b0 0x7f06300c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f062fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06300d05b0 0x7f06300c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34266/0 (socket says 172.21.15.59:34266) 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f062fe00640 1 -- 172.21.15.59:0/818520046 learned_addr learned my addr 172.21.15.59:0/818520046 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0634a00640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f063009af80 0x7f0630158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0635400640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06300d14c0 0x7f06300cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f062fe00640 1 -- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f063009af80 msgr2=0x7f0630158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f062fe00640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f063009af80 0x7f0630158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f062fe00640 1 -- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06300d14c0 msgr2=0x7f06300cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f062fe00640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06300d14c0 0x7f06300cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f062fe00640 1 -- 172.21.15.59:0/818520046 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06300c62f0 con 0x7f06300d05b0 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0635400640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06300d14c0 0x7f06300cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f062fe00640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06300d05b0 0x7f06300c7390 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f061c01a0a0 tx=0x7f061c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f062cc00640 1 -- 172.21.15.59:0/818520046 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c0bf610 con 0x7f06300d05b0 2024-05-30T17:02:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f062cc00640 1 -- 172.21.15.59:0/818520046 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f061c0bf7b0 con 0x7f06300d05b0 2024-05-30T17:02:56.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0637400640 1 -- 172.21.15.59:0/818520046 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06300c65d0 con 0x7f06300d05b0 2024-05-30T17:02:56.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f062cc00640 1 -- 172.21.15.59:0/818520046 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c0bfba0 con 0x7f06300d05b0 2024-05-30T17:02:56.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0637400640 1 -- 172.21.15.59:0/818520046 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06300c6b90 con 0x7f06300d05b0 2024-05-30T17:02:56.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.174+0000 7f0637400640 1 -- 172.21.15.59:0/818520046 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0630068a90 con 0x7f06300d05b0 2024-05-30T17:02:56.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.178+0000 7f062cc00640 1 -- 172.21.15.59:0/818520046 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f061c0bd020 con 0x7f06300d05b0 2024-05-30T17:02:56.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.178+0000 7f062cc00640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0610069b20 0x7f061006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:56.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.178+0000 7f062cc00640 1 -- 172.21.15.59:0/818520046 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f061c0a8030 con 0x7f06300d05b0 2024-05-30T17:02:56.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.178+0000 7f0634a00640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0610069b20 0x7f061006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:56.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.178+0000 7f0634a00640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0610069b20 0x7f061006bfe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f06240011f0 tx=0x7f0624007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.182+0000 7f062cc00640 1 -- 172.21.15.59:0/818520046 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f061c0c4060 con 0x7f06300d05b0 2024-05-30T17:02:56.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.382+0000 7f0637400640 1 -- 172.21.15.59:0/818520046 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f06300d2270 con 0x7f06300d05b0 2024-05-30T17:02:56.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.382+0000 7f062cc00640 1 -- 172.21.15.59:0/818520046 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) ==== 53+0+73 (secure 0 0 0) 0x7f061c016090 con 0x7f06300d05b0 2024-05-30T17:02:56.387 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T17:02:56.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.386+0000 7f0637400640 1 -- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0610069b20 msgr2=0x7f061006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:56.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.386+0000 7f0637400640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0610069b20 0x7f061006bfe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f06240011f0 tx=0x7f0624007d40 comp rx=0 tx=0).stop 2024-05-30T17:02:56.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.386+0000 7f0637400640 1 -- 172.21.15.59:0/818520046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06300d05b0 msgr2=0x7f06300c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:56.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.386+0000 7f0637400640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06300d05b0 0x7f06300c7390 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f061c01a0a0 tx=0x7f061c01acb0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.386+0000 7f0637400640 1 -- 172.21.15.59:0/818520046 shutdown_connections 2024-05-30T17:02:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.386+0000 7f0637400640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0610069b20 0x7f061006bfe0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.386+0000 7f0637400640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06300d14c0 0x7f06300cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.386+0000 7f0637400640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06300d05b0 0x7f06300c7390 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.386+0000 7f0637400640 1 --2- 172.21.15.59:0/818520046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f063009af80 0x7f0630158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.386+0000 7f0637400640 1 -- 172.21.15.59:0/818520046 >> 172.21.15.59:0/818520046 conn(0x7f06300b3f80 msgr2=0x7f06300d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.386+0000 7f0637400640 1 -- 172.21.15.59:0/818520046 shutdown_connections 2024-05-30T17:02:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56.386+0000 7f0637400640 1 -- 172.21.15.59:0/818520046 wait complete. 2024-05-30T17:02:56.409 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T17:02:56.409 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T17:02:56.409 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-05-30T17:02:56.409 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T17:02:56.409 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T17:02:56.409 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T17:02:56.409 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T17:02:56.409 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T17:02:56.409 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T17:02:56.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:56.409 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-05-30T17:02:56.418 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T17:02:56.418 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T17:02:56.418 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-05-30T17:02:56.419 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41613sec preferred_lft 41613sec 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:46:82:05:9a brd ff:ff:ff:ff:ff:ff 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T17:02:56.420 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:02:56.421 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T17:02:56.421 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:02:56.421 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T17:02:56.421 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:02:56.421 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T17:02:56.421 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:02:56.421 INFO:teuthology.orchestra.run.smithi059.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T17:02:56.421 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:02:56.421 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T17:02:56.421 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:02:56.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:56.425 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T17:02:56.485 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-05-30T17:02:56.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:56.487 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-05-30T17:02:56.545 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-05-30T17:02:56.545 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T17:02:56.545 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T17:02:56.545 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T17:02:56.545 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T17:02:56.546 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T17:02:56.546 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T17:02:56.546 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T17:02:56.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T17:02:56.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T17:02:56.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T17:02:56.546 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T17:02:56.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T17:02:56.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T17:02:56.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:56.684 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-05-30T17:02:56.741 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T17:02:56.741 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T17:02:56.741 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T17:02:56.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:56.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-05-30T17:02:56.803 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-30T17:02:56.803 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T17:02:56.804 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T17:02:56.859 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T17:02:56.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T17:02:56.860 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T17:02:56.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T17:02:56.975 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T17:02:57.029 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T17:02:57.029 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T17:02:57.029 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T17:02:57.029 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T17:02:57.029 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T17:02:57.029 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T17:02:57.029 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T17:02:57.029 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T17:02:57.029 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T17:02:57.030 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T17:02:57.031 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T17:02:57.031 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T17:02:57.031 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T17:02:57.031 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T17:02:57.031 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T17:02:57.031 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T17:02:57.031 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T17:02:57.031 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:02:57.031 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:02:57.031 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:02:57.031 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:02:57.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:57.032 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T17:02:57.087 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-30T17:02:57.087 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-30T17:02:57.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T17:02:57.155 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T17:02:57.209 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T17:02:57.209 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T17:02:57.209 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T17:02:57.209 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T17:02:57.209 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T17:02:57.209 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T17:02:57.209 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T17:02:57.209 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T17:02:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T17:02:57.211 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T17:02:57.211 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T17:02:57.211 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T17:02:57.211 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T17:02:57.211 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T17:02:57.211 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T17:02:57.211 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T17:02:57.211 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T17:02:57.211 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:02:57.211 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:02:57.211 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:02:57.211 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:02:57.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:57.212 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T17:02:57.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:2024-05-30T17:02:57.226+0000 7fbd8b433580 -1 init, newargv = 0x55e33003b6f0 newargc=15 2024-05-30T17:02:57.231 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[49753]: starting ceph client 2024-05-30T17:02:57.237 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[49753]: starting fuse 2024-05-30T17:02:57.240 INFO:teuthology.orchestra.run.smithi059.stdout:44 2024-05-30T17:02:57.240 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> import re 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2024-05-30T17:02:57.241 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2024-05-30T17:02:57.242 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T17:02:57.242 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2024-05-30T17:02:57.242 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-30T17:02:57.242 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-30T17:02:57.242 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-30T17:02:57.242 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2024-05-30T17:02:57.242 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2024-05-30T17:02:57.242 DEBUG:teuthology.orchestra.run.smithi059:> return f 2024-05-30T17:02:57.242 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-30T17:02:57.242 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T17:02:57.242 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.0")) 2024-05-30T17:02:57.242 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-05-30T17:02:57.370 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.0.49753.asok 2024-05-30T17:02:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T17:02:57.381 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49753.asok 2024-05-30T17:02:57.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:57.382 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49753.asok status 2024-05-30T17:02:57.559 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:02:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2024-05-30T17:02:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "9ed025fbf4406fb54980a0647506b15895b6d863", 2024-05-30T17:02:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-3154-g9ed025fb (9ed025fbf4406fb54980a0647506b15895b6d863) squid (dev)", 2024-05-30T17:02:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "0", 2024-05-30T17:02:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2024-05-30T17:02:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-30T17:02:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "49753", 2024-05-30T17:02:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2024-05-30T17:02:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2024-05-30T17:02:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2024-05-30T17:02:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8628, 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 8628 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2994583983 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T17:02:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2994583983 2024-05-30T17:02:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:02:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.8628 192.168.0.1:0/2994583983", 2024-05-30T17:02:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/2994583983", 2024-05-30T17:02:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2024-05-30T17:02:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 71, 2024-05-30T17:02:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 116, 2024-05-30T17:02:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2024-05-30T17:02:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2024-05-30T17:02:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2024-05-30T17:02:57.562 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:02:57.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:57.575 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2024-05-30T17:02:57.575 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-30T17:02:57.584 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2024-05-30T17:02:57.585 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-30T17:02:57.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:02:57.585 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T17:02:57.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T17:02:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9bab000640 1 Processor -- start 2024-05-30T17:02:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9bab000640 1 -- start start 2024-05-30T17:02:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9bab000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ba40b43e0 0x7f9ba406f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9bab000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ba406b9b0 0x7f9ba406be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9bab000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba406e8a0 con 0x7f9ba4148360 2024-05-30T17:02:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9bab000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9ba406e650 con 0x7f9ba406b9b0 2024-05-30T17:02:57.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9bab000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba406f4b0 con 0x7f9ba40b43e0 2024-05-30T17:02:57.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9ba9000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ba406b9b0 0x7f9ba406be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:57.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9ba3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9ba4148360 0x7f9ba4072ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41618/0 (socket says 172.21.15.59:41618) 2024-05-30T17:02:57.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9ba3e00640 1 -- 172.21.15.59:0/4224931818 learned_addr learned my addr 172.21.15.59:0/4224931818 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:57.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9b9be00640 1 --2- 172.21.15.59:0/4224931818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ba40b43e0 0x7f9ba406f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9ba3400640 1 -- 172.21.15.59:0/4224931818 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1704541815 0 0) 0x7f9ba406e8a0 con 0x7f9ba4148360 2024-05-30T17:02:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9ba3400640 1 -- 172.21.15.59:0/4224931818 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b88003530 con 0x7f9ba4148360 2024-05-30T17:02:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9ba9000640 1 -- 172.21.15.59:0/4224931818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ba40b43e0 msgr2=0x7f9ba406f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9ba9000640 1 --2- 172.21.15.59:0/4224931818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ba40b43e0 0x7f9ba406f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9ba9000640 1 -- 172.21.15.59:0/4224931818 >> v1:172.21.15.59:6789/0 conn(0x7f9ba4148360 legacy=0x7f9ba4072ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9ba9000640 1 -- 172.21.15.59:0/4224931818 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba406eb80 con 0x7f9ba406b9b0 2024-05-30T17:02:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.838+0000 7f9b9be00640 1 --2- 172.21.15.59:0/4224931818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ba40b43e0 0x7f9ba406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9ba9000640 1 --2- 172.21.15.59:0/4224931818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba406b9b0 0x7f9ba406be40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009d90 tx=0x7f9b9c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aada1e3300ab0f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9ba3400640 1 -- 172.21.15.59:0/4224931818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0b2070 con 0x7f9ba406b9b0 2024-05-30T17:02:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9ba3400640 1 -- 172.21.15.59:0/4224931818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c0a5830 con 0x7f9ba406b9b0 2024-05-30T17:02:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9ba3400640 1 -- 172.21.15.59:0/4224931818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0a5c00 con 0x7f9ba406b9b0 2024-05-30T17:02:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 -- 172.21.15.59:0/4224931818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba406b9b0 msgr2=0x7f9ba406be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 --2- 172.21.15.59:0/4224931818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba406b9b0 0x7f9ba406be40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009d90 tx=0x7f9b9c01c970 comp rx=0 tx=0).stop 2024-05-30T17:02:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 -- 172.21.15.59:0/4224931818 shutdown_connections 2024-05-30T17:02:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 --2- 172.21.15.59:0/4224931818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba406b9b0 0x7f9ba406be40 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 --2- 172.21.15.59:0/4224931818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ba40b43e0 0x7f9ba406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 -- 172.21.15.59:0/4224931818 >> 172.21.15.59:0/4224931818 conn(0x7f9ba40b2560 msgr2=0x7f9ba40b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 -- 172.21.15.59:0/4224931818 shutdown_connections 2024-05-30T17:02:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 -- 172.21.15.59:0/4224931818 wait complete. 2024-05-30T17:02:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 Processor -- start 2024-05-30T17:02:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 -- start start 2024-05-30T17:02:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ba406b9b0 0x7f9ba415e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba40b43e0 0x7f9ba4146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba4148360 0x7f9ba4142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40ae380 con 0x7f9ba40b43e0 2024-05-30T17:02:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40ae200 con 0x7f9ba4148360 2024-05-30T17:02:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba40ae500 con 0x7f9ba406b9b0 2024-05-30T17:02:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9b9be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba40b43e0 0x7f9ba4146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9b9be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba40b43e0 0x7f9ba4146fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34284/0 (socket says 172.21.15.59:34284) 2024-05-30T17:02:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9b9be00640 1 -- 172.21.15.59:0/1126728013 learned_addr learned my addr 172.21.15.59:0/1126728013 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:57.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9ba3e00640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ba406b9b0 0x7f9ba415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:57.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9ba9000640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba4148360 0x7f9ba4142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:57.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9b9be00640 1 -- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ba406b9b0 msgr2=0x7f9ba415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:57.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9b9be00640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ba406b9b0 0x7f9ba415e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9b9be00640 1 -- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba4148360 msgr2=0x7f9ba4142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9b9be00640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba4148360 0x7f9ba4142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9b9be00640 1 -- 172.21.15.59:0/1126728013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba4160b80 con 0x7f9ba40b43e0 2024-05-30T17:02:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9b9be00640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba40b43e0 0x7f9ba4146fb0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00e840 tx=0x7f9b8c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9ba0c00640 1 -- 172.21.15.59:0/1126728013 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c017070 con 0x7f9ba40b43e0 2024-05-30T17:02:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9ba0c00640 1 -- 172.21.15.59:0/1126728013 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00c6d0 con 0x7f9ba40b43e0 2024-05-30T17:02:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 -- 172.21.15.59:0/1126728013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba4160e60 con 0x7f9ba40b43e0 2024-05-30T17:02:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9ba0c00640 1 -- 172.21.15.59:0/1126728013 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00f040 con 0x7f9ba40b43e0 2024-05-30T17:02:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 -- 172.21.15.59:0/1126728013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba40cd410 con 0x7f9ba40b43e0 2024-05-30T17:02:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.846+0000 7f9bab000640 1 -- 172.21.15.59:0/1126728013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba4068a90 con 0x7f9ba40b43e0 2024-05-30T17:02:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.850+0000 7f9ba0c00640 1 -- 172.21.15.59:0/1126728013 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f9b8c01a070 con 0x7f9ba40b43e0 2024-05-30T17:02:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.850+0000 7f9ba0c00640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9b80069b20 0x7f9b8006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.850+0000 7f9ba0c00640 1 -- 172.21.15.59:0/1126728013 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f9b8c0853d0 con 0x7f9ba40b43e0 2024-05-30T17:02:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.850+0000 7f9ba3e00640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9b80069b20 0x7f9b8006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.850+0000 7f9ba3e00640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9b80069b20 0x7f9b8006bfe0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9b94005890 tx=0x7f9b94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:57.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:57.858+0000 7f9ba0c00640 1 -- 172.21.15.59:0/1126728013 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b8c0573f0 con 0x7f9ba40b43e0 2024-05-30T17:02:58.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.058+0000 7f9bab000640 1 -- 172.21.15.59:0/1126728013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f9ba406c7d0 con 0x7f9ba40b43e0 2024-05-30T17:02:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9ba0c00640 1 -- 172.21.15.59:0/1126728013 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v72) ==== 136+0+0 (secure 0 0 0) 0x7f9b8c056cf0 con 0x7f9ba40b43e0 2024-05-30T17:02:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9bab000640 1 -- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9b80069b20 msgr2=0x7f9b8006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9bab000640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9b80069b20 0x7f9b8006bfe0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9b94005890 tx=0x7f9b94009040 comp rx=0 tx=0).stop 2024-05-30T17:02:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9bab000640 1 -- 172.21.15.59:0/1126728013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba40b43e0 msgr2=0x7f9ba4146fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9bab000640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba40b43e0 0x7f9ba4146fb0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00e840 tx=0x7f9b8c00ed00 comp rx=0 tx=0).stop 2024-05-30T17:02:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9bab000640 1 -- 172.21.15.59:0/1126728013 shutdown_connections 2024-05-30T17:02:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9bab000640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9b80069b20 0x7f9b8006bfe0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9bab000640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba4148360 0x7f9ba4142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9bab000640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba40b43e0 0x7f9ba4146fb0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9bab000640 1 --2- 172.21.15.59:0/1126728013 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ba406b9b0 0x7f9ba415e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9bab000640 1 -- 172.21.15.59:0/1126728013 >> 172.21.15.59:0/1126728013 conn(0x7f9ba40b2560 msgr2=0x7f9ba40b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9bab000640 1 -- 172.21.15.59:0/1126728013 shutdown_connections 2024-05-30T17:02:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.090+0000 7f9bab000640 1 -- 172.21.15.59:0/1126728013 wait complete. 2024-05-30T17:02:58.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17f5000640 1 Processor -- start 2024-05-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17f5000640 1 -- start start 2024-05-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17f5000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0161bf0 0x7f17f015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17f5000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f17f015f030 0x7f17f015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17f5000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f01627a0 con 0x7f17f015e710 2024-05-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17f5000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f17f00d0660 con 0x7f17f015f030 2024-05-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17f5000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f17f00d1aa0 con 0x7f17f0161bf0 2024-05-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ede00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f17f015e710 0x7f17f01614e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41622/0 (socket says 172.21.15.59:41622) 2024-05-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ede00640 1 -- 172.21.15.59:0/1312594990 learned_addr learned my addr 172.21.15.59:0/1312594990 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3478340741 0 0) 0x7f17f01627a0 con 0x7f17f015e710 2024-05-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ee800640 1 --2- 172.21.15.59:0/1312594990 >> v2:172.21.15.107:3300/0 conn(0x7f17f015f030 0x7f17f015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17d4003530 con 0x7f17f015e710 2024-05-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17e7e00640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0161bf0 0x7f17f015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1693819583 0 0) 0x7f17d4003530 con 0x7f17f015e710 2024-05-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0161bf0 msgr2=0x7f17f015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0161bf0 0x7f17f015eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 >> v2:172.21.15.107:3300/0 conn(0x7f17f015f030 msgr2=0x7f17f015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 --2- 172.21.15.59:0/1312594990 >> v2:172.21.15.107:3300/0 conn(0x7f17f015f030 0x7f17f015f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f0162a80 con 0x7f17f015e710 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f17e0001680 con 0x7f17f015e710 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 >> v1:172.21.15.59:6789/0 conn(0x7f17f015e710 legacy=0x7f17f01614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17d40039c0 0x7f17d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d4004810 0x7f17d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0161bf0 0x7f17d40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f17d400b9d0 con 0x7f17d4004810 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f17d400bb50 con 0x7f17d40039c0 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f17d400bcd0 con 0x7f17f0161bf0 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17e7e00640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d4004810 0x7f17d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ede00640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17d40039c0 0x7f17d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ee800640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0161bf0 0x7f17d40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17e7e00640 1 -- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0161bf0 msgr2=0x7f17d40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17e7e00640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0161bf0 0x7f17d40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17e7e00640 1 -- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17d40039c0 msgr2=0x7f17d4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17e7e00640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17d40039c0 0x7f17d4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17e7e00640 1 -- 172.21.15.59:0/1312594990 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d4003530 con 0x7f17d4004810 2024-05-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ee800640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0161bf0 0x7f17d40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.254+0000 7f17ede00640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17d40039c0 0x7f17d4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.258+0000 7f17e7e00640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d4004810 0x7f17d4004c90 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f17d8009ae0 tx=0x7f17d801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c514df5526546837 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.258+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d80b2070 con 0x7f17d4004810 2024-05-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.258+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d80a5580 con 0x7f17d4004810 2024-05-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.258+0000 7f17ed400640 1 -- 172.21.15.59:0/1312594990 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d80096b0 con 0x7f17d4004810 2024-05-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.258+0000 7f17f5000640 1 -- 172.21.15.59:0/1312594990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d4004810 msgr2=0x7f17d4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.258+0000 7f17f5000640 1 --2- 172.21.15.59:0/1312594990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d4004810 0x7f17d4004c90 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f17d8009ae0 tx=0x7f17d801ca70 comp rx=0 tx=0).stop 2024-05-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.258+0000 7f17ee800640 1 -- 172.21.15.59:0/1312594990 reap_dead start 2024-05-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.258+0000 7f17f5000640 1 -- 172.21.15.59:0/1312594990 shutdown_connections 2024-05-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.258+0000 7f17f5000640 1 -- 172.21.15.59:0/1312594990 >> 172.21.15.59:0/1312594990 conn(0x7f17f00b3f50 msgr2=0x7f17f00b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.258+0000 7f17f5000640 1 -- 172.21.15.59:0/1312594990 shutdown_connections 2024-05-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.258+0000 7f17f5000640 1 -- 172.21.15.59:0/1312594990 wait complete. 2024-05-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17f5000640 1 Processor -- start 2024-05-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17f5000640 1 -- start start 2024-05-30T17:02:58.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17f5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d4004810 0x7f17f0150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17f5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17f00b29b0 0x7f17f00b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17f5000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0150b50 0x7f17f01f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17f5000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f17f0162070 con 0x7f17d4004810 2024-05-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17f5000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f17f0163040 con 0x7f17f00b29b0 2024-05-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17f5000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f17f01601a0 con 0x7f17f0150b50 2024-05-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17ede00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d4004810 0x7f17f0150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17ede00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d4004810 0x7f17f0150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34296/0 (socket says 172.21.15.59:34296) 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17ede00640 1 -- 172.21.15.59:0/3237690728 learned_addr learned my addr 172.21.15.59:0/3237690728 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17e7e00640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17f00b29b0 0x7f17f00b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17ee800640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0150b50 0x7f17f01f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17ede00640 1 -- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0150b50 msgr2=0x7f17f01f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17ede00640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0150b50 0x7f17f01f4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17ede00640 1 -- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17f00b29b0 msgr2=0x7f17f00b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17ede00640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17f00b29b0 0x7f17f00b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17ede00640 1 -- 172.21.15.59:0/3237690728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f00b1910 con 0x7f17d4004810 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17ede00640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d4004810 0x7f17f0150610 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f17e0001840 tx=0x7f17e00126f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17e6000640 1 -- 172.21.15.59:0/3237690728 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e001c070 con 0x7f17d4004810 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17e6000640 1 -- 172.21.15.59:0/3237690728 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e0014750 con 0x7f17d4004810 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17e6000640 1 -- 172.21.15.59:0/3237690728 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e0014b00 con 0x7f17d4004810 2024-05-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17f5000640 1 -- 172.21.15.59:0/3237690728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f00b1bf0 con 0x7f17d4004810 2024-05-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.262+0000 7f17f5000640 1 -- 172.21.15.59:0/3237690728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f00b21b0 con 0x7f17d4004810 2024-05-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.266+0000 7f17f5000640 1 -- 172.21.15.59:0/3237690728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f00d33a0 con 0x7f17d4004810 2024-05-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.266+0000 7f17e6000640 1 -- 172.21.15.59:0/3237690728 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f17e0014ca0 con 0x7f17d4004810 2024-05-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.266+0000 7f17e6000640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f17cc069b20 0x7f17cc06bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.266+0000 7f17e6000640 1 -- 172.21.15.59:0/3237690728 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f17e0088060 con 0x7f17d4004810 2024-05-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.266+0000 7f17e7e00640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f17cc069b20 0x7f17cc06bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.266+0000 7f17e7e00640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f17cc069b20 0x7f17cc06bfe0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f17d80af000 tx=0x7f17d80046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:58.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.270+0000 7f17e6000640 1 -- 172.21.15.59:0/3237690728 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f17e0059af0 con 0x7f17d4004810 2024-05-30T17:02:58.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.458+0000 7f17f5000640 1 -- 172.21.15.59:0/3237690728 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f17f0068a90 con 0x7f17cc069b20 2024-05-30T17:02:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.458+0000 7f17e6000640 1 -- 172.21.15.59:0/3237690728 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f17f0068a90 con 0x7f17cc069b20 2024-05-30T17:02:58.462 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:02:58.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:02:58.463 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T17:02:58.463 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:02:58.463 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:02:58.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.462+0000 7f17f5000640 1 -- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f17cc069b20 msgr2=0x7f17cc06bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.462+0000 7f17f5000640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f17cc069b20 0x7f17cc06bfe0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f17d80af000 tx=0x7f17d80046d0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.462+0000 7f17f5000640 1 -- 172.21.15.59:0/3237690728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d4004810 msgr2=0x7f17f0150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.462+0000 7f17f5000640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d4004810 0x7f17f0150610 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f17e0001840 tx=0x7f17e00126f0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.462+0000 7f17f5000640 1 -- 172.21.15.59:0/3237690728 shutdown_connections 2024-05-30T17:02:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.462+0000 7f17f5000640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f17cc069b20 0x7f17cc06bfe0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.462+0000 7f17f5000640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17f0150b50 0x7f17f01f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.462+0000 7f17f5000640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17f00b29b0 0x7f17f00b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.462+0000 7f17f5000640 1 --2- 172.21.15.59:0/3237690728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d4004810 0x7f17f0150610 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.462+0000 7f17f5000640 1 -- 172.21.15.59:0/3237690728 >> 172.21.15.59:0/3237690728 conn(0x7f17f00b3f50 msgr2=0x7f17f00b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.462+0000 7f17f5000640 1 -- 172.21.15.59:0/3237690728 shutdown_connections 2024-05-30T17:02:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.462+0000 7f17f5000640 1 -- 172.21.15.59:0/3237690728 wait complete. 2024-05-30T17:02:58.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T17:02:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.626+0000 7fd7cf200640 1 Processor -- start 2024-05-30T17:02:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.626+0000 7fd7cf200640 1 -- start start 2024-05-30T17:02:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7cf200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd7c8159100 0x7fd7c806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7cf200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd7c815c010 0x7fd7c815c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7cf200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c80b52d0 con 0x7fd7c80b44e0 2024-05-30T17:02:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7cf200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c80b4a30 con 0x7fd7c815c010 2024-05-30T17:02:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7cf200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c80b4d10 con 0x7fd7c8159100 2024-05-30T17:02:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7cd200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd7c815c010 0x7fd7c815c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7cd200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd7c815c010 0x7fd7c815c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34308/0 (socket says 172.21.15.59:34308) 2024-05-30T17:02:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7cd200640 1 -- 172.21.15.59:0/4117842510 learned_addr learned my addr 172.21.15.59:0/4117842510 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7c7e00640 1 --2- 172.21.15.59:0/4117842510 >> v2:172.21.15.107:3300/0 conn(0x7fd7c8159100 0x7fd7c806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7cd200640 1 -- 172.21.15.59:0/4117842510 >> v2:172.21.15.107:3300/0 conn(0x7fd7c8159100 msgr2=0x7fd7c806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7cd200640 1 --2- 172.21.15.59:0/4117842510 >> v2:172.21.15.107:3300/0 conn(0x7fd7c8159100 0x7fd7c806e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7cd200640 1 -- 172.21.15.59:0/4117842510 >> v1:172.21.15.107:6789/0 conn(0x7fd7c80b44e0 legacy=0x7fd7c815efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.630+0000 7fd7cd200640 1 -- 172.21.15.59:0/4117842510 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c80b4ff0 con 0x7fd7c815c010 2024-05-30T17:02:58.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7cd200640 1 --2- 172.21.15.59:0/4117842510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c815c010 0x7fd7c815c440 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fd7c806c8f0 tx=0x7fd7c001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2bdee7cdbf8496 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:58.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7c7400640 1 -- 172.21.15.59:0/4117842510 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00b0070 con 0x7fd7c815c010 2024-05-30T17:02:58.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7c7400640 1 -- 172.21.15.59:0/4117842510 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c00ab600 con 0x7fd7c815c010 2024-05-30T17:02:58.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7c7400640 1 -- 172.21.15.59:0/4117842510 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00ab9d0 con 0x7fd7c815c010 2024-05-30T17:02:58.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7cf200640 1 -- 172.21.15.59:0/4117842510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c815c010 msgr2=0x7fd7c815c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7cf200640 1 --2- 172.21.15.59:0/4117842510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c815c010 0x7fd7c815c440 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fd7c806c8f0 tx=0x7fd7c001c450 comp rx=0 tx=0).stop 2024-05-30T17:02:58.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7cf200640 1 -- 172.21.15.59:0/4117842510 shutdown_connections 2024-05-30T17:02:58.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7cf200640 1 --2- 172.21.15.59:0/4117842510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c815c010 0x7fd7c815c440 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7cf200640 1 --2- 172.21.15.59:0/4117842510 >> v2:172.21.15.107:3300/0 conn(0x7fd7c8159100 0x7fd7c806e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7cf200640 1 -- 172.21.15.59:0/4117842510 >> 172.21.15.59:0/4117842510 conn(0x7fd7c806bdb0 msgr2=0x7fd7c806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:58.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7cf200640 1 -- 172.21.15.59:0/4117842510 shutdown_connections 2024-05-30T17:02:58.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7cf200640 1 -- 172.21.15.59:0/4117842510 wait complete. 2024-05-30T17:02:58.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7cf200640 1 Processor -- start 2024-05-30T17:02:58.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7cf200640 1 -- start start 2024-05-30T17:02:58.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.634+0000 7fd7cf200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c80b44e0 0x7fd7c80cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7cf200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c8159100 0x7fd7c8145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7cf200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c815c010 0x7fd7c814f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7cf200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c81662b0 con 0x7fd7c8159100 2024-05-30T17:02:58.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7cf200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c8166130 con 0x7fd7c80b44e0 2024-05-30T17:02:58.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7cf200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c8166430 con 0x7fd7c815c010 2024-05-30T17:02:58.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7bf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c8159100 0x7fd7c8145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7bf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c8159100 0x7fd7c8145860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34318/0 (socket says 172.21.15.59:34318) 2024-05-30T17:02:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7bf400640 1 -- 172.21.15.59:0/3209485277 learned_addr learned my addr 172.21.15.59:0/3209485277 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7c7e00640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c80b44e0 0x7fd7c80cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7cd200640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c815c010 0x7fd7c814f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7bf400640 1 -- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c815c010 msgr2=0x7fd7c814f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7bf400640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c815c010 0x7fd7c814f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7bf400640 1 -- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c80b44e0 msgr2=0x7fd7c80cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7bf400640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c80b44e0 0x7fd7c80cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7bf400640 1 -- 172.21.15.59:0/3209485277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c814fce0 con 0x7fd7c8159100 2024-05-30T17:02:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7cd200640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c815c010 0x7fd7c814f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7c7e00640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c80b44e0 0x7fd7c80cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7bf400640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c8159100 0x7fd7c8145860 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000c450 tx=0x7fd7b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7c4c00640 1 -- 172.21.15.59:0/3209485277 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0011790 con 0x7fd7c8159100 2024-05-30T17:02:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7c4c00640 1 -- 172.21.15.59:0/3209485277 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b0017070 con 0x7fd7c8159100 2024-05-30T17:02:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7c4c00640 1 -- 172.21.15.59:0/3209485277 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0011b90 con 0x7fd7c8159100 2024-05-30T17:02:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7cf200640 1 -- 172.21.15.59:0/3209485277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c814ffc0 con 0x7fd7c8159100 2024-05-30T17:02:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7cf200640 1 -- 172.21.15.59:0/3209485277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c80b0470 con 0x7fd7c8159100 2024-05-30T17:02:58.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7cf200640 1 -- 172.21.15.59:0/3209485277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c8068a90 con 0x7fd7c8159100 2024-05-30T17:02:58.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.638+0000 7fd7c4c00640 1 -- 172.21.15.59:0/3209485277 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fd7b0011d30 con 0x7fd7c8159100 2024-05-30T17:02:58.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.642+0000 7fd7c4c00640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7a4069b20 0x7fd7a406bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.642+0000 7fd7c4c00640 1 -- 172.21.15.59:0/3209485277 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7fd7b00855b0 con 0x7fd7c8159100 2024-05-30T17:02:58.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.642+0000 7fd7c7e00640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7a4069b20 0x7fd7a406bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.642+0000 7fd7c7e00640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7a4069b20 0x7fd7a406bfe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8003fd0 tx=0x7fd7b80039e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:58.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.646+0000 7fd7c4c00640 1 -- 172.21.15.59:0/3209485277 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd7b0057650 con 0x7fd7c8159100 2024-05-30T17:02:58.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.810+0000 7fd7cf200640 1 -- 172.21.15.59:0/3209485277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd7c80cc800 con 0x7fd7c8159100 2024-05-30T17:02:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.810+0000 7fd7c4c00640 1 -- 172.21.15.59:0/3209485277 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fd7b0056f50 con 0x7fd7c8159100 2024-05-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.814+0000 7fd7cf200640 1 -- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7a4069b20 msgr2=0x7fd7a406bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.814+0000 7fd7cf200640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7a4069b20 0x7fd7a406bfe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8003fd0 tx=0x7fd7b80039e0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.814+0000 7fd7cf200640 1 -- 172.21.15.59:0/3209485277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c8159100 msgr2=0x7fd7c8145860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.814+0000 7fd7cf200640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c8159100 0x7fd7c8145860 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000c450 tx=0x7fd7b000c910 comp rx=0 tx=0).stop 2024-05-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.814+0000 7fd7cf200640 1 -- 172.21.15.59:0/3209485277 shutdown_connections 2024-05-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.814+0000 7fd7cf200640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7a4069b20 0x7fd7a406bfe0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.814+0000 7fd7cf200640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c815c010 0x7fd7c814f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.814+0000 7fd7cf200640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c8159100 0x7fd7c8145860 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.814+0000 7fd7cf200640 1 --2- 172.21.15.59:0/3209485277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c80b44e0 0x7fd7c80cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.814+0000 7fd7cf200640 1 -- 172.21.15.59:0/3209485277 >> 172.21.15.59:0/3209485277 conn(0x7fd7c806bdb0 msgr2=0x7fd7c806c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.814+0000 7fd7cf200640 1 -- 172.21.15.59:0/3209485277 shutdown_connections 2024-05-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.814+0000 7fd7cf200640 1 -- 172.21.15.59:0/3209485277 wait complete. 2024-05-30T17:02:58.832 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T17:02:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7978600640 1 Processor -- start 2024-05-30T17:02:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7978600640 1 -- start start 2024-05-30T17:02:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7978600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7970156e40 0x7f797006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7978600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f797006dc60 0x7f797015d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7978600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79700af130 0x7f79700af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7978600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f797015db80 con 0x7f797006dc60 2024-05-30T17:02:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7978600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f797006e120 con 0x7f79700af130 2024-05-30T17:02:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7978600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f797006e400 con 0x7f7970156e40 2024-05-30T17:02:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7975200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f797006dc60 0x7f797015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7975200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f797006dc60 0x7f797015d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34324/0 (socket says 172.21.15.59:34324) 2024-05-30T17:02:58.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7975200640 1 -- 172.21.15.59:0/3032469341 learned_addr learned my addr 172.21.15.59:0/3032469341 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:58.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7975c00640 1 --2- 172.21.15.59:0/3032469341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7970156e40 0x7f797006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7976600640 1 --2- 172.21.15.59:0/3032469341 >> v2:172.21.15.107:3300/0 conn(0x7f79700af130 0x7f79700af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7975200640 1 -- 172.21.15.59:0/3032469341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7970156e40 msgr2=0x7f797006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:58.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7975200640 1 --2- 172.21.15.59:0/3032469341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7970156e40 0x7f797006f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7975200640 1 -- 172.21.15.59:0/3032469341 >> v2:172.21.15.107:3300/0 conn(0x7f79700af130 msgr2=0x7f79700af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:58.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7975200640 1 --2- 172.21.15.59:0/3032469341 >> v2:172.21.15.107:3300/0 conn(0x7f79700af130 0x7f79700af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.978+0000 7f7975200640 1 -- 172.21.15.59:0/3032469341 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797006e6e0 con 0x7f797006dc60 2024-05-30T17:02:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f7975200640 1 --2- 172.21.15.59:0/3032469341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f797006dc60 0x7f797015d640 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f7970071c40 tx=0x7f795c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c066764a0c35311 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f796fe00640 1 -- 172.21.15.59:0/3032469341 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c0b1070 con 0x7f797006dc60 2024-05-30T17:02:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f796fe00640 1 -- 172.21.15.59:0/3032469341 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f795c0ac630 con 0x7f797006dc60 2024-05-30T17:02:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f796fe00640 1 -- 172.21.15.59:0/3032469341 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c0a8050 con 0x7f797006dc60 2024-05-30T17:02:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f7978600640 1 -- 172.21.15.59:0/3032469341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f797006dc60 msgr2=0x7f797015d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f7978600640 1 --2- 172.21.15.59:0/3032469341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f797006dc60 0x7f797015d640 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f7970071c40 tx=0x7f795c01c520 comp rx=0 tx=0).stop 2024-05-30T17:02:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f7978600640 1 -- 172.21.15.59:0/3032469341 shutdown_connections 2024-05-30T17:02:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f7978600640 1 --2- 172.21.15.59:0/3032469341 >> v2:172.21.15.107:3300/0 conn(0x7f79700af130 0x7f79700af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f7978600640 1 --2- 172.21.15.59:0/3032469341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f797006dc60 0x7f797015d640 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f7978600640 1 --2- 172.21.15.59:0/3032469341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7970156e40 0x7f797006f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f7978600640 1 -- 172.21.15.59:0/3032469341 >> 172.21.15.59:0/3032469341 conn(0x7f79700b1e60 msgr2=0x7f79700b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f7978600640 1 -- 172.21.15.59:0/3032469341 shutdown_connections 2024-05-30T17:02:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.982+0000 7f7978600640 1 -- 172.21.15.59:0/3032469341 wait complete. 2024-05-30T17:02:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7978600640 1 Processor -- start 2024-05-30T17:02:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7978600640 1 -- start start 2024-05-30T17:02:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7978600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f797006dc60 0x7f7970099410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7978600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79700af130 0x7f797014d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7978600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7970156e40 0x7f7970146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7978600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f797015e920 con 0x7f7970156e40 2024-05-30T17:02:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7978600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f797015e7a0 con 0x7f79700af130 2024-05-30T17:02:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7978600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f797015eaa0 con 0x7f797006dc60 2024-05-30T17:02:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7976600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7970156e40 0x7f7970146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7976600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7970156e40 0x7f7970146700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34328/0 (socket says 172.21.15.59:34328) 2024-05-30T17:02:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7976600640 1 -- 172.21.15.59:0/303238744 learned_addr learned my addr 172.21.15.59:0/303238744 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7975c00640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f797006dc60 0x7f7970099410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7975200640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79700af130 0x7f797014d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7976600640 1 -- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f797006dc60 msgr2=0x7f7970099410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7976600640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f797006dc60 0x7f7970099410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7976600640 1 -- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79700af130 msgr2=0x7f797014d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7976600640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79700af130 0x7f797014d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7976600640 1 -- 172.21.15.59:0/303238744 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79701471c0 con 0x7f7970156e40 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7976600640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7970156e40 0x7f7970146700 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f7968007e90 tx=0x7f796800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f796d600640 1 -- 172.21.15.59:0/303238744 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968014420 con 0x7f7970156e40 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f796d600640 1 -- 172.21.15.59:0/303238744 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7968019070 con 0x7f7970156e40 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f796d600640 1 -- 172.21.15.59:0/303238744 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968014820 con 0x7f7970156e40 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7978600640 1 -- 172.21.15.59:0/303238744 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797014a8e0 con 0x7f7970156e40 2024-05-30T17:02:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7978600640 1 -- 172.21.15.59:0/303238744 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797014aea0 con 0x7f7970156e40 2024-05-30T17:02:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.986+0000 7f7978600640 1 -- 172.21.15.59:0/303238744 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7970068a90 con 0x7f7970156e40 2024-05-30T17:02:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.990+0000 7f796d600640 1 -- 172.21.15.59:0/303238744 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f79680149c0 con 0x7f7970156e40 2024-05-30T17:02:58.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.990+0000 7f796d600640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7950069b20 0x7f795006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:58.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.990+0000 7f796d600640 1 -- 172.21.15.59:0/303238744 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f7968085f00 con 0x7f7970156e40 2024-05-30T17:02:58.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.990+0000 7f7975c00640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7950069b20 0x7f795006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:58.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.990+0000 7f7975c00640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7950069b20 0x7f795006bfe0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f79700ae5a0 tx=0x7f7964008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:58.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:58.994+0000 7f796d600640 1 -- 172.21.15.59:0/303238744 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f79680578d0 con 0x7f7970156e40 2024-05-30T17:02:59.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.182+0000 7f7978600640 1 -- 172.21.15.59:0/303238744 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f797006fab0 con 0x7f7950069b20 2024-05-30T17:02:59.192 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:59.191+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:59.192 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:59.191+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:59.192 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:59.191+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:59.192 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:59.191+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:59.192 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:02:59.191+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:02:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f796d600640 1 -- 172.21.15.59:0/303238744 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f797006fab0 con 0x7f7950069b20 2024-05-30T17:02:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f7978600640 1 -- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7950069b20 msgr2=0x7f795006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f7978600640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7950069b20 0x7f795006bfe0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f79700ae5a0 tx=0x7f7964008040 comp rx=0 tx=0).stop 2024-05-30T17:02:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f7978600640 1 -- 172.21.15.59:0/303238744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7970156e40 msgr2=0x7f7970146700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f7978600640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7970156e40 0x7f7970146700 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f7968007e90 tx=0x7f796800e4b0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f7978600640 1 -- 172.21.15.59:0/303238744 shutdown_connections 2024-05-30T17:02:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f7978600640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7950069b20 0x7f795006bfe0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f7978600640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7970156e40 0x7f7970146700 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f7978600640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79700af130 0x7f797014d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f7978600640 1 --2- 172.21.15.59:0/303238744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f797006dc60 0x7f7970099410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f7978600640 1 -- 172.21.15.59:0/303238744 >> 172.21.15.59:0/303238744 conn(0x7f79700b1e60 msgr2=0x7f797015ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f7978600640 1 -- 172.21.15.59:0/303238744 shutdown_connections 2024-05-30T17:02:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.226+0000 7f7978600640 1 -- 172.21.15.59:0/303238744 wait complete. 2024-05-30T17:02:59.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T17:02:59.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.390+0000 7f5c46600640 1 Processor -- start 2024-05-30T17:02:59.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.390+0000 7f5c46600640 1 -- start start 2024-05-30T17:02:59.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.390+0000 7f5c46600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5c400ad2b0 0x7f5c4015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.390+0000 7f5c46600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5c400d0660 0x7f5c400d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.390+0000 7f5c46600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c400ad770 con 0x7f5c401569e0 2024-05-30T17:02:59.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.390+0000 7f5c46600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f5c400d1010 con 0x7f5c400d0660 2024-05-30T17:02:59.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.390+0000 7f5c46600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5c4015cb40 con 0x7f5c400ad2b0 2024-05-30T17:02:59.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.390+0000 7f5c3fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5c400d0660 0x7f5c400d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.390+0000 7f5c3fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5c400d0660 0x7f5c400d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34330/0 (socket says 172.21.15.59:34330) 2024-05-30T17:02:59.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.390+0000 7f5c3fe00640 1 -- 172.21.15.59:0/3075758205 learned_addr learned my addr 172.21.15.59:0/3075758205 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:59.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.390+0000 7f5c37e00640 1 --2- 172.21.15.59:0/3075758205 >> v2:172.21.15.107:3300/0 conn(0x7f5c400ad2b0 0x7f5c4015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c3fe00640 1 -- 172.21.15.59:0/3075758205 >> v2:172.21.15.107:3300/0 conn(0x7f5c400ad2b0 msgr2=0x7f5c4015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:59.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c3fe00640 1 --2- 172.21.15.59:0/3075758205 >> v2:172.21.15.107:3300/0 conn(0x7f5c400ad2b0 0x7f5c4015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c3fe00640 1 -- 172.21.15.59:0/3075758205 >> v1:172.21.15.107:6789/0 conn(0x7f5c401569e0 legacy=0x7f5c400cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c3fe00640 1 -- 172.21.15.59:0/3075758205 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4015ce20 con 0x7f5c400d0660 2024-05-30T17:02:59.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c3fe00640 1 --2- 172.21.15.59:0/3075758205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c400d0660 0x7f5c400d0ad0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f5c400b4c10 tx=0x7f5c3801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27c7a6f4aa63d99 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:59.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c3ea00640 1 -- 172.21.15.59:0/3075758205 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c380a56a0 con 0x7f5c400d0660 2024-05-30T17:02:59.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c3ea00640 1 -- 172.21.15.59:0/3075758205 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c380a5840 con 0x7f5c400d0660 2024-05-30T17:02:59.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c3ea00640 1 -- 172.21.15.59:0/3075758205 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c380a5c10 con 0x7f5c400d0660 2024-05-30T17:02:59.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c46600640 1 -- 172.21.15.59:0/3075758205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c400d0660 msgr2=0x7f5c400d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c46600640 1 --2- 172.21.15.59:0/3075758205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c400d0660 0x7f5c400d0ad0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f5c400b4c10 tx=0x7f5c3801c960 comp rx=0 tx=0).stop 2024-05-30T17:02:59.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c46600640 1 -- 172.21.15.59:0/3075758205 shutdown_connections 2024-05-30T17:02:59.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c46600640 1 --2- 172.21.15.59:0/3075758205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c400d0660 0x7f5c400d0ad0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c46600640 1 --2- 172.21.15.59:0/3075758205 >> v2:172.21.15.107:3300/0 conn(0x7f5c400ad2b0 0x7f5c4015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c46600640 1 -- 172.21.15.59:0/3075758205 >> 172.21.15.59:0/3075758205 conn(0x7f5c4006bdb0 msgr2=0x7f5c4006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:59.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c46600640 1 -- 172.21.15.59:0/3075758205 shutdown_connections 2024-05-30T17:02:59.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.394+0000 7f5c46600640 1 -- 172.21.15.59:0/3075758205 wait complete. 2024-05-30T17:02:59.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c46600640 1 Processor -- start 2024-05-30T17:02:59.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c46600640 1 -- start start 2024-05-30T17:02:59.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c46600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c400ad2b0 0x7f5c400b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c46600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c400d0660 0x7f5c4014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c46600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c401569e0 0x7f5c4009d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c46600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5c400b3c60 con 0x7f5c400ad2b0 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c46600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5c400b3ae0 con 0x7f5c400d0660 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c46600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5c400b3de0 con 0x7f5c401569e0 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c3f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c400ad2b0 0x7f5c400b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c3f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c400ad2b0 0x7f5c400b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34334/0 (socket says 172.21.15.59:34334) 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c3f400640 1 -- 172.21.15.59:0/1942544032 learned_addr learned my addr 172.21.15.59:0/1942544032 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c3fe00640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c401569e0 0x7f5c4009d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c37e00640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c400d0660 0x7f5c4014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c3f400640 1 -- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c401569e0 msgr2=0x7f5c4009d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c3f400640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c401569e0 0x7f5c4009d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c3f400640 1 -- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c400d0660 msgr2=0x7f5c4014a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c3f400640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c400d0660 0x7f5c4014a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c3f400640 1 -- 172.21.15.59:0/1942544032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4014b2a0 con 0x7f5c400ad2b0 2024-05-30T17:02:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c37e00640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c400d0660 0x7f5c4014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c3f400640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c400ad2b0 0x7f5c400b2810 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000c370 tx=0x7f5c3000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c37400640 1 -- 172.21.15.59:0/1942544032 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c300052d0 con 0x7f5c400ad2b0 2024-05-30T17:02:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c37400640 1 -- 172.21.15.59:0/1942544032 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c30005470 con 0x7f5c400ad2b0 2024-05-30T17:02:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c37400640 1 -- 172.21.15.59:0/1942544032 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c30007260 con 0x7f5c400ad2b0 2024-05-30T17:02:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.398+0000 7f5c46600640 1 -- 172.21.15.59:0/1942544032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4014b580 con 0x7f5c400ad2b0 2024-05-30T17:02:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.402+0000 7f5c46600640 1 -- 172.21.15.59:0/1942544032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4014bb40 con 0x7f5c400ad2b0 2024-05-30T17:02:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.402+0000 7f5c46600640 1 -- 172.21.15.59:0/1942544032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c40068a90 con 0x7f5c400ad2b0 2024-05-30T17:02:59.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.402+0000 7f5c37400640 1 -- 172.21.15.59:0/1942544032 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7f5c30007400 con 0x7f5c400ad2b0 2024-05-30T17:02:59.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.402+0000 7f5c37400640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5c1c069b70 0x7f5c1c06c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.402+0000 7f5c37400640 1 -- 172.21.15.59:0/1942544032 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f5c30084af0 con 0x7f5c400ad2b0 2024-05-30T17:02:59.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.402+0000 7f5c37e00640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5c1c069b70 0x7f5c1c06c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.402+0000 7f5c37e00640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5c1c069b70 0x7f5c1c06c030 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009bb0 tx=0x7f5c28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:59.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.406+0000 7f5c37400640 1 -- 172.21.15.59:0/1942544032 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5c30056580 con 0x7f5c400ad2b0 2024-05-30T17:02:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.598+0000 7f5c46600640 1 -- 172.21.15.59:0/1942544032 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f5c400d0df0 con 0x7f5c1c069b70 2024-05-30T17:02:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c37400640 1 -- 172.21.15.59:0/1942544032 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f5c400d0df0 con 0x7f5c1c069b70 2024-05-30T17:02:59.604 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e 2024-05-30T17:02:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c46600640 1 -- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5c1c069b70 msgr2=0x7f5c1c06c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c46600640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5c1c069b70 0x7f5c1c06c030 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009bb0 tx=0x7f5c28008040 comp rx=0 tx=0).stop 2024-05-30T17:02:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c46600640 1 -- 172.21.15.59:0/1942544032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c400ad2b0 msgr2=0x7f5c400b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c46600640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c400ad2b0 0x7f5c400b2810 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000c370 tx=0x7f5c3000c830 comp rx=0 tx=0).stop 2024-05-30T17:02:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c46600640 1 -- 172.21.15.59:0/1942544032 shutdown_connections 2024-05-30T17:02:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c46600640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5c1c069b70 0x7f5c1c06c030 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c46600640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c401569e0 0x7f5c4009d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c46600640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c400d0660 0x7f5c4014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c46600640 1 --2- 172.21.15.59:0/1942544032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c400ad2b0 0x7f5c400b2810 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c46600640 1 -- 172.21.15.59:0/1942544032 >> 172.21.15.59:0/1942544032 conn(0x7f5c4006bdb0 msgr2=0x7f5c4014fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c46600640 1 -- 172.21.15.59:0/1942544032 shutdown_connections 2024-05-30T17:02:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.606+0000 7f5c46600640 1 -- 172.21.15.59:0/1942544032 wait complete. 2024-05-30T17:02:59.625 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T17:02:59.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc591000640 1 Processor -- start 2024-05-30T17:02:59.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc591000640 1 -- start start 2024-05-30T17:02:59.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc591000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc58c144ea0 0x7fc58c070760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc591000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58c06f1e0 con 0x7fc58c070ca0 2024-05-30T17:02:59.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc591000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58c06f4c0 con 0x7fc58c06c0c0 2024-05-30T17:02:59.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc591000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc58c145280 con 0x7fc58c144ea0 2024-05-30T17:02:59.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc583e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc58c070ca0 0x7fc58c06b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41626/0 (socket says 172.21.15.59:41626) 2024-05-30T17:02:59.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc583e00640 1 -- 172.21.15.59:0/393242027 learned_addr learned my addr 172.21.15.59:0/393242027 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:02:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58b400640 1 --2- 172.21.15.59:0/393242027 >> v2:172.21.15.107:3300/0 conn(0x7fc58c144ea0 0x7fc58c070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658465346 0 0) 0x7fc58c06f1e0 con 0x7fc58c070ca0 2024-05-30T17:02:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc570003530 con 0x7fc58c070ca0 2024-05-30T17:02:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2916463228 0 0) 0x7fc570003530 con 0x7fc58c070ca0 2024-05-30T17:02:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 >> v2:172.21.15.107:3300/0 conn(0x7fc58c144ea0 msgr2=0x7fc58c070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 --2- 172.21.15.59:0/393242027 >> v2:172.21.15.107:3300/0 conn(0x7fc58c144ea0 0x7fc58c070760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 >> v1:172.21.15.107:6789/0 conn(0x7fc58c06c0c0 legacy=0x7fc58c0ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58c06f7a0 con 0x7fc58c070ca0 2024-05-30T17:02:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fc574001680 con 0x7fc58c070ca0 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 >> v1:172.21.15.59:6789/0 conn(0x7fc58c070ca0 legacy=0x7fc58c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 --2- 172.21.15.59:0/393242027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5700039c0 0x7fc570003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 --2- 172.21.15.59:0/393242027 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc570004810 0x7fc570004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 --2- 172.21.15.59:0/393242027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 0x7fc57000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c145280 con 0x7fc5700051d0 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc57000c070 con 0x7fc5700039c0 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc57000c270 con 0x7fc570004810 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58be00640 1 --2- 172.21.15.59:0/393242027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 0x7fc57000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.770+0000 7fc58b400640 1 --2- 172.21.15.59:0/393242027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5700039c0 0x7fc570003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc583e00640 1 --2- 172.21.15.59:0/393242027 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc570004810 0x7fc570004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc58be00640 1 -- 172.21.15.59:0/393242027 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc570004810 msgr2=0x7fc570004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc58be00640 1 --2- 172.21.15.59:0/393242027 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc570004810 0x7fc570004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc58be00640 1 -- 172.21.15.59:0/393242027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5700039c0 msgr2=0x7fc570003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:02:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc58be00640 1 --2- 172.21.15.59:0/393242027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5700039c0 0x7fc570003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc58be00640 1 -- 172.21.15.59:0/393242027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc570003530 con 0x7fc5700051d0 2024-05-30T17:02:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc583e00640 1 --2- 172.21.15.59:0/393242027 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc570004810 0x7fc570004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:02:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc58be00640 1 -- 172.21.15.59:0/393242027 reap_dead start 2024-05-30T17:02:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc58be00640 1 --2- 172.21.15.59:0/393242027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 0x7fc57000b9d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fc58c072a50 tx=0x7fc58401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87270ada0bd90731 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584001a90 con 0x7fc5700051d0 2024-05-30T17:02:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc584003b80 con 0x7fc5700051d0 2024-05-30T17:02:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc58aa00640 1 -- 172.21.15.59:0/393242027 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5840050d0 con 0x7fc5700051d0 2024-05-30T17:02:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc591000640 1 -- 172.21.15.59:0/393242027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 msgr2=0x7fc57000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.774+0000 7fc591000640 1 --2- 172.21.15.59:0/393242027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 0x7fc57000b9d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fc58c072a50 tx=0x7fc58401c700 comp rx=0 tx=0).stop 2024-05-30T17:02:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 -- 172.21.15.59:0/393242027 shutdown_connections 2024-05-30T17:02:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 --2- 172.21.15.59:0/393242027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 0x7fc57000b9d0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 -- 172.21.15.59:0/393242027 >> 172.21.15.59:0/393242027 conn(0x7fc58c0b6800 msgr2=0x7fc58c0b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:59.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 -- 172.21.15.59:0/393242027 shutdown_connections 2024-05-30T17:02:59.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 -- 172.21.15.59:0/393242027 wait complete. 2024-05-30T17:02:59.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 Processor -- start 2024-05-30T17:02:59.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 -- start start 2024-05-30T17:02:59.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 0x7fc58c13a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc58c147cb0 0x7fc58c147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc58c161320 0x7fc58c0af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c06ee40 con 0x7fc5700051d0 2024-05-30T17:02:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c06fd60 con 0x7fc58c161320 2024-05-30T17:02:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc591000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc58c06efc0 con 0x7fc58c147cb0 2024-05-30T17:02:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc58b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 0x7fc58c13a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc58b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 0x7fc58c13a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34346/0 (socket says 172.21.15.59:34346) 2024-05-30T17:02:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc58b400640 1 -- 172.21.15.59:0/3771749311 learned_addr learned my addr 172.21.15.59:0/3771749311 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:02:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc58b400640 1 -- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc58c147cb0 msgr2=0x7fc58c147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc583e00640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc58c147cb0 0x7fc58c147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc58be00640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc58c161320 0x7fc58c0af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc58b400640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc58c147cb0 0x7fc58c147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc58b400640 1 -- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc58c161320 msgr2=0x7fc58c0af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc58b400640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc58c161320 0x7fc58c0af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc58b400640 1 -- 172.21.15.59:0/3771749311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58c1479b0 con 0x7fc5700051d0 2024-05-30T17:02:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc583e00640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc58c147cb0 0x7fc58c147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc58be00640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc58c161320 0x7fc58c0af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:02:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc58b400640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 0x7fc58c13a550 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fc57c011960 tx=0x7fc57c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.778+0000 7fc583400640 1 -- 172.21.15.59:0/3771749311 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00fa90 con 0x7fc5700051d0 2024-05-30T17:02:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.782+0000 7fc583400640 1 -- 172.21.15.59:0/3771749311 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57c00fc30 con 0x7fc5700051d0 2024-05-30T17:02:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.782+0000 7fc583400640 1 -- 172.21.15.59:0/3771749311 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c014440 con 0x7fc5700051d0 2024-05-30T17:02:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.782+0000 7fc591000640 1 -- 172.21.15.59:0/3771749311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58c1397d0 con 0x7fc5700051d0 2024-05-30T17:02:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.782+0000 7fc591000640 1 -- 172.21.15.59:0/3771749311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc58c139a70 con 0x7fc5700051d0 2024-05-30T17:02:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.782+0000 7fc591000640 1 -- 172.21.15.59:0/3771749311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc58c068a90 con 0x7fc5700051d0 2024-05-30T17:02:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.782+0000 7fc583400640 1 -- 172.21.15.59:0/3771749311 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 34) ==== 90129+0+0 (secure 0 0 0) 0x7fc57c012040 con 0x7fc5700051d0 2024-05-30T17:02:59.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.782+0000 7fc583400640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc568069b20 0x7fc56806bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:02:59.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.782+0000 7fc583400640 1 -- 172.21.15.59:0/3771749311 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7fc57c085e10 con 0x7fc5700051d0 2024-05-30T17:02:59.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.782+0000 7fc583e00640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc568069b20 0x7fc56806bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:02:59.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.786+0000 7fc583e00640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc568069b20 0x7fc56806bfe0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc574001210 tx=0x7fc574001160 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:02:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.786+0000 7fc583400640 1 -- 172.21.15.59:0/3771749311 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc57c019030 con 0x7fc5700051d0 2024-05-30T17:02:59.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.978+0000 7fc591000640 1 -- 172.21.15.59:0/3771749311 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fc58c0b2ee0 con 0x7fc568069b20 2024-05-30T17:02:59.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.982+0000 7fc583400640 1 -- 172.21.15.59:0/3771749311 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fc58c0b2ee0 con 0x7fc568069b20 2024-05-30T17:02:59.983 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e 2024-05-30T17:02:59.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.986+0000 7fc591000640 1 -- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc568069b20 msgr2=0x7fc56806bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.986+0000 7fc591000640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc568069b20 0x7fc56806bfe0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc574001210 tx=0x7fc574001160 comp rx=0 tx=0).stop 2024-05-30T17:02:59.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.986+0000 7fc591000640 1 -- 172.21.15.59:0/3771749311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 msgr2=0x7fc58c13a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:02:59.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.986+0000 7fc591000640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 0x7fc58c13a550 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fc57c011960 tx=0x7fc57c011e20 comp rx=0 tx=0).stop 2024-05-30T17:02:59.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.986+0000 7fc591000640 1 -- 172.21.15.59:0/3771749311 shutdown_connections 2024-05-30T17:02:59.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.986+0000 7fc591000640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc568069b20 0x7fc56806bfe0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.986+0000 7fc591000640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc58c161320 0x7fc58c0af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.986+0000 7fc591000640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc58c147cb0 0x7fc58c147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.986+0000 7fc591000640 1 --2- 172.21.15.59:0/3771749311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5700051d0 0x7fc58c13a550 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:02:59.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.986+0000 7fc591000640 1 -- 172.21.15.59:0/3771749311 >> 172.21.15.59:0/3771749311 conn(0x7fc58c0b6800 msgr2=0x7fc58c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:02:59.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.986+0000 7fc591000640 1 -- 172.21.15.59:0/3771749311 shutdown_connections 2024-05-30T17:02:59.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:02:59.986+0000 7fc591000640 1 -- 172.21.15.59:0/3771749311 wait complete. 2024-05-30T17:03:00.004 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e 2024-05-30T17:03:00.005 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:03:00.005 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:03:00.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:03:00.016 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T17:03:05.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:03:05.918 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:03:07.168 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T17:03:07.168 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T17:03:07.168 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.08841 s, 151 MB/s 2024-05-30T17:03:07.169 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:03:07.169 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:03:07.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:03:07.178 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T17:03:14.034 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T17:03:14.035 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T17:03:14.035 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.7995 s, 158 MB/s 2024-05-30T17:03:14.036 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:03:14.036 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:03:14.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:03:14.045 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T17:03:20.917 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T17:03:20.917 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T17:03:20.917 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.81322 s, 158 MB/s 2024-05-30T17:03:20.918 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.066+0000 7ff62e600640 1 Processor -- start 2024-05-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.066+0000 7ff62e600640 1 -- start start 2024-05-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62e600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff628156b80 0x7ff6280b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62e600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff62806fb50 0x7ff6280d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62e600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6280d1f50 0x7ff62809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62e600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff6280719f0 con 0x7ff6280d1f50 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62e600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff628070030 con 0x7ff628156b80 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62e600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff62815d710 con 0x7ff62806fb50 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6280d1f50 0x7ff62809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6280d1f50 0x7ff62809aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44082/0 (socket says 172.21.15.59:44082) 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62dc00640 1 -- 172.21.15.59:0/2532968245 learned_addr learned my addr 172.21.15.59:0/2532968245 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff61fe00640 1 --2- 172.21.15.59:0/2532968245 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff62806fb50 0x7ff6280d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62d200640 1 --2- 172.21.15.59:0/2532968245 >> v2:172.21.15.107:3300/0 conn(0x7ff628156b80 0x7ff6280b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62dc00640 1 -- 172.21.15.59:0/2532968245 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff62806fb50 msgr2=0x7ff6280d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62dc00640 1 --2- 172.21.15.59:0/2532968245 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff62806fb50 0x7ff6280d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62dc00640 1 -- 172.21.15.59:0/2532968245 >> v2:172.21.15.107:3300/0 conn(0x7ff628156b80 msgr2=0x7ff6280b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62dc00640 1 --2- 172.21.15.59:0/2532968245 >> v2:172.21.15.107:3300/0 conn(0x7ff628156b80 0x7ff6280b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62dc00640 1 -- 172.21.15.59:0/2532968245 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff628071680 con 0x7ff6280d1f50 2024-05-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62d200640 1 --2- 172.21.15.59:0/2532968245 >> v2:172.21.15.107:3300/0 conn(0x7ff628156b80 0x7ff6280b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.070+0000 7ff62dc00640 1 --2- 172.21.15.59:0/2532968245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6280d1f50 0x7ff62809aa40 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff6280757e0 tx=0x7ff62001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9187a7c67da279 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff627e00640 1 -- 172.21.15.59:0/2532968245 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6200a5670 con 0x7ff6280d1f50 2024-05-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff627e00640 1 -- 172.21.15.59:0/2532968245 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6200a5810 con 0x7ff6280d1f50 2024-05-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff627e00640 1 -- 172.21.15.59:0/2532968245 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6200a5be0 con 0x7ff6280d1f50 2024-05-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 -- 172.21.15.59:0/2532968245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6280d1f50 msgr2=0x7ff62809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 --2- 172.21.15.59:0/2532968245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6280d1f50 0x7ff62809aa40 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff6280757e0 tx=0x7ff62001c9f0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 -- 172.21.15.59:0/2532968245 shutdown_connections 2024-05-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 --2- 172.21.15.59:0/2532968245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6280d1f50 0x7ff62809aa40 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 --2- 172.21.15.59:0/2532968245 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff62806fb50 0x7ff6280d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 --2- 172.21.15.59:0/2532968245 >> v2:172.21.15.107:3300/0 conn(0x7ff628156b80 0x7ff6280b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 -- 172.21.15.59:0/2532968245 >> 172.21.15.59:0/2532968245 conn(0x7ff6280b3ed0 msgr2=0x7ff6280b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 -- 172.21.15.59:0/2532968245 shutdown_connections 2024-05-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 -- 172.21.15.59:0/2532968245 wait complete. 2024-05-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 Processor -- start 2024-05-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 -- start start 2024-05-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff62806fb50 0x7ff6280af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6280d1f50 0x7ff6281faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff628156b80 0x7ff62815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff6280cf380 con 0x7ff628156b80 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff6280cf200 con 0x7ff6280d1f50 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62e600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff6280cf500 con 0x7ff62806fb50 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff628156b80 0x7ff62815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff628156b80 0x7ff62815dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44098/0 (socket says 172.21.15.59:44098) 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62dc00640 1 -- 172.21.15.59:0/1314324312 learned_addr learned my addr 172.21.15.59:0/1314324312 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62d200640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff62806fb50 0x7ff6280af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff61fe00640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6280d1f50 0x7ff6281faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62dc00640 1 -- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff62806fb50 msgr2=0x7ff6280af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62dc00640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff62806fb50 0x7ff6280af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62dc00640 1 -- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6280d1f50 msgr2=0x7ff6281faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62dc00640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6280d1f50 0x7ff6281faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.074+0000 7ff62dc00640 1 -- 172.21.15.59:0/1314324312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff628142bb0 con 0x7ff628156b80 2024-05-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.078+0000 7ff62dc00640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff628156b80 0x7ff62815dc90 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7ff6200af040 tx=0x7ff620019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.078+0000 7ff625600640 1 -- 172.21.15.59:0/1314324312 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6200bc020 con 0x7ff628156b80 2024-05-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.078+0000 7ff625600640 1 -- 172.21.15.59:0/1314324312 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6200b8670 con 0x7ff628156b80 2024-05-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.078+0000 7ff625600640 1 -- 172.21.15.59:0/1314324312 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620009510 con 0x7ff628156b80 2024-05-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.078+0000 7ff62e600640 1 -- 172.21.15.59:0/1314324312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff628142e50 con 0x7ff628156b80 2024-05-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.078+0000 7ff62e600640 1 -- 172.21.15.59:0/1314324312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff628143410 con 0x7ff628156b80 2024-05-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.078+0000 7ff62e600640 1 -- 172.21.15.59:0/1314324312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff628068a90 con 0x7ff628156b80 2024-05-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.078+0000 7ff625600640 1 -- 172.21.15.59:0/1314324312 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 35) ==== 90180+0+0 (secure 0 0 0) 0x7ff6200bf020 con 0x7ff628156b80 2024-05-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.078+0000 7ff625600640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff604069bb0 0x7ff60406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.078+0000 7ff625600640 1 -- 172.21.15.59:0/1314324312 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7ff620120910 con 0x7ff628156b80 2024-05-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.078+0000 7ff62d200640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff604069bb0 0x7ff60406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.082+0000 7ff62d200640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff604069bb0 0x7ff60406c070 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff618006e90 tx=0x7ff618008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.082+0000 7ff625600640 1 -- 172.21.15.59:0/1314324312 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff6200c6030 con 0x7ff628156b80 2024-05-30T17:03:21.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.278+0000 7ff62e600640 1 -- 172.21.15.59:0/1314324312 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7ff628072650 con 0x7ff604069bb0 2024-05-30T17:03:21.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.290+0000 7ff625600640 1 -- 172.21.15.59:0/1314324312 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff628072650 con 0x7ff604069bb0 2024-05-30T17:03:21.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.294+0000 7ff62e600640 1 -- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff604069bb0 msgr2=0x7ff60406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:21.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.294+0000 7ff62e600640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff604069bb0 0x7ff60406c070 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff618006e90 tx=0x7ff618008040 comp rx=0 tx=0).stop 2024-05-30T17:03:21.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.294+0000 7ff62e600640 1 -- 172.21.15.59:0/1314324312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff628156b80 msgr2=0x7ff62815dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:21.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.294+0000 7ff62e600640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff628156b80 0x7ff62815dc90 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7ff6200af040 tx=0x7ff620019790 comp rx=0 tx=0).stop 2024-05-30T17:03:21.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.294+0000 7ff62e600640 1 -- 172.21.15.59:0/1314324312 shutdown_connections 2024-05-30T17:03:21.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.294+0000 7ff62e600640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff604069bb0 0x7ff60406c070 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.294+0000 7ff62e600640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff628156b80 0x7ff62815dc90 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.294+0000 7ff62e600640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6280d1f50 0x7ff6281faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.294+0000 7ff62e600640 1 --2- 172.21.15.59:0/1314324312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff62806fb50 0x7ff6280af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.294+0000 7ff62e600640 1 -- 172.21.15.59:0/1314324312 >> 172.21.15.59:0/1314324312 conn(0x7ff6280b3ed0 msgr2=0x7ff62815cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:21.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.294+0000 7ff62e600640 1 -- 172.21.15.59:0/1314324312 shutdown_connections 2024-05-30T17:03:21.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.294+0000 7ff62e600640 1 -- 172.21.15.59:0/1314324312 wait complete. 2024-05-30T17:03:21.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T17:03:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.454+0000 7fa777200640 1 Processor -- start 2024-05-30T17:03:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.454+0000 7fa777200640 1 -- start start 2024-05-30T17:03:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa777200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa77809b4b0 0x7fa77806cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa777200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa778162340 0x7fa7781627d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa777200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7780d0fb0 con 0x7fa77809b890 2024-05-30T17:03:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa777200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa77806fef0 con 0x7fa77809b4b0 2024-05-30T17:03:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa777200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa7780d1290 con 0x7fa778162340 2024-05-30T17:03:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa76fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa77809b890 0x7fa7780d0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58352/0 (socket says 172.21.15.59:58352) 2024-05-30T17:03:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa76fe00640 1 -- 172.21.15.59:0/2132119876 learned_addr learned my addr 172.21.15.59:0/2132119876 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:03:21.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775e00640 1 --2- 172.21.15.59:0/2132119876 >> v2:172.21.15.107:3300/0 conn(0x7fa77809b4b0 0x7fa77806cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa776800640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa778162340 0x7fa7781627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2124080596 0 0) 0x7fa7780d0fb0 con 0x7fa77809b890 2024-05-30T17:03:21.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa75c003530 con 0x7fa77809b890 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 253595924 0 0) 0x7fa75c003530 con 0x7fa77809b890 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa778162340 msgr2=0x7fa7781627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa778162340 0x7fa7781627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 >> v2:172.21.15.107:3300/0 conn(0x7fa77809b4b0 msgr2=0x7fa77806cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 --2- 172.21.15.59:0/2132119876 >> v2:172.21.15.107:3300/0 conn(0x7fa77809b4b0 0x7fa77806cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7780d1570 con 0x7fa77809b890 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fa760001680 con 0x7fa77809b890 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa776800640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa778162340 0x7fa7781627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775e00640 1 --2- 172.21.15.59:0/2132119876 >> v2:172.21.15.107:3300/0 conn(0x7fa77809b4b0 0x7fa77806cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 >> v1:172.21.15.59:6789/0 conn(0x7fa77809b890 legacy=0x7fa7780d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75c0039c0 0x7fa75c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa778162340 0x7fa75c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c004d50 0x7fa75c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa77806fef0 con 0x7fa75c0039c0 2024-05-30T17:03:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa7780d1290 con 0x7fa75c004d50 2024-05-30T17:03:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c00b9d0 con 0x7fa778162340 2024-05-30T17:03:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775e00640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75c0039c0 0x7fa75c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa776800640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c004d50 0x7fa75c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa76fe00640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa778162340 0x7fa75c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775e00640 1 -- 172.21.15.59:0/2132119876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa778162340 msgr2=0x7fa75c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775e00640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa778162340 0x7fa75c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775e00640 1 -- 172.21.15.59:0/2132119876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c004d50 msgr2=0x7fa75c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775e00640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c004d50 0x7fa75c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.458+0000 7fa775e00640 1 -- 172.21.15.59:0/2132119876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c003530 con 0x7fa75c0039c0 2024-05-30T17:03:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa775e00640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75c0039c0 0x7fa75c003de0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fa768009cb0 tx=0x7fa76801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8859e5b16ac17f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680b2070 con 0x7fa75c0039c0 2024-05-30T17:03:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7680a5890 con 0x7fa75c0039c0 2024-05-30T17:03:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa775400640 1 -- 172.21.15.59:0/2132119876 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768009880 con 0x7fa75c0039c0 2024-05-30T17:03:21.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa777200640 1 -- 172.21.15.59:0/2132119876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75c0039c0 msgr2=0x7fa75c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:21.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa777200640 1 --2- 172.21.15.59:0/2132119876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75c0039c0 0x7fa75c003de0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fa768009cb0 tx=0x7fa76801cc60 comp rx=0 tx=0).stop 2024-05-30T17:03:21.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa776800640 1 -- 172.21.15.59:0/2132119876 reap_dead start 2024-05-30T17:03:21.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa777200640 1 -- 172.21.15.59:0/2132119876 shutdown_connections 2024-05-30T17:03:21.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa777200640 1 -- 172.21.15.59:0/2132119876 >> 172.21.15.59:0/2132119876 conn(0x7fa7780b3ec0 msgr2=0x7fa7780b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:21.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa777200640 1 -- 172.21.15.59:0/2132119876 shutdown_connections 2024-05-30T17:03:21.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa777200640 1 -- 172.21.15.59:0/2132119876 wait complete. 2024-05-30T17:03:21.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa777200640 1 Processor -- start 2024-05-30T17:03:21.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.462+0000 7fa777200640 1 -- start start 2024-05-30T17:03:21.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa777200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c0039c0 0x7fa7781f78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa777200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa778158b40 0x7fa7780cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa777200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7780cb330 0x7fa7780b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa777200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa77815f9e0 con 0x7fa778158b40 2024-05-30T17:03:21.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa777200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa77815f860 con 0x7fa75c0039c0 2024-05-30T17:03:21.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa777200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa77815fb60 con 0x7fa7780cb330 2024-05-30T17:03:21.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa76fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa778158b40 0x7fa7780cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa76fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa778158b40 0x7fa7780cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44116/0 (socket says 172.21.15.59:44116) 2024-05-30T17:03:21.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa76fe00640 1 -- 172.21.15.59:0/2855685886 learned_addr learned my addr 172.21.15.59:0/2855685886 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:21.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa775e00640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c0039c0 0x7fa7781f78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa776800640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7780cb330 0x7fa7780b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa76fe00640 1 -- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7780cb330 msgr2=0x7fa7780b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa76fe00640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7780cb330 0x7fa7780b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa76fe00640 1 -- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c0039c0 msgr2=0x7fa7781f78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa76fe00640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c0039c0 0x7fa7781f78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa76fe00640 1 -- 172.21.15.59:0/2855685886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7780cb800 con 0x7fa778158b40 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa776800640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7780cb330 0x7fa7780b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa76fe00640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa778158b40 0x7fa7780cadf0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fa760004f80 tx=0x7fa7600074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa76e000640 1 -- 172.21.15.59:0/2855685886 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760007740 con 0x7fa778158b40 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa76e000640 1 -- 172.21.15.59:0/2855685886 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760018070 con 0x7fa778158b40 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa76e000640 1 -- 172.21.15.59:0/2855685886 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76000fbe0 con 0x7fa778158b40 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa777200640 1 -- 172.21.15.59:0/2855685886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7780afac0 con 0x7fa778158b40 2024-05-30T17:03:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa777200640 1 -- 172.21.15.59:0/2855685886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7780b0080 con 0x7fa778158b40 2024-05-30T17:03:21.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.466+0000 7fa777200640 1 -- 172.21.15.59:0/2855685886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa778068a90 con 0x7fa778158b40 2024-05-30T17:03:21.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.470+0000 7fa76e000640 1 -- 172.21.15.59:0/2855685886 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 35) ==== 90180+0+0 (secure 0 0 0) 0x7fa76001d460 con 0x7fa778158b40 2024-05-30T17:03:21.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.470+0000 7fa76e000640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa754069bb0 0x7fa75406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:21.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.470+0000 7fa76e000640 1 -- 172.21.15.59:0/2855685886 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7fa760085800 con 0x7fa778158b40 2024-05-30T17:03:21.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.470+0000 7fa775e00640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa754069bb0 0x7fa75406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:21.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.470+0000 7fa775e00640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa754069bb0 0x7fa75406c070 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa7680af000 tx=0x7fa7680046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:21.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.474+0000 7fa76e000640 1 -- 172.21.15.59:0/2855685886 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa7780cb800 con 0x7fa778158b40 2024-05-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.662+0000 7fa777200640 1 -- 172.21.15.59:0/2855685886 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fa7780b4b20 con 0x7fa754069bb0 2024-05-30T17:03:21.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa76e000640 1 -- 172.21.15.59:0/2855685886 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fa7780b4b20 con 0x7fa754069bb0 2024-05-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e 2024-05-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa777200640 1 -- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa754069bb0 msgr2=0x7fa75406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa777200640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa754069bb0 0x7fa75406c070 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa7680af000 tx=0x7fa7680046d0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa777200640 1 -- 172.21.15.59:0/2855685886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa778158b40 msgr2=0x7fa7780cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa777200640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa778158b40 0x7fa7780cadf0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fa760004f80 tx=0x7fa7600074f0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa777200640 1 -- 172.21.15.59:0/2855685886 shutdown_connections 2024-05-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa777200640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa754069bb0 0x7fa75406c070 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa777200640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7780cb330 0x7fa7780b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa777200640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa778158b40 0x7fa7780cadf0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa777200640 1 --2- 172.21.15.59:0/2855685886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c0039c0 0x7fa7781f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa777200640 1 -- 172.21.15.59:0/2855685886 >> 172.21.15.59:0/2855685886 conn(0x7fa7780b3ec0 msgr2=0x7fa7780b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa777200640 1 -- 172.21.15.59:0/2855685886 shutdown_connections 2024-05-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:21.670+0000 7fa777200640 1 -- 172.21.15.59:0/2855685886 wait complete. 2024-05-30T17:03:21.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:03:21.688 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e 2024-05-30T17:03:21.689 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:03:21.702 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e 2024-05-30T17:03:21.702 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3138256896" 2024-05-30T17:03:21.702 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:03:21.703 INFO:tasks.cephfs.test_volumes:r_size = 3138256896 exp_size = 3221225472 2024-05-30T17:03:23.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:03:23.703 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e 2024-05-30T17:03:23.703 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:03:23.718 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e 2024-05-30T17:03:23.718 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3138256896" 2024-05-30T17:03:23.719 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:03:23.719 INFO:tasks.cephfs.test_volumes:r_size = 3138256896 exp_size = 3221225472 2024-05-30T17:03:25.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:03:25.721 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e 2024-05-30T17:03:25.721 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:03:25.735 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e 2024-05-30T17:03:25.736 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T17:03:25.736 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:03:25.737 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T17:03:25.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone55781 2024-05-30T17:03:25.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.933+0000 7f2a05e00640 1 Processor -- start 2024-05-30T17:03:25.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.933+0000 7f2a05e00640 1 -- start start 2024-05-30T17:03:25.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f2a05e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a001569e0 0x7f2a0015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:25.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f2a05e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a000ad770 con 0x7f2a000ad2b0 2024-05-30T17:03:25.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f2a05e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a0015cb40 con 0x7f2a000d0660 2024-05-30T17:03:25.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f2a05e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0015ce20 con 0x7f2a001569e0 2024-05-30T17:03:25.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29f6000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2a000ad2b0 0x7f2a000cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42904/0 (socket says 172.21.15.59:42904) 2024-05-30T17:03:25.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29f6000640 1 -- 172.21.15.59:0/1309677924 learned_addr learned my addr 172.21.15.59:0/1309677924 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:03:25.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fea00640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a001569e0 0x7f2a0015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:25.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3976726410 0 0) 0x7f2a000ad770 con 0x7f2a000ad2b0 2024-05-30T17:03:25.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29e4003530 con 0x7f2a000ad2b0 2024-05-30T17:03:25.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776949209 0 0) 0x7f2a0015cb40 con 0x7f2a000d0660 2024-05-30T17:03:25.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a000ad770 con 0x7f2a000d0660 2024-05-30T17:03:25.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1688366758 0 0) 0x7f29e4003530 con 0x7f2a000ad2b0 2024-05-30T17:03:25.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a001569e0 msgr2=0x7f2a0015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:25.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a001569e0 0x7f2a0015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:25.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 >> v1:172.21.15.107:6789/0 conn(0x7f2a000d0660 legacy=0x7f2a000b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:25.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0015d100 con 0x7f2a000ad2b0 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f29e8001680 con 0x7f2a000ad2b0 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 >> v1:172.21.15.59:6789/0 conn(0x7f2a000ad2b0 legacy=0x7f2a000cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29e4003b80 0x7f29e4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29e4004810 0x7f29e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a001569e0 0x7f29e40051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0015ce20 con 0x7f29e4004810 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f29e400bae0 con 0x7f29e4003b80 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f29e400bce0 con 0x7f2a001569e0 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29f6000640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29e4004810 0x7f29e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29fea00640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29e4003b80 0x7f29e4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29ff400640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a001569e0 0x7f29e40051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29f6000640 1 -- 172.21.15.59:0/1309677924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a001569e0 msgr2=0x7f29e40051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29f6000640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a001569e0 0x7f29e40051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:25.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29f6000640 1 -- 172.21.15.59:0/1309677924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29e4003b80 msgr2=0x7f29e4003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:25.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29f6000640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29e4003b80 0x7f29e4003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:25.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29f6000640 1 -- 172.21.15.59:0/1309677924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e4003530 con 0x7f29e4004810 2024-05-30T17:03:25.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.937+0000 7f29ff400640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a001569e0 0x7f29e40051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:03:25.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.941+0000 7f29f6000640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29e4004810 0x7f29e4004c90 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f29e800c190 tx=0x7f29e801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9514fcbb5567652a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:25.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.941+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8007cd0 con 0x7f29e4004810 2024-05-30T17:03:25.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.941+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e80a9020 con 0x7f29e4004810 2024-05-30T17:03:25.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.941+0000 7f29fe000640 1 -- 172.21.15.59:0/1309677924 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8005ae0 con 0x7f29e4004810 2024-05-30T17:03:25.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.941+0000 7f2a05e00640 1 -- 172.21.15.59:0/1309677924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29e4004810 msgr2=0x7f29e4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:25.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.941+0000 7f2a05e00640 1 --2- 172.21.15.59:0/1309677924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29e4004810 0x7f29e4004c90 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f29e800c190 tx=0x7f29e801cc00 comp rx=0 tx=0).stop 2024-05-30T17:03:25.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.941+0000 7f29ff400640 1 -- 172.21.15.59:0/1309677924 reap_dead start 2024-05-30T17:03:25.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.941+0000 7f2a05e00640 1 -- 172.21.15.59:0/1309677924 shutdown_connections 2024-05-30T17:03:25.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.941+0000 7f2a05e00640 1 -- 172.21.15.59:0/1309677924 >> 172.21.15.59:0/1309677924 conn(0x7f2a0006bdb0 msgr2=0x7f2a0006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:25.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.941+0000 7f2a05e00640 1 -- 172.21.15.59:0/1309677924 shutdown_connections 2024-05-30T17:03:25.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.941+0000 7f2a05e00640 1 -- 172.21.15.59:0/1309677924 wait complete. 2024-05-30T17:03:25.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f2a05e00640 1 Processor -- start 2024-05-30T17:03:25.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f2a05e00640 1 -- start start 2024-05-30T17:03:25.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f2a05e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29e4004810 0x7f2a0014ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:25.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f2a05e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a00153220 0x7f2a0006f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:25.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f2a05e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0006da70 0x7f2a0015b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:25.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f2a05e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00168330 con 0x7f2a0006da70 2024-05-30T17:03:25.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f2a05e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2a001681b0 con 0x7f2a00153220 2024-05-30T17:03:25.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f2a05e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2a001684b0 con 0x7f29e4004810 2024-05-30T17:03:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29ff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0006da70 0x7f2a0015b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29ff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0006da70 0x7f2a0015b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35432/0 (socket says 172.21.15.59:35432) 2024-05-30T17:03:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29ff400640 1 -- 172.21.15.59:0/3154495153 learned_addr learned my addr 172.21.15.59:0/3154495153 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29fea00640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29e4004810 0x7f2a0014ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29f6000640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a00153220 0x7f2a0006f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29ff400640 1 -- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29e4004810 msgr2=0x7f2a0014ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29ff400640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29e4004810 0x7f2a0014ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29ff400640 1 -- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a00153220 msgr2=0x7f2a0006f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29ff400640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a00153220 0x7f2a0006f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29ff400640 1 -- 172.21.15.59:0/3154495153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a00154310 con 0x7f2a0006da70 2024-05-30T17:03:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29ff400640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0006da70 0x7f2a0015b470 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f2a000b4c40 tx=0x7f29f800e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29f7e00640 1 -- 172.21.15.59:0/3154495153 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8019070 con 0x7f2a0006da70 2024-05-30T17:03:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29f7e00640 1 -- 172.21.15.59:0/3154495153 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f80052e0 con 0x7f2a0006da70 2024-05-30T17:03:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f29f7e00640 1 -- 172.21.15.59:0/3154495153 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8003840 con 0x7f2a0006da70 2024-05-30T17:03:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f2a05e00640 1 -- 172.21.15.59:0/3154495153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0006f8a0 con 0x7f2a0006da70 2024-05-30T17:03:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f2a05e00640 1 -- 172.21.15.59:0/3154495153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0006e5a0 con 0x7f2a0006da70 2024-05-30T17:03:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.945+0000 7f2a05e00640 1 -- 172.21.15.59:0/3154495153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a00153600 con 0x7f2a0006da70 2024-05-30T17:03:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.949+0000 7f29f7e00640 1 -- 172.21.15.59:0/3154495153 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 35) ==== 90180+0+0 (secure 0 0 0) 0x7f29f80039e0 con 0x7f2a0006da70 2024-05-30T17:03:25.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.949+0000 7f29f7e00640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f29dc069bb0 0x7f29dc06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:25.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.949+0000 7f29f7e00640 1 -- 172.21.15.59:0/3154495153 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f29f8084b30 con 0x7f2a0006da70 2024-05-30T17:03:25.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.949+0000 7f29fea00640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f29dc069bb0 0x7f29dc06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:25.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.949+0000 7f29fea00640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f29dc069bb0 0x7f29dc06c070 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f29f0014430 tx=0x7f29f000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:25.953+0000 7f29f7e00640 1 -- 172.21.15.59:0/3154495153 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2a00153600 con 0x7f2a0006da70 2024-05-30T17:03:26.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.149+0000 7f2a05e00640 1 -- 172.21.15.59:0/3154495153 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone55781", "target": ["mon-mgr", ""]}) -- 0x7f2a0014d6e0 con 0x7f29dc069bb0 2024-05-30T17:03:26.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f29f7e00640 1 -- 172.21.15.59:0/3154495153 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2a0014d6e0 con 0x7f29dc069bb0 2024-05-30T17:03:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f2a05e00640 1 -- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f29dc069bb0 msgr2=0x7f29dc06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f2a05e00640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f29dc069bb0 0x7f29dc06c070 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f29f0014430 tx=0x7f29f000b040 comp rx=0 tx=0).stop 2024-05-30T17:03:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f2a05e00640 1 -- 172.21.15.59:0/3154495153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0006da70 msgr2=0x7f2a0015b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f2a05e00640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0006da70 0x7f2a0015b470 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f2a000b4c40 tx=0x7f29f800e890 comp rx=0 tx=0).stop 2024-05-30T17:03:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f2a05e00640 1 -- 172.21.15.59:0/3154495153 shutdown_connections 2024-05-30T17:03:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f2a05e00640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f29dc069bb0 0x7f29dc06c070 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f2a05e00640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0006da70 0x7f2a0015b470 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f2a05e00640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a00153220 0x7f2a0006f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:26.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f2a05e00640 1 --2- 172.21.15.59:0/3154495153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29e4004810 0x7f2a0014ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:26.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f2a05e00640 1 -- 172.21.15.59:0/3154495153 >> 172.21.15.59:0/3154495153 conn(0x7f2a0006bdb0 msgr2=0x7f2a00160690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:26.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f2a05e00640 1 -- 172.21.15.59:0/3154495153 shutdown_connections 2024-05-30T17:03:26.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.209+0000 7f2a05e00640 1 -- 172.21.15.59:0/3154495153 wait complete. 2024-05-30T17:03:26.213 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:26.210+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:26.213 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:26.210+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:26.213 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:26.210+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:26.213 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:26.210+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:26.214 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:26.210+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:26.229 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:26.226+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:26.229 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:26.226+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:26.229 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:26.226+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:26.229 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:26.226+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:26.229 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:26.226+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:26.233 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone55782 2024-05-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.381+0000 7f2293400640 1 Processor -- start 2024-05-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.381+0000 7f2293400640 1 -- start start 2024-05-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.381+0000 7f2293400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f228c1569e0 0x7f228c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f2293400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f228c0ad2b0 0x7f228c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f2293400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c0ad770 con 0x7f228c0d0660 2024-05-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f2293400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f228c15cb40 con 0x7f228c1569e0 2024-05-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f2293400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f228c15ce20 con 0x7f228c0ad2b0 2024-05-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f2290a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f228c1569e0 0x7f228c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f228be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f228c0ad2b0 0x7f228c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f2291400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f228c0d0660 0x7f228c0b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:43226/0 (socket says 172.21.15.59:43226) 2024-05-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f2291400640 1 -- 172.21.15.59:0/1076180339 learned_addr learned my addr 172.21.15.59:0/1076180339 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f228be00640 1 -- 172.21.15.59:0/1076180339 >> v2:172.21.15.107:3300/0 conn(0x7f228c1569e0 msgr2=0x7f228c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f228be00640 1 --2- 172.21.15.59:0/1076180339 >> v2:172.21.15.107:3300/0 conn(0x7f228c1569e0 0x7f228c15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f228be00640 1 -- 172.21.15.59:0/1076180339 >> v1:172.21.15.107:6789/0 conn(0x7f228c0d0660 legacy=0x7f228c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f228b400640 1 -- 172.21.15.59:0/1076180339 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3066684035 0 0) 0x7f228c0ad770 con 0x7f228c0d0660 2024-05-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f228be00640 1 -- 172.21.15.59:0/1076180339 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c15d100 con 0x7f228c0ad2b0 2024-05-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.385+0000 7f2290a00640 1 --2- 172.21.15.59:0/1076180339 >> v2:172.21.15.107:3300/0 conn(0x7f228c1569e0 0x7f228c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f228be00640 1 --2- 172.21.15.59:0/1076180339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f228c0ad2b0 0x7f228c0cf9f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f22780097c0 tx=0x7f227801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe8769ebde5c3970 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f228b400640 1 -- 172.21.15.59:0/1076180339 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22780b0070 con 0x7f228c0ad2b0 2024-05-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f228b400640 1 -- 172.21.15.59:0/1076180339 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22780ab600 con 0x7f228c0ad2b0 2024-05-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f228b400640 1 -- 172.21.15.59:0/1076180339 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22780ab9d0 con 0x7f228c0ad2b0 2024-05-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 -- 172.21.15.59:0/1076180339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f228c0ad2b0 msgr2=0x7f228c0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 --2- 172.21.15.59:0/1076180339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f228c0ad2b0 0x7f228c0cf9f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f22780097c0 tx=0x7f227801c380 comp rx=0 tx=0).stop 2024-05-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 -- 172.21.15.59:0/1076180339 shutdown_connections 2024-05-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 --2- 172.21.15.59:0/1076180339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f228c0ad2b0 0x7f228c0cf9f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 --2- 172.21.15.59:0/1076180339 >> v2:172.21.15.107:3300/0 conn(0x7f228c1569e0 0x7f228c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 -- 172.21.15.59:0/1076180339 >> 172.21.15.59:0/1076180339 conn(0x7f228c06bdb0 msgr2=0x7f228c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 -- 172.21.15.59:0/1076180339 shutdown_connections 2024-05-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 -- 172.21.15.59:0/1076180339 wait complete. 2024-05-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 Processor -- start 2024-05-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 -- start start 2024-05-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f228c0ad2b0 0x7f228c0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f228c0d0660 0x7f228c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f228c1569e0 0x7f228c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f228c0d00b0 con 0x7f228c1569e0 2024-05-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f228c0cff30 con 0x7f228c0d0660 2024-05-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2293400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f228c1691b0 con 0x7f228c0ad2b0 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2291400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f228c1569e0 0x7f228c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2290a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f228c0ad2b0 0x7f228c0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2291400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f228c1569e0 0x7f228c155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35436/0 (socket says 172.21.15.59:35436) 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f2291400640 1 -- 172.21.15.59:0/979199402 learned_addr learned my addr 172.21.15.59:0/979199402 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.389+0000 7f228be00640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f228c0d0660 0x7f228c1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2291400640 1 -- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f228c0ad2b0 msgr2=0x7f228c0b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2291400640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f228c0ad2b0 0x7f228c0b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2291400640 1 -- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f228c0d0660 msgr2=0x7f228c1555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2291400640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f228c0d0660 0x7f228c1555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2291400640 1 -- 172.21.15.59:0/979199402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c0b4630 con 0x7f228c1569e0 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2290a00640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f228c0ad2b0 0x7f228c0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2291400640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f228c1569e0 0x7f228c155b10 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f228400c7a0 tx=0x7f228400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2288c00640 1 -- 172.21.15.59:0/979199402 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284018070 con 0x7f228c1569e0 2024-05-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2288c00640 1 -- 172.21.15.59:0/979199402 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228400a640 con 0x7f228c1569e0 2024-05-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2288c00640 1 -- 172.21.15.59:0/979199402 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228400aa70 con 0x7f228c1569e0 2024-05-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2293400640 1 -- 172.21.15.59:0/979199402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c0b1270 con 0x7f228c1569e0 2024-05-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2293400640 1 -- 172.21.15.59:0/979199402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c0b1510 con 0x7f228c1569e0 2024-05-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2293400640 1 -- 172.21.15.59:0/979199402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c068a90 con 0x7f228c1569e0 2024-05-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2288c00640 1 -- 172.21.15.59:0/979199402 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 35) ==== 90180+0+0 (secure 0 0 0) 0x7f228400ac10 con 0x7f228c1569e0 2024-05-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.393+0000 7f2288c00640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f226c069bb0 0x7f226c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.397+0000 7f2288c00640 1 -- 172.21.15.59:0/979199402 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f2284084da0 con 0x7f228c1569e0 2024-05-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.397+0000 7f2290a00640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f226c069bb0 0x7f226c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.397+0000 7f2290a00640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f226c069bb0 0x7f226c06c070 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2280009580 tx=0x7f2280009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.397+0000 7f2288c00640 1 -- 172.21.15.59:0/979199402 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2284056770 con 0x7f228c1569e0 2024-05-30T17:03:26.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:26.593+0000 7f2293400640 1 -- 172.21.15.59:0/979199402 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone55782", "target": ["mon-mgr", ""]}) -- 0x7f228c0b2e00 con 0x7f226c069bb0 2024-05-30T17:03:27.214 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:27.214+0000 7efd4aa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:27.214 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:27.214+0000 7efd4aa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:27.214 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:27.214+0000 7efd4aa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:27.215 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:27.214+0000 7efd4aa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:27.215 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:27.214+0000 7efd4aa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.305+0000 7f2288c00640 1 -- 172.21.15.59:0/979199402 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f228c0b2e00 con 0x7f226c069bb0 2024-05-30T17:03:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.309+0000 7f2293400640 1 -- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f226c069bb0 msgr2=0x7f226c06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.309+0000 7f2293400640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f226c069bb0 0x7f226c06c070 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2280009580 tx=0x7f2280009190 comp rx=0 tx=0).stop 2024-05-30T17:03:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.309+0000 7f2293400640 1 -- 172.21.15.59:0/979199402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f228c1569e0 msgr2=0x7f228c155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.309+0000 7f2293400640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f228c1569e0 0x7f228c155b10 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f228400c7a0 tx=0x7f228400cc60 comp rx=0 tx=0).stop 2024-05-30T17:03:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.309+0000 7f2293400640 1 -- 172.21.15.59:0/979199402 shutdown_connections 2024-05-30T17:03:27.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.309+0000 7f2293400640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f226c069bb0 0x7f226c06c070 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:27.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.309+0000 7f2293400640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f228c1569e0 0x7f228c155b10 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:27.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.309+0000 7f2293400640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f228c0d0660 0x7f228c1555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:27.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.309+0000 7f2293400640 1 --2- 172.21.15.59:0/979199402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f228c0ad2b0 0x7f228c0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:27.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.309+0000 7f2293400640 1 -- 172.21.15.59:0/979199402 >> 172.21.15.59:0/979199402 conn(0x7f228c06bdb0 msgr2=0x7f228c14e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:27.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.313+0000 7f2293400640 1 -- 172.21.15.59:0/979199402 shutdown_connections 2024-05-30T17:03:27.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.313+0000 7f2293400640 1 -- 172.21.15.59:0/979199402 wait complete. 2024-05-30T17:03:27.320 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:27.318+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:27.320 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:27.318+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:27.320 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:27.318+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:27.320 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:27.318+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:27.321 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:27.318+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:27.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone55783 2024-05-30T17:03:27.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.585+0000 7faa0f800640 1 Processor -- start 2024-05-30T17:03:27.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.585+0000 7faa0f800640 1 -- start start 2024-05-30T17:03:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.585+0000 7faa0f800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa081569e0 0x7faa0815d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.585+0000 7faa0f800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faa080ad2b0 0x7faa080cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.585+0000 7faa0f800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa080ad770 con 0x7faa080d0660 2024-05-30T17:03:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.585+0000 7faa0f800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7faa0815cb40 con 0x7faa081569e0 2024-05-30T17:03:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.585+0000 7faa0f800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7faa0815ce20 con 0x7faa080ad2b0 2024-05-30T17:03:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.589+0000 7faa0d800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faa080d0660 0x7faa080b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42920/0 (socket says 172.21.15.59:42920) 2024-05-30T17:03:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.589+0000 7faa0ce00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa081569e0 0x7faa0815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.589+0000 7faa0d800640 1 -- 172.21.15.59:0/3695895351 learned_addr learned my addr 172.21.15.59:0/3695895351 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:03:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.589+0000 7faa0ce00640 1 -- 172.21.15.59:0/3695895351 >> v2:172.21.15.107:3300/0 conn(0x7faa080ad2b0 msgr2=0x7faa080cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.589+0000 7faa0ce00640 1 --2- 172.21.15.59:0/3695895351 >> v2:172.21.15.107:3300/0 conn(0x7faa080ad2b0 0x7faa080cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.589+0000 7faa0ce00640 1 -- 172.21.15.59:0/3695895351 >> v1:172.21.15.59:6789/0 conn(0x7faa080d0660 legacy=0x7faa080b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.589+0000 7faa0ce00640 1 -- 172.21.15.59:0/3695895351 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0815d100 con 0x7faa081569e0 2024-05-30T17:03:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.589+0000 7faa07400640 1 -- 172.21.15.59:0/3695895351 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 389499706 0 0) 0x7faa080ad770 con 0x7faa080d0660 2024-05-30T17:03:27.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.593+0000 7faa0ce00640 1 --2- 172.21.15.59:0/3695895351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa081569e0 0x7faa0815d620 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7faa080b4c10 tx=0x7fa9fc01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4385d78a81fd7965 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:27.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.593+0000 7faa07400640 1 -- 172.21.15.59:0/3695895351 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc0b0070 con 0x7faa081569e0 2024-05-30T17:03:27.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.593+0000 7faa07400640 1 -- 172.21.15.59:0/3695895351 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc004230 con 0x7faa081569e0 2024-05-30T17:03:27.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.593+0000 7faa07400640 1 -- 172.21.15.59:0/3695895351 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc003620 con 0x7faa081569e0 2024-05-30T17:03:27.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.593+0000 7faa0f800640 1 -- 172.21.15.59:0/3695895351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa081569e0 msgr2=0x7faa0815d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:27.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.593+0000 7faa0f800640 1 --2- 172.21.15.59:0/3695895351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa081569e0 0x7faa0815d620 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7faa080b4c10 tx=0x7fa9fc01c360 comp rx=0 tx=0).stop 2024-05-30T17:03:27.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.593+0000 7faa0f800640 1 -- 172.21.15.59:0/3695895351 shutdown_connections 2024-05-30T17:03:27.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.593+0000 7faa0f800640 1 --2- 172.21.15.59:0/3695895351 >> v2:172.21.15.107:3300/0 conn(0x7faa080ad2b0 0x7faa080cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:27.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.593+0000 7faa0f800640 1 --2- 172.21.15.59:0/3695895351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa081569e0 0x7faa0815d620 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:27.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.593+0000 7faa0f800640 1 -- 172.21.15.59:0/3695895351 >> 172.21.15.59:0/3695895351 conn(0x7faa0806bdb0 msgr2=0x7faa0806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:27.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.593+0000 7faa0f800640 1 -- 172.21.15.59:0/3695895351 shutdown_connections 2024-05-30T17:03:27.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.593+0000 7faa0f800640 1 -- 172.21.15.59:0/3695895351 wait complete. 2024-05-30T17:03:27.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0f800640 1 Processor -- start 2024-05-30T17:03:27.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0f800640 1 -- start start 2024-05-30T17:03:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0f800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa080ad2b0 0x7faa080999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0f800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080d0660 0x7faa08159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0f800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa081569e0 0x7faa0815dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0f800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faa080d00b0 con 0x7faa081569e0 2024-05-30T17:03:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0f800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faa080cff30 con 0x7faa080ad2b0 2024-05-30T17:03:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0f800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa081691b0 con 0x7faa080d0660 2024-05-30T17:03:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa081569e0 0x7faa0815dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa081569e0 0x7faa0815dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35452/0 (socket says 172.21.15.59:35452) 2024-05-30T17:03:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0d800640 1 -- 172.21.15.59:0/434313893 learned_addr learned my addr 172.21.15.59:0/434313893 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa07e00640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080d0660 0x7faa08159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0d800640 1 -- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080d0660 msgr2=0x7faa08159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0d800640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080d0660 0x7faa08159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0d800640 1 -- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa080ad2b0 msgr2=0x7faa080999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0d800640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa080ad2b0 0x7faa080999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0d800640 1 -- 172.21.15.59:0/434313893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa08159e00 con 0x7faa081569e0 2024-05-30T17:03:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa07e00640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080d0660 0x7faa08159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:03:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.597+0000 7faa0d800640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa081569e0 0x7faa0815dde0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7faa0000c7d0 tx=0x7faa0000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.601+0000 7faa04c00640 1 -- 172.21.15.59:0/434313893 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00018070 con 0x7faa081569e0 2024-05-30T17:03:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.601+0000 7faa04c00640 1 -- 172.21.15.59:0/434313893 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa0000a5e0 con 0x7faa081569e0 2024-05-30T17:03:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.601+0000 7faa0f800640 1 -- 172.21.15.59:0/434313893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0815a0e0 con 0x7faa081569e0 2024-05-30T17:03:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.601+0000 7faa04c00640 1 -- 172.21.15.59:0/434313893 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0000aa10 con 0x7faa081569e0 2024-05-30T17:03:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.601+0000 7faa0f800640 1 -- 172.21.15.59:0/434313893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0815a6a0 con 0x7faa081569e0 2024-05-30T17:03:27.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.601+0000 7faa0f800640 1 -- 172.21.15.59:0/434313893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa08068a90 con 0x7faa081569e0 2024-05-30T17:03:27.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.601+0000 7faa04c00640 1 -- 172.21.15.59:0/434313893 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 35) ==== 90180+0+0 (secure 0 0 0) 0x7faa0001b070 con 0x7faa081569e0 2024-05-30T17:03:27.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.601+0000 7faa04c00640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa9e8069bb0 0x7fa9e806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:27.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.601+0000 7faa04c00640 1 -- 172.21.15.59:0/434313893 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7faa00084e60 con 0x7faa081569e0 2024-05-30T17:03:27.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.605+0000 7faa0ce00640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa9e8069bb0 0x7fa9e806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:27.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.605+0000 7faa0ce00640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa9e8069bb0 0x7fa9e806c070 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc0ad000 tx=0x7fa9fc004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:27.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.609+0000 7faa04c00640 1 -- 172.21.15.59:0/434313893 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faa00056df0 con 0x7faa081569e0 2024-05-30T17:03:27.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:27.945+0000 7faa0f800640 1 -- 172.21.15.59:0/434313893 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone55783", "target": ["mon-mgr", ""]}) -- 0x7faa08159bb0 con 0x7fa9e8069bb0 2024-05-30T17:03:28.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.261+0000 7faa04c00640 1 -- 172.21.15.59:0/434313893 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 36) ==== 90384+0+0 (secure 0 0 0) 0x7faa00052d60 con 0x7faa081569e0 2024-05-30T17:03:28.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.605+0000 7faa04c00640 1 -- 172.21.15.59:0/434313893 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faa08159bb0 con 0x7fa9e8069bb0 2024-05-30T17:03:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.613+0000 7faa0f800640 1 -- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa9e8069bb0 msgr2=0x7fa9e806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.613+0000 7faa0f800640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa9e8069bb0 0x7fa9e806c070 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc0ad000 tx=0x7fa9fc004740 comp rx=0 tx=0).stop 2024-05-30T17:03:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.613+0000 7faa0f800640 1 -- 172.21.15.59:0/434313893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa081569e0 msgr2=0x7faa0815dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.613+0000 7faa0f800640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa081569e0 0x7faa0815dde0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7faa0000c7d0 tx=0x7faa0000cc90 comp rx=0 tx=0).stop 2024-05-30T17:03:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.613+0000 7faa0f800640 1 -- 172.21.15.59:0/434313893 shutdown_connections 2024-05-30T17:03:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.613+0000 7faa0f800640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa9e8069bb0 0x7fa9e806c070 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.613+0000 7faa0f800640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa081569e0 0x7faa0815dde0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.613+0000 7faa0f800640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080d0660 0x7faa08159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.613+0000 7faa0f800640 1 --2- 172.21.15.59:0/434313893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa080ad2b0 0x7faa080999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.613+0000 7faa0f800640 1 -- 172.21.15.59:0/434313893 >> 172.21.15.59:0/434313893 conn(0x7faa0806bdb0 msgr2=0x7faa08072b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.613+0000 7faa0f800640 1 -- 172.21.15.59:0/434313893 shutdown_connections 2024-05-30T17:03:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:28.613+0000 7faa0f800640 1 -- 172.21.15.59:0/434313893 wait complete. 2024-05-30T17:03:28.653 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:28.654+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:28.653 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:28.654+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:28.654 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:28.654+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:28.654 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:28.654+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:28.654 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:03:28.654+0000 7efd75200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:03:29.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone55781 2024-05-30T17:03:29.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.869+0000 7f0684e00640 1 Processor -- start 2024-05-30T17:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.869+0000 7f0684e00640 1 -- start start 2024-05-30T17:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.873+0000 7f0684e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06800701c0 0x7f06800b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.873+0000 7f0684e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f068006f5a0 0x7f06800cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.873+0000 7f0684e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06800cf9e0 con 0x7f068015eea0 2024-05-30T17:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.873+0000 7f0684e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f06800cbbc0 con 0x7f068006f5a0 2024-05-30T17:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.873+0000 7f0684e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f06800cfcc0 con 0x7f06800701c0 2024-05-30T17:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.873+0000 7f067de00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f068015eea0 0x7f068006ee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42928/0 (socket says 172.21.15.59:42928) 2024-05-30T17:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.873+0000 7f067de00640 1 -- 172.21.15.59:0/2820093477 learned_addr learned my addr 172.21.15.59:0/2820093477 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:03:29.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.877+0000 7f067e800640 1 --2- 172.21.15.59:0/2820093477 >> v2:172.21.15.107:3300/0 conn(0x7f068006f5a0 0x7f06800cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:29.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.877+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1897063490 0 0) 0x7f06800cf9e0 con 0x7f068015eea0 2024-05-30T17:03:29.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.877+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0664007940 con 0x7f068015eea0 2024-05-30T17:03:29.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.877+0000 7f0677e00640 1 --2- 172.21.15.59:0/2820093477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06800701c0 0x7f06800b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:29.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.877+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 997803068 0 0) 0x7f0664007940 con 0x7f068015eea0 2024-05-30T17:03:29.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.877+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06800701c0 msgr2=0x7f06800b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:29.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.877+0000 7f067d400640 1 --2- 172.21.15.59:0/2820093477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06800701c0 0x7f06800b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:29.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.877+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 >> v2:172.21.15.107:3300/0 conn(0x7f068006f5a0 msgr2=0x7f06800cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:29.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.877+0000 7f067d400640 1 --2- 172.21.15.59:0/2820093477 >> v2:172.21.15.107:3300/0 conn(0x7f068006f5a0 0x7f06800cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:29.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.877+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06800cc800 con 0x7f068015eea0 2024-05-30T17:03:29.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.877+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f0670001680 con 0x7f068015eea0 2024-05-30T17:03:29.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.877+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 >> v1:172.21.15.59:6789/0 conn(0x7f068015eea0 legacy=0x7f068006ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:29.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f067d400640 1 --2- 172.21.15.59:0/2820093477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0664007dd0 0x7f06640081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:29.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f067d400640 1 --2- 172.21.15.59:0/2820093477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06800701c0 0x7f0664008c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:29.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f067d400640 1 --2- 172.21.15.59:0/2820093477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0664009160 0x7f06640095e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:29.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06800cfcc0 con 0x7f0664007dd0 2024-05-30T17:03:29.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f066400fe90 con 0x7f0664009160 2024-05-30T17:03:29.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0664010090 con 0x7f06800701c0 2024-05-30T17:03:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f067de00640 1 --2- 172.21.15.59:0/2820093477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0664007dd0 0x7f06640081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f0677e00640 1 --2- 172.21.15.59:0/2820093477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06800701c0 0x7f0664008c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:29.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f067de00640 1 -- 172.21.15.59:0/2820093477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06800701c0 msgr2=0x7f0664008c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:29.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f067de00640 1 --2- 172.21.15.59:0/2820093477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06800701c0 0x7f0664008c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:29.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f067de00640 1 -- 172.21.15.59:0/2820093477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0664009160 msgr2=0x7f06640095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:29.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f067de00640 1 --2- 172.21.15.59:0/2820093477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0664009160 0x7f06640095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:29.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.881+0000 7f067de00640 1 -- 172.21.15.59:0/2820093477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0664007940 con 0x7f0664007dd0 2024-05-30T17:03:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.889+0000 7f067de00640 1 --2- 172.21.15.59:0/2820093477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0664007dd0 0x7f06640081f0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f067000c190 tx=0x7f067001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3be609b207aa77d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:29.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.889+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670007c90 con 0x7f0664007dd0 2024-05-30T17:03:29.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.889+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06700a9020 con 0x7f0664007dd0 2024-05-30T17:03:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.889+0000 7f067d400640 1 -- 172.21.15.59:0/2820093477 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670005b00 con 0x7f0664007dd0 2024-05-30T17:03:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.893+0000 7f0684e00640 1 -- 172.21.15.59:0/2820093477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0664007dd0 msgr2=0x7f06640081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.893+0000 7f0684e00640 1 --2- 172.21.15.59:0/2820093477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0664007dd0 0x7f06640081f0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f067000c190 tx=0x7f067001cc00 comp rx=0 tx=0).stop 2024-05-30T17:03:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.893+0000 7f067e800640 1 -- 172.21.15.59:0/2820093477 reap_dead start 2024-05-30T17:03:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.893+0000 7f0684e00640 1 -- 172.21.15.59:0/2820093477 shutdown_connections 2024-05-30T17:03:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.893+0000 7f0684e00640 1 -- 172.21.15.59:0/2820093477 >> 172.21.15.59:0/2820093477 conn(0x7f06800b2f50 msgr2=0x7f06800b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.893+0000 7f0684e00640 1 -- 172.21.15.59:0/2820093477 shutdown_connections 2024-05-30T17:03:29.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.893+0000 7f0684e00640 1 -- 172.21.15.59:0/2820093477 wait complete. 2024-05-30T17:03:29.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.897+0000 7f0684e00640 1 Processor -- start 2024-05-30T17:03:29.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.897+0000 7f0684e00640 1 -- start start 2024-05-30T17:03:29.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.897+0000 7f0684e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0664007dd0 0x7f06801588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:29.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.897+0000 7f0684e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06801f41a0 0x7f06800c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:29.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.897+0000 7f0684e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0680159e50 0x7f068015a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:29.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.897+0000 7f0684e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06800ae230 con 0x7f0664007dd0 2024-05-30T17:03:29.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.897+0000 7f0684e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f06800b3e50 con 0x7f0680159e50 2024-05-30T17:03:29.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.897+0000 7f0684e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f06800ae3b0 con 0x7f06801f41a0 2024-05-30T17:03:29.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.897+0000 7f067de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0664007dd0 0x7f06801588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:29.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.897+0000 7f067de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0664007dd0 0x7f06801588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35472/0 (socket says 172.21.15.59:35472) 2024-05-30T17:03:29.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.897+0000 7f067de00640 1 -- 172.21.15.59:0/2141122772 learned_addr learned my addr 172.21.15.59:0/2141122772 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:29.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.901+0000 7f0677e00640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06801f41a0 0x7f06800c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:29.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.901+0000 7f067de00640 1 -- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06801f41a0 msgr2=0x7f06800c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:29.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.901+0000 7f067de00640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06801f41a0 0x7f06800c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:29.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.901+0000 7f067de00640 1 -- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0680159e50 msgr2=0x7f068015a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:29.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.901+0000 7f067de00640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0680159e50 0x7f068015a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:29.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.901+0000 7f067de00640 1 -- 172.21.15.59:0/2141122772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06800b5e20 con 0x7f0664007dd0 2024-05-30T17:03:29.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.901+0000 7f067de00640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0664007dd0 0x7f06801588b0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f067001ca30 tx=0x7f0664009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:29.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.901+0000 7f0676000640 1 -- 172.21.15.59:0/2141122772 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670004bb0 con 0x7f0664007dd0 2024-05-30T17:03:29.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.901+0000 7f0676000640 1 -- 172.21.15.59:0/2141122772 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0670004d50 con 0x7f0664007dd0 2024-05-30T17:03:29.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.901+0000 7f0676000640 1 -- 172.21.15.59:0/2141122772 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06700072f0 con 0x7f0664007dd0 2024-05-30T17:03:29.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.901+0000 7f0684e00640 1 -- 172.21.15.59:0/2141122772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06800b5b40 con 0x7f0664007dd0 2024-05-30T17:03:29.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.901+0000 7f0684e00640 1 -- 172.21.15.59:0/2141122772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06801f39a0 con 0x7f0664007dd0 2024-05-30T17:03:29.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.905+0000 7f0684e00640 1 -- 172.21.15.59:0/2141122772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068015a810 con 0x7f0664007dd0 2024-05-30T17:03:29.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.909+0000 7f0676000640 1 -- 172.21.15.59:0/2141122772 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 36) ==== 90384+0+0 (secure 0 0 0) 0x7f0670007490 con 0x7f0664007dd0 2024-05-30T17:03:29.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.913+0000 7f0676000640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f065c069df0 0x7f065c06c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:29.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.913+0000 7f0676000640 1 -- 172.21.15.59:0/2141122772 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f067011ec00 con 0x7f0664007dd0 2024-05-30T17:03:29.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.917+0000 7f0676000640 1 -- 172.21.15.59:0/2141122772 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06700bf030 con 0x7f0664007dd0 2024-05-30T17:03:29.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.917+0000 7f0677e00640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f065c069df0 0x7f065c06c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:29.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:29.929+0000 7f0677e00640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f065c069df0 0x7f065c06c2b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f06800b5700 tx=0x7f0668008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:30.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.273+0000 7f0684e00640 1 -- 172.21.15.59:0/2141122772 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone55781", "target": ["mon-mgr", ""]}) -- 0x7f0680068a90 con 0x7f065c069df0 2024-05-30T17:03:30.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.337+0000 7f0676000640 1 -- 172.21.15.59:0/2141122772 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7f06700ecb00 con 0x7f0664007dd0 2024-05-30T17:03:30.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0676000640 1 -- 172.21.15.59:0/2141122772 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0680068a90 con 0x7f065c069df0 2024-05-30T17:03:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0684e00640 1 -- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f065c069df0 msgr2=0x7f065c06c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0684e00640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f065c069df0 0x7f065c06c2b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f06800b5700 tx=0x7f0668008040 comp rx=0 tx=0).stop 2024-05-30T17:03:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0684e00640 1 -- 172.21.15.59:0/2141122772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0664007dd0 msgr2=0x7f06801588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0684e00640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0664007dd0 0x7f06801588b0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f067001ca30 tx=0x7f0664009c50 comp rx=0 tx=0).stop 2024-05-30T17:03:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0684e00640 1 -- 172.21.15.59:0/2141122772 shutdown_connections 2024-05-30T17:03:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0684e00640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f065c069df0 0x7f065c06c2b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0684e00640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0680159e50 0x7f068015a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0684e00640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06801f41a0 0x7f06800c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0684e00640 1 --2- 172.21.15.59:0/2141122772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0664007dd0 0x7f06801588b0 secure :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f067001ca30 tx=0x7f0664009c50 comp rx=0 tx=0).stop 2024-05-30T17:03:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0684e00640 1 -- 172.21.15.59:0/2141122772 >> 172.21.15.59:0/2141122772 conn(0x7f06800b2f50 msgr2=0x7f06800b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0684e00640 1 -- 172.21.15.59:0/2141122772 shutdown_connections 2024-05-30T17:03:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:30.857+0000 7f0684e00640 1 -- 172.21.15.59:0/2141122772 wait complete. 2024-05-30T17:03:30.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone55782 2024-05-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.141+0000 7fc835800640 1 Processor -- start 2024-05-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.141+0000 7fc835800640 1 -- start start 2024-05-30T17:03:31.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.145+0000 7fc835800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8300b39e0 0x7fc830162b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.145+0000 7fc835800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8300b3fc0 con 0x7fc8300d0d70 2024-05-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.145+0000 7fc835800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc83006ddb0 con 0x7fc830162780 2024-05-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.145+0000 7fc835800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc8300b42a0 con 0x7fc8300b39e0 2024-05-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.145+0000 7fc82f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8300b39e0 0x7fc830162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.145+0000 7fc82f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8300b39e0 0x7fc830162b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35478/0 (socket says 172.21.15.59:35478) 2024-05-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.145+0000 7fc82f400640 1 -- 172.21.15.59:0/2022217315 learned_addr learned my addr 172.21.15.59:0/2022217315 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.145+0000 7fc82f400640 1 -- 172.21.15.59:0/2022217315 >> v1:172.21.15.107:6789/0 conn(0x7fc830162780 legacy=0x7fc8300d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.145+0000 7fc82f400640 1 -- 172.21.15.59:0/2022217315 >> v1:172.21.15.59:6789/0 conn(0x7fc8300d0d70 legacy=0x7fc8300b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.149+0000 7fc82f400640 1 -- 172.21.15.59:0/2022217315 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83006e090 con 0x7fc8300b39e0 2024-05-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.153+0000 7fc82f400640 1 --2- 172.21.15.59:0/2022217315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8300b39e0 0x7fc830162b60 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fc828009e50 tx=0x7fc82801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e511514f93a0ec95 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.153+0000 7fc82d600640 1 -- 172.21.15.59:0/2022217315 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8280a5730 con 0x7fc8300b39e0 2024-05-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.153+0000 7fc82d600640 1 -- 172.21.15.59:0/2022217315 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8280a58d0 con 0x7fc8300b39e0 2024-05-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.153+0000 7fc82d600640 1 -- 172.21.15.59:0/2022217315 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8280a5ca0 con 0x7fc8300b39e0 2024-05-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.153+0000 7fc835800640 1 -- 172.21.15.59:0/2022217315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8300b39e0 msgr2=0x7fc830162b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.153+0000 7fc835800640 1 --2- 172.21.15.59:0/2022217315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8300b39e0 0x7fc830162b60 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fc828009e50 tx=0x7fc82801c960 comp rx=0 tx=0).stop 2024-05-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.153+0000 7fc835800640 1 -- 172.21.15.59:0/2022217315 shutdown_connections 2024-05-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.153+0000 7fc835800640 1 --2- 172.21.15.59:0/2022217315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8300b39e0 0x7fc830162b60 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.153+0000 7fc835800640 1 -- 172.21.15.59:0/2022217315 >> 172.21.15.59:0/2022217315 conn(0x7fc83006bdb0 msgr2=0x7fc83006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.153+0000 7fc835800640 1 -- 172.21.15.59:0/2022217315 shutdown_connections 2024-05-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.153+0000 7fc835800640 1 -- 172.21.15.59:0/2022217315 wait complete. 2024-05-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc835800640 1 Processor -- start 2024-05-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc835800640 1 -- start start 2024-05-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc835800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8300b39e0 0x7fc8300ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc835800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8300d0d70 0x7fc830164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc835800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc830162780 0x7fc83015b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc835800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc830170330 con 0x7fc8300d0d70 2024-05-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc835800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc8301701b0 con 0x7fc830162780 2024-05-30T17:03:31.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc835800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc8301704b0 con 0x7fc8300b39e0 2024-05-30T17:03:31.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc82e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8300d0d70 0x7fc830164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc82e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8300d0d70 0x7fc830164f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35494/0 (socket says 172.21.15.59:35494) 2024-05-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc82e000640 1 -- 172.21.15.59:0/1250123330 learned_addr learned my addr 172.21.15.59:0/1250123330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc82f400640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc830162780 0x7fc83015b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc82ea00640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8300b39e0 0x7fc8300ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc82e000640 1 -- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8300b39e0 msgr2=0x7fc8300ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc82e000640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8300b39e0 0x7fc8300ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc82e000640 1 -- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc830162780 msgr2=0x7fc83015b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc82e000640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc830162780 0x7fc83015b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc82e000640 1 -- 172.21.15.59:0/1250123330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8300adc20 con 0x7fc8300d0d70 2024-05-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc82f400640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc830162780 0x7fc83015b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc82e000640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8300d0d70 0x7fc830164f00 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00c450 tx=0x7fc81c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc826a00640 1 -- 172.21.15.59:0/1250123330 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c016020 con 0x7fc8300d0d70 2024-05-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc826a00640 1 -- 172.21.15.59:0/1250123330 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81c0052d0 con 0x7fc8300d0d70 2024-05-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc835800640 1 -- 172.21.15.59:0/1250123330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8300adf00 con 0x7fc8300d0d70 2024-05-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc826a00640 1 -- 172.21.15.59:0/1250123330 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c007260 con 0x7fc8300d0d70 2024-05-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.157+0000 7fc835800640 1 -- 172.21.15.59:0/1250123330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8300ae4c0 con 0x7fc8300d0d70 2024-05-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.161+0000 7fc835800640 1 -- 172.21.15.59:0/1250123330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc830068a90 con 0x7fc8300d0d70 2024-05-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.165+0000 7fc826a00640 1 -- 172.21.15.59:0/1250123330 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7fc81c007400 con 0x7fc8300d0d70 2024-05-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.165+0000 7fc826a00640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc810069e80 0x7fc81006c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.165+0000 7fc826a00640 1 -- 172.21.15.59:0/1250123330 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7fc81c0860b0 con 0x7fc8300d0d70 2024-05-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.169+0000 7fc82ea00640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc810069e80 0x7fc81006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:31.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.169+0000 7fc826a00640 1 -- 172.21.15.59:0/1250123330 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc81c020020 con 0x7fc8300d0d70 2024-05-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.177+0000 7fc82ea00640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc810069e80 0x7fc81006c340 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc82000b810 tx=0x7fc820008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.517+0000 7fc835800640 1 -- 172.21.15.59:0/1250123330 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone55782", "target": ["mon-mgr", ""]}) -- 0x7fc8300cfa40 con 0x7fc810069e80 2024-05-30T17:03:31.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.945+0000 7fc826a00640 1 -- 172.21.15.59:0/1250123330 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc8300cfa40 con 0x7fc810069e80 2024-05-30T17:03:31.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.949+0000 7fc835800640 1 -- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc810069e80 msgr2=0x7fc81006c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:31.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.949+0000 7fc835800640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc810069e80 0x7fc81006c340 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc82000b810 tx=0x7fc820008040 comp rx=0 tx=0).stop 2024-05-30T17:03:31.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.949+0000 7fc835800640 1 -- 172.21.15.59:0/1250123330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8300d0d70 msgr2=0x7fc830164f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:31.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.949+0000 7fc835800640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8300d0d70 0x7fc830164f00 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00c450 tx=0x7fc81c00c910 comp rx=0 tx=0).stop 2024-05-30T17:03:31.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.949+0000 7fc835800640 1 -- 172.21.15.59:0/1250123330 shutdown_connections 2024-05-30T17:03:31.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.949+0000 7fc835800640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc810069e80 0x7fc81006c340 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:31.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.949+0000 7fc835800640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc830162780 0x7fc83015b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:31.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.949+0000 7fc835800640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8300d0d70 0x7fc830164f00 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:31.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.949+0000 7fc835800640 1 --2- 172.21.15.59:0/1250123330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8300b39e0 0x7fc8300ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:31.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.949+0000 7fc835800640 1 -- 172.21.15.59:0/1250123330 >> 172.21.15.59:0/1250123330 conn(0x7fc83006bdb0 msgr2=0x7fc8300b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:31.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.949+0000 7fc835800640 1 -- 172.21.15.59:0/1250123330 shutdown_connections 2024-05-30T17:03:31.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:31.949+0000 7fc835800640 1 -- 172.21.15.59:0/1250123330 wait complete. 2024-05-30T17:03:31.986 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone55783 2024-05-30T17:03:32.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.181+0000 7f0b14a00640 1 Processor -- start 2024-05-30T17:03:32.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b14a00640 1 -- start start 2024-05-30T17:03:32.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b14a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b1015b8f0 0x7f0b100b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:32.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b14a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0b100cbd30 0x7f0b100cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b14a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b100ae230 0x7f0b100ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b14a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0b100b2d40 con 0x7f0b100ae230 2024-05-30T17:03:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b14a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0b100b2780 con 0x7f0b100cbd30 2024-05-30T17:03:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b14a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0b100b2a60 con 0x7f0b1015b8f0 2024-05-30T17:03:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b0de00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b1015b8f0 0x7f0b100b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b0d400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0b100cbd30 0x7f0b100cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b0de00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b1015b8f0 0x7f0b100b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:60362/0 (socket says 172.21.15.59:60362) 2024-05-30T17:03:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b0de00640 1 -- 172.21.15.59:0/2766367223 learned_addr learned my addr 172.21.15.59:0/2766367223 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b0de00640 1 -- 172.21.15.59:0/2766367223 >> v2:172.21.15.107:3300/0 conn(0x7f0b100cbd30 msgr2=0x7f0b100cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b0de00640 1 --2- 172.21.15.59:0/2766367223 >> v2:172.21.15.107:3300/0 conn(0x7f0b100cbd30 0x7f0b100cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b0de00640 1 -- 172.21.15.59:0/2766367223 >> v2:172.21.15.59:3300/0 conn(0x7f0b100ae230 msgr2=0x7f0b100ae6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T17:03:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b0de00640 1 --2- 172.21.15.59:0/2766367223 >> v2:172.21.15.59:3300/0 conn(0x7f0b100ae230 0x7f0b100ae6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.185+0000 7f0b0de00640 1 -- 172.21.15.59:0/2766367223 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b100af370 con 0x7f0b1015b8f0 2024-05-30T17:03:32.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b0de00640 1 --2- 172.21.15.59:0/2766367223 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b1015b8f0 0x7f0b100b20f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0b100756d0 tx=0x7f0b0001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25fab8de4713b46d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:32.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b0ca00640 1 -- 172.21.15.59:0/2766367223 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b000b5070 con 0x7f0b1015b8f0 2024-05-30T17:03:32.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b0ca00640 1 -- 172.21.15.59:0/2766367223 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b000a89f0 con 0x7f0b1015b8f0 2024-05-30T17:03:32.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b0ca00640 1 -- 172.21.15.59:0/2766367223 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b000a8dc0 con 0x7f0b1015b8f0 2024-05-30T17:03:32.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b14a00640 1 -- 172.21.15.59:0/2766367223 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b1015b8f0 msgr2=0x7f0b100b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:32.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b14a00640 1 --2- 172.21.15.59:0/2766367223 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b1015b8f0 0x7f0b100b20f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0b100756d0 tx=0x7f0b0001ed30 comp rx=0 tx=0).stop 2024-05-30T17:03:32.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b14a00640 1 -- 172.21.15.59:0/2766367223 shutdown_connections 2024-05-30T17:03:32.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b14a00640 1 --2- 172.21.15.59:0/2766367223 >> v2:172.21.15.107:3300/0 conn(0x7f0b100cbd30 0x7f0b100cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:32.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b14a00640 1 --2- 172.21.15.59:0/2766367223 >> v2:172.21.15.59:3300/0 conn(0x7f0b100ae230 0x7f0b100ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:32.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b14a00640 1 --2- 172.21.15.59:0/2766367223 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b1015b8f0 0x7f0b100b20f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:32.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b14a00640 1 -- 172.21.15.59:0/2766367223 >> 172.21.15.59:0/2766367223 conn(0x7f0b100b2f50 msgr2=0x7f0b100b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:32.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b14a00640 1 -- 172.21.15.59:0/2766367223 shutdown_connections 2024-05-30T17:03:32.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.193+0000 7f0b14a00640 1 -- 172.21.15.59:0/2766367223 wait complete. 2024-05-30T17:03:32.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b14a00640 1 Processor -- start 2024-05-30T17:03:32.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b14a00640 1 -- start start 2024-05-30T17:03:32.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b14a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b100ae230 0x7f0b100c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:32.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b14a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b100cbd30 0x7f0b10169830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:32.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b14a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b1015b8f0 0x7f0b1016c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:32.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b14a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0b100cc170 con 0x7f0b100cbd30 2024-05-30T17:03:32.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b14a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0b100d0170 con 0x7f0b1015b8f0 2024-05-30T17:03:32.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b14a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1015bcd0 con 0x7f0b100ae230 2024-05-30T17:03:32.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b0d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b100cbd30 0x7f0b10169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:32.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b0d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b100cbd30 0x7f0b10169830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55454/0 (socket says 172.21.15.59:55454) 2024-05-30T17:03:32.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b0d400640 1 -- 172.21.15.59:0/2815485066 learned_addr learned my addr 172.21.15.59:0/2815485066 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:32.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b0e800640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b1015b8f0 0x7f0b1016c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:32.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b0de00640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b100ae230 0x7f0b100c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:32.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b0d400640 1 -- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b100ae230 msgr2=0x7f0b100c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:32.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b0d400640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b100ae230 0x7f0b100c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:32.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b0d400640 1 -- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b1015b8f0 msgr2=0x7f0b1016c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:32.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b0d400640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b1015b8f0 0x7f0b1016c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:32.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b0d400640 1 -- 172.21.15.59:0/2815485066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1016c9b0 con 0x7f0b100cbd30 2024-05-30T17:03:32.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.197+0000 7f0b0d400640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b100cbd30 0x7f0b10169830 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00d830 tx=0x7f0afc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:32.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.201+0000 7f0b06000640 1 -- 172.21.15.59:0/2815485066 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc00b6c0 con 0x7f0b100cbd30 2024-05-30T17:03:32.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.201+0000 7f0b06000640 1 -- 172.21.15.59:0/2815485066 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc019070 con 0x7f0b100cbd30 2024-05-30T17:03:32.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.201+0000 7f0b06000640 1 -- 172.21.15.59:0/2815485066 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc00ba60 con 0x7f0b100cbd30 2024-05-30T17:03:32.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.201+0000 7f0b14a00640 1 -- 172.21.15.59:0/2815485066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b100cdee0 con 0x7f0b100cbd30 2024-05-30T17:03:32.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.201+0000 7f0b14a00640 1 -- 172.21.15.59:0/2815485066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b100ce4a0 con 0x7f0b100cbd30 2024-05-30T17:03:32.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.201+0000 7f0b14a00640 1 -- 172.21.15.59:0/2815485066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b10068a90 con 0x7f0b100cbd30 2024-05-30T17:03:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.201+0000 7f0b06000640 1 -- 172.21.15.59:0/2815485066 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7f0afc01e460 con 0x7f0b100cbd30 2024-05-30T17:03:32.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.205+0000 7f0b06000640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0af0069ed0 0x7f0af006c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:32.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.205+0000 7f0b06000640 1 -- 172.21.15.59:0/2815485066 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f0afc085e30 con 0x7f0b100cbd30 2024-05-30T17:03:32.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.209+0000 7f0b0de00640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0af0069ed0 0x7f0af006c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.209+0000 7f0b0de00640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0af0069ed0 0x7f0af006c390 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0b000b2000 tx=0x7f0b000aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.209+0000 7f0b06000640 1 -- 172.21.15.59:0/2815485066 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0afc057fd0 con 0x7f0b100cbd30 2024-05-30T17:03:32.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:32.505+0000 7f0b14a00640 1 -- 172.21.15.59:0/2815485066 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone55783", "target": ["mon-mgr", ""]}) -- 0x7f0b100cef70 con 0x7f0af0069ed0 2024-05-30T17:03:35.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.229+0000 7f0b06000640 1 -- 172.21.15.59:0/2815485066 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0b100cef70 con 0x7f0af0069ed0 2024-05-30T17:03:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.233+0000 7f0b14a00640 1 -- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0af0069ed0 msgr2=0x7f0af006c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.233+0000 7f0b14a00640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0af0069ed0 0x7f0af006c390 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0b000b2000 tx=0x7f0b000aa070 comp rx=0 tx=0).stop 2024-05-30T17:03:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.233+0000 7f0b14a00640 1 -- 172.21.15.59:0/2815485066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b100cbd30 msgr2=0x7f0b10169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.233+0000 7f0b14a00640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b100cbd30 0x7f0b10169830 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00d830 tx=0x7f0afc00dcf0 comp rx=0 tx=0).stop 2024-05-30T17:03:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.233+0000 7f0b14a00640 1 -- 172.21.15.59:0/2815485066 shutdown_connections 2024-05-30T17:03:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.233+0000 7f0b14a00640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0af0069ed0 0x7f0af006c390 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.233+0000 7f0b14a00640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b1015b8f0 0x7f0b1016c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.233+0000 7f0b14a00640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b100cbd30 0x7f0b10169830 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.233+0000 7f0b14a00640 1 --2- 172.21.15.59:0/2815485066 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b100ae230 0x7f0b100c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:35.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.233+0000 7f0b14a00640 1 -- 172.21.15.59:0/2815485066 >> 172.21.15.59:0/2815485066 conn(0x7f0b100b2f50 msgr2=0x7f0b100afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:35.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.233+0000 7f0b14a00640 1 -- 172.21.15.59:0/2815485066 shutdown_connections 2024-05-30T17:03:35.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:35.233+0000 7f0b14a00640 1 -- 172.21.15.59:0/2815485066 wait complete. 2024-05-30T17:03:35.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:03:35.982 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:03:40.256 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:03:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fcce00640 1 Processor -- start 2024-05-30T17:03:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fcce00640 1 -- start start 2024-05-30T17:03:40.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fcce00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7fc815c890 0x7f7fc8160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fcce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fc80b2b00 0x7f7fc80b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fcce00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc806c390 con 0x7f7fc806b9b0 2024-05-30T17:03:40.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fcce00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc8160790 con 0x7f7fc815c890 2024-05-30T17:03:40.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fcce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc806c670 con 0x7f7fc80b2b00 2024-05-30T17:03:40.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fbfe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7fc806b9b0 0x7f7fc80b23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49316/0 (socket says 172.21.15.59:49316) 2024-05-30T17:03:40.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fbfe00640 1 -- 172.21.15.59:0/2577659002 learned_addr learned my addr 172.21.15.59:0/2577659002 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:03:40.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc6800640 1 --2- 172.21.15.59:0/2577659002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fc80b2b00 0x7f7fc80b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5e00640 1 --2- 172.21.15.59:0/2577659002 >> v2:172.21.15.107:3300/0 conn(0x7f7fc815c890 0x7f7fc8160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4183814720 0 0) 0x7f7fc806c390 con 0x7f7fc806b9b0 2024-05-30T17:03:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fac003530 con 0x7f7fc806b9b0 2024-05-30T17:03:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2675770219 0 0) 0x7f7fac003530 con 0x7f7fc806b9b0 2024-05-30T17:03:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fc80b2b00 msgr2=0x7f7fc80b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 --2- 172.21.15.59:0/2577659002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fc80b2b00 0x7f7fc80b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 >> v2:172.21.15.107:3300/0 conn(0x7f7fc815c890 msgr2=0x7f7fc8160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 --2- 172.21.15.59:0/2577659002 >> v2:172.21.15.107:3300/0 conn(0x7f7fc815c890 0x7f7fc8160c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc8160420 con 0x7f7fc806b9b0 2024-05-30T17:03:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f7fb0001680 con 0x7f7fc806b9b0 2024-05-30T17:03:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 >> v1:172.21.15.59:6789/0 conn(0x7f7fc806b9b0 legacy=0x7f7fc80b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 --2- 172.21.15.59:0/2577659002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac0039c0 0x7f7fac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 --2- 172.21.15.59:0/2577659002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fac004810 0x7f7fac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 --2- 172.21.15.59:0/2577659002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fc80b2b00 0x7f7fac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8160790 con 0x7f7fac004810 2024-05-30T17:03:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc806c670 con 0x7f7fac0039c0 2024-05-30T17:03:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7fac00b9d0 con 0x7f7fc80b2b00 2024-05-30T17:03:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fbfe00640 1 --2- 172.21.15.59:0/2577659002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fac004810 0x7f7fac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc5e00640 1 --2- 172.21.15.59:0/2577659002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac0039c0 0x7f7fac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fc6800640 1 --2- 172.21.15.59:0/2577659002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fc80b2b00 0x7f7fac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fbfe00640 1 -- 172.21.15.59:0/2577659002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fc80b2b00 msgr2=0x7f7fac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:40.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fbfe00640 1 --2- 172.21.15.59:0/2577659002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fc80b2b00 0x7f7fac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fbfe00640 1 -- 172.21.15.59:0/2577659002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac0039c0 msgr2=0x7f7fac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:40.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fbfe00640 1 --2- 172.21.15.59:0/2577659002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac0039c0 0x7f7fac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.409+0000 7f7fbfe00640 1 -- 172.21.15.59:0/2577659002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac003530 con 0x7f7fac004810 2024-05-30T17:03:40.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.413+0000 7f7fbfe00640 1 --2- 172.21.15.59:0/2577659002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fac004810 0x7f7fac004c90 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000c240 tx=0x7f7fb001f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27764c787154701c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:40.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.413+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0007d60 con 0x7f7fac004810 2024-05-30T17:03:40.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.413+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb0005b00 con 0x7f7fac004810 2024-05-30T17:03:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.413+0000 7f7fc5400640 1 -- 172.21.15.59:0/2577659002 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0007070 con 0x7f7fac004810 2024-05-30T17:03:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.413+0000 7f7fcce00640 1 -- 172.21.15.59:0/2577659002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fac004810 msgr2=0x7f7fac004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.413+0000 7f7fcce00640 1 --2- 172.21.15.59:0/2577659002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fac004810 0x7f7fac004c90 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000c240 tx=0x7f7fb001f430 comp rx=0 tx=0).stop 2024-05-30T17:03:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.413+0000 7f7fc6800640 1 -- 172.21.15.59:0/2577659002 reap_dead start 2024-05-30T17:03:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.413+0000 7f7fcce00640 1 -- 172.21.15.59:0/2577659002 shutdown_connections 2024-05-30T17:03:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.413+0000 7f7fcce00640 1 -- 172.21.15.59:0/2577659002 >> 172.21.15.59:0/2577659002 conn(0x7f7fc809aa40 msgr2=0x7f7fc80b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.413+0000 7f7fcce00640 1 -- 172.21.15.59:0/2577659002 shutdown_connections 2024-05-30T17:03:40.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.413+0000 7f7fcce00640 1 -- 172.21.15.59:0/2577659002 wait complete. 2024-05-30T17:03:40.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fcce00640 1 Processor -- start 2024-05-30T17:03:40.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fcce00640 1 -- start start 2024-05-30T17:03:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fcce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fac004810 0x7f7fc8159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fcce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fc80d0910 0x7f7fc80b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fcce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fc80c9090 0x7f7fc80afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fcce00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80b3dd0 con 0x7f7fc80d0910 2024-05-30T17:03:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fcce00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80b3c50 con 0x7f7fc80c9090 2024-05-30T17:03:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fcce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc806be10 con 0x7f7fac004810 2024-05-30T17:03:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fbfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fc80d0910 0x7f7fc80b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fbfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fc80d0910 0x7f7fc80b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55478/0 (socket says 172.21.15.59:55478) 2024-05-30T17:03:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fbfe00640 1 -- 172.21.15.59:0/3110247463 learned_addr learned my addr 172.21.15.59:0/3110247463 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fc5e00640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fac004810 0x7f7fc8159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fc6800640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fc80c9090 0x7f7fc80afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fbfe00640 1 -- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fac004810 msgr2=0x7f7fc8159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:40.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fbfe00640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fac004810 0x7f7fc8159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fbfe00640 1 -- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fc80c9090 msgr2=0x7f7fc80afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:40.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fbfe00640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fc80c9090 0x7f7fc80afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fbfe00640 1 -- 172.21.15.59:0/3110247463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc8159da0 con 0x7f7fc80d0910 2024-05-30T17:03:40.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fbfe00640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fc80d0910 0x7f7fc80b6440 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000c240 tx=0x7f7fac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:40.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fbe000640 1 -- 172.21.15.59:0/3110247463 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0001ca0 con 0x7f7fc80d0910 2024-05-30T17:03:40.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fbe000640 1 -- 172.21.15.59:0/3110247463 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb0005cb0 con 0x7f7fc80d0910 2024-05-30T17:03:40.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.417+0000 7f7fcce00640 1 -- 172.21.15.59:0/3110247463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc80c85f0 con 0x7f7fc80d0910 2024-05-30T17:03:40.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.421+0000 7f7fbe000640 1 -- 172.21.15.59:0/3110247463 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0005e60 con 0x7f7fc80d0910 2024-05-30T17:03:40.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.421+0000 7f7fcce00640 1 -- 172.21.15.59:0/3110247463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc80b6c20 con 0x7f7fc80d0910 2024-05-30T17:03:40.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.421+0000 7f7fcce00640 1 -- 172.21.15.59:0/3110247463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc8068a90 con 0x7f7fc80d0910 2024-05-30T17:03:40.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.421+0000 7f7fbe000640 1 -- 172.21.15.59:0/3110247463 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7f7fb00ba030 con 0x7f7fc80d0910 2024-05-30T17:03:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.421+0000 7f7fbe000640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7fa4069e80 0x7f7fa406c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.421+0000 7f7fbe000640 1 -- 172.21.15.59:0/3110247463 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f7fb01222f0 con 0x7f7fc80d0910 2024-05-30T17:03:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.421+0000 7f7fc5e00640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7fa4069e80 0x7f7fa406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.421+0000 7f7fc5e00640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7fa4069e80 0x7f7fa406c340 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009be0 tx=0x7f7fb8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:40.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.425+0000 7f7fbe000640 1 -- 172.21.15.59:0/3110247463 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7fb00c1030 con 0x7f7fc80d0910 2024-05-30T17:03:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 -- 172.21.15.59:0/3110247463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7fc80b1230 con 0x7f7fc80d0910 2024-05-30T17:03:40.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fbe000640 1 -- 172.21.15.59:0/3110247463 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2124 (secure 0 0 0) 0x7f7fc8159da0 con 0x7f7fc80d0910 2024-05-30T17:03:40.653 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:03:40.653 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:03:40.653 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:03:40.653 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:03:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:03:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:03:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:03:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:03:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:03:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:03:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 900, 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:03:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:03:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 116, 2024-05-30T17:03:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:03:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:03:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:03:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:03:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:03:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:03:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:03:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:03:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1714, 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 7056098110, 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 15133499392, 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 757960613888, 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 323213817, 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 319056211, 2024-05-30T17:03:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 79, 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 89 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 72, 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8, 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 8, 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:03:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8460 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:03:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:03:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:03:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:03:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T17:03:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:02:25.347963+0000", 2024-05-30T17:03:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:03:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:03:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: "ae4fdb91-7bfa-4a93-a691-3ed755f261d2": { 2024-05-30T17:03:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 27.0 seconds before exiting (11s)\n [============================] ", 2024-05-30T17:03:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:03:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:03:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:40.661 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:03:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 -- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7fa4069e80 msgr2=0x7f7fa406c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7fa4069e80 0x7f7fa406c340 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009be0 tx=0x7f7fb8009190 comp rx=0 tx=0).stop 2024-05-30T17:03:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 -- 172.21.15.59:0/3110247463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fc80d0910 msgr2=0x7f7fc80b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fc80d0910 0x7f7fc80b6440 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000c240 tx=0x7f7fac005840 comp rx=0 tx=0).stop 2024-05-30T17:03:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 -- 172.21.15.59:0/3110247463 shutdown_connections 2024-05-30T17:03:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7fa4069e80 0x7f7fa406c340 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fc80c9090 0x7f7fc80afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fc80d0910 0x7f7fc80b6440 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 --2- 172.21.15.59:0/3110247463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fac004810 0x7f7fc8159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 -- 172.21.15.59:0/3110247463 >> 172.21.15.59:0/3110247463 conn(0x7f7fc809aa40 msgr2=0x7f7fc8070710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 -- 172.21.15.59:0/3110247463 shutdown_connections 2024-05-30T17:03:40.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.653+0000 7f7fcce00640 1 -- 172.21.15.59:0/3110247463 wait complete. 2024-05-30T17:03:40.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:03:40.674 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -lh volumes/_nogroup/subvol_clone55781/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e 2024-05-30T17:03:40.674 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:03:40.687 INFO:teuthology.orchestra.run.smithi059.stderr:ls: cannot access 'volumes/_nogroup/subvol_clone55781/a0fcd62f-b8a8-4ae1-84f0-857fc72ddf4e': No such file or directory 2024-05-30T17:03:40.688 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-30T17:03:40.688 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T17:03:40.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.873+0000 7f6b35c00640 1 Processor -- start 2024-05-30T17:03:40.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.873+0000 7f6b35c00640 1 -- start start 2024-05-30T17:03:40.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.873+0000 7f6b35c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6b300cfa40 0x7f6b3015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.873+0000 7f6b35c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b300cfe20 0x7f6b300b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.873+0000 7f6b35c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b3015f3b0 con 0x7f6b300b3dd0 2024-05-30T17:03:40.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.873+0000 7f6b35c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6b3015f690 con 0x7f6b300cfa40 2024-05-30T17:03:40.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.873+0000 7f6b35c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6b3015f970 con 0x7f6b300cfe20 2024-05-30T17:03:40.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b27e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b300cfe20 0x7f6b300b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b2ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6b300cfa40 0x7f6b3015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b27e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b300cfe20 0x7f6b300b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:60422/0 (socket says 172.21.15.59:60422) 2024-05-30T17:03:40.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b27e00640 1 -- 172.21.15.59:0/3390139823 learned_addr learned my addr 172.21.15.59:0/3390139823 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:40.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b2f400640 1 --1- 172.21.15.59:0/3390139823 >> v1:172.21.15.107:6789/0 conn(0x7f6b300b3dd0 0x7f6b30072060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:55862/0 (socket says 172.21.15.59:55862) 2024-05-30T17:03:40.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b27e00640 1 -- 172.21.15.59:0/3390139823 >> v2:172.21.15.107:3300/0 conn(0x7f6b300cfa40 msgr2=0x7f6b3015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:40.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b27e00640 1 --2- 172.21.15.59:0/3390139823 >> v2:172.21.15.107:3300/0 conn(0x7f6b300cfa40 0x7f6b3015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b27e00640 1 -- 172.21.15.59:0/3390139823 >> v1:172.21.15.107:6789/0 conn(0x7f6b300b3dd0 legacy=0x7f6b30072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:40.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b27e00640 1 -- 172.21.15.59:0/3390139823 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b300b3370 con 0x7f6b300cfe20 2024-05-30T17:03:40.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b27e00640 1 --2- 172.21.15.59:0/3390139823 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b300cfe20 0x7f6b300b3890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009870 tx=0x7f6b1801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f24a8a03ae2f7a2d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:40.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b2e000640 1 -- 172.21.15.59:0/3390139823 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180a7070 con 0x7f6b300cfe20 2024-05-30T17:03:40.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b2e000640 1 -- 172.21.15.59:0/3390139823 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b180b0070 con 0x7f6b300cfe20 2024-05-30T17:03:40.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.877+0000 7f6b2e000640 1 -- 172.21.15.59:0/3390139823 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180ab890 con 0x7f6b300cfe20 2024-05-30T17:03:40.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 -- 172.21.15.59:0/3390139823 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b300cfe20 msgr2=0x7f6b300b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:40.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 --2- 172.21.15.59:0/3390139823 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b300cfe20 0x7f6b300b3890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009870 tx=0x7f6b1801c560 comp rx=0 tx=0).stop 2024-05-30T17:03:40.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 -- 172.21.15.59:0/3390139823 shutdown_connections 2024-05-30T17:03:40.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 --2- 172.21.15.59:0/3390139823 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b300cfe20 0x7f6b300b3890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 --2- 172.21.15.59:0/3390139823 >> v2:172.21.15.107:3300/0 conn(0x7f6b300cfa40 0x7f6b3015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 -- 172.21.15.59:0/3390139823 >> 172.21.15.59:0/3390139823 conn(0x7f6b300b22d0 msgr2=0x7f6b300b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 -- 172.21.15.59:0/3390139823 shutdown_connections 2024-05-30T17:03:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 -- 172.21.15.59:0/3390139823 wait complete. 2024-05-30T17:03:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 Processor -- start 2024-05-30T17:03:40.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 -- start start 2024-05-30T17:03:40.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b300b3dd0 0x7f6b30099300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b300cfa40 0x7f6b300ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b300cfe20 0x7f6b300ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6b30155250 con 0x7f6b300cfa40 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301550d0 con 0x7f6b300cfe20 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b35c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6b301553d0 con 0x7f6b300b3dd0 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b27e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b300cfa40 0x7f6b300ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b27e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b300cfa40 0x7f6b300ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55492/0 (socket says 172.21.15.59:55492) 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b27e00640 1 -- 172.21.15.59:0/2527296309 learned_addr learned my addr 172.21.15.59:0/2527296309 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b2ea00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b300b3dd0 0x7f6b30099300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b2f400640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b300cfe20 0x7f6b300ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b27e00640 1 -- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b300b3dd0 msgr2=0x7f6b30099300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b27e00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b300b3dd0 0x7f6b30099300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b27e00640 1 -- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b300cfe20 msgr2=0x7f6b300ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:40.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b27e00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b300cfe20 0x7f6b300ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:40.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.881+0000 7f6b27e00640 1 -- 172.21.15.59:0/2527296309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b30150cd0 con 0x7f6b300cfa40 2024-05-30T17:03:40.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.885+0000 7f6b27e00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b300cfa40 0x7f6b300ad1b0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f6b180ad040 tx=0x7f6b18019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:40.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.885+0000 7f6b26a00640 1 -- 172.21.15.59:0/2527296309 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180bf610 con 0x7f6b300cfa40 2024-05-30T17:03:40.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.885+0000 7f6b26a00640 1 -- 172.21.15.59:0/2527296309 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b180bf7d0 con 0x7f6b300cfa40 2024-05-30T17:03:40.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.885+0000 7f6b26a00640 1 -- 172.21.15.59:0/2527296309 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180bfbc0 con 0x7f6b300cfa40 2024-05-30T17:03:40.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.885+0000 7f6b35c00640 1 -- 172.21.15.59:0/2527296309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b30150fb0 con 0x7f6b300cfa40 2024-05-30T17:03:40.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.885+0000 7f6b35c00640 1 -- 172.21.15.59:0/2527296309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b30151570 con 0x7f6b300cfa40 2024-05-30T17:03:40.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.885+0000 7f6b35c00640 1 -- 172.21.15.59:0/2527296309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b30068a90 con 0x7f6b300cfa40 2024-05-30T17:03:40.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.885+0000 7f6b26a00640 1 -- 172.21.15.59:0/2527296309 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7f6b180bd020 con 0x7f6b300cfa40 2024-05-30T17:03:40.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.885+0000 7f6b26a00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b0c069e80 0x7f6b0c06c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:40.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.885+0000 7f6b26a00640 1 -- 172.21.15.59:0/2527296309 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f6b1811f9b0 con 0x7f6b300cfa40 2024-05-30T17:03:40.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.885+0000 7f6b2ea00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b0c069e80 0x7f6b0c06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:40.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.889+0000 7f6b2ea00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b0c069e80 0x7f6b0c06c340 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009b60 tx=0x7f6b20009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:40.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:40.889+0000 7f6b26a00640 1 -- 172.21.15.59:0/2527296309 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b180c6070 con 0x7f6b300cfa40 2024-05-30T17:03:41.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.077+0000 7f6b35c00640 1 -- 172.21.15.59:0/2527296309 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f6b30151f50 con 0x7f6b0c069e80 2024-05-30T17:03:41.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b26a00640 1 -- 172.21.15.59:0/2527296309 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f6b20011ac0 con 0x7f6b0c069e80 2024-05-30T17:03:41.081 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:03:41.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:03:41.081 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T17:03:41.081 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:41.081 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:03:41.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b35c00640 1 -- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b0c069e80 msgr2=0x7f6b0c06c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:41.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b35c00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b0c069e80 0x7f6b0c06c340 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009b60 tx=0x7f6b20009190 comp rx=0 tx=0).stop 2024-05-30T17:03:41.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b35c00640 1 -- 172.21.15.59:0/2527296309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b300cfa40 msgr2=0x7f6b300ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:41.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b35c00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b300cfa40 0x7f6b300ad1b0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f6b180ad040 tx=0x7f6b18019300 comp rx=0 tx=0).stop 2024-05-30T17:03:41.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b35c00640 1 -- 172.21.15.59:0/2527296309 shutdown_connections 2024-05-30T17:03:41.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b35c00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b0c069e80 0x7f6b0c06c340 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b35c00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b300cfe20 0x7f6b300ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b35c00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b300cfa40 0x7f6b300ad1b0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b35c00640 1 --2- 172.21.15.59:0/2527296309 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b300b3dd0 0x7f6b30099300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b35c00640 1 -- 172.21.15.59:0/2527296309 >> 172.21.15.59:0/2527296309 conn(0x7f6b300b22d0 msgr2=0x7f6b30072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:41.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b35c00640 1 -- 172.21.15.59:0/2527296309 shutdown_connections 2024-05-30T17:03:41.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.081+0000 7f6b35c00640 1 -- 172.21.15.59:0/2527296309 wait complete. 2024-05-30T17:03:41.102 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:03:41.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.241+0000 7f0e16c00640 1 Processor -- start 2024-05-30T17:03:41.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.241+0000 7f0e16c00640 1 -- start start 2024-05-30T17:03:41.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.241+0000 7f0e16c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e100cd7a0 0x7f0e100cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:41.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e16c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e100cdb80 0x7f0e1015d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:41.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e16c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0e1006be40 0x7f0e1006c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:41.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e16c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1006b9b0 con 0x7f0e100cd7a0 2024-05-30T17:03:41.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e16c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1015daf0 con 0x7f0e1006be40 2024-05-30T17:03:41.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e16c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0e100cff10 con 0x7f0e100cdb80 2024-05-30T17:03:41.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e100cd7a0 0x7f0e100cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:41.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e100cd7a0 0x7f0e100cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55494/0 (socket says 172.21.15.59:55494) 2024-05-30T17:03:41.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0fe00640 1 -- 172.21.15.59:0/941971758 learned_addr learned my addr 172.21.15.59:0/941971758 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:41.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0f400640 1 --2- 172.21.15.59:0/941971758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e100cdb80 0x7f0e1015d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:41.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e14c00640 1 --2- 172.21.15.59:0/941971758 >> v2:172.21.15.107:3300/0 conn(0x7f0e1006be40 0x7f0e1006c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:41.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0fe00640 1 -- 172.21.15.59:0/941971758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e100cdb80 msgr2=0x7f0e1015d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:41.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0fe00640 1 --2- 172.21.15.59:0/941971758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e100cdb80 0x7f0e1015d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0fe00640 1 -- 172.21.15.59:0/941971758 >> v2:172.21.15.107:3300/0 conn(0x7f0e1006be40 msgr2=0x7f0e1006c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:41.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0fe00640 1 --2- 172.21.15.59:0/941971758 >> v2:172.21.15.107:3300/0 conn(0x7f0e1006be40 0x7f0e1006c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0fe00640 1 -- 172.21.15.59:0/941971758 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e100d01f0 con 0x7f0e100cd7a0 2024-05-30T17:03:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e14c00640 1 --2- 172.21.15.59:0/941971758 >> v2:172.21.15.107:3300/0 conn(0x7f0e1006be40 0x7f0e1006c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:03:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0f400640 1 --2- 172.21.15.59:0/941971758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e100cdb80 0x7f0e1015d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:03:41.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0fe00640 1 --2- 172.21.15.59:0/941971758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e100cd7a0 0x7f0e100cf870 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0e1015a700 tx=0x7f0e0001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744a892a41be2551 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:41.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0ea00640 1 -- 172.21.15.59:0/941971758 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e000b1070 con 0x7f0e100cd7a0 2024-05-30T17:03:41.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0ea00640 1 -- 172.21.15.59:0/941971758 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e000ac620 con 0x7f0e100cd7a0 2024-05-30T17:03:41.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.245+0000 7f0e0ea00640 1 -- 172.21.15.59:0/941971758 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e000ac9f0 con 0x7f0e100cd7a0 2024-05-30T17:03:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 -- 172.21.15.59:0/941971758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e100cd7a0 msgr2=0x7f0e100cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 --2- 172.21.15.59:0/941971758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e100cd7a0 0x7f0e100cf870 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0e1015a700 tx=0x7f0e0001c4f0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 -- 172.21.15.59:0/941971758 shutdown_connections 2024-05-30T17:03:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 --2- 172.21.15.59:0/941971758 >> v2:172.21.15.107:3300/0 conn(0x7f0e1006be40 0x7f0e1006c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 --2- 172.21.15.59:0/941971758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e100cdb80 0x7f0e1015d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 --2- 172.21.15.59:0/941971758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e100cd7a0 0x7f0e100cf870 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 -- 172.21.15.59:0/941971758 >> 172.21.15.59:0/941971758 conn(0x7f0e100d0b10 msgr2=0x7f0e100d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 -- 172.21.15.59:0/941971758 shutdown_connections 2024-05-30T17:03:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 -- 172.21.15.59:0/941971758 wait complete. 2024-05-30T17:03:41.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 Processor -- start 2024-05-30T17:03:41.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 -- start start 2024-05-30T17:03:41.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e1006be40 0x7f0e10158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:41.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e100cd7a0 0x7f0e100b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:41.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e100cdb80 0x7f0e10135dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:41.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0e10141980 con 0x7f0e100cd7a0 2024-05-30T17:03:41.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0e10141800 con 0x7f0e100cdb80 2024-05-30T17:03:41.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e16c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0e10141b00 con 0x7f0e1006be40 2024-05-30T17:03:41.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e0f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e100cd7a0 0x7f0e100b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:41.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e0f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e100cd7a0 0x7f0e100b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55500/0 (socket says 172.21.15.59:55500) 2024-05-30T17:03:41.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e0f400640 1 -- 172.21.15.59:0/1936523385 learned_addr learned my addr 172.21.15.59:0/1936523385 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:41.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e14c00640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e100cdb80 0x7f0e10135dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:41.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e0fe00640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e1006be40 0x7f0e10158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:41.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e0f400640 1 -- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e1006be40 msgr2=0x7f0e10158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:41.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e0f400640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e1006be40 0x7f0e10158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e0f400640 1 -- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e100cdb80 msgr2=0x7f0e10135dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:41.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e0f400640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e100cdb80 0x7f0e10135dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.249+0000 7f0e0f400640 1 -- 172.21.15.59:0/1936523385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e100cf830 con 0x7f0e100cd7a0 2024-05-30T17:03:41.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.253+0000 7f0e0f400640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e100cd7a0 0x7f0e100b4f30 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c7f0 tx=0x7f0dfc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:41.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.253+0000 7f0e07e00640 1 -- 172.21.15.59:0/1936523385 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc015070 con 0x7f0e100cd7a0 2024-05-30T17:03:41.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.253+0000 7f0e07e00640 1 -- 172.21.15.59:0/1936523385 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dfc007820 con 0x7f0e100cd7a0 2024-05-30T17:03:41.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.253+0000 7f0e07e00640 1 -- 172.21.15.59:0/1936523385 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc007c10 con 0x7f0e100cd7a0 2024-05-30T17:03:41.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.253+0000 7f0e16c00640 1 -- 172.21.15.59:0/1936523385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e101585a0 con 0x7f0e100cd7a0 2024-05-30T17:03:41.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.253+0000 7f0e16c00640 1 -- 172.21.15.59:0/1936523385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e10158b20 con 0x7f0e100cd7a0 2024-05-30T17:03:41.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.253+0000 7f0e16c00640 1 -- 172.21.15.59:0/1936523385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e10158f20 con 0x7f0e100cd7a0 2024-05-30T17:03:41.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.253+0000 7f0e07e00640 1 -- 172.21.15.59:0/1936523385 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7f0dfc018070 con 0x7f0e100cd7a0 2024-05-30T17:03:41.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.253+0000 7f0e07e00640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0df0069e80 0x7f0df006c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:41.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.253+0000 7f0e07e00640 1 -- 172.21.15.59:0/1936523385 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5821+0+0 (secure 0 0 0) 0x7f0dfc085990 con 0x7f0e100cd7a0 2024-05-30T17:03:41.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.257+0000 7f0e0fe00640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0df0069e80 0x7f0df006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:41.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.257+0000 7f0e0fe00640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0df0069e80 0x7f0df006c340 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0e000ae000 tx=0x7f0e000a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:41.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.257+0000 7f0e07e00640 1 -- 172.21.15.59:0/1936523385 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0dfc057360 con 0x7f0e100cd7a0 2024-05-30T17:03:41.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 -- 172.21.15.59:0/1936523385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0e100d1000 con 0x7f0e100cd7a0 2024-05-30T17:03:41.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e07e00640 1 -- 172.21.15.59:0/1936523385 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2124 (secure 0 0 0) 0x7f0dfc05b660 con 0x7f0e100cd7a0 2024-05-30T17:03:41.484 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:03:41.485 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:03:41.485 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:03:41.485 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:03:41.485 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:03:41.485 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:03:41.485 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:03:41.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:41.485 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:03:41.485 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:03:41.485 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:03:41.485 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:03:41.485 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:03:41.486 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:41.486 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:03:41.486 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:03:41.486 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:03:41.486 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:03:41.486 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:41.486 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 901, 2024-05-30T17:03:41.486 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:03:41.486 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:03:41.486 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:03:41.486 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:03:41.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 116, 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:03:41.487 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1714, 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 7056098110, 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 15133536256, 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 757960577024, 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 313777512, 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 313463328, 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 77, 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 87 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:41.488 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 72, 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8, 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 8, 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8460 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:41.489 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:03:41.490 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T17:03:41.491 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:02:25.347963+0000", 2024-05-30T17:03:41.491 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:03:41.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:41.491 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:03:41.491 INFO:teuthology.orchestra.run.smithi059.stdout: "ae4fdb91-7bfa-4a93-a691-3ed755f261d2": { 2024-05-30T17:03:41.491 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 25.0 seconds before exiting (13s)\n [============================] ", 2024-05-30T17:03:41.491 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:03:41.491 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:03:41.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:41.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:41.491 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:03:41.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 -- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0df0069e80 msgr2=0x7f0df006c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:41.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0df0069e80 0x7f0df006c340 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0e000ae000 tx=0x7f0e000a7000 comp rx=0 tx=0).stop 2024-05-30T17:03:41.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 -- 172.21.15.59:0/1936523385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e100cd7a0 msgr2=0x7f0e100b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:41.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e100cd7a0 0x7f0e100b4f30 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c7f0 tx=0x7f0dfc00ccb0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 -- 172.21.15.59:0/1936523385 shutdown_connections 2024-05-30T17:03:41.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0df0069e80 0x7f0df006c340 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e100cdb80 0x7f0e10135dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e100cd7a0 0x7f0e100b4f30 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 --2- 172.21.15.59:0/1936523385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e1006be40 0x7f0e10158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 -- 172.21.15.59:0/1936523385 >> 172.21.15.59:0/1936523385 conn(0x7f0e100d0b10 msgr2=0x7f0e100b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 -- 172.21.15.59:0/1936523385 shutdown_connections 2024-05-30T17:03:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:41.485+0000 7f0e16c00640 1 -- 172.21.15.59:0/1936523385 wait complete. 2024-05-30T17:03:46.507 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:03:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.657+0000 7f0842200640 1 Processor -- start 2024-05-30T17:03:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.657+0000 7f0842200640 1 -- start start 2024-05-30T17:03:46.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.657+0000 7f0842200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f083c146000 0x7f083c1600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:46.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.657+0000 7f0842200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f083c160610 0x7f083c0b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:46.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.657+0000 7f0842200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f083c0b4c20 0x7f083c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:46.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.657+0000 7f0842200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f083c15ce50 con 0x7f083c146000 2024-05-30T17:03:46.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.657+0000 7f0842200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f083c0b3c20 con 0x7f083c0b4c20 2024-05-30T17:03:46.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.657+0000 7f0842200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f083c160c40 con 0x7f083c160610 2024-05-30T17:03:46.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.657+0000 7f083b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f083c146000 0x7f083c1600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:46.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.657+0000 7f083b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f083c146000 0x7f083c1600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35378/0 (socket says 172.21.15.59:35378) 2024-05-30T17:03:46.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.657+0000 7f083b400640 1 -- 172.21.15.59:0/2127649993 learned_addr learned my addr 172.21.15.59:0/2127649993 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:46.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.661+0000 7f0832a00640 1 --2- 172.21.15.59:0/2127649993 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f083c160610 0x7f083c0b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.661+0000 7f083be00640 1 --2- 172.21.15.59:0/2127649993 >> v2:172.21.15.107:3300/0 conn(0x7f083c0b4c20 0x7f083c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.661+0000 7f083b400640 1 -- 172.21.15.59:0/2127649993 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f083c160610 msgr2=0x7f083c0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.661+0000 7f083b400640 1 --2- 172.21.15.59:0/2127649993 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f083c160610 0x7f083c0b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.661+0000 7f083b400640 1 -- 172.21.15.59:0/2127649993 >> v2:172.21.15.107:3300/0 conn(0x7f083c0b4c20 msgr2=0x7f083c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.661+0000 7f083b400640 1 --2- 172.21.15.59:0/2127649993 >> v2:172.21.15.107:3300/0 conn(0x7f083c0b4c20 0x7f083c0cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.661+0000 7f083b400640 1 -- 172.21.15.59:0/2127649993 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c160f20 con 0x7f083c146000 2024-05-30T17:03:46.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.661+0000 7f083b400640 1 --2- 172.21.15.59:0/2127649993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083c146000 0x7f083c1600d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f083c0b38d0 tx=0x7f082c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1988c72edf76fc6e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:46.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.661+0000 7f083aa00640 1 -- 172.21.15.59:0/2127649993 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c0b0070 con 0x7f083c146000 2024-05-30T17:03:46.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.661+0000 7f083aa00640 1 -- 172.21.15.59:0/2127649993 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082c0ab600 con 0x7f083c146000 2024-05-30T17:03:46.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.661+0000 7f083aa00640 1 -- 172.21.15.59:0/2127649993 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c0ab9d0 con 0x7f083c146000 2024-05-30T17:03:46.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 -- 172.21.15.59:0/2127649993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083c146000 msgr2=0x7f083c1600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:46.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 --2- 172.21.15.59:0/2127649993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083c146000 0x7f083c1600d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f083c0b38d0 tx=0x7f082c01c520 comp rx=0 tx=0).stop 2024-05-30T17:03:46.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 -- 172.21.15.59:0/2127649993 shutdown_connections 2024-05-30T17:03:46.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 --2- 172.21.15.59:0/2127649993 >> v2:172.21.15.107:3300/0 conn(0x7f083c0b4c20 0x7f083c0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 --2- 172.21.15.59:0/2127649993 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f083c160610 0x7f083c0b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 --2- 172.21.15.59:0/2127649993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083c146000 0x7f083c1600d0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 -- 172.21.15.59:0/2127649993 >> 172.21.15.59:0/2127649993 conn(0x7f083c067d60 msgr2=0x7f083c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:46.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 -- 172.21.15.59:0/2127649993 shutdown_connections 2024-05-30T17:03:46.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 -- 172.21.15.59:0/2127649993 wait complete. 2024-05-30T17:03:46.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 Processor -- start 2024-05-30T17:03:46.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 -- start start 2024-05-30T17:03:46.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083c0b4c20 0x7f083c143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:46.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f083c146000 0x7f083c0ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:46.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f083c160610 0x7f083c0ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:46.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f083c0cd120 con 0x7f083c0b4c20 2024-05-30T17:03:46.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f083c0ccfa0 con 0x7f083c160610 2024-05-30T17:03:46.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0842200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f083c0cd2a0 con 0x7f083c146000 2024-05-30T17:03:46.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f083b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083c0b4c20 0x7f083c143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:46.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f083b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083c0b4c20 0x7f083c143920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35394/0 (socket says 172.21.15.59:35394) 2024-05-30T17:03:46.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f083b400640 1 -- 172.21.15.59:0/1504987606 learned_addr learned my addr 172.21.15.59:0/1504987606 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:46.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f083be00640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f083c160610 0x7f083c0ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:46.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f0832a00640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f083c146000 0x7f083c0ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:46.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f083b400640 1 -- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f083c146000 msgr2=0x7f083c0ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:46.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f083b400640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f083c146000 0x7f083c0ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f083b400640 1 -- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f083c160610 msgr2=0x7f083c0ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:46.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f083b400640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f083c160610 0x7f083c0ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f083b400640 1 -- 172.21.15.59:0/1504987606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c142640 con 0x7f083c0b4c20 2024-05-30T17:03:46.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.665+0000 7f083b400640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083c0b4c20 0x7f083c143920 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f082c0ae040 tx=0x7f082c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:46.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.669+0000 7f0833e00640 1 -- 172.21.15.59:0/1504987606 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c0b0040 con 0x7f083c0b4c20 2024-05-30T17:03:46.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.669+0000 7f0833e00640 1 -- 172.21.15.59:0/1504987606 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082c0b9070 con 0x7f083c0b4c20 2024-05-30T17:03:46.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.669+0000 7f0833e00640 1 -- 172.21.15.59:0/1504987606 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c0b4680 con 0x7f083c0b4c20 2024-05-30T17:03:46.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.669+0000 7f0842200640 1 -- 172.21.15.59:0/1504987606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083c142920 con 0x7f083c0b4c20 2024-05-30T17:03:46.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.669+0000 7f0842200640 1 -- 172.21.15.59:0/1504987606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f083c142ee0 con 0x7f083c0b4c20 2024-05-30T17:03:46.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.669+0000 7f0842200640 1 -- 172.21.15.59:0/1504987606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083c068a90 con 0x7f083c0b4c20 2024-05-30T17:03:46.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.669+0000 7f0833e00640 1 -- 172.21.15.59:0/1504987606 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7f082c0b4820 con 0x7f083c0b4c20 2024-05-30T17:03:46.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.669+0000 7f0833e00640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0818069e80 0x7f081806c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:46.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.669+0000 7f0833e00640 1 -- 172.21.15.59:0/1504987606 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7f082c11f600 con 0x7f083c0b4c20 2024-05-30T17:03:46.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.669+0000 7f0832a00640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0818069e80 0x7f081806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:46.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.673+0000 7f0832a00640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0818069e80 0x7f081806c340 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0824003fd0 tx=0x7f0824003ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:46.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.677+0000 7f0833e00640 1 -- 172.21.15.59:0/1504987606 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f082c016110 con 0x7f083c0b4c20 2024-05-30T17:03:46.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.901+0000 7f0842200640 1 -- 172.21.15.59:0/1504987606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f083c15fc90 con 0x7f083c0b4c20 2024-05-30T17:03:46.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.901+0000 7f0833e00640 1 -- 172.21.15.59:0/1504987606 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2121 (secure 0 0 0) 0x7f082c0f1620 con 0x7f083c0b4c20 2024-05-30T17:03:46.903 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:03:46.903 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:03:46.903 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:03:46.904 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:03:46.904 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:03:46.904 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:03:46.904 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:03:46.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:46.904 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:03:46.904 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:03:46.904 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:03:46.904 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:03:46.904 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:03:46.904 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:46.904 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 906, 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 117, 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:03:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:03:46.906 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:03:46.906 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:03:46.906 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:03:46.906 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:03:46.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:46.906 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:03:46.906 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:03:46.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:03:46.906 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:03:46.906 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:03:46.906 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:46.906 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1713, 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 7056138936, 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 15133573120, 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 757960540160, 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 14327536, 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 18534567, 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 4, 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 10 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:46.907 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 72, 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8, 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 8, 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8460 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:46.908 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:03:46.910 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 17, 2024-05-30T17:03:46.910 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:02:25.347963+0000", 2024-05-30T17:03:46.910 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:03:46.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:46.910 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:03:46.910 INFO:teuthology.orchestra.run.smithi059.stdout: "ae4fdb91-7bfa-4a93-a691-3ed755f261d2": { 2024-05-30T17:03:46.910 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 21.0 seconds before exiting (18s)\n [============================] ", 2024-05-30T17:03:46.910 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:03:46.910 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:03:46.910 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:46.910 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:46.910 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:03:46.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.905+0000 7f0842200640 1 -- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0818069e80 msgr2=0x7f081806c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.905+0000 7f0842200640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0818069e80 0x7f081806c340 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0824003fd0 tx=0x7f0824003ce0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.905+0000 7f0842200640 1 -- 172.21.15.59:0/1504987606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083c0b4c20 msgr2=0x7f083c143920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.905+0000 7f0842200640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083c0b4c20 0x7f083c143920 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f082c0ae040 tx=0x7f082c0192c0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.905+0000 7f0842200640 1 -- 172.21.15.59:0/1504987606 shutdown_connections 2024-05-30T17:03:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.905+0000 7f0842200640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0818069e80 0x7f081806c340 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.905+0000 7f0842200640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f083c160610 0x7f083c0ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.905+0000 7f0842200640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f083c146000 0x7f083c0ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.905+0000 7f0842200640 1 --2- 172.21.15.59:0/1504987606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083c0b4c20 0x7f083c143920 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.905+0000 7f0842200640 1 -- 172.21.15.59:0/1504987606 >> 172.21.15.59:0/1504987606 conn(0x7f083c067d60 msgr2=0x7f083c144cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.905+0000 7f0842200640 1 -- 172.21.15.59:0/1504987606 shutdown_connections 2024-05-30T17:03:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:46.905+0000 7f0842200640 1 -- 172.21.15.59:0/1504987606 wait complete. 2024-05-30T17:03:51.928 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:03:52.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.081+0000 7fa62de00640 1 Processor -- start 2024-05-30T17:03:52.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.081+0000 7fa62de00640 1 -- start start 2024-05-30T17:03:52.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62de00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa62815c5a0 0x7fa6280d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:52.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa628160940 0x7fa628166560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:52.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62de00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62809aae0 con 0x7fa62809bb20 2024-05-30T17:03:52.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62de00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa62809ad80 con 0x7fa628160940 2024-05-30T17:03:52.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62de00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa62809b060 con 0x7fa62815c5a0 2024-05-30T17:03:52.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa62809bb20 0x7fa628160230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34390/0 (socket says 172.21.15.59:34390) 2024-05-30T17:03:52.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627e00640 1 -- 172.21.15.59:0/1864891786 learned_addr learned my addr 172.21.15.59:0/1864891786 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:03:52.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62ca00640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa62815c5a0 0x7fa6280d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:52.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62d400640 1 --2- 172.21.15.59:0/1864891786 >> v2:172.21.15.107:3300/0 conn(0x7fa628160940 0x7fa628166560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:52.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069560628 0 0) 0x7fa62809aae0 con 0x7fa62809bb20 2024-05-30T17:03:52.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa610003530 con 0x7fa62809bb20 2024-05-30T17:03:52.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2603399136 0 0) 0x7fa610003530 con 0x7fa62809bb20 2024-05-30T17:03:52.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa62815c5a0 msgr2=0x7fa6280d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:52.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa62815c5a0 0x7fa6280d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:52.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 >> v2:172.21.15.107:3300/0 conn(0x7fa628160940 msgr2=0x7fa628166560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:52.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 --2- 172.21.15.59:0/1864891786 >> v2:172.21.15.107:3300/0 conn(0x7fa628160940 0x7fa628166560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:52.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62809b340 con 0x7fa62809bb20 2024-05-30T17:03:52.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fa614001680 con 0x7fa62809bb20 2024-05-30T17:03:52.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 >> v1:172.21.15.59:6789/0 conn(0x7fa62809bb20 legacy=0x7fa628160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:52.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6100039c0 0x7fa610003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:52.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa610004810 0x7fa610004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:52.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa62815c5a0 0x7fa6100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:52.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa62809ad80 con 0x7fa6100039c0 2024-05-30T17:03:52.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa62809b060 con 0x7fa610004810 2024-05-30T17:03:52.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa61000b9d0 con 0x7fa62815c5a0 2024-05-30T17:03:52.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62ca00640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6100039c0 0x7fa610003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:52.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627e00640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa610004810 0x7fa610004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:52.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62d400640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa62815c5a0 0x7fa6100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:52.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62ca00640 1 -- 172.21.15.59:0/1864891786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa62815c5a0 msgr2=0x7fa6100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:52.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62ca00640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa62815c5a0 0x7fa6100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:52.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62ca00640 1 -- 172.21.15.59:0/1864891786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa610004810 msgr2=0x7fa610004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:52.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62ca00640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa610004810 0x7fa610004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:52.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa62ca00640 1 -- 172.21.15.59:0/1864891786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa610003530 con 0x7fa6100039c0 2024-05-30T17:03:52.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.085+0000 7fa627e00640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa610004810 0x7fa610004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:03:52.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.089+0000 7fa62ca00640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6100039c0 0x7fa610003de0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009b10 tx=0x7fa61c01ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c4b03ba70cce6f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:52.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.089+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0096b0 con 0x7fa6100039c0 2024-05-30T17:03:52.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.089+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c0a6450 con 0x7fa6100039c0 2024-05-30T17:03:52.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.089+0000 7fa627400640 1 -- 172.21.15.59:0/1864891786 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0a6840 con 0x7fa6100039c0 2024-05-30T17:03:52.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.089+0000 7fa62de00640 1 -- 172.21.15.59:0/1864891786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6100039c0 msgr2=0x7fa610003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:52.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.089+0000 7fa62de00640 1 --2- 172.21.15.59:0/1864891786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6100039c0 0x7fa610003de0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009b10 tx=0x7fa61c01ca40 comp rx=0 tx=0).stop 2024-05-30T17:03:52.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.089+0000 7fa62d400640 1 -- 172.21.15.59:0/1864891786 reap_dead start 2024-05-30T17:03:52.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.089+0000 7fa62de00640 1 -- 172.21.15.59:0/1864891786 shutdown_connections 2024-05-30T17:03:52.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.089+0000 7fa62de00640 1 -- 172.21.15.59:0/1864891786 >> 172.21.15.59:0/1864891786 conn(0x7fa6280b3f40 msgr2=0x7fa6280b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:52.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.089+0000 7fa62de00640 1 -- 172.21.15.59:0/1864891786 shutdown_connections 2024-05-30T17:03:52.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.089+0000 7fa62de00640 1 -- 172.21.15.59:0/1864891786 wait complete. 2024-05-30T17:03:52.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62de00640 1 Processor -- start 2024-05-30T17:03:52.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62de00640 1 -- start start 2024-05-30T17:03:52.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6100039c0 0x7fa62806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:52.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa628165730 0x7fa628165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:52.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62de00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6280c6890 0x7fa6280c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:52.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62de00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa628166aa0 con 0x7fa628165730 2024-05-30T17:03:52.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62de00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa62815cb90 con 0x7fa6100039c0 2024-05-30T17:03:52.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62de00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa628166c20 con 0x7fa6280c6890 2024-05-30T17:03:52.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa627e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa628165730 0x7fa628165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:52.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa627e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa628165730 0x7fa628165bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38864/0 (socket says 172.21.15.59:38864) 2024-05-30T17:03:52.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa627e00640 1 -- 172.21.15.59:0/2761167951 learned_addr learned my addr 172.21.15.59:0/2761167951 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:52.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62ca00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6100039c0 0x7fa62806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:52.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62d400640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6280c6890 0x7fa6280c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:52.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa627e00640 1 -- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6280c6890 msgr2=0x7fa6280c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:52.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa627e00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6280c6890 0x7fa6280c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:52.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa627e00640 1 -- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6100039c0 msgr2=0x7fa62806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:52.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa627e00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6100039c0 0x7fa62806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:52.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa627e00640 1 -- 172.21.15.59:0/2761167951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62806d490 con 0x7fa628165730 2024-05-30T17:03:52.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62d400640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6280c6890 0x7fa6280c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:03:52.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa627e00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa628165730 0x7fa628165bb0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fa61400e7b0 tx=0x7fa61400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:52.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa624c00640 1 -- 172.21.15.59:0/2761167951 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61400ee60 con 0x7fa628165730 2024-05-30T17:03:52.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa624c00640 1 -- 172.21.15.59:0/2761167951 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa614018070 con 0x7fa628165730 2024-05-30T17:03:52.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa624c00640 1 -- 172.21.15.59:0/2761167951 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61400ca70 con 0x7fa628165730 2024-05-30T17:03:52.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62de00640 1 -- 172.21.15.59:0/2761167951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62806d770 con 0x7fa628165730 2024-05-30T17:03:52.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.093+0000 7fa62de00640 1 -- 172.21.15.59:0/2761167951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62806dd30 con 0x7fa628165730 2024-05-30T17:03:52.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.097+0000 7fa62de00640 1 -- 172.21.15.59:0/2761167951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa62806e060 con 0x7fa628165730 2024-05-30T17:03:52.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.097+0000 7fa624c00640 1 -- 172.21.15.59:0/2761167951 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7fa61400cc10 con 0x7fa628165730 2024-05-30T17:03:52.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.097+0000 7fa624c00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa608069e80 0x7fa60806c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:52.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.097+0000 7fa624c00640 1 -- 172.21.15.59:0/2761167951 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5879+0+0 (secure 0 0 0) 0x7fa614085610 con 0x7fa628165730 2024-05-30T17:03:52.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.097+0000 7fa62ca00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa608069e80 0x7fa60806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:52.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.097+0000 7fa62ca00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa608069e80 0x7fa60806c340 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0ad000 tx=0x7fa61c0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:52.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.101+0000 7fa624c00640 1 -- 172.21.15.59:0/2761167951 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa614057630 con 0x7fa628165730 2024-05-30T17:03:52.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 -- 172.21.15.59:0/2761167951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa6280691a0 con 0x7fa628165730 2024-05-30T17:03:52.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa624c00640 1 -- 172.21.15.59:0/2761167951 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+4114 (secure 0 0 0) 0x7fa614056f30 con 0x7fa628165730 2024-05-30T17:03:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:03:52.327 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:03:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:03:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:03:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:03:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:03:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:03:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:03:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:03:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:03:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:03:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:03:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:03:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:03:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:03:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:03:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 912, 2024-05-30T17:03:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 118, 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:03:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:03:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:03:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:03:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:03:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 95 2024-05-30T17:03:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:03:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "peering", 2024-05-30T17:03:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 2 2024-05-30T17:03:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:03:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:03:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1713, 2024-05-30T17:03:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 7056158071, 2024-05-30T17:03:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 15133732864, 2024-05-30T17:03:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 757960380416, 2024-05-30T17:03:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:03:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "inactive_pgs_ratio": 0.020618556067347527, 2024-05-30T17:03:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 2943, 2024-05-30T17:03:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:03:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 1 2024-05-30T17:03:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:03:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 72, 2024-05-30T17:03:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8, 2024-05-30T17:03:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:03:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:03:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:03:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:03:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:03:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 8, 2024-05-30T17:03:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:03:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:03:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8460 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:03:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:03:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:03:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 18, 2024-05-30T17:03:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:03:47.368593+0000", 2024-05-30T17:03:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-05-30T17:03:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-05-30T17:03:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:03:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:03:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "a": { 2024-05-30T17:03:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": { 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "y": { 2024-05-30T17:03:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": { 2024-05-30T17:03:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:03:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:03:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "a": { 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "b": { 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:03:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "ae4fdb91-7bfa-4a93-a691-3ed755f261d2": { 2024-05-30T17:03:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 15.0 seconds before exiting (24s)\n [============================] ", 2024-05-30T17:03:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:03:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:03:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "c86c09a6-8c2a-4644-80f0-21d55a6abfb7": { 2024-05-30T17:03:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "Global Recovery Event (0s)\n [............................] ", 2024-05-30T17:03:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0, 2024-05-30T17:03:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:03:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:52.339 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:03:52.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 -- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa608069e80 msgr2=0x7fa60806c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:52.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa608069e80 0x7fa60806c340 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0ad000 tx=0x7fa61c0b3040 comp rx=0 tx=0).stop 2024-05-30T17:03:52.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 -- 172.21.15.59:0/2761167951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa628165730 msgr2=0x7fa628165bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:52.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa628165730 0x7fa628165bb0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fa61400e7b0 tx=0x7fa61400ec70 comp rx=0 tx=0).stop 2024-05-30T17:03:52.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 -- 172.21.15.59:0/2761167951 shutdown_connections 2024-05-30T17:03:52.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa608069e80 0x7fa60806c340 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:52.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6280c6890 0x7fa6280c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:52.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa628165730 0x7fa628165bb0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:52.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 --2- 172.21.15.59:0/2761167951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6100039c0 0x7fa62806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:52.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 -- 172.21.15.59:0/2761167951 >> 172.21.15.59:0/2761167951 conn(0x7fa6280b3f40 msgr2=0x7fa6280ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:52.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 -- 172.21.15.59:0/2761167951 shutdown_connections 2024-05-30T17:03:52.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:52.325+0000 7fa62de00640 1 -- 172.21.15.59:0/2761167951 wait complete. 2024-05-30T17:03:57.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:03:57.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.497+0000 7ff2b1e00640 1 Processor -- start 2024-05-30T17:03:57.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.497+0000 7ff2b1e00640 1 -- start start 2024-05-30T17:03:57.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2b1e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff2ac162870 0x7ff2ac09b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:57.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2b1e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2ac162c50 0x7ff2ac0cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:57.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2b1e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2ac0d0ba0 con 0x7ff2ac0d05e0 2024-05-30T17:03:57.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2b1e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ac0d17b0 con 0x7ff2ac162c50 2024-05-30T17:03:57.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2b1e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ac0cdab0 con 0x7ff2ac162870 2024-05-30T17:03:57.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2abe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2ac162c50 0x7ff2ac0cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:57.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2abe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2ac162c50 0x7ff2ac0cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38874/0 (socket says 172.21.15.59:38874) 2024-05-30T17:03:57.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2abe00640 1 -- 172.21.15.59:0/1341521857 learned_addr learned my addr 172.21.15.59:0/1341521857 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:57.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2b0a00640 1 --2- 172.21.15.59:0/1341521857 >> v2:172.21.15.107:3300/0 conn(0x7ff2ac162870 0x7ff2ac09b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:57.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2abe00640 1 -- 172.21.15.59:0/1341521857 >> v2:172.21.15.107:3300/0 conn(0x7ff2ac162870 msgr2=0x7ff2ac09b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:03:57.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2abe00640 1 --2- 172.21.15.59:0/1341521857 >> v2:172.21.15.107:3300/0 conn(0x7ff2ac162870 0x7ff2ac09b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:57.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2abe00640 1 -- 172.21.15.59:0/1341521857 >> v1:172.21.15.107:6789/0 conn(0x7ff2ac0d05e0 legacy=0x7ff2ac070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:57.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.501+0000 7ff2abe00640 1 -- 172.21.15.59:0/1341521857 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ac0d0e80 con 0x7ff2ac162c50 2024-05-30T17:03:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2abe00640 1 --2- 172.21.15.59:0/1341521857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac162c50 0x7ff2ac0cdee0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac06c990 tx=0x7ff29801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6554feea49051dd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2ab400640 1 -- 172.21.15.59:0/1341521857 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2980ab600 con 0x7ff2ac162c50 2024-05-30T17:03:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2ab400640 1 -- 172.21.15.59:0/1341521857 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2980b0070 con 0x7ff2ac162c50 2024-05-30T17:03:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2ab400640 1 -- 172.21.15.59:0/1341521857 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2980ab9c0 con 0x7ff2ac162c50 2024-05-30T17:03:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2b1e00640 1 -- 172.21.15.59:0/1341521857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac162c50 msgr2=0x7ff2ac0cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2b1e00640 1 --2- 172.21.15.59:0/1341521857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac162c50 0x7ff2ac0cdee0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac06c990 tx=0x7ff29801c4f0 comp rx=0 tx=0).stop 2024-05-30T17:03:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2b1e00640 1 -- 172.21.15.59:0/1341521857 shutdown_connections 2024-05-30T17:03:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2b1e00640 1 --2- 172.21.15.59:0/1341521857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac162c50 0x7ff2ac0cdee0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2b1e00640 1 --2- 172.21.15.59:0/1341521857 >> v2:172.21.15.107:3300/0 conn(0x7ff2ac162870 0x7ff2ac09b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2b1e00640 1 -- 172.21.15.59:0/1341521857 >> 172.21.15.59:0/1341521857 conn(0x7ff2ac0b3f40 msgr2=0x7ff2ac0b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2b1e00640 1 -- 172.21.15.59:0/1341521857 shutdown_connections 2024-05-30T17:03:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2b1e00640 1 -- 172.21.15.59:0/1341521857 wait complete. 2024-05-30T17:03:57.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2b1e00640 1 Processor -- start 2024-05-30T17:03:57.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.505+0000 7ff2b1e00640 1 -- start start 2024-05-30T17:03:57.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2b1e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2ac0d05e0 0x7ff2ac14b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:57.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2b1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac162870 0x7ff2ac161c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2b1e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2ac162c50 0x7ff2ac160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2b1e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac09ba40 con 0x7ff2ac162870 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2b1e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac0d1c20 con 0x7ff2ac0d05e0 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2b1e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff2ac09bbc0 con 0x7ff2ac162c50 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2abe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac162870 0x7ff2ac161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2abe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac162870 0x7ff2ac161c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38878/0 (socket says 172.21.15.59:38878) 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2abe00640 1 -- 172.21.15.59:0/3176028782 learned_addr learned my addr 172.21.15.59:0/3176028782 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2b0a00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2ac0d05e0 0x7ff2ac14b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2b1400640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2ac162c50 0x7ff2ac160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2abe00640 1 -- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2ac162c50 msgr2=0x7ff2ac160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2abe00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2ac162c50 0x7ff2ac160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2abe00640 1 -- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2ac0d05e0 msgr2=0x7ff2ac14b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2abe00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2ac0d05e0 0x7ff2ac14b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:57.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2abe00640 1 -- 172.21.15.59:0/3176028782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ac15c210 con 0x7ff2ac162870 2024-05-30T17:03:57.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2abe00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac162870 0x7ff2ac161c40 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7ff29801c9d0 tx=0x7ff29801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:57.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2a8c00640 1 -- 172.21.15.59:0/3176028782 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2980be5f0 con 0x7ff2ac162870 2024-05-30T17:03:57.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2a8c00640 1 -- 172.21.15.59:0/3176028782 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2980be7b0 con 0x7ff2ac162870 2024-05-30T17:03:57.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2a8c00640 1 -- 172.21.15.59:0/3176028782 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2980beba0 con 0x7ff2ac162870 2024-05-30T17:03:57.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2b1e00640 1 -- 172.21.15.59:0/3176028782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ac14bdb0 con 0x7ff2ac162870 2024-05-30T17:03:57.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2b1e00640 1 -- 172.21.15.59:0/3176028782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ac0af420 con 0x7ff2ac162870 2024-05-30T17:03:57.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2b1e00640 1 -- 172.21.15.59:0/3176028782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2ac0691a0 con 0x7ff2ac162870 2024-05-30T17:03:57.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.509+0000 7ff2a8c00640 1 -- 172.21.15.59:0/3176028782 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7ff2980aa070 con 0x7ff2ac162870 2024-05-30T17:03:57.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.513+0000 7ff2a8c00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff28c069e80 0x7ff28c06c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:03:57.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.513+0000 7ff2a8c00640 1 -- 172.21.15.59:0/3176028782 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5879+0+0 (secure 0 0 0) 0x7ff29811fb70 con 0x7ff2ac162870 2024-05-30T17:03:57.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.513+0000 7ff2b0a00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff28c069e80 0x7ff28c06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:03:57.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.513+0000 7ff2b0a00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff28c069e80 0x7ff28c06c340 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009b60 tx=0x7ff2a0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:03:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.517+0000 7ff2a8c00640 1 -- 172.21.15.59:0/3176028782 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff2ac15c210 con 0x7ff2ac162870 2024-05-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 -- 172.21.15.59:0/3176028782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff2ac09af80 con 0x7ff2ac162870 2024-05-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2a8c00640 1 -- 172.21.15.59:0/3176028782 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+6283 (secure 0 0 0) 0x7ff298016110 con 0x7ff2ac162870 2024-05-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 917, 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 118, 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1713, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 7056166155, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 15133839360, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 757960273920, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_objects_per_sec": 5, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_bytes_per_sec": 21385932, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_keys_per_sec": 0, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects_recovered": 52, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "num_bytes_recovered": 213909504, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "num_keys_recovered": 0, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 1023, 2024-05-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 72, 2024-05-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8, 2024-05-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 8, 2024-05-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8460 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 19, 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:03:57.371237+0000", 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": { 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: "y": { 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": { 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: "a": { 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: "b": { 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": { 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: "0": { 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "1": { 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "2": { 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: "3": { 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: "4": { 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: "5": { 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi059.stdout: "6": { 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: "7": { 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: "ae4fdb91-7bfa-4a93-a691-3ed755f261d2": { 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 9.0 seconds before exiting (30s)\n [============================] ", 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 -- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff28c069e80 msgr2=0x7ff28c06c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff28c069e80 0x7ff28c06c340 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009b60 tx=0x7ff2a0009190 comp rx=0 tx=0).stop 2024-05-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 -- 172.21.15.59:0/3176028782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac162870 msgr2=0x7ff2ac161c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac162870 0x7ff2ac161c40 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7ff29801c9d0 tx=0x7ff29801ad30 comp rx=0 tx=0).stop 2024-05-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 -- 172.21.15.59:0/3176028782 shutdown_connections 2024-05-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff28c069e80 0x7ff28c06c340 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2ac162c50 0x7ff2ac160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac162870 0x7ff2ac161c40 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 --2- 172.21.15.59:0/3176028782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2ac0d05e0 0x7ff2ac14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 -- 172.21.15.59:0/3176028782 >> 172.21.15.59:0/3176028782 conn(0x7ff2ac0b3f40 msgr2=0x7ff2ac0b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 -- 172.21.15.59:0/3176028782 shutdown_connections 2024-05-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:03:57.745+0000 7ff2b1e00640 1 -- 172.21.15.59:0/3176028782 wait complete. 2024-05-30T17:04:02.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:04:02.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f0541400640 1 Processor -- start 2024-05-30T17:04:02.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f0541400640 1 -- start start 2024-05-30T17:04:02.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f0541400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f053c09b3c0 0x7f053c09b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:02.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f0541400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053c0b1ae0 con 0x7f053c0d0220 2024-05-30T17:04:02.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f0541400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053c0ce220 con 0x7f053c0b1700 2024-05-30T17:04:02.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f0541400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f053c09bd90 con 0x7f053c09b3c0 2024-05-30T17:04:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f053b200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f053c0d0220 0x7f053c0d0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53458/0 (socket says 172.21.15.59:53458) 2024-05-30T17:04:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f0533e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f053c09b3c0 0x7f053c09b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f053b200640 1 -- 172.21.15.59:0/863639715 learned_addr learned my addr 172.21.15.59:0/863639715 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f0533e00640 1 -- 172.21.15.59:0/863639715 >> v1:172.21.15.107:6789/0 conn(0x7f053c0b1700 legacy=0x7f053c0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f0533e00640 1 -- 172.21.15.59:0/863639715 >> v1:172.21.15.59:6789/0 conn(0x7f053c0d0220 legacy=0x7f053c0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f0539e00640 1 -- 172.21.15.59:0/863639715 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615284115 0 0) 0x7f053c0b1ae0 con 0x7f053c0d0220 2024-05-30T17:04:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.921+0000 7f0533e00640 1 -- 172.21.15.59:0/863639715 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c0ce500 con 0x7f053c09b3c0 2024-05-30T17:04:02.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.925+0000 7f0533e00640 1 --2- 172.21.15.59:0/863639715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c09b3c0 0x7f053c09b850 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f05240097c0 tx=0x7f052401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80edbefded773d91 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:02.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.925+0000 7f0539e00640 1 -- 172.21.15.59:0/863639715 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05240b0070 con 0x7f053c09b3c0 2024-05-30T17:04:02.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.925+0000 7f0539e00640 1 -- 172.21.15.59:0/863639715 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05240ab600 con 0x7f053c09b3c0 2024-05-30T17:04:02.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.925+0000 7f0539e00640 1 -- 172.21.15.59:0/863639715 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05240ab9d0 con 0x7f053c09b3c0 2024-05-30T17:04:02.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.925+0000 7f0541400640 1 -- 172.21.15.59:0/863639715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c09b3c0 msgr2=0x7f053c09b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:02.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.925+0000 7f0541400640 1 --2- 172.21.15.59:0/863639715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c09b3c0 0x7f053c09b850 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f05240097c0 tx=0x7f052401c410 comp rx=0 tx=0).stop 2024-05-30T17:04:02.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.925+0000 7f0541400640 1 -- 172.21.15.59:0/863639715 shutdown_connections 2024-05-30T17:04:02.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.925+0000 7f0541400640 1 --2- 172.21.15.59:0/863639715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c09b3c0 0x7f053c09b850 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:02.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.925+0000 7f0541400640 1 -- 172.21.15.59:0/863639715 >> 172.21.15.59:0/863639715 conn(0x7f053c0b3f30 msgr2=0x7f053c0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.925+0000 7f0541400640 1 -- 172.21.15.59:0/863639715 shutdown_connections 2024-05-30T17:04:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.925+0000 7f0541400640 1 -- 172.21.15.59:0/863639715 wait complete. 2024-05-30T17:04:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.925+0000 7f0541400640 1 Processor -- start 2024-05-30T17:04:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0541400640 1 -- start start 2024-05-30T17:04:02.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0541400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f053c09b3c0 0x7f053c0cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:02.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0541400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c0b1700 0x7f053c0cf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:02.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0541400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f053c0d0220 0x7f053c15cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:02.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0541400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f053c16c9b0 con 0x7f053c0b1700 2024-05-30T17:04:02.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0541400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f053c16c830 con 0x7f053c0d0220 2024-05-30T17:04:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0541400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f053c16cb30 con 0x7f053c09b3c0 2024-05-30T17:04:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0533e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c0b1700 0x7f053c0cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0533e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c0b1700 0x7f053c0cf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33632/0 (socket says 172.21.15.59:33632) 2024-05-30T17:04:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0533e00640 1 -- 172.21.15.59:0/3868354918 learned_addr learned my addr 172.21.15.59:0/3868354918 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f053b200640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f053c0d0220 0x7f053c15cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f053a800640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f053c09b3c0 0x7f053c0cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0533e00640 1 -- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f053c09b3c0 msgr2=0x7f053c0cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0533e00640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f053c09b3c0 0x7f053c0cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0533e00640 1 -- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f053c0d0220 msgr2=0x7f053c15cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0533e00640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f053c0d0220 0x7f053c15cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0533e00640 1 -- 172.21.15.59:0/3868354918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c15d2b0 con 0x7f053c0b1700 2024-05-30T17:04:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0533e00640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c0b1700 0x7f053c0cf990 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f052401a040 tx=0x7f05240191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:02.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0532a00640 1 -- 172.21.15.59:0/3868354918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05240b8030 con 0x7f053c0b1700 2024-05-30T17:04:02.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0532a00640 1 -- 172.21.15.59:0/3868354918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05240b4410 con 0x7f053c0b1700 2024-05-30T17:04:02.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0532a00640 1 -- 172.21.15.59:0/3868354918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05240b0040 con 0x7f053c0b1700 2024-05-30T17:04:02.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0541400640 1 -- 172.21.15.59:0/3868354918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f053c0b7990 con 0x7f053c0b1700 2024-05-30T17:04:02.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0541400640 1 -- 172.21.15.59:0/3868354918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f053c0b7f50 con 0x7f053c0b1700 2024-05-30T17:04:02.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.929+0000 7f0541400640 1 -- 172.21.15.59:0/3868354918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f053c068a90 con 0x7f053c0b1700 2024-05-30T17:04:02.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.933+0000 7f0532a00640 1 -- 172.21.15.59:0/3868354918 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7f05240bb070 con 0x7f053c0b1700 2024-05-30T17:04:02.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.933+0000 7f0532a00640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0518069eb0 0x7f051806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:02.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.933+0000 7f0532a00640 1 -- 172.21.15.59:0/3868354918 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5879+0+0 (secure 0 0 0) 0x7f052411eb00 con 0x7f053c0b1700 2024-05-30T17:04:02.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.933+0000 7f053a800640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0518069eb0 0x7f051806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:02.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.933+0000 7f053a800640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0518069eb0 0x7f051806c370 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f053c0b5470 tx=0x7f052c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:02.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:02.937+0000 7f0532a00640 1 -- 172.21.15.59:0/3868354918 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f05240c3020 con 0x7f053c0b1700 2024-05-30T17:04:03.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.157+0000 7f0541400640 1 -- 172.21.15.59:0/3868354918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f053c0b4d40 con 0x7f053c0b1700 2024-05-30T17:04:03.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0532a00640 1 -- 172.21.15.59:0/3868354918 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+6282 (secure 0 0 0) 0x7f0524016090 con 0x7f053c0b1700 2024-05-30T17:04:03.160 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:03.160 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:04:03.160 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:04:03.160 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:04:03.160 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:04:03.160 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:04:03.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:04:03.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.160 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:04:03.160 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 923, 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:04:03.161 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 118, 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:04:03.162 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1713, 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 7056166155, 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 15133839360, 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 757960273920, 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_objects_per_sec": 4, 2024-05-30T17:04:03.163 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_bytes_per_sec": 17821140, 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_keys_per_sec": 0, 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects_recovered": 52, 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "num_bytes_recovered": 213909504, 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "num_keys_recovered": 0, 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 853, 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 72, 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8, 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:04:03.164 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 8, 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8460 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:04:03.165 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 19, 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:03:57.371237+0000", 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": { 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:04:03.166 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: "y": { 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": { 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:04:03.167 INFO:teuthology.orchestra.run.smithi059.stdout: "a": { 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "b": { 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": { 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: "0": { 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: "1": { 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "2": { 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:03.170 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "3": { 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "4": { 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:03.171 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: "5": { 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: "6": { 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:03.172 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: "7": { 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:03.173 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:03.174 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:03.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:03.174 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:04:03.174 INFO:teuthology.orchestra.run.smithi059.stdout: "ae4fdb91-7bfa-4a93-a691-3ed755f261d2": { 2024-05-30T17:04:03.174 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 5.0 seconds before exiting (34s)\n [============================] ", 2024-05-30T17:04:03.174 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:04:03.174 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:04:03.174 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:03.174 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:03.174 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:04:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0541400640 1 -- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0518069eb0 msgr2=0x7f051806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0541400640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0518069eb0 0x7f051806c370 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f053c0b5470 tx=0x7f052c009040 comp rx=0 tx=0).stop 2024-05-30T17:04:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0541400640 1 -- 172.21.15.59:0/3868354918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c0b1700 msgr2=0x7f053c0cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0541400640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c0b1700 0x7f053c0cf990 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f052401a040 tx=0x7f05240191b0 comp rx=0 tx=0).stop 2024-05-30T17:04:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0541400640 1 -- 172.21.15.59:0/3868354918 shutdown_connections 2024-05-30T17:04:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0541400640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0518069eb0 0x7f051806c370 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0541400640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f053c0d0220 0x7f053c15cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0541400640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c0b1700 0x7f053c0cf990 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0541400640 1 --2- 172.21.15.59:0/3868354918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f053c09b3c0 0x7f053c0cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0541400640 1 -- 172.21.15.59:0/3868354918 >> 172.21.15.59:0/3868354918 conn(0x7f053c0b3f30 msgr2=0x7f053c0b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0541400640 1 -- 172.21.15.59:0/3868354918 shutdown_connections 2024-05-30T17:04:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:03.161+0000 7f0541400640 1 -- 172.21.15.59:0/3868354918 wait complete. 2024-05-30T17:04:06.039 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:04:06.043 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:04:08.183 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:04:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a77a00640 1 Processor -- start 2024-05-30T17:04:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a77a00640 1 -- start start 2024-05-30T17:04:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a77a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a700b3e30 0x7f2a7006f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a77a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7006de10 con 0x7f2a7015f690 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a77a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7006e0f0 con 0x7f2a701558e0 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a77a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7006e3d0 con 0x7f2a700b3e30 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a67e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2a7015f690 0x7f2a700b46b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53468/0 (socket says 172.21.15.59:53468) 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a67e00640 1 -- 172.21.15.59:0/1232001985 learned_addr learned my addr 172.21.15.59:0/1232001985 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a75a00640 1 --2- 172.21.15.59:0/1232001985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a700b3e30 0x7f2a7006f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a6fe00640 1 -- 172.21.15.59:0/1232001985 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 357827854 0 0) 0x7f2a7006de10 con 0x7f2a7015f690 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a6fe00640 1 -- 172.21.15.59:0/1232001985 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a54003530 con 0x7f2a7015f690 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a6fe00640 1 -- 172.21.15.59:0/1232001985 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577102601 0 0) 0x7f2a7006e0f0 con 0x7f2a701558e0 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.337+0000 7f2a6fe00640 1 -- 172.21.15.59:0/1232001985 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a7006de10 con 0x7f2a701558e0 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.341+0000 7f2a6fe00640 1 -- 172.21.15.59:0/1232001985 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 548033800 0 0) 0x7f2a54003530 con 0x7f2a7015f690 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.341+0000 7f2a75a00640 1 -- 172.21.15.59:0/1232001985 >> v1:172.21.15.107:6789/0 conn(0x7f2a701558e0 legacy=0x7f2a7015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.341+0000 7f2a75a00640 1 -- 172.21.15.59:0/1232001985 >> v1:172.21.15.59:6789/0 conn(0x7f2a7015f690 legacy=0x7f2a700b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.341+0000 7f2a75a00640 1 -- 172.21.15.59:0/1232001985 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7006e6b0 con 0x7f2a700b3e30 2024-05-30T17:04:08.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.341+0000 7f2a75a00640 1 --2- 172.21.15.59:0/1232001985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a700b3e30 0x7f2a7006f8c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009dc0 tx=0x7f2a6801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13a5a71df266fe7a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.341+0000 7f2a6fe00640 1 -- 172.21.15.59:0/1232001985 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a680b2070 con 0x7f2a700b3e30 2024-05-30T17:04:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.341+0000 7f2a6fe00640 1 -- 172.21.15.59:0/1232001985 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a680a5570 con 0x7f2a700b3e30 2024-05-30T17:04:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.341+0000 7f2a6fe00640 1 -- 172.21.15.59:0/1232001985 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58001680 con 0x7f2a700b3e30 2024-05-30T17:04:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 -- 172.21.15.59:0/1232001985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a700b3e30 msgr2=0x7f2a7006f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 --2- 172.21.15.59:0/1232001985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a700b3e30 0x7f2a7006f8c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009dc0 tx=0x7f2a6801c8b0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 -- 172.21.15.59:0/1232001985 shutdown_connections 2024-05-30T17:04:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 --2- 172.21.15.59:0/1232001985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a700b3e30 0x7f2a7006f8c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 -- 172.21.15.59:0/1232001985 >> 172.21.15.59:0/1232001985 conn(0x7f2a70067d60 msgr2=0x7f2a7006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 -- 172.21.15.59:0/1232001985 shutdown_connections 2024-05-30T17:04:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 -- 172.21.15.59:0/1232001985 wait complete. 2024-05-30T17:04:08.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 Processor -- start 2024-05-30T17:04:08.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 -- start start 2024-05-30T17:04:08.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a700b3e30 0x7f2a7014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:08.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a701558e0 0x7f2a7014bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:08.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a7015f690 0x7f2a7014c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:08.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70155e40 con 0x7f2a7015f690 2024-05-30T17:04:08.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70155cc0 con 0x7f2a701558e0 2024-05-30T17:04:08.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a77a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2a70169100 con 0x7f2a700b3e30 2024-05-30T17:04:08.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a75a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a7015f690 0x7f2a7014c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:08.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a75a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a7015f690 0x7f2a7014c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33648/0 (socket says 172.21.15.59:33648) 2024-05-30T17:04:08.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a75a00640 1 -- 172.21.15.59:0/3240954307 learned_addr learned my addr 172.21.15.59:0/3240954307 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:08.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a75000640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a700b3e30 0x7f2a7014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:08.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a67e00640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a701558e0 0x7f2a7014bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:08.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a75a00640 1 -- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a700b3e30 msgr2=0x7f2a7014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a75a00640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a700b3e30 0x7f2a7014b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a75a00640 1 -- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a701558e0 msgr2=0x7f2a7014bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a75a00640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a701558e0 0x7f2a7014bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.345+0000 7f2a75a00640 1 -- 172.21.15.59:0/3240954307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7014d3b0 con 0x7f2a7015f690 2024-05-30T17:04:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.349+0000 7f2a75a00640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a7015f690 0x7f2a7014c0e0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f2a6801cd90 tx=0x7f2a68019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.349+0000 7f2a6d600640 1 -- 172.21.15.59:0/3240954307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a680b2050 con 0x7f2a7015f690 2024-05-30T17:04:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.349+0000 7f2a6d600640 1 -- 172.21.15.59:0/3240954307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a680be070 con 0x7f2a7015f690 2024-05-30T17:04:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.349+0000 7f2a6d600640 1 -- 172.21.15.59:0/3240954307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a680b9850 con 0x7f2a7015f690 2024-05-30T17:04:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.349+0000 7f2a77a00640 1 -- 172.21.15.59:0/3240954307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7014c710 con 0x7f2a7015f690 2024-05-30T17:04:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.349+0000 7f2a77a00640 1 -- 172.21.15.59:0/3240954307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a7014ccd0 con 0x7f2a7015f690 2024-05-30T17:04:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.349+0000 7f2a77a00640 1 -- 172.21.15.59:0/3240954307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a70068a90 con 0x7f2a7015f690 2024-05-30T17:04:08.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.349+0000 7f2a6d600640 1 -- 172.21.15.59:0/3240954307 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7f2a680b99f0 con 0x7f2a7015f690 2024-05-30T17:04:08.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.349+0000 7f2a6d600640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2a4c069eb0 0x7f2a4c06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:08.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.349+0000 7f2a6d600640 1 -- 172.21.15.59:0/3240954307 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5879+0+0 (secure 0 0 0) 0x7f2a68120790 con 0x7f2a7015f690 2024-05-30T17:04:08.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.353+0000 7f2a75000640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2a4c069eb0 0x7f2a4c06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:08.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.353+0000 7f2a75000640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2a4c069eb0 0x7f2a4c06c370 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2a600011f0 tx=0x7f2a60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:08.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.357+0000 7f2a6d600640 1 -- 172.21.15.59:0/3240954307 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2a680164a0 con 0x7f2a7015f690 2024-05-30T17:04:08.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.577+0000 7f2a77a00640 1 -- 172.21.15.59:0/3240954307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2a70072a40 con 0x7f2a7015f690 2024-05-30T17:04:08.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.577+0000 7f2a6d600640 1 -- 172.21.15.59:0/3240954307 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+5791 (secure 0 0 0) 0x7f2a680f21f0 con 0x7f2a7015f690 2024-05-30T17:04:08.578 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:08.578 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:04:08.578 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:04:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:04:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:04:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:04:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:04:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 928, 2024-05-30T17:04:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:04:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:04:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:04:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:04:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:04:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 118, 2024-05-30T17:04:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:04:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:04:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:04:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 1713, 2024-05-30T17:04:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 7056166155, 2024-05-30T17:04:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 15133839360, 2024-05-30T17:04:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 757960273920, 2024-05-30T17:04:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:04:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 853, 2024-05-30T17:04:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:04:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T17:04:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:04:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 72, 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8, 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 8, 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8460 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 19, 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:03:57.371237+0000", 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": { 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "y": { 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": { 2024-05-30T17:04:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:04:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:04:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: "a": { 2024-05-30T17:04:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: "b": { 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": { 2024-05-30T17:04:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "0": { 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "1": { 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: "2": { 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: "3": { 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: "4": { 2024-05-30T17:04:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: "5": { 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: "6": { 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: "7": { 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:08.593 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:08.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.593 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": {} 2024-05-30T17:04:08.593 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:04:08.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.581+0000 7f2a77a00640 1 -- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2a4c069eb0 msgr2=0x7f2a4c06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.581+0000 7f2a77a00640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2a4c069eb0 0x7f2a4c06c370 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2a600011f0 tx=0x7f2a60009040 comp rx=0 tx=0).stop 2024-05-30T17:04:08.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.581+0000 7f2a77a00640 1 -- 172.21.15.59:0/3240954307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a7015f690 msgr2=0x7f2a7014c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.581+0000 7f2a77a00640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a7015f690 0x7f2a7014c0e0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f2a6801cd90 tx=0x7f2a68019650 comp rx=0 tx=0).stop 2024-05-30T17:04:08.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.581+0000 7f2a77a00640 1 -- 172.21.15.59:0/3240954307 shutdown_connections 2024-05-30T17:04:08.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.581+0000 7f2a77a00640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2a4c069eb0 0x7f2a4c06c370 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.581+0000 7f2a77a00640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a7015f690 0x7f2a7014c0e0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.581+0000 7f2a77a00640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a701558e0 0x7f2a7014bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.581+0000 7f2a77a00640 1 --2- 172.21.15.59:0/3240954307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a700b3e30 0x7f2a7014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.581+0000 7f2a77a00640 1 -- 172.21.15.59:0/3240954307 >> 172.21.15.59:0/3240954307 conn(0x7f2a70067d60 msgr2=0x7f2a70154660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:08.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.581+0000 7f2a77a00640 1 -- 172.21.15.59:0/3240954307 shutdown_connections 2024-05-30T17:04:08.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.581+0000 7f2a77a00640 1 -- 172.21.15.59:0/3240954307 wait complete. 2024-05-30T17:04:08.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T17:04:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.741+0000 7fed37400640 1 Processor -- start 2024-05-30T17:04:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.741+0000 7fed37400640 1 -- start start 2024-05-30T17:04:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed37400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fed3009b150 0x7fed300cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed37400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed3009b780 0x7fed300ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed37400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed300d1310 con 0x7fed30160d90 2024-05-30T17:04:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed37400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fed3009bcf0 con 0x7fed3009b780 2024-05-30T17:04:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed37400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fed300d0a70 con 0x7fed3009b150 2024-05-30T17:04:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed35400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed3009b780 0x7fed300ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed35400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed3009b780 0x7fed300ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33652/0 (socket says 172.21.15.59:33652) 2024-05-30T17:04:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed35400640 1 -- 172.21.15.59:0/1714962582 learned_addr learned my addr 172.21.15.59:0/1714962582 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed27e00640 1 --2- 172.21.15.59:0/1714962582 >> v2:172.21.15.107:3300/0 conn(0x7fed3009b150 0x7fed300cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed35400640 1 -- 172.21.15.59:0/1714962582 >> v2:172.21.15.107:3300/0 conn(0x7fed3009b150 msgr2=0x7fed300cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed35400640 1 --2- 172.21.15.59:0/1714962582 >> v2:172.21.15.107:3300/0 conn(0x7fed3009b150 0x7fed300cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed35400640 1 -- 172.21.15.59:0/1714962582 >> v1:172.21.15.107:6789/0 conn(0x7fed30160d90 legacy=0x7fed3009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.745+0000 7fed35400640 1 -- 172.21.15.59:0/1714962582 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed300d0d50 con 0x7fed3009b780 2024-05-30T17:04:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed35400640 1 --2- 172.21.15.59:0/1714962582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed3009b780 0x7fed300ce260 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fed300d22d0 tx=0x7fed2801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2551dbab2d12aa02 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed2fe00640 1 -- 172.21.15.59:0/1714962582 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280a56a0 con 0x7fed3009b780 2024-05-30T17:04:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed2fe00640 1 -- 172.21.15.59:0/1714962582 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed280a5840 con 0x7fed3009b780 2024-05-30T17:04:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed2fe00640 1 -- 172.21.15.59:0/1714962582 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280a5c10 con 0x7fed3009b780 2024-05-30T17:04:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed37400640 1 -- 172.21.15.59:0/1714962582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed3009b780 msgr2=0x7fed300ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed37400640 1 --2- 172.21.15.59:0/1714962582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed3009b780 0x7fed300ce260 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fed300d22d0 tx=0x7fed2801c8d0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed37400640 1 -- 172.21.15.59:0/1714962582 shutdown_connections 2024-05-30T17:04:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed37400640 1 --2- 172.21.15.59:0/1714962582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed3009b780 0x7fed300ce260 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed37400640 1 --2- 172.21.15.59:0/1714962582 >> v2:172.21.15.107:3300/0 conn(0x7fed3009b150 0x7fed300cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed37400640 1 -- 172.21.15.59:0/1714962582 >> 172.21.15.59:0/1714962582 conn(0x7fed300b3f80 msgr2=0x7fed300b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed37400640 1 -- 172.21.15.59:0/1714962582 shutdown_connections 2024-05-30T17:04:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed37400640 1 -- 172.21.15.59:0/1714962582 wait complete. 2024-05-30T17:04:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed37400640 1 Processor -- start 2024-05-30T17:04:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed37400640 1 -- start start 2024-05-30T17:04:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.749+0000 7fed37400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed3009b150 0x7fed30155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed37400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed3009b780 0x7fed301faf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed37400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed30160d90 0x7fed3015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed37400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fed30071fe0 con 0x7fed30160d90 2024-05-30T17:04:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed37400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fed30071e60 con 0x7fed3009b780 2024-05-30T17:04:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed37400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fed30161170 con 0x7fed3009b150 2024-05-30T17:04:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed35400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed30160d90 0x7fed3015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed35400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed30160d90 0x7fed3015a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33656/0 (socket says 172.21.15.59:33656) 2024-05-30T17:04:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed35400640 1 -- 172.21.15.59:0/3797788047 learned_addr learned my addr 172.21.15.59:0/3797788047 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed27e00640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed3009b780 0x7fed301faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed34a00640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed3009b150 0x7fed30155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed35400640 1 -- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed3009b150 msgr2=0x7fed30155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed35400640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed3009b150 0x7fed30155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed35400640 1 -- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed3009b780 msgr2=0x7fed301faf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed35400640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed3009b780 0x7fed301faf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed35400640 1 -- 172.21.15.59:0/3797788047 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed301fb470 con 0x7fed30160d90 2024-05-30T17:04:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed34a00640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed3009b150 0x7fed30155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed35400640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed30160d90 0x7fed3015a7d0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fed280194e0 tx=0x7fed28019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed2d600640 1 -- 172.21.15.59:0/3797788047 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280bc020 con 0x7fed30160d90 2024-05-30T17:04:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed2d600640 1 -- 172.21.15.59:0/3797788047 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed280b8670 con 0x7fed30160d90 2024-05-30T17:04:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed2d600640 1 -- 172.21.15.59:0/3797788047 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28009510 con 0x7fed30160d90 2024-05-30T17:04:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed37400640 1 -- 172.21.15.59:0/3797788047 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed301fb710 con 0x7fed30160d90 2024-05-30T17:04:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed37400640 1 -- 172.21.15.59:0/3797788047 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed301fbcd0 con 0x7fed30160d90 2024-05-30T17:04:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed37400640 1 -- 172.21.15.59:0/3797788047 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed30068a90 con 0x7fed30160d90 2024-05-30T17:04:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.753+0000 7fed2d600640 1 -- 172.21.15.59:0/3797788047 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7fed280bf020 con 0x7fed30160d90 2024-05-30T17:04:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.757+0000 7fed2d600640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed0c069e80 0x7fed0c06c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.757+0000 7fed2d600640 1 -- 172.21.15.59:0/3797788047 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5879+0+0 (secure 0 0 0) 0x7fed28120750 con 0x7fed30160d90 2024-05-30T17:04:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.757+0000 7fed34a00640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed0c069e80 0x7fed0c06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:08.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.757+0000 7fed34a00640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed0c069e80 0x7fed0c06c340 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fed20001670 tx=0x7fed20009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.761+0000 7fed2d600640 1 -- 172.21.15.59:0/3797788047 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed280c6030 con 0x7fed30160d90 2024-05-30T17:04:08.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.949+0000 7fed37400640 1 -- 172.21.15.59:0/3797788047 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed300b4be0 con 0x7fed0c069e80 2024-05-30T17:04:08.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed2d600640 1 -- 172.21.15.59:0/3797788047 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+185 (secure 0 0 0) 0x7fed300b4be0 con 0x7fed0c069e80 2024-05-30T17:04:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:08.956 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:04:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sv1" 2024-05-30T17:04:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone55783" 2024-05-30T17:04:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone55782" 2024-05-30T17:04:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone55781" 2024-05-30T17:04:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:08.957 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:04:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed37400640 1 -- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed0c069e80 msgr2=0x7fed0c06c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed37400640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed0c069e80 0x7fed0c06c340 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fed20001670 tx=0x7fed20009040 comp rx=0 tx=0).stop 2024-05-30T17:04:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed37400640 1 -- 172.21.15.59:0/3797788047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed30160d90 msgr2=0x7fed3015a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed37400640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed30160d90 0x7fed3015a7d0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fed280194e0 tx=0x7fed28019670 comp rx=0 tx=0).stop 2024-05-30T17:04:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed37400640 1 -- 172.21.15.59:0/3797788047 shutdown_connections 2024-05-30T17:04:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed37400640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed0c069e80 0x7fed0c06c340 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed37400640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed30160d90 0x7fed3015a7d0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed37400640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed3009b780 0x7fed301faf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed37400640 1 --2- 172.21.15.59:0/3797788047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed3009b150 0x7fed30155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed37400640 1 -- 172.21.15.59:0/3797788047 >> 172.21.15.59:0/3797788047 conn(0x7fed300b3f80 msgr2=0x7fed3015d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed37400640 1 -- 172.21.15.59:0/3797788047 shutdown_connections 2024-05-30T17:04:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:08.957+0000 7fed37400640 1 -- 172.21.15.59:0/3797788047 wait complete. 2024-05-30T17:04:08.977 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T17:04:09.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.121+0000 7f3c12800640 1 Processor -- start 2024-05-30T17:04:09.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.121+0000 7f3c12800640 1 -- start start 2024-05-30T17:04:09.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c12800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c0c0af840 0x7f3c0c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c12800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0c06e120 con 0x7f3c0c156e40 2024-05-30T17:04:09.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c12800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0c06e400 con 0x7f3c0c06dc60 2024-05-30T17:04:09.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c12800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c06e6e0 con 0x7f3c0c0af840 2024-05-30T17:04:09.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c0b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3c0c156e40 0x7f3c0c15d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53482/0 (socket says 172.21.15.59:53482) 2024-05-30T17:04:09.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c0b400640 1 -- 172.21.15.59:0/2343875216 learned_addr learned my addr 172.21.15.59:0/2343875216 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:09.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c0be00640 1 --2- 172.21.15.59:0/2343875216 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c0c0af840 0x7f3c0c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c0aa00640 1 -- 172.21.15.59:0/2343875216 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1018659068 0 0) 0x7f3c0c06e120 con 0x7f3c0c156e40 2024-05-30T17:04:09.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c0aa00640 1 -- 172.21.15.59:0/2343875216 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bf0003530 con 0x7f3c0c156e40 2024-05-30T17:04:09.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c0aa00640 1 -- 172.21.15.59:0/2343875216 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 266382117 0 0) 0x7f3c0c06e400 con 0x7f3c0c06dc60 2024-05-30T17:04:09.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c0aa00640 1 -- 172.21.15.59:0/2343875216 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c0c06e120 con 0x7f3c0c06dc60 2024-05-30T17:04:09.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c0aa00640 1 -- 172.21.15.59:0/2343875216 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2579874554 0 0) 0x7f3bf0003530 con 0x7f3c0c156e40 2024-05-30T17:04:09.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c0be00640 1 -- 172.21.15.59:0/2343875216 >> v1:172.21.15.107:6789/0 conn(0x7f3c0c06dc60 legacy=0x7f3c0c0af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c0be00640 1 -- 172.21.15.59:0/2343875216 >> v1:172.21.15.59:6789/0 conn(0x7f3c0c156e40 legacy=0x7f3c0c15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.125+0000 7f3c0be00640 1 -- 172.21.15.59:0/2343875216 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c06e9c0 con 0x7f3c0c0af840 2024-05-30T17:04:09.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c0be00640 1 --2- 172.21.15.59:0/2343875216 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c0c0af840 0x7f3c0c06f1c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009dc0 tx=0x7f3c0401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=666113e94543fc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:09.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c0aa00640 1 -- 172.21.15.59:0/2343875216 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c040b2070 con 0x7f3c0c0af840 2024-05-30T17:04:09.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c0aa00640 1 -- 172.21.15.59:0/2343875216 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c040a5600 con 0x7f3c0c0af840 2024-05-30T17:04:09.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c0aa00640 1 -- 172.21.15.59:0/2343875216 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc0016a0 con 0x7f3c0c0af840 2024-05-30T17:04:09.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c12800640 1 -- 172.21.15.59:0/2343875216 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c0c0af840 msgr2=0x7f3c0c06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c12800640 1 --2- 172.21.15.59:0/2343875216 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c0c0af840 0x7f3c0c06f1c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009dc0 tx=0x7f3c0401c8b0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c12800640 1 -- 172.21.15.59:0/2343875216 shutdown_connections 2024-05-30T17:04:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c12800640 1 --2- 172.21.15.59:0/2343875216 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c0c0af840 0x7f3c0c06f1c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c12800640 1 -- 172.21.15.59:0/2343875216 >> 172.21.15.59:0/2343875216 conn(0x7f3c0c0b1e60 msgr2=0x7f3c0c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c12800640 1 -- 172.21.15.59:0/2343875216 shutdown_connections 2024-05-30T17:04:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c12800640 1 -- 172.21.15.59:0/2343875216 wait complete. 2024-05-30T17:04:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c12800640 1 Processor -- start 2024-05-30T17:04:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.129+0000 7f3c12800640 1 -- start start 2024-05-30T17:04:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c12800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c0c06dc60 0x7f3c0c14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c12800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c0c0af840 0x7f3c0c148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c12800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c156e40 0x7f3c0c167cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c12800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c15eb70 con 0x7f3c0c156e40 2024-05-30T17:04:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c12800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c15e9f0 con 0x7f3c0c06dc60 2024-05-30T17:04:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c12800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c16a560 con 0x7f3c0c0af840 2024-05-30T17:04:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c0be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c156e40 0x7f3c0c167cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c0be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c156e40 0x7f3c0c167cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33664/0 (socket says 172.21.15.59:33664) 2024-05-30T17:04:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c0be00640 1 -- 172.21.15.59:0/985640353 learned_addr learned my addr 172.21.15.59:0/985640353 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c0b400640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c0c06dc60 0x7f3c0c14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c03e00640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c0c0af840 0x7f3c0c148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c0be00640 1 -- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c0c0af840 msgr2=0x7f3c0c148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c0be00640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c0c0af840 0x7f3c0c148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c0be00640 1 -- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c0c06dc60 msgr2=0x7f3c0c14d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c0be00640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c0c06dc60 0x7f3c0c14d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c0be00640 1 -- 172.21.15.59:0/985640353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c149120 con 0x7f3c0c156e40 2024-05-30T17:04:09.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c03e00640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c0c0af840 0x7f3c0c148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:09.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c0be00640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c156e40 0x7f3c0c167cc0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f3c040b0040 tx=0x7f3c04019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:09.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c03400640 1 -- 172.21.15.59:0/985640353 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c040b2040 con 0x7f3c0c156e40 2024-05-30T17:04:09.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c03400640 1 -- 172.21.15.59:0/985640353 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c040bf070 con 0x7f3c0c156e40 2024-05-30T17:04:09.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c03400640 1 -- 172.21.15.59:0/985640353 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04009450 con 0x7f3c0c156e40 2024-05-30T17:04:09.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c12800640 1 -- 172.21.15.59:0/985640353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0c073060 con 0x7f3c0c156e40 2024-05-30T17:04:09.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c12800640 1 -- 172.21.15.59:0/985640353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c0c154e50 con 0x7f3c0c156e40 2024-05-30T17:04:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.133+0000 7f3c12800640 1 -- 172.21.15.59:0/985640353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c0c068a90 con 0x7f3c0c156e40 2024-05-30T17:04:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.137+0000 7f3c03400640 1 -- 172.21.15.59:0/985640353 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7f3c04004040 con 0x7f3c0c156e40 2024-05-30T17:04:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.137+0000 7f3c03400640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3be8069eb0 0x7f3be806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.137+0000 7f3c03400640 1 -- 172.21.15.59:0/985640353 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5879+0+0 (secure 0 0 0) 0x7f3c041209e0 con 0x7f3c0c156e40 2024-05-30T17:04:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.137+0000 7f3c0b400640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3be8069eb0 0x7f3be806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.137+0000 7f3c0b400640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3be8069eb0 0x7f3be806c370 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc000c10 tx=0x7f3bfc001560 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:09.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.141+0000 7f3c03400640 1 -- 172.21.15.59:0/985640353 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3c040164a0 con 0x7f3c0c156e40 2024-05-30T17:04:09.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.337+0000 7f3c12800640 1 -- 172.21.15.59:0/985640353 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c0c06fab0 con 0x7f3be8069eb0 2024-05-30T17:04:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.349+0000 7f3c03400640 1 -- 172.21.15.59:0/985640353 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3c0c06fab0 con 0x7f3be8069eb0 2024-05-30T17:04:09.351 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:09.351 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:04:09.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:09.351 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ss1" 2024-05-30T17:04:09.352 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:09.352 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:04:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.353+0000 7f3c12800640 1 -- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3be8069eb0 msgr2=0x7f3be806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.353+0000 7f3c12800640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3be8069eb0 0x7f3be806c370 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc000c10 tx=0x7f3bfc001560 comp rx=0 tx=0).stop 2024-05-30T17:04:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.353+0000 7f3c12800640 1 -- 172.21.15.59:0/985640353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c156e40 msgr2=0x7f3c0c167cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.353+0000 7f3c12800640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c156e40 0x7f3c0c167cc0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f3c040b0040 tx=0x7f3c04019650 comp rx=0 tx=0).stop 2024-05-30T17:04:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.353+0000 7f3c12800640 1 -- 172.21.15.59:0/985640353 shutdown_connections 2024-05-30T17:04:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.353+0000 7f3c12800640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3be8069eb0 0x7f3be806c370 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.353+0000 7f3c12800640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c156e40 0x7f3c0c167cc0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.353+0000 7f3c12800640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c0c0af840 0x7f3c0c148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.353+0000 7f3c12800640 1 --2- 172.21.15.59:0/985640353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c0c06dc60 0x7f3c0c14d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.353+0000 7f3c12800640 1 -- 172.21.15.59:0/985640353 >> 172.21.15.59:0/985640353 conn(0x7f3c0c0b1e60 msgr2=0x7f3c0c15c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.353+0000 7f3c12800640 1 -- 172.21.15.59:0/985640353 shutdown_connections 2024-05-30T17:04:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.353+0000 7f3c12800640 1 -- 172.21.15.59:0/985640353 wait complete. 2024-05-30T17:04:09.373 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:04:09.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.517+0000 7fd8ace00640 1 Processor -- start 2024-05-30T17:04:09.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.517+0000 7fd8ace00640 1 -- start start 2024-05-30T17:04:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8ace00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8a815fc30 0x7fd8a81602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8ace00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8a80cea50 0x7fd8a81607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8ace00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd8a80ce0b0 0x7fd8a809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8ace00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a80d2290 con 0x7fd8a80cea50 2024-05-30T17:04:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8ace00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a80b3970 con 0x7fd8a80ce0b0 2024-05-30T17:04:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8ace00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a8160010 con 0x7fd8a815fc30 2024-05-30T17:04:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8a5400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8a80cea50 0x7fd8a81607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8a5400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8a80cea50 0x7fd8a81607f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33670/0 (socket says 172.21.15.59:33670) 2024-05-30T17:04:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8a5400640 1 -- 172.21.15.59:0/1433405091 learned_addr learned my addr 172.21.15.59:0/1433405091 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8a5e00640 1 --2- 172.21.15.59:0/1433405091 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8a815fc30 0x7fd8a81602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8a6800640 1 --2- 172.21.15.59:0/1433405091 >> v2:172.21.15.107:3300/0 conn(0x7fd8a80ce0b0 0x7fd8a809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8a5400640 1 -- 172.21.15.59:0/1433405091 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8a815fc30 msgr2=0x7fd8a81602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8a5400640 1 --2- 172.21.15.59:0/1433405091 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8a815fc30 0x7fd8a81602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8a5400640 1 -- 172.21.15.59:0/1433405091 >> v2:172.21.15.107:3300/0 conn(0x7fd8a80ce0b0 msgr2=0x7fd8a809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8a5400640 1 --2- 172.21.15.59:0/1433405091 >> v2:172.21.15.107:3300/0 conn(0x7fd8a80ce0b0 0x7fd8a809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.521+0000 7fd8a5400640 1 -- 172.21.15.59:0/1433405091 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a80b33b0 con 0x7fd8a80cea50 2024-05-30T17:04:09.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8a5400640 1 --2- 172.21.15.59:0/1433405091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8a80cea50 0x7fd8a81607f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8073550 tx=0x7fd89401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42fde4714975b8a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:09.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8a4a00640 1 -- 172.21.15.59:0/1433405091 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8940b0070 con 0x7fd8a80cea50 2024-05-30T17:04:09.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8a4a00640 1 -- 172.21.15.59:0/1433405091 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8940ab600 con 0x7fd8a80cea50 2024-05-30T17:04:09.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8a4a00640 1 -- 172.21.15.59:0/1433405091 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8940ab9d0 con 0x7fd8a80cea50 2024-05-30T17:04:09.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8ace00640 1 -- 172.21.15.59:0/1433405091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8a80cea50 msgr2=0x7fd8a81607f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8ace00640 1 --2- 172.21.15.59:0/1433405091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8a80cea50 0x7fd8a81607f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8073550 tx=0x7fd89401c490 comp rx=0 tx=0).stop 2024-05-30T17:04:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8ace00640 1 -- 172.21.15.59:0/1433405091 shutdown_connections 2024-05-30T17:04:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8ace00640 1 --2- 172.21.15.59:0/1433405091 >> v2:172.21.15.107:3300/0 conn(0x7fd8a80ce0b0 0x7fd8a809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8ace00640 1 --2- 172.21.15.59:0/1433405091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8a80cea50 0x7fd8a81607f0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8ace00640 1 --2- 172.21.15.59:0/1433405091 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8a815fc30 0x7fd8a81602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8ace00640 1 -- 172.21.15.59:0/1433405091 >> 172.21.15.59:0/1433405091 conn(0x7fd8a80d2440 msgr2=0x7fd8a80d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8ace00640 1 -- 172.21.15.59:0/1433405091 shutdown_connections 2024-05-30T17:04:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8ace00640 1 -- 172.21.15.59:0/1433405091 wait complete. 2024-05-30T17:04:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8ace00640 1 Processor -- start 2024-05-30T17:04:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.525+0000 7fd8ace00640 1 -- start start 2024-05-30T17:04:09.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8ace00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8a80ce0b0 0x7fd8a8166f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8ace00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8a80cea50 0x7fd8a8152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8ace00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8a815fc30 0x7fd8a806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8ace00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a80d0190 con 0x7fd8a80cea50 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8ace00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a80d0010 con 0x7fd8a815fc30 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8ace00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a80d0310 con 0x7fd8a80ce0b0 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8a5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8a80cea50 0x7fd8a8152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8a5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8a80cea50 0x7fd8a8152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33676/0 (socket says 172.21.15.59:33676) 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8a5400640 1 -- 172.21.15.59:0/2860058811 learned_addr learned my addr 172.21.15.59:0/2860058811 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8a5e00640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8a80ce0b0 0x7fd8a8166f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8a6800640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8a815fc30 0x7fd8a806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8a5400640 1 -- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8a80ce0b0 msgr2=0x7fd8a8166f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8a5400640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8a80ce0b0 0x7fd8a8166f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8a5400640 1 -- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8a815fc30 msgr2=0x7fd8a806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8a5400640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8a815fc30 0x7fd8a806e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8a5400640 1 -- 172.21.15.59:0/2860058811 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a81fc410 con 0x7fd8a80cea50 2024-05-30T17:04:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8a5400640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8a80cea50 0x7fd8a8152930 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd89401ab40 tx=0x7fd894019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd89e000640 1 -- 172.21.15.59:0/2860058811 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8940b9070 con 0x7fd8a80cea50 2024-05-30T17:04:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd89e000640 1 -- 172.21.15.59:0/2860058811 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8940b4420 con 0x7fd8a80cea50 2024-05-30T17:04:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd89e000640 1 -- 172.21.15.59:0/2860058811 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8940b0040 con 0x7fd8a80cea50 2024-05-30T17:04:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8ace00640 1 -- 172.21.15.59:0/2860058811 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a81fb650 con 0x7fd8a80cea50 2024-05-30T17:04:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8ace00640 1 -- 172.21.15.59:0/2860058811 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a81fbc10 con 0x7fd8a80cea50 2024-05-30T17:04:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd8ace00640 1 -- 172.21.15.59:0/2860058811 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a8068a90 con 0x7fd8a80cea50 2024-05-30T17:04:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.529+0000 7fd89e000640 1 -- 172.21.15.59:0/2860058811 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7fd8940bc070 con 0x7fd8a80cea50 2024-05-30T17:04:09.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.533+0000 7fd89e000640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd888069e80 0x7fd88806c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.533+0000 7fd89e000640 1 -- 172.21.15.59:0/2860058811 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5879+0+0 (secure 0 0 0) 0x7fd89411e8c0 con 0x7fd8a80cea50 2024-05-30T17:04:09.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.533+0000 7fd8a5e00640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd888069e80 0x7fd88806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.533+0000 7fd8a5e00640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd888069e80 0x7fd88806c340 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd898009a40 tx=0x7fd898009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:09.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.537+0000 7fd89e000640 1 -- 172.21.15.59:0/2860058811 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd894016110 con 0x7fd8a80cea50 2024-05-30T17:04:09.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.733+0000 7fd8ace00640 1 -- 172.21.15.59:0/2860058811 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8a80cc870 con 0x7fd888069e80 2024-05-30T17:04:09.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd89e000640 1 -- 172.21.15.59:0/2860058811 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd8a80cc870 con 0x7fd888069e80 2024-05-30T17:04:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd8ace00640 1 -- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd888069e80 msgr2=0x7fd88806c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd8ace00640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd888069e80 0x7fd88806c340 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd898009a40 tx=0x7fd898009190 comp rx=0 tx=0).stop 2024-05-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd8ace00640 1 -- 172.21.15.59:0/2860058811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8a80cea50 msgr2=0x7fd8a8152930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd8ace00640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8a80cea50 0x7fd8a8152930 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd89401ab40 tx=0x7fd894019230 comp rx=0 tx=0).stop 2024-05-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd8ace00640 1 -- 172.21.15.59:0/2860058811 shutdown_connections 2024-05-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd8ace00640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd888069e80 0x7fd88806c340 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd8ace00640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8a815fc30 0x7fd8a806e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd8ace00640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8a80cea50 0x7fd8a8152930 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd8ace00640 1 --2- 172.21.15.59:0/2860058811 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8a80ce0b0 0x7fd8a8166f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd8ace00640 1 -- 172.21.15.59:0/2860058811 >> 172.21.15.59:0/2860058811 conn(0x7fd8a80d2440 msgr2=0x7fd8a80cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd8ace00640 1 -- 172.21.15.59:0/2860058811 shutdown_connections 2024-05-30T17:04:09.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.765+0000 7fd8ace00640 1 -- 172.21.15.59:0/2860058811 wait complete. 2024-05-30T17:04:09.786 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T17:04:09.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.929+0000 7f66b0e00640 1 Processor -- start 2024-05-30T17:04:09.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66b0e00640 1 -- start start 2024-05-30T17:04:09.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66b0e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66ac15c890 0x7f66ac0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66b0e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f66ac0b3a70 0x7f66ac06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66b0e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac0c4cf0 con 0x7f66ac06bef0 2024-05-30T17:04:09.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66b0e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f66ac0ce160 con 0x7f66ac15c890 2024-05-30T17:04:09.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66b0e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f66ac0ce440 con 0x7f66ac0b3a70 2024-05-30T17:04:09.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66a9e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66ac15c890 0x7f66ac0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66a9e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66ac15c890 0x7f66ac0cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33678/0 (socket says 172.21.15.59:33678) 2024-05-30T17:04:09.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66a9e00640 1 -- 172.21.15.59:0/55273249 learned_addr learned my addr 172.21.15.59:0/55273249 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:09.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66a1400640 1 --2- 172.21.15.59:0/55273249 >> v2:172.21.15.107:3300/0 conn(0x7f66ac0b3a70 0x7f66ac06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66a9e00640 1 -- 172.21.15.59:0/55273249 >> v2:172.21.15.107:3300/0 conn(0x7f66ac0b3a70 msgr2=0x7f66ac06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:09.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66a9e00640 1 --2- 172.21.15.59:0/55273249 >> v2:172.21.15.107:3300/0 conn(0x7f66ac0b3a70 0x7f66ac06b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66a9e00640 1 -- 172.21.15.59:0/55273249 >> v1:172.21.15.107:6789/0 conn(0x7f66ac06bef0 legacy=0x7f66ac160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:09.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66a9e00640 1 -- 172.21.15.59:0/55273249 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac0ce720 con 0x7f66ac15c890 2024-05-30T17:04:09.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.933+0000 7f66a1400640 1 --2- 172.21.15.59:0/55273249 >> v2:172.21.15.107:3300/0 conn(0x7f66ac0b3a70 0x7f66ac06b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:09.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66a9e00640 1 --2- 172.21.15.59:0/55273249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac15c890 0x7f66ac0cda60 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f66ac06ec70 tx=0x7f669c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eec69446a35e344 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:09.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66a9400640 1 -- 172.21.15.59:0/55273249 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c0ab5f0 con 0x7f66ac15c890 2024-05-30T17:04:09.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66a9400640 1 -- 172.21.15.59:0/55273249 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f669c0b0070 con 0x7f66ac15c890 2024-05-30T17:04:09.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66a9400640 1 -- 172.21.15.59:0/55273249 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c0ab9b0 con 0x7f66ac15c890 2024-05-30T17:04:09.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66b0e00640 1 -- 172.21.15.59:0/55273249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac15c890 msgr2=0x7f66ac0cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66b0e00640 1 --2- 172.21.15.59:0/55273249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac15c890 0x7f66ac0cda60 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f66ac06ec70 tx=0x7f669c01c4e0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66b0e00640 1 -- 172.21.15.59:0/55273249 shutdown_connections 2024-05-30T17:04:09.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66b0e00640 1 --2- 172.21.15.59:0/55273249 >> v2:172.21.15.107:3300/0 conn(0x7f66ac0b3a70 0x7f66ac06b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66b0e00640 1 --2- 172.21.15.59:0/55273249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac15c890 0x7f66ac0cda60 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66b0e00640 1 -- 172.21.15.59:0/55273249 >> 172.21.15.59:0/55273249 conn(0x7f66ac0b2f50 msgr2=0x7f66ac0b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:09.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66b0e00640 1 -- 172.21.15.59:0/55273249 shutdown_connections 2024-05-30T17:04:09.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66b0e00640 1 -- 172.21.15.59:0/55273249 wait complete. 2024-05-30T17:04:09.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66b0e00640 1 Processor -- start 2024-05-30T17:04:09.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.937+0000 7f66b0e00640 1 -- start start 2024-05-30T17:04:09.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66b0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac06bef0 0x7f66ac0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66b0e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66ac0b3a70 0x7f66ac1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66b0e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ac15c890 0x7f66ac0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66b0e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac169760 con 0x7f66ac06bef0 2024-05-30T17:04:09.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66b0e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac1695e0 con 0x7f66ac0b3a70 2024-05-30T17:04:09.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66b0e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f66ac1698e0 con 0x7f66ac15c890 2024-05-30T17:04:09.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac06bef0 0x7f66ac0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac06bef0 0x7f66ac0c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33686/0 (socket says 172.21.15.59:33686) 2024-05-30T17:04:09.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a9e00640 1 -- 172.21.15.59:0/3309136560 learned_addr learned my addr 172.21.15.59:0/3309136560 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:09.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a1400640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66ac0b3a70 0x7f66ac1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66aa800640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ac15c890 0x7f66ac0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a9e00640 1 -- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ac15c890 msgr2=0x7f66ac0c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a9e00640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ac15c890 0x7f66ac0c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a9e00640 1 -- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66ac0b3a70 msgr2=0x7f66ac1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:09.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a9e00640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66ac0b3a70 0x7f66ac1571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:09.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a9e00640 1 -- 172.21.15.59:0/3309136560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac15e000 con 0x7f66ac06bef0 2024-05-30T17:04:09.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a1400640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66ac0b3a70 0x7f66ac1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:09.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a9e00640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac06bef0 0x7f66ac0c7920 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f669c01a110 tx=0x7f669c01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:09.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a2a00640 1 -- 172.21.15.59:0/3309136560 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c0b4800 con 0x7f66ac06bef0 2024-05-30T17:04:09.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a2a00640 1 -- 172.21.15.59:0/3309136560 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f669c0b49a0 con 0x7f66ac06bef0 2024-05-30T17:04:09.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a2a00640 1 -- 172.21.15.59:0/3309136560 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c0b4d90 con 0x7f66ac06bef0 2024-05-30T17:04:09.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66b0e00640 1 -- 172.21.15.59:0/3309136560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac15e2e0 con 0x7f66ac06bef0 2024-05-30T17:04:09.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66b0e00640 1 -- 172.21.15.59:0/3309136560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac15e8a0 con 0x7f66ac06bef0 2024-05-30T17:04:09.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66b0e00640 1 -- 172.21.15.59:0/3309136560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ac068a90 con 0x7f66ac06bef0 2024-05-30T17:04:09.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.941+0000 7f66a2a00640 1 -- 172.21.15.59:0/3309136560 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7f669c0c7390 con 0x7f66ac06bef0 2024-05-30T17:04:09.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.945+0000 7f66a2a00640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6688069e80 0x7f668806c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:09.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.945+0000 7f66a2a00640 1 -- 172.21.15.59:0/3309136560 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5879+0+0 (secure 0 0 0) 0x7f669c11ffb0 con 0x7f66ac06bef0 2024-05-30T17:04:09.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.945+0000 7f66a1400640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6688069e80 0x7f668806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:09.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.945+0000 7f66a1400640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6688069e80 0x7f668806c340 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f66ac15dc50 tx=0x7f6694007a10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:09.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:09.949+0000 7f66a2a00640 1 -- 172.21.15.59:0/3309136560 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f669c0c4060 con 0x7f66ac06bef0 2024-05-30T17:04:10.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.141+0000 7f66b0e00640 1 -- 172.21.15.59:0/3309136560 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f66ac0cba10 con 0x7f6688069e80 2024-05-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.161+0000 7f66a2a00640 1 -- 172.21.15.59:0/3309136560 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f66ac0cba10 con 0x7f6688069e80 2024-05-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.165+0000 7f66b0e00640 1 -- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6688069e80 msgr2=0x7f668806c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.165+0000 7f66b0e00640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6688069e80 0x7f668806c340 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f66ac15dc50 tx=0x7f6694007a10 comp rx=0 tx=0).stop 2024-05-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.165+0000 7f66b0e00640 1 -- 172.21.15.59:0/3309136560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac06bef0 msgr2=0x7f66ac0c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.165+0000 7f66b0e00640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac06bef0 0x7f66ac0c7920 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f669c01a110 tx=0x7f669c01ad20 comp rx=0 tx=0).stop 2024-05-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.165+0000 7f66b0e00640 1 -- 172.21.15.59:0/3309136560 shutdown_connections 2024-05-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.165+0000 7f66b0e00640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6688069e80 0x7f668806c340 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.165+0000 7f66b0e00640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ac15c890 0x7f66ac0c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.165+0000 7f66b0e00640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66ac0b3a70 0x7f66ac1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.165+0000 7f66b0e00640 1 --2- 172.21.15.59:0/3309136560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac06bef0 0x7f66ac0c7920 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.165+0000 7f66b0e00640 1 -- 172.21.15.59:0/3309136560 >> 172.21.15.59:0/3309136560 conn(0x7f66ac0b2f50 msgr2=0x7f66ac06ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.165+0000 7f66b0e00640 1 -- 172.21.15.59:0/3309136560 shutdown_connections 2024-05-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.165+0000 7f66b0e00640 1 -- 172.21.15.59:0/3309136560 wait complete. 2024-05-30T17:04:10.167 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:10.166+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:10.167 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:10.166+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:10.167 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:10.166+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:10.167 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:10.166+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:10.167 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:10.166+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:10.183 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:10.182+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:10.183 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:10.182+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:10.183 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:10.182+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:10.183 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:10.182+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:10.184 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:10.182+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:10.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone55783 2024-05-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.333+0000 7fbfcb800640 1 Processor -- start 2024-05-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.333+0000 7fbfcb800640 1 -- start start 2024-05-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfcb800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfc415ed00 0x7fbfc409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfcb800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfc40b4aa0 0x7fbfc409af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfcb800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbfc40b32e0 0x7fbfc4162780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfcb800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbfc415f0e0 con 0x7fbfc40b4aa0 2024-05-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfcb800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbfc40b3830 con 0x7fbfc40b32e0 2024-05-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfcb800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc40d1200 con 0x7fbfc415ed00 2024-05-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfc3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfc40b4aa0 0x7fbfc409af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfc3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfc40b4aa0 0x7fbfc409af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33700/0 (socket says 172.21.15.59:33700) 2024-05-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfc3e00640 1 -- 172.21.15.59:0/415567627 learned_addr learned my addr 172.21.15.59:0/415567627 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfc9800640 1 --2- 172.21.15.59:0/415567627 >> v2:172.21.15.107:3300/0 conn(0x7fbfc40b32e0 0x7fbfc4162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfc8e00640 1 --2- 172.21.15.59:0/415567627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfc415ed00 0x7fbfc409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfc3e00640 1 -- 172.21.15.59:0/415567627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfc415ed00 msgr2=0x7fbfc409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfc3e00640 1 --2- 172.21.15.59:0/415567627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfc415ed00 0x7fbfc409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfc3e00640 1 -- 172.21.15.59:0/415567627 >> v2:172.21.15.107:3300/0 conn(0x7fbfc40b32e0 msgr2=0x7fbfc4162780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfc3e00640 1 --2- 172.21.15.59:0/415567627 >> v2:172.21.15.107:3300/0 conn(0x7fbfc40b32e0 0x7fbfc4162780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfc3e00640 1 -- 172.21.15.59:0/415567627 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc40d0ed0 con 0x7fbfc40b4aa0 2024-05-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.337+0000 7fbfc9800640 1 --2- 172.21.15.59:0/415567627 >> v2:172.21.15.107:3300/0 conn(0x7fbfc40b32e0 0x7fbfc4162780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfc3e00640 1 --2- 172.21.15.59:0/415567627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc40b4aa0 0x7fbfc409af80 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009870 tx=0x7fbfb001c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4187f2c982c54e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfc3400640 1 -- 172.21.15.59:0/415567627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00b0070 con 0x7fbfc40b4aa0 2024-05-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfc3400640 1 -- 172.21.15.59:0/415567627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb00ab600 con 0x7fbfc40b4aa0 2024-05-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfc3400640 1 -- 172.21.15.59:0/415567627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00ab9d0 con 0x7fbfc40b4aa0 2024-05-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfcb800640 1 -- 172.21.15.59:0/415567627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc40b4aa0 msgr2=0x7fbfc409af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfcb800640 1 --2- 172.21.15.59:0/415567627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc40b4aa0 0x7fbfc409af80 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009870 tx=0x7fbfb001c140 comp rx=0 tx=0).stop 2024-05-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfcb800640 1 -- 172.21.15.59:0/415567627 shutdown_connections 2024-05-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfcb800640 1 --2- 172.21.15.59:0/415567627 >> v2:172.21.15.107:3300/0 conn(0x7fbfc40b32e0 0x7fbfc4162780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfcb800640 1 --2- 172.21.15.59:0/415567627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc40b4aa0 0x7fbfc409af80 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfcb800640 1 --2- 172.21.15.59:0/415567627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfc415ed00 0x7fbfc409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfcb800640 1 -- 172.21.15.59:0/415567627 >> 172.21.15.59:0/415567627 conn(0x7fbfc40b3f80 msgr2=0x7fbfc40b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfcb800640 1 -- 172.21.15.59:0/415567627 shutdown_connections 2024-05-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfcb800640 1 -- 172.21.15.59:0/415567627 wait complete. 2024-05-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfcb800640 1 Processor -- start 2024-05-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.341+0000 7fbfcb800640 1 -- start start 2024-05-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfcb800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfc40b32e0 0x7fbfc4153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfcb800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfc40b4aa0 0x7fbfc4161930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfcb800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc415ed00 0x7fbfc40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfcb800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc409b8b0 con 0x7fbfc415ed00 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfcb800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc409b730 con 0x7fbfc40b32e0 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfcb800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc40b1c50 con 0x7fbfc40b4aa0 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc415ed00 0x7fbfc40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc415ed00 0x7fbfc40b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33712/0 (socket says 172.21.15.59:33712) 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc9800640 1 -- 172.21.15.59:0/2766295337 learned_addr learned my addr 172.21.15.59:0/2766295337 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc8e00640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfc40b32e0 0x7fbfc4153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc3e00640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfc40b4aa0 0x7fbfc4161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc9800640 1 -- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfc40b4aa0 msgr2=0x7fbfc4161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc9800640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfc40b4aa0 0x7fbfc4161930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc9800640 1 -- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfc40b32e0 msgr2=0x7fbfc4153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc9800640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfc40b32e0 0x7fbfc4153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc9800640 1 -- 172.21.15.59:0/2766295337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc4154120 con 0x7fbfc415ed00 2024-05-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc3e00640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfc40b4aa0 0x7fbfc4161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc9800640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc415ed00 0x7fbfc40b5080 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc007f20 tx=0x7fbfbc00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc0c00640 1 -- 172.21.15.59:0/2766295337 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc01a070 con 0x7fbfc415ed00 2024-05-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc0c00640 1 -- 172.21.15.59:0/2766295337 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfbc003ba0 con 0x7fbfc415ed00 2024-05-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfc0c00640 1 -- 172.21.15.59:0/2766295337 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc004030 con 0x7fbfc415ed00 2024-05-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfcb800640 1 -- 172.21.15.59:0/2766295337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc415fe10 con 0x7fbfc415ed00 2024-05-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfcb800640 1 -- 172.21.15.59:0/2766295337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc41603d0 con 0x7fbfc415ed00 2024-05-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.345+0000 7fbfcb800640 1 -- 172.21.15.59:0/2766295337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc4068a90 con 0x7fbfc415ed00 2024-05-30T17:04:10.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.349+0000 7fbfc0c00640 1 -- 172.21.15.59:0/2766295337 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7fbfbc01d070 con 0x7fbfc415ed00 2024-05-30T17:04:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.349+0000 7fbfc0c00640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbfa4069e80 0x7fbfa406c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.349+0000 7fbfc0c00640 1 -- 172.21.15.59:0/2766295337 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5879+0+0 (secure 0 0 0) 0x7fbfbc085bd0 con 0x7fbfc415ed00 2024-05-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.349+0000 7fbfc8e00640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbfa4069e80 0x7fbfa406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.349+0000 7fbfc8e00640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbfa4069e80 0x7fbfa406c340 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009a40 tx=0x7fbfb8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.353+0000 7fbfc0c00640 1 -- 172.21.15.59:0/2766295337 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbfc4154120 con 0x7fbfc415ed00 2024-05-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.549+0000 7fbfcb800640 1 -- 172.21.15.59:0/2766295337 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone55783", "target": ["mon-mgr", ""]}) -- 0x7fbfc409bd50 con 0x7fbfa4069e80 2024-05-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.573+0000 7fbfc0c00640 1 -- 172.21.15.59:0/2766295337 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbfc409bd50 con 0x7fbfa4069e80 2024-05-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.577+0000 7fbfcb800640 1 -- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbfa4069e80 msgr2=0x7fbfa406c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.577+0000 7fbfcb800640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbfa4069e80 0x7fbfa406c340 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009a40 tx=0x7fbfb8009190 comp rx=0 tx=0).stop 2024-05-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.577+0000 7fbfcb800640 1 -- 172.21.15.59:0/2766295337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc415ed00 msgr2=0x7fbfc40b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.577+0000 7fbfcb800640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc415ed00 0x7fbfc40b5080 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc007f20 tx=0x7fbfbc00d560 comp rx=0 tx=0).stop 2024-05-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.577+0000 7fbfcb800640 1 -- 172.21.15.59:0/2766295337 shutdown_connections 2024-05-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.577+0000 7fbfcb800640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbfa4069e80 0x7fbfa406c340 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.577+0000 7fbfcb800640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc415ed00 0x7fbfc40b5080 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.577+0000 7fbfcb800640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfc40b4aa0 0x7fbfc4161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.577+0000 7fbfcb800640 1 --2- 172.21.15.59:0/2766295337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfc40b32e0 0x7fbfc4153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.577+0000 7fbfcb800640 1 -- 172.21.15.59:0/2766295337 >> 172.21.15.59:0/2766295337 conn(0x7fbfc40b3f80 msgr2=0x7fbfc4070a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.577+0000 7fbfcb800640 1 -- 172.21.15.59:0/2766295337 shutdown_connections 2024-05-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.577+0000 7fbfcb800640 1 -- 172.21.15.59:0/2766295337 wait complete. 2024-05-30T17:04:10.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone55782 2024-05-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.745+0000 7f34f2e00640 1 Processor -- start 2024-05-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.745+0000 7f34f2e00640 1 -- start start 2024-05-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34f2e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f34ec0b62c0 0x7f34ec0b0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34f2e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f34ec0b0680 0x7f34ec0af420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34f2e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34ec0b2910 con 0x7f34ec15e890 2024-05-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34f2e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f34ec15fc80 con 0x7f34ec0b62c0 2024-05-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34f2e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f34ec0b26c0 con 0x7f34ec0b0680 2024-05-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34e3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f34ec0b62c0 0x7f34ec0b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34e3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f34ec0b62c0 0x7f34ec0b0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33728/0 (socket says 172.21.15.59:33728) 2024-05-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34e3e00640 1 -- 172.21.15.59:0/296438001 learned_addr learned my addr 172.21.15.59:0/296438001 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34f0e00640 1 --2- 172.21.15.59:0/296438001 >> v2:172.21.15.107:3300/0 conn(0x7f34ec0b0680 0x7f34ec0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34e3e00640 1 -- 172.21.15.59:0/296438001 >> v2:172.21.15.107:3300/0 conn(0x7f34ec0b0680 msgr2=0x7f34ec0af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34e3e00640 1 --2- 172.21.15.59:0/296438001 >> v2:172.21.15.107:3300/0 conn(0x7f34ec0b0680 0x7f34ec0af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34e3e00640 1 -- 172.21.15.59:0/296438001 >> v1:172.21.15.107:6789/0 conn(0x7f34ec15e890 legacy=0x7f34ec0b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34e3e00640 1 -- 172.21.15.59:0/296438001 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec0b2bf0 con 0x7f34ec0b62c0 2024-05-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.749+0000 7f34eb400640 1 -- 172.21.15.59:0/296438001 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250608271 0 0) 0x7f34ec0b2910 con 0x7f34ec15e890 2024-05-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34e3e00640 1 --2- 172.21.15.59:0/296438001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34ec0b62c0 0x7f34ec0b0140 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0b75a0 tx=0x7f34d401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c45acb2f3843574 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34eb400640 1 -- 172.21.15.59:0/296438001 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d40b0070 con 0x7f34ec0b62c0 2024-05-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34eb400640 1 -- 172.21.15.59:0/296438001 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d40ab600 con 0x7f34ec0b62c0 2024-05-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34eb400640 1 -- 172.21.15.59:0/296438001 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d40ab9d0 con 0x7f34ec0b62c0 2024-05-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34f2e00640 1 -- 172.21.15.59:0/296438001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34ec0b62c0 msgr2=0x7f34ec0b0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34f2e00640 1 --2- 172.21.15.59:0/296438001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34ec0b62c0 0x7f34ec0b0140 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0b75a0 tx=0x7f34d401c400 comp rx=0 tx=0).stop 2024-05-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34f2e00640 1 -- 172.21.15.59:0/296438001 shutdown_connections 2024-05-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34f2e00640 1 --2- 172.21.15.59:0/296438001 >> v2:172.21.15.107:3300/0 conn(0x7f34ec0b0680 0x7f34ec0af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34f2e00640 1 --2- 172.21.15.59:0/296438001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34ec0b62c0 0x7f34ec0b0140 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34f2e00640 1 -- 172.21.15.59:0/296438001 >> 172.21.15.59:0/296438001 conn(0x7f34ec09aa40 msgr2=0x7f34ec0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34f2e00640 1 -- 172.21.15.59:0/296438001 shutdown_connections 2024-05-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34f2e00640 1 -- 172.21.15.59:0/296438001 wait complete. 2024-05-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34f2e00640 1 Processor -- start 2024-05-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.753+0000 7f34f2e00640 1 -- start start 2024-05-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34f2e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34ec0b0680 0x7f34ec156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34f2e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34ec0b62c0 0x7f34ec14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34f2e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34ec15e890 0x7f34ec157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34f2e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec16b720 con 0x7f34ec0b0680 2024-05-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34f2e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec16b5a0 con 0x7f34ec15e890 2024-05-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34f2e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f34ec16b8a0 con 0x7f34ec0b62c0 2024-05-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34ebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34ec0b0680 0x7f34ec156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34ebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34ec0b0680 0x7f34ec156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33744/0 (socket says 172.21.15.59:33744) 2024-05-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34ebe00640 1 -- 172.21.15.59:0/3603439073 learned_addr learned my addr 172.21.15.59:0/3603439073 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34f0e00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34ec15e890 0x7f34ec157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34e3e00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34ec0b62c0 0x7f34ec14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34ebe00640 1 -- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34ec0b62c0 msgr2=0x7f34ec14f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34ebe00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34ec0b62c0 0x7f34ec14f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34ebe00640 1 -- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34ec15e890 msgr2=0x7f34ec157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34ebe00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34ec15e890 0x7f34ec157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34ebe00640 1 -- 172.21.15.59:0/3603439073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec160110 con 0x7f34ec0b0680 2024-05-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34f0e00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34ec15e890 0x7f34ec157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34ebe00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34ec0b0680 0x7f34ec156f20 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00c4d0 tx=0x7f34dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34e8c00640 1 -- 172.21.15.59:0/3603439073 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc017070 con 0x7f34ec0b0680 2024-05-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34e8c00640 1 -- 172.21.15.59:0/3603439073 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34dc005480 con 0x7f34ec0b0680 2024-05-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34e8c00640 1 -- 172.21.15.59:0/3603439073 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc003840 con 0x7f34ec0b0680 2024-05-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34f2e00640 1 -- 172.21.15.59:0/3603439073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34ec1603f0 con 0x7f34ec0b0680 2024-05-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34f2e00640 1 -- 172.21.15.59:0/3603439073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34ec1609b0 con 0x7f34ec0b0680 2024-05-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34f2e00640 1 -- 172.21.15.59:0/3603439073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34ec068a90 con 0x7f34ec0b0680 2024-05-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.757+0000 7f34e8c00640 1 -- 172.21.15.59:0/3603439073 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7f34dc01a070 con 0x7f34ec0b0680 2024-05-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.761+0000 7f34e8c00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f34c8069e80 0x7f34c806c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.761+0000 7f34e8c00640 1 -- 172.21.15.59:0/3603439073 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5935+0+0 (secure 0 0 0) 0x7f34dc084c60 con 0x7f34ec0b0680 2024-05-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.761+0000 7f34e3e00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f34c8069e80 0x7f34c806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.761+0000 7f34e3e00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f34c8069e80 0x7f34c806c340 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f34d40ad000 tx=0x7f34d40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.769+0000 7f34e8c00640 1 -- 172.21.15.59:0/3603439073 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f34dc0566f0 con 0x7f34ec0b0680 2024-05-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.961+0000 7f34f2e00640 1 -- 172.21.15.59:0/3603439073 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone55782", "target": ["mon-mgr", ""]}) -- 0x7f34ec152da0 con 0x7f34c8069e80 2024-05-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.981+0000 7f34e8c00640 1 -- 172.21.15.59:0/3603439073 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f34ec152da0 con 0x7f34c8069e80 2024-05-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.985+0000 7f34f2e00640 1 -- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f34c8069e80 msgr2=0x7f34c806c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.985+0000 7f34f2e00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f34c8069e80 0x7f34c806c340 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f34d40ad000 tx=0x7f34d40a6000 comp rx=0 tx=0).stop 2024-05-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.985+0000 7f34f2e00640 1 -- 172.21.15.59:0/3603439073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34ec0b0680 msgr2=0x7f34ec156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.985+0000 7f34f2e00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34ec0b0680 0x7f34ec156f20 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00c4d0 tx=0x7f34dc00c990 comp rx=0 tx=0).stop 2024-05-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.985+0000 7f34f2e00640 1 -- 172.21.15.59:0/3603439073 shutdown_connections 2024-05-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.985+0000 7f34f2e00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f34c8069e80 0x7f34c806c340 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.985+0000 7f34f2e00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34ec15e890 0x7f34ec157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.985+0000 7f34f2e00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34ec0b62c0 0x7f34ec14f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.985+0000 7f34f2e00640 1 --2- 172.21.15.59:0/3603439073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34ec0b0680 0x7f34ec156f20 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.985+0000 7f34f2e00640 1 -- 172.21.15.59:0/3603439073 >> 172.21.15.59:0/3603439073 conn(0x7f34ec09aa40 msgr2=0x7f34ec0ae2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.985+0000 7f34f2e00640 1 -- 172.21.15.59:0/3603439073 shutdown_connections 2024-05-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:10.985+0000 7f34f2e00640 1 -- 172.21.15.59:0/3603439073 wait complete. 2024-05-30T17:04:11.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone55781 2024-05-30T17:04:11.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac36600640 1 Processor -- start 2024-05-30T17:04:11.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac36600640 1 -- start start 2024-05-30T17:04:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac36600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac30161e20 0x7fac3006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac36600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fac300730e0 0x7fac3006cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac36600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac300b3d50 con 0x7fac30162310 2024-05-30T17:04:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac36600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fac300b4030 con 0x7fac300730e0 2024-05-30T17:04:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac36600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fac3006e7c0 con 0x7fac30161e20 2024-05-30T17:04:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac2fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fac30162310 0x7fac301627a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53494/0 (socket says 172.21.15.59:53494) 2024-05-30T17:04:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac2fe00640 1 -- 172.21.15.59:0/1228636094 learned_addr learned my addr 172.21.15.59:0/1228636094 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:11.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac26a00640 1 --2- 172.21.15.59:0/1228636094 >> v2:172.21.15.107:3300/0 conn(0x7fac300730e0 0x7fac3006cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315893934 0 0) 0x7fac300b3d50 con 0x7fac30162310 2024-05-30T17:04:11.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac2f400640 1 --2- 172.21.15.59:0/1228636094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac30161e20 0x7fac3006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac14003530 con 0x7fac30162310 2024-05-30T17:04:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.153+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3580177294 0 0) 0x7fac14003530 con 0x7fac30162310 2024-05-30T17:04:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac30161e20 msgr2=0x7fac3006c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 --2- 172.21.15.59:0/1228636094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac30161e20 0x7fac3006c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 >> v2:172.21.15.107:3300/0 conn(0x7fac300730e0 msgr2=0x7fac3006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 --2- 172.21.15.59:0/1228636094 >> v2:172.21.15.107:3300/0 conn(0x7fac300730e0 0x7fac3006cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3006eaa0 con 0x7fac30162310 2024-05-30T17:04:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fac28001680 con 0x7fac30162310 2024-05-30T17:04:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 >> v1:172.21.15.59:6789/0 conn(0x7fac30162310 legacy=0x7fac301627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 --2- 172.21.15.59:0/1228636094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac140039c0 0x7fac14003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 --2- 172.21.15.59:0/1228636094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14004810 0x7fac14004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 --2- 172.21.15.59:0/1228636094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac30161e20 0x7fac140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fac3006e7c0 con 0x7fac14004810 2024-05-30T17:04:11.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fac1400b9d0 con 0x7fac140039c0 2024-05-30T17:04:11.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fac1400bb50 con 0x7fac30161e20 2024-05-30T17:04:11.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac26a00640 1 --2- 172.21.15.59:0/1228636094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14004810 0x7fac14004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2f400640 1 --2- 172.21.15.59:0/1228636094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac140039c0 0x7fac14003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2fe00640 1 --2- 172.21.15.59:0/1228636094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac30161e20 0x7fac140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac26a00640 1 -- 172.21.15.59:0/1228636094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac30161e20 msgr2=0x7fac140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:11.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac26a00640 1 --2- 172.21.15.59:0/1228636094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac30161e20 0x7fac140051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac26a00640 1 -- 172.21.15.59:0/1228636094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac140039c0 msgr2=0x7fac14003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:11.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac26a00640 1 --2- 172.21.15.59:0/1228636094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac140039c0 0x7fac14003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac26a00640 1 -- 172.21.15.59:0/1228636094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac14003530 con 0x7fac14004810 2024-05-30T17:04:11.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac26a00640 1 --2- 172.21.15.59:0/1228636094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14004810 0x7fac14004c90 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fac18009ae0 tx=0x7fac1801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8a68eb7db48f2e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:11.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180b2070 con 0x7fac14004810 2024-05-30T17:04:11.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac180a55c0 con 0x7fac14004810 2024-05-30T17:04:11.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.157+0000 7fac2ea00640 1 -- 172.21.15.59:0/1228636094 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180096b0 con 0x7fac14004810 2024-05-30T17:04:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 -- 172.21.15.59:0/1228636094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14004810 msgr2=0x7fac14004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 --2- 172.21.15.59:0/1228636094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14004810 0x7fac14004c90 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fac18009ae0 tx=0x7fac1801cab0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac2fe00640 1 -- 172.21.15.59:0/1228636094 reap_dead start 2024-05-30T17:04:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 -- 172.21.15.59:0/1228636094 shutdown_connections 2024-05-30T17:04:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 -- 172.21.15.59:0/1228636094 >> 172.21.15.59:0/1228636094 conn(0x7fac300725c0 msgr2=0x7fac300729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:11.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 -- 172.21.15.59:0/1228636094 shutdown_connections 2024-05-30T17:04:11.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 -- 172.21.15.59:0/1228636094 wait complete. 2024-05-30T17:04:11.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 Processor -- start 2024-05-30T17:04:11.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 -- start start 2024-05-30T17:04:11.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14004810 0x7fac300b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac3015e430 0x7fac300ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac3014c180 0x7fac3014c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fac300d0820 con 0x7fac14004810 2024-05-30T17:04:11.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fac300b3a20 con 0x7fac3015e430 2024-05-30T17:04:11.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac36600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fac300cd0d0 con 0x7fac3014c180 2024-05-30T17:04:11.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac2f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14004810 0x7fac300b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac2f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14004810 0x7fac300b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33758/0 (socket says 172.21.15.59:33758) 2024-05-30T17:04:11.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac2f400640 1 -- 172.21.15.59:0/2419176712 learned_addr learned my addr 172.21.15.59:0/2419176712 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:11.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac2fe00640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac3014c180 0x7fac3014c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac26a00640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac3015e430 0x7fac300ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac2f400640 1 -- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac3014c180 msgr2=0x7fac3014c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:11.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac2f400640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac3014c180 0x7fac3014c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac2f400640 1 -- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac3015e430 msgr2=0x7fac300ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:11.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac2f400640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac3015e430 0x7fac300ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.161+0000 7fac2f400640 1 -- 172.21.15.59:0/2419176712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3015eba0 con 0x7fac14004810 2024-05-30T17:04:11.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.165+0000 7fac2f400640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14004810 0x7fac300b19b0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fac20009f90 tx=0x7fac2000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:11.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.165+0000 7fac27e00640 1 -- 172.21.15.59:0/2419176712 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2000fea0 con 0x7fac14004810 2024-05-30T17:04:11.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.165+0000 7fac27e00640 1 -- 172.21.15.59:0/2419176712 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac20015630 con 0x7fac14004810 2024-05-30T17:04:11.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.165+0000 7fac27e00640 1 -- 172.21.15.59:0/2419176712 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20015a20 con 0x7fac14004810 2024-05-30T17:04:11.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.165+0000 7fac36600640 1 -- 172.21.15.59:0/2419176712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3015ee80 con 0x7fac14004810 2024-05-30T17:04:11.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.165+0000 7fac36600640 1 -- 172.21.15.59:0/2419176712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3015fe60 con 0x7fac14004810 2024-05-30T17:04:11.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.165+0000 7fac36600640 1 -- 172.21.15.59:0/2419176712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac30068a90 con 0x7fac14004810 2024-05-30T17:04:11.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.165+0000 7fac27e00640 1 -- 172.21.15.59:0/2419176712 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 37) ==== 90435+0+0 (secure 0 0 0) 0x7fac20015bc0 con 0x7fac14004810 2024-05-30T17:04:11.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.165+0000 7fac27e00640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fac0c069e80 0x7fac0c06c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.165+0000 7fac27e00640 1 -- 172.21.15.59:0/2419176712 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5935+0+0 (secure 0 0 0) 0x7fac20086810 con 0x7fac14004810 2024-05-30T17:04:11.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.165+0000 7fac26a00640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fac0c069e80 0x7fac0c06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.169+0000 7fac26a00640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fac0c069e80 0x7fac0c06c340 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fac180af000 tx=0x7fac180046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:11.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.169+0000 7fac27e00640 1 -- 172.21.15.59:0/2419176712 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fac20019030 con 0x7fac14004810 2024-05-30T17:04:11.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.365+0000 7fac36600640 1 -- 172.21.15.59:0/2419176712 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone55781", "target": ["mon-mgr", ""]}) -- 0x7fac300678a0 con 0x7fac0c069e80 2024-05-30T17:04:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.385+0000 7fac27e00640 1 -- 172.21.15.59:0/2419176712 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fac300678a0 con 0x7fac0c069e80 2024-05-30T17:04:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.389+0000 7fac36600640 1 -- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fac0c069e80 msgr2=0x7fac0c06c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.389+0000 7fac36600640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fac0c069e80 0x7fac0c06c340 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fac180af000 tx=0x7fac180046d0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.389+0000 7fac36600640 1 -- 172.21.15.59:0/2419176712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14004810 msgr2=0x7fac300b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.389+0000 7fac36600640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14004810 0x7fac300b19b0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fac20009f90 tx=0x7fac2000f580 comp rx=0 tx=0).stop 2024-05-30T17:04:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.389+0000 7fac36600640 1 -- 172.21.15.59:0/2419176712 shutdown_connections 2024-05-30T17:04:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.389+0000 7fac36600640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fac0c069e80 0x7fac0c06c340 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.389+0000 7fac36600640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac3014c180 0x7fac3014c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.389+0000 7fac36600640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac3015e430 0x7fac300ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.389+0000 7fac36600640 1 --2- 172.21.15.59:0/2419176712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14004810 0x7fac300b19b0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.389+0000 7fac36600640 1 -- 172.21.15.59:0/2419176712 >> 172.21.15.59:0/2419176712 conn(0x7fac300725c0 msgr2=0x7fac3006fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.389+0000 7fac36600640 1 -- 172.21.15.59:0/2419176712 shutdown_connections 2024-05-30T17:04:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.389+0000 7fac36600640 1 -- 172.21.15.59:0/2419176712 wait complete. 2024-05-30T17:04:11.410 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T17:04:11.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T17:04:11.469 INFO:teuthology.orchestra.run.smithi059.stdout:2 2024-05-30T17:04:11.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T17:04:11.476 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T17:04:11.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T17:04:11.563 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T17:04:11.652 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T17:04:11.652 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T17:04:11.652 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:04:11.652 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:04:11.662 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:04:11.662 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:04:11.715 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T17:04:11.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1df1200640 1 Processor -- start 2024-05-30T17:04:11.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1df1200640 1 -- start start 2024-05-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1df1200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dec0b48f0 0x7f1dec1630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1df1200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dec15fbe0 con 0x7f1dec0b4510 2024-05-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1df1200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dec15fec0 con 0x7f1dec072d00 2024-05-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1df1200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1dec1635f0 con 0x7f1dec0b48f0 2024-05-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de9e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1dec0b4510 0x7f1dec15f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53504/0 (socket says 172.21.15.59:53504) 2024-05-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de9e00640 1 -- 172.21.15.59:0/3241531273 learned_addr learned my addr 172.21.15.59:0/3241531273 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:11.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de9400640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dec0b48f0 0x7f1dec1630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2995494044 0 0) 0x7f1dec15fbe0 con 0x7f1dec0b4510 2024-05-30T17:04:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dd0003530 con 0x7f1dec0b4510 2024-05-30T17:04:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485247500 0 0) 0x7f1dec15fec0 con 0x7f1dec072d00 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dec15fbe0 con 0x7f1dec072d00 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1039446937 0 0) 0x7f1dd0003530 con 0x7f1dec0b4510 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dec0b48f0 msgr2=0x7f1dec1630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dec0b48f0 0x7f1dec1630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 >> v1:172.21.15.107:6789/0 conn(0x7f1dec072d00 legacy=0x7f1dec06e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dec1628b0 con 0x7f1dec0b4510 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f1ddc001680 con 0x7f1dec0b4510 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 >> v1:172.21.15.59:6789/0 conn(0x7f1dec0b4510 legacy=0x7f1dec15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd0003b80 0x7f1dd0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd0004810 0x7f1dd0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dec0b48f0 0x7f1dd00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec1635f0 con 0x7f1dd0003b80 2024-05-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd000ba80 con 0x7f1dd0004810 2024-05-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1dd000bc50 con 0x7f1dec0b48f0 2024-05-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de9e00640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd0003b80 0x7f1dd0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de9400640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd0004810 0x7f1dd0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1dea800640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dec0b48f0 0x7f1dd00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de9e00640 1 -- 172.21.15.59:0/3241531273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dec0b48f0 msgr2=0x7f1dd00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de9e00640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dec0b48f0 0x7f1dd00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de9e00640 1 -- 172.21.15.59:0/3241531273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd0004810 msgr2=0x7f1dd0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de9e00640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd0004810 0x7f1dd0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1de9e00640 1 -- 172.21.15.59:0/3241531273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd0003530 con 0x7f1dd0003b80 2024-05-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.901+0000 7f1dea800640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dec0b48f0 0x7f1dd00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.905+0000 7f1de9e00640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd0003b80 0x7f1dd0003f80 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00c190 tx=0x7f1ddc01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10dc4ba99a8ffcd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.905+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc007cd0 con 0x7f1dd0003b80 2024-05-30T17:04:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.905+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ddc0a9020 con 0x7f1dd0003b80 2024-05-30T17:04:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.905+0000 7f1de8a00640 1 -- 172.21.15.59:0/3241531273 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc005ae0 con 0x7f1dd0003b80 2024-05-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.905+0000 7f1df1200640 1 -- 172.21.15.59:0/3241531273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd0003b80 msgr2=0x7f1dd0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.905+0000 7f1df1200640 1 --2- 172.21.15.59:0/3241531273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd0003b80 0x7f1dd0003f80 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00c190 tx=0x7f1ddc01cbc0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.905+0000 7f1dea800640 1 -- 172.21.15.59:0/3241531273 reap_dead start 2024-05-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.905+0000 7f1df1200640 1 -- 172.21.15.59:0/3241531273 shutdown_connections 2024-05-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.905+0000 7f1df1200640 1 -- 172.21.15.59:0/3241531273 >> 172.21.15.59:0/3241531273 conn(0x7f1dec0b3240 msgr2=0x7f1dec0725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.905+0000 7f1df1200640 1 -- 172.21.15.59:0/3241531273 shutdown_connections 2024-05-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.905+0000 7f1df1200640 1 -- 172.21.15.59:0/3241531273 wait complete. 2024-05-30T17:04:11.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1df1200640 1 Processor -- start 2024-05-30T17:04:11.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1df1200640 1 -- start start 2024-05-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1df1200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd0003b80 0x7f1dec13d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1df1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dec13f350 0x7f1dec161ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1df1200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec152a40 0x7f1dec1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1df1200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec15f940 con 0x7f1dec13f350 2024-05-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1df1200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec15f7c0 con 0x7f1dec152a40 2024-05-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1df1200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1dec073110 con 0x7f1dd0003b80 2024-05-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dec13f350 0x7f1dec161ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de9e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd0003b80 0x7f1dec13d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dec13f350 0x7f1dec161ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33768/0 (socket says 172.21.15.59:33768) 2024-05-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de9400640 1 -- 172.21.15.59:0/4118916422 learned_addr learned my addr 172.21.15.59:0/4118916422 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1dea800640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec152a40 0x7f1dec1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de9400640 1 -- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd0003b80 msgr2=0x7f1dec13d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de9400640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd0003b80 0x7f1dec13d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de9400640 1 -- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec152a40 msgr2=0x7f1dec1582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de9400640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec152a40 0x7f1dec1582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de9400640 1 -- 172.21.15.59:0/4118916422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dec13f920 con 0x7f1dec13f350 2024-05-30T17:04:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de9400640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dec13f350 0x7f1dec161ae0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8011930 tx=0x7f1dd8011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de2000640 1 -- 172.21.15.59:0/4118916422 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800faf0 con 0x7f1dec13f350 2024-05-30T17:04:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de2000640 1 -- 172.21.15.59:0/4118916422 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd800fc90 con 0x7f1dec13f350 2024-05-30T17:04:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1df1200640 1 -- 172.21.15.59:0/4118916422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dec13fc00 con 0x7f1dec13f350 2024-05-30T17:04:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1de2000640 1 -- 172.21.15.59:0/4118916422 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8014440 con 0x7f1dec13f350 2024-05-30T17:04:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.909+0000 7f1df1200640 1 -- 172.21.15.59:0/4118916422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dec1401c0 con 0x7f1dec13f350 2024-05-30T17:04:11.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.913+0000 7f1df1200640 1 -- 172.21.15.59:0/4118916422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dec068a90 con 0x7f1dec13f350 2024-05-30T17:04:11.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.913+0000 7f1de2000640 1 -- 172.21.15.59:0/4118916422 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f1dd8012040 con 0x7f1dec13f350 2024-05-30T17:04:11.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.913+0000 7f1de2000640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1dcc069fd0 0x7f1dcc06c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:11.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.913+0000 7f1de2000640 1 -- 172.21.15.59:0/4118916422 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5935+0+0 (secure 0 0 0) 0x7f1dd8085e60 con 0x7f1dec13f350 2024-05-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.913+0000 7f1de9e00640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1dcc069fd0 0x7f1dcc06c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.917+0000 7f1de9e00640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1dcc069fd0 0x7f1dcc06c490 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0aa000 tx=0x7f1ddc0019d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:11.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:11.917+0000 7f1de2000640 1 -- 172.21.15.59:0/4118916422 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1dd8019030 con 0x7f1dec13f350 2024-05-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 -- 172.21.15.59:0/4118916422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1dec06d2c0 con 0x7f1dec13f350 2024-05-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1de2000640 1 -- 172.21.15.59:0/4118916422 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v119) ==== 80+0+0 (secure 0 0 0) 0x7f1dd80578d0 con 0x7f1dec13f350 2024-05-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 -- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1dcc069fd0 msgr2=0x7f1dcc06c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1dcc069fd0 0x7f1dcc06c490 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0aa000 tx=0x7f1ddc0019d0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 -- 172.21.15.59:0/4118916422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dec13f350 msgr2=0x7f1dec161ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dec13f350 0x7f1dec161ae0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8011930 tx=0x7f1dd8011df0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 -- 172.21.15.59:0/4118916422 shutdown_connections 2024-05-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1dcc069fd0 0x7f1dcc06c490 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec152a40 0x7f1dec1582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dec13f350 0x7f1dec161ae0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 --2- 172.21.15.59:0/4118916422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd0003b80 0x7f1dec13d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 -- 172.21.15.59:0/4118916422 >> 172.21.15.59:0/4118916422 conn(0x7f1dec0b3240 msgr2=0x7f1dec06e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 -- 172.21.15.59:0/4118916422 shutdown_connections 2024-05-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.097+0000 7f1df1200640 1 -- 172.21.15.59:0/4118916422 wait complete. 2024-05-30T17:04:12.119 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2024-05-30T17:04:12.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:12.119 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-30T17:04:12.139 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T17:04:12.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:12.139 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T17:04:12.141 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[49753]: fuse finished with error 0 and tester_r 0 2024-05-30T17:04:12.275 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T17:04:12.275 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:04:12.275 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:04:12.284 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:04:12.285 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T17:04:12.285 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:04:12.285 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:04:12.332 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T17:04:12.332 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T17:04:12.332 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:04:12.332 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:04:12.341 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:04:12.341 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf65e00640 1 Processor -- start 2024-05-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf65e00640 1 -- start start 2024-05-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf65e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf60160d90 0x7fcf6009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf65e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcf600711e0 0x7fcf6009af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf65e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf600d1310 con 0x7fcf6009b780 2024-05-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf65e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fcf600ced30 con 0x7fcf60160d90 2024-05-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf65e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6009bcf0 con 0x7fcf600711e0 2024-05-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf5ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf60160d90 0x7fcf6009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf57e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcf6009b780 0x7fcf6006ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42180/0 (socket says 172.21.15.59:42180) 2024-05-30T17:04:12.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf57e00640 1 -- 172.21.15.59:0/2673454469 learned_addr learned my addr 172.21.15.59:0/2673454469 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:12.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf5f400640 1 --2- 172.21.15.59:0/2673454469 >> v2:172.21.15.107:3300/0 conn(0x7fcf600711e0 0x7fcf6009af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:12.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf5ea00640 1 -- 172.21.15.59:0/2673454469 >> v2:172.21.15.107:3300/0 conn(0x7fcf600711e0 msgr2=0x7fcf6009af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:12.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf5ea00640 1 --2- 172.21.15.59:0/2673454469 >> v2:172.21.15.107:3300/0 conn(0x7fcf600711e0 0x7fcf6009af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf5ea00640 1 -- 172.21.15.59:0/2673454469 >> v1:172.21.15.59:6789/0 conn(0x7fcf6009b780 legacy=0x7fcf6006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf5ea00640 1 -- 172.21.15.59:0/2673454469 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf600d0a70 con 0x7fcf60160d90 2024-05-30T17:04:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf5e000640 1 -- 172.21.15.59:0/2673454469 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439263093 0 0) 0x7fcf600d1310 con 0x7fcf6009b780 2024-05-30T17:04:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.517+0000 7fcf5f400640 1 --2- 172.21.15.59:0/2673454469 >> v2:172.21.15.107:3300/0 conn(0x7fcf600711e0 0x7fcf6009af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf5ea00640 1 --2- 172.21.15.59:0/2673454469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf60160d90 0x7fcf6009aa40 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fcf600d2300 tx=0x7fcf5001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815288011d76237c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf5e000640 1 -- 172.21.15.59:0/2673454469 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf500b0070 con 0x7fcf60160d90 2024-05-30T17:04:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf5e000640 1 -- 172.21.15.59:0/2673454469 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf500ab600 con 0x7fcf60160d90 2024-05-30T17:04:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf5e000640 1 -- 172.21.15.59:0/2673454469 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf500ab9d0 con 0x7fcf60160d90 2024-05-30T17:04:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf65e00640 1 -- 172.21.15.59:0/2673454469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf60160d90 msgr2=0x7fcf6009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf65e00640 1 --2- 172.21.15.59:0/2673454469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf60160d90 0x7fcf6009aa40 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fcf600d2300 tx=0x7fcf5001c3f0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf65e00640 1 -- 172.21.15.59:0/2673454469 shutdown_connections 2024-05-30T17:04:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf65e00640 1 --2- 172.21.15.59:0/2673454469 >> v2:172.21.15.107:3300/0 conn(0x7fcf600711e0 0x7fcf6009af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf65e00640 1 --2- 172.21.15.59:0/2673454469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf60160d90 0x7fcf6009aa40 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf65e00640 1 -- 172.21.15.59:0/2673454469 >> 172.21.15.59:0/2673454469 conn(0x7fcf600b3f80 msgr2=0x7fcf600b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf65e00640 1 -- 172.21.15.59:0/2673454469 shutdown_connections 2024-05-30T17:04:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf65e00640 1 -- 172.21.15.59:0/2673454469 wait complete. 2024-05-30T17:04:12.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf65e00640 1 Processor -- start 2024-05-30T17:04:12.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.521+0000 7fcf65e00640 1 -- start start 2024-05-30T17:04:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf65e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf600711e0 0x7fcf600b7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf65e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6009b780 0x7fcf6015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf65e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf60160d90 0x7fcf6014eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf65e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf60071fe0 con 0x7fcf6009b780 2024-05-30T17:04:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf65e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcf60071e60 con 0x7fcf600711e0 2024-05-30T17:04:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf65e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcf60161170 con 0x7fcf60160d90 2024-05-30T17:04:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf57e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6009b780 0x7fcf6015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf57e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6009b780 0x7fcf6015eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50504/0 (socket says 172.21.15.59:50504) 2024-05-30T17:04:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf57e00640 1 -- 172.21.15.59:0/2433655644 learned_addr learned my addr 172.21.15.59:0/2433655644 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf5ea00640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf600711e0 0x7fcf600b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf5f400640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf60160d90 0x7fcf6014eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf57e00640 1 -- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf60160d90 msgr2=0x7fcf6014eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf57e00640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf60160d90 0x7fcf6014eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf57e00640 1 -- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf600711e0 msgr2=0x7fcf600b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf57e00640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf600711e0 0x7fcf600b7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf57e00640 1 -- 172.21.15.59:0/2433655644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf60159cc0 con 0x7fcf6009b780 2024-05-30T17:04:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf5f400640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf60160d90 0x7fcf6014eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf57e00640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6009b780 0x7fcf6015eb60 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c580 tx=0x7fcf4800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf57400640 1 -- 172.21.15.59:0/2433655644 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48017070 con 0x7fcf6009b780 2024-05-30T17:04:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf57400640 1 -- 172.21.15.59:0/2433655644 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf48005d10 con 0x7fcf6009b780 2024-05-30T17:04:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf65e00640 1 -- 172.21.15.59:0/2433655644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf600b6c40 con 0x7fcf6009b780 2024-05-30T17:04:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf57400640 1 -- 172.21.15.59:0/2433655644 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48007330 con 0x7fcf6009b780 2024-05-30T17:04:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf65e00640 1 -- 172.21.15.59:0/2433655644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6015f0a0 con 0x7fcf6009b780 2024-05-30T17:04:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.525+0000 7fcf65e00640 1 -- 172.21.15.59:0/2433655644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf60068a90 con 0x7fcf6009b780 2024-05-30T17:04:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.529+0000 7fcf57400640 1 -- 172.21.15.59:0/2433655644 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fcf4801a070 con 0x7fcf6009b780 2024-05-30T17:04:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.529+0000 7fcf57400640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcf3c069fd0 0x7fcf3c06c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.529+0000 7fcf57400640 1 -- 172.21.15.59:0/2433655644 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5935+0+0 (secure 0 0 0) 0x7fcf48084d80 con 0x7fcf6009b780 2024-05-30T17:04:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.529+0000 7fcf5ea00640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcf3c069fd0 0x7fcf3c06c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.529+0000 7fcf5ea00640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcf3c069fd0 0x7fcf3c06c490 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fcf500ad000 tx=0x7fcf50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.533+0000 7fcf57400640 1 -- 172.21.15.59:0/2433655644 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcf480566d0 con 0x7fcf6009b780 2024-05-30T17:04:12.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 -- 172.21.15.59:0/2433655644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf600b4be0 con 0x7fcf6009b780 2024-05-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf57400640 1 -- 172.21.15.59:0/2433655644 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5186 (secure 0 0 0) 0x7fcf4805a9d0 con 0x7fcf6009b780 2024-05-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":72,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3022278523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3022278523},{"type":"v1","addr":"172.21.15.59:6835","nonce":3022278523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2843818914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2843818914},{"type":"v1","addr":"172.21.15.107:6837","nonce":2843818914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7750,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3415278570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3415278570},{"type":"v1","addr":"172.21.15.107:6836","nonce":3415278570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:02:49.435879+0000","modified":"2024-05-30T17:02:52.455412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8460":{"gid":8460,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/871678202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":871678202},{"type":"v1","addr":"172.21.15.59:6834","nonce":871678202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8460,"qdb_cluster":[8460]},"id":8}]} 2024-05-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 72 2024-05-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 -- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcf3c069fd0 msgr2=0x7fcf3c06c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcf3c069fd0 0x7fcf3c06c490 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fcf500ad000 tx=0x7fcf50008040 comp rx=0 tx=0).stop 2024-05-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 -- 172.21.15.59:0/2433655644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6009b780 msgr2=0x7fcf6015eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6009b780 0x7fcf6015eb60 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c580 tx=0x7fcf4800ca40 comp rx=0 tx=0).stop 2024-05-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 -- 172.21.15.59:0/2433655644 shutdown_connections 2024-05-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcf3c069fd0 0x7fcf3c06c490 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf60160d90 0x7fcf6014eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6009b780 0x7fcf6015eb60 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 --2- 172.21.15.59:0/2433655644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf600711e0 0x7fcf600b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 -- 172.21.15.59:0/2433655644 >> 172.21.15.59:0/2433655644 conn(0x7fcf600b3f80 msgr2=0x7fcf600af6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 -- 172.21.15.59:0/2433655644 shutdown_connections 2024-05-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.733+0000 7fcf65e00640 1 -- 172.21.15.59:0/2433655644 wait complete. 2024-05-30T17:04:12.754 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:04:12.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.893+0000 7f7439000640 1 Processor -- start 2024-05-30T17:04:12.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.893+0000 7f7439000640 1 -- start start 2024-05-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.893+0000 7f7439000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7434156ec0 0x7f743406e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.893+0000 7f7439000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74341572a0 con 0x7f743406eb90 2024-05-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.893+0000 7f7439000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f743406f0a0 con 0x7f7434073410 2024-05-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.893+0000 7f7439000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f743406f380 con 0x7f7434156ec0 2024-05-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.893+0000 7f7429400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f743406eb90 0x7f7434072d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42190/0 (socket says 172.21.15.59:42190) 2024-05-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.893+0000 7f7429400640 1 -- 172.21.15.59:0/1947701289 learned_addr learned my addr 172.21.15.59:0/1947701289 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431e00640 1 --2- 172.21.15.59:0/1947701289 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7434156ec0 0x7f743406e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431400640 1 -- 172.21.15.59:0/1947701289 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237447184 0 0) 0x7f741c001120 con 0x7f743406eb90 2024-05-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431400640 1 -- 172.21.15.59:0/1947701289 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7418003530 con 0x7f743406eb90 2024-05-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431400640 1 -- 172.21.15.59:0/1947701289 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766770829 0 0) 0x7f743406f0a0 con 0x7f7434073410 2024-05-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431400640 1 -- 172.21.15.59:0/1947701289 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f741c001120 con 0x7f7434073410 2024-05-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431400640 1 -- 172.21.15.59:0/1947701289 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2760395222 0 0) 0x7f7418003530 con 0x7f743406eb90 2024-05-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431e00640 1 -- 172.21.15.59:0/1947701289 >> v1:172.21.15.107:6789/0 conn(0x7f7434073410 legacy=0x7f74340ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431e00640 1 -- 172.21.15.59:0/1947701289 >> v1:172.21.15.59:6789/0 conn(0x7f743406eb90 legacy=0x7f7434072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431e00640 1 -- 172.21.15.59:0/1947701289 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743406f660 con 0x7f7434156ec0 2024-05-30T17:04:12.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431e00640 1 --2- 172.21.15.59:0/1947701289 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7434156ec0 0x7f743406e650 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f74240097f0 tx=0x7f742401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97ecdc639f4106a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:12.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431400640 1 -- 172.21.15.59:0/1947701289 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74240b0070 con 0x7f7434156ec0 2024-05-30T17:04:12.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431400640 1 -- 172.21.15.59:0/1947701289 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74240ab400 con 0x7f7434156ec0 2024-05-30T17:04:12.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.897+0000 7f7431400640 1 -- 172.21.15.59:0/1947701289 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c0017d0 con 0x7f7434156ec0 2024-05-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 -- 172.21.15.59:0/1947701289 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7434156ec0 msgr2=0x7f743406e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 --2- 172.21.15.59:0/1947701289 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7434156ec0 0x7f743406e650 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f74240097f0 tx=0x7f742401c400 comp rx=0 tx=0).stop 2024-05-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 -- 172.21.15.59:0/1947701289 shutdown_connections 2024-05-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 --2- 172.21.15.59:0/1947701289 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7434156ec0 0x7f743406e650 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 -- 172.21.15.59:0/1947701289 >> 172.21.15.59:0/1947701289 conn(0x7f74340b3240 msgr2=0x7f74340725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 -- 172.21.15.59:0/1947701289 shutdown_connections 2024-05-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 -- 172.21.15.59:0/1947701289 wait complete. 2024-05-30T17:04:12.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 Processor -- start 2024-05-30T17:04:12.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 -- start start 2024-05-30T17:04:12.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f743406eb90 0x7f74340ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:12.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7434073410 0x7f74340cf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:12.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7434156ec0 0x7f743414b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:12.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f74340af6f0 con 0x7f7434156ec0 2024-05-30T17:04:12.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f74340af570 con 0x7f743406eb90 2024-05-30T17:04:12.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7439000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f743416a7f0 con 0x7f7434073410 2024-05-30T17:04:12.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7432800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7434156ec0 0x7f743414b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:12.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7432800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7434156ec0 0x7f743414b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50514/0 (socket says 172.21.15.59:50514) 2024-05-30T17:04:12.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7432800640 1 -- 172.21.15.59:0/1080862627 learned_addr learned my addr 172.21.15.59:0/1080862627 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:12.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7431e00640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f743406eb90 0x7f74340ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:12.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7429400640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7434073410 0x7f74340cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:12.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7432800640 1 -- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7434073410 msgr2=0x7f74340cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7432800640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7434073410 0x7f74340cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7432800640 1 -- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f743406eb90 msgr2=0x7f74340ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:12.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7432800640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f743406eb90 0x7f74340ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:12.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7432800640 1 -- 172.21.15.59:0/1080862627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74340b5b00 con 0x7f7434156ec0 2024-05-30T17:04:12.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.901+0000 7f7429400640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7434073410 0x7f74340cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:12.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.905+0000 7f7432800640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7434156ec0 0x7f743414b6a0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f742c00c7c0 tx=0x7f742c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:12.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.905+0000 7f742aa00640 1 -- 172.21.15.59:0/1080862627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c003b80 con 0x7f7434156ec0 2024-05-30T17:04:12.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.905+0000 7f742aa00640 1 -- 172.21.15.59:0/1080862627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c003d20 con 0x7f7434156ec0 2024-05-30T17:04:12.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.905+0000 7f742aa00640 1 -- 172.21.15.59:0/1080862627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c00aa90 con 0x7f7434156ec0 2024-05-30T17:04:12.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.905+0000 7f7439000640 1 -- 172.21.15.59:0/1080862627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74340cd480 con 0x7f7434156ec0 2024-05-30T17:04:12.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.905+0000 7f7439000640 1 -- 172.21.15.59:0/1080862627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74340b5540 con 0x7f7434156ec0 2024-05-30T17:04:12.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.905+0000 7f7439000640 1 -- 172.21.15.59:0/1080862627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7434068a90 con 0x7f7434156ec0 2024-05-30T17:04:12.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.905+0000 7f742aa00640 1 -- 172.21.15.59:0/1080862627 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f742c00ac30 con 0x7f7434156ec0 2024-05-30T17:04:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.905+0000 7f742aa00640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7410069fa0 0x7f741006c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.905+0000 7f742aa00640 1 -- 172.21.15.59:0/1080862627 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5935+0+0 (secure 0 0 0) 0x7f742c085870 con 0x7f7434156ec0 2024-05-30T17:04:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.909+0000 7f7431e00640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7410069fa0 0x7f741006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.909+0000 7f7431e00640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7410069fa0 0x7f741006c460 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f74240ad000 tx=0x7f74240a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:12.909+0000 7f742aa00640 1 -- 172.21.15.59:0/1080862627 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f742c057890 con 0x7f7434156ec0 2024-05-30T17:04:13.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.109+0000 7f7439000640 1 -- 172.21.15.59:0/1080862627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74341519e0 con 0x7f7434156ec0 2024-05-30T17:04:13.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f742aa00640 1 -- 172.21.15.59:0/1080862627 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5186 (secure 0 0 0) 0x7f742c057190 con 0x7f7434156ec0 2024-05-30T17:04:13.112 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:13.112 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":72,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3022278523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3022278523},{"type":"v1","addr":"172.21.15.59:6835","nonce":3022278523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2843818914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2843818914},{"type":"v1","addr":"172.21.15.107:6837","nonce":2843818914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7750,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3415278570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3415278570},{"type":"v1","addr":"172.21.15.107:6836","nonce":3415278570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:02:49.435879+0000","modified":"2024-05-30T17:02:52.455412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8460":{"gid":8460,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/871678202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":871678202},{"type":"v1","addr":"172.21.15.59:6834","nonce":871678202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8460,"qdb_cluster":[8460]},"id":8}]} 2024-05-30T17:04:13.112 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 72 2024-05-30T17:04:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f7439000640 1 -- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7410069fa0 msgr2=0x7f741006c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f7439000640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7410069fa0 0x7f741006c460 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f74240ad000 tx=0x7f74240a6000 comp rx=0 tx=0).stop 2024-05-30T17:04:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f7439000640 1 -- 172.21.15.59:0/1080862627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7434156ec0 msgr2=0x7f743414b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f7439000640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7434156ec0 0x7f743414b6a0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f742c00c7c0 tx=0x7f742c00cc80 comp rx=0 tx=0).stop 2024-05-30T17:04:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f7439000640 1 -- 172.21.15.59:0/1080862627 shutdown_connections 2024-05-30T17:04:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f7439000640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f7410069fa0 0x7f741006c460 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f7439000640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7434156ec0 0x7f743414b6a0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f7439000640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7434073410 0x7f74340cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f7439000640 1 --2- 172.21.15.59:0/1080862627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f743406eb90 0x7f74340ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f7439000640 1 -- 172.21.15.59:0/1080862627 >> 172.21.15.59:0/1080862627 conn(0x7f74340b3240 msgr2=0x7f74340725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f7439000640 1 -- 172.21.15.59:0/1080862627 shutdown_connections 2024-05-30T17:04:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.113+0000 7f7439000640 1 -- 172.21.15.59:0/1080862627 wait complete. 2024-05-30T17:04:13.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.373+0000 7fde23c00640 1 Processor -- start 2024-05-30T17:04:13.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.373+0000 7fde23c00640 1 -- start start 2024-05-30T17:04:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.373+0000 7fde23c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde1c0d0470 0x7fde1c06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.373+0000 7fde23c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c163b80 0x7fde1c0d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.373+0000 7fde21c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fde1c0b3b50 0x7fde1c0721c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42204/0 (socket says 172.21.15.59:42204) 2024-05-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.373+0000 7fde21c00640 1 -- 172.21.15.59:0/4212004622 learned_addr learned my addr 172.21.15.59:0/4212004622 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.373+0000 7fde21200640 1 --2- 172.21.15.59:0/4212004622 >> v2:172.21.15.59:3300/0 conn(0x7fde1c0d0470 0x7fde1c06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.373+0000 7fde1be00640 1 --2- 172.21.15.59:0/4212004622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c163b80 0x7fde1c0d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.373+0000 7fde23c00640 1 -- 172.21.15.59:0/4212004622 --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde1c164000 con 0x7fde1c0b3b50 2024-05-30T17:04:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde23c00640 1 -- 172.21.15.59:0/4212004622 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fde1c06ea20 con 0x7fde1c0d0470 2024-05-30T17:04:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde23c00640 1 -- 172.21.15.59:0/4212004622 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fde1c0d0d90 con 0x7fde1c163b80 2024-05-30T17:04:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 124469612 0 0) 0x7fde1c164000 con 0x7fde1c0b3b50 2024-05-30T17:04:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde00003530 con 0x7fde1c0b3b50 2024-05-30T17:04:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3645562507 0 0) 0x7fde00003530 con 0x7fde1c0b3b50 2024-05-30T17:04:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c163b80 msgr2=0x7fde1c0d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 --2- 172.21.15.59:0/4212004622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c163b80 0x7fde1c0d0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 >> v2:172.21.15.59:3300/0 conn(0x7fde1c0d0470 msgr2=0x7fde1c06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 --2- 172.21.15.59:0/4212004622 >> v2:172.21.15.59:3300/0 conn(0x7fde1c0d0470 0x7fde1c06dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1c15d4e0 con 0x7fde1c0b3b50 2024-05-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fde08001680 con 0x7fde1c0b3b50 2024-05-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1be00640 1 --2- 172.21.15.59:0/4212004622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c163b80 0x7fde1c0d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 >> v1:172.21.15.59:6789/0 conn(0x7fde1c0b3b50 legacy=0x7fde1c0721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 --2- 172.21.15.59:0/4212004622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde000039c0 0x7fde00003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 --2- 172.21.15.59:0/4212004622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde00004810 0x7fde00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 --2- 172.21.15.59:0/4212004622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c163b80 0x7fde0000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c06ea20 con 0x7fde000039c0 2024-05-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c0d0d90 con 0x7fde00004810 2024-05-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fde00005650 con 0x7fde1c163b80 2024-05-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde21200640 1 --2- 172.21.15.59:0/4212004622 >> v2:172.21.15.59:3300/0 conn(0x7fde1c0d0470 0x7fde1c06dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde21200640 1 --2- 172.21.15.59:0/4212004622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde000039c0 0x7fde00003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde1be00640 1 --2- 172.21.15.59:0/4212004622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde00004810 0x7fde00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde21200640 1 -- 172.21.15.59:0/4212004622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c163b80 msgr2=0x7fde0000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde21200640 1 --2- 172.21.15.59:0/4212004622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c163b80 0x7fde0000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde21200640 1 -- 172.21.15.59:0/4212004622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde00004810 msgr2=0x7fde00004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde21200640 1 --2- 172.21.15.59:0/4212004622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde00004810 0x7fde00004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.377+0000 7fde21200640 1 -- 172.21.15.59:0/4212004622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde00003530 con 0x7fde000039c0 2024-05-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.381+0000 7fde21200640 1 --2- 172.21.15.59:0/4212004622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde000039c0 0x7fde00003de0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fde1400c410 tx=0x7fde1401d0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffcca037a738828 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.381+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde14007c00 con 0x7fde000039c0 2024-05-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.381+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde140039a0 con 0x7fde000039c0 2024-05-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.381+0000 7fde1b400640 1 -- 172.21.15.59:0/4212004622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde14003db0 con 0x7fde000039c0 2024-05-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.381+0000 7fde23c00640 1 -- 172.21.15.59:0/4212004622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde000039c0 msgr2=0x7fde00003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.381+0000 7fde23c00640 1 --2- 172.21.15.59:0/4212004622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde000039c0 0x7fde00003de0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fde1400c410 tx=0x7fde1401d0e0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.381+0000 7fde21c00640 1 -- 172.21.15.59:0/4212004622 reap_dead start 2024-05-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.381+0000 7fde23c00640 1 -- 172.21.15.59:0/4212004622 shutdown_connections 2024-05-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.381+0000 7fde23c00640 1 -- 172.21.15.59:0/4212004622 >> 172.21.15.59:0/4212004622 conn(0x7fde1c0b22d0 msgr2=0x7fde1c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.381+0000 7fde23c00640 1 -- 172.21.15.59:0/4212004622 shutdown_connections 2024-05-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.381+0000 7fde23c00640 1 -- 172.21.15.59:0/4212004622 wait complete. 2024-05-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.385+0000 7fde23c00640 1 Processor -- start 2024-05-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.385+0000 7fde23c00640 1 -- start start 2024-05-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.385+0000 7fde23c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c340 0x7fde1c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde23c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde1c15c720 0x7fde1c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde23c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde1c0cd640 0x7fde1c09a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde23c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c072ce0 con 0x7fde1c0cd640 2024-05-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde23c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c0b3630 con 0x7fde1c15c720 2024-05-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde23c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fde1c0b3f30 con 0x7fde1c15c340 2024-05-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde21c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde1c0cd640 0x7fde1c09a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde21200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c340 0x7fde1c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde21c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde1c0cd640 0x7fde1c09a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50544/0 (socket says 172.21.15.59:50544) 2024-05-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde21c00640 1 -- 172.21.15.59:0/341877907 learned_addr learned my addr 172.21.15.59:0/341877907 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde1be00640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde1c15c720 0x7fde1c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde21c00640 1 -- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c340 msgr2=0x7fde1c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde21c00640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c340 0x7fde1c0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde21c00640 1 -- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde1c15c720 msgr2=0x7fde1c0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde21c00640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde1c15c720 0x7fde1c0cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde21c00640 1 -- 172.21.15.59:0/341877907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1c0cdbb0 con 0x7fde1c0cd640 2024-05-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde21c00640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde1c0cd640 0x7fde1c09a5b0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0b5160 tx=0x7fde0800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde18c00640 1 -- 172.21.15.59:0/341877907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08004cc0 con 0x7fde1c0cd640 2024-05-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde18c00640 1 -- 172.21.15.59:0/341877907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde08007030 con 0x7fde1c0cd640 2024-05-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde18c00640 1 -- 172.21.15.59:0/341877907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08007420 con 0x7fde1c0cd640 2024-05-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde23c00640 1 -- 172.21.15.59:0/341877907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde1c0cde90 con 0x7fde1c0cd640 2024-05-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.389+0000 7fde23c00640 1 -- 172.21.15.59:0/341877907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde1c0ce450 con 0x7fde1c0cd640 2024-05-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.393+0000 7fde23c00640 1 -- 172.21.15.59:0/341877907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde1c068a90 con 0x7fde1c0cd640 2024-05-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.393+0000 7fde18c00640 1 -- 172.21.15.59:0/341877907 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fde080075c0 con 0x7fde1c0cd640 2024-05-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.393+0000 7fde18c00640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddfc06a070 0x7fddfc06c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.393+0000 7fde18c00640 1 -- 172.21.15.59:0/341877907 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5935+0+0 (secure 0 0 0) 0x7fde08084cc0 con 0x7fde1c0cd640 2024-05-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.397+0000 7fde21200640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddfc06a070 0x7fddfc06c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.397+0000 7fde21200640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddfc06a070 0x7fddfc06c530 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fde140ae000 tx=0x7fde14004a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.405+0000 7fde18c00640 1 -- 172.21.15.59:0/341877907 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fde08056710 con 0x7fde1c0cd640 2024-05-30T17:04:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.749+0000 7fde23c00640 1 -- 172.21.15.59:0/341877907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde1c0b5190 con 0x7fde1c0cd640 2024-05-30T17:04:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.749+0000 7fde18c00640 1 -- 172.21.15.59:0/341877907 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16997 (secure 0 0 0) 0x7fde080861b0 con 0x7fde1c0cd640 2024-05-30T17:04:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:13.753 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":119,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:04:10.523036+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:02:47.120546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-05-30T17:02:48.398347+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":119,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.18","mappings":[{"from":0,"to":5}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:04:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.753+0000 7fde23c00640 1 -- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddfc06a070 msgr2=0x7fddfc06c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.753+0000 7fde23c00640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddfc06a070 0x7fddfc06c530 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fde140ae000 tx=0x7fde14004a50 comp rx=0 tx=0).stop 2024-05-30T17:04:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.753+0000 7fde23c00640 1 -- 172.21.15.59:0/341877907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde1c0cd640 msgr2=0x7fde1c09a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.753+0000 7fde23c00640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde1c0cd640 0x7fde1c09a5b0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0b5160 tx=0x7fde0800c8a0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.753+0000 7fde23c00640 1 -- 172.21.15.59:0/341877907 shutdown_connections 2024-05-30T17:04:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.753+0000 7fde23c00640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fddfc06a070 0x7fddfc06c530 secure :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fde140ae000 tx=0x7fde14004a50 comp rx=0 tx=0).stop 2024-05-30T17:04:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.753+0000 7fde23c00640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde1c0cd640 0x7fde1c09a5b0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.753+0000 7fde23c00640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde1c15c720 0x7fde1c0cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.753+0000 7fde23c00640 1 --2- 172.21.15.59:0/341877907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c340 0x7fde1c0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.753+0000 7fde23c00640 1 -- 172.21.15.59:0/341877907 >> 172.21.15.59:0/341877907 conn(0x7fde1c0b22d0 msgr2=0x7fde1c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.753+0000 7fde23c00640 1 -- 172.21.15.59:0/341877907 shutdown_connections 2024-05-30T17:04:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.753+0000 7fde23c00640 1 -- 172.21.15.59:0/341877907 wait complete. 2024-05-30T17:04:13.789 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T17:04:13.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:04:13.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.957+0000 7f74c6200640 1 Processor -- start 2024-05-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74c6200640 1 -- start start 2024-05-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74c6200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74c009b890 0x7f74c006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74c6200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f74c0162340 0x7f74c01627d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74c6200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c00d0fb0 con 0x7f74c009b4b0 2024-05-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74c6200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f74c006fef0 con 0x7f74c009b890 2024-05-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74c6200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f74c00d1290 con 0x7f74c0162340 2024-05-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74b7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74c009b890 0x7f74c006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74c4e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f74c009b4b0 0x7f74c00d0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42208/0 (socket says 172.21.15.59:42208) 2024-05-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74c4e00640 1 -- 172.21.15.59:0/1521233979 learned_addr learned my addr 172.21.15.59:0/1521233979 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74c5800640 1 --2- 172.21.15.59:0/1521233979 >> v2:172.21.15.107:3300/0 conn(0x7f74c0162340 0x7f74c01627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74b7e00640 1 -- 172.21.15.59:0/1521233979 >> v2:172.21.15.107:3300/0 conn(0x7f74c0162340 msgr2=0x7f74c01627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74b7e00640 1 --2- 172.21.15.59:0/1521233979 >> v2:172.21.15.107:3300/0 conn(0x7f74c0162340 0x7f74c01627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74b7e00640 1 -- 172.21.15.59:0/1521233979 >> v1:172.21.15.59:6789/0 conn(0x7f74c009b4b0 legacy=0x7f74c00d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.961+0000 7f74b7e00640 1 -- 172.21.15.59:0/1521233979 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c00d1570 con 0x7f74c009b890 2024-05-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74b7e00640 1 --2- 172.21.15.59:0/1521233979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c009b890 0x7f74c006cac0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f74c006f7f0 tx=0x7f74a801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba680c882080455b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74bfe00640 1 -- 172.21.15.59:0/1521233979 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a80b0070 con 0x7f74c009b890 2024-05-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74bfe00640 1 -- 172.21.15.59:0/1521233979 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a80ab600 con 0x7f74c009b890 2024-05-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74bfe00640 1 -- 172.21.15.59:0/1521233979 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a80ab9d0 con 0x7f74c009b890 2024-05-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74c6200640 1 -- 172.21.15.59:0/1521233979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c009b890 msgr2=0x7f74c006cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74c6200640 1 --2- 172.21.15.59:0/1521233979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c009b890 0x7f74c006cac0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f74c006f7f0 tx=0x7f74a801c3f0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74c6200640 1 -- 172.21.15.59:0/1521233979 shutdown_connections 2024-05-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74c6200640 1 --2- 172.21.15.59:0/1521233979 >> v2:172.21.15.107:3300/0 conn(0x7f74c0162340 0x7f74c01627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74c6200640 1 --2- 172.21.15.59:0/1521233979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c009b890 0x7f74c006cac0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74c6200640 1 -- 172.21.15.59:0/1521233979 >> 172.21.15.59:0/1521233979 conn(0x7f74c00b3ec0 msgr2=0x7f74c00b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74c6200640 1 -- 172.21.15.59:0/1521233979 shutdown_connections 2024-05-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74c6200640 1 -- 172.21.15.59:0/1521233979 wait complete. 2024-05-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74c6200640 1 Processor -- start 2024-05-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.965+0000 7f74c6200640 1 -- start start 2024-05-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74c6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c009b4b0 0x7f74c0161ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74c6200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c009b890 0x7f74c015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74c6200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c0162340 0x7f74c0155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74c6200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f74c015fbf0 con 0x7f74c009b890 2024-05-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74c6200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f74c015fa70 con 0x7f74c0162340 2024-05-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74c6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f74c0070360 con 0x7f74c009b4b0 2024-05-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74b7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c009b890 0x7f74c015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74b7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c009b890 0x7f74c015a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50564/0 (socket says 172.21.15.59:50564) 2024-05-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74b7e00640 1 -- 172.21.15.59:0/3274201467 learned_addr learned my addr 172.21.15.59:0/3274201467 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74c4e00640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c009b4b0 0x7f74c0161ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74c5800640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c0162340 0x7f74c0155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74b7e00640 1 -- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c009b4b0 msgr2=0x7f74c0161ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74b7e00640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c009b4b0 0x7f74c0161ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74b7e00640 1 -- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c0162340 msgr2=0x7f74c0155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74b7e00640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c0162340 0x7f74c0155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74b7e00640 1 -- 172.21.15.59:0/3274201467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c01567b0 con 0x7f74c009b890 2024-05-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74b7e00640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c009b890 0x7f74c015a4a0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f74a801a020 tx=0x7f74a801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74bd600640 1 -- 172.21.15.59:0/3274201467 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a80b0050 con 0x7f74c009b890 2024-05-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74bd600640 1 -- 172.21.15.59:0/3274201467 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a80bc070 con 0x7f74c009b890 2024-05-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74bd600640 1 -- 172.21.15.59:0/3274201467 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a80b5830 con 0x7f74c009b890 2024-05-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74c6200640 1 -- 172.21.15.59:0/3274201467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c015abd0 con 0x7f74c009b890 2024-05-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74c6200640 1 -- 172.21.15.59:0/3274201467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c015b190 con 0x7f74c009b890 2024-05-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74c6200640 1 -- 172.21.15.59:0/3274201467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c0156980 con 0x7f74c009b890 2024-05-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.969+0000 7f74bd600640 1 -- 172.21.15.59:0/3274201467 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f74a80b59d0 con 0x7f74c009b890 2024-05-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.973+0000 7f74bd600640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f749c069fa0 0x7f749c06c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.973+0000 7f74bd600640 1 -- 172.21.15.59:0/3274201467 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5935+0+0 (secure 0 0 0) 0x7f74a81200a0 con 0x7f74c009b890 2024-05-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.973+0000 7f74c4e00640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f749c069fa0 0x7f749c06c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.973+0000 7f74c4e00640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f749c069fa0 0x7f749c06c460 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f74b0000f70 tx=0x7f74b0007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:13.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:13.977+0000 7f74bd600640 1 -- 172.21.15.59:0/3274201467 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f74a8016070 con 0x7f74c009b890 2024-05-30T17:04:14.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.205+0000 7f74c6200640 1 -- 172.21.15.59:0/3274201467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74c0068a90 con 0x7f74c009b890 2024-05-30T17:04:14.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.205+0000 7f74bd600640 1 -- 172.21.15.59:0/3274201467 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5186 (secure 0 0 0) 0x7f74a80f1a70 con 0x7f74c009b890 2024-05-30T17:04:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:14.207 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":72,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3022278523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3022278523},{"type":"v1","addr":"172.21.15.59:6835","nonce":3022278523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2843818914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2843818914},{"type":"v1","addr":"172.21.15.107:6837","nonce":2843818914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7750,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3415278570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3415278570},{"type":"v1","addr":"172.21.15.107:6836","nonce":3415278570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:02:49.435879+0000","modified":"2024-05-30T17:02:52.455412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8460":{"gid":8460,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/871678202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":871678202},{"type":"v1","addr":"172.21.15.59:6834","nonce":871678202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8460,"qdb_cluster":[8460]},"id":8}]} 2024-05-30T17:04:14.207 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 72 2024-05-30T17:04:14.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.209+0000 7f74c6200640 1 -- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f749c069fa0 msgr2=0x7f749c06c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.209+0000 7f74c6200640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f749c069fa0 0x7f749c06c460 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f74b0000f70 tx=0x7f74b0007e90 comp rx=0 tx=0).stop 2024-05-30T17:04:14.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.209+0000 7f74c6200640 1 -- 172.21.15.59:0/3274201467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c009b890 msgr2=0x7f74c015a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.209+0000 7f74c6200640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c009b890 0x7f74c015a4a0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f74a801a020 tx=0x7f74a801ac30 comp rx=0 tx=0).stop 2024-05-30T17:04:14.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.213+0000 7f74c6200640 1 -- 172.21.15.59:0/3274201467 shutdown_connections 2024-05-30T17:04:14.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.213+0000 7f74c6200640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f749c069fa0 0x7f749c06c460 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.213+0000 7f74c6200640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c0162340 0x7f74c0155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.213+0000 7f74c6200640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c009b890 0x7f74c015a4a0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.213+0000 7f74c6200640 1 --2- 172.21.15.59:0/3274201467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c009b4b0 0x7f74c0161ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.213+0000 7f74c6200640 1 -- 172.21.15.59:0/3274201467 >> 172.21.15.59:0/3274201467 conn(0x7f74c00b3ec0 msgr2=0x7f74c00cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:14.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.213+0000 7f74c6200640 1 -- 172.21.15.59:0/3274201467 shutdown_connections 2024-05-30T17:04:14.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.213+0000 7f74c6200640 1 -- 172.21.15.59:0/3274201467 wait complete. 2024-05-30T17:04:14.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:04:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b5a000640 1 Processor -- start 2024-05-30T17:04:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b5a000640 1 -- start start 2024-05-30T17:04:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b5a000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b540d14c0 0x7f8b5406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b5a000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b540d05b0 0x7f8b5409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b5a000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b5406ea20 con 0x7f8b5409af80 2024-05-30T17:04:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b5a000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f8b54070950 con 0x7f8b540d14c0 2024-05-30T17:04:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b5a000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8b54070c30 con 0x7f8b540d05b0 2024-05-30T17:04:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b53400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b540d14c0 0x7f8b5406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b53e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8b5409af80 0x7f8b54162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42224/0 (socket says 172.21.15.59:42224) 2024-05-30T17:04:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b53e00640 1 -- 172.21.15.59:0/1277762590 learned_addr learned my addr 172.21.15.59:0/1277762590 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b4aa00640 1 --2- 172.21.15.59:0/1277762590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b540d05b0 0x7f8b5409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b53400640 1 -- 172.21.15.59:0/1277762590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b540d05b0 msgr2=0x7f8b5409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b53400640 1 --2- 172.21.15.59:0/1277762590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b540d05b0 0x7f8b5409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b53400640 1 -- 172.21.15.59:0/1277762590 >> v1:172.21.15.59:6789/0 conn(0x7f8b5409af80 legacy=0x7f8b54162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b53400640 1 -- 172.21.15.59:0/1277762590 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b54070f10 con 0x7f8b540d14c0 2024-05-30T17:04:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.401+0000 7f8b52a00640 1 -- 172.21.15.59:0/1277762590 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2008773601 0 0) 0x7f8b4c0014a0 con 0x7f8b5409af80 2024-05-30T17:04:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.405+0000 7f8b53400640 1 --2- 172.21.15.59:0/1277762590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b540d14c0 0x7f8b5406e4e0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8b440097c0 tx=0x7f8b4401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90ebefd6a01a861 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.405+0000 7f8b52a00640 1 -- 172.21.15.59:0/1277762590 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b440b0070 con 0x7f8b540d14c0 2024-05-30T17:04:14.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.405+0000 7f8b52a00640 1 -- 172.21.15.59:0/1277762590 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b440ab600 con 0x7f8b540d14c0 2024-05-30T17:04:14.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.405+0000 7f8b52a00640 1 -- 172.21.15.59:0/1277762590 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b440ab9d0 con 0x7f8b540d14c0 2024-05-30T17:04:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.405+0000 7f8b5a000640 1 -- 172.21.15.59:0/1277762590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b540d14c0 msgr2=0x7f8b5406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.405+0000 7f8b5a000640 1 --2- 172.21.15.59:0/1277762590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b540d14c0 0x7f8b5406e4e0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8b440097c0 tx=0x7f8b4401c4a0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.405+0000 7f8b5a000640 1 -- 172.21.15.59:0/1277762590 shutdown_connections 2024-05-30T17:04:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.405+0000 7f8b5a000640 1 --2- 172.21.15.59:0/1277762590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b540d05b0 0x7f8b5409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.405+0000 7f8b5a000640 1 --2- 172.21.15.59:0/1277762590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b540d14c0 0x7f8b5406e4e0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.405+0000 7f8b5a000640 1 -- 172.21.15.59:0/1277762590 >> 172.21.15.59:0/1277762590 conn(0x7f8b540b3f80 msgr2=0x7f8b540b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.405+0000 7f8b5a000640 1 -- 172.21.15.59:0/1277762590 shutdown_connections 2024-05-30T17:04:14.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.405+0000 7f8b5a000640 1 -- 172.21.15.59:0/1277762590 wait complete. 2024-05-30T17:04:14.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b5a000640 1 Processor -- start 2024-05-30T17:04:14.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b5a000640 1 -- start start 2024-05-30T17:04:14.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b5a000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b5409af80 0x7f8b540c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b5a000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b540d05b0 0x7f8b540c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b5a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b540d14c0 0x7f8b54150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b5a000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b540d0b10 con 0x7f8b540d14c0 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b5a000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8b540d0990 con 0x7f8b540d05b0 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b5a000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5406e100 con 0x7f8b5409af80 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b53e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b540d14c0 0x7f8b54150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b53e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b540d14c0 0x7f8b54150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50574/0 (socket says 172.21.15.59:50574) 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b53e00640 1 -- 172.21.15.59:0/2087522058 learned_addr learned my addr 172.21.15.59:0/2087522058 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b53400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b5409af80 0x7f8b540c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b4aa00640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b540d05b0 0x7f8b540c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b53e00640 1 -- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b5409af80 msgr2=0x7f8b540c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b53e00640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b5409af80 0x7f8b540c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b53e00640 1 -- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b540d05b0 msgr2=0x7f8b540c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b53e00640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b540d05b0 0x7f8b540c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b53e00640 1 -- 172.21.15.59:0/2087522058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b540c8fd0 con 0x7f8b540d14c0 2024-05-30T17:04:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b53e00640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b540d14c0 0x7f8b54150870 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c820 tx=0x7f8b4c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b4be00640 1 -- 172.21.15.59:0/2087522058 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c018070 con 0x7f8b540d14c0 2024-05-30T17:04:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b4be00640 1 -- 172.21.15.59:0/2087522058 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b4c00a640 con 0x7f8b540d14c0 2024-05-30T17:04:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b4be00640 1 -- 172.21.15.59:0/2087522058 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c00aa30 con 0x7f8b540d14c0 2024-05-30T17:04:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b5a000640 1 -- 172.21.15.59:0/2087522058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b540b6230 con 0x7f8b540d14c0 2024-05-30T17:04:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b5a000640 1 -- 172.21.15.59:0/2087522058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b540b67f0 con 0x7f8b540d14c0 2024-05-30T17:04:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.409+0000 7f8b5a000640 1 -- 172.21.15.59:0/2087522058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b540b69f0 con 0x7f8b540d14c0 2024-05-30T17:04:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.413+0000 7f8b4be00640 1 -- 172.21.15.59:0/2087522058 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f8b4c00abd0 con 0x7f8b540d14c0 2024-05-30T17:04:14.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.413+0000 7f8b4be00640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b30069fa0 0x7f8b3006c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.413+0000 7f8b4be00640 1 -- 172.21.15.59:0/2087522058 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5935+0+0 (secure 0 0 0) 0x7f8b4c084e10 con 0x7f8b540d14c0 2024-05-30T17:04:14.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.413+0000 7f8b53400640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b30069fa0 0x7f8b3006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.413+0000 7f8b53400640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b30069fa0 0x7f8b3006c460 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8b440ad000 tx=0x7f8b440a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:14.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.417+0000 7f8b4be00640 1 -- 172.21.15.59:0/2087522058 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8b5406ea20 con 0x7f8b540d14c0 2024-05-30T17:04:14.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 -- 172.21.15.59:0/2087522058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b54068a90 con 0x7f8b540d14c0 2024-05-30T17:04:14.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b4be00640 1 -- 172.21.15.59:0/2087522058 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5186 (secure 0 0 0) 0x7f8b4c0567e0 con 0x7f8b540d14c0 2024-05-30T17:04:14.620 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:14.621 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":72,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3022278523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3022278523},{"type":"v1","addr":"172.21.15.59:6835","nonce":3022278523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2843818914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2843818914},{"type":"v1","addr":"172.21.15.107:6837","nonce":2843818914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7750,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3415278570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3415278570},{"type":"v1","addr":"172.21.15.107:6836","nonce":3415278570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:02:49.435879+0000","modified":"2024-05-30T17:02:52.455412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8460":{"gid":8460,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/871678202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":871678202},{"type":"v1","addr":"172.21.15.59:6834","nonce":871678202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8460,"qdb_cluster":[8460]},"id":8}]} 2024-05-30T17:04:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 72 2024-05-30T17:04:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 -- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b30069fa0 msgr2=0x7f8b3006c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b30069fa0 0x7f8b3006c460 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8b440ad000 tx=0x7f8b440a6000 comp rx=0 tx=0).stop 2024-05-30T17:04:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 -- 172.21.15.59:0/2087522058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b540d14c0 msgr2=0x7f8b54150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b540d14c0 0x7f8b54150870 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c820 tx=0x7f8b4c00cce0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 -- 172.21.15.59:0/2087522058 shutdown_connections 2024-05-30T17:04:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f8b30069fa0 0x7f8b3006c460 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b540d14c0 0x7f8b54150870 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b540d05b0 0x7f8b540c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 --2- 172.21.15.59:0/2087522058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b5409af80 0x7f8b540c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 -- 172.21.15.59:0/2087522058 >> 172.21.15.59:0/2087522058 conn(0x7f8b540b3f80 msgr2=0x7f8b541625f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 -- 172.21.15.59:0/2087522058 shutdown_connections 2024-05-30T17:04:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.621+0000 7f8b5a000640 1 -- 172.21.15.59:0/2087522058 wait complete. 2024-05-30T17:04:14.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:04:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.781+0000 7f9e93200640 1 Processor -- start 2024-05-30T17:04:14.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.781+0000 7f9e93200640 1 -- start start 2024-05-30T17:04:14.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e93200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9e8c159df0 0x7f9e8c0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e93200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e8c15a1d0 0x7f9e8c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e93200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0b3e50 0x7f9e8c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e93200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9e8c15d730 con 0x7f9e8c15a1d0 2024-05-30T17:04:14.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e93200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9e8c0b3370 con 0x7f9e8c159df0 2024-05-30T17:04:14.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e93200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8c0b3650 con 0x7f9e8c0b3e50 2024-05-30T17:04:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e83400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e8c15a1d0 0x7f9e8c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e83400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e8c15a1d0 0x7f9e8c0ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50584/0 (socket says 172.21.15.59:50584) 2024-05-30T17:04:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e83400640 1 -- 172.21.15.59:0/2010177840 learned_addr learned my addr 172.21.15.59:0/2010177840 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e8be00640 1 --2- 172.21.15.59:0/2010177840 >> v2:172.21.15.107:3300/0 conn(0x7f9e8c159df0 0x7f9e8c0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e91200640 1 --2- 172.21.15.59:0/2010177840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0b3e50 0x7f9e8c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e83400640 1 -- 172.21.15.59:0/2010177840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0b3e50 msgr2=0x7f9e8c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e83400640 1 --2- 172.21.15.59:0/2010177840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0b3e50 0x7f9e8c15ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e83400640 1 -- 172.21.15.59:0/2010177840 >> v2:172.21.15.107:3300/0 conn(0x7f9e8c159df0 msgr2=0x7f9e8c0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e83400640 1 --2- 172.21.15.59:0/2010177840 >> v2:172.21.15.107:3300/0 conn(0x7f9e8c159df0 0x7f9e8c0ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.785+0000 7f9e83400640 1 -- 172.21.15.59:0/2010177840 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c0b3930 con 0x7f9e8c15a1d0 2024-05-30T17:04:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e83400640 1 --2- 172.21.15.59:0/2010177840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c15a1d0 0x7f9e8c0ad6f0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0b4c20 tx=0x7f9e7401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a50d8ef9a6bf2c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e8b400640 1 -- 172.21.15.59:0/2010177840 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e740ab5f0 con 0x7f9e8c15a1d0 2024-05-30T17:04:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e8b400640 1 -- 172.21.15.59:0/2010177840 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e740b0070 con 0x7f9e8c15a1d0 2024-05-30T17:04:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e8b400640 1 -- 172.21.15.59:0/2010177840 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e740ab9b0 con 0x7f9e8c15a1d0 2024-05-30T17:04:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e93200640 1 -- 172.21.15.59:0/2010177840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c15a1d0 msgr2=0x7f9e8c0ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e93200640 1 --2- 172.21.15.59:0/2010177840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c15a1d0 0x7f9e8c0ad6f0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0b4c20 tx=0x7f9e7401c520 comp rx=0 tx=0).stop 2024-05-30T17:04:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e93200640 1 -- 172.21.15.59:0/2010177840 shutdown_connections 2024-05-30T17:04:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e93200640 1 --2- 172.21.15.59:0/2010177840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c0b3e50 0x7f9e8c15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e93200640 1 --2- 172.21.15.59:0/2010177840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c15a1d0 0x7f9e8c0ad6f0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e93200640 1 --2- 172.21.15.59:0/2010177840 >> v2:172.21.15.107:3300/0 conn(0x7f9e8c159df0 0x7f9e8c0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e93200640 1 -- 172.21.15.59:0/2010177840 >> 172.21.15.59:0/2010177840 conn(0x7f9e8c0b22d0 msgr2=0x7f9e8c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e93200640 1 -- 172.21.15.59:0/2010177840 shutdown_connections 2024-05-30T17:04:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e93200640 1 -- 172.21.15.59:0/2010177840 wait complete. 2024-05-30T17:04:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e93200640 1 Processor -- start 2024-05-30T17:04:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.789+0000 7f9e93200640 1 -- start start 2024-05-30T17:04:14.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e93200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e8c0b3e50 0x7f9e8c147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e93200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c159df0 0x7f9e8c0726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e93200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c15a1d0 0x7f9e8c0b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e93200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c15e720 con 0x7f9e8c159df0 2024-05-30T17:04:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e93200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c15e5a0 con 0x7f9e8c0b3e50 2024-05-30T17:04:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e93200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8c15e8a0 con 0x7f9e8c15a1d0 2024-05-30T17:04:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e83400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c159df0 0x7f9e8c0726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e8be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e8c0b3e50 0x7f9e8c147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e83400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c159df0 0x7f9e8c0726d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50600/0 (socket says 172.21.15.59:50600) 2024-05-30T17:04:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e83400640 1 -- 172.21.15.59:0/2567746170 learned_addr learned my addr 172.21.15.59:0/2567746170 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e91200640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c15a1d0 0x7f9e8c0b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e83400640 1 -- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c15a1d0 msgr2=0x7f9e8c0b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e83400640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c15a1d0 0x7f9e8c0b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e83400640 1 -- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e8c0b3e50 msgr2=0x7f9e8c147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e83400640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e8c0b3e50 0x7f9e8c147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e83400640 1 -- 172.21.15.59:0/2567746170 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c1522c0 con 0x7f9e8c159df0 2024-05-30T17:04:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e83400640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c159df0 0x7f9e8c0726d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f9e740ad040 tx=0x7f9e7401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e88c00640 1 -- 172.21.15.59:0/2567746170 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e740b4800 con 0x7f9e8c159df0 2024-05-30T17:04:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e88c00640 1 -- 172.21.15.59:0/2567746170 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e740b49a0 con 0x7f9e8c159df0 2024-05-30T17:04:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e93200640 1 -- 172.21.15.59:0/2567746170 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8c1525a0 con 0x7f9e8c159df0 2024-05-30T17:04:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e88c00640 1 -- 172.21.15.59:0/2567746170 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e740b4d70 con 0x7f9e8c159df0 2024-05-30T17:04:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e93200640 1 -- 172.21.15.59:0/2567746170 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8c0721b0 con 0x7f9e8c159df0 2024-05-30T17:04:14.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e93200640 1 -- 172.21.15.59:0/2567746170 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8c068a90 con 0x7f9e8c159df0 2024-05-30T17:04:14.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.793+0000 7f9e88c00640 1 -- 172.21.15.59:0/2567746170 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f9e740c7390 con 0x7f9e8c159df0 2024-05-30T17:04:14.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.797+0000 7f9e88c00640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9e68069fd0 0x7f9e6806c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:14.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.797+0000 7f9e88c00640 1 -- 172.21.15.59:0/2567746170 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5935+0+0 (secure 0 0 0) 0x7f9e7411ffa0 con 0x7f9e8c159df0 2024-05-30T17:04:14.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.797+0000 7f9e8be00640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9e68069fd0 0x7f9e6806c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:14.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.797+0000 7f9e8be00640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9e68069fd0 0x7f9e6806c490 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c011340 tx=0x7f9e7c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:14.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.801+0000 7f9e88c00640 1 -- 172.21.15.59:0/2567746170 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9e740c4060 con 0x7f9e8c159df0 2024-05-30T17:04:14.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 -- 172.21.15.59:0/2567746170 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e8c1671d0 con 0x7f9e8c159df0 2024-05-30T17:04:14.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e88c00640 1 -- 172.21.15.59:0/2567746170 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16997 (secure 0 0 0) 0x7f9e74016110 con 0x7f9e8c159df0 2024-05-30T17:04:14.965 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:14.965 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":119,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:04:10.523036+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:02:47.120546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-05-30T17:02:48.398347+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":119,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.18","mappings":[{"from":0,"to":5}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:04:14.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 -- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9e68069fd0 msgr2=0x7f9e6806c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9e68069fd0 0x7f9e6806c490 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c011340 tx=0x7f9e7c00b040 comp rx=0 tx=0).stop 2024-05-30T17:04:14.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 -- 172.21.15.59:0/2567746170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c159df0 msgr2=0x7f9e8c0726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:14.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c159df0 0x7f9e8c0726d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f9e740ad040 tx=0x7f9e7401ad60 comp rx=0 tx=0).stop 2024-05-30T17:04:14.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 -- 172.21.15.59:0/2567746170 shutdown_connections 2024-05-30T17:04:14.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9e68069fd0 0x7f9e6806c490 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e8c15a1d0 0x7f9e8c0b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8c159df0 0x7f9e8c0726d0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 --2- 172.21.15.59:0/2567746170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e8c0b3e50 0x7f9e8c147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:14.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 -- 172.21.15.59:0/2567746170 >> 172.21.15.59:0/2567746170 conn(0x7f9e8c0b22d0 msgr2=0x7f9e8c06edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:14.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 -- 172.21.15.59:0/2567746170 shutdown_connections 2024-05-30T17:04:14.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:14.965+0000 7f9e93200640 1 -- 172.21.15.59:0/2567746170 wait complete. 2024-05-30T17:04:14.988 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T17:04:15.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa3c600640 1 Processor -- start 2024-05-30T17:04:15.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa3c600640 1 -- start start 2024-05-30T17:04:15.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa3c600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa340af720 0x7ffa3415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:15.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa3c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa3406e900 0x7ffa3415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:15.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa3c600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa3415f060 con 0x7ffa340d0560 2024-05-30T17:04:15.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa3c600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ffa340afb00 con 0x7ffa340af720 2024-05-30T17:04:15.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa3c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3415c270 con 0x7ffa3406e900 2024-05-30T17:04:15.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa39200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa3406e900 0x7ffa3415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:15.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa39c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa340af720 0x7ffa3415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:15.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa39200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa3406e900 0x7ffa3415f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:43696/0 (socket says 172.21.15.59:43696) 2024-05-30T17:04:15.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa39200640 1 -- 172.21.15.59:0/1157542083 learned_addr learned my addr 172.21.15.59:0/1157542083 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:15.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa39200640 1 -- 172.21.15.59:0/1157542083 >> v2:172.21.15.107:3300/0 conn(0x7ffa340af720 msgr2=0x7ffa3415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:15.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa39200640 1 --2- 172.21.15.59:0/1157542083 >> v2:172.21.15.107:3300/0 conn(0x7ffa340af720 0x7ffa3415b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa39200640 1 -- 172.21.15.59:0/1157542083 >> v1:172.21.15.107:6789/0 conn(0x7ffa340d0560 legacy=0x7ffa34072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:15.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.133+0000 7ffa39200640 1 -- 172.21.15.59:0/1157542083 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3415c550 con 0x7ffa3406e900 2024-05-30T17:04:15.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.137+0000 7ffa39200640 1 --2- 172.21.15.59:0/1157542083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa3406e900 0x7ffa3415f7f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009870 tx=0x7ffa2001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c49f614a64de5790 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:15.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.137+0000 7ffa33e00640 1 -- 172.21.15.59:0/1157542083 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa200a9610 con 0x7ffa3406e900 2024-05-30T17:04:15.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.137+0000 7ffa33e00640 1 -- 172.21.15.59:0/1157542083 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa200a97b0 con 0x7ffa3406e900 2024-05-30T17:04:15.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.137+0000 7ffa33e00640 1 -- 172.21.15.59:0/1157542083 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa200a9b80 con 0x7ffa3406e900 2024-05-30T17:04:15.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.137+0000 7ffa3c600640 1 -- 172.21.15.59:0/1157542083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa3406e900 msgr2=0x7ffa3415f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:15.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.137+0000 7ffa3c600640 1 --2- 172.21.15.59:0/1157542083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa3406e900 0x7ffa3415f7f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009870 tx=0x7ffa2001c530 comp rx=0 tx=0).stop 2024-05-30T17:04:15.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.137+0000 7ffa3c600640 1 -- 172.21.15.59:0/1157542083 shutdown_connections 2024-05-30T17:04:15.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.137+0000 7ffa3c600640 1 --2- 172.21.15.59:0/1157542083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa3406e900 0x7ffa3415f7f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.137+0000 7ffa3c600640 1 --2- 172.21.15.59:0/1157542083 >> v2:172.21.15.107:3300/0 conn(0x7ffa340af720 0x7ffa3415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.137+0000 7ffa3c600640 1 -- 172.21.15.59:0/1157542083 >> 172.21.15.59:0/1157542083 conn(0x7ffa340b22d0 msgr2=0x7ffa340b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:15.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.137+0000 7ffa3c600640 1 -- 172.21.15.59:0/1157542083 shutdown_connections 2024-05-30T17:04:15.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.137+0000 7ffa3c600640 1 -- 172.21.15.59:0/1157542083 wait complete. 2024-05-30T17:04:15.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa3c600640 1 Processor -- start 2024-05-30T17:04:15.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa3c600640 1 -- start start 2024-05-30T17:04:15.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa3c600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa3406e900 0x7ffa3415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:15.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa3c600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa340af720 0x7ffa3415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:15.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa3c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa340d0560 0x7ffa341fb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:15.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa3c600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3415fd30 con 0x7ffa3406e900 2024-05-30T17:04:15.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa3c600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffa340d0da0 con 0x7ffa340af720 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa3c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3415feb0 con 0x7ffa340d0560 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa39c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa3406e900 0x7ffa3415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa39c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa3406e900 0x7ffa3415cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50608/0 (socket says 172.21.15.59:50608) 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa39c00640 1 -- 172.21.15.59:0/98554397 learned_addr learned my addr 172.21.15.59:0/98554397 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa39200640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa340af720 0x7ffa3415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa3a600640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa340d0560 0x7ffa341fb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa39c00640 1 -- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa340d0560 msgr2=0x7ffa341fb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa39c00640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa340d0560 0x7ffa341fb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa39c00640 1 -- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa340af720 msgr2=0x7ffa3415d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa39c00640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa340af720 0x7ffa3415d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa39c00640 1 -- 172.21.15.59:0/98554397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa341f78d0 con 0x7ffa3406e900 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa39c00640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa3406e900 0x7ffa3415cb90 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800e930 tx=0x7ffa2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa31600640 1 -- 172.21.15.59:0/98554397 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28017070 con 0x7ffa3406e900 2024-05-30T17:04:15.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa31600640 1 -- 172.21.15.59:0/98554397 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa2800c9a0 con 0x7ffa3406e900 2024-05-30T17:04:15.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa31600640 1 -- 172.21.15.59:0/98554397 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800cd50 con 0x7ffa3406e900 2024-05-30T17:04:15.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa3c600640 1 -- 172.21.15.59:0/98554397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa34152a70 con 0x7ffa3406e900 2024-05-30T17:04:15.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa3c600640 1 -- 172.21.15.59:0/98554397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa34153030 con 0x7ffa3406e900 2024-05-30T17:04:15.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.141+0000 7ffa3c600640 1 -- 172.21.15.59:0/98554397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa34153270 con 0x7ffa3406e900 2024-05-30T17:04:15.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.145+0000 7ffa31600640 1 -- 172.21.15.59:0/98554397 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7ffa2801a070 con 0x7ffa3406e900 2024-05-30T17:04:15.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.145+0000 7ffa31600640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa14069fa0 0x7ffa1406c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:15.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.145+0000 7ffa31600640 1 -- 172.21.15.59:0/98554397 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5907+0+0 (secure 0 0 0) 0x7ffa28085880 con 0x7ffa3406e900 2024-05-30T17:04:15.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.145+0000 7ffa39200640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa14069fa0 0x7ffa1406c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:15.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.145+0000 7ffa39200640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa14069fa0 0x7ffa1406c460 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ffa200ae000 tx=0x7ffa200b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:15.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.149+0000 7ffa31600640 1 -- 172.21.15.59:0/98554397 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa28057310 con 0x7ffa3406e900 2024-05-30T17:04:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.357+0000 7ffa3c600640 1 -- 172.21.15.59:0/98554397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ffa34068a90 con 0x7ffa3406e900 2024-05-30T17:04:15.359 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-05-30T17:04:15.357+0000 7f2f74c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.361+0000 7ffa31600640 1 -- 172.21.15.59:0/98554397 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) ==== 161+0+0 (secure 0 0 0) 0x7ffa2805b610 con 0x7ffa3406e900 2024-05-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T17:04:15.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.361+0000 7ffa3c600640 1 -- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa14069fa0 msgr2=0x7ffa1406c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.361+0000 7ffa3c600640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa14069fa0 0x7ffa1406c460 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ffa200ae000 tx=0x7ffa200b3040 comp rx=0 tx=0).stop 2024-05-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.361+0000 7ffa3c600640 1 -- 172.21.15.59:0/98554397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa3406e900 msgr2=0x7ffa3415cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.361+0000 7ffa3c600640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa3406e900 0x7ffa3415cb90 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800e930 tx=0x7ffa2800edf0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.361+0000 7ffa3c600640 1 -- 172.21.15.59:0/98554397 shutdown_connections 2024-05-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.361+0000 7ffa3c600640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ffa14069fa0 0x7ffa1406c460 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.361+0000 7ffa3c600640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa340d0560 0x7ffa341fb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.361+0000 7ffa3c600640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa340af720 0x7ffa3415d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.361+0000 7ffa3c600640 1 --2- 172.21.15.59:0/98554397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa3406e900 0x7ffa3415cb90 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.361+0000 7ffa3c600640 1 -- 172.21.15.59:0/98554397 >> 172.21.15.59:0/98554397 conn(0x7ffa340b22d0 msgr2=0x7ffa3415aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.365+0000 7ffa3c600640 1 -- 172.21.15.59:0/98554397 shutdown_connections 2024-05-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.365+0000 7ffa3c600640 1 -- 172.21.15.59:0/98554397 wait complete. 2024-05-30T17:04:15.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T17:04:15.433 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-05-30T17:04:15.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f4197600640 1 Processor -- start 2024-05-30T17:04:15.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f4197600640 1 -- start start 2024-05-30T17:04:15.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f4197600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41900d14c0 0x7f419006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:15.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f4197600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41900d05b0 0x7f419009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:15.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f4197600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419006ea20 con 0x7f419009af80 2024-05-30T17:04:15.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f4197600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4190070950 con 0x7f41900d05b0 2024-05-30T17:04:15.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f4197600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4190070c30 con 0x7f41900d14c0 2024-05-30T17:04:15.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f418fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41900d05b0 0x7f419009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:15.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f418fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41900d05b0 0x7f419009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50630/0 (socket says 172.21.15.59:50630) 2024-05-30T17:04:15.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f4195600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f419009af80 0x7f4190162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42248/0 (socket says 172.21.15.59:42248) 2024-05-30T17:04:15.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f418fe00640 1 -- 172.21.15.59:0/2777930501 learned_addr learned my addr 172.21.15.59:0/2777930501 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:15.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f4194c00640 1 --2- 172.21.15.59:0/2777930501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41900d14c0 0x7f419006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:15.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f418fe00640 1 -- 172.21.15.59:0/2777930501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41900d14c0 msgr2=0x7f419006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:15.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f418fe00640 1 --2- 172.21.15.59:0/2777930501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41900d14c0 0x7f419006e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f418fe00640 1 -- 172.21.15.59:0/2777930501 >> v1:172.21.15.59:6789/0 conn(0x7f419009af80 legacy=0x7f4190162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:15.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f418fe00640 1 -- 172.21.15.59:0/2777930501 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4190070f10 con 0x7f41900d05b0 2024-05-30T17:04:15.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f4194c00640 1 --2- 172.21.15.59:0/2777930501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41900d14c0 0x7f419006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:15.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.537+0000 7f418f400640 1 -- 172.21.15.59:0/2777930501 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3748627193 0 0) 0x7f41880014a0 con 0x7f419009af80 2024-05-30T17:04:15.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.541+0000 7f418fe00640 1 --2- 172.21.15.59:0/2777930501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41900d05b0 0x7f419009aa40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f417c009870 tx=0x7f417c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fda03ac44e6b7b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:15.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.541+0000 7f418f400640 1 -- 172.21.15.59:0/2777930501 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0b0070 con 0x7f41900d05b0 2024-05-30T17:04:15.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.541+0000 7f418f400640 1 -- 172.21.15.59:0/2777930501 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c0ab600 con 0x7f41900d05b0 2024-05-30T17:04:15.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.541+0000 7f418f400640 1 -- 172.21.15.59:0/2777930501 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0ab9d0 con 0x7f41900d05b0 2024-05-30T17:04:15.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.541+0000 7f4197600640 1 -- 172.21.15.59:0/2777930501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41900d05b0 msgr2=0x7f419009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:15.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.541+0000 7f4197600640 1 --2- 172.21.15.59:0/2777930501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41900d05b0 0x7f419009aa40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f417c009870 tx=0x7f417c01c560 comp rx=0 tx=0).stop 2024-05-30T17:04:15.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.541+0000 7f4197600640 1 -- 172.21.15.59:0/2777930501 shutdown_connections 2024-05-30T17:04:15.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.541+0000 7f4197600640 1 --2- 172.21.15.59:0/2777930501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41900d05b0 0x7f419009aa40 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.541+0000 7f4197600640 1 --2- 172.21.15.59:0/2777930501 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41900d14c0 0x7f419006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.541+0000 7f4197600640 1 -- 172.21.15.59:0/2777930501 >> 172.21.15.59:0/2777930501 conn(0x7f41900b3f80 msgr2=0x7f41900b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:15.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.541+0000 7f4197600640 1 -- 172.21.15.59:0/2777930501 shutdown_connections 2024-05-30T17:04:15.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.541+0000 7f4197600640 1 -- 172.21.15.59:0/2777930501 wait complete. 2024-05-30T17:04:15.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4197600640 1 Processor -- start 2024-05-30T17:04:15.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4197600640 1 -- start start 2024-05-30T17:04:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4197600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f419009af80 0x7f4190149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4197600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41900d05b0 0x7f419014a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4197600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41900d14c0 0x7f419015c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4197600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f419006e100 con 0x7f41900d05b0 2024-05-30T17:04:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4197600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f41900d0a30 con 0x7f41900d14c0 2024-05-30T17:04:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4197600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f419006e280 con 0x7f419009af80 2024-05-30T17:04:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f418fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41900d05b0 0x7f419014a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f418fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41900d05b0 0x7f419014a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50640/0 (socket says 172.21.15.59:50640) 2024-05-30T17:04:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f418fe00640 1 -- 172.21.15.59:0/1952997308 learned_addr learned my addr 172.21.15.59:0/1952997308 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4194c00640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f419009af80 0x7f4190149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4195600640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41900d14c0 0x7f419015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f418fe00640 1 -- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f419009af80 msgr2=0x7f4190149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f418fe00640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f419009af80 0x7f4190149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f418fe00640 1 -- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41900d14c0 msgr2=0x7f419015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f418fe00640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41900d14c0 0x7f419015c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f418fe00640 1 -- 172.21.15.59:0/1952997308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4190161530 con 0x7f41900d05b0 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4195600640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41900d14c0 0x7f419015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f418fe00640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41900d05b0 0x7f419014a120 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f417c0ae040 tx=0x7f417c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f418cc00640 1 -- 172.21.15.59:0/1952997308 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0bc070 con 0x7f41900d05b0 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f418cc00640 1 -- 172.21.15.59:0/1952997308 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c004030 con 0x7f41900d05b0 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f418cc00640 1 -- 172.21.15.59:0/1952997308 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0b0040 con 0x7f41900d05b0 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4197600640 1 -- 172.21.15.59:0/1952997308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4190161810 con 0x7f41900d05b0 2024-05-30T17:04:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.545+0000 7f4197600640 1 -- 172.21.15.59:0/1952997308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4190161dd0 con 0x7f41900d05b0 2024-05-30T17:04:15.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.549+0000 7f4197600640 1 -- 172.21.15.59:0/1952997308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4190068a90 con 0x7f41900d05b0 2024-05-30T17:04:15.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.549+0000 7f418cc00640 1 -- 172.21.15.59:0/1952997308 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f417c003620 con 0x7f41900d05b0 2024-05-30T17:04:15.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.549+0000 7f418cc00640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4170069fa0 0x7f417006c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:15.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.549+0000 7f418cc00640 1 -- 172.21.15.59:0/1952997308 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5965+0+0 (secure 0 0 0) 0x7f417c11f000 con 0x7f41900d05b0 2024-05-30T17:04:15.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.549+0000 7f4194c00640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4170069fa0 0x7f417006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:15.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.549+0000 7f4194c00640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4170069fa0 0x7f417006c460 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f41900693a0 tx=0x7f4184008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.553+0000 7f418cc00640 1 -- 172.21.15.59:0/1952997308 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f417c016150 con 0x7f41900d05b0 2024-05-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:15.761+0000 7f4197600640 1 -- 172.21.15.59:0/1952997308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f41900cc7c0 con 0x7f41900d05b0 2024-05-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f418cc00640 1 -- 172.21.15.59:0/1952997308 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) ==== 104+0+0 (secure 0 0 0) 0x7f417c0f09d0 con 0x7f41900d05b0 2024-05-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f4197600640 1 -- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4170069fa0 msgr2=0x7f417006c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f4197600640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4170069fa0 0x7f417006c460 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f41900693a0 tx=0x7f4184008040 comp rx=0 tx=0).stop 2024-05-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f4197600640 1 -- 172.21.15.59:0/1952997308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41900d05b0 msgr2=0x7f419014a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f4197600640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41900d05b0 0x7f419014a120 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f417c0ae040 tx=0x7f417c01ada0 comp rx=0 tx=0).stop 2024-05-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f4197600640 1 -- 172.21.15.59:0/1952997308 shutdown_connections 2024-05-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f4197600640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4170069fa0 0x7f417006c460 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f4197600640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41900d14c0 0x7f419015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f4197600640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41900d05b0 0x7f419014a120 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f4197600640 1 --2- 172.21.15.59:0/1952997308 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f419009af80 0x7f4190149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f4197600640 1 -- 172.21.15.59:0/1952997308 >> 172.21.15.59:0/1952997308 conn(0x7f41900b3f80 msgr2=0x7f419006ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f4197600640 1 -- 172.21.15.59:0/1952997308 shutdown_connections 2024-05-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.369+0000 7f4197600640 1 -- 172.21.15.59:0/1952997308 wait complete. 2024-05-30T17:04:16.395 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2efaa00640 1 Processor -- start 2024-05-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2efaa00640 1 -- start start 2024-05-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2efaa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2ef415b790 0x7f2ef40adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2efaa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef40723c0 0x7f2ef40af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2efaa00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef4072870 con 0x7f2ef415b3b0 2024-05-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2efaa00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef40afaf0 con 0x7f2ef415b790 2024-05-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2efaa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef40ae510 con 0x7f2ef40723c0 2024-05-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2ef3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2ef415b3b0 0x7f2ef4071cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42252/0 (socket says 172.21.15.59:42252) 2024-05-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2ef3e00640 1 -- 172.21.15.59:0/1597877200 learned_addr learned my addr 172.21.15.59:0/1597877200 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3910944666 0 0) 0x7f2ef4072870 con 0x7f2ef415b3b0 2024-05-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ed8003530 con 0x7f2ef415b3b0 2024-05-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2eeb400640 1 --2- 172.21.15.59:0/1597877200 >> v2:172.21.15.107:3300/0 conn(0x7f2ef415b790 0x7f2ef40adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.589+0000 7f2ef8a00640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef40723c0 0x7f2ef40af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2607174955 0 0) 0x7f2ed8003530 con 0x7f2ef415b3b0 2024-05-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef40723c0 msgr2=0x7f2ef40af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef40723c0 0x7f2ef40af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 >> v2:172.21.15.107:3300/0 conn(0x7f2ef415b790 msgr2=0x7f2ef40adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 --2- 172.21.15.59:0/1597877200 >> v2:172.21.15.107:3300/0 conn(0x7f2ef415b790 0x7f2ef40adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef40ae7f0 con 0x7f2ef415b3b0 2024-05-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f2ee4001680 con 0x7f2ef415b3b0 2024-05-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 >> v1:172.21.15.59:6789/0 conn(0x7f2ef415b3b0 legacy=0x7f2ef4071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ed80039c0 0x7f2ed8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef40723c0 0x7f2ed8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8004d50 0x7f2ed80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef40afaf0 con 0x7f2ed8004d50 2024-05-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef40ae510 con 0x7f2ed80039c0 2024-05-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed800dc90 con 0x7f2ef40723c0 2024-05-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2eeb400640 1 --2- 172.21.15.59:0/1597877200 >> v2:172.21.15.107:3300/0 conn(0x7f2ef415b790 0x7f2ef40adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef8a00640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8004d50 0x7f2ed80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef3e00640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ed80039c0 0x7f2ed8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2eeb400640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef40723c0 0x7f2ed8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef8a00640 1 -- 172.21.15.59:0/1597877200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef40723c0 msgr2=0x7f2ed8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef8a00640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef40723c0 0x7f2ed8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef8a00640 1 -- 172.21.15.59:0/1597877200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ed80039c0 msgr2=0x7f2ed8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef8a00640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ed80039c0 0x7f2ed8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef8a00640 1 -- 172.21.15.59:0/1597877200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed8003530 con 0x7f2ed8004d50 2024-05-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2eeb400640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef40723c0 0x7f2ed8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.593+0000 7f2ef8a00640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8004d50 0x7f2ed80051d0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f2eec007390 tx=0x7f2eec01ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9782565c7de0b331 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0b2070 con 0x7f2ed8004d50 2024-05-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eec0a5d40 con 0x7f2ed8004d50 2024-05-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2ef3400640 1 -- 172.21.15.59:0/1597877200 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec009be0 con 0x7f2ed8004d50 2024-05-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 -- 172.21.15.59:0/1597877200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8004d50 msgr2=0x7f2ed80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 --2- 172.21.15.59:0/1597877200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8004d50 0x7f2ed80051d0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f2eec007390 tx=0x7f2eec01ce40 comp rx=0 tx=0).stop 2024-05-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2ef8a00640 1 -- 172.21.15.59:0/1597877200 reap_dead start 2024-05-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 -- 172.21.15.59:0/1597877200 shutdown_connections 2024-05-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 -- 172.21.15.59:0/1597877200 >> 172.21.15.59:0/1597877200 conn(0x7f2ef40b1e60 msgr2=0x7f2ef40b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 -- 172.21.15.59:0/1597877200 shutdown_connections 2024-05-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 -- 172.21.15.59:0/1597877200 wait complete. 2024-05-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 Processor -- start 2024-05-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 -- start start 2024-05-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8004d50 0x7f2ef413c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef413f020 0x7f2ef409dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ef413dc80 0x7f2ef4159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef40af090 con 0x7f2ed8004d50 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef40aedb0 con 0x7f2ef413dc80 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2efaa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef40cc650 con 0x7f2ef413f020 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2ef3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8004d50 0x7f2ef413c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2ef3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8004d50 0x7f2ef413c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50662/0 (socket says 172.21.15.59:50662) 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.597+0000 7f2ef3e00640 1 -- 172.21.15.59:0/525833477 learned_addr learned my addr 172.21.15.59:0/525833477 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2eeb400640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef413f020 0x7f2ef409dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef8a00640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ef413dc80 0x7f2ef4159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef3e00640 1 -- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef413f020 msgr2=0x7f2ef409dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef3e00640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef413f020 0x7f2ef409dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef3e00640 1 -- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ef413dc80 msgr2=0x7f2ef4159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef3e00640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ef413dc80 0x7f2ef4159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef3e00640 1 -- 172.21.15.59:0/525833477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef413f460 con 0x7f2ed8004d50 2024-05-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef3e00640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8004d50 0x7f2ef413c4d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4007290 tx=0x7f2ee4007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef0c00640 1 -- 172.21.15.59:0/525833477 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400f860 con 0x7f2ed8004d50 2024-05-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef0c00640 1 -- 172.21.15.59:0/525833477 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee4018070 con 0x7f2ed8004d50 2024-05-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2efaa00640 1 -- 172.21.15.59:0/525833477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef413cbe0 con 0x7f2ed8004d50 2024-05-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef0c00640 1 -- 172.21.15.59:0/525833477 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400fc40 con 0x7f2ed8004d50 2024-05-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2efaa00640 1 -- 172.21.15.59:0/525833477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef413d1a0 con 0x7f2ed8004d50 2024-05-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2efaa00640 1 -- 172.21.15.59:0/525833477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef4068a90 con 0x7f2ed8004d50 2024-05-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef0c00640 1 -- 172.21.15.59:0/525833477 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f2ee401d460 con 0x7f2ed8004d50 2024-05-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef0c00640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2ed0069fa0 0x7f2ed006c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.601+0000 7f2ef0c00640 1 -- 172.21.15.59:0/525833477 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5965+0+0 (secure 0 0 0) 0x7f2ee4085960 con 0x7f2ed8004d50 2024-05-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.605+0000 7f2eeb400640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2ed0069fa0 0x7f2ed006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.605+0000 7f2eeb400640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2ed0069fa0 0x7f2ed006c460 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2ef415ac50 tx=0x7f2edc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.605+0000 7f2ef0c00640 1 -- 172.21.15.59:0/525833477 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2ee4057980 con 0x7f2ed8004d50 2024-05-30T17:04:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:16.769+0000 7f2efaa00640 1 -- 172.21.15.59:0/525833477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2ef40cc140 con 0x7f2ed8004d50 2024-05-30T17:04:17.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.565+0000 7f2ef0c00640 1 -- 172.21.15.59:0/525833477 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v122) ==== 181+0+0 (secure 0 0 0) 0x7f2ee4057280 con 0x7f2ed8004d50 2024-05-30T17:04:17.565 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-05-30T17:04:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.569+0000 7f2efaa00640 1 -- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2ed0069fa0 msgr2=0x7f2ed006c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.569+0000 7f2efaa00640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2ed0069fa0 0x7f2ed006c460 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2ef415ac50 tx=0x7f2edc008040 comp rx=0 tx=0).stop 2024-05-30T17:04:17.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.569+0000 7f2efaa00640 1 -- 172.21.15.59:0/525833477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8004d50 msgr2=0x7f2ef413c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:17.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.569+0000 7f2efaa00640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8004d50 0x7f2ef413c4d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4007290 tx=0x7f2ee4007750 comp rx=0 tx=0).stop 2024-05-30T17:04:17.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.569+0000 7f2efaa00640 1 -- 172.21.15.59:0/525833477 shutdown_connections 2024-05-30T17:04:17.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.569+0000 7f2efaa00640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2ed0069fa0 0x7f2ed006c460 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:17.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.569+0000 7f2efaa00640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ef413dc80 0x7f2ef4159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:17.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.569+0000 7f2efaa00640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ef413f020 0x7f2ef409dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:17.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.569+0000 7f2efaa00640 1 --2- 172.21.15.59:0/525833477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8004d50 0x7f2ef413c4d0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:17.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.569+0000 7f2efaa00640 1 -- 172.21.15.59:0/525833477 >> 172.21.15.59:0/525833477 conn(0x7f2ef40b1e60 msgr2=0x7f2ef40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:17.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.569+0000 7f2efaa00640 1 -- 172.21.15.59:0/525833477 shutdown_connections 2024-05-30T17:04:17.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.569+0000 7f2efaa00640 1 -- 172.21.15.59:0/525833477 wait complete. 2024-05-30T17:04:17.598 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T17:04:17.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe311e00640 1 Processor -- start 2024-05-30T17:04:17.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe311e00640 1 -- start start 2024-05-30T17:04:17.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe311e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe30c148360 0x7fe30c072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:17.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe311e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c0b43e0 0x7fe30c06f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:17.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe311e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe30c073020 con 0x7fe30c06b9b0 2024-05-30T17:04:17.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe311e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c06e650 con 0x7fe30c148360 2024-05-30T17:04:17.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe311e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c06f4b0 con 0x7fe30c0b43e0 2024-05-30T17:04:17.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe30aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe30c148360 0x7fe30c072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:17.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe30b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe30c06b9b0 0x7fe30c0ad9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42264/0 (socket says 172.21.15.59:42264) 2024-05-30T17:04:17.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe30b400640 1 -- 172.21.15.59:0/516852434 learned_addr learned my addr 172.21.15.59:0/516852434 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:17.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe302000640 1 --2- 172.21.15.59:0/516852434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c0b43e0 0x7fe30c06f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:17.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe30aa00640 1 -- 172.21.15.59:0/516852434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c0b43e0 msgr2=0x7fe30c06f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:17.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe30aa00640 1 --2- 172.21.15.59:0/516852434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c0b43e0 0x7fe30c06f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:17.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe30aa00640 1 -- 172.21.15.59:0/516852434 >> v1:172.21.15.59:6789/0 conn(0x7fe30c06b9b0 legacy=0x7fe30c0ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:17.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe30aa00640 1 -- 172.21.15.59:0/516852434 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c06e8a0 con 0x7fe30c148360 2024-05-30T17:04:17.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.749+0000 7fe30a000640 1 -- 172.21.15.59:0/516852434 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148597877 0 0) 0x7fe30c073020 con 0x7fe30c06b9b0 2024-05-30T17:04:17.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe30aa00640 1 --2- 172.21.15.59:0/516852434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c148360 0x7fe30c072ae0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009dc0 tx=0x7fe2fc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902503b79b9c58f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:17.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe30a000640 1 -- 172.21.15.59:0/516852434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0b2070 con 0x7fe30c148360 2024-05-30T17:04:17.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe30a000640 1 -- 172.21.15.59:0/516852434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0a5900 con 0x7fe30c148360 2024-05-30T17:04:17.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe30a000640 1 -- 172.21.15.59:0/516852434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0a5cd0 con 0x7fe30c148360 2024-05-30T17:04:17.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe311e00640 1 -- 172.21.15.59:0/516852434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c148360 msgr2=0x7fe30c072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:17.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe311e00640 1 --2- 172.21.15.59:0/516852434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c148360 0x7fe30c072ae0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009dc0 tx=0x7fe2fc01c950 comp rx=0 tx=0).stop 2024-05-30T17:04:17.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe311e00640 1 -- 172.21.15.59:0/516852434 shutdown_connections 2024-05-30T17:04:17.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe311e00640 1 --2- 172.21.15.59:0/516852434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c0b43e0 0x7fe30c06f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:17.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe311e00640 1 --2- 172.21.15.59:0/516852434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c148360 0x7fe30c072ae0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:17.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe311e00640 1 -- 172.21.15.59:0/516852434 >> 172.21.15.59:0/516852434 conn(0x7fe30c0b2560 msgr2=0x7fe30c0b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:17.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe311e00640 1 -- 172.21.15.59:0/516852434 shutdown_connections 2024-05-30T17:04:17.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe311e00640 1 -- 172.21.15.59:0/516852434 wait complete. 2024-05-30T17:04:17.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe311e00640 1 Processor -- start 2024-05-30T17:04:17.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.753+0000 7fe311e00640 1 -- start start 2024-05-30T17:04:17.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe311e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c06b9b0 0x7fe30c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:17.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe311e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe30c0b43e0 0x7fe30c144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe311e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c148360 0x7fe30c145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe311e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c06c210 con 0x7fe30c06b9b0 2024-05-30T17:04:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe311e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c0ae510 con 0x7fe30c0b43e0 2024-05-30T17:04:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe311e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c06fe80 con 0x7fe30c148360 2024-05-30T17:04:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe30aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c06b9b0 0x7fe30c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe30aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c06b9b0 0x7fe30c15e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50684/0 (socket says 172.21.15.59:50684) 2024-05-30T17:04:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe30aa00640 1 -- 172.21.15.59:0/4137356733 learned_addr learned my addr 172.21.15.59:0/4137356733 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe30b400640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c148360 0x7fe30c145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe302000640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe30c0b43e0 0x7fe30c144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe30aa00640 1 -- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c148360 msgr2=0x7fe30c145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe30aa00640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c148360 0x7fe30c145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe30aa00640 1 -- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe30c0b43e0 msgr2=0x7fe30c144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:17.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe30aa00640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe30c0b43e0 0x7fe30c144ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:17.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe30aa00640 1 -- 172.21.15.59:0/4137356733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c15e590 con 0x7fe30c06b9b0 2024-05-30T17:04:17.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe30aa00640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c06b9b0 0x7fe30c15e050 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc01a580 tx=0x7fe2fc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:17.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe303e00640 1 -- 172.21.15.59:0/4137356733 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0bd020 con 0x7fe30c06b9b0 2024-05-30T17:04:17.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe303e00640 1 -- 172.21.15.59:0/4137356733 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0b8670 con 0x7fe30c06b9b0 2024-05-30T17:04:17.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe311e00640 1 -- 172.21.15.59:0/4137356733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c13f890 con 0x7fe30c06b9b0 2024-05-30T17:04:17.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe303e00640 1 -- 172.21.15.59:0/4137356733 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0b2040 con 0x7fe30c06b9b0 2024-05-30T17:04:17.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe311e00640 1 -- 172.21.15.59:0/4137356733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c0cd580 con 0x7fe30c06b9b0 2024-05-30T17:04:17.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.757+0000 7fe311e00640 1 -- 172.21.15.59:0/4137356733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c068a90 con 0x7fe30c06b9b0 2024-05-30T17:04:17.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.761+0000 7fe303e00640 1 -- 172.21.15.59:0/4137356733 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fe2fc0c0020 con 0x7fe30c06b9b0 2024-05-30T17:04:17.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.761+0000 7fe303e00640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe2e8069fd0 0x7fe2e806c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:17.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.761+0000 7fe303e00640 1 -- 172.21.15.59:0/4137356733 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5527+0+0 (secure 0 0 0) 0x7fe2fc1203e0 con 0x7fe30c06b9b0 2024-05-30T17:04:17.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.761+0000 7fe302000640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe2e8069fd0 0x7fe2e806c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:17.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.761+0000 7fe302000640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe2e8069fd0 0x7fe2e806c490 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe30c15e9e0 tx=0x7fe2f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:17.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.765+0000 7fe303e00640 1 -- 172.21.15.59:0/4137356733 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe2fc0c8020 con 0x7fe30c06b9b0 2024-05-30T17:04:17.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:17.929+0000 7fe311e00640 1 -- 172.21.15.59:0/4137356733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe30c06c7d0 con 0x7fe30c06b9b0 2024-05-30T17:04:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.577+0000 7fe303e00640 1 -- 172.21.15.59:0/4137356733 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v123) ==== 169+0+0 (secure 0 0 0) 0x7fe2fc016540 con 0x7fe30c06b9b0 2024-05-30T17:04:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-05-30T17:04:18.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.581+0000 7fe311e00640 1 -- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe2e8069fd0 msgr2=0x7fe2e806c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:18.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.581+0000 7fe311e00640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe2e8069fd0 0x7fe2e806c490 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe30c15e9e0 tx=0x7fe2f4008040 comp rx=0 tx=0).stop 2024-05-30T17:04:18.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.581+0000 7fe311e00640 1 -- 172.21.15.59:0/4137356733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c06b9b0 msgr2=0x7fe30c15e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:18.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.581+0000 7fe311e00640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c06b9b0 0x7fe30c15e050 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc01a580 tx=0x7fe2fc0196f0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.581+0000 7fe311e00640 1 -- 172.21.15.59:0/4137356733 shutdown_connections 2024-05-30T17:04:18.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.581+0000 7fe311e00640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe2e8069fd0 0x7fe2e806c490 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.581+0000 7fe311e00640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c148360 0x7fe30c145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.581+0000 7fe311e00640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe30c0b43e0 0x7fe30c144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.581+0000 7fe311e00640 1 --2- 172.21.15.59:0/4137356733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c06b9b0 0x7fe30c15e050 secure :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc01a580 tx=0x7fe2fc0196f0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.581+0000 7fe311e00640 1 -- 172.21.15.59:0/4137356733 >> 172.21.15.59:0/4137356733 conn(0x7fe30c0b2560 msgr2=0x7fe30c0b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:18.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.581+0000 7fe311e00640 1 -- 172.21.15.59:0/4137356733 shutdown_connections 2024-05-30T17:04:18.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.581+0000 7fe311e00640 1 -- 172.21.15.59:0/4137356733 wait complete. 2024-05-30T17:04:18.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T17:04:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.757+0000 7fe4bfa00640 1 Processor -- start 2024-05-30T17:04:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.757+0000 7fe4bfa00640 1 -- start start 2024-05-30T17:04:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4bfa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe4b8159100 0x7fe4b806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4bfa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4b80b44e0 0x7fe4b815efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4bfa00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4b80b52d0 con 0x7fe4b815f510 2024-05-30T17:04:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4bfa00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe4b80b4a30 con 0x7fe4b8159100 2024-05-30T17:04:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4bfa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b80b4d10 con 0x7fe4b80b44e0 2024-05-30T17:04:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4bd000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe4b8159100 0x7fe4b806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4bd000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe4b8159100 0x7fe4b806e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:55152/0 (socket says 172.21.15.59:55152) 2024-05-30T17:04:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4bd000640 1 -- 172.21.15.59:0/137147414 learned_addr learned my addr 172.21.15.59:0/137147414 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4b7e00640 1 --2- 172.21.15.59:0/137147414 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4b80b44e0 0x7fe4b815efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4bd000640 1 -- 172.21.15.59:0/137147414 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4b80b44e0 msgr2=0x7fe4b815efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4bd000640 1 --2- 172.21.15.59:0/137147414 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4b80b44e0 0x7fe4b815efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4bd000640 1 -- 172.21.15.59:0/137147414 >> v1:172.21.15.107:6789/0 conn(0x7fe4b815f510 legacy=0x7fe4b815c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.761+0000 7fe4bd000640 1 -- 172.21.15.59:0/137147414 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b80b4ff0 con 0x7fe4b8159100 2024-05-30T17:04:18.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4bd000640 1 --2- 172.21.15.59:0/137147414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b8159100 0x7fe4b806e590 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac009870 tx=0x7fe4ac01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a78a81e04e8a189 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:18.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4b7400640 1 -- 172.21.15.59:0/137147414 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac0ab610 con 0x7fe4b8159100 2024-05-30T17:04:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4b7400640 1 -- 172.21.15.59:0/137147414 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4ac0b0070 con 0x7fe4b8159100 2024-05-30T17:04:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4b7400640 1 -- 172.21.15.59:0/137147414 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac0ab9d0 con 0x7fe4b8159100 2024-05-30T17:04:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4bfa00640 1 -- 172.21.15.59:0/137147414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b8159100 msgr2=0x7fe4b806e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4bfa00640 1 --2- 172.21.15.59:0/137147414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b8159100 0x7fe4b806e590 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac009870 tx=0x7fe4ac01c410 comp rx=0 tx=0).stop 2024-05-30T17:04:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4bfa00640 1 -- 172.21.15.59:0/137147414 shutdown_connections 2024-05-30T17:04:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4bfa00640 1 --2- 172.21.15.59:0/137147414 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4b80b44e0 0x7fe4b815efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4bfa00640 1 --2- 172.21.15.59:0/137147414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b8159100 0x7fe4b806e590 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4bfa00640 1 -- 172.21.15.59:0/137147414 >> 172.21.15.59:0/137147414 conn(0x7fe4b806bdb0 msgr2=0x7fe4b806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4bfa00640 1 -- 172.21.15.59:0/137147414 shutdown_connections 2024-05-30T17:04:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4bfa00640 1 -- 172.21.15.59:0/137147414 wait complete. 2024-05-30T17:04:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4bfa00640 1 Processor -- start 2024-05-30T17:04:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.765+0000 7fe4bfa00640 1 -- start start 2024-05-30T17:04:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bfa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b80b44e0 0x7fe4b813fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bfa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4b8159100 0x7fe4b814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bfa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b815f510 0x7fe4b814eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bfa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b8168140 con 0x7fe4b815f510 2024-05-30T17:04:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bfa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b81682c0 con 0x7fe4b80b44e0 2024-05-30T17:04:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bfa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b8168440 con 0x7fe4b8159100 2024-05-30T17:04:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b815f510 0x7fe4b814eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bd000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b80b44e0 0x7fe4b813fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4b7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4b8159100 0x7fe4b814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b815f510 0x7fe4b814eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50694/0 (socket says 172.21.15.59:50694) 2024-05-30T17:04:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bda00640 1 -- 172.21.15.59:0/403899349 learned_addr learned my addr 172.21.15.59:0/403899349 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bda00640 1 -- 172.21.15.59:0/403899349 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4b8159100 msgr2=0x7fe4b814e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bda00640 1 --2- 172.21.15.59:0/403899349 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4b8159100 0x7fe4b814e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bda00640 1 -- 172.21.15.59:0/403899349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b80b44e0 msgr2=0x7fe4b813fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bda00640 1 --2- 172.21.15.59:0/403899349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b80b44e0 0x7fe4b813fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bda00640 1 -- 172.21.15.59:0/403899349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b80cdb20 con 0x7fe4b815f510 2024-05-30T17:04:18.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bda00640 1 --2- 172.21.15.59:0/403899349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b815f510 0x7fe4b814eaf0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000c760 tx=0x7fe4b000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:18.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4b4c00640 1 -- 172.21.15.59:0/403899349 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0003b80 con 0x7fe4b815f510 2024-05-30T17:04:18.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4b4c00640 1 -- 172.21.15.59:0/403899349 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b0003d20 con 0x7fe4b815f510 2024-05-30T17:04:18.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bfa00640 1 -- 172.21.15.59:0/403899349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b80cde00 con 0x7fe4b815f510 2024-05-30T17:04:18.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4b4c00640 1 -- 172.21.15.59:0/403899349 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b000aa30 con 0x7fe4b815f510 2024-05-30T17:04:18.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bfa00640 1 -- 172.21.15.59:0/403899349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b80ce3c0 con 0x7fe4b815f510 2024-05-30T17:04:18.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.769+0000 7fe4bfa00640 1 -- 172.21.15.59:0/403899349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b8068a90 con 0x7fe4b815f510 2024-05-30T17:04:18.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.773+0000 7fe4b4c00640 1 -- 172.21.15.59:0/403899349 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fe4b000abd0 con 0x7fe4b815f510 2024-05-30T17:04:18.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.773+0000 7fe4b4c00640 1 --2- 172.21.15.59:0/403899349 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe498069fa0 0x7fe49806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:18.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.773+0000 7fe4b4c00640 1 -- 172.21.15.59:0/403899349 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5055+0+0 (secure 0 0 0) 0x7fe4b0085640 con 0x7fe4b815f510 2024-05-30T17:04:18.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.773+0000 7fe4bd000640 1 --2- 172.21.15.59:0/403899349 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe498069fa0 0x7fe49806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:18.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.773+0000 7fe4bd000640 1 --2- 172.21.15.59:0/403899349 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe498069fa0 0x7fe49806c460 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0af000 tx=0x7fe4ac0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:18.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.777+0000 7fe4b4c00640 1 -- 172.21.15.59:0/403899349 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4b0057010 con 0x7fe4b815f510 2024-05-30T17:04:18.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.957+0000 7fe4bfa00640 1 -- 172.21.15.59:0/403899349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe4b80b3160 con 0x7fe4b815f510 2024-05-30T17:04:18.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4b4c00640 1 -- 172.21.15.59:0/403899349 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7fe4b005b310 con 0x7fe4b815f510 2024-05-30T17:04:18.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4bfa00640 1 -- 172.21.15.59:0/403899349 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe498069fa0 msgr2=0x7fe49806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:18.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4bfa00640 1 --2- 172.21.15.59:0/403899349 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe498069fa0 0x7fe49806c460 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0af000 tx=0x7fe4ac0a7000 comp rx=0 tx=0).stop 2024-05-30T17:04:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4bfa00640 1 -- 172.21.15.59:0/403899349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b815f510 msgr2=0x7fe4b814eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4bfa00640 1 --2- 172.21.15.59:0/403899349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b815f510 0x7fe4b814eaf0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000c760 tx=0x7fe4b000cc20 comp rx=0 tx=0).stop 2024-05-30T17:04:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4bfa00640 1 -- 172.21.15.59:0/403899349 shutdown_connections 2024-05-30T17:04:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4bfa00640 1 --2- 172.21.15.59:0/403899349 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe498069fa0 0x7fe49806c460 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4bfa00640 1 --2- 172.21.15.59:0/403899349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b815f510 0x7fe4b814eaf0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4bfa00640 1 --2- 172.21.15.59:0/403899349 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4b8159100 0x7fe4b814e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4bfa00640 1 --2- 172.21.15.59:0/403899349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b80b44e0 0x7fe4b813fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4bfa00640 1 -- 172.21.15.59:0/403899349 >> 172.21.15.59:0/403899349 conn(0x7fe4b806bdb0 msgr2=0x7fe4b8156fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4bfa00640 1 -- 172.21.15.59:0/403899349 shutdown_connections 2024-05-30T17:04:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:18.961+0000 7fe4bfa00640 1 -- 172.21.15.59:0/403899349 wait complete. 2024-05-30T17:04:18.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_3_clones_are_cancelled' 2024-05-30T17:04:19.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.125+0000 7fd8dda00640 1 Processor -- start 2024-05-30T17:04:19.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8dda00640 1 -- start start 2024-05-30T17:04:19.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8dda00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd8d80d0f30 0x7fd8d809ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8dda00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d809b080 0x7fd8d80cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8dda00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8d809b900 con 0x7fd8d815c7b0 2024-05-30T17:04:19.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8dda00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d815cb90 con 0x7fd8d80d0f30 2024-05-30T17:04:19.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8dda00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d80cd4c0 con 0x7fd8d809b080 2024-05-30T17:04:19.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd8d815c7b0 0x7fd8d80d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42274/0 (socket says 172.21.15.59:42274) 2024-05-30T17:04:19.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7e00640 1 -- 172.21.15.59:0/2984858764 learned_addr learned my addr 172.21.15.59:0/2984858764 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:19.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642930513 0 0) 0x7fd8d809b900 con 0x7fd8d815c7b0 2024-05-30T17:04:19.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8dd000640 1 --2- 172.21.15.59:0/2984858764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d809b080 0x7fd8d80cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8bc003530 con 0x7fd8d815c7b0 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8cf400640 1 --2- 172.21.15.59:0/2984858764 >> v2:172.21.15.107:3300/0 conn(0x7fd8d80d0f30 0x7fd8d809ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3732686108 0 0) 0x7fd8bc003530 con 0x7fd8d815c7b0 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d809b080 msgr2=0x7fd8d80cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 --2- 172.21.15.59:0/2984858764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d809b080 0x7fd8d80cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 >> v2:172.21.15.107:3300/0 conn(0x7fd8d80d0f30 msgr2=0x7fd8d809ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 --2- 172.21.15.59:0/2984858764 >> v2:172.21.15.107:3300/0 conn(0x7fd8d80d0f30 0x7fd8d809ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d809bbe0 con 0x7fd8d815c7b0 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fd8c8001680 con 0x7fd8d815c7b0 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 >> v1:172.21.15.59:6789/0 conn(0x7fd8d815c7b0 legacy=0x7fd8d80d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 --2- 172.21.15.59:0/2984858764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d809b080 0x7fd8bc0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 --2- 172.21.15.59:0/2984858764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8bc003f40 0x7fd8bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 --2- 172.21.15.59:0/2984858764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8bc004d50 0x7fd8bc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d815cb90 con 0x7fd8bc003f40 2024-05-30T17:04:19.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d80cd4c0 con 0x7fd8bc004d50 2024-05-30T17:04:19.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd8bc00b9d0 con 0x7fd8d809b080 2024-05-30T17:04:19.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8cf400640 1 --2- 172.21.15.59:0/2984858764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8bc003f40 0x7fd8bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8d7e00640 1 --2- 172.21.15.59:0/2984858764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d809b080 0x7fd8bc0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8dd000640 1 --2- 172.21.15.59:0/2984858764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8bc004d50 0x7fd8bc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8cf400640 1 -- 172.21.15.59:0/2984858764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d809b080 msgr2=0x7fd8bc0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:19.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8cf400640 1 --2- 172.21.15.59:0/2984858764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d809b080 0x7fd8bc0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8cf400640 1 -- 172.21.15.59:0/2984858764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8bc004d50 msgr2=0x7fd8bc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:19.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8cf400640 1 --2- 172.21.15.59:0/2984858764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8bc004d50 0x7fd8bc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.129+0000 7fd8cf400640 1 -- 172.21.15.59:0/2984858764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8bc003530 con 0x7fd8bc003f40 2024-05-30T17:04:19.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.133+0000 7fd8cf400640 1 --2- 172.21.15.59:0/2984858764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8bc003f40 0x7fd8bc004810 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009ae0 tx=0x7fd8c001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a8c8e1a998d506 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:19.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.133+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00b2070 con 0x7fd8bc003f40 2024-05-30T17:04:19.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.133+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c00a5590 con 0x7fd8bc003f40 2024-05-30T17:04:19.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.133+0000 7fd8d7400640 1 -- 172.21.15.59:0/2984858764 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00096b0 con 0x7fd8bc003f40 2024-05-30T17:04:19.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.133+0000 7fd8dda00640 1 -- 172.21.15.59:0/2984858764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8bc003f40 msgr2=0x7fd8bc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:19.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.133+0000 7fd8dda00640 1 --2- 172.21.15.59:0/2984858764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8bc003f40 0x7fd8bc004810 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009ae0 tx=0x7fd8c001ca50 comp rx=0 tx=0).stop 2024-05-30T17:04:19.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.133+0000 7fd8dd000640 1 -- 172.21.15.59:0/2984858764 reap_dead start 2024-05-30T17:04:19.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.133+0000 7fd8dda00640 1 -- 172.21.15.59:0/2984858764 shutdown_connections 2024-05-30T17:04:19.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.133+0000 7fd8dda00640 1 -- 172.21.15.59:0/2984858764 >> 172.21.15.59:0/2984858764 conn(0x7fd8d80b3ec0 msgr2=0x7fd8d80b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:19.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.133+0000 7fd8dda00640 1 -- 172.21.15.59:0/2984858764 shutdown_connections 2024-05-30T17:04:19.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.133+0000 7fd8dda00640 1 -- 172.21.15.59:0/2984858764 wait complete. 2024-05-30T17:04:19.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dda00640 1 Processor -- start 2024-05-30T17:04:19.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dda00640 1 -- start start 2024-05-30T17:04:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dda00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8bc003f40 0x7fd8d81f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d815bd30 0x7fd8d80c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dda00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d81f7f50 0x7fd8d81f8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dda00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d809b490 con 0x7fd8d815bd30 2024-05-30T17:04:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dda00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d80cce00 con 0x7fd8bc003f40 2024-05-30T17:04:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dda00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d809b610 con 0x7fd8d81f7f50 2024-05-30T17:04:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8cf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d815bd30 0x7fd8d80c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8cf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d815bd30 0x7fd8d80c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50708/0 (socket says 172.21.15.59:50708) 2024-05-30T17:04:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8cf400640 1 -- 172.21.15.59:0/3222114830 learned_addr learned my addr 172.21.15.59:0/3222114830 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dd000640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d81f7f50 0x7fd8d81f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8d7e00640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8bc003f40 0x7fd8d81f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8cf400640 1 -- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d81f7f50 msgr2=0x7fd8d81f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:19.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8cf400640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d81f7f50 0x7fd8d81f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8cf400640 1 -- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8bc003f40 msgr2=0x7fd8d81f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:19.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8cf400640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8bc003f40 0x7fd8d81f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8cf400640 1 -- 172.21.15.59:0/3222114830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d80c6030 con 0x7fd8d815bd30 2024-05-30T17:04:19.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dd000640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d81f7f50 0x7fd8d81f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:19.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8cf400640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d815bd30 0x7fd8d80c5af0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fd8c001d2f0 tx=0x7fd8c8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8d4c00640 1 -- 172.21.15.59:0/3222114830 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00b2040 con 0x7fd8d815bd30 2024-05-30T17:04:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8d4c00640 1 -- 172.21.15.59:0/3222114830 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c00bd070 con 0x7fd8d815bd30 2024-05-30T17:04:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8d4c00640 1 -- 172.21.15.59:0/3222114830 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00b8450 con 0x7fd8d815bd30 2024-05-30T17:04:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dda00640 1 -- 172.21.15.59:0/3222114830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d80cb6f0 con 0x7fd8d815bd30 2024-05-30T17:04:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dda00640 1 -- 172.21.15.59:0/3222114830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d80cbcb0 con 0x7fd8d815bd30 2024-05-30T17:04:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.137+0000 7fd8dda00640 1 -- 172.21.15.59:0/3222114830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d8068a90 con 0x7fd8d815bd30 2024-05-30T17:04:19.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.141+0000 7fd8d4c00640 1 -- 172.21.15.59:0/3222114830 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fd8c00b85f0 con 0x7fd8d815bd30 2024-05-30T17:04:19.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.141+0000 7fd8d4c00640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd8b4069fd0 0x7fd8b406c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.141+0000 7fd8d4c00640 1 -- 172.21.15.59:0/3222114830 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5055+0+0 (secure 0 0 0) 0x7fd8c01208f0 con 0x7fd8d815bd30 2024-05-30T17:04:19.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.141+0000 7fd8d7e00640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd8b4069fd0 0x7fd8b406c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.141+0000 7fd8d7e00640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd8b4069fd0 0x7fd8b406c490 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8001d40 tx=0x7fd8c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:19.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.145+0000 7fd8d4c00640 1 -- 172.21.15.59:0/3222114830 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd8c00167c0 con 0x7fd8d815bd30 2024-05-30T17:04:19.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.373+0000 7fd8dda00640 1 -- 172.21.15.59:0/3222114830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_3_clones_are_cancelled"]} v 0) -- 0x7fd8d80d03f0 con 0x7fd8d815bd30 2024-05-30T17:04:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.577+0000 7fd8d4c00640 1 -- 172.21.15.59:0/3222114830 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_3_clones_are_cancelled"]}]=0 v687) ==== 163+0+0 (secure 0 0 0) 0x7fd8c00f2990 con 0x7fd8d815bd30 2024-05-30T17:04:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.581+0000 7fd8dda00640 1 -- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd8b4069fd0 msgr2=0x7fd8b406c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.581+0000 7fd8dda00640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd8b4069fd0 0x7fd8b406c490 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8001d40 tx=0x7fd8c8009040 comp rx=0 tx=0).stop 2024-05-30T17:04:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.581+0000 7fd8dda00640 1 -- 172.21.15.59:0/3222114830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d815bd30 msgr2=0x7fd8d80c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.581+0000 7fd8dda00640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d815bd30 0x7fd8d80c5af0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fd8c001d2f0 tx=0x7fd8c8007f90 comp rx=0 tx=0).stop 2024-05-30T17:04:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.581+0000 7fd8dda00640 1 -- 172.21.15.59:0/3222114830 shutdown_connections 2024-05-30T17:04:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.581+0000 7fd8dda00640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd8b4069fd0 0x7fd8b406c490 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.581+0000 7fd8dda00640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8d81f7f50 0x7fd8d81f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.581+0000 7fd8dda00640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d815bd30 0x7fd8d80c5af0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.581+0000 7fd8dda00640 1 --2- 172.21.15.59:0/3222114830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8bc003f40 0x7fd8d81f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.581+0000 7fd8dda00640 1 -- 172.21.15.59:0/3222114830 >> 172.21.15.59:0/3222114830 conn(0x7fd8d80b3ec0 msgr2=0x7fd8d80c4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.581+0000 7fd8dda00640 1 -- 172.21.15.59:0/3222114830 shutdown_connections 2024-05-30T17:04:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.581+0000 7fd8dda00640 1 -- 172.21.15.59:0/3222114830 wait complete. 2024-05-30T17:04:19.605 INFO:tasks.cephfs_test_runner:Test that progress bars, that printed for 3 ongoing clone jobs, are ... ok 2024-05-30T17:04:19.605 INFO:tasks.cephfs_test_runner:Starting test: test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that both the progress bars, that are printed for all 7 clone 2024-05-30T17:04:19.606 INFO:tasks.cephfs_test_runner:test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T17:04:19.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:04:19.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.745+0000 7ff674e00640 1 Processor -- start 2024-05-30T17:04:19.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.745+0000 7ff674e00640 1 -- start start 2024-05-30T17:04:19.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff674e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6700af720 0x7ff67015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff674e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6700d0560 0x7ff6700d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff674e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff67015f060 con 0x7ff67006e900 2024-05-30T17:04:19.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff674e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff6700afb00 con 0x7ff6700af720 2024-05-30T17:04:19.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff674e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff67015c270 con 0x7ff6700d0560 2024-05-30T17:04:19.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff66de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6700af720 0x7ff67015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff665400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff67006e900 0x7ff67015f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42280/0 (socket says 172.21.15.59:42280) 2024-05-30T17:04:19.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff665400640 1 -- 172.21.15.59:0/3141400406 learned_addr learned my addr 172.21.15.59:0/3141400406 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:19.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff66e800640 1 --2- 172.21.15.59:0/3141400406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6700d0560 0x7ff6700d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff66de00640 1 -- 172.21.15.59:0/3141400406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6700d0560 msgr2=0x7ff6700d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:19.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff66de00640 1 --2- 172.21.15.59:0/3141400406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6700d0560 0x7ff6700d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff66de00640 1 -- 172.21.15.59:0/3141400406 >> v1:172.21.15.59:6789/0 conn(0x7ff67006e900 legacy=0x7ff67015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:19.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff66de00640 1 -- 172.21.15.59:0/3141400406 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67015ff00 con 0x7ff6700af720 2024-05-30T17:04:19.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.749+0000 7ff66e800640 1 --2- 172.21.15.59:0/3141400406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6700d0560 0x7ff6700d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:19.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff66de00640 1 --2- 172.21.15.59:0/3141400406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6700af720 0x7ff67015b9d0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7ff6600097c0 tx=0x7ff66001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220cec4b74a754e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:19.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff66d400640 1 -- 172.21.15.59:0/3141400406 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6600b2070 con 0x7ff6700af720 2024-05-30T17:04:19.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff66d400640 1 -- 172.21.15.59:0/3141400406 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6600ad640 con 0x7ff6700af720 2024-05-30T17:04:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff66d400640 1 -- 172.21.15.59:0/3141400406 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6600ada10 con 0x7ff6700af720 2024-05-30T17:04:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 -- 172.21.15.59:0/3141400406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6700af720 msgr2=0x7ff67015b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 --2- 172.21.15.59:0/3141400406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6700af720 0x7ff67015b9d0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7ff6600097c0 tx=0x7ff66001c4a0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 -- 172.21.15.59:0/3141400406 shutdown_connections 2024-05-30T17:04:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 --2- 172.21.15.59:0/3141400406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6700d0560 0x7ff6700d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 --2- 172.21.15.59:0/3141400406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6700af720 0x7ff67015b9d0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 -- 172.21.15.59:0/3141400406 >> 172.21.15.59:0/3141400406 conn(0x7ff6700b22d0 msgr2=0x7ff6700b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 -- 172.21.15.59:0/3141400406 shutdown_connections 2024-05-30T17:04:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 -- 172.21.15.59:0/3141400406 wait complete. 2024-05-30T17:04:19.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 Processor -- start 2024-05-30T17:04:19.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 -- start start 2024-05-30T17:04:19.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67006e900 0x7ff67009aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6700af720 0x7ff670145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6700d0560 0x7ff670165530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff670073150 con 0x7ff6700af720 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff67015c830 con 0x7ff6700d0560 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff674e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff6700732d0 con 0x7ff67006e900 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.753+0000 7ff665400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6700af720 0x7ff670145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff665400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6700af720 0x7ff670145d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50728/0 (socket says 172.21.15.59:50728) 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff665400640 1 -- 172.21.15.59:0/779933795 learned_addr learned my addr 172.21.15.59:0/779933795 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff66de00640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67006e900 0x7ff67009aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff66e800640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6700d0560 0x7ff670165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff665400640 1 -- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67006e900 msgr2=0x7ff67009aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff665400640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67006e900 0x7ff67009aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff665400640 1 -- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6700d0560 msgr2=0x7ff670165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff665400640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6700d0560 0x7ff670165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff665400640 1 -- 172.21.15.59:0/779933795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6700c58e0 con 0x7ff6700af720 2024-05-30T17:04:19.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff665400640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6700af720 0x7ff670145d50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7ff65800c340 tx=0x7ff65800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:19.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff666a00640 1 -- 172.21.15.59:0/779933795 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658017070 con 0x7ff6700af720 2024-05-30T17:04:19.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff666a00640 1 -- 172.21.15.59:0/779933795 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff658005cf0 con 0x7ff6700af720 2024-05-30T17:04:19.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff674e00640 1 -- 172.21.15.59:0/779933795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6700c5320 con 0x7ff6700af720 2024-05-30T17:04:19.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff666a00640 1 -- 172.21.15.59:0/779933795 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6580072f0 con 0x7ff6700af720 2024-05-30T17:04:19.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff674e00640 1 -- 172.21.15.59:0/779933795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff670146820 con 0x7ff6700af720 2024-05-30T17:04:19.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff674e00640 1 -- 172.21.15.59:0/779933795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff670068a90 con 0x7ff6700af720 2024-05-30T17:04:19.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff666a00640 1 -- 172.21.15.59:0/779933795 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7ff65801a070 con 0x7ff6700af720 2024-05-30T17:04:19.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.757+0000 7ff666a00640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff64c069fa0 0x7ff64c06c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:19.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.761+0000 7ff666a00640 1 -- 172.21.15.59:0/779933795 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5055+0+0 (secure 0 0 0) 0x7ff658084c50 con 0x7ff6700af720 2024-05-30T17:04:19.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.761+0000 7ff66de00640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff64c069fa0 0x7ff64c06c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:19.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.761+0000 7ff66de00640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff64c069fa0 0x7ff64c06c460 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff6600af000 tx=0x7ff660008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:19.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.765+0000 7ff666a00640 1 -- 172.21.15.59:0/779933795 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff658056c70 con 0x7ff6700af720 2024-05-30T17:04:19.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.929+0000 7ff674e00640 1 -- 172.21.15.59:0/779933795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff67015b490 con 0x7ff6700af720 2024-05-30T17:04:19.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff666a00640 1 -- 172.21.15.59:0/779933795 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+13192 (secure 0 0 0) 0x7ff658056570 con 0x7ff6700af720 2024-05-30T17:04:19.932 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:19.932 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":123,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:04:18.568282+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6834/871678202":"2024-05-31T17:04:15.361596+0000","172.21.15.59:6833/871678202":"2024-05-31T17:04:15.361596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff674e00640 1 -- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff64c069fa0 msgr2=0x7ff64c06c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff674e00640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff64c069fa0 0x7ff64c06c460 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff6600af000 tx=0x7ff660008040 comp rx=0 tx=0).stop 2024-05-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff674e00640 1 -- 172.21.15.59:0/779933795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6700af720 msgr2=0x7ff670145d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff674e00640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6700af720 0x7ff670145d50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7ff65800c340 tx=0x7ff65800c800 comp rx=0 tx=0).stop 2024-05-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff674e00640 1 -- 172.21.15.59:0/779933795 shutdown_connections 2024-05-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff674e00640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff64c069fa0 0x7ff64c06c460 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff674e00640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6700d0560 0x7ff670165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff674e00640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6700af720 0x7ff670145d50 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff674e00640 1 --2- 172.21.15.59:0/779933795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67006e900 0x7ff67009aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff674e00640 1 -- 172.21.15.59:0/779933795 >> 172.21.15.59:0/779933795 conn(0x7ff6700b22d0 msgr2=0x7ff6700b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff674e00640 1 -- 172.21.15.59:0/779933795 shutdown_connections 2024-05-30T17:04:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:19.933+0000 7ff674e00640 1 -- 172.21.15.59:0/779933795 wait complete. 2024-05-30T17:04:19.954 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T16:48:53.098546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T17:04:19.954 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T17:04:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.097+0000 7fc377400640 1 Processor -- start 2024-05-30T17:04:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.097+0000 7fc377400640 1 -- start start 2024-05-30T17:04:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc377400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc37006ffe0 0x7fc3700b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc377400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3700af230 0x7fc3700af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc377400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc37015ed20 con 0x7fc37015e940 2024-05-30T17:04:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc377400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc3700d10f0 con 0x7fc37006ffe0 2024-05-30T17:04:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc377400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc370070420 con 0x7fc3700af230 2024-05-30T17:04:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc374a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc37015e940 0x7fc3700d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42290/0 (socket says 172.21.15.59:42290) 2024-05-30T17:04:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc374a00640 1 -- 172.21.15.59:0/3256223618 learned_addr learned my addr 172.21.15.59:0/3256223618 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc367e00640 1 --2- 172.21.15.59:0/3256223618 >> v2:172.21.15.107:3300/0 conn(0x7fc37006ffe0 0x7fc3700b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc375400640 1 --2- 172.21.15.59:0/3256223618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3700af230 0x7fc3700af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc36fe00640 1 -- 172.21.15.59:0/3256223618 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360705896 0 0) 0x7fc37015ed20 con 0x7fc37015e940 2024-05-30T17:04:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc36fe00640 1 -- 172.21.15.59:0/3256223618 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc354003530 con 0x7fc37015e940 2024-05-30T17:04:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc367e00640 1 -- 172.21.15.59:0/3256223618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3700af230 msgr2=0x7fc3700af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc367e00640 1 --2- 172.21.15.59:0/3256223618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3700af230 0x7fc3700af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc367e00640 1 -- 172.21.15.59:0/3256223618 >> v1:172.21.15.59:6789/0 conn(0x7fc37015e940 legacy=0x7fc3700d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc367e00640 1 -- 172.21.15.59:0/3256223618 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3700d0830 con 0x7fc37006ffe0 2024-05-30T17:04:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.101+0000 7fc375400640 1 --2- 172.21.15.59:0/3256223618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3700af230 0x7fc3700af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:04:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc367e00640 1 --2- 172.21.15.59:0/3256223618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc37006ffe0 0x7fc3700b18c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc3580097c0 tx=0x7fc35801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=674c711ef9fd422a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc36fe00640 1 -- 172.21.15.59:0/3256223618 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3580b5070 con 0x7fc37006ffe0 2024-05-30T17:04:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc36fe00640 1 -- 172.21.15.59:0/3256223618 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3580a8990 con 0x7fc37006ffe0 2024-05-30T17:04:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc36fe00640 1 -- 172.21.15.59:0/3256223618 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3580a8d40 con 0x7fc37006ffe0 2024-05-30T17:04:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc377400640 1 -- 172.21.15.59:0/3256223618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc37006ffe0 msgr2=0x7fc3700b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc377400640 1 --2- 172.21.15.59:0/3256223618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc37006ffe0 0x7fc3700b18c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc3580097c0 tx=0x7fc35801ec90 comp rx=0 tx=0).stop 2024-05-30T17:04:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc377400640 1 -- 172.21.15.59:0/3256223618 shutdown_connections 2024-05-30T17:04:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc377400640 1 --2- 172.21.15.59:0/3256223618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3700af230 0x7fc3700af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc377400640 1 --2- 172.21.15.59:0/3256223618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc37006ffe0 0x7fc3700b18c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc377400640 1 -- 172.21.15.59:0/3256223618 >> 172.21.15.59:0/3256223618 conn(0x7fc3700b3f70 msgr2=0x7fc3700b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc377400640 1 -- 172.21.15.59:0/3256223618 shutdown_connections 2024-05-30T17:04:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc377400640 1 -- 172.21.15.59:0/3256223618 wait complete. 2024-05-30T17:04:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.105+0000 7fc377400640 1 Processor -- start 2024-05-30T17:04:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc377400640 1 -- start start 2024-05-30T17:04:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc377400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc37006ffe0 0x7fc3700c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc377400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3700af230 0x7fc37014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc377400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc37015e940 0x7fc37014e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc377400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc3700d0d80 con 0x7fc37015e940 2024-05-30T17:04:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc377400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc3700d0aa0 con 0x7fc3700af230 2024-05-30T17:04:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc377400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc3700d1c90 con 0x7fc37006ffe0 2024-05-30T17:04:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc375400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc37015e940 0x7fc37014e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc375400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc37015e940 0x7fc37014e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50730/0 (socket says 172.21.15.59:50730) 2024-05-30T17:04:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc375400640 1 -- 172.21.15.59:0/787289100 learned_addr learned my addr 172.21.15.59:0/787289100 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc367e00640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3700af230 0x7fc37014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc374a00640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc37006ffe0 0x7fc3700c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc375400640 1 -- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc37006ffe0 msgr2=0x7fc3700c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc375400640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc37006ffe0 0x7fc3700c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc375400640 1 -- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3700af230 msgr2=0x7fc37014db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc375400640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3700af230 0x7fc37014db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc375400640 1 -- 172.21.15.59:0/787289100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3700b6fe0 con 0x7fc37015e940 2024-05-30T17:04:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc374a00640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc37006ffe0 0x7fc3700c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc375400640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc37015e940 0x7fc37014e040 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fc36800efc0 tx=0x7fc36800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc36d600640 1 -- 172.21.15.59:0/787289100 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368018030 con 0x7fc37015e940 2024-05-30T17:04:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc36d600640 1 -- 172.21.15.59:0/787289100 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36800cdf0 con 0x7fc37015e940 2024-05-30T17:04:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc36d600640 1 -- 172.21.15.59:0/787289100 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368003bc0 con 0x7fc37015e940 2024-05-30T17:04:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc377400640 1 -- 172.21.15.59:0/787289100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3700b72c0 con 0x7fc37015e940 2024-05-30T17:04:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc377400640 1 -- 172.21.15.59:0/787289100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3700b7880 con 0x7fc37015e940 2024-05-30T17:04:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.109+0000 7fc377400640 1 -- 172.21.15.59:0/787289100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc370068a90 con 0x7fc37015e940 2024-05-30T17:04:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.113+0000 7fc36d600640 1 -- 172.21.15.59:0/787289100 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fc36801b070 con 0x7fc37015e940 2024-05-30T17:04:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.113+0000 7fc36d600640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc34c069fa0 0x7fc34c06c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.113+0000 7fc36d600640 1 -- 172.21.15.59:0/787289100 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5055+0+0 (secure 0 0 0) 0x7fc368086280 con 0x7fc37015e940 2024-05-30T17:04:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.113+0000 7fc374a00640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc34c069fa0 0x7fc34c06c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.113+0000 7fc374a00640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc34c069fa0 0x7fc34c06c460 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc360005890 tx=0x7fc360009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.117+0000 7fc36d600640 1 -- 172.21.15.59:0/787289100 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc368010040 con 0x7fc37015e940 2024-05-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.285+0000 7fc377400640 1 -- 172.21.15.59:0/787289100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc3700b4da0 con 0x7fc37015e940 2024-05-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.285+0000 7fc36d600640 1 -- 172.21.15.59:0/787289100 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) ==== 93+0+10 (secure 0 0 0) 0x7fc3680582a0 con 0x7fc37015e940 2024-05-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-05-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.289+0000 7fc377400640 1 -- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc34c069fa0 msgr2=0x7fc34c06c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.289+0000 7fc377400640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc34c069fa0 0x7fc34c06c460 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc360005890 tx=0x7fc360009040 comp rx=0 tx=0).stop 2024-05-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.289+0000 7fc377400640 1 -- 172.21.15.59:0/787289100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc37015e940 msgr2=0x7fc37014e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.289+0000 7fc377400640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc37015e940 0x7fc37014e040 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fc36800efc0 tx=0x7fc36800c490 comp rx=0 tx=0).stop 2024-05-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.289+0000 7fc377400640 1 -- 172.21.15.59:0/787289100 shutdown_connections 2024-05-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.289+0000 7fc377400640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc34c069fa0 0x7fc34c06c460 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.289+0000 7fc377400640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc37015e940 0x7fc37014e040 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.289+0000 7fc377400640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3700af230 0x7fc37014db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.289+0000 7fc377400640 1 --2- 172.21.15.59:0/787289100 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc37006ffe0 0x7fc3700c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.289+0000 7fc377400640 1 -- 172.21.15.59:0/787289100 >> 172.21.15.59:0/787289100 conn(0x7fc3700b3f70 msgr2=0x7fc3700b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.289+0000 7fc377400640 1 -- 172.21.15.59:0/787289100 shutdown_connections 2024-05-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.289+0000 7fc377400640 1 -- 172.21.15.59:0/787289100 wait complete. 2024-05-30T17:04:20.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_7_clones_are_cancelled' 2024-05-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95d1a00640 1 Processor -- start 2024-05-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95d1a00640 1 -- start start 2024-05-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95d1a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f95cc159df0 0x7f95cc0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95d1a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95cc15a1d0 0x7f95cc0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95d1a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc15d730 con 0x7f95cc0b3e50 2024-05-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95d1a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f95cc0b3370 con 0x7f95cc15a1d0 2024-05-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95d1a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f95cc0b3650 con 0x7f95cc159df0 2024-05-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95c2000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95cc15a1d0 0x7f95cc0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95c2000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95cc15a1d0 0x7f95cc0ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50744/0 (socket says 172.21.15.59:50744) 2024-05-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95c2000640 1 -- 172.21.15.59:0/874875202 learned_addr learned my addr 172.21.15.59:0/874875202 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95cb400640 1 --1- 172.21.15.59:0/874875202 >> v1:172.21.15.59:6789/0 conn(0x7f95cc0b3e50 0x7f95cc15ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42306/0 (socket says 172.21.15.59:42306) 2024-05-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95caa00640 1 --2- 172.21.15.59:0/874875202 >> v2:172.21.15.107:3300/0 conn(0x7f95cc159df0 0x7f95cc0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95c2000640 1 -- 172.21.15.59:0/874875202 >> v2:172.21.15.107:3300/0 conn(0x7f95cc159df0 msgr2=0x7f95cc0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95c2000640 1 --2- 172.21.15.59:0/874875202 >> v2:172.21.15.107:3300/0 conn(0x7f95cc159df0 0x7f95cc0ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95c2000640 1 -- 172.21.15.59:0/874875202 >> v1:172.21.15.59:6789/0 conn(0x7f95cc0b3e50 legacy=0x7f95cc15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.449+0000 7f95c2000640 1 -- 172.21.15.59:0/874875202 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc0b3930 con 0x7f95cc15a1d0 2024-05-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.453+0000 7f95c2000640 1 --2- 172.21.15.59:0/874875202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95cc15a1d0 0x7f95cc0ad6f0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0b4c20 tx=0x7f95b401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d5a1ad0d7d9f99 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.453+0000 7f95ca000640 1 -- 172.21.15.59:0/874875202 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b40b0070 con 0x7f95cc15a1d0 2024-05-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.453+0000 7f95ca000640 1 -- 172.21.15.59:0/874875202 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95b40ab600 con 0x7f95cc15a1d0 2024-05-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.453+0000 7f95ca000640 1 -- 172.21.15.59:0/874875202 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b40ab9d0 con 0x7f95cc15a1d0 2024-05-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.453+0000 7f95d1a00640 1 -- 172.21.15.59:0/874875202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95cc15a1d0 msgr2=0x7f95cc0ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.453+0000 7f95d1a00640 1 --2- 172.21.15.59:0/874875202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95cc15a1d0 0x7f95cc0ad6f0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0b4c20 tx=0x7f95b401c520 comp rx=0 tx=0).stop 2024-05-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.453+0000 7f95d1a00640 1 -- 172.21.15.59:0/874875202 shutdown_connections 2024-05-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.453+0000 7f95d1a00640 1 --2- 172.21.15.59:0/874875202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95cc15a1d0 0x7f95cc0ad6f0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.453+0000 7f95d1a00640 1 --2- 172.21.15.59:0/874875202 >> v2:172.21.15.107:3300/0 conn(0x7f95cc159df0 0x7f95cc0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.453+0000 7f95d1a00640 1 -- 172.21.15.59:0/874875202 >> 172.21.15.59:0/874875202 conn(0x7f95cc0b22d0 msgr2=0x7f95cc0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.453+0000 7f95d1a00640 1 -- 172.21.15.59:0/874875202 shutdown_connections 2024-05-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.453+0000 7f95d1a00640 1 -- 172.21.15.59:0/874875202 wait complete. 2024-05-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95d1a00640 1 Processor -- start 2024-05-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95d1a00640 1 -- start start 2024-05-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95d1a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95cc0b3e50 0x7f95cc06f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95d1a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95cc159df0 0x7f95cc153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95d1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95cc15a1d0 0x7f95cc153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95d1a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc15e760 con 0x7f95cc15a1d0 2024-05-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95d1a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc15e5e0 con 0x7f95cc0b3e50 2024-05-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95d1a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc15e8e0 con 0x7f95cc159df0 2024-05-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95cb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95cc15a1d0 0x7f95cc153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95cb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95cc15a1d0 0x7f95cc153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50754/0 (socket says 172.21.15.59:50754) 2024-05-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95caa00640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95cc0b3e50 0x7f95cc06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95cb400640 1 -- 172.21.15.59:0/283574060 learned_addr learned my addr 172.21.15.59:0/283574060 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95c2000640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95cc159df0 0x7f95cc153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95cb400640 1 -- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95cc159df0 msgr2=0x7f95cc153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95cb400640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95cc159df0 0x7f95cc153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95cb400640 1 -- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95cc0b3e50 msgr2=0x7f95cc06f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95cb400640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95cc0b3e50 0x7f95cc06f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95cb400640 1 -- 172.21.15.59:0/283574060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc15c080 con 0x7f95cc15a1d0 2024-05-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95cb400640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95cc15a1d0 0x7f95cc153d40 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f95c400c3c0 tx=0x7f95c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95c3400640 1 -- 172.21.15.59:0/283574060 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c40074e0 con 0x7f95cc15a1d0 2024-05-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95c3400640 1 -- 172.21.15.59:0/283574060 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c4007680 con 0x7f95cc15a1d0 2024-05-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95d1a00640 1 -- 172.21.15.59:0/283574060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95cc06dd30 con 0x7f95cc15a1d0 2024-05-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95c3400640 1 -- 172.21.15.59:0/283574060 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4004a10 con 0x7f95cc15a1d0 2024-05-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.457+0000 7f95d1a00640 1 -- 172.21.15.59:0/283574060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95cc15bda0 con 0x7f95cc15a1d0 2024-05-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.461+0000 7f95d1a00640 1 -- 172.21.15.59:0/283574060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95cc068a90 con 0x7f95cc15a1d0 2024-05-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.461+0000 7f95c3400640 1 -- 172.21.15.59:0/283574060 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f95c401a020 con 0x7f95cc15a1d0 2024-05-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.461+0000 7f95c3400640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f95a8069fa0 0x7f95a806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.461+0000 7f95c3400640 1 -- 172.21.15.59:0/283574060 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5055+0+0 (secure 0 0 0) 0x7f95c4084ea0 con 0x7f95cc15a1d0 2024-05-30T17:04:20.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.461+0000 7f95caa00640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f95a8069fa0 0x7f95a806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:20.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.461+0000 7f95caa00640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f95a8069fa0 0x7f95a806c460 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f95bc003ab0 tx=0x7f95bc009830 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.465+0000 7f95c3400640 1 -- 172.21.15.59:0/283574060 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f95cc15c080 con 0x7f95cc15a1d0 2024-05-30T17:04:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:20.689+0000 7f95d1a00640 1 -- 172.21.15.59:0/283574060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_7_clones_are_cancelled"]} v 0) -- 0x7f95cc0b4ef0 con 0x7f95cc15a1d0 2024-05-30T17:04:21.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.589+0000 7f95c3400640 1 -- 172.21.15.59:0/283574060 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_7_clones_are_cancelled"]}]=0 v689) ==== 166+0+0 (secure 0 0 0) 0x7f95c4056910 con 0x7f95cc15a1d0 2024-05-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.593+0000 7f95d1a00640 1 -- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f95a8069fa0 msgr2=0x7f95a806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.593+0000 7f95d1a00640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f95a8069fa0 0x7f95a806c460 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f95bc003ab0 tx=0x7f95bc009830 comp rx=0 tx=0).stop 2024-05-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.593+0000 7f95d1a00640 1 -- 172.21.15.59:0/283574060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95cc15a1d0 msgr2=0x7f95cc153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.593+0000 7f95d1a00640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95cc15a1d0 0x7f95cc153d40 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f95c400c3c0 tx=0x7f95c400c880 comp rx=0 tx=0).stop 2024-05-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.593+0000 7f95d1a00640 1 -- 172.21.15.59:0/283574060 shutdown_connections 2024-05-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.593+0000 7f95d1a00640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f95a8069fa0 0x7f95a806c460 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.593+0000 7f95d1a00640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95cc15a1d0 0x7f95cc153d40 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.593+0000 7f95d1a00640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95cc159df0 0x7f95cc153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.593+0000 7f95d1a00640 1 --2- 172.21.15.59:0/283574060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95cc0b3e50 0x7f95cc06f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.593+0000 7f95d1a00640 1 -- 172.21.15.59:0/283574060 >> 172.21.15.59:0/283574060 conn(0x7f95cc0b22d0 msgr2=0x7f95cc154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.593+0000 7f95d1a00640 1 -- 172.21.15.59:0/283574060 shutdown_connections 2024-05-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.593+0000 7f95d1a00640 1 -- 172.21.15.59:0/283574060 wait complete. 2024-05-30T17:04:21.617 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T17:04:21.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.765+0000 7f0dc8a00640 1 Processor -- start 2024-05-30T17:04:21.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.765+0000 7f0dc8a00640 1 -- start start 2024-05-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.765+0000 7f0dc8a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dc40b44e0 0x7f0dc415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.765+0000 7f0dc8a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0dc415f510 0x7f0dc415c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.765+0000 7f0dc8a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dc40b52d0 con 0x7f0dc4159100 2024-05-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.765+0000 7f0dc8a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc40b4a30 con 0x7f0dc40b44e0 2024-05-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.765+0000 7f0dc8a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc40b4d10 con 0x7f0dc415f510 2024-05-30T17:04:21.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0db9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dc40b44e0 0x7f0dc415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:21.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0db9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dc40b44e0 0x7f0dc415efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50770/0 (socket says 172.21.15.59:50770) 2024-05-30T17:04:21.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0db9400640 1 -- 172.21.15.59:0/3180884337 learned_addr learned my addr 172.21.15.59:0/3180884337 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:21.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0dc2800640 1 --2- 172.21.15.59:0/3180884337 >> v2:172.21.15.107:3300/0 conn(0x7f0dc415f510 0x7f0dc415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:21.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0db9400640 1 -- 172.21.15.59:0/3180884337 >> v2:172.21.15.107:3300/0 conn(0x7f0dc415f510 msgr2=0x7f0dc415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:21.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0db9400640 1 --2- 172.21.15.59:0/3180884337 >> v2:172.21.15.107:3300/0 conn(0x7f0dc415f510 0x7f0dc415c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0db9400640 1 -- 172.21.15.59:0/3180884337 >> v1:172.21.15.107:6789/0 conn(0x7f0dc4159100 legacy=0x7f0dc406e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:21.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0db9400640 1 -- 172.21.15.59:0/3180884337 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc40b4ff0 con 0x7f0dc40b44e0 2024-05-30T17:04:21.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0dc2800640 1 --2- 172.21.15.59:0/3180884337 >> v2:172.21.15.107:3300/0 conn(0x7f0dc415f510 0x7f0dc415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:21.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0db9400640 1 --2- 172.21.15.59:0/3180884337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc40b44e0 0x7f0dc415efd0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4160040 tx=0x7f0db401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee66f6a619fe04a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:21.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0dc1400640 1 -- 172.21.15.59:0/3180884337 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40b0070 con 0x7f0dc40b44e0 2024-05-30T17:04:21.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0dc1400640 1 -- 172.21.15.59:0/3180884337 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db40ab600 con 0x7f0dc40b44e0 2024-05-30T17:04:21.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.769+0000 7f0dc1400640 1 -- 172.21.15.59:0/3180884337 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40ab9d0 con 0x7f0dc40b44e0 2024-05-30T17:04:21.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 -- 172.21.15.59:0/3180884337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc40b44e0 msgr2=0x7f0dc415efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:21.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 --2- 172.21.15.59:0/3180884337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc40b44e0 0x7f0dc415efd0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4160040 tx=0x7f0db401c420 comp rx=0 tx=0).stop 2024-05-30T17:04:21.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 -- 172.21.15.59:0/3180884337 shutdown_connections 2024-05-30T17:04:21.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 --2- 172.21.15.59:0/3180884337 >> v2:172.21.15.107:3300/0 conn(0x7f0dc415f510 0x7f0dc415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 --2- 172.21.15.59:0/3180884337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc40b44e0 0x7f0dc415efd0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 -- 172.21.15.59:0/3180884337 >> 172.21.15.59:0/3180884337 conn(0x7f0dc406bdb0 msgr2=0x7f0dc406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:21.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 -- 172.21.15.59:0/3180884337 shutdown_connections 2024-05-30T17:04:21.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 -- 172.21.15.59:0/3180884337 wait complete. 2024-05-30T17:04:21.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 Processor -- start 2024-05-30T17:04:21.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 -- start start 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dc40b44e0 0x7f0dc4159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc4159100 0x7f0dc40cf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dc415f510 0x7f0dc415afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc41684d0 con 0x7f0dc4159100 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc4168350 con 0x7f0dc40b44e0 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc8a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc4168650 con 0x7f0dc415f510 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0db9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc4159100 0x7f0dc40cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0db9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc4159100 0x7f0dc40cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50784/0 (socket says 172.21.15.59:50784) 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0db9400640 1 -- 172.21.15.59:0/2174028937 learned_addr learned my addr 172.21.15.59:0/2174028937 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc1e00640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dc40b44e0 0x7f0dc4159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc2800640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dc415f510 0x7f0dc415afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0db9400640 1 -- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dc415f510 msgr2=0x7f0dc415afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0db9400640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dc415f510 0x7f0dc415afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0db9400640 1 -- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dc40b44e0 msgr2=0x7f0dc4159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0db9400640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dc40b44e0 0x7f0dc4159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0db9400640 1 -- 172.21.15.59:0/2174028937 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc406f0a0 con 0x7f0dc4159100 2024-05-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0dc2800640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dc415f510 0x7f0dc415afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.773+0000 7f0db9400640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc4159100 0x7f0dc40cf420 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f0db401aad0 tx=0x7f0db40191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.777+0000 7f0dbaa00640 1 -- 172.21.15.59:0/2174028937 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40b0040 con 0x7f0dc4159100 2024-05-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.777+0000 7f0dbaa00640 1 -- 172.21.15.59:0/2174028937 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db40b9070 con 0x7f0dc4159100 2024-05-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.777+0000 7f0dc8a00640 1 -- 172.21.15.59:0/2174028937 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc40ce660 con 0x7f0dc4159100 2024-05-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.777+0000 7f0dbaa00640 1 -- 172.21.15.59:0/2174028937 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40b38c0 con 0x7f0dc4159100 2024-05-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.777+0000 7f0dc8a00640 1 -- 172.21.15.59:0/2174028937 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc40cec20 con 0x7f0dc4159100 2024-05-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.777+0000 7f0dc8a00640 1 -- 172.21.15.59:0/2174028937 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc4068a90 con 0x7f0dc4159100 2024-05-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.777+0000 7f0dbaa00640 1 -- 172.21.15.59:0/2174028937 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f0db40b3a60 con 0x7f0dc4159100 2024-05-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.777+0000 7f0dbaa00640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0da0069fa0 0x7f0da006c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.777+0000 7f0dbaa00640 1 -- 172.21.15.59:0/2174028937 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5055+0+0 (secure 0 0 0) 0x7f0db411f890 con 0x7f0dc4159100 2024-05-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.777+0000 7f0dc1e00640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0da0069fa0 0x7f0da006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.781+0000 7f0dc1e00640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0da0069fa0 0x7f0da006c460 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0dac007fd0 tx=0x7f0dac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:21.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.781+0000 7f0dbaa00640 1 -- 172.21.15.59:0/2174028937 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0db40160d0 con 0x7f0dc4159100 2024-05-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.949+0000 7f0dc8a00640 1 -- 172.21.15.59:0/2174028937 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0dc406ee60 con 0x7f0dc4159100 2024-05-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dbaa00640 1 -- 172.21.15.59:0/2174028937 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f0db40f18b0 con 0x7f0dc4159100 2024-05-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dc8a00640 1 -- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0da0069fa0 msgr2=0x7f0da006c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dc8a00640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0da0069fa0 0x7f0da006c460 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0dac007fd0 tx=0x7f0dac009040 comp rx=0 tx=0).stop 2024-05-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dc8a00640 1 -- 172.21.15.59:0/2174028937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc4159100 msgr2=0x7f0dc40cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dc8a00640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc4159100 0x7f0dc40cf420 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f0db401aad0 tx=0x7f0db40191c0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dc8a00640 1 -- 172.21.15.59:0/2174028937 shutdown_connections 2024-05-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dc8a00640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0da0069fa0 0x7f0da006c460 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dc8a00640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0dc415f510 0x7f0dc415afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dc8a00640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc4159100 0x7f0dc40cf420 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dc8a00640 1 --2- 172.21.15.59:0/2174028937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dc40b44e0 0x7f0dc4159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dc8a00640 1 -- 172.21.15.59:0/2174028937 >> 172.21.15.59:0/2174028937 conn(0x7f0dc406bdb0 msgr2=0x7f0dc406e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dc8a00640 1 -- 172.21.15.59:0/2174028937 shutdown_connections 2024-05-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:21.953+0000 7f0dc8a00640 1 -- 172.21.15.59:0/2174028937 wait complete. 2024-05-30T17:04:21.975 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T17:04:21.975 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T17:04:22.082 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T17:04:22.168 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T17:04:22.168 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:04:22.168 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:04:22.177 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T17:04:22.177 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:04:22.177 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:04:22.187 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:04:22.187 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:04:22.187 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:04:22.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T17:04:22.227 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:04:22.227 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:04:22.238 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:04:22.238 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T17:04:22.238 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:04:22.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc310200640 1 Processor -- start 2024-05-30T17:04:22.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc310200640 1 -- start start 2024-05-30T17:04:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc310200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc3080ad8c0 0x7fc30815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc310200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc30815a1d0 0x7fc30815cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc310200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc30815d730 con 0x7fc308159df0 2024-05-30T17:04:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc310200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc30815d4f0 con 0x7fc3080ad8c0 2024-05-30T17:04:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc310200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc3080b3370 con 0x7fc30815a1d0 2024-05-30T17:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc30d800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc308159df0 0x7fc3080ad1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41058/0 (socket says 172.21.15.59:41058) 2024-05-30T17:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc30d800640 1 -- 172.21.15.59:0/964130249 learned_addr learned my addr 172.21.15.59:0/964130249 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc30ce00640 1 --2- 172.21.15.59:0/964130249 >> v2:172.21.15.107:3300/0 conn(0x7fc3080ad8c0 0x7fc30815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc30e200640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc30815a1d0 0x7fc30815cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1434640982 0 0) 0x7fc30815d730 con 0x7fc308159df0 2024-05-30T17:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2f0003530 con 0x7fc308159df0 2024-05-30T17:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2341142850 0 0) 0x7fc2f0003530 con 0x7fc308159df0 2024-05-30T17:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc30815a1d0 msgr2=0x7fc30815cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc307e00640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc30815a1d0 0x7fc30815cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 >> v2:172.21.15.107:3300/0 conn(0x7fc3080ad8c0 msgr2=0x7fc30815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc307e00640 1 --2- 172.21.15.59:0/964130249 >> v2:172.21.15.107:3300/0 conn(0x7fc3080ad8c0 0x7fc30815ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3080b3650 con 0x7fc308159df0 2024-05-30T17:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fc2fc001a00 con 0x7fc308159df0 2024-05-30T17:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.413+0000 7fc30e200640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc30815a1d0 0x7fc30815cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 >> v1:172.21.15.59:6789/0 conn(0x7fc308159df0 legacy=0x7fc3080ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc307e00640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2f00039c0 0x7fc2f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc307e00640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc30815a1d0 0x7fc2f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc307e00640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2f0004d50 0x7fc2f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc30815d4f0 con 0x7fc2f00039c0 2024-05-30T17:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc3080b3370 con 0x7fc2f0004d50 2024-05-30T17:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f000b9d0 con 0x7fc30815a1d0 2024-05-30T17:04:22.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc30d800640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2f00039c0 0x7fc2f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc30ce00640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc30815a1d0 0x7fc2f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc30e200640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2f0004d50 0x7fc2f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc30d800640 1 -- 172.21.15.59:0/964130249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc30815a1d0 msgr2=0x7fc2f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:22.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc30d800640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc30815a1d0 0x7fc2f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc30d800640 1 -- 172.21.15.59:0/964130249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2f0004d50 msgr2=0x7fc2f00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:22.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc30d800640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2f0004d50 0x7fc2f00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc30d800640 1 -- 172.21.15.59:0/964130249 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f0003530 con 0x7fc2f00039c0 2024-05-30T17:04:22.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc30d800640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2f00039c0 0x7fc2f0003de0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00a880 tx=0x7fc2fc01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353e852162335a19 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:22.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc00a4a0 con 0x7fc2f00039c0 2024-05-30T17:04:22.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2fc0ad650 con 0x7fc2f00039c0 2024-05-30T17:04:22.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.417+0000 7fc307e00640 1 -- 172.21.15.59:0/964130249 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0ada40 con 0x7fc2f00039c0 2024-05-30T17:04:22.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 -- 172.21.15.59:0/964130249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2f00039c0 msgr2=0x7fc2f0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:22.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 --2- 172.21.15.59:0/964130249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2f00039c0 0x7fc2f0003de0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00a880 tx=0x7fc2fc01d3a0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc30e200640 1 -- 172.21.15.59:0/964130249 reap_dead start 2024-05-30T17:04:22.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 -- 172.21.15.59:0/964130249 shutdown_connections 2024-05-30T17:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 -- 172.21.15.59:0/964130249 >> 172.21.15.59:0/964130249 conn(0x7fc3080b22d0 msgr2=0x7fc3080b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 -- 172.21.15.59:0/964130249 shutdown_connections 2024-05-30T17:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 -- 172.21.15.59:0/964130249 wait complete. 2024-05-30T17:04:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 Processor -- start 2024-05-30T17:04:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 -- start start 2024-05-30T17:04:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2f00039c0 0x7fc3081500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc308153fe0 0x7fc30814d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc308154460 0x7fc30814c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc30815e720 con 0x7fc308153fe0 2024-05-30T17:04:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc30815e5a0 con 0x7fc2f00039c0 2024-05-30T17:04:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc310200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc30815e8a0 con 0x7fc308154460 2024-05-30T17:04:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc30ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc308153fe0 0x7fc30814d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc30ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc308153fe0 0x7fc30814d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43158/0 (socket says 172.21.15.59:43158) 2024-05-30T17:04:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc30d800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2f00039c0 0x7fc3081500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc30ce00640 1 -- 172.21.15.59:0/1980864626 learned_addr learned my addr 172.21.15.59:0/1980864626 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.421+0000 7fc30e200640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc308154460 0x7fc30814c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc30ce00640 1 -- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc308154460 msgr2=0x7fc30814c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:22.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc30ce00640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc308154460 0x7fc30814c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc30ce00640 1 -- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2f00039c0 msgr2=0x7fc3081500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:22.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc30ce00640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2f00039c0 0x7fc3081500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc30ce00640 1 -- 172.21.15.59:0/1980864626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc308150fa0 con 0x7fc308153fe0 2024-05-30T17:04:22.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc30ce00640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc308153fe0 0x7fc30814d460 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4011aa0 tx=0x7fc2f4011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:22.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc305600640 1 -- 172.21.15.59:0/1980864626 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400fb80 con 0x7fc308153fe0 2024-05-30T17:04:22.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc305600640 1 -- 172.21.15.59:0/1980864626 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f400fd20 con 0x7fc308153fe0 2024-05-30T17:04:22.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc310200640 1 -- 172.21.15.59:0/1980864626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc308151280 con 0x7fc308153fe0 2024-05-30T17:04:22.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc305600640 1 -- 172.21.15.59:0/1980864626 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4014680 con 0x7fc308153fe0 2024-05-30T17:04:22.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc310200640 1 -- 172.21.15.59:0/1980864626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc308151840 con 0x7fc308153fe0 2024-05-30T17:04:22.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc310200640 1 -- 172.21.15.59:0/1980864626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc308068a90 con 0x7fc308153fe0 2024-05-30T17:04:22.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc305600640 1 -- 172.21.15.59:0/1980864626 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fc2f4012040 con 0x7fc308153fe0 2024-05-30T17:04:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc305600640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc2e8069fd0 0x7fc2e806c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc305600640 1 -- 172.21.15.59:0/1980864626 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5055+0+0 (secure 0 0 0) 0x7fc2f4085e90 con 0x7fc308153fe0 2024-05-30T17:04:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.425+0000 7fc30d800640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc2e8069fd0 0x7fc2e806c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.429+0000 7fc30d800640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc2e8069fd0 0x7fc2e806c490 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0ad000 tx=0x7fc30815d900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:22.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.429+0000 7fc305600640 1 -- 172.21.15.59:0/1980864626 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc2f4019030 con 0x7fc308153fe0 2024-05-30T17:04:22.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.629+0000 7fc310200640 1 -- 172.21.15.59:0/1980864626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc30815b090 con 0x7fc308153fe0 2024-05-30T17:04:22.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc305600640 1 -- 172.21.15.59:0/1980864626 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+3875 (secure 0 0 0) 0x7fc2f4057860 con 0x7fc308153fe0 2024-05-30T17:04:22.632 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:22.632 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":74,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3022278523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3022278523},{"type":"v1","addr":"172.21.15.59:6835","nonce":3022278523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2843818914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2843818914},{"type":"v1","addr":"172.21.15.107:6837","nonce":2843818914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7750,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3415278570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3415278570},{"type":"v1","addr":"172.21.15.107:6836","nonce":3415278570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":8907,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3262283364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3262283364},{"type":"v1","addr":"172.21.15.59:6834","nonce":3262283364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[]} 2024-05-30T17:04:22.632 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 74 2024-05-30T17:04:22.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc310200640 1 -- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc2e8069fd0 msgr2=0x7fc2e806c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:22.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc310200640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc2e8069fd0 0x7fc2e806c490 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0ad000 tx=0x7fc30815d900 comp rx=0 tx=0).stop 2024-05-30T17:04:22.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc310200640 1 -- 172.21.15.59:0/1980864626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc308153fe0 msgr2=0x7fc30814d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:22.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc310200640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc308153fe0 0x7fc30814d460 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4011aa0 tx=0x7fc2f4011f60 comp rx=0 tx=0).stop 2024-05-30T17:04:22.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc310200640 1 -- 172.21.15.59:0/1980864626 shutdown_connections 2024-05-30T17:04:22.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc310200640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc2e8069fd0 0x7fc2e806c490 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc310200640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc308154460 0x7fc30814c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc310200640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc308153fe0 0x7fc30814d460 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc310200640 1 --2- 172.21.15.59:0/1980864626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2f00039c0 0x7fc3081500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc310200640 1 -- 172.21.15.59:0/1980864626 >> 172.21.15.59:0/1980864626 conn(0x7fc3080b22d0 msgr2=0x7fc3080b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:22.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc310200640 1 -- 172.21.15.59:0/1980864626 shutdown_connections 2024-05-30T17:04:22.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.633+0000 7fc310200640 1 -- 172.21.15.59:0/1980864626 wait complete. 2024-05-30T17:04:22.654 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T17:04:22.654 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T17:04:22.655 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T17:04:22.655 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:04:22.655 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T17:04:22.655 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T17:04:22.655 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T17:04:22.655 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:04:22.655 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T17:04:22.656 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T17:04:22.656 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T17:04:22.656 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:04:22.656 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T17:04:22.656 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T17:04:22.656 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T17:04:22.656 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:04:22.668 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T17:04:22.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T17:04:22.669 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T17:04:22.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T17:04:22.670 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T17:04:22.670 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T17:04:22.671 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T17:04:22.672 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T17:04:22.714 INFO:tasks.ceph.mds.a:Started 2024-05-30T17:04:22.714 DEBUG:teuthology.parallel:result is None 2024-05-30T17:04:22.715 INFO:tasks.ceph.mds.b:Started 2024-05-30T17:04:22.715 DEBUG:teuthology.parallel:result is None 2024-05-30T17:04:22.716 INFO:tasks.ceph.mds.c:Started 2024-05-30T17:04:22.716 DEBUG:teuthology.parallel:result is None 2024-05-30T17:04:22.717 INFO:tasks.ceph.mds.d:Started 2024-05-30T17:04:22.717 DEBUG:teuthology.parallel:result is None 2024-05-30T17:04:22.718 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T17:04:22.800 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-05-30T17:04:22.801 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-05-30T17:04:22.805 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-30T17:04:22.806 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-30T17:04:22.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd99200640 1 Processor -- start 2024-05-30T17:04:22.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd99200640 1 -- start start 2024-05-30T17:04:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd99200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd940d14c0 0x7efd9406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd99200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efd940d05b0 0x7efd9409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd99200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9406ea20 con 0x7efd9409af80 2024-05-30T17:04:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd99200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7efd9409b3f0 con 0x7efd940d14c0 2024-05-30T17:04:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd99200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7efd94070950 con 0x7efd940d05b0 2024-05-30T17:04:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd91e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd940d14c0 0x7efd9406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd91e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd940d14c0 0x7efd9406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43212/0 (socket says 172.21.15.59:43212) 2024-05-30T17:04:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd91e00640 1 -- 172.21.15.59:0/2293909175 learned_addr learned my addr 172.21.15.59:0/2293909175 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:22.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd89400640 1 --2- 172.21.15.59:0/2293909175 >> v2:172.21.15.107:3300/0 conn(0x7efd940d05b0 0x7efd9409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd91e00640 1 -- 172.21.15.59:0/2293909175 >> v2:172.21.15.107:3300/0 conn(0x7efd940d05b0 msgr2=0x7efd9409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:22.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd91e00640 1 --2- 172.21.15.59:0/2293909175 >> v2:172.21.15.107:3300/0 conn(0x7efd940d05b0 0x7efd9409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd91e00640 1 -- 172.21.15.59:0/2293909175 >> v1:172.21.15.107:6789/0 conn(0x7efd9409af80 legacy=0x7efd94162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:22.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.865+0000 7efd91e00640 1 -- 172.21.15.59:0/2293909175 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd94070c30 con 0x7efd940d14c0 2024-05-30T17:04:22.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.869+0000 7efd91e00640 1 --2- 172.21.15.59:0/2293909175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd940d14c0 0x7efd9406e4e0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7efd94072190 tx=0x7efd8401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03b429fa43c98bf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:22.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.869+0000 7efd91400640 1 -- 172.21.15.59:0/2293909175 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840ab610 con 0x7efd940d14c0 2024-05-30T17:04:22.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.869+0000 7efd91400640 1 -- 172.21.15.59:0/2293909175 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd840b0070 con 0x7efd940d14c0 2024-05-30T17:04:22.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.869+0000 7efd91400640 1 -- 172.21.15.59:0/2293909175 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840ab9d0 con 0x7efd940d14c0 2024-05-30T17:04:22.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.869+0000 7efd99200640 1 -- 172.21.15.59:0/2293909175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd940d14c0 msgr2=0x7efd9406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:22.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.869+0000 7efd99200640 1 --2- 172.21.15.59:0/2293909175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd940d14c0 0x7efd9406e4e0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7efd94072190 tx=0x7efd8401c4f0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.869+0000 7efd99200640 1 -- 172.21.15.59:0/2293909175 shutdown_connections 2024-05-30T17:04:22.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.869+0000 7efd99200640 1 --2- 172.21.15.59:0/2293909175 >> v2:172.21.15.107:3300/0 conn(0x7efd940d05b0 0x7efd9409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.869+0000 7efd99200640 1 --2- 172.21.15.59:0/2293909175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd940d14c0 0x7efd9406e4e0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.869+0000 7efd99200640 1 -- 172.21.15.59:0/2293909175 >> 172.21.15.59:0/2293909175 conn(0x7efd940b3f80 msgr2=0x7efd940b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:22.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.869+0000 7efd99200640 1 -- 172.21.15.59:0/2293909175 shutdown_connections 2024-05-30T17:04:22.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.869+0000 7efd99200640 1 -- 172.21.15.59:0/2293909175 wait complete. 2024-05-30T17:04:22.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd99200640 1 Processor -- start 2024-05-30T17:04:22.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd99200640 1 -- start start 2024-05-30T17:04:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd99200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd9409af80 0x7efd94157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd99200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd940d05b0 0x7efd94155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd99200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd940d14c0 0x7efd941585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd99200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd940d09c0 con 0x7efd940d05b0 2024-05-30T17:04:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd99200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efd940d18a0 con 0x7efd940d14c0 2024-05-30T17:04:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd99200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efd940d0b40 con 0x7efd9409af80 2024-05-30T17:04:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd89400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd940d05b0 0x7efd94155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd89400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd940d05b0 0x7efd94155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43224/0 (socket says 172.21.15.59:43224) 2024-05-30T17:04:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd89400640 1 -- 172.21.15.59:0/418231017 learned_addr learned my addr 172.21.15.59:0/418231017 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd91e00640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd9409af80 0x7efd94157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd92800640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd940d14c0 0x7efd941585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd89400640 1 -- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd9409af80 msgr2=0x7efd94157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd89400640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd9409af80 0x7efd94157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd89400640 1 -- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd940d14c0 msgr2=0x7efd941585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:22.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd89400640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd940d14c0 0x7efd941585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:22.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd89400640 1 -- 172.21.15.59:0/418231017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd941612d0 con 0x7efd940d05b0 2024-05-30T17:04:22.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd92800640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd940d14c0 0x7efd941585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:22.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd89400640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd940d05b0 0x7efd94155990 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00e8a0 tx=0x7efd7c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:22.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd8aa00640 1 -- 172.21.15.59:0/418231017 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c017070 con 0x7efd940d05b0 2024-05-30T17:04:22.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd8aa00640 1 -- 172.21.15.59:0/418231017 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7c00c940 con 0x7efd940d05b0 2024-05-30T17:04:22.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd8aa00640 1 -- 172.21.15.59:0/418231017 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c00ccf0 con 0x7efd940d05b0 2024-05-30T17:04:22.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd99200640 1 -- 172.21.15.59:0/418231017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd941561e0 con 0x7efd940d05b0 2024-05-30T17:04:22.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd99200640 1 -- 172.21.15.59:0/418231017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd941567a0 con 0x7efd940d05b0 2024-05-30T17:04:22.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.873+0000 7efd99200640 1 -- 172.21.15.59:0/418231017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd94068a90 con 0x7efd940d05b0 2024-05-30T17:04:22.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.877+0000 7efd8aa00640 1 -- 172.21.15.59:0/418231017 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7efd7c01a070 con 0x7efd940d05b0 2024-05-30T17:04:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.877+0000 7efd8aa00640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd70069fa0 0x7efd7006c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.877+0000 7efd8aa00640 1 -- 172.21.15.59:0/418231017 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5055+0+0 (secure 0 0 0) 0x7efd7c085780 con 0x7efd940d05b0 2024-05-30T17:04:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.877+0000 7efd91e00640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd70069fa0 0x7efd7006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.877+0000 7efd91e00640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd70069fa0 0x7efd7006c460 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7efd840af000 tx=0x7efd840a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:22.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:22.881+0000 7efd8aa00640 1 -- 172.21.15.59:0/418231017 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd7c057150 con 0x7efd940d05b0 2024-05-30T17:04:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.057+0000 7efd99200640 1 -- 172.21.15.59:0/418231017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7efd940b4be0 con 0x7efd940d05b0 2024-05-30T17:04:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.609+0000 7efd8aa00640 1 -- 172.21.15.59:0/418231017 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v125) ==== 97+0+0 (secure 0 0 0) 0x7efd7c05b450 con 0x7efd940d05b0 2024-05-30T17:04:23.609 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-05-30T17:04:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.613+0000 7efd99200640 1 -- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd70069fa0 msgr2=0x7efd7006c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.613+0000 7efd99200640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd70069fa0 0x7efd7006c460 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7efd840af000 tx=0x7efd840a7000 comp rx=0 tx=0).stop 2024-05-30T17:04:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.613+0000 7efd99200640 1 -- 172.21.15.59:0/418231017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd940d05b0 msgr2=0x7efd94155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.613+0000 7efd99200640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd940d05b0 0x7efd94155990 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00e8a0 tx=0x7efd7c00eca0 comp rx=0 tx=0).stop 2024-05-30T17:04:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.613+0000 7efd99200640 1 -- 172.21.15.59:0/418231017 shutdown_connections 2024-05-30T17:04:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.613+0000 7efd99200640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efd70069fa0 0x7efd7006c460 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.613+0000 7efd99200640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd940d14c0 0x7efd941585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.613+0000 7efd99200640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd940d05b0 0x7efd94155990 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.613+0000 7efd99200640 1 --2- 172.21.15.59:0/418231017 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd9409af80 0x7efd94157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.613+0000 7efd99200640 1 -- 172.21.15.59:0/418231017 >> 172.21.15.59:0/418231017 conn(0x7efd940b3f80 msgr2=0x7efd9415ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.613+0000 7efd99200640 1 -- 172.21.15.59:0/418231017 shutdown_connections 2024-05-30T17:04:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.613+0000 7efd99200640 1 -- 172.21.15.59:0/418231017 wait complete. 2024-05-30T17:04:23.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T17:04:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.777+0000 7fa7c2600640 1 Processor -- start 2024-05-30T17:04:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.777+0000 7fa7c2600640 1 -- start start 2024-05-30T17:04:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7c2600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7bc09aa40 0x7fa7bc15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7c2600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7bc09b530 0x7fa7bc0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7c2600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7bc0cce40 con 0x7fa7bc0b34b0 2024-05-30T17:04:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7c2600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa7bc0d0260 con 0x7fa7bc09b530 2024-05-30T17:04:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7c2600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa7bc0b3ba0 con 0x7fa7bc09aa40 2024-05-30T17:04:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7bbe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7bc09b530 0x7fa7bc0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7bb400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7bc09aa40 0x7fa7bc15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7bbe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7bc09b530 0x7fa7bc0cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:33900/0 (socket says 172.21.15.59:33900) 2024-05-30T17:04:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7bbe00640 1 -- 172.21.15.59:0/3049038211 learned_addr learned my addr 172.21.15.59:0/3049038211 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7bb400640 1 -- 172.21.15.59:0/3049038211 >> v2:172.21.15.107:3300/0 conn(0x7fa7bc09b530 msgr2=0x7fa7bc0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7bb400640 1 --2- 172.21.15.59:0/3049038211 >> v2:172.21.15.107:3300/0 conn(0x7fa7bc09b530 0x7fa7bc0cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:23.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7bb400640 1 -- 172.21.15.59:0/3049038211 >> v1:172.21.15.107:6789/0 conn(0x7fa7bc0b34b0 legacy=0x7fa7bc09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:23.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7bb400640 1 -- 172.21.15.59:0/3049038211 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc0ceac0 con 0x7fa7bc09aa40 2024-05-30T17:04:23.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.781+0000 7fa7bbe00640 1 --2- 172.21.15.59:0/3049038211 >> v2:172.21.15.107:3300/0 conn(0x7fa7bc09b530 0x7fa7bc0cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:04:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7bb400640 1 --2- 172.21.15.59:0/3049038211 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7bc09aa40 0x7fa7bc15e2e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0097c0 tx=0x7fa7ac01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23dac107ce034abe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7baa00640 1 -- 172.21.15.59:0/3049038211 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0ab430 con 0x7fa7bc09aa40 2024-05-30T17:04:23.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7baa00640 1 -- 172.21.15.59:0/3049038211 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ac0b0070 con 0x7fa7bc09aa40 2024-05-30T17:04:23.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7baa00640 1 -- 172.21.15.59:0/3049038211 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0ab7f0 con 0x7fa7bc09aa40 2024-05-30T17:04:23.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7c2600640 1 -- 172.21.15.59:0/3049038211 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7bc09aa40 msgr2=0x7fa7bc15e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:23.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7c2600640 1 --2- 172.21.15.59:0/3049038211 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7bc09aa40 0x7fa7bc15e2e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0097c0 tx=0x7fa7ac01c410 comp rx=0 tx=0).stop 2024-05-30T17:04:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7c2600640 1 -- 172.21.15.59:0/3049038211 shutdown_connections 2024-05-30T17:04:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7c2600640 1 --2- 172.21.15.59:0/3049038211 >> v2:172.21.15.107:3300/0 conn(0x7fa7bc09b530 0x7fa7bc0cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7c2600640 1 --2- 172.21.15.59:0/3049038211 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7bc09aa40 0x7fa7bc15e2e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7c2600640 1 -- 172.21.15.59:0/3049038211 >> 172.21.15.59:0/3049038211 conn(0x7fa7bc0b3f50 msgr2=0x7fa7bc0b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7c2600640 1 -- 172.21.15.59:0/3049038211 shutdown_connections 2024-05-30T17:04:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7c2600640 1 -- 172.21.15.59:0/3049038211 wait complete. 2024-05-30T17:04:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7c2600640 1 Processor -- start 2024-05-30T17:04:23.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.785+0000 7fa7c2600640 1 -- start start 2024-05-30T17:04:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7c2600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7bc09aa40 0x7fa7bc15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7c2600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc09b530 0x7fa7bc153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7c2600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7bc0b34b0 0x7fa7bc153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7c2600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1698c0 con 0x7fa7bc09b530 2024-05-30T17:04:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7c2600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc169a40 con 0x7fa7bc0b34b0 2024-05-30T17:04:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7c2600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa7bc169bc0 con 0x7fa7bc09aa40 2024-05-30T17:04:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc09b530 0x7fa7bc153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc09b530 0x7fa7bc153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43240/0 (socket says 172.21.15.59:43240) 2024-05-30T17:04:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3e00640 1 -- 172.21.15.59:0/3308857284 learned_addr learned my addr 172.21.15.59:0/3308857284 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7bbe00640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7bc0b34b0 0x7fa7bc153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7bb400640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7bc09aa40 0x7fa7bc15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3e00640 1 -- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7bc09aa40 msgr2=0x7fa7bc15bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3e00640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7bc09aa40 0x7fa7bc15bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3e00640 1 -- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7bc0b34b0 msgr2=0x7fa7bc153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3e00640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7bc0b34b0 0x7fa7bc153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3e00640 1 -- 172.21.15.59:0/3308857284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc1570c0 con 0x7fa7bc09b530 2024-05-30T17:04:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3e00640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc09b530 0x7fa7bc153020 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400c3a0 tx=0x7fa7a400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3400640 1 -- 172.21.15.59:0/3308857284 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40052d0 con 0x7fa7bc09b530 2024-05-30T17:04:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3400640 1 -- 172.21.15.59:0/3308857284 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a4005470 con 0x7fa7bc09b530 2024-05-30T17:04:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3400640 1 -- 172.21.15.59:0/3308857284 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4007260 con 0x7fa7bc09b530 2024-05-30T17:04:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7c2600640 1 -- 172.21.15.59:0/3308857284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7bc1573a0 con 0x7fa7bc09b530 2024-05-30T17:04:23.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7c2600640 1 -- 172.21.15.59:0/3308857284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7bc157960 con 0x7fa7bc09b530 2024-05-30T17:04:23.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7c2600640 1 -- 172.21.15.59:0/3308857284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7bc068a90 con 0x7fa7bc09b530 2024-05-30T17:04:23.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.789+0000 7fa7b3400640 1 -- 172.21.15.59:0/3308857284 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fa7a4007400 con 0x7fa7bc09b530 2024-05-30T17:04:23.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.793+0000 7fa7b3400640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa798069fa0 0x7fa79806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:23.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.793+0000 7fa7b3400640 1 -- 172.21.15.59:0/3308857284 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4969+0+0 (secure 0 0 0) 0x7fa7a4084de0 con 0x7fa7bc09b530 2024-05-30T17:04:23.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.793+0000 7fa7bb400640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa798069fa0 0x7fa79806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:23.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.793+0000 7fa7bb400640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa798069fa0 0x7fa79806c460 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0af000 tx=0x7fa7ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:23.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:23.797+0000 7fa7b3400640 1 -- 172.21.15.59:0/3308857284 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa7bc0cce40 con 0x7fa7bc09b530 2024-05-30T17:04:24.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.017+0000 7fa7c2600640 1 -- 172.21.15.59:0/3308857284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa7bc0b3270 con 0x7fa7bc09b530 2024-05-30T17:04:24.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.017+0000 7fa7b3400640 1 -- 172.21.15.59:0/3308857284 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7fa7a4056720 con 0x7fa7bc09b530 2024-05-30T17:04:24.018 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:24.018 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:04:24.018 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-05-30T17:04:24.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmAAjIJhAA5/FZHJtfSZuYcD6bEfCGDA==", 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmELVkMxAA/vOsM3Z0z4YEmUqoPtrPBQ==", 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:04:24.020 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:04:24.020 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:04:24.020 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.020 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.020 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-05-30T17:04:24.020 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmD2pGLhAAWmDw/02mc8T7upvRXnj1yw==", 2024-05-30T17:04:24.020 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.020 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:04:24.020 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmYLbYOhAAxggGfPZU/ryu+8vciSXjUw==", 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDJrVhmU0fpBhAA2tKWGJF24DlEjG+iuO4djg==", 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDMrVhmxE2HERAA4N9Bsb0fxl5GERpgyKCl6Q==", 2024-05-30T17:04:24.022 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.023 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:04:24.023 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:04:24.023 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.023 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.023 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-05-30T17:04:24.023 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDPrVhm6v7AGhAAqOQCN90pL0AmnXYIPIb48A==", 2024-05-30T17:04:24.023 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.023 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:04:24.023 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:04:24.023 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSrVhm3BEDJxAA4SOWC/qF90R9ivrCvN92ZA==", 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDYrVhmFzmDHhAAQtbXd6haolYB98wfEbpvTQ==", 2024-05-30T17:04:24.024 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDbrVhmHqkEKRAAKfFPdTqaVhBNnc5lKeEFpg==", 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDerVhm72bzMBAA+FfnxIOnkESuTervY23ruw==", 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDhrVhmXGv/OhAAr2k7IXDA9VDi9ZJwrQ+u6A==", 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-05-30T17:04:24.026 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA==", 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmncPjDBAAWEJOkxm9xfRjonO6U1hO6A==", 2024-05-30T17:04:24.027 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmvlFFCRAAZCq7ijfrVqy8Ukh7jKZESQ==", 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDGrVhmcpjuEhAA0q+PfNy0IWhqQSiIZuyBlg==", 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmnikpCxAA6Q4udmvjQXBmC4f1irI2Xg==", 2024-05-30T17:04:24.029 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhmWZq9IhAAFuEZeFiLGCitIiNARjoDTA==", 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-05-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDFrVhm0UKsHhAAimqtE18XjW/1vA7uMsJmEw==", 2024-05-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-05-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-05-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-05-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-05-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-05-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:04:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.021+0000 7fa7c2600640 1 -- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa798069fa0 msgr2=0x7fa79806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.021+0000 7fa7c2600640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa798069fa0 0x7fa79806c460 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0af000 tx=0x7fa7ac008040 comp rx=0 tx=0).stop 2024-05-30T17:04:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.021+0000 7fa7c2600640 1 -- 172.21.15.59:0/3308857284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc09b530 msgr2=0x7fa7bc153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.021+0000 7fa7c2600640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc09b530 0x7fa7bc153020 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400c3a0 tx=0x7fa7a400c860 comp rx=0 tx=0).stop 2024-05-30T17:04:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.021+0000 7fa7c2600640 1 -- 172.21.15.59:0/3308857284 shutdown_connections 2024-05-30T17:04:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.021+0000 7fa7c2600640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa798069fa0 0x7fa79806c460 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.021+0000 7fa7c2600640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7bc0b34b0 0x7fa7bc153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.021+0000 7fa7c2600640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc09b530 0x7fa7bc153020 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.021+0000 7fa7c2600640 1 --2- 172.21.15.59:0/3308857284 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7bc09aa40 0x7fa7bc15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.021+0000 7fa7c2600640 1 -- 172.21.15.59:0/3308857284 >> 172.21.15.59:0/3308857284 conn(0x7fa7bc0b3f50 msgr2=0x7fa7bc06dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.021+0000 7fa7c2600640 1 -- 172.21.15.59:0/3308857284 shutdown_connections 2024-05-30T17:04:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.021+0000 7fa7c2600640 1 -- 172.21.15.59:0/3308857284 wait complete. 2024-05-30T17:04:24.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T17:04:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.181+0000 7f9f54000640 1 Processor -- start 2024-05-30T17:04:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.181+0000 7f9f54000640 1 -- start start 2024-05-30T17:04:24.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.181+0000 7f9f54000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f4c15e710 0x7f9f4c1614e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:24.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.181+0000 7f9f54000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f4c161ea0 0x7f9f4c0d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:24.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.181+0000 7f9f54000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f4c1627a0 con 0x7f9f4c161a20 2024-05-30T17:04:24.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.181+0000 7f9f54000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9f4c0d0660 con 0x7f9f4c15e710 2024-05-30T17:04:24.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.181+0000 7f9f54000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4c162a80 con 0x7f9f4c161ea0 2024-05-30T17:04:24.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.185+0000 7f9f51600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f4c15e710 0x7f9f4c1614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:24.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.185+0000 7f9f51600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f4c15e710 0x7f9f4c1614e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43254/0 (socket says 172.21.15.59:43254) 2024-05-30T17:04:24.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.185+0000 7f9f51600640 1 -- 172.21.15.59:0/2685639597 learned_addr learned my addr 172.21.15.59:0/2685639597 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:24.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.185+0000 7f9f52000640 1 --2- 172.21.15.59:0/2685639597 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f4c161ea0 0x7f9f4c0d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:24.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.185+0000 7f9f51600640 1 -- 172.21.15.59:0/2685639597 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f4c161ea0 msgr2=0x7f9f4c0d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:24.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.185+0000 7f9f51600640 1 --2- 172.21.15.59:0/2685639597 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f4c161ea0 0x7f9f4c0d11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.185+0000 7f9f51600640 1 -- 172.21.15.59:0/2685639597 >> v1:172.21.15.107:6789/0 conn(0x7f9f4c161a20 legacy=0x7f9f4c0d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:24.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.185+0000 7f9f51600640 1 -- 172.21.15.59:0/2685639597 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c162d60 con 0x7f9f4c15e710 2024-05-30T17:04:24.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.185+0000 7f9f51600640 1 --2- 172.21.15.59:0/2685639597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4c15e710 0x7f9f4c1614e0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009870 tx=0x7f9f4001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6457ab75de479c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:24.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.185+0000 7f9f4be00640 1 -- 172.21.15.59:0/2685639597 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f400b2070 con 0x7f9f4c15e710 2024-05-30T17:04:24.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.185+0000 7f9f4be00640 1 -- 172.21.15.59:0/2685639597 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f400a9070 con 0x7f9f4c15e710 2024-05-30T17:04:24.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.185+0000 7f9f4be00640 1 -- 172.21.15.59:0/2685639597 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f400ad880 con 0x7f9f4c15e710 2024-05-30T17:04:24.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 -- 172.21.15.59:0/2685639597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4c15e710 msgr2=0x7f9f4c1614e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:24.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 --2- 172.21.15.59:0/2685639597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4c15e710 0x7f9f4c1614e0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009870 tx=0x7f9f4001c560 comp rx=0 tx=0).stop 2024-05-30T17:04:24.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 -- 172.21.15.59:0/2685639597 shutdown_connections 2024-05-30T17:04:24.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 --2- 172.21.15.59:0/2685639597 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f4c161ea0 0x7f9f4c0d11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 --2- 172.21.15.59:0/2685639597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4c15e710 0x7f9f4c1614e0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 -- 172.21.15.59:0/2685639597 >> 172.21.15.59:0/2685639597 conn(0x7f9f4c0b3f50 msgr2=0x7f9f4c0b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:24.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 -- 172.21.15.59:0/2685639597 shutdown_connections 2024-05-30T17:04:24.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 -- 172.21.15.59:0/2685639597 wait complete. 2024-05-30T17:04:24.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 Processor -- start 2024-05-30T17:04:24.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 -- start start 2024-05-30T17:04:24.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f4c15e710 0x7f9f4c14ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:24.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4c161a20 0x7f9f4c14f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:24.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f4c161ea0 0x7f9f4c14f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:24.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c15fc80 con 0x7f9f4c161a20 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c15fb00 con 0x7f9f4c161ea0 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f54000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4c06d340 con 0x7f9f4c15e710 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f50c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4c161a20 0x7f9f4c14f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f50c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4c161a20 0x7f9f4c14f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43270/0 (socket says 172.21.15.59:43270) 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f50c00640 1 -- 172.21.15.59:0/3081361958 learned_addr learned my addr 172.21.15.59:0/3081361958 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f51600640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f4c15e710 0x7f9f4c14ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f52000640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f4c161ea0 0x7f9f4c14f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f50c00640 1 -- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f4c15e710 msgr2=0x7f9f4c14ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f50c00640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f4c15e710 0x7f9f4c14ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f50c00640 1 -- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f4c161ea0 msgr2=0x7f9f4c14f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f50c00640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f4c161ea0 0x7f9f4c14f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.189+0000 7f9f50c00640 1 -- 172.21.15.59:0/3081361958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c15af90 con 0x7f9f4c161a20 2024-05-30T17:04:24.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.193+0000 7f9f50c00640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4c161a20 0x7f9f4c14f1a0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800c420 tx=0x7f9f3800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:24.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.193+0000 7f9f49600640 1 -- 172.21.15.59:0/3081361958 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f380052d0 con 0x7f9f4c161a20 2024-05-30T17:04:24.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.193+0000 7f9f49600640 1 -- 172.21.15.59:0/3081361958 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f38005470 con 0x7f9f4c161a20 2024-05-30T17:04:24.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.193+0000 7f9f49600640 1 -- 172.21.15.59:0/3081361958 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38007260 con 0x7f9f4c161a20 2024-05-30T17:04:24.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.193+0000 7f9f54000640 1 -- 172.21.15.59:0/3081361958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4c0c76a0 con 0x7f9f4c161a20 2024-05-30T17:04:24.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.193+0000 7f9f54000640 1 -- 172.21.15.59:0/3081361958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f4c15b200 con 0x7f9f4c161a20 2024-05-30T17:04:24.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.193+0000 7f9f54000640 1 -- 172.21.15.59:0/3081361958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f4c068a90 con 0x7f9f4c161a20 2024-05-30T17:04:24.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.193+0000 7f9f49600640 1 -- 172.21.15.59:0/3081361958 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f9f38007400 con 0x7f9f4c161a20 2024-05-30T17:04:24.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.193+0000 7f9f49600640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f2c069fd0 0x7f9f2c06c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:24.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.193+0000 7f9f49600640 1 -- 172.21.15.59:0/3081361958 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4969+0+0 (secure 0 0 0) 0x7f9f38084d00 con 0x7f9f4c161a20 2024-05-30T17:04:24.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.193+0000 7f9f51600640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f2c069fd0 0x7f9f2c06c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:24.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.197+0000 7f9f51600640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f2c069fd0 0x7f9f2c06c490 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9f400af000 tx=0x7f9f400a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:24.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.197+0000 7f9f49600640 1 -- 172.21.15.59:0/3081361958 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f380566d0 con 0x7f9f4c161a20 2024-05-30T17:04:24.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 -- 172.21.15.59:0/3081361958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9f4c15df20 con 0x7f9f4c161a20 2024-05-30T17:04:24.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f49600640 1 -- 172.21.15.59:0/3081361958 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v127) ==== 84+0+65 (secure 0 0 0) 0x7f9f3805a9d0 con 0x7f9f4c161a20 2024-05-30T17:04:24.365 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:24.365 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:04:24.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:24.365 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-05-30T17:04:24.365 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-05-30T17:04:24.365 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:24.366 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:04:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 -- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f2c069fd0 msgr2=0x7f9f2c06c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f2c069fd0 0x7f9f2c06c490 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9f400af000 tx=0x7f9f400a7000 comp rx=0 tx=0).stop 2024-05-30T17:04:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 -- 172.21.15.59:0/3081361958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4c161a20 msgr2=0x7f9f4c14f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4c161a20 0x7f9f4c14f1a0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800c420 tx=0x7f9f3800c8e0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 -- 172.21.15.59:0/3081361958 shutdown_connections 2024-05-30T17:04:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9f2c069fd0 0x7f9f2c06c490 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f4c161ea0 0x7f9f4c14f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4c161a20 0x7f9f4c14f1a0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 --2- 172.21.15.59:0/3081361958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f4c15e710 0x7f9f4c14ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 -- 172.21.15.59:0/3081361958 >> 172.21.15.59:0/3081361958 conn(0x7f9f4c0b3f50 msgr2=0x7f9f4c070050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 -- 172.21.15.59:0/3081361958 shutdown_connections 2024-05-30T17:04:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.365+0000 7f9f54000640 1 -- 172.21.15.59:0/3081361958 wait complete. 2024-05-30T17:04:24.387 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T17:04:24.387 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T17:04:24.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.529+0000 7fd8fee00640 1 Processor -- start 2024-05-30T17:04:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fee00640 1 -- start start 2024-05-30T17:04:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fee00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd8f809aa40 0x7fd8f809b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8f80cd570 0x7fd8f80cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fee00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f80d1840 con 0x7fd8f80d1050 2024-05-30T17:04:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fee00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f80cca90 con 0x7fd8f809aa40 2024-05-30T17:04:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f80ccd70 con 0x7fd8f80cd570 2024-05-30T17:04:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fe400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8f80cd570 0x7fd8f80cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fda00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd8f809aa40 0x7fd8f809b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fe400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8f80cd570 0x7fd8f80cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:55078/0 (socket says 172.21.15.59:55078) 2024-05-30T17:04:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fe400640 1 -- 172.21.15.59:0/1279458799 learned_addr learned my addr 172.21.15.59:0/1279458799 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fe400640 1 -- 172.21.15.59:0/1279458799 >> v2:172.21.15.107:3300/0 conn(0x7fd8f809aa40 msgr2=0x7fd8f809b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fe400640 1 --2- 172.21.15.59:0/1279458799 >> v2:172.21.15.107:3300/0 conn(0x7fd8f809aa40 0x7fd8f809b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fe400640 1 -- 172.21.15.59:0/1279458799 >> v1:172.21.15.107:6789/0 conn(0x7fd8f80d1050 legacy=0x7fd8f809ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.533+0000 7fd8fe400640 1 -- 172.21.15.59:0/1279458799 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f80cd050 con 0x7fd8f80cd570 2024-05-30T17:04:24.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8fe400640 1 --2- 172.21.15.59:0/1279458799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8f80cd570 0x7fd8f80cda00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009e80 tx=0x7fd8f001f200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f53fc8e1883f4362 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:24.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8f7e00640 1 -- 172.21.15.59:0/1279458799 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00b4070 con 0x7fd8f80cd570 2024-05-30T17:04:24.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8f7e00640 1 -- 172.21.15.59:0/1279458799 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f00af400 con 0x7fd8f80cd570 2024-05-30T17:04:24.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8f7e00640 1 -- 172.21.15.59:0/1279458799 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00af7d0 con 0x7fd8f80cd570 2024-05-30T17:04:24.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8fee00640 1 -- 172.21.15.59:0/1279458799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8f80cd570 msgr2=0x7fd8f80cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:24.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8fee00640 1 --2- 172.21.15.59:0/1279458799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8f80cd570 0x7fd8f80cda00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009e80 tx=0x7fd8f001f200 comp rx=0 tx=0).stop 2024-05-30T17:04:24.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8fee00640 1 -- 172.21.15.59:0/1279458799 shutdown_connections 2024-05-30T17:04:24.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8fee00640 1 --2- 172.21.15.59:0/1279458799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8f80cd570 0x7fd8f80cda00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8fee00640 1 --2- 172.21.15.59:0/1279458799 >> v2:172.21.15.107:3300/0 conn(0x7fd8f809aa40 0x7fd8f809b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8fee00640 1 -- 172.21.15.59:0/1279458799 >> 172.21.15.59:0/1279458799 conn(0x7fd8f80b3db0 msgr2=0x7fd8f80b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:24.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8fee00640 1 -- 172.21.15.59:0/1279458799 shutdown_connections 2024-05-30T17:04:24.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8fee00640 1 -- 172.21.15.59:0/1279458799 wait complete. 2024-05-30T17:04:24.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.537+0000 7fd8fee00640 1 Processor -- start 2024-05-30T17:04:24.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fee00640 1 -- start start 2024-05-30T17:04:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f809aa40 0x7fd8f80ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f80cd570 0x7fd8f80b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8f80d1050 0x7fd8f80b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f80ce0c0 con 0x7fd8f809aa40 2024-05-30T17:04:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f80cdf40 con 0x7fd8f80cd570 2024-05-30T17:04:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f80ce240 con 0x7fd8f80d1050 2024-05-30T17:04:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f809aa40 0x7fd8f80ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f809aa40 0x7fd8f80ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43284/0 (socket says 172.21.15.59:43284) 2024-05-30T17:04:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fda00640 1 -- 172.21.15.59:0/1577140635 learned_addr learned my addr 172.21.15.59:0/1577140635 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fe400640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8f80d1050 0x7fd8f80b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fd000640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f80cd570 0x7fd8f80b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fda00640 1 -- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8f80d1050 msgr2=0x7fd8f80b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fda00640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8f80d1050 0x7fd8f80b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fda00640 1 -- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f80cd570 msgr2=0x7fd8f80b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fda00640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f80cd570 0x7fd8f80b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fda00640 1 -- 172.21.15.59:0/1577140635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f80b7800 con 0x7fd8f809aa40 2024-05-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fda00640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f809aa40 0x7fd8f80ca0f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00e930 tx=0x7fd8ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8f5600640 1 -- 172.21.15.59:0/1577140635 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec017070 con 0x7fd8f809aa40 2024-05-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8f5600640 1 -- 172.21.15.59:0/1577140635 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ec00ca00 con 0x7fd8f809aa40 2024-05-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8f5600640 1 -- 172.21.15.59:0/1577140635 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00cdb0 con 0x7fd8f809aa40 2024-05-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fee00640 1 -- 172.21.15.59:0/1577140635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f80c6040 con 0x7fd8f809aa40 2024-05-30T17:04:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fee00640 1 -- 172.21.15.59:0/1577140635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f80c6600 con 0x7fd8f809aa40 2024-05-30T17:04:24.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.541+0000 7fd8fee00640 1 -- 172.21.15.59:0/1577140635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f8068a90 con 0x7fd8f809aa40 2024-05-30T17:04:24.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.545+0000 7fd8f5600640 1 -- 172.21.15.59:0/1577140635 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fd8ec01a070 con 0x7fd8f809aa40 2024-05-30T17:04:24.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.545+0000 7fd8f5600640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd8d8069fa0 0x7fd8d806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:24.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.545+0000 7fd8f5600640 1 -- 172.21.15.59:0/1577140635 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4969+0+0 (secure 0 0 0) 0x7fd8ec085ce0 con 0x7fd8f809aa40 2024-05-30T17:04:24.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.545+0000 7fd8fd000640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd8d8069fa0 0x7fd8d806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:24.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.545+0000 7fd8fd000640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd8d8069fa0 0x7fd8d806c460 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80b63b0 tx=0x7fd8e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:24.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.549+0000 7fd8f5600640 1 -- 172.21.15.59:0/1577140635 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd8ec0576f0 con 0x7fd8f809aa40 2024-05-30T17:04:24.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:24.717+0000 7fd8fee00640 1 -- 172.21.15.59:0/1577140635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd8f80d0de0 con 0x7fd8f809aa40 2024-05-30T17:04:25.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.617+0000 7fd8f5600640 1 -- 172.21.15.59:0/1577140635 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v128) ==== 138+0+0 (secure 0 0 0) 0x7fd8ec05b9f0 con 0x7fd8f809aa40 2024-05-30T17:04:25.620 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-05-30T17:04:25.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.621+0000 7fd8fee00640 1 -- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd8d8069fa0 msgr2=0x7fd8d806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:25.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.621+0000 7fd8fee00640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd8d8069fa0 0x7fd8d806c460 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80b63b0 tx=0x7fd8e4009040 comp rx=0 tx=0).stop 2024-05-30T17:04:25.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.621+0000 7fd8fee00640 1 -- 172.21.15.59:0/1577140635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f809aa40 msgr2=0x7fd8f80ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:25.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.621+0000 7fd8fee00640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f809aa40 0x7fd8f80ca0f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00e930 tx=0x7fd8ec00edf0 comp rx=0 tx=0).stop 2024-05-30T17:04:25.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.621+0000 7fd8fee00640 1 -- 172.21.15.59:0/1577140635 shutdown_connections 2024-05-30T17:04:25.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.621+0000 7fd8fee00640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd8d8069fa0 0x7fd8d806c460 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:25.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.621+0000 7fd8fee00640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8f80d1050 0x7fd8f80b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:25.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.621+0000 7fd8fee00640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f80cd570 0x7fd8f80b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:25.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.621+0000 7fd8fee00640 1 --2- 172.21.15.59:0/1577140635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f809aa40 0x7fd8f80ca0f0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:25.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.621+0000 7fd8fee00640 1 -- 172.21.15.59:0/1577140635 >> 172.21.15.59:0/1577140635 conn(0x7fd8f80b3db0 msgr2=0x7fd8f8070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:25.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.621+0000 7fd8fee00640 1 -- 172.21.15.59:0/1577140635 shutdown_connections 2024-05-30T17:04:25.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.621+0000 7fd8fee00640 1 -- 172.21.15.59:0/1577140635 wait complete. 2024-05-30T17:04:25.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T17:04:25.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757e00640 1 Processor -- start 2024-05-30T17:04:25.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757e00640 1 -- start start 2024-05-30T17:04:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd75809b890 0x7fd75806cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd758162340 0x7fd7581627d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7580d0fb0 con 0x7fd75809b4b0 2024-05-30T17:04:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd75806fef0 con 0x7fd758162340 2024-05-30T17:04:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd7580d1290 con 0x7fd75809b890 2024-05-30T17:04:25.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd75809b4b0 0x7fd7580d0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41078/0 (socket says 172.21.15.59:41078) 2024-05-30T17:04:25.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756a00640 1 -- 172.21.15.59:0/1160214594 learned_addr learned my addr 172.21.15.59:0/1160214594 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:25.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2039108240 0 0) 0x7fd7580d0fb0 con 0x7fd75809b4b0 2024-05-30T17:04:25.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd73c003530 con 0x7fd75809b4b0 2024-05-30T17:04:25.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd74e000640 1 --2- 172.21.15.59:0/1160214594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd75809b890 0x7fd75806cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:25.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757400640 1 --2- 172.21.15.59:0/1160214594 >> v2:172.21.15.107:3300/0 conn(0x7fd758162340 0x7fd7581627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:25.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2753541709 0 0) 0x7fd73c003530 con 0x7fd75809b4b0 2024-05-30T17:04:25.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd75809b890 msgr2=0x7fd75806cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:25.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 --2- 172.21.15.59:0/1160214594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd75809b890 0x7fd75806cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:25.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 >> v2:172.21.15.107:3300/0 conn(0x7fd758162340 msgr2=0x7fd7581627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:25.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 --2- 172.21.15.59:0/1160214594 >> v2:172.21.15.107:3300/0 conn(0x7fd758162340 0x7fd7581627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:25.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7580d1570 con 0x7fd75809b4b0 2024-05-30T17:04:25.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fd748001a00 con 0x7fd75809b4b0 2024-05-30T17:04:25.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 >> v1:172.21.15.59:6789/0 conn(0x7fd75809b4b0 legacy=0x7fd7580d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:25.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 --2- 172.21.15.59:0/1160214594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd75809b890 0x7fd73c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:25.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 --2- 172.21.15.59:0/1160214594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd73c003f40 0x7fd73c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:25.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 --2- 172.21.15.59:0/1160214594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73c004d50 0x7fd73c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:25.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd75806fef0 con 0x7fd73c004d50 2024-05-30T17:04:25.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd7580d1290 con 0x7fd73c003f40 2024-05-30T17:04:25.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd73c00ba20 con 0x7fd75809b890 2024-05-30T17:04:25.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757400640 1 --2- 172.21.15.59:0/1160214594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73c004d50 0x7fd73c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:25.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd74e000640 1 --2- 172.21.15.59:0/1160214594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd73c003f40 0x7fd73c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:25.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd756a00640 1 --2- 172.21.15.59:0/1160214594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd75809b890 0x7fd73c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:25.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757400640 1 -- 172.21.15.59:0/1160214594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd75809b890 msgr2=0x7fd73c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:25.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757400640 1 --2- 172.21.15.59:0/1160214594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd75809b890 0x7fd73c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:25.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757400640 1 -- 172.21.15.59:0/1160214594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd73c003f40 msgr2=0x7fd73c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:25.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757400640 1 --2- 172.21.15.59:0/1160214594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd73c003f40 0x7fd73c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:25.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.805+0000 7fd757400640 1 -- 172.21.15.59:0/1160214594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73c003530 con 0x7fd73c004d50 2024-05-30T17:04:25.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.809+0000 7fd757400640 1 --2- 172.21.15.59:0/1160214594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73c004d50 0x7fd73c0051d0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fd750009b10 tx=0x7fd75001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9172e923dad022 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:25.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.809+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7500b2070 con 0x7fd73c004d50 2024-05-30T17:04:25.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.809+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7500a5590 con 0x7fd73c004d50 2024-05-30T17:04:25.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.809+0000 7fd756000640 1 -- 172.21.15.59:0/1160214594 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7500096b0 con 0x7fd73c004d50 2024-05-30T17:04:25.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.809+0000 7fd757e00640 1 -- 172.21.15.59:0/1160214594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73c004d50 msgr2=0x7fd73c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:25.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.809+0000 7fd757e00640 1 --2- 172.21.15.59:0/1160214594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73c004d50 0x7fd73c0051d0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fd750009b10 tx=0x7fd75001cab0 comp rx=0 tx=0).stop 2024-05-30T17:04:25.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.809+0000 7fd757400640 1 -- 172.21.15.59:0/1160214594 reap_dead start 2024-05-30T17:04:25.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.809+0000 7fd757e00640 1 -- 172.21.15.59:0/1160214594 shutdown_connections 2024-05-30T17:04:25.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.809+0000 7fd757e00640 1 -- 172.21.15.59:0/1160214594 >> 172.21.15.59:0/1160214594 conn(0x7fd7580b3ec0 msgr2=0x7fd7580b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:25.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.809+0000 7fd757e00640 1 -- 172.21.15.59:0/1160214594 shutdown_connections 2024-05-30T17:04:25.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.809+0000 7fd757e00640 1 -- 172.21.15.59:0/1160214594 wait complete. 2024-05-30T17:04:25.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757e00640 1 Processor -- start 2024-05-30T17:04:25.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757e00640 1 -- start start 2024-05-30T17:04:25.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd73c004d50 0x7fd75815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:25.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7580b12e0 0x7fd7580af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:25.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7580b1760 0x7fd7580af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:25.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd75806cac0 con 0x7fd7580b1760 2024-05-30T17:04:25.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd7580d0c70 con 0x7fd7580b12e0 2024-05-30T17:04:25.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd75806cc40 con 0x7fd73c004d50 2024-05-30T17:04:25.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7580b1760 0x7fd7580af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:25.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7580b1760 0x7fd7580af680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43312/0 (socket says 172.21.15.59:43312) 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757400640 1 -- 172.21.15.59:0/3872108698 learned_addr learned my addr 172.21.15.59:0/3872108698 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd756a00640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd73c004d50 0x7fd75815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd74e000640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7580b12e0 0x7fd7580af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757400640 1 -- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd73c004d50 msgr2=0x7fd75815ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757400640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd73c004d50 0x7fd75815ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757400640 1 -- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7580b12e0 msgr2=0x7fd7580af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757400640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7580b12e0 0x7fd7580af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757400640 1 -- 172.21.15.59:0/3872108698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7580b5270 con 0x7fd7580b1760 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757400640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7580b1760 0x7fd7580af680 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fd7500b0040 tx=0x7fd73c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd74f400640 1 -- 172.21.15.59:0/3872108698 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7500b2040 con 0x7fd7580b1760 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd74f400640 1 -- 172.21.15.59:0/3872108698 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd750000e50 con 0x7fd7580b1760 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd74f400640 1 -- 172.21.15.59:0/3872108698 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7500096b0 con 0x7fd7580b1760 2024-05-30T17:04:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757e00640 1 -- 172.21.15.59:0/3872108698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7580b5550 con 0x7fd7580b1760 2024-05-30T17:04:25.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.813+0000 7fd757e00640 1 -- 172.21.15.59:0/3872108698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7580b5b10 con 0x7fd7580b1760 2024-05-30T17:04:25.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.817+0000 7fd757e00640 1 -- 172.21.15.59:0/3872108698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd758068a90 con 0x7fd7580b1760 2024-05-30T17:04:25.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.817+0000 7fd74f400640 1 -- 172.21.15.59:0/3872108698 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fd7500be060 con 0x7fd7580b1760 2024-05-30T17:04:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.817+0000 7fd74f400640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd734069fa0 0x7fd73406c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.817+0000 7fd74f400640 1 -- 172.21.15.59:0/3872108698 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5339+0+0 (secure 0 0 0) 0x7fd75011eac0 con 0x7fd7580b1760 2024-05-30T17:04:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.817+0000 7fd756a00640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd734069fa0 0x7fd73406c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:25.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.817+0000 7fd756a00640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd734069fa0 0x7fd73406c460 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd748002090 tx=0x7fd74800a060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:25.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.821+0000 7fd74f400640 1 -- 172.21.15.59:0/3872108698 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd750016800 con 0x7fd7580b1760 2024-05-30T17:04:25.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:25.989+0000 7fd757e00640 1 -- 172.21.15.59:0/3872108698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd7580d1e60 con 0x7fd7580b1760 2024-05-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.621+0000 7fd74f400640 1 -- 172.21.15.59:0/3872108698 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v129) ==== 170+0+0 (secure 0 0 0) 0x7fd7500f0400 con 0x7fd7580b1760 2024-05-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-05-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.625+0000 7fd757e00640 1 -- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd734069fa0 msgr2=0x7fd73406c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.625+0000 7fd757e00640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd734069fa0 0x7fd73406c460 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd748002090 tx=0x7fd74800a060 comp rx=0 tx=0).stop 2024-05-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.625+0000 7fd757e00640 1 -- 172.21.15.59:0/3872108698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7580b1760 msgr2=0x7fd7580af680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.625+0000 7fd757e00640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7580b1760 0x7fd7580af680 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fd7500b0040 tx=0x7fd73c005840 comp rx=0 tx=0).stop 2024-05-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.625+0000 7fd757e00640 1 -- 172.21.15.59:0/3872108698 shutdown_connections 2024-05-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.625+0000 7fd757e00640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd734069fa0 0x7fd73406c460 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.625+0000 7fd757e00640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7580b1760 0x7fd7580af680 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.625+0000 7fd757e00640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7580b12e0 0x7fd7580af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.625+0000 7fd757e00640 1 --2- 172.21.15.59:0/3872108698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd73c004d50 0x7fd75815ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.625+0000 7fd757e00640 1 -- 172.21.15.59:0/3872108698 >> 172.21.15.59:0/3872108698 conn(0x7fd7580b3ec0 msgr2=0x7fd7580cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.625+0000 7fd757e00640 1 -- 172.21.15.59:0/3872108698 shutdown_connections 2024-05-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.625+0000 7fd757e00640 1 -- 172.21.15.59:0/3872108698 wait complete. 2024-05-30T17:04:26.664 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd733e00640 1 Processor -- start 2024-05-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd733e00640 1 -- start start 2024-05-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd733e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340d0f30 0x7fd73409ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd733e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd73409b900 con 0x7fd73409b080 2024-05-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd733e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd73409bbe0 con 0x7fd73415c7b0 2024-05-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd733e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd73415cb90 con 0x7fd7340d0f30 2024-05-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd733400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd73409b080 0x7fd7340cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41094/0 (socket says 172.21.15.59:41094) 2024-05-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd733400640 1 -- 172.21.15.59:0/2082817472 learned_addr learned my addr 172.21.15.59:0/2082817472 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706005472 0 0) 0x7fd73409b900 con 0x7fd73409b080 2024-05-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd72a000640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340d0f30 0x7fd73409ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd718003530 con 0x7fd73409b080 2024-05-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1060071998 0 0) 0x7fd718003530 con 0x7fd73409b080 2024-05-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340d0f30 msgr2=0x7fd73409ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340d0f30 0x7fd73409ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 >> v1:172.21.15.107:6789/0 conn(0x7fd73415c7b0 legacy=0x7fd7340d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7340cd150 con 0x7fd73409b080 2024-05-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fd72c001a00 con 0x7fd73409b080 2024-05-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 >> v1:172.21.15.59:6789/0 conn(0x7fd73409b080 legacy=0x7fd7340cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7180039f0 0x7fd718003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340d0f30 0x7fd718004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd718004d50 0x7fd7180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd73415cb90 con 0x7fd718004d50 2024-05-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd71800bab0 con 0x7fd7180039f0 2024-05-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.813+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd71800bcb0 con 0x7fd7340d0f30 2024-05-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.817+0000 7fd732a00640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7180039f0 0x7fd718003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.817+0000 7fd733400640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd718004d50 0x7fd7180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.817+0000 7fd72a000640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340d0f30 0x7fd718004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.817+0000 7fd732a00640 1 -- 172.21.15.59:0/2082817472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340d0f30 msgr2=0x7fd718004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.817+0000 7fd732a00640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340d0f30 0x7fd718004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.817+0000 7fd732a00640 1 -- 172.21.15.59:0/2082817472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd718004d50 msgr2=0x7fd7180051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.817+0000 7fd732a00640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd718004d50 0x7fd7180051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.817+0000 7fd732a00640 1 -- 172.21.15.59:0/2082817472 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd718003530 con 0x7fd7180039f0 2024-05-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.817+0000 7fd733400640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd718004d50 0x7fd7180051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:04:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.817+0000 7fd732a00640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7180039f0 0x7fd718003e10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd724001750 tx=0x7fd72401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fceaa2ad2d289e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7240013a0 con 0x7fd7180039f0 2024-05-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7240052f0 con 0x7fd7180039f0 2024-05-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd732000640 1 -- 172.21.15.59:0/2082817472 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724003840 con 0x7fd7180039f0 2024-05-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 -- 172.21.15.59:0/2082817472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7180039f0 msgr2=0x7fd718003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 --2- 172.21.15.59:0/2082817472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7180039f0 0x7fd718003e10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd724001750 tx=0x7fd72401c3e0 comp rx=0 tx=0).stop 2024-05-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733400640 1 -- 172.21.15.59:0/2082817472 reap_dead start 2024-05-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 -- 172.21.15.59:0/2082817472 shutdown_connections 2024-05-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 -- 172.21.15.59:0/2082817472 >> 172.21.15.59:0/2082817472 conn(0x7fd7340b3ec0 msgr2=0x7fd7340b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 -- 172.21.15.59:0/2082817472 shutdown_connections 2024-05-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 -- 172.21.15.59:0/2082817472 wait complete. 2024-05-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 Processor -- start 2024-05-30T17:04:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 -- start start 2024-05-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7180039f0 0x7fd73406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340caa50 0x7fd7340caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73415aae0 0x7fd73415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd73409b4d0 con 0x7fd73415aae0 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd7340cd4c0 con 0x7fd7180039f0 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd73409b650 con 0x7fd7340caa50 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73415aae0 0x7fd73415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73415aae0 0x7fd73415af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43332/0 (socket says 172.21.15.59:43332) 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd733400640 1 -- 172.21.15.59:0/1486801841 learned_addr learned my addr 172.21.15.59:0/1486801841 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd732a00640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7180039f0 0x7fd73406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.821+0000 7fd72a000640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340caa50 0x7fd7340caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd733400640 1 -- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340caa50 msgr2=0x7fd7340caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd733400640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340caa50 0x7fd7340caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd733400640 1 -- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7180039f0 msgr2=0x7fd73406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd733400640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7180039f0 0x7fd73406cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd733400640 1 -- 172.21.15.59:0/1486801841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7340cb410 con 0x7fd73415aae0 2024-05-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd733400640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73415aae0 0x7fd73415af60 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fd734075460 tx=0x7fd72c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd72b400640 1 -- 172.21.15.59:0/1486801841 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c00a4a0 con 0x7fd73415aae0 2024-05-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd72b400640 1 -- 172.21.15.59:0/1486801841 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd72c019070 con 0x7fd73415aae0 2024-05-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd72b400640 1 -- 172.21.15.59:0/1486801841 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c013630 con 0x7fd73415aae0 2024-05-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd733e00640 1 -- 172.21.15.59:0/1486801841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd734158db0 con 0x7fd73415aae0 2024-05-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd733e00640 1 -- 172.21.15.59:0/1486801841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd734159370 con 0x7fd73415aae0 2024-05-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd733e00640 1 -- 172.21.15.59:0/1486801841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd734068a90 con 0x7fd73415aae0 2024-05-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd72b400640 1 -- 172.21.15.59:0/1486801841 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fd72c0137d0 con 0x7fd73415aae0 2024-05-30T17:04:26.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.825+0000 7fd72b400640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd710069fd0 0x7fd71006c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:26.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.829+0000 7fd72b400640 1 -- 172.21.15.59:0/1486801841 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5721+0+0 (secure 0 0 0) 0x7fd72c086a60 con 0x7fd73415aae0 2024-05-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.829+0000 7fd732a00640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd710069fd0 0x7fd71006c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.829+0000 7fd732a00640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd710069fd0 0x7fd71006c490 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd7180057f0 tx=0x7fd7240011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:26.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:26.829+0000 7fd72b400640 1 -- 172.21.15.59:0/1486801841 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd72c058a70 con 0x7fd73415aae0 2024-05-30T17:04:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.041+0000 7fd733e00640 1 -- 172.21.15.59:0/1486801841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd7340d03f0 con 0x7fd73415aae0 2024-05-30T17:04:27.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.657+0000 7fd72b400640 1 -- 172.21.15.59:0/1486801841 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v77) ==== 174+0+0 (secure 0 0 0) 0x7fd72c01ce40 con 0x7fd73415aae0 2024-05-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 18 and data pool 19 2024-05-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.665+0000 7fd733e00640 1 -- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd710069fd0 msgr2=0x7fd71006c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.665+0000 7fd733e00640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd710069fd0 0x7fd71006c490 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd7180057f0 tx=0x7fd7240011a0 comp rx=0 tx=0).stop 2024-05-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.665+0000 7fd733e00640 1 -- 172.21.15.59:0/1486801841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73415aae0 msgr2=0x7fd73415af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.665+0000 7fd733e00640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73415aae0 0x7fd73415af60 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fd734075460 tx=0x7fd72c007430 comp rx=0 tx=0).stop 2024-05-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.665+0000 7fd733e00640 1 -- 172.21.15.59:0/1486801841 shutdown_connections 2024-05-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.665+0000 7fd733e00640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd710069fd0 0x7fd71006c490 secure :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd7180057f0 tx=0x7fd7240011a0 comp rx=0 tx=0).stop 2024-05-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.665+0000 7fd733e00640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73415aae0 0x7fd73415af60 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.665+0000 7fd733e00640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7340caa50 0x7fd7340caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.665+0000 7fd733e00640 1 --2- 172.21.15.59:0/1486801841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7180039f0 0x7fd73406cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.665+0000 7fd733e00640 1 -- 172.21.15.59:0/1486801841 >> 172.21.15.59:0/1486801841 conn(0x7fd7340b3ec0 msgr2=0x7fd73415fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.665+0000 7fd733e00640 1 -- 172.21.15.59:0/1486801841 shutdown_connections 2024-05-30T17:04:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.665+0000 7fd733e00640 1 -- 172.21.15.59:0/1486801841 wait complete. 2024-05-30T17:04:27.696 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:04:27.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d35e00640 1 Processor -- start 2024-05-30T17:04:27.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d35e00640 1 -- start start 2024-05-30T17:04:27.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d35e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d300b4510 0x7f3d301630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:27.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d35e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d300b48f0 0x7f3d3015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d35e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3d3015f5f0 0x7f3d30072d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d35e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3d301635f0 con 0x7f3d300b48f0 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d35e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3d3015fbe0 con 0x7f3d3015f5f0 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d35e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3015fec0 con 0x7f3d300b4510 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d27e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d300b48f0 0x7f3d3015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d27e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d300b48f0 0x7f3d3015f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43344/0 (socket says 172.21.15.59:43344) 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d27e00640 1 -- 172.21.15.59:0/3823509829 learned_addr learned my addr 172.21.15.59:0/3823509829 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d2f400640 1 --2- 172.21.15.59:0/3823509829 >> v2:172.21.15.107:3300/0 conn(0x7f3d3015f5f0 0x7f3d30072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.837+0000 7f3d2ea00640 1 --2- 172.21.15.59:0/3823509829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d300b4510 0x7f3d301630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d27e00640 1 -- 172.21.15.59:0/3823509829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d300b4510 msgr2=0x7f3d301630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d27e00640 1 --2- 172.21.15.59:0/3823509829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d300b4510 0x7f3d301630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d27e00640 1 -- 172.21.15.59:0/3823509829 >> v2:172.21.15.107:3300/0 conn(0x7f3d3015f5f0 msgr2=0x7f3d30072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d27e00640 1 --2- 172.21.15.59:0/3823509829 >> v2:172.21.15.107:3300/0 conn(0x7f3d3015f5f0 0x7f3d30072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:27.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d27e00640 1 -- 172.21.15.59:0/3823509829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d301628b0 con 0x7f3d300b48f0 2024-05-30T17:04:27.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d27e00640 1 --2- 172.21.15.59:0/3823509829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d300b48f0 0x7f3d3015f0b0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f3d30159700 tx=0x7f3d1801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfa28074cce2851 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:27.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d2e000640 1 -- 172.21.15.59:0/3823509829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d180b0070 con 0x7f3d300b48f0 2024-05-30T17:04:27.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d2e000640 1 -- 172.21.15.59:0/3823509829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d180ab600 con 0x7f3d300b48f0 2024-05-30T17:04:27.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d2e000640 1 -- 172.21.15.59:0/3823509829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d180ab9d0 con 0x7f3d300b48f0 2024-05-30T17:04:27.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d35e00640 1 -- 172.21.15.59:0/3823509829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d300b48f0 msgr2=0x7f3d3015f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:27.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d35e00640 1 --2- 172.21.15.59:0/3823509829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d300b48f0 0x7f3d3015f0b0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f3d30159700 tx=0x7f3d1801c520 comp rx=0 tx=0).stop 2024-05-30T17:04:27.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d35e00640 1 -- 172.21.15.59:0/3823509829 shutdown_connections 2024-05-30T17:04:27.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d35e00640 1 --2- 172.21.15.59:0/3823509829 >> v2:172.21.15.107:3300/0 conn(0x7f3d3015f5f0 0x7f3d30072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:27.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d35e00640 1 --2- 172.21.15.59:0/3823509829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d300b48f0 0x7f3d3015f0b0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:27.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d35e00640 1 --2- 172.21.15.59:0/3823509829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d300b4510 0x7f3d301630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:27.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.841+0000 7f3d35e00640 1 -- 172.21.15.59:0/3823509829 >> 172.21.15.59:0/3823509829 conn(0x7f3d300b3240 msgr2=0x7f3d300725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:27.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d35e00640 1 -- 172.21.15.59:0/3823509829 shutdown_connections 2024-05-30T17:04:27.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d35e00640 1 -- 172.21.15.59:0/3823509829 wait complete. 2024-05-30T17:04:27.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d35e00640 1 Processor -- start 2024-05-30T17:04:27.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d35e00640 1 -- start start 2024-05-30T17:04:27.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d35e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d300b4510 0x7f3d301490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:27.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d35e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d300b48f0 0x7f3d30151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:27.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d35e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d3015f5f0 0x7f3d3014a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:27.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d35e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3006f1f0 con 0x7f3d3015f5f0 2024-05-30T17:04:27.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d35e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3006f070 con 0x7f3d300b4510 2024-05-30T17:04:27.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d35e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3d30073650 con 0x7f3d300b48f0 2024-05-30T17:04:27.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d2f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d3015f5f0 0x7f3d3014a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:27.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d2f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d3015f5f0 0x7f3d3014a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43354/0 (socket says 172.21.15.59:43354) 2024-05-30T17:04:27.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d2f400640 1 -- 172.21.15.59:0/1608617876 learned_addr learned my addr 172.21.15.59:0/1608617876 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:27.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d27e00640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d300b48f0 0x7f3d30151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:27.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d2ea00640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d300b4510 0x7f3d301490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:27.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d2f400640 1 -- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d300b48f0 msgr2=0x7f3d30151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:27.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d2f400640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d300b48f0 0x7f3d30151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:27.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d2f400640 1 -- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d300b4510 msgr2=0x7f3d301490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:27.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d2f400640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d300b4510 0x7f3d301490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:27.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d2f400640 1 -- 172.21.15.59:0/1608617876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3014a880 con 0x7f3d3015f5f0 2024-05-30T17:04:27.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d2f400640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d3015f5f0 0x7f3d3014a030 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800efc0 tx=0x7f3d2800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:27.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d27400640 1 -- 172.21.15.59:0/1608617876 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28018020 con 0x7f3d3015f5f0 2024-05-30T17:04:27.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d27400640 1 -- 172.21.15.59:0/1608617876 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d28014480 con 0x7f3d3015f5f0 2024-05-30T17:04:27.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d35e00640 1 -- 172.21.15.59:0/1608617876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d30154e40 con 0x7f3d3015f5f0 2024-05-30T17:04:27.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.845+0000 7f3d27400640 1 -- 172.21.15.59:0/1608617876 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28014870 con 0x7f3d3015f5f0 2024-05-30T17:04:27.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.849+0000 7f3d35e00640 1 -- 172.21.15.59:0/1608617876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d30155400 con 0x7f3d3015f5f0 2024-05-30T17:04:27.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.849+0000 7f3d35e00640 1 -- 172.21.15.59:0/1608617876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d30068a90 con 0x7f3d3015f5f0 2024-05-30T17:04:27.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.849+0000 7f3d27400640 1 -- 172.21.15.59:0/1608617876 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f3d2801b020 con 0x7f3d3015f5f0 2024-05-30T17:04:27.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.849+0000 7f3d27400640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d0c06a020 0x7f3d0c06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:27.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.849+0000 7f3d27400640 1 -- 172.21.15.59:0/1608617876 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5821+0+0 (secure 0 0 0) 0x7f3d28086320 con 0x7f3d3015f5f0 2024-05-30T17:04:27.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.849+0000 7f3d2ea00640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d0c06a020 0x7f3d0c06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:27.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.849+0000 7f3d2ea00640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d0c06a020 0x7f3d0c06c4e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009a40 tx=0x7f3d20009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:27.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:27.853+0000 7f3d27400640 1 -- 172.21.15.59:0/1608617876 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d28022070 con 0x7f3d3015f5f0 2024-05-30T17:04:28.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.021+0000 7f3d35e00640 1 -- 172.21.15.59:0/1608617876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d3006d2c0 con 0x7f3d3015f5f0 2024-05-30T17:04:28.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.021+0000 7f3d27400640 1 -- 172.21.15.59:0/1608617876 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16856 (secure 0 0 0) 0x7f3d28010040 con 0x7f3d3015f5f0 2024-05-30T17:04:28.022 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:28.022 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":130,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:04:27.043852+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:04:24.731956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-05-30T17:04:26.001487+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:04:28.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.025+0000 7f3d35e00640 1 -- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d0c06a020 msgr2=0x7f3d0c06c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:28.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.025+0000 7f3d35e00640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d0c06a020 0x7f3d0c06c4e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009a40 tx=0x7f3d20009190 comp rx=0 tx=0).stop 2024-05-30T17:04:28.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.025+0000 7f3d35e00640 1 -- 172.21.15.59:0/1608617876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d3015f5f0 msgr2=0x7f3d3014a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.025+0000 7f3d35e00640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d3015f5f0 0x7f3d3014a030 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800efc0 tx=0x7f3d2800c490 comp rx=0 tx=0).stop 2024-05-30T17:04:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.025+0000 7f3d35e00640 1 -- 172.21.15.59:0/1608617876 shutdown_connections 2024-05-30T17:04:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.025+0000 7f3d35e00640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3d0c06a020 0x7f3d0c06c4e0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.025+0000 7f3d35e00640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d3015f5f0 0x7f3d3014a030 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.025+0000 7f3d35e00640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3d300b48f0 0x7f3d30151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.025+0000 7f3d35e00640 1 --2- 172.21.15.59:0/1608617876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d300b4510 0x7f3d301490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.025+0000 7f3d35e00640 1 -- 172.21.15.59:0/1608617876 >> 172.21.15.59:0/1608617876 conn(0x7f3d300b3240 msgr2=0x7f3d300b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.025+0000 7f3d35e00640 1 -- 172.21.15.59:0/1608617876 shutdown_connections 2024-05-30T17:04:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.025+0000 7f3d35e00640 1 -- 172.21.15.59:0/1608617876 wait complete. 2024-05-30T17:04:28.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:04:28.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd7c00640 1 Processor -- start 2024-05-30T17:04:28.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd7c00640 1 -- start start 2024-05-30T17:04:28.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd7c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcbd015a980 0x7fcbd00731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:28.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd7c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015ad60 0x7fcbd006e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:28.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd7c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbd00b31d0 con 0x7fcbd00ad630 2024-05-30T17:04:28.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd7c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fcbd00b4c80 con 0x7fcbd015a980 2024-05-30T17:04:28.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd7c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd0073c30 con 0x7fcbd015ad60 2024-05-30T17:04:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd5200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcbd015a980 0x7fcbd00731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbc7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015ad60 0x7fcbd006e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd5200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcbd015a980 0x7fcbd00731f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:34006/0 (socket says 172.21.15.59:34006) 2024-05-30T17:04:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd5200640 1 -- 172.21.15.59:0/1848707931 learned_addr learned my addr 172.21.15.59:0/1848707931 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd5c00640 1 --1- 172.21.15.59:0/1848707931 >> v1:172.21.15.107:6789/0 conn(0x7fcbd00ad630 0x7fcbd015e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:55366/0 (socket says 172.21.15.59:55366) 2024-05-30T17:04:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd5200640 1 -- 172.21.15.59:0/1848707931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015ad60 msgr2=0x7fcbd006e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd5200640 1 --2- 172.21.15.59:0/1848707931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015ad60 0x7fcbd006e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd5200640 1 -- 172.21.15.59:0/1848707931 >> v1:172.21.15.107:6789/0 conn(0x7fcbd00ad630 legacy=0x7fcbd015e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbd5200640 1 -- 172.21.15.59:0/1848707931 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd0073f10 con 0x7fcbd015a980 2024-05-30T17:04:28.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.185+0000 7fcbcfe00640 1 -- 172.21.15.59:0/1848707931 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321345587 0 0) 0x7fcbd00b31d0 con 0x7fcbd00ad630 2024-05-30T17:04:28.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.189+0000 7fcbd5200640 1 --2- 172.21.15.59:0/1848707931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd015a980 0x7fcbd00731f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0006fd0 tx=0x7fcbc001e9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6bac5eca548ea42 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.189+0000 7fcbcfe00640 1 -- 172.21.15.59:0/1848707931 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00ad070 con 0x7fcbd015a980 2024-05-30T17:04:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.189+0000 7fcbcfe00640 1 -- 172.21.15.59:0/1848707931 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc0004230 con 0x7fcbd015a980 2024-05-30T17:04:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.189+0000 7fcbcfe00640 1 -- 172.21.15.59:0/1848707931 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00a7890 con 0x7fcbd015a980 2024-05-30T17:04:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.189+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1848707931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd015a980 msgr2=0x7fcbd00731f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.189+0000 7fcbd7c00640 1 --2- 172.21.15.59:0/1848707931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd015a980 0x7fcbd00731f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0006fd0 tx=0x7fcbc001e9c0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.189+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1848707931 shutdown_connections 2024-05-30T17:04:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.189+0000 7fcbd7c00640 1 --2- 172.21.15.59:0/1848707931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015ad60 0x7fcbd006e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.189+0000 7fcbd7c00640 1 --2- 172.21.15.59:0/1848707931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd015a980 0x7fcbd00731f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.189+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1848707931 >> 172.21.15.59:0/1848707931 conn(0x7fcbd00b22d0 msgr2=0x7fcbd00b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.189+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1848707931 shutdown_connections 2024-05-30T17:04:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.189+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1848707931 wait complete. 2024-05-30T17:04:28.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd7c00640 1 Processor -- start 2024-05-30T17:04:28.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd7c00640 1 -- start start 2024-05-30T17:04:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd7c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbd00ad630 0x7fcbd0159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd7c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015a980 0x7fcbd0153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd7c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd00b4430 0x7fcbd014c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd7c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd006f020 con 0x7fcbd00ad630 2024-05-30T17:04:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd7c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd006e090 con 0x7fcbd00b4430 2024-05-30T17:04:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd7c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd015ede0 con 0x7fcbd015a980 2024-05-30T17:04:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbd00ad630 0x7fcbd0159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbd00ad630 0x7fcbd0159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43366/0 (socket says 172.21.15.59:43366) 2024-05-30T17:04:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd5200640 1 -- 172.21.15.59:0/1247585544 learned_addr learned my addr 172.21.15.59:0/1247585544 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd5200640 1 -- 172.21.15.59:0/1247585544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015a980 msgr2=0x7fcbd0153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd5200640 1 --2- 172.21.15.59:0/1247585544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015a980 0x7fcbd0153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd5200640 1 -- 172.21.15.59:0/1247585544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd00b4430 msgr2=0x7fcbd014c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd5200640 1 --2- 172.21.15.59:0/1247585544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd00b4430 0x7fcbd014c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd5200640 1 -- 172.21.15.59:0/1247585544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd0158ec0 con 0x7fcbd00ad630 2024-05-30T17:04:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd5200640 1 --2- 172.21.15.59:0/1247585544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbd00ad630 0x7fcbd0159960 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0000c10 tx=0x7fcbc001b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbcd600640 1 -- 172.21.15.59:0/1247585544 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00b7070 con 0x7fcbd00ad630 2024-05-30T17:04:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbcd600640 1 -- 172.21.15.59:0/1247585544 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc0003620 con 0x7fcbd00ad630 2024-05-30T17:04:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbcd600640 1 -- 172.21.15.59:0/1247585544 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00ad050 con 0x7fcbd00ad630 2024-05-30T17:04:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1247585544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd00aede0 con 0x7fcbd00ad630 2024-05-30T17:04:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.193+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1247585544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd00af0c0 con 0x7fcbd00ad630 2024-05-30T17:04:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.197+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1247585544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd0068a90 con 0x7fcbd00ad630 2024-05-30T17:04:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.197+0000 7fcbcd600640 1 -- 172.21.15.59:0/1247585544 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fcbc00c2060 con 0x7fcbd00ad630 2024-05-30T17:04:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.197+0000 7fcbcd600640 1 --2- 172.21.15.59:0/1247585544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcbac069fd0 0x7fcbac06c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.197+0000 7fcbcd600640 1 -- 172.21.15.59:0/1247585544 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5821+0+0 (secure 0 0 0) 0x7fcbc011fcc0 con 0x7fcbd00ad630 2024-05-30T17:04:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.197+0000 7fcbc7e00640 1 --2- 172.21.15.59:0/1247585544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcbac069fd0 0x7fcbac06c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.197+0000 7fcbc7e00640 1 --2- 172.21.15.59:0/1247585544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcbac069fd0 0x7fcbac06c490 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0165540 tx=0x7fcbb8009520 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.201+0000 7fcbcd600640 1 -- 172.21.15.59:0/1247585544 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcbc00185e0 con 0x7fcbd00ad630 2024-05-30T17:04:28.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.365+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1247585544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcbd00cc600 con 0x7fcbd00ad630 2024-05-30T17:04:28.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbcd600640 1 -- 172.21.15.59:0/1247585544 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16856 (secure 0 0 0) 0x7fcbc00f1c50 con 0x7fcbd00ad630 2024-05-30T17:04:28.368 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:28.368 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":130,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:04:27.043852+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:04:24.731956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-05-30T17:04:26.001487+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:04:28.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1247585544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcbac069fd0 msgr2=0x7fcbac06c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:28.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbd7c00640 1 --2- 172.21.15.59:0/1247585544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcbac069fd0 0x7fcbac06c490 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0165540 tx=0x7fcbb8009520 comp rx=0 tx=0).stop 2024-05-30T17:04:28.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1247585544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbd00ad630 msgr2=0x7fcbd0159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:28.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbd7c00640 1 --2- 172.21.15.59:0/1247585544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbd00ad630 0x7fcbd0159960 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0000c10 tx=0x7fcbc001b760 comp rx=0 tx=0).stop 2024-05-30T17:04:28.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1247585544 shutdown_connections 2024-05-30T17:04:28.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbd7c00640 1 --2- 172.21.15.59:0/1247585544 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcbac069fd0 0x7fcbac06c490 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbd7c00640 1 --2- 172.21.15.59:0/1247585544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd00b4430 0x7fcbd014c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbd7c00640 1 --2- 172.21.15.59:0/1247585544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015a980 0x7fcbd0153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbd7c00640 1 --2- 172.21.15.59:0/1247585544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbd00ad630 0x7fcbd0159960 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1247585544 >> 172.21.15.59:0/1247585544 conn(0x7fcbd00b22d0 msgr2=0x7fcbd014fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:28.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1247585544 shutdown_connections 2024-05-30T17:04:28.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.369+0000 7fcbd7c00640 1 -- 172.21.15.59:0/1247585544 wait complete. 2024-05-30T17:04:28.390 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T17:04:28.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddcbe00640 1 Processor -- start 2024-05-30T17:04:28.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddcbe00640 1 -- start start 2024-05-30T17:04:28.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddcbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddc40c9e10 0x7fddc4141f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:28.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddcbe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc406bce0 0x7fddc406c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:28.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddcbe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddc406d320 con 0x7fddc406ce90 2024-05-30T17:04:28.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddcbe00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fddc4163260 con 0x7fddc40c9e10 2024-05-30T17:04:28.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddcbe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fddc41626e0 con 0x7fddc406bce0 2024-05-30T17:04:28.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddc9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddc40c9e10 0x7fddc4141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:28.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddc9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddc40c9e10 0x7fddc4141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43380/0 (socket says 172.21.15.59:43380) 2024-05-30T17:04:28.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddc9400640 1 -- 172.21.15.59:0/2289440853 learned_addr learned my addr 172.21.15.59:0/2289440853 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddc9e00640 1 --2- 172.21.15.59:0/2289440853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc406bce0 0x7fddc406c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddc9400640 1 -- 172.21.15.59:0/2289440853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc406bce0 msgr2=0x7fddc406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddc9400640 1 --2- 172.21.15.59:0/2289440853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc406bce0 0x7fddc406c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddc9400640 1 -- 172.21.15.59:0/2289440853 >> v1:172.21.15.107:6789/0 conn(0x7fddc406ce90 legacy=0x7fddc40ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddc9400640 1 -- 172.21.15.59:0/2289440853 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc41629c0 con 0x7fddc40c9e10 2024-05-30T17:04:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.533+0000 7fddc9e00640 1 --2- 172.21.15.59:0/2289440853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc406bce0 0x7fddc406c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:28.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.537+0000 7fddc9400640 1 --2- 172.21.15.59:0/2289440853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc40c9e10 0x7fddc4141f20 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009870 tx=0x7fddb801c1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d3e636f40f07ea server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:28.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.537+0000 7fddc3e00640 1 -- 172.21.15.59:0/2289440853 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb80b0070 con 0x7fddc40c9e10 2024-05-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.537+0000 7fddc3e00640 1 -- 172.21.15.59:0/2289440853 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb80ab600 con 0x7fddc40c9e10 2024-05-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.537+0000 7fddc3e00640 1 -- 172.21.15.59:0/2289440853 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb80a4e60 con 0x7fddc40c9e10 2024-05-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.537+0000 7fddcbe00640 1 -- 172.21.15.59:0/2289440853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc40c9e10 msgr2=0x7fddc4141f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.537+0000 7fddcbe00640 1 --2- 172.21.15.59:0/2289440853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc40c9e10 0x7fddc4141f20 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009870 tx=0x7fddb801c1f0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.537+0000 7fddcbe00640 1 -- 172.21.15.59:0/2289440853 shutdown_connections 2024-05-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.537+0000 7fddcbe00640 1 --2- 172.21.15.59:0/2289440853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc406bce0 0x7fddc406c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.537+0000 7fddcbe00640 1 --2- 172.21.15.59:0/2289440853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc40c9e10 0x7fddc4141f20 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.537+0000 7fddcbe00640 1 -- 172.21.15.59:0/2289440853 >> 172.21.15.59:0/2289440853 conn(0x7fddc40cd540 msgr2=0x7fddc40cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.537+0000 7fddcbe00640 1 -- 172.21.15.59:0/2289440853 shutdown_connections 2024-05-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddcbe00640 1 -- 172.21.15.59:0/2289440853 wait complete. 2024-05-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddcbe00640 1 Processor -- start 2024-05-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddcbe00640 1 -- start start 2024-05-30T17:04:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddcbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc406bce0 0x7fddc4140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddcbe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc406ce90 0x7fddc4139fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddcbe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40c9e10 0x7fddc415d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddcbe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fddc41480d0 con 0x7fddc406bce0 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddcbe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fddc4162300 con 0x7fddc40c9e10 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddcbe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fddc413a4e0 con 0x7fddc406ce90 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc406bce0 0x7fddc4140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc406bce0 0x7fddc4140690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43384/0 (socket says 172.21.15.59:43384) 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc9400640 1 -- 172.21.15.59:0/3863456650 learned_addr learned my addr 172.21.15.59:0/3863456650 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc8a00640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc406ce90 0x7fddc4139fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc9e00640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40c9e10 0x7fddc415d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc9400640 1 -- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc406ce90 msgr2=0x7fddc4139fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc9400640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc406ce90 0x7fddc4139fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc9400640 1 -- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40c9e10 msgr2=0x7fddc415d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc9400640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40c9e10 0x7fddc415d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc9400640 1 -- 172.21.15.59:0/3863456650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc4138f00 con 0x7fddc406bce0 2024-05-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc9e00640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40c9e10 0x7fddc415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc9400640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc406bce0 0x7fddc4140690 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fddb80ae040 tx=0x7fddb8018f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc1600640 1 -- 172.21.15.59:0/3863456650 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb80b0040 con 0x7fddc406bce0 2024-05-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc1600640 1 -- 172.21.15.59:0/3863456650 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb80b9070 con 0x7fddc406bce0 2024-05-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddc1600640 1 -- 172.21.15.59:0/3863456650 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb80b4670 con 0x7fddc406bce0 2024-05-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.541+0000 7fddcbe00640 1 -- 172.21.15.59:0/3863456650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc41391e0 con 0x7fddc406bce0 2024-05-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.545+0000 7fddcbe00640 1 -- 172.21.15.59:0/3863456650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc41397a0 con 0x7fddc406bce0 2024-05-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.545+0000 7fddcbe00640 1 -- 172.21.15.59:0/3863456650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc4068a90 con 0x7fddc406bce0 2024-05-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.545+0000 7fddc1600640 1 -- 172.21.15.59:0/3863456650 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fddb80b4810 con 0x7fddc406bce0 2024-05-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.545+0000 7fddc1600640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdda4069fa0 0x7fdda406c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.545+0000 7fddc1600640 1 -- 172.21.15.59:0/3863456650 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5821+0+0 (secure 0 0 0) 0x7fddb811f6e0 con 0x7fddc406bce0 2024-05-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.545+0000 7fddc8a00640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdda4069fa0 0x7fdda406c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.549+0000 7fddc8a00640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdda4069fa0 0x7fdda406c460 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fddb0004e30 tx=0x7fddb0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:28.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.549+0000 7fddc1600640 1 -- 172.21.15.59:0/3863456650 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fddc406d320 con 0x7fddc406bce0 2024-05-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:28.757+0000 7fddcbe00640 1 -- 172.21.15.59:0/3863456650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fddc415e5e0 con 0x7fddc406bce0 2024-05-30T17:04:29.616 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-05-30T17:04:29.617+0000 7fa37de00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T17:04:29.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.673+0000 7fddc1600640 1 -- 172.21.15.59:0/3863456650 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v80) ==== 118+0+0 (secure 0 0 0) 0x7fddb80f1700 con 0x7fddc406bce0 2024-05-30T17:04:29.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.677+0000 7fddcbe00640 1 -- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdda4069fa0 msgr2=0x7fdda406c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.677+0000 7fddcbe00640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdda4069fa0 0x7fdda406c460 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fddb0004e30 tx=0x7fddb0009040 comp rx=0 tx=0).stop 2024-05-30T17:04:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.677+0000 7fddcbe00640 1 -- 172.21.15.59:0/3863456650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc406bce0 msgr2=0x7fddc4140690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.677+0000 7fddcbe00640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc406bce0 0x7fddc4140690 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fddb80ae040 tx=0x7fddb8018f90 comp rx=0 tx=0).stop 2024-05-30T17:04:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.677+0000 7fddcbe00640 1 -- 172.21.15.59:0/3863456650 shutdown_connections 2024-05-30T17:04:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.677+0000 7fddcbe00640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdda4069fa0 0x7fdda406c460 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.677+0000 7fddcbe00640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40c9e10 0x7fddc415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.677+0000 7fddcbe00640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc406ce90 0x7fddc4139fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.677+0000 7fddcbe00640 1 --2- 172.21.15.59:0/3863456650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc406bce0 0x7fddc4140690 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.677+0000 7fddcbe00640 1 -- 172.21.15.59:0/3863456650 >> 172.21.15.59:0/3863456650 conn(0x7fddc40cd540 msgr2=0x7fddc413dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.677+0000 7fddcbe00640 1 -- 172.21.15.59:0/3863456650 shutdown_connections 2024-05-30T17:04:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.677+0000 7fddcbe00640 1 -- 172.21.15.59:0/3863456650 wait complete. 2024-05-30T17:04:29.700 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T17:04:29.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T17:04:29.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cfea00640 1 Processor -- start 2024-05-30T17:04:29.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cfea00640 1 -- start start 2024-05-30T17:04:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cfea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6cf80d0f30 0x7f6cf809ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cfea00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf809b900 con 0x7f6cf809b080 2024-05-30T17:04:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cfea00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf809bbe0 con 0x7f6cf815c7b0 2024-05-30T17:04:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cfea00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf815cb90 con 0x7f6cf80d0f30 2024-05-30T17:04:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cfe000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6cf809b080 0x7f6cf80cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41110/0 (socket says 172.21.15.59:41110) 2024-05-30T17:04:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cfe000640 1 -- 172.21.15.59:0/91985430 learned_addr learned my addr 172.21.15.59:0/91985430 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cfcc00640 1 --2- 172.21.15.59:0/91985430 >> v2:172.21.15.59:3300/0 conn(0x7f6cf80d0f30 0x7f6cf809ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:29.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cf7e00640 1 -- 172.21.15.59:0/91985430 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1460918731 0 0) 0x7f6cf809b900 con 0x7f6cf809b080 2024-05-30T17:04:29.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cf7e00640 1 -- 172.21.15.59:0/91985430 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ce0003530 con 0x7f6cf809b080 2024-05-30T17:04:29.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cfcc00640 1 -- 172.21.15.59:0/91985430 >> v1:172.21.15.107:6789/0 conn(0x7f6cf815c7b0 legacy=0x7f6cf80d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:29.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cf7e00640 1 -- 172.21.15.59:0/91985430 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923729388 0 0) 0x7f6cf809bbe0 con 0x7f6cf815c7b0 2024-05-30T17:04:29.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cfcc00640 1 -- 172.21.15.59:0/91985430 >> v1:172.21.15.59:6789/0 conn(0x7f6cf809b080 legacy=0x7f6cf80cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:29.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.849+0000 7f6cfcc00640 1 -- 172.21.15.59:0/91985430 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf80cd150 con 0x7f6cf80d0f30 2024-05-30T17:04:29.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.853+0000 7f6cfcc00640 1 --2- 172.21.15.59:0/91985430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf80d0f30 0x7f6cf809ab40 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40097c0 tx=0x7f6ce401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66437eb419918fa server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.853+0000 7f6cf7e00640 1 -- 172.21.15.59:0/91985430 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40b1070 con 0x7f6cf80d0f30 2024-05-30T17:04:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.853+0000 7f6cf7e00640 1 -- 172.21.15.59:0/91985430 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce40ac410 con 0x7f6cf80d0f30 2024-05-30T17:04:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.853+0000 7f6cf7e00640 1 -- 172.21.15.59:0/91985430 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40ac7c0 con 0x7f6cf80d0f30 2024-05-30T17:04:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.853+0000 7f6cfea00640 1 -- 172.21.15.59:0/91985430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf80d0f30 msgr2=0x7f6cf809ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.853+0000 7f6cfea00640 1 --2- 172.21.15.59:0/91985430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf80d0f30 0x7f6cf809ab40 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40097c0 tx=0x7f6ce401c4a0 comp rx=0 tx=0).stop 2024-05-30T17:04:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.853+0000 7f6cfea00640 1 -- 172.21.15.59:0/91985430 shutdown_connections 2024-05-30T17:04:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.853+0000 7f6cfea00640 1 --2- 172.21.15.59:0/91985430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf80d0f30 0x7f6cf809ab40 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.853+0000 7f6cfea00640 1 -- 172.21.15.59:0/91985430 >> 172.21.15.59:0/91985430 conn(0x7f6cf80b3ec0 msgr2=0x7f6cf80b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.853+0000 7f6cfea00640 1 -- 172.21.15.59:0/91985430 shutdown_connections 2024-05-30T17:04:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.853+0000 7f6cfea00640 1 -- 172.21.15.59:0/91985430 wait complete. 2024-05-30T17:04:29.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfea00640 1 Processor -- start 2024-05-30T17:04:29.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfea00640 1 -- start start 2024-05-30T17:04:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf809b080 0x7f6cf815d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6cf80d0f30 0x7f6cf8167960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf815c7b0 0x7f6cf8152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfea00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80cec40 con 0x7f6cf809b080 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80ceac0 con 0x7f6cf815c7b0 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf816a590 con 0x7f6cf80d0f30 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf809b080 0x7f6cf815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf809b080 0x7f6cf815d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43410/0 (socket says 172.21.15.59:43410) 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfd600640 1 -- 172.21.15.59:0/3542337608 learned_addr learned my addr 172.21.15.59:0/3542337608 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfe000640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf815c7b0 0x7f6cf8152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfcc00640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6cf80d0f30 0x7f6cf8167960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfd600640 1 -- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6cf80d0f30 msgr2=0x7f6cf8167960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfd600640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6cf80d0f30 0x7f6cf8167960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfd600640 1 -- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf815c7b0 msgr2=0x7f6cf8152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfd600640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf815c7b0 0x7f6cf8152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfd600640 1 -- 172.21.15.59:0/3542337608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf8167ea0 con 0x7f6cf809b080 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfe000640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf815c7b0 0x7f6cf8152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfcc00640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6cf80d0f30 0x7f6cf8167960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfd600640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf809b080 0x7f6cf815d510 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00c480 tx=0x7f6cec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cf5600640 1 -- 172.21.15.59:0/3542337608 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec005480 con 0x7f6cf809b080 2024-05-30T17:04:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cf5600640 1 -- 172.21.15.59:0/3542337608 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec003600 con 0x7f6cf809b080 2024-05-30T17:04:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfea00640 1 -- 172.21.15.59:0/3542337608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf806cac0 con 0x7f6cf809b080 2024-05-30T17:04:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cf5600640 1 -- 172.21.15.59:0/3542337608 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0039f0 con 0x7f6cf809b080 2024-05-30T17:04:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfea00640 1 -- 172.21.15.59:0/3542337608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf806d080 con 0x7f6cf809b080 2024-05-30T17:04:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.857+0000 7f6cfea00640 1 -- 172.21.15.59:0/3542337608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf8068a90 con 0x7f6cf809b080 2024-05-30T17:04:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.861+0000 7f6cf5600640 1 -- 172.21.15.59:0/3542337608 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f6cec003b90 con 0x7f6cf809b080 2024-05-30T17:04:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.861+0000 7f6cf5600640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6cd8069fa0 0x7f6cd806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.861+0000 7f6cf5600640 1 -- 172.21.15.59:0/3542337608 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7f6cec085650 con 0x7f6cf809b080 2024-05-30T17:04:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.861+0000 7f6cfcc00640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6cd8069fa0 0x7f6cd806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:29.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.861+0000 7f6cfcc00640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6cd8069fa0 0x7f6cd806c460 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40ae000 tx=0x7f6ce4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:29.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:29.865+0000 7f6cf5600640 1 -- 172.21.15.59:0/3542337608 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6cf8167ea0 con 0x7f6cf809b080 2024-05-30T17:04:30.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.065+0000 7f6cfea00640 1 -- 172.21.15.59:0/3542337608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6cf815b9a0 con 0x7f6cf809b080 2024-05-30T17:04:30.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.673+0000 7f6cf5600640 1 -- 172.21.15.59:0/3542337608 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v81) ==== 122+0+0 (secure 0 0 0) 0x7f6cec057670 con 0x7f6cf809b080 2024-05-30T17:04:30.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.677+0000 7f6cfea00640 1 -- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6cd8069fa0 msgr2=0x7f6cd806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:30.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.677+0000 7f6cfea00640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6cd8069fa0 0x7f6cd806c460 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40ae000 tx=0x7f6ce4008040 comp rx=0 tx=0).stop 2024-05-30T17:04:30.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.677+0000 7f6cfea00640 1 -- 172.21.15.59:0/3542337608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf809b080 msgr2=0x7f6cf815d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:30.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.677+0000 7f6cfea00640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf809b080 0x7f6cf815d510 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00c480 tx=0x7f6cec00c940 comp rx=0 tx=0).stop 2024-05-30T17:04:30.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.677+0000 7f6cfea00640 1 -- 172.21.15.59:0/3542337608 shutdown_connections 2024-05-30T17:04:30.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.677+0000 7f6cfea00640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6cd8069fa0 0x7f6cd806c460 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:30.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.677+0000 7f6cfea00640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf815c7b0 0x7f6cf8152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:30.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.677+0000 7f6cfea00640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6cf80d0f30 0x7f6cf8167960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:30.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.677+0000 7f6cfea00640 1 --2- 172.21.15.59:0/3542337608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf809b080 0x7f6cf815d510 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:30.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.677+0000 7f6cfea00640 1 -- 172.21.15.59:0/3542337608 >> 172.21.15.59:0/3542337608 conn(0x7f6cf80b3ec0 msgr2=0x7f6cf80b7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:30.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.677+0000 7f6cfea00640 1 -- 172.21.15.59:0/3542337608 shutdown_connections 2024-05-30T17:04:30.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.677+0000 7f6cfea00640 1 -- 172.21.15.59:0/3542337608 wait complete. 2024-05-30T17:04:30.699 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T17:04:30.699 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:04:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd791600640 1 Processor -- start 2024-05-30T17:04:30.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd791600640 1 -- start start 2024-05-30T17:04:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd791600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c09b780 0x7fd78c0ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd791600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78c0d1310 con 0x7fd78c160d90 2024-05-30T17:04:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd791600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78c09bcf0 con 0x7fd78c09b150 2024-05-30T17:04:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd791600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd78c0d0a70 con 0x7fd78c09b780 2024-05-30T17:04:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78aa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd78c160d90 0x7fd78c09aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41118/0 (socket says 172.21.15.59:41118) 2024-05-30T17:04:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78aa00640 1 -- 172.21.15.59:0/1986632480 learned_addr learned my addr 172.21.15.59:0/1986632480 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78b400640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c09b780 0x7fd78c0ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152660132 0 0) 0x7fd78c0d1310 con 0x7fd78c160d90 2024-05-30T17:04:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd770003530 con 0x7fd78c160d90 2024-05-30T17:04:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1612546228 0 0) 0x7fd770003530 con 0x7fd78c160d90 2024-05-30T17:04:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c09b780 msgr2=0x7fd78c0ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c09b780 0x7fd78c0ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 >> v1:172.21.15.107:6789/0 conn(0x7fd78c09b150 legacy=0x7fd78c0cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c0d0d50 con 0x7fd78c160d90 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fd77c001680 con 0x7fd78c160d90 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 >> v1:172.21.15.59:6789/0 conn(0x7fd78c160d90 legacy=0x7fd78c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7700039f0 0x7fd770003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c09b780 0x7fd770004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd770004d50 0x7fd7700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c0d0a70 con 0x7fd770004d50 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd77000bb00 con 0x7fd7700039f0 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd77000bd00 con 0x7fd78c09b780 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78b400640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd770004d50 0x7fd7700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd78aa00640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7700039f0 0x7fd770003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.841+0000 7fd782000640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c09b780 0x7fd770004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd78b400640 1 -- 172.21.15.59:0/1986632480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c09b780 msgr2=0x7fd770004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd78b400640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c09b780 0x7fd770004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:30.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd78b400640 1 -- 172.21.15.59:0/1986632480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7700039f0 msgr2=0x7fd770003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:30.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd78b400640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7700039f0 0x7fd770003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:30.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd78b400640 1 -- 172.21.15.59:0/1986632480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd770003530 con 0x7fd770004d50 2024-05-30T17:04:30.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd782000640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c09b780 0x7fd770004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:30.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd78b400640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd770004d50 0x7fd7700051d0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fd784009ae0 tx=0x7fd78401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c60dcace4ed01d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:30.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7840b2070 con 0x7fd770004d50 2024-05-30T17:04:30.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7840a5550 con 0x7fd770004d50 2024-05-30T17:04:30.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd78a000640 1 -- 172.21.15.59:0/1986632480 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7840096b0 con 0x7fd770004d50 2024-05-30T17:04:30.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd791600640 1 -- 172.21.15.59:0/1986632480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd770004d50 msgr2=0x7fd7700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:30.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd791600640 1 --2- 172.21.15.59:0/1986632480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd770004d50 0x7fd7700051d0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fd784009ae0 tx=0x7fd78401ca70 comp rx=0 tx=0).stop 2024-05-30T17:04:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd78b400640 1 -- 172.21.15.59:0/1986632480 reap_dead start 2024-05-30T17:04:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd791600640 1 -- 172.21.15.59:0/1986632480 shutdown_connections 2024-05-30T17:04:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd791600640 1 -- 172.21.15.59:0/1986632480 >> 172.21.15.59:0/1986632480 conn(0x7fd78c0b3f80 msgr2=0x7fd78c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.845+0000 7fd791600640 1 -- 172.21.15.59:0/1986632480 shutdown_connections 2024-05-30T17:04:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd791600640 1 -- 172.21.15.59:0/1986632480 wait complete. 2024-05-30T17:04:30.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd791600640 1 Processor -- start 2024-05-30T17:04:30.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd791600640 1 -- start start 2024-05-30T17:04:30.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd791600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd770004d50 0x7fd78c1f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:30.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd791600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c0b7980 0x7fd78c0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:30.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd791600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0b7e00 0x7fd78c0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd791600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c0af360 con 0x7fd770004d50 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd791600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c0af1e0 con 0x7fd78c0b7e00 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd791600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd78c071e60 con 0x7fd78c0b7980 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd78aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd770004d50 0x7fd78c1f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd78aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd770004d50 0x7fd78c1f5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43422/0 (socket says 172.21.15.59:43422) 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd78aa00640 1 -- 172.21.15.59:0/4026883048 learned_addr learned my addr 172.21.15.59:0/4026883048 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd78b400640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0b7e00 0x7fd78c0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd782000640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c0b7980 0x7fd78c0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd78aa00640 1 -- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c0b7980 msgr2=0x7fd78c0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd78aa00640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c0b7980 0x7fd78c0c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd78aa00640 1 -- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0b7e00 msgr2=0x7fd78c0b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd78aa00640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0b7e00 0x7fd78c0b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd78aa00640 1 -- 172.21.15.59:0/4026883048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c0c7850 con 0x7fd770004d50 2024-05-30T17:04:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd78b400640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0b7e00 0x7fd78c0b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd78aa00640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd770004d50 0x7fd78c1f5110 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0017f0 tx=0x7fd77c012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd783400640 1 -- 172.21.15.59:0/4026883048 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c01c070 con 0x7fd770004d50 2024-05-30T17:04:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd783400640 1 -- 172.21.15.59:0/4026883048 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77c014830 con 0x7fd770004d50 2024-05-30T17:04:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd783400640 1 -- 172.21.15.59:0/4026883048 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c014c20 con 0x7fd770004d50 2024-05-30T17:04:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.849+0000 7fd791600640 1 -- 172.21.15.59:0/4026883048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78c0c7b30 con 0x7fd770004d50 2024-05-30T17:04:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.853+0000 7fd791600640 1 -- 172.21.15.59:0/4026883048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd78c0c80f0 con 0x7fd770004d50 2024-05-30T17:04:30.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.853+0000 7fd791600640 1 -- 172.21.15.59:0/4026883048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78c068a90 con 0x7fd770004d50 2024-05-30T17:04:30.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.853+0000 7fd783400640 1 -- 172.21.15.59:0/4026883048 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fd77c0153e0 con 0x7fd770004d50 2024-05-30T17:04:30.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.853+0000 7fd783400640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd768069fa0 0x7fd76806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:30.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.853+0000 7fd783400640 1 -- 172.21.15.59:0/4026883048 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7fd77c088470 con 0x7fd770004d50 2024-05-30T17:04:30.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.853+0000 7fd782000640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd768069fa0 0x7fd76806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:30.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.857+0000 7fd782000640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd768069fa0 0x7fd76806c460 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd78c1600a0 tx=0x7fd774009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:30.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:30.857+0000 7fd783400640 1 -- 172.21.15.59:0/4026883048 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd77c05a490 con 0x7fd770004d50 2024-05-30T17:04:31.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.053+0000 7fd791600640 1 -- 172.21.15.59:0/4026883048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd78c0b4be0 con 0x7fd770004d50 2024-05-30T17:04:31.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd783400640 1 -- 172.21.15.59:0/4026883048 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5186 (secure 0 0 0) 0x7fd77c059d90 con 0x7fd770004d50 2024-05-30T17:04:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:31.056 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3073990640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3073990640},{"type":"v1","addr":"172.21.15.107:6836","nonce":3073990640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1431726734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1431726734},{"type":"v1","addr":"172.21.15.107:6837","nonce":1431726734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":8988,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/410571111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":410571111},{"type":"v1","addr":"172.21.15.59:6834","nonce":410571111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:04:27.043818+0000","modified":"2024-05-30T17:04:30.067824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8991},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8991":{"gid":8991,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/1040424272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1040424272},{"type":"v1","addr":"172.21.15.59:6835","nonce":1040424272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8991,"qdb_cluster":[8991]},"id":9}]} 2024-05-30T17:04:31.056 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 81 2024-05-30T17:04:31.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd791600640 1 -- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd768069fa0 msgr2=0x7fd76806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd791600640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd768069fa0 0x7fd76806c460 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd78c1600a0 tx=0x7fd774009040 comp rx=0 tx=0).stop 2024-05-30T17:04:31.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd791600640 1 -- 172.21.15.59:0/4026883048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd770004d50 msgr2=0x7fd78c1f5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd791600640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd770004d50 0x7fd78c1f5110 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0017f0 tx=0x7fd77c012920 comp rx=0 tx=0).stop 2024-05-30T17:04:31.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd791600640 1 -- 172.21.15.59:0/4026883048 shutdown_connections 2024-05-30T17:04:31.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd791600640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd768069fa0 0x7fd76806c460 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd791600640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0b7e00 0x7fd78c0b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd791600640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd78c0b7980 0x7fd78c0c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd791600640 1 --2- 172.21.15.59:0/4026883048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd770004d50 0x7fd78c1f5110 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd791600640 1 -- 172.21.15.59:0/4026883048 >> 172.21.15.59:0/4026883048 conn(0x7fd78c0b3f80 msgr2=0x7fd78c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:31.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd791600640 1 -- 172.21.15.59:0/4026883048 shutdown_connections 2024-05-30T17:04:31.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.057+0000 7fd791600640 1 -- 172.21.15.59:0/4026883048 wait complete. 2024-05-30T17:04:31.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:04:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.217+0000 7f1e5a400640 1 Processor -- start 2024-05-30T17:04:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.217+0000 7f1e5a400640 1 -- start start 2024-05-30T17:04:31.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e5a400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1e5406e900 0x7f1e5415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e5a400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e540d0560 0x7f1e540d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e5a400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e5415f060 con 0x7f1e540af720 2024-05-30T17:04:31.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e5a400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1e540afb00 con 0x7f1e5406e900 2024-05-30T17:04:31.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e5a400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1e5415c270 con 0x7f1e540d0560 2024-05-30T17:04:31.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e53400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1e540af720 0x7f1e5415b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41122/0 (socket says 172.21.15.59:41122) 2024-05-30T17:04:31.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e53400640 1 -- 172.21.15.59:0/277467182 learned_addr learned my addr 172.21.15.59:0/277467182 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:31.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e53e00640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e540d0560 0x7f1e540d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e4be00640 1 --2- 172.21.15.59:0/277467182 >> v2:172.21.15.107:3300/0 conn(0x7f1e5406e900 0x7f1e5415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2090042159 0 0) 0x7f1e5415f060 con 0x7f1e540af720 2024-05-30T17:04:31.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e38003530 con 0x7f1e540af720 2024-05-30T17:04:31.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1707029823 0 0) 0x7f1e38003530 con 0x7f1e540af720 2024-05-30T17:04:31.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e540d0560 msgr2=0x7f1e540d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:31.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e540d0560 0x7f1e540d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 >> v2:172.21.15.107:3300/0 conn(0x7f1e5406e900 msgr2=0x7f1e5415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 --2- 172.21.15.59:0/277467182 >> v2:172.21.15.107:3300/0 conn(0x7f1e5406e900 0x7f1e5415f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5415c550 con 0x7f1e540af720 2024-05-30T17:04:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f1e44001680 con 0x7f1e540af720 2024-05-30T17:04:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 >> v1:172.21.15.59:6789/0 conn(0x7f1e540af720 legacy=0x7f1e5415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e540d0560 0x7f1e380039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e38003f40 0x7f1e38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e38004d50 0x7f1e380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1e540afb00 con 0x7f1e38004d50 2024-05-30T17:04:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5415c270 con 0x7f1e38003f40 2024-05-30T17:04:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3800b9d0 con 0x7f1e540d0560 2024-05-30T17:04:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e53e00640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e38004d50 0x7f1e380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e53400640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e540d0560 0x7f1e380039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e4be00640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e38003f40 0x7f1e38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e53e00640 1 -- 172.21.15.59:0/277467182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e540d0560 msgr2=0x7f1e380039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e53e00640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e540d0560 0x7f1e380039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e53e00640 1 -- 172.21.15.59:0/277467182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e38003f40 msgr2=0x7f1e38004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e53e00640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e38003f40 0x7f1e38004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e53e00640 1 -- 172.21.15.59:0/277467182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e38003530 con 0x7f1e38004d50 2024-05-30T17:04:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.221+0000 7f1e4be00640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e38003f40 0x7f1e38004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:31.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.225+0000 7f1e53e00640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e38004d50 0x7f1e380051d0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009fc0 tx=0x7f1e4c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aea4a3eabba1da9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:31.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.225+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c0b2070 con 0x7f1e38004d50 2024-05-30T17:04:31.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.225+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c0a5c90 con 0x7f1e38004d50 2024-05-30T17:04:31.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.225+0000 7f1e52a00640 1 -- 172.21.15.59:0/277467182 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c009c10 con 0x7f1e38004d50 2024-05-30T17:04:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.225+0000 7f1e5a400640 1 -- 172.21.15.59:0/277467182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e38004d50 msgr2=0x7f1e380051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.225+0000 7f1e5a400640 1 --2- 172.21.15.59:0/277467182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e38004d50 0x7f1e380051d0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009fc0 tx=0x7f1e4c01cc20 comp rx=0 tx=0).stop 2024-05-30T17:04:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.225+0000 7f1e53e00640 1 -- 172.21.15.59:0/277467182 reap_dead start 2024-05-30T17:04:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.225+0000 7f1e5a400640 1 -- 172.21.15.59:0/277467182 shutdown_connections 2024-05-30T17:04:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.225+0000 7f1e5a400640 1 -- 172.21.15.59:0/277467182 >> 172.21.15.59:0/277467182 conn(0x7f1e540b22d0 msgr2=0x7f1e540b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.225+0000 7f1e5a400640 1 -- 172.21.15.59:0/277467182 shutdown_connections 2024-05-30T17:04:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.225+0000 7f1e5a400640 1 -- 172.21.15.59:0/277467182 wait complete. 2024-05-30T17:04:31.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e5a400640 1 Processor -- start 2024-05-30T17:04:31.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e5a400640 1 -- start start 2024-05-30T17:04:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e5a400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e38004d50 0x7f1e5409dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e5a400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e541495d0 0x7f1e5409ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e5a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409b180 0x7f1e54159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e5a400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5415fd30 con 0x7f1e5409b180 2024-05-30T17:04:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e5a400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5415c830 con 0x7f1e541495d0 2024-05-30T17:04:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e5a400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1e5415feb0 con 0x7f1e38004d50 2024-05-30T17:04:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e53e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409b180 0x7f1e54159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e53400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e38004d50 0x7f1e5409dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e53e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409b180 0x7f1e54159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43432/0 (socket says 172.21.15.59:43432) 2024-05-30T17:04:31.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e53e00640 1 -- 172.21.15.59:0/1499056552 learned_addr learned my addr 172.21.15.59:0/1499056552 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:31.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e4be00640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e541495d0 0x7f1e5409ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e53e00640 1 -- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e38004d50 msgr2=0x7f1e5409dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e53e00640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e38004d50 0x7f1e5409dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e53e00640 1 -- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e541495d0 msgr2=0x7f1e5409ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e53e00640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e541495d0 0x7f1e5409ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e53e00640 1 -- 172.21.15.59:0/1499056552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5409e290 con 0x7f1e5409b180 2024-05-30T17:04:31.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e53e00640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409b180 0x7f1e54159840 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c002240 tx=0x7f1e4c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:31.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e4b400640 1 -- 172.21.15.59:0/1499056552 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c0bd070 con 0x7f1e5409b180 2024-05-30T17:04:31.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e4b400640 1 -- 172.21.15.59:0/1499056552 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c0a5a90 con 0x7f1e5409b180 2024-05-30T17:04:31.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e4b400640 1 -- 172.21.15.59:0/1499056552 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c0b2040 con 0x7f1e5409b180 2024-05-30T17:04:31.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e5a400640 1 -- 172.21.15.59:0/1499056552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5409ccf0 con 0x7f1e5409b180 2024-05-30T17:04:31.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.229+0000 7f1e5a400640 1 -- 172.21.15.59:0/1499056552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e5409d270 con 0x7f1e5409b180 2024-05-30T17:04:31.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.233+0000 7f1e5a400640 1 -- 172.21.15.59:0/1499056552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e54068a90 con 0x7f1e5409b180 2024-05-30T17:04:31.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.233+0000 7f1e4b400640 1 -- 172.21.15.59:0/1499056552 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f1e4c0c0070 con 0x7f1e5409b180 2024-05-30T17:04:31.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.233+0000 7f1e4b400640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e30069fa0 0x7f1e3006c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.233+0000 7f1e4b400640 1 -- 172.21.15.59:0/1499056552 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7f1e4c11f6f0 con 0x7f1e5409b180 2024-05-30T17:04:31.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.233+0000 7f1e53400640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e30069fa0 0x7f1e3006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.233+0000 7f1e53400640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e30069fa0 0x7f1e3006c460 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1e44000c10 tx=0x7f1e44007980 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:31.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.237+0000 7f1e4b400640 1 -- 172.21.15.59:0/1499056552 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1e5409e290 con 0x7f1e5409b180 2024-05-30T17:04:31.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.401+0000 7f1e5a400640 1 -- 172.21.15.59:0/1499056552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e5406cd10 con 0x7f1e5409b180 2024-05-30T17:04:31.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e4b400640 1 -- 172.21.15.59:0/1499056552 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16843 (secure 0 0 0) 0x7f1e4c016990 con 0x7f1e5409b180 2024-05-30T17:04:31.405 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:31.405 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":131,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:04:28.637769+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:04:24.731956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-05-30T17:04:26.001487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:04:31.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e5a400640 1 -- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e30069fa0 msgr2=0x7f1e3006c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e5a400640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e30069fa0 0x7f1e3006c460 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1e44000c10 tx=0x7f1e44007980 comp rx=0 tx=0).stop 2024-05-30T17:04:31.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e5a400640 1 -- 172.21.15.59:0/1499056552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409b180 msgr2=0x7f1e54159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e5a400640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409b180 0x7f1e54159840 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c002240 tx=0x7f1e4c009750 comp rx=0 tx=0).stop 2024-05-30T17:04:31.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e5a400640 1 -- 172.21.15.59:0/1499056552 shutdown_connections 2024-05-30T17:04:31.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e5a400640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1e30069fa0 0x7f1e3006c460 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e5a400640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409b180 0x7f1e54159840 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e5a400640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e541495d0 0x7f1e5409ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e5a400640 1 --2- 172.21.15.59:0/1499056552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e38004d50 0x7f1e5409dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e5a400640 1 -- 172.21.15.59:0/1499056552 >> 172.21.15.59:0/1499056552 conn(0x7f1e540b22d0 msgr2=0x7f1e5406f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:31.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e5a400640 1 -- 172.21.15.59:0/1499056552 shutdown_connections 2024-05-30T17:04:31.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.405+0000 7f1e5a400640 1 -- 172.21.15.59:0/1499056552 wait complete. 2024-05-30T17:04:31.426 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T17:04:31.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42eca00640 1 Processor -- start 2024-05-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42eca00640 1 -- start start 2024-05-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42eca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42e80ce420 0x7f42e80b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42eca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f42e80b39b0 0x7f42e806cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42eca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42e806dab0 0x7f42e806d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42eca00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f42e80cc9c0 con 0x7f42e806dab0 2024-05-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42eca00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f42e80ce800 con 0x7f42e80b39b0 2024-05-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42eca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f42e809b450 con 0x7f42e80ce420 2024-05-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42e7200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42e806dab0 0x7f42e806d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42e7200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42e806dab0 0x7f42e806d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43446/0 (socket says 172.21.15.59:43446) 2024-05-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42e7200640 1 -- 172.21.15.59:0/1127751640 learned_addr learned my addr 172.21.15.59:0/1127751640 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42dfe00640 1 --2- 172.21.15.59:0/1127751640 >> v2:172.21.15.107:3300/0 conn(0x7f42e80b39b0 0x7f42e806cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42e6800640 1 --2- 172.21.15.59:0/1127751640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42e80ce420 0x7f42e80b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42e7200640 1 -- 172.21.15.59:0/1127751640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42e80ce420 msgr2=0x7f42e80b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42e7200640 1 --2- 172.21.15.59:0/1127751640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42e80ce420 0x7f42e80b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42e7200640 1 -- 172.21.15.59:0/1127751640 >> v2:172.21.15.107:3300/0 conn(0x7f42e80b39b0 msgr2=0x7f42e806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42e7200640 1 --2- 172.21.15.59:0/1127751640 >> v2:172.21.15.107:3300/0 conn(0x7f42e80b39b0 0x7f42e806cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.569+0000 7f42e7200640 1 -- 172.21.15.59:0/1127751640 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e809b730 con 0x7f42e806dab0 2024-05-30T17:04:31.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42e7200640 1 --2- 172.21.15.59:0/1127751640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42e806dab0 0x7f42e806d430 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f42e8073ba0 tx=0x7f42e001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ec58395d77f8c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:31.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42e5e00640 1 -- 172.21.15.59:0/1127751640 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e00a5760 con 0x7f42e806dab0 2024-05-30T17:04:31.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42e5e00640 1 -- 172.21.15.59:0/1127751640 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e00a5900 con 0x7f42e806dab0 2024-05-30T17:04:31.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42e5e00640 1 -- 172.21.15.59:0/1127751640 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e00a5cd0 con 0x7f42e806dab0 2024-05-30T17:04:31.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42eca00640 1 -- 172.21.15.59:0/1127751640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42e806dab0 msgr2=0x7f42e806d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42eca00640 1 --2- 172.21.15.59:0/1127751640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42e806dab0 0x7f42e806d430 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f42e8073ba0 tx=0x7f42e001c9f0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42eca00640 1 -- 172.21.15.59:0/1127751640 shutdown_connections 2024-05-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42eca00640 1 --2- 172.21.15.59:0/1127751640 >> v2:172.21.15.107:3300/0 conn(0x7f42e80b39b0 0x7f42e806cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42eca00640 1 --2- 172.21.15.59:0/1127751640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42e806dab0 0x7f42e806d430 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42eca00640 1 --2- 172.21.15.59:0/1127751640 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42e80ce420 0x7f42e80b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42eca00640 1 -- 172.21.15.59:0/1127751640 >> 172.21.15.59:0/1127751640 conn(0x7f42e80d2370 msgr2=0x7f42e80d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42eca00640 1 -- 172.21.15.59:0/1127751640 shutdown_connections 2024-05-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42eca00640 1 -- 172.21.15.59:0/1127751640 wait complete. 2024-05-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42eca00640 1 Processor -- start 2024-05-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.573+0000 7f42eca00640 1 -- start start 2024-05-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42eca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42e806dab0 0x7f42e815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42eca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e80b39b0 0x7f42e815fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42eca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42e80ce420 0x7f42e80b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42eca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f42e80b26e0 con 0x7f42e80ce420 2024-05-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42eca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f42e80b2560 con 0x7f42e80b39b0 2024-05-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42eca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f42e80b2860 con 0x7f42e806dab0 2024-05-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42e7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42e80ce420 0x7f42e80b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42e7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42e80ce420 0x7f42e80b6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43454/0 (socket says 172.21.15.59:43454) 2024-05-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42e7200640 1 -- 172.21.15.59:0/1641848296 learned_addr learned my addr 172.21.15.59:0/1641848296 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42dfe00640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e80b39b0 0x7f42e815fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42e6800640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42e806dab0 0x7f42e815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42e7200640 1 -- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42e806dab0 msgr2=0x7f42e815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42e7200640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42e806dab0 0x7f42e815b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42e7200640 1 -- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e80b39b0 msgr2=0x7f42e815fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42e7200640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e80b39b0 0x7f42e815fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42e7200640 1 -- 172.21.15.59:0/1641848296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e8160830 con 0x7f42e80ce420 2024-05-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42e7200640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42e80ce420 0x7f42e80b6f20 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f42e00af040 tx=0x7f42e0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42dea00640 1 -- 172.21.15.59:0/1641848296 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e00bc020 con 0x7f42e80ce420 2024-05-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42dea00640 1 -- 172.21.15.59:0/1641848296 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e00b8670 con 0x7f42e80ce420 2024-05-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42dea00640 1 -- 172.21.15.59:0/1641848296 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e00b8a60 con 0x7f42e80ce420 2024-05-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42eca00640 1 -- 172.21.15.59:0/1641848296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e8160b10 con 0x7f42e80ce420 2024-05-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42eca00640 1 -- 172.21.15.59:0/1641848296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e80ca560 con 0x7f42e80ce420 2024-05-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.577+0000 7f42eca00640 1 -- 172.21.15.59:0/1641848296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e80691a0 con 0x7f42e80ce420 2024-05-30T17:04:31.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.581+0000 7f42dea00640 1 -- 172.21.15.59:0/1641848296 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f42e00bf020 con 0x7f42e80ce420 2024-05-30T17:04:31.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.581+0000 7f42dea00640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f42c4069fa0 0x7f42c406c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.581+0000 7f42dea00640 1 -- 172.21.15.59:0/1641848296 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7f42e0120ad0 con 0x7f42e80ce420 2024-05-30T17:04:31.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.581+0000 7f42e6800640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f42c4069fa0 0x7f42c406c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.581+0000 7f42e6800640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f42c4069fa0 0x7f42c406c460 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f42e80cded0 tx=0x7f42d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.585+0000 7f42dea00640 1 -- 172.21.15.59:0/1641848296 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f42e00c6030 con 0x7f42e80ce420 2024-05-30T17:04:31.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.745+0000 7f42eca00640 1 -- 172.21.15.59:0/1641848296 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42e806cac0 con 0x7f42c4069fa0 2024-05-30T17:04:31.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42dea00640 1 -- 172.21.15.59:0/1641848296 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247786 (secure 0 0 0) 0x7f42e806cac0 con 0x7f42c4069fa0 2024-05-30T17:04:31.758 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:31.760 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:04:31.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42eca00640 1 -- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f42c4069fa0 msgr2=0x7f42c406c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42eca00640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f42c4069fa0 0x7f42c406c460 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f42e80cded0 tx=0x7f42d8008040 comp rx=0 tx=0).stop 2024-05-30T17:04:31.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42eca00640 1 -- 172.21.15.59:0/1641848296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42e80ce420 msgr2=0x7f42e80b6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42eca00640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42e80ce420 0x7f42e80b6f20 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f42e00af040 tx=0x7f42e0019790 comp rx=0 tx=0).stop 2024-05-30T17:04:31.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42eca00640 1 -- 172.21.15.59:0/1641848296 shutdown_connections 2024-05-30T17:04:31.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42eca00640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f42c4069fa0 0x7f42c406c460 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42eca00640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42e80ce420 0x7f42e80b6f20 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42eca00640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e80b39b0 0x7f42e815fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42eca00640 1 --2- 172.21.15.59:0/1641848296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42e806dab0 0x7f42e815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42eca00640 1 -- 172.21.15.59:0/1641848296 >> 172.21.15.59:0/1641848296 conn(0x7f42e80d2370 msgr2=0x7f42e806cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42eca00640 1 -- 172.21.15.59:0/1641848296 shutdown_connections 2024-05-30T17:04:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.757+0000 7f42eca00640 1 -- 172.21.15.59:0/1641848296 wait complete. 2024-05-30T17:04:31.779 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":594,"stamp":"2024-05-30T17:04:31.379140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1012332,"kb_used_data":13668,"kb_used_omap":12,"kb_used_meta":998515,"kb_avail":753962388,"statfs":{"total":773094113280,"available":772057485312,"internally_reserved":0,"allocated":13996032,"data_stored":6795642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1022479920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.750927"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.644930+0000","last_change":"2024-05-30T17:04:26.644930+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.644930+0000","last_undegraded":"2024-05-30T17:04:26.644930+0000","last_fullsized":"2024-05-30T17:04:26.644930+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635506+0000","last_change":"2024-05-30T17:04:26.635506+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635506+0000","last_undegraded":"2024-05-30T17:04:26.635506+0000","last_fullsized":"2024-05-30T17:04:26.635506+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638311+0000","last_change":"2024-05-30T17:04:26.638311+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638311+0000","last_undegraded":"2024-05-30T17:04:26.638311+0000","last_fullsized":"2024-05-30T17:04:26.638311+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.641744+0000","last_change":"2024-05-30T17:04:26.641744+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.641744+0000","last_undegraded":"2024-05-30T17:04:26.641744+0000","last_fullsized":"2024-05-30T17:04:26.641744+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.640547+0000","last_change":"2024-05-30T17:04:26.640547+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.640547+0000","last_undegraded":"2024-05-30T17:04:26.640547+0000","last_fullsized":"2024-05-30T17:04:26.640547+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631350+0000","last_change":"2024-05-30T17:04:26.631350+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631350+0000","last_undegraded":"2024-05-30T17:04:26.631350+0000","last_fullsized":"2024-05-30T17:04:26.631350+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631189+0000","last_change":"2024-05-30T17:04:26.631189+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631189+0000","last_undegraded":"2024-05-30T17:04:26.631189+0000","last_fullsized":"2024-05-30T17:04:26.631189+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636699+0000","last_change":"2024-05-30T17:04:26.636699+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636699+0000","last_undegraded":"2024-05-30T17:04:26.636699+0000","last_fullsized":"2024-05-30T17:04:26.636699+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.637191+0000","last_change":"2024-05-30T17:04:26.637191+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.637191+0000","last_undegraded":"2024-05-30T17:04:26.637191+0000","last_fullsized":"2024-05-30T17:04:26.637191+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.634999+0000","last_change":"2024-05-30T17:04:26.634999+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.634999+0000","last_undegraded":"2024-05-30T17:04:26.634999+0000","last_fullsized":"2024-05-30T17:04:26.634999+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.639123+0000","last_change":"2024-05-30T17:04:26.639123+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.639123+0000","last_undegraded":"2024-05-30T17:04:26.639123+0000","last_fullsized":"2024-05-30T17:04:26.639123+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635832+0000","last_change":"2024-05-30T17:04:26.635832+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635832+0000","last_undegraded":"2024-05-30T17:04:26.635832+0000","last_fullsized":"2024-05-30T17:04:26.635832+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.653335+0000","last_change":"2024-05-30T17:04:26.653335+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.653335+0000","last_undegraded":"2024-05-30T17:04:26.653335+0000","last_fullsized":"2024-05-30T17:04:26.653335+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635330+0000","last_change":"2024-05-30T17:04:26.635330+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635330+0000","last_undegraded":"2024-05-30T17:04:26.635330+0000","last_fullsized":"2024-05-30T17:04:26.635330+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638835+0000","last_change":"2024-05-30T17:04:26.638835+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638835+0000","last_undegraded":"2024-05-30T17:04:26.638835+0000","last_fullsized":"2024-05-30T17:04:26.638835+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266123+0000","last_change":"2024-05-30T17:04:27.656402+0000","last_active":"2024-05-30T17:04:29.266123+0000","last_peered":"2024-05-30T17:04:29.266123+0000","last_clean":"2024-05-30T17:04:29.266123+0000","last_became_active":"2024-05-30T17:04:27.656141+0000","last_became_peered":"2024-05-30T17:04:27.656141+0000","last_unstale":"2024-05-30T17:04:29.266123+0000","last_undegraded":"2024-05-30T17:04:29.266123+0000","last_fullsized":"2024-05-30T17:04:29.266123+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:08.433002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631847+0000","last_change":"2024-05-30T17:04:26.631847+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631847+0000","last_undegraded":"2024-05-30T17:04:26.631847+0000","last_fullsized":"2024-05-30T17:04:26.631847+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266584+0000","last_change":"2024-05-30T17:04:27.650889+0000","last_active":"2024-05-30T17:04:29.266584+0000","last_peered":"2024-05-30T17:04:29.266584+0000","last_clean":"2024-05-30T17:04:29.266584+0000","last_became_active":"2024-05-30T17:04:27.649462+0000","last_became_peered":"2024-05-30T17:04:27.649462+0000","last_unstale":"2024-05-30T17:04:29.266584+0000","last_undegraded":"2024-05-30T17:04:29.266584+0000","last_fullsized":"2024-05-30T17:04:29.266584+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:02:33.740142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636711+0000","last_change":"2024-05-30T17:04:26.636711+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636711+0000","last_undegraded":"2024-05-30T17:04:26.636711+0000","last_fullsized":"2024-05-30T17:04:26.636711+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266495+0000","last_change":"2024-05-30T17:04:27.652401+0000","last_active":"2024-05-30T17:04:29.266495+0000","last_peered":"2024-05-30T17:04:29.266495+0000","last_clean":"2024-05-30T17:04:29.266495+0000","last_became_active":"2024-05-30T17:04:27.652097+0000","last_became_peered":"2024-05-30T17:04:27.652097+0000","last_unstale":"2024-05-30T17:04:29.266495+0000","last_undegraded":"2024-05-30T17:04:29.266495+0000","last_fullsized":"2024-05-30T17:04:29.266495+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:22:37.455945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.639170+0000","last_change":"2024-05-30T17:04:26.639170+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.639170+0000","last_undegraded":"2024-05-30T17:04:26.639170+0000","last_fullsized":"2024-05-30T17:04:26.639170+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638697+0000","last_change":"2024-05-30T17:04:26.638697+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638697+0000","last_undegraded":"2024-05-30T17:04:26.638697+0000","last_fullsized":"2024-05-30T17:04:26.638697+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635293+0000","last_change":"2024-05-30T17:04:26.635293+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635293+0000","last_undegraded":"2024-05-30T17:04:26.635293+0000","last_fullsized":"2024-05-30T17:04:26.635293+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638008+0000","last_change":"2024-05-30T17:04:26.638008+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638008+0000","last_undegraded":"2024-05-30T17:04:26.638008+0000","last_fullsized":"2024-05-30T17:04:26.638008+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635275+0000","last_change":"2024-05-30T17:04:26.635275+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635275+0000","last_undegraded":"2024-05-30T17:04:26.635275+0000","last_fullsized":"2024-05-30T17:04:26.635275+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266595+0000","last_change":"2024-05-30T17:04:27.657224+0000","last_active":"2024-05-30T17:04:29.266595+0000","last_peered":"2024-05-30T17:04:29.266595+0000","last_clean":"2024-05-30T17:04:29.266595+0000","last_became_active":"2024-05-30T17:04:27.656941+0000","last_became_peered":"2024-05-30T17:04:27.656941+0000","last_unstale":"2024-05-30T17:04:29.266595+0000","last_undegraded":"2024-05-30T17:04:29.266595+0000","last_fullsized":"2024-05-30T17:04:29.266595+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:33.680204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.641374+0000","last_change":"2024-05-30T17:04:26.641374+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.641374+0000","last_undegraded":"2024-05-30T17:04:26.641374+0000","last_fullsized":"2024-05-30T17:04:26.641374+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631634+0000","last_change":"2024-05-30T17:04:26.631634+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631634+0000","last_undegraded":"2024-05-30T17:04:26.631634+0000","last_fullsized":"2024-05-30T17:04:26.631634+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.652897+0000","last_change":"2024-05-30T17:04:26.652897+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.652897+0000","last_undegraded":"2024-05-30T17:04:26.652897+0000","last_fullsized":"2024-05-30T17:04:26.652897+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.640606+0000","last_change":"2024-05-30T17:04:26.640606+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.640606+0000","last_undegraded":"2024-05-30T17:04:26.640606+0000","last_fullsized":"2024-05-30T17:04:26.640606+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636920+0000","last_change":"2024-05-30T17:04:26.636920+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636920+0000","last_undegraded":"2024-05-30T17:04:26.636920+0000","last_fullsized":"2024-05-30T17:04:26.636920+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631593+0000","last_change":"2024-05-30T17:04:26.631593+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631593+0000","last_undegraded":"2024-05-30T17:04:26.631593+0000","last_fullsized":"2024-05-30T17:04:26.631593+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266938+0000","last_change":"2024-05-30T17:04:27.665116+0000","last_active":"2024-05-30T17:04:29.266938+0000","last_peered":"2024-05-30T17:04:29.266938+0000","last_clean":"2024-05-30T17:04:29.266938+0000","last_became_active":"2024-05-30T17:04:27.664853+0000","last_became_peered":"2024-05-30T17:04:27.664853+0000","last_unstale":"2024-05-30T17:04:29.266938+0000","last_undegraded":"2024-05-30T17:04:29.266938+0000","last_fullsized":"2024-05-30T17:04:29.266938+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:00.380018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654288+0000","last_change":"2024-05-30T17:04:26.653769+0000","last_active":"2024-05-30T17:04:26.654288+0000","last_peered":"2024-05-30T17:04:26.654288+0000","last_clean":"2024-05-30T17:04:26.654288+0000","last_became_active":"2024-05-30T17:04:26.653331+0000","last_became_peered":"2024-05-30T17:04:26.653331+0000","last_unstale":"2024-05-30T17:04:26.654288+0000","last_undegraded":"2024-05-30T17:04:26.654288+0000","last_fullsized":"2024-05-30T17:04:26.654288+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:38:18.013111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636758+0000","last_change":"2024-05-30T17:04:26.636758+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636758+0000","last_undegraded":"2024-05-30T17:04:26.636758+0000","last_fullsized":"2024-05-30T17:04:26.636758+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.653121+0000","last_change":"2024-05-30T17:04:26.652574+0000","last_active":"2024-05-30T17:04:26.653121+0000","last_peered":"2024-05-30T17:04:26.653121+0000","last_clean":"2024-05-30T17:04:26.653121+0000","last_became_active":"2024-05-30T17:04:26.652142+0000","last_became_peered":"2024-05-30T17:04:26.652142+0000","last_unstale":"2024-05-30T17:04:26.653121+0000","last_undegraded":"2024-05-30T17:04:26.653121+0000","last_fullsized":"2024-05-30T17:04:26.653121+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:02.750449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636140+0000","last_change":"2024-05-30T17:04:26.636140+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636140+0000","last_undegraded":"2024-05-30T17:04:26.636140+0000","last_fullsized":"2024-05-30T17:04:26.636140+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654798+0000","last_change":"2024-05-30T17:04:26.652502+0000","last_active":"2024-05-30T17:04:26.654798+0000","last_peered":"2024-05-30T17:04:26.654798+0000","last_clean":"2024-05-30T17:04:26.654798+0000","last_became_active":"2024-05-30T17:04:26.652240+0000","last_became_peered":"2024-05-30T17:04:26.652240+0000","last_unstale":"2024-05-30T17:04:26.654798+0000","last_undegraded":"2024-05-30T17:04:26.654798+0000","last_fullsized":"2024-05-30T17:04:26.654798+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:41:52.185908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638376+0000","last_change":"2024-05-30T17:04:26.638376+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638376+0000","last_undegraded":"2024-05-30T17:04:26.638376+0000","last_fullsized":"2024-05-30T17:04:26.638376+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.650236+0000","last_change":"2024-05-30T17:04:26.644729+0000","last_active":"2024-05-30T17:04:26.650236+0000","last_peered":"2024-05-30T17:04:26.650236+0000","last_clean":"2024-05-30T17:04:26.650236+0000","last_became_active":"2024-05-30T17:04:26.644381+0000","last_became_peered":"2024-05-30T17:04:26.644381+0000","last_unstale":"2024-05-30T17:04:26.650236+0000","last_undegraded":"2024-05-30T17:04:26.650236+0000","last_fullsized":"2024-05-30T17:04:26.650236+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:12.851756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266155+0000","last_change":"2024-05-30T17:04:27.650774+0000","last_active":"2024-05-30T17:04:29.266155+0000","last_peered":"2024-05-30T17:04:29.266155+0000","last_clean":"2024-05-30T17:04:29.266155+0000","last_became_active":"2024-05-30T17:04:27.649829+0000","last_became_peered":"2024-05-30T17:04:27.649829+0000","last_unstale":"2024-05-30T17:04:29.266155+0000","last_undegraded":"2024-05-30T17:04:29.266155+0000","last_fullsized":"2024-05-30T17:04:29.266155+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:43:56.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654476+0000","last_change":"2024-05-30T17:04:26.649081+0000","last_active":"2024-05-30T17:04:26.654476+0000","last_peered":"2024-05-30T17:04:26.654476+0000","last_clean":"2024-05-30T17:04:26.654476+0000","last_became_active":"2024-05-30T17:04:26.648809+0000","last_became_peered":"2024-05-30T17:04:26.648809+0000","last_unstale":"2024-05-30T17:04:26.654476+0000","last_undegraded":"2024-05-30T17:04:26.654476+0000","last_fullsized":"2024-05-30T17:04:26.654476+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:28.984517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.632838+0000","last_change":"2024-05-30T17:04:26.632838+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.632838+0000","last_undegraded":"2024-05-30T17:04:26.632838+0000","last_fullsized":"2024-05-30T17:04:26.632838+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266208+0000","last_change":"2024-05-30T17:04:26.650934+0000","last_active":"2024-05-30T17:04:29.266208+0000","last_peered":"2024-05-30T17:04:29.266208+0000","last_clean":"2024-05-30T17:04:29.266208+0000","last_became_active":"2024-05-30T17:04:26.650668+0000","last_became_peered":"2024-05-30T17:04:26.650668+0000","last_unstale":"2024-05-30T17:04:29.266208+0000","last_undegraded":"2024-05-30T17:04:29.266208+0000","last_fullsized":"2024-05-30T17:04:29.266208+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:04.028994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636215+0000","last_change":"2024-05-30T17:04:26.636215+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636215+0000","last_undegraded":"2024-05-30T17:04:26.636215+0000","last_fullsized":"2024-05-30T17:04:26.636215+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.645187+0000","last_change":"2024-05-30T17:04:26.642168+0000","last_active":"2024-05-30T17:04:26.645187+0000","last_peered":"2024-05-30T17:04:26.645187+0000","last_clean":"2024-05-30T17:04:26.645187+0000","last_became_active":"2024-05-30T17:04:26.641791+0000","last_became_peered":"2024-05-30T17:04:26.641791+0000","last_unstale":"2024-05-30T17:04:26.645187+0000","last_undegraded":"2024-05-30T17:04:26.645187+0000","last_fullsized":"2024-05-30T17:04:26.645187+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:41:35.345382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.634592+0000","last_change":"2024-05-30T17:04:26.634592+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.634592+0000","last_undegraded":"2024-05-30T17:04:26.634592+0000","last_fullsized":"2024-05-30T17:04:26.634592+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.646230+0000","last_change":"2024-05-30T17:04:26.645457+0000","last_active":"2024-05-30T17:04:26.646230+0000","last_peered":"2024-05-30T17:04:26.646230+0000","last_clean":"2024-05-30T17:04:26.646230+0000","last_became_active":"2024-05-30T17:04:26.642988+0000","last_became_peered":"2024-05-30T17:04:26.642988+0000","last_unstale":"2024-05-30T17:04:26.646230+0000","last_undegraded":"2024-05-30T17:04:26.646230+0000","last_fullsized":"2024-05-30T17:04:26.646230+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:56:53.520715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.643824+0000","last_change":"2024-05-30T17:04:26.643824+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.643824+0000","last_undegraded":"2024-05-30T17:04:26.643824+0000","last_fullsized":"2024-05-30T17:04:26.643824+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654544+0000","last_change":"2024-05-30T17:04:26.653783+0000","last_active":"2024-05-30T17:04:26.654544+0000","last_peered":"2024-05-30T17:04:26.654544+0000","last_clean":"2024-05-30T17:04:26.654544+0000","last_became_active":"2024-05-30T17:04:26.653413+0000","last_became_peered":"2024-05-30T17:04:26.653413+0000","last_unstale":"2024-05-30T17:04:26.654544+0000","last_undegraded":"2024-05-30T17:04:26.654544+0000","last_fullsized":"2024-05-30T17:04:26.654544+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:14.217436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633032+0000","last_change":"2024-05-30T17:04:26.633032+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633032+0000","last_undegraded":"2024-05-30T17:04:26.633032+0000","last_fullsized":"2024-05-30T17:04:26.633032+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266674+0000","last_change":"2024-05-30T17:04:26.649285+0000","last_active":"2024-05-30T17:04:29.266674+0000","last_peered":"2024-05-30T17:04:29.266674+0000","last_clean":"2024-05-30T17:04:29.266674+0000","last_became_active":"2024-05-30T17:04:26.648983+0000","last_became_peered":"2024-05-30T17:04:26.648983+0000","last_unstale":"2024-05-30T17:04:29.266674+0000","last_undegraded":"2024-05-30T17:04:29.266674+0000","last_fullsized":"2024-05-30T17:04:29.266674+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:19.123667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635575+0000","last_change":"2024-05-30T17:04:26.635575+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635575+0000","last_undegraded":"2024-05-30T17:04:26.635575+0000","last_fullsized":"2024-05-30T17:04:26.635575+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.656464+0000","last_change":"2024-05-30T17:04:26.655873+0000","last_active":"2024-05-30T17:04:26.656464+0000","last_peered":"2024-05-30T17:04:26.656464+0000","last_clean":"2024-05-30T17:04:26.656464+0000","last_became_active":"2024-05-30T17:04:26.655436+0000","last_became_peered":"2024-05-30T17:04:26.655436+0000","last_unstale":"2024-05-30T17:04:26.656464+0000","last_undegraded":"2024-05-30T17:04:26.656464+0000","last_fullsized":"2024-05-30T17:04:26.656464+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:20.851133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.637882+0000","last_change":"2024-05-30T17:04:26.637882+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.637882+0000","last_undegraded":"2024-05-30T17:04:26.637882+0000","last_fullsized":"2024-05-30T17:04:26.637882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.646625+0000","last_change":"2024-05-30T17:04:26.644996+0000","last_active":"2024-05-30T17:04:26.646625+0000","last_peered":"2024-05-30T17:04:26.646625+0000","last_clean":"2024-05-30T17:04:26.646625+0000","last_became_active":"2024-05-30T17:04:26.644394+0000","last_became_peered":"2024-05-30T17:04:26.644394+0000","last_unstale":"2024-05-30T17:04:26.646625+0000","last_undegraded":"2024-05-30T17:04:26.646625+0000","last_fullsized":"2024-05-30T17:04:26.646625+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:45:55.504801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.652394+0000","last_change":"2024-05-30T17:04:26.652394+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.652394+0000","last_undegraded":"2024-05-30T17:04:26.652394+0000","last_fullsized":"2024-05-30T17:04:26.652394+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654569+0000","last_change":"2024-05-30T17:04:26.648513+0000","last_active":"2024-05-30T17:04:26.654569+0000","last_peered":"2024-05-30T17:04:26.654569+0000","last_clean":"2024-05-30T17:04:26.654569+0000","last_became_active":"2024-05-30T17:04:26.648016+0000","last_became_peered":"2024-05-30T17:04:26.648016+0000","last_unstale":"2024-05-30T17:04:26.654569+0000","last_undegraded":"2024-05-30T17:04:26.654569+0000","last_fullsized":"2024-05-30T17:04:26.654569+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:23:52.647599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.634425+0000","last_change":"2024-05-30T17:04:26.634425+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.634425+0000","last_undegraded":"2024-05-30T17:04:26.634425+0000","last_fullsized":"2024-05-30T17:04:26.634425+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.646449+0000","last_change":"2024-05-30T17:04:26.643372+0000","last_active":"2024-05-30T17:04:26.646449+0000","last_peered":"2024-05-30T17:04:26.646449+0000","last_clean":"2024-05-30T17:04:26.646449+0000","last_became_active":"2024-05-30T17:04:26.641530+0000","last_became_peered":"2024-05-30T17:04:26.641530+0000","last_unstale":"2024-05-30T17:04:26.646449+0000","last_undegraded":"2024-05-30T17:04:26.646449+0000","last_fullsized":"2024-05-30T17:04:26.646449+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:23:52.647599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635921+0000","last_change":"2024-05-30T17:04:26.635921+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635921+0000","last_undegraded":"2024-05-30T17:04:26.635921+0000","last_fullsized":"2024-05-30T17:04:26.635921+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.652596+0000","last_change":"2024-05-30T17:04:26.651768+0000","last_active":"2024-05-30T17:04:26.652596+0000","last_peered":"2024-05-30T17:04:26.652596+0000","last_clean":"2024-05-30T17:04:26.652596+0000","last_became_active":"2024-05-30T17:04:26.651470+0000","last_became_peered":"2024-05-30T17:04:26.651470+0000","last_unstale":"2024-05-30T17:04:26.652596+0000","last_undegraded":"2024-05-30T17:04:26.652596+0000","last_fullsized":"2024-05-30T17:04:26.652596+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:46.418471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636651+0000","last_change":"2024-05-30T17:04:26.636651+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636651+0000","last_undegraded":"2024-05-30T17:04:26.636651+0000","last_fullsized":"2024-05-30T17:04:26.636651+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.648286+0000","last_change":"2024-05-30T17:04:26.646106+0000","last_active":"2024-05-30T17:04:26.648286+0000","last_peered":"2024-05-30T17:04:26.648286+0000","last_clean":"2024-05-30T17:04:26.648286+0000","last_became_active":"2024-05-30T17:04:26.645435+0000","last_became_peered":"2024-05-30T17:04:26.645435+0000","last_unstale":"2024-05-30T17:04:26.648286+0000","last_undegraded":"2024-05-30T17:04:26.648286+0000","last_fullsized":"2024-05-30T17:04:26.648286+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:24:46.141540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.632603+0000","last_change":"2024-05-30T17:04:26.632603+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.632603+0000","last_undegraded":"2024-05-30T17:04:26.632603+0000","last_fullsized":"2024-05-30T17:04:26.632603+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654939+0000","last_change":"2024-05-30T17:04:26.649232+0000","last_active":"2024-05-30T17:04:26.654939+0000","last_peered":"2024-05-30T17:04:26.654939+0000","last_clean":"2024-05-30T17:04:26.654939+0000","last_became_active":"2024-05-30T17:04:26.648936+0000","last_became_peered":"2024-05-30T17:04:26.648936+0000","last_unstale":"2024-05-30T17:04:26.654939+0000","last_undegraded":"2024-05-30T17:04:26.654939+0000","last_fullsized":"2024-05-30T17:04:26.654939+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:50:10.017227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266652+0000","last_change":"2024-05-30T17:04:27.657488+0000","last_active":"2024-05-30T17:04:29.266652+0000","last_peered":"2024-05-30T17:04:29.266652+0000","last_clean":"2024-05-30T17:04:29.266652+0000","last_became_active":"2024-05-30T17:04:27.657216+0000","last_became_peered":"2024-05-30T17:04:27.657216+0000","last_unstale":"2024-05-30T17:04:29.266652+0000","last_undegraded":"2024-05-30T17:04:29.266652+0000","last_fullsized":"2024-05-30T17:04:29.266652+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:18.543050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.653010+0000","last_change":"2024-05-30T17:04:26.652397+0000","last_active":"2024-05-30T17:04:26.653010+0000","last_peered":"2024-05-30T17:04:26.653010+0000","last_clean":"2024-05-30T17:04:26.653010+0000","last_became_active":"2024-05-30T17:04:26.652083+0000","last_became_peered":"2024-05-30T17:04:26.652083+0000","last_unstale":"2024-05-30T17:04:26.653010+0000","last_undegraded":"2024-05-30T17:04:26.653010+0000","last_fullsized":"2024-05-30T17:04:26.653010+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:37:07.130536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633700+0000","last_change":"2024-05-30T17:04:26.633700+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633700+0000","last_undegraded":"2024-05-30T17:04:26.633700+0000","last_fullsized":"2024-05-30T17:04:26.633700+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.648253+0000","last_change":"2024-05-30T17:04:26.646336+0000","last_active":"2024-05-30T17:04:26.648253+0000","last_peered":"2024-05-30T17:04:26.648253+0000","last_clean":"2024-05-30T17:04:26.648253+0000","last_became_active":"2024-05-30T17:04:26.646025+0000","last_became_peered":"2024-05-30T17:04:26.646025+0000","last_unstale":"2024-05-30T17:04:26.648253+0000","last_undegraded":"2024-05-30T17:04:26.648253+0000","last_fullsized":"2024-05-30T17:04:26.648253+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:33.438380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.640162+0000","last_change":"2024-05-30T17:04:26.640162+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.640162+0000","last_undegraded":"2024-05-30T17:04:26.640162+0000","last_fullsized":"2024-05-30T17:04:26.640162+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.658717+0000","last_change":"2024-05-30T17:04:26.657719+0000","last_active":"2024-05-30T17:04:26.658717+0000","last_peered":"2024-05-30T17:04:26.658717+0000","last_clean":"2024-05-30T17:04:26.658717+0000","last_became_active":"2024-05-30T17:04:26.657452+0000","last_became_peered":"2024-05-30T17:04:26.657452+0000","last_unstale":"2024-05-30T17:04:26.658717+0000","last_undegraded":"2024-05-30T17:04:26.658717+0000","last_fullsized":"2024-05-30T17:04:26.658717+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:05:26.624348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.630967+0000","last_change":"2024-05-30T17:04:26.630967+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.630967+0000","last_undegraded":"2024-05-30T17:04:26.630967+0000","last_fullsized":"2024-05-30T17:04:26.630967+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266335+0000","last_change":"2024-05-30T17:04:26.645875+0000","last_active":"2024-05-30T17:04:29.266335+0000","last_peered":"2024-05-30T17:04:29.266335+0000","last_clean":"2024-05-30T17:04:29.266335+0000","last_became_active":"2024-05-30T17:04:26.645583+0000","last_became_peered":"2024-05-30T17:04:26.645583+0000","last_unstale":"2024-05-30T17:04:29.266335+0000","last_undegraded":"2024-05-30T17:04:29.266335+0000","last_fullsized":"2024-05-30T17:04:29.266335+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:03.486308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633916+0000","last_change":"2024-05-30T17:04:26.633916+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633916+0000","last_undegraded":"2024-05-30T17:04:26.633916+0000","last_fullsized":"2024-05-30T17:04:26.633916+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265914+0000","last_change":"2024-05-30T17:04:26.647421+0000","last_active":"2024-05-30T17:04:29.265914+0000","last_peered":"2024-05-30T17:04:29.265914+0000","last_clean":"2024-05-30T17:04:29.265914+0000","last_became_active":"2024-05-30T17:04:26.647155+0000","last_became_peered":"2024-05-30T17:04:26.647155+0000","last_unstale":"2024-05-30T17:04:29.265914+0000","last_undegraded":"2024-05-30T17:04:29.265914+0000","last_fullsized":"2024-05-30T17:04:29.265914+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:59:52.705838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.637392+0000","last_change":"2024-05-30T17:04:26.637392+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.637392+0000","last_undegraded":"2024-05-30T17:04:26.637392+0000","last_fullsized":"2024-05-30T17:04:26.637392+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.655617+0000","last_change":"2024-05-30T17:04:26.650930+0000","last_active":"2024-05-30T17:04:26.655617+0000","last_peered":"2024-05-30T17:04:26.655617+0000","last_clean":"2024-05-30T17:04:26.655617+0000","last_became_active":"2024-05-30T17:04:26.650616+0000","last_became_peered":"2024-05-30T17:04:26.650616+0000","last_unstale":"2024-05-30T17:04:26.655617+0000","last_undegraded":"2024-05-30T17:04:26.655617+0000","last_fullsized":"2024-05-30T17:04:26.655617+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:39:55.080473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631855+0000","last_change":"2024-05-30T17:04:26.631855+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631855+0000","last_undegraded":"2024-05-30T17:04:26.631855+0000","last_fullsized":"2024-05-30T17:04:26.631855+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654744+0000","last_change":"2024-05-30T17:04:26.653129+0000","last_active":"2024-05-30T17:04:26.654744+0000","last_peered":"2024-05-30T17:04:26.654744+0000","last_clean":"2024-05-30T17:04:26.654744+0000","last_became_active":"2024-05-30T17:04:26.652234+0000","last_became_peered":"2024-05-30T17:04:26.652234+0000","last_unstale":"2024-05-30T17:04:26.654744+0000","last_undegraded":"2024-05-30T17:04:26.654744+0000","last_fullsized":"2024-05-30T17:04:26.654744+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:32.416930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.647675+0000","last_change":"2024-05-30T17:04:26.647675+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.647675+0000","last_undegraded":"2024-05-30T17:04:26.647675+0000","last_fullsized":"2024-05-30T17:04:26.647675+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.650180+0000","last_change":"2024-05-30T17:04:26.649574+0000","last_active":"2024-05-30T17:04:26.650180+0000","last_peered":"2024-05-30T17:04:26.650180+0000","last_clean":"2024-05-30T17:04:26.650180+0000","last_became_active":"2024-05-30T17:04:26.648998+0000","last_became_peered":"2024-05-30T17:04:26.648998+0000","last_unstale":"2024-05-30T17:04:26.650180+0000","last_undegraded":"2024-05-30T17:04:26.650180+0000","last_fullsized":"2024-05-30T17:04:26.650180+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:22.583010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633538+0000","last_change":"2024-05-30T17:04:26.633538+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633538+0000","last_undegraded":"2024-05-30T17:04:26.633538+0000","last_fullsized":"2024-05-30T17:04:26.633538+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654441+0000","last_change":"2024-05-30T17:04:26.647328+0000","last_active":"2024-05-30T17:04:26.654441+0000","last_peered":"2024-05-30T17:04:26.654441+0000","last_clean":"2024-05-30T17:04:26.654441+0000","last_became_active":"2024-05-30T17:04:26.647058+0000","last_became_peered":"2024-05-30T17:04:26.647058+0000","last_unstale":"2024-05-30T17:04:26.654441+0000","last_undegraded":"2024-05-30T17:04:26.654441+0000","last_fullsized":"2024-05-30T17:04:26.654441+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:37:15.984675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631554+0000","last_change":"2024-05-30T17:04:26.631554+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631554+0000","last_undegraded":"2024-05-30T17:04:26.631554+0000","last_fullsized":"2024-05-30T17:04:26.631554+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.656291+0000","last_change":"2024-05-30T17:04:26.655225+0000","last_active":"2024-05-30T17:04:26.656291+0000","last_peered":"2024-05-30T17:04:26.656291+0000","last_clean":"2024-05-30T17:04:26.656291+0000","last_became_active":"2024-05-30T17:04:26.654383+0000","last_became_peered":"2024-05-30T17:04:26.654383+0000","last_unstale":"2024-05-30T17:04:26.656291+0000","last_undegraded":"2024-05-30T17:04:26.656291+0000","last_fullsized":"2024-05-30T17:04:26.656291+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:19.749763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636200+0000","last_change":"2024-05-30T17:04:26.636200+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636200+0000","last_undegraded":"2024-05-30T17:04:26.636200+0000","last_fullsized":"2024-05-30T17:04:26.636200+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.645955+0000","last_change":"2024-05-30T17:04:26.643654+0000","last_active":"2024-05-30T17:04:26.645955+0000","last_peered":"2024-05-30T17:04:26.645955+0000","last_clean":"2024-05-30T17:04:26.645955+0000","last_became_active":"2024-05-30T17:04:26.642798+0000","last_became_peered":"2024-05-30T17:04:26.642798+0000","last_unstale":"2024-05-30T17:04:26.645955+0000","last_undegraded":"2024-05-30T17:04:26.645955+0000","last_fullsized":"2024-05-30T17:04:26.645955+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:32.416930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631101+0000","last_change":"2024-05-30T17:04:26.631101+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631101+0000","last_undegraded":"2024-05-30T17:04:26.631101+0000","last_fullsized":"2024-05-30T17:04:26.631101+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.651216+0000","last_change":"2024-05-30T17:04:26.650407+0000","last_active":"2024-05-30T17:04:26.651216+0000","last_peered":"2024-05-30T17:04:26.651216+0000","last_clean":"2024-05-30T17:04:26.651216+0000","last_became_active":"2024-05-30T17:04:26.650063+0000","last_became_peered":"2024-05-30T17:04:26.650063+0000","last_unstale":"2024-05-30T17:04:26.651216+0000","last_undegraded":"2024-05-30T17:04:26.651216+0000","last_fullsized":"2024-05-30T17:04:26.651216+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:22.172682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266816+0000","last_change":"2024-05-30T17:04:27.648839+0000","last_active":"2024-05-30T17:04:29.266816+0000","last_peered":"2024-05-30T17:04:29.266816+0000","last_clean":"2024-05-30T17:04:29.266816+0000","last_became_active":"2024-05-30T17:04:27.648558+0000","last_became_peered":"2024-05-30T17:04:27.648558+0000","last_unstale":"2024-05-30T17:04:29.266816+0000","last_undegraded":"2024-05-30T17:04:29.266816+0000","last_fullsized":"2024-05-30T17:04:29.266816+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:52.862600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266032+0000","last_change":"2024-05-30T17:04:26.646155+0000","last_active":"2024-05-30T17:04:29.266032+0000","last_peered":"2024-05-30T17:04:29.266032+0000","last_clean":"2024-05-30T17:04:29.266032+0000","last_became_active":"2024-05-30T17:04:26.645855+0000","last_became_peered":"2024-05-30T17:04:26.645855+0000","last_unstale":"2024-05-30T17:04:29.266032+0000","last_undegraded":"2024-05-30T17:04:29.266032+0000","last_fullsized":"2024-05-30T17:04:29.266032+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:51.017861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633426+0000","last_change":"2024-05-30T17:04:26.633426+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633426+0000","last_undegraded":"2024-05-30T17:04:26.633426+0000","last_fullsized":"2024-05-30T17:04:26.633426+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.650821+0000","last_change":"2024-05-30T17:04:26.646414+0000","last_active":"2024-05-30T17:04:26.650821+0000","last_peered":"2024-05-30T17:04:26.650821+0000","last_clean":"2024-05-30T17:04:26.650821+0000","last_became_active":"2024-05-30T17:04:26.646125+0000","last_became_peered":"2024-05-30T17:04:26.646125+0000","last_unstale":"2024-05-30T17:04:26.650821+0000","last_undegraded":"2024-05-30T17:04:26.650821+0000","last_fullsized":"2024-05-30T17:04:26.650821+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:56:41.482517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635702+0000","last_change":"2024-05-30T17:04:26.635702+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635702+0000","last_undegraded":"2024-05-30T17:04:26.635702+0000","last_fullsized":"2024-05-30T17:04:26.635702+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.656836+0000","last_change":"2024-05-30T17:04:26.656301+0000","last_active":"2024-05-30T17:04:26.656836+0000","last_peered":"2024-05-30T17:04:26.656836+0000","last_clean":"2024-05-30T17:04:26.656836+0000","last_became_active":"2024-05-30T17:04:26.655900+0000","last_became_peered":"2024-05-30T17:04:26.655900+0000","last_unstale":"2024-05-30T17:04:26.656836+0000","last_undegraded":"2024-05-30T17:04:26.656836+0000","last_fullsized":"2024-05-30T17:04:26.656836+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:11.815687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":374,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.641213+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:04:26.641213+0000","last_peered":"2024-05-30T17:04:26.641213+0000","last_clean":"2024-05-30T17:04:26.641213+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:04:26.641213+0000","last_undegraded":"2024-05-30T17:04:26.641213+0000","last_fullsized":"2024-05-30T17:04:26.641213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509629,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127656,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244184,"statfs":{"total":96636764160,"available":96506044416,"internally_reserved":0,"allocated":2183168,"data_stored":1286557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509630,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127080,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244760,"statfs":{"total":96636764160,"available":96506634240,"internally_reserved":0,"allocated":1601536,"data_stored":702576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509630,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85488,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":83902,"kb_avail":94286352,"statfs":{"total":96636764160,"available":96549224448,"internally_reserved":0,"allocated":1601536,"data_stored":702576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":85916101},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509631,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109032,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94262808,"statfs":{"total":96636764160,"available":96525115392,"internally_reserved":0,"allocated":1589248,"data_stored":696189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509630,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145120,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226720,"statfs":{"total":96636764160,"available":96488161280,"internally_reserved":0,"allocated":1589248,"data_stored":696189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509630,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145128,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226712,"statfs":{"total":96636764160,"available":96488153088,"internally_reserved":0,"allocated":1601536,"data_stored":702576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509630,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141548,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230292,"statfs":{"total":96636764160,"available":96491819008,"internally_reserved":0,"allocated":2195456,"data_stored":1292944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542335,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131280,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240560,"statfs":{"total":96636764160,"available":96502333440,"internally_reserved":0,"allocated":1634304,"data_stored":716035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:04:31.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28be00640 1 Processor -- start 2024-05-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28be00640 1 -- start start 2024-05-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28be00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb28c15b750 0x7fb28c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb28c09ac50 0x7fb28c0ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28be00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28c15bb30 con 0x7fb28c0ceb30 2024-05-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28be00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb28c070f20 con 0x7fb28c15b750 2024-05-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28be00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb28c0d1090 con 0x7fb28c09ac50 2024-05-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28aa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb28c15b750 0x7fb28c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28aa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb28c15b750 0x7fb28c0ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:53256/0 (socket says 172.21.15.59:53256) 2024-05-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28aa00640 1 -- 172.21.15.59:0/2691563329 learned_addr learned my addr 172.21.15.59:0/2691563329 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb283e00640 1 --2- 172.21.15.59:0/2691563329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb28c09ac50 0x7fb28c0ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28aa00640 1 -- 172.21.15.59:0/2691563329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb28c09ac50 msgr2=0x7fb28c0ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28aa00640 1 --2- 172.21.15.59:0/2691563329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb28c09ac50 0x7fb28c0ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28aa00640 1 -- 172.21.15.59:0/2691563329 >> v1:172.21.15.107:6789/0 conn(0x7fb28c0ceb30 legacy=0x7fb28c15f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.965+0000 7fb28aa00640 1 -- 172.21.15.59:0/2691563329 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c070c40 con 0x7fb28c15b750 2024-05-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28aa00640 1 --2- 172.21.15.59:0/2691563329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb28c15b750 0x7fb28c0ce0b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009870 tx=0x7fb27c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5724b55279670155 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28a000640 1 -- 172.21.15.59:0/2691563329 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0b0070 con 0x7fb28c15b750 2024-05-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28a000640 1 -- 172.21.15.59:0/2691563329 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c0ab600 con 0x7fb28c15b750 2024-05-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28a000640 1 -- 172.21.15.59:0/2691563329 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0ab9d0 con 0x7fb28c15b750 2024-05-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28be00640 1 -- 172.21.15.59:0/2691563329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb28c15b750 msgr2=0x7fb28c0ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28be00640 1 --2- 172.21.15.59:0/2691563329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb28c15b750 0x7fb28c0ce0b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009870 tx=0x7fb27c01c410 comp rx=0 tx=0).stop 2024-05-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28be00640 1 -- 172.21.15.59:0/2691563329 shutdown_connections 2024-05-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28be00640 1 --2- 172.21.15.59:0/2691563329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb28c09ac50 0x7fb28c0ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28be00640 1 --2- 172.21.15.59:0/2691563329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb28c15b750 0x7fb28c0ce0b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28be00640 1 -- 172.21.15.59:0/2691563329 >> 172.21.15.59:0/2691563329 conn(0x7fb28c0b6990 msgr2=0x7fb28c0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28be00640 1 -- 172.21.15.59:0/2691563329 shutdown_connections 2024-05-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28be00640 1 -- 172.21.15.59:0/2691563329 wait complete. 2024-05-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.969+0000 7fb28be00640 1 Processor -- start 2024-05-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28be00640 1 -- start start 2024-05-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb28c09ac50 0x7fb28c14ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb28c0ceb30 0x7fb28c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28c15b750 0x7fb28c15d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c06f440 con 0x7fb28c15b750 2024-05-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28be00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c06f2c0 con 0x7fb28c09ac50 2024-05-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28be00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb28c0b4250 con 0x7fb28c0ceb30 2024-05-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28c15b750 0x7fb28c15d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28c15b750 0x7fb28c15d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49504/0 (socket says 172.21.15.59:49504) 2024-05-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28b400640 1 -- 172.21.15.59:0/3949022102 learned_addr learned my addr 172.21.15.59:0/3949022102 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28aa00640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb28c09ac50 0x7fb28c14ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb283e00640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb28c0ceb30 0x7fb28c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28b400640 1 -- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb28c0ceb30 msgr2=0x7fb28c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28b400640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb28c0ceb30 0x7fb28c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28b400640 1 -- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb28c09ac50 msgr2=0x7fb28c14ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28b400640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb28c09ac50 0x7fb28c14ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28b400640 1 -- 172.21.15.59:0/3949022102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c14f2d0 con 0x7fb28c15b750 2024-05-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28aa00640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb28c09ac50 0x7fb28c14ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28b400640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28c15b750 0x7fb28c15d730 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fb28400c760 tx=0x7fb28400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb282a00640 1 -- 172.21.15.59:0/3949022102 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284003b80 con 0x7fb28c15b750 2024-05-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb282a00640 1 -- 172.21.15.59:0/3949022102 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb284003d20 con 0x7fb28c15b750 2024-05-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb282a00640 1 -- 172.21.15.59:0/3949022102 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28400aa30 con 0x7fb28c15b750 2024-05-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28be00640 1 -- 172.21.15.59:0/3949022102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28c156830 con 0x7fb28c15b750 2024-05-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28be00640 1 -- 172.21.15.59:0/3949022102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28c156df0 con 0x7fb28c15b750 2024-05-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.973+0000 7fb28be00640 1 -- 172.21.15.59:0/3949022102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28c0b0ec0 con 0x7fb28c15b750 2024-05-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.977+0000 7fb282a00640 1 -- 172.21.15.59:0/3949022102 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fb28400abd0 con 0x7fb28c15b750 2024-05-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.977+0000 7fb282a00640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb268069fa0 0x7fb26806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.977+0000 7fb282a00640 1 -- 172.21.15.59:0/3949022102 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7fb2840855d0 con 0x7fb28c15b750 2024-05-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.977+0000 7fb28aa00640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb268069fa0 0x7fb26806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:31.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.977+0000 7fb28aa00640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb268069fa0 0x7fb26806c460 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0ad000 tx=0x7fb27c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:31.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:31.981+0000 7fb282a00640 1 -- 172.21.15.59:0/3949022102 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb284057040 con 0x7fb28c15b750 2024-05-30T17:04:32.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.145+0000 7fb28be00640 1 -- 172.21.15.59:0/3949022102 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb28c156fc0 con 0x7fb268069fa0 2024-05-30T17:04:32.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb282a00640 1 -- 172.21.15.59:0/3949022102 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247786 (secure 0 0 0) 0x7fb28c156fc0 con 0x7fb268069fa0 2024-05-30T17:04:32.154 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb28be00640 1 -- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb268069fa0 msgr2=0x7fb26806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb28be00640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb268069fa0 0x7fb26806c460 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0ad000 tx=0x7fb27c008040 comp rx=0 tx=0).stop 2024-05-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb28be00640 1 -- 172.21.15.59:0/3949022102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28c15b750 msgr2=0x7fb28c15d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb28be00640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28c15b750 0x7fb28c15d730 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fb28400c760 tx=0x7fb28400cc20 comp rx=0 tx=0).stop 2024-05-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb28be00640 1 -- 172.21.15.59:0/3949022102 shutdown_connections 2024-05-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb28be00640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb268069fa0 0x7fb26806c460 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb28be00640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28c15b750 0x7fb28c15d730 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb28be00640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb28c0ceb30 0x7fb28c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb28be00640 1 --2- 172.21.15.59:0/3949022102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb28c09ac50 0x7fb28c14ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb28be00640 1 -- 172.21.15.59:0/3949022102 >> 172.21.15.59:0/3949022102 conn(0x7fb28c0b6990 msgr2=0x7fb28c06c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb28be00640 1 -- 172.21.15.59:0/3949022102 shutdown_connections 2024-05-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.153+0000 7fb28be00640 1 -- 172.21.15.59:0/3949022102 wait complete. 2024-05-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":594,"stamp":"2024-05-30T17:04:31.379140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1012332,"kb_used_data":13668,"kb_used_omap":12,"kb_used_meta":998515,"kb_avail":753962388,"statfs":{"total":773094113280,"available":772057485312,"internally_reserved":0,"allocated":13996032,"data_stored":6795642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1022479920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.750927"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.644930+0000","last_change":"2024-05-30T17:04:26.644930+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.644930+0000","last_undegraded":"2024-05-30T17:04:26.644930+0000","last_fullsized":"2024-05-30T17:04:26.644930+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635506+0000","last_change":"2024-05-30T17:04:26.635506+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635506+0000","last_undegraded":"2024-05-30T17:04:26.635506+0000","last_fullsized":"2024-05-30T17:04:26.635506+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638311+0000","last_change":"2024-05-30T17:04:26.638311+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638311+0000","last_undegraded":"2024-05-30T17:04:26.638311+0000","last_fullsized":"2024-05-30T17:04:26.638311+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.641744+0000","last_change":"2024-05-30T17:04:26.641744+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.641744+0000","last_undegraded":"2024-05-30T17:04:26.641744+0000","last_fullsized":"2024-05-30T17:04:26.641744+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.640547+0000","last_change":"2024-05-30T17:04:26.640547+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.640547+0000","last_undegraded":"2024-05-30T17:04:26.640547+0000","last_fullsized":"2024-05-30T17:04:26.640547+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631350+0000","last_change":"2024-05-30T17:04:26.631350+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631350+0000","last_undegraded":"2024-05-30T17:04:26.631350+0000","last_fullsized":"2024-05-30T17:04:26.631350+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631189+0000","last_change":"2024-05-30T17:04:26.631189+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631189+0000","last_undegraded":"2024-05-30T17:04:26.631189+0000","last_fullsized":"2024-05-30T17:04:26.631189+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636699+0000","last_change":"2024-05-30T17:04:26.636699+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636699+0000","last_undegraded":"2024-05-30T17:04:26.636699+0000","last_fullsized":"2024-05-30T17:04:26.636699+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.637191+0000","last_change":"2024-05-30T17:04:26.637191+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.637191+0000","last_undegraded":"2024-05-30T17:04:26.637191+0000","last_fullsized":"2024-05-30T17:04:26.637191+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.634999+0000","last_change":"2024-05-30T17:04:26.634999+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.634999+0000","last_undegraded":"2024-05-30T17:04:26.634999+0000","last_fullsized":"2024-05-30T17:04:26.634999+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.639123+0000","last_change":"2024-05-30T17:04:26.639123+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.639123+0000","last_undegraded":"2024-05-30T17:04:26.639123+0000","last_fullsized":"2024-05-30T17:04:26.639123+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635832+0000","last_change":"2024-05-30T17:04:26.635832+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635832+0000","last_undegraded":"2024-05-30T17:04:26.635832+0000","last_fullsized":"2024-05-30T17:04:26.635832+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.653335+0000","last_change":"2024-05-30T17:04:26.653335+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.653335+0000","last_undegraded":"2024-05-30T17:04:26.653335+0000","last_fullsized":"2024-05-30T17:04:26.653335+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635330+0000","last_change":"2024-05-30T17:04:26.635330+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635330+0000","last_undegraded":"2024-05-30T17:04:26.635330+0000","last_fullsized":"2024-05-30T17:04:26.635330+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638835+0000","last_change":"2024-05-30T17:04:26.638835+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638835+0000","last_undegraded":"2024-05-30T17:04:26.638835+0000","last_fullsized":"2024-05-30T17:04:26.638835+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266123+0000","last_change":"2024-05-30T17:04:27.656402+0000","last_active":"2024-05-30T17:04:29.266123+0000","last_peered":"2024-05-30T17:04:29.266123+0000","last_clean":"2024-05-30T17:04:29.266123+0000","last_became_active":"2024-05-30T17:04:27.656141+0000","last_became_peered":"2024-05-30T17:04:27.656141+0000","last_unstale":"2024-05-30T17:04:29.266123+0000","last_undegraded":"2024-05-30T17:04:29.266123+0000","last_fullsized":"2024-05-30T17:04:29.266123+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:08.433002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631847+0000","last_change":"2024-05-30T17:04:26.631847+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631847+0000","last_undegraded":"2024-05-30T17:04:26.631847+0000","last_fullsized":"2024-05-30T17:04:26.631847+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266584+0000","last_change":"2024-05-30T17:04:27.650889+0000","last_active":"2024-05-30T17:04:29.266584+0000","last_peered":"2024-05-30T17:04:29.266584+0000","last_clean":"2024-05-30T17:04:29.266584+0000","last_became_active":"2024-05-30T17:04:27.649462+0000","last_became_peered":"2024-05-30T17:04:27.649462+0000","last_unstale":"2024-05-30T17:04:29.266584+0000","last_undegraded":"2024-05-30T17:04:29.266584+0000","last_fullsized":"2024-05-30T17:04:29.266584+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:02:33.740142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636711+0000","last_change":"2024-05-30T17:04:26.636711+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636711+0000","last_undegraded":"2024-05-30T17:04:26.636711+0000","last_fullsized":"2024-05-30T17:04:26.636711+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266495+0000","last_change":"2024-05-30T17:04:27.652401+0000","last_active":"2024-05-30T17:04:29.266495+0000","last_peered":"2024-05-30T17:04:29.266495+0000","last_clean":"2024-05-30T17:04:29.266495+0000","last_became_active":"2024-05-30T17:04:27.652097+0000","last_became_peered":"2024-05-30T17:04:27.652097+0000","last_unstale":"2024-05-30T17:04:29.266495+0000","last_undegraded":"2024-05-30T17:04:29.266495+0000","last_fullsized":"2024-05-30T17:04:29.266495+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:22:37.455945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.639170+0000","last_change":"2024-05-30T17:04:26.639170+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.639170+0000","last_undegraded":"2024-05-30T17:04:26.639170+0000","last_fullsized":"2024-05-30T17:04:26.639170+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638697+0000","last_change":"2024-05-30T17:04:26.638697+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638697+0000","last_undegraded":"2024-05-30T17:04:26.638697+0000","last_fullsized":"2024-05-30T17:04:26.638697+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635293+0000","last_change":"2024-05-30T17:04:26.635293+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635293+0000","last_undegraded":"2024-05-30T17:04:26.635293+0000","last_fullsized":"2024-05-30T17:04:26.635293+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638008+0000","last_change":"2024-05-30T17:04:26.638008+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638008+0000","last_undegraded":"2024-05-30T17:04:26.638008+0000","last_fullsized":"2024-05-30T17:04:26.638008+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635275+0000","last_change":"2024-05-30T17:04:26.635275+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635275+0000","last_undegraded":"2024-05-30T17:04:26.635275+0000","last_fullsized":"2024-05-30T17:04:26.635275+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266595+0000","last_change":"2024-05-30T17:04:27.657224+0000","last_active":"2024-05-30T17:04:29.266595+0000","last_peered":"2024-05-30T17:04:29.266595+0000","last_clean":"2024-05-30T17:04:29.266595+0000","last_became_active":"2024-05-30T17:04:27.656941+0000","last_became_peered":"2024-05-30T17:04:27.656941+0000","last_unstale":"2024-05-30T17:04:29.266595+0000","last_undegraded":"2024-05-30T17:04:29.266595+0000","last_fullsized":"2024-05-30T17:04:29.266595+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:33.680204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.641374+0000","last_change":"2024-05-30T17:04:26.641374+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.641374+0000","last_undegraded":"2024-05-30T17:04:26.641374+0000","last_fullsized":"2024-05-30T17:04:26.641374+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631634+0000","last_change":"2024-05-30T17:04:26.631634+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631634+0000","last_undegraded":"2024-05-30T17:04:26.631634+0000","last_fullsized":"2024-05-30T17:04:26.631634+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.652897+0000","last_change":"2024-05-30T17:04:26.652897+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.652897+0000","last_undegraded":"2024-05-30T17:04:26.652897+0000","last_fullsized":"2024-05-30T17:04:26.652897+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.640606+0000","last_change":"2024-05-30T17:04:26.640606+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.640606+0000","last_undegraded":"2024-05-30T17:04:26.640606+0000","last_fullsized":"2024-05-30T17:04:26.640606+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636920+0000","last_change":"2024-05-30T17:04:26.636920+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636920+0000","last_undegraded":"2024-05-30T17:04:26.636920+0000","last_fullsized":"2024-05-30T17:04:26.636920+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631593+0000","last_change":"2024-05-30T17:04:26.631593+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631593+0000","last_undegraded":"2024-05-30T17:04:26.631593+0000","last_fullsized":"2024-05-30T17:04:26.631593+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266938+0000","last_change":"2024-05-30T17:04:27.665116+0000","last_active":"2024-05-30T17:04:29.266938+0000","last_peered":"2024-05-30T17:04:29.266938+0000","last_clean":"2024-05-30T17:04:29.266938+0000","last_became_active":"2024-05-30T17:04:27.664853+0000","last_became_peered":"2024-05-30T17:04:27.664853+0000","last_unstale":"2024-05-30T17:04:29.266938+0000","last_undegraded":"2024-05-30T17:04:29.266938+0000","last_fullsized":"2024-05-30T17:04:29.266938+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:00.380018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654288+0000","last_change":"2024-05-30T17:04:26.653769+0000","last_active":"2024-05-30T17:04:26.654288+0000","last_peered":"2024-05-30T17:04:26.654288+0000","last_clean":"2024-05-30T17:04:26.654288+0000","last_became_active":"2024-05-30T17:04:26.653331+0000","last_became_peered":"2024-05-30T17:04:26.653331+0000","last_unstale":"2024-05-30T17:04:26.654288+0000","last_undegraded":"2024-05-30T17:04:26.654288+0000","last_fullsized":"2024-05-30T17:04:26.654288+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:38:18.013111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636758+0000","last_change":"2024-05-30T17:04:26.636758+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636758+0000","last_undegraded":"2024-05-30T17:04:26.636758+0000","last_fullsized":"2024-05-30T17:04:26.636758+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.653121+0000","last_change":"2024-05-30T17:04:26.652574+0000","last_active":"2024-05-30T17:04:26.653121+0000","last_peered":"2024-05-30T17:04:26.653121+0000","last_clean":"2024-05-30T17:04:26.653121+0000","last_became_active":"2024-05-30T17:04:26.652142+0000","last_became_peered":"2024-05-30T17:04:26.652142+0000","last_unstale":"2024-05-30T17:04:26.653121+0000","last_undegraded":"2024-05-30T17:04:26.653121+0000","last_fullsized":"2024-05-30T17:04:26.653121+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:02.750449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636140+0000","last_change":"2024-05-30T17:04:26.636140+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636140+0000","last_undegraded":"2024-05-30T17:04:26.636140+0000","last_fullsized":"2024-05-30T17:04:26.636140+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654798+0000","last_change":"2024-05-30T17:04:26.652502+0000","last_active":"2024-05-30T17:04:26.654798+0000","last_peered":"2024-05-30T17:04:26.654798+0000","last_clean":"2024-05-30T17:04:26.654798+0000","last_became_active":"2024-05-30T17:04:26.652240+0000","last_became_peered":"2024-05-30T17:04:26.652240+0000","last_unstale":"2024-05-30T17:04:26.654798+0000","last_undegraded":"2024-05-30T17:04:26.654798+0000","last_fullsized":"2024-05-30T17:04:26.654798+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:41:52.185908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638376+0000","last_change":"2024-05-30T17:04:26.638376+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638376+0000","last_undegraded":"2024-05-30T17:04:26.638376+0000","last_fullsized":"2024-05-30T17:04:26.638376+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.650236+0000","last_change":"2024-05-30T17:04:26.644729+0000","last_active":"2024-05-30T17:04:26.650236+0000","last_peered":"2024-05-30T17:04:26.650236+0000","last_clean":"2024-05-30T17:04:26.650236+0000","last_became_active":"2024-05-30T17:04:26.644381+0000","last_became_peered":"2024-05-30T17:04:26.644381+0000","last_unstale":"2024-05-30T17:04:26.650236+0000","last_undegraded":"2024-05-30T17:04:26.650236+0000","last_fullsized":"2024-05-30T17:04:26.650236+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:12.851756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266155+0000","last_change":"2024-05-30T17:04:27.650774+0000","last_active":"2024-05-30T17:04:29.266155+0000","last_peered":"2024-05-30T17:04:29.266155+0000","last_clean":"2024-05-30T17:04:29.266155+0000","last_became_active":"2024-05-30T17:04:27.649829+0000","last_became_peered":"2024-05-30T17:04:27.649829+0000","last_unstale":"2024-05-30T17:04:29.266155+0000","last_undegraded":"2024-05-30T17:04:29.266155+0000","last_fullsized":"2024-05-30T17:04:29.266155+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:43:56.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654476+0000","last_change":"2024-05-30T17:04:26.649081+0000","last_active":"2024-05-30T17:04:26.654476+0000","last_peered":"2024-05-30T17:04:26.654476+0000","last_clean":"2024-05-30T17:04:26.654476+0000","last_became_active":"2024-05-30T17:04:26.648809+0000","last_became_peered":"2024-05-30T17:04:26.648809+0000","last_unstale":"2024-05-30T17:04:26.654476+0000","last_undegraded":"2024-05-30T17:04:26.654476+0000","last_fullsized":"2024-05-30T17:04:26.654476+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:28.984517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.632838+0000","last_change":"2024-05-30T17:04:26.632838+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.632838+0000","last_undegraded":"2024-05-30T17:04:26.632838+0000","last_fullsized":"2024-05-30T17:04:26.632838+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266208+0000","last_change":"2024-05-30T17:04:26.650934+0000","last_active":"2024-05-30T17:04:29.266208+0000","last_peered":"2024-05-30T17:04:29.266208+0000","last_clean":"2024-05-30T17:04:29.266208+0000","last_became_active":"2024-05-30T17:04:26.650668+0000","last_became_peered":"2024-05-30T17:04:26.650668+0000","last_unstale":"2024-05-30T17:04:29.266208+0000","last_undegraded":"2024-05-30T17:04:29.266208+0000","last_fullsized":"2024-05-30T17:04:29.266208+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:04.028994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636215+0000","last_change":"2024-05-30T17:04:26.636215+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636215+0000","last_undegraded":"2024-05-30T17:04:26.636215+0000","last_fullsized":"2024-05-30T17:04:26.636215+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.645187+0000","last_change":"2024-05-30T17:04:26.642168+0000","last_active":"2024-05-30T17:04:26.645187+0000","last_peered":"2024-05-30T17:04:26.645187+0000","last_clean":"2024-05-30T17:04:26.645187+0000","last_became_active":"2024-05-30T17:04:26.641791+0000","last_became_peered":"2024-05-30T17:04:26.641791+0000","last_unstale":"2024-05-30T17:04:26.645187+0000","last_undegraded":"2024-05-30T17:04:26.645187+0000","last_fullsized":"2024-05-30T17:04:26.645187+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:41:35.345382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.634592+0000","last_change":"2024-05-30T17:04:26.634592+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.634592+0000","last_undegraded":"2024-05-30T17:04:26.634592+0000","last_fullsized":"2024-05-30T17:04:26.634592+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.646230+0000","last_change":"2024-05-30T17:04:26.645457+0000","last_active":"2024-05-30T17:04:26.646230+0000","last_peered":"2024-05-30T17:04:26.646230+0000","last_clean":"2024-05-30T17:04:26.646230+0000","last_became_active":"2024-05-30T17:04:26.642988+0000","last_became_peered":"2024-05-30T17:04:26.642988+0000","last_unstale":"2024-05-30T17:04:26.646230+0000","last_undegraded":"2024-05-30T17:04:26.646230+0000","last_fullsized":"2024-05-30T17:04:26.646230+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:56:53.520715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.643824+0000","last_change":"2024-05-30T17:04:26.643824+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.643824+0000","last_undegraded":"2024-05-30T17:04:26.643824+0000","last_fullsized":"2024-05-30T17:04:26.643824+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654544+0000","last_change":"2024-05-30T17:04:26.653783+0000","last_active":"2024-05-30T17:04:26.654544+0000","last_peered":"2024-05-30T17:04:26.654544+0000","last_clean":"2024-05-30T17:04:26.654544+0000","last_became_active":"2024-05-30T17:04:26.653413+0000","last_became_peered":"2024-05-30T17:04:26.653413+0000","last_unstale":"2024-05-30T17:04:26.654544+0000","last_undegraded":"2024-05-30T17:04:26.654544+0000","last_fullsized":"2024-05-30T17:04:26.654544+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:14.217436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633032+0000","last_change":"2024-05-30T17:04:26.633032+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633032+0000","last_undegraded":"2024-05-30T17:04:26.633032+0000","last_fullsized":"2024-05-30T17:04:26.633032+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266674+0000","last_change":"2024-05-30T17:04:26.649285+0000","last_active":"2024-05-30T17:04:29.266674+0000","last_peered":"2024-05-30T17:04:29.266674+0000","last_clean":"2024-05-30T17:04:29.266674+0000","last_became_active":"2024-05-30T17:04:26.648983+0000","last_became_peered":"2024-05-30T17:04:26.648983+0000","last_unstale":"2024-05-30T17:04:29.266674+0000","last_undegraded":"2024-05-30T17:04:29.266674+0000","last_fullsized":"2024-05-30T17:04:29.266674+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:19.123667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635575+0000","last_change":"2024-05-30T17:04:26.635575+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635575+0000","last_undegraded":"2024-05-30T17:04:26.635575+0000","last_fullsized":"2024-05-30T17:04:26.635575+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.656464+0000","last_change":"2024-05-30T17:04:26.655873+0000","last_active":"2024-05-30T17:04:26.656464+0000","last_peered":"2024-05-30T17:04:26.656464+0000","last_clean":"2024-05-30T17:04:26.656464+0000","last_became_active":"2024-05-30T17:04:26.655436+0000","last_became_peered":"2024-05-30T17:04:26.655436+0000","last_unstale":"2024-05-30T17:04:26.656464+0000","last_undegraded":"2024-05-30T17:04:26.656464+0000","last_fullsized":"2024-05-30T17:04:26.656464+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:20.851133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.637882+0000","last_change":"2024-05-30T17:04:26.637882+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.637882+0000","last_undegraded":"2024-05-30T17:04:26.637882+0000","last_fullsized":"2024-05-30T17:04:26.637882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.646625+0000","last_change":"2024-05-30T17:04:26.644996+0000","last_active":"2024-05-30T17:04:26.646625+0000","last_peered":"2024-05-30T17:04:26.646625+0000","last_clean":"2024-05-30T17:04:26.646625+0000","last_became_active":"2024-05-30T17:04:26.644394+0000","last_became_peered":"2024-05-30T17:04:26.644394+0000","last_unstale":"2024-05-30T17:04:26.646625+0000","last_undegraded":"2024-05-30T17:04:26.646625+0000","last_fullsized":"2024-05-30T17:04:26.646625+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:45:55.504801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.652394+0000","last_change":"2024-05-30T17:04:26.652394+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.652394+0000","last_undegraded":"2024-05-30T17:04:26.652394+0000","last_fullsized":"2024-05-30T17:04:26.652394+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654569+0000","last_change":"2024-05-30T17:04:26.648513+0000","last_active":"2024-05-30T17:04:26.654569+0000","last_peered":"2024-05-30T17:04:26.654569+0000","last_clean":"2024-05-30T17:04:26.654569+0000","last_became_active":"2024-05-30T17:04:26.648016+0000","last_became_peered":"2024-05-30T17:04:26.648016+0000","last_unstale":"2024-05-30T17:04:26.654569+0000","last_undegraded":"2024-05-30T17:04:26.654569+0000","last_fullsized":"2024-05-30T17:04:26.654569+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:23:52.647599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.634425+0000","last_change":"2024-05-30T17:04:26.634425+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.634425+0000","last_undegraded":"2024-05-30T17:04:26.634425+0000","last_fullsized":"2024-05-30T17:04:26.634425+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.646449+0000","last_change":"2024-05-30T17:04:26.643372+0000","last_active":"2024-05-30T17:04:26.646449+0000","last_peered":"2024-05-30T17:04:26.646449+0000","last_clean":"2024-05-30T17:04:26.646449+0000","last_became_active":"2024-05-30T17:04:26.641530+0000","last_became_peered":"2024-05-30T17:04:26.641530+0000","last_unstale":"2024-05-30T17:04:26.646449+0000","last_undegraded":"2024-05-30T17:04:26.646449+0000","last_fullsized":"2024-05-30T17:04:26.646449+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:23:52.647599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635921+0000","last_change":"2024-05-30T17:04:26.635921+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635921+0000","last_undegraded":"2024-05-30T17:04:26.635921+0000","last_fullsized":"2024-05-30T17:04:26.635921+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.652596+0000","last_change":"2024-05-30T17:04:26.651768+0000","last_active":"2024-05-30T17:04:26.652596+0000","last_peered":"2024-05-30T17:04:26.652596+0000","last_clean":"2024-05-30T17:04:26.652596+0000","last_became_active":"2024-05-30T17:04:26.651470+0000","last_became_peered":"2024-05-30T17:04:26.651470+0000","last_unstale":"2024-05-30T17:04:26.652596+0000","last_undegraded":"2024-05-30T17:04:26.652596+0000","last_fullsized":"2024-05-30T17:04:26.652596+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:46.418471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636651+0000","last_change":"2024-05-30T17:04:26.636651+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636651+0000","last_undegraded":"2024-05-30T17:04:26.636651+0000","last_fullsized":"2024-05-30T17:04:26.636651+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.648286+0000","last_change":"2024-05-30T17:04:26.646106+0000","last_active":"2024-05-30T17:04:26.648286+0000","last_peered":"2024-05-30T17:04:26.648286+0000","last_clean":"2024-05-30T17:04:26.648286+0000","last_became_active":"2024-05-30T17:04:26.645435+0000","last_became_peered":"2024-05-30T17:04:26.645435+0000","last_unstale":"2024-05-30T17:04:26.648286+0000","last_undegraded":"2024-05-30T17:04:26.648286+0000","last_fullsized":"2024-05-30T17:04:26.648286+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:24:46.141540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.632603+0000","last_change":"2024-05-30T17:04:26.632603+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.632603+0000","last_undegraded":"2024-05-30T17:04:26.632603+0000","last_fullsized":"2024-05-30T17:04:26.632603+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654939+0000","last_change":"2024-05-30T17:04:26.649232+0000","last_active":"2024-05-30T17:04:26.654939+0000","last_peered":"2024-05-30T17:04:26.654939+0000","last_clean":"2024-05-30T17:04:26.654939+0000","last_became_active":"2024-05-30T17:04:26.648936+0000","last_became_peered":"2024-05-30T17:04:26.648936+0000","last_unstale":"2024-05-30T17:04:26.654939+0000","last_undegraded":"2024-05-30T17:04:26.654939+0000","last_fullsized":"2024-05-30T17:04:26.654939+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:50:10.017227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266652+0000","last_change":"2024-05-30T17:04:27.657488+0000","last_active":"2024-05-30T17:04:29.266652+0000","last_peered":"2024-05-30T17:04:29.266652+0000","last_clean":"2024-05-30T17:04:29.266652+0000","last_became_active":"2024-05-30T17:04:27.657216+0000","last_became_peered":"2024-05-30T17:04:27.657216+0000","last_unstale":"2024-05-30T17:04:29.266652+0000","last_undegraded":"2024-05-30T17:04:29.266652+0000","last_fullsized":"2024-05-30T17:04:29.266652+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:18.543050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.653010+0000","last_change":"2024-05-30T17:04:26.652397+0000","last_active":"2024-05-30T17:04:26.653010+0000","last_peered":"2024-05-30T17:04:26.653010+0000","last_clean":"2024-05-30T17:04:26.653010+0000","last_became_active":"2024-05-30T17:04:26.652083+0000","last_became_peered":"2024-05-30T17:04:26.652083+0000","last_unstale":"2024-05-30T17:04:26.653010+0000","last_undegraded":"2024-05-30T17:04:26.653010+0000","last_fullsized":"2024-05-30T17:04:26.653010+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:37:07.130536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633700+0000","last_change":"2024-05-30T17:04:26.633700+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633700+0000","last_undegraded":"2024-05-30T17:04:26.633700+0000","last_fullsized":"2024-05-30T17:04:26.633700+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.648253+0000","last_change":"2024-05-30T17:04:26.646336+0000","last_active":"2024-05-30T17:04:26.648253+0000","last_peered":"2024-05-30T17:04:26.648253+0000","last_clean":"2024-05-30T17:04:26.648253+0000","last_became_active":"2024-05-30T17:04:26.646025+0000","last_became_peered":"2024-05-30T17:04:26.646025+0000","last_unstale":"2024-05-30T17:04:26.648253+0000","last_undegraded":"2024-05-30T17:04:26.648253+0000","last_fullsized":"2024-05-30T17:04:26.648253+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:33.438380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.640162+0000","last_change":"2024-05-30T17:04:26.640162+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.640162+0000","last_undegraded":"2024-05-30T17:04:26.640162+0000","last_fullsized":"2024-05-30T17:04:26.640162+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.658717+0000","last_change":"2024-05-30T17:04:26.657719+0000","last_active":"2024-05-30T17:04:26.658717+0000","last_peered":"2024-05-30T17:04:26.658717+0000","last_clean":"2024-05-30T17:04:26.658717+0000","last_became_active":"2024-05-30T17:04:26.657452+0000","last_became_peered":"2024-05-30T17:04:26.657452+0000","last_unstale":"2024-05-30T17:04:26.658717+0000","last_undegraded":"2024-05-30T17:04:26.658717+0000","last_fullsized":"2024-05-30T17:04:26.658717+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:05:26.624348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.630967+0000","last_change":"2024-05-30T17:04:26.630967+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.630967+0000","last_undegraded":"2024-05-30T17:04:26.630967+0000","last_fullsized":"2024-05-30T17:04:26.630967+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266335+0000","last_change":"2024-05-30T17:04:26.645875+0000","last_active":"2024-05-30T17:04:29.266335+0000","last_peered":"2024-05-30T17:04:29.266335+0000","last_clean":"2024-05-30T17:04:29.266335+0000","last_became_active":"2024-05-30T17:04:26.645583+0000","last_became_peered":"2024-05-30T17:04:26.645583+0000","last_unstale":"2024-05-30T17:04:29.266335+0000","last_undegraded":"2024-05-30T17:04:29.266335+0000","last_fullsized":"2024-05-30T17:04:29.266335+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:03.486308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633916+0000","last_change":"2024-05-30T17:04:26.633916+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633916+0000","last_undegraded":"2024-05-30T17:04:26.633916+0000","last_fullsized":"2024-05-30T17:04:26.633916+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265914+0000","last_change":"2024-05-30T17:04:26.647421+0000","last_active":"2024-05-30T17:04:29.265914+0000","last_peered":"2024-05-30T17:04:29.265914+0000","last_clean":"2024-05-30T17:04:29.265914+0000","last_became_active":"2024-05-30T17:04:26.647155+0000","last_became_peered":"2024-05-30T17:04:26.647155+0000","last_unstale":"2024-05-30T17:04:29.265914+0000","last_undegraded":"2024-05-30T17:04:29.265914+0000","last_fullsized":"2024-05-30T17:04:29.265914+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:59:52.705838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.637392+0000","last_change":"2024-05-30T17:04:26.637392+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.637392+0000","last_undegraded":"2024-05-30T17:04:26.637392+0000","last_fullsized":"2024-05-30T17:04:26.637392+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.655617+0000","last_change":"2024-05-30T17:04:26.650930+0000","last_active":"2024-05-30T17:04:26.655617+0000","last_peered":"2024-05-30T17:04:26.655617+0000","last_clean":"2024-05-30T17:04:26.655617+0000","last_became_active":"2024-05-30T17:04:26.650616+0000","last_became_peered":"2024-05-30T17:04:26.650616+0000","last_unstale":"2024-05-30T17:04:26.655617+0000","last_undegraded":"2024-05-30T17:04:26.655617+0000","last_fullsized":"2024-05-30T17:04:26.655617+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:39:55.080473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631855+0000","last_change":"2024-05-30T17:04:26.631855+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631855+0000","last_undegraded":"2024-05-30T17:04:26.631855+0000","last_fullsized":"2024-05-30T17:04:26.631855+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654744+0000","last_change":"2024-05-30T17:04:26.653129+0000","last_active":"2024-05-30T17:04:26.654744+0000","last_peered":"2024-05-30T17:04:26.654744+0000","last_clean":"2024-05-30T17:04:26.654744+0000","last_became_active":"2024-05-30T17:04:26.652234+0000","last_became_peered":"2024-05-30T17:04:26.652234+0000","last_unstale":"2024-05-30T17:04:26.654744+0000","last_undegraded":"2024-05-30T17:04:26.654744+0000","last_fullsized":"2024-05-30T17:04:26.654744+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:32.416930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.647675+0000","last_change":"2024-05-30T17:04:26.647675+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.647675+0000","last_undegraded":"2024-05-30T17:04:26.647675+0000","last_fullsized":"2024-05-30T17:04:26.647675+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.650180+0000","last_change":"2024-05-30T17:04:26.649574+0000","last_active":"2024-05-30T17:04:26.650180+0000","last_peered":"2024-05-30T17:04:26.650180+0000","last_clean":"2024-05-30T17:04:26.650180+0000","last_became_active":"2024-05-30T17:04:26.648998+0000","last_became_peered":"2024-05-30T17:04:26.648998+0000","last_unstale":"2024-05-30T17:04:26.650180+0000","last_undegraded":"2024-05-30T17:04:26.650180+0000","last_fullsized":"2024-05-30T17:04:26.650180+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:22.583010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633538+0000","last_change":"2024-05-30T17:04:26.633538+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633538+0000","last_undegraded":"2024-05-30T17:04:26.633538+0000","last_fullsized":"2024-05-30T17:04:26.633538+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654441+0000","last_change":"2024-05-30T17:04:26.647328+0000","last_active":"2024-05-30T17:04:26.654441+0000","last_peered":"2024-05-30T17:04:26.654441+0000","last_clean":"2024-05-30T17:04:26.654441+0000","last_became_active":"2024-05-30T17:04:26.647058+0000","last_became_peered":"2024-05-30T17:04:26.647058+0000","last_unstale":"2024-05-30T17:04:26.654441+0000","last_undegraded":"2024-05-30T17:04:26.654441+0000","last_fullsized":"2024-05-30T17:04:26.654441+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:37:15.984675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631554+0000","last_change":"2024-05-30T17:04:26.631554+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631554+0000","last_undegraded":"2024-05-30T17:04:26.631554+0000","last_fullsized":"2024-05-30T17:04:26.631554+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.656291+0000","last_change":"2024-05-30T17:04:26.655225+0000","last_active":"2024-05-30T17:04:26.656291+0000","last_peered":"2024-05-30T17:04:26.656291+0000","last_clean":"2024-05-30T17:04:26.656291+0000","last_became_active":"2024-05-30T17:04:26.654383+0000","last_became_peered":"2024-05-30T17:04:26.654383+0000","last_unstale":"2024-05-30T17:04:26.656291+0000","last_undegraded":"2024-05-30T17:04:26.656291+0000","last_fullsized":"2024-05-30T17:04:26.656291+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:19.749763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636200+0000","last_change":"2024-05-30T17:04:26.636200+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636200+0000","last_undegraded":"2024-05-30T17:04:26.636200+0000","last_fullsized":"2024-05-30T17:04:26.636200+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.645955+0000","last_change":"2024-05-30T17:04:26.643654+0000","last_active":"2024-05-30T17:04:26.645955+0000","last_peered":"2024-05-30T17:04:26.645955+0000","last_clean":"2024-05-30T17:04:26.645955+0000","last_became_active":"2024-05-30T17:04:26.642798+0000","last_became_peered":"2024-05-30T17:04:26.642798+0000","last_unstale":"2024-05-30T17:04:26.645955+0000","last_undegraded":"2024-05-30T17:04:26.645955+0000","last_fullsized":"2024-05-30T17:04:26.645955+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:32.416930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631101+0000","last_change":"2024-05-30T17:04:26.631101+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631101+0000","last_undegraded":"2024-05-30T17:04:26.631101+0000","last_fullsized":"2024-05-30T17:04:26.631101+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.651216+0000","last_change":"2024-05-30T17:04:26.650407+0000","last_active":"2024-05-30T17:04:26.651216+0000","last_peered":"2024-05-30T17:04:26.651216+0000","last_clean":"2024-05-30T17:04:26.651216+0000","last_became_active":"2024-05-30T17:04:26.650063+0000","last_became_peered":"2024-05-30T17:04:26.650063+0000","last_unstale":"2024-05-30T17:04:26.651216+0000","last_undegraded":"2024-05-30T17:04:26.651216+0000","last_fullsized":"2024-05-30T17:04:26.651216+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:22.172682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266816+0000","last_change":"2024-05-30T17:04:27.648839+0000","last_active":"2024-05-30T17:04:29.266816+0000","last_peered":"2024-05-30T17:04:29.266816+0000","last_clean":"2024-05-30T17:04:29.266816+0000","last_became_active":"2024-05-30T17:04:27.648558+0000","last_became_peered":"2024-05-30T17:04:27.648558+0000","last_unstale":"2024-05-30T17:04:29.266816+0000","last_undegraded":"2024-05-30T17:04:29.266816+0000","last_fullsized":"2024-05-30T17:04:29.266816+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:52.862600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266032+0000","last_change":"2024-05-30T17:04:26.646155+0000","last_active":"2024-05-30T17:04:29.266032+0000","last_peered":"2024-05-30T17:04:29.266032+0000","last_clean":"2024-05-30T17:04:29.266032+0000","last_became_active":"2024-05-30T17:04:26.645855+0000","last_became_peered":"2024-05-30T17:04:26.645855+0000","last_unstale":"2024-05-30T17:04:29.266032+0000","last_undegraded":"2024-05-30T17:04:29.266032+0000","last_fullsized":"2024-05-30T17:04:29.266032+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:51.017861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633426+0000","last_change":"2024-05-30T17:04:26.633426+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633426+0000","last_undegraded":"2024-05-30T17:04:26.633426+0000","last_fullsized":"2024-05-30T17:04:26.633426+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.650821+0000","last_change":"2024-05-30T17:04:26.646414+0000","last_active":"2024-05-30T17:04:26.650821+0000","last_peered":"2024-05-30T17:04:26.650821+0000","last_clean":"2024-05-30T17:04:26.650821+0000","last_became_active":"2024-05-30T17:04:26.646125+0000","last_became_peered":"2024-05-30T17:04:26.646125+0000","last_unstale":"2024-05-30T17:04:26.650821+0000","last_undegraded":"2024-05-30T17:04:26.650821+0000","last_fullsized":"2024-05-30T17:04:26.650821+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:56:41.482517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635702+0000","last_change":"2024-05-30T17:04:26.635702+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635702+0000","last_undegraded":"2024-05-30T17:04:26.635702+0000","last_fullsized":"2024-05-30T17:04:26.635702+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.656836+0000","last_change":"2024-05-30T17:04:26.656301+0000","last_active":"2024-05-30T17:04:26.656836+0000","last_peered":"2024-05-30T17:04:26.656836+0000","last_clean":"2024-05-30T17:04:26.656836+0000","last_became_active":"2024-05-30T17:04:26.655900+0000","last_became_peered":"2024-05-30T17:04:26.655900+0000","last_unstale":"2024-05-30T17:04:26.656836+0000","last_undegraded":"2024-05-30T17:04:26.656836+0000","last_fullsized":"2024-05-30T17:04:26.656836+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:11.815687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":374,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.641213+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:04:26.641213+0000","last_peered":"2024-05-30T17:04:26.641213+0000","last_clean":"2024-05-30T17:04:26.641213+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:04:26.641213+0000","last_undegraded":"2024-05-30T17:04:26.641213+0000","last_fullsized":"2024-05-30T17:04:26.641213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509629,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127656,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244184,"statfs":{"total":96636764160,"available":96506044416,"internally_reserved":0,"allocated":2183168,"data_stored":1286557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509630,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127080,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244760,"statfs":{"total":96636764160,"available":96506634240,"internally_reserved":0,"allocated":1601536,"data_stored":702576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509630,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85488,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":83902,"kb_avail":94286352,"statfs":{"total":96636764160,"available":96549224448,"internally_reserved":0,"allocated":1601536,"data_stored":702576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":85916101},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509631,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109032,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94262808,"statfs":{"total":96636764160,"available":96525115392,"internally_reserved":0,"allocated":1589248,"data_stored":696189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509630,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145120,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226720,"statfs":{"total":96636764160,"available":96488161280,"internally_reserved":0,"allocated":1589248,"data_stored":696189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509630,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145128,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226712,"statfs":{"total":96636764160,"available":96488153088,"internally_reserved":0,"allocated":1601536,"data_stored":702576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509630,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141548,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230292,"statfs":{"total":96636764160,"available":96491819008,"internally_reserved":0,"allocated":2195456,"data_stored":1292944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542335,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131280,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240560,"statfs":{"total":96636764160,"available":96502333440,"internally_reserved":0,"allocated":1634304,"data_stored":716035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:04:32.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:04:32.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.353+0000 7fd805600640 1 Processor -- start 2024-05-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd805600640 1 -- start start 2024-05-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd805600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd80009b150 0x7fd8000cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd805600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd80009b780 0x7fd8000ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd805600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8000d1310 con 0x7fd800160d90 2024-05-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd805600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd80009bcf0 con 0x7fd80009b780 2024-05-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd805600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd8000d0a70 con 0x7fd80009b150 2024-05-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd7ff400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd80009b780 0x7fd8000ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd7ff400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd80009b780 0x7fd8000ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:53282/0 (socket says 172.21.15.59:53282) 2024-05-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd7ff400640 1 -- 172.21.15.59:0/2329677193 learned_addr learned my addr 172.21.15.59:0/2329677193 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd7f6000640 1 --2- 172.21.15.59:0/2329677193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd80009b150 0x7fd8000cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd7ff400640 1 -- 172.21.15.59:0/2329677193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd80009b150 msgr2=0x7fd8000cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd7ff400640 1 --2- 172.21.15.59:0/2329677193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd80009b150 0x7fd8000cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd7ff400640 1 -- 172.21.15.59:0/2329677193 >> v1:172.21.15.107:6789/0 conn(0x7fd800160d90 legacy=0x7fd80009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd7ff400640 1 -- 172.21.15.59:0/2329677193 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8000d0d50 con 0x7fd80009b780 2024-05-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.357+0000 7fd7fe000640 1 -- 172.21.15.59:0/2329677193 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2886918148 0 0) 0x7fd8000d1310 con 0x7fd800160d90 2024-05-30T17:04:32.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd7ff400640 1 --2- 172.21.15.59:0/2329677193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd80009b780 0x7fd8000ce260 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009870 tx=0x7fd7f801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=830f0954942141e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:32.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd7fe000640 1 -- 172.21.15.59:0/2329677193 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80b1070 con 0x7fd80009b780 2024-05-30T17:04:32.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd7fe000640 1 -- 172.21.15.59:0/2329677193 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f80a8050 con 0x7fd80009b780 2024-05-30T17:04:32.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd7fe000640 1 -- 172.21.15.59:0/2329677193 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80ac860 con 0x7fd80009b780 2024-05-30T17:04:32.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd805600640 1 -- 172.21.15.59:0/2329677193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd80009b780 msgr2=0x7fd8000ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd805600640 1 --2- 172.21.15.59:0/2329677193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd80009b780 0x7fd8000ce260 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009870 tx=0x7fd7f801c4d0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd805600640 1 -- 172.21.15.59:0/2329677193 shutdown_connections 2024-05-30T17:04:32.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd805600640 1 --2- 172.21.15.59:0/2329677193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd80009b780 0x7fd8000ce260 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd805600640 1 --2- 172.21.15.59:0/2329677193 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd80009b150 0x7fd8000cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd805600640 1 -- 172.21.15.59:0/2329677193 >> 172.21.15.59:0/2329677193 conn(0x7fd8000b3f80 msgr2=0x7fd8000b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:32.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd805600640 1 -- 172.21.15.59:0/2329677193 shutdown_connections 2024-05-30T17:04:32.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd805600640 1 -- 172.21.15.59:0/2329677193 wait complete. 2024-05-30T17:04:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.361+0000 7fd805600640 1 Processor -- start 2024-05-30T17:04:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd805600640 1 -- start start 2024-05-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd805600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd80009b150 0x7fd8000cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd805600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd80009b780 0x7fd80015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd805600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd800160d90 0x7fd8000c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd805600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd800071fe0 con 0x7fd800160d90 2024-05-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd805600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd800071e60 con 0x7fd80009b780 2024-05-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd805600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd800161170 con 0x7fd80009b150 2024-05-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7ff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd800160d90 0x7fd8000c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7ff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd800160d90 0x7fd8000c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49508/0 (socket says 172.21.15.59:49508) 2024-05-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7ff400640 1 -- 172.21.15.59:0/2826748546 learned_addr learned my addr 172.21.15.59:0/2826748546 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7f6000640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd80009b780 0x7fd80015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7fea00640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd80009b150 0x7fd8000cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7ff400640 1 -- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd80009b150 msgr2=0x7fd8000cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7ff400640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd80009b150 0x7fd8000cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7ff400640 1 -- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd80009b780 msgr2=0x7fd80015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7ff400640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd80009b780 0x7fd80015bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7ff400640 1 -- 172.21.15.59:0/2826748546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8000b7b90 con 0x7fd800160d90 2024-05-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7ff400640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd800160d90 0x7fd8000c9560 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009870 tx=0x7fd7f801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7f7400640 1 -- 172.21.15.59:0/2826748546 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80b1040 con 0x7fd800160d90 2024-05-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7f7400640 1 -- 172.21.15.59:0/2826748546 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f80bd070 con 0x7fd800160d90 2024-05-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd7f7400640 1 -- 172.21.15.59:0/2826748546 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80b7420 con 0x7fd800160d90 2024-05-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd805600640 1 -- 172.21.15.59:0/2826748546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8000b7e70 con 0x7fd800160d90 2024-05-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd805600640 1 -- 172.21.15.59:0/2826748546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd80015bff0 con 0x7fd800160d90 2024-05-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.365+0000 7fd805600640 1 -- 172.21.15.59:0/2826748546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd800068a90 con 0x7fd800160d90 2024-05-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.369+0000 7fd7f7400640 1 -- 172.21.15.59:0/2826748546 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fd7f80b75e0 con 0x7fd800160d90 2024-05-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.369+0000 7fd7f7400640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7dc069fa0 0x7fd7dc06c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.369+0000 7fd7f7400640 1 -- 172.21.15.59:0/2826748546 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7fd7f811f950 con 0x7fd800160d90 2024-05-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.369+0000 7fd7fea00640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7dc069fa0 0x7fd7dc06c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.369+0000 7fd7fea00640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7dc069fa0 0x7fd7dc06c460 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00012f0 tx=0x7fd7f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.373+0000 7fd7f7400640 1 -- 172.21.15.59:0/2826748546 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd7f80c7020 con 0x7fd800160d90 2024-05-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.533+0000 7fd805600640 1 -- 172.21.15.59:0/2826748546 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8000b3900 con 0x7fd7dc069fa0 2024-05-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.541+0000 7fd7f7400640 1 -- 172.21.15.59:0/2826748546 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247786 (secure 0 0 0) 0x7fd8000b3900 con 0x7fd7dc069fa0 2024-05-30T17:04:32.542 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.541+0000 7fd805600640 1 -- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7dc069fa0 msgr2=0x7fd7dc06c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.541+0000 7fd805600640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7dc069fa0 0x7fd7dc06c460 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00012f0 tx=0x7fd7f0009040 comp rx=0 tx=0).stop 2024-05-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.541+0000 7fd805600640 1 -- 172.21.15.59:0/2826748546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd800160d90 msgr2=0x7fd8000c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.541+0000 7fd805600640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd800160d90 0x7fd8000c9560 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009870 tx=0x7fd7f801ad10 comp rx=0 tx=0).stop 2024-05-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.545+0000 7fd805600640 1 -- 172.21.15.59:0/2826748546 shutdown_connections 2024-05-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.545+0000 7fd805600640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd7dc069fa0 0x7fd7dc06c460 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.545+0000 7fd805600640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd800160d90 0x7fd8000c9560 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.545+0000 7fd805600640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd80009b780 0x7fd80015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.545+0000 7fd805600640 1 --2- 172.21.15.59:0/2826748546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd80009b150 0x7fd8000cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.545+0000 7fd805600640 1 -- 172.21.15.59:0/2826748546 >> 172.21.15.59:0/2826748546 conn(0x7fd8000b3f80 msgr2=0x7fd8001665a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.545+0000 7fd805600640 1 -- 172.21.15.59:0/2826748546 shutdown_connections 2024-05-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.545+0000 7fd805600640 1 -- 172.21.15.59:0/2826748546 wait complete. 2024-05-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":594,"stamp":"2024-05-30T17:04:31.379140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1012332,"kb_used_data":13668,"kb_used_omap":12,"kb_used_meta":998515,"kb_avail":753962388,"statfs":{"total":773094113280,"available":772057485312,"internally_reserved":0,"allocated":13996032,"data_stored":6795642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1022479920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.750927"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.644930+0000","last_change":"2024-05-30T17:04:26.644930+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.644930+0000","last_undegraded":"2024-05-30T17:04:26.644930+0000","last_fullsized":"2024-05-30T17:04:26.644930+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635506+0000","last_change":"2024-05-30T17:04:26.635506+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635506+0000","last_undegraded":"2024-05-30T17:04:26.635506+0000","last_fullsized":"2024-05-30T17:04:26.635506+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638311+0000","last_change":"2024-05-30T17:04:26.638311+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638311+0000","last_undegraded":"2024-05-30T17:04:26.638311+0000","last_fullsized":"2024-05-30T17:04:26.638311+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.641744+0000","last_change":"2024-05-30T17:04:26.641744+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.641744+0000","last_undegraded":"2024-05-30T17:04:26.641744+0000","last_fullsized":"2024-05-30T17:04:26.641744+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.640547+0000","last_change":"2024-05-30T17:04:26.640547+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.640547+0000","last_undegraded":"2024-05-30T17:04:26.640547+0000","last_fullsized":"2024-05-30T17:04:26.640547+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631350+0000","last_change":"2024-05-30T17:04:26.631350+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631350+0000","last_undegraded":"2024-05-30T17:04:26.631350+0000","last_fullsized":"2024-05-30T17:04:26.631350+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631189+0000","last_change":"2024-05-30T17:04:26.631189+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631189+0000","last_undegraded":"2024-05-30T17:04:26.631189+0000","last_fullsized":"2024-05-30T17:04:26.631189+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636699+0000","last_change":"2024-05-30T17:04:26.636699+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636699+0000","last_undegraded":"2024-05-30T17:04:26.636699+0000","last_fullsized":"2024-05-30T17:04:26.636699+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.637191+0000","last_change":"2024-05-30T17:04:26.637191+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.637191+0000","last_undegraded":"2024-05-30T17:04:26.637191+0000","last_fullsized":"2024-05-30T17:04:26.637191+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.634999+0000","last_change":"2024-05-30T17:04:26.634999+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.634999+0000","last_undegraded":"2024-05-30T17:04:26.634999+0000","last_fullsized":"2024-05-30T17:04:26.634999+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.639123+0000","last_change":"2024-05-30T17:04:26.639123+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.639123+0000","last_undegraded":"2024-05-30T17:04:26.639123+0000","last_fullsized":"2024-05-30T17:04:26.639123+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635832+0000","last_change":"2024-05-30T17:04:26.635832+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635832+0000","last_undegraded":"2024-05-30T17:04:26.635832+0000","last_fullsized":"2024-05-30T17:04:26.635832+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.653335+0000","last_change":"2024-05-30T17:04:26.653335+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.653335+0000","last_undegraded":"2024-05-30T17:04:26.653335+0000","last_fullsized":"2024-05-30T17:04:26.653335+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635330+0000","last_change":"2024-05-30T17:04:26.635330+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635330+0000","last_undegraded":"2024-05-30T17:04:26.635330+0000","last_fullsized":"2024-05-30T17:04:26.635330+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638835+0000","last_change":"2024-05-30T17:04:26.638835+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638835+0000","last_undegraded":"2024-05-30T17:04:26.638835+0000","last_fullsized":"2024-05-30T17:04:26.638835+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266123+0000","last_change":"2024-05-30T17:04:27.656402+0000","last_active":"2024-05-30T17:04:29.266123+0000","last_peered":"2024-05-30T17:04:29.266123+0000","last_clean":"2024-05-30T17:04:29.266123+0000","last_became_active":"2024-05-30T17:04:27.656141+0000","last_became_peered":"2024-05-30T17:04:27.656141+0000","last_unstale":"2024-05-30T17:04:29.266123+0000","last_undegraded":"2024-05-30T17:04:29.266123+0000","last_fullsized":"2024-05-30T17:04:29.266123+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:08.433002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631847+0000","last_change":"2024-05-30T17:04:26.631847+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631847+0000","last_undegraded":"2024-05-30T17:04:26.631847+0000","last_fullsized":"2024-05-30T17:04:26.631847+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266584+0000","last_change":"2024-05-30T17:04:27.650889+0000","last_active":"2024-05-30T17:04:29.266584+0000","last_peered":"2024-05-30T17:04:29.266584+0000","last_clean":"2024-05-30T17:04:29.266584+0000","last_became_active":"2024-05-30T17:04:27.649462+0000","last_became_peered":"2024-05-30T17:04:27.649462+0000","last_unstale":"2024-05-30T17:04:29.266584+0000","last_undegraded":"2024-05-30T17:04:29.266584+0000","last_fullsized":"2024-05-30T17:04:29.266584+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:02:33.740142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636711+0000","last_change":"2024-05-30T17:04:26.636711+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636711+0000","last_undegraded":"2024-05-30T17:04:26.636711+0000","last_fullsized":"2024-05-30T17:04:26.636711+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266495+0000","last_change":"2024-05-30T17:04:27.652401+0000","last_active":"2024-05-30T17:04:29.266495+0000","last_peered":"2024-05-30T17:04:29.266495+0000","last_clean":"2024-05-30T17:04:29.266495+0000","last_became_active":"2024-05-30T17:04:27.652097+0000","last_became_peered":"2024-05-30T17:04:27.652097+0000","last_unstale":"2024-05-30T17:04:29.266495+0000","last_undegraded":"2024-05-30T17:04:29.266495+0000","last_fullsized":"2024-05-30T17:04:29.266495+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:22:37.455945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.639170+0000","last_change":"2024-05-30T17:04:26.639170+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.639170+0000","last_undegraded":"2024-05-30T17:04:26.639170+0000","last_fullsized":"2024-05-30T17:04:26.639170+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638697+0000","last_change":"2024-05-30T17:04:26.638697+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638697+0000","last_undegraded":"2024-05-30T17:04:26.638697+0000","last_fullsized":"2024-05-30T17:04:26.638697+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635293+0000","last_change":"2024-05-30T17:04:26.635293+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635293+0000","last_undegraded":"2024-05-30T17:04:26.635293+0000","last_fullsized":"2024-05-30T17:04:26.635293+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638008+0000","last_change":"2024-05-30T17:04:26.638008+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638008+0000","last_undegraded":"2024-05-30T17:04:26.638008+0000","last_fullsized":"2024-05-30T17:04:26.638008+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635275+0000","last_change":"2024-05-30T17:04:26.635275+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635275+0000","last_undegraded":"2024-05-30T17:04:26.635275+0000","last_fullsized":"2024-05-30T17:04:26.635275+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266595+0000","last_change":"2024-05-30T17:04:27.657224+0000","last_active":"2024-05-30T17:04:29.266595+0000","last_peered":"2024-05-30T17:04:29.266595+0000","last_clean":"2024-05-30T17:04:29.266595+0000","last_became_active":"2024-05-30T17:04:27.656941+0000","last_became_peered":"2024-05-30T17:04:27.656941+0000","last_unstale":"2024-05-30T17:04:29.266595+0000","last_undegraded":"2024-05-30T17:04:29.266595+0000","last_fullsized":"2024-05-30T17:04:29.266595+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:33.680204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.641374+0000","last_change":"2024-05-30T17:04:26.641374+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.641374+0000","last_undegraded":"2024-05-30T17:04:26.641374+0000","last_fullsized":"2024-05-30T17:04:26.641374+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631634+0000","last_change":"2024-05-30T17:04:26.631634+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631634+0000","last_undegraded":"2024-05-30T17:04:26.631634+0000","last_fullsized":"2024-05-30T17:04:26.631634+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.652897+0000","last_change":"2024-05-30T17:04:26.652897+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.652897+0000","last_undegraded":"2024-05-30T17:04:26.652897+0000","last_fullsized":"2024-05-30T17:04:26.652897+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.640606+0000","last_change":"2024-05-30T17:04:26.640606+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.640606+0000","last_undegraded":"2024-05-30T17:04:26.640606+0000","last_fullsized":"2024-05-30T17:04:26.640606+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636920+0000","last_change":"2024-05-30T17:04:26.636920+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636920+0000","last_undegraded":"2024-05-30T17:04:26.636920+0000","last_fullsized":"2024-05-30T17:04:26.636920+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631593+0000","last_change":"2024-05-30T17:04:26.631593+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631593+0000","last_undegraded":"2024-05-30T17:04:26.631593+0000","last_fullsized":"2024-05-30T17:04:26.631593+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266938+0000","last_change":"2024-05-30T17:04:27.665116+0000","last_active":"2024-05-30T17:04:29.266938+0000","last_peered":"2024-05-30T17:04:29.266938+0000","last_clean":"2024-05-30T17:04:29.266938+0000","last_became_active":"2024-05-30T17:04:27.664853+0000","last_became_peered":"2024-05-30T17:04:27.664853+0000","last_unstale":"2024-05-30T17:04:29.266938+0000","last_undegraded":"2024-05-30T17:04:29.266938+0000","last_fullsized":"2024-05-30T17:04:29.266938+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:00.380018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654288+0000","last_change":"2024-05-30T17:04:26.653769+0000","last_active":"2024-05-30T17:04:26.654288+0000","last_peered":"2024-05-30T17:04:26.654288+0000","last_clean":"2024-05-30T17:04:26.654288+0000","last_became_active":"2024-05-30T17:04:26.653331+0000","last_became_peered":"2024-05-30T17:04:26.653331+0000","last_unstale":"2024-05-30T17:04:26.654288+0000","last_undegraded":"2024-05-30T17:04:26.654288+0000","last_fullsized":"2024-05-30T17:04:26.654288+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:38:18.013111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636758+0000","last_change":"2024-05-30T17:04:26.636758+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636758+0000","last_undegraded":"2024-05-30T17:04:26.636758+0000","last_fullsized":"2024-05-30T17:04:26.636758+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.653121+0000","last_change":"2024-05-30T17:04:26.652574+0000","last_active":"2024-05-30T17:04:26.653121+0000","last_peered":"2024-05-30T17:04:26.653121+0000","last_clean":"2024-05-30T17:04:26.653121+0000","last_became_active":"2024-05-30T17:04:26.652142+0000","last_became_peered":"2024-05-30T17:04:26.652142+0000","last_unstale":"2024-05-30T17:04:26.653121+0000","last_undegraded":"2024-05-30T17:04:26.653121+0000","last_fullsized":"2024-05-30T17:04:26.653121+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:02.750449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636140+0000","last_change":"2024-05-30T17:04:26.636140+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636140+0000","last_undegraded":"2024-05-30T17:04:26.636140+0000","last_fullsized":"2024-05-30T17:04:26.636140+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654798+0000","last_change":"2024-05-30T17:04:26.652502+0000","last_active":"2024-05-30T17:04:26.654798+0000","last_peered":"2024-05-30T17:04:26.654798+0000","last_clean":"2024-05-30T17:04:26.654798+0000","last_became_active":"2024-05-30T17:04:26.652240+0000","last_became_peered":"2024-05-30T17:04:26.652240+0000","last_unstale":"2024-05-30T17:04:26.654798+0000","last_undegraded":"2024-05-30T17:04:26.654798+0000","last_fullsized":"2024-05-30T17:04:26.654798+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:41:52.185908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638376+0000","last_change":"2024-05-30T17:04:26.638376+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638376+0000","last_undegraded":"2024-05-30T17:04:26.638376+0000","last_fullsized":"2024-05-30T17:04:26.638376+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.650236+0000","last_change":"2024-05-30T17:04:26.644729+0000","last_active":"2024-05-30T17:04:26.650236+0000","last_peered":"2024-05-30T17:04:26.650236+0000","last_clean":"2024-05-30T17:04:26.650236+0000","last_became_active":"2024-05-30T17:04:26.644381+0000","last_became_peered":"2024-05-30T17:04:26.644381+0000","last_unstale":"2024-05-30T17:04:26.650236+0000","last_undegraded":"2024-05-30T17:04:26.650236+0000","last_fullsized":"2024-05-30T17:04:26.650236+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:12.851756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266155+0000","last_change":"2024-05-30T17:04:27.650774+0000","last_active":"2024-05-30T17:04:29.266155+0000","last_peered":"2024-05-30T17:04:29.266155+0000","last_clean":"2024-05-30T17:04:29.266155+0000","last_became_active":"2024-05-30T17:04:27.649829+0000","last_became_peered":"2024-05-30T17:04:27.649829+0000","last_unstale":"2024-05-30T17:04:29.266155+0000","last_undegraded":"2024-05-30T17:04:29.266155+0000","last_fullsized":"2024-05-30T17:04:29.266155+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:43:56.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654476+0000","last_change":"2024-05-30T17:04:26.649081+0000","last_active":"2024-05-30T17:04:26.654476+0000","last_peered":"2024-05-30T17:04:26.654476+0000","last_clean":"2024-05-30T17:04:26.654476+0000","last_became_active":"2024-05-30T17:04:26.648809+0000","last_became_peered":"2024-05-30T17:04:26.648809+0000","last_unstale":"2024-05-30T17:04:26.654476+0000","last_undegraded":"2024-05-30T17:04:26.654476+0000","last_fullsized":"2024-05-30T17:04:26.654476+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:28.984517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.632838+0000","last_change":"2024-05-30T17:04:26.632838+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.632838+0000","last_undegraded":"2024-05-30T17:04:26.632838+0000","last_fullsized":"2024-05-30T17:04:26.632838+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266208+0000","last_change":"2024-05-30T17:04:26.650934+0000","last_active":"2024-05-30T17:04:29.266208+0000","last_peered":"2024-05-30T17:04:29.266208+0000","last_clean":"2024-05-30T17:04:29.266208+0000","last_became_active":"2024-05-30T17:04:26.650668+0000","last_became_peered":"2024-05-30T17:04:26.650668+0000","last_unstale":"2024-05-30T17:04:29.266208+0000","last_undegraded":"2024-05-30T17:04:29.266208+0000","last_fullsized":"2024-05-30T17:04:29.266208+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:04.028994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636215+0000","last_change":"2024-05-30T17:04:26.636215+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636215+0000","last_undegraded":"2024-05-30T17:04:26.636215+0000","last_fullsized":"2024-05-30T17:04:26.636215+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.645187+0000","last_change":"2024-05-30T17:04:26.642168+0000","last_active":"2024-05-30T17:04:26.645187+0000","last_peered":"2024-05-30T17:04:26.645187+0000","last_clean":"2024-05-30T17:04:26.645187+0000","last_became_active":"2024-05-30T17:04:26.641791+0000","last_became_peered":"2024-05-30T17:04:26.641791+0000","last_unstale":"2024-05-30T17:04:26.645187+0000","last_undegraded":"2024-05-30T17:04:26.645187+0000","last_fullsized":"2024-05-30T17:04:26.645187+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:41:35.345382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.634592+0000","last_change":"2024-05-30T17:04:26.634592+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.634592+0000","last_undegraded":"2024-05-30T17:04:26.634592+0000","last_fullsized":"2024-05-30T17:04:26.634592+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.646230+0000","last_change":"2024-05-30T17:04:26.645457+0000","last_active":"2024-05-30T17:04:26.646230+0000","last_peered":"2024-05-30T17:04:26.646230+0000","last_clean":"2024-05-30T17:04:26.646230+0000","last_became_active":"2024-05-30T17:04:26.642988+0000","last_became_peered":"2024-05-30T17:04:26.642988+0000","last_unstale":"2024-05-30T17:04:26.646230+0000","last_undegraded":"2024-05-30T17:04:26.646230+0000","last_fullsized":"2024-05-30T17:04:26.646230+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:56:53.520715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.643824+0000","last_change":"2024-05-30T17:04:26.643824+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.643824+0000","last_undegraded":"2024-05-30T17:04:26.643824+0000","last_fullsized":"2024-05-30T17:04:26.643824+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654544+0000","last_change":"2024-05-30T17:04:26.653783+0000","last_active":"2024-05-30T17:04:26.654544+0000","last_peered":"2024-05-30T17:04:26.654544+0000","last_clean":"2024-05-30T17:04:26.654544+0000","last_became_active":"2024-05-30T17:04:26.653413+0000","last_became_peered":"2024-05-30T17:04:26.653413+0000","last_unstale":"2024-05-30T17:04:26.654544+0000","last_undegraded":"2024-05-30T17:04:26.654544+0000","last_fullsized":"2024-05-30T17:04:26.654544+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:14.217436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633032+0000","last_change":"2024-05-30T17:04:26.633032+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633032+0000","last_undegraded":"2024-05-30T17:04:26.633032+0000","last_fullsized":"2024-05-30T17:04:26.633032+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266674+0000","last_change":"2024-05-30T17:04:26.649285+0000","last_active":"2024-05-30T17:04:29.266674+0000","last_peered":"2024-05-30T17:04:29.266674+0000","last_clean":"2024-05-30T17:04:29.266674+0000","last_became_active":"2024-05-30T17:04:26.648983+0000","last_became_peered":"2024-05-30T17:04:26.648983+0000","last_unstale":"2024-05-30T17:04:29.266674+0000","last_undegraded":"2024-05-30T17:04:29.266674+0000","last_fullsized":"2024-05-30T17:04:29.266674+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:19.123667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635575+0000","last_change":"2024-05-30T17:04:26.635575+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635575+0000","last_undegraded":"2024-05-30T17:04:26.635575+0000","last_fullsized":"2024-05-30T17:04:26.635575+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.656464+0000","last_change":"2024-05-30T17:04:26.655873+0000","last_active":"2024-05-30T17:04:26.656464+0000","last_peered":"2024-05-30T17:04:26.656464+0000","last_clean":"2024-05-30T17:04:26.656464+0000","last_became_active":"2024-05-30T17:04:26.655436+0000","last_became_peered":"2024-05-30T17:04:26.655436+0000","last_unstale":"2024-05-30T17:04:26.656464+0000","last_undegraded":"2024-05-30T17:04:26.656464+0000","last_fullsized":"2024-05-30T17:04:26.656464+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:20.851133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.637882+0000","last_change":"2024-05-30T17:04:26.637882+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.637882+0000","last_undegraded":"2024-05-30T17:04:26.637882+0000","last_fullsized":"2024-05-30T17:04:26.637882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.646625+0000","last_change":"2024-05-30T17:04:26.644996+0000","last_active":"2024-05-30T17:04:26.646625+0000","last_peered":"2024-05-30T17:04:26.646625+0000","last_clean":"2024-05-30T17:04:26.646625+0000","last_became_active":"2024-05-30T17:04:26.644394+0000","last_became_peered":"2024-05-30T17:04:26.644394+0000","last_unstale":"2024-05-30T17:04:26.646625+0000","last_undegraded":"2024-05-30T17:04:26.646625+0000","last_fullsized":"2024-05-30T17:04:26.646625+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:45:55.504801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.652394+0000","last_change":"2024-05-30T17:04:26.652394+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.652394+0000","last_undegraded":"2024-05-30T17:04:26.652394+0000","last_fullsized":"2024-05-30T17:04:26.652394+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654569+0000","last_change":"2024-05-30T17:04:26.648513+0000","last_active":"2024-05-30T17:04:26.654569+0000","last_peered":"2024-05-30T17:04:26.654569+0000","last_clean":"2024-05-30T17:04:26.654569+0000","last_became_active":"2024-05-30T17:04:26.648016+0000","last_became_peered":"2024-05-30T17:04:26.648016+0000","last_unstale":"2024-05-30T17:04:26.654569+0000","last_undegraded":"2024-05-30T17:04:26.654569+0000","last_fullsized":"2024-05-30T17:04:26.654569+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:23:52.647599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.634425+0000","last_change":"2024-05-30T17:04:26.634425+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.634425+0000","last_undegraded":"2024-05-30T17:04:26.634425+0000","last_fullsized":"2024-05-30T17:04:26.634425+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.646449+0000","last_change":"2024-05-30T17:04:26.643372+0000","last_active":"2024-05-30T17:04:26.646449+0000","last_peered":"2024-05-30T17:04:26.646449+0000","last_clean":"2024-05-30T17:04:26.646449+0000","last_became_active":"2024-05-30T17:04:26.641530+0000","last_became_peered":"2024-05-30T17:04:26.641530+0000","last_unstale":"2024-05-30T17:04:26.646449+0000","last_undegraded":"2024-05-30T17:04:26.646449+0000","last_fullsized":"2024-05-30T17:04:26.646449+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:23:52.647599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635921+0000","last_change":"2024-05-30T17:04:26.635921+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635921+0000","last_undegraded":"2024-05-30T17:04:26.635921+0000","last_fullsized":"2024-05-30T17:04:26.635921+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.652596+0000","last_change":"2024-05-30T17:04:26.651768+0000","last_active":"2024-05-30T17:04:26.652596+0000","last_peered":"2024-05-30T17:04:26.652596+0000","last_clean":"2024-05-30T17:04:26.652596+0000","last_became_active":"2024-05-30T17:04:26.651470+0000","last_became_peered":"2024-05-30T17:04:26.651470+0000","last_unstale":"2024-05-30T17:04:26.652596+0000","last_undegraded":"2024-05-30T17:04:26.652596+0000","last_fullsized":"2024-05-30T17:04:26.652596+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:46.418471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636651+0000","last_change":"2024-05-30T17:04:26.636651+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636651+0000","last_undegraded":"2024-05-30T17:04:26.636651+0000","last_fullsized":"2024-05-30T17:04:26.636651+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.648286+0000","last_change":"2024-05-30T17:04:26.646106+0000","last_active":"2024-05-30T17:04:26.648286+0000","last_peered":"2024-05-30T17:04:26.648286+0000","last_clean":"2024-05-30T17:04:26.648286+0000","last_became_active":"2024-05-30T17:04:26.645435+0000","last_became_peered":"2024-05-30T17:04:26.645435+0000","last_unstale":"2024-05-30T17:04:26.648286+0000","last_undegraded":"2024-05-30T17:04:26.648286+0000","last_fullsized":"2024-05-30T17:04:26.648286+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:24:46.141540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.632603+0000","last_change":"2024-05-30T17:04:26.632603+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.632603+0000","last_undegraded":"2024-05-30T17:04:26.632603+0000","last_fullsized":"2024-05-30T17:04:26.632603+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654939+0000","last_change":"2024-05-30T17:04:26.649232+0000","last_active":"2024-05-30T17:04:26.654939+0000","last_peered":"2024-05-30T17:04:26.654939+0000","last_clean":"2024-05-30T17:04:26.654939+0000","last_became_active":"2024-05-30T17:04:26.648936+0000","last_became_peered":"2024-05-30T17:04:26.648936+0000","last_unstale":"2024-05-30T17:04:26.654939+0000","last_undegraded":"2024-05-30T17:04:26.654939+0000","last_fullsized":"2024-05-30T17:04:26.654939+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:50:10.017227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266652+0000","last_change":"2024-05-30T17:04:27.657488+0000","last_active":"2024-05-30T17:04:29.266652+0000","last_peered":"2024-05-30T17:04:29.266652+0000","last_clean":"2024-05-30T17:04:29.266652+0000","last_became_active":"2024-05-30T17:04:27.657216+0000","last_became_peered":"2024-05-30T17:04:27.657216+0000","last_unstale":"2024-05-30T17:04:29.266652+0000","last_undegraded":"2024-05-30T17:04:29.266652+0000","last_fullsized":"2024-05-30T17:04:29.266652+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:18.543050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.653010+0000","last_change":"2024-05-30T17:04:26.652397+0000","last_active":"2024-05-30T17:04:26.653010+0000","last_peered":"2024-05-30T17:04:26.653010+0000","last_clean":"2024-05-30T17:04:26.653010+0000","last_became_active":"2024-05-30T17:04:26.652083+0000","last_became_peered":"2024-05-30T17:04:26.652083+0000","last_unstale":"2024-05-30T17:04:26.653010+0000","last_undegraded":"2024-05-30T17:04:26.653010+0000","last_fullsized":"2024-05-30T17:04:26.653010+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:37:07.130536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633700+0000","last_change":"2024-05-30T17:04:26.633700+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633700+0000","last_undegraded":"2024-05-30T17:04:26.633700+0000","last_fullsized":"2024-05-30T17:04:26.633700+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.648253+0000","last_change":"2024-05-30T17:04:26.646336+0000","last_active":"2024-05-30T17:04:26.648253+0000","last_peered":"2024-05-30T17:04:26.648253+0000","last_clean":"2024-05-30T17:04:26.648253+0000","last_became_active":"2024-05-30T17:04:26.646025+0000","last_became_peered":"2024-05-30T17:04:26.646025+0000","last_unstale":"2024-05-30T17:04:26.648253+0000","last_undegraded":"2024-05-30T17:04:26.648253+0000","last_fullsized":"2024-05-30T17:04:26.648253+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:33.438380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.640162+0000","last_change":"2024-05-30T17:04:26.640162+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.640162+0000","last_undegraded":"2024-05-30T17:04:26.640162+0000","last_fullsized":"2024-05-30T17:04:26.640162+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.658717+0000","last_change":"2024-05-30T17:04:26.657719+0000","last_active":"2024-05-30T17:04:26.658717+0000","last_peered":"2024-05-30T17:04:26.658717+0000","last_clean":"2024-05-30T17:04:26.658717+0000","last_became_active":"2024-05-30T17:04:26.657452+0000","last_became_peered":"2024-05-30T17:04:26.657452+0000","last_unstale":"2024-05-30T17:04:26.658717+0000","last_undegraded":"2024-05-30T17:04:26.658717+0000","last_fullsized":"2024-05-30T17:04:26.658717+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:05:26.624348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.630967+0000","last_change":"2024-05-30T17:04:26.630967+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.630967+0000","last_undegraded":"2024-05-30T17:04:26.630967+0000","last_fullsized":"2024-05-30T17:04:26.630967+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266335+0000","last_change":"2024-05-30T17:04:26.645875+0000","last_active":"2024-05-30T17:04:29.266335+0000","last_peered":"2024-05-30T17:04:29.266335+0000","last_clean":"2024-05-30T17:04:29.266335+0000","last_became_active":"2024-05-30T17:04:26.645583+0000","last_became_peered":"2024-05-30T17:04:26.645583+0000","last_unstale":"2024-05-30T17:04:29.266335+0000","last_undegraded":"2024-05-30T17:04:29.266335+0000","last_fullsized":"2024-05-30T17:04:29.266335+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:03.486308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633916+0000","last_change":"2024-05-30T17:04:26.633916+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633916+0000","last_undegraded":"2024-05-30T17:04:26.633916+0000","last_fullsized":"2024-05-30T17:04:26.633916+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265914+0000","last_change":"2024-05-30T17:04:26.647421+0000","last_active":"2024-05-30T17:04:29.265914+0000","last_peered":"2024-05-30T17:04:29.265914+0000","last_clean":"2024-05-30T17:04:29.265914+0000","last_became_active":"2024-05-30T17:04:26.647155+0000","last_became_peered":"2024-05-30T17:04:26.647155+0000","last_unstale":"2024-05-30T17:04:29.265914+0000","last_undegraded":"2024-05-30T17:04:29.265914+0000","last_fullsized":"2024-05-30T17:04:29.265914+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:59:52.705838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.637392+0000","last_change":"2024-05-30T17:04:26.637392+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.637392+0000","last_undegraded":"2024-05-30T17:04:26.637392+0000","last_fullsized":"2024-05-30T17:04:26.637392+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.655617+0000","last_change":"2024-05-30T17:04:26.650930+0000","last_active":"2024-05-30T17:04:26.655617+0000","last_peered":"2024-05-30T17:04:26.655617+0000","last_clean":"2024-05-30T17:04:26.655617+0000","last_became_active":"2024-05-30T17:04:26.650616+0000","last_became_peered":"2024-05-30T17:04:26.650616+0000","last_unstale":"2024-05-30T17:04:26.655617+0000","last_undegraded":"2024-05-30T17:04:26.655617+0000","last_fullsized":"2024-05-30T17:04:26.655617+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:39:55.080473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631855+0000","last_change":"2024-05-30T17:04:26.631855+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631855+0000","last_undegraded":"2024-05-30T17:04:26.631855+0000","last_fullsized":"2024-05-30T17:04:26.631855+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654744+0000","last_change":"2024-05-30T17:04:26.653129+0000","last_active":"2024-05-30T17:04:26.654744+0000","last_peered":"2024-05-30T17:04:26.654744+0000","last_clean":"2024-05-30T17:04:26.654744+0000","last_became_active":"2024-05-30T17:04:26.652234+0000","last_became_peered":"2024-05-30T17:04:26.652234+0000","last_unstale":"2024-05-30T17:04:26.654744+0000","last_undegraded":"2024-05-30T17:04:26.654744+0000","last_fullsized":"2024-05-30T17:04:26.654744+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:32.416930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.647675+0000","last_change":"2024-05-30T17:04:26.647675+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.647675+0000","last_undegraded":"2024-05-30T17:04:26.647675+0000","last_fullsized":"2024-05-30T17:04:26.647675+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.650180+0000","last_change":"2024-05-30T17:04:26.649574+0000","last_active":"2024-05-30T17:04:26.650180+0000","last_peered":"2024-05-30T17:04:26.650180+0000","last_clean":"2024-05-30T17:04:26.650180+0000","last_became_active":"2024-05-30T17:04:26.648998+0000","last_became_peered":"2024-05-30T17:04:26.648998+0000","last_unstale":"2024-05-30T17:04:26.650180+0000","last_undegraded":"2024-05-30T17:04:26.650180+0000","last_fullsized":"2024-05-30T17:04:26.650180+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:22.583010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633538+0000","last_change":"2024-05-30T17:04:26.633538+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633538+0000","last_undegraded":"2024-05-30T17:04:26.633538+0000","last_fullsized":"2024-05-30T17:04:26.633538+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654441+0000","last_change":"2024-05-30T17:04:26.647328+0000","last_active":"2024-05-30T17:04:26.654441+0000","last_peered":"2024-05-30T17:04:26.654441+0000","last_clean":"2024-05-30T17:04:26.654441+0000","last_became_active":"2024-05-30T17:04:26.647058+0000","last_became_peered":"2024-05-30T17:04:26.647058+0000","last_unstale":"2024-05-30T17:04:26.654441+0000","last_undegraded":"2024-05-30T17:04:26.654441+0000","last_fullsized":"2024-05-30T17:04:26.654441+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:37:15.984675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631554+0000","last_change":"2024-05-30T17:04:26.631554+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631554+0000","last_undegraded":"2024-05-30T17:04:26.631554+0000","last_fullsized":"2024-05-30T17:04:26.631554+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.656291+0000","last_change":"2024-05-30T17:04:26.655225+0000","last_active":"2024-05-30T17:04:26.656291+0000","last_peered":"2024-05-30T17:04:26.656291+0000","last_clean":"2024-05-30T17:04:26.656291+0000","last_became_active":"2024-05-30T17:04:26.654383+0000","last_became_peered":"2024-05-30T17:04:26.654383+0000","last_unstale":"2024-05-30T17:04:26.656291+0000","last_undegraded":"2024-05-30T17:04:26.656291+0000","last_fullsized":"2024-05-30T17:04:26.656291+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:19.749763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636200+0000","last_change":"2024-05-30T17:04:26.636200+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636200+0000","last_undegraded":"2024-05-30T17:04:26.636200+0000","last_fullsized":"2024-05-30T17:04:26.636200+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.645955+0000","last_change":"2024-05-30T17:04:26.643654+0000","last_active":"2024-05-30T17:04:26.645955+0000","last_peered":"2024-05-30T17:04:26.645955+0000","last_clean":"2024-05-30T17:04:26.645955+0000","last_became_active":"2024-05-30T17:04:26.642798+0000","last_became_peered":"2024-05-30T17:04:26.642798+0000","last_unstale":"2024-05-30T17:04:26.645955+0000","last_undegraded":"2024-05-30T17:04:26.645955+0000","last_fullsized":"2024-05-30T17:04:26.645955+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:32.416930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631101+0000","last_change":"2024-05-30T17:04:26.631101+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631101+0000","last_undegraded":"2024-05-30T17:04:26.631101+0000","last_fullsized":"2024-05-30T17:04:26.631101+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.651216+0000","last_change":"2024-05-30T17:04:26.650407+0000","last_active":"2024-05-30T17:04:26.651216+0000","last_peered":"2024-05-30T17:04:26.651216+0000","last_clean":"2024-05-30T17:04:26.651216+0000","last_became_active":"2024-05-30T17:04:26.650063+0000","last_became_peered":"2024-05-30T17:04:26.650063+0000","last_unstale":"2024-05-30T17:04:26.651216+0000","last_undegraded":"2024-05-30T17:04:26.651216+0000","last_fullsized":"2024-05-30T17:04:26.651216+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:22.172682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266816+0000","last_change":"2024-05-30T17:04:27.648839+0000","last_active":"2024-05-30T17:04:29.266816+0000","last_peered":"2024-05-30T17:04:29.266816+0000","last_clean":"2024-05-30T17:04:29.266816+0000","last_became_active":"2024-05-30T17:04:27.648558+0000","last_became_peered":"2024-05-30T17:04:27.648558+0000","last_unstale":"2024-05-30T17:04:29.266816+0000","last_undegraded":"2024-05-30T17:04:29.266816+0000","last_fullsized":"2024-05-30T17:04:29.266816+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:52.862600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266032+0000","last_change":"2024-05-30T17:04:26.646155+0000","last_active":"2024-05-30T17:04:29.266032+0000","last_peered":"2024-05-30T17:04:29.266032+0000","last_clean":"2024-05-30T17:04:29.266032+0000","last_became_active":"2024-05-30T17:04:26.645855+0000","last_became_peered":"2024-05-30T17:04:26.645855+0000","last_unstale":"2024-05-30T17:04:29.266032+0000","last_undegraded":"2024-05-30T17:04:29.266032+0000","last_fullsized":"2024-05-30T17:04:29.266032+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:51.017861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633426+0000","last_change":"2024-05-30T17:04:26.633426+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633426+0000","last_undegraded":"2024-05-30T17:04:26.633426+0000","last_fullsized":"2024-05-30T17:04:26.633426+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.650821+0000","last_change":"2024-05-30T17:04:26.646414+0000","last_active":"2024-05-30T17:04:26.650821+0000","last_peered":"2024-05-30T17:04:26.650821+0000","last_clean":"2024-05-30T17:04:26.650821+0000","last_became_active":"2024-05-30T17:04:26.646125+0000","last_became_peered":"2024-05-30T17:04:26.646125+0000","last_unstale":"2024-05-30T17:04:26.650821+0000","last_undegraded":"2024-05-30T17:04:26.650821+0000","last_fullsized":"2024-05-30T17:04:26.650821+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:56:41.482517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635702+0000","last_change":"2024-05-30T17:04:26.635702+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635702+0000","last_undegraded":"2024-05-30T17:04:26.635702+0000","last_fullsized":"2024-05-30T17:04:26.635702+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.656836+0000","last_change":"2024-05-30T17:04:26.656301+0000","last_active":"2024-05-30T17:04:26.656836+0000","last_peered":"2024-05-30T17:04:26.656836+0000","last_clean":"2024-05-30T17:04:26.656836+0000","last_became_active":"2024-05-30T17:04:26.655900+0000","last_became_peered":"2024-05-30T17:04:26.655900+0000","last_unstale":"2024-05-30T17:04:26.656836+0000","last_undegraded":"2024-05-30T17:04:26.656836+0000","last_fullsized":"2024-05-30T17:04:26.656836+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:11.815687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":374,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.641213+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:04:26.641213+0000","last_peered":"2024-05-30T17:04:26.641213+0000","last_clean":"2024-05-30T17:04:26.641213+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:04:26.641213+0000","last_undegraded":"2024-05-30T17:04:26.641213+0000","last_fullsized":"2024-05-30T17:04:26.641213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509629,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127656,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244184,"statfs":{"total":96636764160,"available":96506044416,"internally_reserved":0,"allocated":2183168,"data_stored":1286557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509630,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127080,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244760,"statfs":{"total":96636764160,"available":96506634240,"internally_reserved":0,"allocated":1601536,"data_stored":702576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509630,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85488,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":83902,"kb_avail":94286352,"statfs":{"total":96636764160,"available":96549224448,"internally_reserved":0,"allocated":1601536,"data_stored":702576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":85916101},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509631,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109032,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94262808,"statfs":{"total":96636764160,"available":96525115392,"internally_reserved":0,"allocated":1589248,"data_stored":696189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509630,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145120,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226720,"statfs":{"total":96636764160,"available":96488161280,"internally_reserved":0,"allocated":1589248,"data_stored":696189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509630,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145128,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226712,"statfs":{"total":96636764160,"available":96488153088,"internally_reserved":0,"allocated":1601536,"data_stored":702576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509630,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141548,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230292,"statfs":{"total":96636764160,"available":96491819008,"internally_reserved":0,"allocated":2195456,"data_stored":1292944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542335,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131280,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240560,"statfs":{"total":96636764160,"available":96502333440,"internally_reserved":0,"allocated":1634304,"data_stored":716035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:04:32.567 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3f is not active+clean 2024-05-30T17:04:32.567 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.644930+0000', 'last_change': '2024-05-30T17:04:26.644930+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.644930+0000', 'last_undegraded': '2024-05-30T17:04:26.644930+0000', 'last_fullsized': '2024-05-30T17:04:26.644930+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T17:04:32.568 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3e is not active+clean 2024-05-30T17:04:32.568 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.635506+0000', 'last_change': '2024-05-30T17:04:26.635506+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.635506+0000', 'last_undegraded': '2024-05-30T17:04:26.635506+0000', 'last_fullsized': '2024-05-30T17:04:26.635506+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T17:04:32.568 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3d is not active+clean 2024-05-30T17:04:32.568 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.638311+0000', 'last_change': '2024-05-30T17:04:26.638311+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.638311+0000', 'last_undegraded': '2024-05-30T17:04:26.638311+0000', 'last_fullsized': '2024-05-30T17:04:26.638311+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T17:04:32.568 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3c is not active+clean 2024-05-30T17:04:32.568 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.641744+0000', 'last_change': '2024-05-30T17:04:26.641744+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.641744+0000', 'last_undegraded': '2024-05-30T17:04:26.641744+0000', 'last_fullsized': '2024-05-30T17:04:26.641744+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T17:04:32.568 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3b is not active+clean 2024-05-30T17:04:32.568 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.640547+0000', 'last_change': '2024-05-30T17:04:26.640547+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.640547+0000', 'last_undegraded': '2024-05-30T17:04:26.640547+0000', 'last_fullsized': '2024-05-30T17:04:26.640547+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T17:04:32.568 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3a is not active+clean 2024-05-30T17:04:32.568 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.631350+0000', 'last_change': '2024-05-30T17:04:26.631350+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.631350+0000', 'last_undegraded': '2024-05-30T17:04:26.631350+0000', 'last_fullsized': '2024-05-30T17:04:26.631350+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T17:04:32.568 INFO:tasks.ceph.ceph_manager.ceph:PG 19.39 is not active+clean 2024-05-30T17:04:32.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.631189+0000', 'last_change': '2024-05-30T17:04:26.631189+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.631189+0000', 'last_undegraded': '2024-05-30T17:04:26.631189+0000', 'last_fullsized': '2024-05-30T17:04:26.631189+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T17:04:32.569 INFO:tasks.ceph.ceph_manager.ceph:PG 19.38 is not active+clean 2024-05-30T17:04:32.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.636699+0000', 'last_change': '2024-05-30T17:04:26.636699+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.636699+0000', 'last_undegraded': '2024-05-30T17:04:26.636699+0000', 'last_fullsized': '2024-05-30T17:04:26.636699+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T17:04:32.569 INFO:tasks.ceph.ceph_manager.ceph:PG 19.37 is not active+clean 2024-05-30T17:04:32.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.637191+0000', 'last_change': '2024-05-30T17:04:26.637191+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.637191+0000', 'last_undegraded': '2024-05-30T17:04:26.637191+0000', 'last_fullsized': '2024-05-30T17:04:26.637191+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T17:04:32.569 INFO:tasks.ceph.ceph_manager.ceph:PG 19.36 is not active+clean 2024-05-30T17:04:32.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.634999+0000', 'last_change': '2024-05-30T17:04:26.634999+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.634999+0000', 'last_undegraded': '2024-05-30T17:04:26.634999+0000', 'last_fullsized': '2024-05-30T17:04:26.634999+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T17:04:32.569 INFO:tasks.ceph.ceph_manager.ceph:PG 19.35 is not active+clean 2024-05-30T17:04:32.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.639123+0000', 'last_change': '2024-05-30T17:04:26.639123+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.639123+0000', 'last_undegraded': '2024-05-30T17:04:26.639123+0000', 'last_fullsized': '2024-05-30T17:04:26.639123+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T17:04:32.569 INFO:tasks.ceph.ceph_manager.ceph:PG 19.34 is not active+clean 2024-05-30T17:04:32.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.635832+0000', 'last_change': '2024-05-30T17:04:26.635832+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.635832+0000', 'last_undegraded': '2024-05-30T17:04:26.635832+0000', 'last_fullsized': '2024-05-30T17:04:26.635832+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T17:04:32.570 INFO:tasks.ceph.ceph_manager.ceph:PG 19.33 is not active+clean 2024-05-30T17:04:32.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.653335+0000', 'last_change': '2024-05-30T17:04:26.653335+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.653335+0000', 'last_undegraded': '2024-05-30T17:04:26.653335+0000', 'last_fullsized': '2024-05-30T17:04:26.653335+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T17:04:32.570 INFO:tasks.ceph.ceph_manager.ceph:PG 19.32 is not active+clean 2024-05-30T17:04:32.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.635330+0000', 'last_change': '2024-05-30T17:04:26.635330+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.635330+0000', 'last_undegraded': '2024-05-30T17:04:26.635330+0000', 'last_fullsized': '2024-05-30T17:04:26.635330+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T17:04:32.570 INFO:tasks.ceph.ceph_manager.ceph:PG 19.31 is not active+clean 2024-05-30T17:04:32.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.638835+0000', 'last_change': '2024-05-30T17:04:26.638835+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.638835+0000', 'last_undegraded': '2024-05-30T17:04:26.638835+0000', 'last_fullsized': '2024-05-30T17:04:26.638835+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T17:04:32.570 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2f is not active+clean 2024-05-30T17:04:32.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.631847+0000', 'last_change': '2024-05-30T17:04:26.631847+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.631847+0000', 'last_undegraded': '2024-05-30T17:04:26.631847+0000', 'last_fullsized': '2024-05-30T17:04:26.631847+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T17:04:32.570 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2d is not active+clean 2024-05-30T17:04:32.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.636711+0000', 'last_change': '2024-05-30T17:04:26.636711+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.636711+0000', 'last_undegraded': '2024-05-30T17:04:26.636711+0000', 'last_fullsized': '2024-05-30T17:04:26.636711+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T17:04:32.570 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2b is not active+clean 2024-05-30T17:04:32.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.639170+0000', 'last_change': '2024-05-30T17:04:26.639170+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.639170+0000', 'last_undegraded': '2024-05-30T17:04:26.639170+0000', 'last_fullsized': '2024-05-30T17:04:26.639170+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T17:04:32.571 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2a is not active+clean 2024-05-30T17:04:32.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.638697+0000', 'last_change': '2024-05-30T17:04:26.638697+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.638697+0000', 'last_undegraded': '2024-05-30T17:04:26.638697+0000', 'last_fullsized': '2024-05-30T17:04:26.638697+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T17:04:32.571 INFO:tasks.ceph.ceph_manager.ceph:PG 19.29 is not active+clean 2024-05-30T17:04:32.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.635293+0000', 'last_change': '2024-05-30T17:04:26.635293+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.635293+0000', 'last_undegraded': '2024-05-30T17:04:26.635293+0000', 'last_fullsized': '2024-05-30T17:04:26.635293+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T17:04:32.571 INFO:tasks.ceph.ceph_manager.ceph:PG 19.28 is not active+clean 2024-05-30T17:04:32.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.638008+0000', 'last_change': '2024-05-30T17:04:26.638008+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.638008+0000', 'last_undegraded': '2024-05-30T17:04:26.638008+0000', 'last_fullsized': '2024-05-30T17:04:26.638008+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T17:04:32.571 INFO:tasks.ceph.ceph_manager.ceph:PG 19.27 is not active+clean 2024-05-30T17:04:32.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.635275+0000', 'last_change': '2024-05-30T17:04:26.635275+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.635275+0000', 'last_undegraded': '2024-05-30T17:04:26.635275+0000', 'last_fullsized': '2024-05-30T17:04:26.635275+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T17:04:32.571 INFO:tasks.ceph.ceph_manager.ceph:PG 19.25 is not active+clean 2024-05-30T17:04:32.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.641374+0000', 'last_change': '2024-05-30T17:04:26.641374+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.641374+0000', 'last_undegraded': '2024-05-30T17:04:26.641374+0000', 'last_fullsized': '2024-05-30T17:04:26.641374+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T17:04:32.572 INFO:tasks.ceph.ceph_manager.ceph:PG 19.24 is not active+clean 2024-05-30T17:04:32.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.631634+0000', 'last_change': '2024-05-30T17:04:26.631634+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.631634+0000', 'last_undegraded': '2024-05-30T17:04:26.631634+0000', 'last_fullsized': '2024-05-30T17:04:26.631634+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T17:04:32.572 INFO:tasks.ceph.ceph_manager.ceph:PG 19.23 is not active+clean 2024-05-30T17:04:32.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.652897+0000', 'last_change': '2024-05-30T17:04:26.652897+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.652897+0000', 'last_undegraded': '2024-05-30T17:04:26.652897+0000', 'last_fullsized': '2024-05-30T17:04:26.652897+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T17:04:32.572 INFO:tasks.ceph.ceph_manager.ceph:PG 19.22 is not active+clean 2024-05-30T17:04:32.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.640606+0000', 'last_change': '2024-05-30T17:04:26.640606+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.640606+0000', 'last_undegraded': '2024-05-30T17:04:26.640606+0000', 'last_fullsized': '2024-05-30T17:04:26.640606+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T17:04:32.572 INFO:tasks.ceph.ceph_manager.ceph:PG 19.21 is not active+clean 2024-05-30T17:04:32.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.636920+0000', 'last_change': '2024-05-30T17:04:26.636920+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.636920+0000', 'last_undegraded': '2024-05-30T17:04:26.636920+0000', 'last_fullsized': '2024-05-30T17:04:26.636920+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T17:04:32.572 INFO:tasks.ceph.ceph_manager.ceph:PG 19.20 is not active+clean 2024-05-30T17:04:32.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.631593+0000', 'last_change': '2024-05-30T17:04:26.631593+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.631593+0000', 'last_undegraded': '2024-05-30T17:04:26.631593+0000', 'last_fullsized': '2024-05-30T17:04:26.631593+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T17:04:32.572 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1f is not active+clean 2024-05-30T17:04:32.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.636758+0000', 'last_change': '2024-05-30T17:04:26.636758+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.636758+0000', 'last_undegraded': '2024-05-30T17:04:26.636758+0000', 'last_fullsized': '2024-05-30T17:04:26.636758+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T17:04:32.573 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1c is not active+clean 2024-05-30T17:04:32.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.636140+0000', 'last_change': '2024-05-30T17:04:26.636140+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.636140+0000', 'last_undegraded': '2024-05-30T17:04:26.636140+0000', 'last_fullsized': '2024-05-30T17:04:26.636140+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T17:04:32.573 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1d is not active+clean 2024-05-30T17:04:32.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.638376+0000', 'last_change': '2024-05-30T17:04:26.638376+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.638376+0000', 'last_undegraded': '2024-05-30T17:04:26.638376+0000', 'last_fullsized': '2024-05-30T17:04:26.638376+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T17:04:32.573 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1b is not active+clean 2024-05-30T17:04:32.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.632838+0000', 'last_change': '2024-05-30T17:04:26.632838+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.632838+0000', 'last_undegraded': '2024-05-30T17:04:26.632838+0000', 'last_fullsized': '2024-05-30T17:04:26.632838+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T17:04:32.573 INFO:tasks.ceph.ceph_manager.ceph:PG 19.18 is not active+clean 2024-05-30T17:04:32.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.636215+0000', 'last_change': '2024-05-30T17:04:26.636215+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.636215+0000', 'last_undegraded': '2024-05-30T17:04:26.636215+0000', 'last_fullsized': '2024-05-30T17:04:26.636215+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T17:04:32.573 INFO:tasks.ceph.ceph_manager.ceph:PG 19.19 is not active+clean 2024-05-30T17:04:32.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.634592+0000', 'last_change': '2024-05-30T17:04:26.634592+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.634592+0000', 'last_undegraded': '2024-05-30T17:04:26.634592+0000', 'last_fullsized': '2024-05-30T17:04:26.634592+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T17:04:32.574 INFO:tasks.ceph.ceph_manager.ceph:PG 19.16 is not active+clean 2024-05-30T17:04:32.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.643824+0000', 'last_change': '2024-05-30T17:04:26.643824+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.643824+0000', 'last_undegraded': '2024-05-30T17:04:26.643824+0000', 'last_fullsized': '2024-05-30T17:04:26.643824+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T17:04:32.574 INFO:tasks.ceph.ceph_manager.ceph:PG 19.17 is not active+clean 2024-05-30T17:04:32.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.633032+0000', 'last_change': '2024-05-30T17:04:26.633032+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.633032+0000', 'last_undegraded': '2024-05-30T17:04:26.633032+0000', 'last_fullsized': '2024-05-30T17:04:26.633032+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T17:04:32.574 INFO:tasks.ceph.ceph_manager.ceph:PG 19.14 is not active+clean 2024-05-30T17:04:32.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.635575+0000', 'last_change': '2024-05-30T17:04:26.635575+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.635575+0000', 'last_undegraded': '2024-05-30T17:04:26.635575+0000', 'last_fullsized': '2024-05-30T17:04:26.635575+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T17:04:32.574 INFO:tasks.ceph.ceph_manager.ceph:PG 19.15 is not active+clean 2024-05-30T17:04:32.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.637882+0000', 'last_change': '2024-05-30T17:04:26.637882+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.637882+0000', 'last_undegraded': '2024-05-30T17:04:26.637882+0000', 'last_fullsized': '2024-05-30T17:04:26.637882+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T17:04:32.574 INFO:tasks.ceph.ceph_manager.ceph:PG 19.13 is not active+clean 2024-05-30T17:04:32.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.652394+0000', 'last_change': '2024-05-30T17:04:26.652394+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.652394+0000', 'last_undegraded': '2024-05-30T17:04:26.652394+0000', 'last_fullsized': '2024-05-30T17:04:26.652394+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T17:04:32.574 INFO:tasks.ceph.ceph_manager.ceph:PG 19.10 is not active+clean 2024-05-30T17:04:32.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.634425+0000', 'last_change': '2024-05-30T17:04:26.634425+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.634425+0000', 'last_undegraded': '2024-05-30T17:04:26.634425+0000', 'last_fullsized': '2024-05-30T17:04:26.634425+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T17:04:32.575 INFO:tasks.ceph.ceph_manager.ceph:PG 19.11 is not active+clean 2024-05-30T17:04:32.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.635921+0000', 'last_change': '2024-05-30T17:04:26.635921+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.635921+0000', 'last_undegraded': '2024-05-30T17:04:26.635921+0000', 'last_fullsized': '2024-05-30T17:04:26.635921+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T17:04:32.575 INFO:tasks.ceph.ceph_manager.ceph:PG 19.e is not active+clean 2024-05-30T17:04:32.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.636651+0000', 'last_change': '2024-05-30T17:04:26.636651+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.636651+0000', 'last_undegraded': '2024-05-30T17:04:26.636651+0000', 'last_fullsized': '2024-05-30T17:04:26.636651+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T17:04:32.575 INFO:tasks.ceph.ceph_manager.ceph:PG 19.f is not active+clean 2024-05-30T17:04:32.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.632603+0000', 'last_change': '2024-05-30T17:04:26.632603+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.632603+0000', 'last_undegraded': '2024-05-30T17:04:26.632603+0000', 'last_fullsized': '2024-05-30T17:04:26.632603+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T17:04:32.575 INFO:tasks.ceph.ceph_manager.ceph:PG 19.d is not active+clean 2024-05-30T17:04:32.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.633700+0000', 'last_change': '2024-05-30T17:04:26.633700+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.633700+0000', 'last_undegraded': '2024-05-30T17:04:26.633700+0000', 'last_fullsized': '2024-05-30T17:04:26.633700+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T17:04:32.575 INFO:tasks.ceph.ceph_manager.ceph:PG 19.a is not active+clean 2024-05-30T17:04:32.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.640162+0000', 'last_change': '2024-05-30T17:04:26.640162+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.640162+0000', 'last_undegraded': '2024-05-30T17:04:26.640162+0000', 'last_fullsized': '2024-05-30T17:04:26.640162+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T17:04:32.576 INFO:tasks.ceph.ceph_manager.ceph:PG 19.b is not active+clean 2024-05-30T17:04:32.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.630967+0000', 'last_change': '2024-05-30T17:04:26.630967+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.630967+0000', 'last_undegraded': '2024-05-30T17:04:26.630967+0000', 'last_fullsized': '2024-05-30T17:04:26.630967+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T17:04:32.576 INFO:tasks.ceph.ceph_manager.ceph:PG 19.8 is not active+clean 2024-05-30T17:04:32.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.633916+0000', 'last_change': '2024-05-30T17:04:26.633916+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.633916+0000', 'last_undegraded': '2024-05-30T17:04:26.633916+0000', 'last_fullsized': '2024-05-30T17:04:26.633916+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T17:04:32.576 INFO:tasks.ceph.ceph_manager.ceph:PG 19.9 is not active+clean 2024-05-30T17:04:32.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.637392+0000', 'last_change': '2024-05-30T17:04:26.637392+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.637392+0000', 'last_undegraded': '2024-05-30T17:04:26.637392+0000', 'last_fullsized': '2024-05-30T17:04:26.637392+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T17:04:32.576 INFO:tasks.ceph.ceph_manager.ceph:PG 19.6 is not active+clean 2024-05-30T17:04:32.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.631855+0000', 'last_change': '2024-05-30T17:04:26.631855+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.631855+0000', 'last_undegraded': '2024-05-30T17:04:26.631855+0000', 'last_fullsized': '2024-05-30T17:04:26.631855+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T17:04:32.576 INFO:tasks.ceph.ceph_manager.ceph:PG 19.7 is not active+clean 2024-05-30T17:04:32.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.647675+0000', 'last_change': '2024-05-30T17:04:26.647675+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.647675+0000', 'last_undegraded': '2024-05-30T17:04:26.647675+0000', 'last_fullsized': '2024-05-30T17:04:26.647675+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T17:04:32.576 INFO:tasks.ceph.ceph_manager.ceph:PG 19.4 is not active+clean 2024-05-30T17:04:32.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.633538+0000', 'last_change': '2024-05-30T17:04:26.633538+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.633538+0000', 'last_undegraded': '2024-05-30T17:04:26.633538+0000', 'last_fullsized': '2024-05-30T17:04:26.633538+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T17:04:32.577 INFO:tasks.ceph.ceph_manager.ceph:PG 19.5 is not active+clean 2024-05-30T17:04:32.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.631554+0000', 'last_change': '2024-05-30T17:04:26.631554+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.631554+0000', 'last_undegraded': '2024-05-30T17:04:26.631554+0000', 'last_fullsized': '2024-05-30T17:04:26.631554+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T17:04:32.577 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2 is not active+clean 2024-05-30T17:04:32.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.636200+0000', 'last_change': '2024-05-30T17:04:26.636200+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.636200+0000', 'last_undegraded': '2024-05-30T17:04:26.636200+0000', 'last_fullsized': '2024-05-30T17:04:26.636200+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T17:04:32.577 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3 is not active+clean 2024-05-30T17:04:32.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.631101+0000', 'last_change': '2024-05-30T17:04:26.631101+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.631101+0000', 'last_undegraded': '2024-05-30T17:04:26.631101+0000', 'last_fullsized': '2024-05-30T17:04:26.631101+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T17:04:32.577 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1 is not active+clean 2024-05-30T17:04:32.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.633426+0000', 'last_change': '2024-05-30T17:04:26.633426+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.633426+0000', 'last_undegraded': '2024-05-30T17:04:26.633426+0000', 'last_fullsized': '2024-05-30T17:04:26.633426+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T17:04:32.577 INFO:tasks.ceph.ceph_manager.ceph:PG 19.12 is not active+clean 2024-05-30T17:04:32.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 129, 'state': 'creating+peering', 'last_fresh': '2024-05-30T17:04:26.635702+0000', 'last_change': '2024-05-30T17:04:26.635702+0000', 'last_active': '2024-05-30T17:04:26.621980+0000', 'last_peered': '2024-05-30T17:04:26.621980+0000', 'last_clean': '2024-05-30T17:04:26.621980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T17:04:26.635702+0000', 'last_undegraded': '2024-05-30T17:04:26.635702+0000', 'last_fullsized': '2024-05-30T17:04:26.635702+0000', 'mapping_epoch': 129, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 129, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'last_clean_scrub_stamp': '2024-05-30T17:04:26.621980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T17:04:32.578 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T17:04:32.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c76600640 1 Processor -- start 2024-05-30T17:04:32.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c76600640 1 -- start start 2024-05-30T17:04:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c76600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2c700b46e0 0x7f2c700b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c76600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c700b3c20 con 0x7f2c70146000 2024-05-30T17:04:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c76600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c70160c40 con 0x7f2c700cf0d0 2024-05-30T17:04:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c76600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2c700b5060 con 0x7f2c700b46e0 2024-05-30T17:04:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c6f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2c70146000 0x7f2c701600d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54020/0 (socket says 172.21.15.59:54020) 2024-05-30T17:04:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c6f400640 1 -- 172.21.15.59:0/4151562457 learned_addr learned my addr 172.21.15.59:0/4151562457 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:32.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c67e00640 1 --2- 172.21.15.59:0/4151562457 >> v2:172.21.15.107:3300/0 conn(0x7f2c700b46e0 0x7f2c700b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:32.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c6ea00640 1 -- 172.21.15.59:0/4151562457 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653591778 0 0) 0x7f2c700b3c20 con 0x7f2c70146000 2024-05-30T17:04:32.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c6ea00640 1 -- 172.21.15.59:0/4151562457 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c54003530 con 0x7f2c70146000 2024-05-30T17:04:32.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c67e00640 1 -- 172.21.15.59:0/4151562457 >> v1:172.21.15.107:6789/0 conn(0x7f2c700cf0d0 legacy=0x7f2c70071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c6ea00640 1 -- 172.21.15.59:0/4151562457 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2886790960 0 0) 0x7f2c54003530 con 0x7f2c70146000 2024-05-30T17:04:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c67e00640 1 -- 172.21.15.59:0/4151562457 >> v1:172.21.15.59:6789/0 conn(0x7f2c70146000 legacy=0x7f2c701600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.749+0000 7f2c67e00640 1 -- 172.21.15.59:0/4151562457 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c70160f20 con 0x7f2c700b46e0 2024-05-30T17:04:32.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.753+0000 7f2c67e00640 1 --2- 172.21.15.59:0/4151562457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c700b46e0 0x7f2c700b4b20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097c0 tx=0x7f2c5801c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4660a1c7caedbaf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:32.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.753+0000 7f2c6ea00640 1 -- 172.21.15.59:0/4151562457 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c580b0070 con 0x7f2c700b46e0 2024-05-30T17:04:32.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.753+0000 7f2c6ea00640 1 -- 172.21.15.59:0/4151562457 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c580ab400 con 0x7f2c700b46e0 2024-05-30T17:04:32.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.753+0000 7f2c6ea00640 1 -- 172.21.15.59:0/4151562457 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60001680 con 0x7f2c700b46e0 2024-05-30T17:04:32.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.753+0000 7f2c76600640 1 -- 172.21.15.59:0/4151562457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c700b46e0 msgr2=0x7f2c700b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.753+0000 7f2c76600640 1 --2- 172.21.15.59:0/4151562457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c700b46e0 0x7f2c700b4b20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097c0 tx=0x7f2c5801c270 comp rx=0 tx=0).stop 2024-05-30T17:04:32.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.753+0000 7f2c76600640 1 -- 172.21.15.59:0/4151562457 shutdown_connections 2024-05-30T17:04:32.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.753+0000 7f2c76600640 1 --2- 172.21.15.59:0/4151562457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c700b46e0 0x7f2c700b4b20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.753+0000 7f2c76600640 1 -- 172.21.15.59:0/4151562457 >> 172.21.15.59:0/4151562457 conn(0x7f2c70067d60 msgr2=0x7f2c7006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:32.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.753+0000 7f2c76600640 1 -- 172.21.15.59:0/4151562457 shutdown_connections 2024-05-30T17:04:32.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.753+0000 7f2c76600640 1 -- 172.21.15.59:0/4151562457 wait complete. 2024-05-30T17:04:32.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c76600640 1 Processor -- start 2024-05-30T17:04:32.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c76600640 1 -- start start 2024-05-30T17:04:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c76600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c700b46e0 0x7f2c7015c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c76600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c700cf0d0 0x7f2c70161220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c76600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c70146000 0x7f2c70161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c76600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c70072480 con 0x7f2c70146000 2024-05-30T17:04:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c76600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2c701609f0 con 0x7f2c700b46e0 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c76600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2c70072600 con 0x7f2c700cf0d0 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c6fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c70146000 0x7f2c70161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c6fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c70146000 0x7f2c70161760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49514/0 (socket says 172.21.15.59:49514) 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c6fe00640 1 -- 172.21.15.59:0/3580870605 learned_addr learned my addr 172.21.15.59:0/3580870605 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c67e00640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c700cf0d0 0x7f2c70161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c6f400640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c700b46e0 0x7f2c7015c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c6fe00640 1 -- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c700cf0d0 msgr2=0x7f2c70161220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c6fe00640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c700cf0d0 0x7f2c70161220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c6fe00640 1 -- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c700b46e0 msgr2=0x7f2c7015c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c6fe00640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c700b46e0 0x7f2c7015c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c6fe00640 1 -- 172.21.15.59:0/3580870605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c700b05e0 con 0x7f2c70146000 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c6fe00640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c70146000 0x7f2c70161760 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c810 tx=0x7f2c6800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c67400640 1 -- 172.21.15.59:0/3580870605 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68017070 con 0x7f2c70146000 2024-05-30T17:04:32.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c67400640 1 -- 172.21.15.59:0/3580870605 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c68003db0 con 0x7f2c70146000 2024-05-30T17:04:32.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c67400640 1 -- 172.21.15.59:0/3580870605 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c680052b0 con 0x7f2c70146000 2024-05-30T17:04:32.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c76600640 1 -- 172.21.15.59:0/3580870605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c700b0850 con 0x7f2c70146000 2024-05-30T17:04:32.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c76600640 1 -- 172.21.15.59:0/3580870605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c700b0e10 con 0x7f2c70146000 2024-05-30T17:04:32.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.757+0000 7f2c76600640 1 -- 172.21.15.59:0/3580870605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c70068a90 con 0x7f2c70146000 2024-05-30T17:04:32.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.761+0000 7f2c67400640 1 -- 172.21.15.59:0/3580870605 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f2c6801a070 con 0x7f2c70146000 2024-05-30T17:04:32.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.761+0000 7f2c67400640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2c4c069fd0 0x7f2c4c06c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:32.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.761+0000 7f2c67400640 1 -- 172.21.15.59:0/3580870605 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7f2c68085010 con 0x7f2c70146000 2024-05-30T17:04:32.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.761+0000 7f2c6f400640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2c4c069fd0 0x7f2c4c06c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:32.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.761+0000 7f2c6f400640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2c4c069fd0 0x7f2c4c06c490 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2c60001ec0 tx=0x7f2c60001cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:32.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.765+0000 7f2c67400640 1 -- 172.21.15.59:0/3580870605 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2c68057030 con 0x7f2c70146000 2024-05-30T17:04:32.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.985+0000 7f2c76600640 1 -- 172.21.15.59:0/3580870605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2c7015c570 con 0x7f2c70146000 2024-05-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.985+0000 7f2c67400640 1 -- 172.21.15.59:0/3580870605 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2554 (secure 0 0 0) 0x7f2c68056930 con 0x7f2c70146000 2024-05-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi059.stdout:{"fsid":"97857630-028c-48a2-897f-bf5f996be133","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":952,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":131,"num_osds":8,"num_up_osds":8,"osd_up_since":1717087732,"num_in_osds":8,"osd_in_since":1717087722,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":56},{"state_name":"active+clean","count":41}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":1036627968,"bytes_avail":772057485312,"bytes_total":773094113280,"inactive_pgs_ratio":0.57731956243515015},"fsmap":{"epoch":81,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8991}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-05-30T17:03:57.371237+0000","services":{"mgr":{"daemons":{"summary":"","y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-30T17:04:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.989+0000 7f2c76600640 1 -- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2c4c069fd0 msgr2=0x7f2c4c06c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.989+0000 7f2c76600640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2c4c069fd0 0x7f2c4c06c490 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2c60001ec0 tx=0x7f2c60001cd0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.989+0000 7f2c76600640 1 -- 172.21.15.59:0/3580870605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c70146000 msgr2=0x7f2c70161760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.989+0000 7f2c76600640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c70146000 0x7f2c70161760 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c810 tx=0x7f2c6800ccd0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.989+0000 7f2c76600640 1 -- 172.21.15.59:0/3580870605 shutdown_connections 2024-05-30T17:04:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.989+0000 7f2c76600640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2c4c069fd0 0x7f2c4c06c490 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.989+0000 7f2c76600640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c70146000 0x7f2c70161760 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.989+0000 7f2c76600640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c700cf0d0 0x7f2c70161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.989+0000 7f2c76600640 1 --2- 172.21.15.59:0/3580870605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c700b46e0 0x7f2c7015c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.989+0000 7f2c76600640 1 -- 172.21.15.59:0/3580870605 >> 172.21.15.59:0/3580870605 conn(0x7f2c70067d60 msgr2=0x7f2c70071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.989+0000 7f2c76600640 1 -- 172.21.15.59:0/3580870605 shutdown_connections 2024-05-30T17:04:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:32.989+0000 7f2c76600640 1 -- 172.21.15.59:0/3580870605 wait complete. 2024-05-30T17:04:33.009 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-30T17:04:33.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:04:33.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.149+0000 7f0060600640 1 Processor -- start 2024-05-30T17:04:33.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.149+0000 7f0060600640 1 -- start start 2024-05-30T17:04:33.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.149+0000 7f0060600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0058160d90 0x7f005809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:33.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.149+0000 7f0060600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0058070d60 con 0x7f005809b780 2024-05-30T17:04:33.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.149+0000 7f0060600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00580d1310 con 0x7f00580711e0 2024-05-30T17:04:33.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.149+0000 7f0060600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f00580ced30 con 0x7f0058160d90 2024-05-30T17:04:33.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.149+0000 7f005d200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f005809b780 0x7f005806ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54036/0 (socket says 172.21.15.59:54036) 2024-05-30T17:04:33.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.149+0000 7f005dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0058160d90 0x7f005809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:33.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.149+0000 7f005d200640 1 -- 172.21.15.59:0/2664174006 learned_addr learned my addr 172.21.15.59:0/2664174006 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:33.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f005dc00640 1 -- 172.21.15.59:0/2664174006 >> v1:172.21.15.107:6789/0 conn(0x7f00580711e0 legacy=0x7f0058070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:33.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f005dc00640 1 -- 172.21.15.59:0/2664174006 >> v1:172.21.15.59:6789/0 conn(0x7f005809b780 legacy=0x7f005806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:33.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f005dc00640 1 -- 172.21.15.59:0/2664174006 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005809bcf0 con 0x7f0058160d90 2024-05-30T17:04:33.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f0057e00640 1 -- 172.21.15.59:0/2664174006 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566199834 0 0) 0x7f0058070d60 con 0x7f005809b780 2024-05-30T17:04:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f005dc00640 1 --2- 172.21.15.59:0/2664174006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0058160d90 0x7f005809aa40 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f004c0097c0 tx=0x7f004c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2584acf3bda514 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:33.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f0057e00640 1 -- 172.21.15.59:0/2664174006 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c0b0070 con 0x7f0058160d90 2024-05-30T17:04:33.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f0057e00640 1 -- 172.21.15.59:0/2664174006 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004c0ab600 con 0x7f0058160d90 2024-05-30T17:04:33.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f0057e00640 1 -- 172.21.15.59:0/2664174006 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c0ab9d0 con 0x7f0058160d90 2024-05-30T17:04:33.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f0060600640 1 -- 172.21.15.59:0/2664174006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0058160d90 msgr2=0x7f005809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:33.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f0060600640 1 --2- 172.21.15.59:0/2664174006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0058160d90 0x7f005809aa40 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f004c0097c0 tx=0x7f004c01c410 comp rx=0 tx=0).stop 2024-05-30T17:04:33.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f0060600640 1 -- 172.21.15.59:0/2664174006 shutdown_connections 2024-05-30T17:04:33.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f0060600640 1 --2- 172.21.15.59:0/2664174006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0058160d90 0x7f005809aa40 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:33.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f0060600640 1 -- 172.21.15.59:0/2664174006 >> 172.21.15.59:0/2664174006 conn(0x7f00580b3f80 msgr2=0x7f00580b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:33.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f0060600640 1 -- 172.21.15.59:0/2664174006 shutdown_connections 2024-05-30T17:04:33.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.153+0000 7f0060600640 1 -- 172.21.15.59:0/2664174006 wait complete. 2024-05-30T17:04:33.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f0060600640 1 Processor -- start 2024-05-30T17:04:33.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f0060600640 1 -- start start 2024-05-30T17:04:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f0060600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00580711e0 0x7f00580b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f0060600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f005809b780 0x7f00580b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f0060600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0058160d90 0x7f00580b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f0060600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f00580af360 con 0x7f00580711e0 2024-05-30T17:04:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f0060600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f00580af1e0 con 0x7f005809b780 2024-05-30T17:04:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f0060600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0058071e60 con 0x7f0058160d90 2024-05-30T17:04:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f005dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00580711e0 0x7f00580b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f005dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00580711e0 0x7f00580b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49540/0 (socket says 172.21.15.59:49540) 2024-05-30T17:04:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f005dc00640 1 -- 172.21.15.59:0/3454845669 learned_addr learned my addr 172.21.15.59:0/3454845669 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f005d200640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f005809b780 0x7f00580b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f005e600640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0058160d90 0x7f00580b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f005dc00640 1 -- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0058160d90 msgr2=0x7f00580b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f005dc00640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0058160d90 0x7f00580b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f005dc00640 1 -- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f005809b780 msgr2=0x7f00580b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f005dc00640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f005809b780 0x7f00580b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f005dc00640 1 -- 172.21.15.59:0/3454845669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00580c6ff0 con 0x7f00580711e0 2024-05-30T17:04:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f005d200640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f005809b780 0x7f00580b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f005dc00640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00580711e0 0x7f00580b50b0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f004c0ae040 tx=0x7f004c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f0055600640 1 -- 172.21.15.59:0/3454845669 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c0b0050 con 0x7f00580711e0 2024-05-30T17:04:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f0055600640 1 -- 172.21.15.59:0/3454845669 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004c0bc070 con 0x7f00580711e0 2024-05-30T17:04:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f0060600640 1 -- 172.21.15.59:0/3454845669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00580c72d0 con 0x7f00580711e0 2024-05-30T17:04:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.157+0000 7f0055600640 1 -- 172.21.15.59:0/3454845669 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c0b5a50 con 0x7f00580711e0 2024-05-30T17:04:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.161+0000 7f0060600640 1 -- 172.21.15.59:0/3454845669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00580c7890 con 0x7f00580711e0 2024-05-30T17:04:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.161+0000 7f0060600640 1 -- 172.21.15.59:0/3454845669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0058068a90 con 0x7f00580711e0 2024-05-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.161+0000 7f0055600640 1 -- 172.21.15.59:0/3454845669 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f004c0ab4a0 con 0x7f00580711e0 2024-05-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.161+0000 7f0055600640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0038069fa0 0x7f003806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.161+0000 7f0055600640 1 -- 172.21.15.59:0/3454845669 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7f004c120220 con 0x7f00580711e0 2024-05-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.161+0000 7f005d200640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0038069fa0 0x7f003806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.161+0000 7f005d200640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0038069fa0 0x7f003806c460 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f005815faa0 tx=0x7f0044007c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:33.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.165+0000 7f0055600640 1 -- 172.21.15.59:0/3454845669 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f004c016090 con 0x7f00580711e0 2024-05-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.325+0000 7f0060600640 1 -- 172.21.15.59:0/3454845669 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f005815af20 con 0x7f0038069fa0 2024-05-30T17:04:33.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.333+0000 7f0055600640 1 -- 172.21.15.59:0/3454845669 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247786 (secure 0 0 0) 0x7f005815af20 con 0x7f0038069fa0 2024-05-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:33.338 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:04:33.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.337+0000 7f0060600640 1 -- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0038069fa0 msgr2=0x7f003806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:33.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.337+0000 7f0060600640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0038069fa0 0x7f003806c460 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f005815faa0 tx=0x7f0044007c60 comp rx=0 tx=0).stop 2024-05-30T17:04:33.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.337+0000 7f0060600640 1 -- 172.21.15.59:0/3454845669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00580711e0 msgr2=0x7f00580b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:33.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.337+0000 7f0060600640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00580711e0 0x7f00580b50b0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f004c0ae040 tx=0x7f004c01ac50 comp rx=0 tx=0).stop 2024-05-30T17:04:33.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.337+0000 7f0060600640 1 -- 172.21.15.59:0/3454845669 shutdown_connections 2024-05-30T17:04:33.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.337+0000 7f0060600640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0038069fa0 0x7f003806c460 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:33.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.337+0000 7f0060600640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0058160d90 0x7f00580b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:33.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.337+0000 7f0060600640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f005809b780 0x7f00580b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:33.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.337+0000 7f0060600640 1 --2- 172.21.15.59:0/3454845669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00580711e0 0x7f00580b50b0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:33.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.337+0000 7f0060600640 1 -- 172.21.15.59:0/3454845669 >> 172.21.15.59:0/3454845669 conn(0x7f00580b3f80 msgr2=0x7f00580b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:33.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.337+0000 7f0060600640 1 -- 172.21.15.59:0/3454845669 shutdown_connections 2024-05-30T17:04:33.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:33.337+0000 7f0060600640 1 -- 172.21.15.59:0/3454845669 wait complete. 2024-05-30T17:04:33.357 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":594,"stamp":"2024-05-30T17:04:31.379140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1012332,"kb_used_data":13668,"kb_used_omap":12,"kb_used_meta":998515,"kb_avail":753962388,"statfs":{"total":773094113280,"available":772057485312,"internally_reserved":0,"allocated":13996032,"data_stored":6795642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1022479920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.750927"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.644930+0000","last_change":"2024-05-30T17:04:26.644930+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.644930+0000","last_undegraded":"2024-05-30T17:04:26.644930+0000","last_fullsized":"2024-05-30T17:04:26.644930+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635506+0000","last_change":"2024-05-30T17:04:26.635506+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635506+0000","last_undegraded":"2024-05-30T17:04:26.635506+0000","last_fullsized":"2024-05-30T17:04:26.635506+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638311+0000","last_change":"2024-05-30T17:04:26.638311+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638311+0000","last_undegraded":"2024-05-30T17:04:26.638311+0000","last_fullsized":"2024-05-30T17:04:26.638311+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.641744+0000","last_change":"2024-05-30T17:04:26.641744+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.641744+0000","last_undegraded":"2024-05-30T17:04:26.641744+0000","last_fullsized":"2024-05-30T17:04:26.641744+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.640547+0000","last_change":"2024-05-30T17:04:26.640547+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.640547+0000","last_undegraded":"2024-05-30T17:04:26.640547+0000","last_fullsized":"2024-05-30T17:04:26.640547+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631350+0000","last_change":"2024-05-30T17:04:26.631350+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631350+0000","last_undegraded":"2024-05-30T17:04:26.631350+0000","last_fullsized":"2024-05-30T17:04:26.631350+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631189+0000","last_change":"2024-05-30T17:04:26.631189+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631189+0000","last_undegraded":"2024-05-30T17:04:26.631189+0000","last_fullsized":"2024-05-30T17:04:26.631189+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636699+0000","last_change":"2024-05-30T17:04:26.636699+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636699+0000","last_undegraded":"2024-05-30T17:04:26.636699+0000","last_fullsized":"2024-05-30T17:04:26.636699+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.637191+0000","last_change":"2024-05-30T17:04:26.637191+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.637191+0000","last_undegraded":"2024-05-30T17:04:26.637191+0000","last_fullsized":"2024-05-30T17:04:26.637191+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.634999+0000","last_change":"2024-05-30T17:04:26.634999+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.634999+0000","last_undegraded":"2024-05-30T17:04:26.634999+0000","last_fullsized":"2024-05-30T17:04:26.634999+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.639123+0000","last_change":"2024-05-30T17:04:26.639123+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.639123+0000","last_undegraded":"2024-05-30T17:04:26.639123+0000","last_fullsized":"2024-05-30T17:04:26.639123+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635832+0000","last_change":"2024-05-30T17:04:26.635832+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635832+0000","last_undegraded":"2024-05-30T17:04:26.635832+0000","last_fullsized":"2024-05-30T17:04:26.635832+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.653335+0000","last_change":"2024-05-30T17:04:26.653335+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.653335+0000","last_undegraded":"2024-05-30T17:04:26.653335+0000","last_fullsized":"2024-05-30T17:04:26.653335+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635330+0000","last_change":"2024-05-30T17:04:26.635330+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635330+0000","last_undegraded":"2024-05-30T17:04:26.635330+0000","last_fullsized":"2024-05-30T17:04:26.635330+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638835+0000","last_change":"2024-05-30T17:04:26.638835+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638835+0000","last_undegraded":"2024-05-30T17:04:26.638835+0000","last_fullsized":"2024-05-30T17:04:26.638835+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266123+0000","last_change":"2024-05-30T17:04:27.656402+0000","last_active":"2024-05-30T17:04:29.266123+0000","last_peered":"2024-05-30T17:04:29.266123+0000","last_clean":"2024-05-30T17:04:29.266123+0000","last_became_active":"2024-05-30T17:04:27.656141+0000","last_became_peered":"2024-05-30T17:04:27.656141+0000","last_unstale":"2024-05-30T17:04:29.266123+0000","last_undegraded":"2024-05-30T17:04:29.266123+0000","last_fullsized":"2024-05-30T17:04:29.266123+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:08.433002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631847+0000","last_change":"2024-05-30T17:04:26.631847+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631847+0000","last_undegraded":"2024-05-30T17:04:26.631847+0000","last_fullsized":"2024-05-30T17:04:26.631847+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266584+0000","last_change":"2024-05-30T17:04:27.650889+0000","last_active":"2024-05-30T17:04:29.266584+0000","last_peered":"2024-05-30T17:04:29.266584+0000","last_clean":"2024-05-30T17:04:29.266584+0000","last_became_active":"2024-05-30T17:04:27.649462+0000","last_became_peered":"2024-05-30T17:04:27.649462+0000","last_unstale":"2024-05-30T17:04:29.266584+0000","last_undegraded":"2024-05-30T17:04:29.266584+0000","last_fullsized":"2024-05-30T17:04:29.266584+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:02:33.740142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636711+0000","last_change":"2024-05-30T17:04:26.636711+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636711+0000","last_undegraded":"2024-05-30T17:04:26.636711+0000","last_fullsized":"2024-05-30T17:04:26.636711+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266495+0000","last_change":"2024-05-30T17:04:27.652401+0000","last_active":"2024-05-30T17:04:29.266495+0000","last_peered":"2024-05-30T17:04:29.266495+0000","last_clean":"2024-05-30T17:04:29.266495+0000","last_became_active":"2024-05-30T17:04:27.652097+0000","last_became_peered":"2024-05-30T17:04:27.652097+0000","last_unstale":"2024-05-30T17:04:29.266495+0000","last_undegraded":"2024-05-30T17:04:29.266495+0000","last_fullsized":"2024-05-30T17:04:29.266495+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:22:37.455945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.639170+0000","last_change":"2024-05-30T17:04:26.639170+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.639170+0000","last_undegraded":"2024-05-30T17:04:26.639170+0000","last_fullsized":"2024-05-30T17:04:26.639170+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638697+0000","last_change":"2024-05-30T17:04:26.638697+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638697+0000","last_undegraded":"2024-05-30T17:04:26.638697+0000","last_fullsized":"2024-05-30T17:04:26.638697+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635293+0000","last_change":"2024-05-30T17:04:26.635293+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635293+0000","last_undegraded":"2024-05-30T17:04:26.635293+0000","last_fullsized":"2024-05-30T17:04:26.635293+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638008+0000","last_change":"2024-05-30T17:04:26.638008+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638008+0000","last_undegraded":"2024-05-30T17:04:26.638008+0000","last_fullsized":"2024-05-30T17:04:26.638008+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635275+0000","last_change":"2024-05-30T17:04:26.635275+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635275+0000","last_undegraded":"2024-05-30T17:04:26.635275+0000","last_fullsized":"2024-05-30T17:04:26.635275+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266595+0000","last_change":"2024-05-30T17:04:27.657224+0000","last_active":"2024-05-30T17:04:29.266595+0000","last_peered":"2024-05-30T17:04:29.266595+0000","last_clean":"2024-05-30T17:04:29.266595+0000","last_became_active":"2024-05-30T17:04:27.656941+0000","last_became_peered":"2024-05-30T17:04:27.656941+0000","last_unstale":"2024-05-30T17:04:29.266595+0000","last_undegraded":"2024-05-30T17:04:29.266595+0000","last_fullsized":"2024-05-30T17:04:29.266595+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:33.680204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.641374+0000","last_change":"2024-05-30T17:04:26.641374+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.641374+0000","last_undegraded":"2024-05-30T17:04:26.641374+0000","last_fullsized":"2024-05-30T17:04:26.641374+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631634+0000","last_change":"2024-05-30T17:04:26.631634+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631634+0000","last_undegraded":"2024-05-30T17:04:26.631634+0000","last_fullsized":"2024-05-30T17:04:26.631634+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.652897+0000","last_change":"2024-05-30T17:04:26.652897+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.652897+0000","last_undegraded":"2024-05-30T17:04:26.652897+0000","last_fullsized":"2024-05-30T17:04:26.652897+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.640606+0000","last_change":"2024-05-30T17:04:26.640606+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.640606+0000","last_undegraded":"2024-05-30T17:04:26.640606+0000","last_fullsized":"2024-05-30T17:04:26.640606+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636920+0000","last_change":"2024-05-30T17:04:26.636920+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636920+0000","last_undegraded":"2024-05-30T17:04:26.636920+0000","last_fullsized":"2024-05-30T17:04:26.636920+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631593+0000","last_change":"2024-05-30T17:04:26.631593+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631593+0000","last_undegraded":"2024-05-30T17:04:26.631593+0000","last_fullsized":"2024-05-30T17:04:26.631593+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266938+0000","last_change":"2024-05-30T17:04:27.665116+0000","last_active":"2024-05-30T17:04:29.266938+0000","last_peered":"2024-05-30T17:04:29.266938+0000","last_clean":"2024-05-30T17:04:29.266938+0000","last_became_active":"2024-05-30T17:04:27.664853+0000","last_became_peered":"2024-05-30T17:04:27.664853+0000","last_unstale":"2024-05-30T17:04:29.266938+0000","last_undegraded":"2024-05-30T17:04:29.266938+0000","last_fullsized":"2024-05-30T17:04:29.266938+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:00.380018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654288+0000","last_change":"2024-05-30T17:04:26.653769+0000","last_active":"2024-05-30T17:04:26.654288+0000","last_peered":"2024-05-30T17:04:26.654288+0000","last_clean":"2024-05-30T17:04:26.654288+0000","last_became_active":"2024-05-30T17:04:26.653331+0000","last_became_peered":"2024-05-30T17:04:26.653331+0000","last_unstale":"2024-05-30T17:04:26.654288+0000","last_undegraded":"2024-05-30T17:04:26.654288+0000","last_fullsized":"2024-05-30T17:04:26.654288+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:38:18.013111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636758+0000","last_change":"2024-05-30T17:04:26.636758+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636758+0000","last_undegraded":"2024-05-30T17:04:26.636758+0000","last_fullsized":"2024-05-30T17:04:26.636758+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.653121+0000","last_change":"2024-05-30T17:04:26.652574+0000","last_active":"2024-05-30T17:04:26.653121+0000","last_peered":"2024-05-30T17:04:26.653121+0000","last_clean":"2024-05-30T17:04:26.653121+0000","last_became_active":"2024-05-30T17:04:26.652142+0000","last_became_peered":"2024-05-30T17:04:26.652142+0000","last_unstale":"2024-05-30T17:04:26.653121+0000","last_undegraded":"2024-05-30T17:04:26.653121+0000","last_fullsized":"2024-05-30T17:04:26.653121+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:02.750449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636140+0000","last_change":"2024-05-30T17:04:26.636140+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636140+0000","last_undegraded":"2024-05-30T17:04:26.636140+0000","last_fullsized":"2024-05-30T17:04:26.636140+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654798+0000","last_change":"2024-05-30T17:04:26.652502+0000","last_active":"2024-05-30T17:04:26.654798+0000","last_peered":"2024-05-30T17:04:26.654798+0000","last_clean":"2024-05-30T17:04:26.654798+0000","last_became_active":"2024-05-30T17:04:26.652240+0000","last_became_peered":"2024-05-30T17:04:26.652240+0000","last_unstale":"2024-05-30T17:04:26.654798+0000","last_undegraded":"2024-05-30T17:04:26.654798+0000","last_fullsized":"2024-05-30T17:04:26.654798+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:41:52.185908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.638376+0000","last_change":"2024-05-30T17:04:26.638376+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.638376+0000","last_undegraded":"2024-05-30T17:04:26.638376+0000","last_fullsized":"2024-05-30T17:04:26.638376+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.650236+0000","last_change":"2024-05-30T17:04:26.644729+0000","last_active":"2024-05-30T17:04:26.650236+0000","last_peered":"2024-05-30T17:04:26.650236+0000","last_clean":"2024-05-30T17:04:26.650236+0000","last_became_active":"2024-05-30T17:04:26.644381+0000","last_became_peered":"2024-05-30T17:04:26.644381+0000","last_unstale":"2024-05-30T17:04:26.650236+0000","last_undegraded":"2024-05-30T17:04:26.650236+0000","last_fullsized":"2024-05-30T17:04:26.650236+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:12.851756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266155+0000","last_change":"2024-05-30T17:04:27.650774+0000","last_active":"2024-05-30T17:04:29.266155+0000","last_peered":"2024-05-30T17:04:29.266155+0000","last_clean":"2024-05-30T17:04:29.266155+0000","last_became_active":"2024-05-30T17:04:27.649829+0000","last_became_peered":"2024-05-30T17:04:27.649829+0000","last_unstale":"2024-05-30T17:04:29.266155+0000","last_undegraded":"2024-05-30T17:04:29.266155+0000","last_fullsized":"2024-05-30T17:04:29.266155+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:43:56.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654476+0000","last_change":"2024-05-30T17:04:26.649081+0000","last_active":"2024-05-30T17:04:26.654476+0000","last_peered":"2024-05-30T17:04:26.654476+0000","last_clean":"2024-05-30T17:04:26.654476+0000","last_became_active":"2024-05-30T17:04:26.648809+0000","last_became_peered":"2024-05-30T17:04:26.648809+0000","last_unstale":"2024-05-30T17:04:26.654476+0000","last_undegraded":"2024-05-30T17:04:26.654476+0000","last_fullsized":"2024-05-30T17:04:26.654476+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:28.984517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.632838+0000","last_change":"2024-05-30T17:04:26.632838+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.632838+0000","last_undegraded":"2024-05-30T17:04:26.632838+0000","last_fullsized":"2024-05-30T17:04:26.632838+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266208+0000","last_change":"2024-05-30T17:04:26.650934+0000","last_active":"2024-05-30T17:04:29.266208+0000","last_peered":"2024-05-30T17:04:29.266208+0000","last_clean":"2024-05-30T17:04:29.266208+0000","last_became_active":"2024-05-30T17:04:26.650668+0000","last_became_peered":"2024-05-30T17:04:26.650668+0000","last_unstale":"2024-05-30T17:04:29.266208+0000","last_undegraded":"2024-05-30T17:04:29.266208+0000","last_fullsized":"2024-05-30T17:04:29.266208+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:04.028994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636215+0000","last_change":"2024-05-30T17:04:26.636215+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636215+0000","last_undegraded":"2024-05-30T17:04:26.636215+0000","last_fullsized":"2024-05-30T17:04:26.636215+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.645187+0000","last_change":"2024-05-30T17:04:26.642168+0000","last_active":"2024-05-30T17:04:26.645187+0000","last_peered":"2024-05-30T17:04:26.645187+0000","last_clean":"2024-05-30T17:04:26.645187+0000","last_became_active":"2024-05-30T17:04:26.641791+0000","last_became_peered":"2024-05-30T17:04:26.641791+0000","last_unstale":"2024-05-30T17:04:26.645187+0000","last_undegraded":"2024-05-30T17:04:26.645187+0000","last_fullsized":"2024-05-30T17:04:26.645187+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:41:35.345382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.634592+0000","last_change":"2024-05-30T17:04:26.634592+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.634592+0000","last_undegraded":"2024-05-30T17:04:26.634592+0000","last_fullsized":"2024-05-30T17:04:26.634592+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.646230+0000","last_change":"2024-05-30T17:04:26.645457+0000","last_active":"2024-05-30T17:04:26.646230+0000","last_peered":"2024-05-30T17:04:26.646230+0000","last_clean":"2024-05-30T17:04:26.646230+0000","last_became_active":"2024-05-30T17:04:26.642988+0000","last_became_peered":"2024-05-30T17:04:26.642988+0000","last_unstale":"2024-05-30T17:04:26.646230+0000","last_undegraded":"2024-05-30T17:04:26.646230+0000","last_fullsized":"2024-05-30T17:04:26.646230+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:56:53.520715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.643824+0000","last_change":"2024-05-30T17:04:26.643824+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.643824+0000","last_undegraded":"2024-05-30T17:04:26.643824+0000","last_fullsized":"2024-05-30T17:04:26.643824+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654544+0000","last_change":"2024-05-30T17:04:26.653783+0000","last_active":"2024-05-30T17:04:26.654544+0000","last_peered":"2024-05-30T17:04:26.654544+0000","last_clean":"2024-05-30T17:04:26.654544+0000","last_became_active":"2024-05-30T17:04:26.653413+0000","last_became_peered":"2024-05-30T17:04:26.653413+0000","last_unstale":"2024-05-30T17:04:26.654544+0000","last_undegraded":"2024-05-30T17:04:26.654544+0000","last_fullsized":"2024-05-30T17:04:26.654544+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:14.217436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633032+0000","last_change":"2024-05-30T17:04:26.633032+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633032+0000","last_undegraded":"2024-05-30T17:04:26.633032+0000","last_fullsized":"2024-05-30T17:04:26.633032+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266674+0000","last_change":"2024-05-30T17:04:26.649285+0000","last_active":"2024-05-30T17:04:29.266674+0000","last_peered":"2024-05-30T17:04:29.266674+0000","last_clean":"2024-05-30T17:04:29.266674+0000","last_became_active":"2024-05-30T17:04:26.648983+0000","last_became_peered":"2024-05-30T17:04:26.648983+0000","last_unstale":"2024-05-30T17:04:29.266674+0000","last_undegraded":"2024-05-30T17:04:29.266674+0000","last_fullsized":"2024-05-30T17:04:29.266674+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:19.123667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635575+0000","last_change":"2024-05-30T17:04:26.635575+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635575+0000","last_undegraded":"2024-05-30T17:04:26.635575+0000","last_fullsized":"2024-05-30T17:04:26.635575+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.656464+0000","last_change":"2024-05-30T17:04:26.655873+0000","last_active":"2024-05-30T17:04:26.656464+0000","last_peered":"2024-05-30T17:04:26.656464+0000","last_clean":"2024-05-30T17:04:26.656464+0000","last_became_active":"2024-05-30T17:04:26.655436+0000","last_became_peered":"2024-05-30T17:04:26.655436+0000","last_unstale":"2024-05-30T17:04:26.656464+0000","last_undegraded":"2024-05-30T17:04:26.656464+0000","last_fullsized":"2024-05-30T17:04:26.656464+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:20.851133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.637882+0000","last_change":"2024-05-30T17:04:26.637882+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.637882+0000","last_undegraded":"2024-05-30T17:04:26.637882+0000","last_fullsized":"2024-05-30T17:04:26.637882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.646625+0000","last_change":"2024-05-30T17:04:26.644996+0000","last_active":"2024-05-30T17:04:26.646625+0000","last_peered":"2024-05-30T17:04:26.646625+0000","last_clean":"2024-05-30T17:04:26.646625+0000","last_became_active":"2024-05-30T17:04:26.644394+0000","last_became_peered":"2024-05-30T17:04:26.644394+0000","last_unstale":"2024-05-30T17:04:26.646625+0000","last_undegraded":"2024-05-30T17:04:26.646625+0000","last_fullsized":"2024-05-30T17:04:26.646625+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:45:55.504801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.652394+0000","last_change":"2024-05-30T17:04:26.652394+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.652394+0000","last_undegraded":"2024-05-30T17:04:26.652394+0000","last_fullsized":"2024-05-30T17:04:26.652394+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654569+0000","last_change":"2024-05-30T17:04:26.648513+0000","last_active":"2024-05-30T17:04:26.654569+0000","last_peered":"2024-05-30T17:04:26.654569+0000","last_clean":"2024-05-30T17:04:26.654569+0000","last_became_active":"2024-05-30T17:04:26.648016+0000","last_became_peered":"2024-05-30T17:04:26.648016+0000","last_unstale":"2024-05-30T17:04:26.654569+0000","last_undegraded":"2024-05-30T17:04:26.654569+0000","last_fullsized":"2024-05-30T17:04:26.654569+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:23:52.647599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.634425+0000","last_change":"2024-05-30T17:04:26.634425+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.634425+0000","last_undegraded":"2024-05-30T17:04:26.634425+0000","last_fullsized":"2024-05-30T17:04:26.634425+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.646449+0000","last_change":"2024-05-30T17:04:26.643372+0000","last_active":"2024-05-30T17:04:26.646449+0000","last_peered":"2024-05-30T17:04:26.646449+0000","last_clean":"2024-05-30T17:04:26.646449+0000","last_became_active":"2024-05-30T17:04:26.641530+0000","last_became_peered":"2024-05-30T17:04:26.641530+0000","last_unstale":"2024-05-30T17:04:26.646449+0000","last_undegraded":"2024-05-30T17:04:26.646449+0000","last_fullsized":"2024-05-30T17:04:26.646449+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:23:52.647599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635921+0000","last_change":"2024-05-30T17:04:26.635921+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635921+0000","last_undegraded":"2024-05-30T17:04:26.635921+0000","last_fullsized":"2024-05-30T17:04:26.635921+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.652596+0000","last_change":"2024-05-30T17:04:26.651768+0000","last_active":"2024-05-30T17:04:26.652596+0000","last_peered":"2024-05-30T17:04:26.652596+0000","last_clean":"2024-05-30T17:04:26.652596+0000","last_became_active":"2024-05-30T17:04:26.651470+0000","last_became_peered":"2024-05-30T17:04:26.651470+0000","last_unstale":"2024-05-30T17:04:26.652596+0000","last_undegraded":"2024-05-30T17:04:26.652596+0000","last_fullsized":"2024-05-30T17:04:26.652596+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:46.418471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636651+0000","last_change":"2024-05-30T17:04:26.636651+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636651+0000","last_undegraded":"2024-05-30T17:04:26.636651+0000","last_fullsized":"2024-05-30T17:04:26.636651+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.648286+0000","last_change":"2024-05-30T17:04:26.646106+0000","last_active":"2024-05-30T17:04:26.648286+0000","last_peered":"2024-05-30T17:04:26.648286+0000","last_clean":"2024-05-30T17:04:26.648286+0000","last_became_active":"2024-05-30T17:04:26.645435+0000","last_became_peered":"2024-05-30T17:04:26.645435+0000","last_unstale":"2024-05-30T17:04:26.648286+0000","last_undegraded":"2024-05-30T17:04:26.648286+0000","last_fullsized":"2024-05-30T17:04:26.648286+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:24:46.141540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.632603+0000","last_change":"2024-05-30T17:04:26.632603+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.632603+0000","last_undegraded":"2024-05-30T17:04:26.632603+0000","last_fullsized":"2024-05-30T17:04:26.632603+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654939+0000","last_change":"2024-05-30T17:04:26.649232+0000","last_active":"2024-05-30T17:04:26.654939+0000","last_peered":"2024-05-30T17:04:26.654939+0000","last_clean":"2024-05-30T17:04:26.654939+0000","last_became_active":"2024-05-30T17:04:26.648936+0000","last_became_peered":"2024-05-30T17:04:26.648936+0000","last_unstale":"2024-05-30T17:04:26.654939+0000","last_undegraded":"2024-05-30T17:04:26.654939+0000","last_fullsized":"2024-05-30T17:04:26.654939+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:50:10.017227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266652+0000","last_change":"2024-05-30T17:04:27.657488+0000","last_active":"2024-05-30T17:04:29.266652+0000","last_peered":"2024-05-30T17:04:29.266652+0000","last_clean":"2024-05-30T17:04:29.266652+0000","last_became_active":"2024-05-30T17:04:27.657216+0000","last_became_peered":"2024-05-30T17:04:27.657216+0000","last_unstale":"2024-05-30T17:04:29.266652+0000","last_undegraded":"2024-05-30T17:04:29.266652+0000","last_fullsized":"2024-05-30T17:04:29.266652+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:18.543050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.653010+0000","last_change":"2024-05-30T17:04:26.652397+0000","last_active":"2024-05-30T17:04:26.653010+0000","last_peered":"2024-05-30T17:04:26.653010+0000","last_clean":"2024-05-30T17:04:26.653010+0000","last_became_active":"2024-05-30T17:04:26.652083+0000","last_became_peered":"2024-05-30T17:04:26.652083+0000","last_unstale":"2024-05-30T17:04:26.653010+0000","last_undegraded":"2024-05-30T17:04:26.653010+0000","last_fullsized":"2024-05-30T17:04:26.653010+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:37:07.130536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633700+0000","last_change":"2024-05-30T17:04:26.633700+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633700+0000","last_undegraded":"2024-05-30T17:04:26.633700+0000","last_fullsized":"2024-05-30T17:04:26.633700+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.648253+0000","last_change":"2024-05-30T17:04:26.646336+0000","last_active":"2024-05-30T17:04:26.648253+0000","last_peered":"2024-05-30T17:04:26.648253+0000","last_clean":"2024-05-30T17:04:26.648253+0000","last_became_active":"2024-05-30T17:04:26.646025+0000","last_became_peered":"2024-05-30T17:04:26.646025+0000","last_unstale":"2024-05-30T17:04:26.648253+0000","last_undegraded":"2024-05-30T17:04:26.648253+0000","last_fullsized":"2024-05-30T17:04:26.648253+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:33.438380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.640162+0000","last_change":"2024-05-30T17:04:26.640162+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.640162+0000","last_undegraded":"2024-05-30T17:04:26.640162+0000","last_fullsized":"2024-05-30T17:04:26.640162+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.658717+0000","last_change":"2024-05-30T17:04:26.657719+0000","last_active":"2024-05-30T17:04:26.658717+0000","last_peered":"2024-05-30T17:04:26.658717+0000","last_clean":"2024-05-30T17:04:26.658717+0000","last_became_active":"2024-05-30T17:04:26.657452+0000","last_became_peered":"2024-05-30T17:04:26.657452+0000","last_unstale":"2024-05-30T17:04:26.658717+0000","last_undegraded":"2024-05-30T17:04:26.658717+0000","last_fullsized":"2024-05-30T17:04:26.658717+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:05:26.624348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.630967+0000","last_change":"2024-05-30T17:04:26.630967+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.630967+0000","last_undegraded":"2024-05-30T17:04:26.630967+0000","last_fullsized":"2024-05-30T17:04:26.630967+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266335+0000","last_change":"2024-05-30T17:04:26.645875+0000","last_active":"2024-05-30T17:04:29.266335+0000","last_peered":"2024-05-30T17:04:29.266335+0000","last_clean":"2024-05-30T17:04:29.266335+0000","last_became_active":"2024-05-30T17:04:26.645583+0000","last_became_peered":"2024-05-30T17:04:26.645583+0000","last_unstale":"2024-05-30T17:04:29.266335+0000","last_undegraded":"2024-05-30T17:04:29.266335+0000","last_fullsized":"2024-05-30T17:04:29.266335+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:03.486308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633916+0000","last_change":"2024-05-30T17:04:26.633916+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633916+0000","last_undegraded":"2024-05-30T17:04:26.633916+0000","last_fullsized":"2024-05-30T17:04:26.633916+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265914+0000","last_change":"2024-05-30T17:04:26.647421+0000","last_active":"2024-05-30T17:04:29.265914+0000","last_peered":"2024-05-30T17:04:29.265914+0000","last_clean":"2024-05-30T17:04:29.265914+0000","last_became_active":"2024-05-30T17:04:26.647155+0000","last_became_peered":"2024-05-30T17:04:26.647155+0000","last_unstale":"2024-05-30T17:04:29.265914+0000","last_undegraded":"2024-05-30T17:04:29.265914+0000","last_fullsized":"2024-05-30T17:04:29.265914+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:59:52.705838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.637392+0000","last_change":"2024-05-30T17:04:26.637392+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.637392+0000","last_undegraded":"2024-05-30T17:04:26.637392+0000","last_fullsized":"2024-05-30T17:04:26.637392+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.655617+0000","last_change":"2024-05-30T17:04:26.650930+0000","last_active":"2024-05-30T17:04:26.655617+0000","last_peered":"2024-05-30T17:04:26.655617+0000","last_clean":"2024-05-30T17:04:26.655617+0000","last_became_active":"2024-05-30T17:04:26.650616+0000","last_became_peered":"2024-05-30T17:04:26.650616+0000","last_unstale":"2024-05-30T17:04:26.655617+0000","last_undegraded":"2024-05-30T17:04:26.655617+0000","last_fullsized":"2024-05-30T17:04:26.655617+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:39:55.080473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631855+0000","last_change":"2024-05-30T17:04:26.631855+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631855+0000","last_undegraded":"2024-05-30T17:04:26.631855+0000","last_fullsized":"2024-05-30T17:04:26.631855+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654744+0000","last_change":"2024-05-30T17:04:26.653129+0000","last_active":"2024-05-30T17:04:26.654744+0000","last_peered":"2024-05-30T17:04:26.654744+0000","last_clean":"2024-05-30T17:04:26.654744+0000","last_became_active":"2024-05-30T17:04:26.652234+0000","last_became_peered":"2024-05-30T17:04:26.652234+0000","last_unstale":"2024-05-30T17:04:26.654744+0000","last_undegraded":"2024-05-30T17:04:26.654744+0000","last_fullsized":"2024-05-30T17:04:26.654744+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:32.416930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.647675+0000","last_change":"2024-05-30T17:04:26.647675+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.647675+0000","last_undegraded":"2024-05-30T17:04:26.647675+0000","last_fullsized":"2024-05-30T17:04:26.647675+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.650180+0000","last_change":"2024-05-30T17:04:26.649574+0000","last_active":"2024-05-30T17:04:26.650180+0000","last_peered":"2024-05-30T17:04:26.650180+0000","last_clean":"2024-05-30T17:04:26.650180+0000","last_became_active":"2024-05-30T17:04:26.648998+0000","last_became_peered":"2024-05-30T17:04:26.648998+0000","last_unstale":"2024-05-30T17:04:26.650180+0000","last_undegraded":"2024-05-30T17:04:26.650180+0000","last_fullsized":"2024-05-30T17:04:26.650180+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:22.583010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633538+0000","last_change":"2024-05-30T17:04:26.633538+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633538+0000","last_undegraded":"2024-05-30T17:04:26.633538+0000","last_fullsized":"2024-05-30T17:04:26.633538+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.654441+0000","last_change":"2024-05-30T17:04:26.647328+0000","last_active":"2024-05-30T17:04:26.654441+0000","last_peered":"2024-05-30T17:04:26.654441+0000","last_clean":"2024-05-30T17:04:26.654441+0000","last_became_active":"2024-05-30T17:04:26.647058+0000","last_became_peered":"2024-05-30T17:04:26.647058+0000","last_unstale":"2024-05-30T17:04:26.654441+0000","last_undegraded":"2024-05-30T17:04:26.654441+0000","last_fullsized":"2024-05-30T17:04:26.654441+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:37:15.984675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631554+0000","last_change":"2024-05-30T17:04:26.631554+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631554+0000","last_undegraded":"2024-05-30T17:04:26.631554+0000","last_fullsized":"2024-05-30T17:04:26.631554+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.656291+0000","last_change":"2024-05-30T17:04:26.655225+0000","last_active":"2024-05-30T17:04:26.656291+0000","last_peered":"2024-05-30T17:04:26.656291+0000","last_clean":"2024-05-30T17:04:26.656291+0000","last_became_active":"2024-05-30T17:04:26.654383+0000","last_became_peered":"2024-05-30T17:04:26.654383+0000","last_unstale":"2024-05-30T17:04:26.656291+0000","last_undegraded":"2024-05-30T17:04:26.656291+0000","last_fullsized":"2024-05-30T17:04:26.656291+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:19.749763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.636200+0000","last_change":"2024-05-30T17:04:26.636200+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.636200+0000","last_undegraded":"2024-05-30T17:04:26.636200+0000","last_fullsized":"2024-05-30T17:04:26.636200+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.645955+0000","last_change":"2024-05-30T17:04:26.643654+0000","last_active":"2024-05-30T17:04:26.645955+0000","last_peered":"2024-05-30T17:04:26.645955+0000","last_clean":"2024-05-30T17:04:26.645955+0000","last_became_active":"2024-05-30T17:04:26.642798+0000","last_became_peered":"2024-05-30T17:04:26.642798+0000","last_unstale":"2024-05-30T17:04:26.645955+0000","last_undegraded":"2024-05-30T17:04:26.645955+0000","last_fullsized":"2024-05-30T17:04:26.645955+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:32.416930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.631101+0000","last_change":"2024-05-30T17:04:26.631101+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.631101+0000","last_undegraded":"2024-05-30T17:04:26.631101+0000","last_fullsized":"2024-05-30T17:04:26.631101+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.651216+0000","last_change":"2024-05-30T17:04:26.650407+0000","last_active":"2024-05-30T17:04:26.651216+0000","last_peered":"2024-05-30T17:04:26.651216+0000","last_clean":"2024-05-30T17:04:26.651216+0000","last_became_active":"2024-05-30T17:04:26.650063+0000","last_became_peered":"2024-05-30T17:04:26.650063+0000","last_unstale":"2024-05-30T17:04:26.651216+0000","last_undegraded":"2024-05-30T17:04:26.651216+0000","last_fullsized":"2024-05-30T17:04:26.651216+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:22.172682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266816+0000","last_change":"2024-05-30T17:04:27.648839+0000","last_active":"2024-05-30T17:04:29.266816+0000","last_peered":"2024-05-30T17:04:29.266816+0000","last_clean":"2024-05-30T17:04:29.266816+0000","last_became_active":"2024-05-30T17:04:27.648558+0000","last_became_peered":"2024-05-30T17:04:27.648558+0000","last_unstale":"2024-05-30T17:04:29.266816+0000","last_undegraded":"2024-05-30T17:04:29.266816+0000","last_fullsized":"2024-05-30T17:04:29.266816+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:52.862600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266032+0000","last_change":"2024-05-30T17:04:26.646155+0000","last_active":"2024-05-30T17:04:29.266032+0000","last_peered":"2024-05-30T17:04:29.266032+0000","last_clean":"2024-05-30T17:04:29.266032+0000","last_became_active":"2024-05-30T17:04:26.645855+0000","last_became_peered":"2024-05-30T17:04:26.645855+0000","last_unstale":"2024-05-30T17:04:29.266032+0000","last_undegraded":"2024-05-30T17:04:29.266032+0000","last_fullsized":"2024-05-30T17:04:29.266032+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:51.017861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.633426+0000","last_change":"2024-05-30T17:04:26.633426+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.633426+0000","last_undegraded":"2024-05-30T17:04:26.633426+0000","last_fullsized":"2024-05-30T17:04:26.633426+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.650821+0000","last_change":"2024-05-30T17:04:26.646414+0000","last_active":"2024-05-30T17:04:26.650821+0000","last_peered":"2024-05-30T17:04:26.650821+0000","last_clean":"2024-05-30T17:04:26.650821+0000","last_became_active":"2024-05-30T17:04:26.646125+0000","last_became_peered":"2024-05-30T17:04:26.646125+0000","last_unstale":"2024-05-30T17:04:26.650821+0000","last_undegraded":"2024-05-30T17:04:26.650821+0000","last_fullsized":"2024-05-30T17:04:26.650821+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:56:41.482517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-05-30T17:04:26.635702+0000","last_change":"2024-05-30T17:04:26.635702+0000","last_active":"2024-05-30T17:04:26.621980+0000","last_peered":"2024-05-30T17:04:26.621980+0000","last_clean":"2024-05-30T17:04:26.621980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T17:04:26.635702+0000","last_undegraded":"2024-05-30T17:04:26.635702+0000","last_fullsized":"2024-05-30T17:04:26.635702+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.656836+0000","last_change":"2024-05-30T17:04:26.656301+0000","last_active":"2024-05-30T17:04:26.656836+0000","last_peered":"2024-05-30T17:04:26.656836+0000","last_clean":"2024-05-30T17:04:26.656836+0000","last_became_active":"2024-05-30T17:04:26.655900+0000","last_became_peered":"2024-05-30T17:04:26.655900+0000","last_unstale":"2024-05-30T17:04:26.656836+0000","last_undegraded":"2024-05-30T17:04:26.656836+0000","last_fullsized":"2024-05-30T17:04:26.656836+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:11.815687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":374,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-05-30T17:04:26.641213+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:04:26.641213+0000","last_peered":"2024-05-30T17:04:26.641213+0000","last_clean":"2024-05-30T17:04:26.641213+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:04:26.641213+0000","last_undegraded":"2024-05-30T17:04:26.641213+0000","last_fullsized":"2024-05-30T17:04:26.641213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509629,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127656,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244184,"statfs":{"total":96636764160,"available":96506044416,"internally_reserved":0,"allocated":2183168,"data_stored":1286557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509630,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127080,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244760,"statfs":{"total":96636764160,"available":96506634240,"internally_reserved":0,"allocated":1601536,"data_stored":702576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509630,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85488,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":83902,"kb_avail":94286352,"statfs":{"total":96636764160,"available":96549224448,"internally_reserved":0,"allocated":1601536,"data_stored":702576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":85916101},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509631,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109032,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94262808,"statfs":{"total":96636764160,"available":96525115392,"internally_reserved":0,"allocated":1589248,"data_stored":696189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509630,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145120,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226720,"statfs":{"total":96636764160,"available":96488161280,"internally_reserved":0,"allocated":1589248,"data_stored":696189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509630,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145128,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226712,"statfs":{"total":96636764160,"available":96488153088,"internally_reserved":0,"allocated":1601536,"data_stored":702576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509630,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141548,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230292,"statfs":{"total":96636764160,"available":96491819008,"internally_reserved":0,"allocated":2195456,"data_stored":1292944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542335,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131280,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240560,"statfs":{"total":96636764160,"available":96502333440,"internally_reserved":0,"allocated":1634304,"data_stored":716035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:04:36.109 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:04:36.113 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:04:36.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:04:36.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.513+0000 7f09ef600640 1 Processor -- start 2024-05-30T17:04:36.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.513+0000 7f09ef600640 1 -- start start 2024-05-30T17:04:36.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09ef600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f09e8073bb0 0x7f09e815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:36.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09ef600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e815f3b0 con 0x7f09e80cfa40 2024-05-30T17:04:36.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09ef600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e815f690 con 0x7f09e80cfe20 2024-05-30T17:04:36.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09ef600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f09e815f970 con 0x7f09e8073bb0 2024-05-30T17:04:36.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09ecc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f09e80cfa40 0x7f09e80b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54042/0 (socket says 172.21.15.59:54042) 2024-05-30T17:04:36.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09ecc00640 1 -- 172.21.15.59:0/3258997379 learned_addr learned my addr 172.21.15.59:0/3258997379 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:36.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09ed600640 1 --2- 172.21.15.59:0/3258997379 >> v2:172.21.15.107:3300/0 conn(0x7f09e8073bb0 0x7f09e815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:36.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09e7e00640 1 -- 172.21.15.59:0/3258997379 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 748804789 0 0) 0x7f09e815f3b0 con 0x7f09e80cfa40 2024-05-30T17:04:36.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09e7e00640 1 -- 172.21.15.59:0/3258997379 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09cc003530 con 0x7f09e80cfa40 2024-05-30T17:04:36.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09e7e00640 1 -- 172.21.15.59:0/3258997379 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383548817 0 0) 0x7f09e815f690 con 0x7f09e80cfe20 2024-05-30T17:04:36.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09e7e00640 1 -- 172.21.15.59:0/3258997379 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09e815f3b0 con 0x7f09e80cfe20 2024-05-30T17:04:36.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09ed600640 1 -- 172.21.15.59:0/3258997379 >> v1:172.21.15.107:6789/0 conn(0x7f09e80cfe20 legacy=0x7f09e8072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:36.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09ed600640 1 -- 172.21.15.59:0/3258997379 >> v1:172.21.15.59:6789/0 conn(0x7f09e80cfa40 legacy=0x7f09e80b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:36.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.517+0000 7f09ed600640 1 -- 172.21.15.59:0/3258997379 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e80b3370 con 0x7f09e8073bb0 2024-05-30T17:04:36.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09ed600640 1 --2- 172.21.15.59:0/3258997379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e8073bb0 0x7f09e815ecb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009d90 tx=0x7f09e001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b30dc70fcef41dc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:36.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09e7e00640 1 -- 172.21.15.59:0/3258997379 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e00b2070 con 0x7f09e8073bb0 2024-05-30T17:04:36.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09e7e00640 1 -- 172.21.15.59:0/3258997379 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e00a5940 con 0x7f09e8073bb0 2024-05-30T17:04:36.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09e7e00640 1 -- 172.21.15.59:0/3258997379 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e00a5d10 con 0x7f09e8073bb0 2024-05-30T17:04:36.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09ef600640 1 -- 172.21.15.59:0/3258997379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e8073bb0 msgr2=0x7f09e815ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:36.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09ef600640 1 --2- 172.21.15.59:0/3258997379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e8073bb0 0x7f09e815ecb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009d90 tx=0x7f09e001c970 comp rx=0 tx=0).stop 2024-05-30T17:04:36.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09ef600640 1 -- 172.21.15.59:0/3258997379 shutdown_connections 2024-05-30T17:04:36.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09ef600640 1 --2- 172.21.15.59:0/3258997379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e8073bb0 0x7f09e815ecb0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:36.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09ef600640 1 -- 172.21.15.59:0/3258997379 >> 172.21.15.59:0/3258997379 conn(0x7f09e80b22d0 msgr2=0x7f09e80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:36.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09ef600640 1 -- 172.21.15.59:0/3258997379 shutdown_connections 2024-05-30T17:04:36.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09ef600640 1 -- 172.21.15.59:0/3258997379 wait complete. 2024-05-30T17:04:36.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09ef600640 1 Processor -- start 2024-05-30T17:04:36.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.521+0000 7f09ef600640 1 -- start start 2024-05-30T17:04:36.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ef600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e8073bb0 0x7f09e81476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:36.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ef600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f09e80cfa40 0x7f09e80b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:36.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ef600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09e80cfe20 0x7f09e80b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:36.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ef600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8154fc0 con 0x7f09e80cfe20 2024-05-30T17:04:36.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ef600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8154e40 con 0x7f09e8073bb0 2024-05-30T17:04:36.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ef600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f09e8155140 con 0x7f09e80cfa40 2024-05-30T17:04:36.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ed600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09e80cfe20 0x7f09e80b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:36.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ed600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09e80cfe20 0x7f09e80b0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49554/0 (socket says 172.21.15.59:49554) 2024-05-30T17:04:36.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ed600640 1 -- 172.21.15.59:0/1036999717 learned_addr learned my addr 172.21.15.59:0/1036999717 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:36.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ecc00640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e8073bb0 0x7f09e81476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:36.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09dfe00640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f09e80cfa40 0x7f09e80b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:36.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ed600640 1 -- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f09e80cfa40 msgr2=0x7f09e80b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:36.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ed600640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f09e80cfa40 0x7f09e80b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:36.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ed600640 1 -- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e8073bb0 msgr2=0x7f09e81476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:36.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ed600640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e8073bb0 0x7f09e81476d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:36.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ed600640 1 -- 172.21.15.59:0/1036999717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e814e8a0 con 0x7f09e80cfe20 2024-05-30T17:04:36.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09dfe00640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f09e80cfa40 0x7f09e80b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:36.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ed600640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09e80cfe20 0x7f09e80b0d50 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f09e00b0040 tx=0x7f09e0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:36.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09e5600640 1 -- 172.21.15.59:0/1036999717 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e00b2050 con 0x7f09e80cfe20 2024-05-30T17:04:36.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09e5600640 1 -- 172.21.15.59:0/1036999717 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e00be070 con 0x7f09e80cfe20 2024-05-30T17:04:36.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ef600640 1 -- 172.21.15.59:0/1036999717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e814eb80 con 0x7f09e80cfe20 2024-05-30T17:04:36.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09e5600640 1 -- 172.21.15.59:0/1036999717 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e00ada70 con 0x7f09e80cfe20 2024-05-30T17:04:36.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ef600640 1 -- 172.21.15.59:0/1036999717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e814f140 con 0x7f09e80cfe20 2024-05-30T17:04:36.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.525+0000 7f09ef600640 1 -- 172.21.15.59:0/1036999717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e8068a90 con 0x7f09e80cfe20 2024-05-30T17:04:36.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.529+0000 7f09e5600640 1 -- 172.21.15.59:0/1036999717 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f09e00a57c0 con 0x7f09e80cfe20 2024-05-30T17:04:36.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.529+0000 7f09e5600640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f09c4069fd0 0x7f09c406c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:36.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.529+0000 7f09e5600640 1 -- 172.21.15.59:0/1036999717 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7f09e0120860 con 0x7f09e80cfe20 2024-05-30T17:04:36.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.529+0000 7f09ecc00640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f09c4069fd0 0x7f09c406c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:36.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.529+0000 7f09ecc00640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f09c4069fd0 0x7f09c406c490 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f09d8007fd0 tx=0x7f09d8007d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:36.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.533+0000 7f09e5600640 1 -- 172.21.15.59:0/1036999717 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f09e0016560 con 0x7f09e80cfe20 2024-05-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.697+0000 7f09ef600640 1 -- 172.21.15.59:0/1036999717 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09e8154c20 con 0x7f09c4069fd0 2024-05-30T17:04:36.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.701+0000 7f09e5600640 1 -- 172.21.15.59:0/1036999717 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252505 (secure 0 0 0) 0x7f09e8154c20 con 0x7f09c4069fd0 2024-05-30T17:04:36.706 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:04:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.705+0000 7f09ef600640 1 -- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f09c4069fd0 msgr2=0x7f09c406c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.705+0000 7f09ef600640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f09c4069fd0 0x7f09c406c490 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f09d8007fd0 tx=0x7f09d8007d80 comp rx=0 tx=0).stop 2024-05-30T17:04:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.705+0000 7f09ef600640 1 -- 172.21.15.59:0/1036999717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09e80cfe20 msgr2=0x7f09e80b0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.705+0000 7f09ef600640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09e80cfe20 0x7f09e80b0d50 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f09e00b0040 tx=0x7f09e0019710 comp rx=0 tx=0).stop 2024-05-30T17:04:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.705+0000 7f09ef600640 1 -- 172.21.15.59:0/1036999717 shutdown_connections 2024-05-30T17:04:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.705+0000 7f09ef600640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f09c4069fd0 0x7f09c406c490 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.705+0000 7f09ef600640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09e80cfe20 0x7f09e80b0d50 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.705+0000 7f09ef600640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f09e80cfa40 0x7f09e80b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.705+0000 7f09ef600640 1 --2- 172.21.15.59:0/1036999717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e8073bb0 0x7f09e81476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:36.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.705+0000 7f09ef600640 1 -- 172.21.15.59:0/1036999717 >> 172.21.15.59:0/1036999717 conn(0x7f09e80b22d0 msgr2=0x7f09e815ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:36.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.705+0000 7f09ef600640 1 -- 172.21.15.59:0/1036999717 shutdown_connections 2024-05-30T17:04:36.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.705+0000 7f09ef600640 1 -- 172.21.15.59:0/1036999717 wait complete. 2024-05-30T17:04:36.727 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":596,"stamp":"2024-05-30T17:04:35.380177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":991748,"kb_used_data":13928,"kb_used_omap":12,"kb_used_meta":977651,"kb_avail":753982972,"statfs":{"total":773094113280,"available":772078563328,"internally_reserved":0,"allocated":14262272,"data_stored":6912556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1001115184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002035"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267687+0000","last_change":"2024-05-30T17:04:27.656457+0000","last_active":"2024-05-30T17:04:29.267687+0000","last_peered":"2024-05-30T17:04:29.267687+0000","last_clean":"2024-05-30T17:04:29.267687+0000","last_became_active":"2024-05-30T17:04:27.656195+0000","last_became_peered":"2024-05-30T17:04:27.656195+0000","last_unstale":"2024-05-30T17:04:29.267687+0000","last_undegraded":"2024-05-30T17:04:29.267687+0000","last_fullsized":"2024-05-30T17:04:29.267687+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:57.885952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266231+0000","last_change":"2024-05-30T17:04:27.651522+0000","last_active":"2024-05-30T17:04:29.266231+0000","last_peered":"2024-05-30T17:04:29.266231+0000","last_clean":"2024-05-30T17:04:29.266231+0000","last_became_active":"2024-05-30T17:04:27.649831+0000","last_became_peered":"2024-05-30T17:04:27.649831+0000","last_unstale":"2024-05-30T17:04:29.266231+0000","last_undegraded":"2024-05-30T17:04:29.266231+0000","last_fullsized":"2024-05-30T17:04:29.266231+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:56.144416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.647455+0000","last_change":"2024-05-30T17:04:27.662273+0000","last_active":"2024-05-30T17:04:28.647455+0000","last_peered":"2024-05-30T17:04:28.647455+0000","last_clean":"2024-05-30T17:04:28.647455+0000","last_became_active":"2024-05-30T17:04:27.661891+0000","last_became_peered":"2024-05-30T17:04:27.661891+0000","last_unstale":"2024-05-30T17:04:28.647455+0000","last_undegraded":"2024-05-30T17:04:28.647455+0000","last_fullsized":"2024-05-30T17:04:28.647455+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:37.192613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267234+0000","last_change":"2024-05-30T17:04:27.655790+0000","last_active":"2024-05-30T17:04:29.267234+0000","last_peered":"2024-05-30T17:04:29.267234+0000","last_clean":"2024-05-30T17:04:29.267234+0000","last_became_active":"2024-05-30T17:04:27.655516+0000","last_became_peered":"2024-05-30T17:04:27.655516+0000","last_unstale":"2024-05-30T17:04:29.267234+0000","last_undegraded":"2024-05-30T17:04:29.267234+0000","last_fullsized":"2024-05-30T17:04:29.267234+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:21.860246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.674661+0000","last_change":"2024-05-30T17:04:27.668225+0000","last_active":"2024-05-30T17:04:28.674661+0000","last_peered":"2024-05-30T17:04:28.674661+0000","last_clean":"2024-05-30T17:04:28.674661+0000","last_became_active":"2024-05-30T17:04:27.667959+0000","last_became_peered":"2024-05-30T17:04:27.667959+0000","last_unstale":"2024-05-30T17:04:28.674661+0000","last_undegraded":"2024-05-30T17:04:28.674661+0000","last_fullsized":"2024-05-30T17:04:28.674661+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:36:36.807585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.648144+0000","last_change":"2024-05-30T17:04:27.662557+0000","last_active":"2024-05-30T17:04:28.648144+0000","last_peered":"2024-05-30T17:04:28.648144+0000","last_clean":"2024-05-30T17:04:28.648144+0000","last_became_active":"2024-05-30T17:04:27.662304+0000","last_became_peered":"2024-05-30T17:04:27.662304+0000","last_unstale":"2024-05-30T17:04:28.648144+0000","last_undegraded":"2024-05-30T17:04:28.648144+0000","last_fullsized":"2024-05-30T17:04:28.648144+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:23.592124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.647734+0000","last_change":"2024-05-30T17:04:27.650438+0000","last_active":"2024-05-30T17:04:28.647734+0000","last_peered":"2024-05-30T17:04:28.647734+0000","last_clean":"2024-05-30T17:04:28.647734+0000","last_became_active":"2024-05-30T17:04:27.649935+0000","last_became_peered":"2024-05-30T17:04:27.649935+0000","last_unstale":"2024-05-30T17:04:28.647734+0000","last_undegraded":"2024-05-30T17:04:28.647734+0000","last_fullsized":"2024-05-30T17:04:28.647734+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:53.659379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.646798+0000","last_change":"2024-05-30T17:04:27.654259+0000","last_active":"2024-05-30T17:04:28.646798+0000","last_peered":"2024-05-30T17:04:28.646798+0000","last_clean":"2024-05-30T17:04:28.646798+0000","last_became_active":"2024-05-30T17:04:27.653784+0000","last_became_peered":"2024-05-30T17:04:27.653784+0000","last_unstale":"2024-05-30T17:04:28.646798+0000","last_undegraded":"2024-05-30T17:04:28.646798+0000","last_fullsized":"2024-05-30T17:04:28.646798+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:33:17.272892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.648142+0000","last_change":"2024-05-30T17:04:27.667692+0000","last_active":"2024-05-30T17:04:28.648142+0000","last_peered":"2024-05-30T17:04:28.648142+0000","last_clean":"2024-05-30T17:04:28.648142+0000","last_became_active":"2024-05-30T17:04:27.667374+0000","last_became_peered":"2024-05-30T17:04:27.667374+0000","last_unstale":"2024-05-30T17:04:28.648142+0000","last_undegraded":"2024-05-30T17:04:28.648142+0000","last_fullsized":"2024-05-30T17:04:28.648142+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:23.592124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266397+0000","last_change":"2024-05-30T17:04:27.649118+0000","last_active":"2024-05-30T17:04:29.266397+0000","last_peered":"2024-05-30T17:04:29.266397+0000","last_clean":"2024-05-30T17:04:29.266397+0000","last_became_active":"2024-05-30T17:04:27.648603+0000","last_became_peered":"2024-05-30T17:04:27.648603+0000","last_unstale":"2024-05-30T17:04:29.266397+0000","last_undegraded":"2024-05-30T17:04:29.266397+0000","last_fullsized":"2024-05-30T17:04:29.266397+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:34:15.854657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.644005+0000","last_change":"2024-05-30T17:04:27.661461+0000","last_active":"2024-05-30T17:04:28.644005+0000","last_peered":"2024-05-30T17:04:28.644005+0000","last_clean":"2024-05-30T17:04:28.644005+0000","last_became_active":"2024-05-30T17:04:27.660883+0000","last_became_peered":"2024-05-30T17:04:27.660883+0000","last_unstale":"2024-05-30T17:04:28.644005+0000","last_undegraded":"2024-05-30T17:04:28.644005+0000","last_fullsized":"2024-05-30T17:04:28.644005+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:10.641928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.647164+0000","last_change":"2024-05-30T17:04:27.666142+0000","last_active":"2024-05-30T17:04:28.647164+0000","last_peered":"2024-05-30T17:04:28.647164+0000","last_clean":"2024-05-30T17:04:28.647164+0000","last_became_active":"2024-05-30T17:04:27.665266+0000","last_became_peered":"2024-05-30T17:04:27.665266+0000","last_unstale":"2024-05-30T17:04:28.647164+0000","last_undegraded":"2024-05-30T17:04:28.647164+0000","last_fullsized":"2024-05-30T17:04:28.647164+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:22.395407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267083+0000","last_change":"2024-05-30T17:04:27.655353+0000","last_active":"2024-05-30T17:04:29.267083+0000","last_peered":"2024-05-30T17:04:29.267083+0000","last_clean":"2024-05-30T17:04:29.267083+0000","last_became_active":"2024-05-30T17:04:27.655046+0000","last_became_peered":"2024-05-30T17:04:27.655046+0000","last_unstale":"2024-05-30T17:04:29.267083+0000","last_undegraded":"2024-05-30T17:04:29.267083+0000","last_fullsized":"2024-05-30T17:04:29.267083+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:03.759562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265831+0000","last_change":"2024-05-30T17:04:27.660230+0000","last_active":"2024-05-30T17:04:29.265831+0000","last_peered":"2024-05-30T17:04:29.265831+0000","last_clean":"2024-05-30T17:04:29.265831+0000","last_became_active":"2024-05-30T17:04:27.659965+0000","last_became_peered":"2024-05-30T17:04:27.659965+0000","last_unstale":"2024-05-30T17:04:29.265831+0000","last_undegraded":"2024-05-30T17:04:29.265831+0000","last_fullsized":"2024-05-30T17:04:29.265831+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:29:02.948480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266820+0000","last_change":"2024-05-30T17:04:27.651454+0000","last_active":"2024-05-30T17:04:29.266820+0000","last_peered":"2024-05-30T17:04:29.266820+0000","last_clean":"2024-05-30T17:04:29.266820+0000","last_became_active":"2024-05-30T17:04:27.650330+0000","last_became_peered":"2024-05-30T17:04:27.650330+0000","last_unstale":"2024-05-30T17:04:29.266820+0000","last_undegraded":"2024-05-30T17:04:29.266820+0000","last_fullsized":"2024-05-30T17:04:29.266820+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:29:36.345038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266123+0000","last_change":"2024-05-30T17:04:27.656402+0000","last_active":"2024-05-30T17:04:29.266123+0000","last_peered":"2024-05-30T17:04:29.266123+0000","last_clean":"2024-05-30T17:04:29.266123+0000","last_became_active":"2024-05-30T17:04:27.656141+0000","last_became_peered":"2024-05-30T17:04:27.656141+0000","last_unstale":"2024-05-30T17:04:29.266123+0000","last_undegraded":"2024-05-30T17:04:29.266123+0000","last_fullsized":"2024-05-30T17:04:29.266123+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:08.433002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.648531+0000","last_change":"2024-05-30T17:04:27.655050+0000","last_active":"2024-05-30T17:04:28.648531+0000","last_peered":"2024-05-30T17:04:28.648531+0000","last_clean":"2024-05-30T17:04:28.648531+0000","last_became_active":"2024-05-30T17:04:27.654786+0000","last_became_peered":"2024-05-30T17:04:27.654786+0000","last_unstale":"2024-05-30T17:04:28.648531+0000","last_undegraded":"2024-05-30T17:04:28.648531+0000","last_fullsized":"2024-05-30T17:04:28.648531+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:12.824800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266584+0000","last_change":"2024-05-30T17:04:27.650889+0000","last_active":"2024-05-30T17:04:29.266584+0000","last_peered":"2024-05-30T17:04:29.266584+0000","last_clean":"2024-05-30T17:04:29.266584+0000","last_became_active":"2024-05-30T17:04:27.649462+0000","last_became_peered":"2024-05-30T17:04:27.649462+0000","last_unstale":"2024-05-30T17:04:29.266584+0000","last_undegraded":"2024-05-30T17:04:29.266584+0000","last_fullsized":"2024-05-30T17:04:29.266584+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:02:33.740142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.644058+0000","last_change":"2024-05-30T17:04:27.661225+0000","last_active":"2024-05-30T17:04:28.644058+0000","last_peered":"2024-05-30T17:04:28.644058+0000","last_clean":"2024-05-30T17:04:28.644058+0000","last_became_active":"2024-05-30T17:04:27.660532+0000","last_became_peered":"2024-05-30T17:04:27.660532+0000","last_unstale":"2024-05-30T17:04:28.644058+0000","last_undegraded":"2024-05-30T17:04:28.644058+0000","last_fullsized":"2024-05-30T17:04:28.644058+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:06.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266495+0000","last_change":"2024-05-30T17:04:27.652401+0000","last_active":"2024-05-30T17:04:29.266495+0000","last_peered":"2024-05-30T17:04:29.266495+0000","last_clean":"2024-05-30T17:04:29.266495+0000","last_became_active":"2024-05-30T17:04:27.652097+0000","last_became_peered":"2024-05-30T17:04:27.652097+0000","last_unstale":"2024-05-30T17:04:29.266495+0000","last_undegraded":"2024-05-30T17:04:29.266495+0000","last_fullsized":"2024-05-30T17:04:29.266495+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:22:37.455945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.674799+0000","last_change":"2024-05-30T17:04:27.668938+0000","last_active":"2024-05-30T17:04:28.674799+0000","last_peered":"2024-05-30T17:04:28.674799+0000","last_clean":"2024-05-30T17:04:28.674799+0000","last_became_active":"2024-05-30T17:04:27.667647+0000","last_became_peered":"2024-05-30T17:04:27.667647+0000","last_unstale":"2024-05-30T17:04:28.674799+0000","last_undegraded":"2024-05-30T17:04:28.674799+0000","last_fullsized":"2024-05-30T17:04:28.674799+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:30.304469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.643750+0000","last_change":"2024-05-30T17:04:27.662797+0000","last_active":"2024-05-30T17:04:28.643750+0000","last_peered":"2024-05-30T17:04:28.643750+0000","last_clean":"2024-05-30T17:04:28.643750+0000","last_became_active":"2024-05-30T17:04:27.662501+0000","last_became_peered":"2024-05-30T17:04:27.662501+0000","last_unstale":"2024-05-30T17:04:28.643750+0000","last_undegraded":"2024-05-30T17:04:28.643750+0000","last_fullsized":"2024-05-30T17:04:28.643750+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:08:53.115296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.647245+0000","last_change":"2024-05-30T17:04:27.663482+0000","last_active":"2024-05-30T17:04:28.647245+0000","last_peered":"2024-05-30T17:04:28.647245+0000","last_clean":"2024-05-30T17:04:28.647245+0000","last_became_active":"2024-05-30T17:04:27.663243+0000","last_became_peered":"2024-05-30T17:04:27.663243+0000","last_unstale":"2024-05-30T17:04:28.647245+0000","last_undegraded":"2024-05-30T17:04:28.647245+0000","last_fullsized":"2024-05-30T17:04:28.647245+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:18:01.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.643628+0000","last_change":"2024-05-30T17:04:27.664136+0000","last_active":"2024-05-30T17:04:28.643628+0000","last_peered":"2024-05-30T17:04:28.643628+0000","last_clean":"2024-05-30T17:04:28.643628+0000","last_became_active":"2024-05-30T17:04:27.663855+0000","last_became_peered":"2024-05-30T17:04:27.663855+0000","last_unstale":"2024-05-30T17:04:28.643628+0000","last_undegraded":"2024-05-30T17:04:28.643628+0000","last_fullsized":"2024-05-30T17:04:28.643628+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:58:09.184441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265987+0000","last_change":"2024-05-30T17:04:27.653664+0000","last_active":"2024-05-30T17:04:29.265987+0000","last_peered":"2024-05-30T17:04:29.265987+0000","last_clean":"2024-05-30T17:04:29.265987+0000","last_became_active":"2024-05-30T17:04:27.653397+0000","last_became_peered":"2024-05-30T17:04:27.653397+0000","last_unstale":"2024-05-30T17:04:29.265987+0000","last_undegraded":"2024-05-30T17:04:29.265987+0000","last_fullsized":"2024-05-30T17:04:29.265987+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:48.819945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266595+0000","last_change":"2024-05-30T17:04:27.657224+0000","last_active":"2024-05-30T17:04:29.266595+0000","last_peered":"2024-05-30T17:04:29.266595+0000","last_clean":"2024-05-30T17:04:29.266595+0000","last_became_active":"2024-05-30T17:04:27.656941+0000","last_became_peered":"2024-05-30T17:04:27.656941+0000","last_unstale":"2024-05-30T17:04:29.266595+0000","last_undegraded":"2024-05-30T17:04:29.266595+0000","last_fullsized":"2024-05-30T17:04:29.266595+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:33.680204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267468+0000","last_change":"2024-05-30T17:04:27.650536+0000","last_active":"2024-05-30T17:04:29.267468+0000","last_peered":"2024-05-30T17:04:29.267468+0000","last_clean":"2024-05-30T17:04:29.267468+0000","last_became_active":"2024-05-30T17:04:27.650282+0000","last_became_peered":"2024-05-30T17:04:27.650282+0000","last_unstale":"2024-05-30T17:04:29.267468+0000","last_undegraded":"2024-05-30T17:04:29.267468+0000","last_fullsized":"2024-05-30T17:04:29.267468+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:25:31.744496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267625+0000","last_change":"2024-05-30T17:04:27.664832+0000","last_active":"2024-05-30T17:04:29.267625+0000","last_peered":"2024-05-30T17:04:29.267625+0000","last_clean":"2024-05-30T17:04:29.267625+0000","last_became_active":"2024-05-30T17:04:27.664502+0000","last_became_peered":"2024-05-30T17:04:27.664502+0000","last_unstale":"2024-05-30T17:04:29.267625+0000","last_undegraded":"2024-05-30T17:04:29.267625+0000","last_fullsized":"2024-05-30T17:04:29.267625+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:01:53.320309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267222+0000","last_change":"2024-05-30T17:04:27.654528+0000","last_active":"2024-05-30T17:04:29.267222+0000","last_peered":"2024-05-30T17:04:29.267222+0000","last_clean":"2024-05-30T17:04:29.267222+0000","last_became_active":"2024-05-30T17:04:27.653960+0000","last_became_peered":"2024-05-30T17:04:27.653960+0000","last_unstale":"2024-05-30T17:04:29.267222+0000","last_undegraded":"2024-05-30T17:04:29.267222+0000","last_fullsized":"2024-05-30T17:04:29.267222+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:15.226549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267009+0000","last_change":"2024-05-30T17:04:27.654884+0000","last_active":"2024-05-30T17:04:29.267009+0000","last_peered":"2024-05-30T17:04:29.267009+0000","last_clean":"2024-05-30T17:04:29.267009+0000","last_became_active":"2024-05-30T17:04:27.654299+0000","last_became_peered":"2024-05-30T17:04:27.654299+0000","last_unstale":"2024-05-30T17:04:29.267009+0000","last_undegraded":"2024-05-30T17:04:29.267009+0000","last_fullsized":"2024-05-30T17:04:29.267009+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:24:47.150653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.674576+0000","last_change":"2024-05-30T17:04:27.663731+0000","last_active":"2024-05-30T17:04:28.674576+0000","last_peered":"2024-05-30T17:04:28.674576+0000","last_clean":"2024-05-30T17:04:28.674576+0000","last_became_active":"2024-05-30T17:04:27.663462+0000","last_became_peered":"2024-05-30T17:04:27.663462+0000","last_unstale":"2024-05-30T17:04:28.674576+0000","last_undegraded":"2024-05-30T17:04:28.674576+0000","last_fullsized":"2024-05-30T17:04:28.674576+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:05:45.058232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.647696+0000","last_change":"2024-05-30T17:04:27.648781+0000","last_active":"2024-05-30T17:04:28.647696+0000","last_peered":"2024-05-30T17:04:28.647696+0000","last_clean":"2024-05-30T17:04:28.647696+0000","last_became_active":"2024-05-30T17:04:27.648348+0000","last_became_peered":"2024-05-30T17:04:27.648348+0000","last_unstale":"2024-05-30T17:04:28.647696+0000","last_undegraded":"2024-05-30T17:04:28.647696+0000","last_fullsized":"2024-05-30T17:04:28.647696+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:18:01.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266938+0000","last_change":"2024-05-30T17:04:27.665116+0000","last_active":"2024-05-30T17:04:29.266938+0000","last_peered":"2024-05-30T17:04:29.266938+0000","last_clean":"2024-05-30T17:04:29.266938+0000","last_became_active":"2024-05-30T17:04:27.664853+0000","last_became_peered":"2024-05-30T17:04:27.664853+0000","last_unstale":"2024-05-30T17:04:29.266938+0000","last_undegraded":"2024-05-30T17:04:29.266938+0000","last_fullsized":"2024-05-30T17:04:29.266938+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:00.380018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"130'4","reported_seq":18,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.674976+0000","last_change":"2024-05-30T17:04:26.653769+0000","last_active":"2024-05-30T17:04:28.674976+0000","last_peered":"2024-05-30T17:04:28.674976+0000","last_clean":"2024-05-30T17:04:28.674976+0000","last_became_active":"2024-05-30T17:04:26.653331+0000","last_became_peered":"2024-05-30T17:04:26.653331+0000","last_unstale":"2024-05-30T17:04:28.674976+0000","last_undegraded":"2024-05-30T17:04:28.674976+0000","last_fullsized":"2024-05-30T17:04:28.674976+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:48.287253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.647848+0000","last_change":"2024-05-30T17:04:27.662362+0000","last_active":"2024-05-30T17:04:28.647848+0000","last_peered":"2024-05-30T17:04:28.647848+0000","last_clean":"2024-05-30T17:04:28.647848+0000","last_became_active":"2024-05-30T17:04:27.662074+0000","last_became_peered":"2024-05-30T17:04:27.662074+0000","last_unstale":"2024-05-30T17:04:28.647848+0000","last_undegraded":"2024-05-30T17:04:28.647848+0000","last_fullsized":"2024-05-30T17:04:28.647848+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:46.552415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267723+0000","last_change":"2024-05-30T17:04:26.652574+0000","last_active":"2024-05-30T17:04:29.267723+0000","last_peered":"2024-05-30T17:04:29.267723+0000","last_clean":"2024-05-30T17:04:29.267723+0000","last_became_active":"2024-05-30T17:04:26.652142+0000","last_became_peered":"2024-05-30T17:04:26.652142+0000","last_unstale":"2024-05-30T17:04:29.267723+0000","last_undegraded":"2024-05-30T17:04:29.267723+0000","last_fullsized":"2024-05-30T17:04:29.267723+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:56.876839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.674875+0000","last_change":"2024-05-30T17:04:27.660400+0000","last_active":"2024-05-30T17:04:28.674875+0000","last_peered":"2024-05-30T17:04:28.674875+0000","last_clean":"2024-05-30T17:04:28.674875+0000","last_became_active":"2024-05-30T17:04:27.659049+0000","last_became_peered":"2024-05-30T17:04:27.659049+0000","last_unstale":"2024-05-30T17:04:28.674875+0000","last_undegraded":"2024-05-30T17:04:28.674875+0000","last_fullsized":"2024-05-30T17:04:28.674875+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:40.140860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.644108+0000","last_change":"2024-05-30T17:04:26.652502+0000","last_active":"2024-05-30T17:04:28.644108+0000","last_peered":"2024-05-30T17:04:28.644108+0000","last_clean":"2024-05-30T17:04:28.644108+0000","last_became_active":"2024-05-30T17:04:26.652240+0000","last_became_peered":"2024-05-30T17:04:26.652240+0000","last_unstale":"2024-05-30T17:04:28.644108+0000","last_undegraded":"2024-05-30T17:04:28.644108+0000","last_fullsized":"2024-05-30T17:04:28.644108+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:05:38.644445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.675014+0000","last_change":"2024-05-30T17:04:27.659729+0000","last_active":"2024-05-30T17:04:28.675014+0000","last_peered":"2024-05-30T17:04:28.675014+0000","last_clean":"2024-05-30T17:04:28.675014+0000","last_became_active":"2024-05-30T17:04:27.659448+0000","last_became_peered":"2024-05-30T17:04:27.659448+0000","last_unstale":"2024-05-30T17:04:28.675014+0000","last_undegraded":"2024-05-30T17:04:28.675014+0000","last_fullsized":"2024-05-30T17:04:28.675014+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:24:26.077897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265737+0000","last_change":"2024-05-30T17:04:26.644729+0000","last_active":"2024-05-30T17:04:29.265737+0000","last_peered":"2024-05-30T17:04:29.265737+0000","last_clean":"2024-05-30T17:04:29.265737+0000","last_became_active":"2024-05-30T17:04:26.644381+0000","last_became_peered":"2024-05-30T17:04:26.644381+0000","last_unstale":"2024-05-30T17:04:29.265737+0000","last_undegraded":"2024-05-30T17:04:29.265737+0000","last_fullsized":"2024-05-30T17:04:29.265737+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:37:07.585571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266155+0000","last_change":"2024-05-30T17:04:27.650774+0000","last_active":"2024-05-30T17:04:29.266155+0000","last_peered":"2024-05-30T17:04:29.266155+0000","last_clean":"2024-05-30T17:04:29.266155+0000","last_became_active":"2024-05-30T17:04:27.649829+0000","last_became_peered":"2024-05-30T17:04:27.649829+0000","last_unstale":"2024-05-30T17:04:29.266155+0000","last_undegraded":"2024-05-30T17:04:29.266155+0000","last_fullsized":"2024-05-30T17:04:29.266155+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:43:56.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265455+0000","last_change":"2024-05-30T17:04:26.649081+0000","last_active":"2024-05-30T17:04:29.265455+0000","last_peered":"2024-05-30T17:04:29.265455+0000","last_clean":"2024-05-30T17:04:29.265455+0000","last_became_active":"2024-05-30T17:04:26.648809+0000","last_became_peered":"2024-05-30T17:04:26.648809+0000","last_unstale":"2024-05-30T17:04:29.265455+0000","last_undegraded":"2024-05-30T17:04:29.265455+0000","last_fullsized":"2024-05-30T17:04:29.265455+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:19.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.648172+0000","last_change":"2024-05-30T17:04:27.657052+0000","last_active":"2024-05-30T17:04:28.648172+0000","last_peered":"2024-05-30T17:04:28.648172+0000","last_clean":"2024-05-30T17:04:28.648172+0000","last_became_active":"2024-05-30T17:04:27.656807+0000","last_became_peered":"2024-05-30T17:04:27.656807+0000","last_unstale":"2024-05-30T17:04:28.648172+0000","last_undegraded":"2024-05-30T17:04:28.648172+0000","last_fullsized":"2024-05-30T17:04:28.648172+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:23.181795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266208+0000","last_change":"2024-05-30T17:04:26.650934+0000","last_active":"2024-05-30T17:04:29.266208+0000","last_peered":"2024-05-30T17:04:29.266208+0000","last_clean":"2024-05-30T17:04:29.266208+0000","last_became_active":"2024-05-30T17:04:26.650668+0000","last_became_peered":"2024-05-30T17:04:26.650668+0000","last_unstale":"2024-05-30T17:04:29.266208+0000","last_undegraded":"2024-05-30T17:04:29.266208+0000","last_fullsized":"2024-05-30T17:04:29.266208+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:04.028994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.646845+0000","last_change":"2024-05-30T17:04:27.653284+0000","last_active":"2024-05-30T17:04:28.646845+0000","last_peered":"2024-05-30T17:04:28.646845+0000","last_clean":"2024-05-30T17:04:28.646845+0000","last_became_active":"2024-05-30T17:04:27.653020+0000","last_became_peered":"2024-05-30T17:04:27.653020+0000","last_unstale":"2024-05-30T17:04:28.646845+0000","last_undegraded":"2024-05-30T17:04:28.646845+0000","last_fullsized":"2024-05-30T17:04:28.646845+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:21.704608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.647859+0000","last_change":"2024-05-30T17:04:26.642168+0000","last_active":"2024-05-30T17:04:28.647859+0000","last_peered":"2024-05-30T17:04:28.647859+0000","last_clean":"2024-05-30T17:04:28.647859+0000","last_became_active":"2024-05-30T17:04:26.641791+0000","last_became_peered":"2024-05-30T17:04:26.641791+0000","last_unstale":"2024-05-30T17:04:28.647859+0000","last_undegraded":"2024-05-30T17:04:28.647859+0000","last_fullsized":"2024-05-30T17:04:28.647859+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:06:45.068461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265397+0000","last_change":"2024-05-30T17:04:27.648200+0000","last_active":"2024-05-30T17:04:29.265397+0000","last_peered":"2024-05-30T17:04:29.265397+0000","last_clean":"2024-05-30T17:04:29.265397+0000","last_became_active":"2024-05-30T17:04:27.647928+0000","last_became_peered":"2024-05-30T17:04:27.647928+0000","last_unstale":"2024-05-30T17:04:29.265397+0000","last_undegraded":"2024-05-30T17:04:29.265397+0000","last_fullsized":"2024-05-30T17:04:29.265397+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:25:31.744496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265524+0000","last_change":"2024-05-30T17:04:26.645457+0000","last_active":"2024-05-30T17:04:29.265524+0000","last_peered":"2024-05-30T17:04:29.265524+0000","last_clean":"2024-05-30T17:04:29.265524+0000","last_became_active":"2024-05-30T17:04:26.642988+0000","last_became_peered":"2024-05-30T17:04:26.642988+0000","last_unstale":"2024-05-30T17:04:29.265524+0000","last_undegraded":"2024-05-30T17:04:29.265524+0000","last_fullsized":"2024-05-30T17:04:29.265524+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:51:19.024263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267582+0000","last_change":"2024-05-30T17:04:27.654579+0000","last_active":"2024-05-30T17:04:29.267582+0000","last_peered":"2024-05-30T17:04:29.267582+0000","last_clean":"2024-05-30T17:04:29.267582+0000","last_became_active":"2024-05-30T17:04:27.654315+0000","last_became_peered":"2024-05-30T17:04:27.654315+0000","last_unstale":"2024-05-30T17:04:29.267582+0000","last_undegraded":"2024-05-30T17:04:29.267582+0000","last_fullsized":"2024-05-30T17:04:29.267582+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:42.109985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267967+0000","last_change":"2024-05-30T17:04:26.653783+0000","last_active":"2024-05-30T17:04:29.267967+0000","last_peered":"2024-05-30T17:04:29.267967+0000","last_clean":"2024-05-30T17:04:29.267967+0000","last_became_active":"2024-05-30T17:04:26.653413+0000","last_became_peered":"2024-05-30T17:04:26.653413+0000","last_unstale":"2024-05-30T17:04:29.267967+0000","last_undegraded":"2024-05-30T17:04:29.267967+0000","last_fullsized":"2024-05-30T17:04:29.267967+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:47.810832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267843+0000","last_change":"2024-05-30T17:04:27.670112+0000","last_active":"2024-05-30T17:04:29.267843+0000","last_peered":"2024-05-30T17:04:29.267843+0000","last_clean":"2024-05-30T17:04:29.267843+0000","last_became_active":"2024-05-30T17:04:27.669759+0000","last_became_peered":"2024-05-30T17:04:27.669759+0000","last_unstale":"2024-05-30T17:04:29.267843+0000","last_undegraded":"2024-05-30T17:04:29.267843+0000","last_fullsized":"2024-05-30T17:04:29.267843+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:28:30.371308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266674+0000","last_change":"2024-05-30T17:04:26.649285+0000","last_active":"2024-05-30T17:04:29.266674+0000","last_peered":"2024-05-30T17:04:29.266674+0000","last_clean":"2024-05-30T17:04:29.266674+0000","last_became_active":"2024-05-30T17:04:26.648983+0000","last_became_peered":"2024-05-30T17:04:26.648983+0000","last_unstale":"2024-05-30T17:04:29.266674+0000","last_undegraded":"2024-05-30T17:04:29.266674+0000","last_fullsized":"2024-05-30T17:04:29.266674+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:19.123667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.674913+0000","last_change":"2024-05-30T17:04:27.661122+0000","last_active":"2024-05-30T17:04:28.674913+0000","last_peered":"2024-05-30T17:04:28.674913+0000","last_clean":"2024-05-30T17:04:28.674913+0000","last_became_active":"2024-05-30T17:04:27.660791+0000","last_became_peered":"2024-05-30T17:04:27.660791+0000","last_unstale":"2024-05-30T17:04:28.674913+0000","last_undegraded":"2024-05-30T17:04:28.674913+0000","last_fullsized":"2024-05-30T17:04:28.674913+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:44:34.412222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"130'3","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267576+0000","last_change":"2024-05-30T17:04:26.655873+0000","last_active":"2024-05-30T17:04:29.267576+0000","last_peered":"2024-05-30T17:04:29.267576+0000","last_clean":"2024-05-30T17:04:29.267576+0000","last_became_active":"2024-05-30T17:04:26.655436+0000","last_became_peered":"2024-05-30T17:04:26.655436+0000","last_unstale":"2024-05-30T17:04:29.267576+0000","last_undegraded":"2024-05-30T17:04:29.267576+0000","last_fullsized":"2024-05-30T17:04:29.267576+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:41.100872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.675073+0000","last_change":"2024-05-30T17:04:27.655308+0000","last_active":"2024-05-30T17:04:28.675073+0000","last_peered":"2024-05-30T17:04:28.675073+0000","last_clean":"2024-05-30T17:04:28.675073+0000","last_became_active":"2024-05-30T17:04:27.654682+0000","last_became_peered":"2024-05-30T17:04:27.654682+0000","last_unstale":"2024-05-30T17:04:28.675073+0000","last_undegraded":"2024-05-30T17:04:28.675073+0000","last_fullsized":"2024-05-30T17:04:28.675073+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:13:50.711493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"130'6","reported_seq":20,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.647212+0000","last_change":"2024-05-30T17:04:26.644996+0000","last_active":"2024-05-30T17:04:28.647212+0000","last_peered":"2024-05-30T17:04:28.647212+0000","last_clean":"2024-05-30T17:04:28.647212+0000","last_became_active":"2024-05-30T17:04:26.644394+0000","last_became_peered":"2024-05-30T17:04:26.644394+0000","last_unstale":"2024-05-30T17:04:28.647212+0000","last_undegraded":"2024-05-30T17:04:28.647212+0000","last_fullsized":"2024-05-30T17:04:28.647212+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:32:48.916197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267245+0000","last_change":"2024-05-30T17:04:27.667231+0000","last_active":"2024-05-30T17:04:29.267245+0000","last_peered":"2024-05-30T17:04:29.267245+0000","last_clean":"2024-05-30T17:04:29.267245+0000","last_became_active":"2024-05-30T17:04:27.666778+0000","last_became_peered":"2024-05-30T17:04:27.666778+0000","last_unstale":"2024-05-30T17:04:29.267245+0000","last_undegraded":"2024-05-30T17:04:29.267245+0000","last_fullsized":"2024-05-30T17:04:29.267245+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:05:27.633461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267220+0000","last_change":"2024-05-30T17:04:26.648513+0000","last_active":"2024-05-30T17:04:29.267220+0000","last_peered":"2024-05-30T17:04:29.267220+0000","last_clean":"2024-05-30T17:04:29.267220+0000","last_became_active":"2024-05-30T17:04:26.648016+0000","last_became_peered":"2024-05-30T17:04:26.648016+0000","last_unstale":"2024-05-30T17:04:29.267220+0000","last_undegraded":"2024-05-30T17:04:29.267220+0000","last_fullsized":"2024-05-30T17:04:29.267220+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:19.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265410+0000","last_change":"2024-05-30T17:04:27.647201+0000","last_active":"2024-05-30T17:04:29.265410+0000","last_peered":"2024-05-30T17:04:29.265410+0000","last_clean":"2024-05-30T17:04:29.265410+0000","last_became_active":"2024-05-30T17:04:27.646842+0000","last_became_peered":"2024-05-30T17:04:27.646842+0000","last_unstale":"2024-05-30T17:04:29.265410+0000","last_undegraded":"2024-05-30T17:04:29.265410+0000","last_fullsized":"2024-05-30T17:04:29.265410+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:42.109985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265536+0000","last_change":"2024-05-30T17:04:26.643372+0000","last_active":"2024-05-30T17:04:29.265536+0000","last_peered":"2024-05-30T17:04:29.265536+0000","last_clean":"2024-05-30T17:04:29.265536+0000","last_became_active":"2024-05-30T17:04:26.641530+0000","last_became_peered":"2024-05-30T17:04:26.641530+0000","last_unstale":"2024-05-30T17:04:29.265536+0000","last_undegraded":"2024-05-30T17:04:29.265536+0000","last_fullsized":"2024-05-30T17:04:29.265536+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:28.821395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.647021+0000","last_change":"2024-05-30T17:04:27.663493+0000","last_active":"2024-05-30T17:04:28.647021+0000","last_peered":"2024-05-30T17:04:28.647021+0000","last_clean":"2024-05-30T17:04:28.647021+0000","last_became_active":"2024-05-30T17:04:27.662912+0000","last_became_peered":"2024-05-30T17:04:27.662912+0000","last_unstale":"2024-05-30T17:04:28.647021+0000","last_undegraded":"2024-05-30T17:04:28.647021+0000","last_fullsized":"2024-05-30T17:04:28.647021+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:12:24.226617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"130'8","reported_seq":22,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.647002+0000","last_change":"2024-05-30T17:04:26.651768+0000","last_active":"2024-05-30T17:04:28.647002+0000","last_peered":"2024-05-30T17:04:28.647002+0000","last_clean":"2024-05-30T17:04:28.647002+0000","last_became_active":"2024-05-30T17:04:26.651470+0000","last_became_peered":"2024-05-30T17:04:26.651470+0000","last_unstale":"2024-05-30T17:04:28.647002+0000","last_undegraded":"2024-05-30T17:04:28.647002+0000","last_fullsized":"2024-05-30T17:04:28.647002+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:51:21.096723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.647644+0000","last_change":"2024-05-30T17:04:27.656826+0000","last_active":"2024-05-30T17:04:28.647644+0000","last_peered":"2024-05-30T17:04:28.647644+0000","last_clean":"2024-05-30T17:04:28.647644+0000","last_became_active":"2024-05-30T17:04:27.656527+0000","last_became_peered":"2024-05-30T17:04:27.656527+0000","last_unstale":"2024-05-30T17:04:28.647644+0000","last_undegraded":"2024-05-30T17:04:28.647644+0000","last_fullsized":"2024-05-30T17:04:28.647644+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:53.659379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267973+0000","last_change":"2024-05-30T17:04:26.646106+0000","last_active":"2024-05-30T17:04:29.267973+0000","last_peered":"2024-05-30T17:04:29.267973+0000","last_clean":"2024-05-30T17:04:29.267973+0000","last_became_active":"2024-05-30T17:04:26.645435+0000","last_became_peered":"2024-05-30T17:04:26.645435+0000","last_unstale":"2024-05-30T17:04:29.267973+0000","last_undegraded":"2024-05-30T17:04:29.267973+0000","last_fullsized":"2024-05-30T17:04:29.267973+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:55.135303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267844+0000","last_change":"2024-05-30T17:04:27.666627+0000","last_active":"2024-05-30T17:04:29.267844+0000","last_peered":"2024-05-30T17:04:29.267844+0000","last_clean":"2024-05-30T17:04:29.267844+0000","last_became_active":"2024-05-30T17:04:27.666318+0000","last_became_peered":"2024-05-30T17:04:27.666318+0000","last_unstale":"2024-05-30T17:04:29.267844+0000","last_undegraded":"2024-05-30T17:04:29.267844+0000","last_fullsized":"2024-05-30T17:04:29.267844+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:45:56.513914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.644108+0000","last_change":"2024-05-30T17:04:26.649232+0000","last_active":"2024-05-30T17:04:28.644108+0000","last_peered":"2024-05-30T17:04:28.644108+0000","last_clean":"2024-05-30T17:04:28.644108+0000","last_became_active":"2024-05-30T17:04:26.648936+0000","last_became_peered":"2024-05-30T17:04:26.648936+0000","last_unstale":"2024-05-30T17:04:28.644108+0000","last_undegraded":"2024-05-30T17:04:28.644108+0000","last_fullsized":"2024-05-30T17:04:28.644108+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:05:44.049119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266652+0000","last_change":"2024-05-30T17:04:27.657488+0000","last_active":"2024-05-30T17:04:29.266652+0000","last_peered":"2024-05-30T17:04:29.266652+0000","last_clean":"2024-05-30T17:04:29.266652+0000","last_became_active":"2024-05-30T17:04:27.657216+0000","last_became_peered":"2024-05-30T17:04:27.657216+0000","last_unstale":"2024-05-30T17:04:29.266652+0000","last_undegraded":"2024-05-30T17:04:29.266652+0000","last_fullsized":"2024-05-30T17:04:29.266652+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:18.543050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.648354+0000","last_change":"2024-05-30T17:04:26.652397+0000","last_active":"2024-05-30T17:04:28.648354+0000","last_peered":"2024-05-30T17:04:28.648354+0000","last_clean":"2024-05-30T17:04:28.648354+0000","last_became_active":"2024-05-30T17:04:26.652083+0000","last_became_peered":"2024-05-30T17:04:26.652083+0000","last_unstale":"2024-05-30T17:04:28.648354+0000","last_undegraded":"2024-05-30T17:04:28.648354+0000","last_fullsized":"2024-05-30T17:04:28.648354+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:17.631736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265832+0000","last_change":"2024-05-30T17:04:27.649124+0000","last_active":"2024-05-30T17:04:29.265832+0000","last_peered":"2024-05-30T17:04:29.265832+0000","last_clean":"2024-05-30T17:04:29.265832+0000","last_became_active":"2024-05-30T17:04:27.648847+0000","last_became_peered":"2024-05-30T17:04:27.648847+0000","last_unstale":"2024-05-30T17:04:29.265832+0000","last_undegraded":"2024-05-30T17:04:29.265832+0000","last_fullsized":"2024-05-30T17:04:29.265832+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:42:59.091789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267572+0000","last_change":"2024-05-30T17:04:26.646336+0000","last_active":"2024-05-30T17:04:29.267572+0000","last_peered":"2024-05-30T17:04:29.267572+0000","last_clean":"2024-05-30T17:04:29.267572+0000","last_became_active":"2024-05-30T17:04:26.646025+0000","last_became_peered":"2024-05-30T17:04:26.646025+0000","last_unstale":"2024-05-30T17:04:29.267572+0000","last_undegraded":"2024-05-30T17:04:29.267572+0000","last_fullsized":"2024-05-30T17:04:29.267572+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:34.972669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267059+0000","last_change":"2024-05-30T17:04:27.654618+0000","last_active":"2024-05-30T17:04:29.267059+0000","last_peered":"2024-05-30T17:04:29.267059+0000","last_clean":"2024-05-30T17:04:29.267059+0000","last_became_active":"2024-05-30T17:04:27.653888+0000","last_became_peered":"2024-05-30T17:04:27.653888+0000","last_unstale":"2024-05-30T17:04:29.267059+0000","last_undegraded":"2024-05-30T17:04:29.267059+0000","last_fullsized":"2024-05-30T17:04:29.267059+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:34.447493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267488+0000","last_change":"2024-05-30T17:04:26.657719+0000","last_active":"2024-05-30T17:04:29.267488+0000","last_peered":"2024-05-30T17:04:29.267488+0000","last_clean":"2024-05-30T17:04:29.267488+0000","last_became_active":"2024-05-30T17:04:26.657452+0000","last_became_peered":"2024-05-30T17:04:26.657452+0000","last_unstale":"2024-05-30T17:04:29.267488+0000","last_undegraded":"2024-05-30T17:04:29.267488+0000","last_fullsized":"2024-05-30T17:04:29.267488+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:02.780429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.648338+0000","last_change":"2024-05-30T17:04:27.649752+0000","last_active":"2024-05-30T17:04:28.648338+0000","last_peered":"2024-05-30T17:04:28.648338+0000","last_clean":"2024-05-30T17:04:28.648338+0000","last_became_active":"2024-05-30T17:04:27.649442+0000","last_became_peered":"2024-05-30T17:04:27.649442+0000","last_unstale":"2024-05-30T17:04:28.648338+0000","last_undegraded":"2024-05-30T17:04:28.648338+0000","last_fullsized":"2024-05-30T17:04:28.648338+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:38:19.022224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266335+0000","last_change":"2024-05-30T17:04:26.645875+0000","last_active":"2024-05-30T17:04:29.266335+0000","last_peered":"2024-05-30T17:04:29.266335+0000","last_clean":"2024-05-30T17:04:29.266335+0000","last_became_active":"2024-05-30T17:04:26.645583+0000","last_became_peered":"2024-05-30T17:04:26.645583+0000","last_unstale":"2024-05-30T17:04:29.266335+0000","last_undegraded":"2024-05-30T17:04:29.266335+0000","last_fullsized":"2024-05-30T17:04:29.266335+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:03.486308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265690+0000","last_change":"2024-05-30T17:04:27.652007+0000","last_active":"2024-05-30T17:04:29.265690+0000","last_peered":"2024-05-30T17:04:29.265690+0000","last_clean":"2024-05-30T17:04:29.265690+0000","last_became_active":"2024-05-30T17:04:27.651701+0000","last_became_peered":"2024-05-30T17:04:27.651701+0000","last_unstale":"2024-05-30T17:04:29.265690+0000","last_undegraded":"2024-05-30T17:04:29.265690+0000","last_fullsized":"2024-05-30T17:04:29.265690+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:57.885952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265914+0000","last_change":"2024-05-30T17:04:26.647421+0000","last_active":"2024-05-30T17:04:29.265914+0000","last_peered":"2024-05-30T17:04:29.265914+0000","last_clean":"2024-05-30T17:04:29.265914+0000","last_became_active":"2024-05-30T17:04:26.647155+0000","last_became_peered":"2024-05-30T17:04:26.647155+0000","last_unstale":"2024-05-30T17:04:29.265914+0000","last_undegraded":"2024-05-30T17:04:29.265914+0000","last_fullsized":"2024-05-30T17:04:29.265914+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:59:52.705838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.674484+0000","last_change":"2024-05-30T17:04:27.667584+0000","last_active":"2024-05-30T17:04:28.674484+0000","last_peered":"2024-05-30T17:04:28.674484+0000","last_clean":"2024-05-30T17:04:28.674484+0000","last_became_active":"2024-05-30T17:04:27.667268+0000","last_became_peered":"2024-05-30T17:04:27.667268+0000","last_unstale":"2024-05-30T17:04:28.674484+0000","last_undegraded":"2024-05-30T17:04:28.674484+0000","last_fullsized":"2024-05-30T17:04:28.674484+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:45.213871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.643623+0000","last_change":"2024-05-30T17:04:26.650930+0000","last_active":"2024-05-30T17:04:28.643623+0000","last_peered":"2024-05-30T17:04:28.643623+0000","last_clean":"2024-05-30T17:04:28.643623+0000","last_became_active":"2024-05-30T17:04:26.650616+0000","last_became_peered":"2024-05-30T17:04:26.650616+0000","last_unstale":"2024-05-30T17:04:28.643623+0000","last_undegraded":"2024-05-30T17:04:28.643623+0000","last_fullsized":"2024-05-30T17:04:28.643623+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:44.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.648603+0000","last_change":"2024-05-30T17:04:27.664544+0000","last_active":"2024-05-30T17:04:28.648603+0000","last_peered":"2024-05-30T17:04:28.648603+0000","last_clean":"2024-05-30T17:04:28.648603+0000","last_became_active":"2024-05-30T17:04:27.664180+0000","last_became_peered":"2024-05-30T17:04:27.664180+0000","last_unstale":"2024-05-30T17:04:28.648603+0000","last_undegraded":"2024-05-30T17:04:28.648603+0000","last_fullsized":"2024-05-30T17:04:28.648603+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:59.508295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267745+0000","last_change":"2024-05-30T17:04:26.653129+0000","last_active":"2024-05-30T17:04:29.267745+0000","last_peered":"2024-05-30T17:04:29.267745+0000","last_clean":"2024-05-30T17:04:29.267745+0000","last_became_active":"2024-05-30T17:04:26.652234+0000","last_became_peered":"2024-05-30T17:04:26.652234+0000","last_unstale":"2024-05-30T17:04:29.267745+0000","last_undegraded":"2024-05-30T17:04:29.267745+0000","last_fullsized":"2024-05-30T17:04:29.267745+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:12.851756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267612+0000","last_change":"2024-05-30T17:04:27.656246+0000","last_active":"2024-05-30T17:04:29.267612+0000","last_peered":"2024-05-30T17:04:29.267612+0000","last_clean":"2024-05-30T17:04:29.267612+0000","last_became_active":"2024-05-30T17:04:27.655926+0000","last_became_peered":"2024-05-30T17:04:27.655926+0000","last_unstale":"2024-05-30T17:04:29.267612+0000","last_undegraded":"2024-05-30T17:04:29.267612+0000","last_fullsized":"2024-05-30T17:04:29.267612+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:03.789542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"131'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.675002+0000","last_change":"2024-05-30T17:04:26.649574+0000","last_active":"2024-05-30T17:04:28.675002+0000","last_peered":"2024-05-30T17:04:28.675002+0000","last_clean":"2024-05-30T17:04:28.675002+0000","last_became_active":"2024-05-30T17:04:26.648998+0000","last_became_peered":"2024-05-30T17:04:26.648998+0000","last_unstale":"2024-05-30T17:04:28.675002+0000","last_undegraded":"2024-05-30T17:04:28.675002+0000","last_fullsized":"2024-05-30T17:04:28.675002+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:35:25.197491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265672+0000","last_change":"2024-05-30T17:04:27.654582+0000","last_active":"2024-05-30T17:04:29.265672+0000","last_peered":"2024-05-30T17:04:29.265672+0000","last_clean":"2024-05-30T17:04:29.265672+0000","last_became_active":"2024-05-30T17:04:27.654295+0000","last_became_peered":"2024-05-30T17:04:27.654295+0000","last_unstale":"2024-05-30T17:04:29.265672+0000","last_undegraded":"2024-05-30T17:04:29.265672+0000","last_fullsized":"2024-05-30T17:04:29.265672+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:35.981782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266100+0000","last_change":"2024-05-30T17:04:26.647328+0000","last_active":"2024-05-30T17:04:29.266100+0000","last_peered":"2024-05-30T17:04:29.266100+0000","last_clean":"2024-05-30T17:04:29.266100+0000","last_became_active":"2024-05-30T17:04:26.647058+0000","last_became_peered":"2024-05-30T17:04:26.647058+0000","last_unstale":"2024-05-30T17:04:29.266100+0000","last_undegraded":"2024-05-30T17:04:29.266100+0000","last_fullsized":"2024-05-30T17:04:29.266100+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:27:17.347396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.647969+0000","last_change":"2024-05-30T17:04:27.657344+0000","last_active":"2024-05-30T17:04:28.647969+0000","last_peered":"2024-05-30T17:04:28.647969+0000","last_clean":"2024-05-30T17:04:28.647969+0000","last_became_active":"2024-05-30T17:04:27.657041+0000","last_became_peered":"2024-05-30T17:04:27.657041+0000","last_unstale":"2024-05-30T17:04:28.647969+0000","last_undegraded":"2024-05-30T17:04:28.647969+0000","last_fullsized":"2024-05-30T17:04:28.647969+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:46.552415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.643931+0000","last_change":"2024-05-30T17:04:26.655225+0000","last_active":"2024-05-30T17:04:28.643931+0000","last_peered":"2024-05-30T17:04:28.643931+0000","last_clean":"2024-05-30T17:04:28.643931+0000","last_became_active":"2024-05-30T17:04:26.654383+0000","last_became_peered":"2024-05-30T17:04:26.654383+0000","last_unstale":"2024-05-30T17:04:28.643931+0000","last_undegraded":"2024-05-30T17:04:28.643931+0000","last_fullsized":"2024-05-30T17:04:28.643931+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:36:35.798472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.674528+0000","last_change":"2024-05-30T17:04:27.659619+0000","last_active":"2024-05-30T17:04:28.674528+0000","last_peered":"2024-05-30T17:04:28.674528+0000","last_clean":"2024-05-30T17:04:28.674528+0000","last_became_active":"2024-05-30T17:04:27.659316+0000","last_became_peered":"2024-05-30T17:04:27.659316+0000","last_unstale":"2024-05-30T17:04:28.674528+0000","last_undegraded":"2024-05-30T17:04:28.674528+0000","last_fullsized":"2024-05-30T17:04:28.674528+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:29:40.214450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265695+0000","last_change":"2024-05-30T17:04:26.643654+0000","last_active":"2024-05-30T17:04:29.265695+0000","last_peered":"2024-05-30T17:04:29.265695+0000","last_clean":"2024-05-30T17:04:29.265695+0000","last_became_active":"2024-05-30T17:04:26.642798+0000","last_became_peered":"2024-05-30T17:04:26.642798+0000","last_unstale":"2024-05-30T17:04:29.265695+0000","last_undegraded":"2024-05-30T17:04:29.265695+0000","last_fullsized":"2024-05-30T17:04:29.265695+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:22:19.720162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.267533+0000","last_change":"2024-05-30T17:04:27.662540+0000","last_active":"2024-05-30T17:04:29.267533+0000","last_peered":"2024-05-30T17:04:29.267533+0000","last_clean":"2024-05-30T17:04:29.267533+0000","last_became_active":"2024-05-30T17:04:27.662294+0000","last_became_peered":"2024-05-30T17:04:27.662294+0000","last_unstale":"2024-05-30T17:04:29.267533+0000","last_undegraded":"2024-05-30T17:04:29.267533+0000","last_fullsized":"2024-05-30T17:04:29.267533+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:03.093546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.674684+0000","last_change":"2024-05-30T17:04:26.650407+0000","last_active":"2024-05-30T17:04:28.674684+0000","last_peered":"2024-05-30T17:04:28.674684+0000","last_clean":"2024-05-30T17:04:28.674684+0000","last_became_active":"2024-05-30T17:04:26.650063+0000","last_became_peered":"2024-05-30T17:04:26.650063+0000","last_unstale":"2024-05-30T17:04:28.674684+0000","last_undegraded":"2024-05-30T17:04:28.674684+0000","last_fullsized":"2024-05-30T17:04:28.674684+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:58.499182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266816+0000","last_change":"2024-05-30T17:04:27.648839+0000","last_active":"2024-05-30T17:04:29.266816+0000","last_peered":"2024-05-30T17:04:29.266816+0000","last_clean":"2024-05-30T17:04:29.266816+0000","last_became_active":"2024-05-30T17:04:27.648558+0000","last_became_peered":"2024-05-30T17:04:27.648558+0000","last_unstale":"2024-05-30T17:04:29.266816+0000","last_undegraded":"2024-05-30T17:04:29.266816+0000","last_fullsized":"2024-05-30T17:04:29.266816+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:52.862600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.266032+0000","last_change":"2024-05-30T17:04:26.646155+0000","last_active":"2024-05-30T17:04:29.266032+0000","last_peered":"2024-05-30T17:04:29.266032+0000","last_clean":"2024-05-30T17:04:29.266032+0000","last_became_active":"2024-05-30T17:04:26.645855+0000","last_became_peered":"2024-05-30T17:04:26.645855+0000","last_unstale":"2024-05-30T17:04:29.266032+0000","last_undegraded":"2024-05-30T17:04:29.266032+0000","last_fullsized":"2024-05-30T17:04:29.266032+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:51.017861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:29.265424+0000","last_change":"2024-05-30T17:04:27.657377+0000","last_active":"2024-05-30T17:04:29.265424+0000","last_peered":"2024-05-30T17:04:29.265424+0000","last_clean":"2024-05-30T17:04:29.265424+0000","last_became_active":"2024-05-30T17:04:27.657110+0000","last_became_peered":"2024-05-30T17:04:27.657110+0000","last_unstale":"2024-05-30T17:04:29.265424+0000","last_undegraded":"2024-05-30T17:04:29.265424+0000","last_fullsized":"2024-05-30T17:04:29.265424+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:03.789542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.643747+0000","last_change":"2024-05-30T17:04:26.646414+0000","last_active":"2024-05-30T17:04:28.643747+0000","last_peered":"2024-05-30T17:04:28.643747+0000","last_clean":"2024-05-30T17:04:28.643747+0000","last_became_active":"2024-05-30T17:04:26.646125+0000","last_became_peered":"2024-05-30T17:04:26.646125+0000","last_unstale":"2024-05-30T17:04:28.643747+0000","last_undegraded":"2024-05-30T17:04:28.643747+0000","last_fullsized":"2024-05-30T17:04:28.643747+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:29:39.205337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.674551+0000","last_change":"2024-05-30T17:04:27.668983+0000","last_active":"2024-05-30T17:04:28.674551+0000","last_peered":"2024-05-30T17:04:28.674551+0000","last_clean":"2024-05-30T17:04:28.674551+0000","last_became_active":"2024-05-30T17:04:27.668009+0000","last_became_peered":"2024-05-30T17:04:27.668009+0000","last_unstale":"2024-05-30T17:04:28.674551+0000","last_undegraded":"2024-05-30T17:04:28.674551+0000","last_fullsized":"2024-05-30T17:04:28.674551+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:05:39.653558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.674569+0000","last_change":"2024-05-30T17:04:26.656301+0000","last_active":"2024-05-30T17:04:28.674569+0000","last_peered":"2024-05-30T17:04:28.674569+0000","last_clean":"2024-05-30T17:04:28.674569+0000","last_became_active":"2024-05-30T17:04:26.655900+0000","last_became_peered":"2024-05-30T17:04:26.655900+0000","last_unstale":"2024-05-30T17:04:28.674569+0000","last_undegraded":"2024-05-30T17:04:28.674569+0000","last_fullsized":"2024-05-30T17:04:28.674569+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:18.390768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":378,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-05-30T17:04:28.674377+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:04:28.674377+0000","last_peered":"2024-05-30T17:04:28.674377+0000","last_clean":"2024-05-30T17:04:28.674377+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:04:28.674377+0000","last_undegraded":"2024-05-30T17:04:28.674377+0000","last_fullsized":"2024-05-30T17:04:28.674377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509630,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127716,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244124,"statfs":{"total":96636764160,"available":96505982976,"internally_reserved":0,"allocated":2244608,"data_stored":1308493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509631,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127124,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244716,"statfs":{"total":96636764160,"available":96506589184,"internally_reserved":0,"allocated":1638400,"data_stored":717487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509631,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64652,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94307188,"statfs":{"total":96636764160,"available":96570560512,"internally_reserved":0,"allocated":1634304,"data_stored":715987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509632,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109068,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94262772,"statfs":{"total":96636764160,"available":96525078528,"internally_reserved":0,"allocated":1630208,"data_stored":715945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509631,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145168,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226672,"statfs":{"total":96636764160,"available":96488112128,"internally_reserved":0,"allocated":1634304,"data_stored":716491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509631,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145160,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226680,"statfs":{"total":96636764160,"available":96488120320,"internally_reserved":0,"allocated":1626112,"data_stored":715875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509631,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141580,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94230260,"statfs":{"total":96636764160,"available":96491786240,"internally_reserved":0,"allocated":2220032,"data_stored":1306243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542335,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131280,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240560,"statfs":{"total":96636764160,"available":96502333440,"internally_reserved":0,"allocated":1634304,"data_stored":716035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:04:36.731 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T17:04:36.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T17:04:36.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.913+0000 7f0854400640 1 Processor -- start 2024-05-30T17:04:36.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.913+0000 7f0854400640 1 -- start start 2024-05-30T17:04:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.913+0000 7f0854400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f084c159100 0x7f084c06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0854400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f084c15c010 0x7f084c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0854400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f084c0b52d0 con 0x7f084c0b44e0 2024-05-30T17:04:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0854400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f084c0b4a30 con 0x7f084c159100 2024-05-30T17:04:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0854400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f084c0b4d10 con 0x7f084c15c010 2024-05-30T17:04:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0851a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f084c159100 0x7f084c06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0851a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f084c159100 0x7f084c06e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49568/0 (socket says 172.21.15.59:49568) 2024-05-30T17:04:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0851a00640 1 -- 172.21.15.59:0/2943610800 learned_addr learned my addr 172.21.15.59:0/2943610800 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:36.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0852400640 1 --2- 172.21.15.59:0/2943610800 >> v2:172.21.15.107:3300/0 conn(0x7f084c15c010 0x7f084c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:36.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0851a00640 1 -- 172.21.15.59:0/2943610800 >> v2:172.21.15.107:3300/0 conn(0x7f084c15c010 msgr2=0x7f084c15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:36.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0851a00640 1 --2- 172.21.15.59:0/2943610800 >> v2:172.21.15.107:3300/0 conn(0x7f084c15c010 0x7f084c15c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:36.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0851a00640 1 -- 172.21.15.59:0/2943610800 >> v1:172.21.15.107:6789/0 conn(0x7f084c0b44e0 legacy=0x7f084c15efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:36.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0851a00640 1 -- 172.21.15.59:0/2943610800 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084c0b4ff0 con 0x7f084c159100 2024-05-30T17:04:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f0851a00640 1 --2- 172.21.15.59:0/2943610800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084c159100 0x7f084c06e590 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f084c160040 tx=0x7f084001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1acc9a7072626d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f084be00640 1 -- 172.21.15.59:0/2943610800 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08400b0070 con 0x7f084c159100 2024-05-30T17:04:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f084be00640 1 -- 172.21.15.59:0/2943610800 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08400ab600 con 0x7f084c159100 2024-05-30T17:04:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.917+0000 7f084be00640 1 -- 172.21.15.59:0/2943610800 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08400ab9d0 con 0x7f084c159100 2024-05-30T17:04:36.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 -- 172.21.15.59:0/2943610800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084c159100 msgr2=0x7f084c06e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:36.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 --2- 172.21.15.59:0/2943610800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084c159100 0x7f084c06e590 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f084c160040 tx=0x7f084001c450 comp rx=0 tx=0).stop 2024-05-30T17:04:36.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 -- 172.21.15.59:0/2943610800 shutdown_connections 2024-05-30T17:04:36.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 --2- 172.21.15.59:0/2943610800 >> v2:172.21.15.107:3300/0 conn(0x7f084c15c010 0x7f084c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:36.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 --2- 172.21.15.59:0/2943610800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084c159100 0x7f084c06e590 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:36.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 -- 172.21.15.59:0/2943610800 >> 172.21.15.59:0/2943610800 conn(0x7f084c06bdb0 msgr2=0x7f084c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:36.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 -- 172.21.15.59:0/2943610800 shutdown_connections 2024-05-30T17:04:36.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 -- 172.21.15.59:0/2943610800 wait complete. 2024-05-30T17:04:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 Processor -- start 2024-05-30T17:04:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 -- start start 2024-05-30T17:04:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084c0b44e0 0x7f084c0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f084c159100 0x7f084c157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f084c15c010 0x7f084c145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f084c1682c0 con 0x7f084c0b44e0 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f084c168140 con 0x7f084c159100 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0854400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f084c168440 con 0x7f084c15c010 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0851a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084c0b44e0 0x7f084c0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0851a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084c0b44e0 0x7f084c0b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49570/0 (socket says 172.21.15.59:49570) 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0851a00640 1 -- 172.21.15.59:0/3587344539 learned_addr learned my addr 172.21.15.59:0/3587344539 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0852400640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f084c15c010 0x7f084c145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0851000640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f084c159100 0x7f084c157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0851a00640 1 -- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f084c15c010 msgr2=0x7f084c145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0851a00640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f084c15c010 0x7f084c145240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0851a00640 1 -- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f084c159100 msgr2=0x7f084c157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0851a00640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f084c159100 0x7f084c157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.921+0000 7f0851a00640 1 -- 172.21.15.59:0/3587344539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084c155ba0 con 0x7f084c0b44e0 2024-05-30T17:04:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.925+0000 7f0851a00640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084c0b44e0 0x7f084c0b18b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f084001a080 tx=0x7f08400191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.925+0000 7f0849600640 1 -- 172.21.15.59:0/3587344539 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08400b9070 con 0x7f084c0b44e0 2024-05-30T17:04:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.925+0000 7f0849600640 1 -- 172.21.15.59:0/3587344539 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08400b4420 con 0x7f084c0b44e0 2024-05-30T17:04:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.925+0000 7f0849600640 1 -- 172.21.15.59:0/3587344539 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08400b0040 con 0x7f084c0b44e0 2024-05-30T17:04:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.925+0000 7f0854400640 1 -- 172.21.15.59:0/3587344539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f084c155e80 con 0x7f084c0b44e0 2024-05-30T17:04:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.925+0000 7f0854400640 1 -- 172.21.15.59:0/3587344539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f084c0ccc90 con 0x7f084c0b44e0 2024-05-30T17:04:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.925+0000 7f0854400640 1 -- 172.21.15.59:0/3587344539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f084c068a90 con 0x7f084c0b44e0 2024-05-30T17:04:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.925+0000 7f0849600640 1 -- 172.21.15.59:0/3587344539 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f08400b47d0 con 0x7f084c0b44e0 2024-05-30T17:04:36.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.925+0000 7f0849600640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f082c069fd0 0x7f082c06c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:36.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.929+0000 7f0849600640 1 -- 172.21.15.59:0/3587344539 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7f084011ea90 con 0x7f084c0b44e0 2024-05-30T17:04:36.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.929+0000 7f0851000640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f082c069fd0 0x7f082c06c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:36.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.929+0000 7f0851000640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f082c069fd0 0x7f082c06c490 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f084c152970 tx=0x7f0838008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:36.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:36.933+0000 7f0849600640 1 -- 172.21.15.59:0/3587344539 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f08400160d0 con 0x7f084c0b44e0 2024-05-30T17:04:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.153+0000 7f0854400640 1 -- 172.21.15.59:0/3587344539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f084c0b29e0 con 0x7f084c0b44e0 2024-05-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.157+0000 7f0849600640 1 -- 172.21.15.59:0/3587344539 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f08400f0ab0 con 0x7f084c0b44e0 2024-05-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-05-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDGrVhmNMkHAxAA/vNOf3tHHoRRvrjHz/iYJA== 2024-05-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-05-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-05-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-05-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.161+0000 7f0854400640 1 -- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f082c069fd0 msgr2=0x7f082c06c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.161+0000 7f0854400640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f082c069fd0 0x7f082c06c490 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f084c152970 tx=0x7f0838008040 comp rx=0 tx=0).stop 2024-05-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.161+0000 7f0854400640 1 -- 172.21.15.59:0/3587344539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084c0b44e0 msgr2=0x7f084c0b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.161+0000 7f0854400640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084c0b44e0 0x7f084c0b18b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f084001a080 tx=0x7f08400191f0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.161+0000 7f0854400640 1 -- 172.21.15.59:0/3587344539 shutdown_connections 2024-05-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.161+0000 7f0854400640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f082c069fd0 0x7f082c06c490 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.161+0000 7f0854400640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f084c15c010 0x7f084c145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.161+0000 7f0854400640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f084c159100 0x7f084c157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.161+0000 7f0854400640 1 --2- 172.21.15.59:0/3587344539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084c0b44e0 0x7f084c0b18b0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.161+0000 7f0854400640 1 -- 172.21.15.59:0/3587344539 >> 172.21.15.59:0/3587344539 conn(0x7f084c06bdb0 msgr2=0x7f084c0aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.161+0000 7f0854400640 1 -- 172.21.15.59:0/3587344539 shutdown_connections 2024-05-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.161+0000 7f0854400640 1 -- 172.21.15.59:0/3587344539 wait complete. 2024-05-30T17:04:37.180 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.321+0000 7f579ee00640 1 Processor -- start 2024-05-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.321+0000 7f579ee00640 1 -- start start 2024-05-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.321+0000 7f579ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57980af720 0x7f579815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.321+0000 7f579ee00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57980d0560 0x7f57980d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.321+0000 7f579ee00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579815f060 con 0x7f579806e900 2024-05-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.321+0000 7f579ee00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f57980afb00 con 0x7f57980d0560 2024-05-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.321+0000 7f579ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f579815c270 con 0x7f57980af720 2024-05-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.321+0000 7f579ce00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57980d0560 0x7f57980d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.321+0000 7f578fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f579806e900 0x7f579815f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54058/0 (socket says 172.21.15.59:54058) 2024-05-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.321+0000 7f578fe00640 1 -- 172.21.15.59:0/1540180994 learned_addr learned my addr 172.21.15.59:0/1540180994 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.321+0000 7f5797e00640 1 --2- 172.21.15.59:0/1540180994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57980af720 0x7f579815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ce00640 1 -- 172.21.15.59:0/1540180994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57980af720 msgr2=0x7f579815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ce00640 1 --2- 172.21.15.59:0/1540180994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57980af720 0x7f579815b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ce00640 1 -- 172.21.15.59:0/1540180994 >> v1:172.21.15.59:6789/0 conn(0x7f579806e900 legacy=0x7f579815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ce00640 1 -- 172.21.15.59:0/1540180994 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579815ff00 con 0x7f57980d0560 2024-05-30T17:04:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ce00640 1 --2- 172.21.15.59:0/1540180994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57980d0560 0x7f57980d0a10 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f5790009d90 tx=0x7f579001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54d4b0dd5c357be server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f5797400640 1 -- 172.21.15.59:0/1540180994 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57900b2070 con 0x7f57980d0560 2024-05-30T17:04:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f5797400640 1 -- 172.21.15.59:0/1540180994 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57900a5920 con 0x7f57980d0560 2024-05-30T17:04:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f5797400640 1 -- 172.21.15.59:0/1540180994 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57900a5cf0 con 0x7f57980d0560 2024-05-30T17:04:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ee00640 1 -- 172.21.15.59:0/1540180994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57980d0560 msgr2=0x7f57980d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ee00640 1 --2- 172.21.15.59:0/1540180994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57980d0560 0x7f57980d0a10 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f5790009d90 tx=0x7f579001c970 comp rx=0 tx=0).stop 2024-05-30T17:04:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ee00640 1 -- 172.21.15.59:0/1540180994 shutdown_connections 2024-05-30T17:04:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ee00640 1 --2- 172.21.15.59:0/1540180994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57980d0560 0x7f57980d0a10 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ee00640 1 --2- 172.21.15.59:0/1540180994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57980af720 0x7f579815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ee00640 1 -- 172.21.15.59:0/1540180994 >> 172.21.15.59:0/1540180994 conn(0x7f57980b22d0 msgr2=0x7f57980b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ee00640 1 -- 172.21.15.59:0/1540180994 shutdown_connections 2024-05-30T17:04:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.325+0000 7f579ee00640 1 -- 172.21.15.59:0/1540180994 wait complete. 2024-05-30T17:04:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f579ee00640 1 Processor -- start 2024-05-30T17:04:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f579ee00640 1 -- start start 2024-05-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f579ee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579806e900 0x7f57981534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f579ee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57980af720 0x7f5798156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f579ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57980d0560 0x7f5798156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f579ee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5798073150 con 0x7f579806e900 2024-05-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f579ee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f579815c830 con 0x7f57980af720 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f579ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f57980732d0 con 0x7f57980d0560 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f5797e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579806e900 0x7f57981534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f5797e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579806e900 0x7f57981534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49578/0 (socket says 172.21.15.59:49578) 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f5797e00640 1 -- 172.21.15.59:0/3648200828 learned_addr learned my addr 172.21.15.59:0/3648200828 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f579ce00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57980d0560 0x7f5798156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f5797e00640 1 -- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57980d0560 msgr2=0x7f5798156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f5797e00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57980d0560 0x7f5798156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f578fe00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57980af720 0x7f5798156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f5797e00640 1 -- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57980af720 msgr2=0x7f5798156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f5797e00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57980af720 0x7f5798156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f5797e00640 1 -- 172.21.15.59:0/3648200828 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579809d9f0 con 0x7f579806e900 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f579ce00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57980d0560 0x7f5798156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f578fe00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57980af720 0x7f5798156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f5797e00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579806e900 0x7f57981534c0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f578800d620 tx=0x7f578800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f5794c00640 1 -- 172.21.15.59:0/3648200828 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57880125f0 con 0x7f579806e900 2024-05-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f5794c00640 1 -- 172.21.15.59:0/3648200828 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5788019070 con 0x7f579806e900 2024-05-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f5794c00640 1 -- 172.21.15.59:0/3648200828 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57880129b0 con 0x7f579806e900 2024-05-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f579ee00640 1 -- 172.21.15.59:0/3648200828 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579809ce70 con 0x7f579806e900 2024-05-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.329+0000 7f579ee00640 1 -- 172.21.15.59:0/3648200828 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f579809d430 con 0x7f579806e900 2024-05-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.333+0000 7f579ee00640 1 -- 172.21.15.59:0/3648200828 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5798068a90 con 0x7f579806e900 2024-05-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.333+0000 7f5794c00640 1 -- 172.21.15.59:0/3648200828 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f5788012b50 con 0x7f579806e900 2024-05-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.333+0000 7f5794c00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5774069fa0 0x7f577406c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.333+0000 7f5794c00640 1 -- 172.21.15.59:0/3648200828 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7f5788085d00 con 0x7f579806e900 2024-05-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.333+0000 7f578fe00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5774069fa0 0x7f577406c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.337+0000 7f578fe00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5774069fa0 0x7f577406c460 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f5780007fd0 tx=0x7f5780009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.337+0000 7f5794c00640 1 -- 172.21.15.59:0/3648200828 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5788057d20 con 0x7f579806e900 2024-05-30T17:04:37.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.537+0000 7f579ee00640 1 -- 172.21.15.59:0/3648200828 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5798073b50 con 0x7f579806e900 2024-05-30T17:04:37.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.537+0000 7f5794c00640 1 -- 172.21.15.59:0/3648200828 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5186 (secure 0 0 0) 0x7f5788057620 con 0x7f579806e900 2024-05-30T17:04:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:04:37.538 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3073990640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3073990640},{"type":"v1","addr":"172.21.15.107:6836","nonce":3073990640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1431726734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1431726734},{"type":"v1","addr":"172.21.15.107:6837","nonce":1431726734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":8988,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/410571111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":410571111},{"type":"v1","addr":"172.21.15.59:6834","nonce":410571111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:04:27.043818+0000","modified":"2024-05-30T17:04:30.067824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8991},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8991":{"gid":8991,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/1040424272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1040424272},{"type":"v1","addr":"172.21.15.59:6835","nonce":1040424272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8991,"qdb_cluster":[8991]},"id":9}]} 2024-05-30T17:04:37.539 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 81 2024-05-30T17:04:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.541+0000 7f579ee00640 1 -- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5774069fa0 msgr2=0x7f577406c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.541+0000 7f579ee00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5774069fa0 0x7f577406c460 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f5780007fd0 tx=0x7f5780009040 comp rx=0 tx=0).stop 2024-05-30T17:04:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.541+0000 7f579ee00640 1 -- 172.21.15.59:0/3648200828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579806e900 msgr2=0x7f57981534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.541+0000 7f579ee00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579806e900 0x7f57981534c0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f578800d620 tx=0x7f578800dae0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.541+0000 7f579ee00640 1 -- 172.21.15.59:0/3648200828 shutdown_connections 2024-05-30T17:04:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.541+0000 7f579ee00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f5774069fa0 0x7f577406c460 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.541+0000 7f579ee00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57980d0560 0x7f5798156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.541+0000 7f579ee00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57980af720 0x7f5798156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.541+0000 7f579ee00640 1 --2- 172.21.15.59:0/3648200828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579806e900 0x7f57981534c0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:37.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.541+0000 7f579ee00640 1 -- 172.21.15.59:0/3648200828 >> 172.21.15.59:0/3648200828 conn(0x7f57980b22d0 msgr2=0x7f57980b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:37.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.541+0000 7f579ee00640 1 -- 172.21.15.59:0/3648200828 shutdown_connections 2024-05-30T17:04:37.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:37.541+0000 7f579ee00640 1 -- 172.21.15.59:0/3648200828 wait complete. 2024-05-30T17:04:37.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T17:04:27.043818+0000', 'modified': '2024-05-30T17:04:30.067824+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8991}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8991': {'gid': 8991, 'name': 'a', 'rank': 0, 'incarnation': 77, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/1040424272', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 1040424272}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 1040424272}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8991, 'qdb_cluster': [8991]} 2024-05-30T17:04:37.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T17:04:37.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.105+0000 7fa499a00640 1 Processor -- start 2024-05-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.105+0000 7fa499a00640 1 -- start start 2024-05-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.109+0000 7fa499a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa494159df0 0x7fa4940ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.109+0000 7fa499a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49415d730 con 0x7fa49415a1d0 2024-05-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.109+0000 7fa499a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4940b3370 con 0x7fa4940b3e50 2024-05-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.109+0000 7fa499a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa4940b3650 con 0x7fa494159df0 2024-05-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.109+0000 7fa48be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa49415a1d0 0x7fa49415ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54066/0 (socket says 172.21.15.59:54066) 2024-05-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.109+0000 7fa492a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa494159df0 0x7fa4940ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.109+0000 7fa48be00640 1 -- 172.21.15.59:0/2517052939 learned_addr learned my addr 172.21.15.59:0/2517052939 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:38.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.109+0000 7fa492a00640 1 -- 172.21.15.59:0/2517052939 >> v1:172.21.15.107:6789/0 conn(0x7fa4940b3e50 legacy=0x7fa49415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:38.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.109+0000 7fa492a00640 1 -- 172.21.15.59:0/2517052939 >> v1:172.21.15.59:6789/0 conn(0x7fa49415a1d0 legacy=0x7fa49415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.109+0000 7fa492a00640 1 -- 172.21.15.59:0/2517052939 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4940b3930 con 0x7fa494159df0 2024-05-30T17:04:38.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.109+0000 7fa492000640 1 -- 172.21.15.59:0/2517052939 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1822416043 0 0) 0x7fa49415d730 con 0x7fa49415a1d0 2024-05-30T17:04:38.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa492a00640 1 --2- 172.21.15.59:0/2517052939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa494159df0 0x7fa4940ad1b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fa4840097c0 tx=0x7fa48401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89688182b27d8fb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa492000640 1 -- 172.21.15.59:0/2517052939 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840b0070 con 0x7fa494159df0 2024-05-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa492000640 1 -- 172.21.15.59:0/2517052939 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4840ab600 con 0x7fa494159df0 2024-05-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa492000640 1 -- 172.21.15.59:0/2517052939 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840ab9d0 con 0x7fa494159df0 2024-05-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 -- 172.21.15.59:0/2517052939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa494159df0 msgr2=0x7fa4940ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 --2- 172.21.15.59:0/2517052939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa494159df0 0x7fa4940ad1b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fa4840097c0 tx=0x7fa48401c4a0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 -- 172.21.15.59:0/2517052939 shutdown_connections 2024-05-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 --2- 172.21.15.59:0/2517052939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa494159df0 0x7fa4940ad1b0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 -- 172.21.15.59:0/2517052939 >> 172.21.15.59:0/2517052939 conn(0x7fa4940b22d0 msgr2=0x7fa4940b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 -- 172.21.15.59:0/2517052939 shutdown_connections 2024-05-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 -- 172.21.15.59:0/2517052939 wait complete. 2024-05-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 Processor -- start 2024-05-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 -- start start 2024-05-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4940b3e50 0x7fa494165f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa494159df0 0x7fa49415f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa49415a1d0 0x7fa4941471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa49416a7a0 con 0x7fa4940b3e50 2024-05-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa49416a620 con 0x7fa494159df0 2024-05-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa499a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa49416a920 con 0x7fa49415a1d0 2024-05-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa492a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4940b3e50 0x7fa494165f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa492a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4940b3e50 0x7fa494165f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49600/0 (socket says 172.21.15.59:49600) 2024-05-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa492a00640 1 -- 172.21.15.59:0/585124808 learned_addr learned my addr 172.21.15.59:0/585124808 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa48be00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa494159df0 0x7fa49415f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.113+0000 7fa493400640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa49415a1d0 0x7fa4941471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa492a00640 1 -- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa49415a1d0 msgr2=0x7fa4941471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa492a00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa49415a1d0 0x7fa4941471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa492a00640 1 -- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa494159df0 msgr2=0x7fa49415f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa492a00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa494159df0 0x7fa49415f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa492a00640 1 -- 172.21.15.59:0/585124808 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa494166890 con 0x7fa4940b3e50 2024-05-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa48be00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa494159df0 0x7fa49415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa492a00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4940b3e50 0x7fa494165f90 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa4840ae040 tx=0x7fa48401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa48aa00640 1 -- 172.21.15.59:0/585124808 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840b0050 con 0x7fa4940b3e50 2024-05-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa48aa00640 1 -- 172.21.15.59:0/585124808 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4840bc070 con 0x7fa4940b3e50 2024-05-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa48aa00640 1 -- 172.21.15.59:0/585124808 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840aae20 con 0x7fa4940b3e50 2024-05-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa499a00640 1 -- 172.21.15.59:0/585124808 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa494166b70 con 0x7fa4940b3e50 2024-05-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa499a00640 1 -- 172.21.15.59:0/585124808 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa494156690 con 0x7fa4940b3e50 2024-05-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa48aa00640 1 -- 172.21.15.59:0/585124808 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fa4840ab440 con 0x7fa4940b3e50 2024-05-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.117+0000 7fa48aa00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa470069fa0 0x7fa47006c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa48aa00640 1 -- 172.21.15.59:0/585124808 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7fa484120470 con 0x7fa4940b3e50 2024-05-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 Processor -- start 2024-05-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa48be00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa470069fa0 0x7fa47006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 -- start start 2024-05-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa48be00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa470069fa0 0x7fa47006c460 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa49415f050 tx=0x7fa47c007dd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc8a0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 0x55b7fc853110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 0x55b7fc853a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b7fc6a4420 con 0x55b7fc8a0120 2024-05-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b7fc63ebf0 con 0x55b7fc8a0a40 2024-05-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55b7fc6a03e0 con 0x55b7fc853650 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa492a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc8a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa492a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc8a0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49606/0 (socket says 172.21.15.59:49606) 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa492a00640 1 -- 172.21.15.59:0/66281825 learned_addr learned my addr 172.21.15.59:0/66281825 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa48be00640 1 --2- 172.21.15.59:0/66281825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 0x55b7fc853110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa493400640 1 --2- 172.21.15.59:0/66281825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 0x55b7fc853a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa492a00640 1 -- 172.21.15.59:0/66281825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 msgr2=0x55b7fc853a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa492a00640 1 --2- 172.21.15.59:0/66281825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 0x55b7fc853a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa492a00640 1 -- 172.21.15.59:0/66281825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 msgr2=0x55b7fc853110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa492a00640 1 --2- 172.21.15.59:0/66281825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 0x55b7fc853110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa492a00640 1 -- 172.21.15.59:0/66281825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7fc74c450 con 0x55b7fc8a0120 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa492a00640 1 --2- 172.21.15.59:0/66281825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc8a0500 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa4840190b0 tx=0x7fa4840f16f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39aac6398ecd7792 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa483400640 1 -- 172.21.15.59:0/66281825 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48411f070 con 0x55b7fc8a0120 2024-05-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa483400640 1 -- 172.21.15.59:0/66281825 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4840b1040 con 0x55b7fc8a0120 2024-05-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa483400640 1 -- 172.21.15.59:0/66281825 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840f6140 con 0x55b7fc8a0120 2024-05-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 -- 172.21.15.59:0/66281825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 msgr2=0x55b7fc8a0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/66281825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc8a0500 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa4840190b0 tx=0x7fa4840f16f0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 -- 172.21.15.59:0/66281825 shutdown_connections 2024-05-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/66281825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 0x55b7fc853a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/66281825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 0x55b7fc853110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/66281825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc8a0500 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 -- 172.21.15.59:0/66281825 >> 172.21.15.59:0/66281825 conn(0x55b7fc880ec0 msgr2=0x55b7fc8832b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 -- 172.21.15.59:0/66281825 shutdown_connections 2024-05-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.121+0000 7fa49ceb7000 1 -- 172.21.15.59:0/66281825 wait complete. 2024-05-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 1 -- start start 2024-05-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 1 Processor -- start 2024-05-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc853650 0x55b7fc858b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc8a0120 0x55b7fc859080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b7fc644ec0 con 0x55b7fc8a0a40 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b7fc725120 con 0x55b7fc853650 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55b7fc6af350 con 0x55b7fc8a0120 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 10 client.0 _ll_register_callbacks cb 0x55b7fc6814d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa493400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa493400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49608/0 (socket says 172.21.15.59:49608) 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa493400640 1 -- 172.21.15.59:0/4235001220 learned_addr learned my addr 172.21.15.59:0/4235001220 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa492a00640 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc853650 0x55b7fc858b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa48be00640 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc8a0120 0x55b7fc859080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa493400640 1 -- 172.21.15.59:0/4235001220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc8a0120 msgr2=0x55b7fc859080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa493400640 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc8a0120 0x55b7fc859080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa493400640 1 -- 172.21.15.59:0/4235001220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc853650 msgr2=0x55b7fc858b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa493400640 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc853650 0x55b7fc858b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa493400640 1 -- 172.21.15.59:0/4235001220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7fc6e9f80 con 0x55b7fc8a0a40 2024-05-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa493400640 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8595c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fa48c005920 tx=0x7fa48c0019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e8a62e244d4e2f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa477e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa477e00640 1 -- 172.21.15.59:0/4235001220 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c013570 con 0x55b7fc8a0a40 2024-05-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa477e00640 1 -- 172.21.15.59:0/4235001220 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7fa48c013710 con 0x55b7fc8a0a40 2024-05-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 1 -- 172.21.15.59:0/4235001220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4840b1040 con 0x55b7fc8a0a40 2024-05-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa477e00640 1 -- 172.21.15.59:0/4235001220 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fa48c021050 con 0x55b7fc8a0a40 2024-05-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 10 client.9126 fetch_fsmap learned FSMap version 81 2024-05-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 1 -- 172.21.15.59:0/4235001220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55b7fc67df00 con 0x55b7fc8a0a40 2024-05-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa477e00640 1 -- 172.21.15.59:0/4235001220 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4840b1040 con 0x55b7fc8a0a40 2024-05-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa477e00640 1 -- 172.21.15.59:0/4235001220 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7fa48c024020 con 0x55b7fc8a0a40 2024-05-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 10 client.9126 fetch_fsmap finished waiting for FSMap version 81 2024-05-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 10 client.9126 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 20 client.9126 populate_metadata read hostname 'smithi059' 2024-05-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.59:6833/1040424272,v1:172.21.15.59:6835/1040424272] conn(0x55b7fc8af3c0 0x55b7fc8b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 4 client.9126 mds_command: new command op to 8991 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa49ceb7000 1 -- 172.21.15.59:0/4235001220 --> [v2:172.21.15.59:6833/1040424272,v1:172.21.15.59:6835/1040424272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7fc63dbc0 con 0x55b7fc8af3c0 2024-05-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa492a00640 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.59:6833/1040424272,v1:172.21.15.59:6835/1040424272] conn(0x55b7fc8af3c0 0x55b7fc8b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa492a00640 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.59:6833/1040424272,v1:172.21.15.59:6835/1040424272] conn(0x55b7fc8af3c0 0x55b7fc8b17b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98e329bcf0083000 server_cookie=fcaae52a7caed318 in_seq=0 out_seq=0 2024-05-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.125+0000 7fa477e00640 10 client.9126 ms_handle_connect on v2:172.21.15.59:6833/1040424272 2024-05-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa477e00640 1 -- 172.21.15.59:0/4235001220 <== mds.0 v2:172.21.15.59:6833/1040424272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b7fc63dbc0 con 0x55b7fc8af3c0 2024-05-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa477e00640 10 client.9126 handle_command_reply: tid=0 2024-05-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa49ceb7000 1 client.9126 shutdown 2024-05-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa49ceb7000 1 -- 172.21.15.59:0/4235001220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0a40 msgr2=0x55b7fc8595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8595c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fa48c005920 tx=0x7fa48c0019e0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa49ceb7000 1 -- 172.21.15.59:0/4235001220 shutdown_connections 2024-05-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.59:6833/1040424272,v1:172.21.15.59:6835/1040424272] conn(0x55b7fc8af3c0 0x55b7fc8b17b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8595c0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc8a0120 0x55b7fc859080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/4235001220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc853650 0x55b7fc858b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa49ceb7000 1 -- 172.21.15.59:0/4235001220 >> 172.21.15.59:0/4235001220 conn(0x55b7fc880ec0 msgr2=0x55b7fc8832b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa477e00640 0 client.9126 ms_handle_reset on v2:172.21.15.59:6833/1040424272 2024-05-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa49ceb7000 1 -- 172.21.15.59:0/4235001220 shutdown_connections 2024-05-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa49ceb7000 1 -- 172.21.15.59:0/4235001220 wait complete. 2024-05-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.129+0000 7fa49ceb7000 20 client.9126 trim_cache size 0 max 16384 2024-05-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.145+0000 7fa49ceb7000 1 Processor -- start 2024-05-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.145+0000 7fa49ceb7000 1 -- start start 2024-05-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 0x55b7fc852810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc852d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa494203380 con 0x55b7fc8a0120 2024-05-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa4942026e0 con 0x55b7fc8a0a40 2024-05-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa494202d30 con 0x55b7fc853650 2024-05-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa48be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc852d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa48be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc852d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49618/0 (socket says 172.21.15.59:49618) 2024-05-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa48be00640 1 -- 172.21.15.59:0/48963171 learned_addr learned my addr 172.21.15.59:0/48963171 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa48be00640 1 -- 172.21.15.59:0/48963171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 msgr2=0x55b7fc852810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa48be00640 1 --2- 172.21.15.59:0/48963171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 0x55b7fc852810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa48be00640 1 -- 172.21.15.59:0/48963171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 msgr2=0x55b7fc8b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa48be00640 1 --2- 172.21.15.59:0/48963171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa48be00640 1 -- 172.21.15.59:0/48963171 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7fc8a0870 con 0x55b7fc8a0120 2024-05-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa48be00640 1 --2- 172.21.15.59:0/48963171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc852d50 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fa47c000c10 tx=0x7fa47c017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a2244e8d73668e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa482a00640 1 -- 172.21.15.59:0/48963171 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c029070 con 0x55b7fc8a0120 2024-05-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa482a00640 1 -- 172.21.15.59:0/48963171 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c005050 con 0x55b7fc8a0120 2024-05-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa482a00640 1 -- 172.21.15.59:0/48963171 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c005200 con 0x55b7fc8a0120 2024-05-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 -- 172.21.15.59:0/48963171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 msgr2=0x55b7fc852d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/48963171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc852d50 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fa47c000c10 tx=0x7fa47c017040 comp rx=0 tx=0).stop 2024-05-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 -- 172.21.15.59:0/48963171 shutdown_connections 2024-05-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/48963171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/48963171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc852d50 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/48963171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 0x55b7fc852810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 -- 172.21.15.59:0/48963171 >> 172.21.15.59:0/48963171 conn(0x55b7fc880ec0 msgr2=0x55b7fc852100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 -- 172.21.15.59:0/48963171 shutdown_connections 2024-05-30T17:04:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 -- 172.21.15.59:0/48963171 wait complete. 2024-05-30T17:04:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 -- start start 2024-05-30T17:04:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 Processor -- start 2024-05-30T17:04:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 0x55b7fc8b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc8cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b7fc6a3730 con 0x55b7fc8a0120 2024-05-30T17:04:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b7fc6709e0 con 0x55b7fc8a0a40 2024-05-30T17:04:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55b7fc6a8a50 con 0x55b7fc853650 2024-05-30T17:04:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa49ceb7000 10 client.0 _ll_register_callbacks cb 0x7fa48c003ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T17:04:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa48be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc8cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa48be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc8cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49622/0 (socket says 172.21.15.59:49622) 2024-05-30T17:04:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.149+0000 7fa48be00640 1 -- 172.21.15.59:0/1470539795 learned_addr learned my addr 172.21.15.59:0/1470539795 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa492a00640 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 0x55b7fc8b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa493400640 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa48be00640 1 -- 172.21.15.59:0/1470539795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 msgr2=0x55b7fc8b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa48be00640 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 0x55b7fc8b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa48be00640 1 -- 172.21.15.59:0/1470539795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 msgr2=0x55b7fc8cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa48be00640 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa48be00640 1 -- 172.21.15.59:0/1470539795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7fc62ae80 con 0x55b7fc8a0120 2024-05-30T17:04:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa48be00640 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc8cb340 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fa47c027040 tx=0x7fa47c007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc43143b3ee897e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa477e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-05-30T17:04:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa477e00640 1 -- 172.21.15.59:0/1470539795 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c029070 con 0x55b7fc8a0120 2024-05-30T17:04:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa477e00640 1 -- 172.21.15.59:0/1470539795 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7fa47c010050 con 0x55b7fc8a0120 2024-05-30T17:04:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 -- 172.21.15.59:0/1470539795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa47c005050 con 0x55b7fc8a0120 2024-05-30T17:04:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa477e00640 1 -- 172.21.15.59:0/1470539795 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fa47c036050 con 0x55b7fc8a0120 2024-05-30T17:04:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 10 client.9132 fetch_fsmap learned FSMap version 81 2024-05-30T17:04:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 -- 172.21.15.59:0/1470539795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55b7fc66cb30 con 0x55b7fc8a0120 2024-05-30T17:04:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa477e00640 1 -- 172.21.15.59:0/1470539795 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c005050 con 0x55b7fc8a0120 2024-05-30T17:04:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa477e00640 1 -- 172.21.15.59:0/1470539795 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7fa47c039020 con 0x55b7fc8a0120 2024-05-30T17:04:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 10 client.9132 fetch_fsmap finished waiting for FSMap version 81 2024-05-30T17:04:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 10 client.9132 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-30T17:04:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 20 client.9132 populate_metadata read hostname 'smithi059' 2024-05-30T17:04:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.59:6833/1040424272,v1:172.21.15.59:6835/1040424272] conn(0x55b7fc8cbdc0 0x55b7fc90efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 4 client.9132 mds_command: new command op to 8991 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T17:04:38.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 -- 172.21.15.59:0/1470539795 --> [v2:172.21.15.59:6833/1040424272,v1:172.21.15.59:6835/1040424272] -- command(tid 0: {"prefix": "status"}) -- 0x55b7fc6b1e40 con 0x55b7fc8cbdc0 2024-05-30T17:04:38.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa492a00640 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.59:6833/1040424272,v1:172.21.15.59:6835/1040424272] conn(0x55b7fc8cbdc0 0x55b7fc90efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa477e00640 10 client.9132 ms_handle_connect on v2:172.21.15.59:6833/1040424272 2024-05-30T17:04:38.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa492a00640 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.59:6833/1040424272,v1:172.21.15.59:6835/1040424272] conn(0x55b7fc8cbdc0 0x55b7fc90efb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99d7e3e0720629be server_cookie=1313431a5ee84a61 in_seq=0 out_seq=0 2024-05-30T17:04:38.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa477e00640 1 -- 172.21.15.59:0/1470539795 <== mds.0 v2:172.21.15.59:6833/1040424272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b7fc6b1e40 con 0x55b7fc8cbdc0 2024-05-30T17:04:38.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa477e00640 10 client.9132 handle_command_reply: tid=0 2024-05-30T17:04:38.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 client.9132 shutdown 2024-05-30T17:04:38.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 -- 172.21.15.59:0/1470539795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 msgr2=0x55b7fc8cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc8cb340 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fa47c027040 tx=0x7fa47c007b50 comp rx=0 tx=0).stop 2024-05-30T17:04:38.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 -- 172.21.15.59:0/1470539795 shutdown_connections 2024-05-30T17:04:38.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.59:6833/1040424272,v1:172.21.15.59:6835/1040424272] conn(0x55b7fc8cbdc0 0x55b7fc90efb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fc8a0a40 0x55b7fc8cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7fc8a0120 0x55b7fc8cb340 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa477e00640 0 client.9132 ms_handle_reset on v2:172.21.15.59:6833/1040424272 2024-05-30T17:04:38.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 --2- 172.21.15.59:0/1470539795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55b7fc853650 0x55b7fc8b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 -- 172.21.15.59:0/1470539795 >> 172.21.15.59:0/1470539795 conn(0x55b7fc880ec0 msgr2=0x55b7fc852810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:38.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 -- 172.21.15.59:0/1470539795 shutdown_connections 2024-05-30T17:04:38.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 1 -- 172.21.15.59:0/1470539795 wait complete. 2024-05-30T17:04:38.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa49ceb7000 20 client.9132 trim_cache size 0 max 16384 2024-05-30T17:04:38.161 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:04:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:04:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-05-30T17:04:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8991, 2024-05-30T17:04:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-05-30T17:04:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-05-30T17:04:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-05-30T17:04:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 10.496947114999999, 2024-05-30T17:04:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 81, 2024-05-30T17:04:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 131, 2024-05-30T17:04:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 131, 2024-05-30T17:04:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 15.348469513 2024-05-30T17:04:38.162 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:04:38.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa499a00640 1 -- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa470069fa0 msgr2=0x7fa47006c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa499a00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa470069fa0 0x7fa47006c460 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa49415f050 tx=0x7fa47c007dd0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa499a00640 1 -- 172.21.15.59:0/585124808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4940b3e50 msgr2=0x7fa494165f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa499a00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4940b3e50 0x7fa494165f90 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa4840ae040 tx=0x7fa48401ace0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa499a00640 1 -- 172.21.15.59:0/585124808 shutdown_connections 2024-05-30T17:04:38.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa499a00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa470069fa0 0x7fa47006c460 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa499a00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa49415a1d0 0x7fa4941471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa499a00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa494159df0 0x7fa49415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa499a00640 1 --2- 172.21.15.59:0/585124808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4940b3e50 0x7fa494165f90 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa499a00640 1 -- 172.21.15.59:0/585124808 >> 172.21.15.59:0/585124808 conn(0x7fa4940b22d0 msgr2=0x7fa49415c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:38.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa499a00640 1 -- 172.21.15.59:0/585124808 shutdown_connections 2024-05-30T17:04:38.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.153+0000 7fa499a00640 1 -- 172.21.15.59:0/585124808 wait complete. 2024-05-30T17:04:38.174 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T17:04:38.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.313+0000 7fb58ec00640 1 Processor -- start 2024-05-30T17:04:38.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.313+0000 7fb58ec00640 1 -- start start 2024-05-30T17:04:38.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb58ec00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb588160d90 0x7fb58809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb58ec00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb58809b780 0x7fb58809af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb58ec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb5880711e0 0x7fb58806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb58ec00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb5880d1310 con 0x7fb588160d90 2024-05-30T17:04:38.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb58ec00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb58809bcf0 con 0x7fb58809b780 2024-05-30T17:04:38.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb58ec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb5880d0a70 con 0x7fb5880711e0 2024-05-30T17:04:38.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb587e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb588160d90 0x7fb58809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb587e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb588160d90 0x7fb58809aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49628/0 (socket says 172.21.15.59:49628) 2024-05-30T17:04:38.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb587e00640 1 -- 172.21.15.59:0/4214321418 learned_addr learned my addr 172.21.15.59:0/4214321418 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:38.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb587400640 1 --2- 172.21.15.59:0/4214321418 >> v2:172.21.15.107:3300/0 conn(0x7fb58809b780 0x7fb58809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb58cc00640 1 --2- 172.21.15.59:0/4214321418 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb5880711e0 0x7fb58806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb587e00640 1 -- 172.21.15.59:0/4214321418 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb5880711e0 msgr2=0x7fb58806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:38.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb587e00640 1 --2- 172.21.15.59:0/4214321418 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb5880711e0 0x7fb58806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb587e00640 1 -- 172.21.15.59:0/4214321418 >> v2:172.21.15.107:3300/0 conn(0x7fb58809b780 msgr2=0x7fb58809af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:38.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb587e00640 1 --2- 172.21.15.59:0/4214321418 >> v2:172.21.15.107:3300/0 conn(0x7fb58809b780 0x7fb58809af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb587e00640 1 -- 172.21.15.59:0/4214321418 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5880d0d50 con 0x7fb588160d90 2024-05-30T17:04:38.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb587400640 1 --2- 172.21.15.59:0/4214321418 >> v2:172.21.15.107:3300/0 conn(0x7fb58809b780 0x7fb58809af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:38.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.317+0000 7fb58cc00640 1 --2- 172.21.15.59:0/4214321418 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb5880711e0 0x7fb58806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:38.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb587e00640 1 --2- 172.21.15.59:0/4214321418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb588160d90 0x7fb58809aa40 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fb588073b70 tx=0x7fb57801c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f7eb46e3121d51 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:38.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb586a00640 1 -- 172.21.15.59:0/4214321418 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5780b0070 con 0x7fb588160d90 2024-05-30T17:04:38.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb586a00640 1 -- 172.21.15.59:0/4214321418 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5780ab600 con 0x7fb588160d90 2024-05-30T17:04:38.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb586a00640 1 -- 172.21.15.59:0/4214321418 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5780ab9d0 con 0x7fb588160d90 2024-05-30T17:04:38.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb58ec00640 1 -- 172.21.15.59:0/4214321418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb588160d90 msgr2=0x7fb58809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb58ec00640 1 --2- 172.21.15.59:0/4214321418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb588160d90 0x7fb58809aa40 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fb588073b70 tx=0x7fb57801c140 comp rx=0 tx=0).stop 2024-05-30T17:04:38.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb58ec00640 1 -- 172.21.15.59:0/4214321418 shutdown_connections 2024-05-30T17:04:38.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb58ec00640 1 --2- 172.21.15.59:0/4214321418 >> v2:172.21.15.107:3300/0 conn(0x7fb58809b780 0x7fb58809af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb58ec00640 1 --2- 172.21.15.59:0/4214321418 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb5880711e0 0x7fb58806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb58ec00640 1 --2- 172.21.15.59:0/4214321418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb588160d90 0x7fb58809aa40 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb58ec00640 1 -- 172.21.15.59:0/4214321418 >> 172.21.15.59:0/4214321418 conn(0x7fb5880b3f80 msgr2=0x7fb5880b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:38.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb58ec00640 1 -- 172.21.15.59:0/4214321418 shutdown_connections 2024-05-30T17:04:38.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb58ec00640 1 -- 172.21.15.59:0/4214321418 wait complete. 2024-05-30T17:04:38.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb58ec00640 1 Processor -- start 2024-05-30T17:04:38.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.321+0000 7fb58ec00640 1 -- start start 2024-05-30T17:04:38.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb58ec00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5880711e0 0x7fb58806e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb58ec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb58809b780 0x7fb5881f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb58ec00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb588160d90 0x7fb58815ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb58ec00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb5881612f0 con 0x7fb5880711e0 2024-05-30T17:04:38.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb58ec00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb588161170 con 0x7fb588160d90 2024-05-30T17:04:38.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb58ec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb5880cdd20 con 0x7fb58809b780 2024-05-30T17:04:38.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb587e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5880711e0 0x7fb58806e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb587e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5880711e0 0x7fb58806e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49632/0 (socket says 172.21.15.59:49632) 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb587e00640 1 -- 172.21.15.59:0/1844469449 learned_addr learned my addr 172.21.15.59:0/1844469449 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb587400640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb58809b780 0x7fb5881f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb58cc00640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb588160d90 0x7fb58815ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb587e00640 1 -- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb58809b780 msgr2=0x7fb5881f6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb587e00640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb58809b780 0x7fb5881f6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb587e00640 1 -- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb588160d90 msgr2=0x7fb58815ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb587e00640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb588160d90 0x7fb58815ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb587e00640 1 -- 172.21.15.59:0/1844469449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5881f7100 con 0x7fb5880711e0 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb587e00640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5880711e0 0x7fb58806e750 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fb5780ae040 tx=0x7fb57801a980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb57fe00640 1 -- 172.21.15.59:0/1844469449 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5780ba020 con 0x7fb5880711e0 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb57fe00640 1 -- 172.21.15.59:0/1844469449 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5780b6640 con 0x7fb5880711e0 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb58ec00640 1 -- 172.21.15.59:0/1844469449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5881fb790 con 0x7fb5880711e0 2024-05-30T17:04:38.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb57fe00640 1 -- 172.21.15.59:0/1844469449 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5780b0040 con 0x7fb5880711e0 2024-05-30T17:04:38.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb58ec00640 1 -- 172.21.15.59:0/1844469449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5881faef0 con 0x7fb5880711e0 2024-05-30T17:04:38.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb58ec00640 1 -- 172.21.15.59:0/1844469449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb588068a90 con 0x7fb5880711e0 2024-05-30T17:04:38.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.325+0000 7fb57fe00640 1 -- 172.21.15.59:0/1844469449 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fb5780bd020 con 0x7fb5880711e0 2024-05-30T17:04:38.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.329+0000 7fb57fe00640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb568069fa0 0x7fb56806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:38.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.329+0000 7fb57fe00640 1 -- 172.21.15.59:0/1844469449 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7fb57811fbd0 con 0x7fb5880711e0 2024-05-30T17:04:38.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.329+0000 7fb587400640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb568069fa0 0x7fb56806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:38.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.329+0000 7fb587400640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb568069fa0 0x7fb56806c460 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb5880a0530 tx=0x7fb574008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:38.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.333+0000 7fb57fe00640 1 -- 172.21.15.59:0/1844469449 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb5780c4030 con 0x7fb5880711e0 2024-05-30T17:04:38.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.529+0000 7fb58ec00640 1 -- 172.21.15.59:0/1844469449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb5880d1800 con 0x7fb5880711e0 2024-05-30T17:04:38.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb57fe00640 1 -- 172.21.15.59:0/1844469449 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v81) ==== 53+0+73 (secure 0 0 0) 0x7fb578016110 con 0x7fb5880711e0 2024-05-30T17:04:38.532 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T17:04:38.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb58ec00640 1 -- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb568069fa0 msgr2=0x7fb56806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb58ec00640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb568069fa0 0x7fb56806c460 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb5880a0530 tx=0x7fb574008040 comp rx=0 tx=0).stop 2024-05-30T17:04:38.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb58ec00640 1 -- 172.21.15.59:0/1844469449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5880711e0 msgr2=0x7fb58806e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:38.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb58ec00640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5880711e0 0x7fb58806e750 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fb5780ae040 tx=0x7fb57801a980 comp rx=0 tx=0).stop 2024-05-30T17:04:38.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb58ec00640 1 -- 172.21.15.59:0/1844469449 shutdown_connections 2024-05-30T17:04:38.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb58ec00640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb568069fa0 0x7fb56806c460 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb58ec00640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb588160d90 0x7fb58815ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb58ec00640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb58809b780 0x7fb5881f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb58ec00640 1 --2- 172.21.15.59:0/1844469449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5880711e0 0x7fb58806e750 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:38.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb58ec00640 1 -- 172.21.15.59:0/1844469449 >> 172.21.15.59:0/1844469449 conn(0x7fb5880b3f80 msgr2=0x7fb5880afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:38.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb58ec00640 1 -- 172.21.15.59:0/1844469449 shutdown_connections 2024-05-30T17:04:38.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38.533+0000 7fb58ec00640 1 -- 172.21.15.59:0/1844469449 wait complete. 2024-05-30T17:04:38.554 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T17:04:38.554 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T17:04:38.554 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-05-30T17:04:38.554 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T17:04:38.554 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T17:04:38.554 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T17:04:38.554 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T17:04:38.554 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T17:04:38.554 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T17:04:38.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:38.555 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-05-30T17:04:38.565 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T17:04:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T17:04:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T17:04:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:04:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-05-30T17:04:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:04:38.566 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T17:04:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-05-30T17:04:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-05-30T17:04:38.567 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T17:04:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-05-30T17:04:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-05-30T17:04:38.567 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T17:04:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-05-30T17:04:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-05-30T17:04:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T17:04:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41511sec preferred_lft 41511sec 2024-05-30T17:04:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-05-30T17:04:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:04:38.568 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T17:04:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-05-30T17:04:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-05-30T17:04:38.568 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T17:04:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:46:82:05:9a brd ff:ff:ff:ff:ff:ff 2024-05-30T17:04:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T17:04:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:04:38.569 INFO:teuthology.orchestra.run.smithi059.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T17:04:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T17:04:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T17:04:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:04:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T17:04:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:04:38.569 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T17:04:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:04:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T17:04:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:04:38.570 INFO:teuthology.orchestra.run.smithi059.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T17:04:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:04:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T17:04:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-05-30T17:04:38.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:38.571 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T17:04:38.629 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-05-30T17:04:38.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:38.631 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-05-30T17:04:38.688 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-05-30T17:04:38.688 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T17:04:38.688 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T17:04:38.688 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T17:04:38.688 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T17:04:38.688 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T17:04:38.689 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T17:04:38.689 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-05-30T17:04:38.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T17:04:38.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T17:04:38.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T17:04:38.689 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-05-30T17:04:38.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T17:04:38.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T17:04:38.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:38.827 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-05-30T17:04:38.835 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T17:04:38.836 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T17:04:38.836 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T17:04:38.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:38.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-05-30T17:04:38.899 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-30T17:04:38.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T17:04:38.899 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T17:04:38.954 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T17:04:38.954 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T17:04:38.954 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T17:04:39.003 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T17:04:39.067 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T17:04:39.120 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T17:04:39.120 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T17:04:39.120 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T17:04:39.120 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T17:04:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T17:04:39.122 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T17:04:39.122 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T17:04:39.122 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T17:04:39.122 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T17:04:39.122 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T17:04:39.122 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T17:04:39.122 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T17:04:39.122 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T17:04:39.122 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T17:04:39.122 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T17:04:39.122 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T17:04:39.122 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T17:04:39.123 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:04:39.123 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:04:39.123 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:04:39.123 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:04:39.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:39.124 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T17:04:39.175 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-30T17:04:39.175 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-30T17:04:39.222 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-05-30T17:04:39.242 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-05-30T17:04:39.292 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-05-30T17:04:39.292 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-05-30T17:04:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-05-30T17:04:39.294 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-05-30T17:04:39.295 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-05-30T17:04:39.295 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:04:39.295 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:04:39.295 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:04:39.295 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:04:39.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:39.296 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-05-30T17:04:39.318 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:2024-05-30T17:04:39.317+0000 7f19054f0580 -1 init, newargv = 0x55b078b693f0 newargc=15 2024-05-30T17:04:39.318 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[51783]: starting ceph client 2024-05-30T17:04:39.325 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[51783]: starting fuse 2024-05-30T17:04:39.327 INFO:teuthology.orchestra.run.smithi059.stdout:44 2024-05-30T17:04:39.327 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-30T17:04:39.327 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2024-05-30T17:04:39.327 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2024-05-30T17:04:39.327 DEBUG:teuthology.orchestra.run.smithi059:> import re 2024-05-30T17:04:39.327 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-05-30T17:04:39.327 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2024-05-30T17:04:39.327 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T17:04:39.327 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2024-05-30T17:04:39.328 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2024-05-30T17:04:39.329 DEBUG:teuthology.orchestra.run.smithi059:> return f 2024-05-30T17:04:39.329 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-30T17:04:39.329 DEBUG:teuthology.orchestra.run.smithi059:> 2024-05-30T17:04:39.329 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.0")) 2024-05-30T17:04:39.329 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-05-30T17:04:39.457 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.0.51783.asok 2024-05-30T17:04:39.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T17:04:39.469 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51783.asok 2024-05-30T17:04:39.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:39.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51783.asok status 2024-05-30T17:04:39.643 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:04:39.643 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2024-05-30T17:04:39.643 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "9ed025fbf4406fb54980a0647506b15895b6d863", 2024-05-30T17:04:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-3154-g9ed025fb (9ed025fbf4406fb54980a0647506b15895b6d863) squid (dev)", 2024-05-30T17:04:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "0", 2024-05-30T17:04:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2024-05-30T17:04:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-30T17:04:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "51783", 2024-05-30T17:04:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2024-05-30T17:04:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2024-05-30T17:04:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2024-05-30T17:04:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 9144, 2024-05-30T17:04:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2024-05-30T17:04:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 9144 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1306444110 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-05-30T17:04:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1306444110 2024-05-30T17:04:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:04:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.9144 192.168.0.1:0/1306444110", 2024-05-30T17:04:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/1306444110", 2024-05-30T17:04:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2024-05-30T17:04:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 81, 2024-05-30T17:04:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 131, 2024-05-30T17:04:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2024-05-30T17:04:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2024-05-30T17:04:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2024-05-30T17:04:39.646 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:04:39.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:39.659 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2024-05-30T17:04:39.659 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-30T17:04:39.668 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2024-05-30T17:04:39.668 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-30T17:04:39.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:39.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T17:04:39.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T17:04:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3fa00640 1 Processor -- start 2024-05-30T17:04:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3fa00640 1 -- start start 2024-05-30T17:04:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3fa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcb38161ce0 0x7fcb3809b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:39.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3fa00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb380d1020 con 0x7fcb380d0710 2024-05-30T17:04:39.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3fa00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb380d1300 con 0x7fcb380d0ba0 2024-05-30T17:04:39.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3fa00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fcb380d15e0 con 0x7fcb38161ce0 2024-05-30T17:04:39.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcb380d0710 0x7fcb38162410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54076/0 (socket says 172.21.15.59:54076) 2024-05-30T17:04:39.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37e00640 1 -- 172.21.15.59:0/2017524109 learned_addr learned my addr 172.21.15.59:0/2017524109 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:39.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3d000640 1 --2- 172.21.15.59:0/2017524109 >> v2:172.21.15.107:3300/0 conn(0x7fcb38161ce0 0x7fcb3809b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:39.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481903330 0 0) 0x7fcb380d1020 con 0x7fcb380d0710 2024-05-30T17:04:39.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb20003530 con 0x7fcb380d0710 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2631901834 0 0) 0x7fcb20003530 con 0x7fcb380d0710 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 >> v2:172.21.15.107:3300/0 conn(0x7fcb38161ce0 msgr2=0x7fcb3809b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 --2- 172.21.15.59:0/2017524109 >> v2:172.21.15.107:3300/0 conn(0x7fcb38161ce0 0x7fcb3809b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 >> v1:172.21.15.107:6789/0 conn(0x7fcb380d0ba0 legacy=0x7fcb3815e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb380d18c0 con 0x7fcb380d0710 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fcb24001680 con 0x7fcb380d0710 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 >> v1:172.21.15.59:6789/0 conn(0x7fcb380d0710 legacy=0x7fcb38162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 --2- 172.21.15.59:0/2017524109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb200039c0 0x7fcb20003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 --2- 172.21.15.59:0/2017524109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb20004810 0x7fcb20004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 --2- 172.21.15.59:0/2017524109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb200051d0 0x7fcb2000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcb380d15e0 con 0x7fcb200039c0 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2000c070 con 0x7fcb20004810 2024-05-30T17:04:39.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2000c270 con 0x7fcb200051d0 2024-05-30T17:04:39.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3d000640 1 --2- 172.21.15.59:0/2017524109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb200039c0 0x7fcb20003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:39.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37e00640 1 --2- 172.21.15.59:0/2017524109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb20004810 0x7fcb20004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:39.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3da00640 1 --2- 172.21.15.59:0/2017524109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb200051d0 0x7fcb2000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:39.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3d000640 1 -- 172.21.15.59:0/2017524109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb200051d0 msgr2=0x7fcb2000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:39.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3d000640 1 --2- 172.21.15.59:0/2017524109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb200051d0 0x7fcb2000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:39.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3d000640 1 -- 172.21.15.59:0/2017524109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb20004810 msgr2=0x7fcb20004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:39.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3d000640 1 --2- 172.21.15.59:0/2017524109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb20004810 0x7fcb20004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:39.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3d000640 1 -- 172.21.15.59:0/2017524109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb20003530 con 0x7fcb200039c0 2024-05-30T17:04:39.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb3da00640 1 -- 172.21.15.59:0/2017524109 reap_dead start 2024-05-30T17:04:39.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.921+0000 7fcb37e00640 1 --2- 172.21.15.59:0/2017524109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb20004810 0x7fcb20004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:39.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.925+0000 7fcb3d000640 1 --2- 172.21.15.59:0/2017524109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb200039c0 0x7fcb20003de0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009ae0 tx=0x7fcb2c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c7ed33a82d44d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:39.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.925+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c0b2070 con 0x7fcb200039c0 2024-05-30T17:04:39.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.925+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb2c0a5570 con 0x7fcb200039c0 2024-05-30T17:04:39.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.925+0000 7fcb37400640 1 -- 172.21.15.59:0/2017524109 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c0096b0 con 0x7fcb200039c0 2024-05-30T17:04:39.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.925+0000 7fcb3fa00640 1 -- 172.21.15.59:0/2017524109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb200039c0 msgr2=0x7fcb20003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:39.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.925+0000 7fcb3fa00640 1 --2- 172.21.15.59:0/2017524109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb200039c0 0x7fcb20003de0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009ae0 tx=0x7fcb2c01ca90 comp rx=0 tx=0).stop 2024-05-30T17:04:39.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.925+0000 7fcb3fa00640 1 -- 172.21.15.59:0/2017524109 shutdown_connections 2024-05-30T17:04:39.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.925+0000 7fcb3fa00640 1 --2- 172.21.15.59:0/2017524109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb200039c0 0x7fcb20003de0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:39.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.925+0000 7fcb3fa00640 1 -- 172.21.15.59:0/2017524109 >> 172.21.15.59:0/2017524109 conn(0x7fcb380b4000 msgr2=0x7fcb380b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:39.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.925+0000 7fcb3fa00640 1 -- 172.21.15.59:0/2017524109 shutdown_connections 2024-05-30T17:04:39.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.925+0000 7fcb3fa00640 1 -- 172.21.15.59:0/2017524109 wait complete. 2024-05-30T17:04:39.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb3fa00640 1 Processor -- start 2024-05-30T17:04:39.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb3fa00640 1 -- start start 2024-05-30T17:04:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb3fa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb200039c0 0x7fcb38152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb3fa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb3815da70 0x7fcb3815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb3fa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb380b7770 0x7fcb380b7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb3fa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3806d210 con 0x7fcb3815da70 2024-05-30T17:04:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb3fa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3806d090 con 0x7fcb200039c0 2024-05-30T17:04:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb3fa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcb3806d390 con 0x7fcb380b7770 2024-05-30T17:04:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb37e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb3815da70 0x7fcb3815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb37e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb3815da70 0x7fcb3815ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49650/0 (socket says 172.21.15.59:49650) 2024-05-30T17:04:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb37e00640 1 -- 172.21.15.59:0/3514798945 learned_addr learned my addr 172.21.15.59:0/3514798945 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb3da00640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb380b7770 0x7fcb380b7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb3d000640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb200039c0 0x7fcb38152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:39.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb37e00640 1 -- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb380b7770 msgr2=0x7fcb380b7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:39.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb37e00640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb380b7770 0x7fcb380b7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:39.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb37e00640 1 -- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb200039c0 msgr2=0x7fcb38152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:39.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb37e00640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb200039c0 0x7fcb38152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:39.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb37e00640 1 -- 172.21.15.59:0/3514798945 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb381fb150 con 0x7fcb3815da70 2024-05-30T17:04:39.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb37e00640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb3815da70 0x7fcb3815ded0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400e850 tx=0x7fcb2400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:39.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb34c00640 1 -- 172.21.15.59:0/3514798945 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400c8d0 con 0x7fcb3815da70 2024-05-30T17:04:39.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb34c00640 1 -- 172.21.15.59:0/3514798945 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb24018070 con 0x7fcb3815da70 2024-05-30T17:04:39.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb34c00640 1 -- 172.21.15.59:0/3514798945 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400cc70 con 0x7fcb3815da70 2024-05-30T17:04:39.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb3fa00640 1 -- 172.21.15.59:0/3514798945 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb381fb430 con 0x7fcb3815da70 2024-05-30T17:04:39.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.929+0000 7fcb3fa00640 1 -- 172.21.15.59:0/3514798945 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb381fb9f0 con 0x7fcb3815da70 2024-05-30T17:04:39.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.933+0000 7fcb3fa00640 1 -- 172.21.15.59:0/3514798945 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb38068a90 con 0x7fcb3815da70 2024-05-30T17:04:39.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.933+0000 7fcb34c00640 1 -- 172.21.15.59:0/3514798945 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fcb2401d460 con 0x7fcb3815da70 2024-05-30T17:04:39.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.933+0000 7fcb34c00640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcb18069fa0 0x7fcb1806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:39.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.933+0000 7fcb34c00640 1 -- 172.21.15.59:0/3514798945 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7fcb24085780 con 0x7fcb3815da70 2024-05-30T17:04:39.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.933+0000 7fcb3d000640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcb18069fa0 0x7fcb1806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:39.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.933+0000 7fcb3d000640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcb18069fa0 0x7fcb1806c460 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0af000 tx=0x7fcb2c0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:39.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:39.937+0000 7fcb34c00640 1 -- 172.21.15.59:0/3514798945 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcb24057150 con 0x7fcb3815da70 2024-05-30T17:04:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.141+0000 7fcb3fa00640 1 -- 172.21.15.59:0/3514798945 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fcb3815e410 con 0x7fcb3815da70 2024-05-30T17:04:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.169+0000 7fcb34c00640 1 -- 172.21.15.59:0/3514798945 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v82) ==== 136+0+0 (secure 0 0 0) 0x7fcb3815e410 con 0x7fcb3815da70 2024-05-30T17:04:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.173+0000 7fcb3fa00640 1 -- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcb18069fa0 msgr2=0x7fcb1806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.173+0000 7fcb3fa00640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcb18069fa0 0x7fcb1806c460 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0af000 tx=0x7fcb2c0046d0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.173+0000 7fcb3fa00640 1 -- 172.21.15.59:0/3514798945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb3815da70 msgr2=0x7fcb3815ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.173+0000 7fcb3fa00640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb3815da70 0x7fcb3815ded0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400e850 tx=0x7fcb2400ed10 comp rx=0 tx=0).stop 2024-05-30T17:04:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.173+0000 7fcb3fa00640 1 -- 172.21.15.59:0/3514798945 shutdown_connections 2024-05-30T17:04:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.173+0000 7fcb3fa00640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcb18069fa0 0x7fcb1806c460 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.173+0000 7fcb3fa00640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb380b7770 0x7fcb380b7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.173+0000 7fcb3fa00640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb3815da70 0x7fcb3815ded0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.173+0000 7fcb3fa00640 1 --2- 172.21.15.59:0/3514798945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb200039c0 0x7fcb38152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.173+0000 7fcb3fa00640 1 -- 172.21.15.59:0/3514798945 >> 172.21.15.59:0/3514798945 conn(0x7fcb380b4000 msgr2=0x7fcb3806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.173+0000 7fcb3fa00640 1 -- 172.21.15.59:0/3514798945 shutdown_connections 2024-05-30T17:04:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.173+0000 7fcb3fa00640 1 -- 172.21.15.59:0/3514798945 wait complete. 2024-05-30T17:04:40.194 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T17:04:40.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7febae200640 1 Processor -- start 2024-05-30T17:04:40.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7febae200640 1 -- start start 2024-05-30T17:04:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7febae200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feba815e860 0x7feba80cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7febae200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feba80d0e80 0x7feba80c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7febae200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feba80c6d80 0x7feba806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7febae200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7feba815ec40 con 0x7feba80d0e80 2024-05-30T17:04:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7febae200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7feba80c8200 con 0x7feba80c6d80 2024-05-30T17:04:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7febae200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7feba80c7960 con 0x7feba815e860 2024-05-30T17:04:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7feba6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feba80d0e80 0x7feba80c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7feba6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feba80d0e80 0x7feba80c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49660/0 (socket says 172.21.15.59:49660) 2024-05-30T17:04:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7feba6a00640 1 -- 172.21.15.59:0/258983205 learned_addr learned my addr 172.21.15.59:0/258983205 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7feba6a00640 1 -- 172.21.15.59:0/258983205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feba815e860 msgr2=0x7feba80cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7feba6a00640 1 --2- 172.21.15.59:0/258983205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feba815e860 0x7feba80cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7feba6a00640 1 -- 172.21.15.59:0/258983205 >> v2:172.21.15.107:3300/0 conn(0x7feba80c6d80 msgr2=0x7feba806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7feba7e00640 1 --2- 172.21.15.59:0/258983205 >> v2:172.21.15.107:3300/0 conn(0x7feba80c6d80 0x7feba806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7feba6a00640 1 --2- 172.21.15.59:0/258983205 >> v2:172.21.15.107:3300/0 conn(0x7feba80c6d80 0x7feba806b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7feba6a00640 1 -- 172.21.15.59:0/258983205 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba80c7c40 con 0x7feba80d0e80 2024-05-30T17:04:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.337+0000 7feba7e00640 1 --2- 172.21.15.59:0/258983205 >> v2:172.21.15.107:3300/0 conn(0x7feba80c6d80 0x7feba806b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7feba6a00640 1 --2- 172.21.15.59:0/258983205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba80d0e80 0x7feba80c6840 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7feba806db50 tx=0x7feb9401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b6e73d5d3503ef server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7feba6000640 1 -- 172.21.15.59:0/258983205 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb940b2070 con 0x7feba80d0e80 2024-05-30T17:04:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7feba6000640 1 -- 172.21.15.59:0/258983205 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb940a9070 con 0x7feba80d0e80 2024-05-30T17:04:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7feba6000640 1 -- 172.21.15.59:0/258983205 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb940ad880 con 0x7feba80d0e80 2024-05-30T17:04:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7febae200640 1 -- 172.21.15.59:0/258983205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba80d0e80 msgr2=0x7feba80c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7febae200640 1 --2- 172.21.15.59:0/258983205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba80d0e80 0x7feba80c6840 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7feba806db50 tx=0x7feb9401c490 comp rx=0 tx=0).stop 2024-05-30T17:04:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7febae200640 1 -- 172.21.15.59:0/258983205 shutdown_connections 2024-05-30T17:04:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7febae200640 1 --2- 172.21.15.59:0/258983205 >> v2:172.21.15.107:3300/0 conn(0x7feba80c6d80 0x7feba806b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7febae200640 1 --2- 172.21.15.59:0/258983205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba80d0e80 0x7feba80c6840 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7febae200640 1 --2- 172.21.15.59:0/258983205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feba815e860 0x7feba80cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7febae200640 1 -- 172.21.15.59:0/258983205 >> 172.21.15.59:0/258983205 conn(0x7feba80b2fc0 msgr2=0x7feba80b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7febae200640 1 -- 172.21.15.59:0/258983205 shutdown_connections 2024-05-30T17:04:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7febae200640 1 -- 172.21.15.59:0/258983205 wait complete. 2024-05-30T17:04:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7febae200640 1 Processor -- start 2024-05-30T17:04:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.341+0000 7febae200640 1 -- start start 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7febae200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba80c6d80 0x7feba814c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7febae200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feba80d0e80 0x7feba80b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7febae200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feba815e860 0x7feba809e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7febae200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feba80b3d40 con 0x7feba80c6d80 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7febae200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7feba80b3bc0 con 0x7feba815e860 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7febae200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7feba80cdbf0 con 0x7feba80d0e80 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feba7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba80c6d80 0x7feba814c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feba7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba80c6d80 0x7feba814c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49676/0 (socket says 172.21.15.59:49676) 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feba7400640 1 -- 172.21.15.59:0/1003725414 learned_addr learned my addr 172.21.15.59:0/1003725414 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feba7e00640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feba815e860 0x7feba809e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feba6a00640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feba80d0e80 0x7feba80b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feba7400640 1 -- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feba80d0e80 msgr2=0x7feba80b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feba7400640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feba80d0e80 0x7feba80b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feba7400640 1 -- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feba815e860 msgr2=0x7feba809e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feba7400640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feba815e860 0x7feba809e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feba7400640 1 -- 172.21.15.59:0/1003725414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba80b1250 con 0x7feba80c6d80 2024-05-30T17:04:40.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feba7400640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba80c6d80 0x7feba814c1f0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7feb9800b410 tx=0x7feb9800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:40.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feb9f400640 1 -- 172.21.15.59:0/1003725414 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98015020 con 0x7feba80c6d80 2024-05-30T17:04:40.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feb9f400640 1 -- 172.21.15.59:0/1003725414 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb98011830 con 0x7feba80c6d80 2024-05-30T17:04:40.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7feb9f400640 1 -- 172.21.15.59:0/1003725414 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98011c20 con 0x7feba80c6d80 2024-05-30T17:04:40.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7febae200640 1 -- 172.21.15.59:0/1003725414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba814c730 con 0x7feba80c6d80 2024-05-30T17:04:40.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7febae200640 1 -- 172.21.15.59:0/1003725414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba80b17a0 con 0x7feba80c6d80 2024-05-30T17:04:40.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.345+0000 7febae200640 1 -- 172.21.15.59:0/1003725414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba8068a90 con 0x7feba80c6d80 2024-05-30T17:04:40.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.349+0000 7feb9f400640 1 -- 172.21.15.59:0/1003725414 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7feb98018020 con 0x7feba80c6d80 2024-05-30T17:04:40.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.349+0000 7feb9f400640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feb88069fa0 0x7feb8806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.349+0000 7feb9f400640 1 -- 172.21.15.59:0/1003725414 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7feb98085680 con 0x7feba80c6d80 2024-05-30T17:04:40.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.349+0000 7feba6a00640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feb88069fa0 0x7feb8806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:40.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.349+0000 7feba6a00640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feb88069fa0 0x7feb8806c460 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7feb940af000 tx=0x7feb940a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:40.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.353+0000 7feb9f400640 1 -- 172.21.15.59:0/1003725414 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feb9801f020 con 0x7feba80c6d80 2024-05-30T17:04:40.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.537+0000 7febae200640 1 -- 172.21.15.59:0/1003725414 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7feba80c7510 con 0x7feb88069fa0 2024-05-30T17:04:40.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7feb9f400640 1 -- 172.21.15.59:0/1003725414 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7feba80c7510 con 0x7feb88069fa0 2024-05-30T17:04:40.542 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:04:40.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:04:40.542 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T17:04:40.542 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:04:40.542 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:04:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7febae200640 1 -- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feb88069fa0 msgr2=0x7feb8806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7febae200640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feb88069fa0 0x7feb8806c460 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7feb940af000 tx=0x7feb940a7000 comp rx=0 tx=0).stop 2024-05-30T17:04:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7febae200640 1 -- 172.21.15.59:0/1003725414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba80c6d80 msgr2=0x7feba814c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7febae200640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba80c6d80 0x7feba814c1f0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7feb9800b410 tx=0x7feb9800b8d0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7febae200640 1 -- 172.21.15.59:0/1003725414 shutdown_connections 2024-05-30T17:04:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7febae200640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7feb88069fa0 0x7feb8806c460 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7febae200640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feba815e860 0x7feba809e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7febae200640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feba80d0e80 0x7feba80b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7febae200640 1 --2- 172.21.15.59:0/1003725414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba80c6d80 0x7feba814c1f0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7febae200640 1 -- 172.21.15.59:0/1003725414 >> 172.21.15.59:0/1003725414 conn(0x7feba80b2fc0 msgr2=0x7feba80b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7febae200640 1 -- 172.21.15.59:0/1003725414 shutdown_connections 2024-05-30T17:04:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.541+0000 7febae200640 1 -- 172.21.15.59:0/1003725414 wait complete. 2024-05-30T17:04:40.564 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T17:04:40.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff097c00640 1 Processor -- start 2024-05-30T17:04:40.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff097c00640 1 -- start start 2024-05-30T17:04:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff097c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff09006b9b0 0x7ff09015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff097c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0900d0370 0x7ff090160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff097c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0900d0bc0 con 0x7ff0900cced0 2024-05-30T17:04:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff097c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff0900d1180 con 0x7ff09006b9b0 2024-05-30T17:04:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff097c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff09015d060 con 0x7ff0900d0370 2024-05-30T17:04:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff095c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0900d0370 0x7ff090160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff08fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff09006b9b0 0x7ff09015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff095200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff0900cced0 0x7ff0900cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:60218/0 (socket says 172.21.15.59:60218) 2024-05-30T17:04:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff095200640 1 -- 172.21.15.59:0/1537874480 learned_addr learned my addr 172.21.15.59:0/1537874480 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff08fe00640 1 -- 172.21.15.59:0/1537874480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0900d0370 msgr2=0x7ff090160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff08fe00640 1 --2- 172.21.15.59:0/1537874480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0900d0370 0x7ff090160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff08fe00640 1 -- 172.21.15.59:0/1537874480 >> v1:172.21.15.107:6789/0 conn(0x7ff0900cced0 legacy=0x7ff0900cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.709+0000 7ff08fe00640 1 -- 172.21.15.59:0/1537874480 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0900d0ea0 con 0x7ff09006b9b0 2024-05-30T17:04:40.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.713+0000 7ff08fe00640 1 --2- 172.21.15.59:0/1537874480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff09006b9b0 0x7ff09015d4f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff07c0097c0 tx=0x7ff07c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7926d925e6921df server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:40.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.713+0000 7ff08f400640 1 -- 172.21.15.59:0/1537874480 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c0aa5f0 con 0x7ff09006b9b0 2024-05-30T17:04:40.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.713+0000 7ff08f400640 1 -- 172.21.15.59:0/1537874480 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07c0af070 con 0x7ff09006b9b0 2024-05-30T17:04:40.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.713+0000 7ff08f400640 1 -- 172.21.15.59:0/1537874480 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c0aa9b0 con 0x7ff09006b9b0 2024-05-30T17:04:40.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.713+0000 7ff097c00640 1 -- 172.21.15.59:0/1537874480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff09006b9b0 msgr2=0x7ff09015d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.713+0000 7ff097c00640 1 --2- 172.21.15.59:0/1537874480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff09006b9b0 0x7ff09015d4f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff07c0097c0 tx=0x7ff07c01c470 comp rx=0 tx=0).stop 2024-05-30T17:04:40.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.713+0000 7ff097c00640 1 -- 172.21.15.59:0/1537874480 shutdown_connections 2024-05-30T17:04:40.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.713+0000 7ff097c00640 1 --2- 172.21.15.59:0/1537874480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0900d0370 0x7ff090160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.713+0000 7ff097c00640 1 --2- 172.21.15.59:0/1537874480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff09006b9b0 0x7ff09015d4f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.713+0000 7ff097c00640 1 -- 172.21.15.59:0/1537874480 >> 172.21.15.59:0/1537874480 conn(0x7ff0900b2f50 msgr2=0x7ff0900b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.713+0000 7ff097c00640 1 -- 172.21.15.59:0/1537874480 shutdown_connections 2024-05-30T17:04:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.713+0000 7ff097c00640 1 -- 172.21.15.59:0/1537874480 wait complete. 2024-05-30T17:04:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff097c00640 1 Processor -- start 2024-05-30T17:04:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff097c00640 1 -- start start 2024-05-30T17:04:40.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff097c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff09006b9b0 0x7ff0901486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff097c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0900cced0 0x7ff0900b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff097c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0900d0370 0x7ff0900b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff097c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff0900d0900 con 0x7ff0900cced0 2024-05-30T17:04:40.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff097c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff0900d0780 con 0x7ff09006b9b0 2024-05-30T17:04:40.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff097c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff090160a90 con 0x7ff0900d0370 2024-05-30T17:04:40.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff08fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0900cced0 0x7ff0900b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:40.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff08fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0900cced0 0x7ff0900b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49678/0 (socket says 172.21.15.59:49678) 2024-05-30T17:04:40.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff08fe00640 1 -- 172.21.15.59:0/1383539196 learned_addr learned my addr 172.21.15.59:0/1383539196 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:40.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff095c00640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0900d0370 0x7ff0900b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:40.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff095200640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff09006b9b0 0x7ff0901486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff08fe00640 1 -- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0900d0370 msgr2=0x7ff0900b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff08fe00640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0900d0370 0x7ff0900b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff08fe00640 1 -- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff09006b9b0 msgr2=0x7ff0901486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff08fe00640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff09006b9b0 0x7ff0901486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff08fe00640 1 -- 172.21.15.59:0/1383539196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0900682f0 con 0x7ff0900cced0 2024-05-30T17:04:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff095200640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff09006b9b0 0x7ff0901486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:04:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff08fe00640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0900cced0 0x7ff0900b11d0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7ff07c0ac040 tx=0x7ff07c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff08cc00640 1 -- 172.21.15.59:0/1383539196 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c0be610 con 0x7ff0900cced0 2024-05-30T17:04:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff08cc00640 1 -- 172.21.15.59:0/1383539196 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07c0be7d0 con 0x7ff0900cced0 2024-05-30T17:04:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff08cc00640 1 -- 172.21.15.59:0/1383539196 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c0bebc0 con 0x7ff0900cced0 2024-05-30T17:04:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff097c00640 1 -- 172.21.15.59:0/1383539196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09006f030 con 0x7ff0900cced0 2024-05-30T17:04:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.717+0000 7ff097c00640 1 -- 172.21.15.59:0/1383539196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09006f5f0 con 0x7ff0900cced0 2024-05-30T17:04:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.721+0000 7ff097c00640 1 -- 172.21.15.59:0/1383539196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff090068a90 con 0x7ff0900cced0 2024-05-30T17:04:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.721+0000 7ff08cc00640 1 -- 172.21.15.59:0/1383539196 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7ff07c0bc020 con 0x7ff0900cced0 2024-05-30T17:04:40.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.721+0000 7ff08cc00640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff070069fd0 0x7ff07006c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:40.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.721+0000 7ff08cc00640 1 -- 172.21.15.59:0/1383539196 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7ff07c11fa30 con 0x7ff0900cced0 2024-05-30T17:04:40.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.721+0000 7ff095200640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff070069fd0 0x7ff07006c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:40.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.721+0000 7ff095200640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff070069fd0 0x7ff07006c490 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff0900cff10 tx=0x7ff084009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:40.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.725+0000 7ff08cc00640 1 -- 172.21.15.59:0/1383539196 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff07c0c5030 con 0x7ff0900cced0 2024-05-30T17:04:40.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.893+0000 7ff097c00640 1 -- 172.21.15.59:0/1383539196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff0900cbe50 con 0x7ff0900cced0 2024-05-30T17:04:40.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.893+0000 7ff08cc00640 1 -- 172.21.15.59:0/1383539196 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7ff07c016090 con 0x7ff0900cced0 2024-05-30T17:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.897+0000 7ff097c00640 1 -- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff070069fd0 msgr2=0x7ff07006c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.897+0000 7ff097c00640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff070069fd0 0x7ff07006c490 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff0900cff10 tx=0x7ff084009040 comp rx=0 tx=0).stop 2024-05-30T17:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.897+0000 7ff097c00640 1 -- 172.21.15.59:0/1383539196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0900cced0 msgr2=0x7ff0900b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.897+0000 7ff097c00640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0900cced0 0x7ff0900b11d0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7ff07c0ac040 tx=0x7ff07c01acb0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.897+0000 7ff097c00640 1 -- 172.21.15.59:0/1383539196 shutdown_connections 2024-05-30T17:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.897+0000 7ff097c00640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff070069fd0 0x7ff07006c490 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.897+0000 7ff097c00640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0900d0370 0x7ff0900b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.897+0000 7ff097c00640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0900cced0 0x7ff0900b11d0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.897+0000 7ff097c00640 1 --2- 172.21.15.59:0/1383539196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff09006b9b0 0x7ff0901486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:40.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.897+0000 7ff097c00640 1 -- 172.21.15.59:0/1383539196 >> 172.21.15.59:0/1383539196 conn(0x7ff0900b2f50 msgr2=0x7ff0900b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:40.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.897+0000 7ff097c00640 1 -- 172.21.15.59:0/1383539196 shutdown_connections 2024-05-30T17:04:40.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:40.897+0000 7ff097c00640 1 -- 172.21.15.59:0/1383539196 wait complete. 2024-05-30T17:04:40.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait false 2024-05-30T17:04:41.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.057+0000 7f0faec00640 1 Processor -- start 2024-05-30T17:04:41.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.057+0000 7f0faec00640 1 -- start start 2024-05-30T17:04:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0faec00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0fa80c9e10 0x7f0fa8141f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0faec00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa806d320 con 0x7f0fa806ce90 2024-05-30T17:04:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0faec00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa8163260 con 0x7f0fa806bce0 2024-05-30T17:04:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0faec00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa81626e0 con 0x7f0fa80c9e10 2024-05-30T17:04:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0f9f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0fa806ce90 0x7f0fa80ca1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54082/0 (socket says 172.21.15.59:54082) 2024-05-30T17:04:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0f9f400640 1 -- 172.21.15.59:0/2487066847 learned_addr learned my addr 172.21.15.59:0/2487066847 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7e00640 1 --2- 172.21.15.59:0/2487066847 >> v2:172.21.15.107:3300/0 conn(0x7f0fa80c9e10 0x7f0fa8141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4030937860 0 0) 0x7f0f90001120 con 0x7f0fa806ce90 2024-05-30T17:04:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f8c003530 con 0x7f0fa806ce90 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3764939421 0 0) 0x7f0f8c003530 con 0x7f0fa806ce90 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 >> v2:172.21.15.107:3300/0 conn(0x7f0fa80c9e10 msgr2=0x7f0fa8141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 --2- 172.21.15.59:0/2487066847 >> v2:172.21.15.107:3300/0 conn(0x7f0fa80c9e10 0x7f0fa8141f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 >> v1:172.21.15.107:6789/0 conn(0x7f0fa806bce0 legacy=0x7f0fa806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa81629c0 con 0x7f0fa806ce90 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f0f90001850 con 0x7f0fa806ce90 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 >> v1:172.21.15.59:6789/0 conn(0x7f0fa806ce90 legacy=0x7f0fa80ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 --2- 172.21.15.59:0/2487066847 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f8c0039c0 0x7f0f8c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 --2- 172.21.15.59:0/2487066847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f8c004810 0x7f0f8c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 --2- 172.21.15.59:0/2487066847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f8c0052f0 0x7f0f8c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81626e0 con 0x7f0f8c0052f0 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c00c1c0 con 0x7f0f8c0039c0 2024-05-30T17:04:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8c00c3c0 con 0x7f0f8c004810 2024-05-30T17:04:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0facc00640 1 --2- 172.21.15.59:0/2487066847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f8c0052f0 0x7f0f8c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0fa7e00640 1 --2- 172.21.15.59:0/2487066847 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f8c0039c0 0x7f0f8c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0f9f400640 1 --2- 172.21.15.59:0/2487066847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f8c004810 0x7f0f8c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0facc00640 1 -- 172.21.15.59:0/2487066847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f8c004810 msgr2=0x7f0f8c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0facc00640 1 --2- 172.21.15.59:0/2487066847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f8c004810 0x7f0f8c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0facc00640 1 -- 172.21.15.59:0/2487066847 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f8c0039c0 msgr2=0x7f0f8c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0facc00640 1 --2- 172.21.15.59:0/2487066847 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f8c0039c0 0x7f0f8c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.061+0000 7f0facc00640 1 -- 172.21.15.59:0/2487066847 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8c003530 con 0x7f0f8c0052f0 2024-05-30T17:04:41.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0facc00640 1 -- 172.21.15.59:0/2487066847 reap_dead start 2024-05-30T17:04:41.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0facc00640 1 --2- 172.21.15.59:0/2487066847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f8c0052f0 0x7f0f8c00b9d0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0001e40 tx=0x7f0fa001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44c476f869e710b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:41.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0001a90 con 0x7f0f8c0052f0 2024-05-30T17:04:41.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa0003b80 con 0x7f0f8c0052f0 2024-05-30T17:04:41.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0fa7400640 1 -- 172.21.15.59:0/2487066847 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0005020 con 0x7f0f8c0052f0 2024-05-30T17:04:41.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0faec00640 1 -- 172.21.15.59:0/2487066847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f8c0052f0 msgr2=0x7f0f8c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0faec00640 1 --2- 172.21.15.59:0/2487066847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f8c0052f0 0x7f0f8c00b9d0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0001e40 tx=0x7f0fa001c730 comp rx=0 tx=0).stop 2024-05-30T17:04:41.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0faec00640 1 -- 172.21.15.59:0/2487066847 shutdown_connections 2024-05-30T17:04:41.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0faec00640 1 --2- 172.21.15.59:0/2487066847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f8c0052f0 0x7f0f8c00b9d0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0faec00640 1 -- 172.21.15.59:0/2487066847 >> 172.21.15.59:0/2487066847 conn(0x7f0fa80cd540 msgr2=0x7f0fa80cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:41.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0faec00640 1 -- 172.21.15.59:0/2487066847 shutdown_connections 2024-05-30T17:04:41.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0faec00640 1 -- 172.21.15.59:0/2487066847 wait complete. 2024-05-30T17:04:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.065+0000 7f0faec00640 1 Processor -- start 2024-05-30T17:04:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0faec00640 1 -- start start 2024-05-30T17:04:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0faec00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f8c0052f0 0x7f0fa813cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0faec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fa813fe50 0x7f0fa815d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0faec00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fa81402d0 0x7f0fa815d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0faec00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa80cd350 con 0x7f0fa81402d0 2024-05-30T17:04:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0faec00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa80cd1d0 con 0x7f0f8c0052f0 2024-05-30T17:04:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0faec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa8162300 con 0x7f0fa813fe50 2024-05-30T17:04:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0facc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fa81402d0 0x7f0fa815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0facc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fa81402d0 0x7f0fa815d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49706/0 (socket says 172.21.15.59:49706) 2024-05-30T17:04:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0facc00640 1 -- 172.21.15.59:0/2058971150 learned_addr learned my addr 172.21.15.59:0/2058971150 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0f9f400640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fa813fe50 0x7f0fa815d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0fa7e00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f8c0052f0 0x7f0fa813cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0facc00640 1 -- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fa813fe50 msgr2=0x7f0fa815d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0facc00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fa813fe50 0x7f0fa815d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0facc00640 1 -- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f8c0052f0 msgr2=0x7f0fa813cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0facc00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f8c0052f0 0x7f0fa813cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0facc00640 1 -- 172.21.15.59:0/2058971150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa80b6370 con 0x7f0fa81402d0 2024-05-30T17:04:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0f9f400640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fa813fe50 0x7f0fa815d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0facc00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fa81402d0 0x7f0fa815d630 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f0fa001c560 tx=0x7f0f8c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:41.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0fa4c00640 1 -- 172.21.15.59:0/2058971150 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00b6070 con 0x7f0fa81402d0 2024-05-30T17:04:41.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0fa4c00640 1 -- 172.21.15.59:0/2058971150 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa00ad070 con 0x7f0fa81402d0 2024-05-30T17:04:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0faec00640 1 -- 172.21.15.59:0/2058971150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa80b5bb0 con 0x7f0fa81402d0 2024-05-30T17:04:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0fa4c00640 1 -- 172.21.15.59:0/2058971150 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0007dc0 con 0x7f0fa81402d0 2024-05-30T17:04:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0faec00640 1 -- 172.21.15.59:0/2058971150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa813e090 con 0x7f0fa81402d0 2024-05-30T17:04:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.069+0000 7f0faec00640 1 -- 172.21.15.59:0/2058971150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa8068a90 con 0x7f0fa81402d0 2024-05-30T17:04:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.073+0000 7f0fa4c00640 1 -- 172.21.15.59:0/2058971150 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f0fa00b9070 con 0x7f0fa81402d0 2024-05-30T17:04:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.073+0000 7f0fa4c00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0f84069fa0 0x7f0f8406c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.073+0000 7f0fa4c00640 1 -- 172.21.15.59:0/2058971150 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7f0fa011e610 con 0x7f0fa81402d0 2024-05-30T17:04:41.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.073+0000 7f0fa7e00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0f84069fa0 0x7f0f8406c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.073+0000 7f0fa7e00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0f84069fa0 0x7f0f8406c460 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8143380 tx=0x7f0f98009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:41.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.077+0000 7f0fa4c00640 1 -- 172.21.15.59:0/2058971150 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0fa0016470 con 0x7f0fa81402d0 2024-05-30T17:04:41.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.241+0000 7f0faec00640 1 -- 172.21.15.59:0/2058971150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}] v 0) -- 0x7f0fa8067c60 con 0x7f0fa81402d0 2024-05-30T17:04:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.245+0000 7f0fa4c00640 1 -- 172.21.15.59:0/2058971150 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}]=0 v29)=0 v29) ==== 136+0+0 (secure 0 0 0) 0x7f0fa00f06f0 con 0x7f0fa81402d0 2024-05-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.249+0000 7f0faec00640 1 -- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0f84069fa0 msgr2=0x7f0f8406c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.249+0000 7f0faec00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0f84069fa0 0x7f0f8406c460 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8143380 tx=0x7f0f98009190 comp rx=0 tx=0).stop 2024-05-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.249+0000 7f0faec00640 1 -- 172.21.15.59:0/2058971150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fa81402d0 msgr2=0x7f0fa815d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.249+0000 7f0faec00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fa81402d0 0x7f0fa815d630 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f0fa001c560 tx=0x7f0f8c005840 comp rx=0 tx=0).stop 2024-05-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.249+0000 7f0faec00640 1 -- 172.21.15.59:0/2058971150 shutdown_connections 2024-05-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.249+0000 7f0faec00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f0f84069fa0 0x7f0f8406c460 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.249+0000 7f0faec00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fa81402d0 0x7f0fa815d630 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.249+0000 7f0faec00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fa813fe50 0x7f0fa815d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.249+0000 7f0faec00640 1 --2- 172.21.15.59:0/2058971150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f8c0052f0 0x7f0fa813cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.249+0000 7f0faec00640 1 -- 172.21.15.59:0/2058971150 >> 172.21.15.59:0/2058971150 conn(0x7f0fa80cd540 msgr2=0x7f0fa8074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.249+0000 7f0faec00640 1 -- 172.21.15.59:0/2058971150 shutdown_connections 2024-05-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.249+0000 7f0faec00640 1 -- 172.21.15.59:0/2058971150 wait complete. 2024-05-30T17:04:41.269 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T17:04:41.270 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:41.269+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:41.270 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:41.269+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:41.270 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:41.269+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:41.270 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:41.269+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:41.270 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:41.269+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:41.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.413+0000 7fd214600640 1 Processor -- start 2024-05-30T17:04:41.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.413+0000 7fd214600640 1 -- start start 2024-05-30T17:04:41.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.413+0000 7fd214600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd20c15ad90 0x7fd20c071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.413+0000 7fd214600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd20c06ec00 0x7fd20c0b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd214600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd20c0b3370 con 0x7fd20c06f6a0 2024-05-30T17:04:41.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd214600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd20c0b3650 con 0x7fd20c06ec00 2024-05-30T17:04:41.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd214600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd20c0b3930 con 0x7fd20c15ad90 2024-05-30T17:04:41.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd211200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd20c06f6a0 0x7fd20c06e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54092/0 (socket says 172.21.15.59:54092) 2024-05-30T17:04:41.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd211200640 1 -- 172.21.15.59:0/582159185 learned_addr learned my addr 172.21.15.59:0/582159185 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd212600640 1 --2- 172.21.15.59:0/582159185 >> v2:172.21.15.107:3300/0 conn(0x7fd20c06ec00 0x7fd20c0b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd211c00640 1 --2- 172.21.15.59:0/582159185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd20c15ad90 0x7fd20c071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874750867 0 0) 0x7fd20c0b3370 con 0x7fd20c06f6a0 2024-05-30T17:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1f4003530 con 0x7fd20c06f6a0 2024-05-30T17:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3552652698 0 0) 0x7fd1f4003530 con 0x7fd20c06f6a0 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd20c15ad90 msgr2=0x7fd20c071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 --2- 172.21.15.59:0/582159185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd20c15ad90 0x7fd20c071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 >> v2:172.21.15.107:3300/0 conn(0x7fd20c06ec00 msgr2=0x7fd20c0b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 --2- 172.21.15.59:0/582159185 >> v2:172.21.15.107:3300/0 conn(0x7fd20c06ec00 0x7fd20c0b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c0b3c10 con 0x7fd20c06f6a0 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fd1f8001680 con 0x7fd20c06f6a0 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd212600640 1 --2- 172.21.15.59:0/582159185 >> v2:172.21.15.107:3300/0 conn(0x7fd20c06ec00 0x7fd20c0b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 >> v1:172.21.15.59:6789/0 conn(0x7fd20c06f6a0 legacy=0x7fd20c06e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 --2- 172.21.15.59:0/582159185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40039f0 0x7fd1f4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 --2- 172.21.15.59:0/582159185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1f4004810 0x7fd1f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 --2- 172.21.15.59:0/582159185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd20c15ad90 0x7fd1f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c0b3650 con 0x7fd1f4004810 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c0b3930 con 0x7fd1f40039f0 2024-05-30T17:04:41.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f400b9d0 con 0x7fd20c15ad90 2024-05-30T17:04:41.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd211200640 1 --2- 172.21.15.59:0/582159185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1f4004810 0x7fd1f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd211c00640 1 --2- 172.21.15.59:0/582159185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40039f0 0x7fd1f4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd212600640 1 --2- 172.21.15.59:0/582159185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd20c15ad90 0x7fd1f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd211200640 1 -- 172.21.15.59:0/582159185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd20c15ad90 msgr2=0x7fd1f40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:41.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd211200640 1 --2- 172.21.15.59:0/582159185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd20c15ad90 0x7fd1f40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd211200640 1 -- 172.21.15.59:0/582159185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40039f0 msgr2=0x7fd1f4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:41.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd211200640 1 --2- 172.21.15.59:0/582159185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40039f0 0x7fd1f4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.417+0000 7fd211200640 1 -- 172.21.15.59:0/582159185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f4003530 con 0x7fd1f4004810 2024-05-30T17:04:41.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd211200640 1 --2- 172.21.15.59:0/582159185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1f4004810 0x7fd1f4004c90 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800c210 tx=0x7fd1f801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfeeac213d432c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:41.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8007d20 con 0x7fd1f4004810 2024-05-30T17:04:41.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f80ac070 con 0x7fd1f4004810 2024-05-30T17:04:41.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd20be00640 1 -- 172.21.15.59:0/582159185 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8005b00 con 0x7fd1f4004810 2024-05-30T17:04:41.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd214600640 1 -- 172.21.15.59:0/582159185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1f4004810 msgr2=0x7fd1f4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd214600640 1 --2- 172.21.15.59:0/582159185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1f4004810 0x7fd1f4004c90 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800c210 tx=0x7fd1f801f3b0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd212600640 1 -- 172.21.15.59:0/582159185 reap_dead start 2024-05-30T17:04:41.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd214600640 1 -- 172.21.15.59:0/582159185 shutdown_connections 2024-05-30T17:04:41.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd214600640 1 -- 172.21.15.59:0/582159185 >> 172.21.15.59:0/582159185 conn(0x7fd20c0b1e60 msgr2=0x7fd20c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:41.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd214600640 1 -- 172.21.15.59:0/582159185 shutdown_connections 2024-05-30T17:04:41.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd214600640 1 -- 172.21.15.59:0/582159185 wait complete. 2024-05-30T17:04:41.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd214600640 1 Processor -- start 2024-05-30T17:04:41.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.421+0000 7fd214600640 1 -- start start 2024-05-30T17:04:41.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd214600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1f4004810 0x7fd20c0cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd214600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c14f360 0x7fd20c0cf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd214600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd20c098e50 0x7fd20c099300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd214600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c0ad7f0 con 0x7fd20c14f360 2024-05-30T17:04:41.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd214600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c0ad670 con 0x7fd20c098e50 2024-05-30T17:04:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd214600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd20c071cb0 con 0x7fd1f4004810 2024-05-30T17:04:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd211200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c14f360 0x7fd20c0cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd211200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c14f360 0x7fd20c0cf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49736/0 (socket says 172.21.15.59:49736) 2024-05-30T17:04:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd211200640 1 -- 172.21.15.59:0/2087887648 learned_addr learned my addr 172.21.15.59:0/2087887648 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd212600640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd20c098e50 0x7fd20c099300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd211c00640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1f4004810 0x7fd20c0cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd211200640 1 -- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1f4004810 msgr2=0x7fd20c0cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd211200640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1f4004810 0x7fd20c0cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd211200640 1 -- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd20c098e50 msgr2=0x7fd20c099300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd211200640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd20c098e50 0x7fd20c099300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd211200640 1 -- 172.21.15.59:0/2087887648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c0b4850 con 0x7fd20c14f360 2024-05-30T17:04:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd211200640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c14f360 0x7fd20c0cf510 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8025f20 tx=0x7fd1f4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd209600640 1 -- 172.21.15.59:0/2087887648 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8007d20 con 0x7fd20c14f360 2024-05-30T17:04:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd209600640 1 -- 172.21.15.59:0/2087887648 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f80047f0 con 0x7fd20c14f360 2024-05-30T17:04:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd209600640 1 -- 172.21.15.59:0/2087887648 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8004be0 con 0x7fd20c14f360 2024-05-30T17:04:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd214600640 1 -- 172.21.15.59:0/2087887648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c15d390 con 0x7fd20c14f360 2024-05-30T17:04:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd214600640 1 -- 172.21.15.59:0/2087887648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c15d950 con 0x7fd20c14f360 2024-05-30T17:04:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.425+0000 7fd214600640 1 -- 172.21.15.59:0/2087887648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20c068a90 con 0x7fd20c14f360 2024-05-30T17:04:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.429+0000 7fd209600640 1 -- 172.21.15.59:0/2087887648 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7fd1f80ba030 con 0x7fd20c14f360 2024-05-30T17:04:41.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.429+0000 7fd209600640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd1ec069fd0 0x7fd1ec06c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.429+0000 7fd209600640 1 -- 172.21.15.59:0/2087887648 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7fd1f8121f10 con 0x7fd20c14f360 2024-05-30T17:04:41.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.429+0000 7fd211c00640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd1ec069fd0 0x7fd1ec06c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.429+0000 7fd211c00640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd1ec069fd0 0x7fd1ec06c490 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd20c153170 tx=0x7fd200009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:41.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.433+0000 7fd209600640 1 -- 172.21.15.59:0/2087887648 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd1f80190c0 con 0x7fd20c14f360 2024-05-30T17:04:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.625+0000 7fd214600640 1 -- 172.21.15.59:0/2087887648 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7fd20c06f020 con 0x7fd1ec069fd0 2024-05-30T17:04:41.634 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:41.633+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:41.635 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:41.633+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:41.635 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:41.633+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:41.635 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:41.633+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:41.635 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:04:41.633+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:04:41.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.669+0000 7fd209600640 1 -- 172.21.15.59:0/2087887648 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd20c06f020 con 0x7fd1ec069fd0 2024-05-30T17:04:41.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.673+0000 7fd214600640 1 -- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd1ec069fd0 msgr2=0x7fd1ec06c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.673+0000 7fd214600640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd1ec069fd0 0x7fd1ec06c490 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd20c153170 tx=0x7fd200009190 comp rx=0 tx=0).stop 2024-05-30T17:04:41.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.673+0000 7fd214600640 1 -- 172.21.15.59:0/2087887648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c14f360 msgr2=0x7fd20c0cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.673+0000 7fd214600640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c14f360 0x7fd20c0cf510 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8025f20 tx=0x7fd1f4005840 comp rx=0 tx=0).stop 2024-05-30T17:04:41.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.673+0000 7fd214600640 1 -- 172.21.15.59:0/2087887648 shutdown_connections 2024-05-30T17:04:41.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.673+0000 7fd214600640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd1ec069fd0 0x7fd1ec06c490 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.673+0000 7fd214600640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd20c098e50 0x7fd20c099300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.673+0000 7fd214600640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c14f360 0x7fd20c0cf510 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.673+0000 7fd214600640 1 --2- 172.21.15.59:0/2087887648 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1f4004810 0x7fd20c0cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.673+0000 7fd214600640 1 -- 172.21.15.59:0/2087887648 >> 172.21.15.59:0/2087887648 conn(0x7fd20c0b1e60 msgr2=0x7fd20c0726c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:41.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.673+0000 7fd214600640 1 -- 172.21.15.59:0/2087887648 shutdown_connections 2024-05-30T17:04:41.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.673+0000 7fd214600640 1 -- 172.21.15.59:0/2087887648 wait complete. 2024-05-30T17:04:41.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T17:04:41.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a82a00640 1 Processor -- start 2024-05-30T17:04:41.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a82a00640 1 -- start start 2024-05-30T17:04:41.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a82a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4a7c0723a0 0x7f4a7c0b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a82a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a7c15ebf0 0x7f4a7c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a82a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a7c0b32d0 con 0x7f4a7c0b3ff0 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a82a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4a7c15f490 con 0x7f4a7c15ebf0 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a82a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4a7c15f770 con 0x7f4a7c0723a0 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a73400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a7c15ebf0 0x7f4a7c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a80a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4a7c0b3ff0 0x7f4a7c06dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54094/0 (socket says 172.21.15.59:54094) 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a80a00640 1 -- 172.21.15.59:0/1611963794 learned_addr learned my addr 172.21.15.59:0/1611963794 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a7be00640 1 --2- 172.21.15.59:0/1611963794 >> v2:172.21.15.107:3300/0 conn(0x7f4a7c0723a0 0x7f4a7c0b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a73400640 1 -- 172.21.15.59:0/1611963794 >> v2:172.21.15.107:3300/0 conn(0x7f4a7c0723a0 msgr2=0x7f4a7c0b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a73400640 1 --2- 172.21.15.59:0/1611963794 >> v2:172.21.15.107:3300/0 conn(0x7f4a7c0723a0 0x7f4a7c0b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a73400640 1 -- 172.21.15.59:0/1611963794 >> v1:172.21.15.59:6789/0 conn(0x7f4a7c0b3ff0 legacy=0x7f4a7c06dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a73400640 1 -- 172.21.15.59:0/1611963794 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c15fa50 con 0x7f4a7c15ebf0 2024-05-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.837+0000 7f4a7be00640 1 --2- 172.21.15.59:0/1611963794 >> v2:172.21.15.107:3300/0 conn(0x7f4a7c0723a0 0x7f4a7c0b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:41.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.841+0000 7f4a73400640 1 --2- 172.21.15.59:0/1611963794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a7c15ebf0 0x7f4a7c0b3ab0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0b3020 tx=0x7f4a6401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c754e17a0f578d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.841+0000 7f4a7b400640 1 -- 172.21.15.59:0/1611963794 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a640a7070 con 0x7f4a7c15ebf0 2024-05-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.841+0000 7f4a7b400640 1 -- 172.21.15.59:0/1611963794 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a640b0070 con 0x7f4a7c15ebf0 2024-05-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.841+0000 7f4a7b400640 1 -- 172.21.15.59:0/1611963794 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a640ab890 con 0x7f4a7c15ebf0 2024-05-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.841+0000 7f4a82a00640 1 -- 172.21.15.59:0/1611963794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a7c15ebf0 msgr2=0x7f4a7c0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.841+0000 7f4a82a00640 1 --2- 172.21.15.59:0/1611963794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a7c15ebf0 0x7f4a7c0b3ab0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0b3020 tx=0x7f4a6401c450 comp rx=0 tx=0).stop 2024-05-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.841+0000 7f4a82a00640 1 -- 172.21.15.59:0/1611963794 shutdown_connections 2024-05-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.841+0000 7f4a82a00640 1 --2- 172.21.15.59:0/1611963794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a7c15ebf0 0x7f4a7c0b3ab0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.841+0000 7f4a82a00640 1 --2- 172.21.15.59:0/1611963794 >> v2:172.21.15.107:3300/0 conn(0x7f4a7c0723a0 0x7f4a7c0b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.841+0000 7f4a82a00640 1 -- 172.21.15.59:0/1611963794 >> 172.21.15.59:0/1611963794 conn(0x7f4a7c06bdb0 msgr2=0x7f4a7c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.841+0000 7f4a82a00640 1 -- 172.21.15.59:0/1611963794 shutdown_connections 2024-05-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.841+0000 7f4a82a00640 1 -- 172.21.15.59:0/1611963794 wait complete. 2024-05-30T17:04:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a82a00640 1 Processor -- start 2024-05-30T17:04:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a82a00640 1 -- start start 2024-05-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a82a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a7c0723a0 0x7f4a7c146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a82a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a7c0b3ff0 0x7f4a7c0b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a82a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a7c15ebf0 0x7f4a7c0b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a82a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c072900 con 0x7f4a7c0723a0 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a82a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c072780 con 0x7f4a7c0b3ff0 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a82a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4a7c06e390 con 0x7f4a7c15ebf0 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a7be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a7c0723a0 0x7f4a7c146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a7be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a7c0723a0 0x7f4a7c146fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49758/0 (socket says 172.21.15.59:49758) 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a7be00640 1 -- 172.21.15.59:0/3003183375 learned_addr learned my addr 172.21.15.59:0/3003183375 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a73400640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a7c0b3ff0 0x7f4a7c0b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a80a00640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a7c15ebf0 0x7f4a7c0b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a7be00640 1 -- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a7c15ebf0 msgr2=0x7f4a7c0b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a7be00640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a7c15ebf0 0x7f4a7c0b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a7be00640 1 -- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a7c0b3ff0 msgr2=0x7f4a7c0b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a7be00640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a7c0b3ff0 0x7f4a7c0b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a7be00640 1 -- 172.21.15.59:0/3003183375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c158250 con 0x7f4a7c0723a0 2024-05-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a73400640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a7c0b3ff0 0x7f4a7c0b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a80a00640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a7c15ebf0 0x7f4a7c0b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a7be00640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a7c0723a0 0x7f4a7c146fe0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00d100 tx=0x7f4a6c00d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a78c00640 1 -- 172.21.15.59:0/3003183375 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c01a070 con 0x7f4a7c0723a0 2024-05-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a78c00640 1 -- 172.21.15.59:0/3003183375 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6c003ba0 con 0x7f4a7c0723a0 2024-05-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a82a00640 1 -- 172.21.15.59:0/3003183375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c158530 con 0x7f4a7c0723a0 2024-05-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a78c00640 1 -- 172.21.15.59:0/3003183375 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c004030 con 0x7f4a7c0723a0 2024-05-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.845+0000 7f4a82a00640 1 -- 172.21.15.59:0/3003183375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c158af0 con 0x7f4a7c0723a0 2024-05-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.849+0000 7f4a82a00640 1 -- 172.21.15.59:0/3003183375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a7c068a90 con 0x7f4a7c0723a0 2024-05-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.849+0000 7f4a78c00640 1 -- 172.21.15.59:0/3003183375 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f4a6c01d070 con 0x7f4a7c0723a0 2024-05-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.849+0000 7f4a78c00640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a58069fa0 0x7f4a5806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.849+0000 7f4a78c00640 1 -- 172.21.15.59:0/3003183375 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7f4a6c085bc0 con 0x7f4a7c0723a0 2024-05-30T17:04:41.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.849+0000 7f4a73400640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a58069fa0 0x7f4a5806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:41.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.849+0000 7f4a73400640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a58069fa0 0x7f4a5806c460 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4a640af000 tx=0x7f4a640b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:41.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:41.853+0000 7f4a78c00640 1 -- 172.21.15.59:0/3003183375 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4a6c010070 con 0x7f4a7c0723a0 2024-05-30T17:04:42.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.045+0000 7f4a82a00640 1 -- 172.21.15.59:0/3003183375 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f4a7c16a160 con 0x7f4a58069fa0 2024-05-30T17:04:42.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a78c00640 1 -- 172.21.15.59:0/3003183375 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f4a7c16a160 con 0x7f4a58069fa0 2024-05-30T17:04:42.052 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef 2024-05-30T17:04:42.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a82a00640 1 -- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a58069fa0 msgr2=0x7f4a5806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:42.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a82a00640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a58069fa0 0x7f4a5806c460 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4a640af000 tx=0x7f4a640b6040 comp rx=0 tx=0).stop 2024-05-30T17:04:42.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a82a00640 1 -- 172.21.15.59:0/3003183375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a7c0723a0 msgr2=0x7f4a7c146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:42.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a82a00640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a7c0723a0 0x7f4a7c146fe0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00d100 tx=0x7f4a6c00d5c0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a82a00640 1 -- 172.21.15.59:0/3003183375 shutdown_connections 2024-05-30T17:04:42.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a82a00640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a58069fa0 0x7f4a5806c460 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a82a00640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a7c15ebf0 0x7f4a7c0b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a82a00640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a7c0b3ff0 0x7f4a7c0b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a82a00640 1 --2- 172.21.15.59:0/3003183375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a7c0723a0 0x7f4a7c146fe0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a82a00640 1 -- 172.21.15.59:0/3003183375 >> 172.21.15.59:0/3003183375 conn(0x7f4a7c06bdb0 msgr2=0x7f4a7c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:42.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a82a00640 1 -- 172.21.15.59:0/3003183375 shutdown_connections 2024-05-30T17:04:42.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.053+0000 7f4a82a00640 1 -- 172.21.15.59:0/3003183375 wait complete. 2024-05-30T17:04:42.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T17:04:42.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f3515c00640 1 Processor -- start 2024-05-30T17:04:42.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f3515c00640 1 -- start start 2024-05-30T17:04:42.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f3515c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3510159100 0x7f351006e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:42.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f3515c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f35100b44e0 0x7f351015efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:42.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f3515c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35100b52d0 con 0x7f351015f510 2024-05-30T17:04:42.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f3515c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f35100b4a30 con 0x7f35100b44e0 2024-05-30T17:04:42.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f3515c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f35100b4d10 con 0x7f3510159100 2024-05-30T17:04:42.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f350ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3510159100 0x7f351006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:42.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f350e000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f35100b44e0 0x7f351015efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:42.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f350ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3510159100 0x7f351006e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:42846/0 (socket says 172.21.15.59:42846) 2024-05-30T17:04:42.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f350ea00640 1 -- 172.21.15.59:0/3529393468 learned_addr learned my addr 172.21.15.59:0/3529393468 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:42.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f350e000640 1 -- 172.21.15.59:0/3529393468 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3510159100 msgr2=0x7f351006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:04:42.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f350e000640 1 --2- 172.21.15.59:0/3529393468 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3510159100 0x7f351006e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f350e000640 1 -- 172.21.15.59:0/3529393468 >> v1:172.21.15.107:6789/0 conn(0x7f351015f510 legacy=0x7f351015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:42.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f350e000640 1 -- 172.21.15.59:0/3529393468 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35100b4ff0 con 0x7f35100b44e0 2024-05-30T17:04:42.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.221+0000 7f350ea00640 1 --2- 172.21.15.59:0/3529393468 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3510159100 0x7f351006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:04:42.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.225+0000 7f350e000640 1 --2- 172.21.15.59:0/3529393468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35100b44e0 0x7f351015efd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0097c0 tx=0x7f34fc01c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fdc9a9098de49d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:42.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.225+0000 7f350d600640 1 -- 172.21.15.59:0/3529393468 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0b0070 con 0x7f35100b44e0 2024-05-30T17:04:42.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.225+0000 7f350d600640 1 -- 172.21.15.59:0/3529393468 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34fc004230 con 0x7f35100b44e0 2024-05-30T17:04:42.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.225+0000 7f350d600640 1 -- 172.21.15.59:0/3529393468 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc003620 con 0x7f35100b44e0 2024-05-30T17:04:42.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.225+0000 7f3515c00640 1 -- 172.21.15.59:0/3529393468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35100b44e0 msgr2=0x7f351015efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:42.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.225+0000 7f3515c00640 1 --2- 172.21.15.59:0/3529393468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35100b44e0 0x7f351015efd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0097c0 tx=0x7f34fc01c350 comp rx=0 tx=0).stop 2024-05-30T17:04:42.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.225+0000 7f3515c00640 1 -- 172.21.15.59:0/3529393468 shutdown_connections 2024-05-30T17:04:42.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.225+0000 7f3515c00640 1 --2- 172.21.15.59:0/3529393468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35100b44e0 0x7f351015efd0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.225+0000 7f3515c00640 1 --2- 172.21.15.59:0/3529393468 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3510159100 0x7f351006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.225+0000 7f3515c00640 1 -- 172.21.15.59:0/3529393468 >> 172.21.15.59:0/3529393468 conn(0x7f351006bdb0 msgr2=0x7f351006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:42.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.225+0000 7f3515c00640 1 -- 172.21.15.59:0/3529393468 shutdown_connections 2024-05-30T17:04:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.225+0000 7f3515c00640 1 -- 172.21.15.59:0/3529393468 wait complete. 2024-05-30T17:04:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3515c00640 1 Processor -- start 2024-05-30T17:04:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3515c00640 1 -- start start 2024-05-30T17:04:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3515c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35100b44e0 0x7f3510099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3515c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3510159100 0x7f351013de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3515c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351015f510 0x7f351013e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3515c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3510168140 con 0x7f35100b44e0 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3515c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f35101682c0 con 0x7f351015f510 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3515c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3510168440 con 0x7f3510159100 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f350ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35100b44e0 0x7f3510099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f350ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35100b44e0 0x7f3510099850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44976/0 (socket says 172.21.15.59:44976) 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f350ea00640 1 -- 172.21.15.59:0/1334405109 learned_addr learned my addr 172.21.15.59:0/1334405109 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f350f400640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351015f510 0x7f351013e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f350e000640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3510159100 0x7f351013de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f350ea00640 1 -- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3510159100 msgr2=0x7f351013de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f350ea00640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3510159100 0x7f351013de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f350ea00640 1 -- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351015f510 msgr2=0x7f351013e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f350ea00640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351015f510 0x7f351013e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f350ea00640 1 -- 172.21.15.59:0/1334405109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3510150760 con 0x7f35100b44e0 2024-05-30T17:04:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f350ea00640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35100b44e0 0x7f3510099850 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f350000e9d0 tx=0x7f350000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3506a00640 1 -- 172.21.15.59:0/1334405109 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500017070 con 0x7f35100b44e0 2024-05-30T17:04:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3506a00640 1 -- 172.21.15.59:0/1334405109 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350000ca60 con 0x7f35100b44e0 2024-05-30T17:04:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3515c00640 1 -- 172.21.15.59:0/1334405109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351015e100 con 0x7f35100b44e0 2024-05-30T17:04:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3506a00640 1 -- 172.21.15.59:0/1334405109 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350000ce10 con 0x7f35100b44e0 2024-05-30T17:04:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3515c00640 1 -- 172.21.15.59:0/1334405109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f351013c150 con 0x7f35100b44e0 2024-05-30T17:04:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.229+0000 7f3515c00640 1 -- 172.21.15.59:0/1334405109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3510068a90 con 0x7f35100b44e0 2024-05-30T17:04:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.233+0000 7f3506a00640 1 -- 172.21.15.59:0/1334405109 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 38) ==== 90537+0+0 (secure 0 0 0) 0x7f350001a070 con 0x7f35100b44e0 2024-05-30T17:04:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.233+0000 7f3506a00640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f34f0069fa0 0x7f34f006c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:04:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.233+0000 7f3506a00640 1 -- 172.21.15.59:0/1334405109 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5821+0+0 (secure 0 0 0) 0x7f35000857c0 con 0x7f35100b44e0 2024-05-30T17:04:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.233+0000 7f350e000640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f34f0069fa0 0x7f34f006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:04:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.233+0000 7f350e000640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f34f0069fa0 0x7f34f006c460 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0ad000 tx=0x7f34fc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:04:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.237+0000 7f3506a00640 1 -- 172.21.15.59:0/1334405109 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3510150760 con 0x7f35100b44e0 2024-05-30T17:04:42.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.257+0000 7f3506a00640 1 -- 172.21.15.59:0/1334405109 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 39) ==== 90588+0+0 (secure 0 0 0) 0x7f3500053800 con 0x7f35100b44e0 2024-05-30T17:04:42.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.437+0000 7f3515c00640 1 -- 172.21.15.59:0/1334405109 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f351006ccd0 con 0x7f34f0069fa0 2024-05-30T17:04:42.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3506a00640 1 -- 172.21.15.59:0/1334405109 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f351006ccd0 con 0x7f34f0069fa0 2024-05-30T17:04:42.444 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef 2024-05-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3515c00640 1 -- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f34f0069fa0 msgr2=0x7f34f006c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3515c00640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f34f0069fa0 0x7f34f006c460 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0ad000 tx=0x7f34fc0a6000 comp rx=0 tx=0).stop 2024-05-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3515c00640 1 -- 172.21.15.59:0/1334405109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35100b44e0 msgr2=0x7f3510099850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3515c00640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35100b44e0 0x7f3510099850 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f350000e9d0 tx=0x7f350000ee90 comp rx=0 tx=0).stop 2024-05-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3515c00640 1 -- 172.21.15.59:0/1334405109 shutdown_connections 2024-05-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3515c00640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f34f0069fa0 0x7f34f006c460 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3515c00640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351015f510 0x7f351013e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3515c00640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3510159100 0x7f351013de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3515c00640 1 --2- 172.21.15.59:0/1334405109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35100b44e0 0x7f3510099850 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3515c00640 1 -- 172.21.15.59:0/1334405109 >> 172.21.15.59:0/1334405109 conn(0x7f351006bdb0 msgr2=0x7f35100b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3515c00640 1 -- 172.21.15.59:0/1334405109 shutdown_connections 2024-05-30T17:04:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:04:42.445+0000 7f3515c00640 1 -- 172.21.15.59:0/1334405109 wait complete. 2024-05-30T17:04:42.465 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef 2024-05-30T17:04:42.466 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:04:42.466 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:04:42.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:42.475 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T17:04:49.543 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T17:04:49.543 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T17:04:49.543 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.00144 s, 153 MB/s 2024-05-30T17:04:49.544 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:04:49.544 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:04:49.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:49.553 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T17:04:56.356 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T17:04:56.356 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T17:04:56.356 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.74557 s, 159 MB/s 2024-05-30T17:04:56.357 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:04:56.357 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:04:56.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:04:56.366 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T17:05:03.401 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records in 2024-05-30T17:05:03.401 INFO:teuthology.orchestra.run.smithi059.stderr:1024+0 records out 2024-05-30T17:05:03.402 INFO:teuthology.orchestra.run.smithi059.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.97753 s, 154 MB/s 2024-05-30T17:05:03.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T17:05:03.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98ba800640 1 Processor -- start 2024-05-30T17:05:03.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98ba800640 1 -- start start 2024-05-30T17:05:03.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98ba800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f98b40cfbb0 0x7f98b415ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98ba800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98b40723c0 0x7f98b406e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98ba800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b40b3cf0 con 0x7f98b40b3730 2024-05-30T17:05:03.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98ba800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f98b40b3fd0 con 0x7f98b40723c0 2024-05-30T17:05:03.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98ba800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f98b40b42b0 con 0x7f98b40cfbb0 2024-05-30T17:05:03.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98b3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98b40723c0 0x7f98b406e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98b3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98b40723c0 0x7f98b406e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34344/0 (socket says 172.21.15.59:34344) 2024-05-30T17:05:03.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98b3e00640 1 -- 172.21.15.59:0/1578781858 learned_addr learned my addr 172.21.15.59:0/1578781858 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:03.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98b3400640 1 --2- 172.21.15.59:0/1578781858 >> v2:172.21.15.107:3300/0 conn(0x7f98b40cfbb0 0x7f98b415ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98b3e00640 1 -- 172.21.15.59:0/1578781858 >> v2:172.21.15.107:3300/0 conn(0x7f98b40cfbb0 msgr2=0x7f98b415ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:03.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98b3e00640 1 --2- 172.21.15.59:0/1578781858 >> v2:172.21.15.107:3300/0 conn(0x7f98b40cfbb0 0x7f98b415ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98b3e00640 1 -- 172.21.15.59:0/1578781858 >> v1:172.21.15.107:6789/0 conn(0x7f98b40b3730 legacy=0x7f98b4071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:03.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.548+0000 7f98b3e00640 1 -- 172.21.15.59:0/1578781858 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b40b4590 con 0x7f98b40723c0 2024-05-30T17:05:03.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.552+0000 7f98b3e00640 1 --2- 172.21.15.59:0/1578781858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98b40723c0 0x7f98b406e180 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f98b40741d0 tx=0x7f98ac01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0663dd68f4ff04 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:03.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.552+0000 7f98b2a00640 1 -- 172.21.15.59:0/1578781858 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac0a57d0 con 0x7f98b40723c0 2024-05-30T17:05:03.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.552+0000 7f98b2a00640 1 -- 172.21.15.59:0/1578781858 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ac0a5970 con 0x7f98b40723c0 2024-05-30T17:05:03.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.552+0000 7f98b2a00640 1 -- 172.21.15.59:0/1578781858 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac0a5d40 con 0x7f98b40723c0 2024-05-30T17:05:03.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.552+0000 7f98ba800640 1 -- 172.21.15.59:0/1578781858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98b40723c0 msgr2=0x7f98b406e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:03.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.552+0000 7f98ba800640 1 --2- 172.21.15.59:0/1578781858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98b40723c0 0x7f98b406e180 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f98b40741d0 tx=0x7f98ac01c9f0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.552+0000 7f98ba800640 1 -- 172.21.15.59:0/1578781858 shutdown_connections 2024-05-30T17:05:03.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.552+0000 7f98ba800640 1 --2- 172.21.15.59:0/1578781858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98b40723c0 0x7f98b406e180 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.552+0000 7f98ba800640 1 --2- 172.21.15.59:0/1578781858 >> v2:172.21.15.107:3300/0 conn(0x7f98b40cfbb0 0x7f98b415ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.552+0000 7f98ba800640 1 -- 172.21.15.59:0/1578781858 >> 172.21.15.59:0/1578781858 conn(0x7f98b40b1e60 msgr2=0x7f98b40b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:03.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.552+0000 7f98ba800640 1 -- 172.21.15.59:0/1578781858 shutdown_connections 2024-05-30T17:05:03.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.552+0000 7f98ba800640 1 -- 172.21.15.59:0/1578781858 wait complete. 2024-05-30T17:05:03.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ba800640 1 Processor -- start 2024-05-30T17:05:03.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ba800640 1 -- start start 2024-05-30T17:05:03.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ba800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98b40723c0 0x7f98b40b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ba800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98b40b3730 0x7f98b41532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ba800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98b40cfbb0 0x7f98b41537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ba800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f98b406f260 con 0x7f98b40b3730 2024-05-30T17:05:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ba800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f98b406f0e0 con 0x7f98b40cfbb0 2024-05-30T17:05:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ba800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f98b406f3e0 con 0x7f98b40723c0 2024-05-30T17:05:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98abe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98b40b3730 0x7f98b41532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98abe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98b40b3730 0x7f98b41532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34354/0 (socket says 172.21.15.59:34354) 2024-05-30T17:05:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98abe00640 1 -- 172.21.15.59:0/4104461210 learned_addr learned my addr 172.21.15.59:0/4104461210 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98b3400640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98b40723c0 0x7f98b40b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98b3e00640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98b40cfbb0 0x7f98b41537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98abe00640 1 -- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98b40723c0 msgr2=0x7f98b40b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98abe00640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98b40723c0 0x7f98b40b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98abe00640 1 -- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98b40cfbb0 msgr2=0x7f98b41537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98abe00640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98b40cfbb0 0x7f98b41537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98abe00640 1 -- 172.21.15.59:0/4104461210 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b40c9680 con 0x7f98b40b3730 2024-05-30T17:05:03.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98abe00640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98b40b3730 0x7f98b41532b0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f989c00c420 tx=0x7f989c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:03.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ab400640 1 -- 172.21.15.59:0/4104461210 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c0052d0 con 0x7f98b40b3730 2024-05-30T17:05:03.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ab400640 1 -- 172.21.15.59:0/4104461210 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c005470 con 0x7f98b40b3730 2024-05-30T17:05:03.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ba800640 1 -- 172.21.15.59:0/4104461210 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b40c9960 con 0x7f98b40b3730 2024-05-30T17:05:03.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ab400640 1 -- 172.21.15.59:0/4104461210 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c007260 con 0x7f98b40b3730 2024-05-30T17:05:03.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ba800640 1 -- 172.21.15.59:0/4104461210 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b41525c0 con 0x7f98b40b3730 2024-05-30T17:05:03.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.556+0000 7f98ba800640 1 -- 172.21.15.59:0/4104461210 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b4068a90 con 0x7f98b40b3730 2024-05-30T17:05:03.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.560+0000 7f98ab400640 1 -- 172.21.15.59:0/4104461210 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 40) ==== 90639+0+0 (secure 0 0 0) 0x7f989c007400 con 0x7f98b40b3730 2024-05-30T17:05:03.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.560+0000 7f98ab400640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f989006a0c0 0x7f989006c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.560+0000 7f98ab400640 1 -- 172.21.15.59:0/4104461210 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f989c084e00 con 0x7f98b40b3730 2024-05-30T17:05:03.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.560+0000 7f98b3400640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f989006a0c0 0x7f989006c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.560+0000 7f98b3400640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f989006a0c0 0x7f989006c580 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009b60 tx=0x7f98a4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:03.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.564+0000 7f98ab400640 1 -- 172.21.15.59:0/4104461210 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f989c0567d0 con 0x7f98b40b3730 2024-05-30T17:05:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.764+0000 7f98ba800640 1 -- 172.21.15.59:0/4104461210 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f98b40b2980 con 0x7f989006a0c0 2024-05-30T17:05:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ab400640 1 -- 172.21.15.59:0/4104461210 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f98b40b2980 con 0x7f989006a0c0 2024-05-30T17:05:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ba800640 1 -- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f989006a0c0 msgr2=0x7f989006c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ba800640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f989006a0c0 0x7f989006c580 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009b60 tx=0x7f98a4009190 comp rx=0 tx=0).stop 2024-05-30T17:05:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ba800640 1 -- 172.21.15.59:0/4104461210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98b40b3730 msgr2=0x7f98b41532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ba800640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98b40b3730 0x7f98b41532b0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f989c00c420 tx=0x7f989c00c8e0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ba800640 1 -- 172.21.15.59:0/4104461210 shutdown_connections 2024-05-30T17:05:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ba800640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f989006a0c0 0x7f989006c580 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ba800640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98b40cfbb0 0x7f98b41537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ba800640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98b40b3730 0x7f98b41532b0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ba800640 1 --2- 172.21.15.59:0/4104461210 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98b40723c0 0x7f98b40b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ba800640 1 -- 172.21.15.59:0/4104461210 >> 172.21.15.59:0/4104461210 conn(0x7f98b40b1e60 msgr2=0x7f98b40ad8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ba800640 1 -- 172.21.15.59:0/4104461210 shutdown_connections 2024-05-30T17:05:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.776+0000 7f98ba800640 1 -- 172.21.15.59:0/4104461210 wait complete. 2024-05-30T17:05:03.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T17:05:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585a00640 1 Processor -- start 2024-05-30T17:05:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585a00640 1 -- start start 2024-05-30T17:05:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb58015c480 0x7fb5800cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb580160b80 0x7fb58006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb58006ef30 0x7fb5800ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb5800b43b0 con 0x7fb58006ef30 2024-05-30T17:05:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb5800cc4a0 con 0x7fb580160b80 2024-05-30T17:05:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb58015c860 con 0x7fb58015c480 2024-05-30T17:05:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb58006ef30 0x7fb5800ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb58006ef30 0x7fb5800ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34364/0 (socket says 172.21.15.59:34364) 2024-05-30T17:05:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585000640 1 -- 172.21.15.59:0/2014981097 learned_addr learned my addr 172.21.15.59:0/2014981097 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb577400640 1 --2- 172.21.15.59:0/2014981097 >> v2:172.21.15.107:3300/0 conn(0x7fb580160b80 0x7fb58006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb57fe00640 1 --2- 172.21.15.59:0/2014981097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb58015c480 0x7fb5800cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585000640 1 -- 172.21.15.59:0/2014981097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb58015c480 msgr2=0x7fb5800cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585000640 1 --2- 172.21.15.59:0/2014981097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb58015c480 0x7fb5800cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585000640 1 -- 172.21.15.59:0/2014981097 >> v2:172.21.15.107:3300/0 conn(0x7fb580160b80 msgr2=0x7fb58006e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585000640 1 --2- 172.21.15.59:0/2014981097 >> v2:172.21.15.107:3300/0 conn(0x7fb580160b80 0x7fb58006e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb585000640 1 -- 172.21.15.59:0/2014981097 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5800cbee0 con 0x7fb58006ef30 2024-05-30T17:05:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.940+0000 7fb577400640 1 --2- 172.21.15.59:0/2014981097 >> v2:172.21.15.107:3300/0 conn(0x7fb580160b80 0x7fb58006e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:05:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb585000640 1 --2- 172.21.15.59:0/2014981097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58006ef30 0x7fb5800ccba0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fb58006c990 tx=0x7fb57801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d27bfd124a6bb27 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb57f400640 1 -- 172.21.15.59:0/2014981097 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5780b0070 con 0x7fb58006ef30 2024-05-30T17:05:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb57f400640 1 -- 172.21.15.59:0/2014981097 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5780ab600 con 0x7fb58006ef30 2024-05-30T17:05:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb57f400640 1 -- 172.21.15.59:0/2014981097 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5780ab9d0 con 0x7fb58006ef30 2024-05-30T17:05:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb585a00640 1 -- 172.21.15.59:0/2014981097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58006ef30 msgr2=0x7fb5800ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb585a00640 1 --2- 172.21.15.59:0/2014981097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58006ef30 0x7fb5800ccba0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fb58006c990 tx=0x7fb57801c520 comp rx=0 tx=0).stop 2024-05-30T17:05:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb585a00640 1 -- 172.21.15.59:0/2014981097 shutdown_connections 2024-05-30T17:05:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb585a00640 1 --2- 172.21.15.59:0/2014981097 >> v2:172.21.15.107:3300/0 conn(0x7fb580160b80 0x7fb58006e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb585a00640 1 --2- 172.21.15.59:0/2014981097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58006ef30 0x7fb5800ccba0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb585a00640 1 --2- 172.21.15.59:0/2014981097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb58015c480 0x7fb5800cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb585a00640 1 -- 172.21.15.59:0/2014981097 >> 172.21.15.59:0/2014981097 conn(0x7fb58006b9b0 msgr2=0x7fb58006bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:03.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb585a00640 1 -- 172.21.15.59:0/2014981097 shutdown_connections 2024-05-30T17:05:03.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.944+0000 7fb585a00640 1 -- 172.21.15.59:0/2014981097 wait complete. 2024-05-30T17:05:03.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb585a00640 1 Processor -- start 2024-05-30T17:05:03.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb585a00640 1 -- start start 2024-05-30T17:05:03.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb585a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58006ef30 0x7fb580099300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb585a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb58015c480 0x7fb5800af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb585a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb580160b80 0x7fb5801578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb585a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb5800d0100 con 0x7fb58006ef30 2024-05-30T17:05:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb585a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb5800cd4f0 con 0x7fb58015c480 2024-05-30T17:05:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb585a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb5800d0280 con 0x7fb580160b80 2024-05-30T17:05:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb57fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58006ef30 0x7fb580099300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb57fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58006ef30 0x7fb580099300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34378/0 (socket says 172.21.15.59:34378) 2024-05-30T17:05:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb57fe00640 1 -- 172.21.15.59:0/3134323855 learned_addr learned my addr 172.21.15.59:0/3134323855 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb585000640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb580160b80 0x7fb5801578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb577400640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb58015c480 0x7fb5800af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb57fe00640 1 -- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb580160b80 msgr2=0x7fb5801578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb57fe00640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb580160b80 0x7fb5801578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb57fe00640 1 -- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb58015c480 msgr2=0x7fb5800af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb57fe00640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb58015c480 0x7fb5800af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb57fe00640 1 -- 172.21.15.59:0/3134323855 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5800af870 con 0x7fb58006ef30 2024-05-30T17:05:03.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb57fe00640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58006ef30 0x7fb580099300 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb570007e90 tx=0x7fb57000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:03.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb57cc00640 1 -- 172.21.15.59:0/3134323855 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570014620 con 0x7fb58006ef30 2024-05-30T17:05:03.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb57cc00640 1 -- 172.21.15.59:0/3134323855 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb570019070 con 0x7fb58006ef30 2024-05-30T17:05:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb585a00640 1 -- 172.21.15.59:0/3134323855 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5800addc0 con 0x7fb58006ef30 2024-05-30T17:05:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb57cc00640 1 -- 172.21.15.59:0/3134323855 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570014a00 con 0x7fb58006ef30 2024-05-30T17:05:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.948+0000 7fb585a00640 1 -- 172.21.15.59:0/3134323855 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb58015ca60 con 0x7fb58006ef30 2024-05-30T17:05:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.952+0000 7fb585a00640 1 -- 172.21.15.59:0/3134323855 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb580068a90 con 0x7fb58006ef30 2024-05-30T17:05:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.952+0000 7fb57cc00640 1 -- 172.21.15.59:0/3134323855 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 40) ==== 90639+0+0 (secure 0 0 0) 0x7fb570014ba0 con 0x7fb58006ef30 2024-05-30T17:05:03.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.952+0000 7fb57cc00640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb55c06a0c0 0x7fb55c06c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:03.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.952+0000 7fb57cc00640 1 -- 172.21.15.59:0/3134323855 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fb570086060 con 0x7fb58006ef30 2024-05-30T17:05:03.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.952+0000 7fb577400640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb55c06a0c0 0x7fb55c06c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:03.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.956+0000 7fb577400640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb55c06a0c0 0x7fb55c06c580 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb5801fabc0 tx=0x7fb568008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:03.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:03.956+0000 7fb57cc00640 1 -- 172.21.15.59:0/3134323855 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb570057ad0 con 0x7fb58006ef30 2024-05-30T17:05:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.148+0000 7fb585a00640 1 -- 172.21.15.59:0/3134323855 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fb5800b3c40 con 0x7fb55c06a0c0 2024-05-30T17:05:04.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.152+0000 7fb57cc00640 1 -- 172.21.15.59:0/3134323855 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fb5800b3c40 con 0x7fb55c06a0c0 2024-05-30T17:05:04.155 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef 2024-05-30T17:05:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.156+0000 7fb585a00640 1 -- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb55c06a0c0 msgr2=0x7fb55c06c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.156+0000 7fb585a00640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb55c06a0c0 0x7fb55c06c580 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb5801fabc0 tx=0x7fb568008040 comp rx=0 tx=0).stop 2024-05-30T17:05:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.156+0000 7fb585a00640 1 -- 172.21.15.59:0/3134323855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58006ef30 msgr2=0x7fb580099300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.156+0000 7fb585a00640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58006ef30 0x7fb580099300 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb570007e90 tx=0x7fb57000e4b0 comp rx=0 tx=0).stop 2024-05-30T17:05:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.156+0000 7fb585a00640 1 -- 172.21.15.59:0/3134323855 shutdown_connections 2024-05-30T17:05:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.156+0000 7fb585a00640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb55c06a0c0 0x7fb55c06c580 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.156+0000 7fb585a00640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb580160b80 0x7fb5801578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.156+0000 7fb585a00640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb58015c480 0x7fb5800af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.156+0000 7fb585a00640 1 --2- 172.21.15.59:0/3134323855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58006ef30 0x7fb580099300 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.156+0000 7fb585a00640 1 -- 172.21.15.59:0/3134323855 >> 172.21.15.59:0/3134323855 conn(0x7fb58006b9b0 msgr2=0x7fb580151620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.156+0000 7fb585a00640 1 -- 172.21.15.59:0/3134323855 shutdown_connections 2024-05-30T17:05:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:04.156+0000 7fb585a00640 1 -- 172.21.15.59:0/3134323855 wait complete. 2024-05-30T17:05:04.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:05:04.176 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef 2024-05-30T17:05:04.176 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:05:04.190 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef 2024-05-30T17:05:04.190 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3138256896" 2024-05-30T17:05:04.190 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:05:04.191 INFO:tasks.cephfs.test_volumes:r_size = 3138256896 exp_size = 3221225472 2024-05-30T17:05:06.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:05:06.192 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef 2024-05-30T17:05:06.192 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:05:06.207 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef 2024-05-30T17:05:06.207 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3138256896" 2024-05-30T17:05:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:05:06.208 INFO:tasks.cephfs.test_volumes:r_size = 3138256896 exp_size = 3221225472 2024-05-30T17:05:06.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:05:06.565 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:05:08.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:05:08.209 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef 2024-05-30T17:05:08.209 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:05:08.226 INFO:teuthology.orchestra.run.smithi059.stdout:# file: volumes/_nogroup/sv1/f957bb76-cdf2-47e2-9da1-c9bd195f6fef 2024-05-30T17:05:08.226 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T17:05:08.226 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:05:08.226 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T17:05:08.226 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone67191 2024-05-30T17:05:08.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3058000640 1 Processor -- start 2024-05-30T17:05:08.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3058000640 1 -- start start 2024-05-30T17:05:08.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3058000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f305015c890 0x7f30500cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3058000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f30500b3a70 0x7f305006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3058000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30500c4cf0 con 0x7f305006bef0 2024-05-30T17:05:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3058000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f30500ce160 con 0x7f305015c890 2024-05-30T17:05:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3058000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f30500ce440 con 0x7f30500b3a70 2024-05-30T17:05:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3055600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f305015c890 0x7f30500cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3055600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f305015c890 0x7f30500cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34382/0 (socket says 172.21.15.59:34382) 2024-05-30T17:05:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3055600640 1 -- 172.21.15.59:0/2976368051 learned_addr learned my addr 172.21.15.59:0/2976368051 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3054c00640 1 --2- 172.21.15.59:0/2976368051 >> v2:172.21.15.107:3300/0 conn(0x7f30500b3a70 0x7f305006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:08.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3055600640 1 -- 172.21.15.59:0/2976368051 >> v2:172.21.15.107:3300/0 conn(0x7f30500b3a70 msgr2=0x7f305006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:08.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3055600640 1 --2- 172.21.15.59:0/2976368051 >> v2:172.21.15.107:3300/0 conn(0x7f30500b3a70 0x7f305006b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:08.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3055600640 1 -- 172.21.15.59:0/2976368051 >> v1:172.21.15.107:6789/0 conn(0x7f305006bef0 legacy=0x7f3050160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:08.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.428+0000 7f3055600640 1 -- 172.21.15.59:0/2976368051 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30500ce720 con 0x7f305015c890 2024-05-30T17:05:08.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.432+0000 7f3055600640 1 --2- 172.21.15.59:0/2976368051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305015c890 0x7f30500cda60 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f305006ec70 tx=0x7f304401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f12b3316d552b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:08.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.432+0000 7f304fe00640 1 -- 172.21.15.59:0/2976368051 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30440ab430 con 0x7f305015c890 2024-05-30T17:05:08.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.432+0000 7f304fe00640 1 -- 172.21.15.59:0/2976368051 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30440b0070 con 0x7f305015c890 2024-05-30T17:05:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.432+0000 7f304fe00640 1 -- 172.21.15.59:0/2976368051 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30440ab7f0 con 0x7f305015c890 2024-05-30T17:05:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.432+0000 7f3058000640 1 -- 172.21.15.59:0/2976368051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305015c890 msgr2=0x7f30500cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.432+0000 7f3058000640 1 --2- 172.21.15.59:0/2976368051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305015c890 0x7f30500cda60 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f305006ec70 tx=0x7f304401c520 comp rx=0 tx=0).stop 2024-05-30T17:05:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.432+0000 7f3058000640 1 -- 172.21.15.59:0/2976368051 shutdown_connections 2024-05-30T17:05:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.432+0000 7f3058000640 1 --2- 172.21.15.59:0/2976368051 >> v2:172.21.15.107:3300/0 conn(0x7f30500b3a70 0x7f305006b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.432+0000 7f3058000640 1 --2- 172.21.15.59:0/2976368051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305015c890 0x7f30500cda60 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:08.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.432+0000 7f3058000640 1 -- 172.21.15.59:0/2976368051 >> 172.21.15.59:0/2976368051 conn(0x7f30500b2f50 msgr2=0x7f30500b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:08.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.432+0000 7f3058000640 1 -- 172.21.15.59:0/2976368051 shutdown_connections 2024-05-30T17:05:08.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3058000640 1 -- 172.21.15.59:0/2976368051 wait complete. 2024-05-30T17:05:08.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3058000640 1 Processor -- start 2024-05-30T17:05:08.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3058000640 1 -- start start 2024-05-30T17:05:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3058000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305006bef0 0x7f305014e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3058000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500b3a70 0x7f305015f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3058000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f305015c890 0x7f30500c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3058000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f30501695e0 con 0x7f305006bef0 2024-05-30T17:05:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3058000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f305006c300 con 0x7f305015c890 2024-05-30T17:05:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3058000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3050169760 con 0x7f30500b3a70 2024-05-30T17:05:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3055600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305006bef0 0x7f305014e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3055600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305006bef0 0x7f305014e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34392/0 (socket says 172.21.15.59:34392) 2024-05-30T17:05:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3055600640 1 -- 172.21.15.59:0/2270261593 learned_addr learned my addr 172.21.15.59:0/2270261593 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3056000640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f305015c890 0x7f30500c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3054c00640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500b3a70 0x7f305015f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:08.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3055600640 1 -- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500b3a70 msgr2=0x7f305015f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:08.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3055600640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500b3a70 0x7f305015f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:08.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3055600640 1 -- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f305015c890 msgr2=0x7f30500c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:08.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3055600640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f305015c890 0x7f30500c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:08.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3055600640 1 -- 172.21.15.59:0/2270261593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30500cabf0 con 0x7f305006bef0 2024-05-30T17:05:08.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3056000640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f305015c890 0x7f30500c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:05:08.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.436+0000 7f3055600640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305006bef0 0x7f305014e800 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f3044019130 tx=0x7f304401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.440+0000 7f304d600640 1 -- 172.21.15.59:0/2270261593 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30440b4800 con 0x7f305006bef0 2024-05-30T17:05:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.440+0000 7f304d600640 1 -- 172.21.15.59:0/2270261593 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30440b49a0 con 0x7f305006bef0 2024-05-30T17:05:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.440+0000 7f304d600640 1 -- 172.21.15.59:0/2270261593 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30440b4d70 con 0x7f305006bef0 2024-05-30T17:05:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.440+0000 7f3058000640 1 -- 172.21.15.59:0/2270261593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30500caed0 con 0x7f305006bef0 2024-05-30T17:05:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.440+0000 7f3058000640 1 -- 172.21.15.59:0/2270261593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f305015b6e0 con 0x7f305006bef0 2024-05-30T17:05:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.440+0000 7f3058000640 1 -- 172.21.15.59:0/2270261593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3050068a90 con 0x7f305006bef0 2024-05-30T17:05:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.440+0000 7f304d600640 1 -- 172.21.15.59:0/2270261593 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 40) ==== 90639+0+0 (secure 0 0 0) 0x7f30440b3380 con 0x7f305006bef0 2024-05-30T17:05:08.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.440+0000 7f304d600640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f303006a0c0 0x7f303006c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:08.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.440+0000 7f304d600640 1 -- 172.21.15.59:0/2270261593 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f30440a8070 con 0x7f305006bef0 2024-05-30T17:05:08.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.440+0000 7f3054c00640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f303006a0c0 0x7f303006c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:08.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.444+0000 7f3054c00640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f303006a0c0 0x7f303006c580 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f30500d0560 tx=0x7f303c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:08.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.444+0000 7f304d600640 1 -- 172.21.15.59:0/2270261593 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3044016110 con 0x7f305006bef0 2024-05-30T17:05:08.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.648+0000 7f3058000640 1 -- 172.21.15.59:0/2270261593 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone67191", "target": ["mon-mgr", ""]}) -- 0x7f30500cba10 con 0x7f303006a0c0 2024-05-30T17:05:08.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.708+0000 7f304d600640 1 -- 172.21.15.59:0/2270261593 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f30500cba10 con 0x7f303006a0c0 2024-05-30T17:05:08.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.712+0000 7f3058000640 1 -- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f303006a0c0 msgr2=0x7f303006c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:08.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.712+0000 7f3058000640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f303006a0c0 0x7f303006c580 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f30500d0560 tx=0x7f303c008040 comp rx=0 tx=0).stop 2024-05-30T17:05:08.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.712+0000 7f3058000640 1 -- 172.21.15.59:0/2270261593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305006bef0 msgr2=0x7f305014e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:08.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.712+0000 7f3058000640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305006bef0 0x7f305014e800 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f3044019130 tx=0x7f304401ad60 comp rx=0 tx=0).stop 2024-05-30T17:05:08.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.712+0000 7f3058000640 1 -- 172.21.15.59:0/2270261593 shutdown_connections 2024-05-30T17:05:08.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.712+0000 7f3058000640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f303006a0c0 0x7f303006c580 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:08.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.712+0000 7f3058000640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f305015c890 0x7f30500c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:08.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.712+0000 7f3058000640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500b3a70 0x7f305015f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:08.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.712+0000 7f3058000640 1 --2- 172.21.15.59:0/2270261593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305006bef0 0x7f305014e800 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:08.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.712+0000 7f3058000640 1 -- 172.21.15.59:0/2270261593 >> 172.21.15.59:0/2270261593 conn(0x7f30500b2f50 msgr2=0x7f30500b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:08.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.712+0000 7f3058000640 1 -- 172.21.15.59:0/2270261593 shutdown_connections 2024-05-30T17:05:08.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.712+0000 7f3058000640 1 -- 172.21.15.59:0/2270261593 wait complete. 2024-05-30T17:05:08.713 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:08.717+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:08.713 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:08.717+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:08.714 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:08.717+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:08.714 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:08.717+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:08.714 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:08.717+0000 7efd73400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:08.729 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:08.733+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:08.730 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:08.733+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:08.730 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:08.733+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:08.730 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:08.733+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:08.730 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:08.733+0000 7efd74800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:08.733 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone67192 2024-05-30T17:05:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.880+0000 7f0076000640 1 Processor -- start 2024-05-30T17:05:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.880+0000 7f0076000640 1 -- start start 2024-05-30T17:05:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f0076000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f00700d0d70 0x7f007015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f0076000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00700ad770 con 0x7f00700ad2b0 2024-05-30T17:05:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f0076000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f007015cb40 con 0x7f00701569e0 2024-05-30T17:05:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f0076000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f007015ce20 con 0x7f00700d0d70 2024-05-30T17:05:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f0067e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f00700ad2b0 0x7f00700d0660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36338/0 (socket says 172.21.15.59:36338) 2024-05-30T17:05:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f0067e00640 1 -- 172.21.15.59:0/865390761 learned_addr learned my addr 172.21.15.59:0/865390761 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f006fe00640 1 --2- 172.21.15.59:0/865390761 >> v2:172.21.15.107:3300/0 conn(0x7f00700d0d70 0x7f007015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f006ea00640 1 -- 172.21.15.59:0/865390761 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 197862175 0 0) 0x7f00700ad770 con 0x7f00700ad2b0 2024-05-30T17:05:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f006ea00640 1 -- 172.21.15.59:0/865390761 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0054003530 con 0x7f00700ad2b0 2024-05-30T17:05:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f006ea00640 1 -- 172.21.15.59:0/865390761 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2462999109 0 0) 0x7f007015cb40 con 0x7f00701569e0 2024-05-30T17:05:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f006ea00640 1 -- 172.21.15.59:0/865390761 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00700ad770 con 0x7f00701569e0 2024-05-30T17:05:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f006ea00640 1 -- 172.21.15.59:0/865390761 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 29345737 0 0) 0x7f0054003530 con 0x7f00700ad2b0 2024-05-30T17:05:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f006fe00640 1 -- 172.21.15.59:0/865390761 >> v1:172.21.15.107:6789/0 conn(0x7f00701569e0 legacy=0x7f00700cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:08.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f006fe00640 1 -- 172.21.15.59:0/865390761 >> v1:172.21.15.59:6789/0 conn(0x7f00700ad2b0 legacy=0x7f00700d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:08.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.884+0000 7f006fe00640 1 -- 172.21.15.59:0/865390761 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007015d100 con 0x7f00700d0d70 2024-05-30T17:05:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f006fe00640 1 --2- 172.21.15.59:0/865390761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00700d0d70 0x7f007015d620 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0068009d90 tx=0x7f006801c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b131cb57b37550bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:08.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f006ea00640 1 -- 172.21.15.59:0/865390761 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00680b2070 con 0x7f00700d0d70 2024-05-30T17:05:08.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f006ea00640 1 -- 172.21.15.59:0/865390761 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00680a5550 con 0x7f00700d0d70 2024-05-30T17:05:08.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f006ea00640 1 -- 172.21.15.59:0/865390761 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058001680 con 0x7f00700d0d70 2024-05-30T17:05:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f0076000640 1 -- 172.21.15.59:0/865390761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00700d0d70 msgr2=0x7f007015d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f0076000640 1 --2- 172.21.15.59:0/865390761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00700d0d70 0x7f007015d620 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0068009d90 tx=0x7f006801c800 comp rx=0 tx=0).stop 2024-05-30T17:05:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f0076000640 1 -- 172.21.15.59:0/865390761 shutdown_connections 2024-05-30T17:05:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f0076000640 1 --2- 172.21.15.59:0/865390761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00700d0d70 0x7f007015d620 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f0076000640 1 -- 172.21.15.59:0/865390761 >> 172.21.15.59:0/865390761 conn(0x7f007006bdb0 msgr2=0x7f007006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f0076000640 1 -- 172.21.15.59:0/865390761 shutdown_connections 2024-05-30T17:05:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f0076000640 1 -- 172.21.15.59:0/865390761 wait complete. 2024-05-30T17:05:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f0076000640 1 Processor -- start 2024-05-30T17:05:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.888+0000 7f0076000640 1 -- start start 2024-05-30T17:05:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0076000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00700ad2b0 0x7f00700b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0076000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00700d0d70 0x7f007009e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0076000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00701569e0 0x7f007014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0076000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f00700b3ef0 con 0x7f00700ad2b0 2024-05-30T17:05:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0076000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f00700b3d70 con 0x7f00700d0d70 2024-05-30T17:05:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0076000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f00700b4070 con 0x7f00701569e0 2024-05-30T17:05:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f006f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00700ad2b0 0x7f00700b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f006f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00700ad2b0 0x7f00700b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34408/0 (socket says 172.21.15.59:34408) 2024-05-30T17:05:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f006f400640 1 -- 172.21.15.59:0/2698051353 learned_addr learned my addr 172.21.15.59:0/2698051353 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0067e00640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00700d0d70 0x7f007009e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f006fe00640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00701569e0 0x7f007014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f006f400640 1 -- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00701569e0 msgr2=0x7f007014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f006f400640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00701569e0 0x7f007014fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f006f400640 1 -- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00700d0d70 msgr2=0x7f007009e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f006f400640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00700d0d70 0x7f007009e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f006f400640 1 -- 172.21.15.59:0/2698051353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00700d0ba0 con 0x7f00700ad2b0 2024-05-30T17:05:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f006f400640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00700ad2b0 0x7f00700b2220 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f006000c460 tx=0x7f006000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0067400640 1 -- 172.21.15.59:0/2698051353 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00600052d0 con 0x7f00700ad2b0 2024-05-30T17:05:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0067400640 1 -- 172.21.15.59:0/2698051353 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0060005490 con 0x7f00700ad2b0 2024-05-30T17:05:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0067400640 1 -- 172.21.15.59:0/2698051353 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060012850 con 0x7f00700ad2b0 2024-05-30T17:05:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0076000640 1 -- 172.21.15.59:0/2698051353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0070150540 con 0x7f00700ad2b0 2024-05-30T17:05:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0076000640 1 -- 172.21.15.59:0/2698051353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0070150b00 con 0x7f00700ad2b0 2024-05-30T17:05:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0076000640 1 -- 172.21.15.59:0/2698051353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0070068a90 con 0x7f00700ad2b0 2024-05-30T17:05:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.892+0000 7f0067400640 1 -- 172.21.15.59:0/2698051353 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 40) ==== 90639+0+0 (secure 0 0 0) 0x7f00600129f0 con 0x7f00700ad2b0 2024-05-30T17:05:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.896+0000 7f0067400640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f004c06a0f0 0x7f004c06c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.896+0000 7f0067400640 1 -- 172.21.15.59:0/2698051353 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f0060085410 con 0x7f00700ad2b0 2024-05-30T17:05:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.896+0000 7f0067e00640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f004c06a0f0 0x7f004c06c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.896+0000 7f0067e00640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f004c06a0f0 0x7f004c06c5b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f007014dd70 tx=0x7f00580016a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:08.900+0000 7f0067400640 1 -- 172.21.15.59:0/2698051353 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0060056df0 con 0x7f00700ad2b0 2024-05-30T17:05:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.096+0000 7f0076000640 1 -- 172.21.15.59:0/2698051353 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone67192", "target": ["mon-mgr", ""]}) -- 0x7f00700b2e00 con 0x7f004c06a0f0 2024-05-30T17:05:09.715 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:09.717+0000 7efd04000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:09.715 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:09.717+0000 7efd04000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:09.715 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:09.717+0000 7efd04000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:09.715 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:09.717+0000 7efd04000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:09.715 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:09.717+0000 7efd04000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.816+0000 7f0067400640 1 -- 172.21.15.59:0/2698051353 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f00700b2e00 con 0x7f004c06a0f0 2024-05-30T17:05:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.820+0000 7f0076000640 1 -- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f004c06a0f0 msgr2=0x7f004c06c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.820+0000 7f0076000640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f004c06a0f0 0x7f004c06c5b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f007014dd70 tx=0x7f00580016a0 comp rx=0 tx=0).stop 2024-05-30T17:05:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.820+0000 7f0076000640 1 -- 172.21.15.59:0/2698051353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00700ad2b0 msgr2=0x7f00700b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.820+0000 7f0076000640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00700ad2b0 0x7f00700b2220 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f006000c460 tx=0x7f006000c920 comp rx=0 tx=0).stop 2024-05-30T17:05:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.820+0000 7f0076000640 1 -- 172.21.15.59:0/2698051353 shutdown_connections 2024-05-30T17:05:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.820+0000 7f0076000640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f004c06a0f0 0x7f004c06c5b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.820+0000 7f0076000640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00701569e0 0x7f007014fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:09.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.820+0000 7f0076000640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00700d0d70 0x7f007009e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:09.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.820+0000 7f0076000640 1 --2- 172.21.15.59:0/2698051353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00700ad2b0 0x7f00700b2220 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:09.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.820+0000 7f0076000640 1 -- 172.21.15.59:0/2698051353 >> 172.21.15.59:0/2698051353 conn(0x7f007006bdb0 msgr2=0x7f007015b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:09.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.820+0000 7f0076000640 1 -- 172.21.15.59:0/2698051353 shutdown_connections 2024-05-30T17:05:09.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:09.820+0000 7f0076000640 1 -- 172.21.15.59:0/2698051353 wait complete. 2024-05-30T17:05:09.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone67193 2024-05-30T17:05:09.857 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:09.857+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:09.857 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:09.857+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:09.857 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:09.857+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:09.857 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:09.857+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:09.857 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:09.857+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:10.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.080+0000 7ff88b200640 1 Processor -- start 2024-05-30T17:05:10.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.080+0000 7ff88b200640 1 -- start start 2024-05-30T17:05:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.080+0000 7ff88b200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff88415b5e0 0x7ff88406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.080+0000 7ff88b200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff8840adea0 0x7ff8840ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.080+0000 7ff88b200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff88406e660 con 0x7ff884073540 2024-05-30T17:05:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.080+0000 7ff88b200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff8840ae840 con 0x7ff8840adea0 2024-05-30T17:05:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.080+0000 7ff88b200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff88406fbc0 con 0x7ff88415b5e0 2024-05-30T17:05:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.080+0000 7ff87be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff884073540 0x7ff88415f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36350/0 (socket says 172.21.15.59:36350) 2024-05-30T17:05:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.080+0000 7ff87be00640 1 -- 172.21.15.59:0/1754183273 learned_addr learned my addr 172.21.15.59:0/1754183273 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.080+0000 7ff889200640 1 --2- 172.21.15.59:0/1754183273 >> v2:172.21.15.107:3300/0 conn(0x7ff8840adea0 0x7ff8840ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.080+0000 7ff883e00640 1 --2- 172.21.15.59:0/1754183273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff88415b5e0 0x7ff88406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.084+0000 7ff883e00640 1 -- 172.21.15.59:0/1754183273 >> v2:172.21.15.107:3300/0 conn(0x7ff8840adea0 msgr2=0x7ff8840ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.084+0000 7ff883e00640 1 --2- 172.21.15.59:0/1754183273 >> v2:172.21.15.107:3300/0 conn(0x7ff8840adea0 0x7ff8840ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.084+0000 7ff883e00640 1 -- 172.21.15.59:0/1754183273 >> v1:172.21.15.59:6789/0 conn(0x7ff884073540 legacy=0x7ff88415f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.084+0000 7ff883e00640 1 -- 172.21.15.59:0/1754183273 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88415f0f0 con 0x7ff88415b5e0 2024-05-30T17:05:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.088+0000 7ff883e00640 1 --2- 172.21.15.59:0/1754183273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff88415b5e0 0x7ff88406ed40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff8740097c0 tx=0x7ff87401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e861a4562355435c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.088+0000 7ff883400640 1 -- 172.21.15.59:0/1754183273 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8740b0070 con 0x7ff88415b5e0 2024-05-30T17:05:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.088+0000 7ff883400640 1 -- 172.21.15.59:0/1754183273 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8740ab600 con 0x7ff88415b5e0 2024-05-30T17:05:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.088+0000 7ff883400640 1 -- 172.21.15.59:0/1754183273 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8740ab9d0 con 0x7ff88415b5e0 2024-05-30T17:05:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.088+0000 7ff88b200640 1 -- 172.21.15.59:0/1754183273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff88415b5e0 msgr2=0x7ff88406ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.088+0000 7ff88b200640 1 --2- 172.21.15.59:0/1754183273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff88415b5e0 0x7ff88406ed40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff8740097c0 tx=0x7ff87401c410 comp rx=0 tx=0).stop 2024-05-30T17:05:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.088+0000 7ff88b200640 1 -- 172.21.15.59:0/1754183273 shutdown_connections 2024-05-30T17:05:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.088+0000 7ff88b200640 1 --2- 172.21.15.59:0/1754183273 >> v2:172.21.15.107:3300/0 conn(0x7ff8840adea0 0x7ff8840ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.088+0000 7ff88b200640 1 --2- 172.21.15.59:0/1754183273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff88415b5e0 0x7ff88406ed40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.088+0000 7ff88b200640 1 -- 172.21.15.59:0/1754183273 >> 172.21.15.59:0/1754183273 conn(0x7ff88406bdb0 msgr2=0x7ff88406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.088+0000 7ff88b200640 1 -- 172.21.15.59:0/1754183273 shutdown_connections 2024-05-30T17:05:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.088+0000 7ff88b200640 1 -- 172.21.15.59:0/1754183273 wait complete. 2024-05-30T17:05:10.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.092+0000 7ff88b200640 1 Processor -- start 2024-05-30T17:05:10.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.092+0000 7ff88b200640 1 -- start start 2024-05-30T17:05:10.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.092+0000 7ff88b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff884073540 0x7ff88414d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:10.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.092+0000 7ff88b200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840adea0 0x7ff88415a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:10.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.092+0000 7ff88b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8841494c0 0x7ff88414de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.092+0000 7ff88b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff88415fe60 con 0x7ff884073540 2024-05-30T17:05:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.092+0000 7ff88b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff88415fce0 con 0x7ff8841494c0 2024-05-30T17:05:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.092+0000 7ff88b200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff8840b33d0 con 0x7ff8840adea0 2024-05-30T17:05:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.092+0000 7ff883e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff884073540 0x7ff88414d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.092+0000 7ff883e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff884073540 0x7ff88414d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34412/0 (socket says 172.21.15.59:34412) 2024-05-30T17:05:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.092+0000 7ff883e00640 1 -- 172.21.15.59:0/4117771915 learned_addr learned my addr 172.21.15.59:0/4117771915 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff87be00640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840adea0 0x7ff88415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff889200640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8841494c0 0x7ff88414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff883e00640 1 -- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840adea0 msgr2=0x7ff88415a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff883e00640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840adea0 0x7ff88415a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff883e00640 1 -- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8841494c0 msgr2=0x7ff88414de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff883e00640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8841494c0 0x7ff88414de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff883e00640 1 -- 172.21.15.59:0/4117771915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88409b570 con 0x7ff884073540 2024-05-30T17:05:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff883e00640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff884073540 0x7ff88414d200 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7ff87401a040 tx=0x7ff87401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff880c00640 1 -- 172.21.15.59:0/4117771915 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8740b0050 con 0x7ff884073540 2024-05-30T17:05:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff880c00640 1 -- 172.21.15.59:0/4117771915 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8740bc070 con 0x7ff884073540 2024-05-30T17:05:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff880c00640 1 -- 172.21.15.59:0/4117771915 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8740b5850 con 0x7ff884073540 2024-05-30T17:05:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff88b200640 1 -- 172.21.15.59:0/4117771915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88409afb0 con 0x7ff884073540 2024-05-30T17:05:10.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.096+0000 7ff88b200640 1 -- 172.21.15.59:0/4117771915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88414f130 con 0x7ff884073540 2024-05-30T17:05:10.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.100+0000 7ff88b200640 1 -- 172.21.15.59:0/4117771915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff85c0052a0 con 0x7ff884073540 2024-05-30T17:05:10.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.108+0000 7ff880c00640 1 -- 172.21.15.59:0/4117771915 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 40) ==== 90639+0+0 (secure 0 0 0) 0x7ff8740b59f0 con 0x7ff884073540 2024-05-30T17:05:10.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.112+0000 7ff880c00640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff86006a0c0 0x7ff86006c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:10.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.112+0000 7ff880c00640 1 -- 172.21.15.59:0/4117771915 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7ff874120d70 con 0x7ff884073540 2024-05-30T17:05:10.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.116+0000 7ff87be00640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff86006a0c0 0x7ff86006c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:10.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.116+0000 7ff880c00640 1 -- 172.21.15.59:0/4117771915 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff88409b570 con 0x7ff884073540 2024-05-30T17:05:10.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.124+0000 7ff87be00640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff86006a0c0 0x7ff86006c580 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff884165440 tx=0x7ff86c007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:10.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.484+0000 7ff880c00640 1 -- 172.21.15.59:0/4117771915 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 41) ==== 90741+0+0 (secure 0 0 0) 0x7ff8740eeea0 con 0x7ff884073540 2024-05-30T17:05:10.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:10.492+0000 7ff88b200640 1 -- 172.21.15.59:0/4117771915 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone67193", "target": ["mon-mgr", ""]}) -- 0x7ff85c000c90 con 0x7ff86006a0c0 2024-05-30T17:05:11.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.084+0000 7ff880c00640 1 -- 172.21.15.59:0/4117771915 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff85c000c90 con 0x7ff86006a0c0 2024-05-30T17:05:11.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.088+0000 7ff88b200640 1 -- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff86006a0c0 msgr2=0x7ff86006c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:11.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.088+0000 7ff88b200640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff86006a0c0 0x7ff86006c580 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff884165440 tx=0x7ff86c007e90 comp rx=0 tx=0).stop 2024-05-30T17:05:11.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.088+0000 7ff88b200640 1 -- 172.21.15.59:0/4117771915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff884073540 msgr2=0x7ff88414d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.088+0000 7ff88b200640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff884073540 0x7ff88414d200 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7ff87401a040 tx=0x7ff87401ac50 comp rx=0 tx=0).stop 2024-05-30T17:05:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.088+0000 7ff88b200640 1 -- 172.21.15.59:0/4117771915 shutdown_connections 2024-05-30T17:05:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.088+0000 7ff88b200640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff86006a0c0 0x7ff86006c580 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.088+0000 7ff88b200640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8841494c0 0x7ff88414de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.088+0000 7ff88b200640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840adea0 0x7ff88415a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.088+0000 7ff88b200640 1 --2- 172.21.15.59:0/4117771915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff884073540 0x7ff88414d200 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.088+0000 7ff88b200640 1 -- 172.21.15.59:0/4117771915 >> 172.21.15.59:0/4117771915 conn(0x7ff88406bdb0 msgr2=0x7ff8840afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:11.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.088+0000 7ff88b200640 1 -- 172.21.15.59:0/4117771915 shutdown_connections 2024-05-30T17:05:11.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.088+0000 7ff88b200640 1 -- 172.21.15.59:0/4117771915 wait complete. 2024-05-30T17:05:11.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone67194 2024-05-30T17:05:11.211 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:11.213+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:11.211 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:11.213+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:11.211 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:11.213+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:11.211 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:11.213+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:11.211 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:11.213+0000 7efd73e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:11.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f554f400640 1 Processor -- start 2024-05-30T17:05:11.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f554f400640 1 -- start start 2024-05-30T17:05:11.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f554f400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f55480cfe00 0x7f554806ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:11.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f554f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55480ce490 0x7f55480cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:11.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f554f400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55480679b0 con 0x7f55480d01e0 2024-05-30T17:05:11.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f554f400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f55480704c0 con 0x7f55480ce490 2024-05-30T17:05:11.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f554f400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5548067760 con 0x7f55480cfe00 2024-05-30T17:05:11.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f5547e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55480ce490 0x7f55480cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:11.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f554d400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f55480d01e0 0x7f55480cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36364/0 (socket says 172.21.15.59:36364) 2024-05-30T17:05:11.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f554d400640 1 -- 172.21.15.59:0/2076647593 learned_addr learned my addr 172.21.15.59:0/2076647593 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:11.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f5547e00640 1 -- 172.21.15.59:0/2076647593 >> v2:172.21.15.107:3300/0 conn(0x7f55480cfe00 msgr2=0x7f554806ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:11.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f5547e00640 1 --2- 172.21.15.59:0/2076647593 >> v2:172.21.15.107:3300/0 conn(0x7f55480cfe00 0x7f554806ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:11.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f5547e00640 1 -- 172.21.15.59:0/2076647593 >> v1:172.21.15.59:6789/0 conn(0x7f55480d01e0 legacy=0x7f55480cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:11.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.404+0000 7f5547e00640 1 -- 172.21.15.59:0/2076647593 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5548067c90 con 0x7f55480ce490 2024-05-30T17:05:11.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.408+0000 7f5547e00640 1 --2- 172.21.15.59:0/2076647593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55480ce490 0x7f55480cea80 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f5548073f10 tx=0x7f553401c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef117d060e0bfd18 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:11.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.408+0000 7f5547400640 1 -- 172.21.15.59:0/2076647593 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55340b0070 con 0x7f55480ce490 2024-05-30T17:05:11.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.408+0000 7f5547400640 1 -- 172.21.15.59:0/2076647593 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55340ab600 con 0x7f55480ce490 2024-05-30T17:05:11.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.408+0000 7f5547400640 1 -- 172.21.15.59:0/2076647593 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55340ab9d0 con 0x7f55480ce490 2024-05-30T17:05:11.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.408+0000 7f554f400640 1 -- 172.21.15.59:0/2076647593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55480ce490 msgr2=0x7f55480cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:11.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.408+0000 7f554f400640 1 --2- 172.21.15.59:0/2076647593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55480ce490 0x7f55480cea80 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f5548073f10 tx=0x7f553401c280 comp rx=0 tx=0).stop 2024-05-30T17:05:11.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.408+0000 7f554f400640 1 -- 172.21.15.59:0/2076647593 shutdown_connections 2024-05-30T17:05:11.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.408+0000 7f554f400640 1 --2- 172.21.15.59:0/2076647593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55480ce490 0x7f55480cea80 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:11.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.408+0000 7f554f400640 1 --2- 172.21.15.59:0/2076647593 >> v2:172.21.15.107:3300/0 conn(0x7f55480cfe00 0x7f554806ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:11.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.408+0000 7f554f400640 1 -- 172.21.15.59:0/2076647593 >> 172.21.15.59:0/2076647593 conn(0x7f55480cd680 msgr2=0x7f55480cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:11.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.408+0000 7f554f400640 1 -- 172.21.15.59:0/2076647593 shutdown_connections 2024-05-30T17:05:11.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.408+0000 7f554f400640 1 -- 172.21.15.59:0/2076647593 wait complete. 2024-05-30T17:05:11.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.412+0000 7f554f400640 1 Processor -- start 2024-05-30T17:05:11.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.412+0000 7f554f400640 1 -- start start 2024-05-30T17:05:11.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.412+0000 7f554f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55480ce490 0x7f55481f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:11.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.412+0000 7f554f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55480cfe00 0x7f5548158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:11.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.412+0000 7f554f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55480d01e0 0x7f55481e5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:11.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.412+0000 7f554f400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f554806bee0 con 0x7f55480cfe00 2024-05-30T17:05:11.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.412+0000 7f554f400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f554806b9b0 con 0x7f55480d01e0 2024-05-30T17:05:11.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.412+0000 7f554f400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f55480add80 con 0x7f55480ce490 2024-05-30T17:05:11.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.412+0000 7f5547e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55480cfe00 0x7f5548158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:11.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.412+0000 7f5547e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55480cfe00 0x7f5548158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34428/0 (socket says 172.21.15.59:34428) 2024-05-30T17:05:11.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.412+0000 7f5547e00640 1 -- 172.21.15.59:0/2802612137 learned_addr learned my addr 172.21.15.59:0/2802612137 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:11.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.416+0000 7f5547e00640 1 -- 172.21.15.59:0/2802612137 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55480ce490 msgr2=0x7f55481f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:11.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.416+0000 7f5547e00640 1 --2- 172.21.15.59:0/2802612137 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55480ce490 0x7f55481f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:11.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.416+0000 7f5547e00640 1 -- 172.21.15.59:0/2802612137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55480d01e0 msgr2=0x7f55481e5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:11.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.416+0000 7f5547e00640 1 --2- 172.21.15.59:0/2802612137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55480d01e0 0x7f55481e5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:11.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.416+0000 7f5547e00640 1 -- 172.21.15.59:0/2802612137 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55481e6b00 con 0x7f55480cfe00 2024-05-30T17:05:11.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.416+0000 7f5547e00640 1 --2- 172.21.15.59:0/2802612137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55480cfe00 0x7f5548158a30 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f55340ae040 tx=0x7f553401aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:11.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.416+0000 7f5544c00640 1 -- 172.21.15.59:0/2802612137 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55340b0050 con 0x7f55480cfe00 2024-05-30T17:05:11.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.416+0000 7f5544c00640 1 -- 172.21.15.59:0/2802612137 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55340bc070 con 0x7f55480cfe00 2024-05-30T17:05:11.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.416+0000 7f5544c00640 1 -- 172.21.15.59:0/2802612137 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55340aae20 con 0x7f55480cfe00 2024-05-30T17:05:11.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.416+0000 7f554f400640 1 -- 172.21.15.59:0/2802612137 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55481e6de0 con 0x7f55480cfe00 2024-05-30T17:05:11.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.416+0000 7f554f400640 1 -- 172.21.15.59:0/2802612137 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55481e73a0 con 0x7f55480cfe00 2024-05-30T17:05:11.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.416+0000 7f554f400640 1 -- 172.21.15.59:0/2802612137 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55480691a0 con 0x7f55480cfe00 2024-05-30T17:05:11.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.420+0000 7f5544c00640 1 -- 172.21.15.59:0/2802612137 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 41) ==== 90741+0+0 (secure 0 0 0) 0x7f55340ab4c0 con 0x7f55480cfe00 2024-05-30T17:05:11.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.420+0000 7f5544c00640 1 --2- 172.21.15.59:0/2802612137 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f552806a1e0 0x7f552806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:11.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.420+0000 7f5544c00640 1 -- 172.21.15.59:0/2802612137 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f5534120730 con 0x7f55480cfe00 2024-05-30T17:05:11.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.432+0000 7f5544c00640 1 -- 172.21.15.59:0/2802612137 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5534015f90 con 0x7f55480cfe00 2024-05-30T17:05:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.452+0000 7f554ca00640 1 --2- 172.21.15.59:0/2802612137 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f552806a1e0 0x7f552806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:11.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.468+0000 7f554ca00640 1 --2- 172.21.15.59:0/2802612137 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f552806a1e0 0x7f552806c6a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f553c009690 tx=0x7f553c006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.740+0000 7f5544c00640 1 -- 172.21.15.59:0/2802612137 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 42) ==== 90894+0+0 (secure 0 0 0) 0x7f55340ee760 con 0x7f55480cfe00 2024-05-30T17:05:11.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:11.784+0000 7f554f400640 1 -- 172.21.15.59:0/2802612137 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone67194", "target": ["mon-mgr", ""]}) -- 0x7f554806e520 con 0x7f552806a1e0 2024-05-30T17:05:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.280+0000 7f5544c00640 1 -- 172.21.15.59:0/2802612137 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f554806e520 con 0x7f552806a1e0 2024-05-30T17:05:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.284+0000 7f554f400640 1 -- 172.21.15.59:0/2802612137 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f552806a1e0 msgr2=0x7f552806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.284+0000 7f554f400640 1 --2- 172.21.15.59:0/2802612137 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f552806a1e0 0x7f552806c6a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f553c009690 tx=0x7f553c006c00 comp rx=0 tx=0).stop 2024-05-30T17:05:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.284+0000 7f554f400640 1 -- 172.21.15.59:0/2802612137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55480cfe00 msgr2=0x7f5548158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.284+0000 7f554f400640 1 --2- 172.21.15.59:0/2802612137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55480cfe00 0x7f5548158a30 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f55340ae040 tx=0x7f553401aac0 comp rx=0 tx=0).stop 2024-05-30T17:05:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.284+0000 7f554f400640 1 -- 172.21.15.59:0/2802612137 shutdown_connections 2024-05-30T17:05:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.284+0000 7f554f400640 1 --2- 172.21.15.59:0/2802612137 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f552806a1e0 0x7f552806c6a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.284+0000 7f554f400640 1 --2- 172.21.15.59:0/2802612137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55480d01e0 0x7f55481e5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.284+0000 7f554f400640 1 --2- 172.21.15.59:0/2802612137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55480cfe00 0x7f5548158a30 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.284+0000 7f554f400640 1 --2- 172.21.15.59:0/2802612137 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55480ce490 0x7f55481f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.284+0000 7f554f400640 1 -- 172.21.15.59:0/2802612137 >> 172.21.15.59:0/2802612137 conn(0x7f55480cd680 msgr2=0x7f55480ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.284+0000 7f554f400640 1 -- 172.21.15.59:0/2802612137 shutdown_connections 2024-05-30T17:05:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.284+0000 7f554f400640 1 -- 172.21.15.59:0/2802612137 wait complete. 2024-05-30T17:05:12.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone67195 2024-05-30T17:05:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.560+0000 7f4ceca00640 1 Processor -- start 2024-05-30T17:05:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.560+0000 7f4ceca00640 1 -- start start 2024-05-30T17:05:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.560+0000 7f4ceca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ce809b4b0 0x7f4ce806cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.560+0000 7f4ceca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ce8162340 0x7f4ce81627d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.560+0000 7f4ceca00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce80d0fb0 con 0x7f4ce809b890 2024-05-30T17:05:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.560+0000 7f4ceca00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4ce806fef0 con 0x7f4ce809b4b0 2024-05-30T17:05:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.560+0000 7f4ceca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce80d1290 con 0x7f4ce8162340 2024-05-30T17:05:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.564+0000 7f4cdde00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4ce809b890 0x7f4ce80d0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46314/0 (socket says 172.21.15.59:46314) 2024-05-30T17:05:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.564+0000 7f4cdde00640 1 -- 172.21.15.59:0/2623224487 learned_addr learned my addr 172.21.15.59:0/2623224487 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.564+0000 7f4ce6800640 1 --2- 172.21.15.59:0/2623224487 >> v2:172.21.15.59:3300/0 conn(0x7f4ce809b4b0 0x7f4ce806cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.564+0000 7f4ce6800640 1 -- 172.21.15.59:0/2623224487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ce8162340 msgr2=0x7f4ce81627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.564+0000 7f4ce7200640 1 --2- 172.21.15.59:0/2623224487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ce8162340 0x7f4ce81627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.564+0000 7f4ce6800640 1 --2- 172.21.15.59:0/2623224487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ce8162340 0x7f4ce81627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:12.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.564+0000 7f4ce6800640 1 -- 172.21.15.59:0/2623224487 >> v1:172.21.15.59:6789/0 conn(0x7f4ce809b890 legacy=0x7f4ce80d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:12.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.564+0000 7f4ce6800640 1 -- 172.21.15.59:0/2623224487 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce80d1570 con 0x7f4ce809b4b0 2024-05-30T17:05:12.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.564+0000 7f4ce5e00640 1 -- 172.21.15.59:0/2623224487 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3598256504 0 0) 0x7f4ce80d0fb0 con 0x7f4ce809b890 2024-05-30T17:05:12.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.564+0000 7f4ce7200640 1 --2- 172.21.15.59:0/2623224487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ce8162340 0x7f4ce81627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:05:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.564+0000 7f4ce6800640 1 --2- 172.21.15.59:0/2623224487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce809b4b0 0x7f4ce806cac0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80097c0 tx=0x7f4cd801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f8a7ca23be8d2e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.568+0000 7f4ce5e00640 1 -- 172.21.15.59:0/2623224487 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80b0070 con 0x7f4ce809b4b0 2024-05-30T17:05:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.568+0000 7f4ce5e00640 1 -- 172.21.15.59:0/2623224487 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd80ab600 con 0x7f4ce809b4b0 2024-05-30T17:05:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.568+0000 7f4ce5e00640 1 -- 172.21.15.59:0/2623224487 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80ab9d0 con 0x7f4ce809b4b0 2024-05-30T17:05:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.568+0000 7f4ceca00640 1 -- 172.21.15.59:0/2623224487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce809b4b0 msgr2=0x7f4ce806cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.568+0000 7f4ceca00640 1 --2- 172.21.15.59:0/2623224487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce809b4b0 0x7f4ce806cac0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80097c0 tx=0x7f4cd801c410 comp rx=0 tx=0).stop 2024-05-30T17:05:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.568+0000 7f4ceca00640 1 -- 172.21.15.59:0/2623224487 shutdown_connections 2024-05-30T17:05:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.568+0000 7f4ceca00640 1 --2- 172.21.15.59:0/2623224487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ce8162340 0x7f4ce81627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.568+0000 7f4ceca00640 1 --2- 172.21.15.59:0/2623224487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce809b4b0 0x7f4ce806cac0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.568+0000 7f4ceca00640 1 -- 172.21.15.59:0/2623224487 >> 172.21.15.59:0/2623224487 conn(0x7f4ce80b3ec0 msgr2=0x7f4ce80b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.568+0000 7f4ceca00640 1 -- 172.21.15.59:0/2623224487 shutdown_connections 2024-05-30T17:05:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.568+0000 7f4ceca00640 1 -- 172.21.15.59:0/2623224487 wait complete. 2024-05-30T17:05:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.568+0000 7f4ceca00640 1 Processor -- start 2024-05-30T17:05:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4ceca00640 1 -- start start 2024-05-30T17:05:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4ceca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ce809b4b0 0x7f4ce815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4ceca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce809b890 0x7f4ce80c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4ceca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8162340 0x7f4ce815b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4ceca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce815fbf0 con 0x7f4ce809b890 2024-05-30T17:05:12.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4ceca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce815fa70 con 0x7f4ce8162340 2024-05-30T17:05:12.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4ceca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce8070380 con 0x7f4ce809b4b0 2024-05-30T17:05:12.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4cdde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce809b890 0x7f4ce80c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:12.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4cdde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce809b890 0x7f4ce80c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56802/0 (socket says 172.21.15.59:56802) 2024-05-30T17:05:12.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4cdde00640 1 -- 172.21.15.59:0/2958968773 learned_addr learned my addr 172.21.15.59:0/2958968773 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4cdde00640 1 -- 172.21.15.59:0/2958968773 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ce809b4b0 msgr2=0x7f4ce815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4cdde00640 1 --2- 172.21.15.59:0/2958968773 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ce809b4b0 0x7f4ce815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4cdde00640 1 -- 172.21.15.59:0/2958968773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8162340 msgr2=0x7f4ce815b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4cdde00640 1 --2- 172.21.15.59:0/2958968773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8162340 0x7f4ce815b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4cdde00640 1 -- 172.21.15.59:0/2958968773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce80c7360 con 0x7f4ce809b890 2024-05-30T17:05:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4cdde00640 1 --2- 172.21.15.59:0/2958968773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce809b890 0x7f4ce80c6910 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00011f0 tx=0x7f4cd000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4cdf400640 1 -- 172.21.15.59:0/2958968773 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0018070 con 0x7f4ce809b890 2024-05-30T17:05:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4cdf400640 1 -- 172.21.15.59:0/2958968773 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd00074e0 con 0x7f4ce809b890 2024-05-30T17:05:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4ceca00640 1 -- 172.21.15.59:0/2958968773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce80c7640 con 0x7f4ce809b890 2024-05-30T17:05:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4cdf400640 1 -- 172.21.15.59:0/2958968773 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0004a10 con 0x7f4ce809b890 2024-05-30T17:05:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.572+0000 7f4ceca00640 1 -- 172.21.15.59:0/2958968773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce80c7ee0 con 0x7f4ce809b890 2024-05-30T17:05:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.576+0000 7f4ceca00640 1 -- 172.21.15.59:0/2958968773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce80c7a30 con 0x7f4ce809b890 2024-05-30T17:05:12.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.576+0000 7f4cdf400640 1 -- 172.21.15.59:0/2958968773 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 42) ==== 90894+0+0 (secure 0 0 0) 0x7f4cd001b070 con 0x7f4ce809b890 2024-05-30T17:05:12.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.576+0000 7f4cdf400640 1 --2- 172.21.15.59:0/2958968773 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4cc406a390 0x7f4cc406c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:12.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.576+0000 7f4cdf400640 1 -- 172.21.15.59:0/2958968773 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f4cd0084d90 con 0x7f4ce809b890 2024-05-30T17:05:12.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.588+0000 7f4cdf400640 1 -- 172.21.15.59:0/2958968773 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4cd0056e50 con 0x7f4ce809b890 2024-05-30T17:05:12.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.596+0000 7f4ce6800640 1 --2- 172.21.15.59:0/2958968773 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4cc406a390 0x7f4cc406c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:12.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.608+0000 7f4ce6800640 1 --2- 172.21.15.59:0/2958968773 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4cc406a390 0x7f4cc406c850 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80ad000 tx=0x7f4cd8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:12.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:12.896+0000 7f4ceca00640 1 -- 172.21.15.59:0/2958968773 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone67195", "target": ["mon-mgr", ""]}) -- 0x7f4ce8068a90 con 0x7f4cc406a390 2024-05-30T17:05:13.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.676+0000 7f4cdf400640 1 -- 172.21.15.59:0/2958968773 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4ce8068a90 con 0x7f4cc406a390 2024-05-30T17:05:13.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.680+0000 7f4ceca00640 1 -- 172.21.15.59:0/2958968773 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4cc406a390 msgr2=0x7f4cc406c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:13.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.680+0000 7f4ceca00640 1 --2- 172.21.15.59:0/2958968773 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4cc406a390 0x7f4cc406c850 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80ad000 tx=0x7f4cd8008040 comp rx=0 tx=0).stop 2024-05-30T17:05:13.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.680+0000 7f4ceca00640 1 -- 172.21.15.59:0/2958968773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce809b890 msgr2=0x7f4ce80c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:13.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.680+0000 7f4ceca00640 1 --2- 172.21.15.59:0/2958968773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce809b890 0x7f4ce80c6910 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00011f0 tx=0x7f4cd000c9b0 comp rx=0 tx=0).stop 2024-05-30T17:05:13.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.684+0000 7f4ceca00640 1 -- 172.21.15.59:0/2958968773 shutdown_connections 2024-05-30T17:05:13.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.684+0000 7f4ceca00640 1 --2- 172.21.15.59:0/2958968773 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4cc406a390 0x7f4cc406c850 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:13.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.684+0000 7f4ceca00640 1 --2- 172.21.15.59:0/2958968773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8162340 0x7f4ce815b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:13.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.684+0000 7f4ceca00640 1 --2- 172.21.15.59:0/2958968773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce809b890 0x7f4ce80c6910 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:13.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.684+0000 7f4ceca00640 1 --2- 172.21.15.59:0/2958968773 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ce809b4b0 0x7f4ce815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:13.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.684+0000 7f4ceca00640 1 -- 172.21.15.59:0/2958968773 >> 172.21.15.59:0/2958968773 conn(0x7f4ce80b3ec0 msgr2=0x7f4ce806e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:13.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.684+0000 7f4ceca00640 1 -- 172.21.15.59:0/2958968773 shutdown_connections 2024-05-30T17:05:13.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.684+0000 7f4ceca00640 1 -- 172.21.15.59:0/2958968773 wait complete. 2024-05-30T17:05:13.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone67196 2024-05-30T17:05:13.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.996+0000 7fb38c800640 1 Processor -- start 2024-05-30T17:05:13.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:13.996+0000 7fb38c800640 1 -- start start 2024-05-30T17:05:14.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb38c800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb38415b8f0 0x7fb3840b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:14.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb38c800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3840cbd30 0x7fb3840cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:14.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb38c800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3840b2d40 con 0x7fb3840ae230 2024-05-30T17:05:14.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb38c800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb3840b2780 con 0x7fb38415b8f0 2024-05-30T17:05:14.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb38c800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb3840b2a60 con 0x7fb3840cbd30 2024-05-30T17:05:14.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb38a800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb3840ae230 0x7fb3840ae6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46330/0 (socket says 172.21.15.59:46330) 2024-05-30T17:05:14.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb38a800640 1 -- 172.21.15.59:0/1687959919 learned_addr learned my addr 172.21.15.59:0/1687959919 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:14.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb389e00640 1 --2- 172.21.15.59:0/1687959919 >> v2:172.21.15.59:3300/0 conn(0x7fb38415b8f0 0x7fb3840b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:14.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb388a00640 1 -- 172.21.15.59:0/1687959919 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2945557296 0 0) 0x7fb3840b2d40 con 0x7fb3840ae230 2024-05-30T17:05:14.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb388a00640 1 -- 172.21.15.59:0/1687959919 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb36c005740 con 0x7fb3840ae230 2024-05-30T17:05:14.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb389e00640 1 -- 172.21.15.59:0/1687959919 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3840cbd30 msgr2=0x7fb3840cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:14.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb389e00640 1 --2- 172.21.15.59:0/1687959919 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3840cbd30 0x7fb3840cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:14.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb389e00640 1 -- 172.21.15.59:0/1687959919 >> v1:172.21.15.59:6789/0 conn(0x7fb3840ae230 legacy=0x7fb3840ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:14.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.000+0000 7fb389e00640 1 -- 172.21.15.59:0/1687959919 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3840af370 con 0x7fb38415b8f0 2024-05-30T17:05:14.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb389e00640 1 --2- 172.21.15.59:0/1687959919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb38415b8f0 0x7fb3840b20f0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fb3780097c0 tx=0x7fb37801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3156642cf83cb1ea server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:14.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb388a00640 1 -- 172.21.15.59:0/1687959919 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3780b5070 con 0x7fb38415b8f0 2024-05-30T17:05:14.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb388a00640 1 -- 172.21.15.59:0/1687959919 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3780a8990 con 0x7fb38415b8f0 2024-05-30T17:05:14.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb388a00640 1 -- 172.21.15.59:0/1687959919 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3780a8d60 con 0x7fb38415b8f0 2024-05-30T17:05:14.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb38c800640 1 -- 172.21.15.59:0/1687959919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb38415b8f0 msgr2=0x7fb3840b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:14.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb38c800640 1 --2- 172.21.15.59:0/1687959919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb38415b8f0 0x7fb3840b20f0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fb3780097c0 tx=0x7fb37801ec90 comp rx=0 tx=0).stop 2024-05-30T17:05:14.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb38c800640 1 -- 172.21.15.59:0/1687959919 shutdown_connections 2024-05-30T17:05:14.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb38c800640 1 --2- 172.21.15.59:0/1687959919 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3840cbd30 0x7fb3840cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:14.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb38c800640 1 --2- 172.21.15.59:0/1687959919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb38415b8f0 0x7fb3840b20f0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:14.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb38c800640 1 -- 172.21.15.59:0/1687959919 >> 172.21.15.59:0/1687959919 conn(0x7fb3840b2f50 msgr2=0x7fb3840b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:14.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb38c800640 1 -- 172.21.15.59:0/1687959919 shutdown_connections 2024-05-30T17:05:14.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb38c800640 1 -- 172.21.15.59:0/1687959919 wait complete. 2024-05-30T17:05:14.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb38c800640 1 Processor -- start 2024-05-30T17:05:14.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.004+0000 7fb38c800640 1 -- start start 2024-05-30T17:05:14.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb38c800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3840ae230 0x7fb3840cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb38c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3840cbd30 0x7fb3840afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb38c800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb38415b8f0 0x7fb3840b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb38c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb3840cc170 con 0x7fb3840cbd30 2024-05-30T17:05:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb38c800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb3840d0170 con 0x7fb3840ae230 2024-05-30T17:05:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb38c800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb38415bcd0 con 0x7fb38415b8f0 2024-05-30T17:05:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb389400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3840cbd30 0x7fb3840afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb389400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3840cbd30 0x7fb3840afdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56824/0 (socket says 172.21.15.59:56824) 2024-05-30T17:05:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb389400640 1 -- 172.21.15.59:0/4063562989 learned_addr learned my addr 172.21.15.59:0/4063562989 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb389400640 1 -- 172.21.15.59:0/4063562989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb38415b8f0 msgr2=0x7fb3840b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb389400640 1 --2- 172.21.15.59:0/4063562989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb38415b8f0 0x7fb3840b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb389400640 1 -- 172.21.15.59:0/4063562989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3840ae230 msgr2=0x7fb3840cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb389400640 1 --2- 172.21.15.59:0/4063562989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3840ae230 0x7fb3840cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:14.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb389400640 1 -- 172.21.15.59:0/4063562989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3840cc830 con 0x7fb3840cbd30 2024-05-30T17:05:14.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb389400640 1 --2- 172.21.15.59:0/4063562989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3840cbd30 0x7fb3840afdd0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fb37400b550 tx=0x7fb37400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:14.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb37e000640 1 -- 172.21.15.59:0/4063562989 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374014070 con 0x7fb3840cbd30 2024-05-30T17:05:14.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb37e000640 1 -- 172.21.15.59:0/4063562989 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb374010890 con 0x7fb3840cbd30 2024-05-30T17:05:14.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb38c800640 1 -- 172.21.15.59:0/4063562989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3841599c0 con 0x7fb3840cbd30 2024-05-30T17:05:14.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb37e000640 1 -- 172.21.15.59:0/4063562989 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374010c80 con 0x7fb3840cbd30 2024-05-30T17:05:14.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb38c800640 1 -- 172.21.15.59:0/4063562989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3840b4ce0 con 0x7fb3840cbd30 2024-05-30T17:05:14.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.008+0000 7fb38c800640 1 -- 172.21.15.59:0/4063562989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb384068a90 con 0x7fb3840cbd30 2024-05-30T17:05:14.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.012+0000 7fb37e000640 1 -- 172.21.15.59:0/4063562989 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 42) ==== 90894+0+0 (secure 0 0 0) 0x7fb374017070 con 0x7fb3840cbd30 2024-05-30T17:05:14.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.012+0000 7fb37e000640 1 --2- 172.21.15.59:0/4063562989 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb36806a3c0 0x7fb36806c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:14.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.012+0000 7fb37e000640 1 -- 172.21.15.59:0/4063562989 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fb374085870 con 0x7fb3840cbd30 2024-05-30T17:05:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.016+0000 7fb37e000640 1 -- 172.21.15.59:0/4063562989 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb374057890 con 0x7fb3840cbd30 2024-05-30T17:05:14.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.048+0000 7fb389e00640 1 --2- 172.21.15.59:0/4063562989 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb36806a3c0 0x7fb36806c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.052+0000 7fb389e00640 1 --2- 172.21.15.59:0/4063562989 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb36806a3c0 0x7fb36806c880 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb3780b2000 tx=0x7fb378004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:14.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:14.332+0000 7fb38c800640 1 -- 172.21.15.59:0/4063562989 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone67196", "target": ["mon-mgr", ""]}) -- 0x7fb3841e5ba0 con 0x7fb36806a3c0 2024-05-30T17:05:15.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.208+0000 7fb37e000640 1 -- 172.21.15.59:0/4063562989 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb3841e5ba0 con 0x7fb36806a3c0 2024-05-30T17:05:15.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.212+0000 7fb38c800640 1 -- 172.21.15.59:0/4063562989 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb36806a3c0 msgr2=0x7fb36806c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:15.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.212+0000 7fb38c800640 1 --2- 172.21.15.59:0/4063562989 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb36806a3c0 0x7fb36806c880 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb3780b2000 tx=0x7fb378004740 comp rx=0 tx=0).stop 2024-05-30T17:05:15.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.212+0000 7fb38c800640 1 -- 172.21.15.59:0/4063562989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3840cbd30 msgr2=0x7fb3840afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:15.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.212+0000 7fb38c800640 1 --2- 172.21.15.59:0/4063562989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3840cbd30 0x7fb3840afdd0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fb37400b550 tx=0x7fb37400ba10 comp rx=0 tx=0).stop 2024-05-30T17:05:15.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.212+0000 7fb38c800640 1 -- 172.21.15.59:0/4063562989 shutdown_connections 2024-05-30T17:05:15.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.212+0000 7fb38c800640 1 --2- 172.21.15.59:0/4063562989 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fb36806a3c0 0x7fb36806c880 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:15.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.212+0000 7fb38c800640 1 --2- 172.21.15.59:0/4063562989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb38415b8f0 0x7fb3840b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:15.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.212+0000 7fb38c800640 1 --2- 172.21.15.59:0/4063562989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3840cbd30 0x7fb3840afdd0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:15.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.212+0000 7fb38c800640 1 --2- 172.21.15.59:0/4063562989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3840ae230 0x7fb3840cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:15.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.212+0000 7fb38c800640 1 -- 172.21.15.59:0/4063562989 >> 172.21.15.59:0/4063562989 conn(0x7fb3840b2f50 msgr2=0x7fb3841e26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:15.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.212+0000 7fb38c800640 1 -- 172.21.15.59:0/4063562989 shutdown_connections 2024-05-30T17:05:15.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.212+0000 7fb38c800640 1 -- 172.21.15.59:0/4063562989 wait complete. 2024-05-30T17:05:15.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone67197 2024-05-30T17:05:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.508+0000 7fbebf200640 1 Processor -- start 2024-05-30T17:05:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.508+0000 7fbebf200640 1 -- start start 2024-05-30T17:05:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.512+0000 7fbebf200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbec006b9b0 0x7fbec006bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.512+0000 7fbebf200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbec00b0400 0x7fbec00b0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.512+0000 7fbebf200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec009ae20 con 0x7fbec015c7f0 2024-05-30T17:05:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.512+0000 7fbebf200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbec00b3b00 con 0x7fbec006b9b0 2024-05-30T17:05:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.512+0000 7fbebf200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbec00b22a0 con 0x7fbec00b0400 2024-05-30T17:05:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.512+0000 7fbebe800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbec00b0400 0x7fbec00b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:15.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.512+0000 7fbebe800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbec00b0400 0x7fbec00b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:51100/0 (socket says 172.21.15.59:51100) 2024-05-30T17:05:15.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.512+0000 7fbebe800640 1 -- 172.21.15.59:0/693465291 learned_addr learned my addr 172.21.15.59:0/693465291 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:15.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.512+0000 7fbebde00640 1 --2- 172.21.15.59:0/693465291 >> v2:172.21.15.59:3300/0 conn(0x7fbec006b9b0 0x7fbec006bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:15.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.516+0000 7fbebca00640 1 -- 172.21.15.59:0/693465291 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760728560 0 0) 0x7fbec009ae20 con 0x7fbec015c7f0 2024-05-30T17:05:15.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.516+0000 7fbebca00640 1 -- 172.21.15.59:0/693465291 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbea4003530 con 0x7fbec015c7f0 2024-05-30T17:05:15.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.516+0000 7fbebde00640 1 -- 172.21.15.59:0/693465291 >> v2:172.21.15.107:3300/0 conn(0x7fbec00b0400 msgr2=0x7fbec00b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:15.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.516+0000 7fbebde00640 1 --2- 172.21.15.59:0/693465291 >> v2:172.21.15.107:3300/0 conn(0x7fbec00b0400 0x7fbec00b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:15.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.516+0000 7fbebde00640 1 -- 172.21.15.59:0/693465291 >> v1:172.21.15.59:6789/0 conn(0x7fbec015c7f0 legacy=0x7fbec006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:15.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.516+0000 7fbebde00640 1 -- 172.21.15.59:0/693465291 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec00b3790 con 0x7fbec006b9b0 2024-05-30T17:05:15.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.520+0000 7fbebde00640 1 --2- 172.21.15.59:0/693465291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbec006b9b0 0x7fbec006bd90 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fbec006e600 tx=0x7fbeb001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848e1573060f24c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:15.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.520+0000 7fbebca00640 1 -- 172.21.15.59:0/693465291 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb00b0070 con 0x7fbec006b9b0 2024-05-30T17:05:15.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.520+0000 7fbebca00640 1 -- 172.21.15.59:0/693465291 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb00ab600 con 0x7fbec006b9b0 2024-05-30T17:05:15.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.520+0000 7fbebca00640 1 -- 172.21.15.59:0/693465291 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb00ab9d0 con 0x7fbec006b9b0 2024-05-30T17:05:15.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.524+0000 7fbebf200640 1 -- 172.21.15.59:0/693465291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbec006b9b0 msgr2=0x7fbec006bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:15.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.524+0000 7fbebf200640 1 --2- 172.21.15.59:0/693465291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbec006b9b0 0x7fbec006bd90 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fbec006e600 tx=0x7fbeb001c3f0 comp rx=0 tx=0).stop 2024-05-30T17:05:15.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.524+0000 7fbebf200640 1 -- 172.21.15.59:0/693465291 shutdown_connections 2024-05-30T17:05:15.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.524+0000 7fbebf200640 1 --2- 172.21.15.59:0/693465291 >> v2:172.21.15.107:3300/0 conn(0x7fbec00b0400 0x7fbec00b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:15.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.524+0000 7fbebf200640 1 --2- 172.21.15.59:0/693465291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbec006b9b0 0x7fbec006bd90 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:15.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.524+0000 7fbebf200640 1 -- 172.21.15.59:0/693465291 >> 172.21.15.59:0/693465291 conn(0x7fbec00731f0 msgr2=0x7fbec00b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:15.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.524+0000 7fbebf200640 1 -- 172.21.15.59:0/693465291 shutdown_connections 2024-05-30T17:05:15.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.524+0000 7fbebf200640 1 -- 172.21.15.59:0/693465291 wait complete. 2024-05-30T17:05:15.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.528+0000 7fbebf200640 1 Processor -- start 2024-05-30T17:05:15.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.528+0000 7fbebf200640 1 -- start start 2024-05-30T17:05:15.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.528+0000 7fbebf200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbec006b9b0 0x7fbec0149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:15.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.528+0000 7fbebf200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbec00b0400 0x7fbec00b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:15.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.528+0000 7fbebf200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbec015c7f0 0x7fbec0154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:15.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.528+0000 7fbebf200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbec01692e0 con 0x7fbec00b0400 2024-05-30T17:05:15.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.528+0000 7fbebf200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbec00b2bd0 con 0x7fbec006b9b0 2024-05-30T17:05:15.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.528+0000 7fbebf200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbec0169460 con 0x7fbec015c7f0 2024-05-30T17:05:15.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbebe800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbec015c7f0 0x7fbec0154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:15.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbebde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbec006b9b0 0x7fbec0149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:15.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbebd400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbec00b0400 0x7fbec00b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:15.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbebe800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbec015c7f0 0x7fbec0154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:46094/0 (socket says 172.21.15.59:46094) 2024-05-30T17:05:15.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbebe800640 1 -- 172.21.15.59:0/2273439936 learned_addr learned my addr 172.21.15.59:0/2273439936 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:15.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbebd400640 1 -- 172.21.15.59:0/2273439936 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbec015c7f0 msgr2=0x7fbec0154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:15.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbebd400640 1 --2- 172.21.15.59:0/2273439936 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbec015c7f0 0x7fbec0154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:15.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbebd400640 1 -- 172.21.15.59:0/2273439936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbec006b9b0 msgr2=0x7fbec0149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:15.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbebd400640 1 --2- 172.21.15.59:0/2273439936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbec006b9b0 0x7fbec0149910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:15.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbebd400640 1 -- 172.21.15.59:0/2273439936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec00ced10 con 0x7fbec00b0400 2024-05-30T17:05:15.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbebd400640 1 --2- 172.21.15.59:0/2273439936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbec00b0400 0x7fbec00b4aa0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00c3f0 tx=0x7fbeac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:15.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbeb6000640 1 -- 172.21.15.59:0/2273439936 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac017070 con 0x7fbec00b0400 2024-05-30T17:05:15.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbeb6000640 1 -- 172.21.15.59:0/2273439936 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeac0052d0 con 0x7fbec00b0400 2024-05-30T17:05:15.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbeb6000640 1 -- 172.21.15.59:0/2273439936 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac003840 con 0x7fbec00b0400 2024-05-30T17:05:15.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.532+0000 7fbebf200640 1 -- 172.21.15.59:0/2273439936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec00ceff0 con 0x7fbec00b0400 2024-05-30T17:05:15.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.536+0000 7fbebf200640 1 -- 172.21.15.59:0/2273439936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec00cf5b0 con 0x7fbec00b0400 2024-05-30T17:05:15.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.536+0000 7fbebf200640 1 -- 172.21.15.59:0/2273439936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec00cf7b0 con 0x7fbec00b0400 2024-05-30T17:05:15.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.536+0000 7fbeb6000640 1 -- 172.21.15.59:0/2273439936 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 42) ==== 90894+0+0 (secure 0 0 0) 0x7fbeac01a070 con 0x7fbec00b0400 2024-05-30T17:05:15.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.540+0000 7fbeb6000640 1 --2- 172.21.15.59:0/2273439936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbea006a460 0x7fbea006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:15.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.540+0000 7fbeb6000640 1 -- 172.21.15.59:0/2273439936 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fbeac084d40 con 0x7fbec00b0400 2024-05-30T17:05:15.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.548+0000 7fbeb6000640 1 -- 172.21.15.59:0/2273439936 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbec00cf7b0 con 0x7fbec00b0400 2024-05-30T17:05:15.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.568+0000 7fbebde00640 1 --2- 172.21.15.59:0/2273439936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbea006a460 0x7fbea006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.568+0000 7fbebde00640 1 --2- 172.21.15.59:0/2273439936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbea006a460 0x7fbea006c920 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fbeb00ad000 tx=0x7fbeb0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:15.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:15.896+0000 7fbebf200640 1 -- 172.21.15.59:0/2273439936 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone67197", "target": ["mon-mgr", ""]}) -- 0x7fbec00ceac0 con 0x7fbea006a460 2024-05-30T17:05:17.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.132+0000 7fbeb6000640 1 -- 172.21.15.59:0/2273439936 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbec00ceac0 con 0x7fbea006a460 2024-05-30T17:05:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.140+0000 7fbebf200640 1 -- 172.21.15.59:0/2273439936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbea006a460 msgr2=0x7fbea006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.140+0000 7fbebf200640 1 --2- 172.21.15.59:0/2273439936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbea006a460 0x7fbea006c920 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fbeb00ad000 tx=0x7fbeb0008040 comp rx=0 tx=0).stop 2024-05-30T17:05:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.140+0000 7fbebf200640 1 -- 172.21.15.59:0/2273439936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbec00b0400 msgr2=0x7fbec00b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.140+0000 7fbebf200640 1 --2- 172.21.15.59:0/2273439936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbec00b0400 0x7fbec00b4aa0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00c3f0 tx=0x7fbeac00c8b0 comp rx=0 tx=0).stop 2024-05-30T17:05:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.140+0000 7fbebf200640 1 -- 172.21.15.59:0/2273439936 shutdown_connections 2024-05-30T17:05:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.140+0000 7fbebf200640 1 --2- 172.21.15.59:0/2273439936 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbea006a460 0x7fbea006c920 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.140+0000 7fbebf200640 1 --2- 172.21.15.59:0/2273439936 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbec015c7f0 0x7fbec0154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.140+0000 7fbebf200640 1 --2- 172.21.15.59:0/2273439936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbec00b0400 0x7fbec00b4aa0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.140+0000 7fbebf200640 1 --2- 172.21.15.59:0/2273439936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbec006b9b0 0x7fbec0149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.140+0000 7fbebf200640 1 -- 172.21.15.59:0/2273439936 >> 172.21.15.59:0/2273439936 conn(0x7fbec00731f0 msgr2=0x7fbec0155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.140+0000 7fbebf200640 1 -- 172.21.15.59:0/2273439936 shutdown_connections 2024-05-30T17:05:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:17.140+0000 7fbebf200640 1 -- 172.21.15.59:0/2273439936 wait complete. 2024-05-30T17:05:22.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone67191 2024-05-30T17:05:22.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67ac400640 1 Processor -- start 2024-05-30T17:05:22.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67ac400640 1 -- start start 2024-05-30T17:05:22.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67ac400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f67a415e940 0x7f67a406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:22.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67ac400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f67a40b18c0 0x7f67a40d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:22.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67ac400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a415ed20 con 0x7f67a40d1ac0 2024-05-30T17:05:22.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67ac400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f67a40d10f0 con 0x7f67a40b18c0 2024-05-30T17:05:22.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67ac400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f67a40b1d00 con 0x7f67a415e940 2024-05-30T17:05:22.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67aa400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f67a40d1ac0 0x7f67a40af230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51788/0 (socket says 172.21.15.59:51788) 2024-05-30T17:05:22.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67aa400640 1 -- 172.21.15.59:0/3365272145 learned_addr learned my addr 172.21.15.59:0/3365272145 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a9a00640 1 --2- 172.21.15.59:0/3365272145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f67a415e940 0x7f67a406ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730756205 0 0) 0x7f67a415ed20 con 0x7f67a40d1ac0 2024-05-30T17:05:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6788003530 con 0x7f67a40d1ac0 2024-05-30T17:05:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3607851331 0 0) 0x7f6788003530 con 0x7f67a40d1ac0 2024-05-30T17:05:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f67a415e940 msgr2=0x7f67a406ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 --2- 172.21.15.59:0/3365272145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f67a415e940 0x7f67a406ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 >> v2:172.21.15.107:3300/0 conn(0x7f67a40b18c0 msgr2=0x7f67a40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 --2- 172.21.15.59:0/3365272145 >> v2:172.21.15.107:3300/0 conn(0x7f67a40b18c0 0x7f67a40d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a40d0830 con 0x7f67a40d1ac0 2024-05-30T17:05:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f6794001680 con 0x7f67a40d1ac0 2024-05-30T17:05:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 >> v1:172.21.15.59:6789/0 conn(0x7f67a40d1ac0 legacy=0x7f67a40af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 --2- 172.21.15.59:0/3365272145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67880039c0 0x7f6788003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 --2- 172.21.15.59:0/3365272145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6788004810 0x7f6788004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 --2- 172.21.15.59:0/3365272145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f67a415e940 0x7f67880051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f67a40d10f0 con 0x7f67880039c0 2024-05-30T17:05:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f67a40b1d00 con 0x7f6788004810 2024-05-30T17:05:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.440+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f678800bb60 con 0x7f67a415e940 2024-05-30T17:05:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.444+0000 7f67a9a00640 1 --2- 172.21.15.59:0/3365272145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67880039c0 0x7f6788003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.444+0000 7f67a9a00640 1 -- 172.21.15.59:0/3365272145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f67a415e940 msgr2=0x7f67880051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.444+0000 7f67a9a00640 1 --2- 172.21.15.59:0/3365272145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f67a415e940 0x7f67880051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.444+0000 7f67a9a00640 1 -- 172.21.15.59:0/3365272145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6788004810 msgr2=0x7f6788004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.444+0000 7f67a9a00640 1 --2- 172.21.15.59:0/3365272145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6788004810 0x7f6788004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.444+0000 7f67a9a00640 1 -- 172.21.15.59:0/3365272145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6788003530 con 0x7f67880039c0 2024-05-30T17:05:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.444+0000 7f67a9a00640 1 --2- 172.21.15.59:0/3365272145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67880039c0 0x7f6788003de0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f679c007360 tx=0x7f679c01ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275073f8889a5af5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.448+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c0b2070 con 0x7f67880039c0 2024-05-30T17:05:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.448+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c0a5c70 con 0x7f67880039c0 2024-05-30T17:05:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.448+0000 7f67a3e00640 1 -- 172.21.15.59:0/3365272145 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c009be0 con 0x7f67880039c0 2024-05-30T17:05:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.448+0000 7f67ac400640 1 -- 172.21.15.59:0/3365272145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67880039c0 msgr2=0x7f6788003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.448+0000 7f67ac400640 1 --2- 172.21.15.59:0/3365272145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67880039c0 0x7f6788003de0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f679c007360 tx=0x7f679c01ce80 comp rx=0 tx=0).stop 2024-05-30T17:05:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.448+0000 7f67aa400640 1 -- 172.21.15.59:0/3365272145 reap_dead start 2024-05-30T17:05:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.448+0000 7f67ac400640 1 -- 172.21.15.59:0/3365272145 shutdown_connections 2024-05-30T17:05:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.448+0000 7f67ac400640 1 -- 172.21.15.59:0/3365272145 >> 172.21.15.59:0/3365272145 conn(0x7f67a40b3f70 msgr2=0x7f67a40b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.448+0000 7f67ac400640 1 -- 172.21.15.59:0/3365272145 shutdown_connections 2024-05-30T17:05:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.448+0000 7f67ac400640 1 -- 172.21.15.59:0/3365272145 wait complete. 2024-05-30T17:05:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.452+0000 7f67ac400640 1 Processor -- start 2024-05-30T17:05:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.452+0000 7f67ac400640 1 -- start start 2024-05-30T17:05:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67ac400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67880039c0 0x7f67a414c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67ac400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67a4166ca0 0x7f67a409e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67ac400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f67a406d620 0x7f67a406daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67ac400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f67a40afac0 con 0x7f67880039c0 2024-05-30T17:05:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67ac400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f67a40af940 con 0x7f67a4166ca0 2024-05-30T17:05:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67ac400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f67a4169720 con 0x7f67a406d620 2024-05-30T17:05:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67a9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67880039c0 0x7f67a414c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67a9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67880039c0 0x7f67a414c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55598/0 (socket says 172.21.15.59:55598) 2024-05-30T17:05:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67a9a00640 1 -- 172.21.15.59:0/230764998 learned_addr learned my addr 172.21.15.59:0/230764998 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67a9a00640 1 -- 172.21.15.59:0/230764998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f67a406d620 msgr2=0x7f67a406daa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T17:05:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67a9a00640 1 --2- 172.21.15.59:0/230764998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f67a406d620 0x7f67a406daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67a9a00640 1 -- 172.21.15.59:0/230764998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67a4166ca0 msgr2=0x7f67a409e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67a9a00640 1 --2- 172.21.15.59:0/230764998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67a4166ca0 0x7f67a409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67a9a00640 1 -- 172.21.15.59:0/230764998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a409eb40 con 0x7f67880039c0 2024-05-30T17:05:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67a9a00640 1 --2- 172.21.15.59:0/230764998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67880039c0 0x7f67a414c940 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f679c000f90 tx=0x7f6788005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67a1600640 1 -- 172.21.15.59:0/230764998 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c0b2040 con 0x7f67880039c0 2024-05-30T17:05:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67a1600640 1 -- 172.21.15.59:0/230764998 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c0ada20 con 0x7f67880039c0 2024-05-30T17:05:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67ac400640 1 -- 172.21.15.59:0/230764998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a409ee20 con 0x7f67880039c0 2024-05-30T17:05:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67a1600640 1 -- 172.21.15.59:0/230764998 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c0ade30 con 0x7f67880039c0 2024-05-30T17:05:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67ac400640 1 -- 172.21.15.59:0/230764998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a409f3e0 con 0x7f67880039c0 2024-05-30T17:05:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.456+0000 7f67ac400640 1 -- 172.21.15.59:0/230764998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a4068a90 con 0x7f67880039c0 2024-05-30T17:05:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.460+0000 7f67a1600640 1 -- 172.21.15.59:0/230764998 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 42) ==== 90894+0+0 (secure 0 0 0) 0x7f679c0b6430 con 0x7f67880039c0 2024-05-30T17:05:22.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.460+0000 7f67a1600640 1 --2- 172.21.15.59:0/230764998 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f678406a3e0 0x7f678406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:22.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.460+0000 7f67a1600640 1 -- 172.21.15.59:0/230764998 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f679c11fe60 con 0x7f67880039c0 2024-05-30T17:05:22.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.468+0000 7f67a1600640 1 -- 172.21.15.59:0/230764998 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f679c0a5e20 con 0x7f67880039c0 2024-05-30T17:05:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.476+0000 7f67a9000640 1 --2- 172.21.15.59:0/230764998 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f678406a3e0 0x7f678406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:22.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.492+0000 7f67a9000640 1 --2- 172.21.15.59:0/230764998 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f678406a3e0 0x7f678406c8a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6790006fd0 tx=0x7f6790006d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:22.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:22.880+0000 7f67ac400640 1 -- 172.21.15.59:0/230764998 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone67191", "target": ["mon-mgr", ""]}) -- 0x7f67a40b4da0 con 0x7f678406a3e0 2024-05-30T17:05:22.907 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:22.908+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:22.907 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:22.908+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:22.907 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:22.908+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:22.907 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:22.908+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:22.907 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:22.908+0000 7efd6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:05:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.216+0000 7f67a1600640 1 -- 172.21.15.59:0/230764998 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7f679c0edf70 con 0x7f67880039c0 2024-05-30T17:05:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.216+0000 7f67a1600640 1 -- 172.21.15.59:0/230764998 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f67a40b4da0 con 0x7f678406a3e0 2024-05-30T17:05:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.220+0000 7f67ac400640 1 -- 172.21.15.59:0/230764998 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f678406a3e0 msgr2=0x7f678406c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.220+0000 7f67ac400640 1 --2- 172.21.15.59:0/230764998 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f678406a3e0 0x7f678406c8a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6790006fd0 tx=0x7f6790006d80 comp rx=0 tx=0).stop 2024-05-30T17:05:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.220+0000 7f67ac400640 1 -- 172.21.15.59:0/230764998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67880039c0 msgr2=0x7f67a414c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.220+0000 7f67ac400640 1 --2- 172.21.15.59:0/230764998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67880039c0 0x7f67a414c940 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f679c000f90 tx=0x7f6788005840 comp rx=0 tx=0).stop 2024-05-30T17:05:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.220+0000 7f67ac400640 1 -- 172.21.15.59:0/230764998 shutdown_connections 2024-05-30T17:05:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.220+0000 7f67ac400640 1 --2- 172.21.15.59:0/230764998 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f678406a3e0 0x7f678406c8a0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.220+0000 7f67ac400640 1 --2- 172.21.15.59:0/230764998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f67a406d620 0x7f67a406daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.220+0000 7f67ac400640 1 --2- 172.21.15.59:0/230764998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67a4166ca0 0x7f67a409e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.220+0000 7f67ac400640 1 --2- 172.21.15.59:0/230764998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67880039c0 0x7f67a414c940 secure :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f679c000f90 tx=0x7f6788005840 comp rx=0 tx=0).stop 2024-05-30T17:05:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.220+0000 7f67ac400640 1 -- 172.21.15.59:0/230764998 >> 172.21.15.59:0/230764998 conn(0x7f67a40b3f70 msgr2=0x7f67a40709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.224+0000 7f67ac400640 1 -- 172.21.15.59:0/230764998 shutdown_connections 2024-05-30T17:05:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.224+0000 7f67ac400640 1 -- 172.21.15.59:0/230764998 wait complete. 2024-05-30T17:05:24.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone67192 2024-05-30T17:05:24.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.484+0000 7f95e9000640 1 Processor -- start 2024-05-30T17:05:24.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.484+0000 7f95e9000640 1 -- start start 2024-05-30T17:05:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e9000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f95e40ce960 0x7f95e409b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e9000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e409b900 con 0x7f95e40d0f30 2024-05-30T17:05:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e9000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e409bbe0 con 0x7f95e415c7b0 2024-05-30T17:05:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e9000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f95e415cb90 con 0x7f95e40ce960 2024-05-30T17:05:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f95e40d0f30 0x7f95e409ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51804/0 (socket says 172.21.15.59:51804) 2024-05-30T17:05:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2a00640 1 -- 172.21.15.59:0/82161183 learned_addr learned my addr 172.21.15.59:0/82161183 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2282071403 0 0) 0x7f95e409b900 con 0x7f95e40d0f30 2024-05-30T17:05:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95c8003530 con 0x7f95e40d0f30 2024-05-30T17:05:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2269229215 0 0) 0x7f95c8003530 con 0x7f95e40d0f30 2024-05-30T17:05:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 >> v2:172.21.15.107:3300/0 conn(0x7f95e40ce960 msgr2=0x7f95e409b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e3e00640 1 --2- 172.21.15.59:0/82161183 >> v2:172.21.15.107:3300/0 conn(0x7f95e40ce960 0x7f95e409b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:24.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 --2- 172.21.15.59:0/82161183 >> v2:172.21.15.107:3300/0 conn(0x7f95e40ce960 0x7f95e409b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:24.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 >> v1:172.21.15.107:6789/0 conn(0x7f95e415c7b0 legacy=0x7f95e40d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:24.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e40cd150 con 0x7f95e40d0f30 2024-05-30T17:05:24.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f95d0001680 con 0x7f95e40d0f30 2024-05-30T17:05:24.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 >> v1:172.21.15.59:6789/0 conn(0x7f95e40d0f30 legacy=0x7f95e409ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 --2- 172.21.15.59:0/82161183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95c80039c0 0x7f95c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 --2- 172.21.15.59:0/82161183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8004810 0x7f95c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 --2- 172.21.15.59:0/82161183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c8005240 0x7f95c800fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95e415cb90 con 0x7f95c8004810 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f95c80079b0 con 0x7f95c8005240 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f95c8007bb0 con 0x7f95c80039c0 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e3e00640 1 --2- 172.21.15.59:0/82161183 >> v2:172.21.15.107:3300/0 conn(0x7f95e40ce960 0x7f95e409b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e3400640 1 --2- 172.21.15.59:0/82161183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95c80039c0 0x7f95c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.488+0000 7f95e2a00640 1 --2- 172.21.15.59:0/82161183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8004810 0x7f95c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.492+0000 7f95e2a00640 1 -- 172.21.15.59:0/82161183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95c80039c0 msgr2=0x7f95c8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.492+0000 7f95e2a00640 1 --2- 172.21.15.59:0/82161183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95c80039c0 0x7f95c8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.492+0000 7f95e2a00640 1 -- 172.21.15.59:0/82161183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c8005240 msgr2=0x7f95c800fde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T17:05:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.492+0000 7f95e2a00640 1 --2- 172.21.15.59:0/82161183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c8005240 0x7f95c800fde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.492+0000 7f95e2a00640 1 -- 172.21.15.59:0/82161183 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e40cd150 con 0x7f95c8004810 2024-05-30T17:05:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.492+0000 7f95e3e00640 1 -- 172.21.15.59:0/82161183 reap_dead start 2024-05-30T17:05:24.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.496+0000 7f95e2a00640 1 --2- 172.21.15.59:0/82161183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8004810 0x7f95c8004c90 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f95d001d520 tx=0x7f95d00305f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426551c78a2404df server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.500+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d001d0f0 con 0x7f95c8004810 2024-05-30T17:05:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.500+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d0005ae0 con 0x7f95c8004810 2024-05-30T17:05:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.500+0000 7f95e2000640 1 -- 172.21.15.59:0/82161183 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0007070 con 0x7f95c8004810 2024-05-30T17:05:24.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.504+0000 7f95e9000640 1 -- 172.21.15.59:0/82161183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8004810 msgr2=0x7f95c8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:24.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.504+0000 7f95e9000640 1 --2- 172.21.15.59:0/82161183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8004810 0x7f95c8004c90 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f95d001d520 tx=0x7f95d00305f0 comp rx=0 tx=0).stop 2024-05-30T17:05:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.504+0000 7f95e9000640 1 -- 172.21.15.59:0/82161183 shutdown_connections 2024-05-30T17:05:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.504+0000 7f95e9000640 1 --2- 172.21.15.59:0/82161183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8004810 0x7f95c8004c90 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.504+0000 7f95e9000640 1 -- 172.21.15.59:0/82161183 >> 172.21.15.59:0/82161183 conn(0x7f95e40b3ec0 msgr2=0x7f95e40b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.504+0000 7f95e9000640 1 -- 172.21.15.59:0/82161183 shutdown_connections 2024-05-30T17:05:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.504+0000 7f95e9000640 1 -- 172.21.15.59:0/82161183 wait complete. 2024-05-30T17:05:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.504+0000 7f95e9000640 1 Processor -- start 2024-05-30T17:05:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.504+0000 7f95e9000640 1 -- start start 2024-05-30T17:05:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e9000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c8004810 0x7f95e4157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e41586c0 0x7f95e41effc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e9000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95e40c7e50 0x7f95e40c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e9000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95e40d0820 con 0x7f95e41586c0 2024-05-30T17:05:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e9000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f95e40cd4c0 con 0x7f95c8004810 2024-05-30T17:05:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e9000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f95e40d09a0 con 0x7f95e40c7e50 2024-05-30T17:05:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e41586c0 0x7f95e41effc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e41586c0 0x7f95e41effc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55616/0 (socket says 172.21.15.59:55616) 2024-05-30T17:05:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e2a00640 1 -- 172.21.15.59:0/2054408372 learned_addr learned my addr 172.21.15.59:0/2054408372 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e2a00640 1 -- 172.21.15.59:0/2054408372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95e40c7e50 msgr2=0x7f95e40c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e2a00640 1 --2- 172.21.15.59:0/2054408372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95e40c7e50 0x7f95e40c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e2a00640 1 -- 172.21.15.59:0/2054408372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c8004810 msgr2=0x7f95e4157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e2a00640 1 --2- 172.21.15.59:0/2054408372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c8004810 0x7f95e4157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e2a00640 1 -- 172.21.15.59:0/2054408372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e41f0500 con 0x7f95e41586c0 2024-05-30T17:05:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e2a00640 1 --2- 172.21.15.59:0/2054408372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e41586c0 0x7f95e41effc0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f95d0030420 tx=0x7f95c8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95db400640 1 -- 172.21.15.59:0/2054408372 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0005940 con 0x7f95e41586c0 2024-05-30T17:05:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95db400640 1 -- 172.21.15.59:0/2054408372 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d00cf070 con 0x7f95e41586c0 2024-05-30T17:05:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95db400640 1 -- 172.21.15.59:0/2054408372 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0007470 con 0x7f95e41586c0 2024-05-30T17:05:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e9000640 1 -- 172.21.15.59:0/2054408372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e41f07a0 con 0x7f95e41586c0 2024-05-30T17:05:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.508+0000 7f95e9000640 1 -- 172.21.15.59:0/2054408372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e41f0d60 con 0x7f95e41586c0 2024-05-30T17:05:24.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.512+0000 7f95e9000640 1 -- 172.21.15.59:0/2054408372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95bc0052a0 con 0x7f95e41586c0 2024-05-30T17:05:24.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.512+0000 7f95db400640 1 -- 172.21.15.59:0/2054408372 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7f95d00c0020 con 0x7f95e41586c0 2024-05-30T17:05:24.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.516+0000 7f95db400640 1 --2- 172.21.15.59:0/2054408372 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f95c406a4a0 0x7f95c406c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.516+0000 7f95db400640 1 -- 172.21.15.59:0/2054408372 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f95d0134090 con 0x7f95e41586c0 2024-05-30T17:05:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.520+0000 7f95db400640 1 -- 172.21.15.59:0/2054408372 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f95d002a300 con 0x7f95e41586c0 2024-05-30T17:05:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.528+0000 7f95e3400640 1 --2- 172.21.15.59:0/2054408372 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f95c406a4a0 0x7f95c406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:24.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.544+0000 7f95e3400640 1 --2- 172.21.15.59:0/2054408372 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f95c406a4a0 0x7f95c406c960 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f95e40c8a70 tx=0x7f95d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:24.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:24.848+0000 7f95e9000640 1 -- 172.21.15.59:0/2054408372 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone67192", "target": ["mon-mgr", ""]}) -- 0x7f95bc000bd0 con 0x7f95c406a4a0 2024-05-30T17:05:25.082 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:25.084+0000 7efd6da00640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T17:05:25.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.084+0000 7f95db400640 1 -- 172.21.15.59:0/2054408372 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f95bc000bd0 con 0x7f95c406a4a0 2024-05-30T17:05:25.084 INFO:teuthology.orchestra.run.smithi059.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T17:05:25.113 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T17:05:25.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone67193 2024-05-30T17:05:25.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.400+0000 7f36fcc00640 1 Processor -- start 2024-05-30T17:05:25.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.400+0000 7f36fcc00640 1 -- start start 2024-05-30T17:05:25.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36fcc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36f8145e40 0x7f36f80b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:25.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36fcc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f36f80b2670 0x7f36f80cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:25.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36fcc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36f80ce1a0 0x7f36f806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:25.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36fcc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f36f80ce630 con 0x7f36f8145e40 2024-05-30T17:05:25.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36fcc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f36f8146220 con 0x7f36f80b2670 2024-05-30T17:05:25.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36fcc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f36f80ceba0 con 0x7f36f80ce1a0 2024-05-30T17:05:25.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36f5e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36f8145e40 0x7f36f80b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:25.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36f5e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36f8145e40 0x7f36f80b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55622/0 (socket says 172.21.15.59:55622) 2024-05-30T17:05:25.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36f5e00640 1 -- 172.21.15.59:0/520732787 learned_addr learned my addr 172.21.15.59:0/520732787 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:25.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36f5e00640 1 -- 172.21.15.59:0/520732787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36f80ce1a0 msgr2=0x7f36f806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:25.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36f5e00640 1 --2- 172.21.15.59:0/520732787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36f80ce1a0 0x7f36f806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:25.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36f5e00640 1 -- 172.21.15.59:0/520732787 >> v2:172.21.15.107:3300/0 conn(0x7f36f80b2670 msgr2=0x7f36f80cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:25.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36f5e00640 1 --2- 172.21.15.59:0/520732787 >> v2:172.21.15.107:3300/0 conn(0x7f36f80b2670 0x7f36f80cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:25.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.404+0000 7f36f5e00640 1 -- 172.21.15.59:0/520732787 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f80ce8c0 con 0x7f36f8145e40 2024-05-30T17:05:25.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36f5e00640 1 --2- 172.21.15.59:0/520732787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f8145e40 0x7f36f80b2130 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f36f8146520 tx=0x7f36f001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156f5dedaf424870 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:25.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36f4a00640 1 -- 172.21.15.59:0/520732787 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f00ac070 con 0x7f36f8145e40 2024-05-30T17:05:25.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36f4a00640 1 -- 172.21.15.59:0/520732787 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f00a8420 con 0x7f36f8145e40 2024-05-30T17:05:25.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36f4a00640 1 -- 172.21.15.59:0/520732787 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f00a87f0 con 0x7f36f8145e40 2024-05-30T17:05:25.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36fcc00640 1 -- 172.21.15.59:0/520732787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f8145e40 msgr2=0x7f36f80b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:25.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36fcc00640 1 --2- 172.21.15.59:0/520732787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f8145e40 0x7f36f80b2130 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f36f8146520 tx=0x7f36f001c730 comp rx=0 tx=0).stop 2024-05-30T17:05:25.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36fcc00640 1 -- 172.21.15.59:0/520732787 shutdown_connections 2024-05-30T17:05:25.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36fcc00640 1 --2- 172.21.15.59:0/520732787 >> v2:172.21.15.107:3300/0 conn(0x7f36f80b2670 0x7f36f80cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:25.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36fcc00640 1 --2- 172.21.15.59:0/520732787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36f80ce1a0 0x7f36f806b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:25.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36fcc00640 1 --2- 172.21.15.59:0/520732787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f8145e40 0x7f36f80b2130 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:25.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36fcc00640 1 -- 172.21.15.59:0/520732787 >> 172.21.15.59:0/520732787 conn(0x7f36f809aa40 msgr2=0x7f36f80b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:25.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36fcc00640 1 -- 172.21.15.59:0/520732787 shutdown_connections 2024-05-30T17:05:25.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.408+0000 7f36fcc00640 1 -- 172.21.15.59:0/520732787 wait complete. 2024-05-30T17:05:25.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.412+0000 7f36fcc00640 1 Processor -- start 2024-05-30T17:05:25.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.412+0000 7f36fcc00640 1 -- start start 2024-05-30T17:05:25.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36fcc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f80b2670 0x7f36f80d0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:25.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36fcc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36f80ce1a0 0x7f36f813daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:25.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36fcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f8145e40 0x7f36f813e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:25.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36fcc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f36f80b5030 con 0x7f36f8145e40 2024-05-30T17:05:25.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36fcc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f36f80b4eb0 con 0x7f36f80b2670 2024-05-30T17:05:25.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36fcc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f36f80b51b0 con 0x7f36f80ce1a0 2024-05-30T17:05:25.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36f6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f8145e40 0x7f36f813e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:25.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36f5e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f80b2670 0x7f36f80d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:25.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36f6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f8145e40 0x7f36f813e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55636/0 (socket says 172.21.15.59:55636) 2024-05-30T17:05:25.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36f5e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f80b2670 0x7f36f80d0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:44508/0 (socket says 172.21.15.59:44508) 2024-05-30T17:05:25.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36f6800640 1 -- 172.21.15.59:0/3169220780 learned_addr learned my addr 172.21.15.59:0/3169220780 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:25.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36f6800640 1 -- 172.21.15.59:0/3169220780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36f80ce1a0 msgr2=0x7f36f813daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:25.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36f6800640 1 --2- 172.21.15.59:0/3169220780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36f80ce1a0 0x7f36f813daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:25.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36f6800640 1 -- 172.21.15.59:0/3169220780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f80b2670 msgr2=0x7f36f80d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:25.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36f6800640 1 --2- 172.21.15.59:0/3169220780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f80b2670 0x7f36f80d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:25.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36f6800640 1 -- 172.21.15.59:0/3169220780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f80b40e0 con 0x7f36f8145e40 2024-05-30T17:05:25.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36f6800640 1 --2- 172.21.15.59:0/3169220780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f8145e40 0x7f36f813e030 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f36e000b430 tx=0x7f36e000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:25.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36ee000640 1 -- 172.21.15.59:0/3169220780 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e0015020 con 0x7f36f8145e40 2024-05-30T17:05:25.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36ee000640 1 -- 172.21.15.59:0/3169220780 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e0011850 con 0x7f36f8145e40 2024-05-30T17:05:25.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36ee000640 1 -- 172.21.15.59:0/3169220780 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e0011c40 con 0x7f36f8145e40 2024-05-30T17:05:25.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36fcc00640 1 -- 172.21.15.59:0/3169220780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f80cfc90 con 0x7f36f8145e40 2024-05-30T17:05:25.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.416+0000 7f36fcc00640 1 -- 172.21.15.59:0/3169220780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f8139490 con 0x7f36f8145e40 2024-05-30T17:05:25.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.420+0000 7f36fcc00640 1 -- 172.21.15.59:0/3169220780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f80691a0 con 0x7f36f8145e40 2024-05-30T17:05:25.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.420+0000 7f36ee000640 1 -- 172.21.15.59:0/3169220780 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7f36e0018020 con 0x7f36f8145e40 2024-05-30T17:05:25.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.424+0000 7f36ee000640 1 --2- 172.21.15.59:0/3169220780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36d406a4a0 0x7f36d406c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:25.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.424+0000 7f36ee000640 1 -- 172.21.15.59:0/3169220780 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f36e00858c0 con 0x7f36f8145e40 2024-05-30T17:05:25.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.432+0000 7f36ee000640 1 -- 172.21.15.59:0/3169220780 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f36e001f020 con 0x7f36f8145e40 2024-05-30T17:05:25.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.436+0000 7f36f5e00640 1 --2- 172.21.15.59:0/3169220780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36d406a4a0 0x7f36d406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.440+0000 7f36f5e00640 1 --2- 172.21.15.59:0/3169220780 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f36d406a4a0 0x7f36d406c960 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f36f00ae000 tx=0x7f36f00b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:25.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:25.812+0000 7f36fcc00640 1 -- 172.21.15.59:0/3169220780 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone67193", "target": ["mon-mgr", ""]}) -- 0x7f36f80d1e10 con 0x7f36d406a4a0 2024-05-30T17:05:26.215 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:05:26.216+0000 7efd6da00640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T17:05:26.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.240+0000 7f36ee000640 1 -- 172.21.15.59:0/3169220780 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f36f80d1e10 con 0x7f36d406a4a0 2024-05-30T17:05:26.242 INFO:teuthology.orchestra.run.smithi059.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T17:05:26.262 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T17:05:26.263 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone67194 2024-05-30T17:05:26.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.524+0000 7f06cbe00640 1 Processor -- start 2024-05-30T17:05:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.524+0000 7f06cbe00640 1 -- start start 2024-05-30T17:05:26.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.528+0000 7f06cbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06cc0b49e0 0x7f06cc163c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:26.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.528+0000 7f06cbe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06cc09b2e0 0x7f06cc0af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:26.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.528+0000 7f06cbe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06cc070000 con 0x7f06cc0c53a0 2024-05-30T17:05:26.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.528+0000 7f06cbe00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f06cc0702e0 con 0x7f06cc0b49e0 2024-05-30T17:05:26.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.528+0000 7f06cbe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f06cc09aae0 con 0x7f06cc09b2e0 2024-05-30T17:05:26.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.528+0000 7f06ca000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06cc0b49e0 0x7f06cc163c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:26.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.528+0000 7f06ca000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06cc0b49e0 0x7f06cc163c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55642/0 (socket says 172.21.15.59:55642) 2024-05-30T17:05:26.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.528+0000 7f06ca000640 1 -- 172.21.15.59:0/3790707158 learned_addr learned my addr 172.21.15.59:0/3790707158 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:26.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.528+0000 7f06ca000640 1 -- 172.21.15.59:0/3790707158 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06cc09b2e0 msgr2=0x7f06cc0af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:26.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.528+0000 7f06ca000640 1 --2- 172.21.15.59:0/3790707158 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06cc09b2e0 0x7f06cc0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:26.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.528+0000 7f06ca000640 1 -- 172.21.15.59:0/3790707158 >> v1:172.21.15.107:6789/0 conn(0x7f06cc0c53a0 legacy=0x7f06cc0c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:26.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.528+0000 7f06ca000640 1 -- 172.21.15.59:0/3790707158 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc09adc0 con 0x7f06cc0b49e0 2024-05-30T17:05:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.532+0000 7f06ca000640 1 --2- 172.21.15.59:0/3790707158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06cc0b49e0 0x7f06cc163c80 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009870 tx=0x7f06b801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330d0c936f35d4cd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.532+0000 7f06c9600640 1 -- 172.21.15.59:0/3790707158 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b80ab5f0 con 0x7f06cc0b49e0 2024-05-30T17:05:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.532+0000 7f06c9600640 1 -- 172.21.15.59:0/3790707158 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b80b0070 con 0x7f06cc0b49e0 2024-05-30T17:05:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.532+0000 7f06c9600640 1 -- 172.21.15.59:0/3790707158 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b80ab9b0 con 0x7f06cc0b49e0 2024-05-30T17:05:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.532+0000 7f06cbe00640 1 -- 172.21.15.59:0/3790707158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06cc0b49e0 msgr2=0x7f06cc163c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.532+0000 7f06cbe00640 1 --2- 172.21.15.59:0/3790707158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06cc0b49e0 0x7f06cc163c80 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009870 tx=0x7f06b801c520 comp rx=0 tx=0).stop 2024-05-30T17:05:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.532+0000 7f06cbe00640 1 -- 172.21.15.59:0/3790707158 shutdown_connections 2024-05-30T17:05:26.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.532+0000 7f06cbe00640 1 --2- 172.21.15.59:0/3790707158 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06cc09b2e0 0x7f06cc0af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:26.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.532+0000 7f06cbe00640 1 --2- 172.21.15.59:0/3790707158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06cc0b49e0 0x7f06cc163c80 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:26.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.532+0000 7f06cbe00640 1 -- 172.21.15.59:0/3790707158 >> 172.21.15.59:0/3790707158 conn(0x7f06cc0b3ec0 msgr2=0x7f06cc0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:26.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.532+0000 7f06cbe00640 1 -- 172.21.15.59:0/3790707158 shutdown_connections 2024-05-30T17:05:26.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.532+0000 7f06cbe00640 1 -- 172.21.15.59:0/3790707158 wait complete. 2024-05-30T17:05:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cbe00640 1 Processor -- start 2024-05-30T17:05:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cbe00640 1 -- start start 2024-05-30T17:05:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cbe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06cc09b2e0 0x7f06cc15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cbe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06cc0b49e0 0x7f06cc159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06cc0c53a0 0x7f06cc1654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cbe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc170460 con 0x7f06cc0c53a0 2024-05-30T17:05:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cbe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1702e0 con 0x7f06cc09b2e0 2024-05-30T17:05:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cbe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f06cc1705e0 con 0x7f06cc0b49e0 2024-05-30T17:05:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06cc0c53a0 0x7f06cc1654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06cc0c53a0 0x7f06cc1654b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55646/0 (socket says 172.21.15.59:55646) 2024-05-30T17:05:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cb400640 1 -- 172.21.15.59:0/811584703 learned_addr learned my addr 172.21.15.59:0/811584703 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cb400640 1 -- 172.21.15.59:0/811584703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06cc0b49e0 msgr2=0x7f06cc159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cb400640 1 --2- 172.21.15.59:0/811584703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06cc0b49e0 0x7f06cc159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cb400640 1 -- 172.21.15.59:0/811584703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06cc09b2e0 msgr2=0x7f06cc15dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cb400640 1 --2- 172.21.15.59:0/811584703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06cc09b2e0 0x7f06cc15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cb400640 1 -- 172.21.15.59:0/811584703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc159e70 con 0x7f06cc0c53a0 2024-05-30T17:05:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cb400640 1 --2- 172.21.15.59:0/811584703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06cc0c53a0 0x7f06cc1654b0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f06c400b9a0 tx=0x7f06c400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06c3400640 1 -- 172.21.15.59:0/811584703 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4019070 con 0x7f06cc0c53a0 2024-05-30T17:05:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06c3400640 1 -- 172.21.15.59:0/811584703 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c400cbc0 con 0x7f06cc0c53a0 2024-05-30T17:05:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06c3400640 1 -- 172.21.15.59:0/811584703 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4014440 con 0x7f06cc0c53a0 2024-05-30T17:05:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.536+0000 7f06cbe00640 1 -- 172.21.15.59:0/811584703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06cc15a150 con 0x7f06cc0c53a0 2024-05-30T17:05:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.540+0000 7f06cbe00640 1 -- 172.21.15.59:0/811584703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06cc15d520 con 0x7f06cc0c53a0 2024-05-30T17:05:26.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.540+0000 7f06cbe00640 1 -- 172.21.15.59:0/811584703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06cc068a90 con 0x7f06cc0c53a0 2024-05-30T17:05:26.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.540+0000 7f06c3400640 1 -- 172.21.15.59:0/811584703 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7f06c401c070 con 0x7f06cc0c53a0 2024-05-30T17:05:26.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.540+0000 7f06c3400640 1 --2- 172.21.15.59:0/811584703 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f06ac06a420 0x7f06ac06c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:26.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.540+0000 7f06c3400640 1 -- 172.21.15.59:0/811584703 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f06c4085820 con 0x7f06cc0c53a0 2024-05-30T17:05:26.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.544+0000 7f06caa00640 1 --2- 172.21.15.59:0/811584703 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f06ac06a420 0x7f06ac06c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:26.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.544+0000 7f06caa00640 1 --2- 172.21.15.59:0/811584703 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f06ac06a420 0x7f06ac06c8e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f06bc007fd0 tx=0x7f06bc0079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:26.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.548+0000 7f06c3400640 1 -- 172.21.15.59:0/811584703 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06c4057840 con 0x7f06cc0c53a0 2024-05-30T17:05:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:26.872+0000 7f06cbe00640 1 -- 172.21.15.59:0/811584703 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone67194", "target": ["mon-mgr", ""]}) -- 0x7f06cc0d1da0 con 0x7f06ac06a420 2024-05-30T17:05:28.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.252+0000 7f06c3400640 1 -- 172.21.15.59:0/811584703 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f06cc0d1da0 con 0x7f06ac06a420 2024-05-30T17:05:28.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.256+0000 7f06cbe00640 1 -- 172.21.15.59:0/811584703 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f06ac06a420 msgr2=0x7f06ac06c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:28.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.256+0000 7f06cbe00640 1 --2- 172.21.15.59:0/811584703 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f06ac06a420 0x7f06ac06c8e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f06bc007fd0 tx=0x7f06bc0079a0 comp rx=0 tx=0).stop 2024-05-30T17:05:28.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.256+0000 7f06cbe00640 1 -- 172.21.15.59:0/811584703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06cc0c53a0 msgr2=0x7f06cc1654b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:28.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.256+0000 7f06cbe00640 1 --2- 172.21.15.59:0/811584703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06cc0c53a0 0x7f06cc1654b0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f06c400b9a0 tx=0x7f06c400be60 comp rx=0 tx=0).stop 2024-05-30T17:05:28.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.256+0000 7f06cbe00640 1 -- 172.21.15.59:0/811584703 shutdown_connections 2024-05-30T17:05:28.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.256+0000 7f06cbe00640 1 --2- 172.21.15.59:0/811584703 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f06ac06a420 0x7f06ac06c8e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:28.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.256+0000 7f06cbe00640 1 --2- 172.21.15.59:0/811584703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06cc0c53a0 0x7f06cc1654b0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:28.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.256+0000 7f06cbe00640 1 --2- 172.21.15.59:0/811584703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06cc0b49e0 0x7f06cc159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:28.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.256+0000 7f06cbe00640 1 --2- 172.21.15.59:0/811584703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06cc09b2e0 0x7f06cc15dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:28.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.256+0000 7f06cbe00640 1 -- 172.21.15.59:0/811584703 >> 172.21.15.59:0/811584703 conn(0x7f06cc0b3ec0 msgr2=0x7f06cc0b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:28.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.256+0000 7f06cbe00640 1 -- 172.21.15.59:0/811584703 shutdown_connections 2024-05-30T17:05:28.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.256+0000 7f06cbe00640 1 -- 172.21.15.59:0/811584703 wait complete. 2024-05-30T17:05:28.295 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone67195 2024-05-30T17:05:28.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.552+0000 7fde23200640 1 Processor -- start 2024-05-30T17:05:28.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.552+0000 7fde23200640 1 -- start start 2024-05-30T17:05:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.556+0000 7fde23200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2415c480 0x7fde240cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.556+0000 7fde23200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fde240ccba0 0x7fde240cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.556+0000 7fde23200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde2415c860 con 0x7fde24160b80 2024-05-30T17:05:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.556+0000 7fde23200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fde240b43b0 con 0x7fde240ccba0 2024-05-30T17:05:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.556+0000 7fde23200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fde240cc4a0 con 0x7fde2415c480 2024-05-30T17:05:28.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.560+0000 7fde19400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fde24160b80 0x7fde2406e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.59:35580/0 (socket says 172.21.15.59:35580) 2024-05-30T17:05:28.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.560+0000 7fde19400640 1 -- 172.21.15.59:0/4151679109 learned_addr learned my addr 172.21.15.59:0/4151679109 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:28.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.560+0000 7fde22800640 1 --2- 172.21.15.59:0/4151679109 >> v2:172.21.15.107:3300/0 conn(0x7fde240ccba0 0x7fde240cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:28.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.560+0000 7fde21e00640 1 --2- 172.21.15.59:0/4151679109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2415c480 0x7fde240cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:28.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.568+0000 7fde22800640 1 -- 172.21.15.59:0/4151679109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2415c480 msgr2=0x7fde240cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:28.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.568+0000 7fde22800640 1 --2- 172.21.15.59:0/4151679109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2415c480 0x7fde240cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:28.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.568+0000 7fde22800640 1 -- 172.21.15.59:0/4151679109 >> v1:172.21.15.107:6789/0 conn(0x7fde24160b80 legacy=0x7fde2406e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:28.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.568+0000 7fde22800640 1 -- 172.21.15.59:0/4151679109 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde240cbee0 con 0x7fde240ccba0 2024-05-30T17:05:28.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.572+0000 7fde22800640 1 --2- 172.21.15.59:0/4151679109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde240ccba0 0x7fde240cd030 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0097c0 tx=0x7fde1c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdbf4eeedeb4819f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:28.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.572+0000 7fde21400640 1 -- 172.21.15.59:0/4151679109 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0b0070 con 0x7fde240ccba0 2024-05-30T17:05:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.576+0000 7fde21400640 1 -- 172.21.15.59:0/4151679109 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c0ab600 con 0x7fde240ccba0 2024-05-30T17:05:28.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.576+0000 7fde21400640 1 -- 172.21.15.59:0/4151679109 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0ab9d0 con 0x7fde240ccba0 2024-05-30T17:05:28.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.576+0000 7fde23200640 1 -- 172.21.15.59:0/4151679109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde240ccba0 msgr2=0x7fde240cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:28.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.576+0000 7fde23200640 1 --2- 172.21.15.59:0/4151679109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde240ccba0 0x7fde240cd030 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0097c0 tx=0x7fde1c01c4a0 comp rx=0 tx=0).stop 2024-05-30T17:05:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.576+0000 7fde23200640 1 -- 172.21.15.59:0/4151679109 shutdown_connections 2024-05-30T17:05:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.576+0000 7fde23200640 1 --2- 172.21.15.59:0/4151679109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde240ccba0 0x7fde240cd030 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.576+0000 7fde23200640 1 --2- 172.21.15.59:0/4151679109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2415c480 0x7fde240cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.576+0000 7fde23200640 1 -- 172.21.15.59:0/4151679109 >> 172.21.15.59:0/4151679109 conn(0x7fde2406b9b0 msgr2=0x7fde2406bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.576+0000 7fde23200640 1 -- 172.21.15.59:0/4151679109 shutdown_connections 2024-05-30T17:05:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.576+0000 7fde23200640 1 -- 172.21.15.59:0/4151679109 wait complete. 2024-05-30T17:05:28.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.576+0000 7fde23200640 1 Processor -- start 2024-05-30T17:05:28.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde23200640 1 -- start start 2024-05-30T17:05:28.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde23200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde240ccba0 0x7fde2415aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:28.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde23200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2415c480 0x7fde2414a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:28.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde23200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde24160b80 0x7fde24157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:28.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde23200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fde2406f280 con 0x7fde24160b80 2024-05-30T17:05:28.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde23200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fde2406f100 con 0x7fde240ccba0 2024-05-30T17:05:28.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde23200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fde24169380 con 0x7fde2415c480 2024-05-30T17:05:28.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde22800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde24160b80 0x7fde24157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:28.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde22800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde24160b80 0x7fde24157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55650/0 (socket says 172.21.15.59:55650) 2024-05-30T17:05:28.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde22800640 1 -- 172.21.15.59:0/3306088683 learned_addr learned my addr 172.21.15.59:0/3306088683 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:28.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde19400640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2415c480 0x7fde2414a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:28.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde22800640 1 -- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2415c480 msgr2=0x7fde2414a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:28.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde22800640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2415c480 0x7fde2414a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde22800640 1 -- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde240ccba0 msgr2=0x7fde2415aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde22800640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde240ccba0 0x7fde2415aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde22800640 1 -- 172.21.15.59:0/3306088683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2414a710 con 0x7fde24160b80 2024-05-30T17:05:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde22800640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde24160b80 0x7fde24157c60 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fde1c01ab50 tx=0x7fde1c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde1aa00640 1 -- 172.21.15.59:0/3306088683 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0b0040 con 0x7fde24160b80 2024-05-30T17:05:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde23200640 1 -- 172.21.15.59:0/3306088683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde241541d0 con 0x7fde24160b80 2024-05-30T17:05:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde1aa00640 1 -- 172.21.15.59:0/3306088683 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c0b9070 con 0x7fde24160b80 2024-05-30T17:05:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde1aa00640 1 -- 172.21.15.59:0/3306088683 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c006e20 con 0x7fde24160b80 2024-05-30T17:05:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.580+0000 7fde23200640 1 -- 172.21.15.59:0/3306088683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde24154790 con 0x7fde24160b80 2024-05-30T17:05:28.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.584+0000 7fde23200640 1 -- 172.21.15.59:0/3306088683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde24068a90 con 0x7fde24160b80 2024-05-30T17:05:28.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.584+0000 7fde1aa00640 1 -- 172.21.15.59:0/3306088683 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7fde1c0b4650 con 0x7fde24160b80 2024-05-30T17:05:28.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.584+0000 7fde1aa00640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fde0006a420 0x7fde0006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:28.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.584+0000 7fde1aa00640 1 -- 172.21.15.59:0/3306088683 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fde1c11f7e0 con 0x7fde24160b80 2024-05-30T17:05:28.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.592+0000 7fde1aa00640 1 -- 172.21.15.59:0/3306088683 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fde1c016090 con 0x7fde24160b80 2024-05-30T17:05:28.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.624+0000 7fde21e00640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fde0006a420 0x7fde0006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:28.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.648+0000 7fde21e00640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fde0006a420 0x7fde0006c8e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fde1400e190 tx=0x7fde1400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:28.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:28.932+0000 7fde23200640 1 -- 172.21.15.59:0/3306088683 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone67195", "target": ["mon-mgr", ""]}) -- 0x7fde24167150 con 0x7fde0006a420 2024-05-30T17:05:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.796+0000 7fde1aa00640 1 -- 172.21.15.59:0/3306088683 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fde24167150 con 0x7fde0006a420 2024-05-30T17:05:29.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.804+0000 7fde23200640 1 -- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fde0006a420 msgr2=0x7fde0006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:29.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.804+0000 7fde23200640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fde0006a420 0x7fde0006c8e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fde1400e190 tx=0x7fde1400b040 comp rx=0 tx=0).stop 2024-05-30T17:05:29.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.804+0000 7fde23200640 1 -- 172.21.15.59:0/3306088683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde24160b80 msgr2=0x7fde24157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:29.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.804+0000 7fde23200640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde24160b80 0x7fde24157c60 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fde1c01ab50 tx=0x7fde1c019240 comp rx=0 tx=0).stop 2024-05-30T17:05:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.804+0000 7fde23200640 1 -- 172.21.15.59:0/3306088683 shutdown_connections 2024-05-30T17:05:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.804+0000 7fde23200640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fde0006a420 0x7fde0006c8e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.804+0000 7fde23200640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde24160b80 0x7fde24157c60 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.804+0000 7fde23200640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde2415c480 0x7fde2414a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.804+0000 7fde23200640 1 --2- 172.21.15.59:0/3306088683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde240ccba0 0x7fde2415aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.804+0000 7fde23200640 1 -- 172.21.15.59:0/3306088683 >> 172.21.15.59:0/3306088683 conn(0x7fde2406b9b0 msgr2=0x7fde24158830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.804+0000 7fde23200640 1 -- 172.21.15.59:0/3306088683 shutdown_connections 2024-05-30T17:05:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:29.804+0000 7fde23200640 1 -- 172.21.15.59:0/3306088683 wait complete. 2024-05-30T17:05:29.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone67196 2024-05-30T17:05:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.116+0000 7f3e95000640 1 Processor -- start 2024-05-30T17:05:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.116+0000 7f3e95000640 1 -- start start 2024-05-30T17:05:30.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e95000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e900afe40 0x7f3e900ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:30.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e95000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e900b02d0 con 0x7f3e9015c890 2024-05-30T17:05:30.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e95000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e900b05b0 con 0x7f3e900b2af0 2024-05-30T17:05:30.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e95000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9015cc70 con 0x7f3e900afe40 2024-05-30T17:05:30.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8de00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3e9015c890 0x7f3e900cccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51806/0 (socket says 172.21.15.59:51806) 2024-05-30T17:05:30.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8de00640 1 -- 172.21.15.59:0/2642864713 learned_addr learned my addr 172.21.15.59:0/2642864713 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:30.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4126455552 0 0) 0x7f3e900b02d0 con 0x7f3e9015c890 2024-05-30T17:05:30.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e74003530 con 0x7f3e9015c890 2024-05-30T17:05:30.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1911678158 0 0) 0x7f3e74003530 con 0x7f3e9015c890 2024-05-30T17:05:30.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e900afe40 msgr2=0x7f3e900ad2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T17:05:30.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e900afe40 0x7f3e900ad2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:30.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 >> v1:172.21.15.107:6789/0 conn(0x7f3e900b2af0 legacy=0x7f3e900b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:30.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e900b0890 con 0x7f3e9015c890 2024-05-30T17:05:30.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7f3e80001a00 con 0x7f3e9015c890 2024-05-30T17:05:30.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 >> v1:172.21.15.59:6789/0 conn(0x7f3e9015c890 legacy=0x7f3e900cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:30.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e740039f0 0x7f3e74003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:30.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e74004810 0x7f3e74004c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e740051b0 0x7f3e7400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9015cc70 con 0x7f3e740051b0 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7400c0a0 con 0x7f3e740039f0 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7400c270 con 0x7f3e74004810 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8e800640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e740051b0 0x7f3e7400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8d400640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e74004810 0x7f3e74004c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8de00640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e740039f0 0x7f3e74003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8e800640 1 -- 172.21.15.59:0/2642864713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e74004810 msgr2=0x7f3e74004c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8e800640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e74004810 0x7f3e74004c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8e800640 1 -- 172.21.15.59:0/2642864713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e740039f0 msgr2=0x7f3e74003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8e800640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e740039f0 0x7f3e74003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8e800640 1 -- 172.21.15.59:0/2642864713 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e74003530 con 0x7f3e740051b0 2024-05-30T17:05:30.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8de00640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e740039f0 0x7f3e74003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:05:30.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.120+0000 7f3e8d400640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e74004810 0x7f3e74004c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:05:30.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.124+0000 7f3e8e800640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e740051b0 0x7f3e7400b9d0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f3e88003de0 tx=0x7f3e8801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c54b067e6e5b37 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:30.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.124+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e880b0070 con 0x7f3e740051b0 2024-05-30T17:05:30.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.124+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e880ab620 con 0x7f3e740051b0 2024-05-30T17:05:30.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.124+0000 7f3e8ca00640 1 -- 172.21.15.59:0/2642864713 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e880039b0 con 0x7f3e740051b0 2024-05-30T17:05:30.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 -- 172.21.15.59:0/2642864713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e740051b0 msgr2=0x7f3e7400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:30.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 --2- 172.21.15.59:0/2642864713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e740051b0 0x7f3e7400b9d0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f3e88003de0 tx=0x7f3e8801c320 comp rx=0 tx=0).stop 2024-05-30T17:05:30.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e8e800640 1 -- 172.21.15.59:0/2642864713 reap_dead start 2024-05-30T17:05:30.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 -- 172.21.15.59:0/2642864713 shutdown_connections 2024-05-30T17:05:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 -- 172.21.15.59:0/2642864713 >> 172.21.15.59:0/2642864713 conn(0x7f3e900b1fd0 msgr2=0x7f3e900b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 -- 172.21.15.59:0/2642864713 shutdown_connections 2024-05-30T17:05:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 -- 172.21.15.59:0/2642864713 wait complete. 2024-05-30T17:05:30.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 Processor -- start 2024-05-30T17:05:30.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 -- start start 2024-05-30T17:05:30.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e740051b0 0x7f3e900b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:30.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e9014d570 0x7f3e900b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e900b3910 0x7f3e9014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e900cfea0 con 0x7f3e900b3910 2024-05-30T17:05:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3e900b0ee0 con 0x7f3e9014d570 2024-05-30T17:05:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.128+0000 7f3e95000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3e900d0020 con 0x7f3e740051b0 2024-05-30T17:05:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e8e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e900b3910 0x7f3e9014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e8e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e900b3910 0x7f3e9014e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55666/0 (socket says 172.21.15.59:55666) 2024-05-30T17:05:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e8e800640 1 -- 172.21.15.59:0/3967745182 learned_addr learned my addr 172.21.15.59:0/3967745182 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e8de00640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e740051b0 0x7f3e900b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e8e800640 1 -- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e740051b0 msgr2=0x7f3e900b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e8e800640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e740051b0 0x7f3e900b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e8e800640 1 -- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e9014d570 msgr2=0x7f3e900b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e8e800640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e9014d570 0x7f3e900b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e8e800640 1 -- 172.21.15.59:0/3967745182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e900b3db0 con 0x7f3e900b3910 2024-05-30T17:05:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e8de00640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e740051b0 0x7f3e900b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:05:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e8e800640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e900b3910 0x7f3e9014e1b0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f3e880ae040 tx=0x7f3e74005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e86000640 1 -- 172.21.15.59:0/3967745182 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e880b0040 con 0x7f3e900b3910 2024-05-30T17:05:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e86000640 1 -- 172.21.15.59:0/3967745182 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e88003990 con 0x7f3e900b3910 2024-05-30T17:05:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e86000640 1 -- 172.21.15.59:0/3967745182 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e880ab7d0 con 0x7f3e900b3910 2024-05-30T17:05:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e95000640 1 -- 172.21.15.59:0/3967745182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e900b4090 con 0x7f3e900b3910 2024-05-30T17:05:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e95000640 1 -- 172.21.15.59:0/3967745182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e900b4650 con 0x7f3e900b3910 2024-05-30T17:05:30.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.132+0000 7f3e95000640 1 -- 172.21.15.59:0/3967745182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e90068a90 con 0x7f3e900b3910 2024-05-30T17:05:30.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.136+0000 7f3e86000640 1 -- 172.21.15.59:0/3967745182 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7f3e880c0060 con 0x7f3e900b3910 2024-05-30T17:05:30.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.140+0000 7f3e86000640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3e7006a420 0x7f3e7006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:30.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.140+0000 7f3e86000640 1 -- 172.21.15.59:0/3967745182 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f3e8811ef90 con 0x7f3e900b3910 2024-05-30T17:05:30.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.140+0000 7f3e8de00640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3e7006a420 0x7f3e7006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.148+0000 7f3e86000640 1 -- 172.21.15.59:0/3967745182 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3e88016030 con 0x7f3e900b3910 2024-05-30T17:05:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.148+0000 7f3e8de00640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3e7006a420 0x7f3e7006c8e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3e800012f0 tx=0x7f3e80001840 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:30.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.540+0000 7f3e95000640 1 -- 172.21.15.59:0/3967745182 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone67196", "target": ["mon-mgr", ""]}) -- 0x7f3e900b1a70 con 0x7f3e7006a420 2024-05-30T17:05:30.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.904+0000 7f3e86000640 1 -- 172.21.15.59:0/3967745182 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3e900b1a70 con 0x7f3e7006a420 2024-05-30T17:05:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.908+0000 7f3e95000640 1 -- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3e7006a420 msgr2=0x7f3e7006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.908+0000 7f3e95000640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3e7006a420 0x7f3e7006c8e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3e800012f0 tx=0x7f3e80001840 comp rx=0 tx=0).stop 2024-05-30T17:05:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.908+0000 7f3e95000640 1 -- 172.21.15.59:0/3967745182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e900b3910 msgr2=0x7f3e9014e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.908+0000 7f3e95000640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e900b3910 0x7f3e9014e1b0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f3e880ae040 tx=0x7f3e74005840 comp rx=0 tx=0).stop 2024-05-30T17:05:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.908+0000 7f3e95000640 1 -- 172.21.15.59:0/3967745182 shutdown_connections 2024-05-30T17:05:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.908+0000 7f3e95000640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3e7006a420 0x7f3e7006c8e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.908+0000 7f3e95000640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e900b3910 0x7f3e9014e1b0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:30.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.908+0000 7f3e95000640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e9014d570 0x7f3e900b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:30.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.908+0000 7f3e95000640 1 --2- 172.21.15.59:0/3967745182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e740051b0 0x7f3e900b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:30.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.908+0000 7f3e95000640 1 -- 172.21.15.59:0/3967745182 >> 172.21.15.59:0/3967745182 conn(0x7f3e900b1fd0 msgr2=0x7f3e9006ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:30.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.908+0000 7f3e95000640 1 -- 172.21.15.59:0/3967745182 shutdown_connections 2024-05-30T17:05:30.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:30.908+0000 7f3e95000640 1 -- 172.21.15.59:0/3967745182 wait complete. 2024-05-30T17:05:30.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone67197 2024-05-30T17:05:31.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b3200640 1 Processor -- start 2024-05-30T17:05:31.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b3200640 1 -- start start 2024-05-30T17:05:31.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4b415c7b0 0x7fa4b40d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:31.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b3200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b409b900 con 0x7fa4b40d0d60 2024-05-30T17:05:31.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b3200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b409bbe0 con 0x7fa4b409b250 2024-05-30T17:05:31.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b3200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b40d11c0 con 0x7fa4b415c7b0 2024-05-30T17:05:31.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4abe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa4b40d0d60 0x7fa4b409ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51820/0 (socket says 172.21.15.59:51820) 2024-05-30T17:05:31.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4abe00640 1 -- 172.21.15.59:0/321330941 learned_addr learned my addr 172.21.15.59:0/321330941 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:31.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b1e00640 1 --2- 172.21.15.59:0/321330941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4b415c7b0 0x7fa4b40d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b1400640 1 -- 172.21.15.59:0/321330941 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2370690513 0 0) 0x7fa4b409b900 con 0x7fa4b40d0d60 2024-05-30T17:05:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b1400640 1 -- 172.21.15.59:0/321330941 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa498003530 con 0x7fa4b40d0d60 2024-05-30T17:05:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b1400640 1 -- 172.21.15.59:0/321330941 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278169029 0 0) 0x7fa4b409bbe0 con 0x7fa4b409b250 2024-05-30T17:05:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b1400640 1 -- 172.21.15.59:0/321330941 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4b409b900 con 0x7fa4b409b250 2024-05-30T17:05:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b1e00640 1 -- 172.21.15.59:0/321330941 >> v1:172.21.15.107:6789/0 conn(0x7fa4b409b250 legacy=0x7fa4b40cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b1e00640 1 -- 172.21.15.59:0/321330941 >> v1:172.21.15.59:6789/0 conn(0x7fa4b40d0d60 legacy=0x7fa4b409ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.144+0000 7fa4b1e00640 1 -- 172.21.15.59:0/321330941 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b40cd150 con 0x7fa4b415c7b0 2024-05-30T17:05:31.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.148+0000 7fa4b1e00640 1 --2- 172.21.15.59:0/321330941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4b415c7b0 0x7fa4b40d0820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40097f0 tx=0x7fa4a401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e98e7af4ec1eab87 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:31.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.148+0000 7fa4b1400640 1 -- 172.21.15.59:0/321330941 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40b0070 con 0x7fa4b415c7b0 2024-05-30T17:05:31.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.148+0000 7fa4b1400640 1 -- 172.21.15.59:0/321330941 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a40ab600 con 0x7fa4b415c7b0 2024-05-30T17:05:31.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.148+0000 7fa4b1400640 1 -- 172.21.15.59:0/321330941 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40ab9d0 con 0x7fa4b415c7b0 2024-05-30T17:05:31.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.148+0000 7fa4b3200640 1 -- 172.21.15.59:0/321330941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4b415c7b0 msgr2=0x7fa4b40d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:31.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.148+0000 7fa4b3200640 1 --2- 172.21.15.59:0/321330941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4b415c7b0 0x7fa4b40d0820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40097f0 tx=0x7fa4a401c4e0 comp rx=0 tx=0).stop 2024-05-30T17:05:31.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.148+0000 7fa4b3200640 1 -- 172.21.15.59:0/321330941 shutdown_connections 2024-05-30T17:05:31.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.148+0000 7fa4b3200640 1 --2- 172.21.15.59:0/321330941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4b415c7b0 0x7fa4b40d0820 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:31.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.148+0000 7fa4b3200640 1 -- 172.21.15.59:0/321330941 >> 172.21.15.59:0/321330941 conn(0x7fa4b40b3ec0 msgr2=0x7fa4b40b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:31.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.148+0000 7fa4b3200640 1 -- 172.21.15.59:0/321330941 shutdown_connections 2024-05-30T17:05:31.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.148+0000 7fa4b3200640 1 -- 172.21.15.59:0/321330941 wait complete. 2024-05-30T17:05:31.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b3200640 1 Processor -- start 2024-05-30T17:05:31.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b3200640 1 -- start start 2024-05-30T17:05:31.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4b409b250 0x7fa4b41543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:31.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b40d0d60 0x7fa4b4151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:31.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b3200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4b415c7b0 0x7fa4b40b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b3200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b40cd4c0 con 0x7fa4b40d0d60 2024-05-30T17:05:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b3200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b40ceb00 con 0x7fa4b415c7b0 2024-05-30T17:05:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b3200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b416a590 con 0x7fa4b409b250 2024-05-30T17:05:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4abe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b40d0d60 0x7fa4b4151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4abe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b40d0d60 0x7fa4b4151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55680/0 (socket says 172.21.15.59:55680) 2024-05-30T17:05:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4abe00640 1 -- 172.21.15.59:0/3113707178 learned_addr learned my addr 172.21.15.59:0/3113707178 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b1e00640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4b409b250 0x7fa4b41543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b2800640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4b415c7b0 0x7fa4b40b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4abe00640 1 -- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4b409b250 msgr2=0x7fa4b41543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:31.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4abe00640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4b409b250 0x7fa4b41543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:31.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4abe00640 1 -- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4b415c7b0 msgr2=0x7fa4b40b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:31.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4abe00640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4b415c7b0 0x7fa4b40b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:31.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4abe00640 1 -- 172.21.15.59:0/3113707178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b415bc60 con 0x7fa4b40d0d60 2024-05-30T17:05:31.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b2800640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4b415c7b0 0x7fa4b40b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:05:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4abe00640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b40d0d60 0x7fa4b4151830 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00c420 tx=0x7fa49c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4aa000640 1 -- 172.21.15.59:0/3113707178 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c017070 con 0x7fa4b40d0d60 2024-05-30T17:05:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4aa000640 1 -- 172.21.15.59:0/3113707178 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49c005cf0 con 0x7fa4b40d0d60 2024-05-30T17:05:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4aa000640 1 -- 172.21.15.59:0/3113707178 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c007310 con 0x7fa4b40d0d60 2024-05-30T17:05:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b3200640 1 -- 172.21.15.59:0/3113707178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b40b1ec0 con 0x7fa4b40d0d60 2024-05-30T17:05:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.152+0000 7fa4b3200640 1 -- 172.21.15.59:0/3113707178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b40b2480 con 0x7fa4b40d0d60 2024-05-30T17:05:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.156+0000 7fa4b3200640 1 -- 172.21.15.59:0/3113707178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b4068a90 con 0x7fa4b40d0d60 2024-05-30T17:05:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.156+0000 7fa4aa000640 1 -- 172.21.15.59:0/3113707178 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7fa49c01a070 con 0x7fa4b40d0d60 2024-05-30T17:05:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.156+0000 7fa4aa000640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa49006a420 0x7fa49006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.156+0000 7fa4aa000640 1 -- 172.21.15.59:0/3113707178 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fa49c084ec0 con 0x7fa4b40d0d60 2024-05-30T17:05:31.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.156+0000 7fa4b1e00640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa49006a420 0x7fa49006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:31.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.156+0000 7fa4b1e00640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa49006a420 0x7fa49006c8e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40ad000 tx=0x7fa4a40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:31.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.160+0000 7fa4aa000640 1 -- 172.21.15.59:0/3113707178 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa49c056890 con 0x7fa4b40d0d60 2024-05-30T17:05:31.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.472+0000 7fa4b3200640 1 -- 172.21.15.59:0/3113707178 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone67197", "target": ["mon-mgr", ""]}) -- 0x7fa4b40d03f0 con 0x7fa49006a420 2024-05-30T17:05:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.600+0000 7fa4aa000640 1 -- 172.21.15.59:0/3113707178 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa4b40d03f0 con 0x7fa49006a420 2024-05-30T17:05:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.604+0000 7fa4b3200640 1 -- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa49006a420 msgr2=0x7fa49006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.604+0000 7fa4b3200640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa49006a420 0x7fa49006c8e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40ad000 tx=0x7fa4a40a6000 comp rx=0 tx=0).stop 2024-05-30T17:05:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.604+0000 7fa4b3200640 1 -- 172.21.15.59:0/3113707178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b40d0d60 msgr2=0x7fa4b4151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.604+0000 7fa4b3200640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b40d0d60 0x7fa4b4151830 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00c420 tx=0x7fa49c00c8e0 comp rx=0 tx=0).stop 2024-05-30T17:05:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.604+0000 7fa4b3200640 1 -- 172.21.15.59:0/3113707178 shutdown_connections 2024-05-30T17:05:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.604+0000 7fa4b3200640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa49006a420 0x7fa49006c8e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.604+0000 7fa4b3200640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4b415c7b0 0x7fa4b40b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.604+0000 7fa4b3200640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b40d0d60 0x7fa4b4151830 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.604+0000 7fa4b3200640 1 --2- 172.21.15.59:0/3113707178 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4b409b250 0x7fa4b41543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.604+0000 7fa4b3200640 1 -- 172.21.15.59:0/3113707178 >> 172.21.15.59:0/3113707178 conn(0x7fa4b40b3ec0 msgr2=0x7fa4b4074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:31.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.604+0000 7fa4b3200640 1 -- 172.21.15.59:0/3113707178 shutdown_connections 2024-05-30T17:05:31.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.604+0000 7fa4b3200640 1 -- 172.21.15.59:0/3113707178 wait complete. 2024-05-30T17:05:31.626 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:05:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f66800640 1 Processor -- start 2024-05-30T17:05:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f66800640 1 -- start start 2024-05-30T17:05:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f66800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f600b1700 0x7f2f600b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:31.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f66800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f600b1ae0 con 0x7f2f600b22e0 2024-05-30T17:05:31.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f66800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f600ce220 con 0x7f2f6009bad0 2024-05-30T17:05:31.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f66800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2f600ce500 con 0x7f2f600b1700 2024-05-30T17:05:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f5ea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2f600b22e0 0x7f2f6009b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51828/0 (socket says 172.21.15.59:51828) 2024-05-30T17:05:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f5ea00640 1 -- 172.21.15.59:0/103338611 learned_addr learned my addr 172.21.15.59:0/103338611 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f5f400640 1 --2- 172.21.15.59:0/103338611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f600b1700 0x7f2f600b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f5e000640 1 -- 172.21.15.59:0/103338611 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2173298234 0 0) 0x7f2f600b1ae0 con 0x7f2f600b22e0 2024-05-30T17:05:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f5e000640 1 -- 172.21.15.59:0/103338611 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f44003530 con 0x7f2f600b22e0 2024-05-30T17:05:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f5e000640 1 -- 172.21.15.59:0/103338611 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 380023035 0 0) 0x7f2f600ce220 con 0x7f2f6009bad0 2024-05-30T17:05:31.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f5e000640 1 -- 172.21.15.59:0/103338611 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f600b1ae0 con 0x7f2f6009bad0 2024-05-30T17:05:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f5f400640 1 -- 172.21.15.59:0/103338611 >> v1:172.21.15.107:6789/0 conn(0x7f2f6009bad0 legacy=0x7f2f600d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f5f400640 1 -- 172.21.15.59:0/103338611 >> v1:172.21.15.59:6789/0 conn(0x7f2f600b22e0 legacy=0x7f2f6009b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f5e000640 1 -- 172.21.15.59:0/103338611 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1024093541 0 0) 0x7f2f44003530 con 0x7f2f600b22e0 2024-05-30T17:05:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.772+0000 7f2f5f400640 1 -- 172.21.15.59:0/103338611 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6009abc0 con 0x7f2f600b1700 2024-05-30T17:05:31.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.776+0000 7f2f5f400640 1 --2- 172.21.15.59:0/103338611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f600b1700 0x7f2f600b1da0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2f500097d0 tx=0x7f2f5001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15bf8d95ced30752 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:31.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.776+0000 7f2f5e000640 1 -- 172.21.15.59:0/103338611 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f500b0070 con 0x7f2f600b1700 2024-05-30T17:05:31.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.776+0000 7f2f5e000640 1 -- 172.21.15.59:0/103338611 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f500ab400 con 0x7f2f600b1700 2024-05-30T17:05:31.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.776+0000 7f2f5e000640 1 -- 172.21.15.59:0/103338611 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c001680 con 0x7f2f600b1700 2024-05-30T17:05:31.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.776+0000 7f2f66800640 1 -- 172.21.15.59:0/103338611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f600b1700 msgr2=0x7f2f600b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:31.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.776+0000 7f2f66800640 1 --2- 172.21.15.59:0/103338611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f600b1700 0x7f2f600b1da0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2f500097d0 tx=0x7f2f5001c350 comp rx=0 tx=0).stop 2024-05-30T17:05:31.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.776+0000 7f2f66800640 1 -- 172.21.15.59:0/103338611 shutdown_connections 2024-05-30T17:05:31.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.776+0000 7f2f66800640 1 --2- 172.21.15.59:0/103338611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f600b1700 0x7f2f600b1da0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:31.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.776+0000 7f2f66800640 1 -- 172.21.15.59:0/103338611 >> 172.21.15.59:0/103338611 conn(0x7f2f600b3f30 msgr2=0x7f2f600b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:31.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.776+0000 7f2f66800640 1 -- 172.21.15.59:0/103338611 shutdown_connections 2024-05-30T17:05:31.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.776+0000 7f2f66800640 1 -- 172.21.15.59:0/103338611 wait complete. 2024-05-30T17:05:31.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f66800640 1 Processor -- start 2024-05-30T17:05:31.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f66800640 1 -- start start 2024-05-30T17:05:31.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f66800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f6009bad0 0x7f2f6014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:31.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f66800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f600b1700 0x7f2f600b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:31.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f66800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f600b22e0 0x7f2f6014bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:31.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f66800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6016c830 con 0x7f2f600b1700 2024-05-30T17:05:31.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f66800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2f600d1390 con 0x7f2f600b22e0 2024-05-30T17:05:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f66800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2f6016c9b0 con 0x7f2f6009bad0 2024-05-30T17:05:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f5ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f600b1700 0x7f2f600b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f5f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f6009bad0 0x7f2f6014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f5f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f6009bad0 0x7f2f6014fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.59:41856/0 (socket says 172.21.15.59:41856) 2024-05-30T17:05:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f5f400640 1 -- 172.21.15.59:0/1940872067 learned_addr learned my addr 172.21.15.59:0/1940872067 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f5fe00640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f600b22e0 0x7f2f6014bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:31.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f5f400640 1 -- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f600b22e0 msgr2=0x7f2f6014bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:31.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f5f400640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f600b22e0 0x7f2f6014bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:31.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f5f400640 1 -- 172.21.15.59:0/1940872067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f600b1700 msgr2=0x7f2f600b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:31.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f5f400640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f600b1700 0x7f2f600b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:31.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f5f400640 1 -- 172.21.15.59:0/1940872067 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6014c130 con 0x7f2f6009bad0 2024-05-30T17:05:31.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f5f400640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f6009bad0 0x7f2f6014fba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f50000c10 tx=0x7f2f5001ab90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f57400640 1 -- 172.21.15.59:0/1940872067 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f500b0050 con 0x7f2f6009bad0 2024-05-30T17:05:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f57400640 1 -- 172.21.15.59:0/1940872067 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f500b1040 con 0x7f2f6009bad0 2024-05-30T17:05:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f57400640 1 -- 172.21.15.59:0/1940872067 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50006dc0 con 0x7f2f6009bad0 2024-05-30T17:05:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f66800640 1 -- 172.21.15.59:0/1940872067 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6014c650 con 0x7f2f6009bad0 2024-05-30T17:05:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f66800640 1 -- 172.21.15.59:0/1940872067 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f601504b0 con 0x7f2f6009bad0 2024-05-30T17:05:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.780+0000 7f2f66800640 1 -- 172.21.15.59:0/1940872067 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f60068a90 con 0x7f2f6009bad0 2024-05-30T17:05:31.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.784+0000 7f2f57400640 1 -- 172.21.15.59:0/1940872067 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7f2f500be030 con 0x7f2f6009bad0 2024-05-30T17:05:31.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.784+0000 7f2f57400640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f4006a420 0x7f2f4006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:31.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.784+0000 7f2f57400640 1 -- 172.21.15.59:0/1940872067 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f2f5011f520 con 0x7f2f6009bad0 2024-05-30T17:05:31.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.784+0000 7f2f5ea00640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f4006a420 0x7f2f4006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:31.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.784+0000 7f2f5ea00640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f4006a420 0x7f2f4006c8e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2f6016a7d0 tx=0x7f2f4c0016c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:31.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:31.788+0000 7f2f57400640 1 -- 172.21.15.59:0/1940872067 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2f50015fd0 con 0x7f2f6009bad0 2024-05-30T17:05:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.020+0000 7f2f66800640 1 -- 172.21.15.59:0/1940872067 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2f600b4d40 con 0x7f2f6009bad0 2024-05-30T17:05:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.020+0000 7f2f57400640 1 -- 172.21.15.59:0/1940872067 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2876 (secure 0 0 0) 0x7f2f500f0ef0 con 0x7f2f6009bad0 2024-05-30T17:05:32.022 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:05:32.022 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:05:32.022 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:05:32.022 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:05:32.022 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:05:32.022 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:05:32.022 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:05:32.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:32.022 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:05:32.023 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:05:32.023 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:05:32.023 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:05:32.023 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:05:32.023 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:32.023 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:05:32.023 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:05:32.023 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:05:32.023 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:05:32.023 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:32.023 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 1011, 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 133, 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:05:32.024 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4059, 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 16854530490, 2024-05-30T17:05:32.025 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 34091507712, 2024-05-30T17:05:32.026 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 739002605568, 2024-05-30T17:05:32.026 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:05:32.026 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 677567855, 2024-05-30T17:05:32.026 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 680058210, 2024-05-30T17:05:32.026 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 164, 2024-05-30T17:05:32.026 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 177 2024-05-30T17:05:32.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:32.026 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:05:32.026 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 82, 2024-05-30T17:05:32.026 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 9, 2024-05-30T17:05:32.026 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:05:32.026 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 9, 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8991 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:32.027 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 23, 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:05:25.405445+0000", 2024-05-30T17:05:32.028 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: "a": { 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:32.029 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: "6e6cc831-b1b2-4d0f-922b-d5d0e3078e10": { 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "1 ongoing clones; Avg progress is 20.573% (21s)\n [=====.......................] (remaining: 82s)", 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.20573000609874725, 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: "e9349e32-2ec7-45d6-9fcc-56a40d998319": { 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "1 ongoing+pending clones; Avg progress is 20.573% (13s)\n [=====.......................] (remaining: 52s)", 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 0.20573000609874725, 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:32.031 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:05:32.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.024+0000 7f2f66800640 1 -- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f4006a420 msgr2=0x7f2f4006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.024+0000 7f2f66800640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f4006a420 0x7f2f4006c8e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2f6016a7d0 tx=0x7f2f4c0016c0 comp rx=0 tx=0).stop 2024-05-30T17:05:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.024+0000 7f2f66800640 1 -- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f6009bad0 msgr2=0x7f2f6014fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.024+0000 7f2f66800640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f6009bad0 0x7f2f6014fba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f50000c10 tx=0x7f2f5001ab90 comp rx=0 tx=0).stop 2024-05-30T17:05:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.024+0000 7f2f66800640 1 -- 172.21.15.59:0/1940872067 shutdown_connections 2024-05-30T17:05:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.024+0000 7f2f66800640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2f4006a420 0x7f2f4006c8e0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.024+0000 7f2f66800640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f600b22e0 0x7f2f6014bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.024+0000 7f2f66800640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f600b1700 0x7f2f600b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.024+0000 7f2f66800640 1 --2- 172.21.15.59:0/1940872067 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f6009bad0 0x7f2f6014fba0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.024+0000 7f2f66800640 1 -- 172.21.15.59:0/1940872067 >> 172.21.15.59:0/1940872067 conn(0x7f2f600b3f30 msgr2=0x7f2f6006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.024+0000 7f2f66800640 1 -- 172.21.15.59:0/1940872067 shutdown_connections 2024-05-30T17:05:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:32.024+0000 7f2f66800640 1 -- 172.21.15.59:0/1940872067 wait complete. 2024-05-30T17:05:34.045 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:05:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.196+0000 7fd5ae400640 1 Processor -- start 2024-05-30T17:05:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.196+0000 7fd5ae400640 1 -- start start 2024-05-30T17:05:34.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.196+0000 7fd5ae400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd5a809aa40 0x7fd5a809ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.196+0000 7fd5ae400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a81600a0 con 0x7fd5a815fcc0 2024-05-30T17:05:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.196+0000 7fd5ae400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a809ba80 con 0x7fd5a80b3770 2024-05-30T17:05:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.196+0000 7fd5ae400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd5a80b4b80 con 0x7fd5a809aa40 2024-05-30T17:05:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.196+0000 7fd5ad000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd5a815fcc0 0x7fd5a80d0c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50532/0 (socket says 172.21.15.59:50532) 2024-05-30T17:05:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.196+0000 7fd5ad000640 1 -- 172.21.15.59:0/4276651486 learned_addr learned my addr 172.21.15.59:0/4276651486 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.196+0000 7fd5ada00640 1 --2- 172.21.15.59:0/4276651486 >> v2:172.21.15.59:3300/0 conn(0x7fd5a809aa40 0x7fd5a809ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.196+0000 7fd5a7e00640 1 -- 172.21.15.59:0/4276651486 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 69269922 0 0) 0x7fd5a81600a0 con 0x7fd5a815fcc0 2024-05-30T17:05:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.196+0000 7fd5a7e00640 1 -- 172.21.15.59:0/4276651486 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd58c003530 con 0x7fd5a815fcc0 2024-05-30T17:05:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5ada00640 1 -- 172.21.15.59:0/4276651486 >> v1:172.21.15.107:6789/0 conn(0x7fd5a80b3770 legacy=0x7fd5a80b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5ada00640 1 -- 172.21.15.59:0/4276651486 >> v1:172.21.15.59:6789/0 conn(0x7fd5a815fcc0 legacy=0x7fd5a80d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5ada00640 1 -- 172.21.15.59:0/4276651486 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a809b710 con 0x7fd5a809aa40 2024-05-30T17:05:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5ada00640 1 --2- 172.21.15.59:0/4276651486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a809aa40 0x7fd5a809ae90 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009d90 tx=0x7fd5a001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801cc30b40215122 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5a7e00640 1 -- 172.21.15.59:0/4276651486 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00b2070 con 0x7fd5a809aa40 2024-05-30T17:05:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5a7e00640 1 -- 172.21.15.59:0/4276651486 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a00a5830 con 0x7fd5a809aa40 2024-05-30T17:05:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5a7e00640 1 -- 172.21.15.59:0/4276651486 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00a5c00 con 0x7fd5a809aa40 2024-05-30T17:05:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5ae400640 1 -- 172.21.15.59:0/4276651486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a809aa40 msgr2=0x7fd5a809ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5ae400640 1 --2- 172.21.15.59:0/4276651486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a809aa40 0x7fd5a809ae90 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009d90 tx=0x7fd5a001c970 comp rx=0 tx=0).stop 2024-05-30T17:05:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5ae400640 1 -- 172.21.15.59:0/4276651486 shutdown_connections 2024-05-30T17:05:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5ae400640 1 --2- 172.21.15.59:0/4276651486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a809aa40 0x7fd5a809ae90 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5ae400640 1 -- 172.21.15.59:0/4276651486 >> 172.21.15.59:0/4276651486 conn(0x7fd5a80b3ec0 msgr2=0x7fd5a80b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5ae400640 1 -- 172.21.15.59:0/4276651486 shutdown_connections 2024-05-30T17:05:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.200+0000 7fd5ae400640 1 -- 172.21.15.59:0/4276651486 wait complete. 2024-05-30T17:05:34.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ae400640 1 Processor -- start 2024-05-30T17:05:34.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ae400640 1 -- start start 2024-05-30T17:05:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ae400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a809aa40 0x7fd5a80cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ae400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5a80b3770 0x7fd5a815c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ae400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5a815fcc0 0x7fd5a8150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ae400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a80cdaa0 con 0x7fd5a809aa40 2024-05-30T17:05:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ae400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a80cd920 con 0x7fd5a815fcc0 2024-05-30T17:05:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ae400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a816a340 con 0x7fd5a80b3770 2024-05-30T17:05:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ad000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a809aa40 0x7fd5a80cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ad000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a809aa40 0x7fd5a80cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45494/0 (socket says 172.21.15.59:45494) 2024-05-30T17:05:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ad000640 1 -- 172.21.15.59:0/1563543478 learned_addr learned my addr 172.21.15.59:0/1563543478 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ada00640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5a815fcc0 0x7fd5a8150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd59fe00640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5a80b3770 0x7fd5a815c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ad000640 1 -- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5a80b3770 msgr2=0x7fd5a815c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ad000640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5a80b3770 0x7fd5a815c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ad000640 1 -- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5a815fcc0 msgr2=0x7fd5a8150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ad000640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5a815fcc0 0x7fd5a8150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ad000640 1 -- 172.21.15.59:0/1563543478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a815c880 con 0x7fd5a809aa40 2024-05-30T17:05:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd59fe00640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5a80b3770 0x7fd5a815c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:05:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5ad000640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a809aa40 0x7fd5a80cb3b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c420 tx=0x7fd59800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.204+0000 7fd5a5600640 1 -- 172.21.15.59:0/1563543478 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd598017070 con 0x7fd5a809aa40 2024-05-30T17:05:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.208+0000 7fd5a5600640 1 -- 172.21.15.59:0/1563543478 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd598005cf0 con 0x7fd5a809aa40 2024-05-30T17:05:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.208+0000 7fd5ae400640 1 -- 172.21.15.59:0/1563543478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a80d0650 con 0x7fd5a809aa40 2024-05-30T17:05:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.208+0000 7fd5a5600640 1 -- 172.21.15.59:0/1563543478 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980072d0 con 0x7fd5a809aa40 2024-05-30T17:05:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.208+0000 7fd5ae400640 1 -- 172.21.15.59:0/1563543478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a80cfb90 con 0x7fd5a809aa40 2024-05-30T17:05:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.208+0000 7fd5ae400640 1 -- 172.21.15.59:0/1563543478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a8068a90 con 0x7fd5a809aa40 2024-05-30T17:05:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.208+0000 7fd5a5600640 1 -- 172.21.15.59:0/1563543478 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7fd59801a070 con 0x7fd5a809aa40 2024-05-30T17:05:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.208+0000 7fd5a5600640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd58406a420 0x7fd58406c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.208+0000 7fd5a5600640 1 -- 172.21.15.59:0/1563543478 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fd598084de0 con 0x7fd5a809aa40 2024-05-30T17:05:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.208+0000 7fd59fe00640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd58406a420 0x7fd58406c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.212+0000 7fd59fe00640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd58406a420 0x7fd58406c8e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80cb8f0 tx=0x7fd590009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:34.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.212+0000 7fd5a5600640 1 -- 172.21.15.59:0/1563543478 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd5a815c880 con 0x7fd5a809aa40 2024-05-30T17:05:34.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 -- 172.21.15.59:0/1563543478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd5a80d0250 con 0x7fd5a809aa40 2024-05-30T17:05:34.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5a5600640 1 -- 172.21.15.59:0/1563543478 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2834 (secure 0 0 0) 0x7fd5980567b0 con 0x7fd5a809aa40 2024-05-30T17:05:34.437 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:05:34.437 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:05:34.437 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:05:34.437 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:05:34.437 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:05:34.437 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:05:34.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:05:34.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:34.437 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:05:34.438 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:05:34.438 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:05:34.438 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:05:34.438 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:05:34.438 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:34.438 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:05:34.438 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:05:34.442 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:05:34.442 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:05:34.442 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:34.442 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 1014, 2024-05-30T17:05:34.442 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:05:34.442 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:05:34.442 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:05:34.442 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:05:34.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:34.442 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:05:34.442 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 133, 2024-05-30T17:05:34.442 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:34.443 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4720, 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 19631467164, 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 40287404032, 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 732806709248, 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 867385905, 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 876192286, 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 210, 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 232 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 82, 2024-05-30T17:05:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 9, 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 9, 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8991 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:05:34.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 23, 2024-05-30T17:05:34.446 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:05:25.405445+0000", 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: "a": { 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:34.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: "6e6cc831-b1b2-4d0f-922b-d5d0e3078e10": { 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 29.0 seconds before exiting (23s)\n [============================] ", 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: "e9349e32-2ec7-45d6-9fcc-56a40d998319": { 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 29.0 seconds before exiting (15s)\n [============================] ", 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:34.448 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:05:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 -- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd58406a420 msgr2=0x7fd58406c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd58406a420 0x7fd58406c8e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80cb8f0 tx=0x7fd590009040 comp rx=0 tx=0).stop 2024-05-30T17:05:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 -- 172.21.15.59:0/1563543478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a809aa40 msgr2=0x7fd5a80cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a809aa40 0x7fd5a80cb3b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c420 tx=0x7fd59800c8e0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 -- 172.21.15.59:0/1563543478 shutdown_connections 2024-05-30T17:05:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd58406a420 0x7fd58406c8e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5a815fcc0 0x7fd5a8150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5a80b3770 0x7fd5a815c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 --2- 172.21.15.59:0/1563543478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a809aa40 0x7fd5a80cb3b0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 -- 172.21.15.59:0/1563543478 >> 172.21.15.59:0/1563543478 conn(0x7fd5a80b3ec0 msgr2=0x7fd5a815ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 -- 172.21.15.59:0/1563543478 shutdown_connections 2024-05-30T17:05:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.436+0000 7fd5ae400640 1 -- 172.21.15.59:0/1563543478 wait complete. 2024-05-30T17:05:34.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:05:34.459 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -lh volumes/_nogroup/subvol_clone67191/f957bb76-cdf2-47e2-9da1-c9bd195f6fef 2024-05-30T17:05:34.459 DEBUG:teuthology.orchestra.run.smithi059:> ) 2024-05-30T17:05:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:ls: cannot access 'volumes/_nogroup/subvol_clone67191/f957bb76-cdf2-47e2-9da1-c9bd195f6fef': No such file or directory 2024-05-30T17:05:34.472 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-30T17:05:34.473 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T17:05:34.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8304000640 1 Processor -- start 2024-05-30T17:05:34.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8304000640 1 -- start start 2024-05-30T17:05:34.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8304000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f82fc0af720 0x7f82fc15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:34.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8304000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82fc06e900 0x7f82fc15f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:34.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8304000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82fc15f060 con 0x7f82fc0d0560 2024-05-30T17:05:34.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8304000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f82fc0afb00 con 0x7f82fc06e900 2024-05-30T17:05:34.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8304000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f82fc15c270 con 0x7f82fc0af720 2024-05-30T17:05:34.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8300c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82fc06e900 0x7f82fc15f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:34.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8300c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82fc06e900 0x7f82fc15f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45500/0 (socket says 172.21.15.59:45500) 2024-05-30T17:05:34.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8300c00640 1 -- 172.21.15.59:0/1285861773 learned_addr learned my addr 172.21.15.59:0/1285861773 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:34.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8301600640 1 --2- 172.21.15.59:0/1285861773 >> v2:172.21.15.107:3300/0 conn(0x7f82fc0af720 0x7f82fc15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:34.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8300c00640 1 -- 172.21.15.59:0/1285861773 >> v2:172.21.15.107:3300/0 conn(0x7f82fc0af720 msgr2=0x7f82fc15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:34.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8300c00640 1 --2- 172.21.15.59:0/1285861773 >> v2:172.21.15.107:3300/0 conn(0x7f82fc0af720 0x7f82fc15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8300c00640 1 -- 172.21.15.59:0/1285861773 >> v1:172.21.15.107:6789/0 conn(0x7f82fc0d0560 legacy=0x7f82fc072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.656+0000 7f8300c00640 1 -- 172.21.15.59:0/1285861773 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82fc15c550 con 0x7f82fc06e900 2024-05-30T17:05:34.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.660+0000 7f8300c00640 1 --2- 172.21.15.59:0/1285861773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82fc06e900 0x7f82fc15f7f0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0d04b0 tx=0x7f82e801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6af321fb54e49f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:34.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.660+0000 7f82fbe00640 1 -- 172.21.15.59:0/1285861773 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80aa670 con 0x7f82fc06e900 2024-05-30T17:05:34.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.660+0000 7f82fbe00640 1 -- 172.21.15.59:0/1285861773 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e80af070 con 0x7f82fc06e900 2024-05-30T17:05:34.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.660+0000 7f82fbe00640 1 -- 172.21.15.59:0/1285861773 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80aaa30 con 0x7f82fc06e900 2024-05-30T17:05:34.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.660+0000 7f8304000640 1 -- 172.21.15.59:0/1285861773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82fc06e900 msgr2=0x7f82fc15f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.660+0000 7f8304000640 1 --2- 172.21.15.59:0/1285861773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82fc06e900 0x7f82fc15f7f0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0d04b0 tx=0x7f82e801c4f0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.660+0000 7f8304000640 1 -- 172.21.15.59:0/1285861773 shutdown_connections 2024-05-30T17:05:34.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.660+0000 7f8304000640 1 --2- 172.21.15.59:0/1285861773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82fc06e900 0x7f82fc15f7f0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.660+0000 7f8304000640 1 --2- 172.21.15.59:0/1285861773 >> v2:172.21.15.107:3300/0 conn(0x7f82fc0af720 0x7f82fc15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.660+0000 7f8304000640 1 -- 172.21.15.59:0/1285861773 >> 172.21.15.59:0/1285861773 conn(0x7f82fc0b22d0 msgr2=0x7f82fc0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:34.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.660+0000 7f8304000640 1 -- 172.21.15.59:0/1285861773 shutdown_connections 2024-05-30T17:05:34.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.660+0000 7f8304000640 1 -- 172.21.15.59:0/1285861773 wait complete. 2024-05-30T17:05:34.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8304000640 1 Processor -- start 2024-05-30T17:05:34.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8304000640 1 -- start start 2024-05-30T17:05:34.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8304000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82fc06e900 0x7f82fc166b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:34.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8304000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82fc0af720 0x7f82fc158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:34.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8304000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82fc0d0560 0x7f82fc14c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:34.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8304000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f82fc15fd30 con 0x7f82fc0af720 2024-05-30T17:05:34.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8304000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f82fc0d0da0 con 0x7f82fc06e900 2024-05-30T17:05:34.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8304000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f82fc15feb0 con 0x7f82fc0d0560 2024-05-30T17:05:34.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8300c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82fc0af720 0x7f82fc158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:34.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8300c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82fc0af720 0x7f82fc158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45504/0 (socket says 172.21.15.59:45504) 2024-05-30T17:05:34.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8300c00640 1 -- 172.21.15.59:0/3714907185 learned_addr learned my addr 172.21.15.59:0/3714907185 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:34.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8301600640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82fc06e900 0x7f82fc166b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:34.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8302000640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82fc0d0560 0x7f82fc14c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:34.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8300c00640 1 -- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82fc0d0560 msgr2=0x7f82fc14c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8300c00640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82fc0d0560 0x7f82fc14c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8300c00640 1 -- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82fc06e900 msgr2=0x7f82fc166b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8300c00640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82fc06e900 0x7f82fc166b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8300c00640 1 -- 172.21.15.59:0/3714907185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82fc159310 con 0x7f82fc0af720 2024-05-30T17:05:34.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8300c00640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82fc0af720 0x7f82fc158dd0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f82e80ac040 tx=0x7f82e801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:34.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f82f9600640 1 -- 172.21.15.59:0/3714907185 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80bd5f0 con 0x7f82fc0af720 2024-05-30T17:05:34.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f82f9600640 1 -- 172.21.15.59:0/3714907185 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e80bd7b0 con 0x7f82fc0af720 2024-05-30T17:05:34.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f82f9600640 1 -- 172.21.15.59:0/3714907185 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80bdba0 con 0x7f82fc0af720 2024-05-30T17:05:34.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8304000640 1 -- 172.21.15.59:0/3714907185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82fc159e50 con 0x7f82fc0af720 2024-05-30T17:05:34.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8304000640 1 -- 172.21.15.59:0/3714907185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82fc159890 con 0x7f82fc0af720 2024-05-30T17:05:34.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.664+0000 7f8304000640 1 -- 172.21.15.59:0/3714907185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82fc068a90 con 0x7f82fc0af720 2024-05-30T17:05:34.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.668+0000 7f82f9600640 1 -- 172.21.15.59:0/3714907185 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7f82e80b33f0 con 0x7f82fc0af720 2024-05-30T17:05:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.668+0000 7f82f9600640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f82dc06a420 0x7f82dc06c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.668+0000 7f82f9600640 1 -- 172.21.15.59:0/3714907185 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f82e81204d0 con 0x7f82fc0af720 2024-05-30T17:05:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.668+0000 7f8301600640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f82dc06a420 0x7f82dc06c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.668+0000 7f8301600640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f82dc06a420 0x7f82dc06c8e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f82f0006aa0 tx=0x7f82f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.672+0000 7f82f9600640 1 -- 172.21.15.59:0/3714907185 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f82e8016110 con 0x7f82fc0af720 2024-05-30T17:05:34.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.860+0000 7f8304000640 1 -- 172.21.15.59:0/3714907185 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f82fc15f7f0 con 0x7f82dc06a420 2024-05-30T17:05:34.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f82f9600640 1 -- 172.21.15.59:0/3714907185 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f82fc15f7f0 con 0x7f82dc06a420 2024-05-30T17:05:34.864 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:05:34.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:34.864 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephfs" 2024-05-30T17:05:34.864 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:34.864 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:05:34.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f8304000640 1 -- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f82dc06a420 msgr2=0x7f82dc06c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f8304000640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f82dc06a420 0x7f82dc06c8e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f82f0006aa0 tx=0x7f82f0008040 comp rx=0 tx=0).stop 2024-05-30T17:05:34.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f8304000640 1 -- 172.21.15.59:0/3714907185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82fc0af720 msgr2=0x7f82fc158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:34.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f8304000640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82fc0af720 0x7f82fc158dd0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f82e80ac040 tx=0x7f82e801ad30 comp rx=0 tx=0).stop 2024-05-30T17:05:34.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f8304000640 1 -- 172.21.15.59:0/3714907185 shutdown_connections 2024-05-30T17:05:34.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f8304000640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f82dc06a420 0x7f82dc06c8e0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f8304000640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82fc0d0560 0x7f82fc14c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f8304000640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82fc0af720 0x7f82fc158dd0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f8304000640 1 --2- 172.21.15.59:0/3714907185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82fc06e900 0x7f82fc166b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:34.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f8304000640 1 -- 172.21.15.59:0/3714907185 >> 172.21.15.59:0/3714907185 conn(0x7f82fc0b22d0 msgr2=0x7f82fc15af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:34.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f8304000640 1 -- 172.21.15.59:0/3714907185 shutdown_connections 2024-05-30T17:05:34.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:34.864+0000 7f8304000640 1 -- 172.21.15.59:0/3714907185 wait complete. 2024-05-30T17:05:34.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:05:35.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd654400640 1 Processor -- start 2024-05-30T17:05:35.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd654400640 1 -- start start 2024-05-30T17:05:35.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd654400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd64c0b37a0 0x7fd64c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:35.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd654400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd64c0cdb60 0x7fd64c0cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:35.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd654400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd64c0d0260 con 0x7fd64c09aa40 2024-05-30T17:05:35.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd654400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd64c0d0010 con 0x7fd64c0b37a0 2024-05-30T17:05:35.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd654400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd64c0d0540 con 0x7fd64c0cdb60 2024-05-30T17:05:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd651a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd64c0b37a0 0x7fd64c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd651a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd64c0b37a0 0x7fd64c0d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45508/0 (socket says 172.21.15.59:45508) 2024-05-30T17:05:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd651a00640 1 -- 172.21.15.59:0/2537934019 learned_addr learned my addr 172.21.15.59:0/2537934019 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd651000640 1 --2- 172.21.15.59:0/2537934019 >> v2:172.21.15.107:3300/0 conn(0x7fd64c0cdb60 0x7fd64c0cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd651a00640 1 -- 172.21.15.59:0/2537934019 >> v2:172.21.15.107:3300/0 conn(0x7fd64c0cdb60 msgr2=0x7fd64c0cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd651a00640 1 --2- 172.21.15.59:0/2537934019 >> v2:172.21.15.107:3300/0 conn(0x7fd64c0cdb60 0x7fd64c0cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd651a00640 1 -- 172.21.15.59:0/2537934019 >> v1:172.21.15.107:6789/0 conn(0x7fd64c09aa40 legacy=0x7fd64c0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.024+0000 7fd651a00640 1 -- 172.21.15.59:0/2537934019 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64c0d0820 con 0x7fd64c0b37a0 2024-05-30T17:05:35.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.028+0000 7fd651a00640 1 --2- 172.21.15.59:0/2537934019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c0b37a0 0x7fd64c0d1020 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0cce40 tx=0x7fd64001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1297f91f24a5fb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:35.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.028+0000 7fd64be00640 1 -- 172.21.15.59:0/2537934019 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6400b0070 con 0x7fd64c0b37a0 2024-05-30T17:05:35.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.028+0000 7fd64be00640 1 -- 172.21.15.59:0/2537934019 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6400ab600 con 0x7fd64c0b37a0 2024-05-30T17:05:35.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.028+0000 7fd64be00640 1 -- 172.21.15.59:0/2537934019 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6400ab9d0 con 0x7fd64c0b37a0 2024-05-30T17:05:35.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.028+0000 7fd654400640 1 -- 172.21.15.59:0/2537934019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c0b37a0 msgr2=0x7fd64c0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:35.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.028+0000 7fd654400640 1 --2- 172.21.15.59:0/2537934019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c0b37a0 0x7fd64c0d1020 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0cce40 tx=0x7fd64001c490 comp rx=0 tx=0).stop 2024-05-30T17:05:35.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.028+0000 7fd654400640 1 -- 172.21.15.59:0/2537934019 shutdown_connections 2024-05-30T17:05:35.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.028+0000 7fd654400640 1 --2- 172.21.15.59:0/2537934019 >> v2:172.21.15.107:3300/0 conn(0x7fd64c0cdb60 0x7fd64c0cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:35.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.028+0000 7fd654400640 1 --2- 172.21.15.59:0/2537934019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c0b37a0 0x7fd64c0d1020 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:35.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.028+0000 7fd654400640 1 -- 172.21.15.59:0/2537934019 >> 172.21.15.59:0/2537934019 conn(0x7fd64c0b3f30 msgr2=0x7fd64c0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.028+0000 7fd654400640 1 -- 172.21.15.59:0/2537934019 shutdown_connections 2024-05-30T17:05:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.028+0000 7fd654400640 1 -- 172.21.15.59:0/2537934019 wait complete. 2024-05-30T17:05:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd654400640 1 Processor -- start 2024-05-30T17:05:35.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd654400640 1 -- start start 2024-05-30T17:05:35.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd654400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd64c09aa40 0x7fd64c166f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:35.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd654400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c0b37a0 0x7fd64c0c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:35.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd654400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd64c0cdb60 0x7fd64c1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:35.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd654400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c169810 con 0x7fd64c0b37a0 2024-05-30T17:05:35.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd654400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c169690 con 0x7fd64c0cdb60 2024-05-30T17:05:35.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd654400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd64c169990 con 0x7fd64c09aa40 2024-05-30T17:05:35.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd651000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c0b37a0 0x7fd64c0c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:35.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd651000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c0b37a0 0x7fd64c0c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45516/0 (socket says 172.21.15.59:45516) 2024-05-30T17:05:35.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd651000640 1 -- 172.21.15.59:0/1241787729 learned_addr learned my addr 172.21.15.59:0/1241787729 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:35.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd651a00640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd64c09aa40 0x7fd64c166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:35.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd652400640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd64c0cdb60 0x7fd64c1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:35.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd651000640 1 -- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd64c09aa40 msgr2=0x7fd64c166f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:35.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd651000640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd64c09aa40 0x7fd64c166f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:35.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd651000640 1 -- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd64c0cdb60 msgr2=0x7fd64c1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:35.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd651000640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd64c0cdb60 0x7fd64c1589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:35.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd651000640 1 -- 172.21.15.59:0/1241787729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64c0c8290 con 0x7fd64c0b37a0 2024-05-30T17:05:35.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd651000640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c0b37a0 0x7fd64c0c7bd0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fd63800e960 tx=0x7fd63800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:35.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd649600640 1 -- 172.21.15.59:0/1241787729 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd638017070 con 0x7fd64c0b37a0 2024-05-30T17:05:35.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd649600640 1 -- 172.21.15.59:0/1241787729 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd63800ca00 con 0x7fd64c0b37a0 2024-05-30T17:05:35.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd649600640 1 -- 172.21.15.59:0/1241787729 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63800cdb0 con 0x7fd64c0b37a0 2024-05-30T17:05:35.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd654400640 1 -- 172.21.15.59:0/1241787729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64c0c8570 con 0x7fd64c0b37a0 2024-05-30T17:05:35.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.032+0000 7fd654400640 1 -- 172.21.15.59:0/1241787729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64c06cff0 con 0x7fd64c0b37a0 2024-05-30T17:05:35.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.036+0000 7fd654400640 1 -- 172.21.15.59:0/1241787729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd64c068a90 con 0x7fd64c0b37a0 2024-05-30T17:05:35.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.036+0000 7fd649600640 1 -- 172.21.15.59:0/1241787729 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7fd63801a070 con 0x7fd64c0b37a0 2024-05-30T17:05:35.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.036+0000 7fd649600640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd62c06a420 0x7fd62c06c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:35.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.036+0000 7fd649600640 1 -- 172.21.15.59:0/1241787729 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fd638085e40 con 0x7fd64c0b37a0 2024-05-30T17:05:35.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.036+0000 7fd651a00640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd62c06a420 0x7fd62c06c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:35.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.036+0000 7fd651a00640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd62c06a420 0x7fd62c06c8e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd6400ad000 tx=0x7fd6400a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:35.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.040+0000 7fd649600640 1 -- 172.21.15.59:0/1241787729 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd638057810 con 0x7fd64c0b37a0 2024-05-30T17:05:35.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 -- 172.21.15.59:0/1241787729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd64c0ce950 con 0x7fd64c0b37a0 2024-05-30T17:05:35.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd649600640 1 -- 172.21.15.59:0/1241787729 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2834 (secure 0 0 0) 0x7fd63805bb10 con 0x7fd64c0b37a0 2024-05-30T17:05:35.264 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:05:35.264 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:05:35.264 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:05:35.265 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:05:35.265 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:05:35.265 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:05:35.265 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:05:35.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:35.265 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:05:35.265 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:05:35.265 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:05:35.265 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:05:35.265 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:05:35.265 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:35.265 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 1015, 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 133, 2024-05-30T17:05:35.266 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:35.267 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4720, 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 19631467164, 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 40287404032, 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 732806709248, 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 867385905, 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 876192286, 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 210, 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 232 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:35.268 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 82, 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 9, 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 9, 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8991 2024-05-30T17:05:35.269 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:05:35.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:35.271 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:05:35.271 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 23, 2024-05-30T17:05:35.271 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:05:25.405445+0000", 2024-05-30T17:05:35.271 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-05-30T17:05:35.271 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-05-30T17:05:35.271 INFO:teuthology.orchestra.run.smithi059.stdout: "daemons": { 2024-05-30T17:05:35.271 INFO:teuthology.orchestra.run.smithi059.stdout: "summary": "", 2024-05-30T17:05:35.271 INFO:teuthology.orchestra.run.smithi059.stdout: "a": { 2024-05-30T17:05:35.271 INFO:teuthology.orchestra.run.smithi059.stdout: "start_epoch": 0, 2024-05-30T17:05:35.271 INFO:teuthology.orchestra.run.smithi059.stdout: "start_stamp": "0.000000", 2024-05-30T17:05:35.271 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 0, 2024-05-30T17:05:35.271 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": {}, 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: "task_status": {} 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: "6e6cc831-b1b2-4d0f-922b-d5d0e3078e10": { 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 29.0 seconds before exiting (23s)\n [============================] ", 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:35.272 INFO:teuthology.orchestra.run.smithi059.stdout: "e9349e32-2ec7-45d6-9fcc-56a40d998319": { 2024-05-30T17:05:35.273 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 29.0 seconds before exiting (15s)\n [============================] ", 2024-05-30T17:05:35.273 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:05:35.273 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:35.273 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:35.273 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:35.273 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:05:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 -- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd62c06a420 msgr2=0x7fd62c06c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd62c06a420 0x7fd62c06c8e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd6400ad000 tx=0x7fd6400a6000 comp rx=0 tx=0).stop 2024-05-30T17:05:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 -- 172.21.15.59:0/1241787729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c0b37a0 msgr2=0x7fd64c0c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c0b37a0 0x7fd64c0c7bd0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fd63800e960 tx=0x7fd63800ee20 comp rx=0 tx=0).stop 2024-05-30T17:05:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 -- 172.21.15.59:0/1241787729 shutdown_connections 2024-05-30T17:05:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd62c06a420 0x7fd62c06c8e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd64c0cdb60 0x7fd64c1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c0b37a0 0x7fd64c0c7bd0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 --2- 172.21.15.59:0/1241787729 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd64c09aa40 0x7fd64c166f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:35.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 -- 172.21.15.59:0/1241787729 >> 172.21.15.59:0/1241787729 conn(0x7fd64c0b3f30 msgr2=0x7fd64c071620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:35.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 -- 172.21.15.59:0/1241787729 shutdown_connections 2024-05-30T17:05:35.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:35.264+0000 7fd654400640 1 -- 172.21.15.59:0/1241787729 wait complete. 2024-05-30T17:05:36.617 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:05:36.621 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:05:40.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:05:40.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.436+0000 7fcb0f200640 1 Processor -- start 2024-05-30T17:05:40.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.436+0000 7fcb0f200640 1 -- start start 2024-05-30T17:05:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb0f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080d1020 0x7fcb0809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb0f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcb0809af80 0x7fcb080b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb0f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb080d0260 con 0x7fcb080b37a0 2024-05-30T17:05:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb0f200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fcb080d0010 con 0x7fcb0809af80 2024-05-30T17:05:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb0f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcb080d0540 con 0x7fcb080d1020 2024-05-30T17:05:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcb080b37a0 0x7fcb080cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50540/0 (socket says 172.21.15.59:50540) 2024-05-30T17:05:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07e00640 1 -- 172.21.15.59:0/1195390566 learned_addr learned my addr 172.21.15.59:0/1195390566 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcaff400640 1 --2- 172.21.15.59:0/1195390566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080d1020 0x7fcb0809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb0d200640 1 --2- 172.21.15.59:0/1195390566 >> v2:172.21.15.107:3300/0 conn(0x7fcb0809af80 0x7fcb080b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3845302429 0 0) 0x7fcb080d0260 con 0x7fcb080b37a0 2024-05-30T17:05:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaec003530 con 0x7fcb080b37a0 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1473963649 0 0) 0x7fcaec003530 con 0x7fcb080b37a0 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080d1020 msgr2=0x7fcb0809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 --2- 172.21.15.59:0/1195390566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080d1020 0x7fcb0809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 >> v2:172.21.15.107:3300/0 conn(0x7fcb0809af80 msgr2=0x7fcb080b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 --2- 172.21.15.59:0/1195390566 >> v2:172.21.15.107:3300/0 conn(0x7fcb0809af80 0x7fcb080b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb080d0820 con 0x7fcb080b37a0 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fcaf8001800 con 0x7fcb080b37a0 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 >> v1:172.21.15.59:6789/0 conn(0x7fcb080b37a0 legacy=0x7fcb080cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 --2- 172.21.15.59:0/1195390566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080d1020 0x7fcaec0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 --2- 172.21.15.59:0/1195390566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaec003f40 0x7fcaec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 --2- 172.21.15.59:0/1195390566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaec004d50 0x7fcaec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcb080d0010 con 0x7fcaec004d50 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcb080d0540 con 0x7fcaec003f40 2024-05-30T17:05:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcaec00ba20 con 0x7fcb080d1020 2024-05-30T17:05:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb0d200640 1 --2- 172.21.15.59:0/1195390566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaec004d50 0x7fcaec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcaff400640 1 --2- 172.21.15.59:0/1195390566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaec003f40 0x7fcaec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb07e00640 1 --2- 172.21.15.59:0/1195390566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080d1020 0x7fcaec0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb0d200640 1 -- 172.21.15.59:0/1195390566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080d1020 msgr2=0x7fcaec0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb0d200640 1 --2- 172.21.15.59:0/1195390566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080d1020 0x7fcaec0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb0d200640 1 -- 172.21.15.59:0/1195390566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaec003f40 msgr2=0x7fcaec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb0d200640 1 --2- 172.21.15.59:0/1195390566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaec003f40 0x7fcaec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.440+0000 7fcb0d200640 1 -- 172.21.15.59:0/1195390566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec003530 con 0x7fcaec004d50 2024-05-30T17:05:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.444+0000 7fcb0d200640 1 --2- 172.21.15.59:0/1195390566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaec004d50 0x7fcaec0051d0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000e170 tx=0x7fcb0001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90086e2df2d7181 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.444+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb000b2070 con 0x7fcaec004d50 2024-05-30T17:05:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.444+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb000a5cb0 con 0x7fcaec004d50 2024-05-30T17:05:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.444+0000 7fcb07400640 1 -- 172.21.15.59:0/1195390566 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00009c10 con 0x7fcaec004d50 2024-05-30T17:05:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.444+0000 7fcb0f200640 1 -- 172.21.15.59:0/1195390566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaec004d50 msgr2=0x7fcaec0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.444+0000 7fcb0f200640 1 --2- 172.21.15.59:0/1195390566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaec004d50 0x7fcaec0051d0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000e170 tx=0x7fcb0001cca0 comp rx=0 tx=0).stop 2024-05-30T17:05:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.444+0000 7fcb0d200640 1 -- 172.21.15.59:0/1195390566 reap_dead start 2024-05-30T17:05:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.444+0000 7fcb0f200640 1 -- 172.21.15.59:0/1195390566 shutdown_connections 2024-05-30T17:05:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.444+0000 7fcb0f200640 1 -- 172.21.15.59:0/1195390566 >> 172.21.15.59:0/1195390566 conn(0x7fcb080b3f30 msgr2=0x7fcb080b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.444+0000 7fcb0f200640 1 -- 172.21.15.59:0/1195390566 shutdown_connections 2024-05-30T17:05:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.444+0000 7fcb0f200640 1 -- 172.21.15.59:0/1195390566 wait complete. 2024-05-30T17:05:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb0f200640 1 Processor -- start 2024-05-30T17:05:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb0f200640 1 -- start start 2024-05-30T17:05:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb0f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaec004d50 0x7fcb081527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb0f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb080cb8e0 0x7fcb080c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb0f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080c8250 0x7fcb0815c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb0f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcb080ce270 con 0x7fcb080cb8e0 2024-05-30T17:05:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb0f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcb080d1480 con 0x7fcaec004d50 2024-05-30T17:05:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb0f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcb0809b8f0 con 0x7fcb080c8250 2024-05-30T17:05:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcaff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb080cb8e0 0x7fcb080c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcaff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb080cb8e0 0x7fcb080c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45522/0 (socket says 172.21.15.59:45522) 2024-05-30T17:05:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcaff400640 1 -- 172.21.15.59:0/3134627311 learned_addr learned my addr 172.21.15.59:0/3134627311 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb07e00640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaec004d50 0x7fcb081527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb0d200640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080c8250 0x7fcb0815c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcaff400640 1 -- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080c8250 msgr2=0x7fcb0815c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcaff400640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080c8250 0x7fcb0815c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcaff400640 1 -- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaec004d50 msgr2=0x7fcb081527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcaff400640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaec004d50 0x7fcb081527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcaff400640 1 -- 172.21.15.59:0/3134627311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb080ca560 con 0x7fcb080cb8e0 2024-05-30T17:05:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcaff400640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb080cb8e0 0x7fcb080c7d10 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0011960 tx=0x7fcaf0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:40.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb04c00640 1 -- 172.21.15.59:0/3134627311 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf000faf0 con 0x7fcb080cb8e0 2024-05-30T17:05:40.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb04c00640 1 -- 172.21.15.59:0/3134627311 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf000fc90 con 0x7fcb080cb8e0 2024-05-30T17:05:40.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb0f200640 1 -- 172.21.15.59:0/3134627311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb080ca840 con 0x7fcb080cb8e0 2024-05-30T17:05:40.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb04c00640 1 -- 172.21.15.59:0/3134627311 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0014440 con 0x7fcb080cb8e0 2024-05-30T17:05:40.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb0f200640 1 -- 172.21.15.59:0/3134627311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb080cae00 con 0x7fcb080cb8e0 2024-05-30T17:05:40.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.448+0000 7fcb0f200640 1 -- 172.21.15.59:0/3134627311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb08068a90 con 0x7fcb080cb8e0 2024-05-30T17:05:40.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.452+0000 7fcb04c00640 1 -- 172.21.15.59:0/3134627311 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7fcaf0012040 con 0x7fcb080cb8e0 2024-05-30T17:05:40.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.452+0000 7fcb04c00640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcae406a450 0x7fcae406c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:40.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.452+0000 7fcb04c00640 1 -- 172.21.15.59:0/3134627311 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fcaf0085ff0 con 0x7fcb080cb8e0 2024-05-30T17:05:40.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.452+0000 7fcb07e00640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcae406a450 0x7fcae406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:40.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.452+0000 7fcb07e00640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcae406a450 0x7fcae406c910 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80010f0 tx=0x7fcaf8007950 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.456+0000 7fcb04c00640 1 -- 172.21.15.59:0/3134627311 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcaf0019030 con 0x7fcb080cb8e0 2024-05-30T17:05:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.676+0000 7fcb0f200640 1 -- 172.21.15.59:0/3134627311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcb080ce950 con 0x7fcb080cb8e0 2024-05-30T17:05:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb04c00640 1 -- 172.21.15.59:0/3134627311 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2379 (secure 0 0 0) 0x7fcaf00579c0 con 0x7fcb080cb8e0 2024-05-30T17:05:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:05:40.680 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:05:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:05:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:05:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:05:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:05:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 1020, 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 133, 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:05:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4721, 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 19656670582, 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 40505548800, 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 732588564480, 2024-05-30T17:05:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 269385842, 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 273959530, 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 66, 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 77 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 82, 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 9, 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:05:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 9, 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8991 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:05:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 24, 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:05:35.410471+0000", 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "6e6cc831-b1b2-4d0f-922b-d5d0e3078e10": { 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 23.0 seconds before exiting (29s)\n [============================] ", 2024-05-30T17:05:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:05:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "e9349e32-2ec7-45d6-9fcc-56a40d998319": { 2024-05-30T17:05:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 23.0 seconds before exiting (21s)\n [============================] ", 2024-05-30T17:05:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:05:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:40.687 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:05:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb0f200640 1 -- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcae406a450 msgr2=0x7fcae406c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb0f200640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcae406a450 0x7fcae406c910 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80010f0 tx=0x7fcaf8007950 comp rx=0 tx=0).stop 2024-05-30T17:05:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb0f200640 1 -- 172.21.15.59:0/3134627311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb080cb8e0 msgr2=0x7fcb080c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb0f200640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb080cb8e0 0x7fcb080c7d10 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0011960 tx=0x7fcaf0011e20 comp rx=0 tx=0).stop 2024-05-30T17:05:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb0f200640 1 -- 172.21.15.59:0/3134627311 shutdown_connections 2024-05-30T17:05:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb0f200640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcae406a450 0x7fcae406c910 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb0f200640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb080c8250 0x7fcb0815c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb0f200640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb080cb8e0 0x7fcb080c7d10 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb0f200640 1 --2- 172.21.15.59:0/3134627311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaec004d50 0x7fcb081527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb0f200640 1 -- 172.21.15.59:0/3134627311 >> 172.21.15.59:0/3134627311 conn(0x7fcb080b3f30 msgr2=0x7fcb080cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb0f200640 1 -- 172.21.15.59:0/3134627311 shutdown_connections 2024-05-30T17:05:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:40.680+0000 7fcb0f200640 1 -- 172.21.15.59:0/3134627311 wait complete. 2024-05-30T17:05:45.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:05:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.852+0000 7f1095800640 1 Processor -- start 2024-05-30T17:05:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.852+0000 7f1095800640 1 -- start start 2024-05-30T17:05:45.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f1095800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f109015f690 0x7f10900b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f1095800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f109006f8c0 0x7f10900b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f1095800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f109006de10 con 0x7f10901558e0 2024-05-30T17:05:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f1095800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f109006e0f0 con 0x7f109006f8c0 2024-05-30T17:05:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f1095800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f109006e3d0 con 0x7f109015f690 2024-05-30T17:05:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f108f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f109006f8c0 0x7f10900b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f108f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f109006f8c0 0x7f10900b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46338/0 (socket says 172.21.15.59:46338) 2024-05-30T17:05:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f108f400640 1 -- 172.21.15.59:0/3583061757 learned_addr learned my addr 172.21.15.59:0/3583061757 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f108f400640 1 -- 172.21.15.59:0/3583061757 >> v2:172.21.15.107:3300/0 conn(0x7f109015f690 msgr2=0x7f10900b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f1086000640 1 --2- 172.21.15.59:0/3583061757 >> v2:172.21.15.107:3300/0 conn(0x7f109015f690 0x7f10900b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f108f400640 1 --2- 172.21.15.59:0/3583061757 >> v2:172.21.15.107:3300/0 conn(0x7f109015f690 0x7f10900b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f108f400640 1 -- 172.21.15.59:0/3583061757 >> v1:172.21.15.107:6789/0 conn(0x7f10901558e0 legacy=0x7f109015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f108f400640 1 -- 172.21.15.59:0/3583061757 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109006e6b0 con 0x7f109006f8c0 2024-05-30T17:05:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.856+0000 7f1086000640 1 --2- 172.21.15.59:0/3583061757 >> v2:172.21.15.107:3300/0 conn(0x7f109015f690 0x7f10900b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:05:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f108f400640 1 --2- 172.21.15.59:0/3583061757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109006f8c0 0x7f10900b46b0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f1090073090 tx=0x7f108801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e41d8e85133d6e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:45.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f108e000640 1 -- 172.21.15.59:0/3583061757 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10880b2070 con 0x7f109006f8c0 2024-05-30T17:05:45.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f108e000640 1 -- 172.21.15.59:0/3583061757 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10880a9070 con 0x7f109006f8c0 2024-05-30T17:05:45.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f108e000640 1 -- 172.21.15.59:0/3583061757 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10880ad880 con 0x7f109006f8c0 2024-05-30T17:05:45.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f1095800640 1 -- 172.21.15.59:0/3583061757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109006f8c0 msgr2=0x7f10900b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:45.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f1095800640 1 --2- 172.21.15.59:0/3583061757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109006f8c0 0x7f10900b46b0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f1090073090 tx=0x7f108801c4e0 comp rx=0 tx=0).stop 2024-05-30T17:05:45.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f1095800640 1 -- 172.21.15.59:0/3583061757 shutdown_connections 2024-05-30T17:05:45.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f1095800640 1 --2- 172.21.15.59:0/3583061757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109006f8c0 0x7f10900b46b0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:45.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f1095800640 1 --2- 172.21.15.59:0/3583061757 >> v2:172.21.15.107:3300/0 conn(0x7f109015f690 0x7f10900b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:45.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f1095800640 1 -- 172.21.15.59:0/3583061757 >> 172.21.15.59:0/3583061757 conn(0x7f1090067d60 msgr2=0x7f109006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:45.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f1095800640 1 -- 172.21.15.59:0/3583061757 shutdown_connections 2024-05-30T17:05:45.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f1095800640 1 -- 172.21.15.59:0/3583061757 wait complete. 2024-05-30T17:05:45.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f1095800640 1 Processor -- start 2024-05-30T17:05:45.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f1095800640 1 -- start start 2024-05-30T17:05:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.860+0000 7f1095800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f109006f8c0 0x7f10900b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1095800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10901558e0 0x7f1090143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1095800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f109015f690 0x7f109015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1095800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1090155e40 con 0x7f10901558e0 2024-05-30T17:05:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1095800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1090155cc0 con 0x7f109006f8c0 2024-05-30T17:05:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1095800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f10900b5400 con 0x7f109015f690 2024-05-30T17:05:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1086000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10901558e0 0x7f1090143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1086000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10901558e0 0x7f1090143520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46344/0 (socket says 172.21.15.59:46344) 2024-05-30T17:05:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1086000640 1 -- 172.21.15.59:0/639615717 learned_addr learned my addr 172.21.15.59:0/639615717 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f108f400640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f109015f690 0x7f109015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f108ea00640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f109006f8c0 0x7f10900b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1086000640 1 -- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f109015f690 msgr2=0x7f109015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1086000640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f109015f690 0x7f109015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1086000640 1 -- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f109006f8c0 msgr2=0x7f10900b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1086000640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f109006f8c0 0x7f10900b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1086000640 1 -- 172.21.15.59:0/639615717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109014bba0 con 0x7f10901558e0 2024-05-30T17:05:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1086000640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10901558e0 0x7f1090143520 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f107800c7f0 tx=0x7f107800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1087400640 1 -- 172.21.15.59:0/639615717 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1078015070 con 0x7f10901558e0 2024-05-30T17:05:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1087400640 1 -- 172.21.15.59:0/639615717 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1078007820 con 0x7f10901558e0 2024-05-30T17:05:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1095800640 1 -- 172.21.15.59:0/639615717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109014be40 con 0x7f10901558e0 2024-05-30T17:05:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1087400640 1 -- 172.21.15.59:0/639615717 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1078007c10 con 0x7f10901558e0 2024-05-30T17:05:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1095800640 1 -- 172.21.15.59:0/639615717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109014c400 con 0x7f10901558e0 2024-05-30T17:05:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1095800640 1 -- 172.21.15.59:0/639615717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1090068a90 con 0x7f10901558e0 2024-05-30T17:05:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.864+0000 7f1087400640 1 -- 172.21.15.59:0/639615717 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 43) ==== 90945+0+0 (secure 0 0 0) 0x7f1078018070 con 0x7f10901558e0 2024-05-30T17:05:45.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.868+0000 7f1087400640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f106c06a470 0x7f106c06c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:45.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.868+0000 7f1087400640 1 -- 172.21.15.59:0/639615717 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f1078085920 con 0x7f10901558e0 2024-05-30T17:05:45.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.868+0000 7f108ea00640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f106c06a470 0x7f106c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:45.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.868+0000 7f108ea00640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f106c06a470 0x7f106c06c930 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1080005680 tx=0x7f1080003dd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:45.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:45.872+0000 7f1087400640 1 -- 172.21.15.59:0/639615717 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1078057370 con 0x7f10901558e0 2024-05-30T17:05:46.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.036+0000 7f1087400640 1 -- 172.21.15.59:0/639615717 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 44) ==== 90894+0+0 (secure 0 0 0) 0x7f10780539e0 con 0x7f10901558e0 2024-05-30T17:05:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.100+0000 7f1095800640 1 -- 172.21.15.59:0/639615717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f109006cd50 con 0x7f10901558e0 2024-05-30T17:05:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.100+0000 7f1087400640 1 -- 172.21.15.59:0/639615717 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2373 (secure 0 0 0) 0x7f1078087a60 con 0x7f10901558e0 2024-05-30T17:05:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:05:46.102 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:05:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:05:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:05:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:05:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:05:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:05:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:05:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:05:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:05:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:05:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:05:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:05:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:05:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:05:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:05:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 1026, 2024-05-30T17:05:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:05:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:05:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 133, 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:05:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4721, 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 19656717874, 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 40505647104, 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 732588466176, 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "read_bytes_sec": 1747728, 2024-05-30T17:05:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 2105173, 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 4 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 82, 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 9, 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 9, 2024-05-30T17:05:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8991 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:05:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 24, 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:05:35.410471+0000", 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "6e6cc831-b1b2-4d0f-922b-d5d0e3078e10": { 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 17.0 seconds before exiting (35s)\n [============================] ", 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "e9349e32-2ec7-45d6-9fcc-56a40d998319": { 2024-05-30T17:05:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 17.0 seconds before exiting (27s)\n [============================] ", 2024-05-30T17:05:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:05:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:46.110 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:05:46.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.104+0000 7f1095800640 1 -- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f106c06a470 msgr2=0x7f106c06c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:46.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.104+0000 7f1095800640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f106c06a470 0x7f106c06c930 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1080005680 tx=0x7f1080003dd0 comp rx=0 tx=0).stop 2024-05-30T17:05:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.104+0000 7f1095800640 1 -- 172.21.15.59:0/639615717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10901558e0 msgr2=0x7f1090143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.104+0000 7f1095800640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10901558e0 0x7f1090143520 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f107800c7f0 tx=0x7f107800ccb0 comp rx=0 tx=0).stop 2024-05-30T17:05:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.104+0000 7f1095800640 1 -- 172.21.15.59:0/639615717 shutdown_connections 2024-05-30T17:05:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.104+0000 7f1095800640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f106c06a470 0x7f106c06c930 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.104+0000 7f1095800640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f109015f690 0x7f109015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.104+0000 7f1095800640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10901558e0 0x7f1090143520 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.104+0000 7f1095800640 1 --2- 172.21.15.59:0/639615717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f109006f8c0 0x7f10900b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.104+0000 7f1095800640 1 -- 172.21.15.59:0/639615717 >> 172.21.15.59:0/639615717 conn(0x7f1090067d60 msgr2=0x7f109015d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.104+0000 7f1095800640 1 -- 172.21.15.59:0/639615717 shutdown_connections 2024-05-30T17:05:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:46.104+0000 7f1095800640 1 -- 172.21.15.59:0/639615717 wait complete. 2024-05-30T17:05:51.125 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:05:51.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.276+0000 7f81bea00640 1 Processor -- start 2024-05-30T17:05:51.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.276+0000 7f81bea00640 1 -- start start 2024-05-30T17:05:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.276+0000 7f81bea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b80b0080 0x7f81b806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.276+0000 7f81bea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81b8162a30 0x7f81b806e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.276+0000 7f81bea00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b806c200 con 0x7f81b80b3ce0 2024-05-30T17:05:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.276+0000 7f81bea00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f81b806c4e0 con 0x7f81b8162a30 2024-05-30T17:05:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.276+0000 7f81bea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f81b806c7c0 con 0x7f81b80b0080 2024-05-30T17:05:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.276+0000 7f81bca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81b8162a30 0x7f81b806e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.280+0000 7f81bca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81b8162a30 0x7f81b806e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46356/0 (socket says 172.21.15.59:46356) 2024-05-30T17:05:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.280+0000 7f81bca00640 1 -- 172.21.15.59:0/2203714392 learned_addr learned my addr 172.21.15.59:0/2203714392 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.280+0000 7f81b7e00640 1 --2- 172.21.15.59:0/2203714392 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b80b0080 0x7f81b806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.280+0000 7f81bca00640 1 -- 172.21.15.59:0/2203714392 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b80b0080 msgr2=0x7f81b806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.280+0000 7f81bca00640 1 --2- 172.21.15.59:0/2203714392 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b80b0080 0x7f81b806b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.280+0000 7f81bca00640 1 -- 172.21.15.59:0/2203714392 >> v1:172.21.15.107:6789/0 conn(0x7f81b80b3ce0 legacy=0x7f81b8162320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.280+0000 7f81bca00640 1 -- 172.21.15.59:0/2203714392 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b806caa0 con 0x7f81b8162a30 2024-05-30T17:05:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.280+0000 7f81b7e00640 1 --2- 172.21.15.59:0/2203714392 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b80b0080 0x7f81b806b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:05:51.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.280+0000 7f81bca00640 1 --2- 172.21.15.59:0/2203714392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b8162a30 0x7f81b806e820 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f81b00098a0 tx=0x7f81b001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e987f54213dcf6f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:51.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.280+0000 7f81b7400640 1 -- 172.21.15.59:0/2203714392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b00b5070 con 0x7f81b8162a30 2024-05-30T17:05:51.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.280+0000 7f81b7400640 1 -- 172.21.15.59:0/2203714392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b00a89b0 con 0x7f81b8162a30 2024-05-30T17:05:51.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.280+0000 7f81b7400640 1 -- 172.21.15.59:0/2203714392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b00a8d80 con 0x7f81b8162a30 2024-05-30T17:05:51.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 -- 172.21.15.59:0/2203714392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b8162a30 msgr2=0x7f81b806e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:51.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 --2- 172.21.15.59:0/2203714392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b8162a30 0x7f81b806e820 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f81b00098a0 tx=0x7f81b001ecf0 comp rx=0 tx=0).stop 2024-05-30T17:05:51.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 -- 172.21.15.59:0/2203714392 shutdown_connections 2024-05-30T17:05:51.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 --2- 172.21.15.59:0/2203714392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b8162a30 0x7f81b806e820 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:51.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 --2- 172.21.15.59:0/2203714392 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b80b0080 0x7f81b806b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:51.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 -- 172.21.15.59:0/2203714392 >> 172.21.15.59:0/2203714392 conn(0x7f81b80d0b10 msgr2=0x7f81b80d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:51.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 -- 172.21.15.59:0/2203714392 shutdown_connections 2024-05-30T17:05:51.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 -- 172.21.15.59:0/2203714392 wait complete. 2024-05-30T17:05:51.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 Processor -- start 2024-05-30T17:05:51.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 -- start start 2024-05-30T17:05:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b80b0080 0x7f81b8157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b80b3ce0 0x7f81b8153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81b8162a30 0x7f81b8143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f81b806bef0 con 0x7f81b80b0080 2024-05-30T17:05:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f81b806d2a0 con 0x7f81b8162a30 2024-05-30T17:05:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f81b80b0460 con 0x7f81b80b3ce0 2024-05-30T17:05:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81b7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b80b0080 0x7f81b8157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81b7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b80b0080 0x7f81b8157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46368/0 (socket says 172.21.15.59:46368) 2024-05-30T17:05:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81b7e00640 1 -- 172.21.15.59:0/1940798020 learned_addr learned my addr 172.21.15.59:0/1940798020 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81bca00640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81b8162a30 0x7f81b8143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81af400640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b80b3ce0 0x7f81b8153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81b7e00640 1 -- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b80b3ce0 msgr2=0x7f81b8153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81b7e00640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b80b3ce0 0x7f81b8153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81b7e00640 1 -- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81b8162a30 msgr2=0x7f81b8143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81b7e00640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81b8162a30 0x7f81b8143e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.284+0000 7f81b7e00640 1 -- 172.21.15.59:0/1940798020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b81f88e0 con 0x7f81b80b0080 2024-05-30T17:05:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.288+0000 7f81b7e00640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b80b0080 0x7f81b8157830 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f81a800cf60 tx=0x7f81a800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.288+0000 7f81b4c00640 1 -- 172.21.15.59:0/1940798020 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a801a070 con 0x7f81b80b0080 2024-05-30T17:05:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.288+0000 7f81b4c00640 1 -- 172.21.15.59:0/1940798020 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a800d840 con 0x7f81b80b0080 2024-05-30T17:05:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.288+0000 7f81bea00640 1 -- 172.21.15.59:0/1940798020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b8153250 con 0x7f81b80b0080 2024-05-30T17:05:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.288+0000 7f81b4c00640 1 -- 172.21.15.59:0/1940798020 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a800dc10 con 0x7f81b80b0080 2024-05-30T17:05:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.288+0000 7f81bea00640 1 -- 172.21.15.59:0/1940798020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b8153810 con 0x7f81b80b0080 2024-05-30T17:05:51.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.288+0000 7f81bea00640 1 -- 172.21.15.59:0/1940798020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b8068a90 con 0x7f81b80b0080 2024-05-30T17:05:51.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.288+0000 7f81b4c00640 1 -- 172.21.15.59:0/1940798020 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 44) ==== 90894+0+0 (secure 0 0 0) 0x7f81a801d070 con 0x7f81b80b0080 2024-05-30T17:05:51.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.288+0000 7f81b4c00640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f819406a390 0x7f819406c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:51.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.288+0000 7f81b4c00640 1 -- 172.21.15.59:0/1940798020 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f81a80862a0 con 0x7f81b80b0080 2024-05-30T17:05:51.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.288+0000 7f81af400640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f819406a390 0x7f819406c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:51.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.292+0000 7f81af400640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f819406a390 0x7f819406c850 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f81b815e7d0 tx=0x7f81a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:51.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.292+0000 7f81b4c00640 1 -- 172.21.15.59:0/1940798020 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81a8057c70 con 0x7f81b80b0080 2024-05-30T17:05:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.516+0000 7f81bea00640 1 -- 172.21.15.59:0/1940798020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f81b806e3d0 con 0x7f81b80b0080 2024-05-30T17:05:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.516+0000 7f81b4c00640 1 -- 172.21.15.59:0/1940798020 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2335 (secure 0 0 0) 0x7f81a805bf70 con 0x7f81b80b0080 2024-05-30T17:05:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:05:51.518 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:05:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:05:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:05:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:05:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:05:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:05:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:05:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:05:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:05:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:05:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:05:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:05:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:05:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:05:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:05:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 1031, 2024-05-30T17:05:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:05:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 133, 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4721, 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 19656722285, 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 40505655296, 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 732588457984, 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:05:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 4691, 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 82, 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 9, 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 9, 2024-05-30T17:05:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8991 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:05:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 24, 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:05:35.410471+0000", 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "6e6cc831-b1b2-4d0f-922b-d5d0e3078e10": { 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 13.0 seconds before exiting (39s)\n [============================] ", 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:05:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "e9349e32-2ec7-45d6-9fcc-56a40d998319": { 2024-05-30T17:05:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 13.0 seconds before exiting (31s)\n [============================] ", 2024-05-30T17:05:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:05:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:51.525 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:05:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.520+0000 7f81bea00640 1 -- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f819406a390 msgr2=0x7f819406c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.520+0000 7f81bea00640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f819406a390 0x7f819406c850 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f81b815e7d0 tx=0x7f81a0009040 comp rx=0 tx=0).stop 2024-05-30T17:05:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.520+0000 7f81bea00640 1 -- 172.21.15.59:0/1940798020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b80b0080 msgr2=0x7f81b8157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.520+0000 7f81bea00640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b80b0080 0x7f81b8157830 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f81a800cf60 tx=0x7f81a800cf90 comp rx=0 tx=0).stop 2024-05-30T17:05:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.520+0000 7f81bea00640 1 -- 172.21.15.59:0/1940798020 shutdown_connections 2024-05-30T17:05:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.520+0000 7f81bea00640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f819406a390 0x7f819406c850 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.520+0000 7f81bea00640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81b8162a30 0x7f81b8143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.520+0000 7f81bea00640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b80b3ce0 0x7f81b8153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.520+0000 7f81bea00640 1 --2- 172.21.15.59:0/1940798020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b80b0080 0x7f81b8157830 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.520+0000 7f81bea00640 1 -- 172.21.15.59:0/1940798020 >> 172.21.15.59:0/1940798020 conn(0x7f81b80d0b10 msgr2=0x7f81b80d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.520+0000 7f81bea00640 1 -- 172.21.15.59:0/1940798020 shutdown_connections 2024-05-30T17:05:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:51.520+0000 7f81bea00640 1 -- 172.21.15.59:0/1940798020 wait complete. 2024-05-30T17:05:56.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:05:56.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a5c600640 1 Processor -- start 2024-05-30T17:05:56.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a5c600640 1 -- start start 2024-05-30T17:05:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a5c600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9a5409aa40 0x7f9a54162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a5c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a5406ff90 0x7f9a540d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a5c600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a5415fb00 con 0x7f9a540b1370 2024-05-30T17:05:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a5c600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9a5415f8b0 con 0x7f9a5409aa40 2024-05-30T17:05:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a5c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5415fde0 con 0x7f9a5406ff90 2024-05-30T17:05:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a59200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9a540b1370 0x7f9a5409ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36948/0 (socket says 172.21.15.59:36948) 2024-05-30T17:05:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a59200640 1 -- 172.21.15.59:0/3385100447 learned_addr learned my addr 172.21.15.59:0/3385100447 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:05:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a59c00640 1 --2- 172.21.15.59:0/3385100447 >> v2:172.21.15.107:3300/0 conn(0x7f9a5409aa40 0x7f9a54162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a5a600640 1 --2- 172.21.15.59:0/3385100447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a5406ff90 0x7f9a540d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a53e00640 1 -- 172.21.15.59:0/3385100447 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275483576 0 0) 0x7f9a5415fb00 con 0x7f9a540b1370 2024-05-30T17:05:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a53e00640 1 -- 172.21.15.59:0/3385100447 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a3c003530 con 0x7f9a540b1370 2024-05-30T17:05:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a5a600640 1 -- 172.21.15.59:0/3385100447 >> v2:172.21.15.107:3300/0 conn(0x7f9a5409aa40 msgr2=0x7f9a54162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:05:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a5a600640 1 --2- 172.21.15.59:0/3385100447 >> v2:172.21.15.107:3300/0 conn(0x7f9a5409aa40 0x7f9a54162fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a5a600640 1 -- 172.21.15.59:0/3385100447 >> v1:172.21.15.59:6789/0 conn(0x7f9a540b1370 legacy=0x7f9a5409ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.692+0000 7f9a5a600640 1 -- 172.21.15.59:0/3385100447 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a541624f0 con 0x7f9a5406ff90 2024-05-30T17:05:56.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.696+0000 7f9a5a600640 1 --2- 172.21.15.59:0/3385100447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a5406ff90 0x7f9a540d06e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009d90 tx=0x7f9a4c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68ee9da66fa77982 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:56.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.696+0000 7f9a53e00640 1 -- 172.21.15.59:0/3385100447 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0b2070 con 0x7f9a5406ff90 2024-05-30T17:05:56.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.696+0000 7f9a53e00640 1 -- 172.21.15.59:0/3385100447 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a4c0a58b0 con 0x7f9a5406ff90 2024-05-30T17:05:56.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.696+0000 7f9a53e00640 1 -- 172.21.15.59:0/3385100447 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0a5c80 con 0x7f9a5406ff90 2024-05-30T17:05:56.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.696+0000 7f9a5c600640 1 -- 172.21.15.59:0/3385100447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a5406ff90 msgr2=0x7f9a540d06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:56.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.696+0000 7f9a5c600640 1 --2- 172.21.15.59:0/3385100447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a5406ff90 0x7f9a540d06e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009d90 tx=0x7f9a4c01c8e0 comp rx=0 tx=0).stop 2024-05-30T17:05:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.696+0000 7f9a5c600640 1 -- 172.21.15.59:0/3385100447 shutdown_connections 2024-05-30T17:05:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.696+0000 7f9a5c600640 1 --2- 172.21.15.59:0/3385100447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a5406ff90 0x7f9a540d06e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.696+0000 7f9a5c600640 1 --2- 172.21.15.59:0/3385100447 >> v2:172.21.15.107:3300/0 conn(0x7f9a5409aa40 0x7f9a54162fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.696+0000 7f9a5c600640 1 -- 172.21.15.59:0/3385100447 >> 172.21.15.59:0/3385100447 conn(0x7f9a540b3f90 msgr2=0x7f9a540b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.696+0000 7f9a5c600640 1 -- 172.21.15.59:0/3385100447 shutdown_connections 2024-05-30T17:05:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.696+0000 7f9a5c600640 1 -- 172.21.15.59:0/3385100447 wait complete. 2024-05-30T17:05:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5c600640 1 Processor -- start 2024-05-30T17:05:56.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5c600640 1 -- start start 2024-05-30T17:05:56.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5c600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a5406ff90 0x7f9a54151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:56.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a5409aa40 0x7f9a541564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5c600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a540b1370 0x7f9a5415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5c600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5416b8e0 con 0x7f9a540b1370 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5c600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5416b760 con 0x7f9a5406ff90 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5416ba60 con 0x7f9a5409aa40 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a540b1370 0x7f9a5415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a540b1370 0x7f9a5415aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58846/0 (socket says 172.21.15.59:58846) 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5a600640 1 -- 172.21.15.59:0/873543427 learned_addr learned my addr 172.21.15.59:0/873543427 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a59c00640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a5406ff90 0x7f9a54151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a59200640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a5409aa40 0x7f9a541564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5a600640 1 -- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a5409aa40 msgr2=0x7f9a541564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5a600640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a5409aa40 0x7f9a541564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5a600640 1 -- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a5406ff90 msgr2=0x7f9a54151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:56.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5a600640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a5406ff90 0x7f9a54151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:56.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5a600640 1 -- 172.21.15.59:0/873543427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a54152690 con 0x7f9a540b1370 2024-05-30T17:05:56.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5a600640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a540b1370 0x7f9a5415aae0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c01af90 tx=0x7f9a4c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:56.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a51600640 1 -- 172.21.15.59:0/873543427 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0b2050 con 0x7f9a540b1370 2024-05-30T17:05:56.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a51600640 1 -- 172.21.15.59:0/873543427 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a4c0be070 con 0x7f9a540b1370 2024-05-30T17:05:56.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a51600640 1 -- 172.21.15.59:0/873543427 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0ad850 con 0x7f9a540b1370 2024-05-30T17:05:56.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5c600640 1 -- 172.21.15.59:0/873543427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5415ddf0 con 0x7f9a540b1370 2024-05-30T17:05:56.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.700+0000 7f9a5c600640 1 -- 172.21.15.59:0/873543427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a5415e3b0 con 0x7f9a540b1370 2024-05-30T17:05:56.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.704+0000 7f9a5c600640 1 -- 172.21.15.59:0/873543427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a54068a90 con 0x7f9a540b1370 2024-05-30T17:05:56.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.704+0000 7f9a51600640 1 -- 172.21.15.59:0/873543427 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 44) ==== 90894+0+0 (secure 0 0 0) 0x7f9a4c0ad9f0 con 0x7f9a540b1370 2024-05-30T17:05:56.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.704+0000 7f9a51600640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9a3406a3c0 0x7f9a3406c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:05:56.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.704+0000 7f9a51600640 1 -- 172.21.15.59:0/873543427 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f9a4c120770 con 0x7f9a540b1370 2024-05-30T17:05:56.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.704+0000 7f9a59c00640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9a3406a3c0 0x7f9a3406c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:05:56.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.708+0000 7f9a59c00640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9a3406a3c0 0x7f9a3406c880 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f9a48009ac0 tx=0x7f9a48009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:05:56.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.712+0000 7f9a51600640 1 -- 172.21.15.59:0/873543427 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9a4c016560 con 0x7f9a540b1370 2024-05-30T17:05:56.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 -- 172.21.15.59:0/873543427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9a540b3d00 con 0x7f9a540b1370 2024-05-30T17:05:56.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a51600640 1 -- 172.21.15.59:0/873543427 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2332 (secure 0 0 0) 0x7f9a4c0f21e0 con 0x7f9a540b1370 2024-05-30T17:05:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:05:56.938 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:05:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:05:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:05:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:05:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:05:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 1036, 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 133, 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:05:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4721, 2024-05-30T17:05:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 19656723900, 2024-05-30T17:05:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 40505655296, 2024-05-30T17:05:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 732588457984, 2024-05-30T17:05:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:05:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 767, 2024-05-30T17:05:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:05:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T17:05:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:05:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 82, 2024-05-30T17:05:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 9, 2024-05-30T17:05:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:05:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:05:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:05:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:05:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:05:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 9, 2024-05-30T17:05:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:05:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:05:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:05:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8991 2024-05-30T17:05:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:05:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:05:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:05:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:05:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:05:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:05:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:05:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:05:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:05:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:05:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:05:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 24, 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:05:35.410471+0000", 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "6e6cc831-b1b2-4d0f-922b-d5d0e3078e10": { 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 7.0 seconds before exiting (45s)\n [============================] ", 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "e9349e32-2ec7-45d6-9fcc-56a40d998319": { 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 7.0 seconds before exiting (37s)\n [============================] ", 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:05:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:05:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:05:56.946 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:05:56.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 -- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9a3406a3c0 msgr2=0x7f9a3406c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:56.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9a3406a3c0 0x7f9a3406c880 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f9a48009ac0 tx=0x7f9a48009190 comp rx=0 tx=0).stop 2024-05-30T17:05:56.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 -- 172.21.15.59:0/873543427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a540b1370 msgr2=0x7f9a5415aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:05:56.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a540b1370 0x7f9a5415aae0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c01af90 tx=0x7f9a4c019680 comp rx=0 tx=0).stop 2024-05-30T17:05:56.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 -- 172.21.15.59:0/873543427 shutdown_connections 2024-05-30T17:05:56.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9a3406a3c0 0x7f9a3406c880 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:56.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a540b1370 0x7f9a5415aae0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:56.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a5409aa40 0x7f9a541564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:56.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 --2- 172.21.15.59:0/873543427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a5406ff90 0x7f9a54151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:05:56.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 -- 172.21.15.59:0/873543427 >> 172.21.15.59:0/873543427 conn(0x7f9a540b3f90 msgr2=0x7f9a540b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:05:56.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 -- 172.21.15.59:0/873543427 shutdown_connections 2024-05-30T17:05:56.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:05:56.936+0000 7f9a5c600640 1 -- 172.21.15.59:0/873543427 wait complete. 2024-05-30T17:06:01.960 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:06:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.112+0000 7f40a6c00640 1 Processor -- start 2024-05-30T17:06:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.112+0000 7f40a6c00640 1 -- start start 2024-05-30T17:06:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.112+0000 7f40a6c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f40a0158ef0 0x7f40a00b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.112+0000 7f40a6c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40a00af970 0x7f40a00adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.112+0000 7f40a6c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a015f050 con 0x7f40a00b42e0 2024-05-30T17:06:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.112+0000 7f40a6c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f40a015f330 con 0x7f40a00af970 2024-05-30T17:06:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.112+0000 7f40a6c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f40a015f610 con 0x7f40a0158ef0 2024-05-30T17:06:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.112+0000 7f40a4c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40a00af970 0x7f40a00adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.112+0000 7f40a4c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40a00af970 0x7f40a00adca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46276/0 (socket says 172.21.15.59:46276) 2024-05-30T17:06:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.112+0000 7f40a4c00640 1 -- 172.21.15.59:0/107987622 learned_addr learned my addr 172.21.15.59:0/107987622 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.116+0000 7f409fe00640 1 --2- 172.21.15.59:0/107987622 >> v2:172.21.15.107:3300/0 conn(0x7f40a0158ef0 0x7f40a00b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.116+0000 7f40a4c00640 1 -- 172.21.15.59:0/107987622 >> v2:172.21.15.107:3300/0 conn(0x7f40a0158ef0 msgr2=0x7f40a00b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.116+0000 7f40a4c00640 1 --2- 172.21.15.59:0/107987622 >> v2:172.21.15.107:3300/0 conn(0x7f40a0158ef0 0x7f40a00b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.116+0000 7f40a4c00640 1 -- 172.21.15.59:0/107987622 >> v1:172.21.15.107:6789/0 conn(0x7f40a00b42e0 legacy=0x7f40a00af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.116+0000 7f40a4c00640 1 -- 172.21.15.59:0/107987622 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a015f8f0 con 0x7f40a00af970 2024-05-30T17:06:02.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.116+0000 7f40a4c00640 1 --2- 172.21.15.59:0/107987622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40a00af970 0x7f40a00adca0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f40a0072f30 tx=0x7f409801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19b7dd4c858cfe2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:02.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.116+0000 7f409f400640 1 -- 172.21.15.59:0/107987622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40980a5780 con 0x7f40a00af970 2024-05-30T17:06:02.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.116+0000 7f409f400640 1 -- 172.21.15.59:0/107987622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40980a5920 con 0x7f40a00af970 2024-05-30T17:06:02.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.116+0000 7f409f400640 1 -- 172.21.15.59:0/107987622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40980a5cf0 con 0x7f40a00af970 2024-05-30T17:06:02.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.116+0000 7f40a6c00640 1 -- 172.21.15.59:0/107987622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40a00af970 msgr2=0x7f40a00adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.116+0000 7f40a6c00640 1 --2- 172.21.15.59:0/107987622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40a00af970 0x7f40a00adca0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f40a0072f30 tx=0x7f409801c9b0 comp rx=0 tx=0).stop 2024-05-30T17:06:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 -- 172.21.15.59:0/107987622 shutdown_connections 2024-05-30T17:06:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 --2- 172.21.15.59:0/107987622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40a00af970 0x7f40a00adca0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 --2- 172.21.15.59:0/107987622 >> v2:172.21.15.107:3300/0 conn(0x7f40a0158ef0 0x7f40a00b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 -- 172.21.15.59:0/107987622 >> 172.21.15.59:0/107987622 conn(0x7f40a0067d60 msgr2=0x7f40a006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 -- 172.21.15.59:0/107987622 shutdown_connections 2024-05-30T17:06:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 -- 172.21.15.59:0/107987622 wait complete. 2024-05-30T17:06:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 Processor -- start 2024-05-30T17:06:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 -- start start 2024-05-30T17:06:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40a00af970 0x7f40a015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40a00b42e0 0x7f40a0152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40a0158ef0 0x7f40a0150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f40a00aed80 con 0x7f40a00af970 2024-05-30T17:06:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f40a00aec00 con 0x7f40a00b42e0 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f40a016b380 con 0x7f40a0158ef0 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f409fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40a00af970 0x7f40a015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f409fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40a00af970 0x7f40a015a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46284/0 (socket says 172.21.15.59:46284) 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f409fe00640 1 -- 172.21.15.59:0/1546139295 learned_addr learned my addr 172.21.15.59:0/1546139295 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f4097e00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40a00b42e0 0x7f40a0152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a4c00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40a0158ef0 0x7f40a0150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f409fe00640 1 -- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40a0158ef0 msgr2=0x7f40a0150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f409fe00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40a0158ef0 0x7f40a0150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f409fe00640 1 -- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40a00b42e0 msgr2=0x7f40a0152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f409fe00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40a00b42e0 0x7f40a0152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f409fe00640 1 -- 172.21.15.59:0/1546139295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a015a5f0 con 0x7f40a00af970 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f409fe00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40a00af970 0x7f40a015a010 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f409000d620 tx=0x7f409000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f409cc00640 1 -- 172.21.15.59:0/1546139295 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40900125f0 con 0x7f40a00af970 2024-05-30T17:06:02.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f409cc00640 1 -- 172.21.15.59:0/1546139295 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4090019070 con 0x7f40a00af970 2024-05-30T17:06:02.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f409cc00640 1 -- 172.21.15.59:0/1546139295 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40900129b0 con 0x7f40a00af970 2024-05-30T17:06:02.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.120+0000 7f40a6c00640 1 -- 172.21.15.59:0/1546139295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a015a8d0 con 0x7f40a00af970 2024-05-30T17:06:02.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.124+0000 7f40a6c00640 1 -- 172.21.15.59:0/1546139295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a015c590 con 0x7f40a00af970 2024-05-30T17:06:02.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.124+0000 7f40a6c00640 1 -- 172.21.15.59:0/1546139295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a015c0e0 con 0x7f40a00af970 2024-05-30T17:06:02.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.124+0000 7f409cc00640 1 -- 172.21.15.59:0/1546139295 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 44) ==== 90894+0+0 (secure 0 0 0) 0x7f4090012b50 con 0x7f40a00af970 2024-05-30T17:06:02.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.124+0000 7f409cc00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f407c06a390 0x7f407c06c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:02.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.124+0000 7f409cc00640 1 -- 172.21.15.59:0/1546139295 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f4090085da0 con 0x7f40a00af970 2024-05-30T17:06:02.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.124+0000 7f4097e00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f407c06a390 0x7f407c06c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:02.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.124+0000 7f4097e00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f407c06a390 0x7f407c06c850 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f40a0154960 tx=0x7f4088007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.128+0000 7f409cc00640 1 -- 172.21.15.59:0/1546139295 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4090057dc0 con 0x7f40a00af970 2024-05-30T17:06:02.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.352+0000 7f40a6c00640 1 -- 172.21.15.59:0/1546139295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f40a0068a90 con 0x7f40a00af970 2024-05-30T17:06:02.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.352+0000 7f409cc00640 1 -- 172.21.15.59:0/1546139295 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2332 (secure 0 0 0) 0x7f40900576c0 con 0x7f40a00af970 2024-05-30T17:06:02.353 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:06:02.353 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:06:02.354 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 1042, 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 133, 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:06:02.355 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:06:02.356 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4721, 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 19656723900, 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 40505655296, 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 732588457984, 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280, 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "write_bytes_sec": 170, 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "read_op_per_sec": 0, 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "write_op_per_sec": 0 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 82, 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 9, 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:06:02.357 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:06:02.358 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:06:02.358 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:06:02.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:02.358 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 9, 2024-05-30T17:06:02.358 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:06:02.358 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:06:02.358 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:06:02.358 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8991 2024-05-30T17:06:02.358 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:06:02.358 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:06:02.358 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:06:02.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 24, 2024-05-30T17:06:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:05:35.410471+0000", 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": { 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: "6e6cc831-b1b2-4d0f-922b-d5d0e3078e10": { 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "All cloning finished, waiting 1.0 seconds before exiting (51s)\n [============================] ", 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: "e9349e32-2ec7-45d6-9fcc-56a40d998319": { 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "No pending clones left, waiting 1.0 seconds before exiting (43s)\n [============================] ", 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: "progress": 1, 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: "add_to_ceph_s": true 2024-05-30T17:06:02.360 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:06:02.361 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:06:02.361 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:06:02.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.356+0000 7f40a6c00640 1 -- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f407c06a390 msgr2=0x7f407c06c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.356+0000 7f40a6c00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f407c06a390 0x7f407c06c850 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f40a0154960 tx=0x7f4088007e40 comp rx=0 tx=0).stop 2024-05-30T17:06:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.356+0000 7f40a6c00640 1 -- 172.21.15.59:0/1546139295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40a00af970 msgr2=0x7f40a015a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.356+0000 7f40a6c00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40a00af970 0x7f40a015a010 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f409000d620 tx=0x7f409000dae0 comp rx=0 tx=0).stop 2024-05-30T17:06:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.356+0000 7f40a6c00640 1 -- 172.21.15.59:0/1546139295 shutdown_connections 2024-05-30T17:06:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.356+0000 7f40a6c00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f407c06a390 0x7f407c06c850 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.356+0000 7f40a6c00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40a0158ef0 0x7f40a0150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.356+0000 7f40a6c00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40a00b42e0 0x7f40a0152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:02.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.356+0000 7f40a6c00640 1 --2- 172.21.15.59:0/1546139295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40a00af970 0x7f40a015a010 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:02.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.356+0000 7f40a6c00640 1 -- 172.21.15.59:0/1546139295 >> 172.21.15.59:0/1546139295 conn(0x7f40a0067d60 msgr2=0x7f40a006e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:02.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.356+0000 7f40a6c00640 1 -- 172.21.15.59:0/1546139295 shutdown_connections 2024-05-30T17:06:02.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:02.356+0000 7f40a6c00640 1 -- 172.21.15.59:0/1546139295 wait complete. 2024-05-30T17:06:06.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:06:06.741 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:06:07.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T17:06:07.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.528+0000 7fc9bde00640 1 Processor -- start 2024-05-30T17:06:07.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.528+0000 7fc9bde00640 1 -- start start 2024-05-30T17:06:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.528+0000 7fc9bde00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc9b81558e0 0x7fc9b80b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.528+0000 7fc9bde00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9b806f8c0 0x7fc9b815ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.528+0000 7fc9bde00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9b806de10 con 0x7fc9b815f4c0 2024-05-30T17:06:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.528+0000 7fc9bde00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc9b815f910 con 0x7fc9b806f8c0 2024-05-30T17:06:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.528+0000 7fc9bde00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc9b806e0f0 con 0x7fc9b81558e0 2024-05-30T17:06:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.528+0000 7fc9ae000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9b806f8c0 0x7fc9b815ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.528+0000 7fc9b7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc9b815f4c0 0x7fc9b815b990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49292/0 (socket says 172.21.15.59:49292) 2024-05-30T17:06:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.528+0000 7fc9b7400640 1 -- 172.21.15.59:0/2269354326 learned_addr learned my addr 172.21.15.59:0/2269354326 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:06:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.528+0000 7fc9b6a00640 1 --2- 172.21.15.59:0/2269354326 >> v2:172.21.15.107:3300/0 conn(0x7fc9b81558e0 0x7fc9b80b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9ae000640 1 -- 172.21.15.59:0/2269354326 >> v2:172.21.15.107:3300/0 conn(0x7fc9b81558e0 msgr2=0x7fc9b80b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9ae000640 1 --2- 172.21.15.59:0/2269354326 >> v2:172.21.15.107:3300/0 conn(0x7fc9b81558e0 0x7fc9b80b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9ae000640 1 -- 172.21.15.59:0/2269354326 >> v1:172.21.15.59:6789/0 conn(0x7fc9b815f4c0 legacy=0x7fc9b815b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:07.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9ae000640 1 -- 172.21.15.59:0/2269354326 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b806e3d0 con 0x7fc9b806f8c0 2024-05-30T17:06:07.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9b6000640 1 -- 172.21.15.59:0/2269354326 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324527931 0 0) 0x7fc9b806de10 con 0x7fc9b815f4c0 2024-05-30T17:06:07.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9ae000640 1 --2- 172.21.15.59:0/2269354326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b806f8c0 0x7fc9b815ef80 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fc9b806f890 tx=0x7fc9a001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505c00b64ef6afb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:07.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9b6000640 1 -- 172.21.15.59:0/2269354326 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00b0070 con 0x7fc9b806f8c0 2024-05-30T17:06:07.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9b6000640 1 -- 172.21.15.59:0/2269354326 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a0004230 con 0x7fc9b806f8c0 2024-05-30T17:06:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9b6000640 1 -- 172.21.15.59:0/2269354326 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0003620 con 0x7fc9b806f8c0 2024-05-30T17:06:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9bde00640 1 -- 172.21.15.59:0/2269354326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b806f8c0 msgr2=0x7fc9b815ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9bde00640 1 --2- 172.21.15.59:0/2269354326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b806f8c0 0x7fc9b815ef80 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fc9b806f890 tx=0x7fc9a001c480 comp rx=0 tx=0).stop 2024-05-30T17:06:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9bde00640 1 -- 172.21.15.59:0/2269354326 shutdown_connections 2024-05-30T17:06:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9bde00640 1 --2- 172.21.15.59:0/2269354326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b806f8c0 0x7fc9b815ef80 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9bde00640 1 --2- 172.21.15.59:0/2269354326 >> v2:172.21.15.107:3300/0 conn(0x7fc9b81558e0 0x7fc9b80b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9bde00640 1 -- 172.21.15.59:0/2269354326 >> 172.21.15.59:0/2269354326 conn(0x7fc9b8067d60 msgr2=0x7fc9b806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9bde00640 1 -- 172.21.15.59:0/2269354326 shutdown_connections 2024-05-30T17:06:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.532+0000 7fc9bde00640 1 -- 172.21.15.59:0/2269354326 wait complete. 2024-05-30T17:06:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9bde00640 1 Processor -- start 2024-05-30T17:06:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9bde00640 1 -- start start 2024-05-30T17:06:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9bde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9b806f8c0 0x7fc9b8154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9bde00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9b81558e0 0x7fc9b814edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9bde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b815f4c0 0x7fc9b81437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9bde00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b80b56c0 con 0x7fc9b815f4c0 2024-05-30T17:06:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9bde00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8070010 con 0x7fc9b806f8c0 2024-05-30T17:06:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9bde00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b8155cc0 con 0x7fc9b81558e0 2024-05-30T17:06:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9b7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b815f4c0 0x7fc9b81437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9b7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b815f4c0 0x7fc9b81437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46298/0 (socket says 172.21.15.59:46298) 2024-05-30T17:06:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9b7400640 1 -- 172.21.15.59:0/521848419 learned_addr learned my addr 172.21.15.59:0/521848419 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9b6a00640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9b806f8c0 0x7fc9b8154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9ae000640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9b81558e0 0x7fc9b814edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9b7400640 1 -- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9b81558e0 msgr2=0x7fc9b814edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9b7400640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9b81558e0 0x7fc9b814edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9b7400640 1 -- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9b806f8c0 msgr2=0x7fc9b8154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9b7400640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9b806f8c0 0x7fc9b8154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9b7400640 1 -- 172.21.15.59:0/521848419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b8141d90 con 0x7fc9b815f4c0 2024-05-30T17:06:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9b7400640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b815f4c0 0x7fc9b81437a0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c700 tx=0x7fc9b000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9afe00640 1 -- 172.21.15.59:0/521848419 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0018070 con 0x7fc9b815f4c0 2024-05-30T17:06:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9afe00640 1 -- 172.21.15.59:0/521848419 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b000ce10 con 0x7fc9b815f4c0 2024-05-30T17:06:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9afe00640 1 -- 172.21.15.59:0/521848419 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b000a860 con 0x7fc9b815f4c0 2024-05-30T17:06:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9bde00640 1 -- 172.21.15.59:0/521848419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b8142070 con 0x7fc9b815f4c0 2024-05-30T17:06:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.536+0000 7fc9bde00640 1 -- 172.21.15.59:0/521848419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b8142630 con 0x7fc9b815f4c0 2024-05-30T17:06:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.540+0000 7fc9bde00640 1 -- 172.21.15.59:0/521848419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b8068a90 con 0x7fc9b815f4c0 2024-05-30T17:06:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.540+0000 7fc9afe00640 1 -- 172.21.15.59:0/521848419 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 44) ==== 90894+0+0 (secure 0 0 0) 0x7fc9b001b070 con 0x7fc9b815f4c0 2024-05-30T17:06:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.540+0000 7fc9afe00640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc99406a390 0x7fc99406c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.540+0000 7fc9afe00640 1 -- 172.21.15.59:0/521848419 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fc9b0084fa0 con 0x7fc9b815f4c0 2024-05-30T17:06:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.540+0000 7fc9b6a00640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc99406a390 0x7fc99406c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.540+0000 7fc9b6a00640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc99406a390 0x7fc99406c850 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8007a60 tx=0x7fc9a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.544+0000 7fc9afe00640 1 -- 172.21.15.59:0/521848419 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc9b0056970 con 0x7fc9b815f4c0 2024-05-30T17:06:07.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.772+0000 7fc9bde00640 1 -- 172.21.15.59:0/521848419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc9b8071f10 con 0x7fc9b815f4c0 2024-05-30T17:06:07.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.772+0000 7fc9afe00640 1 -- 172.21.15.59:0/521848419 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1733 (secure 0 0 0) 0x7fc9b005ac70 con 0x7fc9b815f4c0 2024-05-30T17:06:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:06:07.774 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:06:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "97857630-028c-48a2-897f-bf5f996be133", 2024-05-30T17:06:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "health": { 2024-05-30T17:06:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "HEALTH_OK", 2024-05-30T17:06:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "checks": {}, 2024-05-30T17:06:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "mutes": [] 2024-05-30T17:06:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "election_epoch": 4, 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum": [ 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_names": [ 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "a", 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "b", 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "c" 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "quorum_age": 1047, 2024-05-30T17:06:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": { 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 1, 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "min_mon_release_name": "squid", 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "num_mons": 3 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap": { 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 133, 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "num_osds": 8, 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "num_up_osds": 8, 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_up_since": 1717087732, 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "num_in_osds": 8, 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_in_since": 1717087722, 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "num_remapped_pgs": 0 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap": { 2024-05-30T17:06:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "pgs_by_state": [ 2024-05-30T17:06:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "state_name": "active+clean", 2024-05-30T17:06:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "count": 97 2024-05-30T17:06:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:06:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:06:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pgs": 97, 2024-05-30T17:06:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "num_pools": 3, 2024-05-30T17:06:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "num_objects": 4721, 2024-05-30T17:06:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "data_bytes": 19656723900, 2024-05-30T17:06:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_used": 40505655296, 2024-05-30T17:06:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_avail": 732588457984, 2024-05-30T17:06:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "bytes_total": 773094113280 2024-05-30T17:06:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "fsmap": { 2024-05-30T17:06:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 82, 2024-05-30T17:06:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 9, 2024-05-30T17:06:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-05-30T17:06:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-05-30T17:06:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1, 2024-05-30T17:06:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "by_rank": [ 2024-05-30T17:06:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "filesystem_id": 9, 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "rank": 0, 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "a", 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "up:active", 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 8991 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "up:standby": 3 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "mgrmap": { 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "num_standbys": 1, 2024-05-30T17:06:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "servicemap": { 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 24, 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-05-30T17:05:35.410471+0000", 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "services": {} 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "progress_events": {} 2024-05-30T17:06:07.780 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:06:07.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.776+0000 7fc9bde00640 1 -- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc99406a390 msgr2=0x7fc99406c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:07.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.776+0000 7fc9bde00640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc99406a390 0x7fc99406c850 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8007a60 tx=0x7fc9a8008040 comp rx=0 tx=0).stop 2024-05-30T17:06:07.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.776+0000 7fc9bde00640 1 -- 172.21.15.59:0/521848419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b815f4c0 msgr2=0x7fc9b81437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.776+0000 7fc9bde00640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b815f4c0 0x7fc9b81437a0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c700 tx=0x7fc9b000cbc0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.776+0000 7fc9bde00640 1 -- 172.21.15.59:0/521848419 shutdown_connections 2024-05-30T17:06:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.776+0000 7fc9bde00640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc99406a390 0x7fc99406c850 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.776+0000 7fc9bde00640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b815f4c0 0x7fc9b81437a0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.776+0000 7fc9bde00640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9b81558e0 0x7fc9b814edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.776+0000 7fc9bde00640 1 --2- 172.21.15.59:0/521848419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9b806f8c0 0x7fc9b8154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.776+0000 7fc9bde00640 1 -- 172.21.15.59:0/521848419 >> 172.21.15.59:0/521848419 conn(0x7fc9b8067d60 msgr2=0x7fc9b8072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.776+0000 7fc9bde00640 1 -- 172.21.15.59:0/521848419 shutdown_connections 2024-05-30T17:06:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.776+0000 7fc9bde00640 1 -- 172.21.15.59:0/521848419 wait complete. 2024-05-30T17:06:07.795 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T17:06:07.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9bc600640 1 Processor -- start 2024-05-30T17:06:07.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9bc600640 1 -- start start 2024-05-30T17:06:07.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9bc600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9b40d14c0 0x7fd9b406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:07.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9bc600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b40d05b0 0x7fd9b409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:07.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9bc600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9b406ea20 con 0x7fd9b409af80 2024-05-30T17:06:07.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9bc600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b4070950 con 0x7fd9b40d14c0 2024-05-30T17:06:07.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9bc600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b4070c30 con 0x7fd9b40d05b0 2024-05-30T17:06:07.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9b9c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9b40d14c0 0x7fd9b406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:07.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9b9c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9b40d14c0 0x7fd9b406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46304/0 (socket says 172.21.15.59:46304) 2024-05-30T17:06:07.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9b9c00640 1 -- 172.21.15.59:0/1743062827 learned_addr learned my addr 172.21.15.59:0/1743062827 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:07.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9b9200640 1 --2- 172.21.15.59:0/1743062827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b40d05b0 0x7fd9b409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:07.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9b9c00640 1 -- 172.21.15.59:0/1743062827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b40d05b0 msgr2=0x7fd9b409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:07.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9b9c00640 1 --2- 172.21.15.59:0/1743062827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b40d05b0 0x7fd9b409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9b9c00640 1 -- 172.21.15.59:0/1743062827 >> v1:172.21.15.107:6789/0 conn(0x7fd9b409af80 legacy=0x7fd9b4162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:07.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.940+0000 7fd9b9c00640 1 -- 172.21.15.59:0/1743062827 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b4070f10 con 0x7fd9b40d14c0 2024-05-30T17:06:07.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9b9c00640 1 --2- 172.21.15.59:0/1743062827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b40d14c0 0x7fd9b406e4e0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009870 tx=0x7fd9a801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4dd225570aac3f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:07.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9b3e00640 1 -- 172.21.15.59:0/1743062827 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80b0070 con 0x7fd9b40d14c0 2024-05-30T17:06:07.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9b3e00640 1 -- 172.21.15.59:0/1743062827 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a80ab600 con 0x7fd9b40d14c0 2024-05-30T17:06:07.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9b3e00640 1 -- 172.21.15.59:0/1743062827 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80ab9d0 con 0x7fd9b40d14c0 2024-05-30T17:06:07.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9bc600640 1 -- 172.21.15.59:0/1743062827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b40d14c0 msgr2=0x7fd9b406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:07.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9bc600640 1 --2- 172.21.15.59:0/1743062827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b40d14c0 0x7fd9b406e4e0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009870 tx=0x7fd9a801c560 comp rx=0 tx=0).stop 2024-05-30T17:06:07.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9bc600640 1 -- 172.21.15.59:0/1743062827 shutdown_connections 2024-05-30T17:06:07.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9bc600640 1 --2- 172.21.15.59:0/1743062827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b40d05b0 0x7fd9b409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9bc600640 1 --2- 172.21.15.59:0/1743062827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b40d14c0 0x7fd9b406e4e0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9bc600640 1 -- 172.21.15.59:0/1743062827 >> 172.21.15.59:0/1743062827 conn(0x7fd9b40b3f80 msgr2=0x7fd9b40b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:07.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9bc600640 1 -- 172.21.15.59:0/1743062827 shutdown_connections 2024-05-30T17:06:07.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9bc600640 1 -- 172.21.15.59:0/1743062827 wait complete. 2024-05-30T17:06:07.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9bc600640 1 Processor -- start 2024-05-30T17:06:07.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.944+0000 7fd9bc600640 1 -- start start 2024-05-30T17:06:07.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9bc600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b409af80 0x7fd9b4158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:07.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9bc600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b40d05b0 0x7fd9b4158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:07.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9bc600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b40d14c0 0x7fd9b40c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:07.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9bc600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b40d0b10 con 0x7fd9b40d05b0 2024-05-30T17:06:07.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9bc600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b40d0990 con 0x7fd9b40d14c0 2024-05-30T17:06:07.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9bc600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b406e100 con 0x7fd9b409af80 2024-05-30T17:06:07.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b9200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b40d05b0 0x7fd9b4158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:07.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b9200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b40d05b0 0x7fd9b4158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46314/0 (socket says 172.21.15.59:46314) 2024-05-30T17:06:07.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b9200640 1 -- 172.21.15.59:0/1004782976 learned_addr learned my addr 172.21.15.59:0/1004782976 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:07.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9ba600640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b40d14c0 0x7fd9b40c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:07.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b9c00640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b409af80 0x7fd9b4158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:07.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b9200640 1 -- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b409af80 msgr2=0x7fd9b4158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:07.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b9200640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b409af80 0x7fd9b4158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b9200640 1 -- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b40d14c0 msgr2=0x7fd9b40c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:07.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b9200640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b40d14c0 0x7fd9b40c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:07.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b9200640 1 -- 172.21.15.59:0/1004782976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b406ff40 con 0x7fd9b40d05b0 2024-05-30T17:06:07.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b9200640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b40d05b0 0x7fd9b4158d60 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000d830 tx=0x7fd9a000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:07.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b1600640 1 -- 172.21.15.59:0/1004782976 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000b6c0 con 0x7fd9b40d05b0 2024-05-30T17:06:07.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b1600640 1 -- 172.21.15.59:0/1004782976 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a0019070 con 0x7fd9b40d05b0 2024-05-30T17:06:07.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9bc600640 1 -- 172.21.15.59:0/1004782976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b40b7110 con 0x7fd9b40d05b0 2024-05-30T17:06:07.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b1600640 1 -- 172.21.15.59:0/1004782976 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000ba60 con 0x7fd9b40d05b0 2024-05-30T17:06:07.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9bc600640 1 -- 172.21.15.59:0/1004782976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b40b76d0 con 0x7fd9b40d05b0 2024-05-30T17:06:07.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9bc600640 1 -- 172.21.15.59:0/1004782976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b4068a90 con 0x7fd9b40d05b0 2024-05-30T17:06:07.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.948+0000 7fd9b1600640 1 -- 172.21.15.59:0/1004782976 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 44) ==== 90894+0+0 (secure 0 0 0) 0x7fd9a001e460 con 0x7fd9b40d05b0 2024-05-30T17:06:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.952+0000 7fd9b1600640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd99406a390 0x7fd99406c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.952+0000 7fd9b1600640 1 -- 172.21.15.59:0/1004782976 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fd9a00861b0 con 0x7fd9b40d05b0 2024-05-30T17:06:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.952+0000 7fd9b9c00640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd99406a390 0x7fd99406c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.952+0000 7fd9b9c00640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd99406a390 0x7fd99406c850 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80ad000 tx=0x7fd9a80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:07.956+0000 7fd9b1600640 1 -- 172.21.15.59:0/1004782976 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd9a00581d0 con 0x7fd9b40d05b0 2024-05-30T17:06:08.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.148+0000 7fd9bc600640 1 -- 172.21.15.59:0/1004782976 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd9b40692a0 con 0x7fd99406a390 2024-05-30T17:06:08.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9b1600640 1 -- 172.21.15.59:0/1004782976 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+381 (secure 0 0 0) 0x7fd9b40692a0 con 0x7fd99406a390 2024-05-30T17:06:08.161 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:06:08.161 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:06:08.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:08.161 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone67197" 2024-05-30T17:06:08.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:08.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:08.161 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone67195" 2024-05-30T17:06:08.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sv1" 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone67193" 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone67194" 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone67192" 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:08.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:08.163 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone67191" 2024-05-30T17:06:08.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-05-30T17:06:08.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:08.163 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subvol_clone67196" 2024-05-30T17:06:08.163 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:06:08.163 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:06:08.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9bc600640 1 -- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd99406a390 msgr2=0x7fd99406c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9bc600640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd99406a390 0x7fd99406c850 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80ad000 tx=0x7fd9a80a6000 comp rx=0 tx=0).stop 2024-05-30T17:06:08.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9bc600640 1 -- 172.21.15.59:0/1004782976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b40d05b0 msgr2=0x7fd9b4158d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9bc600640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b40d05b0 0x7fd9b4158d60 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000d830 tx=0x7fd9a000dcf0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9bc600640 1 -- 172.21.15.59:0/1004782976 shutdown_connections 2024-05-30T17:06:08.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9bc600640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fd99406a390 0x7fd99406c850 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9bc600640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b40d14c0 0x7fd9b40c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9bc600640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b40d05b0 0x7fd9b4158d60 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9bc600640 1 --2- 172.21.15.59:0/1004782976 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9b409af80 0x7fd9b4158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9bc600640 1 -- 172.21.15.59:0/1004782976 >> 172.21.15.59:0/1004782976 conn(0x7fd9b40b3f80 msgr2=0x7fd9b40ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:08.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9bc600640 1 -- 172.21.15.59:0/1004782976 shutdown_connections 2024-05-30T17:06:08.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.160+0000 7fd9bc600640 1 -- 172.21.15.59:0/1004782976 wait complete. 2024-05-30T17:06:08.182 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone67197 2024-05-30T17:06:08.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a60400640 1 Processor -- start 2024-05-30T17:06:08.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a60400640 1 -- start start 2024-05-30T17:06:08.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a60400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2a58161e20 0x7f2a5806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a60400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a580730e0 0x7f2a5806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a60400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a580b3d50 con 0x7f2a58162310 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a60400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f2a580b4030 con 0x7f2a580730e0 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a60400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5806e7c0 con 0x7f2a58161e20 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a5e400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2a58162310 0x7f2a581627c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49306/0 (socket says 172.21.15.59:49306) 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a5e400640 1 -- 172.21.15.59:0/2283635386 learned_addr learned my addr 172.21.15.59:0/2283635386 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a5d000640 1 --2- 172.21.15.59:0/2283635386 >> v2:172.21.15.59:3300/0 conn(0x7f2a580730e0 0x7f2a5806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a5da00640 1 --2- 172.21.15.59:0/2283635386 >> v2:172.21.15.107:3300/0 conn(0x7f2a58161e20 0x7f2a5806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a57e00640 1 -- 172.21.15.59:0/2283635386 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2634685126 0 0) 0x7f2a580b3d50 con 0x7f2a58162310 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a57e00640 1 -- 172.21.15.59:0/2283635386 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a40003530 con 0x7f2a58162310 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a5d000640 1 -- 172.21.15.59:0/2283635386 >> v2:172.21.15.107:3300/0 conn(0x7f2a58161e20 msgr2=0x7f2a5806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a5d000640 1 --2- 172.21.15.59:0/2283635386 >> v2:172.21.15.107:3300/0 conn(0x7f2a58161e20 0x7f2a5806c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a5d000640 1 -- 172.21.15.59:0/2283635386 >> v1:172.21.15.59:6789/0 conn(0x7f2a58162310 legacy=0x7f2a581627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.328+0000 7f2a5d000640 1 -- 172.21.15.59:0/2283635386 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5806eaa0 con 0x7f2a580730e0 2024-05-30T17:06:08.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.332+0000 7f2a5d000640 1 --2- 172.21.15.59:0/2283635386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a580730e0 0x7f2a5806cf00 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f2a580d1b10 tx=0x7f2a4401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96aa9aacdaaa9e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:08.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.332+0000 7f2a57e00640 1 -- 172.21.15.59:0/2283635386 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a440b5070 con 0x7f2a580730e0 2024-05-30T17:06:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.332+0000 7f2a57e00640 1 -- 172.21.15.59:0/2283635386 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a440a8970 con 0x7f2a580730e0 2024-05-30T17:06:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.332+0000 7f2a57e00640 1 -- 172.21.15.59:0/2283635386 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a440a8d40 con 0x7f2a580730e0 2024-05-30T17:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.332+0000 7f2a60400640 1 -- 172.21.15.59:0/2283635386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a580730e0 msgr2=0x7f2a5806cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.332+0000 7f2a60400640 1 --2- 172.21.15.59:0/2283635386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a580730e0 0x7f2a5806cf00 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f2a580d1b10 tx=0x7f2a4401ec70 comp rx=0 tx=0).stop 2024-05-30T17:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 -- 172.21.15.59:0/2283635386 shutdown_connections 2024-05-30T17:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 --2- 172.21.15.59:0/2283635386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a580730e0 0x7f2a5806cf00 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 --2- 172.21.15.59:0/2283635386 >> v2:172.21.15.107:3300/0 conn(0x7f2a58161e20 0x7f2a5806c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 -- 172.21.15.59:0/2283635386 >> 172.21.15.59:0/2283635386 conn(0x7f2a580725c0 msgr2=0x7f2a580729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 -- 172.21.15.59:0/2283635386 shutdown_connections 2024-05-30T17:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 -- 172.21.15.59:0/2283635386 wait complete. 2024-05-30T17:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 Processor -- start 2024-05-30T17:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 -- start start 2024-05-30T17:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a580730e0 0x7f2a5806f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a58161e20 0x7f2a58159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a58162310 0x7f2a58150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2a580d0820 con 0x7f2a58161e20 2024-05-30T17:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2a580b3a20 con 0x7f2a58162310 2024-05-30T17:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a60400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2a580cd0d0 con 0x7f2a580730e0 2024-05-30T17:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a5d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a58161e20 0x7f2a58159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a5d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a58161e20 0x7f2a58159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46332/0 (socket says 172.21.15.59:46332) 2024-05-30T17:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a5d000640 1 -- 172.21.15.59:0/1028309737 learned_addr learned my addr 172.21.15.59:0/1028309737 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a5da00640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a580730e0 0x7f2a5806f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a5e400640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a58162310 0x7f2a58150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a5d000640 1 -- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a580730e0 msgr2=0x7f2a5806f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a5d000640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a580730e0 0x7f2a5806f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a5d000640 1 -- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a58162310 msgr2=0x7f2a58150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a5d000640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a58162310 0x7f2a58150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a5d000640 1 -- 172.21.15.59:0/1028309737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a580d0360 con 0x7f2a58161e20 2024-05-30T17:06:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.336+0000 7f2a5d000640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a58161e20 0x7f2a58159b60 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f2a440b3040 tx=0x7f2a4401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:08.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.340+0000 7f2a55600640 1 -- 172.21.15.59:0/1028309737 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a440bf070 con 0x7f2a58161e20 2024-05-30T17:06:08.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.340+0000 7f2a55600640 1 -- 172.21.15.59:0/1028309737 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a440b0660 con 0x7f2a58161e20 2024-05-30T17:06:08.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.340+0000 7f2a60400640 1 -- 172.21.15.59:0/1028309737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a580cfac0 con 0x7f2a58161e20 2024-05-30T17:06:08.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.340+0000 7f2a55600640 1 -- 172.21.15.59:0/1028309737 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a440b5040 con 0x7f2a58161e20 2024-05-30T17:06:08.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.340+0000 7f2a60400640 1 -- 172.21.15.59:0/1028309737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a580d0080 con 0x7f2a58161e20 2024-05-30T17:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.340+0000 7f2a60400640 1 -- 172.21.15.59:0/1028309737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a58068a90 con 0x7f2a58161e20 2024-05-30T17:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.340+0000 7f2a55600640 1 -- 172.21.15.59:0/1028309737 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 44) ==== 90894+0+0 (secure 0 0 0) 0x7f2a440c2070 con 0x7f2a58161e20 2024-05-30T17:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.340+0000 7f2a55600640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2a3806a390 0x7f2a3806c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.340+0000 7f2a55600640 1 -- 172.21.15.59:0/1028309737 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f2a44122160 con 0x7f2a58161e20 2024-05-30T17:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.340+0000 7f2a5da00640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2a3806a390 0x7f2a3806c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.344+0000 7f2a5da00640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2a3806a390 0x7f2a3806c850 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009a50 tx=0x7f2a4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:08.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.348+0000 7f2a55600640 1 -- 172.21.15.59:0/1028309737 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2a440187d0 con 0x7f2a58161e20 2024-05-30T17:06:08.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.536+0000 7f2a60400640 1 -- 172.21.15.59:0/1028309737 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone67197", "target": ["mon-mgr", ""]}) -- 0x7f2a580678a0 con 0x7f2a3806a390 2024-05-30T17:06:08.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.556+0000 7f2a55600640 1 -- 172.21.15.59:0/1028309737 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2a580678a0 con 0x7f2a3806a390 2024-05-30T17:06:08.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.560+0000 7f2a60400640 1 -- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2a3806a390 msgr2=0x7f2a3806c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.560+0000 7f2a60400640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2a3806a390 0x7f2a3806c850 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009a50 tx=0x7f2a4c008040 comp rx=0 tx=0).stop 2024-05-30T17:06:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.560+0000 7f2a60400640 1 -- 172.21.15.59:0/1028309737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a58161e20 msgr2=0x7f2a58159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.560+0000 7f2a60400640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a58161e20 0x7f2a58159b60 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f2a440b3040 tx=0x7f2a4401ba10 comp rx=0 tx=0).stop 2024-05-30T17:06:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.560+0000 7f2a60400640 1 -- 172.21.15.59:0/1028309737 shutdown_connections 2024-05-30T17:06:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.560+0000 7f2a60400640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2a3806a390 0x7f2a3806c850 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.560+0000 7f2a60400640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a58162310 0x7f2a58150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.560+0000 7f2a60400640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a58161e20 0x7f2a58159b60 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.560+0000 7f2a60400640 1 --2- 172.21.15.59:0/1028309737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2a580730e0 0x7f2a5806f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.560+0000 7f2a60400640 1 -- 172.21.15.59:0/1028309737 >> 172.21.15.59:0/1028309737 conn(0x7f2a580725c0 msgr2=0x7f2a5815f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.560+0000 7f2a60400640 1 -- 172.21.15.59:0/1028309737 shutdown_connections 2024-05-30T17:06:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.560+0000 7f2a60400640 1 -- 172.21.15.59:0/1028309737 wait complete. 2024-05-30T17:06:08.563 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:08.563+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:06:08.564 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:08.563+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:06:08.564 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:08.563+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:06:08.564 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:08.563+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:06:08.564 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:08.563+0000 7efd71600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:06:08.584 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone67195 2024-05-30T17:06:08.585 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:08.583+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:06:08.585 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:08.583+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:06:08.585 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:08.583+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:06:08.585 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:08.583+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:06:08.585 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:08.583+0000 7efd70200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:06:08.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c15000640 1 Processor -- start 2024-05-30T17:06:08.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c15000640 1 -- start start 2024-05-30T17:06:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c15000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c1015b3b0 0x7f9c100adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c15000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100723c0 0x7f9c100af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c15000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c10072870 con 0x7f9c1015b790 2024-05-30T17:06:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c15000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9c100afaf0 con 0x7f9c1015b3b0 2024-05-30T17:06:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c15000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c100ae510 con 0x7f9c100723c0 2024-05-30T17:06:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c0de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c1015b3b0 0x7f9c100adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c0de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c1015b3b0 0x7f9c100adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46334/0 (socket says 172.21.15.59:46334) 2024-05-30T17:06:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c0de00640 1 -- 172.21.15.59:0/4168642663 learned_addr learned my addr 172.21.15.59:0/4168642663 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c0e800640 1 --2- 172.21.15.59:0/4168642663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100723c0 0x7f9c100af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c0de00640 1 -- 172.21.15.59:0/4168642663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100723c0 msgr2=0x7f9c100af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c0de00640 1 --2- 172.21.15.59:0/4168642663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100723c0 0x7f9c100af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c0de00640 1 -- 172.21.15.59:0/4168642663 >> v1:172.21.15.107:6789/0 conn(0x7f9c1015b790 legacy=0x7f9c10071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.732+0000 7f9c0de00640 1 -- 172.21.15.59:0/4168642663 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c100ae7f0 con 0x7f9c1015b3b0 2024-05-30T17:06:08.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c0de00640 1 --2- 172.21.15.59:0/4168642663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1015b3b0 0x7f9c100adf30 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f9c000098a0 tx=0x7f9c0001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b788aa4ffcaaf493 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:08.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c0ca00640 1 -- 172.21.15.59:0/4168642663 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c000aa670 con 0x7f9c1015b3b0 2024-05-30T17:06:08.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c0ca00640 1 -- 172.21.15.59:0/4168642663 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c000af070 con 0x7f9c1015b3b0 2024-05-30T17:06:08.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c0ca00640 1 -- 172.21.15.59:0/4168642663 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c000aaa30 con 0x7f9c1015b3b0 2024-05-30T17:06:08.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c15000640 1 -- 172.21.15.59:0/4168642663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1015b3b0 msgr2=0x7f9c100adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c15000640 1 --2- 172.21.15.59:0/4168642663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1015b3b0 0x7f9c100adf30 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f9c000098a0 tx=0x7f9c0001c510 comp rx=0 tx=0).stop 2024-05-30T17:06:08.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c15000640 1 -- 172.21.15.59:0/4168642663 shutdown_connections 2024-05-30T17:06:08.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c15000640 1 --2- 172.21.15.59:0/4168642663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100723c0 0x7f9c100af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c15000640 1 --2- 172.21.15.59:0/4168642663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1015b3b0 0x7f9c100adf30 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c15000640 1 -- 172.21.15.59:0/4168642663 >> 172.21.15.59:0/4168642663 conn(0x7f9c100b1e60 msgr2=0x7f9c100b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:08.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c15000640 1 -- 172.21.15.59:0/4168642663 shutdown_connections 2024-05-30T17:06:08.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c15000640 1 -- 172.21.15.59:0/4168642663 wait complete. 2024-05-30T17:06:08.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.736+0000 7f9c15000640 1 Processor -- start 2024-05-30T17:06:08.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c15000640 1 -- start start 2024-05-30T17:06:08.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c15000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100723c0 0x7f9c10099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:08.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c15000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1015b3b0 0x7f9c1009ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:08.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c15000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c1015b790 0x7f9c1009b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c15000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c100cc7d0 con 0x7f9c1015b3b0 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c15000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c100cc650 con 0x7f9c1015b790 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c15000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c100b3970 con 0x7f9c100723c0 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c0d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1015b3b0 0x7f9c1009ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c0d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1015b3b0 0x7f9c1009ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46340/0 (socket says 172.21.15.59:46340) 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c0d400640 1 -- 172.21.15.59:0/2155252462 learned_addr learned my addr 172.21.15.59:0/2155252462 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c0de00640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100723c0 0x7f9c10099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c0e800640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c1015b790 0x7f9c1009b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c0d400640 1 -- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100723c0 msgr2=0x7f9c10099850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c0d400640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100723c0 0x7f9c10099850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c0d400640 1 -- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c1015b790 msgr2=0x7f9c1009b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c0d400640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c1015b790 0x7f9c1009b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c0d400640 1 -- 172.21.15.59:0/2155252462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c101f87d0 con 0x7f9c1015b3b0 2024-05-30T17:06:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c0e800640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c1015b790 0x7f9c1009b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:06:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c0d400640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1015b3b0 0x7f9c1009ad40 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00c310 tx=0x7f9bfc00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c06000640 1 -- 172.21.15.59:0/2155252462 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc0052d0 con 0x7f9c1015b3b0 2024-05-30T17:06:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c06000640 1 -- 172.21.15.59:0/2155252462 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bfc005470 con 0x7f9c1015b3b0 2024-05-30T17:06:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c06000640 1 -- 172.21.15.59:0/2155252462 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc007260 con 0x7f9c1015b3b0 2024-05-30T17:06:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c15000640 1 -- 172.21.15.59:0/2155252462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c101f8ab0 con 0x7f9c1015b3b0 2024-05-30T17:06:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c15000640 1 -- 172.21.15.59:0/2155252462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c101f9070 con 0x7f9c1015b3b0 2024-05-30T17:06:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.740+0000 7f9c15000640 1 -- 172.21.15.59:0/2155252462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c10068a90 con 0x7f9c1015b3b0 2024-05-30T17:06:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.744+0000 7f9c06000640 1 -- 172.21.15.59:0/2155252462 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 44) ==== 90894+0+0 (secure 0 0 0) 0x7f9bfc007400 con 0x7f9c1015b3b0 2024-05-30T17:06:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.744+0000 7f9c06000640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9bf006a390 0x7f9bf006c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.744+0000 7f9c06000640 1 -- 172.21.15.59:0/2155252462 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f9bfc084e50 con 0x7f9c1015b3b0 2024-05-30T17:06:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.744+0000 7f9c0de00640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9bf006a390 0x7f9bf006c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.744+0000 7f9c0de00640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9bf006a390 0x7f9bf006c850 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9c000ae000 tx=0x7f9c000a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.748+0000 7f9c06000640 1 -- 172.21.15.59:0/2155252462 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9bfc056820 con 0x7f9c1015b3b0 2024-05-30T17:06:08.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.936+0000 7f9c15000640 1 -- 172.21.15.59:0/2155252462 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone67195", "target": ["mon-mgr", ""]}) -- 0x7f9c100b4da0 con 0x7f9bf006a390 2024-05-30T17:06:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.956+0000 7f9c06000640 1 -- 172.21.15.59:0/2155252462 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9c100b4da0 con 0x7f9bf006a390 2024-05-30T17:06:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.960+0000 7f9c15000640 1 -- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9bf006a390 msgr2=0x7f9bf006c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.960+0000 7f9c15000640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9bf006a390 0x7f9bf006c850 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9c000ae000 tx=0x7f9c000a7000 comp rx=0 tx=0).stop 2024-05-30T17:06:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.960+0000 7f9c15000640 1 -- 172.21.15.59:0/2155252462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1015b3b0 msgr2=0x7f9c1009ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.960+0000 7f9c15000640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1015b3b0 0x7f9c1009ad40 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00c310 tx=0x7f9bfc00c7d0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.960+0000 7f9c15000640 1 -- 172.21.15.59:0/2155252462 shutdown_connections 2024-05-30T17:06:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.960+0000 7f9c15000640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9bf006a390 0x7f9bf006c850 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.960+0000 7f9c15000640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c1015b790 0x7f9c1009b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.960+0000 7f9c15000640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1015b3b0 0x7f9c1009ad40 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.960+0000 7f9c15000640 1 --2- 172.21.15.59:0/2155252462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100723c0 0x7f9c10099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.960+0000 7f9c15000640 1 -- 172.21.15.59:0/2155252462 >> 172.21.15.59:0/2155252462 conn(0x7f9c100b1e60 msgr2=0x7f9c1015bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.960+0000 7f9c15000640 1 -- 172.21.15.59:0/2155252462 shutdown_connections 2024-05-30T17:06:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:08.960+0000 7f9c15000640 1 -- 172.21.15.59:0/2155252462 wait complete. 2024-05-30T17:06:08.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T17:06:09.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.124+0000 7fa472600640 1 Processor -- start 2024-05-30T17:06:09.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.124+0000 7fa472600640 1 -- start start 2024-05-30T17:06:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.124+0000 7fa472600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c159210 0x7fa46c0cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.124+0000 7fa472600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa46c0d0b10 0x7fa46c0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.124+0000 7fa472600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46c15bc20 con 0x7fa46c158e30 2024-05-30T17:06:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.124+0000 7fa472600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa46c15b9d0 con 0x7fa46c0d0b10 2024-05-30T17:06:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.124+0000 7fa472600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa46c15bf00 con 0x7fa46c159210 2024-05-30T17:06:09.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa471200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa46c158e30 0x7fa46c0d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49322/0 (socket says 172.21.15.59:49322) 2024-05-30T17:06:09.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa471200640 1 -- 172.21.15.59:0/1672914546 learned_addr learned my addr 172.21.15.59:0/1672914546 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:06:09.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa463e00640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c159210 0x7fa46c0cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa471c00640 1 --2- 172.21.15.59:0/1672914546 >> v2:172.21.15.107:3300/0 conn(0x7fa46c0d0b10 0x7fa46c0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513919054 0 0) 0x7fa46c15bc20 con 0x7fa46c158e30 2024-05-30T17:06:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa450003530 con 0x7fa46c158e30 2024-05-30T17:06:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 949749767 0 0) 0x7fa450003530 con 0x7fa46c158e30 2024-05-30T17:06:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c159210 msgr2=0x7fa46c0cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c159210 0x7fa46c0cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 >> v2:172.21.15.107:3300/0 conn(0x7fa46c0d0b10 msgr2=0x7fa46c0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 --2- 172.21.15.59:0/1672914546 >> v2:172.21.15.107:3300/0 conn(0x7fa46c0d0b10 0x7fa46c0ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c15c1e0 con 0x7fa46c158e30 2024-05-30T17:06:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fa45c001680 con 0x7fa46c158e30 2024-05-30T17:06:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 >> v1:172.21.15.59:6789/0 conn(0x7fa46c158e30 legacy=0x7fa46c0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4500039c0 0x7fa450003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa450004810 0x7fa450004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c159210 0x7fa4500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c15b9d0 con 0x7fa450004810 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c15bf00 con 0x7fa4500039c0 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa45000b9d0 con 0x7fa46c159210 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa463e00640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa450004810 0x7fa450004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa471200640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4500039c0 0x7fa450003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa471c00640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c159210 0x7fa4500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa463e00640 1 -- 172.21.15.59:0/1672914546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c159210 msgr2=0x7fa4500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa463e00640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c159210 0x7fa4500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa463e00640 1 -- 172.21.15.59:0/1672914546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4500039c0 msgr2=0x7fa450003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa463e00640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4500039c0 0x7fa450003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa463e00640 1 -- 172.21.15.59:0/1672914546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa450003530 con 0x7fa450004810 2024-05-30T17:06:09.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.128+0000 7fa471c00640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c159210 0x7fa4500051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:06:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa463e00640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa450004810 0x7fa450004c90 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fa454009ab0 tx=0x7fa45401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11c211397125397 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4540b2070 con 0x7fa450004810 2024-05-30T17:06:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4540a5560 con 0x7fa450004810 2024-05-30T17:06:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa46be00640 1 -- 172.21.15.59:0/1672914546 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4540096b0 con 0x7fa450004810 2024-05-30T17:06:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa472600640 1 -- 172.21.15.59:0/1672914546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa450004810 msgr2=0x7fa450004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa472600640 1 --2- 172.21.15.59:0/1672914546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa450004810 0x7fa450004c90 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fa454009ab0 tx=0x7fa45401ca50 comp rx=0 tx=0).stop 2024-05-30T17:06:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa471c00640 1 -- 172.21.15.59:0/1672914546 reap_dead start 2024-05-30T17:06:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa472600640 1 -- 172.21.15.59:0/1672914546 shutdown_connections 2024-05-30T17:06:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa472600640 1 -- 172.21.15.59:0/1672914546 >> 172.21.15.59:0/1672914546 conn(0x7fa46c06bb80 msgr2=0x7fa46c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa472600640 1 -- 172.21.15.59:0/1672914546 shutdown_connections 2024-05-30T17:06:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa472600640 1 -- 172.21.15.59:0/1672914546 wait complete. 2024-05-30T17:06:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa472600640 1 Processor -- start 2024-05-30T17:06:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.132+0000 7fa472600640 1 -- start start 2024-05-30T17:06:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa472600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa450004810 0x7fa46c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa472600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46c0afb00 0x7fa46c0aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa472600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c14f0c0 0x7fa46c14f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa472600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c0cdf20 con 0x7fa46c0afb00 2024-05-30T17:06:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa472600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c15c7a0 con 0x7fa450004810 2024-05-30T17:06:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa472600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa46c0ce0a0 con 0x7fa46c14f0c0 2024-05-30T17:06:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa463e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46c0afb00 0x7fa46c0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa463e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46c0afb00 0x7fa46c0aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46352/0 (socket says 172.21.15.59:46352) 2024-05-30T17:06:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa463e00640 1 -- 172.21.15.59:0/2723592888 learned_addr learned my addr 172.21.15.59:0/2723592888 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa471200640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa450004810 0x7fa46c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa471c00640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c14f0c0 0x7fa46c14f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa463e00640 1 -- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c14f0c0 msgr2=0x7fa46c14f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa463e00640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c14f0c0 0x7fa46c14f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa463e00640 1 -- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa450004810 msgr2=0x7fa46c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa463e00640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa450004810 0x7fa46c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa463e00640 1 -- 172.21.15.59:0/2723592888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c0b06e0 con 0x7fa46c0afb00 2024-05-30T17:06:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa471200640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa450004810 0x7fa46c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:06:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa471c00640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c14f0c0 0x7fa46c14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:06:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa463e00640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46c0afb00 0x7fa46c0aff60 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fa45401c880 tx=0x7fa450005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa469600640 1 -- 172.21.15.59:0/2723592888 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4540b2040 con 0x7fa46c0afb00 2024-05-30T17:06:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa469600640 1 -- 172.21.15.59:0/2723592888 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa45400f000 con 0x7fa46c0afb00 2024-05-30T17:06:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa469600640 1 -- 172.21.15.59:0/2723592888 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4540ad640 con 0x7fa46c0afb00 2024-05-30T17:06:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa472600640 1 -- 172.21.15.59:0/2723592888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c0b09c0 con 0x7fa46c0afb00 2024-05-30T17:06:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa472600640 1 -- 172.21.15.59:0/2723592888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c0b0f80 con 0x7fa46c0afb00 2024-05-30T17:06:09.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa472600640 1 -- 172.21.15.59:0/2723592888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46c068a90 con 0x7fa46c0afb00 2024-05-30T17:06:09.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.136+0000 7fa469600640 1 -- 172.21.15.59:0/2723592888 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 44) ==== 90894+0+0 (secure 0 0 0) 0x7fa4540be020 con 0x7fa46c0afb00 2024-05-30T17:06:09.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.140+0000 7fa469600640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa44806a390 0x7fa44806c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.140+0000 7fa469600640 1 -- 172.21.15.59:0/2723592888 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fa45411f280 con 0x7fa46c0afb00 2024-05-30T17:06:09.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.140+0000 7fa471200640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa44806a390 0x7fa44806c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.140+0000 7fa471200640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa44806a390 0x7fa44806c850 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa45c005180 tx=0x7fa45c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.144+0000 7fa469600640 1 -- 172.21.15.59:0/2723592888 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa454016760 con 0x7fa46c0afb00 2024-05-30T17:06:09.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.336+0000 7fa472600640 1 -- 172.21.15.59:0/2723592888 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa46c06f4c0 con 0x7fa44806a390 2024-05-30T17:06:09.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa469600640 1 -- 172.21.15.59:0/2723592888 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa46c06f4c0 con 0x7fa44806a390 2024-05-30T17:06:09.352 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:06:09.352 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-05-30T17:06:09.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-05-30T17:06:09.352 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ss1" 2024-05-30T17:06:09.352 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-05-30T17:06:09.352 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-05-30T17:06:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa472600640 1 -- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa44806a390 msgr2=0x7fa44806c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa472600640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa44806a390 0x7fa44806c850 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa45c005180 tx=0x7fa45c009040 comp rx=0 tx=0).stop 2024-05-30T17:06:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa472600640 1 -- 172.21.15.59:0/2723592888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46c0afb00 msgr2=0x7fa46c0aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa472600640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46c0afb00 0x7fa46c0aff60 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fa45401c880 tx=0x7fa450005840 comp rx=0 tx=0).stop 2024-05-30T17:06:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa472600640 1 -- 172.21.15.59:0/2723592888 shutdown_connections 2024-05-30T17:06:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa472600640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa44806a390 0x7fa44806c850 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa472600640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa46c14f0c0 0x7fa46c14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa472600640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46c0afb00 0x7fa46c0aff60 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa472600640 1 --2- 172.21.15.59:0/2723592888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa450004810 0x7fa46c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa472600640 1 -- 172.21.15.59:0/2723592888 >> 172.21.15.59:0/2723592888 conn(0x7fa46c06bb80 msgr2=0x7fa46c15ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa472600640 1 -- 172.21.15.59:0/2723592888 shutdown_connections 2024-05-30T17:06:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.352+0000 7fa472600640 1 -- 172.21.15.59:0/2723592888 wait complete. 2024-05-30T17:06:09.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:06:09.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd8e200640 1 Processor -- start 2024-05-30T17:06:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd8e200640 1 -- start start 2024-05-30T17:06:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd8e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd88141f20 0x7fdd8806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd8e200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd8806bce0 0x7fdd8806c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd8e200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd88163260 con 0x7fdd880c9e10 2024-05-30T17:06:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd8e200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fdd881626e0 con 0x7fdd8806bce0 2024-05-30T17:06:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd8e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdd881629c0 con 0x7fdd88141f20 2024-05-30T17:06:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd87e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd8806bce0 0x7fdd8806c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd87e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd8806bce0 0x7fdd8806c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46370/0 (socket says 172.21.15.59:46370) 2024-05-30T17:06:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd87e00640 1 -- 172.21.15.59:0/1286011240 learned_addr learned my addr 172.21.15.59:0/1286011240 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd7ea00640 1 --2- 172.21.15.59:0/1286011240 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd88141f20 0x7fdd8806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd87e00640 1 -- 172.21.15.59:0/1286011240 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd88141f20 msgr2=0x7fdd8806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd87e00640 1 --2- 172.21.15.59:0/1286011240 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd88141f20 0x7fdd8806ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd87e00640 1 -- 172.21.15.59:0/1286011240 >> v1:172.21.15.107:6789/0 conn(0x7fdd880c9e10 legacy=0x7fdd880ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.520+0000 7fdd87e00640 1 -- 172.21.15.59:0/1286011240 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd88162ca0 con 0x7fdd8806bce0 2024-05-30T17:06:09.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.524+0000 7fdd87e00640 1 --2- 172.21.15.59:0/1286011240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd8806bce0 0x7fdd8806c170 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009e50 tx=0x7fdd8001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96d23aa32cffe4d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.524+0000 7fdd86a00640 1 -- 172.21.15.59:0/1286011240 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd800a55d0 con 0x7fdd8806bce0 2024-05-30T17:06:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.524+0000 7fdd86a00640 1 -- 172.21.15.59:0/1286011240 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd800a5770 con 0x7fdd8806bce0 2024-05-30T17:06:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.524+0000 7fdd86a00640 1 -- 172.21.15.59:0/1286011240 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd800a5b40 con 0x7fdd8806bce0 2024-05-30T17:06:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.524+0000 7fdd8e200640 1 -- 172.21.15.59:0/1286011240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd8806bce0 msgr2=0x7fdd8806c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.524+0000 7fdd8e200640 1 --2- 172.21.15.59:0/1286011240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd8806bce0 0x7fdd8806c170 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009e50 tx=0x7fdd8001c910 comp rx=0 tx=0).stop 2024-05-30T17:06:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.524+0000 7fdd8e200640 1 -- 172.21.15.59:0/1286011240 shutdown_connections 2024-05-30T17:06:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.524+0000 7fdd8e200640 1 --2- 172.21.15.59:0/1286011240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd8806bce0 0x7fdd8806c170 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.524+0000 7fdd8e200640 1 --2- 172.21.15.59:0/1286011240 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd88141f20 0x7fdd8806ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.524+0000 7fdd8e200640 1 -- 172.21.15.59:0/1286011240 >> 172.21.15.59:0/1286011240 conn(0x7fdd880cd540 msgr2=0x7fdd880cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.524+0000 7fdd8e200640 1 -- 172.21.15.59:0/1286011240 shutdown_connections 2024-05-30T17:06:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.524+0000 7fdd8e200640 1 -- 172.21.15.59:0/1286011240 wait complete. 2024-05-30T17:06:09.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd8e200640 1 Processor -- start 2024-05-30T17:06:09.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd8e200640 1 -- start start 2024-05-30T17:06:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd8e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd8806bce0 0x7fdd881fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd8e200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd880c9e10 0x7fdd8815bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd8e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd88141f20 0x7fdd8813d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd8e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdd880cd1d0 con 0x7fdd8806bce0 2024-05-30T17:06:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd8e200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8806cac0 con 0x7fdd880c9e10 2024-05-30T17:06:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd8e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdd880cd350 con 0x7fdd88141f20 2024-05-30T17:06:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd87400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd8806bce0 0x7fdd881fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd87400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd8806bce0 0x7fdd881fb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46376/0 (socket says 172.21.15.59:46376) 2024-05-30T17:06:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd87400640 1 -- 172.21.15.59:0/1794058435 learned_addr learned my addr 172.21.15.59:0/1794058435 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd7ea00640 1 --2- 172.21.15.59:0/1794058435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd880c9e10 0x7fdd8815bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd87e00640 1 --2- 172.21.15.59:0/1794058435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd88141f20 0x7fdd8813d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd87400640 1 -- 172.21.15.59:0/1794058435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd88141f20 msgr2=0x7fdd8813d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd87400640 1 --2- 172.21.15.59:0/1794058435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd88141f20 0x7fdd8813d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd87400640 1 -- 172.21.15.59:0/1794058435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd880c9e10 msgr2=0x7fdd8815bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd87400640 1 --2- 172.21.15.59:0/1794058435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd880c9e10 0x7fdd8815bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd87400640 1 -- 172.21.15.59:0/1794058435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd88147720 con 0x7fdd8806bce0 2024-05-30T17:06:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd87400640 1 --2- 172.21.15.59:0/1794058435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd8806bce0 0x7fdd881fb8c0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c3a0 tx=0x7fdd7800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:09.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd7fe00640 1 -- 172.21.15.59:0/1794058435 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd780052d0 con 0x7fdd8806bce0 2024-05-30T17:06:09.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd7fe00640 1 -- 172.21.15.59:0/1794058435 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd78005470 con 0x7fdd8806bce0 2024-05-30T17:06:09.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd7fe00640 1 -- 172.21.15.59:0/1794058435 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78007260 con 0x7fdd8806bce0 2024-05-30T17:06:09.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd8e200640 1 -- 172.21.15.59:0/1794058435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd881479e0 con 0x7fdd8806bce0 2024-05-30T17:06:09.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.528+0000 7fdd8e200640 1 -- 172.21.15.59:0/1794058435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd8815cba0 con 0x7fdd8806bce0 2024-05-30T17:06:09.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.532+0000 7fdd8e200640 1 -- 172.21.15.59:0/1794058435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd8815c6e0 con 0x7fdd8806bce0 2024-05-30T17:06:09.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.532+0000 7fdd7fe00640 1 -- 172.21.15.59:0/1794058435 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 44) ==== 90894+0+0 (secure 0 0 0) 0x7fdd78007400 con 0x7fdd8806bce0 2024-05-30T17:06:09.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.532+0000 7fdd7fe00640 1 --2- 172.21.15.59:0/1794058435 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdd6406a390 0x7fdd6406c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:09.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.532+0000 7fdd7fe00640 1 -- 172.21.15.59:0/1794058435 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fdd78084f50 con 0x7fdd8806bce0 2024-05-30T17:06:09.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.532+0000 7fdd7ea00640 1 --2- 172.21.15.59:0/1794058435 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdd6406a390 0x7fdd6406c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:09.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.532+0000 7fdd7ea00640 1 --2- 172.21.15.59:0/1794058435 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fdd6406a390 0x7fdd6406c850 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fdd88143590 tx=0x7fdd70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:09.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.536+0000 7fdd7fe00640 1 -- 172.21.15.59:0/1794058435 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdd8815c6e0 con 0x7fdd8806bce0 2024-05-30T17:06:09.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.732+0000 7fdd8e200640 1 -- 172.21.15.59:0/1794058435 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd88068a90 con 0x7fdd6406a390 2024-05-30T17:06:09.740 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:09.739+0000 7efd6da00640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T17:06:09.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:09.740+0000 7fdd7fe00640 1 -- 172.21.15.59:0/1794058435 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7fdd88068a90 con 0x7fdd6406a390 2024-05-30T17:06:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:06:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T17:06:09.749 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T17:06:15.750 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:06:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f64a6000640 1 Processor -- start 2024-05-30T17:06:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f64a6000640 1 -- start start 2024-05-30T17:06:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f64a6000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f64a00cced0 0x7f64a00cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f64a6000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f64a00d0370 0x7f64a0160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f64a6000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a00cd7f0 con 0x7f64a006b9b0 2024-05-30T17:06:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f64a6000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f64a00d1180 con 0x7f64a00d0370 2024-05-30T17:06:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f64a6000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f64a015d060 con 0x7f64a00cced0 2024-05-30T17:06:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f649fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f64a00d0370 0x7f64a0160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f649fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f64a00d0370 0x7f64a0160140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37912/0 (socket says 172.21.15.59:37912) 2024-05-30T17:06:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f649fe00640 1 -- 172.21.15.59:0/2708594201 learned_addr learned my addr 172.21.15.59:0/2708594201 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:15.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f649f400640 1 --2- 172.21.15.59:0/2708594201 >> v2:172.21.15.107:3300/0 conn(0x7f64a00cced0 0x7f64a00cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:15.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f649fe00640 1 -- 172.21.15.59:0/2708594201 >> v2:172.21.15.107:3300/0 conn(0x7f64a00cced0 msgr2=0x7f64a00cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:15.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f649fe00640 1 --2- 172.21.15.59:0/2708594201 >> v2:172.21.15.107:3300/0 conn(0x7f64a00cced0 0x7f64a00cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:15.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f649fe00640 1 -- 172.21.15.59:0/2708594201 >> v1:172.21.15.107:6789/0 conn(0x7f64a006b9b0 legacy=0x7f64a015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:15.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.908+0000 7f649fe00640 1 -- 172.21.15.59:0/2708594201 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a00d0bc0 con 0x7f64a00d0370 2024-05-30T17:06:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.912+0000 7f649fe00640 1 --2- 172.21.15.59:0/2708594201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64a00d0370 0x7f64a0160140 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f64a00cdd40 tx=0x7f649801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c713030a4615ffe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.912+0000 7f649ea00640 1 -- 172.21.15.59:0/2708594201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64980a57b0 con 0x7f64a00d0370 2024-05-30T17:06:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.912+0000 7f649ea00640 1 -- 172.21.15.59:0/2708594201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64980a5950 con 0x7f64a00d0370 2024-05-30T17:06:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.912+0000 7f649ea00640 1 -- 172.21.15.59:0/2708594201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64980a5d20 con 0x7f64a00d0370 2024-05-30T17:06:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.912+0000 7f64a6000640 1 -- 172.21.15.59:0/2708594201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64a00d0370 msgr2=0x7f64a0160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.912+0000 7f64a6000640 1 --2- 172.21.15.59:0/2708594201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64a00d0370 0x7f64a0160140 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f64a00cdd40 tx=0x7f649801c8f0 comp rx=0 tx=0).stop 2024-05-30T17:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.912+0000 7f64a6000640 1 -- 172.21.15.59:0/2708594201 shutdown_connections 2024-05-30T17:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.912+0000 7f64a6000640 1 --2- 172.21.15.59:0/2708594201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64a00d0370 0x7f64a0160140 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.912+0000 7f64a6000640 1 --2- 172.21.15.59:0/2708594201 >> v2:172.21.15.107:3300/0 conn(0x7f64a00cced0 0x7f64a00cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.912+0000 7f64a6000640 1 -- 172.21.15.59:0/2708594201 >> 172.21.15.59:0/2708594201 conn(0x7f64a00b2f50 msgr2=0x7f64a00b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.912+0000 7f64a6000640 1 -- 172.21.15.59:0/2708594201 shutdown_connections 2024-05-30T17:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.912+0000 7f64a6000640 1 -- 172.21.15.59:0/2708594201 wait complete. 2024-05-30T17:06:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f64a6000640 1 Processor -- start 2024-05-30T17:06:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f64a6000640 1 -- start start 2024-05-30T17:06:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f64a6000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a006b9b0 0x7f64a014e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f64a6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64a00cced0 0x7f64a006f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f64a6000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a00d0370 0x7f64a015b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f64a6000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f64a006c6d0 con 0x7f64a00cced0 2024-05-30T17:06:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f64a6000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f64a006c550 con 0x7f64a006b9b0 2024-05-30T17:06:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f64a6000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f64a0160a90 con 0x7f64a00d0370 2024-05-30T17:06:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f6497e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64a00cced0 0x7f64a006f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f6497e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64a00cced0 0x7f64a006f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37926/0 (socket says 172.21.15.59:37926) 2024-05-30T17:06:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f6497e00640 1 -- 172.21.15.59:0/3749255714 learned_addr learned my addr 172.21.15.59:0/3749255714 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f649f400640 1 --2- 172.21.15.59:0/3749255714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a006b9b0 0x7f64a014e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f649fe00640 1 --2- 172.21.15.59:0/3749255714 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a00d0370 0x7f64a015b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:15.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f6497e00640 1 -- 172.21.15.59:0/3749255714 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a00d0370 msgr2=0x7f64a015b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:15.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f6497e00640 1 --2- 172.21.15.59:0/3749255714 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a00d0370 0x7f64a015b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:15.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f6497e00640 1 -- 172.21.15.59:0/3749255714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a006b9b0 msgr2=0x7f64a014e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:15.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f6497e00640 1 --2- 172.21.15.59:0/3749255714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a006b9b0 0x7f64a014e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:15.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f6497e00640 1 -- 172.21.15.59:0/3749255714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a0070280 con 0x7f64a00cced0 2024-05-30T17:06:15.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f6497e00640 1 --2- 172.21.15.59:0/3749255714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64a00cced0 0x7f64a006f850 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f648800c440 tx=0x7f648800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:15.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f6497400640 1 -- 172.21.15.59:0/3749255714 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6488016020 con 0x7f64a00cced0 2024-05-30T17:06:15.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f6497400640 1 -- 172.21.15.59:0/3749255714 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6488012830 con 0x7f64a00cced0 2024-05-30T17:06:15.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f6497400640 1 -- 172.21.15.59:0/3749255714 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6488012c20 con 0x7f64a00cced0 2024-05-30T17:06:15.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f64a6000640 1 -- 172.21.15.59:0/3749255714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a0070560 con 0x7f64a00cced0 2024-05-30T17:06:15.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.916+0000 7f64a6000640 1 -- 172.21.15.59:0/3749255714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a014f620 con 0x7f64a00cced0 2024-05-30T17:06:15.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.920+0000 7f64a6000640 1 -- 172.21.15.59:0/3749255714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a0068a90 con 0x7f64a00cced0 2024-05-30T17:06:15.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.920+0000 7f6497400640 1 -- 172.21.15.59:0/3749255714 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 45) ==== 90996+0+0 (secure 0 0 0) 0x7f6488019020 con 0x7f64a00cced0 2024-05-30T17:06:15.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.920+0000 7f6497400640 1 --2- 172.21.15.59:0/3749255714 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f647c06a4b0 0x7f647c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:15.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.920+0000 7f6497400640 1 -- 172.21.15.59:0/3749255714 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f6488085910 con 0x7f64a00cced0 2024-05-30T17:06:15.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.920+0000 7f649f400640 1 --2- 172.21.15.59:0/3749255714 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f647c06a4b0 0x7f647c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:15.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.920+0000 7f649f400640 1 --2- 172.21.15.59:0/3749255714 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f647c06a4b0 0x7f647c06c970 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f6490006aa0 tx=0x7f6490008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:15.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:15.924+0000 7f6497400640 1 -- 172.21.15.59:0/3749255714 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6488020020 con 0x7f64a00cced0 2024-05-30T17:06:16.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:16.120+0000 7f64a6000640 1 -- 172.21.15.59:0/3749255714 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64a00739e0 con 0x7f647c06a4b0 2024-05-30T17:06:16.129 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:16.127+0000 7efd6da00640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T17:06:16.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:16.128+0000 7f6497400640 1 -- 172.21.15.59:0/3749255714 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7f64a00739e0 con 0x7f647c06a4b0 2024-05-30T17:06:16.130 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:06:16.130 INFO:teuthology.orchestra.run.smithi059.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T17:06:16.139 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T17:06:22.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:06:22.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c29600640 1 Processor -- start 2024-05-30T17:06:22.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c29600640 1 -- start start 2024-05-30T17:06:22.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c29600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c240b4f90 0x7f9c240b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:22.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c29600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c240b32d0 con 0x7f9c240b3ff0 2024-05-30T17:06:22.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c29600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2415f490 con 0x7f9c240723a0 2024-05-30T17:06:22.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c29600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2415f770 con 0x7f9c240b4f90 2024-05-30T17:06:22.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c23400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9c240b3ff0 0x7f9c2406dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36180/0 (socket says 172.21.15.59:36180) 2024-05-30T17:06:22.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c23400640 1 -- 172.21.15.59:0/759478814 learned_addr learned my addr 172.21.15.59:0/759478814 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:06:22.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c1be00640 1 --2- 172.21.15.59:0/759478814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c240b4f90 0x7f9c240b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:22.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c22000640 1 -- 172.21.15.59:0/759478814 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3974867367 0 0) 0x7f9c240b32d0 con 0x7f9c240b3ff0 2024-05-30T17:06:22.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c22000640 1 -- 172.21.15.59:0/759478814 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c08003530 con 0x7f9c240b3ff0 2024-05-30T17:06:22.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c22000640 1 -- 172.21.15.59:0/759478814 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2740119012 0 0) 0x7f9c2415f490 con 0x7f9c240723a0 2024-05-30T17:06:22.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c22000640 1 -- 172.21.15.59:0/759478814 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c240b32d0 con 0x7f9c240723a0 2024-05-30T17:06:22.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c1be00640 1 -- 172.21.15.59:0/759478814 >> v1:172.21.15.107:6789/0 conn(0x7f9c240723a0 legacy=0x7f9c2415ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:22.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c1be00640 1 -- 172.21.15.59:0/759478814 >> v1:172.21.15.59:6789/0 conn(0x7f9c240b3ff0 legacy=0x7f9c2406dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:22.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.300+0000 7f9c1be00640 1 -- 172.21.15.59:0/759478814 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2415fa50 con 0x7f9c240b4f90 2024-05-30T17:06:22.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.304+0000 7f9c1be00640 1 --2- 172.21.15.59:0/759478814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c240b4f90 0x7f9c240b3ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097f0 tx=0x7f9c0c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19394daf9d51e067 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:22.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.304+0000 7f9c22000640 1 -- 172.21.15.59:0/759478814 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0ab5f0 con 0x7f9c240b4f90 2024-05-30T17:06:22.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.304+0000 7f9c22000640 1 -- 172.21.15.59:0/759478814 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0c0b0070 con 0x7f9c240b4f90 2024-05-30T17:06:22.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.304+0000 7f9c22000640 1 -- 172.21.15.59:0/759478814 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0ab990 con 0x7f9c240b4f90 2024-05-30T17:06:22.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.304+0000 7f9c29600640 1 -- 172.21.15.59:0/759478814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c240b4f90 msgr2=0x7f9c240b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:22.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.304+0000 7f9c29600640 1 --2- 172.21.15.59:0/759478814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c240b4f90 0x7f9c240b3ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097f0 tx=0x7f9c0c01c4e0 comp rx=0 tx=0).stop 2024-05-30T17:06:22.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.304+0000 7f9c29600640 1 -- 172.21.15.59:0/759478814 shutdown_connections 2024-05-30T17:06:22.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.304+0000 7f9c29600640 1 --2- 172.21.15.59:0/759478814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c240b4f90 0x7f9c240b3ab0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:22.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.304+0000 7f9c29600640 1 -- 172.21.15.59:0/759478814 >> 172.21.15.59:0/759478814 conn(0x7f9c2406bdb0 msgr2=0x7f9c2406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:22.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.304+0000 7f9c29600640 1 -- 172.21.15.59:0/759478814 shutdown_connections 2024-05-30T17:06:22.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.304+0000 7f9c29600640 1 -- 172.21.15.59:0/759478814 wait complete. 2024-05-30T17:06:22.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c29600640 1 Processor -- start 2024-05-30T17:06:22.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c29600640 1 -- start start 2024-05-30T17:06:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c29600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c240723a0 0x7f9c24147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c29600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c240b3ff0 0x7f9c2415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c29600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c240b4f90 0x7f9c2415d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c29600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2406e510 con 0x7f9c240b4f90 2024-05-30T17:06:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c29600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2406e390 con 0x7f9c240b3ff0 2024-05-30T17:06:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c29600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c24154e60 con 0x7f9c240723a0 2024-05-30T17:06:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c23400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c240b4f90 0x7f9c2415d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c23400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c240b4f90 0x7f9c2415d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58776/0 (socket says 172.21.15.59:58776) 2024-05-30T17:06:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c23400640 1 -- 172.21.15.59:0/2951280772 learned_addr learned my addr 172.21.15.59:0/2951280772 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c1be00640 1 --2- 172.21.15.59:0/2951280772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c240b3ff0 0x7f9c2415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c22a00640 1 --2- 172.21.15.59:0/2951280772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c240723a0 0x7f9c24147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c23400640 1 -- 172.21.15.59:0/2951280772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c240723a0 msgr2=0x7f9c24147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c23400640 1 --2- 172.21.15.59:0/2951280772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c240723a0 0x7f9c24147660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c23400640 1 -- 172.21.15.59:0/2951280772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c240b3ff0 msgr2=0x7f9c2415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c23400640 1 --2- 172.21.15.59:0/2951280772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c240b3ff0 0x7f9c2415cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c23400640 1 -- 172.21.15.59:0/2951280772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2414b5f0 con 0x7f9c240b4f90 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c22a00640 1 --2- 172.21.15.59:0/2951280772 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c240723a0 0x7f9c24147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c23400640 1 --2- 172.21.15.59:0/2951280772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c240b4f90 0x7f9c2415d130 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00cb90 tx=0x7f9c1c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c1aa00640 1 -- 172.21.15.59:0/2951280772 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c017070 con 0x7f9c240b4f90 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c1aa00640 1 -- 172.21.15.59:0/2951280772 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1c00ace0 con 0x7f9c240b4f90 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c1aa00640 1 -- 172.21.15.59:0/2951280772 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c012600 con 0x7f9c240b4f90 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c29600640 1 -- 172.21.15.59:0/2951280772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2414b8d0 con 0x7f9c240b4f90 2024-05-30T17:06:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c29600640 1 -- 172.21.15.59:0/2951280772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2414be90 con 0x7f9c240b4f90 2024-05-30T17:06:22.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.308+0000 7f9c29600640 1 -- 172.21.15.59:0/2951280772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c24068a90 con 0x7f9c240b4f90 2024-05-30T17:06:22.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.312+0000 7f9c1aa00640 1 -- 172.21.15.59:0/2951280772 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 45) ==== 90996+0+0 (secure 0 0 0) 0x7f9c1c01a070 con 0x7f9c240b4f90 2024-05-30T17:06:22.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.312+0000 7f9c1aa00640 1 --2- 172.21.15.59:0/2951280772 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c0006a4e0 0x7f9c0006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:22.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.312+0000 7f9c1aa00640 1 -- 172.21.15.59:0/2951280772 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f9c1c085770 con 0x7f9c240b4f90 2024-05-30T17:06:22.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.312+0000 7f9c22a00640 1 --2- 172.21.15.59:0/2951280772 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c0006a4e0 0x7f9c0006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.312+0000 7f9c22a00640 1 --2- 172.21.15.59:0/2951280772 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f9c0006a4e0 0x7f9c0006c9a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f9c140011f0 tx=0x7f9c14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.316+0000 7f9c1aa00640 1 -- 172.21.15.59:0/2951280772 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c1c0571e0 con 0x7f9c240b4f90 2024-05-30T17:06:22.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.516+0000 7f9c29600640 1 -- 172.21.15.59:0/2951280772 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c2414b3a0 con 0x7f9c0006a4e0 2024-05-30T17:06:22.525 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:22.523+0000 7efd6da00640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T17:06:22.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:22.524+0000 7f9c1aa00640 1 -- 172.21.15.59:0/2951280772 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7f9c2414b3a0 con 0x7f9c0006a4e0 2024-05-30T17:06:22.526 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:06:22.526 INFO:teuthology.orchestra.run.smithi059.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T17:06:22.534 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T17:06:28.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:06:28.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.692+0000 7fab4c600640 1 Processor -- start 2024-05-30T17:06:28.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.692+0000 7fab4c600640 1 -- start start 2024-05-30T17:06:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab4c600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fab440ad2b0 0x7fab4415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab4c600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab440d0660 0x7fab440d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab4c600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab440ad770 con 0x7fab441569e0 2024-05-30T17:06:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab4c600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fab440d1010 con 0x7fab440d0660 2024-05-30T17:06:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab4c600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fab4415cb40 con 0x7fab440ad2b0 2024-05-30T17:06:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab49c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fab441569e0 0x7fab440cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36190/0 (socket says 172.21.15.59:36190) 2024-05-30T17:06:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab49c00640 1 -- 172.21.15.59:0/1370111500 learned_addr learned my addr 172.21.15.59:0/1370111500 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:06:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab4a600640 1 --2- 172.21.15.59:0/1370111500 >> v2:172.21.15.59:3300/0 conn(0x7fab440d0660 0x7fab440d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab49200640 1 --2- 172.21.15.59:0/1370111500 >> v2:172.21.15.107:3300/0 conn(0x7fab440ad2b0 0x7fab4415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab43e00640 1 -- 172.21.15.59:0/1370111500 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 784041506 0 0) 0x7fab440ad770 con 0x7fab441569e0 2024-05-30T17:06:28.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab43e00640 1 -- 172.21.15.59:0/1370111500 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab2c003530 con 0x7fab441569e0 2024-05-30T17:06:28.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab4a600640 1 -- 172.21.15.59:0/1370111500 >> v2:172.21.15.107:3300/0 conn(0x7fab440ad2b0 msgr2=0x7fab4415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:28.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab4a600640 1 --2- 172.21.15.59:0/1370111500 >> v2:172.21.15.107:3300/0 conn(0x7fab440ad2b0 0x7fab4415d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:28.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab4a600640 1 -- 172.21.15.59:0/1370111500 >> v1:172.21.15.59:6789/0 conn(0x7fab441569e0 legacy=0x7fab440cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:28.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.696+0000 7fab4a600640 1 -- 172.21.15.59:0/1370111500 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4415ce20 con 0x7fab440d0660 2024-05-30T17:06:28.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab4a600640 1 --2- 172.21.15.59:0/1370111500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab440d0660 0x7fab440d0ad0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fab440b4c10 tx=0x7fab3c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3483b6b294ba29b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab43e00640 1 -- 172.21.15.59:0/1370111500 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c0b2070 con 0x7fab440d0660 2024-05-30T17:06:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab43e00640 1 -- 172.21.15.59:0/1370111500 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c0a57e0 con 0x7fab440d0660 2024-05-30T17:06:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab43e00640 1 -- 172.21.15.59:0/1370111500 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c0a5bb0 con 0x7fab440d0660 2024-05-30T17:06:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab4c600640 1 -- 172.21.15.59:0/1370111500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab440d0660 msgr2=0x7fab440d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab4c600640 1 --2- 172.21.15.59:0/1370111500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab440d0660 0x7fab440d0ad0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fab440b4c10 tx=0x7fab3c01c8a0 comp rx=0 tx=0).stop 2024-05-30T17:06:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab4c600640 1 -- 172.21.15.59:0/1370111500 shutdown_connections 2024-05-30T17:06:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab4c600640 1 --2- 172.21.15.59:0/1370111500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab440d0660 0x7fab440d0ad0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab4c600640 1 --2- 172.21.15.59:0/1370111500 >> v2:172.21.15.107:3300/0 conn(0x7fab440ad2b0 0x7fab4415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab4c600640 1 -- 172.21.15.59:0/1370111500 >> 172.21.15.59:0/1370111500 conn(0x7fab4406bdb0 msgr2=0x7fab4406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab4c600640 1 -- 172.21.15.59:0/1370111500 shutdown_connections 2024-05-30T17:06:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab4c600640 1 -- 172.21.15.59:0/1370111500 wait complete. 2024-05-30T17:06:28.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab4c600640 1 Processor -- start 2024-05-30T17:06:28.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.700+0000 7fab4c600640 1 -- start start 2024-05-30T17:06:28.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab4c600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab440ad2b0 0x7fab4414c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:28.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab4c600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab440d0660 0x7fab4415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:28.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab4c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab441569e0 0x7fab4415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:28.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab4c600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fab440b3c60 con 0x7fab440ad2b0 2024-05-30T17:06:28.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab4c600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fab440b3ae0 con 0x7fab440d0660 2024-05-30T17:06:28.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab4c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fab440b3de0 con 0x7fab441569e0 2024-05-30T17:06:28.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab49c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab440ad2b0 0x7fab4414c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:28.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab49c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab440ad2b0 0x7fab4414c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58806/0 (socket says 172.21.15.59:58806) 2024-05-30T17:06:28.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab49c00640 1 -- 172.21.15.59:0/2302687946 learned_addr learned my addr 172.21.15.59:0/2302687946 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:28.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab4a600640 1 --2- 172.21.15.59:0/2302687946 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab441569e0 0x7fab4415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:28.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab49200640 1 --2- 172.21.15.59:0/2302687946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab440d0660 0x7fab4415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:28.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab49c00640 1 -- 172.21.15.59:0/2302687946 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab441569e0 msgr2=0x7fab4415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:28.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab49c00640 1 --2- 172.21.15.59:0/2302687946 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab441569e0 0x7fab4415b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:28.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab49c00640 1 -- 172.21.15.59:0/2302687946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab440d0660 msgr2=0x7fab4415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:28.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab49c00640 1 --2- 172.21.15.59:0/2302687946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab440d0660 0x7fab4415b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:28.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab49c00640 1 -- 172.21.15.59:0/2302687946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4406dc10 con 0x7fab440ad2b0 2024-05-30T17:06:28.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab49c00640 1 --2- 172.21.15.59:0/2302687946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab440ad2b0 0x7fab4414c030 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fab3800c3c0 tx=0x7fab3800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:28.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab41600640 1 -- 172.21.15.59:0/2302687946 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38017070 con 0x7fab440ad2b0 2024-05-30T17:06:28.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab41600640 1 -- 172.21.15.59:0/2302687946 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab38005cf0 con 0x7fab440ad2b0 2024-05-30T17:06:28.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab41600640 1 -- 172.21.15.59:0/2302687946 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab380072f0 con 0x7fab440ad2b0 2024-05-30T17:06:28.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab4c600640 1 -- 172.21.15.59:0/2302687946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4406deb0 con 0x7fab440ad2b0 2024-05-30T17:06:28.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab4c600640 1 -- 172.21.15.59:0/2302687946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab4406e470 con 0x7fab440ad2b0 2024-05-30T17:06:28.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.704+0000 7fab4c600640 1 -- 172.21.15.59:0/2302687946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab44068a90 con 0x7fab440ad2b0 2024-05-30T17:06:28.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.708+0000 7fab41600640 1 -- 172.21.15.59:0/2302687946 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 45) ==== 90996+0+0 (secure 0 0 0) 0x7fab3801a070 con 0x7fab440ad2b0 2024-05-30T17:06:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.708+0000 7fab41600640 1 --2- 172.21.15.59:0/2302687946 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fab2406a500 0x7fab2406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.708+0000 7fab41600640 1 -- 172.21.15.59:0/2302687946 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fab38084e30 con 0x7fab440ad2b0 2024-05-30T17:06:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.708+0000 7fab49200640 1 --2- 172.21.15.59:0/2302687946 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fab2406a500 0x7fab2406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:28.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.708+0000 7fab49200640 1 --2- 172.21.15.59:0/2302687946 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fab2406a500 0x7fab2406c9c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fab30007a60 tx=0x7fab30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:28.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.712+0000 7fab41600640 1 -- 172.21.15.59:0/2302687946 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fab38056880 con 0x7fab440ad2b0 2024-05-30T17:06:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.908+0000 7fab4c600640 1 -- 172.21.15.59:0/2302687946 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab44072790 con 0x7fab2406a500 2024-05-30T17:06:28.916 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:28.915+0000 7efd6da00640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T17:06:28.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:28.916+0000 7fab41600640 1 -- 172.21.15.59:0/2302687946 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7fab44072790 con 0x7fab2406a500 2024-05-30T17:06:28.916 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:06:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T17:06:28.926 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T17:06:34.927 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:06:35.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.084+0000 7f79e6400640 1 Processor -- start 2024-05-30T17:06:35.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.084+0000 7f79e6400640 1 -- start start 2024-05-30T17:06:35.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.084+0000 7f79e6400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79e00ad2b0 0x7f79e015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:35.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.084+0000 7f79e6400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79e00d0660 0x7f79e00d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:35.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.084+0000 7f79e6400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e00ad770 con 0x7f79e01569e0 2024-05-30T17:06:35.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.084+0000 7f79e6400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f79e015cb40 con 0x7f79e00d0660 2024-05-30T17:06:35.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.084+0000 7f79e6400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f79e015ce20 con 0x7f79e00ad2b0 2024-05-30T17:06:35.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79dfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79e00d0660 0x7f79e00d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:35.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79df400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f79e01569e0 0x7f79e00cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32934/0 (socket says 172.21.15.59:32934) 2024-05-30T17:06:35.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79df400640 1 -- 172.21.15.59:0/142441526 learned_addr learned my addr 172.21.15.59:0/142441526 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:06:35.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79d6a00640 1 --2- 172.21.15.59:0/142441526 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79e00ad2b0 0x7f79e015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:35.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79dfe00640 1 -- 172.21.15.59:0/142441526 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79e00ad2b0 msgr2=0x7f79e015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:35.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79dfe00640 1 --2- 172.21.15.59:0/142441526 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79e00ad2b0 0x7f79e015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:35.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79dfe00640 1 -- 172.21.15.59:0/142441526 >> v1:172.21.15.59:6789/0 conn(0x7f79e01569e0 legacy=0x7f79e00cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:35.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79dea00640 1 -- 172.21.15.59:0/142441526 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 803762059 0 0) 0x7f79e00ad770 con 0x7f79e01569e0 2024-05-30T17:06:35.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79dfe00640 1 -- 172.21.15.59:0/142441526 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e015d100 con 0x7f79e00d0660 2024-05-30T17:06:35.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79dfe00640 1 --2- 172.21.15.59:0/142441526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e00d0660 0x7f79e00d0af0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009d90 tx=0x7f79d801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a45fcad68882f41 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:35.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79dea00640 1 -- 172.21.15.59:0/142441526 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d80b2070 con 0x7f79e00d0660 2024-05-30T17:06:35.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79dea00640 1 -- 172.21.15.59:0/142441526 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d80a57a0 con 0x7f79e00d0660 2024-05-30T17:06:35.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.088+0000 7f79dea00640 1 -- 172.21.15.59:0/142441526 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d80a5b70 con 0x7f79e00d0660 2024-05-30T17:06:35.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 -- 172.21.15.59:0/142441526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e00d0660 msgr2=0x7f79e00d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:35.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 --2- 172.21.15.59:0/142441526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e00d0660 0x7f79e00d0af0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009d90 tx=0x7f79d801c8e0 comp rx=0 tx=0).stop 2024-05-30T17:06:35.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 -- 172.21.15.59:0/142441526 shutdown_connections 2024-05-30T17:06:35.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 --2- 172.21.15.59:0/142441526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e00d0660 0x7f79e00d0af0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:35.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 --2- 172.21.15.59:0/142441526 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79e00ad2b0 0x7f79e015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:35.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 -- 172.21.15.59:0/142441526 >> 172.21.15.59:0/142441526 conn(0x7f79e006bdb0 msgr2=0x7f79e006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:35.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 -- 172.21.15.59:0/142441526 shutdown_connections 2024-05-30T17:06:35.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 -- 172.21.15.59:0/142441526 wait complete. 2024-05-30T17:06:35.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 Processor -- start 2024-05-30T17:06:35.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 -- start start 2024-05-30T17:06:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79e00ad2b0 0x7f79e014c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e00d0660 0x7f79e014f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79e01569e0 0x7f79e014f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f79e00b3e70 con 0x7f79e00d0660 2024-05-30T17:06:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f79e00b3cf0 con 0x7f79e00ad2b0 2024-05-30T17:06:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79e6400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f79e00b3ff0 con 0x7f79e01569e0 2024-05-30T17:06:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79d6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e00d0660 0x7f79e014f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79d6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e00d0660 0x7f79e014f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57740/0 (socket says 172.21.15.59:57740) 2024-05-30T17:06:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79d6a00640 1 -- 172.21.15.59:0/792755609 learned_addr learned my addr 172.21.15.59:0/792755609 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79d6a00640 1 -- 172.21.15.59:0/792755609 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79e01569e0 msgr2=0x7f79e014f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79d6a00640 1 --2- 172.21.15.59:0/792755609 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79e01569e0 0x7f79e014f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79d6a00640 1 -- 172.21.15.59:0/792755609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79e00ad2b0 msgr2=0x7f79e014c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79d6a00640 1 --2- 172.21.15.59:0/792755609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79e00ad2b0 0x7f79e014c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.092+0000 7f79d6a00640 1 -- 172.21.15.59:0/792755609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e00b1fa0 con 0x7f79e00d0660 2024-05-30T17:06:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.096+0000 7f79d6a00640 1 --2- 172.21.15.59:0/792755609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e00d0660 0x7f79e014f090 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f79c800d5f0 tx=0x7f79c800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.096+0000 7f79d7e00640 1 -- 172.21.15.59:0/792755609 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c80125f0 con 0x7f79e00d0660 2024-05-30T17:06:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.096+0000 7f79d7e00640 1 -- 172.21.15.59:0/792755609 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c8019070 con 0x7f79e00d0660 2024-05-30T17:06:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.096+0000 7f79d7e00640 1 -- 172.21.15.59:0/792755609 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c80129b0 con 0x7f79e00d0660 2024-05-30T17:06:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.096+0000 7f79e6400640 1 -- 172.21.15.59:0/792755609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e00b2280 con 0x7f79e00d0660 2024-05-30T17:06:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.096+0000 7f79e6400640 1 -- 172.21.15.59:0/792755609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e00b2840 con 0x7f79e00d0660 2024-05-30T17:06:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.096+0000 7f79e6400640 1 -- 172.21.15.59:0/792755609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e0068a90 con 0x7f79e00d0660 2024-05-30T17:06:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.096+0000 7f79d7e00640 1 -- 172.21.15.59:0/792755609 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 45) ==== 90996+0+0 (secure 0 0 0) 0x7f79c8012b50 con 0x7f79e00d0660 2024-05-30T17:06:35.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.096+0000 7f79d7e00640 1 --2- 172.21.15.59:0/792755609 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f79bc06a4e0 0x7f79bc06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:35.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.096+0000 7f79d7e00640 1 -- 172.21.15.59:0/792755609 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f79c8085f00 con 0x7f79e00d0660 2024-05-30T17:06:35.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.100+0000 7f79df400640 1 --2- 172.21.15.59:0/792755609 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f79bc06a4e0 0x7f79bc06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:35.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.100+0000 7f79df400640 1 --2- 172.21.15.59:0/792755609 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f79bc06a4e0 0x7f79bc06c9a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f79d00011f0 tx=0x7f79d0007930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:35.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.104+0000 7f79d7e00640 1 -- 172.21.15.59:0/792755609 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f79c8057f20 con 0x7f79e00d0660 2024-05-30T17:06:35.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.296+0000 7f79e6400640 1 -- 172.21.15.59:0/792755609 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79e014c7a0 con 0x7f79bc06a4e0 2024-05-30T17:06:35.304 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:35.303+0000 7efd6da00640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T17:06:35.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:35.304+0000 7f79d7e00640 1 -- 172.21.15.59:0/792755609 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7f79d00070d0 con 0x7f79bc06a4e0 2024-05-30T17:06:35.305 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:06:35.306 INFO:teuthology.orchestra.run.smithi059.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T17:06:35.314 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T17:06:36.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:06:36.795 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:06:41.315 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:06:41.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.472+0000 7eff28200640 1 Processor -- start 2024-05-30T17:06:41.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.472+0000 7eff28200640 1 -- start start 2024-05-30T17:06:41.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff28200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7eff20159100 0x7eff2006e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:41.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff28200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff2015c010 0x7eff2015c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:41.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff28200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff200b52d0 con 0x7eff200b44e0 2024-05-30T17:06:41.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff28200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7eff200b4a30 con 0x7eff2015c010 2024-05-30T17:06:41.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff28200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7eff200b4d10 con 0x7eff20159100 2024-05-30T17:06:41.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff26200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff2015c010 0x7eff2015c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:41.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff26200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff2015c010 0x7eff2015c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57750/0 (socket says 172.21.15.59:57750) 2024-05-30T17:06:41.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff26200640 1 -- 172.21.15.59:0/947839194 learned_addr learned my addr 172.21.15.59:0/947839194 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:41.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff25800640 1 --2- 172.21.15.59:0/947839194 >> v2:172.21.15.107:3300/0 conn(0x7eff20159100 0x7eff2006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:41.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff26200640 1 -- 172.21.15.59:0/947839194 >> v2:172.21.15.107:3300/0 conn(0x7eff20159100 msgr2=0x7eff2006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:41.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff26200640 1 --2- 172.21.15.59:0/947839194 >> v2:172.21.15.107:3300/0 conn(0x7eff20159100 0x7eff2006e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:41.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff26200640 1 -- 172.21.15.59:0/947839194 >> v1:172.21.15.107:6789/0 conn(0x7eff200b44e0 legacy=0x7eff2015efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:41.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.476+0000 7eff26200640 1 -- 172.21.15.59:0/947839194 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff200b4ff0 con 0x7eff2015c010 2024-05-30T17:06:41.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff26200640 1 --2- 172.21.15.59:0/947839194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2015c010 0x7eff2015c440 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7eff2006c8f0 tx=0x7eff1801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97820f28595c8229 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:41.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff1fe00640 1 -- 172.21.15.59:0/947839194 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff180a5710 con 0x7eff2015c010 2024-05-30T17:06:41.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff1fe00640 1 -- 172.21.15.59:0/947839194 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff180a58b0 con 0x7eff2015c010 2024-05-30T17:06:41.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff1fe00640 1 -- 172.21.15.59:0/947839194 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff180a5c80 con 0x7eff2015c010 2024-05-30T17:06:41.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff28200640 1 -- 172.21.15.59:0/947839194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2015c010 msgr2=0x7eff2015c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:41.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff28200640 1 --2- 172.21.15.59:0/947839194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2015c010 0x7eff2015c440 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7eff2006c8f0 tx=0x7eff1801c960 comp rx=0 tx=0).stop 2024-05-30T17:06:41.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff28200640 1 -- 172.21.15.59:0/947839194 shutdown_connections 2024-05-30T17:06:41.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff28200640 1 --2- 172.21.15.59:0/947839194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2015c010 0x7eff2015c440 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:41.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff28200640 1 --2- 172.21.15.59:0/947839194 >> v2:172.21.15.107:3300/0 conn(0x7eff20159100 0x7eff2006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:41.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff28200640 1 -- 172.21.15.59:0/947839194 >> 172.21.15.59:0/947839194 conn(0x7eff2006bdb0 msgr2=0x7eff2006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:41.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff28200640 1 -- 172.21.15.59:0/947839194 shutdown_connections 2024-05-30T17:06:41.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff28200640 1 -- 172.21.15.59:0/947839194 wait complete. 2024-05-30T17:06:41.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff28200640 1 Processor -- start 2024-05-30T17:06:41.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.480+0000 7eff28200640 1 -- start start 2024-05-30T17:06:41.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff28200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff200b44e0 0x7eff200b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:41.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff28200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff20159100 0x7eff2015d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:41.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff28200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff2015c010 0x7eff2015df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:41.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff28200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff201682c0 con 0x7eff20159100 2024-05-30T17:06:41.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff28200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7eff20168140 con 0x7eff2015c010 2024-05-30T17:06:41.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff28200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7eff20168440 con 0x7eff200b44e0 2024-05-30T17:06:41.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff24e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff20159100 0x7eff2015d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:41.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff24e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff20159100 0x7eff2015d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57756/0 (socket says 172.21.15.59:57756) 2024-05-30T17:06:41.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff24e00640 1 -- 172.21.15.59:0/3228092803 learned_addr learned my addr 172.21.15.59:0/3228092803 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff26200640 1 --2- 172.21.15.59:0/3228092803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff2015c010 0x7eff2015df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff25800640 1 --2- 172.21.15.59:0/3228092803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff200b44e0 0x7eff200b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff24e00640 1 -- 172.21.15.59:0/3228092803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff200b44e0 msgr2=0x7eff200b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff24e00640 1 --2- 172.21.15.59:0/3228092803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff200b44e0 0x7eff200b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff24e00640 1 -- 172.21.15.59:0/3228092803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff2015c010 msgr2=0x7eff2015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff24e00640 1 --2- 172.21.15.59:0/3228092803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff2015c010 0x7eff2015df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff24e00640 1 -- 172.21.15.59:0/3228092803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff20156810 con 0x7eff20159100 2024-05-30T17:06:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff24e00640 1 --2- 172.21.15.59:0/3228092803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff20159100 0x7eff2015d9e0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00c370 tx=0x7eff0c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff1d600640 1 -- 172.21.15.59:0/3228092803 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0052d0 con 0x7eff20159100 2024-05-30T17:06:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff1d600640 1 -- 172.21.15.59:0/3228092803 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff0c005470 con 0x7eff20159100 2024-05-30T17:06:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff1d600640 1 -- 172.21.15.59:0/3228092803 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c007260 con 0x7eff20159100 2024-05-30T17:06:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff28200640 1 -- 172.21.15.59:0/3228092803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff200b2c00 con 0x7eff20159100 2024-05-30T17:06:41.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff28200640 1 -- 172.21.15.59:0/3228092803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff20156d90 con 0x7eff20159100 2024-05-30T17:06:41.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.484+0000 7eff28200640 1 -- 172.21.15.59:0/3228092803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff20068a90 con 0x7eff20159100 2024-05-30T17:06:41.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.488+0000 7eff1d600640 1 -- 172.21.15.59:0/3228092803 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 45) ==== 90996+0+0 (secure 0 0 0) 0x7eff0c007400 con 0x7eff20159100 2024-05-30T17:06:41.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.488+0000 7eff1d600640 1 --2- 172.21.15.59:0/3228092803 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff0006a4b0 0x7eff0006c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:41.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.488+0000 7eff1d600640 1 -- 172.21.15.59:0/3228092803 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7eff0c084f10 con 0x7eff20159100 2024-05-30T17:06:41.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.488+0000 7eff25800640 1 --2- 172.21.15.59:0/3228092803 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff0006a4b0 0x7eff0006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:41.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.488+0000 7eff25800640 1 --2- 172.21.15.59:0/3228092803 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7eff0006a4b0 0x7eff0006c970 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7eff14009ac0 tx=0x7eff14009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:41.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.492+0000 7eff1d600640 1 -- 172.21.15.59:0/3228092803 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7eff0c0568e0 con 0x7eff20159100 2024-05-30T17:06:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.688+0000 7eff28200640 1 -- 172.21.15.59:0/3228092803 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff20165c30 con 0x7eff0006a4b0 2024-05-30T17:06:41.696 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:41.695+0000 7efd6da00640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T17:06:41.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:41.696+0000 7eff1d600640 1 -- 172.21.15.59:0/3228092803 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7eff20165c30 con 0x7eff0006a4b0 2024-05-30T17:06:41.697 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:06:41.697 INFO:teuthology.orchestra.run.smithi059.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T17:06:41.706 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T17:06:47.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:06:47.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.855+0000 7efc34e00640 1 Processor -- start 2024-05-30T17:06:47.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.855+0000 7efc34e00640 1 -- start start 2024-05-30T17:06:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.859+0000 7efc34e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efc300ad2b0 0x7efc3015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.859+0000 7efc34e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc300ad770 con 0x7efc301569e0 2024-05-30T17:06:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.859+0000 7efc34e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc3015cb40 con 0x7efc300d0660 2024-05-30T17:06:47.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.859+0000 7efc34e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7efc3015ce20 con 0x7efc300ad2b0 2024-05-30T17:06:47.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.859+0000 7efc2de00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efc301569e0 0x7efc300cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60294/0 (socket says 172.21.15.59:60294) 2024-05-30T17:06:47.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.859+0000 7efc2de00640 1 -- 172.21.15.59:0/3255118884 learned_addr learned my addr 172.21.15.59:0/3255118884 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:06:47.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.859+0000 7efc27e00640 1 --2- 172.21.15.59:0/3255118884 >> v2:172.21.15.107:3300/0 conn(0x7efc300ad2b0 0x7efc3015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:47.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.859+0000 7efc2d400640 1 -- 172.21.15.59:0/3255118884 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 312185359 0 0) 0x7efc300ad770 con 0x7efc301569e0 2024-05-30T17:06:47.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.859+0000 7efc2d400640 1 -- 172.21.15.59:0/3255118884 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc14003530 con 0x7efc301569e0 2024-05-30T17:06:47.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.859+0000 7efc27e00640 1 -- 172.21.15.59:0/3255118884 >> v1:172.21.15.107:6789/0 conn(0x7efc300d0660 legacy=0x7efc300b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:47.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.859+0000 7efc27e00640 1 -- 172.21.15.59:0/3255118884 >> v1:172.21.15.59:6789/0 conn(0x7efc301569e0 legacy=0x7efc300cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:47.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.859+0000 7efc27e00640 1 -- 172.21.15.59:0/3255118884 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3015d100 con 0x7efc300ad2b0 2024-05-30T17:06:47.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc27e00640 1 --2- 172.21.15.59:0/3255118884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc300ad2b0 0x7efc3015d620 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efc180097c0 tx=0x7efc1801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6463503dda084b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:47.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc2d400640 1 -- 172.21.15.59:0/3255118884 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc180b0070 con 0x7efc300ad2b0 2024-05-30T17:06:47.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc2d400640 1 -- 172.21.15.59:0/3255118884 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc180ab600 con 0x7efc300ad2b0 2024-05-30T17:06:47.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc2d400640 1 -- 172.21.15.59:0/3255118884 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc180ab9b0 con 0x7efc300ad2b0 2024-05-30T17:06:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 -- 172.21.15.59:0/3255118884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc300ad2b0 msgr2=0x7efc3015d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 --2- 172.21.15.59:0/3255118884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc300ad2b0 0x7efc3015d620 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efc180097c0 tx=0x7efc1801c410 comp rx=0 tx=0).stop 2024-05-30T17:06:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 -- 172.21.15.59:0/3255118884 shutdown_connections 2024-05-30T17:06:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 --2- 172.21.15.59:0/3255118884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc300ad2b0 0x7efc3015d620 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 -- 172.21.15.59:0/3255118884 >> 172.21.15.59:0/3255118884 conn(0x7efc3006bdb0 msgr2=0x7efc3006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 -- 172.21.15.59:0/3255118884 shutdown_connections 2024-05-30T17:06:47.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 -- 172.21.15.59:0/3255118884 wait complete. 2024-05-30T17:06:47.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 Processor -- start 2024-05-30T17:06:47.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 -- start start 2024-05-30T17:06:47.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc300ad2b0 0x7efc301f7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:47.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc300d0660 0x7efc300b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:47.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc301569e0 0x7efc301fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:47.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efc3016a340 con 0x7efc300ad2b0 2024-05-30T17:06:47.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efc3016a1c0 con 0x7efc301569e0 2024-05-30T17:06:47.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc34e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efc3016a4c0 con 0x7efc300d0660 2024-05-30T17:06:47.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc2de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc300ad2b0 0x7efc301f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc2de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc300ad2b0 0x7efc301f7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54176/0 (socket says 172.21.15.59:54176) 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.863+0000 7efc2de00640 1 -- 172.21.15.59:0/1704838217 learned_addr learned my addr 172.21.15.59:0/1704838217 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc27e00640 1 --2- 172.21.15.59:0/1704838217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc300d0660 0x7efc300b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc2e800640 1 --2- 172.21.15.59:0/1704838217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc301569e0 0x7efc301fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc2de00640 1 -- 172.21.15.59:0/1704838217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc300d0660 msgr2=0x7efc300b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc2de00640 1 --2- 172.21.15.59:0/1704838217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc300d0660 0x7efc300b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc2de00640 1 -- 172.21.15.59:0/1704838217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc301569e0 msgr2=0x7efc301fa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc2de00640 1 --2- 172.21.15.59:0/1704838217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc301569e0 0x7efc301fa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc2de00640 1 -- 172.21.15.59:0/1704838217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3014c460 con 0x7efc300ad2b0 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc27e00640 1 --2- 172.21.15.59:0/1704838217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc300d0660 0x7efc300b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc2de00640 1 --2- 172.21.15.59:0/1704838217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc300ad2b0 0x7efc301f7540 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7efc2000c4d0 tx=0x7efc2000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc26000640 1 -- 172.21.15.59:0/1704838217 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20017070 con 0x7efc300ad2b0 2024-05-30T17:06:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc26000640 1 -- 172.21.15.59:0/1704838217 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc20005cf0 con 0x7efc300ad2b0 2024-05-30T17:06:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc26000640 1 -- 172.21.15.59:0/1704838217 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20007270 con 0x7efc300ad2b0 2024-05-30T17:06:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc34e00640 1 -- 172.21.15.59:0/1704838217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3014c740 con 0x7efc300ad2b0 2024-05-30T17:06:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc34e00640 1 -- 172.21.15.59:0/1704838217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3014cfe0 con 0x7efc300ad2b0 2024-05-30T17:06:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc34e00640 1 -- 172.21.15.59:0/1704838217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3014c910 con 0x7efc300ad2b0 2024-05-30T17:06:47.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.867+0000 7efc26000640 1 -- 172.21.15.59:0/1704838217 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7efc2001a070 con 0x7efc300ad2b0 2024-05-30T17:06:47.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.871+0000 7efc26000640 1 --2- 172.21.15.59:0/1704838217 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efc0c06a180 0x7efc0c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:47.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.871+0000 7efc26000640 1 -- 172.21.15.59:0/1704838217 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7efc20084cd0 con 0x7efc300ad2b0 2024-05-30T17:06:47.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.871+0000 7efc27e00640 1 --2- 172.21.15.59:0/1704838217 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efc0c06a180 0x7efc0c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:47.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.871+0000 7efc27e00640 1 --2- 172.21.15.59:0/1704838217 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7efc0c06a180 0x7efc0c06c640 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7efc180ad000 tx=0x7efc180a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:47.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:47.875+0000 7efc26000640 1 -- 172.21.15.59:0/1704838217 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efc200566a0 con 0x7efc300ad2b0 2024-05-30T17:06:48.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:48.067+0000 7efc34e00640 1 -- 172.21.15.59:0/1704838217 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc3014cb40 con 0x7efc0c06a180 2024-05-30T17:06:48.077 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:48.075+0000 7efd6da00640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T17:06:48.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:48.075+0000 7efc26000640 1 -- 172.21.15.59:0/1704838217 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7efc180b1040 con 0x7efc0c06a180 2024-05-30T17:06:48.077 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:06:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T17:06:48.086 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T17:06:54.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:06:54.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.243+0000 7fe621c00640 1 Processor -- start 2024-05-30T17:06:54.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621c00640 1 -- start start 2024-05-30T17:06:54.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe61c15a270 0x7fe61c0b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:54.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe61c0d19b0 0x7fe61c160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:54.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe61c0d1e10 0x7fe61c160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:54.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe61c160f90 con 0x7fe61c0d1e10 2024-05-30T17:06:54.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe61c09ae20 con 0x7fe61c15a270 2024-05-30T17:06:54.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe61c09b100 con 0x7fe61c0d19b0 2024-05-30T17:06:54.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe61c0d1e10 0x7fe61c160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:54.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe61c0d1e10 0x7fe61c160680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46056/0 (socket says 172.21.15.59:46056) 2024-05-30T17:06:54.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621200640 1 -- 172.21.15.59:0/3127100012 learned_addr learned my addr 172.21.15.59:0/3127100012 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:54.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe61be00640 1 --2- 172.21.15.59:0/3127100012 >> v2:172.21.15.107:3300/0 conn(0x7fe61c15a270 0x7fe61c0b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:54.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe613e00640 1 --2- 172.21.15.59:0/3127100012 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe61c0d19b0 0x7fe61c160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:54.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621200640 1 -- 172.21.15.59:0/3127100012 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe61c0d19b0 msgr2=0x7fe61c160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:54.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621200640 1 --2- 172.21.15.59:0/3127100012 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe61c0d19b0 0x7fe61c160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:54.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621200640 1 -- 172.21.15.59:0/3127100012 >> v2:172.21.15.107:3300/0 conn(0x7fe61c15a270 msgr2=0x7fe61c0b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:06:54.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621200640 1 --2- 172.21.15.59:0/3127100012 >> v2:172.21.15.107:3300/0 conn(0x7fe61c15a270 0x7fe61c0b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:54.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.247+0000 7fe621200640 1 -- 172.21.15.59:0/3127100012 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61c09b3e0 con 0x7fe61c0d1e10 2024-05-30T17:06:54.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe621200640 1 --2- 172.21.15.59:0/3127100012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe61c0d1e10 0x7fe61c160680 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fe614009e50 tx=0x7fe61401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facaf5e25a81ce5c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe61b400640 1 -- 172.21.15.59:0/3127100012 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6140a5890 con 0x7fe61c0d1e10 2024-05-30T17:06:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe61b400640 1 -- 172.21.15.59:0/3127100012 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6140a5a30 con 0x7fe61c0d1e10 2024-05-30T17:06:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe61b400640 1 -- 172.21.15.59:0/3127100012 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6140a5e00 con 0x7fe61c0d1e10 2024-05-30T17:06:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe621c00640 1 -- 172.21.15.59:0/3127100012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe61c0d1e10 msgr2=0x7fe61c160680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe621c00640 1 --2- 172.21.15.59:0/3127100012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe61c0d1e10 0x7fe61c160680 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fe614009e50 tx=0x7fe61401c9f0 comp rx=0 tx=0).stop 2024-05-30T17:06:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe621c00640 1 -- 172.21.15.59:0/3127100012 shutdown_connections 2024-05-30T17:06:54.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe621c00640 1 --2- 172.21.15.59:0/3127100012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe61c0d1e10 0x7fe61c160680 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:54.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe621c00640 1 --2- 172.21.15.59:0/3127100012 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe61c0d19b0 0x7fe61c160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:54.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe621c00640 1 --2- 172.21.15.59:0/3127100012 >> v2:172.21.15.107:3300/0 conn(0x7fe61c15a270 0x7fe61c0b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:54.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe621c00640 1 -- 172.21.15.59:0/3127100012 >> 172.21.15.59:0/3127100012 conn(0x7fe61c0b3ed0 msgr2=0x7fe61c0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:06:54.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe621c00640 1 -- 172.21.15.59:0/3127100012 shutdown_connections 2024-05-30T17:06:54.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe621c00640 1 -- 172.21.15.59:0/3127100012 wait complete. 2024-05-30T17:06:54.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe621c00640 1 Processor -- start 2024-05-30T17:06:54.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.251+0000 7fe621c00640 1 -- start start 2024-05-30T17:06:54.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe61c0d19b0 0x7fe61c14eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:54.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe61c0d1e10 0x7fe61c1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:54.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe61c15a270 0x7fe61c1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:54.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c0cf970 con 0x7fe61c15a270 2024-05-30T17:06:54.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c0cf7f0 con 0x7fe61c0d19b0 2024-05-30T17:06:54.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe61c0cfaf0 con 0x7fe61c0d1e10 2024-05-30T17:06:54.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe61c15a270 0x7fe61c1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:54.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe61c15a270 0x7fe61c1588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46066/0 (socket says 172.21.15.59:46066) 2024-05-30T17:06:54.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621200640 1 -- 172.21.15.59:0/1748298697 learned_addr learned my addr 172.21.15.59:0/1748298697 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:06:54.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe61be00640 1 --2- 172.21.15.59:0/1748298697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe61c0d19b0 0x7fe61c14eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:54.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe613e00640 1 --2- 172.21.15.59:0/1748298697 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe61c0d1e10 0x7fe61c1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:54.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621200640 1 -- 172.21.15.59:0/1748298697 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe61c0d1e10 msgr2=0x7fe61c1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:54.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621200640 1 --2- 172.21.15.59:0/1748298697 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe61c0d1e10 0x7fe61c1583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:54.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621200640 1 -- 172.21.15.59:0/1748298697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe61c0d19b0 msgr2=0x7fe61c14eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:06:54.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621200640 1 --2- 172.21.15.59:0/1748298697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe61c0d19b0 0x7fe61c14eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:06:54.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621200640 1 -- 172.21.15.59:0/1748298697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61c165680 con 0x7fe61c15a270 2024-05-30T17:06:54.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe613e00640 1 --2- 172.21.15.59:0/1748298697 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe61c0d1e10 0x7fe61c1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:06:54.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621200640 1 --2- 172.21.15.59:0/1748298697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe61c15a270 0x7fe61c1588f0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fe6140af040 tx=0x7fe614019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:54.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe618c00640 1 -- 172.21.15.59:0/1748298697 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6140b8670 con 0x7fe61c15a270 2024-05-30T17:06:54.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe618c00640 1 -- 172.21.15.59:0/1748298697 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6140be070 con 0x7fe61c15a270 2024-05-30T17:06:54.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe618c00640 1 -- 172.21.15.59:0/1748298697 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6140b8a70 con 0x7fe61c15a270 2024-05-30T17:06:54.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621c00640 1 -- 172.21.15.59:0/1748298697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61c15f780 con 0x7fe61c15a270 2024-05-30T17:06:54.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621c00640 1 -- 172.21.15.59:0/1748298697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe61c165920 con 0x7fe61c15a270 2024-05-30T17:06:54.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.255+0000 7fe621c00640 1 -- 172.21.15.59:0/1748298697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe61c068a90 con 0x7fe61c15a270 2024-05-30T17:06:54.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.259+0000 7fe618c00640 1 -- 172.21.15.59:0/1748298697 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7fe6140b8c10 con 0x7fe61c15a270 2024-05-30T17:06:54.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.259+0000 7fe618c00640 1 --2- 172.21.15.59:0/1748298697 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe5f806a150 0x7fe5f806c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:06:54.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.259+0000 7fe618c00640 1 -- 172.21.15.59:0/1748298697 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fe614120b00 con 0x7fe61c15a270 2024-05-30T17:06:54.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.259+0000 7fe61be00640 1 --2- 172.21.15.59:0/1748298697 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe5f806a150 0x7fe5f806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:06:54.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.259+0000 7fe61be00640 1 --2- 172.21.15.59:0/1748298697 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fe5f806a150 0x7fe5f806c610 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe60c007940 tx=0x7fe60c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:06:54.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.263+0000 7fe618c00640 1 -- 172.21.15.59:0/1748298697 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe6140165e0 con 0x7fe61c15a270 2024-05-30T17:06:54.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.459+0000 7fe621c00640 1 -- 172.21.15.59:0/1748298697 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe61c072690 con 0x7fe5f806a150 2024-05-30T17:06:54.469 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:06:54.467+0000 7efd6da00640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T17:06:54.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:06:54.467+0000 7fe618c00640 1 -- 172.21.15.59:0/1748298697 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7fe61c072690 con 0x7fe5f806a150 2024-05-30T17:06:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:06:54.470 INFO:teuthology.orchestra.run.smithi059.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T17:06:54.479 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T17:07:00.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:07:00.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f446ea00640 1 Processor -- start 2024-05-30T17:07:00.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f446ea00640 1 -- start start 2024-05-30T17:07:00.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f446ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44680d05b0 0x7f446809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:00.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f446ea00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4468070950 con 0x7f44680d14c0 2024-05-30T17:07:00.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f446ea00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4468070c30 con 0x7f446809af80 2024-05-30T17:07:00.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f446ea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4468070f10 con 0x7f44680d05b0 2024-05-30T17:07:00.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f4467e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f44680d14c0 0x7f446806e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51866/0 (socket says 172.21.15.59:51866) 2024-05-30T17:07:00.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f4467e00640 1 -- 172.21.15.59:0/3826283719 learned_addr learned my addr 172.21.15.59:0/3826283719 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:00.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f445fe00640 1 --2- 172.21.15.59:0/3826283719 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44680d05b0 0x7f446809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:00.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f4467400640 1 -- 172.21.15.59:0/3826283719 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 394196088 0 0) 0x7f4468070950 con 0x7f44680d14c0 2024-05-30T17:07:00.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f4467400640 1 -- 172.21.15.59:0/3826283719 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f444c003530 con 0x7f44680d14c0 2024-05-30T17:07:00.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f4467400640 1 -- 172.21.15.59:0/3826283719 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68799281 0 0) 0x7f4468070c30 con 0x7f446809af80 2024-05-30T17:07:00.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f4467400640 1 -- 172.21.15.59:0/3826283719 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4468070950 con 0x7f446809af80 2024-05-30T17:07:00.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f445fe00640 1 -- 172.21.15.59:0/3826283719 >> v1:172.21.15.107:6789/0 conn(0x7f446809af80 legacy=0x7f446806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:00.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f445fe00640 1 -- 172.21.15.59:0/3826283719 >> v1:172.21.15.59:6789/0 conn(0x7f44680d14c0 legacy=0x7f446806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:00.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.639+0000 7f445fe00640 1 -- 172.21.15.59:0/3826283719 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446806cbd0 con 0x7f44680d05b0 2024-05-30T17:07:00.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.643+0000 7f445fe00640 1 --2- 172.21.15.59:0/3826283719 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44680d05b0 0x7f446809aa40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f44500097f0 tx=0x7f445001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33842f8b088a9752 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:00.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.643+0000 7f4467400640 1 -- 172.21.15.59:0/3826283719 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44500ab5f0 con 0x7f44680d05b0 2024-05-30T17:07:00.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.643+0000 7f4467400640 1 -- 172.21.15.59:0/3826283719 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44500b0070 con 0x7f44680d05b0 2024-05-30T17:07:00.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.643+0000 7f4467400640 1 -- 172.21.15.59:0/3826283719 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44500ab9b0 con 0x7f44680d05b0 2024-05-30T17:07:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.643+0000 7f446ea00640 1 -- 172.21.15.59:0/3826283719 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44680d05b0 msgr2=0x7f446809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.643+0000 7f446ea00640 1 --2- 172.21.15.59:0/3826283719 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44680d05b0 0x7f446809aa40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f44500097f0 tx=0x7f445001c4e0 comp rx=0 tx=0).stop 2024-05-30T17:07:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.643+0000 7f446ea00640 1 -- 172.21.15.59:0/3826283719 shutdown_connections 2024-05-30T17:07:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.643+0000 7f446ea00640 1 --2- 172.21.15.59:0/3826283719 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44680d05b0 0x7f446809aa40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.643+0000 7f446ea00640 1 -- 172.21.15.59:0/3826283719 >> 172.21.15.59:0/3826283719 conn(0x7f44680b3f80 msgr2=0x7f44680b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.643+0000 7f446ea00640 1 -- 172.21.15.59:0/3826283719 shutdown_connections 2024-05-30T17:07:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.643+0000 7f446ea00640 1 -- 172.21.15.59:0/3826283719 wait complete. 2024-05-30T17:07:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f446ea00640 1 Processor -- start 2024-05-30T17:07:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f446ea00640 1 -- start start 2024-05-30T17:07:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f446ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446809af80 0x7f4468161810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f446ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44680d05b0 0x7f4468157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f446ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44680d14c0 0x7f44680cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f446ea00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f446806e190 con 0x7f446809af80 2024-05-30T17:07:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f446ea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f446806e010 con 0x7f44680d05b0 2024-05-30T17:07:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f446ea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f446806e310 con 0x7f44680d14c0 2024-05-30T17:07:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f4467e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446809af80 0x7f4468161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f4467e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446809af80 0x7f4468161810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46076/0 (socket says 172.21.15.59:46076) 2024-05-30T17:07:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f4467e00640 1 -- 172.21.15.59:0/286869311 learned_addr learned my addr 172.21.15.59:0/286869311 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f446ca00640 1 --2- 172.21.15.59:0/286869311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44680d14c0 0x7f44680cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f445fe00640 1 --2- 172.21.15.59:0/286869311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44680d05b0 0x7f4468157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f4467e00640 1 -- 172.21.15.59:0/286869311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44680d14c0 msgr2=0x7f44680cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f4467e00640 1 --2- 172.21.15.59:0/286869311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44680d14c0 0x7f44680cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f4467e00640 1 -- 172.21.15.59:0/286869311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44680d05b0 msgr2=0x7f4468157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f4467e00640 1 --2- 172.21.15.59:0/286869311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44680d05b0 0x7f4468157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f4467e00640 1 -- 172.21.15.59:0/286869311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4468162110 con 0x7f446809af80 2024-05-30T17:07:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f446ca00640 1 --2- 172.21.15.59:0/286869311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44680d14c0 0x7f44680cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f445fe00640 1 --2- 172.21.15.59:0/286869311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44680d05b0 0x7f4468157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f4467e00640 1 --2- 172.21.15.59:0/286869311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446809af80 0x7f4468161810 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f445800c420 tx=0x7f445800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f4464c00640 1 -- 172.21.15.59:0/286869311 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458017070 con 0x7f446809af80 2024-05-30T17:07:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f4464c00640 1 -- 172.21.15.59:0/286869311 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4458005cf0 con 0x7f446809af80 2024-05-30T17:07:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f4464c00640 1 -- 172.21.15.59:0/286869311 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458007310 con 0x7f446809af80 2024-05-30T17:07:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f446ea00640 1 -- 172.21.15.59:0/286869311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446815ca30 con 0x7f446809af80 2024-05-30T17:07:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.647+0000 7f446ea00640 1 -- 172.21.15.59:0/286869311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446815d510 con 0x7f446809af80 2024-05-30T17:07:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.651+0000 7f446ea00640 1 -- 172.21.15.59:0/286869311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4468068a90 con 0x7f446809af80 2024-05-30T17:07:00.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.651+0000 7f4464c00640 1 -- 172.21.15.59:0/286869311 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f445801a070 con 0x7f446809af80 2024-05-30T17:07:00.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.651+0000 7f4464c00640 1 --2- 172.21.15.59:0/286869311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f444406a150 0x7f444406c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:00.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.651+0000 7f4464c00640 1 -- 172.21.15.59:0/286869311 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f4458084e70 con 0x7f446809af80 2024-05-30T17:07:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.651+0000 7f445fe00640 1 --2- 172.21.15.59:0/286869311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f444406a150 0x7f444406c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.651+0000 7f445fe00640 1 --2- 172.21.15.59:0/286869311 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f444406a150 0x7f444406c610 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f44500af000 tx=0x7f44500a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.655+0000 7f4464c00640 1 -- 172.21.15.59:0/286869311 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4458056e90 con 0x7f446809af80 2024-05-30T17:07:00.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.855+0000 7f446ea00640 1 -- 172.21.15.59:0/286869311 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44680d2270 con 0x7f444406a150 2024-05-30T17:07:00.863 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:07:00.862+0000 7efd6da00640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T17:07:00.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:00.863+0000 7f4464c00640 1 -- 172.21.15.59:0/286869311 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7f44680d2270 con 0x7f444406a150 2024-05-30T17:07:00.864 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:07:00.864 INFO:teuthology.orchestra.run.smithi059.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T17:07:00.872 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T17:07:00.876 INFO:tasks.cephfs_test_runner:Test that both the progress bars, that are printed for all 7 clone ... ERROR 2024-05-30T17:07:00.876 INFO:tasks.cephfs_test_runner: 2024-05-30T17:07:00.876 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-30T17:07:00.877 INFO:tasks.cephfs_test_runner:ERROR: test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T17:07:00.877 INFO:tasks.cephfs_test_runner:Test that both the progress bars, that are printed for all 7 clone 2024-05-30T17:07:00.877 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-30T17:07:00.877 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-30T17:07:00.877 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks/cephfs/test_volumes.py", line 7795, in tearDown 2024-05-30T17:07:00.877 INFO:tasks.cephfs_test_runner: self.loop_cmd_if_eagain('fs subvolume snapshot rm --force ' 2024-05-30T17:07:00.877 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks/cephfs/test_volumes.py", line 7749, in loop_cmd_if_eagain 2024-05-30T17:07:00.877 INFO:tasks.cephfs_test_runner: raise RuntimeError(f'This cmd failed 10 times: {cmdargs}') 2024-05-30T17:07:00.877 INFO:tasks.cephfs_test_runner:RuntimeError: This cmd failed 10 times: fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:07:00.877 INFO:tasks.cephfs_test_runner: 2024-05-30T17:07:00.877 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-30T17:07:00.878 INFO:tasks.cephfs_test_runner:Ran 8 tests in 1051.931s 2024-05-30T17:07:00.878 INFO:tasks.cephfs_test_runner: 2024-05-30T17:07:00.878 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-05-30T17:07:00.878 INFO:tasks.cephfs_test_runner: 2024-05-30T17:07:00.878 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-30T17:07:00.878 INFO:tasks.cephfs_test_runner:ERROR: test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T17:07:00.878 INFO:tasks.cephfs_test_runner:Test that both the progress bars, that are printed for all 7 clone 2024-05-30T17:07:00.878 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-30T17:07:00.878 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-30T17:07:00.879 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks/cephfs/test_volumes.py", line 7795, in tearDown 2024-05-30T17:07:00.879 INFO:tasks.cephfs_test_runner: self.loop_cmd_if_eagain('fs subvolume snapshot rm --force ' 2024-05-30T17:07:00.879 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks/cephfs/test_volumes.py", line 7749, in loop_cmd_if_eagain 2024-05-30T17:07:00.879 INFO:tasks.cephfs_test_runner: raise RuntimeError(f'This cmd failed 10 times: {cmdargs}') 2024-05-30T17:07:00.879 INFO:tasks.cephfs_test_runner:RuntimeError: This cmd failed 10 times: fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T17:07:00.879 INFO:tasks.cephfs_test_runner: 2024-05-30T17:07:00.879 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T17:07:01.072 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2bb5a2d3aa824bb488ae6820add211a1 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T17:07:01.073 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-30T17:07:01.082 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-30T17:07:01.101 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-30T17:07:01.101 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:07:01.101 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:07:01.116 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:07:01.116 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:07:01.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T17:07:01.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.359+0000 7fc668c00640 1 Processor -- start 2024-05-30T17:07:01.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.359+0000 7fc668c00640 1 -- start start 2024-05-30T17:07:01.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc668c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc66406e900 0x7fc66415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc668c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc6640d0560 0x7fc6640d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc668c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc66415f060 con 0x7fc6640af720 2024-05-30T17:07:01.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc668c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc6640afb00 con 0x7fc6640d0560 2024-05-30T17:07:01.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc668c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc66415c270 con 0x7fc66406e900 2024-05-30T17:07:01.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc6640af720 0x7fc66415b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51878/0 (socket says 172.21.15.59:51878) 2024-05-30T17:07:01.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661e00640 1 -- 172.21.15.59:0/2651732087 learned_addr learned my addr 172.21.15.59:0/2651732087 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:01.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc662800640 1 --2- 172.21.15.59:0/2651732087 >> v2:172.21.15.107:3300/0 conn(0x7fc6640d0560 0x7fc6640d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc65be00640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc66406e900 0x7fc66415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 880682604 0 0) 0x7fc66415f060 con 0x7fc6640af720 2024-05-30T17:07:01.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc648005740 con 0x7fc6640af720 2024-05-30T17:07:01.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4239930648 0 0) 0x7fc648005740 con 0x7fc6640af720 2024-05-30T17:07:01.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc66406e900 msgr2=0x7fc66415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:01.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc66406e900 0x7fc66415f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 >> v2:172.21.15.107:3300/0 conn(0x7fc6640d0560 msgr2=0x7fc6640d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:01.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 --2- 172.21.15.59:0/2651732087 >> v2:172.21.15.107:3300/0 conn(0x7fc6640d0560 0x7fc6640d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66415c550 con 0x7fc6640af720 2024-05-30T17:07:01.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fc654001680 con 0x7fc6640af720 2024-05-30T17:07:01.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 >> v1:172.21.15.59:6789/0 conn(0x7fc6640af720 legacy=0x7fc66415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:01.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc648005bd0 0x7fc648005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc648006a20 0x7fc648006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc66406e900 0x7fc6480073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc6640afb00 con 0x7fc648006a20 2024-05-30T17:07:01.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc66415c270 con 0x7fc648005bd0 2024-05-30T17:07:01.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc64800dbe0 con 0x7fc66406e900 2024-05-30T17:07:01.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc65be00640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc648006a20 0x7fc648006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc661e00640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc648005bd0 0x7fc648005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc662800640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc66406e900 0x7fc6480073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc65be00640 1 -- 172.21.15.59:0/2651732087 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc66406e900 msgr2=0x7fc6480073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:01.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc65be00640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc66406e900 0x7fc6480073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc65be00640 1 -- 172.21.15.59:0/2651732087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc648005bd0 msgr2=0x7fc648005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:01.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc65be00640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc648005bd0 0x7fc648005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc65be00640 1 -- 172.21.15.59:0/2651732087 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc648005740 con 0x7fc648006a20 2024-05-30T17:07:01.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.363+0000 7fc662800640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc66406e900 0x7fc6480073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.367+0000 7fc65be00640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc648006a20 0x7fc648006ea0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009ab0 tx=0x7fc64c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80706cc2a8294703 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.367+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c0096b0 con 0x7fc648006a20 2024-05-30T17:07:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.367+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64c0a6460 con 0x7fc648006a20 2024-05-30T17:07:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.367+0000 7fc661400640 1 -- 172.21.15.59:0/2651732087 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c0a6810 con 0x7fc648006a20 2024-05-30T17:07:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.367+0000 7fc668c00640 1 -- 172.21.15.59:0/2651732087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc648006a20 msgr2=0x7fc648006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.367+0000 7fc668c00640 1 --2- 172.21.15.59:0/2651732087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc648006a20 0x7fc648006ea0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009ab0 tx=0x7fc64c01ca50 comp rx=0 tx=0).stop 2024-05-30T17:07:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.367+0000 7fc662800640 1 -- 172.21.15.59:0/2651732087 reap_dead start 2024-05-30T17:07:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.367+0000 7fc668c00640 1 -- 172.21.15.59:0/2651732087 shutdown_connections 2024-05-30T17:07:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.367+0000 7fc668c00640 1 -- 172.21.15.59:0/2651732087 >> 172.21.15.59:0/2651732087 conn(0x7fc6640b22d0 msgr2=0x7fc6640b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.367+0000 7fc668c00640 1 -- 172.21.15.59:0/2651732087 shutdown_connections 2024-05-30T17:07:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.367+0000 7fc668c00640 1 -- 172.21.15.59:0/2651732087 wait complete. 2024-05-30T17:07:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc668c00640 1 Processor -- start 2024-05-30T17:07:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc668c00640 1 -- start start 2024-05-30T17:07:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc668c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc648006a20 0x7fc664146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc668c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc664157a40 0x7fc6641e5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc668c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc66415dc90 0x7fc66415e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc668c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc66415f7f0 con 0x7fc648006a20 2024-05-30T17:07:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc668c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc66415c830 con 0x7fc66415dc90 2024-05-30T17:07:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc668c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc66415f970 con 0x7fc664157a40 2024-05-30T17:07:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc661e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc648006a20 0x7fc664146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc661e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc648006a20 0x7fc664146f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46104/0 (socket says 172.21.15.59:46104) 2024-05-30T17:07:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc661e00640 1 -- 172.21.15.59:0/3138187095 learned_addr learned my addr 172.21.15.59:0/3138187095 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc65be00640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc664157a40 0x7fc6641e5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc662800640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc66415dc90 0x7fc66415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc661e00640 1 -- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc664157a40 msgr2=0x7fc6641e5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc661e00640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc664157a40 0x7fc6641e5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc661e00640 1 -- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc66415dc90 msgr2=0x7fc66415e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc661e00640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc66415dc90 0x7fc66415e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc661e00640 1 -- 172.21.15.59:0/3138187095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66409a460 con 0x7fc648006a20 2024-05-30T17:07:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc662800640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc66415dc90 0x7fc66415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc661e00640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc648006a20 0x7fc664146f90 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fc654011840 tx=0x7fc654011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc65a000640 1 -- 172.21.15.59:0/3138187095 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654010040 con 0x7fc648006a20 2024-05-30T17:07:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc65a000640 1 -- 172.21.15.59:0/3138187095 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65401a070 con 0x7fc648006a20 2024-05-30T17:07:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc65a000640 1 -- 172.21.15.59:0/3138187095 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65400fde0 con 0x7fc648006a20 2024-05-30T17:07:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc668c00640 1 -- 172.21.15.59:0/3138187095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66409a740 con 0x7fc648006a20 2024-05-30T17:07:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc668c00640 1 -- 172.21.15.59:0/3138187095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66409ad00 con 0x7fc648006a20 2024-05-30T17:07:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.371+0000 7fc668c00640 1 -- 172.21.15.59:0/3138187095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc664068a90 con 0x7fc648006a20 2024-05-30T17:07:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.375+0000 7fc65a000640 1 -- 172.21.15.59:0/3138187095 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7fc65401f460 con 0x7fc648006a20 2024-05-30T17:07:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.375+0000 7fc65a000640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc64006a150 0x7fc64006c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.375+0000 7fc65a000640 1 -- 172.21.15.59:0/3138187095 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fc654088b50 con 0x7fc648006a20 2024-05-30T17:07:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.375+0000 7fc65be00640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc64006a150 0x7fc64006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.375+0000 7fc65be00640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc64006a150 0x7fc64006c610 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0ad000 tx=0x7fc64c0b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.379+0000 7fc65a000640 1 -- 172.21.15.59:0/3138187095 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc65405ab70 con 0x7fc648006a20 2024-05-30T17:07:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.555+0000 7fc668c00640 1 -- 172.21.15.59:0/3138187095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc6640d0970 con 0x7fc648006a20 2024-05-30T17:07:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.555+0000 7fc65a000640 1 -- 172.21.15.59:0/3138187095 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v133) ==== 80+0+0 (secure 0 0 0) 0x7fc65405a470 con 0x7fc648006a20 2024-05-30T17:07:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T17:07:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.559+0000 7fc668c00640 1 -- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc64006a150 msgr2=0x7fc64006c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.559+0000 7fc668c00640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc64006a150 0x7fc64006c610 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0ad000 tx=0x7fc64c0b2040 comp rx=0 tx=0).stop 2024-05-30T17:07:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.559+0000 7fc668c00640 1 -- 172.21.15.59:0/3138187095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc648006a20 msgr2=0x7fc664146f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.559+0000 7fc668c00640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc648006a20 0x7fc664146f90 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fc654011840 tx=0x7fc654011d00 comp rx=0 tx=0).stop 2024-05-30T17:07:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.559+0000 7fc668c00640 1 -- 172.21.15.59:0/3138187095 shutdown_connections 2024-05-30T17:07:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.559+0000 7fc668c00640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fc64006a150 0x7fc64006c610 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.559+0000 7fc668c00640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc66415dc90 0x7fc66415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.559+0000 7fc668c00640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc664157a40 0x7fc6641e5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.559+0000 7fc668c00640 1 --2- 172.21.15.59:0/3138187095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc648006a20 0x7fc664146f90 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.559+0000 7fc668c00640 1 -- 172.21.15.59:0/3138187095 >> 172.21.15.59:0/3138187095 conn(0x7fc6640b22d0 msgr2=0x7fc66406f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.559+0000 7fc668c00640 1 -- 172.21.15.59:0/3138187095 shutdown_connections 2024-05-30T17:07:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.559+0000 7fc668c00640 1 -- 172.21.15.59:0/3138187095 wait complete. 2024-05-30T17:07:01.580 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:07:01.580 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:07:01.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T17:07:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57fac00640 1 Processor -- start 2024-05-30T17:07:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57fac00640 1 -- start start 2024-05-30T17:07:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57fac00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57f406e900 0x7f57f415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57fac00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f57f40d0560 0x7f57f40d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57fac00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f415f060 con 0x7f57f40af720 2024-05-30T17:07:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57fac00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f57f40afb00 con 0x7f57f406e900 2024-05-30T17:07:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57fac00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f57f415c270 con 0x7f57f40d0560 2024-05-30T17:07:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57f3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f57f40af720 0x7f57f415b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51884/0 (socket says 172.21.15.59:51884) 2024-05-30T17:07:01.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57f3e00640 1 -- 172.21.15.59:0/4240423750 learned_addr learned my addr 172.21.15.59:0/4240423750 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:01.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57ebe00640 1 --2- 172.21.15.59:0/4240423750 >> v2:172.21.15.59:3300/0 conn(0x7f57f406e900 0x7f57f415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57f8c00640 1 --2- 172.21.15.59:0/4240423750 >> v2:172.21.15.107:3300/0 conn(0x7f57f40d0560 0x7f57f40d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57ebe00640 1 -- 172.21.15.59:0/4240423750 >> v2:172.21.15.107:3300/0 conn(0x7f57f40d0560 msgr2=0x7f57f40d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:01.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57ebe00640 1 --2- 172.21.15.59:0/4240423750 >> v2:172.21.15.107:3300/0 conn(0x7f57f40d0560 0x7f57f40d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57ebe00640 1 -- 172.21.15.59:0/4240423750 >> v1:172.21.15.59:6789/0 conn(0x7f57f40af720 legacy=0x7f57f415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:01.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57ebe00640 1 -- 172.21.15.59:0/4240423750 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f415c550 con 0x7f57f406e900 2024-05-30T17:07:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.771+0000 7f57f8c00640 1 --2- 172.21.15.59:0/4240423750 >> v2:172.21.15.107:3300/0 conn(0x7f57f40d0560 0x7f57f40d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:01.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.775+0000 7f57ebe00640 1 --2- 172.21.15.59:0/4240423750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f406e900 0x7f57f415f7f0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f57f415ef00 tx=0x7f57dc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bade0a53237a8382 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:01.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.775+0000 7f57f3400640 1 -- 172.21.15.59:0/4240423750 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0b0070 con 0x7f57f406e900 2024-05-30T17:07:01.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.775+0000 7f57f3400640 1 -- 172.21.15.59:0/4240423750 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57dc0ab600 con 0x7f57f406e900 2024-05-30T17:07:01.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.775+0000 7f57f3400640 1 -- 172.21.15.59:0/4240423750 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0ab9d0 con 0x7f57f406e900 2024-05-30T17:07:01.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.775+0000 7f57fac00640 1 -- 172.21.15.59:0/4240423750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f406e900 msgr2=0x7f57f415f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:01.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.775+0000 7f57fac00640 1 --2- 172.21.15.59:0/4240423750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f406e900 0x7f57f415f7f0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f57f415ef00 tx=0x7f57dc01c480 comp rx=0 tx=0).stop 2024-05-30T17:07:01.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.775+0000 7f57fac00640 1 -- 172.21.15.59:0/4240423750 shutdown_connections 2024-05-30T17:07:01.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.775+0000 7f57fac00640 1 --2- 172.21.15.59:0/4240423750 >> v2:172.21.15.107:3300/0 conn(0x7f57f40d0560 0x7f57f40d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.775+0000 7f57fac00640 1 --2- 172.21.15.59:0/4240423750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f406e900 0x7f57f415f7f0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.775+0000 7f57fac00640 1 -- 172.21.15.59:0/4240423750 >> 172.21.15.59:0/4240423750 conn(0x7f57f40b22d0 msgr2=0x7f57f40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:01.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.775+0000 7f57fac00640 1 -- 172.21.15.59:0/4240423750 shutdown_connections 2024-05-30T17:07:01.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.775+0000 7f57fac00640 1 -- 172.21.15.59:0/4240423750 wait complete. 2024-05-30T17:07:01.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57fac00640 1 Processor -- start 2024-05-30T17:07:01.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57fac00640 1 -- start start 2024-05-30T17:07:01.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57fac00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57f406e900 0x7f57f4147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57fac00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57f40af720 0x7f57f40b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57fac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f40d0560 0x7f57f4157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57fac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f57f4073150 con 0x7f57f40d0560 2024-05-30T17:07:01.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57fac00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f57f40732d0 con 0x7f57f406e900 2024-05-30T17:07:01.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57fac00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f57f41585c0 con 0x7f57f40af720 2024-05-30T17:07:01.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f40d0560 0x7f57f4157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f40d0560 0x7f57f4157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46124/0 (socket says 172.21.15.59:46124) 2024-05-30T17:07:01.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f8c00640 1 -- 172.21.15.59:0/1134174587 learned_addr learned my addr 172.21.15.59:0/1134174587 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:01.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f3e00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57f406e900 0x7f57f4147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57ebe00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57f40af720 0x7f57f40b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f8c00640 1 -- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57f40af720 msgr2=0x7f57f40b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:01.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f8c00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57f40af720 0x7f57f40b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f8c00640 1 -- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57f406e900 msgr2=0x7f57f4147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:01.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f8c00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57f406e900 0x7f57f4147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f8c00640 1 -- 172.21.15.59:0/1134174587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f40b4fc0 con 0x7f57f40d0560 2024-05-30T17:07:01.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57ebe00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57f40af720 0x7f57f40b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:07:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f8c00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f40d0560 0x7f57f4157800 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f57ec007df0 tx=0x7f57ec00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f0c00640 1 -- 172.21.15.59:0/1134174587 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec01a070 con 0x7f57f40d0560 2024-05-30T17:07:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f0c00640 1 -- 172.21.15.59:0/1134174587 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57ec0039a0 con 0x7f57f40d0560 2024-05-30T17:07:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57f0c00640 1 -- 172.21.15.59:0/1134174587 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec003d90 con 0x7f57f40d0560 2024-05-30T17:07:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57fac00640 1 -- 172.21.15.59:0/1134174587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f40b3f20 con 0x7f57f40d0560 2024-05-30T17:07:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57fac00640 1 -- 172.21.15.59:0/1134174587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f40b44e0 con 0x7f57f40d0560 2024-05-30T17:07:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.779+0000 7f57fac00640 1 -- 172.21.15.59:0/1134174587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f4068a90 con 0x7f57f40d0560 2024-05-30T17:07:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.783+0000 7f57f0c00640 1 -- 172.21.15.59:0/1134174587 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f57ec01d070 con 0x7f57f40d0560 2024-05-30T17:07:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.783+0000 7f57f0c00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f57d006a150 0x7f57d006c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:01.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.783+0000 7f57f0c00640 1 -- 172.21.15.59:0/1134174587 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f57ec085c60 con 0x7f57f40d0560 2024-05-30T17:07:01.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.783+0000 7f57f3e00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f57d006a150 0x7f57d006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:01.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.783+0000 7f57f3e00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f57d006a150 0x7f57d006c610 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f57e4000f70 tx=0x7f57e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:01.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.787+0000 7f57f0c00640 1 -- 172.21.15.59:0/1134174587 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f57ec010070 con 0x7f57f40d0560 2024-05-30T17:07:01.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 -- 172.21.15.59:0/1134174587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f57f40aeaa0 con 0x7f57f40d0560 2024-05-30T17:07:01.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57f0c00640 1 -- 172.21.15.59:0/1134174587 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v133) ==== 80+0+0 (secure 0 0 0) 0x7f57ec057c80 con 0x7f57f40d0560 2024-05-30T17:07:01.965 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-05-30T17:07:01.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 -- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f57d006a150 msgr2=0x7f57d006c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:01.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f57d006a150 0x7f57d006c610 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f57e4000f70 tx=0x7f57e4009040 comp rx=0 tx=0).stop 2024-05-30T17:07:01.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 -- 172.21.15.59:0/1134174587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f40d0560 msgr2=0x7f57f4157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:01.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f40d0560 0x7f57f4157800 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f57ec007df0 tx=0x7f57ec00d4a0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 -- 172.21.15.59:0/1134174587 shutdown_connections 2024-05-30T17:07:01.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f57d006a150 0x7f57d006c610 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f40d0560 0x7f57f4157800 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57f40af720 0x7f57f40b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 --2- 172.21.15.59:0/1134174587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57f406e900 0x7f57f4147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 -- 172.21.15.59:0/1134174587 >> 172.21.15.59:0/1134174587 conn(0x7f57f40b22d0 msgr2=0x7f57f40aded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 -- 172.21.15.59:0/1134174587 shutdown_connections 2024-05-30T17:07:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:01.963+0000 7f57fac00640 1 -- 172.21.15.59:0/1134174587 wait complete. 2024-05-30T17:07:01.987 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2024-05-30T17:07:01.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:07:01.988 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-30T17:07:02.006 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[51783]: fuse finished with error 0 and tester_r 0 2024-05-30T17:07:02.571 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:07:02.571 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T17:07:02.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:07:02.571 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T17:07:02.581 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-05-30T17:07:02.581 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:07:02.631 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3544 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T17:07:02.631 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:07:02.631 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:07:02.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:07:02.641 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-30T17:07:02.641 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T17:07:02.690 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350132k,nr_inodes=4087533,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8260 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T17:07:02.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:07:02.690 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-05-30T17:07:02.699 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T17:07:02.699 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T17:07:02.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:07:02.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T17:07:02.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:07:02.764 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T17:07:02.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:07:02.832 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2024-05-30T17:07:02.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:07:02.982 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-30T17:07:02.991 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-30T17:07:02.992 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-30T17:07:02.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:07:02.993 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T17:07:03.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:07:03.058 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-30T17:07:03.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T17:07:03.125 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-05-30T17:07:03.284 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-30T17:07:03.293 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T17:07:03.294 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:07:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9533800640 1 Processor -- start 2024-05-30T17:07:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9533800640 1 -- start start 2024-05-30T17:07:03.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9533800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f952c0ad8c0 0x7f952c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:03.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9533800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f952c15a1d0 0x7f952c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:03.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9533800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952c15d730 con 0x7f952c159df0 2024-05-30T17:07:03.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9533800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f952c15d4f0 con 0x7f952c15a1d0 2024-05-30T17:07:03.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9533800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f952c0b3370 con 0x7f952c0ad8c0 2024-05-30T17:07:03.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9530e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f952c159df0 0x7f952c0ad1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51688/0 (socket says 172.21.15.59:51688) 2024-05-30T17:07:03.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9530e00640 1 -- 172.21.15.59:0/793134110 learned_addr learned my addr 172.21.15.59:0/793134110 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:03.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9531800640 1 --2- 172.21.15.59:0/793134110 >> v2:172.21.15.59:3300/0 conn(0x7f952c15a1d0 0x7f952c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f952be00640 1 --2- 172.21.15.59:0/793134110 >> v2:172.21.15.107:3300/0 conn(0x7f952c0ad8c0 0x7f952c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9531800640 1 -- 172.21.15.59:0/793134110 >> v2:172.21.15.107:3300/0 conn(0x7f952c0ad8c0 msgr2=0x7f952c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9531800640 1 --2- 172.21.15.59:0/793134110 >> v2:172.21.15.107:3300/0 conn(0x7f952c0ad8c0 0x7f952c15ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9531800640 1 -- 172.21.15.59:0/793134110 >> v1:172.21.15.59:6789/0 conn(0x7f952c159df0 legacy=0x7f952c0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.435+0000 7f9531800640 1 -- 172.21.15.59:0/793134110 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c0b3650 con 0x7f952c15a1d0 2024-05-30T17:07:03.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.439+0000 7f9531800640 1 --2- 172.21.15.59:0/793134110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952c15a1d0 0x7f952c15cfb0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f952c0b4bf0 tx=0x7f952401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305ea7096ad6da29 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:03.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.439+0000 7f952b400640 1 -- 172.21.15.59:0/793134110 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95240b2070 con 0x7f952c15a1d0 2024-05-30T17:07:03.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.439+0000 7f952b400640 1 -- 172.21.15.59:0/793134110 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95240a5900 con 0x7f952c15a1d0 2024-05-30T17:07:03.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.439+0000 7f952b400640 1 -- 172.21.15.59:0/793134110 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95240a5cd0 con 0x7f952c15a1d0 2024-05-30T17:07:03.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.439+0000 7f9533800640 1 -- 172.21.15.59:0/793134110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952c15a1d0 msgr2=0x7f952c15cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:03.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.439+0000 7f9533800640 1 --2- 172.21.15.59:0/793134110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952c15a1d0 0x7f952c15cfb0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f952c0b4bf0 tx=0x7f952401c930 comp rx=0 tx=0).stop 2024-05-30T17:07:03.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.439+0000 7f9533800640 1 -- 172.21.15.59:0/793134110 shutdown_connections 2024-05-30T17:07:03.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.439+0000 7f9533800640 1 --2- 172.21.15.59:0/793134110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952c15a1d0 0x7f952c15cfb0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.439+0000 7f9533800640 1 --2- 172.21.15.59:0/793134110 >> v2:172.21.15.107:3300/0 conn(0x7f952c0ad8c0 0x7f952c15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.439+0000 7f9533800640 1 -- 172.21.15.59:0/793134110 >> 172.21.15.59:0/793134110 conn(0x7f952c0b22d0 msgr2=0x7f952c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:03.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.439+0000 7f9533800640 1 -- 172.21.15.59:0/793134110 shutdown_connections 2024-05-30T17:07:03.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.439+0000 7f9533800640 1 -- 172.21.15.59:0/793134110 wait complete. 2024-05-30T17:07:03.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9533800640 1 Processor -- start 2024-05-30T17:07:03.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9533800640 1 -- start start 2024-05-30T17:07:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9533800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952c0ad8c0 0x7f952c157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9533800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f952c159df0 0x7f952c15bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9533800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f952c15a1d0 0x7f952c15c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9533800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f952c15e720 con 0x7f952c0ad8c0 2024-05-30T17:07:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9533800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f952c15e5a0 con 0x7f952c159df0 2024-05-30T17:07:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9533800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f952c15e8a0 con 0x7f952c15a1d0 2024-05-30T17:07:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9530e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952c0ad8c0 0x7f952c157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9530e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952c0ad8c0 0x7f952c157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46016/0 (socket says 172.21.15.59:46016) 2024-05-30T17:07:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9530e00640 1 -- 172.21.15.59:0/2045251229 learned_addr learned my addr 172.21.15.59:0/2045251229 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f952be00640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f952c159df0 0x7f952c15bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9531800640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f952c15a1d0 0x7f952c15c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9530e00640 1 -- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f952c15a1d0 msgr2=0x7f952c15c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9530e00640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f952c15a1d0 0x7f952c15c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9530e00640 1 -- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f952c159df0 msgr2=0x7f952c15bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9530e00640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f952c159df0 0x7f952c15bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9530e00640 1 -- 172.21.15.59:0/2045251229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c151370 con 0x7f952c0ad8c0 2024-05-30T17:07:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f952be00640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f952c159df0 0x7f952c15bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9530e00640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952c0ad8c0 0x7f952c157ac0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f952000c420 tx=0x7f952000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9528c00640 1 -- 172.21.15.59:0/2045251229 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520017070 con 0x7f952c0ad8c0 2024-05-30T17:07:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9528c00640 1 -- 172.21.15.59:0/2045251229 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9520005cf0 con 0x7f952c0ad8c0 2024-05-30T17:07:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9528c00640 1 -- 172.21.15.59:0/2045251229 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95200072f0 con 0x7f952c0ad8c0 2024-05-30T17:07:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9533800640 1 -- 172.21.15.59:0/2045251229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952c151650 con 0x7f952c0ad8c0 2024-05-30T17:07:03.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9533800640 1 -- 172.21.15.59:0/2045251229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952c096b80 con 0x7f952c0ad8c0 2024-05-30T17:07:03.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.443+0000 7f9533800640 1 -- 172.21.15.59:0/2045251229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952c068a90 con 0x7f952c0ad8c0 2024-05-30T17:07:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.447+0000 7f9528c00640 1 -- 172.21.15.59:0/2045251229 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f952001a070 con 0x7f952c0ad8c0 2024-05-30T17:07:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.447+0000 7f9528c00640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f950c06a180 0x7f950c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.447+0000 7f9528c00640 1 -- 172.21.15.59:0/2045251229 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f9520084e10 con 0x7f952c0ad8c0 2024-05-30T17:07:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.447+0000 7f952be00640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f950c06a180 0x7f950c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.447+0000 7f952be00640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f950c06a180 0x7f950c06c640 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f952c0b14e0 tx=0x7f9518008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.451+0000 7f9528c00640 1 -- 172.21.15.59:0/2045251229 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9520056da0 con 0x7f952c0ad8c0 2024-05-30T17:07:03.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.611+0000 7f9533800640 1 -- 172.21.15.59:0/2045251229 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f952c0d0d80 con 0x7f950c06a180 2024-05-30T17:07:03.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.619+0000 7f9528c00640 1 -- 172.21.15.59:0/2045251229 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255026 (secure 0 0 0) 0x7f952c0d0d80 con 0x7f950c06a180 2024-05-30T17:07:03.624 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:07:03.626 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:07:03.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.623+0000 7f9533800640 1 -- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f950c06a180 msgr2=0x7f950c06c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:03.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.623+0000 7f9533800640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f950c06a180 0x7f950c06c640 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f952c0b14e0 tx=0x7f9518008040 comp rx=0 tx=0).stop 2024-05-30T17:07:03.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.623+0000 7f9533800640 1 -- 172.21.15.59:0/2045251229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952c0ad8c0 msgr2=0x7f952c157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:03.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.623+0000 7f9533800640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952c0ad8c0 0x7f952c157ac0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f952000c420 tx=0x7f952000c8e0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.623+0000 7f9533800640 1 -- 172.21.15.59:0/2045251229 shutdown_connections 2024-05-30T17:07:03.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.623+0000 7f9533800640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f950c06a180 0x7f950c06c640 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.623+0000 7f9533800640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f952c15a1d0 0x7f952c15c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.623+0000 7f9533800640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f952c159df0 0x7f952c15bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.623+0000 7f9533800640 1 --2- 172.21.15.59:0/2045251229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952c0ad8c0 0x7f952c157ac0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.623+0000 7f9533800640 1 -- 172.21.15.59:0/2045251229 >> 172.21.15.59:0/2045251229 conn(0x7f952c0b22d0 msgr2=0x7f952c152a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:03.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.623+0000 7f9533800640 1 -- 172.21.15.59:0/2045251229 shutdown_connections 2024-05-30T17:07:03.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.623+0000 7f9533800640 1 -- 172.21.15.59:0/2045251229 wait complete. 2024-05-30T17:07:03.645 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":672,"stamp":"2024-05-30T17:07:03.435452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":17408645220,"num_objects":4183,"num_object_clones":1,"num_object_copies":8366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4183,"num_whiteouts":1,"num_read":4157,"num_read_kb":16171201,"num_write":6086,"num_write_kb":19198217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9441,"ondisk_log_size":9441,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":35119752,"kb_used_data":34014280,"kb_used_omap":12,"kb_used_meta":1105395,"kb_avail":719854968,"statfs":{"total":773094113280,"available":737131487232,"internally_reserved":0,"allocated":34830622720,"data_stored":34823114907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1131925040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":763,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003807"},"pg_stats":[{"pgid":"19.3f","version":"133'147","reported_seq":236,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073322+0000","last_change":"2024-05-30T17:04:48.466651+0000","last_active":"2024-05-30T17:07:02.073322+0000","last_peered":"2024-05-30T17:07:02.073322+0000","last_clean":"2024-05-30T17:07:02.073322+0000","last_became_active":"2024-05-30T17:04:48.283571+0000","last_became_peered":"2024-05-30T17:04:48.283571+0000","last_unstale":"2024-05-30T17:07:02.073322+0000","last_undegraded":"2024-05-30T17:07:02.073322+0000","last_fullsized":"2024-05-30T17:07:02.073322+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:08:42.536278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":80,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3e","version":"133'152","reported_seq":237,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.079817+0000","last_change":"2024-05-30T17:04:27.651522+0000","last_active":"2024-05-30T17:07:02.079817+0000","last_peered":"2024-05-30T17:07:02.079817+0000","last_clean":"2024-05-30T17:07:02.079817+0000","last_became_active":"2024-05-30T17:04:27.649831+0000","last_became_peered":"2024-05-30T17:04:27.649831+0000","last_unstale":"2024-05-30T17:07:02.079817+0000","last_undegraded":"2024-05-30T17:07:02.079817+0000","last_fullsized":"2024-05-30T17:07:02.079817+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:56.144416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":92,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"133'142","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074186+0000","last_change":"2024-05-30T17:04:27.662273+0000","last_active":"2024-05-30T17:07:02.074186+0000","last_peered":"2024-05-30T17:07:02.074186+0000","last_clean":"2024-05-30T17:07:02.074186+0000","last_became_active":"2024-05-30T17:04:27.661891+0000","last_became_peered":"2024-05-30T17:04:27.661891+0000","last_unstale":"2024-05-30T17:07:02.074186+0000","last_undegraded":"2024-05-30T17:07:02.074186+0000","last_fullsized":"2024-05-30T17:07:02.074186+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:37.192613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":68,"num_read_kb":253958,"num_write":88,"num_write_kb":307203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"133'140","reported_seq":203,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074602+0000","last_change":"2024-05-30T17:04:27.655790+0000","last_active":"2024-05-30T17:07:02.074602+0000","last_peered":"2024-05-30T17:07:02.074602+0000","last_clean":"2024-05-30T17:07:02.074602+0000","last_became_active":"2024-05-30T17:04:27.655516+0000","last_became_peered":"2024-05-30T17:04:27.655516+0000","last_unstale":"2024-05-30T17:07:02.074602+0000","last_undegraded":"2024-05-30T17:07:02.074602+0000","last_fullsized":"2024-05-30T17:07:02.074602+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:21.860246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":46,"num_read_kb":176131,"num_write":84,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"133'129","reported_seq":184,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.056843+0000","last_change":"2024-05-30T17:04:27.668225+0000","last_active":"2024-05-30T17:07:02.056843+0000","last_peered":"2024-05-30T17:07:02.056843+0000","last_clean":"2024-05-30T17:07:02.056843+0000","last_became_active":"2024-05-30T17:04:27.667959+0000","last_became_peered":"2024-05-30T17:04:27.667959+0000","last_unstale":"2024-05-30T17:07:02.056843+0000","last_undegraded":"2024-05-30T17:07:02.056843+0000","last_fullsized":"2024-05-30T17:07:02.056843+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:36:36.807585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":38,"num_read_kb":155648,"num_write":75,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"133'150","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.080422+0000","last_change":"2024-05-30T17:04:27.662557+0000","last_active":"2024-05-30T17:07:02.080422+0000","last_peered":"2024-05-30T17:07:02.080422+0000","last_clean":"2024-05-30T17:07:02.080422+0000","last_became_active":"2024-05-30T17:04:27.662304+0000","last_became_peered":"2024-05-30T17:04:27.662304+0000","last_unstale":"2024-05-30T17:07:02.080422+0000","last_undegraded":"2024-05-30T17:07:02.080422+0000","last_fullsized":"2024-05-30T17:07:02.080422+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:23.592124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":94,"num_write_kb":352257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"133'148","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073252+0000","last_change":"2024-05-30T17:04:27.650438+0000","last_active":"2024-05-30T17:07:02.073252+0000","last_peered":"2024-05-30T17:07:02.073252+0000","last_clean":"2024-05-30T17:07:02.073252+0000","last_became_active":"2024-05-30T17:04:27.649935+0000","last_became_peered":"2024-05-30T17:04:27.649935+0000","last_unstale":"2024-05-30T17:07:02.073252+0000","last_undegraded":"2024-05-30T17:07:02.073252+0000","last_fullsized":"2024-05-30T17:07:02.073252+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:53.659379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":47,"num_read_kb":192512,"num_write":78,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"133'122","reported_seq":190,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072168+0000","last_change":"2024-05-30T17:04:27.654259+0000","last_active":"2024-05-30T17:07:02.072168+0000","last_peered":"2024-05-30T17:07:02.072168+0000","last_clean":"2024-05-30T17:07:02.072168+0000","last_became_active":"2024-05-30T17:04:27.653784+0000","last_became_peered":"2024-05-30T17:04:27.653784+0000","last_unstale":"2024-05-30T17:07:02.072168+0000","last_undegraded":"2024-05-30T17:07:02.072168+0000","last_fullsized":"2024-05-30T17:07:02.072168+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:33:17.272892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":91,"num_write_kb":331776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"133'138","reported_seq":205,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.064343+0000","last_change":"2024-05-30T17:04:27.667692+0000","last_active":"2024-05-30T17:07:02.064343+0000","last_peered":"2024-05-30T17:07:02.064343+0000","last_clean":"2024-05-30T17:07:02.064343+0000","last_became_active":"2024-05-30T17:04:27.667374+0000","last_became_peered":"2024-05-30T17:04:27.667374+0000","last_unstale":"2024-05-30T17:07:02.064343+0000","last_undegraded":"2024-05-30T17:07:02.064343+0000","last_fullsized":"2024-05-30T17:07:02.064343+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:23.592124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":50,"num_read_kb":204800,"num_write":77,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"133'130","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075314+0000","last_change":"2024-05-30T17:04:27.649118+0000","last_active":"2024-05-30T17:07:02.075314+0000","last_peered":"2024-05-30T17:07:02.075314+0000","last_clean":"2024-05-30T17:07:02.075314+0000","last_became_active":"2024-05-30T17:04:27.648603+0000","last_became_peered":"2024-05-30T17:04:27.648603+0000","last_unstale":"2024-05-30T17:07:02.075314+0000","last_undegraded":"2024-05-30T17:07:02.075314+0000","last_fullsized":"2024-05-30T17:07:02.075314+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:34:15.854657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":76,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"133'139","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.065303+0000","last_change":"2024-05-30T17:04:27.661461+0000","last_active":"2024-05-30T17:07:02.065303+0000","last_peered":"2024-05-30T17:07:02.065303+0000","last_clean":"2024-05-30T17:07:02.065303+0000","last_became_active":"2024-05-30T17:04:27.660883+0000","last_became_peered":"2024-05-30T17:04:27.660883+0000","last_unstale":"2024-05-30T17:07:02.065303+0000","last_undegraded":"2024-05-30T17:07:02.065303+0000","last_fullsized":"2024-05-30T17:07:02.065303+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:10.641928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":96,"num_read_kb":393216,"num_write":91,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"133'111","reported_seq":221,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.063559+0000","last_change":"2024-05-30T17:04:27.666142+0000","last_active":"2024-05-30T17:07:02.063559+0000","last_peered":"2024-05-30T17:07:02.063559+0000","last_clean":"2024-05-30T17:07:02.063559+0000","last_became_active":"2024-05-30T17:04:27.665266+0000","last_became_peered":"2024-05-30T17:04:27.665266+0000","last_unstale":"2024-05-30T17:07:02.063559+0000","last_undegraded":"2024-05-30T17:07:02.063559+0000","last_fullsized":"2024-05-30T17:07:02.063559+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:22.395407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":93,"num_read_kb":364548,"num_write":70,"num_write_kb":258049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"133'123","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071900+0000","last_change":"2024-05-30T17:04:27.655353+0000","last_active":"2024-05-30T17:07:02.071900+0000","last_peered":"2024-05-30T17:07:02.071900+0000","last_clean":"2024-05-30T17:07:02.071900+0000","last_became_active":"2024-05-30T17:04:27.655046+0000","last_became_peered":"2024-05-30T17:04:27.655046+0000","last_unstale":"2024-05-30T17:07:02.071900+0000","last_undegraded":"2024-05-30T17:07:02.071900+0000","last_fullsized":"2024-05-30T17:07:02.071900+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:03.759562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":82,"num_read_kb":335872,"num_write":80,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"133'139","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.080510+0000","last_change":"2024-05-30T17:04:27.660230+0000","last_active":"2024-05-30T17:07:02.080510+0000","last_peered":"2024-05-30T17:07:02.080510+0000","last_clean":"2024-05-30T17:07:02.080510+0000","last_became_active":"2024-05-30T17:04:27.659965+0000","last_became_peered":"2024-05-30T17:04:27.659965+0000","last_unstale":"2024-05-30T17:07:02.080510+0000","last_undegraded":"2024-05-30T17:07:02.080510+0000","last_fullsized":"2024-05-30T17:07:02.080510+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:29:02.948480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629892,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":62,"num_read_kb":249857,"num_write":78,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"133'122","reported_seq":169,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075397+0000","last_change":"2024-05-30T17:04:27.651454+0000","last_active":"2024-05-30T17:07:02.075397+0000","last_peered":"2024-05-30T17:07:02.075397+0000","last_clean":"2024-05-30T17:07:02.075397+0000","last_became_active":"2024-05-30T17:04:27.650330+0000","last_became_peered":"2024-05-30T17:04:27.650330+0000","last_unstale":"2024-05-30T17:07:02.075397+0000","last_undegraded":"2024-05-30T17:07:02.075397+0000","last_fullsized":"2024-05-30T17:07:02.075397+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:29:36.345038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":30,"num_read_kb":122880,"num_write":68,"num_write_kb":245760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"133'131","reported_seq":201,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.386722+0000","last_change":"2024-05-30T17:04:27.656402+0000","last_active":"2024-05-30T17:06:47.386722+0000","last_peered":"2024-05-30T17:06:47.386722+0000","last_clean":"2024-05-30T17:06:47.386722+0000","last_became_active":"2024-05-30T17:04:27.656141+0000","last_became_peered":"2024-05-30T17:04:27.656141+0000","last_unstale":"2024-05-30T17:06:47.386722+0000","last_undegraded":"2024-05-30T17:06:47.386722+0000","last_fullsized":"2024-05-30T17:06:47.386722+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:08.433002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":53,"num_read_kb":217088,"num_write":82,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"133'131","reported_seq":190,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075517+0000","last_change":"2024-05-30T17:04:27.655050+0000","last_active":"2024-05-30T17:07:02.075517+0000","last_peered":"2024-05-30T17:07:02.075517+0000","last_clean":"2024-05-30T17:07:02.075517+0000","last_became_active":"2024-05-30T17:04:27.654786+0000","last_became_peered":"2024-05-30T17:04:27.654786+0000","last_unstale":"2024-05-30T17:07:02.075517+0000","last_undegraded":"2024-05-30T17:07:02.075517+0000","last_fullsized":"2024-05-30T17:07:02.075517+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:12.824800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":77,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"133'122","reported_seq":229,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.380145+0000","last_change":"2024-05-30T17:04:27.650889+0000","last_active":"2024-05-30T17:06:47.380145+0000","last_peered":"2024-05-30T17:06:47.380145+0000","last_clean":"2024-05-30T17:06:47.380145+0000","last_became_active":"2024-05-30T17:04:27.649462+0000","last_became_peered":"2024-05-30T17:04:27.649462+0000","last_unstale":"2024-05-30T17:06:47.380145+0000","last_undegraded":"2024-05-30T17:06:47.380145+0000","last_fullsized":"2024-05-30T17:06:47.380145+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:02:33.740142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":90,"num_read_kb":352260,"num_write":88,"num_write_kb":311298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"133'143","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072013+0000","last_change":"2024-05-30T17:04:27.661225+0000","last_active":"2024-05-30T17:07:02.072013+0000","last_peered":"2024-05-30T17:07:02.072013+0000","last_clean":"2024-05-30T17:07:02.072013+0000","last_became_active":"2024-05-30T17:04:27.660532+0000","last_became_peered":"2024-05-30T17:04:27.660532+0000","last_unstale":"2024-05-30T17:07:02.072013+0000","last_undegraded":"2024-05-30T17:07:02.072013+0000","last_fullsized":"2024-05-30T17:07:02.072013+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:06.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":71,"num_read_kb":278531,"num_write":90,"num_write_kb":315393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"133'136","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.385882+0000","last_change":"2024-05-30T17:04:27.652401+0000","last_active":"2024-05-30T17:06:47.385882+0000","last_peered":"2024-05-30T17:06:47.385882+0000","last_clean":"2024-05-30T17:06:47.385882+0000","last_became_active":"2024-05-30T17:04:27.652097+0000","last_became_peered":"2024-05-30T17:04:27.652097+0000","last_unstale":"2024-05-30T17:06:47.385882+0000","last_undegraded":"2024-05-30T17:06:47.385882+0000","last_fullsized":"2024-05-30T17:06:47.385882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:22:37.455945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":84,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"133'143","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.059723+0000","last_change":"2024-05-30T17:04:27.668938+0000","last_active":"2024-05-30T17:07:02.059723+0000","last_peered":"2024-05-30T17:07:02.059723+0000","last_clean":"2024-05-30T17:07:02.059723+0000","last_became_active":"2024-05-30T17:04:27.667647+0000","last_became_peered":"2024-05-30T17:04:27.667647+0000","last_unstale":"2024-05-30T17:07:02.059723+0000","last_undegraded":"2024-05-30T17:07:02.059723+0000","last_fullsized":"2024-05-30T17:07:02.059723+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:30.304469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":90,"num_read_kb":364545,"num_write":97,"num_write_kb":348161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"133'132","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.076029+0000","last_change":"2024-05-30T17:04:27.662797+0000","last_active":"2024-05-30T17:07:02.076029+0000","last_peered":"2024-05-30T17:07:02.076029+0000","last_clean":"2024-05-30T17:07:02.076029+0000","last_became_active":"2024-05-30T17:04:27.662501+0000","last_became_peered":"2024-05-30T17:04:27.662501+0000","last_unstale":"2024-05-30T17:07:02.076029+0000","last_undegraded":"2024-05-30T17:07:02.076029+0000","last_fullsized":"2024-05-30T17:07:02.076029+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:08:53.115296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":57,"num_read_kb":229377,"num_write":78,"num_write_kb":282625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"133'147","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.069190+0000","last_change":"2024-05-30T17:04:27.663482+0000","last_active":"2024-05-30T17:07:02.069190+0000","last_peered":"2024-05-30T17:07:02.069190+0000","last_clean":"2024-05-30T17:07:02.069190+0000","last_became_active":"2024-05-30T17:04:27.663243+0000","last_became_peered":"2024-05-30T17:04:27.663243+0000","last_unstale":"2024-05-30T17:07:02.069190+0000","last_undegraded":"2024-05-30T17:07:02.069190+0000","last_fullsized":"2024-05-30T17:07:02.069190+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:18:01.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":93,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"133'141","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.070605+0000","last_change":"2024-05-30T17:04:27.664136+0000","last_active":"2024-05-30T17:07:02.070605+0000","last_peered":"2024-05-30T17:07:02.070605+0000","last_clean":"2024-05-30T17:07:02.070605+0000","last_became_active":"2024-05-30T17:04:27.663855+0000","last_became_peered":"2024-05-30T17:04:27.663855+0000","last_unstale":"2024-05-30T17:07:02.070605+0000","last_undegraded":"2024-05-30T17:07:02.070605+0000","last_fullsized":"2024-05-30T17:07:02.070605+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:58:09.184441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":52,"num_read_kb":212992,"num_write":85,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"133'145","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073496+0000","last_change":"2024-05-30T17:04:27.653664+0000","last_active":"2024-05-30T17:07:02.073496+0000","last_peered":"2024-05-30T17:07:02.073496+0000","last_clean":"2024-05-30T17:07:02.073496+0000","last_became_active":"2024-05-30T17:04:27.653397+0000","last_became_peered":"2024-05-30T17:04:27.653397+0000","last_unstale":"2024-05-30T17:07:02.073496+0000","last_undegraded":"2024-05-30T17:07:02.073496+0000","last_fullsized":"2024-05-30T17:07:02.073496+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:48.819945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":66,"num_read_kb":253956,"num_write":74,"num_write_kb":266242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"133'150","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.391541+0000","last_change":"2024-05-30T17:04:27.657224+0000","last_active":"2024-05-30T17:06:47.391541+0000","last_peered":"2024-05-30T17:06:47.391541+0000","last_clean":"2024-05-30T17:06:47.391541+0000","last_became_active":"2024-05-30T17:04:27.656941+0000","last_became_peered":"2024-05-30T17:04:27.656941+0000","last_unstale":"2024-05-30T17:06:47.391541+0000","last_undegraded":"2024-05-30T17:06:47.391541+0000","last_fullsized":"2024-05-30T17:06:47.391541+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:33.680204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":86,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"133'127","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072257+0000","last_change":"2024-05-30T17:04:48.390020+0000","last_active":"2024-05-30T17:07:02.072257+0000","last_peered":"2024-05-30T17:07:02.072257+0000","last_clean":"2024-05-30T17:07:02.072257+0000","last_became_active":"2024-05-30T17:04:48.283505+0000","last_became_peered":"2024-05-30T17:04:48.283505+0000","last_unstale":"2024-05-30T17:07:02.072257+0000","last_undegraded":"2024-05-30T17:07:02.072257+0000","last_fullsized":"2024-05-30T17:07:02.072257+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:22:07.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":77,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.24","version":"133'126","reported_seq":175,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.061199+0000","last_change":"2024-05-30T17:04:27.664832+0000","last_active":"2024-05-30T17:07:02.061199+0000","last_peered":"2024-05-30T17:07:02.061199+0000","last_clean":"2024-05-30T17:07:02.061199+0000","last_became_active":"2024-05-30T17:04:27.664502+0000","last_became_peered":"2024-05-30T17:04:27.664502+0000","last_unstale":"2024-05-30T17:07:02.061199+0000","last_undegraded":"2024-05-30T17:07:02.061199+0000","last_fullsized":"2024-05-30T17:07:02.061199+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:01:53.320309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":32,"num_read_kb":131072,"num_write":80,"num_write_kb":282625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"133'142","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071698+0000","last_change":"2024-05-30T17:04:27.654528+0000","last_active":"2024-05-30T17:07:02.071698+0000","last_peered":"2024-05-30T17:07:02.071698+0000","last_clean":"2024-05-30T17:07:02.071698+0000","last_became_active":"2024-05-30T17:04:27.653960+0000","last_became_peered":"2024-05-30T17:04:27.653960+0000","last_unstale":"2024-05-30T17:07:02.071698+0000","last_undegraded":"2024-05-30T17:07:02.071698+0000","last_fullsized":"2024-05-30T17:07:02.071698+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:15.226549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":83,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"133'143","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078546+0000","last_change":"2024-05-30T17:04:27.654884+0000","last_active":"2024-05-30T17:07:02.078546+0000","last_peered":"2024-05-30T17:07:02.078546+0000","last_clean":"2024-05-30T17:07:02.078546+0000","last_became_active":"2024-05-30T17:04:27.654299+0000","last_became_peered":"2024-05-30T17:04:27.654299+0000","last_unstale":"2024-05-30T17:07:02.078546+0000","last_undegraded":"2024-05-30T17:07:02.078546+0000","last_fullsized":"2024-05-30T17:07:02.078546+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:24:47.150653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":87,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"133'142","reported_seq":255,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078715+0000","last_change":"2024-05-30T17:04:27.663731+0000","last_active":"2024-05-30T17:07:02.078715+0000","last_peered":"2024-05-30T17:07:02.078715+0000","last_clean":"2024-05-30T17:07:02.078715+0000","last_became_active":"2024-05-30T17:04:27.663462+0000","last_became_peered":"2024-05-30T17:04:27.663462+0000","last_unstale":"2024-05-30T17:07:02.078715+0000","last_undegraded":"2024-05-30T17:07:02.078715+0000","last_fullsized":"2024-05-30T17:07:02.078715+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:05:45.058232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":96,"num_read_kb":376836,"num_write":70,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"133'136","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074057+0000","last_change":"2024-05-30T17:04:27.648781+0000","last_active":"2024-05-30T17:07:02.074057+0000","last_peered":"2024-05-30T17:07:02.074057+0000","last_clean":"2024-05-30T17:07:02.074057+0000","last_became_active":"2024-05-30T17:04:27.648348+0000","last_became_peered":"2024-05-30T17:04:27.648348+0000","last_unstale":"2024-05-30T17:07:02.074057+0000","last_undegraded":"2024-05-30T17:07:02.074057+0000","last_fullsized":"2024-05-30T17:07:02.074057+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:18:01.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":69,"num_read_kb":282624,"num_write":74,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"133'128","reported_seq":186,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.380374+0000","last_change":"2024-05-30T17:04:27.665116+0000","last_active":"2024-05-30T17:06:47.380374+0000","last_peered":"2024-05-30T17:06:47.380374+0000","last_clean":"2024-05-30T17:06:47.380374+0000","last_became_active":"2024-05-30T17:04:27.664853+0000","last_became_peered":"2024-05-30T17:04:27.664853+0000","last_unstale":"2024-05-30T17:06:47.380374+0000","last_undegraded":"2024-05-30T17:06:47.380374+0000","last_fullsized":"2024-05-30T17:06:47.380374+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:00.380018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":41,"num_read_kb":163841,"num_write":78,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"130'4","reported_seq":23,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.385302+0000","last_change":"2024-05-30T17:04:26.653769+0000","last_active":"2024-05-30T17:04:48.385302+0000","last_peered":"2024-05-30T17:04:48.385302+0000","last_clean":"2024-05-30T17:04:48.385302+0000","last_became_active":"2024-05-30T17:04:26.653331+0000","last_became_peered":"2024-05-30T17:04:26.653331+0000","last_unstale":"2024-05-30T17:04:48.385302+0000","last_undegraded":"2024-05-30T17:04:48.385302+0000","last_fullsized":"2024-05-30T17:04:48.385302+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:48.287253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"133'134","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075995+0000","last_change":"2024-05-30T17:04:27.662362+0000","last_active":"2024-05-30T17:07:02.075995+0000","last_peered":"2024-05-30T17:07:02.075995+0000","last_clean":"2024-05-30T17:07:02.075995+0000","last_became_active":"2024-05-30T17:04:27.662074+0000","last_became_peered":"2024-05-30T17:04:27.662074+0000","last_unstale":"2024-05-30T17:07:02.075995+0000","last_undegraded":"2024-05-30T17:07:02.075995+0000","last_fullsized":"2024-05-30T17:07:02.075995+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:46.552415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":67,"num_read_kb":270337,"num_write":83,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.285510+0000","last_change":"2024-05-30T17:04:26.652574+0000","last_active":"2024-05-30T17:04:48.285510+0000","last_peered":"2024-05-30T17:04:48.285510+0000","last_clean":"2024-05-30T17:04:48.285510+0000","last_became_active":"2024-05-30T17:04:26.652142+0000","last_became_peered":"2024-05-30T17:04:26.652142+0000","last_unstale":"2024-05-30T17:04:48.285510+0000","last_undegraded":"2024-05-30T17:04:48.285510+0000","last_fullsized":"2024-05-30T17:04:48.285510+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:56.876839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"133'126","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.070793+0000","last_change":"2024-05-30T17:04:27.660400+0000","last_active":"2024-05-30T17:07:02.070793+0000","last_peered":"2024-05-30T17:07:02.070793+0000","last_clean":"2024-05-30T17:07:02.070793+0000","last_became_active":"2024-05-30T17:04:27.659049+0000","last_became_peered":"2024-05-30T17:04:27.659049+0000","last_unstale":"2024-05-30T17:07:02.070793+0000","last_undegraded":"2024-05-30T17:07:02.070793+0000","last_fullsized":"2024-05-30T17:07:02.070793+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:40.140860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435717,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":77,"num_write_kb":286721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"133'3","reported_seq":22,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:10.709212+0000","last_change":"2024-05-30T17:04:26.652502+0000","last_active":"2024-05-30T17:05:10.709212+0000","last_peered":"2024-05-30T17:05:10.709212+0000","last_clean":"2024-05-30T17:05:10.709212+0000","last_became_active":"2024-05-30T17:04:26.652240+0000","last_became_peered":"2024-05-30T17:04:26.652240+0000","last_unstale":"2024-05-30T17:05:10.709212+0000","last_undegraded":"2024-05-30T17:05:10.709212+0000","last_fullsized":"2024-05-30T17:05:10.709212+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:05:38.644445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"133'143","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078731+0000","last_change":"2024-05-30T17:04:27.659729+0000","last_active":"2024-05-30T17:07:02.078731+0000","last_peered":"2024-05-30T17:07:02.078731+0000","last_clean":"2024-05-30T17:07:02.078731+0000","last_became_active":"2024-05-30T17:04:27.659448+0000","last_became_peered":"2024-05-30T17:04:27.659448+0000","last_unstale":"2024-05-30T17:07:02.078731+0000","last_undegraded":"2024-05-30T17:07:02.078731+0000","last_fullsized":"2024-05-30T17:07:02.078731+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:24:26.077897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":85,"num_read_kb":348160,"num_write":95,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"133'3","reported_seq":22,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:10.928697+0000","last_change":"2024-05-30T17:04:26.644729+0000","last_active":"2024-05-30T17:06:10.928697+0000","last_peered":"2024-05-30T17:06:10.928697+0000","last_clean":"2024-05-30T17:06:10.928697+0000","last_became_active":"2024-05-30T17:04:26.644381+0000","last_became_peered":"2024-05-30T17:04:26.644381+0000","last_unstale":"2024-05-30T17:06:10.928697+0000","last_undegraded":"2024-05-30T17:06:10.928697+0000","last_fullsized":"2024-05-30T17:06:10.928697+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:37:07.585571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"133'137","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.379965+0000","last_change":"2024-05-30T17:04:27.650774+0000","last_active":"2024-05-30T17:06:47.379965+0000","last_peered":"2024-05-30T17:06:47.379965+0000","last_clean":"2024-05-30T17:06:47.379965+0000","last_became_active":"2024-05-30T17:04:27.649829+0000","last_became_peered":"2024-05-30T17:04:27.649829+0000","last_unstale":"2024-05-30T17:06:47.379965+0000","last_undegraded":"2024-05-30T17:06:47.379965+0000","last_fullsized":"2024-05-30T17:06:47.379965+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:43:56.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":54,"num_read_kb":221184,"num_write":83,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.391828+0000","last_change":"2024-05-30T17:04:26.649081+0000","last_active":"2024-05-30T17:04:48.391828+0000","last_peered":"2024-05-30T17:04:48.391828+0000","last_clean":"2024-05-30T17:04:48.391828+0000","last_became_active":"2024-05-30T17:04:26.648809+0000","last_became_peered":"2024-05-30T17:04:26.648809+0000","last_unstale":"2024-05-30T17:04:48.391828+0000","last_undegraded":"2024-05-30T17:04:48.391828+0000","last_fullsized":"2024-05-30T17:04:48.391828+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:19.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"133'135","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074364+0000","last_change":"2024-05-30T17:04:27.657052+0000","last_active":"2024-05-30T17:07:02.074364+0000","last_peered":"2024-05-30T17:07:02.074364+0000","last_clean":"2024-05-30T17:07:02.074364+0000","last_became_active":"2024-05-30T17:04:27.656807+0000","last_became_peered":"2024-05-30T17:04:27.656807+0000","last_unstale":"2024-05-30T17:07:02.074364+0000","last_undegraded":"2024-05-30T17:07:02.074364+0000","last_fullsized":"2024-05-30T17:07:02.074364+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:23.181795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":89,"num_read_kb":364544,"num_write":85,"num_write_kb":319488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.296676+0000","last_change":"2024-05-30T17:04:26.650934+0000","last_active":"2024-05-30T17:04:48.296676+0000","last_peered":"2024-05-30T17:04:48.296676+0000","last_clean":"2024-05-30T17:04:48.296676+0000","last_became_active":"2024-05-30T17:04:26.650668+0000","last_became_peered":"2024-05-30T17:04:26.650668+0000","last_unstale":"2024-05-30T17:04:48.296676+0000","last_undegraded":"2024-05-30T17:04:48.296676+0000","last_fullsized":"2024-05-30T17:04:48.296676+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:04.028994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"133'140","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072051+0000","last_change":"2024-05-30T17:04:27.653284+0000","last_active":"2024-05-30T17:07:02.072051+0000","last_peered":"2024-05-30T17:07:02.072051+0000","last_clean":"2024-05-30T17:07:02.072051+0000","last_became_active":"2024-05-30T17:04:27.653020+0000","last_became_peered":"2024-05-30T17:04:27.653020+0000","last_unstale":"2024-05-30T17:07:02.072051+0000","last_undegraded":"2024-05-30T17:07:02.072051+0000","last_fullsized":"2024-05-30T17:07:02.072051+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:21.704608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":70,"num_read_kb":278530,"num_write":74,"num_write_kb":262145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.283847+0000","last_change":"2024-05-30T17:04:26.642168+0000","last_active":"2024-05-30T17:04:48.283847+0000","last_peered":"2024-05-30T17:04:48.283847+0000","last_clean":"2024-05-30T17:04:48.283847+0000","last_became_active":"2024-05-30T17:04:26.641791+0000","last_became_peered":"2024-05-30T17:04:26.641791+0000","last_unstale":"2024-05-30T17:04:48.283847+0000","last_undegraded":"2024-05-30T17:04:48.283847+0000","last_fullsized":"2024-05-30T17:04:48.283847+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:06:45.068461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"133'134","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.066277+0000","last_change":"2024-05-30T17:04:27.648200+0000","last_active":"2024-05-30T17:07:02.066277+0000","last_peered":"2024-05-30T17:07:02.066277+0000","last_clean":"2024-05-30T17:07:02.066277+0000","last_became_active":"2024-05-30T17:04:27.647928+0000","last_became_peered":"2024-05-30T17:04:27.647928+0000","last_unstale":"2024-05-30T17:07:02.066277+0000","last_undegraded":"2024-05-30T17:07:02.066277+0000","last_fullsized":"2024-05-30T17:07:02.066277+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:25:31.744496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":75,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.391606+0000","last_change":"2024-05-30T17:04:26.645457+0000","last_active":"2024-05-30T17:04:48.391606+0000","last_peered":"2024-05-30T17:04:48.391606+0000","last_clean":"2024-05-30T17:04:48.391606+0000","last_became_active":"2024-05-30T17:04:26.642988+0000","last_became_peered":"2024-05-30T17:04:26.642988+0000","last_unstale":"2024-05-30T17:04:48.391606+0000","last_undegraded":"2024-05-30T17:04:48.391606+0000","last_fullsized":"2024-05-30T17:04:48.391606+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:51:19.024263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"133'122","reported_seq":174,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078137+0000","last_change":"2024-05-30T17:04:27.654579+0000","last_active":"2024-05-30T17:07:02.078137+0000","last_peered":"2024-05-30T17:07:02.078137+0000","last_clean":"2024-05-30T17:07:02.078137+0000","last_became_active":"2024-05-30T17:04:27.654315+0000","last_became_peered":"2024-05-30T17:04:27.654315+0000","last_unstale":"2024-05-30T17:07:02.078137+0000","last_undegraded":"2024-05-30T17:07:02.078137+0000","last_fullsized":"2024-05-30T17:07:02.078137+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:42.109985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":35,"num_read_kb":143360,"num_write":60,"num_write_kb":217088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"133'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:10.717567+0000","last_change":"2024-05-30T17:04:26.653783+0000","last_active":"2024-05-30T17:05:10.717567+0000","last_peered":"2024-05-30T17:05:10.717567+0000","last_clean":"2024-05-30T17:05:10.717567+0000","last_became_active":"2024-05-30T17:04:26.653413+0000","last_became_peered":"2024-05-30T17:04:26.653413+0000","last_unstale":"2024-05-30T17:05:10.717567+0000","last_undegraded":"2024-05-30T17:05:10.717567+0000","last_fullsized":"2024-05-30T17:05:10.717567+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:47.810832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"133'120","reported_seq":177,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.062511+0000","last_change":"2024-05-30T17:04:27.670112+0000","last_active":"2024-05-30T17:07:02.062511+0000","last_peered":"2024-05-30T17:07:02.062511+0000","last_clean":"2024-05-30T17:07:02.062511+0000","last_became_active":"2024-05-30T17:04:27.669759+0000","last_became_peered":"2024-05-30T17:04:27.669759+0000","last_unstale":"2024-05-30T17:07:02.062511+0000","last_undegraded":"2024-05-30T17:07:02.062511+0000","last_fullsized":"2024-05-30T17:07:02.062511+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:28:30.371308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881204,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":40,"num_read_kb":159745,"num_write":65,"num_write_kb":245761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.297131+0000","last_change":"2024-05-30T17:04:26.649285+0000","last_active":"2024-05-30T17:04:48.297131+0000","last_peered":"2024-05-30T17:04:48.297131+0000","last_clean":"2024-05-30T17:04:48.297131+0000","last_became_active":"2024-05-30T17:04:26.648983+0000","last_became_peered":"2024-05-30T17:04:26.648983+0000","last_unstale":"2024-05-30T17:04:48.297131+0000","last_undegraded":"2024-05-30T17:04:48.297131+0000","last_fullsized":"2024-05-30T17:04:48.297131+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:19.123667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"133'124","reported_seq":217,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074664+0000","last_change":"2024-05-30T17:04:27.661122+0000","last_active":"2024-05-30T17:07:02.074664+0000","last_peered":"2024-05-30T17:07:02.074664+0000","last_clean":"2024-05-30T17:07:02.074664+0000","last_became_active":"2024-05-30T17:04:27.660791+0000","last_became_peered":"2024-05-30T17:04:27.660791+0000","last_unstale":"2024-05-30T17:07:02.074664+0000","last_undegraded":"2024-05-30T17:07:02.074664+0000","last_fullsized":"2024-05-30T17:07:02.074664+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:44:34.412222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":76,"num_read_kb":311296,"num_write":81,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"133'25","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:11.774245+0000","last_change":"2024-05-30T17:04:26.655873+0000","last_active":"2024-05-30T17:06:11.774245+0000","last_peered":"2024-05-30T17:06:11.774245+0000","last_clean":"2024-05-30T17:06:11.774245+0000","last_became_active":"2024-05-30T17:04:26.655436+0000","last_became_peered":"2024-05-30T17:04:26.655436+0000","last_unstale":"2024-05-30T17:06:11.774245+0000","last_undegraded":"2024-05-30T17:06:11.774245+0000","last_fullsized":"2024-05-30T17:06:11.774245+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:41.100872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"133'121","reported_seq":200,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071846+0000","last_change":"2024-05-30T17:04:27.655308+0000","last_active":"2024-05-30T17:07:02.071846+0000","last_peered":"2024-05-30T17:07:02.071846+0000","last_clean":"2024-05-30T17:07:02.071846+0000","last_became_active":"2024-05-30T17:04:27.654682+0000","last_became_peered":"2024-05-30T17:04:27.654682+0000","last_unstale":"2024-05-30T17:07:02.071846+0000","last_undegraded":"2024-05-30T17:07:02.071846+0000","last_fullsized":"2024-05-30T17:07:02.071846+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:13:50.711493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":62,"num_read_kb":237572,"num_write":64,"num_write_kb":221186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"133'445","reported_seq":464,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.024243+0000","last_change":"2024-05-30T17:04:26.644996+0000","last_active":"2024-05-30T17:07:02.024243+0000","last_peered":"2024-05-30T17:07:02.024243+0000","last_clean":"2024-05-30T17:07:02.024243+0000","last_became_active":"2024-05-30T17:04:26.644394+0000","last_became_peered":"2024-05-30T17:04:26.644394+0000","last_unstale":"2024-05-30T17:07:02.024243+0000","last_undegraded":"2024-05-30T17:07:02.024243+0000","last_fullsized":"2024-05-30T17:07:02.024243+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:32:48.916197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":1814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"133'140","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071163+0000","last_change":"2024-05-30T17:04:27.667231+0000","last_active":"2024-05-30T17:07:02.071163+0000","last_peered":"2024-05-30T17:07:02.071163+0000","last_clean":"2024-05-30T17:07:02.071163+0000","last_became_active":"2024-05-30T17:04:27.666778+0000","last_became_peered":"2024-05-30T17:04:27.666778+0000","last_unstale":"2024-05-30T17:07:02.071163+0000","last_undegraded":"2024-05-30T17:07:02.071163+0000","last_fullsized":"2024-05-30T17:07:02.071163+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:05:27.633461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":51,"num_read_kb":204801,"num_write":86,"num_write_kb":315393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.280865+0000","last_change":"2024-05-30T17:04:26.648513+0000","last_active":"2024-05-30T17:04:48.280865+0000","last_peered":"2024-05-30T17:04:48.280865+0000","last_clean":"2024-05-30T17:04:48.280865+0000","last_became_active":"2024-05-30T17:04:26.648016+0000","last_became_peered":"2024-05-30T17:04:26.648016+0000","last_unstale":"2024-05-30T17:04:48.280865+0000","last_undegraded":"2024-05-30T17:04:48.280865+0000","last_fullsized":"2024-05-30T17:04:48.280865+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:19.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"133'138","reported_seq":213,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075471+0000","last_change":"2024-05-30T17:04:27.647201+0000","last_active":"2024-05-30T17:07:02.075471+0000","last_peered":"2024-05-30T17:07:02.075471+0000","last_clean":"2024-05-30T17:07:02.075471+0000","last_became_active":"2024-05-30T17:04:27.646842+0000","last_became_peered":"2024-05-30T17:04:27.646842+0000","last_unstale":"2024-05-30T17:07:02.075471+0000","last_undegraded":"2024-05-30T17:07:02.075471+0000","last_fullsized":"2024-05-30T17:07:02.075471+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:42.109985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":87,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.391719+0000","last_change":"2024-05-30T17:04:26.643372+0000","last_active":"2024-05-30T17:04:48.391719+0000","last_peered":"2024-05-30T17:04:48.391719+0000","last_clean":"2024-05-30T17:04:48.391719+0000","last_became_active":"2024-05-30T17:04:26.641530+0000","last_became_peered":"2024-05-30T17:04:26.641530+0000","last_unstale":"2024-05-30T17:04:48.391719+0000","last_undegraded":"2024-05-30T17:04:48.391719+0000","last_fullsized":"2024-05-30T17:04:48.391719+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:28.821395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"133'158","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.068945+0000","last_change":"2024-05-30T17:04:27.663493+0000","last_active":"2024-05-30T17:07:02.068945+0000","last_peered":"2024-05-30T17:07:02.068945+0000","last_clean":"2024-05-30T17:07:02.068945+0000","last_became_active":"2024-05-30T17:04:27.662912+0000","last_became_peered":"2024-05-30T17:04:27.662912+0000","last_unstale":"2024-05-30T17:07:02.068945+0000","last_undegraded":"2024-05-30T17:07:02.068945+0000","last_fullsized":"2024-05-30T17:07:02.068945+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:12:24.226617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544581,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":99,"num_write_kb":364545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"130'8","reported_seq":27,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.331297+0000","last_change":"2024-05-30T17:04:26.651768+0000","last_active":"2024-05-30T17:04:48.331297+0000","last_peered":"2024-05-30T17:04:48.331297+0000","last_clean":"2024-05-30T17:04:48.331297+0000","last_became_active":"2024-05-30T17:04:26.651470+0000","last_became_peered":"2024-05-30T17:04:26.651470+0000","last_unstale":"2024-05-30T17:04:48.331297+0000","last_undegraded":"2024-05-30T17:04:48.331297+0000","last_fullsized":"2024-05-30T17:04:48.331297+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:51:21.096723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"133'115","reported_seq":158,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071224+0000","last_change":"2024-05-30T17:04:27.656826+0000","last_active":"2024-05-30T17:07:02.071224+0000","last_peered":"2024-05-30T17:07:02.071224+0000","last_clean":"2024-05-30T17:07:02.071224+0000","last_became_active":"2024-05-30T17:04:27.656527+0000","last_became_peered":"2024-05-30T17:04:27.656527+0000","last_unstale":"2024-05-30T17:07:02.071224+0000","last_undegraded":"2024-05-30T17:07:02.071224+0000","last_fullsized":"2024-05-30T17:07:02.071224+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:53.659379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":26,"num_read_kb":94211,"num_write":61,"num_write_kb":212993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.285745+0000","last_change":"2024-05-30T17:04:26.646106+0000","last_active":"2024-05-30T17:04:48.285745+0000","last_peered":"2024-05-30T17:04:48.285745+0000","last_clean":"2024-05-30T17:04:48.285745+0000","last_became_active":"2024-05-30T17:04:26.645435+0000","last_became_peered":"2024-05-30T17:04:26.645435+0000","last_unstale":"2024-05-30T17:04:48.285745+0000","last_undegraded":"2024-05-30T17:04:48.285745+0000","last_fullsized":"2024-05-30T17:04:48.285745+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:55.135303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"133'154","reported_seq":246,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.064901+0000","last_change":"2024-05-30T17:04:27.666627+0000","last_active":"2024-05-30T17:07:02.064901+0000","last_peered":"2024-05-30T17:07:02.064901+0000","last_clean":"2024-05-30T17:07:02.064901+0000","last_became_active":"2024-05-30T17:04:27.666318+0000","last_became_peered":"2024-05-30T17:04:27.666318+0000","last_unstale":"2024-05-30T17:07:02.064901+0000","last_undegraded":"2024-05-30T17:07:02.064901+0000","last_fullsized":"2024-05-30T17:07:02.064901+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:45:56.513914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":102,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"130'2","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.277928+0000","last_change":"2024-05-30T17:04:26.649232+0000","last_active":"2024-05-30T17:04:48.277928+0000","last_peered":"2024-05-30T17:04:48.277928+0000","last_clean":"2024-05-30T17:04:48.277928+0000","last_became_active":"2024-05-30T17:04:26.648936+0000","last_became_peered":"2024-05-30T17:04:26.648936+0000","last_unstale":"2024-05-30T17:04:48.277928+0000","last_undegraded":"2024-05-30T17:04:48.277928+0000","last_fullsized":"2024-05-30T17:04:48.277928+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:05:44.049119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"133'130","reported_seq":205,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.391842+0000","last_change":"2024-05-30T17:04:27.657488+0000","last_active":"2024-05-30T17:06:47.391842+0000","last_peered":"2024-05-30T17:06:47.391842+0000","last_clean":"2024-05-30T17:06:47.391842+0000","last_became_active":"2024-05-30T17:04:27.657216+0000","last_became_peered":"2024-05-30T17:04:27.657216+0000","last_unstale":"2024-05-30T17:06:47.391842+0000","last_undegraded":"2024-05-30T17:06:47.391842+0000","last_fullsized":"2024-05-30T17:06:47.391842+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:18.543050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909897,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":58,"num_read_kb":221188,"num_write":75,"num_write_kb":241669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.284309+0000","last_change":"2024-05-30T17:04:26.652397+0000","last_active":"2024-05-30T17:04:48.284309+0000","last_peered":"2024-05-30T17:04:48.284309+0000","last_clean":"2024-05-30T17:04:48.284309+0000","last_became_active":"2024-05-30T17:04:26.652083+0000","last_became_peered":"2024-05-30T17:04:26.652083+0000","last_unstale":"2024-05-30T17:04:48.284309+0000","last_undegraded":"2024-05-30T17:04:48.284309+0000","last_fullsized":"2024-05-30T17:04:48.284309+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:17.631736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"133'141","reported_seq":233,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.077211+0000","last_change":"2024-05-30T17:04:27.649124+0000","last_active":"2024-05-30T17:07:02.077211+0000","last_peered":"2024-05-30T17:07:02.077211+0000","last_clean":"2024-05-30T17:07:02.077211+0000","last_became_active":"2024-05-30T17:04:27.648847+0000","last_became_peered":"2024-05-30T17:04:27.648847+0000","last_unstale":"2024-05-30T17:07:02.077211+0000","last_undegraded":"2024-05-30T17:07:02.077211+0000","last_fullsized":"2024-05-30T17:07:02.077211+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:42:59.091789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":89,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.285619+0000","last_change":"2024-05-30T17:04:26.646336+0000","last_active":"2024-05-30T17:04:48.285619+0000","last_peered":"2024-05-30T17:04:48.285619+0000","last_clean":"2024-05-30T17:04:48.285619+0000","last_became_active":"2024-05-30T17:04:26.646025+0000","last_became_peered":"2024-05-30T17:04:26.646025+0000","last_unstale":"2024-05-30T17:04:48.285619+0000","last_undegraded":"2024-05-30T17:04:48.285619+0000","last_fullsized":"2024-05-30T17:04:48.285619+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:34.972669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"133'147","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.045813+0000","last_change":"2024-05-30T17:04:27.654618+0000","last_active":"2024-05-30T17:07:02.045813+0000","last_peered":"2024-05-30T17:07:02.045813+0000","last_clean":"2024-05-30T17:07:02.045813+0000","last_became_active":"2024-05-30T17:04:27.653888+0000","last_became_peered":"2024-05-30T17:04:27.653888+0000","last_unstale":"2024-05-30T17:07:02.045813+0000","last_undegraded":"2024-05-30T17:07:02.045813+0000","last_fullsized":"2024-05-30T17:07:02.045813+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:34.447493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":89,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"133'3","reported_seq":22,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:10.719775+0000","last_change":"2024-05-30T17:04:26.657719+0000","last_active":"2024-05-30T17:05:10.719775+0000","last_peered":"2024-05-30T17:05:10.719775+0000","last_clean":"2024-05-30T17:05:10.719775+0000","last_became_active":"2024-05-30T17:04:26.657452+0000","last_became_peered":"2024-05-30T17:04:26.657452+0000","last_unstale":"2024-05-30T17:05:10.719775+0000","last_undegraded":"2024-05-30T17:05:10.719775+0000","last_fullsized":"2024-05-30T17:05:10.719775+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:02.780429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"133'144","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072479+0000","last_change":"2024-05-30T17:04:27.649752+0000","last_active":"2024-05-30T17:07:02.072479+0000","last_peered":"2024-05-30T17:07:02.072479+0000","last_clean":"2024-05-30T17:07:02.072479+0000","last_became_active":"2024-05-30T17:04:27.649442+0000","last_became_peered":"2024-05-30T17:04:27.649442+0000","last_unstale":"2024-05-30T17:07:02.072479+0000","last_undegraded":"2024-05-30T17:07:02.072479+0000","last_fullsized":"2024-05-30T17:07:02.072479+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:38:19.022224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":66,"num_read_kb":241671,"num_write":82,"num_write_kb":278531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.296766+0000","last_change":"2024-05-30T17:04:26.645875+0000","last_active":"2024-05-30T17:04:48.296766+0000","last_peered":"2024-05-30T17:04:48.296766+0000","last_clean":"2024-05-30T17:04:48.296766+0000","last_became_active":"2024-05-30T17:04:26.645583+0000","last_became_peered":"2024-05-30T17:04:26.645583+0000","last_unstale":"2024-05-30T17:04:48.296766+0000","last_undegraded":"2024-05-30T17:04:48.296766+0000","last_fullsized":"2024-05-30T17:04:48.296766+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:03.486308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"133'147","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.068705+0000","last_change":"2024-05-30T17:04:27.652007+0000","last_active":"2024-05-30T17:07:02.068705+0000","last_peered":"2024-05-30T17:07:02.068705+0000","last_clean":"2024-05-30T17:07:02.068705+0000","last_became_active":"2024-05-30T17:04:27.651701+0000","last_became_peered":"2024-05-30T17:04:27.651701+0000","last_unstale":"2024-05-30T17:07:02.068705+0000","last_undegraded":"2024-05-30T17:07:02.068705+0000","last_fullsized":"2024-05-30T17:07:02.068705+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:57.885952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":91,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.296204+0000","last_change":"2024-05-30T17:04:26.647421+0000","last_active":"2024-05-30T17:04:48.296204+0000","last_peered":"2024-05-30T17:04:48.296204+0000","last_clean":"2024-05-30T17:04:48.296204+0000","last_became_active":"2024-05-30T17:04:26.647155+0000","last_became_peered":"2024-05-30T17:04:26.647155+0000","last_unstale":"2024-05-30T17:04:48.296204+0000","last_undegraded":"2024-05-30T17:04:48.296204+0000","last_fullsized":"2024-05-30T17:04:48.296204+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:59:52.705838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"133'135","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078368+0000","last_change":"2024-05-30T17:04:27.667584+0000","last_active":"2024-05-30T17:07:02.078368+0000","last_peered":"2024-05-30T17:07:02.078368+0000","last_clean":"2024-05-30T17:07:02.078368+0000","last_became_active":"2024-05-30T17:04:27.667268+0000","last_became_peered":"2024-05-30T17:04:27.667268+0000","last_unstale":"2024-05-30T17:07:02.078368+0000","last_undegraded":"2024-05-30T17:07:02.078368+0000","last_fullsized":"2024-05-30T17:07:02.078368+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:45.213871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230686720,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":56,"num_read_kb":229376,"num_write":75,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.277625+0000","last_change":"2024-05-30T17:04:26.650930+0000","last_active":"2024-05-30T17:04:48.277625+0000","last_peered":"2024-05-30T17:04:48.277625+0000","last_clean":"2024-05-30T17:04:48.277625+0000","last_became_active":"2024-05-30T17:04:26.650616+0000","last_became_peered":"2024-05-30T17:04:26.650616+0000","last_unstale":"2024-05-30T17:04:48.277625+0000","last_undegraded":"2024-05-30T17:04:48.277625+0000","last_fullsized":"2024-05-30T17:04:48.277625+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:44.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"133'153","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.066680+0000","last_change":"2024-05-30T17:04:27.664544+0000","last_active":"2024-05-30T17:07:02.066680+0000","last_peered":"2024-05-30T17:07:02.066680+0000","last_clean":"2024-05-30T17:07:02.066680+0000","last_became_active":"2024-05-30T17:04:27.664180+0000","last_became_peered":"2024-05-30T17:04:27.664180+0000","last_unstale":"2024-05-30T17:07:02.066680+0000","last_undegraded":"2024-05-30T17:07:02.066680+0000","last_fullsized":"2024-05-30T17:07:02.066680+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:59.508295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":96,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"130'2","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.280667+0000","last_change":"2024-05-30T17:04:26.653129+0000","last_active":"2024-05-30T17:04:48.280667+0000","last_peered":"2024-05-30T17:04:48.280667+0000","last_clean":"2024-05-30T17:04:48.280667+0000","last_became_active":"2024-05-30T17:04:26.652234+0000","last_became_peered":"2024-05-30T17:04:26.652234+0000","last_unstale":"2024-05-30T17:04:48.280667+0000","last_undegraded":"2024-05-30T17:04:48.280667+0000","last_fullsized":"2024-05-30T17:04:48.280667+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:12.851756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"133'138","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.077318+0000","last_change":"2024-05-30T17:04:27.656246+0000","last_active":"2024-05-30T17:07:02.077318+0000","last_peered":"2024-05-30T17:07:02.077318+0000","last_clean":"2024-05-30T17:07:02.077318+0000","last_became_active":"2024-05-30T17:04:27.655926+0000","last_became_peered":"2024-05-30T17:04:27.655926+0000","last_unstale":"2024-05-30T17:07:02.077318+0000","last_undegraded":"2024-05-30T17:07:02.077318+0000","last_fullsized":"2024-05-30T17:07:02.077318+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:03.789542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":90,"num_write_kb":319489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"133'41","reported_seq":60,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:46.695559+0000","last_change":"2024-05-30T17:04:26.649574+0000","last_active":"2024-05-30T17:06:46.695559+0000","last_peered":"2024-05-30T17:06:46.695559+0000","last_clean":"2024-05-30T17:06:46.695559+0000","last_became_active":"2024-05-30T17:04:26.648998+0000","last_became_peered":"2024-05-30T17:04:26.648998+0000","last_unstale":"2024-05-30T17:06:46.695559+0000","last_undegraded":"2024-05-30T17:06:46.695559+0000","last_fullsized":"2024-05-30T17:06:46.695559+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:35:25.197491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"133'132","reported_seq":237,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072558+0000","last_change":"2024-05-30T17:04:27.654582+0000","last_active":"2024-05-30T17:07:02.072558+0000","last_peered":"2024-05-30T17:07:02.072558+0000","last_clean":"2024-05-30T17:07:02.072558+0000","last_became_active":"2024-05-30T17:04:27.654295+0000","last_became_peered":"2024-05-30T17:04:27.654295+0000","last_unstale":"2024-05-30T17:07:02.072558+0000","last_undegraded":"2024-05-30T17:07:02.072558+0000","last_fullsized":"2024-05-30T17:07:02.072558+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:35.981782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":88,"num_read_kb":360448,"num_write":81,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.392097+0000","last_change":"2024-05-30T17:04:26.647328+0000","last_active":"2024-05-30T17:04:48.392097+0000","last_peered":"2024-05-30T17:04:48.392097+0000","last_clean":"2024-05-30T17:04:48.392097+0000","last_became_active":"2024-05-30T17:04:26.647058+0000","last_became_peered":"2024-05-30T17:04:26.647058+0000","last_unstale":"2024-05-30T17:04:48.392097+0000","last_undegraded":"2024-05-30T17:04:48.392097+0000","last_fullsized":"2024-05-30T17:04:48.392097+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:27:17.347396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"133'142","reported_seq":209,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078089+0000","last_change":"2024-05-30T17:04:27.657344+0000","last_active":"2024-05-30T17:07:02.078089+0000","last_peered":"2024-05-30T17:07:02.078089+0000","last_clean":"2024-05-30T17:07:02.078089+0000","last_became_active":"2024-05-30T17:04:27.657041+0000","last_became_peered":"2024-05-30T17:04:27.657041+0000","last_unstale":"2024-05-30T17:07:02.078089+0000","last_undegraded":"2024-05-30T17:07:02.078089+0000","last_fullsized":"2024-05-30T17:07:02.078089+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:46.552415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824186,"num_objects":68,"num_object_clones":1,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":51,"num_read_kb":200706,"num_write":94,"num_write_kb":315395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.277861+0000","last_change":"2024-05-30T17:04:26.655225+0000","last_active":"2024-05-30T17:04:48.277861+0000","last_peered":"2024-05-30T17:04:48.277861+0000","last_clean":"2024-05-30T17:04:48.277861+0000","last_became_active":"2024-05-30T17:04:26.654383+0000","last_became_peered":"2024-05-30T17:04:26.654383+0000","last_unstale":"2024-05-30T17:04:48.277861+0000","last_undegraded":"2024-05-30T17:04:48.277861+0000","last_fullsized":"2024-05-30T17:04:48.277861+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:36:35.798472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"133'142","reported_seq":214,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071377+0000","last_change":"2024-05-30T17:04:27.659619+0000","last_active":"2024-05-30T17:07:02.071377+0000","last_peered":"2024-05-30T17:07:02.071377+0000","last_clean":"2024-05-30T17:07:02.071377+0000","last_became_active":"2024-05-30T17:04:27.659316+0000","last_became_peered":"2024-05-30T17:04:27.659316+0000","last_unstale":"2024-05-30T17:07:02.071377+0000","last_undegraded":"2024-05-30T17:07:02.071377+0000","last_fullsized":"2024-05-30T17:07:02.071377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:29:40.214450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":88,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.391841+0000","last_change":"2024-05-30T17:04:26.643654+0000","last_active":"2024-05-30T17:04:48.391841+0000","last_peered":"2024-05-30T17:04:48.391841+0000","last_clean":"2024-05-30T17:04:48.391841+0000","last_became_active":"2024-05-30T17:04:26.642798+0000","last_became_peered":"2024-05-30T17:04:26.642798+0000","last_unstale":"2024-05-30T17:04:48.391841+0000","last_undegraded":"2024-05-30T17:04:48.391841+0000","last_fullsized":"2024-05-30T17:04:48.391841+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:22:19.720162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"133'151","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073260+0000","last_change":"2024-05-30T17:04:27.662540+0000","last_active":"2024-05-30T17:07:02.073260+0000","last_peered":"2024-05-30T17:07:02.073260+0000","last_clean":"2024-05-30T17:07:02.073260+0000","last_became_active":"2024-05-30T17:04:27.662294+0000","last_became_peered":"2024-05-30T17:04:27.662294+0000","last_unstale":"2024-05-30T17:07:02.073260+0000","last_undegraded":"2024-05-30T17:07:02.073260+0000","last_fullsized":"2024-05-30T17:07:02.073260+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:03.093546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":85,"num_read_kb":335875,"num_write":93,"num_write_kb":335873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.385120+0000","last_change":"2024-05-30T17:04:26.650407+0000","last_active":"2024-05-30T17:04:48.385120+0000","last_peered":"2024-05-30T17:04:48.385120+0000","last_clean":"2024-05-30T17:04:48.385120+0000","last_became_active":"2024-05-30T17:04:26.650063+0000","last_became_peered":"2024-05-30T17:04:26.650063+0000","last_unstale":"2024-05-30T17:04:48.385120+0000","last_undegraded":"2024-05-30T17:04:48.385120+0000","last_fullsized":"2024-05-30T17:04:48.385120+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:58.499182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"133'121","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.379618+0000","last_change":"2024-05-30T17:04:27.648839+0000","last_active":"2024-05-30T17:06:47.379618+0000","last_peered":"2024-05-30T17:06:47.379618+0000","last_clean":"2024-05-30T17:06:47.379618+0000","last_became_active":"2024-05-30T17:04:27.648558+0000","last_became_peered":"2024-05-30T17:04:27.648558+0000","last_unstale":"2024-05-30T17:06:47.379618+0000","last_undegraded":"2024-05-30T17:06:47.379618+0000","last_fullsized":"2024-05-30T17:06:47.379618+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:52.862600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":83,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"133'32","reported_seq":82,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:11.769701+0000","last_change":"2024-05-30T17:04:26.646155+0000","last_active":"2024-05-30T17:06:11.769701+0000","last_peered":"2024-05-30T17:06:11.769701+0000","last_clean":"2024-05-30T17:06:11.769701+0000","last_became_active":"2024-05-30T17:04:26.645855+0000","last_became_peered":"2024-05-30T17:04:26.645855+0000","last_unstale":"2024-05-30T17:06:11.769701+0000","last_undegraded":"2024-05-30T17:06:11.769701+0000","last_fullsized":"2024-05-30T17:06:11.769701+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:51.017861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4957,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":31,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"133'149","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073381+0000","last_change":"2024-05-30T17:04:27.657377+0000","last_active":"2024-05-30T17:07:02.073381+0000","last_peered":"2024-05-30T17:07:02.073381+0000","last_clean":"2024-05-30T17:07:02.073381+0000","last_became_active":"2024-05-30T17:04:27.657110+0000","last_became_peered":"2024-05-30T17:04:27.657110+0000","last_unstale":"2024-05-30T17:07:02.073381+0000","last_undegraded":"2024-05-30T17:07:02.073381+0000","last_fullsized":"2024-05-30T17:07:02.073381+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:03.789542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":76,"num_read_kb":311296,"num_write":106,"num_write_kb":380928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.277746+0000","last_change":"2024-05-30T17:04:26.646414+0000","last_active":"2024-05-30T17:04:48.277746+0000","last_peered":"2024-05-30T17:04:48.277746+0000","last_clean":"2024-05-30T17:04:48.277746+0000","last_became_active":"2024-05-30T17:04:26.646125+0000","last_became_peered":"2024-05-30T17:04:26.646125+0000","last_unstale":"2024-05-30T17:04:48.277746+0000","last_undegraded":"2024-05-30T17:04:48.277746+0000","last_fullsized":"2024-05-30T17:04:48.277746+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:29:39.205337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"133'138","reported_seq":202,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.067455+0000","last_change":"2024-05-30T17:04:27.668983+0000","last_active":"2024-05-30T17:07:02.067455+0000","last_peered":"2024-05-30T17:07:02.067455+0000","last_clean":"2024-05-30T17:07:02.067455+0000","last_became_active":"2024-05-30T17:04:27.668009+0000","last_became_peered":"2024-05-30T17:04:27.668009+0000","last_unstale":"2024-05-30T17:07:02.067455+0000","last_undegraded":"2024-05-30T17:07:02.067455+0000","last_fullsized":"2024-05-30T17:07:02.067455+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:05:39.653558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":47,"num_read_kb":192512,"num_write":88,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"130'2","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.385038+0000","last_change":"2024-05-30T17:04:26.656301+0000","last_active":"2024-05-30T17:04:48.385038+0000","last_peered":"2024-05-30T17:04:48.385038+0000","last_clean":"2024-05-30T17:04:48.385038+0000","last_became_active":"2024-05-30T17:04:26.655900+0000","last_became_peered":"2024-05-30T17:04:26.655900+0000","last_unstale":"2024-05-30T17:04:48.385038+0000","last_undegraded":"2024-05-30T17:04:48.385038+0000","last_fullsized":"2024-05-30T17:04:48.385038+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:18.390768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":384,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:02.147978+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:05:02.147978+0000","last_peered":"2024-05-30T17:05:02.147978+0000","last_clean":"2024-05-30T17:05:02.147978+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:05:02.147978+0000","last_undegraded":"2024-05-30T17:05:02.147978+0000","last_fullsized":"2024-05-30T17:05:02.147978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":17406362949,"num_objects":4158,"num_object_clones":1,"num_object_copies":8316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4158,"num_whiteouts":1,"num_read":4010,"num_read_kb":16171070,"num_write":5302,"num_write_kb":19193899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34812780544,"data_stored":34812725898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8748,"ondisk_log_size":8748,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1691903,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":625,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3448832,"data_stored":3383806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":576,"ondisk_log_size":576,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509660,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3774688,"kb_used_data":3657496,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":90597152,"statfs":{"total":96636764160,"available":92771483648,"internally_reserved":0,"allocated":3745275904,"data_stored":3744324606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509661,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4762904,"kb_used_data":4627664,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89608936,"statfs":{"total":96636764160,"available":91759550464,"internally_reserved":0,"allocated":4738727936,"data_stored":4737788432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509661,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3647204,"kb_used_data":3507804,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":90724636,"statfs":{"total":96636764160,"available":92902027264,"internally_reserved":0,"allocated":3591991296,"data_stored":3591052876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509662,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5289824,"kb_used_data":5142104,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":89082016,"statfs":{"total":96636764160,"available":91219984384,"internally_reserved":0,"allocated":5265514496,"data_stored":5264580072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509661,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5605036,"kb_used_data":5469796,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":88766804,"statfs":{"total":96636764160,"available":90897207296,"internally_reserved":0,"allocated":5601071104,"data_stored":5600125202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509661,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4081496,"kb_used_data":3933776,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90290344,"statfs":{"total":96636764160,"available":92457312256,"internally_reserved":0,"allocated":4028186624,"data_stored":4027260071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509661,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3721624,"kb_used_data":3573904,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90650216,"statfs":{"total":96636764160,"available":92825821184,"internally_reserved":0,"allocated":3659677696,"data_stored":3658751555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542365,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4236976,"kb_used_data":4101736,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":90134864,"statfs":{"total":96636764160,"available":92298100736,"internally_reserved":0,"allocated":4200177664,"data_stored":4199232093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":138475975},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1703936,"data_stored":1691105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1708032,"data_stored":1686786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3657433088,"data_stored":3657433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4026535936,"data_stored":4026531972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5599412224,"data_stored":5599396487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4198510592,"data_stored":4198498877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5263859712,"data_stored":5263851903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3590332416,"data_stored":3590324665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4735373312,"data_stored":4735369477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3741323264,"data_stored":3741319429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:07:03.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:07:03.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed35e00640 1 Processor -- start 2024-05-30T17:07:03.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed35e00640 1 -- start start 2024-05-30T17:07:03.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed35e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed300af720 0x7fed3015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:03.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed35e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d0560 0x7fed300d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:03.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed35e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3015f060 con 0x7fed3006e900 2024-05-30T17:07:03.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed35e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fed300afb00 con 0x7fed300af720 2024-05-30T17:07:03.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed35e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fed3015c270 con 0x7fed300d0560 2024-05-30T17:07:03.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed2ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed300af720 0x7fed3015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:03.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed2ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed300af720 0x7fed3015b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46028/0 (socket says 172.21.15.59:46028) 2024-05-30T17:07:03.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed2ea00640 1 -- 172.21.15.59:0/2599407403 learned_addr learned my addr 172.21.15.59:0/2599407403 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:03.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed2f400640 1 --2- 172.21.15.59:0/2599407403 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d0560 0x7fed300d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:03.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed2ea00640 1 -- 172.21.15.59:0/2599407403 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d0560 msgr2=0x7fed300d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:03.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed2ea00640 1 --2- 172.21.15.59:0/2599407403 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d0560 0x7fed300d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed2ea00640 1 -- 172.21.15.59:0/2599407403 >> v1:172.21.15.107:6789/0 conn(0x7fed3006e900 legacy=0x7fed3015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:03.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.827+0000 7fed2ea00640 1 -- 172.21.15.59:0/2599407403 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3015ff00 con 0x7fed300af720 2024-05-30T17:07:03.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.831+0000 7fed2ea00640 1 --2- 172.21.15.59:0/2599407403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300af720 0x7fed3015b9d0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fed20009870 tx=0x7fed2001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343be35ebeaa0f57 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:03.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.831+0000 7fed2d600640 1 -- 172.21.15.59:0/2599407403 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed200ab650 con 0x7fed300af720 2024-05-30T17:07:03.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.831+0000 7fed2d600640 1 -- 172.21.15.59:0/2599407403 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed200b0070 con 0x7fed300af720 2024-05-30T17:07:03.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.831+0000 7fed2d600640 1 -- 172.21.15.59:0/2599407403 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed200aba10 con 0x7fed300af720 2024-05-30T17:07:03.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.831+0000 7fed35e00640 1 -- 172.21.15.59:0/2599407403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300af720 msgr2=0x7fed3015b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:03.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.831+0000 7fed35e00640 1 --2- 172.21.15.59:0/2599407403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300af720 0x7fed3015b9d0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fed20009870 tx=0x7fed2001c560 comp rx=0 tx=0).stop 2024-05-30T17:07:03.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.831+0000 7fed35e00640 1 -- 172.21.15.59:0/2599407403 shutdown_connections 2024-05-30T17:07:03.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.831+0000 7fed35e00640 1 --2- 172.21.15.59:0/2599407403 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d0560 0x7fed300d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.831+0000 7fed35e00640 1 --2- 172.21.15.59:0/2599407403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300af720 0x7fed3015b9d0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.831+0000 7fed35e00640 1 -- 172.21.15.59:0/2599407403 >> 172.21.15.59:0/2599407403 conn(0x7fed300b22d0 msgr2=0x7fed300b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:03.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.831+0000 7fed35e00640 1 -- 172.21.15.59:0/2599407403 shutdown_connections 2024-05-30T17:07:03.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.831+0000 7fed35e00640 1 -- 172.21.15.59:0/2599407403 wait complete. 2024-05-30T17:07:03.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed35e00640 1 Processor -- start 2024-05-30T17:07:03.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed35e00640 1 -- start start 2024-05-30T17:07:03.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed35e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed3006e900 0x7fed3009ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:03.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed35e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300af720 0x7fed3015e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:03.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed35e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d0560 0x7fed3009a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:03.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed35e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fed30073150 con 0x7fed300af720 2024-05-30T17:07:03.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed35e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fed3015c830 con 0x7fed3006e900 2024-05-30T17:07:03.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed35e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fed300732d0 con 0x7fed300d0560 2024-05-30T17:07:03.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300af720 0x7fed3015e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:03.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed3006e900 0x7fed3009ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:03.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed3006e900 0x7fed3009ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:38348/0 (socket says 172.21.15.59:38348) 2024-05-30T17:07:03.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2ea00640 1 -- 172.21.15.59:0/592019528 learned_addr learned my addr 172.21.15.59:0/592019528 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:03.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2f400640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d0560 0x7fed3009a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:03.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300af720 0x7fed3015e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46034/0 (socket says 172.21.15.59:46034) 2024-05-30T17:07:03.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2e000640 1 -- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d0560 msgr2=0x7fed3009a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:03.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2e000640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d0560 0x7fed3009a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2e000640 1 -- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed3006e900 msgr2=0x7fed3009ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:03.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2e000640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed3006e900 0x7fed3009ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:03.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2e000640 1 -- 172.21.15.59:0/592019528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3009aed0 con 0x7fed300af720 2024-05-30T17:07:03.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2ea00640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed3006e900 0x7fed3009ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:07:03.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2f400640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d0560 0x7fed3009a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:07:03.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed2e000640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300af720 0x7fed3015e890 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00c390 tx=0x7fed1c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:03.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed27400640 1 -- 172.21.15.59:0/592019528 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c0052d0 con 0x7fed300af720 2024-05-30T17:07:03.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed27400640 1 -- 172.21.15.59:0/592019528 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1c005470 con 0x7fed300af720 2024-05-30T17:07:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed35e00640 1 -- 172.21.15.59:0/592019528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3009d500 con 0x7fed300af720 2024-05-30T17:07:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed27400640 1 -- 172.21.15.59:0/592019528 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c007260 con 0x7fed300af720 2024-05-30T17:07:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed35e00640 1 -- 172.21.15.59:0/592019528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3009dac0 con 0x7fed300af720 2024-05-30T17:07:03.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.835+0000 7fed35e00640 1 -- 172.21.15.59:0/592019528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed30145ec0 con 0x7fed300af720 2024-05-30T17:07:03.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.839+0000 7fed27400640 1 -- 172.21.15.59:0/592019528 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7fed1c007400 con 0x7fed300af720 2024-05-30T17:07:03.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.839+0000 7fed27400640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed1006a150 0x7fed1006c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:03.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.839+0000 7fed27400640 1 -- 172.21.15.59:0/592019528 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fed1c084c90 con 0x7fed300af720 2024-05-30T17:07:03.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.839+0000 7fed2ea00640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed1006a150 0x7fed1006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:03.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.839+0000 7fed2ea00640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed1006a150 0x7fed1006c610 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fed2001c5a0 tx=0x7fed200a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:03.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:03.843+0000 7fed27400640 1 -- 172.21.15.59:0/592019528 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed30145ec0 con 0x7fed300af720 2024-05-30T17:07:04.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.003+0000 7fed35e00640 1 -- 172.21.15.59:0/592019528 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed30068a90 con 0x7fed1006a150 2024-05-30T17:07:04.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.011+0000 7fed27400640 1 -- 172.21.15.59:0/592019528 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255026 (secure 0 0 0) 0x7fed30068a90 con 0x7fed1006a150 2024-05-30T17:07:04.015 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:07:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:07:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.015+0000 7fed35e00640 1 -- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed1006a150 msgr2=0x7fed1006c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.015+0000 7fed35e00640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed1006a150 0x7fed1006c610 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fed2001c5a0 tx=0x7fed200a7000 comp rx=0 tx=0).stop 2024-05-30T17:07:04.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.015+0000 7fed35e00640 1 -- 172.21.15.59:0/592019528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300af720 msgr2=0x7fed3015e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.015+0000 7fed35e00640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300af720 0x7fed3015e890 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00c390 tx=0x7fed1c00c850 comp rx=0 tx=0).stop 2024-05-30T17:07:04.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.015+0000 7fed35e00640 1 -- 172.21.15.59:0/592019528 shutdown_connections 2024-05-30T17:07:04.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.015+0000 7fed35e00640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fed1006a150 0x7fed1006c610 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.015+0000 7fed35e00640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed300d0560 0x7fed3009a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.015+0000 7fed35e00640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed300af720 0x7fed3015e890 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.015+0000 7fed35e00640 1 --2- 172.21.15.59:0/592019528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed3006e900 0x7fed3009ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.015+0000 7fed35e00640 1 -- 172.21.15.59:0/592019528 >> 172.21.15.59:0/592019528 conn(0x7fed300b22d0 msgr2=0x7fed3015a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:04.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.015+0000 7fed35e00640 1 -- 172.21.15.59:0/592019528 shutdown_connections 2024-05-30T17:07:04.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.015+0000 7fed35e00640 1 -- 172.21.15.59:0/592019528 wait complete. 2024-05-30T17:07:04.036 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":672,"stamp":"2024-05-30T17:07:03.435452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":17408645220,"num_objects":4183,"num_object_clones":1,"num_object_copies":8366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4183,"num_whiteouts":1,"num_read":4157,"num_read_kb":16171201,"num_write":6086,"num_write_kb":19198217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9441,"ondisk_log_size":9441,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":35119752,"kb_used_data":34014280,"kb_used_omap":12,"kb_used_meta":1105395,"kb_avail":719854968,"statfs":{"total":773094113280,"available":737131487232,"internally_reserved":0,"allocated":34830622720,"data_stored":34823114907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1131925040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":763,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003807"},"pg_stats":[{"pgid":"19.3f","version":"133'147","reported_seq":236,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073322+0000","last_change":"2024-05-30T17:04:48.466651+0000","last_active":"2024-05-30T17:07:02.073322+0000","last_peered":"2024-05-30T17:07:02.073322+0000","last_clean":"2024-05-30T17:07:02.073322+0000","last_became_active":"2024-05-30T17:04:48.283571+0000","last_became_peered":"2024-05-30T17:04:48.283571+0000","last_unstale":"2024-05-30T17:07:02.073322+0000","last_undegraded":"2024-05-30T17:07:02.073322+0000","last_fullsized":"2024-05-30T17:07:02.073322+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:08:42.536278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":80,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3e","version":"133'152","reported_seq":237,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.079817+0000","last_change":"2024-05-30T17:04:27.651522+0000","last_active":"2024-05-30T17:07:02.079817+0000","last_peered":"2024-05-30T17:07:02.079817+0000","last_clean":"2024-05-30T17:07:02.079817+0000","last_became_active":"2024-05-30T17:04:27.649831+0000","last_became_peered":"2024-05-30T17:04:27.649831+0000","last_unstale":"2024-05-30T17:07:02.079817+0000","last_undegraded":"2024-05-30T17:07:02.079817+0000","last_fullsized":"2024-05-30T17:07:02.079817+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:56.144416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":92,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"133'142","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074186+0000","last_change":"2024-05-30T17:04:27.662273+0000","last_active":"2024-05-30T17:07:02.074186+0000","last_peered":"2024-05-30T17:07:02.074186+0000","last_clean":"2024-05-30T17:07:02.074186+0000","last_became_active":"2024-05-30T17:04:27.661891+0000","last_became_peered":"2024-05-30T17:04:27.661891+0000","last_unstale":"2024-05-30T17:07:02.074186+0000","last_undegraded":"2024-05-30T17:07:02.074186+0000","last_fullsized":"2024-05-30T17:07:02.074186+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:37.192613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":68,"num_read_kb":253958,"num_write":88,"num_write_kb":307203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"133'140","reported_seq":203,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074602+0000","last_change":"2024-05-30T17:04:27.655790+0000","last_active":"2024-05-30T17:07:02.074602+0000","last_peered":"2024-05-30T17:07:02.074602+0000","last_clean":"2024-05-30T17:07:02.074602+0000","last_became_active":"2024-05-30T17:04:27.655516+0000","last_became_peered":"2024-05-30T17:04:27.655516+0000","last_unstale":"2024-05-30T17:07:02.074602+0000","last_undegraded":"2024-05-30T17:07:02.074602+0000","last_fullsized":"2024-05-30T17:07:02.074602+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:21.860246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":46,"num_read_kb":176131,"num_write":84,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"133'129","reported_seq":184,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.056843+0000","last_change":"2024-05-30T17:04:27.668225+0000","last_active":"2024-05-30T17:07:02.056843+0000","last_peered":"2024-05-30T17:07:02.056843+0000","last_clean":"2024-05-30T17:07:02.056843+0000","last_became_active":"2024-05-30T17:04:27.667959+0000","last_became_peered":"2024-05-30T17:04:27.667959+0000","last_unstale":"2024-05-30T17:07:02.056843+0000","last_undegraded":"2024-05-30T17:07:02.056843+0000","last_fullsized":"2024-05-30T17:07:02.056843+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:36:36.807585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":38,"num_read_kb":155648,"num_write":75,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"133'150","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.080422+0000","last_change":"2024-05-30T17:04:27.662557+0000","last_active":"2024-05-30T17:07:02.080422+0000","last_peered":"2024-05-30T17:07:02.080422+0000","last_clean":"2024-05-30T17:07:02.080422+0000","last_became_active":"2024-05-30T17:04:27.662304+0000","last_became_peered":"2024-05-30T17:04:27.662304+0000","last_unstale":"2024-05-30T17:07:02.080422+0000","last_undegraded":"2024-05-30T17:07:02.080422+0000","last_fullsized":"2024-05-30T17:07:02.080422+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:23.592124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":94,"num_write_kb":352257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"133'148","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073252+0000","last_change":"2024-05-30T17:04:27.650438+0000","last_active":"2024-05-30T17:07:02.073252+0000","last_peered":"2024-05-30T17:07:02.073252+0000","last_clean":"2024-05-30T17:07:02.073252+0000","last_became_active":"2024-05-30T17:04:27.649935+0000","last_became_peered":"2024-05-30T17:04:27.649935+0000","last_unstale":"2024-05-30T17:07:02.073252+0000","last_undegraded":"2024-05-30T17:07:02.073252+0000","last_fullsized":"2024-05-30T17:07:02.073252+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:53.659379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":47,"num_read_kb":192512,"num_write":78,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"133'122","reported_seq":190,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072168+0000","last_change":"2024-05-30T17:04:27.654259+0000","last_active":"2024-05-30T17:07:02.072168+0000","last_peered":"2024-05-30T17:07:02.072168+0000","last_clean":"2024-05-30T17:07:02.072168+0000","last_became_active":"2024-05-30T17:04:27.653784+0000","last_became_peered":"2024-05-30T17:04:27.653784+0000","last_unstale":"2024-05-30T17:07:02.072168+0000","last_undegraded":"2024-05-30T17:07:02.072168+0000","last_fullsized":"2024-05-30T17:07:02.072168+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:33:17.272892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":91,"num_write_kb":331776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"133'138","reported_seq":205,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.064343+0000","last_change":"2024-05-30T17:04:27.667692+0000","last_active":"2024-05-30T17:07:02.064343+0000","last_peered":"2024-05-30T17:07:02.064343+0000","last_clean":"2024-05-30T17:07:02.064343+0000","last_became_active":"2024-05-30T17:04:27.667374+0000","last_became_peered":"2024-05-30T17:04:27.667374+0000","last_unstale":"2024-05-30T17:07:02.064343+0000","last_undegraded":"2024-05-30T17:07:02.064343+0000","last_fullsized":"2024-05-30T17:07:02.064343+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:23.592124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":50,"num_read_kb":204800,"num_write":77,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"133'130","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075314+0000","last_change":"2024-05-30T17:04:27.649118+0000","last_active":"2024-05-30T17:07:02.075314+0000","last_peered":"2024-05-30T17:07:02.075314+0000","last_clean":"2024-05-30T17:07:02.075314+0000","last_became_active":"2024-05-30T17:04:27.648603+0000","last_became_peered":"2024-05-30T17:04:27.648603+0000","last_unstale":"2024-05-30T17:07:02.075314+0000","last_undegraded":"2024-05-30T17:07:02.075314+0000","last_fullsized":"2024-05-30T17:07:02.075314+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:34:15.854657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":76,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"133'139","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.065303+0000","last_change":"2024-05-30T17:04:27.661461+0000","last_active":"2024-05-30T17:07:02.065303+0000","last_peered":"2024-05-30T17:07:02.065303+0000","last_clean":"2024-05-30T17:07:02.065303+0000","last_became_active":"2024-05-30T17:04:27.660883+0000","last_became_peered":"2024-05-30T17:04:27.660883+0000","last_unstale":"2024-05-30T17:07:02.065303+0000","last_undegraded":"2024-05-30T17:07:02.065303+0000","last_fullsized":"2024-05-30T17:07:02.065303+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:10.641928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":96,"num_read_kb":393216,"num_write":91,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"133'111","reported_seq":221,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.063559+0000","last_change":"2024-05-30T17:04:27.666142+0000","last_active":"2024-05-30T17:07:02.063559+0000","last_peered":"2024-05-30T17:07:02.063559+0000","last_clean":"2024-05-30T17:07:02.063559+0000","last_became_active":"2024-05-30T17:04:27.665266+0000","last_became_peered":"2024-05-30T17:04:27.665266+0000","last_unstale":"2024-05-30T17:07:02.063559+0000","last_undegraded":"2024-05-30T17:07:02.063559+0000","last_fullsized":"2024-05-30T17:07:02.063559+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:22.395407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":93,"num_read_kb":364548,"num_write":70,"num_write_kb":258049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"133'123","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071900+0000","last_change":"2024-05-30T17:04:27.655353+0000","last_active":"2024-05-30T17:07:02.071900+0000","last_peered":"2024-05-30T17:07:02.071900+0000","last_clean":"2024-05-30T17:07:02.071900+0000","last_became_active":"2024-05-30T17:04:27.655046+0000","last_became_peered":"2024-05-30T17:04:27.655046+0000","last_unstale":"2024-05-30T17:07:02.071900+0000","last_undegraded":"2024-05-30T17:07:02.071900+0000","last_fullsized":"2024-05-30T17:07:02.071900+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:03.759562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":82,"num_read_kb":335872,"num_write":80,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"133'139","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.080510+0000","last_change":"2024-05-30T17:04:27.660230+0000","last_active":"2024-05-30T17:07:02.080510+0000","last_peered":"2024-05-30T17:07:02.080510+0000","last_clean":"2024-05-30T17:07:02.080510+0000","last_became_active":"2024-05-30T17:04:27.659965+0000","last_became_peered":"2024-05-30T17:04:27.659965+0000","last_unstale":"2024-05-30T17:07:02.080510+0000","last_undegraded":"2024-05-30T17:07:02.080510+0000","last_fullsized":"2024-05-30T17:07:02.080510+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:29:02.948480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629892,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":62,"num_read_kb":249857,"num_write":78,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"133'122","reported_seq":169,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075397+0000","last_change":"2024-05-30T17:04:27.651454+0000","last_active":"2024-05-30T17:07:02.075397+0000","last_peered":"2024-05-30T17:07:02.075397+0000","last_clean":"2024-05-30T17:07:02.075397+0000","last_became_active":"2024-05-30T17:04:27.650330+0000","last_became_peered":"2024-05-30T17:04:27.650330+0000","last_unstale":"2024-05-30T17:07:02.075397+0000","last_undegraded":"2024-05-30T17:07:02.075397+0000","last_fullsized":"2024-05-30T17:07:02.075397+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:29:36.345038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":30,"num_read_kb":122880,"num_write":68,"num_write_kb":245760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"133'131","reported_seq":201,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.386722+0000","last_change":"2024-05-30T17:04:27.656402+0000","last_active":"2024-05-30T17:06:47.386722+0000","last_peered":"2024-05-30T17:06:47.386722+0000","last_clean":"2024-05-30T17:06:47.386722+0000","last_became_active":"2024-05-30T17:04:27.656141+0000","last_became_peered":"2024-05-30T17:04:27.656141+0000","last_unstale":"2024-05-30T17:06:47.386722+0000","last_undegraded":"2024-05-30T17:06:47.386722+0000","last_fullsized":"2024-05-30T17:06:47.386722+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:08.433002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":53,"num_read_kb":217088,"num_write":82,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"133'131","reported_seq":190,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075517+0000","last_change":"2024-05-30T17:04:27.655050+0000","last_active":"2024-05-30T17:07:02.075517+0000","last_peered":"2024-05-30T17:07:02.075517+0000","last_clean":"2024-05-30T17:07:02.075517+0000","last_became_active":"2024-05-30T17:04:27.654786+0000","last_became_peered":"2024-05-30T17:04:27.654786+0000","last_unstale":"2024-05-30T17:07:02.075517+0000","last_undegraded":"2024-05-30T17:07:02.075517+0000","last_fullsized":"2024-05-30T17:07:02.075517+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:12.824800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":77,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"133'122","reported_seq":229,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.380145+0000","last_change":"2024-05-30T17:04:27.650889+0000","last_active":"2024-05-30T17:06:47.380145+0000","last_peered":"2024-05-30T17:06:47.380145+0000","last_clean":"2024-05-30T17:06:47.380145+0000","last_became_active":"2024-05-30T17:04:27.649462+0000","last_became_peered":"2024-05-30T17:04:27.649462+0000","last_unstale":"2024-05-30T17:06:47.380145+0000","last_undegraded":"2024-05-30T17:06:47.380145+0000","last_fullsized":"2024-05-30T17:06:47.380145+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:02:33.740142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":90,"num_read_kb":352260,"num_write":88,"num_write_kb":311298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"133'143","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072013+0000","last_change":"2024-05-30T17:04:27.661225+0000","last_active":"2024-05-30T17:07:02.072013+0000","last_peered":"2024-05-30T17:07:02.072013+0000","last_clean":"2024-05-30T17:07:02.072013+0000","last_became_active":"2024-05-30T17:04:27.660532+0000","last_became_peered":"2024-05-30T17:04:27.660532+0000","last_unstale":"2024-05-30T17:07:02.072013+0000","last_undegraded":"2024-05-30T17:07:02.072013+0000","last_fullsized":"2024-05-30T17:07:02.072013+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:06.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":71,"num_read_kb":278531,"num_write":90,"num_write_kb":315393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"133'136","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.385882+0000","last_change":"2024-05-30T17:04:27.652401+0000","last_active":"2024-05-30T17:06:47.385882+0000","last_peered":"2024-05-30T17:06:47.385882+0000","last_clean":"2024-05-30T17:06:47.385882+0000","last_became_active":"2024-05-30T17:04:27.652097+0000","last_became_peered":"2024-05-30T17:04:27.652097+0000","last_unstale":"2024-05-30T17:06:47.385882+0000","last_undegraded":"2024-05-30T17:06:47.385882+0000","last_fullsized":"2024-05-30T17:06:47.385882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:22:37.455945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":84,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"133'143","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.059723+0000","last_change":"2024-05-30T17:04:27.668938+0000","last_active":"2024-05-30T17:07:02.059723+0000","last_peered":"2024-05-30T17:07:02.059723+0000","last_clean":"2024-05-30T17:07:02.059723+0000","last_became_active":"2024-05-30T17:04:27.667647+0000","last_became_peered":"2024-05-30T17:04:27.667647+0000","last_unstale":"2024-05-30T17:07:02.059723+0000","last_undegraded":"2024-05-30T17:07:02.059723+0000","last_fullsized":"2024-05-30T17:07:02.059723+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:30.304469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":90,"num_read_kb":364545,"num_write":97,"num_write_kb":348161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"133'132","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.076029+0000","last_change":"2024-05-30T17:04:27.662797+0000","last_active":"2024-05-30T17:07:02.076029+0000","last_peered":"2024-05-30T17:07:02.076029+0000","last_clean":"2024-05-30T17:07:02.076029+0000","last_became_active":"2024-05-30T17:04:27.662501+0000","last_became_peered":"2024-05-30T17:04:27.662501+0000","last_unstale":"2024-05-30T17:07:02.076029+0000","last_undegraded":"2024-05-30T17:07:02.076029+0000","last_fullsized":"2024-05-30T17:07:02.076029+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:08:53.115296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":57,"num_read_kb":229377,"num_write":78,"num_write_kb":282625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"133'147","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.069190+0000","last_change":"2024-05-30T17:04:27.663482+0000","last_active":"2024-05-30T17:07:02.069190+0000","last_peered":"2024-05-30T17:07:02.069190+0000","last_clean":"2024-05-30T17:07:02.069190+0000","last_became_active":"2024-05-30T17:04:27.663243+0000","last_became_peered":"2024-05-30T17:04:27.663243+0000","last_unstale":"2024-05-30T17:07:02.069190+0000","last_undegraded":"2024-05-30T17:07:02.069190+0000","last_fullsized":"2024-05-30T17:07:02.069190+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:18:01.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":93,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"133'141","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.070605+0000","last_change":"2024-05-30T17:04:27.664136+0000","last_active":"2024-05-30T17:07:02.070605+0000","last_peered":"2024-05-30T17:07:02.070605+0000","last_clean":"2024-05-30T17:07:02.070605+0000","last_became_active":"2024-05-30T17:04:27.663855+0000","last_became_peered":"2024-05-30T17:04:27.663855+0000","last_unstale":"2024-05-30T17:07:02.070605+0000","last_undegraded":"2024-05-30T17:07:02.070605+0000","last_fullsized":"2024-05-30T17:07:02.070605+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:58:09.184441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":52,"num_read_kb":212992,"num_write":85,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"133'145","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073496+0000","last_change":"2024-05-30T17:04:27.653664+0000","last_active":"2024-05-30T17:07:02.073496+0000","last_peered":"2024-05-30T17:07:02.073496+0000","last_clean":"2024-05-30T17:07:02.073496+0000","last_became_active":"2024-05-30T17:04:27.653397+0000","last_became_peered":"2024-05-30T17:04:27.653397+0000","last_unstale":"2024-05-30T17:07:02.073496+0000","last_undegraded":"2024-05-30T17:07:02.073496+0000","last_fullsized":"2024-05-30T17:07:02.073496+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:48.819945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":66,"num_read_kb":253956,"num_write":74,"num_write_kb":266242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"133'150","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.391541+0000","last_change":"2024-05-30T17:04:27.657224+0000","last_active":"2024-05-30T17:06:47.391541+0000","last_peered":"2024-05-30T17:06:47.391541+0000","last_clean":"2024-05-30T17:06:47.391541+0000","last_became_active":"2024-05-30T17:04:27.656941+0000","last_became_peered":"2024-05-30T17:04:27.656941+0000","last_unstale":"2024-05-30T17:06:47.391541+0000","last_undegraded":"2024-05-30T17:06:47.391541+0000","last_fullsized":"2024-05-30T17:06:47.391541+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:33.680204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":86,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"133'127","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072257+0000","last_change":"2024-05-30T17:04:48.390020+0000","last_active":"2024-05-30T17:07:02.072257+0000","last_peered":"2024-05-30T17:07:02.072257+0000","last_clean":"2024-05-30T17:07:02.072257+0000","last_became_active":"2024-05-30T17:04:48.283505+0000","last_became_peered":"2024-05-30T17:04:48.283505+0000","last_unstale":"2024-05-30T17:07:02.072257+0000","last_undegraded":"2024-05-30T17:07:02.072257+0000","last_fullsized":"2024-05-30T17:07:02.072257+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:22:07.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":77,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.24","version":"133'126","reported_seq":175,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.061199+0000","last_change":"2024-05-30T17:04:27.664832+0000","last_active":"2024-05-30T17:07:02.061199+0000","last_peered":"2024-05-30T17:07:02.061199+0000","last_clean":"2024-05-30T17:07:02.061199+0000","last_became_active":"2024-05-30T17:04:27.664502+0000","last_became_peered":"2024-05-30T17:04:27.664502+0000","last_unstale":"2024-05-30T17:07:02.061199+0000","last_undegraded":"2024-05-30T17:07:02.061199+0000","last_fullsized":"2024-05-30T17:07:02.061199+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:01:53.320309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":32,"num_read_kb":131072,"num_write":80,"num_write_kb":282625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"133'142","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071698+0000","last_change":"2024-05-30T17:04:27.654528+0000","last_active":"2024-05-30T17:07:02.071698+0000","last_peered":"2024-05-30T17:07:02.071698+0000","last_clean":"2024-05-30T17:07:02.071698+0000","last_became_active":"2024-05-30T17:04:27.653960+0000","last_became_peered":"2024-05-30T17:04:27.653960+0000","last_unstale":"2024-05-30T17:07:02.071698+0000","last_undegraded":"2024-05-30T17:07:02.071698+0000","last_fullsized":"2024-05-30T17:07:02.071698+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:15.226549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":83,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"133'143","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078546+0000","last_change":"2024-05-30T17:04:27.654884+0000","last_active":"2024-05-30T17:07:02.078546+0000","last_peered":"2024-05-30T17:07:02.078546+0000","last_clean":"2024-05-30T17:07:02.078546+0000","last_became_active":"2024-05-30T17:04:27.654299+0000","last_became_peered":"2024-05-30T17:04:27.654299+0000","last_unstale":"2024-05-30T17:07:02.078546+0000","last_undegraded":"2024-05-30T17:07:02.078546+0000","last_fullsized":"2024-05-30T17:07:02.078546+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:24:47.150653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":87,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"133'142","reported_seq":255,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078715+0000","last_change":"2024-05-30T17:04:27.663731+0000","last_active":"2024-05-30T17:07:02.078715+0000","last_peered":"2024-05-30T17:07:02.078715+0000","last_clean":"2024-05-30T17:07:02.078715+0000","last_became_active":"2024-05-30T17:04:27.663462+0000","last_became_peered":"2024-05-30T17:04:27.663462+0000","last_unstale":"2024-05-30T17:07:02.078715+0000","last_undegraded":"2024-05-30T17:07:02.078715+0000","last_fullsized":"2024-05-30T17:07:02.078715+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:05:45.058232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":96,"num_read_kb":376836,"num_write":70,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"133'136","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074057+0000","last_change":"2024-05-30T17:04:27.648781+0000","last_active":"2024-05-30T17:07:02.074057+0000","last_peered":"2024-05-30T17:07:02.074057+0000","last_clean":"2024-05-30T17:07:02.074057+0000","last_became_active":"2024-05-30T17:04:27.648348+0000","last_became_peered":"2024-05-30T17:04:27.648348+0000","last_unstale":"2024-05-30T17:07:02.074057+0000","last_undegraded":"2024-05-30T17:07:02.074057+0000","last_fullsized":"2024-05-30T17:07:02.074057+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:18:01.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":69,"num_read_kb":282624,"num_write":74,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"133'128","reported_seq":186,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.380374+0000","last_change":"2024-05-30T17:04:27.665116+0000","last_active":"2024-05-30T17:06:47.380374+0000","last_peered":"2024-05-30T17:06:47.380374+0000","last_clean":"2024-05-30T17:06:47.380374+0000","last_became_active":"2024-05-30T17:04:27.664853+0000","last_became_peered":"2024-05-30T17:04:27.664853+0000","last_unstale":"2024-05-30T17:06:47.380374+0000","last_undegraded":"2024-05-30T17:06:47.380374+0000","last_fullsized":"2024-05-30T17:06:47.380374+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:00.380018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":41,"num_read_kb":163841,"num_write":78,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"130'4","reported_seq":23,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.385302+0000","last_change":"2024-05-30T17:04:26.653769+0000","last_active":"2024-05-30T17:04:48.385302+0000","last_peered":"2024-05-30T17:04:48.385302+0000","last_clean":"2024-05-30T17:04:48.385302+0000","last_became_active":"2024-05-30T17:04:26.653331+0000","last_became_peered":"2024-05-30T17:04:26.653331+0000","last_unstale":"2024-05-30T17:04:48.385302+0000","last_undegraded":"2024-05-30T17:04:48.385302+0000","last_fullsized":"2024-05-30T17:04:48.385302+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:48.287253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"133'134","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075995+0000","last_change":"2024-05-30T17:04:27.662362+0000","last_active":"2024-05-30T17:07:02.075995+0000","last_peered":"2024-05-30T17:07:02.075995+0000","last_clean":"2024-05-30T17:07:02.075995+0000","last_became_active":"2024-05-30T17:04:27.662074+0000","last_became_peered":"2024-05-30T17:04:27.662074+0000","last_unstale":"2024-05-30T17:07:02.075995+0000","last_undegraded":"2024-05-30T17:07:02.075995+0000","last_fullsized":"2024-05-30T17:07:02.075995+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:46.552415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":67,"num_read_kb":270337,"num_write":83,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.285510+0000","last_change":"2024-05-30T17:04:26.652574+0000","last_active":"2024-05-30T17:04:48.285510+0000","last_peered":"2024-05-30T17:04:48.285510+0000","last_clean":"2024-05-30T17:04:48.285510+0000","last_became_active":"2024-05-30T17:04:26.652142+0000","last_became_peered":"2024-05-30T17:04:26.652142+0000","last_unstale":"2024-05-30T17:04:48.285510+0000","last_undegraded":"2024-05-30T17:04:48.285510+0000","last_fullsized":"2024-05-30T17:04:48.285510+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:56.876839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"133'126","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.070793+0000","last_change":"2024-05-30T17:04:27.660400+0000","last_active":"2024-05-30T17:07:02.070793+0000","last_peered":"2024-05-30T17:07:02.070793+0000","last_clean":"2024-05-30T17:07:02.070793+0000","last_became_active":"2024-05-30T17:04:27.659049+0000","last_became_peered":"2024-05-30T17:04:27.659049+0000","last_unstale":"2024-05-30T17:07:02.070793+0000","last_undegraded":"2024-05-30T17:07:02.070793+0000","last_fullsized":"2024-05-30T17:07:02.070793+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:40.140860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435717,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":77,"num_write_kb":286721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"133'3","reported_seq":22,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:10.709212+0000","last_change":"2024-05-30T17:04:26.652502+0000","last_active":"2024-05-30T17:05:10.709212+0000","last_peered":"2024-05-30T17:05:10.709212+0000","last_clean":"2024-05-30T17:05:10.709212+0000","last_became_active":"2024-05-30T17:04:26.652240+0000","last_became_peered":"2024-05-30T17:04:26.652240+0000","last_unstale":"2024-05-30T17:05:10.709212+0000","last_undegraded":"2024-05-30T17:05:10.709212+0000","last_fullsized":"2024-05-30T17:05:10.709212+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:05:38.644445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"133'143","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078731+0000","last_change":"2024-05-30T17:04:27.659729+0000","last_active":"2024-05-30T17:07:02.078731+0000","last_peered":"2024-05-30T17:07:02.078731+0000","last_clean":"2024-05-30T17:07:02.078731+0000","last_became_active":"2024-05-30T17:04:27.659448+0000","last_became_peered":"2024-05-30T17:04:27.659448+0000","last_unstale":"2024-05-30T17:07:02.078731+0000","last_undegraded":"2024-05-30T17:07:02.078731+0000","last_fullsized":"2024-05-30T17:07:02.078731+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:24:26.077897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":85,"num_read_kb":348160,"num_write":95,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"133'3","reported_seq":22,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:10.928697+0000","last_change":"2024-05-30T17:04:26.644729+0000","last_active":"2024-05-30T17:06:10.928697+0000","last_peered":"2024-05-30T17:06:10.928697+0000","last_clean":"2024-05-30T17:06:10.928697+0000","last_became_active":"2024-05-30T17:04:26.644381+0000","last_became_peered":"2024-05-30T17:04:26.644381+0000","last_unstale":"2024-05-30T17:06:10.928697+0000","last_undegraded":"2024-05-30T17:06:10.928697+0000","last_fullsized":"2024-05-30T17:06:10.928697+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:37:07.585571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"133'137","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.379965+0000","last_change":"2024-05-30T17:04:27.650774+0000","last_active":"2024-05-30T17:06:47.379965+0000","last_peered":"2024-05-30T17:06:47.379965+0000","last_clean":"2024-05-30T17:06:47.379965+0000","last_became_active":"2024-05-30T17:04:27.649829+0000","last_became_peered":"2024-05-30T17:04:27.649829+0000","last_unstale":"2024-05-30T17:06:47.379965+0000","last_undegraded":"2024-05-30T17:06:47.379965+0000","last_fullsized":"2024-05-30T17:06:47.379965+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:43:56.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":54,"num_read_kb":221184,"num_write":83,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.391828+0000","last_change":"2024-05-30T17:04:26.649081+0000","last_active":"2024-05-30T17:04:48.391828+0000","last_peered":"2024-05-30T17:04:48.391828+0000","last_clean":"2024-05-30T17:04:48.391828+0000","last_became_active":"2024-05-30T17:04:26.648809+0000","last_became_peered":"2024-05-30T17:04:26.648809+0000","last_unstale":"2024-05-30T17:04:48.391828+0000","last_undegraded":"2024-05-30T17:04:48.391828+0000","last_fullsized":"2024-05-30T17:04:48.391828+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:19.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"133'135","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074364+0000","last_change":"2024-05-30T17:04:27.657052+0000","last_active":"2024-05-30T17:07:02.074364+0000","last_peered":"2024-05-30T17:07:02.074364+0000","last_clean":"2024-05-30T17:07:02.074364+0000","last_became_active":"2024-05-30T17:04:27.656807+0000","last_became_peered":"2024-05-30T17:04:27.656807+0000","last_unstale":"2024-05-30T17:07:02.074364+0000","last_undegraded":"2024-05-30T17:07:02.074364+0000","last_fullsized":"2024-05-30T17:07:02.074364+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:23.181795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":89,"num_read_kb":364544,"num_write":85,"num_write_kb":319488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.296676+0000","last_change":"2024-05-30T17:04:26.650934+0000","last_active":"2024-05-30T17:04:48.296676+0000","last_peered":"2024-05-30T17:04:48.296676+0000","last_clean":"2024-05-30T17:04:48.296676+0000","last_became_active":"2024-05-30T17:04:26.650668+0000","last_became_peered":"2024-05-30T17:04:26.650668+0000","last_unstale":"2024-05-30T17:04:48.296676+0000","last_undegraded":"2024-05-30T17:04:48.296676+0000","last_fullsized":"2024-05-30T17:04:48.296676+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:04.028994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"133'140","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072051+0000","last_change":"2024-05-30T17:04:27.653284+0000","last_active":"2024-05-30T17:07:02.072051+0000","last_peered":"2024-05-30T17:07:02.072051+0000","last_clean":"2024-05-30T17:07:02.072051+0000","last_became_active":"2024-05-30T17:04:27.653020+0000","last_became_peered":"2024-05-30T17:04:27.653020+0000","last_unstale":"2024-05-30T17:07:02.072051+0000","last_undegraded":"2024-05-30T17:07:02.072051+0000","last_fullsized":"2024-05-30T17:07:02.072051+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:21.704608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":70,"num_read_kb":278530,"num_write":74,"num_write_kb":262145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.283847+0000","last_change":"2024-05-30T17:04:26.642168+0000","last_active":"2024-05-30T17:04:48.283847+0000","last_peered":"2024-05-30T17:04:48.283847+0000","last_clean":"2024-05-30T17:04:48.283847+0000","last_became_active":"2024-05-30T17:04:26.641791+0000","last_became_peered":"2024-05-30T17:04:26.641791+0000","last_unstale":"2024-05-30T17:04:48.283847+0000","last_undegraded":"2024-05-30T17:04:48.283847+0000","last_fullsized":"2024-05-30T17:04:48.283847+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:06:45.068461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"133'134","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.066277+0000","last_change":"2024-05-30T17:04:27.648200+0000","last_active":"2024-05-30T17:07:02.066277+0000","last_peered":"2024-05-30T17:07:02.066277+0000","last_clean":"2024-05-30T17:07:02.066277+0000","last_became_active":"2024-05-30T17:04:27.647928+0000","last_became_peered":"2024-05-30T17:04:27.647928+0000","last_unstale":"2024-05-30T17:07:02.066277+0000","last_undegraded":"2024-05-30T17:07:02.066277+0000","last_fullsized":"2024-05-30T17:07:02.066277+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:25:31.744496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":75,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.391606+0000","last_change":"2024-05-30T17:04:26.645457+0000","last_active":"2024-05-30T17:04:48.391606+0000","last_peered":"2024-05-30T17:04:48.391606+0000","last_clean":"2024-05-30T17:04:48.391606+0000","last_became_active":"2024-05-30T17:04:26.642988+0000","last_became_peered":"2024-05-30T17:04:26.642988+0000","last_unstale":"2024-05-30T17:04:48.391606+0000","last_undegraded":"2024-05-30T17:04:48.391606+0000","last_fullsized":"2024-05-30T17:04:48.391606+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:51:19.024263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"133'122","reported_seq":174,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078137+0000","last_change":"2024-05-30T17:04:27.654579+0000","last_active":"2024-05-30T17:07:02.078137+0000","last_peered":"2024-05-30T17:07:02.078137+0000","last_clean":"2024-05-30T17:07:02.078137+0000","last_became_active":"2024-05-30T17:04:27.654315+0000","last_became_peered":"2024-05-30T17:04:27.654315+0000","last_unstale":"2024-05-30T17:07:02.078137+0000","last_undegraded":"2024-05-30T17:07:02.078137+0000","last_fullsized":"2024-05-30T17:07:02.078137+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:42.109985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":35,"num_read_kb":143360,"num_write":60,"num_write_kb":217088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"133'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:10.717567+0000","last_change":"2024-05-30T17:04:26.653783+0000","last_active":"2024-05-30T17:05:10.717567+0000","last_peered":"2024-05-30T17:05:10.717567+0000","last_clean":"2024-05-30T17:05:10.717567+0000","last_became_active":"2024-05-30T17:04:26.653413+0000","last_became_peered":"2024-05-30T17:04:26.653413+0000","last_unstale":"2024-05-30T17:05:10.717567+0000","last_undegraded":"2024-05-30T17:05:10.717567+0000","last_fullsized":"2024-05-30T17:05:10.717567+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:47.810832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"133'120","reported_seq":177,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.062511+0000","last_change":"2024-05-30T17:04:27.670112+0000","last_active":"2024-05-30T17:07:02.062511+0000","last_peered":"2024-05-30T17:07:02.062511+0000","last_clean":"2024-05-30T17:07:02.062511+0000","last_became_active":"2024-05-30T17:04:27.669759+0000","last_became_peered":"2024-05-30T17:04:27.669759+0000","last_unstale":"2024-05-30T17:07:02.062511+0000","last_undegraded":"2024-05-30T17:07:02.062511+0000","last_fullsized":"2024-05-30T17:07:02.062511+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:28:30.371308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881204,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":40,"num_read_kb":159745,"num_write":65,"num_write_kb":245761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.297131+0000","last_change":"2024-05-30T17:04:26.649285+0000","last_active":"2024-05-30T17:04:48.297131+0000","last_peered":"2024-05-30T17:04:48.297131+0000","last_clean":"2024-05-30T17:04:48.297131+0000","last_became_active":"2024-05-30T17:04:26.648983+0000","last_became_peered":"2024-05-30T17:04:26.648983+0000","last_unstale":"2024-05-30T17:04:48.297131+0000","last_undegraded":"2024-05-30T17:04:48.297131+0000","last_fullsized":"2024-05-30T17:04:48.297131+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:19.123667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"133'124","reported_seq":217,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074664+0000","last_change":"2024-05-30T17:04:27.661122+0000","last_active":"2024-05-30T17:07:02.074664+0000","last_peered":"2024-05-30T17:07:02.074664+0000","last_clean":"2024-05-30T17:07:02.074664+0000","last_became_active":"2024-05-30T17:04:27.660791+0000","last_became_peered":"2024-05-30T17:04:27.660791+0000","last_unstale":"2024-05-30T17:07:02.074664+0000","last_undegraded":"2024-05-30T17:07:02.074664+0000","last_fullsized":"2024-05-30T17:07:02.074664+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:44:34.412222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":76,"num_read_kb":311296,"num_write":81,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"133'25","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:11.774245+0000","last_change":"2024-05-30T17:04:26.655873+0000","last_active":"2024-05-30T17:06:11.774245+0000","last_peered":"2024-05-30T17:06:11.774245+0000","last_clean":"2024-05-30T17:06:11.774245+0000","last_became_active":"2024-05-30T17:04:26.655436+0000","last_became_peered":"2024-05-30T17:04:26.655436+0000","last_unstale":"2024-05-30T17:06:11.774245+0000","last_undegraded":"2024-05-30T17:06:11.774245+0000","last_fullsized":"2024-05-30T17:06:11.774245+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:41.100872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"133'121","reported_seq":200,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071846+0000","last_change":"2024-05-30T17:04:27.655308+0000","last_active":"2024-05-30T17:07:02.071846+0000","last_peered":"2024-05-30T17:07:02.071846+0000","last_clean":"2024-05-30T17:07:02.071846+0000","last_became_active":"2024-05-30T17:04:27.654682+0000","last_became_peered":"2024-05-30T17:04:27.654682+0000","last_unstale":"2024-05-30T17:07:02.071846+0000","last_undegraded":"2024-05-30T17:07:02.071846+0000","last_fullsized":"2024-05-30T17:07:02.071846+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:13:50.711493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":62,"num_read_kb":237572,"num_write":64,"num_write_kb":221186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"133'445","reported_seq":464,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.024243+0000","last_change":"2024-05-30T17:04:26.644996+0000","last_active":"2024-05-30T17:07:02.024243+0000","last_peered":"2024-05-30T17:07:02.024243+0000","last_clean":"2024-05-30T17:07:02.024243+0000","last_became_active":"2024-05-30T17:04:26.644394+0000","last_became_peered":"2024-05-30T17:04:26.644394+0000","last_unstale":"2024-05-30T17:07:02.024243+0000","last_undegraded":"2024-05-30T17:07:02.024243+0000","last_fullsized":"2024-05-30T17:07:02.024243+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:32:48.916197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":1814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"133'140","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071163+0000","last_change":"2024-05-30T17:04:27.667231+0000","last_active":"2024-05-30T17:07:02.071163+0000","last_peered":"2024-05-30T17:07:02.071163+0000","last_clean":"2024-05-30T17:07:02.071163+0000","last_became_active":"2024-05-30T17:04:27.666778+0000","last_became_peered":"2024-05-30T17:04:27.666778+0000","last_unstale":"2024-05-30T17:07:02.071163+0000","last_undegraded":"2024-05-30T17:07:02.071163+0000","last_fullsized":"2024-05-30T17:07:02.071163+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:05:27.633461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":51,"num_read_kb":204801,"num_write":86,"num_write_kb":315393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.280865+0000","last_change":"2024-05-30T17:04:26.648513+0000","last_active":"2024-05-30T17:04:48.280865+0000","last_peered":"2024-05-30T17:04:48.280865+0000","last_clean":"2024-05-30T17:04:48.280865+0000","last_became_active":"2024-05-30T17:04:26.648016+0000","last_became_peered":"2024-05-30T17:04:26.648016+0000","last_unstale":"2024-05-30T17:04:48.280865+0000","last_undegraded":"2024-05-30T17:04:48.280865+0000","last_fullsized":"2024-05-30T17:04:48.280865+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:19.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"133'138","reported_seq":213,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075471+0000","last_change":"2024-05-30T17:04:27.647201+0000","last_active":"2024-05-30T17:07:02.075471+0000","last_peered":"2024-05-30T17:07:02.075471+0000","last_clean":"2024-05-30T17:07:02.075471+0000","last_became_active":"2024-05-30T17:04:27.646842+0000","last_became_peered":"2024-05-30T17:04:27.646842+0000","last_unstale":"2024-05-30T17:07:02.075471+0000","last_undegraded":"2024-05-30T17:07:02.075471+0000","last_fullsized":"2024-05-30T17:07:02.075471+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:42.109985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":87,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.391719+0000","last_change":"2024-05-30T17:04:26.643372+0000","last_active":"2024-05-30T17:04:48.391719+0000","last_peered":"2024-05-30T17:04:48.391719+0000","last_clean":"2024-05-30T17:04:48.391719+0000","last_became_active":"2024-05-30T17:04:26.641530+0000","last_became_peered":"2024-05-30T17:04:26.641530+0000","last_unstale":"2024-05-30T17:04:48.391719+0000","last_undegraded":"2024-05-30T17:04:48.391719+0000","last_fullsized":"2024-05-30T17:04:48.391719+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:28.821395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"133'158","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.068945+0000","last_change":"2024-05-30T17:04:27.663493+0000","last_active":"2024-05-30T17:07:02.068945+0000","last_peered":"2024-05-30T17:07:02.068945+0000","last_clean":"2024-05-30T17:07:02.068945+0000","last_became_active":"2024-05-30T17:04:27.662912+0000","last_became_peered":"2024-05-30T17:04:27.662912+0000","last_unstale":"2024-05-30T17:07:02.068945+0000","last_undegraded":"2024-05-30T17:07:02.068945+0000","last_fullsized":"2024-05-30T17:07:02.068945+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:12:24.226617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544581,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":99,"num_write_kb":364545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"130'8","reported_seq":27,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.331297+0000","last_change":"2024-05-30T17:04:26.651768+0000","last_active":"2024-05-30T17:04:48.331297+0000","last_peered":"2024-05-30T17:04:48.331297+0000","last_clean":"2024-05-30T17:04:48.331297+0000","last_became_active":"2024-05-30T17:04:26.651470+0000","last_became_peered":"2024-05-30T17:04:26.651470+0000","last_unstale":"2024-05-30T17:04:48.331297+0000","last_undegraded":"2024-05-30T17:04:48.331297+0000","last_fullsized":"2024-05-30T17:04:48.331297+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:51:21.096723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"133'115","reported_seq":158,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071224+0000","last_change":"2024-05-30T17:04:27.656826+0000","last_active":"2024-05-30T17:07:02.071224+0000","last_peered":"2024-05-30T17:07:02.071224+0000","last_clean":"2024-05-30T17:07:02.071224+0000","last_became_active":"2024-05-30T17:04:27.656527+0000","last_became_peered":"2024-05-30T17:04:27.656527+0000","last_unstale":"2024-05-30T17:07:02.071224+0000","last_undegraded":"2024-05-30T17:07:02.071224+0000","last_fullsized":"2024-05-30T17:07:02.071224+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:53.659379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":26,"num_read_kb":94211,"num_write":61,"num_write_kb":212993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.285745+0000","last_change":"2024-05-30T17:04:26.646106+0000","last_active":"2024-05-30T17:04:48.285745+0000","last_peered":"2024-05-30T17:04:48.285745+0000","last_clean":"2024-05-30T17:04:48.285745+0000","last_became_active":"2024-05-30T17:04:26.645435+0000","last_became_peered":"2024-05-30T17:04:26.645435+0000","last_unstale":"2024-05-30T17:04:48.285745+0000","last_undegraded":"2024-05-30T17:04:48.285745+0000","last_fullsized":"2024-05-30T17:04:48.285745+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:55.135303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"133'154","reported_seq":246,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.064901+0000","last_change":"2024-05-30T17:04:27.666627+0000","last_active":"2024-05-30T17:07:02.064901+0000","last_peered":"2024-05-30T17:07:02.064901+0000","last_clean":"2024-05-30T17:07:02.064901+0000","last_became_active":"2024-05-30T17:04:27.666318+0000","last_became_peered":"2024-05-30T17:04:27.666318+0000","last_unstale":"2024-05-30T17:07:02.064901+0000","last_undegraded":"2024-05-30T17:07:02.064901+0000","last_fullsized":"2024-05-30T17:07:02.064901+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:45:56.513914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":102,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"130'2","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.277928+0000","last_change":"2024-05-30T17:04:26.649232+0000","last_active":"2024-05-30T17:04:48.277928+0000","last_peered":"2024-05-30T17:04:48.277928+0000","last_clean":"2024-05-30T17:04:48.277928+0000","last_became_active":"2024-05-30T17:04:26.648936+0000","last_became_peered":"2024-05-30T17:04:26.648936+0000","last_unstale":"2024-05-30T17:04:48.277928+0000","last_undegraded":"2024-05-30T17:04:48.277928+0000","last_fullsized":"2024-05-30T17:04:48.277928+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:05:44.049119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"133'130","reported_seq":205,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.391842+0000","last_change":"2024-05-30T17:04:27.657488+0000","last_active":"2024-05-30T17:06:47.391842+0000","last_peered":"2024-05-30T17:06:47.391842+0000","last_clean":"2024-05-30T17:06:47.391842+0000","last_became_active":"2024-05-30T17:04:27.657216+0000","last_became_peered":"2024-05-30T17:04:27.657216+0000","last_unstale":"2024-05-30T17:06:47.391842+0000","last_undegraded":"2024-05-30T17:06:47.391842+0000","last_fullsized":"2024-05-30T17:06:47.391842+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:18.543050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909897,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":58,"num_read_kb":221188,"num_write":75,"num_write_kb":241669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.284309+0000","last_change":"2024-05-30T17:04:26.652397+0000","last_active":"2024-05-30T17:04:48.284309+0000","last_peered":"2024-05-30T17:04:48.284309+0000","last_clean":"2024-05-30T17:04:48.284309+0000","last_became_active":"2024-05-30T17:04:26.652083+0000","last_became_peered":"2024-05-30T17:04:26.652083+0000","last_unstale":"2024-05-30T17:04:48.284309+0000","last_undegraded":"2024-05-30T17:04:48.284309+0000","last_fullsized":"2024-05-30T17:04:48.284309+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:17.631736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"133'141","reported_seq":233,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.077211+0000","last_change":"2024-05-30T17:04:27.649124+0000","last_active":"2024-05-30T17:07:02.077211+0000","last_peered":"2024-05-30T17:07:02.077211+0000","last_clean":"2024-05-30T17:07:02.077211+0000","last_became_active":"2024-05-30T17:04:27.648847+0000","last_became_peered":"2024-05-30T17:04:27.648847+0000","last_unstale":"2024-05-30T17:07:02.077211+0000","last_undegraded":"2024-05-30T17:07:02.077211+0000","last_fullsized":"2024-05-30T17:07:02.077211+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:42:59.091789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":89,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.285619+0000","last_change":"2024-05-30T17:04:26.646336+0000","last_active":"2024-05-30T17:04:48.285619+0000","last_peered":"2024-05-30T17:04:48.285619+0000","last_clean":"2024-05-30T17:04:48.285619+0000","last_became_active":"2024-05-30T17:04:26.646025+0000","last_became_peered":"2024-05-30T17:04:26.646025+0000","last_unstale":"2024-05-30T17:04:48.285619+0000","last_undegraded":"2024-05-30T17:04:48.285619+0000","last_fullsized":"2024-05-30T17:04:48.285619+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:34.972669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"133'147","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.045813+0000","last_change":"2024-05-30T17:04:27.654618+0000","last_active":"2024-05-30T17:07:02.045813+0000","last_peered":"2024-05-30T17:07:02.045813+0000","last_clean":"2024-05-30T17:07:02.045813+0000","last_became_active":"2024-05-30T17:04:27.653888+0000","last_became_peered":"2024-05-30T17:04:27.653888+0000","last_unstale":"2024-05-30T17:07:02.045813+0000","last_undegraded":"2024-05-30T17:07:02.045813+0000","last_fullsized":"2024-05-30T17:07:02.045813+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:34.447493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":89,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"133'3","reported_seq":22,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:10.719775+0000","last_change":"2024-05-30T17:04:26.657719+0000","last_active":"2024-05-30T17:05:10.719775+0000","last_peered":"2024-05-30T17:05:10.719775+0000","last_clean":"2024-05-30T17:05:10.719775+0000","last_became_active":"2024-05-30T17:04:26.657452+0000","last_became_peered":"2024-05-30T17:04:26.657452+0000","last_unstale":"2024-05-30T17:05:10.719775+0000","last_undegraded":"2024-05-30T17:05:10.719775+0000","last_fullsized":"2024-05-30T17:05:10.719775+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:02.780429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"133'144","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072479+0000","last_change":"2024-05-30T17:04:27.649752+0000","last_active":"2024-05-30T17:07:02.072479+0000","last_peered":"2024-05-30T17:07:02.072479+0000","last_clean":"2024-05-30T17:07:02.072479+0000","last_became_active":"2024-05-30T17:04:27.649442+0000","last_became_peered":"2024-05-30T17:04:27.649442+0000","last_unstale":"2024-05-30T17:07:02.072479+0000","last_undegraded":"2024-05-30T17:07:02.072479+0000","last_fullsized":"2024-05-30T17:07:02.072479+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:38:19.022224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":66,"num_read_kb":241671,"num_write":82,"num_write_kb":278531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.296766+0000","last_change":"2024-05-30T17:04:26.645875+0000","last_active":"2024-05-30T17:04:48.296766+0000","last_peered":"2024-05-30T17:04:48.296766+0000","last_clean":"2024-05-30T17:04:48.296766+0000","last_became_active":"2024-05-30T17:04:26.645583+0000","last_became_peered":"2024-05-30T17:04:26.645583+0000","last_unstale":"2024-05-30T17:04:48.296766+0000","last_undegraded":"2024-05-30T17:04:48.296766+0000","last_fullsized":"2024-05-30T17:04:48.296766+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:03.486308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"133'147","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.068705+0000","last_change":"2024-05-30T17:04:27.652007+0000","last_active":"2024-05-30T17:07:02.068705+0000","last_peered":"2024-05-30T17:07:02.068705+0000","last_clean":"2024-05-30T17:07:02.068705+0000","last_became_active":"2024-05-30T17:04:27.651701+0000","last_became_peered":"2024-05-30T17:04:27.651701+0000","last_unstale":"2024-05-30T17:07:02.068705+0000","last_undegraded":"2024-05-30T17:07:02.068705+0000","last_fullsized":"2024-05-30T17:07:02.068705+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:57.885952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":91,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.296204+0000","last_change":"2024-05-30T17:04:26.647421+0000","last_active":"2024-05-30T17:04:48.296204+0000","last_peered":"2024-05-30T17:04:48.296204+0000","last_clean":"2024-05-30T17:04:48.296204+0000","last_became_active":"2024-05-30T17:04:26.647155+0000","last_became_peered":"2024-05-30T17:04:26.647155+0000","last_unstale":"2024-05-30T17:04:48.296204+0000","last_undegraded":"2024-05-30T17:04:48.296204+0000","last_fullsized":"2024-05-30T17:04:48.296204+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:59:52.705838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"133'135","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078368+0000","last_change":"2024-05-30T17:04:27.667584+0000","last_active":"2024-05-30T17:07:02.078368+0000","last_peered":"2024-05-30T17:07:02.078368+0000","last_clean":"2024-05-30T17:07:02.078368+0000","last_became_active":"2024-05-30T17:04:27.667268+0000","last_became_peered":"2024-05-30T17:04:27.667268+0000","last_unstale":"2024-05-30T17:07:02.078368+0000","last_undegraded":"2024-05-30T17:07:02.078368+0000","last_fullsized":"2024-05-30T17:07:02.078368+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:45.213871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230686720,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":56,"num_read_kb":229376,"num_write":75,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.277625+0000","last_change":"2024-05-30T17:04:26.650930+0000","last_active":"2024-05-30T17:04:48.277625+0000","last_peered":"2024-05-30T17:04:48.277625+0000","last_clean":"2024-05-30T17:04:48.277625+0000","last_became_active":"2024-05-30T17:04:26.650616+0000","last_became_peered":"2024-05-30T17:04:26.650616+0000","last_unstale":"2024-05-30T17:04:48.277625+0000","last_undegraded":"2024-05-30T17:04:48.277625+0000","last_fullsized":"2024-05-30T17:04:48.277625+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:44.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"133'153","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.066680+0000","last_change":"2024-05-30T17:04:27.664544+0000","last_active":"2024-05-30T17:07:02.066680+0000","last_peered":"2024-05-30T17:07:02.066680+0000","last_clean":"2024-05-30T17:07:02.066680+0000","last_became_active":"2024-05-30T17:04:27.664180+0000","last_became_peered":"2024-05-30T17:04:27.664180+0000","last_unstale":"2024-05-30T17:07:02.066680+0000","last_undegraded":"2024-05-30T17:07:02.066680+0000","last_fullsized":"2024-05-30T17:07:02.066680+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:59.508295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":96,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"130'2","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.280667+0000","last_change":"2024-05-30T17:04:26.653129+0000","last_active":"2024-05-30T17:04:48.280667+0000","last_peered":"2024-05-30T17:04:48.280667+0000","last_clean":"2024-05-30T17:04:48.280667+0000","last_became_active":"2024-05-30T17:04:26.652234+0000","last_became_peered":"2024-05-30T17:04:26.652234+0000","last_unstale":"2024-05-30T17:04:48.280667+0000","last_undegraded":"2024-05-30T17:04:48.280667+0000","last_fullsized":"2024-05-30T17:04:48.280667+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:12.851756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"133'138","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.077318+0000","last_change":"2024-05-30T17:04:27.656246+0000","last_active":"2024-05-30T17:07:02.077318+0000","last_peered":"2024-05-30T17:07:02.077318+0000","last_clean":"2024-05-30T17:07:02.077318+0000","last_became_active":"2024-05-30T17:04:27.655926+0000","last_became_peered":"2024-05-30T17:04:27.655926+0000","last_unstale":"2024-05-30T17:07:02.077318+0000","last_undegraded":"2024-05-30T17:07:02.077318+0000","last_fullsized":"2024-05-30T17:07:02.077318+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:03.789542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":90,"num_write_kb":319489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"133'41","reported_seq":60,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:46.695559+0000","last_change":"2024-05-30T17:04:26.649574+0000","last_active":"2024-05-30T17:06:46.695559+0000","last_peered":"2024-05-30T17:06:46.695559+0000","last_clean":"2024-05-30T17:06:46.695559+0000","last_became_active":"2024-05-30T17:04:26.648998+0000","last_became_peered":"2024-05-30T17:04:26.648998+0000","last_unstale":"2024-05-30T17:06:46.695559+0000","last_undegraded":"2024-05-30T17:06:46.695559+0000","last_fullsized":"2024-05-30T17:06:46.695559+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:35:25.197491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"133'132","reported_seq":237,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072558+0000","last_change":"2024-05-30T17:04:27.654582+0000","last_active":"2024-05-30T17:07:02.072558+0000","last_peered":"2024-05-30T17:07:02.072558+0000","last_clean":"2024-05-30T17:07:02.072558+0000","last_became_active":"2024-05-30T17:04:27.654295+0000","last_became_peered":"2024-05-30T17:04:27.654295+0000","last_unstale":"2024-05-30T17:07:02.072558+0000","last_undegraded":"2024-05-30T17:07:02.072558+0000","last_fullsized":"2024-05-30T17:07:02.072558+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:35.981782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":88,"num_read_kb":360448,"num_write":81,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.392097+0000","last_change":"2024-05-30T17:04:26.647328+0000","last_active":"2024-05-30T17:04:48.392097+0000","last_peered":"2024-05-30T17:04:48.392097+0000","last_clean":"2024-05-30T17:04:48.392097+0000","last_became_active":"2024-05-30T17:04:26.647058+0000","last_became_peered":"2024-05-30T17:04:26.647058+0000","last_unstale":"2024-05-30T17:04:48.392097+0000","last_undegraded":"2024-05-30T17:04:48.392097+0000","last_fullsized":"2024-05-30T17:04:48.392097+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:27:17.347396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"133'142","reported_seq":209,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078089+0000","last_change":"2024-05-30T17:04:27.657344+0000","last_active":"2024-05-30T17:07:02.078089+0000","last_peered":"2024-05-30T17:07:02.078089+0000","last_clean":"2024-05-30T17:07:02.078089+0000","last_became_active":"2024-05-30T17:04:27.657041+0000","last_became_peered":"2024-05-30T17:04:27.657041+0000","last_unstale":"2024-05-30T17:07:02.078089+0000","last_undegraded":"2024-05-30T17:07:02.078089+0000","last_fullsized":"2024-05-30T17:07:02.078089+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:46.552415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824186,"num_objects":68,"num_object_clones":1,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":51,"num_read_kb":200706,"num_write":94,"num_write_kb":315395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.277861+0000","last_change":"2024-05-30T17:04:26.655225+0000","last_active":"2024-05-30T17:04:48.277861+0000","last_peered":"2024-05-30T17:04:48.277861+0000","last_clean":"2024-05-30T17:04:48.277861+0000","last_became_active":"2024-05-30T17:04:26.654383+0000","last_became_peered":"2024-05-30T17:04:26.654383+0000","last_unstale":"2024-05-30T17:04:48.277861+0000","last_undegraded":"2024-05-30T17:04:48.277861+0000","last_fullsized":"2024-05-30T17:04:48.277861+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:36:35.798472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"133'142","reported_seq":214,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071377+0000","last_change":"2024-05-30T17:04:27.659619+0000","last_active":"2024-05-30T17:07:02.071377+0000","last_peered":"2024-05-30T17:07:02.071377+0000","last_clean":"2024-05-30T17:07:02.071377+0000","last_became_active":"2024-05-30T17:04:27.659316+0000","last_became_peered":"2024-05-30T17:04:27.659316+0000","last_unstale":"2024-05-30T17:07:02.071377+0000","last_undegraded":"2024-05-30T17:07:02.071377+0000","last_fullsized":"2024-05-30T17:07:02.071377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:29:40.214450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":88,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.391841+0000","last_change":"2024-05-30T17:04:26.643654+0000","last_active":"2024-05-30T17:04:48.391841+0000","last_peered":"2024-05-30T17:04:48.391841+0000","last_clean":"2024-05-30T17:04:48.391841+0000","last_became_active":"2024-05-30T17:04:26.642798+0000","last_became_peered":"2024-05-30T17:04:26.642798+0000","last_unstale":"2024-05-30T17:04:48.391841+0000","last_undegraded":"2024-05-30T17:04:48.391841+0000","last_fullsized":"2024-05-30T17:04:48.391841+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:22:19.720162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"133'151","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073260+0000","last_change":"2024-05-30T17:04:27.662540+0000","last_active":"2024-05-30T17:07:02.073260+0000","last_peered":"2024-05-30T17:07:02.073260+0000","last_clean":"2024-05-30T17:07:02.073260+0000","last_became_active":"2024-05-30T17:04:27.662294+0000","last_became_peered":"2024-05-30T17:04:27.662294+0000","last_unstale":"2024-05-30T17:07:02.073260+0000","last_undegraded":"2024-05-30T17:07:02.073260+0000","last_fullsized":"2024-05-30T17:07:02.073260+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:03.093546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":85,"num_read_kb":335875,"num_write":93,"num_write_kb":335873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.385120+0000","last_change":"2024-05-30T17:04:26.650407+0000","last_active":"2024-05-30T17:04:48.385120+0000","last_peered":"2024-05-30T17:04:48.385120+0000","last_clean":"2024-05-30T17:04:48.385120+0000","last_became_active":"2024-05-30T17:04:26.650063+0000","last_became_peered":"2024-05-30T17:04:26.650063+0000","last_unstale":"2024-05-30T17:04:48.385120+0000","last_undegraded":"2024-05-30T17:04:48.385120+0000","last_fullsized":"2024-05-30T17:04:48.385120+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:58.499182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"133'121","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.379618+0000","last_change":"2024-05-30T17:04:27.648839+0000","last_active":"2024-05-30T17:06:47.379618+0000","last_peered":"2024-05-30T17:06:47.379618+0000","last_clean":"2024-05-30T17:06:47.379618+0000","last_became_active":"2024-05-30T17:04:27.648558+0000","last_became_peered":"2024-05-30T17:04:27.648558+0000","last_unstale":"2024-05-30T17:06:47.379618+0000","last_undegraded":"2024-05-30T17:06:47.379618+0000","last_fullsized":"2024-05-30T17:06:47.379618+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:52.862600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":83,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"133'32","reported_seq":82,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:11.769701+0000","last_change":"2024-05-30T17:04:26.646155+0000","last_active":"2024-05-30T17:06:11.769701+0000","last_peered":"2024-05-30T17:06:11.769701+0000","last_clean":"2024-05-30T17:06:11.769701+0000","last_became_active":"2024-05-30T17:04:26.645855+0000","last_became_peered":"2024-05-30T17:04:26.645855+0000","last_unstale":"2024-05-30T17:06:11.769701+0000","last_undegraded":"2024-05-30T17:06:11.769701+0000","last_fullsized":"2024-05-30T17:06:11.769701+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:51.017861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4957,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":31,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"133'149","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073381+0000","last_change":"2024-05-30T17:04:27.657377+0000","last_active":"2024-05-30T17:07:02.073381+0000","last_peered":"2024-05-30T17:07:02.073381+0000","last_clean":"2024-05-30T17:07:02.073381+0000","last_became_active":"2024-05-30T17:04:27.657110+0000","last_became_peered":"2024-05-30T17:04:27.657110+0000","last_unstale":"2024-05-30T17:07:02.073381+0000","last_undegraded":"2024-05-30T17:07:02.073381+0000","last_fullsized":"2024-05-30T17:07:02.073381+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:03.789542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":76,"num_read_kb":311296,"num_write":106,"num_write_kb":380928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.277746+0000","last_change":"2024-05-30T17:04:26.646414+0000","last_active":"2024-05-30T17:04:48.277746+0000","last_peered":"2024-05-30T17:04:48.277746+0000","last_clean":"2024-05-30T17:04:48.277746+0000","last_became_active":"2024-05-30T17:04:26.646125+0000","last_became_peered":"2024-05-30T17:04:26.646125+0000","last_unstale":"2024-05-30T17:04:48.277746+0000","last_undegraded":"2024-05-30T17:04:48.277746+0000","last_fullsized":"2024-05-30T17:04:48.277746+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:29:39.205337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"133'138","reported_seq":202,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.067455+0000","last_change":"2024-05-30T17:04:27.668983+0000","last_active":"2024-05-30T17:07:02.067455+0000","last_peered":"2024-05-30T17:07:02.067455+0000","last_clean":"2024-05-30T17:07:02.067455+0000","last_became_active":"2024-05-30T17:04:27.668009+0000","last_became_peered":"2024-05-30T17:04:27.668009+0000","last_unstale":"2024-05-30T17:07:02.067455+0000","last_undegraded":"2024-05-30T17:07:02.067455+0000","last_fullsized":"2024-05-30T17:07:02.067455+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:05:39.653558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":47,"num_read_kb":192512,"num_write":88,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"130'2","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.385038+0000","last_change":"2024-05-30T17:04:26.656301+0000","last_active":"2024-05-30T17:04:48.385038+0000","last_peered":"2024-05-30T17:04:48.385038+0000","last_clean":"2024-05-30T17:04:48.385038+0000","last_became_active":"2024-05-30T17:04:26.655900+0000","last_became_peered":"2024-05-30T17:04:26.655900+0000","last_unstale":"2024-05-30T17:04:48.385038+0000","last_undegraded":"2024-05-30T17:04:48.385038+0000","last_fullsized":"2024-05-30T17:04:48.385038+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:18.390768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":384,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:02.147978+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:05:02.147978+0000","last_peered":"2024-05-30T17:05:02.147978+0000","last_clean":"2024-05-30T17:05:02.147978+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:05:02.147978+0000","last_undegraded":"2024-05-30T17:05:02.147978+0000","last_fullsized":"2024-05-30T17:05:02.147978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":17406362949,"num_objects":4158,"num_object_clones":1,"num_object_copies":8316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4158,"num_whiteouts":1,"num_read":4010,"num_read_kb":16171070,"num_write":5302,"num_write_kb":19193899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34812780544,"data_stored":34812725898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8748,"ondisk_log_size":8748,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1691903,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":625,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3448832,"data_stored":3383806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":576,"ondisk_log_size":576,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509660,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3774688,"kb_used_data":3657496,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":90597152,"statfs":{"total":96636764160,"available":92771483648,"internally_reserved":0,"allocated":3745275904,"data_stored":3744324606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509661,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4762904,"kb_used_data":4627664,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89608936,"statfs":{"total":96636764160,"available":91759550464,"internally_reserved":0,"allocated":4738727936,"data_stored":4737788432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509661,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3647204,"kb_used_data":3507804,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":90724636,"statfs":{"total":96636764160,"available":92902027264,"internally_reserved":0,"allocated":3591991296,"data_stored":3591052876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509662,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5289824,"kb_used_data":5142104,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":89082016,"statfs":{"total":96636764160,"available":91219984384,"internally_reserved":0,"allocated":5265514496,"data_stored":5264580072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509661,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5605036,"kb_used_data":5469796,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":88766804,"statfs":{"total":96636764160,"available":90897207296,"internally_reserved":0,"allocated":5601071104,"data_stored":5600125202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509661,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4081496,"kb_used_data":3933776,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90290344,"statfs":{"total":96636764160,"available":92457312256,"internally_reserved":0,"allocated":4028186624,"data_stored":4027260071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509661,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3721624,"kb_used_data":3573904,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90650216,"statfs":{"total":96636764160,"available":92825821184,"internally_reserved":0,"allocated":3659677696,"data_stored":3658751555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542365,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4236976,"kb_used_data":4101736,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":90134864,"statfs":{"total":96636764160,"available":92298100736,"internally_reserved":0,"allocated":4200177664,"data_stored":4199232093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":138475975},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1703936,"data_stored":1691105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1708032,"data_stored":1686786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3657433088,"data_stored":3657433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4026535936,"data_stored":4026531972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5599412224,"data_stored":5599396487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4198510592,"data_stored":4198498877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5263859712,"data_stored":5263851903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3590332416,"data_stored":3590324665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4735373312,"data_stored":4735369477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3741323264,"data_stored":3741319429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:07:04.040 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T17:07:04.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:07:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b81a00640 1 Processor -- start 2024-05-30T17:07:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b81a00640 1 -- start start 2024-05-30T17:07:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b81a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b7c06b9b0 0x7f2b7c0732e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b81a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2b7c0b4bb0 0x7f2b7c06bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b81a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b7c0b0cf0 con 0x7f2b7c0b0500 2024-05-30T17:07:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b81a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f2b7c0cf140 con 0x7f2b7c0b4bb0 2024-05-30T17:07:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b81a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7c160ae0 con 0x7f2b7c06b9b0 2024-05-30T17:07:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b73e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2b7c0b4bb0 0x7f2b7c06bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b73e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2b7c0b4bb0 0x7f2b7c06bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46040/0 (socket says 172.21.15.59:46040) 2024-05-30T17:07:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b73e00640 1 -- 172.21.15.59:0/2500778283 learned_addr learned my addr 172.21.15.59:0/2500778283 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b7be00640 1 --2- 172.21.15.59:0/2500778283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b7c06b9b0 0x7f2b7c0732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b73e00640 1 -- 172.21.15.59:0/2500778283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b7c06b9b0 msgr2=0x7f2b7c0732e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b73e00640 1 --2- 172.21.15.59:0/2500778283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b7c06b9b0 0x7f2b7c0732e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b73e00640 1 -- 172.21.15.59:0/2500778283 >> v1:172.21.15.107:6789/0 conn(0x7f2b7c0b0500 legacy=0x7f2b7c0cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b73e00640 1 -- 172.21.15.59:0/2500778283 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7c06c2d0 con 0x7f2b7c0b4bb0 2024-05-30T17:07:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.219+0000 7f2b7be00640 1 --2- 172.21.15.59:0/2500778283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b7c06b9b0 0x7f2b7c0732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:07:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b73e00640 1 --2- 172.21.15.59:0/2500778283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0b4bb0 0x7f2b7c06bd90 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009870 tx=0x7f2b6401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97df871148e6f1f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b7b400640 1 -- 172.21.15.59:0/2500778283 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b640aa610 con 0x7f2b7c0b4bb0 2024-05-30T17:07:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b7b400640 1 -- 172.21.15.59:0/2500778283 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b640af070 con 0x7f2b7c0b4bb0 2024-05-30T17:07:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b7b400640 1 -- 172.21.15.59:0/2500778283 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b640aa9d0 con 0x7f2b7c0b4bb0 2024-05-30T17:07:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b81a00640 1 -- 172.21.15.59:0/2500778283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0b4bb0 msgr2=0x7f2b7c06bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b81a00640 1 --2- 172.21.15.59:0/2500778283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0b4bb0 0x7f2b7c06bd90 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009870 tx=0x7f2b6401c4f0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b81a00640 1 -- 172.21.15.59:0/2500778283 shutdown_connections 2024-05-30T17:07:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b81a00640 1 --2- 172.21.15.59:0/2500778283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0b4bb0 0x7f2b7c06bd90 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b81a00640 1 --2- 172.21.15.59:0/2500778283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b7c06b9b0 0x7f2b7c0732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b81a00640 1 -- 172.21.15.59:0/2500778283 >> 172.21.15.59:0/2500778283 conn(0x7f2b7c0b6990 msgr2=0x7f2b7c0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b81a00640 1 -- 172.21.15.59:0/2500778283 shutdown_connections 2024-05-30T17:07:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b81a00640 1 -- 172.21.15.59:0/2500778283 wait complete. 2024-05-30T17:07:04.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b81a00640 1 Processor -- start 2024-05-30T17:07:04.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.223+0000 7f2b81a00640 1 -- start start 2024-05-30T17:07:04.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b81a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b7c06b9b0 0x7f2b7c158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:04.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b81a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0b0500 0x7f2b7c15a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:04.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b81a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b7c0b4bb0 0x7f2b7c0af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:04.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b81a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c1693d0 con 0x7f2b7c0b0500 2024-05-30T17:07:04.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b81a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c15d810 con 0x7f2b7c0b4bb0 2024-05-30T17:07:04.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b81a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7c169550 con 0x7f2b7c06b9b0 2024-05-30T17:07:04.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b73e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0b0500 0x7f2b7c15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:04.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b73e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0b0500 0x7f2b7c15a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46054/0 (socket says 172.21.15.59:46054) 2024-05-30T17:07:04.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b73e00640 1 -- 172.21.15.59:0/2746607701 learned_addr learned my addr 172.21.15.59:0/2746607701 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:04.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b7be00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b7c06b9b0 0x7f2b7c158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:04.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b81000640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b7c0b4bb0 0x7f2b7c0af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:04.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b73e00640 1 -- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b7c06b9b0 msgr2=0x7f2b7c158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b73e00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b7c06b9b0 0x7f2b7c158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b73e00640 1 -- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b7c0b4bb0 msgr2=0x7f2b7c0af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b73e00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b7c0b4bb0 0x7f2b7c0af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b73e00640 1 -- 172.21.15.59:0/2746607701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7c158e30 con 0x7f2b7c0b0500 2024-05-30T17:07:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b7be00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b7c06b9b0 0x7f2b7c158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b73e00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0b0500 0x7f2b7c15a880 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f2b640ac040 tx=0x7f2b6401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b78c00640 1 -- 172.21.15.59:0/2746607701 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b640bd5f0 con 0x7f2b7c0b0500 2024-05-30T17:07:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b78c00640 1 -- 172.21.15.59:0/2746607701 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b640bd7b0 con 0x7f2b7c0b0500 2024-05-30T17:07:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b81a00640 1 -- 172.21.15.59:0/2746607701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7c159110 con 0x7f2b7c0b0500 2024-05-30T17:07:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b78c00640 1 -- 172.21.15.59:0/2746607701 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b640bdba0 con 0x7f2b7c0b0500 2024-05-30T17:07:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b81a00640 1 -- 172.21.15.59:0/2746607701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7c1596d0 con 0x7f2b7c0b0500 2024-05-30T17:07:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.227+0000 7f2b81a00640 1 -- 172.21.15.59:0/2746607701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b7c0691a0 con 0x7f2b7c0b0500 2024-05-30T17:07:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.231+0000 7f2b78c00640 1 -- 172.21.15.59:0/2746607701 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f2b640b33f0 con 0x7f2b7c0b0500 2024-05-30T17:07:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.231+0000 7f2b78c00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b5806a180 0x7f2b5806c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.231+0000 7f2b78c00640 1 -- 172.21.15.59:0/2746607701 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f2b64120650 con 0x7f2b7c0b0500 2024-05-30T17:07:04.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.231+0000 7f2b7be00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b5806a180 0x7f2b5806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:04.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.231+0000 7f2b7be00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b5806a180 0x7f2b5806c640 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c006fd0 tx=0x7f2b6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:04.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.235+0000 7f2b78c00640 1 -- 172.21.15.59:0/2746607701 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2b640c3060 con 0x7f2b7c0b0500 2024-05-30T17:07:04.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.399+0000 7f2b81a00640 1 -- 172.21.15.59:0/2746607701 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2b7c0b3e20 con 0x7f2b5806a180 2024-05-30T17:07:04.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.407+0000 7f2b78c00640 1 -- 172.21.15.59:0/2746607701 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255026 (secure 0 0 0) 0x7f2b7c0b3e20 con 0x7f2b5806a180 2024-05-30T17:07:04.410 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:07:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:07:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.407+0000 7f2b81a00640 1 -- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b5806a180 msgr2=0x7f2b5806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.407+0000 7f2b81a00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b5806a180 0x7f2b5806c640 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c006fd0 tx=0x7f2b6c008040 comp rx=0 tx=0).stop 2024-05-30T17:07:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.407+0000 7f2b81a00640 1 -- 172.21.15.59:0/2746607701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0b0500 msgr2=0x7f2b7c15a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.407+0000 7f2b81a00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0b0500 0x7f2b7c15a880 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f2b640ac040 tx=0x7f2b6401ad30 comp rx=0 tx=0).stop 2024-05-30T17:07:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.407+0000 7f2b81a00640 1 -- 172.21.15.59:0/2746607701 shutdown_connections 2024-05-30T17:07:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.407+0000 7f2b81a00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f2b5806a180 0x7f2b5806c640 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.411+0000 7f2b81a00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b7c0b4bb0 0x7f2b7c0af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.411+0000 7f2b81a00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0b0500 0x7f2b7c15a880 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.411+0000 7f2b81a00640 1 --2- 172.21.15.59:0/2746607701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b7c06b9b0 0x7f2b7c158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.411+0000 7f2b81a00640 1 -- 172.21.15.59:0/2746607701 >> 172.21.15.59:0/2746607701 conn(0x7f2b7c0b6990 msgr2=0x7f2b7c0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.411+0000 7f2b81a00640 1 -- 172.21.15.59:0/2746607701 shutdown_connections 2024-05-30T17:07:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.411+0000 7f2b81a00640 1 -- 172.21.15.59:0/2746607701 wait complete. 2024-05-30T17:07:04.431 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":672,"stamp":"2024-05-30T17:07:03.435452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":17408645220,"num_objects":4183,"num_object_clones":1,"num_object_copies":8366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4183,"num_whiteouts":1,"num_read":4157,"num_read_kb":16171201,"num_write":6086,"num_write_kb":19198217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9441,"ondisk_log_size":9441,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":35119752,"kb_used_data":34014280,"kb_used_omap":12,"kb_used_meta":1105395,"kb_avail":719854968,"statfs":{"total":773094113280,"available":737131487232,"internally_reserved":0,"allocated":34830622720,"data_stored":34823114907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1131925040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":763,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003807"},"pg_stats":[{"pgid":"19.3f","version":"133'147","reported_seq":236,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073322+0000","last_change":"2024-05-30T17:04:48.466651+0000","last_active":"2024-05-30T17:07:02.073322+0000","last_peered":"2024-05-30T17:07:02.073322+0000","last_clean":"2024-05-30T17:07:02.073322+0000","last_became_active":"2024-05-30T17:04:48.283571+0000","last_became_peered":"2024-05-30T17:04:48.283571+0000","last_unstale":"2024-05-30T17:07:02.073322+0000","last_undegraded":"2024-05-30T17:07:02.073322+0000","last_fullsized":"2024-05-30T17:07:02.073322+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:08:42.536278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":80,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3e","version":"133'152","reported_seq":237,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.079817+0000","last_change":"2024-05-30T17:04:27.651522+0000","last_active":"2024-05-30T17:07:02.079817+0000","last_peered":"2024-05-30T17:07:02.079817+0000","last_clean":"2024-05-30T17:07:02.079817+0000","last_became_active":"2024-05-30T17:04:27.649831+0000","last_became_peered":"2024-05-30T17:04:27.649831+0000","last_unstale":"2024-05-30T17:07:02.079817+0000","last_undegraded":"2024-05-30T17:07:02.079817+0000","last_fullsized":"2024-05-30T17:07:02.079817+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:56.144416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":92,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"133'142","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074186+0000","last_change":"2024-05-30T17:04:27.662273+0000","last_active":"2024-05-30T17:07:02.074186+0000","last_peered":"2024-05-30T17:07:02.074186+0000","last_clean":"2024-05-30T17:07:02.074186+0000","last_became_active":"2024-05-30T17:04:27.661891+0000","last_became_peered":"2024-05-30T17:04:27.661891+0000","last_unstale":"2024-05-30T17:07:02.074186+0000","last_undegraded":"2024-05-30T17:07:02.074186+0000","last_fullsized":"2024-05-30T17:07:02.074186+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:37.192613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":68,"num_read_kb":253958,"num_write":88,"num_write_kb":307203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"133'140","reported_seq":203,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074602+0000","last_change":"2024-05-30T17:04:27.655790+0000","last_active":"2024-05-30T17:07:02.074602+0000","last_peered":"2024-05-30T17:07:02.074602+0000","last_clean":"2024-05-30T17:07:02.074602+0000","last_became_active":"2024-05-30T17:04:27.655516+0000","last_became_peered":"2024-05-30T17:04:27.655516+0000","last_unstale":"2024-05-30T17:07:02.074602+0000","last_undegraded":"2024-05-30T17:07:02.074602+0000","last_fullsized":"2024-05-30T17:07:02.074602+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:21.860246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":46,"num_read_kb":176131,"num_write":84,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"133'129","reported_seq":184,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.056843+0000","last_change":"2024-05-30T17:04:27.668225+0000","last_active":"2024-05-30T17:07:02.056843+0000","last_peered":"2024-05-30T17:07:02.056843+0000","last_clean":"2024-05-30T17:07:02.056843+0000","last_became_active":"2024-05-30T17:04:27.667959+0000","last_became_peered":"2024-05-30T17:04:27.667959+0000","last_unstale":"2024-05-30T17:07:02.056843+0000","last_undegraded":"2024-05-30T17:07:02.056843+0000","last_fullsized":"2024-05-30T17:07:02.056843+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:36:36.807585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":38,"num_read_kb":155648,"num_write":75,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"133'150","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.080422+0000","last_change":"2024-05-30T17:04:27.662557+0000","last_active":"2024-05-30T17:07:02.080422+0000","last_peered":"2024-05-30T17:07:02.080422+0000","last_clean":"2024-05-30T17:07:02.080422+0000","last_became_active":"2024-05-30T17:04:27.662304+0000","last_became_peered":"2024-05-30T17:04:27.662304+0000","last_unstale":"2024-05-30T17:07:02.080422+0000","last_undegraded":"2024-05-30T17:07:02.080422+0000","last_fullsized":"2024-05-30T17:07:02.080422+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:23.592124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":94,"num_write_kb":352257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"133'148","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073252+0000","last_change":"2024-05-30T17:04:27.650438+0000","last_active":"2024-05-30T17:07:02.073252+0000","last_peered":"2024-05-30T17:07:02.073252+0000","last_clean":"2024-05-30T17:07:02.073252+0000","last_became_active":"2024-05-30T17:04:27.649935+0000","last_became_peered":"2024-05-30T17:04:27.649935+0000","last_unstale":"2024-05-30T17:07:02.073252+0000","last_undegraded":"2024-05-30T17:07:02.073252+0000","last_fullsized":"2024-05-30T17:07:02.073252+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:53.659379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":47,"num_read_kb":192512,"num_write":78,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"133'122","reported_seq":190,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072168+0000","last_change":"2024-05-30T17:04:27.654259+0000","last_active":"2024-05-30T17:07:02.072168+0000","last_peered":"2024-05-30T17:07:02.072168+0000","last_clean":"2024-05-30T17:07:02.072168+0000","last_became_active":"2024-05-30T17:04:27.653784+0000","last_became_peered":"2024-05-30T17:04:27.653784+0000","last_unstale":"2024-05-30T17:07:02.072168+0000","last_undegraded":"2024-05-30T17:07:02.072168+0000","last_fullsized":"2024-05-30T17:07:02.072168+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:33:17.272892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":91,"num_write_kb":331776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"133'138","reported_seq":205,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.064343+0000","last_change":"2024-05-30T17:04:27.667692+0000","last_active":"2024-05-30T17:07:02.064343+0000","last_peered":"2024-05-30T17:07:02.064343+0000","last_clean":"2024-05-30T17:07:02.064343+0000","last_became_active":"2024-05-30T17:04:27.667374+0000","last_became_peered":"2024-05-30T17:04:27.667374+0000","last_unstale":"2024-05-30T17:07:02.064343+0000","last_undegraded":"2024-05-30T17:07:02.064343+0000","last_fullsized":"2024-05-30T17:07:02.064343+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:23.592124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":50,"num_read_kb":204800,"num_write":77,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"133'130","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075314+0000","last_change":"2024-05-30T17:04:27.649118+0000","last_active":"2024-05-30T17:07:02.075314+0000","last_peered":"2024-05-30T17:07:02.075314+0000","last_clean":"2024-05-30T17:07:02.075314+0000","last_became_active":"2024-05-30T17:04:27.648603+0000","last_became_peered":"2024-05-30T17:04:27.648603+0000","last_unstale":"2024-05-30T17:07:02.075314+0000","last_undegraded":"2024-05-30T17:07:02.075314+0000","last_fullsized":"2024-05-30T17:07:02.075314+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:34:15.854657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":76,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"133'139","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.065303+0000","last_change":"2024-05-30T17:04:27.661461+0000","last_active":"2024-05-30T17:07:02.065303+0000","last_peered":"2024-05-30T17:07:02.065303+0000","last_clean":"2024-05-30T17:07:02.065303+0000","last_became_active":"2024-05-30T17:04:27.660883+0000","last_became_peered":"2024-05-30T17:04:27.660883+0000","last_unstale":"2024-05-30T17:07:02.065303+0000","last_undegraded":"2024-05-30T17:07:02.065303+0000","last_fullsized":"2024-05-30T17:07:02.065303+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:09:10.641928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":96,"num_read_kb":393216,"num_write":91,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"133'111","reported_seq":221,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.063559+0000","last_change":"2024-05-30T17:04:27.666142+0000","last_active":"2024-05-30T17:07:02.063559+0000","last_peered":"2024-05-30T17:07:02.063559+0000","last_clean":"2024-05-30T17:07:02.063559+0000","last_became_active":"2024-05-30T17:04:27.665266+0000","last_became_peered":"2024-05-30T17:04:27.665266+0000","last_unstale":"2024-05-30T17:07:02.063559+0000","last_undegraded":"2024-05-30T17:07:02.063559+0000","last_fullsized":"2024-05-30T17:07:02.063559+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:22.395407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":93,"num_read_kb":364548,"num_write":70,"num_write_kb":258049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"133'123","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071900+0000","last_change":"2024-05-30T17:04:27.655353+0000","last_active":"2024-05-30T17:07:02.071900+0000","last_peered":"2024-05-30T17:07:02.071900+0000","last_clean":"2024-05-30T17:07:02.071900+0000","last_became_active":"2024-05-30T17:04:27.655046+0000","last_became_peered":"2024-05-30T17:04:27.655046+0000","last_unstale":"2024-05-30T17:07:02.071900+0000","last_undegraded":"2024-05-30T17:07:02.071900+0000","last_fullsized":"2024-05-30T17:07:02.071900+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:03.759562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":82,"num_read_kb":335872,"num_write":80,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"133'139","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.080510+0000","last_change":"2024-05-30T17:04:27.660230+0000","last_active":"2024-05-30T17:07:02.080510+0000","last_peered":"2024-05-30T17:07:02.080510+0000","last_clean":"2024-05-30T17:07:02.080510+0000","last_became_active":"2024-05-30T17:04:27.659965+0000","last_became_peered":"2024-05-30T17:04:27.659965+0000","last_unstale":"2024-05-30T17:07:02.080510+0000","last_undegraded":"2024-05-30T17:07:02.080510+0000","last_fullsized":"2024-05-30T17:07:02.080510+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:29:02.948480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629892,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":62,"num_read_kb":249857,"num_write":78,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"133'122","reported_seq":169,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075397+0000","last_change":"2024-05-30T17:04:27.651454+0000","last_active":"2024-05-30T17:07:02.075397+0000","last_peered":"2024-05-30T17:07:02.075397+0000","last_clean":"2024-05-30T17:07:02.075397+0000","last_became_active":"2024-05-30T17:04:27.650330+0000","last_became_peered":"2024-05-30T17:04:27.650330+0000","last_unstale":"2024-05-30T17:07:02.075397+0000","last_undegraded":"2024-05-30T17:07:02.075397+0000","last_fullsized":"2024-05-30T17:07:02.075397+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:29:36.345038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":30,"num_read_kb":122880,"num_write":68,"num_write_kb":245760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"133'131","reported_seq":201,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.386722+0000","last_change":"2024-05-30T17:04:27.656402+0000","last_active":"2024-05-30T17:06:47.386722+0000","last_peered":"2024-05-30T17:06:47.386722+0000","last_clean":"2024-05-30T17:06:47.386722+0000","last_became_active":"2024-05-30T17:04:27.656141+0000","last_became_peered":"2024-05-30T17:04:27.656141+0000","last_unstale":"2024-05-30T17:06:47.386722+0000","last_undegraded":"2024-05-30T17:06:47.386722+0000","last_fullsized":"2024-05-30T17:06:47.386722+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:08.433002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":53,"num_read_kb":217088,"num_write":82,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"133'131","reported_seq":190,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075517+0000","last_change":"2024-05-30T17:04:27.655050+0000","last_active":"2024-05-30T17:07:02.075517+0000","last_peered":"2024-05-30T17:07:02.075517+0000","last_clean":"2024-05-30T17:07:02.075517+0000","last_became_active":"2024-05-30T17:04:27.654786+0000","last_became_peered":"2024-05-30T17:04:27.654786+0000","last_unstale":"2024-05-30T17:07:02.075517+0000","last_undegraded":"2024-05-30T17:07:02.075517+0000","last_fullsized":"2024-05-30T17:07:02.075517+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:12.824800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":77,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"133'122","reported_seq":229,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.380145+0000","last_change":"2024-05-30T17:04:27.650889+0000","last_active":"2024-05-30T17:06:47.380145+0000","last_peered":"2024-05-30T17:06:47.380145+0000","last_clean":"2024-05-30T17:06:47.380145+0000","last_became_active":"2024-05-30T17:04:27.649462+0000","last_became_peered":"2024-05-30T17:04:27.649462+0000","last_unstale":"2024-05-30T17:06:47.380145+0000","last_undegraded":"2024-05-30T17:06:47.380145+0000","last_fullsized":"2024-05-30T17:06:47.380145+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:02:33.740142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":90,"num_read_kb":352260,"num_write":88,"num_write_kb":311298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"133'143","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072013+0000","last_change":"2024-05-30T17:04:27.661225+0000","last_active":"2024-05-30T17:07:02.072013+0000","last_peered":"2024-05-30T17:07:02.072013+0000","last_clean":"2024-05-30T17:07:02.072013+0000","last_became_active":"2024-05-30T17:04:27.660532+0000","last_became_peered":"2024-05-30T17:04:27.660532+0000","last_unstale":"2024-05-30T17:07:02.072013+0000","last_undegraded":"2024-05-30T17:07:02.072013+0000","last_fullsized":"2024-05-30T17:07:02.072013+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:06.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":71,"num_read_kb":278531,"num_write":90,"num_write_kb":315393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"133'136","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.385882+0000","last_change":"2024-05-30T17:04:27.652401+0000","last_active":"2024-05-30T17:06:47.385882+0000","last_peered":"2024-05-30T17:06:47.385882+0000","last_clean":"2024-05-30T17:06:47.385882+0000","last_became_active":"2024-05-30T17:04:27.652097+0000","last_became_peered":"2024-05-30T17:04:27.652097+0000","last_unstale":"2024-05-30T17:06:47.385882+0000","last_undegraded":"2024-05-30T17:06:47.385882+0000","last_fullsized":"2024-05-30T17:06:47.385882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:22:37.455945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":84,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"133'143","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.059723+0000","last_change":"2024-05-30T17:04:27.668938+0000","last_active":"2024-05-30T17:07:02.059723+0000","last_peered":"2024-05-30T17:07:02.059723+0000","last_clean":"2024-05-30T17:07:02.059723+0000","last_became_active":"2024-05-30T17:04:27.667647+0000","last_became_peered":"2024-05-30T17:04:27.667647+0000","last_unstale":"2024-05-30T17:07:02.059723+0000","last_undegraded":"2024-05-30T17:07:02.059723+0000","last_fullsized":"2024-05-30T17:07:02.059723+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:30.304469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":90,"num_read_kb":364545,"num_write":97,"num_write_kb":348161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"133'132","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.076029+0000","last_change":"2024-05-30T17:04:27.662797+0000","last_active":"2024-05-30T17:07:02.076029+0000","last_peered":"2024-05-30T17:07:02.076029+0000","last_clean":"2024-05-30T17:07:02.076029+0000","last_became_active":"2024-05-30T17:04:27.662501+0000","last_became_peered":"2024-05-30T17:04:27.662501+0000","last_unstale":"2024-05-30T17:07:02.076029+0000","last_undegraded":"2024-05-30T17:07:02.076029+0000","last_fullsized":"2024-05-30T17:07:02.076029+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:08:53.115296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":57,"num_read_kb":229377,"num_write":78,"num_write_kb":282625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"133'147","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.069190+0000","last_change":"2024-05-30T17:04:27.663482+0000","last_active":"2024-05-30T17:07:02.069190+0000","last_peered":"2024-05-30T17:07:02.069190+0000","last_clean":"2024-05-30T17:07:02.069190+0000","last_became_active":"2024-05-30T17:04:27.663243+0000","last_became_peered":"2024-05-30T17:04:27.663243+0000","last_unstale":"2024-05-30T17:07:02.069190+0000","last_undegraded":"2024-05-30T17:07:02.069190+0000","last_fullsized":"2024-05-30T17:07:02.069190+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:18:01.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":93,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"133'141","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.070605+0000","last_change":"2024-05-30T17:04:27.664136+0000","last_active":"2024-05-30T17:07:02.070605+0000","last_peered":"2024-05-30T17:07:02.070605+0000","last_clean":"2024-05-30T17:07:02.070605+0000","last_became_active":"2024-05-30T17:04:27.663855+0000","last_became_peered":"2024-05-30T17:04:27.663855+0000","last_unstale":"2024-05-30T17:07:02.070605+0000","last_undegraded":"2024-05-30T17:07:02.070605+0000","last_fullsized":"2024-05-30T17:07:02.070605+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:58:09.184441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":52,"num_read_kb":212992,"num_write":85,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"133'145","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073496+0000","last_change":"2024-05-30T17:04:27.653664+0000","last_active":"2024-05-30T17:07:02.073496+0000","last_peered":"2024-05-30T17:07:02.073496+0000","last_clean":"2024-05-30T17:07:02.073496+0000","last_became_active":"2024-05-30T17:04:27.653397+0000","last_became_peered":"2024-05-30T17:04:27.653397+0000","last_unstale":"2024-05-30T17:07:02.073496+0000","last_undegraded":"2024-05-30T17:07:02.073496+0000","last_fullsized":"2024-05-30T17:07:02.073496+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:48.819945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":66,"num_read_kb":253956,"num_write":74,"num_write_kb":266242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"133'150","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.391541+0000","last_change":"2024-05-30T17:04:27.657224+0000","last_active":"2024-05-30T17:06:47.391541+0000","last_peered":"2024-05-30T17:06:47.391541+0000","last_clean":"2024-05-30T17:06:47.391541+0000","last_became_active":"2024-05-30T17:04:27.656941+0000","last_became_peered":"2024-05-30T17:04:27.656941+0000","last_unstale":"2024-05-30T17:06:47.391541+0000","last_undegraded":"2024-05-30T17:06:47.391541+0000","last_fullsized":"2024-05-30T17:06:47.391541+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:33.680204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":86,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"133'127","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072257+0000","last_change":"2024-05-30T17:04:48.390020+0000","last_active":"2024-05-30T17:07:02.072257+0000","last_peered":"2024-05-30T17:07:02.072257+0000","last_clean":"2024-05-30T17:07:02.072257+0000","last_became_active":"2024-05-30T17:04:48.283505+0000","last_became_peered":"2024-05-30T17:04:48.283505+0000","last_unstale":"2024-05-30T17:07:02.072257+0000","last_undegraded":"2024-05-30T17:07:02.072257+0000","last_fullsized":"2024-05-30T17:07:02.072257+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:22:07.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":77,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.24","version":"133'126","reported_seq":175,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.061199+0000","last_change":"2024-05-30T17:04:27.664832+0000","last_active":"2024-05-30T17:07:02.061199+0000","last_peered":"2024-05-30T17:07:02.061199+0000","last_clean":"2024-05-30T17:07:02.061199+0000","last_became_active":"2024-05-30T17:04:27.664502+0000","last_became_peered":"2024-05-30T17:04:27.664502+0000","last_unstale":"2024-05-30T17:07:02.061199+0000","last_undegraded":"2024-05-30T17:07:02.061199+0000","last_fullsized":"2024-05-30T17:07:02.061199+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:01:53.320309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":32,"num_read_kb":131072,"num_write":80,"num_write_kb":282625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"133'142","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071698+0000","last_change":"2024-05-30T17:04:27.654528+0000","last_active":"2024-05-30T17:07:02.071698+0000","last_peered":"2024-05-30T17:07:02.071698+0000","last_clean":"2024-05-30T17:07:02.071698+0000","last_became_active":"2024-05-30T17:04:27.653960+0000","last_became_peered":"2024-05-30T17:04:27.653960+0000","last_unstale":"2024-05-30T17:07:02.071698+0000","last_undegraded":"2024-05-30T17:07:02.071698+0000","last_fullsized":"2024-05-30T17:07:02.071698+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:15.226549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":83,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"133'143","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078546+0000","last_change":"2024-05-30T17:04:27.654884+0000","last_active":"2024-05-30T17:07:02.078546+0000","last_peered":"2024-05-30T17:07:02.078546+0000","last_clean":"2024-05-30T17:07:02.078546+0000","last_became_active":"2024-05-30T17:04:27.654299+0000","last_became_peered":"2024-05-30T17:04:27.654299+0000","last_unstale":"2024-05-30T17:07:02.078546+0000","last_undegraded":"2024-05-30T17:07:02.078546+0000","last_fullsized":"2024-05-30T17:07:02.078546+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:24:47.150653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":87,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"133'142","reported_seq":255,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078715+0000","last_change":"2024-05-30T17:04:27.663731+0000","last_active":"2024-05-30T17:07:02.078715+0000","last_peered":"2024-05-30T17:07:02.078715+0000","last_clean":"2024-05-30T17:07:02.078715+0000","last_became_active":"2024-05-30T17:04:27.663462+0000","last_became_peered":"2024-05-30T17:04:27.663462+0000","last_unstale":"2024-05-30T17:07:02.078715+0000","last_undegraded":"2024-05-30T17:07:02.078715+0000","last_fullsized":"2024-05-30T17:07:02.078715+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:05:45.058232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":96,"num_read_kb":376836,"num_write":70,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"133'136","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074057+0000","last_change":"2024-05-30T17:04:27.648781+0000","last_active":"2024-05-30T17:07:02.074057+0000","last_peered":"2024-05-30T17:07:02.074057+0000","last_clean":"2024-05-30T17:07:02.074057+0000","last_became_active":"2024-05-30T17:04:27.648348+0000","last_became_peered":"2024-05-30T17:04:27.648348+0000","last_unstale":"2024-05-30T17:07:02.074057+0000","last_undegraded":"2024-05-30T17:07:02.074057+0000","last_fullsized":"2024-05-30T17:07:02.074057+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:18:01.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":69,"num_read_kb":282624,"num_write":74,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"133'128","reported_seq":186,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.380374+0000","last_change":"2024-05-30T17:04:27.665116+0000","last_active":"2024-05-30T17:06:47.380374+0000","last_peered":"2024-05-30T17:06:47.380374+0000","last_clean":"2024-05-30T17:06:47.380374+0000","last_became_active":"2024-05-30T17:04:27.664853+0000","last_became_peered":"2024-05-30T17:04:27.664853+0000","last_unstale":"2024-05-30T17:06:47.380374+0000","last_undegraded":"2024-05-30T17:06:47.380374+0000","last_fullsized":"2024-05-30T17:06:47.380374+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:00.380018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":41,"num_read_kb":163841,"num_write":78,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"130'4","reported_seq":23,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.385302+0000","last_change":"2024-05-30T17:04:26.653769+0000","last_active":"2024-05-30T17:04:48.385302+0000","last_peered":"2024-05-30T17:04:48.385302+0000","last_clean":"2024-05-30T17:04:48.385302+0000","last_became_active":"2024-05-30T17:04:26.653331+0000","last_became_peered":"2024-05-30T17:04:26.653331+0000","last_unstale":"2024-05-30T17:04:48.385302+0000","last_undegraded":"2024-05-30T17:04:48.385302+0000","last_fullsized":"2024-05-30T17:04:48.385302+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:48.287253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"133'134","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075995+0000","last_change":"2024-05-30T17:04:27.662362+0000","last_active":"2024-05-30T17:07:02.075995+0000","last_peered":"2024-05-30T17:07:02.075995+0000","last_clean":"2024-05-30T17:07:02.075995+0000","last_became_active":"2024-05-30T17:04:27.662074+0000","last_became_peered":"2024-05-30T17:04:27.662074+0000","last_unstale":"2024-05-30T17:07:02.075995+0000","last_undegraded":"2024-05-30T17:07:02.075995+0000","last_fullsized":"2024-05-30T17:07:02.075995+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:46.552415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":67,"num_read_kb":270337,"num_write":83,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.285510+0000","last_change":"2024-05-30T17:04:26.652574+0000","last_active":"2024-05-30T17:04:48.285510+0000","last_peered":"2024-05-30T17:04:48.285510+0000","last_clean":"2024-05-30T17:04:48.285510+0000","last_became_active":"2024-05-30T17:04:26.652142+0000","last_became_peered":"2024-05-30T17:04:26.652142+0000","last_unstale":"2024-05-30T17:04:48.285510+0000","last_undegraded":"2024-05-30T17:04:48.285510+0000","last_fullsized":"2024-05-30T17:04:48.285510+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:56.876839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"133'126","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.070793+0000","last_change":"2024-05-30T17:04:27.660400+0000","last_active":"2024-05-30T17:07:02.070793+0000","last_peered":"2024-05-30T17:07:02.070793+0000","last_clean":"2024-05-30T17:07:02.070793+0000","last_became_active":"2024-05-30T17:04:27.659049+0000","last_became_peered":"2024-05-30T17:04:27.659049+0000","last_unstale":"2024-05-30T17:07:02.070793+0000","last_undegraded":"2024-05-30T17:07:02.070793+0000","last_fullsized":"2024-05-30T17:07:02.070793+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:40.140860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435717,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":77,"num_write_kb":286721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"133'3","reported_seq":22,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:10.709212+0000","last_change":"2024-05-30T17:04:26.652502+0000","last_active":"2024-05-30T17:05:10.709212+0000","last_peered":"2024-05-30T17:05:10.709212+0000","last_clean":"2024-05-30T17:05:10.709212+0000","last_became_active":"2024-05-30T17:04:26.652240+0000","last_became_peered":"2024-05-30T17:04:26.652240+0000","last_unstale":"2024-05-30T17:05:10.709212+0000","last_undegraded":"2024-05-30T17:05:10.709212+0000","last_fullsized":"2024-05-30T17:05:10.709212+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:05:38.644445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"133'143","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078731+0000","last_change":"2024-05-30T17:04:27.659729+0000","last_active":"2024-05-30T17:07:02.078731+0000","last_peered":"2024-05-30T17:07:02.078731+0000","last_clean":"2024-05-30T17:07:02.078731+0000","last_became_active":"2024-05-30T17:04:27.659448+0000","last_became_peered":"2024-05-30T17:04:27.659448+0000","last_unstale":"2024-05-30T17:07:02.078731+0000","last_undegraded":"2024-05-30T17:07:02.078731+0000","last_fullsized":"2024-05-30T17:07:02.078731+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:24:26.077897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":85,"num_read_kb":348160,"num_write":95,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"133'3","reported_seq":22,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:10.928697+0000","last_change":"2024-05-30T17:04:26.644729+0000","last_active":"2024-05-30T17:06:10.928697+0000","last_peered":"2024-05-30T17:06:10.928697+0000","last_clean":"2024-05-30T17:06:10.928697+0000","last_became_active":"2024-05-30T17:04:26.644381+0000","last_became_peered":"2024-05-30T17:04:26.644381+0000","last_unstale":"2024-05-30T17:06:10.928697+0000","last_undegraded":"2024-05-30T17:06:10.928697+0000","last_fullsized":"2024-05-30T17:06:10.928697+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:37:07.585571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"133'137","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.379965+0000","last_change":"2024-05-30T17:04:27.650774+0000","last_active":"2024-05-30T17:06:47.379965+0000","last_peered":"2024-05-30T17:06:47.379965+0000","last_clean":"2024-05-30T17:06:47.379965+0000","last_became_active":"2024-05-30T17:04:27.649829+0000","last_became_peered":"2024-05-30T17:04:27.649829+0000","last_unstale":"2024-05-30T17:06:47.379965+0000","last_undegraded":"2024-05-30T17:06:47.379965+0000","last_fullsized":"2024-05-30T17:06:47.379965+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:43:56.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":54,"num_read_kb":221184,"num_write":83,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.391828+0000","last_change":"2024-05-30T17:04:26.649081+0000","last_active":"2024-05-30T17:04:48.391828+0000","last_peered":"2024-05-30T17:04:48.391828+0000","last_clean":"2024-05-30T17:04:48.391828+0000","last_became_active":"2024-05-30T17:04:26.648809+0000","last_became_peered":"2024-05-30T17:04:26.648809+0000","last_unstale":"2024-05-30T17:04:48.391828+0000","last_undegraded":"2024-05-30T17:04:48.391828+0000","last_fullsized":"2024-05-30T17:04:48.391828+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:19.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"133'135","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074364+0000","last_change":"2024-05-30T17:04:27.657052+0000","last_active":"2024-05-30T17:07:02.074364+0000","last_peered":"2024-05-30T17:07:02.074364+0000","last_clean":"2024-05-30T17:07:02.074364+0000","last_became_active":"2024-05-30T17:04:27.656807+0000","last_became_peered":"2024-05-30T17:04:27.656807+0000","last_unstale":"2024-05-30T17:07:02.074364+0000","last_undegraded":"2024-05-30T17:07:02.074364+0000","last_fullsized":"2024-05-30T17:07:02.074364+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:23.181795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":89,"num_read_kb":364544,"num_write":85,"num_write_kb":319488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.296676+0000","last_change":"2024-05-30T17:04:26.650934+0000","last_active":"2024-05-30T17:04:48.296676+0000","last_peered":"2024-05-30T17:04:48.296676+0000","last_clean":"2024-05-30T17:04:48.296676+0000","last_became_active":"2024-05-30T17:04:26.650668+0000","last_became_peered":"2024-05-30T17:04:26.650668+0000","last_unstale":"2024-05-30T17:04:48.296676+0000","last_undegraded":"2024-05-30T17:04:48.296676+0000","last_fullsized":"2024-05-30T17:04:48.296676+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:04.028994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"133'140","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072051+0000","last_change":"2024-05-30T17:04:27.653284+0000","last_active":"2024-05-30T17:07:02.072051+0000","last_peered":"2024-05-30T17:07:02.072051+0000","last_clean":"2024-05-30T17:07:02.072051+0000","last_became_active":"2024-05-30T17:04:27.653020+0000","last_became_peered":"2024-05-30T17:04:27.653020+0000","last_unstale":"2024-05-30T17:07:02.072051+0000","last_undegraded":"2024-05-30T17:07:02.072051+0000","last_fullsized":"2024-05-30T17:07:02.072051+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:21.704608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":70,"num_read_kb":278530,"num_write":74,"num_write_kb":262145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.283847+0000","last_change":"2024-05-30T17:04:26.642168+0000","last_active":"2024-05-30T17:04:48.283847+0000","last_peered":"2024-05-30T17:04:48.283847+0000","last_clean":"2024-05-30T17:04:48.283847+0000","last_became_active":"2024-05-30T17:04:26.641791+0000","last_became_peered":"2024-05-30T17:04:26.641791+0000","last_unstale":"2024-05-30T17:04:48.283847+0000","last_undegraded":"2024-05-30T17:04:48.283847+0000","last_fullsized":"2024-05-30T17:04:48.283847+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:06:45.068461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"133'134","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.066277+0000","last_change":"2024-05-30T17:04:27.648200+0000","last_active":"2024-05-30T17:07:02.066277+0000","last_peered":"2024-05-30T17:07:02.066277+0000","last_clean":"2024-05-30T17:07:02.066277+0000","last_became_active":"2024-05-30T17:04:27.647928+0000","last_became_peered":"2024-05-30T17:04:27.647928+0000","last_unstale":"2024-05-30T17:07:02.066277+0000","last_undegraded":"2024-05-30T17:07:02.066277+0000","last_fullsized":"2024-05-30T17:07:02.066277+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:25:31.744496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":75,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.391606+0000","last_change":"2024-05-30T17:04:26.645457+0000","last_active":"2024-05-30T17:04:48.391606+0000","last_peered":"2024-05-30T17:04:48.391606+0000","last_clean":"2024-05-30T17:04:48.391606+0000","last_became_active":"2024-05-30T17:04:26.642988+0000","last_became_peered":"2024-05-30T17:04:26.642988+0000","last_unstale":"2024-05-30T17:04:48.391606+0000","last_undegraded":"2024-05-30T17:04:48.391606+0000","last_fullsized":"2024-05-30T17:04:48.391606+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:51:19.024263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"133'122","reported_seq":174,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078137+0000","last_change":"2024-05-30T17:04:27.654579+0000","last_active":"2024-05-30T17:07:02.078137+0000","last_peered":"2024-05-30T17:07:02.078137+0000","last_clean":"2024-05-30T17:07:02.078137+0000","last_became_active":"2024-05-30T17:04:27.654315+0000","last_became_peered":"2024-05-30T17:04:27.654315+0000","last_unstale":"2024-05-30T17:07:02.078137+0000","last_undegraded":"2024-05-30T17:07:02.078137+0000","last_fullsized":"2024-05-30T17:07:02.078137+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:42.109985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":35,"num_read_kb":143360,"num_write":60,"num_write_kb":217088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"133'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:10.717567+0000","last_change":"2024-05-30T17:04:26.653783+0000","last_active":"2024-05-30T17:05:10.717567+0000","last_peered":"2024-05-30T17:05:10.717567+0000","last_clean":"2024-05-30T17:05:10.717567+0000","last_became_active":"2024-05-30T17:04:26.653413+0000","last_became_peered":"2024-05-30T17:04:26.653413+0000","last_unstale":"2024-05-30T17:05:10.717567+0000","last_undegraded":"2024-05-30T17:05:10.717567+0000","last_fullsized":"2024-05-30T17:05:10.717567+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:47.810832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"133'120","reported_seq":177,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.062511+0000","last_change":"2024-05-30T17:04:27.670112+0000","last_active":"2024-05-30T17:07:02.062511+0000","last_peered":"2024-05-30T17:07:02.062511+0000","last_clean":"2024-05-30T17:07:02.062511+0000","last_became_active":"2024-05-30T17:04:27.669759+0000","last_became_peered":"2024-05-30T17:04:27.669759+0000","last_unstale":"2024-05-30T17:07:02.062511+0000","last_undegraded":"2024-05-30T17:07:02.062511+0000","last_fullsized":"2024-05-30T17:07:02.062511+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:28:30.371308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881204,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":40,"num_read_kb":159745,"num_write":65,"num_write_kb":245761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.297131+0000","last_change":"2024-05-30T17:04:26.649285+0000","last_active":"2024-05-30T17:04:48.297131+0000","last_peered":"2024-05-30T17:04:48.297131+0000","last_clean":"2024-05-30T17:04:48.297131+0000","last_became_active":"2024-05-30T17:04:26.648983+0000","last_became_peered":"2024-05-30T17:04:26.648983+0000","last_unstale":"2024-05-30T17:04:48.297131+0000","last_undegraded":"2024-05-30T17:04:48.297131+0000","last_fullsized":"2024-05-30T17:04:48.297131+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:19.123667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"133'124","reported_seq":217,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074664+0000","last_change":"2024-05-30T17:04:27.661122+0000","last_active":"2024-05-30T17:07:02.074664+0000","last_peered":"2024-05-30T17:07:02.074664+0000","last_clean":"2024-05-30T17:07:02.074664+0000","last_became_active":"2024-05-30T17:04:27.660791+0000","last_became_peered":"2024-05-30T17:04:27.660791+0000","last_unstale":"2024-05-30T17:07:02.074664+0000","last_undegraded":"2024-05-30T17:07:02.074664+0000","last_fullsized":"2024-05-30T17:07:02.074664+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:44:34.412222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":76,"num_read_kb":311296,"num_write":81,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"133'25","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:11.774245+0000","last_change":"2024-05-30T17:04:26.655873+0000","last_active":"2024-05-30T17:06:11.774245+0000","last_peered":"2024-05-30T17:06:11.774245+0000","last_clean":"2024-05-30T17:06:11.774245+0000","last_became_active":"2024-05-30T17:04:26.655436+0000","last_became_peered":"2024-05-30T17:04:26.655436+0000","last_unstale":"2024-05-30T17:06:11.774245+0000","last_undegraded":"2024-05-30T17:06:11.774245+0000","last_fullsized":"2024-05-30T17:06:11.774245+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:41.100872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"133'121","reported_seq":200,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071846+0000","last_change":"2024-05-30T17:04:27.655308+0000","last_active":"2024-05-30T17:07:02.071846+0000","last_peered":"2024-05-30T17:07:02.071846+0000","last_clean":"2024-05-30T17:07:02.071846+0000","last_became_active":"2024-05-30T17:04:27.654682+0000","last_became_peered":"2024-05-30T17:04:27.654682+0000","last_unstale":"2024-05-30T17:07:02.071846+0000","last_undegraded":"2024-05-30T17:07:02.071846+0000","last_fullsized":"2024-05-30T17:07:02.071846+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:13:50.711493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":62,"num_read_kb":237572,"num_write":64,"num_write_kb":221186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"133'445","reported_seq":464,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.024243+0000","last_change":"2024-05-30T17:04:26.644996+0000","last_active":"2024-05-30T17:07:02.024243+0000","last_peered":"2024-05-30T17:07:02.024243+0000","last_clean":"2024-05-30T17:07:02.024243+0000","last_became_active":"2024-05-30T17:04:26.644394+0000","last_became_peered":"2024-05-30T17:04:26.644394+0000","last_unstale":"2024-05-30T17:07:02.024243+0000","last_undegraded":"2024-05-30T17:07:02.024243+0000","last_fullsized":"2024-05-30T17:07:02.024243+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:32:48.916197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":1814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"133'140","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071163+0000","last_change":"2024-05-30T17:04:27.667231+0000","last_active":"2024-05-30T17:07:02.071163+0000","last_peered":"2024-05-30T17:07:02.071163+0000","last_clean":"2024-05-30T17:07:02.071163+0000","last_became_active":"2024-05-30T17:04:27.666778+0000","last_became_peered":"2024-05-30T17:04:27.666778+0000","last_unstale":"2024-05-30T17:07:02.071163+0000","last_undegraded":"2024-05-30T17:07:02.071163+0000","last_fullsized":"2024-05-30T17:07:02.071163+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:05:27.633461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":51,"num_read_kb":204801,"num_write":86,"num_write_kb":315393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.280865+0000","last_change":"2024-05-30T17:04:26.648513+0000","last_active":"2024-05-30T17:04:48.280865+0000","last_peered":"2024-05-30T17:04:48.280865+0000","last_clean":"2024-05-30T17:04:48.280865+0000","last_became_active":"2024-05-30T17:04:26.648016+0000","last_became_peered":"2024-05-30T17:04:26.648016+0000","last_unstale":"2024-05-30T17:04:48.280865+0000","last_undegraded":"2024-05-30T17:04:48.280865+0000","last_fullsized":"2024-05-30T17:04:48.280865+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:19.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"133'138","reported_seq":213,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075471+0000","last_change":"2024-05-30T17:04:27.647201+0000","last_active":"2024-05-30T17:07:02.075471+0000","last_peered":"2024-05-30T17:07:02.075471+0000","last_clean":"2024-05-30T17:07:02.075471+0000","last_became_active":"2024-05-30T17:04:27.646842+0000","last_became_peered":"2024-05-30T17:04:27.646842+0000","last_unstale":"2024-05-30T17:07:02.075471+0000","last_undegraded":"2024-05-30T17:07:02.075471+0000","last_fullsized":"2024-05-30T17:07:02.075471+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:42.109985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":87,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.391719+0000","last_change":"2024-05-30T17:04:26.643372+0000","last_active":"2024-05-30T17:04:48.391719+0000","last_peered":"2024-05-30T17:04:48.391719+0000","last_clean":"2024-05-30T17:04:48.391719+0000","last_became_active":"2024-05-30T17:04:26.641530+0000","last_became_peered":"2024-05-30T17:04:26.641530+0000","last_unstale":"2024-05-30T17:04:48.391719+0000","last_undegraded":"2024-05-30T17:04:48.391719+0000","last_fullsized":"2024-05-30T17:04:48.391719+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:28.821395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"133'158","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.068945+0000","last_change":"2024-05-30T17:04:27.663493+0000","last_active":"2024-05-30T17:07:02.068945+0000","last_peered":"2024-05-30T17:07:02.068945+0000","last_clean":"2024-05-30T17:07:02.068945+0000","last_became_active":"2024-05-30T17:04:27.662912+0000","last_became_peered":"2024-05-30T17:04:27.662912+0000","last_unstale":"2024-05-30T17:07:02.068945+0000","last_undegraded":"2024-05-30T17:07:02.068945+0000","last_fullsized":"2024-05-30T17:07:02.068945+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:12:24.226617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544581,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":99,"num_write_kb":364545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"130'8","reported_seq":27,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.331297+0000","last_change":"2024-05-30T17:04:26.651768+0000","last_active":"2024-05-30T17:04:48.331297+0000","last_peered":"2024-05-30T17:04:48.331297+0000","last_clean":"2024-05-30T17:04:48.331297+0000","last_became_active":"2024-05-30T17:04:26.651470+0000","last_became_peered":"2024-05-30T17:04:26.651470+0000","last_unstale":"2024-05-30T17:04:48.331297+0000","last_undegraded":"2024-05-30T17:04:48.331297+0000","last_fullsized":"2024-05-30T17:04:48.331297+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:51:21.096723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"133'115","reported_seq":158,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071224+0000","last_change":"2024-05-30T17:04:27.656826+0000","last_active":"2024-05-30T17:07:02.071224+0000","last_peered":"2024-05-30T17:07:02.071224+0000","last_clean":"2024-05-30T17:07:02.071224+0000","last_became_active":"2024-05-30T17:04:27.656527+0000","last_became_peered":"2024-05-30T17:04:27.656527+0000","last_unstale":"2024-05-30T17:07:02.071224+0000","last_undegraded":"2024-05-30T17:07:02.071224+0000","last_fullsized":"2024-05-30T17:07:02.071224+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:53.659379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":26,"num_read_kb":94211,"num_write":61,"num_write_kb":212993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.285745+0000","last_change":"2024-05-30T17:04:26.646106+0000","last_active":"2024-05-30T17:04:48.285745+0000","last_peered":"2024-05-30T17:04:48.285745+0000","last_clean":"2024-05-30T17:04:48.285745+0000","last_became_active":"2024-05-30T17:04:26.645435+0000","last_became_peered":"2024-05-30T17:04:26.645435+0000","last_unstale":"2024-05-30T17:04:48.285745+0000","last_undegraded":"2024-05-30T17:04:48.285745+0000","last_fullsized":"2024-05-30T17:04:48.285745+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:55.135303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"133'154","reported_seq":246,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.064901+0000","last_change":"2024-05-30T17:04:27.666627+0000","last_active":"2024-05-30T17:07:02.064901+0000","last_peered":"2024-05-30T17:07:02.064901+0000","last_clean":"2024-05-30T17:07:02.064901+0000","last_became_active":"2024-05-30T17:04:27.666318+0000","last_became_peered":"2024-05-30T17:04:27.666318+0000","last_unstale":"2024-05-30T17:07:02.064901+0000","last_undegraded":"2024-05-30T17:07:02.064901+0000","last_fullsized":"2024-05-30T17:07:02.064901+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:45:56.513914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":102,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"130'2","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.277928+0000","last_change":"2024-05-30T17:04:26.649232+0000","last_active":"2024-05-30T17:04:48.277928+0000","last_peered":"2024-05-30T17:04:48.277928+0000","last_clean":"2024-05-30T17:04:48.277928+0000","last_became_active":"2024-05-30T17:04:26.648936+0000","last_became_peered":"2024-05-30T17:04:26.648936+0000","last_unstale":"2024-05-30T17:04:48.277928+0000","last_undegraded":"2024-05-30T17:04:48.277928+0000","last_fullsized":"2024-05-30T17:04:48.277928+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:05:44.049119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"133'130","reported_seq":205,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.391842+0000","last_change":"2024-05-30T17:04:27.657488+0000","last_active":"2024-05-30T17:06:47.391842+0000","last_peered":"2024-05-30T17:06:47.391842+0000","last_clean":"2024-05-30T17:06:47.391842+0000","last_became_active":"2024-05-30T17:04:27.657216+0000","last_became_peered":"2024-05-30T17:04:27.657216+0000","last_unstale":"2024-05-30T17:06:47.391842+0000","last_undegraded":"2024-05-30T17:06:47.391842+0000","last_fullsized":"2024-05-30T17:06:47.391842+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:18.543050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909897,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":58,"num_read_kb":221188,"num_write":75,"num_write_kb":241669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.284309+0000","last_change":"2024-05-30T17:04:26.652397+0000","last_active":"2024-05-30T17:04:48.284309+0000","last_peered":"2024-05-30T17:04:48.284309+0000","last_clean":"2024-05-30T17:04:48.284309+0000","last_became_active":"2024-05-30T17:04:26.652083+0000","last_became_peered":"2024-05-30T17:04:26.652083+0000","last_unstale":"2024-05-30T17:04:48.284309+0000","last_undegraded":"2024-05-30T17:04:48.284309+0000","last_fullsized":"2024-05-30T17:04:48.284309+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:17.631736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"133'141","reported_seq":233,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.077211+0000","last_change":"2024-05-30T17:04:27.649124+0000","last_active":"2024-05-30T17:07:02.077211+0000","last_peered":"2024-05-30T17:07:02.077211+0000","last_clean":"2024-05-30T17:07:02.077211+0000","last_became_active":"2024-05-30T17:04:27.648847+0000","last_became_peered":"2024-05-30T17:04:27.648847+0000","last_unstale":"2024-05-30T17:07:02.077211+0000","last_undegraded":"2024-05-30T17:07:02.077211+0000","last_fullsized":"2024-05-30T17:07:02.077211+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:42:59.091789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":89,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.285619+0000","last_change":"2024-05-30T17:04:26.646336+0000","last_active":"2024-05-30T17:04:48.285619+0000","last_peered":"2024-05-30T17:04:48.285619+0000","last_clean":"2024-05-30T17:04:48.285619+0000","last_became_active":"2024-05-30T17:04:26.646025+0000","last_became_peered":"2024-05-30T17:04:26.646025+0000","last_unstale":"2024-05-30T17:04:48.285619+0000","last_undegraded":"2024-05-30T17:04:48.285619+0000","last_fullsized":"2024-05-30T17:04:48.285619+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:34.972669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"133'147","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.045813+0000","last_change":"2024-05-30T17:04:27.654618+0000","last_active":"2024-05-30T17:07:02.045813+0000","last_peered":"2024-05-30T17:07:02.045813+0000","last_clean":"2024-05-30T17:07:02.045813+0000","last_became_active":"2024-05-30T17:04:27.653888+0000","last_became_peered":"2024-05-30T17:04:27.653888+0000","last_unstale":"2024-05-30T17:07:02.045813+0000","last_undegraded":"2024-05-30T17:07:02.045813+0000","last_fullsized":"2024-05-30T17:07:02.045813+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:34.447493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":89,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"133'3","reported_seq":22,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:10.719775+0000","last_change":"2024-05-30T17:04:26.657719+0000","last_active":"2024-05-30T17:05:10.719775+0000","last_peered":"2024-05-30T17:05:10.719775+0000","last_clean":"2024-05-30T17:05:10.719775+0000","last_became_active":"2024-05-30T17:04:26.657452+0000","last_became_peered":"2024-05-30T17:04:26.657452+0000","last_unstale":"2024-05-30T17:05:10.719775+0000","last_undegraded":"2024-05-30T17:05:10.719775+0000","last_fullsized":"2024-05-30T17:05:10.719775+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:02.780429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"133'144","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072479+0000","last_change":"2024-05-30T17:04:27.649752+0000","last_active":"2024-05-30T17:07:02.072479+0000","last_peered":"2024-05-30T17:07:02.072479+0000","last_clean":"2024-05-30T17:07:02.072479+0000","last_became_active":"2024-05-30T17:04:27.649442+0000","last_became_peered":"2024-05-30T17:04:27.649442+0000","last_unstale":"2024-05-30T17:07:02.072479+0000","last_undegraded":"2024-05-30T17:07:02.072479+0000","last_fullsized":"2024-05-30T17:07:02.072479+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:38:19.022224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":66,"num_read_kb":241671,"num_write":82,"num_write_kb":278531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.296766+0000","last_change":"2024-05-30T17:04:26.645875+0000","last_active":"2024-05-30T17:04:48.296766+0000","last_peered":"2024-05-30T17:04:48.296766+0000","last_clean":"2024-05-30T17:04:48.296766+0000","last_became_active":"2024-05-30T17:04:26.645583+0000","last_became_peered":"2024-05-30T17:04:26.645583+0000","last_unstale":"2024-05-30T17:04:48.296766+0000","last_undegraded":"2024-05-30T17:04:48.296766+0000","last_fullsized":"2024-05-30T17:04:48.296766+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:03.486308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"133'147","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.068705+0000","last_change":"2024-05-30T17:04:27.652007+0000","last_active":"2024-05-30T17:07:02.068705+0000","last_peered":"2024-05-30T17:07:02.068705+0000","last_clean":"2024-05-30T17:07:02.068705+0000","last_became_active":"2024-05-30T17:04:27.651701+0000","last_became_peered":"2024-05-30T17:04:27.651701+0000","last_unstale":"2024-05-30T17:07:02.068705+0000","last_undegraded":"2024-05-30T17:07:02.068705+0000","last_fullsized":"2024-05-30T17:07:02.068705+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:57.885952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":91,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.296204+0000","last_change":"2024-05-30T17:04:26.647421+0000","last_active":"2024-05-30T17:04:48.296204+0000","last_peered":"2024-05-30T17:04:48.296204+0000","last_clean":"2024-05-30T17:04:48.296204+0000","last_became_active":"2024-05-30T17:04:26.647155+0000","last_became_peered":"2024-05-30T17:04:26.647155+0000","last_unstale":"2024-05-30T17:04:48.296204+0000","last_undegraded":"2024-05-30T17:04:48.296204+0000","last_fullsized":"2024-05-30T17:04:48.296204+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:59:52.705838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"133'135","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078368+0000","last_change":"2024-05-30T17:04:27.667584+0000","last_active":"2024-05-30T17:07:02.078368+0000","last_peered":"2024-05-30T17:07:02.078368+0000","last_clean":"2024-05-30T17:07:02.078368+0000","last_became_active":"2024-05-30T17:04:27.667268+0000","last_became_peered":"2024-05-30T17:04:27.667268+0000","last_unstale":"2024-05-30T17:07:02.078368+0000","last_undegraded":"2024-05-30T17:07:02.078368+0000","last_fullsized":"2024-05-30T17:07:02.078368+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:45.213871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230686720,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":56,"num_read_kb":229376,"num_write":75,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.277625+0000","last_change":"2024-05-30T17:04:26.650930+0000","last_active":"2024-05-30T17:04:48.277625+0000","last_peered":"2024-05-30T17:04:48.277625+0000","last_clean":"2024-05-30T17:04:48.277625+0000","last_became_active":"2024-05-30T17:04:26.650616+0000","last_became_peered":"2024-05-30T17:04:26.650616+0000","last_unstale":"2024-05-30T17:04:48.277625+0000","last_undegraded":"2024-05-30T17:04:48.277625+0000","last_fullsized":"2024-05-30T17:04:48.277625+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:44.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"133'153","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.066680+0000","last_change":"2024-05-30T17:04:27.664544+0000","last_active":"2024-05-30T17:07:02.066680+0000","last_peered":"2024-05-30T17:07:02.066680+0000","last_clean":"2024-05-30T17:07:02.066680+0000","last_became_active":"2024-05-30T17:04:27.664180+0000","last_became_peered":"2024-05-30T17:04:27.664180+0000","last_unstale":"2024-05-30T17:07:02.066680+0000","last_undegraded":"2024-05-30T17:07:02.066680+0000","last_fullsized":"2024-05-30T17:07:02.066680+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:59.508295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":96,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"130'2","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.280667+0000","last_change":"2024-05-30T17:04:26.653129+0000","last_active":"2024-05-30T17:04:48.280667+0000","last_peered":"2024-05-30T17:04:48.280667+0000","last_clean":"2024-05-30T17:04:48.280667+0000","last_became_active":"2024-05-30T17:04:26.652234+0000","last_became_peered":"2024-05-30T17:04:26.652234+0000","last_unstale":"2024-05-30T17:04:48.280667+0000","last_undegraded":"2024-05-30T17:04:48.280667+0000","last_fullsized":"2024-05-30T17:04:48.280667+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:12.851756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"133'138","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.077318+0000","last_change":"2024-05-30T17:04:27.656246+0000","last_active":"2024-05-30T17:07:02.077318+0000","last_peered":"2024-05-30T17:07:02.077318+0000","last_clean":"2024-05-30T17:07:02.077318+0000","last_became_active":"2024-05-30T17:04:27.655926+0000","last_became_peered":"2024-05-30T17:04:27.655926+0000","last_unstale":"2024-05-30T17:07:02.077318+0000","last_undegraded":"2024-05-30T17:07:02.077318+0000","last_fullsized":"2024-05-30T17:07:02.077318+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:03.789542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":90,"num_write_kb":319489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"133'41","reported_seq":60,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:46.695559+0000","last_change":"2024-05-30T17:04:26.649574+0000","last_active":"2024-05-30T17:06:46.695559+0000","last_peered":"2024-05-30T17:06:46.695559+0000","last_clean":"2024-05-30T17:06:46.695559+0000","last_became_active":"2024-05-30T17:04:26.648998+0000","last_became_peered":"2024-05-30T17:04:26.648998+0000","last_unstale":"2024-05-30T17:06:46.695559+0000","last_undegraded":"2024-05-30T17:06:46.695559+0000","last_fullsized":"2024-05-30T17:06:46.695559+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:35:25.197491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"133'132","reported_seq":237,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072558+0000","last_change":"2024-05-30T17:04:27.654582+0000","last_active":"2024-05-30T17:07:02.072558+0000","last_peered":"2024-05-30T17:07:02.072558+0000","last_clean":"2024-05-30T17:07:02.072558+0000","last_became_active":"2024-05-30T17:04:27.654295+0000","last_became_peered":"2024-05-30T17:04:27.654295+0000","last_unstale":"2024-05-30T17:07:02.072558+0000","last_undegraded":"2024-05-30T17:07:02.072558+0000","last_fullsized":"2024-05-30T17:07:02.072558+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:35.981782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":88,"num_read_kb":360448,"num_write":81,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.392097+0000","last_change":"2024-05-30T17:04:26.647328+0000","last_active":"2024-05-30T17:04:48.392097+0000","last_peered":"2024-05-30T17:04:48.392097+0000","last_clean":"2024-05-30T17:04:48.392097+0000","last_became_active":"2024-05-30T17:04:26.647058+0000","last_became_peered":"2024-05-30T17:04:26.647058+0000","last_unstale":"2024-05-30T17:04:48.392097+0000","last_undegraded":"2024-05-30T17:04:48.392097+0000","last_fullsized":"2024-05-30T17:04:48.392097+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:27:17.347396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"133'142","reported_seq":209,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078089+0000","last_change":"2024-05-30T17:04:27.657344+0000","last_active":"2024-05-30T17:07:02.078089+0000","last_peered":"2024-05-30T17:07:02.078089+0000","last_clean":"2024-05-30T17:07:02.078089+0000","last_became_active":"2024-05-30T17:04:27.657041+0000","last_became_peered":"2024-05-30T17:04:27.657041+0000","last_unstale":"2024-05-30T17:07:02.078089+0000","last_undegraded":"2024-05-30T17:07:02.078089+0000","last_fullsized":"2024-05-30T17:07:02.078089+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:46.552415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824186,"num_objects":68,"num_object_clones":1,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":51,"num_read_kb":200706,"num_write":94,"num_write_kb":315395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.277861+0000","last_change":"2024-05-30T17:04:26.655225+0000","last_active":"2024-05-30T17:04:48.277861+0000","last_peered":"2024-05-30T17:04:48.277861+0000","last_clean":"2024-05-30T17:04:48.277861+0000","last_became_active":"2024-05-30T17:04:26.654383+0000","last_became_peered":"2024-05-30T17:04:26.654383+0000","last_unstale":"2024-05-30T17:04:48.277861+0000","last_undegraded":"2024-05-30T17:04:48.277861+0000","last_fullsized":"2024-05-30T17:04:48.277861+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:36:35.798472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"133'142","reported_seq":214,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071377+0000","last_change":"2024-05-30T17:04:27.659619+0000","last_active":"2024-05-30T17:07:02.071377+0000","last_peered":"2024-05-30T17:07:02.071377+0000","last_clean":"2024-05-30T17:07:02.071377+0000","last_became_active":"2024-05-30T17:04:27.659316+0000","last_became_peered":"2024-05-30T17:04:27.659316+0000","last_unstale":"2024-05-30T17:07:02.071377+0000","last_undegraded":"2024-05-30T17:07:02.071377+0000","last_fullsized":"2024-05-30T17:07:02.071377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:29:40.214450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":88,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.391841+0000","last_change":"2024-05-30T17:04:26.643654+0000","last_active":"2024-05-30T17:04:48.391841+0000","last_peered":"2024-05-30T17:04:48.391841+0000","last_clean":"2024-05-30T17:04:48.391841+0000","last_became_active":"2024-05-30T17:04:26.642798+0000","last_became_peered":"2024-05-30T17:04:26.642798+0000","last_unstale":"2024-05-30T17:04:48.391841+0000","last_undegraded":"2024-05-30T17:04:48.391841+0000","last_fullsized":"2024-05-30T17:04:48.391841+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:22:19.720162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"133'151","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073260+0000","last_change":"2024-05-30T17:04:27.662540+0000","last_active":"2024-05-30T17:07:02.073260+0000","last_peered":"2024-05-30T17:07:02.073260+0000","last_clean":"2024-05-30T17:07:02.073260+0000","last_became_active":"2024-05-30T17:04:27.662294+0000","last_became_peered":"2024-05-30T17:04:27.662294+0000","last_unstale":"2024-05-30T17:07:02.073260+0000","last_undegraded":"2024-05-30T17:07:02.073260+0000","last_fullsized":"2024-05-30T17:07:02.073260+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:03.093546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":85,"num_read_kb":335875,"num_write":93,"num_write_kb":335873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.385120+0000","last_change":"2024-05-30T17:04:26.650407+0000","last_active":"2024-05-30T17:04:48.385120+0000","last_peered":"2024-05-30T17:04:48.385120+0000","last_clean":"2024-05-30T17:04:48.385120+0000","last_became_active":"2024-05-30T17:04:26.650063+0000","last_became_peered":"2024-05-30T17:04:26.650063+0000","last_unstale":"2024-05-30T17:04:48.385120+0000","last_undegraded":"2024-05-30T17:04:48.385120+0000","last_fullsized":"2024-05-30T17:04:48.385120+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:58.499182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"133'121","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.379618+0000","last_change":"2024-05-30T17:04:27.648839+0000","last_active":"2024-05-30T17:06:47.379618+0000","last_peered":"2024-05-30T17:06:47.379618+0000","last_clean":"2024-05-30T17:06:47.379618+0000","last_became_active":"2024-05-30T17:04:27.648558+0000","last_became_peered":"2024-05-30T17:04:27.648558+0000","last_unstale":"2024-05-30T17:06:47.379618+0000","last_undegraded":"2024-05-30T17:06:47.379618+0000","last_fullsized":"2024-05-30T17:06:47.379618+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:52.862600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":83,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"133'32","reported_seq":82,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:11.769701+0000","last_change":"2024-05-30T17:04:26.646155+0000","last_active":"2024-05-30T17:06:11.769701+0000","last_peered":"2024-05-30T17:06:11.769701+0000","last_clean":"2024-05-30T17:06:11.769701+0000","last_became_active":"2024-05-30T17:04:26.645855+0000","last_became_peered":"2024-05-30T17:04:26.645855+0000","last_unstale":"2024-05-30T17:06:11.769701+0000","last_undegraded":"2024-05-30T17:06:11.769701+0000","last_fullsized":"2024-05-30T17:06:11.769701+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:51.017861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4957,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":31,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"133'149","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073381+0000","last_change":"2024-05-30T17:04:27.657377+0000","last_active":"2024-05-30T17:07:02.073381+0000","last_peered":"2024-05-30T17:07:02.073381+0000","last_clean":"2024-05-30T17:07:02.073381+0000","last_became_active":"2024-05-30T17:04:27.657110+0000","last_became_peered":"2024-05-30T17:04:27.657110+0000","last_unstale":"2024-05-30T17:07:02.073381+0000","last_undegraded":"2024-05-30T17:07:02.073381+0000","last_fullsized":"2024-05-30T17:07:02.073381+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:03.789542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":76,"num_read_kb":311296,"num_write":106,"num_write_kb":380928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.277746+0000","last_change":"2024-05-30T17:04:26.646414+0000","last_active":"2024-05-30T17:04:48.277746+0000","last_peered":"2024-05-30T17:04:48.277746+0000","last_clean":"2024-05-30T17:04:48.277746+0000","last_became_active":"2024-05-30T17:04:26.646125+0000","last_became_peered":"2024-05-30T17:04:26.646125+0000","last_unstale":"2024-05-30T17:04:48.277746+0000","last_undegraded":"2024-05-30T17:04:48.277746+0000","last_fullsized":"2024-05-30T17:04:48.277746+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:29:39.205337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"133'138","reported_seq":202,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.067455+0000","last_change":"2024-05-30T17:04:27.668983+0000","last_active":"2024-05-30T17:07:02.067455+0000","last_peered":"2024-05-30T17:07:02.067455+0000","last_clean":"2024-05-30T17:07:02.067455+0000","last_became_active":"2024-05-30T17:04:27.668009+0000","last_became_peered":"2024-05-30T17:04:27.668009+0000","last_unstale":"2024-05-30T17:07:02.067455+0000","last_undegraded":"2024-05-30T17:07:02.067455+0000","last_fullsized":"2024-05-30T17:07:02.067455+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:05:39.653558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":47,"num_read_kb":192512,"num_write":88,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"130'2","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.385038+0000","last_change":"2024-05-30T17:04:26.656301+0000","last_active":"2024-05-30T17:04:48.385038+0000","last_peered":"2024-05-30T17:04:48.385038+0000","last_clean":"2024-05-30T17:04:48.385038+0000","last_became_active":"2024-05-30T17:04:26.655900+0000","last_became_peered":"2024-05-30T17:04:26.655900+0000","last_unstale":"2024-05-30T17:04:48.385038+0000","last_undegraded":"2024-05-30T17:04:48.385038+0000","last_fullsized":"2024-05-30T17:04:48.385038+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:18.390768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":384,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:02.147978+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:05:02.147978+0000","last_peered":"2024-05-30T17:05:02.147978+0000","last_clean":"2024-05-30T17:05:02.147978+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:05:02.147978+0000","last_undegraded":"2024-05-30T17:05:02.147978+0000","last_fullsized":"2024-05-30T17:05:02.147978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":17406362949,"num_objects":4158,"num_object_clones":1,"num_object_copies":8316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4158,"num_whiteouts":1,"num_read":4010,"num_read_kb":16171070,"num_write":5302,"num_write_kb":19193899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34812780544,"data_stored":34812725898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8748,"ondisk_log_size":8748,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1691903,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":625,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3448832,"data_stored":3383806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":576,"ondisk_log_size":576,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509660,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3774688,"kb_used_data":3657496,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":90597152,"statfs":{"total":96636764160,"available":92771483648,"internally_reserved":0,"allocated":3745275904,"data_stored":3744324606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509661,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4762904,"kb_used_data":4627664,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89608936,"statfs":{"total":96636764160,"available":91759550464,"internally_reserved":0,"allocated":4738727936,"data_stored":4737788432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509661,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3647204,"kb_used_data":3507804,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":90724636,"statfs":{"total":96636764160,"available":92902027264,"internally_reserved":0,"allocated":3591991296,"data_stored":3591052876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509662,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5289824,"kb_used_data":5142104,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":89082016,"statfs":{"total":96636764160,"available":91219984384,"internally_reserved":0,"allocated":5265514496,"data_stored":5264580072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509661,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5605036,"kb_used_data":5469796,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":88766804,"statfs":{"total":96636764160,"available":90897207296,"internally_reserved":0,"allocated":5601071104,"data_stored":5600125202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509661,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4081496,"kb_used_data":3933776,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90290344,"statfs":{"total":96636764160,"available":92457312256,"internally_reserved":0,"allocated":4028186624,"data_stored":4027260071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509661,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3721624,"kb_used_data":3573904,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90650216,"statfs":{"total":96636764160,"available":92825821184,"internally_reserved":0,"allocated":3659677696,"data_stored":3658751555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542365,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4236976,"kb_used_data":4101736,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":90134864,"statfs":{"total":96636764160,"available":92298100736,"internally_reserved":0,"allocated":4200177664,"data_stored":4199232093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":138475975},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1703936,"data_stored":1691105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1708032,"data_stored":1686786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3657433088,"data_stored":3657433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4026535936,"data_stored":4026531972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5599412224,"data_stored":5599396487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4198510592,"data_stored":4198498877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5263859712,"data_stored":5263851903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3590332416,"data_stored":3590324665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4735373312,"data_stored":4735369477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3741323264,"data_stored":3741319429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:07:04.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T17:07:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.611+0000 7f6b6f600640 1 Processor -- start 2024-05-30T17:07:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6f600640 1 -- start start 2024-05-30T17:07:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6f600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b680d14c0 0x7f6b6806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6f600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b680d05b0 0x7f6b6809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6f600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6806ea20 con 0x7f6b6809af80 2024-05-30T17:07:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6f600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6b68070950 con 0x7f6b680d14c0 2024-05-30T17:07:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6f600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6b68070c30 con 0x7f6b680d05b0 2024-05-30T17:07:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6cc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b680d14c0 0x7f6b6806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6d600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6b6809af80 0x7f6b68162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51698/0 (socket says 172.21.15.59:51698) 2024-05-30T17:07:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6d600640 1 -- 172.21.15.59:0/1609344617 learned_addr learned my addr 172.21.15.59:0/1609344617 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b5fe00640 1 --2- 172.21.15.59:0/1609344617 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b680d05b0 0x7f6b6809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6cc00640 1 -- 172.21.15.59:0/1609344617 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b680d05b0 msgr2=0x7f6b6809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6cc00640 1 --2- 172.21.15.59:0/1609344617 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b680d05b0 0x7f6b6809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6cc00640 1 -- 172.21.15.59:0/1609344617 >> v1:172.21.15.59:6789/0 conn(0x7f6b6809af80 legacy=0x7f6b68162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.615+0000 7f6b6cc00640 1 -- 172.21.15.59:0/1609344617 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b68070f10 con 0x7f6b680d14c0 2024-05-30T17:07:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b6cc00640 1 --2- 172.21.15.59:0/1609344617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b680d14c0 0x7f6b6806e4e0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f6b580097c0 tx=0x7f6b5801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6470c4733d215183 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b67e00640 1 -- 172.21.15.59:0/1609344617 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b580b0070 con 0x7f6b680d14c0 2024-05-30T17:07:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b67e00640 1 -- 172.21.15.59:0/1609344617 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b580ab600 con 0x7f6b680d14c0 2024-05-30T17:07:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b67e00640 1 -- 172.21.15.59:0/1609344617 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b580ab9d0 con 0x7f6b680d14c0 2024-05-30T17:07:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b6f600640 1 -- 172.21.15.59:0/1609344617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b680d14c0 msgr2=0x7f6b6806e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b6f600640 1 --2- 172.21.15.59:0/1609344617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b680d14c0 0x7f6b6806e4e0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f6b580097c0 tx=0x7f6b5801c4a0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b6f600640 1 -- 172.21.15.59:0/1609344617 shutdown_connections 2024-05-30T17:07:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b6f600640 1 --2- 172.21.15.59:0/1609344617 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b680d05b0 0x7f6b6809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b6f600640 1 --2- 172.21.15.59:0/1609344617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b680d14c0 0x7f6b6806e4e0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b6f600640 1 -- 172.21.15.59:0/1609344617 >> 172.21.15.59:0/1609344617 conn(0x7f6b680b3f80 msgr2=0x7f6b680b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b6f600640 1 -- 172.21.15.59:0/1609344617 shutdown_connections 2024-05-30T17:07:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b6f600640 1 -- 172.21.15.59:0/1609344617 wait complete. 2024-05-30T17:07:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b6f600640 1 Processor -- start 2024-05-30T17:07:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.619+0000 7f6b6f600640 1 -- start start 2024-05-30T17:07:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b6f600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6809af80 0x7f6b681552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b6f600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b680d05b0 0x7f6b6815f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b6f600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b680d14c0 0x7f6b681586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b6f600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680d0b10 con 0x7f6b680d05b0 2024-05-30T17:07:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b6f600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680d0990 con 0x7f6b6809af80 2024-05-30T17:07:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b6f600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6b6806e100 con 0x7f6b680d14c0 2024-05-30T17:07:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b5fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b680d05b0 0x7f6b6815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b5fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b680d05b0 0x7f6b6815f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46084/0 (socket says 172.21.15.59:46084) 2024-05-30T17:07:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b5fe00640 1 -- 172.21.15.59:0/2781150522 learned_addr learned my addr 172.21.15.59:0/2781150522 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b6cc00640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6809af80 0x7f6b681552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b6d600640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b680d14c0 0x7f6b681586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b5fe00640 1 -- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b680d14c0 msgr2=0x7f6b681586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b5fe00640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b680d14c0 0x7f6b681586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b5fe00640 1 -- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6809af80 msgr2=0x7f6b681552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b5fe00640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6809af80 0x7f6b681552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b5fe00640 1 -- 172.21.15.59:0/2781150522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6815e2c0 con 0x7f6b680d05b0 2024-05-30T17:07:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b6d600640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b680d14c0 0x7f6b681586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:07:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b5fe00640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b680d05b0 0x7f6b6815f750 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000d800 tx=0x7f6b5000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b65600640 1 -- 172.21.15.59:0/2781150522 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5000b6c0 con 0x7f6b680d05b0 2024-05-30T17:07:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b65600640 1 -- 172.21.15.59:0/2781150522 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b50019070 con 0x7f6b680d05b0 2024-05-30T17:07:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b65600640 1 -- 172.21.15.59:0/2781150522 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5000ba60 con 0x7f6b680d05b0 2024-05-30T17:07:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b6f600640 1 -- 172.21.15.59:0/2781150522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6815e5a0 con 0x7f6b680d05b0 2024-05-30T17:07:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b6f600640 1 -- 172.21.15.59:0/2781150522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6815eb60 con 0x7f6b680d05b0 2024-05-30T17:07:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b6f600640 1 -- 172.21.15.59:0/2781150522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b68068a90 con 0x7f6b680d05b0 2024-05-30T17:07:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.623+0000 7f6b65600640 1 -- 172.21.15.59:0/2781150522 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f6b5000bc00 con 0x7f6b680d05b0 2024-05-30T17:07:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.627+0000 7f6b65600640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b4406a150 0x7f6b4406c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.627+0000 7f6b65600640 1 -- 172.21.15.59:0/2781150522 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f6b50085ee0 con 0x7f6b680d05b0 2024-05-30T17:07:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.627+0000 7f6b6cc00640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b4406a150 0x7f6b4406c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.627+0000 7f6b6cc00640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b4406a150 0x7f6b4406c610 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6b580ad000 tx=0x7f6b580a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.631+0000 7f6b65600640 1 -- 172.21.15.59:0/2781150522 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b5008f070 con 0x7f6b680d05b0 2024-05-30T17:07:04.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.795+0000 7f6b6f600640 1 -- 172.21.15.59:0/2781150522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b68161f00 con 0x7f6b680d05b0 2024-05-30T17:07:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.795+0000 7f6b65600640 1 -- 172.21.15.59:0/2781150522 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) ==== 74+0+16885 (secure 0 0 0) 0x7f6b50057f00 con 0x7f6b680d05b0 2024-05-30T17:07:04.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:07:04.798 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":133,"fsid":"97857630-028c-48a2-897f-bf5f996be133","created":"2024-05-30T16:48:40.034672+0000","modified":"2024-05-30T17:04:48.273874+0000","last_up_change":"2024-05-30T16:48:52.039397+0000","last_in_change":"2024-05-30T16:48:42.540914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:48:53.098546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-05-30T17:04:24.731956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-05-30T17:04:26.001487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0944a0f-0119-4302-b5df-86a303bb4f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6817","nonce":1671295766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6819","nonce":1671295766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6823","nonce":1671295766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1671295766},{"type":"v1","addr":"172.21.15.59:6821","nonce":1671295766}]},"public_addr":"172.21.15.59:6817/1671295766","cluster_addr":"172.21.15.59:6819/1671295766","heartbeat_back_addr":"172.21.15.59:6823/1671295766","heartbeat_front_addr":"172.21.15.59:6821/1671295766","state":["exists","up"]},{"osd":1,"uuid":"c3562d37-416b-4433-8f1f-d9767f4c5b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6825","nonce":743808646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6827","nonce":743808646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6831","nonce":743808646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":743808646},{"type":"v1","addr":"172.21.15.59:6829","nonce":743808646}]},"public_addr":"172.21.15.59:6825/743808646","cluster_addr":"172.21.15.59:6827/743808646","heartbeat_back_addr":"172.21.15.59:6831/743808646","heartbeat_front_addr":"172.21.15.59:6829/743808646","state":["exists","up"]},{"osd":2,"uuid":"c4c61001-0148-4453-bc11-9056a3b70ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6809","nonce":3949011694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6811","nonce":3949011694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6815","nonce":3949011694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3949011694},{"type":"v1","addr":"172.21.15.59:6813","nonce":3949011694}]},"public_addr":"172.21.15.59:6809/3949011694","cluster_addr":"172.21.15.59:6811/3949011694","heartbeat_back_addr":"172.21.15.59:6815/3949011694","heartbeat_front_addr":"172.21.15.59:6813/3949011694","state":["exists","up"]},{"osd":3,"uuid":"6f4274e3-f29a-424b-9eff-dc82e384c867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6801","nonce":2728314061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6803","nonce":2728314061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6807","nonce":2728314061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2728314061},{"type":"v1","addr":"172.21.15.59:6805","nonce":2728314061}]},"public_addr":"172.21.15.59:6801/2728314061","cluster_addr":"172.21.15.59:6803/2728314061","heartbeat_back_addr":"172.21.15.59:6807/2728314061","heartbeat_front_addr":"172.21.15.59:6805/2728314061","state":["exists","up"]},{"osd":4,"uuid":"55f90922-47ad-445a-93b1-2478afbc03ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6809","nonce":2449835032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6811","nonce":2449835032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6815","nonce":2449835032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2449835032},{"type":"v1","addr":"172.21.15.107:6813","nonce":2449835032}]},"public_addr":"172.21.15.107:6809/2449835032","cluster_addr":"172.21.15.107:6811/2449835032","heartbeat_back_addr":"172.21.15.107:6815/2449835032","heartbeat_front_addr":"172.21.15.107:6813/2449835032","state":["exists","up"]},{"osd":5,"uuid":"1c557515-2bf0-4537-869c-2fa7818cf9f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6817","nonce":4169986841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6819","nonce":4169986841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6823","nonce":4169986841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4169986841},{"type":"v1","addr":"172.21.15.107:6821","nonce":4169986841}]},"public_addr":"172.21.15.107:6817/4169986841","cluster_addr":"172.21.15.107:6819/4169986841","heartbeat_back_addr":"172.21.15.107:6823/4169986841","heartbeat_front_addr":"172.21.15.107:6821/4169986841","state":["exists","up"]},{"osd":6,"uuid":"16dd51a3-0bc9-4d2a-b4db-b8e44e62e6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6801","nonce":518733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6803","nonce":518733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6807","nonce":518733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":518733335},{"type":"v1","addr":"172.21.15.107:6805","nonce":518733335}]},"public_addr":"172.21.15.107:6801/518733335","cluster_addr":"172.21.15.107:6803/518733335","heartbeat_back_addr":"172.21.15.107:6807/518733335","heartbeat_front_addr":"172.21.15.107:6805/518733335","state":["exists","up"]},{"osd":7,"uuid":"7286638d-077a-494a-b4bf-0dc3ca5326c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6825","nonce":3952746286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6827","nonce":3952746286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6831","nonce":3952746286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3952746286},{"type":"v1","addr":"172.21.15.107:6829","nonce":3952746286}]},"public_addr":"172.21.15.107:6825/3952746286","cluster_addr":"172.21.15.107:6827/3952746286","heartbeat_back_addr":"172.21.15.107:6831/3952746286","heartbeat_front_addr":"172.21.15.107:6829/3952746286","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.299487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.127065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.236841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.100116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.219185+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.252753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.097074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:48:48.248755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.25","mappings":[{"from":2,"to":0}]},{"pgid":"19.3f","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T17:07:04.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.799+0000 7f6b6f600640 1 -- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b4406a150 msgr2=0x7f6b4406c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.799+0000 7f6b6f600640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b4406a150 0x7f6b4406c610 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6b580ad000 tx=0x7f6b580a6000 comp rx=0 tx=0).stop 2024-05-30T17:07:04.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.799+0000 7f6b6f600640 1 -- 172.21.15.59:0/2781150522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b680d05b0 msgr2=0x7f6b6815f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:04.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.799+0000 7f6b6f600640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b680d05b0 0x7f6b6815f750 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000d800 tx=0x7f6b5000dcc0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.799+0000 7f6b6f600640 1 -- 172.21.15.59:0/2781150522 shutdown_connections 2024-05-30T17:07:04.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.799+0000 7f6b6f600640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f6b4406a150 0x7f6b4406c610 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.799+0000 7f6b6f600640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b680d14c0 0x7f6b681586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.799+0000 7f6b6f600640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b680d05b0 0x7f6b6815f750 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.799+0000 7f6b6f600640 1 --2- 172.21.15.59:0/2781150522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6809af80 0x7f6b681552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:04.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.799+0000 7f6b6f600640 1 -- 172.21.15.59:0/2781150522 >> 172.21.15.59:0/2781150522 conn(0x7f6b680b3f80 msgr2=0x7f6b680b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:04.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.799+0000 7f6b6f600640 1 -- 172.21.15.59:0/2781150522 shutdown_connections 2024-05-30T17:07:04.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:04.799+0000 7f6b6f600640 1 -- 172.21.15.59:0/2781150522 wait complete. 2024-05-30T17:07:05.820 INFO:tasks.ceph:Scrubbing osd.0 2024-05-30T17:07:05.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-30T17:07:05.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.975+0000 7fa1ea200640 1 Processor -- start 2024-05-30T17:07:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.975+0000 7fa1ea200640 1 -- start start 2024-05-30T17:07:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.979+0000 7fa1ea200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa1e4161ce0 0x7fa1e409b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.979+0000 7fa1ea200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e40d1020 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.979+0000 7fa1ea200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e40d1300 con 0x7fa1e40d0710 2024-05-30T17:07:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.979+0000 7fa1ea200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e40d15e0 con 0x7fa1e4161ce0 2024-05-30T17:07:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.979+0000 7fa1e3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa1e40d0ba0 0x7fa1e415e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51712/0 (socket says 172.21.15.59:51712) 2024-05-30T17:07:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.979+0000 7fa1e3e00640 1 -- 172.21.15.59:0/3196720159 learned_addr learned my addr 172.21.15.59:0/3196720159 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.979+0000 7fa1e3400640 1 --2- 172.21.15.59:0/3196720159 >> v2:172.21.15.107:3300/0 conn(0x7fa1e4161ce0 0x7fa1e409b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.979+0000 7fa1e2a00640 1 -- 172.21.15.59:0/3196720159 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796085985 0 0) 0x7fa1e40d1020 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.979+0000 7fa1e2a00640 1 -- 172.21.15.59:0/3196720159 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1c8003530 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.979+0000 7fa1e3400640 1 -- 172.21.15.59:0/3196720159 >> v1:172.21.15.107:6789/0 conn(0x7fa1e40d0710 legacy=0x7fa1e4162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.979+0000 7fa1e3400640 1 -- 172.21.15.59:0/3196720159 >> v1:172.21.15.59:6789/0 conn(0x7fa1e40d0ba0 legacy=0x7fa1e415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.979+0000 7fa1e3400640 1 -- 172.21.15.59:0/3196720159 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e40d18c0 con 0x7fa1e4161ce0 2024-05-30T17:07:05.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1e3400640 1 --2- 172.21.15.59:0/3196720159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1e4161ce0 0x7fa1e409b7a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40097c0 tx=0x7fa1d401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51d3a4d87489ca9d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:05.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1e2a00640 1 -- 172.21.15.59:0/3196720159 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d40aa620 con 0x7fa1e4161ce0 2024-05-30T17:07:05.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1e2a00640 1 -- 172.21.15.59:0/3196720159 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d40af070 con 0x7fa1e4161ce0 2024-05-30T17:07:05.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1e2a00640 1 -- 172.21.15.59:0/3196720159 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d40aa9e0 con 0x7fa1e4161ce0 2024-05-30T17:07:05.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 -- 172.21.15.59:0/3196720159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1e4161ce0 msgr2=0x7fa1e409b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:05.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 --2- 172.21.15.59:0/3196720159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1e4161ce0 0x7fa1e409b7a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40097c0 tx=0x7fa1d401c4a0 comp rx=0 tx=0).stop 2024-05-30T17:07:05.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 -- 172.21.15.59:0/3196720159 shutdown_connections 2024-05-30T17:07:05.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 --2- 172.21.15.59:0/3196720159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1e4161ce0 0x7fa1e409b7a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:05.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 -- 172.21.15.59:0/3196720159 >> 172.21.15.59:0/3196720159 conn(0x7fa1e40b4000 msgr2=0x7fa1e40b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:05.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 -- 172.21.15.59:0/3196720159 shutdown_connections 2024-05-30T17:07:05.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 -- 172.21.15.59:0/3196720159 wait complete. 2024-05-30T17:07:05.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 Processor -- start 2024-05-30T17:07:05.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 -- start start 2024-05-30T17:07:05.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1e40d0710 0x7fa1e415f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:05.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1e40d0ba0 0x7fa1e41605b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:05.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1e4161ce0 0x7fa1e4160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:05.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e415f8a0 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e4162d70 con 0x7fa1e40d0710 2024-05-30T17:07:05.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1ea200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e415fa20 con 0x7fa1e4161ce0 2024-05-30T17:07:05.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.983+0000 7fa1daa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1e40d0ba0 0x7fa1e41605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:05.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1daa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1e40d0ba0 0x7fa1e41605b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46098/0 (socket says 172.21.15.59:46098) 2024-05-30T17:07:05.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1daa00640 1 -- 172.21.15.59:0/2492905702 learned_addr learned my addr 172.21.15.59:0/2492905702 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1e3400640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1e40d0710 0x7fa1e415f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1e3e00640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1e4161ce0 0x7fa1e4160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1daa00640 1 -- 172.21.15.59:0/2492905702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1e4161ce0 msgr2=0x7fa1e4160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1daa00640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1e4161ce0 0x7fa1e4160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1daa00640 1 -- 172.21.15.59:0/2492905702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1e40d0710 msgr2=0x7fa1e415f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1daa00640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1e40d0710 0x7fa1e415f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1daa00640 1 -- 172.21.15.59:0/2492905702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e415e610 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1e3400640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1e40d0710 0x7fa1e415f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1daa00640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1e40d0ba0 0x7fa1e41605b0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00c420 tx=0x7fa1cc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1dbe00640 1 -- 172.21.15.59:0/2492905702 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0052d0 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1dbe00640 1 -- 172.21.15.59:0/2492905702 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1cc005470 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1ea200640 1 -- 172.21.15.59:0/2492905702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e415f6b0 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1dbe00640 1 -- 172.21.15.59:0/2492905702 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc007260 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1ea200640 1 -- 172.21.15.59:0/2492905702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e40b56e0 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1ea200640 1 -- 172.21.15.59:0/2492905702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1e415e1f0 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1dbe00640 1 -- 172.21.15.59:0/2492905702 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7fa1cc007400 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.987+0000 7fa1dbe00640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa1c006a150 0x7fa1c006c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:05.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.991+0000 7fa1dbe00640 1 -- 172.21.15.59:0/2492905702 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fa1cc085a60 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.991+0000 7fa1dbe00640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] conn(0x7fa1c0072550 0x7fa1c00749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:05.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.991+0000 7fa1dbe00640 1 -- 172.21.15.59:0/2492905702 --> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1c00750c0 con 0x7fa1c0072550 2024-05-30T17:07:05.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.991+0000 7fa1dbe00640 1 -- 172.21.15.59:0/2492905702 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7fa1cc086df0 con 0x7fa1e40d0ba0 2024-05-30T17:07:05.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.991+0000 7fa1e3400640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa1c006a150 0x7fa1c006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:05.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.991+0000 7fa1e3e00640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] conn(0x7fa1c0072550 0x7fa1c00749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.991+0000 7fa1e3e00640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] conn(0x7fa1c0072550 0x7fa1c00749f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.991+0000 7fa1e3400640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa1c006a150 0x7fa1c006c610 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40ae000 tx=0x7fa1d40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:05.991+0000 7fa1dbe00640 1 -- 172.21.15.59:0/2492905702 <== osd.0 v2:172.21.15.59:6816/1671295766 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa1c00750c0 con 0x7fa1c0072550 2024-05-30T17:07:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.003+0000 7fa1ea200640 1 -- 172.21.15.59:0/2492905702 --> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa1e4068a90 con 0x7fa1c0072550 2024-05-30T17:07:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.003+0000 7fa1dbe00640 1 -- 172.21.15.59:0/2492905702 <== osd.0 v2:172.21.15.59:6816/1671295766 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa1e4068a90 con 0x7fa1c0072550 2024-05-30T17:07:06.007 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:07:06.007 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T17:07:06.007 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:07:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.003+0000 7fa1ea200640 1 -- 172.21.15.59:0/2492905702 >> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] conn(0x7fa1c0072550 msgr2=0x7fa1c00749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.003+0000 7fa1ea200640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.59:6816/1671295766,v1:172.21.15.59:6817/1671295766] conn(0x7fa1c0072550 0x7fa1c00749f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.003+0000 7fa1ea200640 1 -- 172.21.15.59:0/2492905702 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa1c006a150 msgr2=0x7fa1c006c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.003+0000 7fa1ea200640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fa1c006a150 0x7fa1c006c610 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40ae000 tx=0x7fa1d40a7000 comp rx=0 tx=0).stop 2024-05-30T17:07:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.003+0000 7fa1ea200640 1 -- 172.21.15.59:0/2492905702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1e40d0ba0 msgr2=0x7fa1e41605b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.007+0000 7fa1ea200640 1 --2- 172.21.15.59:0/2492905702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1e40d0ba0 0x7fa1e41605b0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00c420 tx=0x7fa1cc00c8e0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.007+0000 7fa1e3e00640 1 -- 172.21.15.59:0/2492905702 reap_dead start 2024-05-30T17:07:06.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.007+0000 7fa1ea200640 1 -- 172.21.15.59:0/2492905702 shutdown_connections 2024-05-30T17:07:06.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.007+0000 7fa1ea200640 1 -- 172.21.15.59:0/2492905702 >> 172.21.15.59:0/2492905702 conn(0x7fa1e40b4000 msgr2=0x7fa1e40ce430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:06.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.007+0000 7fa1ea200640 1 -- 172.21.15.59:0/2492905702 shutdown_connections 2024-05-30T17:07:06.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.007+0000 7fa1ea200640 1 -- 172.21.15.59:0/2492905702 wait complete. 2024-05-30T17:07:06.025 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-30T17:07:06.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e28800640 1 Processor -- start 2024-05-30T17:07:06.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e28800640 1 -- start start 2024-05-30T17:07:06.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e28800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e2006e900 0x7f3e2015f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e28800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e200d0560 0x7f3e200d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e28800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2015f060 con 0x7f3e200af720 2024-05-30T17:07:06.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e28800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3e200afb00 con 0x7f3e2006e900 2024-05-30T17:07:06.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e28800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3e2015c270 con 0x7f3e200d0560 2024-05-30T17:07:06.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e25e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3e200af720 0x7f3e2015b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51716/0 (socket says 172.21.15.59:51716) 2024-05-30T17:07:06.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e25e00640 1 -- 172.21.15.59:0/455762625 learned_addr learned my addr 172.21.15.59:0/455762625 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:06.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e25400640 1 --2- 172.21.15.59:0/455762625 >> v2:172.21.15.59:3300/0 conn(0x7f3e2006e900 0x7f3e2015f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e26800640 1 --2- 172.21.15.59:0/455762625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e200d0560 0x7f3e200d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e24a00640 1 -- 172.21.15.59:0/455762625 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44520708 0 0) 0x7f3e2015f060 con 0x7f3e200af720 2024-05-30T17:07:06.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e24a00640 1 -- 172.21.15.59:0/455762625 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e08005740 con 0x7f3e200af720 2024-05-30T17:07:06.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e25400640 1 -- 172.21.15.59:0/455762625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e200d0560 msgr2=0x7f3e200d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:06.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e25400640 1 --2- 172.21.15.59:0/455762625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e200d0560 0x7f3e200d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e25400640 1 -- 172.21.15.59:0/455762625 >> v1:172.21.15.59:6789/0 conn(0x7f3e200af720 legacy=0x7f3e2015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e25400640 1 -- 172.21.15.59:0/455762625 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2015c550 con 0x7f3e2006e900 2024-05-30T17:07:06.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.167+0000 7f3e26800640 1 --2- 172.21.15.59:0/455762625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e200d0560 0x7f3e200d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:06.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.171+0000 7f3e25400640 1 --2- 172.21.15.59:0/455762625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e2006e900 0x7f3e2015f7f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f3e100097c0 tx=0x7f3e1001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972881606bec2dfd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:06.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.171+0000 7f3e24a00640 1 -- 172.21.15.59:0/455762625 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e100b0070 con 0x7f3e2006e900 2024-05-30T17:07:06.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.171+0000 7f3e24a00640 1 -- 172.21.15.59:0/455762625 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e100ab600 con 0x7f3e2006e900 2024-05-30T17:07:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.171+0000 7f3e24a00640 1 -- 172.21.15.59:0/455762625 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e100ab9b0 con 0x7f3e2006e900 2024-05-30T17:07:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.171+0000 7f3e28800640 1 -- 172.21.15.59:0/455762625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e2006e900 msgr2=0x7f3e2015f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.171+0000 7f3e28800640 1 --2- 172.21.15.59:0/455762625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e2006e900 0x7f3e2015f7f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f3e100097c0 tx=0x7f3e1001c4a0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.171+0000 7f3e28800640 1 -- 172.21.15.59:0/455762625 shutdown_connections 2024-05-30T17:07:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.171+0000 7f3e28800640 1 --2- 172.21.15.59:0/455762625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e200d0560 0x7f3e200d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.171+0000 7f3e28800640 1 --2- 172.21.15.59:0/455762625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e2006e900 0x7f3e2015f7f0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.171+0000 7f3e28800640 1 -- 172.21.15.59:0/455762625 >> 172.21.15.59:0/455762625 conn(0x7f3e200b22d0 msgr2=0x7f3e200b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:06.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.171+0000 7f3e28800640 1 -- 172.21.15.59:0/455762625 shutdown_connections 2024-05-30T17:07:06.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.171+0000 7f3e28800640 1 -- 172.21.15.59:0/455762625 wait complete. 2024-05-30T17:07:06.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e28800640 1 Processor -- start 2024-05-30T17:07:06.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e28800640 1 -- start start 2024-05-30T17:07:06.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e28800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e2006e900 0x7f3e200b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e28800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e200af720 0x7f3e2015de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e28800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e200d0560 0x7f3e2015e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e28800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e200732d0 con 0x7f3e200af720 2024-05-30T17:07:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e28800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3e20073150 con 0x7f3e200d0560 2024-05-30T17:07:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e28800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3e201585c0 con 0x7f3e2006e900 2024-05-30T17:07:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e25400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e200af720 0x7f3e2015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e25400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e200af720 0x7f3e2015de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46112/0 (socket says 172.21.15.59:46112) 2024-05-30T17:07:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e25400640 1 -- 172.21.15.59:0/1136243476 learned_addr learned my addr 172.21.15.59:0/1136243476 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e26800640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e200d0560 0x7f3e2015e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e25e00640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e2006e900 0x7f3e200b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e25400640 1 -- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e2006e900 msgr2=0x7f3e200b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e25400640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e2006e900 0x7f3e200b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e25400640 1 -- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e200d0560 msgr2=0x7f3e2015e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e25400640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e200d0560 0x7f3e2015e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e25400640 1 -- 172.21.15.59:0/1136243476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e201655b0 con 0x7f3e200af720 2024-05-30T17:07:06.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e26800640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e200d0560 0x7f3e2015e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:06.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e25400640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e200af720 0x7f3e2015de50 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f3e100097c0 tx=0x7f3e10019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:06.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e1a000640 1 -- 172.21.15.59:0/1136243476 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e100ba070 con 0x7f3e200af720 2024-05-30T17:07:06.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e1a000640 1 -- 172.21.15.59:0/1136243476 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e100b43f0 con 0x7f3e200af720 2024-05-30T17:07:06.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e1a000640 1 -- 172.21.15.59:0/1136243476 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e100b0040 con 0x7f3e200af720 2024-05-30T17:07:06.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e28800640 1 -- 172.21.15.59:0/1136243476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e20165890 con 0x7f3e200af720 2024-05-30T17:07:06.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e28800640 1 -- 172.21.15.59:0/1136243476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e20165e50 con 0x7f3e200af720 2024-05-30T17:07:06.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.175+0000 7f3e28800640 1 -- 172.21.15.59:0/1136243476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e200cf8a0 con 0x7f3e200af720 2024-05-30T17:07:06.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.179+0000 7f3e1a000640 1 -- 172.21.15.59:0/1136243476 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f3e100b47a0 con 0x7f3e200af720 2024-05-30T17:07:06.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.179+0000 7f3e1a000640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3e0406a150 0x7f3e0406c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.179+0000 7f3e1a000640 1 -- 172.21.15.59:0/1136243476 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f3e1011ea70 con 0x7f3e200af720 2024-05-30T17:07:06.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.179+0000 7f3e25e00640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3e0406a150 0x7f3e0406c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.179+0000 7f3e25e00640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3e0406a150 0x7f3e0406c610 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3e14005890 tx=0x7f3e14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.183+0000 7f3e1a000640 1 -- 172.21.15.59:0/1136243476 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3e200cf8a0 con 0x7f3e200af720 2024-05-30T17:07:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.347+0000 7f3e28800640 1 -- 172.21.15.59:0/1136243476 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f3e20068a90 con 0x7f3e0406a150 2024-05-30T17:07:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.347+0000 7f3e1a000640 1 -- 172.21.15.59:0/1136243476 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3e20068a90 con 0x7f3e0406a150 2024-05-30T17:07:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 0 to deep-scrub 2024-05-30T17:07:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.351+0000 7f3e28800640 1 -- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3e0406a150 msgr2=0x7f3e0406c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.351+0000 7f3e28800640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3e0406a150 0x7f3e0406c610 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3e14005890 tx=0x7f3e14009040 comp rx=0 tx=0).stop 2024-05-30T17:07:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.351+0000 7f3e28800640 1 -- 172.21.15.59:0/1136243476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e200af720 msgr2=0x7f3e2015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.351+0000 7f3e28800640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e200af720 0x7f3e2015de50 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f3e100097c0 tx=0x7f3e10019240 comp rx=0 tx=0).stop 2024-05-30T17:07:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.351+0000 7f3e28800640 1 -- 172.21.15.59:0/1136243476 shutdown_connections 2024-05-30T17:07:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.351+0000 7f3e28800640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3e0406a150 0x7f3e0406c610 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.351+0000 7f3e28800640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e200d0560 0x7f3e2015e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.351+0000 7f3e28800640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e200af720 0x7f3e2015de50 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.351+0000 7f3e28800640 1 --2- 172.21.15.59:0/1136243476 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3e2006e900 0x7f3e200b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.351+0000 7f3e28800640 1 -- 172.21.15.59:0/1136243476 >> 172.21.15.59:0/1136243476 conn(0x7f3e200b22d0 msgr2=0x7f3e2015d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.351+0000 7f3e28800640 1 -- 172.21.15.59:0/1136243476 shutdown_connections 2024-05-30T17:07:06.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.351+0000 7f3e28800640 1 -- 172.21.15.59:0/1136243476 wait complete. 2024-05-30T17:07:06.372 INFO:tasks.ceph:Scrubbing osd.1 2024-05-30T17:07:06.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-30T17:07:06.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.515+0000 7f8864a00640 1 Processor -- start 2024-05-30T17:07:06.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.515+0000 7f8864a00640 1 -- start start 2024-05-30T17:07:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.515+0000 7f8864a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f886006dc60 0x7f886006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.515+0000 7f8864a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88600af130 0x7f88600af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.515+0000 7f8864a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f886006e120 con 0x7f8860156e40 2024-05-30T17:07:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.515+0000 7f8864a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f886006e400 con 0x7f88600af130 2024-05-30T17:07:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.515+0000 7f8864a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f886006e6e0 con 0x7f886006dc60 2024-05-30T17:07:06.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.515+0000 7f885e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88600af130 0x7f88600af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.515+0000 7f885e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88600af130 0x7f88600af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46126/0 (socket says 172.21.15.59:46126) 2024-05-30T17:07:06.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.515+0000 7f885e800640 1 -- 172.21.15.59:0/2154397851 learned_addr learned my addr 172.21.15.59:0/2154397851 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:06.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.519+0000 7f8857e00640 1 --2- 172.21.15.59:0/2154397851 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f886006dc60 0x7f886006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.519+0000 7f885e800640 1 -- 172.21.15.59:0/2154397851 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f886006dc60 msgr2=0x7f886006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:06.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.519+0000 7f885e800640 1 --2- 172.21.15.59:0/2154397851 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f886006dc60 0x7f886006f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.519+0000 7f885e800640 1 -- 172.21.15.59:0/2154397851 >> v1:172.21.15.107:6789/0 conn(0x7f8860156e40 legacy=0x7f886015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:06.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.519+0000 7f885e800640 1 -- 172.21.15.59:0/2154397851 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f886006e9c0 con 0x7f88600af130 2024-05-30T17:07:06.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.519+0000 7f885e800640 1 --2- 172.21.15.59:0/2154397851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600af130 0x7f88600af580 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f8858009e50 tx=0x7f885801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a33eda9e5a17024 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:06.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.519+0000 7f885d400640 1 -- 172.21.15.59:0/2154397851 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88580a5780 con 0x7f88600af130 2024-05-30T17:07:06.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.519+0000 7f885d400640 1 -- 172.21.15.59:0/2154397851 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88580a5920 con 0x7f88600af130 2024-05-30T17:07:06.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.519+0000 7f885d400640 1 -- 172.21.15.59:0/2154397851 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88580a5cf0 con 0x7f88600af130 2024-05-30T17:07:06.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 -- 172.21.15.59:0/2154397851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600af130 msgr2=0x7f88600af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 --2- 172.21.15.59:0/2154397851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600af130 0x7f88600af580 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f8858009e50 tx=0x7f885801ca30 comp rx=0 tx=0).stop 2024-05-30T17:07:06.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 -- 172.21.15.59:0/2154397851 shutdown_connections 2024-05-30T17:07:06.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 --2- 172.21.15.59:0/2154397851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600af130 0x7f88600af580 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 --2- 172.21.15.59:0/2154397851 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f886006dc60 0x7f886006f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 -- 172.21.15.59:0/2154397851 >> 172.21.15.59:0/2154397851 conn(0x7f88600b1e60 msgr2=0x7f88600b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:06.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 -- 172.21.15.59:0/2154397851 shutdown_connections 2024-05-30T17:07:06.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 -- 172.21.15.59:0/2154397851 wait complete. 2024-05-30T17:07:06.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 Processor -- start 2024-05-30T17:07:06.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 -- start start 2024-05-30T17:07:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f886006dc60 0x7f8860099530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600af130 0x7f88601601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8860156e40 0x7f88601606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f886015eb70 con 0x7f88600af130 2024-05-30T17:07:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f886015e9f0 con 0x7f886006dc60 2024-05-30T17:07:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8864a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8860169550 con 0x7f8860156e40 2024-05-30T17:07:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8857e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600af130 0x7f88601601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8857e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600af130 0x7f88601601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46140/0 (socket says 172.21.15.59:46140) 2024-05-30T17:07:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8857e00640 1 -- 172.21.15.59:0/1782264431 learned_addr learned my addr 172.21.15.59:0/1782264431 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f885de00640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f886006dc60 0x7f8860099530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f885e800640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8860156e40 0x7f88601606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8857e00640 1 -- 172.21.15.59:0/1782264431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8860156e40 msgr2=0x7f88601606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8857e00640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8860156e40 0x7f88601606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8857e00640 1 -- 172.21.15.59:0/1782264431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f886006dc60 msgr2=0x7f8860099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8857e00640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f886006dc60 0x7f8860099530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8857e00640 1 -- 172.21.15.59:0/1782264431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88600b08b0 con 0x7f88600af130 2024-05-30T17:07:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f885e800640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8860156e40 0x7f88601606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.523+0000 7f8857e00640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600af130 0x7f88601601a0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f884800d620 tx=0x7f884800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f8856000640 1 -- 172.21.15.59:0/1782264431 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884800b620 con 0x7f88600af130 2024-05-30T17:07:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f8856000640 1 -- 172.21.15.59:0/1782264431 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8848019070 con 0x7f88600af130 2024-05-30T17:07:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f8856000640 1 -- 172.21.15.59:0/1782264431 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884800b9e0 con 0x7f88600af130 2024-05-30T17:07:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f8864a00640 1 -- 172.21.15.59:0/1782264431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8860160fb0 con 0x7f88600af130 2024-05-30T17:07:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f8864a00640 1 -- 172.21.15.59:0/1782264431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8860147500 con 0x7f88600af130 2024-05-30T17:07:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f8864a00640 1 -- 172.21.15.59:0/1782264431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8860156630 con 0x7f88600af130 2024-05-30T17:07:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f8856000640 1 -- 172.21.15.59:0/1782264431 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f884800bb80 con 0x7f88600af130 2024-05-30T17:07:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f8856000640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f883c06a150 0x7f883c06c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f8856000640 1 -- 172.21.15.59:0/1782264431 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f8848086760 con 0x7f88600af130 2024-05-30T17:07:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f8856000640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] conn(0x7f883c0725b0 0x7f883c074a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f8856000640 1 -- 172.21.15.59:0/1782264431 --> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8848001d40 con 0x7f883c0725b0 2024-05-30T17:07:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f8856000640 1 -- 172.21.15.59:0/1782264431 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f8848087bb0 con 0x7f88600af130 2024-05-30T17:07:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f885de00640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f883c06a150 0x7f883c06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.527+0000 7f885e800640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] conn(0x7f883c0725b0 0x7f883c074a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.531+0000 7f885de00640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f883c06a150 0x7f883c06c610 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8860150de0 tx=0x7f8850009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.531+0000 7f885e800640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] conn(0x7f883c0725b0 0x7f883c074a50 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:06.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.531+0000 7f8856000640 1 -- 172.21.15.59:0/1782264431 <== osd.1 v2:172.21.15.59:6824/743808646 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8848001d40 con 0x7f883c0725b0 2024-05-30T17:07:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f8864a00640 1 -- 172.21.15.59:0/1782264431 --> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8860068a90 con 0x7f883c0725b0 2024-05-30T17:07:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f8856000640 1 -- 172.21.15.59:0/1782264431 <== osd.1 v2:172.21.15.59:6824/743808646 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8860068a90 con 0x7f883c0725b0 2024-05-30T17:07:06.546 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:07:06.546 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T17:07:06.546 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:07:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f8864a00640 1 -- 172.21.15.59:0/1782264431 >> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] conn(0x7f883c0725b0 msgr2=0x7f883c074a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f8864a00640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.59:6824/743808646,v1:172.21.15.59:6825/743808646] conn(0x7f883c0725b0 0x7f883c074a50 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f8864a00640 1 -- 172.21.15.59:0/1782264431 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f883c06a150 msgr2=0x7f883c06c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f8864a00640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f883c06a150 0x7f883c06c610 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8860150de0 tx=0x7f8850009040 comp rx=0 tx=0).stop 2024-05-30T17:07:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f8864a00640 1 -- 172.21.15.59:0/1782264431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600af130 msgr2=0x7f88601601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f8864a00640 1 --2- 172.21.15.59:0/1782264431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600af130 0x7f88601601a0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f884800d620 tx=0x7f884800dae0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f885e800640 1 -- 172.21.15.59:0/1782264431 reap_dead start 2024-05-30T17:07:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f8864a00640 1 -- 172.21.15.59:0/1782264431 shutdown_connections 2024-05-30T17:07:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f8864a00640 1 -- 172.21.15.59:0/1782264431 >> 172.21.15.59:0/1782264431 conn(0x7f88600b1e60 msgr2=0x7f8860166740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f8864a00640 1 -- 172.21.15.59:0/1782264431 shutdown_connections 2024-05-30T17:07:06.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.543+0000 7f8864a00640 1 -- 172.21.15.59:0/1782264431 wait complete. 2024-05-30T17:07:06.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-30T17:07:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.707+0000 7f1a68600640 1 Processor -- start 2024-05-30T17:07:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.707+0000 7f1a68600640 1 -- start start 2024-05-30T17:07:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.707+0000 7f1a68600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1a60159df0 0x7f1a600ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.707+0000 7f1a68600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a600b3e50 0x7f1a600ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.707+0000 7f1a68600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a6015d730 con 0x7f1a6015a1d0 2024-05-30T17:07:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.707+0000 7f1a68600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1a600b3370 con 0x7f1a600b3e50 2024-05-30T17:07:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.707+0000 7f1a68600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1a600b3650 con 0x7f1a60159df0 2024-05-30T17:07:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a66600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a600b3e50 0x7f1a600ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a65200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1a6015a1d0 0x7f1a6015ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51720/0 (socket says 172.21.15.59:51720) 2024-05-30T17:07:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a65200640 1 -- 172.21.15.59:0/3348978109 learned_addr learned my addr 172.21.15.59:0/3348978109 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a65c00640 1 --2- 172.21.15.59:0/3348978109 >> v2:172.21.15.107:3300/0 conn(0x7f1a60159df0 0x7f1a600ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a66600640 1 -- 172.21.15.59:0/3348978109 >> v2:172.21.15.107:3300/0 conn(0x7f1a60159df0 msgr2=0x7f1a600ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a66600640 1 --2- 172.21.15.59:0/3348978109 >> v2:172.21.15.107:3300/0 conn(0x7f1a60159df0 0x7f1a600ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a66600640 1 -- 172.21.15.59:0/3348978109 >> v1:172.21.15.59:6789/0 conn(0x7f1a6015a1d0 legacy=0x7f1a6015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a66600640 1 -- 172.21.15.59:0/3348978109 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a600b3930 con 0x7f1a600b3e50 2024-05-30T17:07:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a5fe00640 1 -- 172.21.15.59:0/3348978109 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353890537 0 0) 0x7f1a6015d730 con 0x7f1a6015a1d0 2024-05-30T17:07:06.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a66600640 1 --2- 172.21.15.59:0/3348978109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b3e50 0x7f1a600ad6f0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f1a600b4c20 tx=0x7f1a5801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbf505a6b6df4f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:06.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a5fe00640 1 -- 172.21.15.59:0/3348978109 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a580b2070 con 0x7f1a600b3e50 2024-05-30T17:07:06.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a5fe00640 1 -- 172.21.15.59:0/3348978109 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a580a5800 con 0x7f1a600b3e50 2024-05-30T17:07:06.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.711+0000 7f1a5fe00640 1 -- 172.21.15.59:0/3348978109 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a580a5bd0 con 0x7f1a600b3e50 2024-05-30T17:07:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 -- 172.21.15.59:0/3348978109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b3e50 msgr2=0x7f1a600ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 --2- 172.21.15.59:0/3348978109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b3e50 0x7f1a600ad6f0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f1a600b4c20 tx=0x7f1a5801c930 comp rx=0 tx=0).stop 2024-05-30T17:07:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 -- 172.21.15.59:0/3348978109 shutdown_connections 2024-05-30T17:07:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 --2- 172.21.15.59:0/3348978109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b3e50 0x7f1a600ad6f0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 --2- 172.21.15.59:0/3348978109 >> v2:172.21.15.107:3300/0 conn(0x7f1a60159df0 0x7f1a600ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 -- 172.21.15.59:0/3348978109 >> 172.21.15.59:0/3348978109 conn(0x7f1a600b22d0 msgr2=0x7f1a600b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 -- 172.21.15.59:0/3348978109 shutdown_connections 2024-05-30T17:07:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 -- 172.21.15.59:0/3348978109 wait complete. 2024-05-30T17:07:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 Processor -- start 2024-05-30T17:07:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 -- start start 2024-05-30T17:07:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a600b3e50 0x7f1a6014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a60159df0 0x7f1a60160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a6015a1d0 0x7f1a60073790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6015e720 con 0x7f1a6015a1d0 2024-05-30T17:07:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6015e5a0 con 0x7f1a600b3e50 2024-05-30T17:07:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a68600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6015e8a0 con 0x7f1a60159df0 2024-05-30T17:07:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a66600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a6015a1d0 0x7f1a60073790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a66600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a6015a1d0 0x7f1a60073790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46158/0 (socket says 172.21.15.59:46158) 2024-05-30T17:07:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a66600640 1 -- 172.21.15.59:0/1591238739 learned_addr learned my addr 172.21.15.59:0/1591238739 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a65c00640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a600b3e50 0x7f1a6014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a65200640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a60159df0 0x7f1a60160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a66600640 1 -- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a60159df0 msgr2=0x7f1a60160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a66600640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a60159df0 0x7f1a60160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a66600640 1 -- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a600b3e50 msgr2=0x7f1a6014dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a66600640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a600b3e50 0x7f1a6014dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.715+0000 7f1a66600640 1 -- 172.21.15.59:0/1591238739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6015f660 con 0x7f1a6015a1d0 2024-05-30T17:07:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.719+0000 7f1a66600640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a6015a1d0 0x7f1a60073790 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f1a5801a560 tx=0x7f1a580196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.719+0000 7f1a5d600640 1 -- 172.21.15.59:0/1591238739 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a580b2050 con 0x7f1a6015a1d0 2024-05-30T17:07:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.719+0000 7f1a5d600640 1 -- 172.21.15.59:0/1591238739 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a580be070 con 0x7f1a6015a1d0 2024-05-30T17:07:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.719+0000 7f1a5d600640 1 -- 172.21.15.59:0/1591238739 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58009450 con 0x7f1a6015a1d0 2024-05-30T17:07:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.719+0000 7f1a68600640 1 -- 172.21.15.59:0/1591238739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6015f940 con 0x7f1a6015a1d0 2024-05-30T17:07:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.719+0000 7f1a68600640 1 -- 172.21.15.59:0/1591238739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6015ff00 con 0x7f1a6015a1d0 2024-05-30T17:07:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.719+0000 7f1a68600640 1 -- 172.21.15.59:0/1591238739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a60068a90 con 0x7f1a6015a1d0 2024-05-30T17:07:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.719+0000 7f1a5d600640 1 -- 172.21.15.59:0/1591238739 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f1a580c3460 con 0x7f1a6015a1d0 2024-05-30T17:07:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.719+0000 7f1a5d600640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a4006a150 0x7f1a4006c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.719+0000 7f1a5d600640 1 -- 172.21.15.59:0/1591238739 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f1a58120b60 con 0x7f1a6015a1d0 2024-05-30T17:07:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.719+0000 7f1a65c00640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a4006a150 0x7f1a4006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.723+0000 7f1a65c00640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a4006a150 0x7f1a4006c610 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1a601671e0 tx=0x7f1a54009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:06.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.723+0000 7f1a5d600640 1 -- 172.21.15.59:0/1591238739 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1a58016520 con 0x7f1a6015a1d0 2024-05-30T17:07:06.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:07:06.866 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:07:06.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.891+0000 7f1a68600640 1 -- 172.21.15.59:0/1591238739 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f1a600b4ef0 con 0x7f1a4006a150 2024-05-30T17:07:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.891+0000 7f1a5d600640 1 -- 172.21.15.59:0/1591238739 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1a600b4ef0 con 0x7f1a4006a150 2024-05-30T17:07:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 1 to deep-scrub 2024-05-30T17:07:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.895+0000 7f1a68600640 1 -- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a4006a150 msgr2=0x7f1a4006c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.895+0000 7f1a68600640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a4006a150 0x7f1a4006c610 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1a601671e0 tx=0x7f1a54009190 comp rx=0 tx=0).stop 2024-05-30T17:07:06.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.895+0000 7f1a68600640 1 -- 172.21.15.59:0/1591238739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a6015a1d0 msgr2=0x7f1a60073790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:06.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.895+0000 7f1a68600640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a6015a1d0 0x7f1a60073790 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f1a5801a560 tx=0x7f1a580196d0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.895+0000 7f1a68600640 1 -- 172.21.15.59:0/1591238739 shutdown_connections 2024-05-30T17:07:06.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.895+0000 7f1a68600640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1a4006a150 0x7f1a4006c610 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.895+0000 7f1a68600640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a6015a1d0 0x7f1a60073790 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.895+0000 7f1a68600640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a60159df0 0x7f1a60160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.895+0000 7f1a68600640 1 --2- 172.21.15.59:0/1591238739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a600b3e50 0x7f1a6014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:06.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.895+0000 7f1a68600640 1 -- 172.21.15.59:0/1591238739 >> 172.21.15.59:0/1591238739 conn(0x7f1a600b22d0 msgr2=0x7f1a60159110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:06.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.895+0000 7f1a68600640 1 -- 172.21.15.59:0/1591238739 shutdown_connections 2024-05-30T17:07:06.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:06.895+0000 7f1a68600640 1 -- 172.21.15.59:0/1591238739 wait complete. 2024-05-30T17:07:06.915 INFO:tasks.ceph:Scrubbing osd.2 2024-05-30T17:07:06.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-30T17:07:07.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.103+0000 7ff877800640 1 Processor -- start 2024-05-30T17:07:07.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.103+0000 7ff877800640 1 -- start start 2024-05-30T17:07:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff877800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff87015b790 0x7ff8700adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff877800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8700723c0 0x7ff8700af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff877800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff870072870 con 0x7ff87015b3b0 2024-05-30T17:07:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff877800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff8700afaf0 con 0x7ff87015b790 2024-05-30T17:07:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff877800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff8700ae510 con 0x7ff8700723c0 2024-05-30T17:07:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff86fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff87015b790 0x7ff8700adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff86fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff87015b790 0x7ff8700adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:38446/0 (socket says 172.21.15.59:38446) 2024-05-30T17:07:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff86fe00640 1 -- 172.21.15.59:0/3782617516 learned_addr learned my addr 172.21.15.59:0/3782617516 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff875800640 1 --2- 172.21.15.59:0/3782617516 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8700723c0 0x7ff8700af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff86fe00640 1 -- 172.21.15.59:0/3782617516 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8700723c0 msgr2=0x7ff8700af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:07.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff86fe00640 1 --2- 172.21.15.59:0/3782617516 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8700723c0 0x7ff8700af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff86fe00640 1 -- 172.21.15.59:0/3782617516 >> v1:172.21.15.107:6789/0 conn(0x7ff87015b3b0 legacy=0x7ff870071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.107+0000 7ff86fe00640 1 -- 172.21.15.59:0/3782617516 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8700ae7f0 con 0x7ff87015b790 2024-05-30T17:07:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff86fe00640 1 --2- 172.21.15.59:0/3782617516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff87015b790 0x7ff8700adf30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0098a0 tx=0x7ff85c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=675ff43b7bb8bdfb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff86f400640 1 -- 172.21.15.59:0/3782617516 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0aa670 con 0x7ff87015b790 2024-05-30T17:07:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff86f400640 1 -- 172.21.15.59:0/3782617516 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff85c0af070 con 0x7ff87015b790 2024-05-30T17:07:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff86f400640 1 -- 172.21.15.59:0/3782617516 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0aaa30 con 0x7ff87015b790 2024-05-30T17:07:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff877800640 1 -- 172.21.15.59:0/3782617516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff87015b790 msgr2=0x7ff8700adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff877800640 1 --2- 172.21.15.59:0/3782617516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff87015b790 0x7ff8700adf30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0098a0 tx=0x7ff85c01c510 comp rx=0 tx=0).stop 2024-05-30T17:07:07.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff877800640 1 -- 172.21.15.59:0/3782617516 shutdown_connections 2024-05-30T17:07:07.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff877800640 1 --2- 172.21.15.59:0/3782617516 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8700723c0 0x7ff8700af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff877800640 1 --2- 172.21.15.59:0/3782617516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff87015b790 0x7ff8700adf30 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff877800640 1 -- 172.21.15.59:0/3782617516 >> 172.21.15.59:0/3782617516 conn(0x7ff8700b1e60 msgr2=0x7ff8700b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:07.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff877800640 1 -- 172.21.15.59:0/3782617516 shutdown_connections 2024-05-30T17:07:07.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff877800640 1 -- 172.21.15.59:0/3782617516 wait complete. 2024-05-30T17:07:07.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff877800640 1 Processor -- start 2024-05-30T17:07:07.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.111+0000 7ff877800640 1 -- start start 2024-05-30T17:07:07.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff877800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8700723c0 0x7ff870099300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff877800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff87015b3b0 0x7ff8700b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff877800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87015b790 0x7ff8701faee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff877800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff8700cc7d0 con 0x7ff87015b790 2024-05-30T17:07:07.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff877800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff8700cc650 con 0x7ff87015b3b0 2024-05-30T17:07:07.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff877800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff8700b3970 con 0x7ff8700723c0 2024-05-30T17:07:07.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff875800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87015b790 0x7ff8701faee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff875800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87015b790 0x7ff8701faee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46168/0 (socket says 172.21.15.59:46168) 2024-05-30T17:07:07.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff874e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8700723c0 0x7ff870099300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff875800640 1 -- 172.21.15.59:0/699568994 learned_addr learned my addr 172.21.15.59:0/699568994 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:07.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff86fe00640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff87015b3b0 0x7ff8700b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff875800640 1 -- 172.21.15.59:0/699568994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8700723c0 msgr2=0x7ff870099300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff875800640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8700723c0 0x7ff870099300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff875800640 1 -- 172.21.15.59:0/699568994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff87015b3b0 msgr2=0x7ff8700b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff875800640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff87015b3b0 0x7ff8700b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff875800640 1 -- 172.21.15.59:0/699568994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8700b16f0 con 0x7ff87015b790 2024-05-30T17:07:07.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff875800640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87015b790 0x7ff8701faee0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7ff86800efc0 tx=0x7ff86800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff86cc00640 1 -- 172.21.15.59:0/699568994 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff868018020 con 0x7ff87015b790 2024-05-30T17:07:07.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff86cc00640 1 -- 172.21.15.59:0/699568994 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff868014480 con 0x7ff87015b790 2024-05-30T17:07:07.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff86cc00640 1 -- 172.21.15.59:0/699568994 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff868014870 con 0x7ff87015b790 2024-05-30T17:07:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff877800640 1 -- 172.21.15.59:0/699568994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8700b19d0 con 0x7ff87015b790 2024-05-30T17:07:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff877800640 1 -- 172.21.15.59:0/699568994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87014c980 con 0x7ff87015b790 2024-05-30T17:07:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.115+0000 7ff877800640 1 -- 172.21.15.59:0/699568994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff870068a90 con 0x7ff87015b790 2024-05-30T17:07:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.119+0000 7ff86cc00640 1 -- 172.21.15.59:0/699568994 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7ff86801b020 con 0x7ff87015b790 2024-05-30T17:07:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.119+0000 7ff86cc00640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff85006a180 0x7ff85006c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.119+0000 7ff86cc00640 1 -- 172.21.15.59:0/699568994 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7ff868086a70 con 0x7ff87015b790 2024-05-30T17:07:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.119+0000 7ff86cc00640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] conn(0x7ff8500725e0 0x7ff850074a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.119+0000 7ff86cc00640 1 -- 172.21.15.59:0/699568994 --> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff850075150 con 0x7ff8500725e0 2024-05-30T17:07:07.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.119+0000 7ff86cc00640 1 -- 172.21.15.59:0/699568994 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7ff868087a70 con 0x7ff87015b790 2024-05-30T17:07:07.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.119+0000 7ff86fe00640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] conn(0x7ff8500725e0 0x7ff850074a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.119+0000 7ff874e00640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff85006a180 0x7ff85006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.119+0000 7ff86fe00640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] conn(0x7ff8500725e0 0x7ff850074a80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.119+0000 7ff874e00640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff85006a180 0x7ff85006c640 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff864001810 tx=0x7ff864009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.119+0000 7ff86cc00640 1 -- 172.21.15.59:0/699568994 <== osd.2 v2:172.21.15.59:6808/3949011694 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff850075150 con 0x7ff8500725e0 2024-05-30T17:07:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff877800640 1 -- 172.21.15.59:0/699568994 --> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff870158b50 con 0x7ff8500725e0 2024-05-30T17:07:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff86cc00640 1 -- 172.21.15.59:0/699568994 <== osd.2 v2:172.21.15.59:6808/3949011694 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff870158b50 con 0x7ff8500725e0 2024-05-30T17:07:07.136 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:07:07.136 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T17:07:07.136 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:07:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff877800640 1 -- 172.21.15.59:0/699568994 >> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] conn(0x7ff8500725e0 msgr2=0x7ff850074a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff877800640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.59:6808/3949011694,v1:172.21.15.59:6809/3949011694] conn(0x7ff8500725e0 0x7ff850074a80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff877800640 1 -- 172.21.15.59:0/699568994 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff85006a180 msgr2=0x7ff85006c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff877800640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff85006a180 0x7ff85006c640 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff864001810 tx=0x7ff864009040 comp rx=0 tx=0).stop 2024-05-30T17:07:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff877800640 1 -- 172.21.15.59:0/699568994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87015b790 msgr2=0x7ff8701faee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff877800640 1 --2- 172.21.15.59:0/699568994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87015b790 0x7ff8701faee0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7ff86800efc0 tx=0x7ff86800c490 comp rx=0 tx=0).stop 2024-05-30T17:07:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff875800640 1 -- 172.21.15.59:0/699568994 reap_dead start 2024-05-30T17:07:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff877800640 1 -- 172.21.15.59:0/699568994 shutdown_connections 2024-05-30T17:07:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff877800640 1 -- 172.21.15.59:0/699568994 >> 172.21.15.59:0/699568994 conn(0x7ff8700b1e60 msgr2=0x7ff8700735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff877800640 1 -- 172.21.15.59:0/699568994 shutdown_connections 2024-05-30T17:07:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.135+0000 7ff877800640 1 -- 172.21.15.59:0/699568994 wait complete. 2024-05-30T17:07:07.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-30T17:07:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff710e00640 1 Processor -- start 2024-05-30T17:07:07.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff710e00640 1 -- start start 2024-05-30T17:07:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff710e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff70c0af720 0x7ff70c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff710e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff70c0d0560 0x7ff70c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff710e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff70c15f060 con 0x7ff70c06e900 2024-05-30T17:07:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff710e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff70c0afb00 con 0x7ff70c0d0560 2024-05-30T17:07:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff710e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff70c15c270 con 0x7ff70c0af720 2024-05-30T17:07:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff709400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff70c06e900 0x7ff70c15f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51724/0 (socket says 172.21.15.59:51724) 2024-05-30T17:07:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff709400640 1 -- 172.21.15.59:0/1512267910 learned_addr learned my addr 172.21.15.59:0/1512267910 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:07.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff709e00640 1 --2- 172.21.15.59:0/1512267910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff70c0af720 0x7ff70c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff70a800640 1 --2- 172.21.15.59:0/1512267910 >> v2:172.21.15.107:3300/0 conn(0x7ff70c0d0560 0x7ff70c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff708a00640 1 -- 172.21.15.59:0/1512267910 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958220157 0 0) 0x7ff70c15f060 con 0x7ff70c06e900 2024-05-30T17:07:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff708a00640 1 -- 172.21.15.59:0/1512267910 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6f0003530 con 0x7ff70c06e900 2024-05-30T17:07:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff709e00640 1 -- 172.21.15.59:0/1512267910 >> v2:172.21.15.107:3300/0 conn(0x7ff70c0d0560 msgr2=0x7ff70c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff709e00640 1 --2- 172.21.15.59:0/1512267910 >> v2:172.21.15.107:3300/0 conn(0x7ff70c0d0560 0x7ff70c0d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff709e00640 1 -- 172.21.15.59:0/1512267910 >> v1:172.21.15.59:6789/0 conn(0x7ff70c06e900 legacy=0x7ff70c15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff709e00640 1 -- 172.21.15.59:0/1512267910 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70c15ff00 con 0x7ff70c0af720 2024-05-30T17:07:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.295+0000 7ff70a800640 1 --2- 172.21.15.59:0/1512267910 >> v2:172.21.15.107:3300/0 conn(0x7ff70c0d0560 0x7ff70c0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T17:07:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.299+0000 7ff709e00640 1 --2- 172.21.15.59:0/1512267910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff70c0af720 0x7ff70c15b9d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0097c0 tx=0x7ff6fc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e26459cc4af91353 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.299+0000 7ff708a00640 1 -- 172.21.15.59:0/1512267910 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0b2070 con 0x7ff70c0af720 2024-05-30T17:07:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.299+0000 7ff708a00640 1 -- 172.21.15.59:0/1512267910 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc0ad640 con 0x7ff70c0af720 2024-05-30T17:07:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.299+0000 7ff708a00640 1 -- 172.21.15.59:0/1512267910 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0ada10 con 0x7ff70c0af720 2024-05-30T17:07:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.299+0000 7ff710e00640 1 -- 172.21.15.59:0/1512267910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff70c0af720 msgr2=0x7ff70c15b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.299+0000 7ff710e00640 1 --2- 172.21.15.59:0/1512267910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff70c0af720 0x7ff70c15b9d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0097c0 tx=0x7ff6fc01c4a0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.299+0000 7ff710e00640 1 -- 172.21.15.59:0/1512267910 shutdown_connections 2024-05-30T17:07:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.299+0000 7ff710e00640 1 --2- 172.21.15.59:0/1512267910 >> v2:172.21.15.107:3300/0 conn(0x7ff70c0d0560 0x7ff70c0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.299+0000 7ff710e00640 1 --2- 172.21.15.59:0/1512267910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff70c0af720 0x7ff70c15b9d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.299+0000 7ff710e00640 1 -- 172.21.15.59:0/1512267910 >> 172.21.15.59:0/1512267910 conn(0x7ff70c0b22d0 msgr2=0x7ff70c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.299+0000 7ff710e00640 1 -- 172.21.15.59:0/1512267910 shutdown_connections 2024-05-30T17:07:07.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.299+0000 7ff710e00640 1 -- 172.21.15.59:0/1512267910 wait complete. 2024-05-30T17:07:07.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff710e00640 1 Processor -- start 2024-05-30T17:07:07.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff710e00640 1 -- start start 2024-05-30T17:07:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff710e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff70c06e900 0x7ff70c14e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff710e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff70c0af720 0x7ff70c14d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff710e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff70c0d0560 0x7ff70c164800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff710e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c073150 con 0x7ff70c06e900 2024-05-30T17:07:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff710e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c15c830 con 0x7ff70c0d0560 2024-05-30T17:07:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff710e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff70c0732d0 con 0x7ff70c0af720 2024-05-30T17:07:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff709e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff70c06e900 0x7ff70c14e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff709e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff70c06e900 0x7ff70c14e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46172/0 (socket says 172.21.15.59:46172) 2024-05-30T17:07:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff709e00640 1 -- 172.21.15.59:0/1246209698 learned_addr learned my addr 172.21.15.59:0/1246209698 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff709e00640 1 -- 172.21.15.59:0/1246209698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff70c0af720 msgr2=0x7ff70c14d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff709e00640 1 --2- 172.21.15.59:0/1246209698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff70c0af720 0x7ff70c14d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff709e00640 1 -- 172.21.15.59:0/1246209698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff70c0d0560 msgr2=0x7ff70c164800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff709e00640 1 --2- 172.21.15.59:0/1246209698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff70c0d0560 0x7ff70c164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff709e00640 1 -- 172.21.15.59:0/1246209698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70c14d700 con 0x7ff70c06e900 2024-05-30T17:07:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff709e00640 1 --2- 172.21.15.59:0/1246209698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff70c06e900 0x7ff70c14e1b0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc01a0d0 tx=0x7ff6fc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff702000640 1 -- 172.21.15.59:0/1246209698 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0ba020 con 0x7ff70c06e900 2024-05-30T17:07:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff702000640 1 -- 172.21.15.59:0/1246209698 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc0b6410 con 0x7ff70c06e900 2024-05-30T17:07:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff702000640 1 -- 172.21.15.59:0/1246209698 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0b2040 con 0x7ff70c06e900 2024-05-30T17:07:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff710e00640 1 -- 172.21.15.59:0/1246209698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff70c13b6c0 con 0x7ff70c06e900 2024-05-30T17:07:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff710e00640 1 -- 172.21.15.59:0/1246209698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff70c13bc80 con 0x7ff70c06e900 2024-05-30T17:07:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.303+0000 7ff710e00640 1 -- 172.21.15.59:0/1246209698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff70c068a90 con 0x7ff70c06e900 2024-05-30T17:07:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.307+0000 7ff702000640 1 -- 172.21.15.59:0/1246209698 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7ff6fc0bd020 con 0x7ff70c06e900 2024-05-30T17:07:07.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.307+0000 7ff702000640 1 --2- 172.21.15.59:0/1246209698 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff6ec06a150 0x7ff6ec06c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.307+0000 7ff702000640 1 -- 172.21.15.59:0/1246209698 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7ff6fc11f6d0 con 0x7ff70c06e900 2024-05-30T17:07:07.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.307+0000 7ff709400640 1 --2- 172.21.15.59:0/1246209698 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff6ec06a150 0x7ff6ec06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.307+0000 7ff709400640 1 --2- 172.21.15.59:0/1246209698 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff6ec06a150 0x7ff6ec06c610 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8007fd0 tx=0x7ff6f8007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.311+0000 7ff702000640 1 -- 172.21.15.59:0/1246209698 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff6fc0c4030 con 0x7ff70c06e900 2024-05-30T17:07:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.475+0000 7ff710e00640 1 -- 172.21.15.59:0/1246209698 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7ff70c0d0a10 con 0x7ff6ec06a150 2024-05-30T17:07:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.475+0000 7ff702000640 1 -- 172.21.15.59:0/1246209698 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff70c0d0a10 con 0x7ff6ec06a150 2024-05-30T17:07:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 2 to deep-scrub 2024-05-30T17:07:07.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.479+0000 7ff710e00640 1 -- 172.21.15.59:0/1246209698 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff6ec06a150 msgr2=0x7ff6ec06c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.479+0000 7ff710e00640 1 --2- 172.21.15.59:0/1246209698 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff6ec06a150 0x7ff6ec06c610 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8007fd0 tx=0x7ff6f8007900 comp rx=0 tx=0).stop 2024-05-30T17:07:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.479+0000 7ff710e00640 1 -- 172.21.15.59:0/1246209698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff70c06e900 msgr2=0x7ff70c14e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.479+0000 7ff710e00640 1 --2- 172.21.15.59:0/1246209698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff70c06e900 0x7ff70c14e1b0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc01a0d0 tx=0x7ff6fc019240 comp rx=0 tx=0).stop 2024-05-30T17:07:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.479+0000 7ff710e00640 1 -- 172.21.15.59:0/1246209698 shutdown_connections 2024-05-30T17:07:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.479+0000 7ff710e00640 1 --2- 172.21.15.59:0/1246209698 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7ff6ec06a150 0x7ff6ec06c610 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.479+0000 7ff710e00640 1 --2- 172.21.15.59:0/1246209698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff70c0d0560 0x7ff70c164800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.479+0000 7ff710e00640 1 --2- 172.21.15.59:0/1246209698 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff70c0af720 0x7ff70c14d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.479+0000 7ff710e00640 1 --2- 172.21.15.59:0/1246209698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff70c06e900 0x7ff70c14e1b0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.479+0000 7ff710e00640 1 -- 172.21.15.59:0/1246209698 >> 172.21.15.59:0/1246209698 conn(0x7ff70c0b22d0 msgr2=0x7ff70c169240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:07.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.479+0000 7ff710e00640 1 -- 172.21.15.59:0/1246209698 shutdown_connections 2024-05-30T17:07:07.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.479+0000 7ff710e00640 1 -- 172.21.15.59:0/1246209698 wait complete. 2024-05-30T17:07:07.499 INFO:tasks.ceph:Scrubbing osd.3 2024-05-30T17:07:07.499 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-30T17:07:07.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.643+0000 7f6772800640 1 Processor -- start 2024-05-30T17:07:07.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.643+0000 7f6772800640 1 -- start start 2024-05-30T17:07:07.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.643+0000 7f6772800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f676c09b7a0 0x7f676c162410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.643+0000 7f6772800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f676c162950 0x7f676c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.643+0000 7f6772800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f676c0d1020 con 0x7f676c161ce0 2024-05-30T17:07:07.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.643+0000 7f6772800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f676c0d1300 con 0x7f676c09b7a0 2024-05-30T17:07:07.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.643+0000 7f6772800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f676c0d15e0 con 0x7f676c162950 2024-05-30T17:07:07.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f676b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f676c161ce0 0x7f676c0d0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51726/0 (socket says 172.21.15.59:51726) 2024-05-30T17:07:07.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f676b400640 1 -- 172.21.15.59:0/4129252412 learned_addr learned my addr 172.21.15.59:0/4129252412 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:07.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f6762a00640 1 --2- 172.21.15.59:0/4129252412 >> v2:172.21.15.59:3300/0 conn(0x7f676c09b7a0 0x7f676c162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f676be00640 1 --2- 172.21.15.59:0/4129252412 >> v2:172.21.15.107:3300/0 conn(0x7f676c162950 0x7f676c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f676aa00640 1 -- 172.21.15.59:0/4129252412 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716294269 0 0) 0x7f676c0d1020 con 0x7f676c161ce0 2024-05-30T17:07:07.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f676aa00640 1 -- 172.21.15.59:0/4129252412 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6750003530 con 0x7f676c161ce0 2024-05-30T17:07:07.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f6762a00640 1 -- 172.21.15.59:0/4129252412 >> v2:172.21.15.107:3300/0 conn(0x7f676c162950 msgr2=0x7f676c15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:07.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f6762a00640 1 --2- 172.21.15.59:0/4129252412 >> v2:172.21.15.107:3300/0 conn(0x7f676c162950 0x7f676c15e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f6762a00640 1 -- 172.21.15.59:0/4129252412 >> v1:172.21.15.59:6789/0 conn(0x7f676c161ce0 legacy=0x7f676c0d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f6762a00640 1 -- 172.21.15.59:0/4129252412 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676c0d18c0 con 0x7f676c09b7a0 2024-05-30T17:07:07.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f6762a00640 1 --2- 172.21.15.59:0/4129252412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c09b7a0 0x7f676c162410 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f676c1633e0 tx=0x7f675401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dc13c3bdbdc543 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f676aa00640 1 -- 172.21.15.59:0/4129252412 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67540b1070 con 0x7f676c09b7a0 2024-05-30T17:07:07.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f676aa00640 1 -- 172.21.15.59:0/4129252412 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67540ac5f0 con 0x7f676c09b7a0 2024-05-30T17:07:07.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.647+0000 7f676aa00640 1 -- 172.21.15.59:0/4129252412 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67540ac9c0 con 0x7f676c09b7a0 2024-05-30T17:07:07.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 -- 172.21.15.59:0/4129252412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c09b7a0 msgr2=0x7f676c162410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 --2- 172.21.15.59:0/4129252412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c09b7a0 0x7f676c162410 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f676c1633e0 tx=0x7f675401c480 comp rx=0 tx=0).stop 2024-05-30T17:07:07.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 -- 172.21.15.59:0/4129252412 shutdown_connections 2024-05-30T17:07:07.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 --2- 172.21.15.59:0/4129252412 >> v2:172.21.15.107:3300/0 conn(0x7f676c162950 0x7f676c15e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 --2- 172.21.15.59:0/4129252412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c09b7a0 0x7f676c162410 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 -- 172.21.15.59:0/4129252412 >> 172.21.15.59:0/4129252412 conn(0x7f676c0b4000 msgr2=0x7f676c0b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:07.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 -- 172.21.15.59:0/4129252412 shutdown_connections 2024-05-30T17:07:07.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 -- 172.21.15.59:0/4129252412 wait complete. 2024-05-30T17:07:07.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 Processor -- start 2024-05-30T17:07:07.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 -- start start 2024-05-30T17:07:07.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f676c09b7a0 0x7f676c154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c161ce0 0x7f676c0b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f676c162950 0x7f676c156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f676c15f260 con 0x7f676c161ce0 2024-05-30T17:07:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f676c15f0e0 con 0x7f676c162950 2024-05-30T17:07:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6772800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f676c15f3e0 con 0x7f676c09b7a0 2024-05-30T17:07:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6762a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c161ce0 0x7f676c0b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6762a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c161ce0 0x7f676c0b5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46188/0 (socket says 172.21.15.59:46188) 2024-05-30T17:07:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f6762a00640 1 -- 172.21.15.59:0/368200681 learned_addr learned my addr 172.21.15.59:0/368200681 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f676b400640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f676c09b7a0 0x7f676c154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.651+0000 7f676be00640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f676c162950 0x7f676c156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6762a00640 1 -- 172.21.15.59:0/368200681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f676c09b7a0 msgr2=0x7f676c154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6762a00640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f676c09b7a0 0x7f676c154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6762a00640 1 -- 172.21.15.59:0/368200681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f676c162950 msgr2=0x7f676c156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6762a00640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f676c162950 0x7f676c156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6762a00640 1 -- 172.21.15.59:0/368200681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676c154ae0 con 0x7f676c161ce0 2024-05-30T17:07:07.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6762a00640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c161ce0 0x7f676c0b5360 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f67540af040 tx=0x7f6754019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6763e00640 1 -- 172.21.15.59:0/368200681 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67540b1040 con 0x7f676c161ce0 2024-05-30T17:07:07.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6763e00640 1 -- 172.21.15.59:0/368200681 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67540bb070 con 0x7f676c161ce0 2024-05-30T17:07:07.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6763e00640 1 -- 172.21.15.59:0/368200681 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6754006e20 con 0x7f676c161ce0 2024-05-30T17:07:07.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6772800640 1 -- 172.21.15.59:0/368200681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676c154dc0 con 0x7f676c161ce0 2024-05-30T17:07:07.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6772800640 1 -- 172.21.15.59:0/368200681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676c155380 con 0x7f676c161ce0 2024-05-30T17:07:07.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6772800640 1 -- 172.21.15.59:0/368200681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f676c068a90 con 0x7f676c161ce0 2024-05-30T17:07:07.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.655+0000 7f6763e00640 1 -- 172.21.15.59:0/368200681 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f67540b5630 con 0x7f676c161ce0 2024-05-30T17:07:07.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.659+0000 7f6763e00640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f674806a1a0 0x7f674806c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.659+0000 7f6763e00640 1 -- 172.21.15.59:0/368200681 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f675411fd30 con 0x7f676c161ce0 2024-05-30T17:07:07.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.659+0000 7f676b400640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f674806a1a0 0x7f674806c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.659+0000 7f6763e00640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] conn(0x7f6748072680 0x7f6748074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.659+0000 7f6763e00640 1 -- 172.21.15.59:0/368200681 --> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67540ac5f0 con 0x7f6748072680 2024-05-30T17:07:07.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.659+0000 7f6763e00640 1 -- 172.21.15.59:0/368200681 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f6754120e40 con 0x7f676c161ce0 2024-05-30T17:07:07.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.659+0000 7f676be00640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] conn(0x7f6748072680 0x7f6748074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.659+0000 7f676b400640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f674806a1a0 0x7f674806c660 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f675c005c10 tx=0x7f675c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.659+0000 7f676be00640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] conn(0x7f6748072680 0x7f6748074b20 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.659+0000 7f6763e00640 1 -- 172.21.15.59:0/368200681 <== osd.3 v2:172.21.15.59:6800/2728314061 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f67540ac5f0 con 0x7f6748072680 2024-05-30T17:07:07.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f6772800640 1 -- 172.21.15.59:0/368200681 --> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f676c0b4bb0 con 0x7f6748072680 2024-05-30T17:07:07.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f6763e00640 1 -- 172.21.15.59:0/368200681 <== osd.3 v2:172.21.15.59:6800/2728314061 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f676c0b4bb0 con 0x7f6748072680 2024-05-30T17:07:07.677 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:07:07.677 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T17:07:07.677 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:07:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f6772800640 1 -- 172.21.15.59:0/368200681 >> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] conn(0x7f6748072680 msgr2=0x7f6748074b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f6772800640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.59:6800/2728314061,v1:172.21.15.59:6801/2728314061] conn(0x7f6748072680 0x7f6748074b20 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f6772800640 1 -- 172.21.15.59:0/368200681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f674806a1a0 msgr2=0x7f674806c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f6772800640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f674806a1a0 0x7f674806c660 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f675c005c10 tx=0x7f675c009040 comp rx=0 tx=0).stop 2024-05-30T17:07:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f6772800640 1 -- 172.21.15.59:0/368200681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c161ce0 msgr2=0x7f676c0b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f6772800640 1 --2- 172.21.15.59:0/368200681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c161ce0 0x7f676c0b5360 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f67540af040 tx=0x7f6754019220 comp rx=0 tx=0).stop 2024-05-30T17:07:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f676be00640 1 -- 172.21.15.59:0/368200681 reap_dead start 2024-05-30T17:07:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f6772800640 1 -- 172.21.15.59:0/368200681 shutdown_connections 2024-05-30T17:07:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f6772800640 1 -- 172.21.15.59:0/368200681 >> 172.21.15.59:0/368200681 conn(0x7f676c0b4000 msgr2=0x7f676c15a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f6772800640 1 -- 172.21.15.59:0/368200681 shutdown_connections 2024-05-30T17:07:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.675+0000 7f6772800640 1 -- 172.21.15.59:0/368200681 wait complete. 2024-05-30T17:07:07.696 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-30T17:07:07.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.835+0000 7f597d000640 1 Processor -- start 2024-05-30T17:07:07.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.835+0000 7f597d000640 1 -- start start 2024-05-30T17:07:07.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.835+0000 7f597d000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f597806e900 0x7f597815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.835+0000 7f597d000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f597815f060 con 0x7f59780d0560 2024-05-30T17:07:07.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.835+0000 7f597d000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59780afb00 con 0x7f59780af720 2024-05-30T17:07:07.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.835+0000 7f597d000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f597815c270 con 0x7f597806e900 2024-05-30T17:07:07.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.839+0000 7f5976800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f59780d0560 0x7f5978072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51742/0 (socket says 172.21.15.59:51742) 2024-05-30T17:07:07.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.839+0000 7f5976800640 1 -- 172.21.15.59:0/3899021512 learned_addr learned my addr 172.21.15.59:0/3899021512 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:07.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.839+0000 7f5975400640 1 --2- 172.21.15.59:0/3899021512 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f597806e900 0x7f597815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.839+0000 7f5974a00640 1 -- 172.21.15.59:0/3899021512 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2041426939 0 0) 0x7f597815f060 con 0x7f59780d0560 2024-05-30T17:07:07.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.839+0000 7f5975400640 1 -- 172.21.15.59:0/3899021512 >> v1:172.21.15.107:6789/0 conn(0x7f59780af720 legacy=0x7f597815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.839+0000 7f5975400640 1 -- 172.21.15.59:0/3899021512 >> v1:172.21.15.59:6789/0 conn(0x7f59780d0560 legacy=0x7f5978072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.839+0000 7f5975400640 1 -- 172.21.15.59:0/3899021512 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597815c550 con 0x7f597806e900 2024-05-30T17:07:07.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.839+0000 7f5975400640 1 --2- 172.21.15.59:0/3899021512 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f597806e900 0x7f597815f7f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5964009770 tx=0x7f596401c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=528d4ce42b32412e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f5974a00640 1 -- 172.21.15.59:0/3899021512 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640b0070 con 0x7f597806e900 2024-05-30T17:07:07.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f5974a00640 1 -- 172.21.15.59:0/3899021512 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59640ab600 con 0x7f597806e900 2024-05-30T17:07:07.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f5974a00640 1 -- 172.21.15.59:0/3899021512 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640ab9d0 con 0x7f597806e900 2024-05-30T17:07:07.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 -- 172.21.15.59:0/3899021512 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f597806e900 msgr2=0x7f597815f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 --2- 172.21.15.59:0/3899021512 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f597806e900 0x7f597815f7f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5964009770 tx=0x7f596401c2e0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 -- 172.21.15.59:0/3899021512 shutdown_connections 2024-05-30T17:07:07.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 --2- 172.21.15.59:0/3899021512 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f597806e900 0x7f597815f7f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 -- 172.21.15.59:0/3899021512 >> 172.21.15.59:0/3899021512 conn(0x7f59780b22d0 msgr2=0x7f59780b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:07.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 -- 172.21.15.59:0/3899021512 shutdown_connections 2024-05-30T17:07:07.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 -- 172.21.15.59:0/3899021512 wait complete. 2024-05-30T17:07:07.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 Processor -- start 2024-05-30T17:07:07.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 -- start start 2024-05-30T17:07:07.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597806e900 0x7f597814b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59780af720 0x7f59781502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f59780d0560 0x7f597815de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f597815feb0 con 0x7f597806e900 2024-05-30T17:07:07.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f597815fd30 con 0x7f59780af720 2024-05-30T17:07:07.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f597d000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5978158dd0 con 0x7f59780d0560 2024-05-30T17:07:07.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f5975e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597806e900 0x7f597814b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f5975e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597806e900 0x7f597814b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46202/0 (socket says 172.21.15.59:46202) 2024-05-30T17:07:07.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f5975e00640 1 -- 172.21.15.59:0/3335707071 learned_addr learned my addr 172.21.15.59:0/3335707071 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:07.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f5976800640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f59780d0560 0x7f597815de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.843+0000 7f5975400640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59780af720 0x7f59781502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f5975e00640 1 -- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f59780d0560 msgr2=0x7f597815de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f5975e00640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f59780d0560 0x7f597815de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f5975e00640 1 -- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59780af720 msgr2=0x7f59781502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f5975e00640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59780af720 0x7f59781502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f5975e00640 1 -- 172.21.15.59:0/3335707071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597814bc50 con 0x7f597806e900 2024-05-30T17:07:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f5975e00640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597806e900 0x7f597814b710 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f596800c750 tx=0x7f596800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f596e000640 1 -- 172.21.15.59:0/3335707071 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968017070 con 0x7f597806e900 2024-05-30T17:07:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f596e000640 1 -- 172.21.15.59:0/3335707071 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5968005280 con 0x7f597806e900 2024-05-30T17:07:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f596e000640 1 -- 172.21.15.59:0/3335707071 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596800a640 con 0x7f597806e900 2024-05-30T17:07:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f597d000640 1 -- 172.21.15.59:0/3335707071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59781530e0 con 0x7f597806e900 2024-05-30T17:07:07.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f597d000640 1 -- 172.21.15.59:0/3335707071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5978152320 con 0x7f597806e900 2024-05-30T17:07:07.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f597d000640 1 -- 172.21.15.59:0/3335707071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5978068a90 con 0x7f597806e900 2024-05-30T17:07:07.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f596e000640 1 -- 172.21.15.59:0/3335707071 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f596801a070 con 0x7f597806e900 2024-05-30T17:07:07.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f596e000640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f595806a150 0x7f595806c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:07.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.847+0000 7f596e000640 1 -- 172.21.15.59:0/3335707071 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f5968084eb0 con 0x7f597806e900 2024-05-30T17:07:07.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.851+0000 7f5975400640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f595806a150 0x7f595806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:07.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.851+0000 7f5975400640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f595806a150 0x7f595806c610 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f59640ad000 tx=0x7f59640a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:07.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:07.851+0000 7f596e000640 1 -- 172.21.15.59:0/3335707071 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f596808d030 con 0x7f597806e900 2024-05-30T17:07:08.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.019+0000 7f597d000640 1 -- 172.21.15.59:0/3335707071 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f59780afee0 con 0x7f595806a150 2024-05-30T17:07:08.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.019+0000 7f596e000640 1 -- 172.21.15.59:0/3335707071 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f59780afee0 con 0x7f595806a150 2024-05-30T17:07:08.022 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 3 to deep-scrub 2024-05-30T17:07:08.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.023+0000 7f597d000640 1 -- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f595806a150 msgr2=0x7f595806c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.023+0000 7f597d000640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f595806a150 0x7f595806c610 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f59640ad000 tx=0x7f59640a4f90 comp rx=0 tx=0).stop 2024-05-30T17:07:08.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.023+0000 7f597d000640 1 -- 172.21.15.59:0/3335707071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597806e900 msgr2=0x7f597814b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.023+0000 7f597d000640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597806e900 0x7f597814b710 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f596800c750 tx=0x7f596800cc10 comp rx=0 tx=0).stop 2024-05-30T17:07:08.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.023+0000 7f597d000640 1 -- 172.21.15.59:0/3335707071 shutdown_connections 2024-05-30T17:07:08.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.023+0000 7f597d000640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f595806a150 0x7f595806c610 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.023+0000 7f597d000640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f59780d0560 0x7f597815de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.023+0000 7f597d000640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59780af720 0x7f59781502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.023+0000 7f597d000640 1 --2- 172.21.15.59:0/3335707071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597806e900 0x7f597814b710 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.023+0000 7f597d000640 1 -- 172.21.15.59:0/3335707071 >> 172.21.15.59:0/3335707071 conn(0x7f59780b22d0 msgr2=0x7f59780b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:08.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.023+0000 7f597d000640 1 -- 172.21.15.59:0/3335707071 shutdown_connections 2024-05-30T17:07:08.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.023+0000 7f597d000640 1 -- 172.21.15.59:0/3335707071 wait complete. 2024-05-30T17:07:08.044 INFO:tasks.ceph:Scrubbing osd.4 2024-05-30T17:07:08.044 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-30T17:07:08.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf35600640 1 Processor -- start 2024-05-30T17:07:08.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf35600640 1 -- start start 2024-05-30T17:07:08.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf35600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbf30161ce0 0x7fbf3009b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf35600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbf300d0ba0 0x7fbf3015e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf35600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf300d1020 con 0x7fbf300d0710 2024-05-30T17:07:08.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf35600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbf300d1300 con 0x7fbf300d0ba0 2024-05-30T17:07:08.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf35600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbf300d15e0 con 0x7fbf30161ce0 2024-05-30T17:07:08.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf2f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbf300d0ba0 0x7fbf3015e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf27e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbf300d0710 0x7fbf30162410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51744/0 (socket says 172.21.15.59:51744) 2024-05-30T17:07:08.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf27e00640 1 -- 172.21.15.59:0/4241299221 learned_addr learned my addr 172.21.15.59:0/4241299221 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:08.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf2ea00640 1 --2- 172.21.15.59:0/4241299221 >> v2:172.21.15.107:3300/0 conn(0x7fbf30161ce0 0x7fbf3009b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf2e000640 1 -- 172.21.15.59:0/4241299221 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3086191463 0 0) 0x7fbf300d1020 con 0x7fbf300d0710 2024-05-30T17:07:08.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf2e000640 1 -- 172.21.15.59:0/4241299221 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf14003530 con 0x7fbf300d0710 2024-05-30T17:07:08.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf2f400640 1 -- 172.21.15.59:0/4241299221 >> v2:172.21.15.107:3300/0 conn(0x7fbf30161ce0 msgr2=0x7fbf3009b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:08.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf2f400640 1 --2- 172.21.15.59:0/4241299221 >> v2:172.21.15.107:3300/0 conn(0x7fbf30161ce0 0x7fbf3009b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf2f400640 1 -- 172.21.15.59:0/4241299221 >> v1:172.21.15.59:6789/0 conn(0x7fbf300d0710 legacy=0x7fbf30162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf2f400640 1 -- 172.21.15.59:0/4241299221 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf300d18c0 con 0x7fbf300d0ba0 2024-05-30T17:07:08.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.187+0000 7fbf2ea00640 1 --2- 172.21.15.59:0/4241299221 >> v2:172.21.15.107:3300/0 conn(0x7fbf30161ce0 0x7fbf3009b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:08.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.191+0000 7fbf2f400640 1 --2- 172.21.15.59:0/4241299221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf300d0ba0 0x7fbf3015e180 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fbf30073460 tx=0x7fbf2801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc54b8018aa9676d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.191+0000 7fbf2e000640 1 -- 172.21.15.59:0/4241299221 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf280b2070 con 0x7fbf300d0ba0 2024-05-30T17:07:08.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.191+0000 7fbf2e000640 1 -- 172.21.15.59:0/4241299221 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf280a5a10 con 0x7fbf300d0ba0 2024-05-30T17:07:08.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.191+0000 7fbf2e000640 1 -- 172.21.15.59:0/4241299221 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf280a5de0 con 0x7fbf300d0ba0 2024-05-30T17:07:08.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.191+0000 7fbf35600640 1 -- 172.21.15.59:0/4241299221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf300d0ba0 msgr2=0x7fbf3015e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.191+0000 7fbf35600640 1 --2- 172.21.15.59:0/4241299221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf300d0ba0 0x7fbf3015e180 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fbf30073460 tx=0x7fbf2801c930 comp rx=0 tx=0).stop 2024-05-30T17:07:08.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.191+0000 7fbf35600640 1 -- 172.21.15.59:0/4241299221 shutdown_connections 2024-05-30T17:07:08.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.191+0000 7fbf35600640 1 --2- 172.21.15.59:0/4241299221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf300d0ba0 0x7fbf3015e180 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.191+0000 7fbf35600640 1 --2- 172.21.15.59:0/4241299221 >> v2:172.21.15.107:3300/0 conn(0x7fbf30161ce0 0x7fbf3009b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.191+0000 7fbf35600640 1 -- 172.21.15.59:0/4241299221 >> 172.21.15.59:0/4241299221 conn(0x7fbf300b4000 msgr2=0x7fbf300b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.191+0000 7fbf35600640 1 -- 172.21.15.59:0/4241299221 shutdown_connections 2024-05-30T17:07:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.191+0000 7fbf35600640 1 -- 172.21.15.59:0/4241299221 wait complete. 2024-05-30T17:07:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf35600640 1 Processor -- start 2024-05-30T17:07:08.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf35600640 1 -- start start 2024-05-30T17:07:08.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf35600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf300d0710 0x7fbf301577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf35600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf300d0ba0 0x7fbf30156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf35600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf30161ce0 0x7fbf300b7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf35600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3015eed0 con 0x7fbf30161ce0 2024-05-30T17:07:08.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf35600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbf30162d30 con 0x7fbf300d0710 2024-05-30T17:07:08.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf35600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3015f050 con 0x7fbf300d0ba0 2024-05-30T17:07:08.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf2f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf30161ce0 0x7fbf300b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf2f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf30161ce0 0x7fbf300b7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46220/0 (socket says 172.21.15.59:46220) 2024-05-30T17:07:08.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf2f400640 1 -- 172.21.15.59:0/2930039285 learned_addr learned my addr 172.21.15.59:0/2930039285 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:08.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf2ea00640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf300d0710 0x7fbf301577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf27e00640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf300d0ba0 0x7fbf30156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf2f400640 1 -- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf300d0ba0 msgr2=0x7fbf30156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf2f400640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf300d0ba0 0x7fbf30156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf2f400640 1 -- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf300d0710 msgr2=0x7fbf301577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf2f400640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf300d0710 0x7fbf301577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf2f400640 1 -- 172.21.15.59:0/2930039285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3015a830 con 0x7fbf30161ce0 2024-05-30T17:07:08.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf27e00640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf300d0ba0 0x7fbf30156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:08.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf2f400640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf30161ce0 0x7fbf300b7530 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fbf28019540 tx=0x7fbf280196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf26a00640 1 -- 172.21.15.59:0/2930039285 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf280b2050 con 0x7fbf30161ce0 2024-05-30T17:07:08.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf26a00640 1 -- 172.21.15.59:0/2930039285 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf280be070 con 0x7fbf30161ce0 2024-05-30T17:07:08.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf35600640 1 -- 172.21.15.59:0/2930039285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3015aad0 con 0x7fbf30161ce0 2024-05-30T17:07:08.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf26a00640 1 -- 172.21.15.59:0/2930039285 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf280ada90 con 0x7fbf30161ce0 2024-05-30T17:07:08.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.195+0000 7fbf35600640 1 -- 172.21.15.59:0/2930039285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3015b090 con 0x7fbf30161ce0 2024-05-30T17:07:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.199+0000 7fbf35600640 1 -- 172.21.15.59:0/2930039285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf30068a90 con 0x7fbf30161ce0 2024-05-30T17:07:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.199+0000 7fbf26a00640 1 -- 172.21.15.59:0/2930039285 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7fbf280adc30 con 0x7fbf30161ce0 2024-05-30T17:07:08.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.199+0000 7fbf26a00640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbf0c06a150 0x7fbf0c06c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.199+0000 7fbf26a00640 1 -- 172.21.15.59:0/2930039285 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fbf28121570 con 0x7fbf30161ce0 2024-05-30T17:07:08.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.199+0000 7fbf26a00640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] conn(0x7fbf0c0725b0 0x7fbf0c074a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.199+0000 7fbf26a00640 1 -- 172.21.15.59:0/2930039285 --> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf0c075120 con 0x7fbf0c0725b0 2024-05-30T17:07:08.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.199+0000 7fbf26a00640 1 -- 172.21.15.59:0/2930039285 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7fbf28122460 con 0x7fbf30161ce0 2024-05-30T17:07:08.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.199+0000 7fbf2ea00640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbf0c06a150 0x7fbf0c06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.199+0000 7fbf27e00640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] conn(0x7fbf0c0725b0 0x7fbf0c074a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.199+0000 7fbf2ea00640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbf0c06a150 0x7fbf0c06c610 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fbf301faf70 tx=0x7fbf20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.203+0000 7fbf27e00640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] conn(0x7fbf0c0725b0 0x7fbf0c074a50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.203+0000 7fbf26a00640 1 -- 172.21.15.59:0/2930039285 <== osd.4 v2:172.21.15.107:6808/2449835032 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf0c075120 con 0x7fbf0c0725b0 2024-05-30T17:07:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.215+0000 7fbf35600640 1 -- 172.21.15.59:0/2930039285 --> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbf300d1f10 con 0x7fbf0c0725b0 2024-05-30T17:07:08.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.215+0000 7fbf26a00640 1 -- 172.21.15.59:0/2930039285 <== osd.4 v2:172.21.15.107:6808/2449835032 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbf18001930 con 0x7fbf0c0725b0 2024-05-30T17:07:08.219 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:07:08.219 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T17:07:08.219 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:07:08.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.215+0000 7fbf35600640 1 -- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] conn(0x7fbf0c0725b0 msgr2=0x7fbf0c074a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.215+0000 7fbf35600640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:6808/2449835032,v1:172.21.15.107:6809/2449835032] conn(0x7fbf0c0725b0 0x7fbf0c074a50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.215+0000 7fbf35600640 1 -- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbf0c06a150 msgr2=0x7fbf0c06c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.215+0000 7fbf35600640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fbf0c06a150 0x7fbf0c06c610 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fbf301faf70 tx=0x7fbf20008040 comp rx=0 tx=0).stop 2024-05-30T17:07:08.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.215+0000 7fbf35600640 1 -- 172.21.15.59:0/2930039285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf30161ce0 msgr2=0x7fbf300b7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.215+0000 7fbf35600640 1 --2- 172.21.15.59:0/2930039285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf30161ce0 0x7fbf300b7530 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fbf28019540 tx=0x7fbf280196d0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.215+0000 7fbf2f400640 1 -- 172.21.15.59:0/2930039285 reap_dead start 2024-05-30T17:07:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.215+0000 7fbf35600640 1 -- 172.21.15.59:0/2930039285 shutdown_connections 2024-05-30T17:07:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.215+0000 7fbf35600640 1 -- 172.21.15.59:0/2930039285 >> 172.21.15.59:0/2930039285 conn(0x7fbf300b4000 msgr2=0x7fbf300ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.219+0000 7fbf35600640 1 -- 172.21.15.59:0/2930039285 shutdown_connections 2024-05-30T17:07:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.219+0000 7fbf35600640 1 -- 172.21.15.59:0/2930039285 wait complete. 2024-05-30T17:07:08.237 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-30T17:07:08.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.375+0000 7f80d1a00640 1 Processor -- start 2024-05-30T17:07:08.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.375+0000 7f80d1a00640 1 -- start start 2024-05-30T17:07:08.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80d1a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80cc15ff30 0x7f80cc070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80d1a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80cc09ba50 0x7f80cc070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80d1a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80cc070bd0 con 0x7f80cc0b1ac0 2024-05-30T17:07:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80d1a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f80cc070e70 con 0x7f80cc09ba50 2024-05-30T17:07:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80d1a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f80cc072020 con 0x7f80cc15ff30 2024-05-30T17:07:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80cb400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80cc09ba50 0x7f80cc070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80cb400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80cc09ba50 0x7f80cc070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46236/0 (socket says 172.21.15.59:46236) 2024-05-30T17:07:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80cb400640 1 -- 172.21.15.59:0/1749813011 learned_addr learned my addr 172.21.15.59:0/1749813011 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80caa00640 1 --2- 172.21.15.59:0/1749813011 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80cc15ff30 0x7f80cc070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80cb400640 1 -- 172.21.15.59:0/1749813011 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80cc15ff30 msgr2=0x7f80cc070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80cb400640 1 --2- 172.21.15.59:0/1749813011 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80cc15ff30 0x7f80cc070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80cb400640 1 -- 172.21.15.59:0/1749813011 >> v1:172.21.15.107:6789/0 conn(0x7f80cc0b1ac0 legacy=0x7f80cc0ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:08.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.379+0000 7f80cb400640 1 -- 172.21.15.59:0/1749813011 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80cc071cd0 con 0x7f80cc09ba50 2024-05-30T17:07:08.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80cb400640 1 --2- 172.21.15.59:0/1749813011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80cc09ba50 0x7f80cc070540 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009e50 tx=0x7f80c401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339b30ff54f3796 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80ca000640 1 -- 172.21.15.59:0/1749813011 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c40a5770 con 0x7f80cc09ba50 2024-05-30T17:07:08.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80ca000640 1 -- 172.21.15.59:0/1749813011 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c40a5910 con 0x7f80cc09ba50 2024-05-30T17:07:08.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80ca000640 1 -- 172.21.15.59:0/1749813011 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c40a5ce0 con 0x7f80cc09ba50 2024-05-30T17:07:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 -- 172.21.15.59:0/1749813011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80cc09ba50 msgr2=0x7f80cc070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 --2- 172.21.15.59:0/1749813011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80cc09ba50 0x7f80cc070540 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009e50 tx=0x7f80c401c9a0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 -- 172.21.15.59:0/1749813011 shutdown_connections 2024-05-30T17:07:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 --2- 172.21.15.59:0/1749813011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80cc09ba50 0x7f80cc070540 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 --2- 172.21.15.59:0/1749813011 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80cc15ff30 0x7f80cc070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 -- 172.21.15.59:0/1749813011 >> 172.21.15.59:0/1749813011 conn(0x7f80cc0b3f70 msgr2=0x7f80cc0b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:08.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 -- 172.21.15.59:0/1749813011 shutdown_connections 2024-05-30T17:07:08.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 -- 172.21.15.59:0/1749813011 wait complete. 2024-05-30T17:07:08.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 Processor -- start 2024-05-30T17:07:08.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 -- start start 2024-05-30T17:07:08.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80cc09ba50 0x7f80cc0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80cc0b1ac0 0x7f80cc15a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80cc15ff30 0x7f80cc15d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f80cc169870 con 0x7f80cc09ba50 2024-05-30T17:07:08.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f80cc1696f0 con 0x7f80cc15ff30 2024-05-30T17:07:08.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80d1a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f80cc1699f0 con 0x7f80cc0b1ac0 2024-05-30T17:07:08.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.383+0000 7f80caa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80cc09ba50 0x7f80cc0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80caa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80cc09ba50 0x7f80cc0c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46238/0 (socket says 172.21.15.59:46238) 2024-05-30T17:07:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80caa00640 1 -- 172.21.15.59:0/4290457724 learned_addr learned my addr 172.21.15.59:0/4290457724 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80caa00640 1 -- 172.21.15.59:0/4290457724 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80cc0b1ac0 msgr2=0x7f80cc15a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80caa00640 1 --2- 172.21.15.59:0/4290457724 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80cc0b1ac0 0x7f80cc15a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80caa00640 1 -- 172.21.15.59:0/4290457724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80cc15ff30 msgr2=0x7f80cc15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80caa00640 1 --2- 172.21.15.59:0/4290457724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80cc15ff30 0x7f80cc15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80caa00640 1 -- 172.21.15.59:0/4290457724 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80cc0c5fb0 con 0x7f80cc09ba50 2024-05-30T17:07:08.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80caa00640 1 --2- 172.21.15.59:0/4290457724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80cc09ba50 0x7f80cc0c8880 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00d5f0 tx=0x7f80bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80c3400640 1 -- 172.21.15.59:0/4290457724 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0125f0 con 0x7f80cc09ba50 2024-05-30T17:07:08.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80c3400640 1 -- 172.21.15.59:0/4290457724 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80bc019070 con 0x7f80cc09ba50 2024-05-30T17:07:08.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80c3400640 1 -- 172.21.15.59:0/4290457724 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0129b0 con 0x7f80cc09ba50 2024-05-30T17:07:08.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80d1a00640 1 -- 172.21.15.59:0/4290457724 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80cc0c8dc0 con 0x7f80cc09ba50 2024-05-30T17:07:08.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80d1a00640 1 -- 172.21.15.59:0/4290457724 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80cc15ad30 con 0x7f80cc09ba50 2024-05-30T17:07:08.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80d1a00640 1 -- 172.21.15.59:0/4290457724 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80cc068a90 con 0x7f80cc09ba50 2024-05-30T17:07:08.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.387+0000 7f80c3400640 1 -- 172.21.15.59:0/4290457724 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f80bc012b50 con 0x7f80cc09ba50 2024-05-30T17:07:08.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.391+0000 7f80c3400640 1 --2- 172.21.15.59:0/4290457724 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f80a806a180 0x7f80a806c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.391+0000 7f80c3400640 1 -- 172.21.15.59:0/4290457724 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f80bc085d80 con 0x7f80cc09ba50 2024-05-30T17:07:08.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.391+0000 7f80c2000640 1 --2- 172.21.15.59:0/4290457724 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f80a806a180 0x7f80a806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.391+0000 7f80c2000640 1 --2- 172.21.15.59:0/4290457724 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f80a806a180 0x7f80a806c640 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f80b4007fd0 tx=0x7f80b4007980 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.391+0000 7f80c3400640 1 -- 172.21.15.59:0/4290457724 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f80bc057da0 con 0x7f80cc09ba50 2024-05-30T17:07:08.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.563+0000 7f80d1a00640 1 -- 172.21.15.59:0/4290457724 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f80cc15af00 con 0x7f80a806a180 2024-05-30T17:07:08.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.563+0000 7f80c3400640 1 -- 172.21.15.59:0/4290457724 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f80cc15af00 con 0x7f80a806a180 2024-05-30T17:07:08.567 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 4 to deep-scrub 2024-05-30T17:07:08.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.567+0000 7f80d1a00640 1 -- 172.21.15.59:0/4290457724 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f80a806a180 msgr2=0x7f80a806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.567+0000 7f80d1a00640 1 --2- 172.21.15.59:0/4290457724 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f80a806a180 0x7f80a806c640 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f80b4007fd0 tx=0x7f80b4007980 comp rx=0 tx=0).stop 2024-05-30T17:07:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.567+0000 7f80d1a00640 1 -- 172.21.15.59:0/4290457724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80cc09ba50 msgr2=0x7f80cc0c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.567+0000 7f80d1a00640 1 --2- 172.21.15.59:0/4290457724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80cc09ba50 0x7f80cc0c8880 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00d5f0 tx=0x7f80bc00dab0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.567+0000 7f80d1a00640 1 -- 172.21.15.59:0/4290457724 shutdown_connections 2024-05-30T17:07:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.567+0000 7f80d1a00640 1 --2- 172.21.15.59:0/4290457724 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f80a806a180 0x7f80a806c640 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.567+0000 7f80d1a00640 1 --2- 172.21.15.59:0/4290457724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80cc15ff30 0x7f80cc15d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.567+0000 7f80d1a00640 1 --2- 172.21.15.59:0/4290457724 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80cc0b1ac0 0x7f80cc15a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.567+0000 7f80d1a00640 1 --2- 172.21.15.59:0/4290457724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80cc09ba50 0x7f80cc0c8880 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.567+0000 7f80d1a00640 1 -- 172.21.15.59:0/4290457724 >> 172.21.15.59:0/4290457724 conn(0x7f80cc0b3f70 msgr2=0x7f80cc158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.567+0000 7f80d1a00640 1 -- 172.21.15.59:0/4290457724 shutdown_connections 2024-05-30T17:07:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.567+0000 7f80d1a00640 1 -- 172.21.15.59:0/4290457724 wait complete. 2024-05-30T17:07:08.588 INFO:tasks.ceph:Scrubbing osd.5 2024-05-30T17:07:08.588 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-30T17:07:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1dbae00640 1 Processor -- start 2024-05-30T17:07:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1dbae00640 1 -- start start 2024-05-30T17:07:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1dbae00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1db415b3b0 0x7f1db40adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1dbae00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1db415b790 0x7f1db40af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1dbae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1db4071cb0 0x7f1db4072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1dbae00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1db40afaf0 con 0x7f1db415b3b0 2024-05-30T17:07:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1dbae00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1db40ae510 con 0x7f1db415b790 2024-05-30T17:07:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1dbae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1db40ae7f0 con 0x7f1db4071cb0 2024-05-30T17:07:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1db3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1db415b3b0 0x7f1db40adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1db3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1db415b3b0 0x7f1db40adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46254/0 (socket says 172.21.15.59:46254) 2024-05-30T17:07:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1db3e00640 1 -- 172.21.15.59:0/2985222327 learned_addr learned my addr 172.21.15.59:0/2985222327 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1dab400640 1 --2- 172.21.15.59:0/2985222327 >> v2:172.21.15.107:3300/0 conn(0x7f1db415b790 0x7f1db40af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1db8e00640 1 --2- 172.21.15.59:0/2985222327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1db4071cb0 0x7f1db4072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1db3e00640 1 -- 172.21.15.59:0/2985222327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1db4071cb0 msgr2=0x7f1db4072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:08.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1db3e00640 1 --2- 172.21.15.59:0/2985222327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1db4071cb0 0x7f1db4072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1db3e00640 1 -- 172.21.15.59:0/2985222327 >> v2:172.21.15.107:3300/0 conn(0x7f1db415b790 msgr2=0x7f1db40af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:08.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1db3e00640 1 --2- 172.21.15.59:0/2985222327 >> v2:172.21.15.107:3300/0 conn(0x7f1db415b790 0x7f1db40af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.731+0000 7f1db3e00640 1 -- 172.21.15.59:0/2985222327 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db40aead0 con 0x7f1db415b3b0 2024-05-30T17:07:08.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1db3e00640 1 --2- 172.21.15.59:0/2985222327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db415b3b0 0x7f1db40adf30 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009e50 tx=0x7f1da401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa17c9d3573af88 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1db3400640 1 -- 172.21.15.59:0/2985222327 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da40a5840 con 0x7f1db415b3b0 2024-05-30T17:07:08.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1db3400640 1 -- 172.21.15.59:0/2985222327 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da40a59e0 con 0x7f1db415b3b0 2024-05-30T17:07:08.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1db3400640 1 -- 172.21.15.59:0/2985222327 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da40a5db0 con 0x7f1db415b3b0 2024-05-30T17:07:08.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1dbae00640 1 -- 172.21.15.59:0/2985222327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db415b3b0 msgr2=0x7f1db40adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1dbae00640 1 --2- 172.21.15.59:0/2985222327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db415b3b0 0x7f1db40adf30 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009e50 tx=0x7f1da401c9c0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1dbae00640 1 -- 172.21.15.59:0/2985222327 shutdown_connections 2024-05-30T17:07:08.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1dbae00640 1 --2- 172.21.15.59:0/2985222327 >> v2:172.21.15.107:3300/0 conn(0x7f1db415b790 0x7f1db40af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1dbae00640 1 --2- 172.21.15.59:0/2985222327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1db4071cb0 0x7f1db4072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1dbae00640 1 --2- 172.21.15.59:0/2985222327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db415b3b0 0x7f1db40adf30 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1dbae00640 1 -- 172.21.15.59:0/2985222327 >> 172.21.15.59:0/2985222327 conn(0x7f1db40b1e60 msgr2=0x7f1db40b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:08.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1dbae00640 1 -- 172.21.15.59:0/2985222327 shutdown_connections 2024-05-30T17:07:08.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.735+0000 7f1dbae00640 1 -- 172.21.15.59:0/2985222327 wait complete. 2024-05-30T17:07:08.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dbae00640 1 Processor -- start 2024-05-30T17:07:08.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dbae00640 1 -- start start 2024-05-30T17:07:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dbae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1db4071cb0 0x7f1db4148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dbae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db415b3b0 0x7f1db41652b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dbae00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db415b790 0x7f1db414bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dbae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1db40726a0 con 0x7f1db415b3b0 2024-05-30T17:07:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dbae00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1db40cc860 con 0x7f1db415b790 2024-05-30T17:07:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dbae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1db4072820 con 0x7f1db4071cb0 2024-05-30T17:07:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dab400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db415b3b0 0x7f1db41652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dab400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db415b3b0 0x7f1db41652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46256/0 (socket says 172.21.15.59:46256) 2024-05-30T17:07:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dab400640 1 -- 172.21.15.59:0/1487436220 learned_addr learned my addr 172.21.15.59:0/1487436220 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1db8e00640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db415b790 0x7f1db414bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1db3e00640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1db4071cb0 0x7f1db4148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dab400640 1 -- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1db4071cb0 msgr2=0x7f1db4148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dab400640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1db4071cb0 0x7f1db4148740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dab400640 1 -- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db415b790 msgr2=0x7f1db414bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dab400640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db415b790 0x7f1db414bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dab400640 1 -- 172.21.15.59:0/1487436220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db4148c80 con 0x7f1db415b3b0 2024-05-30T17:07:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dab400640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db415b3b0 0x7f1db41652b0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00d830 tx=0x7f1d9c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1db0c00640 1 -- 172.21.15.59:0/1487436220 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c004030 con 0x7f1db415b3b0 2024-05-30T17:07:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1db0c00640 1 -- 172.21.15.59:0/1487436220 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9c0041d0 con 0x7f1db415b3b0 2024-05-30T17:07:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1db0c00640 1 -- 172.21.15.59:0/1487436220 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c00b6c0 con 0x7f1db415b3b0 2024-05-30T17:07:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dbae00640 1 -- 172.21.15.59:0/1487436220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1db4164290 con 0x7f1db415b3b0 2024-05-30T17:07:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.739+0000 7f1dbae00640 1 -- 172.21.15.59:0/1487436220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1db4164850 con 0x7f1db415b3b0 2024-05-30T17:07:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.743+0000 7f1dbae00640 1 -- 172.21.15.59:0/1487436220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1db4068a90 con 0x7f1db415b3b0 2024-05-30T17:07:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.743+0000 7f1db0c00640 1 -- 172.21.15.59:0/1487436220 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f1d9c00ba70 con 0x7f1db415b3b0 2024-05-30T17:07:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.743+0000 7f1db0c00640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1d9006a150 0x7f1d9006c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.743+0000 7f1db0c00640 1 -- 172.21.15.59:0/1487436220 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f1d9c0869f0 con 0x7f1db415b3b0 2024-05-30T17:07:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.743+0000 7f1db0c00640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] conn(0x7f1d900725b0 0x7f1d90074a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.743+0000 7f1db0c00640 1 -- 172.21.15.59:0/1487436220 --> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d9c00fe50 con 0x7f1d900725b0 2024-05-30T17:07:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.743+0000 7f1db0c00640 1 -- 172.21.15.59:0/1487436220 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f1d9c087d80 con 0x7f1db415b3b0 2024-05-30T17:07:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.743+0000 7f1db3e00640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1d9006a150 0x7f1d9006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.743+0000 7f1db8e00640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] conn(0x7f1d900725b0 0x7f1d90074a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.743+0000 7f1db3e00640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1d9006a150 0x7f1d9006c610 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1da40ae000 tx=0x7f1da40a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.743+0000 7f1db8e00640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] conn(0x7f1d900725b0 0x7f1d90074a50 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.747+0000 7f1db0c00640 1 -- 172.21.15.59:0/1487436220 <== osd.5 v2:172.21.15.107:6816/4169986841 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1d9c00fe50 con 0x7f1d900725b0 2024-05-30T17:07:08.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1dbae00640 1 -- 172.21.15.59:0/1487436220 --> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1db406f830 con 0x7f1d900725b0 2024-05-30T17:07:08.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1db0c00640 1 -- 172.21.15.59:0/1487436220 <== osd.5 v2:172.21.15.107:6816/4169986841 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1db406f830 con 0x7f1d900725b0 2024-05-30T17:07:08.762 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:07:08.762 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T17:07:08.762 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:07:08.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1dbae00640 1 -- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] conn(0x7f1d900725b0 msgr2=0x7f1d90074a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1dbae00640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:6816/4169986841,v1:172.21.15.107:6817/4169986841] conn(0x7f1d900725b0 0x7f1d90074a50 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1dbae00640 1 -- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1d9006a150 msgr2=0x7f1d9006c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1dbae00640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f1d9006a150 0x7f1d9006c610 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1da40ae000 tx=0x7f1da40a7070 comp rx=0 tx=0).stop 2024-05-30T17:07:08.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1dbae00640 1 -- 172.21.15.59:0/1487436220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db415b3b0 msgr2=0x7f1db41652b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1dbae00640 1 --2- 172.21.15.59:0/1487436220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db415b3b0 0x7f1db41652b0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00d830 tx=0x7f1d9c00dcf0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1db8e00640 1 -- 172.21.15.59:0/1487436220 reap_dead start 2024-05-30T17:07:08.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1dbae00640 1 -- 172.21.15.59:0/1487436220 shutdown_connections 2024-05-30T17:07:08.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1dbae00640 1 -- 172.21.15.59:0/1487436220 >> 172.21.15.59:0/1487436220 conn(0x7f1db40b1e60 msgr2=0x7f1db40b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:08.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1dbae00640 1 -- 172.21.15.59:0/1487436220 shutdown_connections 2024-05-30T17:07:08.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.759+0000 7f1dbae00640 1 -- 172.21.15.59:0/1487436220 wait complete. 2024-05-30T17:07:08.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-30T17:07:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.919+0000 7f1395000640 1 Processor -- start 2024-05-30T17:07:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.919+0000 7f1395000640 1 -- start start 2024-05-30T17:07:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1395000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f13900d14c0 0x7f139006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1395000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f13900d05b0 0x7f139009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1395000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f139006ea20 con 0x7f139009af80 2024-05-30T17:07:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1395000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f139009b3f0 con 0x7f13900d05b0 2024-05-30T17:07:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1395000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1390070950 con 0x7f13900d14c0 2024-05-30T17:07:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1385400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f13900d05b0 0x7f139009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1385400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f13900d05b0 0x7f139009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46272/0 (socket says 172.21.15.59:46272) 2024-05-30T17:07:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1385400640 1 -- 172.21.15.59:0/963603614 learned_addr learned my addr 172.21.15.59:0/963603614 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f138de00640 1 --2- 172.21.15.59:0/963603614 >> v2:172.21.15.107:3300/0 conn(0x7f13900d14c0 0x7f139006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1385400640 1 -- 172.21.15.59:0/963603614 >> v2:172.21.15.107:3300/0 conn(0x7f13900d14c0 msgr2=0x7f139006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1385400640 1 --2- 172.21.15.59:0/963603614 >> v2:172.21.15.107:3300/0 conn(0x7f13900d14c0 0x7f139006e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1385400640 1 -- 172.21.15.59:0/963603614 >> v1:172.21.15.107:6789/0 conn(0x7f139009af80 legacy=0x7f1390162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1385400640 1 -- 172.21.15.59:0/963603614 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1390070c30 con 0x7f13900d05b0 2024-05-30T17:07:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.923+0000 7f1385400640 1 --2- 172.21.15.59:0/963603614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13900d05b0 0x7f139009aa40 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f13900735d0 tx=0x7f137801c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8795a39e43fd7c4a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f138d400640 1 -- 172.21.15.59:0/963603614 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13780b0070 con 0x7f13900d05b0 2024-05-30T17:07:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f138d400640 1 -- 172.21.15.59:0/963603614 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13780ab600 con 0x7f13900d05b0 2024-05-30T17:07:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f138d400640 1 -- 172.21.15.59:0/963603614 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13780ab9d0 con 0x7f13900d05b0 2024-05-30T17:07:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 -- 172.21.15.59:0/963603614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13900d05b0 msgr2=0x7f139009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 --2- 172.21.15.59:0/963603614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13900d05b0 0x7f139009aa40 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f13900735d0 tx=0x7f137801c2d0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 -- 172.21.15.59:0/963603614 shutdown_connections 2024-05-30T17:07:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 --2- 172.21.15.59:0/963603614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13900d05b0 0x7f139009aa40 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 --2- 172.21.15.59:0/963603614 >> v2:172.21.15.107:3300/0 conn(0x7f13900d14c0 0x7f139006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 -- 172.21.15.59:0/963603614 >> 172.21.15.59:0/963603614 conn(0x7f13900b3f80 msgr2=0x7f13900b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 -- 172.21.15.59:0/963603614 shutdown_connections 2024-05-30T17:07:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 -- 172.21.15.59:0/963603614 wait complete. 2024-05-30T17:07:08.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 Processor -- start 2024-05-30T17:07:08.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 -- start start 2024-05-30T17:07:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f139009af80 0x7f13900b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13900d05b0 0x7f139015f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13900d14c0 0x7f139015f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f13900d18a0 con 0x7f13900d14c0 2024-05-30T17:07:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f13900d0a60 con 0x7f13900d05b0 2024-05-30T17:07:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1395000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f139006e100 con 0x7f139009af80 2024-05-30T17:07:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f138e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13900d14c0 0x7f139015f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f138de00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f139009af80 0x7f13900b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f138e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13900d14c0 0x7f139015f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46276/0 (socket says 172.21.15.59:46276) 2024-05-30T17:07:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f138e800640 1 -- 172.21.15.59:0/3535389279 learned_addr learned my addr 172.21.15.59:0/3535389279 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.927+0000 7f1385400640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13900d05b0 0x7f139015f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f138e800640 1 -- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f139009af80 msgr2=0x7f13900b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f138e800640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f139009af80 0x7f13900b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f138e800640 1 -- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13900d05b0 msgr2=0x7f139015f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f138e800640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13900d05b0 0x7f139015f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f138e800640 1 -- 172.21.15.59:0/3535389279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13900b6e70 con 0x7f13900d14c0 2024-05-30T17:07:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f138e800640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13900d14c0 0x7f139015f720 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f138800b410 tx=0x7f138800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f1386a00640 1 -- 172.21.15.59:0/3535389279 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388015020 con 0x7f13900d14c0 2024-05-30T17:07:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f1386a00640 1 -- 172.21.15.59:0/3535389279 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1388011870 con 0x7f13900d14c0 2024-05-30T17:07:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f1386a00640 1 -- 172.21.15.59:0/3535389279 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388011c60 con 0x7f13900d14c0 2024-05-30T17:07:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f1395000640 1 -- 172.21.15.59:0/3535389279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13900b7150 con 0x7f13900d14c0 2024-05-30T17:07:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f1395000640 1 -- 172.21.15.59:0/3535389279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13900b7710 con 0x7f13900d14c0 2024-05-30T17:07:08.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f1395000640 1 -- 172.21.15.59:0/3535389279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1390068a90 con 0x7f13900d14c0 2024-05-30T17:07:08.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f1386a00640 1 -- 172.21.15.59:0/3535389279 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f1388018020 con 0x7f13900d14c0 2024-05-30T17:07:08.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f1386a00640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f136c06a150 0x7f136c06c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:08.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.931+0000 7f1386a00640 1 -- 172.21.15.59:0/3535389279 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f1388085840 con 0x7f13900d14c0 2024-05-30T17:07:08.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.935+0000 7f138de00640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f136c06a150 0x7f136c06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:08.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.935+0000 7f138de00640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f136c06a150 0x7f136c06c610 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f1380003b90 tx=0x7f13800098d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:08.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:08.935+0000 7f1386a00640 1 -- 172.21.15.59:0/3535389279 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f138801f020 con 0x7f13900d14c0 2024-05-30T17:07:09.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.103+0000 7f1395000640 1 -- 172.21.15.59:0/3535389279 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f13900d2270 con 0x7f136c06a150 2024-05-30T17:07:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.103+0000 7f1386a00640 1 -- 172.21.15.59:0/3535389279 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f13900d2270 con 0x7f136c06a150 2024-05-30T17:07:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 5 to deep-scrub 2024-05-30T17:07:09.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.107+0000 7f1395000640 1 -- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f136c06a150 msgr2=0x7f136c06c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.107+0000 7f1395000640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f136c06a150 0x7f136c06c610 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f1380003b90 tx=0x7f13800098d0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.107+0000 7f1395000640 1 -- 172.21.15.59:0/3535389279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13900d14c0 msgr2=0x7f139015f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.107+0000 7f1395000640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13900d14c0 0x7f139015f720 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f138800b410 tx=0x7f138800b8d0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.107+0000 7f1395000640 1 -- 172.21.15.59:0/3535389279 shutdown_connections 2024-05-30T17:07:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.107+0000 7f1395000640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f136c06a150 0x7f136c06c610 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.107+0000 7f1395000640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13900d14c0 0x7f139015f720 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.107+0000 7f1395000640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13900d05b0 0x7f139015f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.107+0000 7f1395000640 1 --2- 172.21.15.59:0/3535389279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f139009af80 0x7f13900b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.107+0000 7f1395000640 1 -- 172.21.15.59:0/3535389279 >> 172.21.15.59:0/3535389279 conn(0x7f13900b3f80 msgr2=0x7f13900ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.107+0000 7f1395000640 1 -- 172.21.15.59:0/3535389279 shutdown_connections 2024-05-30T17:07:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.107+0000 7f1395000640 1 -- 172.21.15.59:0/3535389279 wait complete. 2024-05-30T17:07:09.128 INFO:tasks.ceph:Scrubbing osd.6 2024-05-30T17:07:09.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-30T17:07:09.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cc2200640 1 Processor -- start 2024-05-30T17:07:09.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cc2200640 1 -- start start 2024-05-30T17:07:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cc2200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3cbc156e40 0x7f3cbc06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cc2200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3cbc06dc60 0x7f3cbc15d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cc2200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cbc15db80 con 0x7f3cbc0af130 2024-05-30T17:07:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cc2200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3cbc06e120 con 0x7f3cbc156e40 2024-05-30T17:07:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cc2200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3cbc06e400 con 0x7f3cbc06dc60 2024-05-30T17:07:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cbbe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3cbc0af130 0x7f3cbc0af550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51758/0 (socket says 172.21.15.59:51758) 2024-05-30T17:07:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cbbe00640 1 -- 172.21.15.59:0/2549577882 learned_addr learned my addr 172.21.15.59:0/2549577882 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cbb400640 1 --2- 172.21.15.59:0/2549577882 >> v2:172.21.15.59:3300/0 conn(0x7f3cbc156e40 0x7f3cbc06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cb2a00640 1 --2- 172.21.15.59:0/2549577882 >> v2:172.21.15.107:3300/0 conn(0x7f3cbc06dc60 0x7f3cbc15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cbb400640 1 -- 172.21.15.59:0/2549577882 >> v2:172.21.15.107:3300/0 conn(0x7f3cbc06dc60 msgr2=0x7f3cbc15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cbb400640 1 --2- 172.21.15.59:0/2549577882 >> v2:172.21.15.107:3300/0 conn(0x7f3cbc06dc60 0x7f3cbc15d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cbb400640 1 -- 172.21.15.59:0/2549577882 >> v1:172.21.15.59:6789/0 conn(0x7f3cbc0af130 legacy=0x7f3cbc0af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cbb400640 1 -- 172.21.15.59:0/2549577882 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cbc06e6e0 con 0x7f3cbc156e40 2024-05-30T17:07:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.271+0000 7f3cbaa00640 1 -- 172.21.15.59:0/2549577882 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927905945 0 0) 0x7f3cb4001120 con 0x7f3cbc0af130 2024-05-30T17:07:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cb2a00640 1 --2- 172.21.15.59:0/2549577882 >> v2:172.21.15.107:3300/0 conn(0x7f3cbc06dc60 0x7f3cbc15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cbb400640 1 --2- 172.21.15.59:0/2549577882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc156e40 0x7f3cbc06f1c0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc06fa50 tx=0x7f3cac01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb7c9c637645cd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cbaa00640 1 -- 172.21.15.59:0/2549577882 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0b2070 con 0x7f3cbc156e40 2024-05-30T17:07:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cbaa00640 1 -- 172.21.15.59:0/2549577882 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cac0a58e0 con 0x7f3cbc156e40 2024-05-30T17:07:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cbaa00640 1 -- 172.21.15.59:0/2549577882 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0a5cb0 con 0x7f3cbc156e40 2024-05-30T17:07:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cc2200640 1 -- 172.21.15.59:0/2549577882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc156e40 msgr2=0x7f3cbc06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cc2200640 1 --2- 172.21.15.59:0/2549577882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc156e40 0x7f3cbc06f1c0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc06fa50 tx=0x7f3cac01c930 comp rx=0 tx=0).stop 2024-05-30T17:07:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cc2200640 1 -- 172.21.15.59:0/2549577882 shutdown_connections 2024-05-30T17:07:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cc2200640 1 --2- 172.21.15.59:0/2549577882 >> v2:172.21.15.107:3300/0 conn(0x7f3cbc06dc60 0x7f3cbc15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cc2200640 1 --2- 172.21.15.59:0/2549577882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc156e40 0x7f3cbc06f1c0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cc2200640 1 -- 172.21.15.59:0/2549577882 >> 172.21.15.59:0/2549577882 conn(0x7f3cbc0b1e60 msgr2=0x7f3cbc0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cc2200640 1 -- 172.21.15.59:0/2549577882 shutdown_connections 2024-05-30T17:07:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.275+0000 7f3cc2200640 1 -- 172.21.15.59:0/2549577882 wait complete. 2024-05-30T17:07:09.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cc2200640 1 Processor -- start 2024-05-30T17:07:09.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cc2200640 1 -- start start 2024-05-30T17:07:09.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cc2200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc06dc60 0x7f3cbc06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cc2200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cbc0af130 0x7f3cbc0993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cc2200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cbc156e40 0x7f3cbc155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cc2200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc15eb30 con 0x7f3cbc06dc60 2024-05-30T17:07:09.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cc2200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc15e9b0 con 0x7f3cbc156e40 2024-05-30T17:07:09.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cc2200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3cbc15be40 con 0x7f3cbc0af130 2024-05-30T17:07:09.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cbb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc06dc60 0x7f3cbc06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cbb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc06dc60 0x7f3cbc06f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46294/0 (socket says 172.21.15.59:46294) 2024-05-30T17:07:09.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cbb400640 1 -- 172.21.15.59:0/3555933514 learned_addr learned my addr 172.21.15.59:0/3555933514 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:09.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cbbe00640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cbc156e40 0x7f3cbc155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cb2a00640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cbc0af130 0x7f3cbc0993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cbb400640 1 -- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cbc0af130 msgr2=0x7f3cbc0993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cbb400640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cbc0af130 0x7f3cbc0993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cbb400640 1 -- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cbc156e40 msgr2=0x7f3cbc155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cbb400640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cbc156e40 0x7f3cbc155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cbb400640 1 -- 172.21.15.59:0/3555933514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cbc15c120 con 0x7f3cbc06dc60 2024-05-30T17:07:09.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cbb400640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc06dc60 0x7f3cbc06f1c0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0b0040 tx=0x7f3cac0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:09.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cb3e00640 1 -- 172.21.15.59:0/3555933514 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0bd020 con 0x7f3cbc06dc60 2024-05-30T17:07:09.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cb3e00640 1 -- 172.21.15.59:0/3555933514 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cac0b8690 con 0x7f3cbc06dc60 2024-05-30T17:07:09.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cb3e00640 1 -- 172.21.15.59:0/3555933514 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0b2040 con 0x7f3cbc06dc60 2024-05-30T17:07:09.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cc2200640 1 -- 172.21.15.59:0/3555933514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cbc160760 con 0x7f3cbc06dc60 2024-05-30T17:07:09.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.279+0000 7f3cc2200640 1 -- 172.21.15.59:0/3555933514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cbc072660 con 0x7f3cbc06dc60 2024-05-30T17:07:09.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.283+0000 7f3cc2200640 1 -- 172.21.15.59:0/3555933514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3cbc072a80 con 0x7f3cbc06dc60 2024-05-30T17:07:09.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.283+0000 7f3cb3e00640 1 -- 172.21.15.59:0/3555933514 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f3cac0c0020 con 0x7f3cbc06dc60 2024-05-30T17:07:09.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.283+0000 7f3cb3e00640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c9806a150 0x7f3c9806c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.283+0000 7f3cb3e00640 1 -- 172.21.15.59:0/3555933514 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f3cac120eb0 con 0x7f3cbc06dc60 2024-05-30T17:07:09.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.283+0000 7f3cb3e00640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] conn(0x7f3c980725b0 0x7f3c98074a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.283+0000 7f3cb3e00640 1 -- 172.21.15.59:0/3555933514 --> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3cac0afe90 con 0x7f3c980725b0 2024-05-30T17:07:09.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.283+0000 7f3cb3e00640 1 -- 172.21.15.59:0/3555933514 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f3cac121da0 con 0x7f3cbc06dc60 2024-05-30T17:07:09.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.283+0000 7f3cb2a00640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c9806a150 0x7f3c9806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.283+0000 7f3cbbe00640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] conn(0x7f3c980725b0 0x7f3c98074a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.283+0000 7f3cb2a00640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c9806a150 0x7f3c9806c610 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc155e60 tx=0x7f3ca4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:09.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.283+0000 7f3cbbe00640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] conn(0x7f3c980725b0 0x7f3c98074a50 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:09.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.287+0000 7f3cb3e00640 1 -- 172.21.15.59:0/3555933514 <== osd.6 v2:172.21.15.107:6800/518733335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3cac0afe90 con 0x7f3c980725b0 2024-05-30T17:07:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cc2200640 1 -- 172.21.15.59:0/3555933514 --> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3cbc068a90 con 0x7f3c980725b0 2024-05-30T17:07:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cb3e00640 1 -- 172.21.15.59:0/3555933514 <== osd.6 v2:172.21.15.107:6800/518733335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3cbc068a90 con 0x7f3c980725b0 2024-05-30T17:07:09.302 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:07:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T17:07:09.302 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:07:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cc2200640 1 -- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] conn(0x7f3c980725b0 msgr2=0x7f3c98074a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cc2200640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:6800/518733335,v1:172.21.15.107:6801/518733335] conn(0x7f3c980725b0 0x7f3c98074a50 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cc2200640 1 -- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c9806a150 msgr2=0x7f3c9806c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cc2200640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f3c9806a150 0x7f3c9806c610 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc155e60 tx=0x7f3ca4008040 comp rx=0 tx=0).stop 2024-05-30T17:07:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cc2200640 1 -- 172.21.15.59:0/3555933514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc06dc60 msgr2=0x7f3cbc06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cc2200640 1 --2- 172.21.15.59:0/3555933514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc06dc60 0x7f3cbc06f1c0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0b0040 tx=0x7f3cac0196d0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cbbe00640 1 -- 172.21.15.59:0/3555933514 reap_dead start 2024-05-30T17:07:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cc2200640 1 -- 172.21.15.59:0/3555933514 shutdown_connections 2024-05-30T17:07:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cc2200640 1 -- 172.21.15.59:0/3555933514 >> 172.21.15.59:0/3555933514 conn(0x7f3cbc0b1e60 msgr2=0x7f3cbc15c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cc2200640 1 -- 172.21.15.59:0/3555933514 shutdown_connections 2024-05-30T17:07:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.299+0000 7f3cc2200640 1 -- 172.21.15.59:0/3555933514 wait complete. 2024-05-30T17:07:09.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-30T17:07:09.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.463+0000 7f862c800640 1 Processor -- start 2024-05-30T17:07:09.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.463+0000 7f862c800640 1 -- start start 2024-05-30T17:07:09.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.463+0000 7f862c800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8624159df0 0x7f86240ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.463+0000 7f862c800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86240b3e50 0x7f86240ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.463+0000 7f862c800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f862415d730 con 0x7f862415a1d0 2024-05-30T17:07:09.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.463+0000 7f862c800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f86240b3370 con 0x7f8624159df0 2024-05-30T17:07:09.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.463+0000 7f862c800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f86240b3650 con 0x7f86240b3e50 2024-05-30T17:07:09.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.463+0000 7f8629e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8624159df0 0x7f86240ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.463+0000 7f8629400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f862415a1d0 0x7f862415ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51760/0 (socket says 172.21.15.59:51760) 2024-05-30T17:07:09.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.463+0000 7f8629400640 1 -- 172.21.15.59:0/3136038047 learned_addr learned my addr 172.21.15.59:0/3136038047 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:09.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.463+0000 7f862a800640 1 --2- 172.21.15.59:0/3136038047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86240b3e50 0x7f86240ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f8629e00640 1 -- 172.21.15.59:0/3136038047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86240b3e50 msgr2=0x7f86240ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f8629e00640 1 --2- 172.21.15.59:0/3136038047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86240b3e50 0x7f86240ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f8629e00640 1 -- 172.21.15.59:0/3136038047 >> v1:172.21.15.59:6789/0 conn(0x7f862415a1d0 legacy=0x7f862415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f8629e00640 1 -- 172.21.15.59:0/3136038047 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86240b3930 con 0x7f8624159df0 2024-05-30T17:07:09.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f8629e00640 1 --2- 172.21.15.59:0/3136038047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8624159df0 0x7f86240ad1b0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f86180097c0 tx=0x7f861801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1449c9b79f8d8c01 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:09.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f8628a00640 1 -- 172.21.15.59:0/3136038047 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86180b0070 con 0x7f8624159df0 2024-05-30T17:07:09.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f8628a00640 1 -- 172.21.15.59:0/3136038047 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86180ab600 con 0x7f8624159df0 2024-05-30T17:07:09.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f8628a00640 1 -- 172.21.15.59:0/3136038047 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86180ab9d0 con 0x7f8624159df0 2024-05-30T17:07:09.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f862c800640 1 -- 172.21.15.59:0/3136038047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8624159df0 msgr2=0x7f86240ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f862c800640 1 --2- 172.21.15.59:0/3136038047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8624159df0 0x7f86240ad1b0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f86180097c0 tx=0x7f861801c4a0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f862c800640 1 -- 172.21.15.59:0/3136038047 shutdown_connections 2024-05-30T17:07:09.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f862c800640 1 --2- 172.21.15.59:0/3136038047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86240b3e50 0x7f86240ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f862c800640 1 --2- 172.21.15.59:0/3136038047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8624159df0 0x7f86240ad1b0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f862c800640 1 -- 172.21.15.59:0/3136038047 >> 172.21.15.59:0/3136038047 conn(0x7f86240b22d0 msgr2=0x7f86240b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f862c800640 1 -- 172.21.15.59:0/3136038047 shutdown_connections 2024-05-30T17:07:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.467+0000 7f862c800640 1 -- 172.21.15.59:0/3136038047 wait complete. 2024-05-30T17:07:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f862c800640 1 Processor -- start 2024-05-30T17:07:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f862c800640 1 -- start start 2024-05-30T17:07:09.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f862c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240b3e50 0x7f8624149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f862c800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8624159df0 0x7f862415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f862c800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f862415a1d0 0x7f862415af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f862c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f862415e720 con 0x7f86240b3e50 2024-05-30T17:07:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f862c800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f862415e5a0 con 0x7f8624159df0 2024-05-30T17:07:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f862c800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f862415e8a0 con 0x7f862415a1d0 2024-05-30T17:07:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f8629e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240b3e50 0x7f8624149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f8629e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240b3e50 0x7f8624149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46326/0 (socket says 172.21.15.59:46326) 2024-05-30T17:07:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f8629e00640 1 -- 172.21.15.59:0/3129971594 learned_addr learned my addr 172.21.15.59:0/3129971594 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f8629400640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8624159df0 0x7f862415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f862a800640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f862415a1d0 0x7f862415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f8629e00640 1 -- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f862415a1d0 msgr2=0x7f862415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f8629e00640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f862415a1d0 0x7f862415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f8629e00640 1 -- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8624159df0 msgr2=0x7f862415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f8629e00640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8624159df0 0x7f862415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f8629e00640 1 -- 172.21.15.59:0/3129971594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8624166680 con 0x7f86240b3e50 2024-05-30T17:07:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f8629e00640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240b3e50 0x7f8624149560 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f86180ae040 tx=0x7f861801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f861e000640 1 -- 172.21.15.59:0/3129971594 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86180b0050 con 0x7f86240b3e50 2024-05-30T17:07:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f861e000640 1 -- 172.21.15.59:0/3129971594 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86180bc070 con 0x7f86240b3e50 2024-05-30T17:07:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f861e000640 1 -- 172.21.15.59:0/3129971594 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86180aac40 con 0x7f86240b3e50 2024-05-30T17:07:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f862c800640 1 -- 172.21.15.59:0/3129971594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8624166960 con 0x7f86240b3e50 2024-05-30T17:07:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.471+0000 7f862c800640 1 -- 172.21.15.59:0/3129971594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8624166f20 con 0x7f86240b3e50 2024-05-30T17:07:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.475+0000 7f862c800640 1 -- 172.21.15.59:0/3129971594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8624167160 con 0x7f86240b3e50 2024-05-30T17:07:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.475+0000 7f861e000640 1 -- 172.21.15.59:0/3129971594 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f86180c1460 con 0x7f86240b3e50 2024-05-30T17:07:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.475+0000 7f861e000640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f860806a150 0x7f860806c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.475+0000 7f861e000640 1 -- 172.21.15.59:0/3129971594 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f8618120420 con 0x7f86240b3e50 2024-05-30T17:07:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.475+0000 7f8629400640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f860806a150 0x7f860806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.475+0000 7f8629400640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f860806a150 0x7f860806c610 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f86241fafa0 tx=0x7f8614007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:09.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.479+0000 7f861e000640 1 -- 172.21.15.59:0/3129971594 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8624167160 con 0x7f86240b3e50 2024-05-30T17:07:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.647+0000 7f862c800640 1 -- 172.21.15.59:0/3129971594 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f8624156e50 con 0x7f860806a150 2024-05-30T17:07:09.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.647+0000 7f861e000640 1 -- 172.21.15.59:0/3129971594 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8624156e50 con 0x7f860806a150 2024-05-30T17:07:09.649 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 6 to deep-scrub 2024-05-30T17:07:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.651+0000 7f862c800640 1 -- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f860806a150 msgr2=0x7f860806c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.651+0000 7f862c800640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f860806a150 0x7f860806c610 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f86241fafa0 tx=0x7f8614007e90 comp rx=0 tx=0).stop 2024-05-30T17:07:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.651+0000 7f862c800640 1 -- 172.21.15.59:0/3129971594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240b3e50 msgr2=0x7f8624149560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.651+0000 7f862c800640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240b3e50 0x7f8624149560 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f86180ae040 tx=0x7f861801ace0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.651+0000 7f862c800640 1 -- 172.21.15.59:0/3129971594 shutdown_connections 2024-05-30T17:07:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.651+0000 7f862c800640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f860806a150 0x7f860806c610 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.651+0000 7f862c800640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f862415a1d0 0x7f862415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.651+0000 7f862c800640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8624159df0 0x7f862415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.651+0000 7f862c800640 1 --2- 172.21.15.59:0/3129971594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240b3e50 0x7f8624149560 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.651+0000 7f862c800640 1 -- 172.21.15.59:0/3129971594 >> 172.21.15.59:0/3129971594 conn(0x7f86240b22d0 msgr2=0x7f86240b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:09.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.651+0000 7f862c800640 1 -- 172.21.15.59:0/3129971594 shutdown_connections 2024-05-30T17:07:09.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.651+0000 7f862c800640 1 -- 172.21.15.59:0/3129971594 wait complete. 2024-05-30T17:07:09.671 INFO:tasks.ceph:Scrubbing osd.7 2024-05-30T17:07:09.671 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-30T17:07:09.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a0ce00640 1 Processor -- start 2024-05-30T17:07:09.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a0ce00640 1 -- start start 2024-05-30T17:07:09.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a0ce00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4a0815b4b0 0x7f4a080b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a0ce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a080b4800 0x7f4a080b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a0ce00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0815c720 con 0x7f4a080b5350 2024-05-30T17:07:09.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a0ce00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4a0815ca00 con 0x7f4a0815b4b0 2024-05-30T17:07:09.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a0ce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0815cce0 con 0x7f4a080b4800 2024-05-30T17:07:09.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a06800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4a080b5350 0x7f4a0815f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51770/0 (socket says 172.21.15.59:51770) 2024-05-30T17:07:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a06800640 1 -- 172.21.15.59:0/1899370334 learned_addr learned my addr 172.21.15.59:0/1899370334 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a05e00640 1 --2- 172.21.15.59:0/1899370334 >> v2:172.21.15.107:3300/0 conn(0x7f4a0815b4b0 0x7f4a080b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a05400640 1 --2- 172.21.15.59:0/1899370334 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a080b4800 0x7f4a080b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a04a00640 1 -- 172.21.15.59:0/1899370334 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449554883 0 0) 0x7f4a0815c720 con 0x7f4a080b5350 2024-05-30T17:07:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a04a00640 1 -- 172.21.15.59:0/1899370334 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49ec003530 con 0x7f4a080b5350 2024-05-30T17:07:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a05e00640 1 -- 172.21.15.59:0/1899370334 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a080b4800 msgr2=0x7f4a080b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a05e00640 1 --2- 172.21.15.59:0/1899370334 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a080b4800 0x7f4a080b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a04a00640 1 -- 172.21.15.59:0/1899370334 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 710931115 0 0) 0x7f49ec003530 con 0x7f4a080b5350 2024-05-30T17:07:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a05e00640 1 -- 172.21.15.59:0/1899370334 >> v1:172.21.15.59:6789/0 conn(0x7f4a080b5350 legacy=0x7f4a0815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.815+0000 7f4a05e00640 1 -- 172.21.15.59:0/1899370334 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0815cfc0 con 0x7f4a0815b4b0 2024-05-30T17:07:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.819+0000 7f4a05e00640 1 --2- 172.21.15.59:0/1899370334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a0815b4b0 0x7f4a080b42c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f49f80097c0 tx=0x7f49f801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d04d1f49ad6d84e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.819+0000 7f4a04a00640 1 -- 172.21.15.59:0/1899370334 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f80b0070 con 0x7f4a0815b4b0 2024-05-30T17:07:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.819+0000 7f4a04a00640 1 -- 172.21.15.59:0/1899370334 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f80ab400 con 0x7f4a0815b4b0 2024-05-30T17:07:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.819+0000 7f4a04a00640 1 -- 172.21.15.59:0/1899370334 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00001a00 con 0x7f4a0815b4b0 2024-05-30T17:07:09.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.819+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1899370334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a0815b4b0 msgr2=0x7f4a080b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.819+0000 7f4a0ce00640 1 --2- 172.21.15.59:0/1899370334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a0815b4b0 0x7f4a080b42c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f49f80097c0 tx=0x7f49f801c3c0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.819+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1899370334 shutdown_connections 2024-05-30T17:07:09.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.819+0000 7f4a0ce00640 1 --2- 172.21.15.59:0/1899370334 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a080b4800 0x7f4a080b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.819+0000 7f4a0ce00640 1 --2- 172.21.15.59:0/1899370334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a0815b4b0 0x7f4a080b42c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.819+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1899370334 >> 172.21.15.59:0/1899370334 conn(0x7f4a0809aa40 msgr2=0x7f4a080b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:09.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.819+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1899370334 shutdown_connections 2024-05-30T17:07:09.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.819+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1899370334 wait complete. 2024-05-30T17:07:09.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a0ce00640 1 Processor -- start 2024-05-30T17:07:09.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a0ce00640 1 -- start start 2024-05-30T17:07:09.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a0ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a080b4800 0x7f4a08146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a0ce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a080b5350 0x7f4a081441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a0ce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a0815b4b0 0x7f4a08151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a0ce00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0806bd40 con 0x7f4a080b4800 2024-05-30T17:07:09.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a0ce00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0806bbc0 con 0x7f4a080b5350 2024-05-30T17:07:09.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a0ce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0806bec0 con 0x7f4a0815b4b0 2024-05-30T17:07:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a05e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a080b4800 0x7f4a08146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a05e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a080b4800 0x7f4a08146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46328/0 (socket says 172.21.15.59:46328) 2024-05-30T17:07:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a05e00640 1 -- 172.21.15.59:0/1409019741 learned_addr learned my addr 172.21.15.59:0/1409019741 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a05400640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a080b5350 0x7f4a081441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a06800640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a0815b4b0 0x7f4a08151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a05e00640 1 -- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a0815b4b0 msgr2=0x7f4a08151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a05e00640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a0815b4b0 0x7f4a08151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a05e00640 1 -- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a080b5350 msgr2=0x7f4a081441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a05e00640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a080b5350 0x7f4a081441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a05e00640 1 -- 172.21.15.59:0/1409019741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a081455c0 con 0x7f4a080b4800 2024-05-30T17:07:09.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a05e00640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a080b4800 0x7f4a08146660 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f49f801aa70 tx=0x7f49f801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:09.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f49fe000640 1 -- 172.21.15.59:0/1409019741 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f80b0050 con 0x7f4a080b4800 2024-05-30T17:07:09.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f49fe000640 1 -- 172.21.15.59:0/1409019741 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f80bc070 con 0x7f4a080b4800 2024-05-30T17:07:09.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f49fe000640 1 -- 172.21.15.59:0/1409019741 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f80b78b0 con 0x7f4a080b4800 2024-05-30T17:07:09.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1409019741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a081458a0 con 0x7f4a080b4800 2024-05-30T17:07:09.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.823+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1409019741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a08145e60 con 0x7f4a080b4800 2024-05-30T17:07:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.827+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1409019741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4a08068a90 con 0x7f4a080b4800 2024-05-30T17:07:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.827+0000 7f49fe000640 1 -- 172.21.15.59:0/1409019741 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f49f80b7a50 con 0x7f4a080b4800 2024-05-30T17:07:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.827+0000 7f49fe000640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49e806a180 0x7f49e806c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.827+0000 7f49fe000640 1 -- 172.21.15.59:0/1409019741 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f49f8120870 con 0x7f4a080b4800 2024-05-30T17:07:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.827+0000 7f4a05400640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49e806a180 0x7f49e806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.827+0000 7f49fe000640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] conn(0x7f49e80725e0 0x7f49e8074a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.827+0000 7f49fe000640 1 -- 172.21.15.59:0/1409019741 --> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49f8008eb0 con 0x7f49e80725e0 2024-05-30T17:07:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.827+0000 7f49fe000640 1 -- 172.21.15.59:0/1409019741 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f49f8121870 con 0x7f4a080b4800 2024-05-30T17:07:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.827+0000 7f4a06800640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] conn(0x7f49e80725e0 0x7f49e8074a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.827+0000 7f4a05400640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49e806a180 0x7f49e806c640 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4a08148e10 tx=0x7f49f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.831+0000 7f4a06800640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] conn(0x7f49e80725e0 0x7f49e8074a80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.831+0000 7f49fe000640 1 -- 172.21.15.59:0/1409019741 <== osd.7 v2:172.21.15.107:6824/3952746286 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49f8008eb0 con 0x7f49e80725e0 2024-05-30T17:07:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1409019741 --> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4a081597e0 con 0x7f49e80725e0 2024-05-30T17:07:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f49fe000640 1 -- 172.21.15.59:0/1409019741 <== osd.7 v2:172.21.15.107:6824/3952746286 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4a081597e0 con 0x7f49e80725e0 2024-05-30T17:07:09.846 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-05-30T17:07:09.846 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T17:07:09.846 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-05-30T17:07:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] conn(0x7f49e80725e0 msgr2=0x7f49e8074a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f4a0ce00640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:6824/3952746286,v1:172.21.15.107:6825/3952746286] conn(0x7f49e80725e0 0x7f49e8074a80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49e806a180 msgr2=0x7f49e806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f4a0ce00640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f49e806a180 0x7f49e806c640 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4a08148e10 tx=0x7f49f4008040 comp rx=0 tx=0).stop 2024-05-30T17:07:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1409019741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a080b4800 msgr2=0x7f4a08146660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f4a0ce00640 1 --2- 172.21.15.59:0/1409019741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a080b4800 0x7f4a08146660 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f49f801aa70 tx=0x7f49f801ac00 comp rx=0 tx=0).stop 2024-05-30T17:07:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f4a06800640 1 -- 172.21.15.59:0/1409019741 reap_dead start 2024-05-30T17:07:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1409019741 shutdown_connections 2024-05-30T17:07:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1409019741 >> 172.21.15.59:0/1409019741 conn(0x7f4a0809aa40 msgr2=0x7f4a0806c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1409019741 shutdown_connections 2024-05-30T17:07:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:09.843+0000 7f4a0ce00640 1 -- 172.21.15.59:0/1409019741 wait complete. 2024-05-30T17:07:09.864 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-30T17:07:10.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1769400640 1 Processor -- start 2024-05-30T17:07:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1769400640 1 -- start start 2024-05-30T17:07:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1769400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17640af720 0x7f176415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1769400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f176406e900 0x7f176415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1769400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f176415f060 con 0x7f17640d0560 2024-05-30T17:07:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1769400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f17640afb00 con 0x7f17640af720 2024-05-30T17:07:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1769400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f176415c270 con 0x7f176406e900 2024-05-30T17:07:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1762800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17640af720 0x7f176415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1763200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f17640d0560 0x7f1764072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51774/0 (socket says 172.21.15.59:51774) 2024-05-30T17:07:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1763200640 1 -- 172.21.15.59:0/696515386 learned_addr learned my addr 172.21.15.59:0/696515386 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f175be00640 1 --2- 172.21.15.59:0/696515386 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f176406e900 0x7f176415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1762800640 1 -- 172.21.15.59:0/696515386 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f176406e900 msgr2=0x7f176415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1762800640 1 --2- 172.21.15.59:0/696515386 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f176406e900 0x7f176415f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1762800640 1 -- 172.21.15.59:0/696515386 >> v1:172.21.15.59:6789/0 conn(0x7f17640d0560 legacy=0x7f1764072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:10.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1762800640 1 -- 172.21.15.59:0/696515386 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176415c550 con 0x7f17640af720 2024-05-30T17:07:10.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.007+0000 7f1761e00640 1 -- 172.21.15.59:0/696515386 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860997508 0 0) 0x7f176415f060 con 0x7f17640d0560 2024-05-30T17:07:10.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1762800640 1 --2- 172.21.15.59:0/696515386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17640af720 0x7f176415b9d0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f17540097c0 tx=0x7f175401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af9785374b1ed25 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:10.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1761e00640 1 -- 172.21.15.59:0/696515386 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17540aa5f0 con 0x7f17640af720 2024-05-30T17:07:10.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1761e00640 1 -- 172.21.15.59:0/696515386 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17540af070 con 0x7f17640af720 2024-05-30T17:07:10.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1761e00640 1 -- 172.21.15.59:0/696515386 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17540aa9b0 con 0x7f17640af720 2024-05-30T17:07:10.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1769400640 1 -- 172.21.15.59:0/696515386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17640af720 msgr2=0x7f176415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:10.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1769400640 1 --2- 172.21.15.59:0/696515386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17640af720 0x7f176415b9d0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f17540097c0 tx=0x7f175401c470 comp rx=0 tx=0).stop 2024-05-30T17:07:10.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1769400640 1 -- 172.21.15.59:0/696515386 shutdown_connections 2024-05-30T17:07:10.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1769400640 1 --2- 172.21.15.59:0/696515386 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f176406e900 0x7f176415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1769400640 1 --2- 172.21.15.59:0/696515386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17640af720 0x7f176415b9d0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1769400640 1 -- 172.21.15.59:0/696515386 >> 172.21.15.59:0/696515386 conn(0x7f17640b22d0 msgr2=0x7f17640b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:10.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1769400640 1 -- 172.21.15.59:0/696515386 shutdown_connections 2024-05-30T17:07:10.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1769400640 1 -- 172.21.15.59:0/696515386 wait complete. 2024-05-30T17:07:10.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1769400640 1 Processor -- start 2024-05-30T17:07:10.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.011+0000 7f1769400640 1 -- start start 2024-05-30T17:07:10.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1769400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176406e900 0x7f17640b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1769400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17640af720 0x7f1764154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1769400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17640d0560 0x7f1764158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1769400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f176415fd30 con 0x7f176406e900 2024-05-30T17:07:10.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1769400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f176415c830 con 0x7f17640af720 2024-05-30T17:07:10.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1769400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f176415feb0 con 0x7f17640d0560 2024-05-30T17:07:10.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1762800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176406e900 0x7f17640b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1762800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176406e900 0x7f17640b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46346/0 (socket says 172.21.15.59:46346) 2024-05-30T17:07:10.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1762800640 1 -- 172.21.15.59:0/2354232022 learned_addr learned my addr 172.21.15.59:0/2354232022 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:10.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f175be00640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17640af720 0x7f1764154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1763200640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17640d0560 0x7f1764158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1762800640 1 -- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17640d0560 msgr2=0x7f1764158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1762800640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17640d0560 0x7f1764158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1762800640 1 -- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17640af720 msgr2=0x7f1764154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1762800640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17640af720 0x7f1764154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1762800640 1 -- 172.21.15.59:0/2354232022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17641f7a90 con 0x7f176406e900 2024-05-30T17:07:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1763200640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17640d0560 0x7f1764158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1762800640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176406e900 0x7f17640b0ee0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f17540ac040 tx=0x7f175401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f175aa00640 1 -- 172.21.15.59:0/2354232022 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17540be610 con 0x7f176406e900 2024-05-30T17:07:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f175aa00640 1 -- 172.21.15.59:0/2354232022 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17540be7f0 con 0x7f176406e900 2024-05-30T17:07:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f175aa00640 1 -- 172.21.15.59:0/2354232022 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17540bebe0 con 0x7f176406e900 2024-05-30T17:07:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1769400640 1 -- 172.21.15.59:0/2354232022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1764159cc0 con 0x7f176406e900 2024-05-30T17:07:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1769400640 1 -- 172.21.15.59:0/2354232022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f176415a280 con 0x7f176406e900 2024-05-30T17:07:10.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.015+0000 7f1769400640 1 -- 172.21.15.59:0/2354232022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1764068a90 con 0x7f176406e900 2024-05-30T17:07:10.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.019+0000 7f175aa00640 1 -- 172.21.15.59:0/2354232022 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f17540bc020 con 0x7f176406e900 2024-05-30T17:07:10.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.019+0000 7f175aa00640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f174006a150 0x7f174006c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.019+0000 7f175aa00640 1 -- 172.21.15.59:0/2354232022 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f175411fb40 con 0x7f176406e900 2024-05-30T17:07:10.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.019+0000 7f175be00640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f174006a150 0x7f174006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.019+0000 7f175be00640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f174006a150 0x7f174006c610 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f17641659b0 tx=0x7f174c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:10.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.023+0000 7f175aa00640 1 -- 172.21.15.59:0/2354232022 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f17540c5030 con 0x7f176406e900 2024-05-30T17:07:10.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.215+0000 7f1769400640 1 -- 172.21.15.59:0/2354232022 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f176415b2b0 con 0x7f174006a150 2024-05-30T17:07:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.215+0000 7f175aa00640 1 -- 172.21.15.59:0/2354232022 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f176415b2b0 con 0x7f174006a150 2024-05-30T17:07:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 7 to deep-scrub 2024-05-30T17:07:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.215+0000 7f1769400640 1 -- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f174006a150 msgr2=0x7f174006c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.215+0000 7f1769400640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f174006a150 0x7f174006c610 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f17641659b0 tx=0x7f174c008040 comp rx=0 tx=0).stop 2024-05-30T17:07:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.215+0000 7f1769400640 1 -- 172.21.15.59:0/2354232022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176406e900 msgr2=0x7f17640b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.215+0000 7f1769400640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176406e900 0x7f17640b0ee0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f17540ac040 tx=0x7f175401acb0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.219+0000 7f1769400640 1 -- 172.21.15.59:0/2354232022 shutdown_connections 2024-05-30T17:07:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.219+0000 7f1769400640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f174006a150 0x7f174006c610 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.219+0000 7f1769400640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17640d0560 0x7f1764158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.219+0000 7f1769400640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17640af720 0x7f1764154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.219+0000 7f1769400640 1 --2- 172.21.15.59:0/2354232022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176406e900 0x7f17640b0ee0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.219+0000 7f1769400640 1 -- 172.21.15.59:0/2354232022 >> 172.21.15.59:0/2354232022 conn(0x7f17640b22d0 msgr2=0x7f17640b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.219+0000 7f1769400640 1 -- 172.21.15.59:0/2354232022 shutdown_connections 2024-05-30T17:07:10.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.219+0000 7f1769400640 1 -- 172.21.15.59:0/2354232022 wait complete. 2024-05-30T17:07:10.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:07:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.379+0000 7f4a6ca00640 1 Processor -- start 2024-05-30T17:07:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.379+0000 7f4a6ca00640 1 -- start start 2024-05-30T17:07:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a6ca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a68159df0 0x7f4a680ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a6ca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4a6815a1d0 0x7f4a680ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a6ca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a680b3e50 0x7f4a6815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a6ca00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4a6815d730 con 0x7f4a680b3e50 2024-05-30T17:07:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a6ca00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4a680b3370 con 0x7f4a6815a1d0 2024-05-30T17:07:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a6ca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4a680b3650 con 0x7f4a68159df0 2024-05-30T17:07:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a66800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a680b3e50 0x7f4a6815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a66800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a680b3e50 0x7f4a6815ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46354/0 (socket says 172.21.15.59:46354) 2024-05-30T17:07:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a65e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a68159df0 0x7f4a680ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a66800640 1 -- 172.21.15.59:0/1755960018 learned_addr learned my addr 172.21.15.59:0/1755960018 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a5d400640 1 --2- 172.21.15.59:0/1755960018 >> v2:172.21.15.107:3300/0 conn(0x7f4a6815a1d0 0x7f4a680ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a66800640 1 -- 172.21.15.59:0/1755960018 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a68159df0 msgr2=0x7f4a680ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a66800640 1 --2- 172.21.15.59:0/1755960018 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a68159df0 0x7f4a680ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a66800640 1 -- 172.21.15.59:0/1755960018 >> v2:172.21.15.107:3300/0 conn(0x7f4a6815a1d0 msgr2=0x7f4a680ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a66800640 1 --2- 172.21.15.59:0/1755960018 >> v2:172.21.15.107:3300/0 conn(0x7f4a6815a1d0 0x7f4a680ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a66800640 1 -- 172.21.15.59:0/1755960018 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a680b3930 con 0x7f4a680b3e50 2024-05-30T17:07:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.383+0000 7f4a66800640 1 --2- 172.21.15.59:0/1755960018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a680b3e50 0x7f4a6815ca70 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f4a680b3580 tx=0x7f4a6001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b82e9491163d0a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a65400640 1 -- 172.21.15.59:0/1755960018 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a600ab5f0 con 0x7f4a680b3e50 2024-05-30T17:07:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a65400640 1 -- 172.21.15.59:0/1755960018 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a600b0070 con 0x7f4a680b3e50 2024-05-30T17:07:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a65400640 1 -- 172.21.15.59:0/1755960018 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a600ab9b0 con 0x7f4a680b3e50 2024-05-30T17:07:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 -- 172.21.15.59:0/1755960018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a680b3e50 msgr2=0x7f4a6815ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 --2- 172.21.15.59:0/1755960018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a680b3e50 0x7f4a6815ca70 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f4a680b3580 tx=0x7f4a6001c520 comp rx=0 tx=0).stop 2024-05-30T17:07:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 -- 172.21.15.59:0/1755960018 shutdown_connections 2024-05-30T17:07:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 --2- 172.21.15.59:0/1755960018 >> v2:172.21.15.107:3300/0 conn(0x7f4a6815a1d0 0x7f4a680ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 --2- 172.21.15.59:0/1755960018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a680b3e50 0x7f4a6815ca70 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 --2- 172.21.15.59:0/1755960018 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a68159df0 0x7f4a680ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 -- 172.21.15.59:0/1755960018 >> 172.21.15.59:0/1755960018 conn(0x7f4a680b22d0 msgr2=0x7f4a680b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:10.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 -- 172.21.15.59:0/1755960018 shutdown_connections 2024-05-30T17:07:10.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 -- 172.21.15.59:0/1755960018 wait complete. 2024-05-30T17:07:10.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 Processor -- start 2024-05-30T17:07:10.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 -- start start 2024-05-30T17:07:10.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a680b3e50 0x7f4a6814c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a68159df0 0x7f4a68073540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a6815a1d0 0x7f4a68158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6815e720 con 0x7f4a68159df0 2024-05-30T17:07:10.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6815e5a0 con 0x7f4a6815a1d0 2024-05-30T17:07:10.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a6ca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4a6815e8a0 con 0x7f4a680b3e50 2024-05-30T17:07:10.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a5d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a68159df0 0x7f4a68073540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a5d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a68159df0 0x7f4a68073540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46370/0 (socket says 172.21.15.59:46370) 2024-05-30T17:07:10.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.387+0000 7f4a5d400640 1 -- 172.21.15.59:0/3546087578 learned_addr learned my addr 172.21.15.59:0/3546087578 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:10.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a66800640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a6815a1d0 0x7f4a68158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a65e00640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a680b3e50 0x7f4a6814c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a5d400640 1 -- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a680b3e50 msgr2=0x7f4a6814c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:10.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a5d400640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a680b3e50 0x7f4a6814c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a5d400640 1 -- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a6815a1d0 msgr2=0x7f4a68158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:10.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a5d400640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a6815a1d0 0x7f4a68158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a5d400640 1 -- 172.21.15.59:0/3546087578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6815eff0 con 0x7f4a68159df0 2024-05-30T17:07:10.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a66800640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a6815a1d0 0x7f4a68158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:07:10.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a65e00640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a680b3e50 0x7f4a6814c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T17:07:10.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a5d400640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a68159df0 0x7f4a68073540 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000efc0 tx=0x7f4a5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:10.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a5ea00640 1 -- 172.21.15.59:0/3546087578 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50018020 con 0x7f4a68159df0 2024-05-30T17:07:10.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a5ea00640 1 -- 172.21.15.59:0/3546087578 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a50014480 con 0x7f4a68159df0 2024-05-30T17:07:10.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a5ea00640 1 -- 172.21.15.59:0/3546087578 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50014830 con 0x7f4a68159df0 2024-05-30T17:07:10.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a6ca00640 1 -- 172.21.15.59:0/3546087578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a68072990 con 0x7f4a68159df0 2024-05-30T17:07:10.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a6ca00640 1 -- 172.21.15.59:0/3546087578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a6814ca30 con 0x7f4a68159df0 2024-05-30T17:07:10.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a6ca00640 1 -- 172.21.15.59:0/3546087578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a68068a90 con 0x7f4a68159df0 2024-05-30T17:07:10.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a5ea00640 1 -- 172.21.15.59:0/3546087578 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 46) ==== 90690+0+0 (secure 0 0 0) 0x7f4a5001b020 con 0x7f4a68159df0 2024-05-30T17:07:10.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a5ea00640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a4406a150 0x7f4a4406c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:10.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.391+0000 7f4a5ea00640 1 -- 172.21.15.59:0/3546087578 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f4a50086710 con 0x7f4a68159df0 2024-05-30T17:07:10.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.395+0000 7f4a65e00640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a4406a150 0x7f4a4406c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:10.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.395+0000 7f4a65e00640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a4406a150 0x7f4a4406c610 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009a40 tx=0x7f4a58008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:10.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.399+0000 7f4a5ea00640 1 -- 172.21.15.59:0/3546087578 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4a50022030 con 0x7f4a68159df0 2024-05-30T17:07:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.559+0000 7f4a6ca00640 1 -- 172.21.15.59:0/3546087578 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a6814cca0 con 0x7f4a4406a150 2024-05-30T17:07:10.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.567+0000 7f4a5ea00640 1 -- 172.21.15.59:0/3546087578 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253988 (secure 0 0 0) 0x7f4a6814cca0 con 0x7f4a4406a150 2024-05-30T17:07:10.571 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:07:10.572 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:07:10.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.571+0000 7f4a6ca00640 1 -- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a4406a150 msgr2=0x7f4a4406c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.571+0000 7f4a6ca00640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a4406a150 0x7f4a4406c610 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009a40 tx=0x7f4a58008040 comp rx=0 tx=0).stop 2024-05-30T17:07:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.571+0000 7f4a6ca00640 1 -- 172.21.15.59:0/3546087578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a68159df0 msgr2=0x7f4a68073540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.571+0000 7f4a6ca00640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a68159df0 0x7f4a68073540 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000efc0 tx=0x7f4a5000c490 comp rx=0 tx=0).stop 2024-05-30T17:07:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.571+0000 7f4a6ca00640 1 -- 172.21.15.59:0/3546087578 shutdown_connections 2024-05-30T17:07:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.571+0000 7f4a6ca00640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f4a4406a150 0x7f4a4406c610 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.571+0000 7f4a6ca00640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a6815a1d0 0x7f4a68158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.571+0000 7f4a6ca00640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a68159df0 0x7f4a68073540 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.571+0000 7f4a6ca00640 1 --2- 172.21.15.59:0/3546087578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a680b3e50 0x7f4a6814c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:10.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.571+0000 7f4a6ca00640 1 -- 172.21.15.59:0/3546087578 >> 172.21.15.59:0/3546087578 conn(0x7f4a680b22d0 msgr2=0x7f4a680af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:10.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.571+0000 7f4a6ca00640 1 -- 172.21.15.59:0/3546087578 shutdown_connections 2024-05-30T17:07:10.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:10.571+0000 7f4a6ca00640 1 -- 172.21.15.59:0/3546087578 wait complete. 2024-05-30T17:07:10.591 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":675,"stamp":"2024-05-30T17:07:09.437307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":17408645220,"num_objects":4183,"num_object_clones":1,"num_object_copies":8366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4183,"num_whiteouts":1,"num_read":4157,"num_read_kb":16171201,"num_write":6088,"num_write_kb":19198217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9505,"ondisk_log_size":9505,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":35123912,"kb_used_data":34014280,"kb_used_omap":12,"kb_used_meta":1109555,"kb_avail":719850808,"statfs":{"total":773094113280,"available":737127227392,"internally_reserved":0,"allocated":34830622720,"data_stored":34823115232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1136184880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003671"},"pg_stats":[{"pgid":"19.3f","version":"133'147","reported_seq":237,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073566+0000","last_change":"2024-05-30T17:04:48.466651+0000","last_active":"2024-05-30T17:07:02.073566+0000","last_peered":"2024-05-30T17:07:02.073566+0000","last_clean":"2024-05-30T17:07:02.073566+0000","last_became_active":"2024-05-30T17:04:48.283571+0000","last_became_peered":"2024-05-30T17:04:48.283571+0000","last_unstale":"2024-05-30T17:07:02.073566+0000","last_undegraded":"2024-05-30T17:07:02.073566+0000","last_fullsized":"2024-05-30T17:07:02.073566+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":80,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3e","version":"133'152","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.080238+0000","last_change":"2024-05-30T17:04:27.651522+0000","last_active":"2024-05-30T17:07:02.080238+0000","last_peered":"2024-05-30T17:07:02.080238+0000","last_clean":"2024-05-30T17:07:02.080238+0000","last_became_active":"2024-05-30T17:04:27.649831+0000","last_became_peered":"2024-05-30T17:04:27.649831+0000","last_unstale":"2024-05-30T17:07:02.080238+0000","last_undegraded":"2024-05-30T17:07:02.080238+0000","last_fullsized":"2024-05-30T17:07:02.080238+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":92,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"133'142","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074186+0000","last_change":"2024-05-30T17:04:27.662273+0000","last_active":"2024-05-30T17:07:02.074186+0000","last_peered":"2024-05-30T17:07:02.074186+0000","last_clean":"2024-05-30T17:07:02.074186+0000","last_became_active":"2024-05-30T17:04:27.661891+0000","last_became_peered":"2024-05-30T17:04:27.661891+0000","last_unstale":"2024-05-30T17:07:02.074186+0000","last_undegraded":"2024-05-30T17:07:02.074186+0000","last_fullsized":"2024-05-30T17:07:02.074186+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:37.192613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":68,"num_read_kb":253958,"num_write":88,"num_write_kb":307203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"133'140","reported_seq":203,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074602+0000","last_change":"2024-05-30T17:04:27.655790+0000","last_active":"2024-05-30T17:07:02.074602+0000","last_peered":"2024-05-30T17:07:02.074602+0000","last_clean":"2024-05-30T17:07:02.074602+0000","last_became_active":"2024-05-30T17:04:27.655516+0000","last_became_peered":"2024-05-30T17:04:27.655516+0000","last_unstale":"2024-05-30T17:07:02.074602+0000","last_undegraded":"2024-05-30T17:07:02.074602+0000","last_fullsized":"2024-05-30T17:07:02.074602+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:21.860246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":46,"num_read_kb":176131,"num_write":84,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"133'129","reported_seq":184,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.056843+0000","last_change":"2024-05-30T17:04:27.668225+0000","last_active":"2024-05-30T17:07:02.056843+0000","last_peered":"2024-05-30T17:07:02.056843+0000","last_clean":"2024-05-30T17:07:02.056843+0000","last_became_active":"2024-05-30T17:04:27.667959+0000","last_became_peered":"2024-05-30T17:04:27.667959+0000","last_unstale":"2024-05-30T17:07:02.056843+0000","last_undegraded":"2024-05-30T17:07:02.056843+0000","last_fullsized":"2024-05-30T17:07:02.056843+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:36:36.807585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":38,"num_read_kb":155648,"num_write":75,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"133'150","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.080422+0000","last_change":"2024-05-30T17:04:27.662557+0000","last_active":"2024-05-30T17:07:02.080422+0000","last_peered":"2024-05-30T17:07:02.080422+0000","last_clean":"2024-05-30T17:07:02.080422+0000","last_became_active":"2024-05-30T17:04:27.662304+0000","last_became_peered":"2024-05-30T17:04:27.662304+0000","last_unstale":"2024-05-30T17:07:02.080422+0000","last_undegraded":"2024-05-30T17:07:02.080422+0000","last_fullsized":"2024-05-30T17:07:02.080422+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:23.592124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":94,"num_write_kb":352257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"133'148","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073252+0000","last_change":"2024-05-30T17:04:27.650438+0000","last_active":"2024-05-30T17:07:02.073252+0000","last_peered":"2024-05-30T17:07:02.073252+0000","last_clean":"2024-05-30T17:07:02.073252+0000","last_became_active":"2024-05-30T17:04:27.649935+0000","last_became_peered":"2024-05-30T17:04:27.649935+0000","last_unstale":"2024-05-30T17:07:02.073252+0000","last_undegraded":"2024-05-30T17:07:02.073252+0000","last_fullsized":"2024-05-30T17:07:02.073252+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:53.659379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":47,"num_read_kb":192512,"num_write":78,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"133'122","reported_seq":190,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072168+0000","last_change":"2024-05-30T17:04:27.654259+0000","last_active":"2024-05-30T17:07:02.072168+0000","last_peered":"2024-05-30T17:07:02.072168+0000","last_clean":"2024-05-30T17:07:02.072168+0000","last_became_active":"2024-05-30T17:04:27.653784+0000","last_became_peered":"2024-05-30T17:04:27.653784+0000","last_unstale":"2024-05-30T17:07:02.072168+0000","last_undegraded":"2024-05-30T17:07:02.072168+0000","last_fullsized":"2024-05-30T17:07:02.072168+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:33:17.272892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":91,"num_write_kb":331776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"133'138","reported_seq":205,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.064343+0000","last_change":"2024-05-30T17:04:27.667692+0000","last_active":"2024-05-30T17:07:02.064343+0000","last_peered":"2024-05-30T17:07:02.064343+0000","last_clean":"2024-05-30T17:07:02.064343+0000","last_became_active":"2024-05-30T17:04:27.667374+0000","last_became_peered":"2024-05-30T17:04:27.667374+0000","last_unstale":"2024-05-30T17:07:02.064343+0000","last_undegraded":"2024-05-30T17:07:02.064343+0000","last_fullsized":"2024-05-30T17:07:02.064343+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:28:23.592124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":50,"num_read_kb":204800,"num_write":77,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"133'130","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.077894+0000","last_change":"2024-05-30T17:04:27.649118+0000","last_active":"2024-05-30T17:07:02.077894+0000","last_peered":"2024-05-30T17:07:02.077894+0000","last_clean":"2024-05-30T17:07:02.077894+0000","last_became_active":"2024-05-30T17:04:27.648603+0000","last_became_peered":"2024-05-30T17:04:27.648603+0000","last_unstale":"2024-05-30T17:07:02.077894+0000","last_undegraded":"2024-05-30T17:07:02.077894+0000","last_fullsized":"2024-05-30T17:07:02.077894+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":76,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"133'139","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.076761+0000","last_change":"2024-05-30T17:04:27.661461+0000","last_active":"2024-05-30T17:07:02.076761+0000","last_peered":"2024-05-30T17:07:02.076761+0000","last_clean":"2024-05-30T17:07:02.076761+0000","last_became_active":"2024-05-30T17:04:27.660883+0000","last_became_peered":"2024-05-30T17:04:27.660883+0000","last_unstale":"2024-05-30T17:07:02.076761+0000","last_undegraded":"2024-05-30T17:07:02.076761+0000","last_fullsized":"2024-05-30T17:07:02.076761+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":96,"num_read_kb":393216,"num_write":91,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"133'111","reported_seq":221,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.063559+0000","last_change":"2024-05-30T17:04:27.666142+0000","last_active":"2024-05-30T17:07:02.063559+0000","last_peered":"2024-05-30T17:07:02.063559+0000","last_clean":"2024-05-30T17:07:02.063559+0000","last_became_active":"2024-05-30T17:04:27.665266+0000","last_became_peered":"2024-05-30T17:04:27.665266+0000","last_unstale":"2024-05-30T17:07:02.063559+0000","last_undegraded":"2024-05-30T17:07:02.063559+0000","last_fullsized":"2024-05-30T17:07:02.063559+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:22.395407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":93,"num_read_kb":364548,"num_write":70,"num_write_kb":258049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"133'123","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071900+0000","last_change":"2024-05-30T17:04:27.655353+0000","last_active":"2024-05-30T17:07:02.071900+0000","last_peered":"2024-05-30T17:07:02.071900+0000","last_clean":"2024-05-30T17:07:02.071900+0000","last_became_active":"2024-05-30T17:04:27.655046+0000","last_became_peered":"2024-05-30T17:04:27.655046+0000","last_unstale":"2024-05-30T17:07:02.071900+0000","last_undegraded":"2024-05-30T17:07:02.071900+0000","last_fullsized":"2024-05-30T17:07:02.071900+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:03.759562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":82,"num_read_kb":335872,"num_write":80,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"133'139","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.080643+0000","last_change":"2024-05-30T17:04:27.660230+0000","last_active":"2024-05-30T17:07:02.080643+0000","last_peered":"2024-05-30T17:07:02.080643+0000","last_clean":"2024-05-30T17:07:02.080643+0000","last_became_active":"2024-05-30T17:04:27.659965+0000","last_became_peered":"2024-05-30T17:04:27.659965+0000","last_unstale":"2024-05-30T17:07:02.080643+0000","last_undegraded":"2024-05-30T17:07:02.080643+0000","last_fullsized":"2024-05-30T17:07:02.080643+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629892,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":62,"num_read_kb":249857,"num_write":78,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"133'122","reported_seq":169,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075397+0000","last_change":"2024-05-30T17:04:27.651454+0000","last_active":"2024-05-30T17:07:02.075397+0000","last_peered":"2024-05-30T17:07:02.075397+0000","last_clean":"2024-05-30T17:07:02.075397+0000","last_became_active":"2024-05-30T17:04:27.650330+0000","last_became_peered":"2024-05-30T17:04:27.650330+0000","last_unstale":"2024-05-30T17:07:02.075397+0000","last_undegraded":"2024-05-30T17:07:02.075397+0000","last_fullsized":"2024-05-30T17:07:02.075397+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:29:36.345038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":30,"num_read_kb":122880,"num_write":68,"num_write_kb":245760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"133'138","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.068324+0000","last_change":"2024-05-30T17:04:27.656402+0000","last_active":"2024-05-30T17:07:02.068324+0000","last_peered":"2024-05-30T17:07:02.068324+0000","last_clean":"2024-05-30T17:07:02.068324+0000","last_became_active":"2024-05-30T17:04:27.656141+0000","last_became_peered":"2024-05-30T17:04:27.656141+0000","last_unstale":"2024-05-30T17:07:02.068324+0000","last_undegraded":"2024-05-30T17:07:02.068324+0000","last_fullsized":"2024-05-30T17:07:02.068324+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:08.433002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":53,"num_read_kb":217088,"num_write":82,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"133'131","reported_seq":190,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075517+0000","last_change":"2024-05-30T17:04:27.655050+0000","last_active":"2024-05-30T17:07:02.075517+0000","last_peered":"2024-05-30T17:07:02.075517+0000","last_clean":"2024-05-30T17:07:02.075517+0000","last_became_active":"2024-05-30T17:04:27.654786+0000","last_became_peered":"2024-05-30T17:04:27.654786+0000","last_unstale":"2024-05-30T17:07:02.075517+0000","last_undegraded":"2024-05-30T17:07:02.075517+0000","last_fullsized":"2024-05-30T17:07:02.075517+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:12.824800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":77,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"133'133","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072270+0000","last_change":"2024-05-30T17:04:27.650889+0000","last_active":"2024-05-30T17:07:02.072270+0000","last_peered":"2024-05-30T17:07:02.072270+0000","last_clean":"2024-05-30T17:07:02.072270+0000","last_became_active":"2024-05-30T17:04:27.649462+0000","last_became_peered":"2024-05-30T17:04:27.649462+0000","last_unstale":"2024-05-30T17:07:02.072270+0000","last_undegraded":"2024-05-30T17:07:02.072270+0000","last_fullsized":"2024-05-30T17:07:02.072270+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:02:33.740142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":90,"num_read_kb":352260,"num_write":88,"num_write_kb":311298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"133'143","reported_seq":232,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072136+0000","last_change":"2024-05-30T17:04:27.661225+0000","last_active":"2024-05-30T17:07:02.072136+0000","last_peered":"2024-05-30T17:07:02.072136+0000","last_clean":"2024-05-30T17:07:02.072136+0000","last_became_active":"2024-05-30T17:04:27.660532+0000","last_became_peered":"2024-05-30T17:04:27.660532+0000","last_unstale":"2024-05-30T17:07:02.072136+0000","last_undegraded":"2024-05-30T17:07:02.072136+0000","last_fullsized":"2024-05-30T17:07:02.072136+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":71,"num_read_kb":278531,"num_write":90,"num_write_kb":315393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"133'147","reported_seq":221,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.066691+0000","last_change":"2024-05-30T17:04:27.652401+0000","last_active":"2024-05-30T17:07:02.066691+0000","last_peered":"2024-05-30T17:07:02.066691+0000","last_clean":"2024-05-30T17:07:02.066691+0000","last_became_active":"2024-05-30T17:04:27.652097+0000","last_became_peered":"2024-05-30T17:04:27.652097+0000","last_unstale":"2024-05-30T17:07:02.066691+0000","last_undegraded":"2024-05-30T17:07:02.066691+0000","last_fullsized":"2024-05-30T17:07:02.066691+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:22:37.455945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":84,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"133'143","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.059723+0000","last_change":"2024-05-30T17:04:27.668938+0000","last_active":"2024-05-30T17:07:02.059723+0000","last_peered":"2024-05-30T17:07:02.059723+0000","last_clean":"2024-05-30T17:07:02.059723+0000","last_became_active":"2024-05-30T17:04:27.667647+0000","last_became_peered":"2024-05-30T17:04:27.667647+0000","last_unstale":"2024-05-30T17:07:02.059723+0000","last_undegraded":"2024-05-30T17:07:02.059723+0000","last_fullsized":"2024-05-30T17:07:02.059723+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:34:30.304469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":90,"num_read_kb":364545,"num_write":97,"num_write_kb":348161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"133'132","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.076440+0000","last_change":"2024-05-30T17:04:27.662797+0000","last_active":"2024-05-30T17:07:02.076440+0000","last_peered":"2024-05-30T17:07:02.076440+0000","last_clean":"2024-05-30T17:07:02.076440+0000","last_became_active":"2024-05-30T17:04:27.662501+0000","last_became_peered":"2024-05-30T17:04:27.662501+0000","last_unstale":"2024-05-30T17:07:02.076440+0000","last_undegraded":"2024-05-30T17:07:02.076440+0000","last_fullsized":"2024-05-30T17:07:02.076440+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":57,"num_read_kb":229377,"num_write":78,"num_write_kb":282625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"133'147","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.069190+0000","last_change":"2024-05-30T17:04:27.663482+0000","last_active":"2024-05-30T17:07:02.069190+0000","last_peered":"2024-05-30T17:07:02.069190+0000","last_clean":"2024-05-30T17:07:02.069190+0000","last_became_active":"2024-05-30T17:04:27.663243+0000","last_became_peered":"2024-05-30T17:04:27.663243+0000","last_unstale":"2024-05-30T17:07:02.069190+0000","last_undegraded":"2024-05-30T17:07:02.069190+0000","last_fullsized":"2024-05-30T17:07:02.069190+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:18:01.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":93,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"133'141","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073384+0000","last_change":"2024-05-30T17:04:27.664136+0000","last_active":"2024-05-30T17:07:02.073384+0000","last_peered":"2024-05-30T17:07:02.073384+0000","last_clean":"2024-05-30T17:07:02.073384+0000","last_became_active":"2024-05-30T17:04:27.663855+0000","last_became_peered":"2024-05-30T17:04:27.663855+0000","last_unstale":"2024-05-30T17:07:02.073384+0000","last_undegraded":"2024-05-30T17:07:02.073384+0000","last_fullsized":"2024-05-30T17:07:02.073384+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":52,"num_read_kb":212992,"num_write":85,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"133'145","reported_seq":229,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075248+0000","last_change":"2024-05-30T17:04:27.653664+0000","last_active":"2024-05-30T17:07:02.075248+0000","last_peered":"2024-05-30T17:07:02.075248+0000","last_clean":"2024-05-30T17:07:02.075248+0000","last_became_active":"2024-05-30T17:04:27.653397+0000","last_became_peered":"2024-05-30T17:04:27.653397+0000","last_unstale":"2024-05-30T17:07:02.075248+0000","last_undegraded":"2024-05-30T17:07:02.075248+0000","last_fullsized":"2024-05-30T17:07:02.075248+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":66,"num_read_kb":253956,"num_write":74,"num_write_kb":266242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"133'158","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074135+0000","last_change":"2024-05-30T17:04:27.657224+0000","last_active":"2024-05-30T17:07:02.074135+0000","last_peered":"2024-05-30T17:07:02.074135+0000","last_clean":"2024-05-30T17:07:02.074135+0000","last_became_active":"2024-05-30T17:04:27.656941+0000","last_became_peered":"2024-05-30T17:04:27.656941+0000","last_unstale":"2024-05-30T17:07:02.074135+0000","last_undegraded":"2024-05-30T17:07:02.074135+0000","last_fullsized":"2024-05-30T17:07:02.074135+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:34:33.680204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":86,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"133'127","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.156564+0000","last_change":"2024-05-30T17:04:48.390020+0000","last_active":"2024-05-30T17:07:02.156564+0000","last_peered":"2024-05-30T17:07:02.156564+0000","last_clean":"2024-05-30T17:07:02.156564+0000","last_became_active":"2024-05-30T17:04:48.283505+0000","last_became_peered":"2024-05-30T17:04:48.283505+0000","last_unstale":"2024-05-30T17:07:02.156564+0000","last_undegraded":"2024-05-30T17:07:02.156564+0000","last_fullsized":"2024-05-30T17:07:02.156564+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":77,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.24","version":"133'126","reported_seq":175,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.061199+0000","last_change":"2024-05-30T17:04:27.664832+0000","last_active":"2024-05-30T17:07:02.061199+0000","last_peered":"2024-05-30T17:07:02.061199+0000","last_clean":"2024-05-30T17:07:02.061199+0000","last_became_active":"2024-05-30T17:04:27.664502+0000","last_became_peered":"2024-05-30T17:04:27.664502+0000","last_unstale":"2024-05-30T17:07:02.061199+0000","last_undegraded":"2024-05-30T17:07:02.061199+0000","last_fullsized":"2024-05-30T17:07:02.061199+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:01:53.320309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":32,"num_read_kb":131072,"num_write":80,"num_write_kb":282625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"133'142","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071698+0000","last_change":"2024-05-30T17:04:27.654528+0000","last_active":"2024-05-30T17:07:02.071698+0000","last_peered":"2024-05-30T17:07:02.071698+0000","last_clean":"2024-05-30T17:07:02.071698+0000","last_became_active":"2024-05-30T17:04:27.653960+0000","last_became_peered":"2024-05-30T17:04:27.653960+0000","last_unstale":"2024-05-30T17:07:02.071698+0000","last_undegraded":"2024-05-30T17:07:02.071698+0000","last_fullsized":"2024-05-30T17:07:02.071698+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:15.226549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":83,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"133'143","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078546+0000","last_change":"2024-05-30T17:04:27.654884+0000","last_active":"2024-05-30T17:07:02.078546+0000","last_peered":"2024-05-30T17:07:02.078546+0000","last_clean":"2024-05-30T17:07:02.078546+0000","last_became_active":"2024-05-30T17:04:27.654299+0000","last_became_peered":"2024-05-30T17:04:27.654299+0000","last_unstale":"2024-05-30T17:07:02.078546+0000","last_undegraded":"2024-05-30T17:07:02.078546+0000","last_fullsized":"2024-05-30T17:07:02.078546+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:24:47.150653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":87,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"133'142","reported_seq":255,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078715+0000","last_change":"2024-05-30T17:04:27.663731+0000","last_active":"2024-05-30T17:07:02.078715+0000","last_peered":"2024-05-30T17:07:02.078715+0000","last_clean":"2024-05-30T17:07:02.078715+0000","last_became_active":"2024-05-30T17:04:27.663462+0000","last_became_peered":"2024-05-30T17:04:27.663462+0000","last_unstale":"2024-05-30T17:07:02.078715+0000","last_undegraded":"2024-05-30T17:07:02.078715+0000","last_fullsized":"2024-05-30T17:07:02.078715+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:05:45.058232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":96,"num_read_kb":376836,"num_write":70,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"133'136","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074057+0000","last_change":"2024-05-30T17:04:27.648781+0000","last_active":"2024-05-30T17:07:02.074057+0000","last_peered":"2024-05-30T17:07:02.074057+0000","last_clean":"2024-05-30T17:07:02.074057+0000","last_became_active":"2024-05-30T17:04:27.648348+0000","last_became_peered":"2024-05-30T17:04:27.648348+0000","last_unstale":"2024-05-30T17:07:02.074057+0000","last_undegraded":"2024-05-30T17:07:02.074057+0000","last_fullsized":"2024-05-30T17:07:02.074057+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:18:01.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":69,"num_read_kb":282624,"num_write":74,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"133'132","reported_seq":190,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.065633+0000","last_change":"2024-05-30T17:04:27.665116+0000","last_active":"2024-05-30T17:07:02.065633+0000","last_peered":"2024-05-30T17:07:02.065633+0000","last_clean":"2024-05-30T17:07:02.065633+0000","last_became_active":"2024-05-30T17:04:27.664853+0000","last_became_peered":"2024-05-30T17:04:27.664853+0000","last_unstale":"2024-05-30T17:07:02.065633+0000","last_undegraded":"2024-05-30T17:07:02.065633+0000","last_fullsized":"2024-05-30T17:07:02.065633+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:56:00.380018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":41,"num_read_kb":163841,"num_write":78,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"130'4","reported_seq":23,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.385302+0000","last_change":"2024-05-30T17:04:26.653769+0000","last_active":"2024-05-30T17:04:48.385302+0000","last_peered":"2024-05-30T17:04:48.385302+0000","last_clean":"2024-05-30T17:04:48.385302+0000","last_became_active":"2024-05-30T17:04:26.653331+0000","last_became_peered":"2024-05-30T17:04:26.653331+0000","last_unstale":"2024-05-30T17:04:48.385302+0000","last_undegraded":"2024-05-30T17:04:48.385302+0000","last_fullsized":"2024-05-30T17:04:48.385302+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:48.287253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"133'134","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075995+0000","last_change":"2024-05-30T17:04:27.662362+0000","last_active":"2024-05-30T17:07:02.075995+0000","last_peered":"2024-05-30T17:07:02.075995+0000","last_clean":"2024-05-30T17:07:02.075995+0000","last_became_active":"2024-05-30T17:04:27.662074+0000","last_became_peered":"2024-05-30T17:04:27.662074+0000","last_unstale":"2024-05-30T17:07:02.075995+0000","last_undegraded":"2024-05-30T17:07:02.075995+0000","last_fullsized":"2024-05-30T17:07:02.075995+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:46.552415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":67,"num_read_kb":270337,"num_write":83,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.285510+0000","last_change":"2024-05-30T17:04:26.652574+0000","last_active":"2024-05-30T17:04:48.285510+0000","last_peered":"2024-05-30T17:04:48.285510+0000","last_clean":"2024-05-30T17:04:48.285510+0000","last_became_active":"2024-05-30T17:04:26.652142+0000","last_became_peered":"2024-05-30T17:04:26.652142+0000","last_unstale":"2024-05-30T17:04:48.285510+0000","last_undegraded":"2024-05-30T17:04:48.285510+0000","last_fullsized":"2024-05-30T17:04:48.285510+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:58:56.876839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"133'126","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.070793+0000","last_change":"2024-05-30T17:04:27.660400+0000","last_active":"2024-05-30T17:07:02.070793+0000","last_peered":"2024-05-30T17:07:02.070793+0000","last_clean":"2024-05-30T17:07:02.070793+0000","last_became_active":"2024-05-30T17:04:27.659049+0000","last_became_peered":"2024-05-30T17:04:27.659049+0000","last_unstale":"2024-05-30T17:07:02.070793+0000","last_undegraded":"2024-05-30T17:07:02.070793+0000","last_fullsized":"2024-05-30T17:07:02.070793+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:40.140860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435717,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":77,"num_write_kb":286721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"133'3","reported_seq":23,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:57.156089+0000","last_change":"2024-05-30T17:04:26.652502+0000","last_active":"2024-05-30T17:06:57.156089+0000","last_peered":"2024-05-30T17:06:57.156089+0000","last_clean":"2024-05-30T17:06:57.156089+0000","last_became_active":"2024-05-30T17:04:26.652240+0000","last_became_peered":"2024-05-30T17:04:26.652240+0000","last_unstale":"2024-05-30T17:06:57.156089+0000","last_undegraded":"2024-05-30T17:06:57.156089+0000","last_fullsized":"2024-05-30T17:06:57.156089+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"133'143","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078731+0000","last_change":"2024-05-30T17:04:27.659729+0000","last_active":"2024-05-30T17:07:02.078731+0000","last_peered":"2024-05-30T17:07:02.078731+0000","last_clean":"2024-05-30T17:07:02.078731+0000","last_became_active":"2024-05-30T17:04:27.659448+0000","last_became_peered":"2024-05-30T17:04:27.659448+0000","last_unstale":"2024-05-30T17:07:02.078731+0000","last_undegraded":"2024-05-30T17:07:02.078731+0000","last_fullsized":"2024-05-30T17:07:02.078731+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:24:26.077897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":85,"num_read_kb":348160,"num_write":95,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"133'3","reported_seq":23,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:57.154027+0000","last_change":"2024-05-30T17:04:26.644729+0000","last_active":"2024-05-30T17:06:57.154027+0000","last_peered":"2024-05-30T17:06:57.154027+0000","last_clean":"2024-05-30T17:06:57.154027+0000","last_became_active":"2024-05-30T17:04:26.644381+0000","last_became_peered":"2024-05-30T17:04:26.644381+0000","last_unstale":"2024-05-30T17:06:57.154027+0000","last_undegraded":"2024-05-30T17:06:57.154027+0000","last_fullsized":"2024-05-30T17:06:57.154027+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"133'144","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072514+0000","last_change":"2024-05-30T17:04:27.650774+0000","last_active":"2024-05-30T17:07:02.072514+0000","last_peered":"2024-05-30T17:07:02.072514+0000","last_clean":"2024-05-30T17:07:02.072514+0000","last_became_active":"2024-05-30T17:04:27.649829+0000","last_became_peered":"2024-05-30T17:04:27.649829+0000","last_unstale":"2024-05-30T17:07:02.072514+0000","last_undegraded":"2024-05-30T17:07:02.072514+0000","last_fullsized":"2024-05-30T17:07:02.072514+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:43:56.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":54,"num_read_kb":221184,"num_write":83,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"130'1","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:57.153990+0000","last_change":"2024-05-30T17:04:26.649081+0000","last_active":"2024-05-30T17:06:57.153990+0000","last_peered":"2024-05-30T17:06:57.153990+0000","last_clean":"2024-05-30T17:06:57.153990+0000","last_became_active":"2024-05-30T17:04:26.648809+0000","last_became_peered":"2024-05-30T17:04:26.648809+0000","last_unstale":"2024-05-30T17:06:57.153990+0000","last_undegraded":"2024-05-30T17:06:57.153990+0000","last_fullsized":"2024-05-30T17:06:57.153990+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"133'135","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074364+0000","last_change":"2024-05-30T17:04:27.657052+0000","last_active":"2024-05-30T17:07:02.074364+0000","last_peered":"2024-05-30T17:07:02.074364+0000","last_clean":"2024-05-30T17:07:02.074364+0000","last_became_active":"2024-05-30T17:04:27.656807+0000","last_became_peered":"2024-05-30T17:04:27.656807+0000","last_unstale":"2024-05-30T17:07:02.074364+0000","last_undegraded":"2024-05-30T17:07:02.074364+0000","last_fullsized":"2024-05-30T17:07:02.074364+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:13:23.181795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":89,"num_read_kb":364544,"num_write":85,"num_write_kb":319488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.296676+0000","last_change":"2024-05-30T17:04:26.650934+0000","last_active":"2024-05-30T17:04:48.296676+0000","last_peered":"2024-05-30T17:04:48.296676+0000","last_clean":"2024-05-30T17:04:48.296676+0000","last_became_active":"2024-05-30T17:04:26.650668+0000","last_became_peered":"2024-05-30T17:04:26.650668+0000","last_unstale":"2024-05-30T17:04:48.296676+0000","last_undegraded":"2024-05-30T17:04:48.296676+0000","last_fullsized":"2024-05-30T17:04:48.296676+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:04.028994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"133'140","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072051+0000","last_change":"2024-05-30T17:04:27.653284+0000","last_active":"2024-05-30T17:07:02.072051+0000","last_peered":"2024-05-30T17:07:02.072051+0000","last_clean":"2024-05-30T17:07:02.072051+0000","last_became_active":"2024-05-30T17:04:27.653020+0000","last_became_peered":"2024-05-30T17:04:27.653020+0000","last_unstale":"2024-05-30T17:07:02.072051+0000","last_undegraded":"2024-05-30T17:07:02.072051+0000","last_fullsized":"2024-05-30T17:07:02.072051+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:21.704608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":70,"num_read_kb":278530,"num_write":74,"num_write_kb":262145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.283847+0000","last_change":"2024-05-30T17:04:26.642168+0000","last_active":"2024-05-30T17:04:48.283847+0000","last_peered":"2024-05-30T17:04:48.283847+0000","last_clean":"2024-05-30T17:04:48.283847+0000","last_became_active":"2024-05-30T17:04:26.641791+0000","last_became_peered":"2024-05-30T17:04:26.641791+0000","last_unstale":"2024-05-30T17:04:48.283847+0000","last_undegraded":"2024-05-30T17:04:48.283847+0000","last_fullsized":"2024-05-30T17:04:48.283847+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:06:45.068461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"133'134","reported_seq":216,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.066411+0000","last_change":"2024-05-30T17:04:27.648200+0000","last_active":"2024-05-30T17:07:02.066411+0000","last_peered":"2024-05-30T17:07:02.066411+0000","last_clean":"2024-05-30T17:07:02.066411+0000","last_became_active":"2024-05-30T17:04:27.647928+0000","last_became_peered":"2024-05-30T17:04:27.647928+0000","last_unstale":"2024-05-30T17:07:02.066411+0000","last_undegraded":"2024-05-30T17:07:02.066411+0000","last_fullsized":"2024-05-30T17:07:02.066411+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":75,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:52.153373+0000","last_change":"2024-05-30T17:04:26.645457+0000","last_active":"2024-05-30T17:06:52.153373+0000","last_peered":"2024-05-30T17:06:52.153373+0000","last_clean":"2024-05-30T17:06:52.153373+0000","last_became_active":"2024-05-30T17:04:26.642988+0000","last_became_peered":"2024-05-30T17:04:26.642988+0000","last_unstale":"2024-05-30T17:06:52.153373+0000","last_undegraded":"2024-05-30T17:06:52.153373+0000","last_fullsized":"2024-05-30T17:06:52.153373+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"133'122","reported_seq":174,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078137+0000","last_change":"2024-05-30T17:04:27.654579+0000","last_active":"2024-05-30T17:07:02.078137+0000","last_peered":"2024-05-30T17:07:02.078137+0000","last_clean":"2024-05-30T17:07:02.078137+0000","last_became_active":"2024-05-30T17:04:27.654315+0000","last_became_peered":"2024-05-30T17:04:27.654315+0000","last_unstale":"2024-05-30T17:07:02.078137+0000","last_undegraded":"2024-05-30T17:07:02.078137+0000","last_fullsized":"2024-05-30T17:07:02.078137+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:42.109985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":35,"num_read_kb":143360,"num_write":60,"num_write_kb":217088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"133'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:10.717567+0000","last_change":"2024-05-30T17:04:26.653783+0000","last_active":"2024-05-30T17:05:10.717567+0000","last_peered":"2024-05-30T17:05:10.717567+0000","last_clean":"2024-05-30T17:05:10.717567+0000","last_became_active":"2024-05-30T17:04:26.653413+0000","last_became_peered":"2024-05-30T17:04:26.653413+0000","last_unstale":"2024-05-30T17:05:10.717567+0000","last_undegraded":"2024-05-30T17:05:10.717567+0000","last_fullsized":"2024-05-30T17:05:10.717567+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:47.810832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"133'120","reported_seq":177,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.062511+0000","last_change":"2024-05-30T17:04:27.670112+0000","last_active":"2024-05-30T17:07:02.062511+0000","last_peered":"2024-05-30T17:07:02.062511+0000","last_clean":"2024-05-30T17:07:02.062511+0000","last_became_active":"2024-05-30T17:04:27.669759+0000","last_became_peered":"2024-05-30T17:04:27.669759+0000","last_unstale":"2024-05-30T17:07:02.062511+0000","last_undegraded":"2024-05-30T17:07:02.062511+0000","last_fullsized":"2024-05-30T17:07:02.062511+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:28:30.371308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881204,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":40,"num_read_kb":159745,"num_write":65,"num_write_kb":245761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.297131+0000","last_change":"2024-05-30T17:04:26.649285+0000","last_active":"2024-05-30T17:04:48.297131+0000","last_peered":"2024-05-30T17:04:48.297131+0000","last_clean":"2024-05-30T17:04:48.297131+0000","last_became_active":"2024-05-30T17:04:26.648983+0000","last_became_peered":"2024-05-30T17:04:26.648983+0000","last_unstale":"2024-05-30T17:04:48.297131+0000","last_undegraded":"2024-05-30T17:04:48.297131+0000","last_fullsized":"2024-05-30T17:04:48.297131+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:34:19.123667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"133'124","reported_seq":217,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.074664+0000","last_change":"2024-05-30T17:04:27.661122+0000","last_active":"2024-05-30T17:07:02.074664+0000","last_peered":"2024-05-30T17:07:02.074664+0000","last_clean":"2024-05-30T17:07:02.074664+0000","last_became_active":"2024-05-30T17:04:27.660791+0000","last_became_peered":"2024-05-30T17:04:27.660791+0000","last_unstale":"2024-05-30T17:07:02.074664+0000","last_undegraded":"2024-05-30T17:07:02.074664+0000","last_fullsized":"2024-05-30T17:07:02.074664+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:44:34.412222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":76,"num_read_kb":311296,"num_write":81,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"133'25","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:11.774245+0000","last_change":"2024-05-30T17:04:26.655873+0000","last_active":"2024-05-30T17:06:11.774245+0000","last_peered":"2024-05-30T17:06:11.774245+0000","last_clean":"2024-05-30T17:06:11.774245+0000","last_became_active":"2024-05-30T17:04:26.655436+0000","last_became_peered":"2024-05-30T17:04:26.655436+0000","last_unstale":"2024-05-30T17:06:11.774245+0000","last_undegraded":"2024-05-30T17:06:11.774245+0000","last_fullsized":"2024-05-30T17:06:11.774245+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:40:41.100872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"133'121","reported_seq":200,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071846+0000","last_change":"2024-05-30T17:04:27.655308+0000","last_active":"2024-05-30T17:07:02.071846+0000","last_peered":"2024-05-30T17:07:02.071846+0000","last_clean":"2024-05-30T17:07:02.071846+0000","last_became_active":"2024-05-30T17:04:27.654682+0000","last_became_peered":"2024-05-30T17:04:27.654682+0000","last_unstale":"2024-05-30T17:07:02.071846+0000","last_undegraded":"2024-05-30T17:07:02.071846+0000","last_fullsized":"2024-05-30T17:07:02.071846+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:13:50.711493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":62,"num_read_kb":237572,"num_write":64,"num_write_kb":221186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"133'445","reported_seq":464,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.024243+0000","last_change":"2024-05-30T17:04:26.644996+0000","last_active":"2024-05-30T17:07:02.024243+0000","last_peered":"2024-05-30T17:07:02.024243+0000","last_clean":"2024-05-30T17:07:02.024243+0000","last_became_active":"2024-05-30T17:04:26.644394+0000","last_became_peered":"2024-05-30T17:04:26.644394+0000","last_unstale":"2024-05-30T17:07:02.024243+0000","last_undegraded":"2024-05-30T17:07:02.024243+0000","last_fullsized":"2024-05-30T17:07:02.024243+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:32:48.916197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":1814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"133'140","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071163+0000","last_change":"2024-05-30T17:04:27.667231+0000","last_active":"2024-05-30T17:07:02.071163+0000","last_peered":"2024-05-30T17:07:02.071163+0000","last_clean":"2024-05-30T17:07:02.071163+0000","last_became_active":"2024-05-30T17:04:27.666778+0000","last_became_peered":"2024-05-30T17:04:27.666778+0000","last_unstale":"2024-05-30T17:07:02.071163+0000","last_undegraded":"2024-05-30T17:07:02.071163+0000","last_fullsized":"2024-05-30T17:07:02.071163+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:05:27.633461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":51,"num_read_kb":204801,"num_write":86,"num_write_kb":315393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.280865+0000","last_change":"2024-05-30T17:04:26.648513+0000","last_active":"2024-05-30T17:04:48.280865+0000","last_peered":"2024-05-30T17:04:48.280865+0000","last_clean":"2024-05-30T17:04:48.280865+0000","last_became_active":"2024-05-30T17:04:26.648016+0000","last_became_peered":"2024-05-30T17:04:26.648016+0000","last_unstale":"2024-05-30T17:04:48.280865+0000","last_undegraded":"2024-05-30T17:04:48.280865+0000","last_fullsized":"2024-05-30T17:04:48.280865+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:57:19.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"133'138","reported_seq":214,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075590+0000","last_change":"2024-05-30T17:04:27.647201+0000","last_active":"2024-05-30T17:07:02.075590+0000","last_peered":"2024-05-30T17:07:02.075590+0000","last_clean":"2024-05-30T17:07:02.075590+0000","last_became_active":"2024-05-30T17:04:27.646842+0000","last_became_peered":"2024-05-30T17:04:27.646842+0000","last_unstale":"2024-05-30T17:07:02.075590+0000","last_undegraded":"2024-05-30T17:07:02.075590+0000","last_fullsized":"2024-05-30T17:07:02.075590+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":87,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.152900+0000","last_change":"2024-05-30T17:04:26.643372+0000","last_active":"2024-05-30T17:06:47.152900+0000","last_peered":"2024-05-30T17:06:47.152900+0000","last_clean":"2024-05-30T17:06:47.152900+0000","last_became_active":"2024-05-30T17:04:26.641530+0000","last_became_peered":"2024-05-30T17:04:26.641530+0000","last_unstale":"2024-05-30T17:06:47.152900+0000","last_undegraded":"2024-05-30T17:06:47.152900+0000","last_fullsized":"2024-05-30T17:06:47.152900+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"133'158","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.068945+0000","last_change":"2024-05-30T17:04:27.663493+0000","last_active":"2024-05-30T17:07:02.068945+0000","last_peered":"2024-05-30T17:07:02.068945+0000","last_clean":"2024-05-30T17:07:02.068945+0000","last_became_active":"2024-05-30T17:04:27.662912+0000","last_became_peered":"2024-05-30T17:04:27.662912+0000","last_unstale":"2024-05-30T17:07:02.068945+0000","last_undegraded":"2024-05-30T17:07:02.068945+0000","last_fullsized":"2024-05-30T17:07:02.068945+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:12:24.226617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544581,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":99,"num_write_kb":364545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"130'8","reported_seq":27,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.331297+0000","last_change":"2024-05-30T17:04:26.651768+0000","last_active":"2024-05-30T17:04:48.331297+0000","last_peered":"2024-05-30T17:04:48.331297+0000","last_clean":"2024-05-30T17:04:48.331297+0000","last_became_active":"2024-05-30T17:04:26.651470+0000","last_became_peered":"2024-05-30T17:04:26.651470+0000","last_unstale":"2024-05-30T17:04:48.331297+0000","last_undegraded":"2024-05-30T17:04:48.331297+0000","last_fullsized":"2024-05-30T17:04:48.331297+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:51:21.096723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"133'115","reported_seq":158,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071224+0000","last_change":"2024-05-30T17:04:27.656826+0000","last_active":"2024-05-30T17:07:02.071224+0000","last_peered":"2024-05-30T17:07:02.071224+0000","last_clean":"2024-05-30T17:07:02.071224+0000","last_became_active":"2024-05-30T17:04:27.656527+0000","last_became_peered":"2024-05-30T17:04:27.656527+0000","last_unstale":"2024-05-30T17:07:02.071224+0000","last_undegraded":"2024-05-30T17:07:02.071224+0000","last_fullsized":"2024-05-30T17:07:02.071224+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:53.659379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":26,"num_read_kb":94211,"num_write":61,"num_write_kb":212993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.285745+0000","last_change":"2024-05-30T17:04:26.646106+0000","last_active":"2024-05-30T17:04:48.285745+0000","last_peered":"2024-05-30T17:04:48.285745+0000","last_clean":"2024-05-30T17:04:48.285745+0000","last_became_active":"2024-05-30T17:04:26.645435+0000","last_became_peered":"2024-05-30T17:04:26.645435+0000","last_unstale":"2024-05-30T17:04:48.285745+0000","last_undegraded":"2024-05-30T17:04:48.285745+0000","last_fullsized":"2024-05-30T17:04:48.285745+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:55.135303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"133'154","reported_seq":246,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.064901+0000","last_change":"2024-05-30T17:04:27.666627+0000","last_active":"2024-05-30T17:07:02.064901+0000","last_peered":"2024-05-30T17:07:02.064901+0000","last_clean":"2024-05-30T17:07:02.064901+0000","last_became_active":"2024-05-30T17:04:27.666318+0000","last_became_peered":"2024-05-30T17:04:27.666318+0000","last_unstale":"2024-05-30T17:07:02.064901+0000","last_undegraded":"2024-05-30T17:07:02.064901+0000","last_fullsized":"2024-05-30T17:07:02.064901+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:45:56.513914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":102,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"130'2","reported_seq":22,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:42.154781+0000","last_change":"2024-05-30T17:04:26.649232+0000","last_active":"2024-05-30T17:06:42.154781+0000","last_peered":"2024-05-30T17:06:42.154781+0000","last_clean":"2024-05-30T17:06:42.154781+0000","last_became_active":"2024-05-30T17:04:26.648936+0000","last_became_peered":"2024-05-30T17:04:26.648936+0000","last_unstale":"2024-05-30T17:06:42.154781+0000","last_undegraded":"2024-05-30T17:06:42.154781+0000","last_fullsized":"2024-05-30T17:06:42.154781+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"133'140","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.067851+0000","last_change":"2024-05-30T17:04:27.657488+0000","last_active":"2024-05-30T17:07:02.067851+0000","last_peered":"2024-05-30T17:07:02.067851+0000","last_clean":"2024-05-30T17:07:02.067851+0000","last_became_active":"2024-05-30T17:04:27.657216+0000","last_became_peered":"2024-05-30T17:04:27.657216+0000","last_unstale":"2024-05-30T17:07:02.067851+0000","last_undegraded":"2024-05-30T17:07:02.067851+0000","last_fullsized":"2024-05-30T17:07:02.067851+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:18.543050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909897,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":58,"num_read_kb":221188,"num_write":75,"num_write_kb":241669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"130'1","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.284309+0000","last_change":"2024-05-30T17:04:26.652397+0000","last_active":"2024-05-30T17:04:48.284309+0000","last_peered":"2024-05-30T17:04:48.284309+0000","last_clean":"2024-05-30T17:04:48.284309+0000","last_became_active":"2024-05-30T17:04:26.652083+0000","last_became_peered":"2024-05-30T17:04:26.652083+0000","last_unstale":"2024-05-30T17:04:48.284309+0000","last_undegraded":"2024-05-30T17:04:48.284309+0000","last_fullsized":"2024-05-30T17:04:48.284309+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:17.631736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"133'141","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.080513+0000","last_change":"2024-05-30T17:04:27.649124+0000","last_active":"2024-05-30T17:07:02.080513+0000","last_peered":"2024-05-30T17:07:02.080513+0000","last_clean":"2024-05-30T17:07:02.080513+0000","last_became_active":"2024-05-30T17:04:27.648847+0000","last_became_peered":"2024-05-30T17:04:27.648847+0000","last_unstale":"2024-05-30T17:07:02.080513+0000","last_undegraded":"2024-05-30T17:07:02.080513+0000","last_fullsized":"2024-05-30T17:07:02.080513+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":89,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.285619+0000","last_change":"2024-05-30T17:04:26.646336+0000","last_active":"2024-05-30T17:04:48.285619+0000","last_peered":"2024-05-30T17:04:48.285619+0000","last_clean":"2024-05-30T17:04:48.285619+0000","last_became_active":"2024-05-30T17:04:26.646025+0000","last_became_peered":"2024-05-30T17:04:26.646025+0000","last_unstale":"2024-05-30T17:04:48.285619+0000","last_undegraded":"2024-05-30T17:04:48.285619+0000","last_fullsized":"2024-05-30T17:04:48.285619+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:34.972669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"133'147","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.045813+0000","last_change":"2024-05-30T17:04:27.654618+0000","last_active":"2024-05-30T17:07:02.045813+0000","last_peered":"2024-05-30T17:07:02.045813+0000","last_clean":"2024-05-30T17:07:02.045813+0000","last_became_active":"2024-05-30T17:04:27.653888+0000","last_became_peered":"2024-05-30T17:04:27.653888+0000","last_unstale":"2024-05-30T17:07:02.045813+0000","last_undegraded":"2024-05-30T17:07:02.045813+0000","last_fullsized":"2024-05-30T17:07:02.045813+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:28:34.447493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":89,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"133'3","reported_seq":22,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:10.719775+0000","last_change":"2024-05-30T17:04:26.657719+0000","last_active":"2024-05-30T17:05:10.719775+0000","last_peered":"2024-05-30T17:05:10.719775+0000","last_clean":"2024-05-30T17:05:10.719775+0000","last_became_active":"2024-05-30T17:04:26.657452+0000","last_became_peered":"2024-05-30T17:04:26.657452+0000","last_unstale":"2024-05-30T17:05:10.719775+0000","last_undegraded":"2024-05-30T17:05:10.719775+0000","last_fullsized":"2024-05-30T17:05:10.719775+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:02.780429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"133'144","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072479+0000","last_change":"2024-05-30T17:04:27.649752+0000","last_active":"2024-05-30T17:07:02.072479+0000","last_peered":"2024-05-30T17:07:02.072479+0000","last_clean":"2024-05-30T17:07:02.072479+0000","last_became_active":"2024-05-30T17:04:27.649442+0000","last_became_peered":"2024-05-30T17:04:27.649442+0000","last_unstale":"2024-05-30T17:07:02.072479+0000","last_undegraded":"2024-05-30T17:07:02.072479+0000","last_fullsized":"2024-05-30T17:07:02.072479+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:38:19.022224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":66,"num_read_kb":241671,"num_write":82,"num_write_kb":278531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.296766+0000","last_change":"2024-05-30T17:04:26.645875+0000","last_active":"2024-05-30T17:04:48.296766+0000","last_peered":"2024-05-30T17:04:48.296766+0000","last_clean":"2024-05-30T17:04:48.296766+0000","last_became_active":"2024-05-30T17:04:26.645583+0000","last_became_peered":"2024-05-30T17:04:26.645583+0000","last_unstale":"2024-05-30T17:04:48.296766+0000","last_undegraded":"2024-05-30T17:04:48.296766+0000","last_fullsized":"2024-05-30T17:04:48.296766+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:03.486308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"133'147","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.075699+0000","last_change":"2024-05-30T17:04:27.652007+0000","last_active":"2024-05-30T17:07:02.075699+0000","last_peered":"2024-05-30T17:07:02.075699+0000","last_clean":"2024-05-30T17:07:02.075699+0000","last_became_active":"2024-05-30T17:04:27.651701+0000","last_became_peered":"2024-05-30T17:04:27.651701+0000","last_unstale":"2024-05-30T17:07:02.075699+0000","last_undegraded":"2024-05-30T17:07:02.075699+0000","last_fullsized":"2024-05-30T17:07:02.075699+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":91,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.296204+0000","last_change":"2024-05-30T17:04:26.647421+0000","last_active":"2024-05-30T17:04:48.296204+0000","last_peered":"2024-05-30T17:04:48.296204+0000","last_clean":"2024-05-30T17:04:48.296204+0000","last_became_active":"2024-05-30T17:04:26.647155+0000","last_became_peered":"2024-05-30T17:04:26.647155+0000","last_unstale":"2024-05-30T17:04:48.296204+0000","last_undegraded":"2024-05-30T17:04:48.296204+0000","last_fullsized":"2024-05-30T17:04:48.296204+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:59:52.705838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"133'135","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078368+0000","last_change":"2024-05-30T17:04:27.667584+0000","last_active":"2024-05-30T17:07:02.078368+0000","last_peered":"2024-05-30T17:07:02.078368+0000","last_clean":"2024-05-30T17:07:02.078368+0000","last_became_active":"2024-05-30T17:04:27.667268+0000","last_became_peered":"2024-05-30T17:04:27.667268+0000","last_unstale":"2024-05-30T17:07:02.078368+0000","last_undegraded":"2024-05-30T17:07:02.078368+0000","last_fullsized":"2024-05-30T17:07:02.078368+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:41:45.213871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230686720,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":56,"num_read_kb":229376,"num_write":75,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:37.154348+0000","last_change":"2024-05-30T17:04:26.650930+0000","last_active":"2024-05-30T17:06:37.154348+0000","last_peered":"2024-05-30T17:06:37.154348+0000","last_clean":"2024-05-30T17:06:37.154348+0000","last_became_active":"2024-05-30T17:04:26.650616+0000","last_became_peered":"2024-05-30T17:04:26.650616+0000","last_unstale":"2024-05-30T17:06:37.154348+0000","last_undegraded":"2024-05-30T17:06:37.154348+0000","last_fullsized":"2024-05-30T17:06:37.154348+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"133'153","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.066680+0000","last_change":"2024-05-30T17:04:27.664544+0000","last_active":"2024-05-30T17:07:02.066680+0000","last_peered":"2024-05-30T17:07:02.066680+0000","last_clean":"2024-05-30T17:07:02.066680+0000","last_became_active":"2024-05-30T17:04:27.664180+0000","last_became_peered":"2024-05-30T17:04:27.664180+0000","last_unstale":"2024-05-30T17:07:02.066680+0000","last_undegraded":"2024-05-30T17:07:02.066680+0000","last_fullsized":"2024-05-30T17:07:02.066680+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:59.508295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":96,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"130'2","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.280667+0000","last_change":"2024-05-30T17:04:26.653129+0000","last_active":"2024-05-30T17:04:48.280667+0000","last_peered":"2024-05-30T17:04:48.280667+0000","last_clean":"2024-05-30T17:04:48.280667+0000","last_became_active":"2024-05-30T17:04:26.652234+0000","last_became_peered":"2024-05-30T17:04:26.652234+0000","last_unstale":"2024-05-30T17:04:48.280667+0000","last_undegraded":"2024-05-30T17:04:48.280667+0000","last_fullsized":"2024-05-30T17:04:48.280667+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:12.851756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"133'138","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.077318+0000","last_change":"2024-05-30T17:04:27.656246+0000","last_active":"2024-05-30T17:07:02.077318+0000","last_peered":"2024-05-30T17:07:02.077318+0000","last_clean":"2024-05-30T17:07:02.077318+0000","last_became_active":"2024-05-30T17:04:27.655926+0000","last_became_peered":"2024-05-30T17:04:27.655926+0000","last_unstale":"2024-05-30T17:07:02.077318+0000","last_undegraded":"2024-05-30T17:07:02.077318+0000","last_fullsized":"2024-05-30T17:07:02.077318+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:10:03.789542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":90,"num_write_kb":319489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"133'42","reported_seq":61,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:47.695551+0000","last_change":"2024-05-30T17:04:26.649574+0000","last_active":"2024-05-30T17:06:47.695551+0000","last_peered":"2024-05-30T17:06:47.695551+0000","last_clean":"2024-05-30T17:06:47.695551+0000","last_became_active":"2024-05-30T17:04:26.648998+0000","last_became_peered":"2024-05-30T17:04:26.648998+0000","last_unstale":"2024-05-30T17:06:47.695551+0000","last_undegraded":"2024-05-30T17:06:47.695551+0000","last_fullsized":"2024-05-30T17:06:47.695551+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:35:25.197491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"133'132","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.072665+0000","last_change":"2024-05-30T17:04:27.654582+0000","last_active":"2024-05-30T17:07:02.072665+0000","last_peered":"2024-05-30T17:07:02.072665+0000","last_clean":"2024-05-30T17:07:02.072665+0000","last_became_active":"2024-05-30T17:04:27.654295+0000","last_became_peered":"2024-05-30T17:04:27.654295+0000","last_unstale":"2024-05-30T17:07:02.072665+0000","last_undegraded":"2024-05-30T17:07:02.072665+0000","last_fullsized":"2024-05-30T17:07:02.072665+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":88,"num_read_kb":360448,"num_write":81,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:32.151359+0000","last_change":"2024-05-30T17:04:26.647328+0000","last_active":"2024-05-30T17:06:32.151359+0000","last_peered":"2024-05-30T17:06:32.151359+0000","last_clean":"2024-05-30T17:06:32.151359+0000","last_became_active":"2024-05-30T17:04:26.647058+0000","last_became_peered":"2024-05-30T17:04:26.647058+0000","last_unstale":"2024-05-30T17:06:32.151359+0000","last_undegraded":"2024-05-30T17:06:32.151359+0000","last_fullsized":"2024-05-30T17:06:32.151359+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"133'142","reported_seq":209,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.078089+0000","last_change":"2024-05-30T17:04:27.657344+0000","last_active":"2024-05-30T17:07:02.078089+0000","last_peered":"2024-05-30T17:07:02.078089+0000","last_clean":"2024-05-30T17:07:02.078089+0000","last_became_active":"2024-05-30T17:04:27.657041+0000","last_became_peered":"2024-05-30T17:04:27.657041+0000","last_unstale":"2024-05-30T17:07:02.078089+0000","last_undegraded":"2024-05-30T17:07:02.078089+0000","last_fullsized":"2024-05-30T17:07:02.078089+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:46.552415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824186,"num_objects":68,"num_object_clones":1,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":51,"num_read_kb":200706,"num_write":94,"num_write_kb":315395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:32.153864+0000","last_change":"2024-05-30T17:04:26.655225+0000","last_active":"2024-05-30T17:06:32.153864+0000","last_peered":"2024-05-30T17:06:32.153864+0000","last_clean":"2024-05-30T17:06:32.153864+0000","last_became_active":"2024-05-30T17:04:26.654383+0000","last_became_peered":"2024-05-30T17:04:26.654383+0000","last_unstale":"2024-05-30T17:06:32.153864+0000","last_undegraded":"2024-05-30T17:06:32.153864+0000","last_fullsized":"2024-05-30T17:06:32.153864+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"133'142","reported_seq":214,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.071377+0000","last_change":"2024-05-30T17:04:27.659619+0000","last_active":"2024-05-30T17:07:02.071377+0000","last_peered":"2024-05-30T17:07:02.071377+0000","last_clean":"2024-05-30T17:07:02.071377+0000","last_became_active":"2024-05-30T17:04:27.659316+0000","last_became_peered":"2024-05-30T17:04:27.659316+0000","last_unstale":"2024-05-30T17:07:02.071377+0000","last_undegraded":"2024-05-30T17:07:02.071377+0000","last_fullsized":"2024-05-30T17:07:02.071377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:29:40.214450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":88,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:32.151334+0000","last_change":"2024-05-30T17:04:26.643654+0000","last_active":"2024-05-30T17:06:32.151334+0000","last_peered":"2024-05-30T17:06:32.151334+0000","last_clean":"2024-05-30T17:06:32.151334+0000","last_became_active":"2024-05-30T17:04:26.642798+0000","last_became_peered":"2024-05-30T17:04:26.642798+0000","last_unstale":"2024-05-30T17:06:32.151334+0000","last_undegraded":"2024-05-30T17:06:32.151334+0000","last_fullsized":"2024-05-30T17:06:32.151334+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"133'151","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073260+0000","last_change":"2024-05-30T17:04:27.662540+0000","last_active":"2024-05-30T17:07:02.073260+0000","last_peered":"2024-05-30T17:07:02.073260+0000","last_clean":"2024-05-30T17:07:02.073260+0000","last_became_active":"2024-05-30T17:04:27.662294+0000","last_became_peered":"2024-05-30T17:04:27.662294+0000","last_unstale":"2024-05-30T17:07:02.073260+0000","last_undegraded":"2024-05-30T17:07:02.073260+0000","last_fullsized":"2024-05-30T17:07:02.073260+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:03.093546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":85,"num_read_kb":335875,"num_write":93,"num_write_kb":335873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.385120+0000","last_change":"2024-05-30T17:04:26.650407+0000","last_active":"2024-05-30T17:04:48.385120+0000","last_peered":"2024-05-30T17:04:48.385120+0000","last_clean":"2024-05-30T17:04:48.385120+0000","last_became_active":"2024-05-30T17:04:26.650063+0000","last_became_peered":"2024-05-30T17:04:26.650063+0000","last_unstale":"2024-05-30T17:04:48.385120+0000","last_undegraded":"2024-05-30T17:04:48.385120+0000","last_fullsized":"2024-05-30T17:04:48.385120+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:58.499182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"133'126","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.068394+0000","last_change":"2024-05-30T17:04:27.648839+0000","last_active":"2024-05-30T17:07:02.068394+0000","last_peered":"2024-05-30T17:07:02.068394+0000","last_clean":"2024-05-30T17:07:02.068394+0000","last_became_active":"2024-05-30T17:04:27.648558+0000","last_became_peered":"2024-05-30T17:04:27.648558+0000","last_unstale":"2024-05-30T17:07:02.068394+0000","last_undegraded":"2024-05-30T17:07:02.068394+0000","last_fullsized":"2024-05-30T17:07:02.068394+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:52.862600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":83,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"133'32","reported_seq":82,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:06:11.769701+0000","last_change":"2024-05-30T17:04:26.646155+0000","last_active":"2024-05-30T17:06:11.769701+0000","last_peered":"2024-05-30T17:06:11.769701+0000","last_clean":"2024-05-30T17:06:11.769701+0000","last_became_active":"2024-05-30T17:04:26.645855+0000","last_became_peered":"2024-05-30T17:04:26.645855+0000","last_unstale":"2024-05-30T17:06:11.769701+0000","last_undegraded":"2024-05-30T17:06:11.769701+0000","last_fullsized":"2024-05-30T17:06:11.769701+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:20:51.017861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4957,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":31,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"133'149","reported_seq":243,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.073479+0000","last_change":"2024-05-30T17:04:27.657377+0000","last_active":"2024-05-30T17:07:02.073479+0000","last_peered":"2024-05-30T17:07:02.073479+0000","last_clean":"2024-05-30T17:07:02.073479+0000","last_became_active":"2024-05-30T17:04:27.657110+0000","last_became_peered":"2024-05-30T17:04:27.657110+0000","last_unstale":"2024-05-30T17:07:02.073479+0000","last_undegraded":"2024-05-30T17:07:02.073479+0000","last_fullsized":"2024-05-30T17:07:02.073479+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":76,"num_read_kb":311296,"num_write":106,"num_write_kb":380928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:06.900171+0000","last_change":"2024-05-30T17:07:06.900190+0000","last_active":"2024-05-30T17:07:06.900171+0000","last_peered":"2024-05-30T17:07:06.900171+0000","last_clean":"2024-05-30T17:07:06.900171+0000","last_became_active":"2024-05-30T17:04:26.646125+0000","last_became_peered":"2024-05-30T17:04:26.646125+0000","last_unstale":"2024-05-30T17:07:06.900171+0000","last_undegraded":"2024-05-30T17:07:06.900171+0000","last_fullsized":"2024-05-30T17:07:06.900171+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:06.900090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:06.900090+0000","last_clean_scrub_stamp":"2024-05-30T17:07:06.900090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:30:24.784282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"133'138","reported_seq":202,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:02.067455+0000","last_change":"2024-05-30T17:04:27.668983+0000","last_active":"2024-05-30T17:07:02.067455+0000","last_peered":"2024-05-30T17:07:02.067455+0000","last_clean":"2024-05-30T17:07:02.067455+0000","last_became_active":"2024-05-30T17:04:27.668009+0000","last_became_peered":"2024-05-30T17:04:27.668009+0000","last_unstale":"2024-05-30T17:07:02.067455+0000","last_undegraded":"2024-05-30T17:07:02.067455+0000","last_fullsized":"2024-05-30T17:07:02.067455+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:26.621980+0000","last_clean_scrub_stamp":"2024-05-30T17:04:26.621980+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:05:39.653558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":47,"num_read_kb":192512,"num_write":88,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"130'2","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:04:48.385038+0000","last_change":"2024-05-30T17:04:26.656301+0000","last_active":"2024-05-30T17:04:48.385038+0000","last_peered":"2024-05-30T17:04:48.385038+0000","last_clean":"2024-05-30T17:04:48.385038+0000","last_became_active":"2024-05-30T17:04:26.655900+0000","last_became_peered":"2024-05-30T17:04:26.655900+0000","last_unstale":"2024-05-30T17:04:48.385038+0000","last_undegraded":"2024-05-30T17:04:48.385038+0000","last_fullsized":"2024-05-30T17:04:48.385038+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:04:25.612867+0000","last_clean_scrub_stamp":"2024-05-30T17:04:25.612867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:18.390768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":384,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:05:02.147978+0000","last_change":"2024-05-30T16:48:55.226616+0000","last_active":"2024-05-30T17:05:02.147978+0000","last_peered":"2024-05-30T17:05:02.147978+0000","last_clean":"2024-05-30T17:05:02.147978+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:05:02.147978+0000","last_undegraded":"2024-05-30T17:05:02.147978+0000","last_fullsized":"2024-05-30T17:05:02.147978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:48:54.044602+0000","last_clean_scrub_stamp":"2024-05-30T16:48:54.044602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:30:16.164250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":17406362949,"num_objects":4158,"num_object_clones":1,"num_object_copies":8316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4158,"num_whiteouts":1,"num_read":4010,"num_read_kb":16171070,"num_write":5302,"num_write_kb":19193899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34812780544,"data_stored":34812725898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8811,"ondisk_log_size":8811,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1691903,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":627,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3448832,"data_stored":3383806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509661,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3774688,"kb_used_data":3657496,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":90597152,"statfs":{"total":96636764160,"available":92771483648,"internally_reserved":0,"allocated":3745275904,"data_stored":3744324682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509662,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4762904,"kb_used_data":4627664,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89608936,"statfs":{"total":96636764160,"available":91759550464,"internally_reserved":0,"allocated":4738727936,"data_stored":4737788681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509662,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3647204,"kb_used_data":3507804,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":90724636,"statfs":{"total":96636764160,"available":92902027264,"internally_reserved":0,"allocated":3591991296,"data_stored":3591052876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509663,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5289824,"kb_used_data":5142104,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":89082016,"statfs":{"total":96636764160,"available":91219984384,"internally_reserved":0,"allocated":5265514496,"data_stored":5264580072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509662,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5605036,"kb_used_data":5469796,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":88766804,"statfs":{"total":96636764160,"available":90897207296,"internally_reserved":0,"allocated":5601071104,"data_stored":5600125202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509662,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4081496,"kb_used_data":3933776,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90290344,"statfs":{"total":96636764160,"available":92457312256,"internally_reserved":0,"allocated":4028186624,"data_stored":4027260071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509662,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3721624,"kb_used_data":3573904,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90650216,"statfs":{"total":96636764160,"available":92825821184,"internally_reserved":0,"allocated":3659677696,"data_stored":3658751555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542366,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4241136,"kb_used_data":4101736,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":90130704,"statfs":{"total":96636764160,"available":92293840896,"internally_reserved":0,"allocated":4200177664,"data_stored":4199232093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":142735815},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1703936,"data_stored":1691105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1708032,"data_stored":1686786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3657433088,"data_stored":3657433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4026535936,"data_stored":4026531972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5599412224,"data_stored":5599396487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4198510592,"data_stored":4198498877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5263859712,"data_stored":5263851903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3590332416,"data_stored":3590324665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4735373312,"data_stored":4735369477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3741323264,"data_stored":3741319429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:07:10.597 INFO:tasks.ceph:pgid 19.3f last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.598 INFO:tasks.ceph:pgid 19.3e last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.598 INFO:tasks.ceph:pgid 19.3d last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.598 INFO:tasks.ceph:pgid 19.3c last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.598 INFO:tasks.ceph:pgid 19.3b last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.598 INFO:tasks.ceph:pgid 19.3a last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.598 INFO:tasks.ceph:pgid 19.39 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.599 INFO:tasks.ceph:pgid 19.38 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.599 INFO:tasks.ceph:pgid 19.37 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.599 INFO:tasks.ceph:pgid 19.36 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.599 INFO:tasks.ceph:pgid 19.35 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.599 INFO:tasks.ceph:pgid 19.34 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.599 INFO:tasks.ceph:pgid 19.33 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.600 INFO:tasks.ceph:pgid 19.32 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.600 INFO:tasks.ceph:pgid 19.31 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.600 INFO:tasks.ceph:pgid 19.30 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.600 INFO:tasks.ceph:pgid 19.2f last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.600 INFO:tasks.ceph:pgid 19.2e last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.600 INFO:tasks.ceph:pgid 19.2d last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.601 INFO:tasks.ceph:pgid 19.2c last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.601 INFO:tasks.ceph:pgid 19.2b last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.601 INFO:tasks.ceph:pgid 19.2a last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.601 INFO:tasks.ceph:pgid 19.29 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.601 INFO:tasks.ceph:pgid 19.28 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.601 INFO:tasks.ceph:pgid 19.27 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.602 INFO:tasks.ceph:pgid 19.26 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.602 INFO:tasks.ceph:pgid 19.25 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.602 INFO:tasks.ceph:pgid 19.24 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.602 INFO:tasks.ceph:pgid 19.23 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.602 INFO:tasks.ceph:pgid 19.22 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.602 INFO:tasks.ceph:pgid 19.21 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.603 INFO:tasks.ceph:pgid 19.20 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.603 INFO:tasks.ceph:pgid 19.1e last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.603 INFO:tasks.ceph:pgid 18.1f last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.603 INFO:tasks.ceph:pgid 19.1f last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.603 INFO:tasks.ceph:pgid 18.1e last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.603 INFO:tasks.ceph:pgid 19.1c last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.604 INFO:tasks.ceph:pgid 18.1d last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.604 INFO:tasks.ceph:pgid 19.1d last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.604 INFO:tasks.ceph:pgid 18.1c last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.604 INFO:tasks.ceph:pgid 19.1a last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.604 INFO:tasks.ceph:pgid 18.1b last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.604 INFO:tasks.ceph:pgid 19.1b last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.604 INFO:tasks.ceph:pgid 18.1a last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.605 INFO:tasks.ceph:pgid 19.18 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.605 INFO:tasks.ceph:pgid 18.19 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.605 INFO:tasks.ceph:pgid 19.19 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.605 INFO:tasks.ceph:pgid 18.18 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.605 INFO:tasks.ceph:pgid 19.16 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.605 INFO:tasks.ceph:pgid 18.17 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.605 INFO:tasks.ceph:pgid 19.17 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.606 INFO:tasks.ceph:pgid 18.16 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.606 INFO:tasks.ceph:pgid 19.14 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.606 INFO:tasks.ceph:pgid 18.15 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.606 INFO:tasks.ceph:pgid 19.15 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.606 INFO:tasks.ceph:pgid 18.14 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.607 INFO:tasks.ceph:pgid 19.13 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.607 INFO:tasks.ceph:pgid 18.12 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.607 INFO:tasks.ceph:pgid 19.10 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.607 INFO:tasks.ceph:pgid 18.11 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.607 INFO:tasks.ceph:pgid 19.11 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.607 INFO:tasks.ceph:pgid 18.10 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.607 INFO:tasks.ceph:pgid 19.e last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.608 INFO:tasks.ceph:pgid 18.f last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.608 INFO:tasks.ceph:pgid 19.f last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.608 INFO:tasks.ceph:pgid 18.e last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.608 INFO:tasks.ceph:pgid 19.c last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.608 INFO:tasks.ceph:pgid 18.d last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.609 INFO:tasks.ceph:pgid 19.d last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.609 INFO:tasks.ceph:pgid 18.c last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.609 INFO:tasks.ceph:pgid 19.a last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.609 INFO:tasks.ceph:pgid 18.b last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.609 INFO:tasks.ceph:pgid 19.b last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.609 INFO:tasks.ceph:pgid 18.a last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.610 INFO:tasks.ceph:pgid 19.8 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.610 INFO:tasks.ceph:pgid 18.9 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.610 INFO:tasks.ceph:pgid 19.9 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.610 INFO:tasks.ceph:pgid 18.8 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.610 INFO:tasks.ceph:pgid 19.6 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.610 INFO:tasks.ceph:pgid 18.7 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.610 INFO:tasks.ceph:pgid 19.7 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.611 INFO:tasks.ceph:pgid 18.6 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.611 INFO:tasks.ceph:pgid 19.4 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.611 INFO:tasks.ceph:pgid 18.5 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.611 INFO:tasks.ceph:pgid 19.5 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.611 INFO:tasks.ceph:pgid 18.4 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.611 INFO:tasks.ceph:pgid 19.2 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.611 INFO:tasks.ceph:pgid 18.3 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.612 INFO:tasks.ceph:pgid 19.3 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.612 INFO:tasks.ceph:pgid 18.2 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.612 INFO:tasks.ceph:pgid 19.0 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.612 INFO:tasks.ceph:pgid 18.1 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.612 INFO:tasks.ceph:pgid 19.1 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.612 INFO:tasks.ceph:pgid 19.12 last_scrub_stamp 2024-05-30T17:04:26.621980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=26, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.613 INFO:tasks.ceph:pgid 18.13 last_scrub_stamp 2024-05-30T17:04:25.612867+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=4, tm_sec=25, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.613 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-30T16:48:54.044602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=48, tm_sec=54, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=17, tm_min=7, tm_sec=4, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T17:07:10.613 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-30T17:07:30.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T17:07:30.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.767+0000 7f01d0600640 1 Processor -- start 2024-05-30T17:07:30.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.767+0000 7f01d0600640 1 -- start start 2024-05-30T17:07:30.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.767+0000 7f01d0600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f01c80cfa40 0x7f01c815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:30.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.767+0000 7f01d0600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01c80cfe20 0x7f01c80b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:30.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01d0600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c815f3b0 con 0x7f01c80b3dd0 2024-05-30T17:07:30.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01d0600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f01c815f690 con 0x7f01c80cfe20 2024-05-30T17:07:30.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01d0600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f01c815f970 con 0x7f01c80cfa40 2024-05-30T17:07:30.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01cd200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01c80cfe20 0x7f01c80b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:30.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01ce600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f01c80b3dd0 0x7f01c8072060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58294/0 (socket says 172.21.15.59:58294) 2024-05-30T17:07:30.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01ce600640 1 -- 172.21.15.59:0/451251 learned_addr learned my addr 172.21.15.59:0/451251 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:30.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01cdc00640 1 --2- 172.21.15.59:0/451251 >> v2:172.21.15.107:3300/0 conn(0x7f01c80cfa40 0x7f01c815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:30.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01cd200640 1 -- 172.21.15.59:0/451251 >> v2:172.21.15.107:3300/0 conn(0x7f01c80cfa40 msgr2=0x7f01c815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:30.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01cd200640 1 --2- 172.21.15.59:0/451251 >> v2:172.21.15.107:3300/0 conn(0x7f01c80cfa40 0x7f01c815ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:30.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01cd200640 1 -- 172.21.15.59:0/451251 >> v1:172.21.15.59:6789/0 conn(0x7f01c80b3dd0 legacy=0x7f01c8072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:30.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01cd200640 1 -- 172.21.15.59:0/451251 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c80b3370 con 0x7f01c80cfe20 2024-05-30T17:07:30.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01c7e00640 1 -- 172.21.15.59:0/451251 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709891192 0 0) 0x7f01c815f3b0 con 0x7f01c80b3dd0 2024-05-30T17:07:30.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.771+0000 7f01cd200640 1 --2- 172.21.15.59:0/451251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c80cfe20 0x7f01c80b3890 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f01c806d820 tx=0x7f01b401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fa23e9bcb2eb03 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01c7e00640 1 -- 172.21.15.59:0/451251 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b40b1070 con 0x7f01c80cfe20 2024-05-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01c7e00640 1 -- 172.21.15.59:0/451251 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b40ac5f0 con 0x7f01c80cfe20 2024-05-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01c7e00640 1 -- 172.21.15.59:0/451251 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b40ac9c0 con 0x7f01c80cfe20 2024-05-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 -- 172.21.15.59:0/451251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c80cfe20 msgr2=0x7f01c80b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 --2- 172.21.15.59:0/451251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c80cfe20 0x7f01c80b3890 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f01c806d820 tx=0x7f01b401c480 comp rx=0 tx=0).stop 2024-05-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 -- 172.21.15.59:0/451251 shutdown_connections 2024-05-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 --2- 172.21.15.59:0/451251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c80cfe20 0x7f01c80b3890 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:30.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 --2- 172.21.15.59:0/451251 >> v2:172.21.15.107:3300/0 conn(0x7f01c80cfa40 0x7f01c815ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:30.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 -- 172.21.15.59:0/451251 >> 172.21.15.59:0/451251 conn(0x7f01c80b22d0 msgr2=0x7f01c80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:30.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 -- 172.21.15.59:0/451251 shutdown_connections 2024-05-30T17:07:30.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 -- 172.21.15.59:0/451251 wait complete. 2024-05-30T17:07:30.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 Processor -- start 2024-05-30T17:07:30.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 -- start start 2024-05-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01c80b3dd0 0x7f01c81481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01c80cfa40 0x7f01c8152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c80cfe20 0x7f01c8072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8155210 con 0x7f01c80cfe20 2024-05-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8155090 con 0x7f01c80b3dd0 2024-05-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01d0600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f01c8155390 con 0x7f01c80cfa40 2024-05-30T17:07:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01ce600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c80cfe20 0x7f01c8072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01ce600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c80cfe20 0x7f01c8072980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39182/0 (socket says 172.21.15.59:39182) 2024-05-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01ce600640 1 -- 172.21.15.59:0/4083741906 learned_addr learned my addr 172.21.15.59:0/4083741906 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01cd200640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01c80cfa40 0x7f01c8152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.775+0000 7f01cdc00640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01c80b3dd0 0x7f01c81481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01ce600640 1 -- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01c80cfa40 msgr2=0x7f01c8152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01ce600640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01c80cfa40 0x7f01c8152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01ce600640 1 -- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01c80b3dd0 msgr2=0x7f01c81481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01ce600640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01c80b3dd0 0x7f01c81481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01ce600640 1 -- 172.21.15.59:0/4083741906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c814b3b0 con 0x7f01c80cfe20 2024-05-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01ce600640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c80cfe20 0x7f01c8072980 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f01c000c7d0 tx=0x7f01c000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01c5600640 1 -- 172.21.15.59:0/4083741906 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c0018070 con 0x7f01c80cfe20 2024-05-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01c5600640 1 -- 172.21.15.59:0/4083741906 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01c000a640 con 0x7f01c80cfe20 2024-05-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01c5600640 1 -- 172.21.15.59:0/4083741906 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c000aa70 con 0x7f01c80cfe20 2024-05-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01d0600640 1 -- 172.21.15.59:0/4083741906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c8148720 con 0x7f01c80cfe20 2024-05-30T17:07:30.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01d0600640 1 -- 172.21.15.59:0/4083741906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c814b900 con 0x7f01c80cfe20 2024-05-30T17:07:30.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01d0600640 1 -- 172.21.15.59:0/4083741906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c8068a90 con 0x7f01c80cfe20 2024-05-30T17:07:30.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01c5600640 1 -- 172.21.15.59:0/4083741906 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 47) ==== 90588+0+0 (secure 0 0 0) 0x7f01c001b070 con 0x7f01c80cfe20 2024-05-30T17:07:30.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01c5600640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f01a806a030 0x7f01a806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:30.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.779+0000 7f01c5600640 1 -- 172.21.15.59:0/4083741906 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f01c0084f60 con 0x7f01c80cfe20 2024-05-30T17:07:30.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.783+0000 7f01cdc00640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f01a806a030 0x7f01a806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:30.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.783+0000 7f01cdc00640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f01a806a030 0x7f01a806c4f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009b60 tx=0x7f01bc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.787+0000 7f01c5600640 1 -- 172.21.15.59:0/4083741906 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01c008f020 con 0x7f01c80cfe20 2024-05-30T17:07:30.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.947+0000 7f01d0600640 1 -- 172.21.15.59:0/4083741906 --> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01c80b5170 con 0x7f01a806a030 2024-05-30T17:07:30.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.955+0000 7f01c5600640 1 -- 172.21.15.59:0/4083741906 <== mgr.4103 v2:172.21.15.107:6832/1203848956 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255747 (secure 0 0 0) 0x7f01c80b5170 con 0x7f01a806a030 2024-05-30T17:07:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:07:30.961 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-05-30T17:07:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.959+0000 7f01d0600640 1 -- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f01a806a030 msgr2=0x7f01a806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.959+0000 7f01d0600640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f01a806a030 0x7f01a806c4f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009b60 tx=0x7f01bc009190 comp rx=0 tx=0).stop 2024-05-30T17:07:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.959+0000 7f01d0600640 1 -- 172.21.15.59:0/4083741906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c80cfe20 msgr2=0x7f01c8072980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.959+0000 7f01d0600640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c80cfe20 0x7f01c8072980 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f01c000c7d0 tx=0x7f01c000cc90 comp rx=0 tx=0).stop 2024-05-30T17:07:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.959+0000 7f01d0600640 1 -- 172.21.15.59:0/4083741906 shutdown_connections 2024-05-30T17:07:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.959+0000 7f01d0600640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f01a806a030 0x7f01a806c4f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.959+0000 7f01d0600640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01c80cfe20 0x7f01c8072980 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.959+0000 7f01d0600640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01c80cfa40 0x7f01c8152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.959+0000 7f01d0600640 1 --2- 172.21.15.59:0/4083741906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01c80b3dd0 0x7f01c81481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.959+0000 7f01d0600640 1 -- 172.21.15.59:0/4083741906 >> 172.21.15.59:0/4083741906 conn(0x7f01c80b22d0 msgr2=0x7f01c80b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.959+0000 7f01d0600640 1 -- 172.21.15.59:0/4083741906 shutdown_connections 2024-05-30T17:07:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:30.959+0000 7f01d0600640 1 -- 172.21.15.59:0/4083741906 wait complete. 2024-05-30T17:07:30.981 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":685,"stamp":"2024-05-30T17:07:29.442014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":17408645502,"num_objects":4183,"num_object_clones":1,"num_object_copies":8366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4183,"num_whiteouts":1,"num_read":4157,"num_read_kb":16171201,"num_write":6090,"num_write_kb":19198219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5499,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13687,"ondisk_log_size":13687,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":35133640,"kb_used_data":34014280,"kb_used_omap":12,"kb_used_meta":1119283,"kb_avail":719841080,"statfs":{"total":773094113280,"available":737117265920,"internally_reserved":0,"allocated":34830622720,"data_stored":34823115796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1146146352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003027"},"pg_stats":[{"pgid":"19.3f","version":"133'207","reported_seq":308,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:17.703944+0000","last_change":"2024-05-30T17:07:17.704016+0000","last_active":"2024-05-30T17:07:17.703944+0000","last_peered":"2024-05-30T17:07:17.703944+0000","last_clean":"2024-05-30T17:07:17.703944+0000","last_became_active":"2024-05-30T17:04:48.283571+0000","last_became_peered":"2024-05-30T17:04:48.283571+0000","last_unstale":"2024-05-30T17:07:17.703944+0000","last_undegraded":"2024-05-30T17:07:17.703944+0000","last_fullsized":"2024-05-30T17:07:17.703944+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'207","last_scrub_stamp":"2024-05-30T17:07:17.703804+0000","last_deep_scrub":"133'207","last_deep_scrub_stamp":"2024-05-30T17:07:17.703804+0000","last_clean_scrub_stamp":"2024-05-30T17:07:17.703804+0000","objects_scrubbed":60,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:22:13.873946+0000","scrub_duration":819,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":80,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3e","version":"133'226","reported_seq":322,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:18.690507+0000","last_change":"2024-05-30T17:07:18.690632+0000","last_active":"2024-05-30T17:07:18.690507+0000","last_peered":"2024-05-30T17:07:18.690507+0000","last_clean":"2024-05-30T17:07:18.690507+0000","last_became_active":"2024-05-30T17:04:27.649831+0000","last_became_peered":"2024-05-30T17:04:27.649831+0000","last_unstale":"2024-05-30T17:07:18.690507+0000","last_undegraded":"2024-05-30T17:07:18.690507+0000","last_fullsized":"2024-05-30T17:07:18.690507+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'226","last_scrub_stamp":"2024-05-30T17:07:18.690382+0000","last_deep_scrub":"133'226","last_deep_scrub_stamp":"2024-05-30T17:07:18.690382+0000","last_clean_scrub_stamp":"2024-05-30T17:07:18.690382+0000","objects_scrubbed":74,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:54:42.109144+0000","scrub_duration":951,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":92,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"133'210","reported_seq":306,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:15.642333+0000","last_change":"2024-05-30T17:07:15.642394+0000","last_active":"2024-05-30T17:07:15.642333+0000","last_peered":"2024-05-30T17:07:15.642333+0000","last_clean":"2024-05-30T17:07:15.642333+0000","last_became_active":"2024-05-30T17:04:27.661891+0000","last_became_peered":"2024-05-30T17:04:27.661891+0000","last_unstale":"2024-05-30T17:07:15.642333+0000","last_undegraded":"2024-05-30T17:07:15.642333+0000","last_fullsized":"2024-05-30T17:07:15.642333+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'210","last_scrub_stamp":"2024-05-30T17:07:15.642271+0000","last_deep_scrub":"133'210","last_deep_scrub_stamp":"2024-05-30T17:07:15.642271+0000","last_clean_scrub_stamp":"2024-05-30T17:07:15.642271+0000","objects_scrubbed":68,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:37:26.925726+0000","scrub_duration":755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":68,"num_read_kb":253958,"num_write":88,"num_write_kb":307203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"133'204","reported_seq":278,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:16.761732+0000","last_change":"2024-05-30T17:07:16.761932+0000","last_active":"2024-05-30T17:07:16.761732+0000","last_peered":"2024-05-30T17:07:16.761732+0000","last_clean":"2024-05-30T17:07:16.761732+0000","last_became_active":"2024-05-30T17:04:27.655516+0000","last_became_peered":"2024-05-30T17:04:27.655516+0000","last_unstale":"2024-05-30T17:07:16.761732+0000","last_undegraded":"2024-05-30T17:07:16.761732+0000","last_fullsized":"2024-05-30T17:07:16.761732+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'204","last_scrub_stamp":"2024-05-30T17:07:16.761625+0000","last_deep_scrub":"133'204","last_deep_scrub_stamp":"2024-05-30T17:07:16.761625+0000","last_clean_scrub_stamp":"2024-05-30T17:07:16.761625+0000","objects_scrubbed":64,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:18:42.497030+0000","scrub_duration":835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":46,"num_read_kb":176131,"num_write":84,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"133'186","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:23.354711+0000","last_change":"2024-05-30T17:07:23.354746+0000","last_active":"2024-05-30T17:07:23.354711+0000","last_peered":"2024-05-30T17:07:23.354711+0000","last_clean":"2024-05-30T17:07:23.354711+0000","last_became_active":"2024-05-30T17:04:27.667959+0000","last_became_peered":"2024-05-30T17:04:27.667959+0000","last_unstale":"2024-05-30T17:07:23.354711+0000","last_undegraded":"2024-05-30T17:07:23.354711+0000","last_fullsized":"2024-05-30T17:07:23.354711+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'186","last_scrub_stamp":"2024-05-30T17:07:23.354613+0000","last_deep_scrub":"133'186","last_deep_scrub_stamp":"2024-05-30T17:07:23.354613+0000","last_clean_scrub_stamp":"2024-05-30T17:07:23.354613+0000","objects_scrubbed":57,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:42:32.777438+0000","scrub_duration":415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":38,"num_read_kb":155648,"num_write":75,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"133'230","reported_seq":345,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:18.420969+0000","last_change":"2024-05-30T17:07:18.421008+0000","last_active":"2024-05-30T17:07:18.420969+0000","last_peered":"2024-05-30T17:07:18.420969+0000","last_clean":"2024-05-30T17:07:18.420969+0000","last_became_active":"2024-05-30T17:04:27.662304+0000","last_became_peered":"2024-05-30T17:04:27.662304+0000","last_unstale":"2024-05-30T17:07:18.420969+0000","last_undegraded":"2024-05-30T17:07:18.420969+0000","last_fullsized":"2024-05-30T17:07:18.420969+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'230","last_scrub_stamp":"2024-05-30T17:07:18.420889+0000","last_deep_scrub":"133'230","last_deep_scrub_stamp":"2024-05-30T17:07:18.420889+0000","last_clean_scrub_stamp":"2024-05-30T17:07:18.420889+0000","objects_scrubbed":80,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:26.190041+0000","scrub_duration":1055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":94,"num_write_kb":352257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"133'200","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:13.899419+0000","last_change":"2024-05-30T17:07:13.899448+0000","last_active":"2024-05-30T17:07:13.899419+0000","last_peered":"2024-05-30T17:07:13.899419+0000","last_clean":"2024-05-30T17:07:13.899419+0000","last_became_active":"2024-05-30T17:04:27.649935+0000","last_became_peered":"2024-05-30T17:04:27.649935+0000","last_unstale":"2024-05-30T17:07:13.899419+0000","last_undegraded":"2024-05-30T17:07:13.899419+0000","last_fullsized":"2024-05-30T17:07:13.899419+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'200","last_scrub_stamp":"2024-05-30T17:07:13.899354+0000","last_deep_scrub":"133'200","last_deep_scrub_stamp":"2024-05-30T17:07:13.899354+0000","last_clean_scrub_stamp":"2024-05-30T17:07:13.899354+0000","objects_scrubbed":52,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:37:25.182810+0000","scrub_duration":507,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":47,"num_read_kb":192512,"num_write":78,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"133'193","reported_seq":272,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:13.596537+0000","last_change":"2024-05-30T17:07:13.596605+0000","last_active":"2024-05-30T17:07:13.596537+0000","last_peered":"2024-05-30T17:07:13.596537+0000","last_clean":"2024-05-30T17:07:13.596537+0000","last_became_active":"2024-05-30T17:04:27.653784+0000","last_became_peered":"2024-05-30T17:04:27.653784+0000","last_unstale":"2024-05-30T17:07:13.596537+0000","last_undegraded":"2024-05-30T17:07:13.596537+0000","last_fullsized":"2024-05-30T17:07:13.596537+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'193","last_scrub_stamp":"2024-05-30T17:07:13.596469+0000","last_deep_scrub":"133'193","last_deep_scrub_stamp":"2024-05-30T17:07:13.596469+0000","last_clean_scrub_stamp":"2024-05-30T17:07:13.596469+0000","objects_scrubbed":71,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:26:41.289938+0000","scrub_duration":699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":91,"num_write_kb":331776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"133'199","reported_seq":277,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:20.429022+0000","last_change":"2024-05-30T17:07:20.429080+0000","last_active":"2024-05-30T17:07:20.429022+0000","last_peered":"2024-05-30T17:07:20.429022+0000","last_clean":"2024-05-30T17:07:20.429022+0000","last_became_active":"2024-05-30T17:04:27.667374+0000","last_became_peered":"2024-05-30T17:04:27.667374+0000","last_unstale":"2024-05-30T17:07:20.429022+0000","last_undegraded":"2024-05-30T17:07:20.429022+0000","last_fullsized":"2024-05-30T17:07:20.429022+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'199","last_scrub_stamp":"2024-05-30T17:07:20.428923+0000","last_deep_scrub":"133'199","last_deep_scrub_stamp":"2024-05-30T17:07:20.428923+0000","last_clean_scrub_stamp":"2024-05-30T17:07:20.428923+0000","objects_scrubbed":61,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:20:06.391123+0000","scrub_duration":543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":50,"num_read_kb":204800,"num_write":77,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"133'192","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:16.525328+0000","last_change":"2024-05-30T17:07:16.525410+0000","last_active":"2024-05-30T17:07:16.525328+0000","last_peered":"2024-05-30T17:07:16.525328+0000","last_clean":"2024-05-30T17:07:16.525328+0000","last_became_active":"2024-05-30T17:04:27.648603+0000","last_became_peered":"2024-05-30T17:04:27.648603+0000","last_unstale":"2024-05-30T17:07:16.525328+0000","last_undegraded":"2024-05-30T17:07:16.525328+0000","last_fullsized":"2024-05-30T17:07:16.525328+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'192","last_scrub_stamp":"2024-05-30T17:07:16.525209+0000","last_deep_scrub":"133'192","last_deep_scrub_stamp":"2024-05-30T17:07:16.525209+0000","last_clean_scrub_stamp":"2024-05-30T17:07:16.525209+0000","objects_scrubbed":62,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:34.261597+0000","scrub_duration":759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":76,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"133'214","reported_seq":339,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:13.618337+0000","last_change":"2024-05-30T17:07:13.618388+0000","last_active":"2024-05-30T17:07:13.618337+0000","last_peered":"2024-05-30T17:07:13.618337+0000","last_clean":"2024-05-30T17:07:13.618337+0000","last_became_active":"2024-05-30T17:04:27.660883+0000","last_became_peered":"2024-05-30T17:04:27.660883+0000","last_unstale":"2024-05-30T17:07:13.618337+0000","last_undegraded":"2024-05-30T17:07:13.618337+0000","last_fullsized":"2024-05-30T17:07:13.618337+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'214","last_scrub_stamp":"2024-05-30T17:07:13.618203+0000","last_deep_scrub":"133'214","last_deep_scrub_stamp":"2024-05-30T17:07:13.618203+0000","last_clean_scrub_stamp":"2024-05-30T17:07:13.618203+0000","objects_scrubbed":75,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:15:53.507851+0000","scrub_duration":735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":96,"num_read_kb":393216,"num_write":91,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"133'169","reported_seq":290,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:19.472366+0000","last_change":"2024-05-30T17:07:19.472406+0000","last_active":"2024-05-30T17:07:19.472366+0000","last_peered":"2024-05-30T17:07:19.472366+0000","last_clean":"2024-05-30T17:07:19.472366+0000","last_became_active":"2024-05-30T17:04:27.665266+0000","last_became_peered":"2024-05-30T17:04:27.665266+0000","last_unstale":"2024-05-30T17:07:19.472366+0000","last_undegraded":"2024-05-30T17:07:19.472366+0000","last_fullsized":"2024-05-30T17:07:19.472366+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'169","last_scrub_stamp":"2024-05-30T17:07:19.472282+0000","last_deep_scrub":"133'169","last_deep_scrub_stamp":"2024-05-30T17:07:19.472282+0000","last_clean_scrub_stamp":"2024-05-30T17:07:19.472282+0000","objects_scrubbed":58,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:18:33.577915+0000","scrub_duration":599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":93,"num_read_kb":364548,"num_write":70,"num_write_kb":258049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"133'187","reported_seq":297,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:15.684559+0000","last_change":"2024-05-30T17:07:15.684635+0000","last_active":"2024-05-30T17:07:15.684559+0000","last_peered":"2024-05-30T17:07:15.684559+0000","last_clean":"2024-05-30T17:07:15.684559+0000","last_became_active":"2024-05-30T17:04:27.655046+0000","last_became_peered":"2024-05-30T17:04:27.655046+0000","last_unstale":"2024-05-30T17:07:15.684559+0000","last_undegraded":"2024-05-30T17:07:15.684559+0000","last_fullsized":"2024-05-30T17:07:15.684559+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'187","last_scrub_stamp":"2024-05-30T17:07:15.684474+0000","last_deep_scrub":"133'187","last_deep_scrub_stamp":"2024-05-30T17:07:15.684474+0000","last_clean_scrub_stamp":"2024-05-30T17:07:15.684474+0000","objects_scrubbed":64,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:20:38.737606+0000","scrub_duration":727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":82,"num_read_kb":335872,"num_write":80,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"133'205","reported_seq":295,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:23.309309+0000","last_change":"2024-05-30T17:07:23.309378+0000","last_active":"2024-05-30T17:07:23.309309+0000","last_peered":"2024-05-30T17:07:23.309309+0000","last_clean":"2024-05-30T17:07:23.309309+0000","last_became_active":"2024-05-30T17:04:27.659965+0000","last_became_peered":"2024-05-30T17:04:27.659965+0000","last_unstale":"2024-05-30T17:07:23.309309+0000","last_undegraded":"2024-05-30T17:07:23.309309+0000","last_fullsized":"2024-05-30T17:07:23.309309+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'205","last_scrub_stamp":"2024-05-30T17:07:23.309235+0000","last_deep_scrub":"133'205","last_deep_scrub_stamp":"2024-05-30T17:07:23.309235+0000","last_clean_scrub_stamp":"2024-05-30T17:07:23.309235+0000","objects_scrubbed":66,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:10:37.668469+0000","scrub_duration":463,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629892,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":62,"num_read_kb":249857,"num_write":78,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"133'174","reported_seq":232,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:10.347161+0000","last_change":"2024-05-30T17:07:10.347213+0000","last_active":"2024-05-30T17:07:10.347161+0000","last_peered":"2024-05-30T17:07:10.347161+0000","last_clean":"2024-05-30T17:07:10.347161+0000","last_became_active":"2024-05-30T17:04:27.650330+0000","last_became_peered":"2024-05-30T17:04:27.650330+0000","last_unstale":"2024-05-30T17:07:10.347161+0000","last_undegraded":"2024-05-30T17:07:10.347161+0000","last_fullsized":"2024-05-30T17:07:10.347161+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'174","last_scrub_stamp":"2024-05-30T17:07:10.347066+0000","last_deep_scrub":"133'174","last_deep_scrub_stamp":"2024-05-30T17:07:10.347066+0000","last_clean_scrub_stamp":"2024-05-30T17:07:10.347066+0000","objects_scrubbed":52,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:08:28.783318+0000","scrub_duration":323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":30,"num_read_kb":122880,"num_write":68,"num_write_kb":245760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"133'200","reported_seq":281,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:18.047412+0000","last_change":"2024-05-30T17:07:18.047514+0000","last_active":"2024-05-30T17:07:18.047412+0000","last_peered":"2024-05-30T17:07:18.047412+0000","last_clean":"2024-05-30T17:07:18.047412+0000","last_became_active":"2024-05-30T17:04:27.656141+0000","last_became_peered":"2024-05-30T17:04:27.656141+0000","last_unstale":"2024-05-30T17:07:18.047412+0000","last_undegraded":"2024-05-30T17:07:18.047412+0000","last_fullsized":"2024-05-30T17:07:18.047412+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'200","last_scrub_stamp":"2024-05-30T17:07:18.047285+0000","last_deep_scrub":"133'200","last_deep_scrub_stamp":"2024-05-30T17:07:18.047285+0000","last_clean_scrub_stamp":"2024-05-30T17:07:18.047285+0000","objects_scrubbed":62,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:28.716853+0000","scrub_duration":799,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":53,"num_read_kb":217088,"num_write":82,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"133'190","reported_seq":260,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:14.943706+0000","last_change":"2024-05-30T17:07:14.943744+0000","last_active":"2024-05-30T17:07:14.943706+0000","last_peered":"2024-05-30T17:07:14.943706+0000","last_clean":"2024-05-30T17:07:14.943706+0000","last_became_active":"2024-05-30T17:04:27.654786+0000","last_became_peered":"2024-05-30T17:04:27.654786+0000","last_unstale":"2024-05-30T17:07:14.943706+0000","last_undegraded":"2024-05-30T17:07:14.943706+0000","last_fullsized":"2024-05-30T17:07:14.943706+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'190","last_scrub_stamp":"2024-05-30T17:07:14.943617+0000","last_deep_scrub":"133'190","last_deep_scrub_stamp":"2024-05-30T17:07:14.943617+0000","last_clean_scrub_stamp":"2024-05-30T17:07:14.943617+0000","objects_scrubbed":59,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:41:55.029519+0000","scrub_duration":547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":77,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"133'201","reported_seq":319,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:15.996532+0000","last_change":"2024-05-30T17:07:15.996616+0000","last_active":"2024-05-30T17:07:15.996532+0000","last_peered":"2024-05-30T17:07:15.996532+0000","last_clean":"2024-05-30T17:07:15.996532+0000","last_became_active":"2024-05-30T17:04:27.649462+0000","last_became_peered":"2024-05-30T17:04:27.649462+0000","last_unstale":"2024-05-30T17:07:15.996532+0000","last_undegraded":"2024-05-30T17:07:15.996532+0000","last_fullsized":"2024-05-30T17:07:15.996532+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'201","last_scrub_stamp":"2024-05-30T17:07:15.996392+0000","last_deep_scrub":"133'201","last_deep_scrub_stamp":"2024-05-30T17:07:15.996392+0000","last_clean_scrub_stamp":"2024-05-30T17:07:15.996392+0000","objects_scrubbed":68,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:51.309752+0000","scrub_duration":755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":90,"num_read_kb":352260,"num_write":88,"num_write_kb":311298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"133'209","reported_seq":309,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:12.502617+0000","last_change":"2024-05-30T17:07:12.502657+0000","last_active":"2024-05-30T17:07:12.502617+0000","last_peered":"2024-05-30T17:07:12.502617+0000","last_clean":"2024-05-30T17:07:12.502617+0000","last_became_active":"2024-05-30T17:04:27.660532+0000","last_became_peered":"2024-05-30T17:04:27.660532+0000","last_unstale":"2024-05-30T17:07:12.502617+0000","last_undegraded":"2024-05-30T17:07:12.502617+0000","last_fullsized":"2024-05-30T17:07:12.502617+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'209","last_scrub_stamp":"2024-05-30T17:07:12.502555+0000","last_deep_scrub":"133'209","last_deep_scrub_stamp":"2024-05-30T17:07:12.502555+0000","last_clean_scrub_stamp":"2024-05-30T17:07:12.502555+0000","objects_scrubbed":66,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:20:43.323697+0000","scrub_duration":575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":71,"num_read_kb":278531,"num_write":90,"num_write_kb":315393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"133'215","reported_seq":300,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:17.165302+0000","last_change":"2024-05-30T17:07:17.165365+0000","last_active":"2024-05-30T17:07:17.165302+0000","last_peered":"2024-05-30T17:07:17.165302+0000","last_clean":"2024-05-30T17:07:17.165302+0000","last_became_active":"2024-05-30T17:04:27.652097+0000","last_became_peered":"2024-05-30T17:04:27.652097+0000","last_unstale":"2024-05-30T17:07:17.165302+0000","last_undegraded":"2024-05-30T17:07:17.165302+0000","last_fullsized":"2024-05-30T17:07:17.165302+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'215","last_scrub_stamp":"2024-05-30T17:07:17.165204+0000","last_deep_scrub":"133'215","last_deep_scrub_stamp":"2024-05-30T17:07:17.165204+0000","last_clean_scrub_stamp":"2024-05-30T17:07:17.165204+0000","objects_scrubbed":68,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:09:20.453627+0000","scrub_duration":883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":84,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"133'218","reported_seq":337,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:24.498123+0000","last_change":"2024-05-30T17:07:24.498146+0000","last_active":"2024-05-30T17:07:24.498123+0000","last_peered":"2024-05-30T17:07:24.498123+0000","last_clean":"2024-05-30T17:07:24.498123+0000","last_became_active":"2024-05-30T17:04:27.667647+0000","last_became_peered":"2024-05-30T17:04:27.667647+0000","last_unstale":"2024-05-30T17:07:24.498123+0000","last_undegraded":"2024-05-30T17:07:24.498123+0000","last_fullsized":"2024-05-30T17:07:24.498123+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'218","last_scrub_stamp":"2024-05-30T17:07:24.498049+0000","last_deep_scrub":"133'218","last_deep_scrub_stamp":"2024-05-30T17:07:24.498049+0000","last_clean_scrub_stamp":"2024-05-30T17:07:24.498049+0000","objects_scrubbed":75,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:37:57.699852+0000","scrub_duration":527,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":90,"num_read_kb":364545,"num_write":97,"num_write_kb":348161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"133'194","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:14.537630+0000","last_change":"2024-05-30T17:07:14.537693+0000","last_active":"2024-05-30T17:07:14.537630+0000","last_peered":"2024-05-30T17:07:14.537630+0000","last_clean":"2024-05-30T17:07:14.537630+0000","last_became_active":"2024-05-30T17:04:27.662501+0000","last_became_peered":"2024-05-30T17:04:27.662501+0000","last_unstale":"2024-05-30T17:07:14.537630+0000","last_undegraded":"2024-05-30T17:07:14.537630+0000","last_fullsized":"2024-05-30T17:07:14.537630+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'194","last_scrub_stamp":"2024-05-30T17:07:14.537560+0000","last_deep_scrub":"133'194","last_deep_scrub_stamp":"2024-05-30T17:07:14.537560+0000","last_clean_scrub_stamp":"2024-05-30T17:07:14.537560+0000","objects_scrubbed":62,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:52.554903+0000","scrub_duration":667,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":57,"num_read_kb":229377,"num_write":78,"num_write_kb":282625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"133'212","reported_seq":292,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:17.651982+0000","last_change":"2024-05-30T17:07:17.652085+0000","last_active":"2024-05-30T17:07:17.651982+0000","last_peered":"2024-05-30T17:07:17.651982+0000","last_clean":"2024-05-30T17:07:17.651982+0000","last_became_active":"2024-05-30T17:04:27.663243+0000","last_became_peered":"2024-05-30T17:04:27.663243+0000","last_unstale":"2024-05-30T17:07:17.651982+0000","last_undegraded":"2024-05-30T17:07:17.651982+0000","last_fullsized":"2024-05-30T17:07:17.651982+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'212","last_scrub_stamp":"2024-05-30T17:07:17.651914+0000","last_deep_scrub":"133'212","last_deep_scrub_stamp":"2024-05-30T17:07:17.651914+0000","last_clean_scrub_stamp":"2024-05-30T17:07:17.651914+0000","objects_scrubbed":65,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:11:16.011008+0000","scrub_duration":779,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":93,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"133'214","reported_seq":294,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:15.726952+0000","last_change":"2024-05-30T17:07:15.727012+0000","last_active":"2024-05-30T17:07:15.726952+0000","last_peered":"2024-05-30T17:07:15.726952+0000","last_clean":"2024-05-30T17:07:15.726952+0000","last_became_active":"2024-05-30T17:04:27.663855+0000","last_became_peered":"2024-05-30T17:04:27.663855+0000","last_unstale":"2024-05-30T17:07:15.726952+0000","last_undegraded":"2024-05-30T17:07:15.726952+0000","last_fullsized":"2024-05-30T17:07:15.726952+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'214","last_scrub_stamp":"2024-05-30T17:07:15.726883+0000","last_deep_scrub":"133'214","last_deep_scrub_stamp":"2024-05-30T17:07:15.726883+0000","last_clean_scrub_stamp":"2024-05-30T17:07:15.726883+0000","objects_scrubbed":73,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:00:15.779772+0000","scrub_duration":819,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":52,"num_read_kb":212992,"num_write":85,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"133'205","reported_seq":299,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:20.270064+0000","last_change":"2024-05-30T17:07:20.270136+0000","last_active":"2024-05-30T17:07:20.270064+0000","last_peered":"2024-05-30T17:07:20.270064+0000","last_clean":"2024-05-30T17:07:20.270064+0000","last_became_active":"2024-05-30T17:04:27.653397+0000","last_became_peered":"2024-05-30T17:04:27.653397+0000","last_unstale":"2024-05-30T17:07:20.270064+0000","last_undegraded":"2024-05-30T17:07:20.270064+0000","last_fullsized":"2024-05-30T17:07:20.270064+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'205","last_scrub_stamp":"2024-05-30T17:07:20.269963+0000","last_deep_scrub":"133'205","last_deep_scrub_stamp":"2024-05-30T17:07:20.269963+0000","last_clean_scrub_stamp":"2024-05-30T17:07:20.269963+0000","objects_scrubbed":60,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:20:31.490770+0000","scrub_duration":467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":66,"num_read_kb":253956,"num_write":74,"num_write_kb":266242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"133'222","reported_seq":313,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:19.044321+0000","last_change":"2024-05-30T17:07:19.044375+0000","last_active":"2024-05-30T17:07:19.044321+0000","last_peered":"2024-05-30T17:07:19.044321+0000","last_clean":"2024-05-30T17:07:19.044321+0000","last_became_active":"2024-05-30T17:04:27.656941+0000","last_became_peered":"2024-05-30T17:04:27.656941+0000","last_unstale":"2024-05-30T17:07:19.044321+0000","last_undegraded":"2024-05-30T17:07:19.044321+0000","last_fullsized":"2024-05-30T17:07:19.044321+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'222","last_scrub_stamp":"2024-05-30T17:07:19.044248+0000","last_deep_scrub":"133'222","last_deep_scrub_stamp":"2024-05-30T17:07:19.044248+0000","last_clean_scrub_stamp":"2024-05-30T17:07:19.044248+0000","objects_scrubbed":64,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:14:42.601592+0000","scrub_duration":831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":86,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"133'194","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:16.764596+0000","last_change":"2024-05-30T17:07:16.764660+0000","last_active":"2024-05-30T17:07:16.764596+0000","last_peered":"2024-05-30T17:07:16.764596+0000","last_clean":"2024-05-30T17:07:16.764596+0000","last_became_active":"2024-05-30T17:04:48.283505+0000","last_became_peered":"2024-05-30T17:04:48.283505+0000","last_unstale":"2024-05-30T17:07:16.764596+0000","last_undegraded":"2024-05-30T17:07:16.764596+0000","last_fullsized":"2024-05-30T17:07:16.764596+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'194","last_scrub_stamp":"2024-05-30T17:07:16.764526+0000","last_deep_scrub":"133'194","last_deep_scrub_stamp":"2024-05-30T17:07:16.764526+0000","last_clean_scrub_stamp":"2024-05-30T17:07:16.764526+0000","objects_scrubbed":67,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:46:26.259386+0000","scrub_duration":871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":77,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.24","version":"133'186","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:17.200250+0000","last_change":"2024-05-30T17:07:17.200325+0000","last_active":"2024-05-30T17:07:17.200250+0000","last_peered":"2024-05-30T17:07:17.200250+0000","last_clean":"2024-05-30T17:07:17.200250+0000","last_became_active":"2024-05-30T17:04:27.664502+0000","last_became_peered":"2024-05-30T17:04:27.664502+0000","last_unstale":"2024-05-30T17:07:17.200250+0000","last_undegraded":"2024-05-30T17:07:17.200250+0000","last_fullsized":"2024-05-30T17:07:17.200250+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'186","last_scrub_stamp":"2024-05-30T17:07:17.200145+0000","last_deep_scrub":"133'186","last_deep_scrub_stamp":"2024-05-30T17:07:17.200145+0000","last_clean_scrub_stamp":"2024-05-30T17:07:17.200145+0000","objects_scrubbed":60,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:57:17.518803+0000","scrub_duration":803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":32,"num_read_kb":131072,"num_write":80,"num_write_kb":282625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"133'211","reported_seq":307,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:11.403735+0000","last_change":"2024-05-30T17:07:11.403789+0000","last_active":"2024-05-30T17:07:11.403735+0000","last_peered":"2024-05-30T17:07:11.403735+0000","last_clean":"2024-05-30T17:07:11.403735+0000","last_became_active":"2024-05-30T17:04:27.653960+0000","last_became_peered":"2024-05-30T17:04:27.653960+0000","last_unstale":"2024-05-30T17:07:11.403735+0000","last_undegraded":"2024-05-30T17:07:11.403735+0000","last_fullsized":"2024-05-30T17:07:11.403735+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'211","last_scrub_stamp":"2024-05-30T17:07:11.403659+0000","last_deep_scrub":"133'211","last_deep_scrub_stamp":"2024-05-30T17:07:11.403659+0000","last_clean_scrub_stamp":"2024-05-30T17:07:11.403659+0000","objects_scrubbed":69,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:37:15.086149+0000","scrub_duration":423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":83,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"133'214","reported_seq":304,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:14.693224+0000","last_change":"2024-05-30T17:07:14.693287+0000","last_active":"2024-05-30T17:07:14.693224+0000","last_peered":"2024-05-30T17:07:14.693224+0000","last_clean":"2024-05-30T17:07:14.693224+0000","last_became_active":"2024-05-30T17:04:27.654299+0000","last_became_peered":"2024-05-30T17:04:27.654299+0000","last_unstale":"2024-05-30T17:07:14.693224+0000","last_undegraded":"2024-05-30T17:07:14.693224+0000","last_fullsized":"2024-05-30T17:07:14.693224+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'214","last_scrub_stamp":"2024-05-30T17:07:14.693136+0000","last_deep_scrub":"133'214","last_deep_scrub_stamp":"2024-05-30T17:07:14.693136+0000","last_clean_scrub_stamp":"2024-05-30T17:07:14.693136+0000","objects_scrubbed":71,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:11:58.713083+0000","scrub_duration":707,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":87,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"133'208","reported_seq":332,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:21.418255+0000","last_change":"2024-05-30T17:07:21.418310+0000","last_active":"2024-05-30T17:07:21.418255+0000","last_peered":"2024-05-30T17:07:21.418255+0000","last_clean":"2024-05-30T17:07:21.418255+0000","last_became_active":"2024-05-30T17:04:27.663462+0000","last_became_peered":"2024-05-30T17:04:27.663462+0000","last_unstale":"2024-05-30T17:07:21.418255+0000","last_undegraded":"2024-05-30T17:07:21.418255+0000","last_fullsized":"2024-05-30T17:07:21.418255+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'208","last_scrub_stamp":"2024-05-30T17:07:21.418176+0000","last_deep_scrub":"133'208","last_deep_scrub_stamp":"2024-05-30T17:07:21.418176+0000","last_clean_scrub_stamp":"2024-05-30T17:07:21.418176+0000","objects_scrubbed":66,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:00:21.471066+0000","scrub_duration":443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":96,"num_read_kb":376836,"num_write":70,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"133'196","reported_seq":293,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:11.795367+0000","last_change":"2024-05-30T17:07:11.795407+0000","last_active":"2024-05-30T17:07:11.795367+0000","last_peered":"2024-05-30T17:07:11.795367+0000","last_clean":"2024-05-30T17:07:11.795367+0000","last_became_active":"2024-05-30T17:04:27.648348+0000","last_became_peered":"2024-05-30T17:04:27.648348+0000","last_unstale":"2024-05-30T17:07:11.795367+0000","last_undegraded":"2024-05-30T17:07:11.795367+0000","last_fullsized":"2024-05-30T17:07:11.795367+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'196","last_scrub_stamp":"2024-05-30T17:07:11.795299+0000","last_deep_scrub":"133'196","last_deep_scrub_stamp":"2024-05-30T17:07:11.795299+0000","last_clean_scrub_stamp":"2024-05-30T17:07:11.795299+0000","objects_scrubbed":60,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:26:39.488768+0000","scrub_duration":375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":69,"num_read_kb":282624,"num_write":74,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"133'190","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:20.699164+0000","last_change":"2024-05-30T17:07:20.699202+0000","last_active":"2024-05-30T17:07:20.699164+0000","last_peered":"2024-05-30T17:07:20.699164+0000","last_clean":"2024-05-30T17:07:20.699164+0000","last_became_active":"2024-05-30T17:04:27.664853+0000","last_became_peered":"2024-05-30T17:04:27.664853+0000","last_unstale":"2024-05-30T17:07:20.699164+0000","last_undegraded":"2024-05-30T17:07:20.699164+0000","last_fullsized":"2024-05-30T17:07:20.699164+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'190","last_scrub_stamp":"2024-05-30T17:07:20.699093+0000","last_deep_scrub":"133'190","last_deep_scrub_stamp":"2024-05-30T17:07:20.699093+0000","last_clean_scrub_stamp":"2024-05-30T17:07:20.699093+0000","objects_scrubbed":58,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:55.604186+0000","scrub_duration":431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":41,"num_read_kb":163841,"num_write":78,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"133'6","reported_seq":34,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:14.102802+0000","last_change":"2024-05-30T17:07:14.102827+0000","last_active":"2024-05-30T17:07:14.102802+0000","last_peered":"2024-05-30T17:07:14.102802+0000","last_clean":"2024-05-30T17:07:14.102802+0000","last_became_active":"2024-05-30T17:04:26.653331+0000","last_became_peered":"2024-05-30T17:04:26.653331+0000","last_unstale":"2024-05-30T17:07:14.102802+0000","last_undegraded":"2024-05-30T17:07:14.102802+0000","last_fullsized":"2024-05-30T17:07:14.102802+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'6","last_scrub_stamp":"2024-05-30T17:07:14.102731+0000","last_deep_scrub":"133'6","last_deep_scrub_stamp":"2024-05-30T17:07:14.102731+0000","last_clean_scrub_stamp":"2024-05-30T17:07:14.102731+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:23.025235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"133'199","reported_seq":294,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:16.733050+0000","last_change":"2024-05-30T17:07:16.733149+0000","last_active":"2024-05-30T17:07:16.733050+0000","last_peered":"2024-05-30T17:07:16.733050+0000","last_clean":"2024-05-30T17:07:16.733050+0000","last_became_active":"2024-05-30T17:04:27.662074+0000","last_became_peered":"2024-05-30T17:04:27.662074+0000","last_unstale":"2024-05-30T17:07:16.733050+0000","last_undegraded":"2024-05-30T17:07:16.733050+0000","last_fullsized":"2024-05-30T17:07:16.733050+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'199","last_scrub_stamp":"2024-05-30T17:07:16.732928+0000","last_deep_scrub":"133'199","last_deep_scrub_stamp":"2024-05-30T17:07:16.732928+0000","last_clean_scrub_stamp":"2024-05-30T17:07:16.732928+0000","objects_scrubbed":65,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:41:56.818830+0000","scrub_duration":831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":67,"num_read_kb":270337,"num_write":83,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"130'1","reported_seq":29,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:11.418456+0000","last_change":"2024-05-30T17:07:11.418477+0000","last_active":"2024-05-30T17:07:11.418456+0000","last_peered":"2024-05-30T17:07:11.418456+0000","last_clean":"2024-05-30T17:07:11.418456+0000","last_became_active":"2024-05-30T17:04:26.652142+0000","last_became_peered":"2024-05-30T17:04:26.652142+0000","last_unstale":"2024-05-30T17:07:11.418456+0000","last_undegraded":"2024-05-30T17:07:11.418456+0000","last_fullsized":"2024-05-30T17:07:11.418456+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'1","last_scrub_stamp":"2024-05-30T17:07:11.418264+0000","last_deep_scrub":"130'1","last_deep_scrub_stamp":"2024-05-30T17:07:11.418264+0000","last_clean_scrub_stamp":"2024-05-30T17:07:11.418264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:24:50.950849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"133'191","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:19.582907+0000","last_change":"2024-05-30T17:07:19.582958+0000","last_active":"2024-05-30T17:07:19.582907+0000","last_peered":"2024-05-30T17:07:19.582907+0000","last_clean":"2024-05-30T17:07:19.582907+0000","last_became_active":"2024-05-30T17:04:27.659049+0000","last_became_peered":"2024-05-30T17:04:27.659049+0000","last_unstale":"2024-05-30T17:07:19.582907+0000","last_undegraded":"2024-05-30T17:07:19.582907+0000","last_fullsized":"2024-05-30T17:07:19.582907+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'191","last_scrub_stamp":"2024-05-30T17:07:19.582832+0000","last_deep_scrub":"133'191","last_deep_scrub_stamp":"2024-05-30T17:07:19.582832+0000","last_clean_scrub_stamp":"2024-05-30T17:07:19.582832+0000","objects_scrubbed":65,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:57.600175+0000","scrub_duration":599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435717,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":77,"num_write_kb":286721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"133'4","reported_seq":32,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:09.942705+0000","last_change":"2024-05-30T17:07:09.942731+0000","last_active":"2024-05-30T17:07:09.942705+0000","last_peered":"2024-05-30T17:07:09.942705+0000","last_clean":"2024-05-30T17:07:09.942705+0000","last_became_active":"2024-05-30T17:04:26.652240+0000","last_became_peered":"2024-05-30T17:04:26.652240+0000","last_unstale":"2024-05-30T17:07:09.942705+0000","last_undegraded":"2024-05-30T17:07:09.942705+0000","last_fullsized":"2024-05-30T17:07:09.942705+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'4","last_scrub_stamp":"2024-05-30T17:07:09.942642+0000","last_deep_scrub":"133'4","last_deep_scrub_stamp":"2024-05-30T17:07:09.942642+0000","last_clean_scrub_stamp":"2024-05-30T17:07:09.942642+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:48:36.189893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"133'214","reported_seq":327,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:18.918711+0000","last_change":"2024-05-30T17:07:18.918789+0000","last_active":"2024-05-30T17:07:18.918711+0000","last_peered":"2024-05-30T17:07:18.918711+0000","last_clean":"2024-05-30T17:07:18.918711+0000","last_became_active":"2024-05-30T17:04:27.659448+0000","last_became_peered":"2024-05-30T17:04:27.659448+0000","last_unstale":"2024-05-30T17:07:18.918711+0000","last_undegraded":"2024-05-30T17:07:18.918711+0000","last_fullsized":"2024-05-30T17:07:18.918711+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'214","last_scrub_stamp":"2024-05-30T17:07:18.918634+0000","last_deep_scrub":"133'214","last_deep_scrub_stamp":"2024-05-30T17:07:18.918634+0000","last_clean_scrub_stamp":"2024-05-30T17:07:18.918634+0000","objects_scrubbed":71,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:15:58.808282+0000","scrub_duration":923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":85,"num_read_kb":348160,"num_write":95,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"133'4","reported_seq":32,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:10.621826+0000","last_change":"2024-05-30T17:07:10.621849+0000","last_active":"2024-05-30T17:07:10.621826+0000","last_peered":"2024-05-30T17:07:10.621826+0000","last_clean":"2024-05-30T17:07:10.621826+0000","last_became_active":"2024-05-30T17:04:26.644381+0000","last_became_peered":"2024-05-30T17:04:26.644381+0000","last_unstale":"2024-05-30T17:07:10.621826+0000","last_undegraded":"2024-05-30T17:07:10.621826+0000","last_fullsized":"2024-05-30T17:07:10.621826+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'4","last_scrub_stamp":"2024-05-30T17:07:10.621755+0000","last_deep_scrub":"133'4","last_deep_scrub_stamp":"2024-05-30T17:07:10.621755+0000","last_clean_scrub_stamp":"2024-05-30T17:07:10.621755+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:11:37.115071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"133'215","reported_seq":297,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:14.916757+0000","last_change":"2024-05-30T17:07:14.916835+0000","last_active":"2024-05-30T17:07:14.916757+0000","last_peered":"2024-05-30T17:07:14.916757+0000","last_clean":"2024-05-30T17:07:14.916757+0000","last_became_active":"2024-05-30T17:04:27.649829+0000","last_became_peered":"2024-05-30T17:04:27.649829+0000","last_unstale":"2024-05-30T17:07:14.916757+0000","last_undegraded":"2024-05-30T17:07:14.916757+0000","last_fullsized":"2024-05-30T17:07:14.916757+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'215","last_scrub_stamp":"2024-05-30T17:07:14.916688+0000","last_deep_scrub":"133'215","last_deep_scrub_stamp":"2024-05-30T17:07:14.916688+0000","last_clean_scrub_stamp":"2024-05-30T17:07:14.916688+0000","objects_scrubbed":71,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:10:54.990138+0000","scrub_duration":671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":54,"num_read_kb":221184,"num_write":83,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"130'1","reported_seq":29,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:12.677166+0000","last_change":"2024-05-30T17:07:12.677186+0000","last_active":"2024-05-30T17:07:12.677166+0000","last_peered":"2024-05-30T17:07:12.677166+0000","last_clean":"2024-05-30T17:07:12.677166+0000","last_became_active":"2024-05-30T17:04:26.648809+0000","last_became_peered":"2024-05-30T17:04:26.648809+0000","last_unstale":"2024-05-30T17:07:12.677166+0000","last_undegraded":"2024-05-30T17:07:12.677166+0000","last_fullsized":"2024-05-30T17:07:12.677166+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'1","last_scrub_stamp":"2024-05-30T17:07:12.677087+0000","last_deep_scrub":"130'1","last_deep_scrub_stamp":"2024-05-30T17:07:12.677087+0000","last_clean_scrub_stamp":"2024-05-30T17:07:12.677087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:18:38.412492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"133'206","reported_seq":323,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:16.175764+0000","last_change":"2024-05-30T17:07:16.175862+0000","last_active":"2024-05-30T17:07:16.175764+0000","last_peered":"2024-05-30T17:07:16.175764+0000","last_clean":"2024-05-30T17:07:16.175764+0000","last_became_active":"2024-05-30T17:04:27.656807+0000","last_became_peered":"2024-05-30T17:04:27.656807+0000","last_unstale":"2024-05-30T17:07:16.175764+0000","last_undegraded":"2024-05-30T17:07:16.175764+0000","last_fullsized":"2024-05-30T17:07:16.175764+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'206","last_scrub_stamp":"2024-05-30T17:07:16.175687+0000","last_deep_scrub":"133'206","last_deep_scrub_stamp":"2024-05-30T17:07:16.175687+0000","last_clean_scrub_stamp":"2024-05-30T17:07:16.175687+0000","objects_scrubbed":71,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:11:14.534781+0000","scrub_duration":811,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":89,"num_read_kb":364544,"num_write":85,"num_write_kb":319488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"130'1","reported_seq":29,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:12.215298+0000","last_change":"2024-05-30T17:07:12.215319+0000","last_active":"2024-05-30T17:07:12.215298+0000","last_peered":"2024-05-30T17:07:12.215298+0000","last_clean":"2024-05-30T17:07:12.215298+0000","last_became_active":"2024-05-30T17:04:26.650668+0000","last_became_peered":"2024-05-30T17:04:26.650668+0000","last_unstale":"2024-05-30T17:07:12.215298+0000","last_undegraded":"2024-05-30T17:07:12.215298+0000","last_fullsized":"2024-05-30T17:07:12.215298+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'1","last_scrub_stamp":"2024-05-30T17:07:12.215218+0000","last_deep_scrub":"130'1","last_deep_scrub_stamp":"2024-05-30T17:07:12.215218+0000","last_clean_scrub_stamp":"2024-05-30T17:07:12.215218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:24:51.721884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"133'196","reported_seq":295,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:12.355546+0000","last_change":"2024-05-30T17:07:12.355575+0000","last_active":"2024-05-30T17:07:12.355546+0000","last_peered":"2024-05-30T17:07:12.355546+0000","last_clean":"2024-05-30T17:07:12.355546+0000","last_became_active":"2024-05-30T17:04:27.653020+0000","last_became_peered":"2024-05-30T17:04:27.653020+0000","last_unstale":"2024-05-30T17:07:12.355546+0000","last_undegraded":"2024-05-30T17:07:12.355546+0000","last_fullsized":"2024-05-30T17:07:12.355546+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'196","last_scrub_stamp":"2024-05-30T17:07:12.355474+0000","last_deep_scrub":"133'196","last_deep_scrub_stamp":"2024-05-30T17:07:12.355474+0000","last_clean_scrub_stamp":"2024-05-30T17:07:12.355474+0000","objects_scrubbed":56,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:43:10.850850+0000","scrub_duration":471,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":70,"num_read_kb":278530,"num_write":74,"num_write_kb":262145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:09.471782+0000","last_change":"2024-05-30T17:07:09.471804+0000","last_active":"2024-05-30T17:07:09.471782+0000","last_peered":"2024-05-30T17:07:09.471782+0000","last_clean":"2024-05-30T17:07:09.471782+0000","last_became_active":"2024-05-30T17:04:26.641791+0000","last_became_peered":"2024-05-30T17:04:26.641791+0000","last_unstale":"2024-05-30T17:07:09.471782+0000","last_undegraded":"2024-05-30T17:07:09.471782+0000","last_fullsized":"2024-05-30T17:07:09.471782+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:09.471689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:09.471689+0000","last_clean_scrub_stamp":"2024-05-30T17:07:09.471689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:28:13.377350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"133'195","reported_seq":287,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:15.411786+0000","last_change":"2024-05-30T17:07:15.411864+0000","last_active":"2024-05-30T17:07:15.411786+0000","last_peered":"2024-05-30T17:07:15.411786+0000","last_clean":"2024-05-30T17:07:15.411786+0000","last_became_active":"2024-05-30T17:04:27.647928+0000","last_became_peered":"2024-05-30T17:04:27.647928+0000","last_unstale":"2024-05-30T17:07:15.411786+0000","last_undegraded":"2024-05-30T17:07:15.411786+0000","last_fullsized":"2024-05-30T17:07:15.411786+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'195","last_scrub_stamp":"2024-05-30T17:07:15.411646+0000","last_deep_scrub":"133'195","last_deep_scrub_stamp":"2024-05-30T17:07:15.411646+0000","last_clean_scrub_stamp":"2024-05-30T17:07:15.411646+0000","objects_scrubbed":61,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:24:56.387756+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":75,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:09.624288+0000","last_change":"2024-05-30T17:07:09.624321+0000","last_active":"2024-05-30T17:07:09.624288+0000","last_peered":"2024-05-30T17:07:09.624288+0000","last_clean":"2024-05-30T17:07:09.624288+0000","last_became_active":"2024-05-30T17:04:26.642988+0000","last_became_peered":"2024-05-30T17:04:26.642988+0000","last_unstale":"2024-05-30T17:07:09.624288+0000","last_undegraded":"2024-05-30T17:07:09.624288+0000","last_fullsized":"2024-05-30T17:07:09.624288+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:09.624187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:09.624187+0000","last_clean_scrub_stamp":"2024-05-30T17:07:09.624187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:16:33.713699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"133'168","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:12.404358+0000","last_change":"2024-05-30T17:07:12.404472+0000","last_active":"2024-05-30T17:07:12.404358+0000","last_peered":"2024-05-30T17:07:12.404358+0000","last_clean":"2024-05-30T17:07:12.404358+0000","last_became_active":"2024-05-30T17:04:27.654315+0000","last_became_peered":"2024-05-30T17:04:27.654315+0000","last_unstale":"2024-05-30T17:07:12.404358+0000","last_undegraded":"2024-05-30T17:07:12.404358+0000","last_fullsized":"2024-05-30T17:07:12.404358+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'168","last_scrub_stamp":"2024-05-30T17:07:12.404278+0000","last_deep_scrub":"133'168","last_deep_scrub_stamp":"2024-05-30T17:07:12.404278+0000","last_clean_scrub_stamp":"2024-05-30T17:07:12.404278+0000","objects_scrubbed":46,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:27:11.860195+0000","scrub_duration":431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":35,"num_read_kb":143360,"num_write":60,"num_write_kb":217088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"133'1","reported_seq":29,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:12.370923+0000","last_change":"2024-05-30T17:07:12.370944+0000","last_active":"2024-05-30T17:07:12.370923+0000","last_peered":"2024-05-30T17:07:12.370923+0000","last_clean":"2024-05-30T17:07:12.370923+0000","last_became_active":"2024-05-30T17:04:26.653413+0000","last_became_peered":"2024-05-30T17:04:26.653413+0000","last_unstale":"2024-05-30T17:07:12.370923+0000","last_undegraded":"2024-05-30T17:07:12.370923+0000","last_fullsized":"2024-05-30T17:07:12.370923+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'1","last_scrub_stamp":"2024-05-30T17:07:12.370847+0000","last_deep_scrub":"133'1","last_deep_scrub_stamp":"2024-05-30T17:07:12.370847+0000","last_clean_scrub_stamp":"2024-05-30T17:07:12.370847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:18:38.106252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"133'177","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:19.109682+0000","last_change":"2024-05-30T17:07:19.109723+0000","last_active":"2024-05-30T17:07:19.109682+0000","last_peered":"2024-05-30T17:07:19.109682+0000","last_clean":"2024-05-30T17:07:19.109682+0000","last_became_active":"2024-05-30T17:04:27.669759+0000","last_became_peered":"2024-05-30T17:04:27.669759+0000","last_unstale":"2024-05-30T17:07:19.109682+0000","last_undegraded":"2024-05-30T17:07:19.109682+0000","last_fullsized":"2024-05-30T17:07:19.109682+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'177","last_scrub_stamp":"2024-05-30T17:07:19.109615+0000","last_deep_scrub":"133'177","last_deep_scrub_stamp":"2024-05-30T17:07:19.109615+0000","last_clean_scrub_stamp":"2024-05-30T17:07:19.109615+0000","objects_scrubbed":57,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:32:01.120267+0000","scrub_duration":723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881204,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":40,"num_read_kb":159745,"num_write":65,"num_write_kb":245761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:11.199317+0000","last_change":"2024-05-30T17:07:11.199337+0000","last_active":"2024-05-30T17:07:11.199317+0000","last_peered":"2024-05-30T17:07:11.199317+0000","last_clean":"2024-05-30T17:07:11.199317+0000","last_became_active":"2024-05-30T17:04:26.648983+0000","last_became_peered":"2024-05-30T17:04:26.648983+0000","last_unstale":"2024-05-30T17:07:11.199317+0000","last_undegraded":"2024-05-30T17:07:11.199317+0000","last_fullsized":"2024-05-30T17:07:11.199317+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:11.199243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:11.199243+0000","last_clean_scrub_stamp":"2024-05-30T17:07:11.199243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:16:15.198116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"133'181","reported_seq":285,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:20.509060+0000","last_change":"2024-05-30T17:07:20.509098+0000","last_active":"2024-05-30T17:07:20.509060+0000","last_peered":"2024-05-30T17:07:20.509060+0000","last_clean":"2024-05-30T17:07:20.509060+0000","last_became_active":"2024-05-30T17:04:27.660791+0000","last_became_peered":"2024-05-30T17:04:27.660791+0000","last_unstale":"2024-05-30T17:07:20.509060+0000","last_undegraded":"2024-05-30T17:07:20.509060+0000","last_fullsized":"2024-05-30T17:07:20.509060+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'181","last_scrub_stamp":"2024-05-30T17:07:20.508985+0000","last_deep_scrub":"133'181","last_deep_scrub_stamp":"2024-05-30T17:07:20.508985+0000","last_clean_scrub_stamp":"2024-05-30T17:07:20.508985+0000","objects_scrubbed":57,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:40:46.237546+0000","scrub_duration":503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":76,"num_read_kb":311296,"num_write":81,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"133'27","reported_seq":55,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:13.394753+0000","last_change":"2024-05-30T17:07:13.394800+0000","last_active":"2024-05-30T17:07:13.394753+0000","last_peered":"2024-05-30T17:07:13.394753+0000","last_clean":"2024-05-30T17:07:13.394753+0000","last_became_active":"2024-05-30T17:04:26.655436+0000","last_became_peered":"2024-05-30T17:04:26.655436+0000","last_unstale":"2024-05-30T17:07:13.394753+0000","last_undegraded":"2024-05-30T17:07:13.394753+0000","last_fullsized":"2024-05-30T17:07:13.394753+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'27","last_scrub_stamp":"2024-05-30T17:07:13.394640+0000","last_deep_scrub":"133'27","last_deep_scrub_stamp":"2024-05-30T17:07:13.394640+0000","last_clean_scrub_stamp":"2024-05-30T17:07:13.394640+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:01.804430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"133'169","reported_seq":258,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:16.706818+0000","last_change":"2024-05-30T17:07:16.706939+0000","last_active":"2024-05-30T17:07:16.706818+0000","last_peered":"2024-05-30T17:07:16.706818+0000","last_clean":"2024-05-30T17:07:16.706818+0000","last_became_active":"2024-05-30T17:04:27.654682+0000","last_became_peered":"2024-05-30T17:04:27.654682+0000","last_unstale":"2024-05-30T17:07:16.706818+0000","last_undegraded":"2024-05-30T17:07:16.706818+0000","last_fullsized":"2024-05-30T17:07:16.706818+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'169","last_scrub_stamp":"2024-05-30T17:07:16.706699+0000","last_deep_scrub":"133'169","last_deep_scrub_stamp":"2024-05-30T17:07:16.706699+0000","last_clean_scrub_stamp":"2024-05-30T17:07:16.706699+0000","objects_scrubbed":48,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:20:36.372702+0000","scrub_duration":639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":62,"num_read_kb":237572,"num_write":64,"num_write_kb":221186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"133'449","reported_seq":477,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:15.222713+0000","last_change":"2024-05-30T17:07:09.857815+0000","last_active":"2024-05-30T17:07:15.222713+0000","last_peered":"2024-05-30T17:07:15.222713+0000","last_clean":"2024-05-30T17:07:15.222713+0000","last_became_active":"2024-05-30T17:04:26.644394+0000","last_became_peered":"2024-05-30T17:04:26.644394+0000","last_unstale":"2024-05-30T17:07:15.222713+0000","last_undegraded":"2024-05-30T17:07:15.222713+0000","last_fullsized":"2024-05-30T17:07:15.222713+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'447","last_scrub_stamp":"2024-05-30T17:07:09.857691+0000","last_deep_scrub":"133'447","last_deep_scrub_stamp":"2024-05-30T17:07:09.857691+0000","last_clean_scrub_stamp":"2024-05-30T17:07:09.857691+0000","objects_scrubbed":4,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:59:47.912947+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686430,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445,"num_write_kb":1816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"133'210","reported_seq":289,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:18.827856+0000","last_change":"2024-05-30T17:07:18.827959+0000","last_active":"2024-05-30T17:07:18.827856+0000","last_peered":"2024-05-30T17:07:18.827856+0000","last_clean":"2024-05-30T17:07:18.827856+0000","last_became_active":"2024-05-30T17:04:27.666778+0000","last_became_peered":"2024-05-30T17:04:27.666778+0000","last_unstale":"2024-05-30T17:07:18.827856+0000","last_undegraded":"2024-05-30T17:07:18.827856+0000","last_fullsized":"2024-05-30T17:07:18.827856+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'210","last_scrub_stamp":"2024-05-30T17:07:18.827766+0000","last_deep_scrub":"133'210","last_deep_scrub_stamp":"2024-05-30T17:07:18.827766+0000","last_clean_scrub_stamp":"2024-05-30T17:07:18.827766+0000","objects_scrubbed":70,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:19:44.553069+0000","scrub_duration":931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":51,"num_read_kb":204801,"num_write":86,"num_write_kb":315393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:07.998830+0000","last_change":"2024-05-30T17:07:07.998863+0000","last_active":"2024-05-30T17:07:07.998830+0000","last_peered":"2024-05-30T17:07:07.998830+0000","last_clean":"2024-05-30T17:07:07.998830+0000","last_became_active":"2024-05-30T17:04:26.648016+0000","last_became_peered":"2024-05-30T17:04:26.648016+0000","last_unstale":"2024-05-30T17:07:07.998830+0000","last_undegraded":"2024-05-30T17:07:07.998830+0000","last_fullsized":"2024-05-30T17:07:07.998830+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:07.998750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:07.998750+0000","last_clean_scrub_stamp":"2024-05-30T17:07:07.998750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:15:18.984005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"133'209","reported_seq":295,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:14.444791+0000","last_change":"2024-05-30T17:07:14.444882+0000","last_active":"2024-05-30T17:07:14.444791+0000","last_peered":"2024-05-30T17:07:14.444791+0000","last_clean":"2024-05-30T17:07:14.444791+0000","last_became_active":"2024-05-30T17:04:27.646842+0000","last_became_peered":"2024-05-30T17:04:27.646842+0000","last_unstale":"2024-05-30T17:07:14.444791+0000","last_undegraded":"2024-05-30T17:07:14.444791+0000","last_fullsized":"2024-05-30T17:07:14.444791+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'209","last_scrub_stamp":"2024-05-30T17:07:14.444705+0000","last_deep_scrub":"133'209","last_deep_scrub_stamp":"2024-05-30T17:07:14.444705+0000","last_clean_scrub_stamp":"2024-05-30T17:07:14.444705+0000","objects_scrubbed":71,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:02.854495+0000","scrub_duration":719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":87,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:07.684178+0000","last_change":"2024-05-30T17:07:07.684214+0000","last_active":"2024-05-30T17:07:07.684178+0000","last_peered":"2024-05-30T17:07:07.684178+0000","last_clean":"2024-05-30T17:07:07.684178+0000","last_became_active":"2024-05-30T17:04:26.641530+0000","last_became_peered":"2024-05-30T17:04:26.641530+0000","last_unstale":"2024-05-30T17:07:07.684178+0000","last_undegraded":"2024-05-30T17:07:07.684178+0000","last_fullsized":"2024-05-30T17:07:07.684178+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:07.684092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:07.684092+0000","last_clean_scrub_stamp":"2024-05-30T17:07:07.684092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:37:11.366582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"133'239","reported_seq":333,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:18.797127+0000","last_change":"2024-05-30T17:07:18.797188+0000","last_active":"2024-05-30T17:07:18.797127+0000","last_peered":"2024-05-30T17:07:18.797127+0000","last_clean":"2024-05-30T17:07:18.797127+0000","last_became_active":"2024-05-30T17:04:27.662912+0000","last_became_peered":"2024-05-30T17:04:27.662912+0000","last_unstale":"2024-05-30T17:07:18.797127+0000","last_undegraded":"2024-05-30T17:07:18.797127+0000","last_fullsized":"2024-05-30T17:07:18.797127+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'239","last_scrub_stamp":"2024-05-30T17:07:18.796993+0000","last_deep_scrub":"133'239","last_deep_scrub_stamp":"2024-05-30T17:07:18.796993+0000","last_clean_scrub_stamp":"2024-05-30T17:07:18.796993+0000","objects_scrubbed":81,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:15.345317+0000","scrub_duration":923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544581,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":99,"num_write_kb":364545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"133'12","reported_seq":40,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:10.873612+0000","last_change":"2024-05-30T17:07:10.873637+0000","last_active":"2024-05-30T17:07:10.873612+0000","last_peered":"2024-05-30T17:07:10.873612+0000","last_clean":"2024-05-30T17:07:10.873612+0000","last_became_active":"2024-05-30T17:04:26.651470+0000","last_became_peered":"2024-05-30T17:04:26.651470+0000","last_unstale":"2024-05-30T17:07:10.873612+0000","last_undegraded":"2024-05-30T17:07:10.873612+0000","last_fullsized":"2024-05-30T17:07:10.873612+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'12","last_scrub_stamp":"2024-05-30T17:07:10.873545+0000","last_deep_scrub":"133'12","last_deep_scrub_stamp":"2024-05-30T17:07:10.873545+0000","last_clean_scrub_stamp":"2024-05-30T17:07:10.873545+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:32.948729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"133'160","reported_seq":213,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:14.323971+0000","last_change":"2024-05-30T17:07:14.324056+0000","last_active":"2024-05-30T17:07:14.323971+0000","last_peered":"2024-05-30T17:07:14.323971+0000","last_clean":"2024-05-30T17:07:14.323971+0000","last_became_active":"2024-05-30T17:04:27.656527+0000","last_became_peered":"2024-05-30T17:04:27.656527+0000","last_unstale":"2024-05-30T17:07:14.323971+0000","last_undegraded":"2024-05-30T17:07:14.323971+0000","last_fullsized":"2024-05-30T17:07:14.323971+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'160","last_scrub_stamp":"2024-05-30T17:07:14.323896+0000","last_deep_scrub":"133'160","last_deep_scrub_stamp":"2024-05-30T17:07:14.323896+0000","last_clean_scrub_stamp":"2024-05-30T17:07:14.323896+0000","objects_scrubbed":45,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:07.742647+0000","scrub_duration":463,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":26,"num_read_kb":94211,"num_write":61,"num_write_kb":212993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"133'2","reported_seq":30,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:09.469682+0000","last_change":"2024-05-30T17:07:09.469712+0000","last_active":"2024-05-30T17:07:09.469682+0000","last_peered":"2024-05-30T17:07:09.469682+0000","last_clean":"2024-05-30T17:07:09.469682+0000","last_became_active":"2024-05-30T17:04:26.645435+0000","last_became_peered":"2024-05-30T17:04:26.645435+0000","last_unstale":"2024-05-30T17:07:09.469682+0000","last_undegraded":"2024-05-30T17:07:09.469682+0000","last_fullsized":"2024-05-30T17:07:09.469682+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'2","last_scrub_stamp":"2024-05-30T17:07:09.469592+0000","last_deep_scrub":"133'2","last_deep_scrub_stamp":"2024-05-30T17:07:09.469592+0000","last_clean_scrub_stamp":"2024-05-30T17:07:09.469592+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:16:33.559105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"133'230","reported_seq":334,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:18.440673+0000","last_change":"2024-05-30T17:07:18.440724+0000","last_active":"2024-05-30T17:07:18.440673+0000","last_peered":"2024-05-30T17:07:18.440673+0000","last_clean":"2024-05-30T17:07:18.440673+0000","last_became_active":"2024-05-30T17:04:27.666318+0000","last_became_peered":"2024-05-30T17:04:27.666318+0000","last_unstale":"2024-05-30T17:07:18.440673+0000","last_undegraded":"2024-05-30T17:07:18.440673+0000","last_fullsized":"2024-05-30T17:07:18.440673+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'230","last_scrub_stamp":"2024-05-30T17:07:18.440530+0000","last_deep_scrub":"133'230","last_deep_scrub_stamp":"2024-05-30T17:07:18.440530+0000","last_clean_scrub_stamp":"2024-05-30T17:07:18.440530+0000","objects_scrubbed":76,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:19:16.629760+0000","scrub_duration":1011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":102,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"133'3","reported_seq":31,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:07.886586+0000","last_change":"2024-05-30T17:07:07.886610+0000","last_active":"2024-05-30T17:07:07.886586+0000","last_peered":"2024-05-30T17:07:07.886586+0000","last_clean":"2024-05-30T17:07:07.886586+0000","last_became_active":"2024-05-30T17:04:26.648936+0000","last_became_peered":"2024-05-30T17:04:26.648936+0000","last_unstale":"2024-05-30T17:07:07.886586+0000","last_undegraded":"2024-05-30T17:07:07.886586+0000","last_fullsized":"2024-05-30T17:07:07.886586+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'3","last_scrub_stamp":"2024-05-30T17:07:07.886492+0000","last_deep_scrub":"133'3","last_deep_scrub_stamp":"2024-05-30T17:07:07.886492+0000","last_clean_scrub_stamp":"2024-05-30T17:07:07.886492+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:05:02.954715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"133'193","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:19.673742+0000","last_change":"2024-05-30T17:07:19.673769+0000","last_active":"2024-05-30T17:07:19.673742+0000","last_peered":"2024-05-30T17:07:19.673742+0000","last_clean":"2024-05-30T17:07:19.673742+0000","last_became_active":"2024-05-30T17:04:27.657216+0000","last_became_peered":"2024-05-30T17:04:27.657216+0000","last_unstale":"2024-05-30T17:07:19.673742+0000","last_undegraded":"2024-05-30T17:07:19.673742+0000","last_fullsized":"2024-05-30T17:07:19.673742+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'193","last_scrub_stamp":"2024-05-30T17:07:19.673675+0000","last_deep_scrub":"133'193","last_deep_scrub_stamp":"2024-05-30T17:07:19.673675+0000","last_clean_scrub_stamp":"2024-05-30T17:07:19.673675+0000","objects_scrubbed":53,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:22:19.120790+0000","scrub_duration":435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909897,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":58,"num_read_kb":221188,"num_write":75,"num_write_kb":241669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"133'2","reported_seq":30,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:10.452901+0000","last_change":"2024-05-30T17:07:10.452923+0000","last_active":"2024-05-30T17:07:10.452901+0000","last_peered":"2024-05-30T17:07:10.452901+0000","last_clean":"2024-05-30T17:07:10.452901+0000","last_became_active":"2024-05-30T17:04:26.652083+0000","last_became_peered":"2024-05-30T17:04:26.652083+0000","last_unstale":"2024-05-30T17:07:10.452901+0000","last_undegraded":"2024-05-30T17:07:10.452901+0000","last_fullsized":"2024-05-30T17:07:10.452901+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'2","last_scrub_stamp":"2024-05-30T17:07:10.452832+0000","last_deep_scrub":"133'2","last_deep_scrub_stamp":"2024-05-30T17:07:10.452832+0000","last_clean_scrub_stamp":"2024-05-30T17:07:10.452832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:20:24.307133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"133'210","reported_seq":314,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:17.693432+0000","last_change":"2024-05-30T17:07:17.693515+0000","last_active":"2024-05-30T17:07:17.693432+0000","last_peered":"2024-05-30T17:07:17.693432+0000","last_clean":"2024-05-30T17:07:17.693432+0000","last_became_active":"2024-05-30T17:04:27.648847+0000","last_became_peered":"2024-05-30T17:04:27.648847+0000","last_unstale":"2024-05-30T17:07:17.693432+0000","last_undegraded":"2024-05-30T17:07:17.693432+0000","last_fullsized":"2024-05-30T17:07:17.693432+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'210","last_scrub_stamp":"2024-05-30T17:07:17.693334+0000","last_deep_scrub":"133'210","last_deep_scrub_stamp":"2024-05-30T17:07:17.693334+0000","last_clean_scrub_stamp":"2024-05-30T17:07:17.693334+0000","objects_scrubbed":69,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:57:18.011993+0000","scrub_duration":907,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":89,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:10.461953+0000","last_change":"2024-05-30T17:07:10.461972+0000","last_active":"2024-05-30T17:07:10.461953+0000","last_peered":"2024-05-30T17:07:10.461953+0000","last_clean":"2024-05-30T17:07:10.461953+0000","last_became_active":"2024-05-30T17:04:26.646025+0000","last_became_peered":"2024-05-30T17:04:26.646025+0000","last_unstale":"2024-05-30T17:07:10.461953+0000","last_undegraded":"2024-05-30T17:07:10.461953+0000","last_fullsized":"2024-05-30T17:07:10.461953+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:10.461878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:10.461878+0000","last_clean_scrub_stamp":"2024-05-30T17:07:10.461878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:11:36.955194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"133'224","reported_seq":331,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:13.713794+0000","last_change":"2024-05-30T17:07:13.713846+0000","last_active":"2024-05-30T17:07:13.713794+0000","last_peered":"2024-05-30T17:07:13.713794+0000","last_clean":"2024-05-30T17:07:13.713794+0000","last_became_active":"2024-05-30T17:04:27.653888+0000","last_became_peered":"2024-05-30T17:04:27.653888+0000","last_unstale":"2024-05-30T17:07:13.713794+0000","last_undegraded":"2024-05-30T17:07:13.713794+0000","last_fullsized":"2024-05-30T17:07:13.713794+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'224","last_scrub_stamp":"2024-05-30T17:07:13.713712+0000","last_deep_scrub":"133'224","last_deep_scrub_stamp":"2024-05-30T17:07:13.713712+0000","last_clean_scrub_stamp":"2024-05-30T17:07:13.713712+0000","objects_scrubbed":77,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:00:56.276173+0000","scrub_duration":763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":89,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"133'4","reported_seq":32,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:14.426758+0000","last_change":"2024-05-30T17:07:14.426801+0000","last_active":"2024-05-30T17:07:14.426758+0000","last_peered":"2024-05-30T17:07:14.426758+0000","last_clean":"2024-05-30T17:07:14.426758+0000","last_became_active":"2024-05-30T17:04:26.657452+0000","last_became_peered":"2024-05-30T17:04:26.657452+0000","last_unstale":"2024-05-30T17:07:14.426758+0000","last_undegraded":"2024-05-30T17:07:14.426758+0000","last_fullsized":"2024-05-30T17:07:14.426758+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'4","last_scrub_stamp":"2024-05-30T17:07:14.426672+0000","last_deep_scrub":"133'4","last_deep_scrub_stamp":"2024-05-30T17:07:14.426672+0000","last_clean_scrub_stamp":"2024-05-30T17:07:14.426672+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:24:55.402782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"133'204","reported_seq":298,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:12.826194+0000","last_change":"2024-05-30T17:07:12.826234+0000","last_active":"2024-05-30T17:07:12.826194+0000","last_peered":"2024-05-30T17:07:12.826194+0000","last_clean":"2024-05-30T17:07:12.826194+0000","last_became_active":"2024-05-30T17:04:27.649442+0000","last_became_peered":"2024-05-30T17:04:27.649442+0000","last_unstale":"2024-05-30T17:07:12.826194+0000","last_undegraded":"2024-05-30T17:07:12.826194+0000","last_fullsized":"2024-05-30T17:07:12.826194+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'204","last_scrub_stamp":"2024-05-30T17:07:12.826115+0000","last_deep_scrub":"133'204","last_deep_scrub_stamp":"2024-05-30T17:07:12.826115+0000","last_clean_scrub_stamp":"2024-05-30T17:07:12.826115+0000","objects_scrubbed":60,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:06.244866+0000","scrub_duration":447,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":66,"num_read_kb":241671,"num_write":82,"num_write_kb":278531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:08.179523+0000","last_change":"2024-05-30T17:07:08.179542+0000","last_active":"2024-05-30T17:07:08.179523+0000","last_peered":"2024-05-30T17:07:08.179523+0000","last_clean":"2024-05-30T17:07:08.179523+0000","last_became_active":"2024-05-30T17:04:26.645583+0000","last_became_peered":"2024-05-30T17:04:26.645583+0000","last_unstale":"2024-05-30T17:07:08.179523+0000","last_undegraded":"2024-05-30T17:07:08.179523+0000","last_fullsized":"2024-05-30T17:07:08.179523+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:08.179440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:08.179440+0000","last_clean_scrub_stamp":"2024-05-30T17:07:08.179440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:06.667753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"133'226","reported_seq":297,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:19.508764+0000","last_change":"2024-05-30T17:07:19.508796+0000","last_active":"2024-05-30T17:07:19.508764+0000","last_peered":"2024-05-30T17:07:19.508764+0000","last_clean":"2024-05-30T17:07:19.508764+0000","last_became_active":"2024-05-30T17:04:27.651701+0000","last_became_peered":"2024-05-30T17:04:27.651701+0000","last_unstale":"2024-05-30T17:07:19.508764+0000","last_undegraded":"2024-05-30T17:07:19.508764+0000","last_fullsized":"2024-05-30T17:07:19.508764+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'226","last_scrub_stamp":"2024-05-30T17:07:19.508695+0000","last_deep_scrub":"133'226","last_deep_scrub_stamp":"2024-05-30T17:07:19.508695+0000","last_clean_scrub_stamp":"2024-05-30T17:07:19.508695+0000","objects_scrubbed":79,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:19:17.697925+0000","scrub_duration":755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":91,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:10.182304+0000","last_change":"2024-05-30T17:07:10.182343+0000","last_active":"2024-05-30T17:07:10.182304+0000","last_peered":"2024-05-30T17:07:10.182304+0000","last_clean":"2024-05-30T17:07:10.182304+0000","last_became_active":"2024-05-30T17:04:26.647155+0000","last_became_peered":"2024-05-30T17:04:26.647155+0000","last_unstale":"2024-05-30T17:07:10.182304+0000","last_undegraded":"2024-05-30T17:07:10.182304+0000","last_fullsized":"2024-05-30T17:07:10.182304+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:10.182184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:10.182184+0000","last_clean_scrub_stamp":"2024-05-30T17:07:10.182184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:29.722356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"133'190","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:22.345311+0000","last_change":"2024-05-30T17:07:22.345342+0000","last_active":"2024-05-30T17:07:22.345311+0000","last_peered":"2024-05-30T17:07:22.345311+0000","last_clean":"2024-05-30T17:07:22.345311+0000","last_became_active":"2024-05-30T17:04:27.667268+0000","last_became_peered":"2024-05-30T17:04:27.667268+0000","last_unstale":"2024-05-30T17:07:22.345311+0000","last_undegraded":"2024-05-30T17:07:22.345311+0000","last_fullsized":"2024-05-30T17:07:22.345311+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'190","last_scrub_stamp":"2024-05-30T17:07:22.345251+0000","last_deep_scrub":"133'190","last_deep_scrub_stamp":"2024-05-30T17:07:22.345251+0000","last_clean_scrub_stamp":"2024-05-30T17:07:22.345251+0000","objects_scrubbed":55,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:46:31.840111+0000","scrub_duration":379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230686720,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":56,"num_read_kb":229376,"num_write":75,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:08.916291+0000","last_change":"2024-05-30T17:07:08.916312+0000","last_active":"2024-05-30T17:07:08.916291+0000","last_peered":"2024-05-30T17:07:08.916291+0000","last_clean":"2024-05-30T17:07:08.916291+0000","last_became_active":"2024-05-30T17:04:26.650616+0000","last_became_peered":"2024-05-30T17:04:26.650616+0000","last_unstale":"2024-05-30T17:07:08.916291+0000","last_undegraded":"2024-05-30T17:07:08.916291+0000","last_fullsized":"2024-05-30T17:07:08.916291+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:08.916204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:08.916204+0000","last_clean_scrub_stamp":"2024-05-30T17:07:08.916204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:17.838708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"133'217","reported_seq":281,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:19.150430+0000","last_change":"2024-05-30T17:07:19.150559+0000","last_active":"2024-05-30T17:07:19.150430+0000","last_peered":"2024-05-30T17:07:19.150430+0000","last_clean":"2024-05-30T17:07:19.150430+0000","last_became_active":"2024-05-30T17:04:27.664180+0000","last_became_peered":"2024-05-30T17:04:27.664180+0000","last_unstale":"2024-05-30T17:07:19.150430+0000","last_undegraded":"2024-05-30T17:07:19.150430+0000","last_fullsized":"2024-05-30T17:07:19.150430+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'217","last_scrub_stamp":"2024-05-30T17:07:19.150347+0000","last_deep_scrub":"133'217","last_deep_scrub_stamp":"2024-05-30T17:07:19.150347+0000","last_clean_scrub_stamp":"2024-05-30T17:07:19.150347+0000","objects_scrubbed":64,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:20:05.112548+0000","scrub_duration":743,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":96,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"133'3","reported_seq":31,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:09.025176+0000","last_change":"2024-05-30T17:07:09.025199+0000","last_active":"2024-05-30T17:07:09.025176+0000","last_peered":"2024-05-30T17:07:09.025176+0000","last_clean":"2024-05-30T17:07:09.025176+0000","last_became_active":"2024-05-30T17:04:26.652234+0000","last_became_peered":"2024-05-30T17:04:26.652234+0000","last_unstale":"2024-05-30T17:07:09.025176+0000","last_undegraded":"2024-05-30T17:07:09.025176+0000","last_fullsized":"2024-05-30T17:07:09.025176+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'3","last_scrub_stamp":"2024-05-30T17:07:09.025105+0000","last_deep_scrub":"133'3","last_deep_scrub_stamp":"2024-05-30T17:07:09.025105+0000","last_clean_scrub_stamp":"2024-05-30T17:07:09.025105+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:32:22.617575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"133'206","reported_seq":308,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:17.808735+0000","last_change":"2024-05-30T17:07:17.808834+0000","last_active":"2024-05-30T17:07:17.808735+0000","last_peered":"2024-05-30T17:07:17.808735+0000","last_clean":"2024-05-30T17:07:17.808735+0000","last_became_active":"2024-05-30T17:04:27.655926+0000","last_became_peered":"2024-05-30T17:04:27.655926+0000","last_unstale":"2024-05-30T17:07:17.808735+0000","last_undegraded":"2024-05-30T17:07:17.808735+0000","last_fullsized":"2024-05-30T17:07:17.808735+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'206","last_scrub_stamp":"2024-05-30T17:07:17.808654+0000","last_deep_scrub":"133'206","last_deep_scrub_stamp":"2024-05-30T17:07:17.808654+0000","last_clean_scrub_stamp":"2024-05-30T17:07:17.808654+0000","objects_scrubbed":68,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:06.218444+0000","scrub_duration":895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":90,"num_write_kb":319489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"133'42","reported_seq":70,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:12.094869+0000","last_change":"2024-05-30T17:07:12.094892+0000","last_active":"2024-05-30T17:07:12.094869+0000","last_peered":"2024-05-30T17:07:12.094869+0000","last_clean":"2024-05-30T17:07:12.094869+0000","last_became_active":"2024-05-30T17:04:26.648998+0000","last_became_peered":"2024-05-30T17:04:26.648998+0000","last_unstale":"2024-05-30T17:07:12.094869+0000","last_undegraded":"2024-05-30T17:07:12.094869+0000","last_fullsized":"2024-05-30T17:07:12.094869+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-05-30T17:07:12.094800+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-05-30T17:07:12.094800+0000","last_clean_scrub_stamp":"2024-05-30T17:07:12.094800+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:53:12.153226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":499,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"133'195","reported_seq":311,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:21.214779+0000","last_change":"2024-05-30T17:07:21.214822+0000","last_active":"2024-05-30T17:07:21.214779+0000","last_peered":"2024-05-30T17:07:21.214779+0000","last_clean":"2024-05-30T17:07:21.214779+0000","last_became_active":"2024-05-30T17:04:27.654295+0000","last_became_peered":"2024-05-30T17:04:27.654295+0000","last_unstale":"2024-05-30T17:07:21.214779+0000","last_undegraded":"2024-05-30T17:07:21.214779+0000","last_fullsized":"2024-05-30T17:07:21.214779+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'195","last_scrub_stamp":"2024-05-30T17:07:21.214702+0000","last_deep_scrub":"133'195","last_deep_scrub_stamp":"2024-05-30T17:07:21.214702+0000","last_clean_scrub_stamp":"2024-05-30T17:07:21.214702+0000","objects_scrubbed":63,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:17:39.448292+0000","scrub_duration":419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":88,"num_read_kb":360448,"num_write":81,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:11.650477+0000","last_change":"2024-05-30T17:07:11.650496+0000","last_active":"2024-05-30T17:07:11.650477+0000","last_peered":"2024-05-30T17:07:11.650477+0000","last_clean":"2024-05-30T17:07:11.650477+0000","last_became_active":"2024-05-30T17:04:26.647058+0000","last_became_peered":"2024-05-30T17:04:26.647058+0000","last_unstale":"2024-05-30T17:07:11.650477+0000","last_undegraded":"2024-05-30T17:07:11.650477+0000","last_fullsized":"2024-05-30T17:07:11.650477+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:11.650381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:11.650381+0000","last_clean_scrub_stamp":"2024-05-30T17:07:11.650381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:20:34.703512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"133'210","reported_seq":289,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:17.196350+0000","last_change":"2024-05-30T17:07:17.196451+0000","last_active":"2024-05-30T17:07:17.196350+0000","last_peered":"2024-05-30T17:07:17.196350+0000","last_clean":"2024-05-30T17:07:17.196350+0000","last_became_active":"2024-05-30T17:04:27.657041+0000","last_became_peered":"2024-05-30T17:04:27.657041+0000","last_unstale":"2024-05-30T17:07:17.196350+0000","last_undegraded":"2024-05-30T17:07:17.196350+0000","last_fullsized":"2024-05-30T17:07:17.196350+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'210","last_scrub_stamp":"2024-05-30T17:07:17.196257+0000","last_deep_scrub":"133'210","last_deep_scrub_stamp":"2024-05-30T17:07:17.196257+0000","last_clean_scrub_stamp":"2024-05-30T17:07:17.196257+0000","objects_scrubbed":68,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:23:13.744581+0000","scrub_duration":851,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824186,"num_objects":68,"num_object_clones":1,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":51,"num_read_kb":200706,"num_write":94,"num_write_kb":315395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:10.910575+0000","last_change":"2024-05-30T17:07:10.910594+0000","last_active":"2024-05-30T17:07:10.910575+0000","last_peered":"2024-05-30T17:07:10.910575+0000","last_clean":"2024-05-30T17:07:10.910575+0000","last_became_active":"2024-05-30T17:04:26.654383+0000","last_became_peered":"2024-05-30T17:04:26.654383+0000","last_unstale":"2024-05-30T17:07:10.910575+0000","last_undegraded":"2024-05-30T17:07:10.910575+0000","last_fullsized":"2024-05-30T17:07:10.910575+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:10.910486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:10.910486+0000","last_clean_scrub_stamp":"2024-05-30T17:07:10.910486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:20:30.576489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"133'212","reported_seq":296,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:17.911359+0000","last_change":"2024-05-30T17:07:17.911437+0000","last_active":"2024-05-30T17:07:17.911359+0000","last_peered":"2024-05-30T17:07:17.911359+0000","last_clean":"2024-05-30T17:07:17.911359+0000","last_became_active":"2024-05-30T17:04:27.659316+0000","last_became_peered":"2024-05-30T17:04:27.659316+0000","last_unstale":"2024-05-30T17:07:17.911359+0000","last_undegraded":"2024-05-30T17:07:17.911359+0000","last_fullsized":"2024-05-30T17:07:17.911359+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'212","last_scrub_stamp":"2024-05-30T17:07:17.911290+0000","last_deep_scrub":"133'212","last_deep_scrub_stamp":"2024-05-30T17:07:17.911290+0000","last_clean_scrub_stamp":"2024-05-30T17:07:17.911290+0000","objects_scrubbed":70,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:20:48.732432+0000","scrub_duration":867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":88,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:08.642773+0000","last_change":"2024-05-30T17:07:08.642792+0000","last_active":"2024-05-30T17:07:08.642773+0000","last_peered":"2024-05-30T17:07:08.642773+0000","last_clean":"2024-05-30T17:07:08.642773+0000","last_became_active":"2024-05-30T17:04:26.642798+0000","last_became_peered":"2024-05-30T17:04:26.642798+0000","last_unstale":"2024-05-30T17:07:08.642773+0000","last_undegraded":"2024-05-30T17:07:08.642773+0000","last_fullsized":"2024-05-30T17:07:08.642773+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:08.642700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:08.642700+0000","last_clean_scrub_stamp":"2024-05-30T17:07:08.642700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:47:16.432942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"133'224","reported_seq":337,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:16.274743+0000","last_change":"2024-05-30T17:07:16.274843+0000","last_active":"2024-05-30T17:07:16.274743+0000","last_peered":"2024-05-30T17:07:16.274743+0000","last_clean":"2024-05-30T17:07:16.274743+0000","last_became_active":"2024-05-30T17:04:27.662294+0000","last_became_peered":"2024-05-30T17:04:27.662294+0000","last_unstale":"2024-05-30T17:07:16.274743+0000","last_undegraded":"2024-05-30T17:07:16.274743+0000","last_fullsized":"2024-05-30T17:07:16.274743+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'224","last_scrub_stamp":"2024-05-30T17:07:16.274621+0000","last_deep_scrub":"133'224","last_deep_scrub_stamp":"2024-05-30T17:07:16.274621+0000","last_clean_scrub_stamp":"2024-05-30T17:07:16.274621+0000","objects_scrubbed":73,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:34.011009+0000","scrub_duration":847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":85,"num_read_kb":335875,"num_write":93,"num_write_kb":335873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:13.085501+0000","last_change":"2024-05-30T17:07:13.085560+0000","last_active":"2024-05-30T17:07:13.085501+0000","last_peered":"2024-05-30T17:07:13.085501+0000","last_clean":"2024-05-30T17:07:13.085501+0000","last_became_active":"2024-05-30T17:04:26.650063+0000","last_became_peered":"2024-05-30T17:04:26.650063+0000","last_unstale":"2024-05-30T17:07:13.085501+0000","last_undegraded":"2024-05-30T17:07:13.085501+0000","last_fullsized":"2024-05-30T17:07:13.085501+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:13.085338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:13.085338+0000","last_clean_scrub_stamp":"2024-05-30T17:07:13.085338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:51:34.875191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"133'195","reported_seq":295,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:13.932889+0000","last_change":"2024-05-30T17:07:13.933015+0000","last_active":"2024-05-30T17:07:13.932889+0000","last_peered":"2024-05-30T17:07:13.932889+0000","last_clean":"2024-05-30T17:07:13.932889+0000","last_became_active":"2024-05-30T17:04:27.648558+0000","last_became_peered":"2024-05-30T17:04:27.648558+0000","last_unstale":"2024-05-30T17:07:13.932889+0000","last_undegraded":"2024-05-30T17:07:13.932889+0000","last_fullsized":"2024-05-30T17:07:13.932889+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'195","last_scrub_stamp":"2024-05-30T17:07:13.932736+0000","last_deep_scrub":"133'195","last_deep_scrub_stamp":"2024-05-30T17:07:13.932736+0000","last_clean_scrub_stamp":"2024-05-30T17:07:13.932736+0000","objects_scrubbed":69,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:32.524293+0000","scrub_duration":699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":83,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"133'33","reported_seq":92,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:09.140945+0000","last_change":"2024-05-30T17:07:09.140993+0000","last_active":"2024-05-30T17:07:09.140945+0000","last_peered":"2024-05-30T17:07:09.140945+0000","last_clean":"2024-05-30T17:07:09.140945+0000","last_became_active":"2024-05-30T17:04:26.645855+0000","last_became_peered":"2024-05-30T17:04:26.645855+0000","last_unstale":"2024-05-30T17:07:09.140945+0000","last_undegraded":"2024-05-30T17:07:09.140945+0000","last_fullsized":"2024-05-30T17:07:09.140945+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'33","last_scrub_stamp":"2024-05-30T17:07:09.140865+0000","last_deep_scrub":"133'33","last_deep_scrub_stamp":"2024-05-30T17:07:09.140865+0000","last_clean_scrub_stamp":"2024-05-30T17:07:09.140865+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:00:53.056968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4957,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":31,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"133'229","reported_seq":335,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:22.383034+0000","last_change":"2024-05-30T17:07:22.383064+0000","last_active":"2024-05-30T17:07:22.383034+0000","last_peered":"2024-05-30T17:07:22.383034+0000","last_clean":"2024-05-30T17:07:22.383034+0000","last_became_active":"2024-05-30T17:04:27.657110+0000","last_became_peered":"2024-05-30T17:04:27.657110+0000","last_unstale":"2024-05-30T17:07:22.383034+0000","last_undegraded":"2024-05-30T17:07:22.383034+0000","last_fullsized":"2024-05-30T17:07:22.383034+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'229","last_scrub_stamp":"2024-05-30T17:07:22.382940+0000","last_deep_scrub":"133'229","last_deep_scrub_stamp":"2024-05-30T17:07:22.382940+0000","last_clean_scrub_stamp":"2024-05-30T17:07:22.382940+0000","objects_scrubbed":80,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:36.348705+0000","scrub_duration":543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":76,"num_read_kb":311296,"num_write":106,"num_write_kb":380928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":28,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:06.900171+0000","last_change":"2024-05-30T17:07:06.900190+0000","last_active":"2024-05-30T17:07:06.900171+0000","last_peered":"2024-05-30T17:07:06.900171+0000","last_clean":"2024-05-30T17:07:06.900171+0000","last_became_active":"2024-05-30T17:04:26.646125+0000","last_became_peered":"2024-05-30T17:04:26.646125+0000","last_unstale":"2024-05-30T17:07:06.900171+0000","last_undegraded":"2024-05-30T17:07:06.900171+0000","last_fullsized":"2024-05-30T17:07:06.900171+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T17:07:06.900090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T17:07:06.900090+0000","last_clean_scrub_stamp":"2024-05-30T17:07:06.900090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:30:24.784282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"133'200","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:25.326645+0000","last_change":"2024-05-30T17:07:25.326854+0000","last_active":"2024-05-30T17:07:25.326645+0000","last_peered":"2024-05-30T17:07:25.326645+0000","last_clean":"2024-05-30T17:07:25.326645+0000","last_became_active":"2024-05-30T17:04:27.668009+0000","last_became_peered":"2024-05-30T17:04:27.668009+0000","last_unstale":"2024-05-30T17:07:25.326645+0000","last_undegraded":"2024-05-30T17:07:25.326645+0000","last_fullsized":"2024-05-30T17:07:25.326645+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'200","last_scrub_stamp":"2024-05-30T17:07:25.326578+0000","last_deep_scrub":"133'200","last_deep_scrub_stamp":"2024-05-30T17:07:25.326578+0000","last_clean_scrub_stamp":"2024-05-30T17:07:25.326578+0000","objects_scrubbed":62,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:30:03.031070+0000","scrub_duration":395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":47,"num_read_kb":192512,"num_write":88,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"133'4","reported_seq":32,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:15.056619+0000","last_change":"2024-05-30T17:07:15.056663+0000","last_active":"2024-05-30T17:07:15.056619+0000","last_peered":"2024-05-30T17:07:15.056619+0000","last_clean":"2024-05-30T17:07:15.056619+0000","last_became_active":"2024-05-30T17:04:26.655900+0000","last_became_peered":"2024-05-30T17:04:26.655900+0000","last_unstale":"2024-05-30T17:07:15.056619+0000","last_undegraded":"2024-05-30T17:07:15.056619+0000","last_fullsized":"2024-05-30T17:07:15.056619+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'4","last_scrub_stamp":"2024-05-30T17:07:15.056533+0000","last_deep_scrub":"133'4","last_deep_scrub_stamp":"2024-05-30T17:07:15.056533+0000","last_clean_scrub_stamp":"2024-05-30T17:07:15.056533+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:25:26.243108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"133'119","reported_seq":395,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-05-30T17:07:11.135857+0000","last_change":"2024-05-30T17:07:11.135888+0000","last_active":"2024-05-30T17:07:11.135857+0000","last_peered":"2024-05-30T17:07:11.135857+0000","last_clean":"2024-05-30T17:07:11.135857+0000","last_became_active":"2024-05-30T16:48:55.225446+0000","last_became_peered":"2024-05-30T16:48:55.225446+0000","last_unstale":"2024-05-30T17:07:11.135857+0000","last_undegraded":"2024-05-30T17:07:11.135857+0000","last_fullsized":"2024-05-30T17:07:11.135857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'119","last_scrub_stamp":"2024-05-30T17:07:11.135780+0000","last_deep_scrub":"133'119","last_deep_scrub_stamp":"2024-05-30T17:07:11.135780+0000","last_clean_scrub_stamp":"2024-05-30T17:07:11.135780+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:49.119002+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":17406362949,"num_objects":4158,"num_object_clones":1,"num_object_copies":8316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4158,"num_whiteouts":1,"num_read":4010,"num_read_kb":16171070,"num_write":5302,"num_write_kb":19193899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34812780544,"data_stored":34812725898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12969,"ondisk_log_size":12969,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1692185,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":629,"num_write_kb":1904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5499,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3448832,"data_stored":3384370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":599,"ondisk_log_size":599,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509665,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3796896,"kb_used_data":3657496,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":90574944,"statfs":{"total":96636764160,"available":92748742656,"internally_reserved":0,"allocated":3745275904,"data_stored":3744324964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":142735818},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509666,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4767064,"kb_used_data":4627664,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":89604776,"statfs":{"total":96636764160,"available":91755290624,"internally_reserved":0,"allocated":4738727936,"data_stored":4737788963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":142735814},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509666,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3651364,"kb_used_data":3507804,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":90720476,"statfs":{"total":96636764160,"available":92897767424,"internally_reserved":0,"allocated":3591991296,"data_stored":3591052876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509667,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5277344,"kb_used_data":5142104,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89094496,"statfs":{"total":96636764160,"available":91232763904,"internally_reserved":0,"allocated":5265514496,"data_stored":5264580072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509666,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5609196,"kb_used_data":5469796,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":88762644,"statfs":{"total":96636764160,"available":90892947456,"internally_reserved":0,"allocated":5601071104,"data_stored":5600125202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509666,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4069016,"kb_used_data":3933776,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":90302824,"statfs":{"total":96636764160,"available":92470091776,"internally_reserved":0,"allocated":4028186624,"data_stored":4027260071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509666,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3721624,"kb_used_data":3573904,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90650216,"statfs":{"total":96636764160,"available":92825821184,"internally_reserved":0,"allocated":3659677696,"data_stored":3658751555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542370,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4241136,"kb_used_data":4101736,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":90130704,"statfs":{"total":96636764160,"available":92293840896,"internally_reserved":0,"allocated":4200177664,"data_stored":4199232093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":142735815},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1703936,"data_stored":1691387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1708032,"data_stored":1687068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3657433088,"data_stored":3657433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4026535936,"data_stored":4026531972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5599412224,"data_stored":5599396487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4198510592,"data_stored":4198498877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5263859712,"data_stored":5263851903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3590332416,"data_stored":3590324665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4735373312,"data_stored":4735369477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3741323264,"data_stored":3741319429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T17:07:30.989 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-30T17:07:31.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.163+0000 7f6261600640 1 Processor -- start 2024-05-30T17:07:31.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.163+0000 7f6261600640 1 -- start start 2024-05-30T17:07:31.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.163+0000 7f6261600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f625c159100 0x7f625c06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.163+0000 7f6261600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f625c0b44e0 0x7f625c15efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.163+0000 7f6261600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625c0b52d0 con 0x7f625c15f510 2024-05-30T17:07:31.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.163+0000 7f6261600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f625c0b4a30 con 0x7f625c0b44e0 2024-05-30T17:07:31.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.163+0000 7f6261600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f625c0b4d10 con 0x7f625c159100 2024-05-30T17:07:31.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f625b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f625c15f510 0x7f625c15c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58310/0 (socket says 172.21.15.59:58310) 2024-05-30T17:07:31.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f6253e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f625c0b44e0 0x7f625c15efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f625b400640 1 -- 172.21.15.59:0/2308615592 learned_addr learned my addr 172.21.15.59:0/2308615592 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:31.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f625aa00640 1 --2- 172.21.15.59:0/2308615592 >> v2:172.21.15.107:3300/0 conn(0x7f625c159100 0x7f625c06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f6253e00640 1 -- 172.21.15.59:0/2308615592 >> v2:172.21.15.107:3300/0 conn(0x7f625c159100 msgr2=0x7f625c06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:31.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f6253e00640 1 --2- 172.21.15.59:0/2308615592 >> v2:172.21.15.107:3300/0 conn(0x7f625c159100 0x7f625c06e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f6253e00640 1 -- 172.21.15.59:0/2308615592 >> v1:172.21.15.59:6789/0 conn(0x7f625c15f510 legacy=0x7f625c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f6253e00640 1 -- 172.21.15.59:0/2308615592 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c0b4ff0 con 0x7f625c0b44e0 2024-05-30T17:07:31.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f625a000640 1 -- 172.21.15.59:0/2308615592 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153443596 0 0) 0x7f625c0b52d0 con 0x7f625c15f510 2024-05-30T17:07:31.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f6253e00640 1 --2- 172.21.15.59:0/2308615592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625c0b44e0 0x7f625c15efd0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f625c06c8f0 tx=0x7f624401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7a5cd1a4e062a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:31.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f625a000640 1 -- 172.21.15.59:0/2308615592 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62440b1070 con 0x7f625c0b44e0 2024-05-30T17:07:31.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f625a000640 1 -- 172.21.15.59:0/2308615592 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62440ac620 con 0x7f625c0b44e0 2024-05-30T17:07:31.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.167+0000 7f625a000640 1 -- 172.21.15.59:0/2308615592 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62440ac9f0 con 0x7f625c0b44e0 2024-05-30T17:07:31.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 -- 172.21.15.59:0/2308615592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625c0b44e0 msgr2=0x7f625c15efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 --2- 172.21.15.59:0/2308615592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625c0b44e0 0x7f625c15efd0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f625c06c8f0 tx=0x7f624401c3c0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 -- 172.21.15.59:0/2308615592 shutdown_connections 2024-05-30T17:07:31.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 --2- 172.21.15.59:0/2308615592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625c0b44e0 0x7f625c15efd0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 --2- 172.21.15.59:0/2308615592 >> v2:172.21.15.107:3300/0 conn(0x7f625c159100 0x7f625c06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 -- 172.21.15.59:0/2308615592 >> 172.21.15.59:0/2308615592 conn(0x7f625c06bdb0 msgr2=0x7f625c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:31.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 -- 172.21.15.59:0/2308615592 shutdown_connections 2024-05-30T17:07:31.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 -- 172.21.15.59:0/2308615592 wait complete. 2024-05-30T17:07:31.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 Processor -- start 2024-05-30T17:07:31.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 -- start start 2024-05-30T17:07:31.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f625c0b44e0 0x7f625c099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f625c159100 0x7f625c144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625c15f510 0x7f625c142410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f625c1682c0 con 0x7f625c15f510 2024-05-30T17:07:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f625c168140 con 0x7f625c0b44e0 2024-05-30T17:07:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6261600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f625c168440 con 0x7f625c159100 2024-05-30T17:07:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f625b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625c15f510 0x7f625c142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f625aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f625c0b44e0 0x7f625c099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f625b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625c15f510 0x7f625c142410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39210/0 (socket says 172.21.15.59:39210) 2024-05-30T17:07:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f625aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f625c0b44e0 0x7f625c099a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.59:54478/0 (socket says 172.21.15.59:54478) 2024-05-30T17:07:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f625b400640 1 -- 172.21.15.59:0/1897425375 learned_addr learned my addr 172.21.15.59:0/1897425375 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f6253e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f625c159100 0x7f625c144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f625b400640 1 -- 172.21.15.59:0/1897425375 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f625c159100 msgr2=0x7f625c144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f625b400640 1 --2- 172.21.15.59:0/1897425375 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f625c159100 0x7f625c144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.171+0000 7f625b400640 1 -- 172.21.15.59:0/1897425375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f625c0b44e0 msgr2=0x7f625c099a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f625b400640 1 --2- 172.21.15.59:0/1897425375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f625c0b44e0 0x7f625c099a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f625b400640 1 -- 172.21.15.59:0/1897425375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c1453b0 con 0x7f625c15f510 2024-05-30T17:07:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f625b400640 1 --2- 172.21.15.59:0/1897425375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625c15f510 0x7f625c142410 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f625400c730 tx=0x7f625400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f6252a00640 1 -- 172.21.15.59:0/1897425375 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254018070 con 0x7f625c15f510 2024-05-30T17:07:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f6252a00640 1 -- 172.21.15.59:0/1897425375 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625400ce40 con 0x7f625c15f510 2024-05-30T17:07:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f6252a00640 1 -- 172.21.15.59:0/1897425375 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625400a860 con 0x7f625c15f510 2024-05-30T17:07:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f6261600640 1 -- 172.21.15.59:0/1897425375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625c0ccdd0 con 0x7f625c15f510 2024-05-30T17:07:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f6261600640 1 -- 172.21.15.59:0/1897425375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625c0ceb10 con 0x7f625c15f510 2024-05-30T17:07:31.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f6261600640 1 -- 172.21.15.59:0/1897425375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f625c068a90 con 0x7f625c15f510 2024-05-30T17:07:31.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f6252a00640 1 -- 172.21.15.59:0/1897425375 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 47) ==== 90588+0+0 (secure 0 0 0) 0x7f625400aa00 con 0x7f625c15f510 2024-05-30T17:07:31.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f6252a00640 1 --2- 172.21.15.59:0/1897425375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f623806a030 0x7f623806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f6252a00640 1 -- 172.21.15.59:0/1897425375 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7f6254084e30 con 0x7f625c15f510 2024-05-30T17:07:31.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.175+0000 7f625aa00640 1 --2- 172.21.15.59:0/1897425375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f623806a030 0x7f623806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.179+0000 7f625aa00640 1 --2- 172.21.15.59:0/1897425375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f623806a030 0x7f623806c4f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f624c007a60 tx=0x7f624c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:31.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.179+0000 7f6252a00640 1 -- 172.21.15.59:0/1897425375 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f62540568a0 con 0x7f625c15f510 2024-05-30T17:07:31.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.347+0000 7f6261600640 1 -- 172.21.15.59:0/1897425375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f625c15e910 con 0x7f625c15f510 2024-05-30T17:07:31.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6252a00640 1 -- 172.21.15.59:0/1897425375 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7f625405aba0 con 0x7f625c15f510 2024-05-30T17:07:31.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6252a00640 1 -- 172.21.15.59:0/1897425375 <== mon.0 v2:172.21.15.59:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f625405f3d0 con 0x7f625c15f510 2024-05-30T17:07:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6261600640 1 -- 172.21.15.59:0/1897425375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f623806a030 msgr2=0x7f623806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6261600640 1 --2- 172.21.15.59:0/1897425375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f623806a030 0x7f623806c4f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f624c007a60 tx=0x7f624c008040 comp rx=0 tx=0).stop 2024-05-30T17:07:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6261600640 1 -- 172.21.15.59:0/1897425375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625c15f510 msgr2=0x7f625c142410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6261600640 1 --2- 172.21.15.59:0/1897425375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625c15f510 0x7f625c142410 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f625400c730 tx=0x7f625400cbf0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6261600640 1 -- 172.21.15.59:0/1897425375 shutdown_connections 2024-05-30T17:07:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6261600640 1 --2- 172.21.15.59:0/1897425375 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7f623806a030 0x7f623806c4f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6261600640 1 --2- 172.21.15.59:0/1897425375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625c15f510 0x7f625c142410 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6261600640 1 --2- 172.21.15.59:0/1897425375 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f625c159100 0x7f625c144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6261600640 1 --2- 172.21.15.59:0/1897425375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f625c0b44e0 0x7f625c099a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6261600640 1 -- 172.21.15.59:0/1897425375 >> 172.21.15.59:0/1897425375 conn(0x7f625c06bdb0 msgr2=0x7f625c164480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6261600640 1 -- 172.21.15.59:0/1897425375 shutdown_connections 2024-05-30T17:07:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.351+0000 7f6261600640 1 -- 172.21.15.59:0/1897425375 wait complete. 2024-05-30T17:07:31.370 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:07:31.370+0000 7efd6f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:07:31.371 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:07:31.370+0000 7efd6f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:07:31.371 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:07:31.370+0000 7efd6f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:07:31.371 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:07:31.370+0000 7efd6f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:07:31.371 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-30T17:07:31.370+0000 7efd6f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T17:07:31.374 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T17:07:31.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T17:07:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca4400640 1 Processor -- start 2024-05-30T17:07:31.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca4400640 1 -- start start 2024-05-30T17:07:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca4400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcc9c160d90 0x7fcc9c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca4400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc9c070d60 con 0x7fcc9c0711e0 2024-05-30T17:07:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca4400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc9c0d1310 con 0x7fcc9c09b780 2024-05-30T17:07:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca4400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fcc9c0ced30 con 0x7fcc9c160d90 2024-05-30T17:07:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca2400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcc9c0711e0 0x7fcc9c070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58322/0 (socket says 172.21.15.59:58322) 2024-05-30T17:07:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca2400640 1 -- 172.21.15.59:0/2131613213 learned_addr learned my addr 172.21.15.59:0/2131613213 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-05-30T17:07:31.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca1a00640 1 --2- 172.21.15.59:0/2131613213 >> v2:172.21.15.107:3300/0 conn(0x7fcc9c160d90 0x7fcc9c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 452118863 0 0) 0x7fcc9c070d60 con 0x7fcc9c0711e0 2024-05-30T17:07:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc84003530 con 0x7fcc9c0711e0 2024-05-30T17:07:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1828534451 0 0) 0x7fcc84003530 con 0x7fcc9c0711e0 2024-05-30T17:07:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 >> v2:172.21.15.107:3300/0 conn(0x7fcc9c160d90 msgr2=0x7fcc9c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 --2- 172.21.15.59:0/2131613213 >> v2:172.21.15.107:3300/0 conn(0x7fcc9c160d90 0x7fcc9c09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 >> v1:172.21.15.107:6789/0 conn(0x7fcc9c09b780 legacy=0x7fcc9c06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c09bcf0 con 0x7fcc9c0711e0 2024-05-30T17:07:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1832127791 0 0) 0x7fcc94001a00 con 0x7fcc9c0711e0 2024-05-30T17:07:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 >> v1:172.21.15.59:6789/0 conn(0x7fcc9c0711e0 legacy=0x7fcc9c070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 --2- 172.21.15.59:0/2131613213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc840039c0 0x7fcc84003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 --2- 172.21.15.59:0/2131613213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc84004810 0x7fcc84004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 --2- 172.21.15.59:0/2131613213 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc840051d0 0x7fcc8400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8400c140 con 0x7fcc840039c0 2024-05-30T17:07:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8400c2f0 con 0x7fcc84004810 2024-05-30T17:07:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcc8400c4f0 con 0x7fcc840051d0 2024-05-30T17:07:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca1a00640 1 --2- 172.21.15.59:0/2131613213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc840039c0 0x7fcc84003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca1000640 1 --2- 172.21.15.59:0/2131613213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc84004810 0x7fcc84004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca2400640 1 --2- 172.21.15.59:0/2131613213 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc840051d0 0x7fcc8400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca1a00640 1 -- 172.21.15.59:0/2131613213 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc840051d0 msgr2=0x7fcc8400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca1a00640 1 --2- 172.21.15.59:0/2131613213 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc840051d0 0x7fcc8400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca1a00640 1 -- 172.21.15.59:0/2131613213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc84004810 msgr2=0x7fcc84004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T17:07:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca1a00640 1 --2- 172.21.15.59:0/2131613213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc84004810 0x7fcc84004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca1a00640 1 -- 172.21.15.59:0/2131613213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc84003530 con 0x7fcc840039c0 2024-05-30T17:07:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca1000640 1 --2- 172.21.15.59:0/2131613213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc84004810 0x7fcc84004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T17:07:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.515+0000 7fcca2400640 1 -- 172.21.15.59:0/2131613213 reap_dead start 2024-05-30T17:07:31.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.519+0000 7fcca1a00640 1 --2- 172.21.15.59:0/2131613213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc840039c0 0x7fcc84003de0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009ae0 tx=0x7fcc9001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560b9d8450f7b4a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:31.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.519+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc900096b0 con 0x7fcc840039c0 2024-05-30T17:07:31.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.519+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcc900a6440 con 0x7fcc840039c0 2024-05-30T17:07:31.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.519+0000 7fcc9be00640 1 -- 172.21.15.59:0/2131613213 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc900a6850 con 0x7fcc840039c0 2024-05-30T17:07:31.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.519+0000 7fcca4400640 1 -- 172.21.15.59:0/2131613213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc840039c0 msgr2=0x7fcc84003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.519+0000 7fcca4400640 1 --2- 172.21.15.59:0/2131613213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc840039c0 0x7fcc84003de0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009ae0 tx=0x7fcc9001ca90 comp rx=0 tx=0).stop 2024-05-30T17:07:31.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.519+0000 7fcca4400640 1 -- 172.21.15.59:0/2131613213 shutdown_connections 2024-05-30T17:07:31.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.519+0000 7fcca4400640 1 --2- 172.21.15.59:0/2131613213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc840039c0 0x7fcc84003de0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.519+0000 7fcca4400640 1 -- 172.21.15.59:0/2131613213 >> 172.21.15.59:0/2131613213 conn(0x7fcc9c0b3f80 msgr2=0x7fcc9c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:31.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.519+0000 7fcca4400640 1 -- 172.21.15.59:0/2131613213 shutdown_connections 2024-05-30T17:07:31.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.519+0000 7fcca4400640 1 -- 172.21.15.59:0/2131613213 wait complete. 2024-05-30T17:07:31.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca4400640 1 Processor -- start 2024-05-30T17:07:31.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca4400640 1 -- start start 2024-05-30T17:07:31.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca4400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc840039c0 0x7fcc9c1601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca4400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c0b5ac0 0x7fcc9c15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca4400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc9c1f4740 0x7fcc9c1f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca4400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c0af360 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca4400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c0af1e0 con 0x7fcc840039c0 2024-05-30T17:07:31.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca4400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9c071e60 con 0x7fcc9c1f4740 2024-05-30T17:07:31.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c0b5ac0 0x7fcc9c15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c0b5ac0 0x7fcc9c15a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39224/0 (socket says 172.21.15.59:39224) 2024-05-30T17:07:31.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca1000640 1 -- 172.21.15.59:0/2992766425 learned_addr learned my addr 172.21.15.59:0/2992766425 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-05-30T17:07:31.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca1a00640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc840039c0 0x7fcc9c1601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca2400640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc9c1f4740 0x7fcc9c1f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca1000640 1 -- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc9c1f4740 msgr2=0x7fcc9c1f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca1000640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc9c1f4740 0x7fcc9c1f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca1000640 1 -- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc840039c0 msgr2=0x7fcc9c1601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca1000640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc840039c0 0x7fcc9c1601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca1000640 1 -- 172.21.15.59:0/2992766425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c1f5100 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca1000640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c0b5ac0 0x7fcc9c15a530 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800e580 tx=0x7fcc8800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:31.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcc99600640 1 -- 172.21.15.59:0/2992766425 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc880052e0 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcc99600640 1 -- 172.21.15.59:0/2992766425 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcc88018070 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca4400640 1 -- 172.21.15.59:0/2992766425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9c0b6a00 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcc99600640 1 -- 172.21.15.59:0/2992766425 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88005480 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.523+0000 7fcca4400640 1 -- 172.21.15.59:0/2992766425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9c0b6fc0 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.527+0000 7fcca4400640 1 -- 172.21.15.59:0/2992766425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc9c0b71c0 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.527+0000 7fcc99600640 1 -- 172.21.15.59:0/2992766425 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 47) ==== 90588+0+0 (secure 0 0 0) 0x7fcc88003860 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.527+0000 7fcc99600640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc7c06a060 0x7fcc7c06c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T17:07:31.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.527+0000 7fcc99600640 1 -- 172.21.15.59:0/2992766425 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5879+0+0 (secure 0 0 0) 0x7fcc88085620 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.527+0000 7fcca1a00640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc7c06a060 0x7fcc7c06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T17:07:31.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.527+0000 7fcca1a00640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc7c06a060 0x7fcc7c06c520 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcc900ad000 tx=0x7fcc900b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T17:07:31.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.531+0000 7fcc99600640 1 -- 172.21.15.59:0/2992766425 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcc9c0b71c0 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.735+0000 7fcca4400640 1 -- 172.21.15.59:0/2992766425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc9c0b4be0 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.735+0000 7fcc99600640 1 -- 172.21.15.59:0/2992766425 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5186 (secure 0 0 0) 0x7fcc88056f70 con 0x7fcc9c0b5ac0 2024-05-30T17:07:31.739 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-05-30T17:07:31.739 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":82,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3073990640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3073990640},{"type":"v1","addr":"172.21.15.107:6836","nonce":3073990640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1431726734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1431726734},{"type":"v1","addr":"172.21.15.107:6837","nonce":1431726734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":8988,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/410571111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":410571111},{"type":"v1","addr":"172.21.15.59:6834","nonce":410571111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T17:04:27.043818+0000","modified":"2024-05-30T17:04:30.067824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8991},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8991":{"gid":8991,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/1040424272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1040424272},{"type":"v1","addr":"172.21.15.59:6835","nonce":1040424272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8991,"qdb_cluster":[8991]},"id":9}]} 2024-05-30T17:07:31.739 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 82 2024-05-30T17:07:31.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.739+0000 7fcca4400640 1 -- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc7c06a060 msgr2=0x7fcc7c06c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.739+0000 7fcca4400640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc7c06a060 0x7fcc7c06c520 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcc900ad000 tx=0x7fcc900b2040 comp rx=0 tx=0).stop 2024-05-30T17:07:31.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.739+0000 7fcca4400640 1 -- 172.21.15.59:0/2992766425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c0b5ac0 msgr2=0x7fcc9c15a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T17:07:31.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.739+0000 7fcca4400640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c0b5ac0 0x7fcc9c15a530 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800e580 tx=0x7fcc8800ea40 comp rx=0 tx=0).stop 2024-05-30T17:07:31.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.739+0000 7fcca4400640 1 -- 172.21.15.59:0/2992766425 shutdown_connections 2024-05-30T17:07:31.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.739+0000 7fcca4400640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:6832/1203848956,v1:172.21.15.107:6833/1203848956] conn(0x7fcc7c06a060 0x7fcc7c06c520 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.739+0000 7fcca4400640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc9c1f4740 0x7fcc9c1f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.739+0000 7fcca4400640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c0b5ac0 0x7fcc9c15a530 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.739+0000 7fcca4400640 1 --2- 172.21.15.59:0/2992766425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc840039c0 0x7fcc9c1601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T17:07:31.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.739+0000 7fcca4400640 1 -- 172.21.15.59:0/2992766425 >> 172.21.15.59:0/2992766425 conn(0x7fcc9c0b3f80 msgr2=0x7fcc9c0af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T17:07:31.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.739+0000 7fcca4400640 1 -- 172.21.15.59:0/2992766425 shutdown_connections 2024-05-30T17:07:31.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-05-30T17:07:31.739+0000 7fcca4400640 1 -- 172.21.15.59:0/2992766425 wait complete. 2024-05-30T17:07:31.759 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-30T17:07:31.760 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-30T17:07:31.760 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T17:07:31.760 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:07:31.775 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T17:07:31.775 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T17:07:31.775 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:07:31.831 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T17:07:31.831 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T17:07:31.831 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:07:31.844 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T17:07:31.844 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T17:07:31.844 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:07:31.898 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T17:07:31.899 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-30T17:07:31.899 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-30T17:07:31.899 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:07:35.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-30T17:07:36.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:07:36.929 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:07:38.000 INFO:tasks.ceph.osd.0:Stopped 2024-05-30T17:07:38.001 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-30T17:07:38.001 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:07:41.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-30T17:07:41.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-30T17:07:44.103 INFO:tasks.ceph.osd.1:Stopped 2024-05-30T17:07:44.104 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-30T17:07:44.104 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:07:47.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-30T17:07:47.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-30T17:07:50.206 INFO:tasks.ceph.osd.2:Stopped 2024-05-30T17:07:50.206 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-30T17:07:50.206 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:07:53.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-30T17:07:53.902 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-30T17:07:56.308 INFO:tasks.ceph.osd.3:Stopped 2024-05-30T17:07:56.308 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-30T17:07:56.309 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:07:59.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-30T17:07:59.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-30T17:08:02.410 INFO:tasks.ceph.osd.4:Stopped 2024-05-30T17:08:02.411 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-30T17:08:02.411 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:08:02.494 INFO:tasks.ceph.osd.5:Stopped 2024-05-30T17:08:02.495 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-30T17:08:02.495 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:08:05.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-30T17:08:05.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-30T17:08:06.988 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:08:06.992 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:08:08.597 INFO:tasks.ceph.osd.6:Stopped 2024-05-30T17:08:08.597 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-30T17:08:08.597 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:08:08.689 INFO:tasks.ceph.osd.7:Stopped 2024-05-30T17:08:08.690 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-30T17:08:08.690 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-30T17:08:08.690 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:08:08.749 INFO:tasks.ceph.mgr.y:Stopped 2024-05-30T17:08:08.749 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-30T17:08:08.749 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:08:10.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-05-30T17:08:10.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-30T17:08:14.851 INFO:tasks.ceph.mgr.x:Stopped 2024-05-30T17:08:14.852 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-30T17:08:14.852 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-30T17:08:14.852 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:08:14.875 INFO:tasks.ceph.mon.a:Stopped 2024-05-30T17:08:14.875 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-30T17:08:14.875 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:08:14.894 INFO:tasks.ceph.mon.b:Stopped 2024-05-30T17:08:14.894 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-30T17:08:14.895 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T17:08:14.962 INFO:tasks.ceph.mon.c:Stopped 2024-05-30T17:08:14.962 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-30T17:08:14.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-05-30T17:08:15.003 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T17:08:15.003 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-30T17:08:15.306 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T17:08:15.307 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-30T17:08:15.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-05-30T17:08:15.626 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T17:08:15.626 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-30T17:08:15.852 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T17:08:15.853 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-30T17:08:16.059 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T17:08:16.059 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-30T17:08:16.546 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T17:08:16.546 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-30T17:08:16.733 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T17:08:16.734 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-30T17:08:16.904 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T17:08:16.904 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-30T17:08:17.086 INFO:tasks.ceph:Archiving mon data... 2024-05-30T17:08:17.087 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145/data/mon.a.tgz 2024-05-30T17:08:17.087 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-05-30T17:08:17.096 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.gbl7UHF6NW 2024-05-30T17:08:17.097 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.gbl7UHF6NW 2024-05-30T17:08:17.438 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.gbl7UHF6NW 2024-05-30T17:08:17.511 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.gbl7UHF6NW is 2MB 2024-05-30T17:08:17.598 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.gbl7UHF6NW 2024-05-30T17:08:17.607 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145/data/mon.b.tgz 2024-05-30T17:08:17.607 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-05-30T17:08:17.615 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.6F7L350XzY 2024-05-30T17:08:17.616 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6F7L350XzY 2024-05-30T17:08:17.955 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.6F7L350XzY 2024-05-30T17:08:18.030 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.6F7L350XzY is 2MB 2024-05-30T17:08:18.109 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.6F7L350XzY 2024-05-30T17:08:18.118 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145/data/mon.c.tgz 2024-05-30T17:08:18.118 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-05-30T17:08:18.169 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.Acq7BAHvUV 2024-05-30T17:08:18.169 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Acq7BAHvUV 2024-05-30T17:08:18.498 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.Acq7BAHvUV 2024-05-30T17:08:18.570 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.Acq7BAHvUV is 2MB 2024-05-30T17:08:18.649 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.Acq7BAHvUV 2024-05-30T17:08:18.658 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-30T17:08:18.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-30T17:08:18.662 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-30T17:08:18.731 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-30T17:08:18.769 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-30T17:08:18.769 INFO:tasks.ceph:Archiving crash dumps... 2024-05-30T17:08:18.771 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145/remote/smithi059/crash 2024-05-30T17:08:18.772 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-30T17:08:18.796 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145/remote/smithi107/crash 2024-05-30T17:08:18.797 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-30T17:08:18.827 INFO:tasks.ceph:Shutting down logrotate 2024-05-30T17:08:18.827 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:08:18.841 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T17:08:18.922 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-30T17:08:18.947 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-30T17:08:18.966 INFO:tasks.ceph:Compressing logs... 2024-05-30T17:08:18.966 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-30T17:08:18.993 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-30T17:08:19.018 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48499.log 2024-05-30T17:08:19.019 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42880.log 2024-05-30T17:08:19.020 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35912.log 2024-05-30T17:08:19.020 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48499.log.gz 2024-05-30T17:08:19.021 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44209.log 2024-05-30T17:08:19.021 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42880.log.gz 2024-05-30T17:08:19.021 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.35912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33288.log 2024-05-30T17:08:19.023 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35240.log 2024-05-30T17:08:19.023 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44209.log.gz 2024-05-30T17:08:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49490.log 2024-05-30T17:08:19.024 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33288.log.gz 2024-05-30T17:08:19.024 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45330.log 2024-05-30T17:08:19.025 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35240.log.gz 2024-05-30T17:08:19.025 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35144.log 2024-05-30T17:08:19.026 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49490.log.gz 2024-05-30T17:08:19.026 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52450.log 2024-05-30T17:08:19.026 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45330.log.gz 2024-05-30T17:08:19.027 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34962.log 2024-05-30T17:08:19.028 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35144.log.gz 2024-05-30T17:08:19.028 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44979.log 2024-05-30T17:08:19.028 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52450.log.gz 2024-05-30T17:08:19.029 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33514.log 2024-05-30T17:08:19.030 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34962.log.gz 2024-05-30T17:08:19.030 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40123.log 2024-05-30T17:08:19.030 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44979.log.gz 2024-05-30T17:08:19.031 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51935.log 2024-05-30T17:08:19.031 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33514.log.gz 2024-05-30T17:08:19.032 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41687.log 2024-05-30T17:08:19.032 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40123.log.gz 2024-05-30T17:08:19.033 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45135.log 2024-05-30T17:08:19.033 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51935.log.gz 2024-05-30T17:08:19.034 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41804.log 2024-05-30T17:08:19.034 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41687.log.gz 2024-05-30T17:08:19.034 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52270.log 2024-05-30T17:08:19.035 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45135.log.gz 2024-05-30T17:08:19.036 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46381.log 2024-05-30T17:08:19.036 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41804.log.gz 2024-05-30T17:08:19.036 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53470.log 2024-05-30T17:08:19.037 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52270.log.gz 2024-05-30T17:08:19.037 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44953.log 2024-05-30T17:08:19.038 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46381.log.gz 2024-05-30T17:08:19.038 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52424.log 2024-05-30T17:08:19.038 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53470.log.gz 2024-05-30T17:08:19.039 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39313.log 2024-05-30T17:08:19.039 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44953.log.gz 2024-05-30T17:08:19.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52088.log 2024-05-30T17:08:19.040 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52424.log.gz 2024-05-30T17:08:19.041 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28122.log 2024-05-30T17:08:19.041 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33798.log 2024-05-30T17:08:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46947.log 2024-05-30T17:08:19.042 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39313.log.gz 2024-05-30T17:08:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52088.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.37324.log -- replaced with /var/log/ceph/ceph-client.admin.52088.log.gz 2024-05-30T17:08:19.042 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-05-30T17:08:19.044 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.28122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28074.log 2024-05-30T17:08:19.044 INFO:teuthology.orchestra.run.smithi107.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28122.log.gz 2024-05-30T17:08:19.044 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.3.33798.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-30T17:08:19.044 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.28074.log: 87.8% -- replaced with /var/log/ceph/ceph-client.3.33798.log.gz 2024-05-30T17:08:19.044 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33685.log 2024-05-30T17:08:19.044 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28074.log.gz 2024-05-30T17:08:19.045 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-30T17:08:19.047 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.1.33685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28194.log 2024-05-30T17:08:19.048 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.6.log: 88.2% -- replaced with /var/log/ceph/ceph-client.1.33685.log.gz 2024-05-30T17:08:19.048 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28098.log 2024-05-30T17:08:19.048 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.28194.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-30T17:08:19.048 INFO:teuthology.orchestra.run.smithi107.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28194.log.gz 2024-05-30T17:08:19.048 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.28098.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28098.log.gz 2024-05-30T17:08:19.048 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28026.log 2024-05-30T17:08:19.050 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37755.log 2024-05-30T17:08:19.050 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46947.log.gz 2024-05-30T17:08:19.050 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47721.log 2024-05-30T17:08:19.051 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37324.log.gz 2024-05-30T17:08:19.051 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51162.log 2024-05-30T17:08:19.051 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47721.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.37755.log.gz 2024-05-30T17:08:19.051 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39405.log 2024-05-30T17:08:19.051 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47721.log.gz 2024-05-30T17:08:19.051 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45005.log 2024-05-30T17:08:19.051 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51162.log.gz 2024-05-30T17:08:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43255.log 2024-05-30T17:08:19.052 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39405.log.gz 2024-05-30T17:08:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50291.log 2024-05-30T17:08:19.052 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45005.log.gz 2024-05-30T17:08:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48421.log 2024-05-30T17:08:19.052 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43255.log.gz 2024-05-30T17:08:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42802.log 2024-05-30T17:08:19.052 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50291.log.gz 2024-05-30T17:08:19.057 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-30T17:08:19.057 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.28026.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-30T17:08:19.057 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28026.log.gz 2024-05-30T17:08:19.057 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28146.log 2024-05-30T17:08:19.057 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-30T17:08:19.057 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.28146.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-30T17:08:19.058 INFO:teuthology.orchestra.run.smithi107.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.28146.log.gz 2024-05-30T17:08:19.058 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28170.log 2024-05-30T17:08:19.060 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.28170.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28170.log.gz 2024-05-30T17:08:19.060 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-30T17:08:19.060 INFO:teuthology.orchestra.run.smithi107.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-30T17:08:19.060 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-30T17:08:19.062 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39459.log 2024-05-30T17:08:19.062 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48421.log.gz 2024-05-30T17:08:19.062 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42802.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-30T17:08:19.063 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42802.log.gz 2024-05-30T17:08:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49647.log 2024-05-30T17:08:19.063 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39459.log.gz 2024-05-30T17:08:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44339.log 2024-05-30T17:08:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50805.log 2024-05-30T17:08:19.063 INFO:teuthology.orchestra.run.smithi059.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49647.log.gz 2024-05-30T17:08:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44339.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44339.log.gz 2024-05-30T17:08:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51519.log 2024-05-30T17:08:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34910.log 2024-05-30T17:08:19.064 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50805.log.gz 2024-05-30T17:08:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46050.log 2024-05-30T17:08:19.064 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51519.log.gz 2024-05-30T17:08:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27813.log 2024-05-30T17:08:19.064 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34910.log.gz 2024-05-30T17:08:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46050.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46050.log.gz 2024-05-30T17:08:19.065 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50701.log 2024-05-30T17:08:19.065 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.27813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33444.log 2024-05-30T17:08:19.065 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27813.log.gz 2024-05-30T17:08:19.065 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50477.log 2024-05-30T17:08:19.065 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50701.log.gz 2024-05-30T17:08:19.065 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50105.log 2024-05-30T17:08:19.065 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33444.log.gz 2024-05-30T17:08:19.067 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mds.b.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-30T17:08:19.067 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-30T17:08:19.067 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-30T17:08:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46102.log 2024-05-30T17:08:19.070 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50477.log.gz 2024-05-30T17:08:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47183.log 2024-05-30T17:08:19.070 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50105.log.gz 2024-05-30T17:08:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47025.log 2024-05-30T17:08:19.071 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46102.log.gz 2024-05-30T17:08:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37941.log 2024-05-30T17:08:19.071 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47183.log.gz 2024-05-30T17:08:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47025.log: 94.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-30T17:08:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46511.log 2024-05-30T17:08:19.071 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47025.log.gz 2024-05-30T17:08:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51599.log 2024-05-30T17:08:19.071 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37941.log.gz 2024-05-30T17:08:19.072 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37061.log 2024-05-30T17:08:19.072 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46511.log.gz 2024-05-30T17:08:19.072 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41302.log 2024-05-30T17:08:19.072 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51599.log.gz 2024-05-30T17:08:19.074 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41328.log 2024-05-30T17:08:19.074 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37061.log.gz 2024-05-30T17:08:19.074 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52398.log 2024-05-30T17:08:19.074 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41302.log.gz 2024-05-30T17:08:19.074 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52584.log 2024-05-30T17:08:19.074 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41328.log.gz 2024-05-30T17:08:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40071.log 2024-05-30T17:08:19.075 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52398.log.gz 2024-05-30T17:08:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51358.log 2024-05-30T17:08:19.075 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52584.log.gz 2024-05-30T17:08:19.075 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28050.log 2024-05-30T17:08:19.077 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49905.log 2024-05-30T17:08:19.077 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40071.log.gz 2024-05-30T17:08:19.077 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51065.log 2024-05-30T17:08:19.077 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51358.log.gz 2024-05-30T17:08:19.077 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50876.log 2024-05-30T17:08:19.077 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49905.log.gz 2024-05-30T17:08:19.078 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49264.log 2024-05-30T17:08:19.078 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51065.log.gz 2024-05-30T17:08:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49594.log 2024-05-30T17:08:19.079 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50876.log.gz 2024-05-30T17:08:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44547.log 2024-05-30T17:08:19.080 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49264.log.gz 2024-05-30T17:08:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45818.log 2024-05-30T17:08:19.080 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49594.log.gz 2024-05-30T17:08:19.081 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.28050.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28050.log.gz 2024-05-30T17:08:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41896.log 2024-05-30T17:08:19.082 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44547.log.gz 2024-05-30T17:08:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42186.log 2024-05-30T17:08:19.082 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45818.log.gz 2024-05-30T17:08:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39092.log 2024-05-30T17:08:19.083 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41896.log.gz 2024-05-30T17:08:19.084 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42186.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-30T17:08:19.084 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42186.log.gz 2024-05-30T17:08:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53626.log 2024-05-30T17:08:19.085 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39092.log.gz 2024-05-30T17:08:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38665.log 2024-05-30T17:08:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34687.log 2024-05-30T17:08:19.086 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53626.log.gz 2024-05-30T17:08:19.087 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45478.log 2024-05-30T17:08:19.088 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38665.log.gz 2024-05-30T17:08:19.088 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34687.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34687.log.gz 2024-05-30T17:08:19.089 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36728.log 2024-05-30T17:08:19.089 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52296.log 2024-05-30T17:08:19.090 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45478.log.gz 2024-05-30T17:08:19.090 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35040.log 2024-05-30T17:08:19.091 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36728.log.gz 2024-05-30T17:08:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53366.log 2024-05-30T17:08:19.096 INFO:teuthology.orchestra.run.smithi059.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52296.log.gz 2024-05-30T17:08:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35040.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35040.log.gz 2024-05-30T17:08:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52504.log 2024-05-30T17:08:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44024.log 2024-05-30T17:08:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53366.log: /var/log/ceph/ceph-client.admin.52504.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53366.log.gz 2024-05-30T17:08:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33392.log 2024-05-30T17:08:19.097 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52504.log.gz 2024-05-30T17:08:19.097 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39813.log 2024-05-30T17:08:19.097 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44024.log.gz 2024-05-30T17:08:19.098 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33392.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33392.log.gz 2024-05-30T17:08:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33158.log 2024-05-30T17:08:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43038.log 2024-05-30T17:08:19.099 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39813.log.gz 2024-05-30T17:08:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36371.log 2024-05-30T17:08:19.099 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33158.log.gz 2024-05-30T17:08:19.100 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38019.log 2024-05-30T17:08:19.100 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43038.log.gz 2024-05-30T17:08:19.101 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46433.log 2024-05-30T17:08:19.101 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36371.log.gz 2024-05-30T17:08:19.101 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47773.log 2024-05-30T17:08:19.102 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38019.log.gz 2024-05-30T17:08:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47665.log 2024-05-30T17:08:19.103 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46433.log.gz 2024-05-30T17:08:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49141.log 2024-05-30T17:08:19.104 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47773.log.gz 2024-05-30T17:08:19.105 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42960.log 2024-05-30T17:08:19.105 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47665.log.gz 2024-05-30T17:08:19.105 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44495.log 2024-05-30T17:08:19.106 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49141.log.gz 2024-05-30T17:08:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36581.log 2024-05-30T17:08:19.107 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42960.log.gz 2024-05-30T17:08:19.107 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43531.log 2024-05-30T17:08:19.108 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44495.log.gz 2024-05-30T17:08:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43505.log 2024-05-30T17:08:19.109 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36581.log.gz 2024-05-30T17:08:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46973.log 2024-05-30T17:08:19.110 INFO:teuthology.orchestra.run.smithi059.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.43531.log.gz 2024-05-30T17:08:19.110 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43505.log: gzip 86.0% -- replaced with /var/log/ceph/ceph-client.admin.43505.log.gz 2024-05-30T17:08:19.111 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53208.log 2024-05-30T17:08:19.112 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44443.log 2024-05-30T17:08:19.112 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46973.log.gz 2024-05-30T17:08:19.113 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53208.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53208.log.gz 2024-05-30T17:08:19.113 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41739.log 2024-05-30T17:08:19.114 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46615.log 2024-05-30T17:08:19.114 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44443.log.gz 2024-05-30T17:08:19.115 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35701.log 2024-05-30T17:08:19.115 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41739.log.gz 2024-05-30T17:08:19.116 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46915.log 2024-05-30T17:08:19.116 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46615.log.gz 2024-05-30T17:08:19.117 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53548.log 2024-05-30T17:08:19.117 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35701.log.gz 2024-05-30T17:08:19.117 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45896.log 2024-05-30T17:08:19.118 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46915.log.gz 2024-05-30T17:08:19.118 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47131.log 2024-05-30T17:08:19.119 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53548.log.gz 2024-05-30T17:08:19.120 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51032.log 2024-05-30T17:08:19.120 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47131.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45896.log.gz 2024-05-30T17:08:19.121 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47131.log.gz 2024-05-30T17:08:19.121 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40378.log 2024-05-30T17:08:19.122 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41870.log 2024-05-30T17:08:19.122 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51032.log.gz 2024-05-30T17:08:19.123 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36555.log 2024-05-30T17:08:19.123 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40378.log.gz 2024-05-30T17:08:19.124 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42575.log 2024-05-30T17:08:19.124 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41870.log.gz 2024-05-30T17:08:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41270.log 2024-05-30T17:08:19.125 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36555.log.gz 2024-05-30T17:08:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41354.log 2024-05-30T17:08:19.126 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42575.log.gz 2024-05-30T17:08:19.127 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33262.log 2024-05-30T17:08:19.127 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41270.log.gz 2024-05-30T17:08:19.128 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45421.log 2024-05-30T17:08:19.128 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41354.log.gz 2024-05-30T17:08:19.129 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50053.log 2024-05-30T17:08:19.129 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33262.log.gz 2024-05-30T17:08:19.130 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52951.log 2024-05-30T17:08:19.130 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45421.log.gz 2024-05-30T17:08:19.130 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42776.log 2024-05-30T17:08:19.131 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50053.log.gz 2024-05-30T17:08:19.132 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37387.log 2024-05-30T17:08:19.132 INFO:teuthology.orchestra.run.smithi059.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.52951.log.gz 2024-05-30T17:08:19.133 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40644.log 2024-05-30T17:08:19.133 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42776.log.gz 2024-05-30T17:08:19.133 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37387.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37387.log.gz 2024-05-30T17:08:19.133 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53728.log 2024-05-30T17:08:19.134 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52846.log 2024-05-30T17:08:19.134 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40644.log.gz 2024-05-30T17:08:19.136 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51006.log 2024-05-30T17:08:19.136 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53728.log.gz 2024-05-30T17:08:19.136 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44076.log 2024-05-30T17:08:19.137 INFO:teuthology.orchestra.run.smithi059.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.52846.log.gz 2024-05-30T17:08:19.137 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43281.log 2024-05-30T17:08:19.138 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51006.log.gz 2024-05-30T17:08:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44076.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44076.log.gz 2024-05-30T17:08:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52140.log 2024-05-30T17:08:19.139 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41206.log 2024-05-30T17:08:19.140 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43281.log.gz 2024-05-30T17:08:19.141 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43480.log 2024-05-30T17:08:19.141 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52140.log.gz 2024-05-30T17:08:19.141 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46002.log 2024-05-30T17:08:19.142 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41206.log.gz 2024-05-30T17:08:19.143 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43480.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.43480.log.gz 2024-05-30T17:08:19.143 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42056.log 2024-05-30T17:08:19.143 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.46002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38193.log 2024-05-30T17:08:19.145 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43606.log 2024-05-30T17:08:19.145 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42056.log.gz 2024-05-30T17:08:19.146 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42601.log 2024-05-30T17:08:19.146 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38193.log.gz 2024-05-30T17:08:19.147 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35623.log 2024-05-30T17:08:19.147 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43606.log.gz 2024-05-30T17:08:19.148 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50345.log 2024-05-30T17:08:19.148 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42601.log.gz 2024-05-30T17:08:19.149 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40432.log 2024-05-30T17:08:19.149 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35623.log.gz 2024-05-30T17:08:19.150 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35986.log 2024-05-30T17:08:19.150 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40432.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50345.log.gz 2024-05-30T17:08:19.151 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40432.log.gz 2024-05-30T17:08:19.151 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49004.log 2024-05-30T17:08:19.152 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39281.log 2024-05-30T17:08:19.153 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35986.log.gz 2024-05-30T17:08:19.153 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48286.log 2024-05-30T17:08:19.153 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49004.log.gz 2024-05-30T17:08:19.154 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35506.log 2024-05-30T17:08:19.154 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39281.log.gz 2024-05-30T17:08:19.155 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48926.log 2024-05-30T17:08:19.156 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48286.log.gz 2024-05-30T17:08:19.156 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37651.log 2024-05-30T17:08:19.157 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35506.log.gz 2024-05-30T17:08:19.157 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43996.log 2024-05-30T17:08:19.158 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48926.log.gz 2024-05-30T17:08:19.158 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45083.log 2024-05-30T17:08:19.159 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37651.log.gz 2024-05-30T17:08:19.159 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43064.log 2024-05-30T17:08:19.160 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43996.log.gz 2024-05-30T17:08:19.161 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51097.log 2024-05-30T17:08:19.161 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45083.log.gz 2024-05-30T17:08:19.162 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49542.log 2024-05-30T17:08:19.162 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43064.log.gz 2024-05-30T17:08:19.163 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43398.log 2024-05-30T17:08:19.163 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51097.log.gz 2024-05-30T17:08:19.164 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50850.log 2024-05-30T17:08:19.164 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49542.log.gz 2024-05-30T17:08:19.165 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44365.log 2024-05-30T17:08:19.165 INFO:teuthology.orchestra.run.smithi059.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43398.log.gz 2024-05-30T17:08:19.166 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52321.log 2024-05-30T17:08:19.166 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50850.log.gz 2024-05-30T17:08:19.167 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43788.log 2024-05-30T17:08:19.167 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44365.log.gz 2024-05-30T17:08:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40510.log 2024-05-30T17:08:19.168 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52321.log.gz 2024-05-30T17:08:19.169 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49173.log 2024-05-30T17:08:19.169 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43788.log.gz 2024-05-30T17:08:19.171 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51727.log 2024-05-30T17:08:19.171 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40510.log.gz 2024-05-30T17:08:19.171 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5/var/log/ceph/ceph-client.admin.49173.log: --verbose -- /var/log/ceph/ceph-client.admin.52769.log 2024-05-30T17:08:19.172 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49173.log.gz 2024-05-30T17:08:19.172 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46749.log 2024-05-30T17:08:19.173 INFO:teuthology.orchestra.run.smithi059.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51727.log.gz 2024-05-30T17:08:19.174 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53312.log 2024-05-30T17:08:19.175 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52769.log.gz 2024-05-30T17:08:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.46749.log: -- /var/log/ceph/ceph-client.admin.44677.log 2024-05-30T17:08:19.176 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46749.log.gz 2024-05-30T17:08:19.176 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37146.log 2024-05-30T17:08:19.176 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53312.log.gz 2024-05-30T17:08:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43177.log 2024-05-30T17:08:19.177 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44677.log.gz 2024-05-30T17:08:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51271.log 2024-05-30T17:08:19.178 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37146.log.gz 2024-05-30T17:08:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34550.log 2024-05-30T17:08:19.179 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43177.log.gz 2024-05-30T17:08:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51271.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-30T17:08:19.180 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51271.log.gz 2024-05-30T17:08:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51783.log 2024-05-30T17:08:19.181 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34550.log.gz 2024-05-30T17:08:19.182 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50157.log 2024-05-30T17:08:19.183 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.51783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53600.log 2024-05-30T17:08:19.184 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46589.log 2024-05-30T17:08:19.184 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50157.log.gz 2024-05-30T17:08:19.186 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44849.log 2024-05-30T17:08:19.186 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53600.log.gz 2024-05-30T17:08:19.187 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39630.log 2024-05-30T17:08:19.188 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46589.log.gz 2024-05-30T17:08:19.188 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44849.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44849.log.gz 2024-05-30T17:08:19.189 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33470.log 2024-05-30T17:08:19.189 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39630.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39630.log.gz 2024-05-30T17:08:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46563.log 2024-05-30T17:08:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35753.log 2024-05-30T17:08:19.191 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33470.log.gz 2024-05-30T17:08:19.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46563.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46563.log.gz 2024-05-30T17:08:19.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35753.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35753.log.gz 2024-05-30T17:08:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40149.log 2024-05-30T17:08:19.195 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42627.log 2024-05-30T17:08:19.197 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33184.log 2024-05-30T17:08:19.197 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40149.log.gz 2024-05-30T17:08:19.198 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46251.log 2024-05-30T17:08:19.198 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz 2024-05-30T17:08:19.199 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33184.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33184.log.gz 2024-05-30T17:08:19.200 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39066.log 2024-05-30T17:08:19.200 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46251.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46251.log.gz 2024-05-30T17:08:19.201 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36884.log 2024-05-30T17:08:19.202 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46853.log 2024-05-30T17:08:19.202 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39066.log.gz 2024-05-30T17:08:19.204 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36884.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36884.log.gz 2024-05-30T17:08:19.205 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46853.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46853.log.gz 2024-05-30T17:08:19.205 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37413.log 2024-05-30T17:08:19.206 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53234.log 2024-05-30T17:08:19.207 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38561.log 2024-05-30T17:08:19.207 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37413.log.gz 2024-05-30T17:08:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53234.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53234.log.gz 2024-05-30T17:08:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38561.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38561.log.gz 2024-05-30T17:08:19.210 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44927.log 2024-05-30T17:08:19.211 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-30T17:08:19.212 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52795.log 2024-05-30T17:08:19.212 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44927.log.gz 2024-05-30T17:08:19.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41555.log 2024-05-30T17:08:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52795.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52795.log.gz 2024-05-30T17:08:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49408.log 2024-05-30T17:08:19.216 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41555.log.gz 2024-05-30T17:08:19.217 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36451.log 2024-05-30T17:08:19.219 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49408.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49408.log.gz 2024-05-30T17:08:19.219 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43372.log 2024-05-30T17:08:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36451.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36451.log.gz 2024-05-30T17:08:19.222 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43372.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43372.log.gz 2024-05-30T17:08:19.222 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37244.log 2024-05-30T17:08:19.223 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39997.log 2024-05-30T17:08:19.225 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37244.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37244.log.gz 2024-05-30T17:08:19.227 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.39997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38889.log 2024-05-30T17:08:19.228 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34042.log 2024-05-30T17:08:19.229 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38889.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38889.log.gz 2024-05-30T17:08:19.231 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49620.log 2024-05-30T17:08:19.233 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34042.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34042.log.gz 2024-05-30T17:08:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49620.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49620.log.gz 2024-05-30T17:08:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39604.log 2024-05-30T17:08:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39487.log 2024-05-30T17:08:19.238 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39604.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39604.log.gz 2024-05-30T17:08:19.239 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45662.log 2024-05-30T17:08:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39487.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39487.log.gz 2024-05-30T17:08:19.245 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45662.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45662.log.gz 2024-05-30T17:08:19.245 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51625.log 2024-05-30T17:08:19.248 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51625.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51625.log.gz 2024-05-30T17:08:19.248 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48473.log 2024-05-30T17:08:19.251 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48473.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48473.log.gz 2024-05-30T17:08:19.251 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34936.log 2024-05-30T17:08:19.255 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34936.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34936.log.gz 2024-05-30T17:08:19.255 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40920.log 2024-05-30T17:08:19.255 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52821.log 2024-05-30T17:08:19.256 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40920.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40920.log.gz 2024-05-30T17:08:19.259 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47404.log 2024-05-30T17:08:19.260 INFO:teuthology.orchestra.run.smithi059.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52821.log.gz 2024-05-30T17:08:19.262 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49753.log 2024-05-30T17:08:19.267 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47404.log: /var/log/ceph/ceph-client.0.49753.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47404.log.gz 2024-05-30T17:08:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40326.log 2024-05-30T17:08:19.272 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40813.log 2024-05-30T17:08:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40326.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40326.log.gz 2024-05-30T17:08:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45161.log 2024-05-30T17:08:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40813.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40813.log.gz 2024-05-30T17:08:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45161.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45161.log.gz 2024-05-30T17:08:19.279 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35855.log 2024-05-30T17:08:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35855.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35855.log.gz 2024-05-30T17:08:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52244.log 2024-05-30T17:08:19.291 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41950.log 2024-05-30T17:08:19.293 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52244.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52244.log.gz 2024-05-30T17:08:19.295 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45610.log 2024-05-30T17:08:19.297 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41950.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41950.log.gz 2024-05-30T17:08:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47578.log 2024-05-30T17:08:19.301 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45610.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45610.log.gz 2024-05-30T17:08:19.302 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49030.log 2024-05-30T17:08:19.303 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47578.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47578.log.gz 2024-05-30T17:08:19.307 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45057.log 2024-05-30T17:08:19.309 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49030.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49030.log.gz 2024-05-30T17:08:19.313 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45057.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45057.log.gz 2024-05-30T17:08:19.315 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36290.log 2024-05-30T17:08:19.319 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49801.log 2024-05-30T17:08:19.321 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36290.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36290.log.gz 2024-05-30T17:08:19.323 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40175.log 2024-05-30T17:08:19.325 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49801.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49801.log.gz 2024-05-30T17:08:19.326 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51677.log 2024-05-30T17:08:19.327 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49319.log 2024-05-30T17:08:19.328 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40175.log.gz 2024-05-30T17:08:19.329 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51677.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51677.log.gz 2024-05-30T17:08:19.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35649.log 2024-05-30T17:08:19.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49319.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49319.log.gz 2024-05-30T17:08:19.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34094.log 2024-05-30T17:08:19.339 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33132.log 2024-05-30T17:08:19.339 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35649.log.gz 2024-05-30T17:08:19.339 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34094.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34094.log.gz 2024-05-30T17:08:19.341 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33132.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33132.log.gz 2024-05-30T17:08:19.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49827.log 2024-05-30T17:08:19.347 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35118.log 2024-05-30T17:08:19.349 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49827.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49827.log.gz 2024-05-30T17:08:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51987.log 2024-05-30T17:08:19.353 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35118.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35118.log.gz 2024-05-30T17:08:19.355 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37178.log 2024-05-30T17:08:19.357 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51987.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51987.log.gz 2024-05-30T17:08:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51214.log 2024-05-30T17:08:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37178.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37178.log.gz 2024-05-30T17:08:19.364 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53652.log 2024-05-30T17:08:19.365 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51214.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51214.log.gz 2024-05-30T17:08:19.368 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36607.log 2024-05-30T17:08:19.369 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53652.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53652.log.gz 2024-05-30T17:08:19.373 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36607.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36607.log.gz 2024-05-30T17:08:19.375 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41609.log 2024-05-30T17:08:19.379 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34884.log 2024-05-30T17:08:19.381 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41609.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41609.log.gz 2024-05-30T17:08:19.383 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40972.log 2024-05-30T17:08:19.385 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34884.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34884.log.gz 2024-05-30T17:08:19.386 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40274.log 2024-05-30T17:08:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40972.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40972.log.gz 2024-05-30T17:08:19.391 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48138.log 2024-05-30T17:08:19.393 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40274.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40274.log.gz 2024-05-30T17:08:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51415.log 2024-05-30T17:08:19.397 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48138.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48138.log.gz 2024-05-30T17:08:19.399 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48629.log 2024-05-30T17:08:19.401 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51415.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51415.log.gz 2024-05-30T17:08:19.405 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48629.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48629.log.gz 2024-05-30T17:08:19.407 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47339.log 2024-05-30T17:08:19.408 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44050.log 2024-05-30T17:08:19.409 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47339.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47339.log.gz 2024-05-30T17:08:19.411 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33080.log 2024-05-30T17:08:19.413 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44050.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44050.log.gz 2024-05-30T17:08:19.414 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43646.log 2024-05-30T17:08:19.416 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33080.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33080.log.gz 2024-05-30T17:08:19.419 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47799.log 2024-05-30T17:08:19.421 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43646.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43646.log.gz 2024-05-30T17:08:19.423 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38613.log 2024-05-30T17:08:19.425 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47799.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47799.log.gz 2024-05-30T17:08:19.429 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38613.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38613.log.gz 2024-05-30T17:08:19.431 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47851.log 2024-05-30T17:08:19.436 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42854.log 2024-05-30T17:08:19.437 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47851.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47851.log.gz 2024-05-30T17:08:19.439 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40735.log 2024-05-30T17:08:19.441 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42854.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42854.log.gz 2024-05-30T17:08:19.442 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41180.log 2024-05-30T17:08:19.444 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40735.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40735.log.gz 2024-05-30T17:08:19.447 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46219.log 2024-05-30T17:08:19.448 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41180.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41180.log.gz 2024-05-30T17:08:19.450 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52054.log 2024-05-30T17:08:19.455 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46219.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46219.log.gz 2024-05-30T17:08:19.455 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52054.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52054.log.gz 2024-05-30T17:08:19.455 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36955.log 2024-05-30T17:08:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42004.log 2024-05-30T17:08:19.461 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36955.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36955.log.gz 2024-05-30T17:08:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47235.log 2024-05-30T17:08:19.465 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42004.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42004.log.gz 2024-05-30T17:08:19.467 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38805.log 2024-05-30T17:08:19.469 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47235.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47235.log.gz 2024-05-30T17:08:19.471 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2024-05-30T17:08:19.473 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38805.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38805.log.gz 2024-05-30T17:08:19.475 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53702.log 2024-05-30T17:08:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48033.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2024-05-30T17:08:19.478 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53130.log 2024-05-30T17:08:19.481 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53702.log: /var/log/ceph/ceph-client.admin.53130.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53130.log.gz 2024-05-30T17:08:19.483 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41128.log 2024-05-30T17:08:19.483 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53702.log.gz 2024-05-30T17:08:19.487 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35675.log 2024-05-30T17:08:19.489 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41128.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41128.log.gz 2024-05-30T17:08:19.491 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53522.log 2024-05-30T17:08:19.493 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35675.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35675.log.gz 2024-05-30T17:08:19.494 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48259.log 2024-05-30T17:08:19.500 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53522.log: gzip -5 --verbose -- 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53522.log.gz 2024-05-30T17:08:19.500 INFO:teuthology.orchestra.run.smithi059.stderr: /var/log/ceph/ceph-client.admin.50185.log 2024-05-30T17:08:19.501 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48259.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48259.log.gz 2024-05-30T17:08:19.505 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50185.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50185.log.gz 2024-05-30T17:08:19.507 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42108.log 2024-05-30T17:08:19.512 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35398.log 2024-05-30T17:08:19.513 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42108.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42108.log.gz 2024-05-30T17:08:19.514 INFO:teuthology.orchestra.run.smithi107.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-30T17:08:19.515 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35014.log 2024-05-30T17:08:19.517 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35398.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35398.log.gz 2024-05-30T17:08:19.519 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42653.log 2024-05-30T17:08:19.523 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51831.log 2024-05-30T17:08:19.523 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35014.log.gz 2024-05-30T17:08:19.525 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42653.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42653.log.gz 2024-05-30T17:08:19.526 INFO:teuthology.orchestra.run.smithi107.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-30T17:08:19.527 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46485.log 2024-05-30T17:08:19.529 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51831.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51831.log.gz 2024-05-30T17:08:19.531 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.46485.log: -- /var/log/ceph/ceph-client.admin.51188.log 2024-05-30T17:08:19.531 INFO:teuthology.orchestra.run.smithi059.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46485.log.gz 2024-05-30T17:08:19.536 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52192.log 2024-05-30T17:08:19.537 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51188.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51188.log.gz 2024-05-30T17:08:19.541 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52192.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52192.log.gz 2024-05-30T17:08:19.543 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46879.log 2024-05-30T17:08:19.547 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38941.log 2024-05-30T17:08:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46879.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46879.log.gz 2024-05-30T17:08:19.551 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34327.log 2024-05-30T17:08:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38941.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38941.log.gz 2024-05-30T17:08:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42264.log 2024-05-30T17:08:19.560 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38509.log 2024-05-30T17:08:19.560 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34327.log.gz 2024-05-30T17:08:19.561 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42264.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42264.log.gz 2024-05-30T17:08:19.563 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36064.log 2024-05-30T17:08:19.565 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38509.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38509.log.gz 2024-05-30T17:08:19.567 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51545.log/var/log/ceph/ceph-client.admin.36064.log: 2024-05-30T17:08:19.568 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36064.log.gz 2024-05-30T17:08:19.571 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35450.log 2024-05-30T17:08:19.573 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51545.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51545.log.gz 2024-05-30T17:08:19.577 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35450.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35450.log.gz 2024-05-30T17:08:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48803.log 2024-05-30T17:08:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38967.log 2024-05-30T17:08:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48803.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48803.log.gz 2024-05-30T17:08:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40998.log 2024-05-30T17:08:19.589 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38967.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38967.log.gz 2024-05-30T17:08:19.591 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37703.log 2024-05-30T17:08:19.593 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40998.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40998.log.gz 2024-05-30T17:08:19.595 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45740.log 2024-05-30T17:08:19.597 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37703.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37703.log.gz 2024-05-30T17:08:19.599 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43125.log 2024-05-30T17:08:19.601 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45740.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45740.log.gz 2024-05-30T17:08:19.603 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39548.log 2024-05-30T17:08:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43125.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43125.log.gz 2024-05-30T17:08:19.609 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39548.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39548.log.gz 2024-05-30T17:08:19.611 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42418.log 2024-05-30T17:08:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32904.log 2024-05-30T17:08:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42418.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42418.log.gz 2024-05-30T17:08:19.619 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35805.log 2024-05-30T17:08:19.621 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32904.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32904.log.gz 2024-05-30T17:08:19.623 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50649.log 2024-05-30T17:08:19.625 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35805.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35805.log.gz 2024-05-30T17:08:19.627 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49056.log 2024-05-30T17:08:19.631 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50649.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50649.log.gz 2024-05-30T17:08:19.632 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50753.log 2024-05-30T17:08:19.633 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49056.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49056.log.gz 2024-05-30T17:08:19.635 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53054.log 2024-05-30T17:08:19.637 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50753.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50753.log.gz 2024-05-30T17:08:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53054.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53054.log.gz 2024-05-30T17:08:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34988.log 2024-05-30T17:08:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-30T17:08:19.649 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34988.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34988.log.gz 2024-05-30T17:08:19.651 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44235.log 2024-05-30T17:08:19.660 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40404.log 2024-05-30T17:08:19.661 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44235.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44235.log.gz 2024-05-30T17:08:19.664 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51243.log 2024-05-30T17:08:19.665 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40404.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40404.log.gz 2024-05-30T17:08:19.669 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51243.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51243.log.gz 2024-05-30T17:08:19.671 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47495.log 2024-05-30T17:08:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38915.log 2024-05-30T17:08:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47495.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47495.log.gz 2024-05-30T17:08:19.679 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33340.log 2024-05-30T17:08:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38915.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38915.log.gz 2024-05-30T17:08:19.683 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39656.log 2024-05-30T17:08:19.685 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33340.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33340.log.gz 2024-05-30T17:08:19.687 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38297.log 2024-05-30T17:08:19.689 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39656.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39656.log.gz 2024-05-30T17:08:19.691 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46459.log 2024-05-30T17:08:19.693 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38297.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38297.log.gz 2024-05-30T17:08:19.695 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38457.log 2024-05-30T17:08:19.697 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46459.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46459.log.gz 2024-05-30T17:08:19.701 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38457.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38457.log.gz 2024-05-30T17:08:19.703 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43337.log 2024-05-30T17:08:19.707 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48665.log 2024-05-30T17:08:19.709 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43337.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43337.log.gz 2024-05-30T17:08:19.711 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50980.log 2024-05-30T17:08:19.713 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48665.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48665.log.gz 2024-05-30T17:08:19.715 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48059.log 2024-05-30T17:08:19.717 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50980.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50980.log.gz 2024-05-30T17:08:19.719 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52218.log 2024-05-30T17:08:19.721 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48059.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48059.log.gz 2024-05-30T17:08:19.723 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50131.log 2024-05-30T17:08:19.725 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52218.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52218.log.gz 2024-05-30T17:08:19.727 INFO:teuthology.orchestra.run.smithi107.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-30T17:08:19.727 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43733.log 2024-05-30T17:08:19.729 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50131.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50131.log.gz 2024-05-30T17:08:19.731 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39760.log 2024-05-30T17:08:19.733 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43733.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43733.log.gz 2024-05-30T17:08:19.737 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39760.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39760.log.gz 2024-05-30T17:08:19.739 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43581.log 2024-05-30T17:08:19.743 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23004.log 2024-05-30T17:08:19.745 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43581.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.43581.log.gz 2024-05-30T17:08:19.747 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.34423.log 2024-05-30T17:08:19.749 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.tmp-client.admin.23004.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23004.log.gz 2024-05-30T17:08:19.751 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47372.log 2024-05-30T17:08:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.2.34423.log: 88.9% -- replaced with /var/log/ceph/ceph-client.2.34423.log.gz 2024-05-30T17:08:19.755 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49290.log 2024-05-30T17:08:19.757 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47372.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47372.log.gz 2024-05-30T17:08:19.759 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42290.log 2024-05-30T17:08:19.761 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49290.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49290.log.gz 2024-05-30T17:08:19.763 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47983.log 2024-05-30T17:08:19.765 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42290.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42290.log.gz 2024-05-30T17:08:19.771 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.47983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45766.log 2024-05-30T17:08:19.775 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44703.log 2024-05-30T17:08:19.777 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45766.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45766.log.gz 2024-05-30T17:08:19.779 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53444.log 2024-05-30T17:08:19.781 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44703.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44703.log.gz 2024-05-30T17:08:19.786 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36186.log 2024-05-30T17:08:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53444.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53444.log.gz 2024-05-30T17:08:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37862.log 2024-05-30T17:08:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36186.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36186.log.gz 2024-05-30T17:08:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40300.log 2024-05-30T17:08:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.37862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52924.log 2024-05-30T17:08:19.797 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40300.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40300.log.gz 2024-05-30T17:08:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48577.log 2024-05-30T17:08:19.801 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52924.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.52924.log.gz 2024-05-30T17:08:19.805 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48577.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48577.log.gz 2024-05-30T17:08:19.807 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44102.log 2024-05-30T17:08:19.811 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36503.log 2024-05-30T17:08:19.813 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44102.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44102.log.gz 2024-05-30T17:08:19.815 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34654.log 2024-05-30T17:08:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36503.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36503.log.gz 2024-05-30T17:08:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33050.log 2024-05-30T17:08:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34654.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34654.log.gz 2024-05-30T17:08:19.823 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48551.log 2024-05-30T17:08:19.825 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33050.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33050.log.gz 2024-05-30T17:08:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39170.log 2024-05-30T17:08:19.828 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48551.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48551.log.gz 2024-05-30T17:08:19.833 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39170.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39170.log.gz 2024-05-30T17:08:19.834 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34524.log 2024-05-30T17:08:19.839 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36397.log 2024-05-30T17:08:19.841 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34524.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34524.log.gz 2024-05-30T17:08:19.843 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38323.log 2024-05-30T17:08:19.845 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36397.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36397.log.gz 2024-05-30T17:08:19.848 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51441.log 2024-05-30T17:08:19.849 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38323.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38323.log.gz 2024-05-30T17:08:19.851 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45792.log 2024-05-30T17:08:19.853 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50239.log 2024-05-30T17:08:19.854 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51441.log.gz 2024-05-30T17:08:19.854 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45792.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45792.log.gz 2024-05-30T17:08:19.859 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50239.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50239.log.gz 2024-05-30T17:08:19.860 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38587.log 2024-05-30T17:08:19.863 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48312.log 2024-05-30T17:08:19.865 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38587.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38587.log.gz 2024-05-30T17:08:19.867 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44729.log 2024-05-30T17:08:19.869 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48312.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48312.log.gz 2024-05-30T17:08:19.873 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44729.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44729.log.gz 2024-05-30T17:08:19.873 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41978.log 2024-05-30T17:08:19.876 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33990.log 2024-05-30T17:08:19.880 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41978.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.41978.log.gz 2024-05-30T17:08:19.880 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-30T17:08:19.881 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33990.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33990.log.gz 2024-05-30T17:08:19.883 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41484.log 2024-05-30T17:08:19.889 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.41484.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41484.log.gz 2024-05-30T17:08:19.891 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36780.log 2024-05-30T17:08:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39682.log 2024-05-30T17:08:19.897 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36780.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36780.log.gz 2024-05-30T17:08:19.900 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41050.log 2024-05-30T17:08:19.901 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39682.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39682.log.gz 2024-05-30T17:08:19.903 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53678.log 2024-05-30T17:08:19.905 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41050.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41050.log.gz 2024-05-30T17:08:19.907 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37599.log 2024-05-30T17:08:19.909 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53678.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53678.log.gz 2024-05-30T17:08:19.911 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50213.log 2024-05-30T17:08:19.913 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37599.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37599.log.gz 2024-05-30T17:08:19.915 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38428.log 2024-05-30T17:08:19.917 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50213.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50213.log.gz 2024-05-30T17:08:19.921 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38428.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.38428.log.gz 2024-05-30T17:08:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33210.log 2024-05-30T17:08:19.927 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37495.log 2024-05-30T17:08:19.929 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33210.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33210.log.gz 2024-05-30T17:08:19.931 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53182.log 2024-05-30T17:08:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37495.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37495.log.gz 2024-05-30T17:08:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36702.log 2024-05-30T17:08:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53182.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53182.log.gz 2024-05-30T17:08:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36806.log 2024-05-30T17:08:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36702.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36702.log.gz 2024-05-30T17:08:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41154.log 2024-05-30T17:08:19.945 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36806.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36806.log.gz 2024-05-30T17:08:19.947 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49382.log 2024-05-30T17:08:19.949 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41154.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41154.log.gz 2024-05-30T17:08:19.951 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48164.log 2024-05-30T17:08:19.953 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49382.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49382.log.gz 2024-05-30T17:08:19.957 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48164.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48164.log.gz 2024-05-30T17:08:19.959 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50318.log 2024-05-30T17:08:19.963 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37547.log 2024-05-30T17:08:19.965 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50318.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50318.log.gz 2024-05-30T17:08:19.967 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51909.log 2024-05-30T17:08:19.969 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37547.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37547.log.gz 2024-05-30T17:08:19.972 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53081.log 2024-05-30T17:08:19.973 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51909.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51909.log.gz 2024-05-30T17:08:19.976 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43455.log 2024-05-30T17:08:19.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53081.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53081.log.gz 2024-05-30T17:08:19.979 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50529.log 2024-05-30T17:08:19.981 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43455.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.43455.log.gz 2024-05-30T17:08:19.983 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43090.log 2024-05-30T17:08:19.985 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50529.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50529.log.gz 2024-05-30T17:08:19.989 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43090.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43090.log.gz 2024-05-30T17:08:19.991 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36477.log 2024-05-30T17:08:19.995 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36342.log 2024-05-30T17:08:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36477.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36477.log.gz 2024-05-30T17:08:20.005 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34714.log 2024-05-30T17:08:20.006 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36342.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36342.log.gz 2024-05-30T17:08:20.008 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41529.log 2024-05-30T17:08:20.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34714.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34714.log.gz 2024-05-30T17:08:20.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41529.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41529.log.gz 2024-05-30T17:08:20.013 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45870.log 2024-05-30T17:08:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47261.log 2024-05-30T17:08:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45870.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45870.log.gz 2024-05-30T17:08:20.024 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43151.log 2024-05-30T17:08:20.025 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47261.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47261.log.gz 2024-05-30T17:08:20.026 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43151.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43151.log.gz 2024-05-30T17:08:20.031 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41635.log 2024-05-30T17:08:20.036 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47105.log 2024-05-30T17:08:20.037 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41635.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41635.log.gz 2024-05-30T17:08:20.039 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42030.log 2024-05-30T17:08:20.041 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47105.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47105.log.gz 2024-05-30T17:08:20.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42750.log 2024-05-30T17:08:20.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39891.log 2024-05-30T17:08:20.045 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42030.log.gz 2024-05-30T17:08:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42750.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42750.log.gz/var/log/ceph/ceph-client.admin.39891.log: 2024-05-30T17:08:20.049 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50451.log 2024-05-30T17:08:20.055 INFO:teuthology.orchestra.run.smithi059.stderr: 91.6%gzip/var/log/ceph/ceph-client.admin.50451.log: -- replaced with /var/log/ceph/ceph-client.admin.39891.log.gz 2024-05-30T17:08:20.055 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53286.log 2024-05-30T17:08:20.056 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50451.log.gz 2024-05-30T17:08:20.056 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40216.log 2024-05-30T17:08:20.063 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53286.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53286.log.gz 2024-05-30T17:08:20.064 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36238.log 2024-05-30T17:08:20.065 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40216.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40216.log.gz 2024-05-30T17:08:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48341.log 2024-05-30T17:08:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36238.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36238.log.gz 2024-05-30T17:08:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36212.log 2024-05-30T17:08:20.073 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48341.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48341.log.gz 2024-05-30T17:08:20.075 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50928.log 2024-05-30T17:08:20.077 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36212.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36212.log.gz 2024-05-30T17:08:20.081 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50928.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50928.log.gz 2024-05-30T17:08:20.083 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28032.log 2024-05-30T17:08:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45109.log 2024-05-30T17:08:20.089 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.28032.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28032.log.gz 2024-05-30T17:08:20.093 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45109.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45109.log.gz 2024-05-30T17:08:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38375.log 2024-05-30T17:08:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39734.log 2024-05-30T17:08:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38375.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38375.log.gz 2024-05-30T17:08:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37352.log 2024-05-30T17:08:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39734.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39734.log.gz 2024-05-30T17:08:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45265.log 2024-05-30T17:08:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37352.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37352.log.gz 2024-05-30T17:08:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36264.log 2024-05-30T17:08:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45265.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45265.log.gz 2024-05-30T17:08:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35176.log 2024-05-30T17:08:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36264.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36264.log.gz 2024-05-30T17:08:20.119 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49568.log 2024-05-30T17:08:20.121 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35176.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35176.log.gz 2024-05-30T17:08:20.125 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49568.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49568.log.gz 2024-05-30T17:08:20.127 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46193.log 2024-05-30T17:08:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52898.log 2024-05-30T17:08:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46193.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46193.log.gz 2024-05-30T17:08:20.135 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36316.log 2024-05-30T17:08:20.137 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52898.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.52898.log.gz 2024-05-30T17:08:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51332.log 2024-05-30T17:08:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36316.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36316.log.gz 2024-05-30T17:08:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49238.log 2024-05-30T17:08:20.145 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51332.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51332.log.gz 2024-05-30T17:08:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38639.log 2024-05-30T17:08:20.149 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49238.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49238.log.gz 2024-05-30T17:08:20.151 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49516.log 2024-05-30T17:08:20.153 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38639.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38639.log.gz 2024-05-30T17:08:20.155 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50675.log 2024-05-30T17:08:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49516.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49516.log.gz 2024-05-30T17:08:20.161 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50675.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50675.log.gz 2024-05-30T17:08:20.163 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45714.log 2024-05-30T17:08:20.167 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46303.log 2024-05-30T17:08:20.169 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45714.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45714.log.gz 2024-05-30T17:08:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50902.log 2024-05-30T17:08:20.173 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46303.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46303.log.gz 2024-05-30T17:08:20.175 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41661.log 2024-05-30T17:08:20.177 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50902.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50902.log.gz 2024-05-30T17:08:20.181 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41661.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41661.log.gz 2024-05-30T17:08:20.181 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46076.log 2024-05-30T17:08:20.182 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40097.log 2024-05-30T17:08:20.188 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.46076.log: /var/log/ceph/ceph-client.admin.46407.log 2024-05-30T17:08:20.188 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46076.log.gz 2024-05-30T17:08:20.189 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40097.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40097.log.gz 2024-05-30T17:08:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46407.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46407.log.gz 2024-05-30T17:08:20.195 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34466.log 2024-05-30T17:08:20.199 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38993.log 2024-05-30T17:08:20.201 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34466.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34466.log.gz 2024-05-30T17:08:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43012.log 2024-05-30T17:08:20.205 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38993.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38993.log.gz 2024-05-30T17:08:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38219.log 2024-05-30T17:08:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43012.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43012.log.gz 2024-05-30T17:08:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35346.log 2024-05-30T17:08:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38219.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38219.log.gz 2024-05-30T17:08:20.215 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52871.log 2024-05-30T17:08:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35346.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35346.log.gz 2024-05-30T17:08:20.219 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44755.log 2024-05-30T17:08:20.221 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52871.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.52871.log.gz 2024-05-30T17:08:20.225 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44755.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44755.log.gz 2024-05-30T17:08:20.225 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40868.log 2024-05-30T17:08:20.226 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52637.log 2024-05-30T17:08:20.232 INFO:teuthology.orchestra.run.smithi059.stderr:gzip/var/log/ceph/ceph-client.admin.40868.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44901.log 2024-05-30T17:08:20.232 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40868.log.gz 2024-05-30T17:08:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52637.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52637.log.gz 2024-05-30T17:08:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44901.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44901.log.gz 2024-05-30T17:08:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53418.log 2024-05-30T17:08:20.238 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37469.log 2024-05-30T17:08:20.247 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53418.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53418.log.gz 2024-05-30T17:08:20.247 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37469.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37469.log.gz 2024-05-30T17:08:20.247 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47927.log 2024-05-30T17:08:20.252 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46277.log 2024-05-30T17:08:20.253 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47927.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47927.log.gz 2024-05-30T17:08:20.256 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32814.log 2024-05-30T17:08:20.257 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46277.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46277.log.gz 2024-05-30T17:08:20.259 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38837.log 2024-05-30T17:08:20.261 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32814.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32814.log.gz 2024-05-30T17:08:20.264 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39865.log 2024-05-30T17:08:20.265 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38837.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38837.log.gz 2024-05-30T17:08:20.267 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33505.log 2024-05-30T17:08:20.269 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39865.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39865.log.gz 2024-05-30T17:08:20.271 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42932.log 2024-05-30T17:08:20.273 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33505.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33505.log.gz 2024-05-30T17:08:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43918.log 2024-05-30T17:08:20.277 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42932.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42932.log.gz 2024-05-30T17:08:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43918.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43918.log.gz 2024-05-30T17:08:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44875.log 2024-05-30T17:08:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-30T17:08:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44875.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44875.log.gz 2024-05-30T17:08:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47695.log 2024-05-30T17:08:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41406.log 2024-05-30T17:08:20.297 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47695.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47695.log.gz 2024-05-30T17:08:20.301 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41406.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41406.log.gz 2024-05-30T17:08:20.301 INFO:teuthology.orchestra.run.smithi059.stderr: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-30T17:08:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42160.log 2024-05-30T17:08:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37805.log 2024-05-30T17:08:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42160.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42160.log.gz 2024-05-30T17:08:20.311 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45447.log 2024-05-30T17:08:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37805.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37805.log.gz 2024-05-30T17:08:20.317 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45447.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45447.log.gz 2024-05-30T17:08:20.319 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47747.log 2024-05-30T17:08:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32970.log 2024-05-30T17:08:20.325 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47747.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47747.log.gz 2024-05-30T17:08:20.327 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2024-05-30T17:08:20.329 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32970.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32970.log.gz 2024-05-30T17:08:20.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42523.log 2024-05-30T17:08:20.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46154.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2024-05-30T17:08:20.336 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36929.log 2024-05-30T17:08:20.337 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42523.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42523.log.gz 2024-05-30T17:08:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40699.log 2024-05-30T17:08:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36929.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36929.log.gz 2024-05-30T17:08:20.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34771.log 2024-05-30T17:08:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40699.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40699.log.gz 2024-05-30T17:08:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44599.log 2024-05-30T17:08:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34771.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34771.log.gz 2024-05-30T17:08:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44599.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44599.log.gz 2024-05-30T17:08:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35266.log 2024-05-30T17:08:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42549.log 2024-05-30T17:08:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35266.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35266.log.gz 2024-05-30T17:08:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42549.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42549.log.gz 2024-05-30T17:08:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40484.log 2024-05-30T17:08:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36012.log 2024-05-30T17:08:20.373 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40484.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40484.log.gz 2024-05-30T17:08:20.376 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33236.log 2024-05-30T17:08:20.377 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36012.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36012.log.gz 2024-05-30T17:08:20.380 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36633.log 2024-05-30T17:08:20.381 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33236.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33236.log.gz 2024-05-30T17:08:20.385 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36633.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36633.log.gz 2024-05-30T17:08:20.387 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37915.log 2024-05-30T17:08:20.391 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52558.log 2024-05-30T17:08:20.393 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53260.log 2024-05-30T17:08:20.393 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37915.log.gz 2024-05-30T17:08:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52558.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52558.log.gz 2024-05-30T17:08:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40536.log 2024-05-30T17:08:20.396 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45946.log 2024-05-30T17:08:20.397 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53260.log.gz 2024-05-30T17:08:20.399 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45946.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45946.log.gz 2024-05-30T17:08:20.406 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40536.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40536.log.gz 2024-05-30T17:08:20.407 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34602.log 2024-05-30T17:08:20.407 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39222.log 2024-05-30T17:08:20.412 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34602.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42212.log 2024-05-30T17:08:20.413 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39222.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39222.log.gz 2024-05-30T17:08:20.415 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34602.log.gz 2024-05-30T17:08:20.415 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49108.log 2024-05-30T17:08:20.416 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33718.log 2024-05-30T17:08:20.417 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42212.log.gz 2024-05-30T17:08:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49108.log: /var/log/ceph/ceph-client.admin.33718.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49108.log.gz 2024-05-30T17:08:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38167.log 2024-05-30T17:08:20.427 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33718.log.gz 2024-05-30T17:08:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48395.log 2024-05-30T17:08:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35727.log 2024-05-30T17:08:20.429 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38167.log.gz 2024-05-30T17:08:20.435 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48395.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48395.log.gz 2024-05-30T17:08:20.437 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35727.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35727.log.gz 2024-05-30T17:08:20.437 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33964.log 2024-05-30T17:08:20.439 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39941.log 2024-05-30T17:08:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45395.log 2024-05-30T17:08:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53156.log 2024-05-30T17:08:20.445 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39941.log.gz 2024-05-30T17:08:20.447 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45395.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33964.log.gz 2024-05-30T17:08:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48699.log 2024-05-30T17:08:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53156.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45395.log.gz 2024-05-30T17:08:20.449 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53156.log.gz 2024-05-30T17:08:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42082.log 2024-05-30T17:08:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48699.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48699.log.gz 2024-05-30T17:08:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35066.log 2024-05-30T17:08:20.461 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42082.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42082.log.gz 2024-05-30T17:08:20.463 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49969.log 2024-05-30T17:08:20.465 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35066.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35066.log.gz 2024-05-30T17:08:20.467 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33731.log 2024-05-30T17:08:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49969.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49969.log.gz 2024-05-30T17:08:20.473 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33731.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33731.log.gz 2024-05-30T17:08:20.475 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37439.log 2024-05-30T17:08:20.480 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46722.log 2024-05-30T17:08:20.481 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37439.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37439.log.gz 2024-05-30T17:08:20.483 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40787.log 2024-05-30T17:08:20.485 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46722.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46722.log.gz 2024-05-30T17:08:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50779.log 2024-05-30T17:08:20.489 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40787.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40787.log.gz 2024-05-30T17:08:20.491 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46827.log 2024-05-30T17:08:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50779.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50779.log.gz 2024-05-30T17:08:20.495 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39021.log 2024-05-30T17:08:20.497 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46827.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46827.log.gz 2024-05-30T17:08:20.499 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33314.log 2024-05-30T17:08:20.501 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39021.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39021.log.gz 2024-05-30T17:08:20.505 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33314.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33314.log.gz 2024-05-30T17:08:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48978.log 2024-05-30T17:08:20.511 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46775.log 2024-05-30T17:08:20.513 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48978.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48978.log.gz 2024-05-30T17:08:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46775.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46775.log.gz 2024-05-30T17:08:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45636.log 2024-05-30T17:08:20.519 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51306.log 2024-05-30T17:08:20.523 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45636.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45636.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44573.log 2024-05-30T17:08:20.524 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-05-30T17:08:20.525 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52663.log 2024-05-30T17:08:20.525 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51306.log.gz 2024-05-30T17:08:20.529 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52663.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52663.log.gz 2024-05-30T17:08:20.529 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45844.log 2024-05-30T17:08:20.533 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44573.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44573.log.gz 2024-05-30T17:08:20.535 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39248.log 2024-05-30T17:08:20.537 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45844.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45844.log.gz 2024-05-30T17:08:20.539 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51467.log 2024-05-30T17:08:20.541 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39248.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39248.log.gz 2024-05-30T17:08:20.545 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51467.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51467.log.gz 2024-05-30T17:08:20.547 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38271.log 2024-05-30T17:08:20.552 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44651.log 2024-05-30T17:08:20.553 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38271.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38271.log.gz 2024-05-30T17:08:20.555 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33418.log 2024-05-30T17:08:20.557 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44651.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44651.log.gz 2024-05-30T17:08:20.559 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41102.log 2024-05-30T17:08:20.561 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33418.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33418.log.gz 2024-05-30T17:08:20.565 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41102.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41102.log.gz 2024-05-30T17:08:20.565 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52346.log 2024-05-30T17:08:20.567 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53574.log 2024-05-30T17:08:20.572 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51388.log 2024-05-30T17:08:20.573 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53574.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53574.log.gz 2024-05-30T17:08:20.574 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51388.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51388.log.gz 2024-05-30T17:08:20.575 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49434.log 2024-05-30T17:08:20.575 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52346.log.gz 2024-05-30T17:08:20.581 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49434.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49434.log.gz 2024-05-30T17:08:20.583 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50623.log 2024-05-30T17:08:20.584 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51883.log 2024-05-30T17:08:20.586 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50623.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50623.log.gz 2024-05-30T17:08:20.588 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39708.log 2024-05-30T17:08:20.589 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51883.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51883.log.gz 2024-05-30T17:08:20.591 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35292.log 2024-05-30T17:08:20.593 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39708.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39708.log.gz 2024-05-30T17:08:20.595 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32996.log 2024-05-30T17:08:20.597 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35292.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35292.log.gz 2024-05-30T17:08:20.600 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37993.log 2024-05-30T17:08:20.601 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32996.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32996.log.gz 2024-05-30T17:08:20.603 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46128.log 2024-05-30T17:08:20.605 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37993.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37993.log.gz 2024-05-30T17:08:20.609 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46128.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46128.log.gz 2024-05-30T17:08:20.611 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33366.log 2024-05-30T17:08:20.616 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42986.log 2024-05-30T17:08:20.617 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33366.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33366.log.gz 2024-05-30T17:08:20.619 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36128.log 2024-05-30T17:08:20.621 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42986.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42986.log.gz 2024-05-30T17:08:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44155.log 2024-05-30T17:08:20.625 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36128.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36128.log.gz 2024-05-30T17:08:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34068.log 2024-05-30T17:08:20.629 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44155.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44155.log.gz 2024-05-30T17:08:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45031.log 2024-05-30T17:08:20.633 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34068.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34068.log.gz 2024-05-30T17:08:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51571.log 2024-05-30T17:08:20.637 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45031.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45031.log.gz 2024-05-30T17:08:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47209.log 2024-05-30T17:08:20.641 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51571.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51571.log.gz 2024-05-30T17:08:20.645 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47209.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47209.log.gz 2024-05-30T17:08:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33522.log 2024-05-30T17:08:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39574.log 2024-05-30T17:08:20.653 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33522.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33522.log.gz 2024-05-30T17:08:20.655 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40946.log 2024-05-30T17:08:20.657 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39574.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39574.log.gz 2024-05-30T17:08:20.659 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41922.log 2024-05-30T17:08:20.661 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40946.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40946.log.gz 2024-05-30T17:08:20.663 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52691.log 2024-05-30T17:08:20.665 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41922.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41922.log.gz 2024-05-30T17:08:20.667 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42316.log 2024-05-30T17:08:20.669 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52691.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52691.log.gz 2024-05-30T17:08:20.671 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44181.log 2024-05-30T17:08:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42316.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42316.log.gz 2024-05-30T17:08:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44181.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44181.log.gz 2024-05-30T17:08:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38083.log 2024-05-30T17:08:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44817.log 2024-05-30T17:08:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38083.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38083.log.gz 2024-05-30T17:08:20.687 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43308.log 2024-05-30T17:08:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44817.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44817.log.gz 2024-05-30T17:08:20.690 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39379.log 2024-05-30T17:08:20.692 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43308.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43308.log.gz 2024-05-30T17:08:20.695 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39144.log 2024-05-30T17:08:20.697 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39379.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39379.log.gz 2024-05-30T17:08:20.700 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37113.log 2024-05-30T17:08:20.701 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39144.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39144.log.gz 2024-05-30T17:08:20.703 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36038.log 2024-05-30T17:08:20.705 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37113.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37113.log.gz 2024-05-30T17:08:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36038.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36038.log.gz 2024-05-30T17:08:20.711 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49853.log 2024-05-30T17:08:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48085.log 2024-05-30T17:08:20.713 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33732.log 2024-05-30T17:08:20.714 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49853.log.gz 2024-05-30T17:08:20.719 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48085.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48085.log.gz 2024-05-30T17:08:20.720 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51857.log 2024-05-30T17:08:20.722 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33732.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33732.log.gz 2024-05-30T17:08:20.725 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51857.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51857.log.gz 2024-05-30T17:08:20.727 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41234.log 2024-05-30T17:08:20.732 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43423.log 2024-05-30T17:08:20.733 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52372.log 2024-05-30T17:08:20.733 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41234.log.gz 2024-05-30T17:08:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43423.log: /var/log/ceph/ceph-client.admin.52372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45532.log 2024-05-30T17:08:20.739 INFO:teuthology.orchestra.run.smithi059.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.43423.log.gz 2024-05-30T17:08:20.741 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45532.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45532.log.gz 2024-05-30T17:08:20.741 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43944.log 2024-05-30T17:08:20.744 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52372.log.gz 2024-05-30T17:08:20.747 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37521.log 2024-05-30T17:08:20.749 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43944.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43944.log.gz 2024-05-30T17:08:20.753 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37521.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37521.log.gz 2024-05-30T17:08:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41024.log 2024-05-30T17:08:20.759 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50954.log 2024-05-30T17:08:20.761 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41024.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41024.log.gz 2024-05-30T17:08:20.763 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50555.log 2024-05-30T17:08:20.765 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50954.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50954.log.gz 2024-05-30T17:08:20.767 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42342.log 2024-05-30T17:08:20.769 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50555.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50555.log.gz 2024-05-30T17:08:20.771 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53496.log 2024-05-30T17:08:20.773 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42342.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42342.log.gz 2024-05-30T17:08:20.775 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48227.log 2024-05-30T17:08:20.777 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53496.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53496.log.gz 2024-05-30T17:08:20.781 INFO:teuthology.orchestra.run.smithi059.stderr: 96.5%/var/log/ceph/ceph-client.admin.48227.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48227.log.gz 2024-05-30T17:08:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39522.log 2024-05-30T17:08:20.782 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.0.46002.log.gz 2024-05-30T17:08:20.783 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-30T17:08:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39522.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39522.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-30T17:08:20.788 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-05-30T17:08:20.795 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.audit.log: gzip/var/log/ceph/ceph-mds.c.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41458.log 2024-05-30T17:08:20.796 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38109.log 2024-05-30T17:08:20.797 INFO:teuthology.orchestra.run.smithi059.stderr: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-30T17:08:20.800 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36754.log 2024-05-30T17:08:20.803 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38109.log: 88.0%/var/log/ceph/ceph-client.admin.36754.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41458.log.gz 2024-05-30T17:08:20.807 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -- replaced with /var/log/ceph/ceph-client.admin.38109.log.gz -5 2024-05-30T17:08:20.807 INFO:teuthology.orchestra.run.smithi059.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39786.log 2024-05-30T17:08:20.807 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36754.log.gz 2024-05-30T17:08:20.811 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46643.log 2024-05-30T17:08:20.813 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39786.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39786.log.gz 2024-05-30T17:08:20.815 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38717.log 2024-05-30T17:08:20.817 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46643.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46643.log.gz 2024-05-30T17:08:20.819 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39839.log 2024-05-30T17:08:20.821 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38717.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38717.log.gz 2024-05-30T17:08:20.823 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52476.log 2024-05-30T17:08:20.825 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39839.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39839.log.gz 2024-05-30T17:08:20.827 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34149.log 2024-05-30T17:08:20.829 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52476.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52476.log.gz 2024-05-30T17:08:20.831 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35541.log 2024-05-30T17:08:20.833 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34149.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34149.log.gz 2024-05-30T17:08:20.835 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-30T17:08:20.837 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35541.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35541.log.gz 2024-05-30T17:08:20.843 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47825.log 2024-05-30T17:08:20.847 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49082.log 2024-05-30T17:08:20.849 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47825.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47825.log.gz 2024-05-30T17:08:20.851 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38349.log 2024-05-30T17:08:20.853 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49082.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49082.log.gz 2024-05-30T17:08:20.857 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38349.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38349.log.gz 2024-05-30T17:08:20.859 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52717.log 2024-05-30T17:08:20.864 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34016.log 2024-05-30T17:08:20.865 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52717.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52717.log.gz 2024-05-30T17:08:20.867 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38535.log 2024-05-30T17:08:20.869 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34016.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34016.log.gz 2024-05-30T17:08:20.873 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38535.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38535.log.gz 2024-05-30T17:08:20.873 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43203.log 2024-05-30T17:08:20.880 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37967.log 2024-05-30T17:08:20.881 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43203.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43203.log.gz 2024-05-30T17:08:20.884 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39431.log 2024-05-30T17:08:20.885 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37967.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37967.log.gz 2024-05-30T17:08:20.889 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39431.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39431.log.gz 2024-05-30T17:08:20.891 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44287.log 2024-05-30T17:08:20.896 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52028.log 2024-05-30T17:08:20.897 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44287.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44287.log.gz 2024-05-30T17:08:20.899 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52976.log 2024-05-30T17:08:20.901 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52028.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52028.log.gz 2024-05-30T17:08:20.903 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38401.log 2024-05-30T17:08:20.905 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52976.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.52976.log.gz 2024-05-30T17:08:20.906 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38401.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38401.log.gz 2024-05-30T17:08:20.911 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48525.log 2024-05-30T17:08:20.915 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2024-05-30T17:08:20.917 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44521.log 2024-05-30T17:08:20.918 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48525.log.gz 2024-05-30T17:08:20.919 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50079.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42475.log 2024-05-30T17:08:20.923 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44521.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2024-05-30T17:08:20.923 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44521.log.gz 2024-05-30T17:08:20.924 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33106.log 2024-05-30T17:08:20.928 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.42475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40045.log 2024-05-30T17:08:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33106.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33106.log.gz 2024-05-30T17:08:20.933 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40045.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47287.log 2024-05-30T17:08:20.934 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40045.log.gz 2024-05-30T17:08:20.941 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47287.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47287.log.gz 2024-05-30T17:08:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50265.log 2024-05-30T17:08:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38769.log 2024-05-30T17:08:20.949 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50265.log: /var/log/ceph/ceph-client.admin.38769.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38769.log.gz 2024-05-30T17:08:20.952 INFO:teuthology.orchestra.run.smithi059.stderr: 90.4% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50265.log.gz 2024-05-30T17:08:20.952 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50373.log 2024-05-30T17:08:20.955 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-30T17:08:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48777.log 2024-05-30T17:08:20.957 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33912.log 2024-05-30T17:08:20.957 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50373.log.gz 2024-05-30T17:08:20.960 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42906.log 2024-05-30T17:08:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33912.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48777.log.gz 2024-05-30T17:08:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42906.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42906.log.gz 2024-05-30T17:08:20.967 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33912.log.gz 2024-05-30T17:08:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41772.log 2024-05-30T17:08:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41432.log 2024-05-30T17:08:20.973 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41772.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41772.log.gz 2024-05-30T17:08:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35960.log 2024-05-30T17:08:20.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41432.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41432.log.gz 2024-05-30T17:08:20.980 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46696.log 2024-05-30T17:08:20.981 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35960.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35960.log.gz 2024-05-30T17:08:20.983 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50399.log 2024-05-30T17:08:20.985 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46696.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46696.log.gz 2024-05-30T17:08:20.987 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37087.log 2024-05-30T17:08:20.989 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50399.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50399.log.gz 2024-05-30T17:08:20.991 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37573.log 2024-05-30T17:08:20.993 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37087.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37087.log.gz 2024-05-30T17:08:20.996 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38743.log 2024-05-30T17:08:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37573.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37573.log.gz 2024-05-30T17:08:21.000 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35478.log 2024-05-30T17:08:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38743.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38743.log.gz 2024-05-30T17:08:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36529.log 2024-05-30T17:08:21.005 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35478.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35478.log.gz 2024-05-30T17:08:21.007 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33523.log 2024-05-30T17:08:21.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36529.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36529.log.gz 2024-05-30T17:08:21.011 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53340.log 2024-05-30T17:08:21.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33523.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33523.log.gz 2024-05-30T17:08:21.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53340.log: 96.5% -- replaced with /var/log/ceph/ceph-client.0.51783.log.gz 2024-05-30T17:08:21.017 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53340.log.gz 2024-05-30T17:08:21.019 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34801.log 2024-05-30T17:08:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48447.log 2024-05-30T17:08:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34801.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34801.log.gz 2024-05-30T17:08:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40894.log 2024-05-30T17:08:21.029 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48447.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48447.log.gz 2024-05-30T17:08:21.033 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40894.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40894.log.gz 2024-05-30T17:08:21.033 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48952.log 2024-05-30T17:08:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46999.log 2024-05-30T17:08:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48952.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48952.log.gz 2024-05-30T17:08:21.044 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49347.log 2024-05-30T17:08:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46999.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46999.log.gz 2024-05-30T17:08:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49347.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49347.log.gz 2024-05-30T17:08:21.051 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37296.log 2024-05-30T17:08:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46801.log 2024-05-30T17:08:21.057 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37296.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37296.log.gz 2024-05-30T17:08:21.061 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45506.log/var/log/ceph/ceph-client.admin.46801.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46801.log.gz 2024-05-30T17:08:21.063 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-05-30T17:08:21.068 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45558.log 2024-05-30T17:08:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45506.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45506.log.gz 2024-05-30T17:08:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37035.log 2024-05-30T17:08:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45558.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45558.log.gz 2024-05-30T17:08:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37035.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37035.log.gz 2024-05-30T17:08:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33723.log 2024-05-30T17:08:21.084 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44781.log 2024-05-30T17:08:21.085 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33723.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33723.log.gz 2024-05-30T17:08:21.089 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5/var/log/ceph/ceph-client.admin.44781.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44781.log.gz 2024-05-30T17:08:21.091 INFO:teuthology.orchestra.run.smithi059.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50591.log 2024-05-30T17:08:21.096 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44625.log 2024-05-30T17:08:21.097 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50591.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50591.log.gz 2024-05-30T17:08:21.100 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46355.log 2024-05-30T17:08:21.101 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44625.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44625.log.gz 2024-05-30T17:08:21.104 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45688.log 2024-05-30T17:08:21.109 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46355.log: 87.4%gzip -5 --verbose --/var/log/ceph/ceph-client.admin.45688.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45688.log.gz 2024-05-30T17:08:21.111 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46355.log.gz /var/log/ceph/ceph-client.admin.37729.log 2024-05-30T17:08:21.111 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-05-30T17:08:21.117 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37729.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37729.log.gz 2024-05-30T17:08:21.117 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34828.log 2024-05-30T17:08:21.119 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42238.log 2024-05-30T17:08:21.124 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34828.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34828.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38483.log 2024-05-30T17:08:21.124 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-05-30T17:08:21.125 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42238.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42238.log.gz 2024-05-30T17:08:21.127 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48367.log 2024-05-30T17:08:21.129 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38483.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38483.log.gz 2024-05-30T17:08:21.133 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48367.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48367.log.gz 2024-05-30T17:08:21.135 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33716.log 2024-05-30T17:08:21.140 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33709.log 2024-05-30T17:08:21.141 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33716.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33716.log.gz 2024-05-30T17:08:21.144 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33022.log 2024-05-30T17:08:21.145 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33709.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33709.log.gz 2024-05-30T17:08:21.148 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44313.log 2024-05-30T17:08:21.149 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33022.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33022.log.gz 2024-05-30T17:08:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44313.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44313.log.gz 2024-05-30T17:08:21.155 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44417.log 2024-05-30T17:08:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44417.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44417.log.gz 2024-05-30T17:08:21.161 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33724.log 2024-05-30T17:08:21.164 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49995.log 2024-05-30T17:08:21.168 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27923.log 2024-05-30T17:08:21.169 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49995.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49995.log.gz 2024-05-30T17:08:21.171 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33724.log.gz 2024-05-30T17:08:21.173 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.27923.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27923.log.gz 2024-05-30T17:08:21.175 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2024-05-30T17:08:21.179 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49697.log 2024-05-30T17:08:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43814.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz 2024-05-30T17:08:21.183 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45239.log 2024-05-30T17:08:21.185 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49697.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49697.log.gz 2024-05-30T17:08:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43696.log 2024-05-30T17:08:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45239.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45239.log.gz 2024-05-30T17:08:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44391.log 2024-05-30T17:08:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43696.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43696.log.gz 2024-05-30T17:08:21.196 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36981.log 2024-05-30T17:08:21.197 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44391.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44391.log.gz 2024-05-30T17:08:21.201 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36981.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36981.log.gz 2024-05-30T17:08:21.203 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47521.log 2024-05-30T17:08:21.208 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34628.log 2024-05-30T17:08:21.209 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47521.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47521.log.gz 2024-05-30T17:08:21.212 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49464.log 2024-05-30T17:08:21.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34628.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34628.log.gz 2024-05-30T17:08:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49464.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49464.log.gz 2024-05-30T17:08:21.217 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53001.log 2024-05-30T17:08:21.221 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35372.log/var/log/ceph/ceph-client.admin.53001.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53001.log.gz 2024-05-30T17:08:21.222 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-05-30T17:08:21.228 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43970.log 2024-05-30T17:08:21.229 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35372.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35372.log.gz 2024-05-30T17:08:21.232 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33517.log 2024-05-30T17:08:21.233 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43970.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43970.log.gz 2024-05-30T17:08:21.237 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33517.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33517.log.gz 2024-05-30T17:08:21.237 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52610.log 2024-05-30T17:08:21.240 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39118.log 2024-05-30T17:08:21.241 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52610.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52610.log.gz 2024-05-30T17:08:21.245 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39118.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39118.log.gz 2024-05-30T17:08:21.247 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47877.log 2024-05-30T17:08:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37270.log 2024-05-30T17:08:21.254 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47877.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47877.log.gz 2024-05-30T17:08:21.256 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47313.log 2024-05-30T17:08:21.257 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37270.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37270.log.gz 2024-05-30T17:08:21.261 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47313.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47313.log.gz 2024-05-30T17:08:21.263 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53027.log 2024-05-30T17:08:21.268 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36832.log 2024-05-30T17:08:21.269 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53027.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.53027.log.gz 2024-05-30T17:08:21.272 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48725.log 2024-05-30T17:08:21.273 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36832.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36832.log.gz 2024-05-30T17:08:21.277 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48725.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48725.log.gz 2024-05-30T17:08:21.278 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33518.log 2024-05-30T17:08:21.285 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33518.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33518.log.gz 2024-05-30T17:08:21.285 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52530.log 2024-05-30T17:08:21.288 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34858.log 2024-05-30T17:08:21.289 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52530.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52530.log.gz 2024-05-30T17:08:21.292 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- 96.5% -- replaced with /var/log/ceph/ceph-client.0.47983.log.gz 2024-05-30T17:08:21.292 INFO:teuthology.orchestra.run.smithi059.stderr: /var/log/ceph/ceph-client.admin.47613.log 2024-05-30T17:08:21.293 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34858.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34858.log.gz 2024-05-30T17:08:21.293 INFO:teuthology.orchestra.run.smithi059.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.0.49753.log.gz 2024-05-30T17:08:21.295 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46329.log 2024-05-30T17:08:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47613.log: /var/log/ceph/ceph-client.admin.46329.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46329.log.gz 2024-05-30T17:08:21.299 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47613.log.gz 2024-05-30T17:08:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47079.log 2024-05-30T17:08:21.301 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41076.log 2024-05-30T17:08:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47079.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47079.log.gz 2024-05-30T17:08:21.304 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38141.log 2024-05-30T17:08:21.304 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41076.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41076.log.gz 2024-05-30T17:08:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50727.log 2024-05-30T17:08:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42368.log 2024-05-30T17:08:21.307 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38141.log.gz 2024-05-30T17:08:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50727.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50727.log.gz 2024-05-30T17:08:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47550.log 2024-05-30T17:08:21.313 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42368.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42368.log.gz 2024-05-30T17:08:21.314 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47550.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47550.log.gz 2024-05-30T17:08:21.315 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45298.log 2024-05-30T17:08:21.320 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53392.log 2024-05-30T17:08:21.321 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45298.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45298.log.gz 2024-05-30T17:08:21.324 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35567.log 2024-05-30T17:08:21.325 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53392.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53392.log.gz 2024-05-30T17:08:21.329 INFO:teuthology.orchestra.run.smithi059.stderr:gzip/var/log/ceph/ceph-client.admin.35567.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35567.log.gz 2024-05-30T17:08:21.331 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43892.log 2024-05-30T17:08:21.336 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47639.log 2024-05-30T17:08:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43892.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43892.log.gz 2024-05-30T17:08:21.340 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36858.log 2024-05-30T17:08:21.341 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47639.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47639.log.gz 2024-05-30T17:08:21.344 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44261.log 2024-05-30T17:08:21.345 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36858.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36858.log.gz 2024-05-30T17:08:21.349 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44261.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44261.log.gz 2024-05-30T17:08:21.351 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33524.log 2024-05-30T17:08:21.355 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33510.log 2024-05-30T17:08:21.357 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33524.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33524.log.gz 2024-05-30T17:08:21.359 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40840.log 2024-05-30T17:08:21.361 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33510.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33510.log.gz 2024-05-30T17:08:21.363 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42692.log 2024-05-30T17:08:21.368 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40840.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38245.log 2024-05-30T17:08:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42692.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42692.log.gz 2024-05-30T17:08:21.371 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40840.log.gz 2024-05-30T17:08:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38245.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38245.log.gz 2024-05-30T17:08:21.375 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43229.log 2024-05-30T17:08:21.379 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41581.log 2024-05-30T17:08:21.381 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43229.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43229.log.gz 2024-05-30T17:08:21.383 INFO:teuthology.orchestra.run.smithi059.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.0.39997.log.gz 2024-05-30T17:08:21.383 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43759.log 2024-05-30T17:08:21.385 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41581.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41581.log.gz 2024-05-30T17:08:21.387 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40242.log 2024-05-30T17:08:21.393 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43759.log: 88.6%/var/log/ceph/ceph-client.admin.40242.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40242.log.gz 2024-05-30T17:08:21.395 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43759.log.gz 2024-05-30T17:08:21.395 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51961.log 2024-05-30T17:08:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37677.log 2024-05-30T17:08:21.401 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51961.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51961.log.gz 2024-05-30T17:08:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50027.log 2024-05-30T17:08:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37677.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37677.log.gz 2024-05-30T17:08:21.407 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48881.log 2024-05-30T17:08:21.409 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50027.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50027.log.gz 2024-05-30T17:08:21.411 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47157.log 2024-05-30T17:08:21.413 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48881.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48881.log.gz 2024-05-30T17:08:21.415 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45213.log 2024-05-30T17:08:21.417 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47157.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47157.log.gz 2024-05-30T17:08:21.419 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44469.log 2024-05-30T17:08:21.421 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45213.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45213.log.gz 2024-05-30T17:08:21.424 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36425.log 2024-05-30T17:08:21.425 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44469.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44469.log.gz 2024-05-30T17:08:21.429 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36425.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36425.log.gz 2024-05-30T17:08:21.431 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37007.log 2024-05-30T17:08:21.435 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33720.log 2024-05-30T17:08:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37007.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37007.log.gz 2024-05-30T17:08:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52166.log 2024-05-30T17:08:21.441 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33720.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33720.log.gz 2024-05-30T17:08:21.444 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50425.log 2024-05-30T17:08:21.445 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52166.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52166.log.gz 2024-05-30T17:08:21.447 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48201.log 2024-05-30T17:08:21.449 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50425.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50425.log.gz 2024-05-30T17:08:21.451 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38863.log 2024-05-30T17:08:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48201.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48201.log.gz 2024-05-30T17:08:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32871.log 2024-05-30T17:08:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38863.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38863.log.gz 2024-05-30T17:08:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32871.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32871.log.gz 2024-05-30T17:08:21.463 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2024-05-30T17:08:21.467 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49931.log 2024-05-30T17:08:21.469 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43556.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz 2024-05-30T17:08:21.474 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52114.log 2024-05-30T17:08:21.475 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49931.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49931.log.gz 2024-05-30T17:08:21.475 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48112.log 2024-05-30T17:08:21.477 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52114.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52114.log.gz 2024-05-30T17:08:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41380.log 2024-05-30T17:08:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48112.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48112.log.gz 2024-05-30T17:08:21.483 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46537.log 2024-05-30T17:08:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41380.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41380.log.gz 2024-05-30T17:08:21.487 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40570.log 2024-05-30T17:08:21.489 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46537.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46537.log.gz 2024-05-30T17:08:21.491 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48603.log 2024-05-30T17:08:21.493 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40570.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40570.log.gz 2024-05-30T17:08:21.497 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48603.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48603.log.gz 2024-05-30T17:08:21.499 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48751.log 2024-05-30T17:08:21.504 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34576.log 2024-05-30T17:08:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48751.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48751.log.gz 2024-05-30T17:08:21.507 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45187.log 2024-05-30T17:08:21.509 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34576.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34576.log.gz 2024-05-30T17:08:21.510 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41713.log 2024-05-30T17:08:21.512 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45187.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45187.log.gz 2024-05-30T17:08:21.515 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47053.log 2024-05-30T17:08:21.517 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41713.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41713.log.gz 2024-05-30T17:08:21.519 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38691.log 2024-05-30T17:08:21.521 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47053.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47053.log.gz 2024-05-30T17:08:21.525 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38691.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38691.log.gz 2024-05-30T17:08:21.527 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42718.log 2024-05-30T17:08:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50503.log 2024-05-30T17:08:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42718.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42718.log.gz 2024-05-30T17:08:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35593.log 2024-05-30T17:08:21.537 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50503.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50503.log.gz 2024-05-30T17:08:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44129.log 2024-05-30T17:08:21.540 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35593.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35593.log.gz 2024-05-30T17:08:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49879.log 2024-05-30T17:08:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44129.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44129.log.gz 2024-05-30T17:08:21.547 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47469.log 2024-05-30T17:08:21.549 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49879.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49879.log.gz 2024-05-30T17:08:21.553 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47469.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47469.log.gz 2024-05-30T17:08:21.555 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52743.log 2024-05-30T17:08:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34492.log 2024-05-30T17:08:21.561 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52743.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52743.log.gz 2024-05-30T17:08:21.563 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48829.log 2024-05-30T17:08:21.565 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34492.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34492.log.gz 2024-05-30T17:08:21.566 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37625.log 2024-05-30T17:08:21.572 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48855.log 2024-05-30T17:08:21.572 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48829.log.gz 2024-05-30T17:08:21.573 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37625.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37625.log.gz 2024-05-30T17:08:21.575 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40458.log 2024-05-30T17:08:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48855.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48855.log.gz 2024-05-30T17:08:21.579 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33938.log 2024-05-30T17:08:21.583 INFO:teuthology.orchestra.run.smithi059.stderr:gzip/var/log/ceph/ceph-client.admin.33938.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46670.log 2024-05-30T17:08:21.583 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40458.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33938.log.gz 2024-05-30T17:08:21.583 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40458.log.gz 2024-05-30T17:08:21.588 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40761.log 2024-05-30T17:08:21.589 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46670.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46670.log.gz 2024-05-30T17:08:21.593 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40761.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40761.log.gz 2024-05-30T17:08:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36670.log 2024-05-30T17:08:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42134.log 2024-05-30T17:08:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36670.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36670.log.gz 2024-05-30T17:08:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51651.log 2024-05-30T17:08:21.605 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42134.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42134.log.gz 2024-05-30T17:08:21.606 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35424.log 2024-05-30T17:08:21.612 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51651.log: gzip -5 --verbose -- 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51651.log.gz 2024-05-30T17:08:21.612 INFO:teuthology.orchestra.run.smithi059.stderr: /var/log/ceph/ceph-client.admin.42828.log 2024-05-30T17:08:21.613 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35424.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35424.log.gz 2024-05-30T17:08:21.617 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42828.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42828.log.gz 2024-05-30T17:08:21.619 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39196.log 2024-05-30T17:08:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36154.log 2024-05-30T17:08:21.625 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39196.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39196.log.gz 2024-05-30T17:08:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43866.log 2024-05-30T17:08:21.629 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36154.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36154.log.gz 2024-05-30T17:08:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43840.log 2024-05-30T17:08:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43866.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43866.log.gz 2024-05-30T17:08:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45584.log 2024-05-30T17:08:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43840.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43840.log.gz 2024-05-30T17:08:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45584.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45584.log.gz 2024-05-30T17:08:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35320.log 2024-05-30T17:08:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35092.log 2024-05-30T17:08:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35320.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35320.log.gz 2024-05-30T17:08:21.651 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40352.log 2024-05-30T17:08:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35092.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35092.log.gz 2024-05-30T17:08:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35779.log 2024-05-30T17:08:21.657 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40352.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40352.log.gz 2024-05-30T17:08:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34745.log 2024-05-30T17:08:21.661 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35779.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35779.log.gz 2024-05-30T17:08:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34278.log 2024-05-30T17:08:21.664 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34745.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34745.log.gz 2024-05-30T17:08:21.667 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51493.log 2024-05-30T17:08:21.669 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.34278.log: 89.3% -- replaced with /var/log/ceph/ceph-client.0.34278.log.gz 2024-05-30T17:08:21.673 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51493.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51493.log.gz 2024-05-30T17:08:22.502 INFO:teuthology.orchestra.run.smithi059.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.0.42475.log.gz 2024-05-30T17:08:22.605 INFO:teuthology.orchestra.run.smithi107.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-30T17:08:23.200 INFO:teuthology.orchestra.run.smithi107.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-30T17:08:23.407 INFO:teuthology.orchestra.run.smithi059.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-30T17:08:23.825 INFO:teuthology.orchestra.run.smithi059.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.0.35912.log.gz 2024-05-30T17:08:24.220 INFO:teuthology.orchestra.run.smithi107.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-30T17:08:24.321 INFO:teuthology.orchestra.run.smithi107.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-30T17:08:24.540 INFO:teuthology.orchestra.run.smithi059.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-30T17:08:24.543 INFO:teuthology.orchestra.run.smithi059.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.0.37862.log.gz 2024-05-30T17:08:24.643 INFO:teuthology.orchestra.run.smithi107.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-30T17:08:24.695 INFO:teuthology.orchestra.run.smithi107.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-30T17:08:24.697 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-05-30T17:08:24.697 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m5.682s 2024-05-30T17:08:24.697 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m28.408s 2024-05-30T17:08:24.697 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m2.169s 2024-05-30T17:08:25.240 INFO:teuthology.orchestra.run.smithi059.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-30T17:08:25.393 INFO:teuthology.orchestra.run.smithi059.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-30T17:08:25.730 INFO:teuthology.orchestra.run.smithi059.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-30T17:08:25.748 INFO:teuthology.orchestra.run.smithi059.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-30T17:08:25.750 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-05-30T17:08:25.751 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m6.753s 2024-05-30T17:08:25.751 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m41.512s 2024-05-30T17:08:25.751 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m3.995s 2024-05-30T17:08:25.751 INFO:tasks.ceph:Archiving logs... 2024-05-30T17:08:25.751 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145/remote/smithi059/log 2024-05-30T17:08:25.753 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-30T17:08:29.335 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145/remote/smithi107/log 2024-05-30T17:08:29.335 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-30T17:08:32.237 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-30T17:08:32.246 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-30T17:08:32.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-30T17:08:32.250 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-30T17:08:32.336 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-30T17:08:32.345 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-30T17:08:32.345 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-30T17:08:32.348 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-30T17:08:32.360 INFO:teuthology.orchestra.run.smithi059.stdout: remote refid st t when poll reach delay offset jitter 2024-05-30T17:08:32.360 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================== 2024-05-30T17:08:32.360 INFO:teuthology.orchestra.run.smithi059.stdout:+hv01.front.sepi 67.205.162.81 3 u 18 128 377 0.112 -3.000 0.458 2024-05-30T17:08:32.361 INFO:teuthology.orchestra.run.smithi059.stdout:+hv02.front.sepi 63.231.80.2 3 u 8 128 377 0.089 -0.268 0.445 2024-05-30T17:08:32.361 INFO:teuthology.orchestra.run.smithi059.stdout:*hv03.front.sepi 74.6.168.72 3 u 131 128 377 0.079 -1.067 0.451 2024-05-30T17:08:32.361 INFO:teuthology.orchestra.run.smithi059.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-05-30T17:08:32.363 INFO:teuthology.orchestra.run.smithi107.stdout: remote refid st t when poll reach delay offset jitter 2024-05-30T17:08:32.363 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================== 2024-05-30T17:08:32.363 INFO:teuthology.orchestra.run.smithi107.stdout:+hv01.front.sepi 67.205.162.81 3 u 25 64 377 0.089 -5.044 0.535 2024-05-30T17:08:32.363 INFO:teuthology.orchestra.run.smithi107.stdout:+hv02.front.sepi 63.231.80.2 3 u 10 64 377 0.100 -1.982 0.355 2024-05-30T17:08:32.364 INFO:teuthology.orchestra.run.smithi107.stdout:*hv03.front.sepi 74.6.168.72 3 u 18 64 377 0.076 -2.566 0.394 2024-05-30T17:08:32.364 INFO:teuthology.orchestra.run.smithi107.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-05-30T17:08:32.365 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-30T17:08:32.373 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-30T17:08:32.373 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-30T17:08:32.381 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-30T17:08:32.457 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-30T17:08:32.511 INFO:teuthology.task.internal:Duration was 1873.484962 seconds 2024-05-30T17:08:32.512 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-30T17:08:32.520 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-30T17:08:32.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-30T17:08:32.524 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-30T17:08:32.632 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-30T17:08:32.632 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-05-30T17:08:32.632 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-30T17:08:32.653 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-05-30T17:08:32.653 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-30T17:08:32.673 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-30T17:08:32.674 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-30T17:08:32.697 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-30T17:08:32.756 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-30T17:08:32.756 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-30T17:08:32.789 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-30T17:08:32.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-30T17:08:32.901 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-30T17:08:32.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-30T17:08:32.922 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-30T17:08:32.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-30T17:08:32.952 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-30T17:08:32.965 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-30T17:08:32.980 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-05-30T17:08:33.003 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-05-30T17:08:33.021 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-30T17:08:33.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T17:08:33.049 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-30T17:08:33.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T17:08:33.069 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-30T17:08:33.078 INFO:teuthology.task.internal:Transferring archived files... 2024-05-30T17:08:33.079 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145/remote/smithi059 2024-05-30T17:08:33.079 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-30T17:08:33.117 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-30_16:11:34-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734145/remote/smithi107 2024-05-30T17:08:33.117 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-30T17:08:33.143 INFO:teuthology.task.internal:Removing archive directory... 2024-05-30T17:08:33.144 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-30T17:08:33.157 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-30T17:08:33.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-30T17:08:33.211 INFO:teuthology.task.internal:Not uploading archives. 2024-05-30T17:08:33.212 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-30T17:08:33.221 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-30T17:08:33.221 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-30T17:08:33.224 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-30T17:08:33.229 INFO:teuthology.orchestra.run.smithi059.stdout: 655467 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 30 17:08 /home/ubuntu/cephtest 2024-05-30T17:08:33.249 INFO:teuthology.orchestra.run.smithi107.stdout: 658119 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 30 17:08 /home/ubuntu/cephtest 2024-05-30T17:08:33.251 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-30T17:08:33.261 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-30T17:08:33.283 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} duration: 1873.4849615097046 failure_reason: 'Test failure: test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter)' flavor: default mon.a-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 mon.b-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=2bb5a2d3aa824bb488ae6820add211a1 status: fail success: false 2024-05-30T17:08:33.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-30T17:08:33.366 INFO:teuthology.run:FAIL